2023-11-28T19:43:12.702 INFO:root:teuthology version: 0.0.1.dev209+g5ae09a5 2023-11-28T19:43:12.702 DEBUG:teuthology.run:Teuthology command: teuthology --verbose --name vshankar-2023-11-28_06:29:14-fs-wip-vshankar-testing-20231127.102914-testing-default-smithi --archive /home/teuthworker/archive/vshankar-2023-11-28_06:29:14-fs-wip-vshankar-testing-20231127.102914-testing-default-smithi/7469593 --description fs/multifs/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-2c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore-ec/bluestore-comp-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down mon-debug} tasks/multifs-auth} --owner scheduled_vshankar@teuthology -- /home/teuthworker/archive/vshankar-2023-11-28_06:29:14-fs-wip-vshankar-testing-20231127.102914-testing-default-smithi/7469593/orig.config.yaml 2023-11-28T19:43:12.747 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-28T19:43:12.831 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/vshankar-2023-11-28_06:29:14-fs-wip-vshankar-testing-20231127.102914-testing-default-smithi/7469593 branch: wip-vshankar-testing-20231127.102914 description: fs/multifs/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-2c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore-ec/bluestore-comp-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down mon-debug} tasks/multifs-auth} email: vshankar@redhat.com first_in_suite: false job_id: '7469593' kernel: client: branch: testing flavor: default kdb: true sha1: 8247bbb5b470f7e2a1f3eefcc16e24cf1338f606 ktype: upstream last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi name: vshankar-2023-11-28_06:29:14-fs-wip-vshankar-testing-20231127.102914-testing-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: ubuntu os_version: '22.04' overrides: admin_socket: branch: wip-vshankar-testing-20231127.102914 ceph: cephfs: ec_profile: - m=2 - k=2 - crush-failure-domain=osd conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 rados mon op timeout: 900 rados osd op timeout: 900 global: ms die on skipped message: false mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon op complaint time: 120 osd: bluestore block size: 96636764160 bluestore compression mode: aggressive bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug ms: 1 debug osd: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - overall HEALTH_ - \(FS_DEGRADED\) - \(MDS_FAILED\) - \(MDS_DEGRADED\) - \(FS_WITH_FAILED_MDS\) - \(MDS_DAMAGE\) - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(FS_INLINE_DATA_DEPRECATED\) - \(POOL_APP_NOT_ENABLED\) - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding sha1: 43dd94c190073cf16cff1e711dd7f5a7b1cbc883 ceph-deploy: conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: osd default pool size: 2 install: ceph: flavor: default sha1: 43dd94c190073cf16cff1e711dd7f5a7b1cbc883 kclient: syntax: v2 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-vshankar-testing-20231127.102914 sha1: 43dd94c190073cf16cff1e711dd7f5a7b1cbc883 owner: scheduled_vshankar@teuthology priority: 150 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mgr.y - mds.a - mds.c - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - - mon.b - mon.c - mgr.x - mds.b - mds.d - osd.4 - osd.5 - osd.6 - osd.7 - client.1 seed: 8377 sha1: 43dd94c190073cf16cff1e711dd7f5a7b1cbc883 sleep_before_teardown: 0 subset: 462/1024 suite: fs suite_branch: wip-vshankar-testing-20231127.102914 suite_path: /home/teuthworker/src/git.ceph.com_ceph-c_43dd94c190073cf16cff1e711dd7f5a7b1cbc883/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph-ci.git suite_sha1: 43dd94c190073cf16cff1e711dd7f5a7b1cbc883 syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi078.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBH/BeLiF6FTEmVwv4xjOSLQMi1fcn6OhmXMNOPbYsX9UlDQVQgA3D8ZYxMasqYDlK9yyf4L2ZFq8uURMFenUqRM= smithi179.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBIR0Ew728ISPUwTPh1+symK9Vcl9MvI/7y0fWrxFmT3H1OOhgkayTfBUsQ3QNFFmaHkudSbzgGgjwY6jUo6/cjM= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - ceph: create_rbd_pool: false - kclient: null - cephfs_test_runner: fail_on_skip: false modules: - tasks.cephfs.test_multifs_auth teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return yaml.ktype == 'upstream' end - local function is_kdistro() return yaml.ktype == 'distro' end - local function is_fuse() return false end - local function syntax_version() return yaml.overrides.kclient.syntax end teuthology_branch: main teuthology_sha1: 5ae09a5cc7064ca2bf994df19f3006b79794789a timestamp: 2023-11-28_06:29:14 tube: smithi user: vshankar verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.232157 2023-11-28T19:43:12.831 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph-c_43dd94c190073cf16cff1e711dd7f5a7b1cbc883/qa; will attempt to use it 2023-11-28T19:43:12.832 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph-c_43dd94c190073cf16cff1e711dd7f5a7b1cbc883/qa/tasks 2023-11-28T19:43:12.832 INFO:teuthology.run_tasks:Running task internal.check_packages... 2023-11-28T19:43:12.833 INFO:teuthology.task.internal:Checking packages... 2023-11-28T19:43:12.857 INFO:teuthology.task.internal:Checking packages for os_type 'ubuntu', flavor 'default' and ceph hash '43dd94c190073cf16cff1e711dd7f5a7b1cbc883' 2023-11-28T19:43:12.857 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2023-11-28T19:43:12.857 INFO:teuthology.packaging:ref: None 2023-11-28T19:43:12.857 INFO:teuthology.packaging:tag: None 2023-11-28T19:43:12.857 INFO:teuthology.packaging:branch: wip-vshankar-testing-20231127.102914 2023-11-28T19:43:12.857 INFO:teuthology.packaging:sha1: 43dd94c190073cf16cff1e711dd7f5a7b1cbc883 2023-11-28T19:43:12.857 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&ref=wip-vshankar-testing-20231127.102914 2023-11-28T19:43:12.992 INFO:teuthology.task.internal:Found packages for ceph version 18.0.0-7520-g43dd94c1-1jammy 2023-11-28T19:43:12.992 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2023-11-28T19:43:12.999 INFO:teuthology.task.internal:no buildpackages task found 2023-11-28T19:43:12.999 INFO:teuthology.run_tasks:Running task internal.save_config... 2023-11-28T19:43:13.016 INFO:teuthology.task.internal:Saving configuration 2023-11-28T19:43:13.031 INFO:teuthology.run_tasks:Running task internal.check_lock... 2023-11-28T19:43:13.037 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-11-28T19:43:13.061 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi078.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vshankar-2023-11-28_06:29:14-fs-wip-vshankar-testing-20231127.102914-testing-default-smithi/7469593', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-11-28 19:37:39.621432', 'locked_by': 'scheduled_vshankar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIJh5CNCYinnGzPBMTLzizk2ZXGXpjlGxX8NQRf6mcMSK'} 2023-11-28T19:43:13.082 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi179.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vshankar-2023-11-28_06:29:14-fs-wip-vshankar-testing-20231127.102914-testing-default-smithi/7469593', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-11-28 19:37:39.619886', 'locked_by': 'scheduled_vshankar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIAjBTZI87xjnNHymMqaHBL4ZRatqoOMdGLGi+rBAfQ0S'} 2023-11-28T19:43:13.082 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2023-11-28T19:43:13.088 INFO:teuthology.task.internal:roles: ubuntu@smithi078.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0'] 2023-11-28T19:43:13.088 INFO:teuthology.task.internal:roles: ubuntu@smithi179.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1'] 2023-11-28T19:43:13.088 INFO:teuthology.run_tasks:Running task console_log... 2023-11-28T19:43:13.176 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f1641d090d0>, signals=[15]) 2023-11-28T19:43:13.176 INFO:teuthology.run_tasks:Running task internal.connect... 2023-11-28T19:43:13.182 INFO:teuthology.task.internal:Opening connections... 2023-11-28T19:43:13.183 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi078.front.sepia.ceph.com 2023-11-28T19:43:13.184 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi078.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-28T19:43:13.257 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi179.front.sepia.ceph.com 2023-11-28T19:43:13.258 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi179.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-28T19:43:13.333 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2023-11-28T19:43:13.341 DEBUG:teuthology.orchestra.run.smithi078:> uname -m 2023-11-28T19:43:13.347 INFO:teuthology.orchestra.run.smithi078.stdout:x86_64 2023-11-28T19:43:13.347 DEBUG:teuthology.orchestra.run.smithi078:> cat /etc/os-release 2023-11-28T19:43:13.391 INFO:teuthology.orchestra.run.smithi078.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2023-11-28T19:43:13.391 INFO:teuthology.orchestra.run.smithi078.stdout:NAME="Ubuntu" 2023-11-28T19:43:13.392 INFO:teuthology.orchestra.run.smithi078.stdout:VERSION_ID="22.04" 2023-11-28T19:43:13.392 INFO:teuthology.orchestra.run.smithi078.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2023-11-28T19:43:13.392 INFO:teuthology.orchestra.run.smithi078.stdout:VERSION_CODENAME=jammy 2023-11-28T19:43:13.392 INFO:teuthology.orchestra.run.smithi078.stdout:ID=ubuntu 2023-11-28T19:43:13.392 INFO:teuthology.orchestra.run.smithi078.stdout:ID_LIKE=debian 2023-11-28T19:43:13.392 INFO:teuthology.orchestra.run.smithi078.stdout:HOME_URL="https://www.ubuntu.com/" 2023-11-28T19:43:13.392 INFO:teuthology.orchestra.run.smithi078.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-11-28T19:43:13.392 INFO:teuthology.orchestra.run.smithi078.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-11-28T19:43:13.392 INFO:teuthology.orchestra.run.smithi078.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-11-28T19:43:13.392 INFO:teuthology.orchestra.run.smithi078.stdout:UBUNTU_CODENAME=jammy 2023-11-28T19:43:13.393 INFO:teuthology.lock.ops:Updating smithi078.front.sepia.ceph.com on lock server 2023-11-28T19:43:13.414 DEBUG:teuthology.orchestra.run.smithi179:> uname -m 2023-11-28T19:43:13.419 INFO:teuthology.orchestra.run.smithi179.stdout:x86_64 2023-11-28T19:43:13.419 DEBUG:teuthology.orchestra.run.smithi179:> cat /etc/os-release 2023-11-28T19:43:13.465 INFO:teuthology.orchestra.run.smithi179.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2023-11-28T19:43:13.465 INFO:teuthology.orchestra.run.smithi179.stdout:NAME="Ubuntu" 2023-11-28T19:43:13.465 INFO:teuthology.orchestra.run.smithi179.stdout:VERSION_ID="22.04" 2023-11-28T19:43:13.465 INFO:teuthology.orchestra.run.smithi179.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2023-11-28T19:43:13.465 INFO:teuthology.orchestra.run.smithi179.stdout:VERSION_CODENAME=jammy 2023-11-28T19:43:13.465 INFO:teuthology.orchestra.run.smithi179.stdout:ID=ubuntu 2023-11-28T19:43:13.465 INFO:teuthology.orchestra.run.smithi179.stdout:ID_LIKE=debian 2023-11-28T19:43:13.465 INFO:teuthology.orchestra.run.smithi179.stdout:HOME_URL="https://www.ubuntu.com/" 2023-11-28T19:43:13.466 INFO:teuthology.orchestra.run.smithi179.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-11-28T19:43:13.466 INFO:teuthology.orchestra.run.smithi179.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-11-28T19:43:13.466 INFO:teuthology.orchestra.run.smithi179.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-11-28T19:43:13.466 INFO:teuthology.orchestra.run.smithi179.stdout:UBUNTU_CODENAME=jammy 2023-11-28T19:43:13.466 INFO:teuthology.lock.ops:Updating smithi179.front.sepia.ceph.com on lock server 2023-11-28T19:43:13.489 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2023-11-28T19:43:13.498 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2023-11-28T19:43:13.504 INFO:teuthology.task.internal:Checking for old test directory... 2023-11-28T19:43:13.505 DEBUG:teuthology.orchestra.run.smithi078:> test '!' -e /home/ubuntu/cephtest 2023-11-28T19:43:13.507 DEBUG:teuthology.orchestra.run.smithi179:> test '!' -e /home/ubuntu/cephtest 2023-11-28T19:43:13.512 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2023-11-28T19:43:13.518 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2023-11-28T19:43:13.518 DEBUG:teuthology.orchestra.run.smithi078:> test -z $(ls -A /var/lib/ceph) 2023-11-28T19:43:13.553 DEBUG:teuthology.orchestra.run.smithi179:> test -z $(ls -A /var/lib/ceph) 2023-11-28T19:43:13.574 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2023-11-28T19:43:13.625 INFO:teuthology.run_tasks:Running task kernel... 2023-11-28T19:43:13.640 INFO:teuthology.task.kernel:normalize config orig: {'client': {'branch': 'testing'}, 'flavor': 'default', 'kdb': True, 'sha1': '8247bbb5b470f7e2a1f3eefcc16e24cf1338f606'} 2023-11-28T19:43:13.640 INFO:teuthology.task.kernel:normalize config final: {'client.0': {'branch': 'testing'}, 'client.1': {'branch': 'testing'}} 2023-11-28T19:43:13.640 INFO:teuthology.task.kernel:config {'client.0': {'branch': 'testing'}, 'client.1': {'branch': 'testing'}}, timeout 300 2023-11-28T19:43:13.640 DEBUG:teuthology.orchestra.run.smithi078:> test -f /run/.containerenv -o -f /.dockerenv 2023-11-28T19:43:13.641 DEBUG:teuthology.orchestra.run.smithi179:> test -f /run/.containerenv -o -f /.dockerenv 2023-11-28T19:43:13.645 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-28T19:43:13.646 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&ref=testing 2023-11-28T19:43:13.649 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-28T19:43:13.649 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&ref=testing 2023-11-28T19:43:13.838 DEBUG:teuthology.task.kernel:sha1 for client.0 is 8247bbb5b470f7e2a1f3eefcc16e24cf1338f606 2023-11-28T19:43:13.838 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "8247bbb5b470f7e2a1f3eefcc16e24cf1338f606"... 2023-11-28T19:43:13.838 DEBUG:teuthology.orchestra.run.smithi078:> uname -r 2023-11-28T19:43:13.844 INFO:teuthology.orchestra.run.smithi078.stdout:5.15.0-56-generic 2023-11-28T19:43:13.844 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-56-generic vs 8247bbb5b470f7e2a1f3eefcc16e24cf1338f606 2023-11-28T19:43:13.844 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2023-11-28T19:43:13.844 INFO:teuthology.task.kernel:Installing linux-firmware on client.0... 2023-11-28T19:43:13.845 DEBUG:teuthology.orchestra.run.smithi078:> cd /lib/firmware/updates && test -d .git && test '!' -s .git/HEAD && sudo rm -rf .git ; sudo install -d -m0755 /lib/firmware/updates && cd /lib/firmware/updates && sudo git init 2023-11-28T19:43:13.906 INFO:teuthology.orchestra.run.smithi078.stderr:bash: line 1: cd: /lib/firmware/updates: No such file or directory 2023-11-28T19:43:13.947 DEBUG:teuthology.task.kernel:sha1 for client.1 is 8247bbb5b470f7e2a1f3eefcc16e24cf1338f606 2023-11-28T19:43:13.947 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "8247bbb5b470f7e2a1f3eefcc16e24cf1338f606"... 2023-11-28T19:43:13.947 DEBUG:teuthology.orchestra.run.smithi179:> uname -r 2023-11-28T19:43:13.953 INFO:teuthology.orchestra.run.smithi179.stdout:5.15.0-56-generic 2023-11-28T19:43:13.953 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-56-generic vs 8247bbb5b470f7e2a1f3eefcc16e24cf1338f606 2023-11-28T19:43:13.953 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2023-11-28T19:43:13.954 INFO:teuthology.task.kernel:Installing linux-firmware on client.1... 2023-11-28T19:43:13.954 DEBUG:teuthology.orchestra.run.smithi179:> cd /lib/firmware/updates && test -d .git && test '!' -s .git/HEAD && sudo rm -rf .git ; sudo install -d -m0755 /lib/firmware/updates && cd /lib/firmware/updates && sudo git init 2023-11-28T19:43:14.015 INFO:teuthology.orchestra.run.smithi179.stderr:bash: line 1: cd: /lib/firmware/updates: No such file or directory 2023-11-28T19:43:14.071 INFO:teuthology.orchestra.run.smithi078.stderr:hint: Using 'master' as the name for the initial branch. This default branch name 2023-11-28T19:43:14.071 INFO:teuthology.orchestra.run.smithi078.stderr:hint: is subject to change. To configure the initial branch name to use in all 2023-11-28T19:43:14.071 INFO:teuthology.orchestra.run.smithi078.stderr:hint: of your new repositories, which will suppress this warning, call: 2023-11-28T19:43:14.071 INFO:teuthology.orchestra.run.smithi078.stderr:hint: 2023-11-28T19:43:14.072 INFO:teuthology.orchestra.run.smithi078.stderr:hint: git config --global init.defaultBranch 2023-11-28T19:43:14.072 INFO:teuthology.orchestra.run.smithi078.stderr:hint: 2023-11-28T19:43:14.072 INFO:teuthology.orchestra.run.smithi078.stderr:hint: Names commonly chosen instead of 'master' are 'main', 'trunk' and 2023-11-28T19:43:14.072 INFO:teuthology.orchestra.run.smithi078.stderr:hint: 'development'. The just-created branch can be renamed via this command: 2023-11-28T19:43:14.072 INFO:teuthology.orchestra.run.smithi078.stderr:hint: 2023-11-28T19:43:14.072 INFO:teuthology.orchestra.run.smithi078.stderr:hint: git branch -m 2023-11-28T19:43:14.072 INFO:teuthology.orchestra.run.smithi078.stdout:Initialized empty Git repository in /usr/lib/firmware/updates/.git/ 2023-11-28T19:43:14.075 DEBUG:teuthology.orchestra.run.smithi078:> sudo git --git-dir=/lib/firmware/updates/.git config --get remote.origin.url >/dev/null || sudo git --git-dir=/lib/firmware/updates/.git remote add origin git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware.git 2023-11-28T19:43:14.144 DEBUG:teuthology.orchestra.run.smithi078:> sudo git --git-dir=/lib/firmware/updates/.git remote set-url origin git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware.git >/dev/null 2023-11-28T19:43:14.157 INFO:teuthology.orchestra.run.smithi179.stderr:hint: Using 'master' as the name for the initial branch. This default branch name 2023-11-28T19:43:14.158 INFO:teuthology.orchestra.run.smithi179.stderr:hint: is subject to change. To configure the initial branch name to use in all 2023-11-28T19:43:14.158 INFO:teuthology.orchestra.run.smithi179.stderr:hint: of your new repositories, which will suppress this warning, call: 2023-11-28T19:43:14.158 INFO:teuthology.orchestra.run.smithi179.stderr:hint: 2023-11-28T19:43:14.158 INFO:teuthology.orchestra.run.smithi179.stderr:hint: git config --global init.defaultBranch 2023-11-28T19:43:14.158 INFO:teuthology.orchestra.run.smithi179.stderr:hint: 2023-11-28T19:43:14.158 INFO:teuthology.orchestra.run.smithi179.stderr:hint: Names commonly chosen instead of 'master' are 'main', 'trunk' and 2023-11-28T19:43:14.158 INFO:teuthology.orchestra.run.smithi179.stderr:hint: 'development'. The just-created branch can be renamed via this command: 2023-11-28T19:43:14.158 INFO:teuthology.orchestra.run.smithi179.stderr:hint: 2023-11-28T19:43:14.158 INFO:teuthology.orchestra.run.smithi179.stderr:hint: git branch -m 2023-11-28T19:43:14.159 INFO:teuthology.orchestra.run.smithi179.stdout:Initialized empty Git repository in /usr/lib/firmware/updates/.git/ 2023-11-28T19:43:14.161 DEBUG:teuthology.orchestra.run.smithi179:> sudo git --git-dir=/lib/firmware/updates/.git config --get remote.origin.url >/dev/null || sudo git --git-dir=/lib/firmware/updates/.git remote add origin git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware.git 2023-11-28T19:43:14.200 DEBUG:teuthology.orchestra.run.smithi078:> cd /lib/firmware/updates && sudo git fetch origin && sudo git reset --hard origin/main 2023-11-28T19:43:14.229 DEBUG:teuthology.orchestra.run.smithi179:> sudo git --git-dir=/lib/firmware/updates/.git remote set-url origin git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware.git >/dev/null 2023-11-28T19:43:14.287 DEBUG:teuthology.orchestra.run.smithi179:> cd /lib/firmware/updates && sudo git fetch origin && sudo git reset --hard origin/main 2023-11-28T19:43:56.236 INFO:teuthology.orchestra.run.smithi078.stderr:From git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware 2023-11-28T19:43:56.237 INFO:teuthology.orchestra.run.smithi078.stderr: * [new branch] main -> origin/main 2023-11-28T19:43:56.260 INFO:teuthology.orchestra.run.smithi078.stderr: * [new tag] 20190312 -> 20190312 2023-11-28T19:43:56.260 INFO:teuthology.orchestra.run.smithi078.stderr: * [new tag] 20190416 -> 20190416 2023-11-28T19:43:56.260 INFO:teuthology.orchestra.run.smithi078.stderr: * [new tag] 20190514 -> 20190514 2023-11-28T19:43:56.260 INFO:teuthology.orchestra.run.smithi078.stderr: * [new tag] 20190618 -> 20190618 2023-11-28T19:43:56.261 INFO:teuthology.orchestra.run.smithi078.stderr: * [new tag] 20190717 -> 20190717 2023-11-28T19:43:56.261 INFO:teuthology.orchestra.run.smithi078.stderr: * [new tag] 20190815 -> 20190815 2023-11-28T19:43:56.261 INFO:teuthology.orchestra.run.smithi078.stderr: * [new tag] 20190923 -> 20190923 2023-11-28T19:43:56.261 INFO:teuthology.orchestra.run.smithi078.stderr: * [new tag] 20191022 -> 20191022 2023-11-28T19:43:56.262 INFO:teuthology.orchestra.run.smithi078.stderr: * [new tag] 20191215 -> 20191215 2023-11-28T19:43:56.262 INFO:teuthology.orchestra.run.smithi078.stderr: * [new tag] 20200122 -> 20200122 2023-11-28T19:43:56.262 INFO:teuthology.orchestra.run.smithi078.stderr: * [new tag] 20200316 -> 20200316 2023-11-28T19:43:56.263 INFO:teuthology.orchestra.run.smithi078.stderr: * [new tag] 20200421 -> 20200421 2023-11-28T19:43:56.263 INFO:teuthology.orchestra.run.smithi078.stderr: * [new tag] 20200519 -> 20200519 2023-11-28T19:43:56.263 INFO:teuthology.orchestra.run.smithi078.stderr: * [new tag] 20200619 -> 20200619 2023-11-28T19:43:56.263 INFO:teuthology.orchestra.run.smithi078.stderr: * [new tag] 20200721 -> 20200721 2023-11-28T19:43:56.264 INFO:teuthology.orchestra.run.smithi078.stderr: * [new tag] 20200817 -> 20200817 2023-11-28T19:43:56.264 INFO:teuthology.orchestra.run.smithi078.stderr: * [new tag] 20200918 -> 20200918 2023-11-28T19:43:56.264 INFO:teuthology.orchestra.run.smithi078.stderr: * [new tag] 20201022 -> 20201022 2023-11-28T19:43:56.264 INFO:teuthology.orchestra.run.smithi078.stderr: * [new tag] 20201118 -> 20201118 2023-11-28T19:43:56.264 INFO:teuthology.orchestra.run.smithi078.stderr: * [new tag] 20201218 -> 20201218 2023-11-28T19:43:56.264 INFO:teuthology.orchestra.run.smithi078.stderr: * [new tag] 20210208 -> 20210208 2023-11-28T19:43:56.264 INFO:teuthology.orchestra.run.smithi078.stderr: * [new tag] 20210315 -> 20210315 2023-11-28T19:43:56.265 INFO:teuthology.orchestra.run.smithi078.stderr: * [new tag] 20210511 -> 20210511 2023-11-28T19:43:56.265 INFO:teuthology.orchestra.run.smithi078.stderr: * [new tag] 20210716 -> 20210716 2023-11-28T19:43:56.265 INFO:teuthology.orchestra.run.smithi078.stderr: * [new tag] 20210818 -> 20210818 2023-11-28T19:43:56.265 INFO:teuthology.orchestra.run.smithi078.stderr: * [new tag] 20210919 -> 20210919 2023-11-28T19:43:56.266 INFO:teuthology.orchestra.run.smithi078.stderr: * [new tag] 20211027 -> 20211027 2023-11-28T19:43:56.266 INFO:teuthology.orchestra.run.smithi078.stderr: * [new tag] 20211216 -> 20211216 2023-11-28T19:43:56.266 INFO:teuthology.orchestra.run.smithi078.stderr: * [new tag] 20220209 -> 20220209 2023-11-28T19:43:56.266 INFO:teuthology.orchestra.run.smithi078.stderr: * [new tag] 20220310 -> 20220310 2023-11-28T19:43:56.266 INFO:teuthology.orchestra.run.smithi078.stderr: * [new tag] 20220411 -> 20220411 2023-11-28T19:43:56.266 INFO:teuthology.orchestra.run.smithi078.stderr: * [new tag] 20220509 -> 20220509 2023-11-28T19:43:56.268 INFO:teuthology.orchestra.run.smithi078.stderr: * [new tag] 20220610 -> 20220610 2023-11-28T19:43:56.268 INFO:teuthology.orchestra.run.smithi078.stderr: * [new tag] 20220708 -> 20220708 2023-11-28T19:43:56.268 INFO:teuthology.orchestra.run.smithi078.stderr: * [new tag] 20220815 -> 20220815 2023-11-28T19:43:56.268 INFO:teuthology.orchestra.run.smithi078.stderr: * [new tag] 20220913 -> 20220913 2023-11-28T19:43:56.268 INFO:teuthology.orchestra.run.smithi078.stderr: * [new tag] 20221012 -> 20221012 2023-11-28T19:43:56.268 INFO:teuthology.orchestra.run.smithi078.stderr: * [new tag] 20221109 -> 20221109 2023-11-28T19:43:56.268 INFO:teuthology.orchestra.run.smithi078.stderr: * [new tag] 20221214 -> 20221214 2023-11-28T19:43:56.268 INFO:teuthology.orchestra.run.smithi078.stderr: * [new tag] 20230117 -> 20230117 2023-11-28T19:43:56.268 INFO:teuthology.orchestra.run.smithi078.stderr: * [new tag] 20230210 -> 20230210 2023-11-28T19:43:56.268 INFO:teuthology.orchestra.run.smithi078.stderr: * [new tag] 20230310 -> 20230310 2023-11-28T19:43:56.268 INFO:teuthology.orchestra.run.smithi078.stderr: * [new tag] 20230404 -> 20230404 2023-11-28T19:43:56.268 INFO:teuthology.orchestra.run.smithi078.stderr: * [new tag] 20230515 -> 20230515 2023-11-28T19:43:56.269 INFO:teuthology.orchestra.run.smithi078.stderr: * [new tag] 20230625 -> 20230625 2023-11-28T19:43:56.269 INFO:teuthology.orchestra.run.smithi078.stderr: * [new tag] 20230804 -> 20230804 2023-11-28T19:43:56.269 INFO:teuthology.orchestra.run.smithi078.stderr: * [new tag] 20230919 -> 20230919 2023-11-28T19:43:56.269 INFO:teuthology.orchestra.run.smithi078.stderr: * [new tag] 20231030 -> 20231030 2023-11-28T19:43:56.269 INFO:teuthology.orchestra.run.smithi078.stderr: * [new tag] 20231111 -> 20231111 2023-11-28T19:44:00.236 INFO:teuthology.orchestra.run.smithi078.stderr:Updating files: 51% (1676/3250) Updating files: 52% (1690/3250) Updating files: 53% (1723/3250) Updating files: 54% (1755/3250) Updating files: 55% (1788/3250) Updating files: 56% (1820/3250) Updating files: 57% (1853/3250) Updating files: 58% (1885/3250) Updating files: 59% (1918/3250) Updating files: 60% (1950/3250) Updating files: 61% (1983/3250) Updating files: 62% (2015/3250) Updating files: 63% (2048/3250) Updating files: 64% (2080/3250) Updating files: 65% (2113/3250) Updating files: 65% (2120/3250) Updating files: 66% (2145/3250) Updating files: 67% (2178/3250) Updating files: 68% (2210/3250) Updating files: 69% (2243/3250) Updating files: 70% (2275/3250) Updating files: 71% (2308/3250) Updating files: 72% (2340/3250) Updating files: 73% (2373/3250) Updating files: 74% (2405/3250) Updating files: 75% (2438/3250) Updating files: 76% (2470/3250) Updating files: 77% (2503/3250) Updating files: 78% (2535/3250) Updating files: 79% (2568/3250) Updating files: 80% (2600/3250) Updating files: 81% (2633/3250) Updating files: 81% (2655/3250) Updating files: 82% (2665/3250) Updating files: 83% (2698/3250) Updating files: 84% (2730/3250) Updating files: 85% (2763/3250) Updating files: 86% (2795/3250) Updating files: 87% (2828/3250) Updating files: 88% (2860/3250) Updating files: 89% (2893/3250) Updating files: 90% (2925/3250) Updating files: 91% (2958/3250) Updating files: 92% (2990/3250) Updating files: 93% (3023/3250) Updating files: 94% (3055/3250) Updating files: 95% (3088/3250) Updating files: 96% (3120/3250) Updating files: 97% (3153/3250) Updating files: 98% (3185/3250) Updating files: 99% (3218/3250) Updating files: 100% (3250/3250) Updating files: 100% (3250/3250), done. 2023-11-28T19:44:00.241 INFO:teuthology.orchestra.run.smithi078.stdout:HEAD is now at aae60524 Merge branch 'make-opts' into 'main' 2023-11-28T19:44:00.262 INFO:teuthology.task.kernel:Downloading kernel 8247bbb5b470f7e2a1f3eefcc16e24cf1338f606 on client.0... 2023-11-28T19:44:00.263 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=8247bbb5b470f7e2a1f3eefcc16e24cf1338f606 2023-11-28T19:44:00.371 INFO:teuthology.orchestra.run.smithi179.stderr:From git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware 2023-11-28T19:44:00.371 INFO:teuthology.orchestra.run.smithi179.stderr: * [new branch] main -> origin/main 2023-11-28T19:44:00.403 INFO:teuthology.orchestra.run.smithi179.stderr: * [new tag] 20190312 -> 20190312 2023-11-28T19:44:00.403 INFO:teuthology.orchestra.run.smithi179.stderr: * [new tag] 20190416 -> 20190416 2023-11-28T19:44:00.403 INFO:teuthology.orchestra.run.smithi179.stderr: * [new tag] 20190514 -> 20190514 2023-11-28T19:44:00.403 INFO:teuthology.orchestra.run.smithi179.stderr: * [new tag] 20190618 -> 20190618 2023-11-28T19:44:00.404 INFO:teuthology.orchestra.run.smithi179.stderr: * [new tag] 20190717 -> 20190717 2023-11-28T19:44:00.405 INFO:teuthology.orchestra.run.smithi179.stderr: * [new tag] 20190815 -> 20190815 2023-11-28T19:44:00.405 INFO:teuthology.orchestra.run.smithi179.stderr: * [new tag] 20190923 -> 20190923 2023-11-28T19:44:00.405 INFO:teuthology.orchestra.run.smithi179.stderr: * [new tag] 20191022 -> 20191022 2023-11-28T19:44:00.405 INFO:teuthology.orchestra.run.smithi179.stderr: * [new tag] 20191215 -> 20191215 2023-11-28T19:44:00.405 INFO:teuthology.orchestra.run.smithi179.stderr: * [new tag] 20200122 -> 20200122 2023-11-28T19:44:00.405 INFO:teuthology.orchestra.run.smithi179.stderr: * [new tag] 20200316 -> 20200316 2023-11-28T19:44:00.405 INFO:teuthology.orchestra.run.smithi179.stderr: * [new tag] 20200421 -> 20200421 2023-11-28T19:44:00.410 INFO:teuthology.task.kernel:fetching, builder baseurl is https://3.chacra.ceph.com/r/kernel/testing/8247bbb5b470f7e2a1f3eefcc16e24cf1338f606/ubuntu/jammy/flavors/default/pool/main/l/linux-6.6.0-g8247bbb5b470/ 2023-11-28T19:44:00.410 DEBUG:teuthology.orchestra.run.smithi078:> rm -f /tmp/linux-image.deb && echo linux-image-6.6.0-g8247bbb5b470_6.6.0-g8247bbb5b470-1_amd64.deb | wget -nv -O /tmp/linux-image.deb --base=https://3.chacra.ceph.com/r/kernel/testing/8247bbb5b470f7e2a1f3eefcc16e24cf1338f606/ubuntu/jammy/flavors/default/pool/main/l/linux-6.6.0-g8247bbb5b470/ --input-file=- 2023-11-28T19:44:00.413 INFO:teuthology.orchestra.run.smithi179.stderr: * [new tag] 20200519 -> 20200519 2023-11-28T19:44:00.414 INFO:teuthology.orchestra.run.smithi179.stderr: * [new tag] 20200619 -> 20200619 2023-11-28T19:44:00.414 INFO:teuthology.orchestra.run.smithi179.stderr: * [new tag] 20200721 -> 20200721 2023-11-28T19:44:00.414 INFO:teuthology.orchestra.run.smithi179.stderr: * [new tag] 20200817 -> 20200817 2023-11-28T19:44:00.414 INFO:teuthology.orchestra.run.smithi179.stderr: * [new tag] 20200918 -> 20200918 2023-11-28T19:44:00.414 INFO:teuthology.orchestra.run.smithi179.stderr: * [new tag] 20201022 -> 20201022 2023-11-28T19:44:00.414 INFO:teuthology.orchestra.run.smithi179.stderr: * [new tag] 20201118 -> 20201118 2023-11-28T19:44:00.414 INFO:teuthology.orchestra.run.smithi179.stderr: * [new tag] 20201218 -> 20201218 2023-11-28T19:44:00.414 INFO:teuthology.orchestra.run.smithi179.stderr: * [new tag] 20210208 -> 20210208 2023-11-28T19:44:00.415 INFO:teuthology.orchestra.run.smithi179.stderr: * [new tag] 20210315 -> 20210315 2023-11-28T19:44:00.415 INFO:teuthology.orchestra.run.smithi179.stderr: * [new tag] 20210511 -> 20210511 2023-11-28T19:44:00.415 INFO:teuthology.orchestra.run.smithi179.stderr: * [new tag] 20210716 -> 20210716 2023-11-28T19:44:00.415 INFO:teuthology.orchestra.run.smithi179.stderr: * [new tag] 20210818 -> 20210818 2023-11-28T19:44:00.415 INFO:teuthology.orchestra.run.smithi179.stderr: * [new tag] 20210919 -> 20210919 2023-11-28T19:44:00.415 INFO:teuthology.orchestra.run.smithi179.stderr: * [new tag] 20211027 -> 20211027 2023-11-28T19:44:00.415 INFO:teuthology.orchestra.run.smithi179.stderr: * [new tag] 20211216 -> 20211216 2023-11-28T19:44:00.415 INFO:teuthology.orchestra.run.smithi179.stderr: * [new tag] 20220209 -> 20220209 2023-11-28T19:44:00.415 INFO:teuthology.orchestra.run.smithi179.stderr: * [new tag] 20220310 -> 20220310 2023-11-28T19:44:00.415 INFO:teuthology.orchestra.run.smithi179.stderr: * [new tag] 20220411 -> 20220411 2023-11-28T19:44:00.416 INFO:teuthology.orchestra.run.smithi179.stderr: * [new tag] 20220509 -> 20220509 2023-11-28T19:44:00.416 INFO:teuthology.orchestra.run.smithi179.stderr: * [new tag] 20220610 -> 20220610 2023-11-28T19:44:00.416 INFO:teuthology.orchestra.run.smithi179.stderr: * [new tag] 20220708 -> 20220708 2023-11-28T19:44:00.416 INFO:teuthology.orchestra.run.smithi179.stderr: * [new tag] 20220815 -> 20220815 2023-11-28T19:44:00.416 INFO:teuthology.orchestra.run.smithi179.stderr: * [new tag] 20220913 -> 20220913 2023-11-28T19:44:00.416 INFO:teuthology.orchestra.run.smithi179.stderr: * [new tag] 20221012 -> 20221012 2023-11-28T19:44:00.416 INFO:teuthology.orchestra.run.smithi179.stderr: * [new tag] 20221109 -> 20221109 2023-11-28T19:44:00.416 INFO:teuthology.orchestra.run.smithi179.stderr: * [new tag] 20221214 -> 20221214 2023-11-28T19:44:00.416 INFO:teuthology.orchestra.run.smithi179.stderr: * [new tag] 20230117 -> 20230117 2023-11-28T19:44:00.416 INFO:teuthology.orchestra.run.smithi179.stderr: * [new tag] 20230210 -> 20230210 2023-11-28T19:44:00.417 INFO:teuthology.orchestra.run.smithi179.stderr: * [new tag] 20230310 -> 20230310 2023-11-28T19:44:00.417 INFO:teuthology.orchestra.run.smithi179.stderr: * [new tag] 20230404 -> 20230404 2023-11-28T19:44:00.417 INFO:teuthology.orchestra.run.smithi179.stderr: * [new tag] 20230515 -> 20230515 2023-11-28T19:44:00.417 INFO:teuthology.orchestra.run.smithi179.stderr: * [new tag] 20230625 -> 20230625 2023-11-28T19:44:00.417 INFO:teuthology.orchestra.run.smithi179.stderr: * [new tag] 20230804 -> 20230804 2023-11-28T19:44:00.417 INFO:teuthology.orchestra.run.smithi179.stderr: * [new tag] 20230919 -> 20230919 2023-11-28T19:44:00.417 INFO:teuthology.orchestra.run.smithi179.stderr: * [new tag] 20231030 -> 20231030 2023-11-28T19:44:00.417 INFO:teuthology.orchestra.run.smithi179.stderr: * [new tag] 20231111 -> 20231111 2023-11-28T19:44:00.418 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi078.front.sepia.ceph.com to complete... 2023-11-28T19:44:01.905 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28 19:44:01 URL:https://3.chacra.ceph.com/r/kernel/testing/8247bbb5b470f7e2a1f3eefcc16e24cf1338f606/ubuntu/jammy/flavors/default/pool/main/l/linux-6.6.0-g8247bbb5b470/linux-image-6.6.0-g8247bbb5b470_6.6.0-g8247bbb5b470-1_amd64.deb [38938726/38938726] -> "/tmp/linux-image.deb" [1] 2023-11-28T19:44:01.905 INFO:teuthology.orchestra.run.smithi078.stderr:FINISHED --2023-11-28 19:44:01-- 2023-11-28T19:44:01.905 INFO:teuthology.orchestra.run.smithi078.stderr:Total wall clock time: 1.5s 2023-11-28T19:44:01.906 INFO:teuthology.orchestra.run.smithi078.stderr:Downloaded: 1 files, 37M in 1.4s (27.5 MB/s) 2023-11-28T19:44:01.908 INFO:teuthology.task.kernel:Installing kernel 8247bbb5b470f7e2a1f3eefcc16e24cf1338f606 on client.0... 2023-11-28T19:44:01.908 DEBUG:teuthology.orchestra.run.smithi078:> sudo dpkg -i /tmp/linux-image.deb 2023-11-28T19:44:02.192 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package linux-image-6.6.0-g8247bbb5b470. 2023-11-28T19:44:04.301 INFO:teuthology.orchestra.run.smithi078.stdout:(Reading database ... 129542 files and directories currently installed.) 2023-11-28T19:44:04.306 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack /tmp/linux-image.deb ... 2023-11-28T19:44:04.401 INFO:teuthology.orchestra.run.smithi179.stderr:Updating files: 51% (1664/3250) Updating files: 52% (1690/3250) Updating files: 53% (1723/3250) Updating files: 54% (1755/3250) Updating files: 55% (1788/3250) Updating files: 56% (1820/3250) Updating files: 57% (1853/3250) Updating files: 58% (1885/3250) Updating files: 59% (1918/3250) Updating files: 60% (1950/3250) Updating files: 61% (1983/3250) Updating files: 62% (2015/3250) Updating files: 63% (2048/3250) Updating files: 64% (2080/3250) Updating files: 64% (2112/3250) Updating files: 65% (2113/3250) Updating files: 66% (2145/3250) Updating files: 67% (2178/3250) Updating files: 68% (2210/3250) Updating files: 69% (2243/3250) Updating files: 70% (2275/3250) Updating files: 71% (2308/3250) Updating files: 72% (2340/3250) Updating files: 73% (2373/3250) Updating files: 74% (2405/3250) Updating files: 75% (2438/3250) Updating files: 76% (2470/3250) Updating files: 77% (2503/3250) Updating files: 78% (2535/3250) Updating files: 79% (2568/3250) Updating files: 80% (2600/3250) Updating files: 81% (2633/3250) Updating files: 81% (2650/3250) Updating files: 82% (2665/3250) Updating files: 83% (2698/3250) Updating files: 84% (2730/3250) Updating files: 85% (2763/3250) Updating files: 86% (2795/3250) Updating files: 87% (2828/3250) Updating files: 88% (2860/3250) Updating files: 89% (2893/3250) Updating files: 90% (2925/3250) Updating files: 91% (2958/3250) Updating files: 92% (2990/3250) Updating files: 93% (3023/3250) Updating files: 94% (3055/3250) Updating files: 95% (3088/3250) Updating files: 96% (3120/3250) Updating files: 97% (3153/3250) Updating files: 98% (3185/3250) Updating files: 99% (3218/3250) Updating files: 100% (3250/3250) Updating files: 100% (3250/3250), done. 2023-11-28T19:44:04.405 INFO:teuthology.orchestra.run.smithi179.stdout:HEAD is now at aae60524 Merge branch 'make-opts' into 'main' 2023-11-28T19:44:04.426 INFO:teuthology.task.kernel:Downloading kernel 8247bbb5b470f7e2a1f3eefcc16e24cf1338f606 on client.1... 2023-11-28T19:44:04.426 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=8247bbb5b470f7e2a1f3eefcc16e24cf1338f606 2023-11-28T19:44:04.477 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking linux-image-6.6.0-g8247bbb5b470 (6.6.0-g8247bbb5b470-1) ... 2023-11-28T19:44:04.572 INFO:teuthology.task.kernel:fetching, builder baseurl is https://3.chacra.ceph.com/r/kernel/testing/8247bbb5b470f7e2a1f3eefcc16e24cf1338f606/ubuntu/jammy/flavors/default/pool/main/l/linux-6.6.0-g8247bbb5b470/ 2023-11-28T19:44:04.572 DEBUG:teuthology.orchestra.run.smithi179:> rm -f /tmp/linux-image.deb && echo linux-image-6.6.0-g8247bbb5b470_6.6.0-g8247bbb5b470-1_amd64.deb | wget -nv -O /tmp/linux-image.deb --base=https://3.chacra.ceph.com/r/kernel/testing/8247bbb5b470f7e2a1f3eefcc16e24cf1338f606/ubuntu/jammy/flavors/default/pool/main/l/linux-6.6.0-g8247bbb5b470/ --input-file=- 2023-11-28T19:44:04.575 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi179.front.sepia.ceph.com to complete... 2023-11-28T19:44:08.408 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up linux-image-6.6.0-g8247bbb5b470 (6.6.0-g8247bbb5b470-1) ... 2023-11-28T19:44:08.534 INFO:teuthology.orchestra.run.smithi078.stderr:update-initramfs: Generating /boot/initrd.img-6.6.0-g8247bbb5b470 2023-11-28T19:44:11.968 INFO:teuthology.orchestra.run.smithi179.stderr:2023-11-28 19:44:12 URL:https://3.chacra.ceph.com/r/kernel/testing/8247bbb5b470f7e2a1f3eefcc16e24cf1338f606/ubuntu/jammy/flavors/default/pool/main/l/linux-6.6.0-g8247bbb5b470/linux-image-6.6.0-g8247bbb5b470_6.6.0-g8247bbb5b470-1_amd64.deb [38938726/38938726] -> "/tmp/linux-image.deb" [1] 2023-11-28T19:44:11.969 INFO:teuthology.orchestra.run.smithi179.stderr:FINISHED --2023-11-28 19:44:12-- 2023-11-28T19:44:11.969 INFO:teuthology.orchestra.run.smithi179.stderr:Total wall clock time: 7.4s 2023-11-28T19:44:11.969 INFO:teuthology.orchestra.run.smithi179.stderr:Downloaded: 1 files, 37M in 7.0s (5.32 MB/s) 2023-11-28T19:44:11.972 INFO:teuthology.task.kernel:Installing kernel 8247bbb5b470f7e2a1f3eefcc16e24cf1338f606 on client.1... 2023-11-28T19:44:11.972 DEBUG:teuthology.orchestra.run.smithi179:> sudo dpkg -i /tmp/linux-image.deb 2023-11-28T19:44:12.250 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package linux-image-6.6.0-g8247bbb5b470. 2023-11-28T19:44:14.383 INFO:teuthology.orchestra.run.smithi179.stdout:(Reading database ... 129542 files and directories currently installed.) 2023-11-28T19:44:14.387 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack /tmp/linux-image.deb ... 2023-11-28T19:44:14.522 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking linux-image-6.6.0-g8247bbb5b470 (6.6.0-g8247bbb5b470-1) ... 2023-11-28T19:44:18.109 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up linux-image-6.6.0-g8247bbb5b470 (6.6.0-g8247bbb5b470-1) ... 2023-11-28T19:44:18.242 INFO:teuthology.orchestra.run.smithi179.stderr:update-initramfs: Generating /boot/initrd.img-6.6.0-g8247bbb5b470 2023-11-28T19:44:30.062 INFO:teuthology.orchestra.run.smithi078.stderr:Sourcing file `/etc/default/grub' 2023-11-28T19:44:30.085 INFO:teuthology.orchestra.run.smithi078.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2023-11-28T19:44:30.113 INFO:teuthology.orchestra.run.smithi078.stderr:Generating grub configuration file ... 2023-11-28T19:44:30.453 INFO:teuthology.orchestra.run.smithi078.stderr:Found linux image: /boot/vmlinuz-6.6.0-g8247bbb5b470 2023-11-28T19:44:30.479 INFO:teuthology.orchestra.run.smithi078.stderr:Found initrd image: /boot/initrd.img-6.6.0-g8247bbb5b470 2023-11-28T19:44:30.777 INFO:teuthology.orchestra.run.smithi078.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2023-11-28T19:44:30.786 INFO:teuthology.orchestra.run.smithi078.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2023-11-28T19:44:30.847 INFO:teuthology.orchestra.run.smithi078.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2023-11-28T19:44:30.852 INFO:teuthology.orchestra.run.smithi078.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2023-11-28T19:44:31.007 INFO:teuthology.orchestra.run.smithi078.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2023-11-28T19:44:31.007 INFO:teuthology.orchestra.run.smithi078.stderr:Systems on them will not be added to the GRUB boot configuration. 2023-11-28T19:44:31.007 INFO:teuthology.orchestra.run.smithi078.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2023-11-28T19:44:31.050 INFO:teuthology.orchestra.run.smithi078.stderr:done 2023-11-28T19:44:31.225 DEBUG:teuthology.orchestra.run.smithi078:> dpkg-deb -c /tmp/linux-image.deb 2023-11-28T19:44:31.232 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./ 2023-11-28T19:44:31.232 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./boot/ 2023-11-28T19:44:31.232 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 4415617 2023-11-23 03:47 ./boot/System.map-6.6.0-g8247bbb5b470 2023-11-28T19:44:31.241 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 169214 2023-11-23 03:47 ./boot/config-6.6.0-g8247bbb5b470 2023-11-28T19:44:31.242 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 11352832 2023-11-23 03:47 ./boot/vmlinuz-6.6.0-g8247bbb5b470 2023-11-28T19:44:31.259 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./etc/ 2023-11-28T19:44:31.259 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./etc/kernel/ 2023-11-28T19:44:31.259 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./etc/kernel/postinst.d/ 2023-11-28T19:44:31.259 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./etc/kernel/postrm.d/ 2023-11-28T19:44:31.259 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./etc/kernel/preinst.d/ 2023-11-28T19:44:31.259 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./etc/kernel/prerm.d/ 2023-11-28T19:44:31.259 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/ 2023-11-28T19:44:31.259 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/ 2023-11-28T19:44:31.259 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/ 2023-11-28T19:44:31.260 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/ 2023-11-28T19:44:31.260 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/ 2023-11-28T19:44:31.260 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/ 2023-11-28T19:44:31.260 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/ 2023-11-28T19:44:31.260 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 490233 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/aesni-intel.ko 2023-11-28T19:44:31.262 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 25329 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/blowfish-x86_64.ko 2023-11-28T19:44:31.262 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 29529 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2023-11-28T19:44:31.262 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 30313 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2023-11-28T19:44:31.262 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 93113 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/camellia-x86_64.ko 2023-11-28T19:44:31.262 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 106729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2023-11-28T19:44:31.262 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 152241 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2023-11-28T19:44:31.263 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 12553 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/crc32-pclmul.ko 2023-11-28T19:44:31.263 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 13777 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2023-11-28T19:44:31.263 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 83889 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2023-11-28T19:44:31.263 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 18625 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2023-11-28T19:44:31.263 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 47225 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2023-11-28T19:44:31.263 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 47209 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/serpent-avx2.ko 2023-11-28T19:44:31.263 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 51801 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2023-11-28T19:44:31.263 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 38937 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/sha1-ssse3.ko 2023-11-28T19:44:31.263 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 40529 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/sha256-ssse3.ko 2023-11-28T19:44:31.263 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 58585 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/sha512-ssse3.ko 2023-11-28T19:44:31.263 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 50497 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2023-11-28T19:44:31.263 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 32065 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2023-11-28T19:44:31.264 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 13625 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/twofish-x86_64.ko 2023-11-28T19:44:31.264 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/kernel/ 2023-11-28T19:44:31.264 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/kernel/cpu/ 2023-11-28T19:44:31.264 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/kernel/cpu/mce/ 2023-11-28T19:44:31.264 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 40113 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2023-11-28T19:44:31.264 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 13353 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/kernel/cpuid.ko 2023-11-28T19:44:31.264 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 17937 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/kernel/msr.ko 2023-11-28T19:44:31.264 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/kvm/ 2023-11-28T19:44:31.264 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 354433 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/kvm/kvm-amd.ko 2023-11-28T19:44:31.264 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 881625 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/kvm/kvm-intel.ko 2023-11-28T19:44:31.265 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 2275865 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/kvm/kvm.ko 2023-11-28T19:44:31.302 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/ 2023-11-28T19:44:31.302 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 53697 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/af_alg.ko 2023-11-28T19:44:31.302 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 23097 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/algif_hash.ko 2023-11-28T19:44:31.302 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 19985 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/algif_skcipher.ko 2023-11-28T19:44:31.302 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 17209 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/ansi_cprng.ko 2023-11-28T19:44:31.302 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 19641 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/anubis.ko 2023-11-28T19:44:31.302 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 10145 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/arc4.ko 2023-11-28T19:44:31.302 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/asymmetric_keys/ 2023-11-28T19:44:31.302 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 10185 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/asymmetric_keys/pkcs7_test_key.ko 2023-11-28T19:44:31.303 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/async_tx/ 2023-11-28T19:44:31.303 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 11249 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/async_tx/async_memcpy.ko 2023-11-28T19:44:31.303 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 19473 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/async_tx/async_pq.ko 2023-11-28T19:44:31.303 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 21561 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/async_tx/async_raid6_recov.ko 2023-11-28T19:44:31.303 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 13825 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/async_tx/async_tx.ko 2023-11-28T19:44:31.303 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 17745 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/async_tx/async_xor.ko 2023-11-28T19:44:31.303 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 17921 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/async_tx/raid6test.ko 2023-11-28T19:44:31.303 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 20489 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/authenc.ko 2023-11-28T19:44:31.303 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 22577 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/authencesn.ko 2023-11-28T19:44:31.303 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 21817 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/blake2b_generic.ko 2023-11-28T19:44:31.303 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 12729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/blowfish_common.ko 2023-11-28T19:44:31.303 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 10537 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/blowfish_generic.ko 2023-11-28T19:44:31.303 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 38809 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/camellia_generic.ko 2023-11-28T19:44:31.304 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 27321 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/cast5_generic.ko 2023-11-28T19:44:31.304 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 17745 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/cast6_generic.ko 2023-11-28T19:44:31.304 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 10537 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/cast_common.ko 2023-11-28T19:44:31.304 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 35097 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/ccm.ko 2023-11-28T19:44:31.304 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 14769 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/cmac.ko 2023-11-28T19:44:31.304 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 9585 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/crc32_generic.ko 2023-11-28T19:44:31.304 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 47505 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/cryptd.ko 2023-11-28T19:44:31.304 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 39505 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/crypto_engine.ko 2023-11-28T19:44:31.304 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 26953 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/crypto_simd.ko 2023-11-28T19:44:31.304 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 24737 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/crypto_user.ko 2023-11-28T19:44:31.304 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 17729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/cts.ko 2023-11-28T19:44:31.304 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 10913 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/des_generic.ko 2023-11-28T19:44:31.304 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 15681 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/dh_generic.ko 2023-11-28T19:44:31.305 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 11001 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/echainiv.ko 2023-11-28T19:44:31.305 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 25321 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/essiv.ko 2023-11-28T19:44:31.305 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 17993 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/fcrypt.ko 2023-11-28T19:44:31.305 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 26897 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/khazad.ko 2023-11-28T19:44:31.305 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 15649 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/lrw.ko 2023-11-28T19:44:31.305 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 11513 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/lz4.ko 2023-11-28T19:44:31.305 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 11529 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/lz4hc.ko 2023-11-28T19:44:31.305 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 11697 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/md4.ko 2023-11-28T19:44:31.305 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 9729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/michael_mic.ko 2023-11-28T19:44:31.305 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 10673 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/pcbc.ko 2023-11-28T19:44:31.305 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 18745 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/pcrypt.ko 2023-11-28T19:44:31.305 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 16049 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/rmd160.ko 2023-11-28T19:44:31.305 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 29393 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/seed.ko 2023-11-28T19:44:31.305 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 27081 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/serpent_generic.ko 2023-11-28T19:44:31.306 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 149193 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/tcrypt.ko 2023-11-28T19:44:31.306 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 10881 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/tea.ko 2023-11-28T19:44:31.306 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 28777 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/twofish_common.ko 2023-11-28T19:44:31.306 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 13169 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/twofish_generic.ko 2023-11-28T19:44:31.306 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 17401 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/vmac.ko 2023-11-28T19:44:31.306 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 36185 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/wp512.ko 2023-11-28T19:44:31.306 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 14105 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/xcbc.ko 2023-11-28T19:44:31.306 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 26665 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/xor.ko 2023-11-28T19:44:31.306 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 18713 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/xts.ko 2023-11-28T19:44:31.306 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 9481 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/xxhash_generic.ko 2023-11-28T19:44:31.306 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ 2023-11-28T19:44:31.306 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/acpi/ 2023-11-28T19:44:31.307 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 18249 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/acpi/acpi_extlog.ko 2023-11-28T19:44:31.307 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 26985 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/acpi/acpi_ipmi.ko 2023-11-28T19:44:31.307 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 28793 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/acpi/acpi_pad.ko 2023-11-28T19:44:31.307 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/acpi/apei/ 2023-11-28T19:44:31.307 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 31241 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/acpi/apei/einj.ko 2023-11-28T19:44:31.307 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 12801 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/acpi/ec_sys.ko 2023-11-28T19:44:31.307 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 14937 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/acpi/platform_profile.ko 2023-11-28T19:44:31.307 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 24401 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/acpi/sbs.ko 2023-11-28T19:44:31.307 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 19521 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/acpi/sbshc.ko 2023-11-28T19:44:31.307 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 103025 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/acpi/video.ko 2023-11-28T19:44:31.307 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/ 2023-11-28T19:44:31.307 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 21601 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/acard-ahci.ko 2023-11-28T19:44:31.308 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 88865 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/ahci.ko 2023-11-28T19:44:31.308 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 14729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/ahci_platform.ko 2023-11-28T19:44:31.308 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 88289 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/libahci.ko 2023-11-28T19:44:31.308 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 34985 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/libahci_platform.ko 2023-11-28T19:44:31.308 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 17137 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_acpi.ko 2023-11-28T19:44:31.308 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 30433 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_ali.ko 2023-11-28T19:44:31.308 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 33505 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_amd.ko 2023-11-28T19:44:31.308 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 21265 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_artop.ko 2023-11-28T19:44:31.308 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 21121 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_atiixp.ko 2023-11-28T19:44:31.308 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 24945 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_atp867x.ko 2023-11-28T19:44:31.308 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 17657 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_cmd640.ko 2023-11-28T19:44:31.308 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 25185 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_cmd64x.ko 2023-11-28T19:44:31.309 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 15049 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_cypress.ko 2023-11-28T19:44:31.309 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 17849 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_efar.ko 2023-11-28T19:44:31.309 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 21945 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_hpt366.ko 2023-11-28T19:44:31.309 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 33977 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_hpt37x.ko 2023-11-28T19:44:31.309 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 23129 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_hpt3x2n.ko 2023-11-28T19:44:31.309 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 16921 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_hpt3x3.ko 2023-11-28T19:44:31.309 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 16993 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_it8213.ko 2023-11-28T19:44:31.309 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 35273 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_it821x.ko 2023-11-28T19:44:31.309 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 12889 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_jmicron.ko 2023-11-28T19:44:31.309 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 51481 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_legacy.ko 2023-11-28T19:44:31.309 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 15185 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_marvell.ko 2023-11-28T19:44:31.309 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 16281 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_mpiix.ko 2023-11-28T19:44:31.309 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 12833 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_netcell.ko 2023-11-28T19:44:31.310 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 16817 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_ninja32.ko 2023-11-28T19:44:31.310 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 15105 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_ns87410.ko 2023-11-28T19:44:31.310 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 17361 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_ns87415.ko 2023-11-28T19:44:31.310 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 16569 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_oldpiix.ko 2023-11-28T19:44:31.310 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 15377 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_opti.ko 2023-11-28T19:44:31.310 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 20681 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_optidma.ko 2023-11-28T19:44:31.310 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 32585 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_pcmcia.ko 2023-11-28T19:44:31.310 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 37793 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_pdc2027x.ko 2023-11-28T19:44:31.310 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 20561 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_pdc202xx_old.ko 2023-11-28T19:44:31.310 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 14225 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_piccolo.ko 2023-11-28T19:44:31.310 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 15449 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_radisys.ko 2023-11-28T19:44:31.310 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 19521 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_rdc.ko 2023-11-28T19:44:31.311 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 15329 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_rz1000.ko 2023-11-28T19:44:31.311 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 13937 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_sch.ko 2023-11-28T19:44:31.311 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 23097 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_serverworks.ko 2023-11-28T19:44:31.311 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 23457 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_sil680.ko 2023-11-28T19:44:31.311 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 19697 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_sl82c105.ko 2023-11-28T19:44:31.311 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 16009 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_triflex.ko 2023-11-28T19:44:31.311 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 30433 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_via.ko 2023-11-28T19:44:31.311 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 22793 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pdc_adma.ko 2023-11-28T19:44:31.311 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 29121 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/sata_inic162x.ko 2023-11-28T19:44:31.311 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 83345 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/sata_mv.ko 2023-11-28T19:44:31.311 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 70393 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/sata_nv.ko 2023-11-28T19:44:31.311 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 37377 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/sata_promise.ko 2023-11-28T19:44:31.311 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 23041 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/sata_qstor.ko 2023-11-28T19:44:31.312 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 29273 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/sata_sil.ko 2023-11-28T19:44:31.312 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 38337 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/sata_sil24.ko 2023-11-28T19:44:31.312 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 17945 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/sata_sis.ko 2023-11-28T19:44:31.312 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 20441 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/sata_svw.ko 2023-11-28T19:44:31.312 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 44793 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/sata_sx4.ko 2023-11-28T19:44:31.312 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 15601 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/sata_uli.ko 2023-11-28T19:44:31.312 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 35065 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/sata_via.ko 2023-11-28T19:44:31.312 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 20065 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/sata_vsc.ko 2023-11-28T19:44:31.312 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/auxdisplay/ 2023-11-28T19:44:31.312 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 16289 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/auxdisplay/ks0108.ko 2023-11-28T19:44:31.312 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/bcma/ 2023-11-28T19:44:31.312 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 124473 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/bcma/bcma.ko 2023-11-28T19:44:31.312 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/ 2023-11-28T19:44:31.313 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/aoe/ 2023-11-28T19:44:31.313 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 113665 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/aoe/aoe.ko 2023-11-28T19:44:31.313 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/drbd/ 2023-11-28T19:44:31.313 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 965585 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/drbd/drbd.ko 2023-11-28T19:44:31.313 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 173225 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/floppy.ko 2023-11-28T19:44:31.313 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/mtip32xx/ 2023-11-28T19:44:31.313 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 94297 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/mtip32xx/mtip32xx.ko 2023-11-28T19:44:31.313 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 115793 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/nbd.ko 2023-11-28T19:44:31.313 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/null_blk/ 2023-11-28T19:44:31.313 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 110385 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/null_blk/null_blk.ko 2023-11-28T19:44:31.313 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 98193 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/pktcdvd.ko 2023-11-28T19:44:31.313 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 263769 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/rbd.ko 2023-11-28T19:44:31.313 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/xen-blkback/ 2023-11-28T19:44:31.314 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 98145 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/xen-blkback/xen-blkback.ko 2023-11-28T19:44:31.314 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/zram/ 2023-11-28T19:44:31.314 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 60217 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/zram/zram.ko 2023-11-28T19:44:31.314 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/ 2023-11-28T19:44:31.314 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 30705 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/applicom.ko 2023-11-28T19:44:31.314 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 12009 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/hangcheck-timer.ko 2023-11-28T19:44:31.314 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/hw_random/ 2023-11-28T19:44:31.314 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 13889 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/hw_random/amd-rng.ko 2023-11-28T19:44:31.314 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 18809 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/hw_random/intel-rng.ko 2023-11-28T19:44:31.314 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 13169 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/hw_random/timeriomem-rng.ko 2023-11-28T19:44:31.314 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 10673 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/hw_random/via-rng.ko 2023-11-28T19:44:31.315 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 15633 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/hw_random/virtio-rng.ko 2023-11-28T19:44:31.315 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/ipmi/ 2023-11-28T19:44:31.315 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 30713 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/ipmi/ipmi_devintf.ko 2023-11-28T19:44:31.315 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 148601 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2023-11-28T19:44:31.315 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 26569 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2023-11-28T19:44:31.315 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 139313 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/ipmi/ipmi_si.ko 2023-11-28T19:44:31.315 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 70921 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/ipmi/ipmi_ssif.ko 2023-11-28T19:44:31.315 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 53513 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2023-11-28T19:44:31.315 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 36321 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/lp.ko 2023-11-28T19:44:31.315 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/mwave/ 2023-11-28T19:44:31.315 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 84097 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/mwave/mwave.ko 2023-11-28T19:44:31.315 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 25873 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/nvram.ko 2023-11-28T19:44:31.316 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 32169 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/ppdev.ko 2023-11-28T19:44:31.316 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 51113 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/tlclk.ko 2023-11-28T19:44:31.316 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/tpm/ 2023-11-28T19:44:31.316 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 16401 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/tpm/tpm_atmel.ko 2023-11-28T19:44:31.316 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 15881 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/tpm/tpm_i2c_atmel.ko 2023-11-28T19:44:31.316 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 23473 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/tpm/tpm_i2c_infineon.ko 2023-11-28T19:44:31.316 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 32985 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/tpm/tpm_i2c_nuvoton.ko 2023-11-28T19:44:31.316 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 30121 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/tpm/tpm_infineon.ko 2023-11-28T19:44:31.316 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 22697 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/tpm/tpm_nsc.ko 2023-11-28T19:44:31.316 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 23561 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/tpm/xen-tpmfront.ko 2023-11-28T19:44:31.316 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/xillybus/ 2023-11-28T19:44:31.316 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 17001 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/xillybus/xillybus_class.ko 2023-11-28T19:44:31.317 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 50945 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/xillybus/xillybus_core.ko 2023-11-28T19:44:31.317 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 12393 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/xillybus/xillybus_pcie.ko 2023-11-28T19:44:31.317 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/clk/ 2023-11-28T19:44:31.317 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 12489 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/clk/clk-palmas.ko 2023-11-28T19:44:31.317 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 47849 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/clk/clk-si5351.ko 2023-11-28T19:44:31.317 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 11457 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/clk/clk-twl6040.ko 2023-11-28T19:44:31.317 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 19249 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/clk/clk-wm831x.ko 2023-11-28T19:44:31.317 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/cpufreq/ 2023-11-28T19:44:31.317 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 10097 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2023-11-28T19:44:31.317 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 16833 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/cpufreq/p4-clockmod.ko 2023-11-28T19:44:31.317 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 25297 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/cpufreq/speedstep-lib.ko 2023-11-28T19:44:31.318 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/crypto/ 2023-11-28T19:44:31.318 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/crypto/ccp/ 2023-11-28T19:44:31.318 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 70801 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/crypto/ccp/ccp-crypto.ko 2023-11-28T19:44:31.318 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 243025 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/crypto/ccp/ccp.ko 2023-11-28T19:44:31.318 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/crypto/intel/ 2023-11-28T19:44:31.318 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/crypto/intel/qat/ 2023-11-28T19:44:31.318 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/crypto/intel/qat/qat_common/ 2023-11-28T19:44:31.318 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 438761 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko 2023-11-28T19:44:31.318 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/crypto/intel/qat/qat_dh895xcc/ 2023-11-28T19:44:31.318 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 24081 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko 2023-11-28T19:44:31.319 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 19937 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/crypto/padlock-aes.ko 2023-11-28T19:44:31.319 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 21537 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/crypto/padlock-sha.ko 2023-11-28T19:44:31.319 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/crypto/virtio/ 2023-11-28T19:44:31.319 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 70273 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/crypto/virtio/virtio_crypto.ko 2023-11-28T19:44:31.319 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/dca/ 2023-11-28T19:44:31.319 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 29785 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/dca/dca.ko 2023-11-28T19:44:31.319 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/dma/ 2023-11-28T19:44:31.319 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/dma/dw/ 2023-11-28T19:44:31.319 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 15857 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/dma/dw/dw_dmac.ko 2023-11-28T19:44:31.319 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/dma/ioat/ 2023-11-28T19:44:31.319 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 122569 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/dma/ioat/ioatdma.ko 2023-11-28T19:44:31.320 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/edac/ 2023-11-28T19:44:31.320 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 79953 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/edac/amd64_edac.ko 2023-11-28T19:44:31.320 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 35769 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/edac/e752x_edac.ko 2023-11-28T19:44:31.320 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 63617 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/edac/edac_mce_amd.ko 2023-11-28T19:44:31.320 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 18105 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/edac/i3000_edac.ko 2023-11-28T19:44:31.320 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 18065 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/edac/i3200_edac.ko 2023-11-28T19:44:31.320 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 22537 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/edac/i5100_edac.ko 2023-11-28T19:44:31.320 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 25657 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/edac/i5400_edac.ko 2023-11-28T19:44:31.320 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 24913 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/edac/i7300_edac.ko 2023-11-28T19:44:31.320 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 52041 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/edac/i7core_edac.ko 2023-11-28T19:44:31.320 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 18433 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/edac/i82975x_edac.ko 2023-11-28T19:44:31.320 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 20017 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/edac/ie31200_edac.ko 2023-11-28T19:44:31.320 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 56825 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/edac/sb_edac.ko 2023-11-28T19:44:31.321 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 17529 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/edac/x38_edac.ko 2023-11-28T19:44:31.321 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/extcon/ 2023-11-28T19:44:31.321 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 12673 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/extcon/extcon-gpio.ko 2023-11-28T19:44:31.321 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 27185 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/extcon/extcon-max14577.ko 2023-11-28T19:44:31.321 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 29569 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/extcon/extcon-max77693.ko 2023-11-28T19:44:31.321 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 24745 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/extcon/extcon-max8997.ko 2023-11-28T19:44:31.321 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 26537 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/extcon/extcon-palmas.ko 2023-11-28T19:44:31.321 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 23713 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/extcon/extcon-rt8973a.ko 2023-11-28T19:44:31.321 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 27785 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/extcon/extcon-sm5502.ko 2023-11-28T19:44:31.321 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/firmware/ 2023-11-28T19:44:31.321 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 34977 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/firmware/dmi-sysfs.ko 2023-11-28T19:44:31.321 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/firmware/efi/ 2023-11-28T19:44:31.322 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 15521 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/firmware/efi/efi-pstore.ko 2023-11-28T19:44:31.322 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 20729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/firmware/iscsi_ibft.ko 2023-11-28T19:44:31.322 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/ 2023-11-28T19:44:31.322 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 12305 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-adp5520.ko 2023-11-28T19:44:31.322 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 20153 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-amd8111.ko 2023-11-28T19:44:31.322 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 14993 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-arizona.ko 2023-11-28T19:44:31.322 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 13841 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-da9052.ko 2023-11-28T19:44:31.322 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 11921 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-da9055.ko 2023-11-28T19:44:31.322 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 22065 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-dln2.ko 2023-11-28T19:44:31.322 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 77849 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-f7188x.ko 2023-11-28T19:44:31.322 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 28937 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-generic.ko 2023-11-28T19:44:31.322 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 19569 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-ich.ko 2023-11-28T19:44:31.323 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 11905 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-janz-ttl.ko 2023-11-28T19:44:31.323 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 14113 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-kempld.ko 2023-11-28T19:44:31.323 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 12537 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-lp3943.ko 2023-11-28T19:44:31.323 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 9505 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-max7300.ko 2023-11-28T19:44:31.323 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 11905 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-max730x.ko 2023-11-28T19:44:31.323 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 22073 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-max732x.ko 2023-11-28T19:44:31.323 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 25145 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-ml-ioh.ko 2023-11-28T19:44:31.323 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 47073 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-pca953x.ko 2023-11-28T19:44:31.323 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 26825 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-pcf857x.ko 2023-11-28T19:44:31.323 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 14377 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-rdc321x.ko 2023-11-28T19:44:31.323 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 20593 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-sch.ko 2023-11-28T19:44:31.323 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 19505 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-sch311x.ko 2023-11-28T19:44:31.324 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 12145 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-tps65912.ko 2023-11-28T19:44:31.324 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 21057 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-twl4030.ko 2023-11-28T19:44:31.324 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 11425 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-twl6040.ko 2023-11-28T19:44:31.324 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 20601 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-viperboard.ko 2023-11-28T19:44:31.324 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 15377 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-vx855.ko 2023-11-28T19:44:31.324 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 16281 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-wm831x.ko 2023-11-28T19:44:31.324 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 11617 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-wm8350.ko 2023-11-28T19:44:31.324 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 16753 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-wm8994.ko 2023-11-28T19:44:31.324 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/ 2023-11-28T19:44:31.324 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 11577 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-a4tech.ko 2023-11-28T19:44:31.324 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 39169 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-apple.ko 2023-11-28T19:44:31.324 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 14481 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-appleir.ko 2023-11-28T19:44:31.324 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 8353 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-aureal.ko 2023-11-28T19:44:31.325 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 15169 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-axff.ko 2023-11-28T19:44:31.325 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 11049 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-belkin.ko 2023-11-28T19:44:31.325 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 10313 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-cherry.ko 2023-11-28T19:44:31.325 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 16041 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-chicony.ko 2023-11-28T19:44:31.325 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 60649 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-cp2112.ko 2023-11-28T19:44:31.325 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 11049 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-cypress.ko 2023-11-28T19:44:31.325 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 16385 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-dr.ko 2023-11-28T19:44:31.325 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 10697 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-elecom.ko 2023-11-28T19:44:31.325 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 17665 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-elo.ko 2023-11-28T19:44:31.325 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 13457 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-emsff.ko 2023-11-28T19:44:31.325 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 10105 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-ezkey.ko 2023-11-28T19:44:31.325 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 14305 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-gaff.ko 2023-11-28T19:44:31.325 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 9225 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-generic.ko 2023-11-28T19:44:31.326 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 17129 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-gt683r.ko 2023-11-28T19:44:31.326 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 12681 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-gyration.ko 2023-11-28T19:44:31.326 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 10161 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-holtek-kbd.ko 2023-11-28T19:44:31.326 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 10457 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-holtek-mouse.ko 2023-11-28T19:44:31.326 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 14449 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-holtekff.ko 2023-11-28T19:44:31.326 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 19105 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-hyperv.ko 2023-11-28T19:44:31.326 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 10489 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-icade.ko 2023-11-28T19:44:31.326 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 9241 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-kensington.ko 2023-11-28T19:44:31.326 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 8545 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-keytouch.ko 2023-11-28T19:44:31.326 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 17201 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-kye.ko 2023-11-28T19:44:31.326 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 10809 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-lcpower.ko 2023-11-28T19:44:31.326 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 20497 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-led.ko 2023-11-28T19:44:31.327 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 42297 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-lenovo.ko 2023-11-28T19:44:31.327 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 30697 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-lg-g15.ko 2023-11-28T19:44:31.327 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 58185 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-logitech-dj.ko 2023-11-28T19:44:31.327 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 101481 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-logitech-hidpp.ko 2023-11-28T19:44:31.327 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 80993 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-logitech.ko 2023-11-28T19:44:31.327 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 30801 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-magicmouse.ko 2023-11-28T19:44:31.327 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 21969 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-microsoft.ko 2023-11-28T19:44:31.327 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 10361 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-monterey.ko 2023-11-28T19:44:31.327 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 50161 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-multitouch.ko 2023-11-28T19:44:31.327 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 32593 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-ntrig.ko 2023-11-28T19:44:31.327 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 8857 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-ortek.ko 2023-11-28T19:44:31.328 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 9121 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-penmount.ko 2023-11-28T19:44:31.328 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 12289 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-petalynx.ko 2023-11-28T19:44:31.328 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 72937 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-picolcd.ko 2023-11-28T19:44:31.328 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 14225 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-pl.ko 2023-11-28T19:44:31.328 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 15105 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-plantronics.ko 2023-11-28T19:44:31.328 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 8417 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-primax.ko 2023-11-28T19:44:31.328 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 35393 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-rmi.ko 2023-11-28T19:44:31.328 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 20833 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-roccat-arvo.ko 2023-11-28T19:44:31.328 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 14065 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-roccat-common.ko 2023-11-28T19:44:31.328 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 31425 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-roccat-isku.ko 2023-11-28T19:44:31.328 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 29729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-roccat-kone.ko 2023-11-28T19:44:31.328 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 31129 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-roccat-koneplus.ko 2023-11-28T19:44:31.329 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 21137 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-roccat-konepure.ko 2023-11-28T19:44:31.329 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 29489 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-roccat-kovaplus.ko 2023-11-28T19:44:31.329 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 13305 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-roccat-lua.ko 2023-11-28T19:44:31.329 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 29313 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-roccat-pyra.ko 2023-11-28T19:44:31.329 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 27937 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-roccat-ryos.ko 2023-11-28T19:44:31.329 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 19521 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-roccat-savu.ko 2023-11-28T19:44:31.329 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 23337 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-roccat.ko 2023-11-28T19:44:31.329 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 13681 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-saitek.ko 2023-11-28T19:44:31.329 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 15193 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-samsung.ko 2023-11-28T19:44:31.329 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 36817 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-sensor-hub.ko 2023-11-28T19:44:31.329 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 13601 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-sjoy.ko 2023-11-28T19:44:31.329 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 51249 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-sony.ko 2023-11-28T19:44:31.329 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 8313 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-speedlink.ko 2023-11-28T19:44:31.330 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 25297 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-steelseries.ko 2023-11-28T19:44:31.330 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 9817 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-sunplus.ko 2023-11-28T19:44:31.330 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 16993 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-thrustmaster.ko 2023-11-28T19:44:31.330 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 10537 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-tivo.ko 2023-11-28T19:44:31.330 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 15089 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-tmff.ko 2023-11-28T19:44:31.330 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 14385 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-topseed.ko 2023-11-28T19:44:31.330 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 16473 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-twinhan.ko 2023-11-28T19:44:31.330 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 71073 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-uclogic.ko 2023-11-28T19:44:31.330 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 10921 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-waltop.ko 2023-11-28T19:44:31.330 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 143473 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-wiimote.ko 2023-11-28T19:44:31.330 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 8153 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-xinmo.ko 2023-11-28T19:44:31.330 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 13321 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-zpff.ko 2023-11-28T19:44:31.331 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 16665 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-zydacron.ko 2023-11-28T19:44:31.331 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 267825 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid.ko 2023-11-28T19:44:31.331 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 32321 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/uhid.ko 2023-11-28T19:44:31.331 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/usbhid/ 2023-11-28T19:44:31.331 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 125721 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/usbhid/usbhid.ko 2023-11-28T19:44:31.331 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 19137 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/usbhid/usbkbd.ko 2023-11-28T19:44:31.331 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 14953 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/usbhid/usbmouse.ko 2023-11-28T19:44:31.331 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 217873 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/wacom.ko 2023-11-28T19:44:31.331 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hv/ 2023-11-28T19:44:31.331 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 64201 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hv/hv_balloon.ko 2023-11-28T19:44:31.331 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 89625 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hv/hv_utils.ko 2023-11-28T19:44:31.331 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 305465 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hv/hv_vmbus.ko 2023-11-28T19:44:31.331 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ 2023-11-28T19:44:31.332 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 66521 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/abituguru.ko 2023-11-28T19:44:31.332 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 61393 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/abituguru3.ko 2023-11-28T19:44:31.332 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 34745 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/acpi_power_meter.ko 2023-11-28T19:44:31.332 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 17505 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ad7414.ko 2023-11-28T19:44:31.332 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 19313 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ad7418.ko 2023-11-28T19:44:31.332 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 25257 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/adc128d818.ko 2023-11-28T19:44:31.332 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 31729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/adm1025.ko 2023-11-28T19:44:31.332 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 97977 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/adm1026.ko 2023-11-28T19:44:31.332 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 19745 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/adm1029.ko 2023-11-28T19:44:31.332 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 45553 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/adm1031.ko 2023-11-28T19:44:31.332 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 26289 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/adm9240.ko 2023-11-28T19:44:31.332 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 14769 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ads7828.ko 2023-11-28T19:44:31.332 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 10769 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/adt7410.ko 2023-11-28T19:44:31.332 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 22049 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/adt7411.ko 2023-11-28T19:44:31.333 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 74433 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/adt7462.ko 2023-11-28T19:44:31.333 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 39585 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/adt7470.ko 2023-11-28T19:44:31.333 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 67929 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/adt7475.ko 2023-11-28T19:44:31.333 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 19625 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/adt7x10.ko 2023-11-28T19:44:31.333 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 39073 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/amc6821.ko 2023-11-28T19:44:31.333 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 55201 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/applesmc.ko 2023-11-28T19:44:31.333 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 49913 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/asb100.ko 2023-11-28T19:44:31.333 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 58617 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/asc7621.ko 2023-11-28T19:44:31.333 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 40825 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/asus_atk0110.ko 2023-11-28T19:44:31.333 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 17225 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/atxp1.ko 2023-11-28T19:44:31.333 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 28281 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/coretemp.ko 2023-11-28T19:44:31.333 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 24593 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/da9052-hwmon.ko 2023-11-28T19:44:31.333 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 17265 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/da9055-hwmon.ko 2023-11-28T19:44:31.334 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 44465 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/dell-smm-hwmon.ko 2023-11-28T19:44:31.334 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 99601 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/dme1737.ko 2023-11-28T19:44:31.334 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 19489 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ds1621.ko 2023-11-28T19:44:31.334 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 15321 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ds620.ko 2023-11-28T19:44:31.334 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 29777 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/emc1403.ko 2023-11-28T19:44:31.334 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 33185 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/emc2103.ko 2023-11-28T19:44:31.334 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 30321 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/emc6w201.ko 2023-11-28T19:44:31.334 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 66985 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/f71805f.ko 2023-11-28T19:44:31.334 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 94457 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/f71882fg.ko 2023-11-28T19:44:31.334 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 41401 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/f75375s.ko 2023-11-28T19:44:31.334 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 21305 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/fam15h_power.ko 2023-11-28T19:44:31.334 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 55449 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/fschmd.ko 2023-11-28T19:44:31.335 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 14481 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/g760a.ko 2023-11-28T19:44:31.335 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 24017 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/g762.ko 2023-11-28T19:44:31.335 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 46801 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/gl518sm.ko 2023-11-28T19:44:31.335 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 45529 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/gl520sm.ko 2023-11-28T19:44:31.335 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 13273 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/hih6130.ko 2023-11-28T19:44:31.335 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 9745 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/hwmon-vid.ko 2023-11-28T19:44:31.335 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 11553 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/i5500_temp.ko 2023-11-28T19:44:31.335 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 22601 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/i5k_amb.ko 2023-11-28T19:44:31.335 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 34529 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ibmaem.ko 2023-11-28T19:44:31.335 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 21257 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ibmpex.ko 2023-11-28T19:44:31.335 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 24873 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ina209.ko 2023-11-28T19:44:31.336 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 13401 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ina2xx.ko 2023-11-28T19:44:31.336 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 130449 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/it87.ko 2023-11-28T19:44:31.336 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 18841 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/jc42.ko 2023-11-28T19:44:31.336 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 24329 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/k10temp.ko 2023-11-28T19:44:31.336 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 13553 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/k8temp.ko 2023-11-28T19:44:31.336 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 18929 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/lineage-pem.ko 2023-11-28T19:44:31.336 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 48601 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/lm63.ko 2023-11-28T19:44:31.336 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 16697 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/lm73.ko 2023-11-28T19:44:31.336 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 36777 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/lm75.ko 2023-11-28T19:44:31.336 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 19537 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/lm77.ko 2023-11-28T19:44:31.336 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 34593 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/lm78.ko 2023-11-28T19:44:31.336 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 31745 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/lm80.ko 2023-11-28T19:44:31.336 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 16889 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/lm83.ko 2023-11-28T19:44:31.337 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 72833 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/lm85.ko 2023-11-28T19:44:31.337 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 46153 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/lm87.ko 2023-11-28T19:44:31.337 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 37913 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/lm90.ko 2023-11-28T19:44:31.337 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 19745 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/lm92.ko 2023-11-28T19:44:31.337 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 108841 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/lm93.ko 2023-11-28T19:44:31.337 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 33393 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/lm95234.ko 2023-11-28T19:44:31.337 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 16201 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/lm95241.ko 2023-11-28T19:44:31.337 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 18113 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/lm95245.ko 2023-11-28T19:44:31.337 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 24017 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ltc2945.ko 2023-11-28T19:44:31.337 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 13793 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ltc4151.ko 2023-11-28T19:44:31.337 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 15193 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ltc4215.ko 2023-11-28T19:44:31.337 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 14889 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ltc4222.ko 2023-11-28T19:44:31.338 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 14825 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ltc4245.ko 2023-11-28T19:44:31.338 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 13249 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ltc4260.ko 2023-11-28T19:44:31.338 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 14993 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ltc4261.ko 2023-11-28T19:44:31.338 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 33489 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/max16065.ko 2023-11-28T19:44:31.338 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 18433 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/max1619.ko 2023-11-28T19:44:31.338 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 24353 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/max1668.ko 2023-11-28T19:44:31.338 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 19969 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/max197.ko 2023-11-28T19:44:31.338 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 27129 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/max6639.ko 2023-11-28T19:44:31.338 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 23321 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/max6650.ko 2023-11-28T19:44:31.338 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 35777 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/max6697.ko 2023-11-28T19:44:31.338 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 18585 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/mc13783-adc.ko 2023-11-28T19:44:31.338 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 10585 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/mcp3021.ko 2023-11-28T19:44:31.339 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 15937 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/menf21bmc_hwmon.ko 2023-11-28T19:44:31.339 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 44129 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/nct6683.ko 2023-11-28T19:44:31.339 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 119817 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/nct6775-core.ko 2023-11-28T19:44:31.339 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 60705 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/nct6775.ko 2023-11-28T19:44:31.339 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 59737 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/nct7802.ko 2023-11-28T19:44:31.339 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 82337 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/pc87360.ko 2023-11-28T19:44:31.339 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 54433 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/pc87427.ko 2023-11-28T19:44:31.339 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 18473 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/pcf8591.ko 2023-11-28T19:44:31.339 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/pmbus/ 2023-11-28T19:44:31.339 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 21353 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/pmbus/adm1275.ko 2023-11-28T19:44:31.339 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 17065 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/pmbus/lm25066.ko 2023-11-28T19:44:31.339 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 28329 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/pmbus/ltc2978.ko 2023-11-28T19:44:31.339 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 9577 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/pmbus/max16064.ko 2023-11-28T19:44:31.340 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 17657 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/pmbus/max34440.ko 2023-11-28T19:44:31.340 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 10169 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/pmbus/max8688.ko 2023-11-28T19:44:31.340 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 15505 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/pmbus/pmbus.ko 2023-11-28T19:44:31.340 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 82577 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2023-11-28T19:44:31.340 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 8729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/pmbus/tps40422.ko 2023-11-28T19:44:31.340 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 30729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/pmbus/ucd9000.ko 2023-11-28T19:44:31.340 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 15073 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/pmbus/ucd9200.ko 2023-11-28T19:44:31.340 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 20681 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/pmbus/zl6100.ko 2023-11-28T19:44:31.340 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 13017 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/powr1220.ko 2023-11-28T19:44:31.340 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 18705 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/sch5627.ko 2023-11-28T19:44:31.340 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 28817 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/sch5636.ko 2023-11-28T19:44:31.340 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 27145 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/sch56xx-common.ko 2023-11-28T19:44:31.340 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 32137 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/sht15.ko 2023-11-28T19:44:31.341 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 13505 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/sht21.ko 2023-11-28T19:44:31.341 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 16833 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/shtc1.ko 2023-11-28T19:44:31.341 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 40105 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/sis5595.ko 2023-11-28T19:44:31.341 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 19577 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/smsc47b397.ko 2023-11-28T19:44:31.341 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 39193 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/smsc47m1.ko 2023-11-28T19:44:31.341 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 37385 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/smsc47m192.ko 2023-11-28T19:44:31.341 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 26553 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/thmc50.ko 2023-11-28T19:44:31.341 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 17057 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/tmp102.ko 2023-11-28T19:44:31.341 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 14097 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/tmp103.ko 2023-11-28T19:44:31.341 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 21257 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/tmp401.ko 2023-11-28T19:44:31.341 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 19537 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/tmp421.ko 2023-11-28T19:44:31.341 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 19721 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/via-cputemp.ko 2023-11-28T19:44:31.341 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 41945 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/via686a.ko 2023-11-28T19:44:31.342 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 52457 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/vt1211.ko 2023-11-28T19:44:31.342 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 51545 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/vt8231.ko 2023-11-28T19:44:31.342 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 57449 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/w83627ehf.ko 2023-11-28T19:44:31.342 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 78873 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/w83627hf.ko 2023-11-28T19:44:31.342 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 71345 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/w83781d.ko 2023-11-28T19:44:31.342 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 63225 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/w83791d.ko 2023-11-28T19:44:31.342 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 71321 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/w83792d.ko 2023-11-28T19:44:31.342 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 101473 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/w83793.ko 2023-11-28T19:44:31.342 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 119505 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/w83795.ko 2023-11-28T19:44:31.342 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 17313 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/w83l785ts.ko 2023-11-28T19:44:31.342 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 35625 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/w83l786ng.ko 2023-11-28T19:44:31.342 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 13825 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/wm831x-hwmon.ko 2023-11-28T19:44:31.342 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 10625 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/wm8350-hwmon.ko 2023-11-28T19:44:31.343 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/ 2023-11-28T19:44:31.343 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/algos/ 2023-11-28T19:44:31.343 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 20049 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2023-11-28T19:44:31.343 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 19345 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2023-11-28T19:44:31.343 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/ 2023-11-28T19:44:31.343 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 27969 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-ali1535.ko 2023-11-28T19:44:31.343 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 28801 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-ali1563.ko 2023-11-28T19:44:31.343 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 27777 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-ali15x3.ko 2023-11-28T19:44:31.343 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 17937 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2023-11-28T19:44:31.343 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 26193 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-amd756.ko 2023-11-28T19:44:31.343 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 16201 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-amd8111.ko 2023-11-28T19:44:31.343 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 15153 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-cbus-gpio.ko 2023-11-28T19:44:31.343 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 6929 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2023-11-28T19:44:31.343 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 13961 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-cros-ec-tunnel.ko 2023-11-28T19:44:31.344 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 50201 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-designware-core.ko 2023-11-28T19:44:31.344 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 23905 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2023-11-28T19:44:31.344 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 20001 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2023-11-28T19:44:31.344 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 17337 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2023-11-28T19:44:31.344 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 12497 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-dln2.ko 2023-11-28T19:44:31.344 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 17585 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-gpio.ko 2023-11-28T19:44:31.344 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 62817 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-i801.ko 2023-11-28T19:44:31.344 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 22433 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-isch.ko 2023-11-28T19:44:31.344 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 47889 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-ismt.ko 2023-11-28T19:44:31.344 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 17721 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-kempld.ko 2023-11-28T19:44:31.344 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 17881 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2023-11-28T19:44:31.344 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 22337 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-nforce2.ko 2023-11-28T19:44:31.344 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 26265 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-ocores.ko 2023-11-28T19:44:31.345 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 25145 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-parport.ko 2023-11-28T19:44:31.345 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 16497 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2023-11-28T19:44:31.345 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 47241 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-piix4.ko 2023-11-28T19:44:31.345 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 15289 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-robotfuzz-osif.ko 2023-11-28T19:44:31.345 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 18649 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-scmi.ko 2023-11-28T19:44:31.345 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 11809 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-simtec.ko 2023-11-28T19:44:31.345 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 22313 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-sis5595.ko 2023-11-28T19:44:31.345 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 29361 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-sis630.ko 2023-11-28T19:44:31.345 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 20329 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-sis96x.ko 2023-11-28T19:44:31.345 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 19241 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-taos-evm.ko 2023-11-28T19:44:31.345 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 19809 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2023-11-28T19:44:31.345 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 13801 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-via.ko 2023-11-28T19:44:31.345 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 26081 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-viapro.ko 2023-11-28T19:44:31.346 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 19041 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-viperboard.ko 2023-11-28T19:44:31.346 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 47657 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-xiic.ko 2023-11-28T19:44:31.346 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 22449 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/i2c-mux.ko 2023-11-28T19:44:31.346 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 18825 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/i2c-smbus.ko 2023-11-28T19:44:31.346 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 27073 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/i2c-stub.ko 2023-11-28T19:44:31.346 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/muxes/ 2023-11-28T19:44:31.346 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 14921 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/muxes/i2c-mux-gpio.ko 2023-11-28T19:44:31.346 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 13457 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/muxes/i2c-mux-pca9541.ko 2023-11-28T19:44:31.346 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 29737 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/muxes/i2c-mux-pca954x.ko 2023-11-28T19:44:31.346 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/ 2023-11-28T19:44:31.346 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/core/ 2023-11-28T19:44:31.346 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 273609 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/core/ib_cm.ko 2023-11-28T19:44:31.347 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 879969 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/core/ib_core.ko 2023-11-28T19:44:31.347 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 69273 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/core/ib_umad.ko 2023-11-28T19:44:31.347 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 324217 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/core/ib_uverbs.ko 2023-11-28T19:44:31.347 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 97985 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/core/iw_cm.ko 2023-11-28T19:44:31.347 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 282273 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/core/rdma_cm.ko 2023-11-28T19:44:31.347 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 66201 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/core/rdma_ucm.ko 2023-11-28T19:44:31.347 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/hw/ 2023-11-28T19:44:31.347 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/hw/cxgb4/ 2023-11-28T19:44:31.347 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 493073 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2023-11-28T19:44:31.347 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/hw/mlx4/ 2023-11-28T19:44:31.347 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 419737 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2023-11-28T19:44:31.347 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/hw/mlx5/ 2023-11-28T19:44:31.348 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 739025 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2023-11-28T19:44:31.429 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/hw/mthca/ 2023-11-28T19:44:31.430 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 296625 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2023-11-28T19:44:31.430 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/hw/ocrdma/ 2023-11-28T19:44:31.430 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 153697 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/hw/ocrdma/ocrdma.ko 2023-11-28T19:44:31.430 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/hw/usnic/ 2023-11-28T19:44:31.430 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 168969 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/hw/usnic/usnic_verbs.ko 2023-11-28T19:44:31.430 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/ulp/ 2023-11-28T19:44:31.430 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/ulp/ipoib/ 2023-11-28T19:44:31.430 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 263081 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2023-11-28T19:44:31.430 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/ulp/iser/ 2023-11-28T19:44:31.430 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 100241 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2023-11-28T19:44:31.430 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/ulp/isert/ 2023-11-28T19:44:31.431 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 111425 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2023-11-28T19:44:31.431 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/ulp/srp/ 2023-11-28T19:44:31.431 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 128753 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2023-11-28T19:44:31.431 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/ulp/srpt/ 2023-11-28T19:44:31.431 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 129529 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2023-11-28T19:44:31.431 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/ 2023-11-28T19:44:31.431 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 10745 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/evbug.ko 2023-11-28T19:44:31.431 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 24129 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/ff-memless.ko 2023-11-28T19:44:31.431 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/gameport/ 2023-11-28T19:44:31.431 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 11881 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/gameport/emu10k1-gp.ko 2023-11-28T19:44:31.431 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 12145 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/gameport/fm801-gp.ko 2023-11-28T19:44:31.431 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 41241 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/gameport/gameport.ko 2023-11-28T19:44:31.432 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 41801 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/joydev.ko 2023-11-28T19:44:31.432 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/ 2023-11-28T19:44:31.432 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 13313 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/adp5520-keys.ko 2023-11-28T19:44:31.432 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 12801 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/adp5588-keys.ko 2023-11-28T19:44:31.432 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 26841 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/adp5589-keys.ko 2023-11-28T19:44:31.432 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 24761 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/cros_ec_keyb.ko 2023-11-28T19:44:31.432 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 36665 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/gpio_keys.ko 2023-11-28T19:44:31.432 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 18625 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/gpio_keys_polled.ko 2023-11-28T19:44:31.432 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 21257 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/lkkbd.ko 2023-11-28T19:44:31.432 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 26473 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/lm8323.ko 2023-11-28T19:44:31.432 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 14409 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/lm8333.ko 2023-11-28T19:44:31.432 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 24265 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/matrix_keypad.ko 2023-11-28T19:44:31.433 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 18217 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/max7359_keypad.ko 2023-11-28T19:44:31.433 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 15929 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/mcs_touchkey.ko 2023-11-28T19:44:31.433 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 16489 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/mpr121_touchkey.ko 2023-11-28T19:44:31.433 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 11585 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/newtonkbd.ko 2023-11-28T19:44:31.433 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 10673 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/opencores-kbd.ko 2023-11-28T19:44:31.433 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 14161 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/qt1070.ko 2023-11-28T19:44:31.433 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 17929 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/qt2160.ko 2023-11-28T19:44:31.433 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 23817 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/samsung-keypad.ko 2023-11-28T19:44:31.433 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 11481 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/stowaway.ko 2023-11-28T19:44:31.433 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 18289 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/sunkbd.ko 2023-11-28T19:44:31.433 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 17425 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/tca6416-keypad.ko 2023-11-28T19:44:31.433 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 16177 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/tca8418_keypad.ko 2023-11-28T19:44:31.434 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 16801 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/twl4030_keypad.ko 2023-11-28T19:44:31.434 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 11753 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/xtkbd.ko 2023-11-28T19:44:31.434 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 11465 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/matrix-keymap.ko 2023-11-28T19:44:31.434 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/mouse/ 2023-11-28T19:44:31.434 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 34329 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/mouse/appletouch.ko 2023-11-28T19:44:31.434 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 34177 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/mouse/bcm5974.ko 2023-11-28T19:44:31.434 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 123681 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/mouse/cyapatp.ko 2023-11-28T19:44:31.434 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 89449 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/mouse/elan_i2c.ko 2023-11-28T19:44:31.434 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 13961 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/mouse/gpio_mouse.ko 2023-11-28T19:44:31.434 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 335929 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/mouse/psmouse.ko 2023-11-28T19:44:31.434 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 14681 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/mouse/sermouse.ko 2023-11-28T19:44:31.434 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 23881 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/mouse/synaptics_i2c.ko 2023-11-28T19:44:31.435 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 22569 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/mouse/synaptics_usb.ko 2023-11-28T19:44:31.435 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 15665 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/mouse/vsxxxaa.ko 2023-11-28T19:44:31.435 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/rmi4/ 2023-11-28T19:44:31.435 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 109873 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/rmi4/rmi_core.ko 2023-11-28T19:44:31.435 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/serio/ 2023-11-28T19:44:31.435 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 11665 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/serio/altera_ps2.ko 2023-11-28T19:44:31.435 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 16289 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/serio/arc_ps2.ko 2023-11-28T19:44:31.435 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 16425 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/serio/ct82c710.ko 2023-11-28T19:44:31.435 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 16953 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/serio/hyperv-keyboard.ko 2023-11-28T19:44:31.435 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 15833 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/serio/parkbd.ko 2023-11-28T19:44:31.435 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 13225 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/serio/pcips2.ko 2023-11-28T19:44:31.435 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 20153 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/serio/ps2mult.ko 2023-11-28T19:44:31.436 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 24153 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/serio/serio_raw.ko 2023-11-28T19:44:31.436 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 17977 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/serio/serport.ko 2023-11-28T19:44:31.436 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 13337 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/sparse-keymap.ko 2023-11-28T19:44:31.436 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/iommu/ 2023-11-28T19:44:31.436 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/iommu/amd/ 2023-11-28T19:44:31.436 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 39289 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/iommu/amd/iommu_v2.ko 2023-11-28T19:44:31.436 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/ 2023-11-28T19:44:31.436 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 13817 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-88pm860x.ko 2023-11-28T19:44:31.436 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 11385 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-adp5520.ko 2023-11-28T19:44:31.436 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 59753 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-bd2802.ko 2023-11-28T19:44:31.436 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 24785 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-blinkm.ko 2023-11-28T19:44:31.437 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 10473 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-da903x.ko 2023-11-28T19:44:31.437 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 12241 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-da9052.ko 2023-11-28T19:44:31.437 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 16561 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-gpio.ko 2023-11-28T19:44:31.437 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 15793 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-lm3530.ko 2023-11-28T19:44:31.437 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 30505 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-lm3533.ko 2023-11-28T19:44:31.437 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 19353 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-lm355x.ko 2023-11-28T19:44:31.437 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 19961 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-lm3642.ko 2023-11-28T19:44:31.437 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 16241 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-lp3944.ko 2023-11-28T19:44:31.437 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 11233 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-lp8788.ko 2023-11-28T19:44:31.437 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 14929 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-max8997.ko 2023-11-28T19:44:31.437 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 12545 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-mc13783.ko 2023-11-28T19:44:31.437 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 13385 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-menf21bmc.ko 2023-11-28T19:44:31.438 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 20721 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-pca9532.ko 2023-11-28T19:44:31.438 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 20481 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-pca955x.ko 2023-11-28T19:44:31.438 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 17857 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-pca963x.ko 2023-11-28T19:44:31.438 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 34433 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-ss4200.ko 2023-11-28T19:44:31.438 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 24865 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-tca6507.ko 2023-11-28T19:44:31.438 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 15665 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-wm831x-status.ko 2023-11-28T19:44:31.438 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 11841 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-wm8350.ko 2023-11-28T19:44:31.438 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/trigger/ 2023-11-28T19:44:31.438 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 9985 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/trigger/ledtrig-audio.ko 2023-11-28T19:44:31.438 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 10873 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2023-11-28T19:44:31.438 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 9089 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/trigger/ledtrig-camera.ko 2023-11-28T19:44:31.438 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 7617 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2023-11-28T19:44:31.438 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 14249 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2023-11-28T19:44:31.439 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 14073 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2023-11-28T19:44:31.439 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 11889 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/trigger/ledtrig-timer.ko 2023-11-28T19:44:31.439 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 14073 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/trigger/ledtrig-transient.ko 2023-11-28T19:44:31.439 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/ 2023-11-28T19:44:31.439 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/bcache/ 2023-11-28T19:44:31.439 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 654969 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/bcache/bcache.ko 2023-11-28T19:44:31.439 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 40577 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-bio-prison.ko 2023-11-28T19:44:31.439 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 89601 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-bufio.ko 2023-11-28T19:44:31.439 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 47529 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-cache-smq.ko 2023-11-28T19:44:31.439 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 156009 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-cache.ko 2023-11-28T19:44:31.439 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 106897 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-crypt.ko 2023-11-28T19:44:31.439 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 21545 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-delay.ko 2023-11-28T19:44:31.440 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 53857 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-era.ko 2023-11-28T19:44:31.440 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 28465 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-flakey.ko 2023-11-28T19:44:31.440 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 41529 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-log-userspace.ko 2023-11-28T19:44:31.440 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 32737 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-log.ko 2023-11-28T19:44:31.440 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 49545 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-mirror.ko 2023-11-28T19:44:31.440 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 78033 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-multipath.ko 2023-11-28T19:44:31.440 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 16473 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-queue-length.ko 2023-11-28T19:44:31.440 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 70825 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-raid.ko 2023-11-28T19:44:31.440 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 36297 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-region-hash.ko 2023-11-28T19:44:31.440 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 15873 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-round-robin.ko 2023-11-28T19:44:31.440 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 16801 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-service-time.ko 2023-11-28T19:44:31.440 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 109529 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-snapshot.ko 2023-11-28T19:44:31.440 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 19361 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-switch.ko 2023-11-28T19:44:31.440 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 181865 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-thin-pool.ko 2023-11-28T19:44:31.440 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 51737 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-verity.ko 2023-11-28T19:44:31.441 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 8561 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-zero.ko 2023-11-28T19:44:31.441 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 15345 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/faulty.ko 2023-11-28T19:44:31.441 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 19625 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/linear.ko 2023-11-28T19:44:31.441 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 32417 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/multipath.ko 2023-11-28T19:44:31.441 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/persistent-data/ 2023-11-28T19:44:31.441 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 199937 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2023-11-28T19:44:31.441 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 37337 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/raid0.ko 2023-11-28T19:44:31.441 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 113073 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/raid1.ko 2023-11-28T19:44:31.441 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 158681 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/raid10.ko 2023-11-28T19:44:31.441 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 395721 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/raid456.ko 2023-11-28T19:44:31.441 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/message/ 2023-11-28T19:44:31.441 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/message/fusion/ 2023-11-28T19:44:31.442 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 178137 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/message/fusion/mptbase.ko 2023-11-28T19:44:31.442 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 63385 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/message/fusion/mptctl.ko 2023-11-28T19:44:31.442 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 44665 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/message/fusion/mptfc.ko 2023-11-28T19:44:31.442 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 37225 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/message/fusion/mptlan.ko 2023-11-28T19:44:31.442 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 123321 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/message/fusion/mptsas.ko 2023-11-28T19:44:31.442 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 79041 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/message/fusion/mptscsih.ko 2023-11-28T19:44:31.442 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 53017 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/message/fusion/mptspi.ko 2023-11-28T19:44:31.442 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/ 2023-11-28T19:44:31.442 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 17305 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/88pm800.ko 2023-11-28T19:44:31.442 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 12761 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/88pm805.ko 2023-11-28T19:44:31.442 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 11193 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/88pm80x.ko 2023-11-28T19:44:31.442 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 11865 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/arizona-i2c.ko 2023-11-28T19:44:31.442 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 123721 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/arizona.ko 2023-11-28T19:44:31.443 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 11961 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/bcm590xx.ko 2023-11-28T19:44:31.443 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 17465 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/cros_ec_dev.ko 2023-11-28T19:44:31.443 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 34961 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/dln2.ko 2023-11-28T19:44:31.443 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 16689 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/janz-cmodio.ko 2023-11-28T19:44:31.443 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 53585 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/kempld-core.ko 2023-11-28T19:44:31.443 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 27529 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/lm3533-core.ko 2023-11-28T19:44:31.443 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 14993 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/lm3533-ctrlbank.ko 2023-11-28T19:44:31.443 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 13009 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/lp3943.ko 2023-11-28T19:44:31.443 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 54569 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/lpc_ich.ko 2023-11-28T19:44:31.443 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 12113 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/lpc_sch.ko 2023-11-28T19:44:31.443 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 17409 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/max8907.ko 2023-11-28T19:44:31.443 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 29857 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/mc13xxx-core.ko 2023-11-28T19:44:31.443 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 11801 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/mc13xxx-i2c.ko 2023-11-28T19:44:31.444 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 11593 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/menf21bmc.ko 2023-11-28T19:44:31.444 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 17329 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/pcf50633-adc.ko 2023-11-28T19:44:31.444 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 9153 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/pcf50633-gpio.ko 2023-11-28T19:44:31.444 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 34873 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/pcf50633.ko 2023-11-28T19:44:31.444 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 10105 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/rdc321x-southbridge.ko 2023-11-28T19:44:31.444 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 20289 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/retu-mfd.ko 2023-11-28T19:44:31.444 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 80425 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/si476x-core.ko 2023-11-28T19:44:31.444 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 48457 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/sm501.ko 2023-11-28T19:44:31.444 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 19825 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/ti_am335x_tscadc.ko 2023-11-28T19:44:31.444 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 51137 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/tps65010.ko 2023-11-28T19:44:31.444 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 10353 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/tps6507x.ko 2023-11-28T19:44:31.444 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 13329 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/viperboard.ko 2023-11-28T19:44:31.444 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 10537 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/vx855.ko 2023-11-28T19:44:31.444 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 17953 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/wl1273-core.ko 2023-11-28T19:44:31.445 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 44345 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/wm8994.ko 2023-11-28T19:44:31.445 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/ 2023-11-28T19:44:31.445 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 13833 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/ad525x_dpot-i2c.ko 2023-11-28T19:44:31.445 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 48489 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/ad525x_dpot.ko 2023-11-28T19:44:31.445 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/altera-stapl/ 2023-11-28T19:44:31.445 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 46585 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2023-11-28T19:44:31.445 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 18393 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/apds9802als.ko 2023-11-28T19:44:31.445 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 36729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/apds990x.ko 2023-11-28T19:44:31.445 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 45593 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/bh1770glc.ko 2023-11-28T19:44:31.445 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/c2port/ 2023-11-28T19:44:31.445 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 11145 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/c2port/c2port-duramar2150.ko 2023-11-28T19:44:31.445 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 35281 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/c2port/core.ko 2023-11-28T19:44:31.445 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/cb710/ 2023-11-28T19:44:31.445 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 25161 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/cb710/cb710.ko 2023-11-28T19:44:31.446 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 17801 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/ds1682.ko 2023-11-28T19:44:31.446 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 8897 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/dummy-irq.ko 2023-11-28T19:44:31.446 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/echo/ 2023-11-28T19:44:31.446 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 13657 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/echo/echo.ko 2023-11-28T19:44:31.446 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/eeprom/ 2023-11-28T19:44:31.446 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 37849 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/eeprom/at24.ko 2023-11-28T19:44:31.446 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 14321 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/eeprom/eeprom.ko 2023-11-28T19:44:31.446 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 14769 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2023-11-28T19:44:31.446 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 13537 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/eeprom/max6875.ko 2023-11-28T19:44:31.446 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 33009 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/enclosure.ko 2023-11-28T19:44:31.446 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/genwqe/ 2023-11-28T19:44:31.446 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 152201 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/genwqe/genwqe_card.ko 2023-11-28T19:44:31.447 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 14129 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/hmc6352.ko 2023-11-28T19:44:31.447 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 31257 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/hpilo.ko 2023-11-28T19:44:31.447 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/ibmasm/ 2023-11-28T19:44:31.447 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 72129 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/ibmasm/ibmasm.ko 2023-11-28T19:44:31.447 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 19785 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/ics932s401.ko 2023-11-28T19:44:31.447 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 21681 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/isl29003.ko 2023-11-28T19:44:31.447 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 15753 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/isl29020.ko 2023-11-28T19:44:31.447 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/lis3lv02d/ 2023-11-28T19:44:31.447 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 42513 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2023-11-28T19:44:31.447 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 13857 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2023-11-28T19:44:31.447 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/mei/ 2023-11-28T19:44:31.447 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 125209 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/mei/mei-me.ko 2023-11-28T19:44:31.447 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 56521 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/mei/mei-txe.ko 2023-11-28T19:44:31.447 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 310113 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/mei/mei.ko 2023-11-28T19:44:31.448 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 31329 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/phantom.ko 2023-11-28T19:44:31.448 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/ti-st/ 2023-11-28T19:44:31.448 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 74265 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/ti-st/st_drv.ko 2023-11-28T19:44:31.448 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 24305 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/tifm_7xx1.ko 2023-11-28T19:44:31.448 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 28785 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/tifm_core.ko 2023-11-28T19:44:31.448 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 18729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/tsl2550.ko 2023-11-28T19:44:31.448 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 48697 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/vmw_balloon.ko 2023-11-28T19:44:31.448 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/vmw_vmci/ 2023-11-28T19:44:31.448 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 183609 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2023-11-28T19:44:31.448 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ 2023-11-28T19:44:31.448 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/bonding/ 2023-11-28T19:44:31.448 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 490129 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/bonding/bonding.ko 2023-11-28T19:44:31.448 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/dsa/ 2023-11-28T19:44:31.449 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/dsa/b53/ 2023-11-28T19:44:31.449 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 106033 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/dsa/b53/b53_common.ko 2023-11-28T19:44:31.449 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 40417 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/dsa/bcm-sf2.ko 2023-11-28T19:44:31.449 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 16041 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/dsa/mv88e6060.ko 2023-11-28T19:44:31.449 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/dsa/mv88e6xxx/ 2023-11-28T19:44:31.449 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 453737 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2023-11-28T19:44:31.449 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 16929 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/dummy.ko 2023-11-28T19:44:31.449 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 17961 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/eql.ko 2023-11-28T19:44:31.449 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/ 2023-11-28T19:44:31.449 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/3com/ 2023-11-28T19:44:31.449 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 45785 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2023-11-28T19:44:31.449 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 42105 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2023-11-28T19:44:31.449 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 130553 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/3com/3c59x.ko 2023-11-28T19:44:31.449 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 68849 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/3com/typhoon.ko 2023-11-28T19:44:31.450 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/8390/ 2023-11-28T19:44:31.450 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 37649 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/8390/8390.ko 2023-11-28T19:44:31.450 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 59689 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2023-11-28T19:44:31.450 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 27201 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2023-11-28T19:44:31.450 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 99049 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2023-11-28T19:44:31.450 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/adaptec/ 2023-11-28T19:44:31.450 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 54521 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/adaptec/starfire.ko 2023-11-28T19:44:31.450 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/agere/ 2023-11-28T19:44:31.450 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 69137 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/agere/et131x.ko 2023-11-28T19:44:31.450 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/alteon/ 2023-11-28T19:44:31.450 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 59585 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/alteon/acenic.ko 2023-11-28T19:44:31.450 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/altera/ 2023-11-28T19:44:31.450 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 41409 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/altera/altera_tse.ko 2023-11-28T19:44:31.451 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/amd/ 2023-11-28T19:44:31.451 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 54609 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/amd/amd8111e.ko 2023-11-28T19:44:31.451 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 49289 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2023-11-28T19:44:31.451 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 87297 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/amd/pcnet32.ko 2023-11-28T19:44:31.451 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/atheros/ 2023-11-28T19:44:31.451 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/atheros/alx/ 2023-11-28T19:44:31.451 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 97337 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2023-11-28T19:44:31.451 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/atheros/atl1c/ 2023-11-28T19:44:31.451 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 104673 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2023-11-28T19:44:31.451 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/atheros/atl1e/ 2023-11-28T19:44:31.451 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 90257 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2023-11-28T19:44:31.451 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/atheros/atlx/ 2023-11-28T19:44:31.452 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 81569 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2023-11-28T19:44:31.452 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 69729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2023-11-28T19:44:31.452 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/broadcom/ 2023-11-28T19:44:31.452 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 78401 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/broadcom/b44.ko 2023-11-28T19:44:31.452 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 176761 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2023-11-28T19:44:31.452 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/broadcom/bnx2x/ 2023-11-28T19:44:31.452 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 1421497 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2023-11-28T19:44:31.452 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 128569 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/broadcom/cnic.ko 2023-11-28T19:44:31.452 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/broadcom/genet/ 2023-11-28T19:44:31.452 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 132089 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2023-11-28T19:44:31.452 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 312081 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/broadcom/tg3.ko 2023-11-28T19:44:31.452 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/brocade/ 2023-11-28T19:44:31.452 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/brocade/bna/ 2023-11-28T19:44:31.452 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 323513 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2023-11-28T19:44:31.453 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/chelsio/ 2023-11-28T19:44:31.453 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/chelsio/cxgb/ 2023-11-28T19:44:31.453 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 193497 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2023-11-28T19:44:31.453 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/chelsio/cxgb3/ 2023-11-28T19:44:31.453 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 347417 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2023-11-28T19:44:31.453 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/chelsio/cxgb4/ 2023-11-28T19:44:31.453 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 1044497 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2023-11-28T19:44:31.453 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/chelsio/cxgb4vf/ 2023-11-28T19:44:31.453 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 166193 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2023-11-28T19:44:31.453 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/chelsio/libcxgb/ 2023-11-28T19:44:31.453 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 34881 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2023-11-28T19:44:31.453 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/cisco/ 2023-11-28T19:44:31.453 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/cisco/enic/ 2023-11-28T19:44:31.454 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 204345 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2023-11-28T19:44:31.454 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/dec/ 2023-11-28T19:44:31.454 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/dec/tulip/ 2023-11-28T19:44:31.454 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 69449 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2023-11-28T19:44:31.454 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 61489 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2023-11-28T19:44:31.454 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 141225 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2023-11-28T19:44:31.454 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 51497 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2023-11-28T19:44:31.454 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 62817 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2023-11-28T19:44:31.454 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 31369 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2023-11-28T19:44:31.454 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/dlink/ 2023-11-28T19:44:31.454 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 60873 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/dlink/dl2k.ko 2023-11-28T19:44:31.454 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 62833 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/dlink/sundance.ko 2023-11-28T19:44:31.454 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 45721 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/dnet.ko 2023-11-28T19:44:31.455 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 25185 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/ec_bhf.ko 2023-11-28T19:44:31.455 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/emulex/ 2023-11-28T19:44:31.455 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/emulex/benet/ 2023-11-28T19:44:31.455 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 281137 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2023-11-28T19:44:31.455 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 49457 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/ethoc.ko 2023-11-28T19:44:31.455 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 51737 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/fealnx.ko 2023-11-28T19:44:31.455 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/fujitsu/ 2023-11-28T19:44:31.455 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 45345 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/fujitsu/fmvj18x_cs.ko 2023-11-28T19:44:31.455 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/ 2023-11-28T19:44:31.455 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 90465 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/e100.ko 2023-11-28T19:44:31.455 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/e1000/ 2023-11-28T19:44:31.455 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 295577 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2023-11-28T19:44:31.455 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/e1000e/ 2023-11-28T19:44:31.456 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 584497 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2023-11-28T19:44:31.456 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/fm10k/ 2023-11-28T19:44:31.456 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 246209 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2023-11-28T19:44:31.456 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/i40e/ 2023-11-28T19:44:31.456 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 925825 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2023-11-28T19:44:31.456 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/iavf/ 2023-11-28T19:44:31.456 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 302937 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2023-11-28T19:44:31.456 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/igb/ 2023-11-28T19:44:31.456 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 514641 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/igb/igb.ko 2023-11-28T19:44:31.456 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/igbvf/ 2023-11-28T19:44:31.456 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 93593 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2023-11-28T19:44:31.456 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/ixgbe/ 2023-11-28T19:44:31.456 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 734305 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2023-11-28T19:44:31.456 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/ixgbevf/ 2023-11-28T19:44:31.457 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 151769 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2023-11-28T19:44:31.457 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 86921 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/jme.ko 2023-11-28T19:44:31.457 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/marvell/ 2023-11-28T19:44:31.457 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 20977 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2023-11-28T19:44:31.457 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 102289 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/marvell/skge.ko 2023-11-28T19:44:31.457 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 122649 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/marvell/sky2.ko 2023-11-28T19:44:31.457 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/mellanox/ 2023-11-28T19:44:31.457 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/mellanox/mlx4/ 2023-11-28T19:44:31.457 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 727601 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2023-11-28T19:44:31.457 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 278937 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2023-11-28T19:44:31.457 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/mellanox/mlx5/ 2023-11-28T19:44:31.457 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/mellanox/mlx5/core/ 2023-11-28T19:44:31.457 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 1113681 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2023-11-28T19:44:31.458 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/micrel/ 2023-11-28T19:44:31.458 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 53041 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/micrel/ks8842.ko 2023-11-28T19:44:31.458 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 40993 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/micrel/ks8851_common.ko 2023-11-28T19:44:31.458 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 19489 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/micrel/ks8851_par.ko 2023-11-28T19:44:31.458 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 95665 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2023-11-28T19:44:31.458 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/myricom/ 2023-11-28T19:44:31.458 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/myricom/myri10ge/ 2023-11-28T19:44:31.458 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 108649 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2023-11-28T19:44:31.458 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/natsemi/ 2023-11-28T19:44:31.458 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 73441 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2023-11-28T19:44:31.458 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 47777 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2023-11-28T19:44:31.458 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/neterion/ 2023-11-28T19:44:31.458 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 150905 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/neterion/s2io.ko 2023-11-28T19:44:31.459 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/nvidia/ 2023-11-28T19:44:31.459 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 136721 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2023-11-28T19:44:31.459 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/packetengines/ 2023-11-28T19:44:31.459 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 50481 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2023-11-28T19:44:31.459 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 43145 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2023-11-28T19:44:31.459 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/qlogic/ 2023-11-28T19:44:31.459 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/qlogic/netxen/ 2023-11-28T19:44:31.459 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 227897 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2023-11-28T19:44:31.459 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 87081 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2023-11-28T19:44:31.459 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/qlogic/qlcnic/ 2023-11-28T19:44:31.459 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 672049 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2023-11-28T19:44:31.459 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/rdc/ 2023-11-28T19:44:31.459 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 43017 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/rdc/r6040.ko 2023-11-28T19:44:31.460 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/realtek/ 2023-11-28T19:44:31.460 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 67385 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/realtek/8139cp.ko 2023-11-28T19:44:31.460 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 83985 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/realtek/8139too.ko 2023-11-28T19:44:31.460 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 29321 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/realtek/atp.ko 2023-11-28T19:44:31.460 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 189801 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/realtek/r8169.ko 2023-11-28T19:44:31.460 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/samsung/ 2023-11-28T19:44:31.460 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/samsung/sxgbe/ 2023-11-28T19:44:31.460 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 104241 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/samsung/sxgbe/samsung-sxgbe.ko 2023-11-28T19:44:31.460 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/sfc/ 2023-11-28T19:44:31.460 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 1052497 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/sfc/sfc.ko 2023-11-28T19:44:31.460 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/silan/ 2023-11-28T19:44:31.460 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 47097 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/silan/sc92031.ko 2023-11-28T19:44:31.460 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/sis/ 2023-11-28T19:44:31.461 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 54817 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/sis/sis190.ko 2023-11-28T19:44:31.461 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 63337 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/sis/sis900.ko 2023-11-28T19:44:31.461 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/smsc/ 2023-11-28T19:44:31.461 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 61537 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/smsc/epic100.ko 2023-11-28T19:44:31.461 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 67193 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2023-11-28T19:44:31.461 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 73409 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2023-11-28T19:44:31.461 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 68177 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2023-11-28T19:44:31.461 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/stmicro/ 2023-11-28T19:44:31.461 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/stmicro/stmmac/ 2023-11-28T19:44:31.461 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 13441 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-generic.ko 2023-11-28T19:44:31.461 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 39905 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2023-11-28T19:44:31.461 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 20657 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac-platform.ko 2023-11-28T19:44:31.461 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 487025 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2023-11-28T19:44:31.462 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/sun/ 2023-11-28T19:44:31.462 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 103337 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/sun/cassini.ko 2023-11-28T19:44:31.462 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 166097 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/sun/niu.ko 2023-11-28T19:44:31.462 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 66329 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/sun/sungem.ko 2023-11-28T19:44:31.462 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 78801 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/sun/sunhme.ko 2023-11-28T19:44:31.462 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/tehuti/ 2023-11-28T19:44:31.462 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 50057 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2023-11-28T19:44:31.462 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/ti/ 2023-11-28T19:44:31.462 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 86529 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/ti/tlan.ko 2023-11-28T19:44:31.462 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/via/ 2023-11-28T19:44:31.462 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 80273 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/via/via-rhine.ko 2023-11-28T19:44:31.462 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 83633 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/via/via-velocity.ko 2023-11-28T19:44:31.462 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/wiznet/ 2023-11-28T19:44:31.463 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 46241 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/wiznet/w5100.ko 2023-11-28T19:44:31.463 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 30849 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/wiznet/w5300.ko 2023-11-28T19:44:31.463 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/xircom/ 2023-11-28T19:44:31.463 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 59993 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2023-11-28T19:44:31.463 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/fddi/ 2023-11-28T19:44:31.463 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 41001 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/fddi/defxx.ko 2023-11-28T19:44:31.463 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/fddi/skfp/ 2023-11-28T19:44:31.463 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 216985 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/fddi/skfp/skfp.ko 2023-11-28T19:44:31.463 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 77345 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/geneve.ko 2023-11-28T19:44:31.463 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/hyperv/ 2023-11-28T19:44:31.463 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 235521 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/hyperv/hv_netvsc.ko 2023-11-28T19:44:31.463 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ieee802154/ 2023-11-28T19:44:31.463 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 18273 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ieee802154/fakelb.ko 2023-11-28T19:44:31.464 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 25065 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ifb.ko 2023-11-28T19:44:31.464 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ipvlan/ 2023-11-28T19:44:31.464 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 83769 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ipvlan/ipvlan.ko 2023-11-28T19:44:31.464 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 62145 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/macvlan.ko 2023-11-28T19:44:31.464 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 15865 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/macvtap.ko 2023-11-28T19:44:31.464 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/mdio/ 2023-11-28T19:44:31.464 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 20569 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2023-11-28T19:44:31.464 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 14185 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/mdio/mdio-bitbang.ko 2023-11-28T19:44:31.464 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 13681 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/mdio/mdio-gpio.ko 2023-11-28T19:44:31.464 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 8825 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/mdio/mdio-regmap.ko 2023-11-28T19:44:31.464 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 16025 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/mdio.ko 2023-11-28T19:44:31.464 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 20513 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/mii.ko 2023-11-28T19:44:31.464 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 43953 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/netconsole.ko 2023-11-28T19:44:31.465 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 13145 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/nlmon.ko 2023-11-28T19:44:31.465 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/pcs/ 2023-11-28T19:44:31.465 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 17985 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/pcs/pcs-lynx.ko 2023-11-28T19:44:31.465 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 38977 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/pcs/pcs_xpcs.ko 2023-11-28T19:44:31.465 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/ 2023-11-28T19:44:31.465 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 9737 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/amd.ko 2023-11-28T19:44:31.465 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 50033 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/bcm-phy-lib.ko 2023-11-28T19:44:31.465 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 44721 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/bcm7xxx.ko 2023-11-28T19:44:31.465 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 11521 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/bcm87xx.ko 2023-11-28T19:44:31.465 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 42241 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/broadcom.ko 2023-11-28T19:44:31.465 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 10625 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/cicada.ko 2023-11-28T19:44:31.465 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 13025 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/davicom.ko 2023-11-28T19:44:31.465 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 9449 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/et1011c.ko 2023-11-28T19:44:31.466 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 24969 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/icplus.ko 2023-11-28T19:44:31.466 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 15849 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/lxt.ko 2023-11-28T19:44:31.466 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 82049 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/marvell.ko 2023-11-28T19:44:31.466 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 76113 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/micrel.ko 2023-11-28T19:44:31.466 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 12033 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/national.ko 2023-11-28T19:44:31.466 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 97857 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/phylink.ko 2023-11-28T19:44:31.466 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 10065 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/qsemi.ko 2023-11-28T19:44:31.466 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 50065 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/realtek.ko 2023-11-28T19:44:31.466 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 29985 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/smsc.ko 2023-11-28T19:44:31.466 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 10857 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/ste10Xp.ko 2023-11-28T19:44:31.466 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 24289 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/vitesse.ko 2023-11-28T19:44:31.466 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/plip/ 2023-11-28T19:44:31.467 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 43505 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/plip/plip.ko 2023-11-28T19:44:31.467 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ppp/ 2023-11-28T19:44:31.467 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 15857 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ppp/bsd_comp.ko 2023-11-28T19:44:31.467 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 29713 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ppp/ppp_async.ko 2023-11-28T19:44:31.467 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 17665 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ppp/ppp_deflate.ko 2023-11-28T19:44:31.467 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 18625 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ppp/ppp_mppe.ko 2023-11-28T19:44:31.467 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 28729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ppp/ppp_synctty.ko 2023-11-28T19:44:31.467 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 42545 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ppp/pppoe.ko 2023-11-28T19:44:31.467 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 13441 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ppp/pppox.ko 2023-11-28T19:44:31.467 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 32689 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ppp/pptp.ko 2023-11-28T19:44:31.467 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 28289 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/sb1000.ko 2023-11-28T19:44:31.467 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/slip/ 2023-11-28T19:44:31.468 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 42465 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/slip/slip.ko 2023-11-28T19:44:31.468 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 26929 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/sungem_phy.ko 2023-11-28T19:44:31.468 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 64449 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/tap.ko 2023-11-28T19:44:31.468 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/team/ 2023-11-28T19:44:31.468 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 106169 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/team/team.ko 2023-11-28T19:44:31.468 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 13497 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/team/team_mode_activebackup.ko 2023-11-28T19:44:31.468 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 10209 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/team/team_mode_broadcast.ko 2023-11-28T19:44:31.468 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 28881 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/team/team_mode_loadbalance.ko 2023-11-28T19:44:31.468 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 9641 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/team/team_mode_random.ko 2023-11-28T19:44:31.468 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 9321 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/team/team_mode_roundrobin.ko 2023-11-28T19:44:31.468 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 87017 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/veth.ko 2023-11-28T19:44:31.468 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/vmxnet3/ 2023-11-28T19:44:31.468 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 144297 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/vmxnet3/vmxnet3.ko 2023-11-28T19:44:31.469 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/vxlan/ 2023-11-28T19:44:31.469 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 297329 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/vxlan/vxlan.ko 2023-11-28T19:44:31.469 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/xen-netback/ 2023-11-28T19:44:31.469 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 144585 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/xen-netback/xen-netback.ko 2023-11-28T19:44:31.469 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ntb/ 2023-11-28T19:44:31.469 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 20969 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ntb/ntb.ko 2023-11-28T19:44:31.469 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/nvme/ 2023-11-28T19:44:31.469 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/nvme/host/ 2023-11-28T19:44:31.469 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 265121 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/nvme/host/nvme-core.ko 2023-11-28T19:44:31.469 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 102209 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/nvme/host/nvme.ko 2023-11-28T19:44:31.469 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/parport/ 2023-11-28T19:44:31.469 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 133841 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/parport/parport.ko 2023-11-28T19:44:31.469 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 14561 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/parport/parport_cs.ko 2023-11-28T19:44:31.470 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 84465 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/parport/parport_pc.ko 2023-11-28T19:44:31.470 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 26121 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/parport/parport_serial.ko 2023-11-28T19:44:31.470 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pci/ 2023-11-28T19:44:31.470 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pci/hotplug/ 2023-11-28T19:44:31.470 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 25009 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2023-11-28T19:44:31.470 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 17849 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pci/hotplug/cpcihp_generic.ko 2023-11-28T19:44:31.470 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 20137 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pci/hotplug/cpcihp_zt5550.ko 2023-11-28T19:44:31.470 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 11857 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pci/pci-stub.ko 2023-11-28T19:44:31.470 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 46465 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pci/xen-pcifront.ko 2023-11-28T19:44:31.470 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pcmcia/ 2023-11-28T19:44:31.470 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 26793 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pcmcia/i82092.ko 2023-11-28T19:44:31.470 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 145809 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pcmcia/pcmcia.ko 2023-11-28T19:44:31.470 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 62137 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pcmcia/pcmcia_core.ko 2023-11-28T19:44:31.470 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 34345 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pcmcia/pcmcia_rsrc.ko 2023-11-28T19:44:31.471 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 34265 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pcmcia/pd6729.ko 2023-11-28T19:44:31.471 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 112889 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pcmcia/yenta_socket.ko 2023-11-28T19:44:31.471 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/phy/ 2023-11-28T19:44:31.471 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/phy/broadcom/ 2023-11-28T19:44:31.471 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 10841 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/phy/broadcom/phy-bcm-kona-usb2.ko 2023-11-28T19:44:31.471 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/phy/samsung/ 2023-11-28T19:44:31.471 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 8441 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/phy/samsung/phy-exynos-usb2.ko 2023-11-28T19:44:31.471 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pinctrl/ 2023-11-28T19:44:31.471 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pinctrl/intel/ 2023-11-28T19:44:31.471 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 70153 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2023-11-28T19:44:31.471 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/ 2023-11-28T19:44:31.471 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/chrome/ 2023-11-28T19:44:31.471 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 50889 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/chrome/cros-ec-sensorhub.ko 2023-11-28T19:44:31.472 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 20849 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/chrome/cros_ec.ko 2023-11-28T19:44:31.472 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 21449 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/chrome/cros_ec_chardev.ko 2023-11-28T19:44:31.472 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 25417 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/chrome/cros_ec_debugfs.ko 2023-11-28T19:44:31.472 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 26201 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/chrome/cros_ec_lightbar.ko 2023-11-28T19:44:31.472 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 18201 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/chrome/cros_ec_sysfs.ko 2023-11-28T19:44:31.472 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 17361 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/chrome/cros_usbpd_notify.ko 2023-11-28T19:44:31.472 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/ 2023-11-28T19:44:31.472 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 67097 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/acer-wmi.ko 2023-11-28T19:44:31.472 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 39145 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/acerhdf.ko 2023-11-28T19:44:31.472 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 37025 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/apple-gmux.ko 2023-11-28T19:44:31.472 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 59665 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/asus-laptop.ko 2023-11-28T19:44:31.472 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 31161 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/asus-nb-wmi.ko 2023-11-28T19:44:31.472 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 127441 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/asus-wmi.ko 2023-11-28T19:44:31.473 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 36849 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/classmate-laptop.ko 2023-11-28T19:44:31.473 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 49121 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/eeepc-laptop.ko 2023-11-28T19:44:31.473 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 13961 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/eeepc-wmi.ko 2023-11-28T19:44:31.473 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 40265 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/fujitsu-laptop.ko 2023-11-28T19:44:31.473 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 22521 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/fujitsu-tablet.ko 2023-11-28T19:44:31.473 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 36593 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/hdaps.ko 2023-11-28T19:44:31.473 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 19449 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/ibm_rtl.ko 2023-11-28T19:44:31.473 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/intel/ 2023-11-28T19:44:31.473 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 12073 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/intel/intel-rst.ko 2023-11-28T19:44:31.473 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 8985 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/intel/intel-smartconnect.ko 2023-11-28T19:44:31.473 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 43497 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/intel_ips.ko 2023-11-28T19:44:31.473 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 20273 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/msi-wmi.ko 2023-11-28T19:44:31.473 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 10377 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/mxm-wmi.ko 2023-11-28T19:44:31.474 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 34801 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/panasonic-laptop.ko 2023-11-28T19:44:31.474 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 42329 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/samsung-laptop.ko 2023-11-28T19:44:31.474 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 14169 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/samsung-q10.ko 2023-11-28T19:44:31.474 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 17321 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/topstar-laptop.ko 2023-11-28T19:44:31.474 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 13721 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2023-11-28T19:44:31.474 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 17081 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/toshiba_haps.ko 2023-11-28T19:44:31.474 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 10129 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/wmi-bmof.ko 2023-11-28T19:44:31.474 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 57569 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/wmi.ko 2023-11-28T19:44:31.474 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/ 2023-11-28T19:44:31.474 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/ 2023-11-28T19:44:31.474 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 30281 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/88pm860x_battery.ko 2023-11-28T19:44:31.474 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 33985 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/88pm860x_charger.ko 2023-11-28T19:44:31.474 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 55057 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/bq2415x_charger.ko 2023-11-28T19:44:31.475 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 54081 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/bq24190_charger.ko 2023-11-28T19:44:31.475 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 21553 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/bq24735-charger.ko 2023-11-28T19:44:31.475 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 17337 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/cros_peripheral_charger.ko 2023-11-28T19:44:31.475 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 19609 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/da9030_battery.ko 2023-11-28T19:44:31.475 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 19841 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/da9052-battery.ko 2023-11-28T19:44:31.475 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 29281 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/ds2760_battery.ko 2023-11-28T19:44:31.475 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 23217 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/ds2780_battery.ko 2023-11-28T19:44:31.475 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 23353 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/ds2781_battery.ko 2023-11-28T19:44:31.475 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 23649 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/ds2782_battery.ko 2023-11-28T19:44:31.475 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 20353 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/gpio-charger.ko 2023-11-28T19:44:31.475 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 18041 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/isp1704_charger.ko 2023-11-28T19:44:31.475 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 20273 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/lp8727_charger.ko 2023-11-28T19:44:31.476 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 12577 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/max14577_charger.ko 2023-11-28T19:44:31.476 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 25897 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/max17040_battery.ko 2023-11-28T19:44:31.476 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 30289 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/max17042_battery.ko 2023-11-28T19:44:31.476 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 18585 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/max8903_charger.ko 2023-11-28T19:44:31.476 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 23729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/max8925_power.ko 2023-11-28T19:44:31.476 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 21657 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/pcf50633-charger.ko 2023-11-28T19:44:31.476 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 38009 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/sbs-battery.ko 2023-11-28T19:44:31.476 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 28385 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/test_power.ko 2023-11-28T19:44:31.476 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 18865 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/tps65090-charger.ko 2023-11-28T19:44:31.476 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 11969 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/wm831x_backup.ko 2023-11-28T19:44:31.476 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 24521 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/wm831x_power.ko 2023-11-28T19:44:31.476 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 22417 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/wm8350_power.ko 2023-11-28T19:44:31.476 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/powercap/ 2023-11-28T19:44:31.476 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 57729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/powercap/intel_rapl_common.ko 2023-11-28T19:44:31.477 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 17345 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/powercap/intel_rapl_msr.ko 2023-11-28T19:44:31.477 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pps/ 2023-11-28T19:44:31.477 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pps/clients/ 2023-11-28T19:44:31.477 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 15521 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pps/clients/pps-gpio.ko 2023-11-28T19:44:31.477 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 13249 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pps/clients/pps-ldisc.ko 2023-11-28T19:44:31.477 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 15913 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pps/clients/pps_parport.ko 2023-11-28T19:44:31.477 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 41873 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pps/pps_core.ko 2023-11-28T19:44:31.477 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ptp/ 2023-11-28T19:44:31.477 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 66385 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ptp/ptp.ko 2023-11-28T19:44:31.477 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 16449 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ptp/ptp_kvm.ko 2023-11-28T19:44:31.477 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/ 2023-11-28T19:44:31.477 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 23497 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-88pm80x.ko 2023-11-28T19:44:31.477 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 24521 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-88pm860x.ko 2023-11-28T19:44:31.478 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 15393 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-bq32k.ko 2023-11-28T19:44:31.478 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 20105 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-da9052.ko 2023-11-28T19:44:31.478 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 18505 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-da9055.ko 2023-11-28T19:44:31.478 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 20425 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-da9063.ko 2023-11-28T19:44:31.478 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 16457 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-ds1286.ko 2023-11-28T19:44:31.478 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 68577 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-ds1307.ko 2023-11-28T19:44:31.478 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 20817 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-ds1374.ko 2023-11-28T19:44:31.478 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 18217 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-ds1511.ko 2023-11-28T19:44:31.478 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 16737 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-ds1553.ko 2023-11-28T19:44:31.478 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 13953 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-ds1672.ko 2023-11-28T19:44:31.478 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 13369 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-ds1742.ko 2023-11-28T19:44:31.478 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 14697 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-ds2404.ko 2023-11-28T19:44:31.478 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 23705 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-ds3232.ko 2023-11-28T19:44:31.479 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 11081 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-em3027.ko 2023-11-28T19:44:31.479 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 24329 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-fm3130.ko 2023-11-28T19:44:31.479 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 20729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-isl12022.ko 2023-11-28T19:44:31.479 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 35969 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-isl1208.ko 2023-11-28T19:44:31.479 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 14673 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-lp8788.ko 2023-11-28T19:44:31.479 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 38097 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-m41t80.ko 2023-11-28T19:44:31.479 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 12089 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-m48t35.ko 2023-11-28T19:44:31.479 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 25945 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-m48t59.ko 2023-11-28T19:44:31.479 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 14841 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-m48t86.ko 2023-11-28T19:44:31.479 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 11633 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-max6900.ko 2023-11-28T19:44:31.479 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 14673 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-max8907.ko 2023-11-28T19:44:31.479 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 15345 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-max8925.ko 2023-11-28T19:44:31.479 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 25809 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-max8997.ko 2023-11-28T19:44:31.480 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 16681 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-max8998.ko 2023-11-28T19:44:31.480 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 18513 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-mc13xxx.ko 2023-11-28T19:44:31.480 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 11409 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-msm6242.ko 2023-11-28T19:44:31.480 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 19625 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-palmas.ko 2023-11-28T19:44:31.480 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 46633 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-pcf2127.ko 2023-11-28T19:44:31.480 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 17977 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-pcf50633.ko 2023-11-28T19:44:31.480 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 26993 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-pcf85063.ko 2023-11-28T19:44:31.480 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 21825 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-pcf8523.ko 2023-11-28T19:44:31.480 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 29817 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-pcf8563.ko 2023-11-28T19:44:31.480 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 12441 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-pcf8583.ko 2023-11-28T19:44:31.480 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 18033 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-rc5t583.ko 2023-11-28T19:44:31.480 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 13049 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-rp5c01.ko 2023-11-28T19:44:31.480 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 33753 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-rs5c372.ko 2023-11-28T19:44:31.480 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 27833 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-rv3029c2.ko 2023-11-28T19:44:31.481 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 25257 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-rx8025.ko 2023-11-28T19:44:31.481 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 20113 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-rx8581.ko 2023-11-28T19:44:31.481 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 21617 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-s35390a.ko 2023-11-28T19:44:31.481 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 16825 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-stk17ta8.ko 2023-11-28T19:44:31.481 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 17889 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-tps6586x.ko 2023-11-28T19:44:31.481 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 21337 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-tps65910.ko 2023-11-28T19:44:31.481 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 20545 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-wm831x.ko 2023-11-28T19:44:31.481 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 21089 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-wm8350.ko 2023-11-28T19:44:31.481 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 27873 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-x1205.ko 2023-11-28T19:44:31.481 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/ 2023-11-28T19:44:31.481 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 77617 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/3w-9xxx.ko 2023-11-28T19:44:31.481 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 57665 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/3w-sas.ko 2023-11-28T19:44:31.481 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 55105 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/3w-xxxx.ko 2023-11-28T19:44:31.482 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 135185 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/BusLogic.ko 2023-11-28T19:44:31.482 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 26657 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/a100u2w.ko 2023-11-28T19:44:31.482 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/aacraid/ 2023-11-28T19:44:31.482 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 272305 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/aacraid/aacraid.ko 2023-11-28T19:44:31.482 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 100617 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/advansys.ko 2023-11-28T19:44:31.482 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/aic7xxx/ 2023-11-28T19:44:31.482 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 356201 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2023-11-28T19:44:31.482 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 295801 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2023-11-28T19:44:31.482 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/aic94xx/ 2023-11-28T19:44:31.482 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 189185 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/aic94xx/aic94xx.ko 2023-11-28T19:44:31.482 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 24073 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/am53c974.ko 2023-11-28T19:44:31.482 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/arcmsr/ 2023-11-28T19:44:31.482 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 106881 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/arcmsr/arcmsr.ko 2023-11-28T19:44:31.483 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 38185 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/atp870u.ko 2023-11-28T19:44:31.483 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/be2iscsi/ 2023-11-28T19:44:31.483 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 246985 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2023-11-28T19:44:31.483 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/bfa/ 2023-11-28T19:44:31.483 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 1171945 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/bfa/bfa.ko 2023-11-28T19:44:31.483 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/bnx2fc/ 2023-11-28T19:44:31.483 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 237273 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2023-11-28T19:44:31.483 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/bnx2i/ 2023-11-28T19:44:31.483 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 115369 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/bnx2i/bnx2i.ko 2023-11-28T19:44:31.483 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 40585 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/ch.ko 2023-11-28T19:44:31.483 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/csiostor/ 2023-11-28T19:44:31.483 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 308921 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/csiostor/csiostor.ko 2023-11-28T19:44:31.483 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/cxgbi/ 2023-11-28T19:44:31.483 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/cxgbi/cxgb3i/ 2023-11-28T19:44:31.484 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 76145 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2023-11-28T19:44:31.484 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/cxgbi/cxgb4i/ 2023-11-28T19:44:31.484 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 101449 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2023-11-28T19:44:31.484 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 146689 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2023-11-28T19:44:31.484 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 75553 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/dc395x.ko 2023-11-28T19:44:31.484 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 38073 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/dmx3191d.ko 2023-11-28T19:44:31.484 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/esas2r/ 2023-11-28T19:44:31.484 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 212425 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/esas2r/esas2r.ko 2023-11-28T19:44:31.484 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 60505 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/esp_scsi.ko 2023-11-28T19:44:31.484 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/fcoe/ 2023-11-28T19:44:31.484 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 78209 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/fcoe/fcoe.ko 2023-11-28T19:44:31.485 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 158505 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/fcoe/libfcoe.ko 2023-11-28T19:44:31.485 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 18945 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/fdomain.ko 2023-11-28T19:44:31.485 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/fnic/ 2023-11-28T19:44:31.485 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 263489 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/fnic/fnic.ko 2023-11-28T19:44:31.485 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 201817 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/hpsa.ko 2023-11-28T19:44:31.485 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 51209 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/hptiop.ko 2023-11-28T19:44:31.485 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 49041 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/hv_storvsc.ko 2023-11-28T19:44:31.485 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 35337 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/imm.ko 2023-11-28T19:44:31.485 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 44057 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/initio.ko 2023-11-28T19:44:31.485 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 266537 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/ipr.ko 2023-11-28T19:44:31.485 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 101881 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/ips.ko 2023-11-28T19:44:31.485 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/isci/ 2023-11-28T19:44:31.485 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 317153 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/isci/isci.ko 2023-11-28T19:44:31.486 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 26385 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2023-11-28T19:44:31.486 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 52961 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/iscsi_tcp.ko 2023-11-28T19:44:31.486 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/libfc/ 2023-11-28T19:44:31.486 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 314865 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/libfc/libfc.ko 2023-11-28T19:44:31.486 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 145585 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/libiscsi.ko 2023-11-28T19:44:31.486 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 53521 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/libiscsi_tcp.ko 2023-11-28T19:44:31.486 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/libsas/ 2023-11-28T19:44:31.486 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 216665 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/libsas/libsas.ko 2023-11-28T19:44:31.486 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/lpfc/ 2023-11-28T19:44:31.486 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 2197249 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/lpfc/lpfc.ko 2023-11-28T19:44:31.486 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/megaraid/ 2023-11-28T19:44:31.486 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 73569 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2023-11-28T19:44:31.486 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 33529 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2023-11-28T19:44:31.487 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 310617 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2023-11-28T19:44:31.487 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 84721 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/megaraid.ko 2023-11-28T19:44:31.487 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/mpt3sas/ 2023-11-28T19:44:31.487 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 659825 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2023-11-28T19:44:31.487 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/mvsas/ 2023-11-28T19:44:31.487 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 119561 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/mvsas/mvsas.ko 2023-11-28T19:44:31.487 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 78129 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/mvumi.ko 2023-11-28T19:44:31.487 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/pcmcia/ 2023-11-28T19:44:31.487 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 81625 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/pcmcia/aha152x_cs.ko 2023-11-28T19:44:31.487 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 11713 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/pcmcia/fdomain_cs.ko 2023-11-28T19:44:31.487 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 20865 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/pcmcia/qlogic_cs.ko 2023-11-28T19:44:31.487 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 23857 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/pcmcia/sym53c500_cs.ko 2023-11-28T19:44:31.487 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/pm8001/ 2023-11-28T19:44:31.488 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 364105 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/pm8001/pm80xx.ko 2023-11-28T19:44:31.488 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 123617 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/pmcraid.ko 2023-11-28T19:44:31.488 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 34513 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/ppa.ko 2023-11-28T19:44:31.488 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 55361 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/qla1280.ko 2023-11-28T19:44:31.488 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/qla2xxx/ 2023-11-28T19:44:31.488 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 1876689 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2023-11-28T19:44:31.488 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 85289 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2023-11-28T19:44:31.488 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/qla4xxx/ 2023-11-28T19:44:31.488 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 559033 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2023-11-28T19:44:31.488 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 19025 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/qlogicfas408.ko 2023-11-28T19:44:31.488 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 15993 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/raid_class.ko 2023-11-28T19:44:31.488 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 238761 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/scsi_debug.ko 2023-11-28T19:44:31.488 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 173937 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/scsi_transport_fc.ko 2023-11-28T19:44:31.489 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 279313 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/scsi_transport_iscsi.ko 2023-11-28T19:44:31.489 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 97729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/scsi_transport_sas.ko 2023-11-28T19:44:31.489 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 73881 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/scsi_transport_spi.ko 2023-11-28T19:44:31.489 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 44993 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/scsi_transport_srp.ko 2023-11-28T19:44:31.489 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 26249 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/ses.ko 2023-11-28T19:44:31.489 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 115889 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/st.ko 2023-11-28T19:44:31.489 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 46825 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/stex.ko 2023-11-28T19:44:31.489 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/sym53c8xx_2/ 2023-11-28T19:44:31.489 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 162121 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2023-11-28T19:44:31.489 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 42297 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/virtio_scsi.ko 2023-11-28T19:44:31.489 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 50321 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/vmw_pvscsi.ko 2023-11-28T19:44:31.489 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 39961 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/wd719x.ko 2023-11-28T19:44:31.489 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 50025 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/xen-scsifront.ko 2023-11-28T19:44:31.489 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ssb/ 2023-11-28T19:44:31.490 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 129441 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ssb/ssb.ko 2023-11-28T19:44:31.490 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/target/ 2023-11-28T19:44:31.490 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/target/iscsi/ 2023-11-28T19:44:31.490 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 736601 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2023-11-28T19:44:31.490 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/target/loopback/ 2023-11-28T19:44:31.490 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 49985 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/target/loopback/tcm_loop.ko 2023-11-28T19:44:31.490 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 39713 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/target/target_core_file.ko 2023-11-28T19:44:31.490 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 43025 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/target/target_core_iblock.ko 2023-11-28T19:44:31.490 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 930257 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/target/target_core_mod.ko 2023-11-28T19:44:31.490 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 44305 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/target/target_core_pscsi.ko 2023-11-28T19:44:31.490 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 122521 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/target/target_core_user.ko 2023-11-28T19:44:31.490 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/target/tcm_fc/ 2023-11-28T19:44:31.490 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 75593 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/target/tcm_fc/tcm_fc.ko 2023-11-28T19:44:31.491 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/ 2023-11-28T19:44:31.491 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/ 2023-11-28T19:44:31.491 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/int340x_thermal/ 2023-11-28T19:44:31.491 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 23481 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2023-11-28T19:44:31.491 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 29321 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2023-11-28T19:44:31.491 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 9953 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2023-11-28T19:44:31.491 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 10257 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2023-11-28T19:44:31.491 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 15081 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2023-11-28T19:44:31.491 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 16497 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2023-11-28T19:44:31.491 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 26809 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2023-11-28T19:44:31.491 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 20281 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2023-11-28T19:44:31.491 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 14865 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2023-11-28T19:44:31.491 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 14393 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2023-11-28T19:44:31.492 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 13001 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2023-11-28T19:44:31.492 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 37065 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2023-11-28T19:44:31.492 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 30729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/intel_powerclamp.ko 2023-11-28T19:44:31.492 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 18937 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2023-11-28T19:44:31.492 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 11521 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2023-11-28T19:44:31.492 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 26425 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2023-11-28T19:44:31.492 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/ 2023-11-28T19:44:31.492 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/ipwireless/ 2023-11-28T19:44:31.492 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 78425 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/ipwireless/ipwireless.ko 2023-11-28T19:44:31.492 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 57865 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/moxa.ko 2023-11-28T19:44:31.492 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 50953 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/mxser.ko 2023-11-28T19:44:31.492 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 108601 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/n_gsm.ko 2023-11-28T19:44:31.492 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 31961 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/n_hdlc.ko 2023-11-28T19:44:31.493 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 67929 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/nozomi.ko 2023-11-28T19:44:31.493 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/serial/ 2023-11-28T19:44:31.493 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/serial/8250/ 2023-11-28T19:44:31.493 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 35753 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/serial/8250/8250_dw.ko 2023-11-28T19:44:31.493 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 59497 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/serial/8250/serial_cs.ko 2023-11-28T19:44:31.493 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 18097 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/serial/altera_jtaguart.ko 2023-11-28T19:44:31.493 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 22577 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/serial/altera_uart.ko 2023-11-28T19:44:31.493 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 9425 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/serial/arc_uart.ko 2023-11-28T19:44:31.493 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 72425 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/serial/fsl_lpuart.ko 2023-11-28T19:44:31.493 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/serial/jsm/ 2023-11-28T19:44:31.493 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 103073 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/serial/jsm/jsm.ko 2023-11-28T19:44:31.493 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 28785 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/serial/rp2.ko 2023-11-28T19:44:31.493 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 52817 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/serial/sc16is7xx.ko 2023-11-28T19:44:31.494 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ufs/ 2023-11-28T19:44:31.494 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ufs/core/ 2023-11-28T19:44:31.494 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 531265 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ufs/core/ufshcd-core.ko 2023-11-28T19:44:31.494 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ufs/host/ 2023-11-28T19:44:31.494 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 28481 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ufs/host/ufshcd-pci.ko 2023-11-28T19:44:31.494 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 14601 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ufs/host/ufshcd-pltfrm.ko 2023-11-28T19:44:31.494 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/uio/ 2023-11-28T19:44:31.494 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 44513 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/uio/uio.ko 2023-11-28T19:44:31.494 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 12241 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/uio/uio_aec.ko 2023-11-28T19:44:31.494 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 11281 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/uio/uio_cif.ko 2023-11-28T19:44:31.494 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 18329 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/uio/uio_dmem_genirq.ko 2023-11-28T19:44:31.494 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 12937 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/uio/uio_mf624.ko 2023-11-28T19:44:31.494 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 12177 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/uio/uio_netx.ko 2023-11-28T19:44:31.495 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 10601 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/uio/uio_pci_generic.ko 2023-11-28T19:44:31.495 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 16057 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/uio/uio_pdrv_genirq.ko 2023-11-28T19:44:31.495 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 13633 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/uio/uio_sercos3.ko 2023-11-28T19:44:31.495 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/ 2023-11-28T19:44:31.495 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/c67x00/ 2023-11-28T19:44:31.495 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 73297 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/c67x00/c67x00.ko 2023-11-28T19:44:31.495 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/chipidea/ 2023-11-28T19:44:31.495 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 144377 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/chipidea/ci_hdrc.ko 2023-11-28T19:44:31.495 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 18505 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/chipidea/ci_hdrc_msm.ko 2023-11-28T19:44:31.495 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 12713 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/chipidea/ci_hdrc_pci.ko 2023-11-28T19:44:31.495 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 13057 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/chipidea/ci_hdrc_usb2.ko 2023-11-28T19:44:31.495 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/class/ 2023-11-28T19:44:31.495 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 87089 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/class/cdc-acm.ko 2023-11-28T19:44:31.496 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 51345 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/class/cdc-wdm.ko 2023-11-28T19:44:31.496 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 47305 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/class/usblp.ko 2023-11-28T19:44:31.496 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 89857 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/class/usbtmc.ko 2023-11-28T19:44:31.496 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/common/ 2023-11-28T19:44:31.496 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 22953 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/common/ulpi.ko 2023-11-28T19:44:31.496 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/dwc2/ 2023-11-28T19:44:31.496 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 11529 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/dwc2/dwc2_pci.ko 2023-11-28T19:44:31.496 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/dwc3/ 2023-11-28T19:44:31.496 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 12089 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/dwc3/dwc3-haps.ko 2023-11-28T19:44:31.496 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 30041 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/dwc3/dwc3-pci.ko 2023-11-28T19:44:31.496 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 448505 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/dwc3/dwc3.ko 2023-11-28T19:44:31.496 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/ 2023-11-28T19:44:31.496 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/function/ 2023-11-28T19:44:31.497 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 60177 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/function/u_ether.ko 2023-11-28T19:44:31.497 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 51881 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/function/u_serial.ko 2023-11-28T19:44:31.497 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 28841 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/function/usb_f_acm.ko 2023-11-28T19:44:31.497 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 42449 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/function/usb_f_ecm.ko 2023-11-28T19:44:31.497 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 27953 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/function/usb_f_ecm_subset.ko 2023-11-28T19:44:31.497 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 36513 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/function/usb_f_eem.ko 2023-11-28T19:44:31.497 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 92489 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/function/usb_f_fs.ko 2023-11-28T19:44:31.497 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 51049 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/function/usb_f_hid.ko 2023-11-28T19:44:31.497 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 122081 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/function/usb_f_mass_storage.ko 2023-11-28T19:44:31.497 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 57681 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/function/usb_f_ncm.ko 2023-11-28T19:44:31.497 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 22185 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/function/usb_f_obex.ko 2023-11-28T19:44:31.497 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 31265 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/function/usb_f_phonet.ko 2023-11-28T19:44:31.497 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 57729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/function/usb_f_printer.ko 2023-11-28T19:44:31.497 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 85609 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/function/usb_f_rndis.ko 2023-11-28T19:44:31.498 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 19273 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/function/usb_f_serial.ko 2023-11-28T19:44:31.498 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 58113 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/function/usb_f_ss_lb.ko 2023-11-28T19:44:31.498 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 67337 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/function/usb_f_tcm.ko 2023-11-28T19:44:31.498 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/legacy/ 2023-11-28T19:44:31.498 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 21265 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/legacy/g_acm_ms.ko 2023-11-28T19:44:31.498 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 18057 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/legacy/g_cdc.ko 2023-11-28T19:44:31.498 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 18465 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/legacy/g_dbgp.ko 2023-11-28T19:44:31.498 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 21657 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/legacy/g_ether.ko 2023-11-28T19:44:31.498 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 28401 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/legacy/g_ffs.ko 2023-11-28T19:44:31.498 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 19009 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/legacy/g_hid.ko 2023-11-28T19:44:31.498 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 20409 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/legacy/g_mass_storage.ko 2023-11-28T19:44:31.498 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 16977 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/legacy/g_ncm.ko 2023-11-28T19:44:31.498 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 32073 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/legacy/g_nokia.ko 2023-11-28T19:44:31.499 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 16793 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/legacy/g_printer.ko 2023-11-28T19:44:31.499 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 19393 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/legacy/g_serial.ko 2023-11-28T19:44:31.499 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 27201 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/legacy/g_zero.ko 2023-11-28T19:44:31.499 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 62185 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/legacy/gadgetfs.ko 2023-11-28T19:44:31.499 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 15201 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/legacy/tcm_usb_gadget.ko 2023-11-28T19:44:31.499 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 161225 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/libcomposite.ko 2023-11-28T19:44:31.499 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/udc/ 2023-11-28T19:44:31.499 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 17705 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/udc/amd5536udc_pci.ko 2023-11-28T19:44:31.499 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/udc/bdc/ 2023-11-28T19:44:31.499 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 157681 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/udc/bdc/bdc.ko 2023-11-28T19:44:31.499 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 36089 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/udc/goku_udc.ko 2023-11-28T19:44:31.499 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 52721 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/udc/gr_udc.ko 2023-11-28T19:44:31.499 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 69705 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/udc/mv_u3d_core.ko 2023-11-28T19:44:31.500 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 56033 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/udc/mv_udc.ko 2023-11-28T19:44:31.500 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 76057 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/udc/net2272.ko 2023-11-28T19:44:31.500 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 75073 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/udc/net2280.ko 2023-11-28T19:44:31.500 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 73169 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/udc/pch_udc.ko 2023-11-28T19:44:31.500 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 65809 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/udc/pxa27x_udc.ko 2023-11-28T19:44:31.500 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 66097 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/udc/r8a66597-udc.ko 2023-11-28T19:44:31.500 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 81505 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/udc/snps_udc_core.ko 2023-11-28T19:44:31.500 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 156073 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/udc/udc-core.ko 2023-11-28T19:44:31.500 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/host/ 2023-11-28T19:44:31.500 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 11585 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/host/bcma-hcd.ko 2023-11-28T19:44:31.500 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 80113 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/host/isp116x-hcd.ko 2023-11-28T19:44:31.500 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 87353 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/host/oxu210hp-hcd.ko 2023-11-28T19:44:31.500 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 78873 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/host/r8a66597-hcd.ko 2023-11-28T19:44:31.500 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 51329 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/host/sl811-hcd.ko 2023-11-28T19:44:31.501 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 15593 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/host/sl811_cs.ko 2023-11-28T19:44:31.501 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 13305 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/host/ssb-hcd.ko 2023-11-28T19:44:31.501 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 25945 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/host/xhci-plat-hcd.ko 2023-11-28T19:44:31.501 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/image/ 2023-11-28T19:44:31.501 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 34585 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/image/mdc800.ko 2023-11-28T19:44:31.501 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 21081 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/image/microtek.ko 2023-11-28T19:44:31.501 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/ 2023-11-28T19:44:31.501 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 41721 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/adutux.ko 2023-11-28T19:44:31.501 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 20713 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/appledisplay.ko 2023-11-28T19:44:31.501 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 17721 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/cypress_cy7c63.ko 2023-11-28T19:44:31.501 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 23049 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/cytherm.ko 2023-11-28T19:44:31.501 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 13729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/ehset.ko 2023-11-28T19:44:31.501 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 15057 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/emi26.ko 2023-11-28T19:44:31.502 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 15985 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/emi62.ko 2023-11-28T19:44:31.502 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 11433 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/ezusb.ko 2023-11-28T19:44:31.502 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 19297 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/idmouse.ko 2023-11-28T19:44:31.502 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 36553 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/iowarrior.ko 2023-11-28T19:44:31.502 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 11593 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/isight_firmware.ko 2023-11-28T19:44:31.502 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 36529 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/ldusb.ko 2023-11-28T19:44:31.502 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 36265 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/legousbtower.ko 2023-11-28T19:44:31.502 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 27793 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/lvstest.ko 2023-11-28T19:44:31.502 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/sisusbvga/ 2023-11-28T19:44:31.502 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 64841 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2023-11-28T19:44:31.502 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 12937 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/trancevibrator.ko 2023-11-28T19:44:31.502 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 20473 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/usb3503.ko 2023-11-28T19:44:31.502 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 25145 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/usblcd.ko 2023-11-28T19:44:31.503 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 22753 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/usbsevseg.ko 2023-11-28T19:44:31.503 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 70809 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/usbtest.ko 2023-11-28T19:44:31.503 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 41905 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/uss720.ko 2023-11-28T19:44:31.503 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 27617 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/yurex.ko 2023-11-28T19:44:31.503 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/mon/ 2023-11-28T19:44:31.503 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 72953 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/mon/usbmon.ko 2023-11-28T19:44:31.503 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/musb/ 2023-11-28T19:44:31.503 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 301697 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/musb/musb_hdrc.ko 2023-11-28T19:44:31.503 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/phy/ 2023-11-28T19:44:31.503 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 21105 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/phy/phy-generic.ko 2023-11-28T19:44:31.503 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 20177 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/phy/phy-gpio-vbus-usb.ko 2023-11-28T19:44:31.503 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 12257 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/phy/phy-isp1301.ko 2023-11-28T19:44:31.504 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 21745 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/phy/phy-tahvo.ko 2023-11-28T19:44:31.504 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/ 2023-11-28T19:44:31.504 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 13209 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/aircable.ko 2023-11-28T19:44:31.504 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 33329 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/ark3116.ko 2023-11-28T19:44:31.504 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 26633 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/belkin_sa.ko 2023-11-28T19:44:31.504 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 38105 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/ch341.ko 2023-11-28T19:44:31.504 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 70257 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/cp210x.ko 2023-11-28T19:44:31.504 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 31057 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/cyberjack.ko 2023-11-28T19:44:31.504 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 58217 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/cypress_m8.ko 2023-11-28T19:44:31.504 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 49817 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/digi_acceleport.ko 2023-11-28T19:44:31.504 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 9617 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/empeg.ko 2023-11-28T19:44:31.504 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 44273 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/f81232.ko 2023-11-28T19:44:31.505 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 175137 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/ftdi_sio.ko 2023-11-28T19:44:31.505 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 53113 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/garmin_gps.ko 2023-11-28T19:44:31.505 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 137081 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/io_edgeport.ko 2023-11-28T19:44:31.505 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 124833 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/io_ti.ko 2023-11-28T19:44:31.505 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 67769 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/ipaq.ko 2023-11-28T19:44:31.505 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 19161 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/ipw.ko 2023-11-28T19:44:31.505 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 26897 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/ir-usb.ko 2023-11-28T19:44:31.505 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 58233 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/iuu_phoenix.ko 2023-11-28T19:44:31.505 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 107521 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/keyspan.ko 2023-11-28T19:44:31.505 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 35617 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/keyspan_pda.ko 2023-11-28T19:44:31.505 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 25665 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/kl5kusb105.ko 2023-11-28T19:44:31.505 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 33689 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/kobil_sct.ko 2023-11-28T19:44:31.506 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 32953 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/mct_u232.ko 2023-11-28T19:44:31.506 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 22033 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/metro-usb.ko 2023-11-28T19:44:31.506 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 66449 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/mos7720.ko 2023-11-28T19:44:31.506 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 78217 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/mos7840.ko 2023-11-28T19:44:31.506 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 56337 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/mxuport.ko 2023-11-28T19:44:31.506 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 14025 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/navman.ko 2023-11-28T19:44:31.506 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 12009 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/omninet.ko 2023-11-28T19:44:31.506 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 24633 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/opticon.ko 2023-11-28T19:44:31.506 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 191137 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/option.ko 2023-11-28T19:44:31.506 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 39073 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/oti6858.ko 2023-11-28T19:44:31.506 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 54353 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/pl2303.ko 2023-11-28T19:44:31.506 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 9737 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/qcaux.ko 2023-11-28T19:44:31.506 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 37825 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/qcserial.ko 2023-11-28T19:44:31.507 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 34321 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/quatech2.ko 2023-11-28T19:44:31.507 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 15393 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/safe_serial.ko 2023-11-28T19:44:31.507 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 51625 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/sierra.ko 2023-11-28T19:44:31.507 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 21673 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/spcp8x5.ko 2023-11-28T19:44:31.507 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 29993 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/ssu100.ko 2023-11-28T19:44:31.507 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 17265 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/symbolserial.ko 2023-11-28T19:44:31.507 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 61489 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2023-11-28T19:44:31.507 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 23729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/usb-serial-simple.ko 2023-11-28T19:44:31.507 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 10241 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/usb_debug.ko 2023-11-28T19:44:31.507 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 33201 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/usb_wwan.ko 2023-11-28T19:44:31.507 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 125609 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/usbserial.ko 2023-11-28T19:44:31.507 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 28753 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/visor.ko 2023-11-28T19:44:31.508 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 37409 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/whiteheat.ko 2023-11-28T19:44:31.508 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 10537 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/wishbone-serial.ko 2023-11-28T19:44:31.508 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 9289 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/xsens_mt.ko 2023-11-28T19:44:31.508 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/storage/ 2023-11-28T19:44:31.508 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 52913 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/storage/uas.ko 2023-11-28T19:44:31.508 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 26017 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/storage/ums-alauda.ko 2023-11-28T19:44:31.508 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 13049 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/storage/ums-cypress.ko 2023-11-28T19:44:31.508 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 22049 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/storage/ums-datafab.ko 2023-11-28T19:44:31.508 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 33497 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/storage/ums-eneub6250.ko 2023-11-28T19:44:31.508 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 13745 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/storage/ums-freecom.ko 2023-11-28T19:44:31.508 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 19769 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/storage/ums-isd200.ko 2023-11-28T19:44:31.508 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 19361 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/storage/ums-jumpshot.ko 2023-11-28T19:44:31.509 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 13713 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/storage/ums-karma.ko 2023-11-28T19:44:31.509 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 17841 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/storage/ums-onetouch.ko 2023-11-28T19:44:31.509 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 28441 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/storage/ums-realtek.ko 2023-11-28T19:44:31.509 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 28905 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/storage/ums-sddr09.ko 2023-11-28T19:44:31.509 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 19521 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/storage/ums-sddr55.ko 2023-11-28T19:44:31.509 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 35337 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/storage/ums-usbat.ko 2023-11-28T19:44:31.509 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 179969 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/storage/usb-storage.ko 2023-11-28T19:44:31.509 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/usbip/ 2023-11-28T19:44:31.509 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 67481 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/usbip/usbip-core.ko 2023-11-28T19:44:31.509 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 72177 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/usbip/usbip-host.ko 2023-11-28T19:44:31.509 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 107001 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/usbip/vhci-hcd.ko 2023-11-28T19:44:31.509 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/vfio/ 2023-11-28T19:44:31.509 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/vfio/pci/ 2023-11-28T19:44:31.510 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 154297 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/vfio/pci/vfio-pci-core.ko 2023-11-28T19:44:31.510 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 29537 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/vfio/pci/vfio-pci.ko 2023-11-28T19:44:31.510 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 108737 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/vfio/vfio.ko 2023-11-28T19:44:31.510 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 77609 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/vfio/vfio_iommu_type1.ko 2023-11-28T19:44:31.510 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/vhost/ 2023-11-28T19:44:31.510 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 113785 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/vhost/vhost.ko 2023-11-28T19:44:31.510 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 17009 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/vhost/vhost_iotlb.ko 2023-11-28T19:44:31.510 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 58089 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/vhost/vhost_net.ko 2023-11-28T19:44:31.510 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 89249 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/vhost/vhost_scsi.ko 2023-11-28T19:44:31.510 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/ 2023-11-28T19:44:31.510 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/backlight/ 2023-11-28T19:44:31.510 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 15417 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/backlight/88pm860x_bl.ko 2023-11-28T19:44:31.511 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 12393 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/backlight/aat2870_bl.ko 2023-11-28T19:44:31.511 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 23305 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/backlight/adp5520_bl.ko 2023-11-28T19:44:31.511 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 32609 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/backlight/adp8860_bl.ko 2023-11-28T19:44:31.511 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 39993 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/backlight/adp8870_bl.ko 2023-11-28T19:44:31.511 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 16921 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/backlight/apple_bl.ko 2023-11-28T19:44:31.511 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 16777 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/backlight/as3711_bl.ko 2023-11-28T19:44:31.511 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 12033 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/backlight/bd6107.ko 2023-11-28T19:44:31.511 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 11409 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/backlight/da903x_bl.ko 2023-11-28T19:44:31.511 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 11273 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/backlight/da9052_bl.ko 2023-11-28T19:44:31.511 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 11753 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/backlight/gpio_backlight.ko 2023-11-28T19:44:31.511 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 14769 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/backlight/kb3886_bl.ko 2023-11-28T19:44:31.511 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 22017 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/backlight/lcd.ko 2023-11-28T19:44:31.512 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 23657 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/backlight/lm3533_bl.ko 2023-11-28T19:44:31.512 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 19337 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/backlight/lm3639_bl.ko 2023-11-28T19:44:31.512 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 11425 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/backlight/lv5207lp.ko 2023-11-28T19:44:31.512 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 14345 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/backlight/max8925_bl.ko 2023-11-28T19:44:31.512 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 11313 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/backlight/pandora_bl.ko 2023-11-28T19:44:31.512 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 10865 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/backlight/pcf50633-backlight.ko 2023-11-28T19:44:31.512 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 10897 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/backlight/platform_lcd.ko 2023-11-28T19:44:31.512 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 12721 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/backlight/wm831x_bl.ko 2023-11-28T19:44:31.512 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/ 2023-11-28T19:44:31.512 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/masters/ 2023-11-28T19:44:31.512 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 18785 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/masters/ds2482.ko 2023-11-28T19:44:31.512 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 38985 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/masters/ds2490.ko 2023-11-28T19:44:31.512 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 11265 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/masters/matrox_w1.ko 2023-11-28T19:44:31.513 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 12417 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/masters/w1-gpio.ko 2023-11-28T19:44:31.513 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/slaves/ 2023-11-28T19:44:31.513 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 12041 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/slaves/w1_ds2406.ko 2023-11-28T19:44:31.513 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 22745 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/slaves/w1_ds2408.ko 2023-11-28T19:44:31.513 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 15113 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/slaves/w1_ds2413.ko 2023-11-28T19:44:31.513 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 10825 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/slaves/w1_ds2423.ko 2023-11-28T19:44:31.513 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 14153 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/slaves/w1_ds2431.ko 2023-11-28T19:44:31.513 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 11929 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/slaves/w1_ds2433.ko 2023-11-28T19:44:31.513 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 14049 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/slaves/w1_ds2780.ko 2023-11-28T19:44:31.513 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 14049 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/slaves/w1_ds2781.ko 2023-11-28T19:44:31.513 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 17921 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/slaves/w1_ds28e04.ko 2023-11-28T19:44:31.513 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 7385 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/slaves/w1_smem.ko 2023-11-28T19:44:31.513 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 56425 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/slaves/w1_therm.ko 2023-11-28T19:44:31.514 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 102673 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/wire.ko 2023-11-28T19:44:31.514 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/ 2023-11-28T19:44:31.514 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 18793 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/acquirewdt.ko 2023-11-28T19:44:31.514 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 19977 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/advantechwdt.ko 2023-11-28T19:44:31.514 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 18561 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/alim1535_wdt.ko 2023-11-28T19:44:31.514 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 22969 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/alim7101_wdt.ko 2023-11-28T19:44:31.514 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 19113 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/cpu5wdt.ko 2023-11-28T19:44:31.514 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 13617 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/da9052_wdt.ko 2023-11-28T19:44:31.514 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 12777 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/da9055_wdt.ko 2023-11-28T19:44:31.514 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 17409 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/da9063_wdt.ko 2023-11-28T19:44:31.514 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 20169 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/dw_wdt.ko 2023-11-28T19:44:31.514 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 20265 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/eurotechwdt.ko 2023-11-28T19:44:31.514 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 23865 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/f71808e_wdt.ko 2023-11-28T19:44:31.515 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 27401 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/hpwdt.ko 2023-11-28T19:44:31.515 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 15577 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/i6300esb.ko 2023-11-28T19:44:31.515 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 10833 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/iTCO_vendor_support.ko 2023-11-28T19:44:31.515 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 21913 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/iTCO_wdt.ko 2023-11-28T19:44:31.515 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 19241 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/ib700wdt.ko 2023-11-28T19:44:31.515 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 18689 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/ibmasr.ko 2023-11-28T19:44:31.515 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 19713 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/ie6xx_wdt.ko 2023-11-28T19:44:31.515 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 21225 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/it8712f_wdt.ko 2023-11-28T19:44:31.515 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 13841 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/it87_wdt.ko 2023-11-28T19:44:31.515 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 21489 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/kempld_wdt.ko 2023-11-28T19:44:31.515 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 18617 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/machzwd.ko 2023-11-28T19:44:31.515 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 14721 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/mena21_wdt.ko 2023-11-28T19:44:31.515 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 13217 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/menf21bmc_wdt.ko 2023-11-28T19:44:31.516 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 24673 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/nv_tco.ko 2023-11-28T19:44:31.516 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 17737 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/of_xilinx_wdt.ko 2023-11-28T19:44:31.516 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 22265 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/pc87413_wdt.ko 2023-11-28T19:44:31.516 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 38657 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/pcwd_pci.ko 2023-11-28T19:44:31.516 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 31825 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/pcwd_usb.ko 2023-11-28T19:44:31.516 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 13065 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/retu_wdt.ko 2023-11-28T19:44:31.516 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 20449 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/sbc60xxwdt.ko 2023-11-28T19:44:31.516 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 14129 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/sbc_epx_c3.ko 2023-11-28T19:44:31.516 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 17321 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2023-11-28T19:44:31.516 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 23809 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/sc1200wdt.ko 2023-11-28T19:44:31.516 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 23321 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/sch311x_wdt.ko 2023-11-28T19:44:31.516 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 21577 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/smsc37b787_wdt.ko 2023-11-28T19:44:31.516 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 17273 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/softdog.ko 2023-11-28T19:44:31.517 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 22273 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/sp5100_tco.ko 2023-11-28T19:44:31.517 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 12817 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/twl4030_wdt.ko 2023-11-28T19:44:31.517 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 17649 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/via_wdt.ko 2023-11-28T19:44:31.517 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 19161 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/w83627hf_wdt.ko 2023-11-28T19:44:31.517 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 20681 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/w83877f_wdt.ko 2023-11-28T19:44:31.517 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 25409 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/w83977f_wdt.ko 2023-11-28T19:44:31.517 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 18497 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/wafer5823wdt.ko 2023-11-28T19:44:31.517 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 28089 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/wdt_pci.ko 2023-11-28T19:44:31.517 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 16257 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/wm831x_wdt.ko 2023-11-28T19:44:31.517 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 13785 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/wm8350_wdt.ko 2023-11-28T19:44:31.517 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 15697 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/xen_wdt.ko 2023-11-28T19:44:31.517 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/xen/ 2023-11-28T19:44:31.517 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 24729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/xen/xen-evtchn.ko 2023-11-28T19:44:31.518 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 26769 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/xen/xen-gntalloc.ko 2023-11-28T19:44:31.518 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 47865 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/xen/xen-gntdev.ko 2023-11-28T19:44:31.518 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/xen/xen-pciback/ 2023-11-28T19:44:31.518 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 176377 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2023-11-28T19:44:31.518 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 40121 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/xen/xen-privcmd.ko 2023-11-28T19:44:31.518 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 71249 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/xen/xen-scsiback.ko 2023-11-28T19:44:31.518 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/xen/xenfs/ 2023-11-28T19:44:31.518 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 19425 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/xen/xenfs/xenfs.ko 2023-11-28T19:44:31.518 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ 2023-11-28T19:44:31.518 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/9p/ 2023-11-28T19:44:31.518 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 166425 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/9p/9p.ko 2023-11-28T19:44:31.518 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/adfs/ 2023-11-28T19:44:31.518 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 61073 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/adfs/adfs.ko 2023-11-28T19:44:31.519 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/affs/ 2023-11-28T19:44:31.519 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 163593 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/affs/affs.ko 2023-11-28T19:44:31.519 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/afs/ 2023-11-28T19:44:31.519 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 932817 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/afs/kafs.ko 2023-11-28T19:44:31.519 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/autofs/ 2023-11-28T19:44:31.519 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 101057 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/autofs/autofs4.ko 2023-11-28T19:44:31.519 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/befs/ 2023-11-28T19:44:31.519 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 64545 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/befs/befs.ko 2023-11-28T19:44:31.519 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/bfs/ 2023-11-28T19:44:31.519 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 41257 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/bfs/bfs.ko 2023-11-28T19:44:31.519 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 34585 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/binfmt_misc.ko 2023-11-28T19:44:31.519 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/btrfs/ 2023-11-28T19:44:31.519 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 3402729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/btrfs/btrfs.ko 2023-11-28T19:44:31.519 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/cachefiles/ 2023-11-28T19:44:31.520 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 306009 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/cachefiles/cachefiles.ko 2023-11-28T19:44:31.565 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ceph/ 2023-11-28T19:44:31.565 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 1333017 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ceph/ceph.ko 2023-11-28T19:44:31.565 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/coda/ 2023-11-28T19:44:31.565 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 100801 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/coda/coda.ko 2023-11-28T19:44:31.565 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/configfs/ 2023-11-28T19:44:31.566 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 108393 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/configfs/configfs.ko 2023-11-28T19:44:31.566 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/cramfs/ 2023-11-28T19:44:31.566 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 29625 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/cramfs/cramfs.ko 2023-11-28T19:44:31.566 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/dlm/ 2023-11-28T19:44:31.566 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 642513 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/dlm/dlm.ko 2023-11-28T19:44:31.566 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/efs/ 2023-11-28T19:44:31.566 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 36649 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/efs/efs.ko 2023-11-28T19:44:31.566 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/f2fs/ 2023-11-28T19:44:31.566 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 1505025 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/f2fs/f2fs.ko 2023-11-28T19:44:31.566 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/fat/ 2023-11-28T19:44:31.566 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 27929 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/fat/msdos.ko 2023-11-28T19:44:31.566 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/freevxfs/ 2023-11-28T19:44:31.567 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 42545 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/freevxfs/freevxfs.ko 2023-11-28T19:44:31.567 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/fscache/ 2023-11-28T19:44:31.567 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 226481 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/fscache/fscache.ko 2023-11-28T19:44:31.567 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/fuse/ 2023-11-28T19:44:31.567 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 24489 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/fuse/cuse.ko 2023-11-28T19:44:31.567 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/gfs2/ 2023-11-28T19:44:31.567 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 1231529 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/gfs2/gfs2.ko 2023-11-28T19:44:31.567 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/hfs/ 2023-11-28T19:44:31.567 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 141209 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/hfs/hfs.ko 2023-11-28T19:44:31.567 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/hfsplus/ 2023-11-28T19:44:31.567 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 222817 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/hfsplus/hfsplus.ko 2023-11-28T19:44:31.567 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/hpfs/ 2023-11-28T19:44:31.567 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 192329 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/hpfs/hpfs.ko 2023-11-28T19:44:31.567 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/isofs/ 2023-11-28T19:44:31.568 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 74065 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/isofs/isofs.ko 2023-11-28T19:44:31.568 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/jfs/ 2023-11-28T19:44:31.568 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 419497 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/jfs/jfs.ko 2023-11-28T19:44:31.568 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/lockd/ 2023-11-28T19:44:31.568 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 280313 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/lockd/lockd.ko 2023-11-28T19:44:31.568 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/minix/ 2023-11-28T19:44:31.568 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 89193 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/minix/minix.ko 2023-11-28T19:44:31.568 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/netfs/ 2023-11-28T19:44:31.568 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 124649 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/netfs/netfs.ko 2023-11-28T19:44:31.568 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nfs/ 2023-11-28T19:44:31.568 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nfs/blocklayout/ 2023-11-28T19:44:31.568 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 81449 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2023-11-28T19:44:31.568 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nfs/filelayout/ 2023-11-28T19:44:31.569 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 59449 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2023-11-28T19:44:31.569 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nfs/flexfilelayout/ 2023-11-28T19:44:31.569 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 117465 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2023-11-28T19:44:31.569 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 1055721 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nfs/nfs.ko 2023-11-28T19:44:31.569 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 66441 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nfs/nfsv2.ko 2023-11-28T19:44:31.569 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 120177 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nfs/nfsv3.ko 2023-11-28T19:44:31.569 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 2042137 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nfs/nfsv4.ko 2023-11-28T19:44:31.569 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nfs_common/ 2023-11-28T19:44:31.569 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 16929 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nfs_common/grace.ko 2023-11-28T19:44:31.569 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 16145 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nfs_common/nfs_acl.ko 2023-11-28T19:44:31.569 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nfsd/ 2023-11-28T19:44:31.569 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 1516873 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nfsd/nfsd.ko 2023-11-28T19:44:31.570 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nilfs2/ 2023-11-28T19:44:31.570 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 592833 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nilfs2/nilfs2.ko 2023-11-28T19:44:31.570 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/ 2023-11-28T19:44:31.570 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 13793 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/mac-celtic.ko 2023-11-28T19:44:31.570 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 13169 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/mac-centeuro.ko 2023-11-28T19:44:31.570 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 13793 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/mac-croatian.ko 2023-11-28T19:44:31.570 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 12865 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/mac-cyrillic.ko 2023-11-28T19:44:31.570 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 13481 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/mac-gaelic.ko 2023-11-28T19:44:31.570 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 12857 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/mac-greek.ko 2023-11-28T19:44:31.570 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 13793 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/mac-iceland.ko 2023-11-28T19:44:31.570 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 13169 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/mac-inuit.ko 2023-11-28T19:44:31.570 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 14097 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/mac-roman.ko 2023-11-28T19:44:31.571 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 13793 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/mac-romanian.ko 2023-11-28T19:44:31.571 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 13793 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/mac-turkish.ko 2023-11-28T19:44:31.571 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 11297 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_ascii.ko 2023-11-28T19:44:31.571 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 12537 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp1250.ko 2023-11-28T19:44:31.571 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 12233 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp1251.ko 2023-11-28T19:44:31.571 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 12921 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp1255.ko 2023-11-28T19:44:31.571 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 12537 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp737.ko 2023-11-28T19:44:31.571 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 12537 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp775.ko 2023-11-28T19:44:31.571 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 12225 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp850.ko 2023-11-28T19:44:31.571 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 12225 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp852.ko 2023-11-28T19:44:31.571 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 12225 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp855.ko 2023-11-28T19:44:31.571 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 11913 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp857.ko 2023-11-28T19:44:31.572 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 12849 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp860.ko 2023-11-28T19:44:31.572 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 13161 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp861.ko 2023-11-28T19:44:31.572 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 13473 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp862.ko 2023-11-28T19:44:31.572 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 13161 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp863.ko 2023-11-28T19:44:31.572 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 12849 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp864.ko 2023-11-28T19:44:31.572 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 13161 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp865.ko 2023-11-28T19:44:31.572 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 12537 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp866.ko 2023-11-28T19:44:31.572 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 12225 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp869.ko 2023-11-28T19:44:31.572 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 11985 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp874.ko 2023-11-28T19:44:31.572 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 94137 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp932.ko 2023-11-28T19:44:31.572 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 142673 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp936.ko 2023-11-28T19:44:31.572 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 165745 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp949.ko 2023-11-28T19:44:31.573 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 118121 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp950.ko 2023-11-28T19:44:31.573 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 12457 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_euc-jp.ko 2023-11-28T19:44:31.573 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 11305 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_iso8859-1.ko 2023-11-28T19:44:31.573 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 11929 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_iso8859-13.ko 2023-11-28T19:44:31.573 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 11929 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_iso8859-14.ko 2023-11-28T19:44:31.573 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 11929 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_iso8859-15.ko 2023-11-28T19:44:31.573 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 11921 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_iso8859-2.ko 2023-11-28T19:44:31.573 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 11921 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_iso8859-3.ko 2023-11-28T19:44:31.573 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 11921 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_iso8859-4.ko 2023-11-28T19:44:31.573 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 11921 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_iso8859-5.ko 2023-11-28T19:44:31.573 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 11617 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_iso8859-6.ko 2023-11-28T19:44:31.573 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 12233 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_iso8859-7.ko 2023-11-28T19:44:31.574 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 11617 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_iso8859-9.ko 2023-11-28T19:44:31.574 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 12537 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_koi8-r.ko 2023-11-28T19:44:31.574 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 8017 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_koi8-ru.ko 2023-11-28T19:44:31.574 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 12537 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_koi8-u.ko 2023-11-28T19:44:31.574 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 7569 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_ucs2_utils.ko 2023-11-28T19:44:31.574 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 8337 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_utf8.ko 2023-11-28T19:44:31.574 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ntfs/ 2023-11-28T19:44:31.574 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 219417 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ntfs/ntfs.ko 2023-11-28T19:44:31.574 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ocfs2/ 2023-11-28T19:44:31.574 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ocfs2/cluster/ 2023-11-28T19:44:31.574 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 244409 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2023-11-28T19:44:31.574 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ocfs2/dlm/ 2023-11-28T19:44:31.575 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 440737 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2023-11-28T19:44:31.575 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ocfs2/dlmfs/ 2023-11-28T19:44:31.575 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 54049 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2023-11-28T19:44:31.575 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 2592433 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ocfs2/ocfs2.ko 2023-11-28T19:44:31.575 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 17905 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2023-11-28T19:44:31.575 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 31729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ocfs2/ocfs2_stack_user.ko 2023-11-28T19:44:31.575 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 35897 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ocfs2/ocfs2_stackglue.ko 2023-11-28T19:44:31.575 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/omfs/ 2023-11-28T19:44:31.575 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 53433 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/omfs/omfs.ko 2023-11-28T19:44:31.575 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/overlayfs/ 2023-11-28T19:44:31.575 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 352161 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/overlayfs/overlay.ko 2023-11-28T19:44:31.575 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/pstore/ 2023-11-28T19:44:31.575 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 54809 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/pstore/ramoops.ko 2023-11-28T19:44:31.576 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/qnx4/ 2023-11-28T19:44:31.576 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 26865 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/qnx4/qnx4.ko 2023-11-28T19:44:31.576 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/qnx6/ 2023-11-28T19:44:31.576 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 46689 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/qnx6/qnx6.ko 2023-11-28T19:44:31.576 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/quota/ 2023-11-28T19:44:31.576 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 30881 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/quota/quota_tree.ko 2023-11-28T19:44:31.576 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 14297 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/quota/quota_v1.ko 2023-11-28T19:44:31.576 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 22017 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/quota/quota_v2.ko 2023-11-28T19:44:31.576 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/reiserfs/ 2023-11-28T19:44:31.576 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 532673 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/reiserfs/reiserfs.ko 2023-11-28T19:44:31.576 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/romfs/ 2023-11-28T19:44:31.576 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 28641 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/romfs/romfs.ko 2023-11-28T19:44:31.577 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/smb/ 2023-11-28T19:44:31.577 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/smb/client/ 2023-11-28T19:44:31.577 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 2668401 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/smb/client/cifs.ko 2023-11-28T19:44:31.577 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/smb/common/ 2023-11-28T19:44:31.577 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 7161 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/smb/common/cifs_arc4.ko 2023-11-28T19:44:31.577 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 11257 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/smb/common/cifs_md4.ko 2023-11-28T19:44:31.577 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/squashfs/ 2023-11-28T19:44:31.577 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 134641 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/squashfs/squashfs.ko 2023-11-28T19:44:31.577 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/sysv/ 2023-11-28T19:44:31.577 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 90721 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/sysv/sysv.ko 2023-11-28T19:44:31.577 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/udf/ 2023-11-28T19:44:31.577 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 247737 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/udf/udf.ko 2023-11-28T19:44:31.578 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ufs/ 2023-11-28T19:44:31.578 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 162497 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ufs/ufs.ko 2023-11-28T19:44:31.578 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/xfs/ 2023-11-28T19:44:31.578 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 4011017 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/xfs/xfs.ko 2023-11-28T19:44:31.578 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/kernel/ 2023-11-28T19:44:31.578 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/kernel/locking/ 2023-11-28T19:44:31.578 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 75489 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/kernel/locking/locktorture.ko 2023-11-28T19:44:31.578 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/kernel/time/ 2023-11-28T19:44:31.578 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 13737 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/kernel/time/test_udelay.ko 2023-11-28T19:44:31.578 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 60553 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/kernel/torture.ko 2023-11-28T19:44:31.578 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/ 2023-11-28T19:44:31.578 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 6833 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/crc-itu-t.ko 2023-11-28T19:44:31.578 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 6529 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/crc7.ko 2023-11-28T19:44:31.579 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 7025 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/crc8.ko 2023-11-28T19:44:31.579 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/crypto/ 2023-11-28T19:44:31.579 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 7097 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/crypto/libarc4.ko 2023-11-28T19:44:31.579 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 37081 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/crypto/libdes.ko 2023-11-28T19:44:31.579 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 13313 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/interval_tree_test.ko 2023-11-28T19:44:31.579 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 8425 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/libcrc32c.ko 2023-11-28T19:44:31.579 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 24953 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/lru_cache.ko 2023-11-28T19:44:31.579 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/lz4/ 2023-11-28T19:44:31.579 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 33801 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/lz4/lz4_compress.ko 2023-11-28T19:44:31.579 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 22633 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/lz4/lz4hc_compress.ko 2023-11-28T19:44:31.579 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/math/ 2023-11-28T19:44:31.579 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 6617 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/math/cordic.ko 2023-11-28T19:44:31.579 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 8233 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/memory-notifier-error-inject.ko 2023-11-28T19:44:31.580 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 10865 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/notifier-error-inject.ko 2023-11-28T19:44:31.580 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 14089 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/percpu_test.ko 2023-11-28T19:44:31.580 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 8305 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/pm-notifier-error-inject.ko 2023-11-28T19:44:31.580 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/raid6/ 2023-11-28T19:44:31.580 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 143433 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/raid6/raid6_pq.ko 2023-11-28T19:44:31.580 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 21105 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/rbtree_test.ko 2023-11-28T19:44:31.580 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/reed_solomon/ 2023-11-28T19:44:31.580 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 18753 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/reed_solomon/reed_solomon.ko 2023-11-28T19:44:31.580 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 38841 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/test-kstrtox.ko 2023-11-28T19:44:31.580 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 26321 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/test-string_helpers.ko 2023-11-28T19:44:31.580 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 4760425 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/test_bpf.ko 2023-11-28T19:44:31.580 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 49089 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/test_firmware.ko 2023-11-28T19:44:31.581 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 6369 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/test_module.ko 2023-11-28T19:44:31.581 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 20801 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/test_user_copy.ko 2023-11-28T19:44:31.581 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 9585 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/ts_bm.ko 2023-11-28T19:44:31.581 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 11121 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/ts_fsm.ko 2023-11-28T19:44:31.581 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 9625 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/ts_kmp.ko 2023-11-28T19:44:31.581 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/xz/ 2023-11-28T19:44:31.581 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 13545 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/xz/xz_dec_test.ko 2023-11-28T19:44:31.581 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/mm/ 2023-11-28T19:44:31.581 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 15425 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/mm/hwpoison-inject.ko 2023-11-28T19:44:31.581 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ 2023-11-28T19:44:31.581 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/6lowpan/ 2023-11-28T19:44:31.581 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 55737 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/6lowpan/6lowpan.ko 2023-11-28T19:44:31.582 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 7049 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/6lowpan/nhc_dest.ko 2023-11-28T19:44:31.582 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 7065 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/6lowpan/nhc_fragment.ko 2023-11-28T19:44:31.582 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 7049 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/6lowpan/nhc_hop.ko 2023-11-28T19:44:31.582 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 6985 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/6lowpan/nhc_ipv6.ko 2023-11-28T19:44:31.582 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 7065 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/6lowpan/nhc_mobility.ko 2023-11-28T19:44:31.582 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 7001 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/6lowpan/nhc_routing.ko 2023-11-28T19:44:31.582 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 15329 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/6lowpan/nhc_udp.ko 2023-11-28T19:44:31.582 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/802/ 2023-11-28T19:44:31.582 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 30385 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/802/garp.ko 2023-11-28T19:44:31.582 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 34809 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/802/mrp.ko 2023-11-28T19:44:31.582 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 8545 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/802/p8022.ko 2023-11-28T19:44:31.583 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 16345 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/802/psnap.ko 2023-11-28T19:44:31.583 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 11537 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/802/stp.ko 2023-11-28T19:44:31.583 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/8021q/ 2023-11-28T19:44:31.583 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 81737 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/8021q/8021q.ko 2023-11-28T19:44:31.583 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/9p/ 2023-11-28T19:44:31.583 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 198337 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/9p/9pnet.ko 2023-11-28T19:44:31.583 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 35977 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/9p/9pnet_fd.ko 2023-11-28T19:44:31.583 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 26345 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/9p/9pnet_rdma.ko 2023-11-28T19:44:31.583 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 32337 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/9p/9pnet_virtio.ko 2023-11-28T19:44:31.583 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/batman-adv/ 2023-11-28T19:44:31.583 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 649297 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/batman-adv/batman-adv.ko 2023-11-28T19:44:31.583 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/ 2023-11-28T19:44:31.583 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 63809 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/br_netfilter.ko 2023-11-28T19:44:31.584 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 777689 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/bridge.ko 2023-11-28T19:44:31.584 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ 2023-11-28T19:44:31.584 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 7657 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_802_3.ko 2023-11-28T19:44:31.584 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 12385 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_among.ko 2023-11-28T19:44:31.584 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 9169 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_arp.ko 2023-11-28T19:44:31.584 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 9073 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_arpreply.ko 2023-11-28T19:44:31.584 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 9625 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_dnat.ko 2023-11-28T19:44:31.584 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 8737 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_ip.ko 2023-11-28T19:44:31.584 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 9145 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_ip6.ko 2023-11-28T19:44:31.584 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 9825 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_limit.ko 2023-11-28T19:44:31.584 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 13217 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_log.ko 2023-11-28T19:44:31.584 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 7585 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_mark.ko 2023-11-28T19:44:31.585 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 7593 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_mark_m.ko 2023-11-28T19:44:31.585 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 8385 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_nflog.ko 2023-11-28T19:44:31.585 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 7537 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_pkttype.ko 2023-11-28T19:44:31.585 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 9593 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_redirect.ko 2023-11-28T19:44:31.585 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 8649 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_snat.ko 2023-11-28T19:44:31.585 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 8825 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_stp.ko 2023-11-28T19:44:31.585 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 12401 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_vlan.ko 2023-11-28T19:44:31.585 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 11529 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebtable_broute.ko 2023-11-28T19:44:31.585 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 9817 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebtable_filter.ko 2023-11-28T19:44:31.585 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 9793 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebtable_nat.ko 2023-11-28T19:44:31.585 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 55929 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebtables.ko 2023-11-28T19:44:31.585 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 14041 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2023-11-28T19:44:31.586 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 13945 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2023-11-28T19:44:31.586 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ceph/ 2023-11-28T19:44:31.586 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 1046833 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ceph/libceph.ko 2023-11-28T19:44:31.586 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/core/ 2023-11-28T19:44:31.586 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 125993 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/core/pktgen.ko 2023-11-28T19:44:31.586 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/dccp/ 2023-11-28T19:44:31.586 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 194209 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/dccp/dccp.ko 2023-11-28T19:44:31.586 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 8665 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/dccp/dccp_diag.ko 2023-11-28T19:44:31.586 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 57881 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/dccp/dccp_ipv4.ko 2023-11-28T19:44:31.586 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 60337 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/dccp/dccp_ipv6.ko 2023-11-28T19:44:31.586 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/dsa/ 2023-11-28T19:44:31.586 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 390473 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/dsa/dsa_core.ko 2023-11-28T19:44:31.587 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 13337 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/dsa/tag_brcm.ko 2023-11-28T19:44:31.587 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 12577 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/dsa/tag_dsa.ko 2023-11-28T19:44:31.587 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 7721 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/dsa/tag_none.ko 2023-11-28T19:44:31.587 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 8953 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/dsa/tag_trailer.ko 2023-11-28T19:44:31.587 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/hsr/ 2023-11-28T19:44:31.587 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 99729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/hsr/hsr.ko 2023-11-28T19:44:31.587 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ieee802154/ 2023-11-28T19:44:31.587 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ieee802154/6lowpan/ 2023-11-28T19:44:31.587 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 45233 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2023-11-28T19:44:31.587 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 254625 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ieee802154/ieee802154.ko 2023-11-28T19:44:31.587 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 47289 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ieee802154/ieee802154_socket.ko 2023-11-28T19:44:31.587 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/ 2023-11-28T19:44:31.587 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 24729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/ah4.ko 2023-11-28T19:44:31.588 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 38905 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/esp4.ko 2023-11-28T19:44:31.588 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 48337 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/fou.ko 2023-11-28T19:44:31.588 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 18121 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/gre.ko 2023-11-28T19:44:31.588 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 48657 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/inet_diag.ko 2023-11-28T19:44:31.588 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 60633 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/ip_gre.ko 2023-11-28T19:44:31.588 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 61225 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/ip_tunnel.ko 2023-11-28T19:44:31.588 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 34505 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/ip_vti.ko 2023-11-28T19:44:31.588 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 14001 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/ipcomp.ko 2023-11-28T19:44:31.588 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 28841 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/ipip.ko 2023-11-28T19:44:31.588 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/ 2023-11-28T19:44:31.588 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 37641 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/arp_tables.ko 2023-11-28T19:44:31.588 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 8873 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/arpt_mangle.ko 2023-11-28T19:44:31.589 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 10409 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/arptable_filter.ko 2023-11-28T19:44:31.589 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 41609 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/ip_tables.ko 2023-11-28T19:44:31.589 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 10057 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/ipt_ECN.ko 2023-11-28T19:44:31.589 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 9681 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/ipt_REJECT.ko 2023-11-28T19:44:31.589 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 14121 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2023-11-28T19:44:31.589 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 11177 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/ipt_ah.ko 2023-11-28T19:44:31.589 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 14881 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2023-11-28T19:44:31.589 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 11305 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/iptable_filter.ko 2023-11-28T19:44:31.589 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 11649 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/iptable_mangle.ko 2023-11-28T19:44:31.589 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 14905 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/iptable_nat.ko 2023-11-28T19:44:31.589 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 11545 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/iptable_raw.ko 2023-11-28T19:44:31.589 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 10409 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/iptable_security.ko 2023-11-28T19:44:31.589 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 12425 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2023-11-28T19:44:31.590 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 8817 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2023-11-28T19:44:31.590 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 27625 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2023-11-28T19:44:31.590 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 18161 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2023-11-28T19:44:31.590 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 13337 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2023-11-28T19:44:31.590 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 20561 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/nf_reject_ipv4.ko 2023-11-28T19:44:31.590 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 9329 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2023-11-28T19:44:31.590 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 15177 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2023-11-28T19:44:31.590 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 9961 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2023-11-28T19:44:31.590 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 17113 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2023-11-28T19:44:31.590 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 9009 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2023-11-28T19:44:31.590 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 13073 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/tcp_bic.ko 2023-11-28T19:44:31.590 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 13737 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/tcp_dctcp.ko 2023-11-28T19:44:31.590 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 15369 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/tcp_diag.ko 2023-11-28T19:44:31.591 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 9537 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/tcp_highspeed.ko 2023-11-28T19:44:31.591 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 12401 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/tcp_htcp.ko 2023-11-28T19:44:31.591 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 10449 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/tcp_hybla.ko 2023-11-28T19:44:31.591 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 11473 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/tcp_illinois.ko 2023-11-28T19:44:31.591 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 10433 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/tcp_lp.ko 2023-11-28T19:44:31.591 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 8329 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/tcp_scalable.ko 2023-11-28T19:44:31.591 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 14425 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/tcp_vegas.ko 2023-11-28T19:44:31.592 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 10089 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/tcp_veno.ko 2023-11-28T19:44:31.592 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 10953 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/tcp_westwood.ko 2023-11-28T19:44:31.592 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 10185 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/tcp_yeah.ko 2023-11-28T19:44:31.592 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 22601 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/tunnel4.ko 2023-11-28T19:44:31.592 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 17097 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/udp_diag.ko 2023-11-28T19:44:31.592 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 41665 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/udp_tunnel.ko 2023-11-28T19:44:31.593 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 11361 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/xfrm4_tunnel.ko 2023-11-28T19:44:31.593 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/ 2023-11-28T19:44:31.593 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 26377 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/ah6.ko 2023-11-28T19:44:31.593 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 39537 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/esp6.ko 2023-11-28T19:44:31.593 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 14425 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/fou6.ko 2023-11-28T19:44:31.593 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 80897 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/ip6_gre.ko 2023-11-28T19:44:31.593 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 93577 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/ip6_tunnel.ko 2023-11-28T19:44:31.593 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 10825 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/ip6_udp_tunnel.ko 2023-11-28T19:44:31.593 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 53273 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/ip6_vti.ko 2023-11-28T19:44:31.593 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 13785 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/ipcomp6.ko 2023-11-28T19:44:31.593 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 19017 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/mip6.ko 2023-11-28T19:44:31.593 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ 2023-11-28T19:44:31.593 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 42169 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6_tables.ko 2023-11-28T19:44:31.594 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 11753 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6t_NPT.ko 2023-11-28T19:44:31.594 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 9753 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2023-11-28T19:44:31.594 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 14137 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2023-11-28T19:44:31.594 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 14273 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6t_ah.ko 2023-11-28T19:44:31.594 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 7801 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2023-11-28T19:44:31.594 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 16209 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6t_frag.ko 2023-11-28T19:44:31.594 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 16033 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2023-11-28T19:44:31.594 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 8913 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2023-11-28T19:44:31.594 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 9897 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6t_mh.ko 2023-11-28T19:44:31.594 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 10937 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2023-11-28T19:44:31.594 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 10897 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6t_rt.ko 2023-11-28T19:44:31.594 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 11321 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6table_filter.ko 2023-11-28T19:44:31.595 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 11121 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2023-11-28T19:44:31.595 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 15009 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6table_nat.ko 2023-11-28T19:44:31.595 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 11553 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6table_raw.ko 2023-11-28T19:44:31.595 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 10433 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6table_security.ko 2023-11-28T19:44:31.595 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 39113 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2023-11-28T19:44:31.595 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 8449 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2023-11-28T19:44:31.595 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 25945 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2023-11-28T19:44:31.595 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 9801 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2023-11-28T19:44:31.595 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 15393 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2023-11-28T19:44:31.595 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 9633 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2023-11-28T19:44:31.595 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 16025 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2023-11-28T19:44:31.595 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 9009 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2023-11-28T19:44:31.595 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 74073 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/sit.ko 2023-11-28T19:44:31.596 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 24193 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/tunnel6.ko 2023-11-28T19:44:31.596 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 23297 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/xfrm6_tunnel.ko 2023-11-28T19:44:31.596 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/key/ 2023-11-28T19:44:31.596 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 82833 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/key/af_key.ko 2023-11-28T19:44:31.596 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/l2tp/ 2023-11-28T19:44:31.596 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 125281 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/l2tp/l2tp_core.ko 2023-11-28T19:44:31.596 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 20177 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/l2tp/l2tp_debugfs.ko 2023-11-28T19:44:31.596 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 25953 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/l2tp/l2tp_eth.ko 2023-11-28T19:44:31.596 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 35569 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/l2tp/l2tp_ip.ko 2023-11-28T19:44:31.596 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 36713 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/l2tp/l2tp_ip6.ko 2023-11-28T19:44:31.596 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 33001 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/l2tp/l2tp_netlink.ko 2023-11-28T19:44:31.597 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 53241 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/l2tp/l2tp_ppp.ko 2023-11-28T19:44:31.597 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/lapb/ 2023-11-28T19:44:31.597 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 47977 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/lapb/lapb.ko 2023-11-28T19:44:31.597 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/llc/ 2023-11-28T19:44:31.597 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 23193 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/llc/llc.ko 2023-11-28T19:44:31.597 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 267913 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/llc/llc2.ko 2023-11-28T19:44:31.597 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/mac802154/ 2023-11-28T19:44:31.597 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 290417 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/mac802154/mac802154.ko 2023-11-28T19:44:31.597 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/mpls/ 2023-11-28T19:44:31.597 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 9393 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/mpls/mpls_gso.ko 2023-11-28T19:44:31.597 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ 2023-11-28T19:44:31.597 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ 2023-11-28T19:44:31.598 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 119585 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ip_set.ko 2023-11-28T19:44:31.598 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 28353 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2023-11-28T19:44:31.598 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 26913 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2023-11-28T19:44:31.598 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 26369 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2023-11-28T19:44:31.598 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 100297 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2023-11-28T19:44:31.598 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 101441 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2023-11-28T19:44:31.598 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 102817 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2023-11-28T19:44:31.598 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 103417 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2023-11-28T19:44:31.598 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 112849 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2023-11-28T19:44:31.598 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 60329 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2023-11-28T19:44:31.598 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 109593 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2023-11-28T19:44:31.598 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 113129 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2023-11-28T19:44:31.598 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 112585 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2023-11-28T19:44:31.599 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 111585 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2023-11-28T19:44:31.599 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 114465 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2023-11-28T19:44:31.599 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 30025 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ip_set_list_set.ko 2023-11-28T19:44:31.599 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipvs/ 2023-11-28T19:44:31.599 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 411729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipvs/ip_vs.ko 2023-11-28T19:44:31.599 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 11961 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2023-11-28T19:44:31.599 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 7625 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2023-11-28T19:44:31.599 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 17729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2023-11-28T19:44:31.599 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 17905 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2023-11-28T19:44:31.599 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 20673 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2023-11-28T19:44:31.599 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 7689 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2023-11-28T19:44:31.599 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 7689 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2023-11-28T19:44:31.599 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 10681 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2023-11-28T19:44:31.600 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 9233 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2023-11-28T19:44:31.600 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 7697 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2023-11-28T19:44:31.600 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 13521 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2023-11-28T19:44:31.600 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 7697 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2023-11-28T19:44:31.600 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 10993 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2023-11-28T19:44:31.600 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 49257 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_conncount.ko 2023-11-28T19:44:31.600 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 408257 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_conntrack.ko 2023-11-28T19:44:31.600 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 15985 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_conntrack_amanda.ko 2023-11-28T19:44:31.600 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 10177 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_conntrack_broadcast.ko 2023-11-28T19:44:31.600 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 33761 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_conntrack_ftp.ko 2023-11-28T19:44:31.600 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 118145 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_conntrack_h323.ko 2023-11-28T19:44:31.600 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 22185 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_conntrack_irc.ko 2023-11-28T19:44:31.601 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 8817 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2023-11-28T19:44:31.601 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 107233 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_conntrack_netlink.ko 2023-11-28T19:44:31.601 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 33633 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_conntrack_pptp.ko 2023-11-28T19:44:31.601 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 17401 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_conntrack_sane.ko 2023-11-28T19:44:31.601 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 66641 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_conntrack_sip.ko 2023-11-28T19:44:31.601 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 11233 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_conntrack_snmp.ko 2023-11-28T19:44:31.601 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 19185 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_conntrack_tftp.ko 2023-11-28T19:44:31.601 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 10113 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_dup_netdev.ko 2023-11-28T19:44:31.601 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 89425 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_flow_table.ko 2023-11-28T19:44:31.601 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 9593 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_flow_table_inet.ko 2023-11-28T19:44:31.601 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 37129 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_log_syslog.ko 2023-11-28T19:44:31.601 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 95353 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_nat.ko 2023-11-28T19:44:31.602 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 10129 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_nat_amanda.ko 2023-11-28T19:44:31.602 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 12625 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_nat_ftp.ko 2023-11-28T19:44:31.602 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 11857 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_nat_irc.ko 2023-11-28T19:44:31.602 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 28929 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_nat_sip.ko 2023-11-28T19:44:31.602 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 8809 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_nat_tftp.ko 2023-11-28T19:44:31.602 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 44065 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_synproxy_core.ko 2023-11-28T19:44:31.602 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 615649 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_tables.ko 2023-11-28T19:44:31.602 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 42561 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nfnetlink.ko 2023-11-28T19:44:31.602 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 30233 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nfnetlink_acct.ko 2023-11-28T19:44:31.602 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 30569 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nfnetlink_cttimeout.ko 2023-11-28T19:44:31.602 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 39785 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nfnetlink_log.ko 2023-11-28T19:44:31.602 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 22921 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nfnetlink_osf.ko 2023-11-28T19:44:31.603 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 49377 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nfnetlink_queue.ko 2023-11-28T19:44:31.603 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 10457 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_chain_nat.ko 2023-11-28T19:44:31.603 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 33209 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_compat.ko 2023-11-28T19:44:31.603 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 40721 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_ct.ko 2023-11-28T19:44:31.603 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 9601 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_dup_netdev.ko 2023-11-28T19:44:31.603 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 11401 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_fib.ko 2023-11-28T19:44:31.603 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 13745 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_fwd_netdev.ko 2023-11-28T19:44:31.603 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 14185 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_hash.ko 2023-11-28T19:44:31.603 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 20065 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_limit.ko 2023-11-28T19:44:31.603 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 15401 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_log.ko 2023-11-28T19:44:31.603 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 14801 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_masq.ko 2023-11-28T19:44:31.603 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 14329 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_nat.ko 2023-11-28T19:44:31.603 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 13673 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_numgen.ko 2023-11-28T19:44:31.604 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 11841 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_osf.ko 2023-11-28T19:44:31.604 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 14073 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_queue.ko 2023-11-28T19:44:31.604 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 14193 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_redir.ko 2023-11-28T19:44:31.604 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 10497 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_reject.ko 2023-11-28T19:44:31.604 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 10081 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_reject_inet.ko 2023-11-28T19:44:31.604 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 12737 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_socket.ko 2023-11-28T19:44:31.604 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 20369 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_synproxy.ko 2023-11-28T19:44:31.604 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 14849 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_tproxy.ko 2023-11-28T19:44:31.604 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 89313 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/x_tables.ko 2023-11-28T19:44:31.604 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 12097 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_AUDIT.ko 2023-11-28T19:44:31.604 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 9633 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_CHECKSUM.ko 2023-11-28T19:44:31.604 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 7729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_CLASSIFY.ko 2023-11-28T19:44:31.605 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 11521 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_CONNSECMARK.ko 2023-11-28T19:44:31.605 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 18169 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_CT.ko 2023-11-28T19:44:31.605 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 10497 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_DSCP.ko 2023-11-28T19:44:31.605 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 9465 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_HL.ko 2023-11-28T19:44:31.605 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 13369 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_HMARK.ko 2023-11-28T19:44:31.605 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 38873 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_IDLETIMER.ko 2023-11-28T19:44:31.605 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 13889 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_LED.ko 2023-11-28T19:44:31.605 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 11489 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_LOG.ko 2023-11-28T19:44:31.605 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 11753 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_MASQUERADE.ko 2023-11-28T19:44:31.605 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 11657 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_NETMAP.ko 2023-11-28T19:44:31.605 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 9473 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_NFLOG.ko 2023-11-28T19:44:31.605 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 13289 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_NFQUEUE.ko 2023-11-28T19:44:31.606 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 19665 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_RATEEST.ko 2023-11-28T19:44:31.606 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 11073 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_REDIRECT.ko 2023-11-28T19:44:31.606 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 14337 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_SECMARK.ko 2023-11-28T19:44:31.606 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 16057 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_TCPMSS.ko 2023-11-28T19:44:31.606 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 10433 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2023-11-28T19:44:31.606 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 17361 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_TEE.ko 2023-11-28T19:44:31.606 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 16785 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_TPROXY.ko 2023-11-28T19:44:31.606 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 8321 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_TRACE.ko 2023-11-28T19:44:31.606 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 13897 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_addrtype.ko 2023-11-28T19:44:31.606 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 13897 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_bpf.ko 2023-11-28T19:44:31.606 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 15529 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_cgroup.ko 2023-11-28T19:44:31.607 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 11209 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_cluster.ko 2023-11-28T19:44:31.607 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 7505 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_comment.ko 2023-11-28T19:44:31.607 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 10465 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_connbytes.ko 2023-11-28T19:44:31.607 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 11081 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_connlabel.ko 2023-11-28T19:44:31.607 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 9401 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_connlimit.ko 2023-11-28T19:44:31.607 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 13129 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_connmark.ko 2023-11-28T19:44:31.607 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 12401 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_conntrack.ko 2023-11-28T19:44:31.607 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 7817 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_cpu.ko 2023-11-28T19:44:31.607 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 10969 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_dccp.ko 2023-11-28T19:44:31.607 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 7865 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_devgroup.ko 2023-11-28T19:44:31.607 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 8801 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_dscp.ko 2023-11-28T19:44:31.607 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 10657 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_ecn.ko 2023-11-28T19:44:31.608 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 11473 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_esp.ko 2023-11-28T19:44:31.608 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 43289 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_hashlimit.ko 2023-11-28T19:44:31.608 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 11313 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_helper.ko 2023-11-28T19:44:31.608 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 7865 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_hl.ko 2023-11-28T19:44:31.608 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 11921 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_ipcomp.ko 2023-11-28T19:44:31.608 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 11473 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_iprange.ko 2023-11-28T19:44:31.608 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 11785 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_ipvs.ko 2023-11-28T19:44:31.608 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 16041 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_l2tp.ko 2023-11-28T19:44:31.608 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 8001 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_length.ko 2023-11-28T19:44:31.608 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 10209 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_limit.ko 2023-11-28T19:44:31.608 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 7545 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_mac.ko 2023-11-28T19:44:31.608 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 8577 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_mark.ko 2023-11-28T19:44:31.608 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 11825 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_multiport.ko 2023-11-28T19:44:31.609 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 13817 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_nat.ko 2023-11-28T19:44:31.609 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 10105 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_nfacct.ko 2023-11-28T19:44:31.609 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 8297 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_osf.ko 2023-11-28T19:44:31.609 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 9553 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_owner.ko 2023-11-28T19:44:31.609 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 9729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_physdev.ko 2023-11-28T19:44:31.609 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 7633 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_pkttype.ko 2023-11-28T19:44:31.609 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 11985 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_policy.ko 2023-11-28T19:44:31.609 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 9473 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_quota.ko 2023-11-28T19:44:31.609 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 10409 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_rateest.ko 2023-11-28T19:44:31.609 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 8257 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_realm.ko 2023-11-28T19:44:31.609 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 36433 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_recent.ko 2023-11-28T19:44:31.609 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 13329 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_sctp.ko 2023-11-28T19:44:31.609 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 30089 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_set.ko 2023-11-28T19:44:31.610 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 16089 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_socket.ko 2023-11-28T19:44:31.610 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 9505 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_state.ko 2023-11-28T19:44:31.610 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 9473 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_statistic.ko 2023-11-28T19:44:31.610 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 8809 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_string.ko 2023-11-28T19:44:31.610 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 8553 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_tcpmss.ko 2023-11-28T19:44:31.610 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 15777 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_tcpudp.ko 2023-11-28T19:44:31.610 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 11065 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_time.ko 2023-11-28T19:44:31.610 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 9401 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_u32.ko 2023-11-28T19:44:31.610 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netlink/ 2023-11-28T19:44:31.610 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 13969 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netlink/netlink_diag.ko 2023-11-28T19:44:31.610 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/nsh/ 2023-11-28T19:44:31.610 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 12425 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/nsh/nsh.ko 2023-11-28T19:44:31.610 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/openvswitch/ 2023-11-28T19:44:31.611 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 380033 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/openvswitch/openvswitch.ko 2023-11-28T19:44:31.611 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 10257 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/openvswitch/vport-geneve.ko 2023-11-28T19:44:31.611 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 9449 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/openvswitch/vport-gre.ko 2023-11-28T19:44:31.611 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 11793 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/openvswitch/vport-vxlan.ko 2023-11-28T19:44:31.611 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/packet/ 2023-11-28T19:44:31.611 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 13057 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/packet/af_packet_diag.ko 2023-11-28T19:44:31.611 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/phonet/ 2023-11-28T19:44:31.611 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 110201 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/phonet/phonet.ko 2023-11-28T19:44:31.611 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 54721 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/phonet/pn_pep.ko 2023-11-28T19:44:31.611 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/rds/ 2023-11-28T19:44:31.611 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 251481 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/rds/rds.ko 2023-11-28T19:44:31.611 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 164937 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/rds/rds_rdma.ko 2023-11-28T19:44:31.611 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 67377 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/rds/rds_tcp.ko 2023-11-28T19:44:31.611 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/rxrpc/ 2023-11-28T19:44:31.612 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 819657 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/rxrpc/rxrpc.ko 2023-11-28T19:44:31.612 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/ 2023-11-28T19:44:31.612 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 32241 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/act_csum.ko 2023-11-28T19:44:31.612 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 23577 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/act_gact.ko 2023-11-28T19:44:31.612 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 26873 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/act_ipt.ko 2023-11-28T19:44:31.612 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 34097 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/act_mirred.ko 2023-11-28T19:44:31.612 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 23401 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/act_nat.ko 2023-11-28T19:44:31.612 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 43449 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/act_pedit.ko 2023-11-28T19:44:31.612 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 31961 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/act_police.ko 2023-11-28T19:44:31.612 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 20289 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/act_simple.ko 2023-11-28T19:44:31.612 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 35297 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/act_skbedit.ko 2023-11-28T19:44:31.612 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 36665 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/act_vlan.ko 2023-11-28T19:44:31.612 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 26169 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/cls_basic.ko 2023-11-28T19:44:31.612 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 33961 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/cls_bpf.ko 2023-11-28T19:44:31.613 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 19169 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/cls_cgroup.ko 2023-11-28T19:44:31.613 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 31401 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/cls_flow.ko 2023-11-28T19:44:31.613 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 31769 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/cls_fw.ko 2023-11-28T19:44:31.613 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 38425 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/cls_route.ko 2023-11-28T19:44:31.613 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 61409 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/cls_u32.ko 2023-11-28T19:44:31.613 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 7441 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/em_cmp.ko 2023-11-28T19:44:31.613 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 13409 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/em_ipset.ko 2023-11-28T19:44:31.613 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 33289 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/em_meta.ko 2023-11-28T19:44:31.613 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 7897 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/em_nbyte.ko 2023-11-28T19:44:31.613 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 10625 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/em_text.ko 2023-11-28T19:44:31.613 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 7249 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/em_u32.ko 2023-11-28T19:44:31.613 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 21649 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_choke.ko 2023-11-28T19:44:31.613 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 20849 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_codel.ko 2023-11-28T19:44:31.614 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 34633 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_drr.ko 2023-11-28T19:44:31.614 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 33609 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_fq.ko 2023-11-28T19:44:31.614 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 31617 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_fq_codel.ko 2023-11-28T19:44:31.614 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 35433 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_gred.ko 2023-11-28T19:44:31.614 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 49817 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_hfsc.ko 2023-11-28T19:44:31.614 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 22089 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_hhf.ko 2023-11-28T19:44:31.614 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 66393 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_htb.ko 2023-11-28T19:44:31.614 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 26073 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_ingress.ko 2023-11-28T19:44:31.614 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 30273 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_mqprio.ko 2023-11-28T19:44:31.614 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 10793 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_mqprio_lib.ko 2023-11-28T19:44:31.614 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 26065 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_multiq.ko 2023-11-28T19:44:31.614 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 36137 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_netem.ko 2023-11-28T19:44:31.614 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 27497 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_pie.ko 2023-11-28T19:44:31.615 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 10625 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_plug.ko 2023-11-28T19:44:31.615 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 24729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_prio.ko 2023-11-28T19:44:31.615 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 48729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_qfq.ko 2023-11-28T19:44:31.615 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 32905 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_red.ko 2023-11-28T19:44:31.615 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 26881 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_sfb.ko 2023-11-28T19:44:31.615 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 31353 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_sfq.ko 2023-11-28T19:44:31.615 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 28897 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_tbf.ko 2023-11-28T19:44:31.615 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 28105 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_teql.ko 2023-11-28T19:44:31.615 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sctp/ 2023-11-28T19:44:31.615 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 929745 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sctp/sctp.ko 2023-11-28T19:44:31.615 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 19033 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sctp/sctp_diag.ko 2023-11-28T19:44:31.615 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sunrpc/ 2023-11-28T19:44:31.615 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sunrpc/auth_gss/ 2023-11-28T19:44:31.615 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 336529 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2023-11-28T19:44:31.616 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 54737 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2023-11-28T19:44:31.616 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 1520097 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sunrpc/sunrpc.ko 2023-11-28T19:44:31.616 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sunrpc/xprtrdma/ 2023-11-28T19:44:31.616 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 707657 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2023-11-28T19:44:31.616 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/tipc/ 2023-11-28T19:44:31.616 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 10025 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/tipc/diag.ko 2023-11-28T19:44:31.616 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 862665 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/tipc/tipc.ko 2023-11-28T19:44:31.616 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/unix/ 2023-11-28T19:44:31.616 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 15729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/unix/unix_diag.ko 2023-11-28T19:44:31.616 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/vmw_vsock/ 2023-11-28T19:44:31.616 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 85409 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2023-11-28T19:44:31.616 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 68049 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2023-11-28T19:44:31.616 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 96193 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/vmw_vsock/vsock.ko 2023-11-28T19:44:31.616 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 10705 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/vmw_vsock/vsock_diag.ko 2023-11-28T19:44:31.617 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 17521 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/vmw_vsock/vsock_loopback.ko 2023-11-28T19:44:31.617 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/x25/ 2023-11-28T19:44:31.617 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 125177 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/x25/x25.ko 2023-11-28T19:44:31.617 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/xfrm/ 2023-11-28T19:44:31.617 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 22657 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/xfrm/xfrm_algo.ko 2023-11-28T19:44:31.617 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 20649 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/xfrm/xfrm_ipcomp.ko 2023-11-28T19:44:31.617 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 102257 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/xfrm/xfrm_user.ko 2023-11-28T19:44:31.617 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/virt/ 2023-11-28T19:44:31.617 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/virt/lib/ 2023-11-28T19:44:31.617 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 15537 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/virt/lib/irqbypass.ko 2023-11-28T19:44:31.617 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 640081 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/modules.alias 2023-11-28T19:44:31.617 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 624107 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/modules.alias.bin 2023-11-28T19:44:31.617 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 7663 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/modules.builtin 2023-11-28T19:44:31.618 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 23428 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/modules.builtin.alias.bin 2023-11-28T19:44:31.618 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 9821 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/modules.builtin.bin 2023-11-28T19:44:31.618 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 70004 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/modules.builtin.modinfo 2023-11-28T19:44:31.618 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 146313 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/modules.dep 2023-11-28T19:44:31.618 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 232548 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/modules.dep.bin 2023-11-28T19:44:31.618 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 210 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/modules.devname 2023-11-28T19:44:31.618 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 72606 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/modules.order 2023-11-28T19:44:31.618 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 879 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/modules.softdep 2023-11-28T19:44:31.618 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 254438 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/modules.symbols 2023-11-28T19:44:31.618 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 309363 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/modules.symbols.bin 2023-11-28T19:44:31.618 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./usr/ 2023-11-28T19:44:31.618 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./usr/share/ 2023-11-28T19:44:31.618 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./usr/share/doc/ 2023-11-28T19:44:31.619 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./usr/share/doc/linux-image-6.6.0-g8247bbb5b470/ 2023-11-28T19:44:31.619 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 172 2023-11-23 03:47 ./usr/share/doc/linux-image-6.6.0-g8247bbb5b470/changelog.Debian.gz 2023-11-28T19:44:31.619 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 691 2023-11-23 03:47 ./usr/share/doc/linux-image-6.6.0-g8247bbb5b470/copyright 2023-11-28T19:44:31.620 DEBUG:teuthology.task.kernel:get_image_version: 6.6.0-g8247bbb5b470 2023-11-28T19:44:31.620 INFO:teuthology.task.kernel:searching for kernel 6.6.0-g8247bbb5b470 2023-11-28T19:44:31.620 DEBUG:teuthology.orchestra.run.smithi078:> egrep '(submenu|menuentry.*6.6.0-g8247bbb5b470).*{' /boot/grub/grub.cfg 2023-11-28T19:44:31.626 INFO:teuthology.orchestra.run.smithi078.stdout:submenu 'Advanced options for Ubuntu' $menuentry_id_option 'gnulinux-advanced-7e9e2103-8bb7-4452-b35a-3b1230743254' { 2023-11-28T19:44:31.626 INFO:teuthology.orchestra.run.smithi078.stdout: menuentry 'Ubuntu, with Linux 6.6.0-g8247bbb5b470' --class ubuntu --class gnu-linux --class gnu --class os $menuentry_id_option 'gnulinux-6.6.0-g8247bbb5b470-advanced-7e9e2103-8bb7-4452-b35a-3b1230743254' { 2023-11-28T19:44:31.626 INFO:teuthology.orchestra.run.smithi078.stdout: menuentry 'Ubuntu, with Linux 6.6.0-g8247bbb5b470 (recovery mode)' --class ubuntu --class gnu-linux --class gnu --class os $menuentry_id_option 'gnulinux-6.6.0-g8247bbb5b470-recovery-7e9e2103-8bb7-4452-b35a-3b1230743254' { 2023-11-28T19:44:31.627 INFO:teuthology.task.kernel:submenu_title:Advanced options for Ubuntu> 2023-11-28T19:44:31.627 INFO:teuthology.task.kernel:default_title:Ubuntu, with Linux 6.6.0-g8247bbb5b470 2023-11-28T19:44:31.627 DEBUG:teuthology.orchestra.run.smithi078:> /bin/echo -e 'cat </dev/null && sudo chmod a+x -- '/etc/grub.d/01_ceph_kernel.tmp~' && sudo mv -- '/etc/grub.d/01_ceph_kernel.tmp~' /etc/grub.d/01_ceph_kernel && sudo update-grub && rm /tmp/linux-image.deb && ( sleep 1 && sudo shutdown -r now & ) 2023-11-28T19:44:31.672 DEBUG:teuthology.task.kernel:Waiting for install on ubuntu@smithi078.front.sepia.ceph.com to complete... 2023-11-28T19:44:32.092 INFO:teuthology.orchestra.run.smithi078.stderr:Sourcing file `/etc/default/grub' 2023-11-28T19:44:32.094 INFO:teuthology.orchestra.run.smithi078.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2023-11-28T19:44:32.118 INFO:teuthology.orchestra.run.smithi078.stderr:Generating grub configuration file ... 2023-11-28T19:44:32.320 INFO:teuthology.orchestra.run.smithi078.stderr:Found linux image: /boot/vmlinuz-6.6.0-g8247bbb5b470 2023-11-28T19:44:32.327 INFO:teuthology.orchestra.run.smithi078.stderr:Found initrd image: /boot/initrd.img-6.6.0-g8247bbb5b470 2023-11-28T19:44:32.600 INFO:teuthology.orchestra.run.smithi078.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2023-11-28T19:44:32.605 INFO:teuthology.orchestra.run.smithi078.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2023-11-28T19:44:32.641 INFO:teuthology.orchestra.run.smithi078.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2023-11-28T19:44:32.646 INFO:teuthology.orchestra.run.smithi078.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2023-11-28T19:44:32.809 INFO:teuthology.orchestra.run.smithi078.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2023-11-28T19:44:32.809 INFO:teuthology.orchestra.run.smithi078.stderr:Systems on them will not be added to the GRUB boot configuration. 2023-11-28T19:44:32.809 INFO:teuthology.orchestra.run.smithi078.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2023-11-28T19:44:32.835 INFO:teuthology.orchestra.run.smithi078.stderr:done 2023-11-28T19:44:40.149 INFO:teuthology.orchestra.run.smithi179.stderr:Sourcing file `/etc/default/grub' 2023-11-28T19:44:40.164 INFO:teuthology.orchestra.run.smithi179.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2023-11-28T19:44:40.189 INFO:teuthology.orchestra.run.smithi179.stderr:Generating grub configuration file ... 2023-11-28T19:44:40.561 INFO:teuthology.orchestra.run.smithi179.stderr:Found linux image: /boot/vmlinuz-6.6.0-g8247bbb5b470 2023-11-28T19:44:40.584 INFO:teuthology.orchestra.run.smithi179.stderr:Found initrd image: /boot/initrd.img-6.6.0-g8247bbb5b470 2023-11-28T19:44:40.890 INFO:teuthology.orchestra.run.smithi179.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2023-11-28T19:44:40.897 INFO:teuthology.orchestra.run.smithi179.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2023-11-28T19:44:40.960 INFO:teuthology.orchestra.run.smithi179.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2023-11-28T19:44:40.966 INFO:teuthology.orchestra.run.smithi179.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2023-11-28T19:44:41.137 INFO:teuthology.orchestra.run.smithi179.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2023-11-28T19:44:41.137 INFO:teuthology.orchestra.run.smithi179.stderr:Systems on them will not be added to the GRUB boot configuration. 2023-11-28T19:44:41.137 INFO:teuthology.orchestra.run.smithi179.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2023-11-28T19:44:41.173 INFO:teuthology.orchestra.run.smithi179.stderr:done 2023-11-28T19:44:41.366 DEBUG:teuthology.orchestra.run.smithi179:> dpkg-deb -c /tmp/linux-image.deb 2023-11-28T19:44:41.374 INFO:teuthology.orchestra.run.smithi179.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./ 2023-11-28T19:44:41.374 INFO:teuthology.orchestra.run.smithi179.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./boot/ 2023-11-28T19:44:41.374 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 4415617 2023-11-23 03:47 ./boot/System.map-6.6.0-g8247bbb5b470 2023-11-28T19:44:41.384 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 169214 2023-11-23 03:47 ./boot/config-6.6.0-g8247bbb5b470 2023-11-28T19:44:41.384 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 11352832 2023-11-23 03:47 ./boot/vmlinuz-6.6.0-g8247bbb5b470 2023-11-28T19:44:41.402 INFO:teuthology.orchestra.run.smithi179.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./etc/ 2023-11-28T19:44:41.402 INFO:teuthology.orchestra.run.smithi179.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./etc/kernel/ 2023-11-28T19:44:41.402 INFO:teuthology.orchestra.run.smithi179.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./etc/kernel/postinst.d/ 2023-11-28T19:44:41.402 INFO:teuthology.orchestra.run.smithi179.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./etc/kernel/postrm.d/ 2023-11-28T19:44:41.402 INFO:teuthology.orchestra.run.smithi179.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./etc/kernel/preinst.d/ 2023-11-28T19:44:41.402 INFO:teuthology.orchestra.run.smithi179.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./etc/kernel/prerm.d/ 2023-11-28T19:44:41.402 INFO:teuthology.orchestra.run.smithi179.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/ 2023-11-28T19:44:41.402 INFO:teuthology.orchestra.run.smithi179.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/ 2023-11-28T19:44:41.402 INFO:teuthology.orchestra.run.smithi179.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/ 2023-11-28T19:44:41.403 INFO:teuthology.orchestra.run.smithi179.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/ 2023-11-28T19:44:41.403 INFO:teuthology.orchestra.run.smithi179.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/ 2023-11-28T19:44:41.403 INFO:teuthology.orchestra.run.smithi179.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/ 2023-11-28T19:44:41.403 INFO:teuthology.orchestra.run.smithi179.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/ 2023-11-28T19:44:41.403 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 490233 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/aesni-intel.ko 2023-11-28T19:44:41.406 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 25329 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/blowfish-x86_64.ko 2023-11-28T19:44:41.406 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 29529 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2023-11-28T19:44:41.406 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 30313 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2023-11-28T19:44:41.406 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 93113 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/camellia-x86_64.ko 2023-11-28T19:44:41.406 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 106729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2023-11-28T19:44:41.406 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 152241 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2023-11-28T19:44:41.406 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 12553 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/crc32-pclmul.ko 2023-11-28T19:44:41.406 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 13777 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2023-11-28T19:44:41.407 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 83889 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2023-11-28T19:44:41.407 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 18625 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2023-11-28T19:44:41.407 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 47225 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2023-11-28T19:44:41.407 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 47209 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/serpent-avx2.ko 2023-11-28T19:44:41.407 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 51801 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2023-11-28T19:44:41.407 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 38937 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/sha1-ssse3.ko 2023-11-28T19:44:41.407 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 40529 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/sha256-ssse3.ko 2023-11-28T19:44:41.407 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 58585 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/sha512-ssse3.ko 2023-11-28T19:44:41.407 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 50497 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2023-11-28T19:44:41.407 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 32065 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2023-11-28T19:44:41.407 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 13625 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/twofish-x86_64.ko 2023-11-28T19:44:41.407 INFO:teuthology.orchestra.run.smithi179.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/kernel/ 2023-11-28T19:44:41.407 INFO:teuthology.orchestra.run.smithi179.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/kernel/cpu/ 2023-11-28T19:44:41.408 INFO:teuthology.orchestra.run.smithi179.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/kernel/cpu/mce/ 2023-11-28T19:44:41.408 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 40113 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2023-11-28T19:44:41.408 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 13353 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/kernel/cpuid.ko 2023-11-28T19:44:41.408 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 17937 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/kernel/msr.ko 2023-11-28T19:44:41.408 INFO:teuthology.orchestra.run.smithi179.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/kvm/ 2023-11-28T19:44:41.408 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 354433 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/kvm/kvm-amd.ko 2023-11-28T19:44:41.408 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 881625 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/kvm/kvm-intel.ko 2023-11-28T19:44:41.408 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 2275865 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/kvm/kvm.ko 2023-11-28T19:44:41.475 INFO:teuthology.orchestra.run.smithi179.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/ 2023-11-28T19:44:41.475 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 53697 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/af_alg.ko 2023-11-28T19:44:41.475 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 23097 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/algif_hash.ko 2023-11-28T19:44:41.475 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 19985 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/algif_skcipher.ko 2023-11-28T19:44:41.475 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 17209 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/ansi_cprng.ko 2023-11-28T19:44:41.476 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 19641 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/anubis.ko 2023-11-28T19:44:41.476 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 10145 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/arc4.ko 2023-11-28T19:44:41.476 INFO:teuthology.orchestra.run.smithi179.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/asymmetric_keys/ 2023-11-28T19:44:41.476 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 10185 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/asymmetric_keys/pkcs7_test_key.ko 2023-11-28T19:44:41.478 INFO:teuthology.orchestra.run.smithi179.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/async_tx/ 2023-11-28T19:44:41.478 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 11249 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/async_tx/async_memcpy.ko 2023-11-28T19:44:41.478 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 19473 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/async_tx/async_pq.ko 2023-11-28T19:44:41.478 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 21561 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/async_tx/async_raid6_recov.ko 2023-11-28T19:44:41.478 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 13825 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/async_tx/async_tx.ko 2023-11-28T19:44:41.478 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 17745 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/async_tx/async_xor.ko 2023-11-28T19:44:41.479 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 17921 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/async_tx/raid6test.ko 2023-11-28T19:44:41.479 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 20489 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/authenc.ko 2023-11-28T19:44:41.479 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 22577 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/authencesn.ko 2023-11-28T19:44:41.479 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 21817 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/blake2b_generic.ko 2023-11-28T19:44:41.479 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 12729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/blowfish_common.ko 2023-11-28T19:44:41.479 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 10537 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/blowfish_generic.ko 2023-11-28T19:44:41.480 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 38809 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/camellia_generic.ko 2023-11-28T19:44:41.480 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 27321 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/cast5_generic.ko 2023-11-28T19:44:41.480 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 17745 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/cast6_generic.ko 2023-11-28T19:44:41.480 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 10537 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/cast_common.ko 2023-11-28T19:44:41.480 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 35097 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/ccm.ko 2023-11-28T19:44:41.480 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 14769 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/cmac.ko 2023-11-28T19:44:41.480 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 9585 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/crc32_generic.ko 2023-11-28T19:44:41.481 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 47505 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/cryptd.ko 2023-11-28T19:44:41.481 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 39505 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/crypto_engine.ko 2023-11-28T19:44:41.481 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 26953 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/crypto_simd.ko 2023-11-28T19:44:41.481 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 24737 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/crypto_user.ko 2023-11-28T19:44:41.481 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 17729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/cts.ko 2023-11-28T19:44:41.481 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 10913 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/des_generic.ko 2023-11-28T19:44:41.481 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 15681 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/dh_generic.ko 2023-11-28T19:44:41.482 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 11001 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/echainiv.ko 2023-11-28T19:44:41.482 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 25321 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/essiv.ko 2023-11-28T19:44:41.482 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 17993 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/fcrypt.ko 2023-11-28T19:44:41.482 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 26897 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/khazad.ko 2023-11-28T19:44:41.482 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 15649 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/lrw.ko 2023-11-28T19:44:41.482 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 11513 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/lz4.ko 2023-11-28T19:44:41.483 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 11529 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/lz4hc.ko 2023-11-28T19:44:41.483 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 11697 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/md4.ko 2023-11-28T19:44:41.483 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 9729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/michael_mic.ko 2023-11-28T19:44:41.483 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 10673 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/pcbc.ko 2023-11-28T19:44:41.483 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 18745 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/pcrypt.ko 2023-11-28T19:44:41.483 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 16049 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/rmd160.ko 2023-11-28T19:44:41.483 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 29393 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/seed.ko 2023-11-28T19:44:41.484 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 27081 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/serpent_generic.ko 2023-11-28T19:44:41.484 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 149193 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/tcrypt.ko 2023-11-28T19:44:41.484 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 10881 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/tea.ko 2023-11-28T19:44:41.484 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 28777 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/twofish_common.ko 2023-11-28T19:44:41.484 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 13169 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/twofish_generic.ko 2023-11-28T19:44:41.484 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 17401 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/vmac.ko 2023-11-28T19:44:41.484 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 36185 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/wp512.ko 2023-11-28T19:44:41.485 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 14105 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/xcbc.ko 2023-11-28T19:44:41.485 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 26665 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/xor.ko 2023-11-28T19:44:41.485 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 18713 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/xts.ko 2023-11-28T19:44:41.485 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 9481 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/xxhash_generic.ko 2023-11-28T19:44:41.485 INFO:teuthology.orchestra.run.smithi179.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ 2023-11-28T19:44:41.485 INFO:teuthology.orchestra.run.smithi179.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/acpi/ 2023-11-28T19:44:41.486 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 18249 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/acpi/acpi_extlog.ko 2023-11-28T19:44:41.486 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 26985 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/acpi/acpi_ipmi.ko 2023-11-28T19:44:41.486 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 28793 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/acpi/acpi_pad.ko 2023-11-28T19:44:41.486 INFO:teuthology.orchestra.run.smithi179.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/acpi/apei/ 2023-11-28T19:44:41.486 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 31241 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/acpi/apei/einj.ko 2023-11-28T19:44:41.486 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 12801 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/acpi/ec_sys.ko 2023-11-28T19:44:41.486 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 14937 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/acpi/platform_profile.ko 2023-11-28T19:44:41.487 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 24401 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/acpi/sbs.ko 2023-11-28T19:44:41.487 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 19521 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/acpi/sbshc.ko 2023-11-28T19:44:41.487 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 103025 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/acpi/video.ko 2023-11-28T19:44:41.487 INFO:teuthology.orchestra.run.smithi179.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/ 2023-11-28T19:44:41.487 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 21601 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/acard-ahci.ko 2023-11-28T19:44:41.487 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 88865 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/ahci.ko 2023-11-28T19:44:41.487 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 14729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/ahci_platform.ko 2023-11-28T19:44:41.488 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 88289 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/libahci.ko 2023-11-28T19:44:41.488 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 34985 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/libahci_platform.ko 2023-11-28T19:44:41.488 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 17137 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_acpi.ko 2023-11-28T19:44:41.488 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 30433 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_ali.ko 2023-11-28T19:44:41.488 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 33505 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_amd.ko 2023-11-28T19:44:41.488 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 21265 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_artop.ko 2023-11-28T19:44:41.488 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 21121 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_atiixp.ko 2023-11-28T19:44:41.489 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 24945 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_atp867x.ko 2023-11-28T19:44:41.489 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 17657 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_cmd640.ko 2023-11-28T19:44:41.489 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 25185 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_cmd64x.ko 2023-11-28T19:44:41.489 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 15049 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_cypress.ko 2023-11-28T19:44:41.489 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 17849 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_efar.ko 2023-11-28T19:44:41.489 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 21945 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_hpt366.ko 2023-11-28T19:44:41.489 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 33977 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_hpt37x.ko 2023-11-28T19:44:41.490 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 23129 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_hpt3x2n.ko 2023-11-28T19:44:41.490 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 16921 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_hpt3x3.ko 2023-11-28T19:44:41.490 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 16993 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_it8213.ko 2023-11-28T19:44:41.490 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 35273 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_it821x.ko 2023-11-28T19:44:41.490 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 12889 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_jmicron.ko 2023-11-28T19:44:41.490 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 51481 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_legacy.ko 2023-11-28T19:44:41.491 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 15185 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_marvell.ko 2023-11-28T19:44:41.491 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 16281 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_mpiix.ko 2023-11-28T19:44:41.491 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 12833 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_netcell.ko 2023-11-28T19:44:41.491 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 16817 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_ninja32.ko 2023-11-28T19:44:41.491 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 15105 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_ns87410.ko 2023-11-28T19:44:41.491 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 17361 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_ns87415.ko 2023-11-28T19:44:41.491 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 16569 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_oldpiix.ko 2023-11-28T19:44:41.492 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 15377 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_opti.ko 2023-11-28T19:44:41.492 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 20681 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_optidma.ko 2023-11-28T19:44:41.492 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 32585 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_pcmcia.ko 2023-11-28T19:44:41.492 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 37793 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_pdc2027x.ko 2023-11-28T19:44:41.492 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 20561 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_pdc202xx_old.ko 2023-11-28T19:44:41.492 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 14225 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_piccolo.ko 2023-11-28T19:44:41.492 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 15449 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_radisys.ko 2023-11-28T19:44:41.493 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 19521 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_rdc.ko 2023-11-28T19:44:41.493 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 15329 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_rz1000.ko 2023-11-28T19:44:41.493 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 13937 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_sch.ko 2023-11-28T19:44:41.493 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 23097 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_serverworks.ko 2023-11-28T19:44:41.494 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 23457 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_sil680.ko 2023-11-28T19:44:41.494 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 19697 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_sl82c105.ko 2023-11-28T19:44:41.494 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 16009 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_triflex.ko 2023-11-28T19:44:41.494 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 30433 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_via.ko 2023-11-28T19:44:41.494 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 22793 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pdc_adma.ko 2023-11-28T19:44:41.494 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 29121 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/sata_inic162x.ko 2023-11-28T19:44:41.494 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 83345 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/sata_mv.ko 2023-11-28T19:44:41.494 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 70393 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/sata_nv.ko 2023-11-28T19:44:41.494 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 37377 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/sata_promise.ko 2023-11-28T19:44:41.494 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 23041 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/sata_qstor.ko 2023-11-28T19:44:41.494 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 29273 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/sata_sil.ko 2023-11-28T19:44:41.494 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 38337 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/sata_sil24.ko 2023-11-28T19:44:41.494 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 17945 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/sata_sis.ko 2023-11-28T19:44:41.495 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 20441 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/sata_svw.ko 2023-11-28T19:44:41.495 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 44793 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/sata_sx4.ko 2023-11-28T19:44:41.495 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 15601 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/sata_uli.ko 2023-11-28T19:44:41.495 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 35065 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/sata_via.ko 2023-11-28T19:44:41.495 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 20065 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/sata_vsc.ko 2023-11-28T19:44:41.495 INFO:teuthology.orchestra.run.smithi179.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/auxdisplay/ 2023-11-28T19:44:41.495 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 16289 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/auxdisplay/ks0108.ko 2023-11-28T19:44:41.495 INFO:teuthology.orchestra.run.smithi179.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/bcma/ 2023-11-28T19:44:41.495 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 124473 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/bcma/bcma.ko 2023-11-28T19:44:41.495 INFO:teuthology.orchestra.run.smithi179.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/ 2023-11-28T19:44:41.495 INFO:teuthology.orchestra.run.smithi179.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/aoe/ 2023-11-28T19:44:41.495 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 113665 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/aoe/aoe.ko 2023-11-28T19:44:41.495 INFO:teuthology.orchestra.run.smithi179.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/drbd/ 2023-11-28T19:44:41.496 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 965585 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/drbd/drbd.ko 2023-11-28T19:44:41.496 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 173225 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/floppy.ko 2023-11-28T19:44:41.496 INFO:teuthology.orchestra.run.smithi179.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/mtip32xx/ 2023-11-28T19:44:41.496 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 94297 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/mtip32xx/mtip32xx.ko 2023-11-28T19:44:41.496 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 115793 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/nbd.ko 2023-11-28T19:44:41.496 INFO:teuthology.orchestra.run.smithi179.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/null_blk/ 2023-11-28T19:44:41.496 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 110385 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/null_blk/null_blk.ko 2023-11-28T19:44:41.496 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 98193 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/pktcdvd.ko 2023-11-28T19:44:41.496 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 263769 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/rbd.ko 2023-11-28T19:44:41.496 INFO:teuthology.orchestra.run.smithi179.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/xen-blkback/ 2023-11-28T19:44:41.496 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 98145 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/xen-blkback/xen-blkback.ko 2023-11-28T19:44:41.496 INFO:teuthology.orchestra.run.smithi179.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/zram/ 2023-11-28T19:44:41.496 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 60217 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/zram/zram.ko 2023-11-28T19:44:41.497 INFO:teuthology.orchestra.run.smithi179.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/ 2023-11-28T19:44:41.497 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 30705 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/applicom.ko 2023-11-28T19:44:41.497 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 12009 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/hangcheck-timer.ko 2023-11-28T19:44:41.497 INFO:teuthology.orchestra.run.smithi179.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/hw_random/ 2023-11-28T19:44:41.497 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 13889 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/hw_random/amd-rng.ko 2023-11-28T19:44:41.497 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 18809 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/hw_random/intel-rng.ko 2023-11-28T19:44:41.497 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 13169 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/hw_random/timeriomem-rng.ko 2023-11-28T19:44:41.497 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 10673 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/hw_random/via-rng.ko 2023-11-28T19:44:41.497 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 15633 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/hw_random/virtio-rng.ko 2023-11-28T19:44:41.497 INFO:teuthology.orchestra.run.smithi179.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/ipmi/ 2023-11-28T19:44:41.497 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 30713 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/ipmi/ipmi_devintf.ko 2023-11-28T19:44:41.497 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 148601 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2023-11-28T19:44:41.497 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 26569 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2023-11-28T19:44:41.498 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 139313 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/ipmi/ipmi_si.ko 2023-11-28T19:44:41.498 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 70921 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/ipmi/ipmi_ssif.ko 2023-11-28T19:44:41.498 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 53513 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2023-11-28T19:44:41.498 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 36321 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/lp.ko 2023-11-28T19:44:41.498 INFO:teuthology.orchestra.run.smithi179.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/mwave/ 2023-11-28T19:44:41.498 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 84097 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/mwave/mwave.ko 2023-11-28T19:44:41.498 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 25873 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/nvram.ko 2023-11-28T19:44:41.498 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 32169 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/ppdev.ko 2023-11-28T19:44:41.498 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 51113 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/tlclk.ko 2023-11-28T19:44:41.498 INFO:teuthology.orchestra.run.smithi179.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/tpm/ 2023-11-28T19:44:41.498 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 16401 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/tpm/tpm_atmel.ko 2023-11-28T19:44:41.498 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 15881 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/tpm/tpm_i2c_atmel.ko 2023-11-28T19:44:41.499 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 23473 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/tpm/tpm_i2c_infineon.ko 2023-11-28T19:44:41.499 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 32985 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/tpm/tpm_i2c_nuvoton.ko 2023-11-28T19:44:41.499 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 30121 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/tpm/tpm_infineon.ko 2023-11-28T19:44:41.499 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 22697 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/tpm/tpm_nsc.ko 2023-11-28T19:44:41.499 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 23561 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/tpm/xen-tpmfront.ko 2023-11-28T19:44:41.499 INFO:teuthology.orchestra.run.smithi179.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/xillybus/ 2023-11-28T19:44:41.499 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 17001 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/xillybus/xillybus_class.ko 2023-11-28T19:44:41.499 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 50945 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/xillybus/xillybus_core.ko 2023-11-28T19:44:41.499 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 12393 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/xillybus/xillybus_pcie.ko 2023-11-28T19:44:41.499 INFO:teuthology.orchestra.run.smithi179.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/clk/ 2023-11-28T19:44:41.499 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 12489 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/clk/clk-palmas.ko 2023-11-28T19:44:41.499 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 47849 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/clk/clk-si5351.ko 2023-11-28T19:44:41.499 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 11457 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/clk/clk-twl6040.ko 2023-11-28T19:44:41.500 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 19249 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/clk/clk-wm831x.ko 2023-11-28T19:44:41.500 INFO:teuthology.orchestra.run.smithi179.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/cpufreq/ 2023-11-28T19:44:41.500 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 10097 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2023-11-28T19:44:41.500 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 16833 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/cpufreq/p4-clockmod.ko 2023-11-28T19:44:41.500 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 25297 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/cpufreq/speedstep-lib.ko 2023-11-28T19:44:41.500 INFO:teuthology.orchestra.run.smithi179.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/crypto/ 2023-11-28T19:44:41.500 INFO:teuthology.orchestra.run.smithi179.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/crypto/ccp/ 2023-11-28T19:44:41.500 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 70801 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/crypto/ccp/ccp-crypto.ko 2023-11-28T19:44:41.500 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 243025 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/crypto/ccp/ccp.ko 2023-11-28T19:44:41.500 INFO:teuthology.orchestra.run.smithi179.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/crypto/intel/ 2023-11-28T19:44:41.500 INFO:teuthology.orchestra.run.smithi179.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/crypto/intel/qat/ 2023-11-28T19:44:41.500 INFO:teuthology.orchestra.run.smithi179.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/crypto/intel/qat/qat_common/ 2023-11-28T19:44:41.500 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 438761 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko 2023-11-28T19:44:41.501 INFO:teuthology.orchestra.run.smithi179.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/crypto/intel/qat/qat_dh895xcc/ 2023-11-28T19:44:41.501 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 24081 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko 2023-11-28T19:44:41.501 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 19937 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/crypto/padlock-aes.ko 2023-11-28T19:44:41.501 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 21537 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/crypto/padlock-sha.ko 2023-11-28T19:44:41.501 INFO:teuthology.orchestra.run.smithi179.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/crypto/virtio/ 2023-11-28T19:44:41.501 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 70273 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/crypto/virtio/virtio_crypto.ko 2023-11-28T19:44:41.501 INFO:teuthology.orchestra.run.smithi179.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/dca/ 2023-11-28T19:44:41.501 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 29785 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/dca/dca.ko 2023-11-28T19:44:41.501 INFO:teuthology.orchestra.run.smithi179.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/dma/ 2023-11-28T19:44:41.501 INFO:teuthology.orchestra.run.smithi179.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/dma/dw/ 2023-11-28T19:44:41.501 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 15857 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/dma/dw/dw_dmac.ko 2023-11-28T19:44:41.501 INFO:teuthology.orchestra.run.smithi179.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/dma/ioat/ 2023-11-28T19:44:41.502 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 122569 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/dma/ioat/ioatdma.ko 2023-11-28T19:44:41.502 INFO:teuthology.orchestra.run.smithi179.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/edac/ 2023-11-28T19:44:41.502 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 79953 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/edac/amd64_edac.ko 2023-11-28T19:44:41.502 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 35769 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/edac/e752x_edac.ko 2023-11-28T19:44:41.502 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 63617 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/edac/edac_mce_amd.ko 2023-11-28T19:44:41.502 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 18105 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/edac/i3000_edac.ko 2023-11-28T19:44:41.502 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 18065 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/edac/i3200_edac.ko 2023-11-28T19:44:41.502 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 22537 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/edac/i5100_edac.ko 2023-11-28T19:44:41.502 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 25657 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/edac/i5400_edac.ko 2023-11-28T19:44:41.502 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 24913 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/edac/i7300_edac.ko 2023-11-28T19:44:41.502 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 52041 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/edac/i7core_edac.ko 2023-11-28T19:44:41.502 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 18433 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/edac/i82975x_edac.ko 2023-11-28T19:44:41.502 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 20017 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/edac/ie31200_edac.ko 2023-11-28T19:44:41.502 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 56825 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/edac/sb_edac.ko 2023-11-28T19:44:41.503 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 17529 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/edac/x38_edac.ko 2023-11-28T19:44:41.503 INFO:teuthology.orchestra.run.smithi179.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/extcon/ 2023-11-28T19:44:41.503 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 12673 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/extcon/extcon-gpio.ko 2023-11-28T19:44:41.503 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 27185 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/extcon/extcon-max14577.ko 2023-11-28T19:44:41.503 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 29569 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/extcon/extcon-max77693.ko 2023-11-28T19:44:41.503 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 24745 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/extcon/extcon-max8997.ko 2023-11-28T19:44:41.503 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 26537 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/extcon/extcon-palmas.ko 2023-11-28T19:44:41.503 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 23713 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/extcon/extcon-rt8973a.ko 2023-11-28T19:44:41.503 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 27785 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/extcon/extcon-sm5502.ko 2023-11-28T19:44:41.503 INFO:teuthology.orchestra.run.smithi179.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/firmware/ 2023-11-28T19:44:41.503 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 34977 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/firmware/dmi-sysfs.ko 2023-11-28T19:44:41.503 INFO:teuthology.orchestra.run.smithi179.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/firmware/efi/ 2023-11-28T19:44:41.503 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 15521 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/firmware/efi/efi-pstore.ko 2023-11-28T19:44:41.504 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 20729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/firmware/iscsi_ibft.ko 2023-11-28T19:44:41.504 INFO:teuthology.orchestra.run.smithi179.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/ 2023-11-28T19:44:41.504 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 12305 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-adp5520.ko 2023-11-28T19:44:41.504 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 20153 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-amd8111.ko 2023-11-28T19:44:41.504 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 14993 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-arizona.ko 2023-11-28T19:44:41.504 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 13841 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-da9052.ko 2023-11-28T19:44:41.504 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 11921 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-da9055.ko 2023-11-28T19:44:41.504 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 22065 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-dln2.ko 2023-11-28T19:44:41.504 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 77849 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-f7188x.ko 2023-11-28T19:44:41.504 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 28937 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-generic.ko 2023-11-28T19:44:41.504 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 19569 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-ich.ko 2023-11-28T19:44:41.504 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 11905 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-janz-ttl.ko 2023-11-28T19:44:41.504 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 14113 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-kempld.ko 2023-11-28T19:44:41.504 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 12537 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-lp3943.ko 2023-11-28T19:44:41.505 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 9505 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-max7300.ko 2023-11-28T19:44:41.505 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 11905 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-max730x.ko 2023-11-28T19:44:41.505 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 22073 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-max732x.ko 2023-11-28T19:44:41.505 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 25145 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-ml-ioh.ko 2023-11-28T19:44:41.505 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 47073 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-pca953x.ko 2023-11-28T19:44:41.505 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 26825 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-pcf857x.ko 2023-11-28T19:44:41.505 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 14377 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-rdc321x.ko 2023-11-28T19:44:41.505 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 20593 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-sch.ko 2023-11-28T19:44:41.505 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 19505 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-sch311x.ko 2023-11-28T19:44:41.505 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 12145 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-tps65912.ko 2023-11-28T19:44:41.505 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 21057 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-twl4030.ko 2023-11-28T19:44:41.505 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 11425 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-twl6040.ko 2023-11-28T19:44:41.505 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 20601 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-viperboard.ko 2023-11-28T19:44:41.506 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 15377 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-vx855.ko 2023-11-28T19:44:41.506 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 16281 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-wm831x.ko 2023-11-28T19:44:41.506 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 11617 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-wm8350.ko 2023-11-28T19:44:41.506 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 16753 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-wm8994.ko 2023-11-28T19:44:41.506 INFO:teuthology.orchestra.run.smithi179.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/ 2023-11-28T19:44:41.506 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 11577 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-a4tech.ko 2023-11-28T19:44:41.506 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 39169 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-apple.ko 2023-11-28T19:44:41.506 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 14481 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-appleir.ko 2023-11-28T19:44:41.506 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 8353 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-aureal.ko 2023-11-28T19:44:41.506 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 15169 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-axff.ko 2023-11-28T19:44:41.506 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 11049 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-belkin.ko 2023-11-28T19:44:41.506 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 10313 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-cherry.ko 2023-11-28T19:44:41.506 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 16041 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-chicony.ko 2023-11-28T19:44:41.507 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 60649 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-cp2112.ko 2023-11-28T19:44:41.507 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 11049 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-cypress.ko 2023-11-28T19:44:41.507 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 16385 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-dr.ko 2023-11-28T19:44:41.507 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 10697 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-elecom.ko 2023-11-28T19:44:41.507 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 17665 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-elo.ko 2023-11-28T19:44:41.507 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 13457 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-emsff.ko 2023-11-28T19:44:41.507 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 10105 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-ezkey.ko 2023-11-28T19:44:41.507 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 14305 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-gaff.ko 2023-11-28T19:44:41.507 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 9225 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-generic.ko 2023-11-28T19:44:41.507 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 17129 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-gt683r.ko 2023-11-28T19:44:41.507 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 12681 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-gyration.ko 2023-11-28T19:44:41.507 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 10161 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-holtek-kbd.ko 2023-11-28T19:44:41.507 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 10457 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-holtek-mouse.ko 2023-11-28T19:44:41.508 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 14449 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-holtekff.ko 2023-11-28T19:44:41.508 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 19105 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-hyperv.ko 2023-11-28T19:44:41.508 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 10489 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-icade.ko 2023-11-28T19:44:41.508 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 9241 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-kensington.ko 2023-11-28T19:44:41.508 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 8545 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-keytouch.ko 2023-11-28T19:44:41.508 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 17201 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-kye.ko 2023-11-28T19:44:41.508 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 10809 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-lcpower.ko 2023-11-28T19:44:41.508 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 20497 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-led.ko 2023-11-28T19:44:41.508 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 42297 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-lenovo.ko 2023-11-28T19:44:41.508 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 30697 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-lg-g15.ko 2023-11-28T19:44:41.508 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 58185 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-logitech-dj.ko 2023-11-28T19:44:41.508 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 101481 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-logitech-hidpp.ko 2023-11-28T19:44:41.508 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 80993 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-logitech.ko 2023-11-28T19:44:41.509 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 30801 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-magicmouse.ko 2023-11-28T19:44:41.509 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 21969 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-microsoft.ko 2023-11-28T19:44:41.509 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 10361 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-monterey.ko 2023-11-28T19:44:41.509 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 50161 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-multitouch.ko 2023-11-28T19:44:41.509 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 32593 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-ntrig.ko 2023-11-28T19:44:41.509 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 8857 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-ortek.ko 2023-11-28T19:44:41.509 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 9121 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-penmount.ko 2023-11-28T19:44:41.509 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 12289 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-petalynx.ko 2023-11-28T19:44:41.509 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 72937 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-picolcd.ko 2023-11-28T19:44:41.509 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 14225 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-pl.ko 2023-11-28T19:44:41.509 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 15105 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-plantronics.ko 2023-11-28T19:44:41.509 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 8417 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-primax.ko 2023-11-28T19:44:41.509 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 35393 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-rmi.ko 2023-11-28T19:44:41.509 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 20833 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-roccat-arvo.ko 2023-11-28T19:44:41.510 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 14065 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-roccat-common.ko 2023-11-28T19:44:41.510 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 31425 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-roccat-isku.ko 2023-11-28T19:44:41.510 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 29729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-roccat-kone.ko 2023-11-28T19:44:41.510 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 31129 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-roccat-koneplus.ko 2023-11-28T19:44:41.510 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 21137 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-roccat-konepure.ko 2023-11-28T19:44:41.510 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 29489 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-roccat-kovaplus.ko 2023-11-28T19:44:41.510 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 13305 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-roccat-lua.ko 2023-11-28T19:44:41.510 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 29313 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-roccat-pyra.ko 2023-11-28T19:44:41.510 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 27937 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-roccat-ryos.ko 2023-11-28T19:44:41.510 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 19521 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-roccat-savu.ko 2023-11-28T19:44:41.510 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 23337 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-roccat.ko 2023-11-28T19:44:41.510 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 13681 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-saitek.ko 2023-11-28T19:44:41.510 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 15193 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-samsung.ko 2023-11-28T19:44:41.511 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 36817 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-sensor-hub.ko 2023-11-28T19:44:41.511 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 13601 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-sjoy.ko 2023-11-28T19:44:41.511 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 51249 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-sony.ko 2023-11-28T19:44:41.511 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 8313 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-speedlink.ko 2023-11-28T19:44:41.511 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 25297 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-steelseries.ko 2023-11-28T19:44:41.511 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 9817 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-sunplus.ko 2023-11-28T19:44:41.511 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 16993 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-thrustmaster.ko 2023-11-28T19:44:41.511 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 10537 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-tivo.ko 2023-11-28T19:44:41.511 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 15089 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-tmff.ko 2023-11-28T19:44:41.511 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 14385 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-topseed.ko 2023-11-28T19:44:41.511 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 16473 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-twinhan.ko 2023-11-28T19:44:41.511 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 71073 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-uclogic.ko 2023-11-28T19:44:41.511 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 10921 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-waltop.ko 2023-11-28T19:44:41.512 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 143473 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-wiimote.ko 2023-11-28T19:44:41.512 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 8153 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-xinmo.ko 2023-11-28T19:44:41.512 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 13321 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-zpff.ko 2023-11-28T19:44:41.512 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 16665 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-zydacron.ko 2023-11-28T19:44:41.512 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 267825 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid.ko 2023-11-28T19:44:41.512 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 32321 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/uhid.ko 2023-11-28T19:44:41.512 INFO:teuthology.orchestra.run.smithi179.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/usbhid/ 2023-11-28T19:44:41.512 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 125721 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/usbhid/usbhid.ko 2023-11-28T19:44:41.512 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 19137 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/usbhid/usbkbd.ko 2023-11-28T19:44:41.512 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 14953 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/usbhid/usbmouse.ko 2023-11-28T19:44:41.512 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 217873 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/wacom.ko 2023-11-28T19:44:41.512 INFO:teuthology.orchestra.run.smithi179.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hv/ 2023-11-28T19:44:41.512 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 64201 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hv/hv_balloon.ko 2023-11-28T19:44:41.512 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 89625 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hv/hv_utils.ko 2023-11-28T19:44:41.513 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 305465 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hv/hv_vmbus.ko 2023-11-28T19:44:41.513 INFO:teuthology.orchestra.run.smithi179.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ 2023-11-28T19:44:41.513 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 66521 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/abituguru.ko 2023-11-28T19:44:41.513 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 61393 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/abituguru3.ko 2023-11-28T19:44:41.513 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 34745 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/acpi_power_meter.ko 2023-11-28T19:44:41.513 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 17505 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ad7414.ko 2023-11-28T19:44:41.513 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 19313 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ad7418.ko 2023-11-28T19:44:41.513 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 25257 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/adc128d818.ko 2023-11-28T19:44:41.513 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 31729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/adm1025.ko 2023-11-28T19:44:41.513 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 97977 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/adm1026.ko 2023-11-28T19:44:41.513 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 19745 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/adm1029.ko 2023-11-28T19:44:41.513 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 45553 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/adm1031.ko 2023-11-28T19:44:41.513 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 26289 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/adm9240.ko 2023-11-28T19:44:41.514 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 14769 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ads7828.ko 2023-11-28T19:44:41.514 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 10769 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/adt7410.ko 2023-11-28T19:44:41.514 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 22049 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/adt7411.ko 2023-11-28T19:44:41.514 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 74433 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/adt7462.ko 2023-11-28T19:44:41.514 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 39585 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/adt7470.ko 2023-11-28T19:44:41.514 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 67929 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/adt7475.ko 2023-11-28T19:44:41.514 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 19625 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/adt7x10.ko 2023-11-28T19:44:41.514 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 39073 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/amc6821.ko 2023-11-28T19:44:41.514 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 55201 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/applesmc.ko 2023-11-28T19:44:41.514 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 49913 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/asb100.ko 2023-11-28T19:44:41.514 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 58617 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/asc7621.ko 2023-11-28T19:44:41.514 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 40825 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/asus_atk0110.ko 2023-11-28T19:44:41.514 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 17225 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/atxp1.ko 2023-11-28T19:44:41.515 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 28281 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/coretemp.ko 2023-11-28T19:44:41.515 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 24593 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/da9052-hwmon.ko 2023-11-28T19:44:41.515 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 17265 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/da9055-hwmon.ko 2023-11-28T19:44:41.515 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 44465 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/dell-smm-hwmon.ko 2023-11-28T19:44:41.515 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 99601 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/dme1737.ko 2023-11-28T19:44:41.515 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 19489 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ds1621.ko 2023-11-28T19:44:41.515 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 15321 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ds620.ko 2023-11-28T19:44:41.515 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 29777 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/emc1403.ko 2023-11-28T19:44:41.515 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 33185 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/emc2103.ko 2023-11-28T19:44:41.515 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 30321 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/emc6w201.ko 2023-11-28T19:44:41.515 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 66985 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/f71805f.ko 2023-11-28T19:44:41.515 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 94457 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/f71882fg.ko 2023-11-28T19:44:41.516 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 41401 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/f75375s.ko 2023-11-28T19:44:41.516 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 21305 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/fam15h_power.ko 2023-11-28T19:44:41.516 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 55449 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/fschmd.ko 2023-11-28T19:44:41.516 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 14481 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/g760a.ko 2023-11-28T19:44:41.516 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 24017 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/g762.ko 2023-11-28T19:44:41.516 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 46801 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/gl518sm.ko 2023-11-28T19:44:41.516 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 45529 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/gl520sm.ko 2023-11-28T19:44:41.516 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 13273 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/hih6130.ko 2023-11-28T19:44:41.516 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 9745 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/hwmon-vid.ko 2023-11-28T19:44:41.516 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 11553 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/i5500_temp.ko 2023-11-28T19:44:41.516 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 22601 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/i5k_amb.ko 2023-11-28T19:44:41.516 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 34529 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ibmaem.ko 2023-11-28T19:44:41.516 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 21257 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ibmpex.ko 2023-11-28T19:44:41.516 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 24873 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ina209.ko 2023-11-28T19:44:41.517 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 13401 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ina2xx.ko 2023-11-28T19:44:41.517 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 130449 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/it87.ko 2023-11-28T19:44:41.517 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 18841 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/jc42.ko 2023-11-28T19:44:41.517 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 24329 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/k10temp.ko 2023-11-28T19:44:41.517 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 13553 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/k8temp.ko 2023-11-28T19:44:41.517 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 18929 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/lineage-pem.ko 2023-11-28T19:44:41.517 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 48601 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/lm63.ko 2023-11-28T19:44:41.517 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 16697 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/lm73.ko 2023-11-28T19:44:41.517 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 36777 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/lm75.ko 2023-11-28T19:44:41.517 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 19537 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/lm77.ko 2023-11-28T19:44:41.517 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 34593 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/lm78.ko 2023-11-28T19:44:41.517 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 31745 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/lm80.ko 2023-11-28T19:44:41.517 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 16889 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/lm83.ko 2023-11-28T19:44:41.517 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 72833 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/lm85.ko 2023-11-28T19:44:41.518 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 46153 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/lm87.ko 2023-11-28T19:44:41.518 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 37913 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/lm90.ko 2023-11-28T19:44:41.518 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 19745 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/lm92.ko 2023-11-28T19:44:41.518 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 108841 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/lm93.ko 2023-11-28T19:44:41.518 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 33393 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/lm95234.ko 2023-11-28T19:44:41.518 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 16201 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/lm95241.ko 2023-11-28T19:44:41.518 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 18113 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/lm95245.ko 2023-11-28T19:44:41.518 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 24017 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ltc2945.ko 2023-11-28T19:44:41.518 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 13793 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ltc4151.ko 2023-11-28T19:44:41.518 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 15193 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ltc4215.ko 2023-11-28T19:44:41.518 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 14889 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ltc4222.ko 2023-11-28T19:44:41.518 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 14825 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ltc4245.ko 2023-11-28T19:44:41.518 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 13249 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ltc4260.ko 2023-11-28T19:44:41.519 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 14993 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ltc4261.ko 2023-11-28T19:44:41.519 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 33489 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/max16065.ko 2023-11-28T19:44:41.519 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 18433 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/max1619.ko 2023-11-28T19:44:41.519 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 24353 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/max1668.ko 2023-11-28T19:44:41.519 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 19969 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/max197.ko 2023-11-28T19:44:41.519 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 27129 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/max6639.ko 2023-11-28T19:44:41.519 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 23321 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/max6650.ko 2023-11-28T19:44:41.519 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 35777 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/max6697.ko 2023-11-28T19:44:41.519 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 18585 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/mc13783-adc.ko 2023-11-28T19:44:41.519 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 10585 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/mcp3021.ko 2023-11-28T19:44:41.519 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 15937 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/menf21bmc_hwmon.ko 2023-11-28T19:44:41.519 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 44129 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/nct6683.ko 2023-11-28T19:44:41.519 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 119817 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/nct6775-core.ko 2023-11-28T19:44:41.520 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 60705 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/nct6775.ko 2023-11-28T19:44:41.520 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 59737 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/nct7802.ko 2023-11-28T19:44:41.520 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 82337 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/pc87360.ko 2023-11-28T19:44:41.520 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 54433 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/pc87427.ko 2023-11-28T19:44:41.520 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 18473 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/pcf8591.ko 2023-11-28T19:44:41.520 INFO:teuthology.orchestra.run.smithi179.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/pmbus/ 2023-11-28T19:44:41.520 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 21353 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/pmbus/adm1275.ko 2023-11-28T19:44:41.520 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 17065 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/pmbus/lm25066.ko 2023-11-28T19:44:41.520 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 28329 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/pmbus/ltc2978.ko 2023-11-28T19:44:41.520 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 9577 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/pmbus/max16064.ko 2023-11-28T19:44:41.520 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 17657 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/pmbus/max34440.ko 2023-11-28T19:44:41.520 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 10169 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/pmbus/max8688.ko 2023-11-28T19:44:41.520 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 15505 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/pmbus/pmbus.ko 2023-11-28T19:44:41.521 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 82577 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2023-11-28T19:44:41.521 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 8729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/pmbus/tps40422.ko 2023-11-28T19:44:41.521 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 30729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/pmbus/ucd9000.ko 2023-11-28T19:44:41.521 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 15073 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/pmbus/ucd9200.ko 2023-11-28T19:44:41.521 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 20681 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/pmbus/zl6100.ko 2023-11-28T19:44:41.521 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 13017 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/powr1220.ko 2023-11-28T19:44:41.521 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 18705 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/sch5627.ko 2023-11-28T19:44:41.521 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 28817 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/sch5636.ko 2023-11-28T19:44:41.521 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 27145 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/sch56xx-common.ko 2023-11-28T19:44:41.521 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 32137 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/sht15.ko 2023-11-28T19:44:41.521 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 13505 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/sht21.ko 2023-11-28T19:44:41.521 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 16833 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/shtc1.ko 2023-11-28T19:44:41.521 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 40105 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/sis5595.ko 2023-11-28T19:44:41.522 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 19577 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/smsc47b397.ko 2023-11-28T19:44:41.522 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 39193 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/smsc47m1.ko 2023-11-28T19:44:41.522 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 37385 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/smsc47m192.ko 2023-11-28T19:44:41.522 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 26553 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/thmc50.ko 2023-11-28T19:44:41.522 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 17057 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/tmp102.ko 2023-11-28T19:44:41.522 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 14097 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/tmp103.ko 2023-11-28T19:44:41.522 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 21257 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/tmp401.ko 2023-11-28T19:44:41.522 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 19537 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/tmp421.ko 2023-11-28T19:44:41.522 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 19721 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/via-cputemp.ko 2023-11-28T19:44:41.522 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 41945 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/via686a.ko 2023-11-28T19:44:41.522 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 52457 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/vt1211.ko 2023-11-28T19:44:41.522 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 51545 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/vt8231.ko 2023-11-28T19:44:41.522 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 57449 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/w83627ehf.ko 2023-11-28T19:44:41.523 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 78873 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/w83627hf.ko 2023-11-28T19:44:41.523 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 71345 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/w83781d.ko 2023-11-28T19:44:41.523 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 63225 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/w83791d.ko 2023-11-28T19:44:41.523 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 71321 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/w83792d.ko 2023-11-28T19:44:41.523 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 101473 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/w83793.ko 2023-11-28T19:44:41.523 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 119505 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/w83795.ko 2023-11-28T19:44:41.523 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 17313 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/w83l785ts.ko 2023-11-28T19:44:41.523 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 35625 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/w83l786ng.ko 2023-11-28T19:44:41.523 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 13825 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/wm831x-hwmon.ko 2023-11-28T19:44:41.523 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 10625 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/wm8350-hwmon.ko 2023-11-28T19:44:41.523 INFO:teuthology.orchestra.run.smithi179.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/ 2023-11-28T19:44:41.523 INFO:teuthology.orchestra.run.smithi179.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/algos/ 2023-11-28T19:44:41.523 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 20049 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2023-11-28T19:44:41.524 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 19345 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2023-11-28T19:44:41.524 INFO:teuthology.orchestra.run.smithi179.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/ 2023-11-28T19:44:41.524 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 27969 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-ali1535.ko 2023-11-28T19:44:41.524 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 28801 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-ali1563.ko 2023-11-28T19:44:41.524 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 27777 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-ali15x3.ko 2023-11-28T19:44:41.524 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 17937 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2023-11-28T19:44:41.524 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 26193 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-amd756.ko 2023-11-28T19:44:41.524 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 16201 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-amd8111.ko 2023-11-28T19:44:41.524 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 15153 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-cbus-gpio.ko 2023-11-28T19:44:41.524 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 6929 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2023-11-28T19:44:41.524 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 13961 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-cros-ec-tunnel.ko 2023-11-28T19:44:41.524 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 50201 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-designware-core.ko 2023-11-28T19:44:41.524 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 23905 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2023-11-28T19:44:41.524 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 20001 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2023-11-28T19:44:41.525 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 17337 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2023-11-28T19:44:41.525 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 12497 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-dln2.ko 2023-11-28T19:44:41.525 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 17585 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-gpio.ko 2023-11-28T19:44:41.525 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 62817 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-i801.ko 2023-11-28T19:44:41.525 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 22433 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-isch.ko 2023-11-28T19:44:41.525 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 47889 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-ismt.ko 2023-11-28T19:44:41.525 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 17721 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-kempld.ko 2023-11-28T19:44:41.525 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 17881 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2023-11-28T19:44:41.525 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 22337 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-nforce2.ko 2023-11-28T19:44:41.525 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 26265 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-ocores.ko 2023-11-28T19:44:41.525 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 25145 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-parport.ko 2023-11-28T19:44:41.525 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 16497 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2023-11-28T19:44:41.525 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 47241 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-piix4.ko 2023-11-28T19:44:41.525 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 15289 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-robotfuzz-osif.ko 2023-11-28T19:44:41.526 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 18649 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-scmi.ko 2023-11-28T19:44:41.526 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 11809 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-simtec.ko 2023-11-28T19:44:41.526 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 22313 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-sis5595.ko 2023-11-28T19:44:41.526 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 29361 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-sis630.ko 2023-11-28T19:44:41.526 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 20329 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-sis96x.ko 2023-11-28T19:44:41.526 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 19241 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-taos-evm.ko 2023-11-28T19:44:41.526 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 19809 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2023-11-28T19:44:41.526 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 13801 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-via.ko 2023-11-28T19:44:41.526 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 26081 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-viapro.ko 2023-11-28T19:44:41.526 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 19041 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-viperboard.ko 2023-11-28T19:44:41.526 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 47657 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-xiic.ko 2023-11-28T19:44:41.526 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 22449 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/i2c-mux.ko 2023-11-28T19:44:41.527 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 18825 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/i2c-smbus.ko 2023-11-28T19:44:41.527 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 27073 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/i2c-stub.ko 2023-11-28T19:44:41.527 INFO:teuthology.orchestra.run.smithi179.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/muxes/ 2023-11-28T19:44:41.527 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 14921 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/muxes/i2c-mux-gpio.ko 2023-11-28T19:44:41.527 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 13457 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/muxes/i2c-mux-pca9541.ko 2023-11-28T19:44:41.527 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 29737 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/muxes/i2c-mux-pca954x.ko 2023-11-28T19:44:41.527 INFO:teuthology.orchestra.run.smithi179.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/ 2023-11-28T19:44:41.527 INFO:teuthology.orchestra.run.smithi179.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/core/ 2023-11-28T19:44:41.527 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 273609 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/core/ib_cm.ko 2023-11-28T19:44:41.527 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 879969 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/core/ib_core.ko 2023-11-28T19:44:41.527 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 69273 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/core/ib_umad.ko 2023-11-28T19:44:41.527 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 324217 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/core/ib_uverbs.ko 2023-11-28T19:44:41.527 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 97985 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/core/iw_cm.ko 2023-11-28T19:44:41.527 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 282273 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/core/rdma_cm.ko 2023-11-28T19:44:41.528 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 66201 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/core/rdma_ucm.ko 2023-11-28T19:44:41.528 INFO:teuthology.orchestra.run.smithi179.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/hw/ 2023-11-28T19:44:41.528 INFO:teuthology.orchestra.run.smithi179.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/hw/cxgb4/ 2023-11-28T19:44:41.528 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 493073 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2023-11-28T19:44:41.528 INFO:teuthology.orchestra.run.smithi179.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/hw/mlx4/ 2023-11-28T19:44:41.528 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 419737 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2023-11-28T19:44:41.528 INFO:teuthology.orchestra.run.smithi179.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/hw/mlx5/ 2023-11-28T19:44:41.528 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 739025 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2023-11-28T19:44:41.528 INFO:teuthology.orchestra.run.smithi179.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/hw/mthca/ 2023-11-28T19:44:41.528 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 296625 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2023-11-28T19:44:41.528 INFO:teuthology.orchestra.run.smithi179.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/hw/ocrdma/ 2023-11-28T19:44:41.528 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 153697 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/hw/ocrdma/ocrdma.ko 2023-11-28T19:44:41.528 INFO:teuthology.orchestra.run.smithi179.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/hw/usnic/ 2023-11-28T19:44:41.528 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 168969 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/hw/usnic/usnic_verbs.ko 2023-11-28T19:44:41.529 INFO:teuthology.orchestra.run.smithi179.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/ulp/ 2023-11-28T19:44:41.529 INFO:teuthology.orchestra.run.smithi179.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/ulp/ipoib/ 2023-11-28T19:44:41.529 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 263081 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2023-11-28T19:44:41.529 INFO:teuthology.orchestra.run.smithi179.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/ulp/iser/ 2023-11-28T19:44:41.529 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 100241 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2023-11-28T19:44:41.529 INFO:teuthology.orchestra.run.smithi179.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/ulp/isert/ 2023-11-28T19:44:41.529 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 111425 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2023-11-28T19:44:41.529 INFO:teuthology.orchestra.run.smithi179.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/ulp/srp/ 2023-11-28T19:44:41.529 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 128753 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2023-11-28T19:44:41.529 INFO:teuthology.orchestra.run.smithi179.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/ulp/srpt/ 2023-11-28T19:44:41.529 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 129529 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2023-11-28T19:44:41.529 INFO:teuthology.orchestra.run.smithi179.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/ 2023-11-28T19:44:41.529 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 10745 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/evbug.ko 2023-11-28T19:44:41.530 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 24129 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/ff-memless.ko 2023-11-28T19:44:41.530 INFO:teuthology.orchestra.run.smithi179.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/gameport/ 2023-11-28T19:44:41.530 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 11881 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/gameport/emu10k1-gp.ko 2023-11-28T19:44:41.530 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 12145 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/gameport/fm801-gp.ko 2023-11-28T19:44:41.530 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 41241 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/gameport/gameport.ko 2023-11-28T19:44:41.530 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 41801 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/joydev.ko 2023-11-28T19:44:41.530 INFO:teuthology.orchestra.run.smithi179.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/ 2023-11-28T19:44:41.530 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 13313 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/adp5520-keys.ko 2023-11-28T19:44:41.530 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 12801 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/adp5588-keys.ko 2023-11-28T19:44:41.530 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 26841 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/adp5589-keys.ko 2023-11-28T19:44:41.530 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 24761 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/cros_ec_keyb.ko 2023-11-28T19:44:41.530 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 36665 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/gpio_keys.ko 2023-11-28T19:44:41.530 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 18625 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/gpio_keys_polled.ko 2023-11-28T19:44:41.531 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 21257 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/lkkbd.ko 2023-11-28T19:44:41.531 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 26473 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/lm8323.ko 2023-11-28T19:44:41.531 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 14409 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/lm8333.ko 2023-11-28T19:44:41.531 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 24265 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/matrix_keypad.ko 2023-11-28T19:44:41.531 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 18217 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/max7359_keypad.ko 2023-11-28T19:44:41.531 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 15929 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/mcs_touchkey.ko 2023-11-28T19:44:41.531 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 16489 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/mpr121_touchkey.ko 2023-11-28T19:44:41.531 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 11585 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/newtonkbd.ko 2023-11-28T19:44:41.531 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 10673 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/opencores-kbd.ko 2023-11-28T19:44:41.531 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 14161 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/qt1070.ko 2023-11-28T19:44:41.531 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 17929 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/qt2160.ko 2023-11-28T19:44:41.531 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 23817 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/samsung-keypad.ko 2023-11-28T19:44:41.531 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 11481 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/stowaway.ko 2023-11-28T19:44:41.531 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 18289 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/sunkbd.ko 2023-11-28T19:44:41.532 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 17425 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/tca6416-keypad.ko 2023-11-28T19:44:41.532 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 16177 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/tca8418_keypad.ko 2023-11-28T19:44:41.532 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 16801 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/twl4030_keypad.ko 2023-11-28T19:44:41.532 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 11753 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/xtkbd.ko 2023-11-28T19:44:41.532 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 11465 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/matrix-keymap.ko 2023-11-28T19:44:41.532 INFO:teuthology.orchestra.run.smithi179.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/mouse/ 2023-11-28T19:44:41.532 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 34329 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/mouse/appletouch.ko 2023-11-28T19:44:41.532 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 34177 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/mouse/bcm5974.ko 2023-11-28T19:44:41.532 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 123681 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/mouse/cyapatp.ko 2023-11-28T19:44:41.532 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 89449 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/mouse/elan_i2c.ko 2023-11-28T19:44:41.532 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 13961 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/mouse/gpio_mouse.ko 2023-11-28T19:44:41.532 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 335929 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/mouse/psmouse.ko 2023-11-28T19:44:41.532 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 14681 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/mouse/sermouse.ko 2023-11-28T19:44:41.533 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 23881 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/mouse/synaptics_i2c.ko 2023-11-28T19:44:41.533 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 22569 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/mouse/synaptics_usb.ko 2023-11-28T19:44:41.533 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 15665 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/mouse/vsxxxaa.ko 2023-11-28T19:44:41.533 INFO:teuthology.orchestra.run.smithi179.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/rmi4/ 2023-11-28T19:44:41.533 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 109873 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/rmi4/rmi_core.ko 2023-11-28T19:44:41.533 INFO:teuthology.orchestra.run.smithi179.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/serio/ 2023-11-28T19:44:41.533 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 11665 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/serio/altera_ps2.ko 2023-11-28T19:44:41.533 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 16289 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/serio/arc_ps2.ko 2023-11-28T19:44:41.533 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 16425 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/serio/ct82c710.ko 2023-11-28T19:44:41.533 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 16953 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/serio/hyperv-keyboard.ko 2023-11-28T19:44:41.533 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 15833 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/serio/parkbd.ko 2023-11-28T19:44:41.533 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 13225 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/serio/pcips2.ko 2023-11-28T19:44:41.533 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 20153 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/serio/ps2mult.ko 2023-11-28T19:44:41.533 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 24153 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/serio/serio_raw.ko 2023-11-28T19:44:41.534 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 17977 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/serio/serport.ko 2023-11-28T19:44:41.534 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 13337 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/sparse-keymap.ko 2023-11-28T19:44:41.534 INFO:teuthology.orchestra.run.smithi179.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/iommu/ 2023-11-28T19:44:41.534 INFO:teuthology.orchestra.run.smithi179.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/iommu/amd/ 2023-11-28T19:44:41.534 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 39289 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/iommu/amd/iommu_v2.ko 2023-11-28T19:44:41.534 INFO:teuthology.orchestra.run.smithi179.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/ 2023-11-28T19:44:41.534 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 13817 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-88pm860x.ko 2023-11-28T19:44:41.534 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 11385 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-adp5520.ko 2023-11-28T19:44:41.534 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 59753 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-bd2802.ko 2023-11-28T19:44:41.534 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 24785 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-blinkm.ko 2023-11-28T19:44:41.534 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 10473 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-da903x.ko 2023-11-28T19:44:41.534 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 12241 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-da9052.ko 2023-11-28T19:44:41.534 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 16561 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-gpio.ko 2023-11-28T19:44:41.535 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 15793 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-lm3530.ko 2023-11-28T19:44:41.535 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 30505 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-lm3533.ko 2023-11-28T19:44:41.535 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 19353 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-lm355x.ko 2023-11-28T19:44:41.535 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 19961 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-lm3642.ko 2023-11-28T19:44:41.535 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 16241 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-lp3944.ko 2023-11-28T19:44:41.535 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 11233 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-lp8788.ko 2023-11-28T19:44:41.535 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 14929 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-max8997.ko 2023-11-28T19:44:41.535 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 12545 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-mc13783.ko 2023-11-28T19:44:41.535 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 13385 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-menf21bmc.ko 2023-11-28T19:44:41.535 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 20721 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-pca9532.ko 2023-11-28T19:44:41.535 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 20481 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-pca955x.ko 2023-11-28T19:44:41.535 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 17857 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-pca963x.ko 2023-11-28T19:44:41.535 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 34433 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-ss4200.ko 2023-11-28T19:44:41.536 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 24865 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-tca6507.ko 2023-11-28T19:44:41.536 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 15665 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-wm831x-status.ko 2023-11-28T19:44:41.536 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 11841 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-wm8350.ko 2023-11-28T19:44:41.536 INFO:teuthology.orchestra.run.smithi179.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/trigger/ 2023-11-28T19:44:41.536 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 9985 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/trigger/ledtrig-audio.ko 2023-11-28T19:44:41.536 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 10873 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2023-11-28T19:44:41.536 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 9089 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/trigger/ledtrig-camera.ko 2023-11-28T19:44:41.536 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 7617 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2023-11-28T19:44:41.536 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 14249 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2023-11-28T19:44:41.536 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 14073 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2023-11-28T19:44:41.536 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 11889 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/trigger/ledtrig-timer.ko 2023-11-28T19:44:41.536 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 14073 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/trigger/ledtrig-transient.ko 2023-11-28T19:44:41.536 INFO:teuthology.orchestra.run.smithi179.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/ 2023-11-28T19:44:41.537 INFO:teuthology.orchestra.run.smithi179.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/bcache/ 2023-11-28T19:44:41.537 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 654969 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/bcache/bcache.ko 2023-11-28T19:44:41.537 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 40577 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-bio-prison.ko 2023-11-28T19:44:41.537 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 89601 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-bufio.ko 2023-11-28T19:44:41.537 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 47529 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-cache-smq.ko 2023-11-28T19:44:41.537 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 156009 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-cache.ko 2023-11-28T19:44:41.537 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 106897 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-crypt.ko 2023-11-28T19:44:41.537 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 21545 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-delay.ko 2023-11-28T19:44:41.537 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 53857 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-era.ko 2023-11-28T19:44:41.537 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 28465 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-flakey.ko 2023-11-28T19:44:41.537 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 41529 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-log-userspace.ko 2023-11-28T19:44:41.537 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 32737 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-log.ko 2023-11-28T19:44:41.537 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 49545 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-mirror.ko 2023-11-28T19:44:41.537 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 78033 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-multipath.ko 2023-11-28T19:44:41.538 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 16473 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-queue-length.ko 2023-11-28T19:44:41.538 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 70825 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-raid.ko 2023-11-28T19:44:41.538 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 36297 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-region-hash.ko 2023-11-28T19:44:41.538 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 15873 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-round-robin.ko 2023-11-28T19:44:41.538 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 16801 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-service-time.ko 2023-11-28T19:44:41.538 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 109529 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-snapshot.ko 2023-11-28T19:44:41.538 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 19361 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-switch.ko 2023-11-28T19:44:41.538 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 181865 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-thin-pool.ko 2023-11-28T19:44:41.538 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 51737 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-verity.ko 2023-11-28T19:44:41.538 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 8561 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-zero.ko 2023-11-28T19:44:41.538 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 15345 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/faulty.ko 2023-11-28T19:44:41.538 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 19625 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/linear.ko 2023-11-28T19:44:41.538 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 32417 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/multipath.ko 2023-11-28T19:44:41.539 INFO:teuthology.orchestra.run.smithi179.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/persistent-data/ 2023-11-28T19:44:41.539 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 199937 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2023-11-28T19:44:41.539 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 37337 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/raid0.ko 2023-11-28T19:44:41.539 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 113073 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/raid1.ko 2023-11-28T19:44:41.539 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 158681 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/raid10.ko 2023-11-28T19:44:41.539 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 395721 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/raid456.ko 2023-11-28T19:44:41.539 INFO:teuthology.orchestra.run.smithi179.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/message/ 2023-11-28T19:44:41.539 INFO:teuthology.orchestra.run.smithi179.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/message/fusion/ 2023-11-28T19:44:41.539 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 178137 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/message/fusion/mptbase.ko 2023-11-28T19:44:41.539 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 63385 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/message/fusion/mptctl.ko 2023-11-28T19:44:41.539 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 44665 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/message/fusion/mptfc.ko 2023-11-28T19:44:41.539 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 37225 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/message/fusion/mptlan.ko 2023-11-28T19:44:41.539 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 123321 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/message/fusion/mptsas.ko 2023-11-28T19:44:41.539 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 79041 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/message/fusion/mptscsih.ko 2023-11-28T19:44:41.540 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 53017 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/message/fusion/mptspi.ko 2023-11-28T19:44:41.540 INFO:teuthology.orchestra.run.smithi179.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/ 2023-11-28T19:44:41.540 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 17305 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/88pm800.ko 2023-11-28T19:44:41.540 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 12761 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/88pm805.ko 2023-11-28T19:44:41.540 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 11193 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/88pm80x.ko 2023-11-28T19:44:41.540 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 11865 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/arizona-i2c.ko 2023-11-28T19:44:41.540 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 123721 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/arizona.ko 2023-11-28T19:44:41.540 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 11961 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/bcm590xx.ko 2023-11-28T19:44:41.540 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 17465 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/cros_ec_dev.ko 2023-11-28T19:44:41.540 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 34961 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/dln2.ko 2023-11-28T19:44:41.540 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 16689 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/janz-cmodio.ko 2023-11-28T19:44:41.540 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 53585 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/kempld-core.ko 2023-11-28T19:44:41.540 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 27529 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/lm3533-core.ko 2023-11-28T19:44:41.540 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 14993 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/lm3533-ctrlbank.ko 2023-11-28T19:44:41.541 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 13009 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/lp3943.ko 2023-11-28T19:44:41.541 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 54569 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/lpc_ich.ko 2023-11-28T19:44:41.541 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 12113 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/lpc_sch.ko 2023-11-28T19:44:41.541 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 17409 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/max8907.ko 2023-11-28T19:44:41.541 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 29857 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/mc13xxx-core.ko 2023-11-28T19:44:41.541 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 11801 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/mc13xxx-i2c.ko 2023-11-28T19:44:41.541 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 11593 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/menf21bmc.ko 2023-11-28T19:44:41.541 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 17329 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/pcf50633-adc.ko 2023-11-28T19:44:41.541 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 9153 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/pcf50633-gpio.ko 2023-11-28T19:44:41.541 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 34873 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/pcf50633.ko 2023-11-28T19:44:41.541 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 10105 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/rdc321x-southbridge.ko 2023-11-28T19:44:41.541 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 20289 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/retu-mfd.ko 2023-11-28T19:44:41.541 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 80425 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/si476x-core.ko 2023-11-28T19:44:41.541 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 48457 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/sm501.ko 2023-11-28T19:44:41.542 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 19825 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/ti_am335x_tscadc.ko 2023-11-28T19:44:41.542 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 51137 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/tps65010.ko 2023-11-28T19:44:41.542 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 10353 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/tps6507x.ko 2023-11-28T19:44:41.542 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 13329 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/viperboard.ko 2023-11-28T19:44:41.542 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 10537 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/vx855.ko 2023-11-28T19:44:41.542 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 17953 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/wl1273-core.ko 2023-11-28T19:44:41.542 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 44345 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/wm8994.ko 2023-11-28T19:44:41.542 INFO:teuthology.orchestra.run.smithi179.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/ 2023-11-28T19:44:41.542 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 13833 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/ad525x_dpot-i2c.ko 2023-11-28T19:44:41.542 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 48489 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/ad525x_dpot.ko 2023-11-28T19:44:41.542 INFO:teuthology.orchestra.run.smithi179.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/altera-stapl/ 2023-11-28T19:44:41.542 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 46585 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2023-11-28T19:44:41.542 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 18393 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/apds9802als.ko 2023-11-28T19:44:41.543 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 36729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/apds990x.ko 2023-11-28T19:44:41.543 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 45593 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/bh1770glc.ko 2023-11-28T19:44:41.543 INFO:teuthology.orchestra.run.smithi179.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/c2port/ 2023-11-28T19:44:41.543 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 11145 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/c2port/c2port-duramar2150.ko 2023-11-28T19:44:41.543 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 35281 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/c2port/core.ko 2023-11-28T19:44:41.543 INFO:teuthology.orchestra.run.smithi179.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/cb710/ 2023-11-28T19:44:41.543 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 25161 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/cb710/cb710.ko 2023-11-28T19:44:41.543 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 17801 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/ds1682.ko 2023-11-28T19:44:41.543 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 8897 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/dummy-irq.ko 2023-11-28T19:44:41.543 INFO:teuthology.orchestra.run.smithi179.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/echo/ 2023-11-28T19:44:41.543 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 13657 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/echo/echo.ko 2023-11-28T19:44:41.543 INFO:teuthology.orchestra.run.smithi179.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/eeprom/ 2023-11-28T19:44:41.543 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 37849 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/eeprom/at24.ko 2023-11-28T19:44:41.543 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 14321 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/eeprom/eeprom.ko 2023-11-28T19:44:41.544 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 14769 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2023-11-28T19:44:41.544 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 13537 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/eeprom/max6875.ko 2023-11-28T19:44:41.544 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 33009 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/enclosure.ko 2023-11-28T19:44:41.544 INFO:teuthology.orchestra.run.smithi179.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/genwqe/ 2023-11-28T19:44:41.544 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 152201 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/genwqe/genwqe_card.ko 2023-11-28T19:44:41.544 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 14129 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/hmc6352.ko 2023-11-28T19:44:41.544 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 31257 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/hpilo.ko 2023-11-28T19:44:41.544 INFO:teuthology.orchestra.run.smithi179.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/ibmasm/ 2023-11-28T19:44:41.544 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 72129 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/ibmasm/ibmasm.ko 2023-11-28T19:44:41.544 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 19785 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/ics932s401.ko 2023-11-28T19:44:41.544 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 21681 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/isl29003.ko 2023-11-28T19:44:41.544 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 15753 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/isl29020.ko 2023-11-28T19:44:41.544 INFO:teuthology.orchestra.run.smithi179.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/lis3lv02d/ 2023-11-28T19:44:41.545 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 42513 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2023-11-28T19:44:41.545 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 13857 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2023-11-28T19:44:41.545 INFO:teuthology.orchestra.run.smithi179.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/mei/ 2023-11-28T19:44:41.545 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 125209 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/mei/mei-me.ko 2023-11-28T19:44:41.545 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 56521 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/mei/mei-txe.ko 2023-11-28T19:44:41.545 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 310113 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/mei/mei.ko 2023-11-28T19:44:41.545 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 31329 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/phantom.ko 2023-11-28T19:44:41.545 INFO:teuthology.orchestra.run.smithi179.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/ti-st/ 2023-11-28T19:44:41.545 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 74265 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/ti-st/st_drv.ko 2023-11-28T19:44:41.545 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 24305 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/tifm_7xx1.ko 2023-11-28T19:44:41.545 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 28785 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/tifm_core.ko 2023-11-28T19:44:41.545 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 18729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/tsl2550.ko 2023-11-28T19:44:41.545 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 48697 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/vmw_balloon.ko 2023-11-28T19:44:41.546 INFO:teuthology.orchestra.run.smithi179.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/vmw_vmci/ 2023-11-28T19:44:41.546 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 183609 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2023-11-28T19:44:41.546 INFO:teuthology.orchestra.run.smithi179.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ 2023-11-28T19:44:41.546 INFO:teuthology.orchestra.run.smithi179.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/bonding/ 2023-11-28T19:44:41.546 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 490129 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/bonding/bonding.ko 2023-11-28T19:44:41.546 INFO:teuthology.orchestra.run.smithi179.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/dsa/ 2023-11-28T19:44:41.546 INFO:teuthology.orchestra.run.smithi179.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/dsa/b53/ 2023-11-28T19:44:41.546 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 106033 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/dsa/b53/b53_common.ko 2023-11-28T19:44:41.546 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 40417 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/dsa/bcm-sf2.ko 2023-11-28T19:44:41.546 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 16041 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/dsa/mv88e6060.ko 2023-11-28T19:44:41.546 INFO:teuthology.orchestra.run.smithi179.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/dsa/mv88e6xxx/ 2023-11-28T19:44:41.546 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 453737 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2023-11-28T19:44:41.547 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 16929 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/dummy.ko 2023-11-28T19:44:41.547 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 17961 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/eql.ko 2023-11-28T19:44:41.547 INFO:teuthology.orchestra.run.smithi179.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/ 2023-11-28T19:44:41.547 INFO:teuthology.orchestra.run.smithi179.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/3com/ 2023-11-28T19:44:41.547 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 45785 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2023-11-28T19:44:41.547 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 42105 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2023-11-28T19:44:41.547 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 130553 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/3com/3c59x.ko 2023-11-28T19:44:41.547 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 68849 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/3com/typhoon.ko 2023-11-28T19:44:41.547 INFO:teuthology.orchestra.run.smithi179.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/8390/ 2023-11-28T19:44:41.547 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 37649 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/8390/8390.ko 2023-11-28T19:44:41.547 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 59689 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2023-11-28T19:44:41.547 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 27201 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2023-11-28T19:44:41.547 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 99049 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2023-11-28T19:44:41.547 INFO:teuthology.orchestra.run.smithi179.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/adaptec/ 2023-11-28T19:44:41.548 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 54521 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/adaptec/starfire.ko 2023-11-28T19:44:41.548 INFO:teuthology.orchestra.run.smithi179.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/agere/ 2023-11-28T19:44:41.548 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 69137 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/agere/et131x.ko 2023-11-28T19:44:41.548 INFO:teuthology.orchestra.run.smithi179.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/alteon/ 2023-11-28T19:44:41.548 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 59585 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/alteon/acenic.ko 2023-11-28T19:44:41.548 INFO:teuthology.orchestra.run.smithi179.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/altera/ 2023-11-28T19:44:41.548 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 41409 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/altera/altera_tse.ko 2023-11-28T19:44:41.548 INFO:teuthology.orchestra.run.smithi179.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/amd/ 2023-11-28T19:44:41.548 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 54609 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/amd/amd8111e.ko 2023-11-28T19:44:41.548 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 49289 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2023-11-28T19:44:41.548 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 87297 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/amd/pcnet32.ko 2023-11-28T19:44:41.548 INFO:teuthology.orchestra.run.smithi179.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/atheros/ 2023-11-28T19:44:41.548 INFO:teuthology.orchestra.run.smithi179.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/atheros/alx/ 2023-11-28T19:44:41.549 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 97337 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2023-11-28T19:44:41.549 INFO:teuthology.orchestra.run.smithi179.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/atheros/atl1c/ 2023-11-28T19:44:41.549 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 104673 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2023-11-28T19:44:41.549 INFO:teuthology.orchestra.run.smithi179.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/atheros/atl1e/ 2023-11-28T19:44:41.549 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 90257 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2023-11-28T19:44:41.549 INFO:teuthology.orchestra.run.smithi179.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/atheros/atlx/ 2023-11-28T19:44:41.549 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 81569 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2023-11-28T19:44:41.549 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 69729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2023-11-28T19:44:41.549 INFO:teuthology.orchestra.run.smithi179.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/broadcom/ 2023-11-28T19:44:41.549 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 78401 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/broadcom/b44.ko 2023-11-28T19:44:41.549 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 176761 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2023-11-28T19:44:41.549 INFO:teuthology.orchestra.run.smithi179.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/broadcom/bnx2x/ 2023-11-28T19:44:41.549 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 1421497 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2023-11-28T19:44:41.550 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 128569 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/broadcom/cnic.ko 2023-11-28T19:44:41.550 INFO:teuthology.orchestra.run.smithi179.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/broadcom/genet/ 2023-11-28T19:44:41.550 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 132089 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2023-11-28T19:44:41.550 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 312081 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/broadcom/tg3.ko 2023-11-28T19:44:41.550 INFO:teuthology.orchestra.run.smithi179.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/brocade/ 2023-11-28T19:44:41.550 INFO:teuthology.orchestra.run.smithi179.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/brocade/bna/ 2023-11-28T19:44:41.550 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 323513 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2023-11-28T19:44:41.550 INFO:teuthology.orchestra.run.smithi179.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/chelsio/ 2023-11-28T19:44:41.550 INFO:teuthology.orchestra.run.smithi179.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/chelsio/cxgb/ 2023-11-28T19:44:41.550 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 193497 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2023-11-28T19:44:41.550 INFO:teuthology.orchestra.run.smithi179.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/chelsio/cxgb3/ 2023-11-28T19:44:41.550 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 347417 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2023-11-28T19:44:41.550 INFO:teuthology.orchestra.run.smithi179.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/chelsio/cxgb4/ 2023-11-28T19:44:41.551 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 1044497 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2023-11-28T19:44:41.651 INFO:teuthology.orchestra.run.smithi179.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/chelsio/cxgb4vf/ 2023-11-28T19:44:41.651 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 166193 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2023-11-28T19:44:41.652 INFO:teuthology.orchestra.run.smithi179.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/chelsio/libcxgb/ 2023-11-28T19:44:41.652 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 34881 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2023-11-28T19:44:41.652 INFO:teuthology.orchestra.run.smithi179.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/cisco/ 2023-11-28T19:44:41.652 INFO:teuthology.orchestra.run.smithi179.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/cisco/enic/ 2023-11-28T19:44:41.652 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 204345 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2023-11-28T19:44:41.652 INFO:teuthology.orchestra.run.smithi179.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/dec/ 2023-11-28T19:44:41.652 INFO:teuthology.orchestra.run.smithi179.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/dec/tulip/ 2023-11-28T19:44:41.652 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 69449 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2023-11-28T19:44:41.652 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 61489 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2023-11-28T19:44:41.652 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 141225 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2023-11-28T19:44:41.652 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 51497 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2023-11-28T19:44:41.652 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 62817 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2023-11-28T19:44:41.652 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 31369 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2023-11-28T19:44:41.653 INFO:teuthology.orchestra.run.smithi179.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/dlink/ 2023-11-28T19:44:41.653 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 60873 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/dlink/dl2k.ko 2023-11-28T19:44:41.653 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 62833 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/dlink/sundance.ko 2023-11-28T19:44:41.653 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 45721 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/dnet.ko 2023-11-28T19:44:41.653 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 25185 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/ec_bhf.ko 2023-11-28T19:44:41.653 INFO:teuthology.orchestra.run.smithi179.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/emulex/ 2023-11-28T19:44:41.653 INFO:teuthology.orchestra.run.smithi179.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/emulex/benet/ 2023-11-28T19:44:41.653 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 281137 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2023-11-28T19:44:41.653 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 49457 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/ethoc.ko 2023-11-28T19:44:41.653 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 51737 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/fealnx.ko 2023-11-28T19:44:41.653 INFO:teuthology.orchestra.run.smithi179.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/fujitsu/ 2023-11-28T19:44:41.653 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 45345 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/fujitsu/fmvj18x_cs.ko 2023-11-28T19:44:41.653 INFO:teuthology.orchestra.run.smithi179.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/ 2023-11-28T19:44:41.654 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 90465 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/e100.ko 2023-11-28T19:44:41.654 INFO:teuthology.orchestra.run.smithi179.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/e1000/ 2023-11-28T19:44:41.654 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 295577 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2023-11-28T19:44:41.654 INFO:teuthology.orchestra.run.smithi179.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/e1000e/ 2023-11-28T19:44:41.654 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 584497 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2023-11-28T19:44:41.654 INFO:teuthology.orchestra.run.smithi179.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/fm10k/ 2023-11-28T19:44:41.654 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 246209 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2023-11-28T19:44:41.654 INFO:teuthology.orchestra.run.smithi179.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/i40e/ 2023-11-28T19:44:41.654 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 925825 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2023-11-28T19:44:41.654 INFO:teuthology.orchestra.run.smithi179.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/iavf/ 2023-11-28T19:44:41.654 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 302937 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2023-11-28T19:44:41.654 INFO:teuthology.orchestra.run.smithi179.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/igb/ 2023-11-28T19:44:41.655 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 514641 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/igb/igb.ko 2023-11-28T19:44:41.655 INFO:teuthology.orchestra.run.smithi179.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/igbvf/ 2023-11-28T19:44:41.655 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 93593 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2023-11-28T19:44:41.655 INFO:teuthology.orchestra.run.smithi179.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/ixgbe/ 2023-11-28T19:44:41.655 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 734305 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2023-11-28T19:44:41.655 INFO:teuthology.orchestra.run.smithi179.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/ixgbevf/ 2023-11-28T19:44:41.655 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 151769 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2023-11-28T19:44:41.655 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 86921 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/jme.ko 2023-11-28T19:44:41.655 INFO:teuthology.orchestra.run.smithi179.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/marvell/ 2023-11-28T19:44:41.655 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 20977 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2023-11-28T19:44:41.655 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 102289 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/marvell/skge.ko 2023-11-28T19:44:41.655 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 122649 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/marvell/sky2.ko 2023-11-28T19:44:41.655 INFO:teuthology.orchestra.run.smithi179.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/mellanox/ 2023-11-28T19:44:41.656 INFO:teuthology.orchestra.run.smithi179.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/mellanox/mlx4/ 2023-11-28T19:44:41.656 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 727601 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2023-11-28T19:44:41.656 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 278937 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2023-11-28T19:44:41.656 INFO:teuthology.orchestra.run.smithi179.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/mellanox/mlx5/ 2023-11-28T19:44:41.656 INFO:teuthology.orchestra.run.smithi179.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/mellanox/mlx5/core/ 2023-11-28T19:44:41.656 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 1113681 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2023-11-28T19:44:41.656 INFO:teuthology.orchestra.run.smithi179.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/micrel/ 2023-11-28T19:44:41.656 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 53041 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/micrel/ks8842.ko 2023-11-28T19:44:41.656 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 40993 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/micrel/ks8851_common.ko 2023-11-28T19:44:41.656 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 19489 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/micrel/ks8851_par.ko 2023-11-28T19:44:41.656 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 95665 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2023-11-28T19:44:41.656 INFO:teuthology.orchestra.run.smithi179.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/myricom/ 2023-11-28T19:44:41.656 INFO:teuthology.orchestra.run.smithi179.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/myricom/myri10ge/ 2023-11-28T19:44:41.657 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 108649 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2023-11-28T19:44:41.657 INFO:teuthology.orchestra.run.smithi179.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/natsemi/ 2023-11-28T19:44:41.657 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 73441 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2023-11-28T19:44:41.657 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 47777 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2023-11-28T19:44:41.657 INFO:teuthology.orchestra.run.smithi179.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/neterion/ 2023-11-28T19:44:41.657 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 150905 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/neterion/s2io.ko 2023-11-28T19:44:41.657 INFO:teuthology.orchestra.run.smithi179.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/nvidia/ 2023-11-28T19:44:41.657 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 136721 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2023-11-28T19:44:41.657 INFO:teuthology.orchestra.run.smithi179.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/packetengines/ 2023-11-28T19:44:41.657 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 50481 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2023-11-28T19:44:41.657 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 43145 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2023-11-28T19:44:41.657 INFO:teuthology.orchestra.run.smithi179.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/qlogic/ 2023-11-28T19:44:41.658 INFO:teuthology.orchestra.run.smithi179.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/qlogic/netxen/ 2023-11-28T19:44:41.658 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 227897 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2023-11-28T19:44:41.658 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 87081 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2023-11-28T19:44:41.658 INFO:teuthology.orchestra.run.smithi179.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/qlogic/qlcnic/ 2023-11-28T19:44:41.658 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 672049 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2023-11-28T19:44:41.658 INFO:teuthology.orchestra.run.smithi179.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/rdc/ 2023-11-28T19:44:41.658 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 43017 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/rdc/r6040.ko 2023-11-28T19:44:41.658 INFO:teuthology.orchestra.run.smithi179.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/realtek/ 2023-11-28T19:44:41.658 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 67385 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/realtek/8139cp.ko 2023-11-28T19:44:41.658 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 83985 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/realtek/8139too.ko 2023-11-28T19:44:41.658 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 29321 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/realtek/atp.ko 2023-11-28T19:44:41.658 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 189801 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/realtek/r8169.ko 2023-11-28T19:44:41.658 INFO:teuthology.orchestra.run.smithi179.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/samsung/ 2023-11-28T19:44:41.659 INFO:teuthology.orchestra.run.smithi179.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/samsung/sxgbe/ 2023-11-28T19:44:41.659 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 104241 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/samsung/sxgbe/samsung-sxgbe.ko 2023-11-28T19:44:41.659 INFO:teuthology.orchestra.run.smithi179.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/sfc/ 2023-11-28T19:44:41.659 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 1052497 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/sfc/sfc.ko 2023-11-28T19:44:41.659 INFO:teuthology.orchestra.run.smithi179.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/silan/ 2023-11-28T19:44:41.659 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 47097 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/silan/sc92031.ko 2023-11-28T19:44:41.659 INFO:teuthology.orchestra.run.smithi179.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/sis/ 2023-11-28T19:44:41.659 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 54817 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/sis/sis190.ko 2023-11-28T19:44:41.659 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 63337 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/sis/sis900.ko 2023-11-28T19:44:41.659 INFO:teuthology.orchestra.run.smithi179.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/smsc/ 2023-11-28T19:44:41.659 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 61537 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/smsc/epic100.ko 2023-11-28T19:44:41.659 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 67193 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2023-11-28T19:44:41.659 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 73409 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2023-11-28T19:44:41.660 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 68177 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2023-11-28T19:44:41.660 INFO:teuthology.orchestra.run.smithi179.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/stmicro/ 2023-11-28T19:44:41.660 INFO:teuthology.orchestra.run.smithi179.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/stmicro/stmmac/ 2023-11-28T19:44:41.660 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 13441 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-generic.ko 2023-11-28T19:44:41.660 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 39905 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2023-11-28T19:44:41.660 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 20657 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac-platform.ko 2023-11-28T19:44:41.660 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 487025 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2023-11-28T19:44:41.660 INFO:teuthology.orchestra.run.smithi179.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/sun/ 2023-11-28T19:44:41.660 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 103337 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/sun/cassini.ko 2023-11-28T19:44:41.660 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 166097 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/sun/niu.ko 2023-11-28T19:44:41.660 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 66329 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/sun/sungem.ko 2023-11-28T19:44:41.660 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 78801 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/sun/sunhme.ko 2023-11-28T19:44:41.660 INFO:teuthology.orchestra.run.smithi179.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/tehuti/ 2023-11-28T19:44:41.661 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 50057 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2023-11-28T19:44:41.661 INFO:teuthology.orchestra.run.smithi179.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/ti/ 2023-11-28T19:44:41.661 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 86529 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/ti/tlan.ko 2023-11-28T19:44:41.661 INFO:teuthology.orchestra.run.smithi179.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/via/ 2023-11-28T19:44:41.661 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 80273 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/via/via-rhine.ko 2023-11-28T19:44:41.661 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 83633 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/via/via-velocity.ko 2023-11-28T19:44:41.661 INFO:teuthology.orchestra.run.smithi179.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/wiznet/ 2023-11-28T19:44:41.661 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 46241 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/wiznet/w5100.ko 2023-11-28T19:44:41.661 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 30849 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/wiznet/w5300.ko 2023-11-28T19:44:41.661 INFO:teuthology.orchestra.run.smithi179.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/xircom/ 2023-11-28T19:44:41.661 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 59993 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2023-11-28T19:44:41.661 INFO:teuthology.orchestra.run.smithi179.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/fddi/ 2023-11-28T19:44:41.661 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 41001 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/fddi/defxx.ko 2023-11-28T19:44:41.661 INFO:teuthology.orchestra.run.smithi179.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/fddi/skfp/ 2023-11-28T19:44:41.662 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 216985 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/fddi/skfp/skfp.ko 2023-11-28T19:44:41.662 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 77345 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/geneve.ko 2023-11-28T19:44:41.662 INFO:teuthology.orchestra.run.smithi179.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/hyperv/ 2023-11-28T19:44:41.662 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 235521 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/hyperv/hv_netvsc.ko 2023-11-28T19:44:41.662 INFO:teuthology.orchestra.run.smithi179.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ieee802154/ 2023-11-28T19:44:41.662 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 18273 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ieee802154/fakelb.ko 2023-11-28T19:44:41.662 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 25065 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ifb.ko 2023-11-28T19:44:41.662 INFO:teuthology.orchestra.run.smithi179.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ipvlan/ 2023-11-28T19:44:41.662 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 83769 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ipvlan/ipvlan.ko 2023-11-28T19:44:41.662 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 62145 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/macvlan.ko 2023-11-28T19:44:41.662 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 15865 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/macvtap.ko 2023-11-28T19:44:41.662 INFO:teuthology.orchestra.run.smithi179.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/mdio/ 2023-11-28T19:44:41.662 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 20569 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2023-11-28T19:44:41.663 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 14185 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/mdio/mdio-bitbang.ko 2023-11-28T19:44:41.663 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 13681 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/mdio/mdio-gpio.ko 2023-11-28T19:44:41.663 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 8825 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/mdio/mdio-regmap.ko 2023-11-28T19:44:41.663 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 16025 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/mdio.ko 2023-11-28T19:44:41.663 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 20513 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/mii.ko 2023-11-28T19:44:41.663 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 43953 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/netconsole.ko 2023-11-28T19:44:41.663 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 13145 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/nlmon.ko 2023-11-28T19:44:41.663 INFO:teuthology.orchestra.run.smithi179.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/pcs/ 2023-11-28T19:44:41.663 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 17985 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/pcs/pcs-lynx.ko 2023-11-28T19:44:41.663 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 38977 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/pcs/pcs_xpcs.ko 2023-11-28T19:44:41.663 INFO:teuthology.orchestra.run.smithi179.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/ 2023-11-28T19:44:41.663 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 9737 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/amd.ko 2023-11-28T19:44:41.663 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 50033 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/bcm-phy-lib.ko 2023-11-28T19:44:41.664 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 44721 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/bcm7xxx.ko 2023-11-28T19:44:41.664 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 11521 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/bcm87xx.ko 2023-11-28T19:44:41.664 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 42241 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/broadcom.ko 2023-11-28T19:44:41.664 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 10625 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/cicada.ko 2023-11-28T19:44:41.664 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 13025 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/davicom.ko 2023-11-28T19:44:41.664 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 9449 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/et1011c.ko 2023-11-28T19:44:41.664 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 24969 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/icplus.ko 2023-11-28T19:44:41.664 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 15849 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/lxt.ko 2023-11-28T19:44:41.664 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 82049 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/marvell.ko 2023-11-28T19:44:41.664 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 76113 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/micrel.ko 2023-11-28T19:44:41.664 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 12033 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/national.ko 2023-11-28T19:44:41.664 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 97857 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/phylink.ko 2023-11-28T19:44:41.664 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 10065 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/qsemi.ko 2023-11-28T19:44:41.664 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 50065 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/realtek.ko 2023-11-28T19:44:41.665 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 29985 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/smsc.ko 2023-11-28T19:44:41.665 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 10857 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/ste10Xp.ko 2023-11-28T19:44:41.665 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 24289 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/vitesse.ko 2023-11-28T19:44:41.665 INFO:teuthology.orchestra.run.smithi179.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/plip/ 2023-11-28T19:44:41.665 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 43505 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/plip/plip.ko 2023-11-28T19:44:41.665 INFO:teuthology.orchestra.run.smithi179.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ppp/ 2023-11-28T19:44:41.665 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 15857 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ppp/bsd_comp.ko 2023-11-28T19:44:41.665 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 29713 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ppp/ppp_async.ko 2023-11-28T19:44:41.665 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 17665 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ppp/ppp_deflate.ko 2023-11-28T19:44:41.665 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 18625 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ppp/ppp_mppe.ko 2023-11-28T19:44:41.665 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 28729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ppp/ppp_synctty.ko 2023-11-28T19:44:41.665 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 42545 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ppp/pppoe.ko 2023-11-28T19:44:41.665 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 13441 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ppp/pppox.ko 2023-11-28T19:44:41.666 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 32689 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ppp/pptp.ko 2023-11-28T19:44:41.666 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 28289 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/sb1000.ko 2023-11-28T19:44:41.666 INFO:teuthology.orchestra.run.smithi179.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/slip/ 2023-11-28T19:44:41.666 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 42465 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/slip/slip.ko 2023-11-28T19:44:41.666 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 26929 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/sungem_phy.ko 2023-11-28T19:44:41.666 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 64449 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/tap.ko 2023-11-28T19:44:41.666 INFO:teuthology.orchestra.run.smithi179.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/team/ 2023-11-28T19:44:41.666 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 106169 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/team/team.ko 2023-11-28T19:44:41.666 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 13497 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/team/team_mode_activebackup.ko 2023-11-28T19:44:41.666 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 10209 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/team/team_mode_broadcast.ko 2023-11-28T19:44:41.666 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 28881 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/team/team_mode_loadbalance.ko 2023-11-28T19:44:41.666 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 9641 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/team/team_mode_random.ko 2023-11-28T19:44:41.666 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 9321 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/team/team_mode_roundrobin.ko 2023-11-28T19:44:41.667 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 87017 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/veth.ko 2023-11-28T19:44:41.667 INFO:teuthology.orchestra.run.smithi179.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/vmxnet3/ 2023-11-28T19:44:41.667 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 144297 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/vmxnet3/vmxnet3.ko 2023-11-28T19:44:41.667 INFO:teuthology.orchestra.run.smithi179.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/vxlan/ 2023-11-28T19:44:41.667 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 297329 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/vxlan/vxlan.ko 2023-11-28T19:44:41.667 INFO:teuthology.orchestra.run.smithi179.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/xen-netback/ 2023-11-28T19:44:41.667 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 144585 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/xen-netback/xen-netback.ko 2023-11-28T19:44:41.667 INFO:teuthology.orchestra.run.smithi179.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ntb/ 2023-11-28T19:44:41.667 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 20969 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ntb/ntb.ko 2023-11-28T19:44:41.667 INFO:teuthology.orchestra.run.smithi179.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/nvme/ 2023-11-28T19:44:41.667 INFO:teuthology.orchestra.run.smithi179.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/nvme/host/ 2023-11-28T19:44:41.667 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 265121 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/nvme/host/nvme-core.ko 2023-11-28T19:44:41.667 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 102209 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/nvme/host/nvme.ko 2023-11-28T19:44:41.668 INFO:teuthology.orchestra.run.smithi179.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/parport/ 2023-11-28T19:44:41.668 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 133841 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/parport/parport.ko 2023-11-28T19:44:41.668 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 14561 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/parport/parport_cs.ko 2023-11-28T19:44:41.668 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 84465 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/parport/parport_pc.ko 2023-11-28T19:44:41.668 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 26121 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/parport/parport_serial.ko 2023-11-28T19:44:41.668 INFO:teuthology.orchestra.run.smithi179.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pci/ 2023-11-28T19:44:41.668 INFO:teuthology.orchestra.run.smithi179.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pci/hotplug/ 2023-11-28T19:44:41.668 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 25009 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2023-11-28T19:44:41.668 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 17849 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pci/hotplug/cpcihp_generic.ko 2023-11-28T19:44:41.668 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 20137 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pci/hotplug/cpcihp_zt5550.ko 2023-11-28T19:44:41.668 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 11857 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pci/pci-stub.ko 2023-11-28T19:44:41.668 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 46465 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pci/xen-pcifront.ko 2023-11-28T19:44:41.668 INFO:teuthology.orchestra.run.smithi179.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pcmcia/ 2023-11-28T19:44:41.668 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 26793 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pcmcia/i82092.ko 2023-11-28T19:44:41.669 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 145809 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pcmcia/pcmcia.ko 2023-11-28T19:44:41.669 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 62137 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pcmcia/pcmcia_core.ko 2023-11-28T19:44:41.669 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 34345 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pcmcia/pcmcia_rsrc.ko 2023-11-28T19:44:41.669 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 34265 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pcmcia/pd6729.ko 2023-11-28T19:44:41.669 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 112889 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pcmcia/yenta_socket.ko 2023-11-28T19:44:41.669 INFO:teuthology.orchestra.run.smithi179.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/phy/ 2023-11-28T19:44:41.669 INFO:teuthology.orchestra.run.smithi179.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/phy/broadcom/ 2023-11-28T19:44:41.669 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 10841 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/phy/broadcom/phy-bcm-kona-usb2.ko 2023-11-28T19:44:41.669 INFO:teuthology.orchestra.run.smithi179.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/phy/samsung/ 2023-11-28T19:44:41.669 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 8441 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/phy/samsung/phy-exynos-usb2.ko 2023-11-28T19:44:41.669 INFO:teuthology.orchestra.run.smithi179.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pinctrl/ 2023-11-28T19:44:41.669 INFO:teuthology.orchestra.run.smithi179.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pinctrl/intel/ 2023-11-28T19:44:41.669 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 70153 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2023-11-28T19:44:41.670 INFO:teuthology.orchestra.run.smithi179.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/ 2023-11-28T19:44:41.670 INFO:teuthology.orchestra.run.smithi179.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/chrome/ 2023-11-28T19:44:41.670 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 50889 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/chrome/cros-ec-sensorhub.ko 2023-11-28T19:44:41.670 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 20849 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/chrome/cros_ec.ko 2023-11-28T19:44:41.670 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 21449 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/chrome/cros_ec_chardev.ko 2023-11-28T19:44:41.670 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 25417 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/chrome/cros_ec_debugfs.ko 2023-11-28T19:44:41.670 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 26201 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/chrome/cros_ec_lightbar.ko 2023-11-28T19:44:41.670 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 18201 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/chrome/cros_ec_sysfs.ko 2023-11-28T19:44:41.670 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 17361 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/chrome/cros_usbpd_notify.ko 2023-11-28T19:44:41.670 INFO:teuthology.orchestra.run.smithi179.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/ 2023-11-28T19:44:41.670 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 67097 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/acer-wmi.ko 2023-11-28T19:44:41.670 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 39145 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/acerhdf.ko 2023-11-28T19:44:41.670 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 37025 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/apple-gmux.ko 2023-11-28T19:44:41.671 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 59665 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/asus-laptop.ko 2023-11-28T19:44:41.671 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 31161 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/asus-nb-wmi.ko 2023-11-28T19:44:41.671 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 127441 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/asus-wmi.ko 2023-11-28T19:44:41.671 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 36849 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/classmate-laptop.ko 2023-11-28T19:44:41.671 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 49121 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/eeepc-laptop.ko 2023-11-28T19:44:41.671 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 13961 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/eeepc-wmi.ko 2023-11-28T19:44:41.671 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 40265 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/fujitsu-laptop.ko 2023-11-28T19:44:41.671 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 22521 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/fujitsu-tablet.ko 2023-11-28T19:44:41.671 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 36593 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/hdaps.ko 2023-11-28T19:44:41.671 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 19449 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/ibm_rtl.ko 2023-11-28T19:44:41.671 INFO:teuthology.orchestra.run.smithi179.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/intel/ 2023-11-28T19:44:41.671 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 12073 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/intel/intel-rst.ko 2023-11-28T19:44:41.671 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 8985 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/intel/intel-smartconnect.ko 2023-11-28T19:44:41.671 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 43497 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/intel_ips.ko 2023-11-28T19:44:41.672 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 20273 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/msi-wmi.ko 2023-11-28T19:44:41.672 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 10377 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/mxm-wmi.ko 2023-11-28T19:44:41.672 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 34801 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/panasonic-laptop.ko 2023-11-28T19:44:41.672 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 42329 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/samsung-laptop.ko 2023-11-28T19:44:41.672 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 14169 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/samsung-q10.ko 2023-11-28T19:44:41.672 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 17321 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/topstar-laptop.ko 2023-11-28T19:44:41.672 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 13721 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2023-11-28T19:44:41.672 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 17081 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/toshiba_haps.ko 2023-11-28T19:44:41.672 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 10129 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/wmi-bmof.ko 2023-11-28T19:44:41.672 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 57569 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/wmi.ko 2023-11-28T19:44:41.672 INFO:teuthology.orchestra.run.smithi179.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/ 2023-11-28T19:44:41.672 INFO:teuthology.orchestra.run.smithi179.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/ 2023-11-28T19:44:41.673 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 30281 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/88pm860x_battery.ko 2023-11-28T19:44:41.673 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 33985 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/88pm860x_charger.ko 2023-11-28T19:44:41.673 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 55057 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/bq2415x_charger.ko 2023-11-28T19:44:41.673 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 54081 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/bq24190_charger.ko 2023-11-28T19:44:41.673 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 21553 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/bq24735-charger.ko 2023-11-28T19:44:41.673 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 17337 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/cros_peripheral_charger.ko 2023-11-28T19:44:41.673 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 19609 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/da9030_battery.ko 2023-11-28T19:44:41.673 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 19841 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/da9052-battery.ko 2023-11-28T19:44:41.673 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 29281 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/ds2760_battery.ko 2023-11-28T19:44:41.673 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 23217 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/ds2780_battery.ko 2023-11-28T19:44:41.673 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 23353 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/ds2781_battery.ko 2023-11-28T19:44:41.673 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 23649 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/ds2782_battery.ko 2023-11-28T19:44:41.673 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 20353 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/gpio-charger.ko 2023-11-28T19:44:41.674 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 18041 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/isp1704_charger.ko 2023-11-28T19:44:41.674 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 20273 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/lp8727_charger.ko 2023-11-28T19:44:41.674 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 12577 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/max14577_charger.ko 2023-11-28T19:44:41.674 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 25897 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/max17040_battery.ko 2023-11-28T19:44:41.674 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 30289 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/max17042_battery.ko 2023-11-28T19:44:41.674 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 18585 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/max8903_charger.ko 2023-11-28T19:44:41.674 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 23729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/max8925_power.ko 2023-11-28T19:44:41.674 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 21657 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/pcf50633-charger.ko 2023-11-28T19:44:41.674 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 38009 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/sbs-battery.ko 2023-11-28T19:44:41.674 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 28385 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/test_power.ko 2023-11-28T19:44:41.674 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 18865 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/tps65090-charger.ko 2023-11-28T19:44:41.675 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 11969 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/wm831x_backup.ko 2023-11-28T19:44:41.675 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 24521 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/wm831x_power.ko 2023-11-28T19:44:41.675 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 22417 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/wm8350_power.ko 2023-11-28T19:44:41.675 INFO:teuthology.orchestra.run.smithi179.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/powercap/ 2023-11-28T19:44:41.675 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 57729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/powercap/intel_rapl_common.ko 2023-11-28T19:44:41.675 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 17345 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/powercap/intel_rapl_msr.ko 2023-11-28T19:44:41.675 INFO:teuthology.orchestra.run.smithi179.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pps/ 2023-11-28T19:44:41.675 INFO:teuthology.orchestra.run.smithi179.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pps/clients/ 2023-11-28T19:44:41.675 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 15521 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pps/clients/pps-gpio.ko 2023-11-28T19:44:41.675 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 13249 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pps/clients/pps-ldisc.ko 2023-11-28T19:44:41.675 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 15913 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pps/clients/pps_parport.ko 2023-11-28T19:44:41.675 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 41873 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pps/pps_core.ko 2023-11-28T19:44:41.675 INFO:teuthology.orchestra.run.smithi179.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ptp/ 2023-11-28T19:44:41.676 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 66385 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ptp/ptp.ko 2023-11-28T19:44:41.676 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 16449 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ptp/ptp_kvm.ko 2023-11-28T19:44:41.676 INFO:teuthology.orchestra.run.smithi179.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/ 2023-11-28T19:44:41.676 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 23497 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-88pm80x.ko 2023-11-28T19:44:41.676 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 24521 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-88pm860x.ko 2023-11-28T19:44:41.676 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 15393 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-bq32k.ko 2023-11-28T19:44:41.676 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 20105 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-da9052.ko 2023-11-28T19:44:41.676 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 18505 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-da9055.ko 2023-11-28T19:44:41.676 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 20425 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-da9063.ko 2023-11-28T19:44:41.676 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 16457 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-ds1286.ko 2023-11-28T19:44:41.676 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 68577 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-ds1307.ko 2023-11-28T19:44:41.676 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 20817 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-ds1374.ko 2023-11-28T19:44:41.676 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 18217 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-ds1511.ko 2023-11-28T19:44:41.677 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 16737 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-ds1553.ko 2023-11-28T19:44:41.677 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 13953 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-ds1672.ko 2023-11-28T19:44:41.677 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 13369 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-ds1742.ko 2023-11-28T19:44:41.677 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 14697 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-ds2404.ko 2023-11-28T19:44:41.677 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 23705 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-ds3232.ko 2023-11-28T19:44:41.677 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 11081 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-em3027.ko 2023-11-28T19:44:41.677 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 24329 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-fm3130.ko 2023-11-28T19:44:41.677 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 20729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-isl12022.ko 2023-11-28T19:44:41.677 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 35969 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-isl1208.ko 2023-11-28T19:44:41.677 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 14673 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-lp8788.ko 2023-11-28T19:44:41.677 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 38097 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-m41t80.ko 2023-11-28T19:44:41.677 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 12089 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-m48t35.ko 2023-11-28T19:44:41.678 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 25945 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-m48t59.ko 2023-11-28T19:44:41.678 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 14841 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-m48t86.ko 2023-11-28T19:44:41.678 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 11633 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-max6900.ko 2023-11-28T19:44:41.678 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 14673 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-max8907.ko 2023-11-28T19:44:41.678 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 15345 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-max8925.ko 2023-11-28T19:44:41.678 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 25809 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-max8997.ko 2023-11-28T19:44:41.678 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 16681 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-max8998.ko 2023-11-28T19:44:41.678 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 18513 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-mc13xxx.ko 2023-11-28T19:44:41.678 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 11409 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-msm6242.ko 2023-11-28T19:44:41.678 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 19625 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-palmas.ko 2023-11-28T19:44:41.678 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 46633 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-pcf2127.ko 2023-11-28T19:44:41.678 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 17977 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-pcf50633.ko 2023-11-28T19:44:41.679 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 26993 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-pcf85063.ko 2023-11-28T19:44:41.679 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 21825 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-pcf8523.ko 2023-11-28T19:44:41.679 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 29817 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-pcf8563.ko 2023-11-28T19:44:41.679 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 12441 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-pcf8583.ko 2023-11-28T19:44:41.679 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 18033 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-rc5t583.ko 2023-11-28T19:44:41.679 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 13049 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-rp5c01.ko 2023-11-28T19:44:41.679 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 33753 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-rs5c372.ko 2023-11-28T19:44:41.679 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 27833 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-rv3029c2.ko 2023-11-28T19:44:41.679 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 25257 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-rx8025.ko 2023-11-28T19:44:41.679 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 20113 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-rx8581.ko 2023-11-28T19:44:41.679 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 21617 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-s35390a.ko 2023-11-28T19:44:41.679 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 16825 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-stk17ta8.ko 2023-11-28T19:44:41.679 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 17889 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-tps6586x.ko 2023-11-28T19:44:41.680 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 21337 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-tps65910.ko 2023-11-28T19:44:41.680 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 20545 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-wm831x.ko 2023-11-28T19:44:41.680 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 21089 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-wm8350.ko 2023-11-28T19:44:41.680 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 27873 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-x1205.ko 2023-11-28T19:44:41.680 INFO:teuthology.orchestra.run.smithi179.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/ 2023-11-28T19:44:41.680 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 77617 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/3w-9xxx.ko 2023-11-28T19:44:41.680 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 57665 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/3w-sas.ko 2023-11-28T19:44:41.680 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 55105 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/3w-xxxx.ko 2023-11-28T19:44:41.680 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 135185 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/BusLogic.ko 2023-11-28T19:44:41.680 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 26657 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/a100u2w.ko 2023-11-28T19:44:41.680 INFO:teuthology.orchestra.run.smithi179.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/aacraid/ 2023-11-28T19:44:41.680 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 272305 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/aacraid/aacraid.ko 2023-11-28T19:44:41.680 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 100617 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/advansys.ko 2023-11-28T19:44:41.680 INFO:teuthology.orchestra.run.smithi179.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/aic7xxx/ 2023-11-28T19:44:41.681 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 356201 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2023-11-28T19:44:41.681 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 295801 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2023-11-28T19:44:41.681 INFO:teuthology.orchestra.run.smithi179.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/aic94xx/ 2023-11-28T19:44:41.681 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 189185 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/aic94xx/aic94xx.ko 2023-11-28T19:44:41.681 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 24073 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/am53c974.ko 2023-11-28T19:44:41.681 INFO:teuthology.orchestra.run.smithi179.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/arcmsr/ 2023-11-28T19:44:41.681 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 106881 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/arcmsr/arcmsr.ko 2023-11-28T19:44:41.681 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 38185 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/atp870u.ko 2023-11-28T19:44:41.681 INFO:teuthology.orchestra.run.smithi179.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/be2iscsi/ 2023-11-28T19:44:41.681 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 246985 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2023-11-28T19:44:41.681 INFO:teuthology.orchestra.run.smithi179.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/bfa/ 2023-11-28T19:44:41.681 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 1171945 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/bfa/bfa.ko 2023-11-28T19:44:41.681 INFO:teuthology.orchestra.run.smithi179.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/bnx2fc/ 2023-11-28T19:44:41.681 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 237273 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2023-11-28T19:44:41.682 INFO:teuthology.orchestra.run.smithi179.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/bnx2i/ 2023-11-28T19:44:41.682 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 115369 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/bnx2i/bnx2i.ko 2023-11-28T19:44:41.682 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 40585 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/ch.ko 2023-11-28T19:44:41.682 INFO:teuthology.orchestra.run.smithi179.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/csiostor/ 2023-11-28T19:44:41.682 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 308921 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/csiostor/csiostor.ko 2023-11-28T19:44:41.682 INFO:teuthology.orchestra.run.smithi179.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/cxgbi/ 2023-11-28T19:44:41.682 INFO:teuthology.orchestra.run.smithi179.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/cxgbi/cxgb3i/ 2023-11-28T19:44:41.682 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 76145 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2023-11-28T19:44:41.682 INFO:teuthology.orchestra.run.smithi179.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/cxgbi/cxgb4i/ 2023-11-28T19:44:41.682 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 101449 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2023-11-28T19:44:41.682 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 146689 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2023-11-28T19:44:41.682 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 75553 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/dc395x.ko 2023-11-28T19:44:41.682 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 38073 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/dmx3191d.ko 2023-11-28T19:44:41.683 INFO:teuthology.orchestra.run.smithi179.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/esas2r/ 2023-11-28T19:44:41.683 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 212425 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/esas2r/esas2r.ko 2023-11-28T19:44:41.683 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 60505 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/esp_scsi.ko 2023-11-28T19:44:41.683 INFO:teuthology.orchestra.run.smithi179.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/fcoe/ 2023-11-28T19:44:41.683 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 78209 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/fcoe/fcoe.ko 2023-11-28T19:44:41.683 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 158505 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/fcoe/libfcoe.ko 2023-11-28T19:44:41.683 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 18945 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/fdomain.ko 2023-11-28T19:44:41.683 INFO:teuthology.orchestra.run.smithi179.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/fnic/ 2023-11-28T19:44:41.683 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 263489 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/fnic/fnic.ko 2023-11-28T19:44:41.683 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 201817 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/hpsa.ko 2023-11-28T19:44:41.683 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 51209 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/hptiop.ko 2023-11-28T19:44:41.683 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 49041 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/hv_storvsc.ko 2023-11-28T19:44:41.683 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 35337 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/imm.ko 2023-11-28T19:44:41.683 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 44057 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/initio.ko 2023-11-28T19:44:41.684 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 266537 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/ipr.ko 2023-11-28T19:44:41.684 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 101881 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/ips.ko 2023-11-28T19:44:41.684 INFO:teuthology.orchestra.run.smithi179.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/isci/ 2023-11-28T19:44:41.684 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 317153 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/isci/isci.ko 2023-11-28T19:44:41.684 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 26385 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2023-11-28T19:44:41.684 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 52961 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/iscsi_tcp.ko 2023-11-28T19:44:41.684 INFO:teuthology.orchestra.run.smithi179.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/libfc/ 2023-11-28T19:44:41.684 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 314865 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/libfc/libfc.ko 2023-11-28T19:44:41.684 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 145585 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/libiscsi.ko 2023-11-28T19:44:41.684 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 53521 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/libiscsi_tcp.ko 2023-11-28T19:44:41.684 INFO:teuthology.orchestra.run.smithi179.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/libsas/ 2023-11-28T19:44:41.684 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 216665 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/libsas/libsas.ko 2023-11-28T19:44:41.684 INFO:teuthology.orchestra.run.smithi179.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/lpfc/ 2023-11-28T19:44:41.685 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 2197249 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/lpfc/lpfc.ko 2023-11-28T19:44:41.685 INFO:teuthology.orchestra.run.smithi179.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/megaraid/ 2023-11-28T19:44:41.685 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 73569 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2023-11-28T19:44:41.685 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 33529 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2023-11-28T19:44:41.685 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 310617 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2023-11-28T19:44:41.685 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 84721 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/megaraid.ko 2023-11-28T19:44:41.685 INFO:teuthology.orchestra.run.smithi179.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/mpt3sas/ 2023-11-28T19:44:41.685 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 659825 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2023-11-28T19:44:41.685 INFO:teuthology.orchestra.run.smithi179.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/mvsas/ 2023-11-28T19:44:41.685 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 119561 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/mvsas/mvsas.ko 2023-11-28T19:44:41.685 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 78129 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/mvumi.ko 2023-11-28T19:44:41.685 INFO:teuthology.orchestra.run.smithi179.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/pcmcia/ 2023-11-28T19:44:41.685 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 81625 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/pcmcia/aha152x_cs.ko 2023-11-28T19:44:41.686 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 11713 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/pcmcia/fdomain_cs.ko 2023-11-28T19:44:41.686 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 20865 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/pcmcia/qlogic_cs.ko 2023-11-28T19:44:41.686 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 23857 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/pcmcia/sym53c500_cs.ko 2023-11-28T19:44:41.686 INFO:teuthology.orchestra.run.smithi179.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/pm8001/ 2023-11-28T19:44:41.686 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 364105 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/pm8001/pm80xx.ko 2023-11-28T19:44:41.686 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 123617 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/pmcraid.ko 2023-11-28T19:44:41.686 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 34513 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/ppa.ko 2023-11-28T19:44:41.686 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 55361 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/qla1280.ko 2023-11-28T19:44:41.686 INFO:teuthology.orchestra.run.smithi179.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/qla2xxx/ 2023-11-28T19:44:41.686 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 1876689 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2023-11-28T19:44:41.686 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 85289 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2023-11-28T19:44:41.686 INFO:teuthology.orchestra.run.smithi179.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/qla4xxx/ 2023-11-28T19:44:41.687 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 559033 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2023-11-28T19:44:41.687 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 19025 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/qlogicfas408.ko 2023-11-28T19:44:41.687 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 15993 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/raid_class.ko 2023-11-28T19:44:41.687 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 238761 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/scsi_debug.ko 2023-11-28T19:44:41.687 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 173937 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/scsi_transport_fc.ko 2023-11-28T19:44:41.687 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 279313 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/scsi_transport_iscsi.ko 2023-11-28T19:44:41.687 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 97729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/scsi_transport_sas.ko 2023-11-28T19:44:41.687 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 73881 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/scsi_transport_spi.ko 2023-11-28T19:44:41.687 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 44993 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/scsi_transport_srp.ko 2023-11-28T19:44:41.687 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 26249 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/ses.ko 2023-11-28T19:44:41.687 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 115889 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/st.ko 2023-11-28T19:44:41.687 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 46825 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/stex.ko 2023-11-28T19:44:41.687 INFO:teuthology.orchestra.run.smithi179.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/sym53c8xx_2/ 2023-11-28T19:44:41.688 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 162121 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2023-11-28T19:44:41.688 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 42297 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/virtio_scsi.ko 2023-11-28T19:44:41.688 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 50321 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/vmw_pvscsi.ko 2023-11-28T19:44:41.688 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 39961 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/wd719x.ko 2023-11-28T19:44:41.688 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 50025 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/xen-scsifront.ko 2023-11-28T19:44:41.688 INFO:teuthology.orchestra.run.smithi179.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ssb/ 2023-11-28T19:44:41.688 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 129441 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ssb/ssb.ko 2023-11-28T19:44:41.688 INFO:teuthology.orchestra.run.smithi179.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/target/ 2023-11-28T19:44:41.688 INFO:teuthology.orchestra.run.smithi179.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/target/iscsi/ 2023-11-28T19:44:41.688 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 736601 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2023-11-28T19:44:41.688 INFO:teuthology.orchestra.run.smithi179.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/target/loopback/ 2023-11-28T19:44:41.688 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 49985 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/target/loopback/tcm_loop.ko 2023-11-28T19:44:41.689 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 39713 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/target/target_core_file.ko 2023-11-28T19:44:41.689 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 43025 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/target/target_core_iblock.ko 2023-11-28T19:44:41.689 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 930257 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/target/target_core_mod.ko 2023-11-28T19:44:41.689 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 44305 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/target/target_core_pscsi.ko 2023-11-28T19:44:41.689 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 122521 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/target/target_core_user.ko 2023-11-28T19:44:41.689 INFO:teuthology.orchestra.run.smithi179.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/target/tcm_fc/ 2023-11-28T19:44:41.689 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 75593 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/target/tcm_fc/tcm_fc.ko 2023-11-28T19:44:41.689 INFO:teuthology.orchestra.run.smithi179.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/ 2023-11-28T19:44:41.689 INFO:teuthology.orchestra.run.smithi179.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/ 2023-11-28T19:44:41.689 INFO:teuthology.orchestra.run.smithi179.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/int340x_thermal/ 2023-11-28T19:44:41.689 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 23481 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2023-11-28T19:44:41.689 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 29321 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2023-11-28T19:44:41.689 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 9953 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2023-11-28T19:44:41.690 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 10257 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2023-11-28T19:44:41.690 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 15081 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2023-11-28T19:44:41.690 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 16497 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2023-11-28T19:44:41.690 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 26809 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2023-11-28T19:44:41.690 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 20281 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2023-11-28T19:44:41.690 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 14865 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2023-11-28T19:44:41.690 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 14393 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2023-11-28T19:44:41.690 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 13001 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2023-11-28T19:44:41.690 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 37065 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2023-11-28T19:44:41.690 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 30729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/intel_powerclamp.ko 2023-11-28T19:44:41.690 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 18937 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2023-11-28T19:44:41.690 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 11521 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2023-11-28T19:44:41.690 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 26425 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2023-11-28T19:44:41.690 INFO:teuthology.orchestra.run.smithi179.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/ 2023-11-28T19:44:41.691 INFO:teuthology.orchestra.run.smithi179.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/ipwireless/ 2023-11-28T19:44:41.691 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 78425 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/ipwireless/ipwireless.ko 2023-11-28T19:44:41.691 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 57865 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/moxa.ko 2023-11-28T19:44:41.691 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 50953 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/mxser.ko 2023-11-28T19:44:41.691 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 108601 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/n_gsm.ko 2023-11-28T19:44:41.691 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 31961 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/n_hdlc.ko 2023-11-28T19:44:41.691 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 67929 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/nozomi.ko 2023-11-28T19:44:41.691 INFO:teuthology.orchestra.run.smithi179.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/serial/ 2023-11-28T19:44:41.691 INFO:teuthology.orchestra.run.smithi179.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/serial/8250/ 2023-11-28T19:44:41.691 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 35753 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/serial/8250/8250_dw.ko 2023-11-28T19:44:41.691 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 59497 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/serial/8250/serial_cs.ko 2023-11-28T19:44:41.691 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 18097 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/serial/altera_jtaguart.ko 2023-11-28T19:44:41.692 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 22577 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/serial/altera_uart.ko 2023-11-28T19:44:41.692 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 9425 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/serial/arc_uart.ko 2023-11-28T19:44:41.692 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 72425 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/serial/fsl_lpuart.ko 2023-11-28T19:44:41.692 INFO:teuthology.orchestra.run.smithi179.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/serial/jsm/ 2023-11-28T19:44:41.692 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 103073 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/serial/jsm/jsm.ko 2023-11-28T19:44:41.692 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 28785 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/serial/rp2.ko 2023-11-28T19:44:41.692 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 52817 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/serial/sc16is7xx.ko 2023-11-28T19:44:41.692 INFO:teuthology.orchestra.run.smithi179.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ufs/ 2023-11-28T19:44:41.692 INFO:teuthology.orchestra.run.smithi179.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ufs/core/ 2023-11-28T19:44:41.692 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 531265 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ufs/core/ufshcd-core.ko 2023-11-28T19:44:41.692 INFO:teuthology.orchestra.run.smithi179.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ufs/host/ 2023-11-28T19:44:41.692 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 28481 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ufs/host/ufshcd-pci.ko 2023-11-28T19:44:41.692 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 14601 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ufs/host/ufshcd-pltfrm.ko 2023-11-28T19:44:41.693 INFO:teuthology.orchestra.run.smithi179.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/uio/ 2023-11-28T19:44:41.693 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 44513 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/uio/uio.ko 2023-11-28T19:44:41.693 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 12241 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/uio/uio_aec.ko 2023-11-28T19:44:41.693 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 11281 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/uio/uio_cif.ko 2023-11-28T19:44:41.693 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 18329 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/uio/uio_dmem_genirq.ko 2023-11-28T19:44:41.693 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 12937 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/uio/uio_mf624.ko 2023-11-28T19:44:41.693 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 12177 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/uio/uio_netx.ko 2023-11-28T19:44:41.693 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 10601 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/uio/uio_pci_generic.ko 2023-11-28T19:44:41.693 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 16057 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/uio/uio_pdrv_genirq.ko 2023-11-28T19:44:41.693 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 13633 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/uio/uio_sercos3.ko 2023-11-28T19:44:41.693 INFO:teuthology.orchestra.run.smithi179.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/ 2023-11-28T19:44:41.693 INFO:teuthology.orchestra.run.smithi179.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/c67x00/ 2023-11-28T19:44:41.694 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 73297 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/c67x00/c67x00.ko 2023-11-28T19:44:41.694 INFO:teuthology.orchestra.run.smithi179.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/chipidea/ 2023-11-28T19:44:41.694 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 144377 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/chipidea/ci_hdrc.ko 2023-11-28T19:44:41.694 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 18505 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/chipidea/ci_hdrc_msm.ko 2023-11-28T19:44:41.694 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 12713 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/chipidea/ci_hdrc_pci.ko 2023-11-28T19:44:41.694 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 13057 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/chipidea/ci_hdrc_usb2.ko 2023-11-28T19:44:41.694 INFO:teuthology.orchestra.run.smithi179.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/class/ 2023-11-28T19:44:41.694 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 87089 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/class/cdc-acm.ko 2023-11-28T19:44:41.694 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 51345 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/class/cdc-wdm.ko 2023-11-28T19:44:41.694 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 47305 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/class/usblp.ko 2023-11-28T19:44:41.694 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 89857 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/class/usbtmc.ko 2023-11-28T19:44:41.694 INFO:teuthology.orchestra.run.smithi179.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/common/ 2023-11-28T19:44:41.695 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 22953 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/common/ulpi.ko 2023-11-28T19:44:41.695 INFO:teuthology.orchestra.run.smithi179.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/dwc2/ 2023-11-28T19:44:41.695 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 11529 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/dwc2/dwc2_pci.ko 2023-11-28T19:44:41.695 INFO:teuthology.orchestra.run.smithi179.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/dwc3/ 2023-11-28T19:44:41.695 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 12089 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/dwc3/dwc3-haps.ko 2023-11-28T19:44:41.695 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 30041 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/dwc3/dwc3-pci.ko 2023-11-28T19:44:41.695 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 448505 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/dwc3/dwc3.ko 2023-11-28T19:44:41.695 INFO:teuthology.orchestra.run.smithi179.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/ 2023-11-28T19:44:41.695 INFO:teuthology.orchestra.run.smithi179.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/function/ 2023-11-28T19:44:41.695 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 60177 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/function/u_ether.ko 2023-11-28T19:44:41.695 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 51881 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/function/u_serial.ko 2023-11-28T19:44:41.695 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 28841 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/function/usb_f_acm.ko 2023-11-28T19:44:41.696 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 42449 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/function/usb_f_ecm.ko 2023-11-28T19:44:41.696 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 27953 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/function/usb_f_ecm_subset.ko 2023-11-28T19:44:41.696 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 36513 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/function/usb_f_eem.ko 2023-11-28T19:44:41.696 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 92489 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/function/usb_f_fs.ko 2023-11-28T19:44:41.696 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 51049 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/function/usb_f_hid.ko 2023-11-28T19:44:41.696 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 122081 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/function/usb_f_mass_storage.ko 2023-11-28T19:44:41.696 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 57681 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/function/usb_f_ncm.ko 2023-11-28T19:44:41.696 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 22185 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/function/usb_f_obex.ko 2023-11-28T19:44:41.696 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 31265 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/function/usb_f_phonet.ko 2023-11-28T19:44:41.696 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 57729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/function/usb_f_printer.ko 2023-11-28T19:44:41.696 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 85609 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/function/usb_f_rndis.ko 2023-11-28T19:44:41.696 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 19273 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/function/usb_f_serial.ko 2023-11-28T19:44:41.696 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 58113 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/function/usb_f_ss_lb.ko 2023-11-28T19:44:41.697 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 67337 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/function/usb_f_tcm.ko 2023-11-28T19:44:41.697 INFO:teuthology.orchestra.run.smithi179.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/legacy/ 2023-11-28T19:44:41.697 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 21265 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/legacy/g_acm_ms.ko 2023-11-28T19:44:41.697 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 18057 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/legacy/g_cdc.ko 2023-11-28T19:44:41.697 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 18465 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/legacy/g_dbgp.ko 2023-11-28T19:44:41.697 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 21657 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/legacy/g_ether.ko 2023-11-28T19:44:41.697 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 28401 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/legacy/g_ffs.ko 2023-11-28T19:44:41.697 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 19009 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/legacy/g_hid.ko 2023-11-28T19:44:41.697 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 20409 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/legacy/g_mass_storage.ko 2023-11-28T19:44:41.697 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 16977 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/legacy/g_ncm.ko 2023-11-28T19:44:41.697 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 32073 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/legacy/g_nokia.ko 2023-11-28T19:44:41.697 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 16793 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/legacy/g_printer.ko 2023-11-28T19:44:41.697 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 19393 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/legacy/g_serial.ko 2023-11-28T19:44:41.698 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 27201 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/legacy/g_zero.ko 2023-11-28T19:44:41.698 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 62185 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/legacy/gadgetfs.ko 2023-11-28T19:44:41.698 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 15201 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/legacy/tcm_usb_gadget.ko 2023-11-28T19:44:41.698 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 161225 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/libcomposite.ko 2023-11-28T19:44:41.698 INFO:teuthology.orchestra.run.smithi179.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/udc/ 2023-11-28T19:44:41.698 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 17705 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/udc/amd5536udc_pci.ko 2023-11-28T19:44:41.698 INFO:teuthology.orchestra.run.smithi179.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/udc/bdc/ 2023-11-28T19:44:41.698 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 157681 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/udc/bdc/bdc.ko 2023-11-28T19:44:41.698 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 36089 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/udc/goku_udc.ko 2023-11-28T19:44:41.698 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 52721 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/udc/gr_udc.ko 2023-11-28T19:44:41.698 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 69705 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/udc/mv_u3d_core.ko 2023-11-28T19:44:41.698 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 56033 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/udc/mv_udc.ko 2023-11-28T19:44:41.698 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 76057 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/udc/net2272.ko 2023-11-28T19:44:41.699 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 75073 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/udc/net2280.ko 2023-11-28T19:44:41.699 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 73169 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/udc/pch_udc.ko 2023-11-28T19:44:41.699 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 65809 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/udc/pxa27x_udc.ko 2023-11-28T19:44:41.699 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 66097 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/udc/r8a66597-udc.ko 2023-11-28T19:44:41.699 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 81505 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/udc/snps_udc_core.ko 2023-11-28T19:44:41.699 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 156073 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/udc/udc-core.ko 2023-11-28T19:44:41.699 INFO:teuthology.orchestra.run.smithi179.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/host/ 2023-11-28T19:44:41.699 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 11585 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/host/bcma-hcd.ko 2023-11-28T19:44:41.699 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 80113 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/host/isp116x-hcd.ko 2023-11-28T19:44:41.699 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 87353 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/host/oxu210hp-hcd.ko 2023-11-28T19:44:41.699 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 78873 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/host/r8a66597-hcd.ko 2023-11-28T19:44:41.699 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 51329 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/host/sl811-hcd.ko 2023-11-28T19:44:41.700 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 15593 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/host/sl811_cs.ko 2023-11-28T19:44:41.700 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 13305 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/host/ssb-hcd.ko 2023-11-28T19:44:41.700 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 25945 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/host/xhci-plat-hcd.ko 2023-11-28T19:44:41.700 INFO:teuthology.orchestra.run.smithi179.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/image/ 2023-11-28T19:44:41.700 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 34585 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/image/mdc800.ko 2023-11-28T19:44:41.700 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 21081 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/image/microtek.ko 2023-11-28T19:44:41.700 INFO:teuthology.orchestra.run.smithi179.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/ 2023-11-28T19:44:41.700 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 41721 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/adutux.ko 2023-11-28T19:44:41.700 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 20713 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/appledisplay.ko 2023-11-28T19:44:41.700 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 17721 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/cypress_cy7c63.ko 2023-11-28T19:44:41.700 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 23049 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/cytherm.ko 2023-11-28T19:44:41.700 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 13729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/ehset.ko 2023-11-28T19:44:41.700 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 15057 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/emi26.ko 2023-11-28T19:44:41.701 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 15985 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/emi62.ko 2023-11-28T19:44:41.701 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 11433 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/ezusb.ko 2023-11-28T19:44:41.701 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 19297 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/idmouse.ko 2023-11-28T19:44:41.701 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 36553 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/iowarrior.ko 2023-11-28T19:44:41.701 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 11593 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/isight_firmware.ko 2023-11-28T19:44:41.701 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 36529 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/ldusb.ko 2023-11-28T19:44:41.701 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 36265 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/legousbtower.ko 2023-11-28T19:44:41.701 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 27793 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/lvstest.ko 2023-11-28T19:44:41.701 INFO:teuthology.orchestra.run.smithi179.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/sisusbvga/ 2023-11-28T19:44:41.701 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 64841 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2023-11-28T19:44:41.701 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 12937 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/trancevibrator.ko 2023-11-28T19:44:41.701 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 20473 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/usb3503.ko 2023-11-28T19:44:41.702 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 25145 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/usblcd.ko 2023-11-28T19:44:41.702 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 22753 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/usbsevseg.ko 2023-11-28T19:44:41.702 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 70809 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/usbtest.ko 2023-11-28T19:44:41.702 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 41905 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/uss720.ko 2023-11-28T19:44:41.702 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 27617 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/yurex.ko 2023-11-28T19:44:41.702 INFO:teuthology.orchestra.run.smithi179.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/mon/ 2023-11-28T19:44:41.702 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 72953 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/mon/usbmon.ko 2023-11-28T19:44:41.702 INFO:teuthology.orchestra.run.smithi179.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/musb/ 2023-11-28T19:44:41.702 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 301697 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/musb/musb_hdrc.ko 2023-11-28T19:44:41.702 INFO:teuthology.orchestra.run.smithi179.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/phy/ 2023-11-28T19:44:41.702 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 21105 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/phy/phy-generic.ko 2023-11-28T19:44:41.702 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 20177 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/phy/phy-gpio-vbus-usb.ko 2023-11-28T19:44:41.702 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 12257 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/phy/phy-isp1301.ko 2023-11-28T19:44:41.703 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 21745 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/phy/phy-tahvo.ko 2023-11-28T19:44:41.703 INFO:teuthology.orchestra.run.smithi179.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/ 2023-11-28T19:44:41.703 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 13209 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/aircable.ko 2023-11-28T19:44:41.703 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 33329 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/ark3116.ko 2023-11-28T19:44:41.703 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 26633 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/belkin_sa.ko 2023-11-28T19:44:41.703 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 38105 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/ch341.ko 2023-11-28T19:44:41.703 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 70257 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/cp210x.ko 2023-11-28T19:44:41.703 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 31057 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/cyberjack.ko 2023-11-28T19:44:41.703 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 58217 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/cypress_m8.ko 2023-11-28T19:44:41.703 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 49817 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/digi_acceleport.ko 2023-11-28T19:44:41.703 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 9617 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/empeg.ko 2023-11-28T19:44:41.703 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 44273 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/f81232.ko 2023-11-28T19:44:41.703 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 175137 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/ftdi_sio.ko 2023-11-28T19:44:41.704 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 53113 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/garmin_gps.ko 2023-11-28T19:44:41.704 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 137081 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/io_edgeport.ko 2023-11-28T19:44:41.704 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 124833 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/io_ti.ko 2023-11-28T19:44:41.704 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 67769 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/ipaq.ko 2023-11-28T19:44:41.704 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 19161 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/ipw.ko 2023-11-28T19:44:41.704 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 26897 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/ir-usb.ko 2023-11-28T19:44:41.704 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 58233 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/iuu_phoenix.ko 2023-11-28T19:44:41.704 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 107521 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/keyspan.ko 2023-11-28T19:44:41.704 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 35617 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/keyspan_pda.ko 2023-11-28T19:44:41.704 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 25665 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/kl5kusb105.ko 2023-11-28T19:44:41.704 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 33689 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/kobil_sct.ko 2023-11-28T19:44:41.704 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 32953 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/mct_u232.ko 2023-11-28T19:44:41.704 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 22033 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/metro-usb.ko 2023-11-28T19:44:41.705 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 66449 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/mos7720.ko 2023-11-28T19:44:41.705 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 78217 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/mos7840.ko 2023-11-28T19:44:41.705 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 56337 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/mxuport.ko 2023-11-28T19:44:41.705 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 14025 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/navman.ko 2023-11-28T19:44:41.705 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 12009 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/omninet.ko 2023-11-28T19:44:41.705 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 24633 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/opticon.ko 2023-11-28T19:44:41.705 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 191137 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/option.ko 2023-11-28T19:44:41.705 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 39073 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/oti6858.ko 2023-11-28T19:44:41.705 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 54353 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/pl2303.ko 2023-11-28T19:44:41.705 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 9737 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/qcaux.ko 2023-11-28T19:44:41.705 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 37825 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/qcserial.ko 2023-11-28T19:44:41.705 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 34321 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/quatech2.ko 2023-11-28T19:44:41.705 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 15393 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/safe_serial.ko 2023-11-28T19:44:41.706 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 51625 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/sierra.ko 2023-11-28T19:44:41.706 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 21673 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/spcp8x5.ko 2023-11-28T19:44:41.706 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 29993 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/ssu100.ko 2023-11-28T19:44:41.706 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 17265 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/symbolserial.ko 2023-11-28T19:44:41.706 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 61489 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2023-11-28T19:44:41.706 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 23729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/usb-serial-simple.ko 2023-11-28T19:44:41.706 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 10241 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/usb_debug.ko 2023-11-28T19:44:41.706 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 33201 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/usb_wwan.ko 2023-11-28T19:44:41.706 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 125609 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/usbserial.ko 2023-11-28T19:44:41.706 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 28753 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/visor.ko 2023-11-28T19:44:41.706 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 37409 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/whiteheat.ko 2023-11-28T19:44:41.706 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 10537 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/wishbone-serial.ko 2023-11-28T19:44:41.706 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 9289 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/xsens_mt.ko 2023-11-28T19:44:41.707 INFO:teuthology.orchestra.run.smithi179.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/storage/ 2023-11-28T19:44:41.707 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 52913 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/storage/uas.ko 2023-11-28T19:44:41.707 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 26017 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/storage/ums-alauda.ko 2023-11-28T19:44:41.707 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 13049 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/storage/ums-cypress.ko 2023-11-28T19:44:41.707 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 22049 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/storage/ums-datafab.ko 2023-11-28T19:44:41.707 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 33497 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/storage/ums-eneub6250.ko 2023-11-28T19:44:41.707 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 13745 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/storage/ums-freecom.ko 2023-11-28T19:44:41.707 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 19769 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/storage/ums-isd200.ko 2023-11-28T19:44:41.707 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 19361 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/storage/ums-jumpshot.ko 2023-11-28T19:44:41.707 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 13713 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/storage/ums-karma.ko 2023-11-28T19:44:41.707 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 17841 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/storage/ums-onetouch.ko 2023-11-28T19:44:41.707 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 28441 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/storage/ums-realtek.ko 2023-11-28T19:44:41.707 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 28905 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/storage/ums-sddr09.ko 2023-11-28T19:44:41.708 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 19521 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/storage/ums-sddr55.ko 2023-11-28T19:44:41.708 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 35337 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/storage/ums-usbat.ko 2023-11-28T19:44:41.708 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 179969 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/storage/usb-storage.ko 2023-11-28T19:44:41.708 INFO:teuthology.orchestra.run.smithi179.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/usbip/ 2023-11-28T19:44:41.708 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 67481 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/usbip/usbip-core.ko 2023-11-28T19:44:41.708 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 72177 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/usbip/usbip-host.ko 2023-11-28T19:44:41.708 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 107001 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/usbip/vhci-hcd.ko 2023-11-28T19:44:41.708 INFO:teuthology.orchestra.run.smithi179.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/vfio/ 2023-11-28T19:44:41.708 INFO:teuthology.orchestra.run.smithi179.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/vfio/pci/ 2023-11-28T19:44:41.708 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 154297 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/vfio/pci/vfio-pci-core.ko 2023-11-28T19:44:41.708 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 29537 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/vfio/pci/vfio-pci.ko 2023-11-28T19:44:41.708 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 108737 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/vfio/vfio.ko 2023-11-28T19:44:41.709 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 77609 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/vfio/vfio_iommu_type1.ko 2023-11-28T19:44:41.709 INFO:teuthology.orchestra.run.smithi179.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/vhost/ 2023-11-28T19:44:41.709 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 113785 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/vhost/vhost.ko 2023-11-28T19:44:41.709 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 17009 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/vhost/vhost_iotlb.ko 2023-11-28T19:44:41.709 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 58089 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/vhost/vhost_net.ko 2023-11-28T19:44:41.709 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 89249 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/vhost/vhost_scsi.ko 2023-11-28T19:44:41.709 INFO:teuthology.orchestra.run.smithi179.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/ 2023-11-28T19:44:41.709 INFO:teuthology.orchestra.run.smithi179.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/backlight/ 2023-11-28T19:44:41.709 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 15417 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/backlight/88pm860x_bl.ko 2023-11-28T19:44:41.709 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 12393 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/backlight/aat2870_bl.ko 2023-11-28T19:44:41.709 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 23305 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/backlight/adp5520_bl.ko 2023-11-28T19:44:41.709 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 32609 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/backlight/adp8860_bl.ko 2023-11-28T19:44:41.709 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 39993 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/backlight/adp8870_bl.ko 2023-11-28T19:44:41.710 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 16921 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/backlight/apple_bl.ko 2023-11-28T19:44:41.710 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 16777 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/backlight/as3711_bl.ko 2023-11-28T19:44:41.710 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 12033 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/backlight/bd6107.ko 2023-11-28T19:44:41.710 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 11409 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/backlight/da903x_bl.ko 2023-11-28T19:44:41.710 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 11273 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/backlight/da9052_bl.ko 2023-11-28T19:44:41.710 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 11753 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/backlight/gpio_backlight.ko 2023-11-28T19:44:41.710 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 14769 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/backlight/kb3886_bl.ko 2023-11-28T19:44:41.710 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 22017 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/backlight/lcd.ko 2023-11-28T19:44:41.710 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 23657 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/backlight/lm3533_bl.ko 2023-11-28T19:44:41.710 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 19337 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/backlight/lm3639_bl.ko 2023-11-28T19:44:41.710 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 11425 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/backlight/lv5207lp.ko 2023-11-28T19:44:41.710 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 14345 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/backlight/max8925_bl.ko 2023-11-28T19:44:41.711 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 11313 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/backlight/pandora_bl.ko 2023-11-28T19:44:41.711 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 10865 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/backlight/pcf50633-backlight.ko 2023-11-28T19:44:41.711 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 10897 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/backlight/platform_lcd.ko 2023-11-28T19:44:41.711 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 12721 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/backlight/wm831x_bl.ko 2023-11-28T19:44:41.711 INFO:teuthology.orchestra.run.smithi179.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/ 2023-11-28T19:44:41.711 INFO:teuthology.orchestra.run.smithi179.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/masters/ 2023-11-28T19:44:41.711 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 18785 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/masters/ds2482.ko 2023-11-28T19:44:41.711 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 38985 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/masters/ds2490.ko 2023-11-28T19:44:41.711 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 11265 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/masters/matrox_w1.ko 2023-11-28T19:44:41.711 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 12417 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/masters/w1-gpio.ko 2023-11-28T19:44:41.711 INFO:teuthology.orchestra.run.smithi179.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/slaves/ 2023-11-28T19:44:41.711 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 12041 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/slaves/w1_ds2406.ko 2023-11-28T19:44:41.712 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 22745 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/slaves/w1_ds2408.ko 2023-11-28T19:44:41.712 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 15113 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/slaves/w1_ds2413.ko 2023-11-28T19:44:41.712 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 10825 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/slaves/w1_ds2423.ko 2023-11-28T19:44:41.712 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 14153 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/slaves/w1_ds2431.ko 2023-11-28T19:44:41.712 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 11929 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/slaves/w1_ds2433.ko 2023-11-28T19:44:41.712 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 14049 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/slaves/w1_ds2780.ko 2023-11-28T19:44:41.712 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 14049 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/slaves/w1_ds2781.ko 2023-11-28T19:44:41.712 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 17921 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/slaves/w1_ds28e04.ko 2023-11-28T19:44:41.712 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 7385 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/slaves/w1_smem.ko 2023-11-28T19:44:41.712 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 56425 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/slaves/w1_therm.ko 2023-11-28T19:44:41.712 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 102673 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/wire.ko 2023-11-28T19:44:41.712 INFO:teuthology.orchestra.run.smithi179.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/ 2023-11-28T19:44:41.712 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 18793 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/acquirewdt.ko 2023-11-28T19:44:41.713 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 19977 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/advantechwdt.ko 2023-11-28T19:44:41.713 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 18561 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/alim1535_wdt.ko 2023-11-28T19:44:41.713 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 22969 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/alim7101_wdt.ko 2023-11-28T19:44:41.713 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 19113 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/cpu5wdt.ko 2023-11-28T19:44:41.713 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 13617 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/da9052_wdt.ko 2023-11-28T19:44:41.713 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 12777 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/da9055_wdt.ko 2023-11-28T19:44:41.713 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 17409 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/da9063_wdt.ko 2023-11-28T19:44:41.713 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 20169 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/dw_wdt.ko 2023-11-28T19:44:41.713 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 20265 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/eurotechwdt.ko 2023-11-28T19:44:41.713 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 23865 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/f71808e_wdt.ko 2023-11-28T19:44:41.713 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 27401 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/hpwdt.ko 2023-11-28T19:44:41.713 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 15577 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/i6300esb.ko 2023-11-28T19:44:41.713 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 10833 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/iTCO_vendor_support.ko 2023-11-28T19:44:41.714 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 21913 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/iTCO_wdt.ko 2023-11-28T19:44:41.714 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 19241 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/ib700wdt.ko 2023-11-28T19:44:41.714 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 18689 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/ibmasr.ko 2023-11-28T19:44:41.714 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 19713 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/ie6xx_wdt.ko 2023-11-28T19:44:41.714 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 21225 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/it8712f_wdt.ko 2023-11-28T19:44:41.714 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 13841 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/it87_wdt.ko 2023-11-28T19:44:41.714 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 21489 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/kempld_wdt.ko 2023-11-28T19:44:41.714 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 18617 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/machzwd.ko 2023-11-28T19:44:41.714 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 14721 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/mena21_wdt.ko 2023-11-28T19:44:41.714 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 13217 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/menf21bmc_wdt.ko 2023-11-28T19:44:41.714 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 24673 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/nv_tco.ko 2023-11-28T19:44:41.714 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 17737 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/of_xilinx_wdt.ko 2023-11-28T19:44:41.715 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 22265 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/pc87413_wdt.ko 2023-11-28T19:44:41.715 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 38657 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/pcwd_pci.ko 2023-11-28T19:44:41.715 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 31825 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/pcwd_usb.ko 2023-11-28T19:44:41.715 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 13065 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/retu_wdt.ko 2023-11-28T19:44:41.715 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 20449 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/sbc60xxwdt.ko 2023-11-28T19:44:41.715 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 14129 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/sbc_epx_c3.ko 2023-11-28T19:44:41.715 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 17321 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2023-11-28T19:44:41.715 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 23809 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/sc1200wdt.ko 2023-11-28T19:44:41.715 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 23321 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/sch311x_wdt.ko 2023-11-28T19:44:41.715 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 21577 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/smsc37b787_wdt.ko 2023-11-28T19:44:41.716 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 17273 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/softdog.ko 2023-11-28T19:44:41.716 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 22273 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/sp5100_tco.ko 2023-11-28T19:44:41.716 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 12817 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/twl4030_wdt.ko 2023-11-28T19:44:41.716 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 17649 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/via_wdt.ko 2023-11-28T19:44:41.716 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 19161 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/w83627hf_wdt.ko 2023-11-28T19:44:41.716 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 20681 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/w83877f_wdt.ko 2023-11-28T19:44:41.716 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 25409 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/w83977f_wdt.ko 2023-11-28T19:44:41.716 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 18497 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/wafer5823wdt.ko 2023-11-28T19:44:41.716 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 28089 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/wdt_pci.ko 2023-11-28T19:44:41.716 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 16257 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/wm831x_wdt.ko 2023-11-28T19:44:41.716 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 13785 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/wm8350_wdt.ko 2023-11-28T19:44:41.716 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 15697 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/xen_wdt.ko 2023-11-28T19:44:41.717 INFO:teuthology.orchestra.run.smithi179.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/xen/ 2023-11-28T19:44:41.717 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 24729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/xen/xen-evtchn.ko 2023-11-28T19:44:41.717 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 26769 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/xen/xen-gntalloc.ko 2023-11-28T19:44:41.717 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 47865 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/xen/xen-gntdev.ko 2023-11-28T19:44:41.717 INFO:teuthology.orchestra.run.smithi179.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/xen/xen-pciback/ 2023-11-28T19:44:41.717 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 176377 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2023-11-28T19:44:41.717 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 40121 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/xen/xen-privcmd.ko 2023-11-28T19:44:41.717 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 71249 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/xen/xen-scsiback.ko 2023-11-28T19:44:41.717 INFO:teuthology.orchestra.run.smithi179.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/xen/xenfs/ 2023-11-28T19:44:41.717 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 19425 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/xen/xenfs/xenfs.ko 2023-11-28T19:44:41.717 INFO:teuthology.orchestra.run.smithi179.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ 2023-11-28T19:44:41.717 INFO:teuthology.orchestra.run.smithi179.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/9p/ 2023-11-28T19:44:41.717 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 166425 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/9p/9p.ko 2023-11-28T19:44:41.717 INFO:teuthology.orchestra.run.smithi179.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/adfs/ 2023-11-28T19:44:41.718 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 61073 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/adfs/adfs.ko 2023-11-28T19:44:41.718 INFO:teuthology.orchestra.run.smithi179.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/affs/ 2023-11-28T19:44:41.718 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 163593 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/affs/affs.ko 2023-11-28T19:44:41.718 INFO:teuthology.orchestra.run.smithi179.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/afs/ 2023-11-28T19:44:41.718 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 932817 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/afs/kafs.ko 2023-11-28T19:44:41.718 INFO:teuthology.orchestra.run.smithi179.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/autofs/ 2023-11-28T19:44:41.718 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 101057 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/autofs/autofs4.ko 2023-11-28T19:44:41.718 INFO:teuthology.orchestra.run.smithi179.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/befs/ 2023-11-28T19:44:41.718 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 64545 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/befs/befs.ko 2023-11-28T19:44:41.718 INFO:teuthology.orchestra.run.smithi179.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/bfs/ 2023-11-28T19:44:41.718 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 41257 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/bfs/bfs.ko 2023-11-28T19:44:41.718 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 34585 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/binfmt_misc.ko 2023-11-28T19:44:41.719 INFO:teuthology.orchestra.run.smithi179.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/btrfs/ 2023-11-28T19:44:41.719 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 3402729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/btrfs/btrfs.ko 2023-11-28T19:44:41.719 INFO:teuthology.orchestra.run.smithi179.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/cachefiles/ 2023-11-28T19:44:41.719 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 306009 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/cachefiles/cachefiles.ko 2023-11-28T19:44:41.719 INFO:teuthology.orchestra.run.smithi179.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ceph/ 2023-11-28T19:44:41.719 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 1333017 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ceph/ceph.ko 2023-11-28T19:44:41.719 INFO:teuthology.orchestra.run.smithi179.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/coda/ 2023-11-28T19:44:41.719 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 100801 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/coda/coda.ko 2023-11-28T19:44:41.719 INFO:teuthology.orchestra.run.smithi179.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/configfs/ 2023-11-28T19:44:41.719 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 108393 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/configfs/configfs.ko 2023-11-28T19:44:41.719 INFO:teuthology.orchestra.run.smithi179.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/cramfs/ 2023-11-28T19:44:41.719 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 29625 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/cramfs/cramfs.ko 2023-11-28T19:44:41.719 INFO:teuthology.orchestra.run.smithi179.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/dlm/ 2023-11-28T19:44:41.720 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 642513 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/dlm/dlm.ko 2023-11-28T19:44:41.720 INFO:teuthology.orchestra.run.smithi179.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/efs/ 2023-11-28T19:44:41.720 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 36649 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/efs/efs.ko 2023-11-28T19:44:41.720 INFO:teuthology.orchestra.run.smithi179.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/f2fs/ 2023-11-28T19:44:41.720 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 1505025 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/f2fs/f2fs.ko 2023-11-28T19:44:41.720 INFO:teuthology.orchestra.run.smithi179.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/fat/ 2023-11-28T19:44:41.720 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 27929 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/fat/msdos.ko 2023-11-28T19:44:41.720 INFO:teuthology.orchestra.run.smithi179.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/freevxfs/ 2023-11-28T19:44:41.720 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 42545 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/freevxfs/freevxfs.ko 2023-11-28T19:44:41.720 INFO:teuthology.orchestra.run.smithi179.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/fscache/ 2023-11-28T19:44:41.720 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 226481 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/fscache/fscache.ko 2023-11-28T19:44:41.720 INFO:teuthology.orchestra.run.smithi179.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/fuse/ 2023-11-28T19:44:41.720 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 24489 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/fuse/cuse.ko 2023-11-28T19:44:41.721 INFO:teuthology.orchestra.run.smithi179.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/gfs2/ 2023-11-28T19:44:41.721 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 1231529 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/gfs2/gfs2.ko 2023-11-28T19:44:41.721 INFO:teuthology.orchestra.run.smithi179.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/hfs/ 2023-11-28T19:44:41.721 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 141209 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/hfs/hfs.ko 2023-11-28T19:44:41.721 INFO:teuthology.orchestra.run.smithi179.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/hfsplus/ 2023-11-28T19:44:41.721 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 222817 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/hfsplus/hfsplus.ko 2023-11-28T19:44:41.721 INFO:teuthology.orchestra.run.smithi179.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/hpfs/ 2023-11-28T19:44:41.721 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 192329 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/hpfs/hpfs.ko 2023-11-28T19:44:41.721 INFO:teuthology.orchestra.run.smithi179.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/isofs/ 2023-11-28T19:44:41.721 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 74065 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/isofs/isofs.ko 2023-11-28T19:44:41.721 INFO:teuthology.orchestra.run.smithi179.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/jfs/ 2023-11-28T19:44:41.721 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 419497 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/jfs/jfs.ko 2023-11-28T19:44:41.721 INFO:teuthology.orchestra.run.smithi179.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/lockd/ 2023-11-28T19:44:41.722 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 280313 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/lockd/lockd.ko 2023-11-28T19:44:41.722 INFO:teuthology.orchestra.run.smithi179.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/minix/ 2023-11-28T19:44:41.722 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 89193 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/minix/minix.ko 2023-11-28T19:44:41.722 INFO:teuthology.orchestra.run.smithi179.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/netfs/ 2023-11-28T19:44:41.722 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 124649 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/netfs/netfs.ko 2023-11-28T19:44:41.722 INFO:teuthology.orchestra.run.smithi179.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nfs/ 2023-11-28T19:44:41.722 INFO:teuthology.orchestra.run.smithi179.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nfs/blocklayout/ 2023-11-28T19:44:41.722 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 81449 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2023-11-28T19:44:41.722 INFO:teuthology.orchestra.run.smithi179.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nfs/filelayout/ 2023-11-28T19:44:41.722 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 59449 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2023-11-28T19:44:41.722 INFO:teuthology.orchestra.run.smithi179.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nfs/flexfilelayout/ 2023-11-28T19:44:41.722 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 117465 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2023-11-28T19:44:41.723 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 1055721 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nfs/nfs.ko 2023-11-28T19:44:41.723 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 66441 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nfs/nfsv2.ko 2023-11-28T19:44:41.723 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 120177 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nfs/nfsv3.ko 2023-11-28T19:44:41.723 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 2042137 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nfs/nfsv4.ko 2023-11-28T19:44:41.723 INFO:teuthology.orchestra.run.smithi179.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nfs_common/ 2023-11-28T19:44:41.723 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 16929 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nfs_common/grace.ko 2023-11-28T19:44:41.723 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 16145 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nfs_common/nfs_acl.ko 2023-11-28T19:44:41.723 INFO:teuthology.orchestra.run.smithi179.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nfsd/ 2023-11-28T19:44:41.723 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 1516873 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nfsd/nfsd.ko 2023-11-28T19:44:41.723 INFO:teuthology.orchestra.run.smithi179.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nilfs2/ 2023-11-28T19:44:41.723 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 592833 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nilfs2/nilfs2.ko 2023-11-28T19:44:41.723 INFO:teuthology.orchestra.run.smithi179.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/ 2023-11-28T19:44:41.724 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 13793 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/mac-celtic.ko 2023-11-28T19:44:41.724 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 13169 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/mac-centeuro.ko 2023-11-28T19:44:41.724 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 13793 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/mac-croatian.ko 2023-11-28T19:44:41.724 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 12865 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/mac-cyrillic.ko 2023-11-28T19:44:41.724 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 13481 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/mac-gaelic.ko 2023-11-28T19:44:41.724 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 12857 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/mac-greek.ko 2023-11-28T19:44:41.724 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 13793 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/mac-iceland.ko 2023-11-28T19:44:41.724 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 13169 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/mac-inuit.ko 2023-11-28T19:44:41.724 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 14097 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/mac-roman.ko 2023-11-28T19:44:41.724 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 13793 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/mac-romanian.ko 2023-11-28T19:44:41.724 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 13793 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/mac-turkish.ko 2023-11-28T19:44:41.724 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 11297 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_ascii.ko 2023-11-28T19:44:41.724 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 12537 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp1250.ko 2023-11-28T19:44:41.725 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 12233 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp1251.ko 2023-11-28T19:44:41.725 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 12921 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp1255.ko 2023-11-28T19:44:41.725 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 12537 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp737.ko 2023-11-28T19:44:41.725 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 12537 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp775.ko 2023-11-28T19:44:41.725 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 12225 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp850.ko 2023-11-28T19:44:41.725 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 12225 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp852.ko 2023-11-28T19:44:41.725 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 12225 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp855.ko 2023-11-28T19:44:41.725 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 11913 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp857.ko 2023-11-28T19:44:41.725 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 12849 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp860.ko 2023-11-28T19:44:41.725 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 13161 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp861.ko 2023-11-28T19:44:41.725 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 13473 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp862.ko 2023-11-28T19:44:41.725 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 13161 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp863.ko 2023-11-28T19:44:41.726 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 12849 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp864.ko 2023-11-28T19:44:41.726 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 13161 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp865.ko 2023-11-28T19:44:41.726 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 12537 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp866.ko 2023-11-28T19:44:41.726 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 12225 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp869.ko 2023-11-28T19:44:41.726 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 11985 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp874.ko 2023-11-28T19:44:41.726 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 94137 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp932.ko 2023-11-28T19:44:41.726 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 142673 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp936.ko 2023-11-28T19:44:41.726 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 165745 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp949.ko 2023-11-28T19:44:41.726 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 118121 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp950.ko 2023-11-28T19:44:41.726 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 12457 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_euc-jp.ko 2023-11-28T19:44:41.726 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 11305 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_iso8859-1.ko 2023-11-28T19:44:41.726 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 11929 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_iso8859-13.ko 2023-11-28T19:44:41.727 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 11929 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_iso8859-14.ko 2023-11-28T19:44:41.727 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 11929 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_iso8859-15.ko 2023-11-28T19:44:41.727 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 11921 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_iso8859-2.ko 2023-11-28T19:44:41.727 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 11921 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_iso8859-3.ko 2023-11-28T19:44:41.727 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 11921 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_iso8859-4.ko 2023-11-28T19:44:41.727 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 11921 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_iso8859-5.ko 2023-11-28T19:44:41.727 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 11617 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_iso8859-6.ko 2023-11-28T19:44:41.727 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 12233 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_iso8859-7.ko 2023-11-28T19:44:41.727 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 11617 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_iso8859-9.ko 2023-11-28T19:44:41.727 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 12537 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_koi8-r.ko 2023-11-28T19:44:41.727 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 8017 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_koi8-ru.ko 2023-11-28T19:44:41.727 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 12537 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_koi8-u.ko 2023-11-28T19:44:41.728 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 7569 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_ucs2_utils.ko 2023-11-28T19:44:41.728 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 8337 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_utf8.ko 2023-11-28T19:44:41.728 INFO:teuthology.orchestra.run.smithi179.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ntfs/ 2023-11-28T19:44:41.728 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 219417 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ntfs/ntfs.ko 2023-11-28T19:44:41.728 INFO:teuthology.orchestra.run.smithi179.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ocfs2/ 2023-11-28T19:44:41.728 INFO:teuthology.orchestra.run.smithi179.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ocfs2/cluster/ 2023-11-28T19:44:41.728 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 244409 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2023-11-28T19:44:41.728 INFO:teuthology.orchestra.run.smithi179.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ocfs2/dlm/ 2023-11-28T19:44:41.728 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 440737 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2023-11-28T19:44:41.728 INFO:teuthology.orchestra.run.smithi179.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ocfs2/dlmfs/ 2023-11-28T19:44:41.728 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 54049 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2023-11-28T19:44:41.728 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 2592433 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ocfs2/ocfs2.ko 2023-11-28T19:44:41.729 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 17905 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2023-11-28T19:44:41.729 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 31729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ocfs2/ocfs2_stack_user.ko 2023-11-28T19:44:41.729 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 35897 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ocfs2/ocfs2_stackglue.ko 2023-11-28T19:44:41.729 INFO:teuthology.orchestra.run.smithi179.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/omfs/ 2023-11-28T19:44:41.729 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 53433 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/omfs/omfs.ko 2023-11-28T19:44:41.729 INFO:teuthology.orchestra.run.smithi179.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/overlayfs/ 2023-11-28T19:44:41.729 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 352161 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/overlayfs/overlay.ko 2023-11-28T19:44:41.729 INFO:teuthology.orchestra.run.smithi179.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/pstore/ 2023-11-28T19:44:41.729 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 54809 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/pstore/ramoops.ko 2023-11-28T19:44:41.729 INFO:teuthology.orchestra.run.smithi179.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/qnx4/ 2023-11-28T19:44:41.729 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 26865 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/qnx4/qnx4.ko 2023-11-28T19:44:41.729 INFO:teuthology.orchestra.run.smithi179.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/qnx6/ 2023-11-28T19:44:41.729 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 46689 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/qnx6/qnx6.ko 2023-11-28T19:44:41.730 INFO:teuthology.orchestra.run.smithi179.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/quota/ 2023-11-28T19:44:41.730 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 30881 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/quota/quota_tree.ko 2023-11-28T19:44:41.730 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 14297 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/quota/quota_v1.ko 2023-11-28T19:44:41.730 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 22017 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/quota/quota_v2.ko 2023-11-28T19:44:41.730 INFO:teuthology.orchestra.run.smithi179.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/reiserfs/ 2023-11-28T19:44:41.730 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 532673 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/reiserfs/reiserfs.ko 2023-11-28T19:44:41.730 INFO:teuthology.orchestra.run.smithi179.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/romfs/ 2023-11-28T19:44:41.730 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 28641 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/romfs/romfs.ko 2023-11-28T19:44:41.730 INFO:teuthology.orchestra.run.smithi179.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/smb/ 2023-11-28T19:44:41.730 INFO:teuthology.orchestra.run.smithi179.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/smb/client/ 2023-11-28T19:44:41.730 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 2668401 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/smb/client/cifs.ko 2023-11-28T19:44:41.730 INFO:teuthology.orchestra.run.smithi179.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/smb/common/ 2023-11-28T19:44:41.731 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 7161 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/smb/common/cifs_arc4.ko 2023-11-28T19:44:41.731 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 11257 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/smb/common/cifs_md4.ko 2023-11-28T19:44:41.731 INFO:teuthology.orchestra.run.smithi179.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/squashfs/ 2023-11-28T19:44:41.731 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 134641 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/squashfs/squashfs.ko 2023-11-28T19:44:41.731 INFO:teuthology.orchestra.run.smithi179.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/sysv/ 2023-11-28T19:44:41.731 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 90721 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/sysv/sysv.ko 2023-11-28T19:44:41.731 INFO:teuthology.orchestra.run.smithi179.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/udf/ 2023-11-28T19:44:41.731 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 247737 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/udf/udf.ko 2023-11-28T19:44:41.731 INFO:teuthology.orchestra.run.smithi179.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ufs/ 2023-11-28T19:44:41.731 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 162497 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ufs/ufs.ko 2023-11-28T19:44:41.731 INFO:teuthology.orchestra.run.smithi179.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/xfs/ 2023-11-28T19:44:41.731 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 4011017 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/xfs/xfs.ko 2023-11-28T19:44:41.732 INFO:teuthology.orchestra.run.smithi179.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/kernel/ 2023-11-28T19:44:41.732 INFO:teuthology.orchestra.run.smithi179.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/kernel/locking/ 2023-11-28T19:44:41.732 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 75489 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/kernel/locking/locktorture.ko 2023-11-28T19:44:41.732 INFO:teuthology.orchestra.run.smithi179.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/kernel/time/ 2023-11-28T19:44:41.732 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 13737 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/kernel/time/test_udelay.ko 2023-11-28T19:44:41.732 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 60553 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/kernel/torture.ko 2023-11-28T19:44:41.732 INFO:teuthology.orchestra.run.smithi179.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/ 2023-11-28T19:44:41.732 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 6833 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/crc-itu-t.ko 2023-11-28T19:44:41.732 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 6529 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/crc7.ko 2023-11-28T19:44:41.732 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 7025 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/crc8.ko 2023-11-28T19:44:41.732 INFO:teuthology.orchestra.run.smithi179.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/crypto/ 2023-11-28T19:44:41.732 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 7097 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/crypto/libarc4.ko 2023-11-28T19:44:41.732 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 37081 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/crypto/libdes.ko 2023-11-28T19:44:41.733 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 13313 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/interval_tree_test.ko 2023-11-28T19:44:41.733 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 8425 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/libcrc32c.ko 2023-11-28T19:44:41.733 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 24953 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/lru_cache.ko 2023-11-28T19:44:41.733 INFO:teuthology.orchestra.run.smithi179.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/lz4/ 2023-11-28T19:44:41.733 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 33801 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/lz4/lz4_compress.ko 2023-11-28T19:44:41.733 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 22633 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/lz4/lz4hc_compress.ko 2023-11-28T19:44:41.733 INFO:teuthology.orchestra.run.smithi179.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/math/ 2023-11-28T19:44:41.733 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 6617 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/math/cordic.ko 2023-11-28T19:44:41.733 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 8233 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/memory-notifier-error-inject.ko 2023-11-28T19:44:41.733 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 10865 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/notifier-error-inject.ko 2023-11-28T19:44:41.733 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 14089 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/percpu_test.ko 2023-11-28T19:44:41.733 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 8305 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/pm-notifier-error-inject.ko 2023-11-28T19:44:41.733 INFO:teuthology.orchestra.run.smithi179.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/raid6/ 2023-11-28T19:44:41.734 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 143433 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/raid6/raid6_pq.ko 2023-11-28T19:44:41.734 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 21105 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/rbtree_test.ko 2023-11-28T19:44:41.734 INFO:teuthology.orchestra.run.smithi179.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/reed_solomon/ 2023-11-28T19:44:41.734 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 18753 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/reed_solomon/reed_solomon.ko 2023-11-28T19:44:41.734 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 38841 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/test-kstrtox.ko 2023-11-28T19:44:41.734 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 26321 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/test-string_helpers.ko 2023-11-28T19:44:41.734 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 4760425 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/test_bpf.ko 2023-11-28T19:44:41.734 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 49089 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/test_firmware.ko 2023-11-28T19:44:41.734 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 6369 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/test_module.ko 2023-11-28T19:44:41.734 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 20801 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/test_user_copy.ko 2023-11-28T19:44:41.734 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 9585 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/ts_bm.ko 2023-11-28T19:44:41.734 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 11121 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/ts_fsm.ko 2023-11-28T19:44:41.735 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 9625 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/ts_kmp.ko 2023-11-28T19:44:41.735 INFO:teuthology.orchestra.run.smithi179.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/xz/ 2023-11-28T19:44:41.735 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 13545 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/xz/xz_dec_test.ko 2023-11-28T19:44:41.735 INFO:teuthology.orchestra.run.smithi179.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/mm/ 2023-11-28T19:44:41.735 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 15425 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/mm/hwpoison-inject.ko 2023-11-28T19:44:41.735 INFO:teuthology.orchestra.run.smithi179.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ 2023-11-28T19:44:41.735 INFO:teuthology.orchestra.run.smithi179.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/6lowpan/ 2023-11-28T19:44:41.735 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 55737 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/6lowpan/6lowpan.ko 2023-11-28T19:44:41.735 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 7049 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/6lowpan/nhc_dest.ko 2023-11-28T19:44:41.735 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 7065 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/6lowpan/nhc_fragment.ko 2023-11-28T19:44:41.735 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 7049 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/6lowpan/nhc_hop.ko 2023-11-28T19:44:41.735 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 6985 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/6lowpan/nhc_ipv6.ko 2023-11-28T19:44:41.736 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 7065 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/6lowpan/nhc_mobility.ko 2023-11-28T19:44:41.736 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 7001 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/6lowpan/nhc_routing.ko 2023-11-28T19:44:41.736 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 15329 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/6lowpan/nhc_udp.ko 2023-11-28T19:44:41.736 INFO:teuthology.orchestra.run.smithi179.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/802/ 2023-11-28T19:44:41.736 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 30385 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/802/garp.ko 2023-11-28T19:44:41.736 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 34809 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/802/mrp.ko 2023-11-28T19:44:41.736 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 8545 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/802/p8022.ko 2023-11-28T19:44:41.736 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 16345 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/802/psnap.ko 2023-11-28T19:44:41.736 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 11537 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/802/stp.ko 2023-11-28T19:44:41.736 INFO:teuthology.orchestra.run.smithi179.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/8021q/ 2023-11-28T19:44:41.736 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 81737 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/8021q/8021q.ko 2023-11-28T19:44:41.736 INFO:teuthology.orchestra.run.smithi179.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/9p/ 2023-11-28T19:44:41.736 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 198337 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/9p/9pnet.ko 2023-11-28T19:44:41.737 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 35977 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/9p/9pnet_fd.ko 2023-11-28T19:44:41.737 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 26345 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/9p/9pnet_rdma.ko 2023-11-28T19:44:41.737 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 32337 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/9p/9pnet_virtio.ko 2023-11-28T19:44:41.737 INFO:teuthology.orchestra.run.smithi179.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/batman-adv/ 2023-11-28T19:44:41.737 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 649297 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/batman-adv/batman-adv.ko 2023-11-28T19:44:41.737 INFO:teuthology.orchestra.run.smithi179.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/ 2023-11-28T19:44:41.737 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 63809 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/br_netfilter.ko 2023-11-28T19:44:41.737 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 777689 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/bridge.ko 2023-11-28T19:44:41.737 INFO:teuthology.orchestra.run.smithi179.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ 2023-11-28T19:44:41.737 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 7657 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_802_3.ko 2023-11-28T19:44:41.737 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 12385 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_among.ko 2023-11-28T19:44:41.737 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 9169 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_arp.ko 2023-11-28T19:44:41.737 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 9073 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_arpreply.ko 2023-11-28T19:44:41.737 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 9625 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_dnat.ko 2023-11-28T19:44:41.738 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 8737 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_ip.ko 2023-11-28T19:44:41.738 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 9145 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_ip6.ko 2023-11-28T19:44:41.738 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 9825 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_limit.ko 2023-11-28T19:44:41.738 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 13217 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_log.ko 2023-11-28T19:44:41.738 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 7585 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_mark.ko 2023-11-28T19:44:41.738 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 7593 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_mark_m.ko 2023-11-28T19:44:41.738 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 8385 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_nflog.ko 2023-11-28T19:44:41.738 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 7537 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_pkttype.ko 2023-11-28T19:44:41.738 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 9593 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_redirect.ko 2023-11-28T19:44:41.738 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 8649 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_snat.ko 2023-11-28T19:44:41.738 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 8825 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_stp.ko 2023-11-28T19:44:41.738 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 12401 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_vlan.ko 2023-11-28T19:44:41.739 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 11529 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebtable_broute.ko 2023-11-28T19:44:41.739 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 9817 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebtable_filter.ko 2023-11-28T19:44:41.739 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 9793 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebtable_nat.ko 2023-11-28T19:44:41.739 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 55929 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebtables.ko 2023-11-28T19:44:41.739 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 14041 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2023-11-28T19:44:41.739 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 13945 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2023-11-28T19:44:41.739 INFO:teuthology.orchestra.run.smithi179.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ceph/ 2023-11-28T19:44:41.739 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 1046833 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ceph/libceph.ko 2023-11-28T19:44:41.739 INFO:teuthology.orchestra.run.smithi179.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/core/ 2023-11-28T19:44:41.739 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 125993 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/core/pktgen.ko 2023-11-28T19:44:41.739 INFO:teuthology.orchestra.run.smithi179.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/dccp/ 2023-11-28T19:44:41.739 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 194209 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/dccp/dccp.ko 2023-11-28T19:44:41.740 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 8665 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/dccp/dccp_diag.ko 2023-11-28T19:44:41.740 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 57881 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/dccp/dccp_ipv4.ko 2023-11-28T19:44:41.740 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 60337 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/dccp/dccp_ipv6.ko 2023-11-28T19:44:41.740 INFO:teuthology.orchestra.run.smithi179.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/dsa/ 2023-11-28T19:44:41.740 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 390473 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/dsa/dsa_core.ko 2023-11-28T19:44:41.740 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 13337 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/dsa/tag_brcm.ko 2023-11-28T19:44:41.740 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 12577 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/dsa/tag_dsa.ko 2023-11-28T19:44:41.740 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 7721 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/dsa/tag_none.ko 2023-11-28T19:44:41.740 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 8953 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/dsa/tag_trailer.ko 2023-11-28T19:44:41.740 INFO:teuthology.orchestra.run.smithi179.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/hsr/ 2023-11-28T19:44:41.740 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 99729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/hsr/hsr.ko 2023-11-28T19:44:41.740 INFO:teuthology.orchestra.run.smithi179.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ieee802154/ 2023-11-28T19:44:41.740 INFO:teuthology.orchestra.run.smithi179.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ieee802154/6lowpan/ 2023-11-28T19:44:41.741 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 45233 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2023-11-28T19:44:41.741 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 254625 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ieee802154/ieee802154.ko 2023-11-28T19:44:41.741 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 47289 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ieee802154/ieee802154_socket.ko 2023-11-28T19:44:41.741 INFO:teuthology.orchestra.run.smithi179.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/ 2023-11-28T19:44:41.741 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 24729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/ah4.ko 2023-11-28T19:44:41.741 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 38905 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/esp4.ko 2023-11-28T19:44:41.741 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 48337 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/fou.ko 2023-11-28T19:44:41.741 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 18121 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/gre.ko 2023-11-28T19:44:41.741 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 48657 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/inet_diag.ko 2023-11-28T19:44:41.741 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 60633 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/ip_gre.ko 2023-11-28T19:44:41.741 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 61225 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/ip_tunnel.ko 2023-11-28T19:44:41.741 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 34505 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/ip_vti.ko 2023-11-28T19:44:41.742 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 14001 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/ipcomp.ko 2023-11-28T19:44:41.742 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 28841 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/ipip.ko 2023-11-28T19:44:41.742 INFO:teuthology.orchestra.run.smithi179.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/ 2023-11-28T19:44:41.742 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 37641 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/arp_tables.ko 2023-11-28T19:44:41.742 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 8873 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/arpt_mangle.ko 2023-11-28T19:44:41.742 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 10409 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/arptable_filter.ko 2023-11-28T19:44:41.742 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 41609 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/ip_tables.ko 2023-11-28T19:44:41.742 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 10057 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/ipt_ECN.ko 2023-11-28T19:44:41.742 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 9681 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/ipt_REJECT.ko 2023-11-28T19:44:41.742 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 14121 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2023-11-28T19:44:41.742 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 11177 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/ipt_ah.ko 2023-11-28T19:44:41.742 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 14881 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2023-11-28T19:44:41.743 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 11305 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/iptable_filter.ko 2023-11-28T19:44:41.743 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 11649 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/iptable_mangle.ko 2023-11-28T19:44:41.743 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 14905 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/iptable_nat.ko 2023-11-28T19:44:41.743 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 11545 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/iptable_raw.ko 2023-11-28T19:44:41.743 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 10409 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/iptable_security.ko 2023-11-28T19:44:41.743 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 12425 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2023-11-28T19:44:41.743 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 8817 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2023-11-28T19:44:41.743 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 27625 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2023-11-28T19:44:41.743 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 18161 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2023-11-28T19:44:41.743 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 13337 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2023-11-28T19:44:41.743 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 20561 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/nf_reject_ipv4.ko 2023-11-28T19:44:41.743 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 9329 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2023-11-28T19:44:41.743 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 15177 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2023-11-28T19:44:41.743 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 9961 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2023-11-28T19:44:41.744 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 17113 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2023-11-28T19:44:41.744 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 9009 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2023-11-28T19:44:41.744 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 13073 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/tcp_bic.ko 2023-11-28T19:44:41.744 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 13737 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/tcp_dctcp.ko 2023-11-28T19:44:41.744 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 15369 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/tcp_diag.ko 2023-11-28T19:44:41.744 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 9537 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/tcp_highspeed.ko 2023-11-28T19:44:41.744 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 12401 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/tcp_htcp.ko 2023-11-28T19:44:41.744 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 10449 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/tcp_hybla.ko 2023-11-28T19:44:41.744 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 11473 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/tcp_illinois.ko 2023-11-28T19:44:41.744 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 10433 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/tcp_lp.ko 2023-11-28T19:44:41.744 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 8329 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/tcp_scalable.ko 2023-11-28T19:44:41.744 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 14425 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/tcp_vegas.ko 2023-11-28T19:44:41.744 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 10089 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/tcp_veno.ko 2023-11-28T19:44:41.745 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 10953 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/tcp_westwood.ko 2023-11-28T19:44:41.745 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 10185 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/tcp_yeah.ko 2023-11-28T19:44:41.745 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 22601 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/tunnel4.ko 2023-11-28T19:44:41.745 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 17097 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/udp_diag.ko 2023-11-28T19:44:41.745 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 41665 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/udp_tunnel.ko 2023-11-28T19:44:41.745 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 11361 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/xfrm4_tunnel.ko 2023-11-28T19:44:41.745 INFO:teuthology.orchestra.run.smithi179.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/ 2023-11-28T19:44:41.745 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 26377 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/ah6.ko 2023-11-28T19:44:41.745 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 39537 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/esp6.ko 2023-11-28T19:44:41.745 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 14425 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/fou6.ko 2023-11-28T19:44:41.745 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 80897 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/ip6_gre.ko 2023-11-28T19:44:41.745 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 93577 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/ip6_tunnel.ko 2023-11-28T19:44:41.745 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 10825 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/ip6_udp_tunnel.ko 2023-11-28T19:44:41.746 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 53273 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/ip6_vti.ko 2023-11-28T19:44:41.746 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 13785 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/ipcomp6.ko 2023-11-28T19:44:41.746 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 19017 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/mip6.ko 2023-11-28T19:44:41.746 INFO:teuthology.orchestra.run.smithi179.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ 2023-11-28T19:44:41.746 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 42169 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6_tables.ko 2023-11-28T19:44:41.746 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 11753 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6t_NPT.ko 2023-11-28T19:44:41.746 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 9753 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2023-11-28T19:44:41.746 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 14137 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2023-11-28T19:44:41.746 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 14273 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6t_ah.ko 2023-11-28T19:44:41.746 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 7801 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2023-11-28T19:44:41.746 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 16209 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6t_frag.ko 2023-11-28T19:44:41.746 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 16033 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2023-11-28T19:44:41.747 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 8913 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2023-11-28T19:44:41.747 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 9897 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6t_mh.ko 2023-11-28T19:44:41.747 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 10937 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2023-11-28T19:44:41.747 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 10897 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6t_rt.ko 2023-11-28T19:44:41.747 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 11321 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6table_filter.ko 2023-11-28T19:44:41.747 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 11121 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2023-11-28T19:44:41.747 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 15009 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6table_nat.ko 2023-11-28T19:44:41.747 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 11553 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6table_raw.ko 2023-11-28T19:44:41.747 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 10433 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6table_security.ko 2023-11-28T19:44:41.747 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 39113 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2023-11-28T19:44:41.747 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 8449 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2023-11-28T19:44:41.747 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 25945 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2023-11-28T19:44:41.747 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 9801 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2023-11-28T19:44:41.748 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 15393 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2023-11-28T19:44:41.748 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 9633 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2023-11-28T19:44:41.748 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 16025 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2023-11-28T19:44:41.748 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 9009 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2023-11-28T19:44:41.748 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 74073 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/sit.ko 2023-11-28T19:44:41.748 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 24193 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/tunnel6.ko 2023-11-28T19:44:41.748 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 23297 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/xfrm6_tunnel.ko 2023-11-28T19:44:41.748 INFO:teuthology.orchestra.run.smithi179.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/key/ 2023-11-28T19:44:41.748 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 82833 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/key/af_key.ko 2023-11-28T19:44:41.748 INFO:teuthology.orchestra.run.smithi179.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/l2tp/ 2023-11-28T19:44:41.748 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 125281 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/l2tp/l2tp_core.ko 2023-11-28T19:44:41.748 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 20177 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/l2tp/l2tp_debugfs.ko 2023-11-28T19:44:41.749 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 25953 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/l2tp/l2tp_eth.ko 2023-11-28T19:44:41.749 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 35569 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/l2tp/l2tp_ip.ko 2023-11-28T19:44:41.749 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 36713 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/l2tp/l2tp_ip6.ko 2023-11-28T19:44:41.749 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 33001 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/l2tp/l2tp_netlink.ko 2023-11-28T19:44:41.749 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 53241 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/l2tp/l2tp_ppp.ko 2023-11-28T19:44:41.749 INFO:teuthology.orchestra.run.smithi179.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/lapb/ 2023-11-28T19:44:41.749 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 47977 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/lapb/lapb.ko 2023-11-28T19:44:41.749 INFO:teuthology.orchestra.run.smithi179.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/llc/ 2023-11-28T19:44:41.749 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 23193 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/llc/llc.ko 2023-11-28T19:44:41.749 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 267913 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/llc/llc2.ko 2023-11-28T19:44:41.749 INFO:teuthology.orchestra.run.smithi179.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/mac802154/ 2023-11-28T19:44:41.749 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 290417 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/mac802154/mac802154.ko 2023-11-28T19:44:41.750 INFO:teuthology.orchestra.run.smithi179.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/mpls/ 2023-11-28T19:44:41.750 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 9393 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/mpls/mpls_gso.ko 2023-11-28T19:44:41.750 INFO:teuthology.orchestra.run.smithi179.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ 2023-11-28T19:44:41.750 INFO:teuthology.orchestra.run.smithi179.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ 2023-11-28T19:44:41.750 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 119585 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ip_set.ko 2023-11-28T19:44:41.750 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 28353 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2023-11-28T19:44:41.750 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 26913 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2023-11-28T19:44:41.750 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 26369 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2023-11-28T19:44:41.750 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 100297 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2023-11-28T19:44:41.750 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 101441 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2023-11-28T19:44:41.750 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 102817 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2023-11-28T19:44:41.750 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 103417 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2023-11-28T19:44:41.750 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 112849 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2023-11-28T19:44:41.751 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 60329 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2023-11-28T19:44:41.751 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 109593 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2023-11-28T19:44:41.751 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 113129 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2023-11-28T19:44:41.751 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 112585 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2023-11-28T19:44:41.751 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 111585 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2023-11-28T19:44:41.751 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 114465 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2023-11-28T19:44:41.751 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 30025 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ip_set_list_set.ko 2023-11-28T19:44:41.751 INFO:teuthology.orchestra.run.smithi179.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipvs/ 2023-11-28T19:44:41.751 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 411729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipvs/ip_vs.ko 2023-11-28T19:44:41.751 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 11961 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2023-11-28T19:44:41.751 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 7625 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2023-11-28T19:44:41.751 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 17729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2023-11-28T19:44:41.752 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 17905 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2023-11-28T19:44:41.752 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 20673 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2023-11-28T19:44:41.752 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 7689 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2023-11-28T19:44:41.752 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 7689 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2023-11-28T19:44:41.752 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 10681 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2023-11-28T19:44:41.752 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 9233 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2023-11-28T19:44:41.752 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 7697 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2023-11-28T19:44:41.752 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 13521 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2023-11-28T19:44:41.752 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 7697 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2023-11-28T19:44:41.752 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 10993 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2023-11-28T19:44:41.752 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 49257 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_conncount.ko 2023-11-28T19:44:41.752 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 408257 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_conntrack.ko 2023-11-28T19:44:41.752 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 15985 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_conntrack_amanda.ko 2023-11-28T19:44:41.753 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 10177 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_conntrack_broadcast.ko 2023-11-28T19:44:41.753 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 33761 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_conntrack_ftp.ko 2023-11-28T19:44:41.753 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 118145 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_conntrack_h323.ko 2023-11-28T19:44:41.753 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 22185 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_conntrack_irc.ko 2023-11-28T19:44:41.753 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 8817 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2023-11-28T19:44:41.753 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 107233 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_conntrack_netlink.ko 2023-11-28T19:44:41.753 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 33633 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_conntrack_pptp.ko 2023-11-28T19:44:41.753 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 17401 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_conntrack_sane.ko 2023-11-28T19:44:41.753 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 66641 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_conntrack_sip.ko 2023-11-28T19:44:41.753 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 11233 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_conntrack_snmp.ko 2023-11-28T19:44:41.753 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 19185 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_conntrack_tftp.ko 2023-11-28T19:44:41.753 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 10113 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_dup_netdev.ko 2023-11-28T19:44:41.753 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 89425 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_flow_table.ko 2023-11-28T19:44:41.754 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 9593 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_flow_table_inet.ko 2023-11-28T19:44:41.754 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 37129 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_log_syslog.ko 2023-11-28T19:44:41.754 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 95353 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_nat.ko 2023-11-28T19:44:41.754 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 10129 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_nat_amanda.ko 2023-11-28T19:44:41.754 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 12625 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_nat_ftp.ko 2023-11-28T19:44:41.754 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 11857 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_nat_irc.ko 2023-11-28T19:44:41.754 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 28929 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_nat_sip.ko 2023-11-28T19:44:41.754 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 8809 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_nat_tftp.ko 2023-11-28T19:44:41.754 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 44065 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_synproxy_core.ko 2023-11-28T19:44:41.754 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 615649 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_tables.ko 2023-11-28T19:44:41.754 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 42561 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nfnetlink.ko 2023-11-28T19:44:41.754 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 30233 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nfnetlink_acct.ko 2023-11-28T19:44:41.754 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 30569 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nfnetlink_cttimeout.ko 2023-11-28T19:44:41.755 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 39785 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nfnetlink_log.ko 2023-11-28T19:44:41.755 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 22921 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nfnetlink_osf.ko 2023-11-28T19:44:41.755 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 49377 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nfnetlink_queue.ko 2023-11-28T19:44:41.755 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 10457 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_chain_nat.ko 2023-11-28T19:44:41.755 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 33209 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_compat.ko 2023-11-28T19:44:41.755 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 40721 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_ct.ko 2023-11-28T19:44:41.755 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 9601 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_dup_netdev.ko 2023-11-28T19:44:41.755 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 11401 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_fib.ko 2023-11-28T19:44:41.755 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 13745 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_fwd_netdev.ko 2023-11-28T19:44:41.755 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 14185 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_hash.ko 2023-11-28T19:44:41.755 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 20065 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_limit.ko 2023-11-28T19:44:41.755 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 15401 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_log.ko 2023-11-28T19:44:41.755 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 14801 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_masq.ko 2023-11-28T19:44:41.756 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 14329 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_nat.ko 2023-11-28T19:44:41.756 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 13673 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_numgen.ko 2023-11-28T19:44:41.756 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 11841 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_osf.ko 2023-11-28T19:44:41.756 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 14073 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_queue.ko 2023-11-28T19:44:41.756 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 14193 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_redir.ko 2023-11-28T19:44:41.756 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 10497 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_reject.ko 2023-11-28T19:44:41.756 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 10081 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_reject_inet.ko 2023-11-28T19:44:41.756 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 12737 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_socket.ko 2023-11-28T19:44:41.756 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 20369 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_synproxy.ko 2023-11-28T19:44:41.756 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 14849 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_tproxy.ko 2023-11-28T19:44:41.756 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 89313 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/x_tables.ko 2023-11-28T19:44:41.756 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 12097 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_AUDIT.ko 2023-11-28T19:44:41.757 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 9633 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_CHECKSUM.ko 2023-11-28T19:44:41.757 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 7729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_CLASSIFY.ko 2023-11-28T19:44:41.757 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 11521 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_CONNSECMARK.ko 2023-11-28T19:44:41.757 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 18169 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_CT.ko 2023-11-28T19:44:41.757 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 10497 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_DSCP.ko 2023-11-28T19:44:41.757 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 9465 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_HL.ko 2023-11-28T19:44:41.757 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 13369 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_HMARK.ko 2023-11-28T19:44:41.757 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 38873 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_IDLETIMER.ko 2023-11-28T19:44:41.757 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 13889 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_LED.ko 2023-11-28T19:44:41.757 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 11489 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_LOG.ko 2023-11-28T19:44:41.757 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 11753 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_MASQUERADE.ko 2023-11-28T19:44:41.757 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 11657 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_NETMAP.ko 2023-11-28T19:44:41.758 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 9473 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_NFLOG.ko 2023-11-28T19:44:41.758 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 13289 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_NFQUEUE.ko 2023-11-28T19:44:41.758 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 19665 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_RATEEST.ko 2023-11-28T19:44:41.758 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 11073 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_REDIRECT.ko 2023-11-28T19:44:41.758 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 14337 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_SECMARK.ko 2023-11-28T19:44:41.758 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 16057 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_TCPMSS.ko 2023-11-28T19:44:41.758 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 10433 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2023-11-28T19:44:41.758 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 17361 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_TEE.ko 2023-11-28T19:44:41.758 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 16785 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_TPROXY.ko 2023-11-28T19:44:41.758 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 8321 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_TRACE.ko 2023-11-28T19:44:41.758 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 13897 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_addrtype.ko 2023-11-28T19:44:41.758 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 13897 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_bpf.ko 2023-11-28T19:44:41.758 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 15529 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_cgroup.ko 2023-11-28T19:44:41.759 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 11209 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_cluster.ko 2023-11-28T19:44:41.759 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 7505 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_comment.ko 2023-11-28T19:44:41.759 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 10465 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_connbytes.ko 2023-11-28T19:44:41.759 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 11081 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_connlabel.ko 2023-11-28T19:44:41.759 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 9401 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_connlimit.ko 2023-11-28T19:44:41.759 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 13129 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_connmark.ko 2023-11-28T19:44:41.759 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 12401 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_conntrack.ko 2023-11-28T19:44:41.759 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 7817 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_cpu.ko 2023-11-28T19:44:41.759 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 10969 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_dccp.ko 2023-11-28T19:44:41.759 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 7865 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_devgroup.ko 2023-11-28T19:44:41.759 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 8801 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_dscp.ko 2023-11-28T19:44:41.759 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 10657 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_ecn.ko 2023-11-28T19:44:41.759 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 11473 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_esp.ko 2023-11-28T19:44:41.760 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 43289 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_hashlimit.ko 2023-11-28T19:44:41.760 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 11313 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_helper.ko 2023-11-28T19:44:41.760 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 7865 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_hl.ko 2023-11-28T19:44:41.760 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 11921 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_ipcomp.ko 2023-11-28T19:44:41.760 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 11473 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_iprange.ko 2023-11-28T19:44:41.760 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 11785 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_ipvs.ko 2023-11-28T19:44:41.760 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 16041 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_l2tp.ko 2023-11-28T19:44:41.760 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 8001 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_length.ko 2023-11-28T19:44:41.760 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 10209 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_limit.ko 2023-11-28T19:44:41.760 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 7545 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_mac.ko 2023-11-28T19:44:41.760 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 8577 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_mark.ko 2023-11-28T19:44:41.760 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 11825 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_multiport.ko 2023-11-28T19:44:41.760 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 13817 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_nat.ko 2023-11-28T19:44:41.761 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 10105 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_nfacct.ko 2023-11-28T19:44:41.761 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 8297 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_osf.ko 2023-11-28T19:44:41.761 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 9553 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_owner.ko 2023-11-28T19:44:41.761 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 9729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_physdev.ko 2023-11-28T19:44:41.761 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 7633 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_pkttype.ko 2023-11-28T19:44:41.761 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 11985 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_policy.ko 2023-11-28T19:44:41.761 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 9473 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_quota.ko 2023-11-28T19:44:41.761 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 10409 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_rateest.ko 2023-11-28T19:44:41.761 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 8257 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_realm.ko 2023-11-28T19:44:41.761 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 36433 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_recent.ko 2023-11-28T19:44:41.761 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 13329 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_sctp.ko 2023-11-28T19:44:41.761 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 30089 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_set.ko 2023-11-28T19:44:41.761 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 16089 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_socket.ko 2023-11-28T19:44:41.761 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 9505 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_state.ko 2023-11-28T19:44:41.762 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 9473 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_statistic.ko 2023-11-28T19:44:41.762 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 8809 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_string.ko 2023-11-28T19:44:41.762 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 8553 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_tcpmss.ko 2023-11-28T19:44:41.762 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 15777 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_tcpudp.ko 2023-11-28T19:44:41.762 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 11065 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_time.ko 2023-11-28T19:44:41.762 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 9401 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_u32.ko 2023-11-28T19:44:41.762 INFO:teuthology.orchestra.run.smithi179.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netlink/ 2023-11-28T19:44:41.762 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 13969 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netlink/netlink_diag.ko 2023-11-28T19:44:41.762 INFO:teuthology.orchestra.run.smithi179.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/nsh/ 2023-11-28T19:44:41.762 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 12425 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/nsh/nsh.ko 2023-11-28T19:44:41.762 INFO:teuthology.orchestra.run.smithi179.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/openvswitch/ 2023-11-28T19:44:41.762 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 380033 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/openvswitch/openvswitch.ko 2023-11-28T19:44:41.763 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 10257 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/openvswitch/vport-geneve.ko 2023-11-28T19:44:41.763 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 9449 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/openvswitch/vport-gre.ko 2023-11-28T19:44:41.763 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 11793 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/openvswitch/vport-vxlan.ko 2023-11-28T19:44:41.763 INFO:teuthology.orchestra.run.smithi179.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/packet/ 2023-11-28T19:44:41.763 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 13057 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/packet/af_packet_diag.ko 2023-11-28T19:44:41.763 INFO:teuthology.orchestra.run.smithi179.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/phonet/ 2023-11-28T19:44:41.763 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 110201 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/phonet/phonet.ko 2023-11-28T19:44:41.763 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 54721 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/phonet/pn_pep.ko 2023-11-28T19:44:41.763 INFO:teuthology.orchestra.run.smithi179.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/rds/ 2023-11-28T19:44:41.763 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 251481 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/rds/rds.ko 2023-11-28T19:44:41.763 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 164937 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/rds/rds_rdma.ko 2023-11-28T19:44:41.763 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 67377 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/rds/rds_tcp.ko 2023-11-28T19:44:41.763 INFO:teuthology.orchestra.run.smithi179.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/rxrpc/ 2023-11-28T19:44:41.764 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 819657 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/rxrpc/rxrpc.ko 2023-11-28T19:44:41.764 INFO:teuthology.orchestra.run.smithi179.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/ 2023-11-28T19:44:41.764 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 32241 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/act_csum.ko 2023-11-28T19:44:41.764 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 23577 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/act_gact.ko 2023-11-28T19:44:41.764 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 26873 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/act_ipt.ko 2023-11-28T19:44:41.764 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 34097 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/act_mirred.ko 2023-11-28T19:44:41.764 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 23401 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/act_nat.ko 2023-11-28T19:44:41.764 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 43449 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/act_pedit.ko 2023-11-28T19:44:41.764 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 31961 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/act_police.ko 2023-11-28T19:44:41.764 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 20289 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/act_simple.ko 2023-11-28T19:44:41.764 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 35297 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/act_skbedit.ko 2023-11-28T19:44:41.764 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 36665 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/act_vlan.ko 2023-11-28T19:44:41.764 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 26169 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/cls_basic.ko 2023-11-28T19:44:41.765 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 33961 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/cls_bpf.ko 2023-11-28T19:44:41.765 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 19169 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/cls_cgroup.ko 2023-11-28T19:44:41.765 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 31401 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/cls_flow.ko 2023-11-28T19:44:41.765 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 31769 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/cls_fw.ko 2023-11-28T19:44:41.765 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 38425 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/cls_route.ko 2023-11-28T19:44:41.765 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 61409 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/cls_u32.ko 2023-11-28T19:44:41.765 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 7441 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/em_cmp.ko 2023-11-28T19:44:41.765 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 13409 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/em_ipset.ko 2023-11-28T19:44:41.765 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 33289 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/em_meta.ko 2023-11-28T19:44:41.765 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 7897 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/em_nbyte.ko 2023-11-28T19:44:41.765 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 10625 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/em_text.ko 2023-11-28T19:44:41.765 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 7249 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/em_u32.ko 2023-11-28T19:44:41.765 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 21649 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_choke.ko 2023-11-28T19:44:41.766 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 20849 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_codel.ko 2023-11-28T19:44:41.766 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 34633 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_drr.ko 2023-11-28T19:44:41.766 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 33609 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_fq.ko 2023-11-28T19:44:41.766 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 31617 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_fq_codel.ko 2023-11-28T19:44:41.766 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 35433 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_gred.ko 2023-11-28T19:44:41.766 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 49817 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_hfsc.ko 2023-11-28T19:44:41.766 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 22089 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_hhf.ko 2023-11-28T19:44:41.766 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 66393 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_htb.ko 2023-11-28T19:44:41.766 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 26073 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_ingress.ko 2023-11-28T19:44:41.766 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 30273 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_mqprio.ko 2023-11-28T19:44:41.766 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 10793 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_mqprio_lib.ko 2023-11-28T19:44:41.766 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 26065 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_multiq.ko 2023-11-28T19:44:41.767 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 36137 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_netem.ko 2023-11-28T19:44:41.767 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 27497 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_pie.ko 2023-11-28T19:44:41.767 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 10625 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_plug.ko 2023-11-28T19:44:41.767 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 24729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_prio.ko 2023-11-28T19:44:41.767 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 48729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_qfq.ko 2023-11-28T19:44:41.767 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 32905 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_red.ko 2023-11-28T19:44:41.767 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 26881 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_sfb.ko 2023-11-28T19:44:41.767 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 31353 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_sfq.ko 2023-11-28T19:44:41.767 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 28897 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_tbf.ko 2023-11-28T19:44:41.767 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 28105 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_teql.ko 2023-11-28T19:44:41.767 INFO:teuthology.orchestra.run.smithi179.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sctp/ 2023-11-28T19:44:41.767 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 929745 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sctp/sctp.ko 2023-11-28T19:44:41.767 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 19033 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sctp/sctp_diag.ko 2023-11-28T19:44:41.768 INFO:teuthology.orchestra.run.smithi179.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sunrpc/ 2023-11-28T19:44:41.768 INFO:teuthology.orchestra.run.smithi179.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sunrpc/auth_gss/ 2023-11-28T19:44:41.768 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 336529 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2023-11-28T19:44:41.768 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 54737 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2023-11-28T19:44:41.768 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 1520097 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sunrpc/sunrpc.ko 2023-11-28T19:44:41.768 INFO:teuthology.orchestra.run.smithi179.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sunrpc/xprtrdma/ 2023-11-28T19:44:41.768 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 707657 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2023-11-28T19:44:41.768 INFO:teuthology.orchestra.run.smithi179.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/tipc/ 2023-11-28T19:44:41.768 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 10025 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/tipc/diag.ko 2023-11-28T19:44:41.768 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 862665 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/tipc/tipc.ko 2023-11-28T19:44:41.768 INFO:teuthology.orchestra.run.smithi179.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/unix/ 2023-11-28T19:44:41.768 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 15729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/unix/unix_diag.ko 2023-11-28T19:44:41.768 INFO:teuthology.orchestra.run.smithi179.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/vmw_vsock/ 2023-11-28T19:44:41.769 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 85409 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2023-11-28T19:44:41.769 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 68049 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2023-11-28T19:44:41.769 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 96193 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/vmw_vsock/vsock.ko 2023-11-28T19:44:41.769 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 10705 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/vmw_vsock/vsock_diag.ko 2023-11-28T19:44:41.769 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 17521 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/vmw_vsock/vsock_loopback.ko 2023-11-28T19:44:41.769 INFO:teuthology.orchestra.run.smithi179.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/x25/ 2023-11-28T19:44:41.769 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 125177 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/x25/x25.ko 2023-11-28T19:44:41.769 INFO:teuthology.orchestra.run.smithi179.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/xfrm/ 2023-11-28T19:44:41.769 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 22657 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/xfrm/xfrm_algo.ko 2023-11-28T19:44:41.769 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 20649 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/xfrm/xfrm_ipcomp.ko 2023-11-28T19:44:41.769 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 102257 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/xfrm/xfrm_user.ko 2023-11-28T19:44:41.769 INFO:teuthology.orchestra.run.smithi179.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/virt/ 2023-11-28T19:44:41.769 INFO:teuthology.orchestra.run.smithi179.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/virt/lib/ 2023-11-28T19:44:41.769 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 15537 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/virt/lib/irqbypass.ko 2023-11-28T19:44:41.770 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 640081 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/modules.alias 2023-11-28T19:44:41.770 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 624107 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/modules.alias.bin 2023-11-28T19:44:41.772 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 7663 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/modules.builtin 2023-11-28T19:44:41.772 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 23428 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/modules.builtin.alias.bin 2023-11-28T19:44:41.772 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 9821 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/modules.builtin.bin 2023-11-28T19:44:41.772 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 70004 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/modules.builtin.modinfo 2023-11-28T19:44:41.772 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 146313 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/modules.dep 2023-11-28T19:44:41.772 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 232548 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/modules.dep.bin 2023-11-28T19:44:41.772 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 210 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/modules.devname 2023-11-28T19:44:41.772 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 72606 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/modules.order 2023-11-28T19:44:41.772 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 879 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/modules.softdep 2023-11-28T19:44:41.772 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 254438 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/modules.symbols 2023-11-28T19:44:41.772 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 309363 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/modules.symbols.bin 2023-11-28T19:44:41.772 INFO:teuthology.orchestra.run.smithi179.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./usr/ 2023-11-28T19:44:41.773 INFO:teuthology.orchestra.run.smithi179.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./usr/share/ 2023-11-28T19:44:41.773 INFO:teuthology.orchestra.run.smithi179.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./usr/share/doc/ 2023-11-28T19:44:41.773 INFO:teuthology.orchestra.run.smithi179.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./usr/share/doc/linux-image-6.6.0-g8247bbb5b470/ 2023-11-28T19:44:41.773 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 172 2023-11-23 03:47 ./usr/share/doc/linux-image-6.6.0-g8247bbb5b470/changelog.Debian.gz 2023-11-28T19:44:41.773 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r-- root/root 691 2023-11-23 03:47 ./usr/share/doc/linux-image-6.6.0-g8247bbb5b470/copyright 2023-11-28T19:44:41.773 DEBUG:teuthology.task.kernel:get_image_version: 6.6.0-g8247bbb5b470 2023-11-28T19:44:41.774 INFO:teuthology.task.kernel:searching for kernel 6.6.0-g8247bbb5b470 2023-11-28T19:44:41.774 DEBUG:teuthology.orchestra.run.smithi179:> egrep '(submenu|menuentry.*6.6.0-g8247bbb5b470).*{' /boot/grub/grub.cfg 2023-11-28T19:44:41.780 INFO:teuthology.orchestra.run.smithi179.stdout:submenu 'Advanced options for Ubuntu' $menuentry_id_option 'gnulinux-advanced-7e9e2103-8bb7-4452-b35a-3b1230743254' { 2023-11-28T19:44:41.780 INFO:teuthology.orchestra.run.smithi179.stdout: menuentry 'Ubuntu, with Linux 6.6.0-g8247bbb5b470' --class ubuntu --class gnu-linux --class gnu --class os $menuentry_id_option 'gnulinux-6.6.0-g8247bbb5b470-advanced-7e9e2103-8bb7-4452-b35a-3b1230743254' { 2023-11-28T19:44:41.780 INFO:teuthology.orchestra.run.smithi179.stdout: menuentry 'Ubuntu, with Linux 6.6.0-g8247bbb5b470 (recovery mode)' --class ubuntu --class gnu-linux --class gnu --class os $menuentry_id_option 'gnulinux-6.6.0-g8247bbb5b470-recovery-7e9e2103-8bb7-4452-b35a-3b1230743254' { 2023-11-28T19:44:41.781 INFO:teuthology.task.kernel:submenu_title:Advanced options for Ubuntu> 2023-11-28T19:44:41.781 INFO:teuthology.task.kernel:default_title:Ubuntu, with Linux 6.6.0-g8247bbb5b470 2023-11-28T19:44:41.781 DEBUG:teuthology.orchestra.run.smithi179:> /bin/echo -e 'cat </dev/null && sudo chmod a+x -- '/etc/grub.d/01_ceph_kernel.tmp~' && sudo mv -- '/etc/grub.d/01_ceph_kernel.tmp~' /etc/grub.d/01_ceph_kernel && sudo update-grub && rm /tmp/linux-image.deb && ( sleep 1 && sudo shutdown -r now & ) 2023-11-28T19:44:41.823 DEBUG:teuthology.task.kernel:Waiting for install on ubuntu@smithi179.front.sepia.ceph.com to complete... 2023-11-28T19:44:42.226 INFO:teuthology.orchestra.run.smithi179.stderr:Sourcing file `/etc/default/grub' 2023-11-28T19:44:42.227 INFO:teuthology.orchestra.run.smithi179.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2023-11-28T19:44:42.245 INFO:teuthology.orchestra.run.smithi179.stderr:Generating grub configuration file ... 2023-11-28T19:44:42.470 INFO:teuthology.orchestra.run.smithi179.stderr:Found linux image: /boot/vmlinuz-6.6.0-g8247bbb5b470 2023-11-28T19:44:42.476 INFO:teuthology.orchestra.run.smithi179.stderr:Found initrd image: /boot/initrd.img-6.6.0-g8247bbb5b470 2023-11-28T19:44:42.732 INFO:teuthology.orchestra.run.smithi179.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2023-11-28T19:44:42.737 INFO:teuthology.orchestra.run.smithi179.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2023-11-28T19:44:42.776 INFO:teuthology.orchestra.run.smithi179.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2023-11-28T19:44:42.780 INFO:teuthology.orchestra.run.smithi179.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2023-11-28T19:44:42.949 INFO:teuthology.orchestra.run.smithi179.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2023-11-28T19:44:42.949 INFO:teuthology.orchestra.run.smithi179.stderr:Systems on them will not be added to the GRUB boot configuration. 2023-11-28T19:44:42.949 INFO:teuthology.orchestra.run.smithi179.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2023-11-28T19:44:42.970 INFO:teuthology.orchestra.run.smithi179.stderr:done 2023-11-28T19:45:03.990 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2023-11-28T19:45:03.990 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi078.front.sepia.ceph.com' 2023-11-28T19:45:03.991 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi078.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-28T19:45:14.093 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2023-11-28T19:45:14.093 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi179.front.sepia.ceph.com' 2023-11-28T19:45:14.094 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi179.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-28T19:45:22.530 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.78 2023-11-28T19:45:31.540 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi078.front.sepia.ceph.com' 2023-11-28T19:45:31.541 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi078.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-28T19:45:32.515 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.179 2023-11-28T19:45:34.594 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.78 2023-11-28T19:45:41.522 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi179.front.sepia.ceph.com' 2023-11-28T19:45:41.523 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi179.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-28T19:45:44.578 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.179 2023-11-28T19:45:46.597 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi078.front.sepia.ceph.com' 2023-11-28T19:45:46.597 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi078.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-28T19:45:56.586 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi179.front.sepia.ceph.com' 2023-11-28T19:45:56.587 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi179.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-28T19:46:15.015 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.179 2023-11-28T19:46:18.375 DEBUG:teuthology.orchestra.run.smithi078:> true 2023-11-28T19:46:19.129 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi078.front.sepia.ceph.com' 2023-11-28T19:46:19.129 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.6.0-g8247bbb5b470"... 2023-11-28T19:46:19.130 DEBUG:teuthology.orchestra.run.smithi078:> uname -r 2023-11-28T19:46:19.181 INFO:teuthology.orchestra.run.smithi078.stdout:6.6.0-g8247bbb5b470 2023-11-28T19:46:19.181 DEBUG:teuthology.task.kernel:current kernel version is 6.6.0-g8247bbb5b470 vs 6.6.0-g8247bbb5b470 2023-11-28T19:46:19.181 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2023-11-28T19:46:19.181 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2023-11-28T19:46:20.183 DEBUG:teuthology.parallel:result is None 2023-11-28T19:46:30.016 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi179.front.sepia.ceph.com' 2023-11-28T19:46:30.017 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi179.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-28T19:46:30.279 DEBUG:teuthology.orchestra.run.smithi179:> true 2023-11-28T19:46:30.962 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi179.front.sepia.ceph.com' 2023-11-28T19:46:30.962 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.6.0-g8247bbb5b470"... 2023-11-28T19:46:30.963 DEBUG:teuthology.orchestra.run.smithi179:> uname -r 2023-11-28T19:46:31.011 INFO:teuthology.orchestra.run.smithi179.stdout:6.6.0-g8247bbb5b470 2023-11-28T19:46:31.011 DEBUG:teuthology.task.kernel:current kernel version is 6.6.0-g8247bbb5b470 vs 6.6.0-g8247bbb5b470 2023-11-28T19:46:31.011 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2023-11-28T19:46:31.011 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2023-11-28T19:46:32.012 DEBUG:teuthology.parallel:result is None 2023-11-28T19:46:32.012 INFO:teuthology.run_tasks:Running task internal.base... 2023-11-28T19:46:32.021 INFO:teuthology.task.internal:Creating test directory... 2023-11-28T19:46:32.021 DEBUG:teuthology.orchestra.run.smithi078:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-11-28T19:46:32.025 DEBUG:teuthology.orchestra.run.smithi179:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-11-28T19:46:32.034 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2023-11-28T19:46:32.041 INFO:teuthology.run_tasks:Running task internal.archive... 2023-11-28T19:46:32.052 INFO:teuthology.task.internal:Creating archive directory... 2023-11-28T19:46:32.052 DEBUG:teuthology.orchestra.run.smithi078:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-11-28T19:46:32.080 DEBUG:teuthology.orchestra.run.smithi179:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-11-28T19:46:32.104 INFO:teuthology.run_tasks:Running task internal.coredump... 2023-11-28T19:46:32.110 INFO:teuthology.task.internal:Enabling coredump saving... 2023-11-28T19:46:32.111 DEBUG:teuthology.orchestra.run.smithi078:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-11-28T19:46:32.148 DEBUG:teuthology.orchestra.run.smithi179:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-11-28T19:46:32.239 INFO:teuthology.orchestra.run.smithi078.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-11-28T19:46:32.239 INFO:teuthology.orchestra.run.smithi179.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-11-28T19:46:32.257 INFO:teuthology.orchestra.run.smithi078.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-11-28T19:46:32.261 INFO:teuthology.orchestra.run.smithi179.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-11-28T19:46:32.263 INFO:teuthology.run_tasks:Running task internal.sudo... 2023-11-28T19:46:32.271 INFO:teuthology.task.internal:Configuring sudo... 2023-11-28T19:46:32.271 DEBUG:teuthology.orchestra.run.smithi078:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-11-28T19:46:32.275 DEBUG:teuthology.orchestra.run.smithi179:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-11-28T19:46:32.296 INFO:teuthology.run_tasks:Running task internal.syslog... 2023-11-28T19:46:32.305 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2023-11-28T19:46:32.305 DEBUG:teuthology.orchestra.run.smithi078:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-11-28T19:46:32.340 DEBUG:teuthology.orchestra.run.smithi179:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-11-28T19:46:32.349 DEBUG:teuthology.orchestra.run.smithi078:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-11-28T19:46:32.397 DEBUG:teuthology.orchestra.run.smithi078:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-11-28T19:46:32.453 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2023-11-28T19:46:32.454 DEBUG:teuthology.orchestra.run.smithi078:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-11-28T19:46:32.529 DEBUG:teuthology.orchestra.run.smithi179:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-11-28T19:46:32.539 DEBUG:teuthology.orchestra.run.smithi179:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-11-28T19:46:32.592 DEBUG:teuthology.orchestra.run.smithi179:> set -ex 2023-11-28T19:46:32.592 DEBUG:teuthology.orchestra.run.smithi179:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-11-28T19:46:32.666 DEBUG:teuthology.orchestra.run.smithi078:> sudo service rsyslog restart 2023-11-28T19:46:32.670 DEBUG:teuthology.orchestra.run.smithi179:> sudo service rsyslog restart 2023-11-28T19:46:32.797 INFO:teuthology.run_tasks:Running task internal.timer... 2023-11-28T19:46:32.804 INFO:teuthology.task.internal:Starting timer... 2023-11-28T19:46:32.805 INFO:teuthology.run_tasks:Running task pcp... 2023-11-28T19:46:32.833 INFO:teuthology.run_tasks:Running task selinux... 2023-11-28T19:46:32.847 DEBUG:teuthology.task.selinux:Excluding smithi078: OS 'ubuntu' does not support SELinux 2023-11-28T19:46:32.847 DEBUG:teuthology.task.selinux:Excluding smithi179: OS 'ubuntu' does not support SELinux 2023-11-28T19:46:32.847 DEBUG:teuthology.task.selinux:Getting current SELinux state 2023-11-28T19:46:32.847 DEBUG:teuthology.task.selinux:Existing SELinux modes: {} 2023-11-28T19:46:32.847 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2023-11-28T19:46:32.848 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2023-11-28T19:46:32.857 DEBUG:teuthology.repo_utils:Setting repo remote to https://git.ceph.com/ceph-cm-ansible.git 2023-11-28T19:46:32.862 INFO:teuthology.repo_utils:Fetching main from origin 2023-11-28T19:46:32.999 INFO:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2023-11-28T19:46:33.014 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2023-11-28T19:46:33.017 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi078.front.sepia.ceph.com,smithi179.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2023-11-28T19:55:12.467 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi078.front.sepia.ceph.com'), Remote(name='ubuntu@smithi179.front.sepia.ceph.com')] 2023-11-28T19:55:12.468 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi078.front.sepia.ceph.com' 2023-11-28T19:55:12.470 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi078.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-28T19:55:12.545 DEBUG:teuthology.orchestra.run.smithi078:> true 2023-11-28T19:55:12.681 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi078.front.sepia.ceph.com' 2023-11-28T19:55:12.681 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi179.front.sepia.ceph.com' 2023-11-28T19:55:12.682 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi179.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-28T19:55:12.765 DEBUG:teuthology.orchestra.run.smithi179:> true 2023-11-28T19:55:12.897 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi179.front.sepia.ceph.com' 2023-11-28T19:55:12.897 INFO:teuthology.run_tasks:Running task clock... 2023-11-28T19:55:12.909 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2023-11-28T19:55:12.910 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-11-28T19:55:12.910 DEBUG:teuthology.orchestra.run.smithi078:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-11-28T19:55:12.913 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-11-28T19:55:12.914 DEBUG:teuthology.orchestra.run.smithi179:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-11-28T19:55:12.950 INFO:teuthology.orchestra.run.smithi078.stdout:28 Nov 19:55:12 ntpd[27988]: ntpd 4.2.8p15@1.3728-o Wed Feb 16 17:13:02 UTC 2022 (1): Starting 2023-11-28T19:55:12.951 INFO:teuthology.orchestra.run.smithi078.stdout:28 Nov 19:55:12 ntpd[27988]: Command line: ntpd -gq 2023-11-28T19:55:12.951 INFO:teuthology.orchestra.run.smithi078.stdout:28 Nov 19:55:12 ntpd[27988]: ---------------------------------------------------- 2023-11-28T19:55:12.952 INFO:teuthology.orchestra.run.smithi078.stdout:28 Nov 19:55:12 ntpd[27988]: ntp-4 is maintained by Network Time Foundation, 2023-11-28T19:55:12.952 INFO:teuthology.orchestra.run.smithi078.stdout:28 Nov 19:55:12 ntpd[27988]: Inc. (NTF), a non-profit 501(c)(3) public-benefit 2023-11-28T19:55:12.952 INFO:teuthology.orchestra.run.smithi078.stdout:28 Nov 19:55:12 ntpd[27988]: corporation. Support and training for ntp-4 are 2023-11-28T19:55:12.952 INFO:teuthology.orchestra.run.smithi078.stdout:28 Nov 19:55:12 ntpd[27988]: available at https://www.nwtime.org/support 2023-11-28T19:55:12.952 INFO:teuthology.orchestra.run.smithi078.stdout:28 Nov 19:55:12 ntpd[27988]: ---------------------------------------------------- 2023-11-28T19:55:12.953 INFO:teuthology.orchestra.run.smithi078.stdout:28 Nov 19:55:12 ntpd[27988]: proto: precision = 0.044 usec (-24) 2023-11-28T19:55:12.953 INFO:teuthology.orchestra.run.smithi078.stdout:28 Nov 19:55:12 ntpd[27988]: basedate set to 2022-02-04 2023-11-28T19:55:12.953 INFO:teuthology.orchestra.run.smithi078.stdout:28 Nov 19:55:12 ntpd[27988]: gps base set to 2022-02-06 (week 2196) 2023-11-28T19:55:12.953 INFO:teuthology.orchestra.run.smithi078.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2023-11-28T19:55:12.954 INFO:teuthology.orchestra.run.smithi078.stdout:28 Nov 19:55:12 ntpd[27988]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2023-11-28T19:55:12.954 INFO:teuthology.orchestra.run.smithi078.stdout:28 Nov 19:55:12 ntpd[27988]: restrict ::: KOD does nothing without LIMITED. 2023-11-28T19:55:12.954 INFO:teuthology.orchestra.run.smithi078.stderr:restrict ::: KOD does nothing without LIMITED. 2023-11-28T19:55:12.955 INFO:teuthology.orchestra.run.smithi078.stdout:28 Nov 19:55:12 ntpd[27988]: Listen and drop on 0 v6wildcard [::]:123 2023-11-28T19:55:12.955 INFO:teuthology.orchestra.run.smithi078.stdout:28 Nov 19:55:12 ntpd[27988]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2023-11-28T19:55:12.955 INFO:teuthology.orchestra.run.smithi078.stdout:28 Nov 19:55:12 ntpd[27988]: Listen normally on 2 lo 127.0.0.1:123 2023-11-28T19:55:12.955 INFO:teuthology.orchestra.run.smithi078.stdout:28 Nov 19:55:12 ntpd[27988]: Listen normally on 3 enp3s0f1 172.21.15.78:123 2023-11-28T19:55:12.955 INFO:teuthology.orchestra.run.smithi078.stdout:28 Nov 19:55:12 ntpd[27988]: Listen normally on 4 lo [::1]:123 2023-11-28T19:55:12.955 INFO:teuthology.orchestra.run.smithi078.stdout:28 Nov 19:55:12 ntpd[27988]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:fe8f:d4dd%5]:123 2023-11-28T19:55:12.956 INFO:teuthology.orchestra.run.smithi078.stdout:28 Nov 19:55:12 ntpd[27988]: Listening on routing socket on fd #22 for interface updates 2023-11-28T19:55:12.979 INFO:teuthology.orchestra.run.smithi179.stdout:28 Nov 19:55:12 ntpd[27975]: ntpd 4.2.8p15@1.3728-o Wed Feb 16 17:13:02 UTC 2022 (1): Starting 2023-11-28T19:55:12.979 INFO:teuthology.orchestra.run.smithi179.stdout:28 Nov 19:55:12 ntpd[27975]: Command line: ntpd -gq 2023-11-28T19:55:12.979 INFO:teuthology.orchestra.run.smithi179.stdout:28 Nov 19:55:12 ntpd[27975]: ---------------------------------------------------- 2023-11-28T19:55:12.979 INFO:teuthology.orchestra.run.smithi179.stdout:28 Nov 19:55:12 ntpd[27975]: ntp-4 is maintained by Network Time Foundation, 2023-11-28T19:55:12.979 INFO:teuthology.orchestra.run.smithi179.stdout:28 Nov 19:55:12 ntpd[27975]: Inc. (NTF), a non-profit 501(c)(3) public-benefit 2023-11-28T19:55:12.979 INFO:teuthology.orchestra.run.smithi179.stdout:28 Nov 19:55:12 ntpd[27975]: corporation. Support and training for ntp-4 are 2023-11-28T19:55:12.979 INFO:teuthology.orchestra.run.smithi179.stdout:28 Nov 19:55:12 ntpd[27975]: available at https://www.nwtime.org/support 2023-11-28T19:55:12.979 INFO:teuthology.orchestra.run.smithi179.stdout:28 Nov 19:55:12 ntpd[27975]: ---------------------------------------------------- 2023-11-28T19:55:12.980 INFO:teuthology.orchestra.run.smithi179.stdout:28 Nov 19:55:12 ntpd[27975]: proto: precision = 0.041 usec (-24) 2023-11-28T19:55:12.980 INFO:teuthology.orchestra.run.smithi179.stdout:28 Nov 19:55:12 ntpd[27975]: basedate set to 2022-02-04 2023-11-28T19:55:12.980 INFO:teuthology.orchestra.run.smithi179.stdout:28 Nov 19:55:12 ntpd[27975]: gps base set to 2022-02-06 (week 2196) 2023-11-28T19:55:12.981 INFO:teuthology.orchestra.run.smithi179.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2023-11-28T19:55:12.981 INFO:teuthology.orchestra.run.smithi179.stdout:28 Nov 19:55:12 ntpd[27975]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2023-11-28T19:55:12.981 INFO:teuthology.orchestra.run.smithi179.stdout:28 Nov 19:55:12 ntpd[27975]: restrict ::: KOD does nothing without LIMITED. 2023-11-28T19:55:12.981 INFO:teuthology.orchestra.run.smithi179.stderr:restrict ::: KOD does nothing without LIMITED. 2023-11-28T19:55:12.982 INFO:teuthology.orchestra.run.smithi179.stdout:28 Nov 19:55:12 ntpd[27975]: Listen and drop on 0 v6wildcard [::]:123 2023-11-28T19:55:12.983 INFO:teuthology.orchestra.run.smithi179.stdout:28 Nov 19:55:12 ntpd[27975]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2023-11-28T19:55:12.983 INFO:teuthology.orchestra.run.smithi179.stdout:28 Nov 19:55:12 ntpd[27975]: Listen normally on 2 lo 127.0.0.1:123 2023-11-28T19:55:12.983 INFO:teuthology.orchestra.run.smithi179.stdout:28 Nov 19:55:12 ntpd[27975]: Listen normally on 3 enp3s0f1 172.21.15.179:123 2023-11-28T19:55:12.983 INFO:teuthology.orchestra.run.smithi179.stdout:28 Nov 19:55:12 ntpd[27975]: Listen normally on 4 lo [::1]:123 2023-11-28T19:55:12.983 INFO:teuthology.orchestra.run.smithi179.stdout:28 Nov 19:55:12 ntpd[27975]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:fe88:725b%5]:123 2023-11-28T19:55:12.983 INFO:teuthology.orchestra.run.smithi179.stdout:28 Nov 19:55:12 ntpd[27975]: Listening on routing socket on fd #22 for interface updates 2023-11-28T19:55:13.951 INFO:teuthology.orchestra.run.smithi078.stderr:28 Nov 19:55:13 ntpd[27988]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-28T19:55:13.951 INFO:teuthology.orchestra.run.smithi078.stderr:28 Nov 19:55:13 ntpd[27988]: can't open /var/log/ntpstats/rawstats.20231128: Permission denied 2023-11-28T19:55:13.951 INFO:teuthology.orchestra.run.smithi078.stderr:28 Nov 19:55:13 ntpd[27988]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-28T19:55:13.951 INFO:teuthology.orchestra.run.smithi078.stderr:28 Nov 19:55:13 ntpd[27988]: can't open /var/log/ntpstats/rawstats.20231128: Permission denied 2023-11-28T19:55:13.951 INFO:teuthology.orchestra.run.smithi078.stderr:28 Nov 19:55:13 ntpd[27988]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-11-28T19:55:13.951 INFO:teuthology.orchestra.run.smithi078.stderr:28 Nov 19:55:13 ntpd[27988]: can't open /var/log/ntpstats/peerstats.20231128: Permission denied 2023-11-28T19:55:13.980 INFO:teuthology.orchestra.run.smithi179.stderr:28 Nov 19:55:13 ntpd[27975]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-28T19:55:13.980 INFO:teuthology.orchestra.run.smithi179.stderr:28 Nov 19:55:13 ntpd[27975]: can't open /var/log/ntpstats/rawstats.20231128: Permission denied 2023-11-28T19:55:13.980 INFO:teuthology.orchestra.run.smithi179.stderr:28 Nov 19:55:13 ntpd[27975]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-28T19:55:13.980 INFO:teuthology.orchestra.run.smithi179.stderr:28 Nov 19:55:13 ntpd[27975]: can't open /var/log/ntpstats/rawstats.20231128: Permission denied 2023-11-28T19:55:13.981 INFO:teuthology.orchestra.run.smithi179.stderr:28 Nov 19:55:13 ntpd[27975]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-28T19:55:13.981 INFO:teuthology.orchestra.run.smithi179.stderr:28 Nov 19:55:13 ntpd[27975]: can't open /var/log/ntpstats/rawstats.20231128: Permission denied 2023-11-28T19:55:13.981 INFO:teuthology.orchestra.run.smithi179.stderr:28 Nov 19:55:13 ntpd[27975]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-11-28T19:55:13.981 INFO:teuthology.orchestra.run.smithi179.stderr:28 Nov 19:55:13 ntpd[27975]: can't open /var/log/ntpstats/peerstats.20231128: Permission denied 2023-11-28T19:55:15.951 INFO:teuthology.orchestra.run.smithi078.stderr:28 Nov 19:55:15 ntpd[27988]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-28T19:55:15.951 INFO:teuthology.orchestra.run.smithi078.stderr:28 Nov 19:55:15 ntpd[27988]: can't open /var/log/ntpstats/rawstats.20231128: Permission denied 2023-11-28T19:55:15.951 INFO:teuthology.orchestra.run.smithi078.stderr:28 Nov 19:55:15 ntpd[27988]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-28T19:55:15.951 INFO:teuthology.orchestra.run.smithi078.stderr:28 Nov 19:55:15 ntpd[27988]: can't open /var/log/ntpstats/rawstats.20231128: Permission denied 2023-11-28T19:55:15.951 INFO:teuthology.orchestra.run.smithi078.stderr:28 Nov 19:55:15 ntpd[27988]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-28T19:55:15.951 INFO:teuthology.orchestra.run.smithi078.stderr:28 Nov 19:55:15 ntpd[27988]: can't open /var/log/ntpstats/rawstats.20231128: Permission denied 2023-11-28T19:55:15.951 INFO:teuthology.orchestra.run.smithi078.stderr:28 Nov 19:55:15 ntpd[27988]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-11-28T19:55:15.951 INFO:teuthology.orchestra.run.smithi078.stderr:28 Nov 19:55:15 ntpd[27988]: can't open /var/log/ntpstats/peerstats.20231128: Permission denied 2023-11-28T19:55:15.980 INFO:teuthology.orchestra.run.smithi179.stderr:28 Nov 19:55:15 ntpd[27975]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-28T19:55:15.980 INFO:teuthology.orchestra.run.smithi179.stderr:28 Nov 19:55:15 ntpd[27975]: can't open /var/log/ntpstats/rawstats.20231128: Permission denied 2023-11-28T19:55:15.980 INFO:teuthology.orchestra.run.smithi179.stderr:28 Nov 19:55:15 ntpd[27975]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-28T19:55:15.981 INFO:teuthology.orchestra.run.smithi179.stderr:28 Nov 19:55:15 ntpd[27975]: can't open /var/log/ntpstats/rawstats.20231128: Permission denied 2023-11-28T19:55:15.981 INFO:teuthology.orchestra.run.smithi179.stderr:28 Nov 19:55:15 ntpd[27975]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-28T19:55:15.981 INFO:teuthology.orchestra.run.smithi179.stderr:28 Nov 19:55:15 ntpd[27975]: can't open /var/log/ntpstats/rawstats.20231128: Permission denied 2023-11-28T19:55:15.981 INFO:teuthology.orchestra.run.smithi179.stderr:28 Nov 19:55:15 ntpd[27975]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-11-28T19:55:15.981 INFO:teuthology.orchestra.run.smithi179.stderr:28 Nov 19:55:15 ntpd[27975]: can't open /var/log/ntpstats/peerstats.20231128: Permission denied 2023-11-28T19:55:15.981 INFO:teuthology.orchestra.run.smithi179.stderr:28 Nov 19:55:15 ntpd[27975]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-28T19:55:15.981 INFO:teuthology.orchestra.run.smithi179.stderr:28 Nov 19:55:15 ntpd[27975]: can't open /var/log/ntpstats/rawstats.20231128: Permission denied 2023-11-28T19:55:15.981 INFO:teuthology.orchestra.run.smithi179.stderr:28 Nov 19:55:15 ntpd[27975]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-11-28T19:55:15.981 INFO:teuthology.orchestra.run.smithi179.stderr:28 Nov 19:55:15 ntpd[27975]: can't open /var/log/ntpstats/peerstats.20231128: Permission denied 2023-11-28T19:55:16.980 INFO:teuthology.orchestra.run.smithi179.stderr:28 Nov 19:55:16 ntpd[27975]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-28T19:55:16.980 INFO:teuthology.orchestra.run.smithi179.stderr:28 Nov 19:55:16 ntpd[27975]: can't open /var/log/ntpstats/rawstats.20231128: Permission denied 2023-11-28T19:55:16.980 INFO:teuthology.orchestra.run.smithi179.stderr:28 Nov 19:55:16 ntpd[27975]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-28T19:55:16.980 INFO:teuthology.orchestra.run.smithi179.stderr:28 Nov 19:55:16 ntpd[27975]: can't open /var/log/ntpstats/rawstats.20231128: Permission denied 2023-11-28T19:55:16.980 INFO:teuthology.orchestra.run.smithi179.stderr:28 Nov 19:55:16 ntpd[27975]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-11-28T19:55:16.980 INFO:teuthology.orchestra.run.smithi179.stderr:28 Nov 19:55:16 ntpd[27975]: can't open /var/log/ntpstats/peerstats.20231128: Permission denied 2023-11-28T19:55:17.952 INFO:teuthology.orchestra.run.smithi078.stderr:28 Nov 19:55:17 ntpd[27988]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-28T19:55:17.952 INFO:teuthology.orchestra.run.smithi078.stderr:28 Nov 19:55:17 ntpd[27988]: can't open /var/log/ntpstats/rawstats.20231128: Permission denied 2023-11-28T19:55:17.952 INFO:teuthology.orchestra.run.smithi078.stderr:28 Nov 19:55:17 ntpd[27988]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-28T19:55:17.953 INFO:teuthology.orchestra.run.smithi078.stderr:28 Nov 19:55:17 ntpd[27988]: can't open /var/log/ntpstats/rawstats.20231128: Permission denied 2023-11-28T19:55:17.953 INFO:teuthology.orchestra.run.smithi078.stderr:28 Nov 19:55:17 ntpd[27988]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-28T19:55:17.953 INFO:teuthology.orchestra.run.smithi078.stderr:28 Nov 19:55:17 ntpd[27988]: can't open /var/log/ntpstats/rawstats.20231128: Permission denied 2023-11-28T19:55:17.953 INFO:teuthology.orchestra.run.smithi078.stderr:28 Nov 19:55:17 ntpd[27988]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-28T19:55:17.953 INFO:teuthology.orchestra.run.smithi078.stderr:28 Nov 19:55:17 ntpd[27988]: can't open /var/log/ntpstats/rawstats.20231128: Permission denied 2023-11-28T19:55:17.953 INFO:teuthology.orchestra.run.smithi078.stderr:28 Nov 19:55:17 ntpd[27988]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-11-28T19:55:17.953 INFO:teuthology.orchestra.run.smithi078.stderr:28 Nov 19:55:17 ntpd[27988]: can't open /var/log/ntpstats/peerstats.20231128: Permission denied 2023-11-28T19:55:17.954 INFO:teuthology.orchestra.run.smithi078.stderr:28 Nov 19:55:17 ntpd[27988]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-28T19:55:17.954 INFO:teuthology.orchestra.run.smithi078.stderr:28 Nov 19:55:17 ntpd[27988]: can't open /var/log/ntpstats/rawstats.20231128: Permission denied 2023-11-28T19:55:17.954 INFO:teuthology.orchestra.run.smithi078.stderr:28 Nov 19:55:17 ntpd[27988]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-11-28T19:55:17.954 INFO:teuthology.orchestra.run.smithi078.stderr:28 Nov 19:55:17 ntpd[27988]: can't open /var/log/ntpstats/peerstats.20231128: Permission denied 2023-11-28T19:55:17.954 INFO:teuthology.orchestra.run.smithi078.stderr:28 Nov 19:55:17 ntpd[27988]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-28T19:55:17.954 INFO:teuthology.orchestra.run.smithi078.stderr:28 Nov 19:55:17 ntpd[27988]: can't open /var/log/ntpstats/rawstats.20231128: Permission denied 2023-11-28T19:55:17.954 INFO:teuthology.orchestra.run.smithi078.stderr:28 Nov 19:55:17 ntpd[27988]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-11-28T19:55:17.954 INFO:teuthology.orchestra.run.smithi078.stderr:28 Nov 19:55:17 ntpd[27988]: can't open /var/log/ntpstats/peerstats.20231128: Permission denied 2023-11-28T19:55:17.980 INFO:teuthology.orchestra.run.smithi179.stderr:28 Nov 19:55:17 ntpd[27975]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-28T19:55:17.980 INFO:teuthology.orchestra.run.smithi179.stderr:28 Nov 19:55:17 ntpd[27975]: can't open /var/log/ntpstats/rawstats.20231128: Permission denied 2023-11-28T19:55:17.980 INFO:teuthology.orchestra.run.smithi179.stderr:28 Nov 19:55:17 ntpd[27975]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-28T19:55:17.980 INFO:teuthology.orchestra.run.smithi179.stderr:28 Nov 19:55:17 ntpd[27975]: can't open /var/log/ntpstats/rawstats.20231128: Permission denied 2023-11-28T19:55:17.980 INFO:teuthology.orchestra.run.smithi179.stderr:28 Nov 19:55:17 ntpd[27975]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-28T19:55:17.980 INFO:teuthology.orchestra.run.smithi179.stderr:28 Nov 19:55:17 ntpd[27975]: can't open /var/log/ntpstats/rawstats.20231128: Permission denied 2023-11-28T19:55:17.981 INFO:teuthology.orchestra.run.smithi179.stderr:28 Nov 19:55:17 ntpd[27975]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-11-28T19:55:17.981 INFO:teuthology.orchestra.run.smithi179.stderr:28 Nov 19:55:17 ntpd[27975]: can't open /var/log/ntpstats/peerstats.20231128: Permission denied 2023-11-28T19:55:17.981 INFO:teuthology.orchestra.run.smithi179.stderr:28 Nov 19:55:17 ntpd[27975]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-28T19:55:17.981 INFO:teuthology.orchestra.run.smithi179.stderr:28 Nov 19:55:17 ntpd[27975]: can't open /var/log/ntpstats/rawstats.20231128: Permission denied 2023-11-28T19:55:17.981 INFO:teuthology.orchestra.run.smithi179.stderr:28 Nov 19:55:17 ntpd[27975]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-11-28T19:55:17.981 INFO:teuthology.orchestra.run.smithi179.stderr:28 Nov 19:55:17 ntpd[27975]: can't open /var/log/ntpstats/peerstats.20231128: Permission denied 2023-11-28T19:55:18.979 INFO:teuthology.orchestra.run.smithi179.stderr:28 Nov 19:55:18 ntpd[27975]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-28T19:55:18.980 INFO:teuthology.orchestra.run.smithi179.stderr:28 Nov 19:55:18 ntpd[27975]: can't open /var/log/ntpstats/rawstats.20231128: Permission denied 2023-11-28T19:55:18.980 INFO:teuthology.orchestra.run.smithi179.stderr:28 Nov 19:55:18 ntpd[27975]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-28T19:55:18.980 INFO:teuthology.orchestra.run.smithi179.stderr:28 Nov 19:55:18 ntpd[27975]: can't open /var/log/ntpstats/rawstats.20231128: Permission denied 2023-11-28T19:55:18.980 INFO:teuthology.orchestra.run.smithi179.stderr:28 Nov 19:55:18 ntpd[27975]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-11-28T19:55:18.980 INFO:teuthology.orchestra.run.smithi179.stderr:28 Nov 19:55:18 ntpd[27975]: can't open /var/log/ntpstats/peerstats.20231128: Permission denied 2023-11-28T19:55:19.951 INFO:teuthology.orchestra.run.smithi078.stderr:28 Nov 19:55:19 ntpd[27988]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-28T19:55:19.951 INFO:teuthology.orchestra.run.smithi078.stderr:28 Nov 19:55:19 ntpd[27988]: can't open /var/log/ntpstats/rawstats.20231128: Permission denied 2023-11-28T19:55:19.951 INFO:teuthology.orchestra.run.smithi078.stderr:28 Nov 19:55:19 ntpd[27988]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-28T19:55:19.951 INFO:teuthology.orchestra.run.smithi078.stderr:28 Nov 19:55:19 ntpd[27988]: can't open /var/log/ntpstats/rawstats.20231128: Permission denied 2023-11-28T19:55:19.951 INFO:teuthology.orchestra.run.smithi078.stderr:28 Nov 19:55:19 ntpd[27988]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-28T19:55:19.951 INFO:teuthology.orchestra.run.smithi078.stderr:28 Nov 19:55:19 ntpd[27988]: can't open /var/log/ntpstats/rawstats.20231128: Permission denied 2023-11-28T19:55:19.952 INFO:teuthology.orchestra.run.smithi078.stderr:28 Nov 19:55:19 ntpd[27988]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-28T19:55:19.952 INFO:teuthology.orchestra.run.smithi078.stderr:28 Nov 19:55:19 ntpd[27988]: can't open /var/log/ntpstats/rawstats.20231128: Permission denied 2023-11-28T19:55:19.952 INFO:teuthology.orchestra.run.smithi078.stderr:28 Nov 19:55:19 ntpd[27988]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-11-28T19:55:19.952 INFO:teuthology.orchestra.run.smithi078.stderr:28 Nov 19:55:19 ntpd[27988]: can't open /var/log/ntpstats/peerstats.20231128: Permission denied 2023-11-28T19:55:19.952 INFO:teuthology.orchestra.run.smithi078.stderr:28 Nov 19:55:19 ntpd[27988]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-28T19:55:19.952 INFO:teuthology.orchestra.run.smithi078.stderr:28 Nov 19:55:19 ntpd[27988]: can't open /var/log/ntpstats/rawstats.20231128: Permission denied 2023-11-28T19:55:19.952 INFO:teuthology.orchestra.run.smithi078.stderr:28 Nov 19:55:19 ntpd[27988]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-11-28T19:55:19.952 INFO:teuthology.orchestra.run.smithi078.stderr:28 Nov 19:55:19 ntpd[27988]: can't open /var/log/ntpstats/peerstats.20231128: Permission denied 2023-11-28T19:55:19.952 INFO:teuthology.orchestra.run.smithi078.stdout:28 Nov 19:55:19 ntpd[27988]: ntpd: time slew +0.000076 s 2023-11-28T19:55:19.953 INFO:teuthology.orchestra.run.smithi078.stdout:ntpd: time slew +0.000076s 2023-11-28T19:55:19.953 INFO:teuthology.orchestra.run.smithi078.stderr:28 Nov 19:55:19 ntpd[27988]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2023-11-28T19:55:19.953 INFO:teuthology.orchestra.run.smithi078.stderr:28 Nov 19:55:19 ntpd[27988]: can't open /var/log/ntpstats/loopstats.20231128: Permission denied 2023-11-28T19:55:19.979 INFO:teuthology.orchestra.run.smithi179.stderr:28 Nov 19:55:19 ntpd[27975]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-28T19:55:19.980 INFO:teuthology.orchestra.run.smithi179.stderr:28 Nov 19:55:19 ntpd[27975]: can't open /var/log/ntpstats/rawstats.20231128: Permission denied 2023-11-28T19:55:19.980 INFO:teuthology.orchestra.run.smithi179.stderr:28 Nov 19:55:19 ntpd[27975]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-28T19:55:19.980 INFO:teuthology.orchestra.run.smithi179.stderr:28 Nov 19:55:19 ntpd[27975]: can't open /var/log/ntpstats/rawstats.20231128: Permission denied 2023-11-28T19:55:19.980 INFO:teuthology.orchestra.run.smithi179.stderr:28 Nov 19:55:19 ntpd[27975]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-28T19:55:19.980 INFO:teuthology.orchestra.run.smithi179.stderr:28 Nov 19:55:19 ntpd[27975]: can't open /var/log/ntpstats/rawstats.20231128: Permission denied 2023-11-28T19:55:19.980 INFO:teuthology.orchestra.run.smithi179.stderr:28 Nov 19:55:19 ntpd[27975]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-11-28T19:55:19.980 INFO:teuthology.orchestra.run.smithi179.stderr:28 Nov 19:55:19 ntpd[27975]: can't open /var/log/ntpstats/peerstats.20231128: Permission denied 2023-11-28T19:55:19.980 INFO:teuthology.orchestra.run.smithi179.stdout:28 Nov 19:55:19 ntpd[27975]: ntpd: time slew -0.000161 s 2023-11-28T19:55:19.981 INFO:teuthology.orchestra.run.smithi179.stdout:ntpd: time slew -0.000161s 2023-11-28T19:55:19.981 INFO:teuthology.orchestra.run.smithi179.stderr:28 Nov 19:55:19 ntpd[27975]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2023-11-28T19:55:19.981 INFO:teuthology.orchestra.run.smithi179.stderr:28 Nov 19:55:19 ntpd[27975]: can't open /var/log/ntpstats/loopstats.20231128: Permission denied 2023-11-28T19:55:20.042 INFO:teuthology.orchestra.run.smithi078.stdout: remote refid st t when poll reach delay offset jitter 2023-11-28T19:55:20.042 INFO:teuthology.orchestra.run.smithi078.stdout:============================================================================== 2023-11-28T19:55:20.042 INFO:teuthology.orchestra.run.smithi078.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2023-11-28T19:55:20.043 INFO:teuthology.orchestra.run.smithi078.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2023-11-28T19:55:20.043 INFO:teuthology.orchestra.run.smithi078.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2023-11-28T19:55:20.043 INFO:teuthology.orchestra.run.smithi078.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2023-11-28T19:55:20.116 INFO:teuthology.orchestra.run.smithi179.stdout: remote refid st t when poll reach delay offset jitter 2023-11-28T19:55:20.117 INFO:teuthology.orchestra.run.smithi179.stdout:============================================================================== 2023-11-28T19:55:20.117 INFO:teuthology.orchestra.run.smithi179.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2023-11-28T19:55:20.117 INFO:teuthology.orchestra.run.smithi179.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2023-11-28T19:55:20.117 INFO:teuthology.orchestra.run.smithi179.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2023-11-28T19:55:20.117 INFO:teuthology.orchestra.run.smithi179.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2023-11-28T19:55:20.119 INFO:teuthology.run_tasks:Running task install... 2023-11-28T19:55:20.128 DEBUG:teuthology.task.install:project ceph 2023-11-28T19:55:20.128 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '43dd94c190073cf16cff1e711dd7f5a7b1cbc883'}} 2023-11-28T19:55:20.128 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '43dd94c190073cf16cff1e711dd7f5a7b1cbc883'} 2023-11-28T19:55:20.128 INFO:teuthology.task.install:Using flavor: default 2023-11-28T19:55:20.134 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2023-11-28T19:55:20.135 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']} 2023-11-28T19:55:20.135 DEBUG:teuthology.orchestra.run.smithi078:> sudo apt-key list | grep Ceph 2023-11-28T19:55:20.136 DEBUG:teuthology.orchestra.run.smithi179:> sudo apt-key list | grep Ceph 2023-11-28T19:55:20.242 INFO:teuthology.orchestra.run.smithi078.stderr:Warning: apt-key is deprecated. Manage keyring files in trusted.gpg.d instead (see apt-key(8)). 2023-11-28T19:55:20.267 INFO:teuthology.orchestra.run.smithi179.stderr:Warning: apt-key is deprecated. Manage keyring files in trusted.gpg.d instead (see apt-key(8)). 2023-11-28T19:55:20.295 INFO:teuthology.orchestra.run.smithi078.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2023-11-28T19:55:20.296 INFO:teuthology.orchestra.run.smithi078.stdout:uid [ unknown] Ceph.com (release key) 2023-11-28T19:55:20.297 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror on remote deb x86_64 2023-11-28T19:55:20.297 INFO:teuthology.task.install.deb:Installing system (non-project) packages: bison, flex, libelf-dev, libssl-dev, network-manager, iproute2, util-linux, dump, indent, libaio-dev, libtool-bin, uuid-dev, xfslibs-dev, postgresql, postgresql-client, postgresql-common, postgresql-contrib on remote deb x86_64 2023-11-28T19:55:20.297 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=43dd94c190073cf16cff1e711dd7f5a7b1cbc883 2023-11-28T19:55:20.320 INFO:teuthology.orchestra.run.smithi179.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2023-11-28T19:55:20.320 INFO:teuthology.orchestra.run.smithi179.stdout:uid [ unknown] Ceph.com (release key) 2023-11-28T19:55:20.321 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror on remote deb x86_64 2023-11-28T19:55:20.321 INFO:teuthology.task.install.deb:Installing system (non-project) packages: bison, flex, libelf-dev, libssl-dev, network-manager, iproute2, util-linux, dump, indent, libaio-dev, libtool-bin, uuid-dev, xfslibs-dev, postgresql, postgresql-client, postgresql-common, postgresql-contrib on remote deb x86_64 2023-11-28T19:55:20.322 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=43dd94c190073cf16cff1e711dd7f5a7b1cbc883 2023-11-28T19:55:20.462 INFO:teuthology.task.install.deb:Pulling from https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102914/43dd94c190073cf16cff1e711dd7f5a7b1cbc883/ubuntu/jammy/flavors/default/ 2023-11-28T19:55:20.462 INFO:teuthology.task.install.deb:Package version is 18.0.0-7520-g43dd94c1-1jammy 2023-11-28T19:55:20.512 INFO:teuthology.task.install.deb:Pulling from https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102914/43dd94c190073cf16cff1e711dd7f5a7b1cbc883/ubuntu/jammy/flavors/default/ 2023-11-28T19:55:20.512 INFO:teuthology.task.install.deb:Package version is 18.0.0-7520-g43dd94c1-1jammy 2023-11-28T19:55:20.632 DEBUG:teuthology.orchestra.run.smithi179:> set -ex 2023-11-28T19:55:20.632 DEBUG:teuthology.orchestra.run.smithi179:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2023-11-28T19:55:20.653 DEBUG:teuthology.orchestra.run.smithi179:> sudo apt-get update 2023-11-28T19:55:20.684 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2023-11-28T19:55:20.685 DEBUG:teuthology.orchestra.run.smithi078:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2023-11-28T19:55:20.705 DEBUG:teuthology.orchestra.run.smithi078:> sudo apt-get update 2023-11-28T19:55:20.926 INFO:teuthology.orchestra.run.smithi179.stdout:Hit:1 http://security.ubuntu.com/ubuntu jammy-security InRelease 2023-11-28T19:55:20.928 INFO:teuthology.orchestra.run.smithi078.stdout:Hit:1 http://security.ubuntu.com/ubuntu jammy-security InRelease 2023-11-28T19:55:20.953 INFO:teuthology.orchestra.run.smithi179.stdout:Ign:2 https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102914/43dd94c190073cf16cff1e711dd7f5a7b1cbc883/ubuntu/jammy/flavors/default jammy InRelease 2023-11-28T19:55:20.961 INFO:teuthology.orchestra.run.smithi179.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy InRelease 2023-11-28T19:55:20.990 INFO:teuthology.orchestra.run.smithi179.stdout:Get:4 https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102914/43dd94c190073cf16cff1e711dd7f5a7b1cbc883/ubuntu/jammy/flavors/default jammy Release [6,978 B] 2023-11-28T19:55:20.998 INFO:teuthology.orchestra.run.smithi078.stdout:Ign:2 https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102914/43dd94c190073cf16cff1e711dd7f5a7b1cbc883/ubuntu/jammy/flavors/default jammy InRelease 2023-11-28T19:55:21.006 INFO:teuthology.orchestra.run.smithi078.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy InRelease 2023-11-28T19:55:21.027 INFO:teuthology.orchestra.run.smithi179.stdout:Ign:5 https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102914/43dd94c190073cf16cff1e711dd7f5a7b1cbc883/ubuntu/jammy/flavors/default jammy Release.gpg 2023-11-28T19:55:21.035 INFO:teuthology.orchestra.run.smithi078.stdout:Get:4 https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102914/43dd94c190073cf16cff1e711dd7f5a7b1cbc883/ubuntu/jammy/flavors/default jammy Release [6,978 B] 2023-11-28T19:55:21.043 INFO:teuthology.orchestra.run.smithi179.stdout:Hit:6 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2023-11-28T19:55:21.063 INFO:teuthology.orchestra.run.smithi179.stdout:Get:7 https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102914/43dd94c190073cf16cff1e711dd7f5a7b1cbc883/ubuntu/jammy/flavors/default jammy/main i386 Packages [3,413 B] 2023-11-28T19:55:21.072 INFO:teuthology.orchestra.run.smithi078.stdout:Ign:5 https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102914/43dd94c190073cf16cff1e711dd7f5a7b1cbc883/ubuntu/jammy/flavors/default jammy Release.gpg 2023-11-28T19:55:21.089 INFO:teuthology.orchestra.run.smithi078.stdout:Hit:6 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2023-11-28T19:55:21.108 INFO:teuthology.orchestra.run.smithi078.stdout:Get:7 https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102914/43dd94c190073cf16cff1e711dd7f5a7b1cbc883/ubuntu/jammy/flavors/default jammy/main amd64 Packages [17.5 kB] 2023-11-28T19:55:21.110 INFO:teuthology.orchestra.run.smithi179.stdout:Get:8 https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102914/43dd94c190073cf16cff1e711dd7f5a7b1cbc883/ubuntu/jammy/flavors/default jammy/main amd64 Packages [17.5 kB] 2023-11-28T19:55:21.125 INFO:teuthology.orchestra.run.smithi179.stdout:Hit:9 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2023-11-28T19:55:21.170 INFO:teuthology.orchestra.run.smithi078.stdout:Hit:8 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2023-11-28T19:55:21.191 INFO:teuthology.orchestra.run.smithi078.stdout:Get:9 https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102914/43dd94c190073cf16cff1e711dd7f5a7b1cbc883/ubuntu/jammy/flavors/default jammy/main i386 Packages [3,413 B] 2023-11-28T19:55:21.532 INFO:teuthology.orchestra.run.smithi179.stdout:Fetched 27.9 kB in 1s (42.7 kB/s) 2023-11-28T19:55:21.533 INFO:teuthology.orchestra.run.smithi078.stdout:Fetched 27.9 kB in 1s (45.8 kB/s) 2023-11-28T19:55:22.450 INFO:teuthology.orchestra.run.smithi078.stdout:Reading package lists... 2023-11-28T19:55:22.459 INFO:teuthology.orchestra.run.smithi179.stdout:Reading package lists... 2023-11-28T19:55:22.464 DEBUG:teuthology.orchestra.run.smithi078:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=18.0.0-7520-g43dd94c1-1jammy cephadm=18.0.0-7520-g43dd94c1-1jammy ceph-mds=18.0.0-7520-g43dd94c1-1jammy ceph-mgr=18.0.0-7520-g43dd94c1-1jammy ceph-common=18.0.0-7520-g43dd94c1-1jammy ceph-fuse=18.0.0-7520-g43dd94c1-1jammy ceph-test=18.0.0-7520-g43dd94c1-1jammy ceph-volume=18.0.0-7520-g43dd94c1-1jammy radosgw=18.0.0-7520-g43dd94c1-1jammy python3-rados=18.0.0-7520-g43dd94c1-1jammy python3-rgw=18.0.0-7520-g43dd94c1-1jammy python3-cephfs=18.0.0-7520-g43dd94c1-1jammy python3-rbd=18.0.0-7520-g43dd94c1-1jammy libcephfs2=18.0.0-7520-g43dd94c1-1jammy libcephfs-dev=18.0.0-7520-g43dd94c1-1jammy librados2=18.0.0-7520-g43dd94c1-1jammy librbd1=18.0.0-7520-g43dd94c1-1jammy rbd-fuse=18.0.0-7520-g43dd94c1-1jammy python3-cephfs=18.0.0-7520-g43dd94c1-1jammy cephfs-shell=18.0.0-7520-g43dd94c1-1jammy cephfs-top=18.0.0-7520-g43dd94c1-1jammy cephfs-mirror=18.0.0-7520-g43dd94c1-1jammy 2023-11-28T19:55:22.473 DEBUG:teuthology.orchestra.run.smithi179:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=18.0.0-7520-g43dd94c1-1jammy cephadm=18.0.0-7520-g43dd94c1-1jammy ceph-mds=18.0.0-7520-g43dd94c1-1jammy ceph-mgr=18.0.0-7520-g43dd94c1-1jammy ceph-common=18.0.0-7520-g43dd94c1-1jammy ceph-fuse=18.0.0-7520-g43dd94c1-1jammy ceph-test=18.0.0-7520-g43dd94c1-1jammy ceph-volume=18.0.0-7520-g43dd94c1-1jammy radosgw=18.0.0-7520-g43dd94c1-1jammy python3-rados=18.0.0-7520-g43dd94c1-1jammy python3-rgw=18.0.0-7520-g43dd94c1-1jammy python3-cephfs=18.0.0-7520-g43dd94c1-1jammy python3-rbd=18.0.0-7520-g43dd94c1-1jammy libcephfs2=18.0.0-7520-g43dd94c1-1jammy libcephfs-dev=18.0.0-7520-g43dd94c1-1jammy librados2=18.0.0-7520-g43dd94c1-1jammy librbd1=18.0.0-7520-g43dd94c1-1jammy rbd-fuse=18.0.0-7520-g43dd94c1-1jammy python3-cephfs=18.0.0-7520-g43dd94c1-1jammy cephfs-shell=18.0.0-7520-g43dd94c1-1jammy cephfs-top=18.0.0-7520-g43dd94c1-1jammy cephfs-mirror=18.0.0-7520-g43dd94c1-1jammy 2023-11-28T19:55:22.538 INFO:teuthology.orchestra.run.smithi078.stdout:Reading package lists... 2023-11-28T19:55:22.547 INFO:teuthology.orchestra.run.smithi179.stdout:Reading package lists... 2023-11-28T19:55:22.703 INFO:teuthology.orchestra.run.smithi078.stdout:Building dependency tree... 2023-11-28T19:55:22.703 INFO:teuthology.orchestra.run.smithi078.stdout:Reading state information... 2023-11-28T19:55:22.712 INFO:teuthology.orchestra.run.smithi179.stdout:Building dependency tree... 2023-11-28T19:55:22.713 INFO:teuthology.orchestra.run.smithi179.stdout:Reading state information... 2023-11-28T19:55:22.854 INFO:teuthology.orchestra.run.smithi078.stdout:The following packages were automatically installed and are no longer required: 2023-11-28T19:55:22.854 INFO:teuthology.orchestra.run.smithi078.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2023-11-28T19:55:22.854 INFO:teuthology.orchestra.run.smithi078.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2023-11-28T19:55:22.855 INFO:teuthology.orchestra.run.smithi078.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2023-11-28T19:55:22.855 INFO:teuthology.orchestra.run.smithi078.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2023-11-28T19:55:22.855 INFO:teuthology.orchestra.run.smithi078.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2023-11-28T19:55:22.855 INFO:teuthology.orchestra.run.smithi078.stdout:Use 'sudo apt autoremove' to remove them. 2023-11-28T19:55:22.855 INFO:teuthology.orchestra.run.smithi078.stdout:The following additional packages will be installed: 2023-11-28T19:55:22.856 INFO:teuthology.orchestra.run.smithi078.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2023-11-28T19:55:22.856 INFO:teuthology.orchestra.run.smithi078.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd jq 2023-11-28T19:55:22.857 INFO:teuthology.orchestra.run.smithi078.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liblua5.3-dev liboath0 libonig5 2023-11-28T19:55:22.857 INFO:teuthology.orchestra.run.smithi078.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 libradosstriper1 2023-11-28T19:55:22.858 INFO:teuthology.orchestra.run.smithi078.stdout: librdkafka1 libreadline-dev librgw2 libsqlite3-mod-ceph libthrift-0.16.0 2023-11-28T19:55:22.858 INFO:teuthology.orchestra.run.smithi078.stdout: lua-any lua-sec lua-socket lua5.1 luarocks nvme-cli pkg-config 2023-11-28T19:55:22.858 INFO:teuthology.orchestra.run.smithi078.stdout: python-asyncssh-doc python-babel-localedata python-pastedeploy-tpl 2023-11-28T19:55:22.858 INFO:teuthology.orchestra.run.smithi078.stdout: python3-asyncssh python3-babel python3-bcrypt python3-cachetools 2023-11-28T19:55:22.858 INFO:teuthology.orchestra.run.smithi078.stdout: python3-ceph-argparse python3-ceph-common python3-certifi python3-cheroot 2023-11-28T19:55:22.858 INFO:teuthology.orchestra.run.smithi078.stdout: python3-cherrypy3 python3-cmd2 python3-colorama python3-google-auth 2023-11-28T19:55:22.858 INFO:teuthology.orchestra.run.smithi078.stdout: python3-idna python3-iniconfig python3-jaraco.classes 2023-11-28T19:55:22.858 INFO:teuthology.orchestra.run.smithi078.stdout: python3-jaraco.collections python3-jaraco.functools python3-jaraco.text 2023-11-28T19:55:22.858 INFO:teuthology.orchestra.run.smithi078.stdout: python3-jinja2 python3-joblib python3-kubernetes python3-logutils 2023-11-28T19:55:22.858 INFO:teuthology.orchestra.run.smithi078.stdout: python3-mako python3-markupsafe python3-natsort python3-openssl 2023-11-28T19:55:22.858 INFO:teuthology.orchestra.run.smithi078.stdout: python3-paste python3-pastedeploy python3-pastescript python3-pecan 2023-11-28T19:55:22.858 INFO:teuthology.orchestra.run.smithi078.stdout: python3-pluggy python3-portend python3-prettytable python3-psutil python3-py 2023-11-28T19:55:22.858 INFO:teuthology.orchestra.run.smithi078.stdout: python3-pyasn1 python3-pyasn1-modules python3-pygments python3-pyinotify 2023-11-28T19:55:22.859 INFO:teuthology.orchestra.run.smithi078.stdout: python3-pyperclip python3-pytest python3-repoze.lru python3-requests 2023-11-28T19:55:22.859 INFO:teuthology.orchestra.run.smithi078.stdout: python3-requests-oauthlib python3-routes python3-rsa python3-simplegeneric 2023-11-28T19:55:22.859 INFO:teuthology.orchestra.run.smithi078.stdout: python3-simplejson python3-singledispatch python3-sklearn 2023-11-28T19:55:22.859 INFO:teuthology.orchestra.run.smithi078.stdout: python3-sklearn-lib python3-tempita python3-tempora python3-threadpoolctl 2023-11-28T19:55:22.859 INFO:teuthology.orchestra.run.smithi078.stdout: python3-toml python3-urllib3 python3-waitress python3-wcwidth python3-webob 2023-11-28T19:55:22.859 INFO:teuthology.orchestra.run.smithi078.stdout: python3-websocket python3-webtest python3-werkzeug python3-zc.lockfile 2023-11-28T19:55:22.859 INFO:teuthology.orchestra.run.smithi078.stdout: qttranslations5-l10n socat unzip xmlstarlet zip 2023-11-28T19:55:22.859 INFO:teuthology.orchestra.run.smithi078.stdout:Suggested packages: 2023-11-28T19:55:22.859 INFO:teuthology.orchestra.run.smithi078.stdout: python3-influxdb readline-doc python-jinja2-doc python3-beaker 2023-11-28T19:55:22.859 INFO:teuthology.orchestra.run.smithi078.stdout: python-mako-doc python-natsort-doc python-openssl-doc python3-openssl-dbg 2023-11-28T19:55:22.859 INFO:teuthology.orchestra.run.smithi078.stdout: httpd-wsgi libapache2-mod-python libapache2-mod-scgi libjs-mochikit 2023-11-28T19:55:22.859 INFO:teuthology.orchestra.run.smithi078.stdout: python-pecan-doc python-psutil-doc subversion python-pygments-doc 2023-11-28T19:55:22.859 INFO:teuthology.orchestra.run.smithi078.stdout: python-pyinotify-doc python3-socks python-requests-doc python3-dap 2023-11-28T19:55:22.859 INFO:teuthology.orchestra.run.smithi078.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2023-11-28T19:55:22.860 INFO:teuthology.orchestra.run.smithi078.stdout: python-webtest-doc python-werkzeug-doc python3-watchdog 2023-11-28T19:55:22.860 INFO:teuthology.orchestra.run.smithi078.stdout:Recommended packages: 2023-11-28T19:55:22.860 INFO:teuthology.orchestra.run.smithi078.stdout: btrfs-tools 2023-11-28T19:55:22.863 INFO:teuthology.orchestra.run.smithi179.stdout:The following packages were automatically installed and are no longer required: 2023-11-28T19:55:22.864 INFO:teuthology.orchestra.run.smithi179.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2023-11-28T19:55:22.864 INFO:teuthology.orchestra.run.smithi179.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2023-11-28T19:55:22.864 INFO:teuthology.orchestra.run.smithi179.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2023-11-28T19:55:22.864 INFO:teuthology.orchestra.run.smithi179.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2023-11-28T19:55:22.864 INFO:teuthology.orchestra.run.smithi179.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2023-11-28T19:55:22.865 INFO:teuthology.orchestra.run.smithi179.stdout:Use 'sudo apt autoremove' to remove them. 2023-11-28T19:55:22.865 INFO:teuthology.orchestra.run.smithi179.stdout:The following additional packages will be installed: 2023-11-28T19:55:22.865 INFO:teuthology.orchestra.run.smithi179.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2023-11-28T19:55:22.867 INFO:teuthology.orchestra.run.smithi179.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd jq 2023-11-28T19:55:22.867 INFO:teuthology.orchestra.run.smithi179.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liblua5.3-dev liboath0 libonig5 2023-11-28T19:55:22.867 INFO:teuthology.orchestra.run.smithi179.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 libradosstriper1 2023-11-28T19:55:22.867 INFO:teuthology.orchestra.run.smithi179.stdout: librdkafka1 libreadline-dev librgw2 libsqlite3-mod-ceph libthrift-0.16.0 2023-11-28T19:55:22.868 INFO:teuthology.orchestra.run.smithi179.stdout: lua-any lua-sec lua-socket lua5.1 luarocks nvme-cli pkg-config 2023-11-28T19:55:22.868 INFO:teuthology.orchestra.run.smithi179.stdout: python-asyncssh-doc python-babel-localedata python-pastedeploy-tpl 2023-11-28T19:55:22.868 INFO:teuthology.orchestra.run.smithi179.stdout: python3-asyncssh python3-babel python3-bcrypt python3-cachetools 2023-11-28T19:55:22.868 INFO:teuthology.orchestra.run.smithi179.stdout: python3-ceph-argparse python3-ceph-common python3-certifi python3-cheroot 2023-11-28T19:55:22.868 INFO:teuthology.orchestra.run.smithi179.stdout: python3-cherrypy3 python3-cmd2 python3-colorama python3-google-auth 2023-11-28T19:55:22.868 INFO:teuthology.orchestra.run.smithi179.stdout: python3-idna python3-iniconfig python3-jaraco.classes 2023-11-28T19:55:22.868 INFO:teuthology.orchestra.run.smithi179.stdout: python3-jaraco.collections python3-jaraco.functools python3-jaraco.text 2023-11-28T19:55:22.868 INFO:teuthology.orchestra.run.smithi179.stdout: python3-jinja2 python3-joblib python3-kubernetes python3-logutils 2023-11-28T19:55:22.868 INFO:teuthology.orchestra.run.smithi179.stdout: python3-mako python3-markupsafe python3-natsort python3-openssl 2023-11-28T19:55:22.868 INFO:teuthology.orchestra.run.smithi179.stdout: python3-paste python3-pastedeploy python3-pastescript python3-pecan 2023-11-28T19:55:22.868 INFO:teuthology.orchestra.run.smithi179.stdout: python3-pluggy python3-portend python3-prettytable python3-psutil python3-py 2023-11-28T19:55:22.868 INFO:teuthology.orchestra.run.smithi179.stdout: python3-pyasn1 python3-pyasn1-modules python3-pygments python3-pyinotify 2023-11-28T19:55:22.868 INFO:teuthology.orchestra.run.smithi179.stdout: python3-pyperclip python3-pytest python3-repoze.lru python3-requests 2023-11-28T19:55:22.869 INFO:teuthology.orchestra.run.smithi179.stdout: python3-requests-oauthlib python3-routes python3-rsa python3-simplegeneric 2023-11-28T19:55:22.869 INFO:teuthology.orchestra.run.smithi179.stdout: python3-simplejson python3-singledispatch python3-sklearn 2023-11-28T19:55:22.869 INFO:teuthology.orchestra.run.smithi179.stdout: python3-sklearn-lib python3-tempita python3-tempora python3-threadpoolctl 2023-11-28T19:55:22.869 INFO:teuthology.orchestra.run.smithi179.stdout: python3-toml python3-urllib3 python3-waitress python3-wcwidth python3-webob 2023-11-28T19:55:22.869 INFO:teuthology.orchestra.run.smithi179.stdout: python3-websocket python3-webtest python3-werkzeug python3-zc.lockfile 2023-11-28T19:55:22.869 INFO:teuthology.orchestra.run.smithi179.stdout: qttranslations5-l10n socat unzip xmlstarlet zip 2023-11-28T19:55:22.869 INFO:teuthology.orchestra.run.smithi179.stdout:Suggested packages: 2023-11-28T19:55:22.869 INFO:teuthology.orchestra.run.smithi179.stdout: python3-influxdb readline-doc python-jinja2-doc python3-beaker 2023-11-28T19:55:22.869 INFO:teuthology.orchestra.run.smithi179.stdout: python-mako-doc python-natsort-doc python-openssl-doc python3-openssl-dbg 2023-11-28T19:55:22.869 INFO:teuthology.orchestra.run.smithi179.stdout: httpd-wsgi libapache2-mod-python libapache2-mod-scgi libjs-mochikit 2023-11-28T19:55:22.869 INFO:teuthology.orchestra.run.smithi179.stdout: python-pecan-doc python-psutil-doc subversion python-pygments-doc 2023-11-28T19:55:22.869 INFO:teuthology.orchestra.run.smithi179.stdout: python-pyinotify-doc python3-socks python-requests-doc python3-dap 2023-11-28T19:55:22.869 INFO:teuthology.orchestra.run.smithi179.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2023-11-28T19:55:22.870 INFO:teuthology.orchestra.run.smithi179.stdout: python-webtest-doc python-werkzeug-doc python3-watchdog 2023-11-28T19:55:22.870 INFO:teuthology.orchestra.run.smithi179.stdout:Recommended packages: 2023-11-28T19:55:22.870 INFO:teuthology.orchestra.run.smithi179.stdout: btrfs-tools 2023-11-28T19:55:23.005 INFO:teuthology.orchestra.run.smithi078.stdout:The following NEW packages will be installed: 2023-11-28T19:55:23.005 INFO:teuthology.orchestra.run.smithi078.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2023-11-28T19:55:23.005 INFO:teuthology.orchestra.run.smithi078.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2023-11-28T19:55:23.005 INFO:teuthology.orchestra.run.smithi078.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm 2023-11-28T19:55:23.005 INFO:teuthology.orchestra.run.smithi078.stdout: cephfs-mirror cephfs-shell cephfs-top jq libcephfs-dev libcephfs2 2023-11-28T19:55:23.007 INFO:teuthology.orchestra.run.smithi078.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liblua5.3-dev liboath0 libonig5 2023-11-28T19:55:23.007 INFO:teuthology.orchestra.run.smithi078.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 librados2 2023-11-28T19:55:23.007 INFO:teuthology.orchestra.run.smithi078.stdout: libradosstriper1 librbd1 librdkafka1 libreadline-dev librgw2 2023-11-28T19:55:23.008 INFO:teuthology.orchestra.run.smithi078.stdout: libsqlite3-mod-ceph libthrift-0.16.0 lua-any lua-sec lua-socket lua5.1 2023-11-28T19:55:23.008 INFO:teuthology.orchestra.run.smithi078.stdout: luarocks nvme-cli pkg-config python-asyncssh-doc python-babel-localedata 2023-11-28T19:55:23.008 INFO:teuthology.orchestra.run.smithi078.stdout: python-pastedeploy-tpl python3-asyncssh python3-babel python3-bcrypt 2023-11-28T19:55:23.008 INFO:teuthology.orchestra.run.smithi078.stdout: python3-cachetools python3-ceph-argparse python3-ceph-common python3-cephfs 2023-11-28T19:55:23.008 INFO:teuthology.orchestra.run.smithi078.stdout: python3-certifi python3-cheroot python3-cherrypy3 python3-cmd2 2023-11-28T19:55:23.008 INFO:teuthology.orchestra.run.smithi078.stdout: python3-colorama python3-google-auth python3-idna python3-iniconfig 2023-11-28T19:55:23.008 INFO:teuthology.orchestra.run.smithi078.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2023-11-28T19:55:23.008 INFO:teuthology.orchestra.run.smithi078.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2023-11-28T19:55:23.008 INFO:teuthology.orchestra.run.smithi078.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2023-11-28T19:55:23.008 INFO:teuthology.orchestra.run.smithi078.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2023-11-28T19:55:23.008 INFO:teuthology.orchestra.run.smithi078.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2023-11-28T19:55:23.008 INFO:teuthology.orchestra.run.smithi078.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2023-11-28T19:55:23.009 INFO:teuthology.orchestra.run.smithi078.stdout: python3-pygments python3-pyinotify python3-pyperclip python3-pytest 2023-11-28T19:55:23.009 INFO:teuthology.orchestra.run.smithi078.stdout: python3-rados python3-rbd python3-repoze.lru python3-requests 2023-11-28T19:55:23.009 INFO:teuthology.orchestra.run.smithi078.stdout: python3-requests-oauthlib python3-rgw python3-routes python3-rsa 2023-11-28T19:55:23.009 INFO:teuthology.orchestra.run.smithi078.stdout: python3-simplegeneric python3-simplejson python3-singledispatch 2023-11-28T19:55:23.009 INFO:teuthology.orchestra.run.smithi078.stdout: python3-sklearn python3-sklearn-lib python3-tempita python3-tempora 2023-11-28T19:55:23.009 INFO:teuthology.orchestra.run.smithi078.stdout: python3-threadpoolctl python3-toml python3-urllib3 python3-waitress 2023-11-28T19:55:23.009 INFO:teuthology.orchestra.run.smithi078.stdout: python3-wcwidth python3-webob python3-websocket python3-webtest 2023-11-28T19:55:23.009 INFO:teuthology.orchestra.run.smithi078.stdout: python3-werkzeug python3-zc.lockfile qttranslations5-l10n radosgw rbd-fuse 2023-11-28T19:55:23.009 INFO:teuthology.orchestra.run.smithi078.stdout: socat unzip xmlstarlet zip 2023-11-28T19:55:23.013 INFO:teuthology.orchestra.run.smithi179.stdout:The following NEW packages will be installed: 2023-11-28T19:55:23.013 INFO:teuthology.orchestra.run.smithi179.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2023-11-28T19:55:23.014 INFO:teuthology.orchestra.run.smithi179.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2023-11-28T19:55:23.014 INFO:teuthology.orchestra.run.smithi179.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm 2023-11-28T19:55:23.015 INFO:teuthology.orchestra.run.smithi179.stdout: cephfs-mirror cephfs-shell cephfs-top jq libcephfs-dev libcephfs2 2023-11-28T19:55:23.015 INFO:teuthology.orchestra.run.smithi179.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liblua5.3-dev liboath0 libonig5 2023-11-28T19:55:23.016 INFO:teuthology.orchestra.run.smithi179.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 librados2 2023-11-28T19:55:23.016 INFO:teuthology.orchestra.run.smithi179.stdout: libradosstriper1 librbd1 librdkafka1 libreadline-dev librgw2 2023-11-28T19:55:23.016 INFO:teuthology.orchestra.run.smithi179.stdout: libsqlite3-mod-ceph libthrift-0.16.0 lua-any lua-sec lua-socket lua5.1 2023-11-28T19:55:23.016 INFO:teuthology.orchestra.run.smithi179.stdout: luarocks nvme-cli pkg-config python-asyncssh-doc python-babel-localedata 2023-11-28T19:55:23.016 INFO:teuthology.orchestra.run.smithi179.stdout: python-pastedeploy-tpl python3-asyncssh python3-babel python3-bcrypt 2023-11-28T19:55:23.016 INFO:teuthology.orchestra.run.smithi179.stdout: python3-cachetools python3-ceph-argparse python3-ceph-common python3-cephfs 2023-11-28T19:55:23.016 INFO:teuthology.orchestra.run.smithi179.stdout: python3-certifi python3-cheroot python3-cherrypy3 python3-cmd2 2023-11-28T19:55:23.016 INFO:teuthology.orchestra.run.smithi179.stdout: python3-colorama python3-google-auth python3-idna python3-iniconfig 2023-11-28T19:55:23.016 INFO:teuthology.orchestra.run.smithi179.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2023-11-28T19:55:23.016 INFO:teuthology.orchestra.run.smithi179.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2023-11-28T19:55:23.016 INFO:teuthology.orchestra.run.smithi179.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2023-11-28T19:55:23.016 INFO:teuthology.orchestra.run.smithi179.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2023-11-28T19:55:23.016 INFO:teuthology.orchestra.run.smithi179.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2023-11-28T19:55:23.016 INFO:teuthology.orchestra.run.smithi179.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2023-11-28T19:55:23.017 INFO:teuthology.orchestra.run.smithi179.stdout: python3-pygments python3-pyinotify python3-pyperclip python3-pytest 2023-11-28T19:55:23.017 INFO:teuthology.orchestra.run.smithi179.stdout: python3-rados python3-rbd python3-repoze.lru python3-requests 2023-11-28T19:55:23.017 INFO:teuthology.orchestra.run.smithi179.stdout: python3-requests-oauthlib python3-rgw python3-routes python3-rsa 2023-11-28T19:55:23.017 INFO:teuthology.orchestra.run.smithi179.stdout: python3-simplegeneric python3-simplejson python3-singledispatch 2023-11-28T19:55:23.017 INFO:teuthology.orchestra.run.smithi179.stdout: python3-sklearn python3-sklearn-lib python3-tempita python3-tempora 2023-11-28T19:55:23.017 INFO:teuthology.orchestra.run.smithi179.stdout: python3-threadpoolctl python3-toml python3-urllib3 python3-waitress 2023-11-28T19:55:23.017 INFO:teuthology.orchestra.run.smithi179.stdout: python3-wcwidth python3-webob python3-websocket python3-webtest 2023-11-28T19:55:23.017 INFO:teuthology.orchestra.run.smithi179.stdout: python3-werkzeug python3-zc.lockfile qttranslations5-l10n radosgw rbd-fuse 2023-11-28T19:55:23.017 INFO:teuthology.orchestra.run.smithi179.stdout: socat unzip xmlstarlet zip 2023-11-28T19:55:23.088 INFO:teuthology.orchestra.run.smithi179.stdout:0 upgraded, 124 newly installed, 0 to remove and 264 not upgraded. 2023-11-28T19:55:23.088 INFO:teuthology.orchestra.run.smithi179.stdout:Need to get 187 MB of archives. 2023-11-28T19:55:23.088 INFO:teuthology.orchestra.run.smithi179.stdout:After this operation, 835 MB of additional disk space will be used. 2023-11-28T19:55:23.088 INFO:teuthology.orchestra.run.smithi179.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyperclip all 1.8.2-2 [11.5 kB] 2023-11-28T19:55:23.109 INFO:teuthology.orchestra.run.smithi179.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-wcwidth all 0.2.5+dfsg1-1 [21.9 kB] 2023-11-28T19:55:23.120 INFO:teuthology.orchestra.run.smithi179.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cmd2 all 2.3.3-1 [124 kB] 2023-11-28T19:55:23.164 INFO:teuthology.orchestra.run.smithi179.stdout:Get:4 https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102914/43dd94c190073cf16cff1e711dd7f5a7b1cbc883/ubuntu/jammy/flavors/default jammy/main amd64 librados2 amd64 18.0.0-7520-g43dd94c1-1jammy [3,469 kB] 2023-11-28T19:55:23.169 INFO:teuthology.orchestra.run.smithi179.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblttng-ust1 amd64 2.13.1-1ubuntu1 [190 kB] 2023-11-28T19:55:23.193 INFO:teuthology.orchestra.run.smithi179.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libdouble-conversion3 amd64 3.1.7-4 [39.0 kB] 2023-11-28T19:55:23.196 INFO:teuthology.orchestra.run.smithi179.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpcre2-16-0 amd64 10.39-3ubuntu0.1 [203 kB] 2023-11-28T19:55:23.203 INFO:teuthology.orchestra.run.smithi078.stdout:0 upgraded, 124 newly installed, 0 to remove and 264 not upgraded. 2023-11-28T19:55:23.203 INFO:teuthology.orchestra.run.smithi078.stdout:Need to get 187 MB of archives. 2023-11-28T19:55:23.203 INFO:teuthology.orchestra.run.smithi078.stdout:After this operation, 835 MB of additional disk space will be used. 2023-11-28T19:55:23.203 INFO:teuthology.orchestra.run.smithi078.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyperclip all 1.8.2-2 [11.5 kB] 2023-11-28T19:55:23.210 INFO:teuthology.orchestra.run.smithi179.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5core5a amd64 5.15.3+dfsg-2ubuntu0.2 [2,006 kB] 2023-11-28T19:55:23.230 INFO:teuthology.orchestra.run.smithi078.stdout:Get:2 https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102914/43dd94c190073cf16cff1e711dd7f5a7b1cbc883/ubuntu/jammy/flavors/default jammy/main amd64 librados2 amd64 18.0.0-7520-g43dd94c1-1jammy [3,469 kB] 2023-11-28T19:55:23.254 INFO:teuthology.orchestra.run.smithi179.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5dbus5 amd64 5.15.3+dfsg-2ubuntu0.2 [222 kB] 2023-11-28T19:55:23.257 INFO:teuthology.orchestra.run.smithi179.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5network5 amd64 5.15.3+dfsg-2ubuntu0.2 [731 kB] 2023-11-28T19:55:23.263 INFO:teuthology.orchestra.run.smithi179.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libthrift-0.16.0 amd64 0.16.0-2 [267 kB] 2023-11-28T19:55:23.266 INFO:teuthology.orchestra.run.smithi179.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-prettytable all 2.5.0-2 [31.3 kB] 2023-11-28T19:55:23.267 INFO:teuthology.orchestra.run.smithi179.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/universe amd64 librdkafka1 amd64 1.8.0-1build1 [633 kB] 2023-11-28T19:55:23.273 INFO:teuthology.orchestra.run.smithi179.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy/main amd64 libreadline-dev amd64 8.1.2-1 [166 kB] 2023-11-28T19:55:23.274 INFO:teuthology.orchestra.run.smithi179.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblua5.3-dev amd64 5.3.6-1build1 [167 kB] 2023-11-28T19:55:23.276 INFO:teuthology.orchestra.run.smithi179.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua5.1 amd64 5.1.5-8.1build4 [94.6 kB] 2023-11-28T19:55:23.278 INFO:teuthology.orchestra.run.smithi179.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-any all 27ubuntu1 [5,034 B] 2023-11-28T19:55:23.278 INFO:teuthology.orchestra.run.smithi179.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy/main amd64 zip amd64 3.0-12build2 [176 kB] 2023-11-28T19:55:23.286 INFO:teuthology.orchestra.run.smithi078.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-wcwidth all 0.2.5+dfsg1-1 [21.9 kB] 2023-11-28T19:55:23.299 INFO:teuthology.orchestra.run.smithi179.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 unzip amd64 6.0-26ubuntu3.1 [174 kB] 2023-11-28T19:55:23.301 INFO:teuthology.orchestra.run.smithi179.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy/universe amd64 luarocks all 3.8.0+dfsg1-1 [140 kB] 2023-11-28T19:55:23.303 INFO:teuthology.orchestra.run.smithi179.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy/main amd64 liboath0 amd64 2.6.7-3build1 [41.1 kB] 2023-11-28T19:55:23.303 INFO:teuthology.orchestra.run.smithi179.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.functools all 3.4.0-2 [9,030 B] 2023-11-28T19:55:23.304 INFO:teuthology.orchestra.run.smithi179.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-cheroot all 8.5.2+ds1-1ubuntu3.1 [71.1 kB] 2023-11-28T19:55:23.304 INFO:teuthology.orchestra.run.smithi179.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.classes all 3.2.1-3 [6,452 B] 2023-11-28T19:55:23.320 INFO:teuthology.orchestra.run.smithi179.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.text all 3.6.0-2 [8,716 B] 2023-11-28T19:55:23.321 INFO:teuthology.orchestra.run.smithi179.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.collections all 3.4.0-2 [11.4 kB] 2023-11-28T19:55:23.321 INFO:teuthology.orchestra.run.smithi179.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempora all 4.1.2-1 [14.8 kB] 2023-11-28T19:55:23.321 INFO:teuthology.orchestra.run.smithi179.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-portend all 3.0.0-1 [7,240 B] 2023-11-28T19:55:23.331 INFO:teuthology.orchestra.run.smithi078.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cmd2 all 2.3.3-1 [124 kB] 2023-11-28T19:55:23.340 INFO:teuthology.orchestra.run.smithi179.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-zc.lockfile all 2.0-1 [8,980 B] 2023-11-28T19:55:23.340 INFO:teuthology.orchestra.run.smithi179.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cherrypy3 all 18.6.1-4 [208 kB] 2023-11-28T19:55:23.342 INFO:teuthology.orchestra.run.smithi179.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-natsort all 8.0.2-1 [35.3 kB] 2023-11-28T19:55:23.343 INFO:teuthology.orchestra.run.smithi179.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-logutils all 0.3.3-8 [17.6 kB] 2023-11-28T19:55:23.343 INFO:teuthology.orchestra.run.smithi179.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-markupsafe amd64 2.0.1-2build1 [12.7 kB] 2023-11-28T19:55:23.343 INFO:teuthology.orchestra.run.smithi179.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-mako all 1.1.3+ds1-2ubuntu0.1 [60.5 kB] 2023-11-28T19:55:23.359 INFO:teuthology.orchestra.run.smithi179.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2023-11-28T19:55:23.360 INFO:teuthology.orchestra.run.smithi179.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-singledispatch all 3.4.0.3-3 [7,320 B] 2023-11-28T19:55:23.360 INFO:teuthology.orchestra.run.smithi179.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webob all 1:1.8.6-1.1 [85.2 kB] 2023-11-28T19:55:23.361 INFO:teuthology.orchestra.run.smithi179.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-waitress all 1.4.4-1.1ubuntu1 [47.3 kB] 2023-11-28T19:55:23.379 INFO:teuthology.orchestra.run.smithi179.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempita all 0.5.2-6ubuntu1 [15.1 kB] 2023-11-28T19:55:23.379 INFO:teuthology.orchestra.run.smithi179.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-paste all 3.5.0+dfsg1-1 [456 kB] 2023-11-28T19:55:23.384 INFO:teuthology.orchestra.run.smithi179.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-pastedeploy-tpl all 2.1.1-1 [4,892 B] 2023-11-28T19:55:23.384 INFO:teuthology.orchestra.run.smithi179.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastedeploy all 2.1.1-1 [26.6 kB] 2023-11-28T19:55:23.385 INFO:teuthology.orchestra.run.smithi179.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webtest all 2.0.35-1 [28.5 kB] 2023-11-28T19:55:23.385 INFO:teuthology.orchestra.run.smithi179.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pecan all 1.3.3-4ubuntu2 [87.3 kB] 2023-11-28T19:55:23.398 INFO:teuthology.orchestra.run.smithi179.stdout:Get:45 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-certifi all 2020.6.20-1 [150 kB] 2023-11-28T19:55:23.400 INFO:teuthology.orchestra.run.smithi179.stdout:Get:46 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-idna all 3.3-1 [49.3 kB] 2023-11-28T19:55:23.400 INFO:teuthology.orchestra.run.smithi179.stdout:Get:47 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-urllib3 all 1.26.5-1~exp1ubuntu0.1 [98.2 kB] 2023-11-28T19:55:23.402 INFO:teuthology.orchestra.run.smithi179.stdout:Get:48 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-requests all 2.25.1+dfsg-2ubuntu0.1 [48.8 kB] 2023-11-28T19:55:23.418 INFO:teuthology.orchestra.run.smithi179.stdout:Get:49 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-werkzeug all 2.0.2+dfsg1-1ubuntu0.22.04.1 [181 kB] 2023-11-28T19:55:23.420 INFO:teuthology.orchestra.run.smithi179.stdout:Get:50 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-bcrypt amd64 3.2.0-1build1 [32.7 kB] 2023-11-28T19:55:23.420 INFO:teuthology.orchestra.run.smithi179.stdout:Get:51 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-openssl all 21.0.0-1 [45.2 kB] 2023-11-28T19:55:23.421 INFO:teuthology.orchestra.run.smithi179.stdout:Get:52 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-asyncssh all 2.5.0-1 [185 kB] 2023-11-28T19:55:23.423 INFO:teuthology.orchestra.run.smithi179.stdout:Get:53 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-babel-localedata all 2.8.0+dfsg.1-7 [4,982 kB] 2023-11-28T19:55:23.471 INFO:teuthology.orchestra.run.smithi179.stdout:Get:54 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-babel all 2.8.0+dfsg.1-7 [85.1 kB] 2023-11-28T19:55:23.472 INFO:teuthology.orchestra.run.smithi179.stdout:Get:55 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jinja2 all 3.0.3-1 [108 kB] 2023-11-28T19:55:23.473 INFO:teuthology.orchestra.run.smithi179.stdout:Get:56 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2023-11-28T19:55:23.474 INFO:teuthology.orchestra.run.smithi179.stdout:Get:57 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-routes all 2.5.1-1ubuntu1 [89.0 kB] 2023-11-28T19:55:23.475 INFO:teuthology.orchestra.run.smithi179.stdout:Get:58 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn-lib amd64 0.23.2-5ubuntu6 [2,058 kB] 2023-11-28T19:55:23.494 INFO:teuthology.orchestra.run.smithi179.stdout:Get:59 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-joblib all 0.17.0-4ubuntu1 [204 kB] 2023-11-28T19:55:23.496 INFO:teuthology.orchestra.run.smithi179.stdout:Get:60 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-threadpoolctl all 3.1.0-1 [21.3 kB] 2023-11-28T19:55:23.496 INFO:teuthology.orchestra.run.smithi179.stdout:Get:61 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn all 0.23.2-5ubuntu6 [1,829 kB] 2023-11-28T19:55:23.514 INFO:teuthology.orchestra.run.smithi179.stdout:Get:62 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cachetools all 5.0.0-1 [9,722 B] 2023-11-28T19:55:23.515 INFO:teuthology.orchestra.run.smithi179.stdout:Get:63 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1 all 0.4.8-1 [50.9 kB] 2023-11-28T19:55:23.516 INFO:teuthology.orchestra.run.smithi179.stdout:Get:64 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1-modules all 0.2.1-1 [33.0 kB] 2023-11-28T19:55:23.516 INFO:teuthology.orchestra.run.smithi179.stdout:Get:65 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-rsa all 4.8-1 [28.4 kB] 2023-11-28T19:55:23.516 INFO:teuthology.orchestra.run.smithi179.stdout:Get:66 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-google-auth all 1.5.1-3 [35.7 kB] 2023-11-28T19:55:23.517 INFO:teuthology.orchestra.run.smithi179.stdout:Get:67 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-requests-oauthlib all 1.3.0+ds-0.1 [18.7 kB] 2023-11-28T19:55:23.518 INFO:teuthology.orchestra.run.smithi179.stdout:Get:68 https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102914/43dd94c190073cf16cff1e711dd7f5a7b1cbc883/ubuntu/jammy/flavors/default jammy/main amd64 librbd1 amd64 18.0.0-7520-g43dd94c1-1jammy [3,111 kB] 2023-11-28T19:55:23.532 INFO:teuthology.orchestra.run.smithi179.stdout:Get:69 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-websocket all 1.2.3-1 [34.7 kB] 2023-11-28T19:55:23.532 INFO:teuthology.orchestra.run.smithi179.stdout:Get:70 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-kubernetes all 12.0.1-1ubuntu1 [353 kB] 2023-11-28T19:55:23.536 INFO:teuthology.orchestra.run.smithi179.stdout:Get:71 http://archive.ubuntu.com/ubuntu jammy/main amd64 libonig5 amd64 6.9.7.1-2build1 [172 kB] 2023-11-28T19:55:23.538 INFO:teuthology.orchestra.run.smithi078.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblttng-ust1 amd64 2.13.1-1ubuntu1 [190 kB] 2023-11-28T19:55:23.551 INFO:teuthology.orchestra.run.smithi179.stdout:Get:72 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjq1 amd64 1.6-2.1ubuntu3 [133 kB] 2023-11-28T19:55:23.553 INFO:teuthology.orchestra.run.smithi179.stdout:Get:73 http://archive.ubuntu.com/ubuntu jammy/main amd64 jq amd64 1.6-2.1ubuntu3 [52.5 kB] 2023-11-28T19:55:23.553 INFO:teuthology.orchestra.run.smithi179.stdout:Get:74 http://archive.ubuntu.com/ubuntu jammy/main amd64 socat amd64 1.7.4.1-3ubuntu4 [349 kB] 2023-11-28T19:55:23.557 INFO:teuthology.orchestra.run.smithi179.stdout:Get:75 http://archive.ubuntu.com/ubuntu jammy/universe amd64 xmlstarlet amd64 1.6.1-2.1 [265 kB] 2023-11-28T19:55:23.559 INFO:teuthology.orchestra.run.smithi179.stdout:Get:76 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-colorama all 0.4.4-1 [24.5 kB] 2023-11-28T19:55:23.560 INFO:teuthology.orchestra.run.smithi179.stdout:Get:77 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-socket amd64 3.0~rc1+git+ac3201d-6 [78.9 kB] 2023-11-28T19:55:23.561 INFO:teuthology.orchestra.run.smithi179.stdout:Get:78 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-sec amd64 1.0.2-1 [37.6 kB] 2023-11-28T19:55:23.570 INFO:teuthology.orchestra.run.smithi179.stdout:Get:79 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 nvme-cli amd64 1.16-3ubuntu0.1 [474 kB] 2023-11-28T19:55:23.575 INFO:teuthology.orchestra.run.smithi179.stdout:Get:80 http://archive.ubuntu.com/ubuntu jammy/main amd64 pkg-config amd64 0.29.2-1ubuntu3 [48.2 kB] 2023-11-28T19:55:23.576 INFO:teuthology.orchestra.run.smithi179.stdout:Get:81 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python-asyncssh-doc all 2.5.0-1 [318 kB] 2023-11-28T19:55:23.590 INFO:teuthology.orchestra.run.smithi179.stdout:Get:82 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-iniconfig all 1.1.1-2 [6,024 B] 2023-11-28T19:55:23.590 INFO:teuthology.orchestra.run.smithi179.stdout:Get:83 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2023-11-28T19:55:23.591 INFO:teuthology.orchestra.run.smithi179.stdout:Get:84 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pluggy all 0.13.0-7.1 [19.0 kB] 2023-11-28T19:55:23.591 INFO:teuthology.orchestra.run.smithi179.stdout:Get:85 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-psutil amd64 5.9.0-1build1 [158 kB] 2023-11-28T19:55:23.593 INFO:teuthology.orchestra.run.smithi179.stdout:Get:86 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-py all 1.10.0-1 [71.9 kB] 2023-11-28T19:55:23.594 INFO:teuthology.orchestra.run.smithi179.stdout:Get:87 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pygments all 2.11.2+dfsg-2 [750 kB] 2023-11-28T19:55:23.601 INFO:teuthology.orchestra.run.smithi179.stdout:Get:88 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyinotify all 0.9.6-1.3 [24.8 kB] 2023-11-28T19:55:23.609 INFO:teuthology.orchestra.run.smithi179.stdout:Get:89 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-toml all 0.10.2-1 [16.5 kB] 2023-11-28T19:55:23.610 INFO:teuthology.orchestra.run.smithi179.stdout:Get:90 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pytest all 6.2.5-1ubuntu2 [214 kB] 2023-11-28T19:55:23.612 INFO:teuthology.orchestra.run.smithi179.stdout:Get:91 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplejson amd64 3.17.6-1build1 [54.7 kB] 2023-11-28T19:55:23.629 INFO:teuthology.orchestra.run.smithi179.stdout:Get:92 http://archive.ubuntu.com/ubuntu jammy/universe amd64 qttranslations5-l10n all 5.15.3-1 [1,983 kB] 2023-11-28T19:55:23.638 INFO:teuthology.orchestra.run.smithi078.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libdouble-conversion3 amd64 3.1.7-4 [39.0 kB] 2023-11-28T19:55:23.651 INFO:teuthology.orchestra.run.smithi078.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpcre2-16-0 amd64 10.39-3ubuntu0.1 [203 kB] 2023-11-28T19:55:23.664 INFO:teuthology.orchestra.run.smithi179.stdout:Get:93 https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102914/43dd94c190073cf16cff1e711dd7f5a7b1cbc883/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs2 amd64 18.0.0-7520-g43dd94c1-1jammy [691 kB] 2023-11-28T19:55:23.691 INFO:teuthology.orchestra.run.smithi179.stdout:Get:94 https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102914/43dd94c190073cf16cff1e711dd7f5a7b1cbc883/ubuntu/jammy/flavors/default jammy/main amd64 python3-rados amd64 18.0.0-7520-g43dd94c1-1jammy [356 kB] 2023-11-28T19:55:23.703 INFO:teuthology.orchestra.run.smithi179.stdout:Get:95 https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102914/43dd94c190073cf16cff1e711dd7f5a7b1cbc883/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-argparse all 18.0.0-7520-g43dd94c1-1jammy [32.8 kB] 2023-11-28T19:55:23.704 INFO:teuthology.orchestra.run.smithi078.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5core5a amd64 5.15.3+dfsg-2ubuntu0.2 [2,006 kB] 2023-11-28T19:55:23.704 INFO:teuthology.orchestra.run.smithi179.stdout:Get:96 https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102914/43dd94c190073cf16cff1e711dd7f5a7b1cbc883/ubuntu/jammy/flavors/default jammy/main amd64 python3-cephfs amd64 18.0.0-7520-g43dd94c1-1jammy [180 kB] 2023-11-28T19:55:23.718 INFO:teuthology.orchestra.run.smithi179.stdout:Get:97 https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102914/43dd94c190073cf16cff1e711dd7f5a7b1cbc883/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-common all 18.0.0-7520-g43dd94c1-1jammy [63.5 kB] 2023-11-28T19:55:23.720 INFO:teuthology.orchestra.run.smithi179.stdout:Get:98 https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102914/43dd94c190073cf16cff1e711dd7f5a7b1cbc883/ubuntu/jammy/flavors/default jammy/main amd64 python3-rbd amd64 18.0.0-7520-g43dd94c1-1jammy [330 kB] 2023-11-28T19:55:23.731 INFO:teuthology.orchestra.run.smithi179.stdout:Get:99 https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102914/43dd94c190073cf16cff1e711dd7f5a7b1cbc883/ubuntu/jammy/flavors/default jammy/main amd64 librgw2 amd64 18.0.0-7520-g43dd94c1-1jammy [6,233 kB] 2023-11-28T19:55:23.843 INFO:teuthology.orchestra.run.smithi078.stdout:Get:9 https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102914/43dd94c190073cf16cff1e711dd7f5a7b1cbc883/ubuntu/jammy/flavors/default jammy/main amd64 librbd1 amd64 18.0.0-7520-g43dd94c1-1jammy [3,111 kB] 2023-11-28T19:55:23.879 INFO:teuthology.orchestra.run.smithi078.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5dbus5 amd64 5.15.3+dfsg-2ubuntu0.2 [222 kB] 2023-11-28T19:55:23.888 INFO:teuthology.orchestra.run.smithi078.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5network5 amd64 5.15.3+dfsg-2ubuntu0.2 [731 kB] 2023-11-28T19:55:23.915 INFO:teuthology.orchestra.run.smithi078.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libthrift-0.16.0 amd64 0.16.0-2 [267 kB] 2023-11-28T19:55:23.923 INFO:teuthology.orchestra.run.smithi078.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-prettytable all 2.5.0-2 [31.3 kB] 2023-11-28T19:55:24.006 INFO:teuthology.orchestra.run.smithi179.stdout:Get:100 https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102914/43dd94c190073cf16cff1e711dd7f5a7b1cbc883/ubuntu/jammy/flavors/default jammy/main amd64 python3-rgw amd64 18.0.0-7520-g43dd94c1-1jammy [112 kB] 2023-11-28T19:55:24.008 INFO:teuthology.orchestra.run.smithi179.stdout:Get:101 https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102914/43dd94c190073cf16cff1e711dd7f5a7b1cbc883/ubuntu/jammy/flavors/default jammy/main amd64 libradosstriper1 amd64 18.0.0-7520-g43dd94c1-1jammy [439 kB] 2023-11-28T19:55:24.029 INFO:teuthology.orchestra.run.smithi179.stdout:Get:102 https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102914/43dd94c190073cf16cff1e711dd7f5a7b1cbc883/ubuntu/jammy/flavors/default jammy/main amd64 ceph-common amd64 18.0.0-7520-g43dd94c1-1jammy [22.6 MB] 2023-11-28T19:55:24.088 INFO:teuthology.orchestra.run.smithi078.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy/universe amd64 librdkafka1 amd64 1.8.0-1build1 [633 kB] 2023-11-28T19:55:24.217 INFO:teuthology.orchestra.run.smithi078.stdout:Get:15 https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102914/43dd94c190073cf16cff1e711dd7f5a7b1cbc883/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs2 amd64 18.0.0-7520-g43dd94c1-1jammy [691 kB] 2023-11-28T19:55:24.304 INFO:teuthology.orchestra.run.smithi078.stdout:Get:16 https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102914/43dd94c190073cf16cff1e711dd7f5a7b1cbc883/ubuntu/jammy/flavors/default jammy/main amd64 python3-rados amd64 18.0.0-7520-g43dd94c1-1jammy [356 kB] 2023-11-28T19:55:24.350 INFO:teuthology.orchestra.run.smithi078.stdout:Get:17 https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102914/43dd94c190073cf16cff1e711dd7f5a7b1cbc883/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-argparse all 18.0.0-7520-g43dd94c1-1jammy [32.8 kB] 2023-11-28T19:55:24.353 INFO:teuthology.orchestra.run.smithi078.stdout:Get:18 https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102914/43dd94c190073cf16cff1e711dd7f5a7b1cbc883/ubuntu/jammy/flavors/default jammy/main amd64 python3-cephfs amd64 18.0.0-7520-g43dd94c1-1jammy [180 kB] 2023-11-28T19:55:24.377 INFO:teuthology.orchestra.run.smithi078.stdout:Get:19 https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102914/43dd94c190073cf16cff1e711dd7f5a7b1cbc883/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-common all 18.0.0-7520-g43dd94c1-1jammy [63.5 kB] 2023-11-28T19:55:24.385 INFO:teuthology.orchestra.run.smithi078.stdout:Get:20 https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102914/43dd94c190073cf16cff1e711dd7f5a7b1cbc883/ubuntu/jammy/flavors/default jammy/main amd64 python3-rbd amd64 18.0.0-7520-g43dd94c1-1jammy [330 kB] 2023-11-28T19:55:24.425 INFO:teuthology.orchestra.run.smithi078.stdout:Get:21 https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102914/43dd94c190073cf16cff1e711dd7f5a7b1cbc883/ubuntu/jammy/flavors/default jammy/main amd64 librgw2 amd64 18.0.0-7520-g43dd94c1-1jammy [6,233 kB] 2023-11-28T19:55:24.672 INFO:teuthology.orchestra.run.smithi078.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy/main amd64 libreadline-dev amd64 8.1.2-1 [166 kB] 2023-11-28T19:55:24.686 INFO:teuthology.orchestra.run.smithi078.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblua5.3-dev amd64 5.3.6-1build1 [167 kB] 2023-11-28T19:55:24.702 INFO:teuthology.orchestra.run.smithi078.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua5.1 amd64 5.1.5-8.1build4 [94.6 kB] 2023-11-28T19:55:24.711 INFO:teuthology.orchestra.run.smithi078.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-any all 27ubuntu1 [5,034 B] 2023-11-28T19:55:24.712 INFO:teuthology.orchestra.run.smithi078.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 zip amd64 3.0-12build2 [176 kB] 2023-11-28T19:55:24.728 INFO:teuthology.orchestra.run.smithi078.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 unzip amd64 6.0-26ubuntu3.1 [174 kB] 2023-11-28T19:55:24.766 INFO:teuthology.orchestra.run.smithi078.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/universe amd64 luarocks all 3.8.0+dfsg1-1 [140 kB] 2023-11-28T19:55:24.779 INFO:teuthology.orchestra.run.smithi078.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 liboath0 amd64 2.6.7-3build1 [41.1 kB] 2023-11-28T19:55:24.783 INFO:teuthology.orchestra.run.smithi078.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.functools all 3.4.0-2 [9,030 B] 2023-11-28T19:55:24.783 INFO:teuthology.orchestra.run.smithi078.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-cheroot all 8.5.2+ds1-1ubuntu3.1 [71.1 kB] 2023-11-28T19:55:24.954 INFO:teuthology.orchestra.run.smithi078.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.classes all 3.2.1-3 [6,452 B] 2023-11-28T19:55:25.036 INFO:teuthology.orchestra.run.smithi078.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.text all 3.6.0-2 [8,716 B] 2023-11-28T19:55:25.045 INFO:teuthology.orchestra.run.smithi179.stdout:Get:103 https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102914/43dd94c190073cf16cff1e711dd7f5a7b1cbc883/ubuntu/jammy/flavors/default jammy/main amd64 ceph-base amd64 18.0.0-7520-g43dd94c1-1jammy [6,900 kB] 2023-11-28T19:55:25.053 INFO:teuthology.orchestra.run.smithi078.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.collections all 3.4.0-2 [11.4 kB] 2023-11-28T19:55:25.118 INFO:teuthology.orchestra.run.smithi078.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempora all 4.1.2-1 [14.8 kB] 2023-11-28T19:55:25.153 INFO:teuthology.orchestra.run.smithi078.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-portend all 3.0.0-1 [7,240 B] 2023-11-28T19:55:25.172 INFO:teuthology.orchestra.run.smithi078.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-zc.lockfile all 2.0-1 [8,980 B] 2023-11-28T19:55:25.202 INFO:teuthology.orchestra.run.smithi078.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cherrypy3 all 18.6.1-4 [208 kB] 2023-11-28T19:55:25.204 INFO:teuthology.orchestra.run.smithi078.stdout:Get:39 https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102914/43dd94c190073cf16cff1e711dd7f5a7b1cbc883/ubuntu/jammy/flavors/default jammy/main amd64 python3-rgw amd64 18.0.0-7520-g43dd94c1-1jammy [112 kB] 2023-11-28T19:55:25.218 INFO:teuthology.orchestra.run.smithi078.stdout:Get:40 https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102914/43dd94c190073cf16cff1e711dd7f5a7b1cbc883/ubuntu/jammy/flavors/default jammy/main amd64 libradosstriper1 amd64 18.0.0-7520-g43dd94c1-1jammy [439 kB] 2023-11-28T19:55:25.271 INFO:teuthology.orchestra.run.smithi078.stdout:Get:41 https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102914/43dd94c190073cf16cff1e711dd7f5a7b1cbc883/ubuntu/jammy/flavors/default jammy/main amd64 ceph-common amd64 18.0.0-7520-g43dd94c1-1jammy [22.6 MB] 2023-11-28T19:55:25.343 INFO:teuthology.orchestra.run.smithi179.stdout:Get:104 https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102914/43dd94c190073cf16cff1e711dd7f5a7b1cbc883/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-modules-core all 18.0.0-7520-g43dd94c1-1jammy [238 kB] 2023-11-28T19:55:25.351 INFO:teuthology.orchestra.run.smithi179.stdout:Get:105 https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102914/43dd94c190073cf16cff1e711dd7f5a7b1cbc883/ubuntu/jammy/flavors/default jammy/main amd64 libsqlite3-mod-ceph amd64 18.0.0-7520-g43dd94c1-1jammy [124 kB] 2023-11-28T19:55:25.357 INFO:teuthology.orchestra.run.smithi179.stdout:Get:106 https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102914/43dd94c190073cf16cff1e711dd7f5a7b1cbc883/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr amd64 18.0.0-7520-g43dd94c1-1jammy [1,496 kB] 2023-11-28T19:55:25.373 INFO:teuthology.orchestra.run.smithi078.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-natsort all 8.0.2-1 [35.3 kB] 2023-11-28T19:55:25.388 INFO:teuthology.orchestra.run.smithi078.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-logutils all 0.3.3-8 [17.6 kB] 2023-11-28T19:55:25.395 INFO:teuthology.orchestra.run.smithi078.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-markupsafe amd64 2.0.1-2build1 [12.7 kB] 2023-11-28T19:55:25.400 INFO:teuthology.orchestra.run.smithi078.stdout:Get:45 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-mako all 1.1.3+ds1-2ubuntu0.1 [60.5 kB] 2023-11-28T19:55:25.423 INFO:teuthology.orchestra.run.smithi179.stdout:Get:107 https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102914/43dd94c190073cf16cff1e711dd7f5a7b1cbc883/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mon amd64 18.0.0-7520-g43dd94c1-1jammy [9,956 kB] 2023-11-28T19:55:25.584 INFO:teuthology.orchestra.run.smithi078.stdout:Get:46 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2023-11-28T19:55:25.666 INFO:teuthology.orchestra.run.smithi078.stdout:Get:47 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-singledispatch all 3.4.0.3-3 [7,320 B] 2023-11-28T19:55:25.683 INFO:teuthology.orchestra.run.smithi078.stdout:Get:48 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webob all 1:1.8.6-1.1 [85.2 kB] 2023-11-28T19:55:25.866 INFO:teuthology.orchestra.run.smithi179.stdout:Get:108 https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102914/43dd94c190073cf16cff1e711dd7f5a7b1cbc883/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd amd64 18.0.0-7520-g43dd94c1-1jammy [31.9 MB] 2023-11-28T19:55:25.867 INFO:teuthology.orchestra.run.smithi078.stdout:Get:49 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-waitress all 1.4.4-1.1ubuntu1 [47.3 kB] 2023-11-28T19:55:25.918 INFO:teuthology.orchestra.run.smithi078.stdout:Get:50 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempita all 0.5.2-6ubuntu1 [15.1 kB] 2023-11-28T19:55:25.931 INFO:teuthology.orchestra.run.smithi078.stdout:Get:51 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-paste all 3.5.0+dfsg1-1 [456 kB] 2023-11-28T19:55:26.089 INFO:teuthology.orchestra.run.smithi078.stdout:Get:52 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-pastedeploy-tpl all 2.1.1-1 [4,892 B] 2023-11-28T19:55:26.090 INFO:teuthology.orchestra.run.smithi078.stdout:Get:53 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastedeploy all 2.1.1-1 [26.6 kB] 2023-11-28T19:55:26.094 INFO:teuthology.orchestra.run.smithi078.stdout:Get:54 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webtest all 2.0.35-1 [28.5 kB] 2023-11-28T19:55:26.099 INFO:teuthology.orchestra.run.smithi078.stdout:Get:55 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pecan all 1.3.3-4ubuntu2 [87.3 kB] 2023-11-28T19:55:26.114 INFO:teuthology.orchestra.run.smithi078.stdout:Get:56 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-certifi all 2020.6.20-1 [150 kB] 2023-11-28T19:55:26.300 INFO:teuthology.orchestra.run.smithi078.stdout:Get:57 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-idna all 3.3-1 [49.3 kB] 2023-11-28T19:55:26.565 INFO:teuthology.orchestra.run.smithi078.stdout:Get:58 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-urllib3 all 1.26.5-1~exp1ubuntu0.1 [98.2 kB] 2023-11-28T19:55:26.698 INFO:teuthology.orchestra.run.smithi078.stdout:Get:59 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-requests all 2.25.1+dfsg-2ubuntu0.1 [48.8 kB] 2023-11-28T19:55:26.741 INFO:teuthology.orchestra.run.smithi078.stdout:Get:60 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-werkzeug all 2.0.2+dfsg1-1ubuntu0.22.04.1 [181 kB] 2023-11-28T19:55:26.833 INFO:teuthology.orchestra.run.smithi078.stdout:Get:61 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-bcrypt amd64 3.2.0-1build1 [32.7 kB] 2023-11-28T19:55:26.841 INFO:teuthology.orchestra.run.smithi078.stdout:Get:62 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-openssl all 21.0.0-1 [45.2 kB] 2023-11-28T19:55:26.854 INFO:teuthology.orchestra.run.smithi078.stdout:Get:63 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-asyncssh all 2.5.0-1 [185 kB] 2023-11-28T19:55:26.896 INFO:teuthology.orchestra.run.smithi078.stdout:Get:64 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-babel-localedata all 2.8.0+dfsg.1-7 [4,982 kB] 2023-11-28T19:55:27.161 INFO:teuthology.orchestra.run.smithi078.stdout:Get:65 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-babel all 2.8.0+dfsg.1-7 [85.1 kB] 2023-11-28T19:55:27.162 INFO:teuthology.orchestra.run.smithi078.stdout:Get:66 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jinja2 all 3.0.3-1 [108 kB] 2023-11-28T19:55:27.163 INFO:teuthology.orchestra.run.smithi078.stdout:Get:67 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2023-11-28T19:55:27.299 INFO:teuthology.orchestra.run.smithi179.stdout:Get:109 https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102914/43dd94c190073cf16cff1e711dd7f5a7b1cbc883/ubuntu/jammy/flavors/default jammy/main amd64 ceph amd64 18.0.0-7520-g43dd94c1-1jammy [14.1 kB] 2023-11-28T19:55:27.299 INFO:teuthology.orchestra.run.smithi179.stdout:Get:110 https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102914/43dd94c190073cf16cff1e711dd7f5a7b1cbc883/ubuntu/jammy/flavors/default jammy/main amd64 ceph-fuse amd64 18.0.0-7520-g43dd94c1-1jammy [839 kB] 2023-11-28T19:55:27.327 INFO:teuthology.orchestra.run.smithi179.stdout:Get:111 https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102914/43dd94c190073cf16cff1e711dd7f5a7b1cbc883/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mds amd64 18.0.0-7520-g43dd94c1-1jammy [2,148 kB] 2023-11-28T19:55:27.327 INFO:teuthology.orchestra.run.smithi078.stdout:Get:68 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-routes all 2.5.1-1ubuntu1 [89.0 kB] 2023-11-28T19:55:27.423 INFO:teuthology.orchestra.run.smithi179.stdout:Get:112 https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102914/43dd94c190073cf16cff1e711dd7f5a7b1cbc883/ubuntu/jammy/flavors/default jammy/main amd64 cephadm amd64 18.0.0-7520-g43dd94c1-1jammy [801 kB] 2023-11-28T19:55:27.459 INFO:teuthology.orchestra.run.smithi179.stdout:Get:113 https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102914/43dd94c190073cf16cff1e711dd7f5a7b1cbc883/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-cephadm all 18.0.0-7520-g43dd94c1-1jammy [139 kB] 2023-11-28T19:55:27.465 INFO:teuthology.orchestra.run.smithi179.stdout:Get:114 https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102914/43dd94c190073cf16cff1e711dd7f5a7b1cbc883/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-dashboard all 18.0.0-7520-g43dd94c1-1jammy [1,900 kB] 2023-11-28T19:55:27.550 INFO:teuthology.orchestra.run.smithi179.stdout:Get:115 https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102914/43dd94c190073cf16cff1e711dd7f5a7b1cbc883/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-diskprediction-local all 18.0.0-7520-g43dd94c1-1jammy [8,625 kB] 2023-11-28T19:55:27.670 INFO:teuthology.orchestra.run.smithi078.stdout:Get:69 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn-lib amd64 0.23.2-5ubuntu6 [2,058 kB] 2023-11-28T19:55:27.941 INFO:teuthology.orchestra.run.smithi179.stdout:Get:116 https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102914/43dd94c190073cf16cff1e711dd7f5a7b1cbc883/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-k8sevents all 18.0.0-7520-g43dd94c1-1jammy [14.2 kB] 2023-11-28T19:55:27.941 INFO:teuthology.orchestra.run.smithi179.stdout:Get:117 https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102914/43dd94c190073cf16cff1e711dd7f5a7b1cbc883/ubuntu/jammy/flavors/default jammy/main amd64 ceph-test amd64 18.0.0-7520-g43dd94c1-1jammy [48.7 MB] 2023-11-28T19:55:28.070 INFO:teuthology.orchestra.run.smithi078.stdout:Get:70 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-joblib all 0.17.0-4ubuntu1 [204 kB] 2023-11-28T19:55:28.073 INFO:teuthology.orchestra.run.smithi078.stdout:Get:71 https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102914/43dd94c190073cf16cff1e711dd7f5a7b1cbc883/ubuntu/jammy/flavors/default jammy/main amd64 ceph-base amd64 18.0.0-7520-g43dd94c1-1jammy [6,900 kB] 2023-11-28T19:55:28.080 INFO:teuthology.orchestra.run.smithi078.stdout:Get:72 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-threadpoolctl all 3.1.0-1 [21.3 kB] 2023-11-28T19:55:28.081 INFO:teuthology.orchestra.run.smithi078.stdout:Get:73 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn all 0.23.2-5ubuntu6 [1,829 kB] 2023-11-28T19:55:28.150 INFO:teuthology.orchestra.run.smithi078.stdout:Get:74 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cachetools all 5.0.0-1 [9,722 B] 2023-11-28T19:55:28.150 INFO:teuthology.orchestra.run.smithi078.stdout:Get:75 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1 all 0.4.8-1 [50.9 kB] 2023-11-28T19:55:28.151 INFO:teuthology.orchestra.run.smithi078.stdout:Get:76 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1-modules all 0.2.1-1 [33.0 kB] 2023-11-28T19:55:28.151 INFO:teuthology.orchestra.run.smithi078.stdout:Get:77 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-rsa all 4.8-1 [28.4 kB] 2023-11-28T19:55:28.153 INFO:teuthology.orchestra.run.smithi078.stdout:Get:78 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-google-auth all 1.5.1-3 [35.7 kB] 2023-11-28T19:55:28.153 INFO:teuthology.orchestra.run.smithi078.stdout:Get:79 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-requests-oauthlib all 1.3.0+ds-0.1 [18.7 kB] 2023-11-28T19:55:28.318 INFO:teuthology.orchestra.run.smithi078.stdout:Get:80 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-websocket all 1.2.3-1 [34.7 kB] 2023-11-28T19:55:28.534 INFO:teuthology.orchestra.run.smithi078.stdout:Get:81 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-kubernetes all 12.0.1-1ubuntu1 [353 kB] 2023-11-28T19:55:28.863 INFO:teuthology.orchestra.run.smithi078.stdout:Get:82 http://archive.ubuntu.com/ubuntu jammy/main amd64 libonig5 amd64 6.9.7.1-2build1 [172 kB] 2023-11-28T19:55:28.904 INFO:teuthology.orchestra.run.smithi078.stdout:Get:83 https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102914/43dd94c190073cf16cff1e711dd7f5a7b1cbc883/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-modules-core all 18.0.0-7520-g43dd94c1-1jammy [238 kB] 2023-11-28T19:55:28.910 INFO:teuthology.orchestra.run.smithi078.stdout:Get:84 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjq1 amd64 1.6-2.1ubuntu3 [133 kB] 2023-11-28T19:55:28.934 INFO:teuthology.orchestra.run.smithi078.stdout:Get:85 https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102914/43dd94c190073cf16cff1e711dd7f5a7b1cbc883/ubuntu/jammy/flavors/default jammy/main amd64 libsqlite3-mod-ceph amd64 18.0.0-7520-g43dd94c1-1jammy [124 kB] 2023-11-28T19:55:28.936 INFO:teuthology.orchestra.run.smithi078.stdout:Get:86 http://archive.ubuntu.com/ubuntu jammy/main amd64 jq amd64 1.6-2.1ubuntu3 [52.5 kB] 2023-11-28T19:55:28.946 INFO:teuthology.orchestra.run.smithi078.stdout:Get:87 http://archive.ubuntu.com/ubuntu jammy/main amd64 socat amd64 1.7.4.1-3ubuntu4 [349 kB] 2023-11-28T19:55:28.947 INFO:teuthology.orchestra.run.smithi078.stdout:Get:88 https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102914/43dd94c190073cf16cff1e711dd7f5a7b1cbc883/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr amd64 18.0.0-7520-g43dd94c1-1jammy [1,496 kB] 2023-11-28T19:55:28.992 INFO:teuthology.orchestra.run.smithi078.stdout:Get:89 http://archive.ubuntu.com/ubuntu jammy/universe amd64 xmlstarlet amd64 1.6.1-2.1 [265 kB] 2023-11-28T19:55:29.017 INFO:teuthology.orchestra.run.smithi078.stdout:Get:90 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-colorama all 0.4.4-1 [24.5 kB] 2023-11-28T19:55:29.019 INFO:teuthology.orchestra.run.smithi078.stdout:Get:91 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-socket amd64 3.0~rc1+git+ac3201d-6 [78.9 kB] 2023-11-28T19:55:29.026 INFO:teuthology.orchestra.run.smithi078.stdout:Get:92 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-sec amd64 1.0.2-1 [37.6 kB] 2023-11-28T19:55:29.029 INFO:teuthology.orchestra.run.smithi078.stdout:Get:93 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 nvme-cli amd64 1.16-3ubuntu0.1 [474 kB] 2023-11-28T19:55:29.127 INFO:teuthology.orchestra.run.smithi078.stdout:Get:94 https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102914/43dd94c190073cf16cff1e711dd7f5a7b1cbc883/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mon amd64 18.0.0-7520-g43dd94c1-1jammy [9,956 kB] 2023-11-28T19:55:29.225 INFO:teuthology.orchestra.run.smithi078.stdout:Get:95 http://archive.ubuntu.com/ubuntu jammy/main amd64 pkg-config amd64 0.29.2-1ubuntu3 [48.2 kB] 2023-11-28T19:55:29.478 INFO:teuthology.orchestra.run.smithi078.stdout:Get:96 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python-asyncssh-doc all 2.5.0-1 [318 kB] 2023-11-28T19:55:29.745 INFO:teuthology.orchestra.run.smithi078.stdout:Get:97 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-iniconfig all 1.1.1-2 [6,024 B] 2023-11-28T19:55:29.748 INFO:teuthology.orchestra.run.smithi078.stdout:Get:98 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2023-11-28T19:55:29.763 INFO:teuthology.orchestra.run.smithi078.stdout:Get:99 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pluggy all 0.13.0-7.1 [19.0 kB] 2023-11-28T19:55:29.769 INFO:teuthology.orchestra.run.smithi078.stdout:Get:100 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-psutil amd64 5.9.0-1build1 [158 kB] 2023-11-28T19:55:29.808 INFO:teuthology.orchestra.run.smithi078.stdout:Get:101 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-py all 1.10.0-1 [71.9 kB] 2023-11-28T19:55:29.823 INFO:teuthology.orchestra.run.smithi078.stdout:Get:102 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pygments all 2.11.2+dfsg-2 [750 kB] 2023-11-28T19:55:29.913 INFO:teuthology.orchestra.run.smithi078.stdout:Get:103 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyinotify all 0.9.6-1.3 [24.8 kB] 2023-11-28T19:55:29.915 INFO:teuthology.orchestra.run.smithi078.stdout:Get:104 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-toml all 0.10.2-1 [16.5 kB] 2023-11-28T19:55:29.916 INFO:teuthology.orchestra.run.smithi078.stdout:Get:105 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pytest all 6.2.5-1ubuntu2 [214 kB] 2023-11-28T19:55:30.097 INFO:teuthology.orchestra.run.smithi078.stdout:Get:106 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplejson amd64 3.17.6-1build1 [54.7 kB] 2023-11-28T19:55:30.129 INFO:teuthology.orchestra.run.smithi078.stdout:Get:107 https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102914/43dd94c190073cf16cff1e711dd7f5a7b1cbc883/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd amd64 18.0.0-7520-g43dd94c1-1jammy [31.9 MB] 2023-11-28T19:55:30.231 INFO:teuthology.orchestra.run.smithi179.stdout:Get:118 https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102914/43dd94c190073cf16cff1e711dd7f5a7b1cbc883/ubuntu/jammy/flavors/default jammy/main amd64 ceph-volume all 18.0.0-7520-g43dd94c1-1jammy [121 kB] 2023-11-28T19:55:30.232 INFO:teuthology.orchestra.run.smithi179.stdout:Get:119 https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102914/43dd94c190073cf16cff1e711dd7f5a7b1cbc883/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-mirror amd64 18.0.0-7520-g43dd94c1-1jammy [225 kB] 2023-11-28T19:55:30.234 INFO:teuthology.orchestra.run.smithi179.stdout:Get:120 https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102914/43dd94c190073cf16cff1e711dd7f5a7b1cbc883/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-shell all 18.0.0-7520-g43dd94c1-1jammy [34.0 kB] 2023-11-28T19:55:30.234 INFO:teuthology.orchestra.run.smithi179.stdout:Get:121 https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102914/43dd94c190073cf16cff1e711dd7f5a7b1cbc883/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-top all 18.0.0-7520-g43dd94c1-1jammy [23.4 kB] 2023-11-28T19:55:30.235 INFO:teuthology.orchestra.run.smithi179.stdout:Get:122 https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102914/43dd94c190073cf16cff1e711dd7f5a7b1cbc883/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-dev amd64 18.0.0-7520-g43dd94c1-1jammy [38.4 kB] 2023-11-28T19:55:30.236 INFO:teuthology.orchestra.run.smithi179.stdout:Get:123 https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102914/43dd94c190073cf16cff1e711dd7f5a7b1cbc883/ubuntu/jammy/flavors/default jammy/main amd64 radosgw amd64 18.0.0-7520-g43dd94c1-1jammy [12.3 MB] 2023-11-28T19:55:30.370 INFO:teuthology.orchestra.run.smithi078.stdout:Get:108 http://archive.ubuntu.com/ubuntu jammy/universe amd64 qttranslations5-l10n all 5.15.3-1 [1,983 kB] 2023-11-28T19:55:30.888 INFO:teuthology.orchestra.run.smithi179.stdout:Get:124 https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102914/43dd94c190073cf16cff1e711dd7f5a7b1cbc883/ubuntu/jammy/flavors/default jammy/main amd64 rbd-fuse amd64 18.0.0-7520-g43dd94c1-1jammy [91.2 kB] 2023-11-28T19:55:31.527 INFO:teuthology.orchestra.run.smithi179.stdout:Fetched 187 MB in 8s (23.8 MB/s) 2023-11-28T19:55:31.643 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package python3-pyperclip. 2023-11-28T19:55:31.711 INFO:teuthology.orchestra.run.smithi179.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 132930 files and directories currently installed.) 2023-11-28T19:55:31.715 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../000-python3-pyperclip_1.8.2-2_all.deb ... 2023-11-28T19:55:31.775 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking python3-pyperclip (1.8.2-2) ... 2023-11-28T19:55:31.954 INFO:teuthology.orchestra.run.smithi078.stdout:Get:109 https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102914/43dd94c190073cf16cff1e711dd7f5a7b1cbc883/ubuntu/jammy/flavors/default jammy/main amd64 ceph amd64 18.0.0-7520-g43dd94c1-1jammy [14.1 kB] 2023-11-28T19:55:31.954 INFO:teuthology.orchestra.run.smithi078.stdout:Get:110 https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102914/43dd94c190073cf16cff1e711dd7f5a7b1cbc883/ubuntu/jammy/flavors/default jammy/main amd64 ceph-fuse amd64 18.0.0-7520-g43dd94c1-1jammy [839 kB] 2023-11-28T19:55:31.990 INFO:teuthology.orchestra.run.smithi078.stdout:Get:111 https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102914/43dd94c190073cf16cff1e711dd7f5a7b1cbc883/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mds amd64 18.0.0-7520-g43dd94c1-1jammy [2,148 kB] 2023-11-28T19:55:31.994 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package python3-wcwidth. 2023-11-28T19:55:32.007 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../001-python3-wcwidth_0.2.5+dfsg1-1_all.deb ... 2023-11-28T19:55:32.044 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking python3-wcwidth (0.2.5+dfsg1-1) ... 2023-11-28T19:55:32.074 INFO:teuthology.orchestra.run.smithi078.stdout:Get:112 https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102914/43dd94c190073cf16cff1e711dd7f5a7b1cbc883/ubuntu/jammy/flavors/default jammy/main amd64 cephadm amd64 18.0.0-7520-g43dd94c1-1jammy [801 kB] 2023-11-28T19:55:32.109 INFO:teuthology.orchestra.run.smithi078.stdout:Get:113 https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102914/43dd94c190073cf16cff1e711dd7f5a7b1cbc883/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-cephadm all 18.0.0-7520-g43dd94c1-1jammy [139 kB] 2023-11-28T19:55:32.120 INFO:teuthology.orchestra.run.smithi078.stdout:Get:114 https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102914/43dd94c190073cf16cff1e711dd7f5a7b1cbc883/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-dashboard all 18.0.0-7520-g43dd94c1-1jammy [1,900 kB] 2023-11-28T19:55:32.207 INFO:teuthology.orchestra.run.smithi078.stdout:Get:115 https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102914/43dd94c190073cf16cff1e711dd7f5a7b1cbc883/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-diskprediction-local all 18.0.0-7520-g43dd94c1-1jammy [8,625 kB] 2023-11-28T19:55:32.355 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package python3-cmd2. 2023-11-28T19:55:32.368 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../002-python3-cmd2_2.3.3-1_all.deb ... 2023-11-28T19:55:32.413 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking python3-cmd2 (2.3.3-1) ... 2023-11-28T19:55:32.600 INFO:teuthology.orchestra.run.smithi078.stdout:Get:116 https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102914/43dd94c190073cf16cff1e711dd7f5a7b1cbc883/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-k8sevents all 18.0.0-7520-g43dd94c1-1jammy [14.2 kB] 2023-11-28T19:55:32.600 INFO:teuthology.orchestra.run.smithi078.stdout:Get:117 https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102914/43dd94c190073cf16cff1e711dd7f5a7b1cbc883/ubuntu/jammy/flavors/default jammy/main amd64 ceph-test amd64 18.0.0-7520-g43dd94c1-1jammy [48.7 MB] 2023-11-28T19:55:32.792 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package liblttng-ust1:amd64. 2023-11-28T19:55:32.805 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../003-liblttng-ust1_2.13.1-1ubuntu1_amd64.deb ... 2023-11-28T19:55:32.892 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2023-11-28T19:55:33.212 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2023-11-28T19:55:33.226 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../004-libdouble-conversion3_3.1.7-4_amd64.deb ... 2023-11-28T19:55:33.270 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking libdouble-conversion3:amd64 (3.1.7-4) ... 2023-11-28T19:55:33.606 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2023-11-28T19:55:33.621 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../005-libpcre2-16-0_10.39-3ubuntu0.1_amd64.deb ... 2023-11-28T19:55:33.656 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2023-11-28T19:55:34.110 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package libqt5core5a:amd64. 2023-11-28T19:55:34.125 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../006-libqt5core5a_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2023-11-28T19:55:34.176 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-11-28T19:55:34.588 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2023-11-28T19:55:34.605 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../007-libqt5dbus5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2023-11-28T19:55:34.646 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-11-28T19:55:34.833 INFO:teuthology.orchestra.run.smithi078.stdout:Get:118 https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102914/43dd94c190073cf16cff1e711dd7f5a7b1cbc883/ubuntu/jammy/flavors/default jammy/main amd64 ceph-volume all 18.0.0-7520-g43dd94c1-1jammy [121 kB] 2023-11-28T19:55:34.833 INFO:teuthology.orchestra.run.smithi078.stdout:Get:119 https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102914/43dd94c190073cf16cff1e711dd7f5a7b1cbc883/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-mirror amd64 18.0.0-7520-g43dd94c1-1jammy [225 kB] 2023-11-28T19:55:34.840 INFO:teuthology.orchestra.run.smithi078.stdout:Get:120 https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102914/43dd94c190073cf16cff1e711dd7f5a7b1cbc883/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-shell all 18.0.0-7520-g43dd94c1-1jammy [34.0 kB] 2023-11-28T19:55:34.841 INFO:teuthology.orchestra.run.smithi078.stdout:Get:121 https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102914/43dd94c190073cf16cff1e711dd7f5a7b1cbc883/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-top all 18.0.0-7520-g43dd94c1-1jammy [23.4 kB] 2023-11-28T19:55:34.844 INFO:teuthology.orchestra.run.smithi078.stdout:Get:122 https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102914/43dd94c190073cf16cff1e711dd7f5a7b1cbc883/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-dev amd64 18.0.0-7520-g43dd94c1-1jammy [38.4 kB] 2023-11-28T19:55:34.845 INFO:teuthology.orchestra.run.smithi078.stdout:Get:123 https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102914/43dd94c190073cf16cff1e711dd7f5a7b1cbc883/ubuntu/jammy/flavors/default jammy/main amd64 radosgw amd64 18.0.0-7520-g43dd94c1-1jammy [12.3 MB] 2023-11-28T19:55:34.982 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package libqt5network5:amd64. 2023-11-28T19:55:34.997 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../008-libqt5network5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2023-11-28T19:55:35.040 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-11-28T19:55:35.377 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package libthrift-0.16.0:amd64. 2023-11-28T19:55:35.389 INFO:teuthology.orchestra.run.smithi078.stdout:Get:124 https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102914/43dd94c190073cf16cff1e711dd7f5a7b1cbc883/ubuntu/jammy/flavors/default jammy/main amd64 rbd-fuse amd64 18.0.0-7520-g43dd94c1-1jammy [91.2 kB] 2023-11-28T19:55:35.392 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../009-libthrift-0.16.0_0.16.0-2_amd64.deb ... 2023-11-28T19:55:35.435 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking libthrift-0.16.0:amd64 (0.16.0-2) ... 2023-11-28T19:55:35.997 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package librados2. 2023-11-28T19:55:36.011 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../010-librados2_18.0.0-7520-g43dd94c1-1jammy_amd64.deb ... 2023-11-28T19:55:36.028 INFO:teuthology.orchestra.run.smithi078.stdout:Fetched 187 MB in 12s (15.1 MB/s) 2023-11-28T19:55:36.055 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking librados2 (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T19:55:36.176 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-pyperclip. 2023-11-28T19:55:36.245 INFO:teuthology.orchestra.run.smithi078.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 132930 files and directories currently installed.) 2023-11-28T19:55:36.248 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../000-python3-pyperclip_1.8.2-2_all.deb ... 2023-11-28T19:55:36.283 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-pyperclip (1.8.2-2) ... 2023-11-28T19:55:36.474 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package librbd1. 2023-11-28T19:55:36.489 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../011-librbd1_18.0.0-7520-g43dd94c1-1jammy_amd64.deb ... 2023-11-28T19:55:36.518 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-wcwidth. 2023-11-28T19:55:36.532 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../001-python3-wcwidth_0.2.5+dfsg1-1_all.deb ... 2023-11-28T19:55:36.532 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking librbd1 (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T19:55:36.560 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-wcwidth (0.2.5+dfsg1-1) ... 2023-11-28T19:55:36.871 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-cmd2. 2023-11-28T19:55:36.884 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../002-python3-cmd2_2.3.3-1_all.deb ... 2023-11-28T19:55:36.921 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-cmd2 (2.3.3-1) ... 2023-11-28T19:55:36.969 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package libcephfs2. 2023-11-28T19:55:36.989 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../012-libcephfs2_18.0.0-7520-g43dd94c1-1jammy_amd64.deb ... 2023-11-28T19:55:37.027 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking libcephfs2 (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T19:55:37.296 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package python3-rados. 2023-11-28T19:55:37.299 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package liblttng-ust1:amd64. 2023-11-28T19:55:37.310 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../013-python3-rados_18.0.0-7520-g43dd94c1-1jammy_amd64.deb ... 2023-11-28T19:55:37.313 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../003-liblttng-ust1_2.13.1-1ubuntu1_amd64.deb ... 2023-11-28T19:55:37.346 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking python3-rados (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T19:55:37.399 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2023-11-28T19:55:37.641 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package python3-ceph-argparse. 2023-11-28T19:55:37.654 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../014-python3-ceph-argparse_18.0.0-7520-g43dd94c1-1jammy_all.deb ... 2023-11-28T19:55:37.732 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking python3-ceph-argparse (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T19:55:37.736 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2023-11-28T19:55:37.750 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../004-libdouble-conversion3_3.1.7-4_amd64.deb ... 2023-11-28T19:55:37.794 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking libdouble-conversion3:amd64 (3.1.7-4) ... 2023-11-28T19:55:37.985 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package python3-cephfs. 2023-11-28T19:55:37.999 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../015-python3-cephfs_18.0.0-7520-g43dd94c1-1jammy_amd64.deb ... 2023-11-28T19:55:38.043 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking python3-cephfs (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T19:55:38.113 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2023-11-28T19:55:38.128 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../005-libpcre2-16-0_10.39-3ubuntu0.1_amd64.deb ... 2023-11-28T19:55:38.172 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2023-11-28T19:55:38.346 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package python3-ceph-common. 2023-11-28T19:55:38.361 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../016-python3-ceph-common_18.0.0-7520-g43dd94c1-1jammy_all.deb ... 2023-11-28T19:55:38.404 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking python3-ceph-common (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T19:55:38.608 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package libqt5core5a:amd64. 2023-11-28T19:55:38.624 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../006-libqt5core5a_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2023-11-28T19:55:38.675 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-11-28T19:55:38.740 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package python3-prettytable. 2023-11-28T19:55:38.755 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../017-python3-prettytable_2.5.0-2_all.deb ... 2023-11-28T19:55:38.790 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking python3-prettytable (2.5.0-2) ... 2023-11-28T19:55:39.026 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package python3-rbd. 2023-11-28T19:55:39.041 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../018-python3-rbd_18.0.0-7520-g43dd94c1-1jammy_amd64.deb ... 2023-11-28T19:55:39.085 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking python3-rbd (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T19:55:39.120 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2023-11-28T19:55:39.134 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../007-libqt5dbus5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2023-11-28T19:55:39.178 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-11-28T19:55:39.429 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package librdkafka1:amd64. 2023-11-28T19:55:39.444 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../019-librdkafka1_1.8.0-1build1_amd64.deb ... 2023-11-28T19:55:39.481 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package libqt5network5:amd64. 2023-11-28T19:55:39.487 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking librdkafka1:amd64 (1.8.0-1build1) ... 2023-11-28T19:55:39.495 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../008-libqt5network5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2023-11-28T19:55:39.548 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-11-28T19:55:39.790 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package libreadline-dev:amd64. 2023-11-28T19:55:39.805 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../020-libreadline-dev_8.1.2-1_amd64.deb ... 2023-11-28T19:55:39.848 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking libreadline-dev:amd64 (8.1.2-1) ... 2023-11-28T19:55:39.950 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package libthrift-0.16.0:amd64. 2023-11-28T19:55:39.965 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../009-libthrift-0.16.0_0.16.0-2_amd64.deb ... 2023-11-28T19:55:40.009 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking libthrift-0.16.0:amd64 (0.16.0-2) ... 2023-11-28T19:55:40.134 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package liblua5.3-dev:amd64. 2023-11-28T19:55:40.150 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../021-liblua5.3-dev_5.3.6-1build1_amd64.deb ... 2023-11-28T19:55:40.184 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking liblua5.3-dev:amd64 (5.3.6-1build1) ... 2023-11-28T19:55:40.320 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package librados2. 2023-11-28T19:55:40.334 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../010-librados2_18.0.0-7520-g43dd94c1-1jammy_amd64.deb ... 2023-11-28T19:55:40.378 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking librados2 (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T19:55:40.496 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package lua5.1. 2023-11-28T19:55:40.511 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../022-lua5.1_5.1.5-8.1build4_amd64.deb ... 2023-11-28T19:55:40.554 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking lua5.1 (5.1.5-8.1build4) ... 2023-11-28T19:55:40.822 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package librbd1. 2023-11-28T19:55:40.837 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../011-librbd1_18.0.0-7520-g43dd94c1-1jammy_amd64.deb ... 2023-11-28T19:55:40.872 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking librbd1 (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T19:55:40.915 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package lua-any. 2023-11-28T19:55:40.930 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../023-lua-any_27ubuntu1_all.deb ... 2023-11-28T19:55:40.974 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking lua-any (27ubuntu1) ... 2023-11-28T19:55:41.227 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package zip. 2023-11-28T19:55:41.241 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../024-zip_3.0-12build2_amd64.deb ... 2023-11-28T19:55:41.276 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking zip (3.0-12build2) ... 2023-11-28T19:55:41.292 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package libcephfs2. 2023-11-28T19:55:41.306 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../012-libcephfs2_18.0.0-7520-g43dd94c1-1jammy_amd64.deb ... 2023-11-28T19:55:41.350 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking libcephfs2 (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T19:55:41.546 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package unzip. 2023-11-28T19:55:41.562 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../025-unzip_6.0-26ubuntu3.1_amd64.deb ... 2023-11-28T19:55:41.638 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking unzip (6.0-26ubuntu3.1) ... 2023-11-28T19:55:41.652 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-rados. 2023-11-28T19:55:41.666 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../013-python3-rados_18.0.0-7520-g43dd94c1-1jammy_amd64.deb ... 2023-11-28T19:55:41.711 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-rados (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T19:55:42.025 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package luarocks. 2023-11-28T19:55:42.030 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-ceph-argparse. 2023-11-28T19:55:42.040 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../026-luarocks_3.8.0+dfsg1-1_all.deb ... 2023-11-28T19:55:42.044 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../014-python3-ceph-argparse_18.0.0-7520-g43dd94c1-1jammy_all.deb ... 2023-11-28T19:55:42.083 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking luarocks (3.8.0+dfsg1-1) ... 2023-11-28T19:55:42.088 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-ceph-argparse (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T19:55:42.357 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-cephfs. 2023-11-28T19:55:42.372 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../015-python3-cephfs_18.0.0-7520-g43dd94c1-1jammy_amd64.deb ... 2023-11-28T19:55:42.432 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-cephfs (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T19:55:42.491 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package librgw2. 2023-11-28T19:55:42.505 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../027-librgw2_18.0.0-7520-g43dd94c1-1jammy_amd64.deb ... 2023-11-28T19:55:42.549 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking librgw2 (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T19:55:42.718 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-ceph-common. 2023-11-28T19:55:42.733 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../016-python3-ceph-common_18.0.0-7520-g43dd94c1-1jammy_all.deb ... 2023-11-28T19:55:42.776 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-ceph-common (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T19:55:43.010 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package python3-rgw. 2023-11-28T19:55:43.024 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../028-python3-rgw_18.0.0-7520-g43dd94c1-1jammy_amd64.deb ... 2023-11-28T19:55:43.068 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking python3-rgw (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T19:55:43.096 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-prettytable. 2023-11-28T19:55:43.110 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../017-python3-prettytable_2.5.0-2_all.deb ... 2023-11-28T19:55:43.154 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-prettytable (2.5.0-2) ... 2023-11-28T19:55:43.388 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package liboath0:amd64. 2023-11-28T19:55:43.402 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../029-liboath0_2.6.7-3build1_amd64.deb ... 2023-11-28T19:55:43.440 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-rbd. 2023-11-28T19:55:43.446 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking liboath0:amd64 (2.6.7-3build1) ... 2023-11-28T19:55:43.454 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../018-python3-rbd_18.0.0-7520-g43dd94c1-1jammy_amd64.deb ... 2023-11-28T19:55:43.498 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-rbd (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T19:55:43.749 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package libradosstriper1. 2023-11-28T19:55:43.764 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../030-libradosstriper1_18.0.0-7520-g43dd94c1-1jammy_amd64.deb ... 2023-11-28T19:55:43.799 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking libradosstriper1 (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T19:55:43.843 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package librdkafka1:amd64. 2023-11-28T19:55:43.857 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../019-librdkafka1_1.8.0-1build1_amd64.deb ... 2023-11-28T19:55:43.892 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking librdkafka1:amd64 (1.8.0-1build1) ... 2023-11-28T19:55:44.145 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package libreadline-dev:amd64. 2023-11-28T19:55:44.160 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../020-libreadline-dev_8.1.2-1_amd64.deb ... 2023-11-28T19:55:44.202 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package ceph-common. 2023-11-28T19:55:44.217 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../031-ceph-common_18.0.0-7520-g43dd94c1-1jammy_amd64.deb ... 2023-11-28T19:55:44.237 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking libreadline-dev:amd64 (8.1.2-1) ... 2023-11-28T19:55:44.260 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking ceph-common (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T19:55:44.539 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package liblua5.3-dev:amd64. 2023-11-28T19:55:44.554 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../021-liblua5.3-dev_5.3.6-1build1_amd64.deb ... 2023-11-28T19:55:44.597 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking liblua5.3-dev:amd64 (5.3.6-1build1) ... 2023-11-28T19:55:44.934 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package lua5.1. 2023-11-28T19:55:44.949 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../022-lua5.1_5.1.5-8.1build4_amd64.deb ... 2023-11-28T19:55:44.992 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking lua5.1 (5.1.5-8.1build4) ... 2023-11-28T19:55:45.329 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package lua-any. 2023-11-28T19:55:45.343 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../023-lua-any_27ubuntu1_all.deb ... 2023-11-28T19:55:45.349 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package ceph-base. 2023-11-28T19:55:45.364 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../032-ceph-base_18.0.0-7520-g43dd94c1-1jammy_amd64.deb ... 2023-11-28T19:55:45.378 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking lua-any (27ubuntu1) ... 2023-11-28T19:55:45.417 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking ceph-base (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T19:55:45.598 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package zip. 2023-11-28T19:55:45.612 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../024-zip_3.0-12build2_amd64.deb ... 2023-11-28T19:55:45.656 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking zip (3.0-12build2) ... 2023-11-28T19:55:45.967 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package unzip. 2023-11-28T19:55:45.982 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../025-unzip_6.0-26ubuntu3.1_amd64.deb ... 2023-11-28T19:55:46.042 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking unzip (6.0-26ubuntu3.1) ... 2023-11-28T19:55:46.295 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package python3-jaraco.functools. 2023-11-28T19:55:46.310 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../033-python3-jaraco.functools_3.4.0-2_all.deb ... 2023-11-28T19:55:46.353 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking python3-jaraco.functools (3.4.0-2) ... 2023-11-28T19:55:46.429 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package luarocks. 2023-11-28T19:55:46.444 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../026-luarocks_3.8.0+dfsg1-1_all.deb ... 2023-11-28T19:55:46.488 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking luarocks (3.8.0+dfsg1-1) ... 2023-11-28T19:55:46.623 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package python3-cheroot. 2023-11-28T19:55:46.637 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../034-python3-cheroot_8.5.2+ds1-1ubuntu3.1_all.deb ... 2023-11-28T19:55:46.706 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2023-11-28T19:55:46.911 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package librgw2. 2023-11-28T19:55:46.925 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../027-librgw2_18.0.0-7520-g43dd94c1-1jammy_amd64.deb ... 2023-11-28T19:55:46.961 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking librgw2 (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T19:55:47.043 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package python3-jaraco.classes. 2023-11-28T19:55:47.057 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../035-python3-jaraco.classes_3.2.1-3_all.deb ... 2023-11-28T19:55:47.101 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking python3-jaraco.classes (3.2.1-3) ... 2023-11-28T19:55:47.404 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package python3-jaraco.text. 2023-11-28T19:55:47.405 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-rgw. 2023-11-28T19:55:47.419 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../036-python3-jaraco.text_3.6.0-2_all.deb ... 2023-11-28T19:55:47.419 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../028-python3-rgw_18.0.0-7520-g43dd94c1-1jammy_amd64.deb ... 2023-11-28T19:55:47.462 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking python3-jaraco.text (3.6.0-2) ... 2023-11-28T19:55:47.463 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-rgw (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T19:55:47.756 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package python3-jaraco.collections. 2023-11-28T19:55:47.772 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../037-python3-jaraco.collections_3.4.0-2_all.deb ... 2023-11-28T19:55:47.806 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking python3-jaraco.collections (3.4.0-2) ... 2023-11-28T19:55:47.825 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package liboath0:amd64. 2023-11-28T19:55:47.840 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../029-liboath0_2.6.7-3build1_amd64.deb ... 2023-11-28T19:55:47.883 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking liboath0:amd64 (2.6.7-3build1) ... 2023-11-28T19:55:48.084 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package python3-tempora. 2023-11-28T19:55:48.100 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../038-python3-tempora_4.1.2-1_all.deb ... 2023-11-28T19:55:48.143 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking python3-tempora (4.1.2-1) ... 2023-11-28T19:55:48.186 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package libradosstriper1. 2023-11-28T19:55:48.201 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../030-libradosstriper1_18.0.0-7520-g43dd94c1-1jammy_amd64.deb ... 2023-11-28T19:55:48.244 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking libradosstriper1 (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T19:55:48.445 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package python3-portend. 2023-11-28T19:55:48.460 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../039-python3-portend_3.0.0-1_all.deb ... 2023-11-28T19:55:48.504 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking python3-portend (3.0.0-1) ... 2023-11-28T19:55:48.606 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package ceph-common. 2023-11-28T19:55:48.620 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../031-ceph-common_18.0.0-7520-g43dd94c1-1jammy_amd64.deb ... 2023-11-28T19:55:48.664 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking ceph-common (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T19:55:48.840 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package python3-zc.lockfile. 2023-11-28T19:55:48.855 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../040-python3-zc.lockfile_2.0-1_all.deb ... 2023-11-28T19:55:48.898 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking python3-zc.lockfile (2.0-1) ... 2023-11-28T19:55:49.160 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package python3-cherrypy3. 2023-11-28T19:55:49.175 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../041-python3-cherrypy3_18.6.1-4_all.deb ... 2023-11-28T19:55:49.218 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking python3-cherrypy3 (18.6.1-4) ... 2023-11-28T19:55:49.538 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package python3-natsort. 2023-11-28T19:55:49.553 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../042-python3-natsort_8.0.2-1_all.deb ... 2023-11-28T19:55:49.613 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking python3-natsort (8.0.2-1) ... 2023-11-28T19:55:49.635 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package ceph-base. 2023-11-28T19:55:49.650 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../032-ceph-base_18.0.0-7520-g43dd94c1-1jammy_amd64.deb ... 2023-11-28T19:55:49.694 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking ceph-base (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T19:55:49.899 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package python3-logutils. 2023-11-28T19:55:49.914 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../043-python3-logutils_0.3.3-8_all.deb ... 2023-11-28T19:55:49.949 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking python3-logutils (0.3.3-8) ... 2023-11-28T19:55:50.219 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package python3-markupsafe. 2023-11-28T19:55:50.233 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../044-python3-markupsafe_2.0.1-2build1_amd64.deb ... 2023-11-28T19:55:50.277 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking python3-markupsafe (2.0.1-2build1) ... 2023-11-28T19:55:50.605 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package python3-mako. 2023-11-28T19:55:50.620 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../045-python3-mako_1.1.3+ds1-2ubuntu0.1_all.deb ... 2023-11-28T19:55:50.663 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2023-11-28T19:55:50.698 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-jaraco.functools. 2023-11-28T19:55:50.712 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../033-python3-jaraco.functools_3.4.0-2_all.deb ... 2023-11-28T19:55:50.756 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-jaraco.functools (3.4.0-2) ... 2023-11-28T19:55:51.000 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package python3-simplegeneric. 2023-11-28T19:55:51.015 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../046-python3-simplegeneric_0.8.1-3_all.deb ... 2023-11-28T19:55:51.058 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2023-11-28T19:55:51.261 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-cheroot. 2023-11-28T19:55:51.276 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../034-python3-cheroot_8.5.2+ds1-1ubuntu3.1_all.deb ... 2023-11-28T19:55:51.320 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2023-11-28T19:55:51.361 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package python3-singledispatch. 2023-11-28T19:55:51.376 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../047-python3-singledispatch_3.4.0.3-3_all.deb ... 2023-11-28T19:55:51.411 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking python3-singledispatch (3.4.0.3-3) ... 2023-11-28T19:55:51.648 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-jaraco.classes. 2023-11-28T19:55:51.662 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../035-python3-jaraco.classes_3.2.1-3_all.deb ... 2023-11-28T19:55:51.698 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-jaraco.classes (3.2.1-3) ... 2023-11-28T19:55:51.713 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package python3-webob. 2023-11-28T19:55:51.729 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../048-python3-webob_1%3a1.8.6-1.1_all.deb ... 2023-11-28T19:55:51.772 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking python3-webob (1:1.8.6-1.1) ... 2023-11-28T19:55:51.968 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-jaraco.text. 2023-11-28T19:55:51.982 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../036-python3-jaraco.text_3.6.0-2_all.deb ... 2023-11-28T19:55:52.026 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-jaraco.text (3.6.0-2) ... 2023-11-28T19:55:52.083 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package python3-waitress. 2023-11-28T19:55:52.098 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../049-python3-waitress_1.4.4-1.1ubuntu1_all.deb ... 2023-11-28T19:55:52.144 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking python3-waitress (1.4.4-1.1ubuntu1) ... 2023-11-28T19:55:52.337 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-jaraco.collections. 2023-11-28T19:55:52.352 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../037-python3-jaraco.collections_3.4.0-2_all.deb ... 2023-11-28T19:55:52.395 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-jaraco.collections (3.4.0-2) ... 2023-11-28T19:55:52.461 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package python3-tempita. 2023-11-28T19:55:52.476 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../050-python3-tempita_0.5.2-6ubuntu1_all.deb ... 2023-11-28T19:55:52.544 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking python3-tempita (0.5.2-6ubuntu1) ... 2023-11-28T19:55:52.698 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-tempora. 2023-11-28T19:55:52.713 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../038-python3-tempora_4.1.2-1_all.deb ... 2023-11-28T19:55:52.757 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-tempora (4.1.2-1) ... 2023-11-28T19:55:52.847 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package python3-paste. 2023-11-28T19:55:52.862 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../051-python3-paste_3.5.0+dfsg1-1_all.deb ... 2023-11-28T19:55:52.905 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking python3-paste (3.5.0+dfsg1-1) ... 2023-11-28T19:55:53.026 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-portend. 2023-11-28T19:55:53.041 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../039-python3-portend_3.0.0-1_all.deb ... 2023-11-28T19:55:53.085 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-portend (3.0.0-1) ... 2023-11-28T19:55:53.233 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2023-11-28T19:55:53.249 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../052-python-pastedeploy-tpl_2.1.1-1_all.deb ... 2023-11-28T19:55:53.291 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking python-pastedeploy-tpl (2.1.1-1) ... 2023-11-28T19:55:53.413 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-zc.lockfile. 2023-11-28T19:55:53.427 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../040-python3-zc.lockfile_2.0-1_all.deb ... 2023-11-28T19:55:53.471 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-zc.lockfile (2.0-1) ... 2023-11-28T19:55:53.561 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package python3-pastedeploy. 2023-11-28T19:55:53.576 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../053-python3-pastedeploy_2.1.1-1_all.deb ... 2023-11-28T19:55:53.611 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking python3-pastedeploy (2.1.1-1) ... 2023-11-28T19:55:53.774 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-cherrypy3. 2023-11-28T19:55:53.788 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../041-python3-cherrypy3_18.6.1-4_all.deb ... 2023-11-28T19:55:53.832 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-cherrypy3 (18.6.1-4) ... 2023-11-28T19:55:53.897 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package python3-webtest. 2023-11-28T19:55:53.913 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../054-python3-webtest_2.0.35-1_all.deb ... 2023-11-28T19:55:53.955 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking python3-webtest (2.0.35-1) ... 2023-11-28T19:55:54.228 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-natsort. 2023-11-28T19:55:54.242 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../042-python3-natsort_8.0.2-1_all.deb ... 2023-11-28T19:55:54.250 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package python3-pecan. 2023-11-28T19:55:54.265 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../055-python3-pecan_1.3.3-4ubuntu2_all.deb ... 2023-11-28T19:55:54.278 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-natsort (8.0.2-1) ... 2023-11-28T19:55:54.308 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking python3-pecan (1.3.3-4ubuntu2) ... 2023-11-28T19:55:54.556 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-logutils. 2023-11-28T19:55:54.570 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../043-python3-logutils_0.3.3-8_all.deb ... 2023-11-28T19:55:54.614 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-logutils (0.3.3-8) ... 2023-11-28T19:55:54.696 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package python3-certifi. 2023-11-28T19:55:54.710 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../056-python3-certifi_2020.6.20-1_all.deb ... 2023-11-28T19:55:54.755 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking python3-certifi (2020.6.20-1) ... 2023-11-28T19:55:54.900 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-markupsafe. 2023-11-28T19:55:54.915 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../044-python3-markupsafe_2.0.1-2build1_amd64.deb ... 2023-11-28T19:55:54.983 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-markupsafe (2.0.1-2build1) ... 2023-11-28T19:55:55.074 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package python3-idna. 2023-11-28T19:55:55.088 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../057-python3-idna_3.3-1_all.deb ... 2023-11-28T19:55:55.132 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking python3-idna (3.3-1) ... 2023-11-28T19:55:55.286 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-mako. 2023-11-28T19:55:55.301 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../045-python3-mako_1.1.3+ds1-2ubuntu0.1_all.deb ... 2023-11-28T19:55:55.345 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2023-11-28T19:55:55.385 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package python3-urllib3. 2023-11-28T19:55:55.400 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../058-python3-urllib3_1.26.5-1~exp1ubuntu0.1_all.deb ... 2023-11-28T19:55:55.477 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2023-11-28T19:55:55.648 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-simplegeneric. 2023-11-28T19:55:55.663 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../046-python3-simplegeneric_0.8.1-3_all.deb ... 2023-11-28T19:55:55.698 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2023-11-28T19:55:55.780 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package python3-requests. 2023-11-28T19:55:55.795 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../059-python3-requests_2.25.1+dfsg-2ubuntu0.1_all.deb ... 2023-11-28T19:55:55.838 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2023-11-28T19:55:56.627 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-singledispatch. 2023-11-28T19:55:56.641 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../047-python3-singledispatch_3.4.0.3-3_all.deb ... 2023-11-28T19:55:56.685 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-singledispatch (3.4.0.3-3) ... 2023-11-28T19:55:56.900 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package python3-werkzeug. 2023-11-28T19:55:56.915 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../060-python3-werkzeug_2.0.2+dfsg1-1ubuntu0.22.04.1_all.deb ... 2023-11-28T19:55:56.958 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2023-11-28T19:55:56.996 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-webob. 2023-11-28T19:55:57.011 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../048-python3-webob_1%3a1.8.6-1.1_all.deb ... 2023-11-28T19:55:57.054 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-webob (1:1.8.6-1.1) ... 2023-11-28T19:55:57.220 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2023-11-28T19:55:57.234 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../061-ceph-mgr-modules-core_18.0.0-7520-g43dd94c1-1jammy_all.deb ... 2023-11-28T19:55:57.278 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking ceph-mgr-modules-core (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T19:55:57.407 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-waitress. 2023-11-28T19:55:57.422 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../049-python3-waitress_1.4.4-1.1ubuntu1_all.deb ... 2023-11-28T19:55:57.468 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-waitress (1.4.4-1.1ubuntu1) ... 2023-11-28T19:55:57.699 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2023-11-28T19:55:57.714 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../062-libsqlite3-mod-ceph_18.0.0-7520-g43dd94c1-1jammy_amd64.deb ... 2023-11-28T19:55:57.758 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking libsqlite3-mod-ceph (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T19:55:57.794 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-tempita. 2023-11-28T19:55:57.808 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../050-python3-tempita_0.5.2-6ubuntu1_all.deb ... 2023-11-28T19:55:57.843 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-tempita (0.5.2-6ubuntu1) ... 2023-11-28T19:55:58.036 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package python3-bcrypt. 2023-11-28T19:55:58.050 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../063-python3-bcrypt_3.2.0-1build1_amd64.deb ... 2023-11-28T19:55:58.085 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking python3-bcrypt (3.2.0-1build1) ... 2023-11-28T19:55:58.122 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-paste. 2023-11-28T19:55:58.136 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../051-python3-paste_3.5.0+dfsg1-1_all.deb ... 2023-11-28T19:55:58.181 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-paste (3.5.0+dfsg1-1) ... 2023-11-28T19:55:58.388 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package python3-openssl. 2023-11-28T19:55:58.403 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../064-python3-openssl_21.0.0-1_all.deb ... 2023-11-28T19:55:58.446 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking python3-openssl (21.0.0-1) ... 2023-11-28T19:55:58.491 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2023-11-28T19:55:58.506 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../052-python-pastedeploy-tpl_2.1.1-1_all.deb ... 2023-11-28T19:55:58.566 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python-pastedeploy-tpl (2.1.1-1) ... 2023-11-28T19:55:58.791 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package ceph-mgr. 2023-11-28T19:55:58.806 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../065-ceph-mgr_18.0.0-7520-g43dd94c1-1jammy_amd64.deb ... 2023-11-28T19:55:58.836 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-pastedeploy. 2023-11-28T19:55:58.849 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking ceph-mgr (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T19:55:58.851 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../053-python3-pastedeploy_2.1.1-1_all.deb ... 2023-11-28T19:55:58.894 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-pastedeploy (2.1.1-1) ... 2023-11-28T19:55:59.219 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package ceph-mon. 2023-11-28T19:55:59.222 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-webtest. 2023-11-28T19:55:59.234 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../066-ceph-mon_18.0.0-7520-g43dd94c1-1jammy_amd64.deb ... 2023-11-28T19:55:59.237 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../054-python3-webtest_2.0.35-1_all.deb ... 2023-11-28T19:55:59.269 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking ceph-mon (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T19:55:59.280 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-webtest (2.0.35-1) ... 2023-11-28T19:55:59.625 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-pecan. 2023-11-28T19:55:59.640 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../055-python3-pecan_1.3.3-4ubuntu2_all.deb ... 2023-11-28T19:55:59.683 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-pecan (1.3.3-4ubuntu2) ... 2023-11-28T19:56:00.047 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-certifi. 2023-11-28T19:56:00.062 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../056-python3-certifi_2020.6.20-1_all.deb ... 2023-11-28T19:56:00.072 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package ceph-osd. 2023-11-28T19:56:00.087 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../067-ceph-osd_18.0.0-7520-g43dd94c1-1jammy_amd64.deb ... 2023-11-28T19:56:00.105 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-certifi (2020.6.20-1) ... 2023-11-28T19:56:00.130 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking ceph-osd (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T19:56:00.408 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-idna. 2023-11-28T19:56:00.423 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../057-python3-idna_3.3-1_all.deb ... 2023-11-28T19:56:00.467 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-idna (3.3-1) ... 2023-11-28T19:56:00.769 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-urllib3. 2023-11-28T19:56:00.784 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../058-python3-urllib3_1.26.5-1~exp1ubuntu0.1_all.deb ... 2023-11-28T19:56:00.827 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2023-11-28T19:56:01.147 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-requests. 2023-11-28T19:56:01.162 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../059-python3-requests_2.25.1+dfsg-2ubuntu0.1_all.deb ... 2023-11-28T19:56:01.206 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2023-11-28T19:56:01.375 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package ceph. 2023-11-28T19:56:01.390 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../068-ceph_18.0.0-7520-g43dd94c1-1jammy_amd64.deb ... 2023-11-28T19:56:01.433 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking ceph (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T19:56:01.542 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-werkzeug. 2023-11-28T19:56:01.557 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../060-python3-werkzeug_2.0.2+dfsg1-1ubuntu0.22.04.1_all.deb ... 2023-11-28T19:56:01.600 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2023-11-28T19:56:01.770 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package ceph-fuse. 2023-11-28T19:56:01.785 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../069-ceph-fuse_18.0.0-7520-g43dd94c1-1jammy_amd64.deb ... 2023-11-28T19:56:01.853 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking ceph-fuse (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T19:56:01.870 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2023-11-28T19:56:01.885 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../061-ceph-mgr-modules-core_18.0.0-7520-g43dd94c1-1jammy_all.deb ... 2023-11-28T19:56:01.928 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking ceph-mgr-modules-core (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T19:56:02.189 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package ceph-mds. 2023-11-28T19:56:02.204 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../070-ceph-mds_18.0.0-7520-g43dd94c1-1jammy_amd64.deb ... 2023-11-28T19:56:02.247 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking ceph-mds (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T19:56:02.308 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2023-11-28T19:56:02.323 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../062-libsqlite3-mod-ceph_18.0.0-7520-g43dd94c1-1jammy_amd64.deb ... 2023-11-28T19:56:02.358 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking libsqlite3-mod-ceph (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T19:56:02.609 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package cephadm. 2023-11-28T19:56:02.624 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../071-cephadm_18.0.0-7520-g43dd94c1-1jammy_amd64.deb ... 2023-11-28T19:56:02.667 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking cephadm (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T19:56:02.669 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-bcrypt. 2023-11-28T19:56:02.684 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../063-python3-bcrypt_3.2.0-1build1_amd64.deb ... 2023-11-28T19:56:02.728 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-bcrypt (3.2.0-1build1) ... 2023-11-28T19:56:03.020 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package python3-asyncssh. 2023-11-28T19:56:03.035 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../072-python3-asyncssh_2.5.0-1_all.deb ... 2023-11-28T19:56:03.056 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-openssl. 2023-11-28T19:56:03.071 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../064-python3-openssl_21.0.0-1_all.deb ... 2023-11-28T19:56:03.078 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking python3-asyncssh (2.5.0-1) ... 2023-11-28T19:56:03.105 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-openssl (21.0.0-1) ... 2023-11-28T19:56:03.397 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package python-babel-localedata. 2023-11-28T19:56:03.408 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package ceph-mgr. 2023-11-28T19:56:03.412 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../073-python-babel-localedata_2.8.0+dfsg.1-7_all.deb ... 2023-11-28T19:56:03.423 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../065-ceph-mgr_18.0.0-7520-g43dd94c1-1jammy_amd64.deb ... 2023-11-28T19:56:03.455 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking python-babel-localedata (2.8.0+dfsg.1-7) ... 2023-11-28T19:56:03.467 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking ceph-mgr (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T19:56:03.837 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package ceph-mon. 2023-11-28T19:56:03.852 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../066-ceph-mon_18.0.0-7520-g43dd94c1-1jammy_amd64.deb ... 2023-11-28T19:56:03.895 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking ceph-mon (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T19:56:04.385 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package python3-babel. 2023-11-28T19:56:04.399 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../074-python3-babel_2.8.0+dfsg.1-7_all.deb ... 2023-11-28T19:56:04.444 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking python3-babel (2.8.0+dfsg.1-7) ... 2023-11-28T19:56:04.699 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package ceph-osd. 2023-11-28T19:56:04.713 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../067-ceph-osd_18.0.0-7520-g43dd94c1-1jammy_amd64.deb ... 2023-11-28T19:56:04.738 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package python3-jinja2. 2023-11-28T19:56:04.752 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../075-python3-jinja2_3.0.3-1_all.deb ... 2023-11-28T19:56:04.757 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking ceph-osd (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T19:56:04.813 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking python3-jinja2 (3.0.3-1) ... 2023-11-28T19:56:05.133 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2023-11-28T19:56:05.147 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../076-ceph-mgr-cephadm_18.0.0-7520-g43dd94c1-1jammy_all.deb ... 2023-11-28T19:56:05.183 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking ceph-mgr-cephadm (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T19:56:05.486 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package python3-repoze.lru. 2023-11-28T19:56:05.501 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../077-python3-repoze.lru_0.7-2_all.deb ... 2023-11-28T19:56:05.536 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2023-11-28T19:56:05.830 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package python3-routes. 2023-11-28T19:56:05.846 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../078-python3-routes_2.5.1-1ubuntu1_all.deb ... 2023-11-28T19:56:05.888 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking python3-routes (2.5.1-1ubuntu1) ... 2023-11-28T19:56:05.952 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package ceph. 2023-11-28T19:56:05.967 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../068-ceph_18.0.0-7520-g43dd94c1-1jammy_amd64.deb ... 2023-11-28T19:56:06.019 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking ceph (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T19:56:06.191 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2023-11-28T19:56:06.207 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../079-ceph-mgr-dashboard_18.0.0-7520-g43dd94c1-1jammy_all.deb ... 2023-11-28T19:56:06.241 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking ceph-mgr-dashboard (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T19:56:06.321 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package ceph-fuse. 2023-11-28T19:56:06.336 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../069-ceph-fuse_18.0.0-7520-g43dd94c1-1jammy_amd64.deb ... 2023-11-28T19:56:06.379 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking ceph-fuse (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T19:56:06.647 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package python3-sklearn-lib:amd64. 2023-11-28T19:56:06.661 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../080-python3-sklearn-lib_0.23.2-5ubuntu6_amd64.deb ... 2023-11-28T19:56:06.766 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package ceph-mds. 2023-11-28T19:56:06.781 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../070-ceph-mds_18.0.0-7520-g43dd94c1-1jammy_amd64.deb ... 2023-11-28T19:56:06.824 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking ceph-mds (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T19:56:06.888 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2023-11-28T19:56:07.160 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package cephadm. 2023-11-28T19:56:07.175 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../071-cephadm_18.0.0-7520-g43dd94c1-1jammy_amd64.deb ... 2023-11-28T19:56:07.221 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking cephadm (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T19:56:07.317 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package python3-joblib. 2023-11-28T19:56:07.331 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../081-python3-joblib_0.17.0-4ubuntu1_all.deb ... 2023-11-28T19:56:07.367 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking python3-joblib (0.17.0-4ubuntu1) ... 2023-11-28T19:56:07.555 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-asyncssh. 2023-11-28T19:56:07.570 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../072-python3-asyncssh_2.5.0-1_all.deb ... 2023-11-28T19:56:07.613 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-asyncssh (2.5.0-1) ... 2023-11-28T19:56:07.712 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package python3-threadpoolctl. 2023-11-28T19:56:07.726 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../082-python3-threadpoolctl_3.1.0-1_all.deb ... 2023-11-28T19:56:07.890 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking python3-threadpoolctl (3.1.0-1) ... 2023-11-28T19:56:07.916 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python-babel-localedata. 2023-11-28T19:56:07.931 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../073-python-babel-localedata_2.8.0+dfsg.1-7_all.deb ... 2023-11-28T19:56:07.974 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python-babel-localedata (2.8.0+dfsg.1-7) ... 2023-11-28T19:56:08.201 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package python3-sklearn. 2023-11-28T19:56:08.216 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../083-python3-sklearn_0.23.2-5ubuntu6_all.deb ... 2023-11-28T19:56:08.260 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking python3-sklearn (0.23.2-5ubuntu6) ... 2023-11-28T19:56:08.895 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2023-11-28T19:56:08.909 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../084-ceph-mgr-diskprediction-local_18.0.0-7520-g43dd94c1-1jammy_all.deb ... 2023-11-28T19:56:08.953 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking ceph-mgr-diskprediction-local (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T19:56:08.963 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-babel. 2023-11-28T19:56:08.977 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../074-python3-babel_2.8.0+dfsg.1-7_all.deb ... 2023-11-28T19:56:09.021 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-babel (2.8.0+dfsg.1-7) ... 2023-11-28T19:56:09.307 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-jinja2. 2023-11-28T19:56:09.320 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../075-python3-jinja2_3.0.3-1_all.deb ... 2023-11-28T19:56:09.398 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-jinja2 (3.0.3-1) ... 2023-11-28T19:56:09.735 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2023-11-28T19:56:09.749 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../076-ceph-mgr-cephadm_18.0.0-7520-g43dd94c1-1jammy_all.deb ... 2023-11-28T19:56:09.793 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking ceph-mgr-cephadm (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T19:56:09.899 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package python3-cachetools. 2023-11-28T19:56:09.915 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../085-python3-cachetools_5.0.0-1_all.deb ... 2023-11-28T19:56:09.949 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking python3-cachetools (5.0.0-1) ... 2023-11-28T19:56:10.122 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-repoze.lru. 2023-11-28T19:56:10.136 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../077-python3-repoze.lru_0.7-2_all.deb ... 2023-11-28T19:56:10.180 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2023-11-28T19:56:10.235 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package python3-pyasn1. 2023-11-28T19:56:10.251 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../086-python3-pyasn1_0.4.8-1_all.deb ... 2023-11-28T19:56:10.293 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking python3-pyasn1 (0.4.8-1) ... 2023-11-28T19:56:10.509 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-routes. 2023-11-28T19:56:10.523 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../078-python3-routes_2.5.1-1ubuntu1_all.deb ... 2023-11-28T19:56:10.566 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-routes (2.5.1-1ubuntu1) ... 2023-11-28T19:56:10.631 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package python3-pyasn1-modules. 2023-11-28T19:56:10.646 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../087-python3-pyasn1-modules_0.2.1-1_all.deb ... 2023-11-28T19:56:10.689 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking python3-pyasn1-modules (0.2.1-1) ... 2023-11-28T19:56:11.025 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package python3-rsa. 2023-11-28T19:56:11.041 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../088-python3-rsa_4.8-1_all.deb ... 2023-11-28T19:56:11.083 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking python3-rsa (4.8-1) ... 2023-11-28T19:56:11.095 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2023-11-28T19:56:11.110 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../079-ceph-mgr-dashboard_18.0.0-7520-g43dd94c1-1jammy_all.deb ... 2023-11-28T19:56:11.178 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking ceph-mgr-dashboard (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T19:56:11.396 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package python3-google-auth. 2023-11-28T19:56:11.412 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../089-python3-google-auth_1.5.1-3_all.deb ... 2023-11-28T19:56:11.454 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking python3-google-auth (1.5.1-3) ... 2023-11-28T19:56:11.589 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-sklearn-lib:amd64. 2023-11-28T19:56:11.604 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../080-python3-sklearn-lib_0.23.2-5ubuntu6_amd64.deb ... 2023-11-28T19:56:11.639 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2023-11-28T19:56:11.792 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package python3-requests-oauthlib. 2023-11-28T19:56:11.807 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../090-python3-requests-oauthlib_1.3.0+ds-0.1_all.deb ... 2023-11-28T19:56:11.850 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking python3-requests-oauthlib (1.3.0+ds-0.1) ... 2023-11-28T19:56:12.145 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package python3-websocket. 2023-11-28T19:56:12.160 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../091-python3-websocket_1.2.3-1_all.deb ... 2023-11-28T19:56:12.161 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-joblib. 2023-11-28T19:56:12.176 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../081-python3-joblib_0.17.0-4ubuntu1_all.deb ... 2023-11-28T19:56:12.203 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking python3-websocket (1.2.3-1) ... 2023-11-28T19:56:12.218 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-joblib (0.17.0-4ubuntu1) ... 2023-11-28T19:56:12.499 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package python3-kubernetes. 2023-11-28T19:56:12.515 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../092-python3-kubernetes_12.0.1-1ubuntu1_all.deb ... 2023-11-28T19:56:12.548 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking python3-kubernetes (12.0.1-1ubuntu1) ... 2023-11-28T19:56:12.580 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-threadpoolctl. 2023-11-28T19:56:12.595 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../082-python3-threadpoolctl_3.1.0-1_all.deb ... 2023-11-28T19:56:12.716 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-threadpoolctl (3.1.0-1) ... 2023-11-28T19:56:13.044 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-sklearn. 2023-11-28T19:56:13.058 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../083-python3-sklearn_0.23.2-5ubuntu6_all.deb ... 2023-11-28T19:56:13.093 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-sklearn (0.23.2-5ubuntu6) ... 2023-11-28T19:56:13.196 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2023-11-28T19:56:13.210 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../093-ceph-mgr-k8sevents_18.0.0-7520-g43dd94c1-1jammy_all.deb ... 2023-11-28T19:56:13.255 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking ceph-mgr-k8sevents (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T19:56:13.574 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package libonig5:amd64. 2023-11-28T19:56:13.589 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../094-libonig5_6.9.7.1-2build1_amd64.deb ... 2023-11-28T19:56:13.633 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking libonig5:amd64 (6.9.7.1-2build1) ... 2023-11-28T19:56:13.753 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2023-11-28T19:56:13.767 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../084-ceph-mgr-diskprediction-local_18.0.0-7520-g43dd94c1-1jammy_all.deb ... 2023-11-28T19:56:13.811 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking ceph-mgr-diskprediction-local (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T19:56:13.944 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package libjq1:amd64. 2023-11-28T19:56:13.959 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../095-libjq1_1.6-2.1ubuntu3_amd64.deb ... 2023-11-28T19:56:13.994 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking libjq1:amd64 (1.6-2.1ubuntu3) ... 2023-11-28T19:56:14.256 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package jq. 2023-11-28T19:56:14.270 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../096-jq_1.6-2.1ubuntu3_amd64.deb ... 2023-11-28T19:56:14.314 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking jq (1.6-2.1ubuntu3) ... 2023-11-28T19:56:14.567 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package socat. 2023-11-28T19:56:14.582 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../097-socat_1.7.4.1-3ubuntu4_amd64.deb ... 2023-11-28T19:56:14.625 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking socat (1.7.4.1-3ubuntu4) ... 2023-11-28T19:56:14.773 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-cachetools. 2023-11-28T19:56:14.788 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../085-python3-cachetools_5.0.0-1_all.deb ... 2023-11-28T19:56:14.831 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-cachetools (5.0.0-1) ... 2023-11-28T19:56:14.970 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package xmlstarlet. 2023-11-28T19:56:14.986 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../098-xmlstarlet_1.6.1-2.1_amd64.deb ... 2023-11-28T19:56:15.112 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking xmlstarlet (1.6.1-2.1) ... 2023-11-28T19:56:15.134 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-pyasn1. 2023-11-28T19:56:15.150 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../086-python3-pyasn1_0.4.8-1_all.deb ... 2023-11-28T19:56:15.192 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-pyasn1 (0.4.8-1) ... 2023-11-28T19:56:15.493 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package ceph-test. 2023-11-28T19:56:15.508 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../099-ceph-test_18.0.0-7520-g43dd94c1-1jammy_amd64.deb ... 2023-11-28T19:56:15.529 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-pyasn1-modules. 2023-11-28T19:56:15.545 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../087-python3-pyasn1-modules_0.2.1-1_all.deb ... 2023-11-28T19:56:15.559 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking ceph-test (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T19:56:15.588 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-pyasn1-modules (0.2.1-1) ... 2023-11-28T19:56:15.915 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-rsa. 2023-11-28T19:56:15.931 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../088-python3-rsa_4.8-1_all.deb ... 2023-11-28T19:56:15.974 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-rsa (4.8-1) ... 2023-11-28T19:56:16.261 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-google-auth. 2023-11-28T19:56:16.277 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../089-python3-google-auth_1.5.1-3_all.deb ... 2023-11-28T19:56:16.328 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-google-auth (1.5.1-3) ... 2023-11-28T19:56:16.656 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-requests-oauthlib. 2023-11-28T19:56:16.787 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../090-python3-requests-oauthlib_1.3.0+ds-0.1_all.deb ... 2023-11-28T19:56:16.787 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-requests-oauthlib (1.3.0+ds-0.1) ... 2023-11-28T19:56:17.043 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-websocket. 2023-11-28T19:56:17.058 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../091-python3-websocket_1.2.3-1_all.deb ... 2023-11-28T19:56:17.101 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-websocket (1.2.3-1) ... 2023-11-28T19:56:17.471 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-kubernetes. 2023-11-28T19:56:17.486 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../092-python3-kubernetes_12.0.1-1ubuntu1_all.deb ... 2023-11-28T19:56:17.529 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-kubernetes (12.0.1-1ubuntu1) ... 2023-11-28T19:56:17.756 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package ceph-volume. 2023-11-28T19:56:17.772 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../100-ceph-volume_18.0.0-7520-g43dd94c1-1jammy_all.deb ... 2023-11-28T19:56:17.815 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking ceph-volume (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T19:56:18.226 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2023-11-28T19:56:18.241 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../093-ceph-mgr-k8sevents_18.0.0-7520-g43dd94c1-1jammy_all.deb ... 2023-11-28T19:56:18.243 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package cephfs-mirror. 2023-11-28T19:56:18.259 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../101-cephfs-mirror_18.0.0-7520-g43dd94c1-1jammy_amd64.deb ... 2023-11-28T19:56:18.284 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking ceph-mgr-k8sevents (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T19:56:18.301 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking cephfs-mirror (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T19:56:18.638 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package libonig5:amd64. 2023-11-28T19:56:18.652 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../094-libonig5_6.9.7.1-2build1_amd64.deb ... 2023-11-28T19:56:18.691 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package python3-colorama. 2023-11-28T19:56:18.696 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking libonig5:amd64 (6.9.7.1-2build1) ... 2023-11-28T19:56:18.707 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../102-python3-colorama_0.4.4-1_all.deb ... 2023-11-28T19:56:18.755 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking python3-colorama (0.4.4-1) ... 2023-11-28T19:56:18.982 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package libjq1:amd64. 2023-11-28T19:56:18.997 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../095-libjq1_1.6-2.1ubuntu3_amd64.deb ... 2023-11-28T19:56:19.040 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking libjq1:amd64 (1.6-2.1ubuntu3) ... 2023-11-28T19:56:19.066 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package cephfs-shell. 2023-11-28T19:56:19.082 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../103-cephfs-shell_18.0.0-7520-g43dd94c1-1jammy_all.deb ... 2023-11-28T19:56:19.133 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking cephfs-shell (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T19:56:19.327 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package jq. 2023-11-28T19:56:19.342 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../096-jq_1.6-2.1ubuntu3_amd64.deb ... 2023-11-28T19:56:19.385 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking jq (1.6-2.1ubuntu3) ... 2023-11-28T19:56:19.444 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package cephfs-top. 2023-11-28T19:56:19.460 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../104-cephfs-top_18.0.0-7520-g43dd94c1-1jammy_all.deb ... 2023-11-28T19:56:19.511 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking cephfs-top (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T19:56:19.638 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package socat. 2023-11-28T19:56:19.653 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../097-socat_1.7.4.1-3ubuntu4_amd64.deb ... 2023-11-28T19:56:19.696 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking socat (1.7.4.1-3ubuntu4) ... 2023-11-28T19:56:19.814 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package libcephfs-dev. 2023-11-28T19:56:19.830 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../105-libcephfs-dev_18.0.0-7520-g43dd94c1-1jammy_amd64.deb ... 2023-11-28T19:56:19.872 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking libcephfs-dev (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T19:56:19.999 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package xmlstarlet. 2023-11-28T19:56:20.017 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../098-xmlstarlet_1.6.1-2.1_amd64.deb ... 2023-11-28T19:56:20.057 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking xmlstarlet (1.6.1-2.1) ... 2023-11-28T19:56:20.183 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package lua-socket:amd64. 2023-11-28T19:56:20.199 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../106-lua-socket_3.0~rc1+git+ac3201d-6_amd64.deb ... 2023-11-28T19:56:20.242 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2023-11-28T19:56:20.437 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package ceph-test. 2023-11-28T19:56:20.452 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../099-ceph-test_18.0.0-7520-g43dd94c1-1jammy_amd64.deb ... 2023-11-28T19:56:20.504 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking ceph-test (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T19:56:20.573 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package lua-sec:amd64. 2023-11-28T19:56:20.587 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../107-lua-sec_1.0.2-1_amd64.deb ... 2023-11-28T19:56:20.655 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking lua-sec:amd64 (1.0.2-1) ... 2023-11-28T19:56:20.984 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package nvme-cli. 2023-11-28T19:56:21.000 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../108-nvme-cli_1.16-3ubuntu0.1_amd64.deb ... 2023-11-28T19:56:21.042 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking nvme-cli (1.16-3ubuntu0.1) ... 2023-11-28T19:56:21.432 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package pkg-config. 2023-11-28T19:56:21.447 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../109-pkg-config_0.29.2-1ubuntu3_amd64.deb ... 2023-11-28T19:56:21.490 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking pkg-config (0.29.2-1ubuntu3) ... 2023-11-28T19:56:21.743 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package python-asyncssh-doc. 2023-11-28T19:56:21.759 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../110-python-asyncssh-doc_2.5.0-1_all.deb ... 2023-11-28T19:56:21.794 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking python-asyncssh-doc (2.5.0-1) ... 2023-11-28T19:56:22.222 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package python3-iniconfig. 2023-11-28T19:56:22.237 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../111-python3-iniconfig_1.1.1-2_all.deb ... 2023-11-28T19:56:22.280 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking python3-iniconfig (1.1.1-2) ... 2023-11-28T19:56:22.308 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package ceph-volume. 2023-11-28T19:56:22.323 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../100-ceph-volume_18.0.0-7520-g43dd94c1-1jammy_all.deb ... 2023-11-28T19:56:22.366 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking ceph-volume (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T19:56:22.533 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package python3-pastescript. 2023-11-28T19:56:22.549 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../112-python3-pastescript_2.0.2-4_all.deb ... 2023-11-28T19:56:22.625 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2023-11-28T19:56:22.737 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package cephfs-mirror. 2023-11-28T19:56:22.752 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../101-cephfs-mirror_18.0.0-7520-g43dd94c1-1jammy_amd64.deb ... 2023-11-28T19:56:22.795 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking cephfs-mirror (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T19:56:22.954 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package python3-pluggy. 2023-11-28T19:56:22.969 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../113-python3-pluggy_0.13.0-7.1_all.deb ... 2023-11-28T19:56:23.012 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking python3-pluggy (0.13.0-7.1) ... 2023-11-28T19:56:23.131 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-colorama. 2023-11-28T19:56:23.147 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../102-python3-colorama_0.4.4-1_all.deb ... 2023-11-28T19:56:23.189 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-colorama (0.4.4-1) ... 2023-11-28T19:56:23.290 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package python3-psutil. 2023-11-28T19:56:23.306 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../114-python3-psutil_5.9.0-1build1_amd64.deb ... 2023-11-28T19:56:23.348 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking python3-psutil (5.9.0-1build1) ... 2023-11-28T19:56:23.426 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package cephfs-shell. 2023-11-28T19:56:23.441 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../103-cephfs-shell_18.0.0-7520-g43dd94c1-1jammy_all.deb ... 2023-11-28T19:56:23.476 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking cephfs-shell (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T19:56:23.693 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package python3-py. 2023-11-28T19:56:23.710 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../115-python3-py_1.10.0-1_all.deb ... 2023-11-28T19:56:23.711 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package cephfs-top. 2023-11-28T19:56:23.726 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../104-cephfs-top_18.0.0-7520-g43dd94c1-1jammy_all.deb ... 2023-11-28T19:56:23.751 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking python3-py (1.10.0-1) ... 2023-11-28T19:56:23.769 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking cephfs-top (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T19:56:24.047 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package libcephfs-dev. 2023-11-28T19:56:24.062 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../105-libcephfs-dev_18.0.0-7520-g43dd94c1-1jammy_amd64.deb ... 2023-11-28T19:56:24.080 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package python3-pygments. 2023-11-28T19:56:24.096 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../116-python3-pygments_2.11.2+dfsg-2_all.deb ... 2023-11-28T19:56:24.106 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking libcephfs-dev (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T19:56:24.138 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking python3-pygments (2.11.2+dfsg-2) ... 2023-11-28T19:56:24.433 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package lua-socket:amd64. 2023-11-28T19:56:24.448 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../106-lua-socket_3.0~rc1+git+ac3201d-6_amd64.deb ... 2023-11-28T19:56:24.492 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2023-11-28T19:56:24.610 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package python3-pyinotify. 2023-11-28T19:56:24.624 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../117-python3-pyinotify_0.9.6-1.3_all.deb ... 2023-11-28T19:56:24.659 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking python3-pyinotify (0.9.6-1.3) ... 2023-11-28T19:56:24.863 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package lua-sec:amd64. 2023-11-28T19:56:24.878 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../107-lua-sec_1.0.2-1_amd64.deb ... 2023-11-28T19:56:24.921 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking lua-sec:amd64 (1.0.2-1) ... 2023-11-28T19:56:24.954 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package python3-toml. 2023-11-28T19:56:24.968 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../118-python3-toml_0.10.2-1_all.deb ... 2023-11-28T19:56:25.012 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking python3-toml (0.10.2-1) ... 2023-11-28T19:56:25.317 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package nvme-cli. 2023-11-28T19:56:25.324 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package python3-pytest. 2023-11-28T19:56:25.332 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../108-nvme-cli_1.16-3ubuntu0.1_amd64.deb ... 2023-11-28T19:56:25.338 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../119-python3-pytest_6.2.5-1ubuntu2_all.deb ... 2023-11-28T19:56:25.375 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking nvme-cli (1.16-3ubuntu0.1) ... 2023-11-28T19:56:25.399 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking python3-pytest (6.2.5-1ubuntu2) ... 2023-11-28T19:56:25.753 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package python3-simplejson. 2023-11-28T19:56:25.767 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../120-python3-simplejson_3.17.6-1build1_amd64.deb ... 2023-11-28T19:56:25.789 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package pkg-config. 2023-11-28T19:56:25.804 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../109-pkg-config_0.29.2-1ubuntu3_amd64.deb ... 2023-11-28T19:56:25.811 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking python3-simplejson (3.17.6-1build1) ... 2023-11-28T19:56:25.847 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking pkg-config (0.29.2-1ubuntu3) ... 2023-11-28T19:56:26.058 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python-asyncssh-doc. 2023-11-28T19:56:26.074 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../110-python-asyncssh-doc_2.5.0-1_all.deb ... 2023-11-28T19:56:26.080 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package qttranslations5-l10n. 2023-11-28T19:56:26.095 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../121-qttranslations5-l10n_5.15.3-1_all.deb ... 2023-11-28T19:56:26.116 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python-asyncssh-doc (2.5.0-1) ... 2023-11-28T19:56:26.139 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking qttranslations5-l10n (5.15.3-1) ... 2023-11-28T19:56:26.520 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-iniconfig. 2023-11-28T19:56:26.535 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../111-python3-iniconfig_1.1.1-2_all.deb ... 2023-11-28T19:56:26.578 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-iniconfig (1.1.1-2) ... 2023-11-28T19:56:26.852 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package radosgw. 2023-11-28T19:56:26.864 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-pastescript. 2023-11-28T19:56:26.866 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../122-radosgw_18.0.0-7520-g43dd94c1-1jammy_amd64.deb ... 2023-11-28T19:56:26.880 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../112-python3-pastescript_2.0.2-4_all.deb ... 2023-11-28T19:56:26.910 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking radosgw (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T19:56:26.922 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2023-11-28T19:56:27.243 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-pluggy. 2023-11-28T19:56:27.258 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../113-python3-pluggy_0.13.0-7.1_all.deb ... 2023-11-28T19:56:27.301 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-pluggy (0.13.0-7.1) ... 2023-11-28T19:56:27.480 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package rbd-fuse. 2023-11-28T19:56:27.495 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../123-rbd-fuse_18.0.0-7520-g43dd94c1-1jammy_amd64.deb ... 2023-11-28T19:56:27.580 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking rbd-fuse (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T19:56:27.645 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-psutil. 2023-11-28T19:56:27.661 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../114-python3-psutil_5.9.0-1build1_amd64.deb ... 2023-11-28T19:56:27.703 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-psutil (5.9.0-1build1) ... 2023-11-28T19:56:28.050 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-py. 2023-11-28T19:56:28.066 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../115-python3-py_1.10.0-1_all.deb ... 2023-11-28T19:56:28.108 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-py (1.10.0-1) ... 2023-11-28T19:56:28.125 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up python3-iniconfig (1.1.1-2) ... 2023-11-28T19:56:28.386 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up libdouble-conversion3:amd64 (3.1.7-4) ... 2023-11-28T19:56:28.453 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-pygments. 2023-11-28T19:56:28.468 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../116-python3-pygments_2.11.2+dfsg-2_all.deb ... 2023-11-28T19:56:28.495 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up nvme-cli (1.16-3ubuntu0.1) ... 2023-11-28T19:56:28.512 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-pygments (2.11.2+dfsg-2) ... 2023-11-28T19:56:28.771 INFO:teuthology.orchestra.run.smithi179.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service -> /lib/systemd/system/nvmefc-boot-connections.service. 2023-11-28T19:56:28.966 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-pyinotify. 2023-11-28T19:56:28.981 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../117-python3-pyinotify_0.9.6-1.3_all.deb ... 2023-11-28T19:56:29.016 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-pyinotify (0.9.6-1.3) ... 2023-11-28T19:56:29.175 INFO:teuthology.orchestra.run.smithi179.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmf-autoconnect.service -> /lib/systemd/system/nvmf-autoconnect.service. 2023-11-28T19:56:29.327 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-toml. 2023-11-28T19:56:29.341 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../118-python3-toml_0.10.2-1_all.deb ... 2023-11-28T19:56:29.385 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-toml (0.10.2-1) ... 2023-11-28T19:56:29.688 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-pytest. 2023-11-28T19:56:29.703 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../119-python3-pytest_6.2.5-1ubuntu2_all.deb ... 2023-11-28T19:56:29.746 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-pytest (6.2.5-1ubuntu2) ... 2023-11-28T19:56:29.766 INFO:teuthology.orchestra.run.smithi179.stdout:nvmf-connect.target is a disabled or a static unit, not starting it. 2023-11-28T19:56:29.810 INFO:teuthology.orchestra.run.smithi179.stdout:Could not execute systemctl: at /usr/bin/deb-systemd-invoke line 142. 2023-11-28T19:56:29.864 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up cephadm (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T19:56:30.100 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-simplejson. 2023-11-28T19:56:30.116 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../120-python3-simplejson_3.17.6-1build1_amd64.deb ... 2023-11-28T19:56:30.150 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-simplejson (3.17.6-1build1) ... 2023-11-28T19:56:30.406 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package qttranslations5-l10n. 2023-11-28T19:56:30.419 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../121-qttranslations5-l10n_5.15.3-1_all.deb ... 2023-11-28T19:56:30.435 INFO:teuthology.orchestra.run.smithi179.stdout:Adding system user cephadm....done 2023-11-28T19:56:30.461 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking qttranslations5-l10n (5.15.3-1) ... 2023-11-28T19:56:30.596 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up python3-waitress (1.4.4-1.1ubuntu1) ... 2023-11-28T19:56:30.872 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up python3-jaraco.classes (3.2.1-3) ... 2023-11-28T19:56:31.132 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up python-asyncssh-doc (2.5.0-1) ... 2023-11-28T19:56:31.240 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package radosgw. 2023-11-28T19:56:31.242 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up python3-jaraco.functools (3.4.0-2) ... 2023-11-28T19:56:31.255 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../122-radosgw_18.0.0-7520-g43dd94c1-1jammy_amd64.deb ... 2023-11-28T19:56:31.298 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking radosgw (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T19:56:31.501 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up python3-repoze.lru (0.7-2) ... 2023-11-28T19:56:31.761 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up liboath0:amd64 (2.6.7-3build1) ... 2023-11-28T19:56:31.887 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up python3-py (1.10.0-1) ... 2023-11-28T19:56:31.918 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package rbd-fuse. 2023-11-28T19:56:31.933 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../123-rbd-fuse_18.0.0-7520-g43dd94c1-1jammy_amd64.deb ... 2023-11-28T19:56:31.976 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking rbd-fuse (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T19:56:32.197 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up python3-joblib (0.17.0-4ubuntu1) ... 2023-11-28T19:56:32.270 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-iniconfig (1.1.1-2) ... 2023-11-28T19:56:32.540 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up libdouble-conversion3:amd64 (3.1.7-4) ... 2023-11-28T19:56:32.649 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up nvme-cli (1.16-3ubuntu0.1) ... 2023-11-28T19:56:32.650 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up python3-cachetools (5.0.0-1) ... 2023-11-28T19:56:32.901 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up python3-colorama (0.4.4-1) ... 2023-11-28T19:56:32.915 INFO:teuthology.orchestra.run.smithi078.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service -> /lib/systemd/system/nvmefc-boot-connections.service. 2023-11-28T19:56:33.161 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up python3-openssl (21.0.0-1) ... 2023-11-28T19:56:33.292 INFO:teuthology.orchestra.run.smithi078.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmf-autoconnect.service -> /lib/systemd/system/nvmf-autoconnect.service. 2023-11-28T19:56:33.437 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up unzip (6.0-26ubuntu3.1) ... 2023-11-28T19:56:33.705 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up python3-bcrypt (3.2.0-1build1) ... 2023-11-28T19:56:33.900 INFO:teuthology.orchestra.run.smithi078.stdout:nvmf-connect.target is a disabled or a static unit, not starting it. 2023-11-28T19:56:33.944 INFO:teuthology.orchestra.run.smithi078.stdout:Could not execute systemctl: at /usr/bin/deb-systemd-invoke line 142. 2023-11-28T19:56:33.982 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up python3-pyinotify (0.9.6-1.3) ... 2023-11-28T19:56:33.984 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up cephadm (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T19:56:34.233 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up python3-threadpoolctl (3.1.0-1) ... 2023-11-28T19:56:34.484 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up python3-ceph-argparse (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T19:56:34.571 INFO:teuthology.orchestra.run.smithi078.stdout:Adding system user cephadm....done 2023-11-28T19:56:34.752 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2023-11-28T19:56:34.866 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-waitress (1.4.4-1.1ubuntu1) ... 2023-11-28T19:56:34.878 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2023-11-28T19:56:35.004 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up python3-pyperclip (1.8.2-2) ... 2023-11-28T19:56:35.142 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-jaraco.classes (3.2.1-3) ... 2023-11-28T19:56:35.264 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up libreadline-dev:amd64 (8.1.2-1) ... 2023-11-28T19:56:35.393 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python-asyncssh-doc (2.5.0-1) ... 2023-11-28T19:56:35.415 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up python3-markupsafe (2.0.1-2build1) ... 2023-11-28T19:56:35.553 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-jaraco.functools (3.4.0-2) ... 2023-11-28T19:56:35.667 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up lua5.1 (5.1.5-8.1build4) ... 2023-11-28T19:56:35.812 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-repoze.lru (0.7-2) ... 2023-11-28T19:56:36.024 INFO:teuthology.orchestra.run.smithi179.stdout:update-alternatives: using /usr/bin/lua5.1 to provide /usr/bin/lua (lua-interpreter) in auto mode 2023-11-28T19:56:36.056 INFO:teuthology.orchestra.run.smithi179.stdout:update-alternatives: using /usr/bin/luac5.1 to provide /usr/bin/luac (lua-compiler) in auto mode 2023-11-28T19:56:36.080 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up liboath0:amd64 (2.6.7-3build1) ... 2023-11-28T19:56:36.128 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2023-11-28T19:56:36.206 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-py (1.10.0-1) ... 2023-11-28T19:56:36.254 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up python3-psutil (5.9.0-1build1) ... 2023-11-28T19:56:36.516 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-joblib (0.17.0-4ubuntu1) ... 2023-11-28T19:56:36.647 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up python-babel-localedata (2.8.0+dfsg.1-7) ... 2023-11-28T19:56:36.774 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up python3-natsort (8.0.2-1) ... 2023-11-28T19:56:36.885 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-cachetools (5.0.0-1) ... 2023-11-28T19:56:37.042 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up python3-routes (2.5.1-1ubuntu1) ... 2023-11-28T19:56:37.128 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-colorama (0.4.4-1) ... 2023-11-28T19:56:37.343 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up python3-simplejson (3.17.6-1build1) ... 2023-11-28T19:56:37.379 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-openssl (21.0.0-1) ... 2023-11-28T19:56:37.636 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up zip (3.0-12build2) ... 2023-11-28T19:56:37.664 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up unzip (6.0-26ubuntu3.1) ... 2023-11-28T19:56:37.762 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up python3-pygments (2.11.2+dfsg-2) ... 2023-11-28T19:56:37.940 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-bcrypt (3.2.0-1build1) ... 2023-11-28T19:56:38.200 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-pyinotify (0.9.6-1.3) ... 2023-11-28T19:56:38.443 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-threadpoolctl (3.1.0-1) ... 2023-11-28T19:56:38.456 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up python3-tempita (0.5.2-6ubuntu1) ... 2023-11-28T19:56:38.686 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-ceph-argparse (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T19:56:38.732 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up python-pastedeploy-tpl (2.1.1-1) ... 2023-11-28T19:56:38.858 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up qttranslations5-l10n (5.15.3-1) ... 2023-11-28T19:56:38.953 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2023-11-28T19:56:38.985 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up python3-wcwidth (0.2.5+dfsg1-1) ... 2023-11-28T19:56:39.104 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2023-11-28T19:56:39.231 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-pyperclip (1.8.2-2) ... 2023-11-28T19:56:39.311 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up python3-asyncssh (2.5.0-1) ... 2023-11-28T19:56:39.507 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up libreadline-dev:amd64 (8.1.2-1) ... 2023-11-28T19:56:39.608 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-markupsafe (2.0.1-2build1) ... 2023-11-28T19:56:39.696 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up python3-certifi (2020.6.20-1) ... 2023-11-28T19:56:39.851 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up lua5.1 (5.1.5-8.1build4) ... 2023-11-28T19:56:39.955 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up python3-paste (3.5.0+dfsg1-1) ... 2023-11-28T19:56:40.262 INFO:teuthology.orchestra.run.smithi078.stdout:update-alternatives: using /usr/bin/lua5.1 to provide /usr/bin/lua (lua-interpreter) in auto mode 2023-11-28T19:56:40.298 INFO:teuthology.orchestra.run.smithi078.stdout:update-alternatives: using /usr/bin/luac5.1 to provide /usr/bin/luac (lua-compiler) in auto mode 2023-11-28T19:56:40.349 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2023-11-28T19:56:40.362 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2023-11-28T19:56:40.489 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-psutil (5.9.0-1build1) ... 2023-11-28T19:56:40.650 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up python3-cmd2 (2.3.3-1) ... 2023-11-28T19:56:40.874 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python-babel-localedata (2.8.0+dfsg.1-7) ... 2023-11-28T19:56:40.960 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2023-11-28T19:56:40.991 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-natsort (8.0.2-1) ... 2023-11-28T19:56:41.251 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-routes (2.5.1-1ubuntu1) ... 2023-11-28T19:56:41.311 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up python3-jaraco.text (3.6.0-2) ... 2023-11-28T19:56:41.571 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up socat (1.7.4.1-3ubuntu4) ... 2023-11-28T19:56:41.697 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up python3-ceph-common (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T19:56:41.869 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-simplejson (3.17.6-1build1) ... 2023-11-28T19:56:41.999 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up python3-idna (3.3-1) ... 2023-11-28T19:56:42.170 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up zip (3.0-12build2) ... 2023-11-28T19:56:42.296 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-pygments (2.11.2+dfsg-2) ... 2023-11-28T19:56:42.333 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up python3-sklearn (0.23.2-5ubuntu6) ... 2023-11-28T19:56:42.982 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-tempita (0.5.2-6ubuntu1) ... 2023-11-28T19:56:43.241 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python-pastedeploy-tpl (2.1.1-1) ... 2023-11-28T19:56:43.359 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up qttranslations5-l10n (5.15.3-1) ... 2023-11-28T19:56:43.460 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-wcwidth (0.2.5+dfsg1-1) ... 2023-11-28T19:56:43.549 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up pkg-config (0.29.2-1ubuntu3) ... 2023-11-28T19:56:43.761 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-asyncssh (2.5.0-1) ... 2023-11-28T19:56:43.792 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-11-28T19:56:43.926 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up python3-toml (0.10.2-1) ... 2023-11-28T19:56:44.163 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-certifi (2020.6.20-1) ... 2023-11-28T19:56:44.177 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up librdkafka1:amd64 (1.8.0-1build1) ... 2023-11-28T19:56:44.312 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up xmlstarlet (1.6.1-2.1) ... 2023-11-28T19:56:44.422 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-paste (3.5.0+dfsg1-1) ... 2023-11-28T19:56:44.438 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2023-11-28T19:56:44.740 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up python3-pluggy (0.13.0-7.1) ... 2023-11-28T19:56:44.832 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2023-11-28T19:56:45.008 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up python3-zc.lockfile (2.0-1) ... 2023-11-28T19:56:45.118 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-cmd2 (2.3.3-1) ... 2023-11-28T19:56:45.267 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-11-28T19:56:45.393 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up python3-pyasn1 (0.4.8-1) ... 2023-11-28T19:56:45.460 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2023-11-28T19:56:45.703 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up python3-singledispatch (3.4.0.3-3) ... 2023-11-28T19:56:45.795 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-jaraco.text (3.6.0-2) ... 2023-11-28T19:56:45.963 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up python3-logutils (0.3.3-8) ... 2023-11-28T19:56:46.054 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up socat (1.7.4.1-3ubuntu4) ... 2023-11-28T19:56:46.180 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-ceph-common (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T19:56:46.239 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up python3-tempora (4.1.2-1) ... 2023-11-28T19:56:46.490 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-idna (3.3-1) ... 2023-11-28T19:56:46.516 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2023-11-28T19:56:46.775 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up python3-prettytable (2.5.0-2) ... 2023-11-28T19:56:46.817 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-sklearn (0.23.2-5ubuntu6) ... 2023-11-28T19:56:47.043 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2023-11-28T19:56:47.186 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up python3-websocket (1.2.3-1) ... 2023-11-28T19:56:47.453 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up libonig5:amd64 (6.9.7.1-2build1) ... 2023-11-28T19:56:47.580 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2023-11-28T19:56:47.873 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up python3-webob (1:1.8.6-1.1) ... 2023-11-28T19:56:48.031 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up pkg-config (0.29.2-1ubuntu3) ... 2023-11-28T19:56:48.174 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up python3-jaraco.collections (3.4.0-2) ... 2023-11-28T19:56:48.291 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-11-28T19:56:48.401 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-toml (0.10.2-1) ... 2023-11-28T19:56:48.434 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up liblua5.3-dev:amd64 (5.3.6-1build1) ... 2023-11-28T19:56:48.560 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up lua-sec:amd64 (1.0.2-1) ... 2023-11-28T19:56:48.677 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up librdkafka1:amd64 (1.8.0-1build1) ... 2023-11-28T19:56:48.678 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up python3-babel (2.8.0+dfsg.1-7) ... 2023-11-28T19:56:48.749 INFO:teuthology.orchestra.run.smithi179.stdout:update-alternatives: using /usr/bin/pybabel-python3 to provide /usr/bin/pybabel (pybabel) in auto mode 2023-11-28T19:56:48.820 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up xmlstarlet (1.6.1-2.1) ... 2023-11-28T19:56:48.946 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2023-11-28T19:56:48.988 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up libjq1:amd64 (1.6-2.1ubuntu3) ... 2023-11-28T19:56:49.155 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up python3-pytest (6.2.5-1ubuntu2) ... 2023-11-28T19:56:49.272 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-pluggy (0.13.0-7.1) ... 2023-11-28T19:56:49.551 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up python3-pastedeploy (2.1.1-1) ... 2023-11-28T19:56:49.557 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-zc.lockfile (2.0-1) ... 2023-11-28T19:56:49.800 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-11-28T19:56:49.819 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up lua-any (27ubuntu1) ... 2023-11-28T19:56:49.901 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-pyasn1 (0.4.8-1) ... 2023-11-28T19:56:49.928 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up python3-portend (3.0.0-1) ... 2023-11-28T19:56:50.180 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-11-28T19:56:50.244 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-singledispatch (3.4.0.3-3) ... 2023-11-28T19:56:50.305 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up python3-jinja2 (3.0.3-1) ... 2023-11-28T19:56:50.503 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-logutils (0.3.3-8) ... 2023-11-28T19:56:50.624 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up python3-pyasn1-modules (0.2.1-1) ... 2023-11-28T19:56:50.771 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-tempora (4.1.2-1) ... 2023-11-28T19:56:50.933 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2023-11-28T19:56:51.081 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2023-11-28T19:56:51.235 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up jq (1.6-2.1ubuntu3) ... 2023-11-28T19:56:51.341 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-prettytable (2.5.0-2) ... 2023-11-28T19:56:51.446 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up python3-rsa (4.8-1) ... 2023-11-28T19:56:51.600 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2023-11-28T19:56:51.701 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-websocket (1.2.3-1) ... 2023-11-28T19:56:51.723 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up python3-webtest (2.0.35-1) ... 2023-11-28T19:56:52.010 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up libonig5:amd64 (6.9.7.1-2build1) ... 2023-11-28T19:56:52.026 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up python3-requests-oauthlib (1.3.0+ds-0.1) ... 2023-11-28T19:56:52.136 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2023-11-28T19:56:52.318 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up python3-cherrypy3 (18.6.1-4) ... 2023-11-28T19:56:52.429 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-webob (1:1.8.6-1.1) ... 2023-11-28T19:56:52.703 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up python3-pastescript (2.0.2-4) ... 2023-11-28T19:56:52.739 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-jaraco.collections (3.4.0-2) ... 2023-11-28T19:56:52.980 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up python3-pecan (1.3.3-4ubuntu2) ... 2023-11-28T19:56:53.015 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up liblua5.3-dev:amd64 (5.3.6-1build1) ... 2023-11-28T19:56:53.133 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up lua-sec:amd64 (1.0.2-1) ... 2023-11-28T19:56:53.242 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-babel (2.8.0+dfsg.1-7) ... 2023-11-28T19:56:53.314 INFO:teuthology.orchestra.run.smithi078.stdout:update-alternatives: using /usr/bin/pybabel-python3 to provide /usr/bin/pybabel (pybabel) in auto mode 2023-11-28T19:56:53.357 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up libthrift-0.16.0:amd64 (0.16.0-2) ... 2023-11-28T19:56:53.467 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up librados2 (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T19:56:53.569 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up libjq1:amd64 (1.6-2.1ubuntu3) ... 2023-11-28T19:56:53.593 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up libsqlite3-mod-ceph (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T19:56:53.695 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-pytest (6.2.5-1ubuntu2) ... 2023-11-28T19:56:53.719 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up luarocks (3.8.0+dfsg1-1) ... 2023-11-28T19:56:54.072 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up libcephfs2 (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T19:56:54.097 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-pastedeploy (2.1.1-1) ... 2023-11-28T19:56:54.199 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up libradosstriper1 (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T19:56:54.325 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up python3-google-auth (1.5.1-3) ... 2023-11-28T19:56:54.373 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up lua-any (27ubuntu1) ... 2023-11-28T19:56:54.517 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-portend (3.0.0-1) ... 2023-11-28T19:56:54.627 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up librbd1 (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T19:56:54.728 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up ceph-mgr-modules-core (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T19:56:54.758 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-11-28T19:56:54.837 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up ceph-fuse (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T19:56:54.868 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-jinja2 (3.0.3-1) ... 2023-11-28T19:56:55.047 INFO:teuthology.orchestra.run.smithi179.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2023-11-28T19:56:55.048 INFO:teuthology.orchestra.run.smithi179.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2023-11-28T19:56:55.194 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-pyasn1-modules (0.2.1-1) ... 2023-11-28T19:56:55.504 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2023-11-28T19:56:55.656 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up libcephfs-dev (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T19:56:55.782 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up python3-rados (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T19:56:55.788 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up jq (1.6-2.1ubuntu3) ... 2023-11-28T19:56:55.908 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up librgw2 (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T19:56:55.992 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-rsa (4.8-1) ... 2023-11-28T19:56:56.059 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up cephfs-top (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T19:56:56.177 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up python3-kubernetes (12.0.1-1ubuntu1) ... 2023-11-28T19:56:56.251 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-webtest (2.0.35-1) ... 2023-11-28T19:56:56.528 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-requests-oauthlib (1.3.0+ds-0.1) ... 2023-11-28T19:56:56.804 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-cherrypy3 (18.6.1-4) ... 2023-11-28T19:56:57.223 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-pastescript (2.0.2-4) ... 2023-11-28T19:56:57.464 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up python3-rbd (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T19:56:57.508 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-pecan (1.3.3-4ubuntu2) ... 2023-11-28T19:56:57.574 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up rbd-fuse (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T19:56:57.675 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up python3-rgw (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T19:56:57.801 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up python3-cephfs (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T19:56:57.843 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up libthrift-0.16.0:amd64 (0.16.0-2) ... 2023-11-28T19:56:57.936 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up cephfs-shell (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T19:56:57.970 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up librados2 (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T19:56:58.037 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up ceph-common (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T19:56:58.121 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up libsqlite3-mod-ceph (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T19:56:58.246 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up luarocks (3.8.0+dfsg1-1) ... 2023-11-28T19:56:58.541 INFO:teuthology.orchestra.run.smithi179.stdout:Adding group ceph....done 2023-11-28T19:56:58.566 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up libcephfs2 (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T19:56:58.667 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up libradosstriper1 (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T19:56:58.793 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-google-auth (1.5.1-3) ... 2023-11-28T19:56:59.112 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up librbd1 (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T19:56:59.237 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up ceph-mgr-modules-core (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T19:56:59.242 INFO:teuthology.orchestra.run.smithi179.stdout:Adding system user ceph....done 2023-11-28T19:56:59.364 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up ceph-fuse (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T19:56:59.429 INFO:teuthology.orchestra.run.smithi179.stdout:Setting system user ceph properties....done 2023-11-28T19:56:59.445 INFO:teuthology.orchestra.run.smithi179.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2023-11-28T19:56:59.574 INFO:teuthology.orchestra.run.smithi078.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2023-11-28T19:56:59.574 INFO:teuthology.orchestra.run.smithi078.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2023-11-28T19:56:59.588 INFO:teuthology.orchestra.run.smithi179.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2023-11-28T19:56:59.982 INFO:teuthology.orchestra.run.smithi179.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2023-11-28T19:57:00.240 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up libcephfs-dev (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T19:57:00.366 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-rados (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T19:57:00.484 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up librgw2 (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T19:57:00.602 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up cephfs-top (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T19:57:00.656 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up cephfs-mirror (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T19:57:00.761 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-kubernetes (12.0.1-1ubuntu1) ... 2023-11-28T19:57:00.864 INFO:teuthology.orchestra.run.smithi179.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2023-11-28T19:57:00.864 INFO:teuthology.orchestra.run.smithi179.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2023-11-28T19:57:01.508 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up ceph-test (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T19:57:01.634 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up radosgw (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T19:57:02.056 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-rbd (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T19:57:02.166 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up rbd-fuse (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T19:57:02.267 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-rgw (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T19:57:02.385 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-cephfs (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T19:57:02.542 INFO:teuthology.orchestra.run.smithi179.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2023-11-28T19:57:02.542 INFO:teuthology.orchestra.run.smithi179.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2023-11-28T19:57:02.544 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up cephfs-shell (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T19:57:02.670 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up ceph-common (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T19:57:03.162 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up ceph-base (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T19:57:03.224 INFO:teuthology.orchestra.run.smithi078.stdout:Adding group ceph....done 2023-11-28T19:57:03.523 INFO:teuthology.orchestra.run.smithi179.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2023-11-28T19:57:03.600 INFO:teuthology.orchestra.run.smithi078.stdout:Adding system user ceph....done 2023-11-28T19:57:03.787 INFO:teuthology.orchestra.run.smithi078.stdout:Setting system user ceph properties....done 2023-11-28T19:57:03.801 INFO:teuthology.orchestra.run.smithi078.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2023-11-28T19:57:03.942 INFO:teuthology.orchestra.run.smithi078.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2023-11-28T19:57:04.215 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up ceph-mds (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T19:57:04.336 INFO:teuthology.orchestra.run.smithi078.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2023-11-28T19:57:04.464 INFO:teuthology.orchestra.run.smithi179.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2023-11-28T19:57:04.464 INFO:teuthology.orchestra.run.smithi179.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2023-11-28T19:57:05.014 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up cephfs-mirror (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T19:57:05.075 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up ceph-mgr (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T19:57:05.223 INFO:teuthology.orchestra.run.smithi078.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2023-11-28T19:57:05.223 INFO:teuthology.orchestra.run.smithi078.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2023-11-28T19:57:05.288 INFO:teuthology.orchestra.run.smithi179.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2023-11-28T19:57:05.288 INFO:teuthology.orchestra.run.smithi179.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2023-11-28T19:57:05.910 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up ceph-osd (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T19:57:05.957 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up ceph-test (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T19:57:06.100 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up radosgw (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T19:57:06.271 INFO:teuthology.orchestra.run.smithi179.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2023-11-28T19:57:06.271 INFO:teuthology.orchestra.run.smithi179.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2023-11-28T19:57:06.638 INFO:teuthology.orchestra.run.smithi078.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2023-11-28T19:57:06.639 INFO:teuthology.orchestra.run.smithi078.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2023-11-28T19:57:06.903 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up ceph-mgr-k8sevents (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T19:57:07.063 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up ceph-mgr-diskprediction-local (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T19:57:07.206 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up ceph-mon (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T19:57:07.219 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up ceph-base (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T19:57:07.419 INFO:teuthology.orchestra.run.smithi179.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2023-11-28T19:57:07.419 INFO:teuthology.orchestra.run.smithi179.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2023-11-28T19:57:07.851 INFO:teuthology.orchestra.run.smithi078.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2023-11-28T19:57:08.050 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up ceph-mgr-cephadm (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T19:57:08.200 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up ceph (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T19:57:08.321 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up ceph-mgr-dashboard (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T19:57:08.436 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up ceph-volume (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T19:57:08.563 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up ceph-mds (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T19:57:08.772 INFO:teuthology.orchestra.run.smithi179.stdout:Processing triggers for mailcap (3.70+nmu1ubuntu1) ... 2023-11-28T19:57:08.786 INFO:teuthology.orchestra.run.smithi078.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2023-11-28T19:57:08.786 INFO:teuthology.orchestra.run.smithi078.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2023-11-28T19:57:08.919 INFO:teuthology.orchestra.run.smithi179.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2023-11-28T19:57:09.151 INFO:teuthology.orchestra.run.smithi179.stdout:Processing triggers for man-db (2.10.2-1) ... 2023-11-28T19:57:09.424 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up ceph-mgr (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T19:57:09.636 INFO:teuthology.orchestra.run.smithi078.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2023-11-28T19:57:09.636 INFO:teuthology.orchestra.run.smithi078.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2023-11-28T19:57:10.270 INFO:teuthology.orchestra.run.smithi179.stdout:Processing triggers for install-info (6.8-4build1) ... 2023-11-28T19:57:10.275 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up ceph-osd (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T19:57:10.593 INFO:teuthology.orchestra.run.smithi078.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2023-11-28T19:57:10.593 INFO:teuthology.orchestra.run.smithi078.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2023-11-28T19:57:11.004 INFO:teuthology.orchestra.run.smithi179.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2023-11-28T19:57:11.009 DEBUG:teuthology.orchestra.run.smithi179:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install bison flex libelf-dev libssl-dev network-manager iproute2 util-linux dump indent libaio-dev libtool-bin uuid-dev xfslibs-dev postgresql postgresql-client postgresql-common postgresql-contrib 2023-11-28T19:57:11.084 INFO:teuthology.orchestra.run.smithi179.stdout:Reading package lists... 2023-11-28T19:57:11.251 INFO:teuthology.orchestra.run.smithi179.stdout:Building dependency tree... 2023-11-28T19:57:11.252 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up ceph-mgr-k8sevents (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T19:57:11.252 INFO:teuthology.orchestra.run.smithi179.stdout:Reading state information... 2023-11-28T19:57:11.386 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up ceph-mgr-diskprediction-local (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T19:57:11.401 INFO:teuthology.orchestra.run.smithi179.stdout:iproute2 is already the newest version (5.15.0-1ubuntu2). 2023-11-28T19:57:11.401 INFO:teuthology.orchestra.run.smithi179.stdout:libtool-bin is already the newest version (2.4.6-15build2). 2023-11-28T19:57:11.401 INFO:teuthology.orchestra.run.smithi179.stdout:util-linux is already the newest version (2.37.2-4ubuntu3). 2023-11-28T19:57:11.401 INFO:teuthology.orchestra.run.smithi179.stdout:uuid-dev is already the newest version (2.37.2-4ubuntu3). 2023-11-28T19:57:11.401 INFO:teuthology.orchestra.run.smithi179.stdout:xfslibs-dev is already the newest version (5.13.0-1ubuntu2). 2023-11-28T19:57:11.402 INFO:teuthology.orchestra.run.smithi179.stdout:The following packages were automatically installed and are no longer required: 2023-11-28T19:57:11.402 INFO:teuthology.orchestra.run.smithi179.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2023-11-28T19:57:11.402 INFO:teuthology.orchestra.run.smithi179.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2023-11-28T19:57:11.402 INFO:teuthology.orchestra.run.smithi179.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2023-11-28T19:57:11.402 INFO:teuthology.orchestra.run.smithi179.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2023-11-28T19:57:11.402 INFO:teuthology.orchestra.run.smithi179.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2023-11-28T19:57:11.402 INFO:teuthology.orchestra.run.smithi179.stdout:Use 'sudo apt autoremove' to remove them. 2023-11-28T19:57:11.403 INFO:teuthology.orchestra.run.smithi179.stdout:The following additional packages will be installed: 2023-11-28T19:57:11.403 INFO:teuthology.orchestra.run.smithi179.stdout: libbluetooth3 libfl-dev libfl2 libjson-perl libllvm14 liblzo2-2 2023-11-28T19:57:11.403 INFO:teuthology.orchestra.run.smithi179.stdout: libmbim-glib4 libmbim-proxy libmm-glib0 libndp0 libnm0 libpq5 libqmi-glib5 2023-11-28T19:57:11.404 INFO:teuthology.orchestra.run.smithi179.stdout: libqmi-proxy libssl3 libteamdctl0 modemmanager network-manager-pptp 2023-11-28T19:57:11.404 INFO:teuthology.orchestra.run.smithi179.stdout: postgresql-14 postgresql-client-14 postgresql-client-common ppp pptp-linux 2023-11-28T19:57:11.404 INFO:teuthology.orchestra.run.smithi179.stdout: tcl tcl8.6 usb-modeswitch usb-modeswitch-data wpasupplicant 2023-11-28T19:57:11.404 INFO:teuthology.orchestra.run.smithi179.stdout:Suggested packages: 2023-11-28T19:57:11.405 INFO:teuthology.orchestra.run.smithi179.stdout: bison-doc flex-doc indent-doc libssl-doc avahi-autoipd libteam-utils 2023-11-28T19:57:11.405 INFO:teuthology.orchestra.run.smithi179.stdout: postgresql-doc postgresql-doc-14 tcl-tclreadline comgt wvdial wpagui 2023-11-28T19:57:11.405 INFO:teuthology.orchestra.run.smithi179.stdout: libengine-pkcs11-openssl 2023-11-28T19:57:11.453 INFO:teuthology.orchestra.run.smithi179.stdout:The following NEW packages will be installed: 2023-11-28T19:57:11.453 INFO:teuthology.orchestra.run.smithi179.stdout: bison dump flex indent libaio-dev libbluetooth3 libelf-dev libfl-dev libfl2 2023-11-28T19:57:11.453 INFO:teuthology.orchestra.run.smithi179.stdout: libjson-perl libllvm14 liblzo2-2 libmbim-glib4 libmbim-proxy libmm-glib0 2023-11-28T19:57:11.454 INFO:teuthology.orchestra.run.smithi179.stdout: libndp0 libnm0 libpq5 libqmi-glib5 libqmi-proxy libssl-dev libteamdctl0 2023-11-28T19:57:11.454 INFO:teuthology.orchestra.run.smithi179.stdout: modemmanager network-manager network-manager-pptp postgresql postgresql-14 2023-11-28T19:57:11.454 INFO:teuthology.orchestra.run.smithi179.stdout: postgresql-client postgresql-client-14 postgresql-client-common 2023-11-28T19:57:11.454 INFO:teuthology.orchestra.run.smithi179.stdout: postgresql-common postgresql-contrib ppp pptp-linux tcl tcl8.6 2023-11-28T19:57:11.454 INFO:teuthology.orchestra.run.smithi179.stdout: usb-modeswitch usb-modeswitch-data wpasupplicant 2023-11-28T19:57:11.454 INFO:teuthology.orchestra.run.smithi179.stdout:The following packages will be upgraded: 2023-11-28T19:57:11.455 INFO:teuthology.orchestra.run.smithi179.stdout: libssl3 2023-11-28T19:57:11.553 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up ceph-mon (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T19:57:11.679 INFO:teuthology.orchestra.run.smithi179.stdout:1 upgraded, 39 newly installed, 0 to remove and 263 not upgraded. 2023-11-28T19:57:11.679 INFO:teuthology.orchestra.run.smithi179.stdout:Need to get 54.6 MB of archives. 2023-11-28T19:57:11.680 INFO:teuthology.orchestra.run.smithi179.stdout:After this operation, 202 MB of additional disk space will be used. 2023-11-28T19:57:11.680 INFO:teuthology.orchestra.run.smithi179.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/main amd64 flex amd64 2.6.4-8build2 [307 kB] 2023-11-28T19:57:11.764 INFO:teuthology.orchestra.run.smithi078.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2023-11-28T19:57:11.764 INFO:teuthology.orchestra.run.smithi078.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2023-11-28T19:57:12.174 INFO:teuthology.orchestra.run.smithi179.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl3 amd64 3.0.2-0ubuntu1.12 [1,901 kB] 2023-11-28T19:57:12.405 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up ceph-mgr-cephadm (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T19:57:12.432 INFO:teuthology.orchestra.run.smithi179.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy/main amd64 bison amd64 2:3.8.2+dfsg-1build1 [748 kB] 2023-11-28T19:57:12.466 INFO:teuthology.orchestra.run.smithi179.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblzo2-2 amd64 2.10-2build3 [53.7 kB] 2023-11-28T19:57:12.468 INFO:teuthology.orchestra.run.smithi179.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy/universe amd64 dump amd64 0.4b47-3 [133 kB] 2023-11-28T19:57:12.473 INFO:teuthology.orchestra.run.smithi179.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 indent amd64 2.2.12-1ubuntu0.22.04.1 [90.8 kB] 2023-11-28T19:57:12.476 INFO:teuthology.orchestra.run.smithi179.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy/main amd64 libaio-dev amd64 0.3.112-13build1 [21.2 kB] 2023-11-28T19:57:12.477 INFO:teuthology.orchestra.run.smithi179.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy/main amd64 libbluetooth3 amd64 5.64-0ubuntu1 [86.9 kB] 2023-11-28T19:57:12.480 INFO:teuthology.orchestra.run.smithi179.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy/main amd64 libelf-dev amd64 0.186-1build1 [64.4 kB] 2023-11-28T19:57:12.482 INFO:teuthology.orchestra.run.smithi179.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl2 amd64 2.6.4-8build2 [10.7 kB] 2023-11-28T19:57:12.483 INFO:teuthology.orchestra.run.smithi179.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl-dev amd64 2.6.4-8build2 [6,236 B] 2023-11-28T19:57:12.547 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up ceph (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T19:57:12.646 INFO:teuthology.orchestra.run.smithi179.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjson-perl all 4.04000-1 [81.8 kB] 2023-11-28T19:57:12.665 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up ceph-mgr-dashboard (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T19:57:12.981 INFO:teuthology.orchestra.run.smithi179.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libllvm14 amd64 1:14.0.0-1ubuntu1.1 [24.0 MB] 2023-11-28T19:57:13.280 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up ceph-volume (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T19:57:13.642 INFO:teuthology.orchestra.run.smithi078.stdout:Processing triggers for mailcap (3.70+nmu1ubuntu1) ... 2023-11-28T19:57:13.734 INFO:teuthology.orchestra.run.smithi078.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2023-11-28T19:57:13.886 INFO:teuthology.orchestra.run.smithi078.stdout:Processing triggers for man-db (2.10.2-1) ... 2023-11-28T19:57:14.048 INFO:teuthology.orchestra.run.smithi179.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmbim-glib4 amd64 1.28.0-1~ubuntu20.04.1 [191 kB] 2023-11-28T19:57:14.049 INFO:teuthology.orchestra.run.smithi179.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmbim-proxy amd64 1.28.0-1~ubuntu20.04.1 [6,130 B] 2023-11-28T19:57:14.050 INFO:teuthology.orchestra.run.smithi179.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmm-glib0 amd64 1.20.0-1~ubuntu22.04.2 [263 kB] 2023-11-28T19:57:14.053 INFO:teuthology.orchestra.run.smithi179.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy/main amd64 libndp0 amd64 1.8-0ubuntu3 [12.3 kB] 2023-11-28T19:57:14.053 INFO:teuthology.orchestra.run.smithi179.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libnm0 amd64 1.36.6-0ubuntu2 [456 kB] 2023-11-28T19:57:14.057 INFO:teuthology.orchestra.run.smithi179.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpq5 amd64 14.9-0ubuntu0.22.04.1 [141 kB] 2023-11-28T19:57:14.059 INFO:teuthology.orchestra.run.smithi179.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libqmi-glib5 amd64 1.32.0-1ubuntu0.22.04.1 [772 kB] 2023-11-28T19:57:14.078 INFO:teuthology.orchestra.run.smithi179.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libqmi-proxy amd64 1.32.0-1ubuntu0.22.04.1 [6,072 B] 2023-11-28T19:57:14.079 INFO:teuthology.orchestra.run.smithi179.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl-dev amd64 3.0.2-0ubuntu1.12 [2,373 kB] 2023-11-28T19:57:14.323 INFO:teuthology.orchestra.run.smithi179.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy/main amd64 libteamdctl0 amd64 1.31-1build2 [12.6 kB] 2023-11-28T19:57:14.406 INFO:teuthology.orchestra.run.smithi179.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 modemmanager amd64 1.20.0-1~ubuntu22.04.2 [1,094 kB] 2023-11-28T19:57:14.880 INFO:teuthology.orchestra.run.smithi179.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 network-manager amd64 1.36.6-0ubuntu2 [2,203 kB] 2023-11-28T19:57:15.010 INFO:teuthology.orchestra.run.smithi179.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 ppp amd64 2.4.9-1+1ubuntu3 [363 kB] 2023-11-28T19:57:15.021 INFO:teuthology.orchestra.run.smithi179.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/main amd64 pptp-linux amd64 1.10.0-1build3 [42.5 kB] 2023-11-28T19:57:15.021 INFO:teuthology.orchestra.run.smithi179.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/main amd64 network-manager-pptp amd64 1.2.10-1 [30.9 kB] 2023-11-28T19:57:15.022 INFO:teuthology.orchestra.run.smithi179.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-client-common all 238 [29.6 kB] 2023-11-28T19:57:15.024 INFO:teuthology.orchestra.run.smithi179.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 postgresql-client-14 amd64 14.9-0ubuntu0.22.04.1 [1,222 kB] 2023-11-28T19:57:15.039 INFO:teuthology.orchestra.run.smithi078.stdout:Processing triggers for install-info (6.8-4build1) ... 2023-11-28T19:57:15.058 INFO:teuthology.orchestra.run.smithi179.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-common all 238 [169 kB] 2023-11-28T19:57:15.061 INFO:teuthology.orchestra.run.smithi179.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 postgresql-14 amd64 14.9-0ubuntu0.22.04.1 [16.1 MB] 2023-11-28T19:57:15.500 INFO:teuthology.orchestra.run.smithi179.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql all 14+238 [3,288 B] 2023-11-28T19:57:15.663 INFO:teuthology.orchestra.run.smithi179.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-client all 14+238 [3,292 B] 2023-11-28T19:57:15.720 INFO:teuthology.orchestra.run.smithi078.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2023-11-28T19:57:15.724 DEBUG:teuthology.orchestra.run.smithi078:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install bison flex libelf-dev libssl-dev network-manager iproute2 util-linux dump indent libaio-dev libtool-bin uuid-dev xfslibs-dev postgresql postgresql-client postgresql-common postgresql-contrib 2023-11-28T19:57:15.745 INFO:teuthology.orchestra.run.smithi179.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-contrib all 14+238 [3,292 B] 2023-11-28T19:57:15.746 INFO:teuthology.orchestra.run.smithi179.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 tcl8.6 amd64 8.6.12+dfsg-1build1 [15.0 kB] 2023-11-28T19:57:15.799 INFO:teuthology.orchestra.run.smithi078.stdout:Reading package lists... 2023-11-28T19:57:15.826 INFO:teuthology.orchestra.run.smithi179.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 tcl amd64 8.6.11+1build2 [4,678 B] 2023-11-28T19:57:15.835 INFO:teuthology.orchestra.run.smithi179.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 wpasupplicant amd64 2:2.10-6ubuntu2 [1,481 kB] 2023-11-28T19:57:15.963 INFO:teuthology.orchestra.run.smithi078.stdout:Building dependency tree... 2023-11-28T19:57:15.964 INFO:teuthology.orchestra.run.smithi078.stdout:Reading state information... 2023-11-28T19:57:16.113 INFO:teuthology.orchestra.run.smithi078.stdout:iproute2 is already the newest version (5.15.0-1ubuntu2). 2023-11-28T19:57:16.113 INFO:teuthology.orchestra.run.smithi078.stdout:libtool-bin is already the newest version (2.4.6-15build2). 2023-11-28T19:57:16.113 INFO:teuthology.orchestra.run.smithi078.stdout:util-linux is already the newest version (2.37.2-4ubuntu3). 2023-11-28T19:57:16.113 INFO:teuthology.orchestra.run.smithi078.stdout:uuid-dev is already the newest version (2.37.2-4ubuntu3). 2023-11-28T19:57:16.113 INFO:teuthology.orchestra.run.smithi078.stdout:xfslibs-dev is already the newest version (5.13.0-1ubuntu2). 2023-11-28T19:57:16.113 INFO:teuthology.orchestra.run.smithi078.stdout:The following packages were automatically installed and are no longer required: 2023-11-28T19:57:16.114 INFO:teuthology.orchestra.run.smithi078.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2023-11-28T19:57:16.114 INFO:teuthology.orchestra.run.smithi078.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2023-11-28T19:57:16.114 INFO:teuthology.orchestra.run.smithi078.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2023-11-28T19:57:16.114 INFO:teuthology.orchestra.run.smithi078.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2023-11-28T19:57:16.115 INFO:teuthology.orchestra.run.smithi078.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2023-11-28T19:57:16.115 INFO:teuthology.orchestra.run.smithi078.stdout:Use 'sudo apt autoremove' to remove them. 2023-11-28T19:57:16.115 INFO:teuthology.orchestra.run.smithi078.stdout:The following additional packages will be installed: 2023-11-28T19:57:16.115 INFO:teuthology.orchestra.run.smithi078.stdout: libbluetooth3 libfl-dev libfl2 libjson-perl libllvm14 liblzo2-2 2023-11-28T19:57:16.115 INFO:teuthology.orchestra.run.smithi078.stdout: libmbim-glib4 libmbim-proxy libmm-glib0 libndp0 libnm0 libpq5 libqmi-glib5 2023-11-28T19:57:16.115 INFO:teuthology.orchestra.run.smithi078.stdout: libqmi-proxy libssl3 libteamdctl0 modemmanager network-manager-pptp 2023-11-28T19:57:16.115 INFO:teuthology.orchestra.run.smithi078.stdout: postgresql-14 postgresql-client-14 postgresql-client-common ppp pptp-linux 2023-11-28T19:57:16.115 INFO:teuthology.orchestra.run.smithi078.stdout: tcl tcl8.6 usb-modeswitch usb-modeswitch-data wpasupplicant 2023-11-28T19:57:16.116 INFO:teuthology.orchestra.run.smithi078.stdout:Suggested packages: 2023-11-28T19:57:16.116 INFO:teuthology.orchestra.run.smithi078.stdout: bison-doc flex-doc indent-doc libssl-doc avahi-autoipd libteam-utils 2023-11-28T19:57:16.116 INFO:teuthology.orchestra.run.smithi078.stdout: postgresql-doc postgresql-doc-14 tcl-tclreadline comgt wvdial wpagui 2023-11-28T19:57:16.116 INFO:teuthology.orchestra.run.smithi078.stdout: libengine-pkcs11-openssl 2023-11-28T19:57:16.165 INFO:teuthology.orchestra.run.smithi078.stdout:The following NEW packages will be installed: 2023-11-28T19:57:16.165 INFO:teuthology.orchestra.run.smithi078.stdout: bison dump flex indent libaio-dev libbluetooth3 libelf-dev libfl-dev libfl2 2023-11-28T19:57:16.166 INFO:teuthology.orchestra.run.smithi078.stdout: libjson-perl libllvm14 liblzo2-2 libmbim-glib4 libmbim-proxy libmm-glib0 2023-11-28T19:57:16.166 INFO:teuthology.orchestra.run.smithi078.stdout: libndp0 libnm0 libpq5 libqmi-glib5 libqmi-proxy libssl-dev libteamdctl0 2023-11-28T19:57:16.166 INFO:teuthology.orchestra.run.smithi078.stdout: modemmanager network-manager network-manager-pptp postgresql postgresql-14 2023-11-28T19:57:16.166 INFO:teuthology.orchestra.run.smithi078.stdout: postgresql-client postgresql-client-14 postgresql-client-common 2023-11-28T19:57:16.166 INFO:teuthology.orchestra.run.smithi078.stdout: postgresql-common postgresql-contrib ppp pptp-linux tcl tcl8.6 2023-11-28T19:57:16.166 INFO:teuthology.orchestra.run.smithi078.stdout: usb-modeswitch usb-modeswitch-data wpasupplicant 2023-11-28T19:57:16.167 INFO:teuthology.orchestra.run.smithi078.stdout:The following packages will be upgraded: 2023-11-28T19:57:16.167 INFO:teuthology.orchestra.run.smithi078.stdout: libssl3 2023-11-28T19:57:16.302 INFO:teuthology.orchestra.run.smithi179.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 usb-modeswitch-data all 20191128-4 [33.2 kB] 2023-11-28T19:57:16.304 INFO:teuthology.orchestra.run.smithi179.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 usb-modeswitch amd64 2.6.1-3ubuntu2 [46.0 kB] 2023-11-28T19:57:16.351 INFO:teuthology.orchestra.run.smithi078.stdout:1 upgraded, 39 newly installed, 0 to remove and 263 not upgraded. 2023-11-28T19:57:16.352 INFO:teuthology.orchestra.run.smithi078.stdout:Need to get 54.6 MB of archives. 2023-11-28T19:57:16.352 INFO:teuthology.orchestra.run.smithi078.stdout:After this operation, 202 MB of additional disk space will be used. 2023-11-28T19:57:16.352 INFO:teuthology.orchestra.run.smithi078.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/main amd64 flex amd64 2.6.4-8build2 [307 kB] 2023-11-28T19:57:16.695 INFO:teuthology.orchestra.run.smithi179.stdout:Preconfiguring packages ... 2023-11-28T19:57:16.845 INFO:teuthology.orchestra.run.smithi078.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl3 amd64 3.0.2-0ubuntu1.12 [1,901 kB] 2023-11-28T19:57:16.854 INFO:teuthology.orchestra.run.smithi179.stdout:Fetched 54.6 MB in 5s (11.3 MB/s) 2023-11-28T19:57:16.971 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package flex. 2023-11-28T19:57:17.042 INFO:teuthology.orchestra.run.smithi179.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 140565 files and directories currently installed.) 2023-11-28T19:57:17.046 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../flex_2.6.4-8build2_amd64.deb ... 2023-11-28T19:57:17.086 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking flex (2.6.4-8build2) ... 2023-11-28T19:57:17.103 INFO:teuthology.orchestra.run.smithi078.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy/main amd64 bison amd64 2:3.8.2+dfsg-1build1 [748 kB] 2023-11-28T19:57:17.137 INFO:teuthology.orchestra.run.smithi078.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblzo2-2 amd64 2.10-2build3 [53.7 kB] 2023-11-28T19:57:17.139 INFO:teuthology.orchestra.run.smithi078.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy/universe amd64 dump amd64 0.4b47-3 [133 kB] 2023-11-28T19:57:17.144 INFO:teuthology.orchestra.run.smithi078.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 indent amd64 2.2.12-1ubuntu0.22.04.1 [90.8 kB] 2023-11-28T19:57:17.147 INFO:teuthology.orchestra.run.smithi078.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy/main amd64 libaio-dev amd64 0.3.112-13build1 [21.2 kB] 2023-11-28T19:57:17.148 INFO:teuthology.orchestra.run.smithi078.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy/main amd64 libbluetooth3 amd64 5.64-0ubuntu1 [86.9 kB] 2023-11-28T19:57:17.151 INFO:teuthology.orchestra.run.smithi078.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy/main amd64 libelf-dev amd64 0.186-1build1 [64.4 kB] 2023-11-28T19:57:17.153 INFO:teuthology.orchestra.run.smithi078.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl2 amd64 2.6.4-8build2 [10.7 kB] 2023-11-28T19:57:17.154 INFO:teuthology.orchestra.run.smithi078.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl-dev amd64 2.6.4-8build2 [6,236 B] 2023-11-28T19:57:17.318 INFO:teuthology.orchestra.run.smithi078.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjson-perl all 4.04000-1 [81.8 kB] 2023-11-28T19:57:17.614 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../libssl3_3.0.2-0ubuntu1.12_amd64.deb ... 2023-11-28T19:57:17.658 INFO:teuthology.orchestra.run.smithi078.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libllvm14 amd64 1:14.0.0-1ubuntu1.1 [24.0 MB] 2023-11-28T19:57:17.809 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking libssl3:amd64 (3.0.2-0ubuntu1.12) over (3.0.2-0ubuntu1.7) ... 2023-11-28T19:57:18.201 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up libssl3:amd64 (3.0.2-0ubuntu1.12) ... 2023-11-28T19:57:18.700 INFO:teuthology.orchestra.run.smithi078.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmbim-glib4 amd64 1.28.0-1~ubuntu20.04.1 [191 kB] 2023-11-28T19:57:18.723 INFO:teuthology.orchestra.run.smithi078.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmbim-proxy amd64 1.28.0-1~ubuntu20.04.1 [6,130 B] 2023-11-28T19:57:18.723 INFO:teuthology.orchestra.run.smithi078.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmm-glib0 amd64 1.20.0-1~ubuntu22.04.2 [263 kB] 2023-11-28T19:57:18.726 INFO:teuthology.orchestra.run.smithi078.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy/main amd64 libndp0 amd64 1.8-0ubuntu3 [12.3 kB] 2023-11-28T19:57:18.726 INFO:teuthology.orchestra.run.smithi078.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libnm0 amd64 1.36.6-0ubuntu2 [456 kB] 2023-11-28T19:57:18.731 INFO:teuthology.orchestra.run.smithi078.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpq5 amd64 14.9-0ubuntu0.22.04.1 [141 kB] 2023-11-28T19:57:18.732 INFO:teuthology.orchestra.run.smithi078.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libqmi-glib5 amd64 1.32.0-1ubuntu0.22.04.1 [772 kB] 2023-11-28T19:57:18.736 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package bison. 2023-11-28T19:57:18.765 INFO:teuthology.orchestra.run.smithi078.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libqmi-proxy amd64 1.32.0-1ubuntu0.22.04.1 [6,072 B] 2023-11-28T19:57:18.765 INFO:teuthology.orchestra.run.smithi078.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl-dev amd64 3.0.2-0ubuntu1.12 [2,373 kB] 2023-11-28T19:57:18.808 INFO:teuthology.orchestra.run.smithi179.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 140638 files and directories currently installed.) 2023-11-28T19:57:18.811 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../00-bison_2%3a3.8.2+dfsg-1build1_amd64.deb ... 2023-11-28T19:57:18.856 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking bison (2:3.8.2+dfsg-1build1) ... 2023-11-28T19:57:18.980 INFO:teuthology.orchestra.run.smithi078.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy/main amd64 libteamdctl0 amd64 1.31-1build2 [12.6 kB] 2023-11-28T19:57:19.062 INFO:teuthology.orchestra.run.smithi078.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 modemmanager amd64 1.20.0-1~ubuntu22.04.2 [1,094 kB] 2023-11-28T19:57:19.249 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package liblzo2-2:amd64. 2023-11-28T19:57:19.264 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../01-liblzo2-2_2.10-2build3_amd64.deb ... 2023-11-28T19:57:19.307 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking liblzo2-2:amd64 (2.10-2build3) ... 2023-11-28T19:57:19.535 INFO:teuthology.orchestra.run.smithi078.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 network-manager amd64 1.36.6-0ubuntu2 [2,203 kB] 2023-11-28T19:57:19.619 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package dump. 2023-11-28T19:57:19.634 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../02-dump_0.4b47-3_amd64.deb ... 2023-11-28T19:57:19.665 INFO:teuthology.orchestra.run.smithi078.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 ppp amd64 2.4.9-1+1ubuntu3 [363 kB] 2023-11-28T19:57:19.676 INFO:teuthology.orchestra.run.smithi078.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/main amd64 pptp-linux amd64 1.10.0-1build3 [42.5 kB] 2023-11-28T19:57:19.676 INFO:teuthology.orchestra.run.smithi078.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/main amd64 network-manager-pptp amd64 1.2.10-1 [30.9 kB] 2023-11-28T19:57:19.677 INFO:teuthology.orchestra.run.smithi078.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-client-common all 238 [29.6 kB] 2023-11-28T19:57:19.679 INFO:teuthology.orchestra.run.smithi078.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 postgresql-client-14 amd64 14.9-0ubuntu0.22.04.1 [1,222 kB] 2023-11-28T19:57:19.702 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking dump (0.4b47-3) ... 2023-11-28T19:57:19.712 INFO:teuthology.orchestra.run.smithi078.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-common all 238 [169 kB] 2023-11-28T19:57:19.716 INFO:teuthology.orchestra.run.smithi078.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 postgresql-14 amd64 14.9-0ubuntu0.22.04.1 [16.1 MB] 2023-11-28T19:57:19.982 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package indent. 2023-11-28T19:57:19.996 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../03-indent_2.2.12-1ubuntu0.22.04.1_amd64.deb ... 2023-11-28T19:57:20.031 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking indent (2.2.12-1ubuntu0.22.04.1) ... 2023-11-28T19:57:20.156 INFO:teuthology.orchestra.run.smithi078.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql all 14+238 [3,288 B] 2023-11-28T19:57:20.251 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package libaio-dev:amd64. 2023-11-28T19:57:20.266 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../04-libaio-dev_0.3.112-13build1_amd64.deb ... 2023-11-28T19:57:20.309 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking libaio-dev:amd64 (0.3.112-13build1) ... 2023-11-28T19:57:20.320 INFO:teuthology.orchestra.run.smithi078.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-client all 14+238 [3,292 B] 2023-11-28T19:57:20.403 INFO:teuthology.orchestra.run.smithi078.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-contrib all 14+238 [3,292 B] 2023-11-28T19:57:20.403 INFO:teuthology.orchestra.run.smithi078.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 tcl8.6 amd64 8.6.12+dfsg-1build1 [15.0 kB] 2023-11-28T19:57:20.488 INFO:teuthology.orchestra.run.smithi078.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 tcl amd64 8.6.11+1build2 [4,678 B] 2023-11-28T19:57:20.498 INFO:teuthology.orchestra.run.smithi078.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 wpasupplicant amd64 2:2.10-6ubuntu2 [1,481 kB] 2023-11-28T19:57:20.663 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package libbluetooth3:amd64. 2023-11-28T19:57:20.679 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../05-libbluetooth3_5.64-0ubuntu1_amd64.deb ... 2023-11-28T19:57:20.721 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking libbluetooth3:amd64 (5.64-0ubuntu1) ... 2023-11-28T19:57:20.960 INFO:teuthology.orchestra.run.smithi078.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 usb-modeswitch-data all 20191128-4 [33.2 kB] 2023-11-28T19:57:20.962 INFO:teuthology.orchestra.run.smithi078.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 usb-modeswitch amd64 2.6.1-3ubuntu2 [46.0 kB] 2023-11-28T19:57:20.966 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package libelf-dev:amd64. 2023-11-28T19:57:20.982 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../06-libelf-dev_0.186-1build1_amd64.deb ... 2023-11-28T19:57:21.016 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking libelf-dev:amd64 (0.186-1build1) ... 2023-11-28T19:57:21.336 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package libfl2:amd64. 2023-11-28T19:57:21.352 INFO:teuthology.orchestra.run.smithi078.stdout:Preconfiguring packages ... 2023-11-28T19:57:21.353 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../07-libfl2_2.6.4-8build2_amd64.deb ... 2023-11-28T19:57:21.395 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking libfl2:amd64 (2.6.4-8build2) ... 2023-11-28T19:57:21.503 INFO:teuthology.orchestra.run.smithi078.stdout:Fetched 54.6 MB in 5s (11.4 MB/s) 2023-11-28T19:57:21.611 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package flex. 2023-11-28T19:57:21.681 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package libfl-dev:amd64. 2023-11-28T19:57:21.683 INFO:teuthology.orchestra.run.smithi078.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 140565 files and directories currently installed.) 2023-11-28T19:57:21.687 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../flex_2.6.4-8build2_amd64.deb ... 2023-11-28T19:57:21.697 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../08-libfl-dev_2.6.4-8build2_amd64.deb ... 2023-11-28T19:57:21.726 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking flex (2.6.4-8build2) ... 2023-11-28T19:57:21.739 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking libfl-dev:amd64 (2.6.4-8build2) ... 2023-11-28T19:57:22.000 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package libjson-perl. 2023-11-28T19:57:22.016 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../09-libjson-perl_4.04000-1_all.deb ... 2023-11-28T19:57:22.050 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking libjson-perl (4.04000-1) ... 2023-11-28T19:57:22.296 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../libssl3_3.0.2-0ubuntu1.12_amd64.deb ... 2023-11-28T19:57:22.337 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package libllvm14:amd64. 2023-11-28T19:57:22.353 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../10-libllvm14_1%3a14.0.0-1ubuntu1.1_amd64.deb ... 2023-11-28T19:57:22.395 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking libllvm14:amd64 (1:14.0.0-1ubuntu1.1) ... 2023-11-28T19:57:22.466 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking libssl3:amd64 (3.0.2-0ubuntu1.12) over (3.0.2-0ubuntu1.7) ... 2023-11-28T19:57:22.873 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up libssl3:amd64 (3.0.2-0ubuntu1.12) ... 2023-11-28T19:57:23.417 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package bison. 2023-11-28T19:57:23.491 INFO:teuthology.orchestra.run.smithi078.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 140638 files and directories currently installed.) 2023-11-28T19:57:23.494 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../00-bison_2%3a3.8.2+dfsg-1build1_amd64.deb ... 2023-11-28T19:57:23.536 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking bison (2:3.8.2+dfsg-1build1) ... 2023-11-28T19:57:23.823 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package libmbim-glib4:amd64. 2023-11-28T19:57:23.839 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../11-libmbim-glib4_1.28.0-1~ubuntu20.04.1_amd64.deb ... 2023-11-28T19:57:23.873 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking libmbim-glib4:amd64 (1.28.0-1~ubuntu20.04.1) ... 2023-11-28T19:57:23.921 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package liblzo2-2:amd64. 2023-11-28T19:57:23.934 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../01-liblzo2-2_2.10-2build3_amd64.deb ... 2023-11-28T19:57:24.003 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking liblzo2-2:amd64 (2.10-2build3) ... 2023-11-28T19:57:24.151 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package libmbim-proxy. 2023-11-28T19:57:24.167 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../12-libmbim-proxy_1.28.0-1~ubuntu20.04.1_amd64.deb ... 2023-11-28T19:57:24.210 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking libmbim-proxy (1.28.0-1~ubuntu20.04.1) ... 2023-11-28T19:57:24.300 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package dump. 2023-11-28T19:57:24.315 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../02-dump_0.4b47-3_amd64.deb ... 2023-11-28T19:57:24.359 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking dump (0.4b47-3) ... 2023-11-28T19:57:24.606 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package libmm-glib0:amd64. 2023-11-28T19:57:24.622 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../13-libmm-glib0_1.20.0-1~ubuntu22.04.2_amd64.deb ... 2023-11-28T19:57:24.629 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package indent. 2023-11-28T19:57:24.643 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../03-indent_2.2.12-1ubuntu0.22.04.1_amd64.deb ... 2023-11-28T19:57:24.664 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking libmm-glib0:amd64 (1.20.0-1~ubuntu22.04.2) ... 2023-11-28T19:57:24.687 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking indent (2.2.12-1ubuntu0.22.04.1) ... 2023-11-28T19:57:24.959 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package libndp0:amd64. 2023-11-28T19:57:24.973 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package libaio-dev:amd64. 2023-11-28T19:57:24.974 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../14-libndp0_1.8-0ubuntu3_amd64.deb ... 2023-11-28T19:57:24.988 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../04-libaio-dev_0.3.112-13build1_amd64.deb ... 2023-11-28T19:57:25.025 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking libndp0:amd64 (1.8-0ubuntu3) ... 2023-11-28T19:57:25.031 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking libaio-dev:amd64 (0.3.112-13build1) ... 2023-11-28T19:57:25.337 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package libnm0:amd64. 2023-11-28T19:57:25.343 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package libbluetooth3:amd64. 2023-11-28T19:57:25.352 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../15-libnm0_1.36.6-0ubuntu2_amd64.deb ... 2023-11-28T19:57:25.358 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../05-libbluetooth3_5.64-0ubuntu1_amd64.deb ... 2023-11-28T19:57:25.395 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking libnm0:amd64 (1.36.6-0ubuntu2) ... 2023-11-28T19:57:25.401 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking libbluetooth3:amd64 (5.64-0ubuntu1) ... 2023-11-28T19:57:25.653 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package libelf-dev:amd64. 2023-11-28T19:57:25.668 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../06-libelf-dev_0.186-1build1_amd64.deb ... 2023-11-28T19:57:25.712 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking libelf-dev:amd64 (0.186-1build1) ... 2023-11-28T19:57:25.765 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package libpq5:amd64. 2023-11-28T19:57:25.780 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../16-libpq5_14.9-0ubuntu0.22.04.1_amd64.deb ... 2023-11-28T19:57:25.840 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking libpq5:amd64 (14.9-0ubuntu0.22.04.1) ... 2023-11-28T19:57:26.081 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package libfl2:amd64. 2023-11-28T19:57:26.097 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../07-libfl2_2.6.4-8build2_amd64.deb ... 2023-11-28T19:57:26.140 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking libfl2:amd64 (2.6.4-8build2) ... 2023-11-28T19:57:26.176 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package libqmi-glib5:amd64. 2023-11-28T19:57:26.192 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../17-libqmi-glib5_1.32.0-1ubuntu0.22.04.1_amd64.deb ... 2023-11-28T19:57:26.235 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking libqmi-glib5:amd64 (1.32.0-1ubuntu0.22.04.1) ... 2023-11-28T19:57:26.383 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package libfl-dev:amd64. 2023-11-28T19:57:26.399 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../08-libfl-dev_2.6.4-8build2_amd64.deb ... 2023-11-28T19:57:26.434 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking libfl-dev:amd64 (2.6.4-8build2) ... 2023-11-28T19:57:26.538 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package libqmi-proxy. 2023-11-28T19:57:26.553 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../18-libqmi-proxy_1.32.0-1ubuntu0.22.04.1_amd64.deb ... 2023-11-28T19:57:26.588 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking libqmi-proxy (1.32.0-1ubuntu0.22.04.1) ... 2023-11-28T19:57:26.686 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package libjson-perl. 2023-11-28T19:57:26.702 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../09-libjson-perl_4.04000-1_all.deb ... 2023-11-28T19:57:26.745 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking libjson-perl (4.04000-1) ... 2023-11-28T19:57:26.823 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package libssl-dev:amd64. 2023-11-28T19:57:26.839 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../19-libssl-dev_3.0.2-0ubuntu1.12_amd64.deb ... 2023-11-28T19:57:26.882 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking libssl-dev:amd64 (3.0.2-0ubuntu1.12) ... 2023-11-28T19:57:27.047 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package libllvm14:amd64. 2023-11-28T19:57:27.063 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../10-libllvm14_1%3a14.0.0-1ubuntu1.1_amd64.deb ... 2023-11-28T19:57:27.106 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking libllvm14:amd64 (1:14.0.0-1ubuntu1.1) ... 2023-11-28T19:57:27.377 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package libteamdctl0:amd64. 2023-11-28T19:57:27.392 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../20-libteamdctl0_1.31-1build2_amd64.deb ... 2023-11-28T19:57:27.427 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking libteamdctl0:amd64 (1.31-1build2) ... 2023-11-28T19:57:27.781 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package modemmanager. 2023-11-28T19:57:27.797 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../21-modemmanager_1.20.0-1~ubuntu22.04.2_amd64.deb ... 2023-11-28T19:57:27.839 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking modemmanager (1.20.0-1~ubuntu22.04.2) ... 2023-11-28T19:57:28.429 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package network-manager. 2023-11-28T19:57:28.448 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../22-network-manager_1.36.6-0ubuntu2_amd64.deb ... 2023-11-28T19:57:28.504 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package libmbim-glib4:amd64. 2023-11-28T19:57:28.511 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking network-manager (1.36.6-0ubuntu2) ... 2023-11-28T19:57:28.516 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../11-libmbim-glib4_1.28.0-1~ubuntu20.04.1_amd64.deb ... 2023-11-28T19:57:28.554 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking libmbim-glib4:amd64 (1.28.0-1~ubuntu20.04.1) ... 2023-11-28T19:57:28.811 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package libmbim-proxy. 2023-11-28T19:57:28.826 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../12-libmbim-proxy_1.28.0-1~ubuntu20.04.1_amd64.deb ... 2023-11-28T19:57:28.869 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking libmbim-proxy (1.28.0-1~ubuntu20.04.1) ... 2023-11-28T19:57:29.071 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package ppp. 2023-11-28T19:57:29.087 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../23-ppp_2.4.9-1+1ubuntu3_amd64.deb ... 2023-11-28T19:57:29.180 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package libmm-glib0:amd64. 2023-11-28T19:57:29.195 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../13-libmm-glib0_1.20.0-1~ubuntu22.04.2_amd64.deb ... 2023-11-28T19:57:29.238 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking libmm-glib0:amd64 (1.20.0-1~ubuntu22.04.2) ... 2023-11-28T19:57:29.421 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking ppp (2.4.9-1+1ubuntu3) ... 2023-11-28T19:57:29.549 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package libndp0:amd64. 2023-11-28T19:57:29.565 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../14-libndp0_1.8-0ubuntu3_amd64.deb ... 2023-11-28T19:57:29.607 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking libndp0:amd64 (1.8-0ubuntu3) ... 2023-11-28T19:57:29.935 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package libnm0:amd64. 2023-11-28T19:57:29.951 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../15-libnm0_1.36.6-0ubuntu2_amd64.deb ... 2023-11-28T19:57:29.993 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking libnm0:amd64 (1.36.6-0ubuntu2) ... 2023-11-28T19:57:30.203 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package pptp-linux. 2023-11-28T19:57:30.218 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../24-pptp-linux_1.10.0-1build3_amd64.deb ... 2023-11-28T19:57:30.261 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking pptp-linux (1.10.0-1build3) ... 2023-11-28T19:57:30.372 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package libpq5:amd64. 2023-11-28T19:57:30.387 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../16-libpq5_14.9-0ubuntu0.22.04.1_amd64.deb ... 2023-11-28T19:57:30.430 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking libpq5:amd64 (14.9-0ubuntu0.22.04.1) ... 2023-11-28T19:57:30.497 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package network-manager-pptp. 2023-11-28T19:57:30.512 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../25-network-manager-pptp_1.2.10-1_amd64.deb ... 2023-11-28T19:57:30.556 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking network-manager-pptp (1.2.10-1) ... 2023-11-28T19:57:30.732 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package libqmi-glib5:amd64. 2023-11-28T19:57:30.748 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../17-libqmi-glib5_1.32.0-1ubuntu0.22.04.1_amd64.deb ... 2023-11-28T19:57:30.782 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking libqmi-glib5:amd64 (1.32.0-1ubuntu0.22.04.1) ... 2023-11-28T19:57:30.859 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package postgresql-client-common. 2023-11-28T19:57:30.874 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../26-postgresql-client-common_238_all.deb ... 2023-11-28T19:57:30.925 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking postgresql-client-common (238) ... 2023-11-28T19:57:31.077 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package libqmi-proxy. 2023-11-28T19:57:31.092 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../18-libqmi-proxy_1.32.0-1ubuntu0.22.04.1_amd64.deb ... 2023-11-28T19:57:31.155 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking libqmi-proxy (1.32.0-1ubuntu0.22.04.1) ... 2023-11-28T19:57:31.247 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package postgresql-client-14. 2023-11-28T19:57:31.262 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../27-postgresql-client-14_14.9-0ubuntu0.22.04.1_amd64.deb ... 2023-11-28T19:57:31.305 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking postgresql-client-14 (14.9-0ubuntu0.22.04.1) ... 2023-11-28T19:57:31.430 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package libssl-dev:amd64. 2023-11-28T19:57:31.445 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../19-libssl-dev_3.0.2-0ubuntu1.12_amd64.deb ... 2023-11-28T19:57:31.487 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking libssl-dev:amd64 (3.0.2-0ubuntu1.12) ... 2023-11-28T19:57:31.877 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package postgresql-common. 2023-11-28T19:57:31.893 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../28-postgresql-common_238_all.deb ... 2023-11-28T19:57:31.916 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package libteamdctl0:amd64. 2023-11-28T19:57:31.930 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../20-libteamdctl0_1.31-1build2_amd64.deb ... 2023-11-28T19:57:31.962 INFO:teuthology.orchestra.run.smithi179.stdout:Adding 'diversion of /usr/bin/pg_config to /usr/bin/pg_config.libpq-dev by postgresql-common' 2023-11-28T19:57:31.965 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking libteamdctl0:amd64 (1.31-1build2) ... 2023-11-28T19:57:31.993 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking postgresql-common (238) ... 2023-11-28T19:57:32.352 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package modemmanager. 2023-11-28T19:57:32.367 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../21-modemmanager_1.20.0-1~ubuntu22.04.2_amd64.deb ... 2023-11-28T19:57:32.410 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking modemmanager (1.20.0-1~ubuntu22.04.2) ... 2023-11-28T19:57:32.486 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package postgresql-14. 2023-11-28T19:57:32.502 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../29-postgresql-14_14.9-0ubuntu0.22.04.1_amd64.deb ... 2023-11-28T19:57:32.547 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking postgresql-14 (14.9-0ubuntu0.22.04.1) ... 2023-11-28T19:57:33.066 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package network-manager. 2023-11-28T19:57:33.082 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../22-network-manager_1.36.6-0ubuntu2_amd64.deb ... 2023-11-28T19:57:33.132 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking network-manager (1.36.6-0ubuntu2) ... 2023-11-28T19:57:33.674 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package postgresql. 2023-11-28T19:57:33.688 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../30-postgresql_14+238_all.deb ... 2023-11-28T19:57:33.732 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking postgresql (14+238) ... 2023-11-28T19:57:33.756 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package ppp. 2023-11-28T19:57:33.771 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../23-ppp_2.4.9-1+1ubuntu3_amd64.deb ... 2023-11-28T19:57:33.976 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package postgresql-client. 2023-11-28T19:57:33.991 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../31-postgresql-client_14+238_all.deb ... 2023-11-28T19:57:34.034 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking postgresql-client (14+238) ... 2023-11-28T19:57:34.110 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking ppp (2.4.9-1+1ubuntu3) ... 2023-11-28T19:57:34.295 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package postgresql-contrib. 2023-11-28T19:57:34.310 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../32-postgresql-contrib_14+238_all.deb ... 2023-11-28T19:57:34.354 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking postgresql-contrib (14+238) ... 2023-11-28T19:57:34.419 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package pptp-linux. 2023-11-28T19:57:34.434 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../24-pptp-linux_1.10.0-1build3_amd64.deb ... 2023-11-28T19:57:34.478 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking pptp-linux (1.10.0-1build3) ... 2023-11-28T19:57:34.665 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package tcl8.6. 2023-11-28T19:57:34.681 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../33-tcl8.6_8.6.12+dfsg-1build1_amd64.deb ... 2023-11-28T19:57:34.723 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking tcl8.6 (8.6.12+dfsg-1build1) ... 2023-11-28T19:57:34.755 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package network-manager-pptp. 2023-11-28T19:57:34.769 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../25-network-manager-pptp_1.2.10-1_amd64.deb ... 2023-11-28T19:57:34.813 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking network-manager-pptp (1.2.10-1) ... 2023-11-28T19:57:35.026 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package tcl. 2023-11-28T19:57:35.042 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../34-tcl_8.6.11+1build2_amd64.deb ... 2023-11-28T19:57:35.089 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking tcl (8.6.11+1build2) ... 2023-11-28T19:57:35.099 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package postgresql-client-common. 2023-11-28T19:57:35.114 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../26-postgresql-client-common_238_all.deb ... 2023-11-28T19:57:35.149 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking postgresql-client-common (238) ... 2023-11-28T19:57:35.428 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package postgresql-client-14. 2023-11-28T19:57:35.443 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../27-postgresql-client-14_14.9-0ubuntu0.22.04.1_amd64.deb ... 2023-11-28T19:57:35.446 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package wpasupplicant. 2023-11-28T19:57:35.463 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../35-wpasupplicant_2%3a2.10-6ubuntu2_amd64.deb ... 2023-11-28T19:57:35.495 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking postgresql-client-14 (14.9-0ubuntu0.22.04.1) ... 2023-11-28T19:57:35.521 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking wpasupplicant (2:2.10-6ubuntu2) ... 2023-11-28T19:57:35.834 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package usb-modeswitch-data. 2023-11-28T19:57:35.850 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../36-usb-modeswitch-data_20191128-4_all.deb ... 2023-11-28T19:57:35.893 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking usb-modeswitch-data (20191128-4) ... 2023-11-28T19:57:36.008 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package postgresql-common. 2023-11-28T19:57:36.022 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../28-postgresql-common_238_all.deb ... 2023-11-28T19:57:36.075 INFO:teuthology.orchestra.run.smithi078.stdout:Adding 'diversion of /usr/bin/pg_config to /usr/bin/pg_config.libpq-dev by postgresql-common' 2023-11-28T19:57:36.106 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking postgresql-common (238) ... 2023-11-28T19:57:36.271 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package usb-modeswitch. 2023-11-28T19:57:36.287 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../37-usb-modeswitch_2.6.1-3ubuntu2_amd64.deb ... 2023-11-28T19:57:36.339 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking usb-modeswitch (2.6.1-3ubuntu2) ... 2023-11-28T19:57:36.665 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up postgresql-client-common (238) ... 2023-11-28T19:57:36.706 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package postgresql-14. 2023-11-28T19:57:36.721 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../29-postgresql-14_14.9-0ubuntu0.22.04.1_amd64.deb ... 2023-11-28T19:57:36.767 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking postgresql-14 (14.9-0ubuntu0.22.04.1) ... 2023-11-28T19:57:36.878 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up flex (2.6.4-8build2) ... 2023-11-28T19:57:37.004 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up tcl8.6 (8.6.12+dfsg-1build1) ... 2023-11-28T19:57:37.122 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up libpq5:amd64 (14.9-0ubuntu0.22.04.1) ... 2023-11-28T19:57:37.223 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up liblzo2-2:amd64 (2.10-2build3) ... 2023-11-28T19:57:37.333 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up libaio-dev:amd64 (0.3.112-13build1) ... 2023-11-28T19:57:37.459 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up postgresql-client-14 (14.9-0ubuntu0.22.04.1) ... 2023-11-28T19:57:37.925 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package postgresql. 2023-11-28T19:57:37.940 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../30-postgresql_14+238_all.deb ... 2023-11-28T19:57:37.984 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking postgresql (14+238) ... 2023-11-28T19:57:38.186 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package postgresql-client. 2023-11-28T19:57:38.202 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../31-postgresql-client_14+238_all.deb ... 2023-11-28T19:57:38.244 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking postgresql-client (14+238) ... 2023-11-28T19:57:38.487 INFO:teuthology.orchestra.run.smithi179.stdout:update-alternatives: using /usr/share/postgresql/14/man/man1/psql.1.gz to provide /usr/share/man/man1/psql.1.gz (psql.1.gz) in auto mode 2023-11-28T19:57:38.513 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package postgresql-contrib. 2023-11-28T19:57:38.528 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../32-postgresql-contrib_14+238_all.deb ... 2023-11-28T19:57:38.572 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking postgresql-contrib (14+238) ... 2023-11-28T19:57:38.582 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up wpasupplicant (2:2.10-6ubuntu2) ... 2023-11-28T19:57:38.890 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package tcl8.6. 2023-11-28T19:57:38.906 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../33-tcl8.6_8.6.12+dfsg-1build1_amd64.deb ... 2023-11-28T19:57:38.949 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking tcl8.6 (8.6.12+dfsg-1build1) ... 2023-11-28T19:57:38.952 INFO:teuthology.orchestra.run.smithi179.stdout:Created symlink /etc/systemd/system/dbus-fi.w1.wpa_supplicant1.service -> /lib/systemd/system/wpa_supplicant.service. 2023-11-28T19:57:38.952 INFO:teuthology.orchestra.run.smithi179.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/wpa_supplicant.service -> /lib/systemd/system/wpa_supplicant.service. 2023-11-28T19:57:39.226 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package tcl. 2023-11-28T19:57:39.242 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../34-tcl_8.6.11+1build2_amd64.deb ... 2023-11-28T19:57:39.315 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking tcl (8.6.11+1build2) ... 2023-11-28T19:57:39.638 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package wpasupplicant. 2023-11-28T19:57:39.653 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../35-wpasupplicant_2%3a2.10-6ubuntu2_amd64.deb ... 2023-11-28T19:57:39.696 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking wpasupplicant (2:2.10-6ubuntu2) ... 2023-11-28T19:57:39.710 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up libteamdctl0:amd64 (1.31-1build2) ... 2023-11-28T19:57:39.836 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up libssl-dev:amd64 (3.0.2-0ubuntu1.12) ... 2023-11-28T19:57:39.978 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up usb-modeswitch-data (20191128-4) ... 2023-11-28T19:57:40.042 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package usb-modeswitch-data. 2023-11-28T19:57:40.057 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../36-usb-modeswitch-data_20191128-4_all.deb ... 2023-11-28T19:57:40.100 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking usb-modeswitch-data (20191128-4) ... 2023-11-28T19:57:40.113 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up libelf-dev:amd64 (0.186-1build1) ... 2023-11-28T19:57:40.214 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up libfl2:amd64 (2.6.4-8build2) ... 2023-11-28T19:57:40.315 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up libnm0:amd64 (1.36.6-0ubuntu2) ... 2023-11-28T19:57:40.424 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up ppp (2.4.9-1+1ubuntu3) ... 2023-11-28T19:57:40.503 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package usb-modeswitch. 2023-11-28T19:57:40.519 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../37-usb-modeswitch_2.6.1-3ubuntu2_amd64.deb ... 2023-11-28T19:57:40.570 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking usb-modeswitch (2.6.1-3ubuntu2) ... 2023-11-28T19:57:40.888 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up postgresql-client-common (238) ... 2023-11-28T19:57:41.117 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up flex (2.6.4-8build2) ... 2023-11-28T19:57:41.172 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up libllvm14:amd64 (1:14.0.0-1ubuntu1.1) ... 2023-11-28T19:57:41.243 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up tcl8.6 (8.6.12+dfsg-1build1) ... 2023-11-28T19:57:41.289 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up dump (0.4b47-3) ... 2023-11-28T19:57:41.377 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up libpq5:amd64 (14.9-0ubuntu0.22.04.1) ... 2023-11-28T19:57:41.384 INFO:teuthology.orchestra.run.smithi179.stdout:update-alternatives: using /usr/sbin/rmt-dump to provide /usr/sbin/rmt (rmt) in auto mode 2023-11-28T19:57:41.474 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up libmm-glib0:amd64 (1.20.0-1~ubuntu22.04.2) ... 2023-11-28T19:57:41.503 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up liblzo2-2:amd64 (2.10-2build3) ... 2023-11-28T19:57:41.592 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up libbluetooth3:amd64 (5.64-0ubuntu1) ... 2023-11-28T19:57:41.629 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up libaio-dev:amd64 (0.3.112-13build1) ... 2023-11-28T19:57:41.718 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up tcl (8.6.11+1build2) ... 2023-11-28T19:57:41.755 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up postgresql-client-14 (14.9-0ubuntu0.22.04.1) ... 2023-11-28T19:57:41.844 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up libjson-perl (4.04000-1) ... 2023-11-28T19:57:41.970 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up bison (2:3.8.2+dfsg-1build1) ... 2023-11-28T19:57:42.059 INFO:teuthology.orchestra.run.smithi179.stdout:update-alternatives: using /usr/bin/bison.yacc to provide /usr/bin/yacc (yacc) in auto mode 2023-11-28T19:57:42.130 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up indent (2.2.12-1ubuntu0.22.04.1) ... 2023-11-28T19:57:42.256 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up usb-modeswitch (2.6.1-3ubuntu2) ... 2023-11-28T19:57:42.434 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up libndp0:amd64 (1.8-0ubuntu3) ... 2023-11-28T19:57:42.541 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up libmbim-glib4:amd64 (1.28.0-1~ubuntu20.04.1) ... 2023-11-28T19:57:42.659 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up pptp-linux (1.10.0-1build3) ... 2023-11-28T19:57:42.762 INFO:teuthology.orchestra.run.smithi078.stdout:update-alternatives: using /usr/share/postgresql/14/man/man1/psql.1.gz to provide /usr/share/man/man1/psql.1.gz (psql.1.gz) in auto mode 2023-11-28T19:57:42.827 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up postgresql-client (14+238) ... 2023-11-28T19:57:42.902 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up wpasupplicant (2:2.10-6ubuntu2) ... 2023-11-28T19:57:42.953 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up network-manager (1.36.6-0ubuntu2) ... 2023-11-28T19:57:43.282 INFO:teuthology.orchestra.run.smithi078.stdout:Created symlink /etc/systemd/system/dbus-fi.w1.wpa_supplicant1.service -> /lib/systemd/system/wpa_supplicant.service. 2023-11-28T19:57:43.282 INFO:teuthology.orchestra.run.smithi078.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/wpa_supplicant.service -> /lib/systemd/system/wpa_supplicant.service. 2023-11-28T19:57:43.563 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-11-28T19:57:43.563 INFO:teuthology.orchestra.run.smithi179.stdout:The following network interfaces were found in /etc/network/interfaces 2023-11-28T19:57:43.563 INFO:teuthology.orchestra.run.smithi179.stdout:which means they are currently configured by ifupdown: 2023-11-28T19:57:43.563 INFO:teuthology.orchestra.run.smithi179.stdout:- enp3s0f1 2023-11-28T19:57:43.564 INFO:teuthology.orchestra.run.smithi179.stdout:If you want to manage those interfaces with NetworkManager instead 2023-11-28T19:57:43.564 INFO:teuthology.orchestra.run.smithi179.stdout:remove their configuration from /etc/network/interfaces. 2023-11-28T19:57:43.564 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-11-28T19:57:43.696 INFO:teuthology.orchestra.run.smithi179.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.nm-dispatcher.service -> /lib/systemd/system/NetworkManager-dispatcher.service. 2023-11-28T19:57:44.082 INFO:teuthology.orchestra.run.smithi179.stdout:Created symlink /etc/systemd/system/network-online.target.wants/NetworkManager-wait-online.service -> /lib/systemd/system/NetworkManager-wait-online.service. 2023-11-28T19:57:44.235 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up libteamdctl0:amd64 (1.31-1build2) ... 2023-11-28T19:57:44.356 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up libssl-dev:amd64 (3.0.2-0ubuntu1.12) ... 2023-11-28T19:57:44.482 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up usb-modeswitch-data (20191128-4) ... 2023-11-28T19:57:44.518 INFO:teuthology.orchestra.run.smithi179.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/NetworkManager.service -> /lib/systemd/system/NetworkManager.service. 2023-11-28T19:57:44.607 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up libelf-dev:amd64 (0.186-1build1) ... 2023-11-28T19:57:44.733 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up libfl2:amd64 (2.6.4-8build2) ... 2023-11-28T19:57:44.884 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up libnm0:amd64 (1.36.6-0ubuntu2) ... 2023-11-28T19:57:45.019 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up ppp (2.4.9-1+1ubuntu3) ... 2023-11-28T19:57:45.197 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up libmbim-proxy (1.28.0-1~ubuntu20.04.1) ... 2023-11-28T19:57:45.315 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up libfl-dev:amd64 (2.6.4-8build2) ... 2023-11-28T19:57:45.475 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up network-manager-pptp (1.2.10-1) ... 2023-11-28T19:57:45.601 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up postgresql-common (238) ... 2023-11-28T19:57:45.649 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up libllvm14:amd64 (1:14.0.0-1ubuntu1.1) ... 2023-11-28T19:57:45.800 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up dump (0.4b47-3) ... 2023-11-28T19:57:45.895 INFO:teuthology.orchestra.run.smithi078.stdout:update-alternatives: using /usr/sbin/rmt-dump to provide /usr/sbin/rmt (rmt) in auto mode 2023-11-28T19:57:45.960 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up libmm-glib0:amd64 (1.20.0-1~ubuntu22.04.2) ... 2023-11-28T19:57:46.094 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up libbluetooth3:amd64 (5.64-0ubuntu1) ... 2023-11-28T19:57:46.220 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up tcl (8.6.11+1build2) ... 2023-11-28T19:57:46.346 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up libjson-perl (4.04000-1) ... 2023-11-28T19:57:46.447 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up bison (2:3.8.2+dfsg-1build1) ... 2023-11-28T19:57:46.537 INFO:teuthology.orchestra.run.smithi078.stdout:update-alternatives: using /usr/bin/bison.yacc to provide /usr/bin/yacc (yacc) in auto mode 2023-11-28T19:57:46.640 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up indent (2.2.12-1ubuntu0.22.04.1) ... 2023-11-28T19:57:46.807 INFO:teuthology.orchestra.run.smithi179.stdout:Adding user postgres to group ssl-cert 2023-11-28T19:57:46.824 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up usb-modeswitch (2.6.1-3ubuntu2) ... 2023-11-28T19:57:47.001 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up libndp0:amd64 (1.8-0ubuntu3) ... 2023-11-28T19:57:47.057 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-11-28T19:57:47.057 INFO:teuthology.orchestra.run.smithi179.stdout:Creating config file /etc/postgresql-common/createcluster.conf with new version 2023-11-28T19:57:47.127 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up libmbim-glib4:amd64 (1.28.0-1~ubuntu20.04.1) ... 2023-11-28T19:57:47.253 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up pptp-linux (1.10.0-1build3) ... 2023-11-28T19:57:47.295 INFO:teuthology.orchestra.run.smithi179.stdout:Building PostgreSQL dictionaries from installed myspell/hunspell packages... 2023-11-28T19:57:47.295 INFO:teuthology.orchestra.run.smithi179.stdout:Removing obsolete dictionary files: 2023-11-28T19:57:47.421 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up postgresql-client (14+238) ... 2023-11-28T19:57:47.572 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up network-manager (1.36.6-0ubuntu2) ... 2023-11-28T19:57:48.014 INFO:teuthology.orchestra.run.smithi179.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/postgresql.service -> /lib/systemd/system/postgresql.service. 2023-11-28T19:57:48.175 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-11-28T19:57:48.175 INFO:teuthology.orchestra.run.smithi078.stdout:The following network interfaces were found in /etc/network/interfaces 2023-11-28T19:57:48.175 INFO:teuthology.orchestra.run.smithi078.stdout:which means they are currently configured by ifupdown: 2023-11-28T19:57:48.175 INFO:teuthology.orchestra.run.smithi078.stdout:- enp3s0f1 2023-11-28T19:57:48.176 INFO:teuthology.orchestra.run.smithi078.stdout:If you want to manage those interfaces with NetworkManager instead 2023-11-28T19:57:48.176 INFO:teuthology.orchestra.run.smithi078.stdout:remove their configuration from /etc/network/interfaces. 2023-11-28T19:57:48.176 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-11-28T19:57:48.308 INFO:teuthology.orchestra.run.smithi078.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.nm-dispatcher.service -> /lib/systemd/system/NetworkManager-dispatcher.service. 2023-11-28T19:57:48.561 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up postgresql-14 (14.9-0ubuntu0.22.04.1) ... 2023-11-28T19:57:48.725 INFO:teuthology.orchestra.run.smithi078.stdout:Created symlink /etc/systemd/system/network-online.target.wants/NetworkManager-wait-online.service -> /lib/systemd/system/NetworkManager-wait-online.service. 2023-11-28T19:57:48.899 INFO:teuthology.orchestra.run.smithi179.stdout:Creating new PostgreSQL cluster 14/main ... 2023-11-28T19:57:48.925 INFO:teuthology.orchestra.run.smithi179.stdout:/usr/lib/postgresql/14/bin/initdb -D /var/lib/postgresql/14/main --auth-local peer --auth-host scram-sha-256 --no-instructions 2023-11-28T19:57:48.974 INFO:teuthology.orchestra.run.smithi179.stdout:The files belonging to this database system will be owned by user "postgres". 2023-11-28T19:57:48.974 INFO:teuthology.orchestra.run.smithi179.stdout:This user must also own the server process. 2023-11-28T19:57:48.974 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-11-28T19:57:48.975 INFO:teuthology.orchestra.run.smithi179.stdout:The database cluster will be initialized with locale "en_US". 2023-11-28T19:57:48.975 INFO:teuthology.orchestra.run.smithi179.stdout:The default database encoding has accordingly been set to "LATIN1". 2023-11-28T19:57:48.975 INFO:teuthology.orchestra.run.smithi179.stdout:The default text search configuration will be set to "english". 2023-11-28T19:57:48.975 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-11-28T19:57:48.975 INFO:teuthology.orchestra.run.smithi179.stdout:Data page checksums are disabled. 2023-11-28T19:57:48.975 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-11-28T19:57:48.975 INFO:teuthology.orchestra.run.smithi179.stdout:fixing permissions on existing directory /var/lib/postgresql/14/main ... ok 2023-11-28T19:57:48.976 INFO:teuthology.orchestra.run.smithi179.stdout:creating subdirectories ... ok 2023-11-28T19:57:48.976 INFO:teuthology.orchestra.run.smithi179.stdout:selecting dynamic shared memory implementation ... posix 2023-11-28T19:57:49.000 INFO:teuthology.orchestra.run.smithi179.stdout:selecting default max_connections ... 100 2023-11-28T19:57:49.035 INFO:teuthology.orchestra.run.smithi179.stdout:selecting default shared_buffers ... 128MB 2023-11-28T19:57:49.048 INFO:teuthology.orchestra.run.smithi179.stdout:selecting default time zone ... Etc/UTC 2023-11-28T19:57:49.049 INFO:teuthology.orchestra.run.smithi179.stdout:creating configuration files ... ok 2023-11-28T19:57:49.157 INFO:teuthology.orchestra.run.smithi078.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/NetworkManager.service -> /lib/systemd/system/NetworkManager.service. 2023-11-28T19:57:49.217 INFO:teuthology.orchestra.run.smithi179.stdout:running bootstrap script ... ok 2023-11-28T19:57:49.834 INFO:teuthology.orchestra.run.smithi179.stdout:performing post-bootstrap initialization ... ok 2023-11-28T19:57:49.866 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up libmbim-proxy (1.28.0-1~ubuntu20.04.1) ... 2023-11-28T19:57:49.985 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up libfl-dev:amd64 (2.6.4-8build2) ... 2023-11-28T19:57:50.110 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up network-manager-pptp (1.2.10-1) ... 2023-11-28T19:57:50.269 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up postgresql-common (238) ... 2023-11-28T19:57:50.418 INFO:teuthology.orchestra.run.smithi179.stdout:syncing data to disk ... ok 2023-11-28T19:57:50.948 INFO:teuthology.orchestra.run.smithi179.stdout:update-alternatives: using /usr/share/postgresql/14/man/man1/postmaster.1.gz to provide /usr/share/man/man1/postmaster.1.gz (postmaster.1.gz) in auto mode 2023-11-28T19:57:51.225 INFO:teuthology.orchestra.run.smithi078.stdout:Adding user postgres to group ssl-cert 2023-11-28T19:57:51.500 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-11-28T19:57:51.500 INFO:teuthology.orchestra.run.smithi078.stdout:Creating config file /etc/postgresql-common/createcluster.conf with new version 2023-11-28T19:57:51.761 INFO:teuthology.orchestra.run.smithi078.stdout:Building PostgreSQL dictionaries from installed myspell/hunspell packages... 2023-11-28T19:57:51.761 INFO:teuthology.orchestra.run.smithi078.stdout:Removing obsolete dictionary files: 2023-11-28T19:57:52.498 INFO:teuthology.orchestra.run.smithi078.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/postgresql.service -> /lib/systemd/system/postgresql.service. 2023-11-28T19:57:52.996 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up postgresql-14 (14.9-0ubuntu0.22.04.1) ... 2023-11-28T19:57:53.336 INFO:teuthology.orchestra.run.smithi078.stdout:Creating new PostgreSQL cluster 14/main ... 2023-11-28T19:57:53.358 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/lib/postgresql/14/bin/initdb -D /var/lib/postgresql/14/main --auth-local peer --auth-host scram-sha-256 --no-instructions 2023-11-28T19:57:53.404 INFO:teuthology.orchestra.run.smithi078.stdout:The files belonging to this database system will be owned by user "postgres". 2023-11-28T19:57:53.404 INFO:teuthology.orchestra.run.smithi078.stdout:This user must also own the server process. 2023-11-28T19:57:53.404 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-11-28T19:57:53.404 INFO:teuthology.orchestra.run.smithi078.stdout:The database cluster will be initialized with locale "en_US". 2023-11-28T19:57:53.405 INFO:teuthology.orchestra.run.smithi078.stdout:The default database encoding has accordingly been set to "LATIN1". 2023-11-28T19:57:53.405 INFO:teuthology.orchestra.run.smithi078.stdout:The default text search configuration will be set to "english". 2023-11-28T19:57:53.405 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-11-28T19:57:53.405 INFO:teuthology.orchestra.run.smithi078.stdout:Data page checksums are disabled. 2023-11-28T19:57:53.405 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-11-28T19:57:53.405 INFO:teuthology.orchestra.run.smithi078.stdout:fixing permissions on existing directory /var/lib/postgresql/14/main ... ok 2023-11-28T19:57:53.406 INFO:teuthology.orchestra.run.smithi078.stdout:creating subdirectories ... ok 2023-11-28T19:57:53.406 INFO:teuthology.orchestra.run.smithi078.stdout:selecting dynamic shared memory implementation ... posix 2023-11-28T19:57:53.429 INFO:teuthology.orchestra.run.smithi078.stdout:selecting default max_connections ... 100 2023-11-28T19:57:53.464 INFO:teuthology.orchestra.run.smithi078.stdout:selecting default shared_buffers ... 128MB 2023-11-28T19:57:53.478 INFO:teuthology.orchestra.run.smithi078.stdout:selecting default time zone ... Etc/UTC 2023-11-28T19:57:53.479 INFO:teuthology.orchestra.run.smithi078.stdout:creating configuration files ... ok 2023-11-28T19:57:53.647 INFO:teuthology.orchestra.run.smithi078.stdout:running bootstrap script ... ok 2023-11-28T19:57:53.894 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up libqmi-glib5:amd64 (1.32.0-1ubuntu0.22.04.1) ... 2023-11-28T19:57:54.020 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up postgresql-contrib (14+238) ... 2023-11-28T19:57:54.138 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up postgresql (14+238) ... 2023-11-28T19:57:54.264 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up libqmi-proxy (1.32.0-1ubuntu0.22.04.1) ... 2023-11-28T19:57:54.292 INFO:teuthology.orchestra.run.smithi078.stdout:performing post-bootstrap initialization ... ok 2023-11-28T19:57:54.390 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up modemmanager (1.20.0-1~ubuntu22.04.2) ... 2023-11-28T19:57:54.650 INFO:teuthology.orchestra.run.smithi179.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.ModemManager1.service -> /lib/systemd/system/ModemManager.service. 2023-11-28T19:57:54.650 INFO:teuthology.orchestra.run.smithi179.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ModemManager.service -> /lib/systemd/system/ModemManager.service. 2023-11-28T19:57:54.847 INFO:teuthology.orchestra.run.smithi078.stdout:syncing data to disk ... ok 2023-11-28T19:57:55.379 INFO:teuthology.orchestra.run.smithi078.stdout:update-alternatives: using /usr/share/postgresql/14/man/man1/postmaster.1.gz to provide /usr/share/man/man1/postmaster.1.gz (postmaster.1.gz) in auto mode 2023-11-28T19:57:55.409 INFO:teuthology.orchestra.run.smithi179.stdout:Processing triggers for hicolor-icon-theme (0.17-2) ... 2023-11-28T19:57:55.719 INFO:teuthology.orchestra.run.smithi179.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2023-11-28T19:57:55.888 INFO:teuthology.orchestra.run.smithi179.stdout:Processing triggers for man-db (2.10.2-1) ... 2023-11-28T19:57:57.290 INFO:teuthology.orchestra.run.smithi179.stdout:Processing triggers for dbus (1.12.20-2ubuntu4.1) ... 2023-11-28T19:57:57.382 INFO:teuthology.orchestra.run.smithi179.stdout:Processing triggers for install-info (6.8-4build1) ... 2023-11-28T19:57:57.902 INFO:teuthology.orchestra.run.smithi179.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2023-11-28T19:57:57.910 DEBUG:teuthology.parallel:result is None 2023-11-28T19:57:58.420 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up libqmi-glib5:amd64 (1.32.0-1ubuntu0.22.04.1) ... 2023-11-28T19:57:58.571 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up postgresql-contrib (14+238) ... 2023-11-28T19:57:58.697 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up postgresql (14+238) ... 2023-11-28T19:57:58.823 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up libqmi-proxy (1.32.0-1ubuntu0.22.04.1) ... 2023-11-28T19:57:58.932 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up modemmanager (1.20.0-1~ubuntu22.04.2) ... 2023-11-28T19:57:59.180 INFO:teuthology.orchestra.run.smithi078.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.ModemManager1.service -> /lib/systemd/system/ModemManager.service. 2023-11-28T19:57:59.181 INFO:teuthology.orchestra.run.smithi078.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ModemManager.service -> /lib/systemd/system/ModemManager.service. 2023-11-28T19:57:59.959 INFO:teuthology.orchestra.run.smithi078.stdout:Processing triggers for hicolor-icon-theme (0.17-2) ... 2023-11-28T19:58:00.286 INFO:teuthology.orchestra.run.smithi078.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2023-11-28T19:58:00.421 INFO:teuthology.orchestra.run.smithi078.stdout:Processing triggers for man-db (2.10.2-1) ... 2023-11-28T19:58:01.815 INFO:teuthology.orchestra.run.smithi078.stdout:Processing triggers for dbus (1.12.20-2ubuntu4.1) ... 2023-11-28T19:58:01.940 INFO:teuthology.orchestra.run.smithi078.stdout:Processing triggers for install-info (6.8-4build1) ... 2023-11-28T19:58:02.461 INFO:teuthology.orchestra.run.smithi078.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2023-11-28T19:58:02.465 DEBUG:teuthology.parallel:result is None 2023-11-28T19:58:02.466 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=43dd94c190073cf16cff1e711dd7f5a7b1cbc883 2023-11-28T19:58:02.605 DEBUG:teuthology.orchestra.run.smithi078:> dpkg-query -W -f '${Version}' ceph 2023-11-28T19:58:02.627 INFO:teuthology.orchestra.run.smithi078.stdout:18.0.0-7520-g43dd94c1-1jammy 2023-11-28T19:58:02.627 INFO:teuthology.packaging:The installed version of ceph is 18.0.0-7520-g43dd94c1-1jammy 2023-11-28T19:58:02.627 INFO:teuthology.task.install:The correct ceph version 18.0.0-7520-g43dd94c1-1jammy is installed. 2023-11-28T19:58:02.628 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=43dd94c190073cf16cff1e711dd7f5a7b1cbc883 2023-11-28T19:58:02.843 DEBUG:teuthology.orchestra.run.smithi179:> dpkg-query -W -f '${Version}' ceph 2023-11-28T19:58:02.867 INFO:teuthology.orchestra.run.smithi179.stdout:18.0.0-7520-g43dd94c1-1jammy 2023-11-28T19:58:02.868 INFO:teuthology.packaging:The installed version of ceph is 18.0.0-7520-g43dd94c1-1jammy 2023-11-28T19:58:02.868 INFO:teuthology.task.install:The correct ceph version 18.0.0-7520-g43dd94c1-1jammy is installed. 2023-11-28T19:58:02.868 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2023-11-28T19:58:02.868 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2023-11-28T19:58:02.869 DEBUG:teuthology.orchestra.run.smithi078:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-11-28T19:58:02.889 DEBUG:teuthology.orchestra.run.smithi179:> set -ex 2023-11-28T19:58:02.890 DEBUG:teuthology.orchestra.run.smithi179:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-11-28T19:58:02.932 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2023-11-28T19:58:02.932 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2023-11-28T19:58:02.933 DEBUG:teuthology.orchestra.run.smithi078:> sudo dd of=/usr/bin/daemon-helper 2023-11-28T19:58:02.952 DEBUG:teuthology.orchestra.run.smithi078:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-11-28T19:58:03.017 DEBUG:teuthology.orchestra.run.smithi179:> set -ex 2023-11-28T19:58:03.017 DEBUG:teuthology.orchestra.run.smithi179:> sudo dd of=/usr/bin/daemon-helper 2023-11-28T19:58:03.039 DEBUG:teuthology.orchestra.run.smithi179:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-11-28T19:58:03.107 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2023-11-28T19:58:03.107 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2023-11-28T19:58:03.108 DEBUG:teuthology.orchestra.run.smithi078:> sudo dd of=/usr/bin/adjust-ulimits 2023-11-28T19:58:03.128 DEBUG:teuthology.orchestra.run.smithi078:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-11-28T19:58:03.188 DEBUG:teuthology.orchestra.run.smithi179:> set -ex 2023-11-28T19:58:03.188 DEBUG:teuthology.orchestra.run.smithi179:> sudo dd of=/usr/bin/adjust-ulimits 2023-11-28T19:58:03.211 DEBUG:teuthology.orchestra.run.smithi179:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-11-28T19:58:03.279 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2023-11-28T19:58:03.279 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2023-11-28T19:58:03.279 DEBUG:teuthology.orchestra.run.smithi078:> sudo dd of=/usr/bin/stdin-killer 2023-11-28T19:58:03.299 DEBUG:teuthology.orchestra.run.smithi078:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-11-28T19:58:03.364 DEBUG:teuthology.orchestra.run.smithi179:> set -ex 2023-11-28T19:58:03.364 DEBUG:teuthology.orchestra.run.smithi179:> sudo dd of=/usr/bin/stdin-killer 2023-11-28T19:58:03.386 DEBUG:teuthology.orchestra.run.smithi179:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-11-28T19:58:03.452 INFO:teuthology.run_tasks:Running task ceph... 2023-11-28T19:58:03.525 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2023-11-28T19:58:03.525 DEBUG:teuthology.orchestra.run.smithi078:> sudo chmod 777 /var/log/ceph 2023-11-28T19:58:03.529 DEBUG:teuthology.orchestra.run.smithi179:> sudo chmod 777 /var/log/ceph 2023-11-28T19:58:03.550 INFO:tasks.ceph:Disabling ceph logrotate... 2023-11-28T19:58:03.550 DEBUG:teuthology.orchestra.run.smithi078:> sudo rm -f -- /etc/logrotate.d/ceph 2023-11-28T19:58:03.592 DEBUG:teuthology.orchestra.run.smithi179:> sudo rm -f -- /etc/logrotate.d/ceph 2023-11-28T19:58:03.614 INFO:tasks.ceph:Creating extra log directories... 2023-11-28T19:58:03.615 DEBUG:teuthology.orchestra.run.smithi078:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-11-28T19:58:03.660 DEBUG:teuthology.orchestra.run.smithi179:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-11-28T19:58:03.688 INFO:tasks.ceph:Setting up log rotation with {'ceph-mds': '10G', 'ceph-osd': '10G'} 2023-11-28T19:58:03.689 INFO:tasks.ceph:writing logrotate stanza for ceph-mds 2023-11-28T19:58:03.689 INFO:tasks.ceph:writing logrotate stanza for ceph-osd 2023-11-28T19:58:03.689 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2023-11-28T19:58:03.689 DEBUG:teuthology.orchestra.run.smithi078:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2023-11-28T19:58:03.725 DEBUG:teuthology.orchestra.run.smithi078:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2023-11-28T19:58:03.821 DEBUG:teuthology.orchestra.run.smithi179:> set -ex 2023-11-28T19:58:03.821 DEBUG:teuthology.orchestra.run.smithi179:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2023-11-28T19:58:03.831 DEBUG:teuthology.orchestra.run.smithi179:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2023-11-28T19:58:03.936 INFO:tasks.ceph:Creating ceph cluster ceph... 2023-11-28T19:58:03.936 INFO:tasks.ceph:config {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bluestore block size': 96636764160, 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2023-11-28T19:58:03.936 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/vshankar-2023-11-28_06:29:14-fs-wip-vshankar-testing-20231127.102914-testing-default-smithi/7469593', 'branch': 'wip-vshankar-testing-20231127.102914', 'description': 'fs/multifs/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-2c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore-ec/bluestore-comp-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down mon-debug} tasks/multifs-auth}', 'email': 'vshankar@redhat.com', 'first_in_suite': False, 'job_id': '7469593', 'kernel': {'client': {'branch': 'testing'}, 'flavor': 'default', 'kdb': True, 'sha1': '8247bbb5b470f7e2a1f3eefcc16e24cf1338f606'}, 'ktype': 'upstream', 'last_in_suite': False, 'log-rotate': {'ceph-mds': '10G', 'ceph-osd': '10G'}, 'machine_type': 'smithi', 'name': 'vshankar-2023-11-28_06:29:14-fs-wip-vshankar-testing-20231127.102914-testing-default-smithi', 'no_nested_subset': False, 'nuke-on-error': True, 'openstack': [{'volumes': {'count': 4, 'size': 20}}, {'machine': {'disk': 200}}], 'os_type': 'ubuntu', 'os_version': '22.04', 'overrides': {'admin_socket': {'branch': 'wip-vshankar-testing-20231127.102914'}, 'ceph': {'cephfs': {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd']}, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bluestore block size': 96636764160, 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding'], 'sha1': '43dd94c190073cf16cff1e711dd7f5a7b1cbc883'}, 'ceph-deploy': {'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {'osd default pool size': 2}}}, 'install': {'ceph': {'flavor': 'default', 'sha1': '43dd94c190073cf16cff1e711dd7f5a7b1cbc883'}}, 'kclient': {'syntax': 'v2'}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-vshankar-testing-20231127.102914', 'sha1': '43dd94c190073cf16cff1e711dd7f5a7b1cbc883'}}, 'owner': 'scheduled_vshankar@teuthology', 'priority': 150, 'repo': 'https://git.ceph.com/ceph-ci.git', 'roles': [['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0'], ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1']], 'seed': 8377, 'sha1': '43dd94c190073cf16cff1e711dd7f5a7b1cbc883', 'sleep_before_teardown': 0, 'subset': '462/1024', 'suite': 'fs', 'suite_branch': 'wip-vshankar-testing-20231127.102914', 'suite_path': '/home/teuthworker/src/git.ceph.com_ceph-c_43dd94c190073cf16cff1e711dd7f5a7b1cbc883/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://git.ceph.com/ceph-ci.git', 'suite_sha1': '43dd94c190073cf16cff1e711dd7f5a7b1cbc883', 'syslog': {'ignorelist': ['WARNING*.*check_session_state', 'WARNING*.*__ceph_remove_cap']}, 'targets': {'smithi078.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBH/BeLiF6FTEmVwv4xjOSLQMi1fcn6OhmXMNOPbYsX9UlDQVQgA3D8ZYxMasqYDlK9yyf4L2ZFq8uURMFenUqRM=', 'smithi179.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBIR0Ew728ISPUwTPh1+symK9Vcl9MvI/7y0fWrxFmT3H1OOhgkayTfBUsQ3QNFFmaHkudSbzgGgjwY6jUo6/cjM='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'client': {'branch': 'testing'}, 'flavor': 'default', 'kdb': True, 'sha1': '8247bbb5b470f7e2a1f3eefcc16e24cf1338f606'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '43dd94c190073cf16cff1e711dd7f5a7b1cbc883'}}, {'ceph': {'create_rbd_pool': False, 'cephfs': {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd']}, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bluestore block size': 96636764160, 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding'], 'sha1': '43dd94c190073cf16cff1e711dd7f5a7b1cbc883', 'cluster': 'ceph'}}, {'kclient': None}, {'cephfs_test_runner': {'fail_on_skip': False, 'modules': ['tasks.cephfs.test_multifs_auth']}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': ["local function is_kupstream() return yaml.ktype == 'upstream' end", "local function is_kdistro() return yaml.ktype == 'distro' end", 'local function is_fuse() return false end', 'local function syntax_version() return yaml.overrides.kclient.syntax end']}, 'teuthology_branch': 'main', 'teuthology_sha1': '5ae09a5cc7064ca2bf994df19f3006b79794789a', 'timestamp': '2023-11-28_06:29:14', 'tube': 'smithi', 'user': 'vshankar', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.232157'} 2023-11-28T19:58:03.937 DEBUG:teuthology.orchestra.run.smithi078:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-11-28T19:58:03.941 DEBUG:teuthology.orchestra.run.smithi179:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-11-28T19:58:03.954 DEBUG:teuthology.orchestra.run.smithi078:> sudo install -d -m0777 -- /var/run/ceph 2023-11-28T19:58:03.992 DEBUG:teuthology.orchestra.run.smithi179:> sudo install -d -m0777 -- /var/run/ceph 2023-11-28T19:58:04.014 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2023-11-28T19:58:04.014 DEBUG:teuthology.orchestra.run.smithi078:> dd if=/scratch_devs of=/dev/stdout 2023-11-28T19:58:04.058 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-11-28T19:58:04.059 DEBUG:teuthology.orchestra.run.smithi078:> stat /dev/vg_nvme/lv_1 2023-11-28T19:58:04.110 INFO:teuthology.orchestra.run.smithi078.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-11-28T19:58:04.110 INFO:teuthology.orchestra.run.smithi078.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-11-28T19:58:04.110 INFO:teuthology.orchestra.run.smithi078.stdout:Device: 5h/5d Inode: 902 Links: 1 2023-11-28T19:58:04.110 INFO:teuthology.orchestra.run.smithi078.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-11-28T19:58:04.110 INFO:teuthology.orchestra.run.smithi078.stdout:Access: 2023-11-28 19:51:37.792043062 +0000 2023-11-28T19:58:04.110 INFO:teuthology.orchestra.run.smithi078.stdout:Modify: 2023-11-28 19:51:37.788043098 +0000 2023-11-28T19:58:04.110 INFO:teuthology.orchestra.run.smithi078.stdout:Change: 2023-11-28 19:51:37.788043098 +0000 2023-11-28T19:58:04.110 INFO:teuthology.orchestra.run.smithi078.stdout: Birth: 2023-11-28 19:51:37.788043098 +0000 2023-11-28T19:58:04.111 DEBUG:teuthology.orchestra.run.smithi078:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-11-28T19:58:04.172 INFO:teuthology.orchestra.run.smithi078.stderr:1+0 records in 2023-11-28T19:58:04.172 INFO:teuthology.orchestra.run.smithi078.stderr:1+0 records out 2023-11-28T19:58:04.172 INFO:teuthology.orchestra.run.smithi078.stderr:512 bytes copied, 0.000604168 s, 847 kB/s 2023-11-28T19:58:04.174 DEBUG:teuthology.orchestra.run.smithi078:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-11-28T19:58:04.230 DEBUG:teuthology.orchestra.run.smithi078:> stat /dev/vg_nvme/lv_2 2023-11-28T19:58:04.281 INFO:teuthology.orchestra.run.smithi078.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-11-28T19:58:04.282 INFO:teuthology.orchestra.run.smithi078.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-11-28T19:58:04.282 INFO:teuthology.orchestra.run.smithi078.stdout:Device: 5h/5d Inode: 920 Links: 1 2023-11-28T19:58:04.282 INFO:teuthology.orchestra.run.smithi078.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-11-28T19:58:04.282 INFO:teuthology.orchestra.run.smithi078.stdout:Access: 2023-11-28 19:51:38.832033766 +0000 2023-11-28T19:58:04.282 INFO:teuthology.orchestra.run.smithi078.stdout:Modify: 2023-11-28 19:51:38.448037198 +0000 2023-11-28T19:58:04.282 INFO:teuthology.orchestra.run.smithi078.stdout:Change: 2023-11-28 19:51:38.448037198 +0000 2023-11-28T19:58:04.282 INFO:teuthology.orchestra.run.smithi078.stdout: Birth: 2023-11-28 19:51:38.448037198 +0000 2023-11-28T19:58:04.283 DEBUG:teuthology.orchestra.run.smithi078:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-11-28T19:58:04.343 INFO:teuthology.orchestra.run.smithi078.stderr:1+0 records in 2023-11-28T19:58:04.343 INFO:teuthology.orchestra.run.smithi078.stderr:1+0 records out 2023-11-28T19:58:04.344 INFO:teuthology.orchestra.run.smithi078.stderr:512 bytes copied, 0.000347214 s, 1.5 MB/s 2023-11-28T19:58:04.345 DEBUG:teuthology.orchestra.run.smithi078:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-11-28T19:58:04.399 DEBUG:teuthology.orchestra.run.smithi078:> stat /dev/vg_nvme/lv_3 2023-11-28T19:58:04.453 INFO:teuthology.orchestra.run.smithi078.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-11-28T19:58:04.454 INFO:teuthology.orchestra.run.smithi078.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-11-28T19:58:04.454 INFO:teuthology.orchestra.run.smithi078.stdout:Device: 5h/5d Inode: 935 Links: 1 2023-11-28T19:58:04.454 INFO:teuthology.orchestra.run.smithi078.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-11-28T19:58:04.454 INFO:teuthology.orchestra.run.smithi078.stdout:Access: 2023-11-28 19:51:39.528027546 +0000 2023-11-28T19:58:04.454 INFO:teuthology.orchestra.run.smithi078.stdout:Modify: 2023-11-28 19:51:39.096031406 +0000 2023-11-28T19:58:04.454 INFO:teuthology.orchestra.run.smithi078.stdout:Change: 2023-11-28 19:51:39.096031406 +0000 2023-11-28T19:58:04.454 INFO:teuthology.orchestra.run.smithi078.stdout: Birth: 2023-11-28 19:51:39.096031406 +0000 2023-11-28T19:58:04.454 DEBUG:teuthology.orchestra.run.smithi078:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-11-28T19:58:04.518 INFO:teuthology.orchestra.run.smithi078.stderr:1+0 records in 2023-11-28T19:58:04.519 INFO:teuthology.orchestra.run.smithi078.stderr:1+0 records out 2023-11-28T19:58:04.519 INFO:teuthology.orchestra.run.smithi078.stderr:512 bytes copied, 0.000632602 s, 809 kB/s 2023-11-28T19:58:04.520 DEBUG:teuthology.orchestra.run.smithi078:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-11-28T19:58:04.575 DEBUG:teuthology.orchestra.run.smithi078:> stat /dev/vg_nvme/lv_4 2023-11-28T19:58:04.626 INFO:teuthology.orchestra.run.smithi078.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-11-28T19:58:04.626 INFO:teuthology.orchestra.run.smithi078.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-11-28T19:58:04.626 INFO:teuthology.orchestra.run.smithi078.stdout:Device: 5h/5d Inode: 952 Links: 1 2023-11-28T19:58:04.626 INFO:teuthology.orchestra.run.smithi078.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-11-28T19:58:04.626 INFO:teuthology.orchestra.run.smithi078.stdout:Access: 2023-11-28 19:51:39.816024972 +0000 2023-11-28T19:58:04.626 INFO:teuthology.orchestra.run.smithi078.stdout:Modify: 2023-11-28 19:51:39.812025007 +0000 2023-11-28T19:58:04.626 INFO:teuthology.orchestra.run.smithi078.stdout:Change: 2023-11-28 19:51:39.812025007 +0000 2023-11-28T19:58:04.626 INFO:teuthology.orchestra.run.smithi078.stdout: Birth: 2023-11-28 19:51:39.812025007 +0000 2023-11-28T19:58:04.627 DEBUG:teuthology.orchestra.run.smithi078:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-11-28T19:58:04.687 INFO:teuthology.orchestra.run.smithi078.stderr:1+0 records in 2023-11-28T19:58:04.687 INFO:teuthology.orchestra.run.smithi078.stderr:1+0 records out 2023-11-28T19:58:04.687 INFO:teuthology.orchestra.run.smithi078.stderr:512 bytes copied, 0.00036963 s, 1.4 MB/s 2023-11-28T19:58:04.688 DEBUG:teuthology.orchestra.run.smithi078:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-11-28T19:58:04.739 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-11-28T19:58:04.739 DEBUG:teuthology.orchestra.run.smithi179:> set -ex 2023-11-28T19:58:04.739 DEBUG:teuthology.orchestra.run.smithi179:> dd if=/scratch_devs of=/dev/stdout 2023-11-28T19:58:04.749 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-11-28T19:58:04.749 DEBUG:teuthology.orchestra.run.smithi179:> stat /dev/vg_nvme/lv_1 2023-11-28T19:58:04.799 INFO:teuthology.orchestra.run.smithi179.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-11-28T19:58:04.799 INFO:teuthology.orchestra.run.smithi179.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-11-28T19:58:04.799 INFO:teuthology.orchestra.run.smithi179.stdout:Device: 5h/5d Inode: 889 Links: 1 2023-11-28T19:58:04.800 INFO:teuthology.orchestra.run.smithi179.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-11-28T19:58:04.800 INFO:teuthology.orchestra.run.smithi179.stdout:Access: 2023-11-28 19:51:36.425616739 +0000 2023-11-28T19:58:04.800 INFO:teuthology.orchestra.run.smithi179.stdout:Modify: 2023-11-28 19:51:36.037620205 +0000 2023-11-28T19:58:04.800 INFO:teuthology.orchestra.run.smithi179.stdout:Change: 2023-11-28 19:51:36.037620205 +0000 2023-11-28T19:58:04.800 INFO:teuthology.orchestra.run.smithi179.stdout: Birth: 2023-11-28 19:51:36.037620205 +0000 2023-11-28T19:58:04.800 DEBUG:teuthology.orchestra.run.smithi179:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-11-28T19:58:04.865 INFO:teuthology.orchestra.run.smithi179.stderr:1+0 records in 2023-11-28T19:58:04.865 INFO:teuthology.orchestra.run.smithi179.stderr:1+0 records out 2023-11-28T19:58:04.865 INFO:teuthology.orchestra.run.smithi179.stderr:512 bytes copied, 0.000397866 s, 1.3 MB/s 2023-11-28T19:58:04.867 DEBUG:teuthology.orchestra.run.smithi179:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-11-28T19:58:04.921 DEBUG:teuthology.orchestra.run.smithi179:> stat /dev/vg_nvme/lv_2 2023-11-28T19:58:04.975 INFO:teuthology.orchestra.run.smithi179.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-11-28T19:58:04.975 INFO:teuthology.orchestra.run.smithi179.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-11-28T19:58:04.975 INFO:teuthology.orchestra.run.smithi179.stdout:Device: 5h/5d Inode: 908 Links: 1 2023-11-28T19:58:04.975 INFO:teuthology.orchestra.run.smithi179.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-11-28T19:58:04.975 INFO:teuthology.orchestra.run.smithi179.stdout:Access: 2023-11-28 19:51:37.049611167 +0000 2023-11-28T19:58:04.975 INFO:teuthology.orchestra.run.smithi179.stdout:Modify: 2023-11-28 19:51:36.661614632 +0000 2023-11-28T19:58:04.975 INFO:teuthology.orchestra.run.smithi179.stdout:Change: 2023-11-28 19:51:36.661614632 +0000 2023-11-28T19:58:04.975 INFO:teuthology.orchestra.run.smithi179.stdout: Birth: 2023-11-28 19:51:36.661614632 +0000 2023-11-28T19:58:04.976 DEBUG:teuthology.orchestra.run.smithi179:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-11-28T19:58:05.041 INFO:teuthology.orchestra.run.smithi179.stderr:1+0 records in 2023-11-28T19:58:05.042 INFO:teuthology.orchestra.run.smithi179.stderr:1+0 records out 2023-11-28T19:58:05.042 INFO:teuthology.orchestra.run.smithi179.stderr:512 bytes copied, 0.000382309 s, 1.3 MB/s 2023-11-28T19:58:05.044 DEBUG:teuthology.orchestra.run.smithi179:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-11-28T19:58:05.101 DEBUG:teuthology.orchestra.run.smithi179:> stat /dev/vg_nvme/lv_3 2023-11-28T19:58:05.151 INFO:teuthology.orchestra.run.smithi179.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-11-28T19:58:05.151 INFO:teuthology.orchestra.run.smithi179.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-11-28T19:58:05.151 INFO:teuthology.orchestra.run.smithi179.stdout:Device: 5h/5d Inode: 924 Links: 1 2023-11-28T19:58:05.151 INFO:teuthology.orchestra.run.smithi179.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-11-28T19:58:05.151 INFO:teuthology.orchestra.run.smithi179.stdout:Access: 2023-11-28 19:51:37.313608808 +0000 2023-11-28T19:58:05.151 INFO:teuthology.orchestra.run.smithi179.stdout:Modify: 2023-11-28 19:51:37.309608844 +0000 2023-11-28T19:58:05.151 INFO:teuthology.orchestra.run.smithi179.stdout:Change: 2023-11-28 19:51:37.309608844 +0000 2023-11-28T19:58:05.151 INFO:teuthology.orchestra.run.smithi179.stdout: Birth: 2023-11-28 19:51:37.309608844 +0000 2023-11-28T19:58:05.152 DEBUG:teuthology.orchestra.run.smithi179:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-11-28T19:58:05.214 INFO:teuthology.orchestra.run.smithi179.stderr:1+0 records in 2023-11-28T19:58:05.214 INFO:teuthology.orchestra.run.smithi179.stderr:1+0 records out 2023-11-28T19:58:05.215 INFO:teuthology.orchestra.run.smithi179.stderr:512 bytes copied, 0.000420983 s, 1.2 MB/s 2023-11-28T19:58:05.216 DEBUG:teuthology.orchestra.run.smithi179:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-11-28T19:58:05.269 DEBUG:teuthology.orchestra.run.smithi179:> stat /dev/vg_nvme/lv_4 2023-11-28T19:58:05.319 INFO:teuthology.orchestra.run.smithi179.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-11-28T19:58:05.319 INFO:teuthology.orchestra.run.smithi179.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-11-28T19:58:05.319 INFO:teuthology.orchestra.run.smithi179.stdout:Device: 5h/5d Inode: 941 Links: 1 2023-11-28T19:58:05.319 INFO:teuthology.orchestra.run.smithi179.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-11-28T19:58:05.320 INFO:teuthology.orchestra.run.smithi179.stdout:Access: 2023-11-28 19:51:38.425598874 +0000 2023-11-28T19:58:05.320 INFO:teuthology.orchestra.run.smithi179.stdout:Modify: 2023-11-28 19:51:38.005602627 +0000 2023-11-28T19:58:05.320 INFO:teuthology.orchestra.run.smithi179.stdout:Change: 2023-11-28 19:51:38.005602627 +0000 2023-11-28T19:58:05.320 INFO:teuthology.orchestra.run.smithi179.stdout: Birth: 2023-11-28 19:51:38.005602627 +0000 2023-11-28T19:58:05.320 DEBUG:teuthology.orchestra.run.smithi179:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-11-28T19:58:05.385 INFO:teuthology.orchestra.run.smithi179.stderr:1+0 records in 2023-11-28T19:58:05.386 INFO:teuthology.orchestra.run.smithi179.stderr:1+0 records out 2023-11-28T19:58:05.386 INFO:teuthology.orchestra.run.smithi179.stderr:512 bytes copied, 0.000417884 s, 1.2 MB/s 2023-11-28T19:58:05.387 DEBUG:teuthology.orchestra.run.smithi179:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-11-28T19:58:05.445 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-11-28T19:58:05.445 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi078.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi179.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2023-11-28T19:58:05.445 INFO:tasks.ceph:Generating config... 2023-11-28T19:58:05.446 INFO:tasks.ceph:[client] client mount timeout = 600 2023-11-28T19:58:05.447 INFO:tasks.ceph:[client] debug client = 20 2023-11-28T19:58:05.447 INFO:tasks.ceph:[client] debug ms = 1 2023-11-28T19:58:05.447 INFO:tasks.ceph:[client] rados mon op timeout = 900 2023-11-28T19:58:05.447 INFO:tasks.ceph:[client] rados osd op timeout = 900 2023-11-28T19:58:05.447 INFO:tasks.ceph:[global] ms die on skipped message = False 2023-11-28T19:58:05.448 INFO:tasks.ceph:[mds] debug mds = 20 2023-11-28T19:58:05.448 INFO:tasks.ceph:[mds] debug mds balancer = 20 2023-11-28T19:58:05.448 INFO:tasks.ceph:[mds] debug ms = 1 2023-11-28T19:58:05.448 INFO:tasks.ceph:[mds] mds debug frag = True 2023-11-28T19:58:05.448 INFO:tasks.ceph:[mds] mds debug scatterstat = True 2023-11-28T19:58:05.448 INFO:tasks.ceph:[mds] mds op complaint time = 180 2023-11-28T19:58:05.449 INFO:tasks.ceph:[mds] mds verify scatter = True 2023-11-28T19:58:05.449 INFO:tasks.ceph:[mds] osd op complaint time = 180 2023-11-28T19:58:05.449 INFO:tasks.ceph:[mds] rados mon op timeout = 900 2023-11-28T19:58:05.449 INFO:tasks.ceph:[mds] rados osd op timeout = 900 2023-11-28T19:58:05.449 INFO:tasks.ceph:[mgr] debug mgr = 20 2023-11-28T19:58:05.449 INFO:tasks.ceph:[mgr] debug ms = 1 2023-11-28T19:58:05.449 INFO:tasks.ceph:[mon] debug mon = 20 2023-11-28T19:58:05.449 INFO:tasks.ceph:[mon] debug ms = 1 2023-11-28T19:58:05.450 INFO:tasks.ceph:[mon] debug paxos = 20 2023-11-28T19:58:05.450 INFO:tasks.ceph:[mon] mon op complaint time = 120 2023-11-28T19:58:05.450 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2023-11-28T19:58:05.450 INFO:tasks.ceph:[osd] bluestore compression mode = aggressive 2023-11-28T19:58:05.450 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2023-11-28T19:58:05.451 INFO:tasks.ceph:[osd] debug bluefs = 20 2023-11-28T19:58:05.451 INFO:tasks.ceph:[osd] debug bluestore = 20 2023-11-28T19:58:05.451 INFO:tasks.ceph:[osd] debug ms = 1 2023-11-28T19:58:05.451 INFO:tasks.ceph:[osd] debug osd = 20 2023-11-28T19:58:05.451 INFO:tasks.ceph:[osd] debug rocksdb = 10 2023-11-28T19:58:05.451 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2023-11-28T19:58:05.452 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2023-11-28T19:58:05.452 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2023-11-28T19:58:05.452 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2023-11-28T19:58:05.452 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2023-11-28T19:58:05.452 INFO:tasks.ceph:[osd] osd op complaint time = 180 2023-11-28T19:58:05.452 INFO:tasks.ceph:Setting up mon.a... 2023-11-28T19:58:05.453 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2023-11-28T19:58:05.498 INFO:teuthology.orchestra.run.smithi078.stdout:creating /etc/ceph/ceph.keyring 2023-11-28T19:58:05.512 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2023-11-28T19:58:05.601 DEBUG:teuthology.orchestra.run.smithi078:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-11-28T19:58:05.669 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.78'), ('mon.b', '172.21.15.179'), ('mon.c', '[v2:172.21.15.179:3301,v1:172.21.15.179:6790]')] 2023-11-28T19:58:05.670 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.78,172.21.15.179,[v2:172.21.15.179:3301,v1:172.21.15.179:6790]', 'ms die on skipped message': False}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd debug trim objects': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bluestore block size': 96636764160, 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon op complaint time': 120}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}, 'mds.c': {}, 'mds.b': {}, 'mds.d': {}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}} 2023-11-28T19:58:05.670 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2023-11-28T19:58:05.671 DEBUG:teuthology.orchestra.run.smithi078:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2023-11-28T19:58:05.721 DEBUG:teuthology.orchestra.run.smithi078:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.78 --add b 172.21.15.179 --addv c '[v2:172.21.15.179:3301,v1:172.21.15.179:6790]' --print /home/ubuntu/cephtest/ceph.monmap 2023-11-28T19:58:05.815 INFO:teuthology.orchestra.run.smithi078.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2023-11-28T19:58:05.815 INFO:teuthology.orchestra.run.smithi078.stdout:monmaptool: generated fsid dd9780e8-3bda-44fa-a9f0-fa07d19d901d 2023-11-28T19:58:05.816 INFO:teuthology.orchestra.run.smithi078.stdout:setting min_mon_release = pacific 2023-11-28T19:58:05.816 INFO:teuthology.orchestra.run.smithi078.stdout:epoch 0 2023-11-28T19:58:05.816 INFO:teuthology.orchestra.run.smithi078.stdout:fsid dd9780e8-3bda-44fa-a9f0-fa07d19d901d 2023-11-28T19:58:05.816 INFO:teuthology.orchestra.run.smithi078.stdout:last_changed 2023-11-28T19:58:05.816748+0000 2023-11-28T19:58:05.817 INFO:teuthology.orchestra.run.smithi078.stdout:created 2023-11-28T19:58:05.816748+0000 2023-11-28T19:58:05.817 INFO:teuthology.orchestra.run.smithi078.stdout:min_mon_release 16 (pacific) 2023-11-28T19:58:05.818 INFO:teuthology.orchestra.run.smithi078.stdout:election_strategy: 1 2023-11-28T19:58:05.818 INFO:teuthology.orchestra.run.smithi078.stdout:0: [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] mon.a 2023-11-28T19:58:05.818 INFO:teuthology.orchestra.run.smithi078.stdout:1: [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] mon.b 2023-11-28T19:58:05.818 INFO:teuthology.orchestra.run.smithi078.stdout:2: [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] mon.c 2023-11-28T19:58:05.818 INFO:teuthology.orchestra.run.smithi078.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2023-11-28T19:58:05.820 DEBUG:teuthology.orchestra.run.smithi078:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2023-11-28T19:58:05.828 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID dd9780e8-3bda-44fa-a9f0-fa07d19d901d... 2023-11-28T19:58:05.829 DEBUG:teuthology.orchestra.run.smithi078:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-11-28T19:58:05.876 DEBUG:teuthology.orchestra.run.smithi179:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-11-28T19:58:05.917 INFO:teuthology.orchestra.run.smithi078.stdout:[global] 2023-11-28T19:58:05.917 INFO:teuthology.orchestra.run.smithi078.stdout: chdir = "" 2023-11-28T19:58:05.917 INFO:teuthology.orchestra.run.smithi078.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-11-28T19:58:05.918 INFO:teuthology.orchestra.run.smithi078.stdout: auth supported = cephx 2023-11-28T19:58:05.918 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-11-28T19:58:05.918 INFO:teuthology.orchestra.run.smithi078.stdout: filestore xattr use omap = true 2023-11-28T19:58:05.918 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-11-28T19:58:05.918 INFO:teuthology.orchestra.run.smithi078.stdout: mon clock drift allowed = 1.000 2023-11-28T19:58:05.918 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-11-28T19:58:05.918 INFO:teuthology.orchestra.run.smithi078.stdout: osd crush chooseleaf type = 0 2023-11-28T19:58:05.918 INFO:teuthology.orchestra.run.smithi078.stdout: auth debug = true 2023-11-28T19:58:05.918 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-11-28T19:58:05.918 INFO:teuthology.orchestra.run.smithi078.stdout: ms die on old message = true 2023-11-28T19:58:05.919 INFO:teuthology.orchestra.run.smithi078.stdout: ms die on bug = true 2023-11-28T19:58:05.919 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-11-28T19:58:05.919 INFO:teuthology.orchestra.run.smithi078.stdout: mon max pg per osd = 10000 # >= luminous 2023-11-28T19:58:05.919 INFO:teuthology.orchestra.run.smithi078.stdout: mon pg warn max object skew = 0 2023-11-28T19:58:05.919 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-11-28T19:58:05.919 INFO:teuthology.orchestra.run.smithi078.stdout: # disable pg_autoscaler by default for new pools 2023-11-28T19:58:05.919 INFO:teuthology.orchestra.run.smithi078.stdout: osd_pool_default_pg_autoscale_mode = off 2023-11-28T19:58:05.919 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-11-28T19:58:05.919 INFO:teuthology.orchestra.run.smithi078.stdout: osd pool default size = 2 2023-11-28T19:58:05.919 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-11-28T19:58:05.919 INFO:teuthology.orchestra.run.smithi078.stdout: mon osd allow primary affinity = true 2023-11-28T19:58:05.920 INFO:teuthology.orchestra.run.smithi078.stdout: mon osd allow pg remap = true 2023-11-28T19:58:05.920 INFO:teuthology.orchestra.run.smithi078.stdout: mon warn on legacy crush tunables = false 2023-11-28T19:58:05.920 INFO:teuthology.orchestra.run.smithi078.stdout: mon warn on crush straw calc version zero = false 2023-11-28T19:58:05.920 INFO:teuthology.orchestra.run.smithi078.stdout: mon warn on no sortbitwise = false 2023-11-28T19:58:05.920 INFO:teuthology.orchestra.run.smithi078.stdout: mon warn on osd down out interval zero = false 2023-11-28T19:58:05.920 INFO:teuthology.orchestra.run.smithi078.stdout: mon warn on too few osds = false 2023-11-28T19:58:05.920 INFO:teuthology.orchestra.run.smithi078.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-11-28T19:58:05.920 INFO:teuthology.orchestra.run.smithi078.stdout: mon_warn_on_pool_no_redundancy = false 2023-11-28T19:58:05.920 INFO:teuthology.orchestra.run.smithi078.stdout: mon_allow_pool_size_one = true 2023-11-28T19:58:05.920 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-11-28T19:58:05.920 INFO:teuthology.orchestra.run.smithi078.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-11-28T19:58:05.921 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-11-28T19:58:05.921 INFO:teuthology.orchestra.run.smithi078.stdout: osd default data pool replay window = 5 2023-11-28T19:58:05.921 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-11-28T19:58:05.921 INFO:teuthology.orchestra.run.smithi078.stdout: mon allow pool delete = true 2023-11-28T19:58:05.921 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-11-28T19:58:05.921 INFO:teuthology.orchestra.run.smithi078.stdout: mon cluster log file level = debug 2023-11-28T19:58:05.921 INFO:teuthology.orchestra.run.smithi078.stdout: debug asserts on shutdown = true 2023-11-28T19:58:05.921 INFO:teuthology.orchestra.run.smithi078.stdout: mon health detail to clog = false 2023-11-28T19:58:05.922 INFO:teuthology.orchestra.run.smithi078.stdout: mon host = "172.21.15.78,172.21.15.179,[v2:172.21.15.179:3301,v1:172.21.15.179:6790]" 2023-11-28T19:58:05.922 INFO:teuthology.orchestra.run.smithi078.stdout: ms die on skipped message = False 2023-11-28T19:58:05.922 INFO:teuthology.orchestra.run.smithi078.stdout: fsid = dd9780e8-3bda-44fa-a9f0-fa07d19d901d 2023-11-28T19:58:05.922 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-11-28T19:58:05.922 INFO:teuthology.orchestra.run.smithi078.stdout:[osd] 2023-11-28T19:58:05.922 INFO:teuthology.orchestra.run.smithi078.stdout: osd journal size = 100 2023-11-28T19:58:05.922 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-11-28T19:58:05.922 INFO:teuthology.orchestra.run.smithi078.stdout: osd scrub load threshold = 5.0 2023-11-28T19:58:05.922 INFO:teuthology.orchestra.run.smithi078.stdout: osd scrub max interval = 600 2023-11-28T19:58:05.922 INFO:teuthology.orchestra.run.smithi078.stdout: osd mclock profile = high_recovery_ops 2023-11-28T19:58:05.923 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-11-28T19:58:05.923 INFO:teuthology.orchestra.run.smithi078.stdout: osd recover clone overlap = true 2023-11-28T19:58:05.923 INFO:teuthology.orchestra.run.smithi078.stdout: osd recovery max chunk = 1048576 2023-11-28T19:58:05.923 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-11-28T19:58:05.923 INFO:teuthology.orchestra.run.smithi078.stdout: osd debug shutdown = true 2023-11-28T19:58:05.923 INFO:teuthology.orchestra.run.smithi078.stdout: osd debug op order = true 2023-11-28T19:58:05.923 INFO:teuthology.orchestra.run.smithi078.stdout: osd debug verify stray on activate = true 2023-11-28T19:58:05.923 INFO:teuthology.orchestra.run.smithi078.stdout: osd debug trim objects = true 2023-11-28T19:58:05.923 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-11-28T19:58:05.924 INFO:teuthology.orchestra.run.smithi078.stdout: osd open classes on start = true 2023-11-28T19:58:05.924 INFO:teuthology.orchestra.run.smithi078.stdout: osd debug pg log writeout = true 2023-11-28T19:58:05.924 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-11-28T19:58:05.924 INFO:teuthology.orchestra.run.smithi078.stdout: osd deep scrub update digest min age = 30 2023-11-28T19:58:05.924 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-11-28T19:58:05.924 INFO:teuthology.orchestra.run.smithi078.stdout: osd map max advance = 10 2023-11-28T19:58:05.924 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-11-28T19:58:05.924 INFO:teuthology.orchestra.run.smithi078.stdout: journal zero on create = true 2023-11-28T19:58:05.925 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-11-28T19:58:05.925 INFO:teuthology.orchestra.run.smithi078.stdout: filestore ondisk finisher threads = 3 2023-11-28T19:58:05.925 INFO:teuthology.orchestra.run.smithi078.stdout: filestore apply finisher threads = 3 2023-11-28T19:58:05.925 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-11-28T19:58:05.925 INFO:teuthology.orchestra.run.smithi078.stdout: bdev debug aio = true 2023-11-28T19:58:05.925 INFO:teuthology.orchestra.run.smithi078.stdout: osd debug misdirected ops = true 2023-11-28T19:58:05.925 INFO:teuthology.orchestra.run.smithi078.stdout: bluestore block size = 96636764160 2023-11-28T19:58:05.925 INFO:teuthology.orchestra.run.smithi078.stdout: bluestore compression mode = aggressive 2023-11-28T19:58:05.925 INFO:teuthology.orchestra.run.smithi078.stdout: bluestore fsck on mount = True 2023-11-28T19:58:05.925 INFO:teuthology.orchestra.run.smithi078.stdout: debug bluefs = 20 2023-11-28T19:58:05.925 INFO:teuthology.orchestra.run.smithi078.stdout: debug bluestore = 20 2023-11-28T19:58:05.925 INFO:teuthology.orchestra.run.smithi078.stdout: debug ms = 1 2023-11-28T19:58:05.926 INFO:teuthology.orchestra.run.smithi078.stdout: debug osd = 20 2023-11-28T19:58:05.926 INFO:teuthology.orchestra.run.smithi078.stdout: debug rocksdb = 10 2023-11-28T19:58:05.926 INFO:teuthology.orchestra.run.smithi078.stdout: mon osd backfillfull_ratio = 0.85 2023-11-28T19:58:05.926 INFO:teuthology.orchestra.run.smithi078.stdout: mon osd full ratio = 0.9 2023-11-28T19:58:05.926 INFO:teuthology.orchestra.run.smithi078.stdout: mon osd nearfull ratio = 0.8 2023-11-28T19:58:05.926 INFO:teuthology.orchestra.run.smithi078.stdout: osd failsafe full ratio = 0.95 2023-11-28T19:58:05.926 INFO:teuthology.orchestra.run.smithi078.stdout: osd objectstore = bluestore 2023-11-28T19:58:05.926 INFO:teuthology.orchestra.run.smithi078.stdout: osd op complaint time = 180 2023-11-28T19:58:05.926 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-11-28T19:58:05.926 INFO:teuthology.orchestra.run.smithi078.stdout:[mgr] 2023-11-28T19:58:05.926 INFO:teuthology.orchestra.run.smithi078.stdout: debug ms = 1 2023-11-28T19:58:05.926 INFO:teuthology.orchestra.run.smithi078.stdout: debug mgr = 20 2023-11-28T19:58:05.927 INFO:teuthology.orchestra.run.smithi078.stdout: debug mon = 20 2023-11-28T19:58:05.927 INFO:teuthology.orchestra.run.smithi078.stdout: debug auth = 20 2023-11-28T19:58:05.927 INFO:teuthology.orchestra.run.smithi078.stdout: mon reweight min pgs per osd = 4 2023-11-28T19:58:05.927 INFO:teuthology.orchestra.run.smithi078.stdout: mon reweight min bytes per osd = 10 2023-11-28T19:58:05.927 INFO:teuthology.orchestra.run.smithi078.stdout: mgr/telemetry/nag = false 2023-11-28T19:58:05.927 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-11-28T19:58:05.927 INFO:teuthology.orchestra.run.smithi078.stdout:[mon] 2023-11-28T19:58:05.927 INFO:teuthology.orchestra.run.smithi078.stdout: debug ms = 1 2023-11-28T19:58:05.927 INFO:teuthology.orchestra.run.smithi078.stdout: debug mon = 20 2023-11-28T19:58:05.927 INFO:teuthology.orchestra.run.smithi078.stdout: debug paxos = 20 2023-11-28T19:58:05.927 INFO:teuthology.orchestra.run.smithi078.stdout: debug auth = 20 2023-11-28T19:58:05.927 INFO:teuthology.orchestra.run.smithi078.stdout: mon data avail warn = 5 2023-11-28T19:58:05.927 INFO:teuthology.orchestra.run.smithi078.stdout: mon mgr mkfs grace = 240 2023-11-28T19:58:05.928 INFO:teuthology.orchestra.run.smithi078.stdout: mon reweight min pgs per osd = 4 2023-11-28T19:58:05.928 INFO:teuthology.orchestra.run.smithi078.stdout: mon osd reporter subtree level = osd 2023-11-28T19:58:05.928 INFO:teuthology.orchestra.run.smithi078.stdout: mon osd prime pg temp = true 2023-11-28T19:58:05.928 INFO:teuthology.orchestra.run.smithi078.stdout: mon reweight min bytes per osd = 10 2023-11-28T19:58:05.928 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-11-28T19:58:05.928 INFO:teuthology.orchestra.run.smithi078.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-11-28T19:58:05.928 INFO:teuthology.orchestra.run.smithi078.stdout: auth mon ticket ttl = 660 # 11m 2023-11-28T19:58:05.928 INFO:teuthology.orchestra.run.smithi078.stdout: auth service ticket ttl = 240 # 4m 2023-11-28T19:58:05.928 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-11-28T19:58:05.930 INFO:teuthology.orchestra.run.smithi078.stdout: # don't complain about insecure global_id in the test suite 2023-11-28T19:58:05.930 INFO:teuthology.orchestra.run.smithi078.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-11-28T19:58:05.930 INFO:teuthology.orchestra.run.smithi078.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-11-28T19:58:05.930 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-11-28T19:58:05.930 INFO:teuthology.orchestra.run.smithi078.stdout: # 1m isn't quite enough 2023-11-28T19:58:05.930 INFO:teuthology.orchestra.run.smithi078.stdout: mon_down_mkfs_grace = 2m 2023-11-28T19:58:05.931 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-11-28T19:58:05.931 INFO:teuthology.orchestra.run.smithi078.stdout: mon_warn_on_filestore_osds = false 2023-11-28T19:58:05.931 INFO:teuthology.orchestra.run.smithi078.stdout: mon op complaint time = 120 2023-11-28T19:58:05.931 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-11-28T19:58:05.931 INFO:teuthology.orchestra.run.smithi078.stdout:[client] 2023-11-28T19:58:05.931 INFO:teuthology.orchestra.run.smithi078.stdout: rgw cache enabled = true 2023-11-28T19:58:05.931 INFO:teuthology.orchestra.run.smithi078.stdout: rgw enable ops log = true 2023-11-28T19:58:05.931 INFO:teuthology.orchestra.run.smithi078.stdout: rgw enable usage log = true 2023-11-28T19:58:05.931 INFO:teuthology.orchestra.run.smithi078.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-11-28T19:58:05.931 INFO:teuthology.orchestra.run.smithi078.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-11-28T19:58:05.931 INFO:teuthology.orchestra.run.smithi078.stdout: client mount timeout = 600 2023-11-28T19:58:05.931 INFO:teuthology.orchestra.run.smithi078.stdout: debug client = 20 2023-11-28T19:58:05.932 INFO:teuthology.orchestra.run.smithi078.stdout: debug ms = 1 2023-11-28T19:58:05.932 INFO:teuthology.orchestra.run.smithi078.stdout: rados mon op timeout = 900 2023-11-28T19:58:05.932 INFO:teuthology.orchestra.run.smithi078.stdout: rados osd op timeout = 900 2023-11-28T19:58:05.932 INFO:teuthology.orchestra.run.smithi078.stdout:[mon.a] 2023-11-28T19:58:05.932 INFO:teuthology.orchestra.run.smithi078.stdout:[mon.b] 2023-11-28T19:58:05.932 INFO:teuthology.orchestra.run.smithi078.stdout:[mon.c] 2023-11-28T19:58:05.932 INFO:teuthology.orchestra.run.smithi078.stdout:[mds.a] 2023-11-28T19:58:05.932 INFO:teuthology.orchestra.run.smithi078.stdout:[mds.c] 2023-11-28T19:58:05.932 INFO:teuthology.orchestra.run.smithi078.stdout:[mds.b] 2023-11-28T19:58:05.932 INFO:teuthology.orchestra.run.smithi078.stdout:[mds.d] 2023-11-28T19:58:05.932 INFO:teuthology.orchestra.run.smithi078.stdout:[mds] 2023-11-28T19:58:05.932 INFO:teuthology.orchestra.run.smithi078.stdout: debug mds = 20 2023-11-28T19:58:05.933 INFO:teuthology.orchestra.run.smithi078.stdout: debug mds balancer = 20 2023-11-28T19:58:05.933 INFO:teuthology.orchestra.run.smithi078.stdout: debug ms = 1 2023-11-28T19:58:05.933 INFO:teuthology.orchestra.run.smithi078.stdout: mds debug frag = True 2023-11-28T19:58:05.933 INFO:teuthology.orchestra.run.smithi078.stdout: mds debug scatterstat = True 2023-11-28T19:58:05.933 INFO:teuthology.orchestra.run.smithi078.stdout: mds op complaint time = 180 2023-11-28T19:58:05.933 INFO:teuthology.orchestra.run.smithi078.stdout: mds verify scatter = True 2023-11-28T19:58:05.933 INFO:teuthology.orchestra.run.smithi078.stdout: osd op complaint time = 180 2023-11-28T19:58:05.933 INFO:teuthology.orchestra.run.smithi078.stdout: rados mon op timeout = 900 2023-11-28T19:58:05.933 INFO:teuthology.orchestra.run.smithi078.stdout: rados osd op timeout = 900 2023-11-28T19:58:05.934 INFO:teuthology.orchestra.run.smithi179.stdout:[global] 2023-11-28T19:58:05.934 INFO:teuthology.orchestra.run.smithi179.stdout: chdir = "" 2023-11-28T19:58:05.934 INFO:teuthology.orchestra.run.smithi179.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-11-28T19:58:05.934 INFO:teuthology.orchestra.run.smithi179.stdout: auth supported = cephx 2023-11-28T19:58:05.934 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-11-28T19:58:05.934 INFO:teuthology.orchestra.run.smithi179.stdout: filestore xattr use omap = true 2023-11-28T19:58:05.934 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-11-28T19:58:05.934 INFO:teuthology.orchestra.run.smithi179.stdout: mon clock drift allowed = 1.000 2023-11-28T19:58:05.935 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-11-28T19:58:05.935 INFO:teuthology.orchestra.run.smithi179.stdout: osd crush chooseleaf type = 0 2023-11-28T19:58:05.935 INFO:teuthology.orchestra.run.smithi179.stdout: auth debug = true 2023-11-28T19:58:05.935 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-11-28T19:58:05.935 INFO:teuthology.orchestra.run.smithi179.stdout: ms die on old message = true 2023-11-28T19:58:05.935 INFO:teuthology.orchestra.run.smithi179.stdout: ms die on bug = true 2023-11-28T19:58:05.935 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-11-28T19:58:05.935 INFO:teuthology.orchestra.run.smithi179.stdout: mon max pg per osd = 10000 # >= luminous 2023-11-28T19:58:05.935 INFO:teuthology.orchestra.run.smithi179.stdout: mon pg warn max object skew = 0 2023-11-28T19:58:05.935 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-11-28T19:58:05.935 INFO:teuthology.orchestra.run.smithi179.stdout: # disable pg_autoscaler by default for new pools 2023-11-28T19:58:05.935 INFO:teuthology.orchestra.run.smithi179.stdout: osd_pool_default_pg_autoscale_mode = off 2023-11-28T19:58:05.935 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-11-28T19:58:05.936 INFO:teuthology.orchestra.run.smithi179.stdout: osd pool default size = 2 2023-11-28T19:58:05.936 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-11-28T19:58:05.936 INFO:teuthology.orchestra.run.smithi179.stdout: mon osd allow primary affinity = true 2023-11-28T19:58:05.936 INFO:teuthology.orchestra.run.smithi179.stdout: mon osd allow pg remap = true 2023-11-28T19:58:05.936 INFO:teuthology.orchestra.run.smithi179.stdout: mon warn on legacy crush tunables = false 2023-11-28T19:58:05.936 INFO:teuthology.orchestra.run.smithi179.stdout: mon warn on crush straw calc version zero = false 2023-11-28T19:58:05.936 INFO:teuthology.orchestra.run.smithi179.stdout: mon warn on no sortbitwise = false 2023-11-28T19:58:05.936 INFO:teuthology.orchestra.run.smithi179.stdout: mon warn on osd down out interval zero = false 2023-11-28T19:58:05.936 INFO:teuthology.orchestra.run.smithi179.stdout: mon warn on too few osds = false 2023-11-28T19:58:05.936 INFO:teuthology.orchestra.run.smithi179.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-11-28T19:58:05.936 INFO:teuthology.orchestra.run.smithi179.stdout: mon_warn_on_pool_no_redundancy = false 2023-11-28T19:58:05.936 INFO:teuthology.orchestra.run.smithi179.stdout: mon_allow_pool_size_one = true 2023-11-28T19:58:05.937 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-11-28T19:58:05.937 INFO:teuthology.orchestra.run.smithi179.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-11-28T19:58:05.937 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-11-28T19:58:05.937 INFO:teuthology.orchestra.run.smithi179.stdout: osd default data pool replay window = 5 2023-11-28T19:58:05.937 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-11-28T19:58:05.937 INFO:teuthology.orchestra.run.smithi179.stdout: mon allow pool delete = true 2023-11-28T19:58:05.937 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-11-28T19:58:05.937 INFO:teuthology.orchestra.run.smithi179.stdout: mon cluster log file level = debug 2023-11-28T19:58:05.937 INFO:teuthology.orchestra.run.smithi179.stdout: debug asserts on shutdown = true 2023-11-28T19:58:05.937 INFO:teuthology.orchestra.run.smithi179.stdout: mon health detail to clog = false 2023-11-28T19:58:05.937 INFO:teuthology.orchestra.run.smithi179.stdout: mon host = "172.21.15.78,172.21.15.179,[v2:172.21.15.179:3301,v1:172.21.15.179:6790]" 2023-11-28T19:58:05.937 INFO:teuthology.orchestra.run.smithi179.stdout: ms die on skipped message = False 2023-11-28T19:58:05.938 INFO:teuthology.orchestra.run.smithi179.stdout: fsid = dd9780e8-3bda-44fa-a9f0-fa07d19d901d 2023-11-28T19:58:05.938 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-11-28T19:58:05.938 INFO:teuthology.orchestra.run.smithi179.stdout:[osd] 2023-11-28T19:58:05.938 INFO:teuthology.orchestra.run.smithi179.stdout: osd journal size = 100 2023-11-28T19:58:05.938 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-11-28T19:58:05.938 INFO:teuthology.orchestra.run.smithi179.stdout: osd scrub load threshold = 5.0 2023-11-28T19:58:05.938 INFO:teuthology.orchestra.run.smithi179.stdout: osd scrub max interval = 600 2023-11-28T19:58:05.938 INFO:teuthology.orchestra.run.smithi179.stdout: osd mclock profile = high_recovery_ops 2023-11-28T19:58:05.938 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-11-28T19:58:05.938 INFO:teuthology.orchestra.run.smithi179.stdout: osd recover clone overlap = true 2023-11-28T19:58:05.939 INFO:teuthology.orchestra.run.smithi179.stdout: osd recovery max chunk = 1048576 2023-11-28T19:58:05.939 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-11-28T19:58:05.939 INFO:teuthology.orchestra.run.smithi179.stdout: osd debug shutdown = true 2023-11-28T19:58:05.939 INFO:teuthology.orchestra.run.smithi179.stdout: osd debug op order = true 2023-11-28T19:58:05.939 INFO:teuthology.orchestra.run.smithi179.stdout: osd debug verify stray on activate = true 2023-11-28T19:58:05.939 INFO:teuthology.orchestra.run.smithi179.stdout: osd debug trim objects = true 2023-11-28T19:58:05.939 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-11-28T19:58:05.940 INFO:teuthology.orchestra.run.smithi179.stdout: osd open classes on start = true 2023-11-28T19:58:05.940 INFO:teuthology.orchestra.run.smithi179.stdout: osd debug pg log writeout = true 2023-11-28T19:58:05.940 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-11-28T19:58:05.940 INFO:teuthology.orchestra.run.smithi179.stdout: osd deep scrub update digest min age = 30 2023-11-28T19:58:05.940 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-11-28T19:58:05.940 INFO:teuthology.orchestra.run.smithi179.stdout: osd map max advance = 10 2023-11-28T19:58:05.940 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-11-28T19:58:05.940 INFO:teuthology.orchestra.run.smithi179.stdout: journal zero on create = true 2023-11-28T19:58:05.940 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-11-28T19:58:05.940 INFO:teuthology.orchestra.run.smithi179.stdout: filestore ondisk finisher threads = 3 2023-11-28T19:58:05.940 INFO:teuthology.orchestra.run.smithi179.stdout: filestore apply finisher threads = 3 2023-11-28T19:58:05.940 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-11-28T19:58:05.941 INFO:teuthology.orchestra.run.smithi179.stdout: bdev debug aio = true 2023-11-28T19:58:05.941 INFO:teuthology.orchestra.run.smithi179.stdout: osd debug misdirected ops = true 2023-11-28T19:58:05.941 INFO:teuthology.orchestra.run.smithi179.stdout: bluestore block size = 96636764160 2023-11-28T19:58:05.941 INFO:teuthology.orchestra.run.smithi179.stdout: bluestore compression mode = aggressive 2023-11-28T19:58:05.941 INFO:teuthology.orchestra.run.smithi179.stdout: bluestore fsck on mount = True 2023-11-28T19:58:05.941 INFO:teuthology.orchestra.run.smithi179.stdout: debug bluefs = 20 2023-11-28T19:58:05.941 INFO:teuthology.orchestra.run.smithi179.stdout: debug bluestore = 20 2023-11-28T19:58:05.941 INFO:teuthology.orchestra.run.smithi179.stdout: debug ms = 1 2023-11-28T19:58:05.941 INFO:teuthology.orchestra.run.smithi179.stdout: debug osd = 20 2023-11-28T19:58:05.941 INFO:teuthology.orchestra.run.smithi179.stdout: debug rocksdb = 10 2023-11-28T19:58:05.941 INFO:teuthology.orchestra.run.smithi179.stdout: mon osd backfillfull_ratio = 0.85 2023-11-28T19:58:05.941 INFO:teuthology.orchestra.run.smithi179.stdout: mon osd full ratio = 0.9 2023-11-28T19:58:05.942 INFO:teuthology.orchestra.run.smithi179.stdout: mon osd nearfull ratio = 0.8 2023-11-28T19:58:05.942 INFO:teuthology.orchestra.run.smithi179.stdout: osd failsafe full ratio = 0.95 2023-11-28T19:58:05.942 INFO:teuthology.orchestra.run.smithi179.stdout: osd objectstore = bluestore 2023-11-28T19:58:05.942 INFO:teuthology.orchestra.run.smithi179.stdout: osd op complaint time = 180 2023-11-28T19:58:05.942 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-11-28T19:58:05.942 INFO:teuthology.orchestra.run.smithi179.stdout:[mgr] 2023-11-28T19:58:05.942 INFO:teuthology.orchestra.run.smithi179.stdout: debug ms = 1 2023-11-28T19:58:05.942 INFO:teuthology.orchestra.run.smithi179.stdout: debug mgr = 20 2023-11-28T19:58:05.942 INFO:teuthology.orchestra.run.smithi179.stdout: debug mon = 20 2023-11-28T19:58:05.942 INFO:teuthology.orchestra.run.smithi179.stdout: debug auth = 20 2023-11-28T19:58:05.942 INFO:teuthology.orchestra.run.smithi179.stdout: mon reweight min pgs per osd = 4 2023-11-28T19:58:05.943 INFO:teuthology.orchestra.run.smithi179.stdout: mon reweight min bytes per osd = 10 2023-11-28T19:58:05.943 INFO:teuthology.orchestra.run.smithi179.stdout: mgr/telemetry/nag = false 2023-11-28T19:58:05.943 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-11-28T19:58:05.943 INFO:teuthology.orchestra.run.smithi179.stdout:[mon] 2023-11-28T19:58:05.943 INFO:teuthology.orchestra.run.smithi179.stdout: debug ms = 1 2023-11-28T19:58:05.943 INFO:teuthology.orchestra.run.smithi179.stdout: debug mon = 20 2023-11-28T19:58:05.943 INFO:teuthology.orchestra.run.smithi179.stdout: debug paxos = 20 2023-11-28T19:58:05.943 INFO:teuthology.orchestra.run.smithi179.stdout: debug auth = 20 2023-11-28T19:58:05.943 INFO:teuthology.orchestra.run.smithi179.stdout: mon data avail warn = 5 2023-11-28T19:58:05.943 INFO:teuthology.orchestra.run.smithi179.stdout: mon mgr mkfs grace = 240 2023-11-28T19:58:05.943 INFO:teuthology.orchestra.run.smithi179.stdout: mon reweight min pgs per osd = 4 2023-11-28T19:58:05.943 INFO:teuthology.orchestra.run.smithi179.stdout: mon osd reporter subtree level = osd 2023-11-28T19:58:05.944 INFO:teuthology.orchestra.run.smithi179.stdout: mon osd prime pg temp = true 2023-11-28T19:58:05.944 INFO:teuthology.orchestra.run.smithi179.stdout: mon reweight min bytes per osd = 10 2023-11-28T19:58:05.944 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-11-28T19:58:05.944 INFO:teuthology.orchestra.run.smithi179.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-11-28T19:58:05.944 INFO:teuthology.orchestra.run.smithi179.stdout: auth mon ticket ttl = 660 # 11m 2023-11-28T19:58:05.944 INFO:teuthology.orchestra.run.smithi179.stdout: auth service ticket ttl = 240 # 4m 2023-11-28T19:58:05.944 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-11-28T19:58:05.944 INFO:teuthology.orchestra.run.smithi179.stdout: # don't complain about insecure global_id in the test suite 2023-11-28T19:58:05.944 INFO:teuthology.orchestra.run.smithi179.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-11-28T19:58:05.944 INFO:teuthology.orchestra.run.smithi179.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-11-28T19:58:05.944 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-11-28T19:58:05.944 INFO:teuthology.orchestra.run.smithi179.stdout: # 1m isn't quite enough 2023-11-28T19:58:05.944 INFO:teuthology.orchestra.run.smithi179.stdout: mon_down_mkfs_grace = 2m 2023-11-28T19:58:05.945 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-11-28T19:58:05.945 INFO:teuthology.orchestra.run.smithi179.stdout: mon_warn_on_filestore_osds = false 2023-11-28T19:58:05.945 INFO:teuthology.orchestra.run.smithi179.stdout: mon op complaint time = 120 2023-11-28T19:58:05.945 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-11-28T19:58:05.945 INFO:teuthology.orchestra.run.smithi179.stdout:[client] 2023-11-28T19:58:05.945 INFO:teuthology.orchestra.run.smithi179.stdout: rgw cache enabled = true 2023-11-28T19:58:05.945 INFO:teuthology.orchestra.run.smithi179.stdout: rgw enable ops log = true 2023-11-28T19:58:05.945 INFO:teuthology.orchestra.run.smithi179.stdout: rgw enable usage log = true 2023-11-28T19:58:05.945 INFO:teuthology.orchestra.run.smithi179.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-11-28T19:58:05.945 INFO:teuthology.orchestra.run.smithi179.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-11-28T19:58:05.945 INFO:teuthology.orchestra.run.smithi179.stdout: client mount timeout = 600 2023-11-28T19:58:05.946 INFO:teuthology.orchestra.run.smithi179.stdout: debug client = 20 2023-11-28T19:58:05.946 INFO:teuthology.orchestra.run.smithi179.stdout: debug ms = 1 2023-11-28T19:58:05.946 INFO:teuthology.orchestra.run.smithi179.stdout: rados mon op timeout = 900 2023-11-28T19:58:05.946 INFO:teuthology.orchestra.run.smithi179.stdout: rados osd op timeout = 900 2023-11-28T19:58:05.946 INFO:teuthology.orchestra.run.smithi179.stdout:[mon.a] 2023-11-28T19:58:05.946 INFO:teuthology.orchestra.run.smithi179.stdout:[mon.b] 2023-11-28T19:58:05.946 INFO:teuthology.orchestra.run.smithi179.stdout:[mon.c] 2023-11-28T19:58:05.946 INFO:teuthology.orchestra.run.smithi179.stdout:[mds.a] 2023-11-28T19:58:05.946 INFO:teuthology.orchestra.run.smithi179.stdout:[mds.c] 2023-11-28T19:58:05.946 INFO:teuthology.orchestra.run.smithi179.stdout:[mds.b] 2023-11-28T19:58:05.947 INFO:teuthology.orchestra.run.smithi179.stdout:[mds.d] 2023-11-28T19:58:05.947 INFO:teuthology.orchestra.run.smithi179.stdout:[mds] 2023-11-28T19:58:05.947 INFO:teuthology.orchestra.run.smithi179.stdout: debug mds = 20 2023-11-28T19:58:05.947 INFO:teuthology.orchestra.run.smithi179.stdout: debug mds balancer = 20 2023-11-28T19:58:05.947 INFO:teuthology.orchestra.run.smithi179.stdout: debug ms = 1 2023-11-28T19:58:05.947 INFO:teuthology.orchestra.run.smithi179.stdout: mds debug frag = True 2023-11-28T19:58:05.947 INFO:teuthology.orchestra.run.smithi179.stdout: mds debug scatterstat = True 2023-11-28T19:58:05.947 INFO:teuthology.orchestra.run.smithi179.stdout: mds op complaint time = 180 2023-11-28T19:58:05.947 INFO:teuthology.orchestra.run.smithi179.stdout: mds verify scatter = True 2023-11-28T19:58:05.947 INFO:teuthology.orchestra.run.smithi179.stdout: osd op complaint time = 180 2023-11-28T19:58:05.947 INFO:teuthology.orchestra.run.smithi179.stdout: rados mon op timeout = 900 2023-11-28T19:58:05.947 INFO:teuthology.orchestra.run.smithi179.stdout: rados osd op timeout = 900 2023-11-28T19:58:05.949 INFO:tasks.ceph:Creating admin key on mon.a... 2023-11-28T19:58:05.950 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2023-11-28T19:58:06.045 INFO:tasks.ceph:Copying monmap to all nodes... 2023-11-28T19:58:06.045 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2023-11-28T19:58:06.045 DEBUG:teuthology.orchestra.run.smithi078:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2023-11-28T19:58:06.054 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2023-11-28T19:58:06.055 DEBUG:teuthology.orchestra.run.smithi078:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2023-11-28T19:58:06.105 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi078.front.sepia.ceph.com 2023-11-28T19:58:06.105 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2023-11-28T19:58:06.105 DEBUG:teuthology.orchestra.run.smithi078:> sudo dd of=/etc/ceph/ceph.keyring 2023-11-28T19:58:06.105 DEBUG:teuthology.orchestra.run.smithi078:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-11-28T19:58:06.185 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2023-11-28T19:58:06.185 DEBUG:teuthology.orchestra.run.smithi078:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-11-28T19:58:06.241 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi179.front.sepia.ceph.com 2023-11-28T19:58:06.242 DEBUG:teuthology.orchestra.run.smithi179:> set -ex 2023-11-28T19:58:06.242 DEBUG:teuthology.orchestra.run.smithi179:> sudo dd of=/etc/ceph/ceph.keyring 2023-11-28T19:58:06.242 DEBUG:teuthology.orchestra.run.smithi179:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-11-28T19:58:06.278 DEBUG:teuthology.orchestra.run.smithi179:> set -ex 2023-11-28T19:58:06.278 DEBUG:teuthology.orchestra.run.smithi179:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-11-28T19:58:06.326 INFO:tasks.ceph:Setting up mon nodes... 2023-11-28T19:58:06.327 INFO:tasks.ceph:Setting up mgr nodes... 2023-11-28T19:58:06.327 DEBUG:teuthology.orchestra.run.smithi078:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2023-11-28T19:58:06.382 INFO:teuthology.orchestra.run.smithi078.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2023-11-28T19:58:06.387 DEBUG:teuthology.orchestra.run.smithi179:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2023-11-28T19:58:06.446 INFO:teuthology.orchestra.run.smithi179.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2023-11-28T19:58:06.460 INFO:tasks.ceph:Setting up mds nodes... 2023-11-28T19:58:06.460 DEBUG:teuthology.orchestra.run.smithi078:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2023-11-28T19:58:06.515 INFO:teuthology.orchestra.run.smithi078.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2023-11-28T19:58:06.519 DEBUG:teuthology.orchestra.run.smithi078:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2023-11-28T19:58:06.539 DEBUG:teuthology.orchestra.run.smithi078:> sudo mkdir -p /var/lib/ceph/mds/ceph-c && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.c /var/lib/ceph/mds/ceph-c/keyring 2023-11-28T19:58:06.639 INFO:teuthology.orchestra.run.smithi078.stdout:creating /var/lib/ceph/mds/ceph-c/keyring 2023-11-28T19:58:06.644 DEBUG:teuthology.orchestra.run.smithi078:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-c 2023-11-28T19:58:06.664 DEBUG:teuthology.orchestra.run.smithi179:> sudo mkdir -p /var/lib/ceph/mds/ceph-b && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.b /var/lib/ceph/mds/ceph-b/keyring 2023-11-28T19:58:06.722 INFO:teuthology.orchestra.run.smithi179.stdout:creating /var/lib/ceph/mds/ceph-b/keyring 2023-11-28T19:58:06.727 DEBUG:teuthology.orchestra.run.smithi179:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-b 2023-11-28T19:58:06.749 DEBUG:teuthology.orchestra.run.smithi179:> sudo mkdir -p /var/lib/ceph/mds/ceph-d && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.d /var/lib/ceph/mds/ceph-d/keyring 2023-11-28T19:58:06.845 INFO:teuthology.orchestra.run.smithi179.stdout:creating /var/lib/ceph/mds/ceph-d/keyring 2023-11-28T19:58:06.850 DEBUG:teuthology.orchestra.run.smithi179:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-d 2023-11-28T19:58:06.870 INFO:tasks.ceph_client:Setting up client nodes... 2023-11-28T19:58:06.871 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2023-11-28T19:58:06.913 INFO:teuthology.orchestra.run.smithi078.stdout:creating /etc/ceph/ceph.client.0.keyring 2023-11-28T19:58:06.930 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2023-11-28T19:58:06.972 INFO:teuthology.orchestra.run.smithi179.stdout:creating /etc/ceph/ceph.client.1.keyring 2023-11-28T19:58:06.989 INFO:tasks.ceph:Running mkfs on osd nodes... 2023-11-28T19:58:06.989 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi078.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi179.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2023-11-28T19:58:06.990 DEBUG:teuthology.orchestra.run.smithi078:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2023-11-28T19:58:07.010 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-11-28T19:58:07.010 INFO:tasks.ceph:role: osd.0 2023-11-28T19:58:07.011 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi078.front.sepia.ceph.com 2023-11-28T19:58:07.011 DEBUG:teuthology.orchestra.run.smithi078:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2023-11-28T19:58:07.080 INFO:teuthology.orchestra.run.smithi078.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2023-11-28T19:58:07.080 INFO:teuthology.orchestra.run.smithi078.stdout: = sectsz=512 attr=2, projid32bit=1 2023-11-28T19:58:07.080 INFO:teuthology.orchestra.run.smithi078.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-11-28T19:58:07.080 INFO:teuthology.orchestra.run.smithi078.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-11-28T19:58:07.080 INFO:teuthology.orchestra.run.smithi078.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-11-28T19:58:07.080 INFO:teuthology.orchestra.run.smithi078.stdout: = sunit=0 swidth=0 blks 2023-11-28T19:58:07.080 INFO:teuthology.orchestra.run.smithi078.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-11-28T19:58:07.080 INFO:teuthology.orchestra.run.smithi078.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-11-28T19:58:07.080 INFO:teuthology.orchestra.run.smithi078.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-11-28T19:58:07.080 INFO:teuthology.orchestra.run.smithi078.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-11-28T19:58:07.568 INFO:teuthology.orchestra.run.smithi078.stdout:Discarding blocks...Done. 2023-11-28T19:58:07.571 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi078.front.sepia.ceph.com -o noatime 2023-11-28T19:58:07.571 DEBUG:teuthology.orchestra.run.smithi078:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2023-11-28T19:58:07.722 DEBUG:teuthology.orchestra.run.smithi078:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2023-11-28T19:58:07.740 INFO:teuthology.orchestra.run.smithi078.stderr:sudo: /sbin/restorecon: command not found 2023-11-28T19:58:07.741 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-28T19:58:07.741 DEBUG:teuthology.orchestra.run.smithi078:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2023-11-28T19:58:07.806 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-11-28T19:58:07.806 INFO:tasks.ceph:role: osd.1 2023-11-28T19:58:07.806 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi078.front.sepia.ceph.com 2023-11-28T19:58:07.806 DEBUG:teuthology.orchestra.run.smithi078:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2023-11-28T19:58:07.877 INFO:teuthology.orchestra.run.smithi078.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2023-11-28T19:58:07.878 INFO:teuthology.orchestra.run.smithi078.stdout: = sectsz=512 attr=2, projid32bit=1 2023-11-28T19:58:07.878 INFO:teuthology.orchestra.run.smithi078.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-11-28T19:58:07.878 INFO:teuthology.orchestra.run.smithi078.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-11-28T19:58:07.878 INFO:teuthology.orchestra.run.smithi078.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-11-28T19:58:07.878 INFO:teuthology.orchestra.run.smithi078.stdout: = sunit=0 swidth=0 blks 2023-11-28T19:58:07.878 INFO:teuthology.orchestra.run.smithi078.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-11-28T19:58:07.878 INFO:teuthology.orchestra.run.smithi078.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-11-28T19:58:07.878 INFO:teuthology.orchestra.run.smithi078.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-11-28T19:58:07.878 INFO:teuthology.orchestra.run.smithi078.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-11-28T19:58:08.313 INFO:teuthology.orchestra.run.smithi078.stdout:Discarding blocks...Done. 2023-11-28T19:58:08.315 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi078.front.sepia.ceph.com -o noatime 2023-11-28T19:58:08.315 DEBUG:teuthology.orchestra.run.smithi078:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2023-11-28T19:58:08.420 DEBUG:teuthology.orchestra.run.smithi078:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2023-11-28T19:58:08.437 INFO:teuthology.orchestra.run.smithi078.stderr:sudo: /sbin/restorecon: command not found 2023-11-28T19:58:08.438 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-28T19:58:08.439 DEBUG:teuthology.orchestra.run.smithi078:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2023-11-28T19:58:08.502 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-11-28T19:58:08.502 INFO:tasks.ceph:role: osd.2 2023-11-28T19:58:08.502 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi078.front.sepia.ceph.com 2023-11-28T19:58:08.502 DEBUG:teuthology.orchestra.run.smithi078:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2023-11-28T19:58:08.573 INFO:teuthology.orchestra.run.smithi078.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2023-11-28T19:58:08.574 INFO:teuthology.orchestra.run.smithi078.stdout: = sectsz=512 attr=2, projid32bit=1 2023-11-28T19:58:08.574 INFO:teuthology.orchestra.run.smithi078.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-11-28T19:58:08.574 INFO:teuthology.orchestra.run.smithi078.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-11-28T19:58:08.574 INFO:teuthology.orchestra.run.smithi078.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-11-28T19:58:08.574 INFO:teuthology.orchestra.run.smithi078.stdout: = sunit=0 swidth=0 blks 2023-11-28T19:58:08.574 INFO:teuthology.orchestra.run.smithi078.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-11-28T19:58:08.574 INFO:teuthology.orchestra.run.smithi078.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-11-28T19:58:08.575 INFO:teuthology.orchestra.run.smithi078.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-11-28T19:58:08.575 INFO:teuthology.orchestra.run.smithi078.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-11-28T19:58:09.039 INFO:teuthology.orchestra.run.smithi078.stdout:Discarding blocks...Done. 2023-11-28T19:58:09.042 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi078.front.sepia.ceph.com -o noatime 2023-11-28T19:58:09.042 DEBUG:teuthology.orchestra.run.smithi078:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2023-11-28T19:58:09.191 DEBUG:teuthology.orchestra.run.smithi078:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2023-11-28T19:58:09.208 INFO:teuthology.orchestra.run.smithi078.stderr:sudo: /sbin/restorecon: command not found 2023-11-28T19:58:09.209 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-28T19:58:09.209 DEBUG:teuthology.orchestra.run.smithi078:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2023-11-28T19:58:09.274 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-11-28T19:58:09.274 INFO:tasks.ceph:role: osd.3 2023-11-28T19:58:09.274 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi078.front.sepia.ceph.com 2023-11-28T19:58:09.275 DEBUG:teuthology.orchestra.run.smithi078:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2023-11-28T19:58:09.347 INFO:teuthology.orchestra.run.smithi078.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2023-11-28T19:58:09.347 INFO:teuthology.orchestra.run.smithi078.stdout: = sectsz=512 attr=2, projid32bit=1 2023-11-28T19:58:09.347 INFO:teuthology.orchestra.run.smithi078.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-11-28T19:58:09.347 INFO:teuthology.orchestra.run.smithi078.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-11-28T19:58:09.347 INFO:teuthology.orchestra.run.smithi078.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-11-28T19:58:09.348 INFO:teuthology.orchestra.run.smithi078.stdout: = sunit=0 swidth=0 blks 2023-11-28T19:58:09.348 INFO:teuthology.orchestra.run.smithi078.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-11-28T19:58:09.348 INFO:teuthology.orchestra.run.smithi078.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-11-28T19:58:09.348 INFO:teuthology.orchestra.run.smithi078.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-11-28T19:58:09.348 INFO:teuthology.orchestra.run.smithi078.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-11-28T19:58:09.859 INFO:teuthology.orchestra.run.smithi078.stdout:Discarding blocks...Done. 2023-11-28T19:58:09.863 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi078.front.sepia.ceph.com -o noatime 2023-11-28T19:58:09.863 DEBUG:teuthology.orchestra.run.smithi078:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2023-11-28T19:58:10.012 DEBUG:teuthology.orchestra.run.smithi078:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2023-11-28T19:58:10.030 INFO:teuthology.orchestra.run.smithi078.stderr:sudo: /sbin/restorecon: command not found 2023-11-28T19:58:10.031 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-28T19:58:10.031 DEBUG:teuthology.orchestra.run.smithi078:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-11-28T19:58:10.161 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:58:10.158+0000 7f4c319ef640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2023-11-28T19:58:10.163 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:58:10.162+0000 7f4c319ef640 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2023-11-28T19:58:10.163 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:58:10.162+0000 7f4c319ef640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-11-28T19:58:10.164 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:58:10.162+0000 7f4c319ef640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-11-28T19:58:10.164 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:58:10.162+0000 7f4c319ef640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-11-28T19:58:10.166 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:58:10.166+0000 7f4c319ef640 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2023-11-28T19:58:13.156 DEBUG:teuthology.orchestra.run.smithi078:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2023-11-28T19:58:13.178 DEBUG:teuthology.orchestra.run.smithi078:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-11-28T19:58:13.275 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:58:13.274+0000 7f4b442a4640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2023-11-28T19:58:13.276 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:58:13.274+0000 7f4b442a4640 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2023-11-28T19:58:13.276 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:58:13.274+0000 7f4b442a4640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-11-28T19:58:13.277 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:58:13.274+0000 7f4b442a4640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-11-28T19:58:13.277 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:58:13.274+0000 7f4b442a4640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-11-28T19:58:13.278 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:58:13.278+0000 7f4b442a4640 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2023-11-28T19:58:16.269 DEBUG:teuthology.orchestra.run.smithi078:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2023-11-28T19:58:16.290 DEBUG:teuthology.orchestra.run.smithi078:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-11-28T19:58:16.390 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:58:16.390+0000 7f179141e640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2023-11-28T19:58:16.391 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:58:16.390+0000 7f179141e640 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2023-11-28T19:58:16.391 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:58:16.390+0000 7f179141e640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-11-28T19:58:16.391 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:58:16.390+0000 7f179141e640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-11-28T19:58:16.391 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:58:16.390+0000 7f179141e640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-11-28T19:58:16.392 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:58:16.390+0000 7f179141e640 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2023-11-28T19:58:19.375 DEBUG:teuthology.orchestra.run.smithi078:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2023-11-28T19:58:19.397 DEBUG:teuthology.orchestra.run.smithi078:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-11-28T19:58:19.494 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:58:19.494+0000 7f2120303640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2023-11-28T19:58:19.495 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:58:19.494+0000 7f2120303640 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2023-11-28T19:58:19.495 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:58:19.494+0000 7f2120303640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-11-28T19:58:19.495 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:58:19.494+0000 7f2120303640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-11-28T19:58:19.495 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:58:19.494+0000 7f2120303640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-11-28T19:58:19.496 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:58:19.494+0000 7f2120303640 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2023-11-28T19:58:22.519 DEBUG:teuthology.orchestra.run.smithi078:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2023-11-28T19:58:22.540 DEBUG:teuthology.orchestra.run.smithi179:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2023-11-28T19:58:22.563 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-11-28T19:58:22.564 INFO:tasks.ceph:role: osd.4 2023-11-28T19:58:22.564 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi179.front.sepia.ceph.com 2023-11-28T19:58:22.564 DEBUG:teuthology.orchestra.run.smithi179:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2023-11-28T19:58:22.639 INFO:teuthology.orchestra.run.smithi179.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2023-11-28T19:58:22.639 INFO:teuthology.orchestra.run.smithi179.stdout: = sectsz=512 attr=2, projid32bit=1 2023-11-28T19:58:22.639 INFO:teuthology.orchestra.run.smithi179.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-11-28T19:58:22.639 INFO:teuthology.orchestra.run.smithi179.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-11-28T19:58:22.640 INFO:teuthology.orchestra.run.smithi179.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-11-28T19:58:22.640 INFO:teuthology.orchestra.run.smithi179.stdout: = sunit=0 swidth=0 blks 2023-11-28T19:58:22.640 INFO:teuthology.orchestra.run.smithi179.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-11-28T19:58:22.640 INFO:teuthology.orchestra.run.smithi179.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-11-28T19:58:22.640 INFO:teuthology.orchestra.run.smithi179.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-11-28T19:58:22.640 INFO:teuthology.orchestra.run.smithi179.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-11-28T19:58:23.088 INFO:teuthology.orchestra.run.smithi179.stdout:Discarding blocks...Done. 2023-11-28T19:58:23.091 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi179.front.sepia.ceph.com -o noatime 2023-11-28T19:58:23.092 DEBUG:teuthology.orchestra.run.smithi179:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2023-11-28T19:58:23.204 DEBUG:teuthology.orchestra.run.smithi179:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2023-11-28T19:58:23.221 INFO:teuthology.orchestra.run.smithi179.stderr:sudo: /sbin/restorecon: command not found 2023-11-28T19:58:23.222 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-28T19:58:23.223 DEBUG:teuthology.orchestra.run.smithi179:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2023-11-28T19:58:23.286 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-11-28T19:58:23.286 INFO:tasks.ceph:role: osd.5 2023-11-28T19:58:23.286 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi179.front.sepia.ceph.com 2023-11-28T19:58:23.287 DEBUG:teuthology.orchestra.run.smithi179:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2023-11-28T19:58:23.358 INFO:teuthology.orchestra.run.smithi179.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2023-11-28T19:58:23.358 INFO:teuthology.orchestra.run.smithi179.stdout: = sectsz=512 attr=2, projid32bit=1 2023-11-28T19:58:23.359 INFO:teuthology.orchestra.run.smithi179.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-11-28T19:58:23.359 INFO:teuthology.orchestra.run.smithi179.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-11-28T19:58:23.359 INFO:teuthology.orchestra.run.smithi179.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-11-28T19:58:23.359 INFO:teuthology.orchestra.run.smithi179.stdout: = sunit=0 swidth=0 blks 2023-11-28T19:58:23.359 INFO:teuthology.orchestra.run.smithi179.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-11-28T19:58:23.359 INFO:teuthology.orchestra.run.smithi179.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-11-28T19:58:23.359 INFO:teuthology.orchestra.run.smithi179.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-11-28T19:58:23.359 INFO:teuthology.orchestra.run.smithi179.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-11-28T19:58:23.844 INFO:teuthology.orchestra.run.smithi179.stdout:Discarding blocks...Done. 2023-11-28T19:58:23.846 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi179.front.sepia.ceph.com -o noatime 2023-11-28T19:58:23.847 DEBUG:teuthology.orchestra.run.smithi179:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2023-11-28T19:58:23.997 DEBUG:teuthology.orchestra.run.smithi179:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2023-11-28T19:58:24.015 INFO:teuthology.orchestra.run.smithi179.stderr:sudo: /sbin/restorecon: command not found 2023-11-28T19:58:24.016 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-28T19:58:24.016 DEBUG:teuthology.orchestra.run.smithi179:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2023-11-28T19:58:24.083 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-11-28T19:58:24.083 INFO:tasks.ceph:role: osd.6 2023-11-28T19:58:24.084 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi179.front.sepia.ceph.com 2023-11-28T19:58:24.084 DEBUG:teuthology.orchestra.run.smithi179:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2023-11-28T19:58:24.155 INFO:teuthology.orchestra.run.smithi179.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2023-11-28T19:58:24.155 INFO:teuthology.orchestra.run.smithi179.stdout: = sectsz=512 attr=2, projid32bit=1 2023-11-28T19:58:24.155 INFO:teuthology.orchestra.run.smithi179.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-11-28T19:58:24.155 INFO:teuthology.orchestra.run.smithi179.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-11-28T19:58:24.156 INFO:teuthology.orchestra.run.smithi179.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-11-28T19:58:24.156 INFO:teuthology.orchestra.run.smithi179.stdout: = sunit=0 swidth=0 blks 2023-11-28T19:58:24.156 INFO:teuthology.orchestra.run.smithi179.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-11-28T19:58:24.156 INFO:teuthology.orchestra.run.smithi179.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-11-28T19:58:24.156 INFO:teuthology.orchestra.run.smithi179.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-11-28T19:58:24.156 INFO:teuthology.orchestra.run.smithi179.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-11-28T19:58:24.638 INFO:teuthology.orchestra.run.smithi179.stdout:Discarding blocks...Done. 2023-11-28T19:58:24.641 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi179.front.sepia.ceph.com -o noatime 2023-11-28T19:58:24.641 DEBUG:teuthology.orchestra.run.smithi179:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2023-11-28T19:58:24.765 DEBUG:teuthology.orchestra.run.smithi179:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2023-11-28T19:58:24.783 INFO:teuthology.orchestra.run.smithi179.stderr:sudo: /sbin/restorecon: command not found 2023-11-28T19:58:24.784 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-28T19:58:24.784 DEBUG:teuthology.orchestra.run.smithi179:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2023-11-28T19:58:24.854 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-11-28T19:58:24.854 INFO:tasks.ceph:role: osd.7 2023-11-28T19:58:24.854 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi179.front.sepia.ceph.com 2023-11-28T19:58:24.854 DEBUG:teuthology.orchestra.run.smithi179:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2023-11-28T19:58:24.927 INFO:teuthology.orchestra.run.smithi179.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2023-11-28T19:58:24.927 INFO:teuthology.orchestra.run.smithi179.stdout: = sectsz=512 attr=2, projid32bit=1 2023-11-28T19:58:24.927 INFO:teuthology.orchestra.run.smithi179.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-11-28T19:58:24.928 INFO:teuthology.orchestra.run.smithi179.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-11-28T19:58:24.928 INFO:teuthology.orchestra.run.smithi179.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-11-28T19:58:24.928 INFO:teuthology.orchestra.run.smithi179.stdout: = sunit=0 swidth=0 blks 2023-11-28T19:58:24.928 INFO:teuthology.orchestra.run.smithi179.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-11-28T19:58:24.928 INFO:teuthology.orchestra.run.smithi179.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-11-28T19:58:24.928 INFO:teuthology.orchestra.run.smithi179.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-11-28T19:58:24.928 INFO:teuthology.orchestra.run.smithi179.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-11-28T19:58:25.370 INFO:teuthology.orchestra.run.smithi179.stdout:Discarding blocks...Done. 2023-11-28T19:58:25.373 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi179.front.sepia.ceph.com -o noatime 2023-11-28T19:58:25.373 DEBUG:teuthology.orchestra.run.smithi179:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2023-11-28T19:58:25.492 DEBUG:teuthology.orchestra.run.smithi179:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2023-11-28T19:58:25.510 INFO:teuthology.orchestra.run.smithi179.stderr:sudo: /sbin/restorecon: command not found 2023-11-28T19:58:25.511 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-28T19:58:25.512 DEBUG:teuthology.orchestra.run.smithi179:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-11-28T19:58:25.648 INFO:teuthology.orchestra.run.smithi179.stderr:2023-11-28T19:58:25.645+0000 7ff62122b640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2023-11-28T19:58:25.652 INFO:teuthology.orchestra.run.smithi179.stderr:2023-11-28T19:58:25.649+0000 7ff62122b640 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2023-11-28T19:58:25.652 INFO:teuthology.orchestra.run.smithi179.stderr:2023-11-28T19:58:25.649+0000 7ff62122b640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-11-28T19:58:25.652 INFO:teuthology.orchestra.run.smithi179.stderr:2023-11-28T19:58:25.649+0000 7ff62122b640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-11-28T19:58:25.652 INFO:teuthology.orchestra.run.smithi179.stderr:2023-11-28T19:58:25.649+0000 7ff62122b640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-11-28T19:58:25.656 INFO:teuthology.orchestra.run.smithi179.stderr:2023-11-28T19:58:25.653+0000 7ff62122b640 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2023-11-28T19:58:28.690 DEBUG:teuthology.orchestra.run.smithi179:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2023-11-28T19:58:28.711 DEBUG:teuthology.orchestra.run.smithi179:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-11-28T19:58:28.814 INFO:teuthology.orchestra.run.smithi179.stderr:2023-11-28T19:58:28.809+0000 7fa94417e640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2023-11-28T19:58:28.814 INFO:teuthology.orchestra.run.smithi179.stderr:2023-11-28T19:58:28.813+0000 7fa94417e640 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2023-11-28T19:58:28.815 INFO:teuthology.orchestra.run.smithi179.stderr:2023-11-28T19:58:28.813+0000 7fa94417e640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-11-28T19:58:28.815 INFO:teuthology.orchestra.run.smithi179.stderr:2023-11-28T19:58:28.813+0000 7fa94417e640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-11-28T19:58:28.815 INFO:teuthology.orchestra.run.smithi179.stderr:2023-11-28T19:58:28.813+0000 7fa94417e640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-11-28T19:58:28.816 INFO:teuthology.orchestra.run.smithi179.stderr:2023-11-28T19:58:28.813+0000 7fa94417e640 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2023-11-28T19:58:31.793 DEBUG:teuthology.orchestra.run.smithi179:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2023-11-28T19:58:31.814 DEBUG:teuthology.orchestra.run.smithi179:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-11-28T19:58:31.911 INFO:teuthology.orchestra.run.smithi179.stderr:2023-11-28T19:58:31.909+0000 7fa7d948e640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2023-11-28T19:58:31.912 INFO:teuthology.orchestra.run.smithi179.stderr:2023-11-28T19:58:31.909+0000 7fa7d948e640 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2023-11-28T19:58:31.912 INFO:teuthology.orchestra.run.smithi179.stderr:2023-11-28T19:58:31.909+0000 7fa7d948e640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-11-28T19:58:31.912 INFO:teuthology.orchestra.run.smithi179.stderr:2023-11-28T19:58:31.909+0000 7fa7d948e640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-11-28T19:58:31.912 INFO:teuthology.orchestra.run.smithi179.stderr:2023-11-28T19:58:31.909+0000 7fa7d948e640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-11-28T19:58:31.913 INFO:teuthology.orchestra.run.smithi179.stderr:2023-11-28T19:58:31.909+0000 7fa7d948e640 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2023-11-28T19:58:33.938 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T19:58:33.942 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T19:58:34.948 DEBUG:teuthology.orchestra.run.smithi179:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2023-11-28T19:58:34.970 DEBUG:teuthology.orchestra.run.smithi179:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-11-28T19:58:35.068 INFO:teuthology.orchestra.run.smithi179.stderr:2023-11-28T19:58:35.065+0000 7fbe3aa2b640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2023-11-28T19:58:35.069 INFO:teuthology.orchestra.run.smithi179.stderr:2023-11-28T19:58:35.065+0000 7fbe3aa2b640 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2023-11-28T19:58:35.070 INFO:teuthology.orchestra.run.smithi179.stderr:2023-11-28T19:58:35.065+0000 7fbe3aa2b640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-11-28T19:58:35.070 INFO:teuthology.orchestra.run.smithi179.stderr:2023-11-28T19:58:35.065+0000 7fbe3aa2b640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-11-28T19:58:35.070 INFO:teuthology.orchestra.run.smithi179.stderr:2023-11-28T19:58:35.065+0000 7fbe3aa2b640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-11-28T19:58:35.071 INFO:teuthology.orchestra.run.smithi179.stderr:2023-11-28T19:58:35.069+0000 7fbe3aa2b640 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2023-11-28T19:58:38.065 DEBUG:teuthology.orchestra.run.smithi179:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2023-11-28T19:58:38.086 INFO:tasks.ceph:Reading keys from all nodes... 2023-11-28T19:58:38.086 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2023-11-28T19:58:38.086 DEBUG:teuthology.orchestra.run.smithi078:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2023-11-28T19:58:38.109 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2023-11-28T19:58:38.110 DEBUG:teuthology.orchestra.run.smithi078:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2023-11-28T19:58:38.174 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2023-11-28T19:58:38.175 DEBUG:teuthology.orchestra.run.smithi078:> sudo dd if=/var/lib/ceph/mds/ceph-c/keyring of=/dev/stdout 2023-11-28T19:58:38.238 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2023-11-28T19:58:38.238 DEBUG:teuthology.orchestra.run.smithi078:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2023-11-28T19:58:38.305 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2023-11-28T19:58:38.305 DEBUG:teuthology.orchestra.run.smithi078:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2023-11-28T19:58:38.369 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2023-11-28T19:58:38.369 DEBUG:teuthology.orchestra.run.smithi078:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2023-11-28T19:58:38.437 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2023-11-28T19:58:38.437 DEBUG:teuthology.orchestra.run.smithi078:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2023-11-28T19:58:38.501 DEBUG:teuthology.orchestra.run.smithi179:> set -ex 2023-11-28T19:58:38.501 DEBUG:teuthology.orchestra.run.smithi179:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2023-11-28T19:58:38.523 DEBUG:teuthology.orchestra.run.smithi179:> set -ex 2023-11-28T19:58:38.523 DEBUG:teuthology.orchestra.run.smithi179:> sudo dd if=/var/lib/ceph/mds/ceph-b/keyring of=/dev/stdout 2023-11-28T19:58:38.591 DEBUG:teuthology.orchestra.run.smithi179:> set -ex 2023-11-28T19:58:38.591 DEBUG:teuthology.orchestra.run.smithi179:> sudo dd if=/var/lib/ceph/mds/ceph-d/keyring of=/dev/stdout 2023-11-28T19:58:38.655 DEBUG:teuthology.orchestra.run.smithi179:> set -ex 2023-11-28T19:58:38.655 DEBUG:teuthology.orchestra.run.smithi179:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2023-11-28T19:58:38.718 DEBUG:teuthology.orchestra.run.smithi179:> set -ex 2023-11-28T19:58:38.719 DEBUG:teuthology.orchestra.run.smithi179:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2023-11-28T19:58:38.782 DEBUG:teuthology.orchestra.run.smithi179:> set -ex 2023-11-28T19:58:38.782 DEBUG:teuthology.orchestra.run.smithi179:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2023-11-28T19:58:38.846 DEBUG:teuthology.orchestra.run.smithi179:> set -ex 2023-11-28T19:58:38.846 DEBUG:teuthology.orchestra.run.smithi179:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2023-11-28T19:58:38.910 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2023-11-28T19:58:38.910 DEBUG:teuthology.orchestra.run.smithi078:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2023-11-28T19:58:38.919 DEBUG:teuthology.orchestra.run.smithi179:> set -ex 2023-11-28T19:58:38.919 DEBUG:teuthology.orchestra.run.smithi179:> dd if=/etc/ceph/ceph.client.1.keyring of=/dev/stdout 2023-11-28T19:58:38.962 INFO:tasks.ceph:Adding keys to all mons... 2023-11-28T19:58:38.962 DEBUG:teuthology.orchestra.run.smithi078:> sudo tee -a /etc/ceph/ceph.keyring 2023-11-28T19:58:38.966 DEBUG:teuthology.orchestra.run.smithi179:> sudo tee -a /etc/ceph/ceph.keyring 2023-11-28T19:58:39.014 INFO:teuthology.orchestra.run.smithi078.stdout:[mgr.y] 2023-11-28T19:58:39.014 INFO:teuthology.orchestra.run.smithi078.stdout: key = AQBORmZlQkLqFhAA1lMuqxTImbm69hxar4QpXg== 2023-11-28T19:58:39.014 INFO:teuthology.orchestra.run.smithi078.stdout:[mds.a] 2023-11-28T19:58:39.014 INFO:teuthology.orchestra.run.smithi078.stdout: key = AQBORmZldezUHhAAmHx6/kut7l58IB6id26WJA== 2023-11-28T19:58:39.014 INFO:teuthology.orchestra.run.smithi078.stdout:[mds.c] 2023-11-28T19:58:39.014 INFO:teuthology.orchestra.run.smithi078.stdout: key = AQBORmZlqQU8JhAAjJ7XKQDZbfNnj0FUsYHUXw== 2023-11-28T19:58:39.014 INFO:teuthology.orchestra.run.smithi078.stdout:[osd.0] 2023-11-28T19:58:39.015 INFO:teuthology.orchestra.run.smithi078.stdout: key = AQBSRmZllQa4CRAAUz2YsYjsIf+SX/HkkQjzNw== 2023-11-28T19:58:39.015 INFO:teuthology.orchestra.run.smithi078.stdout:[osd.1] 2023-11-28T19:58:39.015 INFO:teuthology.orchestra.run.smithi078.stdout: key = AQBVRmZlrRCFEBAA+6glXV0u+NS4bF4DEGymmg== 2023-11-28T19:58:39.015 INFO:teuthology.orchestra.run.smithi078.stdout:[osd.2] 2023-11-28T19:58:39.015 INFO:teuthology.orchestra.run.smithi078.stdout: key = AQBYRmZlfcFfFxAApsrWaESm1Utd6BLazDsCIw== 2023-11-28T19:58:39.015 INFO:teuthology.orchestra.run.smithi078.stdout:[osd.3] 2023-11-28T19:58:39.015 INFO:teuthology.orchestra.run.smithi078.stdout: key = AQBbRmZlc7KQHRAA4Y4BYxG7CSLpPpGx9mP5BA== 2023-11-28T19:58:39.015 INFO:teuthology.orchestra.run.smithi078.stdout:[mgr.x] 2023-11-28T19:58:39.015 INFO:teuthology.orchestra.run.smithi078.stdout: key = AQBORmZl1xbAGhAAVP5dcAqZPly145Skxk8QjA== 2023-11-28T19:58:39.015 INFO:teuthology.orchestra.run.smithi078.stdout:[mds.b] 2023-11-28T19:58:39.015 INFO:teuthology.orchestra.run.smithi078.stdout: key = AQBORmZltpo9KxAAF+26E+HxsJs4tdMBVMETKw== 2023-11-28T19:58:39.016 INFO:teuthology.orchestra.run.smithi078.stdout:[mds.d] 2023-11-28T19:58:39.016 INFO:teuthology.orchestra.run.smithi078.stdout: key = AQBORmZlcOaPMhAAABmFnot+b8fMIUvIIJMrtA== 2023-11-28T19:58:39.016 INFO:teuthology.orchestra.run.smithi078.stdout:[osd.4] 2023-11-28T19:58:39.016 INFO:teuthology.orchestra.run.smithi078.stdout: key = AQBhRmZlU5jVJhAAnM5Ow5whdkZS0cY13ehg0Q== 2023-11-28T19:58:39.016 INFO:teuthology.orchestra.run.smithi078.stdout:[osd.5] 2023-11-28T19:58:39.016 INFO:teuthology.orchestra.run.smithi078.stdout: key = AQBkRmZlV0qxMBAAwuuKXOx2QOKWxJlY47Z8gw== 2023-11-28T19:58:39.016 INFO:teuthology.orchestra.run.smithi078.stdout:[osd.6] 2023-11-28T19:58:39.016 INFO:teuthology.orchestra.run.smithi078.stdout: key = AQBnRmZln6R8NhAAu+46Z8Qb0mXkyMx5W2U/oA== 2023-11-28T19:58:39.016 INFO:teuthology.orchestra.run.smithi078.stdout:[osd.7] 2023-11-28T19:58:39.016 INFO:teuthology.orchestra.run.smithi078.stdout: key = AQBrRmZl8+xEBBAAx7CjmIrEZseolpBrEDAJog== 2023-11-28T19:58:39.016 INFO:teuthology.orchestra.run.smithi078.stdout:[client.0] 2023-11-28T19:58:39.016 INFO:teuthology.orchestra.run.smithi078.stdout: key = AQBORmZlPLeINhAAMdB7hy84hvX1S/pHYfkeJg== 2023-11-28T19:58:39.016 INFO:teuthology.orchestra.run.smithi078.stdout:[client.1] 2023-11-28T19:58:39.017 INFO:teuthology.orchestra.run.smithi078.stdout: key = AQBORmZlzBgfOhAAm6M8Y+12MlLdVkJnMmK9BQ== 2023-11-28T19:58:39.029 INFO:teuthology.orchestra.run.smithi179.stdout:[mgr.y] 2023-11-28T19:58:39.029 INFO:teuthology.orchestra.run.smithi179.stdout: key = AQBORmZlQkLqFhAA1lMuqxTImbm69hxar4QpXg== 2023-11-28T19:58:39.029 INFO:teuthology.orchestra.run.smithi179.stdout:[mds.a] 2023-11-28T19:58:39.029 INFO:teuthology.orchestra.run.smithi179.stdout: key = AQBORmZldezUHhAAmHx6/kut7l58IB6id26WJA== 2023-11-28T19:58:39.029 INFO:teuthology.orchestra.run.smithi179.stdout:[mds.c] 2023-11-28T19:58:39.029 INFO:teuthology.orchestra.run.smithi179.stdout: key = AQBORmZlqQU8JhAAjJ7XKQDZbfNnj0FUsYHUXw== 2023-11-28T19:58:39.029 INFO:teuthology.orchestra.run.smithi179.stdout:[osd.0] 2023-11-28T19:58:39.029 INFO:teuthology.orchestra.run.smithi179.stdout: key = AQBSRmZllQa4CRAAUz2YsYjsIf+SX/HkkQjzNw== 2023-11-28T19:58:39.029 INFO:teuthology.orchestra.run.smithi179.stdout:[osd.1] 2023-11-28T19:58:39.030 INFO:teuthology.orchestra.run.smithi179.stdout: key = AQBVRmZlrRCFEBAA+6glXV0u+NS4bF4DEGymmg== 2023-11-28T19:58:39.030 INFO:teuthology.orchestra.run.smithi179.stdout:[osd.2] 2023-11-28T19:58:39.030 INFO:teuthology.orchestra.run.smithi179.stdout: key = AQBYRmZlfcFfFxAApsrWaESm1Utd6BLazDsCIw== 2023-11-28T19:58:39.030 INFO:teuthology.orchestra.run.smithi179.stdout:[osd.3] 2023-11-28T19:58:39.030 INFO:teuthology.orchestra.run.smithi179.stdout: key = AQBbRmZlc7KQHRAA4Y4BYxG7CSLpPpGx9mP5BA== 2023-11-28T19:58:39.030 INFO:teuthology.orchestra.run.smithi179.stdout:[mgr.x] 2023-11-28T19:58:39.030 INFO:teuthology.orchestra.run.smithi179.stdout: key = AQBORmZl1xbAGhAAVP5dcAqZPly145Skxk8QjA== 2023-11-28T19:58:39.030 INFO:teuthology.orchestra.run.smithi179.stdout:[mds.b] 2023-11-28T19:58:39.030 INFO:teuthology.orchestra.run.smithi179.stdout: key = AQBORmZltpo9KxAAF+26E+HxsJs4tdMBVMETKw== 2023-11-28T19:58:39.030 INFO:teuthology.orchestra.run.smithi179.stdout:[mds.d] 2023-11-28T19:58:39.030 INFO:teuthology.orchestra.run.smithi179.stdout: key = AQBORmZlcOaPMhAAABmFnot+b8fMIUvIIJMrtA== 2023-11-28T19:58:39.030 INFO:teuthology.orchestra.run.smithi179.stdout:[osd.4] 2023-11-28T19:58:39.031 INFO:teuthology.orchestra.run.smithi179.stdout: key = AQBhRmZlU5jVJhAAnM5Ow5whdkZS0cY13ehg0Q== 2023-11-28T19:58:39.031 INFO:teuthology.orchestra.run.smithi179.stdout:[osd.5] 2023-11-28T19:58:39.031 INFO:teuthology.orchestra.run.smithi179.stdout: key = AQBkRmZlV0qxMBAAwuuKXOx2QOKWxJlY47Z8gw== 2023-11-28T19:58:39.031 INFO:teuthology.orchestra.run.smithi179.stdout:[osd.6] 2023-11-28T19:58:39.031 INFO:teuthology.orchestra.run.smithi179.stdout: key = AQBnRmZln6R8NhAAu+46Z8Qb0mXkyMx5W2U/oA== 2023-11-28T19:58:39.031 INFO:teuthology.orchestra.run.smithi179.stdout:[osd.7] 2023-11-28T19:58:39.031 INFO:teuthology.orchestra.run.smithi179.stdout: key = AQBrRmZl8+xEBBAAx7CjmIrEZseolpBrEDAJog== 2023-11-28T19:58:39.031 INFO:teuthology.orchestra.run.smithi179.stdout:[client.0] 2023-11-28T19:58:39.031 INFO:teuthology.orchestra.run.smithi179.stdout: key = AQBORmZlPLeINhAAMdB7hy84hvX1S/pHYfkeJg== 2023-11-28T19:58:39.031 INFO:teuthology.orchestra.run.smithi179.stdout:[client.1] 2023-11-28T19:58:39.031 INFO:teuthology.orchestra.run.smithi179.stdout: key = AQBORmZlzBgfOhAAm6M8Y+12MlLdVkJnMmK9BQ== 2023-11-28T19:58:39.032 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-11-28T19:58:39.070 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-11-28T19:58:39.133 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-11-28T19:58:39.137 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-11-28T19:58:39.196 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-11-28T19:58:39.199 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-11-28T19:58:39.255 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-28T19:58:39.259 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-28T19:58:39.313 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-28T19:58:39.316 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-28T19:58:39.371 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-28T19:58:39.377 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-28T19:58:39.431 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-28T19:58:39.472 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-28T19:58:39.526 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-11-28T19:58:39.530 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-11-28T19:58:39.584 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-11-28T19:58:39.587 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-11-28T19:58:39.643 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-11-28T19:58:39.647 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-11-28T19:58:39.705 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-28T19:58:39.709 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-28T19:58:39.763 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-28T19:58:39.767 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-28T19:58:39.821 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-28T19:58:39.824 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-28T19:58:39.877 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-28T19:58:39.881 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-28T19:58:39.935 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-11-28T19:58:39.938 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-11-28T19:58:39.995 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-11-28T19:58:39.999 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-11-28T19:58:40.056 INFO:tasks.ceph:Running mkfs on mon nodes... 2023-11-28T19:58:40.057 DEBUG:teuthology.orchestra.run.smithi078:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2023-11-28T19:58:40.077 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-11-28T19:58:40.196 DEBUG:teuthology.orchestra.run.smithi078:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2023-11-28T19:58:40.217 DEBUG:teuthology.orchestra.run.smithi179:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2023-11-28T19:58:40.239 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-11-28T19:58:40.353 DEBUG:teuthology.orchestra.run.smithi179:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2023-11-28T19:58:40.373 DEBUG:teuthology.orchestra.run.smithi179:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2023-11-28T19:58:40.437 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-11-28T19:58:40.554 DEBUG:teuthology.orchestra.run.smithi179:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2023-11-28T19:58:40.575 DEBUG:teuthology.orchestra.run.smithi078:> rm -- /home/ubuntu/cephtest/ceph.monmap 2023-11-28T19:58:40.578 DEBUG:teuthology.orchestra.run.smithi179:> rm -- /home/ubuntu/cephtest/ceph.monmap 2023-11-28T19:58:40.626 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2023-11-28T19:58:40.626 INFO:tasks.ceph.mon.a:Restarting daemon 2023-11-28T19:58:40.627 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2023-11-28T19:58:40.632 INFO:tasks.ceph.mon.a:Started 2023-11-28T19:58:40.632 INFO:tasks.ceph.mon.b:Restarting daemon 2023-11-28T19:58:40.633 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2023-11-28T19:58:40.673 INFO:tasks.ceph.mon.b:Started 2023-11-28T19:58:40.674 INFO:tasks.ceph.mon.c:Restarting daemon 2023-11-28T19:58:40.674 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2023-11-28T19:58:40.678 INFO:tasks.ceph.mon.c:Started 2023-11-28T19:58:40.678 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2023-11-28T19:58:40.678 INFO:tasks.ceph.mgr.y:Restarting daemon 2023-11-28T19:58:40.678 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2023-11-28T19:58:40.682 INFO:tasks.ceph.mgr.y:Started 2023-11-28T19:58:40.682 INFO:tasks.ceph.mgr.x:Restarting daemon 2023-11-28T19:58:40.682 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2023-11-28T19:58:40.685 INFO:tasks.ceph.mgr.x:Started 2023-11-28T19:58:40.685 INFO:tasks.ceph:Setting crush tunables to default 2023-11-28T19:58:40.686 DEBUG:teuthology.orchestra.run.smithi078:> sudo ceph --cluster ceph osd crush tunables default 2023-11-28T19:58:40.825 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:58:40.822+0000 7f587ab96640 1 Processor -- start 2023-11-28T19:58:40.825 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:58:40.822+0000 7f587ab96640 1 -- start start 2023-11-28T19:58:40.827 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:58:40.826+0000 7f587ab96640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f58741518b0 0x7f58740bf600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:58:40.827 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:58:40.826+0000 7f587ab96640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f58740664c0 0x7f587406acc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:58:40.827 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:58:40.826+0000 7f587ab96640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f58740c19f0 con 0x7f58740c0c40 2023-11-28T19:58:40.827 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:58:40.826+0000 7f587ab96640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f587406b200 con 0x7f58740664c0 2023-11-28T19:58:40.827 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:58:40.826+0000 7f587ab96640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f58741552c0 con 0x7f58741518b0 2023-11-28T19:58:40.827 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:58:40.826+0000 7f587a395640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f58740664c0 0x7f587406acc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:58:40.828 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:58:40.826+0000 7f587a395640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f58740664c0 0x7f587406acc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:44010/0 (socket says 172.21.15.78:44010) 2023-11-28T19:58:40.828 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:58:40.826+0000 7f587a395640 1 -- 172.21.15.78:0/67962504 learned_addr learned my addr 172.21.15.78:0/67962504 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T19:58:40.828 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:58:40.826+0000 7f5879b94640 1 --2- 172.21.15.78:0/67962504 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f58741518b0 0x7f58740bf600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:58:40.828 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:58:40.826+0000 7f5879b94640 1 -- 172.21.15.78:0/67962504 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f58741518b0 msgr2=0x7f58740bf600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-11-28T19:58:40.828 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:58:40.826+0000 7f5879b94640 1 -- 172.21.15.78:0/67962504 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f58741518b0 msgr2=0x7f58740bf600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-28T19:58:40.828 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:58:40.826+0000 7f5879b94640 1 --2- 172.21.15.78:0/67962504 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f58741518b0 0x7f58740bf600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-28T19:58:40.828 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:58:40.826+0000 7f5879b94640 1 --2- 172.21.15.78:0/67962504 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f58741518b0 0x7f58740bf600 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-28T19:58:40.828 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:58:40.826+0000 7f587a395640 1 -- 172.21.15.78:0/67962504 >> v2:172.21.15.78:3300/0 conn(0x7f58740664c0 msgr2=0x7f587406acc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-11-28T19:58:40.828 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:58:40.826+0000 7f587a395640 1 -- 172.21.15.78:0/67962504 >> v2:172.21.15.78:3300/0 conn(0x7f58740664c0 msgr2=0x7f587406acc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-28T19:58:40.828 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:58:40.826+0000 7f587a395640 1 --2- 172.21.15.78:0/67962504 >> v2:172.21.15.78:3300/0 conn(0x7f58740664c0 0x7f587406acc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-28T19:58:40.828 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:58:40.826+0000 7f587a395640 1 --2- 172.21.15.78:0/67962504 >> v2:172.21.15.78:3300/0 conn(0x7f58740664c0 0x7f587406acc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-28T19:58:40.992 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:58:40.990+0000 7f5878b92640 1 -- 172.21.15.78:0/67962504 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 895483552 0 0) 0x7f58740c19f0 con 0x7f58740c0c40 2023-11-28T19:58:40.992 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:58:40.990+0000 7f5878b92640 1 -- 172.21.15.78:0/67962504 --> v1:172.21.15.179:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5860003530 con 0x7f58740c0c40 2023-11-28T19:58:40.999 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:58:40.998+0000 7f5878b92640 1 -- 172.21.15.78:0/67962504 <== mon.1 v1:172.21.15.179:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1481184157 0 0) 0x7f5860003530 con 0x7f58740c0c40 2023-11-28T19:58:40.999 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:58:40.998+0000 7f5878b92640 1 -- 172.21.15.78:0/67962504 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f58741518b0 msgr2=0x7f58740bf600 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-28T19:58:40.999 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:58:40.998+0000 7f5878b92640 1 --2- 172.21.15.78:0/67962504 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f58741518b0 0x7f58740bf600 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:58:40.999 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:58:40.998+0000 7f5878b92640 1 -- 172.21.15.78:0/67962504 >> v2:172.21.15.78:3300/0 conn(0x7f58740664c0 msgr2=0x7f587406acc0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-28T19:58:40.999 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:58:40.998+0000 7f5878b92640 1 --2- 172.21.15.78:0/67962504 >> v2:172.21.15.78:3300/0 conn(0x7f58740664c0 0x7f587406acc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:58:40.999 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:58:40.998+0000 7f5878b92640 1 -- 172.21.15.78:0/67962504 --> v1:172.21.15.179:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5874154fe0 con 0x7f58740c0c40 2023-11-28T19:58:41.000 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:58:40.998+0000 7f5878b92640 1 -- 172.21.15.78:0/67962504 <== mon.1 v1:172.21.15.179:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3326804700 0 0) 0x7f5864001680 con 0x7f58740c0c40 2023-11-28T19:58:41.000 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:58:40.998+0000 7f5878b92640 1 -- 172.21.15.78:0/67962504 >> v1:172.21.15.179:6789/0 conn(0x7f58740c0c40 legacy=0x7f587406a5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:58:41.000 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:58:40.998+0000 7f5878b92640 1 --2- 172.21.15.78:0/67962504 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5860003980 0x7f5860003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:58:41.000 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:58:40.998+0000 7f5878b92640 1 --2- 172.21.15.78:0/67962504 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f58600047d0 0x7f5860004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:58:41.000 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:58:40.998+0000 7f5878b92640 1 --2- 172.21.15.78:0/67962504 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f58741518b0 0x7f5860005260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:58:41.000 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:58:40.998+0000 7f5878b92640 1 -- 172.21.15.78:0/67962504 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f587406b200 con 0x7f58600047d0 2023-11-28T19:58:41.000 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:58:40.998+0000 7f5878b92640 1 -- 172.21.15.78:0/67962504 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58741552c0 con 0x7f5860003980 2023-11-28T19:58:41.000 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:58:40.998+0000 7f5878b92640 1 -- 172.21.15.78:0/67962504 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f586000bbd0 con 0x7f58741518b0 2023-11-28T19:58:41.000 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:58:40.998+0000 7f5879b94640 1 --2- 172.21.15.78:0/67962504 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5860003980 0x7f5860003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:58:41.000 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:58:40.998+0000 7f5879393640 1 --2- 172.21.15.78:0/67962504 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f58600047d0 0x7f5860004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:58:41.001 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:58:40.998+0000 7f587a395640 1 --2- 172.21.15.78:0/67962504 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f58741518b0 0x7f5860005260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:58:41.001 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:58:40.998+0000 7f5879393640 1 -- 172.21.15.78:0/67962504 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f58741518b0 msgr2=0x7f5860005260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T19:58:41.001 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:58:40.998+0000 7f5879393640 1 --2- 172.21.15.78:0/67962504 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f58741518b0 0x7f5860005260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:58:41.001 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:58:40.998+0000 7f5879393640 1 -- 172.21.15.78:0/67962504 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5860003980 msgr2=0x7f5860003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T19:58:41.001 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:58:40.998+0000 7f5879393640 1 --2- 172.21.15.78:0/67962504 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5860003980 0x7f5860003da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:58:41.001 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:58:40.998+0000 7f5879393640 1 -- 172.21.15.78:0/67962504 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5860003530 con 0x7f58600047d0 2023-11-28T19:58:41.001 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:58:40.998+0000 7f587a395640 1 --2- 172.21.15.78:0/67962504 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f58741518b0 0x7f5860005260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T19:58:41.002 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:58:41.002+0000 7f5879393640 1 --2- 172.21.15.78:0/67962504 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f58600047d0 0x7f5860004c50 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f58740c1080 tx=0x7f586401ca70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=45c200f3f09270af server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:58:41.002 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:58:41.002+0000 7f5878b92640 1 -- 172.21.15.78:0/67962504 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58640a5760 con 0x7f58600047d0 2023-11-28T19:58:41.002 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:58:41.002+0000 7f5878b92640 1 -- 172.21.15.78:0/67962504 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f58640a58c0 con 0x7f58600047d0 2023-11-28T19:58:41.002 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:58:41.002+0000 7f5878b92640 1 -- 172.21.15.78:0/67962504 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58640a5c70 con 0x7f58600047d0 2023-11-28T19:58:41.003 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:58:41.002+0000 7f587ab96640 1 -- 172.21.15.78:0/67962504 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f58600047d0 msgr2=0x7f5860004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:58:41.004 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:58:41.002+0000 7f587ab96640 1 --2- 172.21.15.78:0/67962504 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f58600047d0 0x7f5860004c50 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f58740c1080 tx=0x7f586401ca70 comp rx=0 tx=0).stop 2023-11-28T19:58:41.004 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:58:41.002+0000 7f587a395640 1 -- 172.21.15.78:0/67962504 reap_dead start 2023-11-28T19:58:41.004 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:58:41.002+0000 7f587ab96640 1 -- 172.21.15.78:0/67962504 shutdown_connections 2023-11-28T19:58:41.004 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:58:41.002+0000 7f587ab96640 1 -- 172.21.15.78:0/67962504 >> 172.21.15.78:0/67962504 conn(0x7f58740c2d40 msgr2=0x7f58740c3150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T19:58:41.004 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:58:41.002+0000 7f587ab96640 1 -- 172.21.15.78:0/67962504 shutdown_connections 2023-11-28T19:58:41.004 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:58:41.002+0000 7f587ab96640 1 -- 172.21.15.78:0/67962504 wait complete. 2023-11-28T19:58:41.005 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:58:41.002+0000 7f587ab96640 1 Processor -- start 2023-11-28T19:58:41.005 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:58:41.006+0000 7f587ab96640 1 -- start start 2023-11-28T19:58:41.007 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:58:41.006+0000 7f587ab96640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f58600047d0 0x7f5874147100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:58:41.007 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:58:41.006+0000 7f587ab96640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5874146bb0 0x7f587414d530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:58:41.007 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:58:41.006+0000 7f587ab96640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f587415d100 0x7f587415d5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:58:41.007 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:58:41.006+0000 7f587ab96640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58741469f0 con 0x7f5874146bb0 2023-11-28T19:58:41.007 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:58:41.006+0000 7f587ab96640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5874151070 con 0x7f58600047d0 2023-11-28T19:58:41.007 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:58:41.006+0000 7f587ab96640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f58741ece80 con 0x7f587415d100 2023-11-28T19:58:41.007 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:58:41.006+0000 7f5879393640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5874146bb0 0x7f587414d530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:58:41.008 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:58:41.006+0000 7f5879393640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5874146bb0 0x7f587414d530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:44036/0 (socket says 172.21.15.78:44036) 2023-11-28T19:58:41.008 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:58:41.006+0000 7f5879393640 1 -- 172.21.15.78:0/4196343314 learned_addr learned my addr 172.21.15.78:0/4196343314 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T19:58:41.008 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:58:41.006+0000 7f5879b94640 1 --2- 172.21.15.78:0/4196343314 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f58600047d0 0x7f5874147100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:58:41.009 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:58:41.006+0000 7f587a395640 1 --2- 172.21.15.78:0/4196343314 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f587415d100 0x7f587415d5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:58:41.011 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:58:41.006+0000 7f5879393640 1 -- 172.21.15.78:0/4196343314 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f587415d100 msgr2=0x7f587415d5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:58:41.011 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:58:41.006+0000 7f5879393640 1 --2- 172.21.15.78:0/4196343314 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f587415d100 0x7f587415d5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:58:41.011 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:58:41.006+0000 7f5879393640 1 -- 172.21.15.78:0/4196343314 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f58600047d0 msgr2=0x7f5874147100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:58:41.011 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:58:41.006+0000 7f5879393640 1 --2- 172.21.15.78:0/4196343314 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f58600047d0 0x7f5874147100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:58:41.011 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:58:41.006+0000 7f5879393640 1 -- 172.21.15.78:0/4196343314 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58741ed160 con 0x7f5874146bb0 2023-11-28T19:58:41.012 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:58:41.006+0000 7f5879393640 1 --2- 172.21.15.78:0/4196343314 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5874146bb0 0x7f587414d530 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f586401c8a0 tx=0x7f5860005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:58:41.012 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:58:41.006+0000 7f586a7fc640 1 -- 172.21.15.78:0/4196343314 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5864005380 con 0x7f5874146bb0 2023-11-28T19:58:41.012 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:58:41.006+0000 7f586a7fc640 1 -- 172.21.15.78:0/4196343314 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f58640054e0 con 0x7f5874146bb0 2023-11-28T19:58:41.012 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:58:41.006+0000 7f586a7fc640 1 -- 172.21.15.78:0/4196343314 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58640a5c30 con 0x7f5874146bb0 2023-11-28T19:58:41.012 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:58:41.006+0000 7f587ab96640 1 -- 172.21.15.78:0/4196343314 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5874153660 con 0x7f5874146bb0 2023-11-28T19:58:41.012 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:58:41.006+0000 7f587ab96640 1 -- 172.21.15.78:0/4196343314 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5874153c20 con 0x7f5874146bb0 2023-11-28T19:58:41.012 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:58:41.006+0000 7f586a7fc640 1 -- 172.21.15.78:0/4196343314 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f58640b4040 con 0x7f5874146bb0 2023-11-28T19:58:41.012 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:58:41.006+0000 7f586a7fc640 1 -- 172.21.15.78:0/4196343314 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f58640ad440 con 0x7f5874146bb0 2023-11-28T19:58:41.012 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:58:41.006+0000 7f587ab96640 1 -- 172.21.15.78:0/4196343314 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f58740674b0 con 0x7f5874146bb0 2023-11-28T19:58:41.035 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:58:41.034+0000 7f586a7fc640 1 -- 172.21.15.78:0/4196343314 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72898 (secure 0 0 0) 0x7f58640bf070 con 0x7f5874146bb0 2023-11-28T19:58:41.115 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:58:41.114+0000 7f587ab96640 1 -- 172.21.15.78:0/4196343314 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) v1 -- 0x7f58740662a0 con 0x7f5874146bb0 2023-11-28T19:58:41.117 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:58:41.114+0000 7f586a7fc640 1 -- 172.21.15.78:0/4196343314 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) v1 ==== 124+0+0 (secure 0 0 0) 0x7f58640b2070 con 0x7f5874146bb0 2023-11-28T19:58:41.117 INFO:teuthology.orchestra.run.smithi078.stderr:adjusted tunables profile to default 2023-11-28T19:58:41.119 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:58:41.118+0000 7f587ab96640 1 -- 172.21.15.78:0/4196343314 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5874146bb0 msgr2=0x7f587414d530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:58:41.119 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:58:41.118+0000 7f587ab96640 1 --2- 172.21.15.78:0/4196343314 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5874146bb0 0x7f587414d530 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f586401c8a0 tx=0x7f5860005800 comp rx=0 tx=0).stop 2023-11-28T19:58:41.119 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:58:41.118+0000 7f587ab96640 1 -- 172.21.15.78:0/4196343314 shutdown_connections 2023-11-28T19:58:41.119 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:58:41.118+0000 7f587ab96640 1 --2- 172.21.15.78:0/4196343314 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f587415d100 0x7f587415d5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:58:41.119 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:58:41.118+0000 7f587ab96640 1 --2- 172.21.15.78:0/4196343314 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5874146bb0 0x7f587414d530 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:58:41.119 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:58:41.118+0000 7f587ab96640 1 --2- 172.21.15.78:0/4196343314 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f58600047d0 0x7f5874147100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:58:41.119 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:58:41.118+0000 7f587ab96640 1 -- 172.21.15.78:0/4196343314 >> 172.21.15.78:0/4196343314 conn(0x7f58740c2d40 msgr2=0x7f587414f990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T19:58:41.119 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:58:41.118+0000 7f587ab96640 1 -- 172.21.15.78:0/4196343314 shutdown_connections 2023-11-28T19:58:41.119 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:58:41.118+0000 7f587ab96640 1 -- 172.21.15.78:0/4196343314 wait complete. 2023-11-28T19:58:41.138 INFO:tasks.ceph:check_enable_crimson: False 2023-11-28T19:58:41.138 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2023-11-28T19:58:41.138 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2023-11-28T19:58:41.138 DEBUG:teuthology.orchestra.run.smithi078:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2023-11-28T19:58:41.159 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2023-11-28T19:58:41.159 DEBUG:teuthology.orchestra.run.smithi078:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2023-11-28T19:58:41.225 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2023-11-28T19:58:41.225 DEBUG:teuthology.orchestra.run.smithi078:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2023-11-28T19:58:41.229 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-11-28T19:58:41.226+0000 7f9ab524d180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-11-28T19:58:41.249 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2023-11-28T19:58:41.249 DEBUG:teuthology.orchestra.run.smithi078:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2023-11-28T19:58:41.249 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-11-28T19:58:41.248+0000 7f8ad3634180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-11-28T19:58:41.315 DEBUG:teuthology.orchestra.run.smithi179:> set -ex 2023-11-28T19:58:41.316 DEBUG:teuthology.orchestra.run.smithi179:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2023-11-28T19:58:41.338 DEBUG:teuthology.orchestra.run.smithi179:> set -ex 2023-11-28T19:58:41.338 DEBUG:teuthology.orchestra.run.smithi179:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2023-11-28T19:58:41.402 DEBUG:teuthology.orchestra.run.smithi179:> set -ex 2023-11-28T19:58:41.403 DEBUG:teuthology.orchestra.run.smithi179:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2023-11-28T19:58:41.466 DEBUG:teuthology.orchestra.run.smithi179:> set -ex 2023-11-28T19:58:41.466 DEBUG:teuthology.orchestra.run.smithi179:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2023-11-28T19:58:41.530 DEBUG:teuthology.orchestra.run.smithi179:> sudo ceph --cluster ceph osd new e84245ac-b5da-429e-af18-39acaa2b33e4 0 2023-11-28T19:58:41.707 INFO:teuthology.orchestra.run.smithi179.stderr:2023-11-28T19:58:41.708+0000 7f1371caa640 1 Processor -- start 2023-11-28T19:58:41.708 INFO:teuthology.orchestra.run.smithi179.stderr:2023-11-28T19:58:41.708+0000 7f1371caa640 1 -- start start 2023-11-28T19:58:41.709 INFO:teuthology.orchestra.run.smithi179.stderr:2023-11-28T19:58:41.708+0000 7f1371caa640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f136c0c6030 0x7f136c0c7cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:58:41.709 INFO:teuthology.orchestra.run.smithi179.stderr:2023-11-28T19:58:41.708+0000 7f1371caa640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f136c0c98f0 0x7f136c0c8200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:58:41.709 INFO:teuthology.orchestra.run.smithi179.stderr:2023-11-28T19:58:41.708+0000 7f1371caa640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f136c158780 con 0x7f136c0bf2d0 2023-11-28T19:58:41.709 INFO:teuthology.orchestra.run.smithi179.stderr:2023-11-28T19:58:41.708+0000 7f1371caa640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f136c0c0300 con 0x7f136c0c98f0 2023-11-28T19:58:41.709 INFO:teuthology.orchestra.run.smithi179.stderr:2023-11-28T19:58:41.708+0000 7f1371caa640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f136c157b70 con 0x7f136c0c6030 2023-11-28T19:58:41.710 INFO:teuthology.orchestra.run.smithi179.stderr:2023-11-28T19:58:41.708+0000 7f136affd640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f136c0c6030 0x7f136c0c7cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:58:41.710 INFO:teuthology.orchestra.run.smithi179.stderr:2023-11-28T19:58:41.708+0000 7f136bfff640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f136c0c98f0 0x7f136c0c8200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:58:41.710 INFO:teuthology.orchestra.run.smithi179.stderr:2023-11-28T19:58:41.708+0000 7f136affd640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f136c0c6030 0x7f136c0c7cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3301/0 says I am v2:172.21.15.179:40142/0 (socket says 172.21.15.179:40142) 2023-11-28T19:58:41.710 INFO:teuthology.orchestra.run.smithi179.stderr:2023-11-28T19:58:41.708+0000 7f136affd640 1 -- 172.21.15.179:0/3373297896 learned_addr learned my addr 172.21.15.179:0/3373297896 (peer_addr_for_me v2:172.21.15.179:0/0) 2023-11-28T19:58:41.710 INFO:teuthology.orchestra.run.smithi179.stderr:2023-11-28T19:58:41.708+0000 7f136b7fe640 1 --1- 172.21.15.179:0/3373297896 >> v1:172.21.15.179:6789/0 conn(0x7f136c0bf2d0 0x7f136c151970 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.179:6789/0 says I am v1:172.21.15.179:38134/0 (socket says 172.21.15.179:38134) 2023-11-28T19:58:41.711 INFO:teuthology.orchestra.run.smithi179.stderr:2023-11-28T19:58:41.708+0000 7f136affd640 1 -- 172.21.15.179:0/3373297896 >> v2:172.21.15.179:3300/0 conn(0x7f136c0c98f0 msgr2=0x7f136c0c8200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T19:58:41.711 INFO:teuthology.orchestra.run.smithi179.stderr:2023-11-28T19:58:41.708+0000 7f136affd640 1 --2- 172.21.15.179:0/3373297896 >> v2:172.21.15.179:3300/0 conn(0x7f136c0c98f0 0x7f136c0c8200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:58:41.711 INFO:teuthology.orchestra.run.smithi179.stderr:2023-11-28T19:58:41.708+0000 7f136affd640 1 -- 172.21.15.179:0/3373297896 >> v1:172.21.15.179:6789/0 conn(0x7f136c0bf2d0 legacy=0x7f136c151970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T19:58:41.711 INFO:teuthology.orchestra.run.smithi179.stderr:2023-11-28T19:58:41.708+0000 7f136affd640 1 -- 172.21.15.179:0/3373297896 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f136c157e50 con 0x7f136c0c6030 2023-11-28T19:58:41.712 INFO:teuthology.orchestra.run.smithi179.stderr:2023-11-28T19:58:41.712+0000 7f136affd640 1 --2- 172.21.15.179:0/3373297896 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f136c0c6030 0x7f136c0c7cc0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f1360009870 tx=0x7f136001c4d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4c50fe5b8194f62 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:58:41.712 INFO:teuthology.orchestra.run.smithi179.stderr:2023-11-28T19:58:41.712+0000 7f136a7fc640 1 -- 172.21.15.179:0/3373297896 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13600aa5f0 con 0x7f136c0c6030 2023-11-28T19:58:41.713 INFO:teuthology.orchestra.run.smithi179.stderr:2023-11-28T19:58:41.712+0000 7f136a7fc640 1 -- 172.21.15.179:0/3373297896 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f13600aa750 con 0x7f136c0c6030 2023-11-28T19:58:41.713 INFO:teuthology.orchestra.run.smithi179.stderr:2023-11-28T19:58:41.712+0000 7f136a7fc640 1 -- 172.21.15.179:0/3373297896 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13600aaae0 con 0x7f136c0c6030 2023-11-28T19:58:41.714 INFO:teuthology.orchestra.run.smithi179.stderr:2023-11-28T19:58:41.712+0000 7f1371caa640 1 -- 172.21.15.179:0/3373297896 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f136c0c6030 msgr2=0x7f136c0c7cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:58:41.714 INFO:teuthology.orchestra.run.smithi179.stderr:2023-11-28T19:58:41.712+0000 7f1371caa640 1 --2- 172.21.15.179:0/3373297896 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f136c0c6030 0x7f136c0c7cc0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f1360009870 tx=0x7f136001c4d0 comp rx=0 tx=0).stop 2023-11-28T19:58:41.714 INFO:teuthology.orchestra.run.smithi179.stderr:2023-11-28T19:58:41.712+0000 7f1371caa640 1 -- 172.21.15.179:0/3373297896 shutdown_connections 2023-11-28T19:58:41.714 INFO:teuthology.orchestra.run.smithi179.stderr:2023-11-28T19:58:41.712+0000 7f1371caa640 1 --2- 172.21.15.179:0/3373297896 >> v2:172.21.15.179:3300/0 conn(0x7f136c0c98f0 0x7f136c0c8200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:58:41.714 INFO:teuthology.orchestra.run.smithi179.stderr:2023-11-28T19:58:41.712+0000 7f1371caa640 1 --2- 172.21.15.179:0/3373297896 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f136c0c6030 0x7f136c0c7cc0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:58:41.714 INFO:teuthology.orchestra.run.smithi179.stderr:2023-11-28T19:58:41.712+0000 7f1371caa640 1 -- 172.21.15.179:0/3373297896 >> 172.21.15.179:0/3373297896 conn(0x7f136c0c9dc0 msgr2=0x7f136c0ca1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T19:58:41.714 INFO:teuthology.orchestra.run.smithi179.stderr:2023-11-28T19:58:41.712+0000 7f1371caa640 1 -- 172.21.15.179:0/3373297896 shutdown_connections 2023-11-28T19:58:41.714 INFO:teuthology.orchestra.run.smithi179.stderr:2023-11-28T19:58:41.712+0000 7f1371caa640 1 -- 172.21.15.179:0/3373297896 wait complete. 2023-11-28T19:58:41.715 INFO:teuthology.orchestra.run.smithi179.stderr:2023-11-28T19:58:41.716+0000 7f1371caa640 1 Processor -- start 2023-11-28T19:58:41.715 INFO:teuthology.orchestra.run.smithi179.stderr:2023-11-28T19:58:41.716+0000 7f1371caa640 1 -- start start 2023-11-28T19:58:41.717 INFO:teuthology.orchestra.run.smithi179.stderr:2023-11-28T19:58:41.716+0000 7f1371caa640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f136c0bf2d0 0x7f136c1ed970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:58:41.717 INFO:teuthology.orchestra.run.smithi179.stderr:2023-11-28T19:58:41.716+0000 7f1371caa640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f136c0c6030 0x7f136c1f0440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:58:41.717 INFO:teuthology.orchestra.run.smithi179.stderr:2023-11-28T19:58:41.716+0000 7f1371caa640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f136c0c98f0 0x7f136c148020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:58:41.717 INFO:teuthology.orchestra.run.smithi179.stderr:2023-11-28T19:58:41.716+0000 7f1371caa640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f136c1f0980 con 0x7f136c0c98f0 2023-11-28T19:58:41.717 INFO:teuthology.orchestra.run.smithi179.stderr:2023-11-28T19:58:41.716+0000 7f1371caa640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f136c06cbd0 con 0x7f136c0c6030 2023-11-28T19:58:41.717 INFO:teuthology.orchestra.run.smithi179.stderr:2023-11-28T19:58:41.716+0000 7f1371caa640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f136c06c610 con 0x7f136c0bf2d0 2023-11-28T19:58:41.718 INFO:teuthology.orchestra.run.smithi179.stderr:2023-11-28T19:58:41.716+0000 7f136b7fe640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f136c0bf2d0 0x7f136c1ed970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:58:41.718 INFO:teuthology.orchestra.run.smithi179.stderr:2023-11-28T19:58:41.716+0000 7f136b7fe640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f136c0bf2d0 0x7f136c1ed970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3301/0 says I am v2:172.21.15.179:40146/0 (socket says 172.21.15.179:40146) 2023-11-28T19:58:41.721 INFO:teuthology.orchestra.run.smithi179.stderr:2023-11-28T19:58:41.716+0000 7f136b7fe640 1 -- 172.21.15.179:0/2791925723 learned_addr learned my addr 172.21.15.179:0/2791925723 (peer_addr_for_me v2:172.21.15.179:0/0) 2023-11-28T19:58:41.721 INFO:teuthology.orchestra.run.smithi179.stderr:2023-11-28T19:58:41.716+0000 7f136bfff640 1 --2- 172.21.15.179:0/2791925723 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f136c0c98f0 0x7f136c148020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:58:41.722 INFO:teuthology.orchestra.run.smithi179.stderr:2023-11-28T19:58:41.716+0000 7f136affd640 1 --2- 172.21.15.179:0/2791925723 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f136c0c6030 0x7f136c1f0440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:58:41.722 INFO:teuthology.orchestra.run.smithi179.stderr:2023-11-28T19:58:41.716+0000 7f136b7fe640 1 -- 172.21.15.179:0/2791925723 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f136c0c6030 msgr2=0x7f136c1f0440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:58:41.722 INFO:teuthology.orchestra.run.smithi179.stderr:2023-11-28T19:58:41.716+0000 7f136b7fe640 1 --2- 172.21.15.179:0/2791925723 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f136c0c6030 0x7f136c1f0440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:58:41.723 INFO:teuthology.orchestra.run.smithi179.stderr:2023-11-28T19:58:41.716+0000 7f136b7fe640 1 -- 172.21.15.179:0/2791925723 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f136c0c98f0 msgr2=0x7f136c148020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:58:41.724 INFO:teuthology.orchestra.run.smithi179.stderr:2023-11-28T19:58:41.716+0000 7f136b7fe640 1 --2- 172.21.15.179:0/2791925723 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f136c0c98f0 0x7f136c148020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:58:41.724 INFO:teuthology.orchestra.run.smithi179.stderr:2023-11-28T19:58:41.716+0000 7f136b7fe640 1 -- 172.21.15.179:0/2791925723 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13600094d0 con 0x7f136c0bf2d0 2023-11-28T19:58:41.724 INFO:teuthology.orchestra.run.smithi179.stderr:2023-11-28T19:58:41.716+0000 7f136affd640 1 --2- 172.21.15.179:0/2791925723 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f136c0c6030 0x7f136c1f0440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T19:58:41.726 INFO:teuthology.orchestra.run.smithi179.stderr:2023-11-28T19:58:41.716+0000 7f136b7fe640 1 --2- 172.21.15.179:0/2791925723 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f136c0bf2d0 0x7f136c1ed970 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f135c00c460 tx=0x7f135c00c920 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:58:41.726 INFO:teuthology.orchestra.run.smithi179.stderr:2023-11-28T19:58:41.716+0000 7f1353fff640 1 -- 172.21.15.179:0/2791925723 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f135c007480 con 0x7f136c0bf2d0 2023-11-28T19:58:41.726 INFO:teuthology.orchestra.run.smithi179.stderr:2023-11-28T19:58:41.716+0000 7f1353fff640 1 -- 172.21.15.179:0/2791925723 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f135c007600 con 0x7f136c0bf2d0 2023-11-28T19:58:41.726 INFO:teuthology.orchestra.run.smithi179.stderr:2023-11-28T19:58:41.716+0000 7f1371caa640 1 -- 172.21.15.179:0/2791925723 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f136c06c8f0 con 0x7f136c0bf2d0 2023-11-28T19:58:41.727 INFO:teuthology.orchestra.run.smithi179.stderr:2023-11-28T19:58:41.716+0000 7f1353fff640 1 -- 172.21.15.179:0/2791925723 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f135c005a60 con 0x7f136c0bf2d0 2023-11-28T19:58:41.727 INFO:teuthology.orchestra.run.smithi179.stderr:2023-11-28T19:58:41.716+0000 7f1371caa640 1 -- 172.21.15.179:0/2791925723 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f136c1ec8f0 con 0x7f136c0bf2d0 2023-11-28T19:58:41.727 INFO:teuthology.orchestra.run.smithi179.stderr:2023-11-28T19:58:41.716+0000 7f1353fff640 1 -- 172.21.15.179:0/2791925723 <== mon.2 v2:172.21.15.179:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f135c01c440 con 0x7f136c0bf2d0 2023-11-28T19:58:41.727 INFO:teuthology.orchestra.run.smithi179.stderr:2023-11-28T19:58:41.716+0000 7f1353fff640 1 -- 172.21.15.179:0/2791925723 <== mon.2 v2:172.21.15.179:3301/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 725+0+0 (secure 0 0 0) 0x7f135c0127d0 con 0x7f136c0bf2d0 2023-11-28T19:58:41.727 INFO:teuthology.orchestra.run.smithi179.stderr:2023-11-28T19:58:41.720+0000 7f1371caa640 1 -- 172.21.15.179:0/2791925723 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f136c1ecae0 con 0x7f136c0bf2d0 2023-11-28T19:58:41.737 INFO:teuthology.orchestra.run.smithi179.stderr:2023-11-28T19:58:41.736+0000 7f1353fff640 1 -- 172.21.15.179:0/2791925723 <== mon.2 v2:172.21.15.179:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72898 (secure 0 0 0) 0x7f135c017070 con 0x7f136c0bf2d0 2023-11-28T19:58:41.767 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-11-28T19:58:41.766+0000 7f9ab524d180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-11-28T19:58:41.875 INFO:teuthology.orchestra.run.smithi179.stderr:2023-11-28T19:58:41.876+0000 7f1371caa640 1 -- 172.21.15.179:0/2791925723 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_command({"prefix": "osd new", "uuid": "e84245ac-b5da-429e-af18-39acaa2b33e4", "id": 0} v 0) v1 -- 0x7f136c067630 con 0x7f136c0bf2d0 2023-11-28T19:58:41.879 INFO:teuthology.orchestra.run.smithi179.stderr:2023-11-28T19:58:41.880+0000 7f1353fff640 1 -- 172.21.15.179:0/2791925723 <== mon.2 v2:172.21.15.179:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "e84245ac-b5da-429e-af18-39acaa2b33e4", "id": 0}]=0 v3) v1 ==== 112+0+2 (secure 0 0 0) 0x7f135c0129f0 con 0x7f136c0bf2d0 2023-11-28T19:58:41.879 INFO:teuthology.orchestra.run.smithi179.stdout:0 2023-11-28T19:58:41.880 INFO:teuthology.orchestra.run.smithi179.stderr:2023-11-28T19:58:41.880+0000 7f1371caa640 1 -- 172.21.15.179:0/2791925723 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f136c0bf2d0 msgr2=0x7f136c1ed970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:58:41.881 INFO:teuthology.orchestra.run.smithi179.stderr:2023-11-28T19:58:41.880+0000 7f1371caa640 1 --2- 172.21.15.179:0/2791925723 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f136c0bf2d0 0x7f136c1ed970 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f135c00c460 tx=0x7f135c00c920 comp rx=0 tx=0).stop 2023-11-28T19:58:41.881 INFO:teuthology.orchestra.run.smithi179.stderr:2023-11-28T19:58:41.880+0000 7f1371caa640 1 -- 172.21.15.179:0/2791925723 shutdown_connections 2023-11-28T19:58:41.881 INFO:teuthology.orchestra.run.smithi179.stderr:2023-11-28T19:58:41.880+0000 7f1371caa640 1 --2- 172.21.15.179:0/2791925723 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f136c0c98f0 0x7f136c148020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:58:41.881 INFO:teuthology.orchestra.run.smithi179.stderr:2023-11-28T19:58:41.880+0000 7f1371caa640 1 --2- 172.21.15.179:0/2791925723 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f136c0c6030 0x7f136c1f0440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:58:41.881 INFO:teuthology.orchestra.run.smithi179.stderr:2023-11-28T19:58:41.880+0000 7f1371caa640 1 --2- 172.21.15.179:0/2791925723 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f136c0bf2d0 0x7f136c1ed970 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:58:41.882 INFO:teuthology.orchestra.run.smithi179.stderr:2023-11-28T19:58:41.880+0000 7f1371caa640 1 -- 172.21.15.179:0/2791925723 >> 172.21.15.179:0/2791925723 conn(0x7f136c0c9dc0 msgr2=0x7f136c156e90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T19:58:41.882 INFO:teuthology.orchestra.run.smithi179.stderr:2023-11-28T19:58:41.880+0000 7f1371caa640 1 -- 172.21.15.179:0/2791925723 shutdown_connections 2023-11-28T19:58:41.882 INFO:teuthology.orchestra.run.smithi179.stderr:2023-11-28T19:58:41.880+0000 7f1371caa640 1 -- 172.21.15.179:0/2791925723 wait complete. 2023-11-28T19:58:41.896 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-11-28T19:58:41.896+0000 7f8ad3634180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-11-28T19:58:41.906 DEBUG:teuthology.orchestra.run.smithi179:> sudo ceph --cluster ceph osd new e634831d-c4e2-48d9-870c-9556ae162981 1 2023-11-28T19:58:41.970 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-11-28T19:58:41.970+0000 7f9ab524d180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-11-28T19:58:42.045 INFO:teuthology.orchestra.run.smithi179.stderr:2023-11-28T19:58:42.044+0000 7fa65edaa640 1 Processor -- start 2023-11-28T19:58:42.046 INFO:teuthology.orchestra.run.smithi179.stderr:2023-11-28T19:58:42.044+0000 7fa65edaa640 1 -- start start 2023-11-28T19:58:42.047 INFO:teuthology.orchestra.run.smithi179.stderr:2023-11-28T19:58:42.048+0000 7fa65edaa640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fa6580c6030 0x7fa6580c7cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:58:42.047 INFO:teuthology.orchestra.run.smithi179.stderr:2023-11-28T19:58:42.048+0000 7fa65edaa640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa658158780 con 0x7fa6580c98f0 2023-11-28T19:58:42.047 INFO:teuthology.orchestra.run.smithi179.stderr:2023-11-28T19:58:42.048+0000 7fa65edaa640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa6580c8910 con 0x7fa6580bf2d0 2023-11-28T19:58:42.047 INFO:teuthology.orchestra.run.smithi179.stderr:2023-11-28T19:58:42.048+0000 7fa65edaa640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa6580c0300 con 0x7fa6580c6030 2023-11-28T19:58:42.048 INFO:teuthology.orchestra.run.smithi179.stderr:2023-11-28T19:58:42.048+0000 7fa64ffff640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fa6580c6030 0x7fa6580c7cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:58:42.048 INFO:teuthology.orchestra.run.smithi179.stderr:2023-11-28T19:58:42.048+0000 7fa64ffff640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fa6580c6030 0x7fa6580c7cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.179:44276/0 (socket says 172.21.15.179:44276) 2023-11-28T19:58:42.048 INFO:teuthology.orchestra.run.smithi179.stderr:2023-11-28T19:58:42.048+0000 7fa64ffff640 1 -- 172.21.15.179:0/842597576 learned_addr learned my addr 172.21.15.179:0/842597576 (peer_addr_for_me v2:172.21.15.179:0/0) 2023-11-28T19:58:42.048 INFO:teuthology.orchestra.run.smithi179.stderr:2023-11-28T19:58:42.048+0000 7fa65cb46640 1 --1- 172.21.15.179:0/842597576 >> v1:172.21.15.179:6789/0 conn(0x7fa6580bf2d0 0x7fa658151970 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.179:6789/0 says I am v1:172.21.15.179:38144/0 (socket says 172.21.15.179:38144) 2023-11-28T19:58:42.048 INFO:teuthology.orchestra.run.smithi179.stderr:2023-11-28T19:58:42.048+0000 7fa64ffff640 1 -- 172.21.15.179:0/842597576 >> v1:172.21.15.179:6789/0 conn(0x7fa6580bf2d0 legacy=0x7fa658151970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:58:42.048 INFO:teuthology.orchestra.run.smithi179.stderr:2023-11-28T19:58:42.048+0000 7fa64ffff640 1 -- 172.21.15.179:0/842597576 >> v1:172.21.15.78:6789/0 conn(0x7fa6580c98f0 legacy=0x7fa6580c8200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:58:42.048 INFO:teuthology.orchestra.run.smithi179.stderr:2023-11-28T19:58:42.048+0000 7fa64ffff640 1 -- 172.21.15.179:0/842597576 --> v2:172.21.15.179:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa658157b70 con 0x7fa6580c6030 2023-11-28T19:58:42.050 INFO:teuthology.orchestra.run.smithi179.stderr:2023-11-28T19:58:42.052+0000 7fa64ffff640 1 --2- 172.21.15.179:0/842597576 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa6580c6030 0x7fa6580c7cc0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fa648009870 tx=0x7fa64801c510 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1dffd2341484011a server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:58:42.051 INFO:teuthology.orchestra.run.smithi179.stderr:2023-11-28T19:58:42.052+0000 7fa64f7fe640 1 -- 172.21.15.179:0/842597576 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6480aa670 con 0x7fa6580c6030 2023-11-28T19:58:42.051 INFO:teuthology.orchestra.run.smithi179.stderr:2023-11-28T19:58:42.052+0000 7fa64f7fe640 1 -- 172.21.15.179:0/842597576 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa6480aa7d0 con 0x7fa6580c6030 2023-11-28T19:58:42.051 INFO:teuthology.orchestra.run.smithi179.stderr:2023-11-28T19:58:42.052+0000 7fa64f7fe640 1 -- 172.21.15.179:0/842597576 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6480aab60 con 0x7fa6580c6030 2023-11-28T19:58:42.052 INFO:teuthology.orchestra.run.smithi179.stderr:2023-11-28T19:58:42.052+0000 7fa65edaa640 1 -- 172.21.15.179:0/842597576 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa6580c6030 msgr2=0x7fa6580c7cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:58:42.052 INFO:teuthology.orchestra.run.smithi179.stderr:2023-11-28T19:58:42.052+0000 7fa65edaa640 1 --2- 172.21.15.179:0/842597576 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa6580c6030 0x7fa6580c7cc0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fa648009870 tx=0x7fa64801c510 comp rx=0 tx=0).stop 2023-11-28T19:58:42.052 INFO:teuthology.orchestra.run.smithi179.stderr:2023-11-28T19:58:42.052+0000 7fa65edaa640 1 -- 172.21.15.179:0/842597576 shutdown_connections 2023-11-28T19:58:42.052 INFO:teuthology.orchestra.run.smithi179.stderr:2023-11-28T19:58:42.052+0000 7fa65edaa640 1 --2- 172.21.15.179:0/842597576 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa6580c6030 0x7fa6580c7cc0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:58:42.052 INFO:teuthology.orchestra.run.smithi179.stderr:2023-11-28T19:58:42.052+0000 7fa65edaa640 1 -- 172.21.15.179:0/842597576 >> 172.21.15.179:0/842597576 conn(0x7fa6580c9dc0 msgr2=0x7fa6580ca1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T19:58:42.052 INFO:teuthology.orchestra.run.smithi179.stderr:2023-11-28T19:58:42.052+0000 7fa65edaa640 1 -- 172.21.15.179:0/842597576 shutdown_connections 2023-11-28T19:58:42.053 INFO:teuthology.orchestra.run.smithi179.stderr:2023-11-28T19:58:42.052+0000 7fa65edaa640 1 -- 172.21.15.179:0/842597576 wait complete. 2023-11-28T19:58:42.053 INFO:teuthology.orchestra.run.smithi179.stderr:2023-11-28T19:58:42.052+0000 7fa65edaa640 1 Processor -- start 2023-11-28T19:58:42.054 INFO:teuthology.orchestra.run.smithi179.stderr:2023-11-28T19:58:42.052+0000 7fa65edaa640 1 -- start start 2023-11-28T19:58:42.056 INFO:teuthology.orchestra.run.smithi179.stderr:2023-11-28T19:58:42.052+0000 7fa65edaa640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa6580bf2d0 0x7fa65814a6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:58:42.057 INFO:teuthology.orchestra.run.smithi179.stderr:2023-11-28T19:58:42.052+0000 7fa65edaa640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa6580c6030 0x7fa658147a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:58:42.057 INFO:teuthology.orchestra.run.smithi179.stderr:2023-11-28T19:58:42.052+0000 7fa65edaa640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa6580c98f0 0x7fa6581ecad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:58:42.057 INFO:teuthology.orchestra.run.smithi179.stderr:2023-11-28T19:58:42.052+0000 7fa65edaa640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa65814abe0 con 0x7fa6580c6030 2023-11-28T19:58:42.057 INFO:teuthology.orchestra.run.smithi179.stderr:2023-11-28T19:58:42.052+0000 7fa65edaa640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa65814ee00 con 0x7fa6580c98f0 2023-11-28T19:58:42.057 INFO:teuthology.orchestra.run.smithi179.stderr:2023-11-28T19:58:42.052+0000 7fa65edaa640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa6581f0040 con 0x7fa6580bf2d0 2023-11-28T19:58:42.057 INFO:teuthology.orchestra.run.smithi179.stderr:2023-11-28T19:58:42.056+0000 7fa65cb46640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa6580bf2d0 0x7fa65814a6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:58:42.057 INFO:teuthology.orchestra.run.smithi179.stderr:2023-11-28T19:58:42.056+0000 7fa65cb46640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa6580bf2d0 0x7fa65814a6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3301/0 says I am v2:172.21.15.179:40154/0 (socket says 172.21.15.179:40154) 2023-11-28T19:58:42.058 INFO:teuthology.orchestra.run.smithi179.stderr:2023-11-28T19:58:42.056+0000 7fa65cb46640 1 -- 172.21.15.179:0/297702820 learned_addr learned my addr 172.21.15.179:0/297702820 (peer_addr_for_me v2:172.21.15.179:0/0) 2023-11-28T19:58:42.058 INFO:teuthology.orchestra.run.smithi179.stderr:2023-11-28T19:58:42.056+0000 7fa64ffff640 1 --2- 172.21.15.179:0/297702820 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa6580c6030 0x7fa658147a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:58:42.058 INFO:teuthology.orchestra.run.smithi179.stderr:2023-11-28T19:58:42.056+0000 7fa65d347640 1 --2- 172.21.15.179:0/297702820 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa6580c98f0 0x7fa6581ecad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:58:42.058 INFO:teuthology.orchestra.run.smithi179.stderr:2023-11-28T19:58:42.056+0000 7fa65cb46640 1 -- 172.21.15.179:0/297702820 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa6580c98f0 msgr2=0x7fa6581ecad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:58:42.058 INFO:teuthology.orchestra.run.smithi179.stderr:2023-11-28T19:58:42.056+0000 7fa65cb46640 1 --2- 172.21.15.179:0/297702820 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa6580c98f0 0x7fa6581ecad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:58:42.058 INFO:teuthology.orchestra.run.smithi179.stderr:2023-11-28T19:58:42.056+0000 7fa65cb46640 1 -- 172.21.15.179:0/297702820 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa6580c6030 msgr2=0x7fa658147a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:58:42.058 INFO:teuthology.orchestra.run.smithi179.stderr:2023-11-28T19:58:42.056+0000 7fa65cb46640 1 --2- 172.21.15.179:0/297702820 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa6580c6030 0x7fa658147a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:58:42.058 INFO:teuthology.orchestra.run.smithi179.stderr:2023-11-28T19:58:42.056+0000 7fa65cb46640 1 -- 172.21.15.179:0/297702820 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6480094d0 con 0x7fa6580bf2d0 2023-11-28T19:58:42.058 INFO:teuthology.orchestra.run.smithi179.stderr:2023-11-28T19:58:42.056+0000 7fa65cb46640 1 --2- 172.21.15.179:0/297702820 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa6580bf2d0 0x7fa65814a6a0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fa65400c430 tx=0x7fa65400c8f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:58:42.059 INFO:teuthology.orchestra.run.smithi179.stderr:2023-11-28T19:58:42.056+0000 7fa64d7fa640 1 -- 172.21.15.179:0/297702820 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6540074e0 con 0x7fa6580bf2d0 2023-11-28T19:58:42.059 INFO:teuthology.orchestra.run.smithi179.stderr:2023-11-28T19:58:42.056+0000 7fa64d7fa640 1 -- 172.21.15.179:0/297702820 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa654007640 con 0x7fa6580bf2d0 2023-11-28T19:58:42.059 INFO:teuthology.orchestra.run.smithi179.stderr:2023-11-28T19:58:42.056+0000 7fa64d7fa640 1 -- 172.21.15.179:0/297702820 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa654004a10 con 0x7fa6580bf2d0 2023-11-28T19:58:42.059 INFO:teuthology.orchestra.run.smithi179.stderr:2023-11-28T19:58:42.056+0000 7fa65edaa640 1 -- 172.21.15.179:0/297702820 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa658146bf0 con 0x7fa6580bf2d0 2023-11-28T19:58:42.059 INFO:teuthology.orchestra.run.smithi179.stderr:2023-11-28T19:58:42.056+0000 7fa65edaa640 1 -- 172.21.15.179:0/297702820 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa6581f08a0 con 0x7fa6580bf2d0 2023-11-28T19:58:42.059 INFO:teuthology.orchestra.run.smithi179.stderr:2023-11-28T19:58:42.056+0000 7fa64d7fa640 1 -- 172.21.15.179:0/297702820 <== mon.2 v2:172.21.15.179:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fa654013400 con 0x7fa6580bf2d0 2023-11-28T19:58:42.059 INFO:teuthology.orchestra.run.smithi179.stderr:2023-11-28T19:58:42.056+0000 7fa64d7fa640 1 -- 172.21.15.179:0/297702820 <== mon.2 v2:172.21.15.179:3301/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 840+0+0 (secure 0 0 0) 0x7fa65401c7a0 con 0x7fa6580bf2d0 2023-11-28T19:58:42.060 INFO:teuthology.orchestra.run.smithi179.stderr:2023-11-28T19:58:42.056+0000 7fa65edaa640 1 -- 172.21.15.179:0/297702820 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa6580aafb0 con 0x7fa6580bf2d0 2023-11-28T19:58:42.060 INFO:teuthology.orchestra.run.smithi179.stderr:2023-11-28T19:58:42.060+0000 7fa64d7fa640 1 -- 172.21.15.179:0/297702820 <== mon.2 v2:172.21.15.179:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72898 (secure 0 0 0) 0x7fa6540138e0 con 0x7fa6580bf2d0 2023-11-28T19:58:42.112 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-11-28T19:58:42.112+0000 7f8ad3634180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-11-28T19:58:42.125 INFO:teuthology.orchestra.run.smithi179.stderr:2023-11-28T19:58:42.124+0000 7fa65edaa640 1 -- 172.21.15.179:0/297702820 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_command({"prefix": "osd new", "uuid": "e634831d-c4e2-48d9-870c-9556ae162981", "id": 1} v 0) v1 -- 0x7fa658067630 con 0x7fa6580bf2d0 2023-11-28T19:58:42.132 INFO:teuthology.orchestra.run.smithi179.stderr:2023-11-28T19:58:42.132+0000 7fa64d7fa640 1 -- 172.21.15.179:0/297702820 <== mon.2 v2:172.21.15.179:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "e634831d-c4e2-48d9-870c-9556ae162981", "id": 1}]=0 v4) v1 ==== 112+0+2 (secure 0 0 0) 0x7fa654013a80 con 0x7fa6580bf2d0 2023-11-28T19:58:42.133 INFO:teuthology.orchestra.run.smithi179.stdout:1 2023-11-28T19:58:42.134 INFO:teuthology.orchestra.run.smithi179.stderr:2023-11-28T19:58:42.132+0000 7fa65edaa640 1 -- 172.21.15.179:0/297702820 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa6580bf2d0 msgr2=0x7fa65814a6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:58:42.134 INFO:teuthology.orchestra.run.smithi179.stderr:2023-11-28T19:58:42.132+0000 7fa65edaa640 1 --2- 172.21.15.179:0/297702820 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa6580bf2d0 0x7fa65814a6a0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fa65400c430 tx=0x7fa65400c8f0 comp rx=0 tx=0).stop 2023-11-28T19:58:42.134 INFO:teuthology.orchestra.run.smithi179.stderr:2023-11-28T19:58:42.132+0000 7fa65edaa640 1 -- 172.21.15.179:0/297702820 shutdown_connections 2023-11-28T19:58:42.135 INFO:teuthology.orchestra.run.smithi179.stderr:2023-11-28T19:58:42.132+0000 7fa65edaa640 1 --2- 172.21.15.179:0/297702820 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa6580c98f0 0x7fa6581ecad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:58:42.135 INFO:teuthology.orchestra.run.smithi179.stderr:2023-11-28T19:58:42.132+0000 7fa65edaa640 1 --2- 172.21.15.179:0/297702820 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa6580c6030 0x7fa658147a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:58:42.135 INFO:teuthology.orchestra.run.smithi179.stderr:2023-11-28T19:58:42.132+0000 7fa65edaa640 1 --2- 172.21.15.179:0/297702820 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa6580bf2d0 0x7fa65814a6a0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:58:42.135 INFO:teuthology.orchestra.run.smithi179.stderr:2023-11-28T19:58:42.132+0000 7fa65edaa640 1 -- 172.21.15.179:0/297702820 >> 172.21.15.179:0/297702820 conn(0x7fa6580c9dc0 msgr2=0x7fa6581559b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T19:58:42.135 INFO:teuthology.orchestra.run.smithi179.stderr:2023-11-28T19:58:42.132+0000 7fa65edaa640 1 -- 172.21.15.179:0/297702820 shutdown_connections 2023-11-28T19:58:42.135 INFO:teuthology.orchestra.run.smithi179.stderr:2023-11-28T19:58:42.132+0000 7fa65edaa640 1 -- 172.21.15.179:0/297702820 wait complete. 2023-11-28T19:58:42.154 DEBUG:teuthology.orchestra.run.smithi179:> sudo ceph --cluster ceph osd new 274c8395-6534-41f0-b8fb-a00af8985aa8 2 2023-11-28T19:58:42.289 INFO:teuthology.orchestra.run.smithi179.stderr:2023-11-28T19:58:42.288+0000 7fb31cbf8640 1 Processor -- start 2023-11-28T19:58:42.290 INFO:teuthology.orchestra.run.smithi179.stderr:2023-11-28T19:58:42.288+0000 7fb31cbf8640 1 -- start start 2023-11-28T19:58:42.291 INFO:teuthology.orchestra.run.smithi179.stderr:2023-11-28T19:58:42.288+0000 7fb31cbf8640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fb3180bf2d0 0x7fb318151970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:58:42.291 INFO:teuthology.orchestra.run.smithi179.stderr:2023-11-28T19:58:42.288+0000 7fb31cbf8640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb3180c98f0 0x7fb318151eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:58:42.291 INFO:teuthology.orchestra.run.smithi179.stderr:2023-11-28T19:58:42.288+0000 7fb31cbf8640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb318158780 con 0x7fb3180c6030 2023-11-28T19:58:42.291 INFO:teuthology.orchestra.run.smithi179.stderr:2023-11-28T19:58:42.288+0000 7fb31cbf8640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb3180c0300 con 0x7fb3180bf2d0 2023-11-28T19:58:42.291 INFO:teuthology.orchestra.run.smithi179.stderr:2023-11-28T19:58:42.288+0000 7fb31cbf8640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb318157b70 con 0x7fb3180c98f0 2023-11-28T19:58:42.292 INFO:teuthology.orchestra.run.smithi179.stderr:2023-11-28T19:58:42.288+0000 7fb315d9b640 1 --1- >> v1:172.21.15.179:6789/0 conn(0x7fb3180c6030 0x7fb3180c7cc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.179:6789/0 says I am v1:172.21.15.179:38160/0 (socket says 172.21.15.179:38160) 2023-11-28T19:58:42.292 INFO:teuthology.orchestra.run.smithi179.stderr:2023-11-28T19:58:42.292+0000 7fb315d9b640 1 -- 172.21.15.179:0/2673022064 learned_addr learned my addr 172.21.15.179:0/2673022064 (peer_addr_for_me v1:172.21.15.179:0/0) 2023-11-28T19:58:42.292 INFO:teuthology.orchestra.run.smithi179.stderr:2023-11-28T19:58:42.288+0000 7fb316d9d640 1 --2- 172.21.15.179:0/2673022064 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb3180c98f0 0x7fb318151eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:58:42.292 INFO:teuthology.orchestra.run.smithi179.stderr:2023-11-28T19:58:42.292+0000 7fb31659c640 1 --2- 172.21.15.179:0/2673022064 >> v2:172.21.15.78:3300/0 conn(0x7fb3180bf2d0 0x7fb318151970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:58:42.292 INFO:teuthology.orchestra.run.smithi179.stderr:2023-11-28T19:58:42.292+0000 7fb31559a640 1 -- 172.21.15.179:0/2673022064 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4011038046 0 0) 0x7fb318158780 con 0x7fb3180c6030 2023-11-28T19:58:42.292 INFO:teuthology.orchestra.run.smithi179.stderr:2023-11-28T19:58:42.292+0000 7fb31559a640 1 -- 172.21.15.179:0/2673022064 --> v1:172.21.15.179:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb300003530 con 0x7fb3180c6030 2023-11-28T19:58:42.292 INFO:teuthology.orchestra.run.smithi179.stderr:2023-11-28T19:58:42.292+0000 7fb316d9d640 1 -- 172.21.15.179:0/2673022064 >> v2:172.21.15.78:3300/0 conn(0x7fb3180bf2d0 msgr2=0x7fb318151970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T19:58:42.292 INFO:teuthology.orchestra.run.smithi179.stderr:2023-11-28T19:58:42.292+0000 7fb316d9d640 1 --2- 172.21.15.179:0/2673022064 >> v2:172.21.15.78:3300/0 conn(0x7fb3180bf2d0 0x7fb318151970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:58:42.292 INFO:teuthology.orchestra.run.smithi179.stderr:2023-11-28T19:58:42.292+0000 7fb316d9d640 1 -- 172.21.15.179:0/2673022064 >> v1:172.21.15.179:6789/0 conn(0x7fb3180c6030 legacy=0x7fb3180c7cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:58:42.292 INFO:teuthology.orchestra.run.smithi179.stderr:2023-11-28T19:58:42.292+0000 7fb316d9d640 1 -- 172.21.15.179:0/2673022064 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb318157e50 con 0x7fb3180c98f0 2023-11-28T19:58:42.295 INFO:teuthology.orchestra.run.smithi179.stderr:2023-11-28T19:58:42.292+0000 7fb316d9d640 1 --2- 172.21.15.179:0/2673022064 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb3180c98f0 0x7fb318151eb0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fb310009d90 tx=0x7fb31001c920 comp rx=0 tx=0).ready entity=mon.2 client_cookie=73ac2884888142b2 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:58:42.295 INFO:teuthology.orchestra.run.smithi179.stderr:2023-11-28T19:58:42.292+0000 7fb31559a640 1 -- 172.21.15.179:0/2673022064 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3100a59e0 con 0x7fb3180c98f0 2023-11-28T19:58:42.296 INFO:teuthology.orchestra.run.smithi179.stderr:2023-11-28T19:58:42.292+0000 7fb31559a640 1 -- 172.21.15.179:0/2673022064 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb3100a5b40 con 0x7fb3180c98f0 2023-11-28T19:58:42.296 INFO:teuthology.orchestra.run.smithi179.stderr:2023-11-28T19:58:42.292+0000 7fb31559a640 1 -- 172.21.15.179:0/2673022064 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3100ad440 con 0x7fb3180c98f0 2023-11-28T19:58:42.296 INFO:teuthology.orchestra.run.smithi179.stderr:2023-11-28T19:58:42.296+0000 7fb31cbf8640 1 -- 172.21.15.179:0/2673022064 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb3180c98f0 msgr2=0x7fb318151eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:58:42.296 INFO:teuthology.orchestra.run.smithi179.stderr:2023-11-28T19:58:42.296+0000 7fb31cbf8640 1 --2- 172.21.15.179:0/2673022064 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb3180c98f0 0x7fb318151eb0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fb310009d90 tx=0x7fb31001c920 comp rx=0 tx=0).stop 2023-11-28T19:58:42.296 INFO:teuthology.orchestra.run.smithi179.stderr:2023-11-28T19:58:42.296+0000 7fb31cbf8640 1 -- 172.21.15.179:0/2673022064 shutdown_connections 2023-11-28T19:58:42.296 INFO:teuthology.orchestra.run.smithi179.stderr:2023-11-28T19:58:42.296+0000 7fb31cbf8640 1 --2- 172.21.15.179:0/2673022064 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb3180c98f0 0x7fb318151eb0 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:58:42.296 INFO:teuthology.orchestra.run.smithi179.stderr:2023-11-28T19:58:42.296+0000 7fb31cbf8640 1 --2- 172.21.15.179:0/2673022064 >> v2:172.21.15.78:3300/0 conn(0x7fb3180bf2d0 0x7fb318151970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:58:42.296 INFO:teuthology.orchestra.run.smithi179.stderr:2023-11-28T19:58:42.296+0000 7fb31cbf8640 1 -- 172.21.15.179:0/2673022064 >> 172.21.15.179:0/2673022064 conn(0x7fb3180c9dc0 msgr2=0x7fb3180ca1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T19:58:42.296 INFO:teuthology.orchestra.run.smithi179.stderr:2023-11-28T19:58:42.296+0000 7fb31cbf8640 1 -- 172.21.15.179:0/2673022064 shutdown_connections 2023-11-28T19:58:42.296 INFO:teuthology.orchestra.run.smithi179.stderr:2023-11-28T19:58:42.296+0000 7fb31cbf8640 1 -- 172.21.15.179:0/2673022064 wait complete. 2023-11-28T19:58:42.297 INFO:teuthology.orchestra.run.smithi179.stderr:2023-11-28T19:58:42.296+0000 7fb31cbf8640 1 Processor -- start 2023-11-28T19:58:42.297 INFO:teuthology.orchestra.run.smithi179.stderr:2023-11-28T19:58:42.296+0000 7fb31cbf8640 1 -- start start 2023-11-28T19:58:42.300 INFO:teuthology.orchestra.run.smithi179.stderr:2023-11-28T19:58:42.296+0000 7fb31cbf8640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb3180bf2d0 0x7fb3181ed8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:58:42.300 INFO:teuthology.orchestra.run.smithi179.stderr:2023-11-28T19:58:42.296+0000 7fb31cbf8640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb3180c6030 0x7fb31814b790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:58:42.300 INFO:teuthology.orchestra.run.smithi179.stderr:2023-11-28T19:58:42.296+0000 7fb31cbf8640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb3180c98f0 0x7fb31806b0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:58:42.300 INFO:teuthology.orchestra.run.smithi179.stderr:2023-11-28T19:58:42.296+0000 7fb31cbf8640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3181eddf0 con 0x7fb3180c6030 2023-11-28T19:58:42.300 INFO:teuthology.orchestra.run.smithi179.stderr:2023-11-28T19:58:42.296+0000 7fb31cbf8640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb31806bd60 con 0x7fb3180bf2d0 2023-11-28T19:58:42.301 INFO:teuthology.orchestra.run.smithi179.stderr:2023-11-28T19:58:42.296+0000 7fb31cbf8640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb31806c040 con 0x7fb3180c98f0 2023-11-28T19:58:42.301 INFO:teuthology.orchestra.run.smithi179.stderr:2023-11-28T19:58:42.296+0000 7fb31659c640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb3180bf2d0 0x7fb3181ed8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:58:42.301 INFO:teuthology.orchestra.run.smithi179.stderr:2023-11-28T19:58:42.296+0000 7fb316d9d640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb3180c98f0 0x7fb31806b0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:58:42.301 INFO:teuthology.orchestra.run.smithi179.stderr:2023-11-28T19:58:42.296+0000 7fb316d9d640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb3180c98f0 0x7fb31806b0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3301/0 says I am v2:172.21.15.179:40164/0 (socket says 172.21.15.179:40164) 2023-11-28T19:58:42.301 INFO:teuthology.orchestra.run.smithi179.stderr:2023-11-28T19:58:42.296+0000 7fb316d9d640 1 -- 172.21.15.179:0/1746908315 learned_addr learned my addr 172.21.15.179:0/1746908315 (peer_addr_for_me v2:172.21.15.179:0/0) 2023-11-28T19:58:42.301 INFO:teuthology.orchestra.run.smithi179.stderr:2023-11-28T19:58:42.296+0000 7fb31659c640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb3180bf2d0 0x7fb3181ed8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.179:44300/0 (socket says 172.21.15.179:44300) 2023-11-28T19:58:42.301 INFO:teuthology.orchestra.run.smithi179.stderr:2023-11-28T19:58:42.296+0000 7fb315d9b640 1 --2- 172.21.15.179:0/1746908315 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb3180c6030 0x7fb31814b790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:58:42.301 INFO:teuthology.orchestra.run.smithi179.stderr:2023-11-28T19:58:42.300+0000 7fb31659c640 1 -- 172.21.15.179:0/1746908315 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb3180c98f0 msgr2=0x7fb31806b0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:58:42.301 INFO:teuthology.orchestra.run.smithi179.stderr:2023-11-28T19:58:42.300+0000 7fb31659c640 1 --2- 172.21.15.179:0/1746908315 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb3180c98f0 0x7fb31806b0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:58:42.301 INFO:teuthology.orchestra.run.smithi179.stderr:2023-11-28T19:58:42.300+0000 7fb31659c640 1 -- 172.21.15.179:0/1746908315 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb3180c6030 msgr2=0x7fb31814b790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:58:42.301 INFO:teuthology.orchestra.run.smithi179.stderr:2023-11-28T19:58:42.300+0000 7fb31659c640 1 --2- 172.21.15.179:0/1746908315 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb3180c6030 0x7fb31814b790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:58:42.301 INFO:teuthology.orchestra.run.smithi179.stderr:2023-11-28T19:58:42.300+0000 7fb31659c640 1 -- 172.21.15.179:0/1746908315 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb310009a70 con 0x7fb3180bf2d0 2023-11-28T19:58:42.302 INFO:teuthology.orchestra.run.smithi179.stderr:2023-11-28T19:58:42.300+0000 7fb316d9d640 1 --2- 172.21.15.179:0/1746908315 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb3180c98f0 0x7fb31806b0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T19:58:42.302 INFO:teuthology.orchestra.run.smithi179.stderr:2023-11-28T19:58:42.300+0000 7fb315d9b640 1 --2- 172.21.15.179:0/1746908315 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb3180c6030 0x7fb31814b790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T19:58:42.302 INFO:teuthology.orchestra.run.smithi179.stderr:2023-11-28T19:58:42.300+0000 7fb31659c640 1 --2- 172.21.15.179:0/1746908315 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb3180bf2d0 0x7fb3181ed8b0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fb30800e870 tx=0x7fb30800ed30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:58:42.302 INFO:teuthology.orchestra.run.smithi179.stderr:2023-11-28T19:58:42.300+0000 7fb306ffd640 1 -- 172.21.15.179:0/1746908315 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3080095d0 con 0x7fb3180bf2d0 2023-11-28T19:58:42.302 INFO:teuthology.orchestra.run.smithi179.stderr:2023-11-28T19:58:42.300+0000 7fb306ffd640 1 -- 172.21.15.179:0/1746908315 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb30800c940 con 0x7fb3180bf2d0 2023-11-28T19:58:42.302 INFO:teuthology.orchestra.run.smithi179.stderr:2023-11-28T19:58:42.300+0000 7fb306ffd640 1 -- 172.21.15.179:0/1746908315 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb30800ccb0 con 0x7fb3180bf2d0 2023-11-28T19:58:42.302 INFO:teuthology.orchestra.run.smithi179.stderr:2023-11-28T19:58:42.300+0000 7fb31cbf8640 1 -- 172.21.15.179:0/1746908315 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb31806c320 con 0x7fb3180bf2d0 2023-11-28T19:58:42.302 INFO:teuthology.orchestra.run.smithi179.stderr:2023-11-28T19:58:42.300+0000 7fb31cbf8640 1 -- 172.21.15.179:0/1746908315 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb31806aba0 con 0x7fb3180bf2d0 2023-11-28T19:58:42.302 INFO:teuthology.orchestra.run.smithi179.stderr:2023-11-28T19:58:42.300+0000 7fb306ffd640 1 -- 172.21.15.179:0/1746908315 <== mon.1 v2:172.21.15.179:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fb308005ca0 con 0x7fb3180bf2d0 2023-11-28T19:58:42.302 INFO:teuthology.orchestra.run.smithi179.stderr:2023-11-28T19:58:42.300+0000 7fb306ffd640 1 -- 172.21.15.179:0/1746908315 <== mon.1 v2:172.21.15.179:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 955+0+0 (secure 0 0 0) 0x7fb308006890 con 0x7fb3180bf2d0 2023-11-28T19:58:42.303 INFO:teuthology.orchestra.run.smithi179.stderr:2023-11-28T19:58:42.300+0000 7fb31cbf8640 1 -- 172.21.15.179:0/1746908315 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb31806ad60 con 0x7fb3180bf2d0 2023-11-28T19:58:42.303 INFO:teuthology.orchestra.run.smithi179.stderr:2023-11-28T19:58:42.304+0000 7fb306ffd640 1 -- 172.21.15.179:0/1746908315 <== mon.1 v2:172.21.15.179:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72898 (secure 0 0 0) 0x7fb308021060 con 0x7fb3180bf2d0 2023-11-28T19:58:42.370 INFO:teuthology.orchestra.run.smithi179.stderr:2023-11-28T19:58:42.368+0000 7fb31cbf8640 1 -- 172.21.15.179:0/1746908315 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "osd new", "uuid": "274c8395-6534-41f0-b8fb-a00af8985aa8", "id": 2} v 0) v1 -- 0x7fb318067630 con 0x7fb3180bf2d0 2023-11-28T19:58:42.376 INFO:teuthology.orchestra.run.smithi179.stderr:2023-11-28T19:58:42.376+0000 7fb306ffd640 1 -- 172.21.15.179:0/1746908315 <== mon.1 v2:172.21.15.179:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "274c8395-6534-41f0-b8fb-a00af8985aa8", "id": 2}]=0 v5) v1 ==== 112+0+2 (secure 0 0 0) 0x7fb308029020 con 0x7fb3180bf2d0 2023-11-28T19:58:42.377 INFO:teuthology.orchestra.run.smithi179.stdout:2 2023-11-28T19:58:42.378 INFO:teuthology.orchestra.run.smithi179.stderr:2023-11-28T19:58:42.376+0000 7fb31cbf8640 1 -- 172.21.15.179:0/1746908315 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb3180bf2d0 msgr2=0x7fb3181ed8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:58:42.378 INFO:teuthology.orchestra.run.smithi179.stderr:2023-11-28T19:58:42.376+0000 7fb31cbf8640 1 --2- 172.21.15.179:0/1746908315 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb3180bf2d0 0x7fb3181ed8b0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fb30800e870 tx=0x7fb30800ed30 comp rx=0 tx=0).stop 2023-11-28T19:58:42.378 INFO:teuthology.orchestra.run.smithi179.stderr:2023-11-28T19:58:42.376+0000 7fb31cbf8640 1 -- 172.21.15.179:0/1746908315 shutdown_connections 2023-11-28T19:58:42.378 INFO:teuthology.orchestra.run.smithi179.stderr:2023-11-28T19:58:42.376+0000 7fb31cbf8640 1 --2- 172.21.15.179:0/1746908315 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb3180c98f0 0x7fb31806b0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:58:42.378 INFO:teuthology.orchestra.run.smithi179.stderr:2023-11-28T19:58:42.376+0000 7fb31cbf8640 1 --2- 172.21.15.179:0/1746908315 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb3180c6030 0x7fb31814b790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:58:42.378 INFO:teuthology.orchestra.run.smithi179.stderr:2023-11-28T19:58:42.376+0000 7fb31cbf8640 1 --2- 172.21.15.179:0/1746908315 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb3180bf2d0 0x7fb3181ed8b0 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:58:42.378 INFO:teuthology.orchestra.run.smithi179.stderr:2023-11-28T19:58:42.376+0000 7fb31cbf8640 1 -- 172.21.15.179:0/1746908315 >> 172.21.15.179:0/1746908315 conn(0x7fb3180c9dc0 msgr2=0x7fb318150da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T19:58:42.378 INFO:teuthology.orchestra.run.smithi179.stderr:2023-11-28T19:58:42.376+0000 7fb31cbf8640 1 -- 172.21.15.179:0/1746908315 shutdown_connections 2023-11-28T19:58:42.378 INFO:teuthology.orchestra.run.smithi179.stderr:2023-11-28T19:58:42.376+0000 7fb31cbf8640 1 -- 172.21.15.179:0/1746908315 wait complete. 2023-11-28T19:58:42.397 DEBUG:teuthology.orchestra.run.smithi179:> sudo ceph --cluster ceph osd new 77acc9af-7d4d-4b18-8cf5-d62f5971b7c8 3 2023-11-28T19:58:42.532 INFO:teuthology.orchestra.run.smithi179.stderr:2023-11-28T19:58:42.532+0000 7f07a2632640 1 Processor -- start 2023-11-28T19:58:42.532 INFO:teuthology.orchestra.run.smithi179.stderr:2023-11-28T19:58:42.532+0000 7f07a2632640 1 -- start start 2023-11-28T19:58:42.534 INFO:teuthology.orchestra.run.smithi179.stderr:2023-11-28T19:58:42.532+0000 7f07a2632640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f079c0bf2d0 0x7f079c151970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:58:42.535 INFO:teuthology.orchestra.run.smithi179.stderr:2023-11-28T19:58:42.532+0000 7f07a2632640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f079c0c6030 0x7f079c151eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:58:42.535 INFO:teuthology.orchestra.run.smithi179.stderr:2023-11-28T19:58:42.532+0000 7f07a2632640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f079c0c98f0 0x7f079c0c7cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:58:42.535 INFO:teuthology.orchestra.run.smithi179.stderr:2023-11-28T19:58:42.532+0000 7f07a2632640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f079c0c0300 con 0x7f079c0c6030 2023-11-28T19:58:42.535 INFO:teuthology.orchestra.run.smithi179.stderr:2023-11-28T19:58:42.532+0000 7f07a2632640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f079c158780 con 0x7f079c0c98f0 2023-11-28T19:58:42.535 INFO:teuthology.orchestra.run.smithi179.stderr:2023-11-28T19:58:42.532+0000 7f07a2632640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f079c157b70 con 0x7f079c0bf2d0 2023-11-28T19:58:42.535 INFO:teuthology.orchestra.run.smithi179.stderr:2023-11-28T19:58:42.532+0000 7f079bfff640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f079c0bf2d0 0x7f079c151970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:58:42.535 INFO:teuthology.orchestra.run.smithi179.stderr:2023-11-28T19:58:42.532+0000 7f079bfff640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f079c0bf2d0 0x7f079c151970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3301/0 says I am v2:172.21.15.179:40168/0 (socket says 172.21.15.179:40168) 2023-11-28T19:58:42.535 INFO:teuthology.orchestra.run.smithi179.stderr:2023-11-28T19:58:42.532+0000 7f079bfff640 1 -- 172.21.15.179:0/2718148397 learned_addr learned my addr 172.21.15.179:0/2718148397 (peer_addr_for_me v2:172.21.15.179:0/0) 2023-11-28T19:58:42.535 INFO:teuthology.orchestra.run.smithi179.stderr:2023-11-28T19:58:42.532+0000 7f07a0bcf640 1 --2- 172.21.15.179:0/2718148397 >> v2:172.21.15.179:3300/0 conn(0x7f079c0c98f0 0x7f079c0c7cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:58:42.536 INFO:teuthology.orchestra.run.smithi179.stderr:2023-11-28T19:58:42.532+0000 7f079b7fe640 1 --2- 172.21.15.179:0/2718148397 >> v2:172.21.15.78:3300/0 conn(0x7f079c0c6030 0x7f079c151eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:58:42.536 INFO:teuthology.orchestra.run.smithi179.stderr:2023-11-28T19:58:42.532+0000 7f079bfff640 1 -- 172.21.15.179:0/2718148397 >> v2:172.21.15.179:3300/0 conn(0x7f079c0c98f0 msgr2=0x7f079c0c7cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T19:58:42.536 INFO:teuthology.orchestra.run.smithi179.stderr:2023-11-28T19:58:42.532+0000 7f079bfff640 1 --2- 172.21.15.179:0/2718148397 >> v2:172.21.15.179:3300/0 conn(0x7f079c0c98f0 0x7f079c0c7cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:58:42.536 INFO:teuthology.orchestra.run.smithi179.stderr:2023-11-28T19:58:42.532+0000 7f079bfff640 1 -- 172.21.15.179:0/2718148397 >> v2:172.21.15.78:3300/0 conn(0x7f079c0c6030 msgr2=0x7f079c151eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T19:58:42.536 INFO:teuthology.orchestra.run.smithi179.stderr:2023-11-28T19:58:42.532+0000 7f079bfff640 1 --2- 172.21.15.179:0/2718148397 >> v2:172.21.15.78:3300/0 conn(0x7f079c0c6030 0x7f079c151eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:58:42.537 INFO:teuthology.orchestra.run.smithi179.stderr:2023-11-28T19:58:42.532+0000 7f079bfff640 1 -- 172.21.15.179:0/2718148397 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f079c157e50 con 0x7f079c0bf2d0 2023-11-28T19:58:42.537 INFO:teuthology.orchestra.run.smithi179.stderr:2023-11-28T19:58:42.536+0000 7f079bfff640 1 --2- 172.21.15.179:0/2718148397 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f079c0bf2d0 0x7f079c151970 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f079c0c6740 tx=0x7f078c01c410 comp rx=0 tx=0).ready entity=mon.2 client_cookie=63c531debf86f466 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:58:42.538 INFO:teuthology.orchestra.run.smithi179.stderr:2023-11-28T19:58:42.536+0000 7f079affd640 1 -- 172.21.15.179:0/2718148397 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f078c0ac630 con 0x7f079c0bf2d0 2023-11-28T19:58:42.538 INFO:teuthology.orchestra.run.smithi179.stderr:2023-11-28T19:58:42.536+0000 7f079affd640 1 -- 172.21.15.179:0/2718148397 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f078c0ac790 con 0x7f079c0bf2d0 2023-11-28T19:58:42.538 INFO:teuthology.orchestra.run.smithi179.stderr:2023-11-28T19:58:42.536+0000 7f079affd640 1 -- 172.21.15.179:0/2718148397 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f078c0acb20 con 0x7f079c0bf2d0 2023-11-28T19:58:42.545 INFO:teuthology.orchestra.run.smithi179.stderr:2023-11-28T19:58:42.536+0000 7f07a2632640 1 -- 172.21.15.179:0/2718148397 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f079c0bf2d0 msgr2=0x7f079c151970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:58:42.545 INFO:teuthology.orchestra.run.smithi179.stderr:2023-11-28T19:58:42.536+0000 7f07a2632640 1 --2- 172.21.15.179:0/2718148397 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f079c0bf2d0 0x7f079c151970 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f079c0c6740 tx=0x7f078c01c410 comp rx=0 tx=0).stop 2023-11-28T19:58:42.545 INFO:teuthology.orchestra.run.smithi179.stderr:2023-11-28T19:58:42.536+0000 7f07a2632640 1 -- 172.21.15.179:0/2718148397 shutdown_connections 2023-11-28T19:58:42.545 INFO:teuthology.orchestra.run.smithi179.stderr:2023-11-28T19:58:42.536+0000 7f07a2632640 1 --2- 172.21.15.179:0/2718148397 >> v2:172.21.15.179:3300/0 conn(0x7f079c0c98f0 0x7f079c0c7cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:58:42.545 INFO:teuthology.orchestra.run.smithi179.stderr:2023-11-28T19:58:42.536+0000 7f07a2632640 1 --2- 172.21.15.179:0/2718148397 >> v2:172.21.15.78:3300/0 conn(0x7f079c0c6030 0x7f079c151eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:58:42.545 INFO:teuthology.orchestra.run.smithi179.stderr:2023-11-28T19:58:42.536+0000 7f07a2632640 1 --2- 172.21.15.179:0/2718148397 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f079c0bf2d0 0x7f079c151970 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:58:42.545 INFO:teuthology.orchestra.run.smithi179.stderr:2023-11-28T19:58:42.536+0000 7f07a2632640 1 -- 172.21.15.179:0/2718148397 >> 172.21.15.179:0/2718148397 conn(0x7f079c0c9dc0 msgr2=0x7f079c0ca1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T19:58:42.545 INFO:teuthology.orchestra.run.smithi179.stderr:2023-11-28T19:58:42.536+0000 7f07a2632640 1 -- 172.21.15.179:0/2718148397 shutdown_connections 2023-11-28T19:58:42.545 INFO:teuthology.orchestra.run.smithi179.stderr:2023-11-28T19:58:42.536+0000 7f07a2632640 1 -- 172.21.15.179:0/2718148397 wait complete. 2023-11-28T19:58:42.545 INFO:teuthology.orchestra.run.smithi179.stderr:2023-11-28T19:58:42.540+0000 7f07a2632640 1 Processor -- start 2023-11-28T19:58:42.546 INFO:teuthology.orchestra.run.smithi179.stderr:2023-11-28T19:58:42.540+0000 7f07a2632640 1 -- start start 2023-11-28T19:58:42.546 INFO:teuthology.orchestra.run.smithi179.stderr:2023-11-28T19:58:42.540+0000 7f07a2632640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f079c0bf2d0 0x7f079c0aae90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:58:42.546 INFO:teuthology.orchestra.run.smithi179.stderr:2023-11-28T19:58:42.540+0000 7f07a2632640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f079c0c6030 0x7f079c148060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:58:42.546 INFO:teuthology.orchestra.run.smithi179.stderr:2023-11-28T19:58:42.540+0000 7f07a2632640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f079c0c98f0 0x7f079c1485a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:58:42.546 INFO:teuthology.orchestra.run.smithi179.stderr:2023-11-28T19:58:42.540+0000 7f07a2632640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f079c06a810 con 0x7f079c0bf2d0 2023-11-28T19:58:42.546 INFO:teuthology.orchestra.run.smithi179.stderr:2023-11-28T19:58:42.540+0000 7f07a2632640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f079c1f00e0 con 0x7f079c0c98f0 2023-11-28T19:58:42.546 INFO:teuthology.orchestra.run.smithi179.stderr:2023-11-28T19:58:42.540+0000 7f07a2632640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f079c1f03c0 con 0x7f079c0c6030 2023-11-28T19:58:42.546 INFO:teuthology.orchestra.run.smithi179.stderr:2023-11-28T19:58:42.540+0000 7f07a0bcf640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f079c0c98f0 0x7f079c1485a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:58:42.546 INFO:teuthology.orchestra.run.smithi179.stderr:2023-11-28T19:58:42.540+0000 7f079b7fe640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f079c0c6030 0x7f079c148060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:58:42.546 INFO:teuthology.orchestra.run.smithi179.stderr:2023-11-28T19:58:42.540+0000 7f07a0bcf640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f079c0c98f0 0x7f079c1485a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.179:44320/0 (socket says 172.21.15.179:44320) 2023-11-28T19:58:42.546 INFO:teuthology.orchestra.run.smithi179.stderr:2023-11-28T19:58:42.540+0000 7f07a0bcf640 1 -- 172.21.15.179:0/4198369747 learned_addr learned my addr 172.21.15.179:0/4198369747 (peer_addr_for_me v2:172.21.15.179:0/0) 2023-11-28T19:58:42.547 INFO:teuthology.orchestra.run.smithi179.stderr:2023-11-28T19:58:42.540+0000 7f079bfff640 1 --2- 172.21.15.179:0/4198369747 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f079c0bf2d0 0x7f079c0aae90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:58:42.547 INFO:teuthology.orchestra.run.smithi179.stderr:2023-11-28T19:58:42.540+0000 7f079b7fe640 1 -- 172.21.15.179:0/4198369747 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f079c0c98f0 msgr2=0x7f079c1485a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:58:42.547 INFO:teuthology.orchestra.run.smithi179.stderr:2023-11-28T19:58:42.540+0000 7f079b7fe640 1 --2- 172.21.15.179:0/4198369747 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f079c0c98f0 0x7f079c1485a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:58:42.547 INFO:teuthology.orchestra.run.smithi179.stderr:2023-11-28T19:58:42.540+0000 7f079b7fe640 1 -- 172.21.15.179:0/4198369747 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f079c0bf2d0 msgr2=0x7f079c0aae90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:58:42.547 INFO:teuthology.orchestra.run.smithi179.stderr:2023-11-28T19:58:42.540+0000 7f079b7fe640 1 --2- 172.21.15.179:0/4198369747 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f079c0bf2d0 0x7f079c0aae90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:58:42.547 INFO:teuthology.orchestra.run.smithi179.stderr:2023-11-28T19:58:42.540+0000 7f079b7fe640 1 -- 172.21.15.179:0/4198369747 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f078c0094d0 con 0x7f079c0c6030 2023-11-28T19:58:42.547 INFO:teuthology.orchestra.run.smithi179.stderr:2023-11-28T19:58:42.540+0000 7f07a0bcf640 1 --2- 172.21.15.179:0/4198369747 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f079c0c98f0 0x7f079c1485a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T19:58:42.547 INFO:teuthology.orchestra.run.smithi179.stderr:2023-11-28T19:58:42.540+0000 7f079b7fe640 1 --2- 172.21.15.179:0/4198369747 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f079c0c6030 0x7f079c148060 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f079000e870 tx=0x7f079000ed30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:58:42.547 INFO:teuthology.orchestra.run.smithi179.stderr:2023-11-28T19:58:42.540+0000 7f0798ff9640 1 -- 172.21.15.179:0/4198369747 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07900095d0 con 0x7f079c0c6030 2023-11-28T19:58:42.547 INFO:teuthology.orchestra.run.smithi179.stderr:2023-11-28T19:58:42.540+0000 7f0798ff9640 1 -- 172.21.15.179:0/4198369747 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f079000c940 con 0x7f079c0c6030 2023-11-28T19:58:42.547 INFO:teuthology.orchestra.run.smithi179.stderr:2023-11-28T19:58:42.540+0000 7f07a2632640 1 -- 172.21.15.179:0/4198369747 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f079c1f06a0 con 0x7f079c0c6030 2023-11-28T19:58:42.548 INFO:teuthology.orchestra.run.smithi179.stderr:2023-11-28T19:58:42.540+0000 7f0798ff9640 1 -- 172.21.15.179:0/4198369747 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f079000ccb0 con 0x7f079c0c6030 2023-11-28T19:58:42.548 INFO:teuthology.orchestra.run.smithi179.stderr:2023-11-28T19:58:42.544+0000 7f07a2632640 1 -- 172.21.15.179:0/4198369747 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f079c1f0c60 con 0x7f079c0c6030 2023-11-28T19:58:42.548 INFO:teuthology.orchestra.run.smithi179.stderr:2023-11-28T19:58:42.544+0000 7f0798ff9640 1 -- 172.21.15.179:0/4198369747 <== mon.2 v2:172.21.15.179:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f0790005ca0 con 0x7f079c0c6030 2023-11-28T19:58:42.548 INFO:teuthology.orchestra.run.smithi179.stderr:2023-11-28T19:58:42.544+0000 7f0798ff9640 1 -- 172.21.15.179:0/4198369747 <== mon.2 v2:172.21.15.179:3301/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1070+0+0 (secure 0 0 0) 0x7f07900064b0 con 0x7f079c0c6030 2023-11-28T19:58:42.548 INFO:teuthology.orchestra.run.smithi179.stderr:2023-11-28T19:58:42.544+0000 7f07a2632640 1 -- 172.21.15.179:0/4198369747 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f079c067630 con 0x7f079c0c6030 2023-11-28T19:58:42.548 INFO:teuthology.orchestra.run.smithi179.stderr:2023-11-28T19:58:42.544+0000 7f0798ff9640 1 -- 172.21.15.179:0/4198369747 <== mon.2 v2:172.21.15.179:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72898 (secure 0 0 0) 0x7f0790021060 con 0x7f079c0c6030 2023-11-28T19:58:42.603 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-11-28T19:58:42.601+0000 7f9ab524d180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-11-28T19:58:42.611 INFO:teuthology.orchestra.run.smithi179.stderr:2023-11-28T19:58:42.612+0000 7f07a2632640 1 -- 172.21.15.179:0/4198369747 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_command({"prefix": "osd new", "uuid": "77acc9af-7d4d-4b18-8cf5-d62f5971b7c8", "id": 3} v 0) v1 -- 0x7f079c151da0 con 0x7f079c0c6030 2023-11-28T19:58:42.617 INFO:teuthology.orchestra.run.smithi179.stderr:2023-11-28T19:58:42.616+0000 7f0798ff9640 1 -- 172.21.15.179:0/4198369747 <== mon.2 v2:172.21.15.179:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "77acc9af-7d4d-4b18-8cf5-d62f5971b7c8", "id": 3}]=0 v6) v1 ==== 112+0+2 (secure 0 0 0) 0x7f0790029020 con 0x7f079c0c6030 2023-11-28T19:58:42.617 INFO:teuthology.orchestra.run.smithi179.stdout:3 2023-11-28T19:58:42.618 INFO:teuthology.orchestra.run.smithi179.stderr:2023-11-28T19:58:42.616+0000 7f07a2632640 1 -- 172.21.15.179:0/4198369747 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f079c0c6030 msgr2=0x7f079c148060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:58:42.618 INFO:teuthology.orchestra.run.smithi179.stderr:2023-11-28T19:58:42.616+0000 7f07a2632640 1 --2- 172.21.15.179:0/4198369747 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f079c0c6030 0x7f079c148060 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f079000e870 tx=0x7f079000ed30 comp rx=0 tx=0).stop 2023-11-28T19:58:42.619 INFO:teuthology.orchestra.run.smithi179.stderr:2023-11-28T19:58:42.616+0000 7f07a2632640 1 -- 172.21.15.179:0/4198369747 shutdown_connections 2023-11-28T19:58:42.619 INFO:teuthology.orchestra.run.smithi179.stderr:2023-11-28T19:58:42.616+0000 7f07a2632640 1 --2- 172.21.15.179:0/4198369747 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f079c0c6030 0x7f079c148060 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:58:42.619 INFO:teuthology.orchestra.run.smithi179.stderr:2023-11-28T19:58:42.616+0000 7f07a2632640 1 --2- 172.21.15.179:0/4198369747 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f079c0c98f0 0x7f079c1485a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:58:42.619 INFO:teuthology.orchestra.run.smithi179.stderr:2023-11-28T19:58:42.616+0000 7f07a2632640 1 --2- 172.21.15.179:0/4198369747 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f079c0bf2d0 0x7f079c0aae90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:58:42.620 INFO:teuthology.orchestra.run.smithi179.stderr:2023-11-28T19:58:42.616+0000 7f07a2632640 1 -- 172.21.15.179:0/4198369747 >> 172.21.15.179:0/4198369747 conn(0x7f079c0c9dc0 msgr2=0x7f079c14fea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T19:58:42.620 INFO:teuthology.orchestra.run.smithi179.stderr:2023-11-28T19:58:42.616+0000 7f07a2632640 1 -- 172.21.15.179:0/4198369747 shutdown_connections 2023-11-28T19:58:42.620 INFO:teuthology.orchestra.run.smithi179.stderr:2023-11-28T19:58:42.616+0000 7f07a2632640 1 -- 172.21.15.179:0/4198369747 wait complete. 2023-11-28T19:58:42.637 DEBUG:teuthology.orchestra.run.smithi179:> sudo ceph --cluster ceph osd new 5c62bc66-6b34-4b7f-a66b-9a743969138c 4 2023-11-28T19:58:42.666 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-11-28T19:58:42.665+0000 7f9ab524d180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-11-28T19:58:42.726 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-11-28T19:58:42.725+0000 7f9ab524d180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-11-28T19:58:42.767 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-11-28T19:58:42.764+0000 7f8ad3634180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-11-28T19:58:42.774 INFO:teuthology.orchestra.run.smithi179.stderr:2023-11-28T19:58:42.772+0000 7f5a2b365640 1 Processor -- start 2023-11-28T19:58:42.775 INFO:teuthology.orchestra.run.smithi179.stderr:2023-11-28T19:58:42.776+0000 7f5a2b365640 1 -- start start 2023-11-28T19:58:42.776 INFO:teuthology.orchestra.run.smithi179.stderr:2023-11-28T19:58:42.776+0000 7f5a2b365640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5a240bf2d0 0x7f5a24151970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:58:42.776 INFO:teuthology.orchestra.run.smithi179.stderr:2023-11-28T19:58:42.776+0000 7f5a2b365640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5a24158780 con 0x7f5a240c6030 2023-11-28T19:58:42.776 INFO:teuthology.orchestra.run.smithi179.stderr:2023-11-28T19:58:42.776+0000 7f5a2b365640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5a24157b70 con 0x7f5a240c98f0 2023-11-28T19:58:42.777 INFO:teuthology.orchestra.run.smithi179.stderr:2023-11-28T19:58:42.776+0000 7f5a2b365640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5a240c0300 con 0x7f5a240bf2d0 2023-11-28T19:58:42.777 INFO:teuthology.orchestra.run.smithi179.stderr:2023-11-28T19:58:42.776+0000 7f5a29101640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5a240bf2d0 0x7f5a24151970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:58:42.777 INFO:teuthology.orchestra.run.smithi179.stderr:2023-11-28T19:58:42.776+0000 7f5a29902640 1 --1- >> v1:172.21.15.179:6789/0 conn(0x7f5a240c98f0 0x7f5a2415ef00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.179:6789/0 says I am v1:172.21.15.179:38176/0 (socket says 172.21.15.179:38176) 2023-11-28T19:58:42.777 INFO:teuthology.orchestra.run.smithi179.stderr:2023-11-28T19:58:42.776+0000 7f5a29902640 1 -- 172.21.15.179:0/3087742674 learned_addr learned my addr 172.21.15.179:0/3087742674 (peer_addr_for_me v1:172.21.15.179:0/0) 2023-11-28T19:58:42.778 INFO:teuthology.orchestra.run.smithi179.stderr:2023-11-28T19:58:42.776+0000 7f5a1bfff640 1 -- 172.21.15.179:0/3087742674 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 52396992 0 0) 0x7f5a24157b70 con 0x7f5a240c98f0 2023-11-28T19:58:42.778 INFO:teuthology.orchestra.run.smithi179.stderr:2023-11-28T19:58:42.776+0000 7f5a29101640 1 -- 172.21.15.179:0/3087742674 >> v1:172.21.15.179:6789/0 conn(0x7f5a240c98f0 legacy=0x7f5a2415ef00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:58:42.778 INFO:teuthology.orchestra.run.smithi179.stderr:2023-11-28T19:58:42.776+0000 7f5a29101640 1 -- 172.21.15.179:0/3087742674 >> v1:172.21.15.78:6789/0 conn(0x7f5a240c6030 legacy=0x7f5a240c7cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:58:42.778 INFO:teuthology.orchestra.run.smithi179.stderr:2023-11-28T19:58:42.776+0000 7f5a29101640 1 -- 172.21.15.179:0/3087742674 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a24157e50 con 0x7f5a240bf2d0 2023-11-28T19:58:42.780 INFO:teuthology.orchestra.run.smithi179.stderr:2023-11-28T19:58:42.780+0000 7f5a29101640 1 --2- 172.21.15.179:0/3087742674 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5a240bf2d0 0x7f5a24151970 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f5a200097f0 tx=0x7f5a2001c490 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3d44b1385c8be5fa server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:58:42.780 INFO:teuthology.orchestra.run.smithi179.stderr:2023-11-28T19:58:42.780+0000 7f5a1bfff640 1 -- 172.21.15.179:0/3087742674 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a200ac600 con 0x7f5a240bf2d0 2023-11-28T19:58:42.780 INFO:teuthology.orchestra.run.smithi179.stderr:2023-11-28T19:58:42.780+0000 7f5a1bfff640 1 -- 172.21.15.179:0/3087742674 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a200a8050 con 0x7f5a240bf2d0 2023-11-28T19:58:42.780 INFO:teuthology.orchestra.run.smithi179.stderr:2023-11-28T19:58:42.780+0000 7f5a1bfff640 1 -- 172.21.15.179:0/3087742674 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a200ac980 con 0x7f5a240bf2d0 2023-11-28T19:58:42.781 INFO:teuthology.orchestra.run.smithi179.stderr:2023-11-28T19:58:42.780+0000 7f5a2b365640 1 -- 172.21.15.179:0/3087742674 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5a240bf2d0 msgr2=0x7f5a24151970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:58:42.781 INFO:teuthology.orchestra.run.smithi179.stderr:2023-11-28T19:58:42.780+0000 7f5a2b365640 1 --2- 172.21.15.179:0/3087742674 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5a240bf2d0 0x7f5a24151970 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f5a200097f0 tx=0x7f5a2001c490 comp rx=0 tx=0).stop 2023-11-28T19:58:42.781 INFO:teuthology.orchestra.run.smithi179.stderr:2023-11-28T19:58:42.780+0000 7f5a2b365640 1 -- 172.21.15.179:0/3087742674 shutdown_connections 2023-11-28T19:58:42.781 INFO:teuthology.orchestra.run.smithi179.stderr:2023-11-28T19:58:42.780+0000 7f5a2b365640 1 --2- 172.21.15.179:0/3087742674 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5a240bf2d0 0x7f5a24151970 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:58:42.781 INFO:teuthology.orchestra.run.smithi179.stderr:2023-11-28T19:58:42.780+0000 7f5a2b365640 1 -- 172.21.15.179:0/3087742674 >> 172.21.15.179:0/3087742674 conn(0x7f5a240c9dc0 msgr2=0x7f5a240ca1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T19:58:42.781 INFO:teuthology.orchestra.run.smithi179.stderr:2023-11-28T19:58:42.780+0000 7f5a2b365640 1 -- 172.21.15.179:0/3087742674 shutdown_connections 2023-11-28T19:58:42.781 INFO:teuthology.orchestra.run.smithi179.stderr:2023-11-28T19:58:42.780+0000 7f5a2b365640 1 -- 172.21.15.179:0/3087742674 wait complete. 2023-11-28T19:58:42.782 INFO:teuthology.orchestra.run.smithi179.stderr:2023-11-28T19:58:42.780+0000 7f5a2b365640 1 Processor -- start 2023-11-28T19:58:42.782 INFO:teuthology.orchestra.run.smithi179.stderr:2023-11-28T19:58:42.780+0000 7f5a2b365640 1 -- start start 2023-11-28T19:58:42.785 INFO:teuthology.orchestra.run.smithi179.stderr:2023-11-28T19:58:42.784+0000 7f5a2b365640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5a240bf2d0 0x7f5a24156340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:58:42.785 INFO:teuthology.orchestra.run.smithi179.stderr:2023-11-28T19:58:42.784+0000 7f5a2b365640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5a240c6030 0x7f5a241487e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:58:42.785 INFO:teuthology.orchestra.run.smithi179.stderr:2023-11-28T19:58:42.784+0000 7f5a2b365640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5a240c98f0 0x7f5a241f06c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:58:42.785 INFO:teuthology.orchestra.run.smithi179.stderr:2023-11-28T19:58:42.784+0000 7f5a2b365640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a240aad20 con 0x7f5a240bf2d0 2023-11-28T19:58:42.785 INFO:teuthology.orchestra.run.smithi179.stderr:2023-11-28T19:58:42.784+0000 7f5a2b365640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a240c1940 con 0x7f5a240c98f0 2023-11-28T19:58:42.786 INFO:teuthology.orchestra.run.smithi179.stderr:2023-11-28T19:58:42.784+0000 7f5a2b365640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5a2414eec0 con 0x7f5a240c6030 2023-11-28T19:58:42.786 INFO:teuthology.orchestra.run.smithi179.stderr:2023-11-28T19:58:42.784+0000 7f5a29902640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5a240c98f0 0x7f5a241f06c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:58:42.786 INFO:teuthology.orchestra.run.smithi179.stderr:2023-11-28T19:58:42.784+0000 7f5a29101640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5a240bf2d0 0x7f5a24156340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:58:42.786 INFO:teuthology.orchestra.run.smithi179.stderr:2023-11-28T19:58:42.784+0000 7f5a29902640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5a240c98f0 0x7f5a241f06c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.179:44330/0 (socket says 172.21.15.179:44330) 2023-11-28T19:58:42.786 INFO:teuthology.orchestra.run.smithi179.stderr:2023-11-28T19:58:42.784+0000 7f5a29902640 1 -- 172.21.15.179:0/872317784 learned_addr learned my addr 172.21.15.179:0/872317784 (peer_addr_for_me v2:172.21.15.179:0/0) 2023-11-28T19:58:42.786 INFO:teuthology.orchestra.run.smithi179.stderr:2023-11-28T19:58:42.784+0000 7f5a29101640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5a240bf2d0 0x7f5a24156340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.179:37638/0 (socket says 172.21.15.179:37638) 2023-11-28T19:58:42.786 INFO:teuthology.orchestra.run.smithi179.stderr:2023-11-28T19:58:42.784+0000 7f5a28900640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5a240c6030 0x7f5a241487e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:58:42.786 INFO:teuthology.orchestra.run.smithi179.stderr:2023-11-28T19:58:42.784+0000 7f5a29902640 1 -- 172.21.15.179:0/872317784 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5a240c6030 msgr2=0x7f5a241487e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:58:42.787 INFO:teuthology.orchestra.run.smithi179.stderr:2023-11-28T19:58:42.784+0000 7f5a29902640 1 --2- 172.21.15.179:0/872317784 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5a240c6030 0x7f5a241487e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:58:42.787 INFO:teuthology.orchestra.run.smithi179.stderr:2023-11-28T19:58:42.784+0000 7f5a29902640 1 -- 172.21.15.179:0/872317784 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5a240bf2d0 msgr2=0x7f5a24156340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:58:42.787 INFO:teuthology.orchestra.run.smithi179.stderr:2023-11-28T19:58:42.784+0000 7f5a29902640 1 --2- 172.21.15.179:0/872317784 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5a240bf2d0 0x7f5a24156340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:58:42.787 INFO:teuthology.orchestra.run.smithi179.stderr:2023-11-28T19:58:42.784+0000 7f5a29902640 1 -- 172.21.15.179:0/872317784 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a20009420 con 0x7f5a240c98f0 2023-11-28T19:58:42.787 INFO:teuthology.orchestra.run.smithi179.stderr:2023-11-28T19:58:42.784+0000 7f5a29902640 1 --2- 172.21.15.179:0/872317784 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5a240c98f0 0x7f5a241f06c0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f5a1c00c780 tx=0x7f5a1c00cc40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:58:42.787 INFO:teuthology.orchestra.run.smithi179.stderr:2023-11-28T19:58:42.784+0000 7f5a19ffb640 1 -- 172.21.15.179:0/872317784 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a1c00ce90 con 0x7f5a240c98f0 2023-11-28T19:58:42.787 INFO:teuthology.orchestra.run.smithi179.stderr:2023-11-28T19:58:42.784+0000 7f5a19ffb640 1 -- 172.21.15.179:0/872317784 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a1c00a640 con 0x7f5a240c98f0 2023-11-28T19:58:42.787 INFO:teuthology.orchestra.run.smithi179.stderr:2023-11-28T19:58:42.784+0000 7f5a2b365640 1 -- 172.21.15.179:0/872317784 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5a2414c760 con 0x7f5a240c98f0 2023-11-28T19:58:42.788 INFO:teuthology.orchestra.run.smithi179.stderr:2023-11-28T19:58:42.784+0000 7f5a19ffb640 1 -- 172.21.15.179:0/872317784 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a1c00a9d0 con 0x7f5a240c98f0 2023-11-28T19:58:42.788 INFO:teuthology.orchestra.run.smithi179.stderr:2023-11-28T19:58:42.784+0000 7f5a19ffb640 1 -- 172.21.15.179:0/872317784 <== mon.1 v2:172.21.15.179:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f5a1c0070d0 con 0x7f5a240c98f0 2023-11-28T19:58:42.788 INFO:teuthology.orchestra.run.smithi179.stderr:2023-11-28T19:58:42.784+0000 7f5a2b365640 1 -- 172.21.15.179:0/872317784 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5a240c1c20 con 0x7f5a240c98f0 2023-11-28T19:58:42.788 INFO:teuthology.orchestra.run.smithi179.stderr:2023-11-28T19:58:42.784+0000 7f5a19ffb640 1 -- 172.21.15.179:0/872317784 <== mon.1 v2:172.21.15.179:3300/0 5 ==== osd_map(6..6 src has 1..6) v4 ==== 1185+0+0 (secure 0 0 0) 0x7f5a1c01c4f0 con 0x7f5a240c98f0 2023-11-28T19:58:42.788 INFO:teuthology.orchestra.run.smithi179.stderr:2023-11-28T19:58:42.784+0000 7f5a2b365640 1 -- 172.21.15.179:0/872317784 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5a24067630 con 0x7f5a240c98f0 2023-11-28T19:58:42.790 INFO:teuthology.orchestra.run.smithi179.stderr:2023-11-28T19:58:42.788+0000 7f5a19ffb640 1 -- 172.21.15.179:0/872317784 <== mon.1 v2:172.21.15.179:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72898 (secure 0 0 0) 0x7f5a1c018070 con 0x7f5a240c98f0 2023-11-28T19:58:42.814 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-11-28T19:58:42.813+0000 7f9ab524d180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-11-28T19:58:42.833 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-11-28T19:58:42.832+0000 7f8ad3634180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-11-28T19:58:42.856 INFO:teuthology.orchestra.run.smithi179.stderr:2023-11-28T19:58:42.856+0000 7f5a2b365640 1 -- 172.21.15.179:0/872317784 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "osd new", "uuid": "5c62bc66-6b34-4b7f-a66b-9a743969138c", "id": 4} v 0) v1 -- 0x7f5a2414f910 con 0x7f5a240c98f0 2023-11-28T19:58:42.863 INFO:teuthology.orchestra.run.smithi179.stderr:2023-11-28T19:58:42.864+0000 7f5a19ffb640 1 -- 172.21.15.179:0/872317784 <== mon.1 v2:172.21.15.179:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "5c62bc66-6b34-4b7f-a66b-9a743969138c", "id": 4}]=0 v7) v1 ==== 112+0+2 (secure 0 0 0) 0x7f5a1c0075b0 con 0x7f5a240c98f0 2023-11-28T19:58:42.864 INFO:teuthology.orchestra.run.smithi179.stdout:4 2023-11-28T19:58:42.865 INFO:teuthology.orchestra.run.smithi179.stderr:2023-11-28T19:58:42.864+0000 7f5a2b365640 1 -- 172.21.15.179:0/872317784 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5a240c98f0 msgr2=0x7f5a241f06c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:58:42.865 INFO:teuthology.orchestra.run.smithi179.stderr:2023-11-28T19:58:42.864+0000 7f5a2b365640 1 --2- 172.21.15.179:0/872317784 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5a240c98f0 0x7f5a241f06c0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f5a1c00c780 tx=0x7f5a1c00cc40 comp rx=0 tx=0).stop 2023-11-28T19:58:42.865 INFO:teuthology.orchestra.run.smithi179.stderr:2023-11-28T19:58:42.864+0000 7f5a2b365640 1 -- 172.21.15.179:0/872317784 shutdown_connections 2023-11-28T19:58:42.865 INFO:teuthology.orchestra.run.smithi179.stderr:2023-11-28T19:58:42.864+0000 7f5a2b365640 1 --2- 172.21.15.179:0/872317784 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5a240c6030 0x7f5a241487e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:58:42.865 INFO:teuthology.orchestra.run.smithi179.stderr:2023-11-28T19:58:42.864+0000 7f5a2b365640 1 --2- 172.21.15.179:0/872317784 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5a240c98f0 0x7f5a241f06c0 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:58:42.865 INFO:teuthology.orchestra.run.smithi179.stderr:2023-11-28T19:58:42.864+0000 7f5a2b365640 1 --2- 172.21.15.179:0/872317784 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5a240bf2d0 0x7f5a24156340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:58:42.865 INFO:teuthology.orchestra.run.smithi179.stderr:2023-11-28T19:58:42.864+0000 7f5a2b365640 1 -- 172.21.15.179:0/872317784 >> 172.21.15.179:0/872317784 conn(0x7f5a240c9dc0 msgr2=0x7f5a240a9860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T19:58:42.866 INFO:teuthology.orchestra.run.smithi179.stderr:2023-11-28T19:58:42.864+0000 7f5a2b365640 1 -- 172.21.15.179:0/872317784 shutdown_connections 2023-11-28T19:58:42.866 INFO:teuthology.orchestra.run.smithi179.stderr:2023-11-28T19:58:42.864+0000 7f5a2b365640 1 -- 172.21.15.179:0/872317784 wait complete. 2023-11-28T19:58:42.875 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-11-28T19:58:42.873+0000 7f9ab524d180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-11-28T19:58:42.884 DEBUG:teuthology.orchestra.run.smithi179:> sudo ceph --cluster ceph osd new 67db6d36-f684-4079-b0cd-82b4dd61461f 5 2023-11-28T19:58:42.898 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-11-28T19:58:42.896+0000 7f8ad3634180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-11-28T19:58:42.963 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-11-28T19:58:42.961+0000 7f9ab524d180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-11-28T19:58:42.990 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-11-28T19:58:42.988+0000 7f8ad3634180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-11-28T19:58:43.021 INFO:teuthology.orchestra.run.smithi179.stderr:2023-11-28T19:58:43.020+0000 7f7e8ed1e640 1 Processor -- start 2023-11-28T19:58:43.021 INFO:teuthology.orchestra.run.smithi179.stderr:2023-11-28T19:58:43.020+0000 7f7e8ed1e640 1 -- start start 2023-11-28T19:58:43.023 INFO:teuthology.orchestra.run.smithi179.stderr:2023-11-28T19:58:43.020+0000 7f7e8ed1e640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7e880ca330 0x7f7e880ca710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:58:43.023 INFO:teuthology.orchestra.run.smithi179.stderr:2023-11-28T19:58:43.020+0000 7f7e8ed1e640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f7e880c45a0 0x7f7e88154e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:58:43.023 INFO:teuthology.orchestra.run.smithi179.stderr:2023-11-28T19:58:43.020+0000 7f7e8ed1e640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f7e8806c480 0x7f7e880c7d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:58:43.024 INFO:teuthology.orchestra.run.smithi179.stderr:2023-11-28T19:58:43.020+0000 7f7e8ed1e640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7e880c54b0 con 0x7f7e8806c480 2023-11-28T19:58:43.024 INFO:teuthology.orchestra.run.smithi179.stderr:2023-11-28T19:58:43.020+0000 7f7e8ed1e640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7e88151e40 con 0x7f7e880c45a0 2023-11-28T19:58:43.024 INFO:teuthology.orchestra.run.smithi179.stderr:2023-11-28T19:58:43.020+0000 7f7e8ed1e640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e881553c0 con 0x7f7e880ca330 2023-11-28T19:58:43.024 INFO:teuthology.orchestra.run.smithi179.stderr:2023-11-28T19:58:43.020+0000 7f7e8dd1c640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7e880ca330 0x7f7e880ca710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:58:43.024 INFO:teuthology.orchestra.run.smithi179.stderr:2023-11-28T19:58:43.020+0000 7f7e8dd1c640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7e880ca330 0x7f7e880ca710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3301/0 says I am v2:172.21.15.179:40196/0 (socket says 172.21.15.179:40196) 2023-11-28T19:58:43.024 INFO:teuthology.orchestra.run.smithi179.stderr:2023-11-28T19:58:43.020+0000 7f7e8dd1c640 1 -- 172.21.15.179:0/3142975351 learned_addr learned my addr 172.21.15.179:0/3142975351 (peer_addr_for_me v2:172.21.15.179:0/0) 2023-11-28T19:58:43.024 INFO:teuthology.orchestra.run.smithi179.stderr:2023-11-28T19:58:43.020+0000 7f7e8d51b640 1 --2- 172.21.15.179:0/3142975351 >> v2:172.21.15.179:3300/0 conn(0x7f7e880c45a0 0x7f7e88154e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:58:43.024 INFO:teuthology.orchestra.run.smithi179.stderr:2023-11-28T19:58:43.024+0000 7f7e8e51d640 1 --2- 172.21.15.179:0/3142975351 >> v2:172.21.15.78:3300/0 conn(0x7f7e8806c480 0x7f7e880c7d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:58:43.024 INFO:teuthology.orchestra.run.smithi179.stderr:2023-11-28T19:58:43.024+0000 7f7e8dd1c640 1 -- 172.21.15.179:0/3142975351 >> v2:172.21.15.179:3300/0 conn(0x7f7e880c45a0 msgr2=0x7f7e88154e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T19:58:43.024 INFO:teuthology.orchestra.run.smithi179.stderr:2023-11-28T19:58:43.024+0000 7f7e8dd1c640 1 --2- 172.21.15.179:0/3142975351 >> v2:172.21.15.179:3300/0 conn(0x7f7e880c45a0 0x7f7e88154e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:58:43.024 INFO:teuthology.orchestra.run.smithi179.stderr:2023-11-28T19:58:43.024+0000 7f7e8dd1c640 1 -- 172.21.15.179:0/3142975351 >> v2:172.21.15.78:3300/0 conn(0x7f7e8806c480 msgr2=0x7f7e880c7d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T19:58:43.025 INFO:teuthology.orchestra.run.smithi179.stderr:2023-11-28T19:58:43.024+0000 7f7e8dd1c640 1 --2- 172.21.15.179:0/3142975351 >> v2:172.21.15.78:3300/0 conn(0x7f7e8806c480 0x7f7e880c7d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:58:43.025 INFO:teuthology.orchestra.run.smithi179.stderr:2023-11-28T19:58:43.024+0000 7f7e8dd1c640 1 -- 172.21.15.179:0/3142975351 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e8806b9e0 con 0x7f7e880ca330 2023-11-28T19:58:43.025 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-11-28T19:58:43.021+0000 7f9ab524d180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-11-28T19:58:43.025 INFO:teuthology.orchestra.run.smithi179.stderr:2023-11-28T19:58:43.024+0000 7f7e8dd1c640 1 --2- 172.21.15.179:0/3142975351 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7e880ca330 0x7f7e880ca710 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f7e8808b280 tx=0x7f7e8401c500 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6b5d16a72b81b7a5 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:58:43.026 INFO:teuthology.orchestra.run.smithi179.stderr:2023-11-28T19:58:43.024+0000 7f7e8cd1a640 1 -- 172.21.15.179:0/3142975351 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e840aa620 con 0x7f7e880ca330 2023-11-28T19:58:43.026 INFO:teuthology.orchestra.run.smithi179.stderr:2023-11-28T19:58:43.024+0000 7f7e8cd1a640 1 -- 172.21.15.179:0/3142975351 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e840aa780 con 0x7f7e880ca330 2023-11-28T19:58:43.026 INFO:teuthology.orchestra.run.smithi179.stderr:2023-11-28T19:58:43.024+0000 7f7e8cd1a640 1 -- 172.21.15.179:0/3142975351 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e840aab10 con 0x7f7e880ca330 2023-11-28T19:58:43.027 INFO:teuthology.orchestra.run.smithi179.stderr:2023-11-28T19:58:43.028+0000 7f7e8ed1e640 1 -- 172.21.15.179:0/3142975351 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7e880ca330 msgr2=0x7f7e880ca710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:58:43.027 INFO:teuthology.orchestra.run.smithi179.stderr:2023-11-28T19:58:43.028+0000 7f7e8ed1e640 1 --2- 172.21.15.179:0/3142975351 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7e880ca330 0x7f7e880ca710 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f7e8808b280 tx=0x7f7e8401c500 comp rx=0 tx=0).stop 2023-11-28T19:58:43.027 INFO:teuthology.orchestra.run.smithi179.stderr:2023-11-28T19:58:43.028+0000 7f7e8ed1e640 1 -- 172.21.15.179:0/3142975351 shutdown_connections 2023-11-28T19:58:43.027 INFO:teuthology.orchestra.run.smithi179.stderr:2023-11-28T19:58:43.028+0000 7f7e8ed1e640 1 --2- 172.21.15.179:0/3142975351 >> v2:172.21.15.78:3300/0 conn(0x7f7e8806c480 0x7f7e880c7d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:58:43.028 INFO:teuthology.orchestra.run.smithi179.stderr:2023-11-28T19:58:43.028+0000 7f7e8ed1e640 1 --2- 172.21.15.179:0/3142975351 >> v2:172.21.15.179:3300/0 conn(0x7f7e880c45a0 0x7f7e88154e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:58:43.028 INFO:teuthology.orchestra.run.smithi179.stderr:2023-11-28T19:58:43.028+0000 7f7e8ed1e640 1 --2- 172.21.15.179:0/3142975351 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7e880ca330 0x7f7e880ca710 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:58:43.028 INFO:teuthology.orchestra.run.smithi179.stderr:2023-11-28T19:58:43.028+0000 7f7e8ed1e640 1 -- 172.21.15.179:0/3142975351 >> 172.21.15.179:0/3142975351 conn(0x7f7e880abdb0 msgr2=0x7f7e880c9c20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T19:58:43.028 INFO:teuthology.orchestra.run.smithi179.stderr:2023-11-28T19:58:43.028+0000 7f7e8ed1e640 1 -- 172.21.15.179:0/3142975351 shutdown_connections 2023-11-28T19:58:43.028 INFO:teuthology.orchestra.run.smithi179.stderr:2023-11-28T19:58:43.028+0000 7f7e8ed1e640 1 -- 172.21.15.179:0/3142975351 wait complete. 2023-11-28T19:58:43.029 INFO:teuthology.orchestra.run.smithi179.stderr:2023-11-28T19:58:43.028+0000 7f7e8ed1e640 1 Processor -- start 2023-11-28T19:58:43.029 INFO:teuthology.orchestra.run.smithi179.stderr:2023-11-28T19:58:43.028+0000 7f7e8ed1e640 1 -- start start 2023-11-28T19:58:43.032 INFO:teuthology.orchestra.run.smithi179.stderr:2023-11-28T19:58:43.028+0000 7f7e8ed1e640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7e8806c480 0x7f7e880c33f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:58:43.032 INFO:teuthology.orchestra.run.smithi179.stderr:2023-11-28T19:58:43.028+0000 7f7e8ed1e640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7e880c45a0 0x7f7e880c0f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:58:43.032 INFO:teuthology.orchestra.run.smithi179.stderr:2023-11-28T19:58:43.028+0000 7f7e8ed1e640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7e880ca330 0x7f7e8815e240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:58:43.032 INFO:teuthology.orchestra.run.smithi179.stderr:2023-11-28T19:58:43.028+0000 7f7e8ed1e640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e880c3ba0 con 0x7f7e8806c480 2023-11-28T19:58:43.032 INFO:teuthology.orchestra.run.smithi179.stderr:2023-11-28T19:58:43.028+0000 7f7e8ed1e640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e880c3930 con 0x7f7e880c45a0 2023-11-28T19:58:43.033 INFO:teuthology.orchestra.run.smithi179.stderr:2023-11-28T19:58:43.028+0000 7f7e8ed1e640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e8814a620 con 0x7f7e880ca330 2023-11-28T19:58:43.033 INFO:teuthology.orchestra.run.smithi179.stderr:2023-11-28T19:58:43.028+0000 7f7e8d51b640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7e880c45a0 0x7f7e880c0f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:58:43.033 INFO:teuthology.orchestra.run.smithi179.stderr:2023-11-28T19:58:43.028+0000 7f7e8e51d640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7e880ca330 0x7f7e8815e240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:58:43.033 INFO:teuthology.orchestra.run.smithi179.stderr:2023-11-28T19:58:43.028+0000 7f7e8d51b640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7e880c45a0 0x7f7e880c0f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.179:44334/0 (socket says 172.21.15.179:44334) 2023-11-28T19:58:43.033 INFO:teuthology.orchestra.run.smithi179.stderr:2023-11-28T19:58:43.028+0000 7f7e8d51b640 1 -- 172.21.15.179:0/1023462114 learned_addr learned my addr 172.21.15.179:0/1023462114 (peer_addr_for_me v2:172.21.15.179:0/0) 2023-11-28T19:58:43.033 INFO:teuthology.orchestra.run.smithi179.stderr:2023-11-28T19:58:43.028+0000 7f7e8dd1c640 1 --2- 172.21.15.179:0/1023462114 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7e8806c480 0x7f7e880c33f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:58:43.033 INFO:teuthology.orchestra.run.smithi179.stderr:2023-11-28T19:58:43.028+0000 7f7e8d51b640 1 -- 172.21.15.179:0/1023462114 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7e880ca330 msgr2=0x7f7e8815e240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:58:43.033 INFO:teuthology.orchestra.run.smithi179.stderr:2023-11-28T19:58:43.028+0000 7f7e8d51b640 1 --2- 172.21.15.179:0/1023462114 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7e880ca330 0x7f7e8815e240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:58:43.033 INFO:teuthology.orchestra.run.smithi179.stderr:2023-11-28T19:58:43.028+0000 7f7e8d51b640 1 -- 172.21.15.179:0/1023462114 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7e8806c480 msgr2=0x7f7e880c33f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:58:43.033 INFO:teuthology.orchestra.run.smithi179.stderr:2023-11-28T19:58:43.028+0000 7f7e8d51b640 1 --2- 172.21.15.179:0/1023462114 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7e8806c480 0x7f7e880c33f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:58:43.034 INFO:teuthology.orchestra.run.smithi179.stderr:2023-11-28T19:58:43.028+0000 7f7e8d51b640 1 -- 172.21.15.179:0/1023462114 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e840094d0 con 0x7f7e880c45a0 2023-11-28T19:58:43.034 INFO:teuthology.orchestra.run.smithi179.stderr:2023-11-28T19:58:43.032+0000 7f7e8d51b640 1 --2- 172.21.15.179:0/1023462114 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7e880c45a0 0x7f7e880c0f90 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f7e7800e960 tx=0x7f7e7800ee20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:58:43.034 INFO:teuthology.orchestra.run.smithi179.stderr:2023-11-28T19:58:43.032+0000 7f7e7e7fc640 1 -- 172.21.15.179:0/1023462114 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e78009690 con 0x7f7e880c45a0 2023-11-28T19:58:43.034 INFO:teuthology.orchestra.run.smithi179.stderr:2023-11-28T19:58:43.032+0000 7f7e7e7fc640 1 -- 172.21.15.179:0/1023462114 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e7800ca00 con 0x7f7e880c45a0 2023-11-28T19:58:43.034 INFO:teuthology.orchestra.run.smithi179.stderr:2023-11-28T19:58:43.032+0000 7f7e7e7fc640 1 -- 172.21.15.179:0/1023462114 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e7800cd70 con 0x7f7e880c45a0 2023-11-28T19:58:43.034 INFO:teuthology.orchestra.run.smithi179.stderr:2023-11-28T19:58:43.032+0000 7f7e8ed1e640 1 -- 172.21.15.179:0/1023462114 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7e8814a8c0 con 0x7f7e880c45a0 2023-11-28T19:58:43.034 INFO:teuthology.orchestra.run.smithi179.stderr:2023-11-28T19:58:43.032+0000 7f7e8ed1e640 1 -- 172.21.15.179:0/1023462114 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7e8814e110 con 0x7f7e880c45a0 2023-11-28T19:58:43.034 INFO:teuthology.orchestra.run.smithi179.stderr:2023-11-28T19:58:43.032+0000 7f7e7e7fc640 1 -- 172.21.15.179:0/1023462114 <== mon.1 v2:172.21.15.179:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f7e78005ca0 con 0x7f7e880c45a0 2023-11-28T19:58:43.034 INFO:teuthology.orchestra.run.smithi179.stderr:2023-11-28T19:58:43.032+0000 7f7e7e7fc640 1 -- 172.21.15.179:0/1023462114 <== mon.1 v2:172.21.15.179:3300/0 5 ==== osd_map(7..7 src has 1..7) v4 ==== 1300+0+0 (secure 0 0 0) 0x7f7e78013470 con 0x7f7e880c45a0 2023-11-28T19:58:43.034 INFO:teuthology.orchestra.run.smithi179.stderr:2023-11-28T19:58:43.032+0000 7f7e8ed1e640 1 -- 172.21.15.179:0/1023462114 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7e880674b0 con 0x7f7e880c45a0 2023-11-28T19:58:43.035 INFO:teuthology.orchestra.run.smithi179.stderr:2023-11-28T19:58:43.032+0000 7f7e7e7fc640 1 -- 172.21.15.179:0/1023462114 <== mon.1 v2:172.21.15.179:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72898 (secure 0 0 0) 0x7f7e78021060 con 0x7f7e880c45a0 2023-11-28T19:58:43.056 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-11-28T19:58:43.056+0000 7f8ad3634180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-11-28T19:58:43.100 INFO:teuthology.orchestra.run.smithi179.stderr:2023-11-28T19:58:43.100+0000 7f7e8ed1e640 1 -- 172.21.15.179:0/1023462114 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "osd new", "uuid": "67db6d36-f684-4079-b0cd-82b4dd61461f", "id": 5} v 0) v1 -- 0x7f7e8806d260 con 0x7f7e880c45a0 2023-11-28T19:58:43.106 INFO:teuthology.orchestra.run.smithi179.stderr:2023-11-28T19:58:43.104+0000 7f7e7e7fc640 1 -- 172.21.15.179:0/1023462114 <== mon.1 v2:172.21.15.179:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "67db6d36-f684-4079-b0cd-82b4dd61461f", "id": 5}]=0 v8) v1 ==== 112+0+2 (secure 0 0 0) 0x7f7e78029020 con 0x7f7e880c45a0 2023-11-28T19:58:43.106 INFO:teuthology.orchestra.run.smithi179.stdout:5 2023-11-28T19:58:43.107 INFO:teuthology.orchestra.run.smithi179.stderr:2023-11-28T19:58:43.108+0000 7f7e8ed1e640 1 -- 172.21.15.179:0/1023462114 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7e880c45a0 msgr2=0x7f7e880c0f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:58:43.108 INFO:teuthology.orchestra.run.smithi179.stderr:2023-11-28T19:58:43.108+0000 7f7e8ed1e640 1 --2- 172.21.15.179:0/1023462114 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7e880c45a0 0x7f7e880c0f90 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f7e7800e960 tx=0x7f7e7800ee20 comp rx=0 tx=0).stop 2023-11-28T19:58:43.108 INFO:teuthology.orchestra.run.smithi179.stderr:2023-11-28T19:58:43.108+0000 7f7e8ed1e640 1 -- 172.21.15.179:0/1023462114 shutdown_connections 2023-11-28T19:58:43.108 INFO:teuthology.orchestra.run.smithi179.stderr:2023-11-28T19:58:43.108+0000 7f7e8ed1e640 1 --2- 172.21.15.179:0/1023462114 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7e880ca330 0x7f7e8815e240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:58:43.108 INFO:teuthology.orchestra.run.smithi179.stderr:2023-11-28T19:58:43.108+0000 7f7e8ed1e640 1 --2- 172.21.15.179:0/1023462114 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7e880c45a0 0x7f7e880c0f90 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:58:43.108 INFO:teuthology.orchestra.run.smithi179.stderr:2023-11-28T19:58:43.108+0000 7f7e8ed1e640 1 --2- 172.21.15.179:0/1023462114 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7e8806c480 0x7f7e880c33f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:58:43.108 INFO:teuthology.orchestra.run.smithi179.stderr:2023-11-28T19:58:43.108+0000 7f7e8ed1e640 1 -- 172.21.15.179:0/1023462114 >> 172.21.15.179:0/1023462114 conn(0x7f7e880abdb0 msgr2=0x7f7e88073450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T19:58:43.109 INFO:teuthology.orchestra.run.smithi179.stderr:2023-11-28T19:58:43.108+0000 7f7e8ed1e640 1 -- 172.21.15.179:0/1023462114 shutdown_connections 2023-11-28T19:58:43.109 INFO:teuthology.orchestra.run.smithi179.stderr:2023-11-28T19:58:43.108+0000 7f7e8ed1e640 1 -- 172.21.15.179:0/1023462114 wait complete. 2023-11-28T19:58:43.127 DEBUG:teuthology.orchestra.run.smithi179:> sudo ceph --cluster ceph osd new 12e670af-5a16-4c81-9f97-defa66cab967 6 2023-11-28T19:58:43.149 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-11-28T19:58:43.148+0000 7f8ad3634180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-11-28T19:58:43.181 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-11-28T19:58:43.177+0000 7f9ab524d180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-11-28T19:58:43.210 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-11-28T19:58:43.208+0000 7f8ad3634180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-11-28T19:58:43.249 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-11-28T19:58:43.245+0000 7f9ab524d180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-11-28T19:58:43.285 INFO:teuthology.orchestra.run.smithi179.stderr:2023-11-28T19:58:43.284+0000 7f0dc4032640 1 Processor -- start 2023-11-28T19:58:43.286 INFO:teuthology.orchestra.run.smithi179.stderr:2023-11-28T19:58:43.284+0000 7f0dc4032640 1 -- start start 2023-11-28T19:58:43.288 INFO:teuthology.orchestra.run.smithi179.stderr:2023-11-28T19:58:43.288+0000 7f0dc4032640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f0dbc0bf2d0 0x7f0dbc151970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:58:43.288 INFO:teuthology.orchestra.run.smithi179.stderr:2023-11-28T19:58:43.288+0000 7f0dc4032640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0dbc158780 con 0x7f0dbc0c98f0 2023-11-28T19:58:43.288 INFO:teuthology.orchestra.run.smithi179.stderr:2023-11-28T19:58:43.288+0000 7f0dc4032640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0dbc157b70 con 0x7f0dbc0c6030 2023-11-28T19:58:43.288 INFO:teuthology.orchestra.run.smithi179.stderr:2023-11-28T19:58:43.288+0000 7f0dc4032640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0dbc0c0300 con 0x7f0dbc0bf2d0 2023-11-28T19:58:43.288 INFO:teuthology.orchestra.run.smithi179.stderr:2023-11-28T19:58:43.288+0000 7f0dc15cd640 1 --1- >> v1:172.21.15.179:6789/0 conn(0x7f0dbc0c6030 0x7f0dbc0c7cc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.179:6789/0 says I am v1:172.21.15.179:38186/0 (socket says 172.21.15.179:38186) 2023-11-28T19:58:43.288 INFO:teuthology.orchestra.run.smithi179.stderr:2023-11-28T19:58:43.288+0000 7f0dc15cd640 1 -- 172.21.15.179:0/2133386179 learned_addr learned my addr 172.21.15.179:0/2133386179 (peer_addr_for_me v1:172.21.15.179:0/0) 2023-11-28T19:58:43.288 INFO:teuthology.orchestra.run.smithi179.stderr:2023-11-28T19:58:43.288+0000 7f0dc1dce640 1 --2- 172.21.15.179:0/2133386179 >> v2:172.21.15.78:3300/0 conn(0x7f0dbc0bf2d0 0x7f0dbc151970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:58:43.288 INFO:teuthology.orchestra.run.smithi179.stderr:2023-11-28T19:58:43.288+0000 7f0dc0dcc640 1 -- 172.21.15.179:0/2133386179 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1124907137 0 0) 0x7f0dbc157b70 con 0x7f0dbc0c6030 2023-11-28T19:58:43.289 INFO:teuthology.orchestra.run.smithi179.stderr:2023-11-28T19:58:43.288+0000 7f0dc0dcc640 1 -- 172.21.15.179:0/2133386179 --> v1:172.21.15.179:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0da8003530 con 0x7f0dbc0c6030 2023-11-28T19:58:43.289 INFO:teuthology.orchestra.run.smithi179.stderr:2023-11-28T19:58:43.288+0000 7f0dc0dcc640 1 -- 172.21.15.179:0/2133386179 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3176940106 0 0) 0x7f0dbc158780 con 0x7f0dbc0c98f0 2023-11-28T19:58:43.289 INFO:teuthology.orchestra.run.smithi179.stderr:2023-11-28T19:58:43.288+0000 7f0dc0dcc640 1 -- 172.21.15.179:0/2133386179 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0dbc157b70 con 0x7f0dbc0c98f0 2023-11-28T19:58:43.289 INFO:teuthology.orchestra.run.smithi179.stderr:2023-11-28T19:58:43.288+0000 7f0dc1dce640 1 -- 172.21.15.179:0/2133386179 >> v1:172.21.15.179:6789/0 conn(0x7f0dbc0c6030 legacy=0x7f0dbc0c7cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:58:43.289 INFO:teuthology.orchestra.run.smithi179.stderr:2023-11-28T19:58:43.288+0000 7f0dc0dcc640 1 -- 172.21.15.179:0/2133386179 <== mon.1 v1:172.21.15.179:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1386140996 0 0) 0x7f0da8003530 con 0x7f0dbc0c6030 2023-11-28T19:58:43.289 INFO:teuthology.orchestra.run.smithi179.stderr:2023-11-28T19:58:43.288+0000 7f0dc1dce640 1 -- 172.21.15.179:0/2133386179 >> v1:172.21.15.78:6789/0 conn(0x7f0dbc0c98f0 legacy=0x7f0dbc15ef00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:58:43.289 INFO:teuthology.orchestra.run.smithi179.stderr:2023-11-28T19:58:43.288+0000 7f0dc1dce640 1 -- 172.21.15.179:0/2133386179 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0dbc157e50 con 0x7f0dbc0bf2d0 2023-11-28T19:58:43.291 INFO:teuthology.orchestra.run.smithi179.stderr:2023-11-28T19:58:43.292+0000 7f0dc1dce640 1 --2- 172.21.15.179:0/2133386179 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0dbc0bf2d0 0x7f0dbc151970 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f0db8009740 tx=0x7f0db801c310 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4632133f6a545d75 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:58:43.291 INFO:teuthology.orchestra.run.smithi179.stderr:2023-11-28T19:58:43.292+0000 7f0dc0dcc640 1 -- 172.21.15.179:0/2133386179 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0dac001680 con 0x7f0dbc0bf2d0 2023-11-28T19:58:43.291 INFO:teuthology.orchestra.run.smithi179.stderr:2023-11-28T19:58:43.292+0000 7f0dc0dcc640 1 -- 172.21.15.179:0/2133386179 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0db80a7050 con 0x7f0dbc0bf2d0 2023-11-28T19:58:43.291 INFO:teuthology.orchestra.run.smithi179.stderr:2023-11-28T19:58:43.292+0000 7f0dc0dcc640 1 -- 172.21.15.179:0/2133386179 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0db80ab600 con 0x7f0dbc0bf2d0 2023-11-28T19:58:43.292 INFO:teuthology.orchestra.run.smithi179.stderr:2023-11-28T19:58:43.292+0000 7f0dc4032640 1 -- 172.21.15.179:0/2133386179 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0dbc0bf2d0 msgr2=0x7f0dbc151970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:58:43.292 INFO:teuthology.orchestra.run.smithi179.stderr:2023-11-28T19:58:43.292+0000 7f0dc4032640 1 --2- 172.21.15.179:0/2133386179 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0dbc0bf2d0 0x7f0dbc151970 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f0db8009740 tx=0x7f0db801c310 comp rx=0 tx=0).stop 2023-11-28T19:58:43.292 INFO:teuthology.orchestra.run.smithi179.stderr:2023-11-28T19:58:43.292+0000 7f0dc4032640 1 -- 172.21.15.179:0/2133386179 shutdown_connections 2023-11-28T19:58:43.292 INFO:teuthology.orchestra.run.smithi179.stderr:2023-11-28T19:58:43.292+0000 7f0dc4032640 1 --2- 172.21.15.179:0/2133386179 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0dbc0bf2d0 0x7f0dbc151970 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:58:43.292 INFO:teuthology.orchestra.run.smithi179.stderr:2023-11-28T19:58:43.292+0000 7f0dc4032640 1 -- 172.21.15.179:0/2133386179 >> 172.21.15.179:0/2133386179 conn(0x7f0dbc0c9dc0 msgr2=0x7f0dbc0ca1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T19:58:43.293 INFO:teuthology.orchestra.run.smithi179.stderr:2023-11-28T19:58:43.292+0000 7f0dc4032640 1 -- 172.21.15.179:0/2133386179 shutdown_connections 2023-11-28T19:58:43.293 INFO:teuthology.orchestra.run.smithi179.stderr:2023-11-28T19:58:43.292+0000 7f0dc4032640 1 -- 172.21.15.179:0/2133386179 wait complete. 2023-11-28T19:58:43.294 INFO:teuthology.orchestra.run.smithi179.stderr:2023-11-28T19:58:43.292+0000 7f0dc4032640 1 Processor -- start 2023-11-28T19:58:43.294 INFO:teuthology.orchestra.run.smithi179.stderr:2023-11-28T19:58:43.292+0000 7f0dc4032640 1 -- start start 2023-11-28T19:58:43.295 INFO:teuthology.orchestra.run.smithi179.stderr:2023-11-28T19:58:43.296+0000 7f0dc4032640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0dbc0bf2d0 0x7f0dbc150930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:58:43.295 INFO:teuthology.orchestra.run.smithi179.stderr:2023-11-28T19:58:43.296+0000 7f0dc4032640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0dbc0c6030 0x7f0dbc13f8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:58:43.295 INFO:teuthology.orchestra.run.smithi179.stderr:2023-11-28T19:58:43.296+0000 7f0dc4032640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0dbc0c98f0 0x7f0dbc13d620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:58:43.295 INFO:teuthology.orchestra.run.smithi179.stderr:2023-11-28T19:58:43.296+0000 7f0dc4032640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0dbc06bd90 con 0x7f0dbc0c6030 2023-11-28T19:58:43.295 INFO:teuthology.orchestra.run.smithi179.stderr:2023-11-28T19:58:43.296+0000 7f0dc4032640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0dbc06c670 con 0x7f0dbc0c98f0 2023-11-28T19:58:43.295 INFO:teuthology.orchestra.run.smithi179.stderr:2023-11-28T19:58:43.296+0000 7f0dc4032640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0dbc150e70 con 0x7f0dbc0bf2d0 2023-11-28T19:58:43.297 INFO:teuthology.orchestra.run.smithi179.stderr:2023-11-28T19:58:43.296+0000 7f0dc1dce640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0dbc0bf2d0 0x7f0dbc150930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:58:43.297 INFO:teuthology.orchestra.run.smithi179.stderr:2023-11-28T19:58:43.296+0000 7f0dc25cf640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0dbc0c98f0 0x7f0dbc13d620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:58:43.297 INFO:teuthology.orchestra.run.smithi179.stderr:2023-11-28T19:58:43.296+0000 7f0dc1dce640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0dbc0bf2d0 0x7f0dbc150930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3301/0 says I am v2:172.21.15.179:40214/0 (socket says 172.21.15.179:40214) 2023-11-28T19:58:43.297 INFO:teuthology.orchestra.run.smithi179.stderr:2023-11-28T19:58:43.296+0000 7f0dc25cf640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0dbc0c98f0 0x7f0dbc13d620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.179:44338/0 (socket says 172.21.15.179:44338) 2023-11-28T19:58:43.297 INFO:teuthology.orchestra.run.smithi179.stderr:2023-11-28T19:58:43.296+0000 7f0dc1dce640 1 -- 172.21.15.179:0/3244532604 learned_addr learned my addr 172.21.15.179:0/3244532604 (peer_addr_for_me v2:172.21.15.179:0/0) 2023-11-28T19:58:43.297 INFO:teuthology.orchestra.run.smithi179.stderr:2023-11-28T19:58:43.296+0000 7f0dc15cd640 1 --2- 172.21.15.179:0/3244532604 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0dbc0c6030 0x7f0dbc13f8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:58:43.297 INFO:teuthology.orchestra.run.smithi179.stderr:2023-11-28T19:58:43.296+0000 7f0dc15cd640 1 -- 172.21.15.179:0/3244532604 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0dbc0bf2d0 msgr2=0x7f0dbc150930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:58:43.297 INFO:teuthology.orchestra.run.smithi179.stderr:2023-11-28T19:58:43.296+0000 7f0dc15cd640 1 --2- 172.21.15.179:0/3244532604 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0dbc0bf2d0 0x7f0dbc150930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:58:43.297 INFO:teuthology.orchestra.run.smithi179.stderr:2023-11-28T19:58:43.296+0000 7f0dc15cd640 1 -- 172.21.15.179:0/3244532604 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0dbc0c98f0 msgr2=0x7f0dbc13d620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:58:43.298 INFO:teuthology.orchestra.run.smithi179.stderr:2023-11-28T19:58:43.296+0000 7f0dc15cd640 1 --2- 172.21.15.179:0/3244532604 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0dbc0c98f0 0x7f0dbc13d620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:58:43.298 INFO:teuthology.orchestra.run.smithi179.stderr:2023-11-28T19:58:43.296+0000 7f0dc15cd640 1 -- 172.21.15.179:0/3244532604 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0db8009420 con 0x7f0dbc0c6030 2023-11-28T19:58:43.298 INFO:teuthology.orchestra.run.smithi179.stderr:2023-11-28T19:58:43.296+0000 7f0dc1dce640 1 --2- 172.21.15.179:0/3244532604 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0dbc0bf2d0 0x7f0dbc150930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T19:58:43.298 INFO:teuthology.orchestra.run.smithi179.stderr:2023-11-28T19:58:43.296+0000 7f0dc15cd640 1 --2- 172.21.15.179:0/3244532604 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0dbc0c6030 0x7f0dbc13f8c0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f0dac00c750 tx=0x7f0dac00cc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:58:43.298 INFO:teuthology.orchestra.run.smithi179.stderr:2023-11-28T19:58:43.296+0000 7f0db27fc640 1 -- 172.21.15.179:0/3244532604 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0dac0072d0 con 0x7f0dbc0c6030 2023-11-28T19:58:43.298 INFO:teuthology.orchestra.run.smithi179.stderr:2023-11-28T19:58:43.296+0000 7f0db27fc640 1 -- 172.21.15.179:0/3244532604 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0dac007450 con 0x7f0dbc0c6030 2023-11-28T19:58:43.298 INFO:teuthology.orchestra.run.smithi179.stderr:2023-11-28T19:58:43.296+0000 7f0dc4032640 1 -- 172.21.15.179:0/3244532604 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0dbc150690 con 0x7f0dbc0c6030 2023-11-28T19:58:43.298 INFO:teuthology.orchestra.run.smithi179.stderr:2023-11-28T19:58:43.296+0000 7f0db27fc640 1 -- 172.21.15.179:0/3244532604 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0dac0047f0 con 0x7f0dbc0c6030 2023-11-28T19:58:43.298 INFO:teuthology.orchestra.run.smithi179.stderr:2023-11-28T19:58:43.296+0000 7f0dc4032640 1 -- 172.21.15.179:0/3244532604 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0dbc06cb00 con 0x7f0dbc0c6030 2023-11-28T19:58:43.298 INFO:teuthology.orchestra.run.smithi179.stderr:2023-11-28T19:58:43.296+0000 7f0db27fc640 1 -- 172.21.15.179:0/3244532604 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f0dac004c50 con 0x7f0dbc0c6030 2023-11-28T19:58:43.298 INFO:teuthology.orchestra.run.smithi179.stderr:2023-11-28T19:58:43.296+0000 7f0db27fc640 1 -- 172.21.15.179:0/3244532604 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(8..8 src has 1..8) v4 ==== 1415+0+0 (secure 0 0 0) 0x7f0dac012400 con 0x7f0dbc0c6030 2023-11-28T19:58:43.299 INFO:teuthology.orchestra.run.smithi179.stderr:2023-11-28T19:58:43.296+0000 7f0dc4032640 1 -- 172.21.15.179:0/3244532604 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0dbc067630 con 0x7f0dbc0c6030 2023-11-28T19:58:43.302 INFO:teuthology.orchestra.run.smithi179.stderr:2023-11-28T19:58:43.300+0000 7f0db27fc640 1 -- 172.21.15.179:0/3244532604 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72898 (secure 0 0 0) 0x7f0dac018070 con 0x7f0dbc0c6030 2023-11-28T19:58:43.369 INFO:teuthology.orchestra.run.smithi179.stderr:2023-11-28T19:58:43.368+0000 7f0dc4032640 1 -- 172.21.15.179:0/3244532604 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd new", "uuid": "12e670af-5a16-4c81-9f97-defa66cab967", "id": 6} v 0) v1 -- 0x7f0dbc0c3ec0 con 0x7f0dbc0c6030 2023-11-28T19:58:43.370 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-11-28T19:58:43.372+0000 7f8ad3634180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-11-28T19:58:43.372 INFO:teuthology.orchestra.run.smithi179.stderr:2023-11-28T19:58:43.372+0000 7f0db27fc640 1 -- 172.21.15.179:0/3244532604 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "12e670af-5a16-4c81-9f97-defa66cab967", "id": 6}]=0 v9) v1 ==== 112+0+2 (secure 0 0 0) 0x7f0dac00a640 con 0x7f0dbc0c6030 2023-11-28T19:58:43.372 INFO:teuthology.orchestra.run.smithi179.stdout:6 2023-11-28T19:58:43.373 INFO:teuthology.orchestra.run.smithi179.stderr:2023-11-28T19:58:43.372+0000 7f0dc4032640 1 -- 172.21.15.179:0/3244532604 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0dbc0c6030 msgr2=0x7f0dbc13f8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:58:43.373 INFO:teuthology.orchestra.run.smithi179.stderr:2023-11-28T19:58:43.372+0000 7f0dc4032640 1 --2- 172.21.15.179:0/3244532604 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0dbc0c6030 0x7f0dbc13f8c0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f0dac00c750 tx=0x7f0dac00cc10 comp rx=0 tx=0).stop 2023-11-28T19:58:43.373 INFO:teuthology.orchestra.run.smithi179.stderr:2023-11-28T19:58:43.372+0000 7f0dc4032640 1 -- 172.21.15.179:0/3244532604 shutdown_connections 2023-11-28T19:58:43.373 INFO:teuthology.orchestra.run.smithi179.stderr:2023-11-28T19:58:43.372+0000 7f0dc4032640 1 --2- 172.21.15.179:0/3244532604 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0dbc0c98f0 0x7f0dbc13d620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:58:43.373 INFO:teuthology.orchestra.run.smithi179.stderr:2023-11-28T19:58:43.372+0000 7f0dc4032640 1 --2- 172.21.15.179:0/3244532604 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0dbc0c6030 0x7f0dbc13f8c0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:58:43.373 INFO:teuthology.orchestra.run.smithi179.stderr:2023-11-28T19:58:43.372+0000 7f0dc4032640 1 --2- 172.21.15.179:0/3244532604 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0dbc0bf2d0 0x7f0dbc150930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:58:43.373 INFO:teuthology.orchestra.run.smithi179.stderr:2023-11-28T19:58:43.372+0000 7f0dc4032640 1 -- 172.21.15.179:0/3244532604 >> 172.21.15.179:0/3244532604 conn(0x7f0dbc0c9dc0 msgr2=0x7f0dbc146fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T19:58:43.374 INFO:teuthology.orchestra.run.smithi179.stderr:2023-11-28T19:58:43.372+0000 7f0dc4032640 1 -- 172.21.15.179:0/3244532604 shutdown_connections 2023-11-28T19:58:43.374 INFO:teuthology.orchestra.run.smithi179.stderr:2023-11-28T19:58:43.372+0000 7f0dc4032640 1 -- 172.21.15.179:0/3244532604 wait complete. 2023-11-28T19:58:43.391 DEBUG:teuthology.orchestra.run.smithi179:> sudo ceph --cluster ceph osd new fe630650-2eb3-49ad-8676-c341e6332eb1 7 2023-11-28T19:58:43.443 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-11-28T19:58:43.444+0000 7f8ad3634180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-11-28T19:58:43.527 INFO:teuthology.orchestra.run.smithi179.stderr:2023-11-28T19:58:43.528+0000 7f5bb2017640 1 Processor -- start 2023-11-28T19:58:43.527 INFO:teuthology.orchestra.run.smithi179.stderr:2023-11-28T19:58:43.528+0000 7f5bb2017640 1 -- start start 2023-11-28T19:58:43.529 INFO:teuthology.orchestra.run.smithi179.stderr:2023-11-28T19:58:43.528+0000 7f5bb2017640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f5bac1572f0 0x7f5bac154ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:58:43.529 INFO:teuthology.orchestra.run.smithi179.stderr:2023-11-28T19:58:43.528+0000 7f5bb2017640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5bac06b8f0 0x7f5bac06bd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:58:43.529 INFO:teuthology.orchestra.run.smithi179.stderr:2023-11-28T19:58:43.528+0000 7f5bb2017640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5bac06b460 con 0x7f5bac0c64c0 2023-11-28T19:58:43.529 INFO:teuthology.orchestra.run.smithi179.stderr:2023-11-28T19:58:43.528+0000 7f5bb2017640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5bac1554b0 con 0x7f5bac1572f0 2023-11-28T19:58:43.529 INFO:teuthology.orchestra.run.smithi179.stderr:2023-11-28T19:58:43.528+0000 7f5bb2017640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5bac06cd30 con 0x7f5bac06b8f0 2023-11-28T19:58:43.529 INFO:teuthology.orchestra.run.smithi179.stderr:2023-11-28T19:58:43.528+0000 7f5baaffd640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5bac06b8f0 0x7f5bac06bd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:58:43.529 INFO:teuthology.orchestra.run.smithi179.stderr:2023-11-28T19:58:43.528+0000 7f5babfff640 1 --1- >> v1:172.21.15.179:6789/0 conn(0x7f5bac0c64c0 0x7f5bac0c6910 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.179:6789/0 says I am v1:172.21.15.179:38192/0 (socket says 172.21.15.179:38192) 2023-11-28T19:58:43.529 INFO:teuthology.orchestra.run.smithi179.stderr:2023-11-28T19:58:43.528+0000 7f5babfff640 1 -- 172.21.15.179:0/2718031933 learned_addr learned my addr 172.21.15.179:0/2718031933 (peer_addr_for_me v1:172.21.15.179:0/0) 2023-11-28T19:58:43.529 INFO:teuthology.orchestra.run.smithi179.stderr:2023-11-28T19:58:43.528+0000 7f5bab7fe640 1 --2- 172.21.15.179:0/2718031933 >> v2:172.21.15.78:3300/0 conn(0x7f5bac1572f0 0x7f5bac154ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:58:43.530 INFO:teuthology.orchestra.run.smithi179.stderr:2023-11-28T19:58:43.528+0000 7f5baa7fc640 1 -- 172.21.15.179:0/2718031933 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 659526565 0 0) 0x7f5bac06b460 con 0x7f5bac0c64c0 2023-11-28T19:58:43.530 INFO:teuthology.orchestra.run.smithi179.stderr:2023-11-28T19:58:43.528+0000 7f5baa7fc640 1 -- 172.21.15.179:0/2718031933 --> v1:172.21.15.179:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5b94003530 con 0x7f5bac0c64c0 2023-11-28T19:58:43.530 INFO:teuthology.orchestra.run.smithi179.stderr:2023-11-28T19:58:43.528+0000 7f5baaffd640 1 -- 172.21.15.179:0/2718031933 >> v2:172.21.15.78:3300/0 conn(0x7f5bac1572f0 msgr2=0x7f5bac154ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T19:58:43.530 INFO:teuthology.orchestra.run.smithi179.stderr:2023-11-28T19:58:43.528+0000 7f5baaffd640 1 --2- 172.21.15.179:0/2718031933 >> v2:172.21.15.78:3300/0 conn(0x7f5bac1572f0 0x7f5bac154ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:58:43.530 INFO:teuthology.orchestra.run.smithi179.stderr:2023-11-28T19:58:43.528+0000 7f5baaffd640 1 -- 172.21.15.179:0/2718031933 >> v1:172.21.15.179:6789/0 conn(0x7f5bac0c64c0 legacy=0x7f5bac0c6910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:58:43.530 INFO:teuthology.orchestra.run.smithi179.stderr:2023-11-28T19:58:43.528+0000 7f5baaffd640 1 -- 172.21.15.179:0/2718031933 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5bac0c4b20 con 0x7f5bac06b8f0 2023-11-28T19:58:43.532 INFO:teuthology.orchestra.run.smithi179.stderr:2023-11-28T19:58:43.532+0000 7f5baaffd640 1 --2- 172.21.15.179:0/2718031933 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5bac06b8f0 0x7f5bac06bd50 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f5ba00097c0 tx=0x7f5ba001c480 comp rx=0 tx=0).ready entity=mon.2 client_cookie=81cd1ae8fa11530a server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:58:43.532 INFO:teuthology.orchestra.run.smithi179.stderr:2023-11-28T19:58:43.532+0000 7f5baa7fc640 1 -- 172.21.15.179:0/2718031933 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ba00ab600 con 0x7f5bac06b8f0 2023-11-28T19:58:43.532 INFO:teuthology.orchestra.run.smithi179.stderr:2023-11-28T19:58:43.532+0000 7f5baa7fc640 1 -- 172.21.15.179:0/2718031933 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ba00a7050 con 0x7f5bac06b8f0 2023-11-28T19:58:43.533 INFO:teuthology.orchestra.run.smithi179.stderr:2023-11-28T19:58:43.532+0000 7f5baa7fc640 1 -- 172.21.15.179:0/2718031933 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ba00ab980 con 0x7f5bac06b8f0 2023-11-28T19:58:43.533 INFO:teuthology.orchestra.run.smithi179.stderr:2023-11-28T19:58:43.532+0000 7f5bb2017640 1 -- 172.21.15.179:0/2718031933 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5bac06b8f0 msgr2=0x7f5bac06bd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:58:43.533 INFO:teuthology.orchestra.run.smithi179.stderr:2023-11-28T19:58:43.532+0000 7f5bb2017640 1 --2- 172.21.15.179:0/2718031933 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5bac06b8f0 0x7f5bac06bd50 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f5ba00097c0 tx=0x7f5ba001c480 comp rx=0 tx=0).stop 2023-11-28T19:58:43.533 INFO:teuthology.orchestra.run.smithi179.stderr:2023-11-28T19:58:43.532+0000 7f5bb2017640 1 -- 172.21.15.179:0/2718031933 shutdown_connections 2023-11-28T19:58:43.534 INFO:teuthology.orchestra.run.smithi179.stderr:2023-11-28T19:58:43.532+0000 7f5bb2017640 1 --2- 172.21.15.179:0/2718031933 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5bac06b8f0 0x7f5bac06bd50 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:58:43.534 INFO:teuthology.orchestra.run.smithi179.stderr:2023-11-28T19:58:43.532+0000 7f5bb2017640 1 --2- 172.21.15.179:0/2718031933 >> v2:172.21.15.78:3300/0 conn(0x7f5bac1572f0 0x7f5bac154ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:58:43.534 INFO:teuthology.orchestra.run.smithi179.stderr:2023-11-28T19:58:43.532+0000 7f5bb2017640 1 -- 172.21.15.179:0/2718031933 >> 172.21.15.179:0/2718031933 conn(0x7f5bac0abbf0 msgr2=0x7f5bac0ac000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T19:58:43.534 INFO:teuthology.orchestra.run.smithi179.stderr:2023-11-28T19:58:43.532+0000 7f5bb2017640 1 -- 172.21.15.179:0/2718031933 shutdown_connections 2023-11-28T19:58:43.534 INFO:teuthology.orchestra.run.smithi179.stderr:2023-11-28T19:58:43.532+0000 7f5bb2017640 1 -- 172.21.15.179:0/2718031933 wait complete. 2023-11-28T19:58:43.534 INFO:teuthology.orchestra.run.smithi179.stderr:2023-11-28T19:58:43.536+0000 7f5bb2017640 1 Processor -- start 2023-11-28T19:58:43.535 INFO:teuthology.orchestra.run.smithi179.stderr:2023-11-28T19:58:43.536+0000 7f5bb2017640 1 -- start start 2023-11-28T19:58:43.537 INFO:teuthology.orchestra.run.smithi179.stderr:2023-11-28T19:58:43.536+0000 7f5bb2017640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5bac06b8f0 0x7f5bac1f0a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:58:43.537 INFO:teuthology.orchestra.run.smithi179.stderr:2023-11-28T19:58:43.536+0000 7f5bb2017640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5bac0c64c0 0x7f5bac149ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:58:43.537 INFO:teuthology.orchestra.run.smithi179.stderr:2023-11-28T19:58:43.536+0000 7f5bb2017640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5bac1572f0 0x7f5bac0c9200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:58:43.537 INFO:teuthology.orchestra.run.smithi179.stderr:2023-11-28T19:58:43.536+0000 7f5bb2017640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5bac1f0f60 con 0x7f5bac06b8f0 2023-11-28T19:58:43.537 INFO:teuthology.orchestra.run.smithi179.stderr:2023-11-28T19:58:43.536+0000 7f5bb2017640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5bac14a530 con 0x7f5bac0c64c0 2023-11-28T19:58:43.537 INFO:teuthology.orchestra.run.smithi179.stderr:2023-11-28T19:58:43.536+0000 7f5bb2017640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5bac1ecc10 con 0x7f5bac1572f0 2023-11-28T19:58:43.537 INFO:teuthology.orchestra.run.smithi179.stderr:2023-11-28T19:58:43.536+0000 7f5baaffd640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5bac0c64c0 0x7f5bac149ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:58:43.537 INFO:teuthology.orchestra.run.smithi179.stderr:2023-11-28T19:58:43.536+0000 7f5baaffd640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5bac0c64c0 0x7f5bac149ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.179:44348/0 (socket says 172.21.15.179:44348) 2023-11-28T19:58:43.537 INFO:teuthology.orchestra.run.smithi179.stderr:2023-11-28T19:58:43.536+0000 7f5baaffd640 1 -- 172.21.15.179:0/4063853945 learned_addr learned my addr 172.21.15.179:0/4063853945 (peer_addr_for_me v2:172.21.15.179:0/0) 2023-11-28T19:58:43.537 INFO:teuthology.orchestra.run.smithi179.stderr:2023-11-28T19:58:43.536+0000 7f5babfff640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5bac1572f0 0x7f5bac0c9200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:58:43.537 INFO:teuthology.orchestra.run.smithi179.stderr:2023-11-28T19:58:43.536+0000 7f5bab7fe640 1 --2- 172.21.15.179:0/4063853945 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5bac06b8f0 0x7f5bac1f0a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:58:43.537 INFO:teuthology.orchestra.run.smithi179.stderr:2023-11-28T19:58:43.536+0000 7f5baaffd640 1 -- 172.21.15.179:0/4063853945 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5bac1572f0 msgr2=0x7f5bac0c9200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:58:43.538 INFO:teuthology.orchestra.run.smithi179.stderr:2023-11-28T19:58:43.536+0000 7f5baaffd640 1 --2- 172.21.15.179:0/4063853945 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5bac1572f0 0x7f5bac0c9200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:58:43.538 INFO:teuthology.orchestra.run.smithi179.stderr:2023-11-28T19:58:43.536+0000 7f5baaffd640 1 -- 172.21.15.179:0/4063853945 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5bac06b8f0 msgr2=0x7f5bac1f0a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:58:43.538 INFO:teuthology.orchestra.run.smithi179.stderr:2023-11-28T19:58:43.536+0000 7f5baaffd640 1 --2- 172.21.15.179:0/4063853945 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5bac06b8f0 0x7f5bac1f0a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:58:43.538 INFO:teuthology.orchestra.run.smithi179.stderr:2023-11-28T19:58:43.536+0000 7f5baaffd640 1 -- 172.21.15.179:0/4063853945 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ba0009420 con 0x7f5bac0c64c0 2023-11-28T19:58:43.538 INFO:teuthology.orchestra.run.smithi179.stderr:2023-11-28T19:58:43.536+0000 7f5baaffd640 1 --2- 172.21.15.179:0/4063853945 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5bac0c64c0 0x7f5bac149ff0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f5ba00ae040 tx=0x7f5ba0019220 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:58:43.539 INFO:teuthology.orchestra.run.smithi179.stderr:2023-11-28T19:58:43.536+0000 7f5b93fff640 1 -- 172.21.15.179:0/4063853945 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ba00b4430 con 0x7f5bac0c64c0 2023-11-28T19:58:43.539 INFO:teuthology.orchestra.run.smithi179.stderr:2023-11-28T19:58:43.536+0000 7f5b93fff640 1 -- 172.21.15.179:0/4063853945 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ba00b45b0 con 0x7f5bac0c64c0 2023-11-28T19:58:43.539 INFO:teuthology.orchestra.run.smithi179.stderr:2023-11-28T19:58:43.536+0000 7f5b93fff640 1 -- 172.21.15.179:0/4063853945 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ba00b4960 con 0x7f5bac0c64c0 2023-11-28T19:58:43.539 INFO:teuthology.orchestra.run.smithi179.stderr:2023-11-28T19:58:43.536+0000 7f5bb2017640 1 -- 172.21.15.179:0/4063853945 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5bac1ecef0 con 0x7f5bac0c64c0 2023-11-28T19:58:43.539 INFO:teuthology.orchestra.run.smithi179.stderr:2023-11-28T19:58:43.536+0000 7f5bb2017640 1 -- 172.21.15.179:0/4063853945 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5bac1ed4b0 con 0x7f5bac0c64c0 2023-11-28T19:58:43.539 INFO:teuthology.orchestra.run.smithi179.stderr:2023-11-28T19:58:43.536+0000 7f5b93fff640 1 -- 172.21.15.179:0/4063853945 <== mon.1 v2:172.21.15.179:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f5ba00b2040 con 0x7f5bac0c64c0 2023-11-28T19:58:43.539 INFO:teuthology.orchestra.run.smithi179.stderr:2023-11-28T19:58:43.536+0000 7f5b93fff640 1 -- 172.21.15.179:0/4063853945 <== mon.1 v2:172.21.15.179:3300/0 5 ==== osd_map(9..9 src has 1..9) v4 ==== 1530+0+0 (secure 0 0 0) 0x7f5ba00b4dc0 con 0x7f5bac0c64c0 2023-11-28T19:58:43.539 INFO:teuthology.orchestra.run.smithi179.stderr:2023-11-28T19:58:43.536+0000 7f5bb2017640 1 -- 172.21.15.179:0/4063853945 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5bac067630 con 0x7f5bac0c64c0 2023-11-28T19:58:43.540 INFO:teuthology.orchestra.run.smithi179.stderr:2023-11-28T19:58:43.540+0000 7f5b93fff640 1 -- 172.21.15.179:0/4063853945 <== mon.1 v2:172.21.15.179:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72898 (secure 0 0 0) 0x7f5ba00b0070 con 0x7f5bac0c64c0 2023-11-28T19:58:43.606 INFO:teuthology.orchestra.run.smithi179.stderr:2023-11-28T19:58:43.604+0000 7f5bb2017640 1 -- 172.21.15.179:0/4063853945 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "osd new", "uuid": "fe630650-2eb3-49ad-8676-c341e6332eb1", "id": 7} v 0) v1 -- 0x7f5bac06c880 con 0x7f5bac0c64c0 2023-11-28T19:58:43.614 INFO:teuthology.orchestra.run.smithi179.stderr:2023-11-28T19:58:43.612+0000 7f5b93fff640 1 -- 172.21.15.179:0/4063853945 <== mon.1 v2:172.21.15.179:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "fe630650-2eb3-49ad-8676-c341e6332eb1", "id": 7}]=0 v10) v1 ==== 112+0+2 (secure 0 0 0) 0x7f5ba00be460 con 0x7f5bac0c64c0 2023-11-28T19:58:43.614 INFO:teuthology.orchestra.run.smithi179.stdout:7 2023-11-28T19:58:43.615 INFO:teuthology.orchestra.run.smithi179.stderr:2023-11-28T19:58:43.616+0000 7f5bb2017640 1 -- 172.21.15.179:0/4063853945 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5bac0c64c0 msgr2=0x7f5bac149ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:58:43.615 INFO:teuthology.orchestra.run.smithi179.stderr:2023-11-28T19:58:43.616+0000 7f5bb2017640 1 --2- 172.21.15.179:0/4063853945 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5bac0c64c0 0x7f5bac149ff0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f5ba00ae040 tx=0x7f5ba0019220 comp rx=0 tx=0).stop 2023-11-28T19:58:43.615 INFO:teuthology.orchestra.run.smithi179.stderr:2023-11-28T19:58:43.616+0000 7f5bb2017640 1 -- 172.21.15.179:0/4063853945 shutdown_connections 2023-11-28T19:58:43.615 INFO:teuthology.orchestra.run.smithi179.stderr:2023-11-28T19:58:43.616+0000 7f5bb2017640 1 --2- 172.21.15.179:0/4063853945 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5bac1572f0 0x7f5bac0c9200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:58:43.615 INFO:teuthology.orchestra.run.smithi179.stderr:2023-11-28T19:58:43.616+0000 7f5bb2017640 1 --2- 172.21.15.179:0/4063853945 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5bac0c64c0 0x7f5bac149ff0 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:58:43.615 INFO:teuthology.orchestra.run.smithi179.stderr:2023-11-28T19:58:43.616+0000 7f5bb2017640 1 --2- 172.21.15.179:0/4063853945 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5bac06b8f0 0x7f5bac1f0a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:58:43.615 INFO:teuthology.orchestra.run.smithi179.stderr:2023-11-28T19:58:43.616+0000 7f5bb2017640 1 -- 172.21.15.179:0/4063853945 >> 172.21.15.179:0/4063853945 conn(0x7f5bac0abbf0 msgr2=0x7f5bac0abfd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T19:58:43.616 INFO:teuthology.orchestra.run.smithi179.stderr:2023-11-28T19:58:43.616+0000 7f5bb2017640 1 -- 172.21.15.179:0/4063853945 shutdown_connections 2023-11-28T19:58:43.616 INFO:teuthology.orchestra.run.smithi179.stderr:2023-11-28T19:58:43.616+0000 7f5bb2017640 1 -- 172.21.15.179:0/4063853945 wait complete. 2023-11-28T19:58:43.634 INFO:tasks.ceph.osd.0:Restarting daemon 2023-11-28T19:58:43.634 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2023-11-28T19:58:43.644 INFO:tasks.ceph.osd.0:Started 2023-11-28T19:58:43.645 INFO:tasks.ceph.osd.1:Restarting daemon 2023-11-28T19:58:43.645 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2023-11-28T19:58:43.654 INFO:tasks.ceph.osd.1:Started 2023-11-28T19:58:43.654 INFO:tasks.ceph.osd.2:Restarting daemon 2023-11-28T19:58:43.654 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2023-11-28T19:58:43.659 INFO:tasks.ceph.osd.2:Started 2023-11-28T19:58:43.659 INFO:tasks.ceph.osd.3:Restarting daemon 2023-11-28T19:58:43.659 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2023-11-28T19:58:43.664 INFO:tasks.ceph.osd.3:Started 2023-11-28T19:58:43.664 INFO:tasks.ceph.osd.4:Restarting daemon 2023-11-28T19:58:43.664 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2023-11-28T19:58:43.668 INFO:tasks.ceph.osd.4:Started 2023-11-28T19:58:43.668 INFO:tasks.ceph.osd.5:Restarting daemon 2023-11-28T19:58:43.668 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2023-11-28T19:58:43.671 INFO:tasks.ceph.osd.5:Started 2023-11-28T19:58:43.672 INFO:tasks.ceph.osd.6:Restarting daemon 2023-11-28T19:58:43.672 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2023-11-28T19:58:43.675 INFO:tasks.ceph.osd.6:Started 2023-11-28T19:58:43.675 INFO:tasks.ceph.osd.7:Restarting daemon 2023-11-28T19:58:43.676 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2023-11-28T19:58:43.679 INFO:tasks.ceph.osd.7:Started 2023-11-28T19:58:43.679 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-28T19:58:43.832 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:58:43.829+0000 7f5b231df640 1 Processor -- start 2023-11-28T19:58:43.832 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:58:43.829+0000 7f5b231df640 1 -- start start 2023-11-28T19:58:43.833 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:58:43.829+0000 7f5b231df640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f5b1c0c5e10 0x7f5b1c0a6ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:58:43.833 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:58:43.829+0000 7f5b231df640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5b1c155110 con 0x7f5b1c0a7420 2023-11-28T19:58:43.833 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:58:43.829+0000 7f5b231df640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5b1c0c2f20 con 0x7f5b1c14e7e0 2023-11-28T19:58:43.833 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:58:43.829+0000 7f5b231df640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5b1c154520 con 0x7f5b1c0c5e10 2023-11-28T19:58:43.833 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:58:43.829+0000 7f5b2177c640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f5b1c0a7420 0x7f5b1c157b10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:47346/0 (socket says 172.21.15.78:47346) 2023-11-28T19:58:43.834 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:58:43.829+0000 7f5b2177c640 1 -- 172.21.15.78:0/4182918244 learned_addr learned my addr 172.21.15.78:0/4182918244 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-11-28T19:58:43.834 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:58:43.833+0000 7f5b13fff640 1 --2- 172.21.15.78:0/4182918244 >> v2:172.21.15.179:3300/0 conn(0x7f5b1c0c5e10 0x7f5b1c0a6ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:58:43.836 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:58:43.833+0000 7f5b137fe640 1 -- 172.21.15.78:0/4182918244 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3939037637 0 0) 0x7f5b1c155110 con 0x7f5b1c0a7420 2023-11-28T19:58:43.836 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:58:43.833+0000 7f5b137fe640 1 -- 172.21.15.78:0/4182918244 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5b04003530 con 0x7f5b1c0a7420 2023-11-28T19:58:43.836 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:58:43.833+0000 7f5b137fe640 1 -- 172.21.15.78:0/4182918244 <== mon.0 v1:172.21.15.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2266038022 0 0) 0x7f5b04003530 con 0x7f5b1c0a7420 2023-11-28T19:58:43.836 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:58:43.833+0000 7f5b137fe640 1 -- 172.21.15.78:0/4182918244 >> v2:172.21.15.179:3300/0 conn(0x7f5b1c0c5e10 msgr2=0x7f5b1c0a6ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T19:58:43.836 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:58:43.833+0000 7f5b137fe640 1 --2- 172.21.15.78:0/4182918244 >> v2:172.21.15.179:3300/0 conn(0x7f5b1c0c5e10 0x7f5b1c0a6ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:58:43.836 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:58:43.833+0000 7f5b137fe640 1 -- 172.21.15.78:0/4182918244 >> v1:172.21.15.179:6789/0 conn(0x7f5b1c14e7e0 legacy=0x7f5b1c0c2810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T19:58:43.836 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:58:43.833+0000 7f5b137fe640 1 -- 172.21.15.78:0/4182918244 --> v1:172.21.15.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b1c1547e0 con 0x7f5b1c0a7420 2023-11-28T19:58:43.837 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:58:43.833+0000 7f5b137fe640 1 -- 172.21.15.78:0/4182918244 <== mon.0 v1:172.21.15.78:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3326804700 0 0) 0x7f5b14001a00 con 0x7f5b1c0a7420 2023-11-28T19:58:43.837 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:58:43.833+0000 7f5b137fe640 1 -- 172.21.15.78:0/4182918244 >> v1:172.21.15.78:6789/0 conn(0x7f5b1c0a7420 legacy=0x7f5b1c157b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:58:43.837 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:58:43.833+0000 7f5b137fe640 1 --2- 172.21.15.78:0/4182918244 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5b04003980 0x7f5b04003d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:58:43.837 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:58:43.833+0000 7f5b137fe640 1 --2- 172.21.15.78:0/4182918244 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5b040047d0 0x7f5b04004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:58:43.837 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:58:43.833+0000 7f5b137fe640 1 --2- 172.21.15.78:0/4182918244 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5b04005200 0x7f5b0400b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:58:43.837 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:58:43.833+0000 7f5b137fe640 1 -- 172.21.15.78:0/4182918244 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b1c154520 con 0x7f5b040047d0 2023-11-28T19:58:43.837 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:58:43.833+0000 7f5b137fe640 1 -- 172.21.15.78:0/4182918244 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b0400c160 con 0x7f5b04005200 2023-11-28T19:58:43.837 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:58:43.833+0000 7f5b137fe640 1 -- 172.21.15.78:0/4182918244 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b0400c320 con 0x7f5b04003980 2023-11-28T19:58:43.837 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:58:43.833+0000 7f5b13fff640 1 --2- 172.21.15.78:0/4182918244 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5b040047d0 0x7f5b04004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:58:43.837 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:58:43.833+0000 7f5b2177c640 1 --2- 172.21.15.78:0/4182918244 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5b04005200 0x7f5b0400b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:58:43.837 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:58:43.833+0000 7f5b20f7b640 1 --2- 172.21.15.78:0/4182918244 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5b04003980 0x7f5b04003d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:58:43.837 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:58:43.833+0000 7f5b13fff640 1 -- 172.21.15.78:0/4182918244 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5b04003980 msgr2=0x7f5b04003d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T19:58:43.838 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:58:43.833+0000 7f5b13fff640 1 --2- 172.21.15.78:0/4182918244 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5b04003980 0x7f5b04003d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:58:43.838 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:58:43.833+0000 7f5b13fff640 1 -- 172.21.15.78:0/4182918244 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5b04005200 msgr2=0x7f5b0400b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T19:58:43.838 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:58:43.833+0000 7f5b13fff640 1 --2- 172.21.15.78:0/4182918244 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5b04005200 0x7f5b0400b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:58:43.838 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:58:43.833+0000 7f5b2177c640 1 -- 172.21.15.78:0/4182918244 reap_dead start 2023-11-28T19:58:43.838 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:58:43.833+0000 7f5b13fff640 1 -- 172.21.15.78:0/4182918244 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b04003530 con 0x7f5b040047d0 2023-11-28T19:58:43.839 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:58:43.837+0000 7f5b13fff640 1 --2- 172.21.15.78:0/4182918244 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5b040047d0 0x7f5b04004c50 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f5b0c009ab0 tx=0x7f5b0c01ca00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5be7363d61988b25 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:58:43.840 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:58:43.837+0000 7f5b137fe640 1 -- 172.21.15.78:0/4182918244 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b0c0a64f0 con 0x7f5b040047d0 2023-11-28T19:58:43.840 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:58:43.837+0000 7f5b137fe640 1 -- 172.21.15.78:0/4182918244 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b0c0a6650 con 0x7f5b040047d0 2023-11-28T19:58:43.840 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:58:43.837+0000 7f5b137fe640 1 -- 172.21.15.78:0/4182918244 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b0c0a6a00 con 0x7f5b040047d0 2023-11-28T19:58:43.841 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:58:43.837+0000 7f5b231df640 1 -- 172.21.15.78:0/4182918244 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5b040047d0 msgr2=0x7f5b04004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:58:43.841 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:58:43.837+0000 7f5b231df640 1 --2- 172.21.15.78:0/4182918244 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5b040047d0 0x7f5b04004c50 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f5b0c009ab0 tx=0x7f5b0c01ca00 comp rx=0 tx=0).stop 2023-11-28T19:58:43.841 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:58:43.837+0000 7f5b231df640 1 -- 172.21.15.78:0/4182918244 shutdown_connections 2023-11-28T19:58:43.841 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:58:43.837+0000 7f5b231df640 1 --2- 172.21.15.78:0/4182918244 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5b040047d0 0x7f5b04004c50 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:58:43.841 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:58:43.837+0000 7f5b231df640 1 -- 172.21.15.78:0/4182918244 >> 172.21.15.78:0/4182918244 conn(0x7f5b1c0c7c60 msgr2=0x7f5b1c0c8070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T19:58:43.841 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:58:43.837+0000 7f5b231df640 1 -- 172.21.15.78:0/4182918244 shutdown_connections 2023-11-28T19:58:43.841 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:58:43.837+0000 7f5b231df640 1 -- 172.21.15.78:0/4182918244 wait complete. 2023-11-28T19:58:43.843 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:58:43.837+0000 7f5b231df640 1 Processor -- start 2023-11-28T19:58:43.843 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:58:43.837+0000 7f5b231df640 1 -- start start 2023-11-28T19:58:43.843 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:58:43.841+0000 7f5b231df640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5b040047d0 0x7f5b1c1450f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:58:43.843 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:58:43.841+0000 7f5b231df640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5b1c06c290 0x7f5b1c1e2e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:58:43.843 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:58:43.841+0000 7f5b231df640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5b1c1e3370 0x7f5b1c1e3c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:58:43.844 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:58:43.841+0000 7f5b231df640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b1c1ee4d0 con 0x7f5b040047d0 2023-11-28T19:58:43.844 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:58:43.841+0000 7f5b231df640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b1c14d5f0 con 0x7f5b1c06c290 2023-11-28T19:58:43.844 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:58:43.841+0000 7f5b231df640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b1c06b720 con 0x7f5b1c1e3370 2023-11-28T19:58:43.844 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:58:43.841+0000 7f5b20f7b640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5b040047d0 0x7f5b1c1450f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:58:43.844 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:58:43.841+0000 7f5b20f7b640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5b040047d0 0x7f5b1c1450f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:44072/0 (socket says 172.21.15.78:44072) 2023-11-28T19:58:43.844 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:58:43.841+0000 7f5b20f7b640 1 -- 172.21.15.78:0/2590480860 learned_addr learned my addr 172.21.15.78:0/2590480860 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T19:58:43.844 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:58:43.841+0000 7f5b13fff640 1 --2- 172.21.15.78:0/2590480860 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5b1c06c290 0x7f5b1c1e2e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:58:43.844 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:58:43.841+0000 7f5b2177c640 1 --2- 172.21.15.78:0/2590480860 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5b1c1e3370 0x7f5b1c1e3c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:58:43.844 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:58:43.841+0000 7f5b20f7b640 1 -- 172.21.15.78:0/2590480860 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5b1c1e3370 msgr2=0x7f5b1c1e3c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:58:43.844 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:58:43.841+0000 7f5b20f7b640 1 --2- 172.21.15.78:0/2590480860 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5b1c1e3370 0x7f5b1c1e3c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:58:43.844 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:58:43.841+0000 7f5b20f7b640 1 -- 172.21.15.78:0/2590480860 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5b1c06c290 msgr2=0x7f5b1c1e2e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:58:43.844 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:58:43.841+0000 7f5b20f7b640 1 --2- 172.21.15.78:0/2590480860 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5b1c06c290 0x7f5b1c1e2e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:58:43.845 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:58:43.841+0000 7f5b20f7b640 1 -- 172.21.15.78:0/2590480860 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b1c1edf70 con 0x7f5b040047d0 2023-11-28T19:58:43.845 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:58:43.841+0000 7f5b2177c640 1 --2- 172.21.15.78:0/2590480860 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5b1c1e3370 0x7f5b1c1e3c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T19:58:43.845 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:58:43.841+0000 7f5b20f7b640 1 --2- 172.21.15.78:0/2590480860 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5b040047d0 0x7f5b1c1450f0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f5b1800e440 tx=0x7f5b1800e840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:58:43.845 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:58:43.841+0000 7f5b117fa640 1 -- 172.21.15.78:0/2590480860 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b18003a80 con 0x7f5b040047d0 2023-11-28T19:58:43.845 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:58:43.841+0000 7f5b117fa640 1 -- 172.21.15.78:0/2590480860 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b18003c00 con 0x7f5b040047d0 2023-11-28T19:58:43.845 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:58:43.841+0000 7f5b117fa640 1 -- 172.21.15.78:0/2590480860 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b18007030 con 0x7f5b040047d0 2023-11-28T19:58:43.845 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:58:43.841+0000 7f5b231df640 1 -- 172.21.15.78:0/2590480860 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5b1c145630 con 0x7f5b040047d0 2023-11-28T19:58:43.845 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:58:43.841+0000 7f5b117fa640 1 -- 172.21.15.78:0/2590480860 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f5b18007490 con 0x7f5b040047d0 2023-11-28T19:58:43.845 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:58:43.841+0000 7f5b231df640 1 -- 172.21.15.78:0/2590480860 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5b1c14cfa0 con 0x7f5b040047d0 2023-11-28T19:58:43.846 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:58:43.841+0000 7f5b117fa640 1 -- 172.21.15.78:0/2590480860 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1645+0+0 (secure 0 0 0) 0x7f5b180042e0 con 0x7f5b040047d0 2023-11-28T19:58:43.846 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:58:43.841+0000 7f5b231df640 1 -- 172.21.15.78:0/2590480860 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5b1c14cde0 con 0x7f5b040047d0 2023-11-28T19:58:43.847 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:58:43.845+0000 7f5b117fa640 1 -- 172.21.15.78:0/2590480860 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72898 (secure 0 0 0) 0x7f5b18004550 con 0x7f5b040047d0 2023-11-28T19:58:43.903 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:58:43.901+0000 7f5b231df640 1 -- 172.21.15.78:0/2590480860 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f5b1c067630 con 0x7f5b040047d0 2023-11-28T19:58:43.904 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:58:43.901+0000 7f5b117fa640 1 -- 172.21.15.78:0/2590480860 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7057 (secure 0 0 0) 0x7f5b180047a0 con 0x7f5b040047d0 2023-11-28T19:58:43.904 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-11-28T19:58:43.904 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":10,"fsid":"dd9780e8-3bda-44fa-a9f0-fa07d19d901d","created":"2023-11-28T19:58:40.969556+0000","modified":"2023-11-28T19:58:43.609275+0000","last_up_change":"0.000000","last_in_change":"2023-11-28T19:58:43.609275+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"e84245ac-b5da-429e-af18-39acaa2b33e4","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"e634831d-c4e2-48d9-870c-9556ae162981","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"274c8395-6534-41f0-b8fb-a00af8985aa8","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"77acc9af-7d4d-4b18-8cf5-d62f5971b7c8","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"5c62bc66-6b34-4b7f-a66b-9a743969138c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"67db6d36-f684-4079-b0cd-82b4dd61461f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"12e670af-5a16-4c81-9f97-defa66cab967","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"fe630650-2eb3-49ad-8676-c341e6332eb1","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-28T19:58:43.905 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:58:43.901+0000 7f5b231df640 1 -- 172.21.15.78:0/2590480860 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5b040047d0 msgr2=0x7f5b1c1450f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:58:43.906 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:58:43.901+0000 7f5b231df640 1 --2- 172.21.15.78:0/2590480860 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5b040047d0 0x7f5b1c1450f0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f5b1800e440 tx=0x7f5b1800e840 comp rx=0 tx=0).stop 2023-11-28T19:58:43.906 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:58:43.901+0000 7f5b231df640 1 -- 172.21.15.78:0/2590480860 shutdown_connections 2023-11-28T19:58:43.906 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:58:43.901+0000 7f5b231df640 1 --2- 172.21.15.78:0/2590480860 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5b1c1e3370 0x7f5b1c1e3c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:58:43.906 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:58:43.901+0000 7f5b231df640 1 --2- 172.21.15.78:0/2590480860 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5b1c06c290 0x7f5b1c1e2e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:58:43.906 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:58:43.901+0000 7f5b231df640 1 --2- 172.21.15.78:0/2590480860 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5b040047d0 0x7f5b1c1450f0 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:58:43.906 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:58:43.901+0000 7f5b231df640 1 -- 172.21.15.78:0/2590480860 >> 172.21.15.78:0/2590480860 conn(0x7f5b1c0c7c60 msgr2=0x7f5b1c0c6d50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T19:58:43.906 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:58:43.901+0000 7f5b231df640 1 -- 172.21.15.78:0/2590480860 shutdown_connections 2023-11-28T19:58:43.906 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:58:43.901+0000 7f5b231df640 1 -- 172.21.15.78:0/2590480860 wait complete. 2023-11-28T19:58:43.907 INFO:tasks.ceph.mgr.y.smithi078.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2023-11-28T19:58:43.907 INFO:tasks.ceph.mgr.y.smithi078.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2023-11-28T19:58:43.907 INFO:tasks.ceph.mgr.y.smithi078.stderr: from numpy import show_config as show_numpy_config 2023-11-28T19:58:43.924 INFO:tasks.ceph.ceph_manager.ceph:[] 2023-11-28T19:58:43.924 INFO:tasks.ceph:Waiting for OSDs to come up 2023-11-28T19:58:43.946 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-11-28T19:58:43.941+0000 7f9ab524d180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-11-28T19:58:44.084 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-11-28T19:58:44.081+0000 7f9ab524d180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-11-28T19:58:44.112 INFO:tasks.ceph.mgr.x.smithi179.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2023-11-28T19:58:44.112 INFO:tasks.ceph.mgr.x.smithi179.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2023-11-28T19:58:44.112 INFO:tasks.ceph.mgr.x.smithi179.stderr: from numpy import show_config as show_numpy_config 2023-11-28T19:58:44.220 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-11-28T19:58:44.220+0000 7f8ad3634180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-11-28T19:58:44.276 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-11-28T19:58:44.273+0000 7f9ab524d180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-11-28T19:58:44.299 INFO:tasks.ceph.osd.0.smithi078.stderr:2023-11-28T19:58:44.297+0000 7fd068080640 -1 Falling back to public interface 2023-11-28T19:58:44.310 INFO:tasks.ceph.osd.1.smithi078.stderr:2023-11-28T19:58:44.309+0000 7fd0cbb80640 -1 Falling back to public interface 2023-11-28T19:58:44.330 INFO:tasks.ceph.osd.2.smithi078.stderr:2023-11-28T19:58:44.329+0000 7f52da463640 -1 Falling back to public interface 2023-11-28T19:58:44.355 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-11-28T19:58:44.353+0000 7f9ab524d180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-11-28T19:58:44.355 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-11-28T19:58:44.356+0000 7f8ad3634180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-11-28T19:58:44.358 INFO:tasks.ceph.osd.3.smithi078.stderr:2023-11-28T19:58:44.357+0000 7f1708b36640 -1 Falling back to public interface 2023-11-28T19:58:44.360 INFO:tasks.ceph.osd.6.smithi179.stderr:2023-11-28T19:58:44.360+0000 7f99504b6640 -1 Falling back to public interface 2023-11-28T19:58:44.367 INFO:tasks.ceph.osd.4.smithi179.stderr:2023-11-28T19:58:44.368+0000 7fc415648640 -1 Falling back to public interface 2023-11-28T19:58:44.371 INFO:tasks.ceph.osd.5.smithi179.stderr:2023-11-28T19:58:44.372+0000 7f6001338640 -1 Falling back to public interface 2023-11-28T19:58:44.372 INFO:tasks.ceph.osd.7.smithi179.stderr:2023-11-28T19:58:44.372+0000 7f1df0e87640 -1 Falling back to public interface 2023-11-28T19:58:44.494 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-11-28T19:58:44.493+0000 7f9ab524d180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-11-28T19:58:44.540 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-11-28T19:58:44.540+0000 7f8ad3634180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-11-28T19:58:44.625 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-11-28T19:58:44.624+0000 7f8ad3634180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-11-28T19:58:44.731 DEBUG:teuthology.orchestra.run.smithi078:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-11-28T19:58:44.764 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-11-28T19:58:44.764+0000 7f8ad3634180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-11-28T19:58:44.858 INFO:teuthology.misc.health.smithi078.stderr:2023-11-28T19:58:44.857+0000 7f8f8ff80640 1 Processor -- start 2023-11-28T19:58:44.859 INFO:teuthology.misc.health.smithi078.stderr:2023-11-28T19:58:44.857+0000 7f8f8ff80640 1 -- start start 2023-11-28T19:58:44.860 INFO:teuthology.misc.health.smithi078.stderr:2023-11-28T19:58:44.857+0000 7f8f8ff80640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f8f880c2af0 0x7f8f88155bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:58:44.861 INFO:teuthology.misc.health.smithi078.stderr:2023-11-28T19:58:44.857+0000 7f8f8ff80640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f8f8806c370 0x7f8f88156130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:58:44.861 INFO:teuthology.misc.health.smithi078.stderr:2023-11-28T19:58:44.857+0000 7f8f8ff80640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8f8806d090 con 0x7f8f880c11b0 2023-11-28T19:58:44.861 INFO:teuthology.misc.health.smithi078.stderr:2023-11-28T19:58:44.857+0000 7f8f8ff80640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8f880c23a0 con 0x7f8f880c2af0 2023-11-28T19:58:44.861 INFO:teuthology.misc.health.smithi078.stderr:2023-11-28T19:58:44.857+0000 7f8f8ff80640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8f880c1de0 con 0x7f8f8806c370 2023-11-28T19:58:44.861 INFO:teuthology.misc.health.smithi078.stderr:2023-11-28T19:58:44.857+0000 7f8f8dd1c640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f8f880c2af0 0x7f8f88155bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:58:44.861 INFO:teuthology.misc.health.smithi078.stderr:2023-11-28T19:58:44.857+0000 7f8f8dd1c640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f8f880c2af0 0x7f8f88155bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:44078/0 (socket says 172.21.15.78:44078) 2023-11-28T19:58:44.861 INFO:teuthology.misc.health.smithi078.stderr:2023-11-28T19:58:44.857+0000 7f8f8dd1c640 1 -- 172.21.15.78:0/328949017 learned_addr learned my addr 172.21.15.78:0/328949017 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T19:58:44.861 INFO:teuthology.misc.health.smithi078.stderr:2023-11-28T19:58:44.857+0000 7f8f8e51d640 1 --2- 172.21.15.78:0/328949017 >> v2:172.21.15.179:3300/0 conn(0x7f8f8806c370 0x7f8f88156130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:58:44.861 INFO:teuthology.misc.health.smithi078.stderr:2023-11-28T19:58:44.857+0000 7f8f8dd1c640 1 -- 172.21.15.78:0/328949017 >> v2:172.21.15.179:3300/0 conn(0x7f8f8806c370 msgr2=0x7f8f88156130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T19:58:44.861 INFO:teuthology.misc.health.smithi078.stderr:2023-11-28T19:58:44.857+0000 7f8f8dd1c640 1 --2- 172.21.15.78:0/328949017 >> v2:172.21.15.179:3300/0 conn(0x7f8f8806c370 0x7f8f88156130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:58:44.861 INFO:teuthology.misc.health.smithi078.stderr:2023-11-28T19:58:44.857+0000 7f8f8dd1c640 1 -- 172.21.15.78:0/328949017 >> v1:172.21.15.179:6789/0 conn(0x7f8f880c11b0 legacy=0x7f8f88158c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:58:44.862 INFO:teuthology.misc.health.smithi078.stderr:2023-11-28T19:58:44.857+0000 7f8f8dd1c640 1 -- 172.21.15.78:0/328949017 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f880c20c0 con 0x7f8f880c2af0 2023-11-28T19:58:44.862 INFO:teuthology.misc.health.smithi078.stderr:2023-11-28T19:58:44.857+0000 7f8f8cd1a640 1 -- 172.21.15.78:0/328949017 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2566726329 0 0) 0x7f8f8806d090 con 0x7f8f880c11b0 2023-11-28T19:58:44.864 INFO:teuthology.misc.health.smithi078.stderr:2023-11-28T19:58:44.861+0000 7f8f8dd1c640 1 --2- 172.21.15.78:0/328949017 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8f880c2af0 0x7f8f88155bf0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f8f880c5180 tx=0x7f8f8401c3e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=80279c3950686e1 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:58:44.864 INFO:teuthology.misc.health.smithi078.stderr:2023-11-28T19:58:44.861+0000 7f8f8cd1a640 1 -- 172.21.15.78:0/328949017 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f840ab600 con 0x7f8f880c2af0 2023-11-28T19:58:44.864 INFO:teuthology.misc.health.smithi078.stderr:2023-11-28T19:58:44.861+0000 7f8f8cd1a640 1 -- 172.21.15.78:0/328949017 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f840a7050 con 0x7f8f880c2af0 2023-11-28T19:58:44.864 INFO:teuthology.misc.health.smithi078.stderr:2023-11-28T19:58:44.861+0000 7f8f8cd1a640 1 -- 172.21.15.78:0/328949017 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f840ab980 con 0x7f8f880c2af0 2023-11-28T19:58:44.865 INFO:teuthology.misc.health.smithi078.stderr:2023-11-28T19:58:44.861+0000 7f8f8ff80640 1 -- 172.21.15.78:0/328949017 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8f880c2af0 msgr2=0x7f8f88155bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:58:44.865 INFO:teuthology.misc.health.smithi078.stderr:2023-11-28T19:58:44.861+0000 7f8f8ff80640 1 --2- 172.21.15.78:0/328949017 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8f880c2af0 0x7f8f88155bf0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f8f880c5180 tx=0x7f8f8401c3e0 comp rx=0 tx=0).stop 2023-11-28T19:58:44.865 INFO:teuthology.misc.health.smithi078.stderr:2023-11-28T19:58:44.861+0000 7f8f8ff80640 1 -- 172.21.15.78:0/328949017 shutdown_connections 2023-11-28T19:58:44.865 INFO:teuthology.misc.health.smithi078.stderr:2023-11-28T19:58:44.861+0000 7f8f8ff80640 1 --2- 172.21.15.78:0/328949017 >> v2:172.21.15.179:3300/0 conn(0x7f8f8806c370 0x7f8f88156130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:58:44.865 INFO:teuthology.misc.health.smithi078.stderr:2023-11-28T19:58:44.861+0000 7f8f8ff80640 1 --2- 172.21.15.78:0/328949017 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8f880c2af0 0x7f8f88155bf0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:58:44.865 INFO:teuthology.misc.health.smithi078.stderr:2023-11-28T19:58:44.861+0000 7f8f8ff80640 1 -- 172.21.15.78:0/328949017 >> 172.21.15.78:0/328949017 conn(0x7f8f880c5f60 msgr2=0x7f8f880c6370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T19:58:44.865 INFO:teuthology.misc.health.smithi078.stderr:2023-11-28T19:58:44.861+0000 7f8f8ff80640 1 -- 172.21.15.78:0/328949017 shutdown_connections 2023-11-28T19:58:44.865 INFO:teuthology.misc.health.smithi078.stderr:2023-11-28T19:58:44.861+0000 7f8f8ff80640 1 -- 172.21.15.78:0/328949017 wait complete. 2023-11-28T19:58:44.866 INFO:teuthology.misc.health.smithi078.stderr:2023-11-28T19:58:44.865+0000 7f8f8ff80640 1 Processor -- start 2023-11-28T19:58:44.866 INFO:teuthology.misc.health.smithi078.stderr:2023-11-28T19:58:44.865+0000 7f8f8ff80640 1 -- start start 2023-11-28T19:58:44.868 INFO:teuthology.misc.health.smithi078.stderr:2023-11-28T19:58:44.865+0000 7f8f8ff80640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8f8806c370 0x7f8f880a51a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:58:44.868 INFO:teuthology.misc.health.smithi078.stderr:2023-11-28T19:58:44.865+0000 7f8f8ff80640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8f880c11b0 0x7f8f881f47e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:58:44.868 INFO:teuthology.misc.health.smithi078.stderr:2023-11-28T19:58:44.865+0000 7f8f8ff80640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8f880c2af0 0x7f8f880a9620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:58:44.868 INFO:teuthology.misc.health.smithi078.stderr:2023-11-28T19:58:44.865+0000 7f8f8ff80640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f8814fb70 con 0x7f8f8806c370 2023-11-28T19:58:44.869 INFO:teuthology.misc.health.smithi078.stderr:2023-11-28T19:58:44.865+0000 7f8f8ff80640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f8814fe50 con 0x7f8f880c2af0 2023-11-28T19:58:44.869 INFO:teuthology.misc.health.smithi078.stderr:2023-11-28T19:58:44.865+0000 7f8f8ff80640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8f881f5270 con 0x7f8f880c11b0 2023-11-28T19:58:44.869 INFO:teuthology.misc.health.smithi078.stderr:2023-11-28T19:58:44.865+0000 7f8f8dd1c640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8f8806c370 0x7f8f880a51a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:58:44.869 INFO:teuthology.misc.health.smithi078.stderr:2023-11-28T19:58:44.865+0000 7f8f8dd1c640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8f8806c370 0x7f8f880a51a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:44092/0 (socket says 172.21.15.78:44092) 2023-11-28T19:58:44.869 INFO:teuthology.misc.health.smithi078.stderr:2023-11-28T19:58:44.865+0000 7f8f8dd1c640 1 -- 172.21.15.78:0/2620830158 learned_addr learned my addr 172.21.15.78:0/2620830158 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T19:58:44.869 INFO:teuthology.misc.health.smithi078.stderr:2023-11-28T19:58:44.865+0000 7f8f8e51d640 1 --2- 172.21.15.78:0/2620830158 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8f880c2af0 0x7f8f880a9620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:58:44.870 INFO:teuthology.misc.health.smithi078.stderr:2023-11-28T19:58:44.865+0000 7f8f8d51b640 1 --2- 172.21.15.78:0/2620830158 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8f880c11b0 0x7f8f881f47e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:58:44.871 INFO:teuthology.misc.health.smithi078.stderr:2023-11-28T19:58:44.865+0000 7f8f8e51d640 1 -- 172.21.15.78:0/2620830158 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8f880c11b0 msgr2=0x7f8f881f47e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:58:44.871 INFO:teuthology.misc.health.smithi078.stderr:2023-11-28T19:58:44.865+0000 7f8f8e51d640 1 --2- 172.21.15.78:0/2620830158 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8f880c11b0 0x7f8f881f47e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:58:44.871 INFO:teuthology.misc.health.smithi078.stderr:2023-11-28T19:58:44.865+0000 7f8f8e51d640 1 -- 172.21.15.78:0/2620830158 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8f8806c370 msgr2=0x7f8f880a51a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:58:44.871 INFO:teuthology.misc.health.smithi078.stderr:2023-11-28T19:58:44.865+0000 7f8f8e51d640 1 --2- 172.21.15.78:0/2620830158 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8f8806c370 0x7f8f880a51a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:58:44.871 INFO:teuthology.misc.health.smithi078.stderr:2023-11-28T19:58:44.865+0000 7f8f8e51d640 1 -- 172.21.15.78:0/2620830158 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f840094d0 con 0x7f8f880c2af0 2023-11-28T19:58:44.871 INFO:teuthology.misc.health.smithi078.stderr:2023-11-28T19:58:44.865+0000 7f8f8dd1c640 1 --2- 172.21.15.78:0/2620830158 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8f8806c370 0x7f8f880a51a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T19:58:44.872 INFO:teuthology.misc.health.smithi078.stderr:2023-11-28T19:58:44.865+0000 7f8f8e51d640 1 --2- 172.21.15.78:0/2620830158 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8f880c2af0 0x7f8f880a9620 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f8f8000efc0 tx=0x7f8f8000c490 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:58:44.872 INFO:teuthology.misc.health.smithi078.stderr:2023-11-28T19:58:44.865+0000 7f8f7e7fc640 1 -- 172.21.15.78:0/2620830158 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f80009c00 con 0x7f8f880c2af0 2023-11-28T19:58:44.872 INFO:teuthology.misc.health.smithi078.stderr:2023-11-28T19:58:44.865+0000 7f8f7e7fc640 1 -- 172.21.15.78:0/2620830158 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f8000f040 con 0x7f8f880c2af0 2023-11-28T19:58:44.872 INFO:teuthology.misc.health.smithi078.stderr:2023-11-28T19:58:44.865+0000 7f8f8ff80640 1 -- 172.21.15.78:0/2620830158 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8f880ab400 con 0x7f8f880c2af0 2023-11-28T19:58:44.872 INFO:teuthology.misc.health.smithi078.stderr:2023-11-28T19:58:44.865+0000 7f8f7e7fc640 1 -- 172.21.15.78:0/2620830158 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f800146c0 con 0x7f8f880c2af0 2023-11-28T19:58:44.872 INFO:teuthology.misc.health.smithi078.stderr:2023-11-28T19:58:44.865+0000 7f8f8ff80640 1 -- 172.21.15.78:0/2620830158 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8f881f4d20 con 0x7f8f880c2af0 2023-11-28T19:58:44.872 INFO:teuthology.misc.health.smithi078.stderr:2023-11-28T19:58:44.865+0000 7f8f7e7fc640 1 -- 172.21.15.78:0/2620830158 <== mon.1 v2:172.21.15.179:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f8f80014b20 con 0x7f8f880c2af0 2023-11-28T19:58:44.872 INFO:teuthology.misc.health.smithi078.stderr:2023-11-28T19:58:44.865+0000 7f8f7e7fc640 1 -- 172.21.15.78:0/2620830158 <== mon.1 v2:172.21.15.179:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1645+0+0 (secure 0 0 0) 0x7f8f80014dd0 con 0x7f8f880c2af0 2023-11-28T19:58:44.872 INFO:teuthology.misc.health.smithi078.stderr:2023-11-28T19:58:44.869+0000 7f8f8ff80640 1 -- 172.21.15.78:0/2620830158 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8f881f54b0 con 0x7f8f880c2af0 2023-11-28T19:58:44.873 INFO:teuthology.misc.health.smithi078.stderr:2023-11-28T19:58:44.869+0000 7f8f7e7fc640 1 -- 172.21.15.78:0/2620830158 <== mon.1 v2:172.21.15.179:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72898 (secure 0 0 0) 0x7f8f8003bce0 con 0x7f8f880c2af0 2023-11-28T19:58:44.929 INFO:teuthology.misc.health.smithi078.stderr:2023-11-28T19:58:44.925+0000 7f8f8ff80640 1 -- 172.21.15.78:0/2620830158 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f8f880ab5f0 con 0x7f8f880c2af0 2023-11-28T19:58:44.929 INFO:teuthology.misc.health.smithi078.stderr:2023-11-28T19:58:44.925+0000 7f8f7e7fc640 1 -- 172.21.15.78:0/2620830158 <== mon.1 v2:172.21.15.179:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7057 (secure 0 0 0) 0x7f8f8002a070 con 0x7f8f880c2af0 2023-11-28T19:58:44.930 INFO:teuthology.misc.health.smithi078.stdout: 2023-11-28T19:58:44.930 INFO:teuthology.misc.health.smithi078.stdout:{"epoch":10,"fsid":"dd9780e8-3bda-44fa-a9f0-fa07d19d901d","created":"2023-11-28T19:58:40.969556+0000","modified":"2023-11-28T19:58:43.609275+0000","last_up_change":"0.000000","last_in_change":"2023-11-28T19:58:43.609275+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"e84245ac-b5da-429e-af18-39acaa2b33e4","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"e634831d-c4e2-48d9-870c-9556ae162981","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"274c8395-6534-41f0-b8fb-a00af8985aa8","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"77acc9af-7d4d-4b18-8cf5-d62f5971b7c8","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"5c62bc66-6b34-4b7f-a66b-9a743969138c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"67db6d36-f684-4079-b0cd-82b4dd61461f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"12e670af-5a16-4c81-9f97-defa66cab967","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"fe630650-2eb3-49ad-8676-c341e6332eb1","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-28T19:58:44.931 INFO:teuthology.misc.health.smithi078.stderr:2023-11-28T19:58:44.929+0000 7f8f8ff80640 1 -- 172.21.15.78:0/2620830158 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8f880c2af0 msgr2=0x7f8f880a9620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:58:44.931 INFO:teuthology.misc.health.smithi078.stderr:2023-11-28T19:58:44.929+0000 7f8f8ff80640 1 --2- 172.21.15.78:0/2620830158 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8f880c2af0 0x7f8f880a9620 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f8f8000efc0 tx=0x7f8f8000c490 comp rx=0 tx=0).stop 2023-11-28T19:58:44.932 INFO:teuthology.misc.health.smithi078.stderr:2023-11-28T19:58:44.929+0000 7f8f8ff80640 1 -- 172.21.15.78:0/2620830158 shutdown_connections 2023-11-28T19:58:44.932 INFO:teuthology.misc.health.smithi078.stderr:2023-11-28T19:58:44.929+0000 7f8f8ff80640 1 --2- 172.21.15.78:0/2620830158 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8f880c11b0 0x7f8f881f47e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:58:44.932 INFO:teuthology.misc.health.smithi078.stderr:2023-11-28T19:58:44.929+0000 7f8f8ff80640 1 --2- 172.21.15.78:0/2620830158 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8f880c2af0 0x7f8f880a9620 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:58:44.932 INFO:teuthology.misc.health.smithi078.stderr:2023-11-28T19:58:44.929+0000 7f8f8ff80640 1 --2- 172.21.15.78:0/2620830158 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8f8806c370 0x7f8f880a51a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:58:44.932 INFO:teuthology.misc.health.smithi078.stderr:2023-11-28T19:58:44.929+0000 7f8f8ff80640 1 -- 172.21.15.78:0/2620830158 >> 172.21.15.78:0/2620830158 conn(0x7f8f880c5f60 msgr2=0x7f8f880c0460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T19:58:44.932 INFO:teuthology.misc.health.smithi078.stderr:2023-11-28T19:58:44.929+0000 7f8f8ff80640 1 -- 172.21.15.78:0/2620830158 shutdown_connections 2023-11-28T19:58:44.933 INFO:teuthology.misc.health.smithi078.stderr:2023-11-28T19:58:44.929+0000 7f8f8ff80640 1 -- 172.21.15.78:0/2620830158 wait complete. 2023-11-28T19:58:44.947 DEBUG:teuthology.misc:0 of 8 OSDs are up 2023-11-28T19:58:45.177 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-11-28T19:58:45.173+0000 7f9ab524d180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-11-28T19:58:45.264 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-11-28T19:58:45.261+0000 7f9ab524d180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-11-28T19:58:45.438 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-11-28T19:58:45.436+0000 7f8ad3634180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-11-28T19:58:45.454 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-11-28T19:58:45.453+0000 7f9ab524d180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-11-28T19:58:45.525 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-11-28T19:58:45.524+0000 7f8ad3634180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-11-28T19:58:45.539 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-11-28T19:58:45.537+0000 7f9ab524d180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-11-28T19:58:45.716 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-11-28T19:58:45.716+0000 7f8ad3634180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-11-28T19:58:45.801 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-11-28T19:58:45.800+0000 7f8ad3634180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-11-28T19:58:45.866 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-11-28T19:58:45.865+0000 7f9ab524d180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-11-28T19:58:45.934 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-11-28T19:58:45.933+0000 7f9ab524d180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-11-28T19:58:46.133 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-11-28T19:58:46.132+0000 7f8ad3634180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-11-28T19:58:46.201 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-11-28T19:58:46.200+0000 7f8ad3634180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-11-28T19:58:46.956 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-11-28T19:58:46.953+0000 7f9a5be74640 -1 mgr.server handle_report got status from non-daemon mon.b 2023-11-28T19:58:46.956 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-11-28T19:58:46.953+0000 7f9a5be74640 -1 mgr.server handle_report got status from non-daemon mon.c 2023-11-28T19:58:48.166 INFO:tasks.ceph.osd.4.smithi179.stderr:2023-11-28T19:58:48.164+0000 7fc415648640 -1 osd.4 0 log_to_monitors true 2023-11-28T19:58:48.208 INFO:tasks.ceph.osd.0.smithi078.stderr:2023-11-28T19:58:48.205+0000 7fd068080640 -1 osd.0 0 log_to_monitors true 2023-11-28T19:58:48.280 INFO:tasks.ceph.osd.5.smithi179.stderr:2023-11-28T19:58:48.280+0000 7f6001338640 -1 osd.5 0 log_to_monitors true 2023-11-28T19:58:48.284 INFO:tasks.ceph.osd.3.smithi078.stderr:2023-11-28T19:58:48.281+0000 7f1708b36640 -1 osd.3 0 log_to_monitors true 2023-11-28T19:58:48.315 INFO:tasks.ceph.osd.6.smithi179.stderr:2023-11-28T19:58:48.316+0000 7f99504b6640 -1 osd.6 0 log_to_monitors true 2023-11-28T19:58:48.338 INFO:tasks.ceph.osd.7.smithi179.stderr:2023-11-28T19:58:48.336+0000 7f1df0e87640 -1 osd.7 0 log_to_monitors true 2023-11-28T19:58:48.444 INFO:tasks.ceph.osd.1.smithi078.stderr:2023-11-28T19:58:48.441+0000 7fd0cbb80640 -1 osd.1 0 log_to_monitors true 2023-11-28T19:58:48.540 INFO:tasks.ceph.osd.2.smithi078.stderr:2023-11-28T19:58:48.537+0000 7f52da463640 -1 osd.2 0 log_to_monitors true 2023-11-28T19:58:51.557 INFO:tasks.ceph.osd.2.smithi078.stderr:2023-11-28T19:58:51.553+0000 7f52d6c1e640 -1 osd.2 0 waiting for initial osdmap 2023-11-28T19:58:51.560 INFO:tasks.ceph.osd.1.smithi078.stderr:2023-11-28T19:58:51.557+0000 7fd0c7b29640 -1 osd.1 0 waiting for initial osdmap 2023-11-28T19:58:51.563 INFO:tasks.ceph.osd.7.smithi179.stderr:2023-11-28T19:58:51.563+0000 7f1ded642640 -1 osd.7 0 waiting for initial osdmap 2023-11-28T19:58:51.570 INFO:tasks.ceph.osd.6.smithi179.stderr:2023-11-28T19:58:51.567+0000 7f994c45f640 -1 osd.6 0 waiting for initial osdmap 2023-11-28T19:58:51.579 INFO:tasks.ceph.osd.0.smithi078.stderr:2023-11-28T19:58:51.577+0000 7fd06483b640 -1 osd.0 0 waiting for initial osdmap 2023-11-28T19:58:51.586 INFO:tasks.ceph.osd.4.smithi179.stderr:2023-11-28T19:58:51.583+0000 7fc4115fd640 -1 osd.4 0 waiting for initial osdmap 2023-11-28T19:58:51.595 INFO:tasks.ceph.osd.1.smithi078.stderr:2023-11-28T19:58:51.593+0000 7fd0bf964640 -1 osd.1 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-11-28T19:58:51.596 INFO:tasks.ceph.osd.7.smithi179.stderr:2023-11-28T19:58:51.595+0000 7f1de4c6b640 -1 osd.7 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-11-28T19:58:51.611 INFO:tasks.ceph.osd.0.smithi078.stderr:2023-11-28T19:58:51.609+0000 7fd05be64640 -1 osd.0 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-11-28T19:58:51.611 INFO:tasks.ceph.osd.2.smithi078.stderr:2023-11-28T19:58:51.609+0000 7f52ce247640 -1 osd.2 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-11-28T19:58:51.612 INFO:tasks.ceph.osd.6.smithi179.stderr:2023-11-28T19:58:51.611+0000 7f994429a640 -1 osd.6 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-11-28T19:58:51.619 INFO:tasks.ceph.osd.5.smithi179.stderr:2023-11-28T19:58:51.615+0000 7f5ffdaf3640 -1 osd.5 0 waiting for initial osdmap 2023-11-28T19:58:51.620 INFO:tasks.ceph.osd.4.smithi179.stderr:2023-11-28T19:58:51.619+0000 7fc409438640 -1 osd.4 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-11-28T19:58:51.640 INFO:tasks.ceph.osd.3.smithi078.stderr:2023-11-28T19:58:51.637+0000 7f1704adf640 -1 osd.3 0 waiting for initial osdmap 2023-11-28T19:58:51.644 INFO:tasks.ceph.osd.5.smithi179.stderr:2023-11-28T19:58:51.643+0000 7f5ff511c640 -1 osd.5 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-11-28T19:58:51.666 INFO:tasks.ceph.osd.3.smithi078.stderr:2023-11-28T19:58:51.661+0000 7f16fc91a640 -1 osd.3 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-11-28T19:58:51.754 DEBUG:teuthology.orchestra.run.smithi078:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-11-28T19:58:51.879 INFO:teuthology.misc.health.smithi078.stderr:2023-11-28T19:58:51.877+0000 7f36445e6640 1 Processor -- start 2023-11-28T19:58:51.880 INFO:teuthology.misc.health.smithi078.stderr:2023-11-28T19:58:51.877+0000 7f36445e6640 1 -- start start 2023-11-28T19:58:51.881 INFO:teuthology.misc.health.smithi078.stderr:2023-11-28T19:58:51.877+0000 7f36445e6640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f363c14f960 0x7f363c0c2890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:58:51.881 INFO:teuthology.misc.health.smithi078.stderr:2023-11-28T19:58:51.877+0000 7f36445e6640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f363c0c2dd0 0x7f363c152a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:58:51.881 INFO:teuthology.misc.health.smithi078.stderr:2023-11-28T19:58:51.877+0000 7f36445e6640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f363c0c1e60 con 0x7f363c14fd40 2023-11-28T19:58:51.881 INFO:teuthology.misc.health.smithi078.stderr:2023-11-28T19:58:51.877+0000 7f36445e6640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f363c1566f0 con 0x7f363c14f960 2023-11-28T19:58:51.881 INFO:teuthology.misc.health.smithi078.stderr:2023-11-28T19:58:51.877+0000 7f36445e6640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f363c155930 con 0x7f363c0c2dd0 2023-11-28T19:58:51.881 INFO:teuthology.misc.health.smithi078.stderr:2023-11-28T19:58:51.877+0000 7f3642382640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f363c14f960 0x7f363c0c2890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:58:51.881 INFO:teuthology.misc.health.smithi078.stderr:2023-11-28T19:58:51.877+0000 7f3641b81640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f363c14fd40 0x7f363c152320 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:56216/0 (socket says 172.21.15.78:56216) 2023-11-28T19:58:51.881 INFO:teuthology.misc.health.smithi078.stderr:2023-11-28T19:58:51.877+0000 7f3641b81640 1 -- 172.21.15.78:0/1844287023 learned_addr learned my addr 172.21.15.78:0/1844287023 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-11-28T19:58:51.882 INFO:teuthology.misc.health.smithi078.stderr:2023-11-28T19:58:51.877+0000 7f3642382640 1 -- 172.21.15.78:0/1844287023 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f363c0c2dd0 msgr2=0x7f363c152a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T19:58:51.882 INFO:teuthology.misc.health.smithi078.stderr:2023-11-28T19:58:51.877+0000 7f3642382640 1 --2- 172.21.15.78:0/1844287023 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f363c0c2dd0 0x7f363c152a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:58:51.882 INFO:teuthology.misc.health.smithi078.stderr:2023-11-28T19:58:51.877+0000 7f3642382640 1 -- 172.21.15.78:0/1844287023 >> v1:172.21.15.78:6789/0 conn(0x7f363c14fd40 legacy=0x7f363c152320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:58:51.882 INFO:teuthology.misc.health.smithi078.stderr:2023-11-28T19:58:51.877+0000 7f3642382640 1 -- 172.21.15.78:0/1844287023 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f363c155c10 con 0x7f363c14f960 2023-11-28T19:58:51.882 INFO:teuthology.misc.health.smithi078.stderr:2023-11-28T19:58:51.877+0000 7f3641380640 1 -- 172.21.15.78:0/1844287023 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2181029063 0 0) 0x7f363c0c1e60 con 0x7f363c14fd40 2023-11-28T19:58:51.885 INFO:teuthology.misc.health.smithi078.stderr:2023-11-28T19:58:51.881+0000 7f3642382640 1 --2- 172.21.15.78:0/1844287023 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f363c14f960 0x7f363c0c2890 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f36380097c0 tx=0x7f363801c3f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1bb56deed9b37229 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:58:51.885 INFO:teuthology.misc.health.smithi078.stderr:2023-11-28T19:58:51.881+0000 7f3641380640 1 -- 172.21.15.78:0/1844287023 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36380ab5f0 con 0x7f363c14f960 2023-11-28T19:58:51.885 INFO:teuthology.misc.health.smithi078.stderr:2023-11-28T19:58:51.881+0000 7f3641380640 1 -- 172.21.15.78:0/1844287023 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f36380ab750 con 0x7f363c14f960 2023-11-28T19:58:51.885 INFO:teuthology.misc.health.smithi078.stderr:2023-11-28T19:58:51.881+0000 7f3641380640 1 -- 172.21.15.78:0/1844287023 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36380abae0 con 0x7f363c14f960 2023-11-28T19:58:51.886 INFO:teuthology.misc.health.smithi078.stderr:2023-11-28T19:58:51.881+0000 7f36445e6640 1 -- 172.21.15.78:0/1844287023 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f363c14f960 msgr2=0x7f363c0c2890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:58:51.886 INFO:teuthology.misc.health.smithi078.stderr:2023-11-28T19:58:51.881+0000 7f36445e6640 1 --2- 172.21.15.78:0/1844287023 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f363c14f960 0x7f363c0c2890 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f36380097c0 tx=0x7f363801c3f0 comp rx=0 tx=0).stop 2023-11-28T19:58:51.886 INFO:teuthology.misc.health.smithi078.stderr:2023-11-28T19:58:51.881+0000 7f36445e6640 1 -- 172.21.15.78:0/1844287023 shutdown_connections 2023-11-28T19:58:51.886 INFO:teuthology.misc.health.smithi078.stderr:2023-11-28T19:58:51.881+0000 7f36445e6640 1 --2- 172.21.15.78:0/1844287023 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f363c0c2dd0 0x7f363c152a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:58:51.886 INFO:teuthology.misc.health.smithi078.stderr:2023-11-28T19:58:51.881+0000 7f36445e6640 1 --2- 172.21.15.78:0/1844287023 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f363c14f960 0x7f363c0c2890 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:58:51.886 INFO:teuthology.misc.health.smithi078.stderr:2023-11-28T19:58:51.881+0000 7f36445e6640 1 -- 172.21.15.78:0/1844287023 >> 172.21.15.78:0/1844287023 conn(0x7f363c0c5f60 msgr2=0x7f363c0c6370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T19:58:51.886 INFO:teuthology.misc.health.smithi078.stderr:2023-11-28T19:58:51.881+0000 7f36445e6640 1 -- 172.21.15.78:0/1844287023 shutdown_connections 2023-11-28T19:58:51.886 INFO:teuthology.misc.health.smithi078.stderr:2023-11-28T19:58:51.881+0000 7f36445e6640 1 -- 172.21.15.78:0/1844287023 wait complete. 2023-11-28T19:58:51.887 INFO:teuthology.misc.health.smithi078.stderr:2023-11-28T19:58:51.885+0000 7f36445e6640 1 Processor -- start 2023-11-28T19:58:51.887 INFO:teuthology.misc.health.smithi078.stderr:2023-11-28T19:58:51.885+0000 7f36445e6640 1 -- start start 2023-11-28T19:58:51.890 INFO:teuthology.misc.health.smithi078.stderr:2023-11-28T19:58:51.885+0000 7f36445e6640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f363c0c2dd0 0x7f363c140d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:58:51.891 INFO:teuthology.misc.health.smithi078.stderr:2023-11-28T19:58:51.885+0000 7f36445e6640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f363c14f960 0x7f363c141270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:58:51.891 INFO:teuthology.misc.health.smithi078.stderr:2023-11-28T19:58:51.885+0000 7f36445e6640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f363c14fd40 0x7f363c1efe10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:58:51.891 INFO:teuthology.misc.health.smithi078.stderr:2023-11-28T19:58:51.885+0000 7f36445e6640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f363c1515e0 con 0x7f363c0c2dd0 2023-11-28T19:58:51.891 INFO:teuthology.misc.health.smithi078.stderr:2023-11-28T19:58:51.885+0000 7f36445e6640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f363c152310 con 0x7f363c14f960 2023-11-28T19:58:51.891 INFO:teuthology.misc.health.smithi078.stderr:2023-11-28T19:58:51.885+0000 7f36445e6640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f363c1417b0 con 0x7f363c14fd40 2023-11-28T19:58:51.891 INFO:teuthology.misc.health.smithi078.stderr:2023-11-28T19:58:51.885+0000 7f3642382640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f363c0c2dd0 0x7f363c140d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:58:51.891 INFO:teuthology.misc.health.smithi078.stderr:2023-11-28T19:58:51.885+0000 7f3642382640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f363c0c2dd0 0x7f363c140d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:34212/0 (socket says 172.21.15.78:34212) 2023-11-28T19:58:51.892 INFO:teuthology.misc.health.smithi078.stderr:2023-11-28T19:58:51.885+0000 7f3642382640 1 -- 172.21.15.78:0/2077084181 learned_addr learned my addr 172.21.15.78:0/2077084181 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T19:58:51.892 INFO:teuthology.misc.health.smithi078.stderr:2023-11-28T19:58:51.885+0000 7f3642b83640 1 --2- 172.21.15.78:0/2077084181 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f363c14fd40 0x7f363c1efe10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:58:51.892 INFO:teuthology.misc.health.smithi078.stderr:2023-11-28T19:58:51.885+0000 7f3641b81640 1 --2- 172.21.15.78:0/2077084181 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f363c14f960 0x7f363c141270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:58:51.892 INFO:teuthology.misc.health.smithi078.stderr:2023-11-28T19:58:51.885+0000 7f3642382640 1 -- 172.21.15.78:0/2077084181 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f363c14fd40 msgr2=0x7f363c1efe10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:58:51.892 INFO:teuthology.misc.health.smithi078.stderr:2023-11-28T19:58:51.885+0000 7f3642382640 1 --2- 172.21.15.78:0/2077084181 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f363c14fd40 0x7f363c1efe10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:58:51.892 INFO:teuthology.misc.health.smithi078.stderr:2023-11-28T19:58:51.885+0000 7f3642382640 1 -- 172.21.15.78:0/2077084181 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f363c14f960 msgr2=0x7f363c141270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:58:51.893 INFO:teuthology.misc.health.smithi078.stderr:2023-11-28T19:58:51.885+0000 7f3642382640 1 --2- 172.21.15.78:0/2077084181 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f363c14f960 0x7f363c141270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:58:51.893 INFO:teuthology.misc.health.smithi078.stderr:2023-11-28T19:58:51.885+0000 7f3642382640 1 -- 172.21.15.78:0/2077084181 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3638009420 con 0x7f363c0c2dd0 2023-11-28T19:58:51.893 INFO:teuthology.misc.health.smithi078.stderr:2023-11-28T19:58:51.885+0000 7f3642382640 1 --2- 172.21.15.78:0/2077084181 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f363c0c2dd0 0x7f363c140d30 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f36380ad040 tx=0x7f363801ac30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:58:51.893 INFO:teuthology.misc.health.smithi078.stderr:2023-11-28T19:58:51.885+0000 7f3632ffd640 1 -- 172.21.15.78:0/2077084181 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36380bf610 con 0x7f363c0c2dd0 2023-11-28T19:58:51.893 INFO:teuthology.misc.health.smithi078.stderr:2023-11-28T19:58:51.885+0000 7f3632ffd640 1 -- 172.21.15.78:0/2077084181 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f36380bf7b0 con 0x7f363c0c2dd0 2023-11-28T19:58:51.894 INFO:teuthology.misc.health.smithi078.stderr:2023-11-28T19:58:51.885+0000 7f36445e6640 1 -- 172.21.15.78:0/2077084181 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f363c150850 con 0x7f363c0c2dd0 2023-11-28T19:58:51.894 INFO:teuthology.misc.health.smithi078.stderr:2023-11-28T19:58:51.885+0000 7f3632ffd640 1 -- 172.21.15.78:0/2077084181 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36380bfb60 con 0x7f363c0c2dd0 2023-11-28T19:58:51.894 INFO:teuthology.misc.health.smithi078.stderr:2023-11-28T19:58:51.885+0000 7f36445e6640 1 -- 172.21.15.78:0/2077084181 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f363c150f20 con 0x7f363c0c2dd0 2023-11-28T19:58:51.895 INFO:teuthology.misc.health.smithi078.stderr:2023-11-28T19:58:51.889+0000 7f36445e6640 1 -- 172.21.15.78:0/2077084181 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f363c0707c0 con 0x7f363c0c2dd0 2023-11-28T19:58:51.896 INFO:teuthology.misc.health.smithi078.stderr:2023-11-28T19:58:51.889+0000 7f3632ffd640 1 -- 172.21.15.78:0/2077084181 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 4) v1 ==== 85796+0+0 (secure 0 0 0) 0x7f36380b5400 con 0x7f363c0c2dd0 2023-11-28T19:58:51.896 INFO:teuthology.misc.health.smithi078.stderr:2023-11-28T19:58:51.889+0000 7f3632ffd640 1 --2- 172.21.15.78:0/2077084181 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f36200663e0 0x7f36200688a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:58:51.897 INFO:teuthology.misc.health.smithi078.stderr:2023-11-28T19:58:51.889+0000 7f3632ffd640 1 -- 172.21.15.78:0/2077084181 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(12..12 src has 1..12) v4 ==== 2231+0+0 (secure 0 0 0) 0x7f36380a8050 con 0x7f363c0c2dd0 2023-11-28T19:58:51.897 INFO:teuthology.misc.health.smithi078.stderr:2023-11-28T19:58:51.889+0000 7f3641b81640 1 --2- 172.21.15.78:0/2077084181 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f36200663e0 0x7f36200688a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:58:51.897 INFO:teuthology.misc.health.smithi078.stderr:2023-11-28T19:58:51.889+0000 7f3641b81640 1 --2- 172.21.15.78:0/2077084181 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f36200663e0 0x7f36200688a0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f363c0bfd80 tx=0x7f362c007d60 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:58:51.898 INFO:teuthology.misc.health.smithi078.stderr:2023-11-28T19:58:51.893+0000 7f3632ffd640 1 -- 172.21.15.78:0/2077084181 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f36380ebef0 con 0x7f363c0c2dd0 2023-11-28T19:58:52.053 INFO:teuthology.misc.health.smithi078.stderr:2023-11-28T19:58:52.049+0000 7f36445e6640 1 -- 172.21.15.78:0/2077084181 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f363c067630 con 0x7f363c0c2dd0 2023-11-28T19:58:52.053 INFO:teuthology.misc.health.smithi078.stderr:2023-11-28T19:58:52.049+0000 7f3632ffd640 1 -- 172.21.15.78:0/2077084181 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v12) v1 ==== 74+0+7057 (secure 0 0 0) 0x7f36380ef510 con 0x7f363c0c2dd0 2023-11-28T19:58:52.054 INFO:teuthology.misc.health.smithi078.stdout: 2023-11-28T19:58:52.054 INFO:teuthology.misc.health.smithi078.stdout:{"epoch":12,"fsid":"dd9780e8-3bda-44fa-a9f0-fa07d19d901d","created":"2023-11-28T19:58:40.969556+0000","modified":"2023-11-28T19:58:49.963211+0000","last_up_change":"0.000000","last_in_change":"2023-11-28T19:58:43.609275+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"e84245ac-b5da-429e-af18-39acaa2b33e4","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"e634831d-c4e2-48d9-870c-9556ae162981","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"274c8395-6534-41f0-b8fb-a00af8985aa8","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"77acc9af-7d4d-4b18-8cf5-d62f5971b7c8","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"5c62bc66-6b34-4b7f-a66b-9a743969138c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"67db6d36-f684-4079-b0cd-82b4dd61461f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"12e670af-5a16-4c81-9f97-defa66cab967","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"fe630650-2eb3-49ad-8676-c341e6332eb1","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-28T19:58:52.056 INFO:teuthology.misc.health.smithi078.stderr:2023-11-28T19:58:52.053+0000 7f36445e6640 1 -- 172.21.15.78:0/2077084181 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f36200663e0 msgr2=0x7f36200688a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:58:52.056 INFO:teuthology.misc.health.smithi078.stderr:2023-11-28T19:58:52.053+0000 7f36445e6640 1 --2- 172.21.15.78:0/2077084181 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f36200663e0 0x7f36200688a0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f363c0bfd80 tx=0x7f362c007d60 comp rx=0 tx=0).stop 2023-11-28T19:58:52.056 INFO:teuthology.misc.health.smithi078.stderr:2023-11-28T19:58:52.053+0000 7f36445e6640 1 -- 172.21.15.78:0/2077084181 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f363c0c2dd0 msgr2=0x7f363c140d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:58:52.056 INFO:teuthology.misc.health.smithi078.stderr:2023-11-28T19:58:52.053+0000 7f36445e6640 1 --2- 172.21.15.78:0/2077084181 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f363c0c2dd0 0x7f363c140d30 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f36380ad040 tx=0x7f363801ac30 comp rx=0 tx=0).stop 2023-11-28T19:58:52.056 INFO:teuthology.misc.health.smithi078.stderr:2023-11-28T19:58:52.053+0000 7f36445e6640 1 -- 172.21.15.78:0/2077084181 shutdown_connections 2023-11-28T19:58:52.057 INFO:teuthology.misc.health.smithi078.stderr:2023-11-28T19:58:52.053+0000 7f36445e6640 1 --2- 172.21.15.78:0/2077084181 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f36200663e0 0x7f36200688a0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:58:52.057 INFO:teuthology.misc.health.smithi078.stderr:2023-11-28T19:58:52.053+0000 7f36445e6640 1 --2- 172.21.15.78:0/2077084181 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f363c14fd40 0x7f363c1efe10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:58:52.057 INFO:teuthology.misc.health.smithi078.stderr:2023-11-28T19:58:52.053+0000 7f36445e6640 1 --2- 172.21.15.78:0/2077084181 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f363c14f960 0x7f363c141270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:58:52.057 INFO:teuthology.misc.health.smithi078.stderr:2023-11-28T19:58:52.053+0000 7f36445e6640 1 --2- 172.21.15.78:0/2077084181 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f363c0c2dd0 0x7f363c140d30 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:58:52.057 INFO:teuthology.misc.health.smithi078.stderr:2023-11-28T19:58:52.053+0000 7f36445e6640 1 -- 172.21.15.78:0/2077084181 >> 172.21.15.78:0/2077084181 conn(0x7f363c0c5f60 msgr2=0x7f363c0c6340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T19:58:52.057 INFO:teuthology.misc.health.smithi078.stderr:2023-11-28T19:58:52.053+0000 7f36445e6640 1 -- 172.21.15.78:0/2077084181 shutdown_connections 2023-11-28T19:58:52.058 INFO:teuthology.misc.health.smithi078.stderr:2023-11-28T19:58:52.053+0000 7f36445e6640 1 -- 172.21.15.78:0/2077084181 wait complete. 2023-11-28T19:58:52.073 DEBUG:teuthology.misc:0 of 8 OSDs are up 2023-11-28T19:58:58.879 DEBUG:teuthology.orchestra.run.smithi078:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-11-28T19:58:59.015 INFO:teuthology.misc.health.smithi078.stderr:2023-11-28T19:58:59.012+0000 7f866b148640 1 Processor -- start 2023-11-28T19:58:59.015 INFO:teuthology.misc.health.smithi078.stderr:2023-11-28T19:58:59.012+0000 7f866b148640 1 -- start start 2023-11-28T19:58:59.016 INFO:teuthology.misc.health.smithi078.stderr:2023-11-28T19:58:59.012+0000 7f866b148640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f8664072980 0x7f86640a51f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:58:59.017 INFO:teuthology.misc.health.smithi078.stderr:2023-11-28T19:58:59.012+0000 7f866b148640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f86640a4ca0 0x7f86640c2870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:58:59.017 INFO:teuthology.misc.health.smithi078.stderr:2023-11-28T19:58:59.012+0000 7f866b148640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f86641547d0 con 0x7f86640725a0 2023-11-28T19:58:59.017 INFO:teuthology.misc.health.smithi078.stderr:2023-11-28T19:58:59.012+0000 7f866b148640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8664155450 con 0x7f86640a4ca0 2023-11-28T19:58:59.017 INFO:teuthology.misc.health.smithi078.stderr:2023-11-28T19:58:59.012+0000 7f866b148640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8664154ab0 con 0x7f8664072980 2023-11-28T19:58:59.017 INFO:teuthology.misc.health.smithi078.stderr:2023-11-28T19:58:59.012+0000 7f866a947640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f86640a4ca0 0x7f86640c2870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:58:59.017 INFO:teuthology.misc.health.smithi078.stderr:2023-11-28T19:58:59.012+0000 7f866a146640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f86640725a0 0x7f86640c2160 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:37498/0 (socket says 172.21.15.78:37498) 2023-11-28T19:58:59.017 INFO:teuthology.misc.health.smithi078.stderr:2023-11-28T19:58:59.012+0000 7f866a146640 1 -- 172.21.15.78:0/256798170 learned_addr learned my addr 172.21.15.78:0/256798170 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-11-28T19:58:59.017 INFO:teuthology.misc.health.smithi078.stderr:2023-11-28T19:58:59.012+0000 7f866a947640 1 -- 172.21.15.78:0/256798170 >> v2:172.21.15.179:3300/0 conn(0x7f8664072980 msgr2=0x7f86640a51f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T19:58:59.017 INFO:teuthology.misc.health.smithi078.stderr:2023-11-28T19:58:59.012+0000 7f866a947640 1 --2- 172.21.15.78:0/256798170 >> v2:172.21.15.179:3300/0 conn(0x7f8664072980 0x7f86640a51f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:58:59.017 INFO:teuthology.misc.health.smithi078.stderr:2023-11-28T19:58:59.012+0000 7f866a947640 1 -- 172.21.15.78:0/256798170 >> v1:172.21.15.78:6789/0 conn(0x7f86640725a0 legacy=0x7f86640c2160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:58:59.018 INFO:teuthology.misc.health.smithi078.stderr:2023-11-28T19:58:59.012+0000 7f866a947640 1 -- 172.21.15.78:0/256798170 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8664154d90 con 0x7f86640a4ca0 2023-11-28T19:58:59.018 INFO:teuthology.misc.health.smithi078.stderr:2023-11-28T19:58:59.012+0000 7f8669144640 1 -- 172.21.15.78:0/256798170 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3856903994 0 0) 0x7f86641547d0 con 0x7f86640725a0 2023-11-28T19:58:59.019 INFO:teuthology.misc.health.smithi078.stderr:2023-11-28T19:58:59.016+0000 7f866a947640 1 --2- 172.21.15.78:0/256798170 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f86640a4ca0 0x7f86640c2870 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f866406e7c0 tx=0x7f865c01c7c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7094abf51ef9cf8b server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:58:59.020 INFO:teuthology.misc.health.smithi078.stderr:2023-11-28T19:58:59.016+0000 7f8669144640 1 -- 172.21.15.78:0/256798170 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f865c0a58a0 con 0x7f86640a4ca0 2023-11-28T19:58:59.020 INFO:teuthology.misc.health.smithi078.stderr:2023-11-28T19:58:59.016+0000 7f8669144640 1 -- 172.21.15.78:0/256798170 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f865c0a5a00 con 0x7f86640a4ca0 2023-11-28T19:58:59.020 INFO:teuthology.misc.health.smithi078.stderr:2023-11-28T19:58:59.016+0000 7f8669144640 1 -- 172.21.15.78:0/256798170 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f865c0a5d90 con 0x7f86640a4ca0 2023-11-28T19:58:59.021 INFO:teuthology.misc.health.smithi078.stderr:2023-11-28T19:58:59.016+0000 7f866b148640 1 -- 172.21.15.78:0/256798170 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f86640a4ca0 msgr2=0x7f86640c2870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:58:59.021 INFO:teuthology.misc.health.smithi078.stderr:2023-11-28T19:58:59.016+0000 7f866b148640 1 --2- 172.21.15.78:0/256798170 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f86640a4ca0 0x7f86640c2870 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f866406e7c0 tx=0x7f865c01c7c0 comp rx=0 tx=0).stop 2023-11-28T19:58:59.021 INFO:teuthology.misc.health.smithi078.stderr:2023-11-28T19:58:59.016+0000 7f866b148640 1 -- 172.21.15.78:0/256798170 shutdown_connections 2023-11-28T19:58:59.021 INFO:teuthology.misc.health.smithi078.stderr:2023-11-28T19:58:59.016+0000 7f866b148640 1 --2- 172.21.15.78:0/256798170 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f86640a4ca0 0x7f86640c2870 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:58:59.021 INFO:teuthology.misc.health.smithi078.stderr:2023-11-28T19:58:59.016+0000 7f866b148640 1 --2- 172.21.15.78:0/256798170 >> v2:172.21.15.179:3300/0 conn(0x7f8664072980 0x7f86640a51f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:58:59.021 INFO:teuthology.misc.health.smithi078.stderr:2023-11-28T19:58:59.016+0000 7f866b148640 1 -- 172.21.15.78:0/256798170 >> 172.21.15.78:0/256798170 conn(0x7f86640c5a30 msgr2=0x7f86640c5e40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T19:58:59.021 INFO:teuthology.misc.health.smithi078.stderr:2023-11-28T19:58:59.016+0000 7f866b148640 1 -- 172.21.15.78:0/256798170 shutdown_connections 2023-11-28T19:58:59.021 INFO:teuthology.misc.health.smithi078.stderr:2023-11-28T19:58:59.016+0000 7f866b148640 1 -- 172.21.15.78:0/256798170 wait complete. 2023-11-28T19:58:59.022 INFO:teuthology.misc.health.smithi078.stderr:2023-11-28T19:58:59.016+0000 7f866b148640 1 Processor -- start 2023-11-28T19:58:59.022 INFO:teuthology.misc.health.smithi078.stderr:2023-11-28T19:58:59.020+0000 7f866b148640 1 -- start start 2023-11-28T19:58:59.024 INFO:teuthology.misc.health.smithi078.stderr:2023-11-28T19:58:59.020+0000 7f866b148640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f86640725a0 0x7f8664144b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:58:59.024 INFO:teuthology.misc.health.smithi078.stderr:2023-11-28T19:58:59.020+0000 7f866b148640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8664072980 0x7f8664146e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:58:59.025 INFO:teuthology.misc.health.smithi078.stderr:2023-11-28T19:58:59.020+0000 7f866b148640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f86640a4ca0 0x7f86641ecd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:58:59.025 INFO:teuthology.misc.health.smithi078.stderr:2023-11-28T19:58:59.020+0000 7f866b148640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86641ec8e0 con 0x7f8664072980 2023-11-28T19:58:59.025 INFO:teuthology.misc.health.smithi078.stderr:2023-11-28T19:58:59.020+0000 7f866b148640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86641462c0 con 0x7f86640725a0 2023-11-28T19:58:59.025 INFO:teuthology.misc.health.smithi078.stderr:2023-11-28T19:58:59.020+0000 7f866b148640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86641465a0 con 0x7f86640a4ca0 2023-11-28T19:58:59.025 INFO:teuthology.misc.health.smithi078.stderr:2023-11-28T19:58:59.020+0000 7f8669945640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8664072980 0x7f8664146e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:58:59.025 INFO:teuthology.misc.health.smithi078.stderr:2023-11-28T19:58:59.020+0000 7f8669945640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8664072980 0x7f8664146e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:47458/0 (socket says 172.21.15.78:47458) 2023-11-28T19:58:59.025 INFO:teuthology.misc.health.smithi078.stderr:2023-11-28T19:58:59.020+0000 7f8669945640 1 -- 172.21.15.78:0/2458137061 learned_addr learned my addr 172.21.15.78:0/2458137061 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T19:58:59.025 INFO:teuthology.misc.health.smithi078.stderr:2023-11-28T19:58:59.020+0000 7f866a146640 1 --2- 172.21.15.78:0/2458137061 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f86640725a0 0x7f8664144b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:58:59.025 INFO:teuthology.misc.health.smithi078.stderr:2023-11-28T19:58:59.020+0000 7f8669945640 1 -- 172.21.15.78:0/2458137061 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f86640a4ca0 msgr2=0x7f86641ecd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:58:59.025 INFO:teuthology.misc.health.smithi078.stderr:2023-11-28T19:58:59.020+0000 7f866a947640 1 --2- 172.21.15.78:0/2458137061 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f86640a4ca0 0x7f86641ecd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:58:59.025 INFO:teuthology.misc.health.smithi078.stderr:2023-11-28T19:58:59.020+0000 7f8669945640 1 --2- 172.21.15.78:0/2458137061 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f86640a4ca0 0x7f86641ecd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:58:59.026 INFO:teuthology.misc.health.smithi078.stderr:2023-11-28T19:58:59.020+0000 7f8669945640 1 -- 172.21.15.78:0/2458137061 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f86640725a0 msgr2=0x7f8664144b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:58:59.026 INFO:teuthology.misc.health.smithi078.stderr:2023-11-28T19:58:59.020+0000 7f8669945640 1 --2- 172.21.15.78:0/2458137061 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f86640725a0 0x7f8664144b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:58:59.026 INFO:teuthology.misc.health.smithi078.stderr:2023-11-28T19:58:59.020+0000 7f8669945640 1 -- 172.21.15.78:0/2458137061 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f865c009a70 con 0x7f8664072980 2023-11-28T19:58:59.026 INFO:teuthology.misc.health.smithi078.stderr:2023-11-28T19:58:59.020+0000 7f866a146640 1 --2- 172.21.15.78:0/2458137061 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f86640725a0 0x7f8664144b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T19:58:59.026 INFO:teuthology.misc.health.smithi078.stderr:2023-11-28T19:58:59.020+0000 7f866a947640 1 --2- 172.21.15.78:0/2458137061 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f86640a4ca0 0x7f86641ecd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T19:58:59.026 INFO:teuthology.misc.health.smithi078.stderr:2023-11-28T19:58:59.020+0000 7f8669945640 1 --2- 172.21.15.78:0/2458137061 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8664072980 0x7f8664146e50 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f865400b550 tx=0x7f865400ba10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:58:59.026 INFO:teuthology.misc.health.smithi078.stderr:2023-11-28T19:58:59.020+0000 7f865affd640 1 -- 172.21.15.78:0/2458137061 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8654010870 con 0x7f8664072980 2023-11-28T19:58:59.026 INFO:teuthology.misc.health.smithi078.stderr:2023-11-28T19:58:59.020+0000 7f865affd640 1 -- 172.21.15.78:0/2458137061 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f86540109f0 con 0x7f8664072980 2023-11-28T19:58:59.026 INFO:teuthology.misc.health.smithi078.stderr:2023-11-28T19:58:59.020+0000 7f866b148640 1 -- 172.21.15.78:0/2458137061 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8664151ed0 con 0x7f8664072980 2023-11-28T19:58:59.026 INFO:teuthology.misc.health.smithi078.stderr:2023-11-28T19:58:59.020+0000 7f865affd640 1 -- 172.21.15.78:0/2458137061 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8654010da0 con 0x7f8664072980 2023-11-28T19:58:59.026 INFO:teuthology.misc.health.smithi078.stderr:2023-11-28T19:58:59.020+0000 7f866b148640 1 -- 172.21.15.78:0/2458137061 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f86640bf1e0 con 0x7f8664072980 2023-11-28T19:58:59.027 INFO:teuthology.misc.health.smithi078.stderr:2023-11-28T19:58:59.020+0000 7f866b148640 1 -- 172.21.15.78:0/2458137061 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f86641eca50 con 0x7f8664072980 2023-11-28T19:58:59.027 INFO:teuthology.misc.health.smithi078.stderr:2023-11-28T19:58:59.024+0000 7f865affd640 1 -- 172.21.15.78:0/2458137061 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f865400f3c0 con 0x7f8664072980 2023-11-28T19:58:59.028 INFO:teuthology.misc.health.smithi078.stderr:2023-11-28T19:58:59.024+0000 7f865affd640 1 --2- 172.21.15.78:0/2458137061 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f86480664a0 0x7f8648068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:58:59.028 INFO:teuthology.misc.health.smithi078.stderr:2023-11-28T19:58:59.024+0000 7f865affd640 1 -- 172.21.15.78:0/2458137061 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f8654083ba0 con 0x7f8664072980 2023-11-28T19:58:59.028 INFO:teuthology.misc.health.smithi078.stderr:2023-11-28T19:58:59.024+0000 7f866a146640 1 --2- 172.21.15.78:0/2458137061 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f86480664a0 0x7f8648068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:58:59.028 INFO:teuthology.misc.health.smithi078.stderr:2023-11-28T19:58:59.024+0000 7f866a146640 1 --2- 172.21.15.78:0/2458137061 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f86480664a0 0x7f8648068960 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f8660007fd0 tx=0x7f8660009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:58:59.032 INFO:teuthology.misc.health.smithi078.stderr:2023-11-28T19:58:59.028+0000 7f865affd640 1 -- 172.21.15.78:0/2458137061 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f8654051360 con 0x7f8664072980 2023-11-28T19:58:59.183 INFO:teuthology.misc.health.smithi078.stderr:2023-11-28T19:58:59.180+0000 7f866b148640 1 -- 172.21.15.78:0/2458137061 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f86640674b0 con 0x7f8664072980 2023-11-28T19:58:59.184 INFO:teuthology.misc.health.smithi078.stderr:2023-11-28T19:58:59.180+0000 7f865affd640 1 -- 172.21.15.78:0/2458137061 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v17) v1 ==== 74+0+12826 (secure 0 0 0) 0x7f8654054980 con 0x7f8664072980 2023-11-28T19:58:59.184 INFO:teuthology.misc.health.smithi078.stdout: 2023-11-28T19:58:59.184 INFO:teuthology.misc.health.smithi078.stdout:{"epoch":17,"fsid":"dd9780e8-3bda-44fa-a9f0-fa07d19d901d","created":"2023-11-28T19:58:40.969556+0000","modified":"2023-11-28T19:58:56.742459+0000","last_up_change":"2023-11-28T19:58:52.596716+0000","last_in_change":"2023-11-28T19:58:43.609275+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-28T19:58:54.011229+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e84245ac-b5da-429e-af18-39acaa2b33e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6800","nonce":3358701235},{"type":"v1","addr":"172.21.15.78:6801","nonce":3358701235}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6802","nonce":3358701235},{"type":"v1","addr":"172.21.15.78:6803","nonce":3358701235}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6806","nonce":3358701235},{"type":"v1","addr":"172.21.15.78:6807","nonce":3358701235}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6804","nonce":3358701235},{"type":"v1","addr":"172.21.15.78:6805","nonce":3358701235}]},"public_addr":"172.21.15.78:6801/3358701235","cluster_addr":"172.21.15.78:6803/3358701235","heartbeat_back_addr":"172.21.15.78:6807/3358701235","heartbeat_front_addr":"172.21.15.78:6805/3358701235","state":["exists","up"]},{"osd":1,"uuid":"e634831d-c4e2-48d9-870c-9556ae162981","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6808","nonce":3211476654},{"type":"v1","addr":"172.21.15.78:6809","nonce":3211476654}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6810","nonce":3211476654},{"type":"v1","addr":"172.21.15.78:6811","nonce":3211476654}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6814","nonce":3211476654},{"type":"v1","addr":"172.21.15.78:6815","nonce":3211476654}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6812","nonce":3211476654},{"type":"v1","addr":"172.21.15.78:6813","nonce":3211476654}]},"public_addr":"172.21.15.78:6809/3211476654","cluster_addr":"172.21.15.78:6811/3211476654","heartbeat_back_addr":"172.21.15.78:6815/3211476654","heartbeat_front_addr":"172.21.15.78:6813/3211476654","state":["exists","up"]},{"osd":2,"uuid":"274c8395-6534-41f0-b8fb-a00af8985aa8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6816","nonce":2532904479},{"type":"v1","addr":"172.21.15.78:6817","nonce":2532904479}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6818","nonce":2532904479},{"type":"v1","addr":"172.21.15.78:6819","nonce":2532904479}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6822","nonce":2532904479},{"type":"v1","addr":"172.21.15.78:6823","nonce":2532904479}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6820","nonce":2532904479},{"type":"v1","addr":"172.21.15.78:6821","nonce":2532904479}]},"public_addr":"172.21.15.78:6817/2532904479","cluster_addr":"172.21.15.78:6819/2532904479","heartbeat_back_addr":"172.21.15.78:6823/2532904479","heartbeat_front_addr":"172.21.15.78:6821/2532904479","state":["exists","up"]},{"osd":3,"uuid":"77acc9af-7d4d-4b18-8cf5-d62f5971b7c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6824","nonce":3442991267},{"type":"v1","addr":"172.21.15.78:6825","nonce":3442991267}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6826","nonce":3442991267},{"type":"v1","addr":"172.21.15.78:6827","nonce":3442991267}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6830","nonce":3442991267},{"type":"v1","addr":"172.21.15.78:6831","nonce":3442991267}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6828","nonce":3442991267},{"type":"v1","addr":"172.21.15.78:6829","nonce":3442991267}]},"public_addr":"172.21.15.78:6825/3442991267","cluster_addr":"172.21.15.78:6827/3442991267","heartbeat_back_addr":"172.21.15.78:6831/3442991267","heartbeat_front_addr":"172.21.15.78:6829/3442991267","state":["exists","up"]},{"osd":4,"uuid":"5c62bc66-6b34-4b7f-a66b-9a743969138c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":802983577},{"type":"v1","addr":"172.21.15.179:6809","nonce":802983577}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":802983577},{"type":"v1","addr":"172.21.15.179:6811","nonce":802983577}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":802983577},{"type":"v1","addr":"172.21.15.179:6815","nonce":802983577}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":802983577},{"type":"v1","addr":"172.21.15.179:6813","nonce":802983577}]},"public_addr":"172.21.15.179:6809/802983577","cluster_addr":"172.21.15.179:6811/802983577","heartbeat_back_addr":"172.21.15.179:6815/802983577","heartbeat_front_addr":"172.21.15.179:6813/802983577","state":["exists","up"]},{"osd":5,"uuid":"67db6d36-f684-4079-b0cd-82b4dd61461f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":518192887},{"type":"v1","addr":"172.21.15.179:6818","nonce":518192887}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":518192887},{"type":"v1","addr":"172.21.15.179:6822","nonce":518192887}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":518192887},{"type":"v1","addr":"172.21.15.179:6829","nonce":518192887}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6824","nonce":518192887},{"type":"v1","addr":"172.21.15.179:6826","nonce":518192887}]},"public_addr":"172.21.15.179:6818/518192887","cluster_addr":"172.21.15.179:6822/518192887","heartbeat_back_addr":"172.21.15.179:6829/518192887","heartbeat_front_addr":"172.21.15.179:6826/518192887","state":["exists","up"]},{"osd":6,"uuid":"12e670af-5a16-4c81-9f97-defa66cab967","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":815435378},{"type":"v1","addr":"172.21.15.179:6801","nonce":815435378}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":815435378},{"type":"v1","addr":"172.21.15.179:6803","nonce":815435378}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":815435378},{"type":"v1","addr":"172.21.15.179:6807","nonce":815435378}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":815435378},{"type":"v1","addr":"172.21.15.179:6805","nonce":815435378}]},"public_addr":"172.21.15.179:6801/815435378","cluster_addr":"172.21.15.179:6803/815435378","heartbeat_back_addr":"172.21.15.179:6807/815435378","heartbeat_front_addr":"172.21.15.179:6805/815435378","state":["exists","up"]},{"osd":7,"uuid":"fe630650-2eb3-49ad-8676-c341e6332eb1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6817","nonce":2848432339},{"type":"v1","addr":"172.21.15.179:6819","nonce":2848432339}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6821","nonce":2848432339},{"type":"v1","addr":"172.21.15.179:6823","nonce":2848432339}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":2848432339},{"type":"v1","addr":"172.21.15.179:6831","nonce":2848432339}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6825","nonce":2848432339},{"type":"v1","addr":"172.21.15.179:6827","nonce":2848432339}]},"public_addr":"172.21.15.179:6819/2848432339","cluster_addr":"172.21.15.179:6823/2848432339","heartbeat_back_addr":"172.21.15.179:6831/2848432339","heartbeat_front_addr":"172.21.15.179:6827/2848432339","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:58:49.255433+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:58:49.412880+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:58:49.559295+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:58:49.245237+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:58:49.184557+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:58:49.329851+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:58:49.366012+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:58:49.349604+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-28T19:58:59.186 INFO:teuthology.misc.health.smithi078.stderr:2023-11-28T19:58:59.180+0000 7f866b148640 1 -- 172.21.15.78:0/2458137061 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f86480664a0 msgr2=0x7f8648068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:58:59.186 INFO:teuthology.misc.health.smithi078.stderr:2023-11-28T19:58:59.180+0000 7f866b148640 1 --2- 172.21.15.78:0/2458137061 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f86480664a0 0x7f8648068960 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f8660007fd0 tx=0x7f8660009040 comp rx=0 tx=0).stop 2023-11-28T19:58:59.186 INFO:teuthology.misc.health.smithi078.stderr:2023-11-28T19:58:59.180+0000 7f866b148640 1 -- 172.21.15.78:0/2458137061 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8664072980 msgr2=0x7f8664146e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:58:59.186 INFO:teuthology.misc.health.smithi078.stderr:2023-11-28T19:58:59.180+0000 7f866b148640 1 --2- 172.21.15.78:0/2458137061 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8664072980 0x7f8664146e50 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f865400b550 tx=0x7f865400ba10 comp rx=0 tx=0).stop 2023-11-28T19:58:59.186 INFO:teuthology.misc.health.smithi078.stderr:2023-11-28T19:58:59.180+0000 7f866b148640 1 -- 172.21.15.78:0/2458137061 shutdown_connections 2023-11-28T19:58:59.187 INFO:teuthology.misc.health.smithi078.stderr:2023-11-28T19:58:59.180+0000 7f866b148640 1 --2- 172.21.15.78:0/2458137061 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f86480664a0 0x7f8648068960 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:58:59.187 INFO:teuthology.misc.health.smithi078.stderr:2023-11-28T19:58:59.180+0000 7f866b148640 1 --2- 172.21.15.78:0/2458137061 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f86640a4ca0 0x7f86641ecd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:58:59.187 INFO:teuthology.misc.health.smithi078.stderr:2023-11-28T19:58:59.180+0000 7f866b148640 1 --2- 172.21.15.78:0/2458137061 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8664072980 0x7f8664146e50 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:58:59.187 INFO:teuthology.misc.health.smithi078.stderr:2023-11-28T19:58:59.180+0000 7f866b148640 1 --2- 172.21.15.78:0/2458137061 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f86640725a0 0x7f8664144b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:58:59.187 INFO:teuthology.misc.health.smithi078.stderr:2023-11-28T19:58:59.180+0000 7f866b148640 1 -- 172.21.15.78:0/2458137061 >> 172.21.15.78:0/2458137061 conn(0x7f86640c5a30 msgr2=0x7f86640bf560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T19:58:59.187 INFO:teuthology.misc.health.smithi078.stderr:2023-11-28T19:58:59.180+0000 7f866b148640 1 -- 172.21.15.78:0/2458137061 shutdown_connections 2023-11-28T19:58:59.187 INFO:teuthology.misc.health.smithi078.stderr:2023-11-28T19:58:59.180+0000 7f866b148640 1 -- 172.21.15.78:0/2458137061 wait complete. 2023-11-28T19:58:59.203 DEBUG:teuthology.misc:8 of 8 OSDs are up 2023-11-28T19:58:59.203 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2023-11-28T19:58:59.203 INFO:tasks.ceph.mds.a:Restarting daemon 2023-11-28T19:58:59.204 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-11-28T19:58:59.208 INFO:tasks.ceph.mds.a:Started 2023-11-28T19:58:59.208 INFO:tasks.ceph.mds.c:Restarting daemon 2023-11-28T19:58:59.208 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-11-28T19:58:59.211 INFO:tasks.ceph.mds.c:Started 2023-11-28T19:58:59.211 INFO:tasks.ceph.mds.b:Restarting daemon 2023-11-28T19:58:59.211 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-11-28T19:58:59.215 INFO:tasks.ceph.mds.b:Started 2023-11-28T19:58:59.215 INFO:tasks.ceph.mds.d:Restarting daemon 2023-11-28T19:58:59.215 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-11-28T19:58:59.219 INFO:tasks.ceph.mds.d:Started 2023-11-28T19:58:59.219 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2023-11-28T19:58:59.219 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-28T19:58:59.302 INFO:tasks.ceph.mds.a.smithi078.stdout:starting mds.a at 2023-11-28T19:58:59.302 INFO:tasks.ceph.mds.c.smithi078.stdout:starting mds.c at 2023-11-28T19:58:59.303 INFO:tasks.ceph.mds.c.smithi078.stderr:2023-11-28T19:58:59.300+0000 7f4ae3491640 -1 PosixStack listen unable to listen on v2:0.0.0.0:6834/0: (98) Address already in use 2023-11-28T19:58:59.344 INFO:tasks.ceph.mds.b.smithi179.stdout:starting mds.b at 2023-11-28T19:58:59.344 INFO:tasks.ceph.mds.d.smithi179.stdout:starting mds.d at 2023-11-28T19:58:59.369 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:58:59.364+0000 7f94a1e91640 1 Processor -- start 2023-11-28T19:58:59.369 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:58:59.364+0000 7f94a1e91640 1 -- start start 2023-11-28T19:58:59.371 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:58:59.364+0000 7f94a1e91640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f949c151e80 0x7f949c072850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:58:59.371 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:58:59.368+0000 7f94a1e91640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f949c154520 0x7f949c1549d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:58:59.371 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:58:59.368+0000 7f94a1e91640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f949c06b060 con 0x7f949c0a6370 2023-11-28T19:58:59.371 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:58:59.368+0000 7f94a1e91640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f949c0a67b0 con 0x7f949c154520 2023-11-28T19:58:59.371 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:58:59.368+0000 7f94a1e91640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f949c070d30 con 0x7f949c151e80 2023-11-28T19:58:59.371 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:58:59.368+0000 7f949bfff640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f949c154520 0x7f949c1549d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:58:59.371 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:58:59.368+0000 7f949bfff640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f949c154520 0x7f949c1549d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:47514/0 (socket says 172.21.15.78:47514) 2023-11-28T19:58:59.372 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:58:59.368+0000 7f949bfff640 1 -- 172.21.15.78:0/3760060432 learned_addr learned my addr 172.21.15.78:0/3760060432 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T19:58:59.372 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:58:59.368+0000 7f949affd640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f949c0a6370 0x7f949c0c0010 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:37504/0 (socket says 172.21.15.78:37504) 2023-11-28T19:58:59.372 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:58:59.368+0000 7f949b7fe640 1 --2- 172.21.15.78:0/3760060432 >> v2:172.21.15.179:3300/0 conn(0x7f949c151e80 0x7f949c072850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:58:59.372 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:58:59.368+0000 7f949bfff640 1 -- 172.21.15.78:0/3760060432 >> v2:172.21.15.179:3300/0 conn(0x7f949c151e80 msgr2=0x7f949c072850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T19:58:59.372 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:58:59.368+0000 7f949bfff640 1 --2- 172.21.15.78:0/3760060432 >> v2:172.21.15.179:3300/0 conn(0x7f949c151e80 0x7f949c072850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:58:59.372 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:58:59.368+0000 7f949bfff640 1 -- 172.21.15.78:0/3760060432 >> v1:172.21.15.78:6789/0 conn(0x7f949c0a6370 legacy=0x7f949c0c0010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:58:59.372 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:58:59.368+0000 7f949bfff640 1 -- 172.21.15.78:0/3760060432 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f949c06b300 con 0x7f949c154520 2023-11-28T19:58:59.374 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:58:59.368+0000 7f949bfff640 1 --2- 172.21.15.78:0/3760060432 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f949c154520 0x7f949c1549d0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f949c0c1140 tx=0x7f949401c9d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3df3976e8ee855ef server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:58:59.374 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:58:59.368+0000 7f949a7fc640 1 -- 172.21.15.78:0/3760060432 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94940a5690 con 0x7f949c154520 2023-11-28T19:58:59.374 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:58:59.368+0000 7f949a7fc640 1 -- 172.21.15.78:0/3760060432 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f94940a57f0 con 0x7f949c154520 2023-11-28T19:58:59.374 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:58:59.368+0000 7f949a7fc640 1 -- 172.21.15.78:0/3760060432 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94940a5b80 con 0x7f949c154520 2023-11-28T19:58:59.375 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:58:59.372+0000 7f94a1e91640 1 -- 172.21.15.78:0/3760060432 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f949c154520 msgr2=0x7f949c1549d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:58:59.375 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:58:59.372+0000 7f94a1e91640 1 --2- 172.21.15.78:0/3760060432 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f949c154520 0x7f949c1549d0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f949c0c1140 tx=0x7f949401c9d0 comp rx=0 tx=0).stop 2023-11-28T19:58:59.375 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:58:59.372+0000 7f94a1e91640 1 -- 172.21.15.78:0/3760060432 shutdown_connections 2023-11-28T19:58:59.375 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:58:59.372+0000 7f94a1e91640 1 --2- 172.21.15.78:0/3760060432 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f949c154520 0x7f949c1549d0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:58:59.375 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:58:59.372+0000 7f94a1e91640 1 --2- 172.21.15.78:0/3760060432 >> v2:172.21.15.179:3300/0 conn(0x7f949c151e80 0x7f949c072850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:58:59.375 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:58:59.372+0000 7f94a1e91640 1 -- 172.21.15.78:0/3760060432 >> 172.21.15.78:0/3760060432 conn(0x7f949c0a8990 msgr2=0x7f949c0a8da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T19:58:59.375 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:58:59.372+0000 7f94a1e91640 1 -- 172.21.15.78:0/3760060432 shutdown_connections 2023-11-28T19:58:59.376 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:58:59.372+0000 7f94a1e91640 1 -- 172.21.15.78:0/3760060432 wait complete. 2023-11-28T19:58:59.376 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:58:59.372+0000 7f94a1e91640 1 Processor -- start 2023-11-28T19:58:59.376 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:58:59.372+0000 7f94a1e91640 1 -- start start 2023-11-28T19:58:59.378 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:58:59.372+0000 7f94a1e91640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f949c0a6370 0x7f949c146a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:58:59.378 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:58:59.372+0000 7f94a1e91640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f949c151e80 0x7f949c13efb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:58:59.378 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:58:59.372+0000 7f94a1e91640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f949c154520 0x7f949c13f4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:58:59.379 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:58:59.372+0000 7f94a1e91640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f949c1431f0 con 0x7f949c154520 2023-11-28T19:58:59.379 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:58:59.372+0000 7f94a1e91640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f949c1ed790 con 0x7f949c0a6370 2023-11-28T19:58:59.379 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:58:59.372+0000 7f94a1e91640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f949c153bf0 con 0x7f949c151e80 2023-11-28T19:58:59.379 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:58:59.372+0000 7f949bfff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f949c154520 0x7f949c13f4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:58:59.379 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:58:59.372+0000 7f949bfff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f949c154520 0x7f949c13f4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:47524/0 (socket says 172.21.15.78:47524) 2023-11-28T19:58:59.379 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:58:59.372+0000 7f949bfff640 1 -- 172.21.15.78:0/2419982056 learned_addr learned my addr 172.21.15.78:0/2419982056 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T19:58:59.379 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:58:59.372+0000 7f949affd640 1 --2- 172.21.15.78:0/2419982056 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f949c151e80 0x7f949c13efb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:58:59.379 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:58:59.372+0000 7f949b7fe640 1 --2- 172.21.15.78:0/2419982056 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f949c0a6370 0x7f949c146a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:58:59.379 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:58:59.376+0000 7f949bfff640 1 -- 172.21.15.78:0/2419982056 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f949c151e80 msgr2=0x7f949c13efb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:58:59.379 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:58:59.376+0000 7f949bfff640 1 --2- 172.21.15.78:0/2419982056 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f949c151e80 0x7f949c13efb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:58:59.379 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:58:59.376+0000 7f949bfff640 1 -- 172.21.15.78:0/2419982056 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f949c0a6370 msgr2=0x7f949c146a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:58:59.379 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:58:59.376+0000 7f949bfff640 1 --2- 172.21.15.78:0/2419982056 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f949c0a6370 0x7f949c146a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:58:59.380 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:58:59.376+0000 7f949bfff640 1 -- 172.21.15.78:0/2419982056 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9494009b30 con 0x7f949c154520 2023-11-28T19:58:59.380 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:58:59.376+0000 7f949bfff640 1 --2- 172.21.15.78:0/2419982056 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f949c154520 0x7f949c13f4f0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f94940af040 tx=0x7f9494019770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:58:59.381 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:58:59.376+0000 7f9483fff640 1 -- 172.21.15.78:0/2419982056 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94940b8670 con 0x7f949c154520 2023-11-28T19:58:59.381 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:58:59.376+0000 7f9483fff640 1 -- 172.21.15.78:0/2419982056 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f94940b87d0 con 0x7f949c154520 2023-11-28T19:58:59.381 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:58:59.376+0000 7f9483fff640 1 -- 172.21.15.78:0/2419982056 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94940b8b80 con 0x7f949c154520 2023-11-28T19:58:59.381 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:58:59.376+0000 7f94a1e91640 1 -- 172.21.15.78:0/2419982056 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f949c153ed0 con 0x7f949c154520 2023-11-28T19:58:59.381 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:58:59.376+0000 7f94a1e91640 1 -- 172.21.15.78:0/2419982056 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f949c146fd0 con 0x7f949c154520 2023-11-28T19:58:59.381 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:58:59.376+0000 7f94a1e91640 1 -- 172.21.15.78:0/2419982056 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f949c143330 con 0x7f949c154520 2023-11-28T19:58:59.381 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:58:59.376+0000 7f9483fff640 1 -- 172.21.15.78:0/2419982056 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f94940b8ce0 con 0x7f949c154520 2023-11-28T19:58:59.382 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:58:59.380+0000 7f9483fff640 1 --2- 172.21.15.78:0/2419982056 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f9488066470 0x7f9488068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:58:59.382 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:58:59.380+0000 7f9483fff640 1 -- 172.21.15.78:0/2419982056 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f949411ed80 con 0x7f949c154520 2023-11-28T19:58:59.382 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:58:59.380+0000 7f949b7fe640 1 --2- 172.21.15.78:0/2419982056 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f9488066470 0x7f9488068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:58:59.383 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:58:59.380+0000 7f949b7fe640 1 --2- 172.21.15.78:0/2419982056 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f9488066470 0x7f9488068930 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f948c009b60 tx=0x7f948c009190 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:58:59.387 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:58:59.384+0000 7f9483fff640 1 -- 172.21.15.78:0/2419982056 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f949c143330 con 0x7f949c154520 2023-11-28T19:58:59.538 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:58:59.532+0000 7f94a1e91640 1 -- 172.21.15.78:0/2419982056 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f949c143330 con 0x7f949c154520 2023-11-28T19:58:59.538 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:58:59.536+0000 7f9483fff640 1 -- 172.21.15.78:0/2419982056 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v17) v1 ==== 74+0+12826 (secure 0 0 0) 0x7f949c143330 con 0x7f949c154520 2023-11-28T19:58:59.539 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-11-28T19:58:59.539 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":17,"fsid":"dd9780e8-3bda-44fa-a9f0-fa07d19d901d","created":"2023-11-28T19:58:40.969556+0000","modified":"2023-11-28T19:58:56.742459+0000","last_up_change":"2023-11-28T19:58:52.596716+0000","last_in_change":"2023-11-28T19:58:43.609275+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-28T19:58:54.011229+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e84245ac-b5da-429e-af18-39acaa2b33e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6800","nonce":3358701235},{"type":"v1","addr":"172.21.15.78:6801","nonce":3358701235}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6802","nonce":3358701235},{"type":"v1","addr":"172.21.15.78:6803","nonce":3358701235}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6806","nonce":3358701235},{"type":"v1","addr":"172.21.15.78:6807","nonce":3358701235}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6804","nonce":3358701235},{"type":"v1","addr":"172.21.15.78:6805","nonce":3358701235}]},"public_addr":"172.21.15.78:6801/3358701235","cluster_addr":"172.21.15.78:6803/3358701235","heartbeat_back_addr":"172.21.15.78:6807/3358701235","heartbeat_front_addr":"172.21.15.78:6805/3358701235","state":["exists","up"]},{"osd":1,"uuid":"e634831d-c4e2-48d9-870c-9556ae162981","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6808","nonce":3211476654},{"type":"v1","addr":"172.21.15.78:6809","nonce":3211476654}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6810","nonce":3211476654},{"type":"v1","addr":"172.21.15.78:6811","nonce":3211476654}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6814","nonce":3211476654},{"type":"v1","addr":"172.21.15.78:6815","nonce":3211476654}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6812","nonce":3211476654},{"type":"v1","addr":"172.21.15.78:6813","nonce":3211476654}]},"public_addr":"172.21.15.78:6809/3211476654","cluster_addr":"172.21.15.78:6811/3211476654","heartbeat_back_addr":"172.21.15.78:6815/3211476654","heartbeat_front_addr":"172.21.15.78:6813/3211476654","state":["exists","up"]},{"osd":2,"uuid":"274c8395-6534-41f0-b8fb-a00af8985aa8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6816","nonce":2532904479},{"type":"v1","addr":"172.21.15.78:6817","nonce":2532904479}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6818","nonce":2532904479},{"type":"v1","addr":"172.21.15.78:6819","nonce":2532904479}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6822","nonce":2532904479},{"type":"v1","addr":"172.21.15.78:6823","nonce":2532904479}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6820","nonce":2532904479},{"type":"v1","addr":"172.21.15.78:6821","nonce":2532904479}]},"public_addr":"172.21.15.78:6817/2532904479","cluster_addr":"172.21.15.78:6819/2532904479","heartbeat_back_addr":"172.21.15.78:6823/2532904479","heartbeat_front_addr":"172.21.15.78:6821/2532904479","state":["exists","up"]},{"osd":3,"uuid":"77acc9af-7d4d-4b18-8cf5-d62f5971b7c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6824","nonce":3442991267},{"type":"v1","addr":"172.21.15.78:6825","nonce":3442991267}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6826","nonce":3442991267},{"type":"v1","addr":"172.21.15.78:6827","nonce":3442991267}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6830","nonce":3442991267},{"type":"v1","addr":"172.21.15.78:6831","nonce":3442991267}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6828","nonce":3442991267},{"type":"v1","addr":"172.21.15.78:6829","nonce":3442991267}]},"public_addr":"172.21.15.78:6825/3442991267","cluster_addr":"172.21.15.78:6827/3442991267","heartbeat_back_addr":"172.21.15.78:6831/3442991267","heartbeat_front_addr":"172.21.15.78:6829/3442991267","state":["exists","up"]},{"osd":4,"uuid":"5c62bc66-6b34-4b7f-a66b-9a743969138c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":802983577},{"type":"v1","addr":"172.21.15.179:6809","nonce":802983577}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":802983577},{"type":"v1","addr":"172.21.15.179:6811","nonce":802983577}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":802983577},{"type":"v1","addr":"172.21.15.179:6815","nonce":802983577}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":802983577},{"type":"v1","addr":"172.21.15.179:6813","nonce":802983577}]},"public_addr":"172.21.15.179:6809/802983577","cluster_addr":"172.21.15.179:6811/802983577","heartbeat_back_addr":"172.21.15.179:6815/802983577","heartbeat_front_addr":"172.21.15.179:6813/802983577","state":["exists","up"]},{"osd":5,"uuid":"67db6d36-f684-4079-b0cd-82b4dd61461f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":518192887},{"type":"v1","addr":"172.21.15.179:6818","nonce":518192887}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":518192887},{"type":"v1","addr":"172.21.15.179:6822","nonce":518192887}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":518192887},{"type":"v1","addr":"172.21.15.179:6829","nonce":518192887}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6824","nonce":518192887},{"type":"v1","addr":"172.21.15.179:6826","nonce":518192887}]},"public_addr":"172.21.15.179:6818/518192887","cluster_addr":"172.21.15.179:6822/518192887","heartbeat_back_addr":"172.21.15.179:6829/518192887","heartbeat_front_addr":"172.21.15.179:6826/518192887","state":["exists","up"]},{"osd":6,"uuid":"12e670af-5a16-4c81-9f97-defa66cab967","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":815435378},{"type":"v1","addr":"172.21.15.179:6801","nonce":815435378}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":815435378},{"type":"v1","addr":"172.21.15.179:6803","nonce":815435378}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":815435378},{"type":"v1","addr":"172.21.15.179:6807","nonce":815435378}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":815435378},{"type":"v1","addr":"172.21.15.179:6805","nonce":815435378}]},"public_addr":"172.21.15.179:6801/815435378","cluster_addr":"172.21.15.179:6803/815435378","heartbeat_back_addr":"172.21.15.179:6807/815435378","heartbeat_front_addr":"172.21.15.179:6805/815435378","state":["exists","up"]},{"osd":7,"uuid":"fe630650-2eb3-49ad-8676-c341e6332eb1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6817","nonce":2848432339},{"type":"v1","addr":"172.21.15.179:6819","nonce":2848432339}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6821","nonce":2848432339},{"type":"v1","addr":"172.21.15.179:6823","nonce":2848432339}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":2848432339},{"type":"v1","addr":"172.21.15.179:6831","nonce":2848432339}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6825","nonce":2848432339},{"type":"v1","addr":"172.21.15.179:6827","nonce":2848432339}]},"public_addr":"172.21.15.179:6819/2848432339","cluster_addr":"172.21.15.179:6823/2848432339","heartbeat_back_addr":"172.21.15.179:6831/2848432339","heartbeat_front_addr":"172.21.15.179:6827/2848432339","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:58:49.255433+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:58:49.412880+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:58:49.559295+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:58:49.245237+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:58:49.184557+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:58:49.329851+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:58:49.366012+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:58:49.349604+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-28T19:58:59.540 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:58:59.536+0000 7f94a1e91640 1 -- 172.21.15.78:0/2419982056 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f9488066470 msgr2=0x7f9488068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:58:59.541 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:58:59.536+0000 7f94a1e91640 1 --2- 172.21.15.78:0/2419982056 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f9488066470 0x7f9488068930 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f948c009b60 tx=0x7f948c009190 comp rx=0 tx=0).stop 2023-11-28T19:58:59.541 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:58:59.536+0000 7f94a1e91640 1 -- 172.21.15.78:0/2419982056 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f949c154520 msgr2=0x7f949c13f4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:58:59.541 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:58:59.536+0000 7f94a1e91640 1 --2- 172.21.15.78:0/2419982056 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f949c154520 0x7f949c13f4f0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f94940af040 tx=0x7f9494019770 comp rx=0 tx=0).stop 2023-11-28T19:58:59.541 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:58:59.536+0000 7f94a1e91640 1 -- 172.21.15.78:0/2419982056 shutdown_connections 2023-11-28T19:58:59.541 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:58:59.536+0000 7f94a1e91640 1 --2- 172.21.15.78:0/2419982056 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f9488066470 0x7f9488068930 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:58:59.541 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:58:59.536+0000 7f94a1e91640 1 --2- 172.21.15.78:0/2419982056 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f949c151e80 0x7f949c13efb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:58:59.541 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:58:59.536+0000 7f94a1e91640 1 --2- 172.21.15.78:0/2419982056 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f949c154520 0x7f949c13f4f0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:58:59.541 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:58:59.536+0000 7f94a1e91640 1 --2- 172.21.15.78:0/2419982056 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f949c0a6370 0x7f949c146a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:58:59.541 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:58:59.536+0000 7f94a1e91640 1 -- 172.21.15.78:0/2419982056 >> 172.21.15.78:0/2419982056 conn(0x7f949c0a8990 msgr2=0x7f949c06e850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T19:58:59.541 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:58:59.536+0000 7f94a1e91640 1 -- 172.21.15.78:0/2419982056 shutdown_connections 2023-11-28T19:58:59.541 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:58:59.536+0000 7f94a1e91640 1 -- 172.21.15.78:0/2419982056 wait complete. 2023-11-28T19:58:59.559 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-28T19:58:54.011229+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-28T19:58:59.560 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-28T19:58:59.699 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:58:59.696+0000 7fa2c4e32640 1 Processor -- start 2023-11-28T19:58:59.699 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:58:59.696+0000 7fa2c4e32640 1 -- start start 2023-11-28T19:58:59.701 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:58:59.696+0000 7fa2c4e32640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa2c00c5300 0x7fa2c00a9c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:58:59.701 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:58:59.696+0000 7fa2c4e32640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fa2c01548c0 0x7fa2c0154d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:58:59.701 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:58:59.696+0000 7fa2c4e32640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa2c00a4e20 con 0x7fa2c014b1e0 2023-11-28T19:58:59.701 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:58:59.696+0000 7fa2c4e32640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa2c00a50e0 con 0x7fa2c01548c0 2023-11-28T19:58:59.701 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:58:59.696+0000 7fa2c4e32640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2c00c0f00 con 0x7fa2c00c5300 2023-11-28T19:58:59.701 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:58:59.696+0000 7fa2be59c640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7fa2c014b1e0 0x7fa2c00c1700 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:37518/0 (socket says 172.21.15.78:37518) 2023-11-28T19:58:59.702 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:58:59.696+0000 7fa2be59c640 1 -- 172.21.15.78:0/2728232652 learned_addr learned my addr 172.21.15.78:0/2728232652 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-11-28T19:58:59.702 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:58:59.696+0000 7fa2bed9d640 1 --2- 172.21.15.78:0/2728232652 >> v2:172.21.15.78:3300/0 conn(0x7fa2c01548c0 0x7fa2c0154d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:58:59.702 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:58:59.696+0000 7fa2b7fff640 1 --2- 172.21.15.78:0/2728232652 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa2c00c5300 0x7fa2c00a9c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:58:59.702 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:58:59.696+0000 7fa2bdd9b640 1 -- 172.21.15.78:0/2728232652 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3379660743 0 0) 0x7fa2c00a4e20 con 0x7fa2c014b1e0 2023-11-28T19:58:59.702 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:58:59.696+0000 7fa2bdd9b640 1 -- 172.21.15.78:0/2728232652 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa2ac003530 con 0x7fa2c014b1e0 2023-11-28T19:58:59.702 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:58:59.696+0000 7fa2bed9d640 1 -- 172.21.15.78:0/2728232652 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa2c00c5300 msgr2=0x7fa2c00a9c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T19:58:59.702 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:58:59.696+0000 7fa2bed9d640 1 --2- 172.21.15.78:0/2728232652 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa2c00c5300 0x7fa2c00a9c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:58:59.702 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:58:59.696+0000 7fa2bed9d640 1 -- 172.21.15.78:0/2728232652 >> v1:172.21.15.78:6789/0 conn(0x7fa2c014b1e0 legacy=0x7fa2c00c1700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:58:59.702 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:58:59.696+0000 7fa2bed9d640 1 -- 172.21.15.78:0/2728232652 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2c00c11e0 con 0x7fa2c01548c0 2023-11-28T19:58:59.702 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:58:59.696+0000 7fa2b7fff640 1 --2- 172.21.15.78:0/2728232652 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa2c00c5300 0x7fa2c00a9c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T19:58:59.704 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:58:59.700+0000 7fa2bed9d640 1 --2- 172.21.15.78:0/2728232652 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa2c01548c0 0x7fa2c0154d50 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fa2b8009d90 tx=0x7fa2b801c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=510dd3d1816717b server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:58:59.704 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:58:59.700+0000 7fa2bdd9b640 1 -- 172.21.15.78:0/2728232652 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2c01558b0 con 0x7fa2c01548c0 2023-11-28T19:58:59.704 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:58:59.700+0000 7fa2bdd9b640 1 -- 172.21.15.78:0/2728232652 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa2b80a5920 con 0x7fa2c01548c0 2023-11-28T19:58:59.704 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:58:59.700+0000 7fa2bdd9b640 1 -- 172.21.15.78:0/2728232652 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2b80a5cb0 con 0x7fa2c01548c0 2023-11-28T19:58:59.705 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:58:59.700+0000 7fa2c4e32640 1 -- 172.21.15.78:0/2728232652 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa2c01548c0 msgr2=0x7fa2c0154d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:58:59.705 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:58:59.700+0000 7fa2c4e32640 1 --2- 172.21.15.78:0/2728232652 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa2c01548c0 0x7fa2c0154d50 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fa2b8009d90 tx=0x7fa2b801c950 comp rx=0 tx=0).stop 2023-11-28T19:58:59.705 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:58:59.700+0000 7fa2c4e32640 1 -- 172.21.15.78:0/2728232652 shutdown_connections 2023-11-28T19:58:59.705 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:58:59.700+0000 7fa2c4e32640 1 --2- 172.21.15.78:0/2728232652 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa2c01548c0 0x7fa2c0154d50 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:58:59.705 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:58:59.700+0000 7fa2c4e32640 1 --2- 172.21.15.78:0/2728232652 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa2c00c5300 0x7fa2c00a9c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:58:59.705 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:58:59.700+0000 7fa2c4e32640 1 -- 172.21.15.78:0/2728232652 >> 172.21.15.78:0/2728232652 conn(0x7fa2c00c59f0 msgr2=0x7fa2c00c5e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T19:58:59.705 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:58:59.700+0000 7fa2c4e32640 1 -- 172.21.15.78:0/2728232652 shutdown_connections 2023-11-28T19:58:59.705 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:58:59.700+0000 7fa2c4e32640 1 -- 172.21.15.78:0/2728232652 wait complete. 2023-11-28T19:58:59.706 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:58:59.704+0000 7fa2c4e32640 1 Processor -- start 2023-11-28T19:58:59.707 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:58:59.704+0000 7fa2c4e32640 1 -- start start 2023-11-28T19:58:59.709 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:58:59.704+0000 7fa2c4e32640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa2c00c5300 0x7fa2c013e740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:58:59.709 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:58:59.704+0000 7fa2c4e32640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa2c014b1e0 0x7fa2c006cfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:58:59.709 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:58:59.704+0000 7fa2c4e32640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa2c01548c0 0x7fa2c0070160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:58:59.709 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:58:59.704+0000 7fa2c4e32640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2c013efe0 con 0x7fa2c014b1e0 2023-11-28T19:58:59.709 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:58:59.704+0000 7fa2c4e32640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2c0148b80 con 0x7fa2c01548c0 2023-11-28T19:58:59.709 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:58:59.704+0000 7fa2c4e32640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2c013f230 con 0x7fa2c00c5300 2023-11-28T19:58:59.709 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:58:59.704+0000 7fa2b7fff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa2c014b1e0 0x7fa2c006cfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:58:59.709 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:58:59.704+0000 7fa2b7fff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa2c014b1e0 0x7fa2c006cfc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:47546/0 (socket says 172.21.15.78:47546) 2023-11-28T19:58:59.709 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:58:59.704+0000 7fa2b7fff640 1 -- 172.21.15.78:0/1213273995 learned_addr learned my addr 172.21.15.78:0/1213273995 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T19:58:59.709 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:58:59.704+0000 7fa2b7fff640 1 -- 172.21.15.78:0/1213273995 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa2c00c5300 msgr2=0x7fa2c013e740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:58:59.710 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:58:59.704+0000 7fa2b7fff640 1 --2- 172.21.15.78:0/1213273995 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa2c00c5300 0x7fa2c013e740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:58:59.710 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:58:59.704+0000 7fa2b7fff640 1 -- 172.21.15.78:0/1213273995 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa2c01548c0 msgr2=0x7fa2c0070160 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-11-28T19:58:59.710 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:58:59.704+0000 7fa2b7fff640 1 --2- 172.21.15.78:0/1213273995 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa2c01548c0 0x7fa2c0070160 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:58:59.710 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:58:59.704+0000 7fa2b7fff640 1 -- 172.21.15.78:0/1213273995 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2b8009a70 con 0x7fa2c014b1e0 2023-11-28T19:58:59.710 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:58:59.704+0000 7fa2b7fff640 1 --2- 172.21.15.78:0/1213273995 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa2c014b1e0 0x7fa2c006cfc0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fa2a800e810 tx=0x7fa2a800ecd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:58:59.710 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:58:59.704+0000 7fa2b6ffd640 1 -- 172.21.15.78:0/1213273995 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2a800c6d0 con 0x7fa2c014b1e0 2023-11-28T19:58:59.710 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:58:59.704+0000 7fa2b6ffd640 1 -- 172.21.15.78:0/1213273995 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa2a800c830 con 0x7fa2c014b1e0 2023-11-28T19:58:59.710 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:58:59.704+0000 7fa2c4e32640 1 -- 172.21.15.78:0/1213273995 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa2c01ed420 con 0x7fa2c014b1e0 2023-11-28T19:58:59.711 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:58:59.704+0000 7fa2b6ffd640 1 -- 172.21.15.78:0/1213273995 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2a800cbe0 con 0x7fa2c014b1e0 2023-11-28T19:58:59.711 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:58:59.704+0000 7fa2c4e32640 1 -- 172.21.15.78:0/1213273995 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa2c006fc40 con 0x7fa2c014b1e0 2023-11-28T19:58:59.711 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:58:59.704+0000 7fa2c4e32640 1 -- 172.21.15.78:0/1213273995 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa2c01ed940 con 0x7fa2c014b1e0 2023-11-28T19:58:59.711 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:58:59.708+0000 7fa2b6ffd640 1 -- 172.21.15.78:0/1213273995 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fa2a800cd40 con 0x7fa2c014b1e0 2023-11-28T19:58:59.712 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:58:59.708+0000 7fa2b6ffd640 1 --2- 172.21.15.78:0/1213273995 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fa2a0066470 0x7fa2a0068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:58:59.712 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:58:59.708+0000 7fa2b6ffd640 1 -- 172.21.15.78:0/1213273995 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fa2a80838d0 con 0x7fa2c014b1e0 2023-11-28T19:58:59.712 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:58:59.708+0000 7fa2be59c640 1 --2- 172.21.15.78:0/1213273995 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fa2a0066470 0x7fa2a0068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:58:59.712 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:58:59.708+0000 7fa2be59c640 1 --2- 172.21.15.78:0/1213273995 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fa2a0066470 0x7fa2a0068930 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fa2b0007fd0 tx=0x7fa2b0007940 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:58:59.715 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:58:59.712+0000 7fa2b6ffd640 1 -- 172.21.15.78:0/1213273995 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fa2a80510a0 con 0x7fa2c014b1e0 2023-11-28T19:58:59.867 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:58:59.864+0000 7fa2c4e32640 1 -- 172.21.15.78:0/1213273995 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fa2c0067630 con 0x7fa2c014b1e0 2023-11-28T19:58:59.867 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:58:59.864+0000 7fa2b6ffd640 1 -- 172.21.15.78:0/1213273995 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v17) v1 ==== 93+0+10 (secure 0 0 0) 0x7fa2a80546c0 con 0x7fa2c014b1e0 2023-11-28T19:58:59.867 INFO:teuthology.orchestra.run.smithi078.stdout:pg_num: 1 2023-11-28T19:58:59.869 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:58:59.864+0000 7fa2c4e32640 1 -- 172.21.15.78:0/1213273995 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fa2a0066470 msgr2=0x7fa2a0068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:58:59.869 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:58:59.864+0000 7fa2c4e32640 1 --2- 172.21.15.78:0/1213273995 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fa2a0066470 0x7fa2a0068930 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fa2b0007fd0 tx=0x7fa2b0007940 comp rx=0 tx=0).stop 2023-11-28T19:58:59.869 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:58:59.864+0000 7fa2c4e32640 1 -- 172.21.15.78:0/1213273995 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa2c014b1e0 msgr2=0x7fa2c006cfc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:58:59.870 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:58:59.864+0000 7fa2c4e32640 1 --2- 172.21.15.78:0/1213273995 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa2c014b1e0 0x7fa2c006cfc0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fa2a800e810 tx=0x7fa2a800ecd0 comp rx=0 tx=0).stop 2023-11-28T19:58:59.870 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:58:59.864+0000 7fa2c4e32640 1 -- 172.21.15.78:0/1213273995 shutdown_connections 2023-11-28T19:58:59.870 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:58:59.864+0000 7fa2c4e32640 1 --2- 172.21.15.78:0/1213273995 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fa2a0066470 0x7fa2a0068930 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:58:59.870 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:58:59.864+0000 7fa2c4e32640 1 --2- 172.21.15.78:0/1213273995 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa2c01548c0 0x7fa2c0070160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:58:59.870 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:58:59.864+0000 7fa2c4e32640 1 --2- 172.21.15.78:0/1213273995 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa2c014b1e0 0x7fa2c006cfc0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:58:59.870 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:58:59.864+0000 7fa2c4e32640 1 --2- 172.21.15.78:0/1213273995 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa2c00c5300 0x7fa2c013e740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:58:59.870 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:58:59.864+0000 7fa2c4e32640 1 -- 172.21.15.78:0/1213273995 >> 172.21.15.78:0/1213273995 conn(0x7fa2c00c59f0 msgr2=0x7fa2c0149310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T19:58:59.870 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:58:59.864+0000 7fa2c4e32640 1 -- 172.21.15.78:0/1213273995 shutdown_connections 2023-11-28T19:58:59.870 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:58:59.864+0000 7fa2c4e32640 1 -- 172.21.15.78:0/1213273995 wait complete. 2023-11-28T19:58:59.888 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-28T19:59:00.025 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:00.020+0000 7f2a0006b640 1 Processor -- start 2023-11-28T19:59:00.025 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:00.020+0000 7f2a0006b640 1 -- start start 2023-11-28T19:59:00.026 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:00.020+0000 7f2a0006b640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f29f806d890 0x7f29f8154610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:00.026 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:00.024+0000 7f2a0006b640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f29f8154b50 0x7f29f815ee90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:00.026 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:00.024+0000 7f2a0006b640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f29f8158a40 con 0x7f29f8151bf0 2023-11-28T19:59:00.027 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:00.024+0000 7f2a0006b640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f29f81584c0 con 0x7f29f806d890 2023-11-28T19:59:00.027 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:00.024+0000 7f2a0006b640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f29f8158760 con 0x7f29f8154b50 2023-11-28T19:59:00.028 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:00.024+0000 7f29fd606640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f29f806d890 0x7f29f8154610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:00.028 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:00.024+0000 7f29fe608640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f29f8154b50 0x7f29f815ee90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:00.028 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:00.024+0000 7f29fde07640 1 --1- >> v1:172.21.15.179:6789/0 conn(0x7f29f8151bf0 0x7f29f806b5c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.179:6789/0 says I am v1:172.21.15.78:33812/0 (socket says 172.21.15.78:33812) 2023-11-28T19:59:00.028 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:00.024+0000 7f29fde07640 1 -- 172.21.15.78:0/2679554152 learned_addr learned my addr 172.21.15.78:0/2679554152 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-11-28T19:59:00.028 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:00.024+0000 7f29fce05640 1 -- 172.21.15.78:0/2679554152 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 968971729 0 0) 0x7f29f8158a40 con 0x7f29f8151bf0 2023-11-28T19:59:00.028 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:00.024+0000 7f29fce05640 1 -- 172.21.15.78:0/2679554152 --> v1:172.21.15.179:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f29e4003530 con 0x7f29f8151bf0 2023-11-28T19:59:00.028 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:00.024+0000 7f29fe608640 1 -- 172.21.15.78:0/2679554152 >> v2:172.21.15.179:3300/0 conn(0x7f29f806d890 msgr2=0x7f29f8154610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T19:59:00.028 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:00.024+0000 7f29fe608640 1 --2- 172.21.15.78:0/2679554152 >> v2:172.21.15.179:3300/0 conn(0x7f29f806d890 0x7f29f8154610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:00.028 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:00.024+0000 7f29fe608640 1 -- 172.21.15.78:0/2679554152 >> v1:172.21.15.179:6789/0 conn(0x7f29f8151bf0 legacy=0x7f29f806b5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:00.028 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:00.024+0000 7f29fe608640 1 -- 172.21.15.78:0/2679554152 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29f80c0ce0 con 0x7f29f8154b50 2023-11-28T19:59:00.029 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:00.024+0000 7f29fd606640 1 --2- 172.21.15.78:0/2679554152 >> v2:172.21.15.179:3300/0 conn(0x7f29f806d890 0x7f29f8154610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T19:59:00.030 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:00.028+0000 7f29fe608640 1 --2- 172.21.15.78:0/2679554152 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f29f8154b50 0x7f29f815ee90 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f29f0009d90 tx=0x7f29f001c920 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4150a7afa72090d3 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:59:00.030 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:00.028+0000 7f29fce05640 1 -- 172.21.15.78:0/2679554152 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29f00a59e0 con 0x7f29f8154b50 2023-11-28T19:59:00.031 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:00.028+0000 7f29fce05640 1 -- 172.21.15.78:0/2679554152 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f29f00a5b40 con 0x7f29f8154b50 2023-11-28T19:59:00.031 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:00.028+0000 7f29fce05640 1 -- 172.21.15.78:0/2679554152 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29f00ad440 con 0x7f29f8154b50 2023-11-28T19:59:00.031 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:00.028+0000 7f2a0006b640 1 -- 172.21.15.78:0/2679554152 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f29f8154b50 msgr2=0x7f29f815ee90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:00.032 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:00.028+0000 7f2a0006b640 1 --2- 172.21.15.78:0/2679554152 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f29f8154b50 0x7f29f815ee90 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f29f0009d90 tx=0x7f29f001c920 comp rx=0 tx=0).stop 2023-11-28T19:59:00.032 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:00.028+0000 7f2a0006b640 1 -- 172.21.15.78:0/2679554152 shutdown_connections 2023-11-28T19:59:00.032 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:00.028+0000 7f2a0006b640 1 --2- 172.21.15.78:0/2679554152 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f29f8154b50 0x7f29f815ee90 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:00.032 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:00.028+0000 7f2a0006b640 1 --2- 172.21.15.78:0/2679554152 >> v2:172.21.15.179:3300/0 conn(0x7f29f806d890 0x7f29f8154610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:00.032 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:00.028+0000 7f2a0006b640 1 -- 172.21.15.78:0/2679554152 >> 172.21.15.78:0/2679554152 conn(0x7f29f80c61f0 msgr2=0x7f29f80c6600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T19:59:00.032 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:00.028+0000 7f2a0006b640 1 -- 172.21.15.78:0/2679554152 shutdown_connections 2023-11-28T19:59:00.032 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:00.028+0000 7f2a0006b640 1 -- 172.21.15.78:0/2679554152 wait complete. 2023-11-28T19:59:00.033 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:00.028+0000 7f2a0006b640 1 Processor -- start 2023-11-28T19:59:00.033 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:00.028+0000 7f2a0006b640 1 -- start start 2023-11-28T19:59:00.035 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:00.032+0000 7f2a0006b640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f29f806d890 0x7f29f80aaef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:00.036 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:00.032+0000 7f2a0006b640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f29f8151bf0 0x7f29f8071b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:00.036 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:00.032+0000 7f2a0006b640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f29f8154b50 0x7f29f8146b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:00.036 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:00.032+0000 7f2a0006b640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29f80aa150 con 0x7f29f8151bf0 2023-11-28T19:59:00.036 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:00.032+0000 7f2a0006b640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29f81edc90 con 0x7f29f806d890 2023-11-28T19:59:00.036 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:00.032+0000 7f2a0006b640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f29f80aa410 con 0x7f29f8154b50 2023-11-28T19:59:00.036 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:00.032+0000 7f29fd606640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f29f8151bf0 0x7f29f8071b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:00.036 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:00.032+0000 7f29fd606640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f29f8151bf0 0x7f29f8071b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:47552/0 (socket says 172.21.15.78:47552) 2023-11-28T19:59:00.036 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:00.032+0000 7f29fd606640 1 -- 172.21.15.78:0/57808562 learned_addr learned my addr 172.21.15.78:0/57808562 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T19:59:00.036 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:00.032+0000 7f29fde07640 1 --2- 172.21.15.78:0/57808562 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f29f806d890 0x7f29f80aaef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:00.037 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:00.032+0000 7f29fe608640 1 --2- 172.21.15.78:0/57808562 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f29f8154b50 0x7f29f8146b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:00.037 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:00.032+0000 7f29fd606640 1 -- 172.21.15.78:0/57808562 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f29f8154b50 msgr2=0x7f29f8146b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:00.037 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:00.032+0000 7f29fd606640 1 --2- 172.21.15.78:0/57808562 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f29f8154b50 0x7f29f8146b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:00.037 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:00.032+0000 7f29fd606640 1 -- 172.21.15.78:0/57808562 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f29f806d890 msgr2=0x7f29f80aaef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:00.037 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:00.032+0000 7f29fd606640 1 --2- 172.21.15.78:0/57808562 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f29f806d890 0x7f29f80aaef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:00.037 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:00.032+0000 7f29fd606640 1 -- 172.21.15.78:0/57808562 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29e8009420 con 0x7f29f8151bf0 2023-11-28T19:59:00.037 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:00.032+0000 7f29fd606640 1 --2- 172.21.15.78:0/57808562 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f29f8151bf0 0x7f29f8071b50 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f29e800e980 tx=0x7f29e800ee40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:59:00.037 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:00.032+0000 7f29ee7fc640 1 -- 172.21.15.78:0/57808562 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29e800ca00 con 0x7f29f8151bf0 2023-11-28T19:59:00.037 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:00.032+0000 7f29ee7fc640 1 -- 172.21.15.78:0/57808562 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f29e800cb60 con 0x7f29f8151bf0 2023-11-28T19:59:00.037 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:00.032+0000 7f2a0006b640 1 -- 172.21.15.78:0/57808562 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f29f0009a70 con 0x7f29f8151bf0 2023-11-28T19:59:00.037 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:00.032+0000 7f29ee7fc640 1 -- 172.21.15.78:0/57808562 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29e8013470 con 0x7f29f8151bf0 2023-11-28T19:59:00.038 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:00.032+0000 7f2a0006b640 1 -- 172.21.15.78:0/57808562 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f29f80aa9d0 con 0x7f29f8151bf0 2023-11-28T19:59:00.038 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:00.032+0000 7f2a0006b640 1 -- 172.21.15.78:0/57808562 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f29f8067630 con 0x7f29f8151bf0 2023-11-28T19:59:00.038 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:00.032+0000 7f29ee7fc640 1 -- 172.21.15.78:0/57808562 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f29e80135d0 con 0x7f29f8151bf0 2023-11-28T19:59:00.039 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:00.036+0000 7f29ee7fc640 1 --2- 172.21.15.78:0/57808562 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f29dc066470 0x7f29dc068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:00.039 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:00.036+0000 7f29ee7fc640 1 -- 172.21.15.78:0/57808562 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f29e8083d20 con 0x7f29f8151bf0 2023-11-28T19:59:00.039 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:00.036+0000 7f29fde07640 1 --2- 172.21.15.78:0/57808562 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f29dc066470 0x7f29dc068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:00.039 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:00.036+0000 7f29fde07640 1 --2- 172.21.15.78:0/57808562 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f29dc066470 0x7f29dc068930 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f29f4007fd0 tx=0x7f29f4009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:59:00.042 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:00.040+0000 7f29ee7fc640 1 -- 172.21.15.78:0/57808562 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f29e80515a0 con 0x7f29f8151bf0 2023-11-28T19:59:00.220 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:00.216+0000 7f2a0006b640 1 -- 172.21.15.78:0/57808562 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f29f81503e0 con 0x7f29f8151bf0 2023-11-28T19:59:00.221 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:00.216+0000 7f29ee7fc640 1 -- 172.21.15.78:0/57808562 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 2 v2) v1 ==== 93+0+1324 (secure 0 0 0) 0x7f29e8017540 con 0x7f29f8151bf0 2023-11-28T19:59:00.221 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-11-28T19:59:00.221 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":2,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4266,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6836/3073967897","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6835","nonce":3073967897},{"type":"v1","addr":"172.21.15.78:6836","nonce":3073967897}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2}],"filesystems":[]} 2023-11-28T19:59:00.221 INFO:teuthology.orchestra.run.smithi078.stderr:dumped fsmap epoch 2 2023-11-28T19:59:00.223 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:00.220+0000 7f2a0006b640 1 -- 172.21.15.78:0/57808562 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f29dc066470 msgr2=0x7f29dc068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:00.223 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:00.220+0000 7f2a0006b640 1 --2- 172.21.15.78:0/57808562 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f29dc066470 0x7f29dc068930 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f29f4007fd0 tx=0x7f29f4009040 comp rx=0 tx=0).stop 2023-11-28T19:59:00.223 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:00.220+0000 7f2a0006b640 1 -- 172.21.15.78:0/57808562 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f29f8151bf0 msgr2=0x7f29f8071b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:00.223 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:00.220+0000 7f2a0006b640 1 --2- 172.21.15.78:0/57808562 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f29f8151bf0 0x7f29f8071b50 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f29e800e980 tx=0x7f29e800ee40 comp rx=0 tx=0).stop 2023-11-28T19:59:00.223 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:00.220+0000 7f2a0006b640 1 -- 172.21.15.78:0/57808562 shutdown_connections 2023-11-28T19:59:00.223 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:00.220+0000 7f2a0006b640 1 --2- 172.21.15.78:0/57808562 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f29dc066470 0x7f29dc068930 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:00.223 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:00.220+0000 7f2a0006b640 1 --2- 172.21.15.78:0/57808562 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f29f8154b50 0x7f29f8146b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:00.223 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:00.220+0000 7f2a0006b640 1 --2- 172.21.15.78:0/57808562 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f29f8151bf0 0x7f29f8071b50 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:00.224 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:00.220+0000 7f2a0006b640 1 --2- 172.21.15.78:0/57808562 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f29f806d890 0x7f29f80aaef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:00.224 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:00.220+0000 7f2a0006b640 1 -- 172.21.15.78:0/57808562 >> 172.21.15.78:0/57808562 conn(0x7f29f80c61f0 msgr2=0x7f29f814fcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T19:59:00.224 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:00.220+0000 7f2a0006b640 1 -- 172.21.15.78:0/57808562 shutdown_connections 2023-11-28T19:59:00.224 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:00.220+0000 7f2a0006b640 1 -- 172.21.15.78:0/57808562 wait complete. 2023-11-28T19:59:02.242 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-28T19:59:02.386 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:02.380+0000 7f730f92a640 1 Processor -- start 2023-11-28T19:59:02.387 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:02.380+0000 7f730f92a640 1 -- start start 2023-11-28T19:59:02.389 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:02.384+0000 7f730f92a640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f730806d2b0 0x7f730806d690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:02.389 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:02.384+0000 7f730f92a640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f73080c3b80 0x7f73080c5300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:02.389 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:02.384+0000 7f730f92a640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f730806c020 0x7f730806c4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:02.389 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:02.384+0000 7f730f92a640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f73080c5840 con 0x7f73080c3b80 2023-11-28T19:59:02.389 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:02.384+0000 7f730f92a640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f730806bb80 con 0x7f730806d2b0 2023-11-28T19:59:02.389 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:02.384+0000 7f730f92a640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f73081515c0 con 0x7f730806c020 2023-11-28T19:59:02.389 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:02.384+0000 7f730cec5640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f73080c3b80 0x7f73080c5300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:02.389 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:02.384+0000 7f730cec5640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f73080c3b80 0x7f73080c5300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:47560/0 (socket says 172.21.15.78:47560) 2023-11-28T19:59:02.389 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:02.384+0000 7f730cec5640 1 -- 172.21.15.78:0/2035918451 learned_addr learned my addr 172.21.15.78:0/2035918451 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T19:59:02.389 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:02.384+0000 7f730d6c6640 1 --2- 172.21.15.78:0/2035918451 >> v2:172.21.15.179:3300/0 conn(0x7f730806d2b0 0x7f730806d690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:02.389 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:02.384+0000 7f730dec7640 1 --2- 172.21.15.78:0/2035918451 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f730806c020 0x7f730806c4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:02.390 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:02.384+0000 7f730cec5640 1 -- 172.21.15.78:0/2035918451 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f730806c020 msgr2=0x7f730806c4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T19:59:02.390 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:02.384+0000 7f730cec5640 1 --2- 172.21.15.78:0/2035918451 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f730806c020 0x7f730806c4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:02.390 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:02.384+0000 7f730cec5640 1 -- 172.21.15.78:0/2035918451 >> v2:172.21.15.179:3300/0 conn(0x7f730806d2b0 msgr2=0x7f730806d690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T19:59:02.390 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:02.384+0000 7f730cec5640 1 --2- 172.21.15.78:0/2035918451 >> v2:172.21.15.179:3300/0 conn(0x7f730806d2b0 0x7f730806d690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:02.390 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:02.384+0000 7f730cec5640 1 -- 172.21.15.78:0/2035918451 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73081518a0 con 0x7f73080c3b80 2023-11-28T19:59:02.390 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:02.384+0000 7f730d6c6640 1 --2- 172.21.15.78:0/2035918451 >> v2:172.21.15.179:3300/0 conn(0x7f730806d2b0 0x7f730806d690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T19:59:02.390 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:02.384+0000 7f730dec7640 1 --2- 172.21.15.78:0/2035918451 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f730806c020 0x7f730806c4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T19:59:02.392 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:02.388+0000 7f730cec5640 1 --2- 172.21.15.78:0/2035918451 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f73080c3b80 0x7f73080c5300 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f73080c2130 tx=0x7f72f801c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ebdd1799d1006497 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:59:02.393 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:02.388+0000 7f72fffff640 1 -- 172.21.15.78:0/2035918451 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72f80aa5f0 con 0x7f73080c3b80 2023-11-28T19:59:02.393 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:02.388+0000 7f72fffff640 1 -- 172.21.15.78:0/2035918451 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f72f80aa750 con 0x7f73080c3b80 2023-11-28T19:59:02.393 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:02.388+0000 7f72fffff640 1 -- 172.21.15.78:0/2035918451 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72f80aaae0 con 0x7f73080c3b80 2023-11-28T19:59:02.393 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:02.388+0000 7f730f92a640 1 -- 172.21.15.78:0/2035918451 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f73080c3b80 msgr2=0x7f73080c5300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:02.393 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:02.388+0000 7f730f92a640 1 --2- 172.21.15.78:0/2035918451 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f73080c3b80 0x7f73080c5300 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f73080c2130 tx=0x7f72f801c4d0 comp rx=0 tx=0).stop 2023-11-28T19:59:02.393 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:02.388+0000 7f730f92a640 1 -- 172.21.15.78:0/2035918451 shutdown_connections 2023-11-28T19:59:02.393 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:02.388+0000 7f730f92a640 1 --2- 172.21.15.78:0/2035918451 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f730806c020 0x7f730806c4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:02.393 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:02.388+0000 7f730f92a640 1 --2- 172.21.15.78:0/2035918451 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f73080c3b80 0x7f73080c5300 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:02.393 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:02.388+0000 7f730f92a640 1 --2- 172.21.15.78:0/2035918451 >> v2:172.21.15.179:3300/0 conn(0x7f730806d2b0 0x7f730806d690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:02.394 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:02.388+0000 7f730f92a640 1 -- 172.21.15.78:0/2035918451 >> 172.21.15.78:0/2035918451 conn(0x7f73080a7810 msgr2=0x7f73080a7c20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T19:59:02.394 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:02.388+0000 7f730f92a640 1 -- 172.21.15.78:0/2035918451 shutdown_connections 2023-11-28T19:59:02.394 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:02.388+0000 7f730f92a640 1 -- 172.21.15.78:0/2035918451 wait complete. 2023-11-28T19:59:02.397 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:02.388+0000 7f730f92a640 1 Processor -- start 2023-11-28T19:59:02.397 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:02.388+0000 7f730f92a640 1 -- start start 2023-11-28T19:59:02.397 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:02.392+0000 7f730f92a640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f730806c020 0x7f73081441a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:02.397 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:02.392+0000 7f730f92a640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f730806d2b0 0x7f73080bee90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:02.397 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:02.392+0000 7f730f92a640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f73080c3b80 0x7f73081f01c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:02.397 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:02.392+0000 7f730f92a640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7308151200 con 0x7f730806d2b0 2023-11-28T19:59:02.397 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:02.392+0000 7f730f92a640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7308150c10 con 0x7f730806c020 2023-11-28T19:59:02.397 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:02.392+0000 7f730f92a640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f73081446e0 con 0x7f73080c3b80 2023-11-28T19:59:02.397 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:02.392+0000 7f730cec5640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f730806d2b0 0x7f73080bee90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:02.398 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:02.392+0000 7f730cec5640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f730806d2b0 0x7f73080bee90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:47576/0 (socket says 172.21.15.78:47576) 2023-11-28T19:59:02.398 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:02.392+0000 7f730cec5640 1 -- 172.21.15.78:0/3954442345 learned_addr learned my addr 172.21.15.78:0/3954442345 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T19:59:02.398 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:02.392+0000 7f730d6c6640 1 --2- 172.21.15.78:0/3954442345 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f730806c020 0x7f73081441a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:02.398 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:02.392+0000 7f730cec5640 1 -- 172.21.15.78:0/3954442345 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f73080c3b80 msgr2=0x7f73081f01c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:02.398 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:02.392+0000 7f730dec7640 1 --2- 172.21.15.78:0/3954442345 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f73080c3b80 0x7f73081f01c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:02.398 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:02.392+0000 7f730cec5640 1 --2- 172.21.15.78:0/3954442345 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f73080c3b80 0x7f73081f01c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:02.398 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:02.392+0000 7f730cec5640 1 -- 172.21.15.78:0/3954442345 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f730806c020 msgr2=0x7f73081441a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:02.398 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:02.392+0000 7f730cec5640 1 --2- 172.21.15.78:0/3954442345 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f730806c020 0x7f73081441a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:02.398 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:02.392+0000 7f730cec5640 1 -- 172.21.15.78:0/3954442345 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72f80094d0 con 0x7f730806d2b0 2023-11-28T19:59:02.398 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:02.392+0000 7f730d6c6640 1 --2- 172.21.15.78:0/3954442345 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f730806c020 0x7f73081441a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T19:59:02.398 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:02.392+0000 7f730dec7640 1 --2- 172.21.15.78:0/3954442345 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f73080c3b80 0x7f73081f01c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T19:59:02.398 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:02.392+0000 7f730cec5640 1 --2- 172.21.15.78:0/3954442345 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f730806d2b0 0x7f73080bee90 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f72f80ac040 tx=0x7f72f8019270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:59:02.399 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:02.392+0000 7f72fdffb640 1 -- 172.21.15.78:0/3954442345 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72f80b4810 con 0x7f730806d2b0 2023-11-28T19:59:02.399 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:02.392+0000 7f72fdffb640 1 -- 172.21.15.78:0/3954442345 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f72f80b49b0 con 0x7f730806d2b0 2023-11-28T19:59:02.399 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:02.392+0000 7f72fdffb640 1 -- 172.21.15.78:0/3954442345 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72f80b4d60 con 0x7f730806d2b0 2023-11-28T19:59:02.399 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:02.392+0000 7f730f92a640 1 -- 172.21.15.78:0/3954442345 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f730814ef80 con 0x7f730806d2b0 2023-11-28T19:59:02.399 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:02.392+0000 7f730f92a640 1 -- 172.21.15.78:0/3954442345 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7308148480 con 0x7f730806d2b0 2023-11-28T19:59:02.400 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:02.392+0000 7f730f92a640 1 -- 172.21.15.78:0/3954442345 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7308067630 con 0x7f730806d2b0 2023-11-28T19:59:02.400 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:02.392+0000 7f72fdffb640 1 -- 172.21.15.78:0/3954442345 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f72f80b3390 con 0x7f730806d2b0 2023-11-28T19:59:02.400 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:02.396+0000 7f72fdffb640 1 --2- 172.21.15.78:0/3954442345 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f72ec066470 0x7f72ec068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:02.400 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:02.396+0000 7f72fdffb640 1 -- 172.21.15.78:0/3954442345 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f72f80a7070 con 0x7f730806d2b0 2023-11-28T19:59:02.400 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:02.396+0000 7f730d6c6640 1 --2- 172.21.15.78:0/3954442345 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f72ec066470 0x7f72ec068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:02.400 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:02.396+0000 7f730d6c6640 1 --2- 172.21.15.78:0/3954442345 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f72ec066470 0x7f72ec068930 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f7304006fd0 tx=0x7f7304008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:59:02.403 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:02.400+0000 7f72fdffb640 1 -- 172.21.15.78:0/3954442345 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f72f80ebc30 con 0x7f730806d2b0 2023-11-28T19:59:02.585 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:02.580+0000 7f730f92a640 1 -- 172.21.15.78:0/3954442345 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f730806bd70 con 0x7f730806d2b0 2023-11-28T19:59:02.586 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:02.580+0000 7f72fdffb640 1 -- 172.21.15.78:0/3954442345 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) v1 ==== 93+0+3700 (secure 0 0 0) 0x7f72f80ef250 con 0x7f730806d2b0 2023-11-28T19:59:02.586 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-11-28T19:59:02.586 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":3,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4241,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6835/3089461479","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6833","nonce":3089461479},{"type":"v1","addr":"172.21.15.179:6835","nonce":3089461479}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4258,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6837/3153162191","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6834","nonce":3153162191},{"type":"v1","addr":"172.21.15.78:6837","nonce":3153162191}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4266,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6836/3073967897","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6835","nonce":3073967897},{"type":"v1","addr":"172.21.15.78:6836","nonce":3073967897}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4275,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6834/1234044491","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6832","nonce":1234044491},{"type":"v1","addr":"172.21.15.179:6834","nonce":1234044491}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[]} 2023-11-28T19:59:02.586 INFO:teuthology.orchestra.run.smithi078.stderr:dumped fsmap epoch 3 2023-11-28T19:59:02.588 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:02.584+0000 7f730f92a640 1 -- 172.21.15.78:0/3954442345 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f72ec066470 msgr2=0x7f72ec068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:02.588 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:02.584+0000 7f730f92a640 1 --2- 172.21.15.78:0/3954442345 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f72ec066470 0x7f72ec068930 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f7304006fd0 tx=0x7f7304008040 comp rx=0 tx=0).stop 2023-11-28T19:59:02.589 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:02.584+0000 7f730f92a640 1 -- 172.21.15.78:0/3954442345 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f730806d2b0 msgr2=0x7f73080bee90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:02.589 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:02.584+0000 7f730f92a640 1 --2- 172.21.15.78:0/3954442345 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f730806d2b0 0x7f73080bee90 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f72f80ac040 tx=0x7f72f8019270 comp rx=0 tx=0).stop 2023-11-28T19:59:02.589 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:02.584+0000 7f730f92a640 1 -- 172.21.15.78:0/3954442345 shutdown_connections 2023-11-28T19:59:02.589 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:02.584+0000 7f730f92a640 1 --2- 172.21.15.78:0/3954442345 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f72ec066470 0x7f72ec068930 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:02.589 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:02.584+0000 7f730f92a640 1 --2- 172.21.15.78:0/3954442345 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f73080c3b80 0x7f73081f01c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:02.589 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:02.584+0000 7f730f92a640 1 --2- 172.21.15.78:0/3954442345 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f730806d2b0 0x7f73080bee90 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:02.589 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:02.584+0000 7f730f92a640 1 --2- 172.21.15.78:0/3954442345 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f730806c020 0x7f73081441a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:02.589 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:02.584+0000 7f730f92a640 1 -- 172.21.15.78:0/3954442345 >> 172.21.15.78:0/3954442345 conn(0x7f73080a7810 msgr2=0x7f73080aab10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T19:59:02.589 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:02.584+0000 7f730f92a640 1 -- 172.21.15.78:0/3954442345 shutdown_connections 2023-11-28T19:59:02.589 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:02.584+0000 7f730f92a640 1 -- 172.21.15.78:0/3954442345 wait complete. 2023-11-28T19:59:02.607 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-28T19:59:02.747 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:02.744+0000 7faae6980640 1 Processor -- start 2023-11-28T19:59:02.747 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:02.744+0000 7faae6980640 1 -- start start 2023-11-28T19:59:02.749 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:02.744+0000 7faae6980640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7faae00af4c0 0x7faae0154f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:02.749 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:02.744+0000 7faae6980640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7faae00c67d0 0x7faae00c6c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:02.749 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:02.744+0000 7faae6980640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7faae006b9f0 0x7faae006be40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:02.749 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:02.744+0000 7faae6980640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faae0155460 con 0x7faae00c67d0 2023-11-28T19:59:02.749 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:02.744+0000 7faae6980640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faae006c380 con 0x7faae006b9f0 2023-11-28T19:59:02.749 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:02.744+0000 7faae6980640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faae00c4890 con 0x7faae00af4c0 2023-11-28T19:59:02.749 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:02.744+0000 7faadf7fe640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7faae00c67d0 0x7faae00c6c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:02.749 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:02.744+0000 7faadf7fe640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7faae00c67d0 0x7faae00c6c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:47592/0 (socket says 172.21.15.78:47592) 2023-11-28T19:59:02.749 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:02.744+0000 7faadf7fe640 1 -- 172.21.15.78:0/1790046913 learned_addr learned my addr 172.21.15.78:0/1790046913 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T19:59:02.750 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:02.744+0000 7faadffff640 1 --2- 172.21.15.78:0/1790046913 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7faae00af4c0 0x7faae0154f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:02.750 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:02.744+0000 7faadf7fe640 1 -- 172.21.15.78:0/1790046913 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7faae00af4c0 msgr2=0x7faae0154f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T19:59:02.750 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:02.744+0000 7faadf7fe640 1 --2- 172.21.15.78:0/1790046913 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7faae00af4c0 0x7faae0154f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:02.750 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:02.744+0000 7faadf7fe640 1 -- 172.21.15.78:0/1790046913 >> v2:172.21.15.179:3300/0 conn(0x7faae006b9f0 msgr2=0x7faae006be40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T19:59:02.750 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:02.744+0000 7faae4f1d640 1 --2- 172.21.15.78:0/1790046913 >> v2:172.21.15.179:3300/0 conn(0x7faae006b9f0 0x7faae006be40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:02.750 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:02.744+0000 7faadf7fe640 1 --2- 172.21.15.78:0/1790046913 >> v2:172.21.15.179:3300/0 conn(0x7faae006b9f0 0x7faae006be40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:02.750 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:02.744+0000 7faadf7fe640 1 -- 172.21.15.78:0/1790046913 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faae00af8a0 con 0x7faae00c67d0 2023-11-28T19:59:02.750 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:02.744+0000 7faadffff640 1 --2- 172.21.15.78:0/1790046913 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7faae00af4c0 0x7faae0154f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T19:59:02.750 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:02.744+0000 7faae4f1d640 1 --2- 172.21.15.78:0/1790046913 >> v2:172.21.15.179:3300/0 conn(0x7faae006b9f0 0x7faae006be40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T19:59:02.751 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:02.748+0000 7faadf7fe640 1 --2- 172.21.15.78:0/1790046913 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7faae00c67d0 0x7faae00c6c50 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7faae00ab960 tx=0x7faad401c440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fd382e4cf1f29f22 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:59:02.752 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:02.748+0000 7faadeffd640 1 -- 172.21.15.78:0/1790046913 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faad40ab600 con 0x7faae00c67d0 2023-11-28T19:59:02.752 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:02.748+0000 7faadeffd640 1 -- 172.21.15.78:0/1790046913 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faad40ab760 con 0x7faae00c67d0 2023-11-28T19:59:02.752 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:02.748+0000 7faadeffd640 1 -- 172.21.15.78:0/1790046913 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faad40abaf0 con 0x7faae00c67d0 2023-11-28T19:59:02.753 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:02.748+0000 7faae6980640 1 -- 172.21.15.78:0/1790046913 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7faae00c67d0 msgr2=0x7faae00c6c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:02.753 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:02.748+0000 7faae6980640 1 --2- 172.21.15.78:0/1790046913 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7faae00c67d0 0x7faae00c6c50 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7faae00ab960 tx=0x7faad401c440 comp rx=0 tx=0).stop 2023-11-28T19:59:02.753 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:02.748+0000 7faae6980640 1 -- 172.21.15.78:0/1790046913 shutdown_connections 2023-11-28T19:59:02.753 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:02.748+0000 7faae6980640 1 --2- 172.21.15.78:0/1790046913 >> v2:172.21.15.179:3300/0 conn(0x7faae006b9f0 0x7faae006be40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:02.753 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:02.748+0000 7faae6980640 1 --2- 172.21.15.78:0/1790046913 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7faae00c67d0 0x7faae00c6c50 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:02.753 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:02.748+0000 7faae6980640 1 --2- 172.21.15.78:0/1790046913 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7faae00af4c0 0x7faae0154f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:02.753 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:02.748+0000 7faae6980640 1 -- 172.21.15.78:0/1790046913 >> 172.21.15.78:0/1790046913 conn(0x7faae00ab9d0 msgr2=0x7faae00abde0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T19:59:02.753 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:02.748+0000 7faae6980640 1 -- 172.21.15.78:0/1790046913 shutdown_connections 2023-11-28T19:59:02.753 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:02.748+0000 7faae6980640 1 -- 172.21.15.78:0/1790046913 wait complete. 2023-11-28T19:59:02.754 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:02.748+0000 7faae6980640 1 Processor -- start 2023-11-28T19:59:02.754 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:02.752+0000 7faae6980640 1 -- start start 2023-11-28T19:59:02.756 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:02.752+0000 7faae6980640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7faae006b9f0 0x7faae00be650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:02.756 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:02.752+0000 7faae6980640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7faae00af4c0 0x7faae00bd300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:02.756 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:02.752+0000 7faae6980640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7faae00c67d0 0x7faae00bd840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:02.756 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:02.752+0000 7faae6980640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faae0153360 con 0x7faae00c67d0 2023-11-28T19:59:02.756 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:02.752+0000 7faae6980640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faae00bd0e0 con 0x7faae006b9f0 2023-11-28T19:59:02.756 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:02.752+0000 7faae6980640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faae00c28e0 con 0x7faae00af4c0 2023-11-28T19:59:02.757 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:02.752+0000 7faae4f1d640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7faae00c67d0 0x7faae00bd840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:02.757 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:02.752+0000 7faae4f1d640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7faae00c67d0 0x7faae00bd840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:47600/0 (socket says 172.21.15.78:47600) 2023-11-28T19:59:02.757 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:02.752+0000 7faae4f1d640 1 -- 172.21.15.78:0/2378359143 learned_addr learned my addr 172.21.15.78:0/2378359143 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T19:59:02.757 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:02.752+0000 7faadf7fe640 1 --2- 172.21.15.78:0/2378359143 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7faae00af4c0 0x7faae00bd300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:02.757 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:02.752+0000 7faadffff640 1 --2- 172.21.15.78:0/2378359143 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7faae006b9f0 0x7faae00be650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:02.757 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:02.752+0000 7faae4f1d640 1 -- 172.21.15.78:0/2378359143 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7faae00af4c0 msgr2=0x7faae00bd300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:02.757 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:02.752+0000 7faae4f1d640 1 --2- 172.21.15.78:0/2378359143 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7faae00af4c0 0x7faae00bd300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:02.757 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:02.752+0000 7faae4f1d640 1 -- 172.21.15.78:0/2378359143 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7faae006b9f0 msgr2=0x7faae00be650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:02.757 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:02.752+0000 7faae4f1d640 1 --2- 172.21.15.78:0/2378359143 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7faae006b9f0 0x7faae00be650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:02.757 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:02.752+0000 7faae4f1d640 1 -- 172.21.15.78:0/2378359143 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faad40094d0 con 0x7faae00c67d0 2023-11-28T19:59:02.757 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:02.752+0000 7faae4f1d640 1 --2- 172.21.15.78:0/2378359143 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7faae00c67d0 0x7faae00bd840 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7faad800cd50 tx=0x7faad800a650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:59:02.758 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:02.752+0000 7faadcff9640 1 -- 172.21.15.78:0/2378359143 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faad800f680 con 0x7faae00c67d0 2023-11-28T19:59:02.759 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:02.752+0000 7faadcff9640 1 -- 172.21.15.78:0/2378359143 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faad800f800 con 0x7faae00c67d0 2023-11-28T19:59:02.759 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:02.752+0000 7faae6980640 1 -- 172.21.15.78:0/2378359143 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faae00c2b80 con 0x7faae00c67d0 2023-11-28T19:59:02.759 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:02.752+0000 7faadcff9640 1 -- 172.21.15.78:0/2378359143 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faad800fbb0 con 0x7faae00c67d0 2023-11-28T19:59:02.759 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:02.752+0000 7faae6980640 1 -- 172.21.15.78:0/2378359143 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faae01535b0 con 0x7faae00c67d0 2023-11-28T19:59:02.759 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:02.752+0000 7faae6980640 1 -- 172.21.15.78:0/2378359143 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faae01537a0 con 0x7faae00c67d0 2023-11-28T19:59:02.759 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:02.756+0000 7faadcff9640 1 -- 172.21.15.78:0/2378359143 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7faad800b040 con 0x7faae00c67d0 2023-11-28T19:59:02.760 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:02.756+0000 7faadcff9640 1 --2- 172.21.15.78:0/2378359143 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7faacc066470 0x7faacc068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:02.760 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:02.756+0000 7faadcff9640 1 -- 172.21.15.78:0/2378359143 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 4857+0+0 (secure 0 0 0) 0x7faad80843c0 con 0x7faae00c67d0 2023-11-28T19:59:02.760 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:02.756+0000 7faadffff640 1 --2- 172.21.15.78:0/2378359143 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7faacc066470 0x7faacc068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:02.760 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:02.756+0000 7faadffff640 1 --2- 172.21.15.78:0/2378359143 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7faacc066470 0x7faacc068930 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7faae0154700 tx=0x7faad0008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:59:02.763 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:02.760+0000 7faadcff9640 1 -- 172.21.15.78:0/2378359143 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7faad8051c20 con 0x7faae00c67d0 2023-11-28T19:59:02.912 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:02.908+0000 7faae6980640 1 -- 172.21.15.78:0/2378359143 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7faae0067630 con 0x7faae00c67d0 2023-11-28T19:59:02.913 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:02.908+0000 7faadcff9640 1 -- 172.21.15.78:0/2378359143 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v17) v1 ==== 74+0+12826 (secure 0 0 0) 0x7faad8055240 con 0x7faae00c67d0 2023-11-28T19:59:02.913 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-11-28T19:59:02.914 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":17,"fsid":"dd9780e8-3bda-44fa-a9f0-fa07d19d901d","created":"2023-11-28T19:58:40.969556+0000","modified":"2023-11-28T19:58:56.742459+0000","last_up_change":"2023-11-28T19:58:52.596716+0000","last_in_change":"2023-11-28T19:58:43.609275+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-28T19:58:54.011229+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e84245ac-b5da-429e-af18-39acaa2b33e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6800","nonce":3358701235},{"type":"v1","addr":"172.21.15.78:6801","nonce":3358701235}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6802","nonce":3358701235},{"type":"v1","addr":"172.21.15.78:6803","nonce":3358701235}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6806","nonce":3358701235},{"type":"v1","addr":"172.21.15.78:6807","nonce":3358701235}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6804","nonce":3358701235},{"type":"v1","addr":"172.21.15.78:6805","nonce":3358701235}]},"public_addr":"172.21.15.78:6801/3358701235","cluster_addr":"172.21.15.78:6803/3358701235","heartbeat_back_addr":"172.21.15.78:6807/3358701235","heartbeat_front_addr":"172.21.15.78:6805/3358701235","state":["exists","up"]},{"osd":1,"uuid":"e634831d-c4e2-48d9-870c-9556ae162981","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6808","nonce":3211476654},{"type":"v1","addr":"172.21.15.78:6809","nonce":3211476654}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6810","nonce":3211476654},{"type":"v1","addr":"172.21.15.78:6811","nonce":3211476654}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6814","nonce":3211476654},{"type":"v1","addr":"172.21.15.78:6815","nonce":3211476654}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6812","nonce":3211476654},{"type":"v1","addr":"172.21.15.78:6813","nonce":3211476654}]},"public_addr":"172.21.15.78:6809/3211476654","cluster_addr":"172.21.15.78:6811/3211476654","heartbeat_back_addr":"172.21.15.78:6815/3211476654","heartbeat_front_addr":"172.21.15.78:6813/3211476654","state":["exists","up"]},{"osd":2,"uuid":"274c8395-6534-41f0-b8fb-a00af8985aa8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6816","nonce":2532904479},{"type":"v1","addr":"172.21.15.78:6817","nonce":2532904479}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6818","nonce":2532904479},{"type":"v1","addr":"172.21.15.78:6819","nonce":2532904479}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6822","nonce":2532904479},{"type":"v1","addr":"172.21.15.78:6823","nonce":2532904479}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6820","nonce":2532904479},{"type":"v1","addr":"172.21.15.78:6821","nonce":2532904479}]},"public_addr":"172.21.15.78:6817/2532904479","cluster_addr":"172.21.15.78:6819/2532904479","heartbeat_back_addr":"172.21.15.78:6823/2532904479","heartbeat_front_addr":"172.21.15.78:6821/2532904479","state":["exists","up"]},{"osd":3,"uuid":"77acc9af-7d4d-4b18-8cf5-d62f5971b7c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6824","nonce":3442991267},{"type":"v1","addr":"172.21.15.78:6825","nonce":3442991267}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6826","nonce":3442991267},{"type":"v1","addr":"172.21.15.78:6827","nonce":3442991267}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6830","nonce":3442991267},{"type":"v1","addr":"172.21.15.78:6831","nonce":3442991267}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6828","nonce":3442991267},{"type":"v1","addr":"172.21.15.78:6829","nonce":3442991267}]},"public_addr":"172.21.15.78:6825/3442991267","cluster_addr":"172.21.15.78:6827/3442991267","heartbeat_back_addr":"172.21.15.78:6831/3442991267","heartbeat_front_addr":"172.21.15.78:6829/3442991267","state":["exists","up"]},{"osd":4,"uuid":"5c62bc66-6b34-4b7f-a66b-9a743969138c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":802983577},{"type":"v1","addr":"172.21.15.179:6809","nonce":802983577}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":802983577},{"type":"v1","addr":"172.21.15.179:6811","nonce":802983577}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":802983577},{"type":"v1","addr":"172.21.15.179:6815","nonce":802983577}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":802983577},{"type":"v1","addr":"172.21.15.179:6813","nonce":802983577}]},"public_addr":"172.21.15.179:6809/802983577","cluster_addr":"172.21.15.179:6811/802983577","heartbeat_back_addr":"172.21.15.179:6815/802983577","heartbeat_front_addr":"172.21.15.179:6813/802983577","state":["exists","up"]},{"osd":5,"uuid":"67db6d36-f684-4079-b0cd-82b4dd61461f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":518192887},{"type":"v1","addr":"172.21.15.179:6818","nonce":518192887}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":518192887},{"type":"v1","addr":"172.21.15.179:6822","nonce":518192887}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":518192887},{"type":"v1","addr":"172.21.15.179:6829","nonce":518192887}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6824","nonce":518192887},{"type":"v1","addr":"172.21.15.179:6826","nonce":518192887}]},"public_addr":"172.21.15.179:6818/518192887","cluster_addr":"172.21.15.179:6822/518192887","heartbeat_back_addr":"172.21.15.179:6829/518192887","heartbeat_front_addr":"172.21.15.179:6826/518192887","state":["exists","up"]},{"osd":6,"uuid":"12e670af-5a16-4c81-9f97-defa66cab967","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":815435378},{"type":"v1","addr":"172.21.15.179:6801","nonce":815435378}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":815435378},{"type":"v1","addr":"172.21.15.179:6803","nonce":815435378}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":815435378},{"type":"v1","addr":"172.21.15.179:6807","nonce":815435378}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":815435378},{"type":"v1","addr":"172.21.15.179:6805","nonce":815435378}]},"public_addr":"172.21.15.179:6801/815435378","cluster_addr":"172.21.15.179:6803/815435378","heartbeat_back_addr":"172.21.15.179:6807/815435378","heartbeat_front_addr":"172.21.15.179:6805/815435378","state":["exists","up"]},{"osd":7,"uuid":"fe630650-2eb3-49ad-8676-c341e6332eb1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6817","nonce":2848432339},{"type":"v1","addr":"172.21.15.179:6819","nonce":2848432339}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6821","nonce":2848432339},{"type":"v1","addr":"172.21.15.179:6823","nonce":2848432339}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":2848432339},{"type":"v1","addr":"172.21.15.179:6831","nonce":2848432339}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6825","nonce":2848432339},{"type":"v1","addr":"172.21.15.179:6827","nonce":2848432339}]},"public_addr":"172.21.15.179:6819/2848432339","cluster_addr":"172.21.15.179:6823/2848432339","heartbeat_back_addr":"172.21.15.179:6831/2848432339","heartbeat_front_addr":"172.21.15.179:6827/2848432339","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:58:49.255433+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:58:49.412880+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:58:49.559295+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:58:49.245237+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:58:49.184557+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:58:49.329851+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:58:49.366012+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:58:49.349604+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-28T19:59:02.916 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:02.912+0000 7faae6980640 1 -- 172.21.15.78:0/2378359143 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7faacc066470 msgr2=0x7faacc068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:02.916 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:02.912+0000 7faae6980640 1 --2- 172.21.15.78:0/2378359143 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7faacc066470 0x7faacc068930 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7faae0154700 tx=0x7faad0008040 comp rx=0 tx=0).stop 2023-11-28T19:59:02.917 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:02.912+0000 7faae6980640 1 -- 172.21.15.78:0/2378359143 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7faae00c67d0 msgr2=0x7faae00bd840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:02.917 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:02.912+0000 7faae6980640 1 --2- 172.21.15.78:0/2378359143 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7faae00c67d0 0x7faae00bd840 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7faad800cd50 tx=0x7faad800a650 comp rx=0 tx=0).stop 2023-11-28T19:59:02.917 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:02.912+0000 7faae6980640 1 -- 172.21.15.78:0/2378359143 shutdown_connections 2023-11-28T19:59:02.917 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:02.912+0000 7faae6980640 1 --2- 172.21.15.78:0/2378359143 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7faacc066470 0x7faacc068930 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:02.917 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:02.912+0000 7faae6980640 1 --2- 172.21.15.78:0/2378359143 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7faae00af4c0 0x7faae00bd300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:02.917 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:02.912+0000 7faae6980640 1 --2- 172.21.15.78:0/2378359143 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7faae00c67d0 0x7faae00bd840 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:02.917 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:02.912+0000 7faae6980640 1 --2- 172.21.15.78:0/2378359143 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7faae006b9f0 0x7faae00be650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:02.917 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:02.912+0000 7faae6980640 1 -- 172.21.15.78:0/2378359143 >> 172.21.15.78:0/2378359143 conn(0x7faae00ab9d0 msgr2=0x7faae00abdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T19:59:02.917 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:02.912+0000 7faae6980640 1 -- 172.21.15.78:0/2378359143 shutdown_connections 2023-11-28T19:59:02.917 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:02.912+0000 7faae6980640 1 -- 172.21.15.78:0/2378359143 wait complete. 2023-11-28T19:59:02.935 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-28T19:58:54.011229+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-28T19:59:02.935 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-28T19:59:03.077 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:03.072+0000 7fc7c4b80640 1 Processor -- start 2023-11-28T19:59:03.077 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:03.072+0000 7fc7c4b80640 1 -- start start 2023-11-28T19:59:03.078 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:03.072+0000 7fc7c4b80640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fc7c00c5300 0x7fc7c00a9c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:03.078 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:03.072+0000 7fc7c4b80640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc7c01548c0 0x7fc7c0154d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:03.078 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:03.072+0000 7fc7c4b80640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc7c00a4e20 con 0x7fc7c014b1e0 2023-11-28T19:59:03.078 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:03.072+0000 7fc7c4b80640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc7c00a50e0 con 0x7fc7c00c5300 2023-11-28T19:59:03.078 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:03.072+0000 7fc7c4b80640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc7c00c0f00 con 0x7fc7c01548c0 2023-11-28T19:59:03.079 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:03.076+0000 7fc7b7fff640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fc7c00c5300 0x7fc7c00a9c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:03.079 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:03.076+0000 7fc7bed9d640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc7c01548c0 0x7fc7c0154d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:03.080 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:03.076+0000 7fc7be59c640 1 --1- >> v1:172.21.15.179:6789/0 conn(0x7fc7c014b1e0 0x7fc7c00c1700 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.179:6789/0 says I am v1:172.21.15.78:33828/0 (socket says 172.21.15.78:33828) 2023-11-28T19:59:03.080 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:03.076+0000 7fc7be59c640 1 -- 172.21.15.78:0/824024424 learned_addr learned my addr 172.21.15.78:0/824024424 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-11-28T19:59:03.080 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:03.076+0000 7fc7bed9d640 1 -- 172.21.15.78:0/824024424 >> v2:172.21.15.179:3300/0 conn(0x7fc7c00c5300 msgr2=0x7fc7c00a9c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T19:59:03.080 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:03.076+0000 7fc7bed9d640 1 --2- 172.21.15.78:0/824024424 >> v2:172.21.15.179:3300/0 conn(0x7fc7c00c5300 0x7fc7c00a9c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:03.080 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:03.076+0000 7fc7bed9d640 1 -- 172.21.15.78:0/824024424 >> v1:172.21.15.179:6789/0 conn(0x7fc7c014b1e0 legacy=0x7fc7c00c1700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:03.080 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:03.076+0000 7fc7bed9d640 1 -- 172.21.15.78:0/824024424 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7c00c11e0 con 0x7fc7c01548c0 2023-11-28T19:59:03.081 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:03.076+0000 7fc7b7fff640 1 --2- 172.21.15.78:0/824024424 >> v2:172.21.15.179:3300/0 conn(0x7fc7c00c5300 0x7fc7c00a9c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T19:59:03.081 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:03.076+0000 7fc7bed9d640 1 --2- 172.21.15.78:0/824024424 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc7c01548c0 0x7fc7c0154d30 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fc7b8009d90 tx=0x7fc7b801c950 comp rx=0 tx=0).ready entity=mon.2 client_cookie=48f9dd43f475131c server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:59:03.082 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:03.076+0000 7fc7bdd9b640 1 -- 172.21.15.78:0/824024424 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7b80a5920 con 0x7fc7c01548c0 2023-11-28T19:59:03.082 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:03.080+0000 7fc7bdd9b640 1 -- 172.21.15.78:0/824024424 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc7b80a5a80 con 0x7fc7c01548c0 2023-11-28T19:59:03.083 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:03.080+0000 7fc7bdd9b640 1 -- 172.21.15.78:0/824024424 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7b80a5e10 con 0x7fc7c01548c0 2023-11-28T19:59:03.083 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:03.080+0000 7fc7c4b80640 1 -- 172.21.15.78:0/824024424 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc7c01548c0 msgr2=0x7fc7c0154d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:03.083 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:03.080+0000 7fc7c4b80640 1 --2- 172.21.15.78:0/824024424 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc7c01548c0 0x7fc7c0154d30 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fc7b8009d90 tx=0x7fc7b801c950 comp rx=0 tx=0).stop 2023-11-28T19:59:03.084 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:03.080+0000 7fc7c4b80640 1 -- 172.21.15.78:0/824024424 shutdown_connections 2023-11-28T19:59:03.084 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:03.080+0000 7fc7c4b80640 1 --2- 172.21.15.78:0/824024424 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc7c01548c0 0x7fc7c0154d30 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:03.084 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:03.080+0000 7fc7c4b80640 1 --2- 172.21.15.78:0/824024424 >> v2:172.21.15.179:3300/0 conn(0x7fc7c00c5300 0x7fc7c00a9c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:03.084 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:03.080+0000 7fc7c4b80640 1 -- 172.21.15.78:0/824024424 >> 172.21.15.78:0/824024424 conn(0x7fc7c00c59f0 msgr2=0x7fc7c00c5e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T19:59:03.084 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:03.080+0000 7fc7c4b80640 1 -- 172.21.15.78:0/824024424 shutdown_connections 2023-11-28T19:59:03.084 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:03.080+0000 7fc7c4b80640 1 -- 172.21.15.78:0/824024424 wait complete. 2023-11-28T19:59:03.085 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:03.080+0000 7fc7c4b80640 1 Processor -- start 2023-11-28T19:59:03.085 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:03.080+0000 7fc7c4b80640 1 -- start start 2023-11-28T19:59:03.086 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:03.080+0000 7fc7c4b80640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc7c00c5300 0x7fc7c00a5580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:03.087 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:03.080+0000 7fc7c4b80640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc7c014b1e0 0x7fc7c015dd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:03.087 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:03.080+0000 7fc7c4b80640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc7c01548c0 0x7fc7c015e260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:03.087 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:03.080+0000 7fc7c4b80640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7c01ed900 con 0x7fc7c014b1e0 2023-11-28T19:59:03.087 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:03.080+0000 7fc7c4b80640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7c00a6180 con 0x7fc7c01548c0 2023-11-28T19:59:03.087 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:03.080+0000 7fc7c4b80640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc7c01f0480 con 0x7fc7c00c5300 2023-11-28T19:59:03.087 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:03.080+0000 7fc7b7fff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc7c014b1e0 0x7fc7c015dd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:03.088 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:03.080+0000 7fc7b7fff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc7c014b1e0 0x7fc7c015dd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:47616/0 (socket says 172.21.15.78:47616) 2023-11-28T19:59:03.088 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:03.080+0000 7fc7b7fff640 1 -- 172.21.15.78:0/1320852910 learned_addr learned my addr 172.21.15.78:0/1320852910 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T19:59:03.088 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:03.080+0000 7fc7bed9d640 1 --2- 172.21.15.78:0/1320852910 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc7c01548c0 0x7fc7c015e260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:03.088 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:03.084+0000 7fc7be59c640 1 --2- 172.21.15.78:0/1320852910 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc7c00c5300 0x7fc7c00a5580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:03.088 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:03.084+0000 7fc7b7fff640 1 -- 172.21.15.78:0/1320852910 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc7c00c5300 msgr2=0x7fc7c00a5580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:03.088 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:03.084+0000 7fc7b7fff640 1 --2- 172.21.15.78:0/1320852910 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc7c00c5300 0x7fc7c00a5580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:03.089 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:03.084+0000 7fc7b7fff640 1 -- 172.21.15.78:0/1320852910 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc7c01548c0 msgr2=0x7fc7c015e260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:03.089 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:03.084+0000 7fc7b7fff640 1 --2- 172.21.15.78:0/1320852910 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc7c01548c0 0x7fc7c015e260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:03.089 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:03.084+0000 7fc7b7fff640 1 -- 172.21.15.78:0/1320852910 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7a8009420 con 0x7fc7c014b1e0 2023-11-28T19:59:03.089 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:03.084+0000 7fc7b7fff640 1 --2- 172.21.15.78:0/1320852910 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc7c014b1e0 0x7fc7c015dd20 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fc7a800e9d0 tx=0x7fc7a800ee90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:59:03.091 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:03.084+0000 7fc7b6ffd640 1 -- 172.21.15.78:0/1320852910 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7a800ca60 con 0x7fc7c014b1e0 2023-11-28T19:59:03.092 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:03.084+0000 7fc7b6ffd640 1 -- 172.21.15.78:0/1320852910 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc7a800cbc0 con 0x7fc7c014b1e0 2023-11-28T19:59:03.092 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:03.084+0000 7fc7c4b80640 1 -- 172.21.15.78:0/1320852910 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc7b8009a70 con 0x7fc7c014b1e0 2023-11-28T19:59:03.092 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:03.084+0000 7fc7b6ffd640 1 -- 172.21.15.78:0/1320852910 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7a8013470 con 0x7fc7c014b1e0 2023-11-28T19:59:03.092 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:03.084+0000 7fc7c4b80640 1 -- 172.21.15.78:0/1320852910 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc7c01ed240 con 0x7fc7c014b1e0 2023-11-28T19:59:03.092 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:03.084+0000 7fc7c4b80640 1 -- 172.21.15.78:0/1320852910 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc7c01edb70 con 0x7fc7c014b1e0 2023-11-28T19:59:03.092 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:03.084+0000 7fc7b6ffd640 1 -- 172.21.15.78:0/1320852910 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fc7a80135d0 con 0x7fc7c014b1e0 2023-11-28T19:59:03.093 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:03.088+0000 7fc7b6ffd640 1 --2- 172.21.15.78:0/1320852910 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fc7a0066470 0x7fc7a0068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:03.093 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:03.088+0000 7fc7b6ffd640 1 -- 172.21.15.78:0/1320852910 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fc7a8083a80 con 0x7fc7c014b1e0 2023-11-28T19:59:03.093 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:03.088+0000 7fc7be59c640 1 --2- 172.21.15.78:0/1320852910 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fc7a0066470 0x7fc7a0068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:03.093 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:03.088+0000 7fc7be59c640 1 --2- 172.21.15.78:0/1320852910 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fc7a0066470 0x7fc7a0068930 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fc7b0000f70 tx=0x7fc7b0009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:59:03.095 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:03.092+0000 7fc7b6ffd640 1 -- 172.21.15.78:0/1320852910 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fc7a80512c0 con 0x7fc7c014b1e0 2023-11-28T19:59:03.246 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:03.240+0000 7fc7c4b80640 1 -- 172.21.15.78:0/1320852910 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fc7c0067630 con 0x7fc7c014b1e0 2023-11-28T19:59:03.246 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:03.240+0000 7fc7b6ffd640 1 -- 172.21.15.78:0/1320852910 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v17) v1 ==== 93+0+10 (secure 0 0 0) 0x7fc7a80548e0 con 0x7fc7c014b1e0 2023-11-28T19:59:03.247 INFO:teuthology.orchestra.run.smithi078.stdout:pg_num: 1 2023-11-28T19:59:03.247 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:03.240+0000 7fc7c4b80640 1 -- 172.21.15.78:0/1320852910 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fc7a0066470 msgr2=0x7fc7a0068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:03.247 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:03.240+0000 7fc7c4b80640 1 --2- 172.21.15.78:0/1320852910 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fc7a0066470 0x7fc7a0068930 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fc7b0000f70 tx=0x7fc7b0009040 comp rx=0 tx=0).stop 2023-11-28T19:59:03.248 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:03.240+0000 7fc7c4b80640 1 -- 172.21.15.78:0/1320852910 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc7c014b1e0 msgr2=0x7fc7c015dd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:03.248 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:03.240+0000 7fc7c4b80640 1 --2- 172.21.15.78:0/1320852910 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc7c014b1e0 0x7fc7c015dd20 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fc7a800e9d0 tx=0x7fc7a800ee90 comp rx=0 tx=0).stop 2023-11-28T19:59:03.248 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:03.240+0000 7fc7c4b80640 1 -- 172.21.15.78:0/1320852910 shutdown_connections 2023-11-28T19:59:03.248 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:03.240+0000 7fc7c4b80640 1 --2- 172.21.15.78:0/1320852910 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fc7a0066470 0x7fc7a0068930 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:03.248 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:03.240+0000 7fc7c4b80640 1 --2- 172.21.15.78:0/1320852910 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc7c01548c0 0x7fc7c015e260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:03.248 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:03.240+0000 7fc7c4b80640 1 --2- 172.21.15.78:0/1320852910 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc7c014b1e0 0x7fc7c015dd20 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:03.248 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:03.240+0000 7fc7c4b80640 1 --2- 172.21.15.78:0/1320852910 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc7c00c5300 0x7fc7c00a5580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:03.248 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:03.240+0000 7fc7c4b80640 1 -- 172.21.15.78:0/1320852910 >> 172.21.15.78:0/1320852910 conn(0x7fc7c00c59f0 msgr2=0x7fc7c00c1600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T19:59:03.248 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:03.240+0000 7fc7c4b80640 1 -- 172.21.15.78:0/1320852910 shutdown_connections 2023-11-28T19:59:03.248 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:03.240+0000 7fc7c4b80640 1 -- 172.21.15.78:0/1320852910 wait complete. 2023-11-28T19:59:03.265 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-11-28T19:59:03.402 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:03.396+0000 7f8b7beea640 1 Processor -- start 2023-11-28T19:59:03.402 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:03.400+0000 7f8b7beea640 1 -- start start 2023-11-28T19:59:03.404 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:03.400+0000 7f8b7beea640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f8b740722c0 0x7f8b7415de60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:03.404 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:03.400+0000 7f8b7beea640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8b740c5710 con 0x7f8b74071e30 2023-11-28T19:59:03.404 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:03.400+0000 7f8b7beea640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8b74155c80 con 0x7f8b7414fd10 2023-11-28T19:59:03.404 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:03.400+0000 7f8b7beea640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8b7406c5e0 con 0x7f8b740722c0 2023-11-28T19:59:03.404 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:03.400+0000 7f8b79485640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f8b74071e30 0x7f8b74156110 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:37524/0 (socket says 172.21.15.78:37524) 2023-11-28T19:59:03.404 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:03.400+0000 7f8b79485640 1 -- 172.21.15.78:0/3577306550 learned_addr learned my addr 172.21.15.78:0/3577306550 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-11-28T19:59:03.406 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:03.400+0000 7f8b7a487640 1 --2- 172.21.15.78:0/3577306550 >> v2:172.21.15.179:3300/0 conn(0x7f8b740722c0 0x7f8b7415de60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:03.406 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:03.400+0000 7f8b78c84640 1 -- 172.21.15.78:0/3577306550 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 502869189 0 0) 0x7f8b740c5710 con 0x7f8b74071e30 2023-11-28T19:59:03.406 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:03.400+0000 7f8b78c84640 1 -- 172.21.15.78:0/3577306550 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8b60003530 con 0x7f8b74071e30 2023-11-28T19:59:03.406 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:03.400+0000 7f8b78c84640 1 -- 172.21.15.78:0/3577306550 <== mon.0 v1:172.21.15.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3193191576 0 0) 0x7f8b60003530 con 0x7f8b74071e30 2023-11-28T19:59:03.406 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:03.400+0000 7f8b78c84640 1 -- 172.21.15.78:0/3577306550 >> v2:172.21.15.179:3300/0 conn(0x7f8b740722c0 msgr2=0x7f8b7415de60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T19:59:03.406 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:03.400+0000 7f8b78c84640 1 --2- 172.21.15.78:0/3577306550 >> v2:172.21.15.179:3300/0 conn(0x7f8b740722c0 0x7f8b7415de60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:03.406 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:03.400+0000 7f8b78c84640 1 -- 172.21.15.78:0/3577306550 >> v1:172.21.15.179:6789/0 conn(0x7f8b7414fd10 legacy=0x7f8b740a4dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:03.406 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:03.400+0000 7f8b78c84640 1 -- 172.21.15.78:0/3577306550 --> v1:172.21.15.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b740c4e70 con 0x7f8b74071e30 2023-11-28T19:59:03.407 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:03.400+0000 7f8b78c84640 1 -- 172.21.15.78:0/3577306550 <== mon.0 v1:172.21.15.78:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3326804700 0 0) 0x7f8b64001680 con 0x7f8b74071e30 2023-11-28T19:59:03.407 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:03.400+0000 7f8b78c84640 1 -- 172.21.15.78:0/3577306550 >> v1:172.21.15.78:6789/0 conn(0x7f8b74071e30 legacy=0x7f8b74156110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:03.407 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:03.400+0000 7f8b78c84640 1 --2- 172.21.15.78:0/3577306550 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8b600039d0 0x7f8b60003df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:03.407 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:03.400+0000 7f8b78c84640 1 --2- 172.21.15.78:0/3577306550 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8b600047d0 0x7f8b60004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:03.407 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:03.400+0000 7f8b78c84640 1 --2- 172.21.15.78:0/3577306550 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8b600052b0 0x7f8b6000b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:03.407 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:03.400+0000 7f8b78c84640 1 -- 172.21.15.78:0/3577306550 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b6000c180 con 0x7f8b600039d0 2023-11-28T19:59:03.407 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:03.400+0000 7f8b78c84640 1 -- 172.21.15.78:0/3577306550 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b6000c2f0 con 0x7f8b600047d0 2023-11-28T19:59:03.407 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:03.400+0000 7f8b78c84640 1 -- 172.21.15.78:0/3577306550 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b6000c4b0 con 0x7f8b600052b0 2023-11-28T19:59:03.407 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:03.400+0000 7f8b79c86640 1 --2- 172.21.15.78:0/3577306550 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8b600039d0 0x7f8b60003df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:03.407 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:03.400+0000 7f8b79485640 1 --2- 172.21.15.78:0/3577306550 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8b600047d0 0x7f8b60004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:03.407 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:03.400+0000 7f8b7a487640 1 --2- 172.21.15.78:0/3577306550 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8b600052b0 0x7f8b6000b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:03.407 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:03.400+0000 7f8b79c86640 1 -- 172.21.15.78:0/3577306550 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8b600052b0 msgr2=0x7f8b6000b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T19:59:03.407 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:03.400+0000 7f8b79c86640 1 --2- 172.21.15.78:0/3577306550 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8b600052b0 0x7f8b6000b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:03.408 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:03.400+0000 7f8b79c86640 1 -- 172.21.15.78:0/3577306550 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8b600047d0 msgr2=0x7f8b60004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T19:59:03.408 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:03.400+0000 7f8b79c86640 1 --2- 172.21.15.78:0/3577306550 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8b600047d0 0x7f8b60004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:03.408 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:03.400+0000 7f8b79c86640 1 -- 172.21.15.78:0/3577306550 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b60003530 con 0x7f8b600039d0 2023-11-28T19:59:03.408 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:03.400+0000 7f8b7a487640 1 -- 172.21.15.78:0/3577306550 reap_dead start 2023-11-28T19:59:03.408 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:03.404+0000 7f8b79c86640 1 --2- 172.21.15.78:0/3577306550 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8b600039d0 0x7f8b60003df0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f8b70001780 tx=0x7f8b7001c3e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=193efe47885472b7 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:59:03.408 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:03.404+0000 7f8b78c84640 1 -- 172.21.15.78:0/3577306550 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b700052d0 con 0x7f8b600039d0 2023-11-28T19:59:03.409 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:03.404+0000 7f8b78c84640 1 -- 172.21.15.78:0/3577306550 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b700a7050 con 0x7f8b600039d0 2023-11-28T19:59:03.409 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:03.404+0000 7f8b78c84640 1 -- 172.21.15.78:0/3577306550 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b70003600 con 0x7f8b600039d0 2023-11-28T19:59:03.409 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:03.404+0000 7f8b7beea640 1 -- 172.21.15.78:0/3577306550 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8b600039d0 msgr2=0x7f8b60003df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:03.409 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:03.404+0000 7f8b7beea640 1 --2- 172.21.15.78:0/3577306550 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8b600039d0 0x7f8b60003df0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f8b70001780 tx=0x7f8b7001c3e0 comp rx=0 tx=0).stop 2023-11-28T19:59:03.410 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:03.404+0000 7f8b7beea640 1 -- 172.21.15.78:0/3577306550 shutdown_connections 2023-11-28T19:59:03.410 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:03.404+0000 7f8b7beea640 1 --2- 172.21.15.78:0/3577306550 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8b600039d0 0x7f8b60003df0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:03.410 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:03.404+0000 7f8b7beea640 1 -- 172.21.15.78:0/3577306550 >> 172.21.15.78:0/3577306550 conn(0x7f8b740a7810 msgr2=0x7f8b740a7c20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T19:59:03.410 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:03.404+0000 7f8b7beea640 1 -- 172.21.15.78:0/3577306550 shutdown_connections 2023-11-28T19:59:03.410 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:03.404+0000 7f8b7beea640 1 -- 172.21.15.78:0/3577306550 wait complete. 2023-11-28T19:59:03.411 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:03.408+0000 7f8b7beea640 1 Processor -- start 2023-11-28T19:59:03.411 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:03.408+0000 7f8b7beea640 1 -- start start 2023-11-28T19:59:03.413 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:03.408+0000 7f8b7beea640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8b600039d0 0x7f8b74148810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:03.413 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:03.408+0000 7f8b7beea640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8b7414a7c0 0x7f8b740710b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:03.413 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:03.408+0000 7f8b7beea640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8b7414ac10 0x7f8b740715f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:03.413 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:03.408+0000 7f8b7beea640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b74154fc0 con 0x7f8b600039d0 2023-11-28T19:59:03.413 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:03.408+0000 7f8b7beea640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b74149490 con 0x7f8b7414a7c0 2023-11-28T19:59:03.413 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:03.408+0000 7f8b7beea640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b741557f0 con 0x7f8b7414ac10 2023-11-28T19:59:03.413 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:03.408+0000 7f8b79c86640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8b600039d0 0x7f8b74148810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:03.414 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:03.408+0000 7f8b79c86640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8b600039d0 0x7f8b74148810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:47630/0 (socket says 172.21.15.78:47630) 2023-11-28T19:59:03.414 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:03.408+0000 7f8b79c86640 1 -- 172.21.15.78:0/3848166352 learned_addr learned my addr 172.21.15.78:0/3848166352 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T19:59:03.414 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:03.408+0000 7f8b79485640 1 --2- 172.21.15.78:0/3848166352 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8b7414a7c0 0x7f8b740710b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:03.414 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:03.408+0000 7f8b7a487640 1 --2- 172.21.15.78:0/3848166352 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8b7414ac10 0x7f8b740715f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:03.414 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:03.408+0000 7f8b79c86640 1 -- 172.21.15.78:0/3848166352 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8b7414ac10 msgr2=0x7f8b740715f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:03.414 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:03.408+0000 7f8b79c86640 1 --2- 172.21.15.78:0/3848166352 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8b7414ac10 0x7f8b740715f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:03.414 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:03.408+0000 7f8b79c86640 1 -- 172.21.15.78:0/3848166352 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8b7414a7c0 msgr2=0x7f8b740710b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:03.414 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:03.408+0000 7f8b79c86640 1 --2- 172.21.15.78:0/3848166352 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8b7414a7c0 0x7f8b740710b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:03.414 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:03.408+0000 7f8b79c86640 1 -- 172.21.15.78:0/3848166352 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b741491b0 con 0x7f8b600039d0 2023-11-28T19:59:03.414 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:03.408+0000 7f8b7a487640 1 --2- 172.21.15.78:0/3848166352 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8b7414ac10 0x7f8b740715f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T19:59:03.414 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:03.408+0000 7f8b79c86640 1 --2- 172.21.15.78:0/3848166352 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8b600039d0 0x7f8b74148810 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f8b70005040 tx=0x7f8b60005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:59:03.415 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:03.408+0000 7f8b6a7fc640 1 -- 172.21.15.78:0/3848166352 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b700072f0 con 0x7f8b600039d0 2023-11-28T19:59:03.415 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:03.408+0000 7f8b6a7fc640 1 -- 172.21.15.78:0/3848166352 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b70007450 con 0x7f8b600039d0 2023-11-28T19:59:03.415 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:03.408+0000 7f8b6a7fc640 1 -- 172.21.15.78:0/3848166352 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b700067e0 con 0x7f8b600039d0 2023-11-28T19:59:03.415 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:03.408+0000 7f8b7beea640 1 -- 172.21.15.78:0/3848166352 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8b741551a0 con 0x7f8b600039d0 2023-11-28T19:59:03.415 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:03.408+0000 7f8b7beea640 1 -- 172.21.15.78:0/3848166352 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8b7414c660 con 0x7f8b600039d0 2023-11-28T19:59:03.416 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:03.408+0000 7f8b7beea640 1 -- 172.21.15.78:0/3848166352 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8b74067630 con 0x7f8b600039d0 2023-11-28T19:59:03.416 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:03.412+0000 7f8b6a7fc640 1 -- 172.21.15.78:0/3848166352 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f8b70006940 con 0x7f8b600039d0 2023-11-28T19:59:03.416 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:03.412+0000 7f8b6a7fc640 1 --2- 172.21.15.78:0/3848166352 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f8b580664a0 0x7f8b58068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:03.416 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:03.412+0000 7f8b6a7fc640 1 -- 172.21.15.78:0/3848166352 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f8b7011db70 con 0x7f8b600039d0 2023-11-28T19:59:03.416 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:03.412+0000 7f8b79485640 1 --2- 172.21.15.78:0/3848166352 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f8b580664a0 0x7f8b58068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:03.416 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:03.412+0000 7f8b79485640 1 --2- 172.21.15.78:0/3848166352 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f8b580664a0 0x7f8b58068960 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f8b64001130 tx=0x7f8b64001500 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:59:03.419 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:03.416+0000 7f8b6a7fc640 1 -- 172.21.15.78:0/3848166352 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f8b700eb3b0 con 0x7f8b600039d0 2023-11-28T19:59:03.570 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:03.564+0000 7f8b7beea640 1 -- 172.21.15.78:0/3848166352 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f8b740c4b20 con 0x7f8b600039d0 2023-11-28T19:59:03.571 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:03.568+0000 7f8b6a7fc640 1 -- 172.21.15.78:0/3848166352 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v17) v1 ==== 84+0+65 (secure 0 0 0) 0x7f8b700ee9d0 con 0x7f8b600039d0 2023-11-28T19:59:03.571 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-11-28T19:59:03.571 INFO:teuthology.orchestra.run.smithi078.stdout:[ 2023-11-28T19:59:03.571 INFO:teuthology.orchestra.run.smithi078.stdout: { 2023-11-28T19:59:03.571 INFO:teuthology.orchestra.run.smithi078.stdout: "poolnum": 1, 2023-11-28T19:59:03.571 INFO:teuthology.orchestra.run.smithi078.stdout: "poolname": ".mgr" 2023-11-28T19:59:03.571 INFO:teuthology.orchestra.run.smithi078.stdout: } 2023-11-28T19:59:03.571 INFO:teuthology.orchestra.run.smithi078.stdout:] 2023-11-28T19:59:03.573 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:03.568+0000 7f8b7beea640 1 -- 172.21.15.78:0/3848166352 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f8b580664a0 msgr2=0x7f8b58068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:03.573 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:03.568+0000 7f8b7beea640 1 --2- 172.21.15.78:0/3848166352 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f8b580664a0 0x7f8b58068960 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f8b64001130 tx=0x7f8b64001500 comp rx=0 tx=0).stop 2023-11-28T19:59:03.573 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:03.568+0000 7f8b7beea640 1 -- 172.21.15.78:0/3848166352 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8b600039d0 msgr2=0x7f8b74148810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:03.573 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:03.568+0000 7f8b7beea640 1 --2- 172.21.15.78:0/3848166352 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8b600039d0 0x7f8b74148810 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f8b70005040 tx=0x7f8b60005800 comp rx=0 tx=0).stop 2023-11-28T19:59:03.573 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:03.568+0000 7f8b7beea640 1 -- 172.21.15.78:0/3848166352 shutdown_connections 2023-11-28T19:59:03.573 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:03.568+0000 7f8b7beea640 1 --2- 172.21.15.78:0/3848166352 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f8b580664a0 0x7f8b58068960 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:03.573 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:03.568+0000 7f8b7beea640 1 --2- 172.21.15.78:0/3848166352 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8b7414ac10 0x7f8b740715f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:03.573 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:03.568+0000 7f8b7beea640 1 --2- 172.21.15.78:0/3848166352 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8b7414a7c0 0x7f8b740710b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:03.573 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:03.568+0000 7f8b7beea640 1 --2- 172.21.15.78:0/3848166352 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8b600039d0 0x7f8b74148810 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:03.574 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:03.568+0000 7f8b7beea640 1 -- 172.21.15.78:0/3848166352 >> 172.21.15.78:0/3848166352 conn(0x7f8b740a7810 msgr2=0x7f8b7414e0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T19:59:03.574 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:03.568+0000 7f8b7beea640 1 -- 172.21.15.78:0/3848166352 shutdown_connections 2023-11-28T19:59:03.574 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:03.568+0000 7f8b7beea640 1 -- 172.21.15.78:0/3848166352 wait complete. 2023-11-28T19:59:03.591 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-11-28T19:59:03.591 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-11-28T19:59:03.733 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:03.728+0000 7f7a76b2a640 1 Processor -- start 2023-11-28T19:59:03.733 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:03.728+0000 7f7a76b2a640 1 -- start start 2023-11-28T19:59:03.734 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:03.728+0000 7f7a76b2a640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f7a7014fc30 0x7f7a700c3cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:03.734 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:03.732+0000 7f7a76b2a640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7a70152910 con 0x7f7a7006d840 2023-11-28T19:59:03.735 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:03.732+0000 7f7a76b2a640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7a70152bf0 con 0x7f7a7014f850 2023-11-28T19:59:03.735 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:03.732+0000 7f7a76b2a640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7a700c2240 con 0x7f7a7014fc30 2023-11-28T19:59:03.736 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:03.732+0000 7f7a750c7640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f7a7006d840 0x7f7a700c4210 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:37532/0 (socket says 172.21.15.78:37532) 2023-11-28T19:59:03.736 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:03.732+0000 7f7a750c7640 1 -- 172.21.15.78:0/2818599941 learned_addr learned my addr 172.21.15.78:0/2818599941 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-11-28T19:59:03.738 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:03.732+0000 7f7a67fff640 1 --2- 172.21.15.78:0/2818599941 >> v2:172.21.15.179:3300/0 conn(0x7f7a7014fc30 0x7f7a700c3cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:03.738 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:03.732+0000 7f7a677fe640 1 -- 172.21.15.78:0/2818599941 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 383396254 0 0) 0x7f7a70152910 con 0x7f7a7006d840 2023-11-28T19:59:03.738 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:03.732+0000 7f7a677fe640 1 -- 172.21.15.78:0/2818599941 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7a58003530 con 0x7f7a7006d840 2023-11-28T19:59:03.739 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:03.732+0000 7f7a677fe640 1 -- 172.21.15.78:0/2818599941 <== mon.0 v1:172.21.15.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1591957568 0 0) 0x7f7a58003530 con 0x7f7a7006d840 2023-11-28T19:59:03.739 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:03.732+0000 7f7a677fe640 1 -- 172.21.15.78:0/2818599941 >> v2:172.21.15.179:3300/0 conn(0x7f7a7014fc30 msgr2=0x7f7a700c3cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T19:59:03.740 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:03.732+0000 7f7a677fe640 1 --2- 172.21.15.78:0/2818599941 >> v2:172.21.15.179:3300/0 conn(0x7f7a7014fc30 0x7f7a700c3cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:03.740 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:03.732+0000 7f7a677fe640 1 -- 172.21.15.78:0/2818599941 >> v1:172.21.15.179:6789/0 conn(0x7f7a7014f850 legacy=0x7f7a700aacf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:03.740 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:03.732+0000 7f7a677fe640 1 -- 172.21.15.78:0/2818599941 --> v1:172.21.15.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a70152ed0 con 0x7f7a7006d840 2023-11-28T19:59:03.740 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:03.732+0000 7f7a677fe640 1 -- 172.21.15.78:0/2818599941 <== mon.0 v1:172.21.15.78:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3326804700 0 0) 0x7f7a68001a00 con 0x7f7a7006d840 2023-11-28T19:59:03.740 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:03.732+0000 7f7a677fe640 1 -- 172.21.15.78:0/2818599941 >> v1:172.21.15.78:6789/0 conn(0x7f7a7006d840 legacy=0x7f7a700c4210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:03.741 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:03.732+0000 7f7a677fe640 1 --2- 172.21.15.78:0/2818599941 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7a58003980 0x7f7a58003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:03.741 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:03.732+0000 7f7a677fe640 1 --2- 172.21.15.78:0/2818599941 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7a580047d0 0x7f7a58004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:03.741 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:03.732+0000 7f7a677fe640 1 --2- 172.21.15.78:0/2818599941 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7a58005190 0x7f7a5800b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:03.741 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:03.732+0000 7f7a677fe640 1 -- 172.21.15.78:0/2818599941 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a700c2240 con 0x7f7a58005190 2023-11-28T19:59:03.741 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:03.732+0000 7f7a677fe640 1 -- 172.21.15.78:0/2818599941 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a5800c030 con 0x7f7a580047d0 2023-11-28T19:59:03.742 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:03.732+0000 7f7a677fe640 1 -- 172.21.15.78:0/2818599941 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7a5800c1f0 con 0x7f7a58003980 2023-11-28T19:59:03.742 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:03.732+0000 7f7a750c7640 1 --2- 172.21.15.78:0/2818599941 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7a58005190 0x7f7a5800b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:03.742 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:03.732+0000 7f7a748c6640 1 --2- 172.21.15.78:0/2818599941 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7a58003980 0x7f7a58003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:03.742 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:03.732+0000 7f7a67fff640 1 --2- 172.21.15.78:0/2818599941 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7a580047d0 0x7f7a58004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:03.742 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:03.732+0000 7f7a750c7640 1 -- 172.21.15.78:0/2818599941 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7a58003980 msgr2=0x7f7a58003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T19:59:03.742 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:03.732+0000 7f7a750c7640 1 --2- 172.21.15.78:0/2818599941 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7a58003980 0x7f7a58003da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:03.743 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:03.732+0000 7f7a750c7640 1 -- 172.21.15.78:0/2818599941 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7a580047d0 msgr2=0x7f7a58004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T19:59:03.743 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:03.732+0000 7f7a750c7640 1 --2- 172.21.15.78:0/2818599941 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7a580047d0 0x7f7a58004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:03.743 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:03.732+0000 7f7a750c7640 1 -- 172.21.15.78:0/2818599941 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a58003530 con 0x7f7a58005190 2023-11-28T19:59:03.747 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:03.736+0000 7f7a750c7640 1 -- 172.21.15.78:0/2818599941 reap_dead start 2023-11-28T19:59:03.747 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:03.736+0000 7f7a750c7640 1 --2- 172.21.15.78:0/2818599941 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7a58005190 0x7f7a5800b990 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f7a6800a820 tx=0x7f7a6801d320 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8fe77a3e8c79b0b8 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:59:03.748 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:03.736+0000 7f7a677fe640 1 -- 172.21.15.78:0/2818599941 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a680072d0 con 0x7f7a58005190 2023-11-28T19:59:03.748 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:03.736+0000 7f7a677fe640 1 -- 172.21.15.78:0/2818599941 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a680a8070 con 0x7f7a58005190 2023-11-28T19:59:03.748 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:03.736+0000 7f7a677fe640 1 -- 172.21.15.78:0/2818599941 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a680076b0 con 0x7f7a58005190 2023-11-28T19:59:03.748 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:03.736+0000 7f7a76b2a640 1 -- 172.21.15.78:0/2818599941 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7a58005190 msgr2=0x7f7a5800b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:03.748 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:03.736+0000 7f7a76b2a640 1 --2- 172.21.15.78:0/2818599941 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7a58005190 0x7f7a5800b990 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f7a6800a820 tx=0x7f7a6801d320 comp rx=0 tx=0).stop 2023-11-28T19:59:03.749 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:03.736+0000 7f7a76b2a640 1 -- 172.21.15.78:0/2818599941 shutdown_connections 2023-11-28T19:59:03.749 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:03.736+0000 7f7a76b2a640 1 --2- 172.21.15.78:0/2818599941 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7a58005190 0x7f7a5800b990 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:03.749 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:03.736+0000 7f7a76b2a640 1 -- 172.21.15.78:0/2818599941 >> 172.21.15.78:0/2818599941 conn(0x7f7a700c59f0 msgr2=0x7f7a700c5e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T19:59:03.749 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:03.736+0000 7f7a76b2a640 1 -- 172.21.15.78:0/2818599941 shutdown_connections 2023-11-28T19:59:03.749 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:03.736+0000 7f7a76b2a640 1 -- 172.21.15.78:0/2818599941 wait complete. 2023-11-28T19:59:03.750 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:03.736+0000 7f7a76b2a640 1 Processor -- start 2023-11-28T19:59:03.750 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:03.736+0000 7f7a76b2a640 1 -- start start 2023-11-28T19:59:03.750 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:03.740+0000 7f7a76b2a640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7a58005190 0x7f7a701e9f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:03.750 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:03.740+0000 7f7a76b2a640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7a701ea480 0x7f7a7014da60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:03.750 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:03.740+0000 7f7a76b2a640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7a7014dfa0 0x7f7a700705b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:03.751 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:03.740+0000 7f7a76b2a640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a70153e70 con 0x7f7a7014dfa0 2023-11-28T19:59:03.751 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:03.740+0000 7f7a76b2a640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a70072800 con 0x7f7a58005190 2023-11-28T19:59:03.751 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:03.740+0000 7f7a76b2a640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7a700724d0 con 0x7f7a701ea480 2023-11-28T19:59:03.751 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:03.740+0000 7f7a750c7640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7a7014dfa0 0x7f7a700705b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:03.751 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:03.740+0000 7f7a750c7640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7a7014dfa0 0x7f7a700705b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:47642/0 (socket says 172.21.15.78:47642) 2023-11-28T19:59:03.751 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:03.740+0000 7f7a750c7640 1 -- 172.21.15.78:0/529458016 learned_addr learned my addr 172.21.15.78:0/529458016 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T19:59:03.752 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:03.740+0000 7f7a748c6640 1 --2- 172.21.15.78:0/529458016 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7a58005190 0x7f7a701e9f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:03.752 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:03.740+0000 7f7a67fff640 1 --2- 172.21.15.78:0/529458016 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7a701ea480 0x7f7a7014da60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:03.752 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:03.740+0000 7f7a750c7640 1 -- 172.21.15.78:0/529458016 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7a701ea480 msgr2=0x7f7a7014da60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:03.752 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:03.740+0000 7f7a750c7640 1 --2- 172.21.15.78:0/529458016 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7a701ea480 0x7f7a7014da60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:03.752 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:03.740+0000 7f7a750c7640 1 -- 172.21.15.78:0/529458016 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7a58005190 msgr2=0x7f7a701e9f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:03.753 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:03.740+0000 7f7a750c7640 1 --2- 172.21.15.78:0/529458016 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7a58005190 0x7f7a701e9f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:03.753 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:03.740+0000 7f7a750c7640 1 -- 172.21.15.78:0/529458016 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a700a4860 con 0x7f7a7014dfa0 2023-11-28T19:59:03.753 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:03.740+0000 7f7a750c7640 1 --2- 172.21.15.78:0/529458016 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7a7014dfa0 0x7f7a700705b0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f7a6801d150 tx=0x7f7a58005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:59:03.753 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:03.740+0000 7f7a657fa640 1 -- 172.21.15.78:0/529458016 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a68001a00 con 0x7f7a7014dfa0 2023-11-28T19:59:03.753 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:03.740+0000 7f7a657fa640 1 -- 172.21.15.78:0/529458016 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a68001b60 con 0x7f7a7014dfa0 2023-11-28T19:59:03.754 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:03.740+0000 7f7a76b2a640 1 -- 172.21.15.78:0/529458016 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7a701ea900 con 0x7f7a7014dfa0 2023-11-28T19:59:03.754 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:03.740+0000 7f7a657fa640 1 -- 172.21.15.78:0/529458016 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a68007690 con 0x7f7a7014dfa0 2023-11-28T19:59:03.754 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:03.740+0000 7f7a76b2a640 1 -- 172.21.15.78:0/529458016 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7a70153b90 con 0x7f7a7014dfa0 2023-11-28T19:59:03.754 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:03.740+0000 7f7a76b2a640 1 -- 172.21.15.78:0/529458016 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7a70072330 con 0x7f7a7014dfa0 2023-11-28T19:59:03.754 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:03.740+0000 7f7a657fa640 1 -- 172.21.15.78:0/529458016 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f7a680aa070 con 0x7f7a7014dfa0 2023-11-28T19:59:03.755 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:03.744+0000 7f7a657fa640 1 --2- 172.21.15.78:0/529458016 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f7a5c0664a0 0x7f7a5c068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:03.755 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:03.744+0000 7f7a657fa640 1 -- 172.21.15.78:0/529458016 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f7a6811d8e0 con 0x7f7a7014dfa0 2023-11-28T19:59:03.755 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:03.744+0000 7f7a748c6640 1 --2- 172.21.15.78:0/529458016 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f7a5c0664a0 0x7f7a5c068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:03.756 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:03.744+0000 7f7a748c6640 1 --2- 172.21.15.78:0/529458016 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f7a5c0664a0 0x7f7a5c068960 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f7a6c007fd0 tx=0x7f7a6c009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:59:03.756 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:03.748+0000 7f7a657fa640 1 -- 172.21.15.78:0/529458016 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f7a70072330 con 0x7f7a7014dfa0 2023-11-28T19:59:03.901 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:03.896+0000 7f7a76b2a640 1 -- 172.21.15.78:0/529458016 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f7a70072330 con 0x7f7a7014dfa0 2023-11-28T19:59:04.014 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:04.008+0000 7f7a657fa640 1 -- 172.21.15.78:0/529458016 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v18) v1 ==== 138+0+0 (secure 0 0 0) 0x7f7a70072330 con 0x7f7a7014dfa0 2023-11-28T19:59:04.014 INFO:teuthology.orchestra.run.smithi078.stderr:pool 'cephfs_metadata' created 2023-11-28T19:59:04.016 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:04.012+0000 7f7a76b2a640 1 -- 172.21.15.78:0/529458016 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f7a5c0664a0 msgr2=0x7f7a5c068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:04.016 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:04.012+0000 7f7a76b2a640 1 --2- 172.21.15.78:0/529458016 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f7a5c0664a0 0x7f7a5c068960 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f7a6c007fd0 tx=0x7f7a6c009040 comp rx=0 tx=0).stop 2023-11-28T19:59:04.016 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:04.012+0000 7f7a76b2a640 1 -- 172.21.15.78:0/529458016 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7a7014dfa0 msgr2=0x7f7a700705b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:04.016 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:04.012+0000 7f7a76b2a640 1 --2- 172.21.15.78:0/529458016 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7a7014dfa0 0x7f7a700705b0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f7a6801d150 tx=0x7f7a58005800 comp rx=0 tx=0).stop 2023-11-28T19:59:04.016 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:04.012+0000 7f7a76b2a640 1 -- 172.21.15.78:0/529458016 shutdown_connections 2023-11-28T19:59:04.016 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:04.012+0000 7f7a76b2a640 1 --2- 172.21.15.78:0/529458016 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f7a5c0664a0 0x7f7a5c068960 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:04.016 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:04.012+0000 7f7a76b2a640 1 --2- 172.21.15.78:0/529458016 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7a701ea480 0x7f7a7014da60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:04.017 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:04.012+0000 7f7a76b2a640 1 --2- 172.21.15.78:0/529458016 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7a7014dfa0 0x7f7a700705b0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:04.017 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:04.012+0000 7f7a76b2a640 1 --2- 172.21.15.78:0/529458016 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7a58005190 0x7f7a701e9f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:04.017 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:04.012+0000 7f7a76b2a640 1 -- 172.21.15.78:0/529458016 >> 172.21.15.78:0/529458016 conn(0x7f7a700c59f0 msgr2=0x7f7a700c6140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T19:59:04.017 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:04.012+0000 7f7a76b2a640 1 -- 172.21.15.78:0/529458016 shutdown_connections 2023-11-28T19:59:04.017 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:04.012+0000 7f7a76b2a640 1 -- 172.21.15.78:0/529458016 wait complete. 2023-11-28T19:59:04.019 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T19:59:04.027 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T19:59:04.042 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.05 2023-11-28T19:59:04.269 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:04.264+0000 7fe7d5479640 1 Processor -- start 2023-11-28T19:59:04.270 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:04.264+0000 7fe7d5479640 1 -- start start 2023-11-28T19:59:04.271 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:04.264+0000 7fe7d5479640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe7d00bf2d0 0x7fe7d0151970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:04.271 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:04.264+0000 7fe7d5479640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fe7d00c98f0 0x7fe7d0151eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:04.271 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:04.264+0000 7fe7d5479640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe7d0158780 con 0x7fe7d00c6030 2023-11-28T19:59:04.271 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:04.264+0000 7fe7d5479640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe7d00c0300 con 0x7fe7d00c98f0 2023-11-28T19:59:04.271 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:04.264+0000 7fe7d5479640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe7d0157b70 con 0x7fe7d00bf2d0 2023-11-28T19:59:04.271 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:04.268+0000 7fe7cf7fe640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fe7d00c98f0 0x7fe7d0151eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:04.272 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:04.268+0000 7fe7ceffd640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe7d00bf2d0 0x7fe7d0151970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:04.272 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:04.268+0000 7fe7ceffd640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe7d00bf2d0 0x7fe7d0151970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3301/0 says I am v2:172.21.15.78:48924/0 (socket says 172.21.15.78:48924) 2023-11-28T19:59:04.272 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:04.268+0000 7fe7ceffd640 1 -- 172.21.15.78:0/2910169431 learned_addr learned my addr 172.21.15.78:0/2910169431 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T19:59:04.272 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:04.268+0000 7fe7ceffd640 1 -- 172.21.15.78:0/2910169431 >> v2:172.21.15.179:3300/0 conn(0x7fe7d00c98f0 msgr2=0x7fe7d0151eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T19:59:04.272 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:04.268+0000 7fe7ceffd640 1 --2- 172.21.15.78:0/2910169431 >> v2:172.21.15.179:3300/0 conn(0x7fe7d00c98f0 0x7fe7d0151eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:04.272 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:04.268+0000 7fe7ceffd640 1 -- 172.21.15.78:0/2910169431 >> v1:172.21.15.179:6789/0 conn(0x7fe7d00c6030 legacy=0x7fe7d00c7cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:04.272 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:04.268+0000 7fe7ceffd640 1 -- 172.21.15.78:0/2910169431 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7d0157e50 con 0x7fe7d00bf2d0 2023-11-28T19:59:04.274 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:04.268+0000 7fe7ceffd640 1 --2- 172.21.15.78:0/2910169431 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe7d00bf2d0 0x7fe7d0151970 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fe7c0009870 tx=0x7fe7c001c510 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d838e94a9fd83ef6 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:59:04.274 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:04.268+0000 7fe7ce7fc640 1 -- 172.21.15.78:0/2910169431 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7c00aa670 con 0x7fe7d00bf2d0 2023-11-28T19:59:04.274 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:04.268+0000 7fe7ce7fc640 1 -- 172.21.15.78:0/2910169431 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe7c00aa7d0 con 0x7fe7d00bf2d0 2023-11-28T19:59:04.274 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:04.268+0000 7fe7ce7fc640 1 -- 172.21.15.78:0/2910169431 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7c00aab60 con 0x7fe7d00bf2d0 2023-11-28T19:59:04.275 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:04.272+0000 7fe7d5479640 1 -- 172.21.15.78:0/2910169431 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe7d00bf2d0 msgr2=0x7fe7d0151970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:04.275 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:04.272+0000 7fe7d5479640 1 --2- 172.21.15.78:0/2910169431 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe7d00bf2d0 0x7fe7d0151970 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fe7c0009870 tx=0x7fe7c001c510 comp rx=0 tx=0).stop 2023-11-28T19:59:04.275 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:04.272+0000 7fe7d5479640 1 -- 172.21.15.78:0/2910169431 shutdown_connections 2023-11-28T19:59:04.276 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:04.272+0000 7fe7d5479640 1 --2- 172.21.15.78:0/2910169431 >> v2:172.21.15.179:3300/0 conn(0x7fe7d00c98f0 0x7fe7d0151eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:04.276 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:04.272+0000 7fe7d5479640 1 --2- 172.21.15.78:0/2910169431 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe7d00bf2d0 0x7fe7d0151970 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:04.276 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:04.272+0000 7fe7d5479640 1 -- 172.21.15.78:0/2910169431 >> 172.21.15.78:0/2910169431 conn(0x7fe7d00c9dc0 msgr2=0x7fe7d00ca1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T19:59:04.276 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:04.272+0000 7fe7d5479640 1 -- 172.21.15.78:0/2910169431 shutdown_connections 2023-11-28T19:59:04.276 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:04.272+0000 7fe7d5479640 1 -- 172.21.15.78:0/2910169431 wait complete. 2023-11-28T19:59:04.276 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:04.272+0000 7fe7d5479640 1 Processor -- start 2023-11-28T19:59:04.277 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:04.272+0000 7fe7d5479640 1 -- start start 2023-11-28T19:59:04.278 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:04.272+0000 7fe7d5479640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe7d00bf2d0 0x7fe7d00c10f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:04.278 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:04.272+0000 7fe7d5479640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe7d00c6030 0x7fe7d01502f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:04.279 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:04.272+0000 7fe7d5479640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe7d00c98f0 0x7fe7d0150830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:04.279 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:04.272+0000 7fe7d5479640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7d014efe0 con 0x7fe7d00c98f0 2023-11-28T19:59:04.279 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:04.272+0000 7fe7d5479640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7d014fdf0 con 0x7fe7d00bf2d0 2023-11-28T19:59:04.279 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:04.272+0000 7fe7d5479640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe7d01f0ff0 con 0x7fe7d00c6030 2023-11-28T19:59:04.279 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:04.272+0000 7fe7cf7fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe7d00c98f0 0x7fe7d0150830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:04.279 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:04.272+0000 7fe7cf7fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe7d00c98f0 0x7fe7d0150830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:47648/0 (socket says 172.21.15.78:47648) 2023-11-28T19:59:04.279 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:04.272+0000 7fe7cf7fe640 1 -- 172.21.15.78:0/3343444577 learned_addr learned my addr 172.21.15.78:0/3343444577 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T19:59:04.279 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:04.272+0000 7fe7ceffd640 1 --2- 172.21.15.78:0/3343444577 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe7d00bf2d0 0x7fe7d00c10f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:04.279 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:04.272+0000 7fe7c7fff640 1 --2- 172.21.15.78:0/3343444577 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe7d00c6030 0x7fe7d01502f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:04.279 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:04.276+0000 7fe7cf7fe640 1 -- 172.21.15.78:0/3343444577 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe7d00c6030 msgr2=0x7fe7d01502f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:04.279 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:04.276+0000 7fe7cf7fe640 1 --2- 172.21.15.78:0/3343444577 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe7d00c6030 0x7fe7d01502f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:04.280 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:04.276+0000 7fe7cf7fe640 1 -- 172.21.15.78:0/3343444577 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe7d00bf2d0 msgr2=0x7fe7d00c10f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:04.280 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:04.276+0000 7fe7cf7fe640 1 --2- 172.21.15.78:0/3343444577 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe7d00bf2d0 0x7fe7d00c10f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:04.280 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:04.276+0000 7fe7cf7fe640 1 -- 172.21.15.78:0/3343444577 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7c00094d0 con 0x7fe7d00c98f0 2023-11-28T19:59:04.280 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:04.276+0000 7fe7cf7fe640 1 --2- 172.21.15.78:0/3343444577 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe7d00c98f0 0x7fe7d0150830 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fe7c800efc0 tx=0x7fe7c800c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:59:04.281 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:04.276+0000 7fe7c77fe640 1 -- 172.21.15.78:0/3343444577 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7c8009ba0 con 0x7fe7d00c98f0 2023-11-28T19:59:04.281 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:04.276+0000 7fe7c77fe640 1 -- 172.21.15.78:0/3343444577 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe7c800f040 con 0x7fe7d00c98f0 2023-11-28T19:59:04.281 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:04.276+0000 7fe7c77fe640 1 -- 172.21.15.78:0/3343444577 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7c80146c0 con 0x7fe7d00c98f0 2023-11-28T19:59:04.281 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:04.276+0000 7fe7d5479640 1 -- 172.21.15.78:0/3343444577 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe7d01f12d0 con 0x7fe7d00c98f0 2023-11-28T19:59:04.281 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:04.276+0000 7fe7d5479640 1 -- 172.21.15.78:0/3343444577 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe7d014f790 con 0x7fe7d00c98f0 2023-11-28T19:59:04.281 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:04.276+0000 7fe7d5479640 1 -- 172.21.15.78:0/3343444577 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe7d0067630 con 0x7fe7d00c98f0 2023-11-28T19:59:04.281 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:04.276+0000 7fe7c77fe640 1 -- 172.21.15.78:0/3343444577 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fe7c8014820 con 0x7fe7d00c98f0 2023-11-28T19:59:04.282 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:04.276+0000 7fe7c77fe640 1 --2- 172.21.15.78:0/3343444577 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fe7b0066470 0x7fe7b0068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:04.282 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:04.276+0000 7fe7c77fe640 1 -- 172.21.15.78:0/3343444577 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 5227+0+0 (secure 0 0 0) 0x7fe7c80845e0 con 0x7fe7d00c98f0 2023-11-28T19:59:04.282 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:04.276+0000 7fe7ceffd640 1 --2- 172.21.15.78:0/3343444577 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fe7b0066470 0x7fe7b0068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:04.283 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:04.280+0000 7fe7ceffd640 1 --2- 172.21.15.78:0/3343444577 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fe7b0066470 0x7fe7b0068930 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fe7c00ae000 tx=0x7fe7c00b5040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:59:04.286 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:04.284+0000 7fe7c77fe640 1 -- 172.21.15.78:0/3343444577 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fe7c8051cf0 con 0x7fe7d00c98f0 2023-11-28T19:59:04.437 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:04.432+0000 7fe7d5479640 1 -- 172.21.15.78:0/3343444577 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05} v 0) v1 -- 0x7fe7d0147fb0 con 0x7fe7d00c98f0 2023-11-28T19:59:05.018 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:05.012+0000 7fe7c77fe640 1 -- 172.21.15.78:0/3343444577 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]=0 pool 'cephfs_data' created v19) v1 ==== 171+0+0 (secure 0 0 0) 0x7fe7c8055310 con 0x7fe7d00c98f0 2023-11-28T19:59:05.018 INFO:teuthology.orchestra.run.smithi078.stderr:pool 'cephfs_data' created 2023-11-28T19:59:05.020 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:05.016+0000 7fe7d5479640 1 -- 172.21.15.78:0/3343444577 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fe7b0066470 msgr2=0x7fe7b0068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:05.020 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:05.016+0000 7fe7d5479640 1 --2- 172.21.15.78:0/3343444577 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fe7b0066470 0x7fe7b0068930 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fe7c00ae000 tx=0x7fe7c00b5040 comp rx=0 tx=0).stop 2023-11-28T19:59:05.020 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:05.016+0000 7fe7d5479640 1 -- 172.21.15.78:0/3343444577 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe7d00c98f0 msgr2=0x7fe7d0150830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:05.020 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:05.016+0000 7fe7d5479640 1 --2- 172.21.15.78:0/3343444577 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe7d00c98f0 0x7fe7d0150830 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fe7c800efc0 tx=0x7fe7c800c490 comp rx=0 tx=0).stop 2023-11-28T19:59:05.021 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:05.016+0000 7fe7d5479640 1 -- 172.21.15.78:0/3343444577 shutdown_connections 2023-11-28T19:59:05.021 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:05.016+0000 7fe7d5479640 1 --2- 172.21.15.78:0/3343444577 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fe7b0066470 0x7fe7b0068930 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:05.021 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:05.016+0000 7fe7d5479640 1 --2- 172.21.15.78:0/3343444577 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe7d00c6030 0x7fe7d01502f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:05.021 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:05.016+0000 7fe7d5479640 1 --2- 172.21.15.78:0/3343444577 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe7d00c98f0 0x7fe7d0150830 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:05.021 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:05.016+0000 7fe7d5479640 1 --2- 172.21.15.78:0/3343444577 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe7d00bf2d0 0x7fe7d00c10f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:05.021 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:05.016+0000 7fe7d5479640 1 -- 172.21.15.78:0/3343444577 >> 172.21.15.78:0/3343444577 conn(0x7fe7d00c9dc0 msgr2=0x7fe7d0155920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T19:59:05.021 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:05.016+0000 7fe7d5479640 1 -- 172.21.15.78:0/3343444577 shutdown_connections 2023-11-28T19:59:05.022 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:05.016+0000 7fe7d5479640 1 -- 172.21.15.78:0/3343444577 wait complete. 2023-11-28T19:59:05.066 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-11-28T19:59:05.205 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:05.200+0000 7f3379daa640 1 Processor -- start 2023-11-28T19:59:05.206 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:05.200+0000 7f3379daa640 1 -- start start 2023-11-28T19:59:05.206 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:05.204+0000 7f3379daa640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f337414f850 0x7f33740aacf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:05.207 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:05.204+0000 7f3379daa640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3374152910 con 0x7f337414fc30 2023-11-28T19:59:05.207 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:05.204+0000 7f3379daa640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3374152bf0 con 0x7f337406d840 2023-11-28T19:59:05.207 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:05.204+0000 7f3379daa640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33740c2240 con 0x7f337414f850 2023-11-28T19:59:05.207 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:05.204+0000 7f3372ffd640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f337414fc30 0x7f33740c3cd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:39542/0 (socket says 172.21.15.78:39542) 2023-11-28T19:59:05.207 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:05.204+0000 7f3372ffd640 1 -- 172.21.15.78:0/761776065 learned_addr learned my addr 172.21.15.78:0/761776065 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-11-28T19:59:05.209 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:05.204+0000 7f33737fe640 1 --2- 172.21.15.78:0/761776065 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f337414f850 0x7f33740aacf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:05.209 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:05.204+0000 7f33727fc640 1 -- 172.21.15.78:0/761776065 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2457990865 0 0) 0x7f3374152910 con 0x7f337414fc30 2023-11-28T19:59:05.209 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:05.204+0000 7f33727fc640 1 -- 172.21.15.78:0/761776065 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f335c003530 con 0x7f337414fc30 2023-11-28T19:59:05.209 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:05.204+0000 7f33727fc640 1 -- 172.21.15.78:0/761776065 <== mon.0 v1:172.21.15.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4012892898 0 0) 0x7f335c003530 con 0x7f337414fc30 2023-11-28T19:59:05.210 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:05.204+0000 7f33727fc640 1 -- 172.21.15.78:0/761776065 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f337414f850 msgr2=0x7f33740aacf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T19:59:05.210 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:05.204+0000 7f33727fc640 1 --2- 172.21.15.78:0/761776065 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f337414f850 0x7f33740aacf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:05.210 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:05.204+0000 7f33727fc640 1 -- 172.21.15.78:0/761776065 >> v1:172.21.15.179:6789/0 conn(0x7f337406d840 legacy=0x7f33740c43e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:05.210 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:05.204+0000 7f33727fc640 1 -- 172.21.15.78:0/761776065 --> v1:172.21.15.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3374152ed0 con 0x7f337414fc30 2023-11-28T19:59:05.210 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:05.204+0000 7f33727fc640 1 -- 172.21.15.78:0/761776065 <== mon.0 v1:172.21.15.78:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3326804700 0 0) 0x7f3368001680 con 0x7f337414fc30 2023-11-28T19:59:05.210 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:05.204+0000 7f33727fc640 1 -- 172.21.15.78:0/761776065 >> v1:172.21.15.78:6789/0 conn(0x7f337414fc30 legacy=0x7f33740c3cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:05.210 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:05.204+0000 7f33727fc640 1 --2- 172.21.15.78:0/761776065 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f337414f850 0x7f335c0039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:05.210 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:05.204+0000 7f33727fc640 1 --2- 172.21.15.78:0/761776065 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f335c003ef0 0x7f335c0047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:05.210 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:05.204+0000 7f33727fc640 1 --2- 172.21.15.78:0/761776065 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f335c004d10 0x7f335c005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:05.210 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:05.204+0000 7f33727fc640 1 -- 172.21.15.78:0/761776065 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33740c2240 con 0x7f335c003ef0 2023-11-28T19:59:05.210 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:05.204+0000 7f33727fc640 1 -- 172.21.15.78:0/761776065 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f335c00baa0 con 0x7f335c004d10 2023-11-28T19:59:05.211 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:05.204+0000 7f33727fc640 1 -- 172.21.15.78:0/761776065 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f335c00bc60 con 0x7f337414f850 2023-11-28T19:59:05.211 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:05.204+0000 7f3372ffd640 1 --2- 172.21.15.78:0/761776065 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f335c003ef0 0x7f335c0047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:05.211 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:05.204+0000 7f33737fe640 1 --2- 172.21.15.78:0/761776065 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f337414f850 0x7f335c0039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:05.211 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:05.204+0000 7f3373fff640 1 --2- 172.21.15.78:0/761776065 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f335c004d10 0x7f335c005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:05.211 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:05.204+0000 7f3372ffd640 1 -- 172.21.15.78:0/761776065 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f337414f850 msgr2=0x7f335c0039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T19:59:05.211 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:05.204+0000 7f3372ffd640 1 --2- 172.21.15.78:0/761776065 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f337414f850 0x7f335c0039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:05.211 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:05.204+0000 7f3372ffd640 1 -- 172.21.15.78:0/761776065 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f335c004d10 msgr2=0x7f335c005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T19:59:05.211 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:05.204+0000 7f3372ffd640 1 --2- 172.21.15.78:0/761776065 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f335c004d10 0x7f335c005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:05.211 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:05.204+0000 7f3372ffd640 1 -- 172.21.15.78:0/761776065 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f335c003530 con 0x7f335c003ef0 2023-11-28T19:59:05.211 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:05.204+0000 7f3373fff640 1 --2- 172.21.15.78:0/761776065 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f335c004d10 0x7f335c005190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T19:59:05.212 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:05.208+0000 7f3372ffd640 1 --2- 172.21.15.78:0/761776065 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f335c003ef0 0x7f335c0047d0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f336800c190 tx=0x7f336801cbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1c929617452dc85 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:59:05.212 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:05.208+0000 7f33727fc640 1 -- 172.21.15.78:0/761776065 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3368005ae0 con 0x7f335c003ef0 2023-11-28T19:59:05.213 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:05.208+0000 7f33727fc640 1 -- 172.21.15.78:0/761776065 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3368005c60 con 0x7f335c003ef0 2023-11-28T19:59:05.213 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:05.208+0000 7f33727fc640 1 -- 172.21.15.78:0/761776065 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33680a5b00 con 0x7f335c003ef0 2023-11-28T19:59:05.213 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:05.208+0000 7f3379daa640 1 -- 172.21.15.78:0/761776065 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f335c003ef0 msgr2=0x7f335c0047d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:05.213 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:05.208+0000 7f3379daa640 1 --2- 172.21.15.78:0/761776065 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f335c003ef0 0x7f335c0047d0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f336800c190 tx=0x7f336801cbc0 comp rx=0 tx=0).stop 2023-11-28T19:59:05.213 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:05.208+0000 7f3373fff640 1 -- 172.21.15.78:0/761776065 reap_dead start 2023-11-28T19:59:05.213 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:05.208+0000 7f3379daa640 1 -- 172.21.15.78:0/761776065 shutdown_connections 2023-11-28T19:59:05.213 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:05.208+0000 7f3379daa640 1 -- 172.21.15.78:0/761776065 >> 172.21.15.78:0/761776065 conn(0x7f33740c59f0 msgr2=0x7f33740c5e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T19:59:05.213 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:05.208+0000 7f3379daa640 1 -- 172.21.15.78:0/761776065 shutdown_connections 2023-11-28T19:59:05.213 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:05.208+0000 7f3379daa640 1 -- 172.21.15.78:0/761776065 wait complete. 2023-11-28T19:59:05.214 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:05.208+0000 7f3379daa640 1 Processor -- start 2023-11-28T19:59:05.214 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:05.208+0000 7f3379daa640 1 -- start start 2023-11-28T19:59:05.215 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:05.212+0000 7f3379daa640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f335c003ef0 0x7f3374072080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:05.216 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:05.212+0000 7f3379daa640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f33741e9a70 0x7f33741e9ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:05.216 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:05.212+0000 7f3379daa640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f337414dcf0 0x7f337414e170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:05.216 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:05.212+0000 7f3379daa640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3374155c70 con 0x7f335c003ef0 2023-11-28T19:59:05.216 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:05.212+0000 7f3379daa640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33741ea430 con 0x7f337414dcf0 2023-11-28T19:59:05.216 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:05.212+0000 7f3379daa640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33740a4650 con 0x7f33741e9a70 2023-11-28T19:59:05.216 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:05.212+0000 7f33737fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f335c003ef0 0x7f3374072080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:05.216 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:05.212+0000 7f33737fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f335c003ef0 0x7f3374072080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:56810/0 (socket says 172.21.15.78:56810) 2023-11-28T19:59:05.216 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:05.212+0000 7f33737fe640 1 -- 172.21.15.78:0/1649210769 learned_addr learned my addr 172.21.15.78:0/1649210769 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T19:59:05.216 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:05.212+0000 7f3372ffd640 1 --2- 172.21.15.78:0/1649210769 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f33741e9a70 0x7f33741e9ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:05.217 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:05.212+0000 7f3373fff640 1 --2- 172.21.15.78:0/1649210769 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f337414dcf0 0x7f337414e170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:05.217 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:05.212+0000 7f33737fe640 1 -- 172.21.15.78:0/1649210769 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f33741e9a70 msgr2=0x7f33741e9ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:05.217 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:05.212+0000 7f33737fe640 1 --2- 172.21.15.78:0/1649210769 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f33741e9a70 0x7f33741e9ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:05.217 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:05.212+0000 7f33737fe640 1 -- 172.21.15.78:0/1649210769 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f337414dcf0 msgr2=0x7f337414e170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:05.217 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:05.212+0000 7f33737fe640 1 --2- 172.21.15.78:0/1649210769 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f337414dcf0 0x7f337414e170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:05.217 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:05.212+0000 7f33737fe640 1 -- 172.21.15.78:0/1649210769 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33740a4320 con 0x7f335c003ef0 2023-11-28T19:59:05.218 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:05.212+0000 7f33737fe640 1 --2- 172.21.15.78:0/1649210769 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f335c003ef0 0x7f3374072080 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f33640119d0 tx=0x7f3364011dd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:59:05.218 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:05.212+0000 7f335bfff640 1 -- 172.21.15.78:0/1649210769 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f336400f9d0 con 0x7f335c003ef0 2023-11-28T19:59:05.218 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:05.212+0000 7f335bfff640 1 -- 172.21.15.78:0/1649210769 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f336400fb30 con 0x7f335c003ef0 2023-11-28T19:59:05.218 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:05.212+0000 7f335bfff640 1 -- 172.21.15.78:0/1649210769 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f336400fee0 con 0x7f335c003ef0 2023-11-28T19:59:05.218 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:05.212+0000 7f3379daa640 1 -- 172.21.15.78:0/1649210769 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f337414e6b0 con 0x7f335c003ef0 2023-11-28T19:59:05.218 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:05.212+0000 7f3379daa640 1 -- 172.21.15.78:0/1649210769 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3374072780 con 0x7f335c003ef0 2023-11-28T19:59:05.219 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:05.212+0000 7f3379daa640 1 -- 172.21.15.78:0/1649210769 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3374067630 con 0x7f335c003ef0 2023-11-28T19:59:05.219 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:05.216+0000 7f335bfff640 1 -- 172.21.15.78:0/1649210769 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f3364014440 con 0x7f335c003ef0 2023-11-28T19:59:05.221 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:05.216+0000 7f335bfff640 1 --2- 172.21.15.78:0/1649210769 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f3360066470 0x7f3360068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:05.221 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:05.216+0000 7f335bfff640 1 -- 172.21.15.78:0/1649210769 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5609+0+0 (secure 0 0 0) 0x7f3364084930 con 0x7f335c003ef0 2023-11-28T19:59:05.221 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:05.216+0000 7f3372ffd640 1 --2- 172.21.15.78:0/1649210769 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f3360066470 0x7f3360068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:05.221 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:05.216+0000 7f3372ffd640 1 --2- 172.21.15.78:0/1649210769 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f3360066470 0x7f3360068930 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f33680ab000 tx=0x7f33680a7070 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:59:05.224 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:05.220+0000 7f335bfff640 1 -- 172.21.15.78:0/1649210769 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f3364052040 con 0x7f335c003ef0 2023-11-28T19:59:05.410 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:05.404+0000 7f3379daa640 1 -- 172.21.15.78:0/1649210769 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f33740a69f0 con 0x7f335c003ef0 2023-11-28T19:59:06.021 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:06.016+0000 7f335bfff640 1 -- 172.21.15.78:0/1649210769 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v4) v1 ==== 172+0+0 (secure 0 0 0) 0x7f3364055660 con 0x7f335c003ef0 2023-11-28T19:59:06.022 INFO:teuthology.orchestra.run.smithi078.stderr:new fs with metadata pool 2 and data pool 3 2023-11-28T19:59:06.024 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:06.020+0000 7f3379daa640 1 -- 172.21.15.78:0/1649210769 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f3360066470 msgr2=0x7f3360068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:06.024 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:06.020+0000 7f3379daa640 1 --2- 172.21.15.78:0/1649210769 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f3360066470 0x7f3360068930 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f33680ab000 tx=0x7f33680a7070 comp rx=0 tx=0).stop 2023-11-28T19:59:06.024 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:06.020+0000 7f3379daa640 1 -- 172.21.15.78:0/1649210769 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f335c003ef0 msgr2=0x7f3374072080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:06.024 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:06.020+0000 7f3379daa640 1 --2- 172.21.15.78:0/1649210769 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f335c003ef0 0x7f3374072080 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f33640119d0 tx=0x7f3364011dd0 comp rx=0 tx=0).stop 2023-11-28T19:59:06.024 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:06.020+0000 7f3379daa640 1 -- 172.21.15.78:0/1649210769 shutdown_connections 2023-11-28T19:59:06.024 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:06.020+0000 7f3379daa640 1 --2- 172.21.15.78:0/1649210769 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f3360066470 0x7f3360068930 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:06.024 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:06.020+0000 7f3379daa640 1 --2- 172.21.15.78:0/1649210769 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f33741e9a70 0x7f33741e9ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:06.024 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:06.020+0000 7f3379daa640 1 --2- 172.21.15.78:0/1649210769 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f337414dcf0 0x7f337414e170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:06.024 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:06.020+0000 7f3379daa640 1 --2- 172.21.15.78:0/1649210769 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f335c003ef0 0x7f3374072080 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:06.025 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:06.020+0000 7f3379daa640 1 -- 172.21.15.78:0/1649210769 >> 172.21.15.78:0/1649210769 conn(0x7f33740c59f0 msgr2=0x7f337414f0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T19:59:06.025 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:06.020+0000 7f3379daa640 1 -- 172.21.15.78:0/1649210769 shutdown_connections 2023-11-28T19:59:06.025 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:06.020+0000 7f3379daa640 1 -- 172.21.15.78:0/1649210769 wait complete. 2023-11-28T19:59:06.051 DEBUG:tasks.cephfs.filesystem:EC profile is ['m=2', 'k=2', 'crush-failure-domain=osd'] 2023-11-28T19:59:06.051 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd erasure-code-profile set cephfs_data_ec m=2 k=2 crush-failure-domain=osd 2023-11-28T19:59:06.193 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:06.188+0000 7f42069f5640 1 Processor -- start 2023-11-28T19:59:06.193 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:06.188+0000 7f42069f5640 1 -- start start 2023-11-28T19:59:06.195 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:06.188+0000 7f42069f5640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f420014e2a0 0x7f42001516a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:06.195 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:06.188+0000 7f42069f5640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f42000a9460 0x7f42000c4180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:06.195 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:06.188+0000 7f42069f5640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4200151210 con 0x7f42000a9910 2023-11-28T19:59:06.195 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:06.188+0000 7f42069f5640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f420014e680 con 0x7f42000a9460 2023-11-28T19:59:06.195 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:06.188+0000 7f42069f5640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4200150be0 con 0x7f420014e2a0 2023-11-28T19:59:06.195 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:06.188+0000 7f41ff7fe640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f42000a9460 0x7f42000c4180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:06.195 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:06.192+0000 7f41ff7fe640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f42000a9460 0x7f42000c4180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:56814/0 (socket says 172.21.15.78:56814) 2023-11-28T19:59:06.196 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:06.192+0000 7f41ff7fe640 1 -- 172.21.15.78:0/3779122764 learned_addr learned my addr 172.21.15.78:0/3779122764 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T19:59:06.196 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:06.192+0000 7f41fffff640 1 --2- 172.21.15.78:0/3779122764 >> v2:172.21.15.179:3300/0 conn(0x7f420014e2a0 0x7f42001516a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:06.196 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:06.192+0000 7f41ff7fe640 1 -- 172.21.15.78:0/3779122764 >> v2:172.21.15.179:3300/0 conn(0x7f420014e2a0 msgr2=0x7f42001516a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T19:59:06.196 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:06.192+0000 7f41ff7fe640 1 --2- 172.21.15.78:0/3779122764 >> v2:172.21.15.179:3300/0 conn(0x7f420014e2a0 0x7f42001516a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:06.196 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:06.192+0000 7f41ff7fe640 1 -- 172.21.15.78:0/3779122764 >> v1:172.21.15.179:6789/0 conn(0x7f42000a9910 legacy=0x7f420006bc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:06.196 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:06.192+0000 7f41ff7fe640 1 -- 172.21.15.78:0/3779122764 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42000c53c0 con 0x7f42000a9460 2023-11-28T19:59:06.196 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:06.192+0000 7f41fffff640 1 --2- 172.21.15.78:0/3779122764 >> v2:172.21.15.179:3300/0 conn(0x7f420014e2a0 0x7f42001516a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T19:59:06.198 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:06.192+0000 7f41ff7fe640 1 --2- 172.21.15.78:0/3779122764 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f42000a9460 0x7f42000c4180 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f42000c6910 tx=0x7f41f401c500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4144e48b9edebc5f server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:59:06.198 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:06.192+0000 7f41feffd640 1 -- 172.21.15.78:0/3779122764 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41f40ab610 con 0x7f42000a9460 2023-11-28T19:59:06.198 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:06.192+0000 7f41feffd640 1 -- 172.21.15.78:0/3779122764 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f41f40ab770 con 0x7f42000a9460 2023-11-28T19:59:06.198 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:06.192+0000 7f41feffd640 1 -- 172.21.15.78:0/3779122764 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41f40abb00 con 0x7f42000a9460 2023-11-28T19:59:06.199 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:06.196+0000 7f42069f5640 1 -- 172.21.15.78:0/3779122764 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f42000a9460 msgr2=0x7f42000c4180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:06.199 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:06.196+0000 7f42069f5640 1 --2- 172.21.15.78:0/3779122764 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f42000a9460 0x7f42000c4180 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f42000c6910 tx=0x7f41f401c500 comp rx=0 tx=0).stop 2023-11-28T19:59:06.199 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:06.196+0000 7f42069f5640 1 -- 172.21.15.78:0/3779122764 shutdown_connections 2023-11-28T19:59:06.199 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:06.196+0000 7f42069f5640 1 --2- 172.21.15.78:0/3779122764 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f42000a9460 0x7f42000c4180 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:06.199 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:06.196+0000 7f42069f5640 1 --2- 172.21.15.78:0/3779122764 >> v2:172.21.15.179:3300/0 conn(0x7f420014e2a0 0x7f42001516a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:06.199 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:06.196+0000 7f42069f5640 1 -- 172.21.15.78:0/3779122764 >> 172.21.15.78:0/3779122764 conn(0x7f42000c59f0 msgr2=0x7f42000c5e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T19:59:06.200 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:06.196+0000 7f42069f5640 1 -- 172.21.15.78:0/3779122764 shutdown_connections 2023-11-28T19:59:06.200 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:06.196+0000 7f42069f5640 1 -- 172.21.15.78:0/3779122764 wait complete. 2023-11-28T19:59:06.200 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:06.196+0000 7f42069f5640 1 Processor -- start 2023-11-28T19:59:06.201 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:06.196+0000 7f42069f5640 1 -- start start 2023-11-28T19:59:06.203 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:06.196+0000 7f42069f5640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f42000a9460 0x7f42001ecff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:06.203 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:06.196+0000 7f42069f5640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f42000a9910 0x7f420014b000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:06.203 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:06.196+0000 7f42069f5640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f420014e2a0 0x7f420014cd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:06.203 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:06.196+0000 7f42069f5640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4200152740 con 0x7f42000a9460 2023-11-28T19:59:06.203 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:06.196+0000 7f42069f5640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f420014ad60 con 0x7f420014e2a0 2023-11-28T19:59:06.203 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:06.196+0000 7f42069f5640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4200152990 con 0x7f42000a9910 2023-11-28T19:59:06.203 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:06.196+0000 7f41fffff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f42000a9460 0x7f42001ecff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:06.204 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:06.196+0000 7f41fffff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f42000a9460 0x7f42001ecff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:56828/0 (socket says 172.21.15.78:56828) 2023-11-28T19:59:06.204 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:06.196+0000 7f41fffff640 1 -- 172.21.15.78:0/2471219602 learned_addr learned my addr 172.21.15.78:0/2471219602 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T19:59:06.204 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:06.196+0000 7f4204f92640 1 --2- 172.21.15.78:0/2471219602 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f420014e2a0 0x7f420014cd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:06.204 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:06.196+0000 7f41ff7fe640 1 --2- 172.21.15.78:0/2471219602 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f42000a9910 0x7f420014b000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:06.204 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:06.196+0000 7f41fffff640 1 -- 172.21.15.78:0/2471219602 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f42000a9910 msgr2=0x7f420014b000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:06.204 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:06.196+0000 7f41fffff640 1 --2- 172.21.15.78:0/2471219602 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f42000a9910 0x7f420014b000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:06.204 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:06.196+0000 7f41fffff640 1 -- 172.21.15.78:0/2471219602 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f420014e2a0 msgr2=0x7f420014cd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:06.204 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:06.196+0000 7f41fffff640 1 --2- 172.21.15.78:0/2471219602 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f420014e2a0 0x7f420014cd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:06.204 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:06.196+0000 7f41fffff640 1 -- 172.21.15.78:0/2471219602 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41f40094d0 con 0x7f42000a9460 2023-11-28T19:59:06.204 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:06.196+0000 7f4204f92640 1 --2- 172.21.15.78:0/2471219602 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f420014e2a0 0x7f420014cd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T19:59:06.204 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:06.200+0000 7f41fffff640 1 --2- 172.21.15.78:0/2471219602 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f42000a9460 0x7f42001ecff0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f41f000d800 tx=0x7f41f000dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:59:06.204 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:06.200+0000 7f41fcff9640 1 -- 172.21.15.78:0/2471219602 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41f00096c0 con 0x7f42000a9460 2023-11-28T19:59:06.205 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:06.200+0000 7f41fcff9640 1 -- 172.21.15.78:0/2471219602 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f41f0009820 con 0x7f42000a9460 2023-11-28T19:59:06.205 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:06.200+0000 7f41fcff9640 1 -- 172.21.15.78:0/2471219602 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41f0009bd0 con 0x7f42000a9460 2023-11-28T19:59:06.205 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:06.200+0000 7f42069f5640 1 -- 172.21.15.78:0/2471219602 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4200154380 con 0x7f42000a9460 2023-11-28T19:59:06.205 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:06.200+0000 7f42069f5640 1 -- 172.21.15.78:0/2471219602 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4200153d20 con 0x7f42000a9460 2023-11-28T19:59:06.206 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:06.200+0000 7f42069f5640 1 -- 172.21.15.78:0/2471219602 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4200067630 con 0x7f42000a9460 2023-11-28T19:59:06.206 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:06.200+0000 7f41fcff9640 1 -- 172.21.15.78:0/2471219602 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f41f0009d30 con 0x7f42000a9460 2023-11-28T19:59:06.206 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:06.200+0000 7f41fcff9640 1 --2- 172.21.15.78:0/2471219602 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f41ec066470 0x7f41ec068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:06.206 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:06.200+0000 7f41fcff9640 1 -- 172.21.15.78:0/2471219602 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f41f0084620 con 0x7f42000a9460 2023-11-28T19:59:06.206 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:06.200+0000 7f41ff7fe640 1 --2- 172.21.15.78:0/2471219602 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f41ec066470 0x7f41ec068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:06.206 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:06.200+0000 7f41ff7fe640 1 --2- 172.21.15.78:0/2471219602 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f41ec066470 0x7f41ec068930 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f41f40af000 tx=0x7f41f40a7000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:59:06.209 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:06.204+0000 7f41fcff9640 1 -- 172.21.15.78:0/2471219602 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f41f0051a90 con 0x7f42000a9460 2023-11-28T19:59:06.367 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:06.364+0000 7f42069f5640 1 -- 172.21.15.78:0/2471219602 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]} v 0) v1 -- 0x7f42001514f0 con 0x7f42000a9460 2023-11-28T19:59:06.754 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:06.748+0000 7f41fcff9640 1 -- 172.21.15.78:0/2471219602 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]=0 v21) v1 ==== 157+0+0 (secure 0 0 0) 0x7f41f00550b0 con 0x7f42000a9460 2023-11-28T19:59:06.756 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:06.752+0000 7f42069f5640 1 -- 172.21.15.78:0/2471219602 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f41ec066470 msgr2=0x7f41ec068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:06.756 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:06.752+0000 7f42069f5640 1 --2- 172.21.15.78:0/2471219602 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f41ec066470 0x7f41ec068930 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f41f40af000 tx=0x7f41f40a7000 comp rx=0 tx=0).stop 2023-11-28T19:59:06.756 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:06.752+0000 7f42069f5640 1 -- 172.21.15.78:0/2471219602 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f42000a9460 msgr2=0x7f42001ecff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:06.756 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:06.752+0000 7f42069f5640 1 --2- 172.21.15.78:0/2471219602 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f42000a9460 0x7f42001ecff0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f41f000d800 tx=0x7f41f000dcc0 comp rx=0 tx=0).stop 2023-11-28T19:59:06.756 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:06.752+0000 7f42069f5640 1 -- 172.21.15.78:0/2471219602 shutdown_connections 2023-11-28T19:59:06.756 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:06.752+0000 7f42069f5640 1 --2- 172.21.15.78:0/2471219602 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f41ec066470 0x7f41ec068930 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:06.756 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:06.752+0000 7f42069f5640 1 --2- 172.21.15.78:0/2471219602 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f42000a9910 0x7f420014b000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:06.757 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:06.752+0000 7f42069f5640 1 --2- 172.21.15.78:0/2471219602 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f420014e2a0 0x7f420014cd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:06.757 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:06.752+0000 7f42069f5640 1 --2- 172.21.15.78:0/2471219602 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f42000a9460 0x7f42001ecff0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:06.757 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:06.752+0000 7f42069f5640 1 -- 172.21.15.78:0/2471219602 >> 172.21.15.78:0/2471219602 conn(0x7f42000c59f0 msgr2=0x7f42001500a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T19:59:06.757 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:06.752+0000 7f42069f5640 1 -- 172.21.15.78:0/2471219602 shutdown_connections 2023-11-28T19:59:06.757 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:06.752+0000 7f42069f5640 1 -- 172.21.15.78:0/2471219602 wait complete. 2023-11-28T19:59:06.778 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data_ec erasure cephfs_data_ec --pg_num_min 64 --target_size_ratio 0.9 2023-11-28T19:59:06.926 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:06.920+0000 7f8d241f8640 1 Processor -- start 2023-11-28T19:59:06.926 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:06.920+0000 7f8d241f8640 1 -- start start 2023-11-28T19:59:06.926 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:06.920+0000 7f8d241f8640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f8d1c14fa90 0x7f8d1c0c1b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:06.927 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:06.920+0000 7f8d241f8640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f8d1c06d8d0 0x7f8d1c0a4d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:06.927 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:06.920+0000 7f8d241f8640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8d1c06d440 con 0x7f8d1c0c2040 2023-11-28T19:59:06.927 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:06.920+0000 7f8d241f8640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8d1c0c0580 con 0x7f8d1c06d8d0 2023-11-28T19:59:06.927 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:06.920+0000 7f8d241f8640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8d1c14fe70 con 0x7f8d1c14fa90 2023-11-28T19:59:06.927 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:06.920+0000 7f8d21793640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f8d1c06d8d0 0x7f8d1c0a4d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:06.927 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:06.920+0000 7f8d21793640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f8d1c06d8d0 0x7f8d1c0a4d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:56830/0 (socket says 172.21.15.78:56830) 2023-11-28T19:59:06.927 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:06.920+0000 7f8d21793640 1 -- 172.21.15.78:0/532580573 learned_addr learned my addr 172.21.15.78:0/532580573 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T19:59:06.927 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:06.920+0000 7f8d21f94640 1 --2- 172.21.15.78:0/532580573 >> v2:172.21.15.179:3300/0 conn(0x7f8d1c14fa90 0x7f8d1c0c1b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:06.928 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:06.924+0000 7f8d21793640 1 -- 172.21.15.78:0/532580573 >> v2:172.21.15.179:3300/0 conn(0x7f8d1c14fa90 msgr2=0x7f8d1c0c1b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T19:59:06.928 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:06.924+0000 7f8d21793640 1 --2- 172.21.15.78:0/532580573 >> v2:172.21.15.179:3300/0 conn(0x7f8d1c14fa90 0x7f8d1c0c1b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:06.928 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:06.924+0000 7f8d21793640 1 -- 172.21.15.78:0/532580573 >> v1:172.21.15.179:6789/0 conn(0x7f8d1c0c2040 legacy=0x7f8d1c152440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:06.928 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:06.924+0000 7f8d21793640 1 -- 172.21.15.78:0/532580573 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d1c06d0f0 con 0x7f8d1c06d8d0 2023-11-28T19:59:06.930 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:06.924+0000 7f8d21793640 1 --2- 172.21.15.78:0/532580573 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8d1c06d8d0 0x7f8d1c0a4d30 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f8d1c066e30 tx=0x7f8d0c01c440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b8c6c625a0dd83b6 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:59:06.930 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:06.924+0000 7f8d20f92640 1 -- 172.21.15.78:0/532580573 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d0c0ab640 con 0x7f8d1c06d8d0 2023-11-28T19:59:06.930 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:06.924+0000 7f8d20f92640 1 -- 172.21.15.78:0/532580573 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d0c0a7070 con 0x7f8d1c06d8d0 2023-11-28T19:59:06.930 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:06.924+0000 7f8d20f92640 1 -- 172.21.15.78:0/532580573 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d0c0ab9c0 con 0x7f8d1c06d8d0 2023-11-28T19:59:06.931 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:06.928+0000 7f8d241f8640 1 -- 172.21.15.78:0/532580573 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8d1c06d8d0 msgr2=0x7f8d1c0a4d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:06.931 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:06.928+0000 7f8d241f8640 1 --2- 172.21.15.78:0/532580573 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8d1c06d8d0 0x7f8d1c0a4d30 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f8d1c066e30 tx=0x7f8d0c01c440 comp rx=0 tx=0).stop 2023-11-28T19:59:06.931 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:06.928+0000 7f8d241f8640 1 -- 172.21.15.78:0/532580573 shutdown_connections 2023-11-28T19:59:06.931 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:06.928+0000 7f8d241f8640 1 --2- 172.21.15.78:0/532580573 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8d1c06d8d0 0x7f8d1c0a4d30 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:06.931 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:06.928+0000 7f8d241f8640 1 --2- 172.21.15.78:0/532580573 >> v2:172.21.15.179:3300/0 conn(0x7f8d1c14fa90 0x7f8d1c0c1b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:06.931 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:06.928+0000 7f8d241f8640 1 -- 172.21.15.78:0/532580573 >> 172.21.15.78:0/532580573 conn(0x7f8d1c0a77e0 msgr2=0x7f8d1c0a7bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T19:59:06.931 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:06.928+0000 7f8d241f8640 1 -- 172.21.15.78:0/532580573 shutdown_connections 2023-11-28T19:59:06.931 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:06.928+0000 7f8d241f8640 1 -- 172.21.15.78:0/532580573 wait complete. 2023-11-28T19:59:06.932 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:06.928+0000 7f8d241f8640 1 Processor -- start 2023-11-28T19:59:06.932 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:06.928+0000 7f8d241f8640 1 -- start start 2023-11-28T19:59:06.935 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:06.928+0000 7f8d241f8640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8d1c06d8d0 0x7f8d1c146af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:06.935 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:06.928+0000 7f8d241f8640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8d1c0c2040 0x7f8d1c14b740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:06.935 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:06.928+0000 7f8d241f8640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8d1c14fa90 0x7f8d1c1f06d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:06.935 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:06.928+0000 7f8d241f8640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d1c13f7e0 con 0x7f8d1c06d8d0 2023-11-28T19:59:06.935 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:06.928+0000 7f8d241f8640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d1c1521c0 con 0x7f8d1c14fa90 2023-11-28T19:59:06.935 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:06.928+0000 7f8d241f8640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8d1c1f1160 con 0x7f8d1c0c2040 2023-11-28T19:59:06.935 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:06.928+0000 7f8d21f94640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8d1c06d8d0 0x7f8d1c146af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:06.935 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:06.928+0000 7f8d21f94640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8d1c06d8d0 0x7f8d1c146af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:56844/0 (socket says 172.21.15.78:56844) 2023-11-28T19:59:06.935 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:06.928+0000 7f8d21f94640 1 -- 172.21.15.78:0/3647953345 learned_addr learned my addr 172.21.15.78:0/3647953345 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T19:59:06.935 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:06.928+0000 7f8d22795640 1 --2- 172.21.15.78:0/3647953345 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8d1c14fa90 0x7f8d1c1f06d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:06.935 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:06.928+0000 7f8d21f94640 1 -- 172.21.15.78:0/3647953345 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8d1c0c2040 msgr2=0x7f8d1c14b740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:06.936 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:06.928+0000 7f8d21793640 1 --2- 172.21.15.78:0/3647953345 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8d1c0c2040 0x7f8d1c14b740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:06.936 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:06.928+0000 7f8d21f94640 1 --2- 172.21.15.78:0/3647953345 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8d1c0c2040 0x7f8d1c14b740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:06.936 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:06.928+0000 7f8d21f94640 1 -- 172.21.15.78:0/3647953345 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8d1c14fa90 msgr2=0x7f8d1c1f06d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:06.936 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:06.928+0000 7f8d21f94640 1 --2- 172.21.15.78:0/3647953345 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8d1c14fa90 0x7f8d1c1f06d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:06.936 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:06.928+0000 7f8d21f94640 1 -- 172.21.15.78:0/3647953345 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d0c0094d0 con 0x7f8d1c06d8d0 2023-11-28T19:59:06.936 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:06.928+0000 7f8d22795640 1 --2- 172.21.15.78:0/3647953345 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8d1c14fa90 0x7f8d1c1f06d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T19:59:06.936 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:06.928+0000 7f8d21793640 1 --2- 172.21.15.78:0/3647953345 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8d1c0c2040 0x7f8d1c14b740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T19:59:06.936 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:06.928+0000 7f8d21f94640 1 --2- 172.21.15.78:0/3647953345 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8d1c06d8d0 0x7f8d1c146af0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f8d1800e930 tx=0x7f8d1800edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:59:06.936 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:06.932+0000 7f8d127fc640 1 -- 172.21.15.78:0/3647953345 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d18009690 con 0x7f8d1c06d8d0 2023-11-28T19:59:06.936 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:06.932+0000 7f8d127fc640 1 -- 172.21.15.78:0/3647953345 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d1800ca00 con 0x7f8d1c06d8d0 2023-11-28T19:59:06.936 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:06.932+0000 7f8d127fc640 1 -- 172.21.15.78:0/3647953345 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d1800cd70 con 0x7f8d1c06d8d0 2023-11-28T19:59:06.936 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:06.932+0000 7f8d241f8640 1 -- 172.21.15.78:0/3647953345 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8d1c151e50 con 0x7f8d1c06d8d0 2023-11-28T19:59:06.937 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:06.932+0000 7f8d241f8640 1 -- 172.21.15.78:0/3647953345 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8d1c14bc80 con 0x7f8d1c06d8d0 2023-11-28T19:59:06.937 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:06.932+0000 7f8d241f8640 1 -- 172.21.15.78:0/3647953345 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8d1c1f1380 con 0x7f8d1c06d8d0 2023-11-28T19:59:06.937 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:06.932+0000 7f8d127fc640 1 -- 172.21.15.78:0/3647953345 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f8d18013470 con 0x7f8d1c06d8d0 2023-11-28T19:59:06.938 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:06.932+0000 7f8d127fc640 1 --2- 172.21.15.78:0/3647953345 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f8d00066470 0x7f8d00068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:06.938 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:06.932+0000 7f8d127fc640 1 -- 172.21.15.78:0/3647953345 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5935+0+0 (secure 0 0 0) 0x7f8d18084120 con 0x7f8d1c06d8d0 2023-11-28T19:59:06.938 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:06.932+0000 7f8d21793640 1 --2- 172.21.15.78:0/3647953345 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f8d00066470 0x7f8d00068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:06.938 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:06.932+0000 7f8d21793640 1 --2- 172.21.15.78:0/3647953345 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f8d00066470 0x7f8d00068930 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f8d0c0af000 tx=0x7f8d0c008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:59:06.941 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:06.936+0000 7f8d127fc640 1 -- 172.21.15.78:0/3647953345 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f8d18051610 con 0x7f8d1c06d8d0 2023-11-28T19:59:07.096 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:07.092+0000 7f8d241f8640 1 -- 172.21.15.78:0/3647953345 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f8d1c067590 con 0x7f8d1c06d8d0 2023-11-28T19:59:09.070 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:09.064+0000 7f8d127fc640 1 -- 172.21.15.78:0/3647953345 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data_ec' created v23) v1 ==== 228+0+0 (secure 0 0 0) 0x7f8d18054c30 con 0x7f8d1c06d8d0 2023-11-28T19:59:09.070 INFO:teuthology.orchestra.run.smithi078.stderr:pool 'cephfs_data_ec' created 2023-11-28T19:59:09.073 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:09.068+0000 7f8d241f8640 1 -- 172.21.15.78:0/3647953345 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f8d00066470 msgr2=0x7f8d00068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:09.073 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:09.068+0000 7f8d241f8640 1 --2- 172.21.15.78:0/3647953345 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f8d00066470 0x7f8d00068930 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f8d0c0af000 tx=0x7f8d0c008040 comp rx=0 tx=0).stop 2023-11-28T19:59:09.074 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:09.068+0000 7f8d241f8640 1 -- 172.21.15.78:0/3647953345 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8d1c06d8d0 msgr2=0x7f8d1c146af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:09.074 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:09.068+0000 7f8d241f8640 1 --2- 172.21.15.78:0/3647953345 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8d1c06d8d0 0x7f8d1c146af0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f8d1800e930 tx=0x7f8d1800edf0 comp rx=0 tx=0).stop 2023-11-28T19:59:09.074 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:09.068+0000 7f8d241f8640 1 -- 172.21.15.78:0/3647953345 shutdown_connections 2023-11-28T19:59:09.074 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:09.068+0000 7f8d241f8640 1 --2- 172.21.15.78:0/3647953345 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f8d00066470 0x7f8d00068930 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:09.074 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:09.068+0000 7f8d241f8640 1 --2- 172.21.15.78:0/3647953345 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8d1c0c2040 0x7f8d1c14b740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:09.075 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:09.068+0000 7f8d241f8640 1 --2- 172.21.15.78:0/3647953345 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8d1c14fa90 0x7f8d1c1f06d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:09.075 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:09.068+0000 7f8d241f8640 1 --2- 172.21.15.78:0/3647953345 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8d1c06d8d0 0x7f8d1c146af0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:09.075 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:09.068+0000 7f8d241f8640 1 -- 172.21.15.78:0/3647953345 >> 172.21.15.78:0/3647953345 conn(0x7f8d1c0a77e0 msgr2=0x7f8d1c148ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T19:59:09.075 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:09.068+0000 7f8d241f8640 1 -- 172.21.15.78:0/3647953345 shutdown_connections 2023-11-28T19:59:09.076 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:09.068+0000 7f8d241f8640 1 -- 172.21.15.78:0/3647953345 wait complete. 2023-11-28T19:59:09.106 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool set cephfs_data_ec allow_ec_overwrites true 2023-11-28T19:59:09.250 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:09.244+0000 7f8afb59e640 1 Processor -- start 2023-11-28T19:59:09.251 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:09.248+0000 7f8afb59e640 1 -- start start 2023-11-28T19:59:09.252 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:09.248+0000 7f8afb59e640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f8afc0c4010 0x7f8afc14de00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:09.252 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:09.248+0000 7f8afb59e640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8afc0aa880 0x7f8afc0a9910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:09.252 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:09.248+0000 7f8afb59e640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8afc1514f0 con 0x7f8afc0c3c30 2023-11-28T19:59:09.252 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:09.248+0000 7f8afb59e640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8afc1508e0 con 0x7f8afc0c4010 2023-11-28T19:59:09.252 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:09.248+0000 7f8afb59e640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8afc150bc0 con 0x7f8afc0aa880 2023-11-28T19:59:09.253 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:09.248+0000 7f8afad9d640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8afc0aa880 0x7f8afc0a9910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:09.253 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:09.248+0000 7f8af3fff640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f8afc0c4010 0x7f8afc14de00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:09.253 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:09.248+0000 7f8afad9d640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8afc0aa880 0x7f8afc0a9910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3301/0 says I am v2:172.21.15.78:42904/0 (socket says 172.21.15.78:42904) 2023-11-28T19:59:09.253 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:09.248+0000 7f8afa59c640 1 --1- >> v1:172.21.15.179:6789/0 conn(0x7f8afc0c3c30 0x7f8afc14d6f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.179:6789/0 says I am v1:172.21.15.78:42498/0 (socket says 172.21.15.78:42498) 2023-11-28T19:59:09.253 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:09.248+0000 7f8af3fff640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f8afc0c4010 0x7f8afc14de00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.78:58962/0 (socket says 172.21.15.78:58962) 2023-11-28T19:59:09.254 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:09.248+0000 7f8afad9d640 1 -- 172.21.15.78:0/1893672253 learned_addr learned my addr 172.21.15.78:0/1893672253 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T19:59:09.254 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:09.248+0000 7f8af3fff640 1 -- 172.21.15.78:0/1893672253 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8afc0aa880 msgr2=0x7f8afc0a9910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T19:59:09.254 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:09.248+0000 7f8af3fff640 1 --2- 172.21.15.78:0/1893672253 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8afc0aa880 0x7f8afc0a9910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:09.254 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:09.248+0000 7f8af3fff640 1 -- 172.21.15.78:0/1893672253 >> v1:172.21.15.179:6789/0 conn(0x7f8afc0c3c30 legacy=0x7f8afc14d6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:09.254 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:09.248+0000 7f8af3fff640 1 -- 172.21.15.78:0/1893672253 --> v2:172.21.15.179:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8afc150ea0 con 0x7f8afc0c4010 2023-11-28T19:59:09.254 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:09.248+0000 7f8afad9d640 1 --2- 172.21.15.78:0/1893672253 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8afc0aa880 0x7f8afc0a9910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T19:59:09.256 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:09.252+0000 7f8af3fff640 1 --2- 172.21.15.78:0/1893672253 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8afc0c4010 0x7f8afc14de00 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f8ae40097f0 tx=0x7f8ae401c3c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4b36ba183f0d66af server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:59:09.256 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:09.252+0000 7f8af9d9b640 1 -- 172.21.15.78:0/1893672253 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ae40ab600 con 0x7f8afc0c4010 2023-11-28T19:59:09.256 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:09.252+0000 7f8af9d9b640 1 -- 172.21.15.78:0/1893672253 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ae40a7050 con 0x7f8afc0c4010 2023-11-28T19:59:09.257 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:09.252+0000 7f8af9d9b640 1 -- 172.21.15.78:0/1893672253 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ae40ab980 con 0x7f8afc0c4010 2023-11-28T19:59:09.260 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:09.252+0000 7f8afb59e640 1 -- 172.21.15.78:0/1893672253 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8afc0c4010 msgr2=0x7f8afc14de00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:09.260 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:09.252+0000 7f8afb59e640 1 --2- 172.21.15.78:0/1893672253 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8afc0c4010 0x7f8afc14de00 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f8ae40097f0 tx=0x7f8ae401c3c0 comp rx=0 tx=0).stop 2023-11-28T19:59:09.260 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:09.252+0000 7f8afb59e640 1 -- 172.21.15.78:0/1893672253 shutdown_connections 2023-11-28T19:59:09.260 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:09.252+0000 7f8afb59e640 1 --2- 172.21.15.78:0/1893672253 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8afc0aa880 0x7f8afc0a9910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:09.260 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:09.252+0000 7f8afb59e640 1 --2- 172.21.15.78:0/1893672253 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8afc0c4010 0x7f8afc14de00 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:09.260 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:09.252+0000 7f8afb59e640 1 -- 172.21.15.78:0/1893672253 >> 172.21.15.78:0/1893672253 conn(0x7f8afc06b0d0 msgr2=0x7f8afc0a7600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T19:59:09.261 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:09.252+0000 7f8afb59e640 1 -- 172.21.15.78:0/1893672253 shutdown_connections 2023-11-28T19:59:09.261 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:09.252+0000 7f8afb59e640 1 -- 172.21.15.78:0/1893672253 wait complete. 2023-11-28T19:59:09.261 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:09.256+0000 7f8afb59e640 1 Processor -- start 2023-11-28T19:59:09.261 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:09.256+0000 7f8afb59e640 1 -- start start 2023-11-28T19:59:09.261 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:09.256+0000 7f8afb59e640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8afc0aa880 0x7f8afc1f0130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:09.261 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:09.256+0000 7f8afb59e640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8afc0c3c30 0x7f8afc070510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:09.261 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:09.256+0000 7f8afb59e640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8afc0c4010 0x7f8afc070a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:09.261 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:09.256+0000 7f8afb59e640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8afc0723f0 con 0x7f8afc0c3c30 2023-11-28T19:59:09.261 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:09.256+0000 7f8afb59e640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8afc14dc90 con 0x7f8afc0aa880 2023-11-28T19:59:09.261 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:09.256+0000 7f8afb59e640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8afc072690 con 0x7f8afc0c4010 2023-11-28T19:59:09.261 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:09.256+0000 7f8af3fff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8afc0c3c30 0x7f8afc070510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:09.261 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:09.256+0000 7f8af3fff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8afc0c3c30 0x7f8afc070510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:56856/0 (socket says 172.21.15.78:56856) 2023-11-28T19:59:09.262 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:09.256+0000 7f8af3fff640 1 -- 172.21.15.78:0/748717681 learned_addr learned my addr 172.21.15.78:0/748717681 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T19:59:09.262 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:09.256+0000 7f8afad9d640 1 --2- 172.21.15.78:0/748717681 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8afc0c4010 0x7f8afc070a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:09.262 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:09.256+0000 7f8afa59c640 1 --2- 172.21.15.78:0/748717681 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8afc0aa880 0x7f8afc1f0130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:09.263 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:09.256+0000 7f8af3fff640 1 -- 172.21.15.78:0/748717681 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8afc0c4010 msgr2=0x7f8afc070a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:09.263 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:09.256+0000 7f8af3fff640 1 --2- 172.21.15.78:0/748717681 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8afc0c4010 0x7f8afc070a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:09.263 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:09.256+0000 7f8af3fff640 1 -- 172.21.15.78:0/748717681 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8afc0aa880 msgr2=0x7f8afc1f0130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:09.263 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:09.256+0000 7f8af3fff640 1 --2- 172.21.15.78:0/748717681 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8afc0aa880 0x7f8afc1f0130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:09.263 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:09.256+0000 7f8af3fff640 1 -- 172.21.15.78:0/748717681 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8af4009b30 con 0x7f8afc0c3c30 2023-11-28T19:59:09.263 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:09.256+0000 7f8af3fff640 1 --2- 172.21.15.78:0/748717681 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8afc0c3c30 0x7f8afc070510 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f8ae4009740 tx=0x7f8ae4019160 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:59:09.263 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:09.256+0000 7f8af2ffd640 1 -- 172.21.15.78:0/748717681 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ae4006e20 con 0x7f8afc0c3c30 2023-11-28T19:59:09.263 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:09.256+0000 7f8afb59e640 1 -- 172.21.15.78:0/748717681 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8ae4009420 con 0x7f8afc0c3c30 2023-11-28T19:59:09.264 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:09.256+0000 7f8af2ffd640 1 -- 172.21.15.78:0/748717681 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ae40b6480 con 0x7f8afc0c3c30 2023-11-28T19:59:09.264 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:09.256+0000 7f8af2ffd640 1 -- 172.21.15.78:0/748717681 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ae40b67f0 con 0x7f8afc0c3c30 2023-11-28T19:59:09.264 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:09.256+0000 7f8afb59e640 1 -- 172.21.15.78:0/748717681 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8afc072b20 con 0x7f8afc0c3c30 2023-11-28T19:59:09.264 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:09.256+0000 7f8afb59e640 1 -- 172.21.15.78:0/748717681 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8afc0674b0 con 0x7f8afc0c3c30 2023-11-28T19:59:09.264 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:09.260+0000 7f8af2ffd640 1 -- 172.21.15.78:0/748717681 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f8ae40b2040 con 0x7f8afc0c3c30 2023-11-28T19:59:09.265 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:09.260+0000 7f8af2ffd640 1 --2- 172.21.15.78:0/748717681 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f8adc066470 0x7f8adc068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:09.265 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:09.260+0000 7f8af2ffd640 1 -- 172.21.15.78:0/748717681 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6428+0+0 (secure 0 0 0) 0x7f8ae411e920 con 0x7f8afc0c3c30 2023-11-28T19:59:09.265 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:09.260+0000 7f8afa59c640 1 --2- 172.21.15.78:0/748717681 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f8adc066470 0x7f8adc068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:09.265 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:09.260+0000 7f8afa59c640 1 --2- 172.21.15.78:0/748717681 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f8adc066470 0x7f8adc068930 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f8aec000f70 tx=0x7f8aec007e90 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:59:09.269 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:09.264+0000 7f8af2ffd640 1 -- 172.21.15.78:0/748717681 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f8ae40ebaf0 con 0x7f8afc0c3c30 2023-11-28T19:59:09.417 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:09.412+0000 7f8afb59e640 1 -- 172.21.15.78:0/748717681 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"} v 0) v1 -- 0x7f8afc0727d0 con 0x7f8afc0c3c30 2023-11-28T19:59:10.078 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:10.072+0000 7f8af2ffd640 1 -- 172.21.15.78:0/748717681 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]=0 set pool 4 allow_ec_overwrites to true v24) v1 ==== 169+0+0 (secure 0 0 0) 0x7f8ae40c60c0 con 0x7f8afc0c3c30 2023-11-28T19:59:10.078 INFO:teuthology.orchestra.run.smithi078.stderr:set pool 4 allow_ec_overwrites to true 2023-11-28T19:59:10.080 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:10.076+0000 7f8afb59e640 1 -- 172.21.15.78:0/748717681 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f8adc066470 msgr2=0x7f8adc068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:10.080 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:10.076+0000 7f8afb59e640 1 --2- 172.21.15.78:0/748717681 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f8adc066470 0x7f8adc068930 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f8aec000f70 tx=0x7f8aec007e90 comp rx=0 tx=0).stop 2023-11-28T19:59:10.080 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:10.076+0000 7f8afb59e640 1 -- 172.21.15.78:0/748717681 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8afc0c3c30 msgr2=0x7f8afc070510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:10.080 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:10.076+0000 7f8afb59e640 1 --2- 172.21.15.78:0/748717681 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8afc0c3c30 0x7f8afc070510 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f8ae4009740 tx=0x7f8ae4019160 comp rx=0 tx=0).stop 2023-11-28T19:59:10.081 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:10.076+0000 7f8afb59e640 1 -- 172.21.15.78:0/748717681 shutdown_connections 2023-11-28T19:59:10.081 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:10.076+0000 7f8afb59e640 1 --2- 172.21.15.78:0/748717681 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f8adc066470 0x7f8adc068930 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:10.081 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:10.076+0000 7f8afb59e640 1 --2- 172.21.15.78:0/748717681 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8afc0c4010 0x7f8afc070a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:10.081 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:10.076+0000 7f8afb59e640 1 --2- 172.21.15.78:0/748717681 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8afc0c3c30 0x7f8afc070510 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:10.081 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:10.076+0000 7f8afb59e640 1 --2- 172.21.15.78:0/748717681 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8afc0aa880 0x7f8afc1f0130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:10.081 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:10.076+0000 7f8afb59e640 1 -- 172.21.15.78:0/748717681 >> 172.21.15.78:0/748717681 conn(0x7f8afc06b0d0 msgr2=0x7f8afc0a5f60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T19:59:10.082 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:10.076+0000 7f8afb59e640 1 -- 172.21.15.78:0/748717681 shutdown_connections 2023-11-28T19:59:10.082 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:10.076+0000 7f8afb59e640 1 -- 172.21.15.78:0/748717681 wait complete. 2023-11-28T19:59:10.132 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs add_data_pool cephfs cephfs_data_ec 2023-11-28T19:59:10.276 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:10.272+0000 7fb97fb9d640 1 Processor -- start 2023-11-28T19:59:10.276 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:10.272+0000 7fb97fb9d640 1 -- start start 2023-11-28T19:59:10.280 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:10.272+0000 7fb97fb9d640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fb97814f850 0x7fb9780aacf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:10.280 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:10.272+0000 7fb97fb9d640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fb97814fc30 0x7fb9780c3cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:10.281 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:10.272+0000 7fb97fb9d640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb97806d840 0x7fb9780c4210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:10.281 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:10.272+0000 7fb97fb9d640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb9780c2240 con 0x7fb97814fc30 2023-11-28T19:59:10.281 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:10.272+0000 7fb97fb9d640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb978152910 con 0x7fb97814f850 2023-11-28T19:59:10.281 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:10.272+0000 7fb97fb9d640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb978152bf0 con 0x7fb97806d840 2023-11-28T19:59:10.282 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:10.272+0000 7fb97d138640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fb97814fc30 0x7fb9780c3cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:10.282 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:10.272+0000 7fb97d138640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fb97814fc30 0x7fb9780c3cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:56860/0 (socket says 172.21.15.78:56860) 2023-11-28T19:59:10.282 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:10.272+0000 7fb97d138640 1 -- 172.21.15.78:0/561251301 learned_addr learned my addr 172.21.15.78:0/561251301 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T19:59:10.283 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:10.272+0000 7fb97e13a640 1 --2- 172.21.15.78:0/561251301 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb97806d840 0x7fb9780c4210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:10.283 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:10.272+0000 7fb97d939640 1 --2- 172.21.15.78:0/561251301 >> v2:172.21.15.179:3300/0 conn(0x7fb97814f850 0x7fb9780aacf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:10.283 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:10.272+0000 7fb97d138640 1 -- 172.21.15.78:0/561251301 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb97806d840 msgr2=0x7fb9780c4210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T19:59:10.284 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:10.272+0000 7fb97d138640 1 --2- 172.21.15.78:0/561251301 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb97806d840 0x7fb9780c4210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:10.284 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:10.272+0000 7fb97d138640 1 -- 172.21.15.78:0/561251301 >> v2:172.21.15.179:3300/0 conn(0x7fb97814f850 msgr2=0x7fb9780aacf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T19:59:10.284 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:10.272+0000 7fb97d138640 1 --2- 172.21.15.78:0/561251301 >> v2:172.21.15.179:3300/0 conn(0x7fb97814f850 0x7fb9780aacf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:10.285 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:10.272+0000 7fb97d138640 1 -- 172.21.15.78:0/561251301 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb978152ed0 con 0x7fb97814fc30 2023-11-28T19:59:10.295 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:10.276+0000 7fb97d138640 1 --2- 172.21.15.78:0/561251301 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb97814fc30 0x7fb9780c3cd0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fb978066f50 tx=0x7fb96801c500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2843e9bc643db297 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:59:10.295 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:10.276+0000 7fb97c937640 1 -- 172.21.15.78:0/561251301 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9680aa640 con 0x7fb97814fc30 2023-11-28T19:59:10.296 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:10.276+0000 7fb97c937640 1 -- 172.21.15.78:0/561251301 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb9680aa7a0 con 0x7fb97814fc30 2023-11-28T19:59:10.296 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:10.276+0000 7fb97c937640 1 -- 172.21.15.78:0/561251301 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9680aab30 con 0x7fb97814fc30 2023-11-28T19:59:10.296 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:10.276+0000 7fb97fb9d640 1 -- 172.21.15.78:0/561251301 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb97814fc30 msgr2=0x7fb9780c3cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:10.296 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:10.276+0000 7fb97fb9d640 1 --2- 172.21.15.78:0/561251301 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb97814fc30 0x7fb9780c3cd0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fb978066f50 tx=0x7fb96801c500 comp rx=0 tx=0).stop 2023-11-28T19:59:10.296 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:10.276+0000 7fb97fb9d640 1 -- 172.21.15.78:0/561251301 shutdown_connections 2023-11-28T19:59:10.296 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:10.276+0000 7fb97fb9d640 1 --2- 172.21.15.78:0/561251301 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb97806d840 0x7fb9780c4210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:10.297 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:10.276+0000 7fb97fb9d640 1 --2- 172.21.15.78:0/561251301 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb97814fc30 0x7fb9780c3cd0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:10.297 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:10.276+0000 7fb97fb9d640 1 --2- 172.21.15.78:0/561251301 >> v2:172.21.15.179:3300/0 conn(0x7fb97814f850 0x7fb9780aacf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:10.297 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:10.276+0000 7fb97fb9d640 1 -- 172.21.15.78:0/561251301 >> 172.21.15.78:0/561251301 conn(0x7fb9780c59f0 msgr2=0x7fb9780c5e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T19:59:10.297 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:10.276+0000 7fb97fb9d640 1 -- 172.21.15.78:0/561251301 shutdown_connections 2023-11-28T19:59:10.297 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:10.276+0000 7fb97fb9d640 1 -- 172.21.15.78:0/561251301 wait complete. 2023-11-28T19:59:10.297 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:10.280+0000 7fb97fb9d640 1 Processor -- start 2023-11-28T19:59:10.298 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:10.280+0000 7fb97fb9d640 1 -- start start 2023-11-28T19:59:10.298 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:10.280+0000 7fb97fb9d640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb97806d840 0x7fb978151840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:10.298 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:10.280+0000 7fb97fb9d640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb97814f850 0x7fb9781f0f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:10.298 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:10.280+0000 7fb97fb9d640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb97814fc30 0x7fb9781f1440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:10.298 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:10.280+0000 7fb97fb9d640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9780a6a10 con 0x7fb97814fc30 2023-11-28T19:59:10.298 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:10.280+0000 7fb97fb9d640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb978148980 con 0x7fb97806d840 2023-11-28T19:59:10.299 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:10.280+0000 7fb97fb9d640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb9780a6c20 con 0x7fb97814f850 2023-11-28T19:59:10.299 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:10.280+0000 7fb97e13a640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb97814fc30 0x7fb9781f1440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:10.299 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:10.280+0000 7fb97e13a640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb97814fc30 0x7fb9781f1440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:56866/0 (socket says 172.21.15.78:56866) 2023-11-28T19:59:10.299 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:10.280+0000 7fb97e13a640 1 -- 172.21.15.78:0/695867765 learned_addr learned my addr 172.21.15.78:0/695867765 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T19:59:10.299 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:10.280+0000 7fb97d138640 1 --2- 172.21.15.78:0/695867765 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb97814f850 0x7fb9781f0f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:10.299 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:10.280+0000 7fb97d939640 1 --2- 172.21.15.78:0/695867765 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb97806d840 0x7fb978151840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:10.299 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:10.280+0000 7fb97e13a640 1 -- 172.21.15.78:0/695867765 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb97814f850 msgr2=0x7fb9781f0f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:10.300 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:10.280+0000 7fb97e13a640 1 --2- 172.21.15.78:0/695867765 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb97814f850 0x7fb9781f0f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:10.300 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:10.280+0000 7fb97e13a640 1 -- 172.21.15.78:0/695867765 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb97806d840 msgr2=0x7fb978151840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:10.300 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:10.280+0000 7fb97e13a640 1 --2- 172.21.15.78:0/695867765 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb97806d840 0x7fb978151840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:10.301 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:10.280+0000 7fb97e13a640 1 -- 172.21.15.78:0/695867765 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9680094d0 con 0x7fb97814fc30 2023-11-28T19:59:10.301 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:10.280+0000 7fb97e13a640 1 --2- 172.21.15.78:0/695867765 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb97814fc30 0x7fb9781f1440 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fb970007e90 tx=0x7fb97000e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:59:10.302 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:10.280+0000 7fb96e7fc640 1 -- 172.21.15.78:0/695867765 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb970014420 con 0x7fb97814fc30 2023-11-28T19:59:10.302 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:10.280+0000 7fb96e7fc640 1 -- 172.21.15.78:0/695867765 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb9700145a0 con 0x7fb97814fc30 2023-11-28T19:59:10.302 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:10.280+0000 7fb96e7fc640 1 -- 172.21.15.78:0/695867765 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb970014950 con 0x7fb97814fc30 2023-11-28T19:59:10.302 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:10.280+0000 7fb97fb9d640 1 -- 172.21.15.78:0/695867765 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb9780a6f00 con 0x7fb97814fc30 2023-11-28T19:59:10.302 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:10.280+0000 7fb97fb9d640 1 -- 172.21.15.78:0/695867765 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb978151d80 con 0x7fb97814fc30 2023-11-28T19:59:10.303 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:10.284+0000 7fb97fb9d640 1 -- 172.21.15.78:0/695867765 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb9781f0bb0 con 0x7fb97814fc30 2023-11-28T19:59:10.303 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:10.284+0000 7fb96e7fc640 1 -- 172.21.15.78:0/695867765 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fb970014ab0 con 0x7fb97814fc30 2023-11-28T19:59:10.303 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:10.284+0000 7fb96e7fc640 1 --2- 172.21.15.78:0/695867765 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fb95c066470 0x7fb95c068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:10.303 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:10.284+0000 7fb96e7fc640 1 -- 172.21.15.78:0/695867765 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6428+0+0 (secure 0 0 0) 0x7fb9700849c0 con 0x7fb97814fc30 2023-11-28T19:59:10.303 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:10.284+0000 7fb97d939640 1 --2- 172.21.15.78:0/695867765 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fb95c066470 0x7fb95c068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:10.303 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:10.284+0000 7fb97d939640 1 --2- 172.21.15.78:0/695867765 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fb95c066470 0x7fb95c068930 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fb974007a60 tx=0x7fb974008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:59:10.303 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:10.288+0000 7fb96e7fc640 1 -- 172.21.15.78:0/695867765 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fb970051b80 con 0x7fb97814fc30 2023-11-28T19:59:10.330 INFO:tasks.ceph.mds.b.smithi179.stderr:2023-11-28T19:59:10.326+0000 7fb7b8672640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-11-28T19:59:10.473 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:10.468+0000 7fb97fb9d640 1 -- 172.21.15.78:0/695867765 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"} v 0) v1 -- 0x7fb9780a4a90 con 0x7fb97814fc30 2023-11-28T19:59:11.085 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:11.080+0000 7fb96e7fc640 1 -- 172.21.15.78:0/695867765 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]=0 added data pool 4 to fsmap v7) v1 ==== 137+0+0 (secure 0 0 0) 0x7fb9700551a0 con 0x7fb97814fc30 2023-11-28T19:59:11.085 INFO:teuthology.orchestra.run.smithi078.stderr:added data pool 4 to fsmap 2023-11-28T19:59:11.088 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:11.084+0000 7fb97fb9d640 1 -- 172.21.15.78:0/695867765 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fb95c066470 msgr2=0x7fb95c068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:11.088 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:11.084+0000 7fb97fb9d640 1 --2- 172.21.15.78:0/695867765 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fb95c066470 0x7fb95c068930 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fb974007a60 tx=0x7fb974008040 comp rx=0 tx=0).stop 2023-11-28T19:59:11.088 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:11.084+0000 7fb97fb9d640 1 -- 172.21.15.78:0/695867765 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb97814fc30 msgr2=0x7fb9781f1440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:11.088 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:11.084+0000 7fb97fb9d640 1 --2- 172.21.15.78:0/695867765 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb97814fc30 0x7fb9781f1440 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fb970007e90 tx=0x7fb97000e4b0 comp rx=0 tx=0).stop 2023-11-28T19:59:11.088 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:11.084+0000 7fb97fb9d640 1 -- 172.21.15.78:0/695867765 shutdown_connections 2023-11-28T19:59:11.089 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:11.084+0000 7fb97fb9d640 1 --2- 172.21.15.78:0/695867765 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fb95c066470 0x7fb95c068930 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:11.089 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:11.084+0000 7fb97fb9d640 1 --2- 172.21.15.78:0/695867765 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb97814f850 0x7fb9781f0f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:11.089 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:11.084+0000 7fb97fb9d640 1 --2- 172.21.15.78:0/695867765 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb97814fc30 0x7fb9781f1440 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:11.089 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:11.084+0000 7fb97fb9d640 1 --2- 172.21.15.78:0/695867765 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb97806d840 0x7fb978151840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:11.089 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:11.084+0000 7fb97fb9d640 1 -- 172.21.15.78:0/695867765 >> 172.21.15.78:0/695867765 conn(0x7fb9780c59f0 msgr2=0x7fb97814bfe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T19:59:11.089 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:11.084+0000 7fb97fb9d640 1 -- 172.21.15.78:0/695867765 shutdown_connections 2023-11-28T19:59:11.089 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:11.084+0000 7fb97fb9d640 1 -- 172.21.15.78:0/695867765 wait complete. 2023-11-28T19:59:11.109 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-28T19:59:11.247 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:11.244+0000 7f76189e5640 1 Processor -- start 2023-11-28T19:59:11.247 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:11.244+0000 7f76189e5640 1 -- start start 2023-11-28T19:59:11.249 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:11.244+0000 7f76189e5640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f76140a4ca0 0x7f761414bdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:11.249 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:11.244+0000 7f76189e5640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7614152e90 0x7f761414c310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:11.250 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:11.244+0000 7f76189e5640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7614152a00 con 0x7f76140c5a40 2023-11-28T19:59:11.250 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:11.244+0000 7f76189e5640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f76141521a0 con 0x7f76140a4ca0 2023-11-28T19:59:11.250 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:11.244+0000 7f76189e5640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f76140a5180 con 0x7f7614152e90 2023-11-28T19:59:11.250 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:11.244+0000 7f761359e640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7614152e90 0x7f761414c310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:11.251 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:11.244+0000 7f761259c640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f76140a4ca0 0x7f761414bdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:11.251 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:11.244+0000 7f761359e640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7614152e90 0x7f761414c310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3301/0 says I am v2:172.21.15.78:42946/0 (socket says 172.21.15.78:42946) 2023-11-28T19:59:11.251 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:11.244+0000 7f761359e640 1 -- 172.21.15.78:0/2212071716 learned_addr learned my addr 172.21.15.78:0/2212071716 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T19:59:11.251 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:11.244+0000 7f761359e640 1 -- 172.21.15.78:0/2212071716 >> v2:172.21.15.179:3300/0 conn(0x7f76140a4ca0 msgr2=0x7f761414bdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T19:59:11.252 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:11.244+0000 7f761359e640 1 --2- 172.21.15.78:0/2212071716 >> v2:172.21.15.179:3300/0 conn(0x7f76140a4ca0 0x7f761414bdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:11.252 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:11.244+0000 7f7611d9b640 1 -- 172.21.15.78:0/2212071716 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1115423029 0 0) 0x7f7614152a00 con 0x7f76140c5a40 2023-11-28T19:59:11.252 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:11.244+0000 7f761359e640 1 -- 172.21.15.78:0/2212071716 >> v1:172.21.15.179:6789/0 conn(0x7f76140c5a40 legacy=0x7f7614155790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:11.252 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:11.244+0000 7f761359e640 1 -- 172.21.15.78:0/2212071716 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76141523b0 con 0x7f7614152e90 2023-11-28T19:59:11.255 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:11.248+0000 7f761359e640 1 --2- 172.21.15.78:0/2212071716 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7614152e90 0x7f761414c310 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f760c009e50 tx=0x7f760c01c980 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2473b862c0ce5ca9 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:59:11.255 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:11.248+0000 7f7611d9b640 1 -- 172.21.15.78:0/2212071716 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f760c0a5750 con 0x7f7614152e90 2023-11-28T19:59:11.256 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:11.248+0000 7f7611d9b640 1 -- 172.21.15.78:0/2212071716 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f760c0a58b0 con 0x7f7614152e90 2023-11-28T19:59:11.256 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:11.248+0000 7f7611d9b640 1 -- 172.21.15.78:0/2212071716 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f760c0a5c40 con 0x7f7614152e90 2023-11-28T19:59:11.256 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:11.248+0000 7f76189e5640 1 -- 172.21.15.78:0/2212071716 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7614152e90 msgr2=0x7f761414c310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:11.256 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:11.248+0000 7f76189e5640 1 --2- 172.21.15.78:0/2212071716 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7614152e90 0x7f761414c310 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f760c009e50 tx=0x7f760c01c980 comp rx=0 tx=0).stop 2023-11-28T19:59:11.256 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:11.248+0000 7f76189e5640 1 -- 172.21.15.78:0/2212071716 shutdown_connections 2023-11-28T19:59:11.256 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:11.248+0000 7f76189e5640 1 --2- 172.21.15.78:0/2212071716 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7614152e90 0x7f761414c310 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:11.256 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:11.248+0000 7f76189e5640 1 --2- 172.21.15.78:0/2212071716 >> v2:172.21.15.179:3300/0 conn(0x7f76140a4ca0 0x7f761414bdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:11.256 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:11.248+0000 7f76189e5640 1 -- 172.21.15.78:0/2212071716 >> 172.21.15.78:0/2212071716 conn(0x7f76140a7600 msgr2=0x7f76140a7a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T19:59:11.256 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:11.248+0000 7f76189e5640 1 -- 172.21.15.78:0/2212071716 shutdown_connections 2023-11-28T19:59:11.256 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:11.248+0000 7f76189e5640 1 -- 172.21.15.78:0/2212071716 wait complete. 2023-11-28T19:59:11.256 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:11.252+0000 7f76189e5640 1 Processor -- start 2023-11-28T19:59:11.257 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:11.252+0000 7f76189e5640 1 -- start start 2023-11-28T19:59:11.259 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:11.252+0000 7f76189e5640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f76140a4ca0 0x7f761406fae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:11.259 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:11.252+0000 7f76189e5640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f76140c5a40 0x7f76141ee250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:11.259 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:11.252+0000 7f76189e5640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7614152e90 0x7f76141ee790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:11.259 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:11.252+0000 7f76189e5640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7614155c80 con 0x7f76140a4ca0 2023-11-28T19:59:11.259 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:11.252+0000 7f76189e5640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76141540d0 con 0x7f76140c5a40 2023-11-28T19:59:11.259 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:11.252+0000 7f76189e5640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f76141eee50 con 0x7f7614152e90 2023-11-28T19:59:11.260 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:11.252+0000 7f7612d9d640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f76140a4ca0 0x7f761406fae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:11.260 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:11.252+0000 7f7612d9d640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f76140a4ca0 0x7f761406fae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:56868/0 (socket says 172.21.15.78:56868) 2023-11-28T19:59:11.260 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:11.252+0000 7f7612d9d640 1 -- 172.21.15.78:0/901694190 learned_addr learned my addr 172.21.15.78:0/901694190 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T19:59:11.260 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:11.252+0000 7f761259c640 1 --2- 172.21.15.78:0/901694190 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f76140c5a40 0x7f76141ee250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:11.260 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:11.252+0000 7f761359e640 1 --2- 172.21.15.78:0/901694190 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7614152e90 0x7f76141ee790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:11.260 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:11.252+0000 7f7612d9d640 1 -- 172.21.15.78:0/901694190 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7614152e90 msgr2=0x7f76141ee790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:11.260 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:11.252+0000 7f7612d9d640 1 --2- 172.21.15.78:0/901694190 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7614152e90 0x7f76141ee790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:11.260 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:11.252+0000 7f7612d9d640 1 -- 172.21.15.78:0/901694190 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f76140c5a40 msgr2=0x7f76141ee250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:11.260 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:11.252+0000 7f7612d9d640 1 --2- 172.21.15.78:0/901694190 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f76140c5a40 0x7f76141ee250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:11.260 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:11.252+0000 7f7612d9d640 1 -- 172.21.15.78:0/901694190 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f760c009b30 con 0x7f76140a4ca0 2023-11-28T19:59:11.260 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:11.252+0000 7f761359e640 1 --2- 172.21.15.78:0/901694190 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7614152e90 0x7f76141ee790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T19:59:11.261 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:11.252+0000 7f7612d9d640 1 --2- 172.21.15.78:0/901694190 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f76140a4ca0 0x7f761406fae0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f7604001ec0 tx=0x7f760400c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:59:11.261 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:11.252+0000 7f75fb7fe640 1 -- 172.21.15.78:0/901694190 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76040054e0 con 0x7f76140a4ca0 2023-11-28T19:59:11.261 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:11.252+0000 7f75fb7fe640 1 -- 172.21.15.78:0/901694190 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7604003600 con 0x7f76140a4ca0 2023-11-28T19:59:11.261 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:11.252+0000 7f75fb7fe640 1 -- 172.21.15.78:0/901694190 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76040039b0 con 0x7f76140a4ca0 2023-11-28T19:59:11.261 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:11.252+0000 7f76189e5640 1 -- 172.21.15.78:0/901694190 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f76141556c0 con 0x7f76140a4ca0 2023-11-28T19:59:11.261 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:11.252+0000 7f76189e5640 1 -- 172.21.15.78:0/901694190 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f76140c0f20 con 0x7f76140a4ca0 2023-11-28T19:59:11.261 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:11.252+0000 7f76189e5640 1 -- 172.21.15.78:0/901694190 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f76140674b0 con 0x7f76140a4ca0 2023-11-28T19:59:11.261 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:11.256+0000 7f75fb7fe640 1 -- 172.21.15.78:0/901694190 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f7604003b10 con 0x7f76140a4ca0 2023-11-28T19:59:11.262 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:11.256+0000 7f75fb7fe640 1 --2- 172.21.15.78:0/901694190 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f7600066470 0x7f7600068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:11.262 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:11.256+0000 7f75fb7fe640 1 -- 172.21.15.78:0/901694190 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f7604083730 con 0x7f76140a4ca0 2023-11-28T19:59:11.262 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:11.256+0000 7f761259c640 1 --2- 172.21.15.78:0/901694190 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f7600066470 0x7f7600068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:11.262 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:11.256+0000 7f761259c640 1 --2- 172.21.15.78:0/901694190 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f7600066470 0x7f7600068930 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f76140a63d0 tx=0x7f7608008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:59:11.264 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:11.260+0000 7f75fb7fe640 1 -- 172.21.15.78:0/901694190 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f76040508b0 con 0x7f76140a4ca0 2023-11-28T19:59:11.443 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:11.440+0000 7f76189e5640 1 -- 172.21.15.78:0/901694190 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f76140c4760 con 0x7f76140a4ca0 2023-11-28T19:59:11.444 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:11.440+0000 7f75fb7fe640 1 -- 172.21.15.78:0/901694190 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+4915 (secure 0 0 0) 0x7f7604017090 con 0x7f76140a4ca0 2023-11-28T19:59:11.444 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-11-28T19:59:11.444 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4241,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6835/3089461479","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6833","nonce":3089461479},{"type":"v1","addr":"172.21.15.179:6835","nonce":3089461479}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4258,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6837/3153162191","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6834","nonce":3153162191},{"type":"v1","addr":"172.21.15.78:6837","nonce":3153162191}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4266,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6836/3073967897","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6835","nonce":3073967897},{"type":"v1","addr":"172.21.15.78:6836","nonce":3073967897}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-28T19:59:05.411488+0000","modified":"2023-11-28T19:59:10.474793+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4275},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4275":{"gid":4275,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.179:6834/1234044491","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6832","nonce":1234044491},{"type":"v1","addr":"172.21.15.179:6834","nonce":1234044491}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2023-11-28T19:59:11.445 INFO:teuthology.orchestra.run.smithi078.stderr:dumped fsmap epoch 7 2023-11-28T19:59:11.446 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:11.440+0000 7f76189e5640 1 -- 172.21.15.78:0/901694190 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f7600066470 msgr2=0x7f7600068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:11.446 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:11.440+0000 7f76189e5640 1 --2- 172.21.15.78:0/901694190 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f7600066470 0x7f7600068930 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f76140a63d0 tx=0x7f7608008040 comp rx=0 tx=0).stop 2023-11-28T19:59:11.446 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:11.440+0000 7f76189e5640 1 -- 172.21.15.78:0/901694190 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f76140a4ca0 msgr2=0x7f761406fae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:11.446 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:11.440+0000 7f76189e5640 1 --2- 172.21.15.78:0/901694190 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f76140a4ca0 0x7f761406fae0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f7604001ec0 tx=0x7f760400c8e0 comp rx=0 tx=0).stop 2023-11-28T19:59:11.446 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:11.440+0000 7f76189e5640 1 -- 172.21.15.78:0/901694190 shutdown_connections 2023-11-28T19:59:11.446 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:11.440+0000 7f76189e5640 1 --2- 172.21.15.78:0/901694190 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f7600066470 0x7f7600068930 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:11.446 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:11.440+0000 7f76189e5640 1 --2- 172.21.15.78:0/901694190 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7614152e90 0x7f76141ee790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:11.446 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:11.440+0000 7f76189e5640 1 --2- 172.21.15.78:0/901694190 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f76140c5a40 0x7f76141ee250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:11.447 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:11.440+0000 7f76189e5640 1 --2- 172.21.15.78:0/901694190 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f76140a4ca0 0x7f761406fae0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:11.447 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:11.440+0000 7f76189e5640 1 -- 172.21.15.78:0/901694190 >> 172.21.15.78:0/901694190 conn(0x7f76140a7600 msgr2=0x7f76140a79e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T19:59:11.447 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:11.440+0000 7f76189e5640 1 -- 172.21.15.78:0/901694190 shutdown_connections 2023-11-28T19:59:11.447 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:11.440+0000 7f76189e5640 1 -- 172.21.15.78:0/901694190 wait complete. 2023-11-28T19:59:11.465 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-28T19:59:11.601 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:11.596+0000 7fabfbabb640 1 Processor -- start 2023-11-28T19:59:11.601 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:11.596+0000 7fabfbabb640 1 -- start start 2023-11-28T19:59:11.603 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:11.596+0000 7fabfbabb640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fabf4072580 0x7fabf40c3960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:11.603 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:11.596+0000 7fabfbabb640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fabf40c0460 0x7fabf4155ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:11.603 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:11.596+0000 7fabfbabb640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fabf40c1a50 con 0x7fabf40c0f30 2023-11-28T19:59:11.603 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:11.596+0000 7fabfbabb640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fabf4159990 con 0x7fabf40c0460 2023-11-28T19:59:11.603 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:11.596+0000 7fabfbabb640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fabf40c0890 con 0x7fabf4072580 2023-11-28T19:59:11.603 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:11.600+0000 7fabfa058640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fabf40c0460 0x7fabf4155ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:11.603 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:11.600+0000 7fabfa058640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fabf40c0460 0x7fabf4155ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:56880/0 (socket says 172.21.15.78:56880) 2023-11-28T19:59:11.604 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:11.600+0000 7fabfa058640 1 -- 172.21.15.78:0/4233885185 learned_addr learned my addr 172.21.15.78:0/4233885185 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T19:59:11.604 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:11.600+0000 7fabf9056640 1 --2- 172.21.15.78:0/4233885185 >> v2:172.21.15.179:3300/0 conn(0x7fabf4072580 0x7fabf40c3960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:11.604 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:11.600+0000 7fabfa058640 1 -- 172.21.15.78:0/4233885185 >> v2:172.21.15.179:3300/0 conn(0x7fabf4072580 msgr2=0x7fabf40c3960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T19:59:11.604 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:11.600+0000 7fabfa058640 1 --2- 172.21.15.78:0/4233885185 >> v2:172.21.15.179:3300/0 conn(0x7fabf4072580 0x7fabf40c3960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:11.604 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:11.600+0000 7fabfa058640 1 -- 172.21.15.78:0/4233885185 >> v1:172.21.15.179:6789/0 conn(0x7fabf40c0f30 legacy=0x7fabf4159280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:11.604 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:11.600+0000 7fabfa058640 1 -- 172.21.15.78:0/4233885185 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fabf40c1ca0 con 0x7fabf40c0460 2023-11-28T19:59:11.606 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:11.600+0000 7fabfa058640 1 --2- 172.21.15.78:0/4233885185 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fabf40c0460 0x7fabf4155ed0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fabf4066ed0 tx=0x7fabec01c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=800a0ff9291757db server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:59:11.606 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:11.600+0000 7fabf8855640 1 -- 172.21.15.78:0/4233885185 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabec0a5710 con 0x7fabf40c0460 2023-11-28T19:59:11.606 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:11.600+0000 7fabf8855640 1 -- 172.21.15.78:0/4233885185 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fabec0a5870 con 0x7fabf40c0460 2023-11-28T19:59:11.606 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:11.600+0000 7fabf8855640 1 -- 172.21.15.78:0/4233885185 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabec0a5c00 con 0x7fabf40c0460 2023-11-28T19:59:11.607 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:11.604+0000 7fabfbabb640 1 -- 172.21.15.78:0/4233885185 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fabf40c0460 msgr2=0x7fabf4155ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:11.607 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:11.604+0000 7fabfbabb640 1 --2- 172.21.15.78:0/4233885185 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fabf40c0460 0x7fabf4155ed0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fabf4066ed0 tx=0x7fabec01c940 comp rx=0 tx=0).stop 2023-11-28T19:59:11.607 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:11.604+0000 7fabfbabb640 1 -- 172.21.15.78:0/4233885185 shutdown_connections 2023-11-28T19:59:11.608 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:11.604+0000 7fabfbabb640 1 --2- 172.21.15.78:0/4233885185 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fabf40c0460 0x7fabf4155ed0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:11.608 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:11.604+0000 7fabfbabb640 1 --2- 172.21.15.78:0/4233885185 >> v2:172.21.15.179:3300/0 conn(0x7fabf4072580 0x7fabf40c3960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:11.608 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:11.604+0000 7fabfbabb640 1 -- 172.21.15.78:0/4233885185 >> 172.21.15.78:0/4233885185 conn(0x7fabf40a7810 msgr2=0x7fabf40a7c20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T19:59:11.608 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:11.604+0000 7fabfbabb640 1 -- 172.21.15.78:0/4233885185 shutdown_connections 2023-11-28T19:59:11.608 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:11.604+0000 7fabfbabb640 1 -- 172.21.15.78:0/4233885185 wait complete. 2023-11-28T19:59:11.608 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:11.604+0000 7fabfbabb640 1 Processor -- start 2023-11-28T19:59:11.608 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:11.604+0000 7fabfbabb640 1 -- start start 2023-11-28T19:59:11.610 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:11.604+0000 7fabfbabb640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fabf4072580 0x7fabf4147800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:11.611 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:11.604+0000 7fabfbabb640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fabf40c0460 0x7fabf40c2d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:11.611 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:11.604+0000 7fabfbabb640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fabf40c0f30 0x7fabf4152ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:11.611 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:11.604+0000 7fabfbabb640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fabf4147d40 con 0x7fabf40c0460 2023-11-28T19:59:11.611 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:11.604+0000 7fabfbabb640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fabf41f0f00 con 0x7fabf40c0f30 2023-11-28T19:59:11.611 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:11.604+0000 7fabfbabb640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fabf41f11c0 con 0x7fabf4072580 2023-11-28T19:59:11.611 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:11.604+0000 7fabf9056640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fabf40c0460 0x7fabf40c2d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:11.611 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:11.604+0000 7fabf9056640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fabf40c0460 0x7fabf40c2d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:56896/0 (socket says 172.21.15.78:56896) 2023-11-28T19:59:11.611 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:11.604+0000 7fabf9056640 1 -- 172.21.15.78:0/2178886375 learned_addr learned my addr 172.21.15.78:0/2178886375 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T19:59:11.611 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:11.604+0000 7fabf9857640 1 --2- 172.21.15.78:0/2178886375 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fabf4072580 0x7fabf4147800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:11.611 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:11.604+0000 7fabfa058640 1 --2- 172.21.15.78:0/2178886375 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fabf40c0f30 0x7fabf4152ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:11.611 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:11.604+0000 7fabf9056640 1 -- 172.21.15.78:0/2178886375 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fabf4072580 msgr2=0x7fabf4147800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:11.612 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:11.604+0000 7fabf9056640 1 --2- 172.21.15.78:0/2178886375 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fabf4072580 0x7fabf4147800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:11.612 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:11.604+0000 7fabf9056640 1 -- 172.21.15.78:0/2178886375 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fabf40c0f30 msgr2=0x7fabf4152ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:11.612 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:11.604+0000 7fabf9056640 1 --2- 172.21.15.78:0/2178886375 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fabf40c0f30 0x7fabf4152ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:11.612 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:11.604+0000 7fabf9056640 1 -- 172.21.15.78:0/2178886375 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fabec009b30 con 0x7fabf40c0460 2023-11-28T19:59:11.612 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:11.604+0000 7fabf9056640 1 --2- 172.21.15.78:0/2178886375 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fabf40c0460 0x7fabf40c2d20 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fabe400d5f0 tx=0x7fabe400dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:59:11.612 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:11.608+0000 7fabea7fc640 1 -- 172.21.15.78:0/2178886375 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabe40125f0 con 0x7fabf40c0460 2023-11-28T19:59:11.612 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:11.608+0000 7fabea7fc640 1 -- 172.21.15.78:0/2178886375 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fabe4012750 con 0x7fabf40c0460 2023-11-28T19:59:11.612 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:11.608+0000 7fabfbabb640 1 -- 172.21.15.78:0/2178886375 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fabf41f14a0 con 0x7fabf40c0460 2023-11-28T19:59:11.612 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:11.608+0000 7fabea7fc640 1 -- 172.21.15.78:0/2178886375 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabe4012ae0 con 0x7fabf40c0460 2023-11-28T19:59:11.612 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:11.608+0000 7fabfbabb640 1 -- 172.21.15.78:0/2178886375 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fabf41f1a60 con 0x7fabf40c0460 2023-11-28T19:59:11.613 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:11.608+0000 7fabfbabb640 1 -- 172.21.15.78:0/2178886375 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fabf4067630 con 0x7fabf40c0460 2023-11-28T19:59:11.613 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:11.608+0000 7fabea7fc640 1 -- 172.21.15.78:0/2178886375 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fabe4012c40 con 0x7fabf40c0460 2023-11-28T19:59:11.613 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:11.608+0000 7fabea7fc640 1 --2- 172.21.15.78:0/2178886375 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fabd8066470 0x7fabd8068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:11.614 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:11.608+0000 7fabea7fc640 1 -- 172.21.15.78:0/2178886375 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fabe40845a0 con 0x7fabf40c0460 2023-11-28T19:59:11.614 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:11.608+0000 7fabf9857640 1 --2- 172.21.15.78:0/2178886375 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fabd8066470 0x7fabd8068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:11.614 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:11.608+0000 7fabf9857640 1 --2- 172.21.15.78:0/2178886375 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fabd8066470 0x7fabd8068930 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fabf4158320 tx=0x7fabf0009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:59:11.617 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:11.612+0000 7fabea7fc640 1 -- 172.21.15.78:0/2178886375 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fabe4051740 con 0x7fabf40c0460 2023-11-28T19:59:11.767 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:11.760+0000 7fabfbabb640 1 -- 172.21.15.78:0/2178886375 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fabf40ab920 con 0x7fabf40c0460 2023-11-28T19:59:11.767 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:11.764+0000 7fabea7fc640 1 -- 172.21.15.78:0/2178886375 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+18322 (secure 0 0 0) 0x7fabe4007380 con 0x7fabf40c0460 2023-11-28T19:59:11.768 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-11-28T19:59:11.768 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":25,"fsid":"dd9780e8-3bda-44fa-a9f0-fa07d19d901d","created":"2023-11-28T19:58:40.969556+0000","modified":"2023-11-28T19:59:10.474525+0000","last_up_change":"2023-11-28T19:58:52.596716+0000","last_in_change":"2023-11-28T19:58:43.609275+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-28T19:58:54.011229+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-28T19:59:03.945559+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-28T19:59:04.481478+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-11-28T19:59:08.109152+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"e84245ac-b5da-429e-af18-39acaa2b33e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6800","nonce":3358701235},{"type":"v1","addr":"172.21.15.78:6801","nonce":3358701235}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6802","nonce":3358701235},{"type":"v1","addr":"172.21.15.78:6803","nonce":3358701235}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6806","nonce":3358701235},{"type":"v1","addr":"172.21.15.78:6807","nonce":3358701235}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6804","nonce":3358701235},{"type":"v1","addr":"172.21.15.78:6805","nonce":3358701235}]},"public_addr":"172.21.15.78:6801/3358701235","cluster_addr":"172.21.15.78:6803/3358701235","heartbeat_back_addr":"172.21.15.78:6807/3358701235","heartbeat_front_addr":"172.21.15.78:6805/3358701235","state":["exists","up"]},{"osd":1,"uuid":"e634831d-c4e2-48d9-870c-9556ae162981","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6808","nonce":3211476654},{"type":"v1","addr":"172.21.15.78:6809","nonce":3211476654}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6810","nonce":3211476654},{"type":"v1","addr":"172.21.15.78:6811","nonce":3211476654}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6814","nonce":3211476654},{"type":"v1","addr":"172.21.15.78:6815","nonce":3211476654}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6812","nonce":3211476654},{"type":"v1","addr":"172.21.15.78:6813","nonce":3211476654}]},"public_addr":"172.21.15.78:6809/3211476654","cluster_addr":"172.21.15.78:6811/3211476654","heartbeat_back_addr":"172.21.15.78:6815/3211476654","heartbeat_front_addr":"172.21.15.78:6813/3211476654","state":["exists","up"]},{"osd":2,"uuid":"274c8395-6534-41f0-b8fb-a00af8985aa8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6816","nonce":2532904479},{"type":"v1","addr":"172.21.15.78:6817","nonce":2532904479}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6818","nonce":2532904479},{"type":"v1","addr":"172.21.15.78:6819","nonce":2532904479}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6822","nonce":2532904479},{"type":"v1","addr":"172.21.15.78:6823","nonce":2532904479}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6820","nonce":2532904479},{"type":"v1","addr":"172.21.15.78:6821","nonce":2532904479}]},"public_addr":"172.21.15.78:6817/2532904479","cluster_addr":"172.21.15.78:6819/2532904479","heartbeat_back_addr":"172.21.15.78:6823/2532904479","heartbeat_front_addr":"172.21.15.78:6821/2532904479","state":["exists","up"]},{"osd":3,"uuid":"77acc9af-7d4d-4b18-8cf5-d62f5971b7c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6824","nonce":3442991267},{"type":"v1","addr":"172.21.15.78:6825","nonce":3442991267}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6826","nonce":3442991267},{"type":"v1","addr":"172.21.15.78:6827","nonce":3442991267}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6830","nonce":3442991267},{"type":"v1","addr":"172.21.15.78:6831","nonce":3442991267}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6828","nonce":3442991267},{"type":"v1","addr":"172.21.15.78:6829","nonce":3442991267}]},"public_addr":"172.21.15.78:6825/3442991267","cluster_addr":"172.21.15.78:6827/3442991267","heartbeat_back_addr":"172.21.15.78:6831/3442991267","heartbeat_front_addr":"172.21.15.78:6829/3442991267","state":["exists","up"]},{"osd":4,"uuid":"5c62bc66-6b34-4b7f-a66b-9a743969138c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":802983577},{"type":"v1","addr":"172.21.15.179:6809","nonce":802983577}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":802983577},{"type":"v1","addr":"172.21.15.179:6811","nonce":802983577}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":802983577},{"type":"v1","addr":"172.21.15.179:6815","nonce":802983577}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":802983577},{"type":"v1","addr":"172.21.15.179:6813","nonce":802983577}]},"public_addr":"172.21.15.179:6809/802983577","cluster_addr":"172.21.15.179:6811/802983577","heartbeat_back_addr":"172.21.15.179:6815/802983577","heartbeat_front_addr":"172.21.15.179:6813/802983577","state":["exists","up"]},{"osd":5,"uuid":"67db6d36-f684-4079-b0cd-82b4dd61461f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":518192887},{"type":"v1","addr":"172.21.15.179:6818","nonce":518192887}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":518192887},{"type":"v1","addr":"172.21.15.179:6822","nonce":518192887}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":518192887},{"type":"v1","addr":"172.21.15.179:6829","nonce":518192887}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6824","nonce":518192887},{"type":"v1","addr":"172.21.15.179:6826","nonce":518192887}]},"public_addr":"172.21.15.179:6818/518192887","cluster_addr":"172.21.15.179:6822/518192887","heartbeat_back_addr":"172.21.15.179:6829/518192887","heartbeat_front_addr":"172.21.15.179:6826/518192887","state":["exists","up"]},{"osd":6,"uuid":"12e670af-5a16-4c81-9f97-defa66cab967","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":815435378},{"type":"v1","addr":"172.21.15.179:6801","nonce":815435378}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":815435378},{"type":"v1","addr":"172.21.15.179:6803","nonce":815435378}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":815435378},{"type":"v1","addr":"172.21.15.179:6807","nonce":815435378}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":815435378},{"type":"v1","addr":"172.21.15.179:6805","nonce":815435378}]},"public_addr":"172.21.15.179:6801/815435378","cluster_addr":"172.21.15.179:6803/815435378","heartbeat_back_addr":"172.21.15.179:6807/815435378","heartbeat_front_addr":"172.21.15.179:6805/815435378","state":["exists","up"]},{"osd":7,"uuid":"fe630650-2eb3-49ad-8676-c341e6332eb1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6817","nonce":2848432339},{"type":"v1","addr":"172.21.15.179:6819","nonce":2848432339}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6821","nonce":2848432339},{"type":"v1","addr":"172.21.15.179:6823","nonce":2848432339}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":2848432339},{"type":"v1","addr":"172.21.15.179:6831","nonce":2848432339}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6825","nonce":2848432339},{"type":"v1","addr":"172.21.15.179:6827","nonce":2848432339}]},"public_addr":"172.21.15.179:6819/2848432339","cluster_addr":"172.21.15.179:6823/2848432339","heartbeat_back_addr":"172.21.15.179:6831/2848432339","heartbeat_front_addr":"172.21.15.179:6827/2848432339","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:58:49.255433+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:58:49.412880+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:58:49.559295+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:58:49.245237+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:58:49.184557+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:58:49.329851+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:58:49.366012+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:58:49.349604+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-28T19:59:11.769 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:11.764+0000 7fabfbabb640 1 -- 172.21.15.78:0/2178886375 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fabd8066470 msgr2=0x7fabd8068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:11.769 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:11.764+0000 7fabfbabb640 1 --2- 172.21.15.78:0/2178886375 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fabd8066470 0x7fabd8068930 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fabf4158320 tx=0x7fabf0009040 comp rx=0 tx=0).stop 2023-11-28T19:59:11.770 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:11.764+0000 7fabfbabb640 1 -- 172.21.15.78:0/2178886375 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fabf40c0460 msgr2=0x7fabf40c2d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:11.770 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:11.764+0000 7fabfbabb640 1 --2- 172.21.15.78:0/2178886375 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fabf40c0460 0x7fabf40c2d20 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fabe400d5f0 tx=0x7fabe400dab0 comp rx=0 tx=0).stop 2023-11-28T19:59:11.770 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:11.764+0000 7fabfbabb640 1 -- 172.21.15.78:0/2178886375 shutdown_connections 2023-11-28T19:59:11.770 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:11.764+0000 7fabfbabb640 1 --2- 172.21.15.78:0/2178886375 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fabd8066470 0x7fabd8068930 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:11.770 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:11.764+0000 7fabfbabb640 1 --2- 172.21.15.78:0/2178886375 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fabf40c0f30 0x7fabf4152ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:11.771 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:11.764+0000 7fabfbabb640 1 --2- 172.21.15.78:0/2178886375 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fabf40c0460 0x7fabf40c2d20 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:11.771 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:11.764+0000 7fabfbabb640 1 --2- 172.21.15.78:0/2178886375 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fabf4072580 0x7fabf4147800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:11.771 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:11.764+0000 7fabfbabb640 1 -- 172.21.15.78:0/2178886375 >> 172.21.15.78:0/2178886375 conn(0x7fabf40a7810 msgr2=0x7fabf40a7bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T19:59:11.771 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:11.764+0000 7fabfbabb640 1 -- 172.21.15.78:0/2178886375 shutdown_connections 2023-11-28T19:59:11.771 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:11.764+0000 7fabfbabb640 1 -- 172.21.15.78:0/2178886375 wait complete. 2023-11-28T19:59:11.788 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-28T19:59:11.925 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:11.920+0000 7f239af80640 1 Processor -- start 2023-11-28T19:59:11.925 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:11.920+0000 7f239af80640 1 -- start start 2023-11-28T19:59:11.927 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:11.920+0000 7f239af80640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f23940c3b80 0x7f239406d690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:11.927 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:11.920+0000 7f239af80640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f23940c5300 0x7f239406c730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:11.927 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:11.920+0000 7f239af80640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f239406bb80 con 0x7f239406d2b0 2023-11-28T19:59:11.927 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:11.920+0000 7f239af80640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f239406cc70 con 0x7f23940c5300 2023-11-28T19:59:11.927 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:11.920+0000 7f239af80640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f23940c5790 con 0x7f23940c3b80 2023-11-28T19:59:11.927 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:11.920+0000 7f239951d640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f23940c5300 0x7f239406c730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:11.927 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:11.920+0000 7f239951d640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f23940c5300 0x7f239406c730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:56904/0 (socket says 172.21.15.78:56904) 2023-11-28T19:59:11.927 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:11.920+0000 7f239951d640 1 -- 172.21.15.78:0/3528818940 learned_addr learned my addr 172.21.15.78:0/3528818940 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T19:59:11.927 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:11.920+0000 7f2398d1c640 1 --1- 172.21.15.78:0/3528818940 >> v1:172.21.15.78:6789/0 conn(0x7f239406d2b0 0x7f239406c020 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:39550/0 (socket says 172.21.15.78:39550) 2023-11-28T19:59:11.927 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:11.920+0000 7f238bfff640 1 --2- 172.21.15.78:0/3528818940 >> v2:172.21.15.179:3300/0 conn(0x7f23940c3b80 0x7f239406d690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:11.928 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:11.924+0000 7f239951d640 1 -- 172.21.15.78:0/3528818940 >> v2:172.21.15.179:3300/0 conn(0x7f23940c3b80 msgr2=0x7f239406d690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T19:59:11.928 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:11.924+0000 7f239951d640 1 --2- 172.21.15.78:0/3528818940 >> v2:172.21.15.179:3300/0 conn(0x7f23940c3b80 0x7f239406d690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:11.928 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:11.924+0000 7f239951d640 1 -- 172.21.15.78:0/3528818940 >> v1:172.21.15.78:6789/0 conn(0x7f239406d2b0 legacy=0x7f239406c020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:11.928 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:11.924+0000 7f239951d640 1 -- 172.21.15.78:0/3528818940 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23941515c0 con 0x7f23940c5300 2023-11-28T19:59:11.928 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:11.924+0000 7f238b7fe640 1 -- 172.21.15.78:0/3528818940 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3001335593 0 0) 0x7f239406bb80 con 0x7f239406d2b0 2023-11-28T19:59:11.930 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:11.924+0000 7f239951d640 1 --2- 172.21.15.78:0/3528818940 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f23940c5300 0x7f239406c730 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f239406b5a0 tx=0x7f238c01c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=edd089aa74bdd0dc server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:59:11.930 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:11.924+0000 7f238b7fe640 1 -- 172.21.15.78:0/3528818940 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f238c0a5770 con 0x7f23940c5300 2023-11-28T19:59:11.931 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:11.924+0000 7f238b7fe640 1 -- 172.21.15.78:0/3528818940 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f238c0a58d0 con 0x7f23940c5300 2023-11-28T19:59:11.931 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:11.924+0000 7f238b7fe640 1 -- 172.21.15.78:0/3528818940 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f238c0a5c60 con 0x7f23940c5300 2023-11-28T19:59:11.931 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:11.924+0000 7f239af80640 1 -- 172.21.15.78:0/3528818940 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f23940c5300 msgr2=0x7f239406c730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:11.931 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:11.924+0000 7f239af80640 1 --2- 172.21.15.78:0/3528818940 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f23940c5300 0x7f239406c730 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f239406b5a0 tx=0x7f238c01c9a0 comp rx=0 tx=0).stop 2023-11-28T19:59:11.932 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:11.924+0000 7f239af80640 1 -- 172.21.15.78:0/3528818940 shutdown_connections 2023-11-28T19:59:11.932 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:11.924+0000 7f239af80640 1 --2- 172.21.15.78:0/3528818940 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f23940c5300 0x7f239406c730 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:11.932 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:11.924+0000 7f239af80640 1 --2- 172.21.15.78:0/3528818940 >> v2:172.21.15.179:3300/0 conn(0x7f23940c3b80 0x7f239406d690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:11.932 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:11.924+0000 7f239af80640 1 -- 172.21.15.78:0/3528818940 >> 172.21.15.78:0/3528818940 conn(0x7f23940a7810 msgr2=0x7f23940a7c20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T19:59:11.932 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:11.928+0000 7f239af80640 1 -- 172.21.15.78:0/3528818940 shutdown_connections 2023-11-28T19:59:11.932 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:11.928+0000 7f239af80640 1 -- 172.21.15.78:0/3528818940 wait complete. 2023-11-28T19:59:11.933 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:11.928+0000 7f239af80640 1 Processor -- start 2023-11-28T19:59:11.933 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:11.928+0000 7f239af80640 1 -- start start 2023-11-28T19:59:11.934 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:11.928+0000 7f239af80640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f239406d2b0 0x7f239415e450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:11.935 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:11.928+0000 7f239af80640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f23940c3b80 0x7f239415e990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:11.935 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:11.928+0000 7f239af80640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f23940c5300 0x7f23941f0640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:11.935 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:11.928+0000 7f239af80640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23941f01b0 con 0x7f23940c5300 2023-11-28T19:59:11.935 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:11.928+0000 7f239af80640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2394146280 con 0x7f23940c3b80 2023-11-28T19:59:11.935 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:11.928+0000 7f239af80640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2394147d60 con 0x7f239406d2b0 2023-11-28T19:59:11.935 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:11.928+0000 7f239951d640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f23940c5300 0x7f23941f0640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:11.935 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:11.928+0000 7f239951d640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f23940c5300 0x7f23941f0640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:56920/0 (socket says 172.21.15.78:56920) 2023-11-28T19:59:11.935 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:11.928+0000 7f239951d640 1 -- 172.21.15.78:0/3849484255 learned_addr learned my addr 172.21.15.78:0/3849484255 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T19:59:11.935 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:11.928+0000 7f2398d1c640 1 --2- 172.21.15.78:0/3849484255 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f239406d2b0 0x7f239415e450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:11.935 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:11.928+0000 7f238bfff640 1 --2- 172.21.15.78:0/3849484255 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f23940c3b80 0x7f239415e990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:11.935 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:11.928+0000 7f239951d640 1 -- 172.21.15.78:0/3849484255 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f239406d2b0 msgr2=0x7f239415e450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:11.935 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:11.928+0000 7f239951d640 1 --2- 172.21.15.78:0/3849484255 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f239406d2b0 0x7f239415e450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:11.936 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:11.928+0000 7f239951d640 1 -- 172.21.15.78:0/3849484255 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f23940c3b80 msgr2=0x7f239415e990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:11.936 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:11.928+0000 7f239951d640 1 --2- 172.21.15.78:0/3849484255 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f23940c3b80 0x7f239415e990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:11.936 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:11.928+0000 7f239951d640 1 -- 172.21.15.78:0/3849484255 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f238c009b30 con 0x7f23940c5300 2023-11-28T19:59:11.936 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:11.928+0000 7f2398d1c640 1 --2- 172.21.15.78:0/3849484255 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f239406d2b0 0x7f239415e450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T19:59:11.936 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:11.928+0000 7f238bfff640 1 --2- 172.21.15.78:0/3849484255 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f23940c3b80 0x7f239415e990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T19:59:11.936 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:11.928+0000 7f239951d640 1 --2- 172.21.15.78:0/3849484255 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f23940c5300 0x7f23941f0640 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f238c0af040 tx=0x7f238c019740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:59:11.936 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:11.928+0000 7f23897fa640 1 -- 172.21.15.78:0/3849484255 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f238c0b8670 con 0x7f23940c5300 2023-11-28T19:59:11.936 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:11.928+0000 7f23897fa640 1 -- 172.21.15.78:0/3849484255 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f238c0b87f0 con 0x7f23940c5300 2023-11-28T19:59:11.937 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:11.932+0000 7f23897fa640 1 -- 172.21.15.78:0/3849484255 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f238c0b8ba0 con 0x7f23940c5300 2023-11-28T19:59:11.937 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:11.932+0000 7f239af80640 1 -- 172.21.15.78:0/3849484255 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f239414ef80 con 0x7f23940c5300 2023-11-28T19:59:11.937 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:11.932+0000 7f239af80640 1 -- 172.21.15.78:0/3849484255 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2394148320 con 0x7f23940c5300 2023-11-28T19:59:11.938 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:11.932+0000 7f239af80640 1 -- 172.21.15.78:0/3849484255 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2394067630 con 0x7f23940c5300 2023-11-28T19:59:11.938 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:11.932+0000 7f23897fa640 1 -- 172.21.15.78:0/3849484255 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f238c0b8d00 con 0x7f23940c5300 2023-11-28T19:59:11.938 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:11.932+0000 7f23897fa640 1 --2- 172.21.15.78:0/3849484255 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f2380066470 0x7f2380068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:11.938 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:11.932+0000 7f23897fa640 1 -- 172.21.15.78:0/3849484255 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f238c11f620 con 0x7f23940c5300 2023-11-28T19:59:11.938 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:11.932+0000 7f2398d1c640 1 --2- 172.21.15.78:0/3849484255 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f2380066470 0x7f2380068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:11.938 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:11.932+0000 7f2398d1c640 1 --2- 172.21.15.78:0/3849484255 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f2380066470 0x7f2380068930 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f2390007fd0 tx=0x7f2390007c20 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:59:11.941 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:11.936+0000 7f23897fa640 1 -- 172.21.15.78:0/3849484255 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f238c0ec8c0 con 0x7f23940c5300 2023-11-28T19:59:12.096 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:12.092+0000 7f239af80640 1 -- 172.21.15.78:0/3849484255 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f239406bd70 con 0x7f23940c5300 2023-11-28T19:59:12.098 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:12.092+0000 7f23897fa640 1 -- 172.21.15.78:0/3849484255 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+18322 (secure 0 0 0) 0x7f238c0efee0 con 0x7f23940c5300 2023-11-28T19:59:12.098 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-11-28T19:59:12.098 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":25,"fsid":"dd9780e8-3bda-44fa-a9f0-fa07d19d901d","created":"2023-11-28T19:58:40.969556+0000","modified":"2023-11-28T19:59:10.474525+0000","last_up_change":"2023-11-28T19:58:52.596716+0000","last_in_change":"2023-11-28T19:58:43.609275+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-28T19:58:54.011229+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-28T19:59:03.945559+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-28T19:59:04.481478+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-11-28T19:59:08.109152+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"e84245ac-b5da-429e-af18-39acaa2b33e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6800","nonce":3358701235},{"type":"v1","addr":"172.21.15.78:6801","nonce":3358701235}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6802","nonce":3358701235},{"type":"v1","addr":"172.21.15.78:6803","nonce":3358701235}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6806","nonce":3358701235},{"type":"v1","addr":"172.21.15.78:6807","nonce":3358701235}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6804","nonce":3358701235},{"type":"v1","addr":"172.21.15.78:6805","nonce":3358701235}]},"public_addr":"172.21.15.78:6801/3358701235","cluster_addr":"172.21.15.78:6803/3358701235","heartbeat_back_addr":"172.21.15.78:6807/3358701235","heartbeat_front_addr":"172.21.15.78:6805/3358701235","state":["exists","up"]},{"osd":1,"uuid":"e634831d-c4e2-48d9-870c-9556ae162981","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6808","nonce":3211476654},{"type":"v1","addr":"172.21.15.78:6809","nonce":3211476654}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6810","nonce":3211476654},{"type":"v1","addr":"172.21.15.78:6811","nonce":3211476654}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6814","nonce":3211476654},{"type":"v1","addr":"172.21.15.78:6815","nonce":3211476654}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6812","nonce":3211476654},{"type":"v1","addr":"172.21.15.78:6813","nonce":3211476654}]},"public_addr":"172.21.15.78:6809/3211476654","cluster_addr":"172.21.15.78:6811/3211476654","heartbeat_back_addr":"172.21.15.78:6815/3211476654","heartbeat_front_addr":"172.21.15.78:6813/3211476654","state":["exists","up"]},{"osd":2,"uuid":"274c8395-6534-41f0-b8fb-a00af8985aa8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6816","nonce":2532904479},{"type":"v1","addr":"172.21.15.78:6817","nonce":2532904479}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6818","nonce":2532904479},{"type":"v1","addr":"172.21.15.78:6819","nonce":2532904479}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6822","nonce":2532904479},{"type":"v1","addr":"172.21.15.78:6823","nonce":2532904479}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6820","nonce":2532904479},{"type":"v1","addr":"172.21.15.78:6821","nonce":2532904479}]},"public_addr":"172.21.15.78:6817/2532904479","cluster_addr":"172.21.15.78:6819/2532904479","heartbeat_back_addr":"172.21.15.78:6823/2532904479","heartbeat_front_addr":"172.21.15.78:6821/2532904479","state":["exists","up"]},{"osd":3,"uuid":"77acc9af-7d4d-4b18-8cf5-d62f5971b7c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6824","nonce":3442991267},{"type":"v1","addr":"172.21.15.78:6825","nonce":3442991267}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6826","nonce":3442991267},{"type":"v1","addr":"172.21.15.78:6827","nonce":3442991267}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6830","nonce":3442991267},{"type":"v1","addr":"172.21.15.78:6831","nonce":3442991267}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6828","nonce":3442991267},{"type":"v1","addr":"172.21.15.78:6829","nonce":3442991267}]},"public_addr":"172.21.15.78:6825/3442991267","cluster_addr":"172.21.15.78:6827/3442991267","heartbeat_back_addr":"172.21.15.78:6831/3442991267","heartbeat_front_addr":"172.21.15.78:6829/3442991267","state":["exists","up"]},{"osd":4,"uuid":"5c62bc66-6b34-4b7f-a66b-9a743969138c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":802983577},{"type":"v1","addr":"172.21.15.179:6809","nonce":802983577}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":802983577},{"type":"v1","addr":"172.21.15.179:6811","nonce":802983577}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":802983577},{"type":"v1","addr":"172.21.15.179:6815","nonce":802983577}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":802983577},{"type":"v1","addr":"172.21.15.179:6813","nonce":802983577}]},"public_addr":"172.21.15.179:6809/802983577","cluster_addr":"172.21.15.179:6811/802983577","heartbeat_back_addr":"172.21.15.179:6815/802983577","heartbeat_front_addr":"172.21.15.179:6813/802983577","state":["exists","up"]},{"osd":5,"uuid":"67db6d36-f684-4079-b0cd-82b4dd61461f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":518192887},{"type":"v1","addr":"172.21.15.179:6818","nonce":518192887}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":518192887},{"type":"v1","addr":"172.21.15.179:6822","nonce":518192887}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":518192887},{"type":"v1","addr":"172.21.15.179:6829","nonce":518192887}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6824","nonce":518192887},{"type":"v1","addr":"172.21.15.179:6826","nonce":518192887}]},"public_addr":"172.21.15.179:6818/518192887","cluster_addr":"172.21.15.179:6822/518192887","heartbeat_back_addr":"172.21.15.179:6829/518192887","heartbeat_front_addr":"172.21.15.179:6826/518192887","state":["exists","up"]},{"osd":6,"uuid":"12e670af-5a16-4c81-9f97-defa66cab967","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":815435378},{"type":"v1","addr":"172.21.15.179:6801","nonce":815435378}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":815435378},{"type":"v1","addr":"172.21.15.179:6803","nonce":815435378}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":815435378},{"type":"v1","addr":"172.21.15.179:6807","nonce":815435378}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":815435378},{"type":"v1","addr":"172.21.15.179:6805","nonce":815435378}]},"public_addr":"172.21.15.179:6801/815435378","cluster_addr":"172.21.15.179:6803/815435378","heartbeat_back_addr":"172.21.15.179:6807/815435378","heartbeat_front_addr":"172.21.15.179:6805/815435378","state":["exists","up"]},{"osd":7,"uuid":"fe630650-2eb3-49ad-8676-c341e6332eb1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6817","nonce":2848432339},{"type":"v1","addr":"172.21.15.179:6819","nonce":2848432339}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6821","nonce":2848432339},{"type":"v1","addr":"172.21.15.179:6823","nonce":2848432339}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":2848432339},{"type":"v1","addr":"172.21.15.179:6831","nonce":2848432339}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6825","nonce":2848432339},{"type":"v1","addr":"172.21.15.179:6827","nonce":2848432339}]},"public_addr":"172.21.15.179:6819/2848432339","cluster_addr":"172.21.15.179:6823/2848432339","heartbeat_back_addr":"172.21.15.179:6831/2848432339","heartbeat_front_addr":"172.21.15.179:6827/2848432339","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:58:49.255433+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:58:49.412880+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:58:49.559295+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:58:49.245237+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:58:49.184557+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:58:49.329851+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:58:49.366012+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:58:49.349604+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-28T19:59:12.100 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:12.096+0000 7f239af80640 1 -- 172.21.15.78:0/3849484255 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f2380066470 msgr2=0x7f2380068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:12.100 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:12.096+0000 7f239af80640 1 --2- 172.21.15.78:0/3849484255 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f2380066470 0x7f2380068930 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f2390007fd0 tx=0x7f2390007c20 comp rx=0 tx=0).stop 2023-11-28T19:59:12.101 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:12.096+0000 7f239af80640 1 -- 172.21.15.78:0/3849484255 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f23940c5300 msgr2=0x7f23941f0640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:12.101 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:12.096+0000 7f239af80640 1 --2- 172.21.15.78:0/3849484255 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f23940c5300 0x7f23941f0640 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f238c0af040 tx=0x7f238c019740 comp rx=0 tx=0).stop 2023-11-28T19:59:12.101 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:12.096+0000 7f239af80640 1 -- 172.21.15.78:0/3849484255 shutdown_connections 2023-11-28T19:59:12.101 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:12.096+0000 7f239af80640 1 --2- 172.21.15.78:0/3849484255 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f2380066470 0x7f2380068930 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:12.101 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:12.096+0000 7f239af80640 1 --2- 172.21.15.78:0/3849484255 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f23940c5300 0x7f23941f0640 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:12.101 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:12.096+0000 7f239af80640 1 --2- 172.21.15.78:0/3849484255 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f23940c3b80 0x7f239415e990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:12.101 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:12.096+0000 7f239af80640 1 --2- 172.21.15.78:0/3849484255 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f239406d2b0 0x7f239415e450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:12.101 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:12.096+0000 7f239af80640 1 -- 172.21.15.78:0/3849484255 >> 172.21.15.78:0/3849484255 conn(0x7f23940a7810 msgr2=0x7f23940bee90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T19:59:12.101 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:12.096+0000 7f239af80640 1 -- 172.21.15.78:0/3849484255 shutdown_connections 2023-11-28T19:59:12.102 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:12.096+0000 7f239af80640 1 -- 172.21.15.78:0/3849484255 wait complete. 2023-11-28T19:59:12.134 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-28T19:59:12.271 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:12.264+0000 7f73e3a32640 1 Processor -- start 2023-11-28T19:59:12.271 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:12.268+0000 7f73e3a32640 1 -- start start 2023-11-28T19:59:12.273 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:12.268+0000 7f73e3a32640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f73dc06c100 0x7f73dc15fe30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:12.273 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:12.268+0000 7f73e3a32640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f73dc0c4890 con 0x7f73dc0af4c0 2023-11-28T19:59:12.273 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:12.268+0000 7f73e3a32640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f73dc1553d0 con 0x7f73dc154f20 2023-11-28T19:59:12.273 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:12.268+0000 7f73e3a32640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f73dc0af8a0 con 0x7f73dc06c100 2023-11-28T19:59:12.273 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:12.268+0000 7f73e17ce640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f73dc0af4c0 0x7f73dc0c67d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:39562/0 (socket says 172.21.15.78:39562) 2023-11-28T19:59:12.274 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:12.268+0000 7f73e17ce640 1 -- 172.21.15.78:0/2006315508 learned_addr learned my addr 172.21.15.78:0/2006315508 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-11-28T19:59:12.274 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:12.268+0000 7f73e1fcf640 1 --2- 172.21.15.78:0/2006315508 >> v2:172.21.15.78:3300/0 conn(0x7f73dc06c100 0x7f73dc15fe30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:12.274 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:12.268+0000 7f73d3fff640 1 -- 172.21.15.78:0/2006315508 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3224765880 0 0) 0x7f73dc0c4890 con 0x7f73dc0af4c0 2023-11-28T19:59:12.274 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:12.268+0000 7f73d3fff640 1 -- 172.21.15.78:0/2006315508 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f73c8003530 con 0x7f73dc0af4c0 2023-11-28T19:59:12.274 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:12.268+0000 7f73e1fcf640 1 -- 172.21.15.78:0/2006315508 >> v1:172.21.15.179:6789/0 conn(0x7f73dc154f20 legacy=0x7f73dc06b9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:12.275 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:12.268+0000 7f73e1fcf640 1 -- 172.21.15.78:0/2006315508 >> v1:172.21.15.78:6789/0 conn(0x7f73dc0af4c0 legacy=0x7f73dc0c67d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:12.275 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:12.268+0000 7f73e1fcf640 1 -- 172.21.15.78:0/2006315508 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73dc0c4b30 con 0x7f73dc06c100 2023-11-28T19:59:12.276 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:12.272+0000 7f73e1fcf640 1 --2- 172.21.15.78:0/2006315508 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f73dc06c100 0x7f73dc15fe30 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f73d4009d90 tx=0x7f73d401c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8dc0b34a957656a server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:59:12.277 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:12.272+0000 7f73d3fff640 1 -- 172.21.15.78:0/2006315508 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73d40a5950 con 0x7f73dc06c100 2023-11-28T19:59:12.277 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:12.272+0000 7f73d3fff640 1 -- 172.21.15.78:0/2006315508 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f73d40a5ab0 con 0x7f73dc06c100 2023-11-28T19:59:12.277 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:12.272+0000 7f73d3fff640 1 -- 172.21.15.78:0/2006315508 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73d40a5e40 con 0x7f73dc06c100 2023-11-28T19:59:12.277 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:12.272+0000 7f73e3a32640 1 -- 172.21.15.78:0/2006315508 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f73dc06c100 msgr2=0x7f73dc15fe30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:12.277 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:12.272+0000 7f73e3a32640 1 --2- 172.21.15.78:0/2006315508 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f73dc06c100 0x7f73dc15fe30 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f73d4009d90 tx=0x7f73d401c890 comp rx=0 tx=0).stop 2023-11-28T19:59:12.277 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:12.272+0000 7f73e3a32640 1 -- 172.21.15.78:0/2006315508 shutdown_connections 2023-11-28T19:59:12.277 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:12.272+0000 7f73e3a32640 1 --2- 172.21.15.78:0/2006315508 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f73dc06c100 0x7f73dc15fe30 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:12.277 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:12.272+0000 7f73e3a32640 1 -- 172.21.15.78:0/2006315508 >> 172.21.15.78:0/2006315508 conn(0x7f73dc0ab9d0 msgr2=0x7f73dc0abde0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T19:59:12.277 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:12.272+0000 7f73e3a32640 1 -- 172.21.15.78:0/2006315508 shutdown_connections 2023-11-28T19:59:12.278 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:12.272+0000 7f73e3a32640 1 -- 172.21.15.78:0/2006315508 wait complete. 2023-11-28T19:59:12.278 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:12.272+0000 7f73e3a32640 1 Processor -- start 2023-11-28T19:59:12.278 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:12.272+0000 7f73e3a32640 1 -- start start 2023-11-28T19:59:12.280 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:12.276+0000 7f73e3a32640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f73dc06c100 0x7f73dc149090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:12.281 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:12.276+0000 7f73e3a32640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f73dc0af4c0 0x7f73dc144d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:12.281 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:12.276+0000 7f73e3a32640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f73dc154f20 0x7f73dc1470c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:12.281 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:12.276+0000 7f73e3a32640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73dc14b5f0 con 0x7f73dc154f20 2023-11-28T19:59:12.281 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:12.276+0000 7f73e3a32640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73dc145d70 con 0x7f73dc0af4c0 2023-11-28T19:59:12.281 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:12.276+0000 7f73e3a32640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f73dc146bd0 con 0x7f73dc06c100 2023-11-28T19:59:12.282 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:12.276+0000 7f73e1fcf640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f73dc154f20 0x7f73dc1470c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:12.282 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:12.276+0000 7f73e1fcf640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f73dc154f20 0x7f73dc1470c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:56928/0 (socket says 172.21.15.78:56928) 2023-11-28T19:59:12.282 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:12.276+0000 7f73e1fcf640 1 -- 172.21.15.78:0/1101985388 learned_addr learned my addr 172.21.15.78:0/1101985388 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T19:59:12.282 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:12.276+0000 7f73e17ce640 1 --2- 172.21.15.78:0/1101985388 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f73dc06c100 0x7f73dc149090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:12.282 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:12.276+0000 7f73e0fcd640 1 --2- 172.21.15.78:0/1101985388 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f73dc0af4c0 0x7f73dc144d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:12.282 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:12.276+0000 7f73e1fcf640 1 -- 172.21.15.78:0/1101985388 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f73dc06c100 msgr2=0x7f73dc149090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:12.283 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:12.276+0000 7f73e1fcf640 1 --2- 172.21.15.78:0/1101985388 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f73dc06c100 0x7f73dc149090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:12.283 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:12.276+0000 7f73e1fcf640 1 -- 172.21.15.78:0/1101985388 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f73dc0af4c0 msgr2=0x7f73dc144d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:12.283 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:12.276+0000 7f73e1fcf640 1 --2- 172.21.15.78:0/1101985388 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f73dc0af4c0 0x7f73dc144d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:12.283 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:12.276+0000 7f73e1fcf640 1 -- 172.21.15.78:0/1101985388 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73d4009a70 con 0x7f73dc154f20 2023-11-28T19:59:12.283 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:12.276+0000 7f73e1fcf640 1 --2- 172.21.15.78:0/1101985388 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f73dc154f20 0x7f73dc1470c0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f73d40b0040 tx=0x7f73d4019630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:59:12.283 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:12.276+0000 7f73d1ffb640 1 -- 172.21.15.78:0/1101985388 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73d40add90 con 0x7f73dc154f20 2023-11-28T19:59:12.283 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:12.276+0000 7f73d1ffb640 1 -- 172.21.15.78:0/1101985388 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f73d4009450 con 0x7f73dc154f20 2023-11-28T19:59:12.283 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:12.276+0000 7f73e3a32640 1 -- 172.21.15.78:0/1101985388 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f73dc145fc0 con 0x7f73dc154f20 2023-11-28T19:59:12.283 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:12.276+0000 7f73d1ffb640 1 -- 172.21.15.78:0/1101985388 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73d40b9690 con 0x7f73dc154f20 2023-11-28T19:59:12.283 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:12.276+0000 7f73e3a32640 1 -- 172.21.15.78:0/1101985388 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f73dc146580 con 0x7f73dc154f20 2023-11-28T19:59:12.284 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:12.276+0000 7f73e3a32640 1 -- 172.21.15.78:0/1101985388 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f73dc067630 con 0x7f73dc154f20 2023-11-28T19:59:12.284 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:12.276+0000 7f73d1ffb640 1 -- 172.21.15.78:0/1101985388 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f73d40b97f0 con 0x7f73dc154f20 2023-11-28T19:59:12.284 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:12.280+0000 7f73d1ffb640 1 --2- 172.21.15.78:0/1101985388 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f73c0066470 0x7f73c0068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:12.284 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:12.280+0000 7f73d1ffb640 1 -- 172.21.15.78:0/1101985388 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f73d411f9a0 con 0x7f73dc154f20 2023-11-28T19:59:12.285 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:12.280+0000 7f73e17ce640 1 --2- 172.21.15.78:0/1101985388 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f73c0066470 0x7f73c0068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:12.285 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:12.280+0000 7f73e17ce640 1 --2- 172.21.15.78:0/1101985388 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f73c0066470 0x7f73c0068930 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f73d80011f0 tx=0x7f73d8009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:59:12.287 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:12.284+0000 7f73d1ffb640 1 -- 172.21.15.78:0/1101985388 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f73d40ecc40 con 0x7f73dc154f20 2023-11-28T19:59:12.466 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:12.460+0000 7f73e3a32640 1 -- 172.21.15.78:0/1101985388 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f73dc06c7a0 con 0x7f73dc154f20 2023-11-28T19:59:12.467 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:12.460+0000 7f73d1ffb640 1 -- 172.21.15.78:0/1101985388 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+4915 (secure 0 0 0) 0x7f73d40f0260 con 0x7f73dc154f20 2023-11-28T19:59:12.467 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-11-28T19:59:12.467 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4241,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6835/3089461479","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6833","nonce":3089461479},{"type":"v1","addr":"172.21.15.179:6835","nonce":3089461479}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4258,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6837/3153162191","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6834","nonce":3153162191},{"type":"v1","addr":"172.21.15.78:6837","nonce":3153162191}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4266,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6836/3073967897","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6835","nonce":3073967897},{"type":"v1","addr":"172.21.15.78:6836","nonce":3073967897}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-28T19:59:05.411488+0000","modified":"2023-11-28T19:59:10.474793+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4275},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4275":{"gid":4275,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.179:6834/1234044491","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6832","nonce":1234044491},{"type":"v1","addr":"172.21.15.179:6834","nonce":1234044491}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2023-11-28T19:59:12.467 INFO:teuthology.orchestra.run.smithi078.stderr:dumped fsmap epoch 7 2023-11-28T19:59:12.468 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:12.464+0000 7f73e3a32640 1 -- 172.21.15.78:0/1101985388 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f73c0066470 msgr2=0x7f73c0068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:12.469 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:12.464+0000 7f73e3a32640 1 --2- 172.21.15.78:0/1101985388 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f73c0066470 0x7f73c0068930 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f73d80011f0 tx=0x7f73d8009040 comp rx=0 tx=0).stop 2023-11-28T19:59:12.469 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:12.464+0000 7f73e3a32640 1 -- 172.21.15.78:0/1101985388 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f73dc154f20 msgr2=0x7f73dc1470c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:12.469 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:12.464+0000 7f73e3a32640 1 --2- 172.21.15.78:0/1101985388 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f73dc154f20 0x7f73dc1470c0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f73d40b0040 tx=0x7f73d4019630 comp rx=0 tx=0).stop 2023-11-28T19:59:12.469 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:12.464+0000 7f73e3a32640 1 -- 172.21.15.78:0/1101985388 shutdown_connections 2023-11-28T19:59:12.469 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:12.464+0000 7f73e3a32640 1 --2- 172.21.15.78:0/1101985388 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f73c0066470 0x7f73c0068930 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:12.469 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:12.464+0000 7f73e3a32640 1 --2- 172.21.15.78:0/1101985388 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f73dc154f20 0x7f73dc1470c0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:12.469 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:12.464+0000 7f73e3a32640 1 --2- 172.21.15.78:0/1101985388 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f73dc0af4c0 0x7f73dc144d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:12.469 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:12.464+0000 7f73e3a32640 1 --2- 172.21.15.78:0/1101985388 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f73dc06c100 0x7f73dc149090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:12.469 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:12.464+0000 7f73e3a32640 1 -- 172.21.15.78:0/1101985388 >> 172.21.15.78:0/1101985388 conn(0x7f73dc0ab9d0 msgr2=0x7f73dc0733c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T19:59:12.469 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:12.464+0000 7f73e3a32640 1 -- 172.21.15.78:0/1101985388 shutdown_connections 2023-11-28T19:59:12.469 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:12.464+0000 7f73e3a32640 1 -- 172.21.15.78:0/1101985388 wait complete. 2023-11-28T19:59:12.488 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-28T19:59:12.624 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:12.620+0000 7fa9bf557640 1 Processor -- start 2023-11-28T19:59:12.624 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:12.620+0000 7fa9bf557640 1 -- start start 2023-11-28T19:59:12.626 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:12.620+0000 7fa9bf557640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fa9b8154f20 0x7fa9b806b9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:12.626 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:12.620+0000 7fa9bf557640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fa9b806bf30 0x7fa9b815ee20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:12.627 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:12.620+0000 7fa9bf557640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa9b80c4890 con 0x7fa9b80af4c0 2023-11-28T19:59:12.627 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:12.620+0000 7fa9bf557640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa9b81553d0 con 0x7fa9b806bf30 2023-11-28T19:59:12.627 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:12.620+0000 7fa9bf557640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa9b806c340 con 0x7fa9b8154f20 2023-11-28T19:59:12.627 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:12.620+0000 7fa9bd2f3640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7fa9b80af4c0 0x7fa9b80c67d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:39564/0 (socket says 172.21.15.78:39564) 2023-11-28T19:59:12.627 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:12.620+0000 7fa9bd2f3640 1 -- 172.21.15.78:0/3429519605 learned_addr learned my addr 172.21.15.78:0/3429519605 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-11-28T19:59:12.627 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:12.620+0000 7fa9bdaf4640 1 --2- 172.21.15.78:0/3429519605 >> v2:172.21.15.78:3300/0 conn(0x7fa9b806bf30 0x7fa9b815ee20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:12.628 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:12.620+0000 7fa9bcaf2640 1 --2- 172.21.15.78:0/3429519605 >> v2:172.21.15.179:3300/0 conn(0x7fa9b8154f20 0x7fa9b806b9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:12.628 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:12.620+0000 7fa9affff640 1 -- 172.21.15.78:0/3429519605 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1349146718 0 0) 0x7fa9b80c4890 con 0x7fa9b80af4c0 2023-11-28T19:59:12.628 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:12.620+0000 7fa9affff640 1 -- 172.21.15.78:0/3429519605 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa9a4003530 con 0x7fa9b80af4c0 2023-11-28T19:59:12.628 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:12.620+0000 7fa9bdaf4640 1 -- 172.21.15.78:0/3429519605 >> v2:172.21.15.179:3300/0 conn(0x7fa9b8154f20 msgr2=0x7fa9b806b9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T19:59:12.628 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:12.620+0000 7fa9bdaf4640 1 --2- 172.21.15.78:0/3429519605 >> v2:172.21.15.179:3300/0 conn(0x7fa9b8154f20 0x7fa9b806b9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:12.629 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:12.620+0000 7fa9bdaf4640 1 -- 172.21.15.78:0/3429519605 >> v1:172.21.15.78:6789/0 conn(0x7fa9b80af4c0 legacy=0x7fa9b80c67d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:12.629 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:12.620+0000 7fa9bdaf4640 1 -- 172.21.15.78:0/3429519605 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9b80af8a0 con 0x7fa9b806bf30 2023-11-28T19:59:12.630 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:12.624+0000 7fa9bdaf4640 1 --2- 172.21.15.78:0/3429519605 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa9b806bf30 0x7fa9b815ee20 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fa9b80c7290 tx=0x7fa9b001c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d08d402a90adb232 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:59:12.630 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:12.624+0000 7fa9affff640 1 -- 172.21.15.78:0/3429519605 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9b00a5910 con 0x7fa9b806bf30 2023-11-28T19:59:12.630 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:12.624+0000 7fa9affff640 1 -- 172.21.15.78:0/3429519605 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa9b00a5a70 con 0x7fa9b806bf30 2023-11-28T19:59:12.631 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:12.624+0000 7fa9affff640 1 -- 172.21.15.78:0/3429519605 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9b00a5e00 con 0x7fa9b806bf30 2023-11-28T19:59:12.631 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:12.624+0000 7fa9bf557640 1 -- 172.21.15.78:0/3429519605 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa9b806bf30 msgr2=0x7fa9b815ee20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:12.631 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:12.624+0000 7fa9bf557640 1 --2- 172.21.15.78:0/3429519605 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa9b806bf30 0x7fa9b815ee20 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fa9b80c7290 tx=0x7fa9b001c850 comp rx=0 tx=0).stop 2023-11-28T19:59:12.631 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:12.624+0000 7fa9bf557640 1 -- 172.21.15.78:0/3429519605 shutdown_connections 2023-11-28T19:59:12.631 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:12.624+0000 7fa9bf557640 1 --2- 172.21.15.78:0/3429519605 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa9b806bf30 0x7fa9b815ee20 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:12.631 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:12.624+0000 7fa9bf557640 1 --2- 172.21.15.78:0/3429519605 >> v2:172.21.15.179:3300/0 conn(0x7fa9b8154f20 0x7fa9b806b9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:12.632 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:12.624+0000 7fa9bf557640 1 -- 172.21.15.78:0/3429519605 >> 172.21.15.78:0/3429519605 conn(0x7fa9b80ab9d0 msgr2=0x7fa9b80abde0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T19:59:12.632 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:12.624+0000 7fa9bf557640 1 -- 172.21.15.78:0/3429519605 shutdown_connections 2023-11-28T19:59:12.632 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:12.624+0000 7fa9bf557640 1 -- 172.21.15.78:0/3429519605 wait complete. 2023-11-28T19:59:12.634 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:12.628+0000 7fa9bf557640 1 Processor -- start 2023-11-28T19:59:12.635 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:12.628+0000 7fa9bf557640 1 -- start start 2023-11-28T19:59:12.635 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:12.628+0000 7fa9bf557640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa9b806bf30 0x7fa9b814db90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:12.635 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:12.628+0000 7fa9bf557640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa9b80af4c0 0x7fa9b8149020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:12.635 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:12.628+0000 7fa9bf557640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa9b8154f20 0x7fa9b80c7bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:12.635 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:12.628+0000 7fa9bf557640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9b814e0d0 con 0x7fa9b8154f20 2023-11-28T19:59:12.635 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:12.628+0000 7fa9bf557640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9b80c99a0 con 0x7fa9b806bf30 2023-11-28T19:59:12.636 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:12.628+0000 7fa9bf557640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa9b814d4c0 con 0x7fa9b80af4c0 2023-11-28T19:59:12.636 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:12.628+0000 7fa9bdaf4640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa9b8154f20 0x7fa9b80c7bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:12.636 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:12.628+0000 7fa9bdaf4640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa9b8154f20 0x7fa9b80c7bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:56948/0 (socket says 172.21.15.78:56948) 2023-11-28T19:59:12.636 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:12.628+0000 7fa9bdaf4640 1 -- 172.21.15.78:0/2239705668 learned_addr learned my addr 172.21.15.78:0/2239705668 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T19:59:12.636 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:12.628+0000 7fa9bdaf4640 1 -- 172.21.15.78:0/2239705668 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa9b80af4c0 msgr2=0x7fa9b8149020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:12.636 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:12.628+0000 7fa9bdaf4640 1 --2- 172.21.15.78:0/2239705668 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa9b80af4c0 0x7fa9b8149020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:12.637 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:12.628+0000 7fa9bdaf4640 1 -- 172.21.15.78:0/2239705668 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa9b806bf30 msgr2=0x7fa9b814db90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:12.637 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:12.628+0000 7fa9bdaf4640 1 --2- 172.21.15.78:0/2239705668 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa9b806bf30 0x7fa9b814db90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:12.637 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:12.628+0000 7fa9bdaf4640 1 -- 172.21.15.78:0/2239705668 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9b0009a70 con 0x7fa9b8154f20 2023-11-28T19:59:12.637 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:12.628+0000 7fa9bdaf4640 1 --2- 172.21.15.78:0/2239705668 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa9b8154f20 0x7fa9b80c7bc0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fa9b001a480 tx=0x7fa9b00195f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:59:12.637 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:12.628+0000 7fa9adffb640 1 -- 172.21.15.78:0/2239705668 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9b00b9860 con 0x7fa9b8154f20 2023-11-28T19:59:12.637 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:12.628+0000 7fa9adffb640 1 -- 172.21.15.78:0/2239705668 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa9b00b99c0 con 0x7fa9b8154f20 2023-11-28T19:59:12.638 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:12.628+0000 7fa9adffb640 1 -- 172.21.15.78:0/2239705668 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9b00b9d50 con 0x7fa9b8154f20 2023-11-28T19:59:12.638 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:12.628+0000 7fa9bf557640 1 -- 172.21.15.78:0/2239705668 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa9b80c93e0 con 0x7fa9b8154f20 2023-11-28T19:59:12.638 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:12.628+0000 7fa9bf557640 1 -- 172.21.15.78:0/2239705668 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa9b8149560 con 0x7fa9b8154f20 2023-11-28T19:59:12.638 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:12.628+0000 7fa9bf557640 1 -- 172.21.15.78:0/2239705668 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa9b80a9c90 con 0x7fa9b8154f20 2023-11-28T19:59:12.639 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:12.632+0000 7fa9adffb640 1 -- 172.21.15.78:0/2239705668 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fa9b00ad440 con 0x7fa9b8154f20 2023-11-28T19:59:12.639 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:12.632+0000 7fa9adffb640 1 --2- 172.21.15.78:0/2239705668 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fa99c066470 0x7fa99c068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:12.639 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:12.632+0000 7fa9adffb640 1 -- 172.21.15.78:0/2239705668 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fa9b011f420 con 0x7fa9b8154f20 2023-11-28T19:59:12.640 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:12.632+0000 7fa9bd2f3640 1 --2- 172.21.15.78:0/2239705668 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fa99c066470 0x7fa99c068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:12.640 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:12.632+0000 7fa9bd2f3640 1 --2- 172.21.15.78:0/2239705668 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fa99c066470 0x7fa99c068930 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fa9b4007fd0 tx=0x7fa9b4007940 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:59:12.641 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:12.636+0000 7fa9adffb640 1 -- 172.21.15.78:0/2239705668 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fa9b00ec5a0 con 0x7fa9b8154f20 2023-11-28T19:59:12.790 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:12.784+0000 7fa9bf557640 1 -- 172.21.15.78:0/2239705668 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa9b8067630 con 0x7fa9b8154f20 2023-11-28T19:59:12.792 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:12.788+0000 7fa9adffb640 1 -- 172.21.15.78:0/2239705668 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+18322 (secure 0 0 0) 0x7fa9b00efbc0 con 0x7fa9b8154f20 2023-11-28T19:59:12.792 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-11-28T19:59:12.792 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":25,"fsid":"dd9780e8-3bda-44fa-a9f0-fa07d19d901d","created":"2023-11-28T19:58:40.969556+0000","modified":"2023-11-28T19:59:10.474525+0000","last_up_change":"2023-11-28T19:58:52.596716+0000","last_in_change":"2023-11-28T19:58:43.609275+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-28T19:58:54.011229+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-28T19:59:03.945559+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-28T19:59:04.481478+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-11-28T19:59:08.109152+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"e84245ac-b5da-429e-af18-39acaa2b33e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6800","nonce":3358701235},{"type":"v1","addr":"172.21.15.78:6801","nonce":3358701235}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6802","nonce":3358701235},{"type":"v1","addr":"172.21.15.78:6803","nonce":3358701235}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6806","nonce":3358701235},{"type":"v1","addr":"172.21.15.78:6807","nonce":3358701235}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6804","nonce":3358701235},{"type":"v1","addr":"172.21.15.78:6805","nonce":3358701235}]},"public_addr":"172.21.15.78:6801/3358701235","cluster_addr":"172.21.15.78:6803/3358701235","heartbeat_back_addr":"172.21.15.78:6807/3358701235","heartbeat_front_addr":"172.21.15.78:6805/3358701235","state":["exists","up"]},{"osd":1,"uuid":"e634831d-c4e2-48d9-870c-9556ae162981","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6808","nonce":3211476654},{"type":"v1","addr":"172.21.15.78:6809","nonce":3211476654}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6810","nonce":3211476654},{"type":"v1","addr":"172.21.15.78:6811","nonce":3211476654}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6814","nonce":3211476654},{"type":"v1","addr":"172.21.15.78:6815","nonce":3211476654}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6812","nonce":3211476654},{"type":"v1","addr":"172.21.15.78:6813","nonce":3211476654}]},"public_addr":"172.21.15.78:6809/3211476654","cluster_addr":"172.21.15.78:6811/3211476654","heartbeat_back_addr":"172.21.15.78:6815/3211476654","heartbeat_front_addr":"172.21.15.78:6813/3211476654","state":["exists","up"]},{"osd":2,"uuid":"274c8395-6534-41f0-b8fb-a00af8985aa8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6816","nonce":2532904479},{"type":"v1","addr":"172.21.15.78:6817","nonce":2532904479}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6818","nonce":2532904479},{"type":"v1","addr":"172.21.15.78:6819","nonce":2532904479}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6822","nonce":2532904479},{"type":"v1","addr":"172.21.15.78:6823","nonce":2532904479}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6820","nonce":2532904479},{"type":"v1","addr":"172.21.15.78:6821","nonce":2532904479}]},"public_addr":"172.21.15.78:6817/2532904479","cluster_addr":"172.21.15.78:6819/2532904479","heartbeat_back_addr":"172.21.15.78:6823/2532904479","heartbeat_front_addr":"172.21.15.78:6821/2532904479","state":["exists","up"]},{"osd":3,"uuid":"77acc9af-7d4d-4b18-8cf5-d62f5971b7c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6824","nonce":3442991267},{"type":"v1","addr":"172.21.15.78:6825","nonce":3442991267}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6826","nonce":3442991267},{"type":"v1","addr":"172.21.15.78:6827","nonce":3442991267}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6830","nonce":3442991267},{"type":"v1","addr":"172.21.15.78:6831","nonce":3442991267}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6828","nonce":3442991267},{"type":"v1","addr":"172.21.15.78:6829","nonce":3442991267}]},"public_addr":"172.21.15.78:6825/3442991267","cluster_addr":"172.21.15.78:6827/3442991267","heartbeat_back_addr":"172.21.15.78:6831/3442991267","heartbeat_front_addr":"172.21.15.78:6829/3442991267","state":["exists","up"]},{"osd":4,"uuid":"5c62bc66-6b34-4b7f-a66b-9a743969138c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":802983577},{"type":"v1","addr":"172.21.15.179:6809","nonce":802983577}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":802983577},{"type":"v1","addr":"172.21.15.179:6811","nonce":802983577}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":802983577},{"type":"v1","addr":"172.21.15.179:6815","nonce":802983577}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":802983577},{"type":"v1","addr":"172.21.15.179:6813","nonce":802983577}]},"public_addr":"172.21.15.179:6809/802983577","cluster_addr":"172.21.15.179:6811/802983577","heartbeat_back_addr":"172.21.15.179:6815/802983577","heartbeat_front_addr":"172.21.15.179:6813/802983577","state":["exists","up"]},{"osd":5,"uuid":"67db6d36-f684-4079-b0cd-82b4dd61461f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":518192887},{"type":"v1","addr":"172.21.15.179:6818","nonce":518192887}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":518192887},{"type":"v1","addr":"172.21.15.179:6822","nonce":518192887}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":518192887},{"type":"v1","addr":"172.21.15.179:6829","nonce":518192887}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6824","nonce":518192887},{"type":"v1","addr":"172.21.15.179:6826","nonce":518192887}]},"public_addr":"172.21.15.179:6818/518192887","cluster_addr":"172.21.15.179:6822/518192887","heartbeat_back_addr":"172.21.15.179:6829/518192887","heartbeat_front_addr":"172.21.15.179:6826/518192887","state":["exists","up"]},{"osd":6,"uuid":"12e670af-5a16-4c81-9f97-defa66cab967","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":815435378},{"type":"v1","addr":"172.21.15.179:6801","nonce":815435378}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":815435378},{"type":"v1","addr":"172.21.15.179:6803","nonce":815435378}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":815435378},{"type":"v1","addr":"172.21.15.179:6807","nonce":815435378}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":815435378},{"type":"v1","addr":"172.21.15.179:6805","nonce":815435378}]},"public_addr":"172.21.15.179:6801/815435378","cluster_addr":"172.21.15.179:6803/815435378","heartbeat_back_addr":"172.21.15.179:6807/815435378","heartbeat_front_addr":"172.21.15.179:6805/815435378","state":["exists","up"]},{"osd":7,"uuid":"fe630650-2eb3-49ad-8676-c341e6332eb1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6817","nonce":2848432339},{"type":"v1","addr":"172.21.15.179:6819","nonce":2848432339}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6821","nonce":2848432339},{"type":"v1","addr":"172.21.15.179:6823","nonce":2848432339}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":2848432339},{"type":"v1","addr":"172.21.15.179:6831","nonce":2848432339}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6825","nonce":2848432339},{"type":"v1","addr":"172.21.15.179:6827","nonce":2848432339}]},"public_addr":"172.21.15.179:6819/2848432339","cluster_addr":"172.21.15.179:6823/2848432339","heartbeat_back_addr":"172.21.15.179:6831/2848432339","heartbeat_front_addr":"172.21.15.179:6827/2848432339","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:58:49.255433+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:58:49.412880+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:58:49.559295+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:58:49.245237+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:58:49.184557+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:58:49.329851+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:58:49.366012+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:58:49.349604+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-28T19:59:12.794 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:12.788+0000 7fa9bf557640 1 -- 172.21.15.78:0/2239705668 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fa99c066470 msgr2=0x7fa99c068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:12.794 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:12.788+0000 7fa9bf557640 1 --2- 172.21.15.78:0/2239705668 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fa99c066470 0x7fa99c068930 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fa9b4007fd0 tx=0x7fa9b4007940 comp rx=0 tx=0).stop 2023-11-28T19:59:12.795 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:12.788+0000 7fa9bf557640 1 -- 172.21.15.78:0/2239705668 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa9b8154f20 msgr2=0x7fa9b80c7bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:12.795 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:12.788+0000 7fa9bf557640 1 --2- 172.21.15.78:0/2239705668 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa9b8154f20 0x7fa9b80c7bc0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fa9b001a480 tx=0x7fa9b00195f0 comp rx=0 tx=0).stop 2023-11-28T19:59:12.795 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:12.788+0000 7fa9bf557640 1 -- 172.21.15.78:0/2239705668 shutdown_connections 2023-11-28T19:59:12.795 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:12.788+0000 7fa9bf557640 1 --2- 172.21.15.78:0/2239705668 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fa99c066470 0x7fa99c068930 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:12.795 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:12.788+0000 7fa9bf557640 1 --2- 172.21.15.78:0/2239705668 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa9b80af4c0 0x7fa9b8149020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:12.795 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:12.788+0000 7fa9bf557640 1 --2- 172.21.15.78:0/2239705668 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa9b8154f20 0x7fa9b80c7bc0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:12.796 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:12.788+0000 7fa9bf557640 1 --2- 172.21.15.78:0/2239705668 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa9b806bf30 0x7fa9b814db90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:12.796 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:12.788+0000 7fa9bf557640 1 -- 172.21.15.78:0/2239705668 >> 172.21.15.78:0/2239705668 conn(0x7fa9b80ab9d0 msgr2=0x7fa9b8149c10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T19:59:12.796 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:12.788+0000 7fa9bf557640 1 -- 172.21.15.78:0/2239705668 shutdown_connections 2023-11-28T19:59:12.796 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:12.788+0000 7fa9bf557640 1 -- 172.21.15.78:0/2239705668 wait complete. 2023-11-28T19:59:13.217 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 7, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-11-28T19:59:05.411488+0000', 'modified': '2023-11-28T19:59:10.474793+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4275}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4275': {'gid': 4275, 'name': 'b', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.179:6834/1234044491', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.179:6832', 'nonce': 1234044491}, {'type': 'v1', 'addr': '172.21.15.179:6834', 'nonce': 1234044491}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 1} 2023-11-28T19:59:13.217 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-11-28T19:59:13.217 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2023-11-28T19:59:13.356 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:13.352+0000 7f8220a9c640 1 Processor -- start 2023-11-28T19:59:13.356 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:13.352+0000 7f8220a9c640 1 -- start start 2023-11-28T19:59:13.357 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:13.352+0000 7f8220a9c640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f821c0c47b0 0x7f821c0c4b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:13.358 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:13.352+0000 7f8220a9c640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f821c155950 0x7f821c1582f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:13.358 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:13.352+0000 7f8220a9c640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f821c0c6840 con 0x7f821c0bd550 2023-11-28T19:59:13.358 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:13.352+0000 7f8220a9c640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f821c0af870 con 0x7f821c155950 2023-11-28T19:59:13.358 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:13.352+0000 7f8220a9c640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f821c155d80 con 0x7f821c0c47b0 2023-11-28T19:59:13.358 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:13.352+0000 7f821ad9d640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f821c155950 0x7f821c1582f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:13.358 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:13.352+0000 7f821ad9d640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f821c155950 0x7f821c1582f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:56950/0 (socket says 172.21.15.78:56950) 2023-11-28T19:59:13.358 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:13.352+0000 7f821ad9d640 1 -- 172.21.15.78:0/1421645484 learned_addr learned my addr 172.21.15.78:0/1421645484 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T19:59:13.358 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:13.352+0000 7f821a59c640 1 --2- 172.21.15.78:0/1421645484 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f821c0c47b0 0x7f821c0c4b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:13.358 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:13.352+0000 7f821ad9d640 1 -- 172.21.15.78:0/1421645484 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f821c0c47b0 msgr2=0x7f821c0c4b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T19:59:13.358 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:13.352+0000 7f821ad9d640 1 --2- 172.21.15.78:0/1421645484 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f821c0c47b0 0x7f821c0c4b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:13.359 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:13.352+0000 7f821ad9d640 1 -- 172.21.15.78:0/1421645484 >> v1:172.21.15.179:6789/0 conn(0x7f821c0bd550 legacy=0x7f821c154ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:13.359 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:13.352+0000 7f821ad9d640 1 -- 172.21.15.78:0/1421645484 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f821c0c6a70 con 0x7f821c155950 2023-11-28T19:59:13.360 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:13.356+0000 7f821ad9d640 1 --2- 172.21.15.78:0/1421645484 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f821c155950 0x7f821c1582f0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f8214009e50 tx=0x7f821401c980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=35b495ed6eec998a server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:59:13.361 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:13.356+0000 7f8219d9b640 1 -- 172.21.15.78:0/1421645484 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82140a5730 con 0x7f821c155950 2023-11-28T19:59:13.361 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:13.356+0000 7f8219d9b640 1 -- 172.21.15.78:0/1421645484 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f82140a5890 con 0x7f821c155950 2023-11-28T19:59:13.361 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:13.356+0000 7f8219d9b640 1 -- 172.21.15.78:0/1421645484 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82140a5c20 con 0x7f821c155950 2023-11-28T19:59:13.362 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:13.356+0000 7f8220a9c640 1 -- 172.21.15.78:0/1421645484 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f821c155950 msgr2=0x7f821c1582f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:13.362 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:13.356+0000 7f8220a9c640 1 --2- 172.21.15.78:0/1421645484 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f821c155950 0x7f821c1582f0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f8214009e50 tx=0x7f821401c980 comp rx=0 tx=0).stop 2023-11-28T19:59:13.362 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:13.356+0000 7f8220a9c640 1 -- 172.21.15.78:0/1421645484 shutdown_connections 2023-11-28T19:59:13.362 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:13.356+0000 7f8220a9c640 1 --2- 172.21.15.78:0/1421645484 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f821c155950 0x7f821c1582f0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:13.362 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:13.356+0000 7f8220a9c640 1 --2- 172.21.15.78:0/1421645484 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f821c0c47b0 0x7f821c0c4b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:13.362 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:13.356+0000 7f8220a9c640 1 -- 172.21.15.78:0/1421645484 >> 172.21.15.78:0/1421645484 conn(0x7f821c0aba00 msgr2=0x7f821c0abe10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T19:59:13.362 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:13.356+0000 7f8220a9c640 1 -- 172.21.15.78:0/1421645484 shutdown_connections 2023-11-28T19:59:13.362 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:13.356+0000 7f8220a9c640 1 -- 172.21.15.78:0/1421645484 wait complete. 2023-11-28T19:59:13.364 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:13.360+0000 7f8220a9c640 1 Processor -- start 2023-11-28T19:59:13.364 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:13.360+0000 7f8220a9c640 1 -- start start 2023-11-28T19:59:13.365 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:13.360+0000 7f8220a9c640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f821c0bd550 0x7f821c146e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:13.365 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:13.360+0000 7f8220a9c640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f821c0c47b0 0x7f821c0a9870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:13.365 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:13.360+0000 7f8220a9c640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f821c155950 0x7f821c14d650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:13.366 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:13.360+0000 7f8220a9c640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f821c14d1c0 con 0x7f821c0bd550 2023-11-28T19:59:13.366 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:13.360+0000 7f8220a9c640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f821c14efa0 con 0x7f821c0c47b0 2023-11-28T19:59:13.366 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:13.360+0000 7f8220a9c640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f821c147360 con 0x7f821c155950 2023-11-28T19:59:13.366 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:13.360+0000 7f821a59c640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f821c0bd550 0x7f821c146e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:13.366 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:13.360+0000 7f821a59c640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f821c0bd550 0x7f821c146e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:56964/0 (socket says 172.21.15.78:56964) 2023-11-28T19:59:13.366 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:13.360+0000 7f821a59c640 1 -- 172.21.15.78:0/3116647370 learned_addr learned my addr 172.21.15.78:0/3116647370 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T19:59:13.366 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:13.360+0000 7f821ad9d640 1 --2- 172.21.15.78:0/3116647370 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f821c155950 0x7f821c14d650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:13.366 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:13.360+0000 7f8211d9b640 1 --2- 172.21.15.78:0/3116647370 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f821c0c47b0 0x7f821c0a9870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:13.366 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:13.360+0000 7f821a59c640 1 -- 172.21.15.78:0/3116647370 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f821c155950 msgr2=0x7f821c14d650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:13.366 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:13.360+0000 7f821a59c640 1 --2- 172.21.15.78:0/3116647370 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f821c155950 0x7f821c14d650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:13.366 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:13.360+0000 7f821a59c640 1 -- 172.21.15.78:0/3116647370 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f821c0c47b0 msgr2=0x7f821c0a9870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:13.366 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:13.360+0000 7f821a59c640 1 --2- 172.21.15.78:0/3116647370 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f821c0c47b0 0x7f821c0a9870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:13.367 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:13.360+0000 7f821a59c640 1 -- 172.21.15.78:0/3116647370 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8214009b30 con 0x7f821c0bd550 2023-11-28T19:59:13.367 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:13.360+0000 7f8211d9b640 1 --2- 172.21.15.78:0/3116647370 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f821c0c47b0 0x7f821c0a9870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T19:59:13.367 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:13.360+0000 7f821a59c640 1 --2- 172.21.15.78:0/3116647370 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f821c0bd550 0x7f821c146e20 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f820c00e8a0 tx=0x7f820c00eca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:59:13.367 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:13.360+0000 7f82137fe640 1 -- 172.21.15.78:0/3116647370 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f820c009510 con 0x7f821c0bd550 2023-11-28T19:59:13.367 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:13.360+0000 7f82137fe640 1 -- 172.21.15.78:0/3116647370 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f820c00c940 con 0x7f821c0bd550 2023-11-28T19:59:13.368 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:13.360+0000 7f82137fe640 1 -- 172.21.15.78:0/3116647370 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f820c00ccb0 con 0x7f821c0bd550 2023-11-28T19:59:13.368 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:13.360+0000 7f8220a9c640 1 -- 172.21.15.78:0/3116647370 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f821c153350 con 0x7f821c0bd550 2023-11-28T19:59:13.368 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:13.360+0000 7f8220a9c640 1 -- 172.21.15.78:0/3116647370 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f821c153910 con 0x7f821c0bd550 2023-11-28T19:59:13.368 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:13.364+0000 7f82137fe640 1 -- 172.21.15.78:0/3116647370 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f820c013470 con 0x7f821c0bd550 2023-11-28T19:59:13.369 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:13.364+0000 7f82137fe640 1 --2- 172.21.15.78:0/3116647370 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f81fc066470 0x7f81fc068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:13.369 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:13.364+0000 7f82137fe640 1 -- 172.21.15.78:0/3116647370 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f820c0841f0 con 0x7f821c0bd550 2023-11-28T19:59:13.369 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:13.364+0000 7f8211d9b640 1 --2- 172.21.15.78:0/3116647370 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f81fc066470 0x7f81fc068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:13.369 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:13.364+0000 7f8223e14000 1 Processor -- start 2023-11-28T19:59:13.370 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:13.364+0000 7f8211d9b640 1 --2- 172.21.15.78:0/3116647370 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f81fc066470 0x7f81fc068930 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f821c0c59f0 tx=0x7f8204009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:59:13.370 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:13.364+0000 7f8223e14000 1 -- start start 2023-11-28T19:59:13.370 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:13.368+0000 7f8223e14000 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55b018eb22e0 0x55b018eb26c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:13.371 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:13.368+0000 7f8223e14000 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55b018eb2c00 0x55b018eb2fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:13.371 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:13.368+0000 7f8223e14000 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55b018eb3520 0x55b018efca30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:13.371 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:13.368+0000 7f8223e14000 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b018d1f130 con 0x55b018eb2c00 2023-11-28T19:59:13.371 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:13.368+0000 7f8223e14000 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b018d0c9a0 con 0x55b018eb3520 2023-11-28T19:59:13.371 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:13.368+0000 7f8223e14000 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x55b018d09ed0 con 0x55b018eb22e0 2023-11-28T19:59:13.373 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:13.368+0000 7f8211d9b640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55b018eb2c00 0x55b018eb2fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:13.373 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:13.368+0000 7f8211d9b640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55b018eb2c00 0x55b018eb2fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:56966/0 (socket says 172.21.15.78:56966) 2023-11-28T19:59:13.373 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:13.368+0000 7f8211d9b640 1 -- 172.21.15.78:0/110305792 learned_addr learned my addr 172.21.15.78:0/110305792 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T19:59:13.373 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:13.368+0000 7f821ad9d640 1 --2- 172.21.15.78:0/110305792 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55b018eb3520 0x55b018efca30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:13.373 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:13.368+0000 7f821a59c640 1 --2- 172.21.15.78:0/110305792 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55b018eb22e0 0x55b018eb26c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:13.373 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:13.368+0000 7f8211d9b640 1 -- 172.21.15.78:0/110305792 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55b018eb22e0 msgr2=0x55b018eb26c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T19:59:13.373 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:13.368+0000 7f8211d9b640 1 --2- 172.21.15.78:0/110305792 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55b018eb22e0 0x55b018eb26c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:13.373 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:13.368+0000 7f8211d9b640 1 -- 172.21.15.78:0/110305792 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55b018eb3520 msgr2=0x55b018efca30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T19:59:13.373 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:13.368+0000 7f8211d9b640 1 --2- 172.21.15.78:0/110305792 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55b018eb3520 0x55b018efca30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:13.373 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:13.368+0000 7f8211d9b640 1 -- 172.21.15.78:0/110305792 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b0189fd890 con 0x55b018eb2c00 2023-11-28T19:59:13.374 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:13.368+0000 7f821ad9d640 1 --2- 172.21.15.78:0/110305792 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55b018eb3520 0x55b018efca30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T19:59:13.374 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:13.368+0000 7f8211d9b640 1 --2- 172.21.15.78:0/110305792 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55b018eb2c00 0x55b018eb2fe0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f8204001da0 tx=0x7f8204011000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eb49bd463f2f4bb7 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:59:13.374 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:13.368+0000 7f81fbfff640 1 -- 172.21.15.78:0/110305792 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8204003600 con 0x55b018eb2c00 2023-11-28T19:59:13.374 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:13.368+0000 7f81fbfff640 1 -- 172.21.15.78:0/110305792 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8204003760 con 0x55b018eb2c00 2023-11-28T19:59:13.374 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:13.368+0000 7f81fbfff640 1 -- 172.21.15.78:0/110305792 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8204003ad0 con 0x55b018eb2c00 2023-11-28T19:59:13.374 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:13.368+0000 7f8223e14000 1 -- 172.21.15.78:0/110305792 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55b018eb2c00 msgr2=0x55b018eb2fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:13.374 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:13.368+0000 7f8223e14000 1 --2- 172.21.15.78:0/110305792 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55b018eb2c00 0x55b018eb2fe0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f8204001da0 tx=0x7f8204011000 comp rx=0 tx=0).stop 2023-11-28T19:59:13.374 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:13.368+0000 7f8223e14000 1 -- 172.21.15.78:0/110305792 shutdown_connections 2023-11-28T19:59:13.374 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:13.368+0000 7f8223e14000 1 --2- 172.21.15.78:0/110305792 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55b018eb3520 0x55b018efca30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:13.374 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:13.368+0000 7f8223e14000 1 --2- 172.21.15.78:0/110305792 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55b018eb2c00 0x55b018eb2fe0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:13.374 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:13.368+0000 7f8223e14000 1 --2- 172.21.15.78:0/110305792 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55b018eb22e0 0x55b018eb26c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:13.374 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:13.368+0000 7f8223e14000 1 -- 172.21.15.78:0/110305792 >> 172.21.15.78:0/110305792 conn(0x55b018ebb190 msgr2=0x55b018ef27a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T19:59:13.375 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:13.368+0000 7f8223e14000 1 -- 172.21.15.78:0/110305792 shutdown_connections 2023-11-28T19:59:13.375 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:13.368+0000 7f8223e14000 1 -- 172.21.15.78:0/110305792 wait complete. 2023-11-28T19:59:13.380 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:13.368+0000 7f8223e14000 1 -- start start 2023-11-28T19:59:13.380 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:13.368+0000 7f8223e14000 1 Processor -- start 2023-11-28T19:59:13.380 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:13.372+0000 7f8223e14000 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55b018eb22e0 0x55b018eef120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:13.380 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:13.372+0000 7f8223e14000 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55b018eb2c00 0x55b018eb8b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:13.380 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:13.372+0000 7f8223e14000 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55b018eb3520 0x55b018eb9040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:13.380 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:13.372+0000 7f8223e14000 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b018d057c0 con 0x55b018eb22e0 2023-11-28T19:59:13.380 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:13.372+0000 7f8223e14000 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b018cbdbf0 con 0x55b018eb2c00 2023-11-28T19:59:13.381 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:13.372+0000 7f8223e14000 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x55b018cc3a90 con 0x55b018eb3520 2023-11-28T19:59:13.381 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:13.372+0000 7f8223e14000 10 client.0 _ll_register_callbacks cb 0x55b018ea03c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-28T19:59:13.381 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:13.372+0000 7f821a59c640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55b018eb22e0 0x55b018eef120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:13.381 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:13.372+0000 7f821a59c640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55b018eb22e0 0x55b018eef120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:56976/0 (socket says 172.21.15.78:56976) 2023-11-28T19:59:13.381 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:13.372+0000 7f821a59c640 1 -- 172.21.15.78:0/881682000 learned_addr learned my addr 172.21.15.78:0/881682000 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T19:59:13.381 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:13.372+0000 7f821a59c640 1 -- 172.21.15.78:0/881682000 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55b018eb3520 msgr2=0x55b018eb9040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T19:59:13.381 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:13.372+0000 7f821a59c640 1 --2- 172.21.15.78:0/881682000 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55b018eb3520 0x55b018eb9040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:13.381 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:13.372+0000 7f8211d9b640 1 --2- 172.21.15.78:0/881682000 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55b018eb2c00 0x55b018eb8b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:13.381 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:13.372+0000 7f821a59c640 1 -- 172.21.15.78:0/881682000 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55b018eb2c00 msgr2=0x55b018eb8b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T19:59:13.381 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:13.372+0000 7f821a59c640 1 --2- 172.21.15.78:0/881682000 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55b018eb2c00 0x55b018eb8b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:13.381 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:13.372+0000 7f821a59c640 1 -- 172.21.15.78:0/881682000 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f820400f040 con 0x55b018eb22e0 2023-11-28T19:59:13.382 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:13.372+0000 7f8211d9b640 1 --2- 172.21.15.78:0/881682000 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55b018eb2c00 0x55b018eb8b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T19:59:13.382 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:13.372+0000 7f821a59c640 1 --2- 172.21.15.78:0/881682000 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55b018eb22e0 0x55b018eef120 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f820c082420 tx=0x7f820c0592c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3e81068317a1efed server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:59:13.382 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:13.372+0000 7f81f97fa640 10 client.0 ms_handle_connect on v2:172.21.15.78:3300/0 2023-11-28T19:59:13.382 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:13.372+0000 7f81f97fa640 1 -- 172.21.15.78:0/881682000 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f820c05b2b0 con 0x55b018eb22e0 2023-11-28T19:59:13.382 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:13.372+0000 7f8223e14000 1 -- 172.21.15.78:0/881682000 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55b018cc7470 con 0x55b018eb22e0 2023-11-28T19:59:13.382 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:13.372+0000 7f81f97fa640 1 -- 172.21.15.78:0/881682000 <== mon.0 v2:172.21.15.78:3300/0 2 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f820c05cea0 con 0x55b018eb22e0 2023-11-28T19:59:13.382 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:13.372+0000 7f81f97fa640 1 -- 172.21.15.78:0/881682000 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_get_version_reply(handle=1 version=7) v2 ==== 24+0+0 (secure 0 0 0) 0x7f820c082120 con 0x55b018eb22e0 2023-11-28T19:59:13.382 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:13.372+0000 7f8223e14000 10 client.4404 fetch_fsmap learned FSMap version 7 2023-11-28T19:59:13.382 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:13.372+0000 7f8223e14000 1 -- 172.21.15.78:0/881682000 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,fsmap=7,monmap=2+}) v3 -- 0x55b018cc6190 con 0x55b018eb22e0 2023-11-28T19:59:13.382 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:13.372+0000 7f81f97fa640 1 -- 172.21.15.78:0/881682000 <== mon.0 v2:172.21.15.78:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f820c070020 con 0x55b018eb22e0 2023-11-28T19:59:13.382 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:13.372+0000 7f81f97fa640 1 -- 172.21.15.78:0/881682000 <== mon.0 v2:172.21.15.78:3300/0 5 ==== fsmap(e 7) v1 ==== 3302+0+0 (secure 0 0 0) 0x7f820c011070 con 0x55b018eb22e0 2023-11-28T19:59:13.383 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:13.372+0000 7f8223e14000 10 client.4404 fetch_fsmap finished waiting for FSMap version 7 2023-11-28T19:59:13.383 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:13.372+0000 7f8223e14000 10 client.4404 resolve_mds: resolved name 'b' to daemon mds.b 2023-11-28T19:59:13.383 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:13.372+0000 7f8223e14000 20 client.4404 populate_metadata read hostname 'smithi078' 2023-11-28T19:59:13.383 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:13.372+0000 7f8223e14000 1 --2- 172.21.15.78:0/881682000 >> [v2:172.21.15.179:6832/1234044491,v1:172.21.15.179:6834/1234044491] conn(0x55b018eb9a50 0x55b018eb9e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:13.383 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:13.372+0000 7f8223e14000 4 client.4404 mds_command: new command op to 4275 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-11-28T19:59:13.383 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:13.372+0000 7f8223e14000 1 -- 172.21.15.78:0/881682000 --> [v2:172.21.15.179:6832/1234044491,v1:172.21.15.179:6834/1234044491] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55b018ccab50 con 0x55b018eb9a50 2023-11-28T19:59:13.383 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:13.372+0000 7f8211d9b640 1 --2- 172.21.15.78:0/881682000 >> [v2:172.21.15.179:6832/1234044491,v1:172.21.15.179:6834/1234044491] conn(0x55b018eb9a50 0x55b018eb9e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:13.383 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:13.372+0000 7f8211d9b640 1 --2- 172.21.15.78:0/881682000 >> [v2:172.21.15.179:6832/1234044491,v1:172.21.15.179:6834/1234044491] conn(0x55b018eb9a50 0x55b018eb9e30 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f719e1f9ac22519 server_cookie=ee41c32b85e5739a in_seq=0 out_seq=0 2023-11-28T19:59:13.383 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:13.372+0000 7f81f97fa640 10 client.4404 ms_handle_connect on v2:172.21.15.179:6832/1234044491 2023-11-28T19:59:13.383 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:13.376+0000 7f81f97fa640 1 -- 172.21.15.78:0/881682000 <== mds.0 v2:172.21.15.179:6832/1234044491 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55b018ccab50 con 0x55b018eb9a50 2023-11-28T19:59:13.383 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:13.376+0000 7f81f97fa640 10 client.4404 handle_command_reply: tid=0 2023-11-28T19:59:13.384 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:13.376+0000 7f8223e14000 1 client.4404 shutdown 2023-11-28T19:59:13.384 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:13.376+0000 7f8223e14000 1 -- 172.21.15.78:0/881682000 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55b018eb22e0 msgr2=0x55b018eef120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:13.384 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:13.376+0000 7f8223e14000 1 --2- 172.21.15.78:0/881682000 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55b018eb22e0 0x55b018eef120 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f820c082420 tx=0x7f820c0592c0 comp rx=0 tx=0).stop 2023-11-28T19:59:13.384 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:13.376+0000 7f8223e14000 1 -- 172.21.15.78:0/881682000 shutdown_connections 2023-11-28T19:59:13.384 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:13.376+0000 7f8223e14000 1 --2- 172.21.15.78:0/881682000 >> [v2:172.21.15.179:6832/1234044491,v1:172.21.15.179:6834/1234044491] conn(0x55b018eb9a50 0x55b018eb9e30 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:13.384 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:13.376+0000 7f8223e14000 1 --2- 172.21.15.78:0/881682000 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55b018eb3520 0x55b018eb9040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:13.384 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:13.376+0000 7f8223e14000 1 --2- 172.21.15.78:0/881682000 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55b018eb2c00 0x55b018eb8b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:13.384 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:13.376+0000 7f81f97fa640 0 client.4404 ms_handle_reset on v2:172.21.15.179:6832/1234044491 2023-11-28T19:59:13.384 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:13.376+0000 7f8223e14000 1 --2- 172.21.15.78:0/881682000 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55b018eb22e0 0x55b018eef120 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:13.384 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:13.376+0000 7f8223e14000 1 -- 172.21.15.78:0/881682000 >> 172.21.15.78:0/881682000 conn(0x55b018ebb190 msgr2=0x55b018eb19d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T19:59:13.384 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:13.376+0000 7f8223e14000 1 -- 172.21.15.78:0/881682000 shutdown_connections 2023-11-28T19:59:13.385 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:13.376+0000 7f8223e14000 1 -- 172.21.15.78:0/881682000 wait complete. 2023-11-28T19:59:13.385 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:13.376+0000 7f8223e14000 20 client.4404 trim_cache size 0 max 16384 2023-11-28T19:59:13.394 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:13.388+0000 7f8223e14000 1 Processor -- start 2023-11-28T19:59:13.394 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:13.388+0000 7f8223e14000 1 -- start start 2023-11-28T19:59:13.396 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:13.392+0000 7f8223e14000 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55b018eb22e0 0x55b018f0d220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:13.396 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:13.392+0000 7f8223e14000 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55b018eb2c00 0x55b018eb88b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:13.396 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:13.392+0000 7f8223e14000 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55b018eb3520 0x55b018eb8df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:13.396 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:13.392+0000 7f8223e14000 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b0189be940 con 0x55b018eb22e0 2023-11-28T19:59:13.397 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:13.392+0000 7f8223e14000 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b018d0d0c0 con 0x55b018eb2c00 2023-11-28T19:59:13.397 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:13.392+0000 7f8223e14000 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x55b018d787a0 con 0x55b018eb3520 2023-11-28T19:59:13.397 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:13.392+0000 7f821a59c640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55b018eb22e0 0x55b018f0d220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:13.397 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:13.392+0000 7f821a59c640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55b018eb22e0 0x55b018f0d220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:56990/0 (socket says 172.21.15.78:56990) 2023-11-28T19:59:13.397 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:13.392+0000 7f821a59c640 1 -- 172.21.15.78:0/3995805867 learned_addr learned my addr 172.21.15.78:0/3995805867 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T19:59:13.397 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:13.392+0000 7f821a59c640 1 -- 172.21.15.78:0/3995805867 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55b018eb3520 msgr2=0x55b018eb8df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T19:59:13.397 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:13.392+0000 7f821a59c640 1 --2- 172.21.15.78:0/3995805867 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55b018eb3520 0x55b018eb8df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:13.397 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:13.392+0000 7f821a59c640 1 -- 172.21.15.78:0/3995805867 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55b018eb2c00 msgr2=0x55b018eb88b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T19:59:13.397 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:13.392+0000 7f821a59c640 1 --2- 172.21.15.78:0/3995805867 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55b018eb2c00 0x55b018eb88b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:13.397 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:13.392+0000 7f821a59c640 1 -- 172.21.15.78:0/3995805867 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b018cac490 con 0x55b018eb22e0 2023-11-28T19:59:13.397 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:13.392+0000 7f821a59c640 1 --2- 172.21.15.78:0/3995805867 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55b018eb22e0 0x55b018f0d220 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f820c05b010 tx=0x7f820c084000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=27247ed17d728882 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:59:13.397 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:13.392+0000 7f8210d99640 1 -- 172.21.15.78:0/3995805867 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f820c05d150 con 0x55b018eb22e0 2023-11-28T19:59:13.398 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:13.392+0000 7f8210d99640 1 -- 172.21.15.78:0/3995805867 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f820c070030 con 0x55b018eb22e0 2023-11-28T19:59:13.398 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:13.392+0000 7f8210d99640 1 -- 172.21.15.78:0/3995805867 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f820c082120 con 0x55b018eb22e0 2023-11-28T19:59:13.401 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:13.392+0000 7f8223e14000 1 -- 172.21.15.78:0/3995805867 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55b018eb22e0 msgr2=0x55b018f0d220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:13.401 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:13.392+0000 7f8223e14000 1 --2- 172.21.15.78:0/3995805867 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55b018eb22e0 0x55b018f0d220 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f820c05b010 tx=0x7f820c084000 comp rx=0 tx=0).stop 2023-11-28T19:59:13.401 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:13.392+0000 7f8223e14000 1 -- 172.21.15.78:0/3995805867 shutdown_connections 2023-11-28T19:59:13.401 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:13.392+0000 7f8223e14000 1 --2- 172.21.15.78:0/3995805867 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55b018eb3520 0x55b018eb8df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:13.401 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:13.392+0000 7f8223e14000 1 --2- 172.21.15.78:0/3995805867 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55b018eb2c00 0x55b018eb88b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:13.402 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:13.392+0000 7f8223e14000 1 --2- 172.21.15.78:0/3995805867 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55b018eb22e0 0x55b018f0d220 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:13.402 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:13.392+0000 7f8223e14000 1 -- 172.21.15.78:0/3995805867 >> 172.21.15.78:0/3995805867 conn(0x55b018ebb190 msgr2=0x55b018eb9e30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T19:59:13.402 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:13.392+0000 7f8223e14000 1 -- 172.21.15.78:0/3995805867 shutdown_connections 2023-11-28T19:59:13.402 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:13.392+0000 7f8223e14000 1 -- 172.21.15.78:0/3995805867 wait complete. 2023-11-28T19:59:13.402 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:13.392+0000 7f8223e14000 1 -- start start 2023-11-28T19:59:13.402 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:13.392+0000 7f8223e14000 1 Processor -- start 2023-11-28T19:59:13.402 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:13.396+0000 7f8223e14000 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55b018eb22e0 0x55b018f093c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:13.402 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:13.396+0000 7f8223e14000 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55b018eb2c00 0x55b018f09900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:13.402 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:13.396+0000 7f8223e14000 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55b018eb3520 0x55b018f09e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:13.402 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:13.396+0000 7f8223e14000 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b018cffac0 con 0x55b018eb2c00 2023-11-28T19:59:13.402 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:13.396+0000 7f8223e14000 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b018d01130 con 0x55b018eb22e0 2023-11-28T19:59:13.403 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:13.396+0000 7f8223e14000 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x55b018d057c0 con 0x55b018eb3520 2023-11-28T19:59:13.403 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:13.396+0000 7f8223e14000 10 client.0 _ll_register_callbacks cb 0x55b018e80bd0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-28T19:59:13.403 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:13.396+0000 7f8211d9b640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55b018eb2c00 0x55b018f09900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:13.403 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:13.396+0000 7f8211d9b640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55b018eb2c00 0x55b018f09900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:56992/0 (socket says 172.21.15.78:56992) 2023-11-28T19:59:13.403 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:13.396+0000 7f8211d9b640 1 -- 172.21.15.78:0/1015012167 learned_addr learned my addr 172.21.15.78:0/1015012167 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T19:59:13.403 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:13.396+0000 7f821a59c640 1 --2- 172.21.15.78:0/1015012167 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55b018eb22e0 0x55b018f093c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:13.403 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:13.396+0000 7f821ad9d640 1 --2- 172.21.15.78:0/1015012167 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55b018eb3520 0x55b018f09e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:13.403 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:13.396+0000 7f8211d9b640 1 -- 172.21.15.78:0/1015012167 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55b018eb3520 msgr2=0x55b018f09e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T19:59:13.403 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:13.396+0000 7f8211d9b640 1 --2- 172.21.15.78:0/1015012167 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55b018eb3520 0x55b018f09e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:13.403 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:13.396+0000 7f8211d9b640 1 -- 172.21.15.78:0/1015012167 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55b018eb22e0 msgr2=0x55b018f093c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T19:59:13.404 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:13.396+0000 7f8211d9b640 1 --2- 172.21.15.78:0/1015012167 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55b018eb22e0 0x55b018f093c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:13.404 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:13.396+0000 7f8211d9b640 1 -- 172.21.15.78:0/1015012167 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55b018cc6190 con 0x55b018eb2c00 2023-11-28T19:59:13.404 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:13.396+0000 7f8211d9b640 1 --2- 172.21.15.78:0/1015012167 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55b018eb2c00 0x55b018f09900 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x55b018ea4fe0 tx=0x7f8204001090 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8e65fc7259abee35 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:59:13.404 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:13.396+0000 7f81f97fa640 10 client.0 ms_handle_connect on v2:172.21.15.78:3300/0 2023-11-28T19:59:13.404 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:13.396+0000 7f81f97fa640 1 -- 172.21.15.78:0/1015012167 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f820402d5e0 con 0x55b018eb2c00 2023-11-28T19:59:13.404 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:13.396+0000 7f8223e14000 1 -- 172.21.15.78:0/1015012167 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55b018d04110 con 0x55b018eb2c00 2023-11-28T19:59:13.404 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:13.396+0000 7f81f97fa640 1 -- 172.21.15.78:0/1015012167 <== mon.0 v2:172.21.15.78:3300/0 2 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f820402d740 con 0x55b018eb2c00 2023-11-28T19:59:13.404 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:13.396+0000 7f81f97fa640 1 -- 172.21.15.78:0/1015012167 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_get_version_reply(handle=1 version=7) v2 ==== 24+0+0 (secure 0 0 0) 0x7f820402d900 con 0x55b018eb2c00 2023-11-28T19:59:13.404 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:13.396+0000 7f8223e14000 10 client.4410 fetch_fsmap learned FSMap version 7 2023-11-28T19:59:13.404 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:13.396+0000 7f8223e14000 1 -- 172.21.15.78:0/1015012167 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,fsmap=7,monmap=2+}) v3 -- 0x55b0189fdcc0 con 0x55b018eb2c00 2023-11-28T19:59:13.404 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:13.396+0000 7f81f97fa640 1 -- 172.21.15.78:0/1015012167 <== mon.0 v2:172.21.15.78:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55b018d04110 con 0x55b018eb2c00 2023-11-28T19:59:13.404 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:13.396+0000 7f81f97fa640 1 -- 172.21.15.78:0/1015012167 <== mon.0 v2:172.21.15.78:3300/0 5 ==== fsmap(e 7) v1 ==== 3302+0+0 (secure 0 0 0) 0x7f820402c070 con 0x55b018eb2c00 2023-11-28T19:59:13.405 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:13.396+0000 7f8223e14000 10 client.4410 fetch_fsmap finished waiting for FSMap version 7 2023-11-28T19:59:13.405 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:13.396+0000 7f8223e14000 10 client.4410 resolve_mds: resolved name 'b' to daemon mds.b 2023-11-28T19:59:13.405 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:13.396+0000 7f8223e14000 20 client.4410 populate_metadata read hostname 'smithi078' 2023-11-28T19:59:13.405 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:13.396+0000 7f8223e14000 1 --2- 172.21.15.78:0/1015012167 >> [v2:172.21.15.179:6832/1234044491,v1:172.21.15.179:6834/1234044491] conn(0x55b018f66340 0x55b018f68730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:13.405 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:13.396+0000 7f8223e14000 4 client.4410 mds_command: new command op to 4275 tid=0 multi_id=0 [{"prefix": "status"}] 2023-11-28T19:59:13.405 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:13.396+0000 7f8223e14000 1 -- 172.21.15.78:0/1015012167 --> [v2:172.21.15.179:6832/1234044491,v1:172.21.15.179:6834/1234044491] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55b018d339a0 con 0x55b018f66340 2023-11-28T19:59:13.405 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:13.396+0000 7f821a59c640 1 --2- 172.21.15.78:0/1015012167 >> [v2:172.21.15.179:6832/1234044491,v1:172.21.15.179:6834/1234044491] conn(0x55b018f66340 0x55b018f68730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:13.405 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:13.396+0000 7f81f97fa640 10 client.4410 ms_handle_connect on v2:172.21.15.179:6832/1234044491 2023-11-28T19:59:13.405 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:13.396+0000 7f821a59c640 1 --2- 172.21.15.78:0/1015012167 >> [v2:172.21.15.179:6832/1234044491,v1:172.21.15.179:6834/1234044491] conn(0x55b018f66340 0x55b018f68730 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6931f891faa6445a server_cookie=f196b065f1e17e in_seq=0 out_seq=0 2023-11-28T19:59:13.406 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:13.396+0000 7f81f97fa640 1 -- 172.21.15.78:0/1015012167 <== mds.0 v2:172.21.15.179:6832/1234044491 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+324 (crc 0 0 0) 0x55b018d339a0 con 0x55b018f66340 2023-11-28T19:59:13.407 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:13.396+0000 7f81f97fa640 10 client.4410 handle_command_reply: tid=0 2023-11-28T19:59:13.407 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:13.396+0000 7f8223e14000 1 client.4410 shutdown 2023-11-28T19:59:13.407 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:13.396+0000 7f8223e14000 1 -- 172.21.15.78:0/1015012167 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55b018eb2c00 msgr2=0x55b018f09900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:13.407 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:13.396+0000 7f8223e14000 1 --2- 172.21.15.78:0/1015012167 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55b018eb2c00 0x55b018f09900 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x55b018ea4fe0 tx=0x7f8204001090 comp rx=0 tx=0).stop 2023-11-28T19:59:13.407 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:13.396+0000 7f8223e14000 1 -- 172.21.15.78:0/1015012167 shutdown_connections 2023-11-28T19:59:13.407 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:13.396+0000 7f8223e14000 1 --2- 172.21.15.78:0/1015012167 >> [v2:172.21.15.179:6832/1234044491,v1:172.21.15.179:6834/1234044491] conn(0x55b018f66340 0x55b018f68730 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:13.407 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:13.396+0000 7f8223e14000 1 --2- 172.21.15.78:0/1015012167 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55b018eb3520 0x55b018f09e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:13.407 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:13.396+0000 7f8223e14000 1 --2- 172.21.15.78:0/1015012167 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55b018eb2c00 0x55b018f09900 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:13.407 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:13.396+0000 7f8223e14000 1 --2- 172.21.15.78:0/1015012167 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55b018eb22e0 0x55b018f093c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:13.408 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:13.396+0000 7f8223e14000 1 -- 172.21.15.78:0/1015012167 >> 172.21.15.78:0/1015012167 conn(0x55b018ebb190 msgr2=0x55b018eb0a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T19:59:13.408 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:13.396+0000 7f81f97fa640 0 client.4410 ms_handle_reset on v2:172.21.15.179:6832/1234044491 2023-11-28T19:59:13.408 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:13.396+0000 7f8223e14000 1 -- 172.21.15.78:0/1015012167 shutdown_connections 2023-11-28T19:59:13.408 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:13.396+0000 7f8223e14000 1 -- 172.21.15.78:0/1015012167 wait complete. 2023-11-28T19:59:13.408 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:13.396+0000 7f8223e14000 20 client.4410 trim_cache size 0 max 16384 2023-11-28T19:59:13.408 INFO:teuthology.orchestra.run.smithi078.stdout:{ 2023-11-28T19:59:13.408 INFO:teuthology.orchestra.run.smithi078.stdout: "cluster_fsid": "dd9780e8-3bda-44fa-a9f0-fa07d19d901d", 2023-11-28T19:59:13.409 INFO:teuthology.orchestra.run.smithi078.stdout: "whoami": 0, 2023-11-28T19:59:13.409 INFO:teuthology.orchestra.run.smithi078.stdout: "id": 4275, 2023-11-28T19:59:13.409 INFO:teuthology.orchestra.run.smithi078.stdout: "want_state": "up:active", 2023-11-28T19:59:13.409 INFO:teuthology.orchestra.run.smithi078.stdout: "state": "up:active", 2023-11-28T19:59:13.409 INFO:teuthology.orchestra.run.smithi078.stdout: "fs_name": "cephfs", 2023-11-28T19:59:13.409 INFO:teuthology.orchestra.run.smithi078.stdout: "rank_uptime": 7.3792787459999998, 2023-11-28T19:59:13.409 INFO:teuthology.orchestra.run.smithi078.stdout: "mdsmap_epoch": 7, 2023-11-28T19:59:13.409 INFO:teuthology.orchestra.run.smithi078.stdout: "osdmap_epoch": 25, 2023-11-28T19:59:13.409 INFO:teuthology.orchestra.run.smithi078.stdout: "osdmap_epoch_barrier": 25, 2023-11-28T19:59:13.409 INFO:teuthology.orchestra.run.smithi078.stdout: "uptime": 14.054507165 2023-11-28T19:59:13.409 INFO:teuthology.orchestra.run.smithi078.stdout:} 2023-11-28T19:59:13.410 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:13.400+0000 7f8220a9c640 1 -- 172.21.15.78:0/3116647370 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f81fc066470 msgr2=0x7f81fc068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:13.410 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:13.400+0000 7f8220a9c640 1 --2- 172.21.15.78:0/3116647370 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f81fc066470 0x7f81fc068930 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f821c0c59f0 tx=0x7f8204009040 comp rx=0 tx=0).stop 2023-11-28T19:59:13.411 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:13.400+0000 7f8220a9c640 1 -- 172.21.15.78:0/3116647370 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f821c0bd550 msgr2=0x7f821c146e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:13.411 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:13.400+0000 7f8220a9c640 1 --2- 172.21.15.78:0/3116647370 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f821c0bd550 0x7f821c146e20 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f820c00e8a0 tx=0x7f820c00eca0 comp rx=0 tx=0).stop 2023-11-28T19:59:13.411 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:13.400+0000 7f8220a9c640 1 -- 172.21.15.78:0/3116647370 shutdown_connections 2023-11-28T19:59:13.411 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:13.400+0000 7f8220a9c640 1 --2- 172.21.15.78:0/3116647370 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f81fc066470 0x7f81fc068930 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:13.411 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:13.400+0000 7f8220a9c640 1 --2- 172.21.15.78:0/3116647370 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f821c155950 0x7f821c14d650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:13.411 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:13.400+0000 7f8220a9c640 1 --2- 172.21.15.78:0/3116647370 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f821c0c47b0 0x7f821c0a9870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:13.411 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:13.400+0000 7f8220a9c640 1 --2- 172.21.15.78:0/3116647370 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f821c0bd550 0x7f821c146e20 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:13.411 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:13.400+0000 7f8220a9c640 1 -- 172.21.15.78:0/3116647370 >> 172.21.15.78:0/3116647370 conn(0x7f821c0aba00 msgr2=0x7f821c0abde0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T19:59:13.411 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:13.400+0000 7f8220a9c640 1 -- 172.21.15.78:0/3116647370 shutdown_connections 2023-11-28T19:59:13.411 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:13.400+0000 7f8220a9c640 1 -- 172.21.15.78:0/3116647370 wait complete. 2023-11-28T19:59:13.421 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-11-28T19:59:13.421 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.admin 2023-11-28T19:59:13.421 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-11-28T19:59:13.559 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:13.556+0000 7f59ca7d1640 1 Processor -- start 2023-11-28T19:59:13.559 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:13.556+0000 7f59ca7d1640 1 -- start start 2023-11-28T19:59:13.560 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:13.556+0000 7f59ca7d1640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f59c4071e30 0x7f59c4072290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:13.560 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:13.556+0000 7f59ca7d1640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f59c40c5710 con 0x7f59c4156110 2023-11-28T19:59:13.560 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:13.556+0000 7f59ca7d1640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f59c4155c80 con 0x7f59c414fd10 2023-11-28T19:59:13.560 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:13.556+0000 7f59ca7d1640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59c406c5e0 con 0x7f59c4071e30 2023-11-28T19:59:13.561 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:13.556+0000 7f59c8d6e640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f59c4156110 0x7f59c415ce50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:39572/0 (socket says 172.21.15.78:39572) 2023-11-28T19:59:13.561 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:13.556+0000 7f59c8d6e640 1 -- 172.21.15.78:0/2979033598 learned_addr learned my addr 172.21.15.78:0/2979033598 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-11-28T19:59:13.561 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:13.556+0000 7f59c37fe640 1 --2- 172.21.15.78:0/2979033598 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f59c4071e30 0x7f59c4072290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:13.561 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:13.556+0000 7f59c2ffd640 1 -- 172.21.15.78:0/2979033598 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2457029810 0 0) 0x7f59c40c5710 con 0x7f59c4156110 2023-11-28T19:59:13.562 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:13.556+0000 7f59c2ffd640 1 -- 172.21.15.78:0/2979033598 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f59ac003530 con 0x7f59c4156110 2023-11-28T19:59:13.562 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:13.556+0000 7f59c2ffd640 1 -- 172.21.15.78:0/2979033598 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1927440086 0 0) 0x7f59c4155c80 con 0x7f59c414fd10 2023-11-28T19:59:13.562 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:13.556+0000 7f59c2ffd640 1 -- 172.21.15.78:0/2979033598 --> v1:172.21.15.179:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f59c40c5710 con 0x7f59c414fd10 2023-11-28T19:59:13.562 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:13.556+0000 7f59c37fe640 1 -- 172.21.15.78:0/2979033598 >> v1:172.21.15.179:6789/0 conn(0x7f59c414fd10 legacy=0x7f59c40a4dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:13.562 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:13.556+0000 7f59c37fe640 1 -- 172.21.15.78:0/2979033598 >> v1:172.21.15.78:6789/0 conn(0x7f59c4156110 legacy=0x7f59c415ce50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:13.562 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:13.556+0000 7f59c37fe640 1 -- 172.21.15.78:0/2979033598 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59c40c4e70 con 0x7f59c4071e30 2023-11-28T19:59:13.564 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:13.560+0000 7f59c37fe640 1 --2- 172.21.15.78:0/2979033598 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f59c4071e30 0x7f59c4072290 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f59b80097f0 tx=0x7f59b801c370 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1509223041230ac0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:59:13.565 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:13.560+0000 7f59c2ffd640 1 -- 172.21.15.78:0/2979033598 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59b80ab600 con 0x7f59c4071e30 2023-11-28T19:59:13.565 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:13.560+0000 7f59c2ffd640 1 -- 172.21.15.78:0/2979033598 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f59b80a7050 con 0x7f59c4071e30 2023-11-28T19:59:13.565 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:13.560+0000 7f59c2ffd640 1 -- 172.21.15.78:0/2979033598 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59b80ab980 con 0x7f59c4071e30 2023-11-28T19:59:13.567 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:13.560+0000 7f59ca7d1640 1 -- 172.21.15.78:0/2979033598 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f59c4071e30 msgr2=0x7f59c4072290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:13.567 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:13.560+0000 7f59ca7d1640 1 --2- 172.21.15.78:0/2979033598 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f59c4071e30 0x7f59c4072290 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f59b80097f0 tx=0x7f59b801c370 comp rx=0 tx=0).stop 2023-11-28T19:59:13.567 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:13.560+0000 7f59ca7d1640 1 -- 172.21.15.78:0/2979033598 shutdown_connections 2023-11-28T19:59:13.567 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:13.560+0000 7f59ca7d1640 1 --2- 172.21.15.78:0/2979033598 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f59c4071e30 0x7f59c4072290 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:13.567 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:13.560+0000 7f59ca7d1640 1 -- 172.21.15.78:0/2979033598 >> 172.21.15.78:0/2979033598 conn(0x7f59c40a7810 msgr2=0x7f59c40a7c20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T19:59:13.568 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:13.560+0000 7f59ca7d1640 1 -- 172.21.15.78:0/2979033598 shutdown_connections 2023-11-28T19:59:13.568 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:13.560+0000 7f59ca7d1640 1 -- 172.21.15.78:0/2979033598 wait complete. 2023-11-28T19:59:13.568 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:13.560+0000 7f59ca7d1640 1 Processor -- start 2023-11-28T19:59:13.568 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:13.564+0000 7f59ca7d1640 1 -- start start 2023-11-28T19:59:13.573 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:13.564+0000 7f59ca7d1640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f59c4071e30 0x7f59c40a9f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:13.573 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:13.564+0000 7f59ca7d1640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f59c414fd10 0x7f59c40a8b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:13.573 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:13.564+0000 7f59ca7d1640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f59c4156110 0x7f59c41eac60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:13.574 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:13.564+0000 7f59ca7d1640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59c40aa4d0 con 0x7f59c414fd10 2023-11-28T19:59:13.574 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:13.564+0000 7f59ca7d1640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59c414ec80 con 0x7f59c4071e30 2023-11-28T19:59:13.574 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:13.564+0000 7f59ca7d1640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59c414ef20 con 0x7f59c4156110 2023-11-28T19:59:13.574 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:13.564+0000 7f59c37fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f59c414fd10 0x7f59c40a8b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:13.574 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:13.564+0000 7f59c37fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f59c414fd10 0x7f59c40a8b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:57000/0 (socket says 172.21.15.78:57000) 2023-11-28T19:59:13.575 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:13.564+0000 7f59c37fe640 1 -- 172.21.15.78:0/2341972380 learned_addr learned my addr 172.21.15.78:0/2341972380 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T19:59:13.575 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:13.564+0000 7f59c3fff640 1 --2- 172.21.15.78:0/2341972380 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f59c4071e30 0x7f59c40a9f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:13.575 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:13.564+0000 7f59c8d6e640 1 --2- 172.21.15.78:0/2341972380 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f59c4156110 0x7f59c41eac60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:13.575 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:13.564+0000 7f59c37fe640 1 -- 172.21.15.78:0/2341972380 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f59c4156110 msgr2=0x7f59c41eac60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:13.575 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:13.564+0000 7f59c37fe640 1 --2- 172.21.15.78:0/2341972380 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f59c4156110 0x7f59c41eac60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:13.575 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:13.564+0000 7f59c37fe640 1 -- 172.21.15.78:0/2341972380 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f59c4071e30 msgr2=0x7f59c40a9f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:13.576 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:13.564+0000 7f59c37fe640 1 --2- 172.21.15.78:0/2341972380 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f59c4071e30 0x7f59c40a9f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:13.576 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:13.564+0000 7f59c37fe640 1 -- 172.21.15.78:0/2341972380 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59b8009420 con 0x7f59c414fd10 2023-11-28T19:59:13.576 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:13.564+0000 7f59c8d6e640 1 --2- 172.21.15.78:0/2341972380 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f59c4156110 0x7f59c41eac60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T19:59:13.576 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:13.564+0000 7f59c37fe640 1 --2- 172.21.15.78:0/2341972380 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f59c414fd10 0x7f59c40a8b60 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f59b8018f80 tx=0x7f59b8019110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:59:13.576 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:13.564+0000 7f59c0ff9640 1 -- 172.21.15.78:0/2341972380 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59b80b4430 con 0x7f59c414fd10 2023-11-28T19:59:13.576 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:13.564+0000 7f59c0ff9640 1 -- 172.21.15.78:0/2341972380 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f59b80b45b0 con 0x7f59c414fd10 2023-11-28T19:59:13.577 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:13.564+0000 7f59c0ff9640 1 -- 172.21.15.78:0/2341972380 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59b80b4960 con 0x7f59c414fd10 2023-11-28T19:59:13.577 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:13.564+0000 7f59ca7d1640 1 -- 172.21.15.78:0/2341972380 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f59c41eebe0 con 0x7f59c414fd10 2023-11-28T19:59:13.577 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:13.564+0000 7f59ca7d1640 1 -- 172.21.15.78:0/2341972380 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f59c40a90a0 con 0x7f59c414fd10 2023-11-28T19:59:13.577 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:13.564+0000 7f59ca7d1640 1 -- 172.21.15.78:0/2341972380 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f59c4067630 con 0x7f59c414fd10 2023-11-28T19:59:13.577 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:13.568+0000 7f59c0ff9640 1 -- 172.21.15.78:0/2341972380 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f59b80b2040 con 0x7f59c414fd10 2023-11-28T19:59:13.577 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:13.568+0000 7f59c0ff9640 1 --2- 172.21.15.78:0/2341972380 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f59b0066470 0x7f59b0068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:13.578 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:13.568+0000 7f59c0ff9640 1 -- 172.21.15.78:0/2341972380 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f59b811e030 con 0x7f59c414fd10 2023-11-28T19:59:13.578 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:13.568+0000 7f59c3fff640 1 --2- 172.21.15.78:0/2341972380 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f59b0066470 0x7f59b0068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:13.578 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:13.568+0000 7f59c3fff640 1 --2- 172.21.15.78:0/2341972380 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f59b0066470 0x7f59b0068930 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f59b40011f0 tx=0x7f59b4009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:59:13.578 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:13.572+0000 7f59c0ff9640 1 -- 172.21.15.78:0/2341972380 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f59b814f280 con 0x7f59c414fd10 2023-11-28T19:59:13.761 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:13.756+0000 7f59ca7d1640 1 -- 172.21.15.78:0/2341972380 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f59c415e350 con 0x7f59c414fd10 2023-11-28T19:59:13.762 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:13.756+0000 7f59c0ff9640 1 -- 172.21.15.78:0/2341972380 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v7) v1 ==== 53+0+88 (secure 0 0 0) 0x7f59b80eb1b0 con 0x7f59c414fd10 2023-11-28T19:59:13.762 INFO:teuthology.orchestra.run.smithi078.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2023-11-28T19:59:13.764 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:13.760+0000 7f59ca7d1640 1 -- 172.21.15.78:0/2341972380 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f59b0066470 msgr2=0x7f59b0068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:13.765 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:13.760+0000 7f59ca7d1640 1 --2- 172.21.15.78:0/2341972380 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f59b0066470 0x7f59b0068930 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f59b40011f0 tx=0x7f59b4009040 comp rx=0 tx=0).stop 2023-11-28T19:59:13.765 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:13.760+0000 7f59ca7d1640 1 -- 172.21.15.78:0/2341972380 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f59c414fd10 msgr2=0x7f59c40a8b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:13.765 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:13.760+0000 7f59ca7d1640 1 --2- 172.21.15.78:0/2341972380 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f59c414fd10 0x7f59c40a8b60 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f59b8018f80 tx=0x7f59b8019110 comp rx=0 tx=0).stop 2023-11-28T19:59:13.765 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:13.760+0000 7f59ca7d1640 1 -- 172.21.15.78:0/2341972380 shutdown_connections 2023-11-28T19:59:13.766 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:13.760+0000 7f59ca7d1640 1 --2- 172.21.15.78:0/2341972380 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f59b0066470 0x7f59b0068930 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:13.766 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:13.760+0000 7f59ca7d1640 1 --2- 172.21.15.78:0/2341972380 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f59c4156110 0x7f59c41eac60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:13.766 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:13.760+0000 7f59ca7d1640 1 --2- 172.21.15.78:0/2341972380 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f59c414fd10 0x7f59c40a8b60 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:13.766 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:13.760+0000 7f59ca7d1640 1 --2- 172.21.15.78:0/2341972380 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f59c4071e30 0x7f59c40a9f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:13.766 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:13.760+0000 7f59ca7d1640 1 -- 172.21.15.78:0/2341972380 >> 172.21.15.78:0/2341972380 conn(0x7f59c40a7810 msgr2=0x7f59c406d1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T19:59:13.766 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:13.760+0000 7f59ca7d1640 1 -- 172.21.15.78:0/2341972380 shutdown_connections 2023-11-28T19:59:13.767 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:13.760+0000 7f59ca7d1640 1 -- 172.21.15.78:0/2341972380 wait complete. 2023-11-28T19:59:13.785 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-11-28T19:59:13.785 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-11-28T19:59:13.785 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi078.front.sepia.ceph.com 2023-11-28T19:59:13.785 INFO:tasks.cephfs.mount:self.client.name = client.admin 2023-11-28T19:59:13.785 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.admin 2023-11-28T19:59:13.786 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-11-28T19:59:13.786 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-11-28T19:59:13.787 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-11-28T19:59:13.787 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.admin' 2023-11-28T19:59:13.787 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T19:59:13.787 DEBUG:teuthology.orchestra.run.smithi078:> ip addr 2023-11-28T19:59:13.796 INFO:teuthology.orchestra.run.smithi078.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-11-28T19:59:13.797 INFO:teuthology.orchestra.run.smithi078.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-11-28T19:59:13.797 INFO:teuthology.orchestra.run.smithi078.stdout: inet 127.0.0.1/8 scope host lo 2023-11-28T19:59:13.797 INFO:teuthology.orchestra.run.smithi078.stdout: valid_lft forever preferred_lft forever 2023-11-28T19:59:13.797 INFO:teuthology.orchestra.run.smithi078.stdout: inet6 ::1/128 scope host 2023-11-28T19:59:13.797 INFO:teuthology.orchestra.run.smithi078.stdout: valid_lft forever preferred_lft forever 2023-11-28T19:59:13.797 INFO:teuthology.orchestra.run.smithi078.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-11-28T19:59:13.797 INFO:teuthology.orchestra.run.smithi078.stdout: link/ether 0c:c4:7a:d8:a1:22 brd ff:ff:ff:ff:ff:ff 2023-11-28T19:59:13.798 INFO:teuthology.orchestra.run.smithi078.stdout: altname enp7s0f0 2023-11-28T19:59:13.798 INFO:teuthology.orchestra.run.smithi078.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-11-28T19:59:13.798 INFO:teuthology.orchestra.run.smithi078.stdout: link/ether 0c:c4:7a:d8:a1:23 brd ff:ff:ff:ff:ff:ff 2023-11-28T19:59:13.798 INFO:teuthology.orchestra.run.smithi078.stdout: altname enp7s0f1 2023-11-28T19:59:13.798 INFO:teuthology.orchestra.run.smithi078.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-11-28T19:59:13.798 INFO:teuthology.orchestra.run.smithi078.stdout: link/ether 0c:c4:7a:8f:d4:dc brd ff:ff:ff:ff:ff:ff 2023-11-28T19:59:13.799 INFO:teuthology.orchestra.run.smithi078.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-11-28T19:59:13.799 INFO:teuthology.orchestra.run.smithi078.stdout: link/ether 0c:c4:7a:8f:d4:dd brd ff:ff:ff:ff:ff:ff 2023-11-28T19:59:13.799 INFO:teuthology.orchestra.run.smithi078.stdout: inet 172.21.15.78/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2023-11-28T19:59:13.799 INFO:teuthology.orchestra.run.smithi078.stdout: valid_lft 42418sec preferred_lft 42418sec 2023-11-28T19:59:13.799 INFO:teuthology.orchestra.run.smithi078.stdout: inet6 fe80::ec4:7aff:fe8f:d4dd/64 scope link 2023-11-28T19:59:13.800 INFO:teuthology.orchestra.run.smithi078.stdout: valid_lft forever preferred_lft forever 2023-11-28T19:59:13.800 INFO:teuthology.orchestra.run.smithi078.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-11-28T19:59:13.800 INFO:teuthology.orchestra.run.smithi078.stdout: link/ether 02:42:8f:cc:76:dd brd ff:ff:ff:ff:ff:ff 2023-11-28T19:59:13.800 INFO:teuthology.orchestra.run.smithi078.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-11-28T19:59:13.800 INFO:teuthology.orchestra.run.smithi078.stdout: valid_lft forever preferred_lft forever 2023-11-28T19:59:13.801 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-11-28T19:59:13.801 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T19:59:13.801 DEBUG:teuthology.orchestra.run.smithi078:> (cd / && exec bash -c ' 2023-11-28T19:59:13.801 DEBUG:teuthology.orchestra.run.smithi078:> set -e 2023-11-28T19:59:13.801 DEBUG:teuthology.orchestra.run.smithi078:> sudo ip link add name ceph-brx type bridge 2023-11-28T19:59:13.801 DEBUG:teuthology.orchestra.run.smithi078:> sudo ip addr flush dev ceph-brx 2023-11-28T19:59:13.802 DEBUG:teuthology.orchestra.run.smithi078:> sudo ip link set ceph-brx up 2023-11-28T19:59:13.802 DEBUG:teuthology.orchestra.run.smithi078:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-11-28T19:59:13.802 DEBUG:teuthology.orchestra.run.smithi078:> ') 2023-11-28T19:59:13.908 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T19:59:13.908 DEBUG:teuthology.orchestra.run.smithi078:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-11-28T19:59:13.927 INFO:teuthology.orchestra.run.smithi078.stdout:1 2023-11-28T19:59:13.929 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T19:59:13.930 DEBUG:teuthology.orchestra.run.smithi078:> route 2023-11-28T19:59:13.997 INFO:teuthology.orchestra.run.smithi078.stdout:Kernel IP routing table 2023-11-28T19:59:13.997 INFO:teuthology.orchestra.run.smithi078.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-11-28T19:59:13.997 INFO:teuthology.orchestra.run.smithi078.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2023-11-28T19:59:13.997 INFO:teuthology.orchestra.run.smithi078.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-11-28T19:59:13.997 INFO:teuthology.orchestra.run.smithi078.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-11-28T19:59:13.997 INFO:teuthology.orchestra.run.smithi078.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-11-28T19:59:13.998 INFO:teuthology.orchestra.run.smithi078.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-11-28T19:59:13.998 INFO:teuthology.orchestra.run.smithi078.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-11-28T19:59:13.998 INFO:teuthology.orchestra.run.smithi078.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-11-28T19:59:13.998 INFO:teuthology.orchestra.run.smithi078.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-11-28T19:59:13.999 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T19:59:13.999 DEBUG:teuthology.orchestra.run.smithi078:> (cd / && exec bash -c ' 2023-11-28T19:59:13.999 DEBUG:teuthology.orchestra.run.smithi078:> set -e 2023-11-28T19:59:13.999 DEBUG:teuthology.orchestra.run.smithi078:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-11-28T19:59:13.999 DEBUG:teuthology.orchestra.run.smithi078:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-11-28T19:59:13.999 DEBUG:teuthology.orchestra.run.smithi078:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-11-28T19:59:13.999 DEBUG:teuthology.orchestra.run.smithi078:> ') 2023-11-28T19:59:14.089 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T19:59:14.089 DEBUG:teuthology.orchestra.run.smithi078:> ip netns list 2023-11-28T19:59:14.100 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T19:59:14.100 DEBUG:teuthology.orchestra.run.smithi078:> ip netns list-id 2023-11-28T19:59:14.152 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T19:59:14.152 DEBUG:teuthology.orchestra.run.smithi078:> (cd / && exec bash -c ' 2023-11-28T19:59:14.152 DEBUG:teuthology.orchestra.run.smithi078:> set -e 2023-11-28T19:59:14.152 DEBUG:teuthology.orchestra.run.smithi078:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.admin 2023-11-28T19:59:14.152 DEBUG:teuthology.orchestra.run.smithi078:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.admin 0 2023-11-28T19:59:14.152 DEBUG:teuthology.orchestra.run.smithi078:> ') 2023-11-28T19:59:14.235 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.admin' with 192.168.0.1/16 2023-11-28T19:59:14.235 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T19:59:14.235 DEBUG:teuthology.orchestra.run.smithi078:> (cd / && exec bash -c ' 2023-11-28T19:59:14.236 DEBUG:teuthology.orchestra.run.smithi078:> set -e 2023-11-28T19:59:14.236 DEBUG:teuthology.orchestra.run.smithi078:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.admin type veth peer name brx.0 2023-11-28T19:59:14.236 DEBUG:teuthology.orchestra.run.smithi078:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-11-28T19:59:14.236 DEBUG:teuthology.orchestra.run.smithi078:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip link set veth0 up 2023-11-28T19:59:14.236 DEBUG:teuthology.orchestra.run.smithi078:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip link set lo up 2023-11-28T19:59:14.237 DEBUG:teuthology.orchestra.run.smithi078:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip route add default via 192.168.255.254 2023-11-28T19:59:14.237 DEBUG:teuthology.orchestra.run.smithi078:> ') 2023-11-28T19:59:14.397 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T19:59:14.398 DEBUG:teuthology.orchestra.run.smithi078:> (cd / && exec bash -c ' 2023-11-28T19:59:14.398 DEBUG:teuthology.orchestra.run.smithi078:> set -e 2023-11-28T19:59:14.398 DEBUG:teuthology.orchestra.run.smithi078:> sudo ip link set brx.0 up 2023-11-28T19:59:14.398 DEBUG:teuthology.orchestra.run.smithi078:> sudo ip link set dev brx.0 master ceph-brx 2023-11-28T19:59:14.398 DEBUG:teuthology.orchestra.run.smithi078:> ') 2023-11-28T19:59:14.439 INFO:tasks.cephfs.fuse_mount:Client client.admin config is {} 2023-11-28T19:59:14.439 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-28T19:59:14.439 DEBUG:teuthology.orchestra.run.smithi078:> mkdir -p -v /home/ubuntu/cephtest/mnt.admin 2023-11-28T19:59:14.491 INFO:teuthology.orchestra.run.smithi078.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.admin' 2023-11-28T19:59:14.491 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-28T19:59:14.491 DEBUG:teuthology.orchestra.run.smithi078:> chmod 0000 /home/ubuntu/cephtest/mnt.admin 2023-11-28T19:59:14.542 DEBUG:teuthology.orchestra.run.smithi078:> sudo modprobe fuse 2023-11-28T19:59:14.607 DEBUG:teuthology.orchestra.run.smithi078:> cat /proc/self/mounts | awk '{print $2}' 2023-11-28T19:59:14.664 INFO:teuthology.orchestra.run.smithi078.stdout:/sys 2023-11-28T19:59:14.664 INFO:teuthology.orchestra.run.smithi078.stdout:/proc 2023-11-28T19:59:14.664 INFO:teuthology.orchestra.run.smithi078.stdout:/dev 2023-11-28T19:59:14.665 INFO:teuthology.orchestra.run.smithi078.stdout:/dev/pts 2023-11-28T19:59:14.665 INFO:teuthology.orchestra.run.smithi078.stdout:/run 2023-11-28T19:59:14.665 INFO:teuthology.orchestra.run.smithi078.stdout:/ 2023-11-28T19:59:14.665 INFO:teuthology.orchestra.run.smithi078.stdout:/sys/kernel/security 2023-11-28T19:59:14.666 INFO:teuthology.orchestra.run.smithi078.stdout:/dev/shm 2023-11-28T19:59:14.666 INFO:teuthology.orchestra.run.smithi078.stdout:/run/lock 2023-11-28T19:59:14.666 INFO:teuthology.orchestra.run.smithi078.stdout:/sys/fs/cgroup 2023-11-28T19:59:14.666 INFO:teuthology.orchestra.run.smithi078.stdout:/sys/fs/pstore 2023-11-28T19:59:14.666 INFO:teuthology.orchestra.run.smithi078.stdout:/sys/fs/bpf 2023-11-28T19:59:14.667 INFO:teuthology.orchestra.run.smithi078.stdout:/proc/sys/fs/binfmt_misc 2023-11-28T19:59:14.667 INFO:teuthology.orchestra.run.smithi078.stdout:/dev/hugepages 2023-11-28T19:59:14.667 INFO:teuthology.orchestra.run.smithi078.stdout:/dev/mqueue 2023-11-28T19:59:14.667 INFO:teuthology.orchestra.run.smithi078.stdout:/sys/kernel/debug 2023-11-28T19:59:14.668 INFO:teuthology.orchestra.run.smithi078.stdout:/sys/kernel/tracing 2023-11-28T19:59:14.668 INFO:teuthology.orchestra.run.smithi078.stdout:/proc/fs/nfsd 2023-11-28T19:59:14.668 INFO:teuthology.orchestra.run.smithi078.stdout:/sys/fs/fuse/connections 2023-11-28T19:59:14.668 INFO:teuthology.orchestra.run.smithi078.stdout:/sys/kernel/config 2023-11-28T19:59:14.668 INFO:teuthology.orchestra.run.smithi078.stdout:/run/credentials/systemd-sysusers.service 2023-11-28T19:59:14.668 INFO:teuthology.orchestra.run.smithi078.stdout:/run/rpc_pipefs 2023-11-28T19:59:14.669 INFO:teuthology.orchestra.run.smithi078.stdout:/run/user/1000 2023-11-28T19:59:14.669 INFO:teuthology.orchestra.run.smithi078.stdout:/var/lib/ceph 2023-11-28T19:59:14.669 INFO:teuthology.orchestra.run.smithi078.stdout:/var/lib/ceph/osd/ceph-0 2023-11-28T19:59:14.669 INFO:teuthology.orchestra.run.smithi078.stdout:/var/lib/ceph/osd/ceph-1 2023-11-28T19:59:14.669 INFO:teuthology.orchestra.run.smithi078.stdout:/var/lib/ceph/osd/ceph-2 2023-11-28T19:59:14.669 INFO:teuthology.orchestra.run.smithi078.stdout:/var/lib/ceph/osd/ceph-3 2023-11-28T19:59:14.669 INFO:teuthology.orchestra.run.smithi078.stdout:/run/netns 2023-11-28T19:59:14.670 INFO:teuthology.orchestra.run.smithi078.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2023-11-28T19:59:14.670 INFO:teuthology.orchestra.run.smithi078.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2023-11-28T19:59:14.671 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T19:59:14.671 DEBUG:teuthology.orchestra.run.smithi078:> ls /sys/fs/fuse/connections 2023-11-28T19:59:14.722 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-11-28T19:59:14.723 DEBUG:teuthology.orchestra.run.smithi078:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.admin --id admin --client_fs=cephfs) 2023-11-28T19:59:14.769 DEBUG:teuthology.orchestra.run.smithi078:> sudo modprobe fuse 2023-11-28T19:59:14.791 DEBUG:teuthology.orchestra.run.smithi078:> cat /proc/self/mounts | awk '{print $2}' 2023-11-28T19:59:14.844 INFO:teuthology.orchestra.run.smithi078.stdout:/sys 2023-11-28T19:59:14.844 INFO:teuthology.orchestra.run.smithi078.stdout:/proc 2023-11-28T19:59:14.844 INFO:teuthology.orchestra.run.smithi078.stdout:/dev 2023-11-28T19:59:14.844 INFO:teuthology.orchestra.run.smithi078.stdout:/dev/pts 2023-11-28T19:59:14.845 INFO:teuthology.orchestra.run.smithi078.stdout:/run 2023-11-28T19:59:14.845 INFO:teuthology.orchestra.run.smithi078.stdout:/ 2023-11-28T19:59:14.845 INFO:teuthology.orchestra.run.smithi078.stdout:/sys/kernel/security 2023-11-28T19:59:14.845 INFO:teuthology.orchestra.run.smithi078.stdout:/dev/shm 2023-11-28T19:59:14.845 INFO:teuthology.orchestra.run.smithi078.stdout:/run/lock 2023-11-28T19:59:14.845 INFO:teuthology.orchestra.run.smithi078.stdout:/sys/fs/cgroup 2023-11-28T19:59:14.845 INFO:teuthology.orchestra.run.smithi078.stdout:/sys/fs/pstore 2023-11-28T19:59:14.845 INFO:teuthology.orchestra.run.smithi078.stdout:/sys/fs/bpf 2023-11-28T19:59:14.845 INFO:teuthology.orchestra.run.smithi078.stdout:/proc/sys/fs/binfmt_misc 2023-11-28T19:59:14.845 INFO:teuthology.orchestra.run.smithi078.stdout:/dev/hugepages 2023-11-28T19:59:14.845 INFO:teuthology.orchestra.run.smithi078.stdout:/dev/mqueue 2023-11-28T19:59:14.845 INFO:teuthology.orchestra.run.smithi078.stdout:/sys/kernel/debug 2023-11-28T19:59:14.845 INFO:teuthology.orchestra.run.smithi078.stdout:/sys/kernel/tracing 2023-11-28T19:59:14.846 INFO:teuthology.orchestra.run.smithi078.stdout:/proc/fs/nfsd 2023-11-28T19:59:14.846 INFO:teuthology.orchestra.run.smithi078.stdout:/sys/fs/fuse/connections 2023-11-28T19:59:14.846 INFO:teuthology.orchestra.run.smithi078.stdout:/sys/kernel/config 2023-11-28T19:59:14.846 INFO:teuthology.orchestra.run.smithi078.stdout:/run/credentials/systemd-sysusers.service 2023-11-28T19:59:14.846 INFO:teuthology.orchestra.run.smithi078.stdout:/run/rpc_pipefs 2023-11-28T19:59:14.846 INFO:teuthology.orchestra.run.smithi078.stdout:/run/user/1000 2023-11-28T19:59:14.846 INFO:teuthology.orchestra.run.smithi078.stdout:/var/lib/ceph 2023-11-28T19:59:14.846 INFO:teuthology.orchestra.run.smithi078.stdout:/var/lib/ceph/osd/ceph-0 2023-11-28T19:59:14.846 INFO:teuthology.orchestra.run.smithi078.stdout:/var/lib/ceph/osd/ceph-1 2023-11-28T19:59:14.846 INFO:teuthology.orchestra.run.smithi078.stdout:/var/lib/ceph/osd/ceph-2 2023-11-28T19:59:14.846 INFO:teuthology.orchestra.run.smithi078.stdout:/var/lib/ceph/osd/ceph-3 2023-11-28T19:59:14.847 INFO:teuthology.orchestra.run.smithi078.stdout:/run/netns 2023-11-28T19:59:14.847 INFO:teuthology.orchestra.run.smithi078.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2023-11-28T19:59:14.847 INFO:teuthology.orchestra.run.smithi078.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2023-11-28T19:59:14.848 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T19:59:14.848 DEBUG:teuthology.orchestra.run.smithi078:> ls /sys/fs/fuse/connections 2023-11-28T19:59:14.878 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi078.stderr:2023-11-28T19:59:14.872+0000 7fb2d48ba580 -1 init, newargv = 0x55f91f1bb310 newargc=15 2023-11-28T19:59:14.878 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi078.stderr:ceph-fuse[42918]: starting ceph client 2023-11-28T19:59:14.889 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi078.stderr:ceph-fuse[42918]: starting fuse 2023-11-28T19:59:15.988 DEBUG:teuthology.orchestra.run.smithi078:> sudo modprobe fuse 2023-11-28T19:59:16.014 DEBUG:teuthology.orchestra.run.smithi078:> cat /proc/self/mounts | awk '{print $2}' 2023-11-28T19:59:16.069 INFO:teuthology.orchestra.run.smithi078.stdout:/sys 2023-11-28T19:59:16.070 INFO:teuthology.orchestra.run.smithi078.stdout:/proc 2023-11-28T19:59:16.070 INFO:teuthology.orchestra.run.smithi078.stdout:/dev 2023-11-28T19:59:16.070 INFO:teuthology.orchestra.run.smithi078.stdout:/dev/pts 2023-11-28T19:59:16.070 INFO:teuthology.orchestra.run.smithi078.stdout:/run 2023-11-28T19:59:16.070 INFO:teuthology.orchestra.run.smithi078.stdout:/ 2023-11-28T19:59:16.070 INFO:teuthology.orchestra.run.smithi078.stdout:/sys/kernel/security 2023-11-28T19:59:16.070 INFO:teuthology.orchestra.run.smithi078.stdout:/dev/shm 2023-11-28T19:59:16.070 INFO:teuthology.orchestra.run.smithi078.stdout:/run/lock 2023-11-28T19:59:16.070 INFO:teuthology.orchestra.run.smithi078.stdout:/sys/fs/cgroup 2023-11-28T19:59:16.070 INFO:teuthology.orchestra.run.smithi078.stdout:/sys/fs/pstore 2023-11-28T19:59:16.071 INFO:teuthology.orchestra.run.smithi078.stdout:/sys/fs/bpf 2023-11-28T19:59:16.071 INFO:teuthology.orchestra.run.smithi078.stdout:/proc/sys/fs/binfmt_misc 2023-11-28T19:59:16.071 INFO:teuthology.orchestra.run.smithi078.stdout:/dev/hugepages 2023-11-28T19:59:16.071 INFO:teuthology.orchestra.run.smithi078.stdout:/dev/mqueue 2023-11-28T19:59:16.071 INFO:teuthology.orchestra.run.smithi078.stdout:/sys/kernel/debug 2023-11-28T19:59:16.071 INFO:teuthology.orchestra.run.smithi078.stdout:/sys/kernel/tracing 2023-11-28T19:59:16.071 INFO:teuthology.orchestra.run.smithi078.stdout:/proc/fs/nfsd 2023-11-28T19:59:16.071 INFO:teuthology.orchestra.run.smithi078.stdout:/sys/fs/fuse/connections 2023-11-28T19:59:16.071 INFO:teuthology.orchestra.run.smithi078.stdout:/sys/kernel/config 2023-11-28T19:59:16.072 INFO:teuthology.orchestra.run.smithi078.stdout:/run/credentials/systemd-sysusers.service 2023-11-28T19:59:16.072 INFO:teuthology.orchestra.run.smithi078.stdout:/run/rpc_pipefs 2023-11-28T19:59:16.072 INFO:teuthology.orchestra.run.smithi078.stdout:/run/user/1000 2023-11-28T19:59:16.072 INFO:teuthology.orchestra.run.smithi078.stdout:/var/lib/ceph 2023-11-28T19:59:16.072 INFO:teuthology.orchestra.run.smithi078.stdout:/var/lib/ceph/osd/ceph-0 2023-11-28T19:59:16.072 INFO:teuthology.orchestra.run.smithi078.stdout:/var/lib/ceph/osd/ceph-1 2023-11-28T19:59:16.072 INFO:teuthology.orchestra.run.smithi078.stdout:/var/lib/ceph/osd/ceph-2 2023-11-28T19:59:16.073 INFO:teuthology.orchestra.run.smithi078.stdout:/var/lib/ceph/osd/ceph-3 2023-11-28T19:59:16.073 INFO:teuthology.orchestra.run.smithi078.stdout:/run/netns 2023-11-28T19:59:16.073 INFO:teuthology.orchestra.run.smithi078.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2023-11-28T19:59:16.073 INFO:teuthology.orchestra.run.smithi078.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2023-11-28T19:59:16.073 INFO:teuthology.orchestra.run.smithi078.stdout:/home/ubuntu/cephtest/mnt.admin 2023-11-28T19:59:16.074 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T19:59:16.074 DEBUG:teuthology.orchestra.run.smithi078:> ls /sys/fs/fuse/connections 2023-11-28T19:59:16.124 INFO:teuthology.orchestra.run.smithi078.stdout:43 2023-11-28T19:59:16.124 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [43] 2023-11-28T19:59:16.124 DEBUG:teuthology.orchestra.run.smithi078:> sudo stdin-killer -- python3 -c ' 2023-11-28T19:59:16.124 DEBUG:teuthology.orchestra.run.smithi078:> import glob 2023-11-28T19:59:16.124 DEBUG:teuthology.orchestra.run.smithi078:> import re 2023-11-28T19:59:16.125 DEBUG:teuthology.orchestra.run.smithi078:> import os 2023-11-28T19:59:16.125 DEBUG:teuthology.orchestra.run.smithi078:> import subprocess 2023-11-28T19:59:16.125 DEBUG:teuthology.orchestra.run.smithi078:> 2023-11-28T19:59:16.125 DEBUG:teuthology.orchestra.run.smithi078:> def _find_admin_socket(client_name): 2023-11-28T19:59:16.125 DEBUG:teuthology.orchestra.run.smithi078:> asok_path = "/var/run/ceph/ceph-client.admin.*.asok" 2023-11-28T19:59:16.125 DEBUG:teuthology.orchestra.run.smithi078:> files = glob.glob(asok_path) 2023-11-28T19:59:16.125 DEBUG:teuthology.orchestra.run.smithi078:> mountpoint = "/home/ubuntu/cephtest/mnt.admin" 2023-11-28T19:59:16.125 DEBUG:teuthology.orchestra.run.smithi078:> 2023-11-28T19:59:16.126 DEBUG:teuthology.orchestra.run.smithi078:> # Given a non-glob path, it better be there 2023-11-28T19:59:16.126 DEBUG:teuthology.orchestra.run.smithi078:> if "*" not in asok_path: 2023-11-28T19:59:16.126 DEBUG:teuthology.orchestra.run.smithi078:> assert(len(files) == 1) 2023-11-28T19:59:16.126 DEBUG:teuthology.orchestra.run.smithi078:> return files[0] 2023-11-28T19:59:16.126 DEBUG:teuthology.orchestra.run.smithi078:> 2023-11-28T19:59:16.126 DEBUG:teuthology.orchestra.run.smithi078:> for f in files: 2023-11-28T19:59:16.126 DEBUG:teuthology.orchestra.run.smithi078:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-11-28T19:59:16.126 DEBUG:teuthology.orchestra.run.smithi078:> if os.path.exists("/proc/{0}".format(pid)): 2023-11-28T19:59:16.126 DEBUG:teuthology.orchestra.run.smithi078:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-11-28T19:59:16.126 DEBUG:teuthology.orchestra.run.smithi078:> contents = proc_f.read() 2023-11-28T19:59:16.126 DEBUG:teuthology.orchestra.run.smithi078:> if mountpoint in contents: 2023-11-28T19:59:16.127 DEBUG:teuthology.orchestra.run.smithi078:> return f 2023-11-28T19:59:16.127 DEBUG:teuthology.orchestra.run.smithi078:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-11-28T19:59:16.127 DEBUG:teuthology.orchestra.run.smithi078:> 2023-11-28T19:59:16.127 DEBUG:teuthology.orchestra.run.smithi078:> print(_find_admin_socket("client.admin")) 2023-11-28T19:59:16.127 DEBUG:teuthology.orchestra.run.smithi078:> ' 2023-11-28T19:59:16.259 INFO:teuthology.orchestra.run.smithi078.stdout:/var/run/ceph/ceph-client.admin.42918.asok 2023-11-28T19:59:16.262 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:16 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-11-28T19:59:16.270 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.admin.42918.asok 2023-11-28T19:59:16.271 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T19:59:16.271 DEBUG:teuthology.orchestra.run.smithi078:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.admin.42918.asok status 2023-11-28T19:59:16.443 INFO:teuthology.orchestra.run.smithi078.stdout:{ 2023-11-28T19:59:16.444 INFO:teuthology.orchestra.run.smithi078.stdout: "metadata": { 2023-11-28T19:59:16.444 INFO:teuthology.orchestra.run.smithi078.stdout: "ceph_sha1": "43dd94c190073cf16cff1e711dd7f5a7b1cbc883", 2023-11-28T19:59:16.444 INFO:teuthology.orchestra.run.smithi078.stdout: "ceph_version": "ceph version 18.0.0-7520-g43dd94c1 (43dd94c190073cf16cff1e711dd7f5a7b1cbc883) reef (dev)", 2023-11-28T19:59:16.444 INFO:teuthology.orchestra.run.smithi078.stdout: "entity_id": "admin", 2023-11-28T19:59:16.444 INFO:teuthology.orchestra.run.smithi078.stdout: "hostname": "smithi078", 2023-11-28T19:59:16.444 INFO:teuthology.orchestra.run.smithi078.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.admin", 2023-11-28T19:59:16.444 INFO:teuthology.orchestra.run.smithi078.stdout: "pid": "42918", 2023-11-28T19:59:16.444 INFO:teuthology.orchestra.run.smithi078.stdout: "root": "/" 2023-11-28T19:59:16.444 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2023-11-28T19:59:16.444 INFO:teuthology.orchestra.run.smithi078.stdout: "dentry_count": 0, 2023-11-28T19:59:16.445 INFO:teuthology.orchestra.run.smithi078.stdout: "dentry_pinned_count": 0, 2023-11-28T19:59:16.445 INFO:teuthology.orchestra.run.smithi078.stdout: "id": 4331, 2023-11-28T19:59:16.445 INFO:teuthology.orchestra.run.smithi078.stdout: "inst": { 2023-11-28T19:59:16.445 INFO:teuthology.orchestra.run.smithi078.stdout: "name": { 2023-11-28T19:59:16.445 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "client", 2023-11-28T19:59:16.445 INFO:teuthology.orchestra.run.smithi078.stdout: "num": 4331 2023-11-28T19:59:16.445 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2023-11-28T19:59:16.445 INFO:teuthology.orchestra.run.smithi078.stdout: "addr": { 2023-11-28T19:59:16.445 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "v1", 2023-11-28T19:59:16.446 INFO:teuthology.orchestra.run.smithi078.stdout: "addr": "172.21.15.78:0", 2023-11-28T19:59:16.446 INFO:teuthology.orchestra.run.smithi078.stdout: "nonce": 3578872862 2023-11-28T19:59:16.446 INFO:teuthology.orchestra.run.smithi078.stdout: } 2023-11-28T19:59:16.446 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2023-11-28T19:59:16.446 INFO:teuthology.orchestra.run.smithi078.stdout: "addr": { 2023-11-28T19:59:16.446 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "v1", 2023-11-28T19:59:16.446 INFO:teuthology.orchestra.run.smithi078.stdout: "addr": "172.21.15.78:0", 2023-11-28T19:59:16.446 INFO:teuthology.orchestra.run.smithi078.stdout: "nonce": 3578872862 2023-11-28T19:59:16.446 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2023-11-28T19:59:16.446 INFO:teuthology.orchestra.run.smithi078.stdout: "inst_str": "client.4331 172.21.15.78:0/3578872862", 2023-11-28T19:59:16.447 INFO:teuthology.orchestra.run.smithi078.stdout: "addr_str": "172.21.15.78:0/3578872862", 2023-11-28T19:59:16.447 INFO:teuthology.orchestra.run.smithi078.stdout: "inode_count": 1, 2023-11-28T19:59:16.447 INFO:teuthology.orchestra.run.smithi078.stdout: "mds_epoch": 7, 2023-11-28T19:59:16.447 INFO:teuthology.orchestra.run.smithi078.stdout: "osd_epoch": 25, 2023-11-28T19:59:16.447 INFO:teuthology.orchestra.run.smithi078.stdout: "osd_epoch_barrier": 0, 2023-11-28T19:59:16.447 INFO:teuthology.orchestra.run.smithi078.stdout: "blocklisted": false, 2023-11-28T19:59:16.447 INFO:teuthology.orchestra.run.smithi078.stdout: "fs_name": "cephfs" 2023-11-28T19:59:16.447 INFO:teuthology.orchestra.run.smithi078.stdout:} 2023-11-28T19:59:16.459 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T19:59:16.460 DEBUG:teuthology.orchestra.run.smithi078:> stat --file-system '--printf=%T 2023-11-28T19:59:16.460 DEBUG:teuthology.orchestra.run.smithi078:> ' -- /home/ubuntu/cephtest/mnt.admin 2023-11-28T19:59:16.470 INFO:teuthology.orchestra.run.smithi078.stdout:fuseblk 2023-11-28T19:59:16.470 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.admin 2023-11-28T19:59:16.471 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T19:59:16.471 DEBUG:teuthology.orchestra.run.smithi078:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.admin 2023-11-28T19:59:16.535 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T19:59:16.535 DEBUG:teuthology.orchestra.run.smithi078:> (cd /home/ubuntu/cephtest/mnt.admin && exec bash -c 'setfattr -n ceph.dir.layout.pool -v cephfs_data_ec . && getfattr -n ceph.dir.layout .') 2023-11-28T19:59:16.626 INFO:teuthology.orchestra.run.smithi078.stdout:# file: . 2023-11-28T19:59:16.626 INFO:teuthology.orchestra.run.smithi078.stdout:ceph.dir.layout="stripe_unit=4194304 stripe_count=1 object_size=4194304 pool=cephfs_data_ec" 2023-11-28T19:59:16.626 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-11-28T19:59:16.627 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2023-11-28T19:59:16.627 DEBUG:teuthology.orchestra.run.smithi078:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-28T19:59:16.679 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-28T19:59:16.863 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:16.856+0000 7f49c0596640 1 Processor -- start 2023-11-28T19:59:16.863 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:16.860+0000 7f49c0596640 1 -- start start 2023-11-28T19:59:16.866 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:16.860+0000 7f49c0596640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f49b814e7e0 0x7f49b80c2810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:16.866 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:16.860+0000 7f49c0596640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f49b80c5e10 0x7f49b80a6ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:16.866 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:16.860+0000 7f49c0596640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f49b8155110 con 0x7f49b80a7420 2023-11-28T19:59:16.866 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:16.860+0000 7f49c0596640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f49b8154520 con 0x7f49b814e7e0 2023-11-28T19:59:16.866 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:16.860+0000 7f49c0596640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f49b81547e0 con 0x7f49b80c5e10 2023-11-28T19:59:16.866 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:16.860+0000 7f49be332640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f49b814e7e0 0x7f49b80c2810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:16.866 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:16.860+0000 7f49be332640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f49b814e7e0 0x7f49b80c2810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:60294/0 (socket says 172.21.15.78:60294) 2023-11-28T19:59:16.866 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:16.860+0000 7f49be332640 1 -- 172.21.15.78:0/2222366110 learned_addr learned my addr 172.21.15.78:0/2222366110 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T19:59:16.866 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:16.860+0000 7f49bdb31640 1 --2- 172.21.15.78:0/2222366110 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f49b80c5e10 0x7f49b80a6ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:16.867 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:16.860+0000 7f49be332640 1 -- 172.21.15.78:0/2222366110 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f49b80c5e10 msgr2=0x7f49b80a6ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T19:59:16.867 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:16.860+0000 7f49be332640 1 --2- 172.21.15.78:0/2222366110 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f49b80c5e10 0x7f49b80a6ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:16.868 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:16.860+0000 7f49be332640 1 -- 172.21.15.78:0/2222366110 >> v1:172.21.15.179:6789/0 conn(0x7f49b80a7420 legacy=0x7f49b8157b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T19:59:16.868 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:16.860+0000 7f49be332640 1 -- 172.21.15.78:0/2222366110 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49b8154ac0 con 0x7f49b814e7e0 2023-11-28T19:59:16.868 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:16.860+0000 7f49bdb31640 1 --2- 172.21.15.78:0/2222366110 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f49b80c5e10 0x7f49b80a6ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T19:59:16.869 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:16.864+0000 7f49be332640 1 --2- 172.21.15.78:0/2222366110 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f49b814e7e0 0x7f49b80c2810 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f49b4009870 tx=0x7f49b401ce10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7335e9c66437e54d server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:59:16.869 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:16.864+0000 7f49bd330640 1 -- 172.21.15.78:0/2222366110 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49b40ad640 con 0x7f49b814e7e0 2023-11-28T19:59:16.870 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:16.864+0000 7f49bd330640 1 -- 172.21.15.78:0/2222366110 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f49b40ad7a0 con 0x7f49b814e7e0 2023-11-28T19:59:16.870 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:16.864+0000 7f49bd330640 1 -- 172.21.15.78:0/2222366110 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49b40adb30 con 0x7f49b814e7e0 2023-11-28T19:59:16.870 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:16.864+0000 7f49c0596640 1 -- 172.21.15.78:0/2222366110 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f49b814e7e0 msgr2=0x7f49b80c2810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:16.870 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:16.864+0000 7f49c0596640 1 --2- 172.21.15.78:0/2222366110 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f49b814e7e0 0x7f49b80c2810 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f49b4009870 tx=0x7f49b401ce10 comp rx=0 tx=0).stop 2023-11-28T19:59:16.871 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:16.864+0000 7f49c0596640 1 -- 172.21.15.78:0/2222366110 shutdown_connections 2023-11-28T19:59:16.871 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:16.864+0000 7f49c0596640 1 --2- 172.21.15.78:0/2222366110 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f49b80c5e10 0x7f49b80a6ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:16.871 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:16.864+0000 7f49c0596640 1 --2- 172.21.15.78:0/2222366110 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f49b814e7e0 0x7f49b80c2810 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:16.871 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:16.864+0000 7f49c0596640 1 -- 172.21.15.78:0/2222366110 >> 172.21.15.78:0/2222366110 conn(0x7f49b80c7c60 msgr2=0x7f49b80c8070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T19:59:16.872 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:16.864+0000 7f49c0596640 1 -- 172.21.15.78:0/2222366110 shutdown_connections 2023-11-28T19:59:16.872 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:16.864+0000 7f49c0596640 1 -- 172.21.15.78:0/2222366110 wait complete. 2023-11-28T19:59:16.875 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:16.864+0000 7f49c0596640 1 Processor -- start 2023-11-28T19:59:16.875 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:16.864+0000 7f49c0596640 1 -- start start 2023-11-28T19:59:16.875 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:16.868+0000 7f49c0596640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f49b80a7420 0x7f49b81f0df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:16.875 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:16.868+0000 7f49c0596640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f49b80c5e10 0x7f49b806cb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:16.876 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:16.868+0000 7f49c0596640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f49b814e7e0 0x7f49b806d060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:16.876 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:16.868+0000 7f49c0596640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49b81ee120 con 0x7f49b80a7420 2023-11-28T19:59:16.876 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:16.868+0000 7f49c0596640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49b806c490 con 0x7f49b814e7e0 2023-11-28T19:59:16.877 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:16.868+0000 7f49c0596640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f49b81ed5a0 con 0x7f49b80c5e10 2023-11-28T19:59:16.877 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:16.868+0000 7f49be332640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f49b80a7420 0x7f49b81f0df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:16.877 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:16.868+0000 7f49be332640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f49b80a7420 0x7f49b81f0df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:60304/0 (socket says 172.21.15.78:60304) 2023-11-28T19:59:16.877 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:16.868+0000 7f49be332640 1 -- 172.21.15.78:0/2202930463 learned_addr learned my addr 172.21.15.78:0/2202930463 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T19:59:16.878 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:16.868+0000 7f49bdb31640 1 --2- 172.21.15.78:0/2202930463 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f49b80c5e10 0x7f49b806cb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:16.878 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:16.868+0000 7f49beb33640 1 --2- 172.21.15.78:0/2202930463 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f49b814e7e0 0x7f49b806d060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:16.878 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:16.868+0000 7f49be332640 1 -- 172.21.15.78:0/2202930463 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f49b80c5e10 msgr2=0x7f49b806cb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:16.878 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:16.868+0000 7f49be332640 1 --2- 172.21.15.78:0/2202930463 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f49b80c5e10 0x7f49b806cb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:16.878 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:16.868+0000 7f49be332640 1 -- 172.21.15.78:0/2202930463 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f49b814e7e0 msgr2=0x7f49b806d060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:16.879 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:16.868+0000 7f49be332640 1 --2- 172.21.15.78:0/2202930463 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f49b814e7e0 0x7f49b806d060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:16.879 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:16.868+0000 7f49be332640 1 -- 172.21.15.78:0/2202930463 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49b40094d0 con 0x7f49b80a7420 2023-11-28T19:59:16.879 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:16.868+0000 7f49bdb31640 1 --2- 172.21.15.78:0/2202930463 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f49b80c5e10 0x7f49b806cb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T19:59:16.879 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:16.868+0000 7f49beb33640 1 --2- 172.21.15.78:0/2202930463 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f49b814e7e0 0x7f49b806d060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T19:59:16.880 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:16.868+0000 7f49be332640 1 --2- 172.21.15.78:0/2202930463 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f49b80a7420 0x7f49b81f0df0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f49b40b0040 tx=0x7f49b4019150 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:59:16.880 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:16.868+0000 7f49aeffd640 1 -- 172.21.15.78:0/2202930463 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49b40b6830 con 0x7f49b80a7420 2023-11-28T19:59:16.880 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:16.868+0000 7f49aeffd640 1 -- 172.21.15.78:0/2202930463 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f49b40a6040 con 0x7f49b80a7420 2023-11-28T19:59:16.880 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:16.868+0000 7f49aeffd640 1 -- 172.21.15.78:0/2202930463 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49b40b6bd0 con 0x7f49b80a7420 2023-11-28T19:59:16.880 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:16.868+0000 7f49c0596640 1 -- 172.21.15.78:0/2202930463 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f49b80c2f60 con 0x7f49b80a7420 2023-11-28T19:59:16.881 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:16.868+0000 7f49c0596640 1 -- 172.21.15.78:0/2202930463 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f49b81edb60 con 0x7f49b80a7420 2023-11-28T19:59:16.881 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:16.868+0000 7f49c0596640 1 -- 172.21.15.78:0/2202930463 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f49b8067630 con 0x7f49b80a7420 2023-11-28T19:59:16.881 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:16.868+0000 7f49aeffd640 1 -- 172.21.15.78:0/2202930463 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f49b40b4070 con 0x7f49b80a7420 2023-11-28T19:59:16.881 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:16.872+0000 7f49aeffd640 1 --2- 172.21.15.78:0/2202930463 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f499c066470 0x7f499c068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:16.882 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:16.872+0000 7f49aeffd640 1 -- 172.21.15.78:0/2202930463 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f49b411eb20 con 0x7f49b80a7420 2023-11-28T19:59:16.882 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:16.872+0000 7f49bdb31640 1 --2- 172.21.15.78:0/2202930463 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f499c066470 0x7f499c068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:16.882 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:16.872+0000 7f49bdb31640 1 --2- 172.21.15.78:0/2202930463 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f499c066470 0x7f499c068930 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f49b814e1c0 tx=0x7f49a8008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:59:16.882 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:16.876+0000 7f49aeffd640 1 -- 172.21.15.78:0/2202930463 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f49b40ebcc0 con 0x7f49b80a7420 2023-11-28T19:59:17.035 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:17.032+0000 7f49c0596640 1 -- 172.21.15.78:0/2202930463 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f49b8067630 con 0x7f49b80a7420 2023-11-28T19:59:17.036 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:17.032+0000 7f49aeffd640 1 -- 172.21.15.78:0/2202930463 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+18322 (secure 0 0 0) 0x7f49b40b2020 con 0x7f49b80a7420 2023-11-28T19:59:17.037 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-11-28T19:59:17.037 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":25,"fsid":"dd9780e8-3bda-44fa-a9f0-fa07d19d901d","created":"2023-11-28T19:58:40.969556+0000","modified":"2023-11-28T19:59:10.474525+0000","last_up_change":"2023-11-28T19:58:52.596716+0000","last_in_change":"2023-11-28T19:58:43.609275+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-28T19:58:54.011229+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-28T19:59:03.945559+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-28T19:59:04.481478+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-11-28T19:59:08.109152+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"e84245ac-b5da-429e-af18-39acaa2b33e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6800","nonce":3358701235},{"type":"v1","addr":"172.21.15.78:6801","nonce":3358701235}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6802","nonce":3358701235},{"type":"v1","addr":"172.21.15.78:6803","nonce":3358701235}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6806","nonce":3358701235},{"type":"v1","addr":"172.21.15.78:6807","nonce":3358701235}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6804","nonce":3358701235},{"type":"v1","addr":"172.21.15.78:6805","nonce":3358701235}]},"public_addr":"172.21.15.78:6801/3358701235","cluster_addr":"172.21.15.78:6803/3358701235","heartbeat_back_addr":"172.21.15.78:6807/3358701235","heartbeat_front_addr":"172.21.15.78:6805/3358701235","state":["exists","up"]},{"osd":1,"uuid":"e634831d-c4e2-48d9-870c-9556ae162981","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6808","nonce":3211476654},{"type":"v1","addr":"172.21.15.78:6809","nonce":3211476654}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6810","nonce":3211476654},{"type":"v1","addr":"172.21.15.78:6811","nonce":3211476654}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6814","nonce":3211476654},{"type":"v1","addr":"172.21.15.78:6815","nonce":3211476654}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6812","nonce":3211476654},{"type":"v1","addr":"172.21.15.78:6813","nonce":3211476654}]},"public_addr":"172.21.15.78:6809/3211476654","cluster_addr":"172.21.15.78:6811/3211476654","heartbeat_back_addr":"172.21.15.78:6815/3211476654","heartbeat_front_addr":"172.21.15.78:6813/3211476654","state":["exists","up"]},{"osd":2,"uuid":"274c8395-6534-41f0-b8fb-a00af8985aa8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6816","nonce":2532904479},{"type":"v1","addr":"172.21.15.78:6817","nonce":2532904479}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6818","nonce":2532904479},{"type":"v1","addr":"172.21.15.78:6819","nonce":2532904479}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6822","nonce":2532904479},{"type":"v1","addr":"172.21.15.78:6823","nonce":2532904479}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6820","nonce":2532904479},{"type":"v1","addr":"172.21.15.78:6821","nonce":2532904479}]},"public_addr":"172.21.15.78:6817/2532904479","cluster_addr":"172.21.15.78:6819/2532904479","heartbeat_back_addr":"172.21.15.78:6823/2532904479","heartbeat_front_addr":"172.21.15.78:6821/2532904479","state":["exists","up"]},{"osd":3,"uuid":"77acc9af-7d4d-4b18-8cf5-d62f5971b7c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6824","nonce":3442991267},{"type":"v1","addr":"172.21.15.78:6825","nonce":3442991267}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6826","nonce":3442991267},{"type":"v1","addr":"172.21.15.78:6827","nonce":3442991267}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6830","nonce":3442991267},{"type":"v1","addr":"172.21.15.78:6831","nonce":3442991267}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6828","nonce":3442991267},{"type":"v1","addr":"172.21.15.78:6829","nonce":3442991267}]},"public_addr":"172.21.15.78:6825/3442991267","cluster_addr":"172.21.15.78:6827/3442991267","heartbeat_back_addr":"172.21.15.78:6831/3442991267","heartbeat_front_addr":"172.21.15.78:6829/3442991267","state":["exists","up"]},{"osd":4,"uuid":"5c62bc66-6b34-4b7f-a66b-9a743969138c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":802983577},{"type":"v1","addr":"172.21.15.179:6809","nonce":802983577}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":802983577},{"type":"v1","addr":"172.21.15.179:6811","nonce":802983577}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":802983577},{"type":"v1","addr":"172.21.15.179:6815","nonce":802983577}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":802983577},{"type":"v1","addr":"172.21.15.179:6813","nonce":802983577}]},"public_addr":"172.21.15.179:6809/802983577","cluster_addr":"172.21.15.179:6811/802983577","heartbeat_back_addr":"172.21.15.179:6815/802983577","heartbeat_front_addr":"172.21.15.179:6813/802983577","state":["exists","up"]},{"osd":5,"uuid":"67db6d36-f684-4079-b0cd-82b4dd61461f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":518192887},{"type":"v1","addr":"172.21.15.179:6818","nonce":518192887}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":518192887},{"type":"v1","addr":"172.21.15.179:6822","nonce":518192887}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":518192887},{"type":"v1","addr":"172.21.15.179:6829","nonce":518192887}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6824","nonce":518192887},{"type":"v1","addr":"172.21.15.179:6826","nonce":518192887}]},"public_addr":"172.21.15.179:6818/518192887","cluster_addr":"172.21.15.179:6822/518192887","heartbeat_back_addr":"172.21.15.179:6829/518192887","heartbeat_front_addr":"172.21.15.179:6826/518192887","state":["exists","up"]},{"osd":6,"uuid":"12e670af-5a16-4c81-9f97-defa66cab967","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":815435378},{"type":"v1","addr":"172.21.15.179:6801","nonce":815435378}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":815435378},{"type":"v1","addr":"172.21.15.179:6803","nonce":815435378}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":815435378},{"type":"v1","addr":"172.21.15.179:6807","nonce":815435378}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":815435378},{"type":"v1","addr":"172.21.15.179:6805","nonce":815435378}]},"public_addr":"172.21.15.179:6801/815435378","cluster_addr":"172.21.15.179:6803/815435378","heartbeat_back_addr":"172.21.15.179:6807/815435378","heartbeat_front_addr":"172.21.15.179:6805/815435378","state":["exists","up"]},{"osd":7,"uuid":"fe630650-2eb3-49ad-8676-c341e6332eb1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6817","nonce":2848432339},{"type":"v1","addr":"172.21.15.179:6819","nonce":2848432339}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6821","nonce":2848432339},{"type":"v1","addr":"172.21.15.179:6823","nonce":2848432339}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":2848432339},{"type":"v1","addr":"172.21.15.179:6831","nonce":2848432339}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6825","nonce":2848432339},{"type":"v1","addr":"172.21.15.179:6827","nonce":2848432339}]},"public_addr":"172.21.15.179:6819/2848432339","cluster_addr":"172.21.15.179:6823/2848432339","heartbeat_back_addr":"172.21.15.179:6831/2848432339","heartbeat_front_addr":"172.21.15.179:6827/2848432339","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:58:49.255433+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:58:49.412880+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:58:49.559295+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:58:49.245237+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:58:49.184557+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:58:49.329851+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:58:49.366012+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:58:49.349604+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-28T19:59:17.039 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:17.032+0000 7f49c0596640 1 -- 172.21.15.78:0/2202930463 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f499c066470 msgr2=0x7f499c068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:17.039 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:17.032+0000 7f49c0596640 1 --2- 172.21.15.78:0/2202930463 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f499c066470 0x7f499c068930 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f49b814e1c0 tx=0x7f49a8008040 comp rx=0 tx=0).stop 2023-11-28T19:59:17.040 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:17.032+0000 7f49c0596640 1 -- 172.21.15.78:0/2202930463 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f49b80a7420 msgr2=0x7f49b81f0df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:17.040 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:17.032+0000 7f49c0596640 1 --2- 172.21.15.78:0/2202930463 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f49b80a7420 0x7f49b81f0df0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f49b40b0040 tx=0x7f49b4019150 comp rx=0 tx=0).stop 2023-11-28T19:59:17.041 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:17.032+0000 7f49c0596640 1 -- 172.21.15.78:0/2202930463 shutdown_connections 2023-11-28T19:59:17.041 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:17.032+0000 7f49c0596640 1 --2- 172.21.15.78:0/2202930463 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f499c066470 0x7f499c068930 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:17.041 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:17.032+0000 7f49c0596640 1 --2- 172.21.15.78:0/2202930463 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f49b80c5e10 0x7f49b806cb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:17.041 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:17.032+0000 7f49c0596640 1 --2- 172.21.15.78:0/2202930463 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f49b814e7e0 0x7f49b806d060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:17.041 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:17.032+0000 7f49c0596640 1 --2- 172.21.15.78:0/2202930463 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f49b80a7420 0x7f49b81f0df0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:17.042 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:17.032+0000 7f49c0596640 1 -- 172.21.15.78:0/2202930463 >> 172.21.15.78:0/2202930463 conn(0x7f49b80c7c60 msgr2=0x7f49b80c6b80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T19:59:17.042 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:17.032+0000 7f49c0596640 1 -- 172.21.15.78:0/2202930463 shutdown_connections 2023-11-28T19:59:17.042 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:17.032+0000 7f49c0596640 1 -- 172.21.15.78:0/2202930463 wait complete. 2023-11-28T19:59:17.058 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-28T19:58:54.011229+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-28T19:59:03.945559+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-11-28T19:59:04.481478+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-11-28T19:59:08.109152+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-11-28T19:59:17.059 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-28T19:59:17.199 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:17.196+0000 7feeb6c32640 1 Processor -- start 2023-11-28T19:59:17.199 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:17.196+0000 7feeb6c32640 1 -- start start 2023-11-28T19:59:17.201 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:17.196+0000 7feeb6c32640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7feeb014f850 0x7feeb00aacf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:17.201 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:17.196+0000 7feeb6c32640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7feeb014fc30 0x7feeb00c3cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:17.201 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:17.196+0000 7feeb6c32640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feeb0152910 con 0x7feeb006d840 2023-11-28T19:59:17.201 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:17.196+0000 7feeb6c32640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feeb00c2240 con 0x7feeb014fc30 2023-11-28T19:59:17.201 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:17.196+0000 7feeb6c32640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feeb0152bf0 con 0x7feeb014f850 2023-11-28T19:59:17.201 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:17.196+0000 7feeaffff640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7feeb014fc30 0x7feeb00c3cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:17.201 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:17.196+0000 7feeb51cf640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7feeb006d840 0x7feeb00c4210 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:35160/0 (socket says 172.21.15.78:35160) 2023-11-28T19:59:17.201 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:17.196+0000 7feeb51cf640 1 -- 172.21.15.78:0/2148996966 learned_addr learned my addr 172.21.15.78:0/2148996966 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-11-28T19:59:17.201 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:17.196+0000 7feeb49ce640 1 --2- 172.21.15.78:0/2148996966 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7feeb014f850 0x7feeb00aacf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:17.201 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:17.196+0000 7feeaffff640 1 -- 172.21.15.78:0/2148996966 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7feeb014f850 msgr2=0x7feeb00aacf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T19:59:17.202 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:17.196+0000 7feeaffff640 1 --2- 172.21.15.78:0/2148996966 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7feeb014f850 0x7feeb00aacf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:17.202 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:17.196+0000 7feeaffff640 1 -- 172.21.15.78:0/2148996966 >> v1:172.21.15.78:6789/0 conn(0x7feeb006d840 legacy=0x7feeb00c4210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:17.202 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:17.196+0000 7feeaffff640 1 -- 172.21.15.78:0/2148996966 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feeb0152ed0 con 0x7feeb014fc30 2023-11-28T19:59:17.202 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:17.196+0000 7feeaf7fe640 1 -- 172.21.15.78:0/2148996966 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3983257317 0 0) 0x7feeb0152910 con 0x7feeb006d840 2023-11-28T19:59:17.204 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:17.200+0000 7feeaffff640 1 --2- 172.21.15.78:0/2148996966 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7feeb014fc30 0x7feeb00c3cd0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fee9c0097c0 tx=0x7fee9c01c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3f081198d957252e server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:59:17.204 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:17.200+0000 7feeaf7fe640 1 -- 172.21.15.78:0/2148996966 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee9c0a6040 con 0x7feeb014fc30 2023-11-28T19:59:17.204 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:17.200+0000 7feeaf7fe640 1 -- 172.21.15.78:0/2148996966 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee9c0aa600 con 0x7feeb014fc30 2023-11-28T19:59:17.204 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:17.200+0000 7feeaf7fe640 1 -- 172.21.15.78:0/2148996966 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee9c0aa990 con 0x7feeb014fc30 2023-11-28T19:59:17.206 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:17.200+0000 7feeb6c32640 1 -- 172.21.15.78:0/2148996966 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7feeb014fc30 msgr2=0x7feeb00c3cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:17.206 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:17.200+0000 7feeb6c32640 1 --2- 172.21.15.78:0/2148996966 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7feeb014fc30 0x7feeb00c3cd0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fee9c0097c0 tx=0x7fee9c01c480 comp rx=0 tx=0).stop 2023-11-28T19:59:17.206 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:17.200+0000 7feeb6c32640 1 -- 172.21.15.78:0/2148996966 shutdown_connections 2023-11-28T19:59:17.206 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:17.200+0000 7feeb6c32640 1 --2- 172.21.15.78:0/2148996966 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7feeb014fc30 0x7feeb00c3cd0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:17.206 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:17.200+0000 7feeb6c32640 1 --2- 172.21.15.78:0/2148996966 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7feeb014f850 0x7feeb00aacf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:17.207 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:17.200+0000 7feeb6c32640 1 -- 172.21.15.78:0/2148996966 >> 172.21.15.78:0/2148996966 conn(0x7feeb00c59f0 msgr2=0x7feeb00c5e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T19:59:17.207 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:17.200+0000 7feeb6c32640 1 -- 172.21.15.78:0/2148996966 shutdown_connections 2023-11-28T19:59:17.207 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:17.200+0000 7feeb6c32640 1 -- 172.21.15.78:0/2148996966 wait complete. 2023-11-28T19:59:17.212 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:17.200+0000 7feeb6c32640 1 Processor -- start 2023-11-28T19:59:17.212 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:17.200+0000 7feeb6c32640 1 -- start start 2023-11-28T19:59:17.212 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:17.204+0000 7feeb6c32640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7feeb006d840 0x7feeb014b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:17.212 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:17.204+0000 7feeb6c32640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7feeb014f850 0x7feeb0154450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:17.212 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:17.204+0000 7feeb6c32640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7feeb014fc30 0x7feeb00c6030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:17.212 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:17.204+0000 7feeb6c32640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feeb0153fc0 con 0x7feeb014fc30 2023-11-28T19:59:17.213 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:17.204+0000 7feeb6c32640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feeb0072b30 con 0x7feeb006d840 2023-11-28T19:59:17.213 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:17.204+0000 7feeb6c32640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feeb0072850 con 0x7feeb014f850 2023-11-28T19:59:17.213 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:17.204+0000 7feeb51cf640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7feeb014fc30 0x7feeb00c6030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:17.213 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:17.204+0000 7feeb51cf640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7feeb014fc30 0x7feeb00c6030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:60320/0 (socket says 172.21.15.78:60320) 2023-11-28T19:59:17.213 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:17.204+0000 7feeb51cf640 1 -- 172.21.15.78:0/814687058 learned_addr learned my addr 172.21.15.78:0/814687058 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T19:59:17.213 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:17.204+0000 7feeb49ce640 1 --2- 172.21.15.78:0/814687058 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7feeb006d840 0x7feeb014b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:17.214 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:17.204+0000 7feeaffff640 1 --2- 172.21.15.78:0/814687058 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7feeb014f850 0x7feeb0154450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:17.214 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:17.204+0000 7feeb51cf640 1 -- 172.21.15.78:0/814687058 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7feeb014f850 msgr2=0x7feeb0154450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:17.214 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:17.204+0000 7feeb51cf640 1 --2- 172.21.15.78:0/814687058 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7feeb014f850 0x7feeb0154450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:17.214 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:17.204+0000 7feeb51cf640 1 -- 172.21.15.78:0/814687058 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7feeb006d840 msgr2=0x7feeb014b9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:17.214 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:17.204+0000 7feeb51cf640 1 --2- 172.21.15.78:0/814687058 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7feeb006d840 0x7feeb014b9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:17.215 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:17.204+0000 7feeb51cf640 1 -- 172.21.15.78:0/814687058 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee9c009420 con 0x7feeb014fc30 2023-11-28T19:59:17.215 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:17.204+0000 7feeb51cf640 1 --2- 172.21.15.78:0/814687058 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7feeb014fc30 0x7feeb00c6030 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7feea800c780 tx=0x7feea800cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:59:17.215 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:17.204+0000 7feead7fa640 1 -- 172.21.15.78:0/814687058 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feea800ce90 con 0x7feeb014fc30 2023-11-28T19:59:17.215 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:17.204+0000 7feead7fa640 1 -- 172.21.15.78:0/814687058 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feea800a640 con 0x7feeb014fc30 2023-11-28T19:59:17.215 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:17.204+0000 7feeb6c32640 1 -- 172.21.15.78:0/814687058 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feeb0156f40 con 0x7feeb014fc30 2023-11-28T19:59:17.215 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:17.204+0000 7feead7fa640 1 -- 172.21.15.78:0/814687058 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feea800aa70 con 0x7feeb014fc30 2023-11-28T19:59:17.215 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:17.204+0000 7feeb6c32640 1 -- 172.21.15.78:0/814687058 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feeb00c6570 con 0x7feeb014fc30 2023-11-28T19:59:17.216 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:17.204+0000 7feeb6c32640 1 -- 172.21.15.78:0/814687058 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feeb0157460 con 0x7feeb014fc30 2023-11-28T19:59:17.216 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:17.208+0000 7feead7fa640 1 -- 172.21.15.78:0/814687058 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7feea800abd0 con 0x7feeb014fc30 2023-11-28T19:59:17.216 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:17.208+0000 7feead7fa640 1 --2- 172.21.15.78:0/814687058 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fee94066470 0x7fee94068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:17.216 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:17.208+0000 7feead7fa640 1 -- 172.21.15.78:0/814687058 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7feea8083660 con 0x7feeb014fc30 2023-11-28T19:59:17.216 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:17.208+0000 7feeb49ce640 1 --2- 172.21.15.78:0/814687058 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fee94066470 0x7fee94068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:17.217 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:17.208+0000 7feeb49ce640 1 --2- 172.21.15.78:0/814687058 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fee94066470 0x7fee94068930 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7feea4007a60 tx=0x7feea4008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:59:17.217 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:17.212+0000 7feead7fa640 1 -- 172.21.15.78:0/814687058 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7feea8050890 con 0x7feeb014fc30 2023-11-28T19:59:17.365 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:17.360+0000 7feeb6c32640 1 -- 172.21.15.78:0/814687058 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7feeb0154170 con 0x7feeb014fc30 2023-11-28T19:59:17.365 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:17.360+0000 7feead7fa640 1 -- 172.21.15.78:0/814687058 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v25) v1 ==== 93+0+10 (secure 0 0 0) 0x7feea80180a0 con 0x7feeb014fc30 2023-11-28T19:59:17.365 INFO:teuthology.orchestra.run.smithi078.stdout:pg_num: 1 2023-11-28T19:59:17.367 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:17.360+0000 7feeb6c32640 1 -- 172.21.15.78:0/814687058 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fee94066470 msgr2=0x7fee94068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:17.367 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:17.360+0000 7feeb6c32640 1 --2- 172.21.15.78:0/814687058 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fee94066470 0x7fee94068930 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7feea4007a60 tx=0x7feea4008040 comp rx=0 tx=0).stop 2023-11-28T19:59:17.367 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:17.360+0000 7feeb6c32640 1 -- 172.21.15.78:0/814687058 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7feeb014fc30 msgr2=0x7feeb00c6030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:17.368 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:17.360+0000 7feeb6c32640 1 --2- 172.21.15.78:0/814687058 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7feeb014fc30 0x7feeb00c6030 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7feea800c780 tx=0x7feea800cc40 comp rx=0 tx=0).stop 2023-11-28T19:59:17.368 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:17.360+0000 7feeb6c32640 1 -- 172.21.15.78:0/814687058 shutdown_connections 2023-11-28T19:59:17.368 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:17.360+0000 7feeb6c32640 1 --2- 172.21.15.78:0/814687058 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fee94066470 0x7fee94068930 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:17.368 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:17.360+0000 7feeb6c32640 1 --2- 172.21.15.78:0/814687058 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7feeb014f850 0x7feeb0154450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:17.368 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:17.360+0000 7feeb6c32640 1 --2- 172.21.15.78:0/814687058 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7feeb014fc30 0x7feeb00c6030 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:17.368 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:17.360+0000 7feeb6c32640 1 --2- 172.21.15.78:0/814687058 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7feeb006d840 0x7feeb014b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:17.368 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:17.360+0000 7feeb6c32640 1 -- 172.21.15.78:0/814687058 >> 172.21.15.78:0/814687058 conn(0x7feeb00c59f0 msgr2=0x7feeb01519f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T19:59:17.368 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:17.360+0000 7feeb6c32640 1 -- 172.21.15.78:0/814687058 shutdown_connections 2023-11-28T19:59:17.368 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:17.360+0000 7feeb6c32640 1 -- 172.21.15.78:0/814687058 wait complete. 2023-11-28T19:59:17.385 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-28T19:59:17.525 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:17.520+0000 7f316ed2a640 1 Processor -- start 2023-11-28T19:59:17.525 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:17.520+0000 7f316ed2a640 1 -- start start 2023-11-28T19:59:17.526 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:17.520+0000 7f316ed2a640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f316814e2a0 0x7f31681516a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:17.526 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:17.520+0000 7f316ed2a640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f31680a9910 0x7f316806bc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:17.526 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:17.520+0000 7f316ed2a640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3168151210 con 0x7f31680a9460 2023-11-28T19:59:17.527 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:17.520+0000 7f316ed2a640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f316814e680 con 0x7f316814e2a0 2023-11-28T19:59:17.527 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:17.520+0000 7f316ed2a640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3168150be0 con 0x7f31680a9910 2023-11-28T19:59:17.527 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:17.520+0000 7f316cac6640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f316814e2a0 0x7f31681516a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:17.527 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:17.520+0000 7f3167fff640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f31680a9460 0x7f31680c4180 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:35162/0 (socket says 172.21.15.78:35162) 2023-11-28T19:59:17.527 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:17.520+0000 7f3167fff640 1 -- 172.21.15.78:0/606332765 learned_addr learned my addr 172.21.15.78:0/606332765 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-11-28T19:59:17.528 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:17.524+0000 7f316d2c7640 1 --2- 172.21.15.78:0/606332765 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f31680a9910 0x7f316806bc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:17.528 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:17.524+0000 7f316cac6640 1 -- 172.21.15.78:0/606332765 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f31680a9910 msgr2=0x7f316806bc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T19:59:17.528 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:17.524+0000 7f316cac6640 1 --2- 172.21.15.78:0/606332765 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f31680a9910 0x7f316806bc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:17.528 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:17.524+0000 7f316cac6640 1 -- 172.21.15.78:0/606332765 >> v1:172.21.15.78:6789/0 conn(0x7f31680a9460 legacy=0x7f31680c4180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:17.528 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:17.524+0000 7f316cac6640 1 -- 172.21.15.78:0/606332765 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31680c53c0 con 0x7f316814e2a0 2023-11-28T19:59:17.528 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:17.524+0000 7f31677fe640 1 -- 172.21.15.78:0/606332765 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 565023745 0 0) 0x7f3168151210 con 0x7f31680a9460 2023-11-28T19:59:17.529 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:17.524+0000 7f316d2c7640 1 --2- 172.21.15.78:0/606332765 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f31680a9910 0x7f316806bc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T19:59:17.531 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:17.524+0000 7f316cac6640 1 --2- 172.21.15.78:0/606332765 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f316814e2a0 0x7f31681516a0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f315c00a960 tx=0x7f315c01d850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=540d4c7319f9d90 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:59:17.531 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:17.524+0000 7f31677fe640 1 -- 172.21.15.78:0/606332765 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f315c0a76b0 con 0x7f316814e2a0 2023-11-28T19:59:17.531 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:17.524+0000 7f31677fe640 1 -- 172.21.15.78:0/606332765 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f315c0a7810 con 0x7f316814e2a0 2023-11-28T19:59:17.531 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:17.524+0000 7f31677fe640 1 -- 172.21.15.78:0/606332765 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f315c0a7ba0 con 0x7f316814e2a0 2023-11-28T19:59:17.531 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:17.524+0000 7f316ed2a640 1 -- 172.21.15.78:0/606332765 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f316814e2a0 msgr2=0x7f31681516a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:17.532 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:17.524+0000 7f316ed2a640 1 --2- 172.21.15.78:0/606332765 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f316814e2a0 0x7f31681516a0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f315c00a960 tx=0x7f315c01d850 comp rx=0 tx=0).stop 2023-11-28T19:59:17.532 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:17.528+0000 7f316ed2a640 1 -- 172.21.15.78:0/606332765 shutdown_connections 2023-11-28T19:59:17.532 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:17.528+0000 7f316ed2a640 1 --2- 172.21.15.78:0/606332765 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f31680a9910 0x7f316806bc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:17.532 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:17.528+0000 7f316ed2a640 1 --2- 172.21.15.78:0/606332765 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f316814e2a0 0x7f31681516a0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:17.532 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:17.528+0000 7f316ed2a640 1 -- 172.21.15.78:0/606332765 >> 172.21.15.78:0/606332765 conn(0x7f31680c59f0 msgr2=0x7f31680c5e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T19:59:17.532 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:17.528+0000 7f316ed2a640 1 -- 172.21.15.78:0/606332765 shutdown_connections 2023-11-28T19:59:17.532 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:17.528+0000 7f316ed2a640 1 -- 172.21.15.78:0/606332765 wait complete. 2023-11-28T19:59:17.536 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:17.528+0000 7f316ed2a640 1 Processor -- start 2023-11-28T19:59:17.536 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:17.528+0000 7f316ed2a640 1 -- start start 2023-11-28T19:59:17.536 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:17.528+0000 7f316ed2a640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f31680a9460 0x7f3168159ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:17.536 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:17.528+0000 7f316ed2a640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f31680a9910 0x7f3168147b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:17.536 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:17.528+0000 7f316ed2a640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f316814e2a0 0x7f3168148060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:17.536 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:17.528+0000 7f316ed2a640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31681f03d0 con 0x7f31680a9460 2023-11-28T19:59:17.536 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:17.528+0000 7f316ed2a640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31681f1230 con 0x7f316814e2a0 2023-11-28T19:59:17.536 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:17.528+0000 7f316ed2a640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31681f0620 con 0x7f31680a9910 2023-11-28T19:59:17.536 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:17.528+0000 7f316cac6640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f31680a9460 0x7f3168159ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:17.537 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:17.528+0000 7f316cac6640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f31680a9460 0x7f3168159ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:60342/0 (socket says 172.21.15.78:60342) 2023-11-28T19:59:17.537 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:17.528+0000 7f316cac6640 1 -- 172.21.15.78:0/3648955137 learned_addr learned my addr 172.21.15.78:0/3648955137 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T19:59:17.537 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:17.528+0000 7f3167fff640 1 --2- 172.21.15.78:0/3648955137 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f31680a9910 0x7f3168147b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:17.537 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:17.528+0000 7f316d2c7640 1 --2- 172.21.15.78:0/3648955137 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f316814e2a0 0x7f3168148060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:17.537 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:17.528+0000 7f316cac6640 1 -- 172.21.15.78:0/3648955137 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f31680a9910 msgr2=0x7f3168147b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:17.537 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:17.528+0000 7f316cac6640 1 --2- 172.21.15.78:0/3648955137 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f31680a9910 0x7f3168147b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:17.537 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:17.528+0000 7f316cac6640 1 -- 172.21.15.78:0/3648955137 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f316814e2a0 msgr2=0x7f3168148060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:17.537 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:17.528+0000 7f316cac6640 1 --2- 172.21.15.78:0/3648955137 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f316814e2a0 0x7f3168148060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:17.538 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:17.528+0000 7f316cac6640 1 -- 172.21.15.78:0/3648955137 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f315c00a5c0 con 0x7f31680a9460 2023-11-28T19:59:17.538 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:17.528+0000 7f3167fff640 1 --2- 172.21.15.78:0/3648955137 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f31680a9910 0x7f3168147b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T19:59:17.538 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:17.528+0000 7f316d2c7640 1 --2- 172.21.15.78:0/3648955137 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f316814e2a0 0x7f3168148060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T19:59:17.538 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:17.528+0000 7f316cac6640 1 --2- 172.21.15.78:0/3648955137 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f31680a9460 0x7f3168159ac0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f315c00a960 tx=0x7f315c01a5f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:59:17.538 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:17.532+0000 7f31657fa640 1 -- 172.21.15.78:0/3648955137 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f315c0b8660 con 0x7f31680a9460 2023-11-28T19:59:17.538 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:17.532+0000 7f31657fa640 1 -- 172.21.15.78:0/3648955137 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f315c0b87c0 con 0x7f31680a9460 2023-11-28T19:59:17.538 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:17.532+0000 7f31657fa640 1 -- 172.21.15.78:0/3648955137 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f315c0b8b70 con 0x7f31680a9460 2023-11-28T19:59:17.538 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:17.532+0000 7f316ed2a640 1 -- 172.21.15.78:0/3648955137 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f31681f0900 con 0x7f31680a9460 2023-11-28T19:59:17.539 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:17.532+0000 7f316ed2a640 1 -- 172.21.15.78:0/3648955137 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f31681f0ec0 con 0x7f31680a9460 2023-11-28T19:59:17.539 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:17.532+0000 7f316ed2a640 1 -- 172.21.15.78:0/3648955137 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3168067630 con 0x7f31680a9460 2023-11-28T19:59:17.540 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:17.532+0000 7f31657fa640 1 -- 172.21.15.78:0/3648955137 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f315c0b8cd0 con 0x7f31680a9460 2023-11-28T19:59:17.540 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:17.532+0000 7f31657fa640 1 --2- 172.21.15.78:0/3648955137 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f314c066470 0x7f314c068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:17.540 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:17.532+0000 7f31657fa640 1 -- 172.21.15.78:0/3648955137 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f315c0ab070 con 0x7f31680a9460 2023-11-28T19:59:17.541 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:17.532+0000 7f3167fff640 1 --2- 172.21.15.78:0/3648955137 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f314c066470 0x7f314c068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:17.541 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:17.532+0000 7f3167fff640 1 --2- 172.21.15.78:0/3648955137 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f314c066470 0x7f314c068930 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f316815ac90 tx=0x7f3154009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:59:17.542 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:17.536+0000 7f31657fa640 1 -- 172.21.15.78:0/3648955137 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f315c0ebf40 con 0x7f31680a9460 2023-11-28T19:59:17.690 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:17.684+0000 7f316ed2a640 1 -- 172.21.15.78:0/3648955137 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f31680c5100 con 0x7f31680a9460 2023-11-28T19:59:17.691 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:17.688+0000 7f31657fa640 1 -- 172.21.15.78:0/3648955137 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v25) v1 ==== 104+0+11 (secure 0 0 0) 0x7f315c0ef560 con 0x7f31680a9460 2023-11-28T19:59:17.691 INFO:teuthology.orchestra.run.smithi078.stdout:pg_num: 32 2023-11-28T19:59:17.693 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:17.688+0000 7f316ed2a640 1 -- 172.21.15.78:0/3648955137 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f314c066470 msgr2=0x7f314c068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:17.693 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:17.688+0000 7f316ed2a640 1 --2- 172.21.15.78:0/3648955137 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f314c066470 0x7f314c068930 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f316815ac90 tx=0x7f3154009040 comp rx=0 tx=0).stop 2023-11-28T19:59:17.693 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:17.688+0000 7f316ed2a640 1 -- 172.21.15.78:0/3648955137 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f31680a9460 msgr2=0x7f3168159ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:17.693 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:17.688+0000 7f316ed2a640 1 --2- 172.21.15.78:0/3648955137 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f31680a9460 0x7f3168159ac0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f315c00a960 tx=0x7f315c01a5f0 comp rx=0 tx=0).stop 2023-11-28T19:59:17.694 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:17.688+0000 7f316ed2a640 1 -- 172.21.15.78:0/3648955137 shutdown_connections 2023-11-28T19:59:17.694 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:17.688+0000 7f316ed2a640 1 --2- 172.21.15.78:0/3648955137 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f314c066470 0x7f314c068930 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:17.694 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:17.688+0000 7f316ed2a640 1 --2- 172.21.15.78:0/3648955137 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f31680a9910 0x7f3168147b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:17.694 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:17.688+0000 7f316ed2a640 1 --2- 172.21.15.78:0/3648955137 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f316814e2a0 0x7f3168148060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:17.694 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:17.688+0000 7f316ed2a640 1 --2- 172.21.15.78:0/3648955137 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f31680a9460 0x7f3168159ac0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:17.694 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:17.688+0000 7f316ed2a640 1 -- 172.21.15.78:0/3648955137 >> 172.21.15.78:0/3648955137 conn(0x7f31680c59f0 msgr2=0x7f316814aff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T19:59:17.694 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:17.688+0000 7f316ed2a640 1 -- 172.21.15.78:0/3648955137 shutdown_connections 2023-11-28T19:59:17.694 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:17.688+0000 7f316ed2a640 1 -- 172.21.15.78:0/3648955137 wait complete. 2023-11-28T19:59:17.712 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-28T19:59:17.853 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:17.848+0000 7f1d2469e640 1 Processor -- start 2023-11-28T19:59:17.853 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:17.848+0000 7f1d2469e640 1 -- start start 2023-11-28T19:59:17.854 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:17.848+0000 7f1d2469e640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1d1c14fc30 0x7f1d1c0c3cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:17.854 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:17.848+0000 7f1d2469e640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f1d1c06d840 0x7f1d1c0c4210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:17.854 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:17.848+0000 7f1d2469e640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1d1c152910 con 0x7f1d1c14f850 2023-11-28T19:59:17.854 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:17.848+0000 7f1d2469e640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1d1c0c2240 con 0x7f1d1c06d840 2023-11-28T19:59:17.855 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:17.848+0000 7f1d2469e640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d1c152bf0 con 0x7f1d1c14fc30 2023-11-28T19:59:17.855 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:17.852+0000 7f1d21c39640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1d1c14fc30 0x7f1d1c0c3cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:17.855 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:17.852+0000 7f1d22c3b640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f1d1c06d840 0x7f1d1c0c4210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:17.856 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:17.852+0000 7f1d22c3b640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f1d1c06d840 0x7f1d1c0c4210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.78:43206/0 (socket says 172.21.15.78:43206) 2023-11-28T19:59:17.856 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:17.852+0000 7f1d22c3b640 1 -- 172.21.15.78:0/3046945710 learned_addr learned my addr 172.21.15.78:0/3046945710 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T19:59:17.856 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:17.852+0000 7f1d21c39640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1d1c14fc30 0x7f1d1c0c3cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3301/0 says I am v2:172.21.15.78:41540/0 (socket says 172.21.15.78:41540) 2023-11-28T19:59:17.856 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:17.852+0000 7f1d22c3b640 1 -- 172.21.15.78:0/3046945710 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1d1c14fc30 msgr2=0x7f1d1c0c3cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T19:59:17.856 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:17.852+0000 7f1d22c3b640 1 --2- 172.21.15.78:0/3046945710 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1d1c14fc30 0x7f1d1c0c3cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:17.856 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:17.852+0000 7f1d22c3b640 1 -- 172.21.15.78:0/3046945710 >> v1:172.21.15.179:6789/0 conn(0x7f1d1c14f850 legacy=0x7f1d1c0aacf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:17.856 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:17.852+0000 7f1d22c3b640 1 -- 172.21.15.78:0/3046945710 --> v2:172.21.15.179:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d1c152ed0 con 0x7f1d1c06d840 2023-11-28T19:59:17.856 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:17.852+0000 7f1d21c39640 1 --2- 172.21.15.78:0/3046945710 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1d1c14fc30 0x7f1d1c0c3cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T19:59:17.859 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:17.852+0000 7f1d22c3b640 1 --2- 172.21.15.78:0/3046945710 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1d1c06d840 0x7f1d1c0c4210 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f1d14009e50 tx=0x7f1d1401ca10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e6697cc9155cab95 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:59:17.859 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:17.856+0000 7f1d21438640 1 -- 172.21.15.78:0/3046945710 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d140a5810 con 0x7f1d1c06d840 2023-11-28T19:59:17.859 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:17.856+0000 7f1d21438640 1 -- 172.21.15.78:0/3046945710 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d140a5970 con 0x7f1d1c06d840 2023-11-28T19:59:17.859 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:17.856+0000 7f1d21438640 1 -- 172.21.15.78:0/3046945710 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d140a5d00 con 0x7f1d1c06d840 2023-11-28T19:59:17.860 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:17.856+0000 7f1d2469e640 1 -- 172.21.15.78:0/3046945710 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1d1c06d840 msgr2=0x7f1d1c0c4210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:17.861 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:17.856+0000 7f1d2469e640 1 --2- 172.21.15.78:0/3046945710 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1d1c06d840 0x7f1d1c0c4210 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f1d14009e50 tx=0x7f1d1401ca10 comp rx=0 tx=0).stop 2023-11-28T19:59:17.861 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:17.856+0000 7f1d2469e640 1 -- 172.21.15.78:0/3046945710 shutdown_connections 2023-11-28T19:59:17.861 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:17.856+0000 7f1d2469e640 1 --2- 172.21.15.78:0/3046945710 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1d1c06d840 0x7f1d1c0c4210 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:17.861 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:17.856+0000 7f1d2469e640 1 --2- 172.21.15.78:0/3046945710 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1d1c14fc30 0x7f1d1c0c3cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:17.861 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:17.856+0000 7f1d2469e640 1 -- 172.21.15.78:0/3046945710 >> 172.21.15.78:0/3046945710 conn(0x7f1d1c0c59f0 msgr2=0x7f1d1c0c5e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T19:59:17.861 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:17.856+0000 7f1d2469e640 1 -- 172.21.15.78:0/3046945710 shutdown_connections 2023-11-28T19:59:17.861 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:17.856+0000 7f1d2469e640 1 -- 172.21.15.78:0/3046945710 wait complete. 2023-11-28T19:59:17.865 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:17.856+0000 7f1d2469e640 1 Processor -- start 2023-11-28T19:59:17.865 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:17.856+0000 7f1d2469e640 1 -- start start 2023-11-28T19:59:17.866 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:17.856+0000 7f1d2469e640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1d1c06d840 0x7f1d1c14a3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:17.866 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:17.856+0000 7f1d2469e640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1d1c14f850 0x7f1d1c144ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:17.866 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:17.856+0000 7f1d2469e640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1d1c14fc30 0x7f1d1c14cfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:17.866 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:17.856+0000 7f1d2469e640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d1c14c1c0 con 0x7f1d1c14fc30 2023-11-28T19:59:17.866 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:17.856+0000 7f1d2469e640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d1c0a62a0 con 0x7f1d1c14f850 2023-11-28T19:59:17.867 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:17.856+0000 7f1d2469e640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d1c0c4d40 con 0x7f1d1c06d840 2023-11-28T19:59:17.867 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:17.856+0000 7f1d22c3b640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1d1c14fc30 0x7f1d1c14cfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:17.867 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:17.856+0000 7f1d22c3b640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1d1c14fc30 0x7f1d1c14cfd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:60346/0 (socket says 172.21.15.78:60346) 2023-11-28T19:59:17.867 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:17.856+0000 7f1d22c3b640 1 -- 172.21.15.78:0/2967161720 learned_addr learned my addr 172.21.15.78:0/2967161720 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T19:59:17.867 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:17.860+0000 7f1d2243a640 1 --2- 172.21.15.78:0/2967161720 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1d1c06d840 0x7f1d1c14a3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:17.868 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:17.860+0000 7f1d21c39640 1 --2- 172.21.15.78:0/2967161720 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1d1c14f850 0x7f1d1c144ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:17.868 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:17.860+0000 7f1d22c3b640 1 -- 172.21.15.78:0/2967161720 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1d1c06d840 msgr2=0x7f1d1c14a3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:17.868 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:17.860+0000 7f1d22c3b640 1 --2- 172.21.15.78:0/2967161720 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1d1c06d840 0x7f1d1c14a3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:17.868 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:17.860+0000 7f1d22c3b640 1 -- 172.21.15.78:0/2967161720 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1d1c14f850 msgr2=0x7f1d1c144ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:17.868 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:17.860+0000 7f1d22c3b640 1 --2- 172.21.15.78:0/2967161720 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1d1c14f850 0x7f1d1c144ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:17.868 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:17.860+0000 7f1d22c3b640 1 -- 172.21.15.78:0/2967161720 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d0c009420 con 0x7f1d1c14fc30 2023-11-28T19:59:17.868 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:17.860+0000 7f1d21c39640 1 --2- 172.21.15.78:0/2967161720 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1d1c14f850 0x7f1d1c144ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T19:59:17.869 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:17.860+0000 7f1d22c3b640 1 --2- 172.21.15.78:0/2967161720 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1d1c14fc30 0x7f1d1c14cfd0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f1d1401a640 tx=0x7f1d140197b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:59:17.869 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:17.860+0000 7f1d12ffd640 1 -- 172.21.15.78:0/2967161720 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d140b8670 con 0x7f1d1c14fc30 2023-11-28T19:59:17.869 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:17.860+0000 7f1d12ffd640 1 -- 172.21.15.78:0/2967161720 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d140b87d0 con 0x7f1d1c14fc30 2023-11-28T19:59:17.869 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:17.860+0000 7f1d12ffd640 1 -- 172.21.15.78:0/2967161720 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d140b8b80 con 0x7f1d1c14fc30 2023-11-28T19:59:17.869 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:17.860+0000 7f1d2469e640 1 -- 172.21.15.78:0/2967161720 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1d14009b30 con 0x7f1d1c14fc30 2023-11-28T19:59:17.869 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:17.860+0000 7f1d2469e640 1 -- 172.21.15.78:0/2967161720 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1d1c0a5970 con 0x7f1d1c14fc30 2023-11-28T19:59:17.869 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:17.860+0000 7f1d2469e640 1 -- 172.21.15.78:0/2967161720 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1d1c0a6410 con 0x7f1d1c14fc30 2023-11-28T19:59:17.870 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:17.860+0000 7f1d12ffd640 1 -- 172.21.15.78:0/2967161720 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f1d140b8ce0 con 0x7f1d1c14fc30 2023-11-28T19:59:17.870 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:17.860+0000 7f1d12ffd640 1 --2- 172.21.15.78:0/2967161720 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f1d000664a0 0x7f1d00068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:17.871 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:17.860+0000 7f1d12ffd640 1 -- 172.21.15.78:0/2967161720 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f1d1411f550 con 0x7f1d1c14fc30 2023-11-28T19:59:17.871 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:17.860+0000 7f1d2243a640 1 --2- 172.21.15.78:0/2967161720 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f1d000664a0 0x7f1d00068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:17.871 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:17.864+0000 7f1d2243a640 1 --2- 172.21.15.78:0/2967161720 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f1d000664a0 0x7f1d00068960 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f1d1c14cd50 tx=0x7f1d18009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:59:17.871 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:17.864+0000 7f1d12ffd640 1 -- 172.21.15.78:0/2967161720 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f1d140ec810 con 0x7f1d1c14fc30 2023-11-28T19:59:18.026 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:18.020+0000 7f1d2469e640 1 -- 172.21.15.78:0/2967161720 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f1d1c067630 con 0x7f1d1c14fc30 2023-11-28T19:59:18.027 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:18.020+0000 7f1d12ffd640 1 -- 172.21.15.78:0/2967161720 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v25) v1 ==== 100+0+11 (secure 0 0 0) 0x7f1d140efe30 con 0x7f1d1c14fc30 2023-11-28T19:59:18.027 INFO:teuthology.orchestra.run.smithi078.stdout:pg_num: 64 2023-11-28T19:59:18.028 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:18.024+0000 7f1d2469e640 1 -- 172.21.15.78:0/2967161720 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f1d000664a0 msgr2=0x7f1d00068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:18.029 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:18.024+0000 7f1d2469e640 1 --2- 172.21.15.78:0/2967161720 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f1d000664a0 0x7f1d00068960 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f1d1c14cd50 tx=0x7f1d18009040 comp rx=0 tx=0).stop 2023-11-28T19:59:18.029 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:18.024+0000 7f1d2469e640 1 -- 172.21.15.78:0/2967161720 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1d1c14fc30 msgr2=0x7f1d1c14cfd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:18.029 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:18.024+0000 7f1d2469e640 1 --2- 172.21.15.78:0/2967161720 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1d1c14fc30 0x7f1d1c14cfd0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f1d1401a640 tx=0x7f1d140197b0 comp rx=0 tx=0).stop 2023-11-28T19:59:18.029 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:18.024+0000 7f1d2469e640 1 -- 172.21.15.78:0/2967161720 shutdown_connections 2023-11-28T19:59:18.029 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:18.024+0000 7f1d2469e640 1 --2- 172.21.15.78:0/2967161720 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f1d000664a0 0x7f1d00068960 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:18.029 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:18.024+0000 7f1d2469e640 1 --2- 172.21.15.78:0/2967161720 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1d1c14fc30 0x7f1d1c14cfd0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:18.029 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:18.024+0000 7f1d2469e640 1 --2- 172.21.15.78:0/2967161720 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1d1c14f850 0x7f1d1c144ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:18.029 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:18.024+0000 7f1d2469e640 1 --2- 172.21.15.78:0/2967161720 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1d1c06d840 0x7f1d1c14a3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:18.029 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:18.024+0000 7f1d2469e640 1 -- 172.21.15.78:0/2967161720 >> 172.21.15.78:0/2967161720 conn(0x7f1d1c0c59f0 msgr2=0x7f1d1c0bed60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T19:59:18.029 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:18.024+0000 7f1d2469e640 1 -- 172.21.15.78:0/2967161720 shutdown_connections 2023-11-28T19:59:18.029 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:18.024+0000 7f1d2469e640 1 -- 172.21.15.78:0/2967161720 wait complete. 2023-11-28T19:59:18.047 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-11-28T19:59:18.189 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:18.184+0000 7f5328479640 1 Processor -- start 2023-11-28T19:59:18.189 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:18.184+0000 7f5328479640 1 -- start start 2023-11-28T19:59:18.191 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:18.184+0000 7f5328479640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f532014b1e0 0x7f53200c1700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:18.191 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:18.184+0000 7f5328479640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f53200c5300 0x7f53200a9c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:18.191 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:18.184+0000 7f5328479640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f5320151280 0x7f5320151710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:18.191 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:18.184+0000 7f5328479640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f53200a4e20 con 0x7f532014b1e0 2023-11-28T19:59:18.192 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:18.184+0000 7f5328479640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f53200a50e0 con 0x7f5320151280 2023-11-28T19:59:18.192 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:18.184+0000 7f5328479640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53200c0f00 con 0x7f53200c5300 2023-11-28T19:59:18.192 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:18.184+0000 7f5326215640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f532014b1e0 0x7f53200c1700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:18.192 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:18.184+0000 7f5326215640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f532014b1e0 0x7f53200c1700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:60358/0 (socket says 172.21.15.78:60358) 2023-11-28T19:59:18.192 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:18.184+0000 7f5326215640 1 -- 172.21.15.78:0/2028043857 learned_addr learned my addr 172.21.15.78:0/2028043857 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T19:59:18.192 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:18.184+0000 7f5325a14640 1 --2- 172.21.15.78:0/2028043857 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f53200c5300 0x7f53200a9c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:18.193 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:18.188+0000 7f5326a16640 1 --2- 172.21.15.78:0/2028043857 >> v2:172.21.15.179:3300/0 conn(0x7f5320151280 0x7f5320151710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:18.193 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:18.188+0000 7f5326215640 1 -- 172.21.15.78:0/2028043857 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f53200c5300 msgr2=0x7f53200a9c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T19:59:18.193 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:18.188+0000 7f5326215640 1 --2- 172.21.15.78:0/2028043857 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f53200c5300 0x7f53200a9c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:18.193 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:18.188+0000 7f5326215640 1 -- 172.21.15.78:0/2028043857 >> v2:172.21.15.179:3300/0 conn(0x7f5320151280 msgr2=0x7f5320151710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T19:59:18.193 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:18.188+0000 7f5326215640 1 --2- 172.21.15.78:0/2028043857 >> v2:172.21.15.179:3300/0 conn(0x7f5320151280 0x7f5320151710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:18.193 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:18.188+0000 7f5326215640 1 -- 172.21.15.78:0/2028043857 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53200c11e0 con 0x7f532014b1e0 2023-11-28T19:59:18.194 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:18.188+0000 7f5326a16640 1 --2- 172.21.15.78:0/2028043857 >> v2:172.21.15.179:3300/0 conn(0x7f5320151280 0x7f5320151710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T19:59:18.195 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:18.188+0000 7f5326215640 1 --2- 172.21.15.78:0/2028043857 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f532014b1e0 0x7f53200c1700 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f53200c3b30 tx=0x7f531c01c500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f3b4fa9c8e9252db server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:59:18.195 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:18.188+0000 7f5325213640 1 -- 172.21.15.78:0/2028043857 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f531c004230 con 0x7f532014b1e0 2023-11-28T19:59:18.195 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:18.188+0000 7f5325213640 1 -- 172.21.15.78:0/2028043857 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f531c0a7050 con 0x7f532014b1e0 2023-11-28T19:59:18.195 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:18.188+0000 7f5325213640 1 -- 172.21.15.78:0/2028043857 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f531c003620 con 0x7f532014b1e0 2023-11-28T19:59:18.195 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:18.188+0000 7f5328479640 1 -- 172.21.15.78:0/2028043857 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f532014b1e0 msgr2=0x7f53200c1700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:18.196 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:18.188+0000 7f5328479640 1 --2- 172.21.15.78:0/2028043857 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f532014b1e0 0x7f53200c1700 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f53200c3b30 tx=0x7f531c01c500 comp rx=0 tx=0).stop 2023-11-28T19:59:18.196 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:18.192+0000 7f5328479640 1 -- 172.21.15.78:0/2028043857 shutdown_connections 2023-11-28T19:59:18.196 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:18.192+0000 7f5328479640 1 --2- 172.21.15.78:0/2028043857 >> v2:172.21.15.179:3300/0 conn(0x7f5320151280 0x7f5320151710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:18.196 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:18.192+0000 7f5328479640 1 --2- 172.21.15.78:0/2028043857 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f53200c5300 0x7f53200a9c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:18.196 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:18.192+0000 7f5328479640 1 --2- 172.21.15.78:0/2028043857 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f532014b1e0 0x7f53200c1700 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:18.196 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:18.192+0000 7f5328479640 1 -- 172.21.15.78:0/2028043857 >> 172.21.15.78:0/2028043857 conn(0x7f53200c59f0 msgr2=0x7f53200c5e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T19:59:18.197 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:18.192+0000 7f5328479640 1 -- 172.21.15.78:0/2028043857 shutdown_connections 2023-11-28T19:59:18.197 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:18.192+0000 7f5328479640 1 -- 172.21.15.78:0/2028043857 wait complete. 2023-11-28T19:59:18.202 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:18.192+0000 7f5328479640 1 Processor -- start 2023-11-28T19:59:18.202 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:18.192+0000 7f5328479640 1 -- start start 2023-11-28T19:59:18.203 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:18.192+0000 7f5328479640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f53200c5300 0x7f53201417e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:18.203 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:18.192+0000 7f5328479640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f532014b1e0 0x7f53200befc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:18.203 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:18.192+0000 7f5328479640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5320151280 0x7f53201f0650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:18.203 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:18.192+0000 7f5328479640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5320153fe0 con 0x7f53200c5300 2023-11-28T19:59:18.203 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:18.192+0000 7f5328479640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53201539e0 con 0x7f532014b1e0 2023-11-28T19:59:18.204 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:18.192+0000 7f5328479640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53201ecd20 con 0x7f5320151280 2023-11-28T19:59:18.204 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:18.192+0000 7f5326215640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f53200c5300 0x7f53201417e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:18.204 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:18.192+0000 7f5326215640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f53200c5300 0x7f53201417e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:60374/0 (socket says 172.21.15.78:60374) 2023-11-28T19:59:18.204 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:18.192+0000 7f5326215640 1 -- 172.21.15.78:0/3136423417 learned_addr learned my addr 172.21.15.78:0/3136423417 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T19:59:18.204 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:18.192+0000 7f5326a16640 1 --2- 172.21.15.78:0/3136423417 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5320151280 0x7f53201f0650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:18.204 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:18.192+0000 7f5325a14640 1 --2- 172.21.15.78:0/3136423417 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f532014b1e0 0x7f53200befc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:18.205 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:18.192+0000 7f5326215640 1 -- 172.21.15.78:0/3136423417 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5320151280 msgr2=0x7f53201f0650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:18.205 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:18.192+0000 7f5326215640 1 --2- 172.21.15.78:0/3136423417 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5320151280 0x7f53201f0650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:18.205 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:18.192+0000 7f5326215640 1 -- 172.21.15.78:0/3136423417 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f532014b1e0 msgr2=0x7f53200befc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:18.205 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:18.192+0000 7f5326215640 1 --2- 172.21.15.78:0/3136423417 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f532014b1e0 0x7f53200befc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:18.205 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:18.192+0000 7f5326215640 1 -- 172.21.15.78:0/3136423417 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f531c0094d0 con 0x7f53200c5300 2023-11-28T19:59:18.205 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:18.192+0000 7f5325a14640 1 --2- 172.21.15.78:0/3136423417 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f532014b1e0 0x7f53200befc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T19:59:18.206 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:18.192+0000 7f5326215640 1 --2- 172.21.15.78:0/3136423417 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f53200c5300 0x7f53201417e0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f531c01abb0 tx=0x7f531c0192a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:59:18.206 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:18.196+0000 7f5316ffd640 1 -- 172.21.15.78:0/3136423417 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f531c003bb0 con 0x7f53200c5300 2023-11-28T19:59:18.206 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:18.196+0000 7f5316ffd640 1 -- 172.21.15.78:0/3136423417 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f531c003d10 con 0x7f53200c5300 2023-11-28T19:59:18.206 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:18.196+0000 7f5316ffd640 1 -- 172.21.15.78:0/3136423417 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f531c0ab680 con 0x7f53200c5300 2023-11-28T19:59:18.206 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:18.196+0000 7f5328479640 1 -- 172.21.15.78:0/3136423417 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f53201508d0 con 0x7f53200c5300 2023-11-28T19:59:18.207 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:18.196+0000 7f5328479640 1 -- 172.21.15.78:0/3136423417 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f53201541f0 con 0x7f53200c5300 2023-11-28T19:59:18.207 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:18.196+0000 7f5328479640 1 -- 172.21.15.78:0/3136423417 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5320067630 con 0x7f53200c5300 2023-11-28T19:59:18.207 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:18.196+0000 7f5316ffd640 1 -- 172.21.15.78:0/3136423417 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f531c0ab7e0 con 0x7f53200c5300 2023-11-28T19:59:18.207 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:18.196+0000 7f5316ffd640 1 --2- 172.21.15.78:0/3136423417 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f5304066470 0x7f5304068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:18.208 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:18.196+0000 7f5316ffd640 1 -- 172.21.15.78:0/3136423417 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f531c11e750 con 0x7f53200c5300 2023-11-28T19:59:18.208 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:18.196+0000 7f5325a14640 1 --2- 172.21.15.78:0/3136423417 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f5304066470 0x7f5304068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:18.208 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:18.196+0000 7f5325a14640 1 --2- 172.21.15.78:0/3136423417 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f5304066470 0x7f5304068930 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f5310004660 tx=0x7f5310008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:59:18.208 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:18.200+0000 7f5316ffd640 1 -- 172.21.15.78:0/3136423417 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f531c0eb980 con 0x7f53200c5300 2023-11-28T19:59:18.357 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:18.352+0000 7f5328479640 1 -- 172.21.15.78:0/3136423417 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f53201f0290 con 0x7f53200c5300 2023-11-28T19:59:18.358 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:18.352+0000 7f5316ffd640 1 -- 172.21.15.78:0/3136423417 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v25) v1 ==== 103+0+11 (secure 0 0 0) 0x7f531c0eefa0 con 0x7f53200c5300 2023-11-28T19:59:18.358 INFO:teuthology.orchestra.run.smithi078.stdout:pg_num: 32 2023-11-28T19:59:18.360 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:18.356+0000 7f5328479640 1 -- 172.21.15.78:0/3136423417 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f5304066470 msgr2=0x7f5304068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:18.360 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:18.356+0000 7f5328479640 1 --2- 172.21.15.78:0/3136423417 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f5304066470 0x7f5304068930 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f5310004660 tx=0x7f5310008040 comp rx=0 tx=0).stop 2023-11-28T19:59:18.360 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:18.356+0000 7f5328479640 1 -- 172.21.15.78:0/3136423417 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f53200c5300 msgr2=0x7f53201417e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:18.360 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:18.356+0000 7f5328479640 1 --2- 172.21.15.78:0/3136423417 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f53200c5300 0x7f53201417e0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f531c01abb0 tx=0x7f531c0192a0 comp rx=0 tx=0).stop 2023-11-28T19:59:18.360 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:18.356+0000 7f5328479640 1 -- 172.21.15.78:0/3136423417 shutdown_connections 2023-11-28T19:59:18.360 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:18.356+0000 7f5328479640 1 --2- 172.21.15.78:0/3136423417 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f5304066470 0x7f5304068930 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:18.360 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:18.356+0000 7f5328479640 1 --2- 172.21.15.78:0/3136423417 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5320151280 0x7f53201f0650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:18.361 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:18.356+0000 7f5328479640 1 --2- 172.21.15.78:0/3136423417 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f532014b1e0 0x7f53200befc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:18.361 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:18.356+0000 7f5328479640 1 --2- 172.21.15.78:0/3136423417 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f53200c5300 0x7f53201417e0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:18.361 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:18.356+0000 7f5328479640 1 -- 172.21.15.78:0/3136423417 >> 172.21.15.78:0/3136423417 conn(0x7f53200c59f0 msgr2=0x7f53200c4180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T19:59:18.361 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:18.356+0000 7f5328479640 1 -- 172.21.15.78:0/3136423417 shutdown_connections 2023-11-28T19:59:18.361 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:18.356+0000 7f5328479640 1 -- 172.21.15.78:0/3136423417 wait complete. 2023-11-28T19:59:18.379 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-11-28T19:59:18.517 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:18.512+0000 7f74d4557640 1 Processor -- start 2023-11-28T19:59:18.517 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:18.512+0000 7f74d4557640 1 -- start start 2023-11-28T19:59:18.518 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:18.512+0000 7f74d4557640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f74cc154390 0x7f74cc0c4a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:18.518 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:18.512+0000 7f74d4557640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f74cc0c4f80 0x7f74cc0c63b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:18.518 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:18.512+0000 7f74d4557640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f74cc0a93d0 con 0x7f74cc0c2110 2023-11-28T19:59:18.519 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:18.512+0000 7f74d4557640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f74cc0aa1c0 con 0x7f74cc0c4f80 2023-11-28T19:59:18.519 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:18.512+0000 7f74d4557640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f74cc154770 con 0x7f74cc154390 2023-11-28T19:59:18.519 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:18.512+0000 7f74d2af4640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f74cc0c4f80 0x7f74cc0c63b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:18.519 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:18.512+0000 7f74d2af4640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f74cc0c4f80 0x7f74cc0c63b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:60386/0 (socket says 172.21.15.78:60386) 2023-11-28T19:59:18.519 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:18.512+0000 7f74d2af4640 1 -- 172.21.15.78:0/15860234 learned_addr learned my addr 172.21.15.78:0/15860234 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T19:59:18.519 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:18.512+0000 7f74d22f3640 1 --2- 172.21.15.78:0/15860234 >> v2:172.21.15.179:3300/0 conn(0x7f74cc154390 0x7f74cc0c4a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:18.520 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:18.516+0000 7f74d2af4640 1 -- 172.21.15.78:0/15860234 >> v2:172.21.15.179:3300/0 conn(0x7f74cc154390 msgr2=0x7f74cc0c4a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T19:59:18.520 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:18.516+0000 7f74d2af4640 1 --2- 172.21.15.78:0/15860234 >> v2:172.21.15.179:3300/0 conn(0x7f74cc154390 0x7f74cc0c4a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:18.520 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:18.516+0000 7f74d2af4640 1 -- 172.21.15.78:0/15860234 >> v1:172.21.15.179:6789/0 conn(0x7f74cc0c2110 legacy=0x7f74cc0c5ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:18.520 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:18.516+0000 7f74d2af4640 1 -- 172.21.15.78:0/15860234 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74cc0a9640 con 0x7f74cc0c4f80 2023-11-28T19:59:18.521 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:18.516+0000 7f74d2af4640 1 --2- 172.21.15.78:0/15860234 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f74cc0c4f80 0x7f74cc0c63b0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f74cc0a83b0 tx=0x7f74c401ebe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8f198e2af12577c2 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:59:18.522 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:18.516+0000 7f74d12f1640 1 -- 172.21.15.78:0/15860234 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74c40a78c0 con 0x7f74cc0c4f80 2023-11-28T19:59:18.522 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:18.516+0000 7f74d12f1640 1 -- 172.21.15.78:0/15860234 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f74c40a7a20 con 0x7f74cc0c4f80 2023-11-28T19:59:18.522 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:18.516+0000 7f74d12f1640 1 -- 172.21.15.78:0/15860234 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74c40a7db0 con 0x7f74cc0c4f80 2023-11-28T19:59:18.523 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:18.516+0000 7f74d4557640 1 -- 172.21.15.78:0/15860234 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f74cc0c4f80 msgr2=0x7f74cc0c63b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:18.523 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:18.516+0000 7f74d4557640 1 --2- 172.21.15.78:0/15860234 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f74cc0c4f80 0x7f74cc0c63b0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f74cc0a83b0 tx=0x7f74c401ebe0 comp rx=0 tx=0).stop 2023-11-28T19:59:18.523 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:18.520+0000 7f74d4557640 1 -- 172.21.15.78:0/15860234 shutdown_connections 2023-11-28T19:59:18.523 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:18.520+0000 7f74d4557640 1 --2- 172.21.15.78:0/15860234 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f74cc0c4f80 0x7f74cc0c63b0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:18.523 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:18.520+0000 7f74d4557640 1 --2- 172.21.15.78:0/15860234 >> v2:172.21.15.179:3300/0 conn(0x7f74cc154390 0x7f74cc0c4a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:18.523 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:18.520+0000 7f74d4557640 1 -- 172.21.15.78:0/15860234 >> 172.21.15.78:0/15860234 conn(0x7f74cc06b220 msgr2=0x7f74cc0a77e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T19:59:18.523 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:18.520+0000 7f74d4557640 1 -- 172.21.15.78:0/15860234 shutdown_connections 2023-11-28T19:59:18.524 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:18.520+0000 7f74d4557640 1 -- 172.21.15.78:0/15860234 wait complete. 2023-11-28T19:59:18.524 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:18.520+0000 7f74d4557640 1 Processor -- start 2023-11-28T19:59:18.524 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:18.520+0000 7f74d4557640 1 -- start start 2023-11-28T19:59:18.527 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:18.520+0000 7f74d4557640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f74cc0c2110 0x7f74cc14dce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:18.527 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:18.520+0000 7f74d4557640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f74cc0c4f80 0x7f74cc14abd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:18.527 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:18.520+0000 7f74d4557640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f74cc154390 0x7f74cc14b110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:18.527 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:18.520+0000 7f74d4557640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74cc0705f0 con 0x7f74cc0c4f80 2023-11-28T19:59:18.527 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:18.520+0000 7f74d4557640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74cc148610 con 0x7f74cc154390 2023-11-28T19:59:18.527 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:18.520+0000 7f74d4557640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f74cc1ee220 con 0x7f74cc0c2110 2023-11-28T19:59:18.527 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:18.520+0000 7f74d1af2640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f74cc0c4f80 0x7f74cc14abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:18.527 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:18.520+0000 7f74d1af2640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f74cc0c4f80 0x7f74cc14abd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:60400/0 (socket says 172.21.15.78:60400) 2023-11-28T19:59:18.527 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:18.520+0000 7f74d1af2640 1 -- 172.21.15.78:0/3986346280 learned_addr learned my addr 172.21.15.78:0/3986346280 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T19:59:18.527 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:18.520+0000 7f74d22f3640 1 --2- 172.21.15.78:0/3986346280 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f74cc0c2110 0x7f74cc14dce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:18.528 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:18.520+0000 7f74d2af4640 1 --2- 172.21.15.78:0/3986346280 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f74cc154390 0x7f74cc14b110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:18.528 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:18.520+0000 7f74d1af2640 1 -- 172.21.15.78:0/3986346280 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f74cc0c2110 msgr2=0x7f74cc14dce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:18.528 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:18.520+0000 7f74d1af2640 1 --2- 172.21.15.78:0/3986346280 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f74cc0c2110 0x7f74cc14dce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:18.528 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:18.520+0000 7f74d1af2640 1 -- 172.21.15.78:0/3986346280 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f74cc154390 msgr2=0x7f74cc14b110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:18.528 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:18.520+0000 7f74d1af2640 1 --2- 172.21.15.78:0/3986346280 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f74cc154390 0x7f74cc14b110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:18.528 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:18.520+0000 7f74d1af2640 1 -- 172.21.15.78:0/3986346280 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74c4009b30 con 0x7f74cc0c4f80 2023-11-28T19:59:18.528 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:18.520+0000 7f74d1af2640 1 --2- 172.21.15.78:0/3986346280 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f74cc0c4f80 0x7f74cc14abd0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f74bc00c500 tx=0x7f74bc00c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:59:18.528 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:18.524+0000 7f74c2ffd640 1 -- 172.21.15.78:0/3986346280 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74bc005220 con 0x7f74cc0c4f80 2023-11-28T19:59:18.528 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:18.524+0000 7f74c2ffd640 1 -- 172.21.15.78:0/3986346280 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f74bc005380 con 0x7f74cc0c4f80 2023-11-28T19:59:18.528 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:18.524+0000 7f74c2ffd640 1 -- 172.21.15.78:0/3986346280 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74bc007270 con 0x7f74cc0c4f80 2023-11-28T19:59:18.528 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:18.524+0000 7f74d4557640 1 -- 172.21.15.78:0/3986346280 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f74cc070210 con 0x7f74cc0c4f80 2023-11-28T19:59:18.529 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:18.524+0000 7f74d4557640 1 -- 172.21.15.78:0/3986346280 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f74cc14e220 con 0x7f74cc0c4f80 2023-11-28T19:59:18.529 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:18.524+0000 7f74d4557640 1 -- 172.21.15.78:0/3986346280 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f74cc1ee440 con 0x7f74cc0c4f80 2023-11-28T19:59:18.530 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:18.524+0000 7f74c2ffd640 1 -- 172.21.15.78:0/3986346280 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f74bc0073d0 con 0x7f74cc0c4f80 2023-11-28T19:59:18.530 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:18.524+0000 7f74c2ffd640 1 --2- 172.21.15.78:0/3986346280 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f74b0066470 0x7f74b0068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:18.530 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:18.524+0000 7f74c2ffd640 1 -- 172.21.15.78:0/3986346280 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f74bc0835d0 con 0x7f74cc0c4f80 2023-11-28T19:59:18.530 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:18.524+0000 7f74d22f3640 1 --2- 172.21.15.78:0/3986346280 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f74b0066470 0x7f74b0068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:18.530 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:18.524+0000 7f74d22f3640 1 --2- 172.21.15.78:0/3986346280 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f74b0066470 0x7f74b0068930 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f74c80079c0 tx=0x7f74c8008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:59:18.533 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:18.528+0000 7f74c2ffd640 1 -- 172.21.15.78:0/3986346280 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f74bc050820 con 0x7f74cc0c4f80 2023-11-28T19:59:18.693 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:18.688+0000 7f74d4557640 1 -- 172.21.15.78:0/3986346280 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f74cc067630 con 0x7f74cc0c4f80 2023-11-28T19:59:18.694 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:18.688+0000 7f74c2ffd640 1 -- 172.21.15.78:0/3986346280 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v25) v1 ==== 80+0+0 (secure 0 0 0) 0x7f74bc053e40 con 0x7f74cc0c4f80 2023-11-28T19:59:18.694 INFO:teuthology.orchestra.run.smithi078.stderr:listed 0 entries 2023-11-28T19:59:18.696 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:18.692+0000 7f74d4557640 1 -- 172.21.15.78:0/3986346280 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f74b0066470 msgr2=0x7f74b0068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:18.696 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:18.692+0000 7f74d4557640 1 --2- 172.21.15.78:0/3986346280 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f74b0066470 0x7f74b0068930 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f74c80079c0 tx=0x7f74c8008040 comp rx=0 tx=0).stop 2023-11-28T19:59:18.696 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:18.692+0000 7f74d4557640 1 -- 172.21.15.78:0/3986346280 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f74cc0c4f80 msgr2=0x7f74cc14abd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:18.697 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:18.692+0000 7f74d4557640 1 --2- 172.21.15.78:0/3986346280 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f74cc0c4f80 0x7f74cc14abd0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f74bc00c500 tx=0x7f74bc00c9c0 comp rx=0 tx=0).stop 2023-11-28T19:59:18.697 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:18.692+0000 7f74d4557640 1 -- 172.21.15.78:0/3986346280 shutdown_connections 2023-11-28T19:59:18.697 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:18.692+0000 7f74d4557640 1 --2- 172.21.15.78:0/3986346280 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f74b0066470 0x7f74b0068930 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:18.697 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:18.692+0000 7f74d4557640 1 --2- 172.21.15.78:0/3986346280 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f74cc154390 0x7f74cc14b110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:18.697 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:18.692+0000 7f74d4557640 1 --2- 172.21.15.78:0/3986346280 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f74cc0c4f80 0x7f74cc14abd0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:18.697 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:18.692+0000 7f74d4557640 1 --2- 172.21.15.78:0/3986346280 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f74cc0c2110 0x7f74cc14dce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:18.697 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:18.692+0000 7f74d4557640 1 -- 172.21.15.78:0/3986346280 >> 172.21.15.78:0/3986346280 conn(0x7f74cc06b220 msgr2=0x7f74cc151f00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T19:59:18.697 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:18.692+0000 7f74d4557640 1 -- 172.21.15.78:0/3986346280 shutdown_connections 2023-11-28T19:59:18.697 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:18.692+0000 7f74d4557640 1 -- 172.21.15.78:0/3986346280 wait complete. 2023-11-28T19:59:18.715 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2023-11-28T19:59:18.715 DEBUG:teuthology.orchestra.run.smithi078:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-28T19:59:18.724 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-28T19:59:18.907 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:18.900+0000 7f25682e3640 1 Processor -- start 2023-11-28T19:59:18.907 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:18.904+0000 7f25682e3640 1 -- start start 2023-11-28T19:59:18.908 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:18.904+0000 7f25682e3640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f25600af4c0 0x7f2560154f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:18.909 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:18.904+0000 7f25682e3640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f25600c67d0 0x7f25600c6c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:18.909 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:18.904+0000 7f25682e3640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f25600c4890 con 0x7f256006b9f0 2023-11-28T19:59:18.909 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:18.904+0000 7f25682e3640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2560155460 con 0x7f25600af4c0 2023-11-28T19:59:18.909 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:18.904+0000 7f25682e3640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25600af8a0 con 0x7f25600c67d0 2023-11-28T19:59:18.909 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:18.904+0000 7f256607f640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f25600af4c0 0x7f2560154f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:18.909 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:18.904+0000 7f256607f640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f25600af4c0 0x7f2560154f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:60416/0 (socket says 172.21.15.78:60416) 2023-11-28T19:59:18.909 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:18.904+0000 7f256607f640 1 -- 172.21.15.78:0/2598685610 learned_addr learned my addr 172.21.15.78:0/2598685610 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T19:59:18.909 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:18.904+0000 7f256587e640 1 --2- 172.21.15.78:0/2598685610 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f25600c67d0 0x7f25600c6c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:18.909 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:18.904+0000 7f256607f640 1 -- 172.21.15.78:0/2598685610 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f25600c67d0 msgr2=0x7f25600c6c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T19:59:18.910 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:18.904+0000 7f256607f640 1 --2- 172.21.15.78:0/2598685610 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f25600c67d0 0x7f25600c6c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:18.910 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:18.904+0000 7f256607f640 1 -- 172.21.15.78:0/2598685610 >> v1:172.21.15.179:6789/0 conn(0x7f256006b9f0 legacy=0x7f2560157a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:18.910 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:18.904+0000 7f256607f640 1 -- 172.21.15.78:0/2598685610 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25600c4b30 con 0x7f25600af4c0 2023-11-28T19:59:18.911 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:18.908+0000 7f256607f640 1 --2- 172.21.15.78:0/2598685610 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f25600af4c0 0x7f2560154f20 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f255c009870 tx=0x7f255c01c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f3cae64f4c850db0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:59:18.912 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:18.908+0000 7f256507d640 1 -- 172.21.15.78:0/2598685610 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f255c0ab680 con 0x7f25600af4c0 2023-11-28T19:59:18.912 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:18.908+0000 7f256507d640 1 -- 172.21.15.78:0/2598685610 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f255c0ab7e0 con 0x7f25600af4c0 2023-11-28T19:59:18.912 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:18.908+0000 7f256507d640 1 -- 172.21.15.78:0/2598685610 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f255c0abb70 con 0x7f25600af4c0 2023-11-28T19:59:18.913 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:18.908+0000 7f25682e3640 1 -- 172.21.15.78:0/2598685610 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f25600af4c0 msgr2=0x7f2560154f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:18.913 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:18.908+0000 7f25682e3640 1 --2- 172.21.15.78:0/2598685610 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f25600af4c0 0x7f2560154f20 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f255c009870 tx=0x7f255c01c480 comp rx=0 tx=0).stop 2023-11-28T19:59:18.913 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:18.908+0000 7f25682e3640 1 -- 172.21.15.78:0/2598685610 shutdown_connections 2023-11-28T19:59:18.913 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:18.908+0000 7f25682e3640 1 --2- 172.21.15.78:0/2598685610 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f25600c67d0 0x7f25600c6c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:18.913 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:18.908+0000 7f25682e3640 1 --2- 172.21.15.78:0/2598685610 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f25600af4c0 0x7f2560154f20 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:18.913 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:18.908+0000 7f25682e3640 1 -- 172.21.15.78:0/2598685610 >> 172.21.15.78:0/2598685610 conn(0x7f25600ab9d0 msgr2=0x7f25600abde0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T19:59:18.913 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:18.908+0000 7f25682e3640 1 -- 172.21.15.78:0/2598685610 shutdown_connections 2023-11-28T19:59:18.913 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:18.908+0000 7f25682e3640 1 -- 172.21.15.78:0/2598685610 wait complete. 2023-11-28T19:59:18.914 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:18.908+0000 7f25682e3640 1 Processor -- start 2023-11-28T19:59:18.914 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:18.908+0000 7f25682e3640 1 -- start start 2023-11-28T19:59:18.916 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:18.912+0000 7f25682e3640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f256006b9f0 0x7f25600a9c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:18.916 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:18.912+0000 7f25682e3640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f25600af4c0 0x7f2560150490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:18.916 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:18.912+0000 7f25682e3640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f25600c67d0 0x7f25600c3610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:18.916 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:18.912+0000 7f25682e3640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25600c12d0 con 0x7f256006b9f0 2023-11-28T19:59:18.916 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:18.912+0000 7f25682e3640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25600c1fb0 con 0x7f25600c67d0 2023-11-28T19:59:18.916 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:18.912+0000 7f25682e3640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25600c3180 con 0x7f25600af4c0 2023-11-28T19:59:18.916 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:18.912+0000 7f256607f640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f256006b9f0 0x7f25600a9c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:18.916 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:18.912+0000 7f256607f640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f256006b9f0 0x7f25600a9c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:60428/0 (socket says 172.21.15.78:60428) 2023-11-28T19:59:18.916 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:18.912+0000 7f256607f640 1 -- 172.21.15.78:0/774877599 learned_addr learned my addr 172.21.15.78:0/774877599 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T19:59:18.917 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:18.912+0000 7f256587e640 1 --2- 172.21.15.78:0/774877599 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f25600af4c0 0x7f2560150490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:18.917 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:18.912+0000 7f2566880640 1 --2- 172.21.15.78:0/774877599 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f25600c67d0 0x7f25600c3610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:18.917 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:18.912+0000 7f256607f640 1 -- 172.21.15.78:0/774877599 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f25600af4c0 msgr2=0x7f2560150490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:18.917 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:18.912+0000 7f256607f640 1 --2- 172.21.15.78:0/774877599 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f25600af4c0 0x7f2560150490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:18.917 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:18.912+0000 7f256607f640 1 -- 172.21.15.78:0/774877599 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f25600c67d0 msgr2=0x7f25600c3610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:18.917 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:18.912+0000 7f256607f640 1 --2- 172.21.15.78:0/774877599 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f25600c67d0 0x7f25600c3610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:18.917 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:18.912+0000 7f256607f640 1 -- 172.21.15.78:0/774877599 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f255c0094d0 con 0x7f256006b9f0 2023-11-28T19:59:18.917 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:18.912+0000 7f256607f640 1 --2- 172.21.15.78:0/774877599 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f256006b9f0 0x7f25600a9c40 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f255c0ad040 tx=0x7f255c01acc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:59:18.918 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:18.912+0000 7f2556ffd640 1 -- 172.21.15.78:0/774877599 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f255c0b4800 con 0x7f256006b9f0 2023-11-28T19:59:18.918 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:18.912+0000 7f2556ffd640 1 -- 172.21.15.78:0/774877599 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f255c0b4980 con 0x7f256006b9f0 2023-11-28T19:59:18.918 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:18.912+0000 7f2556ffd640 1 -- 172.21.15.78:0/774877599 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f255c0b4d30 con 0x7f256006b9f0 2023-11-28T19:59:18.918 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:18.912+0000 7f25682e3640 1 -- 172.21.15.78:0/774877599 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f25600c2570 con 0x7f256006b9f0 2023-11-28T19:59:18.918 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:18.912+0000 7f25682e3640 1 -- 172.21.15.78:0/774877599 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f25600c2b30 con 0x7f256006b9f0 2023-11-28T19:59:18.918 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:18.912+0000 7f25682e3640 1 -- 172.21.15.78:0/774877599 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2560067630 con 0x7f256006b9f0 2023-11-28T19:59:18.919 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:18.912+0000 7f2556ffd640 1 -- 172.21.15.78:0/774877599 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f255c0c7440 con 0x7f256006b9f0 2023-11-28T19:59:18.919 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:18.916+0000 7f2556ffd640 1 --2- 172.21.15.78:0/774877599 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f2544066470 0x7f2544068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:18.920 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:18.916+0000 7f2556ffd640 1 -- 172.21.15.78:0/774877599 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f255c11f130 con 0x7f256006b9f0 2023-11-28T19:59:18.920 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:18.916+0000 7f256587e640 1 --2- 172.21.15.78:0/774877599 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f2544066470 0x7f2544068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:18.920 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:18.916+0000 7f256587e640 1 --2- 172.21.15.78:0/774877599 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f2544066470 0x7f2544068930 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f2560150200 tx=0x7f2550008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:59:18.923 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:18.920+0000 7f2556ffd640 1 -- 172.21.15.78:0/774877599 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f255c0ec2b0 con 0x7f256006b9f0 2023-11-28T19:59:19.073 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:19.068+0000 7f25682e3640 1 -- 172.21.15.78:0/774877599 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f25601520c0 con 0x7f256006b9f0 2023-11-28T19:59:19.075 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:19.068+0000 7f2556ffd640 1 -- 172.21.15.78:0/774877599 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+18322 (secure 0 0 0) 0x7f255c0ef8d0 con 0x7f256006b9f0 2023-11-28T19:59:19.075 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-11-28T19:59:19.075 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":25,"fsid":"dd9780e8-3bda-44fa-a9f0-fa07d19d901d","created":"2023-11-28T19:58:40.969556+0000","modified":"2023-11-28T19:59:10.474525+0000","last_up_change":"2023-11-28T19:58:52.596716+0000","last_in_change":"2023-11-28T19:58:43.609275+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-28T19:58:54.011229+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-28T19:59:03.945559+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-28T19:59:04.481478+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-11-28T19:59:08.109152+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"e84245ac-b5da-429e-af18-39acaa2b33e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6800","nonce":3358701235},{"type":"v1","addr":"172.21.15.78:6801","nonce":3358701235}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6802","nonce":3358701235},{"type":"v1","addr":"172.21.15.78:6803","nonce":3358701235}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6806","nonce":3358701235},{"type":"v1","addr":"172.21.15.78:6807","nonce":3358701235}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6804","nonce":3358701235},{"type":"v1","addr":"172.21.15.78:6805","nonce":3358701235}]},"public_addr":"172.21.15.78:6801/3358701235","cluster_addr":"172.21.15.78:6803/3358701235","heartbeat_back_addr":"172.21.15.78:6807/3358701235","heartbeat_front_addr":"172.21.15.78:6805/3358701235","state":["exists","up"]},{"osd":1,"uuid":"e634831d-c4e2-48d9-870c-9556ae162981","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6808","nonce":3211476654},{"type":"v1","addr":"172.21.15.78:6809","nonce":3211476654}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6810","nonce":3211476654},{"type":"v1","addr":"172.21.15.78:6811","nonce":3211476654}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6814","nonce":3211476654},{"type":"v1","addr":"172.21.15.78:6815","nonce":3211476654}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6812","nonce":3211476654},{"type":"v1","addr":"172.21.15.78:6813","nonce":3211476654}]},"public_addr":"172.21.15.78:6809/3211476654","cluster_addr":"172.21.15.78:6811/3211476654","heartbeat_back_addr":"172.21.15.78:6815/3211476654","heartbeat_front_addr":"172.21.15.78:6813/3211476654","state":["exists","up"]},{"osd":2,"uuid":"274c8395-6534-41f0-b8fb-a00af8985aa8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6816","nonce":2532904479},{"type":"v1","addr":"172.21.15.78:6817","nonce":2532904479}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6818","nonce":2532904479},{"type":"v1","addr":"172.21.15.78:6819","nonce":2532904479}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6822","nonce":2532904479},{"type":"v1","addr":"172.21.15.78:6823","nonce":2532904479}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6820","nonce":2532904479},{"type":"v1","addr":"172.21.15.78:6821","nonce":2532904479}]},"public_addr":"172.21.15.78:6817/2532904479","cluster_addr":"172.21.15.78:6819/2532904479","heartbeat_back_addr":"172.21.15.78:6823/2532904479","heartbeat_front_addr":"172.21.15.78:6821/2532904479","state":["exists","up"]},{"osd":3,"uuid":"77acc9af-7d4d-4b18-8cf5-d62f5971b7c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6824","nonce":3442991267},{"type":"v1","addr":"172.21.15.78:6825","nonce":3442991267}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6826","nonce":3442991267},{"type":"v1","addr":"172.21.15.78:6827","nonce":3442991267}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6830","nonce":3442991267},{"type":"v1","addr":"172.21.15.78:6831","nonce":3442991267}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6828","nonce":3442991267},{"type":"v1","addr":"172.21.15.78:6829","nonce":3442991267}]},"public_addr":"172.21.15.78:6825/3442991267","cluster_addr":"172.21.15.78:6827/3442991267","heartbeat_back_addr":"172.21.15.78:6831/3442991267","heartbeat_front_addr":"172.21.15.78:6829/3442991267","state":["exists","up"]},{"osd":4,"uuid":"5c62bc66-6b34-4b7f-a66b-9a743969138c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":802983577},{"type":"v1","addr":"172.21.15.179:6809","nonce":802983577}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":802983577},{"type":"v1","addr":"172.21.15.179:6811","nonce":802983577}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":802983577},{"type":"v1","addr":"172.21.15.179:6815","nonce":802983577}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":802983577},{"type":"v1","addr":"172.21.15.179:6813","nonce":802983577}]},"public_addr":"172.21.15.179:6809/802983577","cluster_addr":"172.21.15.179:6811/802983577","heartbeat_back_addr":"172.21.15.179:6815/802983577","heartbeat_front_addr":"172.21.15.179:6813/802983577","state":["exists","up"]},{"osd":5,"uuid":"67db6d36-f684-4079-b0cd-82b4dd61461f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":518192887},{"type":"v1","addr":"172.21.15.179:6818","nonce":518192887}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":518192887},{"type":"v1","addr":"172.21.15.179:6822","nonce":518192887}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":518192887},{"type":"v1","addr":"172.21.15.179:6829","nonce":518192887}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6824","nonce":518192887},{"type":"v1","addr":"172.21.15.179:6826","nonce":518192887}]},"public_addr":"172.21.15.179:6818/518192887","cluster_addr":"172.21.15.179:6822/518192887","heartbeat_back_addr":"172.21.15.179:6829/518192887","heartbeat_front_addr":"172.21.15.179:6826/518192887","state":["exists","up"]},{"osd":6,"uuid":"12e670af-5a16-4c81-9f97-defa66cab967","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":815435378},{"type":"v1","addr":"172.21.15.179:6801","nonce":815435378}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":815435378},{"type":"v1","addr":"172.21.15.179:6803","nonce":815435378}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":815435378},{"type":"v1","addr":"172.21.15.179:6807","nonce":815435378}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":815435378},{"type":"v1","addr":"172.21.15.179:6805","nonce":815435378}]},"public_addr":"172.21.15.179:6801/815435378","cluster_addr":"172.21.15.179:6803/815435378","heartbeat_back_addr":"172.21.15.179:6807/815435378","heartbeat_front_addr":"172.21.15.179:6805/815435378","state":["exists","up"]},{"osd":7,"uuid":"fe630650-2eb3-49ad-8676-c341e6332eb1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6817","nonce":2848432339},{"type":"v1","addr":"172.21.15.179:6819","nonce":2848432339}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6821","nonce":2848432339},{"type":"v1","addr":"172.21.15.179:6823","nonce":2848432339}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":2848432339},{"type":"v1","addr":"172.21.15.179:6831","nonce":2848432339}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6825","nonce":2848432339},{"type":"v1","addr":"172.21.15.179:6827","nonce":2848432339}]},"public_addr":"172.21.15.179:6819/2848432339","cluster_addr":"172.21.15.179:6823/2848432339","heartbeat_back_addr":"172.21.15.179:6831/2848432339","heartbeat_front_addr":"172.21.15.179:6827/2848432339","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:58:49.255433+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:58:49.412880+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:58:49.559295+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:58:49.245237+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:58:49.184557+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:58:49.329851+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:58:49.366012+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:58:49.349604+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-28T19:59:19.076 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:19.072+0000 7f25682e3640 1 -- 172.21.15.78:0/774877599 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f2544066470 msgr2=0x7f2544068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:19.077 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:19.072+0000 7f25682e3640 1 --2- 172.21.15.78:0/774877599 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f2544066470 0x7f2544068930 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f2560150200 tx=0x7f2550008040 comp rx=0 tx=0).stop 2023-11-28T19:59:19.077 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:19.072+0000 7f25682e3640 1 -- 172.21.15.78:0/774877599 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f256006b9f0 msgr2=0x7f25600a9c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:19.077 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:19.072+0000 7f25682e3640 1 --2- 172.21.15.78:0/774877599 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f256006b9f0 0x7f25600a9c40 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f255c0ad040 tx=0x7f255c01acc0 comp rx=0 tx=0).stop 2023-11-28T19:59:19.078 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:19.072+0000 7f25682e3640 1 -- 172.21.15.78:0/774877599 shutdown_connections 2023-11-28T19:59:19.078 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:19.072+0000 7f25682e3640 1 --2- 172.21.15.78:0/774877599 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f2544066470 0x7f2544068930 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:19.078 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:19.072+0000 7f25682e3640 1 --2- 172.21.15.78:0/774877599 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f25600af4c0 0x7f2560150490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:19.078 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:19.072+0000 7f25682e3640 1 --2- 172.21.15.78:0/774877599 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f25600c67d0 0x7f25600c3610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:19.078 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:19.072+0000 7f25682e3640 1 --2- 172.21.15.78:0/774877599 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f256006b9f0 0x7f25600a9c40 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:19.078 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:19.072+0000 7f25682e3640 1 -- 172.21.15.78:0/774877599 >> 172.21.15.78:0/774877599 conn(0x7f25600ab9d0 msgr2=0x7f2560157a90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T19:59:19.079 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:19.072+0000 7f25682e3640 1 -- 172.21.15.78:0/774877599 shutdown_connections 2023-11-28T19:59:19.079 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:19.072+0000 7f25682e3640 1 -- 172.21.15.78:0/774877599 wait complete. 2023-11-28T19:59:19.096 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-28T19:58:54.011229+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-28T19:59:03.945559+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-11-28T19:59:04.481478+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-11-28T19:59:08.109152+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-11-28T19:59:19.096 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-28T19:59:19.236 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:19.232+0000 7ff236b72640 1 Processor -- start 2023-11-28T19:59:19.236 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:19.232+0000 7ff236b72640 1 -- start start 2023-11-28T19:59:19.237 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:19.232+0000 7ff236b72640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff23014b1e0 0x7ff2300c1700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:19.237 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:19.232+0000 7ff236b72640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7ff2301548c0 0x7ff230154d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:19.237 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:19.232+0000 7ff236b72640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff2300a4e20 con 0x7ff2300c5300 2023-11-28T19:59:19.237 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:19.232+0000 7ff236b72640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff2300a50e0 con 0x7ff2301548c0 2023-11-28T19:59:19.237 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:19.232+0000 7ff236b72640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff2300c0f00 con 0x7ff23014b1e0 2023-11-28T19:59:19.238 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:19.232+0000 7ff23510f640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7ff2301548c0 0x7ff230154d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:19.238 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:19.232+0000 7ff22ffff640 1 --1- >> v1:172.21.15.179:6789/0 conn(0x7ff2300c5300 0x7ff2300a9c30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.179:6789/0 says I am v1:172.21.15.78:58484/0 (socket says 172.21.15.78:58484) 2023-11-28T19:59:19.238 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:19.232+0000 7ff22ffff640 1 -- 172.21.15.78:0/885296534 learned_addr learned my addr 172.21.15.78:0/885296534 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-11-28T19:59:19.239 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:19.232+0000 7ff23490e640 1 --2- 172.21.15.78:0/885296534 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff23014b1e0 0x7ff2300c1700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:19.239 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:19.232+0000 7ff22f7fe640 1 -- 172.21.15.78:0/885296534 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1293885133 0 0) 0x7ff2300a4e20 con 0x7ff2300c5300 2023-11-28T19:59:19.239 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:19.232+0000 7ff22f7fe640 1 -- 172.21.15.78:0/885296534 --> v1:172.21.15.179:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff220003530 con 0x7ff2300c5300 2023-11-28T19:59:19.239 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:19.232+0000 7ff23490e640 1 -- 172.21.15.78:0/885296534 >> v2:172.21.15.179:3300/0 conn(0x7ff2301548c0 msgr2=0x7ff230154d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T19:59:19.239 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:19.232+0000 7ff23490e640 1 --2- 172.21.15.78:0/885296534 >> v2:172.21.15.179:3300/0 conn(0x7ff2301548c0 0x7ff230154d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:19.239 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:19.232+0000 7ff23490e640 1 -- 172.21.15.78:0/885296534 >> v1:172.21.15.179:6789/0 conn(0x7ff2300c5300 legacy=0x7ff2300a9c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:19.239 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:19.232+0000 7ff23490e640 1 -- 172.21.15.78:0/885296534 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2300c11e0 con 0x7ff23014b1e0 2023-11-28T19:59:19.239 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:19.232+0000 7ff23510f640 1 --2- 172.21.15.78:0/885296534 >> v2:172.21.15.179:3300/0 conn(0x7ff2301548c0 0x7ff230154d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T19:59:19.241 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:19.236+0000 7ff23490e640 1 --2- 172.21.15.78:0/885296534 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff23014b1e0 0x7ff2300c1700 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7ff2240097c0 tx=0x7ff22401c480 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9580c7e61d86df61 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:59:19.242 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:19.236+0000 7ff22f7fe640 1 -- 172.21.15.78:0/885296534 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2301558b0 con 0x7ff23014b1e0 2023-11-28T19:59:19.242 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:19.236+0000 7ff22f7fe640 1 -- 172.21.15.78:0/885296534 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff2240ad640 con 0x7ff23014b1e0 2023-11-28T19:59:19.242 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:19.236+0000 7ff22f7fe640 1 -- 172.21.15.78:0/885296534 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2240ad9d0 con 0x7ff23014b1e0 2023-11-28T19:59:19.243 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:19.236+0000 7ff236b72640 1 -- 172.21.15.78:0/885296534 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff23014b1e0 msgr2=0x7ff2300c1700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:19.243 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:19.236+0000 7ff236b72640 1 --2- 172.21.15.78:0/885296534 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff23014b1e0 0x7ff2300c1700 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7ff2240097c0 tx=0x7ff22401c480 comp rx=0 tx=0).stop 2023-11-28T19:59:19.243 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:19.236+0000 7ff236b72640 1 -- 172.21.15.78:0/885296534 shutdown_connections 2023-11-28T19:59:19.243 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:19.236+0000 7ff236b72640 1 --2- 172.21.15.78:0/885296534 >> v2:172.21.15.179:3300/0 conn(0x7ff2301548c0 0x7ff230154d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:19.243 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:19.236+0000 7ff236b72640 1 --2- 172.21.15.78:0/885296534 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff23014b1e0 0x7ff2300c1700 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:19.243 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:19.236+0000 7ff236b72640 1 -- 172.21.15.78:0/885296534 >> 172.21.15.78:0/885296534 conn(0x7ff2300c59f0 msgr2=0x7ff2300c5e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T19:59:19.243 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:19.236+0000 7ff236b72640 1 -- 172.21.15.78:0/885296534 shutdown_connections 2023-11-28T19:59:19.243 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:19.236+0000 7ff236b72640 1 -- 172.21.15.78:0/885296534 wait complete. 2023-11-28T19:59:19.244 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:19.240+0000 7ff236b72640 1 Processor -- start 2023-11-28T19:59:19.244 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:19.240+0000 7ff236b72640 1 -- start start 2023-11-28T19:59:19.248 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:19.240+0000 7ff236b72640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff2300c5300 0x7ff23014e5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:19.248 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:19.240+0000 7ff236b72640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff23014b1e0 0x7ff23006cd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:19.248 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:19.240+0000 7ff236b72640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff2301548c0 0x7ff230070a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:19.248 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:19.240+0000 7ff236b72640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff23014c460 con 0x7ff2300c5300 2023-11-28T19:59:19.249 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:19.240+0000 7ff236b72640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff23014eae0 con 0x7ff23014b1e0 2023-11-28T19:59:19.249 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:19.240+0000 7ff236b72640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff23014e110 con 0x7ff2301548c0 2023-11-28T19:59:19.249 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:19.240+0000 7ff23490e640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff2300c5300 0x7ff23014e5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:19.249 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:19.240+0000 7ff23490e640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff2300c5300 0x7ff23014e5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:60440/0 (socket says 172.21.15.78:60440) 2023-11-28T19:59:19.250 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:19.240+0000 7ff23490e640 1 -- 172.21.15.78:0/2266907086 learned_addr learned my addr 172.21.15.78:0/2266907086 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T19:59:19.250 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:19.240+0000 7ff22ffff640 1 --2- 172.21.15.78:0/2266907086 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff23014b1e0 0x7ff23006cd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:19.250 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:19.240+0000 7ff23510f640 1 --2- 172.21.15.78:0/2266907086 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff2301548c0 0x7ff230070a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:19.251 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:19.240+0000 7ff23490e640 1 -- 172.21.15.78:0/2266907086 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff2301548c0 msgr2=0x7ff230070a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:19.251 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:19.240+0000 7ff23490e640 1 --2- 172.21.15.78:0/2266907086 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff2301548c0 0x7ff230070a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:19.251 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:19.240+0000 7ff23490e640 1 -- 172.21.15.78:0/2266907086 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff23014b1e0 msgr2=0x7ff23006cd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:19.251 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:19.240+0000 7ff23490e640 1 --2- 172.21.15.78:0/2266907086 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff23014b1e0 0x7ff23006cd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:19.251 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:19.240+0000 7ff23490e640 1 -- 172.21.15.78:0/2266907086 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff228009a70 con 0x7ff2300c5300 2023-11-28T19:59:19.252 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:19.240+0000 7ff23490e640 1 --2- 172.21.15.78:0/2266907086 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff2300c5300 0x7ff23014e5a0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7ff2240b0040 tx=0x7ff224019220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:59:19.252 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:19.240+0000 7ff22d7fa640 1 -- 172.21.15.78:0/2266907086 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff224006e20 con 0x7ff2300c5300 2023-11-28T19:59:19.252 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:19.240+0000 7ff22d7fa640 1 -- 172.21.15.78:0/2266907086 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff2240a6040 con 0x7ff2300c5300 2023-11-28T19:59:19.252 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:19.240+0000 7ff22d7fa640 1 -- 172.21.15.78:0/2266907086 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2240b6840 con 0x7ff2300c5300 2023-11-28T19:59:19.252 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:19.240+0000 7ff236b72640 1 -- 172.21.15.78:0/2266907086 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff224009420 con 0x7ff2300c5300 2023-11-28T19:59:19.252 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:19.240+0000 7ff236b72640 1 -- 172.21.15.78:0/2266907086 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff230070620 con 0x7ff2300c5300 2023-11-28T19:59:19.253 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:19.244+0000 7ff236b72640 1 -- 172.21.15.78:0/2266907086 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff230067630 con 0x7ff2300c5300 2023-11-28T19:59:19.254 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:19.244+0000 7ff22d7fa640 1 -- 172.21.15.78:0/2266907086 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7ff2240b4040 con 0x7ff2300c5300 2023-11-28T19:59:19.255 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:19.244+0000 7ff22d7fa640 1 --2- 172.21.15.78:0/2266907086 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7ff214066470 0x7ff214068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:19.255 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:19.244+0000 7ff22d7fa640 1 -- 172.21.15.78:0/2266907086 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7ff22411e420 con 0x7ff2300c5300 2023-11-28T19:59:19.255 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:19.244+0000 7ff22ffff640 1 --2- 172.21.15.78:0/2266907086 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7ff214066470 0x7ff214068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:19.255 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:19.244+0000 7ff22ffff640 1 --2- 172.21.15.78:0/2266907086 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7ff214066470 0x7ff214068930 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7ff23015e610 tx=0x7ff21c009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:59:19.255 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:19.248+0000 7ff22d7fa640 1 -- 172.21.15.78:0/2266907086 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7ff2240eb5a0 con 0x7ff2300c5300 2023-11-28T19:59:19.403 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:19.400+0000 7ff236b72640 1 -- 172.21.15.78:0/2266907086 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7ff23015e640 con 0x7ff2300c5300 2023-11-28T19:59:19.404 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:19.400+0000 7ff22d7fa640 1 -- 172.21.15.78:0/2266907086 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v25) v1 ==== 93+0+10 (secure 0 0 0) 0x7ff2240eebc0 con 0x7ff2300c5300 2023-11-28T19:59:19.404 INFO:teuthology.orchestra.run.smithi078.stdout:pg_num: 1 2023-11-28T19:59:19.406 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:19.400+0000 7ff236b72640 1 -- 172.21.15.78:0/2266907086 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7ff214066470 msgr2=0x7ff214068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:19.406 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:19.400+0000 7ff236b72640 1 --2- 172.21.15.78:0/2266907086 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7ff214066470 0x7ff214068930 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7ff23015e610 tx=0x7ff21c009040 comp rx=0 tx=0).stop 2023-11-28T19:59:19.406 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:19.400+0000 7ff236b72640 1 -- 172.21.15.78:0/2266907086 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff2300c5300 msgr2=0x7ff23014e5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:19.407 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:19.400+0000 7ff236b72640 1 --2- 172.21.15.78:0/2266907086 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff2300c5300 0x7ff23014e5a0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7ff2240b0040 tx=0x7ff224019220 comp rx=0 tx=0).stop 2023-11-28T19:59:19.407 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:19.400+0000 7ff236b72640 1 -- 172.21.15.78:0/2266907086 shutdown_connections 2023-11-28T19:59:19.407 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:19.400+0000 7ff236b72640 1 --2- 172.21.15.78:0/2266907086 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7ff214066470 0x7ff214068930 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:19.407 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:19.400+0000 7ff236b72640 1 --2- 172.21.15.78:0/2266907086 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff2301548c0 0x7ff230070a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:19.407 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:19.400+0000 7ff236b72640 1 --2- 172.21.15.78:0/2266907086 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff23014b1e0 0x7ff23006cd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:19.408 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:19.400+0000 7ff236b72640 1 --2- 172.21.15.78:0/2266907086 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff2300c5300 0x7ff23014e5a0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:19.408 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:19.400+0000 7ff236b72640 1 -- 172.21.15.78:0/2266907086 >> 172.21.15.78:0/2266907086 conn(0x7ff2300c59f0 msgr2=0x7ff2300aa690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T19:59:19.408 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:19.400+0000 7ff236b72640 1 -- 172.21.15.78:0/2266907086 shutdown_connections 2023-11-28T19:59:19.408 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:19.400+0000 7ff236b72640 1 -- 172.21.15.78:0/2266907086 wait complete. 2023-11-28T19:59:19.425 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-28T19:59:19.565 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:19.560+0000 7f1e619aa640 1 Processor -- start 2023-11-28T19:59:19.565 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:19.560+0000 7f1e619aa640 1 -- start start 2023-11-28T19:59:19.566 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:19.560+0000 7f1e619aa640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1e5c0bf2d0 0x7f1e5c151970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:19.567 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:19.560+0000 7f1e619aa640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1e5c158780 con 0x7f1e5c0c98f0 2023-11-28T19:59:19.567 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:19.560+0000 7f1e619aa640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1e5c157b70 con 0x7f1e5c0c6030 2023-11-28T19:59:19.567 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:19.560+0000 7f1e619aa640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e5c0c0300 con 0x7f1e5c0bf2d0 2023-11-28T19:59:19.567 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:19.564+0000 7f1e5b7fe640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f1e5c0c98f0 0x7f1e5c15ef00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:35164/0 (socket says 172.21.15.78:35164) 2023-11-28T19:59:19.567 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:19.564+0000 7f1e5b7fe640 1 -- 172.21.15.78:0/1098822298 learned_addr learned my addr 172.21.15.78:0/1098822298 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-11-28T19:59:19.569 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:19.564+0000 7f1e5affd640 1 --2- 172.21.15.78:0/1098822298 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1e5c0bf2d0 0x7f1e5c151970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:19.569 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:19.564+0000 7f1e5a7fc640 1 -- 172.21.15.78:0/1098822298 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2095045050 0 0) 0x7f1e5c158780 con 0x7f1e5c0c98f0 2023-11-28T19:59:19.569 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:19.564+0000 7f1e5a7fc640 1 -- 172.21.15.78:0/1098822298 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1e48003530 con 0x7f1e5c0c98f0 2023-11-28T19:59:19.569 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:19.564+0000 7f1e5a7fc640 1 -- 172.21.15.78:0/1098822298 <== mon.0 v1:172.21.15.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1051500697 0 0) 0x7f1e48003530 con 0x7f1e5c0c98f0 2023-11-28T19:59:19.569 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:19.564+0000 7f1e5a7fc640 1 -- 172.21.15.78:0/1098822298 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1e5c0bf2d0 msgr2=0x7f1e5c151970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T19:59:19.570 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:19.564+0000 7f1e5a7fc640 1 --2- 172.21.15.78:0/1098822298 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1e5c0bf2d0 0x7f1e5c151970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:19.570 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:19.564+0000 7f1e5a7fc640 1 -- 172.21.15.78:0/1098822298 >> v1:172.21.15.179:6789/0 conn(0x7f1e5c0c6030 legacy=0x7f1e5c0c7cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:19.570 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:19.564+0000 7f1e5a7fc640 1 -- 172.21.15.78:0/1098822298 --> v1:172.21.15.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e5c157e50 con 0x7f1e5c0c98f0 2023-11-28T19:59:19.570 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:19.564+0000 7f1e5a7fc640 1 -- 172.21.15.78:0/1098822298 <== mon.0 v1:172.21.15.78:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3326804700 0 0) 0x7f1e54001a00 con 0x7f1e5c0c98f0 2023-11-28T19:59:19.570 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:19.564+0000 7f1e5affd640 1 --2- 172.21.15.78:0/1098822298 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1e5c0bf2d0 0x7f1e5c151970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T19:59:19.570 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:19.564+0000 7f1e5a7fc640 1 -- 172.21.15.78:0/1098822298 >> v1:172.21.15.78:6789/0 conn(0x7f1e5c0c98f0 legacy=0x7f1e5c15ef00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:19.570 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:19.564+0000 7f1e5a7fc640 1 --2- 172.21.15.78:0/1098822298 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1e5c0bf2d0 0x7f1e480039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:19.570 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:19.564+0000 7f1e5a7fc640 1 --2- 172.21.15.78:0/1098822298 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1e48003ef0 0x7f1e480047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:19.570 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:19.564+0000 7f1e5a7fc640 1 --2- 172.21.15.78:0/1098822298 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1e48004d10 0x7f1e48005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:19.570 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:19.564+0000 7f1e5a7fc640 1 -- 172.21.15.78:0/1098822298 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e4800ba40 con 0x7f1e48004d10 2023-11-28T19:59:19.571 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:19.564+0000 7f1e5a7fc640 1 -- 172.21.15.78:0/1098822298 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e4800bb80 con 0x7f1e48003ef0 2023-11-28T19:59:19.571 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:19.564+0000 7f1e5a7fc640 1 -- 172.21.15.78:0/1098822298 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e4800bd40 con 0x7f1e5c0bf2d0 2023-11-28T19:59:19.571 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:19.564+0000 7f1e5b7fe640 1 --2- 172.21.15.78:0/1098822298 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1e48004d10 0x7f1e48005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:19.571 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:19.564+0000 7f1e5affd640 1 --2- 172.21.15.78:0/1098822298 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1e5c0bf2d0 0x7f1e480039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:19.571 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:19.564+0000 7f1e527fc640 1 --2- 172.21.15.78:0/1098822298 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1e48003ef0 0x7f1e480047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:19.571 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:19.564+0000 7f1e5b7fe640 1 -- 172.21.15.78:0/1098822298 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1e5c0bf2d0 msgr2=0x7f1e480039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T19:59:19.571 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:19.564+0000 7f1e5b7fe640 1 --2- 172.21.15.78:0/1098822298 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1e5c0bf2d0 0x7f1e480039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:19.571 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:19.564+0000 7f1e5b7fe640 1 -- 172.21.15.78:0/1098822298 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1e48003ef0 msgr2=0x7f1e480047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T19:59:19.571 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:19.564+0000 7f1e5b7fe640 1 --2- 172.21.15.78:0/1098822298 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1e48003ef0 0x7f1e480047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:19.571 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:19.564+0000 7f1e5b7fe640 1 -- 172.21.15.78:0/1098822298 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e4c009420 con 0x7f1e48004d10 2023-11-28T19:59:19.573 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:19.568+0000 7f1e5b7fe640 1 --2- 172.21.15.78:0/1098822298 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1e48004d10 0x7f1e48005190 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f1e5400a770 tx=0x7f1e5401f9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=498cce91d0697c99 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:59:19.573 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:19.568+0000 7f1e5a7fc640 1 -- 172.21.15.78:0/1098822298 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e540ac670 con 0x7f1e48004d10 2023-11-28T19:59:19.573 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:19.568+0000 7f1e5a7fc640 1 -- 172.21.15.78:0/1098822298 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e540ac7d0 con 0x7f1e48004d10 2023-11-28T19:59:19.573 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:19.568+0000 7f1e5a7fc640 1 -- 172.21.15.78:0/1098822298 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e540acb80 con 0x7f1e48004d10 2023-11-28T19:59:19.573 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:19.568+0000 7f1e619aa640 1 -- 172.21.15.78:0/1098822298 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1e48004d10 msgr2=0x7f1e48005190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:19.573 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:19.568+0000 7f1e619aa640 1 --2- 172.21.15.78:0/1098822298 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1e48004d10 0x7f1e48005190 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f1e5400a770 tx=0x7f1e5401f9c0 comp rx=0 tx=0).stop 2023-11-28T19:59:19.573 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:19.568+0000 7f1e5b7fe640 1 -- 172.21.15.78:0/1098822298 reap_dead start 2023-11-28T19:59:19.573 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:19.568+0000 7f1e619aa640 1 -- 172.21.15.78:0/1098822298 shutdown_connections 2023-11-28T19:59:19.573 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:19.568+0000 7f1e619aa640 1 -- 172.21.15.78:0/1098822298 >> 172.21.15.78:0/1098822298 conn(0x7f1e5c0c9dc0 msgr2=0x7f1e5c0ca1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T19:59:19.573 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:19.568+0000 7f1e619aa640 1 -- 172.21.15.78:0/1098822298 shutdown_connections 2023-11-28T19:59:19.574 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:19.568+0000 7f1e619aa640 1 -- 172.21.15.78:0/1098822298 wait complete. 2023-11-28T19:59:19.574 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:19.568+0000 7f1e619aa640 1 Processor -- start 2023-11-28T19:59:19.574 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:19.568+0000 7f1e619aa640 1 -- start start 2023-11-28T19:59:19.576 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:19.572+0000 7f1e619aa640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1e48004d10 0x7f1e5c0aecb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:19.576 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:19.572+0000 7f1e619aa640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1e5c0af620 0x7f1e5c0accf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:19.576 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:19.572+0000 7f1e619aa640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1e5c1ed990 0x7f1e5c06b970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:19.576 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:19.572+0000 7f1e619aa640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e5c0c4270 con 0x7f1e5c0af620 2023-11-28T19:59:19.577 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:19.572+0000 7f1e619aa640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e5c0adf90 con 0x7f1e48004d10 2023-11-28T19:59:19.577 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:19.572+0000 7f1e619aa640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e5c0af1f0 con 0x7f1e5c1ed990 2023-11-28T19:59:19.577 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:19.572+0000 7f1e527fc640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1e5c0af620 0x7f1e5c0accf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:19.577 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:19.572+0000 7f1e527fc640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1e5c0af620 0x7f1e5c0accf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:60444/0 (socket says 172.21.15.78:60444) 2023-11-28T19:59:19.577 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:19.572+0000 7f1e527fc640 1 -- 172.21.15.78:0/2011982388 learned_addr learned my addr 172.21.15.78:0/2011982388 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T19:59:19.577 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:19.572+0000 7f1e5affd640 1 --2- 172.21.15.78:0/2011982388 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1e48004d10 0x7f1e5c0aecb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:19.577 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:19.572+0000 7f1e5b7fe640 1 --2- 172.21.15.78:0/2011982388 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1e5c1ed990 0x7f1e5c06b970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:19.577 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:19.572+0000 7f1e527fc640 1 -- 172.21.15.78:0/2011982388 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1e5c1ed990 msgr2=0x7f1e5c06b970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:19.577 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:19.572+0000 7f1e527fc640 1 --2- 172.21.15.78:0/2011982388 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1e5c1ed990 0x7f1e5c06b970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:19.577 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:19.572+0000 7f1e527fc640 1 -- 172.21.15.78:0/2011982388 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1e48004d10 msgr2=0x7f1e5c0aecb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:19.578 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:19.572+0000 7f1e527fc640 1 --2- 172.21.15.78:0/2011982388 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1e48004d10 0x7f1e5c0aecb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:19.578 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:19.572+0000 7f1e527fc640 1 -- 172.21.15.78:0/2011982388 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e5c0c3f90 con 0x7f1e5c0af620 2023-11-28T19:59:19.578 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:19.572+0000 7f1e5affd640 1 --2- 172.21.15.78:0/2011982388 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1e48004d10 0x7f1e5c0aecb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T19:59:19.578 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:19.572+0000 7f1e527fc640 1 --2- 172.21.15.78:0/2011982388 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1e5c0af620 0x7f1e5c0accf0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f1e4400f740 tx=0x7f1e4400fc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:59:19.578 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:19.572+0000 7f1e58ff9640 1 -- 172.21.15.78:0/2011982388 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e4400fe50 con 0x7f1e5c0af620 2023-11-28T19:59:19.578 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:19.572+0000 7f1e58ff9640 1 -- 172.21.15.78:0/2011982388 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e440052e0 con 0x7f1e5c0af620 2023-11-28T19:59:19.578 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:19.572+0000 7f1e619aa640 1 -- 172.21.15.78:0/2011982388 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1e5c1eceb0 con 0x7f1e5c0af620 2023-11-28T19:59:19.578 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:19.572+0000 7f1e58ff9640 1 -- 172.21.15.78:0/2011982388 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e4400d970 con 0x7f1e5c0af620 2023-11-28T19:59:19.579 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:19.572+0000 7f1e619aa640 1 -- 172.21.15.78:0/2011982388 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1e5c1ed470 con 0x7f1e5c0af620 2023-11-28T19:59:19.579 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:19.572+0000 7f1e619aa640 1 -- 172.21.15.78:0/2011982388 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1e5c1ecd10 con 0x7f1e5c0af620 2023-11-28T19:59:19.579 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:19.572+0000 7f1e58ff9640 1 -- 172.21.15.78:0/2011982388 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f1e4400dad0 con 0x7f1e5c0af620 2023-11-28T19:59:19.580 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:19.576+0000 7f1e58ff9640 1 --2- 172.21.15.78:0/2011982388 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f1e3c0664a0 0x7f1e3c068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:19.580 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:19.576+0000 7f1e58ff9640 1 -- 172.21.15.78:0/2011982388 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f1e44084190 con 0x7f1e5c0af620 2023-11-28T19:59:19.580 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:19.576+0000 7f1e5affd640 1 --2- 172.21.15.78:0/2011982388 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f1e3c0664a0 0x7f1e3c068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:19.580 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:19.576+0000 7f1e5affd640 1 --2- 172.21.15.78:0/2011982388 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f1e3c0664a0 0x7f1e3c068960 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f1e4c009d70 tx=0x7f1e4c008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:59:19.583 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:19.580+0000 7f1e58ff9640 1 -- 172.21.15.78:0/2011982388 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f1e5c1ecd10 con 0x7f1e5c0af620 2023-11-28T19:59:19.731 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:19.728+0000 7f1e619aa640 1 -- 172.21.15.78:0/2011982388 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f1e5c1ecd10 con 0x7f1e5c0af620 2023-11-28T19:59:19.732 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:19.728+0000 7f1e58ff9640 1 -- 172.21.15.78:0/2011982388 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v25) v1 ==== 104+0+11 (secure 0 0 0) 0x7f1e5c1ecd10 con 0x7f1e5c0af620 2023-11-28T19:59:19.732 INFO:teuthology.orchestra.run.smithi078.stdout:pg_num: 32 2023-11-28T19:59:19.735 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:19.728+0000 7f1e619aa640 1 -- 172.21.15.78:0/2011982388 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f1e3c0664a0 msgr2=0x7f1e3c068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:19.736 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:19.728+0000 7f1e619aa640 1 --2- 172.21.15.78:0/2011982388 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f1e3c0664a0 0x7f1e3c068960 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f1e4c009d70 tx=0x7f1e4c008040 comp rx=0 tx=0).stop 2023-11-28T19:59:19.736 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:19.728+0000 7f1e619aa640 1 -- 172.21.15.78:0/2011982388 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1e5c0af620 msgr2=0x7f1e5c0accf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:19.736 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:19.728+0000 7f1e619aa640 1 --2- 172.21.15.78:0/2011982388 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1e5c0af620 0x7f1e5c0accf0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f1e4400f740 tx=0x7f1e4400fc00 comp rx=0 tx=0).stop 2023-11-28T19:59:19.737 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:19.728+0000 7f1e619aa640 1 -- 172.21.15.78:0/2011982388 shutdown_connections 2023-11-28T19:59:19.737 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:19.728+0000 7f1e619aa640 1 --2- 172.21.15.78:0/2011982388 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f1e3c0664a0 0x7f1e3c068960 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:19.737 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:19.728+0000 7f1e619aa640 1 --2- 172.21.15.78:0/2011982388 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1e5c1ed990 0x7f1e5c06b970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:19.737 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:19.728+0000 7f1e619aa640 1 --2- 172.21.15.78:0/2011982388 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1e5c0af620 0x7f1e5c0accf0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:19.738 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:19.728+0000 7f1e619aa640 1 --2- 172.21.15.78:0/2011982388 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1e48004d10 0x7f1e5c0aecb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:19.738 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:19.728+0000 7f1e619aa640 1 -- 172.21.15.78:0/2011982388 >> 172.21.15.78:0/2011982388 conn(0x7f1e5c0c9dc0 msgr2=0x7f1e5c0aa6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T19:59:19.738 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:19.728+0000 7f1e619aa640 1 -- 172.21.15.78:0/2011982388 shutdown_connections 2023-11-28T19:59:19.738 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:19.728+0000 7f1e619aa640 1 -- 172.21.15.78:0/2011982388 wait complete. 2023-11-28T19:59:19.753 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-28T19:59:19.895 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:19.892+0000 7f384c2bb640 1 Processor -- start 2023-11-28T19:59:19.895 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:19.892+0000 7f384c2bb640 1 -- start start 2023-11-28T19:59:19.896 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:19.892+0000 7f384c2bb640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f38440c5300 0x7f38440a9c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:19.896 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:19.892+0000 7f384c2bb640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f38441548c0 0x7f3844154d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:19.897 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:19.892+0000 7f384c2bb640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f38440a4e20 con 0x7f384414b1e0 2023-11-28T19:59:19.897 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:19.892+0000 7f384c2bb640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f38440a50e0 con 0x7f38441548c0 2023-11-28T19:59:19.897 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:19.892+0000 7f384c2bb640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f38440c0f00 con 0x7f38440c5300 2023-11-28T19:59:19.897 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:19.892+0000 7f384a057640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f384414b1e0 0x7f38440c1700 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:35180/0 (socket says 172.21.15.78:35180) 2023-11-28T19:59:19.897 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:19.892+0000 7f384a057640 1 -- 172.21.15.78:0/3300841497 learned_addr learned my addr 172.21.15.78:0/3300841497 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-11-28T19:59:19.899 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:19.892+0000 7f3849856640 1 --2- 172.21.15.78:0/3300841497 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f38440c5300 0x7f38440a9c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:19.899 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:19.892+0000 7f384a858640 1 --2- 172.21.15.78:0/3300841497 >> v2:172.21.15.179:3300/0 conn(0x7f38441548c0 0x7f3844154d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:19.900 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:19.892+0000 7f3849055640 1 -- 172.21.15.78:0/3300841497 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 318320609 0 0) 0x7f38440a4e20 con 0x7f384414b1e0 2023-11-28T19:59:19.900 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:19.892+0000 7f3849055640 1 -- 172.21.15.78:0/3300841497 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3830003530 con 0x7f384414b1e0 2023-11-28T19:59:19.900 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:19.892+0000 7f3849055640 1 -- 172.21.15.78:0/3300841497 <== mon.0 v1:172.21.15.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3965309548 0 0) 0x7f3830003530 con 0x7f384414b1e0 2023-11-28T19:59:19.900 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:19.892+0000 7f3849055640 1 -- 172.21.15.78:0/3300841497 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f38440c5300 msgr2=0x7f38440a9c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T19:59:19.900 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:19.892+0000 7f3849055640 1 --2- 172.21.15.78:0/3300841497 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f38440c5300 0x7f38440a9c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:19.900 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:19.892+0000 7f3849055640 1 -- 172.21.15.78:0/3300841497 >> v2:172.21.15.179:3300/0 conn(0x7f38441548c0 msgr2=0x7f3844154d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T19:59:19.900 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:19.892+0000 7f3849055640 1 --2- 172.21.15.78:0/3300841497 >> v2:172.21.15.179:3300/0 conn(0x7f38441548c0 0x7f3844154d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:19.901 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:19.892+0000 7f3849055640 1 -- 172.21.15.78:0/3300841497 --> v1:172.21.15.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38440c11e0 con 0x7f384414b1e0 2023-11-28T19:59:19.901 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:19.892+0000 7f3849055640 1 -- 172.21.15.78:0/3300841497 <== mon.0 v1:172.21.15.78:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3326804700 0 0) 0x7f38400016a0 con 0x7f384414b1e0 2023-11-28T19:59:19.901 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:19.892+0000 7f3849055640 1 -- 172.21.15.78:0/3300841497 >> v1:172.21.15.78:6789/0 conn(0x7f384414b1e0 legacy=0x7f38440c1700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:19.901 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:19.892+0000 7f3849055640 1 --2- 172.21.15.78:0/3300841497 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3830003980 0x7f3830003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:19.901 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:19.892+0000 7f3849055640 1 --2- 172.21.15.78:0/3300841497 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f38300047d0 0x7f3830004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:19.901 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:19.892+0000 7f3849055640 1 --2- 172.21.15.78:0/3300841497 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f38440c5300 0x7f3830005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:19.901 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:19.892+0000 7f3849055640 1 -- 172.21.15.78:0/3300841497 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38440a50e0 con 0x7f3830003980 2023-11-28T19:59:19.902 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:19.892+0000 7f3849055640 1 -- 172.21.15.78:0/3300841497 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38440c0f00 con 0x7f38300047d0 2023-11-28T19:59:19.902 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:19.892+0000 7f3849055640 1 -- 172.21.15.78:0/3300841497 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f383000dba0 con 0x7f38440c5300 2023-11-28T19:59:19.902 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:19.892+0000 7f384a057640 1 --2- 172.21.15.78:0/3300841497 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3830003980 0x7f3830003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:19.902 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:19.892+0000 7f3849856640 1 --2- 172.21.15.78:0/3300841497 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f38300047d0 0x7f3830004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:19.902 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:19.892+0000 7f384a858640 1 --2- 172.21.15.78:0/3300841497 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f38440c5300 0x7f3830005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:19.902 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:19.892+0000 7f384a057640 1 -- 172.21.15.78:0/3300841497 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f38440c5300 msgr2=0x7f3830005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T19:59:19.902 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:19.892+0000 7f384a057640 1 --2- 172.21.15.78:0/3300841497 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f38440c5300 0x7f3830005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:19.902 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:19.892+0000 7f384a057640 1 -- 172.21.15.78:0/3300841497 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f38300047d0 msgr2=0x7f3830004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T19:59:19.903 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:19.892+0000 7f384a057640 1 --2- 172.21.15.78:0/3300841497 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f38300047d0 0x7f3830004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:19.903 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:19.892+0000 7f384a057640 1 -- 172.21.15.78:0/3300841497 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3830003530 con 0x7f3830003980 2023-11-28T19:59:19.903 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:19.892+0000 7f384a858640 1 --2- 172.21.15.78:0/3300841497 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f38440c5300 0x7f3830005190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T19:59:19.907 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:19.896+0000 7f384a057640 1 --2- 172.21.15.78:0/3300841497 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3830003980 0x7f3830003da0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f384000c210 tx=0x7f384001cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=18fc3b9e4b6bb299 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:59:19.907 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:19.896+0000 7f3849055640 1 -- 172.21.15.78:0/3300841497 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38400058e0 con 0x7f3830003980 2023-11-28T19:59:19.907 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:19.896+0000 7f3849055640 1 -- 172.21.15.78:0/3300841497 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3840005a40 con 0x7f3830003980 2023-11-28T19:59:19.907 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:19.896+0000 7f3849055640 1 -- 172.21.15.78:0/3300841497 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3840005df0 con 0x7f3830003980 2023-11-28T19:59:19.907 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:19.896+0000 7f384c2bb640 1 -- 172.21.15.78:0/3300841497 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3830003980 msgr2=0x7f3830003da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:19.907 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:19.896+0000 7f384c2bb640 1 --2- 172.21.15.78:0/3300841497 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3830003980 0x7f3830003da0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f384000c210 tx=0x7f384001cc40 comp rx=0 tx=0).stop 2023-11-28T19:59:19.907 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:19.896+0000 7f384a858640 1 -- 172.21.15.78:0/3300841497 reap_dead start 2023-11-28T19:59:19.907 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:19.896+0000 7f384c2bb640 1 -- 172.21.15.78:0/3300841497 shutdown_connections 2023-11-28T19:59:19.908 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:19.896+0000 7f384c2bb640 1 -- 172.21.15.78:0/3300841497 >> 172.21.15.78:0/3300841497 conn(0x7f38440c59f0 msgr2=0x7f38440c5e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T19:59:19.908 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:19.896+0000 7f384c2bb640 1 -- 172.21.15.78:0/3300841497 shutdown_connections 2023-11-28T19:59:19.908 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:19.896+0000 7f384c2bb640 1 -- 172.21.15.78:0/3300841497 wait complete. 2023-11-28T19:59:19.908 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:19.900+0000 7f384c2bb640 1 Processor -- start 2023-11-28T19:59:19.908 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:19.900+0000 7f384c2bb640 1 -- start start 2023-11-28T19:59:19.908 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:19.900+0000 7f384c2bb640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3830003980 0x7f38441f0f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:19.908 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:19.900+0000 7f384c2bb640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f384406d6b0 0x7f38440a6c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:19.908 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:19.900+0000 7f384c2bb640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f38441ed630 0x7f38441edab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:19.908 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:19.900+0000 7f384c2bb640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3844147310 con 0x7f384406d6b0 2023-11-28T19:59:19.909 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:19.900+0000 7f384c2bb640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3844147560 con 0x7f3830003980 2023-11-28T19:59:19.909 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:19.900+0000 7f384c2bb640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3844147840 con 0x7f38441ed630 2023-11-28T19:59:19.909 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:19.900+0000 7f3849856640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f384406d6b0 0x7f38440a6c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:19.909 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:19.900+0000 7f3849856640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f384406d6b0 0x7f38440a6c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:60452/0 (socket says 172.21.15.78:60452) 2023-11-28T19:59:19.909 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:19.900+0000 7f3849856640 1 -- 172.21.15.78:0/3840037784 learned_addr learned my addr 172.21.15.78:0/3840037784 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T19:59:19.909 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:19.900+0000 7f384a057640 1 --2- 172.21.15.78:0/3840037784 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3830003980 0x7f38441f0f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:19.909 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:19.900+0000 7f384a858640 1 --2- 172.21.15.78:0/3840037784 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f38441ed630 0x7f38441edab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:19.909 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:19.900+0000 7f3849856640 1 -- 172.21.15.78:0/3840037784 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f38441ed630 msgr2=0x7f38441edab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:19.909 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:19.900+0000 7f3849856640 1 --2- 172.21.15.78:0/3840037784 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f38441ed630 0x7f38441edab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:19.909 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:19.900+0000 7f3849856640 1 -- 172.21.15.78:0/3840037784 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3830003980 msgr2=0x7f38441f0f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:19.909 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:19.900+0000 7f3849856640 1 --2- 172.21.15.78:0/3840037784 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3830003980 0x7f38441f0f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:19.909 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:19.900+0000 7f3849856640 1 -- 172.21.15.78:0/3840037784 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38441ed110 con 0x7f384406d6b0 2023-11-28T19:59:19.909 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:19.900+0000 7f384a858640 1 --2- 172.21.15.78:0/3840037784 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f38441ed630 0x7f38441edab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T19:59:19.910 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:19.900+0000 7f3849856640 1 --2- 172.21.15.78:0/3840037784 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f384406d6b0 0x7f38440a6c50 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f3834011960 tx=0x7f3834011e20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:59:19.910 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:19.900+0000 7f383affd640 1 -- 172.21.15.78:0/3840037784 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3834004240 con 0x7f384406d6b0 2023-11-28T19:59:19.910 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:19.900+0000 7f383affd640 1 -- 172.21.15.78:0/3840037784 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f38340043a0 con 0x7f384406d6b0 2023-11-28T19:59:19.910 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:19.900+0000 7f383affd640 1 -- 172.21.15.78:0/3840037784 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f383400fb00 con 0x7f384406d6b0 2023-11-28T19:59:19.910 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:19.900+0000 7f384c2bb640 1 -- 172.21.15.78:0/3840037784 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f38440a7190 con 0x7f384406d6b0 2023-11-28T19:59:19.910 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:19.900+0000 7f384c2bb640 1 -- 172.21.15.78:0/3840037784 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3844142740 con 0x7f384406d6b0 2023-11-28T19:59:19.910 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:19.904+0000 7f384c2bb640 1 -- 172.21.15.78:0/3840037784 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3844067630 con 0x7f384406d6b0 2023-11-28T19:59:19.911 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:19.904+0000 7f383affd640 1 -- 172.21.15.78:0/3840037784 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f383400fc60 con 0x7f384406d6b0 2023-11-28T19:59:19.911 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:19.904+0000 7f383affd640 1 --2- 172.21.15.78:0/3840037784 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f38280664a0 0x7f3828068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:19.912 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:19.904+0000 7f383affd640 1 -- 172.21.15.78:0/3840037784 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f3834084720 con 0x7f384406d6b0 2023-11-28T19:59:19.912 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:19.904+0000 7f384a057640 1 --2- 172.21.15.78:0/3840037784 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f38280664a0 0x7f3828068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:19.912 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:19.904+0000 7f384a057640 1 --2- 172.21.15.78:0/3840037784 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f38280664a0 0x7f3828068960 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f38400aa000 tx=0x7f3840001aa0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:59:19.912 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:19.908+0000 7f383affd640 1 -- 172.21.15.78:0/3840037784 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f3834051950 con 0x7f384406d6b0 2023-11-28T19:59:20.077 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:20.072+0000 7f384c2bb640 1 -- 172.21.15.78:0/3840037784 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f38441ed2a0 con 0x7f384406d6b0 2023-11-28T19:59:20.077 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:20.072+0000 7f383affd640 1 -- 172.21.15.78:0/3840037784 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v25) v1 ==== 100+0+11 (secure 0 0 0) 0x7f3834054f70 con 0x7f384406d6b0 2023-11-28T19:59:20.077 INFO:teuthology.orchestra.run.smithi078.stdout:pg_num: 64 2023-11-28T19:59:20.079 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:20.072+0000 7f384c2bb640 1 -- 172.21.15.78:0/3840037784 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f38280664a0 msgr2=0x7f3828068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:20.079 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:20.072+0000 7f384c2bb640 1 --2- 172.21.15.78:0/3840037784 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f38280664a0 0x7f3828068960 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f38400aa000 tx=0x7f3840001aa0 comp rx=0 tx=0).stop 2023-11-28T19:59:20.079 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:20.072+0000 7f384c2bb640 1 -- 172.21.15.78:0/3840037784 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f384406d6b0 msgr2=0x7f38440a6c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:20.079 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:20.072+0000 7f384c2bb640 1 --2- 172.21.15.78:0/3840037784 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f384406d6b0 0x7f38440a6c50 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f3834011960 tx=0x7f3834011e20 comp rx=0 tx=0).stop 2023-11-28T19:59:20.079 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:20.076+0000 7f384c2bb640 1 -- 172.21.15.78:0/3840037784 shutdown_connections 2023-11-28T19:59:20.079 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:20.076+0000 7f384c2bb640 1 --2- 172.21.15.78:0/3840037784 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f38280664a0 0x7f3828068960 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:20.079 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:20.076+0000 7f384c2bb640 1 --2- 172.21.15.78:0/3840037784 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f38441ed630 0x7f38441edab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:20.080 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:20.076+0000 7f384c2bb640 1 --2- 172.21.15.78:0/3840037784 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f384406d6b0 0x7f38440a6c50 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:20.080 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:20.076+0000 7f384c2bb640 1 --2- 172.21.15.78:0/3840037784 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3830003980 0x7f38441f0f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:20.080 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:20.076+0000 7f384c2bb640 1 -- 172.21.15.78:0/3840037784 >> 172.21.15.78:0/3840037784 conn(0x7f38440c59f0 msgr2=0x7f38441497c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T19:59:20.080 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:20.076+0000 7f384c2bb640 1 -- 172.21.15.78:0/3840037784 shutdown_connections 2023-11-28T19:59:20.080 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:20.076+0000 7f384c2bb640 1 -- 172.21.15.78:0/3840037784 wait complete. 2023-11-28T19:59:20.098 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-11-28T19:59:20.239 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:20.232+0000 7fe677bb8640 1 Processor -- start 2023-11-28T19:59:20.239 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:20.236+0000 7fe677bb8640 1 -- start start 2023-11-28T19:59:20.241 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:20.236+0000 7fe677bb8640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe670156200 0x7fe6700c0370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:20.241 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:20.236+0000 7fe677bb8640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fe6700c0e10 0x7fe6700c1b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:20.241 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:20.236+0000 7fe677bb8640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fe67015bf70 0x7fe67015c400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:20.241 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:20.236+0000 7fe677bb8640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe67006d8d0 con 0x7fe67015bf70 2023-11-28T19:59:20.241 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:20.236+0000 7fe677bb8640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe67006bce0 con 0x7fe6700c0e10 2023-11-28T19:59:20.241 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:20.236+0000 7fe677bb8640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe67015cc60 con 0x7fe670156200 2023-11-28T19:59:20.241 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:20.236+0000 7fe676155640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fe67015bf70 0x7fe67015c400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:20.241 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:20.236+0000 7fe676155640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fe67015bf70 0x7fe67015c400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:60464/0 (socket says 172.21.15.78:60464) 2023-11-28T19:59:20.241 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:20.236+0000 7fe676155640 1 -- 172.21.15.78:0/187591365 learned_addr learned my addr 172.21.15.78:0/187591365 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T19:59:20.242 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:20.236+0000 7fe675954640 1 --2- 172.21.15.78:0/187591365 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe670156200 0x7fe6700c0370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:20.242 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:20.236+0000 7fe675153640 1 --2- 172.21.15.78:0/187591365 >> v2:172.21.15.179:3300/0 conn(0x7fe6700c0e10 0x7fe6700c1b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:20.242 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:20.236+0000 7fe676155640 1 -- 172.21.15.78:0/187591365 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe670156200 msgr2=0x7fe6700c0370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T19:59:20.242 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:20.236+0000 7fe676155640 1 --2- 172.21.15.78:0/187591365 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe670156200 0x7fe6700c0370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:20.242 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:20.236+0000 7fe676155640 1 -- 172.21.15.78:0/187591365 >> v2:172.21.15.179:3300/0 conn(0x7fe6700c0e10 msgr2=0x7fe6700c1b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T19:59:20.242 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:20.236+0000 7fe676155640 1 --2- 172.21.15.78:0/187591365 >> v2:172.21.15.179:3300/0 conn(0x7fe6700c0e10 0x7fe6700c1b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:20.242 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:20.236+0000 7fe676155640 1 -- 172.21.15.78:0/187591365 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe67006bf30 con 0x7fe67015bf70 2023-11-28T19:59:20.243 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:20.240+0000 7fe676155640 1 --2- 172.21.15.78:0/187591365 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe67015bf70 0x7fe67015c400 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fe67006f790 tx=0x7fe66801c870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=16d6e1830f8391f2 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:59:20.244 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:20.240+0000 7fe674952640 1 -- 172.21.15.78:0/187591365 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6680a5640 con 0x7fe67015bf70 2023-11-28T19:59:20.244 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:20.240+0000 7fe674952640 1 -- 172.21.15.78:0/187591365 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe6680a57a0 con 0x7fe67015bf70 2023-11-28T19:59:20.244 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:20.240+0000 7fe674952640 1 -- 172.21.15.78:0/187591365 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6680a5b30 con 0x7fe67015bf70 2023-11-28T19:59:20.245 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:20.240+0000 7fe677bb8640 1 -- 172.21.15.78:0/187591365 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe67015bf70 msgr2=0x7fe67015c400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:20.245 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:20.240+0000 7fe677bb8640 1 --2- 172.21.15.78:0/187591365 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe67015bf70 0x7fe67015c400 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fe67006f790 tx=0x7fe66801c870 comp rx=0 tx=0).stop 2023-11-28T19:59:20.245 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:20.240+0000 7fe677bb8640 1 -- 172.21.15.78:0/187591365 shutdown_connections 2023-11-28T19:59:20.245 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:20.240+0000 7fe677bb8640 1 --2- 172.21.15.78:0/187591365 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe67015bf70 0x7fe67015c400 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:20.245 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:20.240+0000 7fe677bb8640 1 --2- 172.21.15.78:0/187591365 >> v2:172.21.15.179:3300/0 conn(0x7fe6700c0e10 0x7fe6700c1b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:20.245 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:20.240+0000 7fe677bb8640 1 --2- 172.21.15.78:0/187591365 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe670156200 0x7fe6700c0370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:20.245 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:20.240+0000 7fe677bb8640 1 -- 172.21.15.78:0/187591365 >> 172.21.15.78:0/187591365 conn(0x7fe6700c59f0 msgr2=0x7fe6700c5e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T19:59:20.246 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:20.240+0000 7fe677bb8640 1 -- 172.21.15.78:0/187591365 shutdown_connections 2023-11-28T19:59:20.246 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:20.240+0000 7fe677bb8640 1 -- 172.21.15.78:0/187591365 wait complete. 2023-11-28T19:59:20.246 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:20.240+0000 7fe677bb8640 1 Processor -- start 2023-11-28T19:59:20.246 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:20.240+0000 7fe677bb8640 1 -- start start 2023-11-28T19:59:20.250 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:20.244+0000 7fe677bb8640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe6700c0e10 0x7fe670157af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:20.251 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:20.244+0000 7fe677bb8640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe670156200 0x7fe6701f47b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:20.251 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:20.244+0000 7fe677bb8640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe67015bf70 0x7fe6701f4cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:20.251 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:20.244+0000 7fe677bb8640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6701474b0 con 0x7fe670156200 2023-11-28T19:59:20.251 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:20.244+0000 7fe677bb8640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe670143920 con 0x7fe67015bf70 2023-11-28T19:59:20.251 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:20.244+0000 7fe677bb8640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe6701f4360 con 0x7fe6700c0e10 2023-11-28T19:59:20.251 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:20.244+0000 7fe675153640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe670156200 0x7fe6701f47b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:20.251 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:20.244+0000 7fe675153640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe670156200 0x7fe6701f47b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:60474/0 (socket says 172.21.15.78:60474) 2023-11-28T19:59:20.251 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:20.244+0000 7fe675153640 1 -- 172.21.15.78:0/29644872 learned_addr learned my addr 172.21.15.78:0/29644872 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T19:59:20.251 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:20.244+0000 7fe675954640 1 --2- 172.21.15.78:0/29644872 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe6700c0e10 0x7fe670157af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:20.251 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:20.244+0000 7fe676155640 1 --2- 172.21.15.78:0/29644872 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe67015bf70 0x7fe6701f4cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:20.251 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:20.244+0000 7fe675153640 1 -- 172.21.15.78:0/29644872 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe6700c0e10 msgr2=0x7fe670157af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:20.252 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:20.244+0000 7fe675153640 1 --2- 172.21.15.78:0/29644872 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe6700c0e10 0x7fe670157af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:20.252 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:20.244+0000 7fe675153640 1 -- 172.21.15.78:0/29644872 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe67015bf70 msgr2=0x7fe6701f4cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:20.252 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:20.244+0000 7fe675153640 1 --2- 172.21.15.78:0/29644872 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe67015bf70 0x7fe6701f4cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:20.252 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:20.244+0000 7fe675153640 1 -- 172.21.15.78:0/29644872 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe668009b30 con 0x7fe670156200 2023-11-28T19:59:20.252 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:20.244+0000 7fe676155640 1 --2- 172.21.15.78:0/29644872 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe67015bf70 0x7fe6701f4cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T19:59:20.252 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:20.244+0000 7fe675153640 1 --2- 172.21.15.78:0/29644872 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe670156200 0x7fe6701f47b0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fe66000d5f0 tx=0x7fe66000dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:59:20.252 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:20.244+0000 7fe6667fc640 1 -- 172.21.15.78:0/29644872 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6600125f0 con 0x7fe670156200 2023-11-28T19:59:20.252 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:20.244+0000 7fe6667fc640 1 -- 172.21.15.78:0/29644872 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe660012750 con 0x7fe670156200 2023-11-28T19:59:20.252 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:20.244+0000 7fe677bb8640 1 -- 172.21.15.78:0/29644872 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe67015b120 con 0x7fe670156200 2023-11-28T19:59:20.252 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:20.244+0000 7fe6667fc640 1 -- 172.21.15.78:0/29644872 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe660012ae0 con 0x7fe670156200 2023-11-28T19:59:20.252 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:20.244+0000 7fe677bb8640 1 -- 172.21.15.78:0/29644872 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe67015bc60 con 0x7fe670156200 2023-11-28T19:59:20.252 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:20.244+0000 7fe677bb8640 1 -- 172.21.15.78:0/29644872 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe6701f44d0 con 0x7fe670156200 2023-11-28T19:59:20.252 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:20.248+0000 7fe6667fc640 1 -- 172.21.15.78:0/29644872 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fe660012c40 con 0x7fe670156200 2023-11-28T19:59:20.253 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:20.248+0000 7fe6667fc640 1 --2- 172.21.15.78:0/29644872 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fe654066470 0x7fe654068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:20.253 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:20.248+0000 7fe6667fc640 1 -- 172.21.15.78:0/29644872 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fe660084370 con 0x7fe670156200 2023-11-28T19:59:20.254 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:20.248+0000 7fe675954640 1 --2- 172.21.15.78:0/29644872 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fe654066470 0x7fe654068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:20.254 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:20.248+0000 7fe675954640 1 --2- 172.21.15.78:0/29644872 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fe654066470 0x7fe654068930 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fe66c009ae0 tx=0x7fe66c009190 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:59:20.256 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:20.252+0000 7fe6667fc640 1 -- 172.21.15.78:0/29644872 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fe6701f44d0 con 0x7fe670156200 2023-11-28T19:59:20.406 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:20.400+0000 7fe677bb8640 1 -- 172.21.15.78:0/29644872 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7fe67015bc60 con 0x7fe670156200 2023-11-28T19:59:20.406 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:20.400+0000 7fe6667fc640 1 -- 172.21.15.78:0/29644872 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v25) v1 ==== 103+0+11 (secure 0 0 0) 0x7fe67015bc60 con 0x7fe670156200 2023-11-28T19:59:20.406 INFO:teuthology.orchestra.run.smithi078.stdout:pg_num: 32 2023-11-28T19:59:20.408 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:20.404+0000 7fe677bb8640 1 -- 172.21.15.78:0/29644872 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fe654066470 msgr2=0x7fe654068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:20.408 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:20.404+0000 7fe677bb8640 1 --2- 172.21.15.78:0/29644872 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fe654066470 0x7fe654068930 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fe66c009ae0 tx=0x7fe66c009190 comp rx=0 tx=0).stop 2023-11-28T19:59:20.408 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:20.404+0000 7fe677bb8640 1 -- 172.21.15.78:0/29644872 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe670156200 msgr2=0x7fe6701f47b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:20.408 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:20.404+0000 7fe677bb8640 1 --2- 172.21.15.78:0/29644872 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe670156200 0x7fe6701f47b0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fe66000d5f0 tx=0x7fe66000dab0 comp rx=0 tx=0).stop 2023-11-28T19:59:20.409 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:20.404+0000 7fe677bb8640 1 -- 172.21.15.78:0/29644872 shutdown_connections 2023-11-28T19:59:20.409 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:20.404+0000 7fe677bb8640 1 --2- 172.21.15.78:0/29644872 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fe654066470 0x7fe654068930 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:20.409 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:20.404+0000 7fe677bb8640 1 --2- 172.21.15.78:0/29644872 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe67015bf70 0x7fe6701f4cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:20.409 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:20.404+0000 7fe677bb8640 1 --2- 172.21.15.78:0/29644872 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe670156200 0x7fe6701f47b0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:20.409 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:20.404+0000 7fe677bb8640 1 --2- 172.21.15.78:0/29644872 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe6700c0e10 0x7fe670157af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:20.409 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:20.404+0000 7fe677bb8640 1 -- 172.21.15.78:0/29644872 >> 172.21.15.78:0/29644872 conn(0x7fe6700c59f0 msgr2=0x7fe67014c990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T19:59:20.409 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:20.404+0000 7fe677bb8640 1 -- 172.21.15.78:0/29644872 shutdown_connections 2023-11-28T19:59:20.409 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:20.404+0000 7fe677bb8640 1 -- 172.21.15.78:0/29644872 wait complete. 2023-11-28T19:59:20.427 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-11-28T19:59:20.564 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:20.560+0000 7f8f333f8640 1 Processor -- start 2023-11-28T19:59:20.564 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:20.560+0000 7f8f333f8640 1 -- start start 2023-11-28T19:59:20.566 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:20.560+0000 7f8f333f8640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8f2c152d30 0x7f8f2c15cba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:20.566 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:20.560+0000 7f8f333f8640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f8f2c0c3930 0x7f8f2c06d160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:20.566 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:20.560+0000 7f8f333f8640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8f2c15c710 con 0x7f8f2c0c3d90 2023-11-28T19:59:20.566 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:20.560+0000 7f8f333f8640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8f2c06c360 con 0x7f8f2c0c3930 2023-11-28T19:59:20.566 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:20.560+0000 7f8f333f8640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8f2c0aa820 con 0x7f8f2c152d30 2023-11-28T19:59:20.566 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:20.560+0000 7f8f31995640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f8f2c0c3d90 0x7f8f2c0a9af0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:35182/0 (socket says 172.21.15.78:35182) 2023-11-28T19:59:20.566 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:20.560+0000 7f8f31995640 1 -- 172.21.15.78:0/251321505 learned_addr learned my addr 172.21.15.78:0/251321505 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-11-28T19:59:20.566 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:20.560+0000 7f8f30993640 1 --2- 172.21.15.78:0/251321505 >> v2:172.21.15.179:3300/0 conn(0x7f8f2c0c3930 0x7f8f2c06d160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:20.566 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:20.560+0000 7f8f31194640 1 --2- 172.21.15.78:0/251321505 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8f2c152d30 0x7f8f2c15cba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:20.567 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:20.560+0000 7f8f23fff640 1 -- 172.21.15.78:0/251321505 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2521750291 0 0) 0x7f8f2c15c710 con 0x7f8f2c0c3d90 2023-11-28T19:59:20.567 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:20.560+0000 7f8f23fff640 1 -- 172.21.15.78:0/251321505 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8f18003530 con 0x7f8f2c0c3d90 2023-11-28T19:59:20.567 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:20.560+0000 7f8f31194640 1 -- 172.21.15.78:0/251321505 >> v2:172.21.15.179:3300/0 conn(0x7f8f2c0c3930 msgr2=0x7f8f2c06d160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T19:59:20.567 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:20.560+0000 7f8f31194640 1 --2- 172.21.15.78:0/251321505 >> v2:172.21.15.179:3300/0 conn(0x7f8f2c0c3930 0x7f8f2c06d160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:20.567 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:20.560+0000 7f8f31194640 1 -- 172.21.15.78:0/251321505 >> v1:172.21.15.78:6789/0 conn(0x7f8f2c0c3d90 legacy=0x7f8f2c0a9af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:20.567 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:20.560+0000 7f8f31194640 1 -- 172.21.15.78:0/251321505 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f2c15c0c0 con 0x7f8f2c152d30 2023-11-28T19:59:20.569 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:20.564+0000 7f8f31194640 1 --2- 172.21.15.78:0/251321505 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8f2c152d30 0x7f8f2c15cba0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f8f280097c0 tx=0x7f8f2801c450 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f068463f5a1a9597 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:59:20.570 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:20.564+0000 7f8f23fff640 1 -- 172.21.15.78:0/251321505 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f280ad660 con 0x7f8f2c152d30 2023-11-28T19:59:20.570 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:20.564+0000 7f8f23fff640 1 -- 172.21.15.78:0/251321505 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f280ad7c0 con 0x7f8f2c152d30 2023-11-28T19:59:20.570 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:20.564+0000 7f8f23fff640 1 -- 172.21.15.78:0/251321505 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f280adb50 con 0x7f8f2c152d30 2023-11-28T19:59:20.570 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:20.564+0000 7f8f333f8640 1 -- 172.21.15.78:0/251321505 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8f2c152d30 msgr2=0x7f8f2c15cba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:20.570 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:20.564+0000 7f8f333f8640 1 --2- 172.21.15.78:0/251321505 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8f2c152d30 0x7f8f2c15cba0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f8f280097c0 tx=0x7f8f2801c450 comp rx=0 tx=0).stop 2023-11-28T19:59:20.571 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:20.564+0000 7f8f333f8640 1 -- 172.21.15.78:0/251321505 shutdown_connections 2023-11-28T19:59:20.571 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:20.564+0000 7f8f333f8640 1 --2- 172.21.15.78:0/251321505 >> v2:172.21.15.179:3300/0 conn(0x7f8f2c0c3930 0x7f8f2c06d160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:20.571 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:20.564+0000 7f8f333f8640 1 --2- 172.21.15.78:0/251321505 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8f2c152d30 0x7f8f2c15cba0 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:20.571 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:20.564+0000 7f8f333f8640 1 -- 172.21.15.78:0/251321505 >> 172.21.15.78:0/251321505 conn(0x7f8f2c06b220 msgr2=0x7f8f2c0a77e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T19:59:20.571 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:20.564+0000 7f8f333f8640 1 -- 172.21.15.78:0/251321505 shutdown_connections 2023-11-28T19:59:20.571 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:20.564+0000 7f8f333f8640 1 -- 172.21.15.78:0/251321505 wait complete. 2023-11-28T19:59:20.572 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:20.568+0000 7f8f333f8640 1 Processor -- start 2023-11-28T19:59:20.572 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:20.568+0000 7f8f333f8640 1 -- start start 2023-11-28T19:59:20.574 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:20.568+0000 7f8f333f8640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8f2c0c3930 0x7f8f2c152250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:20.574 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:20.568+0000 7f8f333f8640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8f2c0c3d90 0x7f8f2c151460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:20.574 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:20.568+0000 7f8f333f8640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8f2c152d30 0x7f8f2c071900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:20.574 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:20.568+0000 7f8f333f8640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f2c0a7620 con 0x7f8f2c0c3930 2023-11-28T19:59:20.574 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:20.568+0000 7f8f333f8640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f2c0a5730 con 0x7f8f2c0c3d90 2023-11-28T19:59:20.574 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:20.568+0000 7f8f333f8640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8f2c14ae10 con 0x7f8f2c152d30 2023-11-28T19:59:20.574 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:20.568+0000 7f8f31194640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8f2c0c3930 0x7f8f2c152250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:20.574 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:20.568+0000 7f8f31194640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8f2c0c3930 0x7f8f2c152250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:60484/0 (socket says 172.21.15.78:60484) 2023-11-28T19:59:20.575 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:20.568+0000 7f8f31194640 1 -- 172.21.15.78:0/2585597020 learned_addr learned my addr 172.21.15.78:0/2585597020 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T19:59:20.575 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:20.568+0000 7f8f30993640 1 --2- 172.21.15.78:0/2585597020 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8f2c0c3d90 0x7f8f2c151460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:20.575 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:20.568+0000 7f8f31995640 1 --2- 172.21.15.78:0/2585597020 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8f2c152d30 0x7f8f2c071900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:20.575 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:20.568+0000 7f8f31194640 1 -- 172.21.15.78:0/2585597020 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8f2c152d30 msgr2=0x7f8f2c071900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:20.575 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:20.568+0000 7f8f31194640 1 --2- 172.21.15.78:0/2585597020 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8f2c152d30 0x7f8f2c071900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:20.575 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:20.568+0000 7f8f31194640 1 -- 172.21.15.78:0/2585597020 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8f2c0c3d90 msgr2=0x7f8f2c151460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:20.575 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:20.568+0000 7f8f31194640 1 --2- 172.21.15.78:0/2585597020 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8f2c0c3d90 0x7f8f2c151460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:20.575 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:20.568+0000 7f8f31194640 1 -- 172.21.15.78:0/2585597020 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f28009420 con 0x7f8f2c0c3930 2023-11-28T19:59:20.575 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:20.568+0000 7f8f31194640 1 --2- 172.21.15.78:0/2585597020 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8f2c0c3930 0x7f8f2c152250 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f8f2801ab00 tx=0x7f8f280191f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:59:20.576 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:20.568+0000 7f8f21ffb640 1 -- 172.21.15.78:0/2585597020 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f280b7670 con 0x7f8f2c0c3930 2023-11-28T19:59:20.576 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:20.568+0000 7f8f21ffb640 1 -- 172.21.15.78:0/2585597020 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f280b77f0 con 0x7f8f2c0c3930 2023-11-28T19:59:20.576 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:20.568+0000 7f8f21ffb640 1 -- 172.21.15.78:0/2585597020 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f280b7ba0 con 0x7f8f2c0c3930 2023-11-28T19:59:20.576 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:20.568+0000 7f8f333f8640 1 -- 172.21.15.78:0/2585597020 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8f2c14b0f0 con 0x7f8f2c0c3930 2023-11-28T19:59:20.576 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:20.568+0000 7f8f333f8640 1 -- 172.21.15.78:0/2585597020 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8f2c14b6b0 con 0x7f8f2c0c3930 2023-11-28T19:59:20.577 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:20.572+0000 7f8f333f8640 1 -- 172.21.15.78:0/2585597020 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8f2c14b8a0 con 0x7f8f2c0c3930 2023-11-28T19:59:20.577 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:20.572+0000 7f8f21ffb640 1 -- 172.21.15.78:0/2585597020 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f8f280b4040 con 0x7f8f2c0c3930 2023-11-28T19:59:20.578 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:20.572+0000 7f8f21ffb640 1 --2- 172.21.15.78:0/2585597020 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f8f10066470 0x7f8f10068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:20.578 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:20.572+0000 7f8f21ffb640 1 -- 172.21.15.78:0/2585597020 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f8f2811e830 con 0x7f8f2c0c3930 2023-11-28T19:59:20.578 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:20.572+0000 7f8f30993640 1 --2- 172.21.15.78:0/2585597020 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f8f10066470 0x7f8f10068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:20.578 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:20.572+0000 7f8f30993640 1 --2- 172.21.15.78:0/2585597020 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f8f10066470 0x7f8f10068930 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f8f2c14baa0 tx=0x7f8f1c008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:59:20.582 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:20.576+0000 7f8f21ffb640 1 -- 172.21.15.78:0/2585597020 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f8f280eb920 con 0x7f8f2c0c3930 2023-11-28T19:59:20.743 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:20.739+0000 7f8f333f8640 1 -- 172.21.15.78:0/2585597020 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f8f2c067630 con 0x7f8f2c0c3930 2023-11-28T19:59:20.743 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:20.739+0000 7f8f21ffb640 1 -- 172.21.15.78:0/2585597020 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v25) v1 ==== 80+0+0 (secure 0 0 0) 0x7f8f280eef40 con 0x7f8f2c0c3930 2023-11-28T19:59:20.743 INFO:teuthology.orchestra.run.smithi078.stderr:listed 0 entries 2023-11-28T19:59:20.745 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:20.739+0000 7f8f333f8640 1 -- 172.21.15.78:0/2585597020 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f8f10066470 msgr2=0x7f8f10068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:20.746 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:20.739+0000 7f8f333f8640 1 --2- 172.21.15.78:0/2585597020 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f8f10066470 0x7f8f10068930 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f8f2c14baa0 tx=0x7f8f1c008040 comp rx=0 tx=0).stop 2023-11-28T19:59:20.746 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:20.739+0000 7f8f333f8640 1 -- 172.21.15.78:0/2585597020 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8f2c0c3930 msgr2=0x7f8f2c152250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:20.746 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:20.739+0000 7f8f333f8640 1 --2- 172.21.15.78:0/2585597020 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8f2c0c3930 0x7f8f2c152250 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f8f2801ab00 tx=0x7f8f280191f0 comp rx=0 tx=0).stop 2023-11-28T19:59:20.746 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:20.739+0000 7f8f333f8640 1 -- 172.21.15.78:0/2585597020 shutdown_connections 2023-11-28T19:59:20.746 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:20.739+0000 7f8f333f8640 1 --2- 172.21.15.78:0/2585597020 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f8f10066470 0x7f8f10068930 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:20.746 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:20.739+0000 7f8f333f8640 1 --2- 172.21.15.78:0/2585597020 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8f2c152d30 0x7f8f2c071900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:20.746 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:20.739+0000 7f8f333f8640 1 --2- 172.21.15.78:0/2585597020 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8f2c0c3d90 0x7f8f2c151460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:20.746 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:20.739+0000 7f8f333f8640 1 --2- 172.21.15.78:0/2585597020 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8f2c0c3930 0x7f8f2c152250 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:20.746 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:20.739+0000 7f8f333f8640 1 -- 172.21.15.78:0/2585597020 >> 172.21.15.78:0/2585597020 conn(0x7f8f2c06b220 msgr2=0x7f8f2c0c56e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T19:59:20.746 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:20.739+0000 7f8f333f8640 1 -- 172.21.15.78:0/2585597020 shutdown_connections 2023-11-28T19:59:20.746 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:20.739+0000 7f8f333f8640 1 -- 172.21.15.78:0/2585597020 wait complete. 2023-11-28T19:59:20.765 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi078.front.sepia.ceph.com... 2023-11-28T19:59:20.766 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T19:59:20.766 DEBUG:teuthology.orchestra.run.smithi078:> sudo fusermount -u /home/ubuntu/cephtest/mnt.admin 2023-11-28T19:59:20.796 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi078.stderr:ceph-fuse[42918]: fuse finished with error 0 and tester_r 0 2023-11-28T19:59:20.799 INFO:teuthology.orchestra.run:waiting for 300 2023-11-28T19:59:20.864 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi078.front.sepia.ceph.com 2023-11-28T19:59:20.864 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T19:59:20.864 DEBUG:teuthology.orchestra.run.smithi078:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.admin) 2023-11-28T19:59:20.882 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-28T19:59:21.065 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:21.059+0000 7f6ffdb65640 1 Processor -- start 2023-11-28T19:59:21.066 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:21.059+0000 7f6ffdb65640 1 -- start start 2023-11-28T19:59:21.071 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:21.059+0000 7f6ffdb65640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6ff814e3f0 0x7f6ff80bfce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:21.071 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:21.059+0000 7f6ffdb65640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f6ff806bef0 0x7f6ff80c41f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:21.071 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:21.059+0000 7f6ffdb65640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f6ff80c4730 0x7f6ff806c5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:21.071 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:21.059+0000 7f6ffdb65640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6ff8151690 con 0x7f6ff806bef0 2023-11-28T19:59:21.071 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:21.059+0000 7f6ffdb65640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6ff8151bc0 con 0x7f6ff80c4730 2023-11-28T19:59:21.071 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:21.059+0000 7f6ffdb65640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ff81518e0 con 0x7f6ff814e3f0 2023-11-28T19:59:21.071 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:21.063+0000 7f6ff6ffd640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f6ff806bef0 0x7f6ff80c41f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:21.072 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:21.063+0000 7f6ff6ffd640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f6ff806bef0 0x7f6ff80c41f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:60500/0 (socket says 172.21.15.78:60500) 2023-11-28T19:59:21.072 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:21.063+0000 7f6ff6ffd640 1 -- 172.21.15.78:0/3728941992 learned_addr learned my addr 172.21.15.78:0/3728941992 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T19:59:21.072 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:21.063+0000 7f6ff7fff640 1 --2- 172.21.15.78:0/3728941992 >> v2:172.21.15.179:3300/0 conn(0x7f6ff80c4730 0x7f6ff806c5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:21.072 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:21.063+0000 7f6ff77fe640 1 --2- 172.21.15.78:0/3728941992 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6ff814e3f0 0x7f6ff80bfce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:21.072 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:21.063+0000 7f6ff6ffd640 1 -- 172.21.15.78:0/3728941992 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6ff814e3f0 msgr2=0x7f6ff80bfce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T19:59:21.072 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:21.063+0000 7f6ff6ffd640 1 --2- 172.21.15.78:0/3728941992 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6ff814e3f0 0x7f6ff80bfce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:21.072 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:21.063+0000 7f6ff6ffd640 1 -- 172.21.15.78:0/3728941992 >> v2:172.21.15.179:3300/0 conn(0x7f6ff80c4730 msgr2=0x7f6ff806c5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T19:59:21.073 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:21.063+0000 7f6ff6ffd640 1 --2- 172.21.15.78:0/3728941992 >> v2:172.21.15.179:3300/0 conn(0x7f6ff80c4730 0x7f6ff806c5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:21.073 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:21.063+0000 7f6ff6ffd640 1 -- 172.21.15.78:0/3728941992 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ff80c1de0 con 0x7f6ff806bef0 2023-11-28T19:59:21.073 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:21.063+0000 7f6ff77fe640 1 --2- 172.21.15.78:0/3728941992 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6ff814e3f0 0x7f6ff80bfce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T19:59:21.073 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:21.063+0000 7f6ff7fff640 1 --2- 172.21.15.78:0/3728941992 >> v2:172.21.15.179:3300/0 conn(0x7f6ff80c4730 0x7f6ff806c5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T19:59:21.073 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:21.063+0000 7f6ff6ffd640 1 --2- 172.21.15.78:0/3728941992 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6ff806bef0 0x7f6ff80c41f0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f6ff80a5750 tx=0x7f6fec01c440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=569532b7e0163099 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:59:21.073 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:21.063+0000 7f6ff67fc640 1 -- 172.21.15.78:0/3728941992 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fec0ac640 con 0x7f6ff806bef0 2023-11-28T19:59:21.073 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:21.063+0000 7f6ff67fc640 1 -- 172.21.15.78:0/3728941992 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6fec0ac7a0 con 0x7f6ff806bef0 2023-11-28T19:59:21.074 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:21.063+0000 7f6ff67fc640 1 -- 172.21.15.78:0/3728941992 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fec0acb30 con 0x7f6ff806bef0 2023-11-28T19:59:21.078 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:21.067+0000 7f6ffdb65640 1 -- 172.21.15.78:0/3728941992 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6ff806bef0 msgr2=0x7f6ff80c41f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:21.078 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:21.067+0000 7f6ffdb65640 1 --2- 172.21.15.78:0/3728941992 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6ff806bef0 0x7f6ff80c41f0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f6ff80a5750 tx=0x7f6fec01c440 comp rx=0 tx=0).stop 2023-11-28T19:59:21.078 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:21.067+0000 7f6ffdb65640 1 -- 172.21.15.78:0/3728941992 shutdown_connections 2023-11-28T19:59:21.078 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:21.067+0000 7f6ffdb65640 1 --2- 172.21.15.78:0/3728941992 >> v2:172.21.15.179:3300/0 conn(0x7f6ff80c4730 0x7f6ff806c5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:21.078 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:21.067+0000 7f6ffdb65640 1 --2- 172.21.15.78:0/3728941992 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6ff806bef0 0x7f6ff80c41f0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:21.078 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:21.067+0000 7f6ffdb65640 1 --2- 172.21.15.78:0/3728941992 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6ff814e3f0 0x7f6ff80bfce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:21.078 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:21.067+0000 7f6ffdb65640 1 -- 172.21.15.78:0/3728941992 >> 172.21.15.78:0/3728941992 conn(0x7f6ff80a7810 msgr2=0x7f6ff80a7c20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T19:59:21.079 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:21.067+0000 7f6ffdb65640 1 -- 172.21.15.78:0/3728941992 shutdown_connections 2023-11-28T19:59:21.079 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:21.067+0000 7f6ffdb65640 1 -- 172.21.15.78:0/3728941992 wait complete. 2023-11-28T19:59:21.079 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:21.067+0000 7f6ffdb65640 1 Processor -- start 2023-11-28T19:59:21.079 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:21.067+0000 7f6ffdb65640 1 -- start start 2023-11-28T19:59:21.079 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:21.067+0000 7f6ffdb65640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6ff806bef0 0x7f6ff80bf0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:21.079 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:21.067+0000 7f6ffdb65640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6ff80c4730 0x7f6ff80a5a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:21.079 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:21.067+0000 7f6ffdb65640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6ff814e3f0 0x7f6ff8147800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:21.080 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:21.067+0000 7f6ffdb65640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ff81486e0 con 0x7f6ff814e3f0 2023-11-28T19:59:21.080 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:21.067+0000 7f6ffdb65640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ff80a6800 con 0x7f6ff80c4730 2023-11-28T19:59:21.080 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:21.067+0000 7f6ffdb65640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ff80a6a50 con 0x7f6ff806bef0 2023-11-28T19:59:21.080 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:21.067+0000 7f6ff7fff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6ff814e3f0 0x7f6ff8147800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:21.080 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:21.067+0000 7f6ff7fff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6ff814e3f0 0x7f6ff8147800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:60508/0 (socket says 172.21.15.78:60508) 2023-11-28T19:59:21.080 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:21.067+0000 7f6ff7fff640 1 -- 172.21.15.78:0/573177214 learned_addr learned my addr 172.21.15.78:0/573177214 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T19:59:21.081 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:21.067+0000 7f6ff77fe640 1 --2- 172.21.15.78:0/573177214 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6ff806bef0 0x7f6ff80bf0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:21.081 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:21.067+0000 7f6ff6ffd640 1 --2- 172.21.15.78:0/573177214 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6ff80c4730 0x7f6ff80a5a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:21.081 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:21.071+0000 7f6ff7fff640 1 -- 172.21.15.78:0/573177214 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6ff806bef0 msgr2=0x7f6ff80bf0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:21.081 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:21.071+0000 7f6ff7fff640 1 --2- 172.21.15.78:0/573177214 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6ff806bef0 0x7f6ff80bf0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:21.081 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:21.071+0000 7f6ff7fff640 1 -- 172.21.15.78:0/573177214 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6ff80c4730 msgr2=0x7f6ff80a5a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:21.081 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:21.071+0000 7f6ff7fff640 1 --2- 172.21.15.78:0/573177214 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6ff80c4730 0x7f6ff80a5a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:21.082 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:21.071+0000 7f6ff7fff640 1 -- 172.21.15.78:0/573177214 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6fec0094d0 con 0x7f6ff814e3f0 2023-11-28T19:59:21.082 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:21.071+0000 7f6ff7fff640 1 --2- 172.21.15.78:0/573177214 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6ff814e3f0 0x7f6ff8147800 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f6ff000ce40 tx=0x7f6ff000a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:59:21.082 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:21.071+0000 7f6fdffff640 1 -- 172.21.15.78:0/573177214 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ff000d840 con 0x7f6ff814e3f0 2023-11-28T19:59:21.082 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:21.071+0000 7f6fdffff640 1 -- 172.21.15.78:0/573177214 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ff000d9a0 con 0x7f6ff814e3f0 2023-11-28T19:59:21.082 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:21.071+0000 7f6ffdb65640 1 -- 172.21.15.78:0/573177214 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6ff80a6d30 con 0x7f6ff814e3f0 2023-11-28T19:59:21.082 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:21.071+0000 7f6fdffff640 1 -- 172.21.15.78:0/573177214 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ff000dd50 con 0x7f6ff814e3f0 2023-11-28T19:59:21.082 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:21.071+0000 7f6ffdb65640 1 -- 172.21.15.78:0/573177214 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6ff80a72f0 con 0x7f6ff814e3f0 2023-11-28T19:59:21.083 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:21.071+0000 7f6ffdb65640 1 -- 172.21.15.78:0/573177214 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6ff8067630 con 0x7f6ff814e3f0 2023-11-28T19:59:21.083 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:21.071+0000 7f6fdffff640 1 -- 172.21.15.78:0/573177214 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f6ff001e3b0 con 0x7f6ff814e3f0 2023-11-28T19:59:21.084 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:21.071+0000 7f6fdffff640 1 --2- 172.21.15.78:0/573177214 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f6fe40664a0 0x7f6fe4068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:21.084 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:21.075+0000 7f6fdffff640 1 -- 172.21.15.78:0/573177214 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f6ff0084b80 con 0x7f6ff814e3f0 2023-11-28T19:59:21.084 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:21.075+0000 7f6ff77fe640 1 --2- 172.21.15.78:0/573177214 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f6fe40664a0 0x7f6fe4068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:21.084 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:21.075+0000 7f6ff77fe640 1 --2- 172.21.15.78:0/573177214 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f6fe40664a0 0x7f6fe4068960 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f6fe8006fd0 tx=0x7f6fe8008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:59:21.085 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:21.079+0000 7f6fdffff640 1 -- 172.21.15.78:0/573177214 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f6ff0051c80 con 0x7f6ff814e3f0 2023-11-28T19:59:21.234 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:21.227+0000 7f6ffdb65640 1 -- 172.21.15.78:0/573177214 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f6ff80bfcf0 con 0x7f6ff814e3f0 2023-11-28T19:59:21.235 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:21.231+0000 7f6fdffff640 1 -- 172.21.15.78:0/573177214 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+18322 (secure 0 0 0) 0x7f6ff001a070 con 0x7f6ff814e3f0 2023-11-28T19:59:21.235 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-11-28T19:59:21.236 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":25,"fsid":"dd9780e8-3bda-44fa-a9f0-fa07d19d901d","created":"2023-11-28T19:58:40.969556+0000","modified":"2023-11-28T19:59:10.474525+0000","last_up_change":"2023-11-28T19:58:52.596716+0000","last_in_change":"2023-11-28T19:58:43.609275+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-28T19:58:54.011229+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-28T19:59:03.945559+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-28T19:59:04.481478+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-11-28T19:59:08.109152+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"e84245ac-b5da-429e-af18-39acaa2b33e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6800","nonce":3358701235},{"type":"v1","addr":"172.21.15.78:6801","nonce":3358701235}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6802","nonce":3358701235},{"type":"v1","addr":"172.21.15.78:6803","nonce":3358701235}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6806","nonce":3358701235},{"type":"v1","addr":"172.21.15.78:6807","nonce":3358701235}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6804","nonce":3358701235},{"type":"v1","addr":"172.21.15.78:6805","nonce":3358701235}]},"public_addr":"172.21.15.78:6801/3358701235","cluster_addr":"172.21.15.78:6803/3358701235","heartbeat_back_addr":"172.21.15.78:6807/3358701235","heartbeat_front_addr":"172.21.15.78:6805/3358701235","state":["exists","up"]},{"osd":1,"uuid":"e634831d-c4e2-48d9-870c-9556ae162981","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6808","nonce":3211476654},{"type":"v1","addr":"172.21.15.78:6809","nonce":3211476654}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6810","nonce":3211476654},{"type":"v1","addr":"172.21.15.78:6811","nonce":3211476654}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6814","nonce":3211476654},{"type":"v1","addr":"172.21.15.78:6815","nonce":3211476654}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6812","nonce":3211476654},{"type":"v1","addr":"172.21.15.78:6813","nonce":3211476654}]},"public_addr":"172.21.15.78:6809/3211476654","cluster_addr":"172.21.15.78:6811/3211476654","heartbeat_back_addr":"172.21.15.78:6815/3211476654","heartbeat_front_addr":"172.21.15.78:6813/3211476654","state":["exists","up"]},{"osd":2,"uuid":"274c8395-6534-41f0-b8fb-a00af8985aa8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6816","nonce":2532904479},{"type":"v1","addr":"172.21.15.78:6817","nonce":2532904479}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6818","nonce":2532904479},{"type":"v1","addr":"172.21.15.78:6819","nonce":2532904479}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6822","nonce":2532904479},{"type":"v1","addr":"172.21.15.78:6823","nonce":2532904479}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6820","nonce":2532904479},{"type":"v1","addr":"172.21.15.78:6821","nonce":2532904479}]},"public_addr":"172.21.15.78:6817/2532904479","cluster_addr":"172.21.15.78:6819/2532904479","heartbeat_back_addr":"172.21.15.78:6823/2532904479","heartbeat_front_addr":"172.21.15.78:6821/2532904479","state":["exists","up"]},{"osd":3,"uuid":"77acc9af-7d4d-4b18-8cf5-d62f5971b7c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6824","nonce":3442991267},{"type":"v1","addr":"172.21.15.78:6825","nonce":3442991267}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6826","nonce":3442991267},{"type":"v1","addr":"172.21.15.78:6827","nonce":3442991267}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6830","nonce":3442991267},{"type":"v1","addr":"172.21.15.78:6831","nonce":3442991267}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6828","nonce":3442991267},{"type":"v1","addr":"172.21.15.78:6829","nonce":3442991267}]},"public_addr":"172.21.15.78:6825/3442991267","cluster_addr":"172.21.15.78:6827/3442991267","heartbeat_back_addr":"172.21.15.78:6831/3442991267","heartbeat_front_addr":"172.21.15.78:6829/3442991267","state":["exists","up"]},{"osd":4,"uuid":"5c62bc66-6b34-4b7f-a66b-9a743969138c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":802983577},{"type":"v1","addr":"172.21.15.179:6809","nonce":802983577}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":802983577},{"type":"v1","addr":"172.21.15.179:6811","nonce":802983577}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":802983577},{"type":"v1","addr":"172.21.15.179:6815","nonce":802983577}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":802983577},{"type":"v1","addr":"172.21.15.179:6813","nonce":802983577}]},"public_addr":"172.21.15.179:6809/802983577","cluster_addr":"172.21.15.179:6811/802983577","heartbeat_back_addr":"172.21.15.179:6815/802983577","heartbeat_front_addr":"172.21.15.179:6813/802983577","state":["exists","up"]},{"osd":5,"uuid":"67db6d36-f684-4079-b0cd-82b4dd61461f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":518192887},{"type":"v1","addr":"172.21.15.179:6818","nonce":518192887}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":518192887},{"type":"v1","addr":"172.21.15.179:6822","nonce":518192887}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":518192887},{"type":"v1","addr":"172.21.15.179:6829","nonce":518192887}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6824","nonce":518192887},{"type":"v1","addr":"172.21.15.179:6826","nonce":518192887}]},"public_addr":"172.21.15.179:6818/518192887","cluster_addr":"172.21.15.179:6822/518192887","heartbeat_back_addr":"172.21.15.179:6829/518192887","heartbeat_front_addr":"172.21.15.179:6826/518192887","state":["exists","up"]},{"osd":6,"uuid":"12e670af-5a16-4c81-9f97-defa66cab967","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":815435378},{"type":"v1","addr":"172.21.15.179:6801","nonce":815435378}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":815435378},{"type":"v1","addr":"172.21.15.179:6803","nonce":815435378}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":815435378},{"type":"v1","addr":"172.21.15.179:6807","nonce":815435378}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":815435378},{"type":"v1","addr":"172.21.15.179:6805","nonce":815435378}]},"public_addr":"172.21.15.179:6801/815435378","cluster_addr":"172.21.15.179:6803/815435378","heartbeat_back_addr":"172.21.15.179:6807/815435378","heartbeat_front_addr":"172.21.15.179:6805/815435378","state":["exists","up"]},{"osd":7,"uuid":"fe630650-2eb3-49ad-8676-c341e6332eb1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6817","nonce":2848432339},{"type":"v1","addr":"172.21.15.179:6819","nonce":2848432339}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6821","nonce":2848432339},{"type":"v1","addr":"172.21.15.179:6823","nonce":2848432339}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":2848432339},{"type":"v1","addr":"172.21.15.179:6831","nonce":2848432339}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6825","nonce":2848432339},{"type":"v1","addr":"172.21.15.179:6827","nonce":2848432339}]},"public_addr":"172.21.15.179:6819/2848432339","cluster_addr":"172.21.15.179:6823/2848432339","heartbeat_back_addr":"172.21.15.179:6831/2848432339","heartbeat_front_addr":"172.21.15.179:6827/2848432339","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:58:49.255433+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:58:49.412880+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:58:49.559295+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:58:49.245237+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:58:49.184557+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:58:49.329851+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:58:49.366012+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:58:49.349604+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-28T19:59:21.237 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:21.231+0000 7f6ffdb65640 1 -- 172.21.15.78:0/573177214 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f6fe40664a0 msgr2=0x7f6fe4068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:21.237 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:21.231+0000 7f6ffdb65640 1 --2- 172.21.15.78:0/573177214 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f6fe40664a0 0x7f6fe4068960 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f6fe8006fd0 tx=0x7f6fe8008040 comp rx=0 tx=0).stop 2023-11-28T19:59:21.238 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:21.231+0000 7f6ffdb65640 1 -- 172.21.15.78:0/573177214 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6ff814e3f0 msgr2=0x7f6ff8147800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:21.238 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:21.231+0000 7f6ffdb65640 1 --2- 172.21.15.78:0/573177214 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6ff814e3f0 0x7f6ff8147800 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f6ff000ce40 tx=0x7f6ff000a710 comp rx=0 tx=0).stop 2023-11-28T19:59:21.238 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:21.231+0000 7f6ffdb65640 1 -- 172.21.15.78:0/573177214 shutdown_connections 2023-11-28T19:59:21.238 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:21.231+0000 7f6ffdb65640 1 --2- 172.21.15.78:0/573177214 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f6fe40664a0 0x7f6fe4068960 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:21.238 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:21.231+0000 7f6ffdb65640 1 --2- 172.21.15.78:0/573177214 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6ff814e3f0 0x7f6ff8147800 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:21.238 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:21.231+0000 7f6ffdb65640 1 --2- 172.21.15.78:0/573177214 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6ff80c4730 0x7f6ff80a5a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:21.238 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:21.231+0000 7f6ffdb65640 1 --2- 172.21.15.78:0/573177214 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6ff806bef0 0x7f6ff80bf0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:21.238 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:21.231+0000 7f6ffdb65640 1 -- 172.21.15.78:0/573177214 >> 172.21.15.78:0/573177214 conn(0x7f6ff80a7810 msgr2=0x7f6ff80a7bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T19:59:21.238 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:21.231+0000 7f6ffdb65640 1 -- 172.21.15.78:0/573177214 shutdown_connections 2023-11-28T19:59:21.238 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:21.231+0000 7f6ffdb65640 1 -- 172.21.15.78:0/573177214 wait complete. 2023-11-28T19:59:21.257 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-28T19:59:21.394 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:21.387+0000 7f697f1d1640 1 Processor -- start 2023-11-28T19:59:21.394 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:21.387+0000 7f697f1d1640 1 -- start start 2023-11-28T19:59:21.395 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:21.391+0000 7f697f1d1640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f6978151be0 0x7f69780c0cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:21.396 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:21.391+0000 7f697f1d1640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6978155220 0x7f697806d220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:21.396 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:21.391+0000 7f697f1d1640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f69780ab540 0x7f697806d760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:21.396 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:21.391+0000 7f697f1d1640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f69780ab1f0 con 0x7f69780ab540 2023-11-28T19:59:21.396 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:21.391+0000 7f697f1d1640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6978154530 con 0x7f6978151be0 2023-11-28T19:59:21.396 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:21.391+0000 7f697f1d1640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f697806a6e0 con 0x7f6978155220 2023-11-28T19:59:21.396 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:21.391+0000 7f697d76e640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f69780ab540 0x7f697806d760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:21.396 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:21.391+0000 7f697d76e640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f69780ab540 0x7f697806d760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:60518/0 (socket says 172.21.15.78:60518) 2023-11-28T19:59:21.396 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:21.391+0000 7f697d76e640 1 -- 172.21.15.78:0/3265752600 learned_addr learned my addr 172.21.15.78:0/3265752600 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T19:59:21.396 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:21.391+0000 7f696ffff640 1 --2- 172.21.15.78:0/3265752600 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6978155220 0x7f697806d220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:21.396 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:21.391+0000 7f697cf6d640 1 --2- 172.21.15.78:0/3265752600 >> v2:172.21.15.179:3300/0 conn(0x7f6978151be0 0x7f69780c0cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:21.397 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:21.391+0000 7f697d76e640 1 -- 172.21.15.78:0/3265752600 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6978155220 msgr2=0x7f697806d220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T19:59:21.397 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:21.391+0000 7f697d76e640 1 --2- 172.21.15.78:0/3265752600 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6978155220 0x7f697806d220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:21.397 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:21.391+0000 7f697d76e640 1 -- 172.21.15.78:0/3265752600 >> v2:172.21.15.179:3300/0 conn(0x7f6978151be0 msgr2=0x7f69780c0cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T19:59:21.397 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:21.391+0000 7f697d76e640 1 --2- 172.21.15.78:0/3265752600 >> v2:172.21.15.179:3300/0 conn(0x7f6978151be0 0x7f69780c0cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:21.397 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:21.391+0000 7f697d76e640 1 -- 172.21.15.78:0/3265752600 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6978154740 con 0x7f69780ab540 2023-11-28T19:59:21.397 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:21.391+0000 7f697cf6d640 1 --2- 172.21.15.78:0/3265752600 >> v2:172.21.15.179:3300/0 conn(0x7f6978151be0 0x7f69780c0cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T19:59:21.398 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:21.391+0000 7f697d76e640 1 --2- 172.21.15.78:0/3265752600 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f69780ab540 0x7f697806d760 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f697806c1f0 tx=0x7f697001c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3abe82a8f7eeff68 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:59:21.399 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:21.395+0000 7f696f7fe640 1 -- 172.21.15.78:0/3265752600 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69700a5790 con 0x7f69780ab540 2023-11-28T19:59:21.399 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:21.395+0000 7f696f7fe640 1 -- 172.21.15.78:0/3265752600 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f69700a58f0 con 0x7f69780ab540 2023-11-28T19:59:21.399 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:21.395+0000 7f696f7fe640 1 -- 172.21.15.78:0/3265752600 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69700a5c80 con 0x7f69780ab540 2023-11-28T19:59:21.400 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:21.395+0000 7f697f1d1640 1 -- 172.21.15.78:0/3265752600 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f69780ab540 msgr2=0x7f697806d760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:21.400 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:21.395+0000 7f697f1d1640 1 --2- 172.21.15.78:0/3265752600 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f69780ab540 0x7f697806d760 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f697806c1f0 tx=0x7f697001c910 comp rx=0 tx=0).stop 2023-11-28T19:59:21.400 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:21.395+0000 7f697f1d1640 1 -- 172.21.15.78:0/3265752600 shutdown_connections 2023-11-28T19:59:21.400 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:21.395+0000 7f697f1d1640 1 --2- 172.21.15.78:0/3265752600 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f69780ab540 0x7f697806d760 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:21.400 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:21.395+0000 7f697f1d1640 1 --2- 172.21.15.78:0/3265752600 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6978155220 0x7f697806d220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:21.400 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:21.395+0000 7f697f1d1640 1 --2- 172.21.15.78:0/3265752600 >> v2:172.21.15.179:3300/0 conn(0x7f6978151be0 0x7f69780c0cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:21.400 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:21.395+0000 7f697f1d1640 1 -- 172.21.15.78:0/3265752600 >> 172.21.15.78:0/3265752600 conn(0x7f69780c62b0 msgr2=0x7f69780c66c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T19:59:21.400 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:21.395+0000 7f697f1d1640 1 -- 172.21.15.78:0/3265752600 shutdown_connections 2023-11-28T19:59:21.401 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:21.395+0000 7f697f1d1640 1 -- 172.21.15.78:0/3265752600 wait complete. 2023-11-28T19:59:21.401 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:21.395+0000 7f697f1d1640 1 Processor -- start 2023-11-28T19:59:21.401 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:21.395+0000 7f697f1d1640 1 -- start start 2023-11-28T19:59:21.404 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:21.395+0000 7f697f1d1640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f69780ab540 0x7f6978142660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:21.404 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:21.395+0000 7f697f1d1640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6978151be0 0x7f6978145b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:21.404 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:21.395+0000 7f697f1d1640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6978155220 0x7f69780c5300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:21.404 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:21.395+0000 7f697f1d1640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6978147800 con 0x7f69780ab540 2023-11-28T19:59:21.404 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:21.395+0000 7f697f1d1640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69780712b0 con 0x7f6978155220 2023-11-28T19:59:21.404 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:21.395+0000 7f697f1d1640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f697814a9e0 con 0x7f6978151be0 2023-11-28T19:59:21.405 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:21.395+0000 7f697cf6d640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f69780ab540 0x7f6978142660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:21.405 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:21.395+0000 7f697cf6d640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f69780ab540 0x7f6978142660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:60526/0 (socket says 172.21.15.78:60526) 2023-11-28T19:59:21.405 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:21.395+0000 7f697cf6d640 1 -- 172.21.15.78:0/521903422 learned_addr learned my addr 172.21.15.78:0/521903422 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T19:59:21.405 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:21.395+0000 7f696ffff640 1 --2- 172.21.15.78:0/521903422 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6978151be0 0x7f6978145b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:21.405 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:21.399+0000 7f697d76e640 1 --2- 172.21.15.78:0/521903422 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6978155220 0x7f69780c5300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:21.405 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:21.399+0000 7f697cf6d640 1 -- 172.21.15.78:0/521903422 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6978151be0 msgr2=0x7f6978145b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:21.405 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:21.399+0000 7f697cf6d640 1 --2- 172.21.15.78:0/521903422 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6978151be0 0x7f6978145b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:21.405 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:21.399+0000 7f697cf6d640 1 -- 172.21.15.78:0/521903422 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6978155220 msgr2=0x7f69780c5300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:21.405 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:21.399+0000 7f697cf6d640 1 --2- 172.21.15.78:0/521903422 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6978155220 0x7f69780c5300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:21.405 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:21.399+0000 7f697cf6d640 1 -- 172.21.15.78:0/521903422 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6970009b30 con 0x7f69780ab540 2023-11-28T19:59:21.405 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:21.399+0000 7f696ffff640 1 --2- 172.21.15.78:0/521903422 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6978151be0 0x7f6978145b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T19:59:21.406 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:21.399+0000 7f697d76e640 1 --2- 172.21.15.78:0/521903422 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6978155220 0x7f69780c5300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T19:59:21.406 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:21.399+0000 7f697cf6d640 1 --2- 172.21.15.78:0/521903422 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f69780ab540 0x7f6978142660 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f697400e810 tx=0x7f697400ecd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:59:21.406 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:21.399+0000 7f696d7fa640 1 -- 172.21.15.78:0/521903422 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6974004030 con 0x7f69780ab540 2023-11-28T19:59:21.406 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:21.399+0000 7f696d7fa640 1 -- 172.21.15.78:0/521903422 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6974004190 con 0x7f69780ab540 2023-11-28T19:59:21.406 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:21.399+0000 7f697f1d1640 1 -- 172.21.15.78:0/521903422 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f69780709c0 con 0x7f69780ab540 2023-11-28T19:59:21.406 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:21.399+0000 7f696d7fa640 1 -- 172.21.15.78:0/521903422 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6974004520 con 0x7f69780ab540 2023-11-28T19:59:21.406 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:21.399+0000 7f697f1d1640 1 -- 172.21.15.78:0/521903422 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6978070c60 con 0x7f69780ab540 2023-11-28T19:59:21.406 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:21.399+0000 7f697f1d1640 1 -- 172.21.15.78:0/521903422 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f69780674b0 con 0x7f69780ab540 2023-11-28T19:59:21.407 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:21.399+0000 7f696d7fa640 1 -- 172.21.15.78:0/521903422 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f697400c670 con 0x7f69780ab540 2023-11-28T19:59:21.407 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:21.399+0000 7f696d7fa640 1 --2- 172.21.15.78:0/521903422 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f6964066470 0x7f6964068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:21.407 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:21.399+0000 7f696d7fa640 1 -- 172.21.15.78:0/521903422 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f6974083d00 con 0x7f69780ab540 2023-11-28T19:59:21.407 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:21.399+0000 7f696ffff640 1 --2- 172.21.15.78:0/521903422 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f6964066470 0x7f6964068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:21.407 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:21.403+0000 7f696ffff640 1 --2- 172.21.15.78:0/521903422 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f6964066470 0x7f6964068930 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f69781eb0c0 tx=0x7f6968008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:59:21.410 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:21.403+0000 7f696d7fa640 1 -- 172.21.15.78:0/521903422 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f6974050e80 con 0x7f69780ab540 2023-11-28T19:59:21.560 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:21.555+0000 7f697f1d1640 1 -- 172.21.15.78:0/521903422 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f6978066880 con 0x7f69780ab540 2023-11-28T19:59:21.561 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:21.555+0000 7f696d7fa640 1 -- 172.21.15.78:0/521903422 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+18322 (secure 0 0 0) 0x7f69740544a0 con 0x7f69780ab540 2023-11-28T19:59:21.561 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-11-28T19:59:21.562 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":25,"fsid":"dd9780e8-3bda-44fa-a9f0-fa07d19d901d","created":"2023-11-28T19:58:40.969556+0000","modified":"2023-11-28T19:59:10.474525+0000","last_up_change":"2023-11-28T19:58:52.596716+0000","last_in_change":"2023-11-28T19:58:43.609275+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-28T19:58:54.011229+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-28T19:59:03.945559+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-28T19:59:04.481478+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-11-28T19:59:08.109152+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"e84245ac-b5da-429e-af18-39acaa2b33e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6800","nonce":3358701235},{"type":"v1","addr":"172.21.15.78:6801","nonce":3358701235}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6802","nonce":3358701235},{"type":"v1","addr":"172.21.15.78:6803","nonce":3358701235}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6806","nonce":3358701235},{"type":"v1","addr":"172.21.15.78:6807","nonce":3358701235}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6804","nonce":3358701235},{"type":"v1","addr":"172.21.15.78:6805","nonce":3358701235}]},"public_addr":"172.21.15.78:6801/3358701235","cluster_addr":"172.21.15.78:6803/3358701235","heartbeat_back_addr":"172.21.15.78:6807/3358701235","heartbeat_front_addr":"172.21.15.78:6805/3358701235","state":["exists","up"]},{"osd":1,"uuid":"e634831d-c4e2-48d9-870c-9556ae162981","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6808","nonce":3211476654},{"type":"v1","addr":"172.21.15.78:6809","nonce":3211476654}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6810","nonce":3211476654},{"type":"v1","addr":"172.21.15.78:6811","nonce":3211476654}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6814","nonce":3211476654},{"type":"v1","addr":"172.21.15.78:6815","nonce":3211476654}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6812","nonce":3211476654},{"type":"v1","addr":"172.21.15.78:6813","nonce":3211476654}]},"public_addr":"172.21.15.78:6809/3211476654","cluster_addr":"172.21.15.78:6811/3211476654","heartbeat_back_addr":"172.21.15.78:6815/3211476654","heartbeat_front_addr":"172.21.15.78:6813/3211476654","state":["exists","up"]},{"osd":2,"uuid":"274c8395-6534-41f0-b8fb-a00af8985aa8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6816","nonce":2532904479},{"type":"v1","addr":"172.21.15.78:6817","nonce":2532904479}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6818","nonce":2532904479},{"type":"v1","addr":"172.21.15.78:6819","nonce":2532904479}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6822","nonce":2532904479},{"type":"v1","addr":"172.21.15.78:6823","nonce":2532904479}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6820","nonce":2532904479},{"type":"v1","addr":"172.21.15.78:6821","nonce":2532904479}]},"public_addr":"172.21.15.78:6817/2532904479","cluster_addr":"172.21.15.78:6819/2532904479","heartbeat_back_addr":"172.21.15.78:6823/2532904479","heartbeat_front_addr":"172.21.15.78:6821/2532904479","state":["exists","up"]},{"osd":3,"uuid":"77acc9af-7d4d-4b18-8cf5-d62f5971b7c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6824","nonce":3442991267},{"type":"v1","addr":"172.21.15.78:6825","nonce":3442991267}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6826","nonce":3442991267},{"type":"v1","addr":"172.21.15.78:6827","nonce":3442991267}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6830","nonce":3442991267},{"type":"v1","addr":"172.21.15.78:6831","nonce":3442991267}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6828","nonce":3442991267},{"type":"v1","addr":"172.21.15.78:6829","nonce":3442991267}]},"public_addr":"172.21.15.78:6825/3442991267","cluster_addr":"172.21.15.78:6827/3442991267","heartbeat_back_addr":"172.21.15.78:6831/3442991267","heartbeat_front_addr":"172.21.15.78:6829/3442991267","state":["exists","up"]},{"osd":4,"uuid":"5c62bc66-6b34-4b7f-a66b-9a743969138c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":802983577},{"type":"v1","addr":"172.21.15.179:6809","nonce":802983577}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":802983577},{"type":"v1","addr":"172.21.15.179:6811","nonce":802983577}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":802983577},{"type":"v1","addr":"172.21.15.179:6815","nonce":802983577}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":802983577},{"type":"v1","addr":"172.21.15.179:6813","nonce":802983577}]},"public_addr":"172.21.15.179:6809/802983577","cluster_addr":"172.21.15.179:6811/802983577","heartbeat_back_addr":"172.21.15.179:6815/802983577","heartbeat_front_addr":"172.21.15.179:6813/802983577","state":["exists","up"]},{"osd":5,"uuid":"67db6d36-f684-4079-b0cd-82b4dd61461f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":518192887},{"type":"v1","addr":"172.21.15.179:6818","nonce":518192887}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":518192887},{"type":"v1","addr":"172.21.15.179:6822","nonce":518192887}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":518192887},{"type":"v1","addr":"172.21.15.179:6829","nonce":518192887}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6824","nonce":518192887},{"type":"v1","addr":"172.21.15.179:6826","nonce":518192887}]},"public_addr":"172.21.15.179:6818/518192887","cluster_addr":"172.21.15.179:6822/518192887","heartbeat_back_addr":"172.21.15.179:6829/518192887","heartbeat_front_addr":"172.21.15.179:6826/518192887","state":["exists","up"]},{"osd":6,"uuid":"12e670af-5a16-4c81-9f97-defa66cab967","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":815435378},{"type":"v1","addr":"172.21.15.179:6801","nonce":815435378}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":815435378},{"type":"v1","addr":"172.21.15.179:6803","nonce":815435378}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":815435378},{"type":"v1","addr":"172.21.15.179:6807","nonce":815435378}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":815435378},{"type":"v1","addr":"172.21.15.179:6805","nonce":815435378}]},"public_addr":"172.21.15.179:6801/815435378","cluster_addr":"172.21.15.179:6803/815435378","heartbeat_back_addr":"172.21.15.179:6807/815435378","heartbeat_front_addr":"172.21.15.179:6805/815435378","state":["exists","up"]},{"osd":7,"uuid":"fe630650-2eb3-49ad-8676-c341e6332eb1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6817","nonce":2848432339},{"type":"v1","addr":"172.21.15.179:6819","nonce":2848432339}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6821","nonce":2848432339},{"type":"v1","addr":"172.21.15.179:6823","nonce":2848432339}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":2848432339},{"type":"v1","addr":"172.21.15.179:6831","nonce":2848432339}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6825","nonce":2848432339},{"type":"v1","addr":"172.21.15.179:6827","nonce":2848432339}]},"public_addr":"172.21.15.179:6819/2848432339","cluster_addr":"172.21.15.179:6823/2848432339","heartbeat_back_addr":"172.21.15.179:6831/2848432339","heartbeat_front_addr":"172.21.15.179:6827/2848432339","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:58:49.255433+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:58:49.412880+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:58:49.559295+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:58:49.245237+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:58:49.184557+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:58:49.329851+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:58:49.366012+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:58:49.349604+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-28T19:59:21.563 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:21.559+0000 7f697f1d1640 1 -- 172.21.15.78:0/521903422 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f6964066470 msgr2=0x7f6964068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:21.563 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:21.559+0000 7f697f1d1640 1 --2- 172.21.15.78:0/521903422 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f6964066470 0x7f6964068930 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f69781eb0c0 tx=0x7f6968008040 comp rx=0 tx=0).stop 2023-11-28T19:59:21.564 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:21.559+0000 7f697f1d1640 1 -- 172.21.15.78:0/521903422 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f69780ab540 msgr2=0x7f6978142660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:21.564 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:21.559+0000 7f697f1d1640 1 --2- 172.21.15.78:0/521903422 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f69780ab540 0x7f6978142660 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f697400e810 tx=0x7f697400ecd0 comp rx=0 tx=0).stop 2023-11-28T19:59:21.564 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:21.559+0000 7f697f1d1640 1 -- 172.21.15.78:0/521903422 shutdown_connections 2023-11-28T19:59:21.564 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:21.559+0000 7f697f1d1640 1 --2- 172.21.15.78:0/521903422 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f6964066470 0x7f6964068930 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:21.564 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:21.559+0000 7f697f1d1640 1 --2- 172.21.15.78:0/521903422 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6978151be0 0x7f6978145b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:21.564 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:21.559+0000 7f697f1d1640 1 --2- 172.21.15.78:0/521903422 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6978155220 0x7f69780c5300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:21.564 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:21.559+0000 7f697f1d1640 1 --2- 172.21.15.78:0/521903422 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f69780ab540 0x7f6978142660 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:21.564 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:21.559+0000 7f697f1d1640 1 -- 172.21.15.78:0/521903422 >> 172.21.15.78:0/521903422 conn(0x7f69780c62b0 msgr2=0x7f69780c09a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T19:59:21.564 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:21.559+0000 7f697f1d1640 1 -- 172.21.15.78:0/521903422 shutdown_connections 2023-11-28T19:59:21.564 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:21.559+0000 7f697f1d1640 1 -- 172.21.15.78:0/521903422 wait complete. 2023-11-28T19:59:21.583 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-11-28T19:59:21.723 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:21.719+0000 7f8ef9e5a640 1 Processor -- start 2023-11-28T19:59:21.723 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:21.719+0000 7f8ef9e5a640 1 -- start start 2023-11-28T19:59:21.725 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:21.719+0000 7f8ef9e5a640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f8ef414b1e0 0x7f8ef40c1700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:21.725 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:21.719+0000 7f8ef9e5a640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f8ef41548c0 0x7f8ef4154d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:21.725 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:21.719+0000 7f8ef9e5a640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8ef40a4e20 con 0x7f8ef40c5300 2023-11-28T19:59:21.725 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:21.719+0000 7f8ef9e5a640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8ef40a50e0 con 0x7f8ef414b1e0 2023-11-28T19:59:21.725 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:21.719+0000 7f8ef9e5a640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8ef40c0f00 con 0x7f8ef41548c0 2023-11-28T19:59:21.725 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:21.719+0000 7f8ef37fe640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f8ef414b1e0 0x7f8ef40c1700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:21.725 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:21.719+0000 7f8ef2ffd640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f8ef40c5300 0x7f8ef40a9c30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:35186/0 (socket says 172.21.15.78:35186) 2023-11-28T19:59:21.725 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:21.719+0000 7f8ef37fe640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f8ef414b1e0 0x7f8ef40c1700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:60530/0 (socket says 172.21.15.78:60530) 2023-11-28T19:59:21.726 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:21.719+0000 7f8ef2ffd640 1 -- 172.21.15.78:0/1732253963 learned_addr learned my addr 172.21.15.78:0/1732253963 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-11-28T19:59:21.726 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:21.719+0000 7f8ef3fff640 1 --2- 172.21.15.78:0/1732253963 >> v2:172.21.15.179:3300/0 conn(0x7f8ef41548c0 0x7f8ef4154d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:21.726 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:21.719+0000 7f8ef37fe640 1 -- 172.21.15.78:0/1732253963 >> v2:172.21.15.179:3300/0 conn(0x7f8ef41548c0 msgr2=0x7f8ef4154d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T19:59:21.726 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:21.719+0000 7f8ef37fe640 1 --2- 172.21.15.78:0/1732253963 >> v2:172.21.15.179:3300/0 conn(0x7f8ef41548c0 0x7f8ef4154d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:21.726 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:21.719+0000 7f8ef37fe640 1 -- 172.21.15.78:0/1732253963 >> v1:172.21.15.78:6789/0 conn(0x7f8ef40c5300 legacy=0x7f8ef40a9c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:21.726 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:21.719+0000 7f8ef37fe640 1 -- 172.21.15.78:0/1732253963 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ef40c11e0 con 0x7f8ef414b1e0 2023-11-28T19:59:21.727 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:21.723+0000 7f8ef37fe640 1 --2- 172.21.15.78:0/1732253963 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8ef414b1e0 0x7f8ef40c1700 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f8ef40c5850 tx=0x7f8ee401e670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fc47204cd21a922b server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:59:21.728 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:21.723+0000 7f8ef27fc640 1 -- 172.21.15.78:0/1732253963 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ee40ac5f0 con 0x7f8ef414b1e0 2023-11-28T19:59:21.728 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:21.723+0000 7f8ef27fc640 1 -- 172.21.15.78:0/1732253963 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ee40ac750 con 0x7f8ef414b1e0 2023-11-28T19:59:21.728 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:21.723+0000 7f8ef27fc640 1 -- 172.21.15.78:0/1732253963 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ee40acae0 con 0x7f8ef414b1e0 2023-11-28T19:59:21.729 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:21.723+0000 7f8ef9e5a640 1 -- 172.21.15.78:0/1732253963 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8ef414b1e0 msgr2=0x7f8ef40c1700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:21.729 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:21.723+0000 7f8ef9e5a640 1 --2- 172.21.15.78:0/1732253963 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8ef414b1e0 0x7f8ef40c1700 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f8ef40c5850 tx=0x7f8ee401e670 comp rx=0 tx=0).stop 2023-11-28T19:59:21.729 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:21.723+0000 7f8ef9e5a640 1 -- 172.21.15.78:0/1732253963 shutdown_connections 2023-11-28T19:59:21.729 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:21.723+0000 7f8ef9e5a640 1 --2- 172.21.15.78:0/1732253963 >> v2:172.21.15.179:3300/0 conn(0x7f8ef41548c0 0x7f8ef4154d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:21.729 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:21.723+0000 7f8ef9e5a640 1 --2- 172.21.15.78:0/1732253963 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8ef414b1e0 0x7f8ef40c1700 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:21.729 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:21.723+0000 7f8ef9e5a640 1 -- 172.21.15.78:0/1732253963 >> 172.21.15.78:0/1732253963 conn(0x7f8ef40c59f0 msgr2=0x7f8ef40c5e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T19:59:21.729 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:21.723+0000 7f8ef9e5a640 1 -- 172.21.15.78:0/1732253963 shutdown_connections 2023-11-28T19:59:21.729 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:21.723+0000 7f8ef9e5a640 1 -- 172.21.15.78:0/1732253963 wait complete. 2023-11-28T19:59:21.730 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:21.723+0000 7f8ef9e5a640 1 Processor -- start 2023-11-28T19:59:21.730 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:21.723+0000 7f8ef9e5a640 1 -- start start 2023-11-28T19:59:21.732 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:21.727+0000 7f8ef9e5a640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8ef40c5300 0x7f8ef41f05d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:21.732 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:21.727+0000 7f8ef9e5a640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8ef414b1e0 0x7f8ef41e41d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:21.732 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:21.727+0000 7f8ef9e5a640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8ef41548c0 0x7f8ef40a5840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:21.732 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:21.727+0000 7f8ef9e5a640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ef40a5420 con 0x7f8ef40c5300 2023-11-28T19:59:21.732 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:21.727+0000 7f8ef9e5a640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ef406c9d0 con 0x7f8ef41548c0 2023-11-28T19:59:21.732 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:21.727+0000 7f8ef9e5a640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ef40a6a50 con 0x7f8ef414b1e0 2023-11-28T19:59:21.732 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:21.727+0000 7f8ef37fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8ef40c5300 0x7f8ef41f05d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:21.732 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:21.727+0000 7f8ef37fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8ef40c5300 0x7f8ef41f05d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:60546/0 (socket says 172.21.15.78:60546) 2023-11-28T19:59:21.733 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:21.727+0000 7f8ef37fe640 1 -- 172.21.15.78:0/553543249 learned_addr learned my addr 172.21.15.78:0/553543249 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T19:59:21.733 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:21.727+0000 7f8ef3fff640 1 --2- 172.21.15.78:0/553543249 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8ef41548c0 0x7f8ef40a5840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:21.733 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:21.727+0000 7f8ef2ffd640 1 --2- 172.21.15.78:0/553543249 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8ef414b1e0 0x7f8ef41e41d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:21.733 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:21.727+0000 7f8ef37fe640 1 -- 172.21.15.78:0/553543249 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8ef414b1e0 msgr2=0x7f8ef41e41d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:21.733 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:21.727+0000 7f8ef37fe640 1 --2- 172.21.15.78:0/553543249 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8ef414b1e0 0x7f8ef41e41d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:21.733 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:21.727+0000 7f8ef37fe640 1 -- 172.21.15.78:0/553543249 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8ef41548c0 msgr2=0x7f8ef40a5840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:21.733 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:21.727+0000 7f8ef37fe640 1 --2- 172.21.15.78:0/553543249 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8ef41548c0 0x7f8ef40a5840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:21.733 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:21.727+0000 7f8ef37fe640 1 -- 172.21.15.78:0/553543249 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ee4009420 con 0x7f8ef40c5300 2023-11-28T19:59:21.734 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:21.727+0000 7f8ef37fe640 1 --2- 172.21.15.78:0/553543249 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8ef40c5300 0x7f8ef41f05d0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f8ee40ae040 tx=0x7f8ee401ceb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:59:21.735 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:21.727+0000 7f8edbfff640 1 -- 172.21.15.78:0/553543249 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ee40b5620 con 0x7f8ef40c5300 2023-11-28T19:59:21.735 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:21.727+0000 7f8edbfff640 1 -- 172.21.15.78:0/553543249 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ee40b57a0 con 0x7f8ef40c5300 2023-11-28T19:59:21.735 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:21.727+0000 7f8ef9e5a640 1 -- 172.21.15.78:0/553543249 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8ef406cc20 con 0x7f8ef40c5300 2023-11-28T19:59:21.735 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:21.727+0000 7f8edbfff640 1 -- 172.21.15.78:0/553543249 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ee40b5b50 con 0x7f8ef40c5300 2023-11-28T19:59:21.735 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:21.727+0000 7f8ef9e5a640 1 -- 172.21.15.78:0/553543249 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8ef40a6fa0 con 0x7f8ef40c5300 2023-11-28T19:59:21.735 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:21.727+0000 7f8ef9e5a640 1 -- 172.21.15.78:0/553543249 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8ef4067630 con 0x7f8ef40c5300 2023-11-28T19:59:21.735 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:21.731+0000 7f8edbfff640 1 -- 172.21.15.78:0/553543249 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f8ee40b5cb0 con 0x7f8ef40c5300 2023-11-28T19:59:21.736 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:21.731+0000 7f8edbfff640 1 --2- 172.21.15.78:0/553543249 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f8ee0066470 0x7f8ee0068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:21.736 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:21.731+0000 7f8edbfff640 1 -- 172.21.15.78:0/553543249 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f8ee40a9070 con 0x7f8ef40c5300 2023-11-28T19:59:21.736 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:21.731+0000 7f8ef2ffd640 1 --2- 172.21.15.78:0/553543249 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f8ee0066470 0x7f8ee0068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:21.736 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:21.731+0000 7f8ef2ffd640 1 --2- 172.21.15.78:0/553543249 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f8ee0066470 0x7f8ee0068930 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f8ef4071520 tx=0x7f8ee8009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:59:21.739 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:21.735+0000 7f8edbfff640 1 -- 172.21.15.78:0/553543249 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f8ee40ebd00 con 0x7f8ef40c5300 2023-11-28T19:59:21.926 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:21.919+0000 7f8ef9e5a640 1 -- 172.21.15.78:0/553543249 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f8ef40c0820 con 0x7f8ef40c5300 2023-11-28T19:59:22.782 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:22.775+0000 7f8edbfff640 1 -- 172.21.15.78:0/553543249 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v8) v1 ==== 118+0+0 (secure 0 0 0) 0x7f8ee40ef320 con 0x7f8ef40c5300 2023-11-28T19:59:22.784 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:22.779+0000 7f8ef9e5a640 1 -- 172.21.15.78:0/553543249 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f8ee0066470 msgr2=0x7f8ee0068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:22.784 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:22.779+0000 7f8ef9e5a640 1 --2- 172.21.15.78:0/553543249 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f8ee0066470 0x7f8ee0068930 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f8ef4071520 tx=0x7f8ee8009040 comp rx=0 tx=0).stop 2023-11-28T19:59:22.784 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:22.779+0000 7f8ef9e5a640 1 -- 172.21.15.78:0/553543249 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8ef40c5300 msgr2=0x7f8ef41f05d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:22.784 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:22.779+0000 7f8ef9e5a640 1 --2- 172.21.15.78:0/553543249 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8ef40c5300 0x7f8ef41f05d0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f8ee40ae040 tx=0x7f8ee401ceb0 comp rx=0 tx=0).stop 2023-11-28T19:59:22.785 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:22.779+0000 7f8ef9e5a640 1 -- 172.21.15.78:0/553543249 shutdown_connections 2023-11-28T19:59:22.785 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:22.779+0000 7f8ef9e5a640 1 --2- 172.21.15.78:0/553543249 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f8ee0066470 0x7f8ee0068930 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:22.785 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:22.779+0000 7f8ef9e5a640 1 --2- 172.21.15.78:0/553543249 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8ef414b1e0 0x7f8ef41e41d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:22.785 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:22.779+0000 7f8ef9e5a640 1 --2- 172.21.15.78:0/553543249 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8ef41548c0 0x7f8ef40a5840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:22.786 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:22.779+0000 7f8ef9e5a640 1 --2- 172.21.15.78:0/553543249 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8ef40c5300 0x7f8ef41f05d0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:22.786 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:22.779+0000 7f8ef9e5a640 1 -- 172.21.15.78:0/553543249 >> 172.21.15.78:0/553543249 conn(0x7f8ef40c59f0 msgr2=0x7f8ef40c6350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T19:59:22.786 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:22.779+0000 7f8ef9e5a640 1 -- 172.21.15.78:0/553543249 shutdown_connections 2023-11-28T19:59:22.786 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:22.779+0000 7f8ef9e5a640 1 -- 172.21.15.78:0/553543249 wait complete. 2023-11-28T19:59:22.808 DEBUG:tasks.cephfs.filesystem:fs_config: {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd']} 2023-11-28T19:59:22.808 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-11-28T19:59:22.951 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:22.947+0000 7f00c69f8640 1 Processor -- start 2023-11-28T19:59:22.951 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:22.947+0000 7f00c69f8640 1 -- start start 2023-11-28T19:59:22.952 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:22.947+0000 7f00c69f8640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f00c00c5300 0x7f00c00a9c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:22.953 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:22.947+0000 7f00c69f8640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f00c00a4e20 con 0x7f00c01548c0 2023-11-28T19:59:22.953 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:22.947+0000 7f00c69f8640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f00c00a50e0 con 0x7f00c014b1e0 2023-11-28T19:59:22.953 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:22.947+0000 7f00c69f8640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00c00c0f00 con 0x7f00c00c5300 2023-11-28T19:59:22.953 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:22.947+0000 7f00c4f95640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f00c01548c0 0x7f00c0154d50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:35188/0 (socket says 172.21.15.78:35188) 2023-11-28T19:59:22.953 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:22.947+0000 7f00c4f95640 1 -- 172.21.15.78:0/3399112043 learned_addr learned my addr 172.21.15.78:0/3399112043 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-11-28T19:59:22.955 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:22.947+0000 7f00bf7fe640 1 --2- 172.21.15.78:0/3399112043 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f00c00c5300 0x7f00c00a9c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:22.955 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:22.947+0000 7f00beffd640 1 -- 172.21.15.78:0/3399112043 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3535527548 0 0) 0x7f00c00a4e20 con 0x7f00c01548c0 2023-11-28T19:59:22.955 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:22.947+0000 7f00beffd640 1 -- 172.21.15.78:0/3399112043 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f00a8003530 con 0x7f00c01548c0 2023-11-28T19:59:22.955 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:22.947+0000 7f00beffd640 1 -- 172.21.15.78:0/3399112043 <== mon.0 v1:172.21.15.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3242023885 0 0) 0x7f00a8003530 con 0x7f00c01548c0 2023-11-28T19:59:22.955 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:22.947+0000 7f00beffd640 1 -- 172.21.15.78:0/3399112043 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f00c00c5300 msgr2=0x7f00c00a9c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T19:59:22.955 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:22.947+0000 7f00beffd640 1 --2- 172.21.15.78:0/3399112043 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f00c00c5300 0x7f00c00a9c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:22.955 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:22.947+0000 7f00beffd640 1 -- 172.21.15.78:0/3399112043 >> v1:172.21.15.179:6789/0 conn(0x7f00c014b1e0 legacy=0x7f00c00c1700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:22.955 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:22.947+0000 7f00beffd640 1 -- 172.21.15.78:0/3399112043 --> v1:172.21.15.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00c00c11e0 con 0x7f00c01548c0 2023-11-28T19:59:22.955 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:22.947+0000 7f00beffd640 1 -- 172.21.15.78:0/3399112043 <== mon.0 v1:172.21.15.78:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3326804700 0 0) 0x7f00b8001a20 con 0x7f00c01548c0 2023-11-28T19:59:22.956 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:22.947+0000 7f00beffd640 1 -- 172.21.15.78:0/3399112043 >> v1:172.21.15.78:6789/0 conn(0x7f00c01548c0 legacy=0x7f00c0154d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:22.956 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:22.947+0000 7f00beffd640 1 --2- 172.21.15.78:0/3399112043 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f00a80039b0 0x7f00a8003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:22.956 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:22.947+0000 7f00beffd640 1 --2- 172.21.15.78:0/3399112043 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f00c00c5300 0x7f00a80047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:22.956 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:22.947+0000 7f00beffd640 1 --2- 172.21.15.78:0/3399112043 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f00a8004d10 0x7f00a8005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:22.956 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:22.947+0000 7f00beffd640 1 -- 172.21.15.78:0/3399112043 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00c00c0f00 con 0x7f00a8004d10 2023-11-28T19:59:22.956 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:22.947+0000 7f00beffd640 1 -- 172.21.15.78:0/3399112043 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00a800ba40 con 0x7f00a80039b0 2023-11-28T19:59:22.956 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:22.947+0000 7f00beffd640 1 -- 172.21.15.78:0/3399112043 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00a800de10 con 0x7f00c00c5300 2023-11-28T19:59:22.956 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:22.947+0000 7f00c4f95640 1 --2- 172.21.15.78:0/3399112043 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f00a8004d10 0x7f00a8005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:22.956 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:22.947+0000 7f00bf7fe640 1 --2- 172.21.15.78:0/3399112043 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f00c00c5300 0x7f00a80047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:22.956 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:22.947+0000 7f00bffff640 1 --2- 172.21.15.78:0/3399112043 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f00a80039b0 0x7f00a8003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:22.956 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:22.947+0000 7f00c4f95640 1 -- 172.21.15.78:0/3399112043 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f00c00c5300 msgr2=0x7f00a80047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T19:59:22.956 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:22.947+0000 7f00c4f95640 1 --2- 172.21.15.78:0/3399112043 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f00c00c5300 0x7f00a80047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:22.957 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:22.947+0000 7f00c4f95640 1 -- 172.21.15.78:0/3399112043 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f00a80039b0 msgr2=0x7f00a8003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T19:59:22.957 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:22.947+0000 7f00c4f95640 1 --2- 172.21.15.78:0/3399112043 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f00a80039b0 0x7f00a8003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:22.957 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:22.947+0000 7f00c4f95640 1 -- 172.21.15.78:0/3399112043 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00a8003530 con 0x7f00a8004d10 2023-11-28T19:59:22.957 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:22.951+0000 7f00c4f95640 1 --2- 172.21.15.78:0/3399112043 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f00a8004d10 0x7f00a8005190 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f00b8002240 tx=0x7f00b801d300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=deeb67cde62de0b2 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:59:22.957 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:22.951+0000 7f00beffd640 1 -- 172.21.15.78:0/3399112043 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00b80ad430 con 0x7f00a8004d10 2023-11-28T19:59:22.958 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:22.951+0000 7f00beffd640 1 -- 172.21.15.78:0/3399112043 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f00b80a8070 con 0x7f00a8004d10 2023-11-28T19:59:22.958 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:22.951+0000 7f00beffd640 1 -- 172.21.15.78:0/3399112043 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00b80ad7f0 con 0x7f00a8004d10 2023-11-28T19:59:22.958 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:22.951+0000 7f00c69f8640 1 -- 172.21.15.78:0/3399112043 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f00a8004d10 msgr2=0x7f00a8005190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:22.958 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:22.951+0000 7f00c69f8640 1 --2- 172.21.15.78:0/3399112043 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f00a8004d10 0x7f00a8005190 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f00b8002240 tx=0x7f00b801d300 comp rx=0 tx=0).stop 2023-11-28T19:59:22.959 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:22.951+0000 7f00c4f95640 1 -- 172.21.15.78:0/3399112043 reap_dead start 2023-11-28T19:59:22.959 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:22.951+0000 7f00c69f8640 1 -- 172.21.15.78:0/3399112043 shutdown_connections 2023-11-28T19:59:22.959 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:22.951+0000 7f00c69f8640 1 -- 172.21.15.78:0/3399112043 >> 172.21.15.78:0/3399112043 conn(0x7f00c00c59f0 msgr2=0x7f00c00c5e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T19:59:22.959 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:22.951+0000 7f00c69f8640 1 -- 172.21.15.78:0/3399112043 shutdown_connections 2023-11-28T19:59:22.959 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:22.951+0000 7f00c69f8640 1 -- 172.21.15.78:0/3399112043 wait complete. 2023-11-28T19:59:22.960 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:22.955+0000 7f00c69f8640 1 Processor -- start 2023-11-28T19:59:22.960 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:22.955+0000 7f00c69f8640 1 -- start start 2023-11-28T19:59:22.962 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:22.955+0000 7f00c69f8640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f00a8004d10 0x7f00c0143f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:22.962 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:22.955+0000 7f00c69f8640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f00c014f140 0x7f00c0144450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:22.963 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:22.955+0000 7f00c69f8640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f00c006b930 0x7f00c006bde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:22.963 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:22.955+0000 7f00c69f8640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00c00a65c0 con 0x7f00c006b930 2023-11-28T19:59:22.963 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:22.955+0000 7f00c69f8640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00c01512a0 con 0x7f00a8004d10 2023-11-28T19:59:22.963 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:22.955+0000 7f00c69f8640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00c0144990 con 0x7f00c014f140 2023-11-28T19:59:22.963 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:22.955+0000 7f00c4f95640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f00c006b930 0x7f00c006bde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:22.963 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:22.955+0000 7f00c4f95640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f00c006b930 0x7f00c006bde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:60560/0 (socket says 172.21.15.78:60560) 2023-11-28T19:59:22.963 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:22.955+0000 7f00c4f95640 1 -- 172.21.15.78:0/201762117 learned_addr learned my addr 172.21.15.78:0/201762117 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T19:59:22.963 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:22.955+0000 7f00c4f95640 1 -- 172.21.15.78:0/201762117 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f00c014f140 msgr2=0x7f00c0144450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:22.963 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:22.955+0000 7f00bf7fe640 1 --2- 172.21.15.78:0/201762117 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f00c014f140 0x7f00c0144450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:22.963 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:22.955+0000 7f00bffff640 1 --2- 172.21.15.78:0/201762117 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f00a8004d10 0x7f00c0143f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:22.963 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:22.955+0000 7f00c4f95640 1 --2- 172.21.15.78:0/201762117 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f00c014f140 0x7f00c0144450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:22.963 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:22.955+0000 7f00c4f95640 1 -- 172.21.15.78:0/201762117 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f00a8004d10 msgr2=0x7f00c0143f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:22.964 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:22.955+0000 7f00c4f95640 1 --2- 172.21.15.78:0/201762117 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f00a8004d10 0x7f00c0143f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:22.964 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:22.955+0000 7f00c4f95640 1 -- 172.21.15.78:0/201762117 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00c00a6a50 con 0x7f00c006b930 2023-11-28T19:59:22.964 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:22.955+0000 7f00bffff640 1 --2- 172.21.15.78:0/201762117 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f00a8004d10 0x7f00c0143f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T19:59:22.964 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:22.955+0000 7f00bf7fe640 1 --2- 172.21.15.78:0/201762117 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f00c014f140 0x7f00c0144450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T19:59:22.964 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:22.955+0000 7f00c4f95640 1 --2- 172.21.15.78:0/201762117 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f00c006b930 0x7f00c006bde0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f00b8002240 tx=0x7f00a8005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:59:22.964 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:22.955+0000 7f00bcff9640 1 -- 172.21.15.78:0/201762117 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00b80019f0 con 0x7f00c006b930 2023-11-28T19:59:22.964 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:22.955+0000 7f00bcff9640 1 -- 172.21.15.78:0/201762117 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f00b80b9480 con 0x7f00c006b930 2023-11-28T19:59:22.964 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:22.955+0000 7f00bcff9640 1 -- 172.21.15.78:0/201762117 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00b80b97f0 con 0x7f00c006b930 2023-11-28T19:59:22.964 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:22.955+0000 7f00c69f8640 1 -- 172.21.15.78:0/201762117 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f00c0151d10 con 0x7f00c006b930 2023-11-28T19:59:22.964 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:22.955+0000 7f00c69f8640 1 -- 172.21.15.78:0/201762117 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f00c00a6250 con 0x7f00c006b930 2023-11-28T19:59:22.965 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:22.959+0000 7f00c69f8640 1 -- 172.21.15.78:0/201762117 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f00c00a6730 con 0x7f00c006b930 2023-11-28T19:59:22.965 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:22.959+0000 7f00bcff9640 1 -- 172.21.15.78:0/201762117 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f00b80aa030 con 0x7f00c006b930 2023-11-28T19:59:22.965 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:22.959+0000 7f00bcff9640 1 --2- 172.21.15.78:0/201762117 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f00ac0664a0 0x7f00ac068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:22.965 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:22.959+0000 7f00bcff9640 1 -- 172.21.15.78:0/201762117 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f00b811e600 con 0x7f00c006b930 2023-11-28T19:59:22.965 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:22.959+0000 7f00bffff640 1 --2- 172.21.15.78:0/201762117 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f00ac0664a0 0x7f00ac068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:22.966 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:22.959+0000 7f00bffff640 1 --2- 172.21.15.78:0/201762117 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f00ac0664a0 0x7f00ac068960 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f00b0007fd0 tx=0x7f00b0009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:59:22.969 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:22.963+0000 7f00bcff9640 1 -- 172.21.15.78:0/201762117 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f00b80ef2b0 con 0x7f00c006b930 2023-11-28T19:59:23.150 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:23.143+0000 7f00c69f8640 1 -- 172.21.15.78:0/201762117 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f00c0067630 con 0x7f00c006b930 2023-11-28T19:59:23.784 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:23.779+0000 7f00bcff9640 1 -- 172.21.15.78:0/201762117 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v9) v1 ==== 122+0+0 (secure 0 0 0) 0x7f00b80eee40 con 0x7f00c006b930 2023-11-28T19:59:23.786 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:23.779+0000 7f00c69f8640 1 -- 172.21.15.78:0/201762117 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f00ac0664a0 msgr2=0x7f00ac068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:23.786 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:23.779+0000 7f00c69f8640 1 --2- 172.21.15.78:0/201762117 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f00ac0664a0 0x7f00ac068960 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f00b0007fd0 tx=0x7f00b0009040 comp rx=0 tx=0).stop 2023-11-28T19:59:23.786 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:23.779+0000 7f00c69f8640 1 -- 172.21.15.78:0/201762117 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f00c006b930 msgr2=0x7f00c006bde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:23.786 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:23.779+0000 7f00c69f8640 1 --2- 172.21.15.78:0/201762117 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f00c006b930 0x7f00c006bde0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f00b8002240 tx=0x7f00a8005800 comp rx=0 tx=0).stop 2023-11-28T19:59:23.787 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:23.779+0000 7f00c69f8640 1 -- 172.21.15.78:0/201762117 shutdown_connections 2023-11-28T19:59:23.787 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:23.779+0000 7f00c69f8640 1 --2- 172.21.15.78:0/201762117 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f00ac0664a0 0x7f00ac068960 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:23.787 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:23.779+0000 7f00c69f8640 1 --2- 172.21.15.78:0/201762117 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f00c014f140 0x7f00c0144450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:23.787 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:23.779+0000 7f00c69f8640 1 --2- 172.21.15.78:0/201762117 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f00c006b930 0x7f00c006bde0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:23.788 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:23.779+0000 7f00c69f8640 1 --2- 172.21.15.78:0/201762117 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f00a8004d10 0x7f00c0143f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:23.788 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:23.779+0000 7f00c69f8640 1 -- 172.21.15.78:0/201762117 >> 172.21.15.78:0/201762117 conn(0x7f00c00c59f0 msgr2=0x7f00c00ab1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T19:59:23.788 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:23.783+0000 7f00c69f8640 1 -- 172.21.15.78:0/201762117 shutdown_connections 2023-11-28T19:59:23.788 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:23.783+0000 7f00c69f8640 1 -- 172.21.15.78:0/201762117 wait complete. 2023-11-28T19:59:23.810 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-11-28T19:59:23.811 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-28T19:59:23.951 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:23.947+0000 7f3f23348640 1 Processor -- start 2023-11-28T19:59:23.951 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:23.947+0000 7f3f23348640 1 -- start start 2023-11-28T19:59:23.952 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:23.947+0000 7f3f23348640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3f1c06baf0 0x7f3f1c06bed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:23.953 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:23.947+0000 7f3f23348640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3f1c0a53c0 con 0x7f3f1c0c1b10 2023-11-28T19:59:23.953 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:23.947+0000 7f3f23348640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3f1c0c0b80 con 0x7f3f1c0c3750 2023-11-28T19:59:23.953 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:23.947+0000 7f3f23348640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f1c0c1680 con 0x7f3f1c06baf0 2023-11-28T19:59:23.953 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:23.947+0000 7f3f22b47640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f3f1c0c1b10 0x7f3f1c15b150 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:35200/0 (socket says 172.21.15.78:35200) 2023-11-28T19:59:23.953 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:23.947+0000 7f3f22b47640 1 -- 172.21.15.78:0/3959882752 learned_addr learned my addr 172.21.15.78:0/3959882752 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-11-28T19:59:23.953 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:23.947+0000 7f3f22346640 1 --2- 172.21.15.78:0/3959882752 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3f1c06baf0 0x7f3f1c06bed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:23.955 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:23.947+0000 7f3f21344640 1 -- 172.21.15.78:0/3959882752 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1700543745 0 0) 0x7f3f1c0a53c0 con 0x7f3f1c0c1b10 2023-11-28T19:59:23.955 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:23.947+0000 7f3f21344640 1 -- 172.21.15.78:0/3959882752 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3f08003530 con 0x7f3f1c0c1b10 2023-11-28T19:59:23.955 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:23.947+0000 7f3f21344640 1 -- 172.21.15.78:0/3959882752 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 852292764 0 0) 0x7f3f1c0c0b80 con 0x7f3f1c0c3750 2023-11-28T19:59:23.955 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:23.947+0000 7f3f21344640 1 -- 172.21.15.78:0/3959882752 --> v1:172.21.15.179:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3f1c0a53c0 con 0x7f3f1c0c3750 2023-11-28T19:59:23.956 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:23.947+0000 7f3f21344640 1 -- 172.21.15.78:0/3959882752 <== mon.0 v1:172.21.15.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1799364344 0 0) 0x7f3f08003530 con 0x7f3f1c0c1b10 2023-11-28T19:59:23.956 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:23.947+0000 7f3f21344640 1 -- 172.21.15.78:0/3959882752 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3f1c06baf0 msgr2=0x7f3f1c06bed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T19:59:23.956 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:23.947+0000 7f3f21344640 1 --2- 172.21.15.78:0/3959882752 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3f1c06baf0 0x7f3f1c06bed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:23.956 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:23.947+0000 7f3f21344640 1 -- 172.21.15.78:0/3959882752 >> v1:172.21.15.179:6789/0 conn(0x7f3f1c0c3750 legacy=0x7f3f1c151220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:23.956 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:23.947+0000 7f3f21344640 1 -- 172.21.15.78:0/3959882752 --> v1:172.21.15.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f1c0c08a0 con 0x7f3f1c0c1b10 2023-11-28T19:59:23.956 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:23.947+0000 7f3f21344640 1 -- 172.21.15.78:0/3959882752 <== mon.0 v1:172.21.15.78:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3326804700 0 0) 0x7f3f14001a00 con 0x7f3f1c0c1b10 2023-11-28T19:59:23.956 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:23.947+0000 7f3f21344640 1 -- 172.21.15.78:0/3959882752 >> v1:172.21.15.78:6789/0 conn(0x7f3f1c0c1b10 legacy=0x7f3f1c15b150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:23.956 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:23.947+0000 7f3f21344640 1 --2- 172.21.15.78:0/3959882752 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3f08003b40 0x7f3f08003f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:23.956 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:23.947+0000 7f3f21344640 1 --2- 172.21.15.78:0/3959882752 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3f080047d0 0x7f3f08004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:23.956 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:23.947+0000 7f3f21344640 1 --2- 172.21.15.78:0/3959882752 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3f080051e0 0x7f3f0800caa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:23.956 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:23.947+0000 7f3f21344640 1 -- 172.21.15.78:0/3959882752 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f1c0c1680 con 0x7f3f08003b40 2023-11-28T19:59:23.957 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:23.947+0000 7f3f21344640 1 -- 172.21.15.78:0/3959882752 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f0800d220 con 0x7f3f080051e0 2023-11-28T19:59:23.957 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:23.947+0000 7f3f21344640 1 -- 172.21.15.78:0/3959882752 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f0800d3e0 con 0x7f3f080047d0 2023-11-28T19:59:23.957 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:23.947+0000 7f3f22346640 1 --2- 172.21.15.78:0/3959882752 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3f1c06baf0 0x7f3f1c06bed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T19:59:23.957 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:23.947+0000 7f3f22346640 1 --2- 172.21.15.78:0/3959882752 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3f08003b40 0x7f3f08003f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:23.957 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:23.947+0000 7f3f22b47640 1 --2- 172.21.15.78:0/3959882752 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3f080051e0 0x7f3f0800caa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:23.957 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:23.947+0000 7f3f21b45640 1 --2- 172.21.15.78:0/3959882752 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3f080047d0 0x7f3f08004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:23.957 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:23.947+0000 7f3f22346640 1 -- 172.21.15.78:0/3959882752 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3f080047d0 msgr2=0x7f3f08004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T19:59:23.957 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:23.947+0000 7f3f22346640 1 --2- 172.21.15.78:0/3959882752 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3f080047d0 0x7f3f08004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:23.957 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:23.947+0000 7f3f22346640 1 -- 172.21.15.78:0/3959882752 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3f080051e0 msgr2=0x7f3f0800caa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T19:59:23.957 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:23.947+0000 7f3f22346640 1 --2- 172.21.15.78:0/3959882752 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3f080051e0 0x7f3f0800caa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:23.957 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:23.947+0000 7f3f22346640 1 -- 172.21.15.78:0/3959882752 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f08003530 con 0x7f3f08003b40 2023-11-28T19:59:23.959 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:23.951+0000 7f3f22346640 1 --2- 172.21.15.78:0/3959882752 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3f08003b40 0x7f3f08003f40 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f3f1c06ec00 tx=0x7f3f1801ca60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5946be6201e09080 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:59:23.959 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:23.951+0000 7f3f21344640 1 -- 172.21.15.78:0/3959882752 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f18004030 con 0x7f3f08003b40 2023-11-28T19:59:23.959 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:23.951+0000 7f3f21344640 1 -- 172.21.15.78:0/3959882752 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f18004190 con 0x7f3f08003b40 2023-11-28T19:59:23.959 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:23.951+0000 7f3f21344640 1 -- 172.21.15.78:0/3959882752 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f18004520 con 0x7f3f08003b40 2023-11-28T19:59:23.959 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:23.951+0000 7f3f23348640 1 -- 172.21.15.78:0/3959882752 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3f08003b40 msgr2=0x7f3f08003f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:23.959 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:23.951+0000 7f3f23348640 1 --2- 172.21.15.78:0/3959882752 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3f08003b40 0x7f3f08003f40 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f3f1c06ec00 tx=0x7f3f1801ca60 comp rx=0 tx=0).stop 2023-11-28T19:59:23.959 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:23.951+0000 7f3f22b47640 1 -- 172.21.15.78:0/3959882752 reap_dead start 2023-11-28T19:59:23.959 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:23.951+0000 7f3f23348640 1 -- 172.21.15.78:0/3959882752 shutdown_connections 2023-11-28T19:59:23.959 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:23.951+0000 7f3f23348640 1 -- 172.21.15.78:0/3959882752 >> 172.21.15.78:0/3959882752 conn(0x7f3f1c0a7600 msgr2=0x7f3f1c0a7a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T19:59:23.959 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:23.951+0000 7f3f23348640 1 -- 172.21.15.78:0/3959882752 shutdown_connections 2023-11-28T19:59:23.959 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:23.951+0000 7f3f23348640 1 -- 172.21.15.78:0/3959882752 wait complete. 2023-11-28T19:59:23.960 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:23.955+0000 7f3f23348640 1 Processor -- start 2023-11-28T19:59:23.960 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:23.955+0000 7f3f23348640 1 -- start start 2023-11-28T19:59:23.963 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:23.955+0000 7f3f23348640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3f08003b40 0x7f3f1c146aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:23.963 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:23.955+0000 7f3f23348640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3f1c0bee50 0x7f3f1c0a9b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:23.964 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:23.955+0000 7f3f23348640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3f1c0aa0a0 0x7f3f1c1f0970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:23.964 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:23.955+0000 7f3f23348640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f1c0a95c0 con 0x7f3f08003b40 2023-11-28T19:59:23.964 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:23.955+0000 7f3f23348640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f1c146fe0 con 0x7f3f1c0aa0a0 2023-11-28T19:59:23.964 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:23.955+0000 7f3f23348640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f1c0a9370 con 0x7f3f1c0bee50 2023-11-28T19:59:23.964 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:23.955+0000 7f3f22346640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3f08003b40 0x7f3f1c146aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:23.964 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:23.955+0000 7f3f22346640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3f08003b40 0x7f3f1c146aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:60576/0 (socket says 172.21.15.78:60576) 2023-11-28T19:59:23.964 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:23.955+0000 7f3f22346640 1 -- 172.21.15.78:0/3510432003 learned_addr learned my addr 172.21.15.78:0/3510432003 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T19:59:23.964 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:23.955+0000 7f3f21b45640 1 --2- 172.21.15.78:0/3510432003 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3f1c0bee50 0x7f3f1c0a9b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:23.964 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:23.955+0000 7f3f22b47640 1 --2- 172.21.15.78:0/3510432003 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3f1c0aa0a0 0x7f3f1c1f0970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:23.964 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:23.955+0000 7f3f22346640 1 -- 172.21.15.78:0/3510432003 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3f1c0bee50 msgr2=0x7f3f1c0a9b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:23.964 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:23.955+0000 7f3f22346640 1 --2- 172.21.15.78:0/3510432003 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3f1c0bee50 0x7f3f1c0a9b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:23.965 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:23.955+0000 7f3f22346640 1 -- 172.21.15.78:0/3510432003 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3f1c0aa0a0 msgr2=0x7f3f1c1f0970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:23.965 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:23.955+0000 7f3f22346640 1 --2- 172.21.15.78:0/3510432003 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3f1c0aa0a0 0x7f3f1c1f0970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:23.965 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:23.955+0000 7f3f22346640 1 -- 172.21.15.78:0/3510432003 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f1c0a89a0 con 0x7f3f08003b40 2023-11-28T19:59:23.965 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:23.955+0000 7f3f22346640 1 --2- 172.21.15.78:0/3510432003 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3f08003b40 0x7f3f1c146aa0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f3f1801caa0 tx=0x7f3f08005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:59:23.965 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:23.955+0000 7f3f12ffd640 1 -- 172.21.15.78:0/3510432003 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f1800f0c0 con 0x7f3f08003b40 2023-11-28T19:59:23.965 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:23.955+0000 7f3f12ffd640 1 -- 172.21.15.78:0/3510432003 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f18004300 con 0x7f3f08003b40 2023-11-28T19:59:23.965 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:23.955+0000 7f3f23348640 1 -- 172.21.15.78:0/3510432003 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3f1c1473a0 con 0x7f3f08003b40 2023-11-28T19:59:23.965 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:23.955+0000 7f3f12ffd640 1 -- 172.21.15.78:0/3510432003 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f180a55d0 con 0x7f3f08003b40 2023-11-28T19:59:23.965 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:23.959+0000 7f3f23348640 1 -- 172.21.15.78:0/3510432003 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3f1c0a8bf0 con 0x7f3f08003b40 2023-11-28T19:59:23.966 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:23.959+0000 7f3f23348640 1 -- 172.21.15.78:0/3510432003 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3f1c0674b0 con 0x7f3f08003b40 2023-11-28T19:59:23.966 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:23.959+0000 7f3f12ffd640 1 -- 172.21.15.78:0/3510432003 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f3f180a5730 con 0x7f3f08003b40 2023-11-28T19:59:23.966 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:23.959+0000 7f3f12ffd640 1 --2- 172.21.15.78:0/3510432003 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f3f00066470 0x7f3f00068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:23.967 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:23.959+0000 7f3f12ffd640 1 -- 172.21.15.78:0/3510432003 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f3f1811e620 con 0x7f3f08003b40 2023-11-28T19:59:23.967 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:23.959+0000 7f3f21b45640 1 --2- 172.21.15.78:0/3510432003 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f3f00066470 0x7f3f00068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:23.967 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:23.959+0000 7f3f21b45640 1 --2- 172.21.15.78:0/3510432003 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f3f00066470 0x7f3f00068930 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f3f0c0010f0 tx=0x7f3f0c009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:59:23.969 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:23.963+0000 7f3f12ffd640 1 -- 172.21.15.78:0/3510432003 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f3f180eb7a0 con 0x7f3f08003b40 2023-11-28T19:59:24.150 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:24.143+0000 7f3f23348640 1 -- 172.21.15.78:0/3510432003 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f3f1c0674b0 con 0x7f3f08003b40 2023-11-28T19:59:24.151 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:24.147+0000 7f3f12ffd640 1 -- 172.21.15.78:0/3510432003 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4915 (secure 0 0 0) 0x7f3f180eedc0 con 0x7f3f08003b40 2023-11-28T19:59:24.151 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-11-28T19:59:24.151 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4241,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6835/3089461479","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6833","nonce":3089461479},{"type":"v1","addr":"172.21.15.179:6835","nonce":3089461479}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4258,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6837/3153162191","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6834","nonce":3153162191},{"type":"v1","addr":"172.21.15.78:6837","nonce":3153162191}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4266,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6836/3073967897","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6835","nonce":3073967897},{"type":"v1","addr":"172.21.15.78:6836","nonce":3073967897}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-28T19:59:05.411488+0000","modified":"2023-11-28T19:59:23.150979+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4275},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4275":{"gid":4275,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.179:6834/1234044491","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6832","nonce":1234044491},{"type":"v1","addr":"172.21.15.179:6834","nonce":1234044491}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-11-28T19:59:24.151 INFO:teuthology.orchestra.run.smithi078.stderr:dumped fsmap epoch 9 2023-11-28T19:59:24.153 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:24.147+0000 7f3f23348640 1 -- 172.21.15.78:0/3510432003 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f3f00066470 msgr2=0x7f3f00068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:24.153 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:24.147+0000 7f3f23348640 1 --2- 172.21.15.78:0/3510432003 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f3f00066470 0x7f3f00068930 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f3f0c0010f0 tx=0x7f3f0c009040 comp rx=0 tx=0).stop 2023-11-28T19:59:24.153 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:24.147+0000 7f3f23348640 1 -- 172.21.15.78:0/3510432003 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3f08003b40 msgr2=0x7f3f1c146aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:24.153 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:24.147+0000 7f3f23348640 1 --2- 172.21.15.78:0/3510432003 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3f08003b40 0x7f3f1c146aa0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f3f1801caa0 tx=0x7f3f08005800 comp rx=0 tx=0).stop 2023-11-28T19:59:24.153 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:24.147+0000 7f3f23348640 1 -- 172.21.15.78:0/3510432003 shutdown_connections 2023-11-28T19:59:24.154 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:24.147+0000 7f3f23348640 1 --2- 172.21.15.78:0/3510432003 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f3f00066470 0x7f3f00068930 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:24.154 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:24.147+0000 7f3f23348640 1 --2- 172.21.15.78:0/3510432003 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3f1c0bee50 0x7f3f1c0a9b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:24.154 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:24.147+0000 7f3f23348640 1 --2- 172.21.15.78:0/3510432003 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3f1c0aa0a0 0x7f3f1c1f0970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:24.154 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:24.147+0000 7f3f23348640 1 --2- 172.21.15.78:0/3510432003 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3f08003b40 0x7f3f1c146aa0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:24.154 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:24.147+0000 7f3f23348640 1 -- 172.21.15.78:0/3510432003 >> 172.21.15.78:0/3510432003 conn(0x7f3f1c0a7600 msgr2=0x7f3f1c0aa880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T19:59:24.154 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:24.147+0000 7f3f23348640 1 -- 172.21.15.78:0/3510432003 shutdown_connections 2023-11-28T19:59:24.154 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:24.147+0000 7f3f23348640 1 -- 172.21.15.78:0/3510432003 wait complete. 2023-11-28T19:59:24.172 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-28T19:59:24.310 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:24.303+0000 7f911ac79640 1 Processor -- start 2023-11-28T19:59:24.311 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:24.303+0000 7f911ac79640 1 -- start start 2023-11-28T19:59:24.311 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:24.307+0000 7f911ac79640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f911414e570 0x7f91140c7cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:24.312 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:24.307+0000 7f911ac79640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f91140c81f0 con 0x7f91140ca190 2023-11-28T19:59:24.312 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:24.307+0000 7f911ac79640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f91140c5140 con 0x7f9114154fd0 2023-11-28T19:59:24.312 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:24.307+0000 7f911ac79640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f91140c4b80 con 0x7f911414e570 2023-11-28T19:59:24.312 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:24.307+0000 7f9119216640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f91140ca190 0x7f911415eed0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:35206/0 (socket says 172.21.15.78:35206) 2023-11-28T19:59:24.312 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:24.307+0000 7f9119216640 1 -- 172.21.15.78:0/2274713536 learned_addr learned my addr 172.21.15.78:0/2274713536 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-11-28T19:59:24.313 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:24.307+0000 7f9118a15640 1 --2- 172.21.15.78:0/2274713536 >> v2:172.21.15.179:3300/0 conn(0x7f911414e570 0x7f91140c7cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:24.313 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:24.307+0000 7f91137fe640 1 -- 172.21.15.78:0/2274713536 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 268459820 0 0) 0x7f91140c81f0 con 0x7f91140ca190 2023-11-28T19:59:24.313 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:24.307+0000 7f91137fe640 1 -- 172.21.15.78:0/2274713536 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9104003530 con 0x7f91140ca190 2023-11-28T19:59:24.313 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:24.307+0000 7f91137fe640 1 -- 172.21.15.78:0/2274713536 <== mon.0 v1:172.21.15.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2043253709 0 0) 0x7f9104003530 con 0x7f91140ca190 2023-11-28T19:59:24.313 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:24.307+0000 7f9118a15640 1 -- 172.21.15.78:0/2274713536 >> v1:172.21.15.179:6789/0 conn(0x7f9114154fd0 legacy=0x7f91141584e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:24.313 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:24.307+0000 7f9118a15640 1 -- 172.21.15.78:0/2274713536 >> v1:172.21.15.78:6789/0 conn(0x7f91140ca190 legacy=0x7f911415eed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:24.313 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:24.307+0000 7f9118a15640 1 -- 172.21.15.78:0/2274713536 --> v2:172.21.15.179:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91140c4e60 con 0x7f911414e570 2023-11-28T19:59:24.315 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:24.311+0000 7f9118a15640 1 --2- 172.21.15.78:0/2274713536 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f911414e570 0x7f91140c7cb0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f91080097c0 tx=0x7f910801c2e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=93fb69edede3cc22 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:59:24.316 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:24.311+0000 7f91137fe640 1 -- 172.21.15.78:0/2274713536 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f910c001a00 con 0x7f911414e570 2023-11-28T19:59:24.316 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:24.311+0000 7f91137fe640 1 -- 172.21.15.78:0/2274713536 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f91080a7050 con 0x7f911414e570 2023-11-28T19:59:24.316 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:24.311+0000 7f91137fe640 1 -- 172.21.15.78:0/2274713536 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91080ab400 con 0x7f911414e570 2023-11-28T19:59:24.317 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:24.311+0000 7f911ac79640 1 -- 172.21.15.78:0/2274713536 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f911414e570 msgr2=0x7f91140c7cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:24.317 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:24.311+0000 7f911ac79640 1 --2- 172.21.15.78:0/2274713536 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f911414e570 0x7f91140c7cb0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f91080097c0 tx=0x7f910801c2e0 comp rx=0 tx=0).stop 2023-11-28T19:59:24.317 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:24.311+0000 7f911ac79640 1 -- 172.21.15.78:0/2274713536 shutdown_connections 2023-11-28T19:59:24.317 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:24.311+0000 7f911ac79640 1 --2- 172.21.15.78:0/2274713536 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f911414e570 0x7f91140c7cb0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:24.317 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:24.311+0000 7f911ac79640 1 -- 172.21.15.78:0/2274713536 >> 172.21.15.78:0/2274713536 conn(0x7f91140abb10 msgr2=0x7f91140abf20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T19:59:24.317 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:24.311+0000 7f911ac79640 1 -- 172.21.15.78:0/2274713536 shutdown_connections 2023-11-28T19:59:24.317 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:24.311+0000 7f911ac79640 1 -- 172.21.15.78:0/2274713536 wait complete. 2023-11-28T19:59:24.318 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:24.311+0000 7f911ac79640 1 Processor -- start 2023-11-28T19:59:24.318 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:24.311+0000 7f911ac79640 1 -- start start 2023-11-28T19:59:24.320 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:24.315+0000 7f911ac79640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f91140ca190 0x7f91140af3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:24.320 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:24.315+0000 7f911ac79640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f911414e570 0x7f91140bea20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:24.320 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:24.315+0000 7f911ac79640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9114154fd0 0x7f91140bef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:24.321 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:24.315+0000 7f911ac79640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91140c33d0 con 0x7f91140ca190 2023-11-28T19:59:24.321 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:24.315+0000 7f911ac79640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9114149d20 con 0x7f911414e570 2023-11-28T19:59:24.321 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:24.315+0000 7f911ac79640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91140bfa80 con 0x7f9114154fd0 2023-11-28T19:59:24.321 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:24.315+0000 7f9118a15640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f91140ca190 0x7f91140af3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:24.321 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:24.315+0000 7f9118a15640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f91140ca190 0x7f91140af3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:60586/0 (socket says 172.21.15.78:60586) 2023-11-28T19:59:24.322 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:24.315+0000 7f9118a15640 1 -- 172.21.15.78:0/3778438795 learned_addr learned my addr 172.21.15.78:0/3778438795 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T19:59:24.322 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:24.315+0000 7f9119216640 1 --2- 172.21.15.78:0/3778438795 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9114154fd0 0x7f91140bef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:24.322 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:24.315+0000 7f9113fff640 1 --2- 172.21.15.78:0/3778438795 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f911414e570 0x7f91140bea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:24.322 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:24.315+0000 7f9118a15640 1 -- 172.21.15.78:0/3778438795 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9114154fd0 msgr2=0x7f91140bef60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:24.322 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:24.315+0000 7f9118a15640 1 --2- 172.21.15.78:0/3778438795 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9114154fd0 0x7f91140bef60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:24.323 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:24.315+0000 7f9118a15640 1 -- 172.21.15.78:0/3778438795 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f911414e570 msgr2=0x7f91140bea20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:24.323 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:24.315+0000 7f9118a15640 1 --2- 172.21.15.78:0/3778438795 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f911414e570 0x7f91140bea20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:24.323 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:24.315+0000 7f9118a15640 1 -- 172.21.15.78:0/3778438795 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9108009420 con 0x7f91140ca190 2023-11-28T19:59:24.323 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:24.315+0000 7f9118a15640 1 --2- 172.21.15.78:0/3778438795 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f91140ca190 0x7f91140af3c0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f9108018ef0 tx=0x7f9108019080 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:59:24.325 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:24.315+0000 7f91117fa640 1 -- 172.21.15.78:0/3778438795 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91080a4ec0 con 0x7f91140ca190 2023-11-28T19:59:24.326 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:24.315+0000 7f91117fa640 1 -- 172.21.15.78:0/3778438795 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f91080b4400 con 0x7f91140ca190 2023-11-28T19:59:24.326 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:24.315+0000 7f911ac79640 1 -- 172.21.15.78:0/3778438795 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f91140c2ea0 con 0x7f91140ca190 2023-11-28T19:59:24.326 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:24.315+0000 7f91117fa640 1 -- 172.21.15.78:0/3778438795 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91080b47b0 con 0x7f91140ca190 2023-11-28T19:59:24.326 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:24.315+0000 7f911ac79640 1 -- 172.21.15.78:0/3778438795 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f911414d4f0 con 0x7f91140ca190 2023-11-28T19:59:24.326 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:24.315+0000 7f911ac79640 1 -- 172.21.15.78:0/3778438795 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f91141553e0 con 0x7f91140ca190 2023-11-28T19:59:24.326 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:24.319+0000 7f91117fa640 1 -- 172.21.15.78:0/3778438795 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f91080b2040 con 0x7f91140ca190 2023-11-28T19:59:24.326 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:24.319+0000 7f91117fa640 1 --2- 172.21.15.78:0/3778438795 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f90f8066470 0x7f90f8068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:24.326 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:24.319+0000 7f91117fa640 1 -- 172.21.15.78:0/3778438795 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f910811e0d0 con 0x7f91140ca190 2023-11-28T19:59:24.326 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:24.319+0000 7f9113fff640 1 --2- 172.21.15.78:0/3778438795 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f90f8066470 0x7f90f8068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:24.327 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:24.319+0000 7f9113fff640 1 --2- 172.21.15.78:0/3778438795 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f90f8066470 0x7f90f8068930 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f91141ee270 tx=0x7f9100009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:59:24.329 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:24.323+0000 7f91117fa640 1 -- 172.21.15.78:0/3778438795 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f91141553e0 con 0x7f91140ca190 2023-11-28T19:59:24.478 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:24.471+0000 7f911ac79640 1 -- 172.21.15.78:0/3778438795 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f91141553e0 con 0x7f91140ca190 2023-11-28T19:59:24.479 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:24.475+0000 7f91117fa640 1 -- 172.21.15.78:0/3778438795 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+18322 (secure 0 0 0) 0x7f91141553e0 con 0x7f91140ca190 2023-11-28T19:59:24.480 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-11-28T19:59:24.480 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":25,"fsid":"dd9780e8-3bda-44fa-a9f0-fa07d19d901d","created":"2023-11-28T19:58:40.969556+0000","modified":"2023-11-28T19:59:10.474525+0000","last_up_change":"2023-11-28T19:58:52.596716+0000","last_in_change":"2023-11-28T19:58:43.609275+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-28T19:58:54.011229+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-28T19:59:03.945559+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-28T19:59:04.481478+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-11-28T19:59:08.109152+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"e84245ac-b5da-429e-af18-39acaa2b33e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6800","nonce":3358701235},{"type":"v1","addr":"172.21.15.78:6801","nonce":3358701235}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6802","nonce":3358701235},{"type":"v1","addr":"172.21.15.78:6803","nonce":3358701235}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6806","nonce":3358701235},{"type":"v1","addr":"172.21.15.78:6807","nonce":3358701235}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6804","nonce":3358701235},{"type":"v1","addr":"172.21.15.78:6805","nonce":3358701235}]},"public_addr":"172.21.15.78:6801/3358701235","cluster_addr":"172.21.15.78:6803/3358701235","heartbeat_back_addr":"172.21.15.78:6807/3358701235","heartbeat_front_addr":"172.21.15.78:6805/3358701235","state":["exists","up"]},{"osd":1,"uuid":"e634831d-c4e2-48d9-870c-9556ae162981","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6808","nonce":3211476654},{"type":"v1","addr":"172.21.15.78:6809","nonce":3211476654}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6810","nonce":3211476654},{"type":"v1","addr":"172.21.15.78:6811","nonce":3211476654}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6814","nonce":3211476654},{"type":"v1","addr":"172.21.15.78:6815","nonce":3211476654}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6812","nonce":3211476654},{"type":"v1","addr":"172.21.15.78:6813","nonce":3211476654}]},"public_addr":"172.21.15.78:6809/3211476654","cluster_addr":"172.21.15.78:6811/3211476654","heartbeat_back_addr":"172.21.15.78:6815/3211476654","heartbeat_front_addr":"172.21.15.78:6813/3211476654","state":["exists","up"]},{"osd":2,"uuid":"274c8395-6534-41f0-b8fb-a00af8985aa8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6816","nonce":2532904479},{"type":"v1","addr":"172.21.15.78:6817","nonce":2532904479}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6818","nonce":2532904479},{"type":"v1","addr":"172.21.15.78:6819","nonce":2532904479}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6822","nonce":2532904479},{"type":"v1","addr":"172.21.15.78:6823","nonce":2532904479}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6820","nonce":2532904479},{"type":"v1","addr":"172.21.15.78:6821","nonce":2532904479}]},"public_addr":"172.21.15.78:6817/2532904479","cluster_addr":"172.21.15.78:6819/2532904479","heartbeat_back_addr":"172.21.15.78:6823/2532904479","heartbeat_front_addr":"172.21.15.78:6821/2532904479","state":["exists","up"]},{"osd":3,"uuid":"77acc9af-7d4d-4b18-8cf5-d62f5971b7c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6824","nonce":3442991267},{"type":"v1","addr":"172.21.15.78:6825","nonce":3442991267}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6826","nonce":3442991267},{"type":"v1","addr":"172.21.15.78:6827","nonce":3442991267}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6830","nonce":3442991267},{"type":"v1","addr":"172.21.15.78:6831","nonce":3442991267}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6828","nonce":3442991267},{"type":"v1","addr":"172.21.15.78:6829","nonce":3442991267}]},"public_addr":"172.21.15.78:6825/3442991267","cluster_addr":"172.21.15.78:6827/3442991267","heartbeat_back_addr":"172.21.15.78:6831/3442991267","heartbeat_front_addr":"172.21.15.78:6829/3442991267","state":["exists","up"]},{"osd":4,"uuid":"5c62bc66-6b34-4b7f-a66b-9a743969138c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":802983577},{"type":"v1","addr":"172.21.15.179:6809","nonce":802983577}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":802983577},{"type":"v1","addr":"172.21.15.179:6811","nonce":802983577}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":802983577},{"type":"v1","addr":"172.21.15.179:6815","nonce":802983577}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":802983577},{"type":"v1","addr":"172.21.15.179:6813","nonce":802983577}]},"public_addr":"172.21.15.179:6809/802983577","cluster_addr":"172.21.15.179:6811/802983577","heartbeat_back_addr":"172.21.15.179:6815/802983577","heartbeat_front_addr":"172.21.15.179:6813/802983577","state":["exists","up"]},{"osd":5,"uuid":"67db6d36-f684-4079-b0cd-82b4dd61461f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":518192887},{"type":"v1","addr":"172.21.15.179:6818","nonce":518192887}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":518192887},{"type":"v1","addr":"172.21.15.179:6822","nonce":518192887}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":518192887},{"type":"v1","addr":"172.21.15.179:6829","nonce":518192887}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6824","nonce":518192887},{"type":"v1","addr":"172.21.15.179:6826","nonce":518192887}]},"public_addr":"172.21.15.179:6818/518192887","cluster_addr":"172.21.15.179:6822/518192887","heartbeat_back_addr":"172.21.15.179:6829/518192887","heartbeat_front_addr":"172.21.15.179:6826/518192887","state":["exists","up"]},{"osd":6,"uuid":"12e670af-5a16-4c81-9f97-defa66cab967","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":815435378},{"type":"v1","addr":"172.21.15.179:6801","nonce":815435378}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":815435378},{"type":"v1","addr":"172.21.15.179:6803","nonce":815435378}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":815435378},{"type":"v1","addr":"172.21.15.179:6807","nonce":815435378}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":815435378},{"type":"v1","addr":"172.21.15.179:6805","nonce":815435378}]},"public_addr":"172.21.15.179:6801/815435378","cluster_addr":"172.21.15.179:6803/815435378","heartbeat_back_addr":"172.21.15.179:6807/815435378","heartbeat_front_addr":"172.21.15.179:6805/815435378","state":["exists","up"]},{"osd":7,"uuid":"fe630650-2eb3-49ad-8676-c341e6332eb1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6817","nonce":2848432339},{"type":"v1","addr":"172.21.15.179:6819","nonce":2848432339}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6821","nonce":2848432339},{"type":"v1","addr":"172.21.15.179:6823","nonce":2848432339}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":2848432339},{"type":"v1","addr":"172.21.15.179:6831","nonce":2848432339}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6825","nonce":2848432339},{"type":"v1","addr":"172.21.15.179:6827","nonce":2848432339}]},"public_addr":"172.21.15.179:6819/2848432339","cluster_addr":"172.21.15.179:6823/2848432339","heartbeat_back_addr":"172.21.15.179:6831/2848432339","heartbeat_front_addr":"172.21.15.179:6827/2848432339","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:58:49.255433+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:58:49.412880+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:58:49.559295+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:58:49.245237+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:58:49.184557+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:58:49.329851+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:58:49.366012+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:58:49.349604+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-28T19:59:24.482 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:24.475+0000 7f911ac79640 1 -- 172.21.15.78:0/3778438795 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f90f8066470 msgr2=0x7f90f8068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:24.482 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:24.475+0000 7f911ac79640 1 --2- 172.21.15.78:0/3778438795 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f90f8066470 0x7f90f8068930 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f91141ee270 tx=0x7f9100009040 comp rx=0 tx=0).stop 2023-11-28T19:59:24.482 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:24.475+0000 7f911ac79640 1 -- 172.21.15.78:0/3778438795 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f91140ca190 msgr2=0x7f91140af3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:24.482 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:24.475+0000 7f911ac79640 1 --2- 172.21.15.78:0/3778438795 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f91140ca190 0x7f91140af3c0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f9108018ef0 tx=0x7f9108019080 comp rx=0 tx=0).stop 2023-11-28T19:59:24.482 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:24.475+0000 7f911ac79640 1 -- 172.21.15.78:0/3778438795 shutdown_connections 2023-11-28T19:59:24.482 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:24.475+0000 7f911ac79640 1 --2- 172.21.15.78:0/3778438795 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f90f8066470 0x7f90f8068930 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:24.482 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:24.475+0000 7f911ac79640 1 --2- 172.21.15.78:0/3778438795 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9114154fd0 0x7f91140bef60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:24.482 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:24.475+0000 7f911ac79640 1 --2- 172.21.15.78:0/3778438795 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f911414e570 0x7f91140bea20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:24.482 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:24.475+0000 7f911ac79640 1 --2- 172.21.15.78:0/3778438795 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f91140ca190 0x7f91140af3c0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:24.483 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:24.475+0000 7f911ac79640 1 -- 172.21.15.78:0/3778438795 >> 172.21.15.78:0/3778438795 conn(0x7f91140abb10 msgr2=0x7f91140aace0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T19:59:24.483 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:24.475+0000 7f911ac79640 1 -- 172.21.15.78:0/3778438795 shutdown_connections 2023-11-28T19:59:24.483 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:24.475+0000 7f911ac79640 1 -- 172.21.15.78:0/3778438795 wait complete. 2023-11-28T19:59:24.501 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-11-28T19:59:24.501 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-28T19:59:24.639 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:24.631+0000 7f56e4cfe640 1 Processor -- start 2023-11-28T19:59:24.639 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:24.631+0000 7f56e4cfe640 1 -- start start 2023-11-28T19:59:24.640 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:24.635+0000 7f56e4cfe640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f56e00af4c0 0x7f56e0154f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:24.640 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:24.635+0000 7f56e4cfe640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f56e00c4890 con 0x7f56e00c67d0 2023-11-28T19:59:24.640 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:24.635+0000 7f56e4cfe640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f56e00af8a0 con 0x7f56e006c100 2023-11-28T19:59:24.640 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:24.635+0000 7f56e4cfe640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f56e0155460 con 0x7f56e00af4c0 2023-11-28T19:59:24.640 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:24.635+0000 7f56d5d9b640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f56e00c67d0 0x7f56e006b9f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:35212/0 (socket says 172.21.15.78:35212) 2023-11-28T19:59:24.641 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:24.635+0000 7f56d5d9b640 1 -- 172.21.15.78:0/3781885903 learned_addr learned my addr 172.21.15.78:0/3781885903 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-11-28T19:59:24.641 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:24.635+0000 7f56de59c640 1 --2- 172.21.15.78:0/3781885903 >> v2:172.21.15.179:3300/0 conn(0x7f56e00af4c0 0x7f56e0154f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:24.641 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:24.635+0000 7f56ddd9b640 1 -- 172.21.15.78:0/3781885903 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3188688355 0 0) 0x7f56e00c4890 con 0x7f56e00c67d0 2023-11-28T19:59:24.641 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:24.635+0000 7f56ddd9b640 1 -- 172.21.15.78:0/3781885903 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f56cc003530 con 0x7f56e00c67d0 2023-11-28T19:59:24.643 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:24.635+0000 7f56ddd9b640 1 -- 172.21.15.78:0/3781885903 <== mon.0 v1:172.21.15.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 910027508 0 0) 0x7f56cc003530 con 0x7f56e00c67d0 2023-11-28T19:59:24.643 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:24.635+0000 7f56ddd9b640 1 -- 172.21.15.78:0/3781885903 >> v2:172.21.15.179:3300/0 conn(0x7f56e00af4c0 msgr2=0x7f56e0154f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T19:59:24.643 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:24.635+0000 7f56ddd9b640 1 --2- 172.21.15.78:0/3781885903 >> v2:172.21.15.179:3300/0 conn(0x7f56e00af4c0 0x7f56e0154f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:24.643 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:24.635+0000 7f56ddd9b640 1 -- 172.21.15.78:0/3781885903 >> v1:172.21.15.179:6789/0 conn(0x7f56e006c100 legacy=0x7f56e015ee20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:24.643 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:24.635+0000 7f56ddd9b640 1 -- 172.21.15.78:0/3781885903 --> v1:172.21.15.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56e00c4b30 con 0x7f56e00c67d0 2023-11-28T19:59:24.643 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:24.635+0000 7f56ddd9b640 1 -- 172.21.15.78:0/3781885903 <== mon.0 v1:172.21.15.78:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3326804700 0 0) 0x7f56c8001a00 con 0x7f56e00c67d0 2023-11-28T19:59:24.643 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:24.635+0000 7f56ddd9b640 1 -- 172.21.15.78:0/3781885903 >> v1:172.21.15.78:6789/0 conn(0x7f56e00c67d0 legacy=0x7f56e006b9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:24.643 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:24.635+0000 7f56ddd9b640 1 --2- 172.21.15.78:0/3781885903 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f56cc003980 0x7f56cc003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:24.644 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:24.635+0000 7f56ddd9b640 1 --2- 172.21.15.78:0/3781885903 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f56cc0047d0 0x7f56cc004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:24.644 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:24.635+0000 7f56ddd9b640 1 --2- 172.21.15.78:0/3781885903 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f56cc005190 0x7f56cc00b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:24.644 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:24.635+0000 7f56ddd9b640 1 -- 172.21.15.78:0/3781885903 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56e0155460 con 0x7f56cc005190 2023-11-28T19:59:24.644 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:24.635+0000 7f56ddd9b640 1 -- 172.21.15.78:0/3781885903 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56cc00c130 con 0x7f56cc003980 2023-11-28T19:59:24.644 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:24.635+0000 7f56ddd9b640 1 -- 172.21.15.78:0/3781885903 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f56cc00c2f0 con 0x7f56cc0047d0 2023-11-28T19:59:24.644 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:24.635+0000 7f56ded9d640 1 --2- 172.21.15.78:0/3781885903 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f56cc005190 0x7f56cc00b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:24.644 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:24.635+0000 7f56de59c640 1 --2- 172.21.15.78:0/3781885903 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f56cc003980 0x7f56cc003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:24.644 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:24.635+0000 7f56d5d9b640 1 --2- 172.21.15.78:0/3781885903 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f56cc0047d0 0x7f56cc004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:24.644 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:24.635+0000 7f56ded9d640 1 -- 172.21.15.78:0/3781885903 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f56cc0047d0 msgr2=0x7f56cc004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T19:59:24.644 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:24.635+0000 7f56ded9d640 1 --2- 172.21.15.78:0/3781885903 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f56cc0047d0 0x7f56cc004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:24.645 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:24.635+0000 7f56ded9d640 1 -- 172.21.15.78:0/3781885903 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f56cc003980 msgr2=0x7f56cc003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T19:59:24.645 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:24.635+0000 7f56ded9d640 1 --2- 172.21.15.78:0/3781885903 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f56cc003980 0x7f56cc003da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:24.645 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:24.635+0000 7f56ded9d640 1 -- 172.21.15.78:0/3781885903 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56cc003530 con 0x7f56cc005190 2023-11-28T19:59:24.646 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:24.639+0000 7f56ded9d640 1 -- 172.21.15.78:0/3781885903 reap_dead start 2023-11-28T19:59:24.646 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:24.639+0000 7f56ded9d640 1 --2- 172.21.15.78:0/3781885903 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f56cc005190 0x7f56cc00b990 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f56d8001780 tx=0x7f56d801c400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b5b6b351049699f server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:59:24.646 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:24.639+0000 7f56ddd9b640 1 -- 172.21.15.78:0/3781885903 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56d80052d0 con 0x7f56cc005190 2023-11-28T19:59:24.647 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:24.639+0000 7f56ddd9b640 1 -- 172.21.15.78:0/3781885903 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f56d80a7050 con 0x7f56cc005190 2023-11-28T19:59:24.647 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:24.639+0000 7f56ddd9b640 1 -- 172.21.15.78:0/3781885903 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56d8003840 con 0x7f56cc005190 2023-11-28T19:59:24.647 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:24.639+0000 7f56e4cfe640 1 -- 172.21.15.78:0/3781885903 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f56cc005190 msgr2=0x7f56cc00b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:24.647 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:24.639+0000 7f56e4cfe640 1 --2- 172.21.15.78:0/3781885903 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f56cc005190 0x7f56cc00b990 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f56d8001780 tx=0x7f56d801c400 comp rx=0 tx=0).stop 2023-11-28T19:59:24.647 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:24.639+0000 7f56e4cfe640 1 -- 172.21.15.78:0/3781885903 shutdown_connections 2023-11-28T19:59:24.647 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:24.639+0000 7f56e4cfe640 1 --2- 172.21.15.78:0/3781885903 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f56cc005190 0x7f56cc00b990 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:24.647 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:24.639+0000 7f56e4cfe640 1 -- 172.21.15.78:0/3781885903 >> 172.21.15.78:0/3781885903 conn(0x7f56e00ab9d0 msgr2=0x7f56e00abde0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T19:59:24.647 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:24.639+0000 7f56e4cfe640 1 -- 172.21.15.78:0/3781885903 shutdown_connections 2023-11-28T19:59:24.647 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:24.639+0000 7f56e4cfe640 1 -- 172.21.15.78:0/3781885903 wait complete. 2023-11-28T19:59:24.650 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:24.643+0000 7f56e4cfe640 1 Processor -- start 2023-11-28T19:59:24.650 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:24.643+0000 7f56e4cfe640 1 -- start start 2023-11-28T19:59:24.650 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:24.643+0000 7f56e4cfe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f56cc005190 0x7f56e00ca7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:24.650 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:24.643+0000 7f56e4cfe640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f56e00c0eb0 0x7f56e00add70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:24.650 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:24.643+0000 7f56e4cfe640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f56e01ea9a0 0x7f56e00c18f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:24.650 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:24.643+0000 7f56e4cfe640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56e0146f30 con 0x7f56cc005190 2023-11-28T19:59:24.650 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:24.643+0000 7f56e4cfe640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56e00c1330 con 0x7f56e00c0eb0 2023-11-28T19:59:24.650 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:24.643+0000 7f56e4cfe640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f56e01ea510 con 0x7f56e01ea9a0 2023-11-28T19:59:24.650 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:24.643+0000 7f56de59c640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f56cc005190 0x7f56e00ca7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:24.650 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:24.643+0000 7f56de59c640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f56cc005190 0x7f56e00ca7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:60608/0 (socket says 172.21.15.78:60608) 2023-11-28T19:59:24.651 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:24.643+0000 7f56de59c640 1 -- 172.21.15.78:0/2044258241 learned_addr learned my addr 172.21.15.78:0/2044258241 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T19:59:24.651 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:24.643+0000 7f56d5d9b640 1 --2- 172.21.15.78:0/2044258241 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f56e00c0eb0 0x7f56e00add70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:24.651 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:24.643+0000 7f56de59c640 1 -- 172.21.15.78:0/2044258241 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f56e01ea9a0 msgr2=0x7f56e00c18f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:24.651 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:24.643+0000 7f56ded9d640 1 --2- 172.21.15.78:0/2044258241 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f56e01ea9a0 0x7f56e00c18f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:24.651 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:24.643+0000 7f56de59c640 1 --2- 172.21.15.78:0/2044258241 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f56e01ea9a0 0x7f56e00c18f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:24.651 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:24.643+0000 7f56de59c640 1 -- 172.21.15.78:0/2044258241 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f56e00c0eb0 msgr2=0x7f56e00add70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:24.651 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:24.643+0000 7f56de59c640 1 --2- 172.21.15.78:0/2044258241 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f56e00c0eb0 0x7f56e00add70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:24.651 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:24.643+0000 7f56de59c640 1 -- 172.21.15.78:0/2044258241 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56e00ca180 con 0x7f56cc005190 2023-11-28T19:59:24.651 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:24.643+0000 7f56d5d9b640 1 --2- 172.21.15.78:0/2044258241 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f56e00c0eb0 0x7f56e00add70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T19:59:24.651 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:24.643+0000 7f56ded9d640 1 --2- 172.21.15.78:0/2044258241 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f56e01ea9a0 0x7f56e00c18f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T19:59:24.651 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:24.643+0000 7f56de59c640 1 --2- 172.21.15.78:0/2044258241 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f56cc005190 0x7f56e00ca7d0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f56d0011990 tx=0x7f56d0011e50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:59:24.652 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:24.643+0000 7f56d77fe640 1 -- 172.21.15.78:0/2044258241 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56d000fa10 con 0x7f56cc005190 2023-11-28T19:59:24.652 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:24.643+0000 7f56d77fe640 1 -- 172.21.15.78:0/2044258241 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f56d000fb70 con 0x7f56cc005190 2023-11-28T19:59:24.652 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:24.643+0000 7f56d77fe640 1 -- 172.21.15.78:0/2044258241 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56d0014440 con 0x7f56cc005190 2023-11-28T19:59:24.652 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:24.643+0000 7f56e4cfe640 1 -- 172.21.15.78:0/2044258241 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f56e00c3680 con 0x7f56cc005190 2023-11-28T19:59:24.652 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:24.643+0000 7f56e4cfe640 1 -- 172.21.15.78:0/2044258241 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f56e01ea1a0 con 0x7f56cc005190 2023-11-28T19:59:24.653 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:24.643+0000 7f56e4cfe640 1 -- 172.21.15.78:0/2044258241 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f56e0067630 con 0x7f56cc005190 2023-11-28T19:59:24.653 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:24.647+0000 7f56d77fe640 1 -- 172.21.15.78:0/2044258241 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f56d00145a0 con 0x7f56cc005190 2023-11-28T19:59:24.653 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:24.647+0000 7f56d77fe640 1 --2- 172.21.15.78:0/2044258241 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f56c00664a0 0x7f56c0068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:24.653 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:24.647+0000 7f56d77fe640 1 -- 172.21.15.78:0/2044258241 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f56d00849b0 con 0x7f56cc005190 2023-11-28T19:59:24.653 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:24.647+0000 7f56d5d9b640 1 --2- 172.21.15.78:0/2044258241 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f56c00664a0 0x7f56c0068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:24.653 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:24.647+0000 7f56d5d9b640 1 --2- 172.21.15.78:0/2044258241 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f56c00664a0 0x7f56c0068960 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f56c80013e0 tx=0x7f56c80014e0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:59:24.656 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:24.651+0000 7f56d77fe640 1 -- 172.21.15.78:0/2044258241 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f56d0051aa0 con 0x7f56cc005190 2023-11-28T19:59:24.806 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:24.799+0000 7f56e4cfe640 1 -- 172.21.15.78:0/2044258241 --> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f56e006b4d0 con 0x7f56c00664a0 2023-11-28T19:59:24.817 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:24.811+0000 7f56d77fe640 1 -- 172.21.15.78:0/2044258241 <== mgr.4106 v2:172.21.15.78:6832/2935380957 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+345346 (secure 0 0 0) 0x7f56c8007ae0 con 0x7f56c00664a0 2023-11-28T19:59:24.819 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-11-28T19:59:24.823 INFO:teuthology.orchestra.run.smithi078.stderr:dumped all 2023-11-28T19:59:24.825 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:24.815+0000 7f56e4cfe640 1 -- 172.21.15.78:0/2044258241 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f56c00664a0 msgr2=0x7f56c0068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:24.825 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:24.815+0000 7f56e4cfe640 1 --2- 172.21.15.78:0/2044258241 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f56c00664a0 0x7f56c0068960 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f56c80013e0 tx=0x7f56c80014e0 comp rx=0 tx=0).stop 2023-11-28T19:59:24.825 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:24.815+0000 7f56e4cfe640 1 -- 172.21.15.78:0/2044258241 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f56cc005190 msgr2=0x7f56e00ca7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:24.825 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:24.815+0000 7f56e4cfe640 1 --2- 172.21.15.78:0/2044258241 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f56cc005190 0x7f56e00ca7d0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f56d0011990 tx=0x7f56d0011e50 comp rx=0 tx=0).stop 2023-11-28T19:59:24.825 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:24.815+0000 7f56e4cfe640 1 -- 172.21.15.78:0/2044258241 shutdown_connections 2023-11-28T19:59:24.825 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:24.815+0000 7f56e4cfe640 1 --2- 172.21.15.78:0/2044258241 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f56c00664a0 0x7f56c0068960 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:24.825 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:24.815+0000 7f56e4cfe640 1 --2- 172.21.15.78:0/2044258241 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f56e01ea9a0 0x7f56e00c18f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:24.826 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:24.815+0000 7f56e4cfe640 1 --2- 172.21.15.78:0/2044258241 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f56e00c0eb0 0x7f56e00add70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:24.826 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:24.815+0000 7f56e4cfe640 1 --2- 172.21.15.78:0/2044258241 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f56cc005190 0x7f56e00ca7d0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:24.826 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:24.815+0000 7f56e4cfe640 1 -- 172.21.15.78:0/2044258241 >> 172.21.15.78:0/2044258241 conn(0x7f56e00ab9d0 msgr2=0x7f56e00a9c10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T19:59:24.826 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:24.815+0000 7f56e4cfe640 1 -- 172.21.15.78:0/2044258241 shutdown_connections 2023-11-28T19:59:24.826 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:24.815+0000 7f56e4cfe640 1 -- 172.21.15.78:0/2044258241 wait complete. 2023-11-28T19:59:24.841 INFO:teuthology.orchestra.run.smithi078.stdout:{"pg_ready":true,"pg_map":{"version":34,"stamp":"2023-11-28T19:59:23.957066+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595007,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":207,"num_write_kb":2434,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":159,"ondisk_log_size":159,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":218464,"kb_used_data":2272,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754756256,"statfs":{"total":773094113280,"available":772870406144,"internally_reserved":0,"allocated":2326528,"data_stored":2025718,"data_compressed":66748,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2229,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002643"},"pg_stats":[{"pgid":"2.1f","version":"20'4","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T19:59:10.106180+0000","last_change":"2023-11-28T19:59:05.052960+0000","last_active":"2023-11-28T19:59:10.106180+0000","last_peered":"2023-11-28T19:59:10.106180+0000","last_clean":"2023-11-28T19:59:10.106180+0000","last_became_active":"2023-11-28T19:59:05.052657+0000","last_became_peered":"2023-11-28T19:59:05.052657+0000","last_unstale":"2023-11-28T19:59:10.106180+0000","last_undegraded":"2023-11-28T19:59:10.106180+0000","last_fullsized":"2023-11-28T19:59:10.106180+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:59:04.008158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:59:04.008158+0000","last_clean_scrub_stamp":"2023-11-28T19:59:04.008158+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:54:59.131019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T19:59:10.086896+0000","last_change":"2023-11-28T19:59:05.769584+0000","last_active":"2023-11-28T19:59:10.086896+0000","last_peered":"2023-11-28T19:59:10.086896+0000","last_clean":"2023-11-28T19:59:10.086896+0000","last_became_active":"2023-11-28T19:59:05.769323+0000","last_became_peered":"2023-11-28T19:59:05.769323+0000","last_unstale":"2023-11-28T19:59:10.086896+0000","last_undegraded":"2023-11-28T19:59:10.086896+0000","last_fullsized":"2023-11-28T19:59:10.086896+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:59:05.015714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:59:05.015714+0000","last_clean_scrub_stamp":"2023-11-28T19:59:05.015714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:37:45.006198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T19:59:10.748258+0000","last_change":"2023-11-28T19:59:10.237008+0000","last_active":"2023-11-28T19:59:10.748258+0000","last_peered":"2023-11-28T19:59:10.748258+0000","last_clean":"2023-11-28T19:59:10.748258+0000","last_became_active":"2023-11-28T19:59:10.236605+0000","last_became_peered":"2023-11-28T19:59:10.236605+0000","last_unstale":"2023-11-28T19:59:10.748258+0000","last_undegraded":"2023-11-28T19:59:10.748258+0000","last_fullsized":"2023-11-28T19:59:10.748258+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:59:09.059796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:59:09.059796+0000","last_clean_scrub_stamp":"2023-11-28T19:59:09.059796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T06:47:20.838966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"20'1","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T19:59:10.086983+0000","last_change":"2023-11-28T19:59:05.045307+0000","last_active":"2023-11-28T19:59:10.086983+0000","last_peered":"2023-11-28T19:59:10.086983+0000","last_clean":"2023-11-28T19:59:10.086983+0000","last_became_active":"2023-11-28T19:59:05.044997+0000","last_became_peered":"2023-11-28T19:59:05.044997+0000","last_unstale":"2023-11-28T19:59:10.086983+0000","last_undegraded":"2023-11-28T19:59:10.086983+0000","last_fullsized":"2023-11-28T19:59:10.086983+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:59:04.008158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:59:04.008158+0000","last_clean_scrub_stamp":"2023-11-28T19:59:04.008158+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T06:35:58.085712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T19:59:10.106013+0000","last_change":"2023-11-28T19:59:05.781411+0000","last_active":"2023-11-28T19:59:10.106013+0000","last_peered":"2023-11-28T19:59:10.106013+0000","last_clean":"2023-11-28T19:59:10.106013+0000","last_became_active":"2023-11-28T19:59:05.781197+0000","last_became_peered":"2023-11-28T19:59:05.781197+0000","last_unstale":"2023-11-28T19:59:10.106013+0000","last_undegraded":"2023-11-28T19:59:10.106013+0000","last_fullsized":"2023-11-28T19:59:10.106013+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:59:05.015714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:59:05.015714+0000","last_clean_scrub_stamp":"2023-11-28T19:59:05.015714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T06:26:55.424441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T19:59:10.750326+0000","last_change":"2023-11-28T19:59:10.118362+0000","last_active":"2023-11-28T19:59:10.750326+0000","last_peered":"2023-11-28T19:59:10.750326+0000","last_clean":"2023-11-28T19:59:10.750326+0000","last_became_active":"2023-11-28T19:59:10.117821+0000","last_became_peered":"2023-11-28T19:59:10.117821+0000","last_unstale":"2023-11-28T19:59:10.750326+0000","last_undegraded":"2023-11-28T19:59:10.750326+0000","last_fullsized":"2023-11-28T19:59:10.750326+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:59:09.059796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:59:09.059796+0000","last_clean_scrub_stamp":"2023-11-28T19:59:09.059796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:05:07.732273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"20'2","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T19:59:10.231816+0000","last_change":"2023-11-28T19:59:05.058010+0000","last_active":"2023-11-28T19:59:10.231816+0000","last_peered":"2023-11-28T19:59:10.231816+0000","last_clean":"2023-11-28T19:59:10.231816+0000","last_became_active":"2023-11-28T19:59:05.055487+0000","last_became_peered":"2023-11-28T19:59:05.055487+0000","last_unstale":"2023-11-28T19:59:10.231816+0000","last_undegraded":"2023-11-28T19:59:10.231816+0000","last_fullsized":"2023-11-28T19:59:10.231816+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:59:04.008158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:59:04.008158+0000","last_clean_scrub_stamp":"2023-11-28T19:59:04.008158+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:44:01.094524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T19:59:10.087933+0000","last_change":"2023-11-28T19:59:05.779496+0000","last_active":"2023-11-28T19:59:10.087933+0000","last_peered":"2023-11-28T19:59:10.087933+0000","last_clean":"2023-11-28T19:59:10.087933+0000","last_became_active":"2023-11-28T19:59:05.777976+0000","last_became_peered":"2023-11-28T19:59:05.777976+0000","last_unstale":"2023-11-28T19:59:10.087933+0000","last_undegraded":"2023-11-28T19:59:10.087933+0000","last_fullsized":"2023-11-28T19:59:10.087933+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:59:05.015714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:59:05.015714+0000","last_clean_scrub_stamp":"2023-11-28T19:59:05.015714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:43:15.986749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T19:59:10.751202+0000","last_change":"2023-11-28T19:59:10.119257+0000","last_active":"2023-11-28T19:59:10.751202+0000","last_peered":"2023-11-28T19:59:10.751202+0000","last_clean":"2023-11-28T19:59:10.751202+0000","last_became_active":"2023-11-28T19:59:10.118744+0000","last_became_peered":"2023-11-28T19:59:10.118744+0000","last_unstale":"2023-11-28T19:59:10.751202+0000","last_undegraded":"2023-11-28T19:59:10.751202+0000","last_fullsized":"2023-11-28T19:59:10.751202+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:59:09.059796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:59:09.059796+0000","last_clean_scrub_stamp":"2023-11-28T19:59:09.059796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:04:08.552896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"20'2","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T19:59:10.231591+0000","last_change":"2023-11-28T19:59:05.054063+0000","last_active":"2023-11-28T19:59:10.231591+0000","last_peered":"2023-11-28T19:59:10.231591+0000","last_clean":"2023-11-28T19:59:10.231591+0000","last_became_active":"2023-11-28T19:59:05.053212+0000","last_became_peered":"2023-11-28T19:59:05.053212+0000","last_unstale":"2023-11-28T19:59:10.231591+0000","last_undegraded":"2023-11-28T19:59:10.231591+0000","last_fullsized":"2023-11-28T19:59:10.231591+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:59:04.008158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:59:04.008158+0000","last_clean_scrub_stamp":"2023-11-28T19:59:04.008158+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:50:57.704628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T19:59:10.086946+0000","last_change":"2023-11-28T19:59:05.779167+0000","last_active":"2023-11-28T19:59:10.086946+0000","last_peered":"2023-11-28T19:59:10.086946+0000","last_clean":"2023-11-28T19:59:10.086946+0000","last_became_active":"2023-11-28T19:59:05.778874+0000","last_became_peered":"2023-11-28T19:59:05.778874+0000","last_unstale":"2023-11-28T19:59:10.086946+0000","last_undegraded":"2023-11-28T19:59:10.086946+0000","last_fullsized":"2023-11-28T19:59:10.086946+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:59:05.015714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:59:05.015714+0000","last_clean_scrub_stamp":"2023-11-28T19:59:05.015714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:59:15.117552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T19:59:10.750952+0000","last_change":"2023-11-28T19:59:10.104844+0000","last_active":"2023-11-28T19:59:10.750952+0000","last_peered":"2023-11-28T19:59:10.750952+0000","last_clean":"2023-11-28T19:59:10.750952+0000","last_became_active":"2023-11-28T19:59:10.104381+0000","last_became_peered":"2023-11-28T19:59:10.104381+0000","last_unstale":"2023-11-28T19:59:10.750952+0000","last_undegraded":"2023-11-28T19:59:10.750952+0000","last_fullsized":"2023-11-28T19:59:10.750952+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:59:09.059796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:59:09.059796+0000","last_clean_scrub_stamp":"2023-11-28T19:59:09.059796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:21:25.563488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T19:59:10.096108+0000","last_change":"2023-11-28T19:59:05.777551+0000","last_active":"2023-11-28T19:59:10.096108+0000","last_peered":"2023-11-28T19:59:10.096108+0000","last_clean":"2023-11-28T19:59:10.096108+0000","last_became_active":"2023-11-28T19:59:05.777205+0000","last_became_peered":"2023-11-28T19:59:05.777205+0000","last_unstale":"2023-11-28T19:59:10.096108+0000","last_undegraded":"2023-11-28T19:59:10.096108+0000","last_fullsized":"2023-11-28T19:59:10.096108+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:59:05.015714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:59:05.015714+0000","last_clean_scrub_stamp":"2023-11-28T19:59:05.015714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:34:41.640833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"20'2","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T19:59:10.231766+0000","last_change":"2023-11-28T19:59:05.059530+0000","last_active":"2023-11-28T19:59:10.231766+0000","last_peered":"2023-11-28T19:59:10.231766+0000","last_clean":"2023-11-28T19:59:10.231766+0000","last_became_active":"2023-11-28T19:59:05.059170+0000","last_became_peered":"2023-11-28T19:59:05.059170+0000","last_unstale":"2023-11-28T19:59:10.231766+0000","last_undegraded":"2023-11-28T19:59:10.231766+0000","last_fullsized":"2023-11-28T19:59:10.231766+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:59:04.008158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:59:04.008158+0000","last_clean_scrub_stamp":"2023-11-28T19:59:04.008158+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:59:05.695936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T19:59:10.751627+0000","last_change":"2023-11-28T19:59:10.107622+0000","last_active":"2023-11-28T19:59:10.751627+0000","last_peered":"2023-11-28T19:59:10.751627+0000","last_clean":"2023-11-28T19:59:10.751627+0000","last_became_active":"2023-11-28T19:59:10.107067+0000","last_became_peered":"2023-11-28T19:59:10.107067+0000","last_unstale":"2023-11-28T19:59:10.751627+0000","last_undegraded":"2023-11-28T19:59:10.751627+0000","last_fullsized":"2023-11-28T19:59:10.751627+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:59:09.059796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:59:09.059796+0000","last_clean_scrub_stamp":"2023-11-28T19:59:09.059796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:43:20.030831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T19:59:10.085907+0000","last_change":"2023-11-28T19:59:05.770916+0000","last_active":"2023-11-28T19:59:10.085907+0000","last_peered":"2023-11-28T19:59:10.085907+0000","last_clean":"2023-11-28T19:59:10.085907+0000","last_became_active":"2023-11-28T19:59:05.770356+0000","last_became_peered":"2023-11-28T19:59:05.770356+0000","last_unstale":"2023-11-28T19:59:10.085907+0000","last_undegraded":"2023-11-28T19:59:10.085907+0000","last_fullsized":"2023-11-28T19:59:10.085907+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:59:05.015714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:59:05.015714+0000","last_clean_scrub_stamp":"2023-11-28T19:59:05.015714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:05:03.688191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T19:59:10.100383+0000","last_change":"2023-11-28T19:59:05.047719+0000","last_active":"2023-11-28T19:59:10.100383+0000","last_peered":"2023-11-28T19:59:10.100383+0000","last_clean":"2023-11-28T19:59:10.100383+0000","last_became_active":"2023-11-28T19:59:05.047441+0000","last_became_peered":"2023-11-28T19:59:05.047441+0000","last_unstale":"2023-11-28T19:59:10.100383+0000","last_undegraded":"2023-11-28T19:59:10.100383+0000","last_fullsized":"2023-11-28T19:59:10.100383+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:59:04.008158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:59:04.008158+0000","last_clean_scrub_stamp":"2023-11-28T19:59:04.008158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:24:13.851530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T19:59:10.751634+0000","last_change":"2023-11-28T19:59:10.118258+0000","last_active":"2023-11-28T19:59:10.751634+0000","last_peered":"2023-11-28T19:59:10.751634+0000","last_clean":"2023-11-28T19:59:10.751634+0000","last_became_active":"2023-11-28T19:59:10.117812+0000","last_became_peered":"2023-11-28T19:59:10.117812+0000","last_unstale":"2023-11-28T19:59:10.751634+0000","last_undegraded":"2023-11-28T19:59:10.751634+0000","last_fullsized":"2023-11-28T19:59:10.751634+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:59:09.059796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:59:09.059796+0000","last_clean_scrub_stamp":"2023-11-28T19:59:09.059796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:04:22.608590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T19:59:10.086832+0000","last_change":"2023-11-28T19:59:05.767529+0000","last_active":"2023-11-28T19:59:10.086832+0000","last_peered":"2023-11-28T19:59:10.086832+0000","last_clean":"2023-11-28T19:59:10.086832+0000","last_became_active":"2023-11-28T19:59:05.767237+0000","last_became_peered":"2023-11-28T19:59:05.767237+0000","last_unstale":"2023-11-28T19:59:10.086832+0000","last_undegraded":"2023-11-28T19:59:10.086832+0000","last_fullsized":"2023-11-28T19:59:10.086832+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:59:05.015714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:59:05.015714+0000","last_clean_scrub_stamp":"2023-11-28T19:59:05.015714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:34:41.640833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T19:59:10.098640+0000","last_change":"2023-11-28T19:59:05.053041+0000","last_active":"2023-11-28T19:59:10.098640+0000","last_peered":"2023-11-28T19:59:10.098640+0000","last_clean":"2023-11-28T19:59:10.098640+0000","last_became_active":"2023-11-28T19:59:05.052673+0000","last_became_peered":"2023-11-28T19:59:05.052673+0000","last_unstale":"2023-11-28T19:59:10.098640+0000","last_undegraded":"2023-11-28T19:59:10.098640+0000","last_fullsized":"2023-11-28T19:59:10.098640+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:59:04.008158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:59:04.008158+0000","last_clean_scrub_stamp":"2023-11-28T19:59:04.008158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:50:57.704628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T19:59:10.893246+0000","last_change":"2023-11-28T19:59:10.238462+0000","last_active":"2023-11-28T19:59:10.893246+0000","last_peered":"2023-11-28T19:59:10.893246+0000","last_clean":"2023-11-28T19:59:10.893246+0000","last_became_active":"2023-11-28T19:59:10.237988+0000","last_became_peered":"2023-11-28T19:59:10.237988+0000","last_unstale":"2023-11-28T19:59:10.893246+0000","last_undegraded":"2023-11-28T19:59:10.893246+0000","last_fullsized":"2023-11-28T19:59:10.893246+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:59:09.059796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:59:09.059796+0000","last_clean_scrub_stamp":"2023-11-28T19:59:09.059796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:09:44.374501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T19:59:10.085913+0000","last_change":"2023-11-28T19:59:05.766196+0000","last_active":"2023-11-28T19:59:10.085913+0000","last_peered":"2023-11-28T19:59:10.085913+0000","last_clean":"2023-11-28T19:59:10.085913+0000","last_became_active":"2023-11-28T19:59:05.765432+0000","last_became_peered":"2023-11-28T19:59:05.765432+0000","last_unstale":"2023-11-28T19:59:10.085913+0000","last_undegraded":"2023-11-28T19:59:10.085913+0000","last_fullsized":"2023-11-28T19:59:10.085913+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:59:05.015714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:59:05.015714+0000","last_clean_scrub_stamp":"2023-11-28T19:59:05.015714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T07:38:27.535482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T19:59:10.231396+0000","last_change":"2023-11-28T19:59:05.057961+0000","last_active":"2023-11-28T19:59:10.231396+0000","last_peered":"2023-11-28T19:59:10.231396+0000","last_clean":"2023-11-28T19:59:10.231396+0000","last_became_active":"2023-11-28T19:59:05.054572+0000","last_became_peered":"2023-11-28T19:59:05.054572+0000","last_unstale":"2023-11-28T19:59:10.231396+0000","last_undegraded":"2023-11-28T19:59:10.231396+0000","last_fullsized":"2023-11-28T19:59:10.231396+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:59:04.008158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:59:04.008158+0000","last_clean_scrub_stamp":"2023-11-28T19:59:04.008158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:55:39.803978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T19:59:10.751124+0000","last_change":"2023-11-28T19:59:10.110793+0000","last_active":"2023-11-28T19:59:10.751124+0000","last_peered":"2023-11-28T19:59:10.751124+0000","last_clean":"2023-11-28T19:59:10.751124+0000","last_became_active":"2023-11-28T19:59:10.110217+0000","last_became_peered":"2023-11-28T19:59:10.110217+0000","last_unstale":"2023-11-28T19:59:10.751124+0000","last_undegraded":"2023-11-28T19:59:10.751124+0000","last_fullsized":"2023-11-28T19:59:10.751124+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:59:09.059796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:59:09.059796+0000","last_clean_scrub_stamp":"2023-11-28T19:59:09.059796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:13:25.677482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T19:59:10.105874+0000","last_change":"2023-11-28T19:59:05.766438+0000","last_active":"2023-11-28T19:59:10.105874+0000","last_peered":"2023-11-28T19:59:10.105874+0000","last_clean":"2023-11-28T19:59:10.105874+0000","last_became_active":"2023-11-28T19:59:05.766122+0000","last_became_peered":"2023-11-28T19:59:05.766122+0000","last_unstale":"2023-11-28T19:59:10.105874+0000","last_undegraded":"2023-11-28T19:59:10.105874+0000","last_fullsized":"2023-11-28T19:59:10.105874+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:59:05.015714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:59:05.015714+0000","last_clean_scrub_stamp":"2023-11-28T19:59:05.015714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:34:41.640833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"20'2","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T19:59:10.097521+0000","last_change":"2023-11-28T19:59:05.051854+0000","last_active":"2023-11-28T19:59:10.097521+0000","last_peered":"2023-11-28T19:59:10.097521+0000","last_clean":"2023-11-28T19:59:10.097521+0000","last_became_active":"2023-11-28T19:59:05.051577+0000","last_became_peered":"2023-11-28T19:59:05.051577+0000","last_unstale":"2023-11-28T19:59:10.097521+0000","last_undegraded":"2023-11-28T19:59:10.097521+0000","last_fullsized":"2023-11-28T19:59:10.097521+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:59:04.008158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:59:04.008158+0000","last_clean_scrub_stamp":"2023-11-28T19:59:04.008158+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:18:36.601049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T19:59:10.750635+0000","last_change":"2023-11-28T19:59:10.233198+0000","last_active":"2023-11-28T19:59:10.750635+0000","last_peered":"2023-11-28T19:59:10.750635+0000","last_clean":"2023-11-28T19:59:10.750635+0000","last_became_active":"2023-11-28T19:59:10.232788+0000","last_became_peered":"2023-11-28T19:59:10.232788+0000","last_unstale":"2023-11-28T19:59:10.750635+0000","last_undegraded":"2023-11-28T19:59:10.750635+0000","last_fullsized":"2023-11-28T19:59:10.750635+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:59:09.059796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:59:09.059796+0000","last_clean_scrub_stamp":"2023-11-28T19:59:09.059796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:37:49.050280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T19:59:10.092085+0000","last_change":"2023-11-28T19:59:05.765916+0000","last_active":"2023-11-28T19:59:10.092085+0000","last_peered":"2023-11-28T19:59:10.092085+0000","last_clean":"2023-11-28T19:59:10.092085+0000","last_became_active":"2023-11-28T19:59:05.765601+0000","last_became_peered":"2023-11-28T19:59:05.765601+0000","last_unstale":"2023-11-28T19:59:10.092085+0000","last_undegraded":"2023-11-28T19:59:10.092085+0000","last_fullsized":"2023-11-28T19:59:10.092085+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:59:05.015714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:59:05.015714+0000","last_clean_scrub_stamp":"2023-11-28T19:59:05.015714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:13:21.633400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"23'1","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T19:59:10.099470+0000","last_change":"2023-11-28T19:59:05.043611+0000","last_active":"2023-11-28T19:59:10.099470+0000","last_peered":"2023-11-28T19:59:10.099470+0000","last_clean":"2023-11-28T19:59:10.099470+0000","last_became_active":"2023-11-28T19:59:05.043302+0000","last_became_peered":"2023-11-28T19:59:05.043302+0000","last_unstale":"2023-11-28T19:59:10.099470+0000","last_undegraded":"2023-11-28T19:59:10.099470+0000","last_fullsized":"2023-11-28T19:59:10.099470+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:59:04.008158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:59:04.008158+0000","last_clean_scrub_stamp":"2023-11-28T19:59:04.008158+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:24:47.265269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T19:59:10.748068+0000","last_change":"2023-11-28T19:59:10.233040+0000","last_active":"2023-11-28T19:59:10.748068+0000","last_peered":"2023-11-28T19:59:10.748068+0000","last_clean":"2023-11-28T19:59:10.748068+0000","last_became_active":"2023-11-28T19:59:10.232226+0000","last_became_peered":"2023-11-28T19:59:10.232226+0000","last_unstale":"2023-11-28T19:59:10.748068+0000","last_undegraded":"2023-11-28T19:59:10.748068+0000","last_fullsized":"2023-11-28T19:59:10.748068+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:59:09.059796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:59:09.059796+0000","last_clean_scrub_stamp":"2023-11-28T19:59:09.059796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:08:16.809984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T19:59:10.098944+0000","last_change":"2023-11-28T19:59:05.756970+0000","last_active":"2023-11-28T19:59:10.098944+0000","last_peered":"2023-11-28T19:59:10.098944+0000","last_clean":"2023-11-28T19:59:10.098944+0000","last_became_active":"2023-11-28T19:59:05.756706+0000","last_became_peered":"2023-11-28T19:59:05.756706+0000","last_unstale":"2023-11-28T19:59:10.098944+0000","last_undegraded":"2023-11-28T19:59:10.098944+0000","last_fullsized":"2023-11-28T19:59:10.098944+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:59:05.015714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:59:05.015714+0000","last_clean_scrub_stamp":"2023-11-28T19:59:05.015714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T06:26:55.424441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T19:59:10.231897+0000","last_change":"2023-11-28T19:59:05.058655+0000","last_active":"2023-11-28T19:59:10.231897+0000","last_peered":"2023-11-28T19:59:10.231897+0000","last_clean":"2023-11-28T19:59:10.231897+0000","last_became_active":"2023-11-28T19:59:05.058338+0000","last_became_peered":"2023-11-28T19:59:05.058338+0000","last_unstale":"2023-11-28T19:59:10.231897+0000","last_undegraded":"2023-11-28T19:59:10.231897+0000","last_fullsized":"2023-11-28T19:59:10.231897+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:59:04.008158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:59:04.008158+0000","last_clean_scrub_stamp":"2023-11-28T19:59:04.008158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:39:43.991385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T19:59:10.892006+0000","last_change":"2023-11-28T19:59:10.234696+0000","last_active":"2023-11-28T19:59:10.892006+0000","last_peered":"2023-11-28T19:59:10.892006+0000","last_clean":"2023-11-28T19:59:10.892006+0000","last_became_active":"2023-11-28T19:59:10.234219+0000","last_became_peered":"2023-11-28T19:59:10.234219+0000","last_unstale":"2023-11-28T19:59:10.892006+0000","last_undegraded":"2023-11-28T19:59:10.892006+0000","last_fullsized":"2023-11-28T19:59:10.892006+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:59:09.059796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:59:09.059796+0000","last_clean_scrub_stamp":"2023-11-28T19:59:09.059796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:04:22.608590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T19:59:10.086968+0000","last_change":"2023-11-28T19:59:05.773876+0000","last_active":"2023-11-28T19:59:10.086968+0000","last_peered":"2023-11-28T19:59:10.086968+0000","last_clean":"2023-11-28T19:59:10.086968+0000","last_became_active":"2023-11-28T19:59:05.773097+0000","last_became_peered":"2023-11-28T19:59:05.773097+0000","last_unstale":"2023-11-28T19:59:10.086968+0000","last_undegraded":"2023-11-28T19:59:10.086968+0000","last_fullsized":"2023-11-28T19:59:10.086968+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:59:05.015714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:59:05.015714+0000","last_clean_scrub_stamp":"2023-11-28T19:59:05.015714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:09:40.330419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T19:59:10.099027+0000","last_change":"2023-11-28T19:59:05.045257+0000","last_active":"2023-11-28T19:59:10.099027+0000","last_peered":"2023-11-28T19:59:10.099027+0000","last_clean":"2023-11-28T19:59:10.099027+0000","last_became_active":"2023-11-28T19:59:05.037691+0000","last_became_peered":"2023-11-28T19:59:05.037691+0000","last_unstale":"2023-11-28T19:59:10.099027+0000","last_undegraded":"2023-11-28T19:59:10.099027+0000","last_fullsized":"2023-11-28T19:59:10.099027+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:59:04.008158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:59:04.008158+0000","last_clean_scrub_stamp":"2023-11-28T19:59:04.008158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:44:01.094524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T19:59:10.892407+0000","last_change":"2023-11-28T19:59:10.110882+0000","last_active":"2023-11-28T19:59:10.892407+0000","last_peered":"2023-11-28T19:59:10.892407+0000","last_clean":"2023-11-28T19:59:10.892407+0000","last_became_active":"2023-11-28T19:59:10.110154+0000","last_became_peered":"2023-11-28T19:59:10.110154+0000","last_unstale":"2023-11-28T19:59:10.892407+0000","last_undegraded":"2023-11-28T19:59:10.892407+0000","last_fullsized":"2023-11-28T19:59:10.892407+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:59:09.059796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:59:09.059796+0000","last_clean_scrub_stamp":"2023-11-28T19:59:09.059796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:59:19.161634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T19:59:10.088733+0000","last_change":"2023-11-28T19:59:05.768336+0000","last_active":"2023-11-28T19:59:10.088733+0000","last_peered":"2023-11-28T19:59:10.088733+0000","last_clean":"2023-11-28T19:59:10.088733+0000","last_became_active":"2023-11-28T19:59:05.768035+0000","last_became_peered":"2023-11-28T19:59:05.768035+0000","last_unstale":"2023-11-28T19:59:10.088733+0000","last_undegraded":"2023-11-28T19:59:10.088733+0000","last_fullsized":"2023-11-28T19:59:10.088733+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:59:05.015714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:59:05.015714+0000","last_clean_scrub_stamp":"2023-11-28T19:59:05.015714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:54:54.632073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T19:59:10.086736+0000","last_change":"2023-11-28T19:59:05.039347+0000","last_active":"2023-11-28T19:59:10.086736+0000","last_peered":"2023-11-28T19:59:10.086736+0000","last_clean":"2023-11-28T19:59:10.086736+0000","last_became_active":"2023-11-28T19:59:05.038995+0000","last_became_peered":"2023-11-28T19:59:05.038995+0000","last_unstale":"2023-11-28T19:59:10.086736+0000","last_undegraded":"2023-11-28T19:59:10.086736+0000","last_fullsized":"2023-11-28T19:59:10.086736+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:59:04.008158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:59:04.008158+0000","last_clean_scrub_stamp":"2023-11-28T19:59:04.008158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T06:35:58.085712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T19:59:10.893010+0000","last_change":"2023-11-28T19:59:10.106996+0000","last_active":"2023-11-28T19:59:10.893010+0000","last_peered":"2023-11-28T19:59:10.893010+0000","last_clean":"2023-11-28T19:59:10.893010+0000","last_became_active":"2023-11-28T19:59:10.106321+0000","last_became_peered":"2023-11-28T19:59:10.106321+0000","last_unstale":"2023-11-28T19:59:10.893010+0000","last_undegraded":"2023-11-28T19:59:10.893010+0000","last_fullsized":"2023-11-28T19:59:10.893010+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:59:09.059796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:59:09.059796+0000","last_clean_scrub_stamp":"2023-11-28T19:59:09.059796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:27:38.944595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T19:59:10.098824+0000","last_change":"2023-11-28T19:59:05.756081+0000","last_active":"2023-11-28T19:59:10.098824+0000","last_peered":"2023-11-28T19:59:10.098824+0000","last_clean":"2023-11-28T19:59:10.098824+0000","last_became_active":"2023-11-28T19:59:05.755784+0000","last_became_peered":"2023-11-28T19:59:05.755784+0000","last_unstale":"2023-11-28T19:59:10.098824+0000","last_undegraded":"2023-11-28T19:59:10.098824+0000","last_fullsized":"2023-11-28T19:59:10.098824+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:59:05.015714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:59:05.015714+0000","last_clean_scrub_stamp":"2023-11-28T19:59:05.015714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:39:44.998942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T19:59:10.081517+0000","last_change":"2023-11-28T19:59:05.050192+0000","last_active":"2023-11-28T19:59:10.081517+0000","last_peered":"2023-11-28T19:59:10.081517+0000","last_clean":"2023-11-28T19:59:10.081517+0000","last_became_active":"2023-11-28T19:59:05.049835+0000","last_became_peered":"2023-11-28T19:59:05.049835+0000","last_unstale":"2023-11-28T19:59:10.081517+0000","last_undegraded":"2023-11-28T19:59:10.081517+0000","last_fullsized":"2023-11-28T19:59:10.081517+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:59:04.008158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:59:04.008158+0000","last_clean_scrub_stamp":"2023-11-28T19:59:04.008158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:55:39.803978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T19:59:10.893279+0000","last_change":"2023-11-28T19:59:10.105472+0000","last_active":"2023-11-28T19:59:10.893279+0000","last_peered":"2023-11-28T19:59:10.893279+0000","last_clean":"2023-11-28T19:59:10.893279+0000","last_became_active":"2023-11-28T19:59:10.103836+0000","last_became_peered":"2023-11-28T19:59:10.103836+0000","last_unstale":"2023-11-28T19:59:10.893279+0000","last_undegraded":"2023-11-28T19:59:10.893279+0000","last_fullsized":"2023-11-28T19:59:10.893279+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:59:09.059796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:59:09.059796+0000","last_clean_scrub_stamp":"2023-11-28T19:59:09.059796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:50:45.043146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T19:59:10.105131+0000","last_change":"2023-11-28T19:59:05.776449+0000","last_active":"2023-11-28T19:59:10.105131+0000","last_peered":"2023-11-28T19:59:10.105131+0000","last_clean":"2023-11-28T19:59:10.105131+0000","last_became_active":"2023-11-28T19:59:05.776170+0000","last_became_peered":"2023-11-28T19:59:05.776170+0000","last_unstale":"2023-11-28T19:59:10.105131+0000","last_undegraded":"2023-11-28T19:59:10.105131+0000","last_fullsized":"2023-11-28T19:59:10.105131+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:59:05.015714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:59:05.015714+0000","last_clean_scrub_stamp":"2023-11-28T19:59:05.015714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T06:35:59.093269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T19:59:10.231401+0000","last_change":"2023-11-28T19:59:05.053328+0000","last_active":"2023-11-28T19:59:10.231401+0000","last_peered":"2023-11-28T19:59:10.231401+0000","last_clean":"2023-11-28T19:59:10.231401+0000","last_became_active":"2023-11-28T19:59:05.053006+0000","last_became_peered":"2023-11-28T19:59:05.053006+0000","last_unstale":"2023-11-28T19:59:10.231401+0000","last_undegraded":"2023-11-28T19:59:10.231401+0000","last_fullsized":"2023-11-28T19:59:10.231401+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:59:04.008158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:59:04.008158+0000","last_clean_scrub_stamp":"2023-11-28T19:59:04.008158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T07:38:26.527925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T19:59:10.892291+0000","last_change":"2023-11-28T19:59:10.233184+0000","last_active":"2023-11-28T19:59:10.892291+0000","last_peered":"2023-11-28T19:59:10.892291+0000","last_clean":"2023-11-28T19:59:10.892291+0000","last_became_active":"2023-11-28T19:59:10.232695+0000","last_became_peered":"2023-11-28T19:59:10.232695+0000","last_unstale":"2023-11-28T19:59:10.892291+0000","last_undegraded":"2023-11-28T19:59:10.892291+0000","last_fullsized":"2023-11-28T19:59:10.892291+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:59:09.059796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:59:09.059796+0000","last_clean_scrub_stamp":"2023-11-28T19:59:09.059796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:50:45.043146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T19:59:10.091832+0000","last_change":"2023-11-28T19:59:05.779101+0000","last_active":"2023-11-28T19:59:10.091832+0000","last_peered":"2023-11-28T19:59:10.091832+0000","last_clean":"2023-11-28T19:59:10.091832+0000","last_became_active":"2023-11-28T19:59:05.778867+0000","last_became_peered":"2023-11-28T19:59:05.778867+0000","last_unstale":"2023-11-28T19:59:10.091832+0000","last_undegraded":"2023-11-28T19:59:10.091832+0000","last_fullsized":"2023-11-28T19:59:10.091832+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:59:05.015714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:59:05.015714+0000","last_clean_scrub_stamp":"2023-11-28T19:59:05.015714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T06:26:55.424441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T19:59:10.086389+0000","last_change":"2023-11-28T19:59:05.039775+0000","last_active":"2023-11-28T19:59:10.086389+0000","last_peered":"2023-11-28T19:59:10.086389+0000","last_clean":"2023-11-28T19:59:10.086389+0000","last_became_active":"2023-11-28T19:59:05.039360+0000","last_became_peered":"2023-11-28T19:59:05.039360+0000","last_unstale":"2023-11-28T19:59:10.086389+0000","last_undegraded":"2023-11-28T19:59:10.086389+0000","last_fullsized":"2023-11-28T19:59:10.086389+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:59:04.008158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:59:04.008158+0000","last_clean_scrub_stamp":"2023-11-28T19:59:04.008158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:55:39.803978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":169,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T19:59:10.231502+0000","last_change":"2023-11-28T19:58:56.136501+0000","last_active":"2023-11-28T19:59:10.231502+0000","last_peered":"2023-11-28T19:59:10.231502+0000","last_clean":"2023-11-28T19:59:10.231502+0000","last_became_active":"2023-11-28T19:58:56.135998+0000","last_became_peered":"2023-11-28T19:58:56.135998+0000","last_unstale":"2023-11-28T19:59:10.231502+0000","last_undegraded":"2023-11-28T19:59:10.231502+0000","last_fullsized":"2023-11-28T19:59:10.231502+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:58:54.602349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:58:54.602349+0000","last_clean_scrub_stamp":"2023-11-28T19:58:54.602349+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:33:42.723349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T19:59:10.892259+0000","last_change":"2023-11-28T19:59:10.237549+0000","last_active":"2023-11-28T19:59:10.892259+0000","last_peered":"2023-11-28T19:59:10.892259+0000","last_clean":"2023-11-28T19:59:10.892259+0000","last_became_active":"2023-11-28T19:59:10.237130+0000","last_became_peered":"2023-11-28T19:59:10.237130+0000","last_unstale":"2023-11-28T19:59:10.892259+0000","last_undegraded":"2023-11-28T19:59:10.892259+0000","last_fullsized":"2023-11-28T19:59:10.892259+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:59:09.059796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:59:09.059796+0000","last_clean_scrub_stamp":"2023-11-28T19:59:09.059796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:59:19.161634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T19:59:10.231699+0000","last_change":"2023-11-28T19:59:05.786506+0000","last_active":"2023-11-28T19:59:10.231699+0000","last_peered":"2023-11-28T19:59:10.231699+0000","last_clean":"2023-11-28T19:59:10.231699+0000","last_became_active":"2023-11-28T19:59:05.785858+0000","last_became_peered":"2023-11-28T19:59:05.785858+0000","last_unstale":"2023-11-28T19:59:10.231699+0000","last_undegraded":"2023-11-28T19:59:10.231699+0000","last_fullsized":"2023-11-28T19:59:10.231699+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:59:05.015714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:59:05.015714+0000","last_clean_scrub_stamp":"2023-11-28T19:59:05.015714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:04:04.508815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T19:59:10.081603+0000","last_change":"2023-11-28T19:59:05.038652+0000","last_active":"2023-11-28T19:59:10.081603+0000","last_peered":"2023-11-28T19:59:10.081603+0000","last_clean":"2023-11-28T19:59:10.081603+0000","last_became_active":"2023-11-28T19:59:05.038327+0000","last_became_peered":"2023-11-28T19:59:05.038327+0000","last_unstale":"2023-11-28T19:59:10.081603+0000","last_undegraded":"2023-11-28T19:59:10.081603+0000","last_fullsized":"2023-11-28T19:59:10.081603+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:59:04.008158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:59:04.008158+0000","last_clean_scrub_stamp":"2023-11-28T19:59:04.008158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:54:53.624516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T19:59:10.892210+0000","last_change":"2023-11-28T19:59:10.234188+0000","last_active":"2023-11-28T19:59:10.892210+0000","last_peered":"2023-11-28T19:59:10.892210+0000","last_clean":"2023-11-28T19:59:10.892210+0000","last_became_active":"2023-11-28T19:59:10.232817+0000","last_became_peered":"2023-11-28T19:59:10.232817+0000","last_unstale":"2023-11-28T19:59:10.892210+0000","last_undegraded":"2023-11-28T19:59:10.892210+0000","last_fullsized":"2023-11-28T19:59:10.892210+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:59:09.059796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:59:09.059796+0000","last_clean_scrub_stamp":"2023-11-28T19:59:09.059796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:04:22.608590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T19:59:10.088147+0000","last_change":"2023-11-28T19:59:05.770485+0000","last_active":"2023-11-28T19:59:10.088147+0000","last_peered":"2023-11-28T19:59:10.088147+0000","last_clean":"2023-11-28T19:59:10.088147+0000","last_became_active":"2023-11-28T19:59:05.769897+0000","last_became_peered":"2023-11-28T19:59:05.769897+0000","last_unstale":"2023-11-28T19:59:10.088147+0000","last_undegraded":"2023-11-28T19:59:10.088147+0000","last_fullsized":"2023-11-28T19:59:10.088147+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:59:05.015714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:59:05.015714+0000","last_clean_scrub_stamp":"2023-11-28T19:59:05.015714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:04:18.564508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"20'1","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T19:59:10.099741+0000","last_change":"2023-11-28T19:59:05.038199+0000","last_active":"2023-11-28T19:59:10.099741+0000","last_peered":"2023-11-28T19:59:10.099741+0000","last_clean":"2023-11-28T19:59:10.099741+0000","last_became_active":"2023-11-28T19:59:05.037884+0000","last_became_peered":"2023-11-28T19:59:05.037884+0000","last_unstale":"2023-11-28T19:59:10.099741+0000","last_undegraded":"2023-11-28T19:59:10.099741+0000","last_fullsized":"2023-11-28T19:59:10.099741+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:59:04.008158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:59:04.008158+0000","last_clean_scrub_stamp":"2023-11-28T19:59:04.008158+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:59:05.695936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T19:59:10.892205+0000","last_change":"2023-11-28T19:59:10.113074+0000","last_active":"2023-11-28T19:59:10.892205+0000","last_peered":"2023-11-28T19:59:10.892205+0000","last_clean":"2023-11-28T19:59:10.892205+0000","last_became_active":"2023-11-28T19:59:10.112703+0000","last_became_peered":"2023-11-28T19:59:10.112703+0000","last_unstale":"2023-11-28T19:59:10.892205+0000","last_undegraded":"2023-11-28T19:59:10.892205+0000","last_fullsized":"2023-11-28T19:59:10.892205+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:59:09.059796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:59:09.059796+0000","last_clean_scrub_stamp":"2023-11-28T19:59:09.059796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:09:44.374501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T19:59:10.232038+0000","last_change":"2023-11-28T19:59:05.787582+0000","last_active":"2023-11-28T19:59:10.232038+0000","last_peered":"2023-11-28T19:59:10.232038+0000","last_clean":"2023-11-28T19:59:10.232038+0000","last_became_active":"2023-11-28T19:59:05.786888+0000","last_became_peered":"2023-11-28T19:59:05.786888+0000","last_unstale":"2023-11-28T19:59:10.232038+0000","last_undegraded":"2023-11-28T19:59:10.232038+0000","last_fullsized":"2023-11-28T19:59:10.232038+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:59:05.015714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:59:05.015714+0000","last_clean_scrub_stamp":"2023-11-28T19:59:05.015714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:50:40.999064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"20'2","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T19:59:10.082013+0000","last_change":"2023-11-28T19:59:05.039063+0000","last_active":"2023-11-28T19:59:10.082013+0000","last_peered":"2023-11-28T19:59:10.082013+0000","last_clean":"2023-11-28T19:59:10.082013+0000","last_became_active":"2023-11-28T19:59:05.038803+0000","last_became_peered":"2023-11-28T19:59:05.038803+0000","last_unstale":"2023-11-28T19:59:10.082013+0000","last_undegraded":"2023-11-28T19:59:10.082013+0000","last_fullsized":"2023-11-28T19:59:10.082013+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:59:04.008158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:59:04.008158+0000","last_clean_scrub_stamp":"2023-11-28T19:59:04.008158+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:24:13.851530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T19:59:10.750166+0000","last_change":"2023-11-28T19:59:10.237605+0000","last_active":"2023-11-28T19:59:10.750166+0000","last_peered":"2023-11-28T19:59:10.750166+0000","last_clean":"2023-11-28T19:59:10.750166+0000","last_became_active":"2023-11-28T19:59:10.237079+0000","last_became_peered":"2023-11-28T19:59:10.237079+0000","last_unstale":"2023-11-28T19:59:10.750166+0000","last_undegraded":"2023-11-28T19:59:10.750166+0000","last_fullsized":"2023-11-28T19:59:10.750166+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:59:09.059796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:59:09.059796+0000","last_clean_scrub_stamp":"2023-11-28T19:59:09.059796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:47:39.329731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T19:59:10.231882+0000","last_change":"2023-11-28T19:59:05.784211+0000","last_active":"2023-11-28T19:59:10.231882+0000","last_peered":"2023-11-28T19:59:10.231882+0000","last_clean":"2023-11-28T19:59:10.231882+0000","last_became_active":"2023-11-28T19:59:05.783924+0000","last_became_peered":"2023-11-28T19:59:05.783924+0000","last_unstale":"2023-11-28T19:59:10.231882+0000","last_undegraded":"2023-11-28T19:59:10.231882+0000","last_fullsized":"2023-11-28T19:59:10.231882+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:59:05.015714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:59:05.015714+0000","last_clean_scrub_stamp":"2023-11-28T19:59:05.015714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:43:15.986749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"20'1","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T19:59:10.086589+0000","last_change":"2023-11-28T19:59:05.050003+0000","last_active":"2023-11-28T19:59:10.086589+0000","last_peered":"2023-11-28T19:59:10.086589+0000","last_clean":"2023-11-28T19:59:10.086589+0000","last_became_active":"2023-11-28T19:59:05.048751+0000","last_became_peered":"2023-11-28T19:59:05.048751+0000","last_unstale":"2023-11-28T19:59:10.086589+0000","last_undegraded":"2023-11-28T19:59:10.086589+0000","last_fullsized":"2023-11-28T19:59:10.086589+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:59:04.008158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:59:04.008158+0000","last_clean_scrub_stamp":"2023-11-28T19:59:04.008158+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:43:22.921922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T19:59:10.750165+0000","last_change":"2023-11-28T19:59:10.118418+0000","last_active":"2023-11-28T19:59:10.750165+0000","last_peered":"2023-11-28T19:59:10.750165+0000","last_clean":"2023-11-28T19:59:10.750165+0000","last_became_active":"2023-11-28T19:59:10.118013+0000","last_became_peered":"2023-11-28T19:59:10.118013+0000","last_unstale":"2023-11-28T19:59:10.750165+0000","last_undegraded":"2023-11-28T19:59:10.750165+0000","last_fullsized":"2023-11-28T19:59:10.750165+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:59:09.059796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:59:09.059796+0000","last_clean_scrub_stamp":"2023-11-28T19:59:09.059796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T06:26:59.468523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T19:59:10.231450+0000","last_change":"2023-11-28T19:59:05.781473+0000","last_active":"2023-11-28T19:59:10.231450+0000","last_peered":"2023-11-28T19:59:10.231450+0000","last_clean":"2023-11-28T19:59:10.231450+0000","last_became_active":"2023-11-28T19:59:05.781227+0000","last_became_peered":"2023-11-28T19:59:05.781227+0000","last_unstale":"2023-11-28T19:59:10.231450+0000","last_undegraded":"2023-11-28T19:59:10.231450+0000","last_fullsized":"2023-11-28T19:59:10.231450+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:59:05.015714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:59:05.015714+0000","last_clean_scrub_stamp":"2023-11-28T19:59:05.015714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:56:09.640427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"20'8","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T19:59:10.081395+0000","last_change":"2023-11-28T19:59:05.038647+0000","last_active":"2023-11-28T19:59:10.081395+0000","last_peered":"2023-11-28T19:59:10.081395+0000","last_clean":"2023-11-28T19:59:10.081395+0000","last_became_active":"2023-11-28T19:59:05.038338+0000","last_became_peered":"2023-11-28T19:59:05.038338+0000","last_unstale":"2023-11-28T19:59:10.081395+0000","last_undegraded":"2023-11-28T19:59:10.081395+0000","last_fullsized":"2023-11-28T19:59:10.081395+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:59:04.008158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:59:04.008158+0000","last_clean_scrub_stamp":"2023-11-28T19:59:04.008158+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T07:38:26.527925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T19:59:10.892176+0000","last_change":"2023-11-28T19:59:10.111085+0000","last_active":"2023-11-28T19:59:10.892176+0000","last_peered":"2023-11-28T19:59:10.892176+0000","last_clean":"2023-11-28T19:59:10.892176+0000","last_became_active":"2023-11-28T19:59:10.109559+0000","last_became_peered":"2023-11-28T19:59:10.109559+0000","last_unstale":"2023-11-28T19:59:10.892176+0000","last_undegraded":"2023-11-28T19:59:10.892176+0000","last_fullsized":"2023-11-28T19:59:10.892176+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:59:09.059796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:59:09.059796+0000","last_clean_scrub_stamp":"2023-11-28T19:59:09.059796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:27:38.944595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T19:59:10.095949+0000","last_change":"2023-11-28T19:59:05.770947+0000","last_active":"2023-11-28T19:59:10.095949+0000","last_peered":"2023-11-28T19:59:10.095949+0000","last_clean":"2023-11-28T19:59:10.095949+0000","last_became_active":"2023-11-28T19:59:05.770478+0000","last_became_peered":"2023-11-28T19:59:05.770478+0000","last_unstale":"2023-11-28T19:59:10.095949+0000","last_undegraded":"2023-11-28T19:59:10.095949+0000","last_fullsized":"2023-11-28T19:59:10.095949+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:59:05.015714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:59:05.015714+0000","last_clean_scrub_stamp":"2023-11-28T19:59:05.015714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:39:44.998942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T19:59:10.096036+0000","last_change":"2023-11-28T19:59:05.047423+0000","last_active":"2023-11-28T19:59:10.096036+0000","last_peered":"2023-11-28T19:59:10.096036+0000","last_clean":"2023-11-28T19:59:10.096036+0000","last_became_active":"2023-11-28T19:59:05.047076+0000","last_became_peered":"2023-11-28T19:59:05.047076+0000","last_unstale":"2023-11-28T19:59:10.096036+0000","last_undegraded":"2023-11-28T19:59:10.096036+0000","last_fullsized":"2023-11-28T19:59:10.096036+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:59:04.008158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:59:04.008158+0000","last_clean_scrub_stamp":"2023-11-28T19:59:04.008158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T06:50:50.328228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T19:59:10.748835+0000","last_change":"2023-11-28T19:59:10.238924+0000","last_active":"2023-11-28T19:59:10.748835+0000","last_peered":"2023-11-28T19:59:10.748835+0000","last_clean":"2023-11-28T19:59:10.748835+0000","last_became_active":"2023-11-28T19:59:10.237678+0000","last_became_peered":"2023-11-28T19:59:10.237678+0000","last_unstale":"2023-11-28T19:59:10.748835+0000","last_undegraded":"2023-11-28T19:59:10.748835+0000","last_fullsized":"2023-11-28T19:59:10.748835+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:59:09.059796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:59:09.059796+0000","last_clean_scrub_stamp":"2023-11-28T19:59:09.059796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:39:07.159036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T19:59:10.231706+0000","last_change":"2023-11-28T19:59:05.786376+0000","last_active":"2023-11-28T19:59:10.231706+0000","last_peered":"2023-11-28T19:59:10.231706+0000","last_clean":"2023-11-28T19:59:10.231706+0000","last_became_active":"2023-11-28T19:59:05.785920+0000","last_became_peered":"2023-11-28T19:59:05.785920+0000","last_unstale":"2023-11-28T19:59:10.231706+0000","last_undegraded":"2023-11-28T19:59:10.231706+0000","last_fullsized":"2023-11-28T19:59:10.231706+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:59:05.015714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:59:05.015714+0000","last_clean_scrub_stamp":"2023-11-28T19:59:05.015714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:09:40.330419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T19:59:10.086641+0000","last_change":"2023-11-28T19:59:05.046163+0000","last_active":"2023-11-28T19:59:10.086641+0000","last_peered":"2023-11-28T19:59:10.086641+0000","last_clean":"2023-11-28T19:59:10.086641+0000","last_became_active":"2023-11-28T19:59:05.045305+0000","last_became_peered":"2023-11-28T19:59:05.045305+0000","last_unstale":"2023-11-28T19:59:10.086641+0000","last_undegraded":"2023-11-28T19:59:10.086641+0000","last_fullsized":"2023-11-28T19:59:10.086641+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:59:04.008158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:59:04.008158+0000","last_clean_scrub_stamp":"2023-11-28T19:59:04.008158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:24:47.265269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T19:59:10.749020+0000","last_change":"2023-11-28T19:59:10.238640+0000","last_active":"2023-11-28T19:59:10.749020+0000","last_peered":"2023-11-28T19:59:10.749020+0000","last_clean":"2023-11-28T19:59:10.749020+0000","last_became_active":"2023-11-28T19:59:10.236870+0000","last_became_peered":"2023-11-28T19:59:10.236870+0000","last_unstale":"2023-11-28T19:59:10.749020+0000","last_undegraded":"2023-11-28T19:59:10.749020+0000","last_fullsized":"2023-11-28T19:59:10.749020+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:59:09.059796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:59:09.059796+0000","last_clean_scrub_stamp":"2023-11-28T19:59:09.059796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:43:34.452592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T19:59:10.105258+0000","last_change":"2023-11-28T19:59:05.772859+0000","last_active":"2023-11-28T19:59:10.105258+0000","last_peered":"2023-11-28T19:59:10.105258+0000","last_clean":"2023-11-28T19:59:10.105258+0000","last_became_active":"2023-11-28T19:59:05.772598+0000","last_became_peered":"2023-11-28T19:59:05.772598+0000","last_unstale":"2023-11-28T19:59:10.105258+0000","last_undegraded":"2023-11-28T19:59:10.105258+0000","last_fullsized":"2023-11-28T19:59:10.105258+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:59:05.015714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:59:05.015714+0000","last_clean_scrub_stamp":"2023-11-28T19:59:05.015714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:44:02.102081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"20'2","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T19:59:10.105695+0000","last_change":"2023-11-28T19:59:05.048324+0000","last_active":"2023-11-28T19:59:10.105695+0000","last_peered":"2023-11-28T19:59:10.105695+0000","last_clean":"2023-11-28T19:59:10.105695+0000","last_became_active":"2023-11-28T19:59:05.048010+0000","last_became_peered":"2023-11-28T19:59:05.048010+0000","last_unstale":"2023-11-28T19:59:10.105695+0000","last_undegraded":"2023-11-28T19:59:10.105695+0000","last_fullsized":"2023-11-28T19:59:10.105695+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:59:04.008158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:59:04.008158+0000","last_clean_scrub_stamp":"2023-11-28T19:59:04.008158+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:47:35.984593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T19:59:10.751337+0000","last_change":"2023-11-28T19:59:10.233429+0000","last_active":"2023-11-28T19:59:10.751337+0000","last_peered":"2023-11-28T19:59:10.751337+0000","last_clean":"2023-11-28T19:59:10.751337+0000","last_became_active":"2023-11-28T19:59:10.232923+0000","last_became_peered":"2023-11-28T19:59:10.232923+0000","last_unstale":"2023-11-28T19:59:10.751337+0000","last_undegraded":"2023-11-28T19:59:10.751337+0000","last_fullsized":"2023-11-28T19:59:10.751337+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:59:09.059796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:59:09.059796+0000","last_clean_scrub_stamp":"2023-11-28T19:59:09.059796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:30:43.834211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T19:59:10.231692+0000","last_change":"2023-11-28T19:59:05.785594+0000","last_active":"2023-11-28T19:59:10.231692+0000","last_peered":"2023-11-28T19:59:10.231692+0000","last_clean":"2023-11-28T19:59:10.231692+0000","last_became_active":"2023-11-28T19:59:05.783565+0000","last_became_peered":"2023-11-28T19:59:05.783565+0000","last_unstale":"2023-11-28T19:59:10.231692+0000","last_undegraded":"2023-11-28T19:59:10.231692+0000","last_fullsized":"2023-11-28T19:59:10.231692+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:59:05.015714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:59:05.015714+0000","last_clean_scrub_stamp":"2023-11-28T19:59:05.015714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:21:21.519406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"25'9","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T19:59:16.612954+0000","last_change":"2023-11-28T19:59:05.050492+0000","last_active":"2023-11-28T19:59:16.612954+0000","last_peered":"2023-11-28T19:59:16.612954+0000","last_clean":"2023-11-28T19:59:16.612954+0000","last_became_active":"2023-11-28T19:59:05.050201+0000","last_became_peered":"2023-11-28T19:59:05.050201+0000","last_unstale":"2023-11-28T19:59:16.612954+0000","last_undegraded":"2023-11-28T19:59:16.612954+0000","last_fullsized":"2023-11-28T19:59:16.612954+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:59:04.008158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:59:04.008158+0000","last_clean_scrub_stamp":"2023-11-28T19:59:04.008158+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T06:35:58.085712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3841,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T19:59:10.891969+0000","last_change":"2023-11-28T19:59:10.110604+0000","last_active":"2023-11-28T19:59:10.891969+0000","last_peered":"2023-11-28T19:59:10.891969+0000","last_clean":"2023-11-28T19:59:10.891969+0000","last_became_active":"2023-11-28T19:59:10.109600+0000","last_became_peered":"2023-11-28T19:59:10.109600+0000","last_unstale":"2023-11-28T19:59:10.891969+0000","last_undegraded":"2023-11-28T19:59:10.891969+0000","last_fullsized":"2023-11-28T19:59:10.891969+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:59:09.059796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:59:09.059796+0000","last_clean_scrub_stamp":"2023-11-28T19:59:09.059796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:04:22.608590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T19:59:10.093975+0000","last_change":"2023-11-28T19:59:05.779793+0000","last_active":"2023-11-28T19:59:10.093975+0000","last_peered":"2023-11-28T19:59:10.093975+0000","last_clean":"2023-11-28T19:59:10.093975+0000","last_became_active":"2023-11-28T19:59:05.779488+0000","last_became_peered":"2023-11-28T19:59:05.779488+0000","last_unstale":"2023-11-28T19:59:10.093975+0000","last_undegraded":"2023-11-28T19:59:10.093975+0000","last_fullsized":"2023-11-28T19:59:10.093975+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:59:05.015714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:59:05.015714+0000","last_clean_scrub_stamp":"2023-11-28T19:59:05.015714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:55:00.138576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"20'3","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T19:59:10.099653+0000","last_change":"2023-11-28T19:59:05.044226+0000","last_active":"2023-11-28T19:59:10.099653+0000","last_peered":"2023-11-28T19:59:10.099653+0000","last_clean":"2023-11-28T19:59:10.099653+0000","last_became_active":"2023-11-28T19:59:05.043946+0000","last_became_peered":"2023-11-28T19:59:05.043946+0000","last_unstale":"2023-11-28T19:59:10.099653+0000","last_undegraded":"2023-11-28T19:59:10.099653+0000","last_fullsized":"2023-11-28T19:59:10.099653+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:59:04.008158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:59:04.008158+0000","last_clean_scrub_stamp":"2023-11-28T19:59:04.008158+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:47:35.984593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T19:59:10.751315+0000","last_change":"2023-11-28T19:59:10.101312+0000","last_active":"2023-11-28T19:59:10.751315+0000","last_peered":"2023-11-28T19:59:10.751315+0000","last_clean":"2023-11-28T19:59:10.751315+0000","last_became_active":"2023-11-28T19:59:10.100486+0000","last_became_peered":"2023-11-28T19:59:10.100486+0000","last_unstale":"2023-11-28T19:59:10.751315+0000","last_undegraded":"2023-11-28T19:59:10.751315+0000","last_fullsized":"2023-11-28T19:59:10.751315+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:59:09.059796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:59:09.059796+0000","last_clean_scrub_stamp":"2023-11-28T19:59:09.059796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:56:13.684509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T19:59:10.106097+0000","last_change":"2023-11-28T19:59:05.781405+0000","last_active":"2023-11-28T19:59:10.106097+0000","last_peered":"2023-11-28T19:59:10.106097+0000","last_clean":"2023-11-28T19:59:10.106097+0000","last_became_active":"2023-11-28T19:59:05.781191+0000","last_became_peered":"2023-11-28T19:59:05.781191+0000","last_unstale":"2023-11-28T19:59:10.106097+0000","last_undegraded":"2023-11-28T19:59:10.106097+0000","last_fullsized":"2023-11-28T19:59:10.106097+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:59:05.015714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:59:05.015714+0000","last_clean_scrub_stamp":"2023-11-28T19:59:05.015714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:05:03.688191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T19:59:10.087858+0000","last_change":"2023-11-28T19:59:05.043993+0000","last_active":"2023-11-28T19:59:10.087858+0000","last_peered":"2023-11-28T19:59:10.087858+0000","last_clean":"2023-11-28T19:59:10.087858+0000","last_became_active":"2023-11-28T19:59:05.043601+0000","last_became_peered":"2023-11-28T19:59:05.043601+0000","last_unstale":"2023-11-28T19:59:10.087858+0000","last_undegraded":"2023-11-28T19:59:10.087858+0000","last_fullsized":"2023-11-28T19:59:10.087858+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:59:04.008158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:59:04.008158+0000","last_clean_scrub_stamp":"2023-11-28T19:59:04.008158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:34:40.633276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T19:59:10.748222+0000","last_change":"2023-11-28T19:59:10.118024+0000","last_active":"2023-11-28T19:59:10.748222+0000","last_peered":"2023-11-28T19:59:10.748222+0000","last_clean":"2023-11-28T19:59:10.748222+0000","last_became_active":"2023-11-28T19:59:10.117574+0000","last_became_peered":"2023-11-28T19:59:10.117574+0000","last_unstale":"2023-11-28T19:59:10.748222+0000","last_undegraded":"2023-11-28T19:59:10.748222+0000","last_fullsized":"2023-11-28T19:59:10.748222+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:59:09.059796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:59:09.059796+0000","last_clean_scrub_stamp":"2023-11-28T19:59:09.059796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:34:54.217873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T19:59:10.087770+0000","last_change":"2023-11-28T19:59:05.773474+0000","last_active":"2023-11-28T19:59:10.087770+0000","last_peered":"2023-11-28T19:59:10.087770+0000","last_clean":"2023-11-28T19:59:10.087770+0000","last_became_active":"2023-11-28T19:59:05.773148+0000","last_became_peered":"2023-11-28T19:59:05.773148+0000","last_unstale":"2023-11-28T19:59:10.087770+0000","last_undegraded":"2023-11-28T19:59:10.087770+0000","last_fullsized":"2023-11-28T19:59:10.087770+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:59:05.015714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:59:05.015714+0000","last_clean_scrub_stamp":"2023-11-28T19:59:05.015714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:27:34.900513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T19:59:10.097405+0000","last_change":"2023-11-28T19:59:05.044167+0000","last_active":"2023-11-28T19:59:10.097405+0000","last_peered":"2023-11-28T19:59:10.097405+0000","last_clean":"2023-11-28T19:59:10.097405+0000","last_became_active":"2023-11-28T19:59:05.043651+0000","last_became_peered":"2023-11-28T19:59:05.043651+0000","last_unstale":"2023-11-28T19:59:10.097405+0000","last_undegraded":"2023-11-28T19:59:10.097405+0000","last_fullsized":"2023-11-28T19:59:10.097405+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:59:04.008158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:59:04.008158+0000","last_clean_scrub_stamp":"2023-11-28T19:59:04.008158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:44:01.094524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T19:59:10.748417+0000","last_change":"2023-11-28T19:59:10.237079+0000","last_active":"2023-11-28T19:59:10.748417+0000","last_peered":"2023-11-28T19:59:10.748417+0000","last_clean":"2023-11-28T19:59:10.748417+0000","last_became_active":"2023-11-28T19:59:10.236659+0000","last_became_peered":"2023-11-28T19:59:10.236659+0000","last_unstale":"2023-11-28T19:59:10.748417+0000","last_undegraded":"2023-11-28T19:59:10.748417+0000","last_fullsized":"2023-11-28T19:59:10.748417+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:59:09.059796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:59:09.059796+0000","last_clean_scrub_stamp":"2023-11-28T19:59:09.059796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:47:39.329731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T19:59:10.892053+0000","last_change":"2023-11-28T19:59:10.236815+0000","last_active":"2023-11-28T19:59:10.892053+0000","last_peered":"2023-11-28T19:59:10.892053+0000","last_clean":"2023-11-28T19:59:10.892053+0000","last_became_active":"2023-11-28T19:59:10.236466+0000","last_became_peered":"2023-11-28T19:59:10.236466+0000","last_unstale":"2023-11-28T19:59:10.892053+0000","last_undegraded":"2023-11-28T19:59:10.892053+0000","last_fullsized":"2023-11-28T19:59:10.892053+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:59:09.059796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:59:09.059796+0000","last_clean_scrub_stamp":"2023-11-28T19:59:09.059796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:59:19.161634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T19:59:10.098528+0000","last_change":"2023-11-28T19:59:05.757721+0000","last_active":"2023-11-28T19:59:10.098528+0000","last_peered":"2023-11-28T19:59:10.098528+0000","last_clean":"2023-11-28T19:59:10.098528+0000","last_became_active":"2023-11-28T19:59:05.757410+0000","last_became_peered":"2023-11-28T19:59:05.757410+0000","last_unstale":"2023-11-28T19:59:10.098528+0000","last_undegraded":"2023-11-28T19:59:10.098528+0000","last_fullsized":"2023-11-28T19:59:10.098528+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:59:05.015714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:59:05.015714+0000","last_clean_scrub_stamp":"2023-11-28T19:59:05.015714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:21:11.899134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T19:59:10.085948+0000","last_change":"2023-11-28T19:59:05.035784+0000","last_active":"2023-11-28T19:59:10.085948+0000","last_peered":"2023-11-28T19:59:10.085948+0000","last_clean":"2023-11-28T19:59:10.085948+0000","last_became_active":"2023-11-28T19:59:05.035438+0000","last_became_peered":"2023-11-28T19:59:05.035438+0000","last_unstale":"2023-11-28T19:59:10.085948+0000","last_undegraded":"2023-11-28T19:59:10.085948+0000","last_fullsized":"2023-11-28T19:59:10.085948+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:59:04.008158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:59:04.008158+0000","last_clean_scrub_stamp":"2023-11-28T19:59:04.008158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:50:57.704628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T19:59:10.892842+0000","last_change":"2023-11-28T19:59:10.118648+0000","last_active":"2023-11-28T19:59:10.892842+0000","last_peered":"2023-11-28T19:59:10.892842+0000","last_clean":"2023-11-28T19:59:10.892842+0000","last_became_active":"2023-11-28T19:59:10.118092+0000","last_became_peered":"2023-11-28T19:59:10.118092+0000","last_unstale":"2023-11-28T19:59:10.892842+0000","last_undegraded":"2023-11-28T19:59:10.892842+0000","last_fullsized":"2023-11-28T19:59:10.892842+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:59:09.059796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:59:09.059796+0000","last_clean_scrub_stamp":"2023-11-28T19:59:09.059796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:27:38.944595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T19:59:10.086761+0000","last_change":"2023-11-28T19:59:05.770886+0000","last_active":"2023-11-28T19:59:10.086761+0000","last_peered":"2023-11-28T19:59:10.086761+0000","last_clean":"2023-11-28T19:59:10.086761+0000","last_became_active":"2023-11-28T19:59:05.770493+0000","last_became_peered":"2023-11-28T19:59:05.770493+0000","last_unstale":"2023-11-28T19:59:10.086761+0000","last_undegraded":"2023-11-28T19:59:10.086761+0000","last_fullsized":"2023-11-28T19:59:10.086761+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:59:05.015714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:59:05.015714+0000","last_clean_scrub_stamp":"2023-11-28T19:59:05.015714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:39:44.998942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T19:59:10.087599+0000","last_change":"2023-11-28T19:59:05.046151+0000","last_active":"2023-11-28T19:59:10.087599+0000","last_peered":"2023-11-28T19:59:10.087599+0000","last_clean":"2023-11-28T19:59:10.087599+0000","last_became_active":"2023-11-28T19:59:05.045604+0000","last_became_peered":"2023-11-28T19:59:05.045604+0000","last_unstale":"2023-11-28T19:59:10.087599+0000","last_undegraded":"2023-11-28T19:59:10.087599+0000","last_fullsized":"2023-11-28T19:59:10.087599+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:59:04.008158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:59:04.008158+0000","last_clean_scrub_stamp":"2023-11-28T19:59:04.008158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:59:05.695936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"20'1","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T19:59:10.096286+0000","last_change":"2023-11-28T19:59:05.048629+0000","last_active":"2023-11-28T19:59:10.096286+0000","last_peered":"2023-11-28T19:59:10.096286+0000","last_clean":"2023-11-28T19:59:10.096286+0000","last_became_active":"2023-11-28T19:59:05.048345+0000","last_became_peered":"2023-11-28T19:59:05.048345+0000","last_unstale":"2023-11-28T19:59:10.096286+0000","last_undegraded":"2023-11-28T19:59:10.096286+0000","last_fullsized":"2023-11-28T19:59:10.096286+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:59:04.008158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:59:04.008158+0000","last_clean_scrub_stamp":"2023-11-28T19:59:04.008158+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:59:05.695936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T19:59:10.105600+0000","last_change":"2023-11-28T19:59:05.777065+0000","last_active":"2023-11-28T19:59:10.105600+0000","last_peered":"2023-11-28T19:59:10.105600+0000","last_clean":"2023-11-28T19:59:10.105600+0000","last_became_active":"2023-11-28T19:59:05.776748+0000","last_became_peered":"2023-11-28T19:59:05.776748+0000","last_unstale":"2023-11-28T19:59:10.105600+0000","last_undegraded":"2023-11-28T19:59:10.105600+0000","last_fullsized":"2023-11-28T19:59:10.105600+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:59:05.015714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:59:05.015714+0000","last_clean_scrub_stamp":"2023-11-28T19:59:05.015714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:39:44.998942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T19:59:10.892135+0000","last_change":"2023-11-28T19:59:10.107795+0000","last_active":"2023-11-28T19:59:10.892135+0000","last_peered":"2023-11-28T19:59:10.892135+0000","last_clean":"2023-11-28T19:59:10.892135+0000","last_became_active":"2023-11-28T19:59:10.107403+0000","last_became_peered":"2023-11-28T19:59:10.107403+0000","last_unstale":"2023-11-28T19:59:10.892135+0000","last_undegraded":"2023-11-28T19:59:10.892135+0000","last_fullsized":"2023-11-28T19:59:10.892135+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:59:09.059796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:59:09.059796+0000","last_clean_scrub_stamp":"2023-11-28T19:59:09.059796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:24:52.316908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"20'1","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T19:59:10.085998+0000","last_change":"2023-11-28T19:59:05.055074+0000","last_active":"2023-11-28T19:59:10.085998+0000","last_peered":"2023-11-28T19:59:10.085998+0000","last_clean":"2023-11-28T19:59:10.085998+0000","last_became_active":"2023-11-28T19:59:05.054809+0000","last_became_peered":"2023-11-28T19:59:05.054809+0000","last_unstale":"2023-11-28T19:59:10.085998+0000","last_undegraded":"2023-11-28T19:59:10.085998+0000","last_fullsized":"2023-11-28T19:59:10.085998+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:59:04.008158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:59:04.008158+0000","last_clean_scrub_stamp":"2023-11-28T19:59:04.008158+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:24:47.265269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T19:59:10.086324+0000","last_change":"2023-11-28T19:59:05.757750+0000","last_active":"2023-11-28T19:59:10.086324+0000","last_peered":"2023-11-28T19:59:10.086324+0000","last_clean":"2023-11-28T19:59:10.086324+0000","last_became_active":"2023-11-28T19:59:05.756939+0000","last_became_peered":"2023-11-28T19:59:05.756939+0000","last_unstale":"2023-11-28T19:59:10.086324+0000","last_undegraded":"2023-11-28T19:59:10.086324+0000","last_fullsized":"2023-11-28T19:59:10.086324+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:59:05.015714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:59:05.015714+0000","last_clean_scrub_stamp":"2023-11-28T19:59:05.015714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:55:40.811535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T19:59:10.748574+0000","last_change":"2023-11-28T19:59:10.108523+0000","last_active":"2023-11-28T19:59:10.748574+0000","last_peered":"2023-11-28T19:59:10.748574+0000","last_clean":"2023-11-28T19:59:10.748574+0000","last_became_active":"2023-11-28T19:59:10.108151+0000","last_became_peered":"2023-11-28T19:59:10.108151+0000","last_unstale":"2023-11-28T19:59:10.748574+0000","last_undegraded":"2023-11-28T19:59:10.748574+0000","last_fullsized":"2023-11-28T19:59:10.748574+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:59:09.059796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:59:09.059796+0000","last_clean_scrub_stamp":"2023-11-28T19:59:09.059796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:30:43.834211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T19:59:10.095918+0000","last_change":"2023-11-28T19:59:05.771095+0000","last_active":"2023-11-28T19:59:10.095918+0000","last_peered":"2023-11-28T19:59:10.095918+0000","last_clean":"2023-11-28T19:59:10.095918+0000","last_became_active":"2023-11-28T19:59:05.770756+0000","last_became_peered":"2023-11-28T19:59:05.770756+0000","last_unstale":"2023-11-28T19:59:10.095918+0000","last_undegraded":"2023-11-28T19:59:10.095918+0000","last_fullsized":"2023-11-28T19:59:10.095918+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:59:05.015714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:59:05.015714+0000","last_clean_scrub_stamp":"2023-11-28T19:59:05.015714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:21:11.899134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T19:59:10.081519+0000","last_change":"2023-11-28T19:59:05.764023+0000","last_active":"2023-11-28T19:59:10.081519+0000","last_peered":"2023-11-28T19:59:10.081519+0000","last_clean":"2023-11-28T19:59:10.081519+0000","last_became_active":"2023-11-28T19:59:05.763722+0000","last_became_peered":"2023-11-28T19:59:05.763722+0000","last_unstale":"2023-11-28T19:59:10.081519+0000","last_undegraded":"2023-11-28T19:59:10.081519+0000","last_fullsized":"2023-11-28T19:59:10.081519+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:59:05.015714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:59:05.015714+0000","last_clean_scrub_stamp":"2023-11-28T19:59:05.015714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:55:00.138576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T19:59:10.086587+0000","last_change":"2023-11-28T19:59:05.771306+0000","last_active":"2023-11-28T19:59:10.086587+0000","last_peered":"2023-11-28T19:59:10.086587+0000","last_clean":"2023-11-28T19:59:10.086587+0000","last_became_active":"2023-11-28T19:59:05.770978+0000","last_became_peered":"2023-11-28T19:59:05.770978+0000","last_unstale":"2023-11-28T19:59:10.086587+0000","last_undegraded":"2023-11-28T19:59:10.086587+0000","last_fullsized":"2023-11-28T19:59:10.086587+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:59:05.015714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:59:05.015714+0000","last_clean_scrub_stamp":"2023-11-28T19:59:05.015714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:04:04.508815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T19:59:10.105498+0000","last_change":"2023-11-28T19:59:05.772219+0000","last_active":"2023-11-28T19:59:10.105498+0000","last_peered":"2023-11-28T19:59:10.105498+0000","last_clean":"2023-11-28T19:59:10.105498+0000","last_became_active":"2023-11-28T19:59:05.771554+0000","last_became_peered":"2023-11-28T19:59:05.771554+0000","last_unstale":"2023-11-28T19:59:10.105498+0000","last_undegraded":"2023-11-28T19:59:10.105498+0000","last_fullsized":"2023-11-28T19:59:10.105498+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:59:05.015714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:59:05.015714+0000","last_clean_scrub_stamp":"2023-11-28T19:59:05.015714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:00:56.432813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T19:59:10.089982+0000","last_change":"2023-11-28T19:59:05.760600+0000","last_active":"2023-11-28T19:59:10.089982+0000","last_peered":"2023-11-28T19:59:10.089982+0000","last_clean":"2023-11-28T19:59:10.089982+0000","last_became_active":"2023-11-28T19:59:05.760294+0000","last_became_peered":"2023-11-28T19:59:05.760294+0000","last_unstale":"2023-11-28T19:59:10.089982+0000","last_undegraded":"2023-11-28T19:59:10.089982+0000","last_fullsized":"2023-11-28T19:59:10.089982+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:59:05.015714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:59:05.015714+0000","last_clean_scrub_stamp":"2023-11-28T19:59:05.015714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:21:11.899134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T19:59:10.099562+0000","last_change":"2023-11-28T19:59:05.766493+0000","last_active":"2023-11-28T19:59:10.099562+0000","last_peered":"2023-11-28T19:59:10.099562+0000","last_clean":"2023-11-28T19:59:10.099562+0000","last_became_active":"2023-11-28T19:59:05.766183+0000","last_became_peered":"2023-11-28T19:59:05.766183+0000","last_unstale":"2023-11-28T19:59:10.099562+0000","last_undegraded":"2023-11-28T19:59:10.099562+0000","last_fullsized":"2023-11-28T19:59:10.099562+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:59:05.015714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:59:05.015714+0000","last_clean_scrub_stamp":"2023-11-28T19:59:05.015714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:34:41.640833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T19:59:10.097144+0000","last_change":"2023-11-28T19:59:05.767616+0000","last_active":"2023-11-28T19:59:10.097144+0000","last_peered":"2023-11-28T19:59:10.097144+0000","last_clean":"2023-11-28T19:59:10.097144+0000","last_became_active":"2023-11-28T19:59:05.766973+0000","last_became_peered":"2023-11-28T19:59:05.766973+0000","last_unstale":"2023-11-28T19:59:10.097144+0000","last_undegraded":"2023-11-28T19:59:10.097144+0000","last_fullsized":"2023-11-28T19:59:10.097144+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:59:05.015714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:59:05.015714+0000","last_clean_scrub_stamp":"2023-11-28T19:59:05.015714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:21:21.519406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T19:59:10.092009+0000","last_change":"2023-11-28T19:59:05.760962+0000","last_active":"2023-11-28T19:59:10.092009+0000","last_peered":"2023-11-28T19:59:10.092009+0000","last_clean":"2023-11-28T19:59:10.092009+0000","last_became_active":"2023-11-28T19:59:05.760666+0000","last_became_peered":"2023-11-28T19:59:05.760666+0000","last_unstale":"2023-11-28T19:59:10.092009+0000","last_undegraded":"2023-11-28T19:59:10.092009+0000","last_fullsized":"2023-11-28T19:59:10.092009+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:59:05.015714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:59:05.015714+0000","last_clean_scrub_stamp":"2023-11-28T19:59:05.015714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:21:21.519406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T19:59:10.085859+0000","last_change":"2023-11-28T19:59:05.769994+0000","last_active":"2023-11-28T19:59:10.085859+0000","last_peered":"2023-11-28T19:59:10.085859+0000","last_clean":"2023-11-28T19:59:10.085859+0000","last_became_active":"2023-11-28T19:59:05.764430+0000","last_became_peered":"2023-11-28T19:59:05.764430+0000","last_unstale":"2023-11-28T19:59:10.085859+0000","last_undegraded":"2023-11-28T19:59:10.085859+0000","last_fullsized":"2023-11-28T19:59:10.085859+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:59:05.015714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:59:05.015714+0000","last_clean_scrub_stamp":"2023-11-28T19:59:05.015714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:13:21.633400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T19:59:10.087468+0000","last_change":"2023-11-28T19:59:05.776439+0000","last_active":"2023-11-28T19:59:10.087468+0000","last_peered":"2023-11-28T19:59:10.087468+0000","last_clean":"2023-11-28T19:59:10.087468+0000","last_became_active":"2023-11-28T19:59:05.776196+0000","last_became_peered":"2023-11-28T19:59:05.776196+0000","last_unstale":"2023-11-28T19:59:10.087468+0000","last_undegraded":"2023-11-28T19:59:10.087468+0000","last_fullsized":"2023-11-28T19:59:10.087468+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:59:05.015714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:59:05.015714+0000","last_clean_scrub_stamp":"2023-11-28T19:59:05.015714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:44:02.102081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T19:59:10.086540+0000","last_change":"2023-11-28T19:59:05.775620+0000","last_active":"2023-11-28T19:59:10.086540+0000","last_peered":"2023-11-28T19:59:10.086540+0000","last_clean":"2023-11-28T19:59:10.086540+0000","last_became_active":"2023-11-28T19:59:05.775057+0000","last_became_peered":"2023-11-28T19:59:05.775057+0000","last_unstale":"2023-11-28T19:59:10.086540+0000","last_undegraded":"2023-11-28T19:59:10.086540+0000","last_fullsized":"2023-11-28T19:59:10.086540+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:59:05.015714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:59:05.015714+0000","last_clean_scrub_stamp":"2023-11-28T19:59:05.015714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:21:21.519406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T19:59:10.105499+0000","last_change":"2023-11-28T19:59:05.783460+0000","last_active":"2023-11-28T19:59:10.105499+0000","last_peered":"2023-11-28T19:59:10.105499+0000","last_clean":"2023-11-28T19:59:10.105499+0000","last_became_active":"2023-11-28T19:59:05.783195+0000","last_became_peered":"2023-11-28T19:59:05.783195+0000","last_unstale":"2023-11-28T19:59:10.105499+0000","last_undegraded":"2023-11-28T19:59:10.105499+0000","last_fullsized":"2023-11-28T19:59:10.105499+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:59:05.015714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:59:05.015714+0000","last_clean_scrub_stamp":"2023-11-28T19:59:05.015714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:18:37.608605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T19:59:10.096571+0000","last_change":"2023-11-28T19:59:05.775976+0000","last_active":"2023-11-28T19:59:10.096571+0000","last_peered":"2023-11-28T19:59:10.096571+0000","last_clean":"2023-11-28T19:59:10.096571+0000","last_became_active":"2023-11-28T19:59:05.775738+0000","last_became_peered":"2023-11-28T19:59:05.775738+0000","last_unstale":"2023-11-28T19:59:10.096571+0000","last_undegraded":"2023-11-28T19:59:10.096571+0000","last_fullsized":"2023-11-28T19:59:10.096571+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:59:05.015714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:59:05.015714+0000","last_clean_scrub_stamp":"2023-11-28T19:59:05.015714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T06:26:55.424441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T19:59:10.231824+0000","last_change":"2023-11-28T19:59:05.786686+0000","last_active":"2023-11-28T19:59:10.231824+0000","last_peered":"2023-11-28T19:59:10.231824+0000","last_clean":"2023-11-28T19:59:10.231824+0000","last_became_active":"2023-11-28T19:59:05.786141+0000","last_became_peered":"2023-11-28T19:59:05.786141+0000","last_unstale":"2023-11-28T19:59:10.231824+0000","last_undegraded":"2023-11-28T19:59:10.231824+0000","last_fullsized":"2023-11-28T19:59:10.231824+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:59:05.015714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:59:05.015714+0000","last_clean_scrub_stamp":"2023-11-28T19:59:05.015714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:04:18.564508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T19:59:10.081827+0000","last_change":"2023-11-28T19:59:05.768915+0000","last_active":"2023-11-28T19:59:10.081827+0000","last_peered":"2023-11-28T19:59:10.081827+0000","last_clean":"2023-11-28T19:59:10.081827+0000","last_became_active":"2023-11-28T19:59:05.768661+0000","last_became_peered":"2023-11-28T19:59:05.768661+0000","last_unstale":"2023-11-28T19:59:10.081827+0000","last_undegraded":"2023-11-28T19:59:10.081827+0000","last_fullsized":"2023-11-28T19:59:10.081827+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:59:05.015714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:59:05.015714+0000","last_clean_scrub_stamp":"2023-11-28T19:59:05.015714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T06:50:51.335785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T19:59:10.086791+0000","last_change":"2023-11-28T19:59:05.763580+0000","last_active":"2023-11-28T19:59:10.086791+0000","last_peered":"2023-11-28T19:59:10.086791+0000","last_clean":"2023-11-28T19:59:10.086791+0000","last_became_active":"2023-11-28T19:59:05.763254+0000","last_became_peered":"2023-11-28T19:59:05.763254+0000","last_unstale":"2023-11-28T19:59:10.086791+0000","last_undegraded":"2023-11-28T19:59:10.086791+0000","last_fullsized":"2023-11-28T19:59:10.086791+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:59:05.015714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:59:05.015714+0000","last_clean_scrub_stamp":"2023-11-28T19:59:05.015714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:50:40.999064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T19:59:10.085773+0000","last_change":"2023-11-28T19:59:05.774080+0000","last_active":"2023-11-28T19:59:10.085773+0000","last_peered":"2023-11-28T19:59:10.085773+0000","last_clean":"2023-11-28T19:59:10.085773+0000","last_became_active":"2023-11-28T19:59:05.773751+0000","last_became_peered":"2023-11-28T19:59:05.773751+0000","last_unstale":"2023-11-28T19:59:10.085773+0000","last_undegraded":"2023-11-28T19:59:10.085773+0000","last_fullsized":"2023-11-28T19:59:10.085773+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:59:05.015714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:59:05.015714+0000","last_clean_scrub_stamp":"2023-11-28T19:59:05.015714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:05:03.688191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T19:59:10.098523+0000","last_change":"2023-11-28T19:59:05.766875+0000","last_active":"2023-11-28T19:59:10.098523+0000","last_peered":"2023-11-28T19:59:10.098523+0000","last_clean":"2023-11-28T19:59:10.098523+0000","last_became_active":"2023-11-28T19:59:05.766555+0000","last_became_peered":"2023-11-28T19:59:05.766555+0000","last_unstale":"2023-11-28T19:59:10.098523+0000","last_undegraded":"2023-11-28T19:59:10.098523+0000","last_fullsized":"2023-11-28T19:59:10.098523+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:59:05.015714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:59:05.015714+0000","last_clean_scrub_stamp":"2023-11-28T19:59:05.015714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:00:56.432813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T19:59:10.105223+0000","last_change":"2023-11-28T19:59:05.769350+0000","last_active":"2023-11-28T19:59:10.105223+0000","last_peered":"2023-11-28T19:59:10.105223+0000","last_clean":"2023-11-28T19:59:10.105223+0000","last_became_active":"2023-11-28T19:59:05.769067+0000","last_became_peered":"2023-11-28T19:59:05.769067+0000","last_unstale":"2023-11-28T19:59:10.105223+0000","last_undegraded":"2023-11-28T19:59:10.105223+0000","last_fullsized":"2023-11-28T19:59:10.105223+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:59:05.015714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:59:05.015714+0000","last_clean_scrub_stamp":"2023-11-28T19:59:05.015714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:24:48.272826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T19:59:10.085817+0000","last_change":"2023-11-28T19:59:05.768359+0000","last_active":"2023-11-28T19:59:10.085817+0000","last_peered":"2023-11-28T19:59:10.085817+0000","last_clean":"2023-11-28T19:59:10.085817+0000","last_became_active":"2023-11-28T19:59:05.768033+0000","last_became_peered":"2023-11-28T19:59:05.768033+0000","last_unstale":"2023-11-28T19:59:10.085817+0000","last_undegraded":"2023-11-28T19:59:10.085817+0000","last_fullsized":"2023-11-28T19:59:10.085817+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:59:05.015714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:59:05.015714+0000","last_clean_scrub_stamp":"2023-11-28T19:59:05.015714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:00:56.432813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T19:59:10.093892+0000","last_change":"2023-11-28T19:59:05.769430+0000","last_active":"2023-11-28T19:59:10.093892+0000","last_peered":"2023-11-28T19:59:10.093892+0000","last_clean":"2023-11-28T19:59:10.093892+0000","last_became_active":"2023-11-28T19:59:05.769077+0000","last_became_peered":"2023-11-28T19:59:05.769077+0000","last_unstale":"2023-11-28T19:59:10.093892+0000","last_undegraded":"2023-11-28T19:59:10.093892+0000","last_fullsized":"2023-11-28T19:59:10.093892+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:59:05.015714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:59:05.015714+0000","last_clean_scrub_stamp":"2023-11-28T19:59:05.015714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T06:50:51.335785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T19:59:10.096948+0000","last_change":"2023-11-28T19:59:05.780244+0000","last_active":"2023-11-28T19:59:10.096948+0000","last_peered":"2023-11-28T19:59:10.096948+0000","last_clean":"2023-11-28T19:59:10.096948+0000","last_became_active":"2023-11-28T19:59:05.779967+0000","last_became_peered":"2023-11-28T19:59:05.779967+0000","last_unstale":"2023-11-28T19:59:10.096948+0000","last_undegraded":"2023-11-28T19:59:10.096948+0000","last_fullsized":"2023-11-28T19:59:10.096948+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:59:05.015714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:59:05.015714+0000","last_clean_scrub_stamp":"2023-11-28T19:59:05.015714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:37:45.006198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T19:59:10.097115+0000","last_change":"2023-11-28T19:59:05.780306+0000","last_active":"2023-11-28T19:59:10.097115+0000","last_peered":"2023-11-28T19:59:10.097115+0000","last_clean":"2023-11-28T19:59:10.097115+0000","last_became_active":"2023-11-28T19:59:05.780039+0000","last_became_peered":"2023-11-28T19:59:05.780039+0000","last_unstale":"2023-11-28T19:59:10.097115+0000","last_undegraded":"2023-11-28T19:59:10.097115+0000","last_fullsized":"2023-11-28T19:59:10.097115+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:59:05.015714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:59:05.015714+0000","last_clean_scrub_stamp":"2023-11-28T19:59:05.015714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:05:03.688191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T19:59:10.232048+0000","last_change":"2023-11-28T19:59:05.786228+0000","last_active":"2023-11-28T19:59:10.232048+0000","last_peered":"2023-11-28T19:59:10.232048+0000","last_clean":"2023-11-28T19:59:10.232048+0000","last_became_active":"2023-11-28T19:59:05.785937+0000","last_became_peered":"2023-11-28T19:59:05.785937+0000","last_unstale":"2023-11-28T19:59:10.232048+0000","last_undegraded":"2023-11-28T19:59:10.232048+0000","last_fullsized":"2023-11-28T19:59:10.232048+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:59:05.015714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:59:05.015714+0000","last_clean_scrub_stamp":"2023-11-28T19:59:05.015714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:27:34.900513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T19:59:10.086749+0000","last_change":"2023-11-28T19:59:05.764238+0000","last_active":"2023-11-28T19:59:10.086749+0000","last_peered":"2023-11-28T19:59:10.086749+0000","last_clean":"2023-11-28T19:59:10.086749+0000","last_became_active":"2023-11-28T19:59:05.763941+0000","last_became_peered":"2023-11-28T19:59:05.763941+0000","last_unstale":"2023-11-28T19:59:10.086749+0000","last_undegraded":"2023-11-28T19:59:10.086749+0000","last_fullsized":"2023-11-28T19:59:10.086749+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:59:05.015714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:59:05.015714+0000","last_clean_scrub_stamp":"2023-11-28T19:59:05.015714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:18:37.608605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T19:59:10.231401+0000","last_change":"2023-11-28T19:59:05.777444+0000","last_active":"2023-11-28T19:59:10.231401+0000","last_peered":"2023-11-28T19:59:10.231401+0000","last_clean":"2023-11-28T19:59:10.231401+0000","last_became_active":"2023-11-28T19:59:05.777096+0000","last_became_peered":"2023-11-28T19:59:05.777096+0000","last_unstale":"2023-11-28T19:59:10.231401+0000","last_undegraded":"2023-11-28T19:59:10.231401+0000","last_fullsized":"2023-11-28T19:59:10.231401+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:59:05.015714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:59:05.015714+0000","last_clean_scrub_stamp":"2023-11-28T19:59:05.015714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:37:45.006198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T19:59:10.086470+0000","last_change":"2023-11-28T19:59:05.775817+0000","last_active":"2023-11-28T19:59:10.086470+0000","last_peered":"2023-11-28T19:59:10.086470+0000","last_clean":"2023-11-28T19:59:10.086470+0000","last_became_active":"2023-11-28T19:59:05.775434+0000","last_became_peered":"2023-11-28T19:59:05.775434+0000","last_unstale":"2023-11-28T19:59:10.086470+0000","last_undegraded":"2023-11-28T19:59:10.086470+0000","last_fullsized":"2023-11-28T19:59:10.086470+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:59:05.015714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:59:05.015714+0000","last_clean_scrub_stamp":"2023-11-28T19:59:05.015714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:37:45.006198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T19:59:10.231662+0000","last_change":"2023-11-28T19:59:05.773714+0000","last_active":"2023-11-28T19:59:10.231662+0000","last_peered":"2023-11-28T19:59:10.231662+0000","last_clean":"2023-11-28T19:59:10.231662+0000","last_became_active":"2023-11-28T19:59:05.773423+0000","last_became_peered":"2023-11-28T19:59:05.773423+0000","last_unstale":"2023-11-28T19:59:10.231662+0000","last_undegraded":"2023-11-28T19:59:10.231662+0000","last_fullsized":"2023-11-28T19:59:10.231662+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:59:05.015714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:59:05.015714+0000","last_clean_scrub_stamp":"2023-11-28T19:59:05.015714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:13:21.633400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T19:59:10.087840+0000","last_change":"2023-11-28T19:59:05.770679+0000","last_active":"2023-11-28T19:59:10.087840+0000","last_peered":"2023-11-28T19:59:10.087840+0000","last_clean":"2023-11-28T19:59:10.087840+0000","last_became_active":"2023-11-28T19:59:05.770220+0000","last_became_peered":"2023-11-28T19:59:05.770220+0000","last_unstale":"2023-11-28T19:59:10.087840+0000","last_undegraded":"2023-11-28T19:59:10.087840+0000","last_fullsized":"2023-11-28T19:59:10.087840+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:59:05.015714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:59:05.015714+0000","last_clean_scrub_stamp":"2023-11-28T19:59:05.015714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:56:09.640427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T19:59:10.106440+0000","last_change":"2023-11-28T19:59:05.763243+0000","last_active":"2023-11-28T19:59:10.106440+0000","last_peered":"2023-11-28T19:59:10.106440+0000","last_clean":"2023-11-28T19:59:10.106440+0000","last_became_active":"2023-11-28T19:59:05.762624+0000","last_became_peered":"2023-11-28T19:59:05.762624+0000","last_unstale":"2023-11-28T19:59:10.106440+0000","last_undegraded":"2023-11-28T19:59:10.106440+0000","last_fullsized":"2023-11-28T19:59:10.106440+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:59:05.015714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:59:05.015714+0000","last_clean_scrub_stamp":"2023-11-28T19:59:05.015714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:21:11.899134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T19:59:10.099378+0000","last_change":"2023-11-28T19:59:05.766991+0000","last_active":"2023-11-28T19:59:10.099378+0000","last_peered":"2023-11-28T19:59:10.099378+0000","last_clean":"2023-11-28T19:59:10.099378+0000","last_became_active":"2023-11-28T19:59:05.766715+0000","last_became_peered":"2023-11-28T19:59:05.766715+0000","last_unstale":"2023-11-28T19:59:10.099378+0000","last_undegraded":"2023-11-28T19:59:10.099378+0000","last_fullsized":"2023-11-28T19:59:10.099378+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:59:05.015714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:59:05.015714+0000","last_clean_scrub_stamp":"2023-11-28T19:59:05.015714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:05:03.688191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T19:59:10.231952+0000","last_change":"2023-11-28T19:59:05.784181+0000","last_active":"2023-11-28T19:59:10.231952+0000","last_peered":"2023-11-28T19:59:10.231952+0000","last_clean":"2023-11-28T19:59:10.231952+0000","last_became_active":"2023-11-28T19:59:05.783940+0000","last_became_peered":"2023-11-28T19:59:05.783940+0000","last_unstale":"2023-11-28T19:59:10.231952+0000","last_undegraded":"2023-11-28T19:59:10.231952+0000","last_fullsized":"2023-11-28T19:59:10.231952+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:59:05.015714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:59:05.015714+0000","last_clean_scrub_stamp":"2023-11-28T19:59:05.015714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:59:15.117552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4639,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9278,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":66748,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574857,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27348,"kb_used_data":328,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344492,"statfs":{"total":96636764160,"available":96608759808,"internally_reserved":0,"allocated":335872,"data_stored":695413,"data_compressed":33374,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67400000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51200000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60899999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45600000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.623}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42399999999999999}]}]},{"osd":6,"up_from":13,"seq":55834574855,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27288,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344552,"statfs":{"total":96636764160,"available":96608821248,"internally_reserved":0,"allocated":278528,"data_stored":108304,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40600000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63700000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54800000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58799999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51600000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68899999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73699999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574857,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27292,"kb_used_data":264,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344548,"statfs":{"total":96636764160,"available":96608817152,"internally_reserved":0,"allocated":270336,"data_stored":104553,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65200000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69399999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.753}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85399999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88300000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97699999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94699999999999995}]}]},{"osd":4,"up_from":13,"seq":55834574856,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27300,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344540,"statfs":{"total":96636764160,"available":96608808960,"internally_reserved":0,"allocated":278528,"data_stored":104589,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54900000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80000000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82299999999999995}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66800000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73599999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85399999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75}]}]},{"osd":3,"up_from":13,"seq":55834574857,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27288,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344552,"statfs":{"total":96636764160,"available":96608821248,"internally_reserved":0,"allocated":278528,"data_stored":108304,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42299999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47399999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40999999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44400000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59399999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48999999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61099999999999999}]}]},{"osd":2,"up_from":13,"seq":55834574855,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27288,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344552,"statfs":{"total":96636764160,"available":96608821248,"internally_reserved":0,"allocated":266240,"data_stored":104463,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.497}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44400000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41799999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92600000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94199999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95999999999999996}]}]},{"osd":1,"up_from":13,"seq":55834574857,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27300,"kb_used_data":268,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344540,"statfs":{"total":96636764160,"available":96608808960,"internally_reserved":0,"allocated":274432,"data_stored":104623,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.31}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38400000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54400000000000004}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78500000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.745}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92700000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80000000000000004}]}]},{"osd":0,"up_from":13,"seq":55834574856,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27360,"kb_used_data":336,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344480,"statfs":{"total":96636764160,"available":96608747520,"internally_reserved":0,"allocated":344064,"data_stored":695469,"data_compressed":33374,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56499999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52500000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46899999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93400000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91800000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95799999999999996}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33374,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33374,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3841,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3841,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-28T19:59:24.847 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-28T19:59:25.024 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:25.019+0000 7fa052fe6640 1 Processor -- start 2023-11-28T19:59:25.024 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:25.019+0000 7fa052fe6640 1 -- start start 2023-11-28T19:59:25.026 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:25.019+0000 7fa052fe6640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fa04c06bef0 0x7fa04c0bfce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:25.026 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:25.019+0000 7fa052fe6640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fa04c06c5b0 0x7fa04c06ca20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:25.027 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:25.019+0000 7fa052fe6640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa04c151690 con 0x7fa04c14e3f0 2023-11-28T19:59:25.027 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:25.019+0000 7fa052fe6640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa04c151bc0 con 0x7fa04c06bef0 2023-11-28T19:59:25.027 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:25.019+0000 7fa052fe6640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa04c1518e0 con 0x7fa04c06c5b0 2023-11-28T19:59:25.027 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:25.019+0000 7fa050d82640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7fa04c14e3f0 0x7fa04c0c41f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:35222/0 (socket says 172.21.15.78:35222) 2023-11-28T19:59:25.027 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:25.019+0000 7fa050d82640 1 -- 172.21.15.78:0/465436119 learned_addr learned my addr 172.21.15.78:0/465436119 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-11-28T19:59:25.027 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:25.019+0000 7fa04bfff640 1 --2- 172.21.15.78:0/465436119 >> v2:172.21.15.78:3300/0 conn(0x7fa04c06bef0 0x7fa04c0bfce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:25.027 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:25.019+0000 7fa051583640 1 --2- 172.21.15.78:0/465436119 >> v2:172.21.15.179:3300/0 conn(0x7fa04c06c5b0 0x7fa04c06ca20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:25.028 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:25.019+0000 7fa04b7fe640 1 -- 172.21.15.78:0/465436119 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3226391931 0 0) 0x7fa04c151690 con 0x7fa04c14e3f0 2023-11-28T19:59:25.028 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:25.019+0000 7fa04b7fe640 1 -- 172.21.15.78:0/465436119 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa03c003530 con 0x7fa04c14e3f0 2023-11-28T19:59:25.028 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:25.019+0000 7fa04bfff640 1 -- 172.21.15.78:0/465436119 >> v2:172.21.15.179:3300/0 conn(0x7fa04c06c5b0 msgr2=0x7fa04c06ca20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T19:59:25.028 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:25.019+0000 7fa04bfff640 1 --2- 172.21.15.78:0/465436119 >> v2:172.21.15.179:3300/0 conn(0x7fa04c06c5b0 0x7fa04c06ca20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:25.028 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:25.019+0000 7fa04bfff640 1 -- 172.21.15.78:0/465436119 >> v1:172.21.15.78:6789/0 conn(0x7fa04c14e3f0 legacy=0x7fa04c0c41f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:25.028 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:25.019+0000 7fa04bfff640 1 -- 172.21.15.78:0/465436119 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa04c0c1de0 con 0x7fa04c06bef0 2023-11-28T19:59:25.029 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:25.023+0000 7fa04bfff640 1 --2- 172.21.15.78:0/465436119 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa04c06bef0 0x7fa04c0bfce0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fa04c070480 tx=0x7fa03801c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9de47ef9910a581 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:59:25.030 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:25.023+0000 7fa04b7fe640 1 -- 172.21.15.78:0/465436119 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0380ab600 con 0x7fa04c06bef0 2023-11-28T19:59:25.030 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:25.023+0000 7fa04b7fe640 1 -- 172.21.15.78:0/465436119 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa0380a7050 con 0x7fa04c06bef0 2023-11-28T19:59:25.030 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:25.023+0000 7fa04b7fe640 1 -- 172.21.15.78:0/465436119 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0380ab980 con 0x7fa04c06bef0 2023-11-28T19:59:25.036 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:25.023+0000 7fa052fe6640 1 -- 172.21.15.78:0/465436119 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa04c06bef0 msgr2=0x7fa04c0bfce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:25.036 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:25.023+0000 7fa052fe6640 1 --2- 172.21.15.78:0/465436119 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa04c06bef0 0x7fa04c0bfce0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fa04c070480 tx=0x7fa03801c3a0 comp rx=0 tx=0).stop 2023-11-28T19:59:25.036 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:25.023+0000 7fa052fe6640 1 -- 172.21.15.78:0/465436119 shutdown_connections 2023-11-28T19:59:25.036 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:25.023+0000 7fa052fe6640 1 --2- 172.21.15.78:0/465436119 >> v2:172.21.15.179:3300/0 conn(0x7fa04c06c5b0 0x7fa04c06ca20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:25.036 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:25.023+0000 7fa052fe6640 1 --2- 172.21.15.78:0/465436119 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa04c06bef0 0x7fa04c0bfce0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:25.037 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:25.023+0000 7fa052fe6640 1 -- 172.21.15.78:0/465436119 >> 172.21.15.78:0/465436119 conn(0x7fa04c0a7810 msgr2=0x7fa04c0a7c20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T19:59:25.037 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:25.023+0000 7fa052fe6640 1 -- 172.21.15.78:0/465436119 shutdown_connections 2023-11-28T19:59:25.037 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:25.023+0000 7fa052fe6640 1 -- 172.21.15.78:0/465436119 wait complete. 2023-11-28T19:59:25.037 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:25.027+0000 7fa052fe6640 1 Processor -- start 2023-11-28T19:59:25.037 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:25.027+0000 7fa052fe6640 1 -- start start 2023-11-28T19:59:25.037 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:25.027+0000 7fa052fe6640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa04c06bef0 0x7fa04c1edb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:25.037 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:25.027+0000 7fa052fe6640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa04c06c5b0 0x7fa04c0718d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:25.037 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:25.027+0000 7fa052fe6640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa04c14e3f0 0x7fa04c0a6aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:25.038 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:25.027+0000 7fa052fe6640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa04c0a9af0 con 0x7fa04c14e3f0 2023-11-28T19:59:25.038 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:25.027+0000 7fa052fe6640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa04c071f20 con 0x7fa04c06bef0 2023-11-28T19:59:25.038 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:25.027+0000 7fa052fe6640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa04c072200 con 0x7fa04c06c5b0 2023-11-28T19:59:25.038 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:25.027+0000 7fa051583640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa04c14e3f0 0x7fa04c0a6aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:25.038 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:25.027+0000 7fa051583640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa04c14e3f0 0x7fa04c0a6aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:60640/0 (socket says 172.21.15.78:60640) 2023-11-28T19:59:25.038 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:25.027+0000 7fa051583640 1 -- 172.21.15.78:0/2318694620 learned_addr learned my addr 172.21.15.78:0/2318694620 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T19:59:25.038 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:25.027+0000 7fa04bfff640 1 --2- 172.21.15.78:0/2318694620 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa04c06c5b0 0x7fa04c0718d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:25.038 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:25.027+0000 7fa050d82640 1 --2- 172.21.15.78:0/2318694620 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa04c06bef0 0x7fa04c1edb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:25.038 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:25.027+0000 7fa051583640 1 -- 172.21.15.78:0/2318694620 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa04c06c5b0 msgr2=0x7fa04c0718d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:25.038 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:25.027+0000 7fa051583640 1 --2- 172.21.15.78:0/2318694620 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa04c06c5b0 0x7fa04c0718d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:25.038 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:25.027+0000 7fa051583640 1 -- 172.21.15.78:0/2318694620 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa04c06bef0 msgr2=0x7fa04c1edb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:25.038 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:25.027+0000 7fa051583640 1 --2- 172.21.15.78:0/2318694620 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa04c06bef0 0x7fa04c1edb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:25.039 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:25.027+0000 7fa051583640 1 -- 172.21.15.78:0/2318694620 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa038009420 con 0x7fa04c14e3f0 2023-11-28T19:59:25.039 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:25.027+0000 7fa051583640 1 --2- 172.21.15.78:0/2318694620 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa04c14e3f0 0x7fa04c0a6aa0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fa04400efc0 tx=0x7fa04400c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:59:25.039 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:25.027+0000 7fa0497fa640 1 -- 172.21.15.78:0/2318694620 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa044009b10 con 0x7fa04c14e3f0 2023-11-28T19:59:25.039 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:25.027+0000 7fa0497fa640 1 -- 172.21.15.78:0/2318694620 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa04400f040 con 0x7fa04c14e3f0 2023-11-28T19:59:25.039 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:25.027+0000 7fa0497fa640 1 -- 172.21.15.78:0/2318694620 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0440146c0 con 0x7fa04c14e3f0 2023-11-28T19:59:25.039 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:25.027+0000 7fa052fe6640 1 -- 172.21.15.78:0/2318694620 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa04c1ed030 con 0x7fa04c14e3f0 2023-11-28T19:59:25.039 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:25.027+0000 7fa052fe6640 1 -- 172.21.15.78:0/2318694620 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa04c1ed5f0 con 0x7fa04c14e3f0 2023-11-28T19:59:25.039 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:25.031+0000 7fa052fe6640 1 -- 172.21.15.78:0/2318694620 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa04c1ed7e0 con 0x7fa04c14e3f0 2023-11-28T19:59:25.039 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:25.031+0000 7fa0497fa640 1 -- 172.21.15.78:0/2318694620 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fa044014820 con 0x7fa04c14e3f0 2023-11-28T19:59:25.040 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:25.031+0000 7fa0497fa640 1 --2- 172.21.15.78:0/2318694620 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fa030066470 0x7fa030068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:25.040 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:25.031+0000 7fa0497fa640 1 -- 172.21.15.78:0/2318694620 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fa044084ee0 con 0x7fa04c14e3f0 2023-11-28T19:59:25.040 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:25.031+0000 7fa050d82640 1 --2- 172.21.15.78:0/2318694620 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fa030066470 0x7fa030068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:25.040 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:25.031+0000 7fa050d82640 1 --2- 172.21.15.78:0/2318694620 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fa030066470 0x7fa030068930 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fa0400011f0 tx=0x7fa040007d40 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:59:25.041 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:25.035+0000 7fa0497fa640 1 -- 172.21.15.78:0/2318694620 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fa044052080 con 0x7fa04c14e3f0 2023-11-28T19:59:25.187 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:25.183+0000 7fa052fe6640 1 -- 172.21.15.78:0/2318694620 --> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fa04c15b4b0 con 0x7fa030066470 2023-11-28T19:59:25.196 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:25.191+0000 7fa0497fa640 1 -- 172.21.15.78:0/2318694620 <== mgr.4106 v2:172.21.15.78:6832/2935380957 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+345346 (secure 0 0 0) 0x7fa040005860 con 0x7fa030066470 2023-11-28T19:59:25.199 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-11-28T19:59:25.201 INFO:teuthology.orchestra.run.smithi078.stderr:dumped all 2023-11-28T19:59:25.202 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:25.195+0000 7fa052fe6640 1 -- 172.21.15.78:0/2318694620 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fa030066470 msgr2=0x7fa030068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:25.203 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:25.195+0000 7fa052fe6640 1 --2- 172.21.15.78:0/2318694620 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fa030066470 0x7fa030068930 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fa0400011f0 tx=0x7fa040007d40 comp rx=0 tx=0).stop 2023-11-28T19:59:25.203 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:25.195+0000 7fa052fe6640 1 -- 172.21.15.78:0/2318694620 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa04c14e3f0 msgr2=0x7fa04c0a6aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:25.203 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:25.195+0000 7fa052fe6640 1 --2- 172.21.15.78:0/2318694620 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa04c14e3f0 0x7fa04c0a6aa0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fa04400efc0 tx=0x7fa04400c490 comp rx=0 tx=0).stop 2023-11-28T19:59:25.203 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:25.195+0000 7fa052fe6640 1 -- 172.21.15.78:0/2318694620 shutdown_connections 2023-11-28T19:59:25.203 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:25.195+0000 7fa052fe6640 1 --2- 172.21.15.78:0/2318694620 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fa030066470 0x7fa030068930 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:25.203 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:25.195+0000 7fa052fe6640 1 --2- 172.21.15.78:0/2318694620 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa04c06c5b0 0x7fa04c0718d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:25.203 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:25.195+0000 7fa052fe6640 1 --2- 172.21.15.78:0/2318694620 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa04c14e3f0 0x7fa04c0a6aa0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:25.203 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:25.195+0000 7fa052fe6640 1 --2- 172.21.15.78:0/2318694620 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa04c06bef0 0x7fa04c1edb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:25.203 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:25.195+0000 7fa052fe6640 1 -- 172.21.15.78:0/2318694620 >> 172.21.15.78:0/2318694620 conn(0x7fa04c0a7810 msgr2=0x7fa04c0c24f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T19:59:25.203 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:25.195+0000 7fa052fe6640 1 -- 172.21.15.78:0/2318694620 shutdown_connections 2023-11-28T19:59:25.203 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:25.195+0000 7fa052fe6640 1 -- 172.21.15.78:0/2318694620 wait complete. 2023-11-28T19:59:25.219 INFO:teuthology.orchestra.run.smithi078.stdout:{"pg_ready":true,"pg_map":{"version":34,"stamp":"2023-11-28T19:59:23.957066+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595007,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":207,"num_write_kb":2434,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":159,"ondisk_log_size":159,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":218464,"kb_used_data":2272,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754756256,"statfs":{"total":773094113280,"available":772870406144,"internally_reserved":0,"allocated":2326528,"data_stored":2025718,"data_compressed":66748,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2229,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002643"},"pg_stats":[{"pgid":"2.1f","version":"20'4","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T19:59:10.106180+0000","last_change":"2023-11-28T19:59:05.052960+0000","last_active":"2023-11-28T19:59:10.106180+0000","last_peered":"2023-11-28T19:59:10.106180+0000","last_clean":"2023-11-28T19:59:10.106180+0000","last_became_active":"2023-11-28T19:59:05.052657+0000","last_became_peered":"2023-11-28T19:59:05.052657+0000","last_unstale":"2023-11-28T19:59:10.106180+0000","last_undegraded":"2023-11-28T19:59:10.106180+0000","last_fullsized":"2023-11-28T19:59:10.106180+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:59:04.008158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:59:04.008158+0000","last_clean_scrub_stamp":"2023-11-28T19:59:04.008158+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:54:59.131019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T19:59:10.086896+0000","last_change":"2023-11-28T19:59:05.769584+0000","last_active":"2023-11-28T19:59:10.086896+0000","last_peered":"2023-11-28T19:59:10.086896+0000","last_clean":"2023-11-28T19:59:10.086896+0000","last_became_active":"2023-11-28T19:59:05.769323+0000","last_became_peered":"2023-11-28T19:59:05.769323+0000","last_unstale":"2023-11-28T19:59:10.086896+0000","last_undegraded":"2023-11-28T19:59:10.086896+0000","last_fullsized":"2023-11-28T19:59:10.086896+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:59:05.015714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:59:05.015714+0000","last_clean_scrub_stamp":"2023-11-28T19:59:05.015714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:37:45.006198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T19:59:10.748258+0000","last_change":"2023-11-28T19:59:10.237008+0000","last_active":"2023-11-28T19:59:10.748258+0000","last_peered":"2023-11-28T19:59:10.748258+0000","last_clean":"2023-11-28T19:59:10.748258+0000","last_became_active":"2023-11-28T19:59:10.236605+0000","last_became_peered":"2023-11-28T19:59:10.236605+0000","last_unstale":"2023-11-28T19:59:10.748258+0000","last_undegraded":"2023-11-28T19:59:10.748258+0000","last_fullsized":"2023-11-28T19:59:10.748258+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:59:09.059796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:59:09.059796+0000","last_clean_scrub_stamp":"2023-11-28T19:59:09.059796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T06:47:20.838966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"20'1","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T19:59:10.086983+0000","last_change":"2023-11-28T19:59:05.045307+0000","last_active":"2023-11-28T19:59:10.086983+0000","last_peered":"2023-11-28T19:59:10.086983+0000","last_clean":"2023-11-28T19:59:10.086983+0000","last_became_active":"2023-11-28T19:59:05.044997+0000","last_became_peered":"2023-11-28T19:59:05.044997+0000","last_unstale":"2023-11-28T19:59:10.086983+0000","last_undegraded":"2023-11-28T19:59:10.086983+0000","last_fullsized":"2023-11-28T19:59:10.086983+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:59:04.008158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:59:04.008158+0000","last_clean_scrub_stamp":"2023-11-28T19:59:04.008158+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T06:35:58.085712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T19:59:10.106013+0000","last_change":"2023-11-28T19:59:05.781411+0000","last_active":"2023-11-28T19:59:10.106013+0000","last_peered":"2023-11-28T19:59:10.106013+0000","last_clean":"2023-11-28T19:59:10.106013+0000","last_became_active":"2023-11-28T19:59:05.781197+0000","last_became_peered":"2023-11-28T19:59:05.781197+0000","last_unstale":"2023-11-28T19:59:10.106013+0000","last_undegraded":"2023-11-28T19:59:10.106013+0000","last_fullsized":"2023-11-28T19:59:10.106013+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:59:05.015714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:59:05.015714+0000","last_clean_scrub_stamp":"2023-11-28T19:59:05.015714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T06:26:55.424441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T19:59:10.750326+0000","last_change":"2023-11-28T19:59:10.118362+0000","last_active":"2023-11-28T19:59:10.750326+0000","last_peered":"2023-11-28T19:59:10.750326+0000","last_clean":"2023-11-28T19:59:10.750326+0000","last_became_active":"2023-11-28T19:59:10.117821+0000","last_became_peered":"2023-11-28T19:59:10.117821+0000","last_unstale":"2023-11-28T19:59:10.750326+0000","last_undegraded":"2023-11-28T19:59:10.750326+0000","last_fullsized":"2023-11-28T19:59:10.750326+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:59:09.059796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:59:09.059796+0000","last_clean_scrub_stamp":"2023-11-28T19:59:09.059796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:05:07.732273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"20'2","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T19:59:10.231816+0000","last_change":"2023-11-28T19:59:05.058010+0000","last_active":"2023-11-28T19:59:10.231816+0000","last_peered":"2023-11-28T19:59:10.231816+0000","last_clean":"2023-11-28T19:59:10.231816+0000","last_became_active":"2023-11-28T19:59:05.055487+0000","last_became_peered":"2023-11-28T19:59:05.055487+0000","last_unstale":"2023-11-28T19:59:10.231816+0000","last_undegraded":"2023-11-28T19:59:10.231816+0000","last_fullsized":"2023-11-28T19:59:10.231816+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:59:04.008158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:59:04.008158+0000","last_clean_scrub_stamp":"2023-11-28T19:59:04.008158+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:44:01.094524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T19:59:10.087933+0000","last_change":"2023-11-28T19:59:05.779496+0000","last_active":"2023-11-28T19:59:10.087933+0000","last_peered":"2023-11-28T19:59:10.087933+0000","last_clean":"2023-11-28T19:59:10.087933+0000","last_became_active":"2023-11-28T19:59:05.777976+0000","last_became_peered":"2023-11-28T19:59:05.777976+0000","last_unstale":"2023-11-28T19:59:10.087933+0000","last_undegraded":"2023-11-28T19:59:10.087933+0000","last_fullsized":"2023-11-28T19:59:10.087933+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:59:05.015714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:59:05.015714+0000","last_clean_scrub_stamp":"2023-11-28T19:59:05.015714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:43:15.986749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T19:59:10.751202+0000","last_change":"2023-11-28T19:59:10.119257+0000","last_active":"2023-11-28T19:59:10.751202+0000","last_peered":"2023-11-28T19:59:10.751202+0000","last_clean":"2023-11-28T19:59:10.751202+0000","last_became_active":"2023-11-28T19:59:10.118744+0000","last_became_peered":"2023-11-28T19:59:10.118744+0000","last_unstale":"2023-11-28T19:59:10.751202+0000","last_undegraded":"2023-11-28T19:59:10.751202+0000","last_fullsized":"2023-11-28T19:59:10.751202+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:59:09.059796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:59:09.059796+0000","last_clean_scrub_stamp":"2023-11-28T19:59:09.059796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:04:08.552896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"20'2","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T19:59:10.231591+0000","last_change":"2023-11-28T19:59:05.054063+0000","last_active":"2023-11-28T19:59:10.231591+0000","last_peered":"2023-11-28T19:59:10.231591+0000","last_clean":"2023-11-28T19:59:10.231591+0000","last_became_active":"2023-11-28T19:59:05.053212+0000","last_became_peered":"2023-11-28T19:59:05.053212+0000","last_unstale":"2023-11-28T19:59:10.231591+0000","last_undegraded":"2023-11-28T19:59:10.231591+0000","last_fullsized":"2023-11-28T19:59:10.231591+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:59:04.008158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:59:04.008158+0000","last_clean_scrub_stamp":"2023-11-28T19:59:04.008158+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:50:57.704628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T19:59:10.086946+0000","last_change":"2023-11-28T19:59:05.779167+0000","last_active":"2023-11-28T19:59:10.086946+0000","last_peered":"2023-11-28T19:59:10.086946+0000","last_clean":"2023-11-28T19:59:10.086946+0000","last_became_active":"2023-11-28T19:59:05.778874+0000","last_became_peered":"2023-11-28T19:59:05.778874+0000","last_unstale":"2023-11-28T19:59:10.086946+0000","last_undegraded":"2023-11-28T19:59:10.086946+0000","last_fullsized":"2023-11-28T19:59:10.086946+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:59:05.015714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:59:05.015714+0000","last_clean_scrub_stamp":"2023-11-28T19:59:05.015714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:59:15.117552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T19:59:10.750952+0000","last_change":"2023-11-28T19:59:10.104844+0000","last_active":"2023-11-28T19:59:10.750952+0000","last_peered":"2023-11-28T19:59:10.750952+0000","last_clean":"2023-11-28T19:59:10.750952+0000","last_became_active":"2023-11-28T19:59:10.104381+0000","last_became_peered":"2023-11-28T19:59:10.104381+0000","last_unstale":"2023-11-28T19:59:10.750952+0000","last_undegraded":"2023-11-28T19:59:10.750952+0000","last_fullsized":"2023-11-28T19:59:10.750952+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:59:09.059796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:59:09.059796+0000","last_clean_scrub_stamp":"2023-11-28T19:59:09.059796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:21:25.563488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T19:59:10.096108+0000","last_change":"2023-11-28T19:59:05.777551+0000","last_active":"2023-11-28T19:59:10.096108+0000","last_peered":"2023-11-28T19:59:10.096108+0000","last_clean":"2023-11-28T19:59:10.096108+0000","last_became_active":"2023-11-28T19:59:05.777205+0000","last_became_peered":"2023-11-28T19:59:05.777205+0000","last_unstale":"2023-11-28T19:59:10.096108+0000","last_undegraded":"2023-11-28T19:59:10.096108+0000","last_fullsized":"2023-11-28T19:59:10.096108+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:59:05.015714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:59:05.015714+0000","last_clean_scrub_stamp":"2023-11-28T19:59:05.015714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:34:41.640833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"20'2","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T19:59:10.231766+0000","last_change":"2023-11-28T19:59:05.059530+0000","last_active":"2023-11-28T19:59:10.231766+0000","last_peered":"2023-11-28T19:59:10.231766+0000","last_clean":"2023-11-28T19:59:10.231766+0000","last_became_active":"2023-11-28T19:59:05.059170+0000","last_became_peered":"2023-11-28T19:59:05.059170+0000","last_unstale":"2023-11-28T19:59:10.231766+0000","last_undegraded":"2023-11-28T19:59:10.231766+0000","last_fullsized":"2023-11-28T19:59:10.231766+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:59:04.008158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:59:04.008158+0000","last_clean_scrub_stamp":"2023-11-28T19:59:04.008158+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:59:05.695936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T19:59:10.751627+0000","last_change":"2023-11-28T19:59:10.107622+0000","last_active":"2023-11-28T19:59:10.751627+0000","last_peered":"2023-11-28T19:59:10.751627+0000","last_clean":"2023-11-28T19:59:10.751627+0000","last_became_active":"2023-11-28T19:59:10.107067+0000","last_became_peered":"2023-11-28T19:59:10.107067+0000","last_unstale":"2023-11-28T19:59:10.751627+0000","last_undegraded":"2023-11-28T19:59:10.751627+0000","last_fullsized":"2023-11-28T19:59:10.751627+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:59:09.059796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:59:09.059796+0000","last_clean_scrub_stamp":"2023-11-28T19:59:09.059796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:43:20.030831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T19:59:10.085907+0000","last_change":"2023-11-28T19:59:05.770916+0000","last_active":"2023-11-28T19:59:10.085907+0000","last_peered":"2023-11-28T19:59:10.085907+0000","last_clean":"2023-11-28T19:59:10.085907+0000","last_became_active":"2023-11-28T19:59:05.770356+0000","last_became_peered":"2023-11-28T19:59:05.770356+0000","last_unstale":"2023-11-28T19:59:10.085907+0000","last_undegraded":"2023-11-28T19:59:10.085907+0000","last_fullsized":"2023-11-28T19:59:10.085907+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:59:05.015714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:59:05.015714+0000","last_clean_scrub_stamp":"2023-11-28T19:59:05.015714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:05:03.688191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T19:59:10.100383+0000","last_change":"2023-11-28T19:59:05.047719+0000","last_active":"2023-11-28T19:59:10.100383+0000","last_peered":"2023-11-28T19:59:10.100383+0000","last_clean":"2023-11-28T19:59:10.100383+0000","last_became_active":"2023-11-28T19:59:05.047441+0000","last_became_peered":"2023-11-28T19:59:05.047441+0000","last_unstale":"2023-11-28T19:59:10.100383+0000","last_undegraded":"2023-11-28T19:59:10.100383+0000","last_fullsized":"2023-11-28T19:59:10.100383+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:59:04.008158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:59:04.008158+0000","last_clean_scrub_stamp":"2023-11-28T19:59:04.008158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:24:13.851530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T19:59:10.751634+0000","last_change":"2023-11-28T19:59:10.118258+0000","last_active":"2023-11-28T19:59:10.751634+0000","last_peered":"2023-11-28T19:59:10.751634+0000","last_clean":"2023-11-28T19:59:10.751634+0000","last_became_active":"2023-11-28T19:59:10.117812+0000","last_became_peered":"2023-11-28T19:59:10.117812+0000","last_unstale":"2023-11-28T19:59:10.751634+0000","last_undegraded":"2023-11-28T19:59:10.751634+0000","last_fullsized":"2023-11-28T19:59:10.751634+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:59:09.059796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:59:09.059796+0000","last_clean_scrub_stamp":"2023-11-28T19:59:09.059796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:04:22.608590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T19:59:10.086832+0000","last_change":"2023-11-28T19:59:05.767529+0000","last_active":"2023-11-28T19:59:10.086832+0000","last_peered":"2023-11-28T19:59:10.086832+0000","last_clean":"2023-11-28T19:59:10.086832+0000","last_became_active":"2023-11-28T19:59:05.767237+0000","last_became_peered":"2023-11-28T19:59:05.767237+0000","last_unstale":"2023-11-28T19:59:10.086832+0000","last_undegraded":"2023-11-28T19:59:10.086832+0000","last_fullsized":"2023-11-28T19:59:10.086832+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:59:05.015714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:59:05.015714+0000","last_clean_scrub_stamp":"2023-11-28T19:59:05.015714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:34:41.640833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T19:59:10.098640+0000","last_change":"2023-11-28T19:59:05.053041+0000","last_active":"2023-11-28T19:59:10.098640+0000","last_peered":"2023-11-28T19:59:10.098640+0000","last_clean":"2023-11-28T19:59:10.098640+0000","last_became_active":"2023-11-28T19:59:05.052673+0000","last_became_peered":"2023-11-28T19:59:05.052673+0000","last_unstale":"2023-11-28T19:59:10.098640+0000","last_undegraded":"2023-11-28T19:59:10.098640+0000","last_fullsized":"2023-11-28T19:59:10.098640+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:59:04.008158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:59:04.008158+0000","last_clean_scrub_stamp":"2023-11-28T19:59:04.008158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:50:57.704628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T19:59:10.893246+0000","last_change":"2023-11-28T19:59:10.238462+0000","last_active":"2023-11-28T19:59:10.893246+0000","last_peered":"2023-11-28T19:59:10.893246+0000","last_clean":"2023-11-28T19:59:10.893246+0000","last_became_active":"2023-11-28T19:59:10.237988+0000","last_became_peered":"2023-11-28T19:59:10.237988+0000","last_unstale":"2023-11-28T19:59:10.893246+0000","last_undegraded":"2023-11-28T19:59:10.893246+0000","last_fullsized":"2023-11-28T19:59:10.893246+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:59:09.059796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:59:09.059796+0000","last_clean_scrub_stamp":"2023-11-28T19:59:09.059796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:09:44.374501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T19:59:10.085913+0000","last_change":"2023-11-28T19:59:05.766196+0000","last_active":"2023-11-28T19:59:10.085913+0000","last_peered":"2023-11-28T19:59:10.085913+0000","last_clean":"2023-11-28T19:59:10.085913+0000","last_became_active":"2023-11-28T19:59:05.765432+0000","last_became_peered":"2023-11-28T19:59:05.765432+0000","last_unstale":"2023-11-28T19:59:10.085913+0000","last_undegraded":"2023-11-28T19:59:10.085913+0000","last_fullsized":"2023-11-28T19:59:10.085913+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:59:05.015714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:59:05.015714+0000","last_clean_scrub_stamp":"2023-11-28T19:59:05.015714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T07:38:27.535482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T19:59:10.231396+0000","last_change":"2023-11-28T19:59:05.057961+0000","last_active":"2023-11-28T19:59:10.231396+0000","last_peered":"2023-11-28T19:59:10.231396+0000","last_clean":"2023-11-28T19:59:10.231396+0000","last_became_active":"2023-11-28T19:59:05.054572+0000","last_became_peered":"2023-11-28T19:59:05.054572+0000","last_unstale":"2023-11-28T19:59:10.231396+0000","last_undegraded":"2023-11-28T19:59:10.231396+0000","last_fullsized":"2023-11-28T19:59:10.231396+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:59:04.008158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:59:04.008158+0000","last_clean_scrub_stamp":"2023-11-28T19:59:04.008158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:55:39.803978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T19:59:10.751124+0000","last_change":"2023-11-28T19:59:10.110793+0000","last_active":"2023-11-28T19:59:10.751124+0000","last_peered":"2023-11-28T19:59:10.751124+0000","last_clean":"2023-11-28T19:59:10.751124+0000","last_became_active":"2023-11-28T19:59:10.110217+0000","last_became_peered":"2023-11-28T19:59:10.110217+0000","last_unstale":"2023-11-28T19:59:10.751124+0000","last_undegraded":"2023-11-28T19:59:10.751124+0000","last_fullsized":"2023-11-28T19:59:10.751124+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:59:09.059796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:59:09.059796+0000","last_clean_scrub_stamp":"2023-11-28T19:59:09.059796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:13:25.677482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T19:59:10.105874+0000","last_change":"2023-11-28T19:59:05.766438+0000","last_active":"2023-11-28T19:59:10.105874+0000","last_peered":"2023-11-28T19:59:10.105874+0000","last_clean":"2023-11-28T19:59:10.105874+0000","last_became_active":"2023-11-28T19:59:05.766122+0000","last_became_peered":"2023-11-28T19:59:05.766122+0000","last_unstale":"2023-11-28T19:59:10.105874+0000","last_undegraded":"2023-11-28T19:59:10.105874+0000","last_fullsized":"2023-11-28T19:59:10.105874+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:59:05.015714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:59:05.015714+0000","last_clean_scrub_stamp":"2023-11-28T19:59:05.015714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:34:41.640833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"20'2","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T19:59:10.097521+0000","last_change":"2023-11-28T19:59:05.051854+0000","last_active":"2023-11-28T19:59:10.097521+0000","last_peered":"2023-11-28T19:59:10.097521+0000","last_clean":"2023-11-28T19:59:10.097521+0000","last_became_active":"2023-11-28T19:59:05.051577+0000","last_became_peered":"2023-11-28T19:59:05.051577+0000","last_unstale":"2023-11-28T19:59:10.097521+0000","last_undegraded":"2023-11-28T19:59:10.097521+0000","last_fullsized":"2023-11-28T19:59:10.097521+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:59:04.008158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:59:04.008158+0000","last_clean_scrub_stamp":"2023-11-28T19:59:04.008158+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:18:36.601049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T19:59:10.750635+0000","last_change":"2023-11-28T19:59:10.233198+0000","last_active":"2023-11-28T19:59:10.750635+0000","last_peered":"2023-11-28T19:59:10.750635+0000","last_clean":"2023-11-28T19:59:10.750635+0000","last_became_active":"2023-11-28T19:59:10.232788+0000","last_became_peered":"2023-11-28T19:59:10.232788+0000","last_unstale":"2023-11-28T19:59:10.750635+0000","last_undegraded":"2023-11-28T19:59:10.750635+0000","last_fullsized":"2023-11-28T19:59:10.750635+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:59:09.059796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:59:09.059796+0000","last_clean_scrub_stamp":"2023-11-28T19:59:09.059796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:37:49.050280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T19:59:10.092085+0000","last_change":"2023-11-28T19:59:05.765916+0000","last_active":"2023-11-28T19:59:10.092085+0000","last_peered":"2023-11-28T19:59:10.092085+0000","last_clean":"2023-11-28T19:59:10.092085+0000","last_became_active":"2023-11-28T19:59:05.765601+0000","last_became_peered":"2023-11-28T19:59:05.765601+0000","last_unstale":"2023-11-28T19:59:10.092085+0000","last_undegraded":"2023-11-28T19:59:10.092085+0000","last_fullsized":"2023-11-28T19:59:10.092085+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:59:05.015714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:59:05.015714+0000","last_clean_scrub_stamp":"2023-11-28T19:59:05.015714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:13:21.633400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"23'1","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T19:59:10.099470+0000","last_change":"2023-11-28T19:59:05.043611+0000","last_active":"2023-11-28T19:59:10.099470+0000","last_peered":"2023-11-28T19:59:10.099470+0000","last_clean":"2023-11-28T19:59:10.099470+0000","last_became_active":"2023-11-28T19:59:05.043302+0000","last_became_peered":"2023-11-28T19:59:05.043302+0000","last_unstale":"2023-11-28T19:59:10.099470+0000","last_undegraded":"2023-11-28T19:59:10.099470+0000","last_fullsized":"2023-11-28T19:59:10.099470+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:59:04.008158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:59:04.008158+0000","last_clean_scrub_stamp":"2023-11-28T19:59:04.008158+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:24:47.265269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T19:59:10.748068+0000","last_change":"2023-11-28T19:59:10.233040+0000","last_active":"2023-11-28T19:59:10.748068+0000","last_peered":"2023-11-28T19:59:10.748068+0000","last_clean":"2023-11-28T19:59:10.748068+0000","last_became_active":"2023-11-28T19:59:10.232226+0000","last_became_peered":"2023-11-28T19:59:10.232226+0000","last_unstale":"2023-11-28T19:59:10.748068+0000","last_undegraded":"2023-11-28T19:59:10.748068+0000","last_fullsized":"2023-11-28T19:59:10.748068+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:59:09.059796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:59:09.059796+0000","last_clean_scrub_stamp":"2023-11-28T19:59:09.059796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:08:16.809984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T19:59:10.098944+0000","last_change":"2023-11-28T19:59:05.756970+0000","last_active":"2023-11-28T19:59:10.098944+0000","last_peered":"2023-11-28T19:59:10.098944+0000","last_clean":"2023-11-28T19:59:10.098944+0000","last_became_active":"2023-11-28T19:59:05.756706+0000","last_became_peered":"2023-11-28T19:59:05.756706+0000","last_unstale":"2023-11-28T19:59:10.098944+0000","last_undegraded":"2023-11-28T19:59:10.098944+0000","last_fullsized":"2023-11-28T19:59:10.098944+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:59:05.015714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:59:05.015714+0000","last_clean_scrub_stamp":"2023-11-28T19:59:05.015714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T06:26:55.424441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T19:59:10.231897+0000","last_change":"2023-11-28T19:59:05.058655+0000","last_active":"2023-11-28T19:59:10.231897+0000","last_peered":"2023-11-28T19:59:10.231897+0000","last_clean":"2023-11-28T19:59:10.231897+0000","last_became_active":"2023-11-28T19:59:05.058338+0000","last_became_peered":"2023-11-28T19:59:05.058338+0000","last_unstale":"2023-11-28T19:59:10.231897+0000","last_undegraded":"2023-11-28T19:59:10.231897+0000","last_fullsized":"2023-11-28T19:59:10.231897+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:59:04.008158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:59:04.008158+0000","last_clean_scrub_stamp":"2023-11-28T19:59:04.008158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:39:43.991385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T19:59:10.892006+0000","last_change":"2023-11-28T19:59:10.234696+0000","last_active":"2023-11-28T19:59:10.892006+0000","last_peered":"2023-11-28T19:59:10.892006+0000","last_clean":"2023-11-28T19:59:10.892006+0000","last_became_active":"2023-11-28T19:59:10.234219+0000","last_became_peered":"2023-11-28T19:59:10.234219+0000","last_unstale":"2023-11-28T19:59:10.892006+0000","last_undegraded":"2023-11-28T19:59:10.892006+0000","last_fullsized":"2023-11-28T19:59:10.892006+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:59:09.059796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:59:09.059796+0000","last_clean_scrub_stamp":"2023-11-28T19:59:09.059796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:04:22.608590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T19:59:10.086968+0000","last_change":"2023-11-28T19:59:05.773876+0000","last_active":"2023-11-28T19:59:10.086968+0000","last_peered":"2023-11-28T19:59:10.086968+0000","last_clean":"2023-11-28T19:59:10.086968+0000","last_became_active":"2023-11-28T19:59:05.773097+0000","last_became_peered":"2023-11-28T19:59:05.773097+0000","last_unstale":"2023-11-28T19:59:10.086968+0000","last_undegraded":"2023-11-28T19:59:10.086968+0000","last_fullsized":"2023-11-28T19:59:10.086968+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:59:05.015714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:59:05.015714+0000","last_clean_scrub_stamp":"2023-11-28T19:59:05.015714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:09:40.330419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T19:59:10.099027+0000","last_change":"2023-11-28T19:59:05.045257+0000","last_active":"2023-11-28T19:59:10.099027+0000","last_peered":"2023-11-28T19:59:10.099027+0000","last_clean":"2023-11-28T19:59:10.099027+0000","last_became_active":"2023-11-28T19:59:05.037691+0000","last_became_peered":"2023-11-28T19:59:05.037691+0000","last_unstale":"2023-11-28T19:59:10.099027+0000","last_undegraded":"2023-11-28T19:59:10.099027+0000","last_fullsized":"2023-11-28T19:59:10.099027+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:59:04.008158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:59:04.008158+0000","last_clean_scrub_stamp":"2023-11-28T19:59:04.008158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:44:01.094524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T19:59:10.892407+0000","last_change":"2023-11-28T19:59:10.110882+0000","last_active":"2023-11-28T19:59:10.892407+0000","last_peered":"2023-11-28T19:59:10.892407+0000","last_clean":"2023-11-28T19:59:10.892407+0000","last_became_active":"2023-11-28T19:59:10.110154+0000","last_became_peered":"2023-11-28T19:59:10.110154+0000","last_unstale":"2023-11-28T19:59:10.892407+0000","last_undegraded":"2023-11-28T19:59:10.892407+0000","last_fullsized":"2023-11-28T19:59:10.892407+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:59:09.059796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:59:09.059796+0000","last_clean_scrub_stamp":"2023-11-28T19:59:09.059796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:59:19.161634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T19:59:10.088733+0000","last_change":"2023-11-28T19:59:05.768336+0000","last_active":"2023-11-28T19:59:10.088733+0000","last_peered":"2023-11-28T19:59:10.088733+0000","last_clean":"2023-11-28T19:59:10.088733+0000","last_became_active":"2023-11-28T19:59:05.768035+0000","last_became_peered":"2023-11-28T19:59:05.768035+0000","last_unstale":"2023-11-28T19:59:10.088733+0000","last_undegraded":"2023-11-28T19:59:10.088733+0000","last_fullsized":"2023-11-28T19:59:10.088733+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:59:05.015714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:59:05.015714+0000","last_clean_scrub_stamp":"2023-11-28T19:59:05.015714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:54:54.632073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T19:59:10.086736+0000","last_change":"2023-11-28T19:59:05.039347+0000","last_active":"2023-11-28T19:59:10.086736+0000","last_peered":"2023-11-28T19:59:10.086736+0000","last_clean":"2023-11-28T19:59:10.086736+0000","last_became_active":"2023-11-28T19:59:05.038995+0000","last_became_peered":"2023-11-28T19:59:05.038995+0000","last_unstale":"2023-11-28T19:59:10.086736+0000","last_undegraded":"2023-11-28T19:59:10.086736+0000","last_fullsized":"2023-11-28T19:59:10.086736+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:59:04.008158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:59:04.008158+0000","last_clean_scrub_stamp":"2023-11-28T19:59:04.008158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T06:35:58.085712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T19:59:10.893010+0000","last_change":"2023-11-28T19:59:10.106996+0000","last_active":"2023-11-28T19:59:10.893010+0000","last_peered":"2023-11-28T19:59:10.893010+0000","last_clean":"2023-11-28T19:59:10.893010+0000","last_became_active":"2023-11-28T19:59:10.106321+0000","last_became_peered":"2023-11-28T19:59:10.106321+0000","last_unstale":"2023-11-28T19:59:10.893010+0000","last_undegraded":"2023-11-28T19:59:10.893010+0000","last_fullsized":"2023-11-28T19:59:10.893010+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:59:09.059796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:59:09.059796+0000","last_clean_scrub_stamp":"2023-11-28T19:59:09.059796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:27:38.944595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T19:59:10.098824+0000","last_change":"2023-11-28T19:59:05.756081+0000","last_active":"2023-11-28T19:59:10.098824+0000","last_peered":"2023-11-28T19:59:10.098824+0000","last_clean":"2023-11-28T19:59:10.098824+0000","last_became_active":"2023-11-28T19:59:05.755784+0000","last_became_peered":"2023-11-28T19:59:05.755784+0000","last_unstale":"2023-11-28T19:59:10.098824+0000","last_undegraded":"2023-11-28T19:59:10.098824+0000","last_fullsized":"2023-11-28T19:59:10.098824+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:59:05.015714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:59:05.015714+0000","last_clean_scrub_stamp":"2023-11-28T19:59:05.015714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:39:44.998942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T19:59:10.081517+0000","last_change":"2023-11-28T19:59:05.050192+0000","last_active":"2023-11-28T19:59:10.081517+0000","last_peered":"2023-11-28T19:59:10.081517+0000","last_clean":"2023-11-28T19:59:10.081517+0000","last_became_active":"2023-11-28T19:59:05.049835+0000","last_became_peered":"2023-11-28T19:59:05.049835+0000","last_unstale":"2023-11-28T19:59:10.081517+0000","last_undegraded":"2023-11-28T19:59:10.081517+0000","last_fullsized":"2023-11-28T19:59:10.081517+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:59:04.008158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:59:04.008158+0000","last_clean_scrub_stamp":"2023-11-28T19:59:04.008158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:55:39.803978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T19:59:10.893279+0000","last_change":"2023-11-28T19:59:10.105472+0000","last_active":"2023-11-28T19:59:10.893279+0000","last_peered":"2023-11-28T19:59:10.893279+0000","last_clean":"2023-11-28T19:59:10.893279+0000","last_became_active":"2023-11-28T19:59:10.103836+0000","last_became_peered":"2023-11-28T19:59:10.103836+0000","last_unstale":"2023-11-28T19:59:10.893279+0000","last_undegraded":"2023-11-28T19:59:10.893279+0000","last_fullsized":"2023-11-28T19:59:10.893279+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:59:09.059796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:59:09.059796+0000","last_clean_scrub_stamp":"2023-11-28T19:59:09.059796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:50:45.043146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T19:59:10.105131+0000","last_change":"2023-11-28T19:59:05.776449+0000","last_active":"2023-11-28T19:59:10.105131+0000","last_peered":"2023-11-28T19:59:10.105131+0000","last_clean":"2023-11-28T19:59:10.105131+0000","last_became_active":"2023-11-28T19:59:05.776170+0000","last_became_peered":"2023-11-28T19:59:05.776170+0000","last_unstale":"2023-11-28T19:59:10.105131+0000","last_undegraded":"2023-11-28T19:59:10.105131+0000","last_fullsized":"2023-11-28T19:59:10.105131+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:59:05.015714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:59:05.015714+0000","last_clean_scrub_stamp":"2023-11-28T19:59:05.015714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T06:35:59.093269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T19:59:10.231401+0000","last_change":"2023-11-28T19:59:05.053328+0000","last_active":"2023-11-28T19:59:10.231401+0000","last_peered":"2023-11-28T19:59:10.231401+0000","last_clean":"2023-11-28T19:59:10.231401+0000","last_became_active":"2023-11-28T19:59:05.053006+0000","last_became_peered":"2023-11-28T19:59:05.053006+0000","last_unstale":"2023-11-28T19:59:10.231401+0000","last_undegraded":"2023-11-28T19:59:10.231401+0000","last_fullsized":"2023-11-28T19:59:10.231401+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:59:04.008158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:59:04.008158+0000","last_clean_scrub_stamp":"2023-11-28T19:59:04.008158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T07:38:26.527925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T19:59:10.892291+0000","last_change":"2023-11-28T19:59:10.233184+0000","last_active":"2023-11-28T19:59:10.892291+0000","last_peered":"2023-11-28T19:59:10.892291+0000","last_clean":"2023-11-28T19:59:10.892291+0000","last_became_active":"2023-11-28T19:59:10.232695+0000","last_became_peered":"2023-11-28T19:59:10.232695+0000","last_unstale":"2023-11-28T19:59:10.892291+0000","last_undegraded":"2023-11-28T19:59:10.892291+0000","last_fullsized":"2023-11-28T19:59:10.892291+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:59:09.059796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:59:09.059796+0000","last_clean_scrub_stamp":"2023-11-28T19:59:09.059796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:50:45.043146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T19:59:10.091832+0000","last_change":"2023-11-28T19:59:05.779101+0000","last_active":"2023-11-28T19:59:10.091832+0000","last_peered":"2023-11-28T19:59:10.091832+0000","last_clean":"2023-11-28T19:59:10.091832+0000","last_became_active":"2023-11-28T19:59:05.778867+0000","last_became_peered":"2023-11-28T19:59:05.778867+0000","last_unstale":"2023-11-28T19:59:10.091832+0000","last_undegraded":"2023-11-28T19:59:10.091832+0000","last_fullsized":"2023-11-28T19:59:10.091832+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:59:05.015714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:59:05.015714+0000","last_clean_scrub_stamp":"2023-11-28T19:59:05.015714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T06:26:55.424441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T19:59:10.086389+0000","last_change":"2023-11-28T19:59:05.039775+0000","last_active":"2023-11-28T19:59:10.086389+0000","last_peered":"2023-11-28T19:59:10.086389+0000","last_clean":"2023-11-28T19:59:10.086389+0000","last_became_active":"2023-11-28T19:59:05.039360+0000","last_became_peered":"2023-11-28T19:59:05.039360+0000","last_unstale":"2023-11-28T19:59:10.086389+0000","last_undegraded":"2023-11-28T19:59:10.086389+0000","last_fullsized":"2023-11-28T19:59:10.086389+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:59:04.008158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:59:04.008158+0000","last_clean_scrub_stamp":"2023-11-28T19:59:04.008158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:55:39.803978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":169,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T19:59:10.231502+0000","last_change":"2023-11-28T19:58:56.136501+0000","last_active":"2023-11-28T19:59:10.231502+0000","last_peered":"2023-11-28T19:59:10.231502+0000","last_clean":"2023-11-28T19:59:10.231502+0000","last_became_active":"2023-11-28T19:58:56.135998+0000","last_became_peered":"2023-11-28T19:58:56.135998+0000","last_unstale":"2023-11-28T19:59:10.231502+0000","last_undegraded":"2023-11-28T19:59:10.231502+0000","last_fullsized":"2023-11-28T19:59:10.231502+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:58:54.602349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:58:54.602349+0000","last_clean_scrub_stamp":"2023-11-28T19:58:54.602349+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:33:42.723349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T19:59:10.892259+0000","last_change":"2023-11-28T19:59:10.237549+0000","last_active":"2023-11-28T19:59:10.892259+0000","last_peered":"2023-11-28T19:59:10.892259+0000","last_clean":"2023-11-28T19:59:10.892259+0000","last_became_active":"2023-11-28T19:59:10.237130+0000","last_became_peered":"2023-11-28T19:59:10.237130+0000","last_unstale":"2023-11-28T19:59:10.892259+0000","last_undegraded":"2023-11-28T19:59:10.892259+0000","last_fullsized":"2023-11-28T19:59:10.892259+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:59:09.059796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:59:09.059796+0000","last_clean_scrub_stamp":"2023-11-28T19:59:09.059796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:59:19.161634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T19:59:10.231699+0000","last_change":"2023-11-28T19:59:05.786506+0000","last_active":"2023-11-28T19:59:10.231699+0000","last_peered":"2023-11-28T19:59:10.231699+0000","last_clean":"2023-11-28T19:59:10.231699+0000","last_became_active":"2023-11-28T19:59:05.785858+0000","last_became_peered":"2023-11-28T19:59:05.785858+0000","last_unstale":"2023-11-28T19:59:10.231699+0000","last_undegraded":"2023-11-28T19:59:10.231699+0000","last_fullsized":"2023-11-28T19:59:10.231699+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:59:05.015714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:59:05.015714+0000","last_clean_scrub_stamp":"2023-11-28T19:59:05.015714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:04:04.508815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T19:59:10.081603+0000","last_change":"2023-11-28T19:59:05.038652+0000","last_active":"2023-11-28T19:59:10.081603+0000","last_peered":"2023-11-28T19:59:10.081603+0000","last_clean":"2023-11-28T19:59:10.081603+0000","last_became_active":"2023-11-28T19:59:05.038327+0000","last_became_peered":"2023-11-28T19:59:05.038327+0000","last_unstale":"2023-11-28T19:59:10.081603+0000","last_undegraded":"2023-11-28T19:59:10.081603+0000","last_fullsized":"2023-11-28T19:59:10.081603+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:59:04.008158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:59:04.008158+0000","last_clean_scrub_stamp":"2023-11-28T19:59:04.008158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:54:53.624516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T19:59:10.892210+0000","last_change":"2023-11-28T19:59:10.234188+0000","last_active":"2023-11-28T19:59:10.892210+0000","last_peered":"2023-11-28T19:59:10.892210+0000","last_clean":"2023-11-28T19:59:10.892210+0000","last_became_active":"2023-11-28T19:59:10.232817+0000","last_became_peered":"2023-11-28T19:59:10.232817+0000","last_unstale":"2023-11-28T19:59:10.892210+0000","last_undegraded":"2023-11-28T19:59:10.892210+0000","last_fullsized":"2023-11-28T19:59:10.892210+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:59:09.059796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:59:09.059796+0000","last_clean_scrub_stamp":"2023-11-28T19:59:09.059796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:04:22.608590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T19:59:10.088147+0000","last_change":"2023-11-28T19:59:05.770485+0000","last_active":"2023-11-28T19:59:10.088147+0000","last_peered":"2023-11-28T19:59:10.088147+0000","last_clean":"2023-11-28T19:59:10.088147+0000","last_became_active":"2023-11-28T19:59:05.769897+0000","last_became_peered":"2023-11-28T19:59:05.769897+0000","last_unstale":"2023-11-28T19:59:10.088147+0000","last_undegraded":"2023-11-28T19:59:10.088147+0000","last_fullsized":"2023-11-28T19:59:10.088147+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:59:05.015714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:59:05.015714+0000","last_clean_scrub_stamp":"2023-11-28T19:59:05.015714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:04:18.564508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"20'1","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T19:59:10.099741+0000","last_change":"2023-11-28T19:59:05.038199+0000","last_active":"2023-11-28T19:59:10.099741+0000","last_peered":"2023-11-28T19:59:10.099741+0000","last_clean":"2023-11-28T19:59:10.099741+0000","last_became_active":"2023-11-28T19:59:05.037884+0000","last_became_peered":"2023-11-28T19:59:05.037884+0000","last_unstale":"2023-11-28T19:59:10.099741+0000","last_undegraded":"2023-11-28T19:59:10.099741+0000","last_fullsized":"2023-11-28T19:59:10.099741+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:59:04.008158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:59:04.008158+0000","last_clean_scrub_stamp":"2023-11-28T19:59:04.008158+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:59:05.695936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T19:59:10.892205+0000","last_change":"2023-11-28T19:59:10.113074+0000","last_active":"2023-11-28T19:59:10.892205+0000","last_peered":"2023-11-28T19:59:10.892205+0000","last_clean":"2023-11-28T19:59:10.892205+0000","last_became_active":"2023-11-28T19:59:10.112703+0000","last_became_peered":"2023-11-28T19:59:10.112703+0000","last_unstale":"2023-11-28T19:59:10.892205+0000","last_undegraded":"2023-11-28T19:59:10.892205+0000","last_fullsized":"2023-11-28T19:59:10.892205+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:59:09.059796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:59:09.059796+0000","last_clean_scrub_stamp":"2023-11-28T19:59:09.059796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:09:44.374501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T19:59:10.232038+0000","last_change":"2023-11-28T19:59:05.787582+0000","last_active":"2023-11-28T19:59:10.232038+0000","last_peered":"2023-11-28T19:59:10.232038+0000","last_clean":"2023-11-28T19:59:10.232038+0000","last_became_active":"2023-11-28T19:59:05.786888+0000","last_became_peered":"2023-11-28T19:59:05.786888+0000","last_unstale":"2023-11-28T19:59:10.232038+0000","last_undegraded":"2023-11-28T19:59:10.232038+0000","last_fullsized":"2023-11-28T19:59:10.232038+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:59:05.015714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:59:05.015714+0000","last_clean_scrub_stamp":"2023-11-28T19:59:05.015714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:50:40.999064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"20'2","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T19:59:10.082013+0000","last_change":"2023-11-28T19:59:05.039063+0000","last_active":"2023-11-28T19:59:10.082013+0000","last_peered":"2023-11-28T19:59:10.082013+0000","last_clean":"2023-11-28T19:59:10.082013+0000","last_became_active":"2023-11-28T19:59:05.038803+0000","last_became_peered":"2023-11-28T19:59:05.038803+0000","last_unstale":"2023-11-28T19:59:10.082013+0000","last_undegraded":"2023-11-28T19:59:10.082013+0000","last_fullsized":"2023-11-28T19:59:10.082013+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:59:04.008158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:59:04.008158+0000","last_clean_scrub_stamp":"2023-11-28T19:59:04.008158+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:24:13.851530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T19:59:10.750166+0000","last_change":"2023-11-28T19:59:10.237605+0000","last_active":"2023-11-28T19:59:10.750166+0000","last_peered":"2023-11-28T19:59:10.750166+0000","last_clean":"2023-11-28T19:59:10.750166+0000","last_became_active":"2023-11-28T19:59:10.237079+0000","last_became_peered":"2023-11-28T19:59:10.237079+0000","last_unstale":"2023-11-28T19:59:10.750166+0000","last_undegraded":"2023-11-28T19:59:10.750166+0000","last_fullsized":"2023-11-28T19:59:10.750166+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:59:09.059796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:59:09.059796+0000","last_clean_scrub_stamp":"2023-11-28T19:59:09.059796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:47:39.329731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T19:59:10.231882+0000","last_change":"2023-11-28T19:59:05.784211+0000","last_active":"2023-11-28T19:59:10.231882+0000","last_peered":"2023-11-28T19:59:10.231882+0000","last_clean":"2023-11-28T19:59:10.231882+0000","last_became_active":"2023-11-28T19:59:05.783924+0000","last_became_peered":"2023-11-28T19:59:05.783924+0000","last_unstale":"2023-11-28T19:59:10.231882+0000","last_undegraded":"2023-11-28T19:59:10.231882+0000","last_fullsized":"2023-11-28T19:59:10.231882+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:59:05.015714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:59:05.015714+0000","last_clean_scrub_stamp":"2023-11-28T19:59:05.015714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:43:15.986749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"20'1","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T19:59:10.086589+0000","last_change":"2023-11-28T19:59:05.050003+0000","last_active":"2023-11-28T19:59:10.086589+0000","last_peered":"2023-11-28T19:59:10.086589+0000","last_clean":"2023-11-28T19:59:10.086589+0000","last_became_active":"2023-11-28T19:59:05.048751+0000","last_became_peered":"2023-11-28T19:59:05.048751+0000","last_unstale":"2023-11-28T19:59:10.086589+0000","last_undegraded":"2023-11-28T19:59:10.086589+0000","last_fullsized":"2023-11-28T19:59:10.086589+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:59:04.008158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:59:04.008158+0000","last_clean_scrub_stamp":"2023-11-28T19:59:04.008158+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:43:22.921922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T19:59:10.750165+0000","last_change":"2023-11-28T19:59:10.118418+0000","last_active":"2023-11-28T19:59:10.750165+0000","last_peered":"2023-11-28T19:59:10.750165+0000","last_clean":"2023-11-28T19:59:10.750165+0000","last_became_active":"2023-11-28T19:59:10.118013+0000","last_became_peered":"2023-11-28T19:59:10.118013+0000","last_unstale":"2023-11-28T19:59:10.750165+0000","last_undegraded":"2023-11-28T19:59:10.750165+0000","last_fullsized":"2023-11-28T19:59:10.750165+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:59:09.059796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:59:09.059796+0000","last_clean_scrub_stamp":"2023-11-28T19:59:09.059796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T06:26:59.468523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T19:59:10.231450+0000","last_change":"2023-11-28T19:59:05.781473+0000","last_active":"2023-11-28T19:59:10.231450+0000","last_peered":"2023-11-28T19:59:10.231450+0000","last_clean":"2023-11-28T19:59:10.231450+0000","last_became_active":"2023-11-28T19:59:05.781227+0000","last_became_peered":"2023-11-28T19:59:05.781227+0000","last_unstale":"2023-11-28T19:59:10.231450+0000","last_undegraded":"2023-11-28T19:59:10.231450+0000","last_fullsized":"2023-11-28T19:59:10.231450+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:59:05.015714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:59:05.015714+0000","last_clean_scrub_stamp":"2023-11-28T19:59:05.015714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:56:09.640427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"20'8","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T19:59:10.081395+0000","last_change":"2023-11-28T19:59:05.038647+0000","last_active":"2023-11-28T19:59:10.081395+0000","last_peered":"2023-11-28T19:59:10.081395+0000","last_clean":"2023-11-28T19:59:10.081395+0000","last_became_active":"2023-11-28T19:59:05.038338+0000","last_became_peered":"2023-11-28T19:59:05.038338+0000","last_unstale":"2023-11-28T19:59:10.081395+0000","last_undegraded":"2023-11-28T19:59:10.081395+0000","last_fullsized":"2023-11-28T19:59:10.081395+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:59:04.008158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:59:04.008158+0000","last_clean_scrub_stamp":"2023-11-28T19:59:04.008158+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T07:38:26.527925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T19:59:10.892176+0000","last_change":"2023-11-28T19:59:10.111085+0000","last_active":"2023-11-28T19:59:10.892176+0000","last_peered":"2023-11-28T19:59:10.892176+0000","last_clean":"2023-11-28T19:59:10.892176+0000","last_became_active":"2023-11-28T19:59:10.109559+0000","last_became_peered":"2023-11-28T19:59:10.109559+0000","last_unstale":"2023-11-28T19:59:10.892176+0000","last_undegraded":"2023-11-28T19:59:10.892176+0000","last_fullsized":"2023-11-28T19:59:10.892176+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:59:09.059796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:59:09.059796+0000","last_clean_scrub_stamp":"2023-11-28T19:59:09.059796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:27:38.944595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T19:59:10.095949+0000","last_change":"2023-11-28T19:59:05.770947+0000","last_active":"2023-11-28T19:59:10.095949+0000","last_peered":"2023-11-28T19:59:10.095949+0000","last_clean":"2023-11-28T19:59:10.095949+0000","last_became_active":"2023-11-28T19:59:05.770478+0000","last_became_peered":"2023-11-28T19:59:05.770478+0000","last_unstale":"2023-11-28T19:59:10.095949+0000","last_undegraded":"2023-11-28T19:59:10.095949+0000","last_fullsized":"2023-11-28T19:59:10.095949+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:59:05.015714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:59:05.015714+0000","last_clean_scrub_stamp":"2023-11-28T19:59:05.015714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:39:44.998942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T19:59:10.096036+0000","last_change":"2023-11-28T19:59:05.047423+0000","last_active":"2023-11-28T19:59:10.096036+0000","last_peered":"2023-11-28T19:59:10.096036+0000","last_clean":"2023-11-28T19:59:10.096036+0000","last_became_active":"2023-11-28T19:59:05.047076+0000","last_became_peered":"2023-11-28T19:59:05.047076+0000","last_unstale":"2023-11-28T19:59:10.096036+0000","last_undegraded":"2023-11-28T19:59:10.096036+0000","last_fullsized":"2023-11-28T19:59:10.096036+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:59:04.008158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:59:04.008158+0000","last_clean_scrub_stamp":"2023-11-28T19:59:04.008158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T06:50:50.328228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T19:59:10.748835+0000","last_change":"2023-11-28T19:59:10.238924+0000","last_active":"2023-11-28T19:59:10.748835+0000","last_peered":"2023-11-28T19:59:10.748835+0000","last_clean":"2023-11-28T19:59:10.748835+0000","last_became_active":"2023-11-28T19:59:10.237678+0000","last_became_peered":"2023-11-28T19:59:10.237678+0000","last_unstale":"2023-11-28T19:59:10.748835+0000","last_undegraded":"2023-11-28T19:59:10.748835+0000","last_fullsized":"2023-11-28T19:59:10.748835+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:59:09.059796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:59:09.059796+0000","last_clean_scrub_stamp":"2023-11-28T19:59:09.059796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:39:07.159036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T19:59:10.231706+0000","last_change":"2023-11-28T19:59:05.786376+0000","last_active":"2023-11-28T19:59:10.231706+0000","last_peered":"2023-11-28T19:59:10.231706+0000","last_clean":"2023-11-28T19:59:10.231706+0000","last_became_active":"2023-11-28T19:59:05.785920+0000","last_became_peered":"2023-11-28T19:59:05.785920+0000","last_unstale":"2023-11-28T19:59:10.231706+0000","last_undegraded":"2023-11-28T19:59:10.231706+0000","last_fullsized":"2023-11-28T19:59:10.231706+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:59:05.015714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:59:05.015714+0000","last_clean_scrub_stamp":"2023-11-28T19:59:05.015714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:09:40.330419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T19:59:10.086641+0000","last_change":"2023-11-28T19:59:05.046163+0000","last_active":"2023-11-28T19:59:10.086641+0000","last_peered":"2023-11-28T19:59:10.086641+0000","last_clean":"2023-11-28T19:59:10.086641+0000","last_became_active":"2023-11-28T19:59:05.045305+0000","last_became_peered":"2023-11-28T19:59:05.045305+0000","last_unstale":"2023-11-28T19:59:10.086641+0000","last_undegraded":"2023-11-28T19:59:10.086641+0000","last_fullsized":"2023-11-28T19:59:10.086641+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:59:04.008158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:59:04.008158+0000","last_clean_scrub_stamp":"2023-11-28T19:59:04.008158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:24:47.265269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T19:59:10.749020+0000","last_change":"2023-11-28T19:59:10.238640+0000","last_active":"2023-11-28T19:59:10.749020+0000","last_peered":"2023-11-28T19:59:10.749020+0000","last_clean":"2023-11-28T19:59:10.749020+0000","last_became_active":"2023-11-28T19:59:10.236870+0000","last_became_peered":"2023-11-28T19:59:10.236870+0000","last_unstale":"2023-11-28T19:59:10.749020+0000","last_undegraded":"2023-11-28T19:59:10.749020+0000","last_fullsized":"2023-11-28T19:59:10.749020+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:59:09.059796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:59:09.059796+0000","last_clean_scrub_stamp":"2023-11-28T19:59:09.059796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:43:34.452592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T19:59:10.105258+0000","last_change":"2023-11-28T19:59:05.772859+0000","last_active":"2023-11-28T19:59:10.105258+0000","last_peered":"2023-11-28T19:59:10.105258+0000","last_clean":"2023-11-28T19:59:10.105258+0000","last_became_active":"2023-11-28T19:59:05.772598+0000","last_became_peered":"2023-11-28T19:59:05.772598+0000","last_unstale":"2023-11-28T19:59:10.105258+0000","last_undegraded":"2023-11-28T19:59:10.105258+0000","last_fullsized":"2023-11-28T19:59:10.105258+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:59:05.015714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:59:05.015714+0000","last_clean_scrub_stamp":"2023-11-28T19:59:05.015714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:44:02.102081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"20'2","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T19:59:10.105695+0000","last_change":"2023-11-28T19:59:05.048324+0000","last_active":"2023-11-28T19:59:10.105695+0000","last_peered":"2023-11-28T19:59:10.105695+0000","last_clean":"2023-11-28T19:59:10.105695+0000","last_became_active":"2023-11-28T19:59:05.048010+0000","last_became_peered":"2023-11-28T19:59:05.048010+0000","last_unstale":"2023-11-28T19:59:10.105695+0000","last_undegraded":"2023-11-28T19:59:10.105695+0000","last_fullsized":"2023-11-28T19:59:10.105695+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:59:04.008158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:59:04.008158+0000","last_clean_scrub_stamp":"2023-11-28T19:59:04.008158+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:47:35.984593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T19:59:10.751337+0000","last_change":"2023-11-28T19:59:10.233429+0000","last_active":"2023-11-28T19:59:10.751337+0000","last_peered":"2023-11-28T19:59:10.751337+0000","last_clean":"2023-11-28T19:59:10.751337+0000","last_became_active":"2023-11-28T19:59:10.232923+0000","last_became_peered":"2023-11-28T19:59:10.232923+0000","last_unstale":"2023-11-28T19:59:10.751337+0000","last_undegraded":"2023-11-28T19:59:10.751337+0000","last_fullsized":"2023-11-28T19:59:10.751337+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:59:09.059796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:59:09.059796+0000","last_clean_scrub_stamp":"2023-11-28T19:59:09.059796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:30:43.834211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T19:59:10.231692+0000","last_change":"2023-11-28T19:59:05.785594+0000","last_active":"2023-11-28T19:59:10.231692+0000","last_peered":"2023-11-28T19:59:10.231692+0000","last_clean":"2023-11-28T19:59:10.231692+0000","last_became_active":"2023-11-28T19:59:05.783565+0000","last_became_peered":"2023-11-28T19:59:05.783565+0000","last_unstale":"2023-11-28T19:59:10.231692+0000","last_undegraded":"2023-11-28T19:59:10.231692+0000","last_fullsized":"2023-11-28T19:59:10.231692+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:59:05.015714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:59:05.015714+0000","last_clean_scrub_stamp":"2023-11-28T19:59:05.015714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:21:21.519406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"25'9","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T19:59:16.612954+0000","last_change":"2023-11-28T19:59:05.050492+0000","last_active":"2023-11-28T19:59:16.612954+0000","last_peered":"2023-11-28T19:59:16.612954+0000","last_clean":"2023-11-28T19:59:16.612954+0000","last_became_active":"2023-11-28T19:59:05.050201+0000","last_became_peered":"2023-11-28T19:59:05.050201+0000","last_unstale":"2023-11-28T19:59:16.612954+0000","last_undegraded":"2023-11-28T19:59:16.612954+0000","last_fullsized":"2023-11-28T19:59:16.612954+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:59:04.008158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:59:04.008158+0000","last_clean_scrub_stamp":"2023-11-28T19:59:04.008158+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T06:35:58.085712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3841,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T19:59:10.891969+0000","last_change":"2023-11-28T19:59:10.110604+0000","last_active":"2023-11-28T19:59:10.891969+0000","last_peered":"2023-11-28T19:59:10.891969+0000","last_clean":"2023-11-28T19:59:10.891969+0000","last_became_active":"2023-11-28T19:59:10.109600+0000","last_became_peered":"2023-11-28T19:59:10.109600+0000","last_unstale":"2023-11-28T19:59:10.891969+0000","last_undegraded":"2023-11-28T19:59:10.891969+0000","last_fullsized":"2023-11-28T19:59:10.891969+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:59:09.059796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:59:09.059796+0000","last_clean_scrub_stamp":"2023-11-28T19:59:09.059796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:04:22.608590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T19:59:10.093975+0000","last_change":"2023-11-28T19:59:05.779793+0000","last_active":"2023-11-28T19:59:10.093975+0000","last_peered":"2023-11-28T19:59:10.093975+0000","last_clean":"2023-11-28T19:59:10.093975+0000","last_became_active":"2023-11-28T19:59:05.779488+0000","last_became_peered":"2023-11-28T19:59:05.779488+0000","last_unstale":"2023-11-28T19:59:10.093975+0000","last_undegraded":"2023-11-28T19:59:10.093975+0000","last_fullsized":"2023-11-28T19:59:10.093975+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:59:05.015714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:59:05.015714+0000","last_clean_scrub_stamp":"2023-11-28T19:59:05.015714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:55:00.138576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"20'3","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T19:59:10.099653+0000","last_change":"2023-11-28T19:59:05.044226+0000","last_active":"2023-11-28T19:59:10.099653+0000","last_peered":"2023-11-28T19:59:10.099653+0000","last_clean":"2023-11-28T19:59:10.099653+0000","last_became_active":"2023-11-28T19:59:05.043946+0000","last_became_peered":"2023-11-28T19:59:05.043946+0000","last_unstale":"2023-11-28T19:59:10.099653+0000","last_undegraded":"2023-11-28T19:59:10.099653+0000","last_fullsized":"2023-11-28T19:59:10.099653+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:59:04.008158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:59:04.008158+0000","last_clean_scrub_stamp":"2023-11-28T19:59:04.008158+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:47:35.984593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T19:59:10.751315+0000","last_change":"2023-11-28T19:59:10.101312+0000","last_active":"2023-11-28T19:59:10.751315+0000","last_peered":"2023-11-28T19:59:10.751315+0000","last_clean":"2023-11-28T19:59:10.751315+0000","last_became_active":"2023-11-28T19:59:10.100486+0000","last_became_peered":"2023-11-28T19:59:10.100486+0000","last_unstale":"2023-11-28T19:59:10.751315+0000","last_undegraded":"2023-11-28T19:59:10.751315+0000","last_fullsized":"2023-11-28T19:59:10.751315+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:59:09.059796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:59:09.059796+0000","last_clean_scrub_stamp":"2023-11-28T19:59:09.059796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:56:13.684509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T19:59:10.106097+0000","last_change":"2023-11-28T19:59:05.781405+0000","last_active":"2023-11-28T19:59:10.106097+0000","last_peered":"2023-11-28T19:59:10.106097+0000","last_clean":"2023-11-28T19:59:10.106097+0000","last_became_active":"2023-11-28T19:59:05.781191+0000","last_became_peered":"2023-11-28T19:59:05.781191+0000","last_unstale":"2023-11-28T19:59:10.106097+0000","last_undegraded":"2023-11-28T19:59:10.106097+0000","last_fullsized":"2023-11-28T19:59:10.106097+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:59:05.015714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:59:05.015714+0000","last_clean_scrub_stamp":"2023-11-28T19:59:05.015714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:05:03.688191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T19:59:10.087858+0000","last_change":"2023-11-28T19:59:05.043993+0000","last_active":"2023-11-28T19:59:10.087858+0000","last_peered":"2023-11-28T19:59:10.087858+0000","last_clean":"2023-11-28T19:59:10.087858+0000","last_became_active":"2023-11-28T19:59:05.043601+0000","last_became_peered":"2023-11-28T19:59:05.043601+0000","last_unstale":"2023-11-28T19:59:10.087858+0000","last_undegraded":"2023-11-28T19:59:10.087858+0000","last_fullsized":"2023-11-28T19:59:10.087858+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:59:04.008158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:59:04.008158+0000","last_clean_scrub_stamp":"2023-11-28T19:59:04.008158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:34:40.633276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T19:59:10.748222+0000","last_change":"2023-11-28T19:59:10.118024+0000","last_active":"2023-11-28T19:59:10.748222+0000","last_peered":"2023-11-28T19:59:10.748222+0000","last_clean":"2023-11-28T19:59:10.748222+0000","last_became_active":"2023-11-28T19:59:10.117574+0000","last_became_peered":"2023-11-28T19:59:10.117574+0000","last_unstale":"2023-11-28T19:59:10.748222+0000","last_undegraded":"2023-11-28T19:59:10.748222+0000","last_fullsized":"2023-11-28T19:59:10.748222+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:59:09.059796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:59:09.059796+0000","last_clean_scrub_stamp":"2023-11-28T19:59:09.059796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:34:54.217873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T19:59:10.087770+0000","last_change":"2023-11-28T19:59:05.773474+0000","last_active":"2023-11-28T19:59:10.087770+0000","last_peered":"2023-11-28T19:59:10.087770+0000","last_clean":"2023-11-28T19:59:10.087770+0000","last_became_active":"2023-11-28T19:59:05.773148+0000","last_became_peered":"2023-11-28T19:59:05.773148+0000","last_unstale":"2023-11-28T19:59:10.087770+0000","last_undegraded":"2023-11-28T19:59:10.087770+0000","last_fullsized":"2023-11-28T19:59:10.087770+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:59:05.015714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:59:05.015714+0000","last_clean_scrub_stamp":"2023-11-28T19:59:05.015714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:27:34.900513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T19:59:10.097405+0000","last_change":"2023-11-28T19:59:05.044167+0000","last_active":"2023-11-28T19:59:10.097405+0000","last_peered":"2023-11-28T19:59:10.097405+0000","last_clean":"2023-11-28T19:59:10.097405+0000","last_became_active":"2023-11-28T19:59:05.043651+0000","last_became_peered":"2023-11-28T19:59:05.043651+0000","last_unstale":"2023-11-28T19:59:10.097405+0000","last_undegraded":"2023-11-28T19:59:10.097405+0000","last_fullsized":"2023-11-28T19:59:10.097405+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:59:04.008158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:59:04.008158+0000","last_clean_scrub_stamp":"2023-11-28T19:59:04.008158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:44:01.094524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T19:59:10.748417+0000","last_change":"2023-11-28T19:59:10.237079+0000","last_active":"2023-11-28T19:59:10.748417+0000","last_peered":"2023-11-28T19:59:10.748417+0000","last_clean":"2023-11-28T19:59:10.748417+0000","last_became_active":"2023-11-28T19:59:10.236659+0000","last_became_peered":"2023-11-28T19:59:10.236659+0000","last_unstale":"2023-11-28T19:59:10.748417+0000","last_undegraded":"2023-11-28T19:59:10.748417+0000","last_fullsized":"2023-11-28T19:59:10.748417+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:59:09.059796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:59:09.059796+0000","last_clean_scrub_stamp":"2023-11-28T19:59:09.059796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:47:39.329731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T19:59:10.892053+0000","last_change":"2023-11-28T19:59:10.236815+0000","last_active":"2023-11-28T19:59:10.892053+0000","last_peered":"2023-11-28T19:59:10.892053+0000","last_clean":"2023-11-28T19:59:10.892053+0000","last_became_active":"2023-11-28T19:59:10.236466+0000","last_became_peered":"2023-11-28T19:59:10.236466+0000","last_unstale":"2023-11-28T19:59:10.892053+0000","last_undegraded":"2023-11-28T19:59:10.892053+0000","last_fullsized":"2023-11-28T19:59:10.892053+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:59:09.059796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:59:09.059796+0000","last_clean_scrub_stamp":"2023-11-28T19:59:09.059796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:59:19.161634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T19:59:10.098528+0000","last_change":"2023-11-28T19:59:05.757721+0000","last_active":"2023-11-28T19:59:10.098528+0000","last_peered":"2023-11-28T19:59:10.098528+0000","last_clean":"2023-11-28T19:59:10.098528+0000","last_became_active":"2023-11-28T19:59:05.757410+0000","last_became_peered":"2023-11-28T19:59:05.757410+0000","last_unstale":"2023-11-28T19:59:10.098528+0000","last_undegraded":"2023-11-28T19:59:10.098528+0000","last_fullsized":"2023-11-28T19:59:10.098528+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:59:05.015714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:59:05.015714+0000","last_clean_scrub_stamp":"2023-11-28T19:59:05.015714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:21:11.899134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T19:59:10.085948+0000","last_change":"2023-11-28T19:59:05.035784+0000","last_active":"2023-11-28T19:59:10.085948+0000","last_peered":"2023-11-28T19:59:10.085948+0000","last_clean":"2023-11-28T19:59:10.085948+0000","last_became_active":"2023-11-28T19:59:05.035438+0000","last_became_peered":"2023-11-28T19:59:05.035438+0000","last_unstale":"2023-11-28T19:59:10.085948+0000","last_undegraded":"2023-11-28T19:59:10.085948+0000","last_fullsized":"2023-11-28T19:59:10.085948+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:59:04.008158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:59:04.008158+0000","last_clean_scrub_stamp":"2023-11-28T19:59:04.008158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:50:57.704628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T19:59:10.892842+0000","last_change":"2023-11-28T19:59:10.118648+0000","last_active":"2023-11-28T19:59:10.892842+0000","last_peered":"2023-11-28T19:59:10.892842+0000","last_clean":"2023-11-28T19:59:10.892842+0000","last_became_active":"2023-11-28T19:59:10.118092+0000","last_became_peered":"2023-11-28T19:59:10.118092+0000","last_unstale":"2023-11-28T19:59:10.892842+0000","last_undegraded":"2023-11-28T19:59:10.892842+0000","last_fullsized":"2023-11-28T19:59:10.892842+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:59:09.059796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:59:09.059796+0000","last_clean_scrub_stamp":"2023-11-28T19:59:09.059796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:27:38.944595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T19:59:10.086761+0000","last_change":"2023-11-28T19:59:05.770886+0000","last_active":"2023-11-28T19:59:10.086761+0000","last_peered":"2023-11-28T19:59:10.086761+0000","last_clean":"2023-11-28T19:59:10.086761+0000","last_became_active":"2023-11-28T19:59:05.770493+0000","last_became_peered":"2023-11-28T19:59:05.770493+0000","last_unstale":"2023-11-28T19:59:10.086761+0000","last_undegraded":"2023-11-28T19:59:10.086761+0000","last_fullsized":"2023-11-28T19:59:10.086761+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:59:05.015714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:59:05.015714+0000","last_clean_scrub_stamp":"2023-11-28T19:59:05.015714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:39:44.998942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T19:59:10.087599+0000","last_change":"2023-11-28T19:59:05.046151+0000","last_active":"2023-11-28T19:59:10.087599+0000","last_peered":"2023-11-28T19:59:10.087599+0000","last_clean":"2023-11-28T19:59:10.087599+0000","last_became_active":"2023-11-28T19:59:05.045604+0000","last_became_peered":"2023-11-28T19:59:05.045604+0000","last_unstale":"2023-11-28T19:59:10.087599+0000","last_undegraded":"2023-11-28T19:59:10.087599+0000","last_fullsized":"2023-11-28T19:59:10.087599+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:59:04.008158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:59:04.008158+0000","last_clean_scrub_stamp":"2023-11-28T19:59:04.008158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:59:05.695936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"20'1","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T19:59:10.096286+0000","last_change":"2023-11-28T19:59:05.048629+0000","last_active":"2023-11-28T19:59:10.096286+0000","last_peered":"2023-11-28T19:59:10.096286+0000","last_clean":"2023-11-28T19:59:10.096286+0000","last_became_active":"2023-11-28T19:59:05.048345+0000","last_became_peered":"2023-11-28T19:59:05.048345+0000","last_unstale":"2023-11-28T19:59:10.096286+0000","last_undegraded":"2023-11-28T19:59:10.096286+0000","last_fullsized":"2023-11-28T19:59:10.096286+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:59:04.008158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:59:04.008158+0000","last_clean_scrub_stamp":"2023-11-28T19:59:04.008158+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:59:05.695936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T19:59:10.105600+0000","last_change":"2023-11-28T19:59:05.777065+0000","last_active":"2023-11-28T19:59:10.105600+0000","last_peered":"2023-11-28T19:59:10.105600+0000","last_clean":"2023-11-28T19:59:10.105600+0000","last_became_active":"2023-11-28T19:59:05.776748+0000","last_became_peered":"2023-11-28T19:59:05.776748+0000","last_unstale":"2023-11-28T19:59:10.105600+0000","last_undegraded":"2023-11-28T19:59:10.105600+0000","last_fullsized":"2023-11-28T19:59:10.105600+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:59:05.015714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:59:05.015714+0000","last_clean_scrub_stamp":"2023-11-28T19:59:05.015714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:39:44.998942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T19:59:10.892135+0000","last_change":"2023-11-28T19:59:10.107795+0000","last_active":"2023-11-28T19:59:10.892135+0000","last_peered":"2023-11-28T19:59:10.892135+0000","last_clean":"2023-11-28T19:59:10.892135+0000","last_became_active":"2023-11-28T19:59:10.107403+0000","last_became_peered":"2023-11-28T19:59:10.107403+0000","last_unstale":"2023-11-28T19:59:10.892135+0000","last_undegraded":"2023-11-28T19:59:10.892135+0000","last_fullsized":"2023-11-28T19:59:10.892135+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:59:09.059796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:59:09.059796+0000","last_clean_scrub_stamp":"2023-11-28T19:59:09.059796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:24:52.316908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"20'1","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T19:59:10.085998+0000","last_change":"2023-11-28T19:59:05.055074+0000","last_active":"2023-11-28T19:59:10.085998+0000","last_peered":"2023-11-28T19:59:10.085998+0000","last_clean":"2023-11-28T19:59:10.085998+0000","last_became_active":"2023-11-28T19:59:05.054809+0000","last_became_peered":"2023-11-28T19:59:05.054809+0000","last_unstale":"2023-11-28T19:59:10.085998+0000","last_undegraded":"2023-11-28T19:59:10.085998+0000","last_fullsized":"2023-11-28T19:59:10.085998+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:59:04.008158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:59:04.008158+0000","last_clean_scrub_stamp":"2023-11-28T19:59:04.008158+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:24:47.265269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T19:59:10.086324+0000","last_change":"2023-11-28T19:59:05.757750+0000","last_active":"2023-11-28T19:59:10.086324+0000","last_peered":"2023-11-28T19:59:10.086324+0000","last_clean":"2023-11-28T19:59:10.086324+0000","last_became_active":"2023-11-28T19:59:05.756939+0000","last_became_peered":"2023-11-28T19:59:05.756939+0000","last_unstale":"2023-11-28T19:59:10.086324+0000","last_undegraded":"2023-11-28T19:59:10.086324+0000","last_fullsized":"2023-11-28T19:59:10.086324+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:59:05.015714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:59:05.015714+0000","last_clean_scrub_stamp":"2023-11-28T19:59:05.015714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:55:40.811535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T19:59:10.748574+0000","last_change":"2023-11-28T19:59:10.108523+0000","last_active":"2023-11-28T19:59:10.748574+0000","last_peered":"2023-11-28T19:59:10.748574+0000","last_clean":"2023-11-28T19:59:10.748574+0000","last_became_active":"2023-11-28T19:59:10.108151+0000","last_became_peered":"2023-11-28T19:59:10.108151+0000","last_unstale":"2023-11-28T19:59:10.748574+0000","last_undegraded":"2023-11-28T19:59:10.748574+0000","last_fullsized":"2023-11-28T19:59:10.748574+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:59:09.059796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:59:09.059796+0000","last_clean_scrub_stamp":"2023-11-28T19:59:09.059796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:30:43.834211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T19:59:10.095918+0000","last_change":"2023-11-28T19:59:05.771095+0000","last_active":"2023-11-28T19:59:10.095918+0000","last_peered":"2023-11-28T19:59:10.095918+0000","last_clean":"2023-11-28T19:59:10.095918+0000","last_became_active":"2023-11-28T19:59:05.770756+0000","last_became_peered":"2023-11-28T19:59:05.770756+0000","last_unstale":"2023-11-28T19:59:10.095918+0000","last_undegraded":"2023-11-28T19:59:10.095918+0000","last_fullsized":"2023-11-28T19:59:10.095918+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:59:05.015714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:59:05.015714+0000","last_clean_scrub_stamp":"2023-11-28T19:59:05.015714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:21:11.899134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T19:59:10.081519+0000","last_change":"2023-11-28T19:59:05.764023+0000","last_active":"2023-11-28T19:59:10.081519+0000","last_peered":"2023-11-28T19:59:10.081519+0000","last_clean":"2023-11-28T19:59:10.081519+0000","last_became_active":"2023-11-28T19:59:05.763722+0000","last_became_peered":"2023-11-28T19:59:05.763722+0000","last_unstale":"2023-11-28T19:59:10.081519+0000","last_undegraded":"2023-11-28T19:59:10.081519+0000","last_fullsized":"2023-11-28T19:59:10.081519+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:59:05.015714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:59:05.015714+0000","last_clean_scrub_stamp":"2023-11-28T19:59:05.015714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:55:00.138576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T19:59:10.086587+0000","last_change":"2023-11-28T19:59:05.771306+0000","last_active":"2023-11-28T19:59:10.086587+0000","last_peered":"2023-11-28T19:59:10.086587+0000","last_clean":"2023-11-28T19:59:10.086587+0000","last_became_active":"2023-11-28T19:59:05.770978+0000","last_became_peered":"2023-11-28T19:59:05.770978+0000","last_unstale":"2023-11-28T19:59:10.086587+0000","last_undegraded":"2023-11-28T19:59:10.086587+0000","last_fullsized":"2023-11-28T19:59:10.086587+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:59:05.015714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:59:05.015714+0000","last_clean_scrub_stamp":"2023-11-28T19:59:05.015714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:04:04.508815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T19:59:10.105498+0000","last_change":"2023-11-28T19:59:05.772219+0000","last_active":"2023-11-28T19:59:10.105498+0000","last_peered":"2023-11-28T19:59:10.105498+0000","last_clean":"2023-11-28T19:59:10.105498+0000","last_became_active":"2023-11-28T19:59:05.771554+0000","last_became_peered":"2023-11-28T19:59:05.771554+0000","last_unstale":"2023-11-28T19:59:10.105498+0000","last_undegraded":"2023-11-28T19:59:10.105498+0000","last_fullsized":"2023-11-28T19:59:10.105498+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:59:05.015714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:59:05.015714+0000","last_clean_scrub_stamp":"2023-11-28T19:59:05.015714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:00:56.432813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T19:59:10.089982+0000","last_change":"2023-11-28T19:59:05.760600+0000","last_active":"2023-11-28T19:59:10.089982+0000","last_peered":"2023-11-28T19:59:10.089982+0000","last_clean":"2023-11-28T19:59:10.089982+0000","last_became_active":"2023-11-28T19:59:05.760294+0000","last_became_peered":"2023-11-28T19:59:05.760294+0000","last_unstale":"2023-11-28T19:59:10.089982+0000","last_undegraded":"2023-11-28T19:59:10.089982+0000","last_fullsized":"2023-11-28T19:59:10.089982+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:59:05.015714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:59:05.015714+0000","last_clean_scrub_stamp":"2023-11-28T19:59:05.015714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:21:11.899134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T19:59:10.099562+0000","last_change":"2023-11-28T19:59:05.766493+0000","last_active":"2023-11-28T19:59:10.099562+0000","last_peered":"2023-11-28T19:59:10.099562+0000","last_clean":"2023-11-28T19:59:10.099562+0000","last_became_active":"2023-11-28T19:59:05.766183+0000","last_became_peered":"2023-11-28T19:59:05.766183+0000","last_unstale":"2023-11-28T19:59:10.099562+0000","last_undegraded":"2023-11-28T19:59:10.099562+0000","last_fullsized":"2023-11-28T19:59:10.099562+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:59:05.015714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:59:05.015714+0000","last_clean_scrub_stamp":"2023-11-28T19:59:05.015714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:34:41.640833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T19:59:10.097144+0000","last_change":"2023-11-28T19:59:05.767616+0000","last_active":"2023-11-28T19:59:10.097144+0000","last_peered":"2023-11-28T19:59:10.097144+0000","last_clean":"2023-11-28T19:59:10.097144+0000","last_became_active":"2023-11-28T19:59:05.766973+0000","last_became_peered":"2023-11-28T19:59:05.766973+0000","last_unstale":"2023-11-28T19:59:10.097144+0000","last_undegraded":"2023-11-28T19:59:10.097144+0000","last_fullsized":"2023-11-28T19:59:10.097144+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:59:05.015714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:59:05.015714+0000","last_clean_scrub_stamp":"2023-11-28T19:59:05.015714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:21:21.519406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T19:59:10.092009+0000","last_change":"2023-11-28T19:59:05.760962+0000","last_active":"2023-11-28T19:59:10.092009+0000","last_peered":"2023-11-28T19:59:10.092009+0000","last_clean":"2023-11-28T19:59:10.092009+0000","last_became_active":"2023-11-28T19:59:05.760666+0000","last_became_peered":"2023-11-28T19:59:05.760666+0000","last_unstale":"2023-11-28T19:59:10.092009+0000","last_undegraded":"2023-11-28T19:59:10.092009+0000","last_fullsized":"2023-11-28T19:59:10.092009+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:59:05.015714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:59:05.015714+0000","last_clean_scrub_stamp":"2023-11-28T19:59:05.015714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:21:21.519406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T19:59:10.085859+0000","last_change":"2023-11-28T19:59:05.769994+0000","last_active":"2023-11-28T19:59:10.085859+0000","last_peered":"2023-11-28T19:59:10.085859+0000","last_clean":"2023-11-28T19:59:10.085859+0000","last_became_active":"2023-11-28T19:59:05.764430+0000","last_became_peered":"2023-11-28T19:59:05.764430+0000","last_unstale":"2023-11-28T19:59:10.085859+0000","last_undegraded":"2023-11-28T19:59:10.085859+0000","last_fullsized":"2023-11-28T19:59:10.085859+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:59:05.015714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:59:05.015714+0000","last_clean_scrub_stamp":"2023-11-28T19:59:05.015714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:13:21.633400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T19:59:10.087468+0000","last_change":"2023-11-28T19:59:05.776439+0000","last_active":"2023-11-28T19:59:10.087468+0000","last_peered":"2023-11-28T19:59:10.087468+0000","last_clean":"2023-11-28T19:59:10.087468+0000","last_became_active":"2023-11-28T19:59:05.776196+0000","last_became_peered":"2023-11-28T19:59:05.776196+0000","last_unstale":"2023-11-28T19:59:10.087468+0000","last_undegraded":"2023-11-28T19:59:10.087468+0000","last_fullsized":"2023-11-28T19:59:10.087468+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:59:05.015714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:59:05.015714+0000","last_clean_scrub_stamp":"2023-11-28T19:59:05.015714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:44:02.102081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T19:59:10.086540+0000","last_change":"2023-11-28T19:59:05.775620+0000","last_active":"2023-11-28T19:59:10.086540+0000","last_peered":"2023-11-28T19:59:10.086540+0000","last_clean":"2023-11-28T19:59:10.086540+0000","last_became_active":"2023-11-28T19:59:05.775057+0000","last_became_peered":"2023-11-28T19:59:05.775057+0000","last_unstale":"2023-11-28T19:59:10.086540+0000","last_undegraded":"2023-11-28T19:59:10.086540+0000","last_fullsized":"2023-11-28T19:59:10.086540+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:59:05.015714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:59:05.015714+0000","last_clean_scrub_stamp":"2023-11-28T19:59:05.015714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:21:21.519406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T19:59:10.105499+0000","last_change":"2023-11-28T19:59:05.783460+0000","last_active":"2023-11-28T19:59:10.105499+0000","last_peered":"2023-11-28T19:59:10.105499+0000","last_clean":"2023-11-28T19:59:10.105499+0000","last_became_active":"2023-11-28T19:59:05.783195+0000","last_became_peered":"2023-11-28T19:59:05.783195+0000","last_unstale":"2023-11-28T19:59:10.105499+0000","last_undegraded":"2023-11-28T19:59:10.105499+0000","last_fullsized":"2023-11-28T19:59:10.105499+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:59:05.015714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:59:05.015714+0000","last_clean_scrub_stamp":"2023-11-28T19:59:05.015714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:18:37.608605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T19:59:10.096571+0000","last_change":"2023-11-28T19:59:05.775976+0000","last_active":"2023-11-28T19:59:10.096571+0000","last_peered":"2023-11-28T19:59:10.096571+0000","last_clean":"2023-11-28T19:59:10.096571+0000","last_became_active":"2023-11-28T19:59:05.775738+0000","last_became_peered":"2023-11-28T19:59:05.775738+0000","last_unstale":"2023-11-28T19:59:10.096571+0000","last_undegraded":"2023-11-28T19:59:10.096571+0000","last_fullsized":"2023-11-28T19:59:10.096571+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:59:05.015714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:59:05.015714+0000","last_clean_scrub_stamp":"2023-11-28T19:59:05.015714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T06:26:55.424441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T19:59:10.231824+0000","last_change":"2023-11-28T19:59:05.786686+0000","last_active":"2023-11-28T19:59:10.231824+0000","last_peered":"2023-11-28T19:59:10.231824+0000","last_clean":"2023-11-28T19:59:10.231824+0000","last_became_active":"2023-11-28T19:59:05.786141+0000","last_became_peered":"2023-11-28T19:59:05.786141+0000","last_unstale":"2023-11-28T19:59:10.231824+0000","last_undegraded":"2023-11-28T19:59:10.231824+0000","last_fullsized":"2023-11-28T19:59:10.231824+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:59:05.015714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:59:05.015714+0000","last_clean_scrub_stamp":"2023-11-28T19:59:05.015714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:04:18.564508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T19:59:10.081827+0000","last_change":"2023-11-28T19:59:05.768915+0000","last_active":"2023-11-28T19:59:10.081827+0000","last_peered":"2023-11-28T19:59:10.081827+0000","last_clean":"2023-11-28T19:59:10.081827+0000","last_became_active":"2023-11-28T19:59:05.768661+0000","last_became_peered":"2023-11-28T19:59:05.768661+0000","last_unstale":"2023-11-28T19:59:10.081827+0000","last_undegraded":"2023-11-28T19:59:10.081827+0000","last_fullsized":"2023-11-28T19:59:10.081827+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:59:05.015714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:59:05.015714+0000","last_clean_scrub_stamp":"2023-11-28T19:59:05.015714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T06:50:51.335785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T19:59:10.086791+0000","last_change":"2023-11-28T19:59:05.763580+0000","last_active":"2023-11-28T19:59:10.086791+0000","last_peered":"2023-11-28T19:59:10.086791+0000","last_clean":"2023-11-28T19:59:10.086791+0000","last_became_active":"2023-11-28T19:59:05.763254+0000","last_became_peered":"2023-11-28T19:59:05.763254+0000","last_unstale":"2023-11-28T19:59:10.086791+0000","last_undegraded":"2023-11-28T19:59:10.086791+0000","last_fullsized":"2023-11-28T19:59:10.086791+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:59:05.015714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:59:05.015714+0000","last_clean_scrub_stamp":"2023-11-28T19:59:05.015714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:50:40.999064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T19:59:10.085773+0000","last_change":"2023-11-28T19:59:05.774080+0000","last_active":"2023-11-28T19:59:10.085773+0000","last_peered":"2023-11-28T19:59:10.085773+0000","last_clean":"2023-11-28T19:59:10.085773+0000","last_became_active":"2023-11-28T19:59:05.773751+0000","last_became_peered":"2023-11-28T19:59:05.773751+0000","last_unstale":"2023-11-28T19:59:10.085773+0000","last_undegraded":"2023-11-28T19:59:10.085773+0000","last_fullsized":"2023-11-28T19:59:10.085773+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:59:05.015714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:59:05.015714+0000","last_clean_scrub_stamp":"2023-11-28T19:59:05.015714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:05:03.688191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T19:59:10.098523+0000","last_change":"2023-11-28T19:59:05.766875+0000","last_active":"2023-11-28T19:59:10.098523+0000","last_peered":"2023-11-28T19:59:10.098523+0000","last_clean":"2023-11-28T19:59:10.098523+0000","last_became_active":"2023-11-28T19:59:05.766555+0000","last_became_peered":"2023-11-28T19:59:05.766555+0000","last_unstale":"2023-11-28T19:59:10.098523+0000","last_undegraded":"2023-11-28T19:59:10.098523+0000","last_fullsized":"2023-11-28T19:59:10.098523+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:59:05.015714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:59:05.015714+0000","last_clean_scrub_stamp":"2023-11-28T19:59:05.015714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:00:56.432813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T19:59:10.105223+0000","last_change":"2023-11-28T19:59:05.769350+0000","last_active":"2023-11-28T19:59:10.105223+0000","last_peered":"2023-11-28T19:59:10.105223+0000","last_clean":"2023-11-28T19:59:10.105223+0000","last_became_active":"2023-11-28T19:59:05.769067+0000","last_became_peered":"2023-11-28T19:59:05.769067+0000","last_unstale":"2023-11-28T19:59:10.105223+0000","last_undegraded":"2023-11-28T19:59:10.105223+0000","last_fullsized":"2023-11-28T19:59:10.105223+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:59:05.015714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:59:05.015714+0000","last_clean_scrub_stamp":"2023-11-28T19:59:05.015714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:24:48.272826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T19:59:10.085817+0000","last_change":"2023-11-28T19:59:05.768359+0000","last_active":"2023-11-28T19:59:10.085817+0000","last_peered":"2023-11-28T19:59:10.085817+0000","last_clean":"2023-11-28T19:59:10.085817+0000","last_became_active":"2023-11-28T19:59:05.768033+0000","last_became_peered":"2023-11-28T19:59:05.768033+0000","last_unstale":"2023-11-28T19:59:10.085817+0000","last_undegraded":"2023-11-28T19:59:10.085817+0000","last_fullsized":"2023-11-28T19:59:10.085817+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:59:05.015714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:59:05.015714+0000","last_clean_scrub_stamp":"2023-11-28T19:59:05.015714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:00:56.432813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T19:59:10.093892+0000","last_change":"2023-11-28T19:59:05.769430+0000","last_active":"2023-11-28T19:59:10.093892+0000","last_peered":"2023-11-28T19:59:10.093892+0000","last_clean":"2023-11-28T19:59:10.093892+0000","last_became_active":"2023-11-28T19:59:05.769077+0000","last_became_peered":"2023-11-28T19:59:05.769077+0000","last_unstale":"2023-11-28T19:59:10.093892+0000","last_undegraded":"2023-11-28T19:59:10.093892+0000","last_fullsized":"2023-11-28T19:59:10.093892+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:59:05.015714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:59:05.015714+0000","last_clean_scrub_stamp":"2023-11-28T19:59:05.015714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T06:50:51.335785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T19:59:10.096948+0000","last_change":"2023-11-28T19:59:05.780244+0000","last_active":"2023-11-28T19:59:10.096948+0000","last_peered":"2023-11-28T19:59:10.096948+0000","last_clean":"2023-11-28T19:59:10.096948+0000","last_became_active":"2023-11-28T19:59:05.779967+0000","last_became_peered":"2023-11-28T19:59:05.779967+0000","last_unstale":"2023-11-28T19:59:10.096948+0000","last_undegraded":"2023-11-28T19:59:10.096948+0000","last_fullsized":"2023-11-28T19:59:10.096948+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:59:05.015714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:59:05.015714+0000","last_clean_scrub_stamp":"2023-11-28T19:59:05.015714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:37:45.006198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T19:59:10.097115+0000","last_change":"2023-11-28T19:59:05.780306+0000","last_active":"2023-11-28T19:59:10.097115+0000","last_peered":"2023-11-28T19:59:10.097115+0000","last_clean":"2023-11-28T19:59:10.097115+0000","last_became_active":"2023-11-28T19:59:05.780039+0000","last_became_peered":"2023-11-28T19:59:05.780039+0000","last_unstale":"2023-11-28T19:59:10.097115+0000","last_undegraded":"2023-11-28T19:59:10.097115+0000","last_fullsized":"2023-11-28T19:59:10.097115+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:59:05.015714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:59:05.015714+0000","last_clean_scrub_stamp":"2023-11-28T19:59:05.015714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:05:03.688191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T19:59:10.232048+0000","last_change":"2023-11-28T19:59:05.786228+0000","last_active":"2023-11-28T19:59:10.232048+0000","last_peered":"2023-11-28T19:59:10.232048+0000","last_clean":"2023-11-28T19:59:10.232048+0000","last_became_active":"2023-11-28T19:59:05.785937+0000","last_became_peered":"2023-11-28T19:59:05.785937+0000","last_unstale":"2023-11-28T19:59:10.232048+0000","last_undegraded":"2023-11-28T19:59:10.232048+0000","last_fullsized":"2023-11-28T19:59:10.232048+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:59:05.015714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:59:05.015714+0000","last_clean_scrub_stamp":"2023-11-28T19:59:05.015714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:27:34.900513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T19:59:10.086749+0000","last_change":"2023-11-28T19:59:05.764238+0000","last_active":"2023-11-28T19:59:10.086749+0000","last_peered":"2023-11-28T19:59:10.086749+0000","last_clean":"2023-11-28T19:59:10.086749+0000","last_became_active":"2023-11-28T19:59:05.763941+0000","last_became_peered":"2023-11-28T19:59:05.763941+0000","last_unstale":"2023-11-28T19:59:10.086749+0000","last_undegraded":"2023-11-28T19:59:10.086749+0000","last_fullsized":"2023-11-28T19:59:10.086749+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:59:05.015714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:59:05.015714+0000","last_clean_scrub_stamp":"2023-11-28T19:59:05.015714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:18:37.608605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T19:59:10.231401+0000","last_change":"2023-11-28T19:59:05.777444+0000","last_active":"2023-11-28T19:59:10.231401+0000","last_peered":"2023-11-28T19:59:10.231401+0000","last_clean":"2023-11-28T19:59:10.231401+0000","last_became_active":"2023-11-28T19:59:05.777096+0000","last_became_peered":"2023-11-28T19:59:05.777096+0000","last_unstale":"2023-11-28T19:59:10.231401+0000","last_undegraded":"2023-11-28T19:59:10.231401+0000","last_fullsized":"2023-11-28T19:59:10.231401+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:59:05.015714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:59:05.015714+0000","last_clean_scrub_stamp":"2023-11-28T19:59:05.015714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:37:45.006198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T19:59:10.086470+0000","last_change":"2023-11-28T19:59:05.775817+0000","last_active":"2023-11-28T19:59:10.086470+0000","last_peered":"2023-11-28T19:59:10.086470+0000","last_clean":"2023-11-28T19:59:10.086470+0000","last_became_active":"2023-11-28T19:59:05.775434+0000","last_became_peered":"2023-11-28T19:59:05.775434+0000","last_unstale":"2023-11-28T19:59:10.086470+0000","last_undegraded":"2023-11-28T19:59:10.086470+0000","last_fullsized":"2023-11-28T19:59:10.086470+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:59:05.015714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:59:05.015714+0000","last_clean_scrub_stamp":"2023-11-28T19:59:05.015714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:37:45.006198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T19:59:10.231662+0000","last_change":"2023-11-28T19:59:05.773714+0000","last_active":"2023-11-28T19:59:10.231662+0000","last_peered":"2023-11-28T19:59:10.231662+0000","last_clean":"2023-11-28T19:59:10.231662+0000","last_became_active":"2023-11-28T19:59:05.773423+0000","last_became_peered":"2023-11-28T19:59:05.773423+0000","last_unstale":"2023-11-28T19:59:10.231662+0000","last_undegraded":"2023-11-28T19:59:10.231662+0000","last_fullsized":"2023-11-28T19:59:10.231662+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:59:05.015714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:59:05.015714+0000","last_clean_scrub_stamp":"2023-11-28T19:59:05.015714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:13:21.633400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T19:59:10.087840+0000","last_change":"2023-11-28T19:59:05.770679+0000","last_active":"2023-11-28T19:59:10.087840+0000","last_peered":"2023-11-28T19:59:10.087840+0000","last_clean":"2023-11-28T19:59:10.087840+0000","last_became_active":"2023-11-28T19:59:05.770220+0000","last_became_peered":"2023-11-28T19:59:05.770220+0000","last_unstale":"2023-11-28T19:59:10.087840+0000","last_undegraded":"2023-11-28T19:59:10.087840+0000","last_fullsized":"2023-11-28T19:59:10.087840+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:59:05.015714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:59:05.015714+0000","last_clean_scrub_stamp":"2023-11-28T19:59:05.015714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:56:09.640427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T19:59:10.106440+0000","last_change":"2023-11-28T19:59:05.763243+0000","last_active":"2023-11-28T19:59:10.106440+0000","last_peered":"2023-11-28T19:59:10.106440+0000","last_clean":"2023-11-28T19:59:10.106440+0000","last_became_active":"2023-11-28T19:59:05.762624+0000","last_became_peered":"2023-11-28T19:59:05.762624+0000","last_unstale":"2023-11-28T19:59:10.106440+0000","last_undegraded":"2023-11-28T19:59:10.106440+0000","last_fullsized":"2023-11-28T19:59:10.106440+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:59:05.015714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:59:05.015714+0000","last_clean_scrub_stamp":"2023-11-28T19:59:05.015714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:21:11.899134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T19:59:10.099378+0000","last_change":"2023-11-28T19:59:05.766991+0000","last_active":"2023-11-28T19:59:10.099378+0000","last_peered":"2023-11-28T19:59:10.099378+0000","last_clean":"2023-11-28T19:59:10.099378+0000","last_became_active":"2023-11-28T19:59:05.766715+0000","last_became_peered":"2023-11-28T19:59:05.766715+0000","last_unstale":"2023-11-28T19:59:10.099378+0000","last_undegraded":"2023-11-28T19:59:10.099378+0000","last_fullsized":"2023-11-28T19:59:10.099378+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:59:05.015714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:59:05.015714+0000","last_clean_scrub_stamp":"2023-11-28T19:59:05.015714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:05:03.688191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T19:59:10.231952+0000","last_change":"2023-11-28T19:59:05.784181+0000","last_active":"2023-11-28T19:59:10.231952+0000","last_peered":"2023-11-28T19:59:10.231952+0000","last_clean":"2023-11-28T19:59:10.231952+0000","last_became_active":"2023-11-28T19:59:05.783940+0000","last_became_peered":"2023-11-28T19:59:05.783940+0000","last_unstale":"2023-11-28T19:59:10.231952+0000","last_undegraded":"2023-11-28T19:59:10.231952+0000","last_fullsized":"2023-11-28T19:59:10.231952+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:59:05.015714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:59:05.015714+0000","last_clean_scrub_stamp":"2023-11-28T19:59:05.015714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:59:15.117552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4639,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9278,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":66748,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574857,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27348,"kb_used_data":328,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344492,"statfs":{"total":96636764160,"available":96608759808,"internally_reserved":0,"allocated":335872,"data_stored":695413,"data_compressed":33374,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67400000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51200000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60899999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45600000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.623}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42399999999999999}]}]},{"osd":6,"up_from":13,"seq":55834574855,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27288,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344552,"statfs":{"total":96636764160,"available":96608821248,"internally_reserved":0,"allocated":278528,"data_stored":108304,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40600000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63700000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54800000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58799999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51600000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68899999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73699999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574857,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27292,"kb_used_data":264,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344548,"statfs":{"total":96636764160,"available":96608817152,"internally_reserved":0,"allocated":270336,"data_stored":104553,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65200000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69399999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.753}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85399999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88300000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97699999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94699999999999995}]}]},{"osd":4,"up_from":13,"seq":55834574856,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27300,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344540,"statfs":{"total":96636764160,"available":96608808960,"internally_reserved":0,"allocated":278528,"data_stored":104589,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54900000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80000000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82299999999999995}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66800000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73599999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85399999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75}]}]},{"osd":3,"up_from":13,"seq":55834574857,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27288,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344552,"statfs":{"total":96636764160,"available":96608821248,"internally_reserved":0,"allocated":278528,"data_stored":108304,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42299999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47399999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40999999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44400000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59399999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48999999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61099999999999999}]}]},{"osd":2,"up_from":13,"seq":55834574855,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27288,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344552,"statfs":{"total":96636764160,"available":96608821248,"internally_reserved":0,"allocated":266240,"data_stored":104463,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.497}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44400000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41799999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92600000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94199999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95999999999999996}]}]},{"osd":1,"up_from":13,"seq":55834574857,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27300,"kb_used_data":268,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344540,"statfs":{"total":96636764160,"available":96608808960,"internally_reserved":0,"allocated":274432,"data_stored":104623,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.31}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38400000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54400000000000004}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78500000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.745}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92700000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80000000000000004}]}]},{"osd":0,"up_from":13,"seq":55834574856,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27360,"kb_used_data":336,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344480,"statfs":{"total":96636764160,"available":96608747520,"internally_reserved":0,"allocated":344064,"data_stored":695469,"data_compressed":33374,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56499999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52500000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46899999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93400000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91800000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95799999999999996}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33374,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33374,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3841,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3841,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-28T19:59:25.225 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-11-28T19:59:25.225 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2023-11-28T19:59:25.226 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2023-11-28T19:59:25.226 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2023-11-28T19:59:25.226 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2023-11-28T19:59:25.399 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:25.395+0000 7fc191596640 1 Processor -- start 2023-11-28T19:59:25.399 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:25.395+0000 7fc191596640 1 -- start start 2023-11-28T19:59:25.400 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:25.395+0000 7fc191596640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fc18c0c7dd0 0x7fc18c154580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:25.400 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:25.395+0000 7fc191596640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fc18c06c580 0x7fc18c14aa80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:25.400 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:25.395+0000 7fc191596640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc18c06bc80 con 0x7fc18c0ca3c0 2023-11-28T19:59:25.401 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:25.395+0000 7fc191596640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc18c157e10 con 0x7fc18c06c580 2023-11-28T19:59:25.401 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:25.395+0000 7fc191596640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc18c0c5120 con 0x7fc18c0c7dd0 2023-11-28T19:59:25.401 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:25.395+0000 7fc18affd640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7fc18c0ca3c0 0x7fc18c158210 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:53888/0 (socket says 172.21.15.78:53888) 2023-11-28T19:59:25.401 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:25.395+0000 7fc18affd640 1 -- 172.21.15.78:0/1093816219 learned_addr learned my addr 172.21.15.78:0/1093816219 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-11-28T19:59:25.401 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:25.395+0000 7fc18b7fe640 1 --2- 172.21.15.78:0/1093816219 >> v2:172.21.15.78:3300/0 conn(0x7fc18c06c580 0x7fc18c14aa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:25.402 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:25.395+0000 7fc189ffb640 1 -- 172.21.15.78:0/1093816219 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 457777381 0 0) 0x7fc18c06bc80 con 0x7fc18c0ca3c0 2023-11-28T19:59:25.402 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:25.395+0000 7fc18a7fc640 1 --2- 172.21.15.78:0/1093816219 >> v2:172.21.15.179:3300/0 conn(0x7fc18c0c7dd0 0x7fc18c154580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:25.402 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:25.395+0000 7fc189ffb640 1 -- 172.21.15.78:0/1093816219 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc174003530 con 0x7fc18c0ca3c0 2023-11-28T19:59:25.402 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:25.395+0000 7fc18b7fe640 1 -- 172.21.15.78:0/1093816219 >> v2:172.21.15.179:3300/0 conn(0x7fc18c0c7dd0 msgr2=0x7fc18c154580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T19:59:25.402 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:25.395+0000 7fc18b7fe640 1 --2- 172.21.15.78:0/1093816219 >> v2:172.21.15.179:3300/0 conn(0x7fc18c0c7dd0 0x7fc18c154580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:25.402 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:25.395+0000 7fc18b7fe640 1 -- 172.21.15.78:0/1093816219 >> v1:172.21.15.78:6789/0 conn(0x7fc18c0ca3c0 legacy=0x7fc18c158210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:25.402 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:25.395+0000 7fc18b7fe640 1 -- 172.21.15.78:0/1093816219 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc18c154ac0 con 0x7fc18c06c580 2023-11-28T19:59:25.404 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:25.399+0000 7fc18b7fe640 1 --2- 172.21.15.78:0/1093816219 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc18c06c580 0x7fc18c14aa80 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fc18c0a9780 tx=0x7fc18401c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=380185fa7800a6a8 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:59:25.404 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:25.399+0000 7fc189ffb640 1 -- 172.21.15.78:0/1093816219 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1840a5940 con 0x7fc18c06c580 2023-11-28T19:59:25.404 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:25.399+0000 7fc189ffb640 1 -- 172.21.15.78:0/1093816219 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc1840a5aa0 con 0x7fc18c06c580 2023-11-28T19:59:25.404 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:25.399+0000 7fc189ffb640 1 -- 172.21.15.78:0/1093816219 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1840a5e30 con 0x7fc18c06c580 2023-11-28T19:59:25.405 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:25.399+0000 7fc191596640 1 -- 172.21.15.78:0/1093816219 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc18c06c580 msgr2=0x7fc18c14aa80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:25.405 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:25.399+0000 7fc191596640 1 --2- 172.21.15.78:0/1093816219 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc18c06c580 0x7fc18c14aa80 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fc18c0a9780 tx=0x7fc18401c880 comp rx=0 tx=0).stop 2023-11-28T19:59:25.405 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:25.399+0000 7fc191596640 1 -- 172.21.15.78:0/1093816219 shutdown_connections 2023-11-28T19:59:25.405 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:25.399+0000 7fc191596640 1 --2- 172.21.15.78:0/1093816219 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc18c06c580 0x7fc18c14aa80 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:25.405 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:25.399+0000 7fc191596640 1 --2- 172.21.15.78:0/1093816219 >> v2:172.21.15.179:3300/0 conn(0x7fc18c0c7dd0 0x7fc18c154580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:25.405 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:25.399+0000 7fc191596640 1 -- 172.21.15.78:0/1093816219 >> 172.21.15.78:0/1093816219 conn(0x7fc18c0666a0 msgr2=0x7fc18c066ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T19:59:25.405 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:25.399+0000 7fc191596640 1 -- 172.21.15.78:0/1093816219 shutdown_connections 2023-11-28T19:59:25.405 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:25.399+0000 7fc191596640 1 -- 172.21.15.78:0/1093816219 wait complete. 2023-11-28T19:59:25.406 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:25.399+0000 7fc191596640 1 Processor -- start 2023-11-28T19:59:25.406 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:25.399+0000 7fc191596640 1 -- start start 2023-11-28T19:59:25.409 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:25.403+0000 7fc191596640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc18c06c580 0x7fc18c1522e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:25.409 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:25.403+0000 7fc191596640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc18c0c7dd0 0x7fc18c149f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:25.409 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:25.403+0000 7fc191596640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc18c0ca3c0 0x7fc18c14a470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:25.409 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:25.403+0000 7fc191596640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc18c151770 con 0x7fc18c0c7dd0 2023-11-28T19:59:25.409 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:25.403+0000 7fc191596640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc18c150360 con 0x7fc18c0ca3c0 2023-11-28T19:59:25.409 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:25.403+0000 7fc191596640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc18c14a9b0 con 0x7fc18c06c580 2023-11-28T19:59:25.409 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:25.403+0000 7fc18a7fc640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc18c0c7dd0 0x7fc18c149f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:25.409 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:25.403+0000 7fc18a7fc640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc18c0c7dd0 0x7fc18c149f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:52816/0 (socket says 172.21.15.78:52816) 2023-11-28T19:59:25.410 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:25.403+0000 7fc18a7fc640 1 -- 172.21.15.78:0/3810737562 learned_addr learned my addr 172.21.15.78:0/3810737562 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T19:59:25.410 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:25.403+0000 7fc18affd640 1 --2- 172.21.15.78:0/3810737562 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc18c06c580 0x7fc18c1522e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:25.410 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:25.403+0000 7fc18a7fc640 1 -- 172.21.15.78:0/3810737562 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc18c06c580 msgr2=0x7fc18c1522e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:25.410 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:25.403+0000 7fc18a7fc640 1 --2- 172.21.15.78:0/3810737562 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc18c06c580 0x7fc18c1522e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:25.410 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:25.403+0000 7fc18b7fe640 1 --2- 172.21.15.78:0/3810737562 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc18c0ca3c0 0x7fc18c14a470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:25.410 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:25.403+0000 7fc18a7fc640 1 -- 172.21.15.78:0/3810737562 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc18c0ca3c0 msgr2=0x7fc18c14a470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:25.410 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:25.403+0000 7fc18a7fc640 1 --2- 172.21.15.78:0/3810737562 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc18c0ca3c0 0x7fc18c14a470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:25.410 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:25.403+0000 7fc18a7fc640 1 -- 172.21.15.78:0/3810737562 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc184009a70 con 0x7fc18c0c7dd0 2023-11-28T19:59:25.410 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:25.403+0000 7fc18affd640 1 --2- 172.21.15.78:0/3810737562 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc18c06c580 0x7fc18c1522e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T19:59:25.410 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:25.403+0000 7fc18b7fe640 1 --2- 172.21.15.78:0/3810737562 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc18c0ca3c0 0x7fc18c14a470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T19:59:25.410 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:25.403+0000 7fc18a7fc640 1 --2- 172.21.15.78:0/3810737562 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc18c0c7dd0 0x7fc18c149f30 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fc18000d830 tx=0x7fc18000dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:59:25.410 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:25.403+0000 7fc1737fe640 1 -- 172.21.15.78:0/3810737562 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc18000b6c0 con 0x7fc18c0c7dd0 2023-11-28T19:59:25.411 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:25.403+0000 7fc1737fe640 1 -- 172.21.15.78:0/3810737562 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc18000b820 con 0x7fc18c0c7dd0 2023-11-28T19:59:25.411 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:25.403+0000 7fc1737fe640 1 -- 172.21.15.78:0/3810737562 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc18000bb90 con 0x7fc18c0c7dd0 2023-11-28T19:59:25.411 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:25.403+0000 7fc191596640 1 -- 172.21.15.78:0/3810737562 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc18c1ee1f0 con 0x7fc18c0c7dd0 2023-11-28T19:59:25.411 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:25.403+0000 7fc191596640 1 -- 172.21.15.78:0/3810737562 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc18c1511b0 con 0x7fc18c0c7dd0 2023-11-28T19:59:25.412 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:25.403+0000 7fc191596640 1 -- 172.21.15.78:0/3810737562 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc18c1ee050 con 0x7fc18c0c7dd0 2023-11-28T19:59:25.412 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:25.407+0000 7fc1737fe640 1 -- 172.21.15.78:0/3810737562 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fc18001e460 con 0x7fc18c0c7dd0 2023-11-28T19:59:25.412 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:25.407+0000 7fc1737fe640 1 --2- 172.21.15.78:0/3810737562 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fc178066470 0x7fc178068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:25.412 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:25.407+0000 7fc1737fe640 1 -- 172.21.15.78:0/3810737562 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fc180084a00 con 0x7fc18c0c7dd0 2023-11-28T19:59:25.412 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:25.407+0000 7fc18affd640 1 --2- 172.21.15.78:0/3810737562 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fc178066470 0x7fc178068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:25.412 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:25.407+0000 7fc18affd640 1 --2- 172.21.15.78:0/3810737562 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fc178066470 0x7fc178068930 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fc17c0011f0 tx=0x7fc17c009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:59:25.415 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:25.411+0000 7fc1737fe640 1 -- 172.21.15.78:0/3810737562 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fc18c1ee050 con 0x7fc18c0c7dd0 2023-11-28T19:59:25.601 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:25.595+0000 7fc191596640 1 -- 172.21.15.78:0/3810737562 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7fc18c1ee050 con 0x7fc18c0c7dd0 2023-11-28T19:59:25.602 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:25.595+0000 7fc1737fe640 1 -- 172.21.15.78:0/3810737562 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) v1 ==== 74+0+164432 (secure 0 0 0) 0x7fc18c1ee050 con 0x7fc18c0c7dd0 2023-11-28T19:59:25.604 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-11-28T19:59:25.606 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:25.599+0000 7fc191596640 1 -- 172.21.15.78:0/3810737562 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fc178066470 msgr2=0x7fc178068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:25.606 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:25.599+0000 7fc191596640 1 --2- 172.21.15.78:0/3810737562 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fc178066470 0x7fc178068930 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fc17c0011f0 tx=0x7fc17c009040 comp rx=0 tx=0).stop 2023-11-28T19:59:25.606 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:25.599+0000 7fc191596640 1 -- 172.21.15.78:0/3810737562 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc18c0c7dd0 msgr2=0x7fc18c149f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:25.606 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:25.599+0000 7fc191596640 1 --2- 172.21.15.78:0/3810737562 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc18c0c7dd0 0x7fc18c149f30 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fc18000d830 tx=0x7fc18000dcf0 comp rx=0 tx=0).stop 2023-11-28T19:59:25.606 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:25.599+0000 7fc191596640 1 -- 172.21.15.78:0/3810737562 shutdown_connections 2023-11-28T19:59:25.606 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:25.599+0000 7fc191596640 1 --2- 172.21.15.78:0/3810737562 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fc178066470 0x7fc178068930 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:25.606 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:25.599+0000 7fc191596640 1 --2- 172.21.15.78:0/3810737562 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc18c0ca3c0 0x7fc18c14a470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:25.606 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:25.599+0000 7fc191596640 1 --2- 172.21.15.78:0/3810737562 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc18c0c7dd0 0x7fc18c149f30 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:25.607 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:25.599+0000 7fc191596640 1 --2- 172.21.15.78:0/3810737562 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc18c06c580 0x7fc18c1522e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:25.607 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:25.599+0000 7fc191596640 1 -- 172.21.15.78:0/3810737562 >> 172.21.15.78:0/3810737562 conn(0x7fc18c0666a0 msgr2=0x7fc18c15e710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T19:59:25.607 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:25.599+0000 7fc191596640 1 -- 172.21.15.78:0/3810737562 shutdown_connections 2023-11-28T19:59:25.607 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:25.599+0000 7fc191596640 1 -- 172.21.15.78:0/3810737562 wait complete. 2023-11-28T19:59:25.624 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":5,"active_gid":4106,"active_name":"y","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6832","nonce":2935380957},{"type":"v1","addr":"172.21.15.78:6833","nonce":2935380957}]},"active_addr":"172.21.15.78:6833/2935380957","active_change":"2023-11-28T19:58:45.938712+0000","active_mgr_features":4540138322906710015,"available":true,"standbys":[{"gid":4111,"name":"x","mgr_features":4540138322906710015,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:latest","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:latest","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.78:0","nonce":2697406733}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.78:0","nonce":2515934411}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.78:0","nonce":2316817447}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.78:0","nonce":3025731511}]}]} 2023-11-28T19:59:25.629 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2023-11-28T19:59:25.629 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2023-11-28T19:59:25.629 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-28T19:59:25.768 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:25.763+0000 7fed92180640 1 Processor -- start 2023-11-28T19:59:25.768 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:25.763+0000 7fed92180640 1 -- start start 2023-11-28T19:59:25.769 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:25.763+0000 7fed92180640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fed8c06d890 0x7fed8c154610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:25.769 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:25.763+0000 7fed92180640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fed8c158a40 con 0x7fed8c151bf0 2023-11-28T19:59:25.769 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:25.763+0000 7fed92180640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fed8c1584c0 con 0x7fed8c154b50 2023-11-28T19:59:25.769 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:25.763+0000 7fed92180640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fed8c158760 con 0x7fed8c06d890 2023-11-28T19:59:25.769 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:25.763+0000 7fed8b7fe640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7fed8c151bf0 0x7fed8c06b5c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:53900/0 (socket says 172.21.15.78:53900) 2023-11-28T19:59:25.770 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:25.763+0000 7fed8b7fe640 1 -- 172.21.15.78:0/1340221836 learned_addr learned my addr 172.21.15.78:0/1340221836 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-11-28T19:59:25.771 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:25.763+0000 7fed8affd640 1 --2- 172.21.15.78:0/1340221836 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fed8c06d890 0x7fed8c154610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:25.771 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:25.763+0000 7fed8a7fc640 1 -- 172.21.15.78:0/1340221836 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4237722111 0 0) 0x7fed8c158a40 con 0x7fed8c151bf0 2023-11-28T19:59:25.772 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:25.763+0000 7fed8a7fc640 1 -- 172.21.15.78:0/1340221836 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fed74003530 con 0x7fed8c151bf0 2023-11-28T19:59:25.772 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:25.763+0000 7fed8a7fc640 1 -- 172.21.15.78:0/1340221836 <== mon.0 v1:172.21.15.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1822156506 0 0) 0x7fed74003530 con 0x7fed8c151bf0 2023-11-28T19:59:25.772 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:25.763+0000 7fed8a7fc640 1 -- 172.21.15.78:0/1340221836 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fed8c06d890 msgr2=0x7fed8c154610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T19:59:25.772 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:25.763+0000 7fed8a7fc640 1 --2- 172.21.15.78:0/1340221836 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fed8c06d890 0x7fed8c154610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:25.772 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:25.763+0000 7fed8a7fc640 1 -- 172.21.15.78:0/1340221836 >> v1:172.21.15.179:6789/0 conn(0x7fed8c154b50 legacy=0x7fed8c15ee90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:25.772 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:25.763+0000 7fed8a7fc640 1 -- 172.21.15.78:0/1340221836 --> v1:172.21.15.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed8c0c0ce0 con 0x7fed8c151bf0 2023-11-28T19:59:25.772 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:25.763+0000 7fed8a7fc640 1 -- 172.21.15.78:0/1340221836 <== mon.0 v1:172.21.15.78:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3326804700 0 0) 0x7fed7c001680 con 0x7fed8c151bf0 2023-11-28T19:59:25.772 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:25.763+0000 7fed8a7fc640 1 -- 172.21.15.78:0/1340221836 >> v1:172.21.15.78:6789/0 conn(0x7fed8c151bf0 legacy=0x7fed8c06b5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:25.772 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:25.763+0000 7fed8a7fc640 1 --2- 172.21.15.78:0/1340221836 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fed740039b0 0x7fed74003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:25.772 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:25.763+0000 7fed8a7fc640 1 --2- 172.21.15.78:0/1340221836 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fed8c06d890 0x7fed740047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:25.772 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:25.763+0000 7fed8a7fc640 1 --2- 172.21.15.78:0/1340221836 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fed74004d10 0x7fed74005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:25.773 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:25.763+0000 7fed8a7fc640 1 -- 172.21.15.78:0/1340221836 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed8c158760 con 0x7fed74004d10 2023-11-28T19:59:25.773 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:25.763+0000 7fed8a7fc640 1 -- 172.21.15.78:0/1340221836 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed7400ba40 con 0x7fed740039b0 2023-11-28T19:59:25.773 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:25.763+0000 7fed8a7fc640 1 -- 172.21.15.78:0/1340221836 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fed7400bc00 con 0x7fed8c06d890 2023-11-28T19:59:25.773 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:25.763+0000 7fed8bfff640 1 --2- 172.21.15.78:0/1340221836 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fed74004d10 0x7fed74005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:25.773 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:25.763+0000 7fed8b7fe640 1 --2- 172.21.15.78:0/1340221836 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fed740039b0 0x7fed74003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:25.773 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:25.763+0000 7fed8affd640 1 --2- 172.21.15.78:0/1340221836 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fed8c06d890 0x7fed740047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:25.773 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:25.767+0000 7fed8bfff640 1 -- 172.21.15.78:0/1340221836 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fed8c06d890 msgr2=0x7fed740047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T19:59:25.773 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:25.767+0000 7fed8bfff640 1 --2- 172.21.15.78:0/1340221836 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fed8c06d890 0x7fed740047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:25.773 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:25.767+0000 7fed8bfff640 1 -- 172.21.15.78:0/1340221836 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fed740039b0 msgr2=0x7fed74003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T19:59:25.773 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:25.767+0000 7fed8bfff640 1 --2- 172.21.15.78:0/1340221836 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fed740039b0 0x7fed74003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:25.773 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:25.767+0000 7fed8bfff640 1 -- 172.21.15.78:0/1340221836 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed74003530 con 0x7fed74004d10 2023-11-28T19:59:25.774 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:25.767+0000 7fed8bfff640 1 --2- 172.21.15.78:0/1340221836 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fed74004d10 0x7fed74005190 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fed84001e40 tx=0x7fed8401c740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=deec6c8c6be6bb44 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:59:25.775 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:25.767+0000 7fed8a7fc640 1 -- 172.21.15.78:0/1340221836 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed84003b80 con 0x7fed74004d10 2023-11-28T19:59:25.775 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:25.767+0000 7fed8a7fc640 1 -- 172.21.15.78:0/1340221836 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed84003ce0 con 0x7fed74004d10 2023-11-28T19:59:25.775 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:25.767+0000 7fed8a7fc640 1 -- 172.21.15.78:0/1340221836 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed840052c0 con 0x7fed74004d10 2023-11-28T19:59:25.775 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:25.767+0000 7fed92180640 1 -- 172.21.15.78:0/1340221836 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fed74004d10 msgr2=0x7fed74005190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:25.775 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:25.767+0000 7fed92180640 1 --2- 172.21.15.78:0/1340221836 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fed74004d10 0x7fed74005190 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fed84001e40 tx=0x7fed8401c740 comp rx=0 tx=0).stop 2023-11-28T19:59:25.775 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:25.767+0000 7fed8bfff640 1 -- 172.21.15.78:0/1340221836 reap_dead start 2023-11-28T19:59:25.775 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:25.767+0000 7fed92180640 1 -- 172.21.15.78:0/1340221836 shutdown_connections 2023-11-28T19:59:25.775 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:25.767+0000 7fed92180640 1 -- 172.21.15.78:0/1340221836 >> 172.21.15.78:0/1340221836 conn(0x7fed8c0c61f0 msgr2=0x7fed8c0c6600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T19:59:25.775 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:25.767+0000 7fed92180640 1 -- 172.21.15.78:0/1340221836 shutdown_connections 2023-11-28T19:59:25.775 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:25.767+0000 7fed92180640 1 -- 172.21.15.78:0/1340221836 wait complete. 2023-11-28T19:59:25.776 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:25.771+0000 7fed92180640 1 Processor -- start 2023-11-28T19:59:25.776 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:25.771+0000 7fed92180640 1 -- start start 2023-11-28T19:59:25.778 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:25.771+0000 7fed92180640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fed74004d10 0x7fed8c14d250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:25.778 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:25.771+0000 7fed92180640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fed8c071d70 0x7fed8c147a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:25.778 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:25.771+0000 7fed92180640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fed8c072410 0x7fed8c147f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:25.779 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:25.771+0000 7fed92180640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed8c0710c0 con 0x7fed8c072410 2023-11-28T19:59:25.779 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:25.771+0000 7fed92180640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed8c1e7530 con 0x7fed8c071d70 2023-11-28T19:59:25.779 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:25.771+0000 7fed92180640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fed8c0704d0 con 0x7fed74004d10 2023-11-28T19:59:25.779 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:25.771+0000 7fed8bfff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fed8c072410 0x7fed8c147f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:25.779 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:25.771+0000 7fed8bfff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fed8c072410 0x7fed8c147f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:52832/0 (socket says 172.21.15.78:52832) 2023-11-28T19:59:25.779 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:25.771+0000 7fed8bfff640 1 -- 172.21.15.78:0/3489928237 learned_addr learned my addr 172.21.15.78:0/3489928237 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T19:59:25.779 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:25.771+0000 7fed8b7fe640 1 --2- 172.21.15.78:0/3489928237 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fed74004d10 0x7fed8c14d250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:25.779 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:25.771+0000 7fed8affd640 1 --2- 172.21.15.78:0/3489928237 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fed8c071d70 0x7fed8c147a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:25.780 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:25.771+0000 7fed8bfff640 1 -- 172.21.15.78:0/3489928237 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fed74004d10 msgr2=0x7fed8c14d250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:25.780 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:25.771+0000 7fed8bfff640 1 --2- 172.21.15.78:0/3489928237 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fed74004d10 0x7fed8c14d250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:25.780 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:25.771+0000 7fed8bfff640 1 -- 172.21.15.78:0/3489928237 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fed8c071d70 msgr2=0x7fed8c147a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:25.780 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:25.771+0000 7fed8bfff640 1 --2- 172.21.15.78:0/3489928237 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fed8c071d70 0x7fed8c147a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:25.780 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:25.771+0000 7fed8bfff640 1 -- 172.21.15.78:0/3489928237 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed8c0714e0 con 0x7fed8c072410 2023-11-28T19:59:25.780 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:25.771+0000 7fed8bfff640 1 --2- 172.21.15.78:0/3489928237 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fed8c072410 0x7fed8c147f50 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fed8401cc20 tx=0x7fed74005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:59:25.781 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:25.771+0000 7fed73fff640 1 -- 172.21.15.78:0/3489928237 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed84006d60 con 0x7fed8c072410 2023-11-28T19:59:25.781 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:25.771+0000 7fed73fff640 1 -- 172.21.15.78:0/3489928237 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed84005240 con 0x7fed8c072410 2023-11-28T19:59:25.781 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:25.771+0000 7fed73fff640 1 -- 172.21.15.78:0/3489928237 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed840055b0 con 0x7fed8c072410 2023-11-28T19:59:25.782 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:25.771+0000 7fed92180640 1 -- 172.21.15.78:0/3489928237 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fed8c070720 con 0x7fed8c072410 2023-11-28T19:59:25.782 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:25.771+0000 7fed92180640 1 -- 172.21.15.78:0/3489928237 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fed8c070ce0 con 0x7fed8c072410 2023-11-28T19:59:25.782 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:25.775+0000 7fed92180640 1 -- 172.21.15.78:0/3489928237 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fed8c067630 con 0x7fed8c072410 2023-11-28T19:59:25.782 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:25.775+0000 7fed73fff640 1 -- 172.21.15.78:0/3489928237 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fed84005710 con 0x7fed8c072410 2023-11-28T19:59:25.782 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:25.775+0000 7fed73fff640 1 --2- 172.21.15.78:0/3489928237 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fed78066470 0x7fed78068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:25.782 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:25.775+0000 7fed73fff640 1 -- 172.21.15.78:0/3489928237 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fed8411da60 con 0x7fed8c072410 2023-11-28T19:59:25.782 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:25.775+0000 7fed8b7fe640 1 --2- 172.21.15.78:0/3489928237 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fed78066470 0x7fed78068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:25.782 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:25.775+0000 7fed8b7fe640 1 --2- 172.21.15.78:0/3489928237 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fed78066470 0x7fed78068930 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fed7c000c10 tx=0x7fed7c009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:59:25.785 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:25.779+0000 7fed73fff640 1 -- 172.21.15.78:0/3489928237 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fed840eaab0 con 0x7fed8c072410 2023-11-28T19:59:25.936 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:25.931+0000 7fed92180640 1 -- 172.21.15.78:0/3489928237 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fed8c0c2070 con 0x7fed8c072410 2023-11-28T19:59:25.938 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:25.931+0000 7fed73fff640 1 -- 172.21.15.78:0/3489928237 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+18322 (secure 0 0 0) 0x7fed840ec9e0 con 0x7fed8c072410 2023-11-28T19:59:25.938 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-11-28T19:59:25.938 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":25,"fsid":"dd9780e8-3bda-44fa-a9f0-fa07d19d901d","created":"2023-11-28T19:58:40.969556+0000","modified":"2023-11-28T19:59:10.474525+0000","last_up_change":"2023-11-28T19:58:52.596716+0000","last_in_change":"2023-11-28T19:58:43.609275+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-28T19:58:54.011229+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-28T19:59:03.945559+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-28T19:59:04.481478+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-11-28T19:59:08.109152+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"e84245ac-b5da-429e-af18-39acaa2b33e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6800","nonce":3358701235},{"type":"v1","addr":"172.21.15.78:6801","nonce":3358701235}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6802","nonce":3358701235},{"type":"v1","addr":"172.21.15.78:6803","nonce":3358701235}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6806","nonce":3358701235},{"type":"v1","addr":"172.21.15.78:6807","nonce":3358701235}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6804","nonce":3358701235},{"type":"v1","addr":"172.21.15.78:6805","nonce":3358701235}]},"public_addr":"172.21.15.78:6801/3358701235","cluster_addr":"172.21.15.78:6803/3358701235","heartbeat_back_addr":"172.21.15.78:6807/3358701235","heartbeat_front_addr":"172.21.15.78:6805/3358701235","state":["exists","up"]},{"osd":1,"uuid":"e634831d-c4e2-48d9-870c-9556ae162981","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6808","nonce":3211476654},{"type":"v1","addr":"172.21.15.78:6809","nonce":3211476654}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6810","nonce":3211476654},{"type":"v1","addr":"172.21.15.78:6811","nonce":3211476654}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6814","nonce":3211476654},{"type":"v1","addr":"172.21.15.78:6815","nonce":3211476654}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6812","nonce":3211476654},{"type":"v1","addr":"172.21.15.78:6813","nonce":3211476654}]},"public_addr":"172.21.15.78:6809/3211476654","cluster_addr":"172.21.15.78:6811/3211476654","heartbeat_back_addr":"172.21.15.78:6815/3211476654","heartbeat_front_addr":"172.21.15.78:6813/3211476654","state":["exists","up"]},{"osd":2,"uuid":"274c8395-6534-41f0-b8fb-a00af8985aa8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6816","nonce":2532904479},{"type":"v1","addr":"172.21.15.78:6817","nonce":2532904479}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6818","nonce":2532904479},{"type":"v1","addr":"172.21.15.78:6819","nonce":2532904479}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6822","nonce":2532904479},{"type":"v1","addr":"172.21.15.78:6823","nonce":2532904479}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6820","nonce":2532904479},{"type":"v1","addr":"172.21.15.78:6821","nonce":2532904479}]},"public_addr":"172.21.15.78:6817/2532904479","cluster_addr":"172.21.15.78:6819/2532904479","heartbeat_back_addr":"172.21.15.78:6823/2532904479","heartbeat_front_addr":"172.21.15.78:6821/2532904479","state":["exists","up"]},{"osd":3,"uuid":"77acc9af-7d4d-4b18-8cf5-d62f5971b7c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6824","nonce":3442991267},{"type":"v1","addr":"172.21.15.78:6825","nonce":3442991267}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6826","nonce":3442991267},{"type":"v1","addr":"172.21.15.78:6827","nonce":3442991267}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6830","nonce":3442991267},{"type":"v1","addr":"172.21.15.78:6831","nonce":3442991267}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6828","nonce":3442991267},{"type":"v1","addr":"172.21.15.78:6829","nonce":3442991267}]},"public_addr":"172.21.15.78:6825/3442991267","cluster_addr":"172.21.15.78:6827/3442991267","heartbeat_back_addr":"172.21.15.78:6831/3442991267","heartbeat_front_addr":"172.21.15.78:6829/3442991267","state":["exists","up"]},{"osd":4,"uuid":"5c62bc66-6b34-4b7f-a66b-9a743969138c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":802983577},{"type":"v1","addr":"172.21.15.179:6809","nonce":802983577}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":802983577},{"type":"v1","addr":"172.21.15.179:6811","nonce":802983577}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":802983577},{"type":"v1","addr":"172.21.15.179:6815","nonce":802983577}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":802983577},{"type":"v1","addr":"172.21.15.179:6813","nonce":802983577}]},"public_addr":"172.21.15.179:6809/802983577","cluster_addr":"172.21.15.179:6811/802983577","heartbeat_back_addr":"172.21.15.179:6815/802983577","heartbeat_front_addr":"172.21.15.179:6813/802983577","state":["exists","up"]},{"osd":5,"uuid":"67db6d36-f684-4079-b0cd-82b4dd61461f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":518192887},{"type":"v1","addr":"172.21.15.179:6818","nonce":518192887}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":518192887},{"type":"v1","addr":"172.21.15.179:6822","nonce":518192887}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":518192887},{"type":"v1","addr":"172.21.15.179:6829","nonce":518192887}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6824","nonce":518192887},{"type":"v1","addr":"172.21.15.179:6826","nonce":518192887}]},"public_addr":"172.21.15.179:6818/518192887","cluster_addr":"172.21.15.179:6822/518192887","heartbeat_back_addr":"172.21.15.179:6829/518192887","heartbeat_front_addr":"172.21.15.179:6826/518192887","state":["exists","up"]},{"osd":6,"uuid":"12e670af-5a16-4c81-9f97-defa66cab967","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":815435378},{"type":"v1","addr":"172.21.15.179:6801","nonce":815435378}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":815435378},{"type":"v1","addr":"172.21.15.179:6803","nonce":815435378}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":815435378},{"type":"v1","addr":"172.21.15.179:6807","nonce":815435378}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":815435378},{"type":"v1","addr":"172.21.15.179:6805","nonce":815435378}]},"public_addr":"172.21.15.179:6801/815435378","cluster_addr":"172.21.15.179:6803/815435378","heartbeat_back_addr":"172.21.15.179:6807/815435378","heartbeat_front_addr":"172.21.15.179:6805/815435378","state":["exists","up"]},{"osd":7,"uuid":"fe630650-2eb3-49ad-8676-c341e6332eb1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6817","nonce":2848432339},{"type":"v1","addr":"172.21.15.179:6819","nonce":2848432339}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6821","nonce":2848432339},{"type":"v1","addr":"172.21.15.179:6823","nonce":2848432339}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":2848432339},{"type":"v1","addr":"172.21.15.179:6831","nonce":2848432339}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6825","nonce":2848432339},{"type":"v1","addr":"172.21.15.179:6827","nonce":2848432339}]},"public_addr":"172.21.15.179:6819/2848432339","cluster_addr":"172.21.15.179:6823/2848432339","heartbeat_back_addr":"172.21.15.179:6831/2848432339","heartbeat_front_addr":"172.21.15.179:6827/2848432339","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:58:49.255433+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:58:49.412880+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:58:49.559295+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:58:49.245237+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:58:49.184557+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:58:49.329851+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:58:49.366012+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:58:49.349604+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-28T19:59:25.940 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:25.935+0000 7fed92180640 1 -- 172.21.15.78:0/3489928237 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fed78066470 msgr2=0x7fed78068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:25.940 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:25.935+0000 7fed92180640 1 --2- 172.21.15.78:0/3489928237 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fed78066470 0x7fed78068930 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fed7c000c10 tx=0x7fed7c009040 comp rx=0 tx=0).stop 2023-11-28T19:59:25.940 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:25.935+0000 7fed92180640 1 -- 172.21.15.78:0/3489928237 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fed8c072410 msgr2=0x7fed8c147f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:25.940 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:25.935+0000 7fed92180640 1 --2- 172.21.15.78:0/3489928237 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fed8c072410 0x7fed8c147f50 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fed8401cc20 tx=0x7fed74005800 comp rx=0 tx=0).stop 2023-11-28T19:59:25.940 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:25.935+0000 7fed92180640 1 -- 172.21.15.78:0/3489928237 shutdown_connections 2023-11-28T19:59:25.940 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:25.935+0000 7fed92180640 1 --2- 172.21.15.78:0/3489928237 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fed78066470 0x7fed78068930 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:25.941 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:25.935+0000 7fed92180640 1 --2- 172.21.15.78:0/3489928237 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fed8c072410 0x7fed8c147f50 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:25.941 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:25.935+0000 7fed92180640 1 --2- 172.21.15.78:0/3489928237 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fed8c071d70 0x7fed8c147a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:25.941 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:25.935+0000 7fed92180640 1 --2- 172.21.15.78:0/3489928237 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fed74004d10 0x7fed8c14d250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:25.941 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:25.935+0000 7fed92180640 1 -- 172.21.15.78:0/3489928237 >> 172.21.15.78:0/3489928237 conn(0x7fed8c0c61f0 msgr2=0x7fed8c150160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T19:59:25.941 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:25.935+0000 7fed92180640 1 -- 172.21.15.78:0/3489928237 shutdown_connections 2023-11-28T19:59:25.941 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:25.935+0000 7fed92180640 1 -- 172.21.15.78:0/3489928237 wait complete. 2023-11-28T19:59:25.959 INFO:tasks.ceph.ceph_manager.ceph:all up! 2023-11-28T19:59:25.959 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-28T19:59:26.097 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.091+0000 7f59ce8e3640 1 Processor -- start 2023-11-28T19:59:26.097 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.091+0000 7f59ce8e3640 1 -- start start 2023-11-28T19:59:26.098 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.091+0000 7f59ce8e3640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f59c80722c0 0x7f59c815de60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:26.098 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.091+0000 7f59ce8e3640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f59c80c5710 con 0x7f59c8071e30 2023-11-28T19:59:26.098 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.091+0000 7f59ce8e3640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f59c8155c80 con 0x7f59c814fd10 2023-11-28T19:59:26.098 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.091+0000 7f59ce8e3640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59c806c5e0 con 0x7f59c80722c0 2023-11-28T19:59:26.099 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.091+0000 7f59c77fe640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f59c8071e30 0x7f59c8156110 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:53902/0 (socket says 172.21.15.78:53902) 2023-11-28T19:59:26.099 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.091+0000 7f59c77fe640 1 -- 172.21.15.78:0/3055043431 learned_addr learned my addr 172.21.15.78:0/3055043431 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-11-28T19:59:26.100 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.095+0000 7f59c6ffd640 1 -- 172.21.15.78:0/3055043431 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2148040420 0 0) 0x7f59c80c5710 con 0x7f59c8071e30 2023-11-28T19:59:26.100 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.095+0000 7f59c6ffd640 1 -- 172.21.15.78:0/3055043431 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f59b0003530 con 0x7f59c8071e30 2023-11-28T19:59:26.101 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.095+0000 7f59cce80640 1 --2- 172.21.15.78:0/3055043431 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f59c80722c0 0x7f59c815de60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:26.101 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.095+0000 7f59c6ffd640 1 -- 172.21.15.78:0/3055043431 <== mon.0 v1:172.21.15.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2712372078 0 0) 0x7f59b0003530 con 0x7f59c8071e30 2023-11-28T19:59:26.101 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.095+0000 7f59c6ffd640 1 -- 172.21.15.78:0/3055043431 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f59c80722c0 msgr2=0x7f59c815de60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T19:59:26.101 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.095+0000 7f59c6ffd640 1 --2- 172.21.15.78:0/3055043431 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f59c80722c0 0x7f59c815de60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:26.101 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.095+0000 7f59c6ffd640 1 -- 172.21.15.78:0/3055043431 >> v1:172.21.15.179:6789/0 conn(0x7f59c814fd10 legacy=0x7f59c80a4dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:26.101 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.095+0000 7f59c6ffd640 1 -- 172.21.15.78:0/3055043431 --> v1:172.21.15.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59c80c4e70 con 0x7f59c8071e30 2023-11-28T19:59:26.101 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.095+0000 7f59c6ffd640 1 -- 172.21.15.78:0/3055043431 <== mon.0 v1:172.21.15.78:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3326804700 0 0) 0x7f59bc001680 con 0x7f59c8071e30 2023-11-28T19:59:26.101 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.095+0000 7f59c6ffd640 1 -- 172.21.15.78:0/3055043431 >> v1:172.21.15.78:6789/0 conn(0x7f59c8071e30 legacy=0x7f59c8156110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:26.101 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.095+0000 7f59c6ffd640 1 --2- 172.21.15.78:0/3055043431 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f59b00039b0 0x7f59b0003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:26.102 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.095+0000 7f59c6ffd640 1 --2- 172.21.15.78:0/3055043431 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f59c80722c0 0x7f59b00047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:26.102 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.095+0000 7f59c6ffd640 1 --2- 172.21.15.78:0/3055043431 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f59b0004d10 0x7f59b0005170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:26.102 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.095+0000 7f59c6ffd640 1 -- 172.21.15.78:0/3055043431 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59b000bb70 con 0x7f59b00039b0 2023-11-28T19:59:26.102 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.095+0000 7f59c6ffd640 1 -- 172.21.15.78:0/3055043431 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59b000bce0 con 0x7f59b0004d10 2023-11-28T19:59:26.102 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.095+0000 7f59c6ffd640 1 -- 172.21.15.78:0/3055043431 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59b000bea0 con 0x7f59c80722c0 2023-11-28T19:59:26.102 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.095+0000 7f59c7fff640 1 --2- 172.21.15.78:0/3055043431 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f59b00039b0 0x7f59b0003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:26.102 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.095+0000 7f59c77fe640 1 --2- 172.21.15.78:0/3055043431 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f59c80722c0 0x7f59b00047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:26.102 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.095+0000 7f59cce80640 1 --2- 172.21.15.78:0/3055043431 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f59b0004d10 0x7f59b0005170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:26.102 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.095+0000 7f59c7fff640 1 -- 172.21.15.78:0/3055043431 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f59c80722c0 msgr2=0x7f59b00047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T19:59:26.102 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.095+0000 7f59c7fff640 1 --2- 172.21.15.78:0/3055043431 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f59c80722c0 0x7f59b00047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:26.102 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.095+0000 7f59c7fff640 1 -- 172.21.15.78:0/3055043431 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f59b0004d10 msgr2=0x7f59b0005170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T19:59:26.103 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.095+0000 7f59c7fff640 1 --2- 172.21.15.78:0/3055043431 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f59b0004d10 0x7f59b0005170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:26.103 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.095+0000 7f59c7fff640 1 -- 172.21.15.78:0/3055043431 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59b0003530 con 0x7f59b00039b0 2023-11-28T19:59:26.103 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.095+0000 7f59cce80640 1 --2- 172.21.15.78:0/3055043431 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f59b0004d10 0x7f59b0005170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T19:59:26.103 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.099+0000 7f59c7fff640 1 --2- 172.21.15.78:0/3055043431 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f59b00039b0 0x7f59b0003dd0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f59b8001780 tx=0x7f59b801c3d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c2c1df5d015a8025 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:59:26.103 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.099+0000 7f59c6ffd640 1 -- 172.21.15.78:0/3055043431 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59b80052d0 con 0x7f59b00039b0 2023-11-28T19:59:26.103 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.099+0000 7f59c6ffd640 1 -- 172.21.15.78:0/3055043431 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f59b80a7050 con 0x7f59b00039b0 2023-11-28T19:59:26.104 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.099+0000 7f59c6ffd640 1 -- 172.21.15.78:0/3055043431 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59b8003600 con 0x7f59b00039b0 2023-11-28T19:59:26.104 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.099+0000 7f59ce8e3640 1 -- 172.21.15.78:0/3055043431 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f59b00039b0 msgr2=0x7f59b0003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:26.104 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.099+0000 7f59ce8e3640 1 --2- 172.21.15.78:0/3055043431 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f59b00039b0 0x7f59b0003dd0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f59b8001780 tx=0x7f59b801c3d0 comp rx=0 tx=0).stop 2023-11-28T19:59:26.104 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.099+0000 7f59cce80640 1 -- 172.21.15.78:0/3055043431 reap_dead start 2023-11-28T19:59:26.104 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.099+0000 7f59ce8e3640 1 -- 172.21.15.78:0/3055043431 shutdown_connections 2023-11-28T19:59:26.105 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.099+0000 7f59ce8e3640 1 -- 172.21.15.78:0/3055043431 >> 172.21.15.78:0/3055043431 conn(0x7f59c80a7810 msgr2=0x7f59c80a7c20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T19:59:26.105 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.099+0000 7f59ce8e3640 1 -- 172.21.15.78:0/3055043431 shutdown_connections 2023-11-28T19:59:26.105 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.099+0000 7f59ce8e3640 1 -- 172.21.15.78:0/3055043431 wait complete. 2023-11-28T19:59:26.105 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.099+0000 7f59ce8e3640 1 Processor -- start 2023-11-28T19:59:26.106 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.099+0000 7f59ce8e3640 1 -- start start 2023-11-28T19:59:26.107 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.103+0000 7f59ce8e3640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f59b00039b0 0x7f59c814a330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:26.107 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.103+0000 7f59ce8e3640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f59c81eb340 0x7f59c815b610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:26.108 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.103+0000 7f59ce8e3640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f59c8151620 0x7f59c8151aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:26.108 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.103+0000 7f59ce8e3640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59c81eb840 con 0x7f59c81eb340 2023-11-28T19:59:26.108 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.103+0000 7f59ce8e3640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59c8151fe0 con 0x7f59b00039b0 2023-11-28T19:59:26.108 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.103+0000 7f59ce8e3640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59c8146f70 con 0x7f59c8151620 2023-11-28T19:59:26.108 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.103+0000 7f59c77fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f59c81eb340 0x7f59c815b610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:26.108 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.103+0000 7f59c7fff640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f59b00039b0 0x7f59c814a330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:26.108 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.103+0000 7f59c77fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f59c81eb340 0x7f59c815b610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:52854/0 (socket says 172.21.15.78:52854) 2023-11-28T19:59:26.108 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.103+0000 7f59c77fe640 1 -- 172.21.15.78:0/1002752101 learned_addr learned my addr 172.21.15.78:0/1002752101 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T19:59:26.108 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.103+0000 7f59cce80640 1 --2- 172.21.15.78:0/1002752101 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f59c8151620 0x7f59c8151aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:26.109 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.103+0000 7f59c77fe640 1 -- 172.21.15.78:0/1002752101 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f59c8151620 msgr2=0x7f59c8151aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:26.109 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.103+0000 7f59c77fe640 1 --2- 172.21.15.78:0/1002752101 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f59c8151620 0x7f59c8151aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:26.110 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.103+0000 7f59c77fe640 1 -- 172.21.15.78:0/1002752101 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f59b00039b0 msgr2=0x7f59c814a330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:26.110 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.103+0000 7f59c77fe640 1 --2- 172.21.15.78:0/1002752101 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f59b00039b0 0x7f59c814a330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:26.110 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.103+0000 7f59c77fe640 1 -- 172.21.15.78:0/1002752101 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59c8147250 con 0x7f59c81eb340 2023-11-28T19:59:26.110 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.103+0000 7f59c77fe640 1 --2- 172.21.15.78:0/1002752101 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f59c81eb340 0x7f59c815b610 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f59bc004ed0 tx=0x7f59bc007430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:59:26.110 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.103+0000 7f59c4ff9640 1 -- 172.21.15.78:0/1002752101 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59bc00f7b0 con 0x7f59c81eb340 2023-11-28T19:59:26.110 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.103+0000 7f59c4ff9640 1 -- 172.21.15.78:0/1002752101 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f59bc00f930 con 0x7f59c81eb340 2023-11-28T19:59:26.110 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.103+0000 7f59c4ff9640 1 -- 172.21.15.78:0/1002752101 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59bc00fce0 con 0x7f59c81eb340 2023-11-28T19:59:26.110 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.103+0000 7f59ce8e3640 1 -- 172.21.15.78:0/1002752101 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f59c8147530 con 0x7f59c81eb340 2023-11-28T19:59:26.110 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.103+0000 7f59ce8e3640 1 -- 172.21.15.78:0/1002752101 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f59c8147d30 con 0x7f59c81eb340 2023-11-28T19:59:26.111 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.103+0000 7f59ce8e3640 1 -- 172.21.15.78:0/1002752101 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f59c8147a50 con 0x7f59c81eb340 2023-11-28T19:59:26.111 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.107+0000 7f59c4ff9640 1 -- 172.21.15.78:0/1002752101 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f59bc01d460 con 0x7f59c81eb340 2023-11-28T19:59:26.112 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.107+0000 7f59c4ff9640 1 --2- 172.21.15.78:0/1002752101 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f59b40664a0 0x7f59b4068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:26.112 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.107+0000 7f59c4ff9640 1 -- 172.21.15.78:0/1002752101 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f59bc084140 con 0x7f59c81eb340 2023-11-28T19:59:26.115 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.111+0000 7f59c7fff640 1 --2- 172.21.15.78:0/1002752101 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f59b40664a0 0x7f59b4068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:26.115 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.111+0000 7f59c7fff640 1 --2- 172.21.15.78:0/1002752101 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f59b40664a0 0x7f59b4068960 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f59b8001750 tx=0x7f59b80011a0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:59:26.116 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.111+0000 7f59c4ff9640 1 -- 172.21.15.78:0/1002752101 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f59c8147a50 con 0x7f59c81eb340 2023-11-28T19:59:26.270 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.263+0000 7f59ce8e3640 1 -- 172.21.15.78:0/1002752101 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f59c8147a50 con 0x7f59c81eb340 2023-11-28T19:59:26.271 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.267+0000 7f59c4ff9640 1 -- 172.21.15.78:0/1002752101 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+18322 (secure 0 0 0) 0x7f59c8147a50 con 0x7f59c81eb340 2023-11-28T19:59:26.271 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-11-28T19:59:26.272 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":25,"fsid":"dd9780e8-3bda-44fa-a9f0-fa07d19d901d","created":"2023-11-28T19:58:40.969556+0000","modified":"2023-11-28T19:59:10.474525+0000","last_up_change":"2023-11-28T19:58:52.596716+0000","last_in_change":"2023-11-28T19:58:43.609275+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-28T19:58:54.011229+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-28T19:59:03.945559+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-28T19:59:04.481478+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-11-28T19:59:08.109152+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"e84245ac-b5da-429e-af18-39acaa2b33e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6800","nonce":3358701235},{"type":"v1","addr":"172.21.15.78:6801","nonce":3358701235}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6802","nonce":3358701235},{"type":"v1","addr":"172.21.15.78:6803","nonce":3358701235}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6806","nonce":3358701235},{"type":"v1","addr":"172.21.15.78:6807","nonce":3358701235}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6804","nonce":3358701235},{"type":"v1","addr":"172.21.15.78:6805","nonce":3358701235}]},"public_addr":"172.21.15.78:6801/3358701235","cluster_addr":"172.21.15.78:6803/3358701235","heartbeat_back_addr":"172.21.15.78:6807/3358701235","heartbeat_front_addr":"172.21.15.78:6805/3358701235","state":["exists","up"]},{"osd":1,"uuid":"e634831d-c4e2-48d9-870c-9556ae162981","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6808","nonce":3211476654},{"type":"v1","addr":"172.21.15.78:6809","nonce":3211476654}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6810","nonce":3211476654},{"type":"v1","addr":"172.21.15.78:6811","nonce":3211476654}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6814","nonce":3211476654},{"type":"v1","addr":"172.21.15.78:6815","nonce":3211476654}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6812","nonce":3211476654},{"type":"v1","addr":"172.21.15.78:6813","nonce":3211476654}]},"public_addr":"172.21.15.78:6809/3211476654","cluster_addr":"172.21.15.78:6811/3211476654","heartbeat_back_addr":"172.21.15.78:6815/3211476654","heartbeat_front_addr":"172.21.15.78:6813/3211476654","state":["exists","up"]},{"osd":2,"uuid":"274c8395-6534-41f0-b8fb-a00af8985aa8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6816","nonce":2532904479},{"type":"v1","addr":"172.21.15.78:6817","nonce":2532904479}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6818","nonce":2532904479},{"type":"v1","addr":"172.21.15.78:6819","nonce":2532904479}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6822","nonce":2532904479},{"type":"v1","addr":"172.21.15.78:6823","nonce":2532904479}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6820","nonce":2532904479},{"type":"v1","addr":"172.21.15.78:6821","nonce":2532904479}]},"public_addr":"172.21.15.78:6817/2532904479","cluster_addr":"172.21.15.78:6819/2532904479","heartbeat_back_addr":"172.21.15.78:6823/2532904479","heartbeat_front_addr":"172.21.15.78:6821/2532904479","state":["exists","up"]},{"osd":3,"uuid":"77acc9af-7d4d-4b18-8cf5-d62f5971b7c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6824","nonce":3442991267},{"type":"v1","addr":"172.21.15.78:6825","nonce":3442991267}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6826","nonce":3442991267},{"type":"v1","addr":"172.21.15.78:6827","nonce":3442991267}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6830","nonce":3442991267},{"type":"v1","addr":"172.21.15.78:6831","nonce":3442991267}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6828","nonce":3442991267},{"type":"v1","addr":"172.21.15.78:6829","nonce":3442991267}]},"public_addr":"172.21.15.78:6825/3442991267","cluster_addr":"172.21.15.78:6827/3442991267","heartbeat_back_addr":"172.21.15.78:6831/3442991267","heartbeat_front_addr":"172.21.15.78:6829/3442991267","state":["exists","up"]},{"osd":4,"uuid":"5c62bc66-6b34-4b7f-a66b-9a743969138c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":802983577},{"type":"v1","addr":"172.21.15.179:6809","nonce":802983577}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":802983577},{"type":"v1","addr":"172.21.15.179:6811","nonce":802983577}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":802983577},{"type":"v1","addr":"172.21.15.179:6815","nonce":802983577}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":802983577},{"type":"v1","addr":"172.21.15.179:6813","nonce":802983577}]},"public_addr":"172.21.15.179:6809/802983577","cluster_addr":"172.21.15.179:6811/802983577","heartbeat_back_addr":"172.21.15.179:6815/802983577","heartbeat_front_addr":"172.21.15.179:6813/802983577","state":["exists","up"]},{"osd":5,"uuid":"67db6d36-f684-4079-b0cd-82b4dd61461f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":518192887},{"type":"v1","addr":"172.21.15.179:6818","nonce":518192887}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":518192887},{"type":"v1","addr":"172.21.15.179:6822","nonce":518192887}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":518192887},{"type":"v1","addr":"172.21.15.179:6829","nonce":518192887}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6824","nonce":518192887},{"type":"v1","addr":"172.21.15.179:6826","nonce":518192887}]},"public_addr":"172.21.15.179:6818/518192887","cluster_addr":"172.21.15.179:6822/518192887","heartbeat_back_addr":"172.21.15.179:6829/518192887","heartbeat_front_addr":"172.21.15.179:6826/518192887","state":["exists","up"]},{"osd":6,"uuid":"12e670af-5a16-4c81-9f97-defa66cab967","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":815435378},{"type":"v1","addr":"172.21.15.179:6801","nonce":815435378}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":815435378},{"type":"v1","addr":"172.21.15.179:6803","nonce":815435378}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":815435378},{"type":"v1","addr":"172.21.15.179:6807","nonce":815435378}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":815435378},{"type":"v1","addr":"172.21.15.179:6805","nonce":815435378}]},"public_addr":"172.21.15.179:6801/815435378","cluster_addr":"172.21.15.179:6803/815435378","heartbeat_back_addr":"172.21.15.179:6807/815435378","heartbeat_front_addr":"172.21.15.179:6805/815435378","state":["exists","up"]},{"osd":7,"uuid":"fe630650-2eb3-49ad-8676-c341e6332eb1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6817","nonce":2848432339},{"type":"v1","addr":"172.21.15.179:6819","nonce":2848432339}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6821","nonce":2848432339},{"type":"v1","addr":"172.21.15.179:6823","nonce":2848432339}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":2848432339},{"type":"v1","addr":"172.21.15.179:6831","nonce":2848432339}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6825","nonce":2848432339},{"type":"v1","addr":"172.21.15.179:6827","nonce":2848432339}]},"public_addr":"172.21.15.179:6819/2848432339","cluster_addr":"172.21.15.179:6823/2848432339","heartbeat_back_addr":"172.21.15.179:6831/2848432339","heartbeat_front_addr":"172.21.15.179:6827/2848432339","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:58:49.255433+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:58:49.412880+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:58:49.559295+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:58:49.245237+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:58:49.184557+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:58:49.329851+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:58:49.366012+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:58:49.349604+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-28T19:59:26.273 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.267+0000 7f59ce8e3640 1 -- 172.21.15.78:0/1002752101 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f59b40664a0 msgr2=0x7f59b4068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:26.273 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.267+0000 7f59ce8e3640 1 --2- 172.21.15.78:0/1002752101 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f59b40664a0 0x7f59b4068960 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f59b8001750 tx=0x7f59b80011a0 comp rx=0 tx=0).stop 2023-11-28T19:59:26.274 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.267+0000 7f59ce8e3640 1 -- 172.21.15.78:0/1002752101 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f59c81eb340 msgr2=0x7f59c815b610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:26.274 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.267+0000 7f59ce8e3640 1 --2- 172.21.15.78:0/1002752101 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f59c81eb340 0x7f59c815b610 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f59bc004ed0 tx=0x7f59bc007430 comp rx=0 tx=0).stop 2023-11-28T19:59:26.274 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.267+0000 7f59ce8e3640 1 -- 172.21.15.78:0/1002752101 shutdown_connections 2023-11-28T19:59:26.274 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.267+0000 7f59ce8e3640 1 --2- 172.21.15.78:0/1002752101 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f59b40664a0 0x7f59b4068960 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:26.274 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.267+0000 7f59ce8e3640 1 --2- 172.21.15.78:0/1002752101 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f59c8151620 0x7f59c8151aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:26.274 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.267+0000 7f59ce8e3640 1 --2- 172.21.15.78:0/1002752101 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f59c81eb340 0x7f59c815b610 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:26.274 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.267+0000 7f59ce8e3640 1 --2- 172.21.15.78:0/1002752101 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f59b00039b0 0x7f59c814a330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:26.275 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.267+0000 7f59ce8e3640 1 -- 172.21.15.78:0/1002752101 >> 172.21.15.78:0/1002752101 conn(0x7f59c80a7810 msgr2=0x7f59c806d1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T19:59:26.275 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.267+0000 7f59ce8e3640 1 -- 172.21.15.78:0/1002752101 shutdown_connections 2023-11-28T19:59:26.275 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.267+0000 7f59ce8e3640 1 -- 172.21.15.78:0/1002752101 wait complete. 2023-11-28T19:59:26.293 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2023-11-28T19:59:26.294 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2023-11-28T19:59:26.294 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2023-11-28T19:59:26.295 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2023-11-28T19:59:26.295 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2023-11-28T19:59:26.296 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2023-11-28T19:59:26.296 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2023-11-28T19:59:26.297 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2023-11-28T19:59:26.535 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.531+0000 7fc223c46640 1 Processor -- start 2023-11-28T19:59:26.535 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.531+0000 7fc223c46640 1 -- start start 2023-11-28T19:59:26.537 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.531+0000 7fc223c46640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc2140d4330 0x7fc214007190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:26.538 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.531+0000 7fc223c46640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc21400e140 con 0x7fc21404dac0 2023-11-28T19:59:26.538 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.531+0000 7fc223c46640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc21404a6c0 con 0x7fc2140076d0 2023-11-28T19:59:26.538 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.531+0000 7fc223c46640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc2140db300 con 0x7fc2140d4330 2023-11-28T19:59:26.538 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.531+0000 7fc2219e2640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc2140d4330 0x7fc214007190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:26.538 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.531+0000 7fc2219e2640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc2140d4330 0x7fc214007190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3301/0 says I am v2:172.21.15.78:47696/0 (socket says 172.21.15.78:47696) 2023-11-28T19:59:26.538 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.531+0000 7fc2219e2640 1 -- 172.21.15.78:0/381124469 learned_addr learned my addr 172.21.15.78:0/381124469 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T19:59:26.539 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.531+0000 7fc2219e2640 1 -- 172.21.15.78:0/381124469 >> v1:172.21.15.179:6789/0 conn(0x7fc2140076d0 legacy=0x7fc21400ece0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T19:59:26.539 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.531+0000 7fc2219e2640 1 -- 172.21.15.78:0/381124469 >> v1:172.21.15.78:6789/0 conn(0x7fc21404dac0 legacy=0x7fc21400e5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T19:59:26.539 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.531+0000 7fc2219e2640 1 -- 172.21.15.78:0/381124469 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc21404a9a0 con 0x7fc2140d4330 2023-11-28T19:59:26.542 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.535+0000 7f324fc32640 1 Processor -- start 2023-11-28T19:59:26.542 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.535+0000 7f324fc32640 1 -- start start 2023-11-28T19:59:26.543 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.539+0000 7fc2219e2640 1 --2- 172.21.15.78:0/381124469 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc2140d4330 0x7fc214007190 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fc2180098a0 tx=0x7fc21801c390 comp rx=0 tx=0).ready entity=mon.2 client_cookie=67ce7356a6b44d3a server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:59:26.543 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.539+0000 7f324fc32640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f324004b980 0x7f324004bd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:26.544 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.539+0000 7fc2209e0640 1 -- 172.21.15.78:0/381124469 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2180ab600 con 0x7fc2140d4330 2023-11-28T19:59:26.544 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.539+0000 7fc2209e0640 1 -- 172.21.15.78:0/381124469 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc2180a7050 con 0x7fc2140d4330 2023-11-28T19:59:26.544 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.539+0000 7f324fc32640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f32400dc230 con 0x7f32400dec90 2023-11-28T19:59:26.545 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.539+0000 7f324fc32640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f32400dfc80 con 0x7f3240049f80 2023-11-28T19:59:26.545 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.539+0000 7f324fc32640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f324000fd70 con 0x7f324004b980 2023-11-28T19:59:26.545 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.539+0000 7fc2209e0640 1 -- 172.21.15.78:0/381124469 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2180ab980 con 0x7fc2140d4330 2023-11-28T19:59:26.545 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.539+0000 7f324d1cd640 1 --1- >> v1:172.21.15.179:6789/0 conn(0x7f3240049f80 0x7f32400e2730 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.179:6789/0 says I am v1:172.21.15.78:60050/0 (socket says 172.21.15.78:60050) 2023-11-28T19:59:26.546 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.539+0000 7f324d1cd640 1 -- 172.21.15.78:0/1544002705 learned_addr learned my addr 172.21.15.78:0/1544002705 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-11-28T19:59:26.546 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.539+0000 7f324d9ce640 1 --2- 172.21.15.78:0/1544002705 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f324004b980 0x7f324004bd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:26.546 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.539+0000 7fc223c46640 1 -- 172.21.15.78:0/381124469 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc2140d4330 msgr2=0x7fc214007190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:26.546 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.539+0000 7fc223c46640 1 --2- 172.21.15.78:0/381124469 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc2140d4330 0x7fc214007190 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fc2180098a0 tx=0x7fc21801c390 comp rx=0 tx=0).stop 2023-11-28T19:59:26.546 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.539+0000 7fc223c46640 1 -- 172.21.15.78:0/381124469 shutdown_connections 2023-11-28T19:59:26.547 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.539+0000 7fc223c46640 1 --2- 172.21.15.78:0/381124469 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc2140d4330 0x7fc214007190 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:26.547 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.539+0000 7fc223c46640 1 -- 172.21.15.78:0/381124469 >> 172.21.15.78:0/381124469 conn(0x7fc21404c640 msgr2=0x7fc21404ca50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T19:59:26.548 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.539+0000 7f324c9cc640 1 -- 172.21.15.78:0/1544002705 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2430609771 0 0) 0x7f32400dfc80 con 0x7f3240049f80 2023-11-28T19:59:26.548 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.539+0000 7f324c9cc640 1 -- 172.21.15.78:0/1544002705 --> v1:172.21.15.179:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3234003530 con 0x7f3240049f80 2023-11-28T19:59:26.548 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.539+0000 7f324c9cc640 1 -- 172.21.15.78:0/1544002705 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1646281415 0 0) 0x7f324804f7e0 con 0x7f32400dec90 2023-11-28T19:59:26.548 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.539+0000 7f324c9cc640 1 -- 172.21.15.78:0/1544002705 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f32400dfc80 con 0x7f32400dec90 2023-11-28T19:59:26.549 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.539+0000 7f324d9ce640 1 -- 172.21.15.78:0/1544002705 >> v1:172.21.15.179:6789/0 conn(0x7f3240049f80 legacy=0x7f32400e2730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:26.549 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.539+0000 7eff92417640 1 Processor -- start 2023-11-28T19:59:26.550 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.539+0000 7f324c9cc640 1 -- 172.21.15.78:0/1544002705 <== mon.0 v1:172.21.15.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 140495959 0 0) 0x7f32400dfc80 con 0x7f32400dec90 2023-11-28T19:59:26.550 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.539+0000 7f324d9ce640 1 -- 172.21.15.78:0/1544002705 >> v1:172.21.15.78:6789/0 conn(0x7f32400dec90 legacy=0x7f32400df120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:26.550 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.539+0000 7f324d9ce640 1 -- 172.21.15.78:0/1544002705 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32400de790 con 0x7f324004b980 2023-11-28T19:59:26.551 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.543+0000 7fc223c46640 1 -- 172.21.15.78:0/381124469 shutdown_connections 2023-11-28T19:59:26.551 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.543+0000 7fc223c46640 1 -- 172.21.15.78:0/381124469 wait complete. 2023-11-28T19:59:26.552 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.539+0000 7eff92417640 1 -- start start 2023-11-28T19:59:26.552 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.543+0000 7eff92417640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7eff8c14dce0 0x7eff8c06ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:26.552 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.543+0000 7eff92417640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7eff8c0c5f80 0x7eff8c0c3a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:26.553 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.543+0000 7eff92417640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7eff8c0a55c0 con 0x7eff8c06bf50 2023-11-28T19:59:26.553 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.543+0000 7eff92417640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7eff8c1505c0 con 0x7eff8c14dce0 2023-11-28T19:59:26.553 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.543+0000 7eff92417640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7eff8c1507d0 con 0x7eff8c0c5f80 2023-11-28T19:59:26.553 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.543+0000 7eff8bfff640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7eff8c14dce0 0x7eff8c06ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:26.553 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.543+0000 7eff837fe640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7eff8c0c5f80 0x7eff8c0c3a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:26.554 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.543+0000 7eff837fe640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7eff8c0c5f80 0x7eff8c0c3a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.78:49808/0 (socket says 172.21.15.78:49808) 2023-11-28T19:59:26.554 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.543+0000 7eff837fe640 1 -- 172.21.15.78:0/756705459 learned_addr learned my addr 172.21.15.78:0/756705459 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T19:59:26.554 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.543+0000 7eff8b7fe640 1 -- 172.21.15.78:0/756705459 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3762329525 0 0) 0x7eff8c0a55c0 con 0x7eff8c06bf50 2023-11-28T19:59:26.554 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.543+0000 7eff8b7fe640 1 -- 172.21.15.78:0/756705459 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7eff78003530 con 0x7eff8c06bf50 2023-11-28T19:59:26.554 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.543+0000 7fc223c46640 1 Processor -- start 2023-11-28T19:59:26.555 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.543+0000 7eff8b7fe640 1 -- 172.21.15.78:0/756705459 <== mon.0 v1:172.21.15.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2397307670 0 0) 0x7eff78003530 con 0x7eff8c06bf50 2023-11-28T19:59:26.555 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.543+0000 7eff8b7fe640 1 -- 172.21.15.78:0/756705459 >> v2:172.21.15.179:3300/0 conn(0x7eff8c0c5f80 msgr2=0x7eff8c0c3a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T19:59:26.555 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.543+0000 7eff8b7fe640 1 --2- 172.21.15.78:0/756705459 >> v2:172.21.15.179:3300/0 conn(0x7eff8c0c5f80 0x7eff8c0c3a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:26.555 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.543+0000 7eff8b7fe640 1 -- 172.21.15.78:0/756705459 >> v2:172.21.15.78:3300/0 conn(0x7eff8c14dce0 msgr2=0x7eff8c06ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T19:59:26.555 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.543+0000 7eff8b7fe640 1 --2- 172.21.15.78:0/756705459 >> v2:172.21.15.78:3300/0 conn(0x7eff8c14dce0 0x7eff8c06ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:26.556 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.543+0000 7fc223c46640 1 -- start start 2023-11-28T19:59:26.556 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.543+0000 7eff8b7fe640 1 -- 172.21.15.78:0/756705459 --> v1:172.21.15.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff8c150ab0 con 0x7eff8c06bf50 2023-11-28T19:59:26.556 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.543+0000 7eff8b7fe640 1 -- 172.21.15.78:0/756705459 <== mon.0 v1:172.21.15.78:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3326804700 0 0) 0x7eff84001680 con 0x7eff8c06bf50 2023-11-28T19:59:26.556 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.543+0000 7eff8b7fe640 1 -- 172.21.15.78:0/756705459 >> v1:172.21.15.78:6789/0 conn(0x7eff8c06bf50 legacy=0x7eff8c0c3f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:26.556 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.543+0000 7eff8b7fe640 1 --2- 172.21.15.78:0/756705459 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7eff78003980 0x7eff78003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:26.556 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.543+0000 7eff8b7fe640 1 --2- 172.21.15.78:0/756705459 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7eff780047d0 0x7eff78004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:26.556 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.547+0000 7eff8b7fe640 1 --2- 172.21.15.78:0/756705459 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7eff78005190 0x7eff7800b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:26.557 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.547+0000 7eff8b7fe640 1 -- 172.21.15.78:0/756705459 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff8c1505c0 con 0x7eff78003980 2023-11-28T19:59:26.557 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.547+0000 7eff8b7fe640 1 -- 172.21.15.78:0/756705459 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff8c1507d0 con 0x7eff780047d0 2023-11-28T19:59:26.557 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.547+0000 7eff8b7fe640 1 -- 172.21.15.78:0/756705459 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff7800c1b0 con 0x7eff78005190 2023-11-28T19:59:26.557 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.547+0000 7eff8bfff640 1 --2- 172.21.15.78:0/756705459 >> v2:172.21.15.78:3300/0 conn(0x7eff8c14dce0 0x7eff8c06ba10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T19:59:26.558 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.547+0000 7f324d9ce640 1 --2- 172.21.15.78:0/1544002705 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f324004b980 0x7f324004bd60 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f32380097f0 tx=0x7f323801c290 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ea9dd04b13385979 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:59:26.558 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.547+0000 7eff909b4640 1 --2- 172.21.15.78:0/756705459 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7eff78005190 0x7eff7800b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:26.559 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.547+0000 7eff837fe640 1 --2- 172.21.15.78:0/756705459 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7eff780047d0 0x7eff78004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:26.559 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.547+0000 7fc223c46640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc2140076d0 0x7fc214176a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:26.560 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.547+0000 7fc223c46640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc21404dac0 0x7fc214176f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:26.560 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.547+0000 7fc223c46640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc2140d4330 0x7fc214175320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:26.560 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.547+0000 7fc223c46640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2140db9e0 con 0x7fc21404dac0 2023-11-28T19:59:26.560 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.547+0000 7fc223c46640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2140db740 con 0x7fc2140d4330 2023-11-28T19:59:26.560 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.547+0000 7fc223c46640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc214177550 con 0x7fc2140076d0 2023-11-28T19:59:26.561 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.547+0000 7f324c9cc640 1 -- 172.21.15.78:0/1544002705 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32380a4ea0 con 0x7f324004b980 2023-11-28T19:59:26.561 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.547+0000 7f324c9cc640 1 -- 172.21.15.78:0/1544002705 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f32380a7050 con 0x7f324004b980 2023-11-28T19:59:26.561 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.547+0000 7f324c9cc640 1 -- 172.21.15.78:0/1544002705 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32480674b0 con 0x7f324004b980 2023-11-28T19:59:26.561 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.547+0000 7eff8bfff640 1 --2- 172.21.15.78:0/756705459 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7eff78003980 0x7eff78003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:26.561 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.547+0000 7fc2219e2640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc2140076d0 0x7fc214176a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:26.562 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.547+0000 7fc2219e2640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc2140076d0 0x7fc214176a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3301/0 says I am v2:172.21.15.78:47740/0 (socket says 172.21.15.78:47740) 2023-11-28T19:59:26.562 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.547+0000 7fc2219e2640 1 -- 172.21.15.78:0/1372462674 learned_addr learned my addr 172.21.15.78:0/1372462674 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T19:59:26.562 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.547+0000 7fc2211e1640 1 --2- 172.21.15.78:0/1372462674 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc21404dac0 0x7fc214176f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:26.562 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.547+0000 7fc2221e3640 1 --2- 172.21.15.78:0/1372462674 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc2140d4330 0x7fc214175320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:26.562 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.547+0000 7eff837fe640 1 -- 172.21.15.78:0/756705459 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7eff78005190 msgr2=0x7eff7800b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T19:59:26.563 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.547+0000 7f324fc32640 1 -- 172.21.15.78:0/1544002705 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f324004b980 msgr2=0x7f324004bd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:26.563 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.547+0000 7f324fc32640 1 --2- 172.21.15.78:0/1544002705 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f324004b980 0x7f324004bd60 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f32380097f0 tx=0x7f323801c290 comp rx=0 tx=0).stop 2023-11-28T19:59:26.563 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.547+0000 7fc2219e2640 1 -- 172.21.15.78:0/1372462674 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc2140d4330 msgr2=0x7fc214175320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:26.563 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.547+0000 7fc2219e2640 1 --2- 172.21.15.78:0/1372462674 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc2140d4330 0x7fc214175320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:26.563 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.547+0000 7fc2219e2640 1 -- 172.21.15.78:0/1372462674 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc21404dac0 msgr2=0x7fc214176f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:26.564 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.547+0000 7fc2219e2640 1 --2- 172.21.15.78:0/1372462674 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc21404dac0 0x7fc214176f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:26.564 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.547+0000 7fc2219e2640 1 -- 172.21.15.78:0/1372462674 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2180094d0 con 0x7fc2140076d0 2023-11-28T19:59:26.564 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.547+0000 7f61e4157640 1 Processor -- start 2023-11-28T19:59:26.564 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.547+0000 7f324fc32640 1 -- 172.21.15.78:0/1544002705 shutdown_connections 2023-11-28T19:59:26.565 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.547+0000 7fc2219e2640 1 --2- 172.21.15.78:0/1372462674 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc2140076d0 0x7fc214176a10 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fc21801cc30 tx=0x7fc218019130 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:59:26.565 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.547+0000 7f324fc32640 1 --2- 172.21.15.78:0/1544002705 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f324004b980 0x7f324004bd60 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:26.565 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.547+0000 7f61e4157640 1 -- start start 2023-11-28T19:59:26.566 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.547+0000 7fc2127fc640 1 -- 172.21.15.78:0/1372462674 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2180b5610 con 0x7fc2140076d0 2023-11-28T19:59:26.566 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.547+0000 7fc2127fc640 1 -- 172.21.15.78:0/1372462674 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc2180b5770 con 0x7fc2140076d0 2023-11-28T19:59:26.566 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.547+0000 7fc2127fc640 1 -- 172.21.15.78:0/1372462674 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2180b5b20 con 0x7fc2140076d0 2023-11-28T19:59:26.566 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.547+0000 7f324fc32640 1 -- 172.21.15.78:0/1544002705 >> 172.21.15.78:0/1544002705 conn(0x7f324004fbe0 msgr2=0x7f324004fff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T19:59:26.567 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.551+0000 7fc223c46640 1 -- 172.21.15.78:0/1372462674 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc214174b20 con 0x7fc2140076d0 2023-11-28T19:59:26.567 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.551+0000 7fc223c46640 1 -- 172.21.15.78:0/1372462674 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc214034470 con 0x7fc2140076d0 2023-11-28T19:59:26.567 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.547+0000 7eff837fe640 1 --2- 172.21.15.78:0/756705459 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7eff78005190 0x7eff7800b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:26.567 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.547+0000 7eff837fe640 1 -- 172.21.15.78:0/756705459 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7eff78003980 msgr2=0x7eff78003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T19:59:26.567 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.547+0000 7eff837fe640 1 --2- 172.21.15.78:0/756705459 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7eff78003980 0x7eff78003da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:26.567 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.547+0000 7eff837fe640 1 -- 172.21.15.78:0/756705459 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff8c150ab0 con 0x7eff780047d0 2023-11-28T19:59:26.567 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.547+0000 7eff909b4640 1 --2- 172.21.15.78:0/756705459 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7eff78005190 0x7eff7800b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T19:59:26.568 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.547+0000 7eff909b4640 1 -- 172.21.15.78:0/756705459 reap_dead start 2023-11-28T19:59:26.568 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.551+0000 7eff8bfff640 1 --2- 172.21.15.78:0/756705459 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7eff78003980 0x7eff78003da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T19:59:26.568 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.551+0000 7feb24b2a640 1 Processor -- start 2023-11-28T19:59:26.568 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.551+0000 7feb24b2a640 1 -- start start 2023-11-28T19:59:26.569 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.551+0000 7f324fc32640 1 -- 172.21.15.78:0/1544002705 shutdown_connections 2023-11-28T19:59:26.569 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.551+0000 7f61e4157640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f61dc0a5370 0x7f61dc14f870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:26.569 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.551+0000 7f61e4157640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f61dc1524b0 con 0x7f61dc0a4f90 2023-11-28T19:59:26.569 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.551+0000 7f61e4157640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f61dc0c62f0 con 0x7f61dc072810 2023-11-28T19:59:26.569 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.551+0000 7f61e4157640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f61dc0c60d0 con 0x7f61dc0a5370 2023-11-28T19:59:26.569 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.551+0000 7f61e26f4640 1 --1- >> v1:172.21.15.179:6789/0 conn(0x7f61dc072810 0x7f61dc0c0800 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.179:6789/0 says I am v1:172.21.15.78:60062/0 (socket says 172.21.15.78:60062) 2023-11-28T19:59:26.569 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.551+0000 7f61e26f4640 1 -- 172.21.15.78:0/3573940705 learned_addr learned my addr 172.21.15.78:0/3573940705 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-11-28T19:59:26.570 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.551+0000 7f324fc32640 1 -- 172.21.15.78:0/1544002705 wait complete. 2023-11-28T19:59:26.570 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.551+0000 7fc223c46640 1 -- 172.21.15.78:0/1372462674 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fc204000fd0 con 0x7fc2140076d0 2023-11-28T19:59:26.570 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.551+0000 7f61e0ef1640 1 -- 172.21.15.78:0/3573940705 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3980325382 0 0) 0x7f61dc0c62f0 con 0x7f61dc072810 2023-11-28T19:59:26.571 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.551+0000 7f61e0ef1640 1 -- 172.21.15.78:0/3573940705 --> v1:172.21.15.179:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f61c8003530 con 0x7f61dc072810 2023-11-28T19:59:26.571 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.551+0000 7feb24b2a640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7feb2006d180 0x7feb200c4a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:26.571 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.551+0000 7feb24b2a640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7feb200bee60 0x7feb200bf270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:26.571 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.551+0000 7feb24b2a640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feb200c0e20 con 0x7feb20155430 2023-11-28T19:59:26.572 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.551+0000 7feb24b2a640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feb2006ce30 con 0x7feb2006d180 2023-11-28T19:59:26.572 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.551+0000 7feb24b2a640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feb200c1350 con 0x7feb200bee60 2023-11-28T19:59:26.572 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.551+0000 7feb1e59c640 1 --1- >> v1:172.21.15.179:6789/0 conn(0x7feb20155430 0x7feb200c0530 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.179:6789/0 says I am v1:172.21.15.78:60074/0 (socket says 172.21.15.78:60074) 2023-11-28T19:59:26.572 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.551+0000 7feb1e59c640 1 -- 172.21.15.78:0/4143109188 learned_addr learned my addr 172.21.15.78:0/4143109188 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-11-28T19:59:26.572 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.551+0000 7feb15d9b640 1 --2- 172.21.15.78:0/4143109188 >> v2:172.21.15.78:3300/0 conn(0x7feb2006d180 0x7feb200c4a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:26.572 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.555+0000 7fc2127fc640 1 -- 172.21.15.78:0/1372462674 <== mon.2 v2:172.21.15.179:3301/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fc2180b2050 con 0x7fc2140076d0 2023-11-28T19:59:26.572 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.555+0000 7f08f685a640 1 Processor -- start 2023-11-28T19:59:26.573 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.555+0000 7feb1dd9b640 1 -- 172.21.15.78:0/4143109188 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2225717530 0 0) 0x7feb200c0e20 con 0x7feb20155430 2023-11-28T19:59:26.573 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.555+0000 7f61e16f2640 1 --2- 172.21.15.78:0/3573940705 >> v2:172.21.15.179:3300/0 conn(0x7f61dc0a5370 0x7f61dc14f870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:26.573 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.555+0000 7feb1ed9d640 1 --2- 172.21.15.78:0/4143109188 >> v2:172.21.15.179:3300/0 conn(0x7feb200bee60 0x7feb200bf270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:26.574 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.555+0000 7feb1dd9b640 1 -- 172.21.15.78:0/4143109188 --> v1:172.21.15.179:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7feb0c003530 con 0x7feb20155430 2023-11-28T19:59:26.574 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.555+0000 7f324fc32640 1 Processor -- start 2023-11-28T19:59:26.574 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.555+0000 7eff837fe640 1 --2- 172.21.15.78:0/756705459 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7eff780047d0 0x7eff78004c50 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7eff7400ab50 tx=0x7eff74020dd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1ff771065c5d61d2 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:59:26.574 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.555+0000 7feb15d9b640 1 -- 172.21.15.78:0/4143109188 >> v2:172.21.15.179:3300/0 conn(0x7feb200bee60 msgr2=0x7feb200bf270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T19:59:26.575 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.555+0000 7feb15d9b640 1 --2- 172.21.15.78:0/4143109188 >> v2:172.21.15.179:3300/0 conn(0x7feb200bee60 0x7feb200bf270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:26.575 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.555+0000 7feb15d9b640 1 -- 172.21.15.78:0/4143109188 >> v1:172.21.15.179:6789/0 conn(0x7feb20155430 legacy=0x7feb200c0530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:26.575 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.555+0000 7feb15d9b640 1 -- 172.21.15.78:0/4143109188 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb200c1070 con 0x7feb2006d180 2023-11-28T19:59:26.575 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.555+0000 7f08f685a640 1 -- start start 2023-11-28T19:59:26.575 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.555+0000 7f324fc32640 1 -- start start 2023-11-28T19:59:26.576 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.555+0000 7fc2127fc640 1 --2- 172.21.15.78:0/1372462674 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fc200066540 0x7fc200068a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:26.576 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.555+0000 7eff8b7fe640 1 -- 172.21.15.78:0/756705459 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff740a9de0 con 0x7eff780047d0 2023-11-28T19:59:26.576 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.555+0000 7eff8b7fe640 1 -- 172.21.15.78:0/756705459 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff740ad070 con 0x7eff780047d0 2023-11-28T19:59:26.576 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.555+0000 7eff8b7fe640 1 -- 172.21.15.78:0/756705459 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff740b3620 con 0x7eff780047d0 2023-11-28T19:59:26.577 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.555+0000 7fc2127fc640 1 -- 172.21.15.78:0/1372462674 <== mon.2 v2:172.21.15.179:3301/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fc21811e710 con 0x7fc2140076d0 2023-11-28T19:59:26.577 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.555+0000 7fc2127fc640 1 --2- 172.21.15.78:0/1372462674 >> [v2:172.21.15.78:6808/3211476654,v1:172.21.15.78:6809/3211476654] conn(0x7fc20006fb80 0x7fc200071fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:26.577 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.555+0000 7fc2127fc640 1 -- 172.21.15.78:0/1372462674 --> [v2:172.21.15.78:6808/3211476654,v1:172.21.15.78:6809/3211476654] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fc200072690 con 0x7fc20006fb80 2023-11-28T19:59:26.577 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.555+0000 7fc2127fc640 1 -- 172.21.15.78:0/1372462674 <== mon.2 v2:172.21.15.179:3301/0 6 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc218120d30 con 0x7fc2140076d0 2023-11-28T19:59:26.577 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.555+0000 7fc2211e1640 1 --2- 172.21.15.78:0/1372462674 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fc200066540 0x7fc200068a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:26.577 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.555+0000 7f08f685a640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f08f015cba0 0x7f08f006d160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:26.578 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.555+0000 7f08f685a640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f08f015c710 con 0x7f08f0152d30 2023-11-28T19:59:26.578 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.555+0000 7f08f685a640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f08f00c4040 con 0x7f08f006d6a0 2023-11-28T19:59:26.578 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.555+0000 7f08f685a640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f08f006c360 con 0x7f08f015cba0 2023-11-28T19:59:26.578 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.555+0000 7f324fc32640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3240049f80 0x7f3240176e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:26.578 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.555+0000 7f324fc32640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f324004b980 0x7f32400343d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:26.578 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.555+0000 7fc2221e3640 1 --2- 172.21.15.78:0/1372462674 >> [v2:172.21.15.78:6808/3211476654,v1:172.21.15.78:6809/3211476654] conn(0x7fc20006fb80 0x7fc200071fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:26.579 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.555+0000 7f08effff640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f08f0152d30 0x7f08f00c3930 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:53942/0 (socket says 172.21.15.78:53942) 2023-11-28T19:59:26.579 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.555+0000 7f08effff640 1 -- 172.21.15.78:0/354454504 learned_addr learned my addr 172.21.15.78:0/354454504 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-11-28T19:59:26.579 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.555+0000 7eff92417640 1 -- 172.21.15.78:0/756705459 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7eff780047d0 msgr2=0x7eff78004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:26.579 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.555+0000 7eff92417640 1 --2- 172.21.15.78:0/756705459 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7eff780047d0 0x7eff78004c50 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7eff7400ab50 tx=0x7eff74020dd0 comp rx=0 tx=0).stop 2023-11-28T19:59:26.580 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.555+0000 7f324fc32640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f32400dec90 0x7f3240032f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:26.580 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.555+0000 7f324d9ce640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3240049f80 0x7f3240176e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:26.580 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.555+0000 7f324d9ce640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3240049f80 0x7f3240176e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.78:49850/0 (socket says 172.21.15.78:49850) 2023-11-28T19:59:26.580 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.555+0000 7f324d1cd640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f324004b980 0x7f32400343d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:26.580 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.555+0000 7f324d1cd640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f324004b980 0x7f32400343d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3301/0 says I am v2:172.21.15.78:47754/0 (socket says 172.21.15.78:47754) 2023-11-28T19:59:26.580 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.555+0000 7eff92417640 1 -- 172.21.15.78:0/756705459 shutdown_connections 2023-11-28T19:59:26.581 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.555+0000 7eff92417640 1 --2- 172.21.15.78:0/756705459 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7eff780047d0 0x7eff78004c50 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:26.581 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.555+0000 7f61e16f2640 1 -- 172.21.15.78:0/3573940705 >> v1:172.21.15.179:6789/0 conn(0x7f61dc072810 legacy=0x7f61dc0c0800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:26.581 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.555+0000 7f61e16f2640 1 -- 172.21.15.78:0/3573940705 >> v1:172.21.15.78:6789/0 conn(0x7f61dc0a4f90 legacy=0x7f61dc0c59c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T19:59:26.581 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.555+0000 7f61e16f2640 1 -- 172.21.15.78:0/3573940705 --> v2:172.21.15.179:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61dc152770 con 0x7f61dc0a5370 2023-11-28T19:59:26.581 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.559+0000 7f324e1cf640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f32400dec90 0x7f3240032f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:26.582 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.559+0000 7f324d9ce640 1 -- 172.21.15.78:0/3968326245 learned_addr learned my addr 172.21.15.78:0/3968326245 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T19:59:26.582 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.559+0000 7f324fc32640 1 -- 172.21.15.78:0/3968326245 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32400d7a50 con 0x7f32400dec90 2023-11-28T19:59:26.582 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.559+0000 7fc2211e1640 1 --2- 172.21.15.78:0/1372462674 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fc200066540 0x7fc200068a00 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fc21402f600 tx=0x7fc20c008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:59:26.582 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.559+0000 7fc2221e3640 1 --2- 172.21.15.78:0/1372462674 >> [v2:172.21.15.78:6808/3211476654,v1:172.21.15.78:6809/3211476654] conn(0x7fc20006fb80 0x7fc200071fc0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:59:26.582 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.555+0000 7eff92417640 1 -- 172.21.15.78:0/756705459 >> 172.21.15.78:0/756705459 conn(0x7eff8c06ad70 msgr2=0x7eff8c0a77e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T19:59:26.583 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.559+0000 7f912759e640 1 Processor -- start 2023-11-28T19:59:26.583 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.559+0000 7f324fc32640 1 -- 172.21.15.78:0/3968326245 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32401773b0 con 0x7f3240049f80 2023-11-28T19:59:26.583 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.559+0000 7f324fc32640 1 -- 172.21.15.78:0/3968326245 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f32400d7fc0 con 0x7f324004b980 2023-11-28T19:59:26.583 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.559+0000 7eff92417640 1 -- 172.21.15.78:0/756705459 shutdown_connections 2023-11-28T19:59:26.583 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.559+0000 7eff92417640 1 -- 172.21.15.78:0/756705459 wait complete. 2023-11-28T19:59:26.584 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.559+0000 7f912759e640 1 -- start start 2023-11-28T19:59:26.584 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.559+0000 7f324d1cd640 1 -- 172.21.15.78:0/3968326245 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3240049f80 msgr2=0x7f3240176e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:26.584 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.559+0000 7f324d1cd640 1 --2- 172.21.15.78:0/3968326245 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3240049f80 0x7f3240176e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:26.584 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.559+0000 7f324d1cd640 1 -- 172.21.15.78:0/3968326245 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f32400dec90 msgr2=0x7f3240032f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:26.584 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.559+0000 7f324d1cd640 1 --2- 172.21.15.78:0/3968326245 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f32400dec90 0x7f3240032f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:26.584 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.559+0000 7f324d1cd640 1 -- 172.21.15.78:0/3968326245 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3238009420 con 0x7f324004b980 2023-11-28T19:59:26.585 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.555+0000 7f08ef7fe640 1 --2- 172.21.15.78:0/354454504 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f08f015cba0 0x7f08f006d160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:26.585 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.559+0000 7f08ef7fe640 1 -- 172.21.15.78:0/354454504 >> v1:172.21.15.179:6789/0 conn(0x7f08f006d6a0 legacy=0x7f08f00a9af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:26.585 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.559+0000 7f08ef7fe640 1 -- 172.21.15.78:0/354454504 >> v1:172.21.15.78:6789/0 conn(0x7f08f0152d30 legacy=0x7f08f00c3930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:26.585 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.559+0000 7f08ef7fe640 1 -- 172.21.15.78:0/354454504 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08f00aa820 con 0x7f08f015cba0 2023-11-28T19:59:26.585 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.559+0000 7f61e16f2640 1 --2- 172.21.15.78:0/3573940705 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f61dc0a5370 0x7f61dc14f870 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f61dc1526a0 tx=0x7f61d801c1d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1b67d8d88ffbd5d8 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:59:26.586 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.559+0000 7f324d1cd640 1 --2- 172.21.15.78:0/3968326245 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f324004b980 0x7f32400343d0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f3244001ec0 tx=0x7f324400c820 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:59:26.586 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.559+0000 7f323e7fc640 1 -- 172.21.15.78:0/3968326245 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3244005cf0 con 0x7f324004b980 2023-11-28T19:59:26.586 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.559+0000 7f323e7fc640 1 -- 172.21.15.78:0/3968326245 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3244005e50 con 0x7f324004b980 2023-11-28T19:59:26.586 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.559+0000 7f323e7fc640 1 -- 172.21.15.78:0/3968326245 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32440072f0 con 0x7f324004b980 2023-11-28T19:59:26.586 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.559+0000 7f61e0ef1640 1 -- 172.21.15.78:0/3573940705 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61d40019e0 con 0x7f61dc0a5370 2023-11-28T19:59:26.587 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.559+0000 7f61e0ef1640 1 -- 172.21.15.78:0/3573940705 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f61d80a7050 con 0x7f61dc0a5370 2023-11-28T19:59:26.587 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.559+0000 7f61e0ef1640 1 -- 172.21.15.78:0/3573940705 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61d80ab620 con 0x7f61dc0a5370 2023-11-28T19:59:26.587 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.559+0000 7feb15d9b640 1 --2- 172.21.15.78:0/4143109188 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7feb2006d180 0x7feb200c4a50 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7feb200c63f0 tx=0x7feb0801c340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=959835fba1a1b230 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:59:26.587 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.559+0000 7f324fc32640 1 -- 172.21.15.78:0/3968326245 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f32400d5dc0 con 0x7f324004b980 2023-11-28T19:59:26.587 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.559+0000 7f324fc32640 1 -- 172.21.15.78:0/3968326245 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f32400d84d0 con 0x7f324004b980 2023-11-28T19:59:26.588 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.559+0000 7fc89de46640 1 Processor -- start 2023-11-28T19:59:26.588 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.559+0000 7eff92417640 1 Processor -- start 2023-11-28T19:59:26.588 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.559+0000 7eff92417640 1 -- start start 2023-11-28T19:59:26.589 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.559+0000 7feb1dd9b640 1 -- 172.21.15.78:0/4143109188 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb080ab600 con 0x7feb2006d180 2023-11-28T19:59:26.589 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.559+0000 7feb1dd9b640 1 -- 172.21.15.78:0/4143109188 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb080a7050 con 0x7feb2006d180 2023-11-28T19:59:26.589 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.559+0000 7feb1dd9b640 1 -- 172.21.15.78:0/4143109188 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb080ab980 con 0x7feb2006d180 2023-11-28T19:59:26.589 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.559+0000 7fc2127fc640 1 -- 172.21.15.78:0/1372462674 <== osd.1 v2:172.21.15.78:6808/3211476654 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7fc200072690 con 0x7fc20006fb80 2023-11-28T19:59:26.589 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.563+0000 7f322bfff640 1 -- 172.21.15.78:0/3968326245 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f324000f6d0 con 0x7f324004b980 2023-11-28T19:59:26.590 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.559+0000 7fc89de46640 1 -- start start 2023-11-28T19:59:26.590 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.563+0000 7feb24b2a640 1 -- 172.21.15.78:0/4143109188 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7feb2006d180 msgr2=0x7feb200c4a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:26.590 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.563+0000 7feb24b2a640 1 --2- 172.21.15.78:0/4143109188 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7feb2006d180 0x7feb200c4a50 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7feb200c63f0 tx=0x7feb0801c340 comp rx=0 tx=0).stop 2023-11-28T19:59:26.591 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.563+0000 7eff92417640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7eff780047d0 0x7eff8c1542f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:26.591 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.563+0000 7eff92417640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7eff8c1e9df0 0x7eff8c149770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:26.591 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.563+0000 7eff92417640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7eff8c149cb0 0x7eff8c152510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:26.591 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.563+0000 7f912759e640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f91200dbcd0 0x7f91200de760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:26.591 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.563+0000 7f912759e640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9120047f10 0x7f91200e25b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:26.591 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.563+0000 7f912559a640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9120047f10 0x7f91200e25b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:26.592 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.563+0000 7f912559a640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9120047f10 0x7f91200e25b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3301/0 says I am v2:172.21.15.78:47764/0 (socket says 172.21.15.78:47764) 2023-11-28T19:59:26.592 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.563+0000 7f9125d9b640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f91200dbcd0 0x7f91200de760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:26.592 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.563+0000 7f9125d9b640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f91200dbcd0 0x7f91200de760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:52918/0 (socket says 172.21.15.78:52918) 2023-11-28T19:59:26.592 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.563+0000 7feb24b2a640 1 -- 172.21.15.78:0/4143109188 shutdown_connections 2023-11-28T19:59:26.592 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.563+0000 7feb24b2a640 1 --2- 172.21.15.78:0/4143109188 >> v2:172.21.15.179:3300/0 conn(0x7feb200bee60 0x7feb200bf270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:26.592 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.563+0000 7feb24b2a640 1 --2- 172.21.15.78:0/4143109188 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7feb2006d180 0x7feb200c4a50 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:26.592 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.563+0000 7feb24b2a640 1 -- 172.21.15.78:0/4143109188 >> 172.21.15.78:0/4143109188 conn(0x7feb2006ad70 msgr2=0x7feb200a77e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T19:59:26.593 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.563+0000 7eff92417640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff8c1549d0 con 0x7eff780047d0 2023-11-28T19:59:26.593 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.563+0000 7eff92417640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff8c06fd30 con 0x7eff8c149cb0 2023-11-28T19:59:26.593 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.563+0000 7eff92417640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff8c070010 con 0x7eff8c1e9df0 2023-11-28T19:59:26.593 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.563+0000 7feb24b2a640 1 -- 172.21.15.78:0/4143109188 shutdown_connections 2023-11-28T19:59:26.593 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.563+0000 7feb24b2a640 1 -- 172.21.15.78:0/4143109188 wait complete. 2023-11-28T19:59:26.593 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.559+0000 7f61e4157640 1 -- 172.21.15.78:0/3573940705 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f61dc0a5370 msgr2=0x7f61dc14f870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:26.594 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.559+0000 7f61e4157640 1 --2- 172.21.15.78:0/3573940705 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f61dc0a5370 0x7f61dc14f870 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f61dc1526a0 tx=0x7f61d801c1d0 comp rx=0 tx=0).stop 2023-11-28T19:59:26.594 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.559+0000 7f61e4157640 1 -- 172.21.15.78:0/3573940705 shutdown_connections 2023-11-28T19:59:26.594 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.559+0000 7f61e4157640 1 --2- 172.21.15.78:0/3573940705 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f61dc0a5370 0x7f61dc14f870 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:26.594 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.559+0000 7f61e4157640 1 -- 172.21.15.78:0/3573940705 >> 172.21.15.78:0/3573940705 conn(0x7f61dc06b220 msgr2=0x7f61dc0a77e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T19:59:26.594 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.563+0000 7f61e4157640 1 -- 172.21.15.78:0/3573940705 shutdown_connections 2023-11-28T19:59:26.594 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.563+0000 7f61e4157640 1 -- 172.21.15.78:0/3573940705 wait complete. 2023-11-28T19:59:26.594 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.563+0000 7f912759e640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f91200e2120 con 0x7f912004a940 2023-11-28T19:59:26.595 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.563+0000 7f912759e640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f91200e1df0 con 0x7f91200dbcd0 2023-11-28T19:59:26.595 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.563+0000 7f912759e640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f912004aeb0 con 0x7f9120047f10 2023-11-28T19:59:26.595 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.563+0000 7f912559a640 1 -- 172.21.15.78:0/1203022101 learned_addr learned my addr 172.21.15.78:0/1203022101 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T19:59:26.595 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.563+0000 7f912559a640 1 -- 172.21.15.78:0/1203022101 >> v2:172.21.15.78:3300/0 conn(0x7f91200dbcd0 msgr2=0x7f91200de760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T19:59:26.595 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.563+0000 7f912559a640 1 --2- 172.21.15.78:0/1203022101 >> v2:172.21.15.78:3300/0 conn(0x7f91200dbcd0 0x7f91200de760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:26.595 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.563+0000 7f912559a640 1 -- 172.21.15.78:0/1203022101 >> v1:172.21.15.179:6789/0 conn(0x7f912004a940 legacy=0x7f9120007050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T19:59:26.595 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.563+0000 7f912559a640 1 -- 172.21.15.78:0/1203022101 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f912004b190 con 0x7f9120047f10 2023-11-28T19:59:26.596 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.563+0000 7eff8bfff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7eff780047d0 0x7eff8c1542f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:26.596 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.563+0000 7eff837fe640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7eff8c1e9df0 0x7eff8c149770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:26.596 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.563+0000 7eff837fe640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7eff8c1e9df0 0x7eff8c149770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3301/0 says I am v2:172.21.15.78:47772/0 (socket says 172.21.15.78:47772) 2023-11-28T19:59:26.596 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.563+0000 7eff837fe640 1 -- 172.21.15.78:0/1285016175 learned_addr learned my addr 172.21.15.78:0/1285016175 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T19:59:26.596 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.563+0000 7eff837fe640 1 -- 172.21.15.78:0/1285016175 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7eff8c149cb0 msgr2=0x7eff8c152510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:26.596 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.563+0000 7eff909b4640 1 --2- 172.21.15.78:0/1285016175 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7eff8c149cb0 0x7eff8c152510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:26.596 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.563+0000 7eff837fe640 1 --2- 172.21.15.78:0/1285016175 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7eff8c149cb0 0x7eff8c152510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:26.596 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.563+0000 7eff837fe640 1 -- 172.21.15.78:0/1285016175 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7eff780047d0 msgr2=0x7eff8c1542f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:26.596 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.563+0000 7eff837fe640 1 --2- 172.21.15.78:0/1285016175 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7eff780047d0 0x7eff8c1542f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:26.596 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.563+0000 7eff837fe640 1 -- 172.21.15.78:0/1285016175 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff8c0702f0 con 0x7eff8c1e9df0 2023-11-28T19:59:26.597 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.563+0000 7eff8bfff640 1 --2- 172.21.15.78:0/1285016175 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7eff780047d0 0x7eff8c1542f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T19:59:26.597 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.563+0000 7eff909b4640 1 --2- 172.21.15.78:0/1285016175 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7eff8c149cb0 0x7eff8c152510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T19:59:26.597 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.563+0000 7fc89de46640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc89814fa60 0x7fc89806f4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:26.597 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.567+0000 7f08ef7fe640 1 --2- 172.21.15.78:0/354454504 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f08f015cba0 0x7f08f006d160 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f08e40097f0 tx=0x7f08e401c200 comp rx=0 tx=0).ready entity=mon.2 client_cookie=15521e972f64b5d1 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:59:26.598 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.567+0000 7fc897fff640 1 --1- >> v1:172.21.15.179:6789/0 conn(0x7fc8980c3670 0x7fc8980c3aa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.179:6789/0 says I am v1:172.21.15.78:60100/0 (socket says 172.21.15.78:60100) 2023-11-28T19:59:26.598 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.567+0000 7fc897fff640 1 -- 172.21.15.78:0/481180926 learned_addr learned my addr 172.21.15.78:0/481180926 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-11-28T19:59:26.598 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.567+0000 7fc89de46640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc8980c2660 con 0x7fc8981562d0 2023-11-28T19:59:26.598 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.567+0000 7f61e4157640 1 Processor -- start 2023-11-28T19:59:26.599 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.567+0000 7fc89de46640 1 -- 172.21.15.78:0/481180926 --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc8980c28b0 con 0x7fc8980c3670 2023-11-28T19:59:26.599 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.567+0000 7fc8977fe640 1 --2- 172.21.15.78:0/481180926 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc89814fa60 0x7fc89806f4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:26.599 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.567+0000 7eff837fe640 1 --2- 172.21.15.78:0/1285016175 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7eff8c1e9df0 0x7eff8c149770 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7eff74020c00 tx=0x7eff78005800 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:59:26.599 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.567+0000 7f08eeffd640 1 -- 172.21.15.78:0/354454504 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08e40ab600 con 0x7f08f015cba0 2023-11-28T19:59:26.600 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.567+0000 7f323e7fc640 1 -- 172.21.15.78:0/3968326245 <== mon.2 v2:172.21.15.179:3301/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f3244007450 con 0x7f324004b980 2023-11-28T19:59:26.600 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.567+0000 7f323e7fc640 1 --2- 172.21.15.78:0/3968326245 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f322c0664f0 0x7f322c0689b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:26.600 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.567+0000 7f61e4157640 1 -- start start 2023-11-28T19:59:26.600 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.567+0000 7feb24b2a640 1 Processor -- start 2023-11-28T19:59:26.600 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.567+0000 7feb24b2a640 1 -- start start 2023-11-28T19:59:26.601 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.567+0000 7f08eeffd640 1 -- 172.21.15.78:0/354454504 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f08e40a7050 con 0x7f08f015cba0 2023-11-28T19:59:26.601 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.567+0000 7f08eeffd640 1 -- 172.21.15.78:0/354454504 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08e40ab980 con 0x7f08f015cba0 2023-11-28T19:59:26.601 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.567+0000 7fc896ffd640 1 -- 172.21.15.78:0/481180926 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3799953206 0 0) 0x7fc8980c28b0 con 0x7fc8980c3670 2023-11-28T19:59:26.601 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.567+0000 7fc89de46640 1 -- 172.21.15.78:0/481180926 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc8980c2b90 con 0x7fc89814fa60 2023-11-28T19:59:26.602 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.567+0000 7eff897fa640 1 -- 172.21.15.78:0/1285016175 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff740bfbd0 con 0x7eff8c1e9df0 2023-11-28T19:59:26.602 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.567+0000 7eff897fa640 1 -- 172.21.15.78:0/1285016175 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff740bfd30 con 0x7eff8c1e9df0 2023-11-28T19:59:26.602 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.567+0000 7eff897fa640 1 -- 172.21.15.78:0/1285016175 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff740bfea0 con 0x7eff8c1e9df0 2023-11-28T19:59:26.602 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.567+0000 7eff92417640 1 -- 172.21.15.78:0/1285016175 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7eff8c0705d0 con 0x7eff8c1e9df0 2023-11-28T19:59:26.602 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.567+0000 7f08f685a640 1 -- 172.21.15.78:0/354454504 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f08f015cba0 msgr2=0x7f08f006d160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:26.602 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.567+0000 7f08f685a640 1 --2- 172.21.15.78:0/354454504 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f08f015cba0 0x7f08f006d160 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f08e40097f0 tx=0x7f08e401c200 comp rx=0 tx=0).stop 2023-11-28T19:59:26.603 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.567+0000 7f323e7fc640 1 -- 172.21.15.78:0/3968326245 <== mon.2 v2:172.21.15.179:3301/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f32440543c0 con 0x7f324004b980 2023-11-28T19:59:26.603 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.567+0000 7eff92417640 1 -- 172.21.15.78:0/1285016175 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7eff8c070af0 con 0x7eff8c1e9df0 2023-11-28T19:59:26.603 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.567+0000 7feb24b2a640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7feb2006d180 0x7feb200a9f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:26.604 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.567+0000 7f08f685a640 1 -- 172.21.15.78:0/354454504 shutdown_connections 2023-11-28T19:59:26.604 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.567+0000 7f08f685a640 1 --2- 172.21.15.78:0/354454504 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f08f015cba0 0x7f08f006d160 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:26.604 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.567+0000 7f08f685a640 1 -- 172.21.15.78:0/354454504 >> 172.21.15.78:0/354454504 conn(0x7f08f006b220 msgr2=0x7f08f00a77e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T19:59:26.604 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.567+0000 7f08f685a640 1 -- 172.21.15.78:0/354454504 shutdown_connections 2023-11-28T19:59:26.604 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.567+0000 7f912559a640 1 --2- 172.21.15.78:0/1203022101 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9120047f10 0x7f91200e25b0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f9128062150 tx=0x7f9128096950 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f15aee094c1b74f4 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:59:26.604 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.567+0000 7f08f685a640 1 -- 172.21.15.78:0/354454504 wait complete. 2023-11-28T19:59:26.605 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.567+0000 7feb24b2a640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7feb200bee60 0x7feb201ee490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:26.605 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.567+0000 7feb24b2a640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7feb20155430 0x7feb201f0f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:26.605 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.567+0000 7feb24b2a640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb200a9010 con 0x7feb20155430 2023-11-28T19:59:26.605 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.567+0000 7feb24b2a640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb200aa7d0 con 0x7feb200bee60 2023-11-28T19:59:26.605 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.567+0000 7feb24b2a640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb200a8a00 con 0x7feb2006d180 2023-11-28T19:59:26.606 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.567+0000 7feb15d9b640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7feb200bee60 0x7feb201ee490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:26.606 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.567+0000 7feb15d9b640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7feb200bee60 0x7feb201ee490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.78:49868/0 (socket says 172.21.15.78:49868) 2023-11-28T19:59:26.606 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.567+0000 7feb15d9b640 1 -- 172.21.15.78:0/4001749545 learned_addr learned my addr 172.21.15.78:0/4001749545 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T19:59:26.606 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.567+0000 7fc896ffd640 1 -- 172.21.15.78:0/481180926 --> v1:172.21.15.179:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc884003530 con 0x7fc8980c3670 2023-11-28T19:59:26.606 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.567+0000 7fc896ffd640 1 -- 172.21.15.78:0/481180926 <== mon.1 v1:172.21.15.179:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1556672705 0 0) 0x7fc884003530 con 0x7fc8980c3670 2023-11-28T19:59:26.606 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.567+0000 7fc896ffd640 1 -- 172.21.15.78:0/481180926 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc89814fa60 msgr2=0x7fc89806f4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T19:59:26.606 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.567+0000 7fc896ffd640 1 --2- 172.21.15.78:0/481180926 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc89814fa60 0x7fc89806f4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:26.606 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.567+0000 7fc896ffd640 1 -- 172.21.15.78:0/481180926 >> v1:172.21.15.78:6789/0 conn(0x7fc8981562d0 legacy=0x7fc8980a6e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T19:59:26.606 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.567+0000 7fc896ffd640 1 -- 172.21.15.78:0/481180926 --> v1:172.21.15.179:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8980c2e70 con 0x7fc8980c3670 2023-11-28T19:59:26.607 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.567+0000 7fc896ffd640 1 -- 172.21.15.78:0/481180926 <== mon.1 v1:172.21.15.179:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3326804700 0 0) 0x7fc890001a00 con 0x7fc8980c3670 2023-11-28T19:59:26.607 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.567+0000 7fc896ffd640 1 -- 172.21.15.78:0/481180926 >> v1:172.21.15.179:6789/0 conn(0x7fc8980c3670 legacy=0x7fc8980c3aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:26.607 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.567+0000 7fc896ffd640 1 --2- 172.21.15.78:0/481180926 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc89814fa60 0x7fc884003980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:26.607 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.567+0000 7f912caea640 1 -- 172.21.15.78:0/1203022101 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91281206f0 con 0x7f9120047f10 2023-11-28T19:59:26.607 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.567+0000 7f912caea640 1 -- 172.21.15.78:0/1203022101 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9128120850 con 0x7f9120047f10 2023-11-28T19:59:26.607 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.567+0000 7f912caea640 1 -- 172.21.15.78:0/1203022101 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9128120c40 con 0x7f9120047f10 2023-11-28T19:59:26.607 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.567+0000 7feb1ed9d640 1 --2- 172.21.15.78:0/4001749545 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7feb20155430 0x7feb201f0f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:26.608 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.567+0000 7fc896ffd640 1 --2- 172.21.15.78:0/481180926 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc884003ec0 0x7fc8840047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:26.608 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.567+0000 7fc896ffd640 1 --2- 172.21.15.78:0/481180926 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc884004340 0x7fc884004d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:26.608 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.567+0000 7fc896ffd640 1 -- 172.21.15.78:0/481180926 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8980c2b90 con 0x7fc884004340 2023-11-28T19:59:26.608 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.567+0000 7fc896ffd640 1 -- 172.21.15.78:0/481180926 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc884005500 con 0x7fc884003ec0 2023-11-28T19:59:26.608 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.567+0000 7fc896ffd640 1 -- 172.21.15.78:0/481180926 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc884014590 con 0x7fc89814fa60 2023-11-28T19:59:26.608 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.567+0000 7feb15d9b640 1 -- 172.21.15.78:0/4001749545 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7feb2006d180 msgr2=0x7feb200a9f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:26.609 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.567+0000 7feb15d9b640 1 --2- 172.21.15.78:0/4001749545 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7feb2006d180 0x7feb200a9f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:26.609 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.567+0000 7feb15d9b640 1 -- 172.21.15.78:0/4001749545 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7feb20155430 msgr2=0x7feb201f0f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:26.609 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.567+0000 7feb15d9b640 1 --2- 172.21.15.78:0/4001749545 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7feb20155430 0x7feb201f0f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:26.609 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.567+0000 7feb15d9b640 1 -- 172.21.15.78:0/4001749545 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb08009420 con 0x7feb200bee60 2023-11-28T19:59:26.609 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.571+0000 7feb1ed9d640 1 --2- 172.21.15.78:0/4001749545 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7feb20155430 0x7feb201f0f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T19:59:26.609 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.571+0000 7f912759e640 1 -- 172.21.15.78:0/1203022101 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9120047f10 msgr2=0x7f91200e25b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:26.609 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.571+0000 7f912759e640 1 --2- 172.21.15.78:0/1203022101 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9120047f10 0x7f91200e25b0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f9128062150 tx=0x7f9128096950 comp rx=0 tx=0).stop 2023-11-28T19:59:26.610 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.567+0000 7f323e7fc640 1 --2- 172.21.15.78:0/3968326245 >> [v2:172.21.15.78:6800/3358701235,v1:172.21.15.78:6801/3358701235] conn(0x7f322c070780 0x7f322c072c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:26.610 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.567+0000 7f323e7fc640 1 -- 172.21.15.78:0/3968326245 --> [v2:172.21.15.78:6800/3358701235,v1:172.21.15.78:6801/3358701235] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f322c0732f0 con 0x7f322c070780 2023-11-28T19:59:26.610 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.567+0000 7f323e7fc640 1 -- 172.21.15.78:0/3968326245 <== mon.2 v2:172.21.15.179:3301/0 6 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3244054190 con 0x7f324004b980 2023-11-28T19:59:26.610 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.571+0000 7f61e4157640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f61dc072810 0x7f61dc1edb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:26.610 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.571+0000 7eff827fc640 1 -- 172.21.15.78:0/1285016175 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7eff8c06dab0 con 0x7eff8c1e9df0 2023-11-28T19:59:26.611 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.571+0000 7fc8977fe640 1 --2- 172.21.15.78:0/481180926 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc89814fa60 0x7fc884003980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:26.611 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.571+0000 7feb15d9b640 1 --2- 172.21.15.78:0/4001749545 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7feb200bee60 0x7feb201ee490 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7feb08018f50 tx=0x7feb080190e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:59:26.611 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.571+0000 7f324d9ce640 1 --2- 172.21.15.78:0/3968326245 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f322c0664f0 0x7f322c0689b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:26.612 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.571+0000 7f08f685a640 1 Processor -- start 2023-11-28T19:59:26.612 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.571+0000 7fc88ffff640 1 --2- 172.21.15.78:0/481180926 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc884003ec0 0x7fc8840047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:26.612 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.571+0000 7f61e4157640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f61dc0a4f90 0x7f61dc1f0f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:26.613 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.571+0000 7feb177fe640 1 -- 172.21.15.78:0/4001749545 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb080b4400 con 0x7feb200bee60 2023-11-28T19:59:26.613 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.571+0000 7feb177fe640 1 -- 172.21.15.78:0/4001749545 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb080b4560 con 0x7feb200bee60 2023-11-28T19:59:26.613 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.571+0000 7feb177fe640 1 -- 172.21.15.78:0/4001749545 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb080b48d0 con 0x7feb200bee60 2023-11-28T19:59:26.613 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.571+0000 7feb24b2a640 1 -- 172.21.15.78:0/4001749545 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feb201f1490 con 0x7feb200bee60 2023-11-28T19:59:26.613 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.571+0000 7f08f685a640 1 -- start start 2023-11-28T19:59:26.613 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.571+0000 7feb24b2a640 1 -- 172.21.15.78:0/4001749545 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feb200a8ca0 con 0x7feb200bee60 2023-11-28T19:59:26.614 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.571+0000 7f61e4157640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f61dc0a5370 0x7f61dc155090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:26.614 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.571+0000 7eff897fa640 1 -- 172.21.15.78:0/1285016175 <== mon.2 v2:172.21.15.179:3301/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7eff74004260 con 0x7eff8c1e9df0 2023-11-28T19:59:26.614 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.571+0000 7f324e1cf640 1 --2- 172.21.15.78:0/3968326245 >> [v2:172.21.15.78:6800/3358701235,v1:172.21.15.78:6801/3358701235] conn(0x7f322c070780 0x7f322c072c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:26.615 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.571+0000 7f61e1ef3640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f61dc072810 0x7f61dc1edb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:26.615 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.571+0000 7f61e4157640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61dc1f14c0 con 0x7f61dc0a4f90 2023-11-28T19:59:26.615 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.571+0000 7f61e4157640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61dc1ed6c0 con 0x7f61dc072810 2023-11-28T19:59:26.615 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.571+0000 7f61e4157640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f61dc071270 con 0x7f61dc0a5370 2023-11-28T19:59:26.615 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.571+0000 7fc8977fe640 1 -- 172.21.15.78:0/481180926 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc884003ec0 msgr2=0x7fc8840047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T19:59:26.615 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.571+0000 7fc8977fe640 1 --2- 172.21.15.78:0/481180926 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc884003ec0 0x7fc8840047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:26.615 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.571+0000 7fc8977fe640 1 -- 172.21.15.78:0/481180926 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc884004340 msgr2=0x7fc884004d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T19:59:26.616 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.571+0000 7fc8977fe640 1 --2- 172.21.15.78:0/481180926 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc884004340 0x7fc884004d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:26.616 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.571+0000 7fc8977fe640 1 -- 172.21.15.78:0/481180926 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc884003530 con 0x7fc89814fa60 2023-11-28T19:59:26.616 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.571+0000 7f61e1ef3640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f61dc072810 0x7f61dc1edb50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.78:49874/0 (socket says 172.21.15.78:49874) 2023-11-28T19:59:26.616 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.571+0000 7f61e1ef3640 1 -- 172.21.15.78:0/2459505695 learned_addr learned my addr 172.21.15.78:0/2459505695 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T19:59:26.616 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.571+0000 7f61e26f4640 1 --2- 172.21.15.78:0/2459505695 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f61dc0a5370 0x7f61dc155090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:26.617 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.571+0000 7f912759e640 1 -- 172.21.15.78:0/1203022101 shutdown_connections 2023-11-28T19:59:26.617 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.571+0000 7f912759e640 1 --2- 172.21.15.78:0/1203022101 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9120047f10 0x7f91200e25b0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:26.617 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.571+0000 7f912759e640 1 --2- 172.21.15.78:0/1203022101 >> v2:172.21.15.78:3300/0 conn(0x7f91200dbcd0 0x7f91200de760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:26.617 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.571+0000 7f912759e640 1 -- 172.21.15.78:0/1203022101 >> 172.21.15.78:0/1203022101 conn(0x7f9120048400 msgr2=0x7f9120048810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T19:59:26.618 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.571+0000 7f61e16f2640 1 --2- 172.21.15.78:0/2459505695 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f61dc0a4f90 0x7f61dc1f0f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:26.618 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.571+0000 7f61e26f4640 1 -- 172.21.15.78:0/2459505695 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f61dc072810 msgr2=0x7f61dc1edb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:26.618 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.571+0000 7f61e26f4640 1 --2- 172.21.15.78:0/2459505695 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f61dc072810 0x7f61dc1edb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:26.618 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.571+0000 7f61e26f4640 1 -- 172.21.15.78:0/2459505695 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f61dc0a4f90 msgr2=0x7f61dc1f0f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:26.618 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.571+0000 7f61e26f4640 1 --2- 172.21.15.78:0/2459505695 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f61dc0a4f90 0x7f61dc1f0f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:26.618 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.571+0000 7f61e26f4640 1 -- 172.21.15.78:0/2459505695 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61d8009420 con 0x7f61dc0a5370 2023-11-28T19:59:26.618 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.571+0000 7f61e16f2640 1 --2- 172.21.15.78:0/2459505695 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f61dc0a4f90 0x7f61dc1f0f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T19:59:26.618 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.571+0000 7f61e26f4640 1 --2- 172.21.15.78:0/2459505695 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f61dc0a5370 0x7f61dc155090 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f61d4007fd0 tx=0x7f61d400cee0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:59:26.619 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.571+0000 7feb24b2a640 1 -- 172.21.15.78:0/4001749545 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7feb200c0330 con 0x7feb200bee60 2023-11-28T19:59:26.619 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.571+0000 7f08f685a640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f08f006d6a0 0x7f08f01554f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:26.619 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.571+0000 7f08f685a640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f08f0152d30 0x7f08f0154170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:26.619 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.571+0000 7f08effff640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f08f006d6a0 0x7f08f01554f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:26.619 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.571+0000 7f08effff640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f08f006d6a0 0x7f08f01554f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.78:49884/0 (socket says 172.21.15.78:49884) 2023-11-28T19:59:26.619 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.571+0000 7f08f685a640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f08f015cba0 0x7f08f01fb9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:26.619 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.571+0000 7f08ef7fe640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f08f0152d30 0x7f08f0154170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:26.620 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.571+0000 7eff897fa640 1 --2- 172.21.15.78:0/1285016175 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7eff6c0664a0 0x7eff6c068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:26.620 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.571+0000 7f08ef7fe640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f08f0152d30 0x7f08f0154170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3301/0 says I am v2:172.21.15.78:47816/0 (socket says 172.21.15.78:47816) 2023-11-28T19:59:26.620 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.571+0000 7eff897fa640 1 -- 172.21.15.78:0/1285016175 <== mon.2 v2:172.21.15.179:3301/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7eff74125f10 con 0x7eff8c1e9df0 2023-11-28T19:59:26.621 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.571+0000 7f61d27fc640 1 -- 172.21.15.78:0/2459505695 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61d400a7c0 con 0x7f61dc0a5370 2023-11-28T19:59:26.621 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.571+0000 7f61d27fc640 1 -- 172.21.15.78:0/2459505695 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f61d400a920 con 0x7f61dc0a5370 2023-11-28T19:59:26.621 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.571+0000 7f61d27fc640 1 -- 172.21.15.78:0/2459505695 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61d400ad10 con 0x7f61dc0a5370 2023-11-28T19:59:26.621 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.571+0000 7f08f4df7640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f08f015cba0 0x7f08f01fb9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:26.621 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.571+0000 7f08f4df7640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f08f015cba0 0x7f08f01fb9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:52976/0 (socket says 172.21.15.78:52976) 2023-11-28T19:59:26.622 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.571+0000 7f324e1cf640 1 --2- 172.21.15.78:0/3968326245 >> [v2:172.21.15.78:6800/3358701235,v1:172.21.15.78:6801/3358701235] conn(0x7f322c070780 0x7f322c072c20 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:59:26.622 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.575+0000 7eff897fa640 1 --2- 172.21.15.78:0/1285016175 >> [v2:172.21.15.78:6816/2532904479,v1:172.21.15.78:6817/2532904479] conn(0x7eff6c06fae0 0x7eff6c071f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:26.622 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.575+0000 7eff897fa640 1 -- 172.21.15.78:0/1285016175 --> [v2:172.21.15.78:6816/2532904479,v1:172.21.15.78:6817/2532904479] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7eff6c0725f0 con 0x7eff6c06fae0 2023-11-28T19:59:26.622 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.575+0000 7eff897fa640 1 -- 172.21.15.78:0/1285016175 <== mon.2 v2:172.21.15.179:3301/0 6 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7eff74128530 con 0x7eff8c1e9df0 2023-11-28T19:59:26.622 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.571+0000 7f61e4157640 1 -- 172.21.15.78:0/2459505695 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f61dc071550 con 0x7f61dc0a5370 2023-11-28T19:59:26.622 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.575+0000 7f61e4157640 1 -- 172.21.15.78:0/2459505695 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f61dc0c4700 con 0x7f61dc0a5370 2023-11-28T19:59:26.623 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.575+0000 7f08effff640 1 -- 172.21.15.78:0/2024637645 learned_addr learned my addr 172.21.15.78:0/2024637645 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T19:59:26.623 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.575+0000 7f08f685a640 1 -- 172.21.15.78:0/2024637645 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08f0153860 con 0x7f08f015cba0 2023-11-28T19:59:26.623 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.575+0000 7f08f685a640 1 -- 172.21.15.78:0/2024637645 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08f0156470 con 0x7f08f006d6a0 2023-11-28T19:59:26.623 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.575+0000 7f08f685a640 1 -- 172.21.15.78:0/2024637645 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f08f0155ed0 con 0x7f08f0152d30 2023-11-28T19:59:26.624 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.575+0000 7eff8bfff640 1 --2- 172.21.15.78:0/1285016175 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7eff6c0664a0 0x7eff6c068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:26.624 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.575+0000 7eff909b4640 1 --2- 172.21.15.78:0/1285016175 >> [v2:172.21.15.78:6816/2532904479,v1:172.21.15.78:6817/2532904479] conn(0x7eff6c06fae0 0x7eff6c071f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:26.624 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.575+0000 7f61e4157640 1 -- 172.21.15.78:0/2459505695 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f61dc0a93f0 con 0x7f61dc0a5370 2023-11-28T19:59:26.624 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.575+0000 7f323e7fc640 1 -- 172.21.15.78:0/3968326245 <== osd.0 v2:172.21.15.78:6800/3358701235 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7f322c0732f0 con 0x7f322c070780 2023-11-28T19:59:26.625 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.575+0000 7f324d9ce640 1 --2- 172.21.15.78:0/3968326245 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f322c0664f0 0x7f322c0689b0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f323801a940 tx=0x7f32380a6000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:59:26.625 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.575+0000 7f08effff640 1 -- 172.21.15.78:0/2024637645 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f08f0152d30 msgr2=0x7f08f0154170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:26.625 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.575+0000 7f08effff640 1 --2- 172.21.15.78:0/2024637645 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f08f0152d30 0x7f08f0154170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:26.625 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.575+0000 7f08effff640 1 -- 172.21.15.78:0/2024637645 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f08f015cba0 msgr2=0x7f08f01fb9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:26.625 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.575+0000 7f08effff640 1 --2- 172.21.15.78:0/2024637645 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f08f015cba0 0x7f08f01fb9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:26.625 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.575+0000 7f08effff640 1 -- 172.21.15.78:0/2024637645 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08e4009420 con 0x7f08f006d6a0 2023-11-28T19:59:26.626 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.575+0000 7f912759e640 1 -- 172.21.15.78:0/1203022101 shutdown_connections 2023-11-28T19:59:26.626 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.575+0000 7feb177fe640 1 -- 172.21.15.78:0/4001749545 <== mon.1 v2:172.21.15.179:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7feb080b2040 con 0x7feb200bee60 2023-11-28T19:59:26.626 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.575+0000 7f08effff640 1 --2- 172.21.15.78:0/2024637645 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f08f006d6a0 0x7f08f01554f0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f08e000c780 tx=0x7f08e000cc40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:59:26.626 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.575+0000 7f08ecff9640 1 -- 172.21.15.78:0/2024637645 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08e00072d0 con 0x7f08f006d6a0 2023-11-28T19:59:26.626 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.575+0000 7f08ecff9640 1 -- 172.21.15.78:0/2024637645 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f08e0007450 con 0x7f08f006d6a0 2023-11-28T19:59:26.627 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.575+0000 7f08ecff9640 1 -- 172.21.15.78:0/2024637645 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08e00047f0 con 0x7f08f006d6a0 2023-11-28T19:59:26.627 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.575+0000 7f08f685a640 1 -- 172.21.15.78:0/2024637645 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f08f0153cf0 con 0x7f08f006d6a0 2023-11-28T19:59:26.627 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.575+0000 7feb177fe640 1 --2- 172.21.15.78:0/4001749545 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7feb000664f0 0x7feb000689b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:26.627 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.575+0000 7feb177fe640 1 -- 172.21.15.78:0/4001749545 <== mon.1 v2:172.21.15.179:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7feb0811e140 con 0x7feb200bee60 2023-11-28T19:59:26.627 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.575+0000 7feb177fe640 1 --2- 172.21.15.78:0/4001749545 >> [v2:172.21.15.179:6808/802983577,v1:172.21.15.179:6809/802983577] conn(0x7feb0006fab0 0x7feb00071ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:26.627 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.575+0000 7feb177fe640 1 -- 172.21.15.78:0/4001749545 --> [v2:172.21.15.179:6808/802983577,v1:172.21.15.179:6809/802983577] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7feb000725c0 con 0x7feb0006fab0 2023-11-28T19:59:26.627 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.575+0000 7f912759e640 1 -- 172.21.15.78:0/1203022101 wait complete. 2023-11-28T19:59:26.628 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.579+0000 7f08f685a640 1 -- 172.21.15.78:0/2024637645 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f08f0156100 con 0x7f08f006d6a0 2023-11-28T19:59:26.628 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.579+0000 7fc8977fe640 1 --2- 172.21.15.78:0/481180926 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc89814fa60 0x7fc884003980 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fc888009ae0 tx=0x7fc88801cab0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=43f8cbb5f62a50ee server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:59:26.628 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.579+0000 7f61d27fc640 1 -- 172.21.15.78:0/2459505695 <== mon.2 v2:172.21.15.179:3301/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f61d40070d0 con 0x7f61dc0a5370 2023-11-28T19:59:26.629 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.579+0000 7f61d27fc640 1 --2- 172.21.15.78:0/2459505695 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f61c0066540 0x7f61c0068a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:26.629 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.579+0000 7f61d27fc640 1 -- 172.21.15.78:0/2459505695 <== mon.2 v2:172.21.15.179:3301/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f61d40842c0 con 0x7f61dc0a5370 2023-11-28T19:59:26.629 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.579+0000 7f08f685a640 1 -- 172.21.15.78:0/2024637645 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f08f00c63d0 con 0x7f08f006d6a0 2023-11-28T19:59:26.629 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.579+0000 7fc896ffd640 1 -- 172.21.15.78:0/481180926 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8880a5680 con 0x7fc89814fa60 2023-11-28T19:59:26.629 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.579+0000 7feb1e59c640 1 --2- 172.21.15.78:0/4001749545 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7feb000664f0 0x7feb000689b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:26.630 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.579+0000 7f08ecff9640 1 -- 172.21.15.78:0/2024637645 <== mon.1 v2:172.21.15.179:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f08e0004950 con 0x7f08f006d6a0 2023-11-28T19:59:26.630 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.575+0000 7eff909b4640 1 --2- 172.21.15.78:0/1285016175 >> [v2:172.21.15.78:6816/2532904479,v1:172.21.15.78:6817/2532904479] conn(0x7eff6c06fae0 0x7eff6c071f20 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:59:26.630 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.575+0000 7eff8bfff640 1 --2- 172.21.15.78:0/1285016175 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7eff6c0664a0 0x7eff6c068960 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7eff7c007550 tx=0x7eff7c0074c0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:59:26.630 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.579+0000 7eff897fa640 1 -- 172.21.15.78:0/1285016175 <== osd.2 v2:172.21.15.78:6816/2532904479 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7eff6c0725f0 con 0x7eff6c06fae0 2023-11-28T19:59:26.631 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.579+0000 7feb1ed9d640 1 --2- 172.21.15.78:0/4001749545 >> [v2:172.21.15.179:6808/802983577,v1:172.21.15.179:6809/802983577] conn(0x7feb0006fab0 0x7feb00071ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:26.631 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.579+0000 7feb177fe640 1 -- 172.21.15.78:0/4001749545 <== mon.1 v2:172.21.15.179:3300/0 6 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7feb080eb340 con 0x7feb200bee60 2023-11-28T19:59:26.631 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.579+0000 7f61d27fc640 1 --2- 172.21.15.78:0/2459505695 >> [v2:172.21.15.78:6824/3442991267,v1:172.21.15.78:6825/3442991267] conn(0x7f61c006fb80 0x7f61c0071fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:26.631 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.579+0000 7f61d27fc640 1 -- 172.21.15.78:0/2459505695 --> [v2:172.21.15.78:6824/3442991267,v1:172.21.15.78:6825/3442991267] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f61c0072690 con 0x7f61c006fb80 2023-11-28T19:59:26.631 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.579+0000 7f61d27fc640 1 -- 172.21.15.78:0/2459505695 <== mon.2 v2:172.21.15.179:3301/0 6 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7f61d4084670 con 0x7f61dc0a5370 2023-11-28T19:59:26.631 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.579+0000 7fc896ffd640 1 -- 172.21.15.78:0/481180926 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc8880a57e0 con 0x7fc89814fa60 2023-11-28T19:59:26.632 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.579+0000 7fc896ffd640 1 -- 172.21.15.78:0/481180926 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8880a5b90 con 0x7fc89814fa60 2023-11-28T19:59:26.632 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.579+0000 7feb1ed9d640 1 --2- 172.21.15.78:0/4001749545 >> [v2:172.21.15.179:6808/802983577,v1:172.21.15.179:6809/802983577] conn(0x7feb0006fab0 0x7feb00071ef0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:59:26.632 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.579+0000 7f61e16f2640 1 --2- 172.21.15.78:0/2459505695 >> [v2:172.21.15.78:6824/3442991267,v1:172.21.15.78:6825/3442991267] conn(0x7f61c006fb80 0x7f61c0071fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:26.632 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.579+0000 7f08ecff9640 1 --2- 172.21.15.78:0/2024637645 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f08dc0664a0 0x7f08dc068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:26.633 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.579+0000 7f08ecff9640 1 -- 172.21.15.78:0/2024637645 <== mon.1 v2:172.21.15.179:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f08e00831e0 con 0x7f08f006d6a0 2023-11-28T19:59:26.633 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.579+0000 7f08ecff9640 1 --2- 172.21.15.78:0/2024637645 >> [v2:172.21.15.179:6816/518192887,v1:172.21.15.179:6818/518192887] conn(0x7f08dc06fa60 0x7f08dc071ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:26.633 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.579+0000 7f912759e640 1 Processor -- start 2023-11-28T19:59:26.633 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.579+0000 7f08ecff9640 1 -- 172.21.15.78:0/2024637645 --> [v2:172.21.15.179:6816/518192887,v1:172.21.15.179:6818/518192887] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f08dc072570 con 0x7f08dc06fa60 2023-11-28T19:59:26.633 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.579+0000 7f08ecff9640 1 -- 172.21.15.78:0/2024637645 <== mon.1 v2:172.21.15.179:3300/0 6 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7f08e00834a0 con 0x7f08f006d6a0 2023-11-28T19:59:26.635 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.579+0000 7fc89de46640 1 -- 172.21.15.78:0/481180926 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc89814fa60 msgr2=0x7fc884003980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:26.635 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.579+0000 7fc89de46640 1 --2- 172.21.15.78:0/481180926 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc89814fa60 0x7fc884003980 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fc888009ae0 tx=0x7fc88801cab0 comp rx=0 tx=0).stop 2023-11-28T19:59:26.635 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.579+0000 7fc897fff640 1 -- 172.21.15.78:0/481180926 reap_dead start 2023-11-28T19:59:26.636 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.579+0000 7f912759e640 1 -- start start 2023-11-28T19:59:26.636 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.579+0000 7f61e1ef3640 1 --2- 172.21.15.78:0/2459505695 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f61c0066540 0x7f61c0068a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:26.636 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.579+0000 7f08ef7fe640 1 --2- 172.21.15.78:0/2024637645 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f08dc0664a0 0x7f08dc068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:26.636 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.583+0000 7f08f4df7640 1 --2- 172.21.15.78:0/2024637645 >> [v2:172.21.15.179:6816/518192887,v1:172.21.15.179:6818/518192887] conn(0x7f08dc06fa60 0x7f08dc071ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:26.637 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.583+0000 7feb177fe640 1 -- 172.21.15.78:0/4001749545 <== osd.4 v2:172.21.15.179:6808/802983577 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7feb000725c0 con 0x7feb0006fab0 2023-11-28T19:59:26.637 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.583+0000 7feb1e59c640 1 --2- 172.21.15.78:0/4001749545 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7feb000664f0 0x7feb000689b0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7feb200a5400 tx=0x7feb10001600 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:59:26.637 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.583+0000 7f61e16f2640 1 --2- 172.21.15.78:0/2459505695 >> [v2:172.21.15.78:6824/3442991267,v1:172.21.15.78:6825/3442991267] conn(0x7f61c006fb80 0x7f61c0071fc0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:59:26.638 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.583+0000 7f912759e640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9120047f10 0x7f91200da860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:26.639 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.583+0000 7f912759e640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f912004a940 0x7f91200d4a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:26.639 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.583+0000 7f61e1ef3640 1 --2- 172.21.15.78:0/2459505695 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f61c0066540 0x7f61c0068a00 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f61cc001960 tx=0x7f61cc009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:59:26.639 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.583+0000 7f912759e640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f91200dbcd0 0x7f91200d4fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:26.639 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.583+0000 7f912759e640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9120176c40 con 0x7f91200dbcd0 2023-11-28T19:59:26.640 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.583+0000 7f912759e640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f912017a640 con 0x7f9120047f10 2023-11-28T19:59:26.640 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.583+0000 7f912759e640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f912017a920 con 0x7f912004a940 2023-11-28T19:59:26.640 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.583+0000 7fc89de46640 1 -- 172.21.15.78:0/481180926 shutdown_connections 2023-11-28T19:59:26.640 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.583+0000 7fc89de46640 1 -- 172.21.15.78:0/481180926 >> 172.21.15.78:0/481180926 conn(0x7fc8980c7c60 msgr2=0x7fc8980c8070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T19:59:26.640 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.583+0000 7f912559a640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f912004a940 0x7f91200d4a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:26.640 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.583+0000 7f912559a640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f912004a940 0x7f91200d4a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3301/0 says I am v2:172.21.15.78:47822/0 (socket says 172.21.15.78:47822) 2023-11-28T19:59:26.641 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.583+0000 7f912559a640 1 -- 172.21.15.78:0/2941149659 learned_addr learned my addr 172.21.15.78:0/2941149659 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T19:59:26.641 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.583+0000 7f9125d9b640 1 --2- 172.21.15.78:0/2941149659 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9120047f10 0x7f91200da860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:26.641 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.583+0000 7f08f4df7640 1 --2- 172.21.15.78:0/2024637645 >> [v2:172.21.15.179:6816/518192887,v1:172.21.15.179:6818/518192887] conn(0x7f08dc06fa60 0x7f08dc071ea0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:59:26.641 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.583+0000 7f08ef7fe640 1 --2- 172.21.15.78:0/2024637645 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f08dc0664a0 0x7f08dc068960 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f08e40ad000 tx=0x7f08e4008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:59:26.641 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.583+0000 7f912659c640 1 --2- 172.21.15.78:0/2941149659 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f91200dbcd0 0x7f91200d4fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:26.642 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.583+0000 7f912559a640 1 -- 172.21.15.78:0/2941149659 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9120047f10 msgr2=0x7f91200da860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:26.642 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.583+0000 7f912559a640 1 --2- 172.21.15.78:0/2941149659 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9120047f10 0x7f91200da860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:26.642 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.583+0000 7f912559a640 1 -- 172.21.15.78:0/2941149659 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f91200dbcd0 msgr2=0x7f91200d4fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:26.642 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.583+0000 7f912559a640 1 --2- 172.21.15.78:0/2941149659 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f91200dbcd0 0x7f91200d4fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:26.642 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.583+0000 7f912559a640 1 -- 172.21.15.78:0/2941149659 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f912804f7e0 con 0x7f912004a940 2023-11-28T19:59:26.642 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.583+0000 7fc89de46640 1 -- 172.21.15.78:0/481180926 shutdown_connections 2023-11-28T19:59:26.643 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.583+0000 7fc89de46640 1 -- 172.21.15.78:0/481180926 wait complete. 2023-11-28T19:59:26.643 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.583+0000 7f912559a640 1 --2- 172.21.15.78:0/2941149659 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f912004a940 0x7f91200d4a70 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f91280732e0 tx=0x7f9128093740 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:59:26.643 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.583+0000 7f61d27fc640 1 -- 172.21.15.78:0/2459505695 <== osd.3 v2:172.21.15.78:6824/3442991267 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7f61c0072690 con 0x7f61c006fb80 2023-11-28T19:59:26.643 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.583+0000 7f9116ffd640 1 -- 172.21.15.78:0/2941149659 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f912812a870 con 0x7f912004a940 2023-11-28T19:59:26.644 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.583+0000 7f9116ffd640 1 -- 172.21.15.78:0/2941149659 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f912812a9d0 con 0x7f912004a940 2023-11-28T19:59:26.644 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.583+0000 7f9116ffd640 1 -- 172.21.15.78:0/2941149659 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f912812ad40 con 0x7f912004a940 2023-11-28T19:59:26.644 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.583+0000 7f912759e640 1 -- 172.21.15.78:0/2941149659 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f912017ac00 con 0x7f912004a940 2023-11-28T19:59:26.644 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.583+0000 7f08ecff9640 1 -- 172.21.15.78:0/2024637645 <== osd.5 v2:172.21.15.179:6816/518192887 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7f08dc072570 con 0x7f08dc06fa60 2023-11-28T19:59:26.645 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.583+0000 7f912759e640 1 -- 172.21.15.78:0/2941149659 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f91200dc5d0 con 0x7f912004a940 2023-11-28T19:59:26.645 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.587+0000 7f9116ffd640 1 -- 172.21.15.78:0/2941149659 <== mon.2 v2:172.21.15.179:3301/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f9128121410 con 0x7f912004a940 2023-11-28T19:59:26.645 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.591+0000 7f9114ff9640 1 -- 172.21.15.78:0/2941149659 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f912017b120 con 0x7f912004a940 2023-11-28T19:59:26.645 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.591+0000 7f9116ffd640 1 --2- 172.21.15.78:0/2941149659 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f9108066540 0x7f9108068a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:26.645 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.591+0000 7f9116ffd640 1 -- 172.21.15.78:0/2941149659 <== mon.2 v2:172.21.15.179:3301/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f9128198040 con 0x7f912004a940 2023-11-28T19:59:26.645 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.591+0000 7f9116ffd640 1 --2- 172.21.15.78:0/2941149659 >> [v2:172.21.15.179:6817/2848432339,v1:172.21.15.179:6819/2848432339] conn(0x7f910806fb00 0x7f9108071f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:26.646 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.591+0000 7f9116ffd640 1 -- 172.21.15.78:0/2941149659 --> [v2:172.21.15.179:6817/2848432339,v1:172.21.15.179:6819/2848432339] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f9108072610 con 0x7f910806fb00 2023-11-28T19:59:26.646 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.591+0000 7f9116ffd640 1 -- 172.21.15.78:0/2941149659 <== mon.2 v2:172.21.15.179:3301/0 6 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7f912812aea0 con 0x7f912004a940 2023-11-28T19:59:26.646 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.591+0000 7f912659c640 1 --2- 172.21.15.78:0/2941149659 >> [v2:172.21.15.179:6817/2848432339,v1:172.21.15.179:6819/2848432339] conn(0x7f910806fb00 0x7f9108071f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:26.646 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.591+0000 7fc89de46640 1 Processor -- start 2023-11-28T19:59:26.646 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.591+0000 7f912659c640 1 --2- 172.21.15.78:0/2941149659 >> [v2:172.21.15.179:6817/2848432339,v1:172.21.15.179:6819/2848432339] conn(0x7f910806fb00 0x7f9108071f40 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:59:26.647 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.591+0000 7fc89de46640 1 -- start start 2023-11-28T19:59:26.647 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.591+0000 7fc223c46640 1 -- 172.21.15.78:0/1372462674 --> [v2:172.21.15.78:6808/3211476654,v1:172.21.15.78:6809/3211476654] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fc204002cc0 con 0x7fc20006fb80 2023-11-28T19:59:26.647 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.591+0000 7f9125d9b640 1 --2- 172.21.15.78:0/2941149659 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f9108066540 0x7f9108068a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:26.647 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.595+0000 7fc89de46640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc89814fa60 0x7fc89806cc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:26.648 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.595+0000 7fc89de46640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc898147140 0x7fc8981e8f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:26.648 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.595+0000 7f9116ffd640 1 -- 172.21.15.78:0/2941149659 <== osd.7 v2:172.21.15.179:6817/2848432339 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7f9108072610 con 0x7f910806fb00 2023-11-28T19:59:26.649 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.595+0000 7fc89de46640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc898147690 0x7fc8981e9440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:26.649 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.595+0000 7fc89de46640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc898150a90 con 0x7fc898147690 2023-11-28T19:59:26.649 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.595+0000 7fc89de46640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8981e9980 con 0x7fc898147140 2023-11-28T19:59:26.649 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.595+0000 7fc89de46640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc8981e9bf0 con 0x7fc89814fa60 2023-11-28T19:59:26.649 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.595+0000 7fc8977fe640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc89814fa60 0x7fc89806cc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:26.649 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.595+0000 7fc8977fe640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc89814fa60 0x7fc89806cc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3301/0 says I am v2:172.21.15.78:47836/0 (socket says 172.21.15.78:47836) 2023-11-28T19:59:26.649 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.595+0000 7fc8977fe640 1 -- 172.21.15.78:0/2770800677 learned_addr learned my addr 172.21.15.78:0/2770800677 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T19:59:26.650 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.595+0000 7fc88ffff640 1 --2- 172.21.15.78:0/2770800677 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc898147140 0x7fc8981e8f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:26.650 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.595+0000 7fc897fff640 1 --2- 172.21.15.78:0/2770800677 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc898147690 0x7fc8981e9440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:26.650 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.595+0000 7fc8977fe640 1 -- 172.21.15.78:0/2770800677 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc898147140 msgr2=0x7fc8981e8f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:26.650 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.595+0000 7fc8977fe640 1 --2- 172.21.15.78:0/2770800677 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc898147140 0x7fc8981e8f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:26.650 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.595+0000 7fc8977fe640 1 -- 172.21.15.78:0/2770800677 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc898147690 msgr2=0x7fc8981e9440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:26.650 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.595+0000 7fc8977fe640 1 --2- 172.21.15.78:0/2770800677 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc898147690 0x7fc8981e9440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:26.650 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.595+0000 7fc8977fe640 1 -- 172.21.15.78:0/2770800677 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8980a7cd0 con 0x7fc89814fa60 2023-11-28T19:59:26.650 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.595+0000 7fc897fff640 1 --2- 172.21.15.78:0/2770800677 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc898147690 0x7fc8981e9440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T19:59:26.650 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.595+0000 7fc2127fc640 1 -- 172.21.15.78:0/1372462674 <== osd.1 v2:172.21.15.78:6808/3211476654 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fc204002cc0 con 0x7fc20006fb80 2023-11-28T19:59:26.651 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.595+0000 7fc8977fe640 1 --2- 172.21.15.78:0/2770800677 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc89814fa60 0x7fc89806cc40 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fc888009ae0 tx=0x7fc884005800 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:59:26.651 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.595+0000 7f9125d9b640 1 --2- 172.21.15.78:0/2941149659 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f9108066540 0x7f9108068a00 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f911c009b60 tx=0x7f911c009190 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:59:26.652 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.595+0000 7fc223c46640 1 -- 172.21.15.78:0/1372462674 >> [v2:172.21.15.78:6808/3211476654,v1:172.21.15.78:6809/3211476654] conn(0x7fc20006fb80 msgr2=0x7fc200071fc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:26.652 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.595+0000 7fc223c46640 1 --2- 172.21.15.78:0/1372462674 >> [v2:172.21.15.78:6808/3211476654,v1:172.21.15.78:6809/3211476654] conn(0x7fc20006fb80 0x7fc200071fc0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:26.652 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.595+0000 7fc894ff9640 1 -- 172.21.15.78:0/2770800677 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc888004230 con 0x7fc89814fa60 2023-11-28T19:59:26.652 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.595+0000 7fc223c46640 1 -- 172.21.15.78:0/1372462674 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fc200066540 msgr2=0x7fc200068a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:26.653 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.595+0000 7fc223c46640 1 --2- 172.21.15.78:0/1372462674 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fc200066540 0x7fc200068a00 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fc21402f600 tx=0x7fc20c008040 comp rx=0 tx=0).stop 2023-11-28T19:59:26.653 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.595+0000 7fc223c46640 1 -- 172.21.15.78:0/1372462674 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc2140076d0 msgr2=0x7fc214176a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:26.653 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.595+0000 7fc223c46640 1 --2- 172.21.15.78:0/1372462674 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc2140076d0 0x7fc214176a10 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fc21801cc30 tx=0x7fc218019130 comp rx=0 tx=0).stop 2023-11-28T19:59:26.653 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.595+0000 7fc2221e3640 1 -- 172.21.15.78:0/1372462674 reap_dead start 2023-11-28T19:59:26.653 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.595+0000 7fc223c46640 1 -- 172.21.15.78:0/1372462674 shutdown_connections 2023-11-28T19:59:26.653 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.595+0000 7fc223c46640 1 -- 172.21.15.78:0/1372462674 >> 172.21.15.78:0/1372462674 conn(0x7fc21404c640 msgr2=0x7fc21402f870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T19:59:26.653 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.595+0000 7fc894ff9640 1 -- 172.21.15.78:0/2770800677 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc888004390 con 0x7fc89814fa60 2023-11-28T19:59:26.654 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.595+0000 7fc894ff9640 1 -- 172.21.15.78:0/2770800677 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8880ad850 con 0x7fc89814fa60 2023-11-28T19:59:26.654 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.599+0000 7fc223c46640 1 -- 172.21.15.78:0/1372462674 shutdown_connections 2023-11-28T19:59:26.654 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.599+0000 7fc89de46640 1 -- 172.21.15.78:0/2770800677 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc8980a7fb0 con 0x7fc89814fa60 2023-11-28T19:59:26.654 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.599+0000 7fc89de46640 1 -- 172.21.15.78:0/2770800677 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc89806d180 con 0x7fc89814fa60 2023-11-28T19:59:26.655 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.599+0000 7fc223c46640 1 -- 172.21.15.78:0/1372462674 wait complete. 2023-11-28T19:59:26.655 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.603+0000 7fc894ff9640 1 -- 172.21.15.78:0/2770800677 <== mon.2 v2:172.21.15.179:3301/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fc8880b4040 con 0x7fc89814fa60 2023-11-28T19:59:26.655 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.603+0000 7fc89de46640 1 -- 172.21.15.78:0/2770800677 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fc8980678b0 con 0x7fc89814fa60 2023-11-28T19:59:26.655 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.603+0000 7f08f685a640 1 -- 172.21.15.78:0/2024637645 --> [v2:172.21.15.179:6816/518192887,v1:172.21.15.179:6818/518192887] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f08f00aa610 con 0x7f08dc06fa60 2023-11-28T19:59:26.656 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.607+0000 7fc894ff9640 1 --2- 172.21.15.78:0/2770800677 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fc878066540 0x7fc878068a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:26.656 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.607+0000 7fc894ff9640 1 -- 172.21.15.78:0/2770800677 <== mon.2 v2:172.21.15.179:3301/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fc88811e6a0 con 0x7fc89814fa60 2023-11-28T19:59:26.656 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.607+0000 7fc894ff9640 1 --2- 172.21.15.78:0/2770800677 >> [v2:172.21.15.179:6800/815435378,v1:172.21.15.179:6801/815435378] conn(0x7fc87806fb80 0x7fc878071fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:26.656 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.607+0000 7fc894ff9640 1 -- 172.21.15.78:0/2770800677 --> [v2:172.21.15.179:6800/815435378,v1:172.21.15.179:6801/815435378] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fc878072690 con 0x7fc87806fb80 2023-11-28T19:59:26.656 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.607+0000 7fc894ff9640 1 -- 172.21.15.78:0/2770800677 <== mon.2 v2:172.21.15.179:3301/0 6 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc888120c00 con 0x7fc89814fa60 2023-11-28T19:59:26.657 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.607+0000 7f08ecff9640 1 -- 172.21.15.78:0/2024637645 <== osd.5 v2:172.21.15.179:6816/518192887 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f08e8001c50 con 0x7f08dc06fa60 2023-11-28T19:59:26.657 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.607+0000 7fc88ffff640 1 --2- 172.21.15.78:0/2770800677 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fc878066540 0x7fc878068a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:26.657 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.607+0000 7fc897fff640 1 --2- 172.21.15.78:0/2770800677 >> [v2:172.21.15.179:6800/815435378,v1:172.21.15.179:6801/815435378] conn(0x7fc87806fb80 0x7fc878071fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:26.658 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.607+0000 7f08f685a640 1 -- 172.21.15.78:0/2024637645 >> [v2:172.21.15.179:6816/518192887,v1:172.21.15.179:6818/518192887] conn(0x7f08dc06fa60 msgr2=0x7f08dc071ea0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:26.658 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.607+0000 7f08f685a640 1 --2- 172.21.15.78:0/2024637645 >> [v2:172.21.15.179:6816/518192887,v1:172.21.15.179:6818/518192887] conn(0x7f08dc06fa60 0x7f08dc071ea0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:26.658 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.607+0000 7f08f685a640 1 -- 172.21.15.78:0/2024637645 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f08dc0664a0 msgr2=0x7f08dc068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:26.658 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.607+0000 7f08f685a640 1 --2- 172.21.15.78:0/2024637645 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f08dc0664a0 0x7f08dc068960 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f08e40ad000 tx=0x7f08e4008040 comp rx=0 tx=0).stop 2023-11-28T19:59:26.658 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.607+0000 7f08f685a640 1 -- 172.21.15.78:0/2024637645 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f08f006d6a0 msgr2=0x7f08f01554f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:26.658 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.607+0000 7f08f685a640 1 --2- 172.21.15.78:0/2024637645 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f08f006d6a0 0x7f08f01554f0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f08e000c780 tx=0x7f08e000cc40 comp rx=0 tx=0).stop 2023-11-28T19:59:26.659 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.607+0000 7f08f4df7640 1 -- 172.21.15.78:0/2024637645 reap_dead start 2023-11-28T19:59:26.659 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.607+0000 7f08f685a640 1 -- 172.21.15.78:0/2024637645 shutdown_connections 2023-11-28T19:59:26.659 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.607+0000 7f08f685a640 1 -- 172.21.15.78:0/2024637645 >> 172.21.15.78:0/2024637645 conn(0x7f08f006b220 msgr2=0x7f08f00a9450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T19:59:26.659 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.607+0000 7feb24b2a640 1 -- 172.21.15.78:0/4001749545 --> [v2:172.21.15.179:6808/802983577,v1:172.21.15.179:6809/802983577] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7feb200c0530 con 0x7feb0006fab0 2023-11-28T19:59:26.659 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.607+0000 7feb177fe640 1 -- 172.21.15.78:0/4001749545 <== osd.4 v2:172.21.15.179:6808/802983577 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7feb200c0530 con 0x7feb0006fab0 2023-11-28T19:59:26.660 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.607+0000 7fc88ffff640 1 --2- 172.21.15.78:0/2770800677 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fc878066540 0x7fc878068a00 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fc89814ce30 tx=0x7fc880009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:59:26.660 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.607+0000 7f08f685a640 1 -- 172.21.15.78:0/2024637645 shutdown_connections 2023-11-28T19:59:26.660 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.607+0000 7fc897fff640 1 --2- 172.21.15.78:0/2770800677 >> [v2:172.21.15.179:6800/815435378,v1:172.21.15.179:6801/815435378] conn(0x7fc87806fb80 0x7fc878071fc0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:59:26.660 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.607+0000 7f08f685a640 1 -- 172.21.15.78:0/2024637645 wait complete. 2023-11-28T19:59:26.661 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.611+0000 7eff827fc640 1 -- 172.21.15.78:0/1285016175 --> [v2:172.21.15.78:6816/2532904479,v1:172.21.15.78:6817/2532904479] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7eff8c0a7cf0 con 0x7eff6c06fae0 2023-11-28T19:59:26.661 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.611+0000 7f322bfff640 1 -- 172.21.15.78:0/3968326245 --> [v2:172.21.15.78:6800/3358701235,v1:172.21.15.78:6801/3358701235] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f32400d5dc0 con 0x7f322c070780 2023-11-28T19:59:26.662 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.611+0000 7eff897fa640 1 -- 172.21.15.78:0/1285016175 <== osd.2 v2:172.21.15.78:6816/2532904479 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7eff8c0a7cf0 con 0x7eff6c06fae0 2023-11-28T19:59:26.662 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.611+0000 7fc894ff9640 1 -- 172.21.15.78:0/2770800677 <== osd.6 v2:172.21.15.179:6800/815435378 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7fc878072690 con 0x7fc87806fb80 2023-11-28T19:59:26.662 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.611+0000 7f323e7fc640 1 -- 172.21.15.78:0/3968326245 <== osd.0 v2:172.21.15.78:6800/3358701235 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f32400d5dc0 con 0x7f322c070780 2023-11-28T19:59:26.663 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.611+0000 7eff827fc640 1 -- 172.21.15.78:0/1285016175 >> [v2:172.21.15.78:6816/2532904479,v1:172.21.15.78:6817/2532904479] conn(0x7eff6c06fae0 msgr2=0x7eff6c071f20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:26.663 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.611+0000 7eff827fc640 1 --2- 172.21.15.78:0/1285016175 >> [v2:172.21.15.78:6816/2532904479,v1:172.21.15.78:6817/2532904479] conn(0x7eff6c06fae0 0x7eff6c071f20 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:26.664 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.611+0000 7feb24b2a640 1 -- 172.21.15.78:0/4001749545 >> [v2:172.21.15.179:6808/802983577,v1:172.21.15.179:6809/802983577] conn(0x7feb0006fab0 msgr2=0x7feb00071ef0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:26.664 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.611+0000 7feb24b2a640 1 --2- 172.21.15.78:0/4001749545 >> [v2:172.21.15.179:6808/802983577,v1:172.21.15.179:6809/802983577] conn(0x7feb0006fab0 0x7feb00071ef0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:26.664 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.611+0000 7feb24b2a640 1 -- 172.21.15.78:0/4001749545 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7feb000664f0 msgr2=0x7feb000689b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:26.664 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.611+0000 7feb24b2a640 1 --2- 172.21.15.78:0/4001749545 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7feb000664f0 0x7feb000689b0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7feb200a5400 tx=0x7feb10001600 comp rx=0 tx=0).stop 2023-11-28T19:59:26.664 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.611+0000 7feb24b2a640 1 -- 172.21.15.78:0/4001749545 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7feb200bee60 msgr2=0x7feb201ee490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:26.664 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.611+0000 7feb24b2a640 1 --2- 172.21.15.78:0/4001749545 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7feb200bee60 0x7feb201ee490 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7feb08018f50 tx=0x7feb080190e0 comp rx=0 tx=0).stop 2023-11-28T19:59:26.664 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.611+0000 7feb1ed9d640 1 -- 172.21.15.78:0/4001749545 reap_dead start 2023-11-28T19:59:26.664 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.611+0000 7feb24b2a640 1 -- 172.21.15.78:0/4001749545 shutdown_connections 2023-11-28T19:59:26.664 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.611+0000 7feb24b2a640 1 -- 172.21.15.78:0/4001749545 >> 172.21.15.78:0/4001749545 conn(0x7feb2006ad70 msgr2=0x7feb200733c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T19:59:26.665 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.611+0000 7eff827fc640 1 -- 172.21.15.78:0/1285016175 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7eff6c0664a0 msgr2=0x7eff6c068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:26.665 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.611+0000 7feb24b2a640 1 -- 172.21.15.78:0/4001749545 shutdown_connections 2023-11-28T19:59:26.665 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.611+0000 7eff827fc640 1 --2- 172.21.15.78:0/1285016175 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7eff6c0664a0 0x7eff6c068960 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7eff7c007550 tx=0x7eff7c0074c0 comp rx=0 tx=0).stop 2023-11-28T19:59:26.665 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.611+0000 7eff827fc640 1 -- 172.21.15.78:0/1285016175 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7eff8c1e9df0 msgr2=0x7eff8c149770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:26.666 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.611+0000 7eff827fc640 1 --2- 172.21.15.78:0/1285016175 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7eff8c1e9df0 0x7eff8c149770 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7eff74020c00 tx=0x7eff78005800 comp rx=0 tx=0).stop 2023-11-28T19:59:26.666 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.611+0000 7feb24b2a640 1 -- 172.21.15.78:0/4001749545 wait complete. 2023-11-28T19:59:26.666 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.611+0000 7eff909b4640 1 -- 172.21.15.78:0/1285016175 reap_dead start 2023-11-28T19:59:26.666 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.611+0000 7eff827fc640 1 -- 172.21.15.78:0/1285016175 shutdown_connections 2023-11-28T19:59:26.666 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.611+0000 7eff827fc640 1 -- 172.21.15.78:0/1285016175 >> 172.21.15.78:0/1285016175 conn(0x7eff8c06ad70 msgr2=0x7eff8c0c0840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T19:59:26.667 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.611+0000 7f322bfff640 1 -- 172.21.15.78:0/3968326245 >> [v2:172.21.15.78:6800/3358701235,v1:172.21.15.78:6801/3358701235] conn(0x7f322c070780 msgr2=0x7f322c072c20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:26.667 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.611+0000 7f322bfff640 1 --2- 172.21.15.78:0/3968326245 >> [v2:172.21.15.78:6800/3358701235,v1:172.21.15.78:6801/3358701235] conn(0x7f322c070780 0x7f322c072c20 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:26.667 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.611+0000 7eff827fc640 1 -- 172.21.15.78:0/1285016175 shutdown_connections 2023-11-28T19:59:26.667 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.611+0000 7eff827fc640 1 -- 172.21.15.78:0/1285016175 wait complete. 2023-11-28T19:59:26.668 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.611+0000 7f322bfff640 1 -- 172.21.15.78:0/3968326245 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f322c0664f0 msgr2=0x7f322c0689b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:26.668 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.611+0000 7f322bfff640 1 --2- 172.21.15.78:0/3968326245 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f322c0664f0 0x7f322c0689b0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f323801a940 tx=0x7f32380a6000 comp rx=0 tx=0).stop 2023-11-28T19:59:26.668 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.611+0000 7f322bfff640 1 -- 172.21.15.78:0/3968326245 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f324004b980 msgr2=0x7f32400343d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:26.668 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.611+0000 7f322bfff640 1 --2- 172.21.15.78:0/3968326245 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f324004b980 0x7f32400343d0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f3244001ec0 tx=0x7f324400c820 comp rx=0 tx=0).stop 2023-11-28T19:59:26.668 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.611+0000 7f324e1cf640 1 -- 172.21.15.78:0/3968326245 reap_dead start 2023-11-28T19:59:26.668 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.611+0000 7f322bfff640 1 -- 172.21.15.78:0/3968326245 shutdown_connections 2023-11-28T19:59:26.668 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.611+0000 7f322bfff640 1 -- 172.21.15.78:0/3968326245 >> 172.21.15.78:0/3968326245 conn(0x7f324004fbe0 msgr2=0x7f32400d8b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T19:59:26.669 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.615+0000 7f322bfff640 1 -- 172.21.15.78:0/3968326245 shutdown_connections 2023-11-28T19:59:26.669 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.615+0000 7f322bfff640 1 -- 172.21.15.78:0/3968326245 wait complete. 2023-11-28T19:59:26.669 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.615+0000 7f61e4157640 1 -- 172.21.15.78:0/2459505695 --> [v2:172.21.15.78:6824/3442991267,v1:172.21.15.78:6825/3442991267] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f61dc1ed830 con 0x7f61c006fb80 2023-11-28T19:59:26.669 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.619+0000 7f61d27fc640 1 -- 172.21.15.78:0/2459505695 <== osd.3 v2:172.21.15.78:6824/3442991267 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f61dc1ed830 con 0x7f61c006fb80 2023-11-28T19:59:26.670 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.623+0000 7f9114ff9640 1 -- 172.21.15.78:0/2941149659 --> [v2:172.21.15.179:6817/2848432339,v1:172.21.15.179:6819/2848432339] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f91200e2af0 con 0x7f910806fb00 2023-11-28T19:59:26.670 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.623+0000 7f61e4157640 1 -- 172.21.15.78:0/2459505695 >> [v2:172.21.15.78:6824/3442991267,v1:172.21.15.78:6825/3442991267] conn(0x7f61c006fb80 msgr2=0x7f61c0071fc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:26.670 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.623+0000 7f61e4157640 1 --2- 172.21.15.78:0/2459505695 >> [v2:172.21.15.78:6824/3442991267,v1:172.21.15.78:6825/3442991267] conn(0x7f61c006fb80 0x7f61c0071fc0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:26.670 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.623+0000 7f61e4157640 1 -- 172.21.15.78:0/2459505695 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f61c0066540 msgr2=0x7f61c0068a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:26.670 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.623+0000 7f61e4157640 1 --2- 172.21.15.78:0/2459505695 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f61c0066540 0x7f61c0068a00 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f61cc001960 tx=0x7f61cc009040 comp rx=0 tx=0).stop 2023-11-28T19:59:26.670 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.623+0000 7f61e4157640 1 -- 172.21.15.78:0/2459505695 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f61dc0a5370 msgr2=0x7f61dc155090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:26.671 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.623+0000 7f61e4157640 1 --2- 172.21.15.78:0/2459505695 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f61dc0a5370 0x7f61dc155090 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f61d4007fd0 tx=0x7f61d400cee0 comp rx=0 tx=0).stop 2023-11-28T19:59:26.671 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.623+0000 7f61e26f4640 1 -- 172.21.15.78:0/2459505695 reap_dead start 2023-11-28T19:59:26.671 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.623+0000 7f61e4157640 1 -- 172.21.15.78:0/2459505695 shutdown_connections 2023-11-28T19:59:26.671 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.623+0000 7f61e4157640 1 -- 172.21.15.78:0/2459505695 >> 172.21.15.78:0/2459505695 conn(0x7f61dc06b220 msgr2=0x7f61dc0c3620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T19:59:26.671 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.623+0000 7f61e4157640 1 -- 172.21.15.78:0/2459505695 shutdown_connections 2023-11-28T19:59:26.671 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.627+0000 7f61e4157640 1 -- 172.21.15.78:0/2459505695 wait complete. 2023-11-28T19:59:26.671 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.627+0000 7f9116ffd640 1 -- 172.21.15.78:0/2941149659 <== osd.7 v2:172.21.15.179:6817/2848432339 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f9118005090 con 0x7f910806fb00 2023-11-28T19:59:26.672 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.627+0000 7f912759e640 1 -- 172.21.15.78:0/2941149659 >> [v2:172.21.15.179:6817/2848432339,v1:172.21.15.179:6819/2848432339] conn(0x7f910806fb00 msgr2=0x7f9108071f40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:26.672 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.627+0000 7f912759e640 1 --2- 172.21.15.78:0/2941149659 >> [v2:172.21.15.179:6817/2848432339,v1:172.21.15.179:6819/2848432339] conn(0x7f910806fb00 0x7f9108071f40 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:26.672 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.627+0000 7f912759e640 1 -- 172.21.15.78:0/2941149659 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f9108066540 msgr2=0x7f9108068a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:26.672 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.627+0000 7f912759e640 1 --2- 172.21.15.78:0/2941149659 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f9108066540 0x7f9108068a00 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f911c009b60 tx=0x7f911c009190 comp rx=0 tx=0).stop 2023-11-28T19:59:26.672 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.627+0000 7f912759e640 1 -- 172.21.15.78:0/2941149659 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f912004a940 msgr2=0x7f91200d4a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:26.672 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.627+0000 7f912759e640 1 --2- 172.21.15.78:0/2941149659 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f912004a940 0x7f91200d4a70 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f91280732e0 tx=0x7f9128093740 comp rx=0 tx=0).stop 2023-11-28T19:59:26.672 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.627+0000 7f912659c640 1 -- 172.21.15.78:0/2941149659 reap_dead start 2023-11-28T19:59:26.673 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.627+0000 7f912759e640 1 -- 172.21.15.78:0/2941149659 shutdown_connections 2023-11-28T19:59:26.673 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.627+0000 7f912759e640 1 -- 172.21.15.78:0/2941149659 >> 172.21.15.78:0/2941149659 conn(0x7f9120048400 msgr2=0x7f9120006540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T19:59:26.673 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.627+0000 7f912759e640 1 -- 172.21.15.78:0/2941149659 shutdown_connections 2023-11-28T19:59:26.673 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.627+0000 7f912759e640 1 -- 172.21.15.78:0/2941149659 wait complete. 2023-11-28T19:59:26.673 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.639+0000 7fc89de46640 1 -- 172.21.15.78:0/2770800677 --> [v2:172.21.15.179:6800/815435378,v1:172.21.15.179:6801/815435378] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fc89806eb00 con 0x7fc87806fb80 2023-11-28T19:59:26.673 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.639+0000 7fc894ff9640 1 -- 172.21.15.78:0/2770800677 <== osd.6 v2:172.21.15.179:6800/815435378 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fc89806eb00 con 0x7fc87806fb80 2023-11-28T19:59:26.674 INFO:teuthology.orchestra.run.smithi078.stdout:55834574858 2023-11-28T19:59:26.674 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-11-28T19:59:26.675 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.643+0000 7fc89de46640 1 -- 172.21.15.78:0/2770800677 >> [v2:172.21.15.179:6800/815435378,v1:172.21.15.179:6801/815435378] conn(0x7fc87806fb80 msgr2=0x7fc878071fc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:26.676 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.643+0000 7fc89de46640 1 --2- 172.21.15.78:0/2770800677 >> [v2:172.21.15.179:6800/815435378,v1:172.21.15.179:6801/815435378] conn(0x7fc87806fb80 0x7fc878071fc0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:26.676 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.643+0000 7fc89de46640 1 -- 172.21.15.78:0/2770800677 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fc878066540 msgr2=0x7fc878068a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:26.676 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.643+0000 7fc89de46640 1 --2- 172.21.15.78:0/2770800677 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fc878066540 0x7fc878068a00 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fc89814ce30 tx=0x7fc880009040 comp rx=0 tx=0).stop 2023-11-28T19:59:26.676 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.643+0000 7fc89de46640 1 -- 172.21.15.78:0/2770800677 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc89814fa60 msgr2=0x7fc89806cc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:26.676 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.643+0000 7fc89de46640 1 --2- 172.21.15.78:0/2770800677 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc89814fa60 0x7fc89806cc40 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fc888009ae0 tx=0x7fc884005800 comp rx=0 tx=0).stop 2023-11-28T19:59:26.676 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.643+0000 7fc897fff640 1 -- 172.21.15.78:0/2770800677 reap_dead start 2023-11-28T19:59:26.676 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.643+0000 7fc89de46640 1 -- 172.21.15.78:0/2770800677 shutdown_connections 2023-11-28T19:59:26.676 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.643+0000 7fc89de46640 1 -- 172.21.15.78:0/2770800677 >> 172.21.15.78:0/2770800677 conn(0x7fc8980c7c60 msgr2=0x7fc898153680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T19:59:26.676 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.643+0000 7fc89de46640 1 -- 172.21.15.78:0/2770800677 shutdown_connections 2023-11-28T19:59:26.676 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.643+0000 7fc89de46640 1 -- 172.21.15.78:0/2770800677 wait complete. 2023-11-28T19:59:26.677 INFO:teuthology.orchestra.run.smithi078.stdout:55834574857 2023-11-28T19:59:26.677 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2023-11-28T19:59:26.678 INFO:teuthology.orchestra.run.smithi078.stdout:55834574856 2023-11-28T19:59:26.678 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-11-28T19:59:26.679 INFO:teuthology.orchestra.run.smithi078.stdout:55834574858 2023-11-28T19:59:26.679 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2023-11-28T19:59:26.680 INFO:teuthology.orchestra.run.smithi078.stdout:55834574857 2023-11-28T19:59:26.680 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-11-28T19:59:26.681 INFO:teuthology.orchestra.run.smithi078.stdout:55834574858 2023-11-28T19:59:26.681 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2023-11-28T19:59:26.682 INFO:teuthology.orchestra.run.smithi078.stdout:55834574858 2023-11-28T19:59:26.683 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-11-28T19:59:26.683 INFO:teuthology.orchestra.run.smithi078.stdout:55834574856 2023-11-28T19:59:26.684 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2023-11-28T19:59:26.959 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.951+0000 7f3281396640 1 Processor -- start 2023-11-28T19:59:26.963 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.955+0000 7f3281396640 1 -- start start 2023-11-28T19:59:26.963 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.955+0000 7f3281396640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f32740df400 0x7f32740e26e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:26.963 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.955+0000 7f3281396640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f32740e2c20 con 0x7f32740dbcb0 2023-11-28T19:59:26.963 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.955+0000 7f3281396640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f32740de840 con 0x7f327400b090 2023-11-28T19:59:26.963 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.955+0000 7f3281396640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f32740475f0 con 0x7f32740df400 2023-11-28T19:59:26.963 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.955+0000 7f327bfff640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f32740dbcb0 0x7f3274006e80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:53960/0 (socket says 172.21.15.78:53960) 2023-11-28T19:59:26.963 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.955+0000 7f327bfff640 1 -- 172.21.15.78:0/2207669128 learned_addr learned my addr 172.21.15.78:0/2207669128 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-11-28T19:59:26.964 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.955+0000 7f3280b95640 1 --2- 172.21.15.78:0/2207669128 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f32740df400 0x7f32740e26e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:26.964 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.955+0000 7f327affd640 1 -- 172.21.15.78:0/2207669128 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3849536097 0 0) 0x7f32740de840 con 0x7f327400b090 2023-11-28T19:59:26.964 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.955+0000 7f327affd640 1 -- 172.21.15.78:0/2207669128 --> v1:172.21.15.179:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f326c003530 con 0x7f327400b090 2023-11-28T19:59:26.964 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.959+0000 7fd026eea640 1 Processor -- start 2023-11-28T19:59:26.964 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.959+0000 7fd026eea640 1 -- start start 2023-11-28T19:59:26.965 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.959+0000 7f327affd640 1 -- 172.21.15.78:0/2207669128 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2748963547 0 0) 0x7f32740e2c20 con 0x7f32740dbcb0 2023-11-28T19:59:26.965 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.959+0000 7f327affd640 1 -- 172.21.15.78:0/2207669128 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f32740de840 con 0x7f32740dbcb0 2023-11-28T19:59:26.965 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.959+0000 7f3280b95640 1 -- 172.21.15.78:0/2207669128 >> v1:172.21.15.179:6789/0 conn(0x7f327400b090 legacy=0x7f32740decf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:26.965 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.959+0000 7f3280b95640 1 -- 172.21.15.78:0/2207669128 >> v1:172.21.15.78:6789/0 conn(0x7f32740dbcb0 legacy=0x7f3274006e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:26.965 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.959+0000 7f3280b95640 1 -- 172.21.15.78:0/2207669128 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32740478d0 con 0x7f32740df400 2023-11-28T19:59:26.966 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.959+0000 7fd026eea640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fd020151d00 0x7fd0200c3930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:26.966 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.959+0000 7fd026eea640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fd0200a8350 0x7fd0201545d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:26.967 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.959+0000 7fd026eea640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd020155580 con 0x7fd0200c0d90 2023-11-28T19:59:26.967 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.959+0000 7fd026eea640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd0200c1490 con 0x7fd020151d00 2023-11-28T19:59:26.967 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.959+0000 7fd026eea640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd0201520e0 con 0x7fd0200a8350 2023-11-28T19:59:26.967 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.959+0000 7fd01ffff640 1 --1- >> v1:172.21.15.179:6789/0 conn(0x7fd0200c0d90 0x7fd0200bfa20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.179:6789/0 says I am v1:172.21.15.78:60118/0 (socket says 172.21.15.78:60118) 2023-11-28T19:59:26.967 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.959+0000 7fd01ffff640 1 -- 172.21.15.78:0/1347541046 learned_addr learned my addr 172.21.15.78:0/1347541046 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-11-28T19:59:26.967 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.959+0000 7fd025487640 1 --2- 172.21.15.78:0/1347541046 >> v2:172.21.15.179:3300/0 conn(0x7fd0200a8350 0x7fd0201545d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:26.967 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.959+0000 7fd01f7fe640 1 -- 172.21.15.78:0/1347541046 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2435786839 0 0) 0x7fd020155580 con 0x7fd0200c0d90 2023-11-28T19:59:26.967 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.959+0000 7fd01f7fe640 1 -- 172.21.15.78:0/1347541046 --> v1:172.21.15.179:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd008003530 con 0x7fd0200c0d90 2023-11-28T19:59:26.968 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.959+0000 7fd024c86640 1 --2- 172.21.15.78:0/1347541046 >> v2:172.21.15.78:3300/0 conn(0x7fd020151d00 0x7fd0200c3930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:26.968 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.959+0000 7fd01f7fe640 1 -- 172.21.15.78:0/1347541046 <== mon.1 v1:172.21.15.179:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1850230231 0 0) 0x7fd008003530 con 0x7fd0200c0d90 2023-11-28T19:59:26.968 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.959+0000 7fd01f7fe640 1 -- 172.21.15.78:0/1347541046 >> v2:172.21.15.179:3300/0 conn(0x7fd0200a8350 msgr2=0x7fd0201545d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T19:59:26.968 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.959+0000 7fd01f7fe640 1 --2- 172.21.15.78:0/1347541046 >> v2:172.21.15.179:3300/0 conn(0x7fd0200a8350 0x7fd0201545d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:26.968 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.959+0000 7fd01f7fe640 1 -- 172.21.15.78:0/1347541046 >> v2:172.21.15.78:3300/0 conn(0x7fd020151d00 msgr2=0x7fd0200c3930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T19:59:26.968 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.959+0000 7fd01f7fe640 1 --2- 172.21.15.78:0/1347541046 >> v2:172.21.15.78:3300/0 conn(0x7fd020151d00 0x7fd0200c3930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:26.969 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.959+0000 7fd01f7fe640 1 -- 172.21.15.78:0/1347541046 --> v1:172.21.15.179:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0200c56d0 con 0x7fd0200c0d90 2023-11-28T19:59:26.969 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.959+0000 7fd01f7fe640 1 -- 172.21.15.78:0/1347541046 <== mon.1 v1:172.21.15.179:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3326804700 0 0) 0x7fd014001680 con 0x7fd0200c0d90 2023-11-28T19:59:26.969 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.959+0000 7fd01f7fe640 1 -- 172.21.15.78:0/1347541046 >> v1:172.21.15.179:6789/0 conn(0x7fd0200c0d90 legacy=0x7fd0200bfa20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:26.969 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.963+0000 7fd01f7fe640 1 --2- 172.21.15.78:0/1347541046 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd008003980 0x7fd008003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:26.969 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.963+0000 7fd01f7fe640 1 --2- 172.21.15.78:0/1347541046 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd0080047d0 0x7fd008004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:26.969 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.963+0000 7fd01f7fe640 1 --2- 172.21.15.78:0/1347541046 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd0080052b0 0x7fd00800b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:26.969 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.963+0000 7fd01f7fe640 1 -- 172.21.15.78:0/1347541046 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0200c1490 con 0x7fd0080047d0 2023-11-28T19:59:26.969 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.963+0000 7fd01f7fe640 1 -- 172.21.15.78:0/1347541046 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd00800c180 con 0x7fd008003980 2023-11-28T19:59:26.969 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.963+0000 7fd01f7fe640 1 -- 172.21.15.78:0/1347541046 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd00800c340 con 0x7fd0080052b0 2023-11-28T19:59:26.970 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.963+0000 7fd024c86640 1 --2- 172.21.15.78:0/1347541046 >> v2:172.21.15.78:3300/0 conn(0x7fd020151d00 0x7fd0200c3930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T19:59:26.970 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.963+0000 7fd01ffff640 1 --2- 172.21.15.78:0/1347541046 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd0080047d0 0x7fd008004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:26.970 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.963+0000 7fd025487640 1 --2- 172.21.15.78:0/1347541046 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd0080052b0 0x7fd00800b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:26.970 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.963+0000 7f3280b95640 1 --2- 172.21.15.78:0/2207669128 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f32740df400 0x7f32740e26e0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f32700097f0 tx=0x7f327001c420 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1bc5a165a8b837a0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:59:26.971 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.963+0000 7fd01ffff640 1 -- 172.21.15.78:0/1347541046 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd0080052b0 msgr2=0x7fd00800b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T19:59:26.971 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.963+0000 7fd01ffff640 1 --2- 172.21.15.78:0/1347541046 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd0080052b0 0x7fd00800b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:26.971 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.963+0000 7fd01ffff640 1 -- 172.21.15.78:0/1347541046 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd008003980 msgr2=0x7fd008003da0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-11-28T19:59:26.971 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.963+0000 7fd01ffff640 1 --2- 172.21.15.78:0/1347541046 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd008003980 0x7fd008003da0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:26.971 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.963+0000 7fd01ffff640 1 -- 172.21.15.78:0/1347541046 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0200c56d0 con 0x7fd0080047d0 2023-11-28T19:59:26.971 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.963+0000 7fd025487640 1 -- 172.21.15.78:0/1347541046 reap_dead start 2023-11-28T19:59:26.972 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.963+0000 7f327affd640 1 -- 172.21.15.78:0/2207669128 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32700ac620 con 0x7f32740df400 2023-11-28T19:59:26.972 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.963+0000 7f327affd640 1 -- 172.21.15.78:0/2207669128 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f32700ac780 con 0x7f32740df400 2023-11-28T19:59:26.972 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.963+0000 7f327affd640 1 -- 172.21.15.78:0/2207669128 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32700acb10 con 0x7f32740df400 2023-11-28T19:59:26.972 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.967+0000 7f3281396640 1 -- 172.21.15.78:0/2207669128 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f32740df400 msgr2=0x7f32740e26e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:26.972 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.967+0000 7f3281396640 1 --2- 172.21.15.78:0/2207669128 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f32740df400 0x7f32740e26e0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f32700097f0 tx=0x7f327001c420 comp rx=0 tx=0).stop 2023-11-28T19:59:26.973 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.967+0000 7f3281396640 1 -- 172.21.15.78:0/2207669128 shutdown_connections 2023-11-28T19:59:26.973 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.967+0000 7f3281396640 1 --2- 172.21.15.78:0/2207669128 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f32740df400 0x7f32740e26e0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:26.973 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.967+0000 7f3281396640 1 -- 172.21.15.78:0/2207669128 >> 172.21.15.78:0/2207669128 conn(0x7f3274048230 msgr2=0x7f3274048640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T19:59:26.973 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.967+0000 7f3281396640 1 -- 172.21.15.78:0/2207669128 shutdown_connections 2023-11-28T19:59:26.973 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.967+0000 7f3281396640 1 -- 172.21.15.78:0/2207669128 wait complete. 2023-11-28T19:59:26.974 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.967+0000 7f4245ff8640 1 Processor -- start 2023-11-28T19:59:26.974 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.967+0000 7f4245ff8640 1 -- start start 2023-11-28T19:59:26.974 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.967+0000 7f3281396640 1 Processor -- start 2023-11-28T19:59:26.974 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.967+0000 7f3281396640 1 -- start start 2023-11-28T19:59:26.975 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.967+0000 7f3ad2948640 1 Processor -- start 2023-11-28T19:59:26.975 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.971+0000 7f3ad2948640 1 -- start start 2023-11-28T19:59:26.976 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.971+0000 7fd01ffff640 1 --2- 172.21.15.78:0/1347541046 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd0080047d0 0x7fd008004c50 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fd0200ab1b0 tx=0x7fd01401cb70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c292de9f66630f08 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:59:26.976 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.971+0000 7f3281396640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f327400b090 0x7f32740da890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:26.976 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.971+0000 7f3281396640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f32740dbcb0 0x7f32740dadd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:26.976 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.971+0000 7f3281396640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f32740df400 0x7f327417a3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:26.976 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.971+0000 7f3281396640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f327417b100 con 0x7f327400b090 2023-11-28T19:59:26.976 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.971+0000 7f3281396640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f327402ee60 con 0x7f32740dbcb0 2023-11-28T19:59:26.977 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.971+0000 7f3281396640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f327402eb50 con 0x7f32740df400 2023-11-28T19:59:26.977 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.971+0000 7f327bfff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f327400b090 0x7f32740da890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:26.977 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.971+0000 7f4245ff8640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f4240157be0 0x7f42400c5f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:26.977 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.971+0000 7f4245ff8640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f42400c0d20 0x7f42400c3b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:26.978 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.971+0000 7f327bfff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f327400b090 0x7f32740da890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:53018/0 (socket says 172.21.15.78:53018) 2023-11-28T19:59:26.978 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.971+0000 7f327bfff640 1 -- 172.21.15.78:0/968106056 learned_addr learned my addr 172.21.15.78:0/968106056 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T19:59:26.978 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.971+0000 7f327b7fe640 1 --2- 172.21.15.78:0/968106056 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f32740dbcb0 0x7f32740dadd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:26.978 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.971+0000 7f3280b95640 1 --2- 172.21.15.78:0/968106056 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f32740df400 0x7f327417a3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:26.978 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.971+0000 7fd01f7fe640 1 -- 172.21.15.78:0/1347541046 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd014005ae0 con 0x7fd0080047d0 2023-11-28T19:59:26.978 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.971+0000 7fd01f7fe640 1 -- 172.21.15.78:0/1347541046 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd014005c40 con 0x7fd0080047d0 2023-11-28T19:59:26.979 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.971+0000 7f3ad2948640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3ac40dbcb0 0x7f3ac40e26e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:26.979 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.971+0000 7f3ad2948640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f3ac40decf0 0x7f3ac40df1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:26.979 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.971+0000 7f3ad2948640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3ac40e2c20 con 0x7f3ac400b090 2023-11-28T19:59:26.979 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.971+0000 7f3ad2948640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3ac40de840 con 0x7f3ac40decf0 2023-11-28T19:59:26.979 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.971+0000 7f3ad2948640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ac40df6e0 con 0x7f3ac40dbcb0 2023-11-28T19:59:26.980 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.971+0000 7fd01f7fe640 1 -- 172.21.15.78:0/1347541046 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd014005ae0 con 0x7fd0080047d0 2023-11-28T19:59:26.980 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.971+0000 7f327bfff640 1 -- 172.21.15.78:0/968106056 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f32740df400 msgr2=0x7f327417a3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:26.980 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.971+0000 7f327bfff640 1 --2- 172.21.15.78:0/968106056 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f32740df400 0x7f327417a3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:26.980 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.971+0000 7f327bfff640 1 -- 172.21.15.78:0/968106056 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f32740dbcb0 msgr2=0x7f32740dadd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:26.980 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.971+0000 7f327bfff640 1 --2- 172.21.15.78:0/968106056 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f32740dbcb0 0x7f32740dadd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:26.980 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.971+0000 7f327bfff640 1 -- 172.21.15.78:0/968106056 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3270009420 con 0x7f327400b090 2023-11-28T19:59:26.981 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.971+0000 7f4245ff8640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f42400c4090 0x7f4240157fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:26.981 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.971+0000 7f423f7fe640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f4240157be0 0x7f42400c5f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:26.981 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.971+0000 7f423effd640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f42400c0d20 0x7f42400c3b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:26.981 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.971+0000 7f423effd640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f42400c0d20 0x7f42400c3b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3301/0 says I am v2:172.21.15.78:47870/0 (socket says 172.21.15.78:47870) 2023-11-28T19:59:26.982 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.971+0000 7f3ad2147640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f3ac40decf0 0x7f3ac40df1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:26.982 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.971+0000 7fcbd271d640 1 Processor -- start 2023-11-28T19:59:26.982 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.971+0000 7f327bfff640 1 --2- 172.21.15.78:0/968106056 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f327400b090 0x7f32740da890 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f326800c4d0 tx=0x7f326800c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:59:26.983 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.971+0000 7fd026eea640 1 -- 172.21.15.78:0/1347541046 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd0080047d0 msgr2=0x7fd008004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:26.983 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.971+0000 7fd026eea640 1 --2- 172.21.15.78:0/1347541046 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd0080047d0 0x7fd008004c50 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fd0200ab1b0 tx=0x7fd01401cb70 comp rx=0 tx=0).stop 2023-11-28T19:59:26.983 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.971+0000 7fcbd271d640 1 -- start start 2023-11-28T19:59:26.983 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.971+0000 7f3ad2147640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f3ac40decf0 0x7f3ac40df1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.78:49956/0 (socket says 172.21.15.78:49956) 2023-11-28T19:59:26.984 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.971+0000 7f3ad2147640 1 -- 172.21.15.78:0/2340152684 learned_addr learned my addr 172.21.15.78:0/2340152684 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T19:59:26.984 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.971+0000 7f3ad1946640 1 --2- 172.21.15.78:0/2340152684 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3ac40dbcb0 0x7f3ac40e26e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:26.984 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.971+0000 7f3ad2147640 1 -- 172.21.15.78:0/2340152684 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3ac40dbcb0 msgr2=0x7f3ac40e26e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T19:59:26.984 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.971+0000 7f3ad2147640 1 --2- 172.21.15.78:0/2340152684 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3ac40dbcb0 0x7f3ac40e26e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:26.985 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.971+0000 7f3ad2147640 1 -- 172.21.15.78:0/2340152684 >> v1:172.21.15.179:6789/0 conn(0x7f3ac400b090 legacy=0x7f3ac4006e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:26.985 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.971+0000 7f3ad2147640 1 -- 172.21.15.78:0/2340152684 --> v2:172.21.15.179:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ac40475f0 con 0x7f3ac40decf0 2023-11-28T19:59:26.985 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.971+0000 7f423ffff640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f42400c4090 0x7f4240157fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:26.986 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.971+0000 7f3ad1946640 1 --2- 172.21.15.78:0/2340152684 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3ac40dbcb0 0x7f3ac40e26e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T19:59:26.986 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.971+0000 7f423ffff640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f42400c4090 0x7f4240157fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.78:49970/0 (socket says 172.21.15.78:49970) 2023-11-28T19:59:26.986 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.971+0000 7fdc85e79640 1 Processor -- start 2023-11-28T19:59:26.987 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.971+0000 7f423f7fe640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f4240157be0 0x7f42400c5f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:53028/0 (socket says 172.21.15.78:53028) 2023-11-28T19:59:26.987 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.975+0000 7f423effd640 1 -- 172.21.15.78:0/2017452179 learned_addr learned my addr 172.21.15.78:0/2017452179 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T19:59:26.987 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.975+0000 7fd026eea640 1 -- 172.21.15.78:0/1347541046 shutdown_connections 2023-11-28T19:59:26.987 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.975+0000 7fd026eea640 1 --2- 172.21.15.78:0/1347541046 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd0080047d0 0x7fd008004c50 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:26.988 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.975+0000 7fd026eea640 1 -- 172.21.15.78:0/1347541046 >> 172.21.15.78:0/1347541046 conn(0x7fd02006ad70 msgr2=0x7fd0200a77e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T19:59:26.988 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.971+0000 7f3278ff9640 1 -- 172.21.15.78:0/968106056 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3268005cf0 con 0x7f327400b090 2023-11-28T19:59:26.988 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.975+0000 7f3281396640 1 -- 172.21.15.78:0/968106056 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f327402f260 con 0x7f327400b090 2023-11-28T19:59:26.989 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.975+0000 7f4245ff8640 1 -- 172.21.15.78:0/2017452179 --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f42400c5aa0 con 0x7f4240157be0 2023-11-28T19:59:26.989 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.975+0000 7f4245ff8640 1 -- 172.21.15.78:0/2017452179 --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f42400bfc90 con 0x7f42400c4090 2023-11-28T19:59:26.989 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.975+0000 7f07f0157640 1 Processor -- start 2023-11-28T19:59:26.990 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.975+0000 7f4245ff8640 1 -- 172.21.15.78:0/2017452179 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42400c5170 con 0x7f42400c0d20 2023-11-28T19:59:26.990 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.975+0000 7fd026eea640 1 -- 172.21.15.78:0/1347541046 shutdown_connections 2023-11-28T19:59:26.990 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.975+0000 7fd026eea640 1 -- 172.21.15.78:0/1347541046 wait complete. 2023-11-28T19:59:26.990 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.975+0000 7f3278ff9640 1 -- 172.21.15.78:0/968106056 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3268005e50 con 0x7f327400b090 2023-11-28T19:59:26.990 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.975+0000 7f3281396640 1 -- 172.21.15.78:0/968106056 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3274031420 con 0x7f327400b090 2023-11-28T19:59:26.991 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.975+0000 7f3278ff9640 1 -- 172.21.15.78:0/968106056 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3268005cf0 con 0x7f327400b090 2023-11-28T19:59:26.991 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.975+0000 7fdc85e79640 1 -- start start 2023-11-28T19:59:26.992 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.975+0000 7fcbd271d640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fcbcc0c5f80 0x7fcbcc0c3a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:26.992 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.975+0000 7fcbd271d640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fcbcc0c0430 0x7fcbcc0c3f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:26.992 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.975+0000 7fcbd271d640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcbcc0a55c0 con 0x7fcbcc14dce0 2023-11-28T19:59:26.992 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.975+0000 7fcbd271d640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcbcc1505c0 con 0x7fcbcc0c0430 2023-11-28T19:59:26.992 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.975+0000 7fcbd271d640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcbcc1507d0 con 0x7fcbcc0c5f80 2023-11-28T19:59:26.992 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.975+0000 7fcbcb7fe640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fcbcc0c5f80 0x7fcbcc0c3a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:26.993 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.975+0000 7fcbcb7fe640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fcbcc0c5f80 0x7fcbcc0c3a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.78:49976/0 (socket says 172.21.15.78:49976) 2023-11-28T19:59:26.993 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.975+0000 7fcbcb7fe640 1 -- 172.21.15.78:0/3998826324 learned_addr learned my addr 172.21.15.78:0/3998826324 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T19:59:26.993 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.975+0000 7fdc85e79640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fdc8014da80 0x7fdc8006ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:26.993 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.975+0000 7fdc85e79640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdc800c5f60 0x7fdc800c40d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:26.994 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.975+0000 7fcbcb7fe640 1 -- 172.21.15.78:0/3998826324 >> v2:172.21.15.78:3300/0 conn(0x7fcbcc0c0430 msgr2=0x7fcbcc0c3f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T19:59:26.994 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.975+0000 7fcbcb7fe640 1 --2- 172.21.15.78:0/3998826324 >> v2:172.21.15.78:3300/0 conn(0x7fcbcc0c0430 0x7fcbcc0c3f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:26.994 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.975+0000 7fcbcb7fe640 1 -- 172.21.15.78:0/3998826324 >> v1:172.21.15.78:6789/0 conn(0x7fcbcc14dce0 legacy=0x7fcbcc06ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T19:59:26.994 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.975+0000 7fd026eea640 1 Processor -- start 2023-11-28T19:59:26.995 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.975+0000 7fdc7f7fe640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fdc8014da80 0x7fdc8006ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:26.995 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.975+0000 7fdc7f7fe640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fdc8014da80 0x7fdc8006ba10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.78:49980/0 (socket says 172.21.15.78:49980) 2023-11-28T19:59:26.995 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.975+0000 7fdc7f7fe640 1 -- 172.21.15.78:0/1290507589 learned_addr learned my addr 172.21.15.78:0/1290507589 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T19:59:26.995 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.975+0000 7fdc85e79640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdc80153c00 con 0x7fdc8006bf50 2023-11-28T19:59:26.995 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.975+0000 7fdc85e79640 1 -- 172.21.15.78:0/1290507589 --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdc80153ee0 con 0x7fdc8014da80 2023-11-28T19:59:26.996 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.975+0000 7fcbcb7fe640 1 -- 172.21.15.78:0/3998826324 --> v2:172.21.15.179:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcbcc150ab0 con 0x7fcbcc0c5f80 2023-11-28T19:59:26.996 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.975+0000 7fdc85e79640 1 -- 172.21.15.78:0/1290507589 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdc801541c0 con 0x7fdc800c5f60 2023-11-28T19:59:26.997 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.975+0000 7fd026eea640 1 -- start start 2023-11-28T19:59:26.997 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.975+0000 7f3278ff9640 1 -- 172.21.15.78:0/968106056 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f3268007070 con 0x7f327400b090 2023-11-28T19:59:26.998 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.975+0000 7fdc7ffff640 1 --2- 172.21.15.78:0/1290507589 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdc800c5f60 0x7fdc800c40d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:26.998 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.979+0000 7fdc7e7fc640 1 -- 172.21.15.78:0/1290507589 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 385680238 0 0) 0x7fdc80153c00 con 0x7fdc8006bf50 2023-11-28T19:59:26.999 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.979+0000 7fdc7f7fe640 1 -- 172.21.15.78:0/1290507589 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdc800c5f60 msgr2=0x7fdc800c40d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T19:59:26.999 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.979+0000 7fdc7f7fe640 1 --2- 172.21.15.78:0/1290507589 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdc800c5f60 0x7fdc800c40d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:26.999 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.979+0000 7fdc7f7fe640 1 -- 172.21.15.78:0/1290507589 >> v1:172.21.15.179:6789/0 conn(0x7fdc8006bf50 legacy=0x7fdc800c39c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:26.999 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.979+0000 7fdc7f7fe640 1 -- 172.21.15.78:0/1290507589 --> v2:172.21.15.179:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc801544a0 con 0x7fdc8014da80 2023-11-28T19:59:26.999 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.979+0000 7fdc7ffff640 1 --2- 172.21.15.78:0/1290507589 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdc800c5f60 0x7fdc800c40d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T19:59:27.000 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.979+0000 7f3278ff9640 1 --2- 172.21.15.78:0/968106056 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f32600664d0 0x7f3260068990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:27.000 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.979+0000 7fd026eea640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd0080047d0 0x7fd020148200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:27.000 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.979+0000 7fd026eea640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd0201edc20 0x7fd0201477f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:27.001 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.979+0000 7fd026eea640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd020147d30 0x7fd020072040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:27.001 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.979+0000 7f3278ff9640 1 -- 172.21.15.78:0/968106056 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f3268083320 con 0x7f327400b090 2023-11-28T19:59:27.001 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.979+0000 7fd026eea640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd02014e750 con 0x7fd0080047d0 2023-11-28T19:59:27.002 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.979+0000 7f327b7fe640 1 --2- 172.21.15.78:0/968106056 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f32600664d0 0x7f3260068990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:27.002 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.975+0000 7f423ffff640 1 -- 172.21.15.78:0/2017452179 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f42400c0d20 msgr2=0x7f42400c3b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T19:59:27.002 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.975+0000 7f423ffff640 1 --2- 172.21.15.78:0/2017452179 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f42400c0d20 0x7f42400c3b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:27.003 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.975+0000 7f423ffff640 1 -- 172.21.15.78:0/2017452179 >> v2:172.21.15.78:3300/0 conn(0x7f4240157be0 msgr2=0x7f42400c5f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T19:59:27.003 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.975+0000 7f423ffff640 1 --2- 172.21.15.78:0/2017452179 >> v2:172.21.15.78:3300/0 conn(0x7f4240157be0 0x7f42400c5f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:27.003 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.975+0000 7f423ffff640 1 -- 172.21.15.78:0/2017452179 --> v2:172.21.15.179:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42400c5450 con 0x7f42400c4090 2023-11-28T19:59:27.004 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.979+0000 7fd026eea640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0201eb1b0 con 0x7fd0201edc20 2023-11-28T19:59:27.004 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.979+0000 7fd026eea640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd0201ee0c0 con 0x7fd020147d30 2023-11-28T19:59:27.005 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.975+0000 7f07f0157640 1 -- start start 2023-11-28T19:59:27.005 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.979+0000 7f07f0157640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f07e80c47b0 0x7f07e80c4b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:27.005 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.979+0000 7f07f0157640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f07e80bd550 0x7f07e8155950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:27.005 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.979+0000 7f07f0157640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f07e80c6840 con 0x7f07e8154ee0 2023-11-28T19:59:27.006 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.979+0000 7f07f0157640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f07e8158a00 con 0x7f07e80bd550 2023-11-28T19:59:27.006 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.979+0000 7f07f0157640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f07e80af870 con 0x7f07e80c47b0 2023-11-28T19:59:27.006 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.979+0000 7fd025487640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd020147d30 0x7fd020072040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:27.006 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.979+0000 7fd025487640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd020147d30 0x7fd020072040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3301/0 says I am v2:172.21.15.78:47904/0 (socket says 172.21.15.78:47904) 2023-11-28T19:59:27.007 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.979+0000 7fd025487640 1 -- 172.21.15.78:0/3174532243 learned_addr learned my addr 172.21.15.78:0/3174532243 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T19:59:27.007 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.979+0000 7f07ee6f4640 1 --1- >> v1:172.21.15.179:6789/0 conn(0x7f07e8154ee0 0x7f07e81582f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.179:6789/0 says I am v1:172.21.15.78:60148/0 (socket says 172.21.15.78:60148) 2023-11-28T19:59:27.007 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.979+0000 7f07ee6f4640 1 -- 172.21.15.78:0/1116165493 learned_addr learned my addr 172.21.15.78:0/1116165493 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-11-28T19:59:27.007 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.979+0000 7f07edef3640 1 --2- 172.21.15.78:0/1116165493 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f07e80c47b0 0x7f07e80c4b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:27.008 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.979+0000 7f3281396640 1 -- 172.21.15.78:0/968106056 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f325c005260 con 0x7f327400b090 2023-11-28T19:59:27.008 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.979+0000 7f327b7fe640 1 --2- 172.21.15.78:0/968106056 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f32600664d0 0x7f3260068990 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f327c050190 tx=0x7f327c06d040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:59:27.008 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.979+0000 7fd025487640 1 -- 172.21.15.78:0/3174532243 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd0201edc20 msgr2=0x7fd0201477f0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-11-28T19:59:27.008 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.979+0000 7fd025487640 1 --2- 172.21.15.78:0/3174532243 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd0201edc20 0x7fd0201477f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:27.009 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.979+0000 7fd025487640 1 -- 172.21.15.78:0/3174532243 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd0080047d0 msgr2=0x7fd020148200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:27.009 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.979+0000 7fd025487640 1 --2- 172.21.15.78:0/3174532243 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd0080047d0 0x7fd020148200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:27.009 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.979+0000 7f07ecef1640 1 -- 172.21.15.78:0/1116165493 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1497938192 0 0) 0x7f07e80c6840 con 0x7f07e8154ee0 2023-11-28T19:59:27.009 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.979+0000 7fd025487640 1 -- 172.21.15.78:0/3174532243 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd02006fca0 con 0x7fd020147d30 2023-11-28T19:59:27.010 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.979+0000 7f07ed6f2640 1 --2- 172.21.15.78:0/1116165493 >> v2:172.21.15.78:3300/0 conn(0x7f07e80bd550 0x7f07e8155950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:27.010 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.979+0000 7fd025487640 1 --2- 172.21.15.78:0/3174532243 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd020147d30 0x7fd020072040 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fd020072d70 tx=0x7fd010011cf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:59:27.012 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.979+0000 7f07ecef1640 1 -- 172.21.15.78:0/1116165493 --> v1:172.21.15.179:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f07d4003530 con 0x7f07e8154ee0 2023-11-28T19:59:27.012 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.979+0000 7f07edef3640 1 -- 172.21.15.78:0/1116165493 >> v2:172.21.15.78:3300/0 conn(0x7f07e80bd550 msgr2=0x7f07e8155950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T19:59:27.012 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.979+0000 7f07edef3640 1 --2- 172.21.15.78:0/1116165493 >> v2:172.21.15.78:3300/0 conn(0x7f07e80bd550 0x7f07e8155950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:27.012 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.979+0000 7f07edef3640 1 -- 172.21.15.78:0/1116165493 >> v1:172.21.15.179:6789/0 conn(0x7f07e8154ee0 legacy=0x7f07e81582f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:27.012 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.979+0000 7f07edef3640 1 -- 172.21.15.78:0/1116165493 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07e80c6a70 con 0x7f07e80c47b0 2023-11-28T19:59:27.013 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.983+0000 7fd01d7fa640 1 -- 172.21.15.78:0/3174532243 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd010004030 con 0x7fd020147d30 2023-11-28T19:59:27.013 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.983+0000 7f423ffff640 1 --2- 172.21.15.78:0/2017452179 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f42400c4090 0x7f4240157fc0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f4240158d00 tx=0x7f423801c8c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a509cc4738601800 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:59:27.013 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.983+0000 7fcbcb7fe640 1 --2- 172.21.15.78:0/3998826324 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcbcc0c5f80 0x7fcbcc0c3a30 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fcbcc0a85a0 tx=0x7fcbc001c430 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cae7a98e32be0daa server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:59:27.014 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.983+0000 7fd01d7fa640 1 -- 172.21.15.78:0/3174532243 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd0100041b0 con 0x7fd020147d30 2023-11-28T19:59:27.014 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.983+0000 7fd01d7fa640 1 -- 172.21.15.78:0/3174532243 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd01000f770 con 0x7fd020147d30 2023-11-28T19:59:27.014 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.983+0000 7fd026eea640 1 -- 172.21.15.78:0/3174532243 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd02006ff80 con 0x7fd020147d30 2023-11-28T19:59:27.014 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.983+0000 7fd026eea640 1 -- 172.21.15.78:0/3174532243 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd020070540 con 0x7fd020147d30 2023-11-28T19:59:27.014 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.983+0000 7f423e7fc640 1 -- 172.21.15.78:0/2017452179 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42380a6710 con 0x7f42400c4090 2023-11-28T19:59:27.015 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.983+0000 7f423e7fc640 1 -- 172.21.15.78:0/2017452179 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f42380a6870 con 0x7f42400c4090 2023-11-28T19:59:27.015 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.983+0000 7f423e7fc640 1 -- 172.21.15.78:0/2017452179 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42380a6c00 con 0x7f42400c4090 2023-11-28T19:59:27.015 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.983+0000 7f3ad2147640 1 --2- 172.21.15.78:0/2340152684 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3ac40decf0 0x7f3ac40df1a0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f3acc062150 tx=0x7f3acc0969b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8cb0921c05d0ebf3 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:59:27.015 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.983+0000 7fdc7f7fe640 1 --2- 172.21.15.78:0/1290507589 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdc8014da80 0x7fdc8006ba10 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fdc70007360 tx=0x7fdc7001d430 comp rx=0 tx=0).ready entity=mon.1 client_cookie=58941dc2e60cc4d3 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:59:27.016 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.983+0000 7fd026eea640 1 -- 172.21.15.78:0/3174532243 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd000005260 con 0x7fd020147d30 2023-11-28T19:59:27.016 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.983+0000 7f3ad0944640 1 -- 172.21.15.78:0/2340152684 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3acc1207c0 con 0x7f3ac40decf0 2023-11-28T19:59:27.016 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.983+0000 7f3ad0944640 1 -- 172.21.15.78:0/2340152684 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3acc120920 con 0x7f3ac40decf0 2023-11-28T19:59:27.016 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.983+0000 7f3ad0944640 1 -- 172.21.15.78:0/2340152684 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3acc120d10 con 0x7f3ac40decf0 2023-11-28T19:59:27.017 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.983+0000 7f4245ff8640 1 -- 172.21.15.78:0/2017452179 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f42400c4090 msgr2=0x7f4240157fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:27.017 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.983+0000 7f4245ff8640 1 --2- 172.21.15.78:0/2017452179 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f42400c4090 0x7f4240157fc0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f4240158d00 tx=0x7f423801c8c0 comp rx=0 tx=0).stop 2023-11-28T19:59:27.017 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.983+0000 7f4245ff8640 1 -- 172.21.15.78:0/2017452179 shutdown_connections 2023-11-28T19:59:27.017 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.983+0000 7f4245ff8640 1 --2- 172.21.15.78:0/2017452179 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f42400c4090 0x7f4240157fc0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:27.017 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.983+0000 7f4245ff8640 1 --2- 172.21.15.78:0/2017452179 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f42400c0d20 0x7f42400c3b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:27.017 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.983+0000 7f4245ff8640 1 --2- 172.21.15.78:0/2017452179 >> v2:172.21.15.78:3300/0 conn(0x7f4240157be0 0x7f42400c5f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:27.017 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.983+0000 7f4245ff8640 1 -- 172.21.15.78:0/2017452179 >> 172.21.15.78:0/2017452179 conn(0x7f424006ad70 msgr2=0x7f42400a77e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T19:59:27.017 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.983+0000 7f4245ff8640 1 -- 172.21.15.78:0/2017452179 shutdown_connections 2023-11-28T19:59:27.018 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.983+0000 7f3ad2948640 1 -- 172.21.15.78:0/2340152684 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3ac40decf0 msgr2=0x7f3ac40df1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:27.018 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.983+0000 7f3ad2948640 1 --2- 172.21.15.78:0/2340152684 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3ac40decf0 0x7f3ac40df1a0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f3acc062150 tx=0x7f3acc0969b0 comp rx=0 tx=0).stop 2023-11-28T19:59:27.018 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.983+0000 7f3ad2948640 1 -- 172.21.15.78:0/2340152684 shutdown_connections 2023-11-28T19:59:27.018 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.983+0000 7f3ad2948640 1 --2- 172.21.15.78:0/2340152684 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3ac40decf0 0x7f3ac40df1a0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:27.018 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.983+0000 7f3ad2948640 1 --2- 172.21.15.78:0/2340152684 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3ac40dbcb0 0x7f3ac40e26e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:27.018 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.983+0000 7f3ad2948640 1 -- 172.21.15.78:0/2340152684 >> 172.21.15.78:0/2340152684 conn(0x7f3ac4048230 msgr2=0x7f3ac4048640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T19:59:27.018 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.983+0000 7fdc7e7fc640 1 -- 172.21.15.78:0/1290507589 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc70008be0 con 0x7fdc8014da80 2023-11-28T19:59:27.019 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.983+0000 7fdc7e7fc640 1 -- 172.21.15.78:0/1290507589 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc70008d40 con 0x7fdc8014da80 2023-11-28T19:59:27.019 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.983+0000 7fdc7e7fc640 1 -- 172.21.15.78:0/1290507589 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc7000a2f0 con 0x7fdc8014da80 2023-11-28T19:59:27.019 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.983+0000 7f234a357640 1 Processor -- start 2023-11-28T19:59:27.019 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.983+0000 7f234a357640 1 -- start start 2023-11-28T19:59:27.019 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.983+0000 7fcbcaffd640 1 -- 172.21.15.78:0/3998826324 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbc00a7070 con 0x7fcbcc0c5f80 2023-11-28T19:59:27.020 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.983+0000 7fcbcaffd640 1 -- 172.21.15.78:0/3998826324 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcbc00ab430 con 0x7fcbcc0c5f80 2023-11-28T19:59:27.020 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.983+0000 7fcbcaffd640 1 -- 172.21.15.78:0/3998826324 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbc00ab7c0 con 0x7fcbcc0c5f80 2023-11-28T19:59:27.020 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.983+0000 7f3ad2948640 1 -- 172.21.15.78:0/2340152684 shutdown_connections 2023-11-28T19:59:27.020 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.983+0000 7fdc85e79640 1 -- 172.21.15.78:0/1290507589 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdc8014da80 msgr2=0x7fdc8006ba10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:27.020 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.983+0000 7fdc85e79640 1 --2- 172.21.15.78:0/1290507589 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdc8014da80 0x7fdc8006ba10 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fdc70007360 tx=0x7fdc7001d430 comp rx=0 tx=0).stop 2023-11-28T19:59:27.021 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.983+0000 7f3ad2948640 1 -- 172.21.15.78:0/2340152684 wait complete. 2023-11-28T19:59:27.021 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.983+0000 7fdc85e79640 1 -- 172.21.15.78:0/1290507589 shutdown_connections 2023-11-28T19:59:27.021 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.983+0000 7fdc85e79640 1 --2- 172.21.15.78:0/1290507589 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdc800c5f60 0x7fdc800c40d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:27.021 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.983+0000 7fdc85e79640 1 --2- 172.21.15.78:0/1290507589 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdc8014da80 0x7fdc8006ba10 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:27.021 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.983+0000 7fdc85e79640 1 -- 172.21.15.78:0/1290507589 >> 172.21.15.78:0/1290507589 conn(0x7fdc8006b220 msgr2=0x7fdc800a77e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T19:59:27.021 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.983+0000 7fd01d7fa640 1 -- 172.21.15.78:0/3174532243 <== mon.2 v2:172.21.15.179:3301/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fd01000f8d0 con 0x7fd020147d30 2023-11-28T19:59:27.022 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.987+0000 7fcbd271d640 1 -- 172.21.15.78:0/3998826324 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcbcc0c5f80 msgr2=0x7fcbcc0c3a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:27.022 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.987+0000 7fcbd271d640 1 --2- 172.21.15.78:0/3998826324 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcbcc0c5f80 0x7fcbcc0c3a30 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fcbcc0a85a0 tx=0x7fcbc001c430 comp rx=0 tx=0).stop 2023-11-28T19:59:27.022 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.987+0000 7f234a357640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f23440c2110 0x7f23440c5ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:27.023 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.987+0000 7f234a357640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f23440c0c80 0x7f23440c61e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:27.023 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.987+0000 7f234a357640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f23440a93d0 con 0x7f2344154390 2023-11-28T19:59:27.023 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.987+0000 7f234a357640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f23440aa1c0 con 0x7f23440c0c80 2023-11-28T19:59:27.023 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.987+0000 7f234a357640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2344154770 con 0x7f23440c2110 2023-11-28T19:59:27.023 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.983+0000 7f4245ff8640 1 -- 172.21.15.78:0/2017452179 wait complete. 2023-11-28T19:59:27.024 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.987+0000 7f4245ff8640 1 Processor -- start 2023-11-28T19:59:27.024 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.987+0000 7fd01d7fa640 1 --2- 172.21.15.78:0/3174532243 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fd00c066540 0x7fd00c068a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:27.024 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.987+0000 7fd01d7fa640 1 -- 172.21.15.78:0/3174532243 <== mon.2 v2:172.21.15.179:3301/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fd010084600 con 0x7fd020147d30 2023-11-28T19:59:27.024 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.987+0000 7fd024c86640 1 --2- 172.21.15.78:0/3174532243 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fd00c066540 0x7fd00c068a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:27.025 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.987+0000 7f233b7fe640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f23440c2110 0x7f23440c5ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:27.025 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.987+0000 7f4245ff8640 1 -- start start 2023-11-28T19:59:27.025 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.987+0000 7f3ad2948640 1 Processor -- start 2023-11-28T19:59:27.025 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.987+0000 7fcbd271d640 1 -- 172.21.15.78:0/3998826324 shutdown_connections 2023-11-28T19:59:27.026 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.987+0000 7fcbd271d640 1 --2- 172.21.15.78:0/3998826324 >> v2:172.21.15.78:3300/0 conn(0x7fcbcc0c0430 0x7fcbcc0c3f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:27.026 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.987+0000 7fcbd271d640 1 --2- 172.21.15.78:0/3998826324 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcbcc0c5f80 0x7fcbcc0c3a30 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:27.026 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.987+0000 7fcbd271d640 1 -- 172.21.15.78:0/3998826324 >> 172.21.15.78:0/3998826324 conn(0x7fcbcc06ad70 msgr2=0x7fcbcc0a77e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T19:59:27.026 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.987+0000 7f23488f4640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f23440c0c80 0x7f23440c61e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:27.026 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.987+0000 7f233b7fe640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f23440c2110 0x7f23440c5ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3301/0 says I am v2:172.21.15.78:47930/0 (socket says 172.21.15.78:47930) 2023-11-28T19:59:27.026 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.987+0000 7f233b7fe640 1 -- 172.21.15.78:0/3108456751 learned_addr learned my addr 172.21.15.78:0/3108456751 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T19:59:27.026 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.987+0000 7f23488f4640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f23440c0c80 0x7f23440c61e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:53074/0 (socket says 172.21.15.78:53074) 2023-11-28T19:59:27.027 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.987+0000 7f07edef3640 1 --2- 172.21.15.78:0/1116165493 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f07e80c47b0 0x7f07e80c4b90 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f07d80097c0 tx=0x7f07d801c3f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bdb33a6a8cb673b5 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:59:27.027 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.987+0000 7f23437fe640 1 -- 172.21.15.78:0/3108456751 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3108313581 0 0) 0x7f23440a93d0 con 0x7f2344154390 2023-11-28T19:59:27.027 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.987+0000 7fcbd271d640 1 -- 172.21.15.78:0/3998826324 shutdown_connections 2023-11-28T19:59:27.028 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.987+0000 7f23437fe640 1 -- 172.21.15.78:0/3108456751 --> v1:172.21.15.179:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2330003530 con 0x7f2344154390 2023-11-28T19:59:27.028 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.987+0000 7fd024c86640 1 --2- 172.21.15.78:0/3174532243 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fd00c066540 0x7fd00c068a00 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fd0200732e0 tx=0x7fd0180083b0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:59:27.028 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.987+0000 7f3ad2948640 1 -- start start 2023-11-28T19:59:27.028 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.987+0000 7fdc85e79640 1 -- 172.21.15.78:0/1290507589 shutdown_connections 2023-11-28T19:59:27.029 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.987+0000 7fdc85e79640 1 -- 172.21.15.78:0/1290507589 wait complete. 2023-11-28T19:59:27.029 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.987+0000 7fdc85e79640 1 Processor -- start 2023-11-28T19:59:27.029 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.987+0000 7fdc85e79640 1 -- start start 2023-11-28T19:59:27.029 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.987+0000 7fdc85e79640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdc8006bf50 0x7fdc8020e710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:27.029 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.987+0000 7fcbd271d640 1 -- 172.21.15.78:0/3998826324 wait complete. 2023-11-28T19:59:27.030 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.991+0000 7f3ad2948640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3ac400b090 0x7f3ac4177910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:27.030 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.991+0000 7f3ad2948640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3ac40dbcb0 0x7f3ac403f540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:27.030 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.987+0000 7fdc85e79640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdc800c5f60 0x7fdc8020c3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:27.030 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.991+0000 7f3ad2948640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3ac40decf0 0x7f3ac40d5610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:27.030 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.991+0000 7f3ad2948640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ac4041f90 con 0x7f3ac40dbcb0 2023-11-28T19:59:27.031 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.991+0000 7f3ad2948640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ac4177e50 con 0x7f3ac40decf0 2023-11-28T19:59:27.031 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.991+0000 7f3ad2948640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ac40db330 con 0x7f3ac400b090 2023-11-28T19:59:27.031 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.991+0000 7fdc85e79640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdc8014da80 0x7fdc8014cd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:27.031 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.991+0000 7fdc85e79640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc801554b0 con 0x7fdc8014da80 2023-11-28T19:59:27.031 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.991+0000 7fdc85e79640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc80071d10 con 0x7fdc8006bf50 2023-11-28T19:59:27.031 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.991+0000 7fdc85e79640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdc80156470 con 0x7fdc800c5f60 2023-11-28T19:59:27.031 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.991+0000 7fdc7effd640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdc800c5f60 0x7fdc8020c3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:27.031 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.991+0000 7fdc7f7fe640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdc8006bf50 0x7fdc8020e710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:27.031 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.991+0000 7fdc7effd640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdc800c5f60 0x7fdc8020c3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3301/0 says I am v2:172.21.15.78:47954/0 (socket says 172.21.15.78:47954) 2023-11-28T19:59:27.032 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.991+0000 7fdc7effd640 1 -- 172.21.15.78:0/2373512644 learned_addr learned my addr 172.21.15.78:0/2373512644 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T19:59:27.032 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.991+0000 7fdc7ffff640 1 --2- 172.21.15.78:0/2373512644 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdc8014da80 0x7fdc8014cd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:27.032 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.987+0000 7f233b7fe640 1 -- 172.21.15.78:0/3108456751 >> v2:172.21.15.78:3300/0 conn(0x7f23440c0c80 msgr2=0x7f23440c61e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T19:59:27.032 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.987+0000 7f233b7fe640 1 --2- 172.21.15.78:0/3108456751 >> v2:172.21.15.78:3300/0 conn(0x7f23440c0c80 0x7f23440c61e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:27.032 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.987+0000 7f233b7fe640 1 -- 172.21.15.78:0/3108456751 >> v1:172.21.15.179:6789/0 conn(0x7f2344154390 legacy=0x7f23440c4a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:27.032 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.987+0000 7f233b7fe640 1 -- 172.21.15.78:0/3108456751 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23440a9640 con 0x7f23440c2110 2023-11-28T19:59:27.033 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.987+0000 7f4245ff8640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f42400c0d20 0x7f42401fdeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:27.033 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.987+0000 7f4245ff8640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f42400c4090 0x7f42400a5f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:27.033 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.991+0000 7f423f7fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f42400c0d20 0x7f42401fdeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:27.033 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.991+0000 7f423effd640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f42400c4090 0x7f42400a5f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:27.033 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.991+0000 7f423effd640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f42400c4090 0x7f42400a5f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3301/0 says I am v2:172.21.15.78:47946/0 (socket says 172.21.15.78:47946) 2023-11-28T19:59:27.033 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.991+0000 7f423f7fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f42400c0d20 0x7f42401fdeb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:53086/0 (socket says 172.21.15.78:53086) 2023-11-28T19:59:27.034 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.991+0000 7f3ad1946640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3ac400b090 0x7f3ac4177910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:27.034 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.991+0000 7f3ad1946640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3ac400b090 0x7f3ac4177910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3301/0 says I am v2:172.21.15.78:47964/0 (socket says 172.21.15.78:47964) 2023-11-28T19:59:27.034 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.991+0000 7f3ad1946640 1 -- 172.21.15.78:0/575914605 learned_addr learned my addr 172.21.15.78:0/575914605 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T19:59:27.034 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.991+0000 7f3ad2147640 1 --2- 172.21.15.78:0/575914605 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3ac40decf0 0x7f3ac40d5610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:27.034 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.991+0000 7f423effd640 1 -- 172.21.15.78:0/365745739 learned_addr learned my addr 172.21.15.78:0/365745739 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T19:59:27.034 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.991+0000 7f4245ff8640 1 --2- 172.21.15.78:0/365745739 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4240157be0 0x7f42400aa210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:27.034 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.991+0000 7f4245ff8640 1 -- 172.21.15.78:0/365745739 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42401fe3f0 con 0x7f42400c0d20 2023-11-28T19:59:27.035 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.991+0000 7f4245ff8640 1 -- 172.21.15.78:0/365745739 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42400a6450 con 0x7f4240157be0 2023-11-28T19:59:27.035 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.991+0000 7f3ad1145640 1 --2- 172.21.15.78:0/575914605 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3ac40dbcb0 0x7f3ac403f540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:27.035 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.991+0000 7f3ad1946640 1 -- 172.21.15.78:0/575914605 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3ac40decf0 msgr2=0x7f3ac40d5610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:27.035 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.991+0000 7f3ad1946640 1 --2- 172.21.15.78:0/575914605 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3ac40decf0 0x7f3ac40d5610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:27.035 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.991+0000 7f3ad1946640 1 -- 172.21.15.78:0/575914605 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3ac40dbcb0 msgr2=0x7f3ac403f540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:27.035 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.991+0000 7f3ad1946640 1 --2- 172.21.15.78:0/575914605 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3ac40dbcb0 0x7f3ac403f540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:27.035 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.991+0000 7f3ad1946640 1 -- 172.21.15.78:0/575914605 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3acc04f7e0 con 0x7f3ac400b090 2023-11-28T19:59:27.036 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.991+0000 7fdc7effd640 1 -- 172.21.15.78:0/2373512644 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdc8006bf50 msgr2=0x7fdc8020e710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:27.036 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.991+0000 7fdc7effd640 1 --2- 172.21.15.78:0/2373512644 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdc8006bf50 0x7fdc8020e710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:27.036 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.991+0000 7fdc7effd640 1 -- 172.21.15.78:0/2373512644 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdc8014da80 msgr2=0x7fdc8014cd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:27.036 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.991+0000 7fdc7effd640 1 --2- 172.21.15.78:0/2373512644 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdc8014da80 0x7fdc8014cd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:27.036 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.991+0000 7fdc7effd640 1 -- 172.21.15.78:0/2373512644 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc70007040 con 0x7fdc800c5f60 2023-11-28T19:59:27.037 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.991+0000 7f4245ff8640 1 -- 172.21.15.78:0/365745739 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4240070720 con 0x7f42400c4090 2023-11-28T19:59:27.037 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.991+0000 7f423effd640 1 -- 172.21.15.78:0/365745739 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4240157be0 msgr2=0x7f42400aa210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:27.037 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.991+0000 7f423ffff640 1 --2- 172.21.15.78:0/365745739 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4240157be0 0x7f42400aa210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:27.037 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.991+0000 7f423effd640 1 --2- 172.21.15.78:0/365745739 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4240157be0 0x7f42400aa210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:27.037 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.991+0000 7f423effd640 1 -- 172.21.15.78:0/365745739 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f42400c0d20 msgr2=0x7f42401fdeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:27.037 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.991+0000 7f423effd640 1 --2- 172.21.15.78:0/365745739 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f42400c0d20 0x7f42401fdeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:27.038 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.991+0000 7fdc7effd640 1 --2- 172.21.15.78:0/2373512644 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdc800c5f60 0x7fdc8020c3e0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fdc74001ec0 tx=0x7fdc7400c8e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:59:27.038 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.991+0000 7f423effd640 1 -- 172.21.15.78:0/365745739 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4238009a70 con 0x7f42400c4090 2023-11-28T19:59:27.038 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.991+0000 7fcbd271d640 1 Processor -- start 2023-11-28T19:59:27.041 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.991+0000 7f423f7fe640 1 --2- 172.21.15.78:0/365745739 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f42400c0d20 0x7f42401fdeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T19:59:27.041 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.991+0000 7f3ad1145640 1 --2- 172.21.15.78:0/575914605 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3ac40dbcb0 0x7f3ac403f540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T19:59:27.041 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.991+0000 7f3ad1946640 1 --2- 172.21.15.78:0/575914605 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3ac400b090 0x7f3ac4177910 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f3abc00c7f0 tx=0x7f3abc00ccb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:59:27.042 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.991+0000 7fdc67fff640 1 -- 172.21.15.78:0/2373512644 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc740054e0 con 0x7fdc800c5f60 2023-11-28T19:59:27.042 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.991+0000 7f3278ff9640 1 -- 172.21.15.78:0/968106056 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f3268050540 con 0x7f327400b090 2023-11-28T19:59:27.042 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.991+0000 7f423ffff640 1 --2- 172.21.15.78:0/365745739 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4240157be0 0x7f42400aa210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T19:59:27.042 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.991+0000 7f07ecef1640 1 -- 172.21.15.78:0/1116165493 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07d80ab600 con 0x7f07e80c47b0 2023-11-28T19:59:27.043 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.991+0000 7f3ac27fc640 1 -- 172.21.15.78:0/575914605 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3abc0077c0 con 0x7f3ac400b090 2023-11-28T19:59:27.043 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.991+0000 7f423effd640 1 --2- 172.21.15.78:0/365745739 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f42400c4090 0x7f42400a5f10 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f423400e910 tx=0x7f423400edd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:59:27.043 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.991+0000 7f3ac27fc640 1 -- 172.21.15.78:0/575914605 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3abc007920 con 0x7f3ac400b090 2023-11-28T19:59:27.044 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.991+0000 7f3ac27fc640 1 -- 172.21.15.78:0/575914605 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3abc007cd0 con 0x7f3ac400b090 2023-11-28T19:59:27.044 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.991+0000 7f3ad2948640 1 -- 172.21.15.78:0/575914605 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3ac40e8e90 con 0x7f3ac400b090 2023-11-28T19:59:27.044 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.991+0000 7fdc85e79640 1 -- 172.21.15.78:0/2373512644 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdc80072b70 con 0x7fdc800c5f60 2023-11-28T19:59:27.044 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.991+0000 7fdc85e79640 1 -- 172.21.15.78:0/2373512644 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdc8020f090 con 0x7fdc800c5f60 2023-11-28T19:59:27.044 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.991+0000 7f07ecef1640 1 -- 172.21.15.78:0/1116165493 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f07d80a7050 con 0x7f07e80c47b0 2023-11-28T19:59:27.045 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.991+0000 7f07ecef1640 1 -- 172.21.15.78:0/1116165493 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07d80ab980 con 0x7f07e80c47b0 2023-11-28T19:59:27.045 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.991+0000 7f3ad2948640 1 -- 172.21.15.78:0/575914605 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3ac40419d0 con 0x7f3ac400b090 2023-11-28T19:59:27.045 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.991+0000 7fdc67fff640 1 -- 172.21.15.78:0/2373512644 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc74003600 con 0x7fdc800c5f60 2023-11-28T19:59:27.045 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.991+0000 7fdc67fff640 1 -- 172.21.15.78:0/2373512644 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc74003990 con 0x7fdc800c5f60 2023-11-28T19:59:27.045 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.991+0000 7fd01d7fa640 1 -- 172.21.15.78:0/3174532243 <== mon.2 v2:172.21.15.179:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fd010051800 con 0x7fd020147d30 2023-11-28T19:59:27.046 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.991+0000 7fcbd271d640 1 -- start start 2023-11-28T19:59:27.046 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.991+0000 7fcbd271d640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcbcc0c0430 0x7fcbcc0a4180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:27.046 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.991+0000 7f4227fff640 1 -- 172.21.15.78:0/365745739 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f423400ca00 con 0x7f42400c4090 2023-11-28T19:59:27.046 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.991+0000 7f4227fff640 1 -- 172.21.15.78:0/365745739 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f423400cb60 con 0x7f42400c4090 2023-11-28T19:59:27.047 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.991+0000 7f4227fff640 1 -- 172.21.15.78:0/365745739 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f423400ced0 con 0x7f42400c4090 2023-11-28T19:59:27.047 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.995+0000 7f4245ff8640 1 -- 172.21.15.78:0/365745739 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f42400a6680 con 0x7f42400c4090 2023-11-28T19:59:27.047 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.995+0000 7f4245ff8640 1 -- 172.21.15.78:0/365745739 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f42400700d0 con 0x7f42400c4090 2023-11-28T19:59:27.047 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.995+0000 7f3ad2948640 1 -- 172.21.15.78:0/575914605 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3ab4005260 con 0x7f3ac400b090 2023-11-28T19:59:27.048 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.995+0000 7f07f0157640 1 -- 172.21.15.78:0/1116165493 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f07e80c47b0 msgr2=0x7f07e80c4b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:27.048 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.995+0000 7f07f0157640 1 --2- 172.21.15.78:0/1116165493 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f07e80c47b0 0x7f07e80c4b90 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f07d80097c0 tx=0x7f07d801c3f0 comp rx=0 tx=0).stop 2023-11-28T19:59:27.048 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.995+0000 7f233b7fe640 1 --2- 172.21.15.78:0/3108456751 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f23440c2110 0x7f23440c5ca0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f232c009870 tx=0x7f232c01c580 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c02410777edcfcf9 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:59:27.048 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.995+0000 7f07f0157640 1 -- 172.21.15.78:0/1116165493 shutdown_connections 2023-11-28T19:59:27.049 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.995+0000 7f07f0157640 1 --2- 172.21.15.78:0/1116165493 >> v2:172.21.15.78:3300/0 conn(0x7f07e80bd550 0x7f07e8155950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:27.049 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.995+0000 7fcbd271d640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcbcc0c5f80 0x7fcbcc145c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:27.049 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.995+0000 7fcbd271d640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcbcc14dce0 0x7fcbcc0a2670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:27.049 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.995+0000 7fcbd271d640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcbcc0a46c0 con 0x7fcbcc0c5f80 2023-11-28T19:59:27.049 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.995+0000 7fcbd271d640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcbcc0a33c0 con 0x7fcbcc14dce0 2023-11-28T19:59:27.049 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.995+0000 7fcbd271d640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcbcc0a36a0 con 0x7fcbcc0c0430 2023-11-28T19:59:27.050 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.995+0000 7f07f0157640 1 --2- 172.21.15.78:0/1116165493 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f07e80c47b0 0x7f07e80c4b90 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:27.050 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.995+0000 7f07f0157640 1 -- 172.21.15.78:0/1116165493 >> 172.21.15.78:0/1116165493 conn(0x7f07e80aba00 msgr2=0x7f07e80abe10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T19:59:27.050 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.995+0000 7fcbcbfff640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcbcc0c0430 0x7fcbcc0a4180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:27.050 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.995+0000 7fcbcbfff640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcbcc0c0430 0x7fcbcc0a4180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3301/0 says I am v2:172.21.15.78:47968/0 (socket says 172.21.15.78:47968) 2023-11-28T19:59:27.050 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.995+0000 7fcbcbfff640 1 -- 172.21.15.78:0/4087000157 learned_addr learned my addr 172.21.15.78:0/4087000157 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T19:59:27.050 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.995+0000 7fcbd0cba640 1 --2- 172.21.15.78:0/4087000157 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcbcc14dce0 0x7fcbcc0a2670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:27.050 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.995+0000 7fcbcb7fe640 1 --2- 172.21.15.78:0/4087000157 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcbcc0c5f80 0x7fcbcc145c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:27.051 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.995+0000 7f07f0157640 1 -- 172.21.15.78:0/1116165493 shutdown_connections 2023-11-28T19:59:27.051 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.995+0000 7fcbcbfff640 1 -- 172.21.15.78:0/4087000157 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcbcc14dce0 msgr2=0x7fcbcc0a2670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:27.051 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.995+0000 7f3ac27fc640 1 -- 172.21.15.78:0/575914605 <== mon.2 v2:172.21.15.179:3301/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f3abc0113f0 con 0x7f3ac400b090 2023-11-28T19:59:27.052 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.995+0000 7fcbcbfff640 1 --2- 172.21.15.78:0/4087000157 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcbcc14dce0 0x7fcbcc0a2670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:27.052 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.995+0000 7fcbcbfff640 1 -- 172.21.15.78:0/4087000157 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcbcc0c5f80 msgr2=0x7fcbcc145c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:27.052 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.995+0000 7fcbcbfff640 1 --2- 172.21.15.78:0/4087000157 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcbcc0c5f80 0x7fcbcc145c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:27.052 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.995+0000 7fcbcbfff640 1 -- 172.21.15.78:0/4087000157 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcbc00094d0 con 0x7fcbcc0c0430 2023-11-28T19:59:27.052 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.995+0000 7fcbd0cba640 1 --2- 172.21.15.78:0/4087000157 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcbcc14dce0 0x7fcbcc0a2670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T19:59:27.052 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.995+0000 7fcbcbfff640 1 --2- 172.21.15.78:0/4087000157 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcbcc0c0430 0x7fcbcc0a4180 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fcbc400ba50 tx=0x7fcbc400bf10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:59:27.053 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.995+0000 7f4245ff8640 1 -- 172.21.15.78:0/365745739 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4240067630 con 0x7f42400c4090 2023-11-28T19:59:27.053 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.995+0000 7f07f0157640 1 -- 172.21.15.78:0/1116165493 wait complete. 2023-11-28T19:59:27.053 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.995+0000 7f23437fe640 1 -- 172.21.15.78:0/3108456751 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f232c0ab640 con 0x7f23440c2110 2023-11-28T19:59:27.054 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.995+0000 7f23437fe640 1 -- 172.21.15.78:0/3108456751 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f232c0a7070 con 0x7f23440c2110 2023-11-28T19:59:27.054 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.995+0000 7f23437fe640 1 -- 172.21.15.78:0/3108456751 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f232c0ab9a0 con 0x7f23440c2110 2023-11-28T19:59:27.054 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.995+0000 7f234a357640 1 -- 172.21.15.78:0/3108456751 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f23440c2110 msgr2=0x7f23440c5ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:27.054 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.995+0000 7f234a357640 1 --2- 172.21.15.78:0/3108456751 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f23440c2110 0x7f23440c5ca0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f232c009870 tx=0x7f232c01c580 comp rx=0 tx=0).stop 2023-11-28T19:59:27.054 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.995+0000 7f234a357640 1 -- 172.21.15.78:0/3108456751 shutdown_connections 2023-11-28T19:59:27.054 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.995+0000 7f234a357640 1 --2- 172.21.15.78:0/3108456751 >> v2:172.21.15.78:3300/0 conn(0x7f23440c0c80 0x7f23440c61e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:27.054 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.995+0000 7f234a357640 1 --2- 172.21.15.78:0/3108456751 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f23440c2110 0x7f23440c5ca0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:27.054 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.995+0000 7f234a357640 1 -- 172.21.15.78:0/3108456751 >> 172.21.15.78:0/3108456751 conn(0x7f234406b220 msgr2=0x7f23440a77e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T19:59:27.054 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.995+0000 7f234a357640 1 -- 172.21.15.78:0/3108456751 shutdown_connections 2023-11-28T19:59:27.054 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.995+0000 7f234a357640 1 -- 172.21.15.78:0/3108456751 wait complete. 2023-11-28T19:59:27.055 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.999+0000 7f3ac27fc640 1 --2- 172.21.15.78:0/575914605 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f3ab00664a0 0x7f3ab0068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:27.055 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.995+0000 7fdc85e79640 1 -- 172.21.15.78:0/2373512644 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdc60005260 con 0x7fdc800c5f60 2023-11-28T19:59:27.055 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.999+0000 7f3ac27fc640 1 -- 172.21.15.78:0/575914605 <== mon.2 v2:172.21.15.179:3301/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f3abc084420 con 0x7f3ac400b090 2023-11-28T19:59:27.056 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.999+0000 7fdc67fff640 1 -- 172.21.15.78:0/2373512644 <== mon.2 v2:172.21.15.179:3301/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fdc74003af0 con 0x7fdc800c5f60 2023-11-28T19:59:27.056 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.999+0000 7f07f0157640 1 Processor -- start 2023-11-28T19:59:27.056 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.999+0000 7f07f0157640 1 -- start start 2023-11-28T19:59:27.056 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.999+0000 7f4227fff640 1 -- 172.21.15.78:0/365745739 <== mon.2 v2:172.21.15.179:3301/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f4234013470 con 0x7f42400c4090 2023-11-28T19:59:27.057 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.999+0000 7fdc67fff640 1 --2- 172.21.15.78:0/2373512644 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fdc6c0664a0 0x7fdc6c068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:27.057 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.999+0000 7fdc67fff640 1 -- 172.21.15.78:0/2373512644 <== mon.2 v2:172.21.15.179:3301/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fdc74083610 con 0x7fdc800c5f60 2023-11-28T19:59:27.057 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.999+0000 7fdc7f7fe640 1 --2- 172.21.15.78:0/2373512644 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fdc6c0664a0 0x7fdc6c068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:27.058 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.999+0000 7f07f0157640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f07e80bd550 0x7f07e80c03e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:27.058 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.999+0000 7f07f0157640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f07e80c47b0 0x7f07e80be430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:27.058 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.999+0000 7fcbc8ff9640 1 -- 172.21.15.78:0/4087000157 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbc400cc10 con 0x7fcbcc0c0430 2023-11-28T19:59:27.058 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.999+0000 7f07f0157640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f07e8154ee0 0x7f07e80be970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:27.058 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.999+0000 7f07edef3640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f07e80bd550 0x7f07e80c03e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:27.059 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.999+0000 7f07f0157640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07e8154af0 con 0x7f07e80c47b0 2023-11-28T19:59:27.059 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.999+0000 7f4227fff640 1 --2- 172.21.15.78:0/365745739 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f422c066540 0x7f422c068a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:27.059 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:27.003+0000 7f4227fff640 1 -- 172.21.15.78:0/365745739 <== mon.2 v2:172.21.15.179:3301/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f42340842f0 con 0x7f42400c4090 2023-11-28T19:59:27.059 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.999+0000 7f07f0157640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07e80c3ed0 con 0x7f07e8154ee0 2023-11-28T19:59:27.059 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.999+0000 7f07f0157640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f07e80beeb0 con 0x7f07e80bd550 2023-11-28T19:59:27.059 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.999+0000 7f07edef3640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f07e80bd550 0x7f07e80c03e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3301/0 says I am v2:172.21.15.78:47970/0 (socket says 172.21.15.78:47970) 2023-11-28T19:59:27.060 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:26.999+0000 7f07edef3640 1 -- 172.21.15.78:0/821989302 learned_addr learned my addr 172.21.15.78:0/821989302 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T19:59:27.060 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:27.003+0000 7fdc7f7fe640 1 --2- 172.21.15.78:0/2373512644 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fdc6c0664a0 0x7fdc6c068960 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fdc700af000 tx=0x7fdc700a8000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:59:27.060 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:27.003+0000 7f3ad1145640 1 --2- 172.21.15.78:0/575914605 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f3ab00664a0 0x7f3ab0068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:27.060 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:27.003+0000 7f3ac27fc640 1 -- 172.21.15.78:0/575914605 <== mon.2 v2:172.21.15.179:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f3abc0515c0 con 0x7f3ac400b090 2023-11-28T19:59:27.061 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:27.003+0000 7fcbd271d640 1 -- 172.21.15.78:0/4087000157 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcbcc0a3980 con 0x7fcbcc0c0430 2023-11-28T19:59:27.061 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:27.003+0000 7fcbd271d640 1 -- 172.21.15.78:0/4087000157 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcbcc1461d0 con 0x7fcbcc0c0430 2023-11-28T19:59:27.061 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:27.003+0000 7f07edef3640 1 -- 172.21.15.78:0/821989302 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f07e8154ee0 msgr2=0x7f07e80be970 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-11-28T19:59:27.061 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:27.003+0000 7f07edef3640 1 --2- 172.21.15.78:0/821989302 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f07e8154ee0 0x7f07e80be970 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:27.061 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:27.003+0000 7f07edef3640 1 -- 172.21.15.78:0/821989302 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f07e80c47b0 msgr2=0x7f07e80be430 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-11-28T19:59:27.062 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:27.003+0000 7f07edef3640 1 --2- 172.21.15.78:0/821989302 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f07e80c47b0 0x7f07e80be430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:27.062 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:27.003+0000 7f07edef3640 1 -- 172.21.15.78:0/821989302 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07d8009420 con 0x7f07e80bd550 2023-11-28T19:59:27.062 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:27.003+0000 7f423f7fe640 1 --2- 172.21.15.78:0/365745739 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f422c066540 0x7f422c068a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:27.062 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:27.003+0000 7f07edef3640 1 --2- 172.21.15.78:0/821989302 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f07e80bd550 0x7f07e80c03e0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f07d801a020 tx=0x7f07d8019190 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:59:27.063 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:27.003+0000 7f234a357640 1 Processor -- start 2023-11-28T19:59:27.063 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:27.003+0000 7f3ad1145640 1 --2- 172.21.15.78:0/575914605 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f3ab00664a0 0x7f3ab0068960 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f3ac4005d60 tx=0x7f3ac8009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:59:27.063 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:27.003+0000 7fcbd271d640 1 -- 172.21.15.78:0/4087000157 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcbcc0a3ea0 con 0x7fcbcc0c0430 2023-11-28T19:59:27.063 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:27.003+0000 7f234a357640 1 -- start start 2023-11-28T19:59:27.064 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:27.003+0000 7f423f7fe640 1 --2- 172.21.15.78:0/365745739 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f422c066540 0x7f422c068a00 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f4230007db0 tx=0x7f4230008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:59:27.064 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:27.003+0000 7f234a357640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f23440c0c80 0x7f2344148040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:27.064 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:27.003+0000 7f234a357640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f23440c2110 0x7f2344146c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:27.065 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:27.003+0000 7f234a357640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2344154390 0x7f23441471c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:27.065 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:27.003+0000 7f234a357640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2344149a10 con 0x7f23440c0c80 2023-11-28T19:59:27.065 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:27.003+0000 7f234a357640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23441e9a60 con 0x7f23440c2110 2023-11-28T19:59:27.065 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:27.003+0000 7f234a357640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23440726d0 con 0x7f2344154390 2023-11-28T19:59:27.065 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:27.003+0000 7f233b7fe640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f23440c2110 0x7f2344146c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:27.065 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:27.003+0000 7f233b7fe640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f23440c2110 0x7f2344146c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.78:50028/0 (socket says 172.21.15.78:50028) 2023-11-28T19:59:27.065 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:27.003+0000 7f233b7fe640 1 -- 172.21.15.78:0/3964812922 learned_addr learned my addr 172.21.15.78:0/3964812922 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T19:59:27.065 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:27.003+0000 7f23488f4640 1 --2- 172.21.15.78:0/3964812922 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2344154390 0x7f23441471c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:27.066 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:27.007+0000 7f4227fff640 1 -- 172.21.15.78:0/365745739 <== mon.2 v2:172.21.15.179:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f4234051510 con 0x7f42400c4090 2023-11-28T19:59:27.066 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:27.007+0000 7f2343fff640 1 --2- 172.21.15.78:0/3964812922 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f23440c0c80 0x7f2344148040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:27.066 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:27.007+0000 7f233b7fe640 1 -- 172.21.15.78:0/3964812922 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2344154390 msgr2=0x7f23441471c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:27.066 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:27.007+0000 7f233b7fe640 1 --2- 172.21.15.78:0/3964812922 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2344154390 0x7f23441471c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:27.066 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:27.007+0000 7f233b7fe640 1 -- 172.21.15.78:0/3964812922 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f23440c0c80 msgr2=0x7f2344148040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:27.066 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:27.007+0000 7f233b7fe640 1 --2- 172.21.15.78:0/3964812922 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f23440c0c80 0x7f2344148040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:27.067 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:27.007+0000 7f233b7fe640 1 -- 172.21.15.78:0/3964812922 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f232c0094d0 con 0x7f23440c2110 2023-11-28T19:59:27.067 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:27.011+0000 7f07de7fc640 1 -- 172.21.15.78:0/821989302 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07d80b4430 con 0x7f07e80bd550 2023-11-28T19:59:27.067 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:27.011+0000 7fcbc8ff9640 1 -- 172.21.15.78:0/4087000157 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcbc4009950 con 0x7fcbcc0c0430 2023-11-28T19:59:27.068 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:27.011+0000 7fcbc8ff9640 1 -- 172.21.15.78:0/4087000157 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbc401e440 con 0x7fcbcc0c0430 2023-11-28T19:59:27.068 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:27.011+0000 7f07de7fc640 1 -- 172.21.15.78:0/821989302 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f07d80b4590 con 0x7f07e80bd550 2023-11-28T19:59:27.068 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:27.011+0000 7f07de7fc640 1 -- 172.21.15.78:0/821989302 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07d80b4900 con 0x7f07e80bd550 2023-11-28T19:59:27.068 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:27.011+0000 7fdc67fff640 1 -- 172.21.15.78:0/2373512644 <== mon.2 v2:172.21.15.179:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fdc74050840 con 0x7fdc800c5f60 2023-11-28T19:59:27.069 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:27.011+0000 7f233b7fe640 1 --2- 172.21.15.78:0/3964812922 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f23440c2110 0x7f2344146c80 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f232c0ad040 tx=0x7f232c019320 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:59:27.069 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:27.011+0000 7f23417fa640 1 -- 172.21.15.78:0/3964812922 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f232c003ae0 con 0x7f23440c2110 2023-11-28T19:59:27.070 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:27.011+0000 7f23417fa640 1 -- 172.21.15.78:0/3964812922 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f232c003c40 con 0x7f23440c2110 2023-11-28T19:59:27.070 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:27.011+0000 7f23417fa640 1 -- 172.21.15.78:0/3964812922 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f232c0ab440 con 0x7f23440c2110 2023-11-28T19:59:27.070 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:27.011+0000 7f234a357640 1 -- 172.21.15.78:0/3964812922 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f23440729b0 con 0x7f23440c2110 2023-11-28T19:59:27.070 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:27.011+0000 7f234a357640 1 -- 172.21.15.78:0/3964812922 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f23440a6d40 con 0x7f23440c2110 2023-11-28T19:59:27.071 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:27.011+0000 7fcbc8ff9640 1 -- 172.21.15.78:0/4087000157 <== mon.2 v2:172.21.15.179:3301/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fcbc4014440 con 0x7fcbcc0c0430 2023-11-28T19:59:27.071 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:27.011+0000 7f234a357640 1 -- 172.21.15.78:0/3964812922 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2344072b40 con 0x7f23440c2110 2023-11-28T19:59:27.071 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:27.015+0000 7fcbc8ff9640 1 --2- 172.21.15.78:0/4087000157 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fcbb8066470 0x7fcbb8068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:27.072 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:27.015+0000 7f07f0157640 1 -- 172.21.15.78:0/821989302 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f07e8155470 con 0x7f07e80bd550 2023-11-28T19:59:27.072 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:27.015+0000 7f07f0157640 1 -- 172.21.15.78:0/821989302 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f07e81ed720 con 0x7f07e80bd550 2023-11-28T19:59:27.072 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:27.015+0000 7f07f0157640 1 -- 172.21.15.78:0/821989302 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f07e8067630 con 0x7f07e80bd550 2023-11-28T19:59:27.072 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:27.015+0000 7fcbcb7fe640 1 --2- 172.21.15.78:0/4087000157 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fcbb8066470 0x7fcbb8068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:27.073 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:27.015+0000 7f23417fa640 1 -- 172.21.15.78:0/3964812922 <== mon.1 v2:172.21.15.179:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f232c0ab5a0 con 0x7f23440c2110 2023-11-28T19:59:27.073 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:27.015+0000 7f23417fa640 1 --2- 172.21.15.78:0/3964812922 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f23240664a0 0x7f2324068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:27.073 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:27.015+0000 7f23417fa640 1 -- 172.21.15.78:0/3964812922 <== mon.1 v2:172.21.15.179:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f232c11dfc0 con 0x7f23440c2110 2023-11-28T19:59:27.073 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:27.019+0000 7f2343fff640 1 --2- 172.21.15.78:0/3964812922 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f23240664a0 0x7f2324068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:27.073 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:27.019+0000 7fcbc8ff9640 1 -- 172.21.15.78:0/4087000157 <== mon.2 v2:172.21.15.179:3301/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fcbc40846c0 con 0x7fcbcc0c0430 2023-11-28T19:59:27.074 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:27.019+0000 7fcbc8ff9640 1 -- 172.21.15.78:0/4087000157 <== mon.2 v2:172.21.15.179:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fcbc4084a50 con 0x7fcbcc0c0430 2023-11-28T19:59:27.074 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:27.019+0000 7f2343fff640 1 --2- 172.21.15.78:0/3964812922 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f23240664a0 0x7f2324068960 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f2334007fd0 tx=0x7f2334009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:59:27.074 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:27.019+0000 7f07de7fc640 1 -- 172.21.15.78:0/821989302 <== mon.2 v2:172.21.15.179:3301/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f07d80b2040 con 0x7f07e80bd550 2023-11-28T19:59:27.074 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:27.019+0000 7f07de7fc640 1 --2- 172.21.15.78:0/821989302 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f07cc0664a0 0x7f07cc068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:27.075 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:27.019+0000 7f07de7fc640 1 -- 172.21.15.78:0/821989302 <== mon.2 v2:172.21.15.179:3301/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f07d811e910 con 0x7f07e80bd550 2023-11-28T19:59:27.075 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:27.019+0000 7fcbcb7fe640 1 --2- 172.21.15.78:0/4087000157 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fcbb8066470 0x7fcbb8068930 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fcbc00af000 tx=0x7fcbc0008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:59:27.075 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:27.019+0000 7f07ed6f2640 1 --2- 172.21.15.78:0/821989302 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f07cc0664a0 0x7f07cc068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:27.076 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:27.019+0000 7f07de7fc640 1 -- 172.21.15.78:0/821989302 <== mon.2 v2:172.21.15.179:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f07d80ebb10 con 0x7f07e80bd550 2023-11-28T19:59:27.076 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:27.023+0000 7f07ed6f2640 1 --2- 172.21.15.78:0/821989302 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f07cc0664a0 0x7f07cc068960 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f07e80aa050 tx=0x7f07e4008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:59:27.076 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:27.023+0000 7f23417fa640 1 -- 172.21.15.78:0/3964812922 <== mon.1 v2:172.21.15.179:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f232c0eb160 con 0x7f23440c2110 2023-11-28T19:59:27.317 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:27.311+0000 7fd026eea640 1 -- 172.21.15.78:0/3174532243 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fd000005510 con 0x7fd020147d30 2023-11-28T19:59:27.318 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:27.311+0000 7fd01d7fa640 1 -- 172.21.15.78:0/3174532243 <== mon.2 v2:172.21.15.179:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fd010054e20 con 0x7fd020147d30 2023-11-28T19:59:27.319 INFO:teuthology.orchestra.run.smithi078.stdout:55834574857 2023-11-28T19:59:27.321 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:27.315+0000 7f3281396640 1 -- 172.21.15.78:0/968106056 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7f325c0057e0 con 0x7f327400b090 2023-11-28T19:59:27.322 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:27.315+0000 7f3278ff9640 1 -- 172.21.15.78:0/968106056 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f3268017030 con 0x7f327400b090 2023-11-28T19:59:27.323 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:27.319+0000 7fd026eea640 1 -- 172.21.15.78:0/3174532243 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fd00c066540 msgr2=0x7fd00c068a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:27.323 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:27.319+0000 7fd026eea640 1 --2- 172.21.15.78:0/3174532243 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fd00c066540 0x7fd00c068a00 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fd0200732e0 tx=0x7fd0180083b0 comp rx=0 tx=0).stop 2023-11-28T19:59:27.323 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:27.319+0000 7fd026eea640 1 -- 172.21.15.78:0/3174532243 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd020147d30 msgr2=0x7fd020072040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:27.323 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:27.319+0000 7fd026eea640 1 --2- 172.21.15.78:0/3174532243 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd020147d30 0x7fd020072040 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fd020072d70 tx=0x7fd010011cf0 comp rx=0 tx=0).stop 2023-11-28T19:59:27.324 INFO:teuthology.orchestra.run.smithi078.stdout:55834574856 2023-11-28T19:59:27.324 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:27.319+0000 7fd026eea640 1 -- 172.21.15.78:0/3174532243 shutdown_connections 2023-11-28T19:59:27.324 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:27.319+0000 7fd026eea640 1 --2- 172.21.15.78:0/3174532243 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fd00c066540 0x7fd00c068a00 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:27.325 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:27.319+0000 7fd026eea640 1 --2- 172.21.15.78:0/3174532243 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd020147d30 0x7fd020072040 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:27.325 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:27.319+0000 7fd026eea640 1 --2- 172.21.15.78:0/3174532243 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd0201edc20 0x7fd0201477f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:27.325 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:27.319+0000 7fd026eea640 1 --2- 172.21.15.78:0/3174532243 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd0080047d0 0x7fd020148200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:27.325 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:27.319+0000 7fd026eea640 1 -- 172.21.15.78:0/3174532243 >> 172.21.15.78:0/3174532243 conn(0x7fd02006ad70 msgr2=0x7fd020152dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T19:59:27.325 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:27.319+0000 7fd026eea640 1 -- 172.21.15.78:0/3174532243 shutdown_connections 2023-11-28T19:59:27.326 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:27.319+0000 7fd026eea640 1 -- 172.21.15.78:0/3174532243 wait complete. 2023-11-28T19:59:27.326 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:27.319+0000 7f3281396640 1 -- 172.21.15.78:0/968106056 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f32600664d0 msgr2=0x7f3260068990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:27.327 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:27.319+0000 7f3281396640 1 --2- 172.21.15.78:0/968106056 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f32600664d0 0x7f3260068990 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f327c050190 tx=0x7f327c06d040 comp rx=0 tx=0).stop 2023-11-28T19:59:27.327 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:27.319+0000 7f3281396640 1 -- 172.21.15.78:0/968106056 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f327400b090 msgr2=0x7f32740da890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:27.327 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:27.319+0000 7f3281396640 1 --2- 172.21.15.78:0/968106056 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f327400b090 0x7f32740da890 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f326800c4d0 tx=0x7f326800c990 comp rx=0 tx=0).stop 2023-11-28T19:59:27.327 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:27.319+0000 7f3281396640 1 -- 172.21.15.78:0/968106056 shutdown_connections 2023-11-28T19:59:27.327 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:27.319+0000 7f3281396640 1 --2- 172.21.15.78:0/968106056 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f32600664d0 0x7f3260068990 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:27.328 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:27.319+0000 7f3281396640 1 --2- 172.21.15.78:0/968106056 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f32740df400 0x7f327417a3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:27.328 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:27.323+0000 7f3281396640 1 --2- 172.21.15.78:0/968106056 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f32740dbcb0 0x7f32740dadd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:27.328 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:27.323+0000 7f3281396640 1 --2- 172.21.15.78:0/968106056 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f327400b090 0x7f32740da890 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:27.328 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:27.323+0000 7f3281396640 1 -- 172.21.15.78:0/968106056 >> 172.21.15.78:0/968106056 conn(0x7f3274048230 msgr2=0x7f327404ae60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T19:59:27.328 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:27.323+0000 7f3281396640 1 -- 172.21.15.78:0/968106056 shutdown_connections 2023-11-28T19:59:27.328 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:27.323+0000 7f3281396640 1 -- 172.21.15.78:0/968106056 wait complete. 2023-11-28T19:59:27.333 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:27.327+0000 7f3ad2948640 1 -- 172.21.15.78:0/575914605 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7f3ab4005510 con 0x7f3ac400b090 2023-11-28T19:59:27.334 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:27.327+0000 7f3ac27fc640 1 -- 172.21.15.78:0/575914605 <== mon.2 v2:172.21.15.179:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f3abc054be0 con 0x7f3ac400b090 2023-11-28T19:59:27.334 INFO:teuthology.orchestra.run.smithi078.stdout:55834574857 2023-11-28T19:59:27.337 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:27.331+0000 7f3ad2948640 1 -- 172.21.15.78:0/575914605 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f3ab00664a0 msgr2=0x7f3ab0068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:27.337 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:27.331+0000 7f3ad2948640 1 --2- 172.21.15.78:0/575914605 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f3ab00664a0 0x7f3ab0068960 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f3ac4005d60 tx=0x7f3ac8009040 comp rx=0 tx=0).stop 2023-11-28T19:59:27.337 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:27.331+0000 7f3ad2948640 1 -- 172.21.15.78:0/575914605 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3ac400b090 msgr2=0x7f3ac4177910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:27.337 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:27.331+0000 7f3ad2948640 1 --2- 172.21.15.78:0/575914605 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3ac400b090 0x7f3ac4177910 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f3abc00c7f0 tx=0x7f3abc00ccb0 comp rx=0 tx=0).stop 2023-11-28T19:59:27.339 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:27.331+0000 7f4245ff8640 1 -- 172.21.15.78:0/365745739 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f42400c3d60 con 0x7f42400c4090 2023-11-28T19:59:27.339 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:27.331+0000 7f4227fff640 1 -- 172.21.15.78:0/365745739 <== mon.2 v2:172.21.15.179:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f4234054b30 con 0x7f42400c4090 2023-11-28T19:59:27.339 INFO:teuthology.orchestra.run.smithi078.stdout:55834574855 2023-11-28T19:59:27.340 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:27.335+0000 7f3ad2948640 1 -- 172.21.15.78:0/575914605 shutdown_connections 2023-11-28T19:59:27.340 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:27.335+0000 7f3ad2948640 1 --2- 172.21.15.78:0/575914605 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f3ab00664a0 0x7f3ab0068960 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:27.340 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:27.335+0000 7f3ad2948640 1 --2- 172.21.15.78:0/575914605 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3ac40decf0 0x7f3ac40d5610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:27.340 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:27.335+0000 7f3ad2948640 1 --2- 172.21.15.78:0/575914605 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3ac40dbcb0 0x7f3ac403f540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:27.341 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:27.335+0000 7f3ad2948640 1 --2- 172.21.15.78:0/575914605 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3ac400b090 0x7f3ac4177910 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:27.341 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:27.335+0000 7f3ad2948640 1 -- 172.21.15.78:0/575914605 >> 172.21.15.78:0/575914605 conn(0x7f3ac4048230 msgr2=0x7f3ac4048610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T19:59:27.341 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:27.335+0000 7f3ad2948640 1 -- 172.21.15.78:0/575914605 shutdown_connections 2023-11-28T19:59:27.341 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:27.335+0000 7f3ad2948640 1 -- 172.21.15.78:0/575914605 wait complete. 2023-11-28T19:59:27.342 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:27.335+0000 7f4245ff8640 1 -- 172.21.15.78:0/365745739 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f422c066540 msgr2=0x7f422c068a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:27.342 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:27.335+0000 7f4245ff8640 1 --2- 172.21.15.78:0/365745739 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f422c066540 0x7f422c068a00 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f4230007db0 tx=0x7f4230008040 comp rx=0 tx=0).stop 2023-11-28T19:59:27.343 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:27.335+0000 7f4245ff8640 1 -- 172.21.15.78:0/365745739 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f42400c4090 msgr2=0x7f42400a5f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:27.343 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:27.335+0000 7f4245ff8640 1 --2- 172.21.15.78:0/365745739 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f42400c4090 0x7f42400a5f10 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f423400e910 tx=0x7f423400edd0 comp rx=0 tx=0).stop 2023-11-28T19:59:27.343 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:27.335+0000 7f4245ff8640 1 -- 172.21.15.78:0/365745739 shutdown_connections 2023-11-28T19:59:27.343 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:27.335+0000 7f4245ff8640 1 --2- 172.21.15.78:0/365745739 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f422c066540 0x7f422c068a00 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:27.344 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:27.335+0000 7f4245ff8640 1 --2- 172.21.15.78:0/365745739 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f42400c4090 0x7f42400a5f10 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:27.344 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:27.335+0000 7f4245ff8640 1 --2- 172.21.15.78:0/365745739 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4240157be0 0x7f42400aa210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:27.344 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:27.335+0000 7f4245ff8640 1 --2- 172.21.15.78:0/365745739 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f42400c0d20 0x7f42401fdeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:27.344 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:27.335+0000 7f4245ff8640 1 -- 172.21.15.78:0/365745739 >> 172.21.15.78:0/365745739 conn(0x7f424006ad70 msgr2=0x7f424006cdc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T19:59:27.344 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:27.335+0000 7f4245ff8640 1 -- 172.21.15.78:0/365745739 shutdown_connections 2023-11-28T19:59:27.344 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:27.335+0000 7f4245ff8640 1 -- 172.21.15.78:0/365745739 wait complete. 2023-11-28T19:59:27.346 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:27.339+0000 7fdc85e79640 1 -- 172.21.15.78:0/2373512644 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7fdc60005510 con 0x7fdc800c5f60 2023-11-28T19:59:27.346 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:27.339+0000 7fdc67fff640 1 -- 172.21.15.78:0/2373512644 <== mon.2 v2:172.21.15.179:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fdc74017090 con 0x7fdc800c5f60 2023-11-28T19:59:27.346 INFO:teuthology.orchestra.run.smithi078.stdout:55834574857 2023-11-28T19:59:27.348 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:27.343+0000 7fdc85e79640 1 -- 172.21.15.78:0/2373512644 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fdc6c0664a0 msgr2=0x7fdc6c068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:27.348 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:27.343+0000 7fdc85e79640 1 --2- 172.21.15.78:0/2373512644 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fdc6c0664a0 0x7fdc6c068960 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fdc700af000 tx=0x7fdc700a8000 comp rx=0 tx=0).stop 2023-11-28T19:59:27.348 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:27.343+0000 7fdc85e79640 1 -- 172.21.15.78:0/2373512644 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdc800c5f60 msgr2=0x7fdc8020c3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:27.349 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:27.343+0000 7fdc85e79640 1 --2- 172.21.15.78:0/2373512644 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdc800c5f60 0x7fdc8020c3e0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fdc74001ec0 tx=0x7fdc7400c8e0 comp rx=0 tx=0).stop 2023-11-28T19:59:27.349 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:27.343+0000 7fcbd271d640 1 -- 172.21.15.78:0/4087000157 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fcbcc0a37e0 con 0x7fcbcc0c0430 2023-11-28T19:59:27.350 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:27.343+0000 7fdc85e79640 1 -- 172.21.15.78:0/2373512644 shutdown_connections 2023-11-28T19:59:27.350 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:27.343+0000 7fdc85e79640 1 --2- 172.21.15.78:0/2373512644 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fdc6c0664a0 0x7fdc6c068960 secure :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fdc700af000 tx=0x7fdc700a8000 comp rx=0 tx=0).stop 2023-11-28T19:59:27.350 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:27.343+0000 7fdc85e79640 1 --2- 172.21.15.78:0/2373512644 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdc800c5f60 0x7fdc8020c3e0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:27.350 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:27.343+0000 7fdc85e79640 1 --2- 172.21.15.78:0/2373512644 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdc8014da80 0x7fdc8014cd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:27.350 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:27.343+0000 7fdc85e79640 1 --2- 172.21.15.78:0/2373512644 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdc8006bf50 0x7fdc8020e710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:27.350 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:27.343+0000 7fdc85e79640 1 -- 172.21.15.78:0/2373512644 >> 172.21.15.78:0/2373512644 conn(0x7fdc8006b220 msgr2=0x7fdc801521f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T19:59:27.351 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:27.343+0000 7fdc85e79640 1 -- 172.21.15.78:0/2373512644 shutdown_connections 2023-11-28T19:59:27.351 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:27.343+0000 7fdc85e79640 1 -- 172.21.15.78:0/2373512644 wait complete. 2023-11-28T19:59:27.351 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:27.343+0000 7f07f0157640 1 -- 172.21.15.78:0/821989302 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f07e80c41f0 con 0x7f07e80bd550 2023-11-28T19:59:27.354 INFO:teuthology.orchestra.run.smithi078.stdout:55834574857 2023-11-28T19:59:27.354 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:27.343+0000 7fcbc8ff9640 1 -- 172.21.15.78:0/4087000157 <== mon.2 v2:172.21.15.179:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fcbc4019020 con 0x7fcbcc0c0430 2023-11-28T19:59:27.355 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:27.347+0000 7f07de7fc640 1 -- 172.21.15.78:0/821989302 <== mon.2 v2:172.21.15.179:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f07d80ef130 con 0x7f07e80bd550 2023-11-28T19:59:27.355 INFO:teuthology.orchestra.run.smithi078.stdout:55834574856 2023-11-28T19:59:27.358 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:27.351+0000 7f07f0157640 1 -- 172.21.15.78:0/821989302 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f07cc0664a0 msgr2=0x7f07cc068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:27.358 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:27.351+0000 7f07f0157640 1 --2- 172.21.15.78:0/821989302 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f07cc0664a0 0x7f07cc068960 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f07e80aa050 tx=0x7f07e4008040 comp rx=0 tx=0).stop 2023-11-28T19:59:27.358 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:27.351+0000 7f07f0157640 1 -- 172.21.15.78:0/821989302 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f07e80bd550 msgr2=0x7f07e80c03e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:27.358 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:27.351+0000 7f07f0157640 1 --2- 172.21.15.78:0/821989302 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f07e80bd550 0x7f07e80c03e0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f07d801a020 tx=0x7f07d8019190 comp rx=0 tx=0).stop 2023-11-28T19:59:27.358 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:27.351+0000 7f07f0157640 1 -- 172.21.15.78:0/821989302 shutdown_connections 2023-11-28T19:59:27.358 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:27.351+0000 7f07f0157640 1 --2- 172.21.15.78:0/821989302 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f07cc0664a0 0x7f07cc068960 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:27.358 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:27.351+0000 7f07f0157640 1 --2- 172.21.15.78:0/821989302 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f07e8154ee0 0x7f07e80be970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:27.358 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:27.351+0000 7f07f0157640 1 --2- 172.21.15.78:0/821989302 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f07e80c47b0 0x7f07e80be430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:27.358 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:27.351+0000 7f07f0157640 1 --2- 172.21.15.78:0/821989302 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f07e80bd550 0x7f07e80c03e0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:27.359 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:27.351+0000 7f07f0157640 1 -- 172.21.15.78:0/821989302 >> 172.21.15.78:0/821989302 conn(0x7f07e80aba00 msgr2=0x7f07e80c9340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T19:59:27.359 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:27.351+0000 7fcbd271d640 1 -- 172.21.15.78:0/4087000157 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fcbb8066470 msgr2=0x7fcbb8068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:27.359 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:27.351+0000 7fcbd271d640 1 --2- 172.21.15.78:0/4087000157 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fcbb8066470 0x7fcbb8068930 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fcbc00af000 tx=0x7fcbc0008040 comp rx=0 tx=0).stop 2023-11-28T19:59:27.359 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:27.351+0000 7f234a357640 1 -- 172.21.15.78:0/3964812922 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7f2344067630 con 0x7f23440c2110 2023-11-28T19:59:27.360 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:27.351+0000 7fcbd271d640 1 -- 172.21.15.78:0/4087000157 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcbcc0c0430 msgr2=0x7fcbcc0a4180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:27.360 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:27.351+0000 7fcbd271d640 1 --2- 172.21.15.78:0/4087000157 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcbcc0c0430 0x7fcbcc0a4180 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fcbc400ba50 tx=0x7fcbc400bf10 comp rx=0 tx=0).stop 2023-11-28T19:59:27.360 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:27.351+0000 7f23417fa640 1 -- 172.21.15.78:0/3964812922 <== mon.1 v2:172.21.15.179:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f232c0ee780 con 0x7f23440c2110 2023-11-28T19:59:27.360 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:27.351+0000 7fcbd271d640 1 -- 172.21.15.78:0/4087000157 shutdown_connections 2023-11-28T19:59:27.361 INFO:teuthology.orchestra.run.smithi078.stdout:55834574855 2023-11-28T19:59:27.362 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:27.351+0000 7fcbd271d640 1 --2- 172.21.15.78:0/4087000157 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fcbb8066470 0x7fcbb8068930 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:27.362 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:27.351+0000 7fcbd271d640 1 --2- 172.21.15.78:0/4087000157 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcbcc14dce0 0x7fcbcc0a2670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:27.362 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:27.351+0000 7fcbd271d640 1 --2- 172.21.15.78:0/4087000157 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcbcc0c5f80 0x7fcbcc145c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:27.362 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:27.351+0000 7fcbd271d640 1 --2- 172.21.15.78:0/4087000157 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcbcc0c0430 0x7fcbcc0a4180 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:27.362 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:27.351+0000 7fcbd271d640 1 -- 172.21.15.78:0/4087000157 >> 172.21.15.78:0/4087000157 conn(0x7fcbcc06ad70 msgr2=0x7fcbcc0a77c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T19:59:27.362 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:27.355+0000 7f07f0157640 1 -- 172.21.15.78:0/821989302 shutdown_connections 2023-11-28T19:59:27.363 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:27.355+0000 7fcbd271d640 1 -- 172.21.15.78:0/4087000157 shutdown_connections 2023-11-28T19:59:27.363 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:27.355+0000 7fcbd271d640 1 -- 172.21.15.78:0/4087000157 wait complete. 2023-11-28T19:59:27.363 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:27.355+0000 7f07f0157640 1 -- 172.21.15.78:0/821989302 wait complete. 2023-11-28T19:59:27.364 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574857 got 55834574856 for osd.4 2023-11-28T19:59:27.365 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:27.355+0000 7f234a357640 1 -- 172.21.15.78:0/3964812922 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f23240664a0 msgr2=0x7f2324068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:27.365 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:27.355+0000 7f234a357640 1 --2- 172.21.15.78:0/3964812922 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f23240664a0 0x7f2324068960 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f2334007fd0 tx=0x7f2334009040 comp rx=0 tx=0).stop 2023-11-28T19:59:27.365 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:27.355+0000 7f234a357640 1 -- 172.21.15.78:0/3964812922 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f23440c2110 msgr2=0x7f2344146c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:27.365 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:27.355+0000 7f234a357640 1 --2- 172.21.15.78:0/3964812922 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f23440c2110 0x7f2344146c80 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f232c0ad040 tx=0x7f232c019320 comp rx=0 tx=0).stop 2023-11-28T19:59:27.365 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:27.355+0000 7f234a357640 1 -- 172.21.15.78:0/3964812922 shutdown_connections 2023-11-28T19:59:27.366 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:27.355+0000 7f234a357640 1 --2- 172.21.15.78:0/3964812922 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f23240664a0 0x7f2324068960 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:27.366 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:27.355+0000 7f234a357640 1 --2- 172.21.15.78:0/3964812922 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2344154390 0x7f23441471c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:27.366 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:27.355+0000 7f234a357640 1 --2- 172.21.15.78:0/3964812922 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f23440c2110 0x7f2344146c80 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:27.366 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:27.355+0000 7f234a357640 1 --2- 172.21.15.78:0/3964812922 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f23440c0c80 0x7f2344148040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:27.366 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:27.355+0000 7f234a357640 1 -- 172.21.15.78:0/3964812922 >> 172.21.15.78:0/3964812922 conn(0x7f234406b220 msgr2=0x7f2344144930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T19:59:27.366 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:27.355+0000 7f234a357640 1 -- 172.21.15.78:0/3964812922 shutdown_connections 2023-11-28T19:59:27.366 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:27.355+0000 7f234a357640 1 -- 172.21.15.78:0/3964812922 wait complete. 2023-11-28T19:59:27.373 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574858 got 55834574857 for osd.1 2023-11-28T19:59:27.383 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574858 got 55834574857 for osd.5 2023-11-28T19:59:27.387 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574856 got 55834574855 for osd.2 2023-11-28T19:59:27.394 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574856 got 55834574855 for osd.6 2023-11-28T19:59:27.395 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574858 got 55834574857 for osd.3 2023-11-28T19:59:27.396 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574858 got 55834574857 for osd.7 2023-11-28T19:59:27.396 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574857 got 55834574856 for osd.0 2023-11-28T19:59:28.366 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2023-11-28T19:59:28.373 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-11-28T19:59:28.384 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2023-11-28T19:59:28.388 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-11-28T19:59:28.395 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2023-11-28T19:59:28.395 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-11-28T19:59:28.397 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2023-11-28T19:59:28.397 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-11-28T19:59:28.577 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:28.571+0000 7f18b9a32640 1 Processor -- start 2023-11-28T19:59:28.580 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:28.571+0000 7f18b9a32640 1 -- start start 2023-11-28T19:59:28.580 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:28.575+0000 7f18b9a32640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f18b40a5050 0x7f18b4150320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:28.580 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:28.575+0000 7f18b9a32640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f18b406bb40 0x7f18b40c16d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:28.581 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:28.575+0000 7f18b27fc640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f18b40a5050 0x7f18b4150320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:28.581 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:28.575+0000 7f18b27fc640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f18b40a5050 0x7f18b4150320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3301/0 says I am v2:172.21.15.78:47982/0 (socket says 172.21.15.78:47982) 2023-11-28T19:59:28.581 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:28.575+0000 7f18b2ffd640 1 --1- >> v1:172.21.15.179:6789/0 conn(0x7f18b414daa0 0x7f18b40c49c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.179:6789/0 says I am v1:172.21.15.78:60174/0 (socket says 172.21.15.78:60174) 2023-11-28T19:59:28.581 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:28.575+0000 7f18b27fc640 1 -- 172.21.15.78:0/2204779458 learned_addr learned my addr 172.21.15.78:0/2204779458 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T19:59:28.582 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:28.575+0000 7f18b9a32640 1 -- 172.21.15.78:0/2204779458 --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f18b40c36d0 con 0x7f18b414daa0 2023-11-28T19:59:28.582 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:28.575+0000 7f18b9a32640 1 -- 172.21.15.78:0/2204779458 --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f18b40c3920 con 0x7f18b406bb40 2023-11-28T19:59:28.582 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:28.575+0000 7f18b9a32640 1 -- 172.21.15.78:0/2204779458 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18b40c3c00 con 0x7f18b40a5050 2023-11-28T19:59:28.583 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:28.575+0000 7f18b37fe640 1 --2- 172.21.15.78:0/2204779458 >> v2:172.21.15.78:3300/0 conn(0x7f18b406bb40 0x7f18b40c16d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:28.583 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:28.575+0000 7f18b1ffb640 1 -- 172.21.15.78:0/2204779458 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 76909802 0 0) 0x7f18b40c36d0 con 0x7f18b414daa0 2023-11-28T19:59:28.583 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:28.575+0000 7f18b1ffb640 1 -- 172.21.15.78:0/2204779458 --> v1:172.21.15.179:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f189c003510 con 0x7f18b414daa0 2023-11-28T19:59:28.583 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:28.575+0000 7f18b1ffb640 1 -- 172.21.15.78:0/2204779458 <== mon.1 v1:172.21.15.179:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3049675903 0 0) 0x7f189c003510 con 0x7f18b414daa0 2023-11-28T19:59:28.584 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:28.579+0000 7f18b27fc640 1 -- 172.21.15.78:0/2204779458 >> v2:172.21.15.78:3300/0 conn(0x7f18b406bb40 msgr2=0x7f18b40c16d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T19:59:28.584 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:28.579+0000 7f18b27fc640 1 --2- 172.21.15.78:0/2204779458 >> v2:172.21.15.78:3300/0 conn(0x7f18b406bb40 0x7f18b40c16d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:28.584 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:28.579+0000 7f18b27fc640 1 -- 172.21.15.78:0/2204779458 >> v1:172.21.15.179:6789/0 conn(0x7f18b414daa0 legacy=0x7f18b40c49c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:28.584 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:28.579+0000 7f18b27fc640 1 -- 172.21.15.78:0/2204779458 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18b40c3ee0 con 0x7f18b40a5050 2023-11-28T19:59:28.584 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:28.579+0000 7f18b37fe640 1 --2- 172.21.15.78:0/2204779458 >> v2:172.21.15.78:3300/0 conn(0x7f18b406bb40 0x7f18b40c16d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T19:59:28.589 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:28.583+0000 7f18b27fc640 1 --2- 172.21.15.78:0/2204779458 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f18b40a5050 0x7f18b4150320 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f18ac00af60 tx=0x7f18ac01d9c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6617cae32fb47f95 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:59:28.590 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:28.583+0000 7f18b1ffb640 1 -- 172.21.15.78:0/2204779458 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18a8001680 con 0x7f18b40a5050 2023-11-28T19:59:28.590 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:28.583+0000 7f18b1ffb640 1 -- 172.21.15.78:0/2204779458 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f18ac00a0d0 con 0x7f18b40a5050 2023-11-28T19:59:28.590 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:28.583+0000 7f18b1ffb640 1 -- 172.21.15.78:0/2204779458 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18ac0a66d0 con 0x7f18b40a5050 2023-11-28T19:59:28.592 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:28.587+0000 7f18b9a32640 1 -- 172.21.15.78:0/2204779458 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f18b40a5050 msgr2=0x7f18b4150320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:28.592 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:28.587+0000 7f18b9a32640 1 --2- 172.21.15.78:0/2204779458 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f18b40a5050 0x7f18b4150320 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f18ac00af60 tx=0x7f18ac01d9c0 comp rx=0 tx=0).stop 2023-11-28T19:59:28.592 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:28.587+0000 7f18b9a32640 1 -- 172.21.15.78:0/2204779458 shutdown_connections 2023-11-28T19:59:28.592 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:28.587+0000 7f18b9a32640 1 --2- 172.21.15.78:0/2204779458 >> v2:172.21.15.78:3300/0 conn(0x7f18b406bb40 0x7f18b40c16d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:28.592 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:28.587+0000 7f18b9a32640 1 --2- 172.21.15.78:0/2204779458 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f18b40a5050 0x7f18b4150320 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:28.592 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:28.587+0000 7f18b9a32640 1 -- 172.21.15.78:0/2204779458 >> 172.21.15.78:0/2204779458 conn(0x7f18b40a7520 msgr2=0x7f18b40a7930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T19:59:28.592 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:28.587+0000 7f18b9a32640 1 -- 172.21.15.78:0/2204779458 shutdown_connections 2023-11-28T19:59:28.592 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:28.587+0000 7f18b9a32640 1 -- 172.21.15.78:0/2204779458 wait complete. 2023-11-28T19:59:28.594 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:28.587+0000 7f18b9a32640 1 Processor -- start 2023-11-28T19:59:28.595 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:28.591+0000 7f18b9a32640 1 -- start start 2023-11-28T19:59:28.598 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:28.591+0000 7f18b9a32640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f18b406bb40 0x7f18b41ed530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:28.598 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:28.591+0000 7f18b9a32640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f18b40a5050 0x7f18b406a810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:28.598 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:28.591+0000 7f18b9a32640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f18b414daa0 0x7f18b4072270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:28.598 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:28.591+0000 7f18b9a32640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18b414a4b0 con 0x7f18b406bb40 2023-11-28T19:59:28.598 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:28.591+0000 7f18b9a32640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18b41502f0 con 0x7f18b414daa0 2023-11-28T19:59:28.598 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:28.591+0000 7f18b9a32640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18b4071de0 con 0x7f18b40a5050 2023-11-28T19:59:28.598 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:28.591+0000 7f18b37fe640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f18b414daa0 0x7f18b4072270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:28.598 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:28.591+0000 7f18b37fe640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f18b414daa0 0x7f18b4072270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.78:50036/0 (socket says 172.21.15.78:50036) 2023-11-28T19:59:28.598 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:28.591+0000 7f18b37fe640 1 -- 172.21.15.78:0/4029163158 learned_addr learned my addr 172.21.15.78:0/4029163158 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T19:59:28.598 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:28.591+0000 7f18b27fc640 1 --2- 172.21.15.78:0/4029163158 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f18b40a5050 0x7f18b406a810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:28.599 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:28.591+0000 7f18b2ffd640 1 --2- 172.21.15.78:0/4029163158 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f18b406bb40 0x7f18b41ed530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:28.599 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:28.591+0000 7f18b37fe640 1 -- 172.21.15.78:0/4029163158 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f18b40a5050 msgr2=0x7f18b406a810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:28.599 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:28.591+0000 7f18b37fe640 1 --2- 172.21.15.78:0/4029163158 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f18b40a5050 0x7f18b406a810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:28.600 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:28.591+0000 7f18b37fe640 1 -- 172.21.15.78:0/4029163158 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f18b406bb40 msgr2=0x7f18b41ed530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:28.600 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:28.591+0000 7f18b37fe640 1 --2- 172.21.15.78:0/4029163158 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f18b406bb40 0x7f18b41ed530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:28.600 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:28.591+0000 7f18b37fe640 1 -- 172.21.15.78:0/4029163158 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18a4009420 con 0x7f18b414daa0 2023-11-28T19:59:28.600 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:28.591+0000 7f18b27fc640 1 --2- 172.21.15.78:0/4029163158 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f18b40a5050 0x7f18b406a810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T19:59:28.600 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:28.591+0000 7f18b2ffd640 1 --2- 172.21.15.78:0/4029163158 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f18b406bb40 0x7f18b41ed530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T19:59:28.600 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:28.591+0000 7f18b37fe640 1 --2- 172.21.15.78:0/4029163158 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f18b414daa0 0x7f18b4072270 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f18a400e950 tx=0x7f18a400ee10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:59:28.600 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:28.595+0000 7f189bfff640 1 -- 172.21.15.78:0/4029163158 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18a4009720 con 0x7f18b414daa0 2023-11-28T19:59:28.600 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:28.595+0000 7f189bfff640 1 -- 172.21.15.78:0/4029163158 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f18a400ca00 con 0x7f18b414daa0 2023-11-28T19:59:28.601 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:28.595+0000 7f18b9a32640 1 -- 172.21.15.78:0/4029163158 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f18ac00ac40 con 0x7f18b414daa0 2023-11-28T19:59:28.601 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:28.595+0000 7f18b9a32640 1 -- 172.21.15.78:0/4029163158 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f18b406c130 con 0x7f18b414daa0 2023-11-28T19:59:28.606 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:28.595+0000 7f189bfff640 1 -- 172.21.15.78:0/4029163158 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18a400cd90 con 0x7f18b414daa0 2023-11-28T19:59:28.606 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:28.595+0000 7f18b9a32640 1 -- 172.21.15.78:0/4029163158 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f18b40674b0 con 0x7f18b414daa0 2023-11-28T19:59:28.606 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:28.599+0000 7f189bfff640 1 -- 172.21.15.78:0/4029163158 <== mon.1 v2:172.21.15.179:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f18a4013470 con 0x7f18b414daa0 2023-11-28T19:59:28.607 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:28.599+0000 7f189bfff640 1 --2- 172.21.15.78:0/4029163158 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f18a0066570 0x7f18a0068a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:28.607 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:28.599+0000 7f189bfff640 1 -- 172.21.15.78:0/4029163158 <== mon.1 v2:172.21.15.179:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f18a4083f40 con 0x7f18b414daa0 2023-11-28T19:59:28.607 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:28.603+0000 7f18b2ffd640 1 --2- 172.21.15.78:0/4029163158 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f18a0066570 0x7f18a0068a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:28.608 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:28.603+0000 7f18b2ffd640 1 --2- 172.21.15.78:0/4029163158 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f18a0066570 0x7f18a0068a30 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f18a8001ec0 tx=0x7f18a8009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:59:28.609 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:28.603+0000 7f189bfff640 1 -- 172.21.15.78:0/4029163158 <== mon.1 v2:172.21.15.179:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f18a40511f0 con 0x7f18b414daa0 2023-11-28T19:59:28.662 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:28.655+0000 7fb6c88e9640 1 Processor -- start 2023-11-28T19:59:28.663 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:28.655+0000 7f3af71aa640 1 Processor -- start 2023-11-28T19:59:28.663 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:28.655+0000 7fb6c88e9640 1 -- start start 2023-11-28T19:59:28.664 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:28.659+0000 7f3af71aa640 1 -- start start 2023-11-28T19:59:28.664 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:28.659+0000 7fb6c88e9640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb6c41519b0 0x7fb6c40ae6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:28.665 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:28.659+0000 7fb6c88e9640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb6c4151d90 con 0x7fb6c40c45b0 2023-11-28T19:59:28.665 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:28.659+0000 7fb6c88e9640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb6c40adfe0 con 0x7fb6c40c94b0 2023-11-28T19:59:28.665 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:28.659+0000 7f3af71aa640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f3af0151ae0 0x7f3af0155070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:28.665 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:28.659+0000 7f3af71aa640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3af00c8000 0x7f3af00c8490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:28.665 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:28.659+0000 7f3af71aa640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3af0151ec0 con 0x7f3af00c5520 2023-11-28T19:59:28.665 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:28.659+0000 7f3af71aa640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3af00c08f0 con 0x7f3af0151ae0 2023-11-28T19:59:28.665 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:28.659+0000 7f3af71aa640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3af00c5a90 con 0x7f3af00c8000 2023-11-28T19:59:28.666 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:28.659+0000 7fb6c88e9640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb6c41588c0 con 0x7fb6c41519b0 2023-11-28T19:59:28.666 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:28.659+0000 7fb6c359e640 1 --1- >> v1:172.21.15.179:6789/0 conn(0x7fb6c40c94b0 0x7fb6c4154c30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.179:6789/0 says I am v1:172.21.15.78:60184/0 (socket says 172.21.15.78:60184) 2023-11-28T19:59:28.666 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:28.659+0000 7fb6c359e640 1 -- 172.21.15.78:0/1493429007 learned_addr learned my addr 172.21.15.78:0/1493429007 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-11-28T19:59:28.666 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:28.659+0000 7fb6c2d9d640 1 --2- 172.21.15.78:0/1493429007 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb6c41519b0 0x7fb6c40ae6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:28.667 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:28.659+0000 7f3af4f46640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f3af0151ae0 0x7f3af0155070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:28.667 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:28.659+0000 7f3af4f46640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f3af0151ae0 0x7f3af0155070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.78:50050/0 (socket says 172.21.15.78:50050) 2023-11-28T19:59:28.667 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:28.659+0000 7f3af4f46640 1 -- 172.21.15.78:0/4258719292 learned_addr learned my addr 172.21.15.78:0/4258719292 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T19:59:28.668 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:28.659+0000 7fb6c2d9d640 1 -- 172.21.15.78:0/1493429007 >> v1:172.21.15.179:6789/0 conn(0x7fb6c40c94b0 legacy=0x7fb6c4154c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:28.668 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:28.659+0000 7fb6c2d9d640 1 -- 172.21.15.78:0/1493429007 >> v1:172.21.15.78:6789/0 conn(0x7fb6c40c45b0 legacy=0x7fb6c4154520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T19:59:28.668 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:28.663+0000 7fb6c2d9d640 1 -- 172.21.15.78:0/1493429007 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6c40acd40 con 0x7fb6c41519b0 2023-11-28T19:59:28.669 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:28.659+0000 7f3af5747640 1 --2- 172.21.15.78:0/4258719292 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3af00c8000 0x7f3af00c8490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:28.669 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:28.659+0000 7f3af4f46640 1 -- 172.21.15.78:0/4258719292 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3af00c8000 msgr2=0x7f3af00c8490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T19:59:28.669 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:28.659+0000 7f3af4f46640 1 --2- 172.21.15.78:0/4258719292 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3af00c8000 0x7f3af00c8490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:28.669 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:28.659+0000 7f3af4f46640 1 -- 172.21.15.78:0/4258719292 >> v1:172.21.15.78:6789/0 conn(0x7f3af00c5520 legacy=0x7f3af00bf570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:28.669 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:28.659+0000 7f3af4f46640 1 -- 172.21.15.78:0/4258719292 --> v2:172.21.15.179:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3af00c5d70 con 0x7f3af0151ae0 2023-11-28T19:59:28.672 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:28.667+0000 7fb6c2d9d640 1 --2- 172.21.15.78:0/1493429007 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb6c41519b0 0x7fb6c40ae6e0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fb6b4009770 tx=0x7fb6b401c240 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7bfa54e66fd0458b server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:59:28.673 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:28.667+0000 7f3af4f46640 1 --2- 172.21.15.78:0/4258719292 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3af0151ae0 0x7f3af0155070 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f3ae4009870 tx=0x7f3ae401c4a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=43db4bdc5536cdcb server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:59:28.673 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:28.667+0000 7f3b3e7d1640 1 Processor -- start 2023-11-28T19:59:28.673 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:28.667+0000 7fb6c1d9b640 1 -- 172.21.15.78:0/1493429007 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6b40ab600 con 0x7fb6c41519b0 2023-11-28T19:59:28.674 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:28.667+0000 7f3b3e7d1640 1 -- start start 2023-11-28T19:59:28.674 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:28.667+0000 7f3aef7fe640 1 -- 172.21.15.78:0/4258719292 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ae40ab680 con 0x7f3af0151ae0 2023-11-28T19:59:28.674 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:28.667+0000 7f3aef7fe640 1 -- 172.21.15.78:0/4258719292 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ae40ab7e0 con 0x7f3af0151ae0 2023-11-28T19:59:28.674 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:28.667+0000 7f3aef7fe640 1 -- 172.21.15.78:0/4258719292 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ae40abb70 con 0x7f3af0151ae0 2023-11-28T19:59:28.675 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:28.667+0000 7efc9089c640 1 Processor -- start 2023-11-28T19:59:28.675 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:28.667+0000 7fb6c1d9b640 1 -- 172.21.15.78:0/1493429007 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb6b40a7050 con 0x7fb6c41519b0 2023-11-28T19:59:28.675 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:28.667+0000 7fb6c1d9b640 1 -- 172.21.15.78:0/1493429007 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6b40ab600 con 0x7fb6c41519b0 2023-11-28T19:59:28.675 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:28.667+0000 7fb6c88e9640 1 -- 172.21.15.78:0/1493429007 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb6c41519b0 msgr2=0x7fb6c40ae6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:28.675 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:28.667+0000 7fb6c88e9640 1 --2- 172.21.15.78:0/1493429007 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb6c41519b0 0x7fb6c40ae6e0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fb6b4009770 tx=0x7fb6b401c240 comp rx=0 tx=0).stop 2023-11-28T19:59:28.676 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:28.667+0000 7f3af71aa640 1 -- 172.21.15.78:0/4258719292 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3af0151ae0 msgr2=0x7f3af0155070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:28.676 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:28.667+0000 7f3af71aa640 1 --2- 172.21.15.78:0/4258719292 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3af0151ae0 0x7f3af0155070 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f3ae4009870 tx=0x7f3ae401c4a0 comp rx=0 tx=0).stop 2023-11-28T19:59:28.676 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:28.667+0000 7f3af71aa640 1 -- 172.21.15.78:0/4258719292 shutdown_connections 2023-11-28T19:59:28.676 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:28.667+0000 7f3af71aa640 1 --2- 172.21.15.78:0/4258719292 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3af00c8000 0x7f3af00c8490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:28.676 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:28.667+0000 7f3af71aa640 1 --2- 172.21.15.78:0/4258719292 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3af0151ae0 0x7f3af0155070 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:28.676 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:28.667+0000 7f3af71aa640 1 -- 172.21.15.78:0/4258719292 >> 172.21.15.78:0/4258719292 conn(0x7f3af00ca000 msgr2=0x7f3af00ca410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T19:59:28.676 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:28.667+0000 7efc9089c640 1 -- start start 2023-11-28T19:59:28.677 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:28.667+0000 7f3b3e7d1640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f3b3814dce0 0x7f3b3806ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:28.677 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:28.667+0000 7f3b3e7d1640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3b380a55c0 con 0x7f3b380c5f80 2023-11-28T19:59:28.677 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:28.667+0000 7f3b3e7d1640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3b381507d0 con 0x7f3b3806bf50 2023-11-28T19:59:28.677 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:28.667+0000 7f3b3e7d1640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3b381505c0 con 0x7f3b3814dce0 2023-11-28T19:59:28.681 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:28.667+0000 7fb6c88e9640 1 -- 172.21.15.78:0/1493429007 shutdown_connections 2023-11-28T19:59:28.681 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:28.667+0000 7fb6c88e9640 1 --2- 172.21.15.78:0/1493429007 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb6c41519b0 0x7fb6c40ae6e0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:28.681 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:28.667+0000 7fb6c88e9640 1 -- 172.21.15.78:0/1493429007 >> 172.21.15.78:0/1493429007 conn(0x7fb6c4066cd0 msgr2=0x7fb6c40ab8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T19:59:28.682 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:28.667+0000 7f3af71aa640 1 -- 172.21.15.78:0/4258719292 shutdown_connections 2023-11-28T19:59:28.682 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:28.671+0000 7f3af71aa640 1 -- 172.21.15.78:0/4258719292 wait complete. 2023-11-28T19:59:28.682 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:28.671+0000 7fb6c88e9640 1 -- 172.21.15.78:0/1493429007 shutdown_connections 2023-11-28T19:59:28.683 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:28.671+0000 7f3b37fff640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f3b3814dce0 0x7f3b3806ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:28.683 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:28.671+0000 7f3b3cd6e640 1 --1- >> v1:172.21.15.179:6789/0 conn(0x7f3b3806bf50 0x7f3b380c4140 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.179:6789/0 says I am v1:172.21.15.78:60196/0 (socket says 172.21.15.78:60196) 2023-11-28T19:59:28.683 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:28.671+0000 7f3b3cd6e640 1 -- 172.21.15.78:0/1464580522 learned_addr learned my addr 172.21.15.78:0/1464580522 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-11-28T19:59:28.683 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:28.671+0000 7f3b37fff640 1 -- 172.21.15.78:0/1464580522 >> v1:172.21.15.179:6789/0 conn(0x7f3b3806bf50 legacy=0x7f3b380c4140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:28.683 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:28.671+0000 7f3b37fff640 1 -- 172.21.15.78:0/1464580522 >> v1:172.21.15.78:6789/0 conn(0x7f3b380c5f80 legacy=0x7f3b380c3a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:28.684 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:28.671+0000 7f3b37fff640 1 -- 172.21.15.78:0/1464580522 --> v2:172.21.15.179:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b38150ab0 con 0x7f3b3814dce0 2023-11-28T19:59:28.684 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:28.671+0000 7fb6c88e9640 1 -- 172.21.15.78:0/1493429007 wait complete. 2023-11-28T19:59:28.684 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:28.671+0000 7efc9089c640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7efc8c151ae0 0x7efc8c155070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:28.685 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:28.671+0000 7efc9089c640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7efc8c0c5520 0x7efc8c0bf570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:28.685 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:28.671+0000 7efc9089c640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7efc8c0bfab0 0x7efc8c0c8000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:28.685 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:28.671+0000 7efc9089c640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efc8c0c08f0 con 0x7efc8c0c5520 2023-11-28T19:59:28.685 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:28.671+0000 7efc9089c640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efc8c151ec0 con 0x7efc8c0bfab0 2023-11-28T19:59:28.685 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:28.671+0000 7efc9089c640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc8c0c5a90 con 0x7efc8c151ae0 2023-11-28T19:59:28.685 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:28.671+0000 7efc89d9b640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7efc8c0c5520 0x7efc8c0bf570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:28.685 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:28.671+0000 7efc8a59c640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7efc8c151ae0 0x7efc8c155070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:28.685 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:28.671+0000 7efc8a59c640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7efc8c151ae0 0x7efc8c155070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3301/0 says I am v2:172.21.15.78:48024/0 (socket says 172.21.15.78:48024) 2023-11-28T19:59:28.685 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:28.671+0000 7efc8a59c640 1 -- 172.21.15.78:0/182559861 learned_addr learned my addr 172.21.15.78:0/182559861 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T19:59:28.686 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:28.671+0000 7efc89d9b640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7efc8c0c5520 0x7efc8c0bf570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:53154/0 (socket says 172.21.15.78:53154) 2023-11-28T19:59:28.686 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:28.671+0000 7efc8ad9d640 1 --2- 172.21.15.78:0/182559861 >> v2:172.21.15.179:3300/0 conn(0x7efc8c0bfab0 0x7efc8c0c8000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:28.686 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:28.671+0000 7efc8ad9d640 1 -- 172.21.15.78:0/182559861 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7efc8c151ae0 msgr2=0x7efc8c155070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T19:59:28.686 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:28.671+0000 7efc8ad9d640 1 --2- 172.21.15.78:0/182559861 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7efc8c151ae0 0x7efc8c155070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:28.686 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:28.671+0000 7efc8ad9d640 1 -- 172.21.15.78:0/182559861 >> v2:172.21.15.78:3300/0 conn(0x7efc8c0c5520 msgr2=0x7efc8c0bf570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T19:59:28.686 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:28.671+0000 7efc8ad9d640 1 --2- 172.21.15.78:0/182559861 >> v2:172.21.15.78:3300/0 conn(0x7efc8c0c5520 0x7efc8c0bf570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:28.686 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:28.671+0000 7efc8ad9d640 1 -- 172.21.15.78:0/182559861 --> v2:172.21.15.179:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc8c0c5d70 con 0x7efc8c0bfab0 2023-11-28T19:59:28.687 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:28.671+0000 7f3af71aa640 1 Processor -- start 2023-11-28T19:59:28.687 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:28.671+0000 7f3af71aa640 1 -- start start 2023-11-28T19:59:28.687 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:28.671+0000 7fb6c88e9640 1 Processor -- start 2023-11-28T19:59:28.687 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:28.671+0000 7fb6c88e9640 1 -- start start 2023-11-28T19:59:28.688 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:28.675+0000 7fb6c88e9640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb6c40c45b0 0x7fb6c414da80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:28.688 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:28.675+0000 7fb6c88e9640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb6c40c94b0 0x7fb6c41536b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:28.688 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:28.675+0000 7fb6c88e9640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb6c41519b0 0x7fb6c4155e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:28.688 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:28.675+0000 7fb6c88e9640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6c414d5f0 con 0x7fb6c41519b0 2023-11-28T19:59:28.688 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:28.675+0000 7fb6c88e9640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6c4155820 con 0x7fb6c40c94b0 2023-11-28T19:59:28.688 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:28.675+0000 7fb6c88e9640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb6c414cfa0 con 0x7fb6c40c45b0 2023-11-28T19:59:28.689 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:28.675+0000 7f3af71aa640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3af00c5520 0x7f3af01ecca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:28.689 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:28.675+0000 7fb6c2d9d640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb6c40c45b0 0x7fb6c414da80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:28.690 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:28.675+0000 7f3af71aa640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3af00c8000 0x7f3af00c10d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:28.690 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:28.675+0000 7fb6c2d9d640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb6c40c45b0 0x7fb6c414da80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3301/0 says I am v2:172.21.15.78:48040/0 (socket says 172.21.15.78:48040) 2023-11-28T19:59:28.690 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:28.675+0000 7fb6c2d9d640 1 -- 172.21.15.78:0/3694544363 learned_addr learned my addr 172.21.15.78:0/3694544363 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T19:59:28.690 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:28.675+0000 7fb6c259c640 1 --2- 172.21.15.78:0/3694544363 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb6c40c94b0 0x7fb6c41536b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:28.691 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:28.675+0000 7f3af71aa640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3af0151ae0 0x7f3af01ef760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:28.691 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:28.675+0000 7f3af4f46640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3af00c5520 0x7f3af01ecca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:28.691 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:28.675+0000 7f3af4f46640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3af00c5520 0x7f3af01ecca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.78:50088/0 (socket says 172.21.15.78:50088) 2023-11-28T19:59:28.691 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:28.675+0000 7f3af4f46640 1 -- 172.21.15.78:0/935838925 learned_addr learned my addr 172.21.15.78:0/935838925 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T19:59:28.691 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:28.675+0000 7f3af71aa640 1 -- 172.21.15.78:0/935838925 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3af00c4050 con 0x7f3af00c8000 2023-11-28T19:59:28.692 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:28.675+0000 7f3af71aa640 1 -- 172.21.15.78:0/935838925 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3af0143a00 con 0x7f3af00c5520 2023-11-28T19:59:28.692 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:28.675+0000 7f3af71aa640 1 -- 172.21.15.78:0/935838925 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3af00c34d0 con 0x7f3af0151ae0 2023-11-28T19:59:28.692 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:28.675+0000 7f3af5747640 1 --2- 172.21.15.78:0/935838925 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3af0151ae0 0x7f3af01ef760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:28.692 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:28.675+0000 7fb6c2d9d640 1 -- 172.21.15.78:0/3694544363 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb6c40c94b0 msgr2=0x7fb6c41536b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:28.692 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:28.675+0000 7fb6c2d9d640 1 --2- 172.21.15.78:0/3694544363 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb6c40c94b0 0x7fb6c41536b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:28.692 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:28.675+0000 7fb6c2d9d640 1 -- 172.21.15.78:0/3694544363 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb6c41519b0 msgr2=0x7fb6c4155e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:28.692 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:28.675+0000 7fb6c2d9d640 1 --2- 172.21.15.78:0/3694544363 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb6c41519b0 0x7fb6c4155e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:28.692 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:28.675+0000 7fb6c2d9d640 1 -- 172.21.15.78:0/3694544363 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6b4009420 con 0x7fb6c40c45b0 2023-11-28T19:59:28.693 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:28.675+0000 7efc8a59c640 1 --2- 172.21.15.78:0/182559861 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7efc8c151ae0 0x7efc8c155070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T19:59:28.693 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:28.675+0000 7f3af4f46640 1 -- 172.21.15.78:0/935838925 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3af0151ae0 msgr2=0x7f3af01ef760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:28.693 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:28.675+0000 7f3af4f46640 1 --2- 172.21.15.78:0/935838925 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3af0151ae0 0x7f3af01ef760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:28.693 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:28.675+0000 7f3af4f46640 1 -- 172.21.15.78:0/935838925 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3af00c8000 msgr2=0x7f3af00c10d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:28.693 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:28.675+0000 7f3af4f46640 1 --2- 172.21.15.78:0/935838925 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3af00c8000 0x7f3af00c10d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:28.693 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:28.675+0000 7f3af4f46640 1 -- 172.21.15.78:0/935838925 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ae40094d0 con 0x7f3af00c5520 2023-11-28T19:59:28.694 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:28.675+0000 7f3b37fff640 1 --2- 172.21.15.78:0/1464580522 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3b3814dce0 0x7f3b3806ba10 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f3b28009fd0 tx=0x7f3b2801d470 comp rx=0 tx=0).ready entity=mon.1 client_cookie=70f4f435ffc7f5b8 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:59:28.694 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:28.675+0000 7f93da1c4640 1 Processor -- start 2023-11-28T19:59:28.695 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:28.675+0000 7f93da1c4640 1 -- start start 2023-11-28T19:59:28.695 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:28.675+0000 7f93da1c4640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f93d4155fc0 0x7f93d40c70a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:28.695 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:28.675+0000 7f93da1c4640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f93d406c7b0 0x7f93d40ca0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:28.695 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:28.675+0000 7f93da1c4640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f93d40ca5f0 0x7f93d415c4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:28.695 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:28.675+0000 7f93da1c4640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f93d40bd600 con 0x7f93d4155fc0 2023-11-28T19:59:28.695 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:28.675+0000 7f93da1c4640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f93d41563a0 con 0x7f93d406c7b0 2023-11-28T19:59:28.695 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:28.675+0000 7f93da1c4640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f93d40c47d0 con 0x7f93d40ca5f0 2023-11-28T19:59:28.695 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:28.675+0000 7f93d3fff640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f93d40ca5f0 0x7f93d415c4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:28.695 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:28.675+0000 7f93d2ffd640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f93d406c7b0 0x7f93d40ca0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:28.696 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:28.675+0000 7f93d3fff640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f93d40ca5f0 0x7f93d415c4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3301/0 says I am v2:172.21.15.78:48052/0 (socket says 172.21.15.78:48052) 2023-11-28T19:59:28.696 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:28.675+0000 7f93d3fff640 1 -- 172.21.15.78:0/1057065660 learned_addr learned my addr 172.21.15.78:0/1057065660 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T19:59:28.696 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:28.675+0000 7f93d2ffd640 1 --2- 172.21.15.78:0/1057065660 >> v2:172.21.15.179:3300/0 conn(0x7f93d406c7b0 0x7f93d40ca0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.78:50090/0 (socket says 172.21.15.78:50090) 2023-11-28T19:59:28.696 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:28.675+0000 7f93d2ffd640 1 -- 172.21.15.78:0/1057065660 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f93d40ca5f0 msgr2=0x7f93d415c4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T19:59:28.696 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:28.675+0000 7f93d2ffd640 1 --2- 172.21.15.78:0/1057065660 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f93d40ca5f0 0x7f93d415c4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:28.696 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:28.675+0000 7f93d2ffd640 1 -- 172.21.15.78:0/1057065660 >> v2:172.21.15.78:3300/0 conn(0x7f93d4155fc0 msgr2=0x7f93d40c70a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T19:59:28.696 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:28.675+0000 7f93d37fe640 1 --2- 172.21.15.78:0/1057065660 >> v2:172.21.15.78:3300/0 conn(0x7f93d4155fc0 0x7f93d40c70a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:28.696 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:28.675+0000 7fb6c2d9d640 1 --2- 172.21.15.78:0/3694544363 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb6c40c45b0 0x7fb6c414da80 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fb6b40ae040 tx=0x7fb6b4018fe0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:59:28.697 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:28.675+0000 7f3af4f46640 1 --2- 172.21.15.78:0/935838925 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3af00c5520 0x7f3af01ecca0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f3ae40ad040 tx=0x7f3ae401ace0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:59:28.697 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:28.679+0000 7f3b36ffd640 1 -- 172.21.15.78:0/1464580522 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b280ac660 con 0x7f3b3814dce0 2023-11-28T19:59:28.697 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:28.679+0000 7f3b36ffd640 1 -- 172.21.15.78:0/1464580522 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b280ac7c0 con 0x7f3b3814dce0 2023-11-28T19:59:28.697 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:28.679+0000 7f3b36ffd640 1 -- 172.21.15.78:0/1464580522 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b280acb50 con 0x7f3b3814dce0 2023-11-28T19:59:28.698 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:28.679+0000 7f93d2ffd640 1 --2- 172.21.15.78:0/1057065660 >> v2:172.21.15.78:3300/0 conn(0x7f93d4155fc0 0x7f93d40c70a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:28.698 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:28.679+0000 7f93d2ffd640 1 -- 172.21.15.78:0/1057065660 --> v2:172.21.15.179:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93d40c4ab0 con 0x7f93d406c7b0 2023-11-28T19:59:28.698 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:28.679+0000 7f93d37fe640 1 --2- 172.21.15.78:0/1057065660 >> v2:172.21.15.78:3300/0 conn(0x7f93d4155fc0 0x7f93d40c70a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T19:59:28.698 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:28.679+0000 7efc8ad9d640 1 --2- 172.21.15.78:0/182559861 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7efc8c0bfab0 0x7efc8c0c8000 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7efc8c0a9b30 tx=0x7efc8001c3e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=34da7da21572f057 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:59:28.699 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:28.679+0000 7f3aed7fa640 1 -- 172.21.15.78:0/935838925 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ae40b4800 con 0x7f3af00c5520 2023-11-28T19:59:28.699 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:28.679+0000 7f3aed7fa640 1 -- 172.21.15.78:0/935838925 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ae40b4980 con 0x7f3af00c5520 2023-11-28T19:59:28.699 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:28.679+0000 7f3aed7fa640 1 -- 172.21.15.78:0/935838925 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ae40b4d30 con 0x7f3af00c5520 2023-11-28T19:59:28.699 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:28.679+0000 7f3af71aa640 1 -- 172.21.15.78:0/935838925 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3af00c37b0 con 0x7f3af00c5520 2023-11-28T19:59:28.699 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:28.679+0000 7f3af71aa640 1 -- 172.21.15.78:0/935838925 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3af00c3d70 con 0x7f3af00c5520 2023-11-28T19:59:28.699 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:28.679+0000 7efc8959a640 1 -- 172.21.15.78:0/182559861 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc8c0c8d50 con 0x7efc8c0bfab0 2023-11-28T19:59:28.699 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:28.679+0000 7efc8959a640 1 -- 172.21.15.78:0/182559861 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc800ad660 con 0x7efc8c0bfab0 2023-11-28T19:59:28.699 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:28.679+0000 7efc8959a640 1 -- 172.21.15.78:0/182559861 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc800ad9f0 con 0x7efc8c0bfab0 2023-11-28T19:59:28.700 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:28.679+0000 7fb6ab7fe640 1 -- 172.21.15.78:0/3694544363 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6b4003c70 con 0x7fb6c40c45b0 2023-11-28T19:59:28.700 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:28.679+0000 7fb6ab7fe640 1 -- 172.21.15.78:0/3694544363 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb6b4003dd0 con 0x7fb6c40c45b0 2023-11-28T19:59:28.700 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:28.679+0000 7fb6ab7fe640 1 -- 172.21.15.78:0/3694544363 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6b40b4620 con 0x7fb6c40c45b0 2023-11-28T19:59:28.700 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:28.679+0000 7f3b3e7d1640 1 -- 172.21.15.78:0/1464580522 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3b3814dce0 msgr2=0x7f3b3806ba10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:28.700 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:28.679+0000 7f3b3e7d1640 1 --2- 172.21.15.78:0/1464580522 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3b3814dce0 0x7f3b3806ba10 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f3b28009fd0 tx=0x7f3b2801d470 comp rx=0 tx=0).stop 2023-11-28T19:59:28.701 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:28.679+0000 7efc9089c640 1 -- 172.21.15.78:0/182559861 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7efc8c0bfab0 msgr2=0x7efc8c0c8000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:28.701 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:28.679+0000 7efc9089c640 1 --2- 172.21.15.78:0/182559861 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7efc8c0bfab0 0x7efc8c0c8000 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7efc8c0a9b30 tx=0x7efc8001c3e0 comp rx=0 tx=0).stop 2023-11-28T19:59:28.701 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:28.679+0000 7fb6c88e9640 1 -- 172.21.15.78:0/3694544363 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb6c414d280 con 0x7fb6c40c45b0 2023-11-28T19:59:28.701 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:28.679+0000 7fb6c88e9640 1 -- 172.21.15.78:0/3694544363 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb6c4156350 con 0x7fb6c40c45b0 2023-11-28T19:59:28.702 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:28.679+0000 7efc9089c640 1 -- 172.21.15.78:0/182559861 shutdown_connections 2023-11-28T19:59:28.702 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:28.679+0000 7efc9089c640 1 --2- 172.21.15.78:0/182559861 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7efc8c0bfab0 0x7efc8c0c8000 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:28.702 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:28.679+0000 7efc9089c640 1 --2- 172.21.15.78:0/182559861 >> v2:172.21.15.78:3300/0 conn(0x7efc8c0c5520 0x7efc8c0bf570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:28.702 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:28.679+0000 7f3b3e7d1640 1 -- 172.21.15.78:0/1464580522 shutdown_connections 2023-11-28T19:59:28.703 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:28.679+0000 7f3b3e7d1640 1 --2- 172.21.15.78:0/1464580522 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3b3814dce0 0x7f3b3806ba10 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:28.703 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:28.679+0000 7f3b3e7d1640 1 -- 172.21.15.78:0/1464580522 >> 172.21.15.78:0/1464580522 conn(0x7f3b3806ad70 msgr2=0x7f3b380a77e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T19:59:28.703 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:28.679+0000 7efc9089c640 1 --2- 172.21.15.78:0/182559861 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7efc8c151ae0 0x7efc8c155070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:28.703 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:28.679+0000 7efc9089c640 1 -- 172.21.15.78:0/182559861 >> 172.21.15.78:0/182559861 conn(0x7efc8c0ca000 msgr2=0x7efc8c0ca410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T19:59:28.703 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:28.679+0000 7efc9089c640 1 -- 172.21.15.78:0/182559861 shutdown_connections 2023-11-28T19:59:28.704 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:28.679+0000 7f3b3e7d1640 1 -- 172.21.15.78:0/1464580522 shutdown_connections 2023-11-28T19:59:28.704 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:28.679+0000 7efc9089c640 1 -- 172.21.15.78:0/182559861 wait complete. 2023-11-28T19:59:28.704 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:28.679+0000 7f3af71aa640 1 -- 172.21.15.78:0/935838925 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3af0067630 con 0x7f3af00c5520 2023-11-28T19:59:28.705 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:28.679+0000 7f3b3e7d1640 1 -- 172.21.15.78:0/1464580522 wait complete. 2023-11-28T19:59:28.705 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:28.683+0000 7f3aed7fa640 1 -- 172.21.15.78:0/935838925 <== mon.1 v2:172.21.15.179:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f3ae40b3380 con 0x7f3af00c5520 2023-11-28T19:59:28.705 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:28.683+0000 7f3aed7fa640 1 --2- 172.21.15.78:0/935838925 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f3ad4066470 0x7f3ad4068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:28.705 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:28.679+0000 7fb6c88e9640 1 -- 172.21.15.78:0/3694544363 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb6c414ce00 con 0x7fb6c40c45b0 2023-11-28T19:59:28.705 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:28.683+0000 7fb6ab7fe640 1 -- 172.21.15.78:0/3694544363 <== mon.2 v2:172.21.15.179:3301/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fb6b40b2040 con 0x7fb6c40c45b0 2023-11-28T19:59:28.706 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:28.683+0000 7feba5ff5640 1 Processor -- start 2023-11-28T19:59:28.706 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:28.683+0000 7fb10f780640 1 Processor -- start 2023-11-28T19:59:28.706 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:28.683+0000 7fb10f780640 1 -- start start 2023-11-28T19:59:28.707 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:28.683+0000 7f3aed7fa640 1 -- 172.21.15.78:0/935838925 <== mon.1 v2:172.21.15.179:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f3ae411eb10 con 0x7f3af00c5520 2023-11-28T19:59:28.707 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:28.683+0000 7feba5ff5640 1 -- start start 2023-11-28T19:59:28.707 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:28.683+0000 7f93d2ffd640 1 --2- 172.21.15.78:0/1057065660 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f93d406c7b0 0x7f93d40ca0b0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f93d40cadb0 tx=0x7f93c401c910 comp rx=0 tx=0).ready entity=mon.1 client_cookie=996e0ab4294bde9a server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:59:28.708 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:28.683+0000 7feba5ff5640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7feba00bd550 0x7feba00c4b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:28.708 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:28.683+0000 7feba5ff5640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7feba0155950 0x7feba01582f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:28.708 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:28.683+0000 7feba5ff5640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feba00c6840 con 0x7feba00c47b0 2023-11-28T19:59:28.708 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:28.683+0000 7feba5ff5640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feba00af870 con 0x7feba0155950 2023-11-28T19:59:28.708 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:28.683+0000 7feba5ff5640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feba00c6a70 con 0x7feba00bd550 2023-11-28T19:59:28.708 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:28.683+0000 7fb6ab7fe640 1 --2- 172.21.15.78:0/3694544363 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fb6b0066570 0x7fb6b0068a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:28.709 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:28.683+0000 7fb10f780640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fb10806c070 0x7fb1081594e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:28.709 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:28.683+0000 7fb6ab7fe640 1 -- 172.21.15.78:0/3694544363 <== mon.2 v2:172.21.15.179:3301/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fb6b411e060 con 0x7fb6c40c45b0 2023-11-28T19:59:28.709 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:28.683+0000 7fb10f780640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb10806b1f0 con 0x7fb1080c6aa0 2023-11-28T19:59:28.709 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:28.683+0000 7fb10f780640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb1080c9b80 con 0x7fb1080bd480 2023-11-28T19:59:28.709 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:28.683+0000 7fb10f780640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb108159a20 con 0x7fb10806c070 2023-11-28T19:59:28.710 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:28.683+0000 7efc9089c640 1 Processor -- start 2023-11-28T19:59:28.710 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:28.683+0000 7f3b3e7d1640 1 Processor -- start 2023-11-28T19:59:28.710 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:28.683+0000 7feb96ffd640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7feba00bd550 0x7feba00c4b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:28.711 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:28.683+0000 7f3aeffff640 1 --2- 172.21.15.78:0/935838925 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f3ad4066470 0x7f3ad4068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:28.711 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:28.683+0000 7fb10cd1b640 1 --1- >> v1:172.21.15.179:6789/0 conn(0x7fb1080bd480 0x7fb10806b960 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.179:6789/0 says I am v1:172.21.15.78:60200/0 (socket says 172.21.15.78:60200) 2023-11-28T19:59:28.711 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:28.683+0000 7fb10cd1b640 1 -- 172.21.15.78:0/2664318734 learned_addr learned my addr 172.21.15.78:0/2664318734 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-11-28T19:59:28.712 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:28.683+0000 7fb6c259c640 1 --2- 172.21.15.78:0/3694544363 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fb6b0066570 0x7fb6b0068a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:28.712 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:28.683+0000 7f3b3e7d1640 1 -- start start 2023-11-28T19:59:28.712 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:28.683+0000 7feb96ffd640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7feba00bd550 0x7feba00c4b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.78:50092/0 (socket says 172.21.15.78:50092) 2023-11-28T19:59:28.713 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:28.687+0000 7feb96ffd640 1 -- 172.21.15.78:0/676082135 learned_addr learned my addr 172.21.15.78:0/676082135 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T19:59:28.713 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:28.687+0000 7fb10dd1d640 1 --2- 172.21.15.78:0/2664318734 >> v2:172.21.15.78:3300/0 conn(0x7fb10806c070 0x7fb1081594e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:28.713 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:28.683+0000 7feb9ffff640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7feba0155950 0x7feba01582f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:28.713 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:28.683+0000 7feb9f7fe640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7feba00c47b0 0x7feba0154ee0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:54008/0 (socket says 172.21.15.78:54008) 2023-11-28T19:59:28.713 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:28.687+0000 7f93d27fc640 1 -- 172.21.15.78:0/1057065660 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93c40a5790 con 0x7f93d406c7b0 2023-11-28T19:59:28.714 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:28.687+0000 7fb0fffff640 1 -- 172.21.15.78:0/2664318734 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4180977247 0 0) 0x7fb1080c9b80 con 0x7fb1080bd480 2023-11-28T19:59:28.714 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:28.687+0000 7f93d27fc640 1 -- 172.21.15.78:0/1057065660 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f93c40a58f0 con 0x7f93d406c7b0 2023-11-28T19:59:28.714 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:28.687+0000 7f93d27fc640 1 -- 172.21.15.78:0/1057065660 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93c40a5c80 con 0x7f93d406c7b0 2023-11-28T19:59:28.715 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:28.687+0000 7fb0fffff640 1 -- 172.21.15.78:0/2664318734 --> v1:172.21.15.179:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb0f4003530 con 0x7fb1080bd480 2023-11-28T19:59:28.715 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:28.687+0000 7fb10dd1d640 1 -- 172.21.15.78:0/2664318734 >> v1:172.21.15.179:6789/0 conn(0x7fb1080bd480 legacy=0x7fb10806b960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:28.715 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:28.687+0000 7fb10dd1d640 1 -- 172.21.15.78:0/2664318734 >> v1:172.21.15.78:6789/0 conn(0x7fb1080c6aa0 legacy=0x7fb108155cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:28.715 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:28.687+0000 7fb10dd1d640 1 -- 172.21.15.78:0/2664318734 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb10806cce0 con 0x7fb10806c070 2023-11-28T19:59:28.716 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:28.687+0000 7f3aeffff640 1 --2- 172.21.15.78:0/935838925 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f3ad4066470 0x7f3ad4068930 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f3af01f12f0 tx=0x7f3adc007930 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:59:28.716 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:28.687+0000 7f3aed7fa640 1 -- 172.21.15.78:0/935838925 <== mon.1 v2:172.21.15.179:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f3ae40ebcb0 con 0x7f3af00c5520 2023-11-28T19:59:28.716 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:28.687+0000 7f3b3e7d1640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3b3806bf50 0x7f3b3814ec30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:28.716 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:28.687+0000 7f3b3e7d1640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3b380c5f80 0x7f3b381f1960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:28.717 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:28.687+0000 7f3b3e7d1640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3b3814dce0 0x7f3b381f1ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:28.717 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:28.687+0000 7f3b3e7d1640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b381f4ed0 con 0x7f3b380c5f80 2023-11-28T19:59:28.717 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:28.687+0000 7f3b3e7d1640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b380aa700 con 0x7f3b3806bf50 2023-11-28T19:59:28.717 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:28.687+0000 7f3b3e7d1640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b3814d330 con 0x7f3b3814dce0 2023-11-28T19:59:28.717 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:28.687+0000 7f3b37fff640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3b3806bf50 0x7f3b3814ec30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:28.717 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:28.687+0000 7f3b37fff640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3b3806bf50 0x7f3b3814ec30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.78:50094/0 (socket says 172.21.15.78:50094) 2023-11-28T19:59:28.717 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:28.687+0000 7f3b37fff640 1 -- 172.21.15.78:0/1464807541 learned_addr learned my addr 172.21.15.78:0/1464807541 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T19:59:28.717 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:28.687+0000 7fb6c259c640 1 --2- 172.21.15.78:0/3694544363 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fb6b0066570 0x7fb6b0068a30 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fb6c414b5a0 tx=0x7fb6b8009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:59:28.718 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:28.687+0000 7f3b37fff640 1 -- 172.21.15.78:0/1464807541 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3b3814dce0 msgr2=0x7f3b381f1ea0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-11-28T19:59:28.718 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:28.687+0000 7efc9089c640 1 -- start start 2023-11-28T19:59:28.718 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:28.687+0000 7f3b37fff640 1 --2- 172.21.15.78:0/1464807541 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3b3814dce0 0x7f3b381f1ea0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:28.718 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:28.687+0000 7f3b37fff640 1 -- 172.21.15.78:0/1464807541 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3b380c5f80 msgr2=0x7f3b381f1960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:28.719 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:28.687+0000 7f3b37fff640 1 --2- 172.21.15.78:0/1464807541 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3b380c5f80 0x7f3b381f1960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:28.719 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:28.687+0000 7f3b37fff640 1 -- 172.21.15.78:0/1464807541 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b28009cb0 con 0x7f3b3806bf50 2023-11-28T19:59:28.719 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:28.687+0000 7fb6ab7fe640 1 -- 172.21.15.78:0/3694544363 <== mon.2 v2:172.21.15.179:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fb6c414ce00 con 0x7fb6c40c45b0 2023-11-28T19:59:28.719 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:28.687+0000 7feb96ffd640 1 -- 172.21.15.78:0/676082135 >> v2:172.21.15.78:3300/0 conn(0x7feba0155950 msgr2=0x7feba01582f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T19:59:28.719 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:28.687+0000 7feb96ffd640 1 --2- 172.21.15.78:0/676082135 >> v2:172.21.15.78:3300/0 conn(0x7feba0155950 0x7feba01582f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:28.720 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:28.687+0000 7feb96ffd640 1 -- 172.21.15.78:0/676082135 >> v1:172.21.15.78:6789/0 conn(0x7feba00c47b0 legacy=0x7feba0154ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T19:59:28.720 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:28.687+0000 7feb96ffd640 1 -- 172.21.15.78:0/676082135 --> v2:172.21.15.179:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feba00c6d50 con 0x7feba00bd550 2023-11-28T19:59:28.720 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:28.691+0000 7f93da1c4640 1 -- 172.21.15.78:0/1057065660 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f93d406c7b0 msgr2=0x7f93d40ca0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:28.720 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:28.691+0000 7f93da1c4640 1 --2- 172.21.15.78:0/1057065660 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f93d406c7b0 0x7f93d40ca0b0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f93d40cadb0 tx=0x7f93c401c910 comp rx=0 tx=0).stop 2023-11-28T19:59:28.721 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:28.691+0000 7f3b37fff640 1 --2- 172.21.15.78:0/1464807541 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3b3806bf50 0x7f3b3814ec30 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f3b2801a080 tx=0x7f3b2801a210 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:59:28.721 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:28.691+0000 7f3b34ff9640 1 -- 172.21.15.78:0/1464807541 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b280b5800 con 0x7f3b3806bf50 2023-11-28T19:59:28.721 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:28.691+0000 7f3b34ff9640 1 -- 172.21.15.78:0/1464807541 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b280b5960 con 0x7f3b3806bf50 2023-11-28T19:59:28.721 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:28.691+0000 7f3b34ff9640 1 -- 172.21.15.78:0/1464807541 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b280b5cd0 con 0x7f3b3806bf50 2023-11-28T19:59:28.722 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:28.691+0000 7efc9089c640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7efc8c0bfab0 0x7efc8c1f0810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:28.722 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:28.691+0000 7efc9089c640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7efc8c0c5520 0x7efc8c06c2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:28.722 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:28.691+0000 7efc9089c640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7efc8c151ae0 0x7efc8c148d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:28.722 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:28.691+0000 7efc9089c640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc8c154970 con 0x7efc8c0bfab0 2023-11-28T19:59:28.722 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:28.691+0000 7efc9089c640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc8c06d690 con 0x7efc8c0c5520 2023-11-28T19:59:28.722 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:28.691+0000 7efc9089c640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc8c14bac0 con 0x7efc8c151ae0 2023-11-28T19:59:28.722 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:28.691+0000 7efc89d9b640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7efc8c0c5520 0x7efc8c06c2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:28.723 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:28.691+0000 7efc89d9b640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7efc8c0c5520 0x7efc8c06c2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.78:50104/0 (socket says 172.21.15.78:50104) 2023-11-28T19:59:28.723 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:28.691+0000 7efc89d9b640 1 -- 172.21.15.78:0/170885661 learned_addr learned my addr 172.21.15.78:0/170885661 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T19:59:28.723 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:28.691+0000 7efc8a59c640 1 --2- 172.21.15.78:0/170885661 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7efc8c0bfab0 0x7efc8c1f0810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:28.724 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:28.691+0000 7f93da1c4640 1 -- 172.21.15.78:0/1057065660 shutdown_connections 2023-11-28T19:59:28.724 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:28.691+0000 7f93da1c4640 1 --2- 172.21.15.78:0/1057065660 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f93d40ca5f0 0x7f93d415c4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:28.724 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:28.691+0000 7f93da1c4640 1 --2- 172.21.15.78:0/1057065660 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f93d406c7b0 0x7f93d40ca0b0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:28.724 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:28.691+0000 7f93da1c4640 1 --2- 172.21.15.78:0/1057065660 >> v2:172.21.15.78:3300/0 conn(0x7f93d4155fc0 0x7f93d40c70a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:28.725 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:28.691+0000 7f93da1c4640 1 -- 172.21.15.78:0/1057065660 >> 172.21.15.78:0/1057065660 conn(0x7f93d40666a0 msgr2=0x7f93d4066ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T19:59:28.725 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:28.691+0000 7efc89d9b640 1 -- 172.21.15.78:0/170885661 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7efc8c151ae0 msgr2=0x7efc8c148d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:28.725 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:28.691+0000 7efc89d9b640 1 --2- 172.21.15.78:0/170885661 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7efc8c151ae0 0x7efc8c148d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:28.725 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:28.691+0000 7efc89d9b640 1 -- 172.21.15.78:0/170885661 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7efc8c0bfab0 msgr2=0x7efc8c1f0810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:28.726 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:28.691+0000 7efc89d9b640 1 --2- 172.21.15.78:0/170885661 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7efc8c0bfab0 0x7efc8c1f0810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:28.726 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:28.691+0000 7efc89d9b640 1 -- 172.21.15.78:0/170885661 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc84009b30 con 0x7efc8c0c5520 2023-11-28T19:59:28.726 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:28.691+0000 7efc8a59c640 1 --2- 172.21.15.78:0/170885661 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7efc8c0bfab0 0x7efc8c1f0810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T19:59:28.726 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:28.691+0000 7efc89d9b640 1 --2- 172.21.15.78:0/170885661 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7efc8c0c5520 0x7efc8c06c2b0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7efc7c00e9b0 tx=0x7efc7c00ee70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:59:28.726 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:28.691+0000 7f3b3e7d1640 1 -- 172.21.15.78:0/1464807541 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3b3814d560 con 0x7f3b3806bf50 2023-11-28T19:59:28.727 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:28.691+0000 7efc7affd640 1 -- 172.21.15.78:0/170885661 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc7c00c9a0 con 0x7efc8c0c5520 2023-11-28T19:59:28.727 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:28.691+0000 7f3b3e7d1640 1 -- 172.21.15.78:0/1464807541 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3b381f53c0 con 0x7f3b3806bf50 2023-11-28T19:59:28.727 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:28.691+0000 7feb96ffd640 1 --2- 172.21.15.78:0/676082135 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7feba00bd550 0x7feba00c4b90 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7feba006a870 tx=0x7feb8801c450 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4aacb03b741ab6e5 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:59:28.728 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:28.691+0000 7efc7affd640 1 -- 172.21.15.78:0/170885661 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc7c00cb00 con 0x7efc8c0c5520 2023-11-28T19:59:28.728 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:28.691+0000 7efc7affd640 1 -- 172.21.15.78:0/170885661 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc7c00ce70 con 0x7efc8c0c5520 2023-11-28T19:59:28.728 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:28.691+0000 7efc9089c640 1 -- 172.21.15.78:0/170885661 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efc80009420 con 0x7efc8c0c5520 2023-11-28T19:59:28.728 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:28.691+0000 7efc9089c640 1 -- 172.21.15.78:0/170885661 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efc8c1f10f0 con 0x7efc8c0c5520 2023-11-28T19:59:28.729 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:28.691+0000 7f93da1c4640 1 -- 172.21.15.78:0/1057065660 shutdown_connections 2023-11-28T19:59:28.729 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:28.691+0000 7f93da1c4640 1 -- 172.21.15.78:0/1057065660 wait complete. 2023-11-28T19:59:28.729 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:28.695+0000 7fb10dd1d640 1 --2- 172.21.15.78:0/2664318734 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb10806c070 0x7fb1081594e0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fb100009d90 tx=0x7fb10001c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b35bef7de4237997 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:59:28.729 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:28.695+0000 7feb9effd640 1 -- 172.21.15.78:0/676082135 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb880ab600 con 0x7feba00bd550 2023-11-28T19:59:28.730 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:28.695+0000 7f3b3e7d1640 1 -- 172.21.15.78:0/1464807541 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3b380aad30 con 0x7f3b3806bf50 2023-11-28T19:59:28.730 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:28.695+0000 7f93da1c4640 1 Processor -- start 2023-11-28T19:59:28.730 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:28.695+0000 7efc9089c640 1 -- 172.21.15.78:0/170885661 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efc8c152b10 con 0x7efc8c0c5520 2023-11-28T19:59:28.730 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:28.695+0000 7f3b34ff9640 1 -- 172.21.15.78:0/1464807541 <== mon.1 v2:172.21.15.179:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f3b280aa070 con 0x7f3b3806bf50 2023-11-28T19:59:28.731 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:28.695+0000 7feb9effd640 1 -- 172.21.15.78:0/676082135 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb880a7050 con 0x7feba00bd550 2023-11-28T19:59:28.731 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:28.695+0000 7feb9effd640 1 -- 172.21.15.78:0/676082135 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb880ab980 con 0x7feba00bd550 2023-11-28T19:59:28.731 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:28.695+0000 7feba5ff5640 1 -- 172.21.15.78:0/676082135 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7feba00bd550 msgr2=0x7feba00c4b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:28.732 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:28.695+0000 7feba5ff5640 1 --2- 172.21.15.78:0/676082135 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7feba00bd550 0x7feba00c4b90 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7feba006a870 tx=0x7feb8801c450 comp rx=0 tx=0).stop 2023-11-28T19:59:28.732 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:28.695+0000 7feba5ff5640 1 -- 172.21.15.78:0/676082135 shutdown_connections 2023-11-28T19:59:28.732 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:28.695+0000 7feba5ff5640 1 --2- 172.21.15.78:0/676082135 >> v2:172.21.15.78:3300/0 conn(0x7feba0155950 0x7feba01582f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:28.732 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:28.695+0000 7feba5ff5640 1 --2- 172.21.15.78:0/676082135 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7feba00bd550 0x7feba00c4b90 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:28.732 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:28.695+0000 7f93da1c4640 1 -- start start 2023-11-28T19:59:28.732 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:28.695+0000 7f93da1c4640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f93d406c7b0 0x7f93d40be5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:28.733 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:28.695+0000 7f93da1c4640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f93d40ca5f0 0x7f93d40ae500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:28.733 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:28.695+0000 7f93da1c4640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f93d4155fc0 0x7f93d40c2f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:28.733 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:28.695+0000 7feba5ff5640 1 -- 172.21.15.78:0/676082135 >> 172.21.15.78:0/676082135 conn(0x7feba00aba00 msgr2=0x7feba00abe10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T19:59:28.733 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:28.699+0000 7f3b34ff9640 1 --2- 172.21.15.78:0/1464807541 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f3b24066570 0x7f3b24068a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:28.734 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:28.699+0000 7f3b34ff9640 1 -- 172.21.15.78:0/1464807541 <== mon.1 v2:172.21.15.179:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f3b280b9070 con 0x7f3b3806bf50 2023-11-28T19:59:28.734 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:28.699+0000 7f93d37fe640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f93d406c7b0 0x7f93d40be5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:28.734 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:28.699+0000 7f93d37fe640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f93d406c7b0 0x7f93d40be5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.78:50112/0 (socket says 172.21.15.78:50112) 2023-11-28T19:59:28.734 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:28.699+0000 7f93d2ffd640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f93d40ca5f0 0x7f93d40ae500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:28.734 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:28.699+0000 7f93d2ffd640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f93d40ca5f0 0x7f93d40ae500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3301/0 says I am v2:172.21.15.78:48082/0 (socket says 172.21.15.78:48082) 2023-11-28T19:59:28.735 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:28.699+0000 7f93d37fe640 1 -- 172.21.15.78:0/2302045593 learned_addr learned my addr 172.21.15.78:0/2302045593 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T19:59:28.735 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:28.699+0000 7f93da1c4640 1 -- 172.21.15.78:0/2302045593 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93d40c0aa0 con 0x7f93d4155fc0 2023-11-28T19:59:28.735 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:28.699+0000 7f93da1c4640 1 -- 172.21.15.78:0/2302045593 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93d40be280 con 0x7f93d406c7b0 2023-11-28T19:59:28.735 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:28.699+0000 7f93da1c4640 1 -- 172.21.15.78:0/2302045593 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f93d40af6f0 con 0x7f93d40ca5f0 2023-11-28T19:59:28.735 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:28.695+0000 7fb0fffff640 1 -- 172.21.15.78:0/2664318734 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1000a5890 con 0x7fb10806c070 2023-11-28T19:59:28.735 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:28.695+0000 7fb0fffff640 1 -- 172.21.15.78:0/2664318734 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb1000a59f0 con 0x7fb10806c070 2023-11-28T19:59:28.735 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:28.695+0000 7fb0fffff640 1 -- 172.21.15.78:0/2664318734 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1000a5d80 con 0x7fb10806c070 2023-11-28T19:59:28.735 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:28.695+0000 7fb10f780640 1 -- 172.21.15.78:0/2664318734 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb10806c070 msgr2=0x7fb1081594e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:28.736 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:28.695+0000 7fb10f780640 1 --2- 172.21.15.78:0/2664318734 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb10806c070 0x7fb1081594e0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fb100009d90 tx=0x7fb10001c8c0 comp rx=0 tx=0).stop 2023-11-28T19:59:28.736 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:28.699+0000 7fb10f780640 1 -- 172.21.15.78:0/2664318734 shutdown_connections 2023-11-28T19:59:28.736 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:28.699+0000 7fb10f780640 1 --2- 172.21.15.78:0/2664318734 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb10806c070 0x7fb1081594e0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:28.736 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:28.699+0000 7fb10f780640 1 -- 172.21.15.78:0/2664318734 >> 172.21.15.78:0/2664318734 conn(0x7fb1080aba00 msgr2=0x7fb1080abe10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T19:59:28.736 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:28.695+0000 7efc7affd640 1 -- 172.21.15.78:0/170885661 <== mon.1 v2:172.21.15.179:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7efc7c013470 con 0x7efc8c0c5520 2023-11-28T19:59:28.736 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:28.699+0000 7efc7affd640 1 --2- 172.21.15.78:0/170885661 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7efc6c0664c0 0x7efc6c068980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:28.736 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:28.699+0000 7efc7affd640 1 -- 172.21.15.78:0/170885661 <== mon.1 v2:172.21.15.179:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7efc7c084530 con 0x7efc8c0c5520 2023-11-28T19:59:28.737 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:28.699+0000 7feba5ff5640 1 -- 172.21.15.78:0/676082135 shutdown_connections 2023-11-28T19:59:28.737 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:28.699+0000 7feba5ff5640 1 -- 172.21.15.78:0/676082135 wait complete. 2023-11-28T19:59:28.738 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:28.699+0000 7f93d3fff640 1 --2- 172.21.15.78:0/2302045593 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f93d4155fc0 0x7f93d40c2f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:28.738 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:28.699+0000 7f93d2ffd640 1 -- 172.21.15.78:0/2302045593 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f93d406c7b0 msgr2=0x7f93d40be5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:28.738 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:28.699+0000 7f93d2ffd640 1 --2- 172.21.15.78:0/2302045593 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f93d406c7b0 0x7f93d40be5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:28.738 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:28.699+0000 7f93d2ffd640 1 -- 172.21.15.78:0/2302045593 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f93d4155fc0 msgr2=0x7f93d40c2f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:28.738 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:28.699+0000 7f93d2ffd640 1 --2- 172.21.15.78:0/2302045593 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f93d4155fc0 0x7f93d40c2f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:28.738 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:28.699+0000 7f93d2ffd640 1 -- 172.21.15.78:0/2302045593 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93c4009a70 con 0x7f93d40ca5f0 2023-11-28T19:59:28.738 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:28.699+0000 7efc8a59c640 1 --2- 172.21.15.78:0/170885661 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7efc6c0664c0 0x7efc6c068980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:28.739 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:28.699+0000 7f93d2ffd640 1 --2- 172.21.15.78:0/2302045593 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f93d40ca5f0 0x7f93d40ae500 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f93d40c7790 tx=0x7f93d4159960 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:59:28.739 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:28.699+0000 7fb10f780640 1 -- 172.21.15.78:0/2664318734 shutdown_connections 2023-11-28T19:59:28.739 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:28.699+0000 7f3b377fe640 1 --2- 172.21.15.78:0/1464807541 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f3b24066570 0x7f3b24068a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:28.740 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:28.699+0000 7fb10f780640 1 -- 172.21.15.78:0/2664318734 wait complete. 2023-11-28T19:59:28.740 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:28.699+0000 7f93bbfff640 1 -- 172.21.15.78:0/2302045593 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93c40ad640 con 0x7f93d40ca5f0 2023-11-28T19:59:28.740 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:28.699+0000 7f93da1c4640 1 -- 172.21.15.78:0/2302045593 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f93d40af410 con 0x7f93d40ca5f0 2023-11-28T19:59:28.740 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:28.699+0000 7feba5ff5640 1 Processor -- start 2023-11-28T19:59:28.741 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:28.699+0000 7efc8a59c640 1 --2- 172.21.15.78:0/170885661 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7efc6c0664c0 0x7efc6c068980 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7efc840072e0 tx=0x7efc8400b040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:59:28.741 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:28.703+0000 7f3b377fe640 1 --2- 172.21.15.78:0/1464807541 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f3b24066570 0x7f3b24068a30 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f3b2c000f70 tx=0x7f3b2c0079b0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:59:28.741 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:28.703+0000 7feba5ff5640 1 -- start start 2023-11-28T19:59:28.742 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:28.699+0000 7f93bbfff640 1 -- 172.21.15.78:0/2302045593 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f93c40ad7a0 con 0x7f93d40ca5f0 2023-11-28T19:59:28.742 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:28.699+0000 7f93bbfff640 1 -- 172.21.15.78:0/2302045593 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93c40ad640 con 0x7f93d40ca5f0 2023-11-28T19:59:28.742 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:28.699+0000 7f93da1c4640 1 -- 172.21.15.78:0/2302045593 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f93d40c0730 con 0x7f93d40ca5f0 2023-11-28T19:59:28.742 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:28.703+0000 7fb10f780640 1 Processor -- start 2023-11-28T19:59:28.743 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:28.703+0000 7f3b34ff9640 1 -- 172.21.15.78:0/1464807541 <== mon.1 v2:172.21.15.179:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f3b280ebd70 con 0x7f3b3806bf50 2023-11-28T19:59:28.743 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:28.703+0000 7f93b9ffb640 1 -- 172.21.15.78:0/2302045593 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f93ac005260 con 0x7f93d40ca5f0 2023-11-28T19:59:28.743 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:28.703+0000 7fb10f780640 1 -- start start 2023-11-28T19:59:28.744 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:28.703+0000 7feba5ff5640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7feba00bd550 0x7feba01ecac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:28.744 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:28.703+0000 7feba5ff5640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7feba00c47b0 0x7feba0150730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:28.744 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:28.703+0000 7feba5ff5640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7feba0155950 0x7feba00c8e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:28.744 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:28.703+0000 7feba5ff5640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feba00c7dd0 con 0x7feba0155950 2023-11-28T19:59:28.744 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:28.703+0000 7feba5ff5640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feba00c8070 con 0x7feba00bd550 2023-11-28T19:59:28.744 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:28.703+0000 7feba5ff5640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feba00c8350 con 0x7feba00c47b0 2023-11-28T19:59:28.745 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:28.703+0000 7feb9f7fe640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7feba00bd550 0x7feba01ecac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:28.745 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:28.703+0000 7feb9f7fe640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7feba00bd550 0x7feba01ecac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.78:50114/0 (socket says 172.21.15.78:50114) 2023-11-28T19:59:28.745 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:28.703+0000 7feb9f7fe640 1 -- 172.21.15.78:0/4108885733 learned_addr learned my addr 172.21.15.78:0/4108885733 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T19:59:28.745 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:28.703+0000 7feb96ffd640 1 --2- 172.21.15.78:0/4108885733 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7feba00c47b0 0x7feba0150730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:28.745 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:28.703+0000 7feb9ffff640 1 --2- 172.21.15.78:0/4108885733 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7feba0155950 0x7feba00c8e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:28.746 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:28.703+0000 7fb10f780640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb10806c070 0x7fb1080adda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:28.746 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:28.703+0000 7fb10f780640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb1080bd480 0x7fb1081549b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:28.746 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:28.703+0000 7fb10f780640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb1080c6aa0 0x7fb108154ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:28.746 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:28.703+0000 7fb10f780640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1080c3d40 con 0x7fb1080bd480 2023-11-28T19:59:28.746 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:28.703+0000 7fb10f780640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb108155dd0 con 0x7fb10806c070 2023-11-28T19:59:28.746 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:28.703+0000 7fb10f780640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb108155b00 con 0x7fb1080c6aa0 2023-11-28T19:59:28.747 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:28.703+0000 7fb10d51c640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb10806c070 0x7fb1080adda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:28.747 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:28.703+0000 7fb10dd1d640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb1080c6aa0 0x7fb108154ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:28.747 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:28.703+0000 7fb10dd1d640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb1080c6aa0 0x7fb108154ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3301/0 says I am v2:172.21.15.78:48088/0 (socket says 172.21.15.78:48088) 2023-11-28T19:59:28.747 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:28.703+0000 7fb10dd1d640 1 -- 172.21.15.78:0/2507223805 learned_addr learned my addr 172.21.15.78:0/2507223805 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T19:59:28.747 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:28.703+0000 7feb96ffd640 1 -- 172.21.15.78:0/4108885733 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7feba00bd550 msgr2=0x7feba01ecac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:28.748 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:28.703+0000 7feb96ffd640 1 --2- 172.21.15.78:0/4108885733 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7feba00bd550 0x7feba01ecac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:28.748 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:28.703+0000 7feb96ffd640 1 -- 172.21.15.78:0/4108885733 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7feba0155950 msgr2=0x7feba00c8e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:28.748 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:28.703+0000 7feb96ffd640 1 --2- 172.21.15.78:0/4108885733 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7feba0155950 0x7feba00c8e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:28.748 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:28.703+0000 7feb96ffd640 1 -- 172.21.15.78:0/4108885733 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb880094d0 con 0x7feba00c47b0 2023-11-28T19:59:28.748 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:28.703+0000 7fb10dd1d640 1 -- 172.21.15.78:0/2507223805 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb10806c070 msgr2=0x7fb1080adda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:28.749 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:28.707+0000 7feb96ffd640 1 --2- 172.21.15.78:0/4108885733 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7feba00c47b0 0x7feba0150730 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7feb880ab000 tx=0x7feb880191f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:59:28.749 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:28.703+0000 7f93bbfff640 1 -- 172.21.15.78:0/2302045593 <== mon.2 v2:172.21.15.179:3301/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f93c40b4040 con 0x7f93d40ca5f0 2023-11-28T19:59:28.749 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:28.703+0000 7f93bbfff640 1 --2- 172.21.15.78:0/2302045593 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f93c0066500 0x7f93c00689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:28.749 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:28.707+0000 7f93bbfff640 1 -- 172.21.15.78:0/2302045593 <== mon.2 v2:172.21.15.179:3301/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f93c411dc10 con 0x7f93d40ca5f0 2023-11-28T19:59:28.750 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:28.703+0000 7fb10dd1d640 1 --2- 172.21.15.78:0/2507223805 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb10806c070 0x7fb1080adda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:28.750 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:28.703+0000 7fb10dd1d640 1 -- 172.21.15.78:0/2507223805 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb1080bd480 msgr2=0x7fb1081549b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:28.750 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:28.707+0000 7fb10dd1d640 1 --2- 172.21.15.78:0/2507223805 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb1080bd480 0x7fb1081549b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:28.750 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:28.707+0000 7fb10dd1d640 1 -- 172.21.15.78:0/2507223805 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb100009a70 con 0x7fb1080c6aa0 2023-11-28T19:59:28.750 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:28.707+0000 7fb10dd1d640 1 --2- 172.21.15.78:0/2507223805 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb1080c6aa0 0x7fb108154ef0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fb1000194d0 tx=0x7fb100019660 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:59:28.750 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:28.707+0000 7efc7affd640 1 -- 172.21.15.78:0/170885661 <== mon.1 v2:172.21.15.179:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7efc8c152b10 con 0x7efc8c0c5520 2023-11-28T19:59:28.751 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:28.707+0000 7f93d37fe640 1 --2- 172.21.15.78:0/2302045593 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f93c0066500 0x7f93c00689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:28.751 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:28.707+0000 7f93d37fe640 1 --2- 172.21.15.78:0/2302045593 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f93c0066500 0x7f93c00689c0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f93c8006fd0 tx=0x7f93c8008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:59:28.751 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:28.707+0000 7fb0fdffb640 1 -- 172.21.15.78:0/2507223805 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1000ad440 con 0x7fb1080c6aa0 2023-11-28T19:59:28.751 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:28.707+0000 7fb0fdffb640 1 -- 172.21.15.78:0/2507223805 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb1000ad5a0 con 0x7fb1080c6aa0 2023-11-28T19:59:28.752 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:28.707+0000 7fb0fdffb640 1 -- 172.21.15.78:0/2507223805 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1000ad930 con 0x7fb1080c6aa0 2023-11-28T19:59:28.752 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:28.707+0000 7feb9cff9640 1 -- 172.21.15.78:0/4108885733 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb880b5440 con 0x7feba00c47b0 2023-11-28T19:59:28.752 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:28.707+0000 7feb9cff9640 1 -- 172.21.15.78:0/4108885733 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb880b55a0 con 0x7feba00c47b0 2023-11-28T19:59:28.752 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:28.707+0000 7feb9cff9640 1 -- 172.21.15.78:0/4108885733 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb880b5930 con 0x7feba00c47b0 2023-11-28T19:59:28.752 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:28.707+0000 7feba5ff5640 1 -- 172.21.15.78:0/4108885733 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feba00c8630 con 0x7feba00c47b0 2023-11-28T19:59:28.752 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:28.711+0000 7feba5ff5640 1 -- 172.21.15.78:0/4108885733 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feba01edf30 con 0x7feba00c47b0 2023-11-28T19:59:28.753 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:28.711+0000 7fb10f780640 1 -- 172.21.15.78:0/2507223805 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb1080c2450 con 0x7fb1080c6aa0 2023-11-28T19:59:28.753 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:28.711+0000 7fb10f780640 1 -- 172.21.15.78:0/2507223805 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb1080ab5e0 con 0x7fb1080c6aa0 2023-11-28T19:59:28.753 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:28.711+0000 7f93bbfff640 1 -- 172.21.15.78:0/2302045593 <== mon.2 v2:172.21.15.179:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f93c40eae70 con 0x7f93d40ca5f0 2023-11-28T19:59:28.754 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:28.711+0000 7feba5ff5640 1 -- 172.21.15.78:0/4108885733 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feba01ee120 con 0x7feba00c47b0 2023-11-28T19:59:28.754 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:28.711+0000 7fb10f780640 1 -- 172.21.15.78:0/2507223805 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb1080c54b0 con 0x7fb1080c6aa0 2023-11-28T19:59:28.754 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:28.715+0000 7feb9cff9640 1 -- 172.21.15.78:0/4108885733 <== mon.2 v2:172.21.15.179:3301/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7feb880b5a90 con 0x7feba00c47b0 2023-11-28T19:59:28.755 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:28.715+0000 7feb9cff9640 1 --2- 172.21.15.78:0/4108885733 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7feb80066570 0x7feb80068a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:28.755 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:28.715+0000 7feb9cff9640 1 -- 172.21.15.78:0/4108885733 <== mon.2 v2:172.21.15.179:3301/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7feb8811e530 con 0x7feba00c47b0 2023-11-28T19:59:28.755 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:28.715+0000 7fb0fdffb640 1 -- 172.21.15.78:0/2507223805 <== mon.2 v2:172.21.15.179:3301/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fb1000adca0 con 0x7fb1080c6aa0 2023-11-28T19:59:28.755 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:28.715+0000 7feb9f7fe640 1 --2- 172.21.15.78:0/4108885733 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7feb80066570 0x7feb80068a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:28.756 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:28.719+0000 7fb0fdffb640 1 --2- 172.21.15.78:0/2507223805 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fb0ec066540 0x7fb0ec068a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:28.756 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:28.719+0000 7fb0fdffb640 1 -- 172.21.15.78:0/2507223805 <== mon.2 v2:172.21.15.179:3301/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fb10011f650 con 0x7fb1080c6aa0 2023-11-28T19:59:28.756 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:28.719+0000 7fb0fdffb640 1 -- 172.21.15.78:0/2507223805 <== mon.2 v2:172.21.15.179:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fb10011fa30 con 0x7fb1080c6aa0 2023-11-28T19:59:28.756 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:28.719+0000 7fb10d51c640 1 --2- 172.21.15.78:0/2507223805 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fb0ec066540 0x7fb0ec068a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:28.756 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:28.719+0000 7fb10d51c640 1 --2- 172.21.15.78:0/2507223805 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fb0ec066540 0x7fb0ec068a00 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fb104007fd0 tx=0x7fb104009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:59:28.757 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:28.719+0000 7feb9f7fe640 1 --2- 172.21.15.78:0/4108885733 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7feb80066570 0x7feb80068a30 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7feb90007fd0 tx=0x7feb90005050 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:59:28.757 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:28.723+0000 7feb9cff9640 1 -- 172.21.15.78:0/4108885733 <== mon.2 v2:172.21.15.179:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7feb880eb730 con 0x7feba00c47b0 2023-11-28T19:59:28.942 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:28.935+0000 7f18b9a32640 1 -- 172.21.15.78:0/4029163158 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7f18b4071f20 con 0x7f18b414daa0 2023-11-28T19:59:28.942 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:28.935+0000 7f189bfff640 1 -- 172.21.15.78:0/4029163158 <== mon.1 v2:172.21.15.179:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f18a4054810 con 0x7f18b414daa0 2023-11-28T19:59:28.942 INFO:teuthology.orchestra.run.smithi078.stdout:55834574857 2023-11-28T19:59:28.945 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:28.939+0000 7f18b9a32640 1 -- 172.21.15.78:0/4029163158 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f18a0066570 msgr2=0x7f18a0068a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:28.946 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:28.939+0000 7f18b9a32640 1 --2- 172.21.15.78:0/4029163158 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f18a0066570 0x7f18a0068a30 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f18a8001ec0 tx=0x7f18a8009040 comp rx=0 tx=0).stop 2023-11-28T19:59:28.946 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:28.939+0000 7f18b9a32640 1 -- 172.21.15.78:0/4029163158 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f18b414daa0 msgr2=0x7f18b4072270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:28.946 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:28.939+0000 7f18b9a32640 1 --2- 172.21.15.78:0/4029163158 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f18b414daa0 0x7f18b4072270 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f18a400e950 tx=0x7f18a400ee10 comp rx=0 tx=0).stop 2023-11-28T19:59:28.947 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:28.939+0000 7f18b9a32640 1 -- 172.21.15.78:0/4029163158 shutdown_connections 2023-11-28T19:59:28.947 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:28.939+0000 7f18b9a32640 1 --2- 172.21.15.78:0/4029163158 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f18a0066570 0x7f18a0068a30 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:28.947 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:28.939+0000 7f18b9a32640 1 --2- 172.21.15.78:0/4029163158 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f18b40a5050 0x7f18b406a810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:28.947 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:28.939+0000 7f18b9a32640 1 --2- 172.21.15.78:0/4029163158 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f18b414daa0 0x7f18b4072270 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:28.947 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:28.939+0000 7f18b9a32640 1 --2- 172.21.15.78:0/4029163158 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f18b406bb40 0x7f18b41ed530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:28.947 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:28.939+0000 7f18b9a32640 1 -- 172.21.15.78:0/4029163158 >> 172.21.15.78:0/4029163158 conn(0x7f18b40a7520 msgr2=0x7f18b40a6dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T19:59:28.951 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:28.947+0000 7f18b9a32640 1 -- 172.21.15.78:0/4029163158 shutdown_connections 2023-11-28T19:59:28.951 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:28.947+0000 7f18b9a32640 1 -- 172.21.15.78:0/4029163158 wait complete. 2023-11-28T19:59:28.983 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574857 got 55834574857 for osd.4 2023-11-28T19:59:28.983 DEBUG:teuthology.parallel:result is None 2023-11-28T19:59:28.999 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:28.991+0000 7f3af71aa640 1 -- 172.21.15.78:0/935838925 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f3af006ad00 con 0x7f3af00c5520 2023-11-28T19:59:28.999 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:28.995+0000 7f3aed7fa640 1 -- 172.21.15.78:0/935838925 <== mon.1 v2:172.21.15.179:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f3ae40c4020 con 0x7f3af00c5520 2023-11-28T19:59:28.999 INFO:teuthology.orchestra.run.smithi078.stdout:55834574858 2023-11-28T19:59:29.002 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:28.995+0000 7f3af71aa640 1 -- 172.21.15.78:0/935838925 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f3ad4066470 msgr2=0x7f3ad4068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:29.003 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:28.995+0000 7f3af71aa640 1 --2- 172.21.15.78:0/935838925 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f3ad4066470 0x7f3ad4068930 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f3af01f12f0 tx=0x7f3adc007930 comp rx=0 tx=0).stop 2023-11-28T19:59:29.003 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:28.999+0000 7f3af71aa640 1 -- 172.21.15.78:0/935838925 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3af00c5520 msgr2=0x7f3af01ecca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:29.003 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:28.999+0000 7f3af71aa640 1 --2- 172.21.15.78:0/935838925 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3af00c5520 0x7f3af01ecca0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f3ae40ad040 tx=0x7f3ae401ace0 comp rx=0 tx=0).stop 2023-11-28T19:59:29.004 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:28.999+0000 7f3af71aa640 1 -- 172.21.15.78:0/935838925 shutdown_connections 2023-11-28T19:59:29.004 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:28.999+0000 7f3af71aa640 1 --2- 172.21.15.78:0/935838925 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f3ad4066470 0x7f3ad4068930 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:29.004 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:28.999+0000 7f3af71aa640 1 --2- 172.21.15.78:0/935838925 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3af0151ae0 0x7f3af01ef760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:29.004 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:28.999+0000 7f3af71aa640 1 --2- 172.21.15.78:0/935838925 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3af00c8000 0x7f3af00c10d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:29.004 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:28.999+0000 7f3af71aa640 1 --2- 172.21.15.78:0/935838925 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3af00c5520 0x7f3af01ecca0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:29.005 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:28.999+0000 7f3af71aa640 1 -- 172.21.15.78:0/935838925 >> 172.21.15.78:0/935838925 conn(0x7f3af00ca000 msgr2=0x7f3af00bf1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T19:59:29.005 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:28.999+0000 7f3af71aa640 1 -- 172.21.15.78:0/935838925 shutdown_connections 2023-11-28T19:59:29.005 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:28.999+0000 7f3af71aa640 1 -- 172.21.15.78:0/935838925 wait complete. 2023-11-28T19:59:29.016 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:29.011+0000 7fb6c88e9640 1 -- 172.21.15.78:0/3694544363 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fb6c414ce00 con 0x7fb6c40c45b0 2023-11-28T19:59:29.017 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:29.011+0000 7f93b9ffb640 1 -- 172.21.15.78:0/2302045593 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7f93ac005510 con 0x7f93d40ca5f0 2023-11-28T19:59:29.018 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:29.011+0000 7f93bbfff640 1 -- 172.21.15.78:0/2302045593 <== mon.2 v2:172.21.15.179:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f93c40ee490 con 0x7f93d40ca5f0 2023-11-28T19:59:29.018 INFO:teuthology.orchestra.run.smithi078.stdout:55834574858 2023-11-28T19:59:29.019 INFO:teuthology.orchestra.run.smithi078.stdout:55834574856 2023-11-28T19:59:29.019 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:29.011+0000 7fb6ab7fe640 1 -- 172.21.15.78:0/3694544363 <== mon.2 v2:172.21.15.179:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fb6c414ce00 con 0x7fb6c40c45b0 2023-11-28T19:59:29.022 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:29.015+0000 7f93b9ffb640 1 -- 172.21.15.78:0/2302045593 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f93c0066500 msgr2=0x7f93c00689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:29.022 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:29.015+0000 7f93b9ffb640 1 --2- 172.21.15.78:0/2302045593 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f93c0066500 0x7f93c00689c0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f93c8006fd0 tx=0x7f93c8008040 comp rx=0 tx=0).stop 2023-11-28T19:59:29.022 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:29.015+0000 7f93b9ffb640 1 -- 172.21.15.78:0/2302045593 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f93d40ca5f0 msgr2=0x7f93d40ae500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:29.022 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:29.015+0000 7f93b9ffb640 1 --2- 172.21.15.78:0/2302045593 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f93d40ca5f0 0x7f93d40ae500 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f93d40c7790 tx=0x7f93d4159960 comp rx=0 tx=0).stop 2023-11-28T19:59:29.023 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:29.015+0000 7fb6c88e9640 1 -- 172.21.15.78:0/3694544363 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fb6b0066570 msgr2=0x7fb6b0068a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:29.023 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:29.015+0000 7fb6c88e9640 1 --2- 172.21.15.78:0/3694544363 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fb6b0066570 0x7fb6b0068a30 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fb6c414b5a0 tx=0x7fb6b8009040 comp rx=0 tx=0).stop 2023-11-28T19:59:29.023 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:29.015+0000 7fb6c88e9640 1 -- 172.21.15.78:0/3694544363 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb6c40c45b0 msgr2=0x7fb6c414da80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:29.023 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:29.015+0000 7fb6c88e9640 1 --2- 172.21.15.78:0/3694544363 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb6c40c45b0 0x7fb6c414da80 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fb6b40ae040 tx=0x7fb6b4018fe0 comp rx=0 tx=0).stop 2023-11-28T19:59:29.023 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:29.015+0000 7f93b9ffb640 1 -- 172.21.15.78:0/2302045593 shutdown_connections 2023-11-28T19:59:29.023 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:29.015+0000 7f93b9ffb640 1 --2- 172.21.15.78:0/2302045593 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f93c0066500 0x7f93c00689c0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:29.023 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:29.015+0000 7f93b9ffb640 1 --2- 172.21.15.78:0/2302045593 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f93d40ca5f0 0x7f93d40ae500 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:29.024 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:29.015+0000 7f93b9ffb640 1 --2- 172.21.15.78:0/2302045593 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f93d4155fc0 0x7f93d40c2f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:29.024 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:29.015+0000 7f93b9ffb640 1 --2- 172.21.15.78:0/2302045593 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f93d406c7b0 0x7f93d40be5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:29.024 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:29.015+0000 7f93b9ffb640 1 -- 172.21.15.78:0/2302045593 >> 172.21.15.78:0/2302045593 conn(0x7f93d40666a0 msgr2=0x7f93d4157e60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T19:59:29.024 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:29.019+0000 7fb6c88e9640 1 -- 172.21.15.78:0/3694544363 shutdown_connections 2023-11-28T19:59:29.024 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:29.019+0000 7fb6c88e9640 1 --2- 172.21.15.78:0/3694544363 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fb6b0066570 0x7fb6b0068a30 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:29.024 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:29.019+0000 7fb6c88e9640 1 --2- 172.21.15.78:0/3694544363 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb6c41519b0 0x7fb6c4155e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:29.024 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:29.019+0000 7fb6c88e9640 1 --2- 172.21.15.78:0/3694544363 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb6c40c94b0 0x7fb6c41536b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:29.024 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:29.019+0000 7fb6c88e9640 1 --2- 172.21.15.78:0/3694544363 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb6c40c45b0 0x7fb6c414da80 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:29.025 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:29.019+0000 7fb6c88e9640 1 -- 172.21.15.78:0/3694544363 >> 172.21.15.78:0/3694544363 conn(0x7fb6c4066cd0 msgr2=0x7fb6c406af80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T19:59:29.025 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:29.019+0000 7fb6c88e9640 1 -- 172.21.15.78:0/3694544363 shutdown_connections 2023-11-28T19:59:29.025 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:29.019+0000 7fb6c88e9640 1 -- 172.21.15.78:0/3694544363 wait complete. 2023-11-28T19:59:29.025 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:29.019+0000 7f93b9ffb640 1 -- 172.21.15.78:0/2302045593 shutdown_connections 2023-11-28T19:59:29.025 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:29.019+0000 7f93b9ffb640 1 -- 172.21.15.78:0/2302045593 wait complete. 2023-11-28T19:59:29.034 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574858 got 55834574858 for osd.1 2023-11-28T19:59:29.034 DEBUG:teuthology.parallel:result is None 2023-11-28T19:59:29.040 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:29.035+0000 7feba5ff5640 1 -- 172.21.15.78:0/4108885733 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7feba00c81b0 con 0x7feba00c47b0 2023-11-28T19:59:29.040 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:29.035+0000 7feb9cff9640 1 -- 172.21.15.78:0/4108885733 <== mon.2 v2:172.21.15.179:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7feba00c81b0 con 0x7feba00c47b0 2023-11-28T19:59:29.041 INFO:teuthology.orchestra.run.smithi078.stdout:55834574858 2023-11-28T19:59:29.043 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:29.039+0000 7feba5ff5640 1 -- 172.21.15.78:0/4108885733 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7feb80066570 msgr2=0x7feb80068a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:29.043 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:29.039+0000 7feba5ff5640 1 --2- 172.21.15.78:0/4108885733 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7feb80066570 0x7feb80068a30 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7feb90007fd0 tx=0x7feb90005050 comp rx=0 tx=0).stop 2023-11-28T19:59:29.043 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:29.039+0000 7feba5ff5640 1 -- 172.21.15.78:0/4108885733 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7feba00c47b0 msgr2=0x7feba0150730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:29.044 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:29.039+0000 7feba5ff5640 1 --2- 172.21.15.78:0/4108885733 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7feba00c47b0 0x7feba0150730 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7feb880ab000 tx=0x7feb880191f0 comp rx=0 tx=0).stop 2023-11-28T19:59:29.044 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:29.039+0000 7f3b3e7d1640 1 -- 172.21.15.78:0/1464807541 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7f3b38067630 con 0x7f3b3806bf50 2023-11-28T19:59:29.044 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:29.039+0000 7feba5ff5640 1 -- 172.21.15.78:0/4108885733 shutdown_connections 2023-11-28T19:59:29.044 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:29.039+0000 7feba5ff5640 1 --2- 172.21.15.78:0/4108885733 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7feb80066570 0x7feb80068a30 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:29.045 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:29.039+0000 7feba5ff5640 1 --2- 172.21.15.78:0/4108885733 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7feba00c47b0 0x7feba0150730 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:29.045 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:29.039+0000 7feba5ff5640 1 --2- 172.21.15.78:0/4108885733 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7feba0155950 0x7feba00c8e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:29.045 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:29.039+0000 7feba5ff5640 1 --2- 172.21.15.78:0/4108885733 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7feba00bd550 0x7feba01ecac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:29.046 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:29.039+0000 7feba5ff5640 1 -- 172.21.15.78:0/4108885733 >> 172.21.15.78:0/4108885733 conn(0x7feba00aba00 msgr2=0x7feba006b1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T19:59:29.046 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:29.039+0000 7f3b34ff9640 1 -- 172.21.15.78:0/1464807541 <== mon.1 v2:172.21.15.179:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f3b280ef390 con 0x7f3b3806bf50 2023-11-28T19:59:29.046 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:29.039+0000 7feba5ff5640 1 -- 172.21.15.78:0/4108885733 shutdown_connections 2023-11-28T19:59:29.048 INFO:teuthology.orchestra.run.smithi078.stdout:55834574856 2023-11-28T19:59:29.048 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:29.039+0000 7feba5ff5640 1 -- 172.21.15.78:0/4108885733 wait complete. 2023-11-28T19:59:29.048 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:29.039+0000 7fb10f780640 1 -- 172.21.15.78:0/2507223805 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fb10806c8a0 con 0x7fb1080c6aa0 2023-11-28T19:59:29.048 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:29.043+0000 7f3b3e7d1640 1 -- 172.21.15.78:0/1464807541 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f3b24066570 msgr2=0x7f3b24068a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:29.049 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:29.043+0000 7f3b3e7d1640 1 --2- 172.21.15.78:0/1464807541 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f3b24066570 0x7f3b24068a30 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f3b2c000f70 tx=0x7f3b2c0079b0 comp rx=0 tx=0).stop 2023-11-28T19:59:29.049 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:29.043+0000 7fb0fdffb640 1 -- 172.21.15.78:0/2507223805 <== mon.2 v2:172.21.15.179:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fb1000c6020 con 0x7fb1080c6aa0 2023-11-28T19:59:29.049 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:29.043+0000 7f3b3e7d1640 1 -- 172.21.15.78:0/1464807541 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3b3806bf50 msgr2=0x7f3b3814ec30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:29.049 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:29.043+0000 7f3b3e7d1640 1 --2- 172.21.15.78:0/1464807541 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3b3806bf50 0x7f3b3814ec30 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f3b2801a080 tx=0x7f3b2801a210 comp rx=0 tx=0).stop 2023-11-28T19:59:29.049 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:29.043+0000 7f3b3e7d1640 1 -- 172.21.15.78:0/1464807541 shutdown_connections 2023-11-28T19:59:29.050 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:29.043+0000 7f3b3e7d1640 1 --2- 172.21.15.78:0/1464807541 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f3b24066570 0x7f3b24068a30 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:29.050 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:29.043+0000 7f3b3e7d1640 1 --2- 172.21.15.78:0/1464807541 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3b3814dce0 0x7f3b381f1ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:29.050 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:29.043+0000 7f3b3e7d1640 1 --2- 172.21.15.78:0/1464807541 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3b380c5f80 0x7f3b381f1960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:29.050 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:29.043+0000 7f3b3e7d1640 1 --2- 172.21.15.78:0/1464807541 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3b3806bf50 0x7f3b3814ec30 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:29.050 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:29.043+0000 7f3b3e7d1640 1 -- 172.21.15.78:0/1464807541 >> 172.21.15.78:0/1464807541 conn(0x7f3b3806ad70 msgr2=0x7f3b380a9ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T19:59:29.050 INFO:teuthology.orchestra.run.smithi078.stdout:55834574857 2023-11-28T19:59:29.051 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:29.043+0000 7f3b3e7d1640 1 -- 172.21.15.78:0/1464807541 shutdown_connections 2023-11-28T19:59:29.051 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:29.043+0000 7f3b3e7d1640 1 -- 172.21.15.78:0/1464807541 wait complete. 2023-11-28T19:59:29.051 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:29.043+0000 7efc9089c640 1 -- 172.21.15.78:0/170885661 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7efc8c152b10 con 0x7efc8c0c5520 2023-11-28T19:59:29.052 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:29.047+0000 7fb10f780640 1 -- 172.21.15.78:0/2507223805 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fb0ec066540 msgr2=0x7fb0ec068a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:29.052 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:29.047+0000 7fb10f780640 1 --2- 172.21.15.78:0/2507223805 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fb0ec066540 0x7fb0ec068a00 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fb104007fd0 tx=0x7fb104009040 comp rx=0 tx=0).stop 2023-11-28T19:59:29.052 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:29.047+0000 7efc7affd640 1 -- 172.21.15.78:0/170885661 <== mon.1 v2:172.21.15.179:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7efc7c021020 con 0x7efc8c0c5520 2023-11-28T19:59:29.052 INFO:teuthology.orchestra.run.smithi078.stdout:55834574858 2023-11-28T19:59:29.053 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:29.047+0000 7fb10f780640 1 -- 172.21.15.78:0/2507223805 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb1080c6aa0 msgr2=0x7fb108154ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:29.053 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:29.047+0000 7fb10f780640 1 --2- 172.21.15.78:0/2507223805 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb1080c6aa0 0x7fb108154ef0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fb1000194d0 tx=0x7fb100019660 comp rx=0 tx=0).stop 2023-11-28T19:59:29.053 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:29.047+0000 7fb10f780640 1 -- 172.21.15.78:0/2507223805 shutdown_connections 2023-11-28T19:59:29.054 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:29.047+0000 7fb10f780640 1 --2- 172.21.15.78:0/2507223805 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fb0ec066540 0x7fb0ec068a00 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:29.054 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:29.047+0000 7fb10f780640 1 --2- 172.21.15.78:0/2507223805 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb1080c6aa0 0x7fb108154ef0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:29.054 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:29.047+0000 7fb10f780640 1 --2- 172.21.15.78:0/2507223805 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb1080bd480 0x7fb1081549b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:29.054 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:29.047+0000 7fb10f780640 1 --2- 172.21.15.78:0/2507223805 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb10806c070 0x7fb1080adda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:29.054 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:29.047+0000 7fb10f780640 1 -- 172.21.15.78:0/2507223805 >> 172.21.15.78:0/2507223805 conn(0x7fb1080aba00 msgr2=0x7fb10806b960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T19:59:29.054 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:29.047+0000 7fb10f780640 1 -- 172.21.15.78:0/2507223805 shutdown_connections 2023-11-28T19:59:29.054 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:29.047+0000 7fb10f780640 1 -- 172.21.15.78:0/2507223805 wait complete. 2023-11-28T19:59:29.055 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:29.047+0000 7efc9089c640 1 -- 172.21.15.78:0/170885661 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7efc6c0664c0 msgr2=0x7efc6c068980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:29.055 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:29.047+0000 7efc9089c640 1 --2- 172.21.15.78:0/170885661 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7efc6c0664c0 0x7efc6c068980 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7efc840072e0 tx=0x7efc8400b040 comp rx=0 tx=0).stop 2023-11-28T19:59:29.055 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:29.047+0000 7efc9089c640 1 -- 172.21.15.78:0/170885661 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7efc8c0c5520 msgr2=0x7efc8c06c2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:29.055 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:29.047+0000 7efc9089c640 1 --2- 172.21.15.78:0/170885661 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7efc8c0c5520 0x7efc8c06c2b0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7efc7c00e9b0 tx=0x7efc7c00ee70 comp rx=0 tx=0).stop 2023-11-28T19:59:29.055 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:29.047+0000 7efc9089c640 1 -- 172.21.15.78:0/170885661 shutdown_connections 2023-11-28T19:59:29.056 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:29.047+0000 7efc9089c640 1 --2- 172.21.15.78:0/170885661 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7efc6c0664c0 0x7efc6c068980 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:29.056 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:29.047+0000 7efc9089c640 1 --2- 172.21.15.78:0/170885661 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7efc8c151ae0 0x7efc8c148d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:29.056 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:29.047+0000 7efc9089c640 1 --2- 172.21.15.78:0/170885661 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7efc8c0c5520 0x7efc8c06c2b0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:29.056 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:29.047+0000 7efc9089c640 1 --2- 172.21.15.78:0/170885661 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7efc8c0bfab0 0x7efc8c1f0810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:29.056 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:29.047+0000 7efc9089c640 1 -- 172.21.15.78:0/170885661 >> 172.21.15.78:0/170885661 conn(0x7efc8c0ca000 msgr2=0x7efc8c1505a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T19:59:29.056 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:29.051+0000 7efc9089c640 1 -- 172.21.15.78:0/170885661 shutdown_connections 2023-11-28T19:59:29.056 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:29.051+0000 7efc9089c640 1 -- 172.21.15.78:0/170885661 wait complete. 2023-11-28T19:59:29.057 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574858 got 55834574858 for osd.7 2023-11-28T19:59:29.058 DEBUG:teuthology.parallel:result is None 2023-11-28T19:59:29.058 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574856 got 55834574856 for osd.2 2023-11-28T19:59:29.058 DEBUG:teuthology.parallel:result is None 2023-11-28T19:59:29.075 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574858 got 55834574858 for osd.3 2023-11-28T19:59:29.075 DEBUG:teuthology.parallel:result is None 2023-11-28T19:59:29.078 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574856 got 55834574856 for osd.6 2023-11-28T19:59:29.078 DEBUG:teuthology.parallel:result is None 2023-11-28T19:59:29.080 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574857 got 55834574857 for osd.0 2023-11-28T19:59:29.080 DEBUG:teuthology.parallel:result is None 2023-11-28T19:59:29.083 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574858 got 55834574858 for osd.5 2023-11-28T19:59:29.083 DEBUG:teuthology.parallel:result is None 2023-11-28T19:59:29.083 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2023-11-28T19:59:29.084 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-28T19:59:29.263 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:29.255+0000 7f6383faa640 1 Processor -- start 2023-11-28T19:59:29.263 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:29.259+0000 7f6383faa640 1 -- start start 2023-11-28T19:59:29.264 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:29.259+0000 7f6383faa640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f637c14fd10 0x7f637c0a4dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:29.264 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:29.259+0000 7f6383faa640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f637c156110 0x7f637c1565c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:29.264 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:29.259+0000 7f6383faa640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f637c0c5710 con 0x7f637c0a5300 2023-11-28T19:59:29.264 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:29.259+0000 7f6383faa640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f637c06c5e0 con 0x7f637c14fd10 2023-11-28T19:59:29.264 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:29.259+0000 7f6383faa640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f637c155c80 con 0x7f637c156110 2023-11-28T19:59:29.265 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:29.259+0000 7f6381d46640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f637c14fd10 0x7f637c0a4dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:29.265 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:29.259+0000 7f6381d46640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f637c14fd10 0x7f637c0a4dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:53232/0 (socket says 172.21.15.78:53232) 2023-11-28T19:59:29.265 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:29.259+0000 7f6381d46640 1 -- 172.21.15.78:0/2262250797 learned_addr learned my addr 172.21.15.78:0/2262250797 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T19:59:29.266 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:29.259+0000 7f6382547640 1 --2- 172.21.15.78:0/2262250797 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f637c156110 0x7f637c1565c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:29.266 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:29.259+0000 7f6381d46640 1 -- 172.21.15.78:0/2262250797 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f637c156110 msgr2=0x7f637c1565c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T19:59:29.266 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:29.259+0000 7f6381d46640 1 --2- 172.21.15.78:0/2262250797 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f637c156110 0x7f637c1565c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:29.266 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:29.259+0000 7f6381d46640 1 -- 172.21.15.78:0/2262250797 >> v1:172.21.15.179:6789/0 conn(0x7f637c0a5300 legacy=0x7f637c071e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T19:59:29.266 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:29.259+0000 7f6381d46640 1 -- 172.21.15.78:0/2262250797 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f637c0c4e70 con 0x7f637c14fd10 2023-11-28T19:59:29.268 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:29.263+0000 7f6381d46640 1 --2- 172.21.15.78:0/2262250797 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f637c14fd10 0x7f637c0a4dc0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f6378009870 tx=0x7f637801c3f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=300295c433634b33 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:59:29.268 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:29.263+0000 7f6380d44640 1 -- 172.21.15.78:0/2262250797 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63780ab5f0 con 0x7f637c14fd10 2023-11-28T19:59:29.268 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:29.263+0000 7f6380d44640 1 -- 172.21.15.78:0/2262250797 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f63780ab750 con 0x7f637c14fd10 2023-11-28T19:59:29.269 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:29.263+0000 7f6380d44640 1 -- 172.21.15.78:0/2262250797 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63780abae0 con 0x7f637c14fd10 2023-11-28T19:59:29.269 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:29.263+0000 7f6383faa640 1 -- 172.21.15.78:0/2262250797 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f637c14fd10 msgr2=0x7f637c0a4dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:29.270 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:29.263+0000 7f6383faa640 1 --2- 172.21.15.78:0/2262250797 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f637c14fd10 0x7f637c0a4dc0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f6378009870 tx=0x7f637801c3f0 comp rx=0 tx=0).stop 2023-11-28T19:59:29.270 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:29.263+0000 7f6383faa640 1 -- 172.21.15.78:0/2262250797 shutdown_connections 2023-11-28T19:59:29.270 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:29.263+0000 7f6383faa640 1 --2- 172.21.15.78:0/2262250797 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f637c156110 0x7f637c1565c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:29.270 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:29.263+0000 7f6383faa640 1 --2- 172.21.15.78:0/2262250797 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f637c14fd10 0x7f637c0a4dc0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:29.271 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:29.263+0000 7f6383faa640 1 -- 172.21.15.78:0/2262250797 >> 172.21.15.78:0/2262250797 conn(0x7f637c0a7810 msgr2=0x7f637c0a7c20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T19:59:29.271 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:29.263+0000 7f6383faa640 1 -- 172.21.15.78:0/2262250797 shutdown_connections 2023-11-28T19:59:29.271 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:29.263+0000 7f6383faa640 1 -- 172.21.15.78:0/2262250797 wait complete. 2023-11-28T19:59:29.273 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:29.263+0000 7f6383faa640 1 Processor -- start 2023-11-28T19:59:29.273 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:29.263+0000 7f6383faa640 1 -- start start 2023-11-28T19:59:29.273 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:29.267+0000 7f6383faa640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f637c0a5300 0x7f637c070630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:29.274 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:29.267+0000 7f6383faa640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f637c14fd10 0x7f637c1f0990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:29.274 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:29.267+0000 7f6383faa640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f637c156110 0x7f637c0bee90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:29.274 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:29.267+0000 7f6383faa640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f637c070f30 con 0x7f637c0a5300 2023-11-28T19:59:29.274 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:29.267+0000 7f6383faa640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f637c071210 con 0x7f637c14fd10 2023-11-28T19:59:29.274 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:29.267+0000 7f6383faa640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f637c0714f0 con 0x7f637c156110 2023-11-28T19:59:29.274 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:29.267+0000 7f6381d46640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f637c0a5300 0x7f637c070630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:29.275 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:29.267+0000 7f6381d46640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f637c0a5300 0x7f637c070630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:53246/0 (socket says 172.21.15.78:53246) 2023-11-28T19:59:29.275 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:29.267+0000 7f6381d46640 1 -- 172.21.15.78:0/3907397562 learned_addr learned my addr 172.21.15.78:0/3907397562 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T19:59:29.275 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:29.267+0000 7f6382547640 1 --2- 172.21.15.78:0/3907397562 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f637c156110 0x7f637c0bee90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:29.275 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:29.267+0000 7f6381545640 1 --2- 172.21.15.78:0/3907397562 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f637c14fd10 0x7f637c1f0990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:29.275 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:29.267+0000 7f6381d46640 1 -- 172.21.15.78:0/3907397562 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f637c156110 msgr2=0x7f637c0bee90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:29.276 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:29.267+0000 7f6381d46640 1 --2- 172.21.15.78:0/3907397562 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f637c156110 0x7f637c0bee90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:29.276 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:29.267+0000 7f6381d46640 1 -- 172.21.15.78:0/3907397562 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f637c14fd10 msgr2=0x7f637c1f0990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:29.276 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:29.267+0000 7f6381d46640 1 --2- 172.21.15.78:0/3907397562 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f637c14fd10 0x7f637c1f0990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:29.276 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:29.267+0000 7f6381d46640 1 -- 172.21.15.78:0/3907397562 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63780094d0 con 0x7f637c0a5300 2023-11-28T19:59:29.276 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:29.267+0000 7f6381545640 1 --2- 172.21.15.78:0/3907397562 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f637c14fd10 0x7f637c1f0990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T19:59:29.276 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:29.267+0000 7f6381d46640 1 --2- 172.21.15.78:0/3907397562 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f637c0a5300 0x7f637c070630 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f63780097c0 tx=0x7f637801ac30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:59:29.276 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:29.267+0000 7f63727fc640 1 -- 172.21.15.78:0/3907397562 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63780b4800 con 0x7f637c0a5300 2023-11-28T19:59:29.277 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:29.267+0000 7f63727fc640 1 -- 172.21.15.78:0/3907397562 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f63780b4960 con 0x7f637c0a5300 2023-11-28T19:59:29.277 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:29.267+0000 7f63727fc640 1 -- 172.21.15.78:0/3907397562 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63780b4d10 con 0x7f637c0a5300 2023-11-28T19:59:29.277 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:29.267+0000 7f6383faa640 1 -- 172.21.15.78:0/3907397562 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f637c1ee1a0 con 0x7f637c0a5300 2023-11-28T19:59:29.277 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:29.267+0000 7f6383faa640 1 -- 172.21.15.78:0/3907397562 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f637c070b70 con 0x7f637c0a5300 2023-11-28T19:59:29.277 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:29.267+0000 7f6383faa640 1 -- 172.21.15.78:0/3907397562 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f637c067630 con 0x7f637c0a5300 2023-11-28T19:59:29.278 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:29.267+0000 7f63727fc640 1 -- 172.21.15.78:0/3907397562 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f63780c7440 con 0x7f637c0a5300 2023-11-28T19:59:29.278 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:29.271+0000 7f63727fc640 1 --2- 172.21.15.78:0/3907397562 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f6360066470 0x7f6360068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:29.278 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:29.271+0000 7f63727fc640 1 -- 172.21.15.78:0/3907397562 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f63780a8050 con 0x7f637c0a5300 2023-11-28T19:59:29.279 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:29.271+0000 7f6381545640 1 --2- 172.21.15.78:0/3907397562 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f6360066470 0x7f6360068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:29.279 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:29.271+0000 7f6381545640 1 --2- 172.21.15.78:0/3907397562 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f6360066470 0x7f6360068930 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f637c0c35a0 tx=0x7f636c009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:59:29.279 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:29.275+0000 7f63727fc640 1 -- 172.21.15.78:0/3907397562 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f63780ebd40 con 0x7f637c0a5300 2023-11-28T19:59:29.427 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:29.419+0000 7f6383faa640 1 -- 172.21.15.78:0/3907397562 --> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f637c071380 con 0x7f6360066470 2023-11-28T19:59:29.436 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:29.431+0000 7f63727fc640 1 -- 172.21.15.78:0/3907397562 <== mgr.4106 v2:172.21.15.78:6832/2935380957 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+345366 (secure 0 0 0) 0x7f637c071380 con 0x7f6360066470 2023-11-28T19:59:29.440 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-11-28T19:59:29.442 INFO:teuthology.orchestra.run.smithi078.stderr:dumped all 2023-11-28T19:59:29.443 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:29.435+0000 7f6383faa640 1 -- 172.21.15.78:0/3907397562 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f6360066470 msgr2=0x7f6360068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:29.444 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:29.435+0000 7f6383faa640 1 --2- 172.21.15.78:0/3907397562 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f6360066470 0x7f6360068930 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f637c0c35a0 tx=0x7f636c009040 comp rx=0 tx=0).stop 2023-11-28T19:59:29.444 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:29.435+0000 7f6383faa640 1 -- 172.21.15.78:0/3907397562 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f637c0a5300 msgr2=0x7f637c070630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:29.444 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:29.435+0000 7f6383faa640 1 --2- 172.21.15.78:0/3907397562 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f637c0a5300 0x7f637c070630 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f63780097c0 tx=0x7f637801ac30 comp rx=0 tx=0).stop 2023-11-28T19:59:29.444 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:29.435+0000 7f6383faa640 1 -- 172.21.15.78:0/3907397562 shutdown_connections 2023-11-28T19:59:29.444 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:29.435+0000 7f6383faa640 1 --2- 172.21.15.78:0/3907397562 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f6360066470 0x7f6360068930 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:29.444 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:29.435+0000 7f6383faa640 1 --2- 172.21.15.78:0/3907397562 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f637c156110 0x7f637c0bee90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:29.444 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:29.435+0000 7f6383faa640 1 --2- 172.21.15.78:0/3907397562 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f637c14fd10 0x7f637c1f0990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:29.444 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:29.435+0000 7f6383faa640 1 --2- 172.21.15.78:0/3907397562 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f637c0a5300 0x7f637c070630 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:29.444 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:29.435+0000 7f6383faa640 1 -- 172.21.15.78:0/3907397562 >> 172.21.15.78:0/3907397562 conn(0x7f637c0a7810 msgr2=0x7f637c071e30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T19:59:29.444 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:29.435+0000 7f6383faa640 1 -- 172.21.15.78:0/3907397562 shutdown_connections 2023-11-28T19:59:29.444 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:29.435+0000 7f6383faa640 1 -- 172.21.15.78:0/3907397562 wait complete. 2023-11-28T19:59:29.460 INFO:teuthology.orchestra.run.smithi078.stdout:{"pg_ready":true,"pg_map":{"version":36,"stamp":"2023-11-28T19:59:27.958140+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595007,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":207,"num_write_kb":2434,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":159,"ondisk_log_size":159,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":218464,"kb_used_data":2272,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754756256,"statfs":{"total":773094113280,"available":772870406144,"internally_reserved":0,"allocated":2326528,"data_stored":2025718,"data_compressed":66748,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2229,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002595"},"pg_stats":[{"pgid":"2.1f","version":"20'4","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T19:59:10.106180+0000","last_change":"2023-11-28T19:59:05.052960+0000","last_active":"2023-11-28T19:59:10.106180+0000","last_peered":"2023-11-28T19:59:10.106180+0000","last_clean":"2023-11-28T19:59:10.106180+0000","last_became_active":"2023-11-28T19:59:05.052657+0000","last_became_peered":"2023-11-28T19:59:05.052657+0000","last_unstale":"2023-11-28T19:59:10.106180+0000","last_undegraded":"2023-11-28T19:59:10.106180+0000","last_fullsized":"2023-11-28T19:59:10.106180+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:59:04.008158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:59:04.008158+0000","last_clean_scrub_stamp":"2023-11-28T19:59:04.008158+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:54:59.131019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T19:59:10.086896+0000","last_change":"2023-11-28T19:59:05.769584+0000","last_active":"2023-11-28T19:59:10.086896+0000","last_peered":"2023-11-28T19:59:10.086896+0000","last_clean":"2023-11-28T19:59:10.086896+0000","last_became_active":"2023-11-28T19:59:05.769323+0000","last_became_peered":"2023-11-28T19:59:05.769323+0000","last_unstale":"2023-11-28T19:59:10.086896+0000","last_undegraded":"2023-11-28T19:59:10.086896+0000","last_fullsized":"2023-11-28T19:59:10.086896+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:59:05.015714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:59:05.015714+0000","last_clean_scrub_stamp":"2023-11-28T19:59:05.015714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:37:45.006198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T19:59:10.748258+0000","last_change":"2023-11-28T19:59:10.237008+0000","last_active":"2023-11-28T19:59:10.748258+0000","last_peered":"2023-11-28T19:59:10.748258+0000","last_clean":"2023-11-28T19:59:10.748258+0000","last_became_active":"2023-11-28T19:59:10.236605+0000","last_became_peered":"2023-11-28T19:59:10.236605+0000","last_unstale":"2023-11-28T19:59:10.748258+0000","last_undegraded":"2023-11-28T19:59:10.748258+0000","last_fullsized":"2023-11-28T19:59:10.748258+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:59:09.059796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:59:09.059796+0000","last_clean_scrub_stamp":"2023-11-28T19:59:09.059796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T06:47:20.838966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"20'1","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T19:59:10.086983+0000","last_change":"2023-11-28T19:59:05.045307+0000","last_active":"2023-11-28T19:59:10.086983+0000","last_peered":"2023-11-28T19:59:10.086983+0000","last_clean":"2023-11-28T19:59:10.086983+0000","last_became_active":"2023-11-28T19:59:05.044997+0000","last_became_peered":"2023-11-28T19:59:05.044997+0000","last_unstale":"2023-11-28T19:59:10.086983+0000","last_undegraded":"2023-11-28T19:59:10.086983+0000","last_fullsized":"2023-11-28T19:59:10.086983+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:59:04.008158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:59:04.008158+0000","last_clean_scrub_stamp":"2023-11-28T19:59:04.008158+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T06:35:58.085712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T19:59:10.106013+0000","last_change":"2023-11-28T19:59:05.781411+0000","last_active":"2023-11-28T19:59:10.106013+0000","last_peered":"2023-11-28T19:59:10.106013+0000","last_clean":"2023-11-28T19:59:10.106013+0000","last_became_active":"2023-11-28T19:59:05.781197+0000","last_became_peered":"2023-11-28T19:59:05.781197+0000","last_unstale":"2023-11-28T19:59:10.106013+0000","last_undegraded":"2023-11-28T19:59:10.106013+0000","last_fullsized":"2023-11-28T19:59:10.106013+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:59:05.015714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:59:05.015714+0000","last_clean_scrub_stamp":"2023-11-28T19:59:05.015714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T06:26:55.424441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T19:59:10.750326+0000","last_change":"2023-11-28T19:59:10.118362+0000","last_active":"2023-11-28T19:59:10.750326+0000","last_peered":"2023-11-28T19:59:10.750326+0000","last_clean":"2023-11-28T19:59:10.750326+0000","last_became_active":"2023-11-28T19:59:10.117821+0000","last_became_peered":"2023-11-28T19:59:10.117821+0000","last_unstale":"2023-11-28T19:59:10.750326+0000","last_undegraded":"2023-11-28T19:59:10.750326+0000","last_fullsized":"2023-11-28T19:59:10.750326+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:59:09.059796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:59:09.059796+0000","last_clean_scrub_stamp":"2023-11-28T19:59:09.059796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:05:07.732273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"20'2","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T19:59:10.231816+0000","last_change":"2023-11-28T19:59:05.058010+0000","last_active":"2023-11-28T19:59:10.231816+0000","last_peered":"2023-11-28T19:59:10.231816+0000","last_clean":"2023-11-28T19:59:10.231816+0000","last_became_active":"2023-11-28T19:59:05.055487+0000","last_became_peered":"2023-11-28T19:59:05.055487+0000","last_unstale":"2023-11-28T19:59:10.231816+0000","last_undegraded":"2023-11-28T19:59:10.231816+0000","last_fullsized":"2023-11-28T19:59:10.231816+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:59:04.008158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:59:04.008158+0000","last_clean_scrub_stamp":"2023-11-28T19:59:04.008158+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:44:01.094524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T19:59:10.087933+0000","last_change":"2023-11-28T19:59:05.779496+0000","last_active":"2023-11-28T19:59:10.087933+0000","last_peered":"2023-11-28T19:59:10.087933+0000","last_clean":"2023-11-28T19:59:10.087933+0000","last_became_active":"2023-11-28T19:59:05.777976+0000","last_became_peered":"2023-11-28T19:59:05.777976+0000","last_unstale":"2023-11-28T19:59:10.087933+0000","last_undegraded":"2023-11-28T19:59:10.087933+0000","last_fullsized":"2023-11-28T19:59:10.087933+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:59:05.015714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:59:05.015714+0000","last_clean_scrub_stamp":"2023-11-28T19:59:05.015714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:43:15.986749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T19:59:10.751202+0000","last_change":"2023-11-28T19:59:10.119257+0000","last_active":"2023-11-28T19:59:10.751202+0000","last_peered":"2023-11-28T19:59:10.751202+0000","last_clean":"2023-11-28T19:59:10.751202+0000","last_became_active":"2023-11-28T19:59:10.118744+0000","last_became_peered":"2023-11-28T19:59:10.118744+0000","last_unstale":"2023-11-28T19:59:10.751202+0000","last_undegraded":"2023-11-28T19:59:10.751202+0000","last_fullsized":"2023-11-28T19:59:10.751202+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:59:09.059796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:59:09.059796+0000","last_clean_scrub_stamp":"2023-11-28T19:59:09.059796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:04:08.552896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"20'2","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T19:59:10.231591+0000","last_change":"2023-11-28T19:59:05.054063+0000","last_active":"2023-11-28T19:59:10.231591+0000","last_peered":"2023-11-28T19:59:10.231591+0000","last_clean":"2023-11-28T19:59:10.231591+0000","last_became_active":"2023-11-28T19:59:05.053212+0000","last_became_peered":"2023-11-28T19:59:05.053212+0000","last_unstale":"2023-11-28T19:59:10.231591+0000","last_undegraded":"2023-11-28T19:59:10.231591+0000","last_fullsized":"2023-11-28T19:59:10.231591+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:59:04.008158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:59:04.008158+0000","last_clean_scrub_stamp":"2023-11-28T19:59:04.008158+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:50:57.704628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T19:59:10.086946+0000","last_change":"2023-11-28T19:59:05.779167+0000","last_active":"2023-11-28T19:59:10.086946+0000","last_peered":"2023-11-28T19:59:10.086946+0000","last_clean":"2023-11-28T19:59:10.086946+0000","last_became_active":"2023-11-28T19:59:05.778874+0000","last_became_peered":"2023-11-28T19:59:05.778874+0000","last_unstale":"2023-11-28T19:59:10.086946+0000","last_undegraded":"2023-11-28T19:59:10.086946+0000","last_fullsized":"2023-11-28T19:59:10.086946+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:59:05.015714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:59:05.015714+0000","last_clean_scrub_stamp":"2023-11-28T19:59:05.015714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:59:15.117552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T19:59:10.750952+0000","last_change":"2023-11-28T19:59:10.104844+0000","last_active":"2023-11-28T19:59:10.750952+0000","last_peered":"2023-11-28T19:59:10.750952+0000","last_clean":"2023-11-28T19:59:10.750952+0000","last_became_active":"2023-11-28T19:59:10.104381+0000","last_became_peered":"2023-11-28T19:59:10.104381+0000","last_unstale":"2023-11-28T19:59:10.750952+0000","last_undegraded":"2023-11-28T19:59:10.750952+0000","last_fullsized":"2023-11-28T19:59:10.750952+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:59:09.059796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:59:09.059796+0000","last_clean_scrub_stamp":"2023-11-28T19:59:09.059796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:21:25.563488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T19:59:10.096108+0000","last_change":"2023-11-28T19:59:05.777551+0000","last_active":"2023-11-28T19:59:10.096108+0000","last_peered":"2023-11-28T19:59:10.096108+0000","last_clean":"2023-11-28T19:59:10.096108+0000","last_became_active":"2023-11-28T19:59:05.777205+0000","last_became_peered":"2023-11-28T19:59:05.777205+0000","last_unstale":"2023-11-28T19:59:10.096108+0000","last_undegraded":"2023-11-28T19:59:10.096108+0000","last_fullsized":"2023-11-28T19:59:10.096108+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:59:05.015714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:59:05.015714+0000","last_clean_scrub_stamp":"2023-11-28T19:59:05.015714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:34:41.640833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"20'2","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T19:59:10.231766+0000","last_change":"2023-11-28T19:59:05.059530+0000","last_active":"2023-11-28T19:59:10.231766+0000","last_peered":"2023-11-28T19:59:10.231766+0000","last_clean":"2023-11-28T19:59:10.231766+0000","last_became_active":"2023-11-28T19:59:05.059170+0000","last_became_peered":"2023-11-28T19:59:05.059170+0000","last_unstale":"2023-11-28T19:59:10.231766+0000","last_undegraded":"2023-11-28T19:59:10.231766+0000","last_fullsized":"2023-11-28T19:59:10.231766+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:59:04.008158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:59:04.008158+0000","last_clean_scrub_stamp":"2023-11-28T19:59:04.008158+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:59:05.695936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T19:59:10.751627+0000","last_change":"2023-11-28T19:59:10.107622+0000","last_active":"2023-11-28T19:59:10.751627+0000","last_peered":"2023-11-28T19:59:10.751627+0000","last_clean":"2023-11-28T19:59:10.751627+0000","last_became_active":"2023-11-28T19:59:10.107067+0000","last_became_peered":"2023-11-28T19:59:10.107067+0000","last_unstale":"2023-11-28T19:59:10.751627+0000","last_undegraded":"2023-11-28T19:59:10.751627+0000","last_fullsized":"2023-11-28T19:59:10.751627+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:59:09.059796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:59:09.059796+0000","last_clean_scrub_stamp":"2023-11-28T19:59:09.059796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:43:20.030831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T19:59:10.085907+0000","last_change":"2023-11-28T19:59:05.770916+0000","last_active":"2023-11-28T19:59:10.085907+0000","last_peered":"2023-11-28T19:59:10.085907+0000","last_clean":"2023-11-28T19:59:10.085907+0000","last_became_active":"2023-11-28T19:59:05.770356+0000","last_became_peered":"2023-11-28T19:59:05.770356+0000","last_unstale":"2023-11-28T19:59:10.085907+0000","last_undegraded":"2023-11-28T19:59:10.085907+0000","last_fullsized":"2023-11-28T19:59:10.085907+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:59:05.015714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:59:05.015714+0000","last_clean_scrub_stamp":"2023-11-28T19:59:05.015714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:05:03.688191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T19:59:10.100383+0000","last_change":"2023-11-28T19:59:05.047719+0000","last_active":"2023-11-28T19:59:10.100383+0000","last_peered":"2023-11-28T19:59:10.100383+0000","last_clean":"2023-11-28T19:59:10.100383+0000","last_became_active":"2023-11-28T19:59:05.047441+0000","last_became_peered":"2023-11-28T19:59:05.047441+0000","last_unstale":"2023-11-28T19:59:10.100383+0000","last_undegraded":"2023-11-28T19:59:10.100383+0000","last_fullsized":"2023-11-28T19:59:10.100383+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:59:04.008158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:59:04.008158+0000","last_clean_scrub_stamp":"2023-11-28T19:59:04.008158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:24:13.851530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T19:59:10.751634+0000","last_change":"2023-11-28T19:59:10.118258+0000","last_active":"2023-11-28T19:59:10.751634+0000","last_peered":"2023-11-28T19:59:10.751634+0000","last_clean":"2023-11-28T19:59:10.751634+0000","last_became_active":"2023-11-28T19:59:10.117812+0000","last_became_peered":"2023-11-28T19:59:10.117812+0000","last_unstale":"2023-11-28T19:59:10.751634+0000","last_undegraded":"2023-11-28T19:59:10.751634+0000","last_fullsized":"2023-11-28T19:59:10.751634+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:59:09.059796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:59:09.059796+0000","last_clean_scrub_stamp":"2023-11-28T19:59:09.059796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:04:22.608590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T19:59:10.086832+0000","last_change":"2023-11-28T19:59:05.767529+0000","last_active":"2023-11-28T19:59:10.086832+0000","last_peered":"2023-11-28T19:59:10.086832+0000","last_clean":"2023-11-28T19:59:10.086832+0000","last_became_active":"2023-11-28T19:59:05.767237+0000","last_became_peered":"2023-11-28T19:59:05.767237+0000","last_unstale":"2023-11-28T19:59:10.086832+0000","last_undegraded":"2023-11-28T19:59:10.086832+0000","last_fullsized":"2023-11-28T19:59:10.086832+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:59:05.015714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:59:05.015714+0000","last_clean_scrub_stamp":"2023-11-28T19:59:05.015714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:34:41.640833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T19:59:10.098640+0000","last_change":"2023-11-28T19:59:05.053041+0000","last_active":"2023-11-28T19:59:10.098640+0000","last_peered":"2023-11-28T19:59:10.098640+0000","last_clean":"2023-11-28T19:59:10.098640+0000","last_became_active":"2023-11-28T19:59:05.052673+0000","last_became_peered":"2023-11-28T19:59:05.052673+0000","last_unstale":"2023-11-28T19:59:10.098640+0000","last_undegraded":"2023-11-28T19:59:10.098640+0000","last_fullsized":"2023-11-28T19:59:10.098640+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:59:04.008158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:59:04.008158+0000","last_clean_scrub_stamp":"2023-11-28T19:59:04.008158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:50:57.704628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T19:59:10.893246+0000","last_change":"2023-11-28T19:59:10.238462+0000","last_active":"2023-11-28T19:59:10.893246+0000","last_peered":"2023-11-28T19:59:10.893246+0000","last_clean":"2023-11-28T19:59:10.893246+0000","last_became_active":"2023-11-28T19:59:10.237988+0000","last_became_peered":"2023-11-28T19:59:10.237988+0000","last_unstale":"2023-11-28T19:59:10.893246+0000","last_undegraded":"2023-11-28T19:59:10.893246+0000","last_fullsized":"2023-11-28T19:59:10.893246+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:59:09.059796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:59:09.059796+0000","last_clean_scrub_stamp":"2023-11-28T19:59:09.059796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:09:44.374501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T19:59:10.085913+0000","last_change":"2023-11-28T19:59:05.766196+0000","last_active":"2023-11-28T19:59:10.085913+0000","last_peered":"2023-11-28T19:59:10.085913+0000","last_clean":"2023-11-28T19:59:10.085913+0000","last_became_active":"2023-11-28T19:59:05.765432+0000","last_became_peered":"2023-11-28T19:59:05.765432+0000","last_unstale":"2023-11-28T19:59:10.085913+0000","last_undegraded":"2023-11-28T19:59:10.085913+0000","last_fullsized":"2023-11-28T19:59:10.085913+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:59:05.015714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:59:05.015714+0000","last_clean_scrub_stamp":"2023-11-28T19:59:05.015714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T07:38:27.535482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T19:59:10.231396+0000","last_change":"2023-11-28T19:59:05.057961+0000","last_active":"2023-11-28T19:59:10.231396+0000","last_peered":"2023-11-28T19:59:10.231396+0000","last_clean":"2023-11-28T19:59:10.231396+0000","last_became_active":"2023-11-28T19:59:05.054572+0000","last_became_peered":"2023-11-28T19:59:05.054572+0000","last_unstale":"2023-11-28T19:59:10.231396+0000","last_undegraded":"2023-11-28T19:59:10.231396+0000","last_fullsized":"2023-11-28T19:59:10.231396+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:59:04.008158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:59:04.008158+0000","last_clean_scrub_stamp":"2023-11-28T19:59:04.008158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:55:39.803978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T19:59:10.751124+0000","last_change":"2023-11-28T19:59:10.110793+0000","last_active":"2023-11-28T19:59:10.751124+0000","last_peered":"2023-11-28T19:59:10.751124+0000","last_clean":"2023-11-28T19:59:10.751124+0000","last_became_active":"2023-11-28T19:59:10.110217+0000","last_became_peered":"2023-11-28T19:59:10.110217+0000","last_unstale":"2023-11-28T19:59:10.751124+0000","last_undegraded":"2023-11-28T19:59:10.751124+0000","last_fullsized":"2023-11-28T19:59:10.751124+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:59:09.059796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:59:09.059796+0000","last_clean_scrub_stamp":"2023-11-28T19:59:09.059796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:13:25.677482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T19:59:10.105874+0000","last_change":"2023-11-28T19:59:05.766438+0000","last_active":"2023-11-28T19:59:10.105874+0000","last_peered":"2023-11-28T19:59:10.105874+0000","last_clean":"2023-11-28T19:59:10.105874+0000","last_became_active":"2023-11-28T19:59:05.766122+0000","last_became_peered":"2023-11-28T19:59:05.766122+0000","last_unstale":"2023-11-28T19:59:10.105874+0000","last_undegraded":"2023-11-28T19:59:10.105874+0000","last_fullsized":"2023-11-28T19:59:10.105874+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:59:05.015714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:59:05.015714+0000","last_clean_scrub_stamp":"2023-11-28T19:59:05.015714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:34:41.640833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"20'2","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T19:59:10.097521+0000","last_change":"2023-11-28T19:59:05.051854+0000","last_active":"2023-11-28T19:59:10.097521+0000","last_peered":"2023-11-28T19:59:10.097521+0000","last_clean":"2023-11-28T19:59:10.097521+0000","last_became_active":"2023-11-28T19:59:05.051577+0000","last_became_peered":"2023-11-28T19:59:05.051577+0000","last_unstale":"2023-11-28T19:59:10.097521+0000","last_undegraded":"2023-11-28T19:59:10.097521+0000","last_fullsized":"2023-11-28T19:59:10.097521+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:59:04.008158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:59:04.008158+0000","last_clean_scrub_stamp":"2023-11-28T19:59:04.008158+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:18:36.601049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T19:59:10.750635+0000","last_change":"2023-11-28T19:59:10.233198+0000","last_active":"2023-11-28T19:59:10.750635+0000","last_peered":"2023-11-28T19:59:10.750635+0000","last_clean":"2023-11-28T19:59:10.750635+0000","last_became_active":"2023-11-28T19:59:10.232788+0000","last_became_peered":"2023-11-28T19:59:10.232788+0000","last_unstale":"2023-11-28T19:59:10.750635+0000","last_undegraded":"2023-11-28T19:59:10.750635+0000","last_fullsized":"2023-11-28T19:59:10.750635+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:59:09.059796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:59:09.059796+0000","last_clean_scrub_stamp":"2023-11-28T19:59:09.059796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:37:49.050280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T19:59:10.092085+0000","last_change":"2023-11-28T19:59:05.765916+0000","last_active":"2023-11-28T19:59:10.092085+0000","last_peered":"2023-11-28T19:59:10.092085+0000","last_clean":"2023-11-28T19:59:10.092085+0000","last_became_active":"2023-11-28T19:59:05.765601+0000","last_became_peered":"2023-11-28T19:59:05.765601+0000","last_unstale":"2023-11-28T19:59:10.092085+0000","last_undegraded":"2023-11-28T19:59:10.092085+0000","last_fullsized":"2023-11-28T19:59:10.092085+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:59:05.015714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:59:05.015714+0000","last_clean_scrub_stamp":"2023-11-28T19:59:05.015714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:13:21.633400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"23'1","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T19:59:10.099470+0000","last_change":"2023-11-28T19:59:05.043611+0000","last_active":"2023-11-28T19:59:10.099470+0000","last_peered":"2023-11-28T19:59:10.099470+0000","last_clean":"2023-11-28T19:59:10.099470+0000","last_became_active":"2023-11-28T19:59:05.043302+0000","last_became_peered":"2023-11-28T19:59:05.043302+0000","last_unstale":"2023-11-28T19:59:10.099470+0000","last_undegraded":"2023-11-28T19:59:10.099470+0000","last_fullsized":"2023-11-28T19:59:10.099470+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:59:04.008158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:59:04.008158+0000","last_clean_scrub_stamp":"2023-11-28T19:59:04.008158+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:24:47.265269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T19:59:10.748068+0000","last_change":"2023-11-28T19:59:10.233040+0000","last_active":"2023-11-28T19:59:10.748068+0000","last_peered":"2023-11-28T19:59:10.748068+0000","last_clean":"2023-11-28T19:59:10.748068+0000","last_became_active":"2023-11-28T19:59:10.232226+0000","last_became_peered":"2023-11-28T19:59:10.232226+0000","last_unstale":"2023-11-28T19:59:10.748068+0000","last_undegraded":"2023-11-28T19:59:10.748068+0000","last_fullsized":"2023-11-28T19:59:10.748068+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:59:09.059796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:59:09.059796+0000","last_clean_scrub_stamp":"2023-11-28T19:59:09.059796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:08:16.809984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T19:59:10.098944+0000","last_change":"2023-11-28T19:59:05.756970+0000","last_active":"2023-11-28T19:59:10.098944+0000","last_peered":"2023-11-28T19:59:10.098944+0000","last_clean":"2023-11-28T19:59:10.098944+0000","last_became_active":"2023-11-28T19:59:05.756706+0000","last_became_peered":"2023-11-28T19:59:05.756706+0000","last_unstale":"2023-11-28T19:59:10.098944+0000","last_undegraded":"2023-11-28T19:59:10.098944+0000","last_fullsized":"2023-11-28T19:59:10.098944+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:59:05.015714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:59:05.015714+0000","last_clean_scrub_stamp":"2023-11-28T19:59:05.015714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T06:26:55.424441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T19:59:10.231897+0000","last_change":"2023-11-28T19:59:05.058655+0000","last_active":"2023-11-28T19:59:10.231897+0000","last_peered":"2023-11-28T19:59:10.231897+0000","last_clean":"2023-11-28T19:59:10.231897+0000","last_became_active":"2023-11-28T19:59:05.058338+0000","last_became_peered":"2023-11-28T19:59:05.058338+0000","last_unstale":"2023-11-28T19:59:10.231897+0000","last_undegraded":"2023-11-28T19:59:10.231897+0000","last_fullsized":"2023-11-28T19:59:10.231897+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:59:04.008158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:59:04.008158+0000","last_clean_scrub_stamp":"2023-11-28T19:59:04.008158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:39:43.991385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T19:59:10.892006+0000","last_change":"2023-11-28T19:59:10.234696+0000","last_active":"2023-11-28T19:59:10.892006+0000","last_peered":"2023-11-28T19:59:10.892006+0000","last_clean":"2023-11-28T19:59:10.892006+0000","last_became_active":"2023-11-28T19:59:10.234219+0000","last_became_peered":"2023-11-28T19:59:10.234219+0000","last_unstale":"2023-11-28T19:59:10.892006+0000","last_undegraded":"2023-11-28T19:59:10.892006+0000","last_fullsized":"2023-11-28T19:59:10.892006+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:59:09.059796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:59:09.059796+0000","last_clean_scrub_stamp":"2023-11-28T19:59:09.059796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:04:22.608590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T19:59:10.086968+0000","last_change":"2023-11-28T19:59:05.773876+0000","last_active":"2023-11-28T19:59:10.086968+0000","last_peered":"2023-11-28T19:59:10.086968+0000","last_clean":"2023-11-28T19:59:10.086968+0000","last_became_active":"2023-11-28T19:59:05.773097+0000","last_became_peered":"2023-11-28T19:59:05.773097+0000","last_unstale":"2023-11-28T19:59:10.086968+0000","last_undegraded":"2023-11-28T19:59:10.086968+0000","last_fullsized":"2023-11-28T19:59:10.086968+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:59:05.015714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:59:05.015714+0000","last_clean_scrub_stamp":"2023-11-28T19:59:05.015714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:09:40.330419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T19:59:10.099027+0000","last_change":"2023-11-28T19:59:05.045257+0000","last_active":"2023-11-28T19:59:10.099027+0000","last_peered":"2023-11-28T19:59:10.099027+0000","last_clean":"2023-11-28T19:59:10.099027+0000","last_became_active":"2023-11-28T19:59:05.037691+0000","last_became_peered":"2023-11-28T19:59:05.037691+0000","last_unstale":"2023-11-28T19:59:10.099027+0000","last_undegraded":"2023-11-28T19:59:10.099027+0000","last_fullsized":"2023-11-28T19:59:10.099027+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:59:04.008158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:59:04.008158+0000","last_clean_scrub_stamp":"2023-11-28T19:59:04.008158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:44:01.094524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T19:59:10.892407+0000","last_change":"2023-11-28T19:59:10.110882+0000","last_active":"2023-11-28T19:59:10.892407+0000","last_peered":"2023-11-28T19:59:10.892407+0000","last_clean":"2023-11-28T19:59:10.892407+0000","last_became_active":"2023-11-28T19:59:10.110154+0000","last_became_peered":"2023-11-28T19:59:10.110154+0000","last_unstale":"2023-11-28T19:59:10.892407+0000","last_undegraded":"2023-11-28T19:59:10.892407+0000","last_fullsized":"2023-11-28T19:59:10.892407+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:59:09.059796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:59:09.059796+0000","last_clean_scrub_stamp":"2023-11-28T19:59:09.059796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:59:19.161634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T19:59:10.088733+0000","last_change":"2023-11-28T19:59:05.768336+0000","last_active":"2023-11-28T19:59:10.088733+0000","last_peered":"2023-11-28T19:59:10.088733+0000","last_clean":"2023-11-28T19:59:10.088733+0000","last_became_active":"2023-11-28T19:59:05.768035+0000","last_became_peered":"2023-11-28T19:59:05.768035+0000","last_unstale":"2023-11-28T19:59:10.088733+0000","last_undegraded":"2023-11-28T19:59:10.088733+0000","last_fullsized":"2023-11-28T19:59:10.088733+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:59:05.015714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:59:05.015714+0000","last_clean_scrub_stamp":"2023-11-28T19:59:05.015714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:54:54.632073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T19:59:10.086736+0000","last_change":"2023-11-28T19:59:05.039347+0000","last_active":"2023-11-28T19:59:10.086736+0000","last_peered":"2023-11-28T19:59:10.086736+0000","last_clean":"2023-11-28T19:59:10.086736+0000","last_became_active":"2023-11-28T19:59:05.038995+0000","last_became_peered":"2023-11-28T19:59:05.038995+0000","last_unstale":"2023-11-28T19:59:10.086736+0000","last_undegraded":"2023-11-28T19:59:10.086736+0000","last_fullsized":"2023-11-28T19:59:10.086736+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:59:04.008158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:59:04.008158+0000","last_clean_scrub_stamp":"2023-11-28T19:59:04.008158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T06:35:58.085712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T19:59:10.893010+0000","last_change":"2023-11-28T19:59:10.106996+0000","last_active":"2023-11-28T19:59:10.893010+0000","last_peered":"2023-11-28T19:59:10.893010+0000","last_clean":"2023-11-28T19:59:10.893010+0000","last_became_active":"2023-11-28T19:59:10.106321+0000","last_became_peered":"2023-11-28T19:59:10.106321+0000","last_unstale":"2023-11-28T19:59:10.893010+0000","last_undegraded":"2023-11-28T19:59:10.893010+0000","last_fullsized":"2023-11-28T19:59:10.893010+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:59:09.059796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:59:09.059796+0000","last_clean_scrub_stamp":"2023-11-28T19:59:09.059796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:27:38.944595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T19:59:10.098824+0000","last_change":"2023-11-28T19:59:05.756081+0000","last_active":"2023-11-28T19:59:10.098824+0000","last_peered":"2023-11-28T19:59:10.098824+0000","last_clean":"2023-11-28T19:59:10.098824+0000","last_became_active":"2023-11-28T19:59:05.755784+0000","last_became_peered":"2023-11-28T19:59:05.755784+0000","last_unstale":"2023-11-28T19:59:10.098824+0000","last_undegraded":"2023-11-28T19:59:10.098824+0000","last_fullsized":"2023-11-28T19:59:10.098824+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:59:05.015714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:59:05.015714+0000","last_clean_scrub_stamp":"2023-11-28T19:59:05.015714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:39:44.998942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T19:59:10.081517+0000","last_change":"2023-11-28T19:59:05.050192+0000","last_active":"2023-11-28T19:59:10.081517+0000","last_peered":"2023-11-28T19:59:10.081517+0000","last_clean":"2023-11-28T19:59:10.081517+0000","last_became_active":"2023-11-28T19:59:05.049835+0000","last_became_peered":"2023-11-28T19:59:05.049835+0000","last_unstale":"2023-11-28T19:59:10.081517+0000","last_undegraded":"2023-11-28T19:59:10.081517+0000","last_fullsized":"2023-11-28T19:59:10.081517+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:59:04.008158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:59:04.008158+0000","last_clean_scrub_stamp":"2023-11-28T19:59:04.008158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:55:39.803978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T19:59:10.893279+0000","last_change":"2023-11-28T19:59:10.105472+0000","last_active":"2023-11-28T19:59:10.893279+0000","last_peered":"2023-11-28T19:59:10.893279+0000","last_clean":"2023-11-28T19:59:10.893279+0000","last_became_active":"2023-11-28T19:59:10.103836+0000","last_became_peered":"2023-11-28T19:59:10.103836+0000","last_unstale":"2023-11-28T19:59:10.893279+0000","last_undegraded":"2023-11-28T19:59:10.893279+0000","last_fullsized":"2023-11-28T19:59:10.893279+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:59:09.059796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:59:09.059796+0000","last_clean_scrub_stamp":"2023-11-28T19:59:09.059796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:50:45.043146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T19:59:10.105131+0000","last_change":"2023-11-28T19:59:05.776449+0000","last_active":"2023-11-28T19:59:10.105131+0000","last_peered":"2023-11-28T19:59:10.105131+0000","last_clean":"2023-11-28T19:59:10.105131+0000","last_became_active":"2023-11-28T19:59:05.776170+0000","last_became_peered":"2023-11-28T19:59:05.776170+0000","last_unstale":"2023-11-28T19:59:10.105131+0000","last_undegraded":"2023-11-28T19:59:10.105131+0000","last_fullsized":"2023-11-28T19:59:10.105131+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:59:05.015714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:59:05.015714+0000","last_clean_scrub_stamp":"2023-11-28T19:59:05.015714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T06:35:59.093269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T19:59:10.231401+0000","last_change":"2023-11-28T19:59:05.053328+0000","last_active":"2023-11-28T19:59:10.231401+0000","last_peered":"2023-11-28T19:59:10.231401+0000","last_clean":"2023-11-28T19:59:10.231401+0000","last_became_active":"2023-11-28T19:59:05.053006+0000","last_became_peered":"2023-11-28T19:59:05.053006+0000","last_unstale":"2023-11-28T19:59:10.231401+0000","last_undegraded":"2023-11-28T19:59:10.231401+0000","last_fullsized":"2023-11-28T19:59:10.231401+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:59:04.008158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:59:04.008158+0000","last_clean_scrub_stamp":"2023-11-28T19:59:04.008158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T07:38:26.527925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T19:59:10.892291+0000","last_change":"2023-11-28T19:59:10.233184+0000","last_active":"2023-11-28T19:59:10.892291+0000","last_peered":"2023-11-28T19:59:10.892291+0000","last_clean":"2023-11-28T19:59:10.892291+0000","last_became_active":"2023-11-28T19:59:10.232695+0000","last_became_peered":"2023-11-28T19:59:10.232695+0000","last_unstale":"2023-11-28T19:59:10.892291+0000","last_undegraded":"2023-11-28T19:59:10.892291+0000","last_fullsized":"2023-11-28T19:59:10.892291+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:59:09.059796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:59:09.059796+0000","last_clean_scrub_stamp":"2023-11-28T19:59:09.059796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:50:45.043146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T19:59:10.091832+0000","last_change":"2023-11-28T19:59:05.779101+0000","last_active":"2023-11-28T19:59:10.091832+0000","last_peered":"2023-11-28T19:59:10.091832+0000","last_clean":"2023-11-28T19:59:10.091832+0000","last_became_active":"2023-11-28T19:59:05.778867+0000","last_became_peered":"2023-11-28T19:59:05.778867+0000","last_unstale":"2023-11-28T19:59:10.091832+0000","last_undegraded":"2023-11-28T19:59:10.091832+0000","last_fullsized":"2023-11-28T19:59:10.091832+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:59:05.015714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:59:05.015714+0000","last_clean_scrub_stamp":"2023-11-28T19:59:05.015714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T06:26:55.424441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T19:59:10.086389+0000","last_change":"2023-11-28T19:59:05.039775+0000","last_active":"2023-11-28T19:59:10.086389+0000","last_peered":"2023-11-28T19:59:10.086389+0000","last_clean":"2023-11-28T19:59:10.086389+0000","last_became_active":"2023-11-28T19:59:05.039360+0000","last_became_peered":"2023-11-28T19:59:05.039360+0000","last_unstale":"2023-11-28T19:59:10.086389+0000","last_undegraded":"2023-11-28T19:59:10.086389+0000","last_fullsized":"2023-11-28T19:59:10.086389+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:59:04.008158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:59:04.008158+0000","last_clean_scrub_stamp":"2023-11-28T19:59:04.008158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:55:39.803978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":169,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T19:59:10.231502+0000","last_change":"2023-11-28T19:58:56.136501+0000","last_active":"2023-11-28T19:59:10.231502+0000","last_peered":"2023-11-28T19:59:10.231502+0000","last_clean":"2023-11-28T19:59:10.231502+0000","last_became_active":"2023-11-28T19:58:56.135998+0000","last_became_peered":"2023-11-28T19:58:56.135998+0000","last_unstale":"2023-11-28T19:59:10.231502+0000","last_undegraded":"2023-11-28T19:59:10.231502+0000","last_fullsized":"2023-11-28T19:59:10.231502+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:58:54.602349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:58:54.602349+0000","last_clean_scrub_stamp":"2023-11-28T19:58:54.602349+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:33:42.723349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T19:59:10.892259+0000","last_change":"2023-11-28T19:59:10.237549+0000","last_active":"2023-11-28T19:59:10.892259+0000","last_peered":"2023-11-28T19:59:10.892259+0000","last_clean":"2023-11-28T19:59:10.892259+0000","last_became_active":"2023-11-28T19:59:10.237130+0000","last_became_peered":"2023-11-28T19:59:10.237130+0000","last_unstale":"2023-11-28T19:59:10.892259+0000","last_undegraded":"2023-11-28T19:59:10.892259+0000","last_fullsized":"2023-11-28T19:59:10.892259+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:59:09.059796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:59:09.059796+0000","last_clean_scrub_stamp":"2023-11-28T19:59:09.059796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:59:19.161634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T19:59:10.231699+0000","last_change":"2023-11-28T19:59:05.786506+0000","last_active":"2023-11-28T19:59:10.231699+0000","last_peered":"2023-11-28T19:59:10.231699+0000","last_clean":"2023-11-28T19:59:10.231699+0000","last_became_active":"2023-11-28T19:59:05.785858+0000","last_became_peered":"2023-11-28T19:59:05.785858+0000","last_unstale":"2023-11-28T19:59:10.231699+0000","last_undegraded":"2023-11-28T19:59:10.231699+0000","last_fullsized":"2023-11-28T19:59:10.231699+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:59:05.015714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:59:05.015714+0000","last_clean_scrub_stamp":"2023-11-28T19:59:05.015714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:04:04.508815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T19:59:10.081603+0000","last_change":"2023-11-28T19:59:05.038652+0000","last_active":"2023-11-28T19:59:10.081603+0000","last_peered":"2023-11-28T19:59:10.081603+0000","last_clean":"2023-11-28T19:59:10.081603+0000","last_became_active":"2023-11-28T19:59:05.038327+0000","last_became_peered":"2023-11-28T19:59:05.038327+0000","last_unstale":"2023-11-28T19:59:10.081603+0000","last_undegraded":"2023-11-28T19:59:10.081603+0000","last_fullsized":"2023-11-28T19:59:10.081603+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:59:04.008158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:59:04.008158+0000","last_clean_scrub_stamp":"2023-11-28T19:59:04.008158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:54:53.624516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T19:59:10.892210+0000","last_change":"2023-11-28T19:59:10.234188+0000","last_active":"2023-11-28T19:59:10.892210+0000","last_peered":"2023-11-28T19:59:10.892210+0000","last_clean":"2023-11-28T19:59:10.892210+0000","last_became_active":"2023-11-28T19:59:10.232817+0000","last_became_peered":"2023-11-28T19:59:10.232817+0000","last_unstale":"2023-11-28T19:59:10.892210+0000","last_undegraded":"2023-11-28T19:59:10.892210+0000","last_fullsized":"2023-11-28T19:59:10.892210+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:59:09.059796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:59:09.059796+0000","last_clean_scrub_stamp":"2023-11-28T19:59:09.059796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:04:22.608590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T19:59:10.088147+0000","last_change":"2023-11-28T19:59:05.770485+0000","last_active":"2023-11-28T19:59:10.088147+0000","last_peered":"2023-11-28T19:59:10.088147+0000","last_clean":"2023-11-28T19:59:10.088147+0000","last_became_active":"2023-11-28T19:59:05.769897+0000","last_became_peered":"2023-11-28T19:59:05.769897+0000","last_unstale":"2023-11-28T19:59:10.088147+0000","last_undegraded":"2023-11-28T19:59:10.088147+0000","last_fullsized":"2023-11-28T19:59:10.088147+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:59:05.015714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:59:05.015714+0000","last_clean_scrub_stamp":"2023-11-28T19:59:05.015714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:04:18.564508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"20'1","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T19:59:10.099741+0000","last_change":"2023-11-28T19:59:05.038199+0000","last_active":"2023-11-28T19:59:10.099741+0000","last_peered":"2023-11-28T19:59:10.099741+0000","last_clean":"2023-11-28T19:59:10.099741+0000","last_became_active":"2023-11-28T19:59:05.037884+0000","last_became_peered":"2023-11-28T19:59:05.037884+0000","last_unstale":"2023-11-28T19:59:10.099741+0000","last_undegraded":"2023-11-28T19:59:10.099741+0000","last_fullsized":"2023-11-28T19:59:10.099741+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:59:04.008158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:59:04.008158+0000","last_clean_scrub_stamp":"2023-11-28T19:59:04.008158+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:59:05.695936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T19:59:10.892205+0000","last_change":"2023-11-28T19:59:10.113074+0000","last_active":"2023-11-28T19:59:10.892205+0000","last_peered":"2023-11-28T19:59:10.892205+0000","last_clean":"2023-11-28T19:59:10.892205+0000","last_became_active":"2023-11-28T19:59:10.112703+0000","last_became_peered":"2023-11-28T19:59:10.112703+0000","last_unstale":"2023-11-28T19:59:10.892205+0000","last_undegraded":"2023-11-28T19:59:10.892205+0000","last_fullsized":"2023-11-28T19:59:10.892205+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:59:09.059796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:59:09.059796+0000","last_clean_scrub_stamp":"2023-11-28T19:59:09.059796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:09:44.374501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T19:59:10.232038+0000","last_change":"2023-11-28T19:59:05.787582+0000","last_active":"2023-11-28T19:59:10.232038+0000","last_peered":"2023-11-28T19:59:10.232038+0000","last_clean":"2023-11-28T19:59:10.232038+0000","last_became_active":"2023-11-28T19:59:05.786888+0000","last_became_peered":"2023-11-28T19:59:05.786888+0000","last_unstale":"2023-11-28T19:59:10.232038+0000","last_undegraded":"2023-11-28T19:59:10.232038+0000","last_fullsized":"2023-11-28T19:59:10.232038+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:59:05.015714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:59:05.015714+0000","last_clean_scrub_stamp":"2023-11-28T19:59:05.015714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:50:40.999064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"20'2","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T19:59:10.082013+0000","last_change":"2023-11-28T19:59:05.039063+0000","last_active":"2023-11-28T19:59:10.082013+0000","last_peered":"2023-11-28T19:59:10.082013+0000","last_clean":"2023-11-28T19:59:10.082013+0000","last_became_active":"2023-11-28T19:59:05.038803+0000","last_became_peered":"2023-11-28T19:59:05.038803+0000","last_unstale":"2023-11-28T19:59:10.082013+0000","last_undegraded":"2023-11-28T19:59:10.082013+0000","last_fullsized":"2023-11-28T19:59:10.082013+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:59:04.008158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:59:04.008158+0000","last_clean_scrub_stamp":"2023-11-28T19:59:04.008158+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:24:13.851530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T19:59:10.750166+0000","last_change":"2023-11-28T19:59:10.237605+0000","last_active":"2023-11-28T19:59:10.750166+0000","last_peered":"2023-11-28T19:59:10.750166+0000","last_clean":"2023-11-28T19:59:10.750166+0000","last_became_active":"2023-11-28T19:59:10.237079+0000","last_became_peered":"2023-11-28T19:59:10.237079+0000","last_unstale":"2023-11-28T19:59:10.750166+0000","last_undegraded":"2023-11-28T19:59:10.750166+0000","last_fullsized":"2023-11-28T19:59:10.750166+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:59:09.059796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:59:09.059796+0000","last_clean_scrub_stamp":"2023-11-28T19:59:09.059796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:47:39.329731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T19:59:10.231882+0000","last_change":"2023-11-28T19:59:05.784211+0000","last_active":"2023-11-28T19:59:10.231882+0000","last_peered":"2023-11-28T19:59:10.231882+0000","last_clean":"2023-11-28T19:59:10.231882+0000","last_became_active":"2023-11-28T19:59:05.783924+0000","last_became_peered":"2023-11-28T19:59:05.783924+0000","last_unstale":"2023-11-28T19:59:10.231882+0000","last_undegraded":"2023-11-28T19:59:10.231882+0000","last_fullsized":"2023-11-28T19:59:10.231882+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:59:05.015714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:59:05.015714+0000","last_clean_scrub_stamp":"2023-11-28T19:59:05.015714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:43:15.986749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"20'1","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T19:59:10.086589+0000","last_change":"2023-11-28T19:59:05.050003+0000","last_active":"2023-11-28T19:59:10.086589+0000","last_peered":"2023-11-28T19:59:10.086589+0000","last_clean":"2023-11-28T19:59:10.086589+0000","last_became_active":"2023-11-28T19:59:05.048751+0000","last_became_peered":"2023-11-28T19:59:05.048751+0000","last_unstale":"2023-11-28T19:59:10.086589+0000","last_undegraded":"2023-11-28T19:59:10.086589+0000","last_fullsized":"2023-11-28T19:59:10.086589+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:59:04.008158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:59:04.008158+0000","last_clean_scrub_stamp":"2023-11-28T19:59:04.008158+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:43:22.921922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T19:59:10.750165+0000","last_change":"2023-11-28T19:59:10.118418+0000","last_active":"2023-11-28T19:59:10.750165+0000","last_peered":"2023-11-28T19:59:10.750165+0000","last_clean":"2023-11-28T19:59:10.750165+0000","last_became_active":"2023-11-28T19:59:10.118013+0000","last_became_peered":"2023-11-28T19:59:10.118013+0000","last_unstale":"2023-11-28T19:59:10.750165+0000","last_undegraded":"2023-11-28T19:59:10.750165+0000","last_fullsized":"2023-11-28T19:59:10.750165+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:59:09.059796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:59:09.059796+0000","last_clean_scrub_stamp":"2023-11-28T19:59:09.059796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T06:26:59.468523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T19:59:10.231450+0000","last_change":"2023-11-28T19:59:05.781473+0000","last_active":"2023-11-28T19:59:10.231450+0000","last_peered":"2023-11-28T19:59:10.231450+0000","last_clean":"2023-11-28T19:59:10.231450+0000","last_became_active":"2023-11-28T19:59:05.781227+0000","last_became_peered":"2023-11-28T19:59:05.781227+0000","last_unstale":"2023-11-28T19:59:10.231450+0000","last_undegraded":"2023-11-28T19:59:10.231450+0000","last_fullsized":"2023-11-28T19:59:10.231450+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:59:05.015714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:59:05.015714+0000","last_clean_scrub_stamp":"2023-11-28T19:59:05.015714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:56:09.640427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"20'8","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T19:59:10.081395+0000","last_change":"2023-11-28T19:59:05.038647+0000","last_active":"2023-11-28T19:59:10.081395+0000","last_peered":"2023-11-28T19:59:10.081395+0000","last_clean":"2023-11-28T19:59:10.081395+0000","last_became_active":"2023-11-28T19:59:05.038338+0000","last_became_peered":"2023-11-28T19:59:05.038338+0000","last_unstale":"2023-11-28T19:59:10.081395+0000","last_undegraded":"2023-11-28T19:59:10.081395+0000","last_fullsized":"2023-11-28T19:59:10.081395+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:59:04.008158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:59:04.008158+0000","last_clean_scrub_stamp":"2023-11-28T19:59:04.008158+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T07:38:26.527925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T19:59:10.892176+0000","last_change":"2023-11-28T19:59:10.111085+0000","last_active":"2023-11-28T19:59:10.892176+0000","last_peered":"2023-11-28T19:59:10.892176+0000","last_clean":"2023-11-28T19:59:10.892176+0000","last_became_active":"2023-11-28T19:59:10.109559+0000","last_became_peered":"2023-11-28T19:59:10.109559+0000","last_unstale":"2023-11-28T19:59:10.892176+0000","last_undegraded":"2023-11-28T19:59:10.892176+0000","last_fullsized":"2023-11-28T19:59:10.892176+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:59:09.059796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:59:09.059796+0000","last_clean_scrub_stamp":"2023-11-28T19:59:09.059796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:27:38.944595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T19:59:10.095949+0000","last_change":"2023-11-28T19:59:05.770947+0000","last_active":"2023-11-28T19:59:10.095949+0000","last_peered":"2023-11-28T19:59:10.095949+0000","last_clean":"2023-11-28T19:59:10.095949+0000","last_became_active":"2023-11-28T19:59:05.770478+0000","last_became_peered":"2023-11-28T19:59:05.770478+0000","last_unstale":"2023-11-28T19:59:10.095949+0000","last_undegraded":"2023-11-28T19:59:10.095949+0000","last_fullsized":"2023-11-28T19:59:10.095949+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:59:05.015714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:59:05.015714+0000","last_clean_scrub_stamp":"2023-11-28T19:59:05.015714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:39:44.998942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T19:59:10.096036+0000","last_change":"2023-11-28T19:59:05.047423+0000","last_active":"2023-11-28T19:59:10.096036+0000","last_peered":"2023-11-28T19:59:10.096036+0000","last_clean":"2023-11-28T19:59:10.096036+0000","last_became_active":"2023-11-28T19:59:05.047076+0000","last_became_peered":"2023-11-28T19:59:05.047076+0000","last_unstale":"2023-11-28T19:59:10.096036+0000","last_undegraded":"2023-11-28T19:59:10.096036+0000","last_fullsized":"2023-11-28T19:59:10.096036+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:59:04.008158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:59:04.008158+0000","last_clean_scrub_stamp":"2023-11-28T19:59:04.008158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T06:50:50.328228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T19:59:10.748835+0000","last_change":"2023-11-28T19:59:10.238924+0000","last_active":"2023-11-28T19:59:10.748835+0000","last_peered":"2023-11-28T19:59:10.748835+0000","last_clean":"2023-11-28T19:59:10.748835+0000","last_became_active":"2023-11-28T19:59:10.237678+0000","last_became_peered":"2023-11-28T19:59:10.237678+0000","last_unstale":"2023-11-28T19:59:10.748835+0000","last_undegraded":"2023-11-28T19:59:10.748835+0000","last_fullsized":"2023-11-28T19:59:10.748835+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:59:09.059796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:59:09.059796+0000","last_clean_scrub_stamp":"2023-11-28T19:59:09.059796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:39:07.159036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T19:59:10.231706+0000","last_change":"2023-11-28T19:59:05.786376+0000","last_active":"2023-11-28T19:59:10.231706+0000","last_peered":"2023-11-28T19:59:10.231706+0000","last_clean":"2023-11-28T19:59:10.231706+0000","last_became_active":"2023-11-28T19:59:05.785920+0000","last_became_peered":"2023-11-28T19:59:05.785920+0000","last_unstale":"2023-11-28T19:59:10.231706+0000","last_undegraded":"2023-11-28T19:59:10.231706+0000","last_fullsized":"2023-11-28T19:59:10.231706+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:59:05.015714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:59:05.015714+0000","last_clean_scrub_stamp":"2023-11-28T19:59:05.015714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:09:40.330419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T19:59:10.086641+0000","last_change":"2023-11-28T19:59:05.046163+0000","last_active":"2023-11-28T19:59:10.086641+0000","last_peered":"2023-11-28T19:59:10.086641+0000","last_clean":"2023-11-28T19:59:10.086641+0000","last_became_active":"2023-11-28T19:59:05.045305+0000","last_became_peered":"2023-11-28T19:59:05.045305+0000","last_unstale":"2023-11-28T19:59:10.086641+0000","last_undegraded":"2023-11-28T19:59:10.086641+0000","last_fullsized":"2023-11-28T19:59:10.086641+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:59:04.008158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:59:04.008158+0000","last_clean_scrub_stamp":"2023-11-28T19:59:04.008158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:24:47.265269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T19:59:10.749020+0000","last_change":"2023-11-28T19:59:10.238640+0000","last_active":"2023-11-28T19:59:10.749020+0000","last_peered":"2023-11-28T19:59:10.749020+0000","last_clean":"2023-11-28T19:59:10.749020+0000","last_became_active":"2023-11-28T19:59:10.236870+0000","last_became_peered":"2023-11-28T19:59:10.236870+0000","last_unstale":"2023-11-28T19:59:10.749020+0000","last_undegraded":"2023-11-28T19:59:10.749020+0000","last_fullsized":"2023-11-28T19:59:10.749020+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:59:09.059796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:59:09.059796+0000","last_clean_scrub_stamp":"2023-11-28T19:59:09.059796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:43:34.452592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T19:59:10.105258+0000","last_change":"2023-11-28T19:59:05.772859+0000","last_active":"2023-11-28T19:59:10.105258+0000","last_peered":"2023-11-28T19:59:10.105258+0000","last_clean":"2023-11-28T19:59:10.105258+0000","last_became_active":"2023-11-28T19:59:05.772598+0000","last_became_peered":"2023-11-28T19:59:05.772598+0000","last_unstale":"2023-11-28T19:59:10.105258+0000","last_undegraded":"2023-11-28T19:59:10.105258+0000","last_fullsized":"2023-11-28T19:59:10.105258+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:59:05.015714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:59:05.015714+0000","last_clean_scrub_stamp":"2023-11-28T19:59:05.015714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:44:02.102081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"20'2","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T19:59:10.105695+0000","last_change":"2023-11-28T19:59:05.048324+0000","last_active":"2023-11-28T19:59:10.105695+0000","last_peered":"2023-11-28T19:59:10.105695+0000","last_clean":"2023-11-28T19:59:10.105695+0000","last_became_active":"2023-11-28T19:59:05.048010+0000","last_became_peered":"2023-11-28T19:59:05.048010+0000","last_unstale":"2023-11-28T19:59:10.105695+0000","last_undegraded":"2023-11-28T19:59:10.105695+0000","last_fullsized":"2023-11-28T19:59:10.105695+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:59:04.008158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:59:04.008158+0000","last_clean_scrub_stamp":"2023-11-28T19:59:04.008158+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:47:35.984593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T19:59:10.751337+0000","last_change":"2023-11-28T19:59:10.233429+0000","last_active":"2023-11-28T19:59:10.751337+0000","last_peered":"2023-11-28T19:59:10.751337+0000","last_clean":"2023-11-28T19:59:10.751337+0000","last_became_active":"2023-11-28T19:59:10.232923+0000","last_became_peered":"2023-11-28T19:59:10.232923+0000","last_unstale":"2023-11-28T19:59:10.751337+0000","last_undegraded":"2023-11-28T19:59:10.751337+0000","last_fullsized":"2023-11-28T19:59:10.751337+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:59:09.059796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:59:09.059796+0000","last_clean_scrub_stamp":"2023-11-28T19:59:09.059796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:30:43.834211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T19:59:10.231692+0000","last_change":"2023-11-28T19:59:05.785594+0000","last_active":"2023-11-28T19:59:10.231692+0000","last_peered":"2023-11-28T19:59:10.231692+0000","last_clean":"2023-11-28T19:59:10.231692+0000","last_became_active":"2023-11-28T19:59:05.783565+0000","last_became_peered":"2023-11-28T19:59:05.783565+0000","last_unstale":"2023-11-28T19:59:10.231692+0000","last_undegraded":"2023-11-28T19:59:10.231692+0000","last_fullsized":"2023-11-28T19:59:10.231692+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:59:05.015714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:59:05.015714+0000","last_clean_scrub_stamp":"2023-11-28T19:59:05.015714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:21:21.519406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"25'9","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T19:59:16.612954+0000","last_change":"2023-11-28T19:59:05.050492+0000","last_active":"2023-11-28T19:59:16.612954+0000","last_peered":"2023-11-28T19:59:16.612954+0000","last_clean":"2023-11-28T19:59:16.612954+0000","last_became_active":"2023-11-28T19:59:05.050201+0000","last_became_peered":"2023-11-28T19:59:05.050201+0000","last_unstale":"2023-11-28T19:59:16.612954+0000","last_undegraded":"2023-11-28T19:59:16.612954+0000","last_fullsized":"2023-11-28T19:59:16.612954+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:59:04.008158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:59:04.008158+0000","last_clean_scrub_stamp":"2023-11-28T19:59:04.008158+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T06:35:58.085712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3841,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T19:59:10.891969+0000","last_change":"2023-11-28T19:59:10.110604+0000","last_active":"2023-11-28T19:59:10.891969+0000","last_peered":"2023-11-28T19:59:10.891969+0000","last_clean":"2023-11-28T19:59:10.891969+0000","last_became_active":"2023-11-28T19:59:10.109600+0000","last_became_peered":"2023-11-28T19:59:10.109600+0000","last_unstale":"2023-11-28T19:59:10.891969+0000","last_undegraded":"2023-11-28T19:59:10.891969+0000","last_fullsized":"2023-11-28T19:59:10.891969+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:59:09.059796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:59:09.059796+0000","last_clean_scrub_stamp":"2023-11-28T19:59:09.059796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:04:22.608590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T19:59:10.093975+0000","last_change":"2023-11-28T19:59:05.779793+0000","last_active":"2023-11-28T19:59:10.093975+0000","last_peered":"2023-11-28T19:59:10.093975+0000","last_clean":"2023-11-28T19:59:10.093975+0000","last_became_active":"2023-11-28T19:59:05.779488+0000","last_became_peered":"2023-11-28T19:59:05.779488+0000","last_unstale":"2023-11-28T19:59:10.093975+0000","last_undegraded":"2023-11-28T19:59:10.093975+0000","last_fullsized":"2023-11-28T19:59:10.093975+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:59:05.015714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:59:05.015714+0000","last_clean_scrub_stamp":"2023-11-28T19:59:05.015714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:55:00.138576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"20'3","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T19:59:10.099653+0000","last_change":"2023-11-28T19:59:05.044226+0000","last_active":"2023-11-28T19:59:10.099653+0000","last_peered":"2023-11-28T19:59:10.099653+0000","last_clean":"2023-11-28T19:59:10.099653+0000","last_became_active":"2023-11-28T19:59:05.043946+0000","last_became_peered":"2023-11-28T19:59:05.043946+0000","last_unstale":"2023-11-28T19:59:10.099653+0000","last_undegraded":"2023-11-28T19:59:10.099653+0000","last_fullsized":"2023-11-28T19:59:10.099653+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:59:04.008158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:59:04.008158+0000","last_clean_scrub_stamp":"2023-11-28T19:59:04.008158+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:47:35.984593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T19:59:10.751315+0000","last_change":"2023-11-28T19:59:10.101312+0000","last_active":"2023-11-28T19:59:10.751315+0000","last_peered":"2023-11-28T19:59:10.751315+0000","last_clean":"2023-11-28T19:59:10.751315+0000","last_became_active":"2023-11-28T19:59:10.100486+0000","last_became_peered":"2023-11-28T19:59:10.100486+0000","last_unstale":"2023-11-28T19:59:10.751315+0000","last_undegraded":"2023-11-28T19:59:10.751315+0000","last_fullsized":"2023-11-28T19:59:10.751315+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:59:09.059796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:59:09.059796+0000","last_clean_scrub_stamp":"2023-11-28T19:59:09.059796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:56:13.684509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T19:59:10.106097+0000","last_change":"2023-11-28T19:59:05.781405+0000","last_active":"2023-11-28T19:59:10.106097+0000","last_peered":"2023-11-28T19:59:10.106097+0000","last_clean":"2023-11-28T19:59:10.106097+0000","last_became_active":"2023-11-28T19:59:05.781191+0000","last_became_peered":"2023-11-28T19:59:05.781191+0000","last_unstale":"2023-11-28T19:59:10.106097+0000","last_undegraded":"2023-11-28T19:59:10.106097+0000","last_fullsized":"2023-11-28T19:59:10.106097+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:59:05.015714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:59:05.015714+0000","last_clean_scrub_stamp":"2023-11-28T19:59:05.015714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:05:03.688191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T19:59:10.087858+0000","last_change":"2023-11-28T19:59:05.043993+0000","last_active":"2023-11-28T19:59:10.087858+0000","last_peered":"2023-11-28T19:59:10.087858+0000","last_clean":"2023-11-28T19:59:10.087858+0000","last_became_active":"2023-11-28T19:59:05.043601+0000","last_became_peered":"2023-11-28T19:59:05.043601+0000","last_unstale":"2023-11-28T19:59:10.087858+0000","last_undegraded":"2023-11-28T19:59:10.087858+0000","last_fullsized":"2023-11-28T19:59:10.087858+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:59:04.008158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:59:04.008158+0000","last_clean_scrub_stamp":"2023-11-28T19:59:04.008158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:34:40.633276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T19:59:10.748222+0000","last_change":"2023-11-28T19:59:10.118024+0000","last_active":"2023-11-28T19:59:10.748222+0000","last_peered":"2023-11-28T19:59:10.748222+0000","last_clean":"2023-11-28T19:59:10.748222+0000","last_became_active":"2023-11-28T19:59:10.117574+0000","last_became_peered":"2023-11-28T19:59:10.117574+0000","last_unstale":"2023-11-28T19:59:10.748222+0000","last_undegraded":"2023-11-28T19:59:10.748222+0000","last_fullsized":"2023-11-28T19:59:10.748222+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:59:09.059796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:59:09.059796+0000","last_clean_scrub_stamp":"2023-11-28T19:59:09.059796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:34:54.217873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T19:59:10.087770+0000","last_change":"2023-11-28T19:59:05.773474+0000","last_active":"2023-11-28T19:59:10.087770+0000","last_peered":"2023-11-28T19:59:10.087770+0000","last_clean":"2023-11-28T19:59:10.087770+0000","last_became_active":"2023-11-28T19:59:05.773148+0000","last_became_peered":"2023-11-28T19:59:05.773148+0000","last_unstale":"2023-11-28T19:59:10.087770+0000","last_undegraded":"2023-11-28T19:59:10.087770+0000","last_fullsized":"2023-11-28T19:59:10.087770+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:59:05.015714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:59:05.015714+0000","last_clean_scrub_stamp":"2023-11-28T19:59:05.015714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:27:34.900513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T19:59:10.097405+0000","last_change":"2023-11-28T19:59:05.044167+0000","last_active":"2023-11-28T19:59:10.097405+0000","last_peered":"2023-11-28T19:59:10.097405+0000","last_clean":"2023-11-28T19:59:10.097405+0000","last_became_active":"2023-11-28T19:59:05.043651+0000","last_became_peered":"2023-11-28T19:59:05.043651+0000","last_unstale":"2023-11-28T19:59:10.097405+0000","last_undegraded":"2023-11-28T19:59:10.097405+0000","last_fullsized":"2023-11-28T19:59:10.097405+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:59:04.008158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:59:04.008158+0000","last_clean_scrub_stamp":"2023-11-28T19:59:04.008158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:44:01.094524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T19:59:10.748417+0000","last_change":"2023-11-28T19:59:10.237079+0000","last_active":"2023-11-28T19:59:10.748417+0000","last_peered":"2023-11-28T19:59:10.748417+0000","last_clean":"2023-11-28T19:59:10.748417+0000","last_became_active":"2023-11-28T19:59:10.236659+0000","last_became_peered":"2023-11-28T19:59:10.236659+0000","last_unstale":"2023-11-28T19:59:10.748417+0000","last_undegraded":"2023-11-28T19:59:10.748417+0000","last_fullsized":"2023-11-28T19:59:10.748417+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:59:09.059796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:59:09.059796+0000","last_clean_scrub_stamp":"2023-11-28T19:59:09.059796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:47:39.329731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T19:59:10.892053+0000","last_change":"2023-11-28T19:59:10.236815+0000","last_active":"2023-11-28T19:59:10.892053+0000","last_peered":"2023-11-28T19:59:10.892053+0000","last_clean":"2023-11-28T19:59:10.892053+0000","last_became_active":"2023-11-28T19:59:10.236466+0000","last_became_peered":"2023-11-28T19:59:10.236466+0000","last_unstale":"2023-11-28T19:59:10.892053+0000","last_undegraded":"2023-11-28T19:59:10.892053+0000","last_fullsized":"2023-11-28T19:59:10.892053+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:59:09.059796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:59:09.059796+0000","last_clean_scrub_stamp":"2023-11-28T19:59:09.059796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:59:19.161634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T19:59:10.098528+0000","last_change":"2023-11-28T19:59:05.757721+0000","last_active":"2023-11-28T19:59:10.098528+0000","last_peered":"2023-11-28T19:59:10.098528+0000","last_clean":"2023-11-28T19:59:10.098528+0000","last_became_active":"2023-11-28T19:59:05.757410+0000","last_became_peered":"2023-11-28T19:59:05.757410+0000","last_unstale":"2023-11-28T19:59:10.098528+0000","last_undegraded":"2023-11-28T19:59:10.098528+0000","last_fullsized":"2023-11-28T19:59:10.098528+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:59:05.015714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:59:05.015714+0000","last_clean_scrub_stamp":"2023-11-28T19:59:05.015714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:21:11.899134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T19:59:10.085948+0000","last_change":"2023-11-28T19:59:05.035784+0000","last_active":"2023-11-28T19:59:10.085948+0000","last_peered":"2023-11-28T19:59:10.085948+0000","last_clean":"2023-11-28T19:59:10.085948+0000","last_became_active":"2023-11-28T19:59:05.035438+0000","last_became_peered":"2023-11-28T19:59:05.035438+0000","last_unstale":"2023-11-28T19:59:10.085948+0000","last_undegraded":"2023-11-28T19:59:10.085948+0000","last_fullsized":"2023-11-28T19:59:10.085948+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:59:04.008158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:59:04.008158+0000","last_clean_scrub_stamp":"2023-11-28T19:59:04.008158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:50:57.704628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T19:59:10.892842+0000","last_change":"2023-11-28T19:59:10.118648+0000","last_active":"2023-11-28T19:59:10.892842+0000","last_peered":"2023-11-28T19:59:10.892842+0000","last_clean":"2023-11-28T19:59:10.892842+0000","last_became_active":"2023-11-28T19:59:10.118092+0000","last_became_peered":"2023-11-28T19:59:10.118092+0000","last_unstale":"2023-11-28T19:59:10.892842+0000","last_undegraded":"2023-11-28T19:59:10.892842+0000","last_fullsized":"2023-11-28T19:59:10.892842+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:59:09.059796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:59:09.059796+0000","last_clean_scrub_stamp":"2023-11-28T19:59:09.059796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:27:38.944595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T19:59:10.086761+0000","last_change":"2023-11-28T19:59:05.770886+0000","last_active":"2023-11-28T19:59:10.086761+0000","last_peered":"2023-11-28T19:59:10.086761+0000","last_clean":"2023-11-28T19:59:10.086761+0000","last_became_active":"2023-11-28T19:59:05.770493+0000","last_became_peered":"2023-11-28T19:59:05.770493+0000","last_unstale":"2023-11-28T19:59:10.086761+0000","last_undegraded":"2023-11-28T19:59:10.086761+0000","last_fullsized":"2023-11-28T19:59:10.086761+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:59:05.015714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:59:05.015714+0000","last_clean_scrub_stamp":"2023-11-28T19:59:05.015714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:39:44.998942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T19:59:10.087599+0000","last_change":"2023-11-28T19:59:05.046151+0000","last_active":"2023-11-28T19:59:10.087599+0000","last_peered":"2023-11-28T19:59:10.087599+0000","last_clean":"2023-11-28T19:59:10.087599+0000","last_became_active":"2023-11-28T19:59:05.045604+0000","last_became_peered":"2023-11-28T19:59:05.045604+0000","last_unstale":"2023-11-28T19:59:10.087599+0000","last_undegraded":"2023-11-28T19:59:10.087599+0000","last_fullsized":"2023-11-28T19:59:10.087599+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:59:04.008158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:59:04.008158+0000","last_clean_scrub_stamp":"2023-11-28T19:59:04.008158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:59:05.695936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"20'1","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T19:59:10.096286+0000","last_change":"2023-11-28T19:59:05.048629+0000","last_active":"2023-11-28T19:59:10.096286+0000","last_peered":"2023-11-28T19:59:10.096286+0000","last_clean":"2023-11-28T19:59:10.096286+0000","last_became_active":"2023-11-28T19:59:05.048345+0000","last_became_peered":"2023-11-28T19:59:05.048345+0000","last_unstale":"2023-11-28T19:59:10.096286+0000","last_undegraded":"2023-11-28T19:59:10.096286+0000","last_fullsized":"2023-11-28T19:59:10.096286+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:59:04.008158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:59:04.008158+0000","last_clean_scrub_stamp":"2023-11-28T19:59:04.008158+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:59:05.695936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T19:59:10.105600+0000","last_change":"2023-11-28T19:59:05.777065+0000","last_active":"2023-11-28T19:59:10.105600+0000","last_peered":"2023-11-28T19:59:10.105600+0000","last_clean":"2023-11-28T19:59:10.105600+0000","last_became_active":"2023-11-28T19:59:05.776748+0000","last_became_peered":"2023-11-28T19:59:05.776748+0000","last_unstale":"2023-11-28T19:59:10.105600+0000","last_undegraded":"2023-11-28T19:59:10.105600+0000","last_fullsized":"2023-11-28T19:59:10.105600+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:59:05.015714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:59:05.015714+0000","last_clean_scrub_stamp":"2023-11-28T19:59:05.015714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:39:44.998942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T19:59:10.892135+0000","last_change":"2023-11-28T19:59:10.107795+0000","last_active":"2023-11-28T19:59:10.892135+0000","last_peered":"2023-11-28T19:59:10.892135+0000","last_clean":"2023-11-28T19:59:10.892135+0000","last_became_active":"2023-11-28T19:59:10.107403+0000","last_became_peered":"2023-11-28T19:59:10.107403+0000","last_unstale":"2023-11-28T19:59:10.892135+0000","last_undegraded":"2023-11-28T19:59:10.892135+0000","last_fullsized":"2023-11-28T19:59:10.892135+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:59:09.059796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:59:09.059796+0000","last_clean_scrub_stamp":"2023-11-28T19:59:09.059796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:24:52.316908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"20'1","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T19:59:10.085998+0000","last_change":"2023-11-28T19:59:05.055074+0000","last_active":"2023-11-28T19:59:10.085998+0000","last_peered":"2023-11-28T19:59:10.085998+0000","last_clean":"2023-11-28T19:59:10.085998+0000","last_became_active":"2023-11-28T19:59:05.054809+0000","last_became_peered":"2023-11-28T19:59:05.054809+0000","last_unstale":"2023-11-28T19:59:10.085998+0000","last_undegraded":"2023-11-28T19:59:10.085998+0000","last_fullsized":"2023-11-28T19:59:10.085998+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:59:04.008158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:59:04.008158+0000","last_clean_scrub_stamp":"2023-11-28T19:59:04.008158+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:24:47.265269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T19:59:10.086324+0000","last_change":"2023-11-28T19:59:05.757750+0000","last_active":"2023-11-28T19:59:10.086324+0000","last_peered":"2023-11-28T19:59:10.086324+0000","last_clean":"2023-11-28T19:59:10.086324+0000","last_became_active":"2023-11-28T19:59:05.756939+0000","last_became_peered":"2023-11-28T19:59:05.756939+0000","last_unstale":"2023-11-28T19:59:10.086324+0000","last_undegraded":"2023-11-28T19:59:10.086324+0000","last_fullsized":"2023-11-28T19:59:10.086324+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:59:05.015714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:59:05.015714+0000","last_clean_scrub_stamp":"2023-11-28T19:59:05.015714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:55:40.811535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T19:59:10.748574+0000","last_change":"2023-11-28T19:59:10.108523+0000","last_active":"2023-11-28T19:59:10.748574+0000","last_peered":"2023-11-28T19:59:10.748574+0000","last_clean":"2023-11-28T19:59:10.748574+0000","last_became_active":"2023-11-28T19:59:10.108151+0000","last_became_peered":"2023-11-28T19:59:10.108151+0000","last_unstale":"2023-11-28T19:59:10.748574+0000","last_undegraded":"2023-11-28T19:59:10.748574+0000","last_fullsized":"2023-11-28T19:59:10.748574+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:59:09.059796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:59:09.059796+0000","last_clean_scrub_stamp":"2023-11-28T19:59:09.059796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:30:43.834211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T19:59:10.095918+0000","last_change":"2023-11-28T19:59:05.771095+0000","last_active":"2023-11-28T19:59:10.095918+0000","last_peered":"2023-11-28T19:59:10.095918+0000","last_clean":"2023-11-28T19:59:10.095918+0000","last_became_active":"2023-11-28T19:59:05.770756+0000","last_became_peered":"2023-11-28T19:59:05.770756+0000","last_unstale":"2023-11-28T19:59:10.095918+0000","last_undegraded":"2023-11-28T19:59:10.095918+0000","last_fullsized":"2023-11-28T19:59:10.095918+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:59:05.015714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:59:05.015714+0000","last_clean_scrub_stamp":"2023-11-28T19:59:05.015714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:21:11.899134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T19:59:10.081519+0000","last_change":"2023-11-28T19:59:05.764023+0000","last_active":"2023-11-28T19:59:10.081519+0000","last_peered":"2023-11-28T19:59:10.081519+0000","last_clean":"2023-11-28T19:59:10.081519+0000","last_became_active":"2023-11-28T19:59:05.763722+0000","last_became_peered":"2023-11-28T19:59:05.763722+0000","last_unstale":"2023-11-28T19:59:10.081519+0000","last_undegraded":"2023-11-28T19:59:10.081519+0000","last_fullsized":"2023-11-28T19:59:10.081519+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:59:05.015714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:59:05.015714+0000","last_clean_scrub_stamp":"2023-11-28T19:59:05.015714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:55:00.138576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T19:59:10.086587+0000","last_change":"2023-11-28T19:59:05.771306+0000","last_active":"2023-11-28T19:59:10.086587+0000","last_peered":"2023-11-28T19:59:10.086587+0000","last_clean":"2023-11-28T19:59:10.086587+0000","last_became_active":"2023-11-28T19:59:05.770978+0000","last_became_peered":"2023-11-28T19:59:05.770978+0000","last_unstale":"2023-11-28T19:59:10.086587+0000","last_undegraded":"2023-11-28T19:59:10.086587+0000","last_fullsized":"2023-11-28T19:59:10.086587+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:59:05.015714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:59:05.015714+0000","last_clean_scrub_stamp":"2023-11-28T19:59:05.015714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:04:04.508815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T19:59:10.105498+0000","last_change":"2023-11-28T19:59:05.772219+0000","last_active":"2023-11-28T19:59:10.105498+0000","last_peered":"2023-11-28T19:59:10.105498+0000","last_clean":"2023-11-28T19:59:10.105498+0000","last_became_active":"2023-11-28T19:59:05.771554+0000","last_became_peered":"2023-11-28T19:59:05.771554+0000","last_unstale":"2023-11-28T19:59:10.105498+0000","last_undegraded":"2023-11-28T19:59:10.105498+0000","last_fullsized":"2023-11-28T19:59:10.105498+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:59:05.015714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:59:05.015714+0000","last_clean_scrub_stamp":"2023-11-28T19:59:05.015714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:00:56.432813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T19:59:10.089982+0000","last_change":"2023-11-28T19:59:05.760600+0000","last_active":"2023-11-28T19:59:10.089982+0000","last_peered":"2023-11-28T19:59:10.089982+0000","last_clean":"2023-11-28T19:59:10.089982+0000","last_became_active":"2023-11-28T19:59:05.760294+0000","last_became_peered":"2023-11-28T19:59:05.760294+0000","last_unstale":"2023-11-28T19:59:10.089982+0000","last_undegraded":"2023-11-28T19:59:10.089982+0000","last_fullsized":"2023-11-28T19:59:10.089982+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:59:05.015714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:59:05.015714+0000","last_clean_scrub_stamp":"2023-11-28T19:59:05.015714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:21:11.899134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T19:59:10.099562+0000","last_change":"2023-11-28T19:59:05.766493+0000","last_active":"2023-11-28T19:59:10.099562+0000","last_peered":"2023-11-28T19:59:10.099562+0000","last_clean":"2023-11-28T19:59:10.099562+0000","last_became_active":"2023-11-28T19:59:05.766183+0000","last_became_peered":"2023-11-28T19:59:05.766183+0000","last_unstale":"2023-11-28T19:59:10.099562+0000","last_undegraded":"2023-11-28T19:59:10.099562+0000","last_fullsized":"2023-11-28T19:59:10.099562+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:59:05.015714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:59:05.015714+0000","last_clean_scrub_stamp":"2023-11-28T19:59:05.015714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:34:41.640833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T19:59:10.097144+0000","last_change":"2023-11-28T19:59:05.767616+0000","last_active":"2023-11-28T19:59:10.097144+0000","last_peered":"2023-11-28T19:59:10.097144+0000","last_clean":"2023-11-28T19:59:10.097144+0000","last_became_active":"2023-11-28T19:59:05.766973+0000","last_became_peered":"2023-11-28T19:59:05.766973+0000","last_unstale":"2023-11-28T19:59:10.097144+0000","last_undegraded":"2023-11-28T19:59:10.097144+0000","last_fullsized":"2023-11-28T19:59:10.097144+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:59:05.015714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:59:05.015714+0000","last_clean_scrub_stamp":"2023-11-28T19:59:05.015714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:21:21.519406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T19:59:10.092009+0000","last_change":"2023-11-28T19:59:05.760962+0000","last_active":"2023-11-28T19:59:10.092009+0000","last_peered":"2023-11-28T19:59:10.092009+0000","last_clean":"2023-11-28T19:59:10.092009+0000","last_became_active":"2023-11-28T19:59:05.760666+0000","last_became_peered":"2023-11-28T19:59:05.760666+0000","last_unstale":"2023-11-28T19:59:10.092009+0000","last_undegraded":"2023-11-28T19:59:10.092009+0000","last_fullsized":"2023-11-28T19:59:10.092009+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:59:05.015714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:59:05.015714+0000","last_clean_scrub_stamp":"2023-11-28T19:59:05.015714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:21:21.519406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T19:59:10.085859+0000","last_change":"2023-11-28T19:59:05.769994+0000","last_active":"2023-11-28T19:59:10.085859+0000","last_peered":"2023-11-28T19:59:10.085859+0000","last_clean":"2023-11-28T19:59:10.085859+0000","last_became_active":"2023-11-28T19:59:05.764430+0000","last_became_peered":"2023-11-28T19:59:05.764430+0000","last_unstale":"2023-11-28T19:59:10.085859+0000","last_undegraded":"2023-11-28T19:59:10.085859+0000","last_fullsized":"2023-11-28T19:59:10.085859+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:59:05.015714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:59:05.015714+0000","last_clean_scrub_stamp":"2023-11-28T19:59:05.015714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:13:21.633400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T19:59:10.087468+0000","last_change":"2023-11-28T19:59:05.776439+0000","last_active":"2023-11-28T19:59:10.087468+0000","last_peered":"2023-11-28T19:59:10.087468+0000","last_clean":"2023-11-28T19:59:10.087468+0000","last_became_active":"2023-11-28T19:59:05.776196+0000","last_became_peered":"2023-11-28T19:59:05.776196+0000","last_unstale":"2023-11-28T19:59:10.087468+0000","last_undegraded":"2023-11-28T19:59:10.087468+0000","last_fullsized":"2023-11-28T19:59:10.087468+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:59:05.015714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:59:05.015714+0000","last_clean_scrub_stamp":"2023-11-28T19:59:05.015714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:44:02.102081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T19:59:10.086540+0000","last_change":"2023-11-28T19:59:05.775620+0000","last_active":"2023-11-28T19:59:10.086540+0000","last_peered":"2023-11-28T19:59:10.086540+0000","last_clean":"2023-11-28T19:59:10.086540+0000","last_became_active":"2023-11-28T19:59:05.775057+0000","last_became_peered":"2023-11-28T19:59:05.775057+0000","last_unstale":"2023-11-28T19:59:10.086540+0000","last_undegraded":"2023-11-28T19:59:10.086540+0000","last_fullsized":"2023-11-28T19:59:10.086540+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:59:05.015714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:59:05.015714+0000","last_clean_scrub_stamp":"2023-11-28T19:59:05.015714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:21:21.519406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T19:59:10.105499+0000","last_change":"2023-11-28T19:59:05.783460+0000","last_active":"2023-11-28T19:59:10.105499+0000","last_peered":"2023-11-28T19:59:10.105499+0000","last_clean":"2023-11-28T19:59:10.105499+0000","last_became_active":"2023-11-28T19:59:05.783195+0000","last_became_peered":"2023-11-28T19:59:05.783195+0000","last_unstale":"2023-11-28T19:59:10.105499+0000","last_undegraded":"2023-11-28T19:59:10.105499+0000","last_fullsized":"2023-11-28T19:59:10.105499+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:59:05.015714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:59:05.015714+0000","last_clean_scrub_stamp":"2023-11-28T19:59:05.015714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:18:37.608605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T19:59:10.096571+0000","last_change":"2023-11-28T19:59:05.775976+0000","last_active":"2023-11-28T19:59:10.096571+0000","last_peered":"2023-11-28T19:59:10.096571+0000","last_clean":"2023-11-28T19:59:10.096571+0000","last_became_active":"2023-11-28T19:59:05.775738+0000","last_became_peered":"2023-11-28T19:59:05.775738+0000","last_unstale":"2023-11-28T19:59:10.096571+0000","last_undegraded":"2023-11-28T19:59:10.096571+0000","last_fullsized":"2023-11-28T19:59:10.096571+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:59:05.015714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:59:05.015714+0000","last_clean_scrub_stamp":"2023-11-28T19:59:05.015714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T06:26:55.424441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T19:59:10.231824+0000","last_change":"2023-11-28T19:59:05.786686+0000","last_active":"2023-11-28T19:59:10.231824+0000","last_peered":"2023-11-28T19:59:10.231824+0000","last_clean":"2023-11-28T19:59:10.231824+0000","last_became_active":"2023-11-28T19:59:05.786141+0000","last_became_peered":"2023-11-28T19:59:05.786141+0000","last_unstale":"2023-11-28T19:59:10.231824+0000","last_undegraded":"2023-11-28T19:59:10.231824+0000","last_fullsized":"2023-11-28T19:59:10.231824+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:59:05.015714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:59:05.015714+0000","last_clean_scrub_stamp":"2023-11-28T19:59:05.015714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:04:18.564508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T19:59:10.081827+0000","last_change":"2023-11-28T19:59:05.768915+0000","last_active":"2023-11-28T19:59:10.081827+0000","last_peered":"2023-11-28T19:59:10.081827+0000","last_clean":"2023-11-28T19:59:10.081827+0000","last_became_active":"2023-11-28T19:59:05.768661+0000","last_became_peered":"2023-11-28T19:59:05.768661+0000","last_unstale":"2023-11-28T19:59:10.081827+0000","last_undegraded":"2023-11-28T19:59:10.081827+0000","last_fullsized":"2023-11-28T19:59:10.081827+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:59:05.015714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:59:05.015714+0000","last_clean_scrub_stamp":"2023-11-28T19:59:05.015714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T06:50:51.335785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T19:59:10.086791+0000","last_change":"2023-11-28T19:59:05.763580+0000","last_active":"2023-11-28T19:59:10.086791+0000","last_peered":"2023-11-28T19:59:10.086791+0000","last_clean":"2023-11-28T19:59:10.086791+0000","last_became_active":"2023-11-28T19:59:05.763254+0000","last_became_peered":"2023-11-28T19:59:05.763254+0000","last_unstale":"2023-11-28T19:59:10.086791+0000","last_undegraded":"2023-11-28T19:59:10.086791+0000","last_fullsized":"2023-11-28T19:59:10.086791+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:59:05.015714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:59:05.015714+0000","last_clean_scrub_stamp":"2023-11-28T19:59:05.015714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:50:40.999064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T19:59:10.085773+0000","last_change":"2023-11-28T19:59:05.774080+0000","last_active":"2023-11-28T19:59:10.085773+0000","last_peered":"2023-11-28T19:59:10.085773+0000","last_clean":"2023-11-28T19:59:10.085773+0000","last_became_active":"2023-11-28T19:59:05.773751+0000","last_became_peered":"2023-11-28T19:59:05.773751+0000","last_unstale":"2023-11-28T19:59:10.085773+0000","last_undegraded":"2023-11-28T19:59:10.085773+0000","last_fullsized":"2023-11-28T19:59:10.085773+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:59:05.015714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:59:05.015714+0000","last_clean_scrub_stamp":"2023-11-28T19:59:05.015714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:05:03.688191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T19:59:10.098523+0000","last_change":"2023-11-28T19:59:05.766875+0000","last_active":"2023-11-28T19:59:10.098523+0000","last_peered":"2023-11-28T19:59:10.098523+0000","last_clean":"2023-11-28T19:59:10.098523+0000","last_became_active":"2023-11-28T19:59:05.766555+0000","last_became_peered":"2023-11-28T19:59:05.766555+0000","last_unstale":"2023-11-28T19:59:10.098523+0000","last_undegraded":"2023-11-28T19:59:10.098523+0000","last_fullsized":"2023-11-28T19:59:10.098523+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:59:05.015714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:59:05.015714+0000","last_clean_scrub_stamp":"2023-11-28T19:59:05.015714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:00:56.432813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T19:59:10.105223+0000","last_change":"2023-11-28T19:59:05.769350+0000","last_active":"2023-11-28T19:59:10.105223+0000","last_peered":"2023-11-28T19:59:10.105223+0000","last_clean":"2023-11-28T19:59:10.105223+0000","last_became_active":"2023-11-28T19:59:05.769067+0000","last_became_peered":"2023-11-28T19:59:05.769067+0000","last_unstale":"2023-11-28T19:59:10.105223+0000","last_undegraded":"2023-11-28T19:59:10.105223+0000","last_fullsized":"2023-11-28T19:59:10.105223+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:59:05.015714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:59:05.015714+0000","last_clean_scrub_stamp":"2023-11-28T19:59:05.015714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:24:48.272826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T19:59:10.085817+0000","last_change":"2023-11-28T19:59:05.768359+0000","last_active":"2023-11-28T19:59:10.085817+0000","last_peered":"2023-11-28T19:59:10.085817+0000","last_clean":"2023-11-28T19:59:10.085817+0000","last_became_active":"2023-11-28T19:59:05.768033+0000","last_became_peered":"2023-11-28T19:59:05.768033+0000","last_unstale":"2023-11-28T19:59:10.085817+0000","last_undegraded":"2023-11-28T19:59:10.085817+0000","last_fullsized":"2023-11-28T19:59:10.085817+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:59:05.015714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:59:05.015714+0000","last_clean_scrub_stamp":"2023-11-28T19:59:05.015714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:00:56.432813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T19:59:10.093892+0000","last_change":"2023-11-28T19:59:05.769430+0000","last_active":"2023-11-28T19:59:10.093892+0000","last_peered":"2023-11-28T19:59:10.093892+0000","last_clean":"2023-11-28T19:59:10.093892+0000","last_became_active":"2023-11-28T19:59:05.769077+0000","last_became_peered":"2023-11-28T19:59:05.769077+0000","last_unstale":"2023-11-28T19:59:10.093892+0000","last_undegraded":"2023-11-28T19:59:10.093892+0000","last_fullsized":"2023-11-28T19:59:10.093892+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:59:05.015714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:59:05.015714+0000","last_clean_scrub_stamp":"2023-11-28T19:59:05.015714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T06:50:51.335785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T19:59:10.096948+0000","last_change":"2023-11-28T19:59:05.780244+0000","last_active":"2023-11-28T19:59:10.096948+0000","last_peered":"2023-11-28T19:59:10.096948+0000","last_clean":"2023-11-28T19:59:10.096948+0000","last_became_active":"2023-11-28T19:59:05.779967+0000","last_became_peered":"2023-11-28T19:59:05.779967+0000","last_unstale":"2023-11-28T19:59:10.096948+0000","last_undegraded":"2023-11-28T19:59:10.096948+0000","last_fullsized":"2023-11-28T19:59:10.096948+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:59:05.015714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:59:05.015714+0000","last_clean_scrub_stamp":"2023-11-28T19:59:05.015714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:37:45.006198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T19:59:10.097115+0000","last_change":"2023-11-28T19:59:05.780306+0000","last_active":"2023-11-28T19:59:10.097115+0000","last_peered":"2023-11-28T19:59:10.097115+0000","last_clean":"2023-11-28T19:59:10.097115+0000","last_became_active":"2023-11-28T19:59:05.780039+0000","last_became_peered":"2023-11-28T19:59:05.780039+0000","last_unstale":"2023-11-28T19:59:10.097115+0000","last_undegraded":"2023-11-28T19:59:10.097115+0000","last_fullsized":"2023-11-28T19:59:10.097115+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:59:05.015714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:59:05.015714+0000","last_clean_scrub_stamp":"2023-11-28T19:59:05.015714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:05:03.688191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T19:59:10.232048+0000","last_change":"2023-11-28T19:59:05.786228+0000","last_active":"2023-11-28T19:59:10.232048+0000","last_peered":"2023-11-28T19:59:10.232048+0000","last_clean":"2023-11-28T19:59:10.232048+0000","last_became_active":"2023-11-28T19:59:05.785937+0000","last_became_peered":"2023-11-28T19:59:05.785937+0000","last_unstale":"2023-11-28T19:59:10.232048+0000","last_undegraded":"2023-11-28T19:59:10.232048+0000","last_fullsized":"2023-11-28T19:59:10.232048+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:59:05.015714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:59:05.015714+0000","last_clean_scrub_stamp":"2023-11-28T19:59:05.015714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:27:34.900513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T19:59:10.086749+0000","last_change":"2023-11-28T19:59:05.764238+0000","last_active":"2023-11-28T19:59:10.086749+0000","last_peered":"2023-11-28T19:59:10.086749+0000","last_clean":"2023-11-28T19:59:10.086749+0000","last_became_active":"2023-11-28T19:59:05.763941+0000","last_became_peered":"2023-11-28T19:59:05.763941+0000","last_unstale":"2023-11-28T19:59:10.086749+0000","last_undegraded":"2023-11-28T19:59:10.086749+0000","last_fullsized":"2023-11-28T19:59:10.086749+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:59:05.015714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:59:05.015714+0000","last_clean_scrub_stamp":"2023-11-28T19:59:05.015714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:18:37.608605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T19:59:10.231401+0000","last_change":"2023-11-28T19:59:05.777444+0000","last_active":"2023-11-28T19:59:10.231401+0000","last_peered":"2023-11-28T19:59:10.231401+0000","last_clean":"2023-11-28T19:59:10.231401+0000","last_became_active":"2023-11-28T19:59:05.777096+0000","last_became_peered":"2023-11-28T19:59:05.777096+0000","last_unstale":"2023-11-28T19:59:10.231401+0000","last_undegraded":"2023-11-28T19:59:10.231401+0000","last_fullsized":"2023-11-28T19:59:10.231401+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:59:05.015714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:59:05.015714+0000","last_clean_scrub_stamp":"2023-11-28T19:59:05.015714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:37:45.006198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T19:59:10.086470+0000","last_change":"2023-11-28T19:59:05.775817+0000","last_active":"2023-11-28T19:59:10.086470+0000","last_peered":"2023-11-28T19:59:10.086470+0000","last_clean":"2023-11-28T19:59:10.086470+0000","last_became_active":"2023-11-28T19:59:05.775434+0000","last_became_peered":"2023-11-28T19:59:05.775434+0000","last_unstale":"2023-11-28T19:59:10.086470+0000","last_undegraded":"2023-11-28T19:59:10.086470+0000","last_fullsized":"2023-11-28T19:59:10.086470+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:59:05.015714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:59:05.015714+0000","last_clean_scrub_stamp":"2023-11-28T19:59:05.015714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:37:45.006198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T19:59:10.231662+0000","last_change":"2023-11-28T19:59:05.773714+0000","last_active":"2023-11-28T19:59:10.231662+0000","last_peered":"2023-11-28T19:59:10.231662+0000","last_clean":"2023-11-28T19:59:10.231662+0000","last_became_active":"2023-11-28T19:59:05.773423+0000","last_became_peered":"2023-11-28T19:59:05.773423+0000","last_unstale":"2023-11-28T19:59:10.231662+0000","last_undegraded":"2023-11-28T19:59:10.231662+0000","last_fullsized":"2023-11-28T19:59:10.231662+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:59:05.015714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:59:05.015714+0000","last_clean_scrub_stamp":"2023-11-28T19:59:05.015714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:13:21.633400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T19:59:10.087840+0000","last_change":"2023-11-28T19:59:05.770679+0000","last_active":"2023-11-28T19:59:10.087840+0000","last_peered":"2023-11-28T19:59:10.087840+0000","last_clean":"2023-11-28T19:59:10.087840+0000","last_became_active":"2023-11-28T19:59:05.770220+0000","last_became_peered":"2023-11-28T19:59:05.770220+0000","last_unstale":"2023-11-28T19:59:10.087840+0000","last_undegraded":"2023-11-28T19:59:10.087840+0000","last_fullsized":"2023-11-28T19:59:10.087840+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:59:05.015714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:59:05.015714+0000","last_clean_scrub_stamp":"2023-11-28T19:59:05.015714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:56:09.640427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T19:59:10.106440+0000","last_change":"2023-11-28T19:59:05.763243+0000","last_active":"2023-11-28T19:59:10.106440+0000","last_peered":"2023-11-28T19:59:10.106440+0000","last_clean":"2023-11-28T19:59:10.106440+0000","last_became_active":"2023-11-28T19:59:05.762624+0000","last_became_peered":"2023-11-28T19:59:05.762624+0000","last_unstale":"2023-11-28T19:59:10.106440+0000","last_undegraded":"2023-11-28T19:59:10.106440+0000","last_fullsized":"2023-11-28T19:59:10.106440+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:59:05.015714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:59:05.015714+0000","last_clean_scrub_stamp":"2023-11-28T19:59:05.015714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:21:11.899134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T19:59:10.099378+0000","last_change":"2023-11-28T19:59:05.766991+0000","last_active":"2023-11-28T19:59:10.099378+0000","last_peered":"2023-11-28T19:59:10.099378+0000","last_clean":"2023-11-28T19:59:10.099378+0000","last_became_active":"2023-11-28T19:59:05.766715+0000","last_became_peered":"2023-11-28T19:59:05.766715+0000","last_unstale":"2023-11-28T19:59:10.099378+0000","last_undegraded":"2023-11-28T19:59:10.099378+0000","last_fullsized":"2023-11-28T19:59:10.099378+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:59:05.015714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:59:05.015714+0000","last_clean_scrub_stamp":"2023-11-28T19:59:05.015714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:05:03.688191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T19:59:10.231952+0000","last_change":"2023-11-28T19:59:05.784181+0000","last_active":"2023-11-28T19:59:10.231952+0000","last_peered":"2023-11-28T19:59:10.231952+0000","last_clean":"2023-11-28T19:59:10.231952+0000","last_became_active":"2023-11-28T19:59:05.783940+0000","last_became_peered":"2023-11-28T19:59:05.783940+0000","last_unstale":"2023-11-28T19:59:10.231952+0000","last_undegraded":"2023-11-28T19:59:10.231952+0000","last_fullsized":"2023-11-28T19:59:10.231952+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:59:05.015714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:59:05.015714+0000","last_clean_scrub_stamp":"2023-11-28T19:59:05.015714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:59:15.117552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4639,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9278,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":66748,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574858,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27348,"kb_used_data":328,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344492,"statfs":{"total":96636764160,"available":96608759808,"internally_reserved":0,"allocated":335872,"data_stored":695413,"data_compressed":33374,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.749}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54000000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59299999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56899999999999995}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.432}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67000000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.626}]}]},{"osd":6,"up_from":13,"seq":55834574856,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27288,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344552,"statfs":{"total":96636764160,"available":96608821248,"internally_reserved":0,"allocated":278528,"data_stored":108304,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65000000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76300000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60099999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70599999999999996}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52100000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84399999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54900000000000004}]}]},{"osd":5,"up_from":13,"seq":55834574858,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27292,"kb_used_data":264,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344548,"statfs":{"total":96636764160,"available":96608817152,"internally_reserved":0,"allocated":270336,"data_stored":104553,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85599999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60599999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56999999999999995}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63400000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72999999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71099999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67200000000000004}]}]},{"osd":4,"up_from":13,"seq":55834574857,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27300,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344540,"statfs":{"total":96636764160,"available":96608808960,"internally_reserved":0,"allocated":278528,"data_stored":104589,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61699999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56000000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60399999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64500000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53400000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70399999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77900000000000003}]}]},{"osd":3,"up_from":13,"seq":55834574858,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27288,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344552,"statfs":{"total":96636764160,"available":96608821248,"internally_reserved":0,"allocated":278528,"data_stored":108304,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36099999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46200000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52200000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57199999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.74299999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70299999999999996}]}]},{"osd":2,"up_from":13,"seq":55834574856,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27288,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344552,"statfs":{"total":96636764160,"available":96608821248,"internally_reserved":0,"allocated":266240,"data_stored":104463,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54400000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51300000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.628}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83999999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95799999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91400000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89800000000000002}]}]},{"osd":1,"up_from":13,"seq":55834574858,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27300,"kb_used_data":268,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344540,"statfs":{"total":96636764160,"available":96608808960,"internally_reserved":0,"allocated":274432,"data_stored":104623,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36899999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33000000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77800000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59199999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82799999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78800000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.74299999999999999}]}]},{"osd":0,"up_from":13,"seq":55834574857,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27360,"kb_used_data":336,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344480,"statfs":{"total":96636764160,"available":96608747520,"internally_reserved":0,"allocated":344064,"data_stored":695469,"data_compressed":33374,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36499999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46100000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38600000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.621}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57299999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66400000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60099999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33374,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33374,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3841,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3841,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-28T19:59:29.465 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-28T19:59:29.638 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:29.631+0000 7fe86e8ea640 1 Processor -- start 2023-11-28T19:59:29.638 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:29.631+0000 7fe86e8ea640 1 -- start start 2023-11-28T19:59:29.639 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:29.635+0000 7fe86e8ea640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fe86806d690 0x7fe8680c5300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:29.639 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:29.635+0000 7fe86e8ea640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe86806db20 con 0x7fe8680c3b80 2023-11-28T19:59:29.639 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:29.635+0000 7fe86e8ea640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe86806bb80 con 0x7fe86806d2b0 2023-11-28T19:59:29.639 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:29.635+0000 7fe86e8ea640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe8680c5840 con 0x7fe86806d690 2023-11-28T19:59:29.639 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:29.635+0000 7fe8677fe640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7fe8680c3b80 0x7fe86806c730 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:54020/0 (socket says 172.21.15.78:54020) 2023-11-28T19:59:29.639 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:29.635+0000 7fe8677fe640 1 -- 172.21.15.78:0/25558777 learned_addr learned my addr 172.21.15.78:0/25558777 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-11-28T19:59:29.641 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:29.635+0000 7fe86ce87640 1 --2- 172.21.15.78:0/25558777 >> v2:172.21.15.179:3300/0 conn(0x7fe86806d690 0x7fe8680c5300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:29.642 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:29.635+0000 7fe866ffd640 1 -- 172.21.15.78:0/25558777 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1887544467 0 0) 0x7fe85c001120 con 0x7fe8680c3b80 2023-11-28T19:59:29.642 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:29.635+0000 7fe866ffd640 1 -- 172.21.15.78:0/25558777 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe850003530 con 0x7fe8680c3b80 2023-11-28T19:59:29.642 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:29.635+0000 7fe866ffd640 1 -- 172.21.15.78:0/25558777 <== mon.0 v1:172.21.15.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2761019367 0 0) 0x7fe850003530 con 0x7fe8680c3b80 2023-11-28T19:59:29.642 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:29.635+0000 7fe866ffd640 1 -- 172.21.15.78:0/25558777 >> v2:172.21.15.179:3300/0 conn(0x7fe86806d690 msgr2=0x7fe8680c5300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T19:59:29.642 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:29.635+0000 7fe866ffd640 1 --2- 172.21.15.78:0/25558777 >> v2:172.21.15.179:3300/0 conn(0x7fe86806d690 0x7fe8680c5300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:29.642 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:29.635+0000 7fe866ffd640 1 -- 172.21.15.78:0/25558777 >> v1:172.21.15.179:6789/0 conn(0x7fe86806d2b0 legacy=0x7fe86806c020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:29.642 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:29.635+0000 7fe866ffd640 1 -- 172.21.15.78:0/25558777 --> v1:172.21.15.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8681515c0 con 0x7fe8680c3b80 2023-11-28T19:59:29.642 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:29.635+0000 7fe866ffd640 1 -- 172.21.15.78:0/25558777 <== mon.0 v1:172.21.15.78:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3326804700 0 0) 0x7fe85c001810 con 0x7fe8680c3b80 2023-11-28T19:59:29.642 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:29.635+0000 7fe866ffd640 1 -- 172.21.15.78:0/25558777 >> v1:172.21.15.78:6789/0 conn(0x7fe8680c3b80 legacy=0x7fe86806c730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:29.642 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:29.635+0000 7fe866ffd640 1 --2- 172.21.15.78:0/25558777 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe850003980 0x7fe850003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:29.643 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:29.635+0000 7fe866ffd640 1 --2- 172.21.15.78:0/25558777 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe8500047d0 0x7fe850004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:29.643 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:29.635+0000 7fe866ffd640 1 --2- 172.21.15.78:0/25558777 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe850005190 0x7fe85000b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:29.643 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:29.635+0000 7fe866ffd640 1 -- 172.21.15.78:0/25558777 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8680c5840 con 0x7fe850003980 2023-11-28T19:59:29.643 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:29.635+0000 7fe866ffd640 1 -- 172.21.15.78:0/25558777 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe85000c030 con 0x7fe850005190 2023-11-28T19:59:29.643 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:29.635+0000 7fe866ffd640 1 -- 172.21.15.78:0/25558777 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe85000c1f0 con 0x7fe8500047d0 2023-11-28T19:59:29.643 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:29.635+0000 7fe867fff640 1 --2- 172.21.15.78:0/25558777 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe850003980 0x7fe850003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:29.643 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:29.635+0000 7fe8677fe640 1 --2- 172.21.15.78:0/25558777 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe8500047d0 0x7fe850004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:29.643 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:29.635+0000 7fe86ce87640 1 --2- 172.21.15.78:0/25558777 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe850005190 0x7fe85000b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:29.644 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:29.635+0000 7fe867fff640 1 -- 172.21.15.78:0/25558777 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe8500047d0 msgr2=0x7fe850004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T19:59:29.644 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:29.635+0000 7fe867fff640 1 --2- 172.21.15.78:0/25558777 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe8500047d0 0x7fe850004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:29.644 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:29.635+0000 7fe867fff640 1 -- 172.21.15.78:0/25558777 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe850005190 msgr2=0x7fe85000b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T19:59:29.644 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:29.635+0000 7fe867fff640 1 --2- 172.21.15.78:0/25558777 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe850005190 0x7fe85000b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:29.644 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:29.635+0000 7fe867fff640 1 -- 172.21.15.78:0/25558777 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe850003530 con 0x7fe850003980 2023-11-28T19:59:29.644 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:29.635+0000 7fe86ce87640 1 --2- 172.21.15.78:0/25558777 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe850005190 0x7fe85000b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T19:59:29.644 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:29.635+0000 7fe86ce87640 1 -- 172.21.15.78:0/25558777 reap_dead start 2023-11-28T19:59:29.644 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:29.635+0000 7fe8677fe640 1 --2- 172.21.15.78:0/25558777 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe8500047d0 0x7fe850004c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T19:59:29.645 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:29.639+0000 7fe867fff640 1 --2- 172.21.15.78:0/25558777 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe850003980 0x7fe850003da0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fe858001780 tx=0x7fe85801c3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b470531c2302205e server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:59:29.645 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:29.639+0000 7fe866ffd640 1 -- 172.21.15.78:0/25558777 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8580052d0 con 0x7fe850003980 2023-11-28T19:59:29.645 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:29.639+0000 7fe866ffd640 1 -- 172.21.15.78:0/25558777 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe8580a7050 con 0x7fe850003980 2023-11-28T19:59:29.645 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:29.639+0000 7fe866ffd640 1 -- 172.21.15.78:0/25558777 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe858003600 con 0x7fe850003980 2023-11-28T19:59:29.646 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:29.639+0000 7fe86e8ea640 1 -- 172.21.15.78:0/25558777 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe850003980 msgr2=0x7fe850003da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:29.646 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:29.639+0000 7fe86e8ea640 1 --2- 172.21.15.78:0/25558777 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe850003980 0x7fe850003da0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fe858001780 tx=0x7fe85801c3b0 comp rx=0 tx=0).stop 2023-11-28T19:59:29.646 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:29.639+0000 7fe86e8ea640 1 -- 172.21.15.78:0/25558777 shutdown_connections 2023-11-28T19:59:29.646 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:29.639+0000 7fe86e8ea640 1 --2- 172.21.15.78:0/25558777 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe850003980 0x7fe850003da0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:29.646 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:29.639+0000 7fe86e8ea640 1 -- 172.21.15.78:0/25558777 >> 172.21.15.78:0/25558777 conn(0x7fe8680a7810 msgr2=0x7fe8680a7c20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T19:59:29.646 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:29.639+0000 7fe86e8ea640 1 -- 172.21.15.78:0/25558777 shutdown_connections 2023-11-28T19:59:29.646 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:29.639+0000 7fe86e8ea640 1 -- 172.21.15.78:0/25558777 wait complete. 2023-11-28T19:59:29.647 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:29.639+0000 7fe86e8ea640 1 Processor -- start 2023-11-28T19:59:29.647 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:29.639+0000 7fe86e8ea640 1 -- start start 2023-11-28T19:59:29.649 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:29.643+0000 7fe86e8ea640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe850003980 0x7fe8681ee5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:29.649 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:29.643+0000 7fe86e8ea640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe8681462c0 0x7fe868150ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:29.649 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:29.643+0000 7fe86e8ea640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe868150120 0x7fe868146f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:29.649 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:29.643+0000 7fe86e8ea640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe86814f9f0 con 0x7fe850003980 2023-11-28T19:59:29.649 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:29.643+0000 7fe86e8ea640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe86814fc90 con 0x7fe8681462c0 2023-11-28T19:59:29.649 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:29.643+0000 7fe86e8ea640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe868154e30 con 0x7fe868150120 2023-11-28T19:59:29.649 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:29.643+0000 7fe867fff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe850003980 0x7fe8681ee5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:29.649 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:29.643+0000 7fe867fff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe850003980 0x7fe8681ee5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:53272/0 (socket says 172.21.15.78:53272) 2023-11-28T19:59:29.650 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:29.643+0000 7fe867fff640 1 -- 172.21.15.78:0/1033275616 learned_addr learned my addr 172.21.15.78:0/1033275616 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T19:59:29.650 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:29.643+0000 7fe86ce87640 1 --2- 172.21.15.78:0/1033275616 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe868150120 0x7fe868146f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:29.650 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:29.643+0000 7fe8677fe640 1 --2- 172.21.15.78:0/1033275616 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe8681462c0 0x7fe868150ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:29.650 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:29.643+0000 7fe867fff640 1 -- 172.21.15.78:0/1033275616 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe868150120 msgr2=0x7fe868146f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:29.650 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:29.643+0000 7fe867fff640 1 --2- 172.21.15.78:0/1033275616 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe868150120 0x7fe868146f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:29.650 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:29.643+0000 7fe867fff640 1 -- 172.21.15.78:0/1033275616 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe8681462c0 msgr2=0x7fe868150ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:29.650 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:29.643+0000 7fe867fff640 1 --2- 172.21.15.78:0/1033275616 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe8681462c0 0x7fe868150ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:29.650 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:29.643+0000 7fe867fff640 1 -- 172.21.15.78:0/1033275616 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe86814ef80 con 0x7fe850003980 2023-11-28T19:59:29.650 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:29.643+0000 7fe8677fe640 1 --2- 172.21.15.78:0/1033275616 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe8681462c0 0x7fe868150ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T19:59:29.650 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:29.643+0000 7fe86ce87640 1 --2- 172.21.15.78:0/1033275616 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe868150120 0x7fe868146f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T19:59:29.650 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:29.643+0000 7fe867fff640 1 --2- 172.21.15.78:0/1033275616 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe850003980 0x7fe8681ee5e0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fe858005040 tx=0x7fe850005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:59:29.651 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:29.643+0000 7fe864ff9640 1 -- 172.21.15.78:0/1033275616 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8580072f0 con 0x7fe850003980 2023-11-28T19:59:29.651 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:29.643+0000 7fe864ff9640 1 -- 172.21.15.78:0/1033275616 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe858007450 con 0x7fe850003980 2023-11-28T19:59:29.651 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:29.643+0000 7fe864ff9640 1 -- 172.21.15.78:0/1033275616 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8580067e0 con 0x7fe850003980 2023-11-28T19:59:29.651 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:29.643+0000 7fe86e8ea640 1 -- 172.21.15.78:0/1033275616 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe868155110 con 0x7fe850003980 2023-11-28T19:59:29.651 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:29.643+0000 7fe86e8ea640 1 -- 172.21.15.78:0/1033275616 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe8681556d0 con 0x7fe850003980 2023-11-28T19:59:29.652 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:29.643+0000 7fe86e8ea640 1 -- 172.21.15.78:0/1033275616 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe8681558c0 con 0x7fe850003980 2023-11-28T19:59:29.652 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:29.643+0000 7fe864ff9640 1 -- 172.21.15.78:0/1033275616 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fe858006940 con 0x7fe850003980 2023-11-28T19:59:29.652 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:29.647+0000 7fe864ff9640 1 --2- 172.21.15.78:0/1033275616 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fe8540664a0 0x7fe854068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:29.652 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:29.647+0000 7fe864ff9640 1 -- 172.21.15.78:0/1033275616 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fe85811e1c0 con 0x7fe850003980 2023-11-28T19:59:29.652 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:29.647+0000 7fe8677fe640 1 --2- 172.21.15.78:0/1033275616 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fe8540664a0 0x7fe854068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:29.652 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:29.647+0000 7fe8677fe640 1 --2- 172.21.15.78:0/1033275616 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fe8540664a0 0x7fe854068960 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fe85c001020 tx=0x7fe85c009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:59:29.655 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:29.651+0000 7fe864ff9640 1 -- 172.21.15.78:0/1033275616 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fe8681558c0 con 0x7fe850003980 2023-11-28T19:59:29.805 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:29.799+0000 7fe86e8ea640 1 -- 172.21.15.78:0/1033275616 --> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fe86806fe50 con 0x7fe8540664a0 2023-11-28T19:59:29.814 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:29.807+0000 7fe864ff9640 1 -- 172.21.15.78:0/1033275616 <== mgr.4106 v2:172.21.15.78:6832/2935380957 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+345366 (secure 0 0 0) 0x7fe86806fe50 con 0x7fe8540664a0 2023-11-28T19:59:29.817 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-11-28T19:59:29.819 INFO:teuthology.orchestra.run.smithi078.stderr:dumped all 2023-11-28T19:59:29.820 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:29.811+0000 7fe86e8ea640 1 -- 172.21.15.78:0/1033275616 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fe8540664a0 msgr2=0x7fe854068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:29.820 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:29.811+0000 7fe86e8ea640 1 --2- 172.21.15.78:0/1033275616 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fe8540664a0 0x7fe854068960 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fe85c001020 tx=0x7fe85c009040 comp rx=0 tx=0).stop 2023-11-28T19:59:29.820 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:29.811+0000 7fe86e8ea640 1 -- 172.21.15.78:0/1033275616 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe850003980 msgr2=0x7fe8681ee5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:29.821 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:29.811+0000 7fe86e8ea640 1 --2- 172.21.15.78:0/1033275616 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe850003980 0x7fe8681ee5e0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fe858005040 tx=0x7fe850005800 comp rx=0 tx=0).stop 2023-11-28T19:59:29.821 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:29.811+0000 7fe86e8ea640 1 -- 172.21.15.78:0/1033275616 shutdown_connections 2023-11-28T19:59:29.821 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:29.811+0000 7fe86e8ea640 1 --2- 172.21.15.78:0/1033275616 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fe8540664a0 0x7fe854068960 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:29.821 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:29.811+0000 7fe86e8ea640 1 --2- 172.21.15.78:0/1033275616 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe868150120 0x7fe868146f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:29.822 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:29.811+0000 7fe86e8ea640 1 --2- 172.21.15.78:0/1033275616 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe8681462c0 0x7fe868150ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:29.822 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:29.811+0000 7fe86e8ea640 1 --2- 172.21.15.78:0/1033275616 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe850003980 0x7fe8681ee5e0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:29.822 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:29.811+0000 7fe86e8ea640 1 -- 172.21.15.78:0/1033275616 >> 172.21.15.78:0/1033275616 conn(0x7fe8680a7810 msgr2=0x7fe8680c4b70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T19:59:29.823 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:29.811+0000 7fe86e8ea640 1 -- 172.21.15.78:0/1033275616 shutdown_connections 2023-11-28T19:59:29.823 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:29.811+0000 7fe86e8ea640 1 -- 172.21.15.78:0/1033275616 wait complete. 2023-11-28T19:59:29.838 INFO:teuthology.orchestra.run.smithi078.stdout:{"pg_ready":true,"pg_map":{"version":36,"stamp":"2023-11-28T19:59:27.958140+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595007,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":207,"num_write_kb":2434,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":159,"ondisk_log_size":159,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":218464,"kb_used_data":2272,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754756256,"statfs":{"total":773094113280,"available":772870406144,"internally_reserved":0,"allocated":2326528,"data_stored":2025718,"data_compressed":66748,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2229,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002595"},"pg_stats":[{"pgid":"2.1f","version":"20'4","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T19:59:10.106180+0000","last_change":"2023-11-28T19:59:05.052960+0000","last_active":"2023-11-28T19:59:10.106180+0000","last_peered":"2023-11-28T19:59:10.106180+0000","last_clean":"2023-11-28T19:59:10.106180+0000","last_became_active":"2023-11-28T19:59:05.052657+0000","last_became_peered":"2023-11-28T19:59:05.052657+0000","last_unstale":"2023-11-28T19:59:10.106180+0000","last_undegraded":"2023-11-28T19:59:10.106180+0000","last_fullsized":"2023-11-28T19:59:10.106180+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:59:04.008158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:59:04.008158+0000","last_clean_scrub_stamp":"2023-11-28T19:59:04.008158+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:54:59.131019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T19:59:10.086896+0000","last_change":"2023-11-28T19:59:05.769584+0000","last_active":"2023-11-28T19:59:10.086896+0000","last_peered":"2023-11-28T19:59:10.086896+0000","last_clean":"2023-11-28T19:59:10.086896+0000","last_became_active":"2023-11-28T19:59:05.769323+0000","last_became_peered":"2023-11-28T19:59:05.769323+0000","last_unstale":"2023-11-28T19:59:10.086896+0000","last_undegraded":"2023-11-28T19:59:10.086896+0000","last_fullsized":"2023-11-28T19:59:10.086896+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:59:05.015714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:59:05.015714+0000","last_clean_scrub_stamp":"2023-11-28T19:59:05.015714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:37:45.006198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T19:59:10.748258+0000","last_change":"2023-11-28T19:59:10.237008+0000","last_active":"2023-11-28T19:59:10.748258+0000","last_peered":"2023-11-28T19:59:10.748258+0000","last_clean":"2023-11-28T19:59:10.748258+0000","last_became_active":"2023-11-28T19:59:10.236605+0000","last_became_peered":"2023-11-28T19:59:10.236605+0000","last_unstale":"2023-11-28T19:59:10.748258+0000","last_undegraded":"2023-11-28T19:59:10.748258+0000","last_fullsized":"2023-11-28T19:59:10.748258+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:59:09.059796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:59:09.059796+0000","last_clean_scrub_stamp":"2023-11-28T19:59:09.059796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T06:47:20.838966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"20'1","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T19:59:10.086983+0000","last_change":"2023-11-28T19:59:05.045307+0000","last_active":"2023-11-28T19:59:10.086983+0000","last_peered":"2023-11-28T19:59:10.086983+0000","last_clean":"2023-11-28T19:59:10.086983+0000","last_became_active":"2023-11-28T19:59:05.044997+0000","last_became_peered":"2023-11-28T19:59:05.044997+0000","last_unstale":"2023-11-28T19:59:10.086983+0000","last_undegraded":"2023-11-28T19:59:10.086983+0000","last_fullsized":"2023-11-28T19:59:10.086983+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:59:04.008158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:59:04.008158+0000","last_clean_scrub_stamp":"2023-11-28T19:59:04.008158+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T06:35:58.085712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T19:59:10.106013+0000","last_change":"2023-11-28T19:59:05.781411+0000","last_active":"2023-11-28T19:59:10.106013+0000","last_peered":"2023-11-28T19:59:10.106013+0000","last_clean":"2023-11-28T19:59:10.106013+0000","last_became_active":"2023-11-28T19:59:05.781197+0000","last_became_peered":"2023-11-28T19:59:05.781197+0000","last_unstale":"2023-11-28T19:59:10.106013+0000","last_undegraded":"2023-11-28T19:59:10.106013+0000","last_fullsized":"2023-11-28T19:59:10.106013+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:59:05.015714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:59:05.015714+0000","last_clean_scrub_stamp":"2023-11-28T19:59:05.015714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T06:26:55.424441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T19:59:10.750326+0000","last_change":"2023-11-28T19:59:10.118362+0000","last_active":"2023-11-28T19:59:10.750326+0000","last_peered":"2023-11-28T19:59:10.750326+0000","last_clean":"2023-11-28T19:59:10.750326+0000","last_became_active":"2023-11-28T19:59:10.117821+0000","last_became_peered":"2023-11-28T19:59:10.117821+0000","last_unstale":"2023-11-28T19:59:10.750326+0000","last_undegraded":"2023-11-28T19:59:10.750326+0000","last_fullsized":"2023-11-28T19:59:10.750326+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:59:09.059796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:59:09.059796+0000","last_clean_scrub_stamp":"2023-11-28T19:59:09.059796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:05:07.732273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"20'2","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T19:59:10.231816+0000","last_change":"2023-11-28T19:59:05.058010+0000","last_active":"2023-11-28T19:59:10.231816+0000","last_peered":"2023-11-28T19:59:10.231816+0000","last_clean":"2023-11-28T19:59:10.231816+0000","last_became_active":"2023-11-28T19:59:05.055487+0000","last_became_peered":"2023-11-28T19:59:05.055487+0000","last_unstale":"2023-11-28T19:59:10.231816+0000","last_undegraded":"2023-11-28T19:59:10.231816+0000","last_fullsized":"2023-11-28T19:59:10.231816+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:59:04.008158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:59:04.008158+0000","last_clean_scrub_stamp":"2023-11-28T19:59:04.008158+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:44:01.094524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T19:59:10.087933+0000","last_change":"2023-11-28T19:59:05.779496+0000","last_active":"2023-11-28T19:59:10.087933+0000","last_peered":"2023-11-28T19:59:10.087933+0000","last_clean":"2023-11-28T19:59:10.087933+0000","last_became_active":"2023-11-28T19:59:05.777976+0000","last_became_peered":"2023-11-28T19:59:05.777976+0000","last_unstale":"2023-11-28T19:59:10.087933+0000","last_undegraded":"2023-11-28T19:59:10.087933+0000","last_fullsized":"2023-11-28T19:59:10.087933+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:59:05.015714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:59:05.015714+0000","last_clean_scrub_stamp":"2023-11-28T19:59:05.015714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:43:15.986749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T19:59:10.751202+0000","last_change":"2023-11-28T19:59:10.119257+0000","last_active":"2023-11-28T19:59:10.751202+0000","last_peered":"2023-11-28T19:59:10.751202+0000","last_clean":"2023-11-28T19:59:10.751202+0000","last_became_active":"2023-11-28T19:59:10.118744+0000","last_became_peered":"2023-11-28T19:59:10.118744+0000","last_unstale":"2023-11-28T19:59:10.751202+0000","last_undegraded":"2023-11-28T19:59:10.751202+0000","last_fullsized":"2023-11-28T19:59:10.751202+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:59:09.059796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:59:09.059796+0000","last_clean_scrub_stamp":"2023-11-28T19:59:09.059796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:04:08.552896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"20'2","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T19:59:10.231591+0000","last_change":"2023-11-28T19:59:05.054063+0000","last_active":"2023-11-28T19:59:10.231591+0000","last_peered":"2023-11-28T19:59:10.231591+0000","last_clean":"2023-11-28T19:59:10.231591+0000","last_became_active":"2023-11-28T19:59:05.053212+0000","last_became_peered":"2023-11-28T19:59:05.053212+0000","last_unstale":"2023-11-28T19:59:10.231591+0000","last_undegraded":"2023-11-28T19:59:10.231591+0000","last_fullsized":"2023-11-28T19:59:10.231591+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:59:04.008158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:59:04.008158+0000","last_clean_scrub_stamp":"2023-11-28T19:59:04.008158+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:50:57.704628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T19:59:10.086946+0000","last_change":"2023-11-28T19:59:05.779167+0000","last_active":"2023-11-28T19:59:10.086946+0000","last_peered":"2023-11-28T19:59:10.086946+0000","last_clean":"2023-11-28T19:59:10.086946+0000","last_became_active":"2023-11-28T19:59:05.778874+0000","last_became_peered":"2023-11-28T19:59:05.778874+0000","last_unstale":"2023-11-28T19:59:10.086946+0000","last_undegraded":"2023-11-28T19:59:10.086946+0000","last_fullsized":"2023-11-28T19:59:10.086946+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:59:05.015714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:59:05.015714+0000","last_clean_scrub_stamp":"2023-11-28T19:59:05.015714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:59:15.117552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T19:59:10.750952+0000","last_change":"2023-11-28T19:59:10.104844+0000","last_active":"2023-11-28T19:59:10.750952+0000","last_peered":"2023-11-28T19:59:10.750952+0000","last_clean":"2023-11-28T19:59:10.750952+0000","last_became_active":"2023-11-28T19:59:10.104381+0000","last_became_peered":"2023-11-28T19:59:10.104381+0000","last_unstale":"2023-11-28T19:59:10.750952+0000","last_undegraded":"2023-11-28T19:59:10.750952+0000","last_fullsized":"2023-11-28T19:59:10.750952+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:59:09.059796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:59:09.059796+0000","last_clean_scrub_stamp":"2023-11-28T19:59:09.059796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:21:25.563488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T19:59:10.096108+0000","last_change":"2023-11-28T19:59:05.777551+0000","last_active":"2023-11-28T19:59:10.096108+0000","last_peered":"2023-11-28T19:59:10.096108+0000","last_clean":"2023-11-28T19:59:10.096108+0000","last_became_active":"2023-11-28T19:59:05.777205+0000","last_became_peered":"2023-11-28T19:59:05.777205+0000","last_unstale":"2023-11-28T19:59:10.096108+0000","last_undegraded":"2023-11-28T19:59:10.096108+0000","last_fullsized":"2023-11-28T19:59:10.096108+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:59:05.015714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:59:05.015714+0000","last_clean_scrub_stamp":"2023-11-28T19:59:05.015714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:34:41.640833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"20'2","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T19:59:10.231766+0000","last_change":"2023-11-28T19:59:05.059530+0000","last_active":"2023-11-28T19:59:10.231766+0000","last_peered":"2023-11-28T19:59:10.231766+0000","last_clean":"2023-11-28T19:59:10.231766+0000","last_became_active":"2023-11-28T19:59:05.059170+0000","last_became_peered":"2023-11-28T19:59:05.059170+0000","last_unstale":"2023-11-28T19:59:10.231766+0000","last_undegraded":"2023-11-28T19:59:10.231766+0000","last_fullsized":"2023-11-28T19:59:10.231766+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:59:04.008158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:59:04.008158+0000","last_clean_scrub_stamp":"2023-11-28T19:59:04.008158+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:59:05.695936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T19:59:10.751627+0000","last_change":"2023-11-28T19:59:10.107622+0000","last_active":"2023-11-28T19:59:10.751627+0000","last_peered":"2023-11-28T19:59:10.751627+0000","last_clean":"2023-11-28T19:59:10.751627+0000","last_became_active":"2023-11-28T19:59:10.107067+0000","last_became_peered":"2023-11-28T19:59:10.107067+0000","last_unstale":"2023-11-28T19:59:10.751627+0000","last_undegraded":"2023-11-28T19:59:10.751627+0000","last_fullsized":"2023-11-28T19:59:10.751627+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:59:09.059796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:59:09.059796+0000","last_clean_scrub_stamp":"2023-11-28T19:59:09.059796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:43:20.030831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T19:59:10.085907+0000","last_change":"2023-11-28T19:59:05.770916+0000","last_active":"2023-11-28T19:59:10.085907+0000","last_peered":"2023-11-28T19:59:10.085907+0000","last_clean":"2023-11-28T19:59:10.085907+0000","last_became_active":"2023-11-28T19:59:05.770356+0000","last_became_peered":"2023-11-28T19:59:05.770356+0000","last_unstale":"2023-11-28T19:59:10.085907+0000","last_undegraded":"2023-11-28T19:59:10.085907+0000","last_fullsized":"2023-11-28T19:59:10.085907+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:59:05.015714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:59:05.015714+0000","last_clean_scrub_stamp":"2023-11-28T19:59:05.015714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:05:03.688191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T19:59:10.100383+0000","last_change":"2023-11-28T19:59:05.047719+0000","last_active":"2023-11-28T19:59:10.100383+0000","last_peered":"2023-11-28T19:59:10.100383+0000","last_clean":"2023-11-28T19:59:10.100383+0000","last_became_active":"2023-11-28T19:59:05.047441+0000","last_became_peered":"2023-11-28T19:59:05.047441+0000","last_unstale":"2023-11-28T19:59:10.100383+0000","last_undegraded":"2023-11-28T19:59:10.100383+0000","last_fullsized":"2023-11-28T19:59:10.100383+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:59:04.008158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:59:04.008158+0000","last_clean_scrub_stamp":"2023-11-28T19:59:04.008158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:24:13.851530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T19:59:10.751634+0000","last_change":"2023-11-28T19:59:10.118258+0000","last_active":"2023-11-28T19:59:10.751634+0000","last_peered":"2023-11-28T19:59:10.751634+0000","last_clean":"2023-11-28T19:59:10.751634+0000","last_became_active":"2023-11-28T19:59:10.117812+0000","last_became_peered":"2023-11-28T19:59:10.117812+0000","last_unstale":"2023-11-28T19:59:10.751634+0000","last_undegraded":"2023-11-28T19:59:10.751634+0000","last_fullsized":"2023-11-28T19:59:10.751634+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:59:09.059796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:59:09.059796+0000","last_clean_scrub_stamp":"2023-11-28T19:59:09.059796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:04:22.608590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T19:59:10.086832+0000","last_change":"2023-11-28T19:59:05.767529+0000","last_active":"2023-11-28T19:59:10.086832+0000","last_peered":"2023-11-28T19:59:10.086832+0000","last_clean":"2023-11-28T19:59:10.086832+0000","last_became_active":"2023-11-28T19:59:05.767237+0000","last_became_peered":"2023-11-28T19:59:05.767237+0000","last_unstale":"2023-11-28T19:59:10.086832+0000","last_undegraded":"2023-11-28T19:59:10.086832+0000","last_fullsized":"2023-11-28T19:59:10.086832+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:59:05.015714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:59:05.015714+0000","last_clean_scrub_stamp":"2023-11-28T19:59:05.015714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:34:41.640833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T19:59:10.098640+0000","last_change":"2023-11-28T19:59:05.053041+0000","last_active":"2023-11-28T19:59:10.098640+0000","last_peered":"2023-11-28T19:59:10.098640+0000","last_clean":"2023-11-28T19:59:10.098640+0000","last_became_active":"2023-11-28T19:59:05.052673+0000","last_became_peered":"2023-11-28T19:59:05.052673+0000","last_unstale":"2023-11-28T19:59:10.098640+0000","last_undegraded":"2023-11-28T19:59:10.098640+0000","last_fullsized":"2023-11-28T19:59:10.098640+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:59:04.008158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:59:04.008158+0000","last_clean_scrub_stamp":"2023-11-28T19:59:04.008158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:50:57.704628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T19:59:10.893246+0000","last_change":"2023-11-28T19:59:10.238462+0000","last_active":"2023-11-28T19:59:10.893246+0000","last_peered":"2023-11-28T19:59:10.893246+0000","last_clean":"2023-11-28T19:59:10.893246+0000","last_became_active":"2023-11-28T19:59:10.237988+0000","last_became_peered":"2023-11-28T19:59:10.237988+0000","last_unstale":"2023-11-28T19:59:10.893246+0000","last_undegraded":"2023-11-28T19:59:10.893246+0000","last_fullsized":"2023-11-28T19:59:10.893246+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:59:09.059796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:59:09.059796+0000","last_clean_scrub_stamp":"2023-11-28T19:59:09.059796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:09:44.374501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T19:59:10.085913+0000","last_change":"2023-11-28T19:59:05.766196+0000","last_active":"2023-11-28T19:59:10.085913+0000","last_peered":"2023-11-28T19:59:10.085913+0000","last_clean":"2023-11-28T19:59:10.085913+0000","last_became_active":"2023-11-28T19:59:05.765432+0000","last_became_peered":"2023-11-28T19:59:05.765432+0000","last_unstale":"2023-11-28T19:59:10.085913+0000","last_undegraded":"2023-11-28T19:59:10.085913+0000","last_fullsized":"2023-11-28T19:59:10.085913+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:59:05.015714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:59:05.015714+0000","last_clean_scrub_stamp":"2023-11-28T19:59:05.015714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T07:38:27.535482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T19:59:10.231396+0000","last_change":"2023-11-28T19:59:05.057961+0000","last_active":"2023-11-28T19:59:10.231396+0000","last_peered":"2023-11-28T19:59:10.231396+0000","last_clean":"2023-11-28T19:59:10.231396+0000","last_became_active":"2023-11-28T19:59:05.054572+0000","last_became_peered":"2023-11-28T19:59:05.054572+0000","last_unstale":"2023-11-28T19:59:10.231396+0000","last_undegraded":"2023-11-28T19:59:10.231396+0000","last_fullsized":"2023-11-28T19:59:10.231396+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:59:04.008158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:59:04.008158+0000","last_clean_scrub_stamp":"2023-11-28T19:59:04.008158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:55:39.803978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T19:59:10.751124+0000","last_change":"2023-11-28T19:59:10.110793+0000","last_active":"2023-11-28T19:59:10.751124+0000","last_peered":"2023-11-28T19:59:10.751124+0000","last_clean":"2023-11-28T19:59:10.751124+0000","last_became_active":"2023-11-28T19:59:10.110217+0000","last_became_peered":"2023-11-28T19:59:10.110217+0000","last_unstale":"2023-11-28T19:59:10.751124+0000","last_undegraded":"2023-11-28T19:59:10.751124+0000","last_fullsized":"2023-11-28T19:59:10.751124+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:59:09.059796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:59:09.059796+0000","last_clean_scrub_stamp":"2023-11-28T19:59:09.059796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:13:25.677482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T19:59:10.105874+0000","last_change":"2023-11-28T19:59:05.766438+0000","last_active":"2023-11-28T19:59:10.105874+0000","last_peered":"2023-11-28T19:59:10.105874+0000","last_clean":"2023-11-28T19:59:10.105874+0000","last_became_active":"2023-11-28T19:59:05.766122+0000","last_became_peered":"2023-11-28T19:59:05.766122+0000","last_unstale":"2023-11-28T19:59:10.105874+0000","last_undegraded":"2023-11-28T19:59:10.105874+0000","last_fullsized":"2023-11-28T19:59:10.105874+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:59:05.015714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:59:05.015714+0000","last_clean_scrub_stamp":"2023-11-28T19:59:05.015714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:34:41.640833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"20'2","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T19:59:10.097521+0000","last_change":"2023-11-28T19:59:05.051854+0000","last_active":"2023-11-28T19:59:10.097521+0000","last_peered":"2023-11-28T19:59:10.097521+0000","last_clean":"2023-11-28T19:59:10.097521+0000","last_became_active":"2023-11-28T19:59:05.051577+0000","last_became_peered":"2023-11-28T19:59:05.051577+0000","last_unstale":"2023-11-28T19:59:10.097521+0000","last_undegraded":"2023-11-28T19:59:10.097521+0000","last_fullsized":"2023-11-28T19:59:10.097521+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:59:04.008158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:59:04.008158+0000","last_clean_scrub_stamp":"2023-11-28T19:59:04.008158+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:18:36.601049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T19:59:10.750635+0000","last_change":"2023-11-28T19:59:10.233198+0000","last_active":"2023-11-28T19:59:10.750635+0000","last_peered":"2023-11-28T19:59:10.750635+0000","last_clean":"2023-11-28T19:59:10.750635+0000","last_became_active":"2023-11-28T19:59:10.232788+0000","last_became_peered":"2023-11-28T19:59:10.232788+0000","last_unstale":"2023-11-28T19:59:10.750635+0000","last_undegraded":"2023-11-28T19:59:10.750635+0000","last_fullsized":"2023-11-28T19:59:10.750635+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:59:09.059796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:59:09.059796+0000","last_clean_scrub_stamp":"2023-11-28T19:59:09.059796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:37:49.050280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T19:59:10.092085+0000","last_change":"2023-11-28T19:59:05.765916+0000","last_active":"2023-11-28T19:59:10.092085+0000","last_peered":"2023-11-28T19:59:10.092085+0000","last_clean":"2023-11-28T19:59:10.092085+0000","last_became_active":"2023-11-28T19:59:05.765601+0000","last_became_peered":"2023-11-28T19:59:05.765601+0000","last_unstale":"2023-11-28T19:59:10.092085+0000","last_undegraded":"2023-11-28T19:59:10.092085+0000","last_fullsized":"2023-11-28T19:59:10.092085+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:59:05.015714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:59:05.015714+0000","last_clean_scrub_stamp":"2023-11-28T19:59:05.015714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:13:21.633400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"23'1","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T19:59:10.099470+0000","last_change":"2023-11-28T19:59:05.043611+0000","last_active":"2023-11-28T19:59:10.099470+0000","last_peered":"2023-11-28T19:59:10.099470+0000","last_clean":"2023-11-28T19:59:10.099470+0000","last_became_active":"2023-11-28T19:59:05.043302+0000","last_became_peered":"2023-11-28T19:59:05.043302+0000","last_unstale":"2023-11-28T19:59:10.099470+0000","last_undegraded":"2023-11-28T19:59:10.099470+0000","last_fullsized":"2023-11-28T19:59:10.099470+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:59:04.008158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:59:04.008158+0000","last_clean_scrub_stamp":"2023-11-28T19:59:04.008158+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:24:47.265269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T19:59:10.748068+0000","last_change":"2023-11-28T19:59:10.233040+0000","last_active":"2023-11-28T19:59:10.748068+0000","last_peered":"2023-11-28T19:59:10.748068+0000","last_clean":"2023-11-28T19:59:10.748068+0000","last_became_active":"2023-11-28T19:59:10.232226+0000","last_became_peered":"2023-11-28T19:59:10.232226+0000","last_unstale":"2023-11-28T19:59:10.748068+0000","last_undegraded":"2023-11-28T19:59:10.748068+0000","last_fullsized":"2023-11-28T19:59:10.748068+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:59:09.059796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:59:09.059796+0000","last_clean_scrub_stamp":"2023-11-28T19:59:09.059796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:08:16.809984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T19:59:10.098944+0000","last_change":"2023-11-28T19:59:05.756970+0000","last_active":"2023-11-28T19:59:10.098944+0000","last_peered":"2023-11-28T19:59:10.098944+0000","last_clean":"2023-11-28T19:59:10.098944+0000","last_became_active":"2023-11-28T19:59:05.756706+0000","last_became_peered":"2023-11-28T19:59:05.756706+0000","last_unstale":"2023-11-28T19:59:10.098944+0000","last_undegraded":"2023-11-28T19:59:10.098944+0000","last_fullsized":"2023-11-28T19:59:10.098944+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:59:05.015714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:59:05.015714+0000","last_clean_scrub_stamp":"2023-11-28T19:59:05.015714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T06:26:55.424441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T19:59:10.231897+0000","last_change":"2023-11-28T19:59:05.058655+0000","last_active":"2023-11-28T19:59:10.231897+0000","last_peered":"2023-11-28T19:59:10.231897+0000","last_clean":"2023-11-28T19:59:10.231897+0000","last_became_active":"2023-11-28T19:59:05.058338+0000","last_became_peered":"2023-11-28T19:59:05.058338+0000","last_unstale":"2023-11-28T19:59:10.231897+0000","last_undegraded":"2023-11-28T19:59:10.231897+0000","last_fullsized":"2023-11-28T19:59:10.231897+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:59:04.008158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:59:04.008158+0000","last_clean_scrub_stamp":"2023-11-28T19:59:04.008158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:39:43.991385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T19:59:10.892006+0000","last_change":"2023-11-28T19:59:10.234696+0000","last_active":"2023-11-28T19:59:10.892006+0000","last_peered":"2023-11-28T19:59:10.892006+0000","last_clean":"2023-11-28T19:59:10.892006+0000","last_became_active":"2023-11-28T19:59:10.234219+0000","last_became_peered":"2023-11-28T19:59:10.234219+0000","last_unstale":"2023-11-28T19:59:10.892006+0000","last_undegraded":"2023-11-28T19:59:10.892006+0000","last_fullsized":"2023-11-28T19:59:10.892006+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:59:09.059796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:59:09.059796+0000","last_clean_scrub_stamp":"2023-11-28T19:59:09.059796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:04:22.608590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T19:59:10.086968+0000","last_change":"2023-11-28T19:59:05.773876+0000","last_active":"2023-11-28T19:59:10.086968+0000","last_peered":"2023-11-28T19:59:10.086968+0000","last_clean":"2023-11-28T19:59:10.086968+0000","last_became_active":"2023-11-28T19:59:05.773097+0000","last_became_peered":"2023-11-28T19:59:05.773097+0000","last_unstale":"2023-11-28T19:59:10.086968+0000","last_undegraded":"2023-11-28T19:59:10.086968+0000","last_fullsized":"2023-11-28T19:59:10.086968+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:59:05.015714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:59:05.015714+0000","last_clean_scrub_stamp":"2023-11-28T19:59:05.015714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:09:40.330419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T19:59:10.099027+0000","last_change":"2023-11-28T19:59:05.045257+0000","last_active":"2023-11-28T19:59:10.099027+0000","last_peered":"2023-11-28T19:59:10.099027+0000","last_clean":"2023-11-28T19:59:10.099027+0000","last_became_active":"2023-11-28T19:59:05.037691+0000","last_became_peered":"2023-11-28T19:59:05.037691+0000","last_unstale":"2023-11-28T19:59:10.099027+0000","last_undegraded":"2023-11-28T19:59:10.099027+0000","last_fullsized":"2023-11-28T19:59:10.099027+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:59:04.008158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:59:04.008158+0000","last_clean_scrub_stamp":"2023-11-28T19:59:04.008158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:44:01.094524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T19:59:10.892407+0000","last_change":"2023-11-28T19:59:10.110882+0000","last_active":"2023-11-28T19:59:10.892407+0000","last_peered":"2023-11-28T19:59:10.892407+0000","last_clean":"2023-11-28T19:59:10.892407+0000","last_became_active":"2023-11-28T19:59:10.110154+0000","last_became_peered":"2023-11-28T19:59:10.110154+0000","last_unstale":"2023-11-28T19:59:10.892407+0000","last_undegraded":"2023-11-28T19:59:10.892407+0000","last_fullsized":"2023-11-28T19:59:10.892407+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:59:09.059796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:59:09.059796+0000","last_clean_scrub_stamp":"2023-11-28T19:59:09.059796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:59:19.161634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T19:59:10.088733+0000","last_change":"2023-11-28T19:59:05.768336+0000","last_active":"2023-11-28T19:59:10.088733+0000","last_peered":"2023-11-28T19:59:10.088733+0000","last_clean":"2023-11-28T19:59:10.088733+0000","last_became_active":"2023-11-28T19:59:05.768035+0000","last_became_peered":"2023-11-28T19:59:05.768035+0000","last_unstale":"2023-11-28T19:59:10.088733+0000","last_undegraded":"2023-11-28T19:59:10.088733+0000","last_fullsized":"2023-11-28T19:59:10.088733+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:59:05.015714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:59:05.015714+0000","last_clean_scrub_stamp":"2023-11-28T19:59:05.015714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:54:54.632073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T19:59:10.086736+0000","last_change":"2023-11-28T19:59:05.039347+0000","last_active":"2023-11-28T19:59:10.086736+0000","last_peered":"2023-11-28T19:59:10.086736+0000","last_clean":"2023-11-28T19:59:10.086736+0000","last_became_active":"2023-11-28T19:59:05.038995+0000","last_became_peered":"2023-11-28T19:59:05.038995+0000","last_unstale":"2023-11-28T19:59:10.086736+0000","last_undegraded":"2023-11-28T19:59:10.086736+0000","last_fullsized":"2023-11-28T19:59:10.086736+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:59:04.008158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:59:04.008158+0000","last_clean_scrub_stamp":"2023-11-28T19:59:04.008158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T06:35:58.085712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T19:59:10.893010+0000","last_change":"2023-11-28T19:59:10.106996+0000","last_active":"2023-11-28T19:59:10.893010+0000","last_peered":"2023-11-28T19:59:10.893010+0000","last_clean":"2023-11-28T19:59:10.893010+0000","last_became_active":"2023-11-28T19:59:10.106321+0000","last_became_peered":"2023-11-28T19:59:10.106321+0000","last_unstale":"2023-11-28T19:59:10.893010+0000","last_undegraded":"2023-11-28T19:59:10.893010+0000","last_fullsized":"2023-11-28T19:59:10.893010+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:59:09.059796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:59:09.059796+0000","last_clean_scrub_stamp":"2023-11-28T19:59:09.059796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:27:38.944595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T19:59:10.098824+0000","last_change":"2023-11-28T19:59:05.756081+0000","last_active":"2023-11-28T19:59:10.098824+0000","last_peered":"2023-11-28T19:59:10.098824+0000","last_clean":"2023-11-28T19:59:10.098824+0000","last_became_active":"2023-11-28T19:59:05.755784+0000","last_became_peered":"2023-11-28T19:59:05.755784+0000","last_unstale":"2023-11-28T19:59:10.098824+0000","last_undegraded":"2023-11-28T19:59:10.098824+0000","last_fullsized":"2023-11-28T19:59:10.098824+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:59:05.015714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:59:05.015714+0000","last_clean_scrub_stamp":"2023-11-28T19:59:05.015714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:39:44.998942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T19:59:10.081517+0000","last_change":"2023-11-28T19:59:05.050192+0000","last_active":"2023-11-28T19:59:10.081517+0000","last_peered":"2023-11-28T19:59:10.081517+0000","last_clean":"2023-11-28T19:59:10.081517+0000","last_became_active":"2023-11-28T19:59:05.049835+0000","last_became_peered":"2023-11-28T19:59:05.049835+0000","last_unstale":"2023-11-28T19:59:10.081517+0000","last_undegraded":"2023-11-28T19:59:10.081517+0000","last_fullsized":"2023-11-28T19:59:10.081517+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:59:04.008158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:59:04.008158+0000","last_clean_scrub_stamp":"2023-11-28T19:59:04.008158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:55:39.803978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T19:59:10.893279+0000","last_change":"2023-11-28T19:59:10.105472+0000","last_active":"2023-11-28T19:59:10.893279+0000","last_peered":"2023-11-28T19:59:10.893279+0000","last_clean":"2023-11-28T19:59:10.893279+0000","last_became_active":"2023-11-28T19:59:10.103836+0000","last_became_peered":"2023-11-28T19:59:10.103836+0000","last_unstale":"2023-11-28T19:59:10.893279+0000","last_undegraded":"2023-11-28T19:59:10.893279+0000","last_fullsized":"2023-11-28T19:59:10.893279+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:59:09.059796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:59:09.059796+0000","last_clean_scrub_stamp":"2023-11-28T19:59:09.059796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:50:45.043146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T19:59:10.105131+0000","last_change":"2023-11-28T19:59:05.776449+0000","last_active":"2023-11-28T19:59:10.105131+0000","last_peered":"2023-11-28T19:59:10.105131+0000","last_clean":"2023-11-28T19:59:10.105131+0000","last_became_active":"2023-11-28T19:59:05.776170+0000","last_became_peered":"2023-11-28T19:59:05.776170+0000","last_unstale":"2023-11-28T19:59:10.105131+0000","last_undegraded":"2023-11-28T19:59:10.105131+0000","last_fullsized":"2023-11-28T19:59:10.105131+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:59:05.015714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:59:05.015714+0000","last_clean_scrub_stamp":"2023-11-28T19:59:05.015714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T06:35:59.093269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T19:59:10.231401+0000","last_change":"2023-11-28T19:59:05.053328+0000","last_active":"2023-11-28T19:59:10.231401+0000","last_peered":"2023-11-28T19:59:10.231401+0000","last_clean":"2023-11-28T19:59:10.231401+0000","last_became_active":"2023-11-28T19:59:05.053006+0000","last_became_peered":"2023-11-28T19:59:05.053006+0000","last_unstale":"2023-11-28T19:59:10.231401+0000","last_undegraded":"2023-11-28T19:59:10.231401+0000","last_fullsized":"2023-11-28T19:59:10.231401+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:59:04.008158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:59:04.008158+0000","last_clean_scrub_stamp":"2023-11-28T19:59:04.008158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T07:38:26.527925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T19:59:10.892291+0000","last_change":"2023-11-28T19:59:10.233184+0000","last_active":"2023-11-28T19:59:10.892291+0000","last_peered":"2023-11-28T19:59:10.892291+0000","last_clean":"2023-11-28T19:59:10.892291+0000","last_became_active":"2023-11-28T19:59:10.232695+0000","last_became_peered":"2023-11-28T19:59:10.232695+0000","last_unstale":"2023-11-28T19:59:10.892291+0000","last_undegraded":"2023-11-28T19:59:10.892291+0000","last_fullsized":"2023-11-28T19:59:10.892291+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:59:09.059796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:59:09.059796+0000","last_clean_scrub_stamp":"2023-11-28T19:59:09.059796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:50:45.043146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T19:59:10.091832+0000","last_change":"2023-11-28T19:59:05.779101+0000","last_active":"2023-11-28T19:59:10.091832+0000","last_peered":"2023-11-28T19:59:10.091832+0000","last_clean":"2023-11-28T19:59:10.091832+0000","last_became_active":"2023-11-28T19:59:05.778867+0000","last_became_peered":"2023-11-28T19:59:05.778867+0000","last_unstale":"2023-11-28T19:59:10.091832+0000","last_undegraded":"2023-11-28T19:59:10.091832+0000","last_fullsized":"2023-11-28T19:59:10.091832+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:59:05.015714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:59:05.015714+0000","last_clean_scrub_stamp":"2023-11-28T19:59:05.015714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T06:26:55.424441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T19:59:10.086389+0000","last_change":"2023-11-28T19:59:05.039775+0000","last_active":"2023-11-28T19:59:10.086389+0000","last_peered":"2023-11-28T19:59:10.086389+0000","last_clean":"2023-11-28T19:59:10.086389+0000","last_became_active":"2023-11-28T19:59:05.039360+0000","last_became_peered":"2023-11-28T19:59:05.039360+0000","last_unstale":"2023-11-28T19:59:10.086389+0000","last_undegraded":"2023-11-28T19:59:10.086389+0000","last_fullsized":"2023-11-28T19:59:10.086389+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:59:04.008158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:59:04.008158+0000","last_clean_scrub_stamp":"2023-11-28T19:59:04.008158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:55:39.803978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":169,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T19:59:10.231502+0000","last_change":"2023-11-28T19:58:56.136501+0000","last_active":"2023-11-28T19:59:10.231502+0000","last_peered":"2023-11-28T19:59:10.231502+0000","last_clean":"2023-11-28T19:59:10.231502+0000","last_became_active":"2023-11-28T19:58:56.135998+0000","last_became_peered":"2023-11-28T19:58:56.135998+0000","last_unstale":"2023-11-28T19:59:10.231502+0000","last_undegraded":"2023-11-28T19:59:10.231502+0000","last_fullsized":"2023-11-28T19:59:10.231502+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:58:54.602349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:58:54.602349+0000","last_clean_scrub_stamp":"2023-11-28T19:58:54.602349+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:33:42.723349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T19:59:10.892259+0000","last_change":"2023-11-28T19:59:10.237549+0000","last_active":"2023-11-28T19:59:10.892259+0000","last_peered":"2023-11-28T19:59:10.892259+0000","last_clean":"2023-11-28T19:59:10.892259+0000","last_became_active":"2023-11-28T19:59:10.237130+0000","last_became_peered":"2023-11-28T19:59:10.237130+0000","last_unstale":"2023-11-28T19:59:10.892259+0000","last_undegraded":"2023-11-28T19:59:10.892259+0000","last_fullsized":"2023-11-28T19:59:10.892259+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:59:09.059796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:59:09.059796+0000","last_clean_scrub_stamp":"2023-11-28T19:59:09.059796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:59:19.161634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T19:59:10.231699+0000","last_change":"2023-11-28T19:59:05.786506+0000","last_active":"2023-11-28T19:59:10.231699+0000","last_peered":"2023-11-28T19:59:10.231699+0000","last_clean":"2023-11-28T19:59:10.231699+0000","last_became_active":"2023-11-28T19:59:05.785858+0000","last_became_peered":"2023-11-28T19:59:05.785858+0000","last_unstale":"2023-11-28T19:59:10.231699+0000","last_undegraded":"2023-11-28T19:59:10.231699+0000","last_fullsized":"2023-11-28T19:59:10.231699+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:59:05.015714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:59:05.015714+0000","last_clean_scrub_stamp":"2023-11-28T19:59:05.015714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:04:04.508815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T19:59:10.081603+0000","last_change":"2023-11-28T19:59:05.038652+0000","last_active":"2023-11-28T19:59:10.081603+0000","last_peered":"2023-11-28T19:59:10.081603+0000","last_clean":"2023-11-28T19:59:10.081603+0000","last_became_active":"2023-11-28T19:59:05.038327+0000","last_became_peered":"2023-11-28T19:59:05.038327+0000","last_unstale":"2023-11-28T19:59:10.081603+0000","last_undegraded":"2023-11-28T19:59:10.081603+0000","last_fullsized":"2023-11-28T19:59:10.081603+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:59:04.008158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:59:04.008158+0000","last_clean_scrub_stamp":"2023-11-28T19:59:04.008158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:54:53.624516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T19:59:10.892210+0000","last_change":"2023-11-28T19:59:10.234188+0000","last_active":"2023-11-28T19:59:10.892210+0000","last_peered":"2023-11-28T19:59:10.892210+0000","last_clean":"2023-11-28T19:59:10.892210+0000","last_became_active":"2023-11-28T19:59:10.232817+0000","last_became_peered":"2023-11-28T19:59:10.232817+0000","last_unstale":"2023-11-28T19:59:10.892210+0000","last_undegraded":"2023-11-28T19:59:10.892210+0000","last_fullsized":"2023-11-28T19:59:10.892210+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:59:09.059796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:59:09.059796+0000","last_clean_scrub_stamp":"2023-11-28T19:59:09.059796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:04:22.608590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T19:59:10.088147+0000","last_change":"2023-11-28T19:59:05.770485+0000","last_active":"2023-11-28T19:59:10.088147+0000","last_peered":"2023-11-28T19:59:10.088147+0000","last_clean":"2023-11-28T19:59:10.088147+0000","last_became_active":"2023-11-28T19:59:05.769897+0000","last_became_peered":"2023-11-28T19:59:05.769897+0000","last_unstale":"2023-11-28T19:59:10.088147+0000","last_undegraded":"2023-11-28T19:59:10.088147+0000","last_fullsized":"2023-11-28T19:59:10.088147+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:59:05.015714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:59:05.015714+0000","last_clean_scrub_stamp":"2023-11-28T19:59:05.015714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:04:18.564508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"20'1","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T19:59:10.099741+0000","last_change":"2023-11-28T19:59:05.038199+0000","last_active":"2023-11-28T19:59:10.099741+0000","last_peered":"2023-11-28T19:59:10.099741+0000","last_clean":"2023-11-28T19:59:10.099741+0000","last_became_active":"2023-11-28T19:59:05.037884+0000","last_became_peered":"2023-11-28T19:59:05.037884+0000","last_unstale":"2023-11-28T19:59:10.099741+0000","last_undegraded":"2023-11-28T19:59:10.099741+0000","last_fullsized":"2023-11-28T19:59:10.099741+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:59:04.008158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:59:04.008158+0000","last_clean_scrub_stamp":"2023-11-28T19:59:04.008158+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:59:05.695936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T19:59:10.892205+0000","last_change":"2023-11-28T19:59:10.113074+0000","last_active":"2023-11-28T19:59:10.892205+0000","last_peered":"2023-11-28T19:59:10.892205+0000","last_clean":"2023-11-28T19:59:10.892205+0000","last_became_active":"2023-11-28T19:59:10.112703+0000","last_became_peered":"2023-11-28T19:59:10.112703+0000","last_unstale":"2023-11-28T19:59:10.892205+0000","last_undegraded":"2023-11-28T19:59:10.892205+0000","last_fullsized":"2023-11-28T19:59:10.892205+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:59:09.059796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:59:09.059796+0000","last_clean_scrub_stamp":"2023-11-28T19:59:09.059796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:09:44.374501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T19:59:10.232038+0000","last_change":"2023-11-28T19:59:05.787582+0000","last_active":"2023-11-28T19:59:10.232038+0000","last_peered":"2023-11-28T19:59:10.232038+0000","last_clean":"2023-11-28T19:59:10.232038+0000","last_became_active":"2023-11-28T19:59:05.786888+0000","last_became_peered":"2023-11-28T19:59:05.786888+0000","last_unstale":"2023-11-28T19:59:10.232038+0000","last_undegraded":"2023-11-28T19:59:10.232038+0000","last_fullsized":"2023-11-28T19:59:10.232038+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:59:05.015714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:59:05.015714+0000","last_clean_scrub_stamp":"2023-11-28T19:59:05.015714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:50:40.999064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"20'2","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T19:59:10.082013+0000","last_change":"2023-11-28T19:59:05.039063+0000","last_active":"2023-11-28T19:59:10.082013+0000","last_peered":"2023-11-28T19:59:10.082013+0000","last_clean":"2023-11-28T19:59:10.082013+0000","last_became_active":"2023-11-28T19:59:05.038803+0000","last_became_peered":"2023-11-28T19:59:05.038803+0000","last_unstale":"2023-11-28T19:59:10.082013+0000","last_undegraded":"2023-11-28T19:59:10.082013+0000","last_fullsized":"2023-11-28T19:59:10.082013+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:59:04.008158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:59:04.008158+0000","last_clean_scrub_stamp":"2023-11-28T19:59:04.008158+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:24:13.851530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T19:59:10.750166+0000","last_change":"2023-11-28T19:59:10.237605+0000","last_active":"2023-11-28T19:59:10.750166+0000","last_peered":"2023-11-28T19:59:10.750166+0000","last_clean":"2023-11-28T19:59:10.750166+0000","last_became_active":"2023-11-28T19:59:10.237079+0000","last_became_peered":"2023-11-28T19:59:10.237079+0000","last_unstale":"2023-11-28T19:59:10.750166+0000","last_undegraded":"2023-11-28T19:59:10.750166+0000","last_fullsized":"2023-11-28T19:59:10.750166+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:59:09.059796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:59:09.059796+0000","last_clean_scrub_stamp":"2023-11-28T19:59:09.059796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:47:39.329731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T19:59:10.231882+0000","last_change":"2023-11-28T19:59:05.784211+0000","last_active":"2023-11-28T19:59:10.231882+0000","last_peered":"2023-11-28T19:59:10.231882+0000","last_clean":"2023-11-28T19:59:10.231882+0000","last_became_active":"2023-11-28T19:59:05.783924+0000","last_became_peered":"2023-11-28T19:59:05.783924+0000","last_unstale":"2023-11-28T19:59:10.231882+0000","last_undegraded":"2023-11-28T19:59:10.231882+0000","last_fullsized":"2023-11-28T19:59:10.231882+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:59:05.015714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:59:05.015714+0000","last_clean_scrub_stamp":"2023-11-28T19:59:05.015714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:43:15.986749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"20'1","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T19:59:10.086589+0000","last_change":"2023-11-28T19:59:05.050003+0000","last_active":"2023-11-28T19:59:10.086589+0000","last_peered":"2023-11-28T19:59:10.086589+0000","last_clean":"2023-11-28T19:59:10.086589+0000","last_became_active":"2023-11-28T19:59:05.048751+0000","last_became_peered":"2023-11-28T19:59:05.048751+0000","last_unstale":"2023-11-28T19:59:10.086589+0000","last_undegraded":"2023-11-28T19:59:10.086589+0000","last_fullsized":"2023-11-28T19:59:10.086589+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:59:04.008158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:59:04.008158+0000","last_clean_scrub_stamp":"2023-11-28T19:59:04.008158+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:43:22.921922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T19:59:10.750165+0000","last_change":"2023-11-28T19:59:10.118418+0000","last_active":"2023-11-28T19:59:10.750165+0000","last_peered":"2023-11-28T19:59:10.750165+0000","last_clean":"2023-11-28T19:59:10.750165+0000","last_became_active":"2023-11-28T19:59:10.118013+0000","last_became_peered":"2023-11-28T19:59:10.118013+0000","last_unstale":"2023-11-28T19:59:10.750165+0000","last_undegraded":"2023-11-28T19:59:10.750165+0000","last_fullsized":"2023-11-28T19:59:10.750165+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:59:09.059796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:59:09.059796+0000","last_clean_scrub_stamp":"2023-11-28T19:59:09.059796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T06:26:59.468523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T19:59:10.231450+0000","last_change":"2023-11-28T19:59:05.781473+0000","last_active":"2023-11-28T19:59:10.231450+0000","last_peered":"2023-11-28T19:59:10.231450+0000","last_clean":"2023-11-28T19:59:10.231450+0000","last_became_active":"2023-11-28T19:59:05.781227+0000","last_became_peered":"2023-11-28T19:59:05.781227+0000","last_unstale":"2023-11-28T19:59:10.231450+0000","last_undegraded":"2023-11-28T19:59:10.231450+0000","last_fullsized":"2023-11-28T19:59:10.231450+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:59:05.015714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:59:05.015714+0000","last_clean_scrub_stamp":"2023-11-28T19:59:05.015714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:56:09.640427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"20'8","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T19:59:10.081395+0000","last_change":"2023-11-28T19:59:05.038647+0000","last_active":"2023-11-28T19:59:10.081395+0000","last_peered":"2023-11-28T19:59:10.081395+0000","last_clean":"2023-11-28T19:59:10.081395+0000","last_became_active":"2023-11-28T19:59:05.038338+0000","last_became_peered":"2023-11-28T19:59:05.038338+0000","last_unstale":"2023-11-28T19:59:10.081395+0000","last_undegraded":"2023-11-28T19:59:10.081395+0000","last_fullsized":"2023-11-28T19:59:10.081395+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:59:04.008158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:59:04.008158+0000","last_clean_scrub_stamp":"2023-11-28T19:59:04.008158+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T07:38:26.527925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T19:59:10.892176+0000","last_change":"2023-11-28T19:59:10.111085+0000","last_active":"2023-11-28T19:59:10.892176+0000","last_peered":"2023-11-28T19:59:10.892176+0000","last_clean":"2023-11-28T19:59:10.892176+0000","last_became_active":"2023-11-28T19:59:10.109559+0000","last_became_peered":"2023-11-28T19:59:10.109559+0000","last_unstale":"2023-11-28T19:59:10.892176+0000","last_undegraded":"2023-11-28T19:59:10.892176+0000","last_fullsized":"2023-11-28T19:59:10.892176+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:59:09.059796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:59:09.059796+0000","last_clean_scrub_stamp":"2023-11-28T19:59:09.059796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:27:38.944595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T19:59:10.095949+0000","last_change":"2023-11-28T19:59:05.770947+0000","last_active":"2023-11-28T19:59:10.095949+0000","last_peered":"2023-11-28T19:59:10.095949+0000","last_clean":"2023-11-28T19:59:10.095949+0000","last_became_active":"2023-11-28T19:59:05.770478+0000","last_became_peered":"2023-11-28T19:59:05.770478+0000","last_unstale":"2023-11-28T19:59:10.095949+0000","last_undegraded":"2023-11-28T19:59:10.095949+0000","last_fullsized":"2023-11-28T19:59:10.095949+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:59:05.015714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:59:05.015714+0000","last_clean_scrub_stamp":"2023-11-28T19:59:05.015714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:39:44.998942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T19:59:10.096036+0000","last_change":"2023-11-28T19:59:05.047423+0000","last_active":"2023-11-28T19:59:10.096036+0000","last_peered":"2023-11-28T19:59:10.096036+0000","last_clean":"2023-11-28T19:59:10.096036+0000","last_became_active":"2023-11-28T19:59:05.047076+0000","last_became_peered":"2023-11-28T19:59:05.047076+0000","last_unstale":"2023-11-28T19:59:10.096036+0000","last_undegraded":"2023-11-28T19:59:10.096036+0000","last_fullsized":"2023-11-28T19:59:10.096036+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:59:04.008158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:59:04.008158+0000","last_clean_scrub_stamp":"2023-11-28T19:59:04.008158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T06:50:50.328228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T19:59:10.748835+0000","last_change":"2023-11-28T19:59:10.238924+0000","last_active":"2023-11-28T19:59:10.748835+0000","last_peered":"2023-11-28T19:59:10.748835+0000","last_clean":"2023-11-28T19:59:10.748835+0000","last_became_active":"2023-11-28T19:59:10.237678+0000","last_became_peered":"2023-11-28T19:59:10.237678+0000","last_unstale":"2023-11-28T19:59:10.748835+0000","last_undegraded":"2023-11-28T19:59:10.748835+0000","last_fullsized":"2023-11-28T19:59:10.748835+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:59:09.059796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:59:09.059796+0000","last_clean_scrub_stamp":"2023-11-28T19:59:09.059796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:39:07.159036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T19:59:10.231706+0000","last_change":"2023-11-28T19:59:05.786376+0000","last_active":"2023-11-28T19:59:10.231706+0000","last_peered":"2023-11-28T19:59:10.231706+0000","last_clean":"2023-11-28T19:59:10.231706+0000","last_became_active":"2023-11-28T19:59:05.785920+0000","last_became_peered":"2023-11-28T19:59:05.785920+0000","last_unstale":"2023-11-28T19:59:10.231706+0000","last_undegraded":"2023-11-28T19:59:10.231706+0000","last_fullsized":"2023-11-28T19:59:10.231706+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:59:05.015714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:59:05.015714+0000","last_clean_scrub_stamp":"2023-11-28T19:59:05.015714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:09:40.330419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T19:59:10.086641+0000","last_change":"2023-11-28T19:59:05.046163+0000","last_active":"2023-11-28T19:59:10.086641+0000","last_peered":"2023-11-28T19:59:10.086641+0000","last_clean":"2023-11-28T19:59:10.086641+0000","last_became_active":"2023-11-28T19:59:05.045305+0000","last_became_peered":"2023-11-28T19:59:05.045305+0000","last_unstale":"2023-11-28T19:59:10.086641+0000","last_undegraded":"2023-11-28T19:59:10.086641+0000","last_fullsized":"2023-11-28T19:59:10.086641+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:59:04.008158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:59:04.008158+0000","last_clean_scrub_stamp":"2023-11-28T19:59:04.008158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:24:47.265269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T19:59:10.749020+0000","last_change":"2023-11-28T19:59:10.238640+0000","last_active":"2023-11-28T19:59:10.749020+0000","last_peered":"2023-11-28T19:59:10.749020+0000","last_clean":"2023-11-28T19:59:10.749020+0000","last_became_active":"2023-11-28T19:59:10.236870+0000","last_became_peered":"2023-11-28T19:59:10.236870+0000","last_unstale":"2023-11-28T19:59:10.749020+0000","last_undegraded":"2023-11-28T19:59:10.749020+0000","last_fullsized":"2023-11-28T19:59:10.749020+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:59:09.059796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:59:09.059796+0000","last_clean_scrub_stamp":"2023-11-28T19:59:09.059796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:43:34.452592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T19:59:10.105258+0000","last_change":"2023-11-28T19:59:05.772859+0000","last_active":"2023-11-28T19:59:10.105258+0000","last_peered":"2023-11-28T19:59:10.105258+0000","last_clean":"2023-11-28T19:59:10.105258+0000","last_became_active":"2023-11-28T19:59:05.772598+0000","last_became_peered":"2023-11-28T19:59:05.772598+0000","last_unstale":"2023-11-28T19:59:10.105258+0000","last_undegraded":"2023-11-28T19:59:10.105258+0000","last_fullsized":"2023-11-28T19:59:10.105258+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:59:05.015714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:59:05.015714+0000","last_clean_scrub_stamp":"2023-11-28T19:59:05.015714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:44:02.102081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"20'2","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T19:59:10.105695+0000","last_change":"2023-11-28T19:59:05.048324+0000","last_active":"2023-11-28T19:59:10.105695+0000","last_peered":"2023-11-28T19:59:10.105695+0000","last_clean":"2023-11-28T19:59:10.105695+0000","last_became_active":"2023-11-28T19:59:05.048010+0000","last_became_peered":"2023-11-28T19:59:05.048010+0000","last_unstale":"2023-11-28T19:59:10.105695+0000","last_undegraded":"2023-11-28T19:59:10.105695+0000","last_fullsized":"2023-11-28T19:59:10.105695+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:59:04.008158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:59:04.008158+0000","last_clean_scrub_stamp":"2023-11-28T19:59:04.008158+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:47:35.984593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T19:59:10.751337+0000","last_change":"2023-11-28T19:59:10.233429+0000","last_active":"2023-11-28T19:59:10.751337+0000","last_peered":"2023-11-28T19:59:10.751337+0000","last_clean":"2023-11-28T19:59:10.751337+0000","last_became_active":"2023-11-28T19:59:10.232923+0000","last_became_peered":"2023-11-28T19:59:10.232923+0000","last_unstale":"2023-11-28T19:59:10.751337+0000","last_undegraded":"2023-11-28T19:59:10.751337+0000","last_fullsized":"2023-11-28T19:59:10.751337+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:59:09.059796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:59:09.059796+0000","last_clean_scrub_stamp":"2023-11-28T19:59:09.059796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:30:43.834211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T19:59:10.231692+0000","last_change":"2023-11-28T19:59:05.785594+0000","last_active":"2023-11-28T19:59:10.231692+0000","last_peered":"2023-11-28T19:59:10.231692+0000","last_clean":"2023-11-28T19:59:10.231692+0000","last_became_active":"2023-11-28T19:59:05.783565+0000","last_became_peered":"2023-11-28T19:59:05.783565+0000","last_unstale":"2023-11-28T19:59:10.231692+0000","last_undegraded":"2023-11-28T19:59:10.231692+0000","last_fullsized":"2023-11-28T19:59:10.231692+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:59:05.015714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:59:05.015714+0000","last_clean_scrub_stamp":"2023-11-28T19:59:05.015714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:21:21.519406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"25'9","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T19:59:16.612954+0000","last_change":"2023-11-28T19:59:05.050492+0000","last_active":"2023-11-28T19:59:16.612954+0000","last_peered":"2023-11-28T19:59:16.612954+0000","last_clean":"2023-11-28T19:59:16.612954+0000","last_became_active":"2023-11-28T19:59:05.050201+0000","last_became_peered":"2023-11-28T19:59:05.050201+0000","last_unstale":"2023-11-28T19:59:16.612954+0000","last_undegraded":"2023-11-28T19:59:16.612954+0000","last_fullsized":"2023-11-28T19:59:16.612954+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:59:04.008158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:59:04.008158+0000","last_clean_scrub_stamp":"2023-11-28T19:59:04.008158+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T06:35:58.085712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3841,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T19:59:10.891969+0000","last_change":"2023-11-28T19:59:10.110604+0000","last_active":"2023-11-28T19:59:10.891969+0000","last_peered":"2023-11-28T19:59:10.891969+0000","last_clean":"2023-11-28T19:59:10.891969+0000","last_became_active":"2023-11-28T19:59:10.109600+0000","last_became_peered":"2023-11-28T19:59:10.109600+0000","last_unstale":"2023-11-28T19:59:10.891969+0000","last_undegraded":"2023-11-28T19:59:10.891969+0000","last_fullsized":"2023-11-28T19:59:10.891969+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:59:09.059796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:59:09.059796+0000","last_clean_scrub_stamp":"2023-11-28T19:59:09.059796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:04:22.608590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T19:59:10.093975+0000","last_change":"2023-11-28T19:59:05.779793+0000","last_active":"2023-11-28T19:59:10.093975+0000","last_peered":"2023-11-28T19:59:10.093975+0000","last_clean":"2023-11-28T19:59:10.093975+0000","last_became_active":"2023-11-28T19:59:05.779488+0000","last_became_peered":"2023-11-28T19:59:05.779488+0000","last_unstale":"2023-11-28T19:59:10.093975+0000","last_undegraded":"2023-11-28T19:59:10.093975+0000","last_fullsized":"2023-11-28T19:59:10.093975+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:59:05.015714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:59:05.015714+0000","last_clean_scrub_stamp":"2023-11-28T19:59:05.015714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:55:00.138576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"20'3","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T19:59:10.099653+0000","last_change":"2023-11-28T19:59:05.044226+0000","last_active":"2023-11-28T19:59:10.099653+0000","last_peered":"2023-11-28T19:59:10.099653+0000","last_clean":"2023-11-28T19:59:10.099653+0000","last_became_active":"2023-11-28T19:59:05.043946+0000","last_became_peered":"2023-11-28T19:59:05.043946+0000","last_unstale":"2023-11-28T19:59:10.099653+0000","last_undegraded":"2023-11-28T19:59:10.099653+0000","last_fullsized":"2023-11-28T19:59:10.099653+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:59:04.008158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:59:04.008158+0000","last_clean_scrub_stamp":"2023-11-28T19:59:04.008158+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:47:35.984593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T19:59:10.751315+0000","last_change":"2023-11-28T19:59:10.101312+0000","last_active":"2023-11-28T19:59:10.751315+0000","last_peered":"2023-11-28T19:59:10.751315+0000","last_clean":"2023-11-28T19:59:10.751315+0000","last_became_active":"2023-11-28T19:59:10.100486+0000","last_became_peered":"2023-11-28T19:59:10.100486+0000","last_unstale":"2023-11-28T19:59:10.751315+0000","last_undegraded":"2023-11-28T19:59:10.751315+0000","last_fullsized":"2023-11-28T19:59:10.751315+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:59:09.059796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:59:09.059796+0000","last_clean_scrub_stamp":"2023-11-28T19:59:09.059796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:56:13.684509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T19:59:10.106097+0000","last_change":"2023-11-28T19:59:05.781405+0000","last_active":"2023-11-28T19:59:10.106097+0000","last_peered":"2023-11-28T19:59:10.106097+0000","last_clean":"2023-11-28T19:59:10.106097+0000","last_became_active":"2023-11-28T19:59:05.781191+0000","last_became_peered":"2023-11-28T19:59:05.781191+0000","last_unstale":"2023-11-28T19:59:10.106097+0000","last_undegraded":"2023-11-28T19:59:10.106097+0000","last_fullsized":"2023-11-28T19:59:10.106097+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:59:05.015714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:59:05.015714+0000","last_clean_scrub_stamp":"2023-11-28T19:59:05.015714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:05:03.688191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T19:59:10.087858+0000","last_change":"2023-11-28T19:59:05.043993+0000","last_active":"2023-11-28T19:59:10.087858+0000","last_peered":"2023-11-28T19:59:10.087858+0000","last_clean":"2023-11-28T19:59:10.087858+0000","last_became_active":"2023-11-28T19:59:05.043601+0000","last_became_peered":"2023-11-28T19:59:05.043601+0000","last_unstale":"2023-11-28T19:59:10.087858+0000","last_undegraded":"2023-11-28T19:59:10.087858+0000","last_fullsized":"2023-11-28T19:59:10.087858+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:59:04.008158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:59:04.008158+0000","last_clean_scrub_stamp":"2023-11-28T19:59:04.008158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:34:40.633276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T19:59:10.748222+0000","last_change":"2023-11-28T19:59:10.118024+0000","last_active":"2023-11-28T19:59:10.748222+0000","last_peered":"2023-11-28T19:59:10.748222+0000","last_clean":"2023-11-28T19:59:10.748222+0000","last_became_active":"2023-11-28T19:59:10.117574+0000","last_became_peered":"2023-11-28T19:59:10.117574+0000","last_unstale":"2023-11-28T19:59:10.748222+0000","last_undegraded":"2023-11-28T19:59:10.748222+0000","last_fullsized":"2023-11-28T19:59:10.748222+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:59:09.059796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:59:09.059796+0000","last_clean_scrub_stamp":"2023-11-28T19:59:09.059796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:34:54.217873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T19:59:10.087770+0000","last_change":"2023-11-28T19:59:05.773474+0000","last_active":"2023-11-28T19:59:10.087770+0000","last_peered":"2023-11-28T19:59:10.087770+0000","last_clean":"2023-11-28T19:59:10.087770+0000","last_became_active":"2023-11-28T19:59:05.773148+0000","last_became_peered":"2023-11-28T19:59:05.773148+0000","last_unstale":"2023-11-28T19:59:10.087770+0000","last_undegraded":"2023-11-28T19:59:10.087770+0000","last_fullsized":"2023-11-28T19:59:10.087770+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:59:05.015714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:59:05.015714+0000","last_clean_scrub_stamp":"2023-11-28T19:59:05.015714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:27:34.900513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T19:59:10.097405+0000","last_change":"2023-11-28T19:59:05.044167+0000","last_active":"2023-11-28T19:59:10.097405+0000","last_peered":"2023-11-28T19:59:10.097405+0000","last_clean":"2023-11-28T19:59:10.097405+0000","last_became_active":"2023-11-28T19:59:05.043651+0000","last_became_peered":"2023-11-28T19:59:05.043651+0000","last_unstale":"2023-11-28T19:59:10.097405+0000","last_undegraded":"2023-11-28T19:59:10.097405+0000","last_fullsized":"2023-11-28T19:59:10.097405+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:59:04.008158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:59:04.008158+0000","last_clean_scrub_stamp":"2023-11-28T19:59:04.008158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:44:01.094524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T19:59:10.748417+0000","last_change":"2023-11-28T19:59:10.237079+0000","last_active":"2023-11-28T19:59:10.748417+0000","last_peered":"2023-11-28T19:59:10.748417+0000","last_clean":"2023-11-28T19:59:10.748417+0000","last_became_active":"2023-11-28T19:59:10.236659+0000","last_became_peered":"2023-11-28T19:59:10.236659+0000","last_unstale":"2023-11-28T19:59:10.748417+0000","last_undegraded":"2023-11-28T19:59:10.748417+0000","last_fullsized":"2023-11-28T19:59:10.748417+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:59:09.059796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:59:09.059796+0000","last_clean_scrub_stamp":"2023-11-28T19:59:09.059796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:47:39.329731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T19:59:10.892053+0000","last_change":"2023-11-28T19:59:10.236815+0000","last_active":"2023-11-28T19:59:10.892053+0000","last_peered":"2023-11-28T19:59:10.892053+0000","last_clean":"2023-11-28T19:59:10.892053+0000","last_became_active":"2023-11-28T19:59:10.236466+0000","last_became_peered":"2023-11-28T19:59:10.236466+0000","last_unstale":"2023-11-28T19:59:10.892053+0000","last_undegraded":"2023-11-28T19:59:10.892053+0000","last_fullsized":"2023-11-28T19:59:10.892053+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:59:09.059796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:59:09.059796+0000","last_clean_scrub_stamp":"2023-11-28T19:59:09.059796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:59:19.161634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T19:59:10.098528+0000","last_change":"2023-11-28T19:59:05.757721+0000","last_active":"2023-11-28T19:59:10.098528+0000","last_peered":"2023-11-28T19:59:10.098528+0000","last_clean":"2023-11-28T19:59:10.098528+0000","last_became_active":"2023-11-28T19:59:05.757410+0000","last_became_peered":"2023-11-28T19:59:05.757410+0000","last_unstale":"2023-11-28T19:59:10.098528+0000","last_undegraded":"2023-11-28T19:59:10.098528+0000","last_fullsized":"2023-11-28T19:59:10.098528+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:59:05.015714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:59:05.015714+0000","last_clean_scrub_stamp":"2023-11-28T19:59:05.015714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:21:11.899134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T19:59:10.085948+0000","last_change":"2023-11-28T19:59:05.035784+0000","last_active":"2023-11-28T19:59:10.085948+0000","last_peered":"2023-11-28T19:59:10.085948+0000","last_clean":"2023-11-28T19:59:10.085948+0000","last_became_active":"2023-11-28T19:59:05.035438+0000","last_became_peered":"2023-11-28T19:59:05.035438+0000","last_unstale":"2023-11-28T19:59:10.085948+0000","last_undegraded":"2023-11-28T19:59:10.085948+0000","last_fullsized":"2023-11-28T19:59:10.085948+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:59:04.008158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:59:04.008158+0000","last_clean_scrub_stamp":"2023-11-28T19:59:04.008158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:50:57.704628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T19:59:10.892842+0000","last_change":"2023-11-28T19:59:10.118648+0000","last_active":"2023-11-28T19:59:10.892842+0000","last_peered":"2023-11-28T19:59:10.892842+0000","last_clean":"2023-11-28T19:59:10.892842+0000","last_became_active":"2023-11-28T19:59:10.118092+0000","last_became_peered":"2023-11-28T19:59:10.118092+0000","last_unstale":"2023-11-28T19:59:10.892842+0000","last_undegraded":"2023-11-28T19:59:10.892842+0000","last_fullsized":"2023-11-28T19:59:10.892842+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:59:09.059796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:59:09.059796+0000","last_clean_scrub_stamp":"2023-11-28T19:59:09.059796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:27:38.944595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T19:59:10.086761+0000","last_change":"2023-11-28T19:59:05.770886+0000","last_active":"2023-11-28T19:59:10.086761+0000","last_peered":"2023-11-28T19:59:10.086761+0000","last_clean":"2023-11-28T19:59:10.086761+0000","last_became_active":"2023-11-28T19:59:05.770493+0000","last_became_peered":"2023-11-28T19:59:05.770493+0000","last_unstale":"2023-11-28T19:59:10.086761+0000","last_undegraded":"2023-11-28T19:59:10.086761+0000","last_fullsized":"2023-11-28T19:59:10.086761+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:59:05.015714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:59:05.015714+0000","last_clean_scrub_stamp":"2023-11-28T19:59:05.015714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:39:44.998942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T19:59:10.087599+0000","last_change":"2023-11-28T19:59:05.046151+0000","last_active":"2023-11-28T19:59:10.087599+0000","last_peered":"2023-11-28T19:59:10.087599+0000","last_clean":"2023-11-28T19:59:10.087599+0000","last_became_active":"2023-11-28T19:59:05.045604+0000","last_became_peered":"2023-11-28T19:59:05.045604+0000","last_unstale":"2023-11-28T19:59:10.087599+0000","last_undegraded":"2023-11-28T19:59:10.087599+0000","last_fullsized":"2023-11-28T19:59:10.087599+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:59:04.008158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:59:04.008158+0000","last_clean_scrub_stamp":"2023-11-28T19:59:04.008158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:59:05.695936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"20'1","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T19:59:10.096286+0000","last_change":"2023-11-28T19:59:05.048629+0000","last_active":"2023-11-28T19:59:10.096286+0000","last_peered":"2023-11-28T19:59:10.096286+0000","last_clean":"2023-11-28T19:59:10.096286+0000","last_became_active":"2023-11-28T19:59:05.048345+0000","last_became_peered":"2023-11-28T19:59:05.048345+0000","last_unstale":"2023-11-28T19:59:10.096286+0000","last_undegraded":"2023-11-28T19:59:10.096286+0000","last_fullsized":"2023-11-28T19:59:10.096286+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:59:04.008158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:59:04.008158+0000","last_clean_scrub_stamp":"2023-11-28T19:59:04.008158+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:59:05.695936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T19:59:10.105600+0000","last_change":"2023-11-28T19:59:05.777065+0000","last_active":"2023-11-28T19:59:10.105600+0000","last_peered":"2023-11-28T19:59:10.105600+0000","last_clean":"2023-11-28T19:59:10.105600+0000","last_became_active":"2023-11-28T19:59:05.776748+0000","last_became_peered":"2023-11-28T19:59:05.776748+0000","last_unstale":"2023-11-28T19:59:10.105600+0000","last_undegraded":"2023-11-28T19:59:10.105600+0000","last_fullsized":"2023-11-28T19:59:10.105600+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:59:05.015714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:59:05.015714+0000","last_clean_scrub_stamp":"2023-11-28T19:59:05.015714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:39:44.998942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T19:59:10.892135+0000","last_change":"2023-11-28T19:59:10.107795+0000","last_active":"2023-11-28T19:59:10.892135+0000","last_peered":"2023-11-28T19:59:10.892135+0000","last_clean":"2023-11-28T19:59:10.892135+0000","last_became_active":"2023-11-28T19:59:10.107403+0000","last_became_peered":"2023-11-28T19:59:10.107403+0000","last_unstale":"2023-11-28T19:59:10.892135+0000","last_undegraded":"2023-11-28T19:59:10.892135+0000","last_fullsized":"2023-11-28T19:59:10.892135+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:59:09.059796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:59:09.059796+0000","last_clean_scrub_stamp":"2023-11-28T19:59:09.059796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:24:52.316908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"20'1","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T19:59:10.085998+0000","last_change":"2023-11-28T19:59:05.055074+0000","last_active":"2023-11-28T19:59:10.085998+0000","last_peered":"2023-11-28T19:59:10.085998+0000","last_clean":"2023-11-28T19:59:10.085998+0000","last_became_active":"2023-11-28T19:59:05.054809+0000","last_became_peered":"2023-11-28T19:59:05.054809+0000","last_unstale":"2023-11-28T19:59:10.085998+0000","last_undegraded":"2023-11-28T19:59:10.085998+0000","last_fullsized":"2023-11-28T19:59:10.085998+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:59:04.008158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:59:04.008158+0000","last_clean_scrub_stamp":"2023-11-28T19:59:04.008158+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:24:47.265269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T19:59:10.086324+0000","last_change":"2023-11-28T19:59:05.757750+0000","last_active":"2023-11-28T19:59:10.086324+0000","last_peered":"2023-11-28T19:59:10.086324+0000","last_clean":"2023-11-28T19:59:10.086324+0000","last_became_active":"2023-11-28T19:59:05.756939+0000","last_became_peered":"2023-11-28T19:59:05.756939+0000","last_unstale":"2023-11-28T19:59:10.086324+0000","last_undegraded":"2023-11-28T19:59:10.086324+0000","last_fullsized":"2023-11-28T19:59:10.086324+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:59:05.015714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:59:05.015714+0000","last_clean_scrub_stamp":"2023-11-28T19:59:05.015714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:55:40.811535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T19:59:10.748574+0000","last_change":"2023-11-28T19:59:10.108523+0000","last_active":"2023-11-28T19:59:10.748574+0000","last_peered":"2023-11-28T19:59:10.748574+0000","last_clean":"2023-11-28T19:59:10.748574+0000","last_became_active":"2023-11-28T19:59:10.108151+0000","last_became_peered":"2023-11-28T19:59:10.108151+0000","last_unstale":"2023-11-28T19:59:10.748574+0000","last_undegraded":"2023-11-28T19:59:10.748574+0000","last_fullsized":"2023-11-28T19:59:10.748574+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:59:09.059796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:59:09.059796+0000","last_clean_scrub_stamp":"2023-11-28T19:59:09.059796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:30:43.834211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T19:59:10.095918+0000","last_change":"2023-11-28T19:59:05.771095+0000","last_active":"2023-11-28T19:59:10.095918+0000","last_peered":"2023-11-28T19:59:10.095918+0000","last_clean":"2023-11-28T19:59:10.095918+0000","last_became_active":"2023-11-28T19:59:05.770756+0000","last_became_peered":"2023-11-28T19:59:05.770756+0000","last_unstale":"2023-11-28T19:59:10.095918+0000","last_undegraded":"2023-11-28T19:59:10.095918+0000","last_fullsized":"2023-11-28T19:59:10.095918+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:59:05.015714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:59:05.015714+0000","last_clean_scrub_stamp":"2023-11-28T19:59:05.015714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:21:11.899134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T19:59:10.081519+0000","last_change":"2023-11-28T19:59:05.764023+0000","last_active":"2023-11-28T19:59:10.081519+0000","last_peered":"2023-11-28T19:59:10.081519+0000","last_clean":"2023-11-28T19:59:10.081519+0000","last_became_active":"2023-11-28T19:59:05.763722+0000","last_became_peered":"2023-11-28T19:59:05.763722+0000","last_unstale":"2023-11-28T19:59:10.081519+0000","last_undegraded":"2023-11-28T19:59:10.081519+0000","last_fullsized":"2023-11-28T19:59:10.081519+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:59:05.015714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:59:05.015714+0000","last_clean_scrub_stamp":"2023-11-28T19:59:05.015714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:55:00.138576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T19:59:10.086587+0000","last_change":"2023-11-28T19:59:05.771306+0000","last_active":"2023-11-28T19:59:10.086587+0000","last_peered":"2023-11-28T19:59:10.086587+0000","last_clean":"2023-11-28T19:59:10.086587+0000","last_became_active":"2023-11-28T19:59:05.770978+0000","last_became_peered":"2023-11-28T19:59:05.770978+0000","last_unstale":"2023-11-28T19:59:10.086587+0000","last_undegraded":"2023-11-28T19:59:10.086587+0000","last_fullsized":"2023-11-28T19:59:10.086587+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:59:05.015714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:59:05.015714+0000","last_clean_scrub_stamp":"2023-11-28T19:59:05.015714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:04:04.508815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T19:59:10.105498+0000","last_change":"2023-11-28T19:59:05.772219+0000","last_active":"2023-11-28T19:59:10.105498+0000","last_peered":"2023-11-28T19:59:10.105498+0000","last_clean":"2023-11-28T19:59:10.105498+0000","last_became_active":"2023-11-28T19:59:05.771554+0000","last_became_peered":"2023-11-28T19:59:05.771554+0000","last_unstale":"2023-11-28T19:59:10.105498+0000","last_undegraded":"2023-11-28T19:59:10.105498+0000","last_fullsized":"2023-11-28T19:59:10.105498+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:59:05.015714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:59:05.015714+0000","last_clean_scrub_stamp":"2023-11-28T19:59:05.015714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:00:56.432813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T19:59:10.089982+0000","last_change":"2023-11-28T19:59:05.760600+0000","last_active":"2023-11-28T19:59:10.089982+0000","last_peered":"2023-11-28T19:59:10.089982+0000","last_clean":"2023-11-28T19:59:10.089982+0000","last_became_active":"2023-11-28T19:59:05.760294+0000","last_became_peered":"2023-11-28T19:59:05.760294+0000","last_unstale":"2023-11-28T19:59:10.089982+0000","last_undegraded":"2023-11-28T19:59:10.089982+0000","last_fullsized":"2023-11-28T19:59:10.089982+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:59:05.015714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:59:05.015714+0000","last_clean_scrub_stamp":"2023-11-28T19:59:05.015714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:21:11.899134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T19:59:10.099562+0000","last_change":"2023-11-28T19:59:05.766493+0000","last_active":"2023-11-28T19:59:10.099562+0000","last_peered":"2023-11-28T19:59:10.099562+0000","last_clean":"2023-11-28T19:59:10.099562+0000","last_became_active":"2023-11-28T19:59:05.766183+0000","last_became_peered":"2023-11-28T19:59:05.766183+0000","last_unstale":"2023-11-28T19:59:10.099562+0000","last_undegraded":"2023-11-28T19:59:10.099562+0000","last_fullsized":"2023-11-28T19:59:10.099562+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:59:05.015714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:59:05.015714+0000","last_clean_scrub_stamp":"2023-11-28T19:59:05.015714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:34:41.640833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T19:59:10.097144+0000","last_change":"2023-11-28T19:59:05.767616+0000","last_active":"2023-11-28T19:59:10.097144+0000","last_peered":"2023-11-28T19:59:10.097144+0000","last_clean":"2023-11-28T19:59:10.097144+0000","last_became_active":"2023-11-28T19:59:05.766973+0000","last_became_peered":"2023-11-28T19:59:05.766973+0000","last_unstale":"2023-11-28T19:59:10.097144+0000","last_undegraded":"2023-11-28T19:59:10.097144+0000","last_fullsized":"2023-11-28T19:59:10.097144+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:59:05.015714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:59:05.015714+0000","last_clean_scrub_stamp":"2023-11-28T19:59:05.015714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:21:21.519406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T19:59:10.092009+0000","last_change":"2023-11-28T19:59:05.760962+0000","last_active":"2023-11-28T19:59:10.092009+0000","last_peered":"2023-11-28T19:59:10.092009+0000","last_clean":"2023-11-28T19:59:10.092009+0000","last_became_active":"2023-11-28T19:59:05.760666+0000","last_became_peered":"2023-11-28T19:59:05.760666+0000","last_unstale":"2023-11-28T19:59:10.092009+0000","last_undegraded":"2023-11-28T19:59:10.092009+0000","last_fullsized":"2023-11-28T19:59:10.092009+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:59:05.015714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:59:05.015714+0000","last_clean_scrub_stamp":"2023-11-28T19:59:05.015714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:21:21.519406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T19:59:10.085859+0000","last_change":"2023-11-28T19:59:05.769994+0000","last_active":"2023-11-28T19:59:10.085859+0000","last_peered":"2023-11-28T19:59:10.085859+0000","last_clean":"2023-11-28T19:59:10.085859+0000","last_became_active":"2023-11-28T19:59:05.764430+0000","last_became_peered":"2023-11-28T19:59:05.764430+0000","last_unstale":"2023-11-28T19:59:10.085859+0000","last_undegraded":"2023-11-28T19:59:10.085859+0000","last_fullsized":"2023-11-28T19:59:10.085859+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:59:05.015714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:59:05.015714+0000","last_clean_scrub_stamp":"2023-11-28T19:59:05.015714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:13:21.633400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T19:59:10.087468+0000","last_change":"2023-11-28T19:59:05.776439+0000","last_active":"2023-11-28T19:59:10.087468+0000","last_peered":"2023-11-28T19:59:10.087468+0000","last_clean":"2023-11-28T19:59:10.087468+0000","last_became_active":"2023-11-28T19:59:05.776196+0000","last_became_peered":"2023-11-28T19:59:05.776196+0000","last_unstale":"2023-11-28T19:59:10.087468+0000","last_undegraded":"2023-11-28T19:59:10.087468+0000","last_fullsized":"2023-11-28T19:59:10.087468+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:59:05.015714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:59:05.015714+0000","last_clean_scrub_stamp":"2023-11-28T19:59:05.015714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:44:02.102081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T19:59:10.086540+0000","last_change":"2023-11-28T19:59:05.775620+0000","last_active":"2023-11-28T19:59:10.086540+0000","last_peered":"2023-11-28T19:59:10.086540+0000","last_clean":"2023-11-28T19:59:10.086540+0000","last_became_active":"2023-11-28T19:59:05.775057+0000","last_became_peered":"2023-11-28T19:59:05.775057+0000","last_unstale":"2023-11-28T19:59:10.086540+0000","last_undegraded":"2023-11-28T19:59:10.086540+0000","last_fullsized":"2023-11-28T19:59:10.086540+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:59:05.015714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:59:05.015714+0000","last_clean_scrub_stamp":"2023-11-28T19:59:05.015714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:21:21.519406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T19:59:10.105499+0000","last_change":"2023-11-28T19:59:05.783460+0000","last_active":"2023-11-28T19:59:10.105499+0000","last_peered":"2023-11-28T19:59:10.105499+0000","last_clean":"2023-11-28T19:59:10.105499+0000","last_became_active":"2023-11-28T19:59:05.783195+0000","last_became_peered":"2023-11-28T19:59:05.783195+0000","last_unstale":"2023-11-28T19:59:10.105499+0000","last_undegraded":"2023-11-28T19:59:10.105499+0000","last_fullsized":"2023-11-28T19:59:10.105499+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:59:05.015714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:59:05.015714+0000","last_clean_scrub_stamp":"2023-11-28T19:59:05.015714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:18:37.608605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T19:59:10.096571+0000","last_change":"2023-11-28T19:59:05.775976+0000","last_active":"2023-11-28T19:59:10.096571+0000","last_peered":"2023-11-28T19:59:10.096571+0000","last_clean":"2023-11-28T19:59:10.096571+0000","last_became_active":"2023-11-28T19:59:05.775738+0000","last_became_peered":"2023-11-28T19:59:05.775738+0000","last_unstale":"2023-11-28T19:59:10.096571+0000","last_undegraded":"2023-11-28T19:59:10.096571+0000","last_fullsized":"2023-11-28T19:59:10.096571+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:59:05.015714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:59:05.015714+0000","last_clean_scrub_stamp":"2023-11-28T19:59:05.015714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T06:26:55.424441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T19:59:10.231824+0000","last_change":"2023-11-28T19:59:05.786686+0000","last_active":"2023-11-28T19:59:10.231824+0000","last_peered":"2023-11-28T19:59:10.231824+0000","last_clean":"2023-11-28T19:59:10.231824+0000","last_became_active":"2023-11-28T19:59:05.786141+0000","last_became_peered":"2023-11-28T19:59:05.786141+0000","last_unstale":"2023-11-28T19:59:10.231824+0000","last_undegraded":"2023-11-28T19:59:10.231824+0000","last_fullsized":"2023-11-28T19:59:10.231824+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:59:05.015714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:59:05.015714+0000","last_clean_scrub_stamp":"2023-11-28T19:59:05.015714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:04:18.564508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T19:59:10.081827+0000","last_change":"2023-11-28T19:59:05.768915+0000","last_active":"2023-11-28T19:59:10.081827+0000","last_peered":"2023-11-28T19:59:10.081827+0000","last_clean":"2023-11-28T19:59:10.081827+0000","last_became_active":"2023-11-28T19:59:05.768661+0000","last_became_peered":"2023-11-28T19:59:05.768661+0000","last_unstale":"2023-11-28T19:59:10.081827+0000","last_undegraded":"2023-11-28T19:59:10.081827+0000","last_fullsized":"2023-11-28T19:59:10.081827+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:59:05.015714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:59:05.015714+0000","last_clean_scrub_stamp":"2023-11-28T19:59:05.015714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T06:50:51.335785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T19:59:10.086791+0000","last_change":"2023-11-28T19:59:05.763580+0000","last_active":"2023-11-28T19:59:10.086791+0000","last_peered":"2023-11-28T19:59:10.086791+0000","last_clean":"2023-11-28T19:59:10.086791+0000","last_became_active":"2023-11-28T19:59:05.763254+0000","last_became_peered":"2023-11-28T19:59:05.763254+0000","last_unstale":"2023-11-28T19:59:10.086791+0000","last_undegraded":"2023-11-28T19:59:10.086791+0000","last_fullsized":"2023-11-28T19:59:10.086791+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:59:05.015714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:59:05.015714+0000","last_clean_scrub_stamp":"2023-11-28T19:59:05.015714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:50:40.999064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T19:59:10.085773+0000","last_change":"2023-11-28T19:59:05.774080+0000","last_active":"2023-11-28T19:59:10.085773+0000","last_peered":"2023-11-28T19:59:10.085773+0000","last_clean":"2023-11-28T19:59:10.085773+0000","last_became_active":"2023-11-28T19:59:05.773751+0000","last_became_peered":"2023-11-28T19:59:05.773751+0000","last_unstale":"2023-11-28T19:59:10.085773+0000","last_undegraded":"2023-11-28T19:59:10.085773+0000","last_fullsized":"2023-11-28T19:59:10.085773+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:59:05.015714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:59:05.015714+0000","last_clean_scrub_stamp":"2023-11-28T19:59:05.015714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:05:03.688191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T19:59:10.098523+0000","last_change":"2023-11-28T19:59:05.766875+0000","last_active":"2023-11-28T19:59:10.098523+0000","last_peered":"2023-11-28T19:59:10.098523+0000","last_clean":"2023-11-28T19:59:10.098523+0000","last_became_active":"2023-11-28T19:59:05.766555+0000","last_became_peered":"2023-11-28T19:59:05.766555+0000","last_unstale":"2023-11-28T19:59:10.098523+0000","last_undegraded":"2023-11-28T19:59:10.098523+0000","last_fullsized":"2023-11-28T19:59:10.098523+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:59:05.015714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:59:05.015714+0000","last_clean_scrub_stamp":"2023-11-28T19:59:05.015714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:00:56.432813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T19:59:10.105223+0000","last_change":"2023-11-28T19:59:05.769350+0000","last_active":"2023-11-28T19:59:10.105223+0000","last_peered":"2023-11-28T19:59:10.105223+0000","last_clean":"2023-11-28T19:59:10.105223+0000","last_became_active":"2023-11-28T19:59:05.769067+0000","last_became_peered":"2023-11-28T19:59:05.769067+0000","last_unstale":"2023-11-28T19:59:10.105223+0000","last_undegraded":"2023-11-28T19:59:10.105223+0000","last_fullsized":"2023-11-28T19:59:10.105223+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:59:05.015714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:59:05.015714+0000","last_clean_scrub_stamp":"2023-11-28T19:59:05.015714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:24:48.272826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T19:59:10.085817+0000","last_change":"2023-11-28T19:59:05.768359+0000","last_active":"2023-11-28T19:59:10.085817+0000","last_peered":"2023-11-28T19:59:10.085817+0000","last_clean":"2023-11-28T19:59:10.085817+0000","last_became_active":"2023-11-28T19:59:05.768033+0000","last_became_peered":"2023-11-28T19:59:05.768033+0000","last_unstale":"2023-11-28T19:59:10.085817+0000","last_undegraded":"2023-11-28T19:59:10.085817+0000","last_fullsized":"2023-11-28T19:59:10.085817+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:59:05.015714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:59:05.015714+0000","last_clean_scrub_stamp":"2023-11-28T19:59:05.015714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:00:56.432813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T19:59:10.093892+0000","last_change":"2023-11-28T19:59:05.769430+0000","last_active":"2023-11-28T19:59:10.093892+0000","last_peered":"2023-11-28T19:59:10.093892+0000","last_clean":"2023-11-28T19:59:10.093892+0000","last_became_active":"2023-11-28T19:59:05.769077+0000","last_became_peered":"2023-11-28T19:59:05.769077+0000","last_unstale":"2023-11-28T19:59:10.093892+0000","last_undegraded":"2023-11-28T19:59:10.093892+0000","last_fullsized":"2023-11-28T19:59:10.093892+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:59:05.015714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:59:05.015714+0000","last_clean_scrub_stamp":"2023-11-28T19:59:05.015714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T06:50:51.335785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T19:59:10.096948+0000","last_change":"2023-11-28T19:59:05.780244+0000","last_active":"2023-11-28T19:59:10.096948+0000","last_peered":"2023-11-28T19:59:10.096948+0000","last_clean":"2023-11-28T19:59:10.096948+0000","last_became_active":"2023-11-28T19:59:05.779967+0000","last_became_peered":"2023-11-28T19:59:05.779967+0000","last_unstale":"2023-11-28T19:59:10.096948+0000","last_undegraded":"2023-11-28T19:59:10.096948+0000","last_fullsized":"2023-11-28T19:59:10.096948+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:59:05.015714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:59:05.015714+0000","last_clean_scrub_stamp":"2023-11-28T19:59:05.015714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:37:45.006198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T19:59:10.097115+0000","last_change":"2023-11-28T19:59:05.780306+0000","last_active":"2023-11-28T19:59:10.097115+0000","last_peered":"2023-11-28T19:59:10.097115+0000","last_clean":"2023-11-28T19:59:10.097115+0000","last_became_active":"2023-11-28T19:59:05.780039+0000","last_became_peered":"2023-11-28T19:59:05.780039+0000","last_unstale":"2023-11-28T19:59:10.097115+0000","last_undegraded":"2023-11-28T19:59:10.097115+0000","last_fullsized":"2023-11-28T19:59:10.097115+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:59:05.015714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:59:05.015714+0000","last_clean_scrub_stamp":"2023-11-28T19:59:05.015714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:05:03.688191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T19:59:10.232048+0000","last_change":"2023-11-28T19:59:05.786228+0000","last_active":"2023-11-28T19:59:10.232048+0000","last_peered":"2023-11-28T19:59:10.232048+0000","last_clean":"2023-11-28T19:59:10.232048+0000","last_became_active":"2023-11-28T19:59:05.785937+0000","last_became_peered":"2023-11-28T19:59:05.785937+0000","last_unstale":"2023-11-28T19:59:10.232048+0000","last_undegraded":"2023-11-28T19:59:10.232048+0000","last_fullsized":"2023-11-28T19:59:10.232048+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:59:05.015714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:59:05.015714+0000","last_clean_scrub_stamp":"2023-11-28T19:59:05.015714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:27:34.900513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T19:59:10.086749+0000","last_change":"2023-11-28T19:59:05.764238+0000","last_active":"2023-11-28T19:59:10.086749+0000","last_peered":"2023-11-28T19:59:10.086749+0000","last_clean":"2023-11-28T19:59:10.086749+0000","last_became_active":"2023-11-28T19:59:05.763941+0000","last_became_peered":"2023-11-28T19:59:05.763941+0000","last_unstale":"2023-11-28T19:59:10.086749+0000","last_undegraded":"2023-11-28T19:59:10.086749+0000","last_fullsized":"2023-11-28T19:59:10.086749+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:59:05.015714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:59:05.015714+0000","last_clean_scrub_stamp":"2023-11-28T19:59:05.015714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:18:37.608605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T19:59:10.231401+0000","last_change":"2023-11-28T19:59:05.777444+0000","last_active":"2023-11-28T19:59:10.231401+0000","last_peered":"2023-11-28T19:59:10.231401+0000","last_clean":"2023-11-28T19:59:10.231401+0000","last_became_active":"2023-11-28T19:59:05.777096+0000","last_became_peered":"2023-11-28T19:59:05.777096+0000","last_unstale":"2023-11-28T19:59:10.231401+0000","last_undegraded":"2023-11-28T19:59:10.231401+0000","last_fullsized":"2023-11-28T19:59:10.231401+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:59:05.015714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:59:05.015714+0000","last_clean_scrub_stamp":"2023-11-28T19:59:05.015714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:37:45.006198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T19:59:10.086470+0000","last_change":"2023-11-28T19:59:05.775817+0000","last_active":"2023-11-28T19:59:10.086470+0000","last_peered":"2023-11-28T19:59:10.086470+0000","last_clean":"2023-11-28T19:59:10.086470+0000","last_became_active":"2023-11-28T19:59:05.775434+0000","last_became_peered":"2023-11-28T19:59:05.775434+0000","last_unstale":"2023-11-28T19:59:10.086470+0000","last_undegraded":"2023-11-28T19:59:10.086470+0000","last_fullsized":"2023-11-28T19:59:10.086470+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:59:05.015714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:59:05.015714+0000","last_clean_scrub_stamp":"2023-11-28T19:59:05.015714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:37:45.006198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T19:59:10.231662+0000","last_change":"2023-11-28T19:59:05.773714+0000","last_active":"2023-11-28T19:59:10.231662+0000","last_peered":"2023-11-28T19:59:10.231662+0000","last_clean":"2023-11-28T19:59:10.231662+0000","last_became_active":"2023-11-28T19:59:05.773423+0000","last_became_peered":"2023-11-28T19:59:05.773423+0000","last_unstale":"2023-11-28T19:59:10.231662+0000","last_undegraded":"2023-11-28T19:59:10.231662+0000","last_fullsized":"2023-11-28T19:59:10.231662+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:59:05.015714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:59:05.015714+0000","last_clean_scrub_stamp":"2023-11-28T19:59:05.015714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:13:21.633400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T19:59:10.087840+0000","last_change":"2023-11-28T19:59:05.770679+0000","last_active":"2023-11-28T19:59:10.087840+0000","last_peered":"2023-11-28T19:59:10.087840+0000","last_clean":"2023-11-28T19:59:10.087840+0000","last_became_active":"2023-11-28T19:59:05.770220+0000","last_became_peered":"2023-11-28T19:59:05.770220+0000","last_unstale":"2023-11-28T19:59:10.087840+0000","last_undegraded":"2023-11-28T19:59:10.087840+0000","last_fullsized":"2023-11-28T19:59:10.087840+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:59:05.015714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:59:05.015714+0000","last_clean_scrub_stamp":"2023-11-28T19:59:05.015714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:56:09.640427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T19:59:10.106440+0000","last_change":"2023-11-28T19:59:05.763243+0000","last_active":"2023-11-28T19:59:10.106440+0000","last_peered":"2023-11-28T19:59:10.106440+0000","last_clean":"2023-11-28T19:59:10.106440+0000","last_became_active":"2023-11-28T19:59:05.762624+0000","last_became_peered":"2023-11-28T19:59:05.762624+0000","last_unstale":"2023-11-28T19:59:10.106440+0000","last_undegraded":"2023-11-28T19:59:10.106440+0000","last_fullsized":"2023-11-28T19:59:10.106440+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:59:05.015714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:59:05.015714+0000","last_clean_scrub_stamp":"2023-11-28T19:59:05.015714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:21:11.899134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T19:59:10.099378+0000","last_change":"2023-11-28T19:59:05.766991+0000","last_active":"2023-11-28T19:59:10.099378+0000","last_peered":"2023-11-28T19:59:10.099378+0000","last_clean":"2023-11-28T19:59:10.099378+0000","last_became_active":"2023-11-28T19:59:05.766715+0000","last_became_peered":"2023-11-28T19:59:05.766715+0000","last_unstale":"2023-11-28T19:59:10.099378+0000","last_undegraded":"2023-11-28T19:59:10.099378+0000","last_fullsized":"2023-11-28T19:59:10.099378+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:59:05.015714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:59:05.015714+0000","last_clean_scrub_stamp":"2023-11-28T19:59:05.015714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:05:03.688191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T19:59:10.231952+0000","last_change":"2023-11-28T19:59:05.784181+0000","last_active":"2023-11-28T19:59:10.231952+0000","last_peered":"2023-11-28T19:59:10.231952+0000","last_clean":"2023-11-28T19:59:10.231952+0000","last_became_active":"2023-11-28T19:59:05.783940+0000","last_became_peered":"2023-11-28T19:59:05.783940+0000","last_unstale":"2023-11-28T19:59:10.231952+0000","last_undegraded":"2023-11-28T19:59:10.231952+0000","last_fullsized":"2023-11-28T19:59:10.231952+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:59:05.015714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:59:05.015714+0000","last_clean_scrub_stamp":"2023-11-28T19:59:05.015714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:59:15.117552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4639,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9278,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":66748,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574858,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27348,"kb_used_data":328,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344492,"statfs":{"total":96636764160,"available":96608759808,"internally_reserved":0,"allocated":335872,"data_stored":695413,"data_compressed":33374,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.749}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54000000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59299999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56899999999999995}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.432}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67000000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.626}]}]},{"osd":6,"up_from":13,"seq":55834574856,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27288,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344552,"statfs":{"total":96636764160,"available":96608821248,"internally_reserved":0,"allocated":278528,"data_stored":108304,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65000000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76300000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60099999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70599999999999996}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52100000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84399999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54900000000000004}]}]},{"osd":5,"up_from":13,"seq":55834574858,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27292,"kb_used_data":264,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344548,"statfs":{"total":96636764160,"available":96608817152,"internally_reserved":0,"allocated":270336,"data_stored":104553,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85599999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60599999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56999999999999995}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63400000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72999999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71099999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67200000000000004}]}]},{"osd":4,"up_from":13,"seq":55834574857,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27300,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344540,"statfs":{"total":96636764160,"available":96608808960,"internally_reserved":0,"allocated":278528,"data_stored":104589,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61699999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56000000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60399999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64500000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53400000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70399999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77900000000000003}]}]},{"osd":3,"up_from":13,"seq":55834574858,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27288,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344552,"statfs":{"total":96636764160,"available":96608821248,"internally_reserved":0,"allocated":278528,"data_stored":108304,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36099999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46200000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52200000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57199999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.74299999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70299999999999996}]}]},{"osd":2,"up_from":13,"seq":55834574856,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27288,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344552,"statfs":{"total":96636764160,"available":96608821248,"internally_reserved":0,"allocated":266240,"data_stored":104463,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54400000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51300000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.628}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83999999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95799999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91400000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89800000000000002}]}]},{"osd":1,"up_from":13,"seq":55834574858,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27300,"kb_used_data":268,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344540,"statfs":{"total":96636764160,"available":96608808960,"internally_reserved":0,"allocated":274432,"data_stored":104623,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36899999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33000000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77800000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59199999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82799999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78800000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.74299999999999999}]}]},{"osd":0,"up_from":13,"seq":55834574857,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27360,"kb_used_data":336,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344480,"statfs":{"total":96636764160,"available":96608747520,"internally_reserved":0,"allocated":344064,"data_stored":695469,"data_compressed":33374,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36499999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46100000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38600000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.621}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57299999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66400000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60099999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33374,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33374,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3841,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3841,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-28T19:59:29.843 INFO:tasks.ceph.ceph_manager.ceph:clean! 2023-11-28T19:59:29.843 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2023-11-28T19:59:29.843 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2023-11-28T19:59:29.843 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-11-28T19:59:30.019 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:30.015+0000 7f8f5c9e6640 1 Processor -- start 2023-11-28T19:59:30.020 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:30.015+0000 7f8f5c9e6640 1 -- start start 2023-11-28T19:59:30.023 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:30.015+0000 7f8f5c9e6640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f8f5806c100 0x7f8f5815fe30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:30.023 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:30.015+0000 7f8f5c9e6640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8f580c4890 con 0x7f8f580af4c0 2023-11-28T19:59:30.023 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:30.015+0000 7f8f5c9e6640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8f581553d0 con 0x7f8f58154f20 2023-11-28T19:59:30.024 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:30.015+0000 7f8f5c9e6640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8f580af8a0 con 0x7f8f5806c100 2023-11-28T19:59:30.024 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:30.015+0000 7f8f5659c640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f8f580af4c0 0x7f8f580c67d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:54032/0 (socket says 172.21.15.78:54032) 2023-11-28T19:59:30.024 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:30.015+0000 7f8f5659c640 1 -- 172.21.15.78:0/2130003003 learned_addr learned my addr 172.21.15.78:0/2130003003 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-11-28T19:59:30.024 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:30.015+0000 7f8f56d9d640 1 --2- 172.21.15.78:0/2130003003 >> v2:172.21.15.179:3300/0 conn(0x7f8f5806c100 0x7f8f5815fe30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:30.024 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:30.015+0000 7f8f5559a640 1 -- 172.21.15.78:0/2130003003 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2732115461 0 0) 0x7f8f580c4890 con 0x7f8f580af4c0 2023-11-28T19:59:30.024 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:30.015+0000 7f8f5559a640 1 -- 172.21.15.78:0/2130003003 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8f40003530 con 0x7f8f580af4c0 2023-11-28T19:59:30.025 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:30.015+0000 7f8f5559a640 1 -- 172.21.15.78:0/2130003003 <== mon.0 v1:172.21.15.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 23723378 0 0) 0x7f8f40003530 con 0x7f8f580af4c0 2023-11-28T19:59:30.025 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:30.015+0000 7f8f5559a640 1 -- 172.21.15.78:0/2130003003 >> v2:172.21.15.179:3300/0 conn(0x7f8f5806c100 msgr2=0x7f8f5815fe30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T19:59:30.025 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:30.015+0000 7f8f5559a640 1 --2- 172.21.15.78:0/2130003003 >> v2:172.21.15.179:3300/0 conn(0x7f8f5806c100 0x7f8f5815fe30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:30.025 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:30.015+0000 7f8f5559a640 1 -- 172.21.15.78:0/2130003003 >> v1:172.21.15.179:6789/0 conn(0x7f8f58154f20 legacy=0x7f8f5806b9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:30.025 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:30.015+0000 7f8f5559a640 1 -- 172.21.15.78:0/2130003003 --> v1:172.21.15.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f580c4b30 con 0x7f8f580af4c0 2023-11-28T19:59:30.025 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:30.015+0000 7f8f5559a640 1 -- 172.21.15.78:0/2130003003 <== mon.0 v1:172.21.15.78:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3326804700 0 0) 0x7f8f48001680 con 0x7f8f580af4c0 2023-11-28T19:59:30.025 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:30.015+0000 7f8f5559a640 1 -- 172.21.15.78:0/2130003003 >> v1:172.21.15.78:6789/0 conn(0x7f8f580af4c0 legacy=0x7f8f580c67d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:30.026 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:30.015+0000 7f8f5559a640 1 --2- 172.21.15.78:0/2130003003 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8f400039d0 0x7f8f40003df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:30.026 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:30.015+0000 7f8f5559a640 1 --2- 172.21.15.78:0/2130003003 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8f400047d0 0x7f8f40004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:30.026 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:30.015+0000 7f8f5559a640 1 --2- 172.21.15.78:0/2130003003 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8f400051e0 0x7f8f4000b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:30.026 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:30.015+0000 7f8f5559a640 1 -- 172.21.15.78:0/2130003003 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f580af8a0 con 0x7f8f400039d0 2023-11-28T19:59:30.026 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:30.015+0000 7f8f5559a640 1 -- 172.21.15.78:0/2130003003 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f4000c130 con 0x7f8f400051e0 2023-11-28T19:59:30.026 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:30.015+0000 7f8f5559a640 1 -- 172.21.15.78:0/2130003003 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8f4000c2f0 con 0x7f8f400047d0 2023-11-28T19:59:30.027 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:30.015+0000 7f8f5659c640 1 --2- 172.21.15.78:0/2130003003 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8f400039d0 0x7f8f40003df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:30.027 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:30.015+0000 7f8f55d9b640 1 --2- 172.21.15.78:0/2130003003 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8f400047d0 0x7f8f40004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:30.027 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:30.015+0000 7f8f56d9d640 1 --2- 172.21.15.78:0/2130003003 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8f400051e0 0x7f8f4000b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:30.027 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:30.015+0000 7f8f5659c640 1 -- 172.21.15.78:0/2130003003 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8f400047d0 msgr2=0x7f8f40004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T19:59:30.027 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:30.015+0000 7f8f5659c640 1 --2- 172.21.15.78:0/2130003003 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8f400047d0 0x7f8f40004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:30.027 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:30.015+0000 7f8f5659c640 1 -- 172.21.15.78:0/2130003003 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8f400051e0 msgr2=0x7f8f4000b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T19:59:30.027 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:30.015+0000 7f8f5659c640 1 --2- 172.21.15.78:0/2130003003 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8f400051e0 0x7f8f4000b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:30.028 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:30.015+0000 7f8f5659c640 1 -- 172.21.15.78:0/2130003003 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f40003530 con 0x7f8f400039d0 2023-11-28T19:59:30.028 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:30.015+0000 7f8f56d9d640 1 -- 172.21.15.78:0/2130003003 reap_dead start 2023-11-28T19:59:30.031 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:30.019+0000 7f8f5659c640 1 --2- 172.21.15.78:0/2130003003 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8f400039d0 0x7f8f40003df0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f8f48007fc0 tx=0x7f8f4801ca70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6fdf90f83dd08aaf server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:59:30.032 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:30.019+0000 7f8f5559a640 1 -- 172.21.15.78:0/2130003003 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f48005ae0 con 0x7f8f400039d0 2023-11-28T19:59:30.032 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:30.019+0000 7f8f5559a640 1 -- 172.21.15.78:0/2130003003 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f48005c60 con 0x7f8f400039d0 2023-11-28T19:59:30.032 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:30.019+0000 7f8f5559a640 1 -- 172.21.15.78:0/2130003003 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f48007070 con 0x7f8f400039d0 2023-11-28T19:59:30.032 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:30.019+0000 7f8f5c9e6640 1 -- 172.21.15.78:0/2130003003 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8f400039d0 msgr2=0x7f8f40003df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:30.032 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:30.019+0000 7f8f5c9e6640 1 --2- 172.21.15.78:0/2130003003 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8f400039d0 0x7f8f40003df0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f8f48007fc0 tx=0x7f8f4801ca70 comp rx=0 tx=0).stop 2023-11-28T19:59:30.032 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:30.019+0000 7f8f5c9e6640 1 -- 172.21.15.78:0/2130003003 shutdown_connections 2023-11-28T19:59:30.032 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:30.019+0000 7f8f5c9e6640 1 --2- 172.21.15.78:0/2130003003 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8f400039d0 0x7f8f40003df0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:30.032 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:30.019+0000 7f8f5c9e6640 1 -- 172.21.15.78:0/2130003003 >> 172.21.15.78:0/2130003003 conn(0x7f8f580ab9d0 msgr2=0x7f8f580abde0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T19:59:30.032 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:30.019+0000 7f8f5c9e6640 1 -- 172.21.15.78:0/2130003003 shutdown_connections 2023-11-28T19:59:30.032 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:30.019+0000 7f8f5c9e6640 1 -- 172.21.15.78:0/2130003003 wait complete. 2023-11-28T19:59:30.032 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:30.023+0000 7f8f5c9e6640 1 Processor -- start 2023-11-28T19:59:30.033 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:30.023+0000 7f8f5c9e6640 1 -- start start 2023-11-28T19:59:30.033 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:30.023+0000 7f8f5c9e6640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8f400039d0 0x7f8f581edc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:30.033 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:30.023+0000 7f8f5c9e6640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8f5814c7e0 0x7f8f580c8e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:30.033 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:30.023+0000 7f8f5c9e6640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8f580c02c0 0x7f8f580c0740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:30.033 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:30.023+0000 7f8f5c9e6640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f580c0c80 con 0x7f8f400039d0 2023-11-28T19:59:30.033 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:30.023+0000 7f8f5c9e6640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f581ee170 con 0x7f8f580c02c0 2023-11-28T19:59:30.033 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:30.023+0000 7f8f5c9e6640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8f5814ce10 con 0x7f8f5814c7e0 2023-11-28T19:59:30.033 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:30.023+0000 7f8f5659c640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8f400039d0 0x7f8f581edc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:30.033 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:30.023+0000 7f8f5659c640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8f400039d0 0x7f8f581edc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:53280/0 (socket says 172.21.15.78:53280) 2023-11-28T19:59:30.033 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:30.023+0000 7f8f5659c640 1 -- 172.21.15.78:0/2706392073 learned_addr learned my addr 172.21.15.78:0/2706392073 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T19:59:30.033 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:30.023+0000 7f8f56d9d640 1 --2- 172.21.15.78:0/2706392073 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8f580c02c0 0x7f8f580c0740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:30.033 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:30.023+0000 7f8f55d9b640 1 --2- 172.21.15.78:0/2706392073 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8f5814c7e0 0x7f8f580c8e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:30.034 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:30.023+0000 7f8f5659c640 1 -- 172.21.15.78:0/2706392073 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8f5814c7e0 msgr2=0x7f8f580c8e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:30.034 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:30.023+0000 7f8f5659c640 1 --2- 172.21.15.78:0/2706392073 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8f5814c7e0 0x7f8f580c8e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:30.034 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:30.023+0000 7f8f5659c640 1 -- 172.21.15.78:0/2706392073 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8f580c02c0 msgr2=0x7f8f580c0740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:30.034 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:30.023+0000 7f8f5659c640 1 --2- 172.21.15.78:0/2706392073 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8f580c02c0 0x7f8f580c0740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:30.034 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:30.023+0000 7f8f5659c640 1 -- 172.21.15.78:0/2706392073 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f580c2590 con 0x7f8f400039d0 2023-11-28T19:59:30.034 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:30.023+0000 7f8f5659c640 1 --2- 172.21.15.78:0/2706392073 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8f400039d0 0x7f8f581edc30 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f8f48000c10 tx=0x7f8f40005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:59:30.034 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:30.023+0000 7f8f46ffd640 1 -- 172.21.15.78:0/2706392073 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f480b4070 con 0x7f8f400039d0 2023-11-28T19:59:30.034 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:30.023+0000 7f8f46ffd640 1 -- 172.21.15.78:0/2706392073 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f48005940 con 0x7f8f400039d0 2023-11-28T19:59:30.034 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:30.023+0000 7f8f5c9e6640 1 -- 172.21.15.78:0/2706392073 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8f580c2870 con 0x7f8f400039d0 2023-11-28T19:59:30.034 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:30.023+0000 7f8f46ffd640 1 -- 172.21.15.78:0/2706392073 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f48007290 con 0x7f8f400039d0 2023-11-28T19:59:30.034 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:30.023+0000 7f8f5c9e6640 1 -- 172.21.15.78:0/2706392073 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8f580c1030 con 0x7f8f400039d0 2023-11-28T19:59:30.034 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:30.027+0000 7f8f5c9e6640 1 -- 172.21.15.78:0/2706392073 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8f580c0e90 con 0x7f8f400039d0 2023-11-28T19:59:30.036 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:30.027+0000 7f8f46ffd640 1 -- 172.21.15.78:0/2706392073 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f8f480073f0 con 0x7f8f400039d0 2023-11-28T19:59:30.036 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:30.027+0000 7f8f46ffd640 1 --2- 172.21.15.78:0/2706392073 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f8f380664a0 0x7f8f38068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:30.036 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:30.027+0000 7f8f46ffd640 1 -- 172.21.15.78:0/2706392073 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f8f4811dd00 con 0x7f8f400039d0 2023-11-28T19:59:30.036 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:30.027+0000 7f8f55d9b640 1 --2- 172.21.15.78:0/2706392073 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f8f380664a0 0x7f8f38068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:30.036 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:30.027+0000 7f8f55d9b640 1 --2- 172.21.15.78:0/2706392073 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f8f380664a0 0x7f8f38068960 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f8f4c000c10 tx=0x7f8f4c009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:59:30.037 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:30.031+0000 7f8f46ffd640 1 -- 172.21.15.78:0/2706392073 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f8f580c0e90 con 0x7f8f400039d0 2023-11-28T19:59:30.215 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:30.211+0000 7f8f5c9e6640 1 -- 172.21.15.78:0/2706392073 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f8f580c0e90 con 0x7f8f400039d0 2023-11-28T19:59:30.216 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:30.211+0000 7f8f46ffd640 1 -- 172.21.15.78:0/2706392073 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+46 (secure 0 0 0) 0x7f8f580c0e90 con 0x7f8f400039d0 2023-11-28T19:59:30.216 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-11-28T19:59:30.216 INFO:teuthology.orchestra.run.smithi078.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2023-11-28T19:59:30.218 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:30.211+0000 7f8f5c9e6640 1 -- 172.21.15.78:0/2706392073 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f8f380664a0 msgr2=0x7f8f38068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:30.218 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:30.211+0000 7f8f5c9e6640 1 --2- 172.21.15.78:0/2706392073 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f8f380664a0 0x7f8f38068960 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f8f4c000c10 tx=0x7f8f4c009040 comp rx=0 tx=0).stop 2023-11-28T19:59:30.218 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:30.211+0000 7f8f5c9e6640 1 -- 172.21.15.78:0/2706392073 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8f400039d0 msgr2=0x7f8f581edc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:30.218 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:30.211+0000 7f8f5c9e6640 1 --2- 172.21.15.78:0/2706392073 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8f400039d0 0x7f8f581edc30 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f8f48000c10 tx=0x7f8f40005800 comp rx=0 tx=0).stop 2023-11-28T19:59:30.218 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:30.211+0000 7f8f5c9e6640 1 -- 172.21.15.78:0/2706392073 shutdown_connections 2023-11-28T19:59:30.219 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:30.211+0000 7f8f5c9e6640 1 --2- 172.21.15.78:0/2706392073 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f8f380664a0 0x7f8f38068960 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:30.219 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:30.211+0000 7f8f5c9e6640 1 --2- 172.21.15.78:0/2706392073 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8f5814c7e0 0x7f8f580c8e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:30.219 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:30.211+0000 7f8f5c9e6640 1 --2- 172.21.15.78:0/2706392073 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8f580c02c0 0x7f8f580c0740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:30.219 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:30.211+0000 7f8f5c9e6640 1 --2- 172.21.15.78:0/2706392073 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8f400039d0 0x7f8f581edc30 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:30.219 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:30.211+0000 7f8f5c9e6640 1 -- 172.21.15.78:0/2706392073 >> 172.21.15.78:0/2706392073 conn(0x7f8f580ab9d0 msgr2=0x7f8f580733c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T19:59:30.219 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:30.211+0000 7f8f5c9e6640 1 -- 172.21.15.78:0/2706392073 shutdown_connections 2023-11-28T19:59:30.220 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:30.211+0000 7f8f5c9e6640 1 -- 172.21.15.78:0/2706392073 wait complete. 2023-11-28T19:59:30.237 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2023-11-28T19:59:30.238 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-28T19:59:30.375 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:30.367+0000 7f70c2279640 1 Processor -- start 2023-11-28T19:59:30.375 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:30.367+0000 7f70c2279640 1 -- start start 2023-11-28T19:59:30.376 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:30.371+0000 7f70c2279640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f70bc06d2b0 0x7f70bc06d690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:30.376 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:30.371+0000 7f70c2279640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f70bc0c3b80 0x7f70bc0c5300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:30.376 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:30.371+0000 7f70c2279640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f70bc06bb80 con 0x7f70bc06c020 2023-11-28T19:59:30.376 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:30.371+0000 7f70c2279640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f70bc0c5840 con 0x7f70bc0c3b80 2023-11-28T19:59:30.376 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:30.371+0000 7f70c2279640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f70bc1515c0 con 0x7f70bc06d2b0 2023-11-28T19:59:30.376 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:30.371+0000 7f70bb7fe640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f70bc0c3b80 0x7f70bc0c5300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:30.377 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:30.371+0000 7f70bb7fe640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f70bc0c3b80 0x7f70bc0c5300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:53286/0 (socket says 172.21.15.78:53286) 2023-11-28T19:59:30.377 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:30.371+0000 7f70bb7fe640 1 -- 172.21.15.78:0/3830762082 learned_addr learned my addr 172.21.15.78:0/3830762082 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T19:59:30.377 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:30.371+0000 7f70c0816640 1 --1- 172.21.15.78:0/3830762082 >> v1:172.21.15.78:6789/0 conn(0x7f70bc06c020 0x7f70bc06c4b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:54036/0 (socket says 172.21.15.78:54036) 2023-11-28T19:59:30.377 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:30.371+0000 7f70bbfff640 1 --2- 172.21.15.78:0/3830762082 >> v2:172.21.15.179:3300/0 conn(0x7f70bc06d2b0 0x7f70bc06d690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:30.378 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:30.371+0000 7f70bb7fe640 1 -- 172.21.15.78:0/3830762082 >> v2:172.21.15.179:3300/0 conn(0x7f70bc06d2b0 msgr2=0x7f70bc06d690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T19:59:30.378 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:30.371+0000 7f70bb7fe640 1 --2- 172.21.15.78:0/3830762082 >> v2:172.21.15.179:3300/0 conn(0x7f70bc06d2b0 0x7f70bc06d690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:30.378 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:30.371+0000 7f70bb7fe640 1 -- 172.21.15.78:0/3830762082 >> v1:172.21.15.78:6789/0 conn(0x7f70bc06c020 legacy=0x7f70bc06c4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:30.378 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:30.371+0000 7f70bb7fe640 1 -- 172.21.15.78:0/3830762082 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70bc1518a0 con 0x7f70bc0c3b80 2023-11-28T19:59:30.378 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:30.371+0000 7f70baffd640 1 -- 172.21.15.78:0/3830762082 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1712754569 0 0) 0x7f70bc06bb80 con 0x7f70bc06c020 2023-11-28T19:59:30.379 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:30.375+0000 7f70bb7fe640 1 --2- 172.21.15.78:0/3830762082 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f70bc0c3b80 0x7f70bc0c5300 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f70bc0c2130 tx=0x7f70b001c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d7d3ba27bb7b3f6 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:59:30.380 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:30.375+0000 7f70baffd640 1 -- 172.21.15.78:0/3830762082 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70b00aa430 con 0x7f70bc0c3b80 2023-11-28T19:59:30.380 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:30.375+0000 7f70baffd640 1 -- 172.21.15.78:0/3830762082 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70b00aa590 con 0x7f70bc0c3b80 2023-11-28T19:59:30.380 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:30.375+0000 7f70baffd640 1 -- 172.21.15.78:0/3830762082 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70b00aa920 con 0x7f70bc0c3b80 2023-11-28T19:59:30.381 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:30.375+0000 7f70c2279640 1 -- 172.21.15.78:0/3830762082 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f70bc0c3b80 msgr2=0x7f70bc0c5300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:30.381 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:30.375+0000 7f70c2279640 1 --2- 172.21.15.78:0/3830762082 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f70bc0c3b80 0x7f70bc0c5300 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f70bc0c2130 tx=0x7f70b001c4d0 comp rx=0 tx=0).stop 2023-11-28T19:59:30.381 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:30.375+0000 7f70c2279640 1 -- 172.21.15.78:0/3830762082 shutdown_connections 2023-11-28T19:59:30.381 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:30.375+0000 7f70c2279640 1 --2- 172.21.15.78:0/3830762082 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f70bc0c3b80 0x7f70bc0c5300 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:30.381 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:30.375+0000 7f70c2279640 1 --2- 172.21.15.78:0/3830762082 >> v2:172.21.15.179:3300/0 conn(0x7f70bc06d2b0 0x7f70bc06d690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:30.381 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:30.375+0000 7f70c2279640 1 -- 172.21.15.78:0/3830762082 >> 172.21.15.78:0/3830762082 conn(0x7f70bc0a7810 msgr2=0x7f70bc0a7c20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T19:59:30.381 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:30.375+0000 7f70c2279640 1 -- 172.21.15.78:0/3830762082 shutdown_connections 2023-11-28T19:59:30.381 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:30.375+0000 7f70c2279640 1 -- 172.21.15.78:0/3830762082 wait complete. 2023-11-28T19:59:30.382 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:30.375+0000 7f70c2279640 1 Processor -- start 2023-11-28T19:59:30.382 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:30.375+0000 7f70c2279640 1 -- start start 2023-11-28T19:59:30.384 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:30.379+0000 7f70c2279640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f70bc06c020 0x7f70bc15a8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:30.384 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:30.379+0000 7f70c2279640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f70bc06d2b0 0x7f70bc15cd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:30.384 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:30.379+0000 7f70c2279640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f70bc0c3b80 0x7f70bc145ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:30.384 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:30.379+0000 7f70c2279640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70bc15da20 con 0x7f70bc06c020 2023-11-28T19:59:30.384 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:30.379+0000 7f70c2279640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70bc15dd00 con 0x7f70bc0c3b80 2023-11-28T19:59:30.384 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:30.379+0000 7f70c2279640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f70bc15dfe0 con 0x7f70bc06d2b0 2023-11-28T19:59:30.384 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:30.379+0000 7f70bbfff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f70bc06c020 0x7f70bc15a8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:30.385 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:30.379+0000 7f70bbfff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f70bc06c020 0x7f70bc15a8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:53292/0 (socket says 172.21.15.78:53292) 2023-11-28T19:59:30.385 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:30.379+0000 7f70bbfff640 1 -- 172.21.15.78:0/3711563259 learned_addr learned my addr 172.21.15.78:0/3711563259 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T19:59:30.385 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:30.379+0000 7f70bb7fe640 1 --2- 172.21.15.78:0/3711563259 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f70bc06d2b0 0x7f70bc15cd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:30.385 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:30.379+0000 7f70c0816640 1 --2- 172.21.15.78:0/3711563259 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f70bc0c3b80 0x7f70bc145ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:30.385 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:30.379+0000 7f70bbfff640 1 -- 172.21.15.78:0/3711563259 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f70bc06d2b0 msgr2=0x7f70bc15cd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:30.385 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:30.379+0000 7f70bbfff640 1 --2- 172.21.15.78:0/3711563259 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f70bc06d2b0 0x7f70bc15cd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:30.385 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:30.379+0000 7f70bbfff640 1 -- 172.21.15.78:0/3711563259 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f70bc0c3b80 msgr2=0x7f70bc145ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:30.385 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:30.379+0000 7f70bbfff640 1 --2- 172.21.15.78:0/3711563259 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f70bc0c3b80 0x7f70bc145ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:30.385 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:30.379+0000 7f70bbfff640 1 -- 172.21.15.78:0/3711563259 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70b00094d0 con 0x7f70bc06c020 2023-11-28T19:59:30.385 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:30.379+0000 7f70c0816640 1 --2- 172.21.15.78:0/3711563259 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f70bc0c3b80 0x7f70bc145ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T19:59:30.385 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:30.379+0000 7f70bbfff640 1 --2- 172.21.15.78:0/3711563259 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f70bc06c020 0x7f70bc15a8d0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f70ac00e930 tx=0x7f70ac00edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:59:30.386 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:30.379+0000 7f70b8ff9640 1 -- 172.21.15.78:0/3711563259 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70ac009690 con 0x7f70bc06c020 2023-11-28T19:59:30.387 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:30.379+0000 7f70b8ff9640 1 -- 172.21.15.78:0/3711563259 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70ac00ca00 con 0x7f70bc06c020 2023-11-28T19:59:30.387 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:30.379+0000 7f70c2279640 1 -- 172.21.15.78:0/3711563259 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f70bc14ef80 con 0x7f70bc06c020 2023-11-28T19:59:30.387 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:30.379+0000 7f70b8ff9640 1 -- 172.21.15.78:0/3711563259 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70ac00cd70 con 0x7f70bc06c020 2023-11-28T19:59:30.387 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:30.379+0000 7f70c2279640 1 -- 172.21.15.78:0/3711563259 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f70bc15e2c0 con 0x7f70bc06c020 2023-11-28T19:59:30.387 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:30.379+0000 7f70c2279640 1 -- 172.21.15.78:0/3711563259 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f70bc067630 con 0x7f70bc06c020 2023-11-28T19:59:30.387 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:30.379+0000 7f70b8ff9640 1 -- 172.21.15.78:0/3711563259 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f70ac013470 con 0x7f70bc06c020 2023-11-28T19:59:30.388 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:30.383+0000 7f70b8ff9640 1 --2- 172.21.15.78:0/3711563259 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f70a8066470 0x7f70a8068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:30.388 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:30.383+0000 7f70b8ff9640 1 -- 172.21.15.78:0/3711563259 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f70ac084330 con 0x7f70bc06c020 2023-11-28T19:59:30.388 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:30.383+0000 7f70bb7fe640 1 --2- 172.21.15.78:0/3711563259 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f70a8066470 0x7f70a8068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:30.388 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:30.383+0000 7f70bb7fe640 1 --2- 172.21.15.78:0/3711563259 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f70a8066470 0x7f70a8068930 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f70b00ae000 tx=0x7f70b00a7000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:59:30.391 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:30.387+0000 7f70b8ff9640 1 -- 172.21.15.78:0/3711563259 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f70ac051610 con 0x7f70bc06c020 2023-11-28T19:59:30.547 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:30.539+0000 7f70c2279640 1 -- 172.21.15.78:0/3711563259 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f70bc06bd70 con 0x7f70bc06c020 2023-11-28T19:59:30.548 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:30.543+0000 7f70b8ff9640 1 -- 172.21.15.78:0/3711563259 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+18322 (secure 0 0 0) 0x7f70ac054c30 con 0x7f70bc06c020 2023-11-28T19:59:30.548 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-11-28T19:59:30.548 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":25,"fsid":"dd9780e8-3bda-44fa-a9f0-fa07d19d901d","created":"2023-11-28T19:58:40.969556+0000","modified":"2023-11-28T19:59:10.474525+0000","last_up_change":"2023-11-28T19:58:52.596716+0000","last_in_change":"2023-11-28T19:58:43.609275+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-28T19:58:54.011229+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-28T19:59:03.945559+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-28T19:59:04.481478+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-11-28T19:59:08.109152+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"e84245ac-b5da-429e-af18-39acaa2b33e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6800","nonce":3358701235},{"type":"v1","addr":"172.21.15.78:6801","nonce":3358701235}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6802","nonce":3358701235},{"type":"v1","addr":"172.21.15.78:6803","nonce":3358701235}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6806","nonce":3358701235},{"type":"v1","addr":"172.21.15.78:6807","nonce":3358701235}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6804","nonce":3358701235},{"type":"v1","addr":"172.21.15.78:6805","nonce":3358701235}]},"public_addr":"172.21.15.78:6801/3358701235","cluster_addr":"172.21.15.78:6803/3358701235","heartbeat_back_addr":"172.21.15.78:6807/3358701235","heartbeat_front_addr":"172.21.15.78:6805/3358701235","state":["exists","up"]},{"osd":1,"uuid":"e634831d-c4e2-48d9-870c-9556ae162981","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6808","nonce":3211476654},{"type":"v1","addr":"172.21.15.78:6809","nonce":3211476654}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6810","nonce":3211476654},{"type":"v1","addr":"172.21.15.78:6811","nonce":3211476654}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6814","nonce":3211476654},{"type":"v1","addr":"172.21.15.78:6815","nonce":3211476654}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6812","nonce":3211476654},{"type":"v1","addr":"172.21.15.78:6813","nonce":3211476654}]},"public_addr":"172.21.15.78:6809/3211476654","cluster_addr":"172.21.15.78:6811/3211476654","heartbeat_back_addr":"172.21.15.78:6815/3211476654","heartbeat_front_addr":"172.21.15.78:6813/3211476654","state":["exists","up"]},{"osd":2,"uuid":"274c8395-6534-41f0-b8fb-a00af8985aa8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6816","nonce":2532904479},{"type":"v1","addr":"172.21.15.78:6817","nonce":2532904479}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6818","nonce":2532904479},{"type":"v1","addr":"172.21.15.78:6819","nonce":2532904479}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6822","nonce":2532904479},{"type":"v1","addr":"172.21.15.78:6823","nonce":2532904479}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6820","nonce":2532904479},{"type":"v1","addr":"172.21.15.78:6821","nonce":2532904479}]},"public_addr":"172.21.15.78:6817/2532904479","cluster_addr":"172.21.15.78:6819/2532904479","heartbeat_back_addr":"172.21.15.78:6823/2532904479","heartbeat_front_addr":"172.21.15.78:6821/2532904479","state":["exists","up"]},{"osd":3,"uuid":"77acc9af-7d4d-4b18-8cf5-d62f5971b7c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6824","nonce":3442991267},{"type":"v1","addr":"172.21.15.78:6825","nonce":3442991267}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6826","nonce":3442991267},{"type":"v1","addr":"172.21.15.78:6827","nonce":3442991267}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6830","nonce":3442991267},{"type":"v1","addr":"172.21.15.78:6831","nonce":3442991267}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6828","nonce":3442991267},{"type":"v1","addr":"172.21.15.78:6829","nonce":3442991267}]},"public_addr":"172.21.15.78:6825/3442991267","cluster_addr":"172.21.15.78:6827/3442991267","heartbeat_back_addr":"172.21.15.78:6831/3442991267","heartbeat_front_addr":"172.21.15.78:6829/3442991267","state":["exists","up"]},{"osd":4,"uuid":"5c62bc66-6b34-4b7f-a66b-9a743969138c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":802983577},{"type":"v1","addr":"172.21.15.179:6809","nonce":802983577}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":802983577},{"type":"v1","addr":"172.21.15.179:6811","nonce":802983577}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":802983577},{"type":"v1","addr":"172.21.15.179:6815","nonce":802983577}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":802983577},{"type":"v1","addr":"172.21.15.179:6813","nonce":802983577}]},"public_addr":"172.21.15.179:6809/802983577","cluster_addr":"172.21.15.179:6811/802983577","heartbeat_back_addr":"172.21.15.179:6815/802983577","heartbeat_front_addr":"172.21.15.179:6813/802983577","state":["exists","up"]},{"osd":5,"uuid":"67db6d36-f684-4079-b0cd-82b4dd61461f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":518192887},{"type":"v1","addr":"172.21.15.179:6818","nonce":518192887}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":518192887},{"type":"v1","addr":"172.21.15.179:6822","nonce":518192887}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":518192887},{"type":"v1","addr":"172.21.15.179:6829","nonce":518192887}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6824","nonce":518192887},{"type":"v1","addr":"172.21.15.179:6826","nonce":518192887}]},"public_addr":"172.21.15.179:6818/518192887","cluster_addr":"172.21.15.179:6822/518192887","heartbeat_back_addr":"172.21.15.179:6829/518192887","heartbeat_front_addr":"172.21.15.179:6826/518192887","state":["exists","up"]},{"osd":6,"uuid":"12e670af-5a16-4c81-9f97-defa66cab967","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":815435378},{"type":"v1","addr":"172.21.15.179:6801","nonce":815435378}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":815435378},{"type":"v1","addr":"172.21.15.179:6803","nonce":815435378}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":815435378},{"type":"v1","addr":"172.21.15.179:6807","nonce":815435378}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":815435378},{"type":"v1","addr":"172.21.15.179:6805","nonce":815435378}]},"public_addr":"172.21.15.179:6801/815435378","cluster_addr":"172.21.15.179:6803/815435378","heartbeat_back_addr":"172.21.15.179:6807/815435378","heartbeat_front_addr":"172.21.15.179:6805/815435378","state":["exists","up"]},{"osd":7,"uuid":"fe630650-2eb3-49ad-8676-c341e6332eb1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6817","nonce":2848432339},{"type":"v1","addr":"172.21.15.179:6819","nonce":2848432339}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6821","nonce":2848432339},{"type":"v1","addr":"172.21.15.179:6823","nonce":2848432339}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":2848432339},{"type":"v1","addr":"172.21.15.179:6831","nonce":2848432339}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6825","nonce":2848432339},{"type":"v1","addr":"172.21.15.179:6827","nonce":2848432339}]},"public_addr":"172.21.15.179:6819/2848432339","cluster_addr":"172.21.15.179:6823/2848432339","heartbeat_back_addr":"172.21.15.179:6831/2848432339","heartbeat_front_addr":"172.21.15.179:6827/2848432339","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:58:49.255433+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:58:49.412880+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:58:49.559295+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:58:49.245237+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:58:49.184557+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:58:49.329851+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:58:49.366012+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:58:49.349604+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-28T19:59:30.550 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:30.543+0000 7f70c2279640 1 -- 172.21.15.78:0/3711563259 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f70a8066470 msgr2=0x7f70a8068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:30.550 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:30.543+0000 7f70c2279640 1 --2- 172.21.15.78:0/3711563259 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f70a8066470 0x7f70a8068930 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f70b00ae000 tx=0x7f70b00a7000 comp rx=0 tx=0).stop 2023-11-28T19:59:30.550 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:30.543+0000 7f70c2279640 1 -- 172.21.15.78:0/3711563259 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f70bc06c020 msgr2=0x7f70bc15a8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:30.550 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:30.543+0000 7f70c2279640 1 --2- 172.21.15.78:0/3711563259 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f70bc06c020 0x7f70bc15a8d0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f70ac00e930 tx=0x7f70ac00edf0 comp rx=0 tx=0).stop 2023-11-28T19:59:30.550 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:30.543+0000 7f70c2279640 1 -- 172.21.15.78:0/3711563259 shutdown_connections 2023-11-28T19:59:30.550 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:30.543+0000 7f70c2279640 1 --2- 172.21.15.78:0/3711563259 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f70a8066470 0x7f70a8068930 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:30.550 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:30.543+0000 7f70c2279640 1 --2- 172.21.15.78:0/3711563259 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f70bc06d2b0 0x7f70bc15cd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:30.551 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:30.543+0000 7f70c2279640 1 --2- 172.21.15.78:0/3711563259 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f70bc0c3b80 0x7f70bc145ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:30.551 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:30.543+0000 7f70c2279640 1 --2- 172.21.15.78:0/3711563259 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f70bc06c020 0x7f70bc15a8d0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:30.551 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:30.543+0000 7f70c2279640 1 -- 172.21.15.78:0/3711563259 >> 172.21.15.78:0/3711563259 conn(0x7f70bc0a7810 msgr2=0x7f70bc0a7bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T19:59:30.551 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:30.543+0000 7f70c2279640 1 -- 172.21.15.78:0/3711563259 shutdown_connections 2023-11-28T19:59:30.551 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:30.543+0000 7f70c2279640 1 -- 172.21.15.78:0/3711563259 wait complete. 2023-11-28T19:59:30.570 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-28T19:58:54.011229+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-28T19:59:03.945559+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-11-28T19:59:04.481478+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-11-28T19:59:08.109152+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-11-28T19:59:30.570 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-28T19:59:30.710 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:30.703+0000 7f80d9fe6640 1 Processor -- start 2023-11-28T19:59:30.710 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:30.703+0000 7f80d9fe6640 1 -- start start 2023-11-28T19:59:30.711 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:30.703+0000 7f80d9fe6640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f80d414b1e0 0x7f80d40c1700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:30.711 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:30.707+0000 7f80d9fe6640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f80d41548c0 0x7f80d4154d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:30.712 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:30.707+0000 7f80d9fe6640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f80d40a4e20 con 0x7f80d40c5300 2023-11-28T19:59:30.712 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:30.707+0000 7f80d9fe6640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f80d40a50e0 con 0x7f80d414b1e0 2023-11-28T19:59:30.712 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:30.707+0000 7f80d9fe6640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f80d40c0f00 con 0x7f80d41548c0 2023-11-28T19:59:30.712 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:30.707+0000 7f80d37fe640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f80d414b1e0 0x7f80d40c1700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:30.712 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:30.707+0000 7f80d37fe640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f80d414b1e0 0x7f80d40c1700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:53300/0 (socket says 172.21.15.78:53300) 2023-11-28T19:59:30.712 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:30.707+0000 7f80d37fe640 1 -- 172.21.15.78:0/765970050 learned_addr learned my addr 172.21.15.78:0/765970050 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T19:59:30.712 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:30.707+0000 7f80d3fff640 1 --2- 172.21.15.78:0/765970050 >> v2:172.21.15.179:3300/0 conn(0x7f80d41548c0 0x7f80d4154d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:30.712 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:30.707+0000 7f80d37fe640 1 -- 172.21.15.78:0/765970050 >> v2:172.21.15.179:3300/0 conn(0x7f80d41548c0 msgr2=0x7f80d4154d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T19:59:30.712 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:30.707+0000 7f80d37fe640 1 --2- 172.21.15.78:0/765970050 >> v2:172.21.15.179:3300/0 conn(0x7f80d41548c0 0x7f80d4154d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:30.712 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:30.707+0000 7f80d37fe640 1 -- 172.21.15.78:0/765970050 >> v1:172.21.15.179:6789/0 conn(0x7f80d40c5300 legacy=0x7f80d40a9c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T19:59:30.712 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:30.707+0000 7f80d37fe640 1 -- 172.21.15.78:0/765970050 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80d40c11e0 con 0x7f80d414b1e0 2023-11-28T19:59:30.714 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:30.707+0000 7f80d37fe640 1 --2- 172.21.15.78:0/765970050 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f80d414b1e0 0x7f80d40c1700 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f80d40c5850 tx=0x7f80c401c4c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=75d26e803d6173bf server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:59:30.715 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:30.707+0000 7f80d27fc640 1 -- 172.21.15.78:0/765970050 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80c40ac630 con 0x7f80d414b1e0 2023-11-28T19:59:30.715 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:30.707+0000 7f80d27fc640 1 -- 172.21.15.78:0/765970050 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f80c40ac790 con 0x7f80d414b1e0 2023-11-28T19:59:30.715 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:30.707+0000 7f80d27fc640 1 -- 172.21.15.78:0/765970050 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80c40acb20 con 0x7f80d414b1e0 2023-11-28T19:59:30.716 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:30.711+0000 7f80d9fe6640 1 -- 172.21.15.78:0/765970050 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f80d414b1e0 msgr2=0x7f80d40c1700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:30.716 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:30.711+0000 7f80d9fe6640 1 --2- 172.21.15.78:0/765970050 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f80d414b1e0 0x7f80d40c1700 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f80d40c5850 tx=0x7f80c401c4c0 comp rx=0 tx=0).stop 2023-11-28T19:59:30.716 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:30.711+0000 7f80d9fe6640 1 -- 172.21.15.78:0/765970050 shutdown_connections 2023-11-28T19:59:30.716 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:30.711+0000 7f80d9fe6640 1 --2- 172.21.15.78:0/765970050 >> v2:172.21.15.179:3300/0 conn(0x7f80d41548c0 0x7f80d4154d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:30.716 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:30.711+0000 7f80d9fe6640 1 --2- 172.21.15.78:0/765970050 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f80d414b1e0 0x7f80d40c1700 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:30.716 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:30.711+0000 7f80d9fe6640 1 -- 172.21.15.78:0/765970050 >> 172.21.15.78:0/765970050 conn(0x7f80d40c59f0 msgr2=0x7f80d40c5e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T19:59:30.716 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:30.711+0000 7f80d9fe6640 1 -- 172.21.15.78:0/765970050 shutdown_connections 2023-11-28T19:59:30.716 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:30.711+0000 7f80d9fe6640 1 -- 172.21.15.78:0/765970050 wait complete. 2023-11-28T19:59:30.717 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:30.711+0000 7f80d9fe6640 1 Processor -- start 2023-11-28T19:59:30.717 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:30.711+0000 7f80d9fe6640 1 -- start start 2023-11-28T19:59:30.719 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:30.711+0000 7f80d9fe6640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f80d40c5300 0x7f80d40a5b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:30.719 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:30.711+0000 7f80d9fe6640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f80d414b1e0 0x7f80d40a6c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:30.719 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:30.711+0000 7f80d9fe6640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f80d41548c0 0x7f80d4070490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:30.719 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:30.711+0000 7f80d9fe6640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80d4072c10 con 0x7f80d41548c0 2023-11-28T19:59:30.719 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:30.711+0000 7f80d9fe6640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80d40a60d0 con 0x7f80d414b1e0 2023-11-28T19:59:30.719 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:30.711+0000 7f80d9fe6640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f80d4072690 con 0x7f80d40c5300 2023-11-28T19:59:30.719 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:30.711+0000 7f80d3fff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f80d41548c0 0x7f80d4070490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:30.719 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:30.711+0000 7f80d3fff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f80d41548c0 0x7f80d4070490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:53304/0 (socket says 172.21.15.78:53304) 2023-11-28T19:59:30.719 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:30.711+0000 7f80d3fff640 1 -- 172.21.15.78:0/1334763762 learned_addr learned my addr 172.21.15.78:0/1334763762 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T19:59:30.720 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:30.711+0000 7f80d37fe640 1 --2- 172.21.15.78:0/1334763762 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f80d40c5300 0x7f80d40a5b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:30.720 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:30.711+0000 7f80d2ffd640 1 --2- 172.21.15.78:0/1334763762 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f80d414b1e0 0x7f80d40a6c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:30.720 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:30.711+0000 7f80d3fff640 1 -- 172.21.15.78:0/1334763762 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f80d40c5300 msgr2=0x7f80d40a5b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:30.720 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:30.711+0000 7f80d3fff640 1 --2- 172.21.15.78:0/1334763762 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f80d40c5300 0x7f80d40a5b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:30.720 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:30.715+0000 7f80d3fff640 1 -- 172.21.15.78:0/1334763762 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f80d414b1e0 msgr2=0x7f80d40a6c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:30.720 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:30.715+0000 7f80d3fff640 1 --2- 172.21.15.78:0/1334763762 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f80d414b1e0 0x7f80d40a6c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:30.720 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:30.715+0000 7f80d3fff640 1 -- 172.21.15.78:0/1334763762 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80c40094d0 con 0x7f80d41548c0 2023-11-28T19:59:30.720 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:30.715+0000 7f80d3fff640 1 --2- 172.21.15.78:0/1334763762 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f80d41548c0 0x7f80d4070490 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f80cc007e90 tx=0x7f80cc00e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:59:30.721 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:30.715+0000 7f80bbfff640 1 -- 172.21.15.78:0/1334763762 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80cc014420 con 0x7f80d41548c0 2023-11-28T19:59:30.721 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:30.715+0000 7f80bbfff640 1 -- 172.21.15.78:0/1334763762 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f80cc014580 con 0x7f80d41548c0 2023-11-28T19:59:30.721 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:30.715+0000 7f80d9fe6640 1 -- 172.21.15.78:0/1334763762 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f80d40a7190 con 0x7f80d41548c0 2023-11-28T19:59:30.721 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:30.715+0000 7f80bbfff640 1 -- 172.21.15.78:0/1334763762 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80cc014930 con 0x7f80d41548c0 2023-11-28T19:59:30.721 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:30.715+0000 7f80d9fe6640 1 -- 172.21.15.78:0/1334763762 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f80d4072930 con 0x7f80d41548c0 2023-11-28T19:59:30.722 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:30.715+0000 7f80d9fe6640 1 -- 172.21.15.78:0/1334763762 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f80d4067630 con 0x7f80d41548c0 2023-11-28T19:59:30.722 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:30.715+0000 7f80bbfff640 1 -- 172.21.15.78:0/1334763762 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f80cc014a90 con 0x7f80d41548c0 2023-11-28T19:59:30.722 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:30.715+0000 7f80bbfff640 1 --2- 172.21.15.78:0/1334763762 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f80c0066470 0x7f80c0068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:30.722 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:30.715+0000 7f80bbfff640 1 -- 172.21.15.78:0/1334763762 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f80cc0849b0 con 0x7f80d41548c0 2023-11-28T19:59:30.722 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:30.715+0000 7f80d37fe640 1 --2- 172.21.15.78:0/1334763762 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f80c0066470 0x7f80c0068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:30.723 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:30.719+0000 7f80d37fe640 1 --2- 172.21.15.78:0/1334763762 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f80c0066470 0x7f80c0068930 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f80c40ae000 tx=0x7f80c40a7000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:59:30.726 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:30.719+0000 7f80bbfff640 1 -- 172.21.15.78:0/1334763762 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f80cc051b50 con 0x7f80d41548c0 2023-11-28T19:59:30.877 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:30.871+0000 7f80d9fe6640 1 -- 172.21.15.78:0/1334763762 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f80d40ab5b0 con 0x7f80d41548c0 2023-11-28T19:59:30.877 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:30.871+0000 7f80bbfff640 1 -- 172.21.15.78:0/1334763762 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v25) v1 ==== 93+0+10 (secure 0 0 0) 0x7f80cc055170 con 0x7f80d41548c0 2023-11-28T19:59:30.877 INFO:teuthology.orchestra.run.smithi078.stdout:pg_num: 1 2023-11-28T19:59:30.879 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:30.871+0000 7f80d9fe6640 1 -- 172.21.15.78:0/1334763762 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f80c0066470 msgr2=0x7f80c0068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:30.879 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:30.871+0000 7f80d9fe6640 1 --2- 172.21.15.78:0/1334763762 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f80c0066470 0x7f80c0068930 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f80c40ae000 tx=0x7f80c40a7000 comp rx=0 tx=0).stop 2023-11-28T19:59:30.879 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:30.875+0000 7f80d9fe6640 1 -- 172.21.15.78:0/1334763762 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f80d41548c0 msgr2=0x7f80d4070490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:30.879 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:30.875+0000 7f80d9fe6640 1 --2- 172.21.15.78:0/1334763762 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f80d41548c0 0x7f80d4070490 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f80cc007e90 tx=0x7f80cc00e4b0 comp rx=0 tx=0).stop 2023-11-28T19:59:30.879 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:30.875+0000 7f80d9fe6640 1 -- 172.21.15.78:0/1334763762 shutdown_connections 2023-11-28T19:59:30.879 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:30.875+0000 7f80d9fe6640 1 --2- 172.21.15.78:0/1334763762 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f80c0066470 0x7f80c0068930 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:30.880 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:30.875+0000 7f80d9fe6640 1 --2- 172.21.15.78:0/1334763762 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f80d41548c0 0x7f80d4070490 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:30.880 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:30.875+0000 7f80d9fe6640 1 --2- 172.21.15.78:0/1334763762 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f80d414b1e0 0x7f80d40a6c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:30.880 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:30.875+0000 7f80d9fe6640 1 --2- 172.21.15.78:0/1334763762 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f80d40c5300 0x7f80d40a5b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:30.880 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:30.875+0000 7f80d9fe6640 1 -- 172.21.15.78:0/1334763762 >> 172.21.15.78:0/1334763762 conn(0x7f80d40c59f0 msgr2=0x7f80d41540f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T19:59:30.880 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:30.875+0000 7f80d9fe6640 1 -- 172.21.15.78:0/1334763762 shutdown_connections 2023-11-28T19:59:30.880 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:30.875+0000 7f80d9fe6640 1 -- 172.21.15.78:0/1334763762 wait complete. 2023-11-28T19:59:30.898 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-28T19:59:31.038 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:31.031+0000 7f1cc0e6b640 1 Processor -- start 2023-11-28T19:59:31.038 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:31.031+0000 7f1cc0e6b640 1 -- start start 2023-11-28T19:59:31.039 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:31.035+0000 7f1cc0e6b640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1cbc06d840 0x7f1cbc0c43e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:31.040 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:31.035+0000 7f1cc0e6b640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1cbc152910 con 0x7f1cbc14fc30 2023-11-28T19:59:31.040 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:31.035+0000 7f1cc0e6b640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1cbc152bf0 con 0x7f1cbc14f850 2023-11-28T19:59:31.040 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:31.035+0000 7f1cc0e6b640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1cbc0c2240 con 0x7f1cbc06d840 2023-11-28T19:59:31.040 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:31.035+0000 7f1cb1d9b640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f1cbc14fc30 0x7f1cbc0c3cd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:54050/0 (socket says 172.21.15.78:54050) 2023-11-28T19:59:31.040 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:31.035+0000 7f1cb1d9b640 1 -- 172.21.15.78:0/901126916 learned_addr learned my addr 172.21.15.78:0/901126916 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-11-28T19:59:31.040 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:31.035+0000 7f1cbad9d640 1 --2- 172.21.15.78:0/901126916 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1cbc06d840 0x7f1cbc0c43e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:31.041 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:31.035+0000 7f1cb9d9b640 1 -- 172.21.15.78:0/901126916 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2625244932 0 0) 0x7f1cbc152910 con 0x7f1cbc14fc30 2023-11-28T19:59:31.041 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:31.035+0000 7f1cb9d9b640 1 -- 172.21.15.78:0/901126916 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1ca8003530 con 0x7f1cbc14fc30 2023-11-28T19:59:31.041 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:31.035+0000 7f1cb9d9b640 1 -- 172.21.15.78:0/901126916 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4089917447 0 0) 0x7f1cbc152bf0 con 0x7f1cbc14f850 2023-11-28T19:59:31.041 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:31.035+0000 7f1cb9d9b640 1 -- 172.21.15.78:0/901126916 --> v1:172.21.15.179:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1cbc152910 con 0x7f1cbc14f850 2023-11-28T19:59:31.041 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:31.035+0000 7f1cbad9d640 1 -- 172.21.15.78:0/901126916 >> v1:172.21.15.179:6789/0 conn(0x7f1cbc14f850 legacy=0x7f1cbc0aacf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:31.041 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:31.035+0000 7f1cbad9d640 1 -- 172.21.15.78:0/901126916 >> v1:172.21.15.78:6789/0 conn(0x7f1cbc14fc30 legacy=0x7f1cbc0c3cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:31.041 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:31.035+0000 7f1cbad9d640 1 -- 172.21.15.78:0/901126916 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1cbc152ed0 con 0x7f1cbc06d840 2023-11-28T19:59:31.043 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:31.039+0000 7f1cbad9d640 1 --2- 172.21.15.78:0/901126916 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1cbc06d840 0x7f1cbc0c43e0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f1cb40097f0 tx=0x7f1cb401c4c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=22d84f91c33f1b99 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:59:31.044 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:31.039+0000 7f1cb9d9b640 1 -- 172.21.15.78:0/901126916 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cb40aa640 con 0x7f1cbc06d840 2023-11-28T19:59:31.044 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:31.039+0000 7f1cb9d9b640 1 -- 172.21.15.78:0/901126916 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1cb40aa7a0 con 0x7f1cbc06d840 2023-11-28T19:59:31.044 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:31.039+0000 7f1cb9d9b640 1 -- 172.21.15.78:0/901126916 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cb40aab30 con 0x7f1cbc06d840 2023-11-28T19:59:31.044 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:31.039+0000 7f1cc0e6b640 1 -- 172.21.15.78:0/901126916 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1cbc06d840 msgr2=0x7f1cbc0c43e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:31.044 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:31.039+0000 7f1cc0e6b640 1 --2- 172.21.15.78:0/901126916 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1cbc06d840 0x7f1cbc0c43e0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f1cb40097f0 tx=0x7f1cb401c4c0 comp rx=0 tx=0).stop 2023-11-28T19:59:31.044 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:31.039+0000 7f1cc0e6b640 1 -- 172.21.15.78:0/901126916 shutdown_connections 2023-11-28T19:59:31.045 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:31.039+0000 7f1cc0e6b640 1 --2- 172.21.15.78:0/901126916 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1cbc06d840 0x7f1cbc0c43e0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:31.045 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:31.039+0000 7f1cc0e6b640 1 -- 172.21.15.78:0/901126916 >> 172.21.15.78:0/901126916 conn(0x7f1cbc0c59f0 msgr2=0x7f1cbc0c5e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T19:59:31.045 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:31.039+0000 7f1cc0e6b640 1 -- 172.21.15.78:0/901126916 shutdown_connections 2023-11-28T19:59:31.045 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:31.039+0000 7f1cc0e6b640 1 -- 172.21.15.78:0/901126916 wait complete. 2023-11-28T19:59:31.046 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:31.039+0000 7f1cc0e6b640 1 Processor -- start 2023-11-28T19:59:31.046 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:31.039+0000 7f1cc0e6b640 1 -- start start 2023-11-28T19:59:31.048 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:31.043+0000 7f1cc0e6b640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1cbc06d840 0x7f1cbc0aa150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:31.048 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:31.043+0000 7f1cc0e6b640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1cbc14f850 0x7f1cbc0a95c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:31.048 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:31.043+0000 7f1cc0e6b640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1cbc14fc30 0x7f1cbc1ed840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:31.049 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:31.043+0000 7f1cc0e6b640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1cbc0a9b00 con 0x7f1cbc14f850 2023-11-28T19:59:31.049 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:31.043+0000 7f1cc0e6b640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1cbc1edd80 con 0x7f1cbc14fc30 2023-11-28T19:59:31.049 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:31.043+0000 7f1cc0e6b640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1cbc0aa730 con 0x7f1cbc06d840 2023-11-28T19:59:31.049 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:31.043+0000 7f1cb1d9b640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1cbc14f850 0x7f1cbc0a95c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:31.049 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:31.043+0000 7f1cb1d9b640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1cbc14f850 0x7f1cbc0a95c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:53312/0 (socket says 172.21.15.78:53312) 2023-11-28T19:59:31.049 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:31.043+0000 7f1cb1d9b640 1 -- 172.21.15.78:0/2716865002 learned_addr learned my addr 172.21.15.78:0/2716865002 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T19:59:31.049 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:31.043+0000 7f1cba59c640 1 --2- 172.21.15.78:0/2716865002 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1cbc06d840 0x7f1cbc0aa150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:31.049 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:31.043+0000 7f1cbad9d640 1 --2- 172.21.15.78:0/2716865002 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1cbc14fc30 0x7f1cbc1ed840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:31.049 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:31.043+0000 7f1cb1d9b640 1 -- 172.21.15.78:0/2716865002 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1cbc06d840 msgr2=0x7f1cbc0aa150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:31.049 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:31.043+0000 7f1cb1d9b640 1 --2- 172.21.15.78:0/2716865002 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1cbc06d840 0x7f1cbc0aa150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:31.049 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:31.043+0000 7f1cb1d9b640 1 -- 172.21.15.78:0/2716865002 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1cbc14fc30 msgr2=0x7f1cbc1ed840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:31.050 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:31.043+0000 7f1cb1d9b640 1 --2- 172.21.15.78:0/2716865002 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1cbc14fc30 0x7f1cbc1ed840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:31.050 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:31.043+0000 7f1cb1d9b640 1 -- 172.21.15.78:0/2716865002 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1cb4009420 con 0x7f1cbc14f850 2023-11-28T19:59:31.050 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:31.043+0000 7f1cb1d9b640 1 --2- 172.21.15.78:0/2716865002 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1cbc14f850 0x7f1cbc0a95c0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f1ca400c410 tx=0x7f1ca400c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:59:31.050 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:31.043+0000 7f1cb37fe640 1 -- 172.21.15.78:0/2716865002 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ca4005cf0 con 0x7f1cbc14f850 2023-11-28T19:59:31.050 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:31.043+0000 7f1cb37fe640 1 -- 172.21.15.78:0/2716865002 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ca4005e50 con 0x7f1cbc14f850 2023-11-28T19:59:31.050 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:31.043+0000 7f1cb37fe640 1 -- 172.21.15.78:0/2716865002 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ca40072d0 con 0x7f1cbc14f850 2023-11-28T19:59:31.050 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:31.043+0000 7f1cc0e6b640 1 -- 172.21.15.78:0/2716865002 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1cbc0aaa10 con 0x7f1cbc14f850 2023-11-28T19:59:31.050 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:31.043+0000 7f1cc0e6b640 1 -- 172.21.15.78:0/2716865002 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1cbc0a8dc0 con 0x7f1cbc14f850 2023-11-28T19:59:31.051 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:31.043+0000 7f1cc0e6b640 1 -- 172.21.15.78:0/2716865002 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1cbc0a4a90 con 0x7f1cbc14f850 2023-11-28T19:59:31.051 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:31.043+0000 7f1cb37fe640 1 -- 172.21.15.78:0/2716865002 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f1ca4007430 con 0x7f1cbc14f850 2023-11-28T19:59:31.051 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:31.047+0000 7f1cb37fe640 1 --2- 172.21.15.78:0/2716865002 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f1c9c066470 0x7f1c9c068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:31.051 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:31.047+0000 7f1cb37fe640 1 -- 172.21.15.78:0/2716865002 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f1ca4083630 con 0x7f1cbc14f850 2023-11-28T19:59:31.052 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:31.047+0000 7f1cba59c640 1 --2- 172.21.15.78:0/2716865002 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f1c9c066470 0x7f1c9c068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:31.052 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:31.047+0000 7f1cba59c640 1 --2- 172.21.15.78:0/2716865002 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f1c9c066470 0x7f1c9c068930 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f1cac007fd0 tx=0x7f1cac009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:59:31.055 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:31.051+0000 7f1cb37fe640 1 -- 172.21.15.78:0/2716865002 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f1ca4054310 con 0x7f1cbc14f850 2023-11-28T19:59:31.205 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:31.199+0000 7f1cc0e6b640 1 -- 172.21.15.78:0/2716865002 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f1cbc067610 con 0x7f1cbc14f850 2023-11-28T19:59:31.234 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:31.199+0000 7f1cb37fe640 1 -- 172.21.15.78:0/2716865002 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v25) v1 ==== 104+0+11 (secure 0 0 0) 0x7f1ca4053ea0 con 0x7f1cbc14f850 2023-11-28T19:59:31.235 INFO:teuthology.orchestra.run.smithi078.stdout:pg_num: 32 2023-11-28T19:59:31.236 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:31.203+0000 7f1cc0e6b640 1 -- 172.21.15.78:0/2716865002 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f1c9c066470 msgr2=0x7f1c9c068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:31.236 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:31.203+0000 7f1cc0e6b640 1 --2- 172.21.15.78:0/2716865002 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f1c9c066470 0x7f1c9c068930 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f1cac007fd0 tx=0x7f1cac009040 comp rx=0 tx=0).stop 2023-11-28T19:59:31.236 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:31.203+0000 7f1cc0e6b640 1 -- 172.21.15.78:0/2716865002 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1cbc14f850 msgr2=0x7f1cbc0a95c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:31.236 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:31.203+0000 7f1cc0e6b640 1 --2- 172.21.15.78:0/2716865002 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1cbc14f850 0x7f1cbc0a95c0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f1ca400c410 tx=0x7f1ca400c8d0 comp rx=0 tx=0).stop 2023-11-28T19:59:31.237 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:31.203+0000 7f1cc0e6b640 1 -- 172.21.15.78:0/2716865002 shutdown_connections 2023-11-28T19:59:31.237 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:31.203+0000 7f1cc0e6b640 1 --2- 172.21.15.78:0/2716865002 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f1c9c066470 0x7f1c9c068930 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:31.237 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:31.203+0000 7f1cc0e6b640 1 --2- 172.21.15.78:0/2716865002 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1cbc14fc30 0x7f1cbc1ed840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:31.237 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:31.203+0000 7f1cc0e6b640 1 --2- 172.21.15.78:0/2716865002 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1cbc14f850 0x7f1cbc0a95c0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:31.237 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:31.203+0000 7f1cc0e6b640 1 --2- 172.21.15.78:0/2716865002 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1cbc06d840 0x7f1cbc0aa150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:31.237 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:31.203+0000 7f1cc0e6b640 1 -- 172.21.15.78:0/2716865002 >> 172.21.15.78:0/2716865002 conn(0x7f1cbc0c59f0 msgr2=0x7f1cbc151750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T19:59:31.237 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:31.203+0000 7f1cc0e6b640 1 -- 172.21.15.78:0/2716865002 shutdown_connections 2023-11-28T19:59:31.237 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:31.203+0000 7f1cc0e6b640 1 -- 172.21.15.78:0/2716865002 wait complete. 2023-11-28T19:59:31.238 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-28T19:59:31.377 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:31.371+0000 7f8bb3cfd640 1 Processor -- start 2023-11-28T19:59:31.377 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:31.371+0000 7f8bb3cfd640 1 -- start start 2023-11-28T19:59:31.378 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:31.371+0000 7f8bb3cfd640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f8bac14e2a0 0x7f8bac1516a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:31.378 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:31.371+0000 7f8bb3cfd640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8bac0a9460 0x7f8bac0c4180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:31.378 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:31.371+0000 7f8bb3cfd640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8bac151210 con 0x7f8bac0a98e0 2023-11-28T19:59:31.379 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:31.371+0000 7f8bb3cfd640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8bac14e680 con 0x7f8bac14e2a0 2023-11-28T19:59:31.379 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:31.371+0000 7f8bb3cfd640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8bac150be0 con 0x7f8bac0a9460 2023-11-28T19:59:31.379 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:31.371+0000 7f8bb229a640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f8bac0a98e0 0x7f8bac06bc80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:54066/0 (socket says 172.21.15.78:54066) 2023-11-28T19:59:31.379 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:31.371+0000 7f8bb229a640 1 -- 172.21.15.78:0/2957909735 learned_addr learned my addr 172.21.15.78:0/2957909735 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-11-28T19:59:31.379 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:31.371+0000 7f8bb1298640 1 --2- 172.21.15.78:0/2957909735 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8bac0a9460 0x7f8bac0c4180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:31.379 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:31.371+0000 7f8bb1a99640 1 --2- 172.21.15.78:0/2957909735 >> v2:172.21.15.179:3300/0 conn(0x7f8bac14e2a0 0x7f8bac1516a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:31.380 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:31.375+0000 7f8bb0a97640 1 -- 172.21.15.78:0/2957909735 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1097447946 0 0) 0x7f8bac151210 con 0x7f8bac0a98e0 2023-11-28T19:59:31.380 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:31.375+0000 7f8bb0a97640 1 -- 172.21.15.78:0/2957909735 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8b98003530 con 0x7f8bac0a98e0 2023-11-28T19:59:31.380 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:31.375+0000 7f8bb1a99640 1 -- 172.21.15.78:0/2957909735 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8bac0a9460 msgr2=0x7f8bac0c4180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T19:59:31.380 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:31.375+0000 7f8bb1a99640 1 --2- 172.21.15.78:0/2957909735 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8bac0a9460 0x7f8bac0c4180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:31.380 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:31.375+0000 7f8bb1a99640 1 -- 172.21.15.78:0/2957909735 >> v1:172.21.15.78:6789/0 conn(0x7f8bac0a98e0 legacy=0x7f8bac06bc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:31.380 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:31.375+0000 7f8bb1a99640 1 -- 172.21.15.78:0/2957909735 --> v2:172.21.15.179:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8bac0c53c0 con 0x7f8bac14e2a0 2023-11-28T19:59:31.382 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:31.375+0000 7f8bb1a99640 1 --2- 172.21.15.78:0/2957909735 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8bac14e2a0 0x7f8bac1516a0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f8ba800a960 tx=0x7f8ba801d850 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4241d34f5629cc65 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:59:31.384 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:31.375+0000 7f8bb0a97640 1 -- 172.21.15.78:0/2957909735 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ba80a67b0 con 0x7f8bac14e2a0 2023-11-28T19:59:31.385 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:31.375+0000 7f8bb0a97640 1 -- 172.21.15.78:0/2957909735 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ba80a6910 con 0x7f8bac14e2a0 2023-11-28T19:59:31.385 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:31.375+0000 7f8bb0a97640 1 -- 172.21.15.78:0/2957909735 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ba80a6ca0 con 0x7f8bac14e2a0 2023-11-28T19:59:31.385 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:31.379+0000 7f8bb3cfd640 1 -- 172.21.15.78:0/2957909735 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8bac14e2a0 msgr2=0x7f8bac1516a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:31.385 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:31.379+0000 7f8bb3cfd640 1 --2- 172.21.15.78:0/2957909735 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8bac14e2a0 0x7f8bac1516a0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f8ba800a960 tx=0x7f8ba801d850 comp rx=0 tx=0).stop 2023-11-28T19:59:31.385 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:31.379+0000 7f8bb3cfd640 1 -- 172.21.15.78:0/2957909735 shutdown_connections 2023-11-28T19:59:31.386 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:31.379+0000 7f8bb3cfd640 1 --2- 172.21.15.78:0/2957909735 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8bac0a9460 0x7f8bac0c4180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:31.386 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:31.379+0000 7f8bb3cfd640 1 --2- 172.21.15.78:0/2957909735 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8bac14e2a0 0x7f8bac1516a0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:31.386 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:31.379+0000 7f8bb3cfd640 1 -- 172.21.15.78:0/2957909735 >> 172.21.15.78:0/2957909735 conn(0x7f8bac0c59f0 msgr2=0x7f8bac0c5e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T19:59:31.386 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:31.379+0000 7f8bb3cfd640 1 -- 172.21.15.78:0/2957909735 shutdown_connections 2023-11-28T19:59:31.386 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:31.379+0000 7f8bb3cfd640 1 -- 172.21.15.78:0/2957909735 wait complete. 2023-11-28T19:59:31.388 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:31.379+0000 7f8bb3cfd640 1 Processor -- start 2023-11-28T19:59:31.389 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:31.379+0000 7f8bb3cfd640 1 -- start start 2023-11-28T19:59:31.389 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:31.379+0000 7f8bb3cfd640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8bac0a9460 0x7f8bac1ee4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:31.389 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:31.379+0000 7f8bb3cfd640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8bac0a98e0 0x7f8bac0710f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:31.389 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:31.379+0000 7f8bb3cfd640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8bac14e2a0 0x7f8bac1ea3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:31.389 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:31.379+0000 7f8bb3cfd640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8bac152030 con 0x7f8bac14e2a0 2023-11-28T19:59:31.389 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:31.379+0000 7f8bb3cfd640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8bac070650 con 0x7f8bac0a98e0 2023-11-28T19:59:31.389 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:31.379+0000 7f8bb3cfd640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8bac1eea20 con 0x7f8bac0a9460 2023-11-28T19:59:31.389 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:31.379+0000 7f8bb229a640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8bac14e2a0 0x7f8bac1ea3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:31.389 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:31.379+0000 7f8bb229a640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8bac14e2a0 0x7f8bac1ea3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:53324/0 (socket says 172.21.15.78:53324) 2023-11-28T19:59:31.389 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:31.379+0000 7f8bb229a640 1 -- 172.21.15.78:0/2826258279 learned_addr learned my addr 172.21.15.78:0/2826258279 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T19:59:31.389 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:31.379+0000 7f8bb1a99640 1 --2- 172.21.15.78:0/2826258279 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8bac0a9460 0x7f8bac1ee4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:31.390 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:31.379+0000 7f8bb1298640 1 --2- 172.21.15.78:0/2826258279 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8bac0a98e0 0x7f8bac0710f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:31.390 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:31.379+0000 7f8bb229a640 1 -- 172.21.15.78:0/2826258279 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8bac0a9460 msgr2=0x7f8bac1ee4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:31.390 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:31.379+0000 7f8bb229a640 1 --2- 172.21.15.78:0/2826258279 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8bac0a9460 0x7f8bac1ee4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:31.390 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:31.379+0000 7f8bb229a640 1 -- 172.21.15.78:0/2826258279 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8bac0a98e0 msgr2=0x7f8bac0710f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:31.390 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:31.379+0000 7f8bb229a640 1 --2- 172.21.15.78:0/2826258279 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8bac0a98e0 0x7f8bac0710f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:31.390 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:31.379+0000 7f8bb229a640 1 -- 172.21.15.78:0/2826258279 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ba800a5c0 con 0x7f8bac14e2a0 2023-11-28T19:59:31.390 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:31.383+0000 7f8bb229a640 1 --2- 172.21.15.78:0/2826258279 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8bac14e2a0 0x7f8bac1ea3a0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f8ba400cbb0 tx=0x7f8ba400a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:59:31.390 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:31.383+0000 7f8ba27fc640 1 -- 172.21.15.78:0/2826258279 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ba400ad40 con 0x7f8bac14e2a0 2023-11-28T19:59:31.390 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:31.383+0000 7f8ba27fc640 1 -- 172.21.15.78:0/2826258279 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ba4012400 con 0x7f8bac14e2a0 2023-11-28T19:59:31.390 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:31.383+0000 7f8bb3cfd640 1 -- 172.21.15.78:0/2826258279 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8bac071630 con 0x7f8bac14e2a0 2023-11-28T19:59:31.390 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:31.383+0000 7f8ba27fc640 1 -- 172.21.15.78:0/2826258279 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ba400aea0 con 0x7f8bac14e2a0 2023-11-28T19:59:31.391 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:31.383+0000 7f8bb3cfd640 1 -- 172.21.15.78:0/2826258279 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8bac072880 con 0x7f8bac14e2a0 2023-11-28T19:59:31.391 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:31.383+0000 7f8bb3cfd640 1 -- 172.21.15.78:0/2826258279 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8bac0c3300 con 0x7f8bac14e2a0 2023-11-28T19:59:31.391 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:31.383+0000 7f8ba27fc640 1 -- 172.21.15.78:0/2826258279 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f8ba4007070 con 0x7f8bac14e2a0 2023-11-28T19:59:31.391 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:31.383+0000 7f8ba27fc640 1 --2- 172.21.15.78:0/2826258279 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f8b900664a0 0x7f8b90068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:31.392 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:31.383+0000 7f8ba27fc640 1 -- 172.21.15.78:0/2826258279 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f8ba4083fe0 con 0x7f8bac14e2a0 2023-11-28T19:59:31.392 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:31.383+0000 7f8bb1a99640 1 --2- 172.21.15.78:0/2826258279 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f8b900664a0 0x7f8b90068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:31.392 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:31.387+0000 7f8bb1a99640 1 --2- 172.21.15.78:0/2826258279 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f8b900664a0 0x7f8b90068960 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f8ba80b0000 tx=0x7f8ba8008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:59:31.394 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:31.387+0000 7f8ba27fc640 1 -- 172.21.15.78:0/2826258279 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f8bac0c3300 con 0x7f8bac14e2a0 2023-11-28T19:59:31.543 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:31.539+0000 7f8bb3cfd640 1 -- 172.21.15.78:0/2826258279 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f8bac0c3300 con 0x7f8bac14e2a0 2023-11-28T19:59:31.544 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:31.539+0000 7f8ba27fc640 1 -- 172.21.15.78:0/2826258279 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v25) v1 ==== 100+0+11 (secure 0 0 0) 0x7f8bac0c3300 con 0x7f8bac14e2a0 2023-11-28T19:59:31.544 INFO:teuthology.orchestra.run.smithi078.stdout:pg_num: 64 2023-11-28T19:59:31.546 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:31.539+0000 7f8bb3cfd640 1 -- 172.21.15.78:0/2826258279 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f8b900664a0 msgr2=0x7f8b90068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:31.546 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:31.539+0000 7f8bb3cfd640 1 --2- 172.21.15.78:0/2826258279 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f8b900664a0 0x7f8b90068960 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f8ba80b0000 tx=0x7f8ba8008040 comp rx=0 tx=0).stop 2023-11-28T19:59:31.546 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:31.539+0000 7f8bb3cfd640 1 -- 172.21.15.78:0/2826258279 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8bac14e2a0 msgr2=0x7f8bac1ea3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:31.546 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:31.539+0000 7f8bb3cfd640 1 --2- 172.21.15.78:0/2826258279 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8bac14e2a0 0x7f8bac1ea3a0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f8ba400cbb0 tx=0x7f8ba400a430 comp rx=0 tx=0).stop 2023-11-28T19:59:31.546 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:31.539+0000 7f8bb3cfd640 1 -- 172.21.15.78:0/2826258279 shutdown_connections 2023-11-28T19:59:31.546 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:31.539+0000 7f8bb3cfd640 1 --2- 172.21.15.78:0/2826258279 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f8b900664a0 0x7f8b90068960 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:31.546 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:31.539+0000 7f8bb3cfd640 1 --2- 172.21.15.78:0/2826258279 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8bac14e2a0 0x7f8bac1ea3a0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:31.546 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:31.539+0000 7f8bb3cfd640 1 --2- 172.21.15.78:0/2826258279 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8bac0a98e0 0x7f8bac0710f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:31.547 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:31.539+0000 7f8bb3cfd640 1 --2- 172.21.15.78:0/2826258279 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8bac0a9460 0x7f8bac1ee4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:31.547 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:31.539+0000 7f8bb3cfd640 1 -- 172.21.15.78:0/2826258279 >> 172.21.15.78:0/2826258279 conn(0x7f8bac0c59f0 msgr2=0x7f8bac15ab70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T19:59:31.547 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:31.539+0000 7f8bb3cfd640 1 -- 172.21.15.78:0/2826258279 shutdown_connections 2023-11-28T19:59:31.547 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:31.539+0000 7f8bb3cfd640 1 -- 172.21.15.78:0/2826258279 wait complete. 2023-11-28T19:59:31.565 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-11-28T19:59:31.705 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:31.699+0000 7f1995691640 1 Processor -- start 2023-11-28T19:59:31.705 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:31.699+0000 7f1995691640 1 -- start start 2023-11-28T19:59:31.706 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:31.699+0000 7f1995691640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f199014b1e0 0x7f19900c1700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:31.707 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:31.699+0000 7f1995691640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f19900c5300 0x7f19900a9c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:31.707 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:31.699+0000 7f1995691640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1990151280 0x7f19901516f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:31.707 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:31.699+0000 7f1995691640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f19900a4e20 con 0x7f19900c5300 2023-11-28T19:59:31.707 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:31.699+0000 7f1995691640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f19900a50e0 con 0x7f199014b1e0 2023-11-28T19:59:31.707 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:31.699+0000 7f1995691640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19900c0f00 con 0x7f1990151280 2023-11-28T19:59:31.707 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:31.699+0000 7f19867fc640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f19900c5300 0x7f19900a9c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:31.707 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:31.699+0000 7f19867fc640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f19900c5300 0x7f19900a9c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:53336/0 (socket says 172.21.15.78:53336) 2023-11-28T19:59:31.707 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:31.699+0000 7f19867fc640 1 -- 172.21.15.78:0/1329077886 learned_addr learned my addr 172.21.15.78:0/1329077886 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T19:59:31.707 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:31.699+0000 7f198f7fe640 1 --2- 172.21.15.78:0/1329077886 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1990151280 0x7f19901516f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:31.708 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:31.699+0000 7f198effd640 1 --2- 172.21.15.78:0/1329077886 >> v2:172.21.15.179:3300/0 conn(0x7f199014b1e0 0x7f19900c1700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:31.708 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:31.699+0000 7f19867fc640 1 -- 172.21.15.78:0/1329077886 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1990151280 msgr2=0x7f19901516f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T19:59:31.708 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:31.699+0000 7f19867fc640 1 --2- 172.21.15.78:0/1329077886 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1990151280 0x7f19901516f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:31.708 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:31.699+0000 7f19867fc640 1 -- 172.21.15.78:0/1329077886 >> v2:172.21.15.179:3300/0 conn(0x7f199014b1e0 msgr2=0x7f19900c1700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T19:59:31.708 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:31.699+0000 7f19867fc640 1 --2- 172.21.15.78:0/1329077886 >> v2:172.21.15.179:3300/0 conn(0x7f199014b1e0 0x7f19900c1700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:31.708 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:31.699+0000 7f19867fc640 1 -- 172.21.15.78:0/1329077886 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19900c11e0 con 0x7f19900c5300 2023-11-28T19:59:31.708 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:31.699+0000 7f198effd640 1 --2- 172.21.15.78:0/1329077886 >> v2:172.21.15.179:3300/0 conn(0x7f199014b1e0 0x7f19900c1700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T19:59:31.709 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:31.703+0000 7f19867fc640 1 --2- 172.21.15.78:0/1329077886 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f19900c5300 0x7f19900a9c30 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f19900c4150 tx=0x7f197801c500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a70d3a2f0e9b9721 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:59:31.709 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:31.703+0000 7f198e7fc640 1 -- 172.21.15.78:0/1329077886 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1978004230 con 0x7f19900c5300 2023-11-28T19:59:31.710 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:31.703+0000 7f198e7fc640 1 -- 172.21.15.78:0/1329077886 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f19780a7050 con 0x7f19900c5300 2023-11-28T19:59:31.710 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:31.703+0000 7f198e7fc640 1 -- 172.21.15.78:0/1329077886 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1978003620 con 0x7f19900c5300 2023-11-28T19:59:31.710 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:31.703+0000 7f1995691640 1 -- 172.21.15.78:0/1329077886 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f19900c5300 msgr2=0x7f19900a9c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:31.711 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:31.703+0000 7f1995691640 1 --2- 172.21.15.78:0/1329077886 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f19900c5300 0x7f19900a9c30 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f19900c4150 tx=0x7f197801c500 comp rx=0 tx=0).stop 2023-11-28T19:59:31.711 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:31.703+0000 7f1995691640 1 -- 172.21.15.78:0/1329077886 shutdown_connections 2023-11-28T19:59:31.711 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:31.703+0000 7f1995691640 1 --2- 172.21.15.78:0/1329077886 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1990151280 0x7f19901516f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:31.711 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:31.703+0000 7f1995691640 1 --2- 172.21.15.78:0/1329077886 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f19900c5300 0x7f19900a9c30 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:31.711 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:31.703+0000 7f1995691640 1 --2- 172.21.15.78:0/1329077886 >> v2:172.21.15.179:3300/0 conn(0x7f199014b1e0 0x7f19900c1700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:31.711 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:31.703+0000 7f1995691640 1 -- 172.21.15.78:0/1329077886 >> 172.21.15.78:0/1329077886 conn(0x7f19900c59f0 msgr2=0x7f19900c5e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T19:59:31.711 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:31.703+0000 7f1995691640 1 -- 172.21.15.78:0/1329077886 shutdown_connections 2023-11-28T19:59:31.711 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:31.703+0000 7f1995691640 1 -- 172.21.15.78:0/1329077886 wait complete. 2023-11-28T19:59:31.711 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:31.707+0000 7f1995691640 1 Processor -- start 2023-11-28T19:59:31.712 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:31.707+0000 7f1995691640 1 -- start start 2023-11-28T19:59:31.714 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:31.707+0000 7f1995691640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f19900c5300 0x7f19901e3930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:31.714 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:31.707+0000 7f1995691640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f199014b1e0 0x7f199013fd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:31.715 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:31.707+0000 7f1995691640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1990151280 0x7f19901402a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:31.715 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:31.707+0000 7f1995691640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19901e2cf0 con 0x7f1990151280 2023-11-28T19:59:31.715 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:31.707+0000 7f1995691640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19901ecd00 con 0x7f199014b1e0 2023-11-28T19:59:31.715 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:31.707+0000 7f1995691640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f199006c790 con 0x7f19900c5300 2023-11-28T19:59:31.715 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:31.707+0000 7f198f7fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1990151280 0x7f19901402a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:31.715 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:31.707+0000 7f198f7fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1990151280 0x7f19901402a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:53338/0 (socket says 172.21.15.78:53338) 2023-11-28T19:59:31.715 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:31.707+0000 7f198f7fe640 1 -- 172.21.15.78:0/2113309424 learned_addr learned my addr 172.21.15.78:0/2113309424 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T19:59:31.715 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:31.707+0000 7f198effd640 1 --2- 172.21.15.78:0/2113309424 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f19900c5300 0x7f19901e3930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:31.715 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:31.707+0000 7f19867fc640 1 --2- 172.21.15.78:0/2113309424 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f199014b1e0 0x7f199013fd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:31.715 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:31.707+0000 7f198f7fe640 1 -- 172.21.15.78:0/2113309424 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f19900c5300 msgr2=0x7f19901e3930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:31.715 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:31.707+0000 7f198f7fe640 1 --2- 172.21.15.78:0/2113309424 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f19900c5300 0x7f19901e3930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:31.716 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:31.707+0000 7f198f7fe640 1 -- 172.21.15.78:0/2113309424 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f199014b1e0 msgr2=0x7f199013fd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:31.716 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:31.707+0000 7f198f7fe640 1 --2- 172.21.15.78:0/2113309424 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f199014b1e0 0x7f199013fd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:31.716 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:31.707+0000 7f198f7fe640 1 -- 172.21.15.78:0/2113309424 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19780094d0 con 0x7f1990151280 2023-11-28T19:59:31.716 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:31.707+0000 7f198f7fe640 1 --2- 172.21.15.78:0/2113309424 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1990151280 0x7f19901402a0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f198800d560 tx=0x7f198800da20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:59:31.716 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:31.707+0000 7f1987fff640 1 -- 172.21.15.78:0/2113309424 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19880125f0 con 0x7f1990151280 2023-11-28T19:59:31.716 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:31.707+0000 7f1987fff640 1 -- 172.21.15.78:0/2113309424 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1988012770 con 0x7f1990151280 2023-11-28T19:59:31.716 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:31.707+0000 7f1987fff640 1 -- 172.21.15.78:0/2113309424 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1988012b20 con 0x7f1990151280 2023-11-28T19:59:31.716 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:31.707+0000 7f1995691640 1 -- 172.21.15.78:0/2113309424 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f19901e2a10 con 0x7f1990151280 2023-11-28T19:59:31.716 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:31.707+0000 7f1995691640 1 -- 172.21.15.78:0/2113309424 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f199006c420 con 0x7f1990151280 2023-11-28T19:59:31.717 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:31.711+0000 7f1995691640 1 -- 172.21.15.78:0/2113309424 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f199006c900 con 0x7f1990151280 2023-11-28T19:59:31.717 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:31.711+0000 7f1987fff640 1 -- 172.21.15.78:0/2113309424 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f1988012c80 con 0x7f1990151280 2023-11-28T19:59:31.717 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:31.711+0000 7f1987fff640 1 --2- 172.21.15.78:0/2113309424 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f1970066470 0x7f1970068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:31.718 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:31.711+0000 7f1987fff640 1 -- 172.21.15.78:0/2113309424 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f1988084490 con 0x7f1990151280 2023-11-28T19:59:31.718 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:31.711+0000 7f198effd640 1 --2- 172.21.15.78:0/2113309424 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f1970066470 0x7f1970068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:31.718 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:31.711+0000 7f198effd640 1 --2- 172.21.15.78:0/2113309424 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f1970066470 0x7f1970068930 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f19900c32d0 tx=0x7f19800077c0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:59:31.721 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:31.715+0000 7f1987fff640 1 -- 172.21.15.78:0/2113309424 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f1988051760 con 0x7f1990151280 2023-11-28T19:59:31.870 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:31.863+0000 7f1995691640 1 -- 172.21.15.78:0/2113309424 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f1990067630 con 0x7f1990151280 2023-11-28T19:59:31.871 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:31.867+0000 7f1987fff640 1 -- 172.21.15.78:0/2113309424 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v25) v1 ==== 103+0+11 (secure 0 0 0) 0x7f1988054d80 con 0x7f1990151280 2023-11-28T19:59:31.871 INFO:teuthology.orchestra.run.smithi078.stdout:pg_num: 32 2023-11-28T19:59:31.874 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:31.867+0000 7f1995691640 1 -- 172.21.15.78:0/2113309424 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f1970066470 msgr2=0x7f1970068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:31.875 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:31.867+0000 7f1995691640 1 --2- 172.21.15.78:0/2113309424 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f1970066470 0x7f1970068930 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f19900c32d0 tx=0x7f19800077c0 comp rx=0 tx=0).stop 2023-11-28T19:59:31.875 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:31.867+0000 7f1995691640 1 -- 172.21.15.78:0/2113309424 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1990151280 msgr2=0x7f19901402a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:31.875 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:31.867+0000 7f1995691640 1 --2- 172.21.15.78:0/2113309424 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1990151280 0x7f19901402a0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f198800d560 tx=0x7f198800da20 comp rx=0 tx=0).stop 2023-11-28T19:59:31.875 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:31.867+0000 7f1995691640 1 -- 172.21.15.78:0/2113309424 shutdown_connections 2023-11-28T19:59:31.875 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:31.867+0000 7f1995691640 1 --2- 172.21.15.78:0/2113309424 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f1970066470 0x7f1970068930 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:31.875 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:31.867+0000 7f1995691640 1 --2- 172.21.15.78:0/2113309424 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1990151280 0x7f19901402a0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:31.875 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:31.867+0000 7f1995691640 1 --2- 172.21.15.78:0/2113309424 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f199014b1e0 0x7f199013fd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:31.875 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:31.867+0000 7f1995691640 1 --2- 172.21.15.78:0/2113309424 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f19900c5300 0x7f19901e3930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:31.875 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:31.867+0000 7f1995691640 1 -- 172.21.15.78:0/2113309424 >> 172.21.15.78:0/2113309424 conn(0x7f19900c59f0 msgr2=0x7f19900c5dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T19:59:31.875 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:31.867+0000 7f1995691640 1 -- 172.21.15.78:0/2113309424 shutdown_connections 2023-11-28T19:59:31.876 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:31.867+0000 7f1995691640 1 -- 172.21.15.78:0/2113309424 wait complete. 2023-11-28T19:59:31.894 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-28T19:59:32.032 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:32.027+0000 7f70b8faa640 1 Processor -- start 2023-11-28T19:59:32.032 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:32.027+0000 7f70b8faa640 1 -- start start 2023-11-28T19:59:32.033 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:32.027+0000 7f70b8faa640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f70b40c3b80 0x7f70b406d690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:32.034 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:32.027+0000 7f70b8faa640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f70b40c5300 0x7f70b406c730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:32.034 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:32.027+0000 7f70b8faa640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f70b406bb80 con 0x7f70b406d2b0 2023-11-28T19:59:32.034 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:32.027+0000 7f70b8faa640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f70b406cc70 con 0x7f70b40c5300 2023-11-28T19:59:32.034 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:32.027+0000 7f70b8faa640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f70b40c5790 con 0x7f70b40c3b80 2023-11-28T19:59:32.034 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:32.027+0000 7f70b2d9d640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f70b40c5300 0x7f70b406c730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:32.034 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:32.027+0000 7f70b2d9d640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f70b40c5300 0x7f70b406c730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:53348/0 (socket says 172.21.15.78:53348) 2023-11-28T19:59:32.034 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:32.027+0000 7f70b2d9d640 1 -- 172.21.15.78:0/1949839847 learned_addr learned my addr 172.21.15.78:0/1949839847 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T19:59:32.035 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:32.027+0000 7f70a9d9b640 1 --2- 172.21.15.78:0/1949839847 >> v2:172.21.15.179:3300/0 conn(0x7f70b40c3b80 0x7f70b406d690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:32.035 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:32.027+0000 7f70b2d9d640 1 -- 172.21.15.78:0/1949839847 >> v2:172.21.15.179:3300/0 conn(0x7f70b40c3b80 msgr2=0x7f70b406d690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T19:59:32.035 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:32.027+0000 7f70b2d9d640 1 --2- 172.21.15.78:0/1949839847 >> v2:172.21.15.179:3300/0 conn(0x7f70b40c3b80 0x7f70b406d690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:32.035 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:32.027+0000 7f70b2d9d640 1 -- 172.21.15.78:0/1949839847 >> v1:172.21.15.179:6789/0 conn(0x7f70b406d2b0 legacy=0x7f70b406c020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T19:59:32.035 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:32.027+0000 7f70b2d9d640 1 -- 172.21.15.78:0/1949839847 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70b41515c0 con 0x7f70b40c5300 2023-11-28T19:59:32.036 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:32.031+0000 7f70b2d9d640 1 --2- 172.21.15.78:0/1949839847 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f70b40c5300 0x7f70b406c730 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f70b406b5a0 tx=0x7f70ac01c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=23ec0f1fadfa25c0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:59:32.038 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:32.031+0000 7f70b1d9b640 1 -- 172.21.15.78:0/1949839847 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70ac0ac600 con 0x7f70b40c5300 2023-11-28T19:59:32.038 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:32.031+0000 7f70b1d9b640 1 -- 172.21.15.78:0/1949839847 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70ac0a8050 con 0x7f70b40c5300 2023-11-28T19:59:32.038 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:32.031+0000 7f70b1d9b640 1 -- 172.21.15.78:0/1949839847 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70ac0ac980 con 0x7f70b40c5300 2023-11-28T19:59:32.038 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:32.031+0000 7f70b8faa640 1 -- 172.21.15.78:0/1949839847 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f70b40c5300 msgr2=0x7f70b406c730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:32.038 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:32.031+0000 7f70b8faa640 1 --2- 172.21.15.78:0/1949839847 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f70b40c5300 0x7f70b406c730 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f70b406b5a0 tx=0x7f70ac01c490 comp rx=0 tx=0).stop 2023-11-28T19:59:32.038 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:32.031+0000 7f70b8faa640 1 -- 172.21.15.78:0/1949839847 shutdown_connections 2023-11-28T19:59:32.039 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:32.031+0000 7f70b8faa640 1 --2- 172.21.15.78:0/1949839847 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f70b40c5300 0x7f70b406c730 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:32.039 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:32.031+0000 7f70b8faa640 1 --2- 172.21.15.78:0/1949839847 >> v2:172.21.15.179:3300/0 conn(0x7f70b40c3b80 0x7f70b406d690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:32.039 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:32.031+0000 7f70b8faa640 1 -- 172.21.15.78:0/1949839847 >> 172.21.15.78:0/1949839847 conn(0x7f70b40a7810 msgr2=0x7f70b40a7c20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T19:59:32.039 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:32.031+0000 7f70b8faa640 1 -- 172.21.15.78:0/1949839847 shutdown_connections 2023-11-28T19:59:32.039 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:32.031+0000 7f70b8faa640 1 -- 172.21.15.78:0/1949839847 wait complete. 2023-11-28T19:59:32.041 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:32.035+0000 7f70b8faa640 1 Processor -- start 2023-11-28T19:59:32.041 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:32.035+0000 7f70b8faa640 1 -- start start 2023-11-28T19:59:32.041 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:32.035+0000 7f70b8faa640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f70b406d2b0 0x7f70b415e240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:32.042 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:32.035+0000 7f70b8faa640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f70b40c3b80 0x7f70b4150700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:32.042 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:32.035+0000 7f70b8faa640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f70b40c5300 0x7f70b415cd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:32.042 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:32.035+0000 7f70b8faa640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70b414e810 con 0x7f70b406d2b0 2023-11-28T19:59:32.042 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:32.035+0000 7f70b8faa640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70b41ed7b0 con 0x7f70b40c5300 2023-11-28T19:59:32.042 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:32.035+0000 7f70b8faa640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f70b415e780 con 0x7f70b40c3b80 2023-11-28T19:59:32.042 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:32.035+0000 7f70b259c640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f70b406d2b0 0x7f70b415e240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:32.043 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:32.035+0000 7f70b259c640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f70b406d2b0 0x7f70b415e240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:53354/0 (socket says 172.21.15.78:53354) 2023-11-28T19:59:32.043 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:32.035+0000 7f70b259c640 1 -- 172.21.15.78:0/3337905413 learned_addr learned my addr 172.21.15.78:0/3337905413 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T19:59:32.043 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:32.035+0000 7f70a9d9b640 1 --2- 172.21.15.78:0/3337905413 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f70b40c3b80 0x7f70b4150700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:32.043 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:32.035+0000 7f70b2d9d640 1 --2- 172.21.15.78:0/3337905413 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f70b40c5300 0x7f70b415cd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:32.043 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:32.035+0000 7f70b259c640 1 -- 172.21.15.78:0/3337905413 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f70b40c3b80 msgr2=0x7f70b4150700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:32.043 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:32.035+0000 7f70b259c640 1 --2- 172.21.15.78:0/3337905413 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f70b40c3b80 0x7f70b4150700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:32.043 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:32.035+0000 7f70b259c640 1 -- 172.21.15.78:0/3337905413 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f70b40c5300 msgr2=0x7f70b415cd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:32.043 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:32.035+0000 7f70b259c640 1 --2- 172.21.15.78:0/3337905413 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f70b40c5300 0x7f70b415cd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:32.044 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:32.035+0000 7f70b259c640 1 -- 172.21.15.78:0/3337905413 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70ac0094d0 con 0x7f70b406d2b0 2023-11-28T19:59:32.044 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:32.035+0000 7f70b259c640 1 --2- 172.21.15.78:0/3337905413 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f70b406d2b0 0x7f70b415e240 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f70a400c490 tx=0x7f70a4001e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:59:32.045 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:32.035+0000 7f70ab7fe640 1 -- 172.21.15.78:0/3337905413 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70a4003600 con 0x7f70b406d2b0 2023-11-28T19:59:32.045 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:32.035+0000 7f70ab7fe640 1 -- 172.21.15.78:0/3337905413 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70a4003780 con 0x7f70b406d2b0 2023-11-28T19:59:32.045 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:32.035+0000 7f70ab7fe640 1 -- 172.21.15.78:0/3337905413 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70a4003b70 con 0x7f70b406d2b0 2023-11-28T19:59:32.045 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:32.035+0000 7f70b8faa640 1 -- 172.21.15.78:0/3337905413 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f70b414ef80 con 0x7f70b406d2b0 2023-11-28T19:59:32.046 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:32.035+0000 7f70b8faa640 1 -- 172.21.15.78:0/3337905413 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f70b415e990 con 0x7f70b406d2b0 2023-11-28T19:59:32.046 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:32.039+0000 7f70b8faa640 1 -- 172.21.15.78:0/3337905413 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f70b41ed8f0 con 0x7f70b406d2b0 2023-11-28T19:59:32.046 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:32.039+0000 7f70ab7fe640 1 -- 172.21.15.78:0/3337905413 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f70a4003cd0 con 0x7f70b406d2b0 2023-11-28T19:59:32.046 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:32.039+0000 7f70ab7fe640 1 --2- 172.21.15.78:0/3337905413 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f7094066470 0x7f7094068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:32.046 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:32.039+0000 7f70ab7fe640 1 -- 172.21.15.78:0/3337905413 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f70a4083280 con 0x7f70b406d2b0 2023-11-28T19:59:32.046 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:32.039+0000 7f70a9d9b640 1 --2- 172.21.15.78:0/3337905413 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f7094066470 0x7f7094068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:32.047 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:32.039+0000 7f70a9d9b640 1 --2- 172.21.15.78:0/3337905413 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f7094066470 0x7f7094068930 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f70b406df00 tx=0x7f709c0098d0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:59:32.048 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:32.043+0000 7f70ab7fe640 1 -- 172.21.15.78:0/3337905413 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f70a40504b0 con 0x7f70b406d2b0 2023-11-28T19:59:32.233 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:32.227+0000 7f70b8faa640 1 -- 172.21.15.78:0/3337905413 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f70b4067630 con 0x7f70b406d2b0 2023-11-28T19:59:32.234 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:32.227+0000 7f70ab7fe640 1 -- 172.21.15.78:0/3337905413 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4915 (secure 0 0 0) 0x7f70a4053ad0 con 0x7f70b406d2b0 2023-11-28T19:59:32.235 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-11-28T19:59:32.235 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4241,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6835/3089461479","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6833","nonce":3089461479},{"type":"v1","addr":"172.21.15.179:6835","nonce":3089461479}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4258,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6837/3153162191","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6834","nonce":3153162191},{"type":"v1","addr":"172.21.15.78:6837","nonce":3153162191}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4266,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6836/3073967897","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6835","nonce":3073967897},{"type":"v1","addr":"172.21.15.78:6836","nonce":3073967897}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-28T19:59:05.411488+0000","modified":"2023-11-28T19:59:23.150979+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4275},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4275":{"gid":4275,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.179:6834/1234044491","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6832","nonce":1234044491},{"type":"v1","addr":"172.21.15.179:6834","nonce":1234044491}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-11-28T19:59:32.236 INFO:teuthology.orchestra.run.smithi078.stderr:dumped fsmap epoch 9 2023-11-28T19:59:32.236 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:32.231+0000 7f70b8faa640 1 -- 172.21.15.78:0/3337905413 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f7094066470 msgr2=0x7f7094068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:32.236 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:32.231+0000 7f70b8faa640 1 --2- 172.21.15.78:0/3337905413 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f7094066470 0x7f7094068930 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f70b406df00 tx=0x7f709c0098d0 comp rx=0 tx=0).stop 2023-11-28T19:59:32.237 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:32.231+0000 7f70b8faa640 1 -- 172.21.15.78:0/3337905413 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f70b406d2b0 msgr2=0x7f70b415e240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:32.237 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:32.231+0000 7f70b8faa640 1 --2- 172.21.15.78:0/3337905413 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f70b406d2b0 0x7f70b415e240 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f70a400c490 tx=0x7f70a4001e80 comp rx=0 tx=0).stop 2023-11-28T19:59:32.238 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:32.231+0000 7f70b8faa640 1 -- 172.21.15.78:0/3337905413 shutdown_connections 2023-11-28T19:59:32.238 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:32.231+0000 7f70b8faa640 1 --2- 172.21.15.78:0/3337905413 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f7094066470 0x7f7094068930 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:32.238 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:32.231+0000 7f70b8faa640 1 --2- 172.21.15.78:0/3337905413 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f70b40c3b80 0x7f70b4150700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:32.238 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:32.231+0000 7f70b8faa640 1 --2- 172.21.15.78:0/3337905413 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f70b40c5300 0x7f70b415cd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:32.238 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:32.231+0000 7f70b8faa640 1 --2- 172.21.15.78:0/3337905413 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f70b406d2b0 0x7f70b415e240 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:32.238 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:32.231+0000 7f70b8faa640 1 -- 172.21.15.78:0/3337905413 >> 172.21.15.78:0/3337905413 conn(0x7f70b40a7810 msgr2=0x7f70b4071790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T19:59:32.239 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:32.231+0000 7f70b8faa640 1 -- 172.21.15.78:0/3337905413 shutdown_connections 2023-11-28T19:59:32.239 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:32.231+0000 7f70b8faa640 1 -- 172.21.15.78:0/3337905413 wait complete. 2023-11-28T19:59:32.255 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-28T19:59:32.392 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:32.387+0000 7f19a1f2a640 1 Processor -- start 2023-11-28T19:59:32.393 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:32.387+0000 7f19a1f2a640 1 -- start start 2023-11-28T19:59:32.394 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:32.387+0000 7f19a1f2a640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f199c0af4c0 0x7f199c154f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:32.394 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:32.387+0000 7f19a1f2a640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f199c0c67d0 0x7f199c0c6c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:32.394 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:32.387+0000 7f19a1f2a640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f199c0c4890 con 0x7f199c06b9f0 2023-11-28T19:59:32.394 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:32.387+0000 7f19a1f2a640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f199c155460 con 0x7f199c0af4c0 2023-11-28T19:59:32.395 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:32.387+0000 7f19a1f2a640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f199c0af8a0 con 0x7f199c0c67d0 2023-11-28T19:59:32.395 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:32.387+0000 7f199b7fe640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f199c0af4c0 0x7f199c154f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:32.395 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:32.387+0000 7f199affd640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f199c0c67d0 0x7f199c0c6c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:32.395 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:32.387+0000 7f199b7fe640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f199c0af4c0 0x7f199c154f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.78:50272/0 (socket says 172.21.15.78:50272) 2023-11-28T19:59:32.395 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:32.387+0000 7f199b7fe640 1 -- 172.21.15.78:0/2488299849 learned_addr learned my addr 172.21.15.78:0/2488299849 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T19:59:32.395 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:32.387+0000 7f199b7fe640 1 -- 172.21.15.78:0/2488299849 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f199c0c67d0 msgr2=0x7f199c0c6c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T19:59:32.395 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:32.387+0000 7f199b7fe640 1 --2- 172.21.15.78:0/2488299849 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f199c0c67d0 0x7f199c0c6c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:32.395 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:32.387+0000 7f199b7fe640 1 -- 172.21.15.78:0/2488299849 >> v1:172.21.15.179:6789/0 conn(0x7f199c06b9f0 legacy=0x7f199c157a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:32.395 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:32.387+0000 7f199b7fe640 1 -- 172.21.15.78:0/2488299849 --> v2:172.21.15.179:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f199c0c4b30 con 0x7f199c0af4c0 2023-11-28T19:59:32.397 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:32.391+0000 7f199b7fe640 1 --2- 172.21.15.78:0/2488299849 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f199c0af4c0 0x7f199c154f20 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f198c009870 tx=0x7f198c01c480 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6bab229b322f087d server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:59:32.398 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:32.391+0000 7f199a7fc640 1 -- 172.21.15.78:0/2488299849 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f198c0ab680 con 0x7f199c0af4c0 2023-11-28T19:59:32.398 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:32.391+0000 7f199a7fc640 1 -- 172.21.15.78:0/2488299849 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f198c0ab7e0 con 0x7f199c0af4c0 2023-11-28T19:59:32.398 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:32.391+0000 7f199a7fc640 1 -- 172.21.15.78:0/2488299849 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f198c0abb70 con 0x7f199c0af4c0 2023-11-28T19:59:32.399 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:32.391+0000 7f19a1f2a640 1 -- 172.21.15.78:0/2488299849 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f199c0af4c0 msgr2=0x7f199c154f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:32.399 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:32.391+0000 7f19a1f2a640 1 --2- 172.21.15.78:0/2488299849 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f199c0af4c0 0x7f199c154f20 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f198c009870 tx=0x7f198c01c480 comp rx=0 tx=0).stop 2023-11-28T19:59:32.399 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:32.391+0000 7f19a1f2a640 1 -- 172.21.15.78:0/2488299849 shutdown_connections 2023-11-28T19:59:32.399 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:32.391+0000 7f19a1f2a640 1 --2- 172.21.15.78:0/2488299849 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f199c0c67d0 0x7f199c0c6c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:32.399 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:32.391+0000 7f19a1f2a640 1 --2- 172.21.15.78:0/2488299849 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f199c0af4c0 0x7f199c154f20 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:32.400 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:32.391+0000 7f19a1f2a640 1 -- 172.21.15.78:0/2488299849 >> 172.21.15.78:0/2488299849 conn(0x7f199c0ab9d0 msgr2=0x7f199c0abde0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T19:59:32.400 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:32.391+0000 7f19a1f2a640 1 -- 172.21.15.78:0/2488299849 shutdown_connections 2023-11-28T19:59:32.400 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:32.391+0000 7f19a1f2a640 1 -- 172.21.15.78:0/2488299849 wait complete. 2023-11-28T19:59:32.400 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:32.395+0000 7f19a1f2a640 1 Processor -- start 2023-11-28T19:59:32.400 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:32.395+0000 7f19a1f2a640 1 -- start start 2023-11-28T19:59:32.402 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:32.395+0000 7f19a1f2a640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f199c06b9f0 0x7f199c0a9c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:32.402 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:32.395+0000 7f19a1f2a640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f199c0af4c0 0x7f199c150490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:32.402 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:32.395+0000 7f19a1f2a640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f199c0c67d0 0x7f199c0c3610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:32.402 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:32.395+0000 7f19a1f2a640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f199c0c12d0 con 0x7f199c06b9f0 2023-11-28T19:59:32.403 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:32.395+0000 7f19a1f2a640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f199c0c1fb0 con 0x7f199c0af4c0 2023-11-28T19:59:32.403 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:32.395+0000 7f19a1f2a640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f199c0c3180 con 0x7f199c0c67d0 2023-11-28T19:59:32.403 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:32.395+0000 7f199b7fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f199c06b9f0 0x7f199c0a9c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:32.403 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:32.395+0000 7f199b7fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f199c06b9f0 0x7f199c0a9c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:53362/0 (socket says 172.21.15.78:53362) 2023-11-28T19:59:32.403 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:32.395+0000 7f199b7fe640 1 -- 172.21.15.78:0/1787265328 learned_addr learned my addr 172.21.15.78:0/1787265328 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T19:59:32.403 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:32.395+0000 7f199bfff640 1 --2- 172.21.15.78:0/1787265328 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f199c0c67d0 0x7f199c0c3610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:32.403 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:32.395+0000 7f199affd640 1 --2- 172.21.15.78:0/1787265328 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f199c0af4c0 0x7f199c150490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:32.403 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:32.395+0000 7f199b7fe640 1 -- 172.21.15.78:0/1787265328 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f199c0c67d0 msgr2=0x7f199c0c3610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:32.403 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:32.395+0000 7f199b7fe640 1 --2- 172.21.15.78:0/1787265328 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f199c0c67d0 0x7f199c0c3610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:32.403 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:32.395+0000 7f199b7fe640 1 -- 172.21.15.78:0/1787265328 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f199c0af4c0 msgr2=0x7f199c150490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:32.403 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:32.395+0000 7f199b7fe640 1 --2- 172.21.15.78:0/1787265328 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f199c0af4c0 0x7f199c150490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:32.403 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:32.395+0000 7f199b7fe640 1 -- 172.21.15.78:0/1787265328 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f198c0094d0 con 0x7f199c06b9f0 2023-11-28T19:59:32.403 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:32.395+0000 7f199bfff640 1 --2- 172.21.15.78:0/1787265328 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f199c0c67d0 0x7f199c0c3610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T19:59:32.404 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:32.395+0000 7f199b7fe640 1 --2- 172.21.15.78:0/1787265328 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f199c06b9f0 0x7f199c0a9c40 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f198c0ad040 tx=0x7f198c01acc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:59:32.405 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:32.395+0000 7f1983fff640 1 -- 172.21.15.78:0/1787265328 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f198c0ab680 con 0x7f199c06b9f0 2023-11-28T19:59:32.405 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:32.395+0000 7f1983fff640 1 -- 172.21.15.78:0/1787265328 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f198c0b4820 con 0x7f199c06b9f0 2023-11-28T19:59:32.405 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:32.395+0000 7f19a1f2a640 1 -- 172.21.15.78:0/1787265328 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f199c0c2570 con 0x7f199c06b9f0 2023-11-28T19:59:32.405 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:32.395+0000 7f1983fff640 1 -- 172.21.15.78:0/1787265328 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f198c0b4bd0 con 0x7f199c06b9f0 2023-11-28T19:59:32.405 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:32.399+0000 7f19a1f2a640 1 -- 172.21.15.78:0/1787265328 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f199c0c2b30 con 0x7f199c06b9f0 2023-11-28T19:59:32.405 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:32.399+0000 7f19a1f2a640 1 -- 172.21.15.78:0/1787265328 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f199c067630 con 0x7f199c06b9f0 2023-11-28T19:59:32.405 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:32.399+0000 7f1983fff640 1 -- 172.21.15.78:0/1787265328 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f198c0b4d30 con 0x7f199c06b9f0 2023-11-28T19:59:32.406 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:32.399+0000 7f1983fff640 1 --2- 172.21.15.78:0/1787265328 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f1988066470 0x7f1988068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:32.406 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:32.399+0000 7f1983fff640 1 -- 172.21.15.78:0/1787265328 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f198c11ef90 con 0x7f199c06b9f0 2023-11-28T19:59:32.406 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:32.399+0000 7f199affd640 1 --2- 172.21.15.78:0/1787265328 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f1988066470 0x7f1988068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:32.407 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:32.399+0000 7f199affd640 1 --2- 172.21.15.78:0/1787265328 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f1988066470 0x7f1988068930 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f199c150200 tx=0x7f1990009190 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:59:32.409 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:32.403+0000 7f1983fff640 1 -- 172.21.15.78:0/1787265328 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f198c0ec1c0 con 0x7f199c06b9f0 2023-11-28T19:59:32.561 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:32.555+0000 7f19a1f2a640 1 -- 172.21.15.78:0/1787265328 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f199c1520c0 con 0x7f199c06b9f0 2023-11-28T19:59:32.562 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:32.555+0000 7f1983fff640 1 -- 172.21.15.78:0/1787265328 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+18322 (secure 0 0 0) 0x7f198c0ef7e0 con 0x7f199c06b9f0 2023-11-28T19:59:32.562 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-11-28T19:59:32.563 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":25,"fsid":"dd9780e8-3bda-44fa-a9f0-fa07d19d901d","created":"2023-11-28T19:58:40.969556+0000","modified":"2023-11-28T19:59:10.474525+0000","last_up_change":"2023-11-28T19:58:52.596716+0000","last_in_change":"2023-11-28T19:58:43.609275+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-28T19:58:54.011229+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-28T19:59:03.945559+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-28T19:59:04.481478+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-11-28T19:59:08.109152+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"e84245ac-b5da-429e-af18-39acaa2b33e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6800","nonce":3358701235},{"type":"v1","addr":"172.21.15.78:6801","nonce":3358701235}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6802","nonce":3358701235},{"type":"v1","addr":"172.21.15.78:6803","nonce":3358701235}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6806","nonce":3358701235},{"type":"v1","addr":"172.21.15.78:6807","nonce":3358701235}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6804","nonce":3358701235},{"type":"v1","addr":"172.21.15.78:6805","nonce":3358701235}]},"public_addr":"172.21.15.78:6801/3358701235","cluster_addr":"172.21.15.78:6803/3358701235","heartbeat_back_addr":"172.21.15.78:6807/3358701235","heartbeat_front_addr":"172.21.15.78:6805/3358701235","state":["exists","up"]},{"osd":1,"uuid":"e634831d-c4e2-48d9-870c-9556ae162981","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6808","nonce":3211476654},{"type":"v1","addr":"172.21.15.78:6809","nonce":3211476654}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6810","nonce":3211476654},{"type":"v1","addr":"172.21.15.78:6811","nonce":3211476654}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6814","nonce":3211476654},{"type":"v1","addr":"172.21.15.78:6815","nonce":3211476654}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6812","nonce":3211476654},{"type":"v1","addr":"172.21.15.78:6813","nonce":3211476654}]},"public_addr":"172.21.15.78:6809/3211476654","cluster_addr":"172.21.15.78:6811/3211476654","heartbeat_back_addr":"172.21.15.78:6815/3211476654","heartbeat_front_addr":"172.21.15.78:6813/3211476654","state":["exists","up"]},{"osd":2,"uuid":"274c8395-6534-41f0-b8fb-a00af8985aa8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6816","nonce":2532904479},{"type":"v1","addr":"172.21.15.78:6817","nonce":2532904479}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6818","nonce":2532904479},{"type":"v1","addr":"172.21.15.78:6819","nonce":2532904479}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6822","nonce":2532904479},{"type":"v1","addr":"172.21.15.78:6823","nonce":2532904479}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6820","nonce":2532904479},{"type":"v1","addr":"172.21.15.78:6821","nonce":2532904479}]},"public_addr":"172.21.15.78:6817/2532904479","cluster_addr":"172.21.15.78:6819/2532904479","heartbeat_back_addr":"172.21.15.78:6823/2532904479","heartbeat_front_addr":"172.21.15.78:6821/2532904479","state":["exists","up"]},{"osd":3,"uuid":"77acc9af-7d4d-4b18-8cf5-d62f5971b7c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6824","nonce":3442991267},{"type":"v1","addr":"172.21.15.78:6825","nonce":3442991267}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6826","nonce":3442991267},{"type":"v1","addr":"172.21.15.78:6827","nonce":3442991267}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6830","nonce":3442991267},{"type":"v1","addr":"172.21.15.78:6831","nonce":3442991267}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6828","nonce":3442991267},{"type":"v1","addr":"172.21.15.78:6829","nonce":3442991267}]},"public_addr":"172.21.15.78:6825/3442991267","cluster_addr":"172.21.15.78:6827/3442991267","heartbeat_back_addr":"172.21.15.78:6831/3442991267","heartbeat_front_addr":"172.21.15.78:6829/3442991267","state":["exists","up"]},{"osd":4,"uuid":"5c62bc66-6b34-4b7f-a66b-9a743969138c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":802983577},{"type":"v1","addr":"172.21.15.179:6809","nonce":802983577}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":802983577},{"type":"v1","addr":"172.21.15.179:6811","nonce":802983577}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":802983577},{"type":"v1","addr":"172.21.15.179:6815","nonce":802983577}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":802983577},{"type":"v1","addr":"172.21.15.179:6813","nonce":802983577}]},"public_addr":"172.21.15.179:6809/802983577","cluster_addr":"172.21.15.179:6811/802983577","heartbeat_back_addr":"172.21.15.179:6815/802983577","heartbeat_front_addr":"172.21.15.179:6813/802983577","state":["exists","up"]},{"osd":5,"uuid":"67db6d36-f684-4079-b0cd-82b4dd61461f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":518192887},{"type":"v1","addr":"172.21.15.179:6818","nonce":518192887}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":518192887},{"type":"v1","addr":"172.21.15.179:6822","nonce":518192887}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":518192887},{"type":"v1","addr":"172.21.15.179:6829","nonce":518192887}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6824","nonce":518192887},{"type":"v1","addr":"172.21.15.179:6826","nonce":518192887}]},"public_addr":"172.21.15.179:6818/518192887","cluster_addr":"172.21.15.179:6822/518192887","heartbeat_back_addr":"172.21.15.179:6829/518192887","heartbeat_front_addr":"172.21.15.179:6826/518192887","state":["exists","up"]},{"osd":6,"uuid":"12e670af-5a16-4c81-9f97-defa66cab967","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":815435378},{"type":"v1","addr":"172.21.15.179:6801","nonce":815435378}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":815435378},{"type":"v1","addr":"172.21.15.179:6803","nonce":815435378}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":815435378},{"type":"v1","addr":"172.21.15.179:6807","nonce":815435378}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":815435378},{"type":"v1","addr":"172.21.15.179:6805","nonce":815435378}]},"public_addr":"172.21.15.179:6801/815435378","cluster_addr":"172.21.15.179:6803/815435378","heartbeat_back_addr":"172.21.15.179:6807/815435378","heartbeat_front_addr":"172.21.15.179:6805/815435378","state":["exists","up"]},{"osd":7,"uuid":"fe630650-2eb3-49ad-8676-c341e6332eb1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6817","nonce":2848432339},{"type":"v1","addr":"172.21.15.179:6819","nonce":2848432339}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6821","nonce":2848432339},{"type":"v1","addr":"172.21.15.179:6823","nonce":2848432339}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":2848432339},{"type":"v1","addr":"172.21.15.179:6831","nonce":2848432339}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6825","nonce":2848432339},{"type":"v1","addr":"172.21.15.179:6827","nonce":2848432339}]},"public_addr":"172.21.15.179:6819/2848432339","cluster_addr":"172.21.15.179:6823/2848432339","heartbeat_back_addr":"172.21.15.179:6831/2848432339","heartbeat_front_addr":"172.21.15.179:6827/2848432339","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:58:49.255433+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:58:49.412880+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:58:49.559295+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:58:49.245237+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:58:49.184557+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:58:49.329851+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:58:49.366012+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:58:49.349604+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-28T19:59:32.564 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:32.559+0000 7f19a1f2a640 1 -- 172.21.15.78:0/1787265328 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f1988066470 msgr2=0x7f1988068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:32.564 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:32.559+0000 7f19a1f2a640 1 --2- 172.21.15.78:0/1787265328 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f1988066470 0x7f1988068930 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f199c150200 tx=0x7f1990009190 comp rx=0 tx=0).stop 2023-11-28T19:59:32.565 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:32.559+0000 7f19a1f2a640 1 -- 172.21.15.78:0/1787265328 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f199c06b9f0 msgr2=0x7f199c0a9c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:32.565 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:32.559+0000 7f19a1f2a640 1 --2- 172.21.15.78:0/1787265328 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f199c06b9f0 0x7f199c0a9c40 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f198c0ad040 tx=0x7f198c01acc0 comp rx=0 tx=0).stop 2023-11-28T19:59:32.565 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:32.559+0000 7f19a1f2a640 1 -- 172.21.15.78:0/1787265328 shutdown_connections 2023-11-28T19:59:32.565 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:32.559+0000 7f19a1f2a640 1 --2- 172.21.15.78:0/1787265328 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f1988066470 0x7f1988068930 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:32.565 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:32.559+0000 7f19a1f2a640 1 --2- 172.21.15.78:0/1787265328 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f199c0c67d0 0x7f199c0c3610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:32.565 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:32.559+0000 7f19a1f2a640 1 --2- 172.21.15.78:0/1787265328 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f199c0af4c0 0x7f199c150490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:32.565 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:32.559+0000 7f19a1f2a640 1 --2- 172.21.15.78:0/1787265328 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f199c06b9f0 0x7f199c0a9c40 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:32.565 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:32.559+0000 7f19a1f2a640 1 -- 172.21.15.78:0/1787265328 >> 172.21.15.78:0/1787265328 conn(0x7f199c0ab9d0 msgr2=0x7f199c157a90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T19:59:32.565 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:32.559+0000 7f19a1f2a640 1 -- 172.21.15.78:0/1787265328 shutdown_connections 2023-11-28T19:59:32.565 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:32.559+0000 7f19a1f2a640 1 -- 172.21.15.78:0/1787265328 wait complete. 2023-11-28T19:59:32.584 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-28T19:58:54.011229+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-28T19:59:03.945559+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-11-28T19:59:04.481478+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-11-28T19:59:08.109152+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-11-28T19:59:32.584 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-28T19:59:32.724 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:32.719+0000 7f78941f8640 1 Processor -- start 2023-11-28T19:59:32.724 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:32.719+0000 7f78941f8640 1 -- start start 2023-11-28T19:59:32.725 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:32.719+0000 7f78941f8640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f788c0c5300 0x7f788c0a9c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:32.725 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:32.719+0000 7f78941f8640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f788c1548c0 0x7f788c154d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:32.725 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:32.719+0000 7f78941f8640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f788c0a4e20 con 0x7f788c14b1e0 2023-11-28T19:59:32.725 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:32.719+0000 7f78941f8640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f788c0a50e0 con 0x7f788c0c5300 2023-11-28T19:59:32.725 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:32.719+0000 7f78941f8640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f788c0c0f00 con 0x7f788c1548c0 2023-11-28T19:59:32.726 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:32.719+0000 7f7892795640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f788c1548c0 0x7f788c154d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:32.726 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:32.719+0000 7f7892795640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f788c1548c0 0x7f788c154d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3301/0 says I am v2:172.21.15.78:48270/0 (socket says 172.21.15.78:48270) 2023-11-28T19:59:32.726 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:32.719+0000 7f7892795640 1 -- 172.21.15.78:0/1166528140 learned_addr learned my addr 172.21.15.78:0/1166528140 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T19:59:32.726 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:32.719+0000 7f7891793640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f788c0c5300 0x7f788c0a9c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:32.726 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:32.719+0000 7f7892795640 1 -- 172.21.15.78:0/1166528140 >> v2:172.21.15.179:3300/0 conn(0x7f788c0c5300 msgr2=0x7f788c0a9c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T19:59:32.726 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:32.719+0000 7f7892795640 1 --2- 172.21.15.78:0/1166528140 >> v2:172.21.15.179:3300/0 conn(0x7f788c0c5300 0x7f788c0a9c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:32.726 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:32.719+0000 7f7892795640 1 -- 172.21.15.78:0/1166528140 >> v1:172.21.15.179:6789/0 conn(0x7f788c14b1e0 legacy=0x7f788c0c1700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:32.727 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:32.719+0000 7f7892795640 1 -- 172.21.15.78:0/1166528140 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f788c0c11e0 con 0x7f788c1548c0 2023-11-28T19:59:32.728 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:32.723+0000 7f7892795640 1 --2- 172.21.15.78:0/1166528140 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f788c1548c0 0x7f788c154d30 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f7884009e50 tx=0x7f788401ca10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2980bae25ed89ad8 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:59:32.729 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:32.723+0000 7f7890f92640 1 -- 172.21.15.78:0/1166528140 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78840a57f0 con 0x7f788c1548c0 2023-11-28T19:59:32.729 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:32.723+0000 7f7890f92640 1 -- 172.21.15.78:0/1166528140 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f78840a5950 con 0x7f788c1548c0 2023-11-28T19:59:32.729 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:32.723+0000 7f7890f92640 1 -- 172.21.15.78:0/1166528140 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78840a5ce0 con 0x7f788c1548c0 2023-11-28T19:59:32.730 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:32.723+0000 7f78941f8640 1 -- 172.21.15.78:0/1166528140 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f788c1548c0 msgr2=0x7f788c154d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:32.731 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:32.723+0000 7f78941f8640 1 --2- 172.21.15.78:0/1166528140 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f788c1548c0 0x7f788c154d30 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f7884009e50 tx=0x7f788401ca10 comp rx=0 tx=0).stop 2023-11-28T19:59:32.731 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:32.723+0000 7f78941f8640 1 -- 172.21.15.78:0/1166528140 shutdown_connections 2023-11-28T19:59:32.731 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:32.723+0000 7f78941f8640 1 --2- 172.21.15.78:0/1166528140 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f788c1548c0 0x7f788c154d30 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:32.731 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:32.723+0000 7f78941f8640 1 --2- 172.21.15.78:0/1166528140 >> v2:172.21.15.179:3300/0 conn(0x7f788c0c5300 0x7f788c0a9c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:32.732 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:32.723+0000 7f78941f8640 1 -- 172.21.15.78:0/1166528140 >> 172.21.15.78:0/1166528140 conn(0x7f788c0c59f0 msgr2=0x7f788c0c5e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T19:59:32.732 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:32.723+0000 7f78941f8640 1 -- 172.21.15.78:0/1166528140 shutdown_connections 2023-11-28T19:59:32.732 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:32.723+0000 7f78941f8640 1 -- 172.21.15.78:0/1166528140 wait complete. 2023-11-28T19:59:32.734 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:32.727+0000 7f78941f8640 1 Processor -- start 2023-11-28T19:59:32.734 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:32.727+0000 7f78941f8640 1 -- start start 2023-11-28T19:59:32.734 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:32.727+0000 7f78941f8640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f788c0c5300 0x7f788c0a62d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:32.735 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:32.727+0000 7f78941f8640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f788c14b1e0 0x7f788c140830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:32.735 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:32.727+0000 7f78941f8640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f788c1548c0 0x7f788c140d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:32.735 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:32.727+0000 7f78941f8640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f788c144d20 con 0x7f788c14b1e0 2023-11-28T19:59:32.735 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:32.727+0000 7f78941f8640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f788c144a10 con 0x7f788c1548c0 2023-11-28T19:59:32.736 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:32.727+0000 7f78941f8640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f788c140070 con 0x7f788c0c5300 2023-11-28T19:59:32.736 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:32.727+0000 7f7891793640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f788c14b1e0 0x7f788c140830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:32.736 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:32.727+0000 7f7891793640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f788c14b1e0 0x7f788c140830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:53370/0 (socket says 172.21.15.78:53370) 2023-11-28T19:59:32.736 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:32.727+0000 7f7891793640 1 -- 172.21.15.78:0/112989532 learned_addr learned my addr 172.21.15.78:0/112989532 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T19:59:32.736 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:32.727+0000 7f7891f94640 1 --2- 172.21.15.78:0/112989532 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f788c0c5300 0x7f788c0a62d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:32.737 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:32.727+0000 7f7892795640 1 --2- 172.21.15.78:0/112989532 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f788c1548c0 0x7f788c140d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:32.737 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:32.727+0000 7f7891793640 1 -- 172.21.15.78:0/112989532 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f788c0c5300 msgr2=0x7f788c0a62d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:32.737 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:32.727+0000 7f7891793640 1 --2- 172.21.15.78:0/112989532 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f788c0c5300 0x7f788c0a62d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:32.737 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:32.727+0000 7f7891793640 1 -- 172.21.15.78:0/112989532 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f788c1548c0 msgr2=0x7f788c140d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:32.738 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:32.727+0000 7f7891793640 1 --2- 172.21.15.78:0/112989532 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f788c1548c0 0x7f788c140d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:32.738 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:32.727+0000 7f7891793640 1 -- 172.21.15.78:0/112989532 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7884009b30 con 0x7f788c14b1e0 2023-11-28T19:59:32.738 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:32.727+0000 7f7891793640 1 --2- 172.21.15.78:0/112989532 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f788c14b1e0 0x7f788c140830 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f787c00e900 tx=0x7f787c00edc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:59:32.738 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:32.727+0000 7f78827fc640 1 -- 172.21.15.78:0/112989532 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f787c009690 con 0x7f788c14b1e0 2023-11-28T19:59:32.738 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:32.727+0000 7f78827fc640 1 -- 172.21.15.78:0/112989532 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f787c00ca00 con 0x7f788c14b1e0 2023-11-28T19:59:32.739 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:32.727+0000 7f78827fc640 1 -- 172.21.15.78:0/112989532 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f787c00cdb0 con 0x7f788c14b1e0 2023-11-28T19:59:32.739 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:32.727+0000 7f78941f8640 1 -- 172.21.15.78:0/112989532 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f788c144450 con 0x7f788c14b1e0 2023-11-28T19:59:32.739 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:32.727+0000 7f78941f8640 1 -- 172.21.15.78:0/112989532 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f788c140310 con 0x7f788c14b1e0 2023-11-28T19:59:32.740 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:32.727+0000 7f78941f8640 1 -- 172.21.15.78:0/112989532 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f788c067630 con 0x7f788c14b1e0 2023-11-28T19:59:32.740 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:32.731+0000 7f78827fc640 1 -- 172.21.15.78:0/112989532 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f787c013470 con 0x7f788c14b1e0 2023-11-28T19:59:32.740 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:32.731+0000 7f78827fc640 1 --2- 172.21.15.78:0/112989532 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f7870066470 0x7f7870068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:32.740 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:32.731+0000 7f78827fc640 1 -- 172.21.15.78:0/112989532 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f787c084320 con 0x7f788c14b1e0 2023-11-28T19:59:32.741 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:32.731+0000 7f7891f94640 1 --2- 172.21.15.78:0/112989532 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f7870066470 0x7f7870068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:32.741 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:32.731+0000 7f7891f94640 1 --2- 172.21.15.78:0/112989532 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f7870066470 0x7f7870068930 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f7888007fd0 tx=0x7f7888009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:59:32.741 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:32.735+0000 7f78827fc640 1 -- 172.21.15.78:0/112989532 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f787c051550 con 0x7f788c14b1e0 2023-11-28T19:59:32.896 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:32.891+0000 7f78941f8640 1 -- 172.21.15.78:0/112989532 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f788c1497a0 con 0x7f788c14b1e0 2023-11-28T19:59:32.897 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:32.891+0000 7f78827fc640 1 -- 172.21.15.78:0/112989532 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v25) v1 ==== 93+0+10 (secure 0 0 0) 0x7f787c054b70 con 0x7f788c14b1e0 2023-11-28T19:59:32.897 INFO:teuthology.orchestra.run.smithi078.stdout:pg_num: 1 2023-11-28T19:59:32.899 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:32.891+0000 7f78941f8640 1 -- 172.21.15.78:0/112989532 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f7870066470 msgr2=0x7f7870068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:32.899 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:32.891+0000 7f78941f8640 1 --2- 172.21.15.78:0/112989532 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f7870066470 0x7f7870068930 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f7888007fd0 tx=0x7f7888009040 comp rx=0 tx=0).stop 2023-11-28T19:59:32.899 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:32.891+0000 7f78941f8640 1 -- 172.21.15.78:0/112989532 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f788c14b1e0 msgr2=0x7f788c140830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:32.899 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:32.891+0000 7f78941f8640 1 --2- 172.21.15.78:0/112989532 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f788c14b1e0 0x7f788c140830 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f787c00e900 tx=0x7f787c00edc0 comp rx=0 tx=0).stop 2023-11-28T19:59:32.899 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:32.891+0000 7f78941f8640 1 -- 172.21.15.78:0/112989532 shutdown_connections 2023-11-28T19:59:32.899 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:32.891+0000 7f78941f8640 1 --2- 172.21.15.78:0/112989532 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f7870066470 0x7f7870068930 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:32.899 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:32.891+0000 7f78941f8640 1 --2- 172.21.15.78:0/112989532 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f788c1548c0 0x7f788c140d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:32.899 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:32.891+0000 7f78941f8640 1 --2- 172.21.15.78:0/112989532 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f788c14b1e0 0x7f788c140830 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:32.899 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:32.891+0000 7f78941f8640 1 --2- 172.21.15.78:0/112989532 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f788c0c5300 0x7f788c0a62d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:32.900 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:32.891+0000 7f78941f8640 1 -- 172.21.15.78:0/112989532 >> 172.21.15.78:0/112989532 conn(0x7f788c0c59f0 msgr2=0x7f788c0c4790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T19:59:32.900 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:32.895+0000 7f78941f8640 1 -- 172.21.15.78:0/112989532 shutdown_connections 2023-11-28T19:59:32.900 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:32.895+0000 7f78941f8640 1 -- 172.21.15.78:0/112989532 wait complete. 2023-11-28T19:59:32.918 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-28T19:59:33.060 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:33.055+0000 7efd92bd1640 1 Processor -- start 2023-11-28T19:59:33.060 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:33.055+0000 7efd92bd1640 1 -- start start 2023-11-28T19:59:33.061 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:33.055+0000 7efd92bd1640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7efd8c14fc30 0x7efd8c0c3cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:33.061 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:33.055+0000 7efd92bd1640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7efd8c06d840 0x7efd8c0c4210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:33.061 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:33.055+0000 7efd92bd1640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efd8c152910 con 0x7efd8c14f850 2023-11-28T19:59:33.062 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:33.055+0000 7efd92bd1640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efd8c0c2240 con 0x7efd8c14fc30 2023-11-28T19:59:33.062 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:33.055+0000 7efd92bd1640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efd8c152bf0 con 0x7efd8c06d840 2023-11-28T19:59:33.062 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:33.055+0000 7efd8bfff640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7efd8c14fc30 0x7efd8c0c3cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:33.062 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:33.055+0000 7efd8bfff640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7efd8c14fc30 0x7efd8c0c3cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:53384/0 (socket says 172.21.15.78:53384) 2023-11-28T19:59:33.062 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:33.055+0000 7efd8bfff640 1 -- 172.21.15.78:0/3858068310 learned_addr learned my addr 172.21.15.78:0/3858068310 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T19:59:33.062 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:33.055+0000 7efd9116e640 1 --2- 172.21.15.78:0/3858068310 >> v2:172.21.15.179:3300/0 conn(0x7efd8c06d840 0x7efd8c0c4210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:33.062 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:33.055+0000 7efd8bfff640 1 -- 172.21.15.78:0/3858068310 >> v2:172.21.15.179:3300/0 conn(0x7efd8c06d840 msgr2=0x7efd8c0c4210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T19:59:33.062 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:33.055+0000 7efd8bfff640 1 --2- 172.21.15.78:0/3858068310 >> v2:172.21.15.179:3300/0 conn(0x7efd8c06d840 0x7efd8c0c4210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:33.062 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:33.055+0000 7efd8bfff640 1 -- 172.21.15.78:0/3858068310 >> v1:172.21.15.179:6789/0 conn(0x7efd8c14f850 legacy=0x7efd8c0aacf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T19:59:33.062 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:33.055+0000 7efd8bfff640 1 -- 172.21.15.78:0/3858068310 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd8c152ed0 con 0x7efd8c14fc30 2023-11-28T19:59:33.062 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:33.055+0000 7efd9116e640 1 --2- 172.21.15.78:0/3858068310 >> v2:172.21.15.179:3300/0 conn(0x7efd8c06d840 0x7efd8c0c4210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T19:59:33.064 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:33.059+0000 7efd8bfff640 1 --2- 172.21.15.78:0/3858068310 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7efd8c14fc30 0x7efd8c0c3cd0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7efd8c0c2440 tx=0x7efd7801c4c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=921d05dd96666bf2 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:59:33.065 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:33.059+0000 7efd8b7fe640 1 -- 172.21.15.78:0/3858068310 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd780ab5f0 con 0x7efd8c14fc30 2023-11-28T19:59:33.065 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:33.059+0000 7efd8b7fe640 1 -- 172.21.15.78:0/3858068310 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd780ab750 con 0x7efd8c14fc30 2023-11-28T19:59:33.065 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:33.059+0000 7efd8b7fe640 1 -- 172.21.15.78:0/3858068310 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd780abae0 con 0x7efd8c14fc30 2023-11-28T19:59:33.065 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:33.059+0000 7efd92bd1640 1 -- 172.21.15.78:0/3858068310 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7efd8c14fc30 msgr2=0x7efd8c0c3cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:33.066 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:33.059+0000 7efd92bd1640 1 --2- 172.21.15.78:0/3858068310 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7efd8c14fc30 0x7efd8c0c3cd0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7efd8c0c2440 tx=0x7efd7801c4c0 comp rx=0 tx=0).stop 2023-11-28T19:59:33.066 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:33.059+0000 7efd92bd1640 1 -- 172.21.15.78:0/3858068310 shutdown_connections 2023-11-28T19:59:33.066 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:33.059+0000 7efd92bd1640 1 --2- 172.21.15.78:0/3858068310 >> v2:172.21.15.179:3300/0 conn(0x7efd8c06d840 0x7efd8c0c4210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:33.066 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:33.059+0000 7efd92bd1640 1 --2- 172.21.15.78:0/3858068310 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7efd8c14fc30 0x7efd8c0c3cd0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:33.066 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:33.059+0000 7efd92bd1640 1 -- 172.21.15.78:0/3858068310 >> 172.21.15.78:0/3858068310 conn(0x7efd8c0c59f0 msgr2=0x7efd8c0c5e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T19:59:33.066 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:33.059+0000 7efd92bd1640 1 -- 172.21.15.78:0/3858068310 shutdown_connections 2023-11-28T19:59:33.066 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:33.059+0000 7efd92bd1640 1 -- 172.21.15.78:0/3858068310 wait complete. 2023-11-28T19:59:33.067 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:33.063+0000 7efd92bd1640 1 Processor -- start 2023-11-28T19:59:33.067 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:33.063+0000 7efd92bd1640 1 -- start start 2023-11-28T19:59:33.069 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:33.063+0000 7efd92bd1640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7efd8c06d840 0x7efd8c1f0740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:33.069 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:33.063+0000 7efd92bd1640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7efd8c14f850 0x7efd8c1ed950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:33.069 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:33.063+0000 7efd92bd1640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7efd8c14fc30 0x7efd8c0a66b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:33.070 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:33.063+0000 7efd92bd1640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd8c1ed4c0 con 0x7efd8c14f850 2023-11-28T19:59:33.070 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:33.063+0000 7efd92bd1640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd8c1ed170 con 0x7efd8c06d840 2023-11-28T19:59:33.070 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:33.063+0000 7efd92bd1640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efd8c072500 con 0x7efd8c14fc30 2023-11-28T19:59:33.070 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:33.063+0000 7efd8bfff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7efd8c14f850 0x7efd8c1ed950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:33.070 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:33.063+0000 7efd8bfff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7efd8c14f850 0x7efd8c1ed950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:53396/0 (socket says 172.21.15.78:53396) 2023-11-28T19:59:33.070 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:33.063+0000 7efd8bfff640 1 -- 172.21.15.78:0/3018451586 learned_addr learned my addr 172.21.15.78:0/3018451586 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T19:59:33.070 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:33.063+0000 7efd9096d640 1 --2- 172.21.15.78:0/3018451586 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7efd8c06d840 0x7efd8c1f0740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:33.070 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:33.063+0000 7efd9116e640 1 --2- 172.21.15.78:0/3018451586 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7efd8c14fc30 0x7efd8c0a66b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:33.070 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:33.063+0000 7efd8bfff640 1 -- 172.21.15.78:0/3018451586 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7efd8c14fc30 msgr2=0x7efd8c0a66b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:33.070 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:33.063+0000 7efd8bfff640 1 --2- 172.21.15.78:0/3018451586 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7efd8c14fc30 0x7efd8c0a66b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:33.071 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:33.063+0000 7efd8bfff640 1 -- 172.21.15.78:0/3018451586 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7efd8c06d840 msgr2=0x7efd8c1f0740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:33.071 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:33.063+0000 7efd8bfff640 1 --2- 172.21.15.78:0/3018451586 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7efd8c06d840 0x7efd8c1f0740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:33.071 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:33.063+0000 7efd8bfff640 1 -- 172.21.15.78:0/3018451586 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd780094d0 con 0x7efd8c14f850 2023-11-28T19:59:33.071 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:33.063+0000 7efd9116e640 1 --2- 172.21.15.78:0/3018451586 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7efd8c14fc30 0x7efd8c0a66b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T19:59:33.071 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:33.063+0000 7efd8bfff640 1 --2- 172.21.15.78:0/3018451586 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7efd8c14f850 0x7efd8c1ed950 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7efd7801a0f0 tx=0x7efd7801ad00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:59:33.071 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:33.063+0000 7efd897fa640 1 -- 172.21.15.78:0/3018451586 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd780b4800 con 0x7efd8c14f850 2023-11-28T19:59:33.071 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:33.063+0000 7efd897fa640 1 -- 172.21.15.78:0/3018451586 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd780b4960 con 0x7efd8c14f850 2023-11-28T19:59:33.071 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:33.063+0000 7efd897fa640 1 -- 172.21.15.78:0/3018451586 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd780b4d10 con 0x7efd8c14f850 2023-11-28T19:59:33.071 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:33.063+0000 7efd92bd1640 1 -- 172.21.15.78:0/3018451586 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efd8c0a9da0 con 0x7efd8c14f850 2023-11-28T19:59:33.071 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:33.063+0000 7efd92bd1640 1 -- 172.21.15.78:0/3018451586 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efd8c0aa5b0 con 0x7efd8c14f850 2023-11-28T19:59:33.072 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:33.063+0000 7efd92bd1640 1 -- 172.21.15.78:0/3018451586 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efd8c1ed2e0 con 0x7efd8c14f850 2023-11-28T19:59:33.072 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:33.067+0000 7efd897fa640 1 -- 172.21.15.78:0/3018451586 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7efd780b3380 con 0x7efd8c14f850 2023-11-28T19:59:33.072 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:33.067+0000 7efd897fa640 1 --2- 172.21.15.78:0/3018451586 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7efd700664a0 0x7efd70068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:33.073 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:33.067+0000 7efd897fa640 1 -- 172.21.15.78:0/3018451586 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7efd780a8050 con 0x7efd8c14f850 2023-11-28T19:59:33.073 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:33.067+0000 7efd9096d640 1 --2- 172.21.15.78:0/3018451586 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7efd700664a0 0x7efd70068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:33.073 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:33.067+0000 7efd9096d640 1 --2- 172.21.15.78:0/3018451586 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7efd700664a0 0x7efd70068960 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7efd80007fd0 tx=0x7efd80007e40 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:59:33.076 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:33.071+0000 7efd897fa640 1 -- 172.21.15.78:0/3018451586 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7efd780eb970 con 0x7efd8c14f850 2023-11-28T19:59:33.225 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:33.219+0000 7efd92bd1640 1 -- 172.21.15.78:0/3018451586 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7efd8c067630 con 0x7efd8c14f850 2023-11-28T19:59:33.226 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:33.219+0000 7efd897fa640 1 -- 172.21.15.78:0/3018451586 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v25) v1 ==== 104+0+11 (secure 0 0 0) 0x7efd780eef90 con 0x7efd8c14f850 2023-11-28T19:59:33.226 INFO:teuthology.orchestra.run.smithi078.stdout:pg_num: 32 2023-11-28T19:59:33.227 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:33.223+0000 7efd92bd1640 1 -- 172.21.15.78:0/3018451586 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7efd700664a0 msgr2=0x7efd70068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:33.228 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:33.223+0000 7efd92bd1640 1 --2- 172.21.15.78:0/3018451586 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7efd700664a0 0x7efd70068960 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7efd80007fd0 tx=0x7efd80007e40 comp rx=0 tx=0).stop 2023-11-28T19:59:33.228 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:33.223+0000 7efd92bd1640 1 -- 172.21.15.78:0/3018451586 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7efd8c14f850 msgr2=0x7efd8c1ed950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:33.228 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:33.223+0000 7efd92bd1640 1 --2- 172.21.15.78:0/3018451586 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7efd8c14f850 0x7efd8c1ed950 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7efd7801a0f0 tx=0x7efd7801ad00 comp rx=0 tx=0).stop 2023-11-28T19:59:33.228 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:33.223+0000 7efd92bd1640 1 -- 172.21.15.78:0/3018451586 shutdown_connections 2023-11-28T19:59:33.228 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:33.223+0000 7efd92bd1640 1 --2- 172.21.15.78:0/3018451586 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7efd700664a0 0x7efd70068960 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:33.228 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:33.223+0000 7efd92bd1640 1 --2- 172.21.15.78:0/3018451586 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7efd8c14fc30 0x7efd8c0a66b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:33.228 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:33.223+0000 7efd92bd1640 1 --2- 172.21.15.78:0/3018451586 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7efd8c14f850 0x7efd8c1ed950 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:33.228 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:33.223+0000 7efd92bd1640 1 --2- 172.21.15.78:0/3018451586 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7efd8c06d840 0x7efd8c1f0740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:33.228 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:33.223+0000 7efd92bd1640 1 -- 172.21.15.78:0/3018451586 >> 172.21.15.78:0/3018451586 conn(0x7efd8c0c59f0 msgr2=0x7efd8c14b0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T19:59:33.228 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:33.223+0000 7efd92bd1640 1 -- 172.21.15.78:0/3018451586 shutdown_connections 2023-11-28T19:59:33.229 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:33.223+0000 7efd92bd1640 1 -- 172.21.15.78:0/3018451586 wait complete. 2023-11-28T19:59:33.247 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-28T19:59:33.387 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:33.379+0000 7f2eadc54640 1 Processor -- start 2023-11-28T19:59:33.387 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:33.383+0000 7f2eadc54640 1 -- start start 2023-11-28T19:59:33.388 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:33.383+0000 7f2eadc54640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2ea814b1e0 0x7f2ea80c1700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:33.388 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:33.383+0000 7f2eadc54640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f2ea80c5300 0x7f2ea80a9c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:33.388 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:33.383+0000 7f2eadc54640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2ea80a4e20 con 0x7f2ea8151280 2023-11-28T19:59:33.388 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:33.383+0000 7f2eadc54640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2ea81558d0 con 0x7f2ea80c5300 2023-11-28T19:59:33.388 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:33.383+0000 7f2eadc54640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ea80a50e0 con 0x7f2ea814b1e0 2023-11-28T19:59:33.389 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:33.383+0000 7f2ea77fe640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2ea814b1e0 0x7f2ea80c1700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:33.390 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:33.383+0000 7f2ea6ffd640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f2ea80c5300 0x7f2ea80a9c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:33.390 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:33.383+0000 7f2ea6ffd640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f2ea80c5300 0x7f2ea80a9c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.78:50304/0 (socket says 172.21.15.78:50304) 2023-11-28T19:59:33.390 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:33.383+0000 7f2ea7fff640 1 --1- >> v1:172.21.15.179:6789/0 conn(0x7f2ea8151280 0x7f2ea8151710 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.179:6789/0 says I am v1:172.21.15.78:60296/0 (socket says 172.21.15.78:60296) 2023-11-28T19:59:33.390 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:33.383+0000 7f2ea77fe640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2ea814b1e0 0x7f2ea80c1700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3301/0 says I am v2:172.21.15.78:48300/0 (socket says 172.21.15.78:48300) 2023-11-28T19:59:33.390 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:33.383+0000 7f2ea6ffd640 1 -- 172.21.15.78:0/1017739594 learned_addr learned my addr 172.21.15.78:0/1017739594 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T19:59:33.390 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:33.383+0000 7f2ea67fc640 1 -- 172.21.15.78:0/1017739594 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 796135682 0 0) 0x7f2ea80a4e20 con 0x7f2ea8151280 2023-11-28T19:59:33.390 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:33.383+0000 7f2ea77fe640 1 -- 172.21.15.78:0/1017739594 >> v2:172.21.15.179:3300/0 conn(0x7f2ea80c5300 msgr2=0x7f2ea80a9c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T19:59:33.390 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:33.383+0000 7f2ea77fe640 1 --2- 172.21.15.78:0/1017739594 >> v2:172.21.15.179:3300/0 conn(0x7f2ea80c5300 0x7f2ea80a9c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:33.390 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:33.383+0000 7f2ea77fe640 1 -- 172.21.15.78:0/1017739594 >> v1:172.21.15.179:6789/0 conn(0x7f2ea8151280 legacy=0x7f2ea8151710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:33.390 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:33.383+0000 7f2ea77fe640 1 -- 172.21.15.78:0/1017739594 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ea80c0f00 con 0x7f2ea814b1e0 2023-11-28T19:59:33.390 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:33.383+0000 7f2ea6ffd640 1 --2- 172.21.15.78:0/1017739594 >> v2:172.21.15.179:3300/0 conn(0x7f2ea80c5300 0x7f2ea80a9c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T19:59:33.392 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:33.387+0000 7f2ea77fe640 1 --2- 172.21.15.78:0/1017739594 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2ea814b1e0 0x7f2ea80c1700 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f2e980097c0 tx=0x7f2e9801c480 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d0ced865b489e483 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:59:33.392 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:33.387+0000 7f2ea67fc640 1 -- 172.21.15.78:0/1017739594 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e980ad640 con 0x7f2ea814b1e0 2023-11-28T19:59:33.393 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:33.387+0000 7f2ea67fc640 1 -- 172.21.15.78:0/1017739594 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e980ad7a0 con 0x7f2ea814b1e0 2023-11-28T19:59:33.393 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:33.387+0000 7f2ea67fc640 1 -- 172.21.15.78:0/1017739594 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e980adb30 con 0x7f2ea814b1e0 2023-11-28T19:59:33.393 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:33.387+0000 7f2eadc54640 1 -- 172.21.15.78:0/1017739594 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2ea814b1e0 msgr2=0x7f2ea80c1700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:33.393 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:33.387+0000 7f2eadc54640 1 --2- 172.21.15.78:0/1017739594 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2ea814b1e0 0x7f2ea80c1700 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f2e980097c0 tx=0x7f2e9801c480 comp rx=0 tx=0).stop 2023-11-28T19:59:33.393 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:33.387+0000 7f2eadc54640 1 -- 172.21.15.78:0/1017739594 shutdown_connections 2023-11-28T19:59:33.394 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:33.387+0000 7f2eadc54640 1 --2- 172.21.15.78:0/1017739594 >> v2:172.21.15.179:3300/0 conn(0x7f2ea80c5300 0x7f2ea80a9c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:33.394 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:33.387+0000 7f2eadc54640 1 --2- 172.21.15.78:0/1017739594 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2ea814b1e0 0x7f2ea80c1700 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:33.394 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:33.387+0000 7f2eadc54640 1 -- 172.21.15.78:0/1017739594 >> 172.21.15.78:0/1017739594 conn(0x7f2ea80c59f0 msgr2=0x7f2ea80c5e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T19:59:33.394 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:33.387+0000 7f2eadc54640 1 -- 172.21.15.78:0/1017739594 shutdown_connections 2023-11-28T19:59:33.394 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:33.387+0000 7f2eadc54640 1 -- 172.21.15.78:0/1017739594 wait complete. 2023-11-28T19:59:33.395 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:33.391+0000 7f2eadc54640 1 Processor -- start 2023-11-28T19:59:33.395 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:33.391+0000 7f2eadc54640 1 -- start start 2023-11-28T19:59:33.397 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:33.391+0000 7f2eadc54640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2ea80c5300 0x7f2ea80befc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:33.397 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:33.391+0000 7f2eadc54640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2ea814b1e0 0x7f2ea8142b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:33.398 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:33.391+0000 7f2eadc54640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2ea8151280 0x7f2ea8143080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:33.398 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:33.391+0000 7f2eadc54640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ea81ed110 con 0x7f2ea8151280 2023-11-28T19:59:33.398 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:33.391+0000 7f2eadc54640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ea80701f0 con 0x7f2ea80c5300 2023-11-28T19:59:33.398 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:33.391+0000 7f2eadc54640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ea80a5e90 con 0x7f2ea814b1e0 2023-11-28T19:59:33.398 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:33.391+0000 7f2ea7fff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2ea8151280 0x7f2ea8143080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:33.398 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:33.391+0000 7f2ea7fff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2ea8151280 0x7f2ea8143080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:53410/0 (socket says 172.21.15.78:53410) 2023-11-28T19:59:33.398 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:33.391+0000 7f2ea7fff640 1 -- 172.21.15.78:0/550910726 learned_addr learned my addr 172.21.15.78:0/550910726 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T19:59:33.398 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:33.391+0000 7f2ea77fe640 1 --2- 172.21.15.78:0/550910726 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2ea80c5300 0x7f2ea80befc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:33.398 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:33.391+0000 7f2ea6ffd640 1 --2- 172.21.15.78:0/550910726 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2ea814b1e0 0x7f2ea8142b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:33.398 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:33.391+0000 7f2ea7fff640 1 -- 172.21.15.78:0/550910726 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2ea814b1e0 msgr2=0x7f2ea8142b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:33.398 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:33.391+0000 7f2ea7fff640 1 --2- 172.21.15.78:0/550910726 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2ea814b1e0 0x7f2ea8142b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:33.398 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:33.391+0000 7f2ea7fff640 1 -- 172.21.15.78:0/550910726 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2ea80c5300 msgr2=0x7f2ea80befc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:33.399 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:33.391+0000 7f2ea7fff640 1 --2- 172.21.15.78:0/550910726 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2ea80c5300 0x7f2ea80befc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:33.399 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:33.391+0000 7f2ea7fff640 1 -- 172.21.15.78:0/550910726 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e9c0094d0 con 0x7f2ea8151280 2023-11-28T19:59:33.399 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:33.391+0000 7f2ea7fff640 1 --2- 172.21.15.78:0/550910726 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2ea8151280 0x7f2ea8143080 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f2ea0001570 tx=0x7f2ea000cc70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:59:33.399 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:33.391+0000 7f2e8ffff640 1 -- 172.21.15.78:0/550910726 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ea000a640 con 0x7f2ea8151280 2023-11-28T19:59:33.399 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:33.391+0000 7f2e8ffff640 1 -- 172.21.15.78:0/550910726 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ea000a7a0 con 0x7f2ea8151280 2023-11-28T19:59:33.399 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:33.391+0000 7f2e8ffff640 1 -- 172.21.15.78:0/550910726 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ea000ab30 con 0x7f2ea8151280 2023-11-28T19:59:33.399 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:33.391+0000 7f2eadc54640 1 -- 172.21.15.78:0/550910726 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2e98009420 con 0x7f2ea8151280 2023-11-28T19:59:33.399 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:33.391+0000 7f2eadc54640 1 -- 172.21.15.78:0/550910726 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2ea80a5560 con 0x7f2ea8151280 2023-11-28T19:59:33.401 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:33.391+0000 7f2eadc54640 1 -- 172.21.15.78:0/550910726 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2ea80a6000 con 0x7f2ea8151280 2023-11-28T19:59:33.401 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:33.395+0000 7f2e8ffff640 1 -- 172.21.15.78:0/550910726 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f2ea000ac90 con 0x7f2ea8151280 2023-11-28T19:59:33.401 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:33.395+0000 7f2e8ffff640 1 --2- 172.21.15.78:0/550910726 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f2e940664a0 0x7f2e94068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:33.401 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:33.395+0000 7f2e8ffff640 1 -- 172.21.15.78:0/550910726 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f2ea00839f0 con 0x7f2ea8151280 2023-11-28T19:59:33.401 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:33.395+0000 7f2ea77fe640 1 --2- 172.21.15.78:0/550910726 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f2e940664a0 0x7f2e94068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:33.402 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:33.395+0000 7f2ea77fe640 1 --2- 172.21.15.78:0/550910726 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f2e940664a0 0x7f2e94068960 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f2e980af000 tx=0x7f2e98008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:59:33.404 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:33.399+0000 7f2e8ffff640 1 -- 172.21.15.78:0/550910726 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f2ea0050b90 con 0x7f2ea8151280 2023-11-28T19:59:33.554 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:33.547+0000 7f2eadc54640 1 -- 172.21.15.78:0/550910726 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f2ea8067630 con 0x7f2ea8151280 2023-11-28T19:59:33.554 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:33.547+0000 7f2e8ffff640 1 -- 172.21.15.78:0/550910726 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v25) v1 ==== 100+0+11 (secure 0 0 0) 0x7f2ea00170a0 con 0x7f2ea8151280 2023-11-28T19:59:33.554 INFO:teuthology.orchestra.run.smithi078.stdout:pg_num: 64 2023-11-28T19:59:33.556 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:33.551+0000 7f2eadc54640 1 -- 172.21.15.78:0/550910726 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f2e940664a0 msgr2=0x7f2e94068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:33.556 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:33.551+0000 7f2eadc54640 1 --2- 172.21.15.78:0/550910726 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f2e940664a0 0x7f2e94068960 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f2e980af000 tx=0x7f2e98008040 comp rx=0 tx=0).stop 2023-11-28T19:59:33.557 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:33.551+0000 7f2eadc54640 1 -- 172.21.15.78:0/550910726 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2ea8151280 msgr2=0x7f2ea8143080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:33.557 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:33.551+0000 7f2eadc54640 1 --2- 172.21.15.78:0/550910726 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2ea8151280 0x7f2ea8143080 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f2ea0001570 tx=0x7f2ea000cc70 comp rx=0 tx=0).stop 2023-11-28T19:59:33.557 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:33.551+0000 7f2eadc54640 1 -- 172.21.15.78:0/550910726 shutdown_connections 2023-11-28T19:59:33.557 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:33.551+0000 7f2eadc54640 1 --2- 172.21.15.78:0/550910726 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f2e940664a0 0x7f2e94068960 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:33.557 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:33.551+0000 7f2eadc54640 1 --2- 172.21.15.78:0/550910726 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2ea814b1e0 0x7f2ea8142b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:33.557 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:33.551+0000 7f2eadc54640 1 --2- 172.21.15.78:0/550910726 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2ea8151280 0x7f2ea8143080 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:33.557 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:33.551+0000 7f2eadc54640 1 --2- 172.21.15.78:0/550910726 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2ea80c5300 0x7f2ea80befc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:33.557 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:33.551+0000 7f2eadc54640 1 -- 172.21.15.78:0/550910726 >> 172.21.15.78:0/550910726 conn(0x7f2ea80c59f0 msgr2=0x7f2ea80c0270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T19:59:33.557 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:33.551+0000 7f2eadc54640 1 -- 172.21.15.78:0/550910726 shutdown_connections 2023-11-28T19:59:33.557 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:33.551+0000 7f2eadc54640 1 -- 172.21.15.78:0/550910726 wait complete. 2023-11-28T19:59:33.575 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-11-28T19:59:33.715 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:33.711+0000 7fcb6ee91640 1 Processor -- start 2023-11-28T19:59:33.715 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:33.711+0000 7fcb6ee91640 1 -- start start 2023-11-28T19:59:33.717 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:33.711+0000 7fcb6ee91640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fcb6814b1e0 0x7fcb680c1700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:33.717 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:33.711+0000 7fcb6ee91640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fcb681548c0 0x7fcb68154d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:33.717 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:33.711+0000 7fcb6ee91640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcb680a4e20 con 0x7fcb680c5300 2023-11-28T19:59:33.717 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:33.711+0000 7fcb6ee91640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcb680a50e0 con 0x7fcb6814b1e0 2023-11-28T19:59:33.717 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:33.711+0000 7fcb6ee91640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcb680c0f00 con 0x7fcb681548c0 2023-11-28T19:59:33.717 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:33.711+0000 7fcb6cc2d640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fcb6814b1e0 0x7fcb680c1700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:33.717 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:33.711+0000 7fcb6cc2d640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fcb6814b1e0 0x7fcb680c1700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:53426/0 (socket says 172.21.15.78:53426) 2023-11-28T19:59:33.717 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:33.711+0000 7fcb6cc2d640 1 -- 172.21.15.78:0/3141542953 learned_addr learned my addr 172.21.15.78:0/3141542953 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T19:59:33.718 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:33.711+0000 7fcb6cc2d640 1 -- 172.21.15.78:0/3141542953 >> v2:172.21.15.179:3300/0 conn(0x7fcb681548c0 msgr2=0x7fcb68154d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T19:59:33.718 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:33.711+0000 7fcb6d42e640 1 --2- 172.21.15.78:0/3141542953 >> v2:172.21.15.179:3300/0 conn(0x7fcb681548c0 0x7fcb68154d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:33.718 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:33.711+0000 7fcb6cc2d640 1 --2- 172.21.15.78:0/3141542953 >> v2:172.21.15.179:3300/0 conn(0x7fcb681548c0 0x7fcb68154d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:33.718 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:33.711+0000 7fcb6cc2d640 1 -- 172.21.15.78:0/3141542953 >> v1:172.21.15.179:6789/0 conn(0x7fcb680c5300 legacy=0x7fcb680a9c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T19:59:33.718 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:33.711+0000 7fcb6cc2d640 1 -- 172.21.15.78:0/3141542953 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb680c11e0 con 0x7fcb6814b1e0 2023-11-28T19:59:33.718 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:33.711+0000 7fcb6d42e640 1 --2- 172.21.15.78:0/3141542953 >> v2:172.21.15.179:3300/0 conn(0x7fcb681548c0 0x7fcb68154d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T19:59:33.720 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:33.715+0000 7fcb6cc2d640 1 --2- 172.21.15.78:0/3141542953 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcb6814b1e0 0x7fcb680c1700 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fcb680c5850 tx=0x7fcb5c01c4c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fc48d9aab4754159 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:59:33.720 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:33.715+0000 7fcb677fe640 1 -- 172.21.15.78:0/3141542953 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb5c0ac630 con 0x7fcb6814b1e0 2023-11-28T19:59:33.721 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:33.715+0000 7fcb677fe640 1 -- 172.21.15.78:0/3141542953 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb5c0ac790 con 0x7fcb6814b1e0 2023-11-28T19:59:33.721 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:33.715+0000 7fcb677fe640 1 -- 172.21.15.78:0/3141542953 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb5c0acb20 con 0x7fcb6814b1e0 2023-11-28T19:59:33.721 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:33.715+0000 7fcb6ee91640 1 -- 172.21.15.78:0/3141542953 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcb6814b1e0 msgr2=0x7fcb680c1700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:33.722 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:33.715+0000 7fcb6ee91640 1 --2- 172.21.15.78:0/3141542953 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcb6814b1e0 0x7fcb680c1700 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fcb680c5850 tx=0x7fcb5c01c4c0 comp rx=0 tx=0).stop 2023-11-28T19:59:33.722 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:33.715+0000 7fcb6ee91640 1 -- 172.21.15.78:0/3141542953 shutdown_connections 2023-11-28T19:59:33.722 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:33.715+0000 7fcb6ee91640 1 --2- 172.21.15.78:0/3141542953 >> v2:172.21.15.179:3300/0 conn(0x7fcb681548c0 0x7fcb68154d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:33.722 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:33.715+0000 7fcb6ee91640 1 --2- 172.21.15.78:0/3141542953 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcb6814b1e0 0x7fcb680c1700 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:33.722 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:33.715+0000 7fcb6ee91640 1 -- 172.21.15.78:0/3141542953 >> 172.21.15.78:0/3141542953 conn(0x7fcb680c59f0 msgr2=0x7fcb680c5e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T19:59:33.722 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:33.715+0000 7fcb6ee91640 1 -- 172.21.15.78:0/3141542953 shutdown_connections 2023-11-28T19:59:33.722 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:33.715+0000 7fcb6ee91640 1 -- 172.21.15.78:0/3141542953 wait complete. 2023-11-28T19:59:33.723 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:33.719+0000 7fcb6ee91640 1 Processor -- start 2023-11-28T19:59:33.723 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:33.719+0000 7fcb6ee91640 1 -- start start 2023-11-28T19:59:33.725 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:33.719+0000 7fcb6ee91640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcb680c5300 0x7fcb681431e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:33.725 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:33.719+0000 7fcb6ee91640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcb6814b1e0 0x7fcb6815d650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:33.726 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:33.719+0000 7fcb6ee91640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcb681548c0 0x7fcb68148350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:33.726 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:33.719+0000 7fcb6ee91640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb681ed0f0 con 0x7fcb6814b1e0 2023-11-28T19:59:33.726 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:33.719+0000 7fcb6ee91640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb6806d800 con 0x7fcb681548c0 2023-11-28T19:59:33.726 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:33.719+0000 7fcb6ee91640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb6806d240 con 0x7fcb680c5300 2023-11-28T19:59:33.726 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:33.719+0000 7fcb67fff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcb6814b1e0 0x7fcb6815d650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:33.726 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:33.719+0000 7fcb67fff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcb6814b1e0 0x7fcb6815d650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:53428/0 (socket says 172.21.15.78:53428) 2023-11-28T19:59:33.726 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:33.719+0000 7fcb67fff640 1 -- 172.21.15.78:0/4084221573 learned_addr learned my addr 172.21.15.78:0/4084221573 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T19:59:33.726 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:33.719+0000 7fcb6d42e640 1 --2- 172.21.15.78:0/4084221573 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcb681548c0 0x7fcb68148350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:33.726 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:33.719+0000 7fcb6cc2d640 1 --2- 172.21.15.78:0/4084221573 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcb680c5300 0x7fcb681431e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:33.726 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:33.719+0000 7fcb67fff640 1 -- 172.21.15.78:0/4084221573 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcb680c5300 msgr2=0x7fcb681431e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:33.727 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:33.719+0000 7fcb67fff640 1 --2- 172.21.15.78:0/4084221573 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcb680c5300 0x7fcb681431e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:33.727 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:33.719+0000 7fcb67fff640 1 -- 172.21.15.78:0/4084221573 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcb681548c0 msgr2=0x7fcb68148350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:33.727 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:33.719+0000 7fcb67fff640 1 --2- 172.21.15.78:0/4084221573 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcb681548c0 0x7fcb68148350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:33.727 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:33.719+0000 7fcb67fff640 1 -- 172.21.15.78:0/4084221573 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb5c0094d0 con 0x7fcb6814b1e0 2023-11-28T19:59:33.727 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:33.719+0000 7fcb67fff640 1 --2- 172.21.15.78:0/4084221573 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcb6814b1e0 0x7fcb6815d650 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fcb5400c410 tx=0x7fcb5400c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:59:33.727 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:33.719+0000 7fcb657fa640 1 -- 172.21.15.78:0/4084221573 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb54011790 con 0x7fcb6814b1e0 2023-11-28T19:59:33.727 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:33.719+0000 7fcb657fa640 1 -- 172.21.15.78:0/4084221573 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb540118f0 con 0x7fcb6814b1e0 2023-11-28T19:59:33.728 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:33.719+0000 7fcb6ee91640 1 -- 172.21.15.78:0/4084221573 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcb6806d520 con 0x7fcb6814b1e0 2023-11-28T19:59:33.728 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:33.719+0000 7fcb657fa640 1 -- 172.21.15.78:0/4084221573 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb54011ce0 con 0x7fcb6814b1e0 2023-11-28T19:59:33.728 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:33.719+0000 7fcb6ee91640 1 -- 172.21.15.78:0/4084221573 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcb68148890 con 0x7fcb6814b1e0 2023-11-28T19:59:33.729 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:33.719+0000 7fcb6ee91640 1 -- 172.21.15.78:0/4084221573 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcb68067630 con 0x7fcb6814b1e0 2023-11-28T19:59:33.729 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:33.723+0000 7fcb657fa640 1 -- 172.21.15.78:0/4084221573 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fcb5401c460 con 0x7fcb6814b1e0 2023-11-28T19:59:33.729 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:33.723+0000 7fcb657fa640 1 --2- 172.21.15.78:0/4084221573 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fcb4c066470 0x7fcb4c068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:33.729 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:33.723+0000 7fcb657fa640 1 -- 172.21.15.78:0/4084221573 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fcb54083d00 con 0x7fcb6814b1e0 2023-11-28T19:59:33.729 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:33.723+0000 7fcb6cc2d640 1 --2- 172.21.15.78:0/4084221573 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fcb4c066470 0x7fcb4c068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:33.729 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:33.723+0000 7fcb6cc2d640 1 --2- 172.21.15.78:0/4084221573 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fcb4c066470 0x7fcb4c068930 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fcb5c0ae000 tx=0x7fcb5c0a7000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:59:33.732 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:33.727+0000 7fcb657fa640 1 -- 172.21.15.78:0/4084221573 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fcb54050f70 con 0x7fcb6814b1e0 2023-11-28T19:59:33.880 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:33.875+0000 7fcb6ee91640 1 -- 172.21.15.78:0/4084221573 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7fcb680aa630 con 0x7fcb6814b1e0 2023-11-28T19:59:33.881 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:33.875+0000 7fcb657fa640 1 -- 172.21.15.78:0/4084221573 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v25) v1 ==== 103+0+11 (secure 0 0 0) 0x7fcb54054590 con 0x7fcb6814b1e0 2023-11-28T19:59:33.881 INFO:teuthology.orchestra.run.smithi078.stdout:pg_num: 32 2023-11-28T19:59:33.883 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:33.879+0000 7fcb6ee91640 1 -- 172.21.15.78:0/4084221573 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fcb4c066470 msgr2=0x7fcb4c068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:33.884 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:33.879+0000 7fcb6ee91640 1 --2- 172.21.15.78:0/4084221573 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fcb4c066470 0x7fcb4c068930 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fcb5c0ae000 tx=0x7fcb5c0a7000 comp rx=0 tx=0).stop 2023-11-28T19:59:33.884 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:33.879+0000 7fcb6ee91640 1 -- 172.21.15.78:0/4084221573 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcb6814b1e0 msgr2=0x7fcb6815d650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:33.884 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:33.879+0000 7fcb6ee91640 1 --2- 172.21.15.78:0/4084221573 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcb6814b1e0 0x7fcb6815d650 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fcb5400c410 tx=0x7fcb5400c8d0 comp rx=0 tx=0).stop 2023-11-28T19:59:33.884 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:33.879+0000 7fcb6ee91640 1 -- 172.21.15.78:0/4084221573 shutdown_connections 2023-11-28T19:59:33.884 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:33.879+0000 7fcb6ee91640 1 --2- 172.21.15.78:0/4084221573 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fcb4c066470 0x7fcb4c068930 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:33.885 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:33.879+0000 7fcb6ee91640 1 --2- 172.21.15.78:0/4084221573 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcb681548c0 0x7fcb68148350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:33.885 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:33.879+0000 7fcb6ee91640 1 --2- 172.21.15.78:0/4084221573 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcb6814b1e0 0x7fcb6815d650 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:33.885 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:33.879+0000 7fcb6ee91640 1 --2- 172.21.15.78:0/4084221573 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcb680c5300 0x7fcb681431e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:33.886 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:33.879+0000 7fcb6ee91640 1 -- 172.21.15.78:0/4084221573 >> 172.21.15.78:0/4084221573 conn(0x7fcb680c59f0 msgr2=0x7fcb680a9b80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T19:59:33.889 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:33.879+0000 7fcb6ee91640 1 -- 172.21.15.78:0/4084221573 shutdown_connections 2023-11-28T19:59:33.890 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:33.879+0000 7fcb6ee91640 1 -- 172.21.15.78:0/4084221573 wait complete. 2023-11-28T19:59:33.906 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-28T19:59:34.045 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:34.039+0000 7fcb1c565640 1 Processor -- start 2023-11-28T19:59:34.045 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:34.039+0000 7fcb1c565640 1 -- start start 2023-11-28T19:59:34.047 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:34.039+0000 7fcb1c565640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fcb1406d2b0 0x7fcb1406d690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:34.047 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:34.039+0000 7fcb1c565640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fcb140c3b80 0x7fcb140c5300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:34.047 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:34.039+0000 7fcb1c565640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcb1406bb80 con 0x7fcb1406c020 2023-11-28T19:59:34.048 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:34.039+0000 7fcb1c565640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcb140c5840 con 0x7fcb140c3b80 2023-11-28T19:59:34.048 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:34.039+0000 7fcb1c565640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcb141515c0 con 0x7fcb1406d2b0 2023-11-28T19:59:34.048 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:34.039+0000 7fcb19b00640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fcb140c3b80 0x7fcb140c5300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:34.048 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:34.039+0000 7fcb19b00640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fcb140c3b80 0x7fcb140c5300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:53436/0 (socket says 172.21.15.78:53436) 2023-11-28T19:59:34.048 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:34.039+0000 7fcb19b00640 1 -- 172.21.15.78:0/2812245775 learned_addr learned my addr 172.21.15.78:0/2812245775 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T19:59:34.048 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:34.039+0000 7fcb1a301640 1 --2- 172.21.15.78:0/2812245775 >> v2:172.21.15.179:3300/0 conn(0x7fcb1406d2b0 0x7fcb1406d690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:34.048 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:34.039+0000 7fcb19b00640 1 -- 172.21.15.78:0/2812245775 >> v2:172.21.15.179:3300/0 conn(0x7fcb1406d2b0 msgr2=0x7fcb1406d690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T19:59:34.048 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:34.039+0000 7fcb19b00640 1 --2- 172.21.15.78:0/2812245775 >> v2:172.21.15.179:3300/0 conn(0x7fcb1406d2b0 0x7fcb1406d690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:34.048 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:34.039+0000 7fcb19b00640 1 -- 172.21.15.78:0/2812245775 >> v1:172.21.15.179:6789/0 conn(0x7fcb1406c020 legacy=0x7fcb1406c4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T19:59:34.048 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:34.039+0000 7fcb19b00640 1 -- 172.21.15.78:0/2812245775 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb141518a0 con 0x7fcb140c3b80 2023-11-28T19:59:34.051 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:34.043+0000 7fcb19b00640 1 --2- 172.21.15.78:0/2812245775 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcb140c3b80 0x7fcb140c5300 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fcb140c2130 tx=0x7fcb0401c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1e383f3d849f20ed server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:59:34.051 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:34.043+0000 7fcb192ff640 1 -- 172.21.15.78:0/2812245775 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb040aa5f0 con 0x7fcb140c3b80 2023-11-28T19:59:34.051 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:34.043+0000 7fcb192ff640 1 -- 172.21.15.78:0/2812245775 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb040aa750 con 0x7fcb140c3b80 2023-11-28T19:59:34.051 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:34.043+0000 7fcb192ff640 1 -- 172.21.15.78:0/2812245775 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb040aaae0 con 0x7fcb140c3b80 2023-11-28T19:59:34.051 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:34.043+0000 7fcb1c565640 1 -- 172.21.15.78:0/2812245775 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcb140c3b80 msgr2=0x7fcb140c5300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:34.051 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:34.043+0000 7fcb1c565640 1 --2- 172.21.15.78:0/2812245775 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcb140c3b80 0x7fcb140c5300 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fcb140c2130 tx=0x7fcb0401c490 comp rx=0 tx=0).stop 2023-11-28T19:59:34.051 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:34.043+0000 7fcb1c565640 1 -- 172.21.15.78:0/2812245775 shutdown_connections 2023-11-28T19:59:34.051 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:34.043+0000 7fcb1c565640 1 --2- 172.21.15.78:0/2812245775 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcb140c3b80 0x7fcb140c5300 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:34.051 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:34.043+0000 7fcb1c565640 1 --2- 172.21.15.78:0/2812245775 >> v2:172.21.15.179:3300/0 conn(0x7fcb1406d2b0 0x7fcb1406d690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:34.052 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:34.043+0000 7fcb1c565640 1 -- 172.21.15.78:0/2812245775 >> 172.21.15.78:0/2812245775 conn(0x7fcb140a7810 msgr2=0x7fcb140a7c20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T19:59:34.052 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:34.043+0000 7fcb1c565640 1 -- 172.21.15.78:0/2812245775 shutdown_connections 2023-11-28T19:59:34.052 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:34.043+0000 7fcb1c565640 1 -- 172.21.15.78:0/2812245775 wait complete. 2023-11-28T19:59:34.052 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:34.047+0000 7fcb1c565640 1 Processor -- start 2023-11-28T19:59:34.052 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:34.047+0000 7fcb1c565640 1 -- start start 2023-11-28T19:59:34.054 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:34.047+0000 7fcb1c565640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcb1406c020 0x7fcb14159950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:34.054 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:34.047+0000 7fcb1c565640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcb1406d2b0 0x7fcb14159e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:34.054 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:34.047+0000 7fcb1c565640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcb140c3b80 0x7fcb141f02c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:34.055 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:34.047+0000 7fcb1c565640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb141509a0 con 0x7fcb140c3b80 2023-11-28T19:59:34.055 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:34.047+0000 7fcb1c565640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb14156dc0 con 0x7fcb1406d2b0 2023-11-28T19:59:34.055 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:34.047+0000 7fcb1c565640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb1414fdd0 con 0x7fcb1406c020 2023-11-28T19:59:34.055 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:34.047+0000 7fcb1ab02640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcb140c3b80 0x7fcb141f02c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:34.055 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:34.047+0000 7fcb1ab02640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcb140c3b80 0x7fcb141f02c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:53438/0 (socket says 172.21.15.78:53438) 2023-11-28T19:59:34.055 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:34.047+0000 7fcb1ab02640 1 -- 172.21.15.78:0/3739679918 learned_addr learned my addr 172.21.15.78:0/3739679918 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T19:59:34.055 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:34.047+0000 7fcb1a301640 1 --2- 172.21.15.78:0/3739679918 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcb1406c020 0x7fcb14159950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:34.055 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:34.047+0000 7fcb19b00640 1 --2- 172.21.15.78:0/3739679918 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcb1406d2b0 0x7fcb14159e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:34.055 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:34.047+0000 7fcb1ab02640 1 -- 172.21.15.78:0/3739679918 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcb1406c020 msgr2=0x7fcb14159950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:34.055 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:34.047+0000 7fcb1ab02640 1 --2- 172.21.15.78:0/3739679918 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcb1406c020 0x7fcb14159950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:34.055 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:34.047+0000 7fcb1ab02640 1 -- 172.21.15.78:0/3739679918 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcb1406d2b0 msgr2=0x7fcb14159e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:34.055 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:34.047+0000 7fcb1ab02640 1 --2- 172.21.15.78:0/3739679918 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcb1406d2b0 0x7fcb14159e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:34.056 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:34.047+0000 7fcb1ab02640 1 -- 172.21.15.78:0/3739679918 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb040094d0 con 0x7fcb140c3b80 2023-11-28T19:59:34.056 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:34.047+0000 7fcb1ab02640 1 --2- 172.21.15.78:0/3739679918 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcb140c3b80 0x7fcb141f02c0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fcb0c00c780 tx=0x7fcb0c00cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:59:34.056 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:34.047+0000 7fcb0affd640 1 -- 172.21.15.78:0/3739679918 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb0c004b20 con 0x7fcb140c3b80 2023-11-28T19:59:34.056 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:34.047+0000 7fcb0affd640 1 -- 172.21.15.78:0/3739679918 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb0c004c80 con 0x7fcb140c3b80 2023-11-28T19:59:34.056 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:34.047+0000 7fcb0affd640 1 -- 172.21.15.78:0/3739679918 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb0c00aa90 con 0x7fcb140c3b80 2023-11-28T19:59:34.056 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:34.047+0000 7fcb1c565640 1 -- 172.21.15.78:0/3739679918 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcb1414ef80 con 0x7fcb140c3b80 2023-11-28T19:59:34.056 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:34.047+0000 7fcb1c565640 1 -- 172.21.15.78:0/3739679918 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcb14150350 con 0x7fcb140c3b80 2023-11-28T19:59:34.057 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:34.051+0000 7fcb1c565640 1 -- 172.21.15.78:0/3739679918 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcb14150b10 con 0x7fcb140c3b80 2023-11-28T19:59:34.057 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:34.051+0000 7fcb0affd640 1 -- 172.21.15.78:0/3739679918 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fcb0c00abf0 con 0x7fcb140c3b80 2023-11-28T19:59:34.058 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:34.051+0000 7fcb0affd640 1 --2- 172.21.15.78:0/3739679918 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fcaf80664a0 0x7fcaf8068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:34.058 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:34.051+0000 7fcb0affd640 1 -- 172.21.15.78:0/3739679918 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fcb0c084130 con 0x7fcb140c3b80 2023-11-28T19:59:34.058 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:34.051+0000 7fcb1a301640 1 --2- 172.21.15.78:0/3739679918 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fcaf80664a0 0x7fcaf8068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:34.059 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:34.051+0000 7fcb1a301640 1 --2- 172.21.15.78:0/3739679918 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fcaf80664a0 0x7fcaf8068960 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fcb10007a60 tx=0x7fcb10008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:59:34.062 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:34.055+0000 7fcb0affd640 1 -- 172.21.15.78:0/3739679918 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fcb0c051360 con 0x7fcb140c3b80 2023-11-28T19:59:34.085 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T19:59:34.089 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T19:59:34.250 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:34.243+0000 7fcb1c565640 1 -- 172.21.15.78:0/3739679918 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fcb14067630 con 0x7fcb140c3b80 2023-11-28T19:59:34.251 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:34.243+0000 7fcb0affd640 1 -- 172.21.15.78:0/3739679918 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4915 (secure 0 0 0) 0x7fcb0c054980 con 0x7fcb140c3b80 2023-11-28T19:59:34.251 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-11-28T19:59:34.251 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4241,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6835/3089461479","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6833","nonce":3089461479},{"type":"v1","addr":"172.21.15.179:6835","nonce":3089461479}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4258,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6837/3153162191","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6834","nonce":3153162191},{"type":"v1","addr":"172.21.15.78:6837","nonce":3153162191}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4266,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6836/3073967897","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6835","nonce":3073967897},{"type":"v1","addr":"172.21.15.78:6836","nonce":3073967897}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-28T19:59:05.411488+0000","modified":"2023-11-28T19:59:23.150979+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4275},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4275":{"gid":4275,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.179:6834/1234044491","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6832","nonce":1234044491},{"type":"v1","addr":"172.21.15.179:6834","nonce":1234044491}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-11-28T19:59:34.251 INFO:teuthology.orchestra.run.smithi078.stderr:dumped fsmap epoch 9 2023-11-28T19:59:34.253 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:34.247+0000 7fcb1c565640 1 -- 172.21.15.78:0/3739679918 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fcaf80664a0 msgr2=0x7fcaf8068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:34.253 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:34.247+0000 7fcb1c565640 1 --2- 172.21.15.78:0/3739679918 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fcaf80664a0 0x7fcaf8068960 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fcb10007a60 tx=0x7fcb10008040 comp rx=0 tx=0).stop 2023-11-28T19:59:34.253 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:34.247+0000 7fcb1c565640 1 -- 172.21.15.78:0/3739679918 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcb140c3b80 msgr2=0x7fcb141f02c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:34.253 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:34.247+0000 7fcb1c565640 1 --2- 172.21.15.78:0/3739679918 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcb140c3b80 0x7fcb141f02c0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fcb0c00c780 tx=0x7fcb0c00cc40 comp rx=0 tx=0).stop 2023-11-28T19:59:34.253 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:34.247+0000 7fcb1c565640 1 -- 172.21.15.78:0/3739679918 shutdown_connections 2023-11-28T19:59:34.253 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:34.247+0000 7fcb1c565640 1 --2- 172.21.15.78:0/3739679918 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fcaf80664a0 0x7fcaf8068960 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:34.253 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:34.247+0000 7fcb1c565640 1 --2- 172.21.15.78:0/3739679918 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcb140c3b80 0x7fcb141f02c0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:34.254 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:34.247+0000 7fcb1c565640 1 --2- 172.21.15.78:0/3739679918 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcb1406d2b0 0x7fcb14159e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:34.254 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:34.247+0000 7fcb1c565640 1 --2- 172.21.15.78:0/3739679918 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcb1406c020 0x7fcb14159950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:34.254 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:34.247+0000 7fcb1c565640 1 -- 172.21.15.78:0/3739679918 >> 172.21.15.78:0/3739679918 conn(0x7fcb140a7810 msgr2=0x7fcb1406d690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T19:59:34.254 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:34.247+0000 7fcb1c565640 1 -- 172.21.15.78:0/3739679918 shutdown_connections 2023-11-28T19:59:34.254 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:34.247+0000 7fcb1c565640 1 -- 172.21.15.78:0/3739679918 wait complete. 2023-11-28T19:59:34.272 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-28T19:59:34.410 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:34.403+0000 7fb131a79640 1 Processor -- start 2023-11-28T19:59:34.410 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:34.403+0000 7fb131a79640 1 -- start start 2023-11-28T19:59:34.411 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:34.407+0000 7fb131a79640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fb12c06d2b0 0x7fb12c06d690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:34.411 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:34.407+0000 7fb131a79640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb12c06bb80 con 0x7fb12c0c5300 2023-11-28T19:59:34.411 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:34.407+0000 7fb131a79640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb12c0c5790 con 0x7fb12c0c3b80 2023-11-28T19:59:34.412 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:34.407+0000 7fb131a79640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb12c1515c0 con 0x7fb12c06d2b0 2023-11-28T19:59:34.412 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:34.407+0000 7fb12b7fe640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fb12c06d2b0 0x7fb12c06d690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:34.412 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:34.407+0000 7fb12bfff640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7fb12c0c5300 0x7fb12c06c730 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:54072/0 (socket says 172.21.15.78:54072) 2023-11-28T19:59:34.412 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:34.407+0000 7fb12b7fe640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fb12c06d2b0 0x7fb12c06d690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:53452/0 (socket says 172.21.15.78:53452) 2023-11-28T19:59:34.412 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:34.407+0000 7fb12bfff640 1 -- 172.21.15.78:0/3244531352 learned_addr learned my addr 172.21.15.78:0/3244531352 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-11-28T19:59:34.412 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:34.407+0000 7fb12b7fe640 1 -- 172.21.15.78:0/3244531352 >> v1:172.21.15.179:6789/0 conn(0x7fb12c0c3b80 legacy=0x7fb12c06c020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:34.413 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:34.407+0000 7fb12b7fe640 1 -- 172.21.15.78:0/3244531352 >> v1:172.21.15.78:6789/0 conn(0x7fb12c0c5300 legacy=0x7fb12c06c730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:34.413 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:34.407+0000 7fb12b7fe640 1 -- 172.21.15.78:0/3244531352 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb12c1518a0 con 0x7fb12c06d2b0 2023-11-28T19:59:34.414 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:34.407+0000 7fb12b7fe640 1 --2- 172.21.15.78:0/3244531352 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb12c06d2b0 0x7fb12c06d690 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fb11c00ba60 tx=0x7fb11c01eb20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c51df1ef4d7aa40 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:59:34.415 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:34.411+0000 7fb12a7fc640 1 -- 172.21.15.78:0/3244531352 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb11c0a7a00 con 0x7fb12c06d2b0 2023-11-28T19:59:34.415 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:34.411+0000 7fb12a7fc640 1 -- 172.21.15.78:0/3244531352 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb11c0a7b60 con 0x7fb12c06d2b0 2023-11-28T19:59:34.415 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:34.411+0000 7fb12a7fc640 1 -- 172.21.15.78:0/3244531352 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb11c0af440 con 0x7fb12c06d2b0 2023-11-28T19:59:34.416 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:34.411+0000 7fb131a79640 1 -- 172.21.15.78:0/3244531352 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb12c06d2b0 msgr2=0x7fb12c06d690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:34.416 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:34.411+0000 7fb131a79640 1 --2- 172.21.15.78:0/3244531352 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb12c06d2b0 0x7fb12c06d690 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fb11c00ba60 tx=0x7fb11c01eb20 comp rx=0 tx=0).stop 2023-11-28T19:59:34.416 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:34.411+0000 7fb131a79640 1 -- 172.21.15.78:0/3244531352 shutdown_connections 2023-11-28T19:59:34.416 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:34.411+0000 7fb131a79640 1 --2- 172.21.15.78:0/3244531352 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb12c06d2b0 0x7fb12c06d690 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:34.416 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:34.411+0000 7fb131a79640 1 -- 172.21.15.78:0/3244531352 >> 172.21.15.78:0/3244531352 conn(0x7fb12c0a7810 msgr2=0x7fb12c0a7c20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T19:59:34.416 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:34.411+0000 7fb131a79640 1 -- 172.21.15.78:0/3244531352 shutdown_connections 2023-11-28T19:59:34.416 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:34.411+0000 7fb131a79640 1 -- 172.21.15.78:0/3244531352 wait complete. 2023-11-28T19:59:34.417 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:34.411+0000 7fb131a79640 1 Processor -- start 2023-11-28T19:59:34.417 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:34.411+0000 7fb131a79640 1 -- start start 2023-11-28T19:59:34.419 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:34.411+0000 7fb131a79640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb12c06d2b0 0x7fb12c1edc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:34.420 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:34.411+0000 7fb131a79640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb12c0c3b80 0x7fb12c14f880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:34.420 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:34.411+0000 7fb131a79640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb12c0c5300 0x7fb12c152c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:34.420 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:34.411+0000 7fb131a79640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb12c149ca0 con 0x7fb12c06d2b0 2023-11-28T19:59:34.420 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:34.411+0000 7fb131a79640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb12c152900 con 0x7fb12c0c3b80 2023-11-28T19:59:34.420 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:34.411+0000 7fb131a79640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb12c149090 con 0x7fb12c0c5300 2023-11-28T19:59:34.420 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:34.411+0000 7fb12b7fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb12c06d2b0 0x7fb12c1edc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:34.420 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:34.411+0000 7fb12b7fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb12c06d2b0 0x7fb12c1edc70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:53464/0 (socket says 172.21.15.78:53464) 2023-11-28T19:59:34.420 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:34.411+0000 7fb12b7fe640 1 -- 172.21.15.78:0/2289678921 learned_addr learned my addr 172.21.15.78:0/2289678921 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T19:59:34.420 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:34.411+0000 7fb12affd640 1 --2- 172.21.15.78:0/2289678921 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb12c0c3b80 0x7fb12c14f880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:34.420 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:34.415+0000 7fb12bfff640 1 --2- 172.21.15.78:0/2289678921 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb12c0c5300 0x7fb12c152c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:34.421 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:34.415+0000 7fb12b7fe640 1 -- 172.21.15.78:0/2289678921 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb12c0c5300 msgr2=0x7fb12c152c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:34.421 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:34.415+0000 7fb12b7fe640 1 --2- 172.21.15.78:0/2289678921 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb12c0c5300 0x7fb12c152c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:34.421 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:34.415+0000 7fb12b7fe640 1 -- 172.21.15.78:0/2289678921 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb12c0c3b80 msgr2=0x7fb12c14f880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:34.421 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:34.415+0000 7fb12b7fe640 1 --2- 172.21.15.78:0/2289678921 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb12c0c3b80 0x7fb12c14f880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:34.421 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:34.415+0000 7fb12b7fe640 1 -- 172.21.15.78:0/2289678921 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb11c00b6c0 con 0x7fb12c06d2b0 2023-11-28T19:59:34.421 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:34.415+0000 7fb12b7fe640 1 --2- 172.21.15.78:0/2289678921 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb12c06d2b0 0x7fb12c1edc70 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fb11c01b730 tx=0x7fb11c01b8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:59:34.421 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:34.415+0000 7fb113fff640 1 -- 172.21.15.78:0/2289678921 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb11c0afe40 con 0x7fb12c06d2b0 2023-11-28T19:59:34.421 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:34.415+0000 7fb113fff640 1 -- 172.21.15.78:0/2289678921 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb11c0ba470 con 0x7fb12c06d2b0 2023-11-28T19:59:34.422 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:34.415+0000 7fb113fff640 1 -- 172.21.15.78:0/2289678921 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb11c0ba820 con 0x7fb12c06d2b0 2023-11-28T19:59:34.422 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:34.415+0000 7fb131a79640 1 -- 172.21.15.78:0/2289678921 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb12c14ef80 con 0x7fb12c06d2b0 2023-11-28T19:59:34.422 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:34.415+0000 7fb131a79640 1 -- 172.21.15.78:0/2289678921 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb12c149650 con 0x7fb12c06d2b0 2023-11-28T19:59:34.423 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:34.415+0000 7fb131a79640 1 -- 172.21.15.78:0/2289678921 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb12c067630 con 0x7fb12c06d2b0 2023-11-28T19:59:34.423 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:34.415+0000 7fb113fff640 1 -- 172.21.15.78:0/2289678921 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fb11c0b6070 con 0x7fb12c06d2b0 2023-11-28T19:59:34.423 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:34.415+0000 7fb113fff640 1 --2- 172.21.15.78:0/2289678921 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fb118066470 0x7fb118068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:34.424 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:34.415+0000 7fb113fff640 1 -- 172.21.15.78:0/2289678921 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fb11c11f720 con 0x7fb12c06d2b0 2023-11-28T19:59:34.424 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:34.415+0000 7fb12affd640 1 --2- 172.21.15.78:0/2289678921 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fb118066470 0x7fb118068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:34.424 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:34.419+0000 7fb12affd640 1 --2- 172.21.15.78:0/2289678921 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fb118066470 0x7fb118068930 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fb12c0a76f0 tx=0x7fb120009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:59:34.426 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:34.419+0000 7fb113fff640 1 -- 172.21.15.78:0/2289678921 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fb11c0eca60 con 0x7fb12c06d2b0 2023-11-28T19:59:34.575 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:34.567+0000 7fb131a79640 1 -- 172.21.15.78:0/2289678921 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb12c070270 con 0x7fb12c06d2b0 2023-11-28T19:59:34.576 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:34.571+0000 7fb113fff640 1 -- 172.21.15.78:0/2289678921 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+18322 (secure 0 0 0) 0x7fb11c0f0080 con 0x7fb12c06d2b0 2023-11-28T19:59:34.576 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-11-28T19:59:34.576 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":25,"fsid":"dd9780e8-3bda-44fa-a9f0-fa07d19d901d","created":"2023-11-28T19:58:40.969556+0000","modified":"2023-11-28T19:59:10.474525+0000","last_up_change":"2023-11-28T19:58:52.596716+0000","last_in_change":"2023-11-28T19:58:43.609275+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-28T19:58:54.011229+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-28T19:59:03.945559+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-28T19:59:04.481478+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-11-28T19:59:08.109152+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"e84245ac-b5da-429e-af18-39acaa2b33e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6800","nonce":3358701235},{"type":"v1","addr":"172.21.15.78:6801","nonce":3358701235}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6802","nonce":3358701235},{"type":"v1","addr":"172.21.15.78:6803","nonce":3358701235}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6806","nonce":3358701235},{"type":"v1","addr":"172.21.15.78:6807","nonce":3358701235}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6804","nonce":3358701235},{"type":"v1","addr":"172.21.15.78:6805","nonce":3358701235}]},"public_addr":"172.21.15.78:6801/3358701235","cluster_addr":"172.21.15.78:6803/3358701235","heartbeat_back_addr":"172.21.15.78:6807/3358701235","heartbeat_front_addr":"172.21.15.78:6805/3358701235","state":["exists","up"]},{"osd":1,"uuid":"e634831d-c4e2-48d9-870c-9556ae162981","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6808","nonce":3211476654},{"type":"v1","addr":"172.21.15.78:6809","nonce":3211476654}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6810","nonce":3211476654},{"type":"v1","addr":"172.21.15.78:6811","nonce":3211476654}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6814","nonce":3211476654},{"type":"v1","addr":"172.21.15.78:6815","nonce":3211476654}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6812","nonce":3211476654},{"type":"v1","addr":"172.21.15.78:6813","nonce":3211476654}]},"public_addr":"172.21.15.78:6809/3211476654","cluster_addr":"172.21.15.78:6811/3211476654","heartbeat_back_addr":"172.21.15.78:6815/3211476654","heartbeat_front_addr":"172.21.15.78:6813/3211476654","state":["exists","up"]},{"osd":2,"uuid":"274c8395-6534-41f0-b8fb-a00af8985aa8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6816","nonce":2532904479},{"type":"v1","addr":"172.21.15.78:6817","nonce":2532904479}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6818","nonce":2532904479},{"type":"v1","addr":"172.21.15.78:6819","nonce":2532904479}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6822","nonce":2532904479},{"type":"v1","addr":"172.21.15.78:6823","nonce":2532904479}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6820","nonce":2532904479},{"type":"v1","addr":"172.21.15.78:6821","nonce":2532904479}]},"public_addr":"172.21.15.78:6817/2532904479","cluster_addr":"172.21.15.78:6819/2532904479","heartbeat_back_addr":"172.21.15.78:6823/2532904479","heartbeat_front_addr":"172.21.15.78:6821/2532904479","state":["exists","up"]},{"osd":3,"uuid":"77acc9af-7d4d-4b18-8cf5-d62f5971b7c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6824","nonce":3442991267},{"type":"v1","addr":"172.21.15.78:6825","nonce":3442991267}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6826","nonce":3442991267},{"type":"v1","addr":"172.21.15.78:6827","nonce":3442991267}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6830","nonce":3442991267},{"type":"v1","addr":"172.21.15.78:6831","nonce":3442991267}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6828","nonce":3442991267},{"type":"v1","addr":"172.21.15.78:6829","nonce":3442991267}]},"public_addr":"172.21.15.78:6825/3442991267","cluster_addr":"172.21.15.78:6827/3442991267","heartbeat_back_addr":"172.21.15.78:6831/3442991267","heartbeat_front_addr":"172.21.15.78:6829/3442991267","state":["exists","up"]},{"osd":4,"uuid":"5c62bc66-6b34-4b7f-a66b-9a743969138c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":802983577},{"type":"v1","addr":"172.21.15.179:6809","nonce":802983577}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":802983577},{"type":"v1","addr":"172.21.15.179:6811","nonce":802983577}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":802983577},{"type":"v1","addr":"172.21.15.179:6815","nonce":802983577}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":802983577},{"type":"v1","addr":"172.21.15.179:6813","nonce":802983577}]},"public_addr":"172.21.15.179:6809/802983577","cluster_addr":"172.21.15.179:6811/802983577","heartbeat_back_addr":"172.21.15.179:6815/802983577","heartbeat_front_addr":"172.21.15.179:6813/802983577","state":["exists","up"]},{"osd":5,"uuid":"67db6d36-f684-4079-b0cd-82b4dd61461f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":518192887},{"type":"v1","addr":"172.21.15.179:6818","nonce":518192887}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":518192887},{"type":"v1","addr":"172.21.15.179:6822","nonce":518192887}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":518192887},{"type":"v1","addr":"172.21.15.179:6829","nonce":518192887}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6824","nonce":518192887},{"type":"v1","addr":"172.21.15.179:6826","nonce":518192887}]},"public_addr":"172.21.15.179:6818/518192887","cluster_addr":"172.21.15.179:6822/518192887","heartbeat_back_addr":"172.21.15.179:6829/518192887","heartbeat_front_addr":"172.21.15.179:6826/518192887","state":["exists","up"]},{"osd":6,"uuid":"12e670af-5a16-4c81-9f97-defa66cab967","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":815435378},{"type":"v1","addr":"172.21.15.179:6801","nonce":815435378}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":815435378},{"type":"v1","addr":"172.21.15.179:6803","nonce":815435378}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":815435378},{"type":"v1","addr":"172.21.15.179:6807","nonce":815435378}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":815435378},{"type":"v1","addr":"172.21.15.179:6805","nonce":815435378}]},"public_addr":"172.21.15.179:6801/815435378","cluster_addr":"172.21.15.179:6803/815435378","heartbeat_back_addr":"172.21.15.179:6807/815435378","heartbeat_front_addr":"172.21.15.179:6805/815435378","state":["exists","up"]},{"osd":7,"uuid":"fe630650-2eb3-49ad-8676-c341e6332eb1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6817","nonce":2848432339},{"type":"v1","addr":"172.21.15.179:6819","nonce":2848432339}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6821","nonce":2848432339},{"type":"v1","addr":"172.21.15.179:6823","nonce":2848432339}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":2848432339},{"type":"v1","addr":"172.21.15.179:6831","nonce":2848432339}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6825","nonce":2848432339},{"type":"v1","addr":"172.21.15.179:6827","nonce":2848432339}]},"public_addr":"172.21.15.179:6819/2848432339","cluster_addr":"172.21.15.179:6823/2848432339","heartbeat_back_addr":"172.21.15.179:6831/2848432339","heartbeat_front_addr":"172.21.15.179:6827/2848432339","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:58:49.255433+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:58:49.412880+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:58:49.559295+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:58:49.245237+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:58:49.184557+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:58:49.329851+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:58:49.366012+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:58:49.349604+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-28T19:59:34.578 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:34.571+0000 7fb131a79640 1 -- 172.21.15.78:0/2289678921 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fb118066470 msgr2=0x7fb118068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:34.578 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:34.571+0000 7fb131a79640 1 --2- 172.21.15.78:0/2289678921 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fb118066470 0x7fb118068930 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fb12c0a76f0 tx=0x7fb120009040 comp rx=0 tx=0).stop 2023-11-28T19:59:34.578 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:34.571+0000 7fb131a79640 1 -- 172.21.15.78:0/2289678921 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb12c06d2b0 msgr2=0x7fb12c1edc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:34.579 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:34.571+0000 7fb131a79640 1 --2- 172.21.15.78:0/2289678921 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb12c06d2b0 0x7fb12c1edc70 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fb11c01b730 tx=0x7fb11c01b8c0 comp rx=0 tx=0).stop 2023-11-28T19:59:34.579 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:34.571+0000 7fb131a79640 1 -- 172.21.15.78:0/2289678921 shutdown_connections 2023-11-28T19:59:34.579 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:34.571+0000 7fb131a79640 1 --2- 172.21.15.78:0/2289678921 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fb118066470 0x7fb118068930 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:34.579 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:34.571+0000 7fb131a79640 1 --2- 172.21.15.78:0/2289678921 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb12c0c5300 0x7fb12c152c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:34.579 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:34.571+0000 7fb131a79640 1 --2- 172.21.15.78:0/2289678921 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb12c0c3b80 0x7fb12c14f880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:34.579 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:34.571+0000 7fb131a79640 1 --2- 172.21.15.78:0/2289678921 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb12c06d2b0 0x7fb12c1edc70 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:34.579 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:34.571+0000 7fb131a79640 1 -- 172.21.15.78:0/2289678921 >> 172.21.15.78:0/2289678921 conn(0x7fb12c0a7810 msgr2=0x7fb12c071100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T19:59:34.579 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:34.571+0000 7fb131a79640 1 -- 172.21.15.78:0/2289678921 shutdown_connections 2023-11-28T19:59:34.579 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:34.571+0000 7fb131a79640 1 -- 172.21.15.78:0/2289678921 wait complete. 2023-11-28T19:59:34.598 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-28T19:59:34.735 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:34.731+0000 7f617cd56640 1 Processor -- start 2023-11-28T19:59:34.735 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:34.731+0000 7f617cd56640 1 -- start start 2023-11-28T19:59:34.738 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:34.731+0000 7f617cd56640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f61780aa990 0x7f61780c0e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:34.738 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:34.731+0000 7f617cd56640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f61780a4e30 0x7f61780c4860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:34.738 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:34.731+0000 7f617cd56640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f61780c4da0 0x7f61780c5900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:34.738 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:34.731+0000 7f617cd56640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f61780c1520 con 0x7f61780aa990 2023-11-28T19:59:34.738 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:34.731+0000 7f617cd56640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6178151c60 con 0x7f61780a4e30 2023-11-28T19:59:34.739 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:34.731+0000 7f617cd56640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f61780c17c0 con 0x7f61780c4da0 2023-11-28T19:59:34.739 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:34.731+0000 7f61777fe640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f61780aa990 0x7f61780c0e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:34.739 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:34.731+0000 7f61777fe640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f61780aa990 0x7f61780c0e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:53472/0 (socket says 172.21.15.78:53472) 2023-11-28T19:59:34.739 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:34.731+0000 7f61777fe640 1 -- 172.21.15.78:0/1995803481 learned_addr learned my addr 172.21.15.78:0/1995803481 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T19:59:34.739 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:34.731+0000 7f6176ffd640 1 --2- 172.21.15.78:0/1995803481 >> v2:172.21.15.179:3300/0 conn(0x7f61780a4e30 0x7f61780c4860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:34.740 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:34.731+0000 7f6177fff640 1 --2- 172.21.15.78:0/1995803481 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f61780c4da0 0x7f61780c5900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:34.740 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:34.731+0000 7f61777fe640 1 -- 172.21.15.78:0/1995803481 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f61780c4da0 msgr2=0x7f61780c5900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T19:59:34.740 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:34.731+0000 7f61777fe640 1 --2- 172.21.15.78:0/1995803481 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f61780c4da0 0x7f61780c5900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:34.740 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:34.731+0000 7f61777fe640 1 -- 172.21.15.78:0/1995803481 >> v2:172.21.15.179:3300/0 conn(0x7f61780a4e30 msgr2=0x7f61780c4860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T19:59:34.740 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:34.731+0000 7f61777fe640 1 --2- 172.21.15.78:0/1995803481 >> v2:172.21.15.179:3300/0 conn(0x7f61780a4e30 0x7f61780c4860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:34.741 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:34.731+0000 7f61777fe640 1 -- 172.21.15.78:0/1995803481 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6178151f40 con 0x7f61780aa990 2023-11-28T19:59:34.741 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:34.731+0000 7f6177fff640 1 --2- 172.21.15.78:0/1995803481 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f61780c4da0 0x7f61780c5900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T19:59:34.741 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:34.731+0000 7f6176ffd640 1 --2- 172.21.15.78:0/1995803481 >> v2:172.21.15.179:3300/0 conn(0x7f61780a4e30 0x7f61780c4860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T19:59:34.743 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:34.735+0000 7f61777fe640 1 --2- 172.21.15.78:0/1995803481 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f61780aa990 0x7f61780c0e10 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f617806e260 tx=0x7f616801c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8d6679ac4fe4cdf3 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:59:34.743 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:34.735+0000 7f61767fc640 1 -- 172.21.15.78:0/1995803481 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61780c6650 con 0x7f61780aa990 2023-11-28T19:59:34.743 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:34.735+0000 7f61767fc640 1 -- 172.21.15.78:0/1995803481 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f61680a7050 con 0x7f61780aa990 2023-11-28T19:59:34.744 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:34.735+0000 7f61767fc640 1 -- 172.21.15.78:0/1995803481 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61680ab820 con 0x7f61780aa990 2023-11-28T19:59:34.744 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:34.735+0000 7f617cd56640 1 -- 172.21.15.78:0/1995803481 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f61780aa990 msgr2=0x7f61780c0e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:34.744 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:34.735+0000 7f617cd56640 1 --2- 172.21.15.78:0/1995803481 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f61780aa990 0x7f61780c0e10 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f617806e260 tx=0x7f616801c470 comp rx=0 tx=0).stop 2023-11-28T19:59:34.744 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:34.735+0000 7f617cd56640 1 -- 172.21.15.78:0/1995803481 shutdown_connections 2023-11-28T19:59:34.744 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:34.735+0000 7f617cd56640 1 --2- 172.21.15.78:0/1995803481 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f61780c4da0 0x7f61780c5900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:34.744 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:34.735+0000 7f617cd56640 1 --2- 172.21.15.78:0/1995803481 >> v2:172.21.15.179:3300/0 conn(0x7f61780a4e30 0x7f61780c4860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:34.744 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:34.735+0000 7f617cd56640 1 --2- 172.21.15.78:0/1995803481 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f61780aa990 0x7f61780c0e10 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:34.744 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:34.735+0000 7f617cd56640 1 -- 172.21.15.78:0/1995803481 >> 172.21.15.78:0/1995803481 conn(0x7f61780a7600 msgr2=0x7f61780a7a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T19:59:34.745 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:34.735+0000 7f617cd56640 1 -- 172.21.15.78:0/1995803481 shutdown_connections 2023-11-28T19:59:34.745 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:34.735+0000 7f617cd56640 1 -- 172.21.15.78:0/1995803481 wait complete. 2023-11-28T19:59:34.745 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:34.735+0000 7f617cd56640 1 Processor -- start 2023-11-28T19:59:34.745 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:34.735+0000 7f617cd56640 1 -- start start 2023-11-28T19:59:34.749 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:34.739+0000 7f617cd56640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f61780a4e30 0x7f61781e4200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:34.749 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:34.739+0000 7f617cd56640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f61780aa990 0x7f617814b250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:34.749 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:34.739+0000 7f617cd56640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f61780c4da0 0x7f61781ed5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:34.749 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:34.739+0000 7f617cd56640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f617814c6b0 con 0x7f61780aa990 2023-11-28T19:59:34.749 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:34.739+0000 7f617cd56640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f617814fc40 con 0x7f61780c4da0 2023-11-28T19:59:34.749 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:34.739+0000 7f617cd56640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f61781ed170 con 0x7f61780a4e30 2023-11-28T19:59:34.749 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:34.739+0000 7f6176ffd640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f61780aa990 0x7f617814b250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:34.749 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:34.739+0000 7f6176ffd640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f61780aa990 0x7f617814b250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:53484/0 (socket says 172.21.15.78:53484) 2023-11-28T19:59:34.750 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:34.739+0000 7f6176ffd640 1 -- 172.21.15.78:0/1643559316 learned_addr learned my addr 172.21.15.78:0/1643559316 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T19:59:34.750 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:34.739+0000 7f6177fff640 1 --2- 172.21.15.78:0/1643559316 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f61780c4da0 0x7f61781ed5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:34.750 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:34.739+0000 7f61777fe640 1 --2- 172.21.15.78:0/1643559316 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f61780a4e30 0x7f61781e4200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:34.750 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:34.739+0000 7f6176ffd640 1 -- 172.21.15.78:0/1643559316 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f61780a4e30 msgr2=0x7f61781e4200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:34.750 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:34.739+0000 7f6176ffd640 1 --2- 172.21.15.78:0/1643559316 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f61780a4e30 0x7f61781e4200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:34.750 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:34.739+0000 7f6176ffd640 1 -- 172.21.15.78:0/1643559316 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f61780c4da0 msgr2=0x7f61781ed5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:34.750 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:34.739+0000 7f6176ffd640 1 --2- 172.21.15.78:0/1643559316 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f61780c4da0 0x7f61781ed5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:34.750 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:34.739+0000 7f6176ffd640 1 -- 172.21.15.78:0/1643559316 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61680094d0 con 0x7f61780aa990 2023-11-28T19:59:34.750 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:34.739+0000 7f6177fff640 1 --2- 172.21.15.78:0/1643559316 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f61780c4da0 0x7f61781ed5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T19:59:34.750 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:34.739+0000 7f6176ffd640 1 --2- 172.21.15.78:0/1643559316 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f61780aa990 0x7f617814b250 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f616c00c7f0 tx=0x7f616c00ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:59:34.750 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:34.739+0000 7f615ffff640 1 -- 172.21.15.78:0/1643559316 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f616c007820 con 0x7f61780aa990 2023-11-28T19:59:34.751 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:34.739+0000 7f615ffff640 1 -- 172.21.15.78:0/1643559316 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f616c007980 con 0x7f61780aa990 2023-11-28T19:59:34.751 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:34.739+0000 7f615ffff640 1 -- 172.21.15.78:0/1643559316 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f616c007d30 con 0x7f61780aa990 2023-11-28T19:59:34.751 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:34.739+0000 7f617cd56640 1 -- 172.21.15.78:0/1643559316 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f617814c180 con 0x7f61780aa990 2023-11-28T19:59:34.751 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:34.739+0000 7f617cd56640 1 -- 172.21.15.78:0/1643559316 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f617814c3d0 con 0x7f61780aa990 2023-11-28T19:59:34.751 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:34.739+0000 7f617cd56640 1 -- 172.21.15.78:0/1643559316 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f61781ed2e0 con 0x7f61780aa990 2023-11-28T19:59:34.751 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:34.743+0000 7f615ffff640 1 -- 172.21.15.78:0/1643559316 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f616c0113f0 con 0x7f61780aa990 2023-11-28T19:59:34.751 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:34.743+0000 7f615ffff640 1 --2- 172.21.15.78:0/1643559316 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f6164066470 0x7f6164068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:34.751 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:34.743+0000 7f615ffff640 1 -- 172.21.15.78:0/1643559316 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f616c084430 con 0x7f61780aa990 2023-11-28T19:59:34.752 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:34.743+0000 7f61777fe640 1 --2- 172.21.15.78:0/1643559316 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f6164066470 0x7f6164068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:34.752 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:34.743+0000 7f61777fe640 1 --2- 172.21.15.78:0/1643559316 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f6164066470 0x7f6164068930 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f61680ad000 tx=0x7f6168008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:59:34.752 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:34.747+0000 7f615ffff640 1 -- 172.21.15.78:0/1643559316 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f616c051540 con 0x7f61780aa990 2023-11-28T19:59:34.933 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:34.927+0000 7f617cd56640 1 -- 172.21.15.78:0/1643559316 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f61780a7f50 con 0x7f61780aa990 2023-11-28T19:59:34.934 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:34.927+0000 7f615ffff640 1 -- 172.21.15.78:0/1643559316 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4915 (secure 0 0 0) 0x7f616c054b60 con 0x7f61780aa990 2023-11-28T19:59:34.934 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-11-28T19:59:34.935 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4241,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6835/3089461479","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6833","nonce":3089461479},{"type":"v1","addr":"172.21.15.179:6835","nonce":3089461479}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4258,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6837/3153162191","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6834","nonce":3153162191},{"type":"v1","addr":"172.21.15.78:6837","nonce":3153162191}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4266,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6836/3073967897","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6835","nonce":3073967897},{"type":"v1","addr":"172.21.15.78:6836","nonce":3073967897}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-28T19:59:05.411488+0000","modified":"2023-11-28T19:59:23.150979+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4275},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4275":{"gid":4275,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.179:6834/1234044491","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6832","nonce":1234044491},{"type":"v1","addr":"172.21.15.179:6834","nonce":1234044491}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-11-28T19:59:34.936 INFO:teuthology.orchestra.run.smithi078.stderr:dumped fsmap epoch 9 2023-11-28T19:59:34.937 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:34.931+0000 7f617cd56640 1 -- 172.21.15.78:0/1643559316 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f6164066470 msgr2=0x7f6164068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:34.937 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:34.931+0000 7f617cd56640 1 --2- 172.21.15.78:0/1643559316 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f6164066470 0x7f6164068930 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f61680ad000 tx=0x7f6168008040 comp rx=0 tx=0).stop 2023-11-28T19:59:34.937 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:34.931+0000 7f617cd56640 1 -- 172.21.15.78:0/1643559316 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f61780aa990 msgr2=0x7f617814b250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:34.937 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:34.931+0000 7f617cd56640 1 --2- 172.21.15.78:0/1643559316 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f61780aa990 0x7f617814b250 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f616c00c7f0 tx=0x7f616c00ccb0 comp rx=0 tx=0).stop 2023-11-28T19:59:34.938 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:34.931+0000 7f617cd56640 1 -- 172.21.15.78:0/1643559316 shutdown_connections 2023-11-28T19:59:34.938 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:34.931+0000 7f617cd56640 1 --2- 172.21.15.78:0/1643559316 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f6164066470 0x7f6164068930 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:34.938 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:34.931+0000 7f617cd56640 1 --2- 172.21.15.78:0/1643559316 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f61780c4da0 0x7f61781ed5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:34.938 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:34.931+0000 7f617cd56640 1 --2- 172.21.15.78:0/1643559316 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f61780aa990 0x7f617814b250 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:34.938 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:34.931+0000 7f617cd56640 1 --2- 172.21.15.78:0/1643559316 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f61780a4e30 0x7f61781e4200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:34.939 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:34.931+0000 7f617cd56640 1 -- 172.21.15.78:0/1643559316 >> 172.21.15.78:0/1643559316 conn(0x7f61780a7600 msgr2=0x7f617806ba60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T19:59:34.939 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:34.931+0000 7f617cd56640 1 -- 172.21.15.78:0/1643559316 shutdown_connections 2023-11-28T19:59:34.940 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:34.931+0000 7f617cd56640 1 -- 172.21.15.78:0/1643559316 wait complete. 2023-11-28T19:59:35.357 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 9, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-11-28T19:59:05.411488+0000', 'modified': '2023-11-28T19:59:23.150979+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4275}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4275': {'gid': 4275, 'name': 'b', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.179:6834/1234044491', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.179:6832', 'nonce': 1234044491}, {'type': 'v1', 'addr': '172.21.15.179:6834', 'nonce': 1234044491}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-11-28T19:59:35.357 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-11-28T19:59:35.358 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2023-11-28T19:59:35.496 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:35.491+0000 7f9e5d165640 1 Processor -- start 2023-11-28T19:59:35.496 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:35.491+0000 7f9e5d165640 1 -- start start 2023-11-28T19:59:35.497 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:35.491+0000 7f9e5d165640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f9e58154390 0x7f9e580c4a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:35.497 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:35.491+0000 7f9e5d165640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f9e580c2110 0x7f9e580c5ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:35.498 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:35.491+0000 7f9e5d165640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9e580a93d0 con 0x7f9e580c4f80 2023-11-28T19:59:35.498 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:35.491+0000 7f9e5d165640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9e580aa1c0 con 0x7f9e58154390 2023-11-28T19:59:35.498 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:35.491+0000 7f9e5d165640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9e58154770 con 0x7f9e580c2110 2023-11-28T19:59:35.498 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:35.491+0000 7f9e56d9d640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f9e58154390 0x7f9e580c4a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:35.498 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:35.491+0000 7f9e56d9d640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f9e58154390 0x7f9e580c4a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:36872/0 (socket says 172.21.15.78:36872) 2023-11-28T19:59:35.498 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:35.491+0000 7f9e56d9d640 1 -- 172.21.15.78:0/31225209 learned_addr learned my addr 172.21.15.78:0/31225209 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T19:59:35.498 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:35.491+0000 7f9e5759e640 1 --1- 172.21.15.78:0/31225209 >> v1:172.21.15.78:6789/0 conn(0x7f9e580c4f80 0x7f9e580c61e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:60724/0 (socket says 172.21.15.78:60724) 2023-11-28T19:59:35.498 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:35.491+0000 7f9e56d9d640 1 -- 172.21.15.78:0/31225209 >> v2:172.21.15.179:3300/0 conn(0x7f9e580c2110 msgr2=0x7f9e580c5ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T19:59:35.498 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:35.491+0000 7f9e56d9d640 1 --2- 172.21.15.78:0/31225209 >> v2:172.21.15.179:3300/0 conn(0x7f9e580c2110 0x7f9e580c5ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:35.499 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:35.491+0000 7f9e56d9d640 1 -- 172.21.15.78:0/31225209 >> v1:172.21.15.78:6789/0 conn(0x7f9e580c4f80 legacy=0x7f9e580c61e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:35.499 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:35.491+0000 7f9e56d9d640 1 -- 172.21.15.78:0/31225209 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e580a9640 con 0x7f9e58154390 2023-11-28T19:59:35.500 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:35.495+0000 7f9e56d9d640 1 --2- 172.21.15.78:0/31225209 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9e58154390 0x7f9e580c4a40 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f9e580bfe50 tx=0x7f9e4801c500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a1abb363187036a4 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:59:35.501 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:35.495+0000 7f9e5659c640 1 -- 172.21.15.78:0/31225209 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e480ac640 con 0x7f9e58154390 2023-11-28T19:59:35.501 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:35.495+0000 7f9e5659c640 1 -- 172.21.15.78:0/31225209 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e480ac7a0 con 0x7f9e58154390 2023-11-28T19:59:35.501 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:35.495+0000 7f9e5659c640 1 -- 172.21.15.78:0/31225209 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e480acb30 con 0x7f9e58154390 2023-11-28T19:59:35.502 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:35.495+0000 7f9e5d165640 1 -- 172.21.15.78:0/31225209 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9e58154390 msgr2=0x7f9e580c4a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:35.502 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:35.495+0000 7f9e5d165640 1 --2- 172.21.15.78:0/31225209 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9e58154390 0x7f9e580c4a40 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f9e580bfe50 tx=0x7f9e4801c500 comp rx=0 tx=0).stop 2023-11-28T19:59:35.502 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:35.495+0000 7f9e5d165640 1 -- 172.21.15.78:0/31225209 shutdown_connections 2023-11-28T19:59:35.502 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:35.495+0000 7f9e5d165640 1 --2- 172.21.15.78:0/31225209 >> v2:172.21.15.179:3300/0 conn(0x7f9e580c2110 0x7f9e580c5ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:35.502 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:35.495+0000 7f9e5d165640 1 --2- 172.21.15.78:0/31225209 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9e58154390 0x7f9e580c4a40 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:35.502 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:35.495+0000 7f9e5d165640 1 -- 172.21.15.78:0/31225209 >> 172.21.15.78:0/31225209 conn(0x7f9e5806b220 msgr2=0x7f9e580a77e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T19:59:35.502 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:35.495+0000 7f9e5d165640 1 -- 172.21.15.78:0/31225209 shutdown_connections 2023-11-28T19:59:35.502 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:35.495+0000 7f9e5d165640 1 -- 172.21.15.78:0/31225209 wait complete. 2023-11-28T19:59:35.503 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:35.499+0000 7f9e5d165640 1 Processor -- start 2023-11-28T19:59:35.503 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:35.499+0000 7f9e5d165640 1 -- start start 2023-11-28T19:59:35.506 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:35.499+0000 7f9e5d165640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9e580c2110 0x7f9e5814dcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:35.506 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:35.499+0000 7f9e5d165640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9e580c4f80 0x7f9e5814c960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:35.506 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:35.499+0000 7f9e5d165640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9e58154390 0x7f9e5814cea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:35.506 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:35.499+0000 7f9e5d165640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e5814c4d0 con 0x7f9e580c4f80 2023-11-28T19:59:35.506 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:35.499+0000 7f9e5d165640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e58070410 con 0x7f9e58154390 2023-11-28T19:59:35.506 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:35.499+0000 7f9e5d165640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9e581441c0 con 0x7f9e580c2110 2023-11-28T19:59:35.506 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:35.499+0000 7f9e4e59c640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9e580c4f80 0x7f9e5814c960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:35.506 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:35.499+0000 7f9e4e59c640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9e580c4f80 0x7f9e5814c960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:36886/0 (socket says 172.21.15.78:36886) 2023-11-28T19:59:35.507 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:35.499+0000 7f9e4e59c640 1 -- 172.21.15.78:0/658427844 learned_addr learned my addr 172.21.15.78:0/658427844 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T19:59:35.507 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:35.499+0000 7f9e56d9d640 1 --2- 172.21.15.78:0/658427844 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9e580c2110 0x7f9e5814dcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:35.507 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:35.499+0000 7f9e5759e640 1 --2- 172.21.15.78:0/658427844 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9e58154390 0x7f9e5814cea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:35.507 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:35.499+0000 7f9e4e59c640 1 -- 172.21.15.78:0/658427844 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9e580c2110 msgr2=0x7f9e5814dcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:35.507 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:35.499+0000 7f9e4e59c640 1 --2- 172.21.15.78:0/658427844 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9e580c2110 0x7f9e5814dcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:35.507 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:35.499+0000 7f9e4e59c640 1 -- 172.21.15.78:0/658427844 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9e58154390 msgr2=0x7f9e5814cea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:35.507 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:35.499+0000 7f9e4e59c640 1 --2- 172.21.15.78:0/658427844 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9e58154390 0x7f9e5814cea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:35.507 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:35.499+0000 7f9e4e59c640 1 -- 172.21.15.78:0/658427844 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e480094d0 con 0x7f9e580c4f80 2023-11-28T19:59:35.507 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:35.499+0000 7f9e4e59c640 1 --2- 172.21.15.78:0/658427844 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9e580c4f80 0x7f9e5814c960 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f9e4000ba50 tx=0x7f9e4000bf10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:59:35.507 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:35.499+0000 7f9e4ffff640 1 -- 172.21.15.78:0/658427844 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e4000cbe0 con 0x7f9e580c4f80 2023-11-28T19:59:35.508 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:35.499+0000 7f9e4ffff640 1 -- 172.21.15.78:0/658427844 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e4000cd60 con 0x7f9e580c4f80 2023-11-28T19:59:35.508 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:35.499+0000 7f9e4ffff640 1 -- 172.21.15.78:0/658427844 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e40014680 con 0x7f9e580c4f80 2023-11-28T19:59:35.508 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:35.499+0000 7f9e5d165640 1 -- 172.21.15.78:0/658427844 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9e580706d0 con 0x7f9e580c4f80 2023-11-28T19:59:35.508 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:35.499+0000 7f9e5d165640 1 -- 172.21.15.78:0/658427844 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9e5814b940 con 0x7f9e580c4f80 2023-11-28T19:59:35.508 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:35.503+0000 7f9e4ffff640 1 -- 172.21.15.78:0/658427844 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f9e4001d3b0 con 0x7f9e580c4f80 2023-11-28T19:59:35.509 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:35.503+0000 7f9e4ffff640 1 --2- 172.21.15.78:0/658427844 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f9e38066470 0x7f9e38068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:35.509 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:35.503+0000 7f9e4ffff640 1 -- 172.21.15.78:0/658427844 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f9e40084090 con 0x7f9e580c4f80 2023-11-28T19:59:35.510 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:35.503+0000 7f9e56d9d640 1 --2- 172.21.15.78:0/658427844 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f9e38066470 0x7f9e38068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:35.510 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:35.503+0000 7f9e604c0000 1 Processor -- start 2023-11-28T19:59:35.513 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:35.503+0000 7f9e604c0000 1 -- start start 2023-11-28T19:59:35.513 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:35.503+0000 7f9e56d9d640 1 --2- 172.21.15.78:0/658427844 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f9e38066470 0x7f9e38068930 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f9e480ae000 tx=0x7f9e480a6070 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:59:35.513 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:35.503+0000 7f9e604c0000 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55fea1d24920 0x55fea1d24d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:35.513 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:35.503+0000 7f9e604c0000 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55fea1ceb6f0 0x55fea1cebad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:35.513 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:35.503+0000 7f9e604c0000 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55fea1cec010 0x55fea1cec3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:35.513 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:35.503+0000 7f9e604c0000 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fea1b54130 con 0x55fea1d24920 2023-11-28T19:59:35.513 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:35.503+0000 7f9e604c0000 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fea1b419a0 con 0x55fea1ceb6f0 2023-11-28T19:59:35.514 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:35.503+0000 7f9e604c0000 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x55fea1b3eed0 con 0x55fea1cec010 2023-11-28T19:59:35.514 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:35.507+0000 7f9e56d9d640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55fea1d24920 0x55fea1d24d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:35.514 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:35.507+0000 7f9e56d9d640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55fea1d24920 0x55fea1d24d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:36896/0 (socket says 172.21.15.78:36896) 2023-11-28T19:59:35.514 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:35.507+0000 7f9e56d9d640 1 -- 172.21.15.78:0/371068287 learned_addr learned my addr 172.21.15.78:0/371068287 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T19:59:35.514 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:35.507+0000 7f9e4e59c640 1 --2- 172.21.15.78:0/371068287 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55fea1ceb6f0 0x55fea1cebad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:35.514 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:35.507+0000 7f9e5759e640 1 --2- 172.21.15.78:0/371068287 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55fea1cec010 0x55fea1cec3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:35.514 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:35.507+0000 7f9e56d9d640 1 -- 172.21.15.78:0/371068287 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55fea1cec010 msgr2=0x55fea1cec3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T19:59:35.514 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:35.507+0000 7f9e56d9d640 1 --2- 172.21.15.78:0/371068287 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55fea1cec010 0x55fea1cec3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:35.514 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:35.507+0000 7f9e56d9d640 1 -- 172.21.15.78:0/371068287 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55fea1ceb6f0 msgr2=0x55fea1cebad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T19:59:35.515 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:35.507+0000 7f9e56d9d640 1 --2- 172.21.15.78:0/371068287 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55fea1ceb6f0 0x55fea1cebad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:35.515 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:35.507+0000 7f9e56d9d640 1 -- 172.21.15.78:0/371068287 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55fea1832890 con 0x55fea1d24920 2023-11-28T19:59:35.515 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:35.507+0000 7f9e4e59c640 1 --2- 172.21.15.78:0/371068287 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55fea1ceb6f0 0x55fea1cebad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T19:59:35.515 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:35.507+0000 7f9e56d9d640 1 --2- 172.21.15.78:0/371068287 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55fea1d24920 0x55fea1d24d00 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f9e480097f0 tx=0x7f9e48004740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a0ba16132f18cc8c server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:59:35.515 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:35.507+0000 7f9e4cd99640 1 -- 172.21.15.78:0/371068287 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e480b6670 con 0x55fea1d24920 2023-11-28T19:59:35.515 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:35.507+0000 7f9e4cd99640 1 -- 172.21.15.78:0/371068287 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e480b67d0 con 0x55fea1d24920 2023-11-28T19:59:35.515 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:35.507+0000 7f9e4cd99640 1 -- 172.21.15.78:0/371068287 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e480b6b40 con 0x55fea1d24920 2023-11-28T19:59:35.515 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:35.507+0000 7f9e604c0000 1 -- 172.21.15.78:0/371068287 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55fea1d24920 msgr2=0x55fea1d24d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:35.515 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:35.507+0000 7f9e604c0000 1 --2- 172.21.15.78:0/371068287 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55fea1d24920 0x55fea1d24d00 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f9e480097f0 tx=0x7f9e48004740 comp rx=0 tx=0).stop 2023-11-28T19:59:35.515 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:35.507+0000 7f9e604c0000 1 -- 172.21.15.78:0/371068287 shutdown_connections 2023-11-28T19:59:35.516 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:35.507+0000 7f9e604c0000 1 --2- 172.21.15.78:0/371068287 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55fea1cec010 0x55fea1cec3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:35.516 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:35.507+0000 7f9e604c0000 1 --2- 172.21.15.78:0/371068287 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55fea1ceb6f0 0x55fea1cebad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:35.516 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:35.507+0000 7f9e604c0000 1 --2- 172.21.15.78:0/371068287 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55fea1d24920 0x55fea1d24d00 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:35.516 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:35.507+0000 7f9e604c0000 1 -- 172.21.15.78:0/371068287 >> 172.21.15.78:0/371068287 conn(0x55fea1cf0190 msgr2=0x55fea1d277a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T19:59:35.516 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:35.507+0000 7f9e604c0000 1 -- 172.21.15.78:0/371068287 shutdown_connections 2023-11-28T19:59:35.516 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:35.507+0000 7f9e604c0000 1 -- 172.21.15.78:0/371068287 wait complete. 2023-11-28T19:59:35.520 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:35.507+0000 7f9e604c0000 1 -- start start 2023-11-28T19:59:35.520 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:35.507+0000 7f9e604c0000 1 Processor -- start 2023-11-28T19:59:35.520 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:35.507+0000 7f9e604c0000 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55fea1ceb6f0 0x55fea1d23740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:35.520 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:35.507+0000 7f9e604c0000 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55fea1cec010 0x55fea1d23c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:35.520 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:35.507+0000 7f9e604c0000 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55fea1d24920 0x55fea1d29a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:35.520 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:35.507+0000 7f9e604c0000 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fea1b3a7c0 con 0x55fea1d24920 2023-11-28T19:59:35.521 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:35.507+0000 7f9e604c0000 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fea1af2bf0 con 0x55fea1ceb6f0 2023-11-28T19:59:35.521 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:35.507+0000 7f9e604c0000 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x55fea1af8a90 con 0x55fea1cec010 2023-11-28T19:59:35.521 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:35.507+0000 7f9e604c0000 10 client.0 _ll_register_callbacks cb 0x55fea1cd53c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-28T19:59:35.521 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:35.511+0000 7f9e5759e640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55fea1d24920 0x55fea1d29a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:35.521 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:35.511+0000 7f9e5759e640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55fea1d24920 0x55fea1d29a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:36898/0 (socket says 172.21.15.78:36898) 2023-11-28T19:59:35.521 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:35.511+0000 7f9e5759e640 1 -- 172.21.15.78:0/1668524904 learned_addr learned my addr 172.21.15.78:0/1668524904 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T19:59:35.521 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:35.511+0000 7f9e56d9d640 1 --2- 172.21.15.78:0/1668524904 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55fea1ceb6f0 0x55fea1d23740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:35.521 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:35.511+0000 7f9e4e59c640 1 --2- 172.21.15.78:0/1668524904 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55fea1cec010 0x55fea1d23c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:35.521 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:35.511+0000 7f9e5759e640 1 -- 172.21.15.78:0/1668524904 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55fea1cec010 msgr2=0x55fea1d23c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T19:59:35.521 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:35.511+0000 7f9e5759e640 1 --2- 172.21.15.78:0/1668524904 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55fea1cec010 0x55fea1d23c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:35.522 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:35.511+0000 7f9e5759e640 1 -- 172.21.15.78:0/1668524904 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55fea1ceb6f0 msgr2=0x55fea1d23740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T19:59:35.522 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:35.511+0000 7f9e5759e640 1 --2- 172.21.15.78:0/1668524904 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55fea1ceb6f0 0x55fea1d23740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:35.522 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:35.511+0000 7f9e5759e640 1 -- 172.21.15.78:0/1668524904 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9e580a9640 con 0x55fea1d24920 2023-11-28T19:59:35.522 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:35.511+0000 7f9e56d9d640 1 --2- 172.21.15.78:0/1668524904 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55fea1ceb6f0 0x55fea1d23740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T19:59:35.522 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:35.511+0000 7f9e5759e640 1 --2- 172.21.15.78:0/1668524904 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55fea1d24920 0x55fea1d29a20 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f9e50009c90 tx=0x7f9e50001570 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7c276d5310591c3c server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:59:35.522 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:35.511+0000 7f9e35ffb640 10 client.0 ms_handle_connect on v2:172.21.15.78:3300/0 2023-11-28T19:59:35.522 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:35.511+0000 7f9e35ffb640 1 -- 172.21.15.78:0/1668524904 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e50006110 con 0x55fea1d24920 2023-11-28T19:59:35.522 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:35.511+0000 7f9e35ffb640 1 -- 172.21.15.78:0/1668524904 <== mon.0 v2:172.21.15.78:3300/0 2 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f9e50016d80 con 0x55fea1d24920 2023-11-28T19:59:35.522 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:35.511+0000 7f9e604c0000 1 -- 172.21.15.78:0/1668524904 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55fea1afc470 con 0x55fea1d24920 2023-11-28T19:59:35.522 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:35.511+0000 7f9e35ffb640 1 -- 172.21.15.78:0/1668524904 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_get_version_reply(handle=1 version=9) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9e50006270 con 0x55fea1d24920 2023-11-28T19:59:35.523 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:35.511+0000 7f9e604c0000 10 client.4755 fetch_fsmap learned FSMap version 9 2023-11-28T19:59:35.523 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:35.511+0000 7f9e604c0000 1 -- 172.21.15.78:0/1668524904 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) v3 -- 0x55fea1afb190 con 0x55fea1d24920 2023-11-28T19:59:35.523 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:35.511+0000 7f9e35ffb640 1 -- 172.21.15.78:0/1668524904 <== mon.0 v2:172.21.15.78:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55fea1afc470 con 0x55fea1d24920 2023-11-28T19:59:35.523 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:35.511+0000 7f9e35ffb640 1 -- 172.21.15.78:0/1668524904 <== mon.0 v2:172.21.15.78:3300/0 5 ==== fsmap(e 9) v1 ==== 3302+0+0 (secure 0 0 0) 0x7f9e5001e070 con 0x55fea1d24920 2023-11-28T19:59:35.523 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:35.511+0000 7f9e604c0000 10 client.4755 fetch_fsmap finished waiting for FSMap version 9 2023-11-28T19:59:35.523 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:35.511+0000 7f9e604c0000 10 client.4755 resolve_mds: resolved name 'b' to daemon mds.b 2023-11-28T19:59:35.523 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:35.511+0000 7f9e604c0000 20 client.4755 populate_metadata read hostname 'smithi078' 2023-11-28T19:59:35.523 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:35.511+0000 7f9e604c0000 1 --2- 172.21.15.78:0/1668524904 >> [v2:172.21.15.179:6832/1234044491,v1:172.21.15.179:6834/1234044491] conn(0x55fea1d2a760 0x55fea1d2ab40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:35.523 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:35.511+0000 7f9e604c0000 4 client.4755 mds_command: new command op to 4275 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-11-28T19:59:35.523 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:35.511+0000 7f9e604c0000 1 -- 172.21.15.78:0/1668524904 --> [v2:172.21.15.179:6832/1234044491,v1:172.21.15.179:6834/1234044491] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55fea1affb50 con 0x55fea1d2a760 2023-11-28T19:59:35.524 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:35.511+0000 7f9e56d9d640 1 --2- 172.21.15.78:0/1668524904 >> [v2:172.21.15.179:6832/1234044491,v1:172.21.15.179:6834/1234044491] conn(0x55fea1d2a760 0x55fea1d2ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:35.524 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:35.511+0000 7f9e56d9d640 1 --2- 172.21.15.78:0/1668524904 >> [v2:172.21.15.179:6832/1234044491,v1:172.21.15.179:6834/1234044491] conn(0x55fea1d2a760 0x55fea1d2ab40 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d9c56474f57a58b0 server_cookie=cd67ecc40e361fd7 in_seq=0 out_seq=0 2023-11-28T19:59:35.524 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:35.511+0000 7f9e35ffb640 10 client.4755 ms_handle_connect on v2:172.21.15.179:6832/1234044491 2023-11-28T19:59:35.524 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:35.511+0000 7f9e35ffb640 1 -- 172.21.15.78:0/1668524904 <== mds.0 v2:172.21.15.179:6832/1234044491 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55fea1affb50 con 0x55fea1d2a760 2023-11-28T19:59:35.524 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:35.511+0000 7f9e35ffb640 10 client.4755 handle_command_reply: tid=0 2023-11-28T19:59:35.524 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:35.511+0000 7f9e604c0000 1 client.4755 shutdown 2023-11-28T19:59:35.524 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:35.511+0000 7f9e604c0000 1 -- 172.21.15.78:0/1668524904 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55fea1d24920 msgr2=0x55fea1d29a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:35.524 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:35.511+0000 7f9e604c0000 1 --2- 172.21.15.78:0/1668524904 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55fea1d24920 0x55fea1d29a20 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f9e50009c90 tx=0x7f9e50001570 comp rx=0 tx=0).stop 2023-11-28T19:59:35.524 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:35.511+0000 7f9e604c0000 1 -- 172.21.15.78:0/1668524904 shutdown_connections 2023-11-28T19:59:35.524 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:35.511+0000 7f9e604c0000 1 --2- 172.21.15.78:0/1668524904 >> [v2:172.21.15.179:6832/1234044491,v1:172.21.15.179:6834/1234044491] conn(0x55fea1d2a760 0x55fea1d2ab40 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:35.525 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:35.511+0000 7f9e604c0000 1 --2- 172.21.15.78:0/1668524904 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55fea1cec010 0x55fea1d23c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:35.525 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:35.511+0000 7f9e604c0000 1 --2- 172.21.15.78:0/1668524904 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55fea1d24920 0x55fea1d29a20 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:35.525 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:35.511+0000 7f9e604c0000 1 --2- 172.21.15.78:0/1668524904 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55fea1ceb6f0 0x55fea1d23740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:35.525 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:35.511+0000 7f9e604c0000 1 -- 172.21.15.78:0/1668524904 >> 172.21.15.78:0/1668524904 conn(0x55fea1cf0190 msgr2=0x55fea1ce62d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T19:59:35.525 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:35.511+0000 7f9e35ffb640 0 client.4755 ms_handle_reset on v2:172.21.15.179:6832/1234044491 2023-11-28T19:59:35.525 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:35.515+0000 7f9e604c0000 1 -- 172.21.15.78:0/1668524904 shutdown_connections 2023-11-28T19:59:35.525 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:35.515+0000 7f9e604c0000 1 -- 172.21.15.78:0/1668524904 wait complete. 2023-11-28T19:59:35.525 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:35.515+0000 7f9e604c0000 20 client.4755 trim_cache size 0 max 16384 2023-11-28T19:59:35.534 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:35.527+0000 7f9e604c0000 1 Processor -- start 2023-11-28T19:59:35.535 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:35.527+0000 7f9e604c0000 1 -- start start 2023-11-28T19:59:35.537 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:35.531+0000 7f9e604c0000 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55fea1ceb6f0 0x55fea1d46470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:35.537 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:35.531+0000 7f9e604c0000 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55fea1cec010 0x55fea1cecb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:35.537 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:35.531+0000 7f9e604c0000 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55fea1d24920 0x55fea1ced040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:35.537 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:35.531+0000 7f9e604c0000 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fea17f3940 con 0x55fea1ceb6f0 2023-11-28T19:59:35.537 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:35.531+0000 7f9e604c0000 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fea1af3d60 con 0x55fea1cec010 2023-11-28T19:59:35.538 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:35.531+0000 7f9e604c0000 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x55fea1bc1fa0 con 0x55fea1d24920 2023-11-28T19:59:35.538 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:35.531+0000 7f9e56d9d640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55fea1ceb6f0 0x55fea1d46470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:35.538 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:35.531+0000 7f9e56d9d640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55fea1ceb6f0 0x55fea1d46470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:36906/0 (socket says 172.21.15.78:36906) 2023-11-28T19:59:35.538 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:35.531+0000 7f9e56d9d640 1 -- 172.21.15.78:0/212348295 learned_addr learned my addr 172.21.15.78:0/212348295 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T19:59:35.538 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:35.531+0000 7f9e56d9d640 1 -- 172.21.15.78:0/212348295 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55fea1d24920 msgr2=0x55fea1ced040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T19:59:35.538 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:35.531+0000 7f9e56d9d640 1 --2- 172.21.15.78:0/212348295 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55fea1d24920 0x55fea1ced040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:35.538 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:35.531+0000 7f9e4e59c640 1 --2- 172.21.15.78:0/212348295 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55fea1cec010 0x55fea1cecb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:35.538 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:35.531+0000 7f9e56d9d640 1 -- 172.21.15.78:0/212348295 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55fea1cec010 msgr2=0x55fea1cecb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T19:59:35.538 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:35.531+0000 7f9e56d9d640 1 --2- 172.21.15.78:0/212348295 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55fea1cec010 0x55fea1cecb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:35.538 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:35.531+0000 7f9e56d9d640 1 -- 172.21.15.78:0/212348295 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55fea1ae1490 con 0x55fea1ceb6f0 2023-11-28T19:59:35.539 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:35.531+0000 7f9e56d9d640 1 --2- 172.21.15.78:0/212348295 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55fea1ceb6f0 0x55fea1d46470 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f9e4801c9e0 tx=0x7f9e480b6000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=735a46b18a470260 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:59:35.539 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:35.531+0000 7f9e4d59a640 1 -- 172.21.15.78:0/212348295 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e480d5d80 con 0x55fea1ceb6f0 2023-11-28T19:59:35.539 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:35.531+0000 7f9e4d59a640 1 -- 172.21.15.78:0/212348295 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e480d3040 con 0x55fea1ceb6f0 2023-11-28T19:59:35.539 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:35.531+0000 7f9e4d59a640 1 -- 172.21.15.78:0/212348295 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e480d54d0 con 0x55fea1ceb6f0 2023-11-28T19:59:35.539 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:35.531+0000 7f9e604c0000 1 -- 172.21.15.78:0/212348295 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55fea1ceb6f0 msgr2=0x55fea1d46470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:35.539 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:35.531+0000 7f9e604c0000 1 --2- 172.21.15.78:0/212348295 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55fea1ceb6f0 0x55fea1d46470 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f9e4801c9e0 tx=0x7f9e480b6000 comp rx=0 tx=0).stop 2023-11-28T19:59:35.539 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:35.531+0000 7f9e604c0000 1 -- 172.21.15.78:0/212348295 shutdown_connections 2023-11-28T19:59:35.539 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:35.531+0000 7f9e604c0000 1 --2- 172.21.15.78:0/212348295 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55fea1d24920 0x55fea1ced040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:35.539 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:35.531+0000 7f9e604c0000 1 --2- 172.21.15.78:0/212348295 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55fea1cec010 0x55fea1cecb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:35.539 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:35.531+0000 7f9e604c0000 1 --2- 172.21.15.78:0/212348295 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55fea1ceb6f0 0x55fea1d46470 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:35.540 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:35.531+0000 7f9e604c0000 1 -- 172.21.15.78:0/212348295 >> 172.21.15.78:0/212348295 conn(0x55fea1cf0190 msgr2=0x55fea1cec3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T19:59:35.540 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:35.531+0000 7f9e604c0000 1 -- 172.21.15.78:0/212348295 shutdown_connections 2023-11-28T19:59:35.540 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:35.531+0000 7f9e604c0000 1 -- 172.21.15.78:0/212348295 wait complete. 2023-11-28T19:59:35.544 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:35.531+0000 7f9e604c0000 1 -- start start 2023-11-28T19:59:35.544 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:35.531+0000 7f9e604c0000 1 Processor -- start 2023-11-28T19:59:35.544 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:35.531+0000 7f9e604c0000 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55fea1ceb6f0 0x55fea1d462a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:35.544 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:35.531+0000 7f9e604c0000 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55fea1cec010 0x55fea1d8e150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:35.544 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:35.531+0000 7f9e604c0000 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55fea1d24920 0x55fea1d8e690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:35.544 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:35.531+0000 7f9e604c0000 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fea1b7c140 con 0x55fea1ceb6f0 2023-11-28T19:59:35.545 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:35.531+0000 7f9e604c0000 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fea1b39650 con 0x55fea1d24920 2023-11-28T19:59:35.545 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:35.531+0000 7f9e604c0000 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x55fea1b06670 con 0x55fea1cec010 2023-11-28T19:59:35.545 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:35.531+0000 7f9e604c0000 10 client.0 _ll_register_callbacks cb 0x55fea1cb5bd0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-28T19:59:35.545 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:35.535+0000 7f9e56d9d640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55fea1ceb6f0 0x55fea1d462a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:35.545 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:35.535+0000 7f9e56d9d640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55fea1ceb6f0 0x55fea1d462a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:36922/0 (socket says 172.21.15.78:36922) 2023-11-28T19:59:35.545 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:35.535+0000 7f9e56d9d640 1 -- 172.21.15.78:0/606806845 learned_addr learned my addr 172.21.15.78:0/606806845 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T19:59:35.545 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:35.535+0000 7f9e4e59c640 1 --2- 172.21.15.78:0/606806845 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55fea1cec010 0x55fea1d8e150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:35.545 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:35.535+0000 7f9e5759e640 1 --2- 172.21.15.78:0/606806845 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55fea1d24920 0x55fea1d8e690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:35.545 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:35.535+0000 7f9e56d9d640 1 -- 172.21.15.78:0/606806845 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55fea1cec010 msgr2=0x55fea1d8e150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T19:59:35.546 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:35.535+0000 7f9e56d9d640 1 --2- 172.21.15.78:0/606806845 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55fea1cec010 0x55fea1d8e150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:35.546 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:35.535+0000 7f9e56d9d640 1 -- 172.21.15.78:0/606806845 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55fea1d24920 msgr2=0x55fea1d8e690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T19:59:35.546 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:35.535+0000 7f9e56d9d640 1 --2- 172.21.15.78:0/606806845 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55fea1d24920 0x55fea1d8e690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:35.546 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:35.535+0000 7f9e56d9d640 1 -- 172.21.15.78:0/606806845 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55fea1832890 con 0x55fea1ceb6f0 2023-11-28T19:59:35.546 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:35.535+0000 7f9e56d9d640 1 --2- 172.21.15.78:0/606806845 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55fea1ceb6f0 0x55fea1d462a0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f9e4801c9e0 tx=0x7f9e4801ad40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=25618a9c38208ebc server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:59:35.546 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:35.535+0000 7f9e35ffb640 10 client.0 ms_handle_connect on v2:172.21.15.78:3300/0 2023-11-28T19:59:35.546 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:35.535+0000 7f9e35ffb640 1 -- 172.21.15.78:0/606806845 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e480d5cc0 con 0x55fea1ceb6f0 2023-11-28T19:59:35.546 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:35.535+0000 7f9e35ffb640 1 -- 172.21.15.78:0/606806845 <== mon.0 v2:172.21.15.78:3300/0 2 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f9e480d5e20 con 0x55fea1ceb6f0 2023-11-28T19:59:35.546 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:35.535+0000 7f9e604c0000 1 -- 172.21.15.78:0/606806845 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55fea1cefa50 con 0x55fea1ceb6f0 2023-11-28T19:59:35.546 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:35.535+0000 7f9e35ffb640 1 -- 172.21.15.78:0/606806845 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_get_version_reply(handle=1 version=9) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9e480d52d0 con 0x55fea1ceb6f0 2023-11-28T19:59:35.547 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:35.535+0000 7f9e604c0000 10 client.4761 fetch_fsmap learned FSMap version 9 2023-11-28T19:59:35.547 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:35.535+0000 7f9e604c0000 1 -- 172.21.15.78:0/606806845 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) v3 -- 0x55fea1832cc0 con 0x55fea1ceb6f0 2023-11-28T19:59:35.547 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:35.535+0000 7f9e35ffb640 1 -- 172.21.15.78:0/606806845 <== mon.0 v2:172.21.15.78:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55fea1cefa50 con 0x55fea1ceb6f0 2023-11-28T19:59:35.547 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:35.535+0000 7f9e35ffb640 1 -- 172.21.15.78:0/606806845 <== mon.0 v2:172.21.15.78:3300/0 5 ==== fsmap(e 9) v1 ==== 3302+0+0 (secure 0 0 0) 0x7f9e480d5430 con 0x55fea1ceb6f0 2023-11-28T19:59:35.547 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:35.535+0000 7f9e604c0000 10 client.4761 fetch_fsmap finished waiting for FSMap version 9 2023-11-28T19:59:35.547 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:35.535+0000 7f9e604c0000 10 client.4761 resolve_mds: resolved name 'b' to daemon mds.b 2023-11-28T19:59:35.547 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:35.535+0000 7f9e604c0000 20 client.4761 populate_metadata read hostname 'smithi078' 2023-11-28T19:59:35.547 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:35.535+0000 7f9e604c0000 1 --2- 172.21.15.78:0/606806845 >> [v2:172.21.15.179:6832/1234044491,v1:172.21.15.179:6834/1234044491] conn(0x55fea1d467e0 0x55fea1d8ebd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:35.547 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:35.535+0000 7f9e604c0000 4 client.4761 mds_command: new command op to 4275 tid=0 multi_id=0 [{"prefix": "status"}] 2023-11-28T19:59:35.547 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:35.535+0000 7f9e604c0000 1 -- 172.21.15.78:0/606806845 --> [v2:172.21.15.179:6832/1234044491,v1:172.21.15.179:6834/1234044491] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55fea1b39110 con 0x55fea1d467e0 2023-11-28T19:59:35.548 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:35.535+0000 7f9e4e59c640 1 --2- 172.21.15.78:0/606806845 >> [v2:172.21.15.179:6832/1234044491,v1:172.21.15.179:6834/1234044491] conn(0x55fea1d467e0 0x55fea1d8ebd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:35.548 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:35.535+0000 7f9e4e59c640 1 --2- 172.21.15.78:0/606806845 >> [v2:172.21.15.179:6832/1234044491,v1:172.21.15.179:6834/1234044491] conn(0x55fea1d467e0 0x55fea1d8ebd0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cc05b25fe3f01184 server_cookie=2f1273ec0ca7f9cd in_seq=0 out_seq=0 2023-11-28T19:59:35.548 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:35.535+0000 7f9e35ffb640 10 client.4761 ms_handle_connect on v2:172.21.15.179:6832/1234044491 2023-11-28T19:59:35.548 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:35.535+0000 7f9e35ffb640 1 -- 172.21.15.78:0/606806845 <== mds.0 v2:172.21.15.179:6832/1234044491 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+324 (crc 0 0 0) 0x55fea1b39110 con 0x55fea1d467e0 2023-11-28T19:59:35.548 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:35.535+0000 7f9e35ffb640 10 client.4761 handle_command_reply: tid=0 2023-11-28T19:59:35.548 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:35.535+0000 7f9e604c0000 1 client.4761 shutdown 2023-11-28T19:59:35.548 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:35.535+0000 7f9e604c0000 1 -- 172.21.15.78:0/606806845 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55fea1ceb6f0 msgr2=0x55fea1d462a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:35.548 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:35.535+0000 7f9e604c0000 1 --2- 172.21.15.78:0/606806845 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55fea1ceb6f0 0x55fea1d462a0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f9e4801c9e0 tx=0x7f9e4801ad40 comp rx=0 tx=0).stop 2023-11-28T19:59:35.548 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:35.535+0000 7f9e604c0000 1 -- 172.21.15.78:0/606806845 shutdown_connections 2023-11-28T19:59:35.548 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:35.535+0000 7f9e604c0000 1 --2- 172.21.15.78:0/606806845 >> [v2:172.21.15.179:6832/1234044491,v1:172.21.15.179:6834/1234044491] conn(0x55fea1d467e0 0x55fea1d8ebd0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:35.549 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:35.535+0000 7f9e604c0000 1 --2- 172.21.15.78:0/606806845 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55fea1cec010 0x55fea1d8e150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:35.549 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:35.535+0000 7f9e604c0000 1 --2- 172.21.15.78:0/606806845 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55fea1d24920 0x55fea1d8e690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:35.549 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:35.535+0000 7f9e604c0000 1 --2- 172.21.15.78:0/606806845 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55fea1ceb6f0 0x55fea1d462a0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:35.549 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:35.535+0000 7f9e604c0000 1 -- 172.21.15.78:0/606806845 >> 172.21.15.78:0/606806845 conn(0x55fea1cf0190 msgr2=0x55fea1cecc80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T19:59:35.549 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:35.535+0000 7f9e35ffb640 0 client.4761 ms_handle_reset on v2:172.21.15.179:6832/1234044491 2023-11-28T19:59:35.549 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:35.535+0000 7f9e604c0000 1 -- 172.21.15.78:0/606806845 shutdown_connections 2023-11-28T19:59:35.549 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:35.535+0000 7f9e604c0000 1 -- 172.21.15.78:0/606806845 wait complete. 2023-11-28T19:59:35.549 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:35.535+0000 7f9e604c0000 20 client.4761 trim_cache size 0 max 16384 2023-11-28T19:59:35.550 INFO:teuthology.orchestra.run.smithi078.stdout:{ 2023-11-28T19:59:35.550 INFO:teuthology.orchestra.run.smithi078.stdout: "cluster_fsid": "dd9780e8-3bda-44fa-a9f0-fa07d19d901d", 2023-11-28T19:59:35.550 INFO:teuthology.orchestra.run.smithi078.stdout: "whoami": 0, 2023-11-28T19:59:35.550 INFO:teuthology.orchestra.run.smithi078.stdout: "id": 4275, 2023-11-28T19:59:35.550 INFO:teuthology.orchestra.run.smithi078.stdout: "want_state": "up:active", 2023-11-28T19:59:35.550 INFO:teuthology.orchestra.run.smithi078.stdout: "state": "up:active", 2023-11-28T19:59:35.550 INFO:teuthology.orchestra.run.smithi078.stdout: "fs_name": "cephfs", 2023-11-28T19:59:35.550 INFO:teuthology.orchestra.run.smithi078.stdout: "rank_uptime": 29.518890955, 2023-11-28T19:59:35.550 INFO:teuthology.orchestra.run.smithi078.stdout: "mdsmap_epoch": 9, 2023-11-28T19:59:35.551 INFO:teuthology.orchestra.run.smithi078.stdout: "osdmap_epoch": 25, 2023-11-28T19:59:35.551 INFO:teuthology.orchestra.run.smithi078.stdout: "osdmap_epoch_barrier": 25, 2023-11-28T19:59:35.551 INFO:teuthology.orchestra.run.smithi078.stdout: "uptime": 36.194119692000001 2023-11-28T19:59:35.551 INFO:teuthology.orchestra.run.smithi078.stdout:} 2023-11-28T19:59:35.552 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:35.535+0000 7f9e5d165640 1 -- 172.21.15.78:0/658427844 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f9e38066470 msgr2=0x7f9e38068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:35.552 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:35.535+0000 7f9e5d165640 1 --2- 172.21.15.78:0/658427844 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f9e38066470 0x7f9e38068930 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f9e480ae000 tx=0x7f9e480a6070 comp rx=0 tx=0).stop 2023-11-28T19:59:35.552 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:35.535+0000 7f9e5d165640 1 -- 172.21.15.78:0/658427844 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9e580c4f80 msgr2=0x7f9e5814c960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:35.552 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:35.535+0000 7f9e5d165640 1 --2- 172.21.15.78:0/658427844 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9e580c4f80 0x7f9e5814c960 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f9e4000ba50 tx=0x7f9e4000bf10 comp rx=0 tx=0).stop 2023-11-28T19:59:35.552 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:35.535+0000 7f9e5d165640 1 -- 172.21.15.78:0/658427844 shutdown_connections 2023-11-28T19:59:35.552 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:35.535+0000 7f9e5d165640 1 --2- 172.21.15.78:0/658427844 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f9e38066470 0x7f9e38068930 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:35.552 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:35.535+0000 7f9e5d165640 1 --2- 172.21.15.78:0/658427844 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9e58154390 0x7f9e5814cea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:35.552 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:35.535+0000 7f9e5d165640 1 --2- 172.21.15.78:0/658427844 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9e580c4f80 0x7f9e5814c960 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:35.553 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:35.535+0000 7f9e5d165640 1 --2- 172.21.15.78:0/658427844 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9e580c2110 0x7f9e5814dcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:35.553 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:35.535+0000 7f9e5d165640 1 -- 172.21.15.78:0/658427844 >> 172.21.15.78:0/658427844 conn(0x7f9e5806b220 msgr2=0x7f9e5806bb30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T19:59:35.553 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:35.539+0000 7f9e5d165640 1 -- 172.21.15.78:0/658427844 shutdown_connections 2023-11-28T19:59:35.553 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:35.539+0000 7f9e5d165640 1 -- 172.21.15.78:0/658427844 wait complete. 2023-11-28T19:59:35.562 INFO:teuthology.run_tasks:Running task kclient... 2023-11-28T19:59:35.575 INFO:tasks.kclient:Mounting kernel clients... 2023-11-28T19:59:35.575 INFO:tasks.kclient:config is {'client.0': {}, 'client.1': {}} 2023-11-28T19:59:35.575 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T19:59:35.575 DEBUG:teuthology.orchestra.run.smithi078:> ip netns list 2023-11-28T19:59:35.585 INFO:teuthology.orchestra.run.smithi078.stdout:ceph-ns--home-ubuntu-cephtest-mnt.admin (id: 0) 2023-11-28T19:59:35.586 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T19:59:35.586 DEBUG:teuthology.orchestra.run.smithi078:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.admin 2023-11-28T19:59:35.647 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T19:59:35.647 DEBUG:teuthology.orchestra.run.smithi078:> sudo ip link delete ceph-brx 2023-11-28T19:59:35.846 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T19:59:35.846 DEBUG:teuthology.orchestra.run.smithi179:> ip netns list 2023-11-28T19:59:35.858 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T19:59:35.858 DEBUG:teuthology.orchestra.run.smithi179:> sudo ip link delete ceph-brx 2023-11-28T19:59:35.926 INFO:teuthology.orchestra.run.smithi179.stderr:Cannot find device "ceph-brx" 2023-11-28T19:59:35.928 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-28T19:59:35.929 INFO:tasks.kclient:client.0 config is {'syntax': 'v2'} 2023-11-28T19:59:35.929 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-11-28T19:59:35.929 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-11-28T19:59:35.929 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-11-28T19:59:36.071 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:36.063+0000 7f4586b1d640 1 Processor -- start 2023-11-28T19:59:36.071 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:36.063+0000 7f4586b1d640 1 -- start start 2023-11-28T19:59:36.071 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:36.063+0000 7f4586b1d640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f458006c100 0x7f458015fe30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:36.072 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:36.063+0000 7f4586b1d640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f45800c4890 con 0x7f45800af4c0 2023-11-28T19:59:36.072 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:36.063+0000 7f4586b1d640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f45801553d0 con 0x7f4580154f20 2023-11-28T19:59:36.072 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:36.063+0000 7f4586b1d640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45800af8a0 con 0x7f458006c100 2023-11-28T19:59:36.072 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:36.063+0000 7f45848b9640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f45800af4c0 0x7f45800c67d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:60728/0 (socket says 172.21.15.78:60728) 2023-11-28T19:59:36.072 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:36.063+0000 7f45848b9640 1 -- 172.21.15.78:0/2505749793 learned_addr learned my addr 172.21.15.78:0/2505749793 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-11-28T19:59:36.072 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:36.063+0000 7f45850ba640 1 --2- 172.21.15.78:0/2505749793 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f458006c100 0x7f458015fe30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:36.072 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:36.063+0000 7f45777fe640 1 -- 172.21.15.78:0/2505749793 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4045872819 0 0) 0x7f45800c4890 con 0x7f45800af4c0 2023-11-28T19:59:36.072 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:36.063+0000 7f45777fe640 1 -- 172.21.15.78:0/2505749793 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4568003530 con 0x7f45800af4c0 2023-11-28T19:59:36.072 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:36.063+0000 7f45777fe640 1 -- 172.21.15.78:0/2505749793 <== mon.0 v1:172.21.15.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1238874451 0 0) 0x7f4568003530 con 0x7f45800af4c0 2023-11-28T19:59:36.072 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:36.063+0000 7f45777fe640 1 -- 172.21.15.78:0/2505749793 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f458006c100 msgr2=0x7f458015fe30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T19:59:36.072 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:36.063+0000 7f45777fe640 1 --2- 172.21.15.78:0/2505749793 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f458006c100 0x7f458015fe30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:36.073 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:36.063+0000 7f45777fe640 1 -- 172.21.15.78:0/2505749793 >> v1:172.21.15.179:6789/0 conn(0x7f4580154f20 legacy=0x7f458006b9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:36.073 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:36.063+0000 7f45777fe640 1 -- 172.21.15.78:0/2505749793 --> v1:172.21.15.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45800c4b30 con 0x7f45800af4c0 2023-11-28T19:59:36.073 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:36.063+0000 7f45777fe640 1 -- 172.21.15.78:0/2505749793 <== mon.0 v1:172.21.15.78:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3326804700 0 0) 0x7f457c001680 con 0x7f45800af4c0 2023-11-28T19:59:36.073 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:36.063+0000 7f45777fe640 1 -- 172.21.15.78:0/2505749793 >> v1:172.21.15.78:6789/0 conn(0x7f45800af4c0 legacy=0x7f45800c67d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:36.073 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:36.063+0000 7f45777fe640 1 --2- 172.21.15.78:0/2505749793 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f458006c100 0x7f45680039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:36.073 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:36.063+0000 7f45777fe640 1 --2- 172.21.15.78:0/2505749793 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4568003ef0 0x7f45680047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:36.073 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:36.063+0000 7f45777fe640 1 --2- 172.21.15.78:0/2505749793 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4568004d10 0x7f4568005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:36.073 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:36.063+0000 7f45777fe640 1 -- 172.21.15.78:0/2505749793 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45800af8a0 con 0x7f4568004d10 2023-11-28T19:59:36.073 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:36.063+0000 7f45777fe640 1 -- 172.21.15.78:0/2505749793 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f456800baa0 con 0x7f4568003ef0 2023-11-28T19:59:36.073 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:36.063+0000 7f45777fe640 1 -- 172.21.15.78:0/2505749793 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f456800bc60 con 0x7f458006c100 2023-11-28T19:59:36.074 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:36.063+0000 7f45850ba640 1 --2- 172.21.15.78:0/2505749793 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4568004d10 0x7f4568005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:36.074 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:36.063+0000 7f45848b9640 1 --2- 172.21.15.78:0/2505749793 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f458006c100 0x7f45680039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:36.074 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:36.063+0000 7f4577fff640 1 --2- 172.21.15.78:0/2505749793 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4568003ef0 0x7f45680047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:36.074 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:36.063+0000 7f45850ba640 1 -- 172.21.15.78:0/2505749793 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f458006c100 msgr2=0x7f45680039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T19:59:36.074 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:36.063+0000 7f45850ba640 1 --2- 172.21.15.78:0/2505749793 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f458006c100 0x7f45680039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:36.074 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:36.063+0000 7f45850ba640 1 -- 172.21.15.78:0/2505749793 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4568003ef0 msgr2=0x7f45680047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T19:59:36.074 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:36.063+0000 7f45850ba640 1 --2- 172.21.15.78:0/2505749793 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4568003ef0 0x7f45680047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:36.074 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:36.063+0000 7f45850ba640 1 -- 172.21.15.78:0/2505749793 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4568003530 con 0x7f4568004d10 2023-11-28T19:59:36.075 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:36.067+0000 7f45850ba640 1 --2- 172.21.15.78:0/2505749793 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4568004d10 0x7f4568005190 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f4578009f90 tx=0x7f457801cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=414fb4aa2a7e80bb server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:59:36.075 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:36.067+0000 7f45777fe640 1 -- 172.21.15.78:0/2505749793 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45780a5c30 con 0x7f4568004d10 2023-11-28T19:59:36.075 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:36.067+0000 7f45777fe640 1 -- 172.21.15.78:0/2505749793 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f457800f040 con 0x7f4568004d10 2023-11-28T19:59:36.076 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:36.067+0000 7f45777fe640 1 -- 172.21.15.78:0/2505749793 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45780ad440 con 0x7f4568004d10 2023-11-28T19:59:36.076 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:36.067+0000 7f4586b1d640 1 -- 172.21.15.78:0/2505749793 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4568004d10 msgr2=0x7f4568005190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:36.076 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:36.067+0000 7f4586b1d640 1 --2- 172.21.15.78:0/2505749793 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4568004d10 0x7f4568005190 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f4578009f90 tx=0x7f457801cc20 comp rx=0 tx=0).stop 2023-11-28T19:59:36.076 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:36.067+0000 7f45850ba640 1 -- 172.21.15.78:0/2505749793 reap_dead start 2023-11-28T19:59:36.077 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:36.067+0000 7f4586b1d640 1 -- 172.21.15.78:0/2505749793 shutdown_connections 2023-11-28T19:59:36.077 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:36.067+0000 7f4586b1d640 1 -- 172.21.15.78:0/2505749793 >> 172.21.15.78:0/2505749793 conn(0x7f45800ab9d0 msgr2=0x7f45800abde0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T19:59:36.077 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:36.067+0000 7f4586b1d640 1 -- 172.21.15.78:0/2505749793 shutdown_connections 2023-11-28T19:59:36.077 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:36.067+0000 7f4586b1d640 1 -- 172.21.15.78:0/2505749793 wait complete. 2023-11-28T19:59:36.079 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:36.071+0000 7f4586b1d640 1 Processor -- start 2023-11-28T19:59:36.079 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:36.071+0000 7f4586b1d640 1 -- start start 2023-11-28T19:59:36.079 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:36.071+0000 7f4586b1d640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4568004d10 0x7f45801522e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:36.080 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:36.071+0000 7f4586b1d640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f45801ed750 0x7f4580148400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:36.081 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:36.071+0000 7f4586b1d640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f45801e9d60 0x7f45801ea1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:36.081 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:36.071+0000 7f4586b1d640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45801ea720 con 0x7f45801ed750 2023-11-28T19:59:36.082 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:36.071+0000 7f4586b1d640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45800c94d0 con 0x7f4568004d10 2023-11-28T19:59:36.082 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:36.071+0000 7f4586b1d640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45800c97b0 con 0x7f45801e9d60 2023-11-28T19:59:36.083 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:36.071+0000 7f4577fff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f45801ed750 0x7f4580148400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:36.083 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:36.071+0000 7f4577fff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f45801ed750 0x7f4580148400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:36940/0 (socket says 172.21.15.78:36940) 2023-11-28T19:59:36.083 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:36.071+0000 7f4577fff640 1 -- 172.21.15.78:0/2938282198 learned_addr learned my addr 172.21.15.78:0/2938282198 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T19:59:36.083 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:36.071+0000 7f45848b9640 1 --2- 172.21.15.78:0/2938282198 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4568004d10 0x7f45801522e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:36.083 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:36.071+0000 7f45850ba640 1 --2- 172.21.15.78:0/2938282198 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f45801e9d60 0x7f45801ea1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:36.084 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:36.071+0000 7f4577fff640 1 -- 172.21.15.78:0/2938282198 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f45801e9d60 msgr2=0x7f45801ea1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:36.084 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:36.071+0000 7f4577fff640 1 --2- 172.21.15.78:0/2938282198 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f45801e9d60 0x7f45801ea1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:36.084 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:36.071+0000 7f4577fff640 1 -- 172.21.15.78:0/2938282198 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4568004d10 msgr2=0x7f45801522e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:36.084 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:36.071+0000 7f4577fff640 1 --2- 172.21.15.78:0/2938282198 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4568004d10 0x7f45801522e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:36.084 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:36.071+0000 7f4577fff640 1 -- 172.21.15.78:0/2938282198 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45800c9a90 con 0x7f45801ed750 2023-11-28T19:59:36.084 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:36.071+0000 7f4577fff640 1 --2- 172.21.15.78:0/2938282198 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f45801ed750 0x7f4580148400 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f4570011b70 tx=0x7f4570011f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:59:36.084 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:36.071+0000 7f45757fa640 1 -- 172.21.15.78:0/2938282198 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45700052e0 con 0x7f45801ed750 2023-11-28T19:59:36.084 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:36.071+0000 7f45757fa640 1 -- 172.21.15.78:0/2938282198 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4570005440 con 0x7f45801ed750 2023-11-28T19:59:36.084 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:36.071+0000 7f4586b1d640 1 -- 172.21.15.78:0/2938282198 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4580148d50 con 0x7f45801ed750 2023-11-28T19:59:36.084 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:36.071+0000 7f45757fa640 1 -- 172.21.15.78:0/2938282198 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f457000fbd0 con 0x7f45801ed750 2023-11-28T19:59:36.084 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:36.071+0000 7f4586b1d640 1 -- 172.21.15.78:0/2938282198 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f45801e97d0 con 0x7f45801ed750 2023-11-28T19:59:36.085 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:36.075+0000 7f4586b1d640 1 -- 172.21.15.78:0/2938282198 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4580067630 con 0x7f45801ed750 2023-11-28T19:59:36.086 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:36.075+0000 7f45757fa640 1 -- 172.21.15.78:0/2938282198 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f457000fd30 con 0x7f45801ed750 2023-11-28T19:59:36.086 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:36.075+0000 7f45757fa640 1 --2- 172.21.15.78:0/2938282198 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f456c066470 0x7f456c068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:36.086 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:36.075+0000 7f45757fa640 1 -- 172.21.15.78:0/2938282198 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f4570087b10 con 0x7f45801ed750 2023-11-28T19:59:36.086 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:36.075+0000 7f45848b9640 1 --2- 172.21.15.78:0/2938282198 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f456c066470 0x7f456c068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:36.086 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:36.075+0000 7f45848b9640 1 --2- 172.21.15.78:0/2938282198 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f456c066470 0x7f456c068930 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f457c000c10 tx=0x7f457c000ff0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:59:36.086 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:36.079+0000 7f45757fa640 1 -- 172.21.15.78:0/2938282198 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f4570054b80 con 0x7f45801ed750 2023-11-28T19:59:36.269 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:36.259+0000 7f4586b1d640 1 -- 172.21.15.78:0/2938282198 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f458006b1c0 con 0x7f45801ed750 2023-11-28T19:59:36.269 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:36.263+0000 7f45757fa640 1 -- 172.21.15.78:0/2938282198 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v9) v1 ==== 53+0+88 (secure 0 0 0) 0x7f4570019070 con 0x7f45801ed750 2023-11-28T19:59:36.270 INFO:teuthology.orchestra.run.smithi078.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2023-11-28T19:59:36.271 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:36.263+0000 7f4586b1d640 1 -- 172.21.15.78:0/2938282198 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f456c066470 msgr2=0x7f456c068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:36.271 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:36.263+0000 7f4586b1d640 1 --2- 172.21.15.78:0/2938282198 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f456c066470 0x7f456c068930 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f457c000c10 tx=0x7f457c000ff0 comp rx=0 tx=0).stop 2023-11-28T19:59:36.271 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:36.263+0000 7f4586b1d640 1 -- 172.21.15.78:0/2938282198 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f45801ed750 msgr2=0x7f4580148400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:36.272 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:36.263+0000 7f4586b1d640 1 --2- 172.21.15.78:0/2938282198 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f45801ed750 0x7f4580148400 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f4570011b70 tx=0x7f4570011f70 comp rx=0 tx=0).stop 2023-11-28T19:59:36.272 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:36.263+0000 7f4586b1d640 1 -- 172.21.15.78:0/2938282198 shutdown_connections 2023-11-28T19:59:36.272 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:36.263+0000 7f4586b1d640 1 --2- 172.21.15.78:0/2938282198 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f456c066470 0x7f456c068930 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:36.272 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:36.263+0000 7f4586b1d640 1 --2- 172.21.15.78:0/2938282198 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f45801e9d60 0x7f45801ea1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:36.272 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:36.263+0000 7f4586b1d640 1 --2- 172.21.15.78:0/2938282198 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f45801ed750 0x7f4580148400 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:36.272 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:36.263+0000 7f4586b1d640 1 --2- 172.21.15.78:0/2938282198 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4568004d10 0x7f45801522e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:36.272 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:36.263+0000 7f4586b1d640 1 -- 172.21.15.78:0/2938282198 >> 172.21.15.78:0/2938282198 conn(0x7f45800ab9d0 msgr2=0x7f458014f930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T19:59:36.273 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:36.263+0000 7f4586b1d640 1 -- 172.21.15.78:0/2938282198 shutdown_connections 2023-11-28T19:59:36.273 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:36.263+0000 7f4586b1d640 1 -- 172.21.15.78:0/2938282198 wait complete. 2023-11-28T19:59:36.288 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-11-28T19:59:36.288 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-11-28T19:59:36.289 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi078.front.sepia.ceph.com 2023-11-28T19:59:36.289 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-11-28T19:59:36.289 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-11-28T19:59:36.289 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-11-28T19:59:36.289 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-11-28T19:59:36.289 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-11-28T19:59:36.289 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2023-11-28T19:59:36.290 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T19:59:36.290 DEBUG:teuthology.orchestra.run.smithi078:> ip addr 2023-11-28T19:59:36.299 INFO:teuthology.orchestra.run.smithi078.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-11-28T19:59:36.299 INFO:teuthology.orchestra.run.smithi078.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-11-28T19:59:36.300 INFO:teuthology.orchestra.run.smithi078.stdout: inet 127.0.0.1/8 scope host lo 2023-11-28T19:59:36.300 INFO:teuthology.orchestra.run.smithi078.stdout: valid_lft forever preferred_lft forever 2023-11-28T19:59:36.300 INFO:teuthology.orchestra.run.smithi078.stdout: inet6 ::1/128 scope host 2023-11-28T19:59:36.300 INFO:teuthology.orchestra.run.smithi078.stdout: valid_lft forever preferred_lft forever 2023-11-28T19:59:36.300 INFO:teuthology.orchestra.run.smithi078.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-11-28T19:59:36.300 INFO:teuthology.orchestra.run.smithi078.stdout: link/ether 0c:c4:7a:d8:a1:22 brd ff:ff:ff:ff:ff:ff 2023-11-28T19:59:36.300 INFO:teuthology.orchestra.run.smithi078.stdout: altname enp7s0f0 2023-11-28T19:59:36.300 INFO:teuthology.orchestra.run.smithi078.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-11-28T19:59:36.300 INFO:teuthology.orchestra.run.smithi078.stdout: link/ether 0c:c4:7a:d8:a1:23 brd ff:ff:ff:ff:ff:ff 2023-11-28T19:59:36.300 INFO:teuthology.orchestra.run.smithi078.stdout: altname enp7s0f1 2023-11-28T19:59:36.300 INFO:teuthology.orchestra.run.smithi078.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-11-28T19:59:36.301 INFO:teuthology.orchestra.run.smithi078.stdout: link/ether 0c:c4:7a:8f:d4:dc brd ff:ff:ff:ff:ff:ff 2023-11-28T19:59:36.301 INFO:teuthology.orchestra.run.smithi078.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-11-28T19:59:36.301 INFO:teuthology.orchestra.run.smithi078.stdout: link/ether 0c:c4:7a:8f:d4:dd brd ff:ff:ff:ff:ff:ff 2023-11-28T19:59:36.301 INFO:teuthology.orchestra.run.smithi078.stdout: inet 172.21.15.78/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2023-11-28T19:59:36.301 INFO:teuthology.orchestra.run.smithi078.stdout: valid_lft 42395sec preferred_lft 42395sec 2023-11-28T19:59:36.301 INFO:teuthology.orchestra.run.smithi078.stdout: inet6 fe80::ec4:7aff:fe8f:d4dd/64 scope link 2023-11-28T19:59:36.301 INFO:teuthology.orchestra.run.smithi078.stdout: valid_lft forever preferred_lft forever 2023-11-28T19:59:36.301 INFO:teuthology.orchestra.run.smithi078.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-11-28T19:59:36.301 INFO:teuthology.orchestra.run.smithi078.stdout: link/ether 02:42:8f:cc:76:dd brd ff:ff:ff:ff:ff:ff 2023-11-28T19:59:36.302 INFO:teuthology.orchestra.run.smithi078.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-11-28T19:59:36.302 INFO:teuthology.orchestra.run.smithi078.stdout: valid_lft forever preferred_lft forever 2023-11-28T19:59:36.302 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-11-28T19:59:36.302 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T19:59:36.302 DEBUG:teuthology.orchestra.run.smithi078:> (cd / && exec bash -c ' 2023-11-28T19:59:36.302 DEBUG:teuthology.orchestra.run.smithi078:> set -e 2023-11-28T19:59:36.302 DEBUG:teuthology.orchestra.run.smithi078:> sudo ip link add name ceph-brx type bridge 2023-11-28T19:59:36.302 DEBUG:teuthology.orchestra.run.smithi078:> sudo ip addr flush dev ceph-brx 2023-11-28T19:59:36.302 DEBUG:teuthology.orchestra.run.smithi078:> sudo ip link set ceph-brx up 2023-11-28T19:59:36.303 DEBUG:teuthology.orchestra.run.smithi078:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-11-28T19:59:36.303 DEBUG:teuthology.orchestra.run.smithi078:> ') 2023-11-28T19:59:36.416 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T19:59:36.416 DEBUG:teuthology.orchestra.run.smithi078:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-11-28T19:59:36.435 INFO:teuthology.orchestra.run.smithi078.stdout:1 2023-11-28T19:59:36.437 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T19:59:36.438 DEBUG:teuthology.orchestra.run.smithi078:> route 2023-11-28T19:59:36.490 INFO:teuthology.orchestra.run.smithi078.stdout:Kernel IP routing table 2023-11-28T19:59:36.490 INFO:teuthology.orchestra.run.smithi078.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-11-28T19:59:36.490 INFO:teuthology.orchestra.run.smithi078.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2023-11-28T19:59:36.490 INFO:teuthology.orchestra.run.smithi078.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-11-28T19:59:36.490 INFO:teuthology.orchestra.run.smithi078.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-11-28T19:59:36.491 INFO:teuthology.orchestra.run.smithi078.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-11-28T19:59:36.491 INFO:teuthology.orchestra.run.smithi078.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-11-28T19:59:36.491 INFO:teuthology.orchestra.run.smithi078.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-11-28T19:59:36.491 INFO:teuthology.orchestra.run.smithi078.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-11-28T19:59:36.491 INFO:teuthology.orchestra.run.smithi078.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-11-28T19:59:36.492 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T19:59:36.492 DEBUG:teuthology.orchestra.run.smithi078:> (cd / && exec bash -c ' 2023-11-28T19:59:36.492 DEBUG:teuthology.orchestra.run.smithi078:> set -e 2023-11-28T19:59:36.492 DEBUG:teuthology.orchestra.run.smithi078:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-11-28T19:59:36.492 DEBUG:teuthology.orchestra.run.smithi078:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-11-28T19:59:36.492 DEBUG:teuthology.orchestra.run.smithi078:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-11-28T19:59:36.492 DEBUG:teuthology.orchestra.run.smithi078:> ') 2023-11-28T19:59:36.583 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T19:59:36.583 DEBUG:teuthology.orchestra.run.smithi078:> ip netns list 2023-11-28T19:59:36.593 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T19:59:36.594 DEBUG:teuthology.orchestra.run.smithi078:> ip netns list-id 2023-11-28T19:59:36.647 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T19:59:36.648 DEBUG:teuthology.orchestra.run.smithi078:> (cd / && exec bash -c ' 2023-11-28T19:59:36.648 DEBUG:teuthology.orchestra.run.smithi078:> set -e 2023-11-28T19:59:36.648 DEBUG:teuthology.orchestra.run.smithi078:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-28T19:59:36.648 DEBUG:teuthology.orchestra.run.smithi078:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2023-11-28T19:59:36.648 DEBUG:teuthology.orchestra.run.smithi078:> ') 2023-11-28T19:59:36.733 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2023-11-28T19:59:36.733 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T19:59:36.734 DEBUG:teuthology.orchestra.run.smithi078:> (cd / && exec bash -c ' 2023-11-28T19:59:36.734 DEBUG:teuthology.orchestra.run.smithi078:> set -e 2023-11-28T19:59:36.734 DEBUG:teuthology.orchestra.run.smithi078:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2023-11-28T19:59:36.734 DEBUG:teuthology.orchestra.run.smithi078:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-11-28T19:59:36.734 DEBUG:teuthology.orchestra.run.smithi078:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2023-11-28T19:59:36.734 DEBUG:teuthology.orchestra.run.smithi078:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2023-11-28T19:59:36.734 DEBUG:teuthology.orchestra.run.smithi078:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2023-11-28T19:59:36.734 DEBUG:teuthology.orchestra.run.smithi078:> ') 2023-11-28T19:59:36.870 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T19:59:36.871 DEBUG:teuthology.orchestra.run.smithi078:> (cd / && exec bash -c ' 2023-11-28T19:59:36.871 DEBUG:teuthology.orchestra.run.smithi078:> set -e 2023-11-28T19:59:36.871 DEBUG:teuthology.orchestra.run.smithi078:> sudo ip link set brx.0 up 2023-11-28T19:59:36.871 DEBUG:teuthology.orchestra.run.smithi078:> sudo ip link set dev brx.0 master ceph-brx 2023-11-28T19:59:36.871 DEBUG:teuthology.orchestra.run.smithi078:> ') 2023-11-28T19:59:36.912 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-28T19:59:36.913 DEBUG:teuthology.orchestra.run.smithi078:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-11-28T19:59:36.967 INFO:teuthology.orchestra.run.smithi078.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-11-28T19:59:36.968 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-28T19:59:36.968 DEBUG:teuthology.orchestra.run.smithi078:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-11-28T19:59:37.019 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2023-11-28T19:59:37.019 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T19:59:37.019 DEBUG:teuthology.orchestra.run.smithi078:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-11-28T19:59:37.113 INFO:teuthology.orchestra.run.smithi078.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-11-28T19:59:37.113 INFO:teuthology.orchestra.run.smithi078.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-11-28T19:59:37.245 INFO:teuthology.orchestra.run.smithi078.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-11-28T19:59:37.245 INFO:teuthology.orchestra.run.smithi078.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-11-28T19:59:37.246 INFO:teuthology.orchestra.run.smithi078.stdout:mount.ceph: resolved to: "172.21.15.78:3300,172.21.15.179:3300,172.21.15.179:3301" 2023-11-28T19:59:37.246 INFO:teuthology.orchestra.run.smithi078.stdout:mount.ceph: trying mount with new device syntax: 0@dd9780e8-3bda-44fa-a9f0-fa07d19d901d.cephfs=/ 2023-11-28T19:59:37.246 INFO:teuthology.orchestra.run.smithi078.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.78:3300/172.21.15.179:3300/172.21.15.179:3301" will pass to kernel 2023-11-28T19:59:37.249 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-11-28T19:59:37.249 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T19:59:37.249 DEBUG:teuthology.orchestra.run.smithi078:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-11-28T19:59:37.269 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T19:59:37.270 DEBUG:teuthology.orchestra.run.smithi078:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-11-28T19:59:37.322 INFO:teuthology.orchestra.run.smithi078.stdout:client4625 2023-11-28T19:59:37.323 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2023-11-28T19:59:37.323 DEBUG:teuthology.orchestra.run.smithi078:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-28T19:59:37.372 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T19:59:37.372 DEBUG:teuthology.orchestra.run.smithi078:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-11-28T19:59:37.430 INFO:teuthology.orchestra.run.smithi078.stdout:client4625 2023-11-28T19:59:37.430 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T19:59:37.430 DEBUG:teuthology.orchestra.run.smithi078:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-11-28T19:59:37.486 INFO:teuthology.orchestra.run.smithi078.stdout:client4625 2023-11-28T19:59:37.486 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T19:59:37.486 DEBUG:teuthology.orchestra.run.smithi078:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/dd9780e8-3bda-44fa-a9f0-fa07d19d901d.client4625/status') 2023-11-28T19:59:37.547 INFO:teuthology.orchestra.run.smithi078.stdout:instance: client.4625 (3)172.21.15.78:0/1113944219 2023-11-28T19:59:37.547 INFO:teuthology.orchestra.run.smithi078.stdout:blocklisted: false 2023-11-28T19:59:37.547 INFO:teuthology.orchestra.run.smithi078.stderr:0+1 records in 2023-11-28T19:59:37.547 INFO:teuthology.orchestra.run.smithi078.stderr:0+1 records out 2023-11-28T19:59:37.547 INFO:teuthology.orchestra.run.smithi078.stderr:70 bytes copied, 5.4357e-05 s, 1.3 MB/s 2023-11-28T19:59:37.549 INFO:tasks.kclient:client.1 config is {'syntax': 'v2'} 2023-11-28T19:59:37.549 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-11-28T19:59:37.549 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-11-28T19:59:37.549 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-11-28T19:59:37.726 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:37.719+0000 7f9e099f8640 1 Processor -- start 2023-11-28T19:59:37.726 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:37.719+0000 7f9e099f8640 1 -- start start 2023-11-28T19:59:37.729 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:37.723+0000 7f9e099f8640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f9e0406d2b0 0x7f9e0406d690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:37.729 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:37.723+0000 7f9e099f8640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9e040c3b80 0x7f9e040c5300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:37.729 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:37.723+0000 7f9e099f8640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9e0406bb80 con 0x7f9e0406c020 2023-11-28T19:59:37.729 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:37.723+0000 7f9e099f8640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9e040c5840 con 0x7f9e0406d2b0 2023-11-28T19:59:37.729 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:37.723+0000 7f9e099f8640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9e041515c0 con 0x7f9e040c3b80 2023-11-28T19:59:37.729 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:37.723+0000 7f9e02ffd640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f9e0406d2b0 0x7f9e0406d690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:37.730 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:37.723+0000 7f9e02ffd640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f9e0406d2b0 0x7f9e0406d690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:36956/0 (socket says 172.21.15.78:36956) 2023-11-28T19:59:37.730 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:37.723+0000 7f9e02ffd640 1 -- 172.21.15.78:0/2838621461 learned_addr learned my addr 172.21.15.78:0/2838621461 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T19:59:37.730 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:37.723+0000 7f9dfa7fc640 1 --2- 172.21.15.78:0/2838621461 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9e040c3b80 0x7f9e040c5300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:37.730 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:37.723+0000 7f9e02ffd640 1 -- 172.21.15.78:0/2838621461 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9e040c3b80 msgr2=0x7f9e040c5300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T19:59:37.730 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:37.723+0000 7f9e02ffd640 1 --2- 172.21.15.78:0/2838621461 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9e040c3b80 0x7f9e040c5300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:37.730 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:37.723+0000 7f9e02ffd640 1 -- 172.21.15.78:0/2838621461 >> v1:172.21.15.179:6789/0 conn(0x7f9e0406c020 legacy=0x7f9e0406c4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T19:59:37.730 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:37.723+0000 7f9e02ffd640 1 -- 172.21.15.78:0/2838621461 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e041518a0 con 0x7f9e0406d2b0 2023-11-28T19:59:37.730 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:37.723+0000 7f9dfa7fc640 1 --2- 172.21.15.78:0/2838621461 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9e040c3b80 0x7f9e040c5300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T19:59:37.731 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:37.723+0000 7f9e02ffd640 1 --2- 172.21.15.78:0/2838621461 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9e0406d2b0 0x7f9e0406d690 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f9df4009870 tx=0x7f9df401c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=55f61ab548cff7bd server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:59:37.731 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:37.727+0000 7f9e027fc640 1 -- 172.21.15.78:0/2838621461 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9df40ac600 con 0x7f9e0406d2b0 2023-11-28T19:59:37.731 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:37.727+0000 7f9e027fc640 1 -- 172.21.15.78:0/2838621461 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9df40a8050 con 0x7f9e0406d2b0 2023-11-28T19:59:37.731 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:37.727+0000 7f9e027fc640 1 -- 172.21.15.78:0/2838621461 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9df40ac980 con 0x7f9e0406d2b0 2023-11-28T19:59:37.732 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:37.727+0000 7f9e099f8640 1 -- 172.21.15.78:0/2838621461 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9e0406d2b0 msgr2=0x7f9e0406d690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:37.732 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:37.727+0000 7f9e099f8640 1 --2- 172.21.15.78:0/2838621461 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9e0406d2b0 0x7f9e0406d690 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f9df4009870 tx=0x7f9df401c4d0 comp rx=0 tx=0).stop 2023-11-28T19:59:37.732 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:37.727+0000 7f9e099f8640 1 -- 172.21.15.78:0/2838621461 shutdown_connections 2023-11-28T19:59:37.732 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:37.727+0000 7f9e099f8640 1 --2- 172.21.15.78:0/2838621461 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9e040c3b80 0x7f9e040c5300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:37.733 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:37.727+0000 7f9e099f8640 1 --2- 172.21.15.78:0/2838621461 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9e0406d2b0 0x7f9e0406d690 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:37.733 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:37.727+0000 7f9e099f8640 1 -- 172.21.15.78:0/2838621461 >> 172.21.15.78:0/2838621461 conn(0x7f9e040a7810 msgr2=0x7f9e040a7c20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T19:59:37.733 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:37.727+0000 7f9e099f8640 1 -- 172.21.15.78:0/2838621461 shutdown_connections 2023-11-28T19:59:37.733 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:37.727+0000 7f9e099f8640 1 -- 172.21.15.78:0/2838621461 wait complete. 2023-11-28T19:59:37.733 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:37.727+0000 7f9e099f8640 1 Processor -- start 2023-11-28T19:59:37.733 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:37.727+0000 7f9e099f8640 1 -- start start 2023-11-28T19:59:37.736 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:37.727+0000 7f9e099f8640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9e0406c020 0x7f9e0415a390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:37.736 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:37.727+0000 7f9e099f8640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9e0406d2b0 0x7f9e040aaa20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:37.736 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:37.727+0000 7f9e099f8640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9e040c3b80 0x7f9e040aaf60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:37.736 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:37.727+0000 7f9e099f8640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e0414f6e0 con 0x7f9e0406c020 2023-11-28T19:59:37.736 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:37.727+0000 7f9e099f8640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e0414a9e0 con 0x7f9e0406d2b0 2023-11-28T19:59:37.736 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:37.727+0000 7f9e099f8640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9e041528c0 con 0x7f9e040c3b80 2023-11-28T19:59:37.737 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:37.727+0000 7f9e02ffd640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9e0406c020 0x7f9e0415a390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:37.737 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:37.727+0000 7f9e02ffd640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9e0406c020 0x7f9e0415a390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:36972/0 (socket says 172.21.15.78:36972) 2023-11-28T19:59:37.737 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:37.731+0000 7f9e02ffd640 1 -- 172.21.15.78:0/2780048832 learned_addr learned my addr 172.21.15.78:0/2780048832 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T19:59:37.737 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:37.731+0000 7f9dfa7fc640 1 --2- 172.21.15.78:0/2780048832 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9e0406d2b0 0x7f9e040aaa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:37.737 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:37.731+0000 7f9e037fe640 1 --2- 172.21.15.78:0/2780048832 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9e040c3b80 0x7f9e040aaf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:37.737 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:37.731+0000 7f9e02ffd640 1 -- 172.21.15.78:0/2780048832 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9e040c3b80 msgr2=0x7f9e040aaf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:37.737 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:37.731+0000 7f9e02ffd640 1 --2- 172.21.15.78:0/2780048832 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9e040c3b80 0x7f9e040aaf60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:37.737 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:37.731+0000 7f9e02ffd640 1 -- 172.21.15.78:0/2780048832 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9e0406d2b0 msgr2=0x7f9e040aaa20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:37.737 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:37.731+0000 7f9e02ffd640 1 --2- 172.21.15.78:0/2780048832 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9e0406d2b0 0x7f9e040aaa20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:37.738 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:37.731+0000 7f9e02ffd640 1 -- 172.21.15.78:0/2780048832 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9df40094d0 con 0x7f9e0406c020 2023-11-28T19:59:37.738 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:37.731+0000 7f9e037fe640 1 --2- 172.21.15.78:0/2780048832 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9e040c3b80 0x7f9e040aaf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T19:59:37.738 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:37.731+0000 7f9e02ffd640 1 --2- 172.21.15.78:0/2780048832 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9e0406c020 0x7f9e0415a390 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f9df401ab80 tx=0x7f9df401ad10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:59:37.738 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:37.731+0000 7f9e00ff9640 1 -- 172.21.15.78:0/2780048832 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9df40b7650 con 0x7f9e0406c020 2023-11-28T19:59:37.738 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:37.731+0000 7f9e00ff9640 1 -- 172.21.15.78:0/2780048832 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9df40b77b0 con 0x7f9e0406c020 2023-11-28T19:59:37.738 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:37.731+0000 7f9e099f8640 1 -- 172.21.15.78:0/2780048832 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9e0414ef80 con 0x7f9e0406c020 2023-11-28T19:59:37.738 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:37.731+0000 7f9e00ff9640 1 -- 172.21.15.78:0/2780048832 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9df40b7b60 con 0x7f9e0406c020 2023-11-28T19:59:37.738 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:37.731+0000 7f9e099f8640 1 -- 172.21.15.78:0/2780048832 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9e04152b60 con 0x7f9e0406c020 2023-11-28T19:59:37.739 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:37.731+0000 7f9e099f8640 1 -- 172.21.15.78:0/2780048832 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9e040679d0 con 0x7f9e0406c020 2023-11-28T19:59:37.739 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:37.731+0000 7f9e00ff9640 1 -- 172.21.15.78:0/2780048832 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f9df40b3070 con 0x7f9e0406c020 2023-11-28T19:59:37.739 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:37.731+0000 7f9e00ff9640 1 --2- 172.21.15.78:0/2780048832 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f9de8066470 0x7f9de8068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:37.740 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:37.731+0000 7f9e00ff9640 1 -- 172.21.15.78:0/2780048832 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f9df411e840 con 0x7f9e0406c020 2023-11-28T19:59:37.740 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:37.731+0000 7f9dfa7fc640 1 --2- 172.21.15.78:0/2780048832 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f9de8066470 0x7f9de8068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:37.740 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:37.735+0000 7f9dfa7fc640 1 --2- 172.21.15.78:0/2780048832 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f9de8066470 0x7f9de8068930 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f9e0414abf0 tx=0x7f9dec008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:59:37.742 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:37.735+0000 7f9e00ff9640 1 -- 172.21.15.78:0/2780048832 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f9df40eb9d0 con 0x7f9e0406c020 2023-11-28T19:59:37.926 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:37.919+0000 7f9e099f8640 1 -- 172.21.15.78:0/2780048832 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f9e04067630 con 0x7f9e0406c020 2023-11-28T19:59:37.927 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:37.919+0000 7f9e00ff9640 1 -- 172.21.15.78:0/2780048832 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v9) v1 ==== 53+0+88 (secure 0 0 0) 0x7f9df40eeff0 con 0x7f9e0406c020 2023-11-28T19:59:37.927 INFO:teuthology.orchestra.run.smithi078.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2023-11-28T19:59:37.929 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:37.923+0000 7f9e099f8640 1 -- 172.21.15.78:0/2780048832 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f9de8066470 msgr2=0x7f9de8068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:37.929 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:37.923+0000 7f9e099f8640 1 --2- 172.21.15.78:0/2780048832 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f9de8066470 0x7f9de8068930 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f9e0414abf0 tx=0x7f9dec008040 comp rx=0 tx=0).stop 2023-11-28T19:59:37.929 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:37.923+0000 7f9e099f8640 1 -- 172.21.15.78:0/2780048832 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9e0406c020 msgr2=0x7f9e0415a390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:37.929 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:37.923+0000 7f9e099f8640 1 --2- 172.21.15.78:0/2780048832 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9e0406c020 0x7f9e0415a390 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f9df401ab80 tx=0x7f9df401ad10 comp rx=0 tx=0).stop 2023-11-28T19:59:37.929 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:37.923+0000 7f9e099f8640 1 -- 172.21.15.78:0/2780048832 shutdown_connections 2023-11-28T19:59:37.929 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:37.923+0000 7f9e099f8640 1 --2- 172.21.15.78:0/2780048832 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f9de8066470 0x7f9de8068930 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:37.929 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:37.923+0000 7f9e099f8640 1 --2- 172.21.15.78:0/2780048832 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9e040c3b80 0x7f9e040aaf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:37.929 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:37.923+0000 7f9e099f8640 1 --2- 172.21.15.78:0/2780048832 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9e0406d2b0 0x7f9e040aaa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:37.930 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:37.923+0000 7f9e099f8640 1 --2- 172.21.15.78:0/2780048832 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9e0406c020 0x7f9e0415a390 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:37.930 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:37.923+0000 7f9e099f8640 1 -- 172.21.15.78:0/2780048832 >> 172.21.15.78:0/2780048832 conn(0x7f9e040a7810 msgr2=0x7f9e040a7bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T19:59:37.930 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:37.923+0000 7f9e099f8640 1 -- 172.21.15.78:0/2780048832 shutdown_connections 2023-11-28T19:59:37.930 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:37.923+0000 7f9e099f8640 1 -- 172.21.15.78:0/2780048832 wait complete. 2023-11-28T19:59:37.948 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-11-28T19:59:37.948 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-11-28T19:59:37.948 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi179.front.sepia.ceph.com 2023-11-28T19:59:37.948 INFO:tasks.cephfs.mount:self.client.name = client.1 2023-11-28T19:59:37.948 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-11-28T19:59:37.948 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-11-28T19:59:37.949 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-11-28T19:59:37.949 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-11-28T19:59:37.949 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.1' 2023-11-28T19:59:37.949 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T19:59:37.950 DEBUG:teuthology.orchestra.run.smithi179:> ip addr 2023-11-28T19:59:37.960 INFO:teuthology.orchestra.run.smithi179.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-11-28T19:59:37.960 INFO:teuthology.orchestra.run.smithi179.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-11-28T19:59:37.960 INFO:teuthology.orchestra.run.smithi179.stdout: inet 127.0.0.1/8 scope host lo 2023-11-28T19:59:37.960 INFO:teuthology.orchestra.run.smithi179.stdout: valid_lft forever preferred_lft forever 2023-11-28T19:59:37.960 INFO:teuthology.orchestra.run.smithi179.stdout: inet6 ::1/128 scope host 2023-11-28T19:59:37.960 INFO:teuthology.orchestra.run.smithi179.stdout: valid_lft forever preferred_lft forever 2023-11-28T19:59:37.961 INFO:teuthology.orchestra.run.smithi179.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-11-28T19:59:37.961 INFO:teuthology.orchestra.run.smithi179.stdout: link/ether 0c:c4:7a:d9:3b:34 brd ff:ff:ff:ff:ff:ff 2023-11-28T19:59:37.961 INFO:teuthology.orchestra.run.smithi179.stdout: altname enp7s0f0 2023-11-28T19:59:37.961 INFO:teuthology.orchestra.run.smithi179.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-11-28T19:59:37.961 INFO:teuthology.orchestra.run.smithi179.stdout: link/ether 0c:c4:7a:d9:3b:35 brd ff:ff:ff:ff:ff:ff 2023-11-28T19:59:37.961 INFO:teuthology.orchestra.run.smithi179.stdout: altname enp7s0f1 2023-11-28T19:59:37.961 INFO:teuthology.orchestra.run.smithi179.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-11-28T19:59:37.961 INFO:teuthology.orchestra.run.smithi179.stdout: link/ether 0c:c4:7a:88:72:5a brd ff:ff:ff:ff:ff:ff 2023-11-28T19:59:37.961 INFO:teuthology.orchestra.run.smithi179.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-11-28T19:59:37.961 INFO:teuthology.orchestra.run.smithi179.stdout: link/ether 0c:c4:7a:88:72:5b brd ff:ff:ff:ff:ff:ff 2023-11-28T19:59:37.961 INFO:teuthology.orchestra.run.smithi179.stdout: inet 172.21.15.179/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2023-11-28T19:59:37.961 INFO:teuthology.orchestra.run.smithi179.stdout: valid_lft 42404sec preferred_lft 42404sec 2023-11-28T19:59:37.962 INFO:teuthology.orchestra.run.smithi179.stdout: inet6 fe80::ec4:7aff:fe88:725b/64 scope link 2023-11-28T19:59:37.962 INFO:teuthology.orchestra.run.smithi179.stdout: valid_lft forever preferred_lft forever 2023-11-28T19:59:37.962 INFO:teuthology.orchestra.run.smithi179.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-11-28T19:59:37.962 INFO:teuthology.orchestra.run.smithi179.stdout: link/ether 02:42:75:f0:7b:8c brd ff:ff:ff:ff:ff:ff 2023-11-28T19:59:37.962 INFO:teuthology.orchestra.run.smithi179.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-11-28T19:59:37.962 INFO:teuthology.orchestra.run.smithi179.stdout: valid_lft forever preferred_lft forever 2023-11-28T19:59:37.963 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-11-28T19:59:37.963 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T19:59:37.963 DEBUG:teuthology.orchestra.run.smithi179:> (cd / && exec bash -c ' 2023-11-28T19:59:37.963 DEBUG:teuthology.orchestra.run.smithi179:> set -e 2023-11-28T19:59:37.963 DEBUG:teuthology.orchestra.run.smithi179:> sudo ip link add name ceph-brx type bridge 2023-11-28T19:59:37.964 DEBUG:teuthology.orchestra.run.smithi179:> sudo ip addr flush dev ceph-brx 2023-11-28T19:59:37.964 DEBUG:teuthology.orchestra.run.smithi179:> sudo ip link set ceph-brx up 2023-11-28T19:59:37.964 DEBUG:teuthology.orchestra.run.smithi179:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-11-28T19:59:37.964 DEBUG:teuthology.orchestra.run.smithi179:> ') 2023-11-28T19:59:38.077 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T19:59:38.077 DEBUG:teuthology.orchestra.run.smithi179:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-11-28T19:59:38.097 INFO:teuthology.orchestra.run.smithi179.stdout:1 2023-11-28T19:59:38.099 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T19:59:38.099 DEBUG:teuthology.orchestra.run.smithi179:> route 2023-11-28T19:59:38.172 INFO:teuthology.orchestra.run.smithi179.stdout:Kernel IP routing table 2023-11-28T19:59:38.173 INFO:teuthology.orchestra.run.smithi179.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-11-28T19:59:38.173 INFO:teuthology.orchestra.run.smithi179.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2023-11-28T19:59:38.173 INFO:teuthology.orchestra.run.smithi179.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-11-28T19:59:38.173 INFO:teuthology.orchestra.run.smithi179.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-11-28T19:59:38.173 INFO:teuthology.orchestra.run.smithi179.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-11-28T19:59:38.173 INFO:teuthology.orchestra.run.smithi179.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-11-28T19:59:38.174 INFO:teuthology.orchestra.run.smithi179.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-11-28T19:59:38.174 INFO:teuthology.orchestra.run.smithi179.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-11-28T19:59:38.174 INFO:teuthology.orchestra.run.smithi179.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-11-28T19:59:38.174 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T19:59:38.174 DEBUG:teuthology.orchestra.run.smithi179:> (cd / && exec bash -c ' 2023-11-28T19:59:38.174 DEBUG:teuthology.orchestra.run.smithi179:> set -e 2023-11-28T19:59:38.174 DEBUG:teuthology.orchestra.run.smithi179:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-11-28T19:59:38.174 DEBUG:teuthology.orchestra.run.smithi179:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-11-28T19:59:38.174 DEBUG:teuthology.orchestra.run.smithi179:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-11-28T19:59:38.175 DEBUG:teuthology.orchestra.run.smithi179:> ') 2023-11-28T19:59:38.266 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T19:59:38.267 DEBUG:teuthology.orchestra.run.smithi179:> ip netns list 2023-11-28T19:59:38.276 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T19:59:38.276 DEBUG:teuthology.orchestra.run.smithi179:> ip netns list-id 2023-11-28T19:59:38.334 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T19:59:38.335 DEBUG:teuthology.orchestra.run.smithi179:> (cd / && exec bash -c ' 2023-11-28T19:59:38.335 DEBUG:teuthology.orchestra.run.smithi179:> set -e 2023-11-28T19:59:38.335 DEBUG:teuthology.orchestra.run.smithi179:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.1 2023-11-28T19:59:38.335 DEBUG:teuthology.orchestra.run.smithi179:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.1 0 2023-11-28T19:59:38.335 DEBUG:teuthology.orchestra.run.smithi179:> ') 2023-11-28T19:59:38.415 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.1' with 192.168.0.1/16 2023-11-28T19:59:38.415 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T19:59:38.415 DEBUG:teuthology.orchestra.run.smithi179:> (cd / && exec bash -c ' 2023-11-28T19:59:38.415 DEBUG:teuthology.orchestra.run.smithi179:> set -e 2023-11-28T19:59:38.416 DEBUG:teuthology.orchestra.run.smithi179:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.1 type veth peer name brx.0 2023-11-28T19:59:38.416 DEBUG:teuthology.orchestra.run.smithi179:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-11-28T19:59:38.416 DEBUG:teuthology.orchestra.run.smithi179:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set veth0 up 2023-11-28T19:59:38.416 DEBUG:teuthology.orchestra.run.smithi179:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set lo up 2023-11-28T19:59:38.416 DEBUG:teuthology.orchestra.run.smithi179:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip route add default via 192.168.255.254 2023-11-28T19:59:38.416 DEBUG:teuthology.orchestra.run.smithi179:> ') 2023-11-28T19:59:38.579 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T19:59:38.579 DEBUG:teuthology.orchestra.run.smithi179:> (cd / && exec bash -c ' 2023-11-28T19:59:38.579 DEBUG:teuthology.orchestra.run.smithi179:> set -e 2023-11-28T19:59:38.579 DEBUG:teuthology.orchestra.run.smithi179:> sudo ip link set brx.0 up 2023-11-28T19:59:38.579 DEBUG:teuthology.orchestra.run.smithi179:> sudo ip link set dev brx.0 master ceph-brx 2023-11-28T19:59:38.579 DEBUG:teuthology.orchestra.run.smithi179:> ') 2023-11-28T19:59:38.620 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-28T19:59:38.620 DEBUG:teuthology.orchestra.run.smithi179:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2023-11-28T19:59:38.677 INFO:teuthology.orchestra.run.smithi179.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2023-11-28T19:59:38.677 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-28T19:59:38.678 DEBUG:teuthology.orchestra.run.smithi179:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2023-11-28T19:59:38.728 INFO:tasks.cephfs.kernel_mount:mounting using device: 1@.cephfs=/ 2023-11-28T19:59:38.728 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T19:59:38.728 DEBUG:teuthology.orchestra.run.smithi179:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 1@.cephfs=/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-11-28T19:59:38.831 INFO:teuthology.orchestra.run.smithi179.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-11-28T19:59:38.832 INFO:teuthology.orchestra.run.smithi179.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-11-28T19:59:38.931 INFO:teuthology.orchestra.run.smithi179.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-11-28T19:59:38.932 INFO:teuthology.orchestra.run.smithi179.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-11-28T19:59:38.932 INFO:teuthology.orchestra.run.smithi179.stdout:mount.ceph: resolved to: "172.21.15.78:3300,172.21.15.179:3300,172.21.15.179:3301" 2023-11-28T19:59:38.932 INFO:teuthology.orchestra.run.smithi179.stdout:mount.ceph: trying mount with new device syntax: 1@dd9780e8-3bda-44fa-a9f0-fa07d19d901d.cephfs=/ 2023-11-28T19:59:38.932 INFO:teuthology.orchestra.run.smithi179.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,ms_mode=prefer-crc,key=1,mon_addr=172.21.15.78:3300/172.21.15.179:3300/172.21.15.179:3301" will pass to kernel 2023-11-28T19:59:38.936 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-11-28T19:59:38.936 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T19:59:38.936 DEBUG:teuthology.orchestra.run.smithi179:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-11-28T19:59:38.957 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T19:59:38.957 DEBUG:teuthology.orchestra.run.smithi179:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-11-28T19:59:39.023 INFO:teuthology.orchestra.run.smithi179.stdout:client4631 2023-11-28T19:59:39.023 DEBUG:teuthology.orchestra.run.smithi179:> set -ex 2023-11-28T19:59:39.023 DEBUG:teuthology.orchestra.run.smithi179:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-28T19:59:39.072 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T19:59:39.072 DEBUG:teuthology.orchestra.run.smithi179:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-11-28T19:59:39.131 INFO:teuthology.orchestra.run.smithi179.stdout:client4631 2023-11-28T19:59:39.131 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T19:59:39.131 DEBUG:teuthology.orchestra.run.smithi179:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-11-28T19:59:39.183 INFO:teuthology.orchestra.run.smithi179.stdout:client4631 2023-11-28T19:59:39.183 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T19:59:39.183 DEBUG:teuthology.orchestra.run.smithi179:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/dd9780e8-3bda-44fa-a9f0-fa07d19d901d.client4631/status') 2023-11-28T19:59:39.248 INFO:teuthology.orchestra.run.smithi179.stdout:instance: client.4631 (3)192.168.0.1:0/3007373884 2023-11-28T19:59:39.248 INFO:teuthology.orchestra.run.smithi179.stdout:blocklisted: false 2023-11-28T19:59:39.248 INFO:teuthology.orchestra.run.smithi179.stderr:0+1 records in 2023-11-28T19:59:39.248 INFO:teuthology.orchestra.run.smithi179.stderr:0+1 records out 2023-11-28T19:59:39.248 INFO:teuthology.orchestra.run.smithi179.stderr:69 bytes copied, 5.4953e-05 s, 1.3 MB/s 2023-11-28T19:59:39.250 INFO:teuthology.run_tasks:Running task cephfs_test_runner... 2023-11-28T19:59:39.264 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-28T19:59:39.410 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:39.403+0000 7f092f79d640 1 Processor -- start 2023-11-28T19:59:39.410 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:39.403+0000 7f092f79d640 1 -- start start 2023-11-28T19:59:39.411 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:39.407+0000 7f092f79d640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f09280c3960 0x7f09280c0460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:39.411 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:39.407+0000 7f092f79d640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f09280c1a50 con 0x7f0928072580 2023-11-28T19:59:39.412 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:39.407+0000 7f092f79d640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f09280c3d90 con 0x7f09280c0f30 2023-11-28T19:59:39.412 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:39.407+0000 7f092f79d640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0928159990 con 0x7f09280c3960 2023-11-28T19:59:39.412 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:39.407+0000 7f092cd38640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f0928072580 0x7f0928155ed0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:60736/0 (socket says 172.21.15.78:60736) 2023-11-28T19:59:39.412 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:39.407+0000 7f092cd38640 1 -- 172.21.15.78:0/361562009 learned_addr learned my addr 172.21.15.78:0/361562009 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-11-28T19:59:39.412 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:39.407+0000 7f092dd3a640 1 --2- 172.21.15.78:0/361562009 >> v2:172.21.15.179:3300/0 conn(0x7f09280c3960 0x7f09280c0460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:39.413 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:39.407+0000 7f091ffff640 1 -- 172.21.15.78:0/361562009 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 50459865 0 0) 0x7f09280c1a50 con 0x7f0928072580 2023-11-28T19:59:39.413 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:39.407+0000 7f091ffff640 1 -- 172.21.15.78:0/361562009 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0914003530 con 0x7f0928072580 2023-11-28T19:59:39.413 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:39.407+0000 7f091ffff640 1 -- 172.21.15.78:0/361562009 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 863090746 0 0) 0x7f09280c3d90 con 0x7f09280c0f30 2023-11-28T19:59:39.413 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:39.407+0000 7f091ffff640 1 -- 172.21.15.78:0/361562009 --> v1:172.21.15.179:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f09280c1a50 con 0x7f09280c0f30 2023-11-28T19:59:39.413 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:39.407+0000 7f092dd3a640 1 -- 172.21.15.78:0/361562009 >> v1:172.21.15.179:6789/0 conn(0x7f09280c0f30 legacy=0x7f0928159280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:39.413 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:39.407+0000 7f092dd3a640 1 -- 172.21.15.78:0/361562009 >> v1:172.21.15.78:6789/0 conn(0x7f0928072580 legacy=0x7f0928155ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:39.413 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:39.407+0000 7f092dd3a640 1 -- 172.21.15.78:0/361562009 --> v2:172.21.15.179:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09280c1ca0 con 0x7f09280c3960 2023-11-28T19:59:39.415 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:39.411+0000 7f092dd3a640 1 --2- 172.21.15.78:0/361562009 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f09280c3960 0x7f09280c0460 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f0920009d90 tx=0x7f092001c8c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3635fed4cd03637a server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:59:39.415 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:39.411+0000 7f091ffff640 1 -- 172.21.15.78:0/361562009 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09200a59a0 con 0x7f09280c3960 2023-11-28T19:59:39.415 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:39.411+0000 7f091ffff640 1 -- 172.21.15.78:0/361562009 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f09200a5b00 con 0x7f09280c3960 2023-11-28T19:59:39.415 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:39.411+0000 7f091ffff640 1 -- 172.21.15.78:0/361562009 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09200a5e90 con 0x7f09280c3960 2023-11-28T19:59:39.416 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:39.411+0000 7f092f79d640 1 -- 172.21.15.78:0/361562009 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f09280c3960 msgr2=0x7f09280c0460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:39.416 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:39.411+0000 7f092f79d640 1 --2- 172.21.15.78:0/361562009 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f09280c3960 0x7f09280c0460 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f0920009d90 tx=0x7f092001c8c0 comp rx=0 tx=0).stop 2023-11-28T19:59:39.416 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:39.411+0000 7f092f79d640 1 -- 172.21.15.78:0/361562009 shutdown_connections 2023-11-28T19:59:39.416 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:39.411+0000 7f092f79d640 1 --2- 172.21.15.78:0/361562009 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f09280c3960 0x7f09280c0460 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:39.416 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:39.411+0000 7f092f79d640 1 -- 172.21.15.78:0/361562009 >> 172.21.15.78:0/361562009 conn(0x7f09280a7810 msgr2=0x7f09280a7c20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T19:59:39.416 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:39.411+0000 7f092f79d640 1 -- 172.21.15.78:0/361562009 shutdown_connections 2023-11-28T19:59:39.417 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:39.411+0000 7f092f79d640 1 -- 172.21.15.78:0/361562009 wait complete. 2023-11-28T19:59:39.417 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:39.411+0000 7f092f79d640 1 Processor -- start 2023-11-28T19:59:39.418 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:39.411+0000 7f092f79d640 1 -- start start 2023-11-28T19:59:39.419 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:39.411+0000 7f092f79d640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0928072580 0x7f09281496f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:39.419 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:39.411+0000 7f092f79d640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f09280c0f30 0x7f09281f4300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:39.419 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:39.411+0000 7f092f79d640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f09280c3960 0x7f09281f4840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:39.419 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:39.411+0000 7f092f79d640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09281f3eb0 con 0x7f09280c3960 2023-11-28T19:59:39.419 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:39.411+0000 7f092f79d640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09280ab610 con 0x7f09280c0f30 2023-11-28T19:59:39.419 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:39.411+0000 7f092f79d640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09281f4d80 con 0x7f0928072580 2023-11-28T19:59:39.419 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:39.415+0000 7f092dd3a640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f09280c3960 0x7f09281f4840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:39.420 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:39.415+0000 7f092dd3a640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f09280c3960 0x7f09281f4840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:36982/0 (socket says 172.21.15.78:36982) 2023-11-28T19:59:39.420 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:39.415+0000 7f092dd3a640 1 -- 172.21.15.78:0/1081216373 learned_addr learned my addr 172.21.15.78:0/1081216373 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T19:59:39.420 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:39.415+0000 7f092cd38640 1 --2- 172.21.15.78:0/1081216373 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f09280c0f30 0x7f09281f4300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:39.420 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:39.415+0000 7f092d539640 1 --2- 172.21.15.78:0/1081216373 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0928072580 0x7f09281496f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:39.421 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:39.415+0000 7f092dd3a640 1 -- 172.21.15.78:0/1081216373 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0928072580 msgr2=0x7f09281496f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:39.421 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:39.415+0000 7f092dd3a640 1 --2- 172.21.15.78:0/1081216373 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0928072580 0x7f09281496f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:39.421 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:39.415+0000 7f092dd3a640 1 -- 172.21.15.78:0/1081216373 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f09280c0f30 msgr2=0x7f09281f4300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:39.421 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:39.415+0000 7f092dd3a640 1 --2- 172.21.15.78:0/1081216373 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f09280c0f30 0x7f09281f4300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:39.421 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:39.415+0000 7f092dd3a640 1 -- 172.21.15.78:0/1081216373 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0920009a70 con 0x7f09280c3960 2023-11-28T19:59:39.421 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:39.415+0000 7f092dd3a640 1 --2- 172.21.15.78:0/1081216373 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f09280c3960 0x7f09281f4840 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f092001a4f0 tx=0x7f0920019660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:59:39.422 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:39.415+0000 7f091dffb640 1 -- 172.21.15.78:0/1081216373 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09200adc60 con 0x7f09280c3960 2023-11-28T19:59:39.422 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:39.415+0000 7f091dffb640 1 -- 172.21.15.78:0/1081216373 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f09200addc0 con 0x7f09280c3960 2023-11-28T19:59:39.422 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:39.415+0000 7f091dffb640 1 -- 172.21.15.78:0/1081216373 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09200b7610 con 0x7f09280c3960 2023-11-28T19:59:39.422 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:39.415+0000 7f092f79d640 1 -- 172.21.15.78:0/1081216373 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0928156760 con 0x7f09280c3960 2023-11-28T19:59:39.422 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:39.415+0000 7f092f79d640 1 -- 172.21.15.78:0/1081216373 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f09280ab820 con 0x7f09280c3960 2023-11-28T19:59:39.422 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:39.415+0000 7f092f79d640 1 -- 172.21.15.78:0/1081216373 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f09281f4020 con 0x7f09280c3960 2023-11-28T19:59:39.422 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:39.415+0000 7f091dffb640 1 -- 172.21.15.78:0/1081216373 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f09200b4050 con 0x7f09280c3960 2023-11-28T19:59:39.423 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:39.419+0000 7f091dffb640 1 --2- 172.21.15.78:0/1081216373 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f090c066470 0x7f090c068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:39.423 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:39.419+0000 7f091dffb640 1 -- 172.21.15.78:0/1081216373 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f092011f060 con 0x7f09280c3960 2023-11-28T19:59:39.423 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:39.419+0000 7f092d539640 1 --2- 172.21.15.78:0/1081216373 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f090c066470 0x7f090c068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:39.423 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:39.419+0000 7f092d539640 1 --2- 172.21.15.78:0/1081216373 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f090c066470 0x7f090c068930 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f09240011f0 tx=0x7f0924009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:59:39.427 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:39.423+0000 7f091dffb640 1 -- 172.21.15.78:0/1081216373 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f0920150280 con 0x7f09280c3960 2023-11-28T19:59:39.575 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:39.571+0000 7f092f79d640 1 -- 172.21.15.78:0/1081216373 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0928067630 con 0x7f09280c3960 2023-11-28T19:59:39.577 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:39.571+0000 7f091dffb640 1 -- 172.21.15.78:0/1081216373 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+18322 (secure 0 0 0) 0x7f09200b2090 con 0x7f09280c3960 2023-11-28T19:59:39.577 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-11-28T19:59:39.577 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":25,"fsid":"dd9780e8-3bda-44fa-a9f0-fa07d19d901d","created":"2023-11-28T19:58:40.969556+0000","modified":"2023-11-28T19:59:10.474525+0000","last_up_change":"2023-11-28T19:58:52.596716+0000","last_in_change":"2023-11-28T19:58:43.609275+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-28T19:58:54.011229+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-28T19:59:03.945559+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-28T19:59:04.481478+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-11-28T19:59:08.109152+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"e84245ac-b5da-429e-af18-39acaa2b33e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6800","nonce":3358701235},{"type":"v1","addr":"172.21.15.78:6801","nonce":3358701235}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6802","nonce":3358701235},{"type":"v1","addr":"172.21.15.78:6803","nonce":3358701235}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6806","nonce":3358701235},{"type":"v1","addr":"172.21.15.78:6807","nonce":3358701235}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6804","nonce":3358701235},{"type":"v1","addr":"172.21.15.78:6805","nonce":3358701235}]},"public_addr":"172.21.15.78:6801/3358701235","cluster_addr":"172.21.15.78:6803/3358701235","heartbeat_back_addr":"172.21.15.78:6807/3358701235","heartbeat_front_addr":"172.21.15.78:6805/3358701235","state":["exists","up"]},{"osd":1,"uuid":"e634831d-c4e2-48d9-870c-9556ae162981","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6808","nonce":3211476654},{"type":"v1","addr":"172.21.15.78:6809","nonce":3211476654}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6810","nonce":3211476654},{"type":"v1","addr":"172.21.15.78:6811","nonce":3211476654}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6814","nonce":3211476654},{"type":"v1","addr":"172.21.15.78:6815","nonce":3211476654}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6812","nonce":3211476654},{"type":"v1","addr":"172.21.15.78:6813","nonce":3211476654}]},"public_addr":"172.21.15.78:6809/3211476654","cluster_addr":"172.21.15.78:6811/3211476654","heartbeat_back_addr":"172.21.15.78:6815/3211476654","heartbeat_front_addr":"172.21.15.78:6813/3211476654","state":["exists","up"]},{"osd":2,"uuid":"274c8395-6534-41f0-b8fb-a00af8985aa8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6816","nonce":2532904479},{"type":"v1","addr":"172.21.15.78:6817","nonce":2532904479}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6818","nonce":2532904479},{"type":"v1","addr":"172.21.15.78:6819","nonce":2532904479}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6822","nonce":2532904479},{"type":"v1","addr":"172.21.15.78:6823","nonce":2532904479}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6820","nonce":2532904479},{"type":"v1","addr":"172.21.15.78:6821","nonce":2532904479}]},"public_addr":"172.21.15.78:6817/2532904479","cluster_addr":"172.21.15.78:6819/2532904479","heartbeat_back_addr":"172.21.15.78:6823/2532904479","heartbeat_front_addr":"172.21.15.78:6821/2532904479","state":["exists","up"]},{"osd":3,"uuid":"77acc9af-7d4d-4b18-8cf5-d62f5971b7c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6824","nonce":3442991267},{"type":"v1","addr":"172.21.15.78:6825","nonce":3442991267}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6826","nonce":3442991267},{"type":"v1","addr":"172.21.15.78:6827","nonce":3442991267}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6830","nonce":3442991267},{"type":"v1","addr":"172.21.15.78:6831","nonce":3442991267}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6828","nonce":3442991267},{"type":"v1","addr":"172.21.15.78:6829","nonce":3442991267}]},"public_addr":"172.21.15.78:6825/3442991267","cluster_addr":"172.21.15.78:6827/3442991267","heartbeat_back_addr":"172.21.15.78:6831/3442991267","heartbeat_front_addr":"172.21.15.78:6829/3442991267","state":["exists","up"]},{"osd":4,"uuid":"5c62bc66-6b34-4b7f-a66b-9a743969138c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":802983577},{"type":"v1","addr":"172.21.15.179:6809","nonce":802983577}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":802983577},{"type":"v1","addr":"172.21.15.179:6811","nonce":802983577}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":802983577},{"type":"v1","addr":"172.21.15.179:6815","nonce":802983577}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":802983577},{"type":"v1","addr":"172.21.15.179:6813","nonce":802983577}]},"public_addr":"172.21.15.179:6809/802983577","cluster_addr":"172.21.15.179:6811/802983577","heartbeat_back_addr":"172.21.15.179:6815/802983577","heartbeat_front_addr":"172.21.15.179:6813/802983577","state":["exists","up"]},{"osd":5,"uuid":"67db6d36-f684-4079-b0cd-82b4dd61461f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":518192887},{"type":"v1","addr":"172.21.15.179:6818","nonce":518192887}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":518192887},{"type":"v1","addr":"172.21.15.179:6822","nonce":518192887}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":518192887},{"type":"v1","addr":"172.21.15.179:6829","nonce":518192887}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6824","nonce":518192887},{"type":"v1","addr":"172.21.15.179:6826","nonce":518192887}]},"public_addr":"172.21.15.179:6818/518192887","cluster_addr":"172.21.15.179:6822/518192887","heartbeat_back_addr":"172.21.15.179:6829/518192887","heartbeat_front_addr":"172.21.15.179:6826/518192887","state":["exists","up"]},{"osd":6,"uuid":"12e670af-5a16-4c81-9f97-defa66cab967","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":815435378},{"type":"v1","addr":"172.21.15.179:6801","nonce":815435378}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":815435378},{"type":"v1","addr":"172.21.15.179:6803","nonce":815435378}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":815435378},{"type":"v1","addr":"172.21.15.179:6807","nonce":815435378}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":815435378},{"type":"v1","addr":"172.21.15.179:6805","nonce":815435378}]},"public_addr":"172.21.15.179:6801/815435378","cluster_addr":"172.21.15.179:6803/815435378","heartbeat_back_addr":"172.21.15.179:6807/815435378","heartbeat_front_addr":"172.21.15.179:6805/815435378","state":["exists","up"]},{"osd":7,"uuid":"fe630650-2eb3-49ad-8676-c341e6332eb1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6817","nonce":2848432339},{"type":"v1","addr":"172.21.15.179:6819","nonce":2848432339}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6821","nonce":2848432339},{"type":"v1","addr":"172.21.15.179:6823","nonce":2848432339}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":2848432339},{"type":"v1","addr":"172.21.15.179:6831","nonce":2848432339}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6825","nonce":2848432339},{"type":"v1","addr":"172.21.15.179:6827","nonce":2848432339}]},"public_addr":"172.21.15.179:6819/2848432339","cluster_addr":"172.21.15.179:6823/2848432339","heartbeat_back_addr":"172.21.15.179:6831/2848432339","heartbeat_front_addr":"172.21.15.179:6827/2848432339","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:58:49.255433+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:58:49.412880+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:58:49.559295+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:58:49.245237+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:58:49.184557+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:58:49.329851+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:58:49.366012+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:58:49.349604+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-28T19:59:39.579 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:39.571+0000 7f092f79d640 1 -- 172.21.15.78:0/1081216373 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f090c066470 msgr2=0x7f090c068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:39.580 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:39.571+0000 7f092f79d640 1 --2- 172.21.15.78:0/1081216373 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f090c066470 0x7f090c068930 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f09240011f0 tx=0x7f0924009040 comp rx=0 tx=0).stop 2023-11-28T19:59:39.580 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:39.571+0000 7f092f79d640 1 -- 172.21.15.78:0/1081216373 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f09280c3960 msgr2=0x7f09281f4840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:39.580 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:39.571+0000 7f092f79d640 1 --2- 172.21.15.78:0/1081216373 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f09280c3960 0x7f09281f4840 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f092001a4f0 tx=0x7f0920019660 comp rx=0 tx=0).stop 2023-11-28T19:59:39.580 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:39.571+0000 7f092f79d640 1 -- 172.21.15.78:0/1081216373 shutdown_connections 2023-11-28T19:59:39.580 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:39.571+0000 7f092f79d640 1 --2- 172.21.15.78:0/1081216373 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f090c066470 0x7f090c068930 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:39.580 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:39.571+0000 7f092f79d640 1 --2- 172.21.15.78:0/1081216373 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f09280c3960 0x7f09281f4840 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:39.580 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:39.571+0000 7f092f79d640 1 --2- 172.21.15.78:0/1081216373 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f09280c0f30 0x7f09281f4300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:39.581 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:39.571+0000 7f092f79d640 1 --2- 172.21.15.78:0/1081216373 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0928072580 0x7f09281496f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:39.581 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:39.571+0000 7f092f79d640 1 -- 172.21.15.78:0/1081216373 >> 172.21.15.78:0/1081216373 conn(0x7f09280a7810 msgr2=0x7f0928158160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T19:59:39.581 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:39.575+0000 7f092f79d640 1 -- 172.21.15.78:0/1081216373 shutdown_connections 2023-11-28T19:59:39.581 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:39.575+0000 7f092f79d640 1 -- 172.21.15.78:0/1081216373 wait complete. 2023-11-28T19:59:39.599 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-28T19:58:54.011229+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-28T19:59:03.945559+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-11-28T19:59:04.481478+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-11-28T19:59:08.109152+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-11-28T19:59:39.600 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-28T19:59:39.740 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:39.735+0000 7f6c3beaa640 1 Processor -- start 2023-11-28T19:59:39.741 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:39.735+0000 7f6c3beaa640 1 -- start start 2023-11-28T19:59:39.743 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:39.735+0000 7f6c3beaa640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f6c340af4d0 0x7f6c340c6840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:39.743 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:39.735+0000 7f6c3beaa640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f6c340c6d80 0x7f6c3406b710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:39.743 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:39.735+0000 7f6c3beaa640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6c34154f00 0x7f6c3406bc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:39.744 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:39.735+0000 7f6c3beaa640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6c340af8b0 con 0x7f6c340c6d80 2023-11-28T19:59:39.744 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:39.735+0000 7f6c3beaa640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6c340c8450 con 0x7f6c340af4d0 2023-11-28T19:59:39.744 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:39.735+0000 7f6c3beaa640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c34155470 con 0x7f6c34154f00 2023-11-28T19:59:39.745 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:39.735+0000 7f6c39445640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f6c340c6d80 0x7f6c3406b710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:39.745 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:39.735+0000 7f6c39445640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f6c340c6d80 0x7f6c3406b710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:36998/0 (socket says 172.21.15.78:36998) 2023-11-28T19:59:39.745 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:39.735+0000 7f6c39445640 1 -- 172.21.15.78:0/2319902134 learned_addr learned my addr 172.21.15.78:0/2319902134 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T19:59:39.746 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:39.735+0000 7f6c39c46640 1 --2- 172.21.15.78:0/2319902134 >> v2:172.21.15.179:3300/0 conn(0x7f6c340af4d0 0x7f6c340c6840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:39.746 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:39.735+0000 7f6c3a447640 1 --2- 172.21.15.78:0/2319902134 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6c34154f00 0x7f6c3406bc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:39.746 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:39.735+0000 7f6c39445640 1 -- 172.21.15.78:0/2319902134 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6c34154f00 msgr2=0x7f6c3406bc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T19:59:39.746 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:39.735+0000 7f6c39445640 1 --2- 172.21.15.78:0/2319902134 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6c34154f00 0x7f6c3406bc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:39.746 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:39.735+0000 7f6c39445640 1 -- 172.21.15.78:0/2319902134 >> v2:172.21.15.179:3300/0 conn(0x7f6c340af4d0 msgr2=0x7f6c340c6840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T19:59:39.746 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:39.735+0000 7f6c39445640 1 --2- 172.21.15.78:0/2319902134 >> v2:172.21.15.179:3300/0 conn(0x7f6c340af4d0 0x7f6c340c6840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:39.746 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:39.735+0000 7f6c39445640 1 -- 172.21.15.78:0/2319902134 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c340c48c0 con 0x7f6c340c6d80 2023-11-28T19:59:39.746 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:39.735+0000 7f6c3a447640 1 --2- 172.21.15.78:0/2319902134 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6c34154f00 0x7f6c3406bc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T19:59:39.748 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:39.739+0000 7f6c39445640 1 --2- 172.21.15.78:0/2319902134 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6c340c6d80 0x7f6c3406b710 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f6c3408b500 tx=0x7f6c2401c440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e899fbe5086cbfec server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:59:39.748 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:39.739+0000 7f6c38c44640 1 -- 172.21.15.78:0/2319902134 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c240ab600 con 0x7f6c340c6d80 2023-11-28T19:59:39.748 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:39.739+0000 7f6c38c44640 1 -- 172.21.15.78:0/2319902134 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c240ab760 con 0x7f6c340c6d80 2023-11-28T19:59:39.748 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:39.739+0000 7f6c38c44640 1 -- 172.21.15.78:0/2319902134 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c240abaf0 con 0x7f6c340c6d80 2023-11-28T19:59:39.748 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:39.739+0000 7f6c3beaa640 1 -- 172.21.15.78:0/2319902134 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6c340c6d80 msgr2=0x7f6c3406b710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:39.748 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:39.739+0000 7f6c3beaa640 1 --2- 172.21.15.78:0/2319902134 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6c340c6d80 0x7f6c3406b710 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f6c3408b500 tx=0x7f6c2401c440 comp rx=0 tx=0).stop 2023-11-28T19:59:39.748 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:39.739+0000 7f6c3beaa640 1 -- 172.21.15.78:0/2319902134 shutdown_connections 2023-11-28T19:59:39.748 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:39.739+0000 7f6c3beaa640 1 --2- 172.21.15.78:0/2319902134 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6c34154f00 0x7f6c3406bc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:39.748 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:39.739+0000 7f6c3beaa640 1 --2- 172.21.15.78:0/2319902134 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6c340c6d80 0x7f6c3406b710 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:39.748 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:39.739+0000 7f6c3beaa640 1 --2- 172.21.15.78:0/2319902134 >> v2:172.21.15.179:3300/0 conn(0x7f6c340af4d0 0x7f6c340c6840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:39.748 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:39.739+0000 7f6c3beaa640 1 -- 172.21.15.78:0/2319902134 >> 172.21.15.78:0/2319902134 conn(0x7f6c340aba00 msgr2=0x7f6c340abe10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T19:59:39.749 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:39.739+0000 7f6c3beaa640 1 -- 172.21.15.78:0/2319902134 shutdown_connections 2023-11-28T19:59:39.749 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:39.739+0000 7f6c3beaa640 1 -- 172.21.15.78:0/2319902134 wait complete. 2023-11-28T19:59:39.749 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:39.743+0000 7f6c3beaa640 1 Processor -- start 2023-11-28T19:59:39.749 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:39.743+0000 7f6c3beaa640 1 -- start start 2023-11-28T19:59:39.751 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:39.743+0000 7f6c3beaa640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6c340af4d0 0x7f6c341529c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:39.751 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:39.743+0000 7f6c3beaa640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6c340c6d80 0x7f6c340c0f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:39.751 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:39.743+0000 7f6c3beaa640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6c34154f00 0x7f6c340c1440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:39.751 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:39.743+0000 7f6c3beaa640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c341ed6d0 con 0x7f6c34154f00 2023-11-28T19:59:39.751 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:39.743+0000 7f6c3beaa640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c34159890 con 0x7f6c340af4d0 2023-11-28T19:59:39.751 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:39.743+0000 7f6c3beaa640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c34150660 con 0x7f6c340c6d80 2023-11-28T19:59:39.751 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:39.743+0000 7f6c3a447640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6c34154f00 0x7f6c340c1440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:39.751 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:39.743+0000 7f6c3a447640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6c34154f00 0x7f6c340c1440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:37014/0 (socket says 172.21.15.78:37014) 2023-11-28T19:59:39.751 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:39.743+0000 7f6c3a447640 1 -- 172.21.15.78:0/2861156882 learned_addr learned my addr 172.21.15.78:0/2861156882 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T19:59:39.751 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:39.743+0000 7f6c39c46640 1 --2- 172.21.15.78:0/2861156882 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6c340af4d0 0x7f6c341529c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:39.752 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:39.743+0000 7f6c39445640 1 --2- 172.21.15.78:0/2861156882 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6c340c6d80 0x7f6c340c0f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:39.752 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:39.743+0000 7f6c3a447640 1 -- 172.21.15.78:0/2861156882 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6c340c6d80 msgr2=0x7f6c340c0f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:39.752 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:39.743+0000 7f6c3a447640 1 --2- 172.21.15.78:0/2861156882 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6c340c6d80 0x7f6c340c0f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:39.752 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:39.743+0000 7f6c3a447640 1 -- 172.21.15.78:0/2861156882 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6c340af4d0 msgr2=0x7f6c341529c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:39.752 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:39.743+0000 7f6c3a447640 1 --2- 172.21.15.78:0/2861156882 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6c340af4d0 0x7f6c341529c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:39.752 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:39.743+0000 7f6c3a447640 1 -- 172.21.15.78:0/2861156882 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c240094d0 con 0x7f6c34154f00 2023-11-28T19:59:39.752 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:39.743+0000 7f6c39445640 1 --2- 172.21.15.78:0/2861156882 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6c340c6d80 0x7f6c340c0f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T19:59:39.752 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:39.743+0000 7f6c3a447640 1 --2- 172.21.15.78:0/2861156882 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6c34154f00 0x7f6c340c1440 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f6c2c009fa0 tx=0x7f6c2c00d560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:59:39.752 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:39.743+0000 7f6c2a7fc640 1 -- 172.21.15.78:0/2861156882 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c2c003ba0 con 0x7f6c34154f00 2023-11-28T19:59:39.752 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:39.743+0000 7f6c2a7fc640 1 -- 172.21.15.78:0/2861156882 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c2c00f040 con 0x7f6c34154f00 2023-11-28T19:59:39.753 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:39.743+0000 7f6c2a7fc640 1 -- 172.21.15.78:0/2861156882 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c2c004030 con 0x7f6c34154f00 2023-11-28T19:59:39.753 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:39.743+0000 7f6c3beaa640 1 -- 172.21.15.78:0/2861156882 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6c341edaf0 con 0x7f6c34154f00 2023-11-28T19:59:39.753 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:39.743+0000 7f6c3beaa640 1 -- 172.21.15.78:0/2861156882 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6c341ecd30 con 0x7f6c34154f00 2023-11-28T19:59:39.754 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:39.747+0000 7f6c3beaa640 1 -- 172.21.15.78:0/2861156882 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6c341ed810 con 0x7f6c34154f00 2023-11-28T19:59:39.754 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:39.747+0000 7f6c2a7fc640 1 -- 172.21.15.78:0/2861156882 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f6c2c004190 con 0x7f6c34154f00 2023-11-28T19:59:39.754 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:39.747+0000 7f6c2a7fc640 1 --2- 172.21.15.78:0/2861156882 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f6c180664a0 0x7f6c18068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:39.754 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:39.747+0000 7f6c2a7fc640 1 -- 172.21.15.78:0/2861156882 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f6c2c0843c0 con 0x7f6c34154f00 2023-11-28T19:59:39.754 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:39.747+0000 7f6c39c46640 1 --2- 172.21.15.78:0/2861156882 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f6c180664a0 0x7f6c18068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:39.754 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:39.747+0000 7f6c39c46640 1 --2- 172.21.15.78:0/2861156882 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f6c180664a0 0x7f6c18068960 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f6c341517c0 tx=0x7f6c30009190 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:59:39.757 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:39.751+0000 7f6c2a7fc640 1 -- 172.21.15.78:0/2861156882 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f6c341ed810 con 0x7f6c34154f00 2023-11-28T19:59:39.906 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:39.899+0000 7f6c3beaa640 1 -- 172.21.15.78:0/2861156882 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f6c341ed810 con 0x7f6c34154f00 2023-11-28T19:59:39.907 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:39.899+0000 7f6c2a7fc640 1 -- 172.21.15.78:0/2861156882 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v25) v1 ==== 93+0+10 (secure 0 0 0) 0x7f6c341ed810 con 0x7f6c34154f00 2023-11-28T19:59:39.907 INFO:teuthology.orchestra.run.smithi078.stdout:pg_num: 1 2023-11-28T19:59:39.909 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:39.903+0000 7f6c3beaa640 1 -- 172.21.15.78:0/2861156882 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f6c180664a0 msgr2=0x7f6c18068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:39.909 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:39.903+0000 7f6c3beaa640 1 --2- 172.21.15.78:0/2861156882 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f6c180664a0 0x7f6c18068960 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f6c341517c0 tx=0x7f6c30009190 comp rx=0 tx=0).stop 2023-11-28T19:59:39.909 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:39.903+0000 7f6c3beaa640 1 -- 172.21.15.78:0/2861156882 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6c34154f00 msgr2=0x7f6c340c1440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:39.909 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:39.903+0000 7f6c3beaa640 1 --2- 172.21.15.78:0/2861156882 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6c34154f00 0x7f6c340c1440 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f6c2c009fa0 tx=0x7f6c2c00d560 comp rx=0 tx=0).stop 2023-11-28T19:59:39.910 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:39.903+0000 7f6c3beaa640 1 -- 172.21.15.78:0/2861156882 shutdown_connections 2023-11-28T19:59:39.910 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:39.903+0000 7f6c3beaa640 1 --2- 172.21.15.78:0/2861156882 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f6c180664a0 0x7f6c18068960 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:39.910 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:39.903+0000 7f6c3beaa640 1 --2- 172.21.15.78:0/2861156882 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6c340c6d80 0x7f6c340c0f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:39.910 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:39.903+0000 7f6c3beaa640 1 --2- 172.21.15.78:0/2861156882 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6c34154f00 0x7f6c340c1440 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:39.910 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:39.903+0000 7f6c3beaa640 1 --2- 172.21.15.78:0/2861156882 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6c340af4d0 0x7f6c341529c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:39.911 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:39.903+0000 7f6c3beaa640 1 -- 172.21.15.78:0/2861156882 >> 172.21.15.78:0/2861156882 conn(0x7f6c340aba00 msgr2=0x7f6c340abde0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T19:59:39.911 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:39.903+0000 7f6c3beaa640 1 -- 172.21.15.78:0/2861156882 shutdown_connections 2023-11-28T19:59:39.911 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:39.903+0000 7f6c3beaa640 1 -- 172.21.15.78:0/2861156882 wait complete. 2023-11-28T19:59:39.927 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-28T19:59:40.069 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:40.063+0000 7f5901c9c640 1 Processor -- start 2023-11-28T19:59:40.069 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:40.063+0000 7f5901c9c640 1 -- start start 2023-11-28T19:59:40.070 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:40.063+0000 7f5901c9c640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f58fc14b1e0 0x7f58fc0c1700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:40.071 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:40.063+0000 7f5901c9c640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f58fc1548c0 0x7f58fc154d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:40.071 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:40.063+0000 7f5901c9c640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f58fc0a4e20 con 0x7f58fc0c5300 2023-11-28T19:59:40.071 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:40.063+0000 7f5901c9c640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f58fc0a50e0 con 0x7f58fc14b1e0 2023-11-28T19:59:40.071 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:40.063+0000 7f5901c9c640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f58fc0c0f00 con 0x7f58fc1548c0 2023-11-28T19:59:40.072 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:40.063+0000 7f58fb7fe640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f58fc14b1e0 0x7f58fc0c1700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:40.072 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:40.063+0000 7f58faffd640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f58fc0c5300 0x7f58fc0a9c30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:60740/0 (socket says 172.21.15.78:60740) 2023-11-28T19:59:40.072 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:40.063+0000 7f58faffd640 1 -- 172.21.15.78:0/2893776030 learned_addr learned my addr 172.21.15.78:0/2893776030 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-11-28T19:59:40.073 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:40.067+0000 7f58fbfff640 1 --2- 172.21.15.78:0/2893776030 >> v2:172.21.15.179:3300/0 conn(0x7f58fc1548c0 0x7f58fc154d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:40.073 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:40.067+0000 7f58fb7fe640 1 -- 172.21.15.78:0/2893776030 >> v2:172.21.15.179:3300/0 conn(0x7f58fc1548c0 msgr2=0x7f58fc154d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T19:59:40.074 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:40.067+0000 7f58fb7fe640 1 --2- 172.21.15.78:0/2893776030 >> v2:172.21.15.179:3300/0 conn(0x7f58fc1548c0 0x7f58fc154d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:40.074 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:40.067+0000 7f58fb7fe640 1 -- 172.21.15.78:0/2893776030 >> v1:172.21.15.78:6789/0 conn(0x7f58fc0c5300 legacy=0x7f58fc0a9c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:40.074 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:40.067+0000 7f58fb7fe640 1 -- 172.21.15.78:0/2893776030 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58fc0c11e0 con 0x7f58fc14b1e0 2023-11-28T19:59:40.075 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:40.067+0000 7f58fb7fe640 1 --2- 172.21.15.78:0/2893776030 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f58fc14b1e0 0x7f58fc0c1700 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f58fc0c5850 tx=0x7f58ec01c460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5f01c45c5dff804a server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:59:40.075 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:40.067+0000 7f58fa7fc640 1 -- 172.21.15.78:0/2893776030 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58ec0ab600 con 0x7f58fc14b1e0 2023-11-28T19:59:40.076 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:40.067+0000 7f58fa7fc640 1 -- 172.21.15.78:0/2893776030 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f58ec0a7050 con 0x7f58fc14b1e0 2023-11-28T19:59:40.076 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:40.067+0000 7f58fa7fc640 1 -- 172.21.15.78:0/2893776030 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58ec0ab980 con 0x7f58fc14b1e0 2023-11-28T19:59:40.076 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:40.071+0000 7f5901c9c640 1 -- 172.21.15.78:0/2893776030 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f58fc14b1e0 msgr2=0x7f58fc0c1700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:40.076 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:40.071+0000 7f5901c9c640 1 --2- 172.21.15.78:0/2893776030 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f58fc14b1e0 0x7f58fc0c1700 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f58fc0c5850 tx=0x7f58ec01c460 comp rx=0 tx=0).stop 2023-11-28T19:59:40.076 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:40.071+0000 7f5901c9c640 1 -- 172.21.15.78:0/2893776030 shutdown_connections 2023-11-28T19:59:40.076 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:40.071+0000 7f5901c9c640 1 --2- 172.21.15.78:0/2893776030 >> v2:172.21.15.179:3300/0 conn(0x7f58fc1548c0 0x7f58fc154d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:40.077 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:40.071+0000 7f5901c9c640 1 --2- 172.21.15.78:0/2893776030 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f58fc14b1e0 0x7f58fc0c1700 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:40.077 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:40.071+0000 7f5901c9c640 1 -- 172.21.15.78:0/2893776030 >> 172.21.15.78:0/2893776030 conn(0x7f58fc0c59f0 msgr2=0x7f58fc0c5e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T19:59:40.077 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:40.071+0000 7f5901c9c640 1 -- 172.21.15.78:0/2893776030 shutdown_connections 2023-11-28T19:59:40.077 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:40.071+0000 7f5901c9c640 1 -- 172.21.15.78:0/2893776030 wait complete. 2023-11-28T19:59:40.080 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:40.071+0000 7f5901c9c640 1 Processor -- start 2023-11-28T19:59:40.080 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:40.071+0000 7f5901c9c640 1 -- start start 2023-11-28T19:59:40.080 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:40.071+0000 7f5901c9c640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f58fc0c5300 0x7f58fc153900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:40.080 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:40.071+0000 7f5901c9c640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f58fc14b1e0 0x7f58fc0aa970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:40.080 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:40.071+0000 7f5901c9c640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f58fc1548c0 0x7f58fc1ec9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:40.081 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:40.071+0000 7f5901c9c640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58fc0a6320 con 0x7f58fc1548c0 2023-11-28T19:59:40.081 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:40.071+0000 7f5901c9c640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58fc0a58b0 con 0x7f58fc14b1e0 2023-11-28T19:59:40.081 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:40.071+0000 7f5901c9c640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f58fc1f0c40 con 0x7f58fc0c5300 2023-11-28T19:59:40.081 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:40.071+0000 7f58fbfff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f58fc1548c0 0x7f58fc1ec9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:40.081 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:40.071+0000 7f58fbfff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f58fc1548c0 0x7f58fc1ec9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:37046/0 (socket says 172.21.15.78:37046) 2023-11-28T19:59:40.082 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:40.071+0000 7f58fbfff640 1 -- 172.21.15.78:0/995512352 learned_addr learned my addr 172.21.15.78:0/995512352 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T19:59:40.082 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:40.071+0000 7f58fb7fe640 1 --2- 172.21.15.78:0/995512352 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f58fc0c5300 0x7f58fc153900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:40.082 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:40.071+0000 7f58faffd640 1 --2- 172.21.15.78:0/995512352 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f58fc14b1e0 0x7f58fc0aa970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:40.082 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:40.071+0000 7f58fbfff640 1 -- 172.21.15.78:0/995512352 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f58fc0c5300 msgr2=0x7f58fc153900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:40.082 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:40.071+0000 7f58fbfff640 1 --2- 172.21.15.78:0/995512352 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f58fc0c5300 0x7f58fc153900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:40.082 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:40.071+0000 7f58fbfff640 1 -- 172.21.15.78:0/995512352 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f58fc14b1e0 msgr2=0x7f58fc0aa970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:40.083 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:40.071+0000 7f58fbfff640 1 --2- 172.21.15.78:0/995512352 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f58fc14b1e0 0x7f58fc0aa970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:40.083 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:40.071+0000 7f58fbfff640 1 -- 172.21.15.78:0/995512352 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58ec009420 con 0x7f58fc1548c0 2023-11-28T19:59:40.083 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:40.071+0000 7f58faffd640 1 --2- 172.21.15.78:0/995512352 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f58fc14b1e0 0x7f58fc0aa970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T19:59:40.083 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:40.075+0000 7f58fbfff640 1 --2- 172.21.15.78:0/995512352 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f58fc1548c0 0x7f58fc1ec9e0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f58f4007e60 tx=0x7f58f400e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:59:40.083 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:40.075+0000 7f58e3fff640 1 -- 172.21.15.78:0/995512352 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58f4014420 con 0x7f58fc1548c0 2023-11-28T19:59:40.083 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:40.075+0000 7f58e3fff640 1 -- 172.21.15.78:0/995512352 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f58f40145a0 con 0x7f58fc1548c0 2023-11-28T19:59:40.083 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:40.075+0000 7f5901c9c640 1 -- 172.21.15.78:0/995512352 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f58fc0a5540 con 0x7f58fc1548c0 2023-11-28T19:59:40.084 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:40.075+0000 7f58e3fff640 1 -- 172.21.15.78:0/995512352 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58f4014950 con 0x7f58fc1548c0 2023-11-28T19:59:40.084 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:40.075+0000 7f5901c9c640 1 -- 172.21.15.78:0/995512352 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f58fc13f370 con 0x7f58fc1548c0 2023-11-28T19:59:40.084 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:40.075+0000 7f5901c9c640 1 -- 172.21.15.78:0/995512352 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f58fc0a6ed0 con 0x7f58fc1548c0 2023-11-28T19:59:40.085 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:40.075+0000 7f58e3fff640 1 -- 172.21.15.78:0/995512352 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f58f4014ab0 con 0x7f58fc1548c0 2023-11-28T19:59:40.085 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:40.075+0000 7f58e3fff640 1 --2- 172.21.15.78:0/995512352 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f58e8066470 0x7f58e8068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:40.085 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:40.075+0000 7f58e3fff640 1 -- 172.21.15.78:0/995512352 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f58f4084a00 con 0x7f58fc1548c0 2023-11-28T19:59:40.085 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:40.075+0000 7f58fb7fe640 1 --2- 172.21.15.78:0/995512352 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f58e8066470 0x7f58e8068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:40.085 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:40.079+0000 7f58fb7fe640 1 --2- 172.21.15.78:0/995512352 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f58e8066470 0x7f58e8068930 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f58ec0ad000 tx=0x7f58ec008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:59:40.086 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:40.079+0000 7f58e3fff640 1 -- 172.21.15.78:0/995512352 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f58fc0a6ed0 con 0x7f58fc1548c0 2023-11-28T19:59:40.236 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:40.231+0000 7f5901c9c640 1 -- 172.21.15.78:0/995512352 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f58fc0a6ed0 con 0x7f58fc1548c0 2023-11-28T19:59:40.237 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:40.231+0000 7f58e3fff640 1 -- 172.21.15.78:0/995512352 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v25) v1 ==== 104+0+11 (secure 0 0 0) 0x7f58fc0a6ed0 con 0x7f58fc1548c0 2023-11-28T19:59:40.237 INFO:teuthology.orchestra.run.smithi078.stdout:pg_num: 32 2023-11-28T19:59:40.239 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:40.231+0000 7f5901c9c640 1 -- 172.21.15.78:0/995512352 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f58e8066470 msgr2=0x7f58e8068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:40.239 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:40.231+0000 7f5901c9c640 1 --2- 172.21.15.78:0/995512352 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f58e8066470 0x7f58e8068930 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f58ec0ad000 tx=0x7f58ec008040 comp rx=0 tx=0).stop 2023-11-28T19:59:40.239 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:40.231+0000 7f5901c9c640 1 -- 172.21.15.78:0/995512352 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f58fc1548c0 msgr2=0x7f58fc1ec9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:40.239 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:40.231+0000 7f5901c9c640 1 --2- 172.21.15.78:0/995512352 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f58fc1548c0 0x7f58fc1ec9e0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f58f4007e60 tx=0x7f58f400e4b0 comp rx=0 tx=0).stop 2023-11-28T19:59:40.240 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:40.231+0000 7f5901c9c640 1 -- 172.21.15.78:0/995512352 shutdown_connections 2023-11-28T19:59:40.240 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:40.231+0000 7f5901c9c640 1 --2- 172.21.15.78:0/995512352 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f58e8066470 0x7f58e8068930 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:40.240 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:40.231+0000 7f5901c9c640 1 --2- 172.21.15.78:0/995512352 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f58fc1548c0 0x7f58fc1ec9e0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:40.240 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:40.231+0000 7f5901c9c640 1 --2- 172.21.15.78:0/995512352 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f58fc14b1e0 0x7f58fc0aa970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:40.240 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:40.231+0000 7f5901c9c640 1 --2- 172.21.15.78:0/995512352 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f58fc0c5300 0x7f58fc153900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:40.241 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:40.231+0000 7f5901c9c640 1 -- 172.21.15.78:0/995512352 >> 172.21.15.78:0/995512352 conn(0x7f58fc0c59f0 msgr2=0x7f58fc142ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T19:59:40.241 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:40.235+0000 7f5901c9c640 1 -- 172.21.15.78:0/995512352 shutdown_connections 2023-11-28T19:59:40.241 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:40.235+0000 7f5901c9c640 1 -- 172.21.15.78:0/995512352 wait complete. 2023-11-28T19:59:40.258 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-28T19:59:40.398 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:40.391+0000 7efd74e3c640 1 Processor -- start 2023-11-28T19:59:40.398 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:40.391+0000 7efd74e3c640 1 -- start start 2023-11-28T19:59:40.400 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:40.395+0000 7efd74e3c640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7efd7014e8e0 0x7efd70154f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:40.400 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:40.395+0000 7efd74e3c640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7efd700c0250 0x7efd7006c670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:40.400 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:40.395+0000 7efd74e3c640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7efd7006cbb0 0x7efd7006d140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:40.400 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:40.395+0000 7efd74e3c640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efd700a9140 con 0x7efd7014e8e0 2023-11-28T19:59:40.400 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:40.395+0000 7efd74e3c640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efd700a53c0 con 0x7efd7006cbb0 2023-11-28T19:59:40.401 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:40.395+0000 7efd74e3c640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efd7014ecc0 con 0x7efd700c0250 2023-11-28T19:59:40.401 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:40.395+0000 7efd6f7fe640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7efd7014e8e0 0x7efd70154f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:40.401 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:40.395+0000 7efd6f7fe640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7efd7014e8e0 0x7efd70154f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:37052/0 (socket says 172.21.15.78:37052) 2023-11-28T19:59:40.401 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:40.395+0000 7efd6f7fe640 1 -- 172.21.15.78:0/1050723743 learned_addr learned my addr 172.21.15.78:0/1050723743 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T19:59:40.401 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:40.395+0000 7efd6f7fe640 1 -- 172.21.15.78:0/1050723743 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7efd700c0250 msgr2=0x7efd7006c670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T19:59:40.402 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:40.395+0000 7efd6f7fe640 1 --2- 172.21.15.78:0/1050723743 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7efd700c0250 0x7efd7006c670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:40.402 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:40.395+0000 7efd6f7fe640 1 -- 172.21.15.78:0/1050723743 >> v2:172.21.15.179:3300/0 conn(0x7efd7006cbb0 msgr2=0x7efd7006d140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T19:59:40.402 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:40.395+0000 7efd6ffff640 1 --2- 172.21.15.78:0/1050723743 >> v2:172.21.15.179:3300/0 conn(0x7efd7006cbb0 0x7efd7006d140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:40.402 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:40.395+0000 7efd6f7fe640 1 --2- 172.21.15.78:0/1050723743 >> v2:172.21.15.179:3300/0 conn(0x7efd7006cbb0 0x7efd7006d140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:40.402 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:40.395+0000 7efd6f7fe640 1 -- 172.21.15.78:0/1050723743 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd700a4e20 con 0x7efd7014e8e0 2023-11-28T19:59:40.403 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:40.395+0000 7efd6ffff640 1 --2- 172.21.15.78:0/1050723743 >> v2:172.21.15.179:3300/0 conn(0x7efd7006cbb0 0x7efd7006d140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T19:59:40.403 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:40.399+0000 7efd6f7fe640 1 --2- 172.21.15.78:0/1050723743 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7efd7014e8e0 0x7efd70154f80 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7efd700a8ad0 tx=0x7efd6001c3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6af5d88138dc4e3f server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:59:40.404 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:40.399+0000 7efd6effd640 1 -- 172.21.15.78:0/1050723743 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd600ab600 con 0x7efd7014e8e0 2023-11-28T19:59:40.404 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:40.399+0000 7efd6effd640 1 -- 172.21.15.78:0/1050723743 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd600a7050 con 0x7efd7014e8e0 2023-11-28T19:59:40.404 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:40.399+0000 7efd6effd640 1 -- 172.21.15.78:0/1050723743 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd600ab980 con 0x7efd7014e8e0 2023-11-28T19:59:40.405 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:40.399+0000 7efd74e3c640 1 -- 172.21.15.78:0/1050723743 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7efd7014e8e0 msgr2=0x7efd70154f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:40.405 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:40.399+0000 7efd74e3c640 1 --2- 172.21.15.78:0/1050723743 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7efd7014e8e0 0x7efd70154f80 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7efd700a8ad0 tx=0x7efd6001c3b0 comp rx=0 tx=0).stop 2023-11-28T19:59:40.406 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:40.399+0000 7efd74e3c640 1 -- 172.21.15.78:0/1050723743 shutdown_connections 2023-11-28T19:59:40.406 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:40.399+0000 7efd74e3c640 1 --2- 172.21.15.78:0/1050723743 >> v2:172.21.15.179:3300/0 conn(0x7efd7006cbb0 0x7efd7006d140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:40.406 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:40.399+0000 7efd74e3c640 1 --2- 172.21.15.78:0/1050723743 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7efd700c0250 0x7efd7006c670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:40.406 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:40.399+0000 7efd74e3c640 1 --2- 172.21.15.78:0/1050723743 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7efd7014e8e0 0x7efd70154f80 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:40.407 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:40.399+0000 7efd74e3c640 1 -- 172.21.15.78:0/1050723743 >> 172.21.15.78:0/1050723743 conn(0x7efd700c2350 msgr2=0x7efd700c2760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T19:59:40.407 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:40.399+0000 7efd74e3c640 1 -- 172.21.15.78:0/1050723743 shutdown_connections 2023-11-28T19:59:40.407 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:40.399+0000 7efd74e3c640 1 -- 172.21.15.78:0/1050723743 wait complete. 2023-11-28T19:59:40.408 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:40.399+0000 7efd74e3c640 1 Processor -- start 2023-11-28T19:59:40.409 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:40.399+0000 7efd74e3c640 1 -- start start 2023-11-28T19:59:40.409 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:40.403+0000 7efd74e3c640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7efd7006cbb0 0x7efd7014a9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:40.409 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:40.403+0000 7efd74e3c640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7efd700c0250 0x7efd70149400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:40.409 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:40.403+0000 7efd74e3c640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7efd7014e8e0 0x7efd701471d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:40.409 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:40.403+0000 7efd74e3c640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd700725e0 con 0x7efd7006cbb0 2023-11-28T19:59:40.409 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:40.403+0000 7efd74e3c640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd7014af20 con 0x7efd7014e8e0 2023-11-28T19:59:40.409 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:40.403+0000 7efd74e3c640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efd70072850 con 0x7efd700c0250 2023-11-28T19:59:40.409 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:40.403+0000 7efd6f7fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7efd7006cbb0 0x7efd7014a9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:40.409 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:40.403+0000 7efd6f7fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7efd7006cbb0 0x7efd7014a9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:37062/0 (socket says 172.21.15.78:37062) 2023-11-28T19:59:40.409 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:40.403+0000 7efd6f7fe640 1 -- 172.21.15.78:0/2969417458 learned_addr learned my addr 172.21.15.78:0/2969417458 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T19:59:40.409 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:40.403+0000 7efd6ffff640 1 --2- 172.21.15.78:0/2969417458 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7efd7014e8e0 0x7efd701471d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:40.410 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:40.403+0000 7efd67fff640 1 --2- 172.21.15.78:0/2969417458 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7efd700c0250 0x7efd70149400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:40.410 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:40.403+0000 7efd6f7fe640 1 -- 172.21.15.78:0/2969417458 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7efd700c0250 msgr2=0x7efd70149400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:40.410 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:40.403+0000 7efd6f7fe640 1 --2- 172.21.15.78:0/2969417458 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7efd700c0250 0x7efd70149400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:40.410 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:40.403+0000 7efd6f7fe640 1 -- 172.21.15.78:0/2969417458 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7efd7014e8e0 msgr2=0x7efd701471d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:40.410 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:40.403+0000 7efd6f7fe640 1 --2- 172.21.15.78:0/2969417458 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7efd7014e8e0 0x7efd701471d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:40.410 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:40.403+0000 7efd6f7fe640 1 -- 172.21.15.78:0/2969417458 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd600094d0 con 0x7efd7006cbb0 2023-11-28T19:59:40.410 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:40.403+0000 7efd6f7fe640 1 --2- 172.21.15.78:0/2969417458 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7efd7006cbb0 0x7efd7014a9e0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7efd600ae040 tx=0x7efd6001abf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:59:40.410 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:40.403+0000 7efd6cff9640 1 -- 172.21.15.78:0/2969417458 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd600b6620 con 0x7efd7006cbb0 2023-11-28T19:59:40.410 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:40.403+0000 7efd6cff9640 1 -- 172.21.15.78:0/2969417458 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd600b67a0 con 0x7efd7006cbb0 2023-11-28T19:59:40.410 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:40.403+0000 7efd6cff9640 1 -- 172.21.15.78:0/2969417458 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd600b6b50 con 0x7efd7006cbb0 2023-11-28T19:59:40.410 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:40.403+0000 7efd74e3c640 1 -- 172.21.15.78:0/2969417458 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efd70072b30 con 0x7efd7006cbb0 2023-11-28T19:59:40.411 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:40.403+0000 7efd74e3c640 1 -- 172.21.15.78:0/2969417458 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efd7014f9d0 con 0x7efd7006cbb0 2023-11-28T19:59:40.411 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:40.403+0000 7efd74e3c640 1 -- 172.21.15.78:0/2969417458 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efd700008e0 con 0x7efd7006cbb0 2023-11-28T19:59:40.412 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:40.403+0000 7efd6cff9640 1 -- 172.21.15.78:0/2969417458 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7efd600b2040 con 0x7efd7006cbb0 2023-11-28T19:59:40.412 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:40.407+0000 7efd6cff9640 1 --2- 172.21.15.78:0/2969417458 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7efd50066470 0x7efd50068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:40.412 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:40.407+0000 7efd6cff9640 1 -- 172.21.15.78:0/2969417458 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7efd6011e670 con 0x7efd7006cbb0 2023-11-28T19:59:40.412 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:40.407+0000 7efd67fff640 1 --2- 172.21.15.78:0/2969417458 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7efd50066470 0x7efd50068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:40.412 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:40.407+0000 7efd67fff640 1 --2- 172.21.15.78:0/2969417458 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7efd50066470 0x7efd50068930 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7efd58006fd0 tx=0x7efd58008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:59:40.414 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:40.411+0000 7efd6cff9640 1 -- 172.21.15.78:0/2969417458 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7efd600eb830 con 0x7efd7006cbb0 2023-11-28T19:59:40.570 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:40.563+0000 7efd74e3c640 1 -- 172.21.15.78:0/2969417458 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7efd70149940 con 0x7efd7006cbb0 2023-11-28T19:59:40.570 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:40.563+0000 7efd6cff9640 1 -- 172.21.15.78:0/2969417458 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v25) v1 ==== 100+0+11 (secure 0 0 0) 0x7efd600eee50 con 0x7efd7006cbb0 2023-11-28T19:59:40.571 INFO:teuthology.orchestra.run.smithi078.stdout:pg_num: 64 2023-11-28T19:59:40.572 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:40.567+0000 7efd74e3c640 1 -- 172.21.15.78:0/2969417458 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7efd50066470 msgr2=0x7efd50068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:40.573 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:40.567+0000 7efd74e3c640 1 --2- 172.21.15.78:0/2969417458 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7efd50066470 0x7efd50068930 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7efd58006fd0 tx=0x7efd58008040 comp rx=0 tx=0).stop 2023-11-28T19:59:40.573 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:40.567+0000 7efd74e3c640 1 -- 172.21.15.78:0/2969417458 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7efd7006cbb0 msgr2=0x7efd7014a9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:40.573 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:40.567+0000 7efd74e3c640 1 --2- 172.21.15.78:0/2969417458 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7efd7006cbb0 0x7efd7014a9e0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7efd600ae040 tx=0x7efd6001abf0 comp rx=0 tx=0).stop 2023-11-28T19:59:40.573 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:40.567+0000 7efd74e3c640 1 -- 172.21.15.78:0/2969417458 shutdown_connections 2023-11-28T19:59:40.573 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:40.567+0000 7efd74e3c640 1 --2- 172.21.15.78:0/2969417458 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7efd50066470 0x7efd50068930 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:40.573 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:40.567+0000 7efd74e3c640 1 --2- 172.21.15.78:0/2969417458 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7efd700c0250 0x7efd70149400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:40.573 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:40.567+0000 7efd74e3c640 1 --2- 172.21.15.78:0/2969417458 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7efd7014e8e0 0x7efd701471d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:40.573 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:40.567+0000 7efd74e3c640 1 --2- 172.21.15.78:0/2969417458 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7efd7006cbb0 0x7efd7014a9e0 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:40.573 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:40.567+0000 7efd74e3c640 1 -- 172.21.15.78:0/2969417458 >> 172.21.15.78:0/2969417458 conn(0x7efd700c2350 msgr2=0x7efd700c44d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T19:59:40.573 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:40.567+0000 7efd74e3c640 1 -- 172.21.15.78:0/2969417458 shutdown_connections 2023-11-28T19:59:40.573 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:40.567+0000 7efd74e3c640 1 -- 172.21.15.78:0/2969417458 wait complete. 2023-11-28T19:59:40.592 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-11-28T19:59:40.732 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:40.727+0000 7ff5cb491640 1 Processor -- start 2023-11-28T19:59:40.733 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:40.727+0000 7ff5cb491640 1 -- start start 2023-11-28T19:59:40.734 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:40.727+0000 7ff5cb491640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff5c414b1e0 0x7ff5c40c1700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:40.734 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:40.727+0000 7ff5cb491640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7ff5c40c5300 0x7ff5c40a9c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:40.735 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:40.727+0000 7ff5cb491640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff5c40a4e20 con 0x7ff5c4151280 2023-11-28T19:59:40.735 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:40.727+0000 7ff5cb491640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff5c41558d0 con 0x7ff5c40c5300 2023-11-28T19:59:40.735 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:40.727+0000 7ff5cb491640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5c40a50e0 con 0x7ff5c414b1e0 2023-11-28T19:59:40.735 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:40.727+0000 7ff5c8a2c640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7ff5c40c5300 0x7ff5c40a9c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:40.735 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:40.727+0000 7ff5c9a2e640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7ff5c4151280 0x7ff5c4151710 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:60750/0 (socket says 172.21.15.78:60750) 2023-11-28T19:59:40.735 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:40.727+0000 7ff5c9a2e640 1 -- 172.21.15.78:0/3558427700 learned_addr learned my addr 172.21.15.78:0/3558427700 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-11-28T19:59:40.735 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:40.727+0000 7ff5c8a2c640 1 -- 172.21.15.78:0/3558427700 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff5c414b1e0 msgr2=0x7ff5c40c1700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T19:59:40.735 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:40.727+0000 7ff5c922d640 1 --2- 172.21.15.78:0/3558427700 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff5c414b1e0 0x7ff5c40c1700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:40.735 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:40.727+0000 7ff5c8a2c640 1 --2- 172.21.15.78:0/3558427700 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff5c414b1e0 0x7ff5c40c1700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:40.735 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:40.727+0000 7ff5bbfff640 1 -- 172.21.15.78:0/3558427700 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 413106088 0 0) 0x7ff5c40a4e20 con 0x7ff5c4151280 2023-11-28T19:59:40.735 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:40.727+0000 7ff5c8a2c640 1 -- 172.21.15.78:0/3558427700 >> v1:172.21.15.78:6789/0 conn(0x7ff5c4151280 legacy=0x7ff5c4151710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:40.736 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:40.727+0000 7ff5c8a2c640 1 -- 172.21.15.78:0/3558427700 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5c40c0f00 con 0x7ff5c40c5300 2023-11-28T19:59:40.736 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:40.727+0000 7ff5c922d640 1 --2- 172.21.15.78:0/3558427700 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff5c414b1e0 0x7ff5c40c1700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T19:59:40.737 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:40.731+0000 7ff5c8a2c640 1 --2- 172.21.15.78:0/3558427700 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff5c40c5300 0x7ff5c40a9c30 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7ff5b40097c0 tx=0x7ff5b401c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a672a81dc92e68f3 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:59:40.737 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:40.731+0000 7ff5bbfff640 1 -- 172.21.15.78:0/3558427700 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5b40ad640 con 0x7ff5c40c5300 2023-11-28T19:59:40.737 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:40.731+0000 7ff5bbfff640 1 -- 172.21.15.78:0/3558427700 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff5b40ad7a0 con 0x7ff5c40c5300 2023-11-28T19:59:40.738 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:40.731+0000 7ff5bbfff640 1 -- 172.21.15.78:0/3558427700 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5b40adb30 con 0x7ff5c40c5300 2023-11-28T19:59:40.738 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:40.731+0000 7ff5cb491640 1 -- 172.21.15.78:0/3558427700 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff5c40c5300 msgr2=0x7ff5c40a9c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:40.739 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:40.731+0000 7ff5cb491640 1 --2- 172.21.15.78:0/3558427700 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff5c40c5300 0x7ff5c40a9c30 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7ff5b40097c0 tx=0x7ff5b401c480 comp rx=0 tx=0).stop 2023-11-28T19:59:40.739 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:40.731+0000 7ff5cb491640 1 -- 172.21.15.78:0/3558427700 shutdown_connections 2023-11-28T19:59:40.739 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:40.731+0000 7ff5cb491640 1 --2- 172.21.15.78:0/3558427700 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff5c40c5300 0x7ff5c40a9c30 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:40.739 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:40.731+0000 7ff5cb491640 1 --2- 172.21.15.78:0/3558427700 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff5c414b1e0 0x7ff5c40c1700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:40.739 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:40.731+0000 7ff5cb491640 1 -- 172.21.15.78:0/3558427700 >> 172.21.15.78:0/3558427700 conn(0x7ff5c40c59f0 msgr2=0x7ff5c40c5e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T19:59:40.739 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:40.731+0000 7ff5cb491640 1 -- 172.21.15.78:0/3558427700 shutdown_connections 2023-11-28T19:59:40.739 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:40.731+0000 7ff5cb491640 1 -- 172.21.15.78:0/3558427700 wait complete. 2023-11-28T19:59:40.740 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:40.735+0000 7ff5cb491640 1 Processor -- start 2023-11-28T19:59:40.740 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:40.735+0000 7ff5cb491640 1 -- start start 2023-11-28T19:59:40.741 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:40.735+0000 7ff5cb491640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff5c40c5300 0x7ff5c4071bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:40.741 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:40.735+0000 7ff5cb491640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff5c414b1e0 0x7ff5c4072100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:40.742 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:40.735+0000 7ff5cb491640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff5c4151280 0x7ff5c41487e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:40.742 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:40.735+0000 7ff5cb491640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5c4072640 con 0x7ff5c414b1e0 2023-11-28T19:59:40.742 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:40.735+0000 7ff5cb491640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5c4071730 con 0x7ff5c40c5300 2023-11-28T19:59:40.742 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:40.735+0000 7ff5cb491640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5c40c6240 con 0x7ff5c4151280 2023-11-28T19:59:40.742 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:40.735+0000 7ff5c8a2c640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff5c414b1e0 0x7ff5c4072100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:40.742 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:40.735+0000 7ff5c8a2c640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff5c414b1e0 0x7ff5c4072100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:37076/0 (socket says 172.21.15.78:37076) 2023-11-28T19:59:40.742 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:40.735+0000 7ff5c8a2c640 1 -- 172.21.15.78:0/3075521305 learned_addr learned my addr 172.21.15.78:0/3075521305 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T19:59:40.742 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:40.735+0000 7ff5c922d640 1 --2- 172.21.15.78:0/3075521305 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff5c40c5300 0x7ff5c4071bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:40.742 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:40.735+0000 7ff5c9a2e640 1 --2- 172.21.15.78:0/3075521305 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff5c4151280 0x7ff5c41487e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:40.742 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:40.735+0000 7ff5c8a2c640 1 -- 172.21.15.78:0/3075521305 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff5c4151280 msgr2=0x7ff5c41487e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:40.742 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:40.735+0000 7ff5c8a2c640 1 --2- 172.21.15.78:0/3075521305 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff5c4151280 0x7ff5c41487e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:40.743 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:40.735+0000 7ff5c8a2c640 1 -- 172.21.15.78:0/3075521305 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff5c40c5300 msgr2=0x7ff5c4071bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:40.743 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:40.735+0000 7ff5c8a2c640 1 --2- 172.21.15.78:0/3075521305 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff5c40c5300 0x7ff5c4071bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:40.743 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:40.735+0000 7ff5c8a2c640 1 -- 172.21.15.78:0/3075521305 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5b4009420 con 0x7ff5c414b1e0 2023-11-28T19:59:40.743 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:40.735+0000 7ff5c9a2e640 1 --2- 172.21.15.78:0/3075521305 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff5c4151280 0x7ff5c41487e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T19:59:40.744 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:40.735+0000 7ff5c8a2c640 1 --2- 172.21.15.78:0/3075521305 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff5c414b1e0 0x7ff5c4072100 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7ff5b401a0b0 tx=0x7ff5b4019220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:59:40.744 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:40.735+0000 7ff5b9ffb640 1 -- 172.21.15.78:0/3075521305 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5b40ad640 con 0x7ff5c414b1e0 2023-11-28T19:59:40.744 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:40.735+0000 7ff5b9ffb640 1 -- 172.21.15.78:0/3075521305 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff5b40a6040 con 0x7ff5c414b1e0 2023-11-28T19:59:40.744 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:40.735+0000 7ff5b9ffb640 1 -- 172.21.15.78:0/3075521305 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5b40b6a80 con 0x7ff5c414b1e0 2023-11-28T19:59:40.744 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:40.735+0000 7ff5cb491640 1 -- 172.21.15.78:0/3075521305 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff5c414eb60 con 0x7ff5c414b1e0 2023-11-28T19:59:40.744 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:40.735+0000 7ff5cb491640 1 -- 172.21.15.78:0/3075521305 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff5c4152b60 con 0x7ff5c414b1e0 2023-11-28T19:59:40.744 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:40.739+0000 7ff5cb491640 1 -- 172.21.15.78:0/3075521305 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff5c40718e0 con 0x7ff5c414b1e0 2023-11-28T19:59:40.745 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:40.739+0000 7ff5b9ffb640 1 -- 172.21.15.78:0/3075521305 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7ff5b40b4040 con 0x7ff5c414b1e0 2023-11-28T19:59:40.745 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:40.739+0000 7ff5b9ffb640 1 --2- 172.21.15.78:0/3075521305 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7ff5a8066470 0x7ff5a8068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:40.745 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:40.739+0000 7ff5b9ffb640 1 -- 172.21.15.78:0/3075521305 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7ff5b411e450 con 0x7ff5c414b1e0 2023-11-28T19:59:40.745 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:40.739+0000 7ff5c922d640 1 --2- 172.21.15.78:0/3075521305 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7ff5a8066470 0x7ff5a8068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:40.746 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:40.739+0000 7ff5c922d640 1 --2- 172.21.15.78:0/3075521305 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7ff5a8066470 0x7ff5a8068930 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7ff5c40c0b10 tx=0x7ff5c0008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:59:40.749 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:40.743+0000 7ff5b9ffb640 1 -- 172.21.15.78:0/3075521305 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7ff5c40718e0 con 0x7ff5c414b1e0 2023-11-28T19:59:40.899 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:40.891+0000 7ff5cb491640 1 -- 172.21.15.78:0/3075521305 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7ff5c40718e0 con 0x7ff5c414b1e0 2023-11-28T19:59:40.900 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:40.895+0000 7ff5b9ffb640 1 -- 172.21.15.78:0/3075521305 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v25) v1 ==== 103+0+11 (secure 0 0 0) 0x7ff5c40718e0 con 0x7ff5c414b1e0 2023-11-28T19:59:40.900 INFO:teuthology.orchestra.run.smithi078.stdout:pg_num: 32 2023-11-28T19:59:40.901 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:40.895+0000 7ff5cb491640 1 -- 172.21.15.78:0/3075521305 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7ff5a8066470 msgr2=0x7ff5a8068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:40.901 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:40.895+0000 7ff5cb491640 1 --2- 172.21.15.78:0/3075521305 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7ff5a8066470 0x7ff5a8068930 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7ff5c40c0b10 tx=0x7ff5c0008040 comp rx=0 tx=0).stop 2023-11-28T19:59:40.901 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:40.895+0000 7ff5cb491640 1 -- 172.21.15.78:0/3075521305 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff5c414b1e0 msgr2=0x7ff5c4072100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:40.902 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:40.895+0000 7ff5cb491640 1 --2- 172.21.15.78:0/3075521305 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff5c414b1e0 0x7ff5c4072100 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7ff5b401a0b0 tx=0x7ff5b4019220 comp rx=0 tx=0).stop 2023-11-28T19:59:40.902 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:40.895+0000 7ff5cb491640 1 -- 172.21.15.78:0/3075521305 shutdown_connections 2023-11-28T19:59:40.902 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:40.895+0000 7ff5cb491640 1 --2- 172.21.15.78:0/3075521305 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7ff5a8066470 0x7ff5a8068930 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:40.902 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:40.895+0000 7ff5cb491640 1 --2- 172.21.15.78:0/3075521305 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff5c4151280 0x7ff5c41487e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:40.902 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:40.895+0000 7ff5cb491640 1 --2- 172.21.15.78:0/3075521305 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff5c414b1e0 0x7ff5c4072100 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:40.902 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:40.895+0000 7ff5cb491640 1 --2- 172.21.15.78:0/3075521305 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff5c40c5300 0x7ff5c4071bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:40.902 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:40.895+0000 7ff5cb491640 1 -- 172.21.15.78:0/3075521305 >> 172.21.15.78:0/3075521305 conn(0x7ff5c40c59f0 msgr2=0x7ff5c4150a50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T19:59:40.902 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:40.895+0000 7ff5cb491640 1 -- 172.21.15.78:0/3075521305 shutdown_connections 2023-11-28T19:59:40.902 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:40.895+0000 7ff5cb491640 1 -- 172.21.15.78:0/3075521305 wait complete. 2023-11-28T19:59:40.920 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-28T19:59:41.061 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:41.055+0000 7fcd35a6b640 1 Processor -- start 2023-11-28T19:59:41.061 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:41.055+0000 7fcd35a6b640 1 -- start start 2023-11-28T19:59:41.062 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:41.055+0000 7fcd35a6b640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fcd300af4c0 0x7fcd30154f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:41.063 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:41.055+0000 7fcd35a6b640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcd3006c100 0x7fcd300c6c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:41.063 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:41.055+0000 7fcd35a6b640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcd300c4890 con 0x7fcd300c67d0 2023-11-28T19:59:41.063 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:41.055+0000 7fcd35a6b640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcd30155460 con 0x7fcd300af4c0 2023-11-28T19:59:41.064 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:41.055+0000 7fcd35a6b640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd300af8a0 con 0x7fcd3006c100 2023-11-28T19:59:41.064 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:41.055+0000 7fcd2f7fe640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fcd300af4c0 0x7fcd30154f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:41.064 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:41.055+0000 7fcd2ffff640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcd3006c100 0x7fcd300c6c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:41.064 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:41.055+0000 7fcd27fff640 1 --1- >> v1:172.21.15.179:6789/0 conn(0x7fcd300c67d0 0x7fcd3006b9f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.179:6789/0 says I am v1:172.21.15.78:52196/0 (socket says 172.21.15.78:52196) 2023-11-28T19:59:41.065 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:41.055+0000 7fcd27fff640 1 -- 172.21.15.78:0/1719787459 learned_addr learned my addr 172.21.15.78:0/1719787459 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-11-28T19:59:41.065 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:41.059+0000 7fcd2ffff640 1 -- 172.21.15.78:0/1719787459 >> v2:172.21.15.179:3300/0 conn(0x7fcd300af4c0 msgr2=0x7fcd30154f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T19:59:41.066 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:41.059+0000 7fcd2ffff640 1 --2- 172.21.15.78:0/1719787459 >> v2:172.21.15.179:3300/0 conn(0x7fcd300af4c0 0x7fcd30154f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:41.066 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:41.059+0000 7fcd2ffff640 1 -- 172.21.15.78:0/1719787459 >> v1:172.21.15.179:6789/0 conn(0x7fcd300c67d0 legacy=0x7fcd3006b9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:41.066 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:41.059+0000 7fcd2ffff640 1 -- 172.21.15.78:0/1719787459 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd300c4b30 con 0x7fcd3006c100 2023-11-28T19:59:41.067 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:41.059+0000 7fcd2ffff640 1 --2- 172.21.15.78:0/1719787459 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcd3006c100 0x7fcd300c6c80 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fcd28009d90 tx=0x7fcd2801c890 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d5c375724f9cf65b server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:59:41.068 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:41.059+0000 7fcd2effd640 1 -- 172.21.15.78:0/1719787459 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd280a5950 con 0x7fcd3006c100 2023-11-28T19:59:41.068 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:41.059+0000 7fcd2effd640 1 -- 172.21.15.78:0/1719787459 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd280a5ab0 con 0x7fcd3006c100 2023-11-28T19:59:41.068 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:41.059+0000 7fcd2effd640 1 -- 172.21.15.78:0/1719787459 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd280a5e40 con 0x7fcd3006c100 2023-11-28T19:59:41.069 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:41.063+0000 7fcd35a6b640 1 -- 172.21.15.78:0/1719787459 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcd3006c100 msgr2=0x7fcd300c6c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:41.069 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:41.063+0000 7fcd35a6b640 1 --2- 172.21.15.78:0/1719787459 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcd3006c100 0x7fcd300c6c80 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fcd28009d90 tx=0x7fcd2801c890 comp rx=0 tx=0).stop 2023-11-28T19:59:41.069 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:41.063+0000 7fcd35a6b640 1 -- 172.21.15.78:0/1719787459 shutdown_connections 2023-11-28T19:59:41.069 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:41.063+0000 7fcd35a6b640 1 --2- 172.21.15.78:0/1719787459 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcd3006c100 0x7fcd300c6c80 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:41.069 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:41.063+0000 7fcd35a6b640 1 --2- 172.21.15.78:0/1719787459 >> v2:172.21.15.179:3300/0 conn(0x7fcd300af4c0 0x7fcd30154f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:41.069 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:41.063+0000 7fcd35a6b640 1 -- 172.21.15.78:0/1719787459 >> 172.21.15.78:0/1719787459 conn(0x7fcd300ab9d0 msgr2=0x7fcd300abde0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T19:59:41.069 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:41.063+0000 7fcd35a6b640 1 -- 172.21.15.78:0/1719787459 shutdown_connections 2023-11-28T19:59:41.069 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:41.063+0000 7fcd35a6b640 1 -- 172.21.15.78:0/1719787459 wait complete. 2023-11-28T19:59:41.072 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:41.063+0000 7fcd35a6b640 1 Processor -- start 2023-11-28T19:59:41.072 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:41.063+0000 7fcd35a6b640 1 -- start start 2023-11-28T19:59:41.072 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:41.063+0000 7fcd35a6b640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcd3006c100 0x7fcd30153f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:41.072 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:41.063+0000 7fcd35a6b640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcd300af4c0 0x7fcd300acac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:41.072 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:41.063+0000 7fcd35a6b640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcd300c67d0 0x7fcd300ad000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:41.073 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:41.063+0000 7fcd35a6b640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd30154c00 con 0x7fcd300af4c0 2023-11-28T19:59:41.073 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:41.063+0000 7fcd35a6b640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd301ed3e0 con 0x7fcd3006c100 2023-11-28T19:59:41.073 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:41.063+0000 7fcd35a6b640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd3015e170 con 0x7fcd300c67d0 2023-11-28T19:59:41.073 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:41.063+0000 7fcd27fff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcd300af4c0 0x7fcd300acac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:41.073 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:41.063+0000 7fcd27fff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcd300af4c0 0x7fcd300acac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:37078/0 (socket says 172.21.15.78:37078) 2023-11-28T19:59:41.073 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:41.063+0000 7fcd27fff640 1 -- 172.21.15.78:0/1568935799 learned_addr learned my addr 172.21.15.78:0/1568935799 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T19:59:41.073 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:41.063+0000 7fcd2ffff640 1 --2- 172.21.15.78:0/1568935799 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcd300c67d0 0x7fcd300ad000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:41.073 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:41.063+0000 7fcd2f7fe640 1 --2- 172.21.15.78:0/1568935799 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcd3006c100 0x7fcd30153f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:41.073 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:41.063+0000 7fcd27fff640 1 -- 172.21.15.78:0/1568935799 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcd300c67d0 msgr2=0x7fcd300ad000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:41.074 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:41.063+0000 7fcd27fff640 1 --2- 172.21.15.78:0/1568935799 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcd300c67d0 0x7fcd300ad000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:41.074 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:41.063+0000 7fcd27fff640 1 -- 172.21.15.78:0/1568935799 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcd3006c100 msgr2=0x7fcd30153f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:41.075 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:41.063+0000 7fcd27fff640 1 --2- 172.21.15.78:0/1568935799 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcd3006c100 0x7fcd30153f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:41.075 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:41.063+0000 7fcd27fff640 1 -- 172.21.15.78:0/1568935799 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd28009a70 con 0x7fcd300af4c0 2023-11-28T19:59:41.075 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:41.063+0000 7fcd2f7fe640 1 --2- 172.21.15.78:0/1568935799 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcd3006c100 0x7fcd30153f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T19:59:41.075 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:41.067+0000 7fcd27fff640 1 --2- 172.21.15.78:0/1568935799 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcd300af4c0 0x7fcd300acac0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fcd1800c530 tx=0x7fcd1800c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:59:41.075 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:41.067+0000 7fcd2cff9640 1 -- 172.21.15.78:0/1568935799 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd18005cf0 con 0x7fcd300af4c0 2023-11-28T19:59:41.075 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:41.067+0000 7fcd2cff9640 1 -- 172.21.15.78:0/1568935799 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd18005e50 con 0x7fcd300af4c0 2023-11-28T19:59:41.075 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:41.067+0000 7fcd35a6b640 1 -- 172.21.15.78:0/1568935799 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcd3015e450 con 0x7fcd300af4c0 2023-11-28T19:59:41.075 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:41.067+0000 7fcd2cff9640 1 -- 172.21.15.78:0/1568935799 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd18007270 con 0x7fcd300af4c0 2023-11-28T19:59:41.075 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:41.067+0000 7fcd35a6b640 1 -- 172.21.15.78:0/1568935799 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcd301544a0 con 0x7fcd300af4c0 2023-11-28T19:59:41.075 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:41.067+0000 7fcd35a6b640 1 -- 172.21.15.78:0/1568935799 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcd30154750 con 0x7fcd300af4c0 2023-11-28T19:59:41.076 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:41.067+0000 7fcd2cff9640 1 -- 172.21.15.78:0/1568935799 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fcd180073d0 con 0x7fcd300af4c0 2023-11-28T19:59:41.077 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:41.067+0000 7fcd2cff9640 1 --2- 172.21.15.78:0/1568935799 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fcd10066470 0x7fcd10068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:41.078 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:41.067+0000 7fcd2cff9640 1 -- 172.21.15.78:0/1568935799 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fcd180835e0 con 0x7fcd300af4c0 2023-11-28T19:59:41.078 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:41.067+0000 7fcd2f7fe640 1 --2- 172.21.15.78:0/1568935799 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fcd10066470 0x7fcd10068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:41.078 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:41.071+0000 7fcd2f7fe640 1 --2- 172.21.15.78:0/1568935799 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fcd10066470 0x7fcd10068930 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fcd30151790 tx=0x7fcd20008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:59:41.078 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:41.071+0000 7fcd2cff9640 1 -- 172.21.15.78:0/1568935799 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fcd18050810 con 0x7fcd300af4c0 2023-11-28T19:59:41.227 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:41.219+0000 7fcd35a6b640 1 -- 172.21.15.78:0/1568935799 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fcd30067630 con 0x7fcd300af4c0 2023-11-28T19:59:41.228 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:41.223+0000 7fcd2cff9640 1 -- 172.21.15.78:0/1568935799 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+18322 (secure 0 0 0) 0x7fcd18053e30 con 0x7fcd300af4c0 2023-11-28T19:59:41.228 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-11-28T19:59:41.228 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":25,"fsid":"dd9780e8-3bda-44fa-a9f0-fa07d19d901d","created":"2023-11-28T19:58:40.969556+0000","modified":"2023-11-28T19:59:10.474525+0000","last_up_change":"2023-11-28T19:58:52.596716+0000","last_in_change":"2023-11-28T19:58:43.609275+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-28T19:58:54.011229+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-28T19:59:03.945559+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-28T19:59:04.481478+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-11-28T19:59:08.109152+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"e84245ac-b5da-429e-af18-39acaa2b33e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6800","nonce":3358701235},{"type":"v1","addr":"172.21.15.78:6801","nonce":3358701235}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6802","nonce":3358701235},{"type":"v1","addr":"172.21.15.78:6803","nonce":3358701235}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6806","nonce":3358701235},{"type":"v1","addr":"172.21.15.78:6807","nonce":3358701235}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6804","nonce":3358701235},{"type":"v1","addr":"172.21.15.78:6805","nonce":3358701235}]},"public_addr":"172.21.15.78:6801/3358701235","cluster_addr":"172.21.15.78:6803/3358701235","heartbeat_back_addr":"172.21.15.78:6807/3358701235","heartbeat_front_addr":"172.21.15.78:6805/3358701235","state":["exists","up"]},{"osd":1,"uuid":"e634831d-c4e2-48d9-870c-9556ae162981","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6808","nonce":3211476654},{"type":"v1","addr":"172.21.15.78:6809","nonce":3211476654}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6810","nonce":3211476654},{"type":"v1","addr":"172.21.15.78:6811","nonce":3211476654}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6814","nonce":3211476654},{"type":"v1","addr":"172.21.15.78:6815","nonce":3211476654}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6812","nonce":3211476654},{"type":"v1","addr":"172.21.15.78:6813","nonce":3211476654}]},"public_addr":"172.21.15.78:6809/3211476654","cluster_addr":"172.21.15.78:6811/3211476654","heartbeat_back_addr":"172.21.15.78:6815/3211476654","heartbeat_front_addr":"172.21.15.78:6813/3211476654","state":["exists","up"]},{"osd":2,"uuid":"274c8395-6534-41f0-b8fb-a00af8985aa8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6816","nonce":2532904479},{"type":"v1","addr":"172.21.15.78:6817","nonce":2532904479}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6818","nonce":2532904479},{"type":"v1","addr":"172.21.15.78:6819","nonce":2532904479}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6822","nonce":2532904479},{"type":"v1","addr":"172.21.15.78:6823","nonce":2532904479}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6820","nonce":2532904479},{"type":"v1","addr":"172.21.15.78:6821","nonce":2532904479}]},"public_addr":"172.21.15.78:6817/2532904479","cluster_addr":"172.21.15.78:6819/2532904479","heartbeat_back_addr":"172.21.15.78:6823/2532904479","heartbeat_front_addr":"172.21.15.78:6821/2532904479","state":["exists","up"]},{"osd":3,"uuid":"77acc9af-7d4d-4b18-8cf5-d62f5971b7c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6824","nonce":3442991267},{"type":"v1","addr":"172.21.15.78:6825","nonce":3442991267}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6826","nonce":3442991267},{"type":"v1","addr":"172.21.15.78:6827","nonce":3442991267}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6830","nonce":3442991267},{"type":"v1","addr":"172.21.15.78:6831","nonce":3442991267}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6828","nonce":3442991267},{"type":"v1","addr":"172.21.15.78:6829","nonce":3442991267}]},"public_addr":"172.21.15.78:6825/3442991267","cluster_addr":"172.21.15.78:6827/3442991267","heartbeat_back_addr":"172.21.15.78:6831/3442991267","heartbeat_front_addr":"172.21.15.78:6829/3442991267","state":["exists","up"]},{"osd":4,"uuid":"5c62bc66-6b34-4b7f-a66b-9a743969138c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":802983577},{"type":"v1","addr":"172.21.15.179:6809","nonce":802983577}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":802983577},{"type":"v1","addr":"172.21.15.179:6811","nonce":802983577}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":802983577},{"type":"v1","addr":"172.21.15.179:6815","nonce":802983577}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":802983577},{"type":"v1","addr":"172.21.15.179:6813","nonce":802983577}]},"public_addr":"172.21.15.179:6809/802983577","cluster_addr":"172.21.15.179:6811/802983577","heartbeat_back_addr":"172.21.15.179:6815/802983577","heartbeat_front_addr":"172.21.15.179:6813/802983577","state":["exists","up"]},{"osd":5,"uuid":"67db6d36-f684-4079-b0cd-82b4dd61461f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":518192887},{"type":"v1","addr":"172.21.15.179:6818","nonce":518192887}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":518192887},{"type":"v1","addr":"172.21.15.179:6822","nonce":518192887}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":518192887},{"type":"v1","addr":"172.21.15.179:6829","nonce":518192887}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6824","nonce":518192887},{"type":"v1","addr":"172.21.15.179:6826","nonce":518192887}]},"public_addr":"172.21.15.179:6818/518192887","cluster_addr":"172.21.15.179:6822/518192887","heartbeat_back_addr":"172.21.15.179:6829/518192887","heartbeat_front_addr":"172.21.15.179:6826/518192887","state":["exists","up"]},{"osd":6,"uuid":"12e670af-5a16-4c81-9f97-defa66cab967","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":815435378},{"type":"v1","addr":"172.21.15.179:6801","nonce":815435378}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":815435378},{"type":"v1","addr":"172.21.15.179:6803","nonce":815435378}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":815435378},{"type":"v1","addr":"172.21.15.179:6807","nonce":815435378}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":815435378},{"type":"v1","addr":"172.21.15.179:6805","nonce":815435378}]},"public_addr":"172.21.15.179:6801/815435378","cluster_addr":"172.21.15.179:6803/815435378","heartbeat_back_addr":"172.21.15.179:6807/815435378","heartbeat_front_addr":"172.21.15.179:6805/815435378","state":["exists","up"]},{"osd":7,"uuid":"fe630650-2eb3-49ad-8676-c341e6332eb1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6817","nonce":2848432339},{"type":"v1","addr":"172.21.15.179:6819","nonce":2848432339}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6821","nonce":2848432339},{"type":"v1","addr":"172.21.15.179:6823","nonce":2848432339}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":2848432339},{"type":"v1","addr":"172.21.15.179:6831","nonce":2848432339}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6825","nonce":2848432339},{"type":"v1","addr":"172.21.15.179:6827","nonce":2848432339}]},"public_addr":"172.21.15.179:6819/2848432339","cluster_addr":"172.21.15.179:6823/2848432339","heartbeat_back_addr":"172.21.15.179:6831/2848432339","heartbeat_front_addr":"172.21.15.179:6827/2848432339","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:58:49.255433+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:58:49.412880+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:58:49.559295+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:58:49.245237+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:58:49.184557+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:58:49.329851+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:58:49.366012+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:58:49.349604+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-28T19:59:41.230 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:41.223+0000 7fcd35a6b640 1 -- 172.21.15.78:0/1568935799 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fcd10066470 msgr2=0x7fcd10068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:41.230 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:41.223+0000 7fcd35a6b640 1 --2- 172.21.15.78:0/1568935799 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fcd10066470 0x7fcd10068930 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fcd30151790 tx=0x7fcd20008040 comp rx=0 tx=0).stop 2023-11-28T19:59:41.230 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:41.223+0000 7fcd35a6b640 1 -- 172.21.15.78:0/1568935799 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcd300af4c0 msgr2=0x7fcd300acac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:41.230 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:41.223+0000 7fcd35a6b640 1 --2- 172.21.15.78:0/1568935799 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcd300af4c0 0x7fcd300acac0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fcd1800c530 tx=0x7fcd1800c9f0 comp rx=0 tx=0).stop 2023-11-28T19:59:41.230 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:41.223+0000 7fcd35a6b640 1 -- 172.21.15.78:0/1568935799 shutdown_connections 2023-11-28T19:59:41.230 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:41.223+0000 7fcd35a6b640 1 --2- 172.21.15.78:0/1568935799 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fcd10066470 0x7fcd10068930 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:41.231 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:41.223+0000 7fcd35a6b640 1 --2- 172.21.15.78:0/1568935799 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcd300c67d0 0x7fcd300ad000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:41.231 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:41.223+0000 7fcd35a6b640 1 --2- 172.21.15.78:0/1568935799 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcd300af4c0 0x7fcd300acac0 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:41.231 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:41.223+0000 7fcd35a6b640 1 --2- 172.21.15.78:0/1568935799 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcd3006c100 0x7fcd30153f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:41.231 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:41.223+0000 7fcd35a6b640 1 -- 172.21.15.78:0/1568935799 >> 172.21.15.78:0/1568935799 conn(0x7fcd300ab9d0 msgr2=0x7fcd300c8420 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T19:59:41.231 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:41.223+0000 7fcd35a6b640 1 -- 172.21.15.78:0/1568935799 shutdown_connections 2023-11-28T19:59:41.231 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:41.223+0000 7fcd35a6b640 1 -- 172.21.15.78:0/1568935799 wait complete. 2023-11-28T19:59:41.250 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-28T19:58:54.011229+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-28T19:59:03.945559+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-11-28T19:59:04.481478+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-11-28T19:59:08.109152+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-11-28T19:59:41.250 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-28T19:59:41.390 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:41.383+0000 7f11cc7b8640 1 Processor -- start 2023-11-28T19:59:41.390 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:41.383+0000 7f11cc7b8640 1 -- start start 2023-11-28T19:59:41.391 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:41.387+0000 7f11cc7b8640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f11c40c5300 0x7f11c40a9c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:41.391 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:41.387+0000 7f11cc7b8640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f11c41548c0 0x7f11c4154d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:41.391 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:41.387+0000 7f11cc7b8640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f11c40a4e20 con 0x7f11c414b1e0 2023-11-28T19:59:41.391 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:41.387+0000 7f11cc7b8640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f11c40a50e0 con 0x7f11c40c5300 2023-11-28T19:59:41.391 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:41.387+0000 7f11cc7b8640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f11c40c0f00 con 0x7f11c41548c0 2023-11-28T19:59:41.392 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:41.387+0000 7f11c9d53640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f11c40c5300 0x7f11c40a9c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:41.392 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:41.387+0000 7f11cad55640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f11c41548c0 0x7f11c4154d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:41.392 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:41.387+0000 7f11c9d53640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f11c40c5300 0x7f11c40a9c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.78:34580/0 (socket says 172.21.15.78:34580) 2023-11-28T19:59:41.392 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:41.387+0000 7f11c9d53640 1 -- 172.21.15.78:0/1695996142 learned_addr learned my addr 172.21.15.78:0/1695996142 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T19:59:41.392 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:41.387+0000 7f11ca554640 1 --1- 172.21.15.78:0/1695996142 >> v1:172.21.15.179:6789/0 conn(0x7f11c414b1e0 0x7f11c40c1700 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.179:6789/0 says I am v1:172.21.15.78:52202/0 (socket says 172.21.15.78:52202) 2023-11-28T19:59:41.393 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:41.387+0000 7f11c9d53640 1 -- 172.21.15.78:0/1695996142 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f11c41548c0 msgr2=0x7f11c4154d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T19:59:41.393 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:41.387+0000 7f11c9d53640 1 --2- 172.21.15.78:0/1695996142 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f11c41548c0 0x7f11c4154d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:41.393 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:41.387+0000 7f11c9d53640 1 -- 172.21.15.78:0/1695996142 >> v1:172.21.15.179:6789/0 conn(0x7f11c414b1e0 legacy=0x7f11c40c1700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:41.393 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:41.387+0000 7f11c9d53640 1 -- 172.21.15.78:0/1695996142 --> v2:172.21.15.179:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11c40c11e0 con 0x7f11c40c5300 2023-11-28T19:59:41.393 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:41.387+0000 7f11cad55640 1 --2- 172.21.15.78:0/1695996142 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f11c41548c0 0x7f11c4154d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T19:59:41.395 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:41.391+0000 7f11c9d53640 1 --2- 172.21.15.78:0/1695996142 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f11c40c5300 0x7f11c40a9c30 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f11b4009870 tx=0x7f11b401c540 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fcf776c2c151f2fc server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:59:41.396 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:41.391+0000 7f11c9552640 1 -- 172.21.15.78:0/1695996142 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11b40ab650 con 0x7f11c40c5300 2023-11-28T19:59:41.397 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:41.391+0000 7f11c9552640 1 -- 172.21.15.78:0/1695996142 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f11b40ab7b0 con 0x7f11c40c5300 2023-11-28T19:59:41.397 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:41.391+0000 7f11c9552640 1 -- 172.21.15.78:0/1695996142 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11b40abb40 con 0x7f11c40c5300 2023-11-28T19:59:41.397 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:41.391+0000 7f11cc7b8640 1 -- 172.21.15.78:0/1695996142 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f11c40c5300 msgr2=0x7f11c40a9c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:41.397 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:41.391+0000 7f11cc7b8640 1 --2- 172.21.15.78:0/1695996142 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f11c40c5300 0x7f11c40a9c30 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f11b4009870 tx=0x7f11b401c540 comp rx=0 tx=0).stop 2023-11-28T19:59:41.397 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:41.391+0000 7f11cc7b8640 1 -- 172.21.15.78:0/1695996142 shutdown_connections 2023-11-28T19:59:41.397 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:41.391+0000 7f11cc7b8640 1 --2- 172.21.15.78:0/1695996142 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f11c41548c0 0x7f11c4154d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:41.397 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:41.391+0000 7f11cc7b8640 1 --2- 172.21.15.78:0/1695996142 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f11c40c5300 0x7f11c40a9c30 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:41.397 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:41.391+0000 7f11cc7b8640 1 -- 172.21.15.78:0/1695996142 >> 172.21.15.78:0/1695996142 conn(0x7f11c40c59f0 msgr2=0x7f11c40c5e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T19:59:41.397 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:41.391+0000 7f11cc7b8640 1 -- 172.21.15.78:0/1695996142 shutdown_connections 2023-11-28T19:59:41.397 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:41.391+0000 7f11cc7b8640 1 -- 172.21.15.78:0/1695996142 wait complete. 2023-11-28T19:59:41.398 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:41.391+0000 7f11cc7b8640 1 Processor -- start 2023-11-28T19:59:41.398 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:41.391+0000 7f11cc7b8640 1 -- start start 2023-11-28T19:59:41.400 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:41.395+0000 7f11cc7b8640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f11c40c5300 0x7f11c406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:41.401 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:41.395+0000 7f11cc7b8640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f11c414b1e0 0x7f11c4142f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:41.401 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:41.395+0000 7f11cc7b8640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f11c41548c0 0x7f11c413fca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:41.401 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:41.395+0000 7f11cc7b8640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11c4153dd0 con 0x7f11c41548c0 2023-11-28T19:59:41.401 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:41.395+0000 7f11cc7b8640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11c41f0f80 con 0x7f11c40c5300 2023-11-28T19:59:41.401 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:41.395+0000 7f11cc7b8640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f11c41f03b0 con 0x7f11c414b1e0 2023-11-28T19:59:41.401 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:41.395+0000 7f11cad55640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f11c41548c0 0x7f11c413fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:41.401 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:41.395+0000 7f11cad55640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f11c41548c0 0x7f11c413fca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:37092/0 (socket says 172.21.15.78:37092) 2023-11-28T19:59:41.401 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:41.395+0000 7f11cad55640 1 -- 172.21.15.78:0/3782556457 learned_addr learned my addr 172.21.15.78:0/3782556457 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T19:59:41.401 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:41.395+0000 7f11c9d53640 1 --2- 172.21.15.78:0/3782556457 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f11c414b1e0 0x7f11c4142f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:41.401 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:41.395+0000 7f11ca554640 1 --2- 172.21.15.78:0/3782556457 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f11c40c5300 0x7f11c406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:41.402 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:41.395+0000 7f11cad55640 1 -- 172.21.15.78:0/3782556457 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f11c414b1e0 msgr2=0x7f11c4142f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:41.402 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:41.395+0000 7f11cad55640 1 --2- 172.21.15.78:0/3782556457 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f11c414b1e0 0x7f11c4142f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:41.402 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:41.395+0000 7f11cad55640 1 -- 172.21.15.78:0/3782556457 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f11c40c5300 msgr2=0x7f11c406d300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:41.402 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:41.395+0000 7f11cad55640 1 --2- 172.21.15.78:0/3782556457 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f11c40c5300 0x7f11c406d300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:41.402 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:41.395+0000 7f11cad55640 1 -- 172.21.15.78:0/3782556457 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11bc009a70 con 0x7f11c41548c0 2023-11-28T19:59:41.402 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:41.395+0000 7f11cad55640 1 --2- 172.21.15.78:0/3782556457 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f11c41548c0 0x7f11c413fca0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f11bc00efc0 tx=0x7f11bc00c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:59:41.402 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:41.395+0000 7f11baffd640 1 -- 172.21.15.78:0/3782556457 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11bc009cd0 con 0x7f11c41548c0 2023-11-28T19:59:41.402 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:41.395+0000 7f11baffd640 1 -- 172.21.15.78:0/3782556457 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f11bc00f040 con 0x7f11c41548c0 2023-11-28T19:59:41.402 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:41.395+0000 7f11cc7b8640 1 -- 172.21.15.78:0/3782556457 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f11b40094d0 con 0x7f11c41548c0 2023-11-28T19:59:41.402 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:41.395+0000 7f11baffd640 1 -- 172.21.15.78:0/3782556457 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11bc0039a0 con 0x7f11c41548c0 2023-11-28T19:59:41.402 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:41.395+0000 7f11cc7b8640 1 -- 172.21.15.78:0/3782556457 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f11c41f0930 con 0x7f11c41548c0 2023-11-28T19:59:41.403 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:41.395+0000 7f11cc7b8640 1 -- 172.21.15.78:0/3782556457 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f11c41f10f0 con 0x7f11c41548c0 2023-11-28T19:59:41.403 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:41.395+0000 7f11baffd640 1 -- 172.21.15.78:0/3782556457 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f11bc014480 con 0x7f11c41548c0 2023-11-28T19:59:41.404 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:41.399+0000 7f11baffd640 1 --2- 172.21.15.78:0/3782556457 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f11a80664a0 0x7f11a8068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:41.404 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:41.399+0000 7f11baffd640 1 -- 172.21.15.78:0/3782556457 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f11bc084c10 con 0x7f11c41548c0 2023-11-28T19:59:41.404 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:41.399+0000 7f11ca554640 1 --2- 172.21.15.78:0/3782556457 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f11a80664a0 0x7f11a8068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:41.404 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:41.399+0000 7f11ca554640 1 --2- 172.21.15.78:0/3782556457 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f11a80664a0 0x7f11a8068960 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f11c0000f70 tx=0x7f11c0007e10 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:59:41.407 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:41.403+0000 7f11baffd640 1 -- 172.21.15.78:0/3782556457 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f11bc051e40 con 0x7f11c41548c0 2023-11-28T19:59:41.558 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:41.551+0000 7f11cc7b8640 1 -- 172.21.15.78:0/3782556457 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f11c4067630 con 0x7f11c41548c0 2023-11-28T19:59:41.559 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:41.551+0000 7f11baffd640 1 -- 172.21.15.78:0/3782556457 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v25) v1 ==== 93+0+10 (secure 0 0 0) 0x7f11bc0180a0 con 0x7f11c41548c0 2023-11-28T19:59:41.559 INFO:teuthology.orchestra.run.smithi078.stdout:pg_num: 1 2023-11-28T19:59:41.561 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:41.555+0000 7f11cc7b8640 1 -- 172.21.15.78:0/3782556457 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f11a80664a0 msgr2=0x7f11a8068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:41.561 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:41.555+0000 7f11cc7b8640 1 --2- 172.21.15.78:0/3782556457 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f11a80664a0 0x7f11a8068960 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f11c0000f70 tx=0x7f11c0007e10 comp rx=0 tx=0).stop 2023-11-28T19:59:41.561 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:41.555+0000 7f11cc7b8640 1 -- 172.21.15.78:0/3782556457 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f11c41548c0 msgr2=0x7f11c413fca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:41.561 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:41.555+0000 7f11cc7b8640 1 --2- 172.21.15.78:0/3782556457 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f11c41548c0 0x7f11c413fca0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f11bc00efc0 tx=0x7f11bc00c490 comp rx=0 tx=0).stop 2023-11-28T19:59:41.562 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:41.555+0000 7f11cc7b8640 1 -- 172.21.15.78:0/3782556457 shutdown_connections 2023-11-28T19:59:41.562 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:41.555+0000 7f11cc7b8640 1 --2- 172.21.15.78:0/3782556457 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f11a80664a0 0x7f11a8068960 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:41.562 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:41.555+0000 7f11cc7b8640 1 --2- 172.21.15.78:0/3782556457 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f11c414b1e0 0x7f11c4142f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:41.562 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:41.555+0000 7f11cc7b8640 1 --2- 172.21.15.78:0/3782556457 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f11c41548c0 0x7f11c413fca0 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:41.562 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:41.555+0000 7f11cc7b8640 1 --2- 172.21.15.78:0/3782556457 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f11c40c5300 0x7f11c406d300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:41.562 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:41.555+0000 7f11cc7b8640 1 -- 172.21.15.78:0/3782556457 >> 172.21.15.78:0/3782556457 conn(0x7f11c40c59f0 msgr2=0x7f11c41486c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T19:59:41.563 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:41.555+0000 7f11cc7b8640 1 -- 172.21.15.78:0/3782556457 shutdown_connections 2023-11-28T19:59:41.563 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:41.555+0000 7f11cc7b8640 1 -- 172.21.15.78:0/3782556457 wait complete. 2023-11-28T19:59:41.580 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-28T19:59:41.720 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:41.715+0000 7f4b2c0c9640 1 Processor -- start 2023-11-28T19:59:41.720 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:41.715+0000 7f4b2c0c9640 1 -- start start 2023-11-28T19:59:41.721 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:41.715+0000 7f4b2c0c9640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f4b2415c680 0x7f4b240c0370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:41.721 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:41.715+0000 7f4b2c0c9640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4b2406bce0 con 0x7f4b24156200 2023-11-28T19:59:41.721 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:41.715+0000 7f4b2c0c9640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4b240c2270 con 0x7f4b240c0e10 2023-11-28T19:59:41.721 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:41.715+0000 7f4b2c0c9640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4b2406d8d0 con 0x7f4b2415c680 2023-11-28T19:59:41.721 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:41.715+0000 7f4b2a666640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f4b2415c680 0x7f4b240c0370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:41.721 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:41.715+0000 7f4b29e65640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f4b24156200 0x7f4b240c1b60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:60758/0 (socket says 172.21.15.78:60758) 2023-11-28T19:59:41.721 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:41.715+0000 7f4b29e65640 1 -- 172.21.15.78:0/1509124710 learned_addr learned my addr 172.21.15.78:0/1509124710 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-11-28T19:59:41.722 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:41.715+0000 7f4b2a666640 1 -- 172.21.15.78:0/1509124710 >> v1:172.21.15.179:6789/0 conn(0x7f4b240c0e10 legacy=0x7f4b2415bf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:41.722 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:41.715+0000 7f4b2a666640 1 -- 172.21.15.78:0/1509124710 >> v1:172.21.15.78:6789/0 conn(0x7f4b24156200 legacy=0x7f4b240c1b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:41.722 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:41.715+0000 7f4b2a666640 1 -- 172.21.15.78:0/1509124710 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b2415cc60 con 0x7f4b2415c680 2023-11-28T19:59:41.724 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:41.719+0000 7f4b2a666640 1 --2- 172.21.15.78:0/1509124710 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4b2415c680 0x7f4b240c0370 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f4b1c009d90 tx=0x7f4b1c01c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eb7ce725fc6706ac server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:59:41.725 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:41.719+0000 7f4b28e63640 1 -- 172.21.15.78:0/1509124710 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b1c0a6700 con 0x7f4b2415c680 2023-11-28T19:59:41.725 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:41.719+0000 7f4b28e63640 1 -- 172.21.15.78:0/1509124710 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b1c0a6860 con 0x7f4b2415c680 2023-11-28T19:59:41.725 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:41.719+0000 7f4b28e63640 1 -- 172.21.15.78:0/1509124710 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b1c0a6bf0 con 0x7f4b2415c680 2023-11-28T19:59:41.726 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:41.719+0000 7f4b2c0c9640 1 -- 172.21.15.78:0/1509124710 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4b2415c680 msgr2=0x7f4b240c0370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:41.726 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:41.719+0000 7f4b2c0c9640 1 --2- 172.21.15.78:0/1509124710 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4b2415c680 0x7f4b240c0370 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f4b1c009d90 tx=0x7f4b1c01c830 comp rx=0 tx=0).stop 2023-11-28T19:59:41.726 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:41.719+0000 7f4b2c0c9640 1 -- 172.21.15.78:0/1509124710 shutdown_connections 2023-11-28T19:59:41.726 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:41.719+0000 7f4b2c0c9640 1 --2- 172.21.15.78:0/1509124710 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4b2415c680 0x7f4b240c0370 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:41.726 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:41.719+0000 7f4b2c0c9640 1 -- 172.21.15.78:0/1509124710 >> 172.21.15.78:0/1509124710 conn(0x7f4b240c59f0 msgr2=0x7f4b240c5e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T19:59:41.726 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:41.719+0000 7f4b2c0c9640 1 -- 172.21.15.78:0/1509124710 shutdown_connections 2023-11-28T19:59:41.726 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:41.719+0000 7f4b2c0c9640 1 -- 172.21.15.78:0/1509124710 wait complete. 2023-11-28T19:59:41.727 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:41.723+0000 7f4b2c0c9640 1 Processor -- start 2023-11-28T19:59:41.727 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:41.723+0000 7f4b2c0c9640 1 -- start start 2023-11-28T19:59:41.728 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:41.723+0000 7f4b2c0c9640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4b240c0e10 0x7f4b24072580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:41.728 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:41.723+0000 7f4b2c0c9640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4b24156200 0x7f4b240706e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:41.729 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:41.723+0000 7f4b2c0c9640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4b2415c680 0x7f4b24148c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:41.729 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:41.723+0000 7f4b2c0c9640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b2414df60 con 0x7f4b240c0e10 2023-11-28T19:59:41.729 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:41.723+0000 7f4b2c0c9640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b240aa370 con 0x7f4b24156200 2023-11-28T19:59:41.729 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:41.723+0000 7f4b2c0c9640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b2414e170 con 0x7f4b2415c680 2023-11-28T19:59:41.729 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:41.723+0000 7f4b29e65640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4b240c0e10 0x7f4b24072580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:41.729 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:41.723+0000 7f4b29e65640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4b240c0e10 0x7f4b24072580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:37110/0 (socket says 172.21.15.78:37110) 2023-11-28T19:59:41.729 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:41.723+0000 7f4b29e65640 1 -- 172.21.15.78:0/3050237551 learned_addr learned my addr 172.21.15.78:0/3050237551 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T19:59:41.729 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:41.723+0000 7f4b2a666640 1 --2- 172.21.15.78:0/3050237551 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4b2415c680 0x7f4b24148c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:41.729 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:41.723+0000 7f4b29664640 1 --2- 172.21.15.78:0/3050237551 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4b24156200 0x7f4b240706e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:41.729 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:41.723+0000 7f4b29e65640 1 -- 172.21.15.78:0/3050237551 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4b2415c680 msgr2=0x7f4b24148c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:41.729 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:41.723+0000 7f4b29e65640 1 --2- 172.21.15.78:0/3050237551 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4b2415c680 0x7f4b24148c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:41.730 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:41.723+0000 7f4b29e65640 1 -- 172.21.15.78:0/3050237551 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4b24156200 msgr2=0x7f4b240706e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:41.730 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:41.723+0000 7f4b29e65640 1 --2- 172.21.15.78:0/3050237551 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4b24156200 0x7f4b240706e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:41.730 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:41.723+0000 7f4b29e65640 1 -- 172.21.15.78:0/3050237551 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b1c009a70 con 0x7f4b240c0e10 2023-11-28T19:59:41.730 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:41.723+0000 7f4b2a666640 1 --2- 172.21.15.78:0/3050237551 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4b2415c680 0x7f4b24148c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T19:59:41.730 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:41.723+0000 7f4b29e65640 1 --2- 172.21.15.78:0/3050237551 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4b240c0e10 0x7f4b24072580 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f4b2000c500 tx=0x7f4b2000c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:59:41.731 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:41.723+0000 7f4b1a7fc640 1 -- 172.21.15.78:0/3050237551 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b20005cf0 con 0x7f4b240c0e10 2023-11-28T19:59:41.731 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:41.723+0000 7f4b1a7fc640 1 -- 172.21.15.78:0/3050237551 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b20005e50 con 0x7f4b240c0e10 2023-11-28T19:59:41.731 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:41.723+0000 7f4b1a7fc640 1 -- 172.21.15.78:0/3050237551 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b200072f0 con 0x7f4b240c0e10 2023-11-28T19:59:41.731 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:41.723+0000 7f4b2c0c9640 1 -- 172.21.15.78:0/3050237551 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4b2414e450 con 0x7f4b240c0e10 2023-11-28T19:59:41.731 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:41.723+0000 7f4b2c0c9640 1 -- 172.21.15.78:0/3050237551 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4b240aa000 con 0x7f4b240c0e10 2023-11-28T19:59:41.731 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:41.723+0000 7f4b2c0c9640 1 -- 172.21.15.78:0/3050237551 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4b24067630 con 0x7f4b240c0e10 2023-11-28T19:59:41.731 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:41.727+0000 7f4b1a7fc640 1 -- 172.21.15.78:0/3050237551 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f4b20007450 con 0x7f4b240c0e10 2023-11-28T19:59:41.732 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:41.727+0000 7f4b1a7fc640 1 --2- 172.21.15.78:0/3050237551 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f4b08066470 0x7f4b08068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:41.732 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:41.727+0000 7f4b1a7fc640 1 -- 172.21.15.78:0/3050237551 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f4b20083620 con 0x7f4b240c0e10 2023-11-28T19:59:41.732 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:41.727+0000 7f4b29664640 1 --2- 172.21.15.78:0/3050237551 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f4b08066470 0x7f4b08068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:41.733 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:41.727+0000 7f4b29664640 1 --2- 172.21.15.78:0/3050237551 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f4b08066470 0x7f4b08068930 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f4b240c5910 tx=0x7f4b14009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:59:41.735 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:41.731+0000 7f4b1a7fc640 1 -- 172.21.15.78:0/3050237551 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f4b20050850 con 0x7f4b240c0e10 2023-11-28T19:59:41.888 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:41.883+0000 7f4b2c0c9640 1 -- 172.21.15.78:0/3050237551 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f4b24155680 con 0x7f4b240c0e10 2023-11-28T19:59:41.888 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:41.883+0000 7f4b1a7fc640 1 -- 172.21.15.78:0/3050237551 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v25) v1 ==== 104+0+11 (secure 0 0 0) 0x7f4b20053e70 con 0x7f4b240c0e10 2023-11-28T19:59:41.889 INFO:teuthology.orchestra.run.smithi078.stdout:pg_num: 32 2023-11-28T19:59:41.890 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:41.883+0000 7f4b2c0c9640 1 -- 172.21.15.78:0/3050237551 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f4b08066470 msgr2=0x7f4b08068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:41.890 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:41.883+0000 7f4b2c0c9640 1 --2- 172.21.15.78:0/3050237551 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f4b08066470 0x7f4b08068930 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f4b240c5910 tx=0x7f4b14009040 comp rx=0 tx=0).stop 2023-11-28T19:59:41.891 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:41.883+0000 7f4b2c0c9640 1 -- 172.21.15.78:0/3050237551 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4b240c0e10 msgr2=0x7f4b24072580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:41.891 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:41.883+0000 7f4b2c0c9640 1 --2- 172.21.15.78:0/3050237551 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4b240c0e10 0x7f4b24072580 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f4b2000c500 tx=0x7f4b2000c9c0 comp rx=0 tx=0).stop 2023-11-28T19:59:41.891 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:41.883+0000 7f4b2c0c9640 1 -- 172.21.15.78:0/3050237551 shutdown_connections 2023-11-28T19:59:41.891 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:41.883+0000 7f4b2c0c9640 1 --2- 172.21.15.78:0/3050237551 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f4b08066470 0x7f4b08068930 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:41.891 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:41.883+0000 7f4b2c0c9640 1 --2- 172.21.15.78:0/3050237551 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4b2415c680 0x7f4b24148c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:41.891 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:41.883+0000 7f4b2c0c9640 1 --2- 172.21.15.78:0/3050237551 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4b24156200 0x7f4b240706e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:41.891 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:41.883+0000 7f4b2c0c9640 1 --2- 172.21.15.78:0/3050237551 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4b240c0e10 0x7f4b24072580 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:41.891 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:41.883+0000 7f4b2c0c9640 1 -- 172.21.15.78:0/3050237551 >> 172.21.15.78:0/3050237551 conn(0x7f4b240c59f0 msgr2=0x7f4b2415bec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T19:59:41.891 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:41.883+0000 7f4b2c0c9640 1 -- 172.21.15.78:0/3050237551 shutdown_connections 2023-11-28T19:59:41.892 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:41.883+0000 7f4b2c0c9640 1 -- 172.21.15.78:0/3050237551 wait complete. 2023-11-28T19:59:41.910 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-28T19:59:42.052 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:42.047+0000 7f210c85a640 1 Processor -- start 2023-11-28T19:59:42.053 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:42.047+0000 7f210c85a640 1 -- start start 2023-11-28T19:59:42.054 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:42.047+0000 7f210c85a640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f210815a580 0x7f210815c970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:42.054 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:42.047+0000 7f210c85a640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2108151210 con 0x7f210814e2a0 2023-11-28T19:59:42.054 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:42.047+0000 7f210c85a640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f210814e680 con 0x7f21081516a0 2023-11-28T19:59:42.054 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:42.047+0000 7f210c85a640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2108151b50 con 0x7f210815a580 2023-11-28T19:59:42.054 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:42.047+0000 7f210659c640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f210814e2a0 0x7f21080a9460 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:60766/0 (socket says 172.21.15.78:60766) 2023-11-28T19:59:42.054 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:42.047+0000 7f210659c640 1 -- 172.21.15.78:0/2522225727 learned_addr learned my addr 172.21.15.78:0/2522225727 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-11-28T19:59:42.055 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:42.047+0000 7f2106d9d640 1 --2- 172.21.15.78:0/2522225727 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f210815a580 0x7f210815c970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:42.055 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:42.047+0000 7f2105d9b640 1 -- 172.21.15.78:0/2522225727 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 660905026 0 0) 0x7f2108151210 con 0x7f210814e2a0 2023-11-28T19:59:42.055 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:42.047+0000 7f2105d9b640 1 -- 172.21.15.78:0/2522225727 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f20f4003530 con 0x7f210814e2a0 2023-11-28T19:59:42.055 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:42.047+0000 7f2105d9b640 1 -- 172.21.15.78:0/2522225727 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 872948918 0 0) 0x7f210814e680 con 0x7f21081516a0 2023-11-28T19:59:42.055 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:42.047+0000 7f2105d9b640 1 -- 172.21.15.78:0/2522225727 --> v1:172.21.15.179:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2108151210 con 0x7f21081516a0 2023-11-28T19:59:42.055 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:42.047+0000 7f2105d9b640 1 -- 172.21.15.78:0/2522225727 <== mon.0 v1:172.21.15.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 565494938 0 0) 0x7f20f4003530 con 0x7f210814e2a0 2023-11-28T19:59:42.055 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:42.047+0000 7f2106d9d640 1 -- 172.21.15.78:0/2522225727 >> v1:172.21.15.179:6789/0 conn(0x7f21081516a0 legacy=0x7f210806bc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:42.055 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:42.047+0000 7f2106d9d640 1 -- 172.21.15.78:0/2522225727 >> v1:172.21.15.78:6789/0 conn(0x7f210814e2a0 legacy=0x7f21080a9460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:42.055 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:42.047+0000 7f2106d9d640 1 -- 172.21.15.78:0/2522225727 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21080a9b70 con 0x7f210815a580 2023-11-28T19:59:42.057 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:42.051+0000 7f2106d9d640 1 --2- 172.21.15.78:0/2522225727 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f210815a580 0x7f210815c970 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f2108151c90 tx=0x7f210001c890 comp rx=0 tx=0).ready entity=mon.2 client_cookie=218455c3e8247ab0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:59:42.057 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:42.051+0000 7f2105d9b640 1 -- 172.21.15.78:0/2522225727 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20f8001680 con 0x7f210815a580 2023-11-28T19:59:42.057 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:42.051+0000 7f2105d9b640 1 -- 172.21.15.78:0/2522225727 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f21000a55e0 con 0x7f210815a580 2023-11-28T19:59:42.057 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:42.051+0000 7f2105d9b640 1 -- 172.21.15.78:0/2522225727 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21000a5970 con 0x7f210815a580 2023-11-28T19:59:42.058 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:42.051+0000 7f210c85a640 1 -- 172.21.15.78:0/2522225727 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f210815a580 msgr2=0x7f210815c970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:42.058 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:42.051+0000 7f210c85a640 1 --2- 172.21.15.78:0/2522225727 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f210815a580 0x7f210815c970 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f2108151c90 tx=0x7f210001c890 comp rx=0 tx=0).stop 2023-11-28T19:59:42.058 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:42.051+0000 7f210c85a640 1 -- 172.21.15.78:0/2522225727 shutdown_connections 2023-11-28T19:59:42.058 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:42.051+0000 7f210c85a640 1 --2- 172.21.15.78:0/2522225727 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f210815a580 0x7f210815c970 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:42.059 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:42.051+0000 7f210c85a640 1 -- 172.21.15.78:0/2522225727 >> 172.21.15.78:0/2522225727 conn(0x7f21080c59f0 msgr2=0x7f21080c5e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T19:59:42.059 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:42.051+0000 7f210c85a640 1 -- 172.21.15.78:0/2522225727 shutdown_connections 2023-11-28T19:59:42.059 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:42.051+0000 7f210c85a640 1 -- 172.21.15.78:0/2522225727 wait complete. 2023-11-28T19:59:42.060 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:42.055+0000 7f210c85a640 1 Processor -- start 2023-11-28T19:59:42.060 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:42.055+0000 7f210c85a640 1 -- start start 2023-11-28T19:59:42.061 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:42.055+0000 7f210c85a640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f210814e2a0 0x7f21081f0d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:42.061 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:42.055+0000 7f210c85a640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f21081516a0 0x7f21081ecd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:42.061 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:42.055+0000 7f210c85a640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f210815a580 0x7f21080a6ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:42.061 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:42.055+0000 7f210c85a640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2108070000 con 0x7f210814e2a0 2023-11-28T19:59:42.062 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:42.055+0000 7f210c85a640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2108151f50 con 0x7f210815a580 2023-11-28T19:59:42.062 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:42.055+0000 7f210c85a640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2108152230 con 0x7f21081516a0 2023-11-28T19:59:42.062 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:42.055+0000 7f210659c640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f210814e2a0 0x7f21081f0d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:42.062 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:42.055+0000 7f210659c640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f210814e2a0 0x7f21081f0d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:37118/0 (socket says 172.21.15.78:37118) 2023-11-28T19:59:42.062 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:42.055+0000 7f210659c640 1 -- 172.21.15.78:0/1164760130 learned_addr learned my addr 172.21.15.78:0/1164760130 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T19:59:42.062 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:42.055+0000 7f20fdd9b640 1 --2- 172.21.15.78:0/1164760130 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f21081516a0 0x7f21081ecd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:42.062 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:42.055+0000 7f2106d9d640 1 --2- 172.21.15.78:0/1164760130 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f210815a580 0x7f21080a6ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:42.063 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:42.055+0000 7f210659c640 1 -- 172.21.15.78:0/1164760130 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f21081516a0 msgr2=0x7f21081ecd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:42.064 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:42.055+0000 7f210659c640 1 --2- 172.21.15.78:0/1164760130 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f21081516a0 0x7f21081ecd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:42.064 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:42.055+0000 7f210659c640 1 -- 172.21.15.78:0/1164760130 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f210815a580 msgr2=0x7f21080a6ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:42.064 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:42.055+0000 7f210659c640 1 --2- 172.21.15.78:0/1164760130 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f210815a580 0x7f21080a6ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:42.064 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:42.055+0000 7f210659c640 1 -- 172.21.15.78:0/1164760130 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2100009a70 con 0x7f210814e2a0 2023-11-28T19:59:42.064 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:42.055+0000 7f210659c640 1 --2- 172.21.15.78:0/1164760130 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f210814e2a0 0x7f21081f0d70 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f20f800c750 tx=0x7f20f800cc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:59:42.064 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:42.055+0000 7f20ff7fe640 1 -- 172.21.15.78:0/1164760130 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20f8005af0 con 0x7f210814e2a0 2023-11-28T19:59:42.064 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:42.055+0000 7f20ff7fe640 1 -- 172.21.15.78:0/1164760130 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f20f8005c50 con 0x7f210814e2a0 2023-11-28T19:59:42.064 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:42.055+0000 7f210c85a640 1 -- 172.21.15.78:0/1164760130 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2108152510 con 0x7f210814e2a0 2023-11-28T19:59:42.064 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:42.055+0000 7f20ff7fe640 1 -- 172.21.15.78:0/1164760130 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20f8007070 con 0x7f210814e2a0 2023-11-28T19:59:42.064 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:42.055+0000 7f210c85a640 1 -- 172.21.15.78:0/1164760130 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f21081f0570 con 0x7f210814e2a0 2023-11-28T19:59:42.064 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:42.059+0000 7f210c85a640 1 -- 172.21.15.78:0/1164760130 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2108067630 con 0x7f210814e2a0 2023-11-28T19:59:42.065 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:42.059+0000 7f20ff7fe640 1 -- 172.21.15.78:0/1164760130 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f20f80071d0 con 0x7f210814e2a0 2023-11-28T19:59:42.065 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:42.059+0000 7f20ff7fe640 1 --2- 172.21.15.78:0/1164760130 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f20e8066470 0x7f20e8068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:42.065 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:42.059+0000 7f20ff7fe640 1 -- 172.21.15.78:0/1164760130 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f20f8083dc0 con 0x7f210814e2a0 2023-11-28T19:59:42.065 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:42.059+0000 7f20fdd9b640 1 --2- 172.21.15.78:0/1164760130 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f20e8066470 0x7f20e8068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:42.066 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:42.059+0000 7f20fdd9b640 1 --2- 172.21.15.78:0/1164760130 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f20e8066470 0x7f20e8068930 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f21080c40f0 tx=0x7f20f0009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:59:42.069 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:42.063+0000 7f20ff7fe640 1 -- 172.21.15.78:0/1164760130 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f20f8050ff0 con 0x7f210814e2a0 2023-11-28T19:59:42.221 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:42.215+0000 7f210c85a640 1 -- 172.21.15.78:0/1164760130 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f21080c5100 con 0x7f210814e2a0 2023-11-28T19:59:42.221 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:42.215+0000 7f20ff7fe640 1 -- 172.21.15.78:0/1164760130 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v25) v1 ==== 100+0+11 (secure 0 0 0) 0x7f20f8054610 con 0x7f210814e2a0 2023-11-28T19:59:42.221 INFO:teuthology.orchestra.run.smithi078.stdout:pg_num: 64 2023-11-28T19:59:42.223 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:42.215+0000 7f210c85a640 1 -- 172.21.15.78:0/1164760130 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f20e8066470 msgr2=0x7f20e8068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:42.223 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:42.215+0000 7f210c85a640 1 --2- 172.21.15.78:0/1164760130 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f20e8066470 0x7f20e8068930 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f21080c40f0 tx=0x7f20f0009040 comp rx=0 tx=0).stop 2023-11-28T19:59:42.223 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:42.215+0000 7f210c85a640 1 -- 172.21.15.78:0/1164760130 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f210814e2a0 msgr2=0x7f21081f0d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:42.223 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:42.215+0000 7f210c85a640 1 --2- 172.21.15.78:0/1164760130 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f210814e2a0 0x7f21081f0d70 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f20f800c750 tx=0x7f20f800cc10 comp rx=0 tx=0).stop 2023-11-28T19:59:42.223 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:42.215+0000 7f210c85a640 1 -- 172.21.15.78:0/1164760130 shutdown_connections 2023-11-28T19:59:42.223 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:42.215+0000 7f210c85a640 1 --2- 172.21.15.78:0/1164760130 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f20e8066470 0x7f20e8068930 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:42.223 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:42.215+0000 7f210c85a640 1 --2- 172.21.15.78:0/1164760130 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f21081516a0 0x7f21081ecd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:42.224 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:42.215+0000 7f210c85a640 1 --2- 172.21.15.78:0/1164760130 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f210815a580 0x7f21080a6ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:42.224 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:42.215+0000 7f210c85a640 1 --2- 172.21.15.78:0/1164760130 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f210814e2a0 0x7f21081f0d70 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:42.224 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:42.215+0000 7f210c85a640 1 -- 172.21.15.78:0/1164760130 >> 172.21.15.78:0/1164760130 conn(0x7f21080c59f0 msgr2=0x7f210814fa00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T19:59:42.224 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:42.219+0000 7f210c85a640 1 -- 172.21.15.78:0/1164760130 shutdown_connections 2023-11-28T19:59:42.224 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:42.219+0000 7f210c85a640 1 -- 172.21.15.78:0/1164760130 wait complete. 2023-11-28T19:59:42.243 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-11-28T19:59:42.383 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:42.375+0000 7f877e0dd640 1 Processor -- start 2023-11-28T19:59:42.383 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:42.379+0000 7f877e0dd640 1 -- start start 2023-11-28T19:59:42.384 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:42.379+0000 7f877e0dd640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f877814b1e0 0x7f87780c1700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:42.385 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:42.379+0000 7f877e0dd640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f87780c5300 0x7f87780a9c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:42.385 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:42.379+0000 7f877e0dd640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f8778151280 0x7f8778151710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:42.385 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:42.379+0000 7f877e0dd640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f87780a4e20 con 0x7f8778151280 2023-11-28T19:59:42.385 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:42.379+0000 7f877e0dd640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f87780a50e0 con 0x7f87780c5300 2023-11-28T19:59:42.385 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:42.379+0000 7f877e0dd640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87780c0f00 con 0x7f877814b1e0 2023-11-28T19:59:42.385 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:42.379+0000 7f8777fff640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f8778151280 0x7f8778151710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:42.385 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:42.379+0000 7f8777fff640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f8778151280 0x7f8778151710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:37134/0 (socket says 172.21.15.78:37134) 2023-11-28T19:59:42.385 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:42.379+0000 7f8777fff640 1 -- 172.21.15.78:0/4286697977 learned_addr learned my addr 172.21.15.78:0/4286697977 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T19:59:42.385 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:42.379+0000 7f8776ffd640 1 --2- 172.21.15.78:0/4286697977 >> v2:172.21.15.179:3300/0 conn(0x7f87780c5300 0x7f87780a9c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:42.385 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:42.379+0000 7f87777fe640 1 --2- 172.21.15.78:0/4286697977 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f877814b1e0 0x7f87780c1700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:42.385 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:42.379+0000 7f8777fff640 1 -- 172.21.15.78:0/4286697977 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f877814b1e0 msgr2=0x7f87780c1700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T19:59:42.386 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:42.379+0000 7f8777fff640 1 --2- 172.21.15.78:0/4286697977 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f877814b1e0 0x7f87780c1700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:42.386 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:42.379+0000 7f8777fff640 1 -- 172.21.15.78:0/4286697977 >> v2:172.21.15.179:3300/0 conn(0x7f87780c5300 msgr2=0x7f87780a9c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T19:59:42.386 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:42.379+0000 7f8777fff640 1 --2- 172.21.15.78:0/4286697977 >> v2:172.21.15.179:3300/0 conn(0x7f87780c5300 0x7f87780a9c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:42.386 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:42.379+0000 7f8777fff640 1 -- 172.21.15.78:0/4286697977 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87780c11e0 con 0x7f8778151280 2023-11-28T19:59:42.387 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:42.383+0000 7f8777fff640 1 --2- 172.21.15.78:0/4286697977 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8778151280 0x7f8778151710 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f877806f790 tx=0x7f877001ebe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f879f917bdbd19f3 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:59:42.388 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:42.383+0000 7f87767fc640 1 -- 172.21.15.78:0/4286697977 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87700a7800 con 0x7f8778151280 2023-11-28T19:59:42.388 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:42.383+0000 7f87767fc640 1 -- 172.21.15.78:0/4286697977 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f87700a7960 con 0x7f8778151280 2023-11-28T19:59:42.388 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:42.383+0000 7f87767fc640 1 -- 172.21.15.78:0/4286697977 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87700a7cf0 con 0x7f8778151280 2023-11-28T19:59:42.389 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:42.383+0000 7f877e0dd640 1 -- 172.21.15.78:0/4286697977 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8778151280 msgr2=0x7f8778151710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:42.389 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:42.383+0000 7f877e0dd640 1 --2- 172.21.15.78:0/4286697977 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8778151280 0x7f8778151710 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f877806f790 tx=0x7f877001ebe0 comp rx=0 tx=0).stop 2023-11-28T19:59:42.389 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:42.383+0000 7f877e0dd640 1 -- 172.21.15.78:0/4286697977 shutdown_connections 2023-11-28T19:59:42.389 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:42.383+0000 7f877e0dd640 1 --2- 172.21.15.78:0/4286697977 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8778151280 0x7f8778151710 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:42.389 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:42.383+0000 7f877e0dd640 1 --2- 172.21.15.78:0/4286697977 >> v2:172.21.15.179:3300/0 conn(0x7f87780c5300 0x7f87780a9c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:42.389 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:42.383+0000 7f877e0dd640 1 --2- 172.21.15.78:0/4286697977 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f877814b1e0 0x7f87780c1700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:42.389 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:42.383+0000 7f877e0dd640 1 -- 172.21.15.78:0/4286697977 >> 172.21.15.78:0/4286697977 conn(0x7f87780c59f0 msgr2=0x7f87780c5e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T19:59:42.389 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:42.383+0000 7f877e0dd640 1 -- 172.21.15.78:0/4286697977 shutdown_connections 2023-11-28T19:59:42.389 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:42.383+0000 7f877e0dd640 1 -- 172.21.15.78:0/4286697977 wait complete. 2023-11-28T19:59:42.390 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:42.383+0000 7f877e0dd640 1 Processor -- start 2023-11-28T19:59:42.390 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:42.383+0000 7f877e0dd640 1 -- start start 2023-11-28T19:59:42.392 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:42.387+0000 7f877e0dd640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f87780c5300 0x7f87781ec930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:42.393 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:42.387+0000 7f877e0dd640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f877814b1e0 0x7f877806c4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:42.393 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:42.387+0000 7f877e0dd640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8778151280 0x7f8778142520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:42.393 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:42.387+0000 7f877e0dd640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87781ebe90 con 0x7f877814b1e0 2023-11-28T19:59:42.393 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:42.387+0000 7f877e0dd640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f877806cba0 con 0x7f8778151280 2023-11-28T19:59:42.393 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:42.387+0000 7f877e0dd640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87780a5b30 con 0x7f87780c5300 2023-11-28T19:59:42.393 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:42.387+0000 7f8776ffd640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f877814b1e0 0x7f877806c4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:42.393 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:42.387+0000 7f87777fe640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f87780c5300 0x7f87781ec930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:42.393 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:42.387+0000 7f8776ffd640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f877814b1e0 0x7f877806c4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:37138/0 (socket says 172.21.15.78:37138) 2023-11-28T19:59:42.393 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:42.387+0000 7f8776ffd640 1 -- 172.21.15.78:0/1711686564 learned_addr learned my addr 172.21.15.78:0/1711686564 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T19:59:42.393 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:42.387+0000 7f8777fff640 1 --2- 172.21.15.78:0/1711686564 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8778151280 0x7f8778142520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:42.393 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:42.387+0000 7f8776ffd640 1 -- 172.21.15.78:0/1711686564 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f87780c5300 msgr2=0x7f87781ec930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:42.393 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:42.387+0000 7f8776ffd640 1 --2- 172.21.15.78:0/1711686564 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f87780c5300 0x7f87781ec930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:42.394 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:42.387+0000 7f8776ffd640 1 -- 172.21.15.78:0/1711686564 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8778151280 msgr2=0x7f8778142520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:42.394 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:42.387+0000 7f8776ffd640 1 --2- 172.21.15.78:0/1711686564 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8778151280 0x7f8778142520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:42.394 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:42.387+0000 7f8776ffd640 1 -- 172.21.15.78:0/1711686564 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8770009b30 con 0x7f877814b1e0 2023-11-28T19:59:42.394 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:42.387+0000 7f8776ffd640 1 --2- 172.21.15.78:0/1711686564 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f877814b1e0 0x7f877806c4c0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f876c00d7d0 tx=0x7f876c00dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:59:42.394 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:42.387+0000 7f875ffff640 1 -- 172.21.15.78:0/1711686564 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f876c0096a0 con 0x7f877814b1e0 2023-11-28T19:59:42.394 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:42.387+0000 7f875ffff640 1 -- 172.21.15.78:0/1711686564 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f876c009800 con 0x7f877814b1e0 2023-11-28T19:59:42.394 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:42.387+0000 7f875ffff640 1 -- 172.21.15.78:0/1711686564 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f876c009bb0 con 0x7f877814b1e0 2023-11-28T19:59:42.394 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:42.387+0000 7f877e0dd640 1 -- 172.21.15.78:0/1711686564 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f87780a7110 con 0x7f877814b1e0 2023-11-28T19:59:42.394 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:42.387+0000 7f877e0dd640 1 -- 172.21.15.78:0/1711686564 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f87781ec410 con 0x7f877814b1e0 2023-11-28T19:59:42.395 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:42.387+0000 7f877e0dd640 1 -- 172.21.15.78:0/1711686564 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8778067630 con 0x7f877814b1e0 2023-11-28T19:59:42.395 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:42.387+0000 7f875ffff640 1 -- 172.21.15.78:0/1711686564 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f876c009d10 con 0x7f877814b1e0 2023-11-28T19:59:42.395 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:42.391+0000 7f875ffff640 1 --2- 172.21.15.78:0/1711686564 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f87640664a0 0x7f8764068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:42.395 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:42.391+0000 7f875ffff640 1 -- 172.21.15.78:0/1711686564 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f876c0844c0 con 0x7f877814b1e0 2023-11-28T19:59:42.396 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:42.391+0000 7f87777fe640 1 --2- 172.21.15.78:0/1711686564 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f87640664a0 0x7f8764068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:42.396 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:42.391+0000 7f87777fe640 1 --2- 172.21.15.78:0/1711686564 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f87640664a0 0x7f8764068960 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f8778148ae0 tx=0x7f8768008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:59:42.399 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:42.395+0000 7f875ffff640 1 -- 172.21.15.78:0/1711686564 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f876c0516f0 con 0x7f877814b1e0 2023-11-28T19:59:42.549 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:42.543+0000 7f877e0dd640 1 -- 172.21.15.78:0/1711686564 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f87780c1700 con 0x7f877814b1e0 2023-11-28T19:59:42.549 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:42.543+0000 7f875ffff640 1 -- 172.21.15.78:0/1711686564 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v25) v1 ==== 103+0+11 (secure 0 0 0) 0x7f876c054d10 con 0x7f877814b1e0 2023-11-28T19:59:42.550 INFO:teuthology.orchestra.run.smithi078.stdout:pg_num: 32 2023-11-28T19:59:42.551 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:42.543+0000 7f877e0dd640 1 -- 172.21.15.78:0/1711686564 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f87640664a0 msgr2=0x7f8764068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:42.551 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:42.543+0000 7f877e0dd640 1 --2- 172.21.15.78:0/1711686564 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f87640664a0 0x7f8764068960 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f8778148ae0 tx=0x7f8768008040 comp rx=0 tx=0).stop 2023-11-28T19:59:42.551 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:42.543+0000 7f877e0dd640 1 -- 172.21.15.78:0/1711686564 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f877814b1e0 msgr2=0x7f877806c4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:42.551 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:42.543+0000 7f877e0dd640 1 --2- 172.21.15.78:0/1711686564 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f877814b1e0 0x7f877806c4c0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f876c00d7d0 tx=0x7f876c00dc90 comp rx=0 tx=0).stop 2023-11-28T19:59:42.551 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:42.547+0000 7f877e0dd640 1 -- 172.21.15.78:0/1711686564 shutdown_connections 2023-11-28T19:59:42.552 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:42.547+0000 7f877e0dd640 1 --2- 172.21.15.78:0/1711686564 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f87640664a0 0x7f8764068960 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:42.552 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:42.547+0000 7f877e0dd640 1 --2- 172.21.15.78:0/1711686564 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8778151280 0x7f8778142520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:42.552 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:42.547+0000 7f877e0dd640 1 --2- 172.21.15.78:0/1711686564 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f877814b1e0 0x7f877806c4c0 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:42.552 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:42.547+0000 7f877e0dd640 1 --2- 172.21.15.78:0/1711686564 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f87780c5300 0x7f87781ec930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:42.552 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:42.547+0000 7f877e0dd640 1 -- 172.21.15.78:0/1711686564 >> 172.21.15.78:0/1711686564 conn(0x7f87780c59f0 msgr2=0x7f87780c5dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T19:59:42.552 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:42.547+0000 7f877e0dd640 1 -- 172.21.15.78:0/1711686564 shutdown_connections 2023-11-28T19:59:42.552 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:42.547+0000 7f877e0dd640 1 -- 172.21.15.78:0/1711686564 wait complete. 2023-11-28T19:59:42.570 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-28T19:59:42.708 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:42.703+0000 7f0de578d640 1 Processor -- start 2023-11-28T19:59:42.708 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:42.703+0000 7f0de578d640 1 -- start start 2023-11-28T19:59:42.710 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:42.703+0000 7f0de578d640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f0de006d2b0 0x7f0de006d690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:42.710 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:42.703+0000 7f0de578d640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f0de00c3b80 0x7f0de00c5300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:42.710 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:42.703+0000 7f0de578d640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0de006bb80 con 0x7f0de006c020 2023-11-28T19:59:42.710 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:42.703+0000 7f0de578d640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0de00c5840 con 0x7f0de00c3b80 2023-11-28T19:59:42.710 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:42.703+0000 7f0de578d640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0de01515c0 con 0x7f0de006d2b0 2023-11-28T19:59:42.711 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:42.703+0000 7f0dd67fc640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f0de00c3b80 0x7f0de00c5300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:42.711 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:42.703+0000 7f0dd67fc640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f0de00c3b80 0x7f0de00c5300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:37150/0 (socket says 172.21.15.78:37150) 2023-11-28T19:59:42.711 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:42.703+0000 7f0ddf7fe640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f0de006c020 0x7f0de006c4b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:60774/0 (socket says 172.21.15.78:60774) 2023-11-28T19:59:42.711 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:42.703+0000 7f0dd67fc640 1 -- 172.21.15.78:0/1663734974 learned_addr learned my addr 172.21.15.78:0/1663734974 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T19:59:42.711 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:42.703+0000 7f0ddeffd640 1 --2- 172.21.15.78:0/1663734974 >> v2:172.21.15.179:3300/0 conn(0x7f0de006d2b0 0x7f0de006d690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:42.711 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:42.703+0000 7f0dd67fc640 1 -- 172.21.15.78:0/1663734974 >> v2:172.21.15.179:3300/0 conn(0x7f0de006d2b0 msgr2=0x7f0de006d690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T19:59:42.711 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:42.703+0000 7f0dd67fc640 1 --2- 172.21.15.78:0/1663734974 >> v2:172.21.15.179:3300/0 conn(0x7f0de006d2b0 0x7f0de006d690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:42.711 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:42.703+0000 7f0dd67fc640 1 -- 172.21.15.78:0/1663734974 >> v1:172.21.15.78:6789/0 conn(0x7f0de006c020 legacy=0x7f0de006c4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:42.711 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:42.703+0000 7f0dd67fc640 1 -- 172.21.15.78:0/1663734974 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0de01518a0 con 0x7f0de00c3b80 2023-11-28T19:59:42.711 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:42.703+0000 7f0dde7fc640 1 -- 172.21.15.78:0/1663734974 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4228512430 0 0) 0x7f0de006bb80 con 0x7f0de006c020 2023-11-28T19:59:42.713 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:42.707+0000 7f0dd67fc640 1 --2- 172.21.15.78:0/1663734974 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0de00c3b80 0x7f0de00c5300 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f0de00c2130 tx=0x7f0dc801c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2b11f019210ce1b4 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:59:42.713 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:42.707+0000 7f0dde7fc640 1 -- 172.21.15.78:0/1663734974 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0dc80a5860 con 0x7f0de00c3b80 2023-11-28T19:59:42.713 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:42.707+0000 7f0dde7fc640 1 -- 172.21.15.78:0/1663734974 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0dc80a59c0 con 0x7f0de00c3b80 2023-11-28T19:59:42.713 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:42.707+0000 7f0dde7fc640 1 -- 172.21.15.78:0/1663734974 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0dc80a5d50 con 0x7f0de00c3b80 2023-11-28T19:59:42.714 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:42.707+0000 7f0de578d640 1 -- 172.21.15.78:0/1663734974 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0de00c3b80 msgr2=0x7f0de00c5300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:42.714 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:42.707+0000 7f0de578d640 1 --2- 172.21.15.78:0/1663734974 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0de00c3b80 0x7f0de00c5300 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f0de00c2130 tx=0x7f0dc801c9a0 comp rx=0 tx=0).stop 2023-11-28T19:59:42.715 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:42.707+0000 7f0de578d640 1 -- 172.21.15.78:0/1663734974 shutdown_connections 2023-11-28T19:59:42.715 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:42.707+0000 7f0de578d640 1 --2- 172.21.15.78:0/1663734974 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0de00c3b80 0x7f0de00c5300 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:42.715 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:42.707+0000 7f0de578d640 1 --2- 172.21.15.78:0/1663734974 >> v2:172.21.15.179:3300/0 conn(0x7f0de006d2b0 0x7f0de006d690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:42.715 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:42.707+0000 7f0de578d640 1 -- 172.21.15.78:0/1663734974 >> 172.21.15.78:0/1663734974 conn(0x7f0de00a7810 msgr2=0x7f0de00a7c20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T19:59:42.715 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:42.707+0000 7f0de578d640 1 -- 172.21.15.78:0/1663734974 shutdown_connections 2023-11-28T19:59:42.716 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:42.707+0000 7f0de578d640 1 -- 172.21.15.78:0/1663734974 wait complete. 2023-11-28T19:59:42.718 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:42.711+0000 7f0de578d640 1 Processor -- start 2023-11-28T19:59:42.718 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:42.711+0000 7f0de578d640 1 -- start start 2023-11-28T19:59:42.718 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:42.711+0000 7f0de578d640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0de006c020 0x7f0de00a8a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:42.718 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:42.711+0000 7f0de578d640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0de006d2b0 0x7f0de00bf0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:42.718 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:42.711+0000 7f0de578d640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0de00c3b80 0x7f0de015a5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:42.718 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:42.711+0000 7f0de578d640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0de01560c0 con 0x7f0de006c020 2023-11-28T19:59:42.719 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:42.711+0000 7f0de578d640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0de01f0cc0 con 0x7f0de006d2b0 2023-11-28T19:59:42.719 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:42.711+0000 7f0de578d640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0de00a9ff0 con 0x7f0de00c3b80 2023-11-28T19:59:42.719 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:42.711+0000 7f0ddeffd640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0de006c020 0x7f0de00a8a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:42.719 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:42.711+0000 7f0ddeffd640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0de006c020 0x7f0de00a8a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:37154/0 (socket says 172.21.15.78:37154) 2023-11-28T19:59:42.719 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:42.711+0000 7f0ddeffd640 1 -- 172.21.15.78:0/1642302490 learned_addr learned my addr 172.21.15.78:0/1642302490 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T19:59:42.719 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:42.711+0000 7f0ddeffd640 1 -- 172.21.15.78:0/1642302490 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0de00c3b80 msgr2=0x7f0de015a5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:42.719 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:42.711+0000 7f0ddeffd640 1 --2- 172.21.15.78:0/1642302490 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0de00c3b80 0x7f0de015a5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:42.719 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:42.711+0000 7f0ddeffd640 1 -- 172.21.15.78:0/1642302490 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0de006d2b0 msgr2=0x7f0de00bf0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:42.719 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:42.711+0000 7f0ddeffd640 1 --2- 172.21.15.78:0/1642302490 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0de006d2b0 0x7f0de00bf0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:42.720 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:42.711+0000 7f0ddeffd640 1 -- 172.21.15.78:0/1642302490 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0dc8009b30 con 0x7f0de006c020 2023-11-28T19:59:42.720 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:42.711+0000 7f0ddeffd640 1 --2- 172.21.15.78:0/1642302490 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0de006c020 0x7f0de00a8a00 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f0dd000d800 tx=0x7f0dd000dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:59:42.720 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:42.711+0000 7f0dd7fff640 1 -- 172.21.15.78:0/1642302490 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0dd000b6c0 con 0x7f0de006c020 2023-11-28T19:59:42.720 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:42.711+0000 7f0dd7fff640 1 -- 172.21.15.78:0/1642302490 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0dd000b820 con 0x7f0de006c020 2023-11-28T19:59:42.720 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:42.711+0000 7f0dd7fff640 1 -- 172.21.15.78:0/1642302490 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0dd000bb90 con 0x7f0de006c020 2023-11-28T19:59:42.720 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:42.711+0000 7f0de578d640 1 -- 172.21.15.78:0/1642302490 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0de014ef80 con 0x7f0de006c020 2023-11-28T19:59:42.720 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:42.711+0000 7f0de578d640 1 -- 172.21.15.78:0/1642302490 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0de00bf630 con 0x7f0de006c020 2023-11-28T19:59:42.721 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:42.711+0000 7f0de578d640 1 -- 172.21.15.78:0/1642302490 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0de0067630 con 0x7f0de006c020 2023-11-28T19:59:42.721 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:42.715+0000 7f0dd7fff640 1 -- 172.21.15.78:0/1642302490 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f0dd000bcf0 con 0x7f0de006c020 2023-11-28T19:59:42.721 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:42.715+0000 7f0dd7fff640 1 --2- 172.21.15.78:0/1642302490 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f0dc0066470 0x7f0dc0068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:42.722 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:42.715+0000 7f0dd7fff640 1 -- 172.21.15.78:0/1642302490 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f0dd00846b0 con 0x7f0de006c020 2023-11-28T19:59:42.722 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:42.715+0000 7f0dd67fc640 1 --2- 172.21.15.78:0/1642302490 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f0dc0066470 0x7f0dc0068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:42.722 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:42.715+0000 7f0dd67fc640 1 --2- 172.21.15.78:0/1642302490 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f0dc0066470 0x7f0dc0068930 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f0dc80ae000 tx=0x7f0dc8004ac0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:59:42.724 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:42.719+0000 7f0dd7fff640 1 -- 172.21.15.78:0/1642302490 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f0dd0051830 con 0x7f0de006c020 2023-11-28T19:59:42.876 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:42.871+0000 7f0de578d640 1 -- 172.21.15.78:0/1642302490 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0de006bd70 con 0x7f0de006c020 2023-11-28T19:59:42.878 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:42.871+0000 7f0dd7fff640 1 -- 172.21.15.78:0/1642302490 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+18322 (secure 0 0 0) 0x7f0dd0054e50 con 0x7f0de006c020 2023-11-28T19:59:42.878 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-11-28T19:59:42.878 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":25,"fsid":"dd9780e8-3bda-44fa-a9f0-fa07d19d901d","created":"2023-11-28T19:58:40.969556+0000","modified":"2023-11-28T19:59:10.474525+0000","last_up_change":"2023-11-28T19:58:52.596716+0000","last_in_change":"2023-11-28T19:58:43.609275+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-28T19:58:54.011229+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-28T19:59:03.945559+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-28T19:59:04.481478+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-11-28T19:59:08.109152+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"e84245ac-b5da-429e-af18-39acaa2b33e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6800","nonce":3358701235},{"type":"v1","addr":"172.21.15.78:6801","nonce":3358701235}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6802","nonce":3358701235},{"type":"v1","addr":"172.21.15.78:6803","nonce":3358701235}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6806","nonce":3358701235},{"type":"v1","addr":"172.21.15.78:6807","nonce":3358701235}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6804","nonce":3358701235},{"type":"v1","addr":"172.21.15.78:6805","nonce":3358701235}]},"public_addr":"172.21.15.78:6801/3358701235","cluster_addr":"172.21.15.78:6803/3358701235","heartbeat_back_addr":"172.21.15.78:6807/3358701235","heartbeat_front_addr":"172.21.15.78:6805/3358701235","state":["exists","up"]},{"osd":1,"uuid":"e634831d-c4e2-48d9-870c-9556ae162981","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6808","nonce":3211476654},{"type":"v1","addr":"172.21.15.78:6809","nonce":3211476654}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6810","nonce":3211476654},{"type":"v1","addr":"172.21.15.78:6811","nonce":3211476654}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6814","nonce":3211476654},{"type":"v1","addr":"172.21.15.78:6815","nonce":3211476654}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6812","nonce":3211476654},{"type":"v1","addr":"172.21.15.78:6813","nonce":3211476654}]},"public_addr":"172.21.15.78:6809/3211476654","cluster_addr":"172.21.15.78:6811/3211476654","heartbeat_back_addr":"172.21.15.78:6815/3211476654","heartbeat_front_addr":"172.21.15.78:6813/3211476654","state":["exists","up"]},{"osd":2,"uuid":"274c8395-6534-41f0-b8fb-a00af8985aa8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6816","nonce":2532904479},{"type":"v1","addr":"172.21.15.78:6817","nonce":2532904479}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6818","nonce":2532904479},{"type":"v1","addr":"172.21.15.78:6819","nonce":2532904479}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6822","nonce":2532904479},{"type":"v1","addr":"172.21.15.78:6823","nonce":2532904479}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6820","nonce":2532904479},{"type":"v1","addr":"172.21.15.78:6821","nonce":2532904479}]},"public_addr":"172.21.15.78:6817/2532904479","cluster_addr":"172.21.15.78:6819/2532904479","heartbeat_back_addr":"172.21.15.78:6823/2532904479","heartbeat_front_addr":"172.21.15.78:6821/2532904479","state":["exists","up"]},{"osd":3,"uuid":"77acc9af-7d4d-4b18-8cf5-d62f5971b7c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6824","nonce":3442991267},{"type":"v1","addr":"172.21.15.78:6825","nonce":3442991267}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6826","nonce":3442991267},{"type":"v1","addr":"172.21.15.78:6827","nonce":3442991267}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6830","nonce":3442991267},{"type":"v1","addr":"172.21.15.78:6831","nonce":3442991267}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6828","nonce":3442991267},{"type":"v1","addr":"172.21.15.78:6829","nonce":3442991267}]},"public_addr":"172.21.15.78:6825/3442991267","cluster_addr":"172.21.15.78:6827/3442991267","heartbeat_back_addr":"172.21.15.78:6831/3442991267","heartbeat_front_addr":"172.21.15.78:6829/3442991267","state":["exists","up"]},{"osd":4,"uuid":"5c62bc66-6b34-4b7f-a66b-9a743969138c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":802983577},{"type":"v1","addr":"172.21.15.179:6809","nonce":802983577}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":802983577},{"type":"v1","addr":"172.21.15.179:6811","nonce":802983577}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":802983577},{"type":"v1","addr":"172.21.15.179:6815","nonce":802983577}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":802983577},{"type":"v1","addr":"172.21.15.179:6813","nonce":802983577}]},"public_addr":"172.21.15.179:6809/802983577","cluster_addr":"172.21.15.179:6811/802983577","heartbeat_back_addr":"172.21.15.179:6815/802983577","heartbeat_front_addr":"172.21.15.179:6813/802983577","state":["exists","up"]},{"osd":5,"uuid":"67db6d36-f684-4079-b0cd-82b4dd61461f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":518192887},{"type":"v1","addr":"172.21.15.179:6818","nonce":518192887}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":518192887},{"type":"v1","addr":"172.21.15.179:6822","nonce":518192887}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":518192887},{"type":"v1","addr":"172.21.15.179:6829","nonce":518192887}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6824","nonce":518192887},{"type":"v1","addr":"172.21.15.179:6826","nonce":518192887}]},"public_addr":"172.21.15.179:6818/518192887","cluster_addr":"172.21.15.179:6822/518192887","heartbeat_back_addr":"172.21.15.179:6829/518192887","heartbeat_front_addr":"172.21.15.179:6826/518192887","state":["exists","up"]},{"osd":6,"uuid":"12e670af-5a16-4c81-9f97-defa66cab967","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":815435378},{"type":"v1","addr":"172.21.15.179:6801","nonce":815435378}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":815435378},{"type":"v1","addr":"172.21.15.179:6803","nonce":815435378}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":815435378},{"type":"v1","addr":"172.21.15.179:6807","nonce":815435378}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":815435378},{"type":"v1","addr":"172.21.15.179:6805","nonce":815435378}]},"public_addr":"172.21.15.179:6801/815435378","cluster_addr":"172.21.15.179:6803/815435378","heartbeat_back_addr":"172.21.15.179:6807/815435378","heartbeat_front_addr":"172.21.15.179:6805/815435378","state":["exists","up"]},{"osd":7,"uuid":"fe630650-2eb3-49ad-8676-c341e6332eb1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6817","nonce":2848432339},{"type":"v1","addr":"172.21.15.179:6819","nonce":2848432339}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6821","nonce":2848432339},{"type":"v1","addr":"172.21.15.179:6823","nonce":2848432339}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":2848432339},{"type":"v1","addr":"172.21.15.179:6831","nonce":2848432339}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6825","nonce":2848432339},{"type":"v1","addr":"172.21.15.179:6827","nonce":2848432339}]},"public_addr":"172.21.15.179:6819/2848432339","cluster_addr":"172.21.15.179:6823/2848432339","heartbeat_back_addr":"172.21.15.179:6831/2848432339","heartbeat_front_addr":"172.21.15.179:6827/2848432339","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:58:49.255433+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:58:49.412880+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:58:49.559295+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:58:49.245237+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:58:49.184557+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:58:49.329851+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:58:49.366012+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:58:49.349604+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-28T19:59:42.880 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:42.875+0000 7f0de578d640 1 -- 172.21.15.78:0/1642302490 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f0dc0066470 msgr2=0x7f0dc0068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:42.880 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:42.875+0000 7f0de578d640 1 --2- 172.21.15.78:0/1642302490 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f0dc0066470 0x7f0dc0068930 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f0dc80ae000 tx=0x7f0dc8004ac0 comp rx=0 tx=0).stop 2023-11-28T19:59:42.880 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:42.875+0000 7f0de578d640 1 -- 172.21.15.78:0/1642302490 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0de006c020 msgr2=0x7f0de00a8a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:42.880 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:42.875+0000 7f0de578d640 1 --2- 172.21.15.78:0/1642302490 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0de006c020 0x7f0de00a8a00 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f0dd000d800 tx=0x7f0dd000dcc0 comp rx=0 tx=0).stop 2023-11-28T19:59:42.880 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:42.875+0000 7f0de578d640 1 -- 172.21.15.78:0/1642302490 shutdown_connections 2023-11-28T19:59:42.880 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:42.875+0000 7f0de578d640 1 --2- 172.21.15.78:0/1642302490 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f0dc0066470 0x7f0dc0068930 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:42.880 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:42.875+0000 7f0de578d640 1 --2- 172.21.15.78:0/1642302490 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0de00c3b80 0x7f0de015a5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:42.881 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:42.875+0000 7f0de578d640 1 --2- 172.21.15.78:0/1642302490 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0de006d2b0 0x7f0de00bf0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:42.881 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:42.875+0000 7f0de578d640 1 --2- 172.21.15.78:0/1642302490 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0de006c020 0x7f0de00a8a00 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:42.881 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:42.875+0000 7f0de578d640 1 -- 172.21.15.78:0/1642302490 >> 172.21.15.78:0/1642302490 conn(0x7f0de00a7810 msgr2=0x7f0de00a7bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T19:59:42.881 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:42.875+0000 7f0de578d640 1 -- 172.21.15.78:0/1642302490 shutdown_connections 2023-11-28T19:59:42.881 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:42.875+0000 7f0de578d640 1 -- 172.21.15.78:0/1642302490 wait complete. 2023-11-28T19:59:42.899 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-28T19:58:54.011229+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-28T19:59:03.945559+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-11-28T19:59:04.481478+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-11-28T19:59:08.109152+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-11-28T19:59:42.900 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-28T19:59:43.041 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:43.035+0000 7f0e83817640 1 Processor -- start 2023-11-28T19:59:43.042 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:43.035+0000 7f0e83817640 1 -- start start 2023-11-28T19:59:43.043 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:43.035+0000 7f0e83817640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f0e7c14f850 0x7f0e7c0aacf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:43.045 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:43.035+0000 7f0e83817640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0e7c152910 con 0x7f0e7c06d840 2023-11-28T19:59:43.046 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:43.035+0000 7f0e83817640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0e7c152bf0 con 0x7f0e7c14fc30 2023-11-28T19:59:43.046 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:43.035+0000 7f0e83817640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0e7c0c2240 con 0x7f0e7c14f850 2023-11-28T19:59:43.046 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:43.039+0000 7f0e81db4640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f0e7c06d840 0x7f0e7c0c43e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:60780/0 (socket says 172.21.15.78:60780) 2023-11-28T19:59:43.046 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:43.039+0000 7f0e81db4640 1 -- 172.21.15.78:0/2424602247 learned_addr learned my addr 172.21.15.78:0/2424602247 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-11-28T19:59:43.048 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:43.039+0000 7f0e815b3640 1 --2- 172.21.15.78:0/2424602247 >> v2:172.21.15.179:3300/0 conn(0x7f0e7c14f850 0x7f0e7c0aacf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:43.048 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:43.039+0000 7f0e73fff640 1 -- 172.21.15.78:0/2424602247 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2781188082 0 0) 0x7f0e7c152910 con 0x7f0e7c06d840 2023-11-28T19:59:43.048 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:43.039+0000 7f0e73fff640 1 -- 172.21.15.78:0/2424602247 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0e68003530 con 0x7f0e7c06d840 2023-11-28T19:59:43.048 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:43.039+0000 7f0e73fff640 1 -- 172.21.15.78:0/2424602247 <== mon.0 v1:172.21.15.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 260091420 0 0) 0x7f0e68003530 con 0x7f0e7c06d840 2023-11-28T19:59:43.048 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:43.039+0000 7f0e815b3640 1 -- 172.21.15.78:0/2424602247 >> v1:172.21.15.179:6789/0 conn(0x7f0e7c14fc30 legacy=0x7f0e7c0c3cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:43.049 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:43.039+0000 7f0e815b3640 1 -- 172.21.15.78:0/2424602247 >> v1:172.21.15.78:6789/0 conn(0x7f0e7c06d840 legacy=0x7f0e7c0c43e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:43.049 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:43.039+0000 7f0e815b3640 1 -- 172.21.15.78:0/2424602247 --> v2:172.21.15.179:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e7c152ed0 con 0x7f0e7c14f850 2023-11-28T19:59:43.049 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:43.039+0000 7f0e815b3640 1 --2- 172.21.15.78:0/2424602247 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0e7c14f850 0x7f0e7c0aacf0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f0e78009740 tx=0x7f0e7801c140 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b47c9ff5f1e3e56f server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:59:43.049 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:43.043+0000 7f0e73fff640 1 -- 172.21.15.78:0/2424602247 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e74001a00 con 0x7f0e7c14f850 2023-11-28T19:59:43.049 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:43.043+0000 7f0e73fff640 1 -- 172.21.15.78:0/2424602247 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e780a7050 con 0x7f0e7c14f850 2023-11-28T19:59:43.049 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:43.043+0000 7f0e73fff640 1 -- 172.21.15.78:0/2424602247 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e780ab620 con 0x7f0e7c14f850 2023-11-28T19:59:43.049 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:43.043+0000 7f0e83817640 1 -- 172.21.15.78:0/2424602247 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0e7c14f850 msgr2=0x7f0e7c0aacf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:43.049 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:43.043+0000 7f0e83817640 1 --2- 172.21.15.78:0/2424602247 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0e7c14f850 0x7f0e7c0aacf0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f0e78009740 tx=0x7f0e7801c140 comp rx=0 tx=0).stop 2023-11-28T19:59:43.050 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:43.043+0000 7f0e83817640 1 -- 172.21.15.78:0/2424602247 shutdown_connections 2023-11-28T19:59:43.050 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:43.043+0000 7f0e83817640 1 --2- 172.21.15.78:0/2424602247 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0e7c14f850 0x7f0e7c0aacf0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:43.050 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:43.043+0000 7f0e83817640 1 -- 172.21.15.78:0/2424602247 >> 172.21.15.78:0/2424602247 conn(0x7f0e7c0c59f0 msgr2=0x7f0e7c0c5e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T19:59:43.050 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:43.043+0000 7f0e83817640 1 -- 172.21.15.78:0/2424602247 shutdown_connections 2023-11-28T19:59:43.050 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:43.043+0000 7f0e83817640 1 -- 172.21.15.78:0/2424602247 wait complete. 2023-11-28T19:59:43.052 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:43.043+0000 7f0e83817640 1 Processor -- start 2023-11-28T19:59:43.052 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:43.043+0000 7f0e83817640 1 -- start start 2023-11-28T19:59:43.052 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:43.043+0000 7f0e83817640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0e7c06d840 0x7f0e7c070d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:43.052 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:43.043+0000 7f0e83817640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0e7c14f850 0x7f0e7c0c04d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:43.052 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:43.043+0000 7f0e83817640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0e7c14fc30 0x7f0e7c1f1540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:43.053 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:43.043+0000 7f0e83817640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e7c1f1120 con 0x7f0e7c14fc30 2023-11-28T19:59:43.053 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:43.043+0000 7f0e83817640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e7c1543f0 con 0x7f0e7c14f850 2023-11-28T19:59:43.053 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:43.043+0000 7f0e83817640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e7c1546d0 con 0x7f0e7c06d840 2023-11-28T19:59:43.053 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:43.043+0000 7f0e81db4640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0e7c14fc30 0x7f0e7c1f1540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:43.053 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:43.043+0000 7f0e81db4640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0e7c14fc30 0x7f0e7c1f1540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:37158/0 (socket says 172.21.15.78:37158) 2023-11-28T19:59:43.053 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:43.043+0000 7f0e81db4640 1 -- 172.21.15.78:0/989478925 learned_addr learned my addr 172.21.15.78:0/989478925 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T19:59:43.053 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:43.047+0000 7f0e815b3640 1 --2- 172.21.15.78:0/989478925 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0e7c06d840 0x7f0e7c070d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:43.053 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:43.047+0000 7f0e80db2640 1 --2- 172.21.15.78:0/989478925 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0e7c14f850 0x7f0e7c0c04d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:43.053 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:43.047+0000 7f0e81db4640 1 -- 172.21.15.78:0/989478925 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0e7c06d840 msgr2=0x7f0e7c070d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:43.053 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:43.047+0000 7f0e81db4640 1 --2- 172.21.15.78:0/989478925 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0e7c06d840 0x7f0e7c070d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:43.053 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:43.047+0000 7f0e81db4640 1 -- 172.21.15.78:0/989478925 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0e7c14f850 msgr2=0x7f0e7c0c04d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:43.054 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:43.047+0000 7f0e81db4640 1 --2- 172.21.15.78:0/989478925 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0e7c14f850 0x7f0e7c0c04d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:43.054 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:43.047+0000 7f0e81db4640 1 -- 172.21.15.78:0/989478925 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e78009420 con 0x7f0e7c14fc30 2023-11-28T19:59:43.054 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:43.047+0000 7f0e80db2640 1 --2- 172.21.15.78:0/989478925 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0e7c14f850 0x7f0e7c0c04d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T19:59:43.054 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:43.047+0000 7f0e81db4640 1 --2- 172.21.15.78:0/989478925 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0e7c14fc30 0x7f0e7c1f1540 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f0e7400caf0 tx=0x7f0e74002110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:59:43.054 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:43.047+0000 7f0e71ffb640 1 -- 172.21.15.78:0/989478925 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e7400a730 con 0x7f0e7c14fc30 2023-11-28T19:59:43.054 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:43.047+0000 7f0e71ffb640 1 -- 172.21.15.78:0/989478925 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e7400a8b0 con 0x7f0e7c14fc30 2023-11-28T19:59:43.054 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:43.047+0000 7f0e71ffb640 1 -- 172.21.15.78:0/989478925 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e7400ac60 con 0x7f0e7c14fc30 2023-11-28T19:59:43.054 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:43.047+0000 7f0e83817640 1 -- 172.21.15.78:0/989478925 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0e7c1f0d40 con 0x7f0e7c14fc30 2023-11-28T19:59:43.054 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:43.047+0000 7f0e83817640 1 -- 172.21.15.78:0/989478925 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0e7c1f1a80 con 0x7f0e7c14fc30 2023-11-28T19:59:43.055 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:43.047+0000 7f0e83817640 1 -- 172.21.15.78:0/989478925 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0e7c1f1260 con 0x7f0e7c14fc30 2023-11-28T19:59:43.055 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:43.047+0000 7f0e71ffb640 1 -- 172.21.15.78:0/989478925 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f0e740070d0 con 0x7f0e7c14fc30 2023-11-28T19:59:43.055 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:43.047+0000 7f0e71ffb640 1 --2- 172.21.15.78:0/989478925 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f0e60066470 0x7f0e60068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:43.055 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:43.047+0000 7f0e71ffb640 1 -- 172.21.15.78:0/989478925 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f0e740837f0 con 0x7f0e7c14fc30 2023-11-28T19:59:43.055 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:43.051+0000 7f0e815b3640 1 --2- 172.21.15.78:0/989478925 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f0e60066470 0x7f0e60068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:43.056 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:43.051+0000 7f0e815b3640 1 --2- 172.21.15.78:0/989478925 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f0e60066470 0x7f0e60068930 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f0e780ad000 tx=0x7f0e780a6000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:59:43.058 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:43.051+0000 7f0e71ffb640 1 -- 172.21.15.78:0/989478925 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f0e7c1f1260 con 0x7f0e7c14fc30 2023-11-28T19:59:43.209 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:43.203+0000 7f0e83817640 1 -- 172.21.15.78:0/989478925 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f0e7c1f1260 con 0x7f0e7c14fc30 2023-11-28T19:59:43.210 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:43.203+0000 7f0e71ffb640 1 -- 172.21.15.78:0/989478925 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v25) v1 ==== 93+0+10 (secure 0 0 0) 0x7f0e74018020 con 0x7f0e7c14fc30 2023-11-28T19:59:43.210 INFO:teuthology.orchestra.run.smithi078.stdout:pg_num: 1 2023-11-28T19:59:43.212 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:43.207+0000 7f0e83817640 1 -- 172.21.15.78:0/989478925 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f0e60066470 msgr2=0x7f0e60068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:43.212 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:43.207+0000 7f0e83817640 1 --2- 172.21.15.78:0/989478925 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f0e60066470 0x7f0e60068930 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f0e780ad000 tx=0x7f0e780a6000 comp rx=0 tx=0).stop 2023-11-28T19:59:43.212 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:43.207+0000 7f0e83817640 1 -- 172.21.15.78:0/989478925 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0e7c14fc30 msgr2=0x7f0e7c1f1540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:43.212 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:43.207+0000 7f0e83817640 1 --2- 172.21.15.78:0/989478925 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0e7c14fc30 0x7f0e7c1f1540 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f0e7400caf0 tx=0x7f0e74002110 comp rx=0 tx=0).stop 2023-11-28T19:59:43.212 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:43.207+0000 7f0e83817640 1 -- 172.21.15.78:0/989478925 shutdown_connections 2023-11-28T19:59:43.213 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:43.207+0000 7f0e83817640 1 --2- 172.21.15.78:0/989478925 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f0e60066470 0x7f0e60068930 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:43.213 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:43.207+0000 7f0e83817640 1 --2- 172.21.15.78:0/989478925 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0e7c14fc30 0x7f0e7c1f1540 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:43.213 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:43.207+0000 7f0e83817640 1 --2- 172.21.15.78:0/989478925 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0e7c14f850 0x7f0e7c0c04d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:43.213 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:43.207+0000 7f0e83817640 1 --2- 172.21.15.78:0/989478925 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0e7c06d840 0x7f0e7c070d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:43.213 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:43.207+0000 7f0e83817640 1 -- 172.21.15.78:0/989478925 >> 172.21.15.78:0/989478925 conn(0x7f0e7c0c59f0 msgr2=0x7f0e7c0bf670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T19:59:43.213 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:43.207+0000 7f0e83817640 1 -- 172.21.15.78:0/989478925 shutdown_connections 2023-11-28T19:59:43.213 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:43.207+0000 7f0e83817640 1 -- 172.21.15.78:0/989478925 wait complete. 2023-11-28T19:59:43.231 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-28T19:59:43.371 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:43.363+0000 7f4d33c5f640 1 Processor -- start 2023-11-28T19:59:43.371 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:43.367+0000 7f4d33c5f640 1 -- start start 2023-11-28T19:59:43.374 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:43.367+0000 7f4d33c5f640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f4d2c159c40 0x7f4d2c15c030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:43.374 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:43.367+0000 7f4d33c5f640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4d2c0a4e20 con 0x7f4d2c0c5300 2023-11-28T19:59:43.374 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:43.367+0000 7f4d33c5f640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4d2c0a50e0 con 0x7f4d2c14b1e0 2023-11-28T19:59:43.375 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:43.367+0000 7f4d33c5f640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4d2c1558d0 con 0x7f4d2c159c40 2023-11-28T19:59:43.375 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:43.367+0000 7f4d311fa640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f4d2c0c5300 0x7f4d2c0a9c30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:60782/0 (socket says 172.21.15.78:60782) 2023-11-28T19:59:43.375 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:43.367+0000 7f4d311fa640 1 -- 172.21.15.78:0/637697903 learned_addr learned my addr 172.21.15.78:0/637697903 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-11-28T19:59:43.375 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:43.367+0000 7f4d321fc640 1 --2- 172.21.15.78:0/637697903 >> v2:172.21.15.179:3300/0 conn(0x7f4d2c159c40 0x7f4d2c15c030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:43.375 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:43.367+0000 7f4d309f9640 1 -- 172.21.15.78:0/637697903 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3438558833 0 0) 0x7f4d2c0a4e20 con 0x7f4d2c0c5300 2023-11-28T19:59:43.376 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:43.367+0000 7f4d309f9640 1 -- 172.21.15.78:0/637697903 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4d18003530 con 0x7f4d2c0c5300 2023-11-28T19:59:43.376 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:43.367+0000 7f4d309f9640 1 -- 172.21.15.78:0/637697903 <== mon.0 v1:172.21.15.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2561868678 0 0) 0x7f4d18003530 con 0x7f4d2c0c5300 2023-11-28T19:59:43.376 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:43.367+0000 7f4d309f9640 1 -- 172.21.15.78:0/637697903 >> v2:172.21.15.179:3300/0 conn(0x7f4d2c159c40 msgr2=0x7f4d2c15c030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T19:59:43.376 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:43.367+0000 7f4d309f9640 1 --2- 172.21.15.78:0/637697903 >> v2:172.21.15.179:3300/0 conn(0x7f4d2c159c40 0x7f4d2c15c030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:43.376 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:43.367+0000 7f4d309f9640 1 -- 172.21.15.78:0/637697903 >> v1:172.21.15.179:6789/0 conn(0x7f4d2c14b1e0 legacy=0x7f4d2c0c1700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:43.376 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:43.367+0000 7f4d309f9640 1 -- 172.21.15.78:0/637697903 --> v1:172.21.15.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d2c0c0f00 con 0x7f4d2c0c5300 2023-11-28T19:59:43.376 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:43.367+0000 7f4d309f9640 1 -- 172.21.15.78:0/637697903 <== mon.0 v1:172.21.15.78:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3326804700 0 0) 0x7f4d1c001680 con 0x7f4d2c0c5300 2023-11-28T19:59:43.376 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:43.367+0000 7f4d309f9640 1 -- 172.21.15.78:0/637697903 >> v1:172.21.15.78:6789/0 conn(0x7f4d2c0c5300 legacy=0x7f4d2c0a9c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:43.376 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:43.367+0000 7f4d309f9640 1 --2- 172.21.15.78:0/637697903 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4d18003980 0x7f4d18003d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:43.376 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:43.367+0000 7f4d309f9640 1 --2- 172.21.15.78:0/637697903 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4d180043a0 0x7f4d18004870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:43.377 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:43.367+0000 7f4d309f9640 1 --2- 172.21.15.78:0/637697903 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4d18005070 0x7f4d1800b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:43.377 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:43.367+0000 7f4d309f9640 1 -- 172.21.15.78:0/637697903 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d2c1558d0 con 0x7f4d18005070 2023-11-28T19:59:43.377 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:43.367+0000 7f4d309f9640 1 -- 172.21.15.78:0/637697903 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d1800bfb0 con 0x7f4d18003980 2023-11-28T19:59:43.377 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:43.367+0000 7f4d309f9640 1 -- 172.21.15.78:0/637697903 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d1800c170 con 0x7f4d180043a0 2023-11-28T19:59:43.377 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:43.367+0000 7f4d321fc640 1 --2- 172.21.15.78:0/637697903 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4d18005070 0x7f4d1800b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:43.377 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:43.367+0000 7f4d319fb640 1 --2- 172.21.15.78:0/637697903 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4d18003980 0x7f4d18003d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:43.377 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:43.367+0000 7f4d311fa640 1 --2- 172.21.15.78:0/637697903 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4d180043a0 0x7f4d18004870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:43.377 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:43.367+0000 7f4d321fc640 1 -- 172.21.15.78:0/637697903 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4d180043a0 msgr2=0x7f4d18004870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T19:59:43.377 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:43.367+0000 7f4d321fc640 1 --2- 172.21.15.78:0/637697903 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4d180043a0 0x7f4d18004870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:43.377 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:43.367+0000 7f4d321fc640 1 -- 172.21.15.78:0/637697903 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4d18003980 msgr2=0x7f4d18003d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T19:59:43.377 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:43.367+0000 7f4d321fc640 1 --2- 172.21.15.78:0/637697903 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4d18003980 0x7f4d18003d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:43.377 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:43.367+0000 7f4d321fc640 1 -- 172.21.15.78:0/637697903 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d18003530 con 0x7f4d18005070 2023-11-28T19:59:43.378 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:43.367+0000 7f4d311fa640 1 --2- 172.21.15.78:0/637697903 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4d180043a0 0x7f4d18004870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T19:59:43.379 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:43.371+0000 7f4d321fc640 1 -- 172.21.15.78:0/637697903 reap_dead start 2023-11-28T19:59:43.379 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:43.371+0000 7f4d321fc640 1 --2- 172.21.15.78:0/637697903 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4d18005070 0x7f4d1800b990 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f4d24009f90 tx=0x7f4d2401cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4095d6f858525488 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:59:43.379 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:43.371+0000 7f4d309f9640 1 -- 172.21.15.78:0/637697903 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d240a5c70 con 0x7f4d18005070 2023-11-28T19:59:43.379 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:43.371+0000 7f4d309f9640 1 -- 172.21.15.78:0/637697903 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d2400f040 con 0x7f4d18005070 2023-11-28T19:59:43.379 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:43.371+0000 7f4d309f9640 1 -- 172.21.15.78:0/637697903 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d240039a0 con 0x7f4d18005070 2023-11-28T19:59:43.379 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:43.371+0000 7f4d33c5f640 1 -- 172.21.15.78:0/637697903 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4d18005070 msgr2=0x7f4d1800b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:43.379 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:43.371+0000 7f4d33c5f640 1 --2- 172.21.15.78:0/637697903 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4d18005070 0x7f4d1800b990 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f4d24009f90 tx=0x7f4d2401cc60 comp rx=0 tx=0).stop 2023-11-28T19:59:43.380 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:43.371+0000 7f4d33c5f640 1 -- 172.21.15.78:0/637697903 shutdown_connections 2023-11-28T19:59:43.380 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:43.371+0000 7f4d33c5f640 1 --2- 172.21.15.78:0/637697903 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4d18005070 0x7f4d1800b990 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:43.380 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:43.371+0000 7f4d33c5f640 1 -- 172.21.15.78:0/637697903 >> 172.21.15.78:0/637697903 conn(0x7f4d2c0c59f0 msgr2=0x7f4d2c0c5e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T19:59:43.380 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:43.371+0000 7f4d33c5f640 1 -- 172.21.15.78:0/637697903 shutdown_connections 2023-11-28T19:59:43.380 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:43.371+0000 7f4d33c5f640 1 -- 172.21.15.78:0/637697903 wait complete. 2023-11-28T19:59:43.382 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:43.375+0000 7f4d33c5f640 1 Processor -- start 2023-11-28T19:59:43.382 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:43.375+0000 7f4d33c5f640 1 -- start start 2023-11-28T19:59:43.383 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:43.375+0000 7f4d33c5f640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4d18005070 0x7f4d2c0befc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:43.383 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:43.375+0000 7f4d33c5f640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4d2c1400f0 0x7f4d2c13f4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:43.383 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:43.375+0000 7f4d33c5f640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4d2c13f9e0 0x7f4d2c1eaa20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:43.383 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:43.375+0000 7f4d33c5f640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d2c071b00 con 0x7f4d18005070 2023-11-28T19:59:43.383 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:43.375+0000 7f4d33c5f640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d2c070840 con 0x7f4d2c1400f0 2023-11-28T19:59:43.383 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:43.375+0000 7f4d33c5f640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d2c070b20 con 0x7f4d2c13f9e0 2023-11-28T19:59:43.384 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:43.375+0000 7f4d319fb640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4d18005070 0x7f4d2c0befc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:43.384 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:43.375+0000 7f4d319fb640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4d18005070 0x7f4d2c0befc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:37178/0 (socket says 172.21.15.78:37178) 2023-11-28T19:59:43.384 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:43.375+0000 7f4d319fb640 1 -- 172.21.15.78:0/3658897080 learned_addr learned my addr 172.21.15.78:0/3658897080 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T19:59:43.384 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:43.375+0000 7f4d311fa640 1 --2- 172.21.15.78:0/3658897080 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4d2c1400f0 0x7f4d2c13f4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:43.384 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:43.375+0000 7f4d321fc640 1 --2- 172.21.15.78:0/3658897080 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4d2c13f9e0 0x7f4d2c1eaa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:43.384 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:43.375+0000 7f4d319fb640 1 -- 172.21.15.78:0/3658897080 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4d2c13f9e0 msgr2=0x7f4d2c1eaa20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:43.384 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:43.375+0000 7f4d319fb640 1 --2- 172.21.15.78:0/3658897080 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4d2c13f9e0 0x7f4d2c1eaa20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:43.384 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:43.375+0000 7f4d319fb640 1 -- 172.21.15.78:0/3658897080 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4d2c1400f0 msgr2=0x7f4d2c13f4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:43.384 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:43.375+0000 7f4d319fb640 1 --2- 172.21.15.78:0/3658897080 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4d2c1400f0 0x7f4d2c13f4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:43.384 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:43.375+0000 7f4d319fb640 1 -- 172.21.15.78:0/3658897080 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d2c070e00 con 0x7f4d18005070 2023-11-28T19:59:43.385 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:43.375+0000 7f4d319fb640 1 --2- 172.21.15.78:0/3658897080 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4d18005070 0x7f4d2c0befc0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f4d2800f7f0 tx=0x7f4d2800fcb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:59:43.385 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:43.375+0000 7f4d227fc640 1 -- 172.21.15.78:0/3658897080 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d2800fea0 con 0x7f4d18005070 2023-11-28T19:59:43.385 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:43.375+0000 7f4d227fc640 1 -- 172.21.15.78:0/3658897080 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d280052e0 con 0x7f4d18005070 2023-11-28T19:59:43.385 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:43.375+0000 7f4d227fc640 1 -- 172.21.15.78:0/3658897080 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d2800d970 con 0x7f4d18005070 2023-11-28T19:59:43.385 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:43.375+0000 7f4d33c5f640 1 -- 172.21.15.78:0/3658897080 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4d2c0710e0 con 0x7f4d18005070 2023-11-28T19:59:43.385 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:43.375+0000 7f4d33c5f640 1 -- 172.21.15.78:0/3658897080 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4d2c0bfab0 con 0x7f4d18005070 2023-11-28T19:59:43.385 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:43.375+0000 7f4d33c5f640 1 -- 172.21.15.78:0/3658897080 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4d2c067630 con 0x7f4d18005070 2023-11-28T19:59:43.386 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:43.379+0000 7f4d227fc640 1 -- 172.21.15.78:0/3658897080 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f4d2800dad0 con 0x7f4d18005070 2023-11-28T19:59:43.386 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:43.379+0000 7f4d227fc640 1 --2- 172.21.15.78:0/3658897080 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f4d100664a0 0x7f4d10068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:43.386 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:43.379+0000 7f4d227fc640 1 -- 172.21.15.78:0/3658897080 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f4d28084220 con 0x7f4d18005070 2023-11-28T19:59:43.387 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:43.379+0000 7f4d311fa640 1 --2- 172.21.15.78:0/3658897080 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f4d100664a0 0x7f4d10068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:43.387 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:43.379+0000 7f4d311fa640 1 --2- 172.21.15.78:0/3658897080 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f4d100664a0 0x7f4d10068960 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f4d1c001020 tx=0x7f4d1c009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:59:43.388 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:43.383+0000 7f4d227fc640 1 -- 172.21.15.78:0/3658897080 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f4d28051280 con 0x7f4d18005070 2023-11-28T19:59:43.537 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:43.531+0000 7f4d33c5f640 1 -- 172.21.15.78:0/3658897080 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f4d2c0ab2e0 con 0x7f4d18005070 2023-11-28T19:59:43.537 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:43.531+0000 7f4d227fc640 1 -- 172.21.15.78:0/3658897080 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v25) v1 ==== 104+0+11 (secure 0 0 0) 0x7f4d280548a0 con 0x7f4d18005070 2023-11-28T19:59:43.538 INFO:teuthology.orchestra.run.smithi078.stdout:pg_num: 32 2023-11-28T19:59:43.540 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:43.535+0000 7f4d33c5f640 1 -- 172.21.15.78:0/3658897080 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f4d100664a0 msgr2=0x7f4d10068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:43.540 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:43.535+0000 7f4d33c5f640 1 --2- 172.21.15.78:0/3658897080 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f4d100664a0 0x7f4d10068960 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f4d1c001020 tx=0x7f4d1c009040 comp rx=0 tx=0).stop 2023-11-28T19:59:43.540 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:43.535+0000 7f4d33c5f640 1 -- 172.21.15.78:0/3658897080 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4d18005070 msgr2=0x7f4d2c0befc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:43.540 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:43.535+0000 7f4d33c5f640 1 --2- 172.21.15.78:0/3658897080 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4d18005070 0x7f4d2c0befc0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f4d2800f7f0 tx=0x7f4d2800fcb0 comp rx=0 tx=0).stop 2023-11-28T19:59:43.540 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:43.535+0000 7f4d33c5f640 1 -- 172.21.15.78:0/3658897080 shutdown_connections 2023-11-28T19:59:43.540 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:43.535+0000 7f4d33c5f640 1 --2- 172.21.15.78:0/3658897080 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f4d100664a0 0x7f4d10068960 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:43.540 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:43.535+0000 7f4d33c5f640 1 --2- 172.21.15.78:0/3658897080 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4d2c13f9e0 0x7f4d2c1eaa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:43.540 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:43.535+0000 7f4d33c5f640 1 --2- 172.21.15.78:0/3658897080 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4d2c1400f0 0x7f4d2c13f4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:43.540 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:43.535+0000 7f4d33c5f640 1 --2- 172.21.15.78:0/3658897080 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4d18005070 0x7f4d2c0befc0 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:43.541 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:43.535+0000 7f4d33c5f640 1 -- 172.21.15.78:0/3658897080 >> 172.21.15.78:0/3658897080 conn(0x7f4d2c0c59f0 msgr2=0x7f4d2c0c1700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T19:59:43.541 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:43.535+0000 7f4d33c5f640 1 -- 172.21.15.78:0/3658897080 shutdown_connections 2023-11-28T19:59:43.541 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:43.535+0000 7f4d33c5f640 1 -- 172.21.15.78:0/3658897080 wait complete. 2023-11-28T19:59:43.558 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-28T19:59:43.698 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:43.691+0000 7f4a52365640 1 Processor -- start 2023-11-28T19:59:43.698 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:43.691+0000 7f4a52365640 1 -- start start 2023-11-28T19:59:43.699 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:43.695+0000 7f4a52365640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4a4c14b1e0 0x7f4a4c0c1700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:43.699 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:43.695+0000 7f4a52365640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f4a4c0c5300 0x7f4a4c0a9c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:43.699 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:43.695+0000 7f4a52365640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4a4c0a4e20 con 0x7f4a4c151280 2023-11-28T19:59:43.699 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:43.695+0000 7f4a52365640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4a4c1558d0 con 0x7f4a4c0c5300 2023-11-28T19:59:43.699 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:43.695+0000 7f4a52365640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4a4c0a50e0 con 0x7f4a4c14b1e0 2023-11-28T19:59:43.700 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:43.695+0000 7f4a4bfff640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4a4c14b1e0 0x7f4a4c0c1700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:43.700 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:43.695+0000 7f4a4bfff640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4a4c14b1e0 0x7f4a4c0c1700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3301/0 says I am v2:172.21.15.78:40290/0 (socket says 172.21.15.78:40290) 2023-11-28T19:59:43.700 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:43.695+0000 7f4a4bfff640 1 -- 172.21.15.78:0/1320724769 learned_addr learned my addr 172.21.15.78:0/1320724769 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T19:59:43.700 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:43.695+0000 7f4a4b7fe640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f4a4c0c5300 0x7f4a4c0a9c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:43.700 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:43.695+0000 7f4a4bfff640 1 -- 172.21.15.78:0/1320724769 >> v2:172.21.15.179:3300/0 conn(0x7f4a4c0c5300 msgr2=0x7f4a4c0a9c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T19:59:43.700 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:43.695+0000 7f4a4bfff640 1 --2- 172.21.15.78:0/1320724769 >> v2:172.21.15.179:3300/0 conn(0x7f4a4c0c5300 0x7f4a4c0a9c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:43.701 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:43.695+0000 7f4a4bfff640 1 -- 172.21.15.78:0/1320724769 >> v1:172.21.15.179:6789/0 conn(0x7f4a4c151280 legacy=0x7f4a4c151710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:43.701 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:43.695+0000 7f4a4bfff640 1 -- 172.21.15.78:0/1320724769 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a4c0c0f00 con 0x7f4a4c14b1e0 2023-11-28T19:59:43.702 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:43.695+0000 7f4a4bfff640 1 --2- 172.21.15.78:0/1320724769 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4a4c14b1e0 0x7f4a4c0c1700 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f4a3c009870 tx=0x7f4a3c01e750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fd9b13f6aa0f00ac server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:59:43.703 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:43.699+0000 7f4a4affd640 1 -- 172.21.15.78:0/1320724769 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a3c0ab630 con 0x7f4a4c14b1e0 2023-11-28T19:59:43.703 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:43.699+0000 7f4a4affd640 1 -- 172.21.15.78:0/1320724769 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a3c0ab790 con 0x7f4a4c14b1e0 2023-11-28T19:59:43.703 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:43.699+0000 7f4a4affd640 1 -- 172.21.15.78:0/1320724769 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a3c0abb20 con 0x7f4a4c14b1e0 2023-11-28T19:59:43.704 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:43.699+0000 7f4a52365640 1 -- 172.21.15.78:0/1320724769 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4a4c14b1e0 msgr2=0x7f4a4c0c1700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:43.704 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:43.699+0000 7f4a52365640 1 --2- 172.21.15.78:0/1320724769 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4a4c14b1e0 0x7f4a4c0c1700 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f4a3c009870 tx=0x7f4a3c01e750 comp rx=0 tx=0).stop 2023-11-28T19:59:43.704 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:43.699+0000 7f4a52365640 1 -- 172.21.15.78:0/1320724769 shutdown_connections 2023-11-28T19:59:43.704 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:43.699+0000 7f4a52365640 1 --2- 172.21.15.78:0/1320724769 >> v2:172.21.15.179:3300/0 conn(0x7f4a4c0c5300 0x7f4a4c0a9c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:43.704 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:43.699+0000 7f4a52365640 1 --2- 172.21.15.78:0/1320724769 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4a4c14b1e0 0x7f4a4c0c1700 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:43.704 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:43.699+0000 7f4a52365640 1 -- 172.21.15.78:0/1320724769 >> 172.21.15.78:0/1320724769 conn(0x7f4a4c0c59f0 msgr2=0x7f4a4c0c5e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T19:59:43.704 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:43.699+0000 7f4a52365640 1 -- 172.21.15.78:0/1320724769 shutdown_connections 2023-11-28T19:59:43.705 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:43.699+0000 7f4a52365640 1 -- 172.21.15.78:0/1320724769 wait complete. 2023-11-28T19:59:43.705 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:43.699+0000 7f4a52365640 1 Processor -- start 2023-11-28T19:59:43.705 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:43.699+0000 7f4a52365640 1 -- start start 2023-11-28T19:59:43.707 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:43.699+0000 7f4a52365640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4a4c0c5300 0x7f4a4c1ed030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:43.708 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:43.699+0000 7f4a52365640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4a4c14b1e0 0x7f4a4c1e9ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:43.708 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:43.699+0000 7f4a52365640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4a4c151280 0x7f4a4c071980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:43.708 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:43.699+0000 7f4a52365640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a4c1e90b0 con 0x7f4a4c14b1e0 2023-11-28T19:59:43.708 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:43.699+0000 7f4a52365640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a4c0a6fa0 con 0x7f4a4c151280 2023-11-28T19:59:43.708 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:43.699+0000 7f4a52365640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4a4c1ed570 con 0x7f4a4c0c5300 2023-11-28T19:59:43.708 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:43.703+0000 7f4a4b7fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4a4c14b1e0 0x7f4a4c1e9ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:43.708 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:43.703+0000 7f4a4bfff640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4a4c0c5300 0x7f4a4c1ed030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:43.708 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:43.703+0000 7f4a4b7fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4a4c14b1e0 0x7f4a4c1e9ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:37190/0 (socket says 172.21.15.78:37190) 2023-11-28T19:59:43.708 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:43.703+0000 7f4a4b7fe640 1 -- 172.21.15.78:0/1837388114 learned_addr learned my addr 172.21.15.78:0/1837388114 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T19:59:43.708 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:43.703+0000 7f4a4bfff640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4a4c0c5300 0x7f4a4c1ed030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3301/0 says I am v2:172.21.15.78:40294/0 (socket says 172.21.15.78:40294) 2023-11-28T19:59:43.708 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:43.703+0000 7f4a50902640 1 --2- 172.21.15.78:0/1837388114 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4a4c151280 0x7f4a4c071980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:43.709 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:43.703+0000 7f4a4b7fe640 1 -- 172.21.15.78:0/1837388114 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4a4c0c5300 msgr2=0x7f4a4c1ed030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:43.709 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:43.703+0000 7f4a4b7fe640 1 --2- 172.21.15.78:0/1837388114 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4a4c0c5300 0x7f4a4c1ed030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:43.709 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:43.703+0000 7f4a4b7fe640 1 -- 172.21.15.78:0/1837388114 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4a4c151280 msgr2=0x7f4a4c071980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:43.709 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:43.703+0000 7f4a4b7fe640 1 --2- 172.21.15.78:0/1837388114 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4a4c151280 0x7f4a4c071980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:43.709 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:43.703+0000 7f4a4b7fe640 1 -- 172.21.15.78:0/1837388114 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a3c0094d0 con 0x7f4a4c14b1e0 2023-11-28T19:59:43.709 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:43.703+0000 7f4a4bfff640 1 --2- 172.21.15.78:0/1837388114 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4a4c0c5300 0x7f4a4c1ed030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T19:59:43.709 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:43.703+0000 7f4a4b7fe640 1 --2- 172.21.15.78:0/1837388114 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4a4c14b1e0 0x7f4a4c1e9ac0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f4a4000e900 tx=0x7f4a4000edc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:59:43.710 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:43.703+0000 7f4a48ff9640 1 -- 172.21.15.78:0/1837388114 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a40009690 con 0x7f4a4c14b1e0 2023-11-28T19:59:43.710 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:43.703+0000 7f4a48ff9640 1 -- 172.21.15.78:0/1837388114 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a4000c9a0 con 0x7f4a4c14b1e0 2023-11-28T19:59:43.710 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:43.703+0000 7f4a48ff9640 1 -- 172.21.15.78:0/1837388114 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a4000cd50 con 0x7f4a4c14b1e0 2023-11-28T19:59:43.710 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:43.703+0000 7f4a52365640 1 -- 172.21.15.78:0/1837388114 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4a4c1ea000 con 0x7f4a4c14b1e0 2023-11-28T19:59:43.710 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:43.703+0000 7f4a52365640 1 -- 172.21.15.78:0/1837388114 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4a4c071f20 con 0x7f4a4c14b1e0 2023-11-28T19:59:43.710 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:43.703+0000 7f4a52365640 1 -- 172.21.15.78:0/1837388114 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4a4c067630 con 0x7f4a4c14b1e0 2023-11-28T19:59:43.710 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:43.703+0000 7f4a48ff9640 1 -- 172.21.15.78:0/1837388114 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f4a40013470 con 0x7f4a4c14b1e0 2023-11-28T19:59:43.711 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:43.707+0000 7f4a48ff9640 1 --2- 172.21.15.78:0/1837388114 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f4a38066470 0x7f4a38068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:43.711 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:43.707+0000 7f4a48ff9640 1 -- 172.21.15.78:0/1837388114 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f4a40084250 con 0x7f4a4c14b1e0 2023-11-28T19:59:43.711 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:43.707+0000 7f4a4bfff640 1 --2- 172.21.15.78:0/1837388114 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f4a38066470 0x7f4a38068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:43.712 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:43.707+0000 7f4a4bfff640 1 --2- 172.21.15.78:0/1837388114 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f4a38066470 0x7f4a38068930 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f4a3c0b0000 tx=0x7f4a3c0b5040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:59:43.715 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:43.711+0000 7f4a48ff9640 1 -- 172.21.15.78:0/1837388114 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f4a40051480 con 0x7f4a4c14b1e0 2023-11-28T19:59:43.862 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:43.855+0000 7f4a52365640 1 -- 172.21.15.78:0/1837388114 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f4a4c0a9c20 con 0x7f4a4c14b1e0 2023-11-28T19:59:43.865 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:43.859+0000 7f4a48ff9640 1 -- 172.21.15.78:0/1837388114 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v25) v1 ==== 100+0+11 (secure 0 0 0) 0x7f4a40054aa0 con 0x7f4a4c14b1e0 2023-11-28T19:59:43.865 INFO:teuthology.orchestra.run.smithi078.stdout:pg_num: 64 2023-11-28T19:59:43.866 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:43.859+0000 7f4a52365640 1 -- 172.21.15.78:0/1837388114 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f4a38066470 msgr2=0x7f4a38068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:43.866 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:43.859+0000 7f4a52365640 1 --2- 172.21.15.78:0/1837388114 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f4a38066470 0x7f4a38068930 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f4a3c0b0000 tx=0x7f4a3c0b5040 comp rx=0 tx=0).stop 2023-11-28T19:59:43.866 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:43.859+0000 7f4a52365640 1 -- 172.21.15.78:0/1837388114 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4a4c14b1e0 msgr2=0x7f4a4c1e9ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:43.866 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:43.859+0000 7f4a52365640 1 --2- 172.21.15.78:0/1837388114 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4a4c14b1e0 0x7f4a4c1e9ac0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f4a4000e900 tx=0x7f4a4000edc0 comp rx=0 tx=0).stop 2023-11-28T19:59:43.866 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:43.859+0000 7f4a52365640 1 -- 172.21.15.78:0/1837388114 shutdown_connections 2023-11-28T19:59:43.866 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:43.859+0000 7f4a52365640 1 --2- 172.21.15.78:0/1837388114 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f4a38066470 0x7f4a38068930 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:43.866 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:43.859+0000 7f4a52365640 1 --2- 172.21.15.78:0/1837388114 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4a4c151280 0x7f4a4c071980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:43.867 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:43.859+0000 7f4a52365640 1 --2- 172.21.15.78:0/1837388114 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4a4c14b1e0 0x7f4a4c1e9ac0 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:43.867 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:43.859+0000 7f4a52365640 1 --2- 172.21.15.78:0/1837388114 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4a4c0c5300 0x7f4a4c1ed030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:43.867 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:43.859+0000 7f4a52365640 1 -- 172.21.15.78:0/1837388114 >> 172.21.15.78:0/1837388114 conn(0x7f4a4c0c59f0 msgr2=0x7f4a4c149cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T19:59:43.867 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:43.859+0000 7f4a52365640 1 -- 172.21.15.78:0/1837388114 shutdown_connections 2023-11-28T19:59:43.867 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:43.859+0000 7f4a52365640 1 -- 172.21.15.78:0/1837388114 wait complete. 2023-11-28T19:59:43.884 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-11-28T19:59:44.024 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:44.019+0000 7fb6f47df640 1 Processor -- start 2023-11-28T19:59:44.024 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:44.019+0000 7fb6f47df640 1 -- start start 2023-11-28T19:59:44.025 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:44.019+0000 7fb6f47df640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fb6ec14b1e0 0x7fb6ec0c1700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:44.026 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:44.019+0000 7fb6f47df640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb6ec0c5300 0x7fb6ec0a9c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:44.026 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:44.019+0000 7fb6f47df640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb6ec0a4e20 con 0x7fb6ec151280 2023-11-28T19:59:44.026 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:44.019+0000 7fb6f47df640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb6ec1558d0 con 0x7fb6ec14b1e0 2023-11-28T19:59:44.026 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:44.019+0000 7fb6f47df640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb6ec0a50e0 con 0x7fb6ec0c5300 2023-11-28T19:59:44.026 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:44.019+0000 7fb6f257b640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fb6ec14b1e0 0x7fb6ec0c1700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:44.026 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:44.019+0000 7fb6f2d7c640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7fb6ec151280 0x7fb6ec151710 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:60794/0 (socket says 172.21.15.78:60794) 2023-11-28T19:59:44.026 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:44.019+0000 7fb6f2d7c640 1 -- 172.21.15.78:0/3232821107 learned_addr learned my addr 172.21.15.78:0/3232821107 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-11-28T19:59:44.026 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:44.019+0000 7fb6f257b640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fb6ec14b1e0 0x7fb6ec0c1700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:37198/0 (socket says 172.21.15.78:37198) 2023-11-28T19:59:44.026 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:44.019+0000 7fb6f1d7a640 1 --2- 172.21.15.78:0/3232821107 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb6ec0c5300 0x7fb6ec0a9c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:44.027 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:44.019+0000 7fb6f257b640 1 -- 172.21.15.78:0/3232821107 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb6ec0c5300 msgr2=0x7fb6ec0a9c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T19:59:44.027 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:44.019+0000 7fb6f257b640 1 --2- 172.21.15.78:0/3232821107 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb6ec0c5300 0x7fb6ec0a9c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:44.027 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:44.019+0000 7fb6f257b640 1 -- 172.21.15.78:0/3232821107 >> v1:172.21.15.78:6789/0 conn(0x7fb6ec151280 legacy=0x7fb6ec151710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:44.027 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:44.019+0000 7fb6f257b640 1 -- 172.21.15.78:0/3232821107 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6ec0c0f00 con 0x7fb6ec14b1e0 2023-11-28T19:59:44.027 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:44.019+0000 7fb6f1579640 1 -- 172.21.15.78:0/3232821107 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1392788252 0 0) 0x7fb6ec0a4e20 con 0x7fb6ec151280 2023-11-28T19:59:44.028 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:44.023+0000 7fb6f257b640 1 --2- 172.21.15.78:0/3232821107 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb6ec14b1e0 0x7fb6ec0c1700 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fb6e800ba60 tx=0x7fb6e801eb50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4a174fb6d889027f server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:59:44.029 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:44.023+0000 7fb6f1579640 1 -- 172.21.15.78:0/3232821107 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6e80a7a30 con 0x7fb6ec14b1e0 2023-11-28T19:59:44.029 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:44.023+0000 7fb6f1579640 1 -- 172.21.15.78:0/3232821107 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb6e80a7b90 con 0x7fb6ec14b1e0 2023-11-28T19:59:44.029 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:44.023+0000 7fb6f1579640 1 -- 172.21.15.78:0/3232821107 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6e80af440 con 0x7fb6ec14b1e0 2023-11-28T19:59:44.031 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:44.023+0000 7fb6f47df640 1 -- 172.21.15.78:0/3232821107 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb6ec14b1e0 msgr2=0x7fb6ec0c1700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:44.031 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:44.023+0000 7fb6f47df640 1 --2- 172.21.15.78:0/3232821107 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb6ec14b1e0 0x7fb6ec0c1700 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fb6e800ba60 tx=0x7fb6e801eb50 comp rx=0 tx=0).stop 2023-11-28T19:59:44.031 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:44.023+0000 7fb6f47df640 1 -- 172.21.15.78:0/3232821107 shutdown_connections 2023-11-28T19:59:44.032 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:44.023+0000 7fb6f47df640 1 --2- 172.21.15.78:0/3232821107 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb6ec0c5300 0x7fb6ec0a9c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:44.032 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:44.023+0000 7fb6f47df640 1 --2- 172.21.15.78:0/3232821107 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb6ec14b1e0 0x7fb6ec0c1700 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:44.032 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:44.023+0000 7fb6f47df640 1 -- 172.21.15.78:0/3232821107 >> 172.21.15.78:0/3232821107 conn(0x7fb6ec0c59f0 msgr2=0x7fb6ec0c5e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T19:59:44.032 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:44.023+0000 7fb6f47df640 1 -- 172.21.15.78:0/3232821107 shutdown_connections 2023-11-28T19:59:44.032 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:44.023+0000 7fb6f47df640 1 -- 172.21.15.78:0/3232821107 wait complete. 2023-11-28T19:59:44.035 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:44.027+0000 7fb6f47df640 1 Processor -- start 2023-11-28T19:59:44.035 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:44.027+0000 7fb6f47df640 1 -- start start 2023-11-28T19:59:44.036 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:44.027+0000 7fb6f47df640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb6ec0c5300 0x7fb6ec1ecb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:44.036 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:44.027+0000 7fb6f47df640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb6ec14b1e0 0x7fb6ec1405c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:44.036 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:44.027+0000 7fb6f47df640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb6ec151280 0x7fb6ec1f0990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:44.036 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:44.027+0000 7fb6f47df640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6ec1ed0c0 con 0x7fb6ec14b1e0 2023-11-28T19:59:44.036 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:44.027+0000 7fb6f47df640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6ec1f0500 con 0x7fb6ec151280 2023-11-28T19:59:44.037 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:44.027+0000 7fb6f47df640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb6ec140000 con 0x7fb6ec0c5300 2023-11-28T19:59:44.037 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:44.027+0000 7fb6f1d7a640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb6ec14b1e0 0x7fb6ec1405c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:44.037 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:44.027+0000 7fb6f1d7a640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb6ec14b1e0 0x7fb6ec1405c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:37208/0 (socket says 172.21.15.78:37208) 2023-11-28T19:59:44.037 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:44.027+0000 7fb6f1d7a640 1 -- 172.21.15.78:0/1808139235 learned_addr learned my addr 172.21.15.78:0/1808139235 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T19:59:44.037 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:44.027+0000 7fb6f2d7c640 1 --2- 172.21.15.78:0/1808139235 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb6ec151280 0x7fb6ec1f0990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:44.038 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:44.027+0000 7fb6f257b640 1 --2- 172.21.15.78:0/1808139235 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb6ec0c5300 0x7fb6ec1ecb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:44.038 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:44.027+0000 7fb6f1d7a640 1 -- 172.21.15.78:0/1808139235 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb6ec0c5300 msgr2=0x7fb6ec1ecb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:44.038 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:44.027+0000 7fb6f1d7a640 1 --2- 172.21.15.78:0/1808139235 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb6ec0c5300 0x7fb6ec1ecb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:44.038 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:44.027+0000 7fb6f1d7a640 1 -- 172.21.15.78:0/1808139235 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb6ec151280 msgr2=0x7fb6ec1f0990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:44.038 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:44.027+0000 7fb6f1d7a640 1 --2- 172.21.15.78:0/1808139235 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb6ec151280 0x7fb6ec1f0990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:44.039 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:44.027+0000 7fb6f1d7a640 1 -- 172.21.15.78:0/1808139235 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6e800b6c0 con 0x7fb6ec14b1e0 2023-11-28T19:59:44.039 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:44.027+0000 7fb6f2d7c640 1 --2- 172.21.15.78:0/1808139235 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb6ec151280 0x7fb6ec1f0990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T19:59:44.039 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:44.027+0000 7fb6f1d7a640 1 --2- 172.21.15.78:0/1808139235 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb6ec14b1e0 0x7fb6ec1405c0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fb6dc00e900 tx=0x7fb6dc00edc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:59:44.039 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:44.027+0000 7fb6e2ffd640 1 -- 172.21.15.78:0/1808139235 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6dc009690 con 0x7fb6ec14b1e0 2023-11-28T19:59:44.039 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:44.027+0000 7fb6e2ffd640 1 -- 172.21.15.78:0/1808139235 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb6dc00ca00 con 0x7fb6ec14b1e0 2023-11-28T19:59:44.039 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:44.027+0000 7fb6f47df640 1 -- 172.21.15.78:0/1808139235 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb6ec1402e0 con 0x7fb6ec14b1e0 2023-11-28T19:59:44.040 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:44.027+0000 7fb6e2ffd640 1 -- 172.21.15.78:0/1808139235 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6dc00cdb0 con 0x7fb6ec14b1e0 2023-11-28T19:59:44.040 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:44.027+0000 7fb6f47df640 1 -- 172.21.15.78:0/1808139235 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb6ec140b00 con 0x7fb6ec14b1e0 2023-11-28T19:59:44.040 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:44.031+0000 7fb6f47df640 1 -- 172.21.15.78:0/1808139235 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb6ec1f0670 con 0x7fb6ec14b1e0 2023-11-28T19:59:44.041 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:44.031+0000 7fb6e2ffd640 1 -- 172.21.15.78:0/1808139235 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fb6dc013470 con 0x7fb6ec14b1e0 2023-11-28T19:59:44.041 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:44.035+0000 7fb6e2ffd640 1 --2- 172.21.15.78:0/1808139235 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fb6d00664a0 0x7fb6d0068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:44.041 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:44.035+0000 7fb6e2ffd640 1 -- 172.21.15.78:0/1808139235 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fb6dc084a70 con 0x7fb6ec14b1e0 2023-11-28T19:59:44.041 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:44.035+0000 7fb6f257b640 1 --2- 172.21.15.78:0/1808139235 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fb6d00664a0 0x7fb6d0068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:44.042 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:44.035+0000 7fb6f257b640 1 --2- 172.21.15.78:0/1808139235 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fb6d00664a0 0x7fb6d0068960 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fb6e80b1000 tx=0x7fb6e8008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:59:44.042 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:44.035+0000 7fb6e2ffd640 1 -- 172.21.15.78:0/1808139235 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fb6dc051ca0 con 0x7fb6ec14b1e0 2023-11-28T19:59:44.191 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:44.183+0000 7fb6f47df640 1 -- 172.21.15.78:0/1808139235 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7fb6ec067630 con 0x7fb6ec14b1e0 2023-11-28T19:59:44.191 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:44.187+0000 7fb6e2ffd640 1 -- 172.21.15.78:0/1808139235 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v25) v1 ==== 103+0+11 (secure 0 0 0) 0x7fb6dc021020 con 0x7fb6ec14b1e0 2023-11-28T19:59:44.191 INFO:teuthology.orchestra.run.smithi078.stdout:pg_num: 32 2023-11-28T19:59:44.193 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:44.187+0000 7fb6f47df640 1 -- 172.21.15.78:0/1808139235 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fb6d00664a0 msgr2=0x7fb6d0068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:44.193 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:44.187+0000 7fb6f47df640 1 --2- 172.21.15.78:0/1808139235 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fb6d00664a0 0x7fb6d0068960 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fb6e80b1000 tx=0x7fb6e8008040 comp rx=0 tx=0).stop 2023-11-28T19:59:44.193 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:44.187+0000 7fb6f47df640 1 -- 172.21.15.78:0/1808139235 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb6ec14b1e0 msgr2=0x7fb6ec1405c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:44.194 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:44.187+0000 7fb6f47df640 1 --2- 172.21.15.78:0/1808139235 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb6ec14b1e0 0x7fb6ec1405c0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fb6dc00e900 tx=0x7fb6dc00edc0 comp rx=0 tx=0).stop 2023-11-28T19:59:44.194 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:44.187+0000 7fb6f47df640 1 -- 172.21.15.78:0/1808139235 shutdown_connections 2023-11-28T19:59:44.194 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:44.187+0000 7fb6f47df640 1 --2- 172.21.15.78:0/1808139235 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fb6d00664a0 0x7fb6d0068960 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:44.194 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:44.187+0000 7fb6f47df640 1 --2- 172.21.15.78:0/1808139235 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb6ec151280 0x7fb6ec1f0990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:44.195 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:44.187+0000 7fb6f47df640 1 --2- 172.21.15.78:0/1808139235 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb6ec14b1e0 0x7fb6ec1405c0 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:44.195 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:44.187+0000 7fb6f47df640 1 --2- 172.21.15.78:0/1808139235 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb6ec0c5300 0x7fb6ec1ecb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:44.195 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:44.187+0000 7fb6f47df640 1 -- 172.21.15.78:0/1808139235 >> 172.21.15.78:0/1808139235 conn(0x7fb6ec0c59f0 msgr2=0x7fb6ec149c20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T19:59:44.195 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:44.187+0000 7fb6f47df640 1 -- 172.21.15.78:0/1808139235 shutdown_connections 2023-11-28T19:59:44.195 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:44.187+0000 7fb6f47df640 1 -- 172.21.15.78:0/1808139235 wait complete. 2023-11-28T19:59:44.212 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-28T19:59:44.350 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:44.343+0000 7f75e6632640 1 Processor -- start 2023-11-28T19:59:44.350 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:44.343+0000 7f75e6632640 1 -- start start 2023-11-28T19:59:44.351 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:44.347+0000 7f75e6632640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f75e0071e30 0x7f75e0072290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:44.351 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:44.347+0000 7f75e6632640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f75e0156110 0x7f75e01565a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:44.351 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:44.347+0000 7f75e6632640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f75e00c5710 con 0x7f75e014fd10 2023-11-28T19:59:44.351 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:44.347+0000 7f75e6632640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f75e006c5e0 con 0x7f75e0156110 2023-11-28T19:59:44.351 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:44.347+0000 7f75e6632640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f75e0155c80 con 0x7f75e0071e30 2023-11-28T19:59:44.352 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:44.347+0000 7f75dffff640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f75e014fd10 0x7f75e00a4dc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:60810/0 (socket says 172.21.15.78:60810) 2023-11-28T19:59:44.352 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:44.347+0000 7f75dffff640 1 -- 172.21.15.78:0/591679981 learned_addr learned my addr 172.21.15.78:0/591679981 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-11-28T19:59:44.353 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:44.347+0000 7f75e4bcf640 1 --2- 172.21.15.78:0/591679981 >> v2:172.21.15.179:3300/0 conn(0x7f75e0156110 0x7f75e01565a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:44.354 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:44.347+0000 7f75df7fe640 1 --2- 172.21.15.78:0/591679981 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f75e0071e30 0x7f75e0072290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:44.354 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:44.347+0000 7f75deffd640 1 -- 172.21.15.78:0/591679981 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4014974000 0 0) 0x7f75e00c5710 con 0x7f75e014fd10 2023-11-28T19:59:44.354 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:44.347+0000 7f75deffd640 1 -- 172.21.15.78:0/591679981 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f75c8003530 con 0x7f75e014fd10 2023-11-28T19:59:44.354 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:44.347+0000 7f75deffd640 1 -- 172.21.15.78:0/591679981 <== mon.0 v1:172.21.15.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3937823962 0 0) 0x7f75c8003530 con 0x7f75e014fd10 2023-11-28T19:59:44.354 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:44.347+0000 7f75deffd640 1 -- 172.21.15.78:0/591679981 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f75e0071e30 msgr2=0x7f75e0072290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T19:59:44.354 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:44.347+0000 7f75deffd640 1 --2- 172.21.15.78:0/591679981 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f75e0071e30 0x7f75e0072290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:44.354 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:44.347+0000 7f75deffd640 1 -- 172.21.15.78:0/591679981 >> v2:172.21.15.179:3300/0 conn(0x7f75e0156110 msgr2=0x7f75e01565a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T19:59:44.354 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:44.347+0000 7f75deffd640 1 --2- 172.21.15.78:0/591679981 >> v2:172.21.15.179:3300/0 conn(0x7f75e0156110 0x7f75e01565a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:44.354 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:44.347+0000 7f75deffd640 1 -- 172.21.15.78:0/591679981 --> v1:172.21.15.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75e00c4e70 con 0x7f75e014fd10 2023-11-28T19:59:44.354 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:44.347+0000 7f75deffd640 1 -- 172.21.15.78:0/591679981 <== mon.0 v1:172.21.15.78:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3326804700 0 0) 0x7f75d0001680 con 0x7f75e014fd10 2023-11-28T19:59:44.354 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:44.347+0000 7f75deffd640 1 -- 172.21.15.78:0/591679981 >> v1:172.21.15.78:6789/0 conn(0x7f75e014fd10 legacy=0x7f75e00a4dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:44.355 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:44.347+0000 7f75deffd640 1 --2- 172.21.15.78:0/591679981 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f75c8003980 0x7f75c8003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:44.355 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:44.347+0000 7f75deffd640 1 --2- 172.21.15.78:0/591679981 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f75e0071e30 0x7f75c80047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:44.355 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:44.347+0000 7f75deffd640 1 --2- 172.21.15.78:0/591679981 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f75c8004d10 0x7f75c8005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:44.355 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:44.347+0000 7f75deffd640 1 -- 172.21.15.78:0/591679981 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75e0155c80 con 0x7f75c8003980 2023-11-28T19:59:44.355 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:44.347+0000 7f75deffd640 1 -- 172.21.15.78:0/591679981 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75c800b990 con 0x7f75c8004d10 2023-11-28T19:59:44.355 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:44.347+0000 7f75deffd640 1 -- 172.21.15.78:0/591679981 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f75c800bb50 con 0x7f75e0071e30 2023-11-28T19:59:44.355 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:44.347+0000 7f75dffff640 1 --2- 172.21.15.78:0/591679981 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f75c8003980 0x7f75c8003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:44.355 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:44.347+0000 7f75df7fe640 1 --2- 172.21.15.78:0/591679981 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f75e0071e30 0x7f75c80047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:44.355 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:44.347+0000 7f75e4bcf640 1 --2- 172.21.15.78:0/591679981 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f75c8004d10 0x7f75c8005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:44.355 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:44.347+0000 7f75dffff640 1 -- 172.21.15.78:0/591679981 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f75e0071e30 msgr2=0x7f75c80047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T19:59:44.355 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:44.347+0000 7f75dffff640 1 --2- 172.21.15.78:0/591679981 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f75e0071e30 0x7f75c80047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:44.355 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:44.347+0000 7f75dffff640 1 -- 172.21.15.78:0/591679981 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f75c8004d10 msgr2=0x7f75c8005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T19:59:44.356 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:44.347+0000 7f75dffff640 1 --2- 172.21.15.78:0/591679981 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f75c8004d10 0x7f75c8005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:44.356 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:44.347+0000 7f75dffff640 1 -- 172.21.15.78:0/591679981 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75c8003530 con 0x7f75c8003980 2023-11-28T19:59:44.357 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:44.351+0000 7f75dffff640 1 --2- 172.21.15.78:0/591679981 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f75c8003980 0x7f75c8003da0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f75d000c240 tx=0x7f75d001cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1e9428c027aeaa2a server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:59:44.357 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:44.351+0000 7f75deffd640 1 -- 172.21.15.78:0/591679981 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75d00a5930 con 0x7f75c8003980 2023-11-28T19:59:44.357 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:44.351+0000 7f75deffd640 1 -- 172.21.15.78:0/591679981 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f75d00a5a90 con 0x7f75c8003980 2023-11-28T19:59:44.357 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:44.351+0000 7f75deffd640 1 -- 172.21.15.78:0/591679981 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75d00a5e60 con 0x7f75c8003980 2023-11-28T19:59:44.357 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:44.351+0000 7f75e6632640 1 -- 172.21.15.78:0/591679981 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f75c8003980 msgr2=0x7f75c8003da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:44.357 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:44.351+0000 7f75e6632640 1 --2- 172.21.15.78:0/591679981 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f75c8003980 0x7f75c8003da0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f75d000c240 tx=0x7f75d001cc30 comp rx=0 tx=0).stop 2023-11-28T19:59:44.357 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:44.351+0000 7f75e4bcf640 1 -- 172.21.15.78:0/591679981 reap_dead start 2023-11-28T19:59:44.357 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:44.351+0000 7f75e6632640 1 -- 172.21.15.78:0/591679981 shutdown_connections 2023-11-28T19:59:44.357 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:44.351+0000 7f75e6632640 1 -- 172.21.15.78:0/591679981 >> 172.21.15.78:0/591679981 conn(0x7f75e00a7810 msgr2=0x7f75e00a7c20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T19:59:44.357 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:44.351+0000 7f75e6632640 1 -- 172.21.15.78:0/591679981 shutdown_connections 2023-11-28T19:59:44.358 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:44.351+0000 7f75e6632640 1 -- 172.21.15.78:0/591679981 wait complete. 2023-11-28T19:59:44.358 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:44.351+0000 7f75e6632640 1 Processor -- start 2023-11-28T19:59:44.358 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:44.351+0000 7f75e6632640 1 -- start start 2023-11-28T19:59:44.360 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:44.355+0000 7f75e6632640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f75c8003980 0x7f75e014d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:44.360 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:44.355+0000 7f75e6632640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f75e00a7300 0x7f75e0149c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:44.360 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:44.355+0000 7f75e6632640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f75e006fc20 0x7f75e014a140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:44.360 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:44.355+0000 7f75e6632640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75e00aa5c0 con 0x7f75e006fc20 2023-11-28T19:59:44.361 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:44.355+0000 7f75e6632640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75e00a9160 con 0x7f75e00a7300 2023-11-28T19:59:44.361 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:44.355+0000 7f75e6632640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f75e01f1390 con 0x7f75c8003980 2023-11-28T19:59:44.361 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:44.355+0000 7f75e4bcf640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f75e006fc20 0x7f75e014a140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:44.361 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:44.355+0000 7f75e4bcf640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f75e006fc20 0x7f75e014a140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:37228/0 (socket says 172.21.15.78:37228) 2023-11-28T19:59:44.361 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:44.355+0000 7f75e4bcf640 1 -- 172.21.15.78:0/2938181967 learned_addr learned my addr 172.21.15.78:0/2938181967 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T19:59:44.361 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:44.355+0000 7f75dffff640 1 --2- 172.21.15.78:0/2938181967 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f75c8003980 0x7f75e014d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:44.361 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:44.355+0000 7f75df7fe640 1 --2- 172.21.15.78:0/2938181967 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f75e00a7300 0x7f75e0149c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:44.361 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:44.355+0000 7f75e4bcf640 1 -- 172.21.15.78:0/2938181967 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f75c8003980 msgr2=0x7f75e014d1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:44.361 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:44.355+0000 7f75e4bcf640 1 --2- 172.21.15.78:0/2938181967 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f75c8003980 0x7f75e014d1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:44.361 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:44.355+0000 7f75e4bcf640 1 -- 172.21.15.78:0/2938181967 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f75e00a7300 msgr2=0x7f75e0149c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:44.361 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:44.355+0000 7f75e4bcf640 1 --2- 172.21.15.78:0/2938181967 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f75e00a7300 0x7f75e0149c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:44.361 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:44.355+0000 7f75e4bcf640 1 -- 172.21.15.78:0/2938181967 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75e00a8aa0 con 0x7f75e006fc20 2023-11-28T19:59:44.362 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:44.355+0000 7f75e4bcf640 1 --2- 172.21.15.78:0/2938181967 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f75e006fc20 0x7f75e014a140 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f75e006b8a0 tx=0x7f75d8011f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:59:44.362 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:44.355+0000 7f75dcff9640 1 -- 172.21.15.78:0/2938181967 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75d800e040 con 0x7f75e006fc20 2023-11-28T19:59:44.362 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:44.355+0000 7f75dcff9640 1 -- 172.21.15.78:0/2938181967 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f75d800f040 con 0x7f75e006fc20 2023-11-28T19:59:44.362 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:44.355+0000 7f75dcff9640 1 -- 172.21.15.78:0/2938181967 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75d800fe30 con 0x7f75e006fc20 2023-11-28T19:59:44.363 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:44.355+0000 7f75e6632640 1 -- 172.21.15.78:0/2938181967 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f75e00a8d80 con 0x7f75e006fc20 2023-11-28T19:59:44.363 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:44.355+0000 7f75e6632640 1 -- 172.21.15.78:0/2938181967 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f75e01f1040 con 0x7f75e006fc20 2023-11-28T19:59:44.363 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:44.355+0000 7f75e6632640 1 -- 172.21.15.78:0/2938181967 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f75e0067630 con 0x7f75e006fc20 2023-11-28T19:59:44.363 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:44.355+0000 7f75dcff9640 1 -- 172.21.15.78:0/2938181967 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f75d8015430 con 0x7f75e006fc20 2023-11-28T19:59:44.363 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:44.359+0000 7f75dcff9640 1 --2- 172.21.15.78:0/2938181967 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f75cc0664a0 0x7f75cc068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:44.364 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:44.359+0000 7f75dcff9640 1 -- 172.21.15.78:0/2938181967 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f75d80845e0 con 0x7f75e006fc20 2023-11-28T19:59:44.364 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:44.359+0000 7f75dffff640 1 --2- 172.21.15.78:0/2938181967 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f75cc0664a0 0x7f75cc068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:44.364 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:44.359+0000 7f75dffff640 1 --2- 172.21.15.78:0/2938181967 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f75cc0664a0 0x7f75cc068960 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f75d00aa000 tx=0x7f75d0001a80 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:59:44.368 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:44.363+0000 7f75dcff9640 1 -- 172.21.15.78:0/2938181967 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f75d8051770 con 0x7f75e006fc20 2023-11-28T19:59:44.519 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:44.515+0000 7f75e6632640 1 -- 172.21.15.78:0/2938181967 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f75e00ab9a0 con 0x7f75e006fc20 2023-11-28T19:59:44.521 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:44.515+0000 7f75dcff9640 1 -- 172.21.15.78:0/2938181967 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+18322 (secure 0 0 0) 0x7f75d8054d90 con 0x7f75e006fc20 2023-11-28T19:59:44.521 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-11-28T19:59:44.521 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":25,"fsid":"dd9780e8-3bda-44fa-a9f0-fa07d19d901d","created":"2023-11-28T19:58:40.969556+0000","modified":"2023-11-28T19:59:10.474525+0000","last_up_change":"2023-11-28T19:58:52.596716+0000","last_in_change":"2023-11-28T19:58:43.609275+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-28T19:58:54.011229+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-28T19:59:03.945559+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-28T19:59:04.481478+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-11-28T19:59:08.109152+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"e84245ac-b5da-429e-af18-39acaa2b33e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6800","nonce":3358701235},{"type":"v1","addr":"172.21.15.78:6801","nonce":3358701235}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6802","nonce":3358701235},{"type":"v1","addr":"172.21.15.78:6803","nonce":3358701235}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6806","nonce":3358701235},{"type":"v1","addr":"172.21.15.78:6807","nonce":3358701235}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6804","nonce":3358701235},{"type":"v1","addr":"172.21.15.78:6805","nonce":3358701235}]},"public_addr":"172.21.15.78:6801/3358701235","cluster_addr":"172.21.15.78:6803/3358701235","heartbeat_back_addr":"172.21.15.78:6807/3358701235","heartbeat_front_addr":"172.21.15.78:6805/3358701235","state":["exists","up"]},{"osd":1,"uuid":"e634831d-c4e2-48d9-870c-9556ae162981","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6808","nonce":3211476654},{"type":"v1","addr":"172.21.15.78:6809","nonce":3211476654}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6810","nonce":3211476654},{"type":"v1","addr":"172.21.15.78:6811","nonce":3211476654}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6814","nonce":3211476654},{"type":"v1","addr":"172.21.15.78:6815","nonce":3211476654}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6812","nonce":3211476654},{"type":"v1","addr":"172.21.15.78:6813","nonce":3211476654}]},"public_addr":"172.21.15.78:6809/3211476654","cluster_addr":"172.21.15.78:6811/3211476654","heartbeat_back_addr":"172.21.15.78:6815/3211476654","heartbeat_front_addr":"172.21.15.78:6813/3211476654","state":["exists","up"]},{"osd":2,"uuid":"274c8395-6534-41f0-b8fb-a00af8985aa8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6816","nonce":2532904479},{"type":"v1","addr":"172.21.15.78:6817","nonce":2532904479}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6818","nonce":2532904479},{"type":"v1","addr":"172.21.15.78:6819","nonce":2532904479}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6822","nonce":2532904479},{"type":"v1","addr":"172.21.15.78:6823","nonce":2532904479}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6820","nonce":2532904479},{"type":"v1","addr":"172.21.15.78:6821","nonce":2532904479}]},"public_addr":"172.21.15.78:6817/2532904479","cluster_addr":"172.21.15.78:6819/2532904479","heartbeat_back_addr":"172.21.15.78:6823/2532904479","heartbeat_front_addr":"172.21.15.78:6821/2532904479","state":["exists","up"]},{"osd":3,"uuid":"77acc9af-7d4d-4b18-8cf5-d62f5971b7c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6824","nonce":3442991267},{"type":"v1","addr":"172.21.15.78:6825","nonce":3442991267}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6826","nonce":3442991267},{"type":"v1","addr":"172.21.15.78:6827","nonce":3442991267}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6830","nonce":3442991267},{"type":"v1","addr":"172.21.15.78:6831","nonce":3442991267}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6828","nonce":3442991267},{"type":"v1","addr":"172.21.15.78:6829","nonce":3442991267}]},"public_addr":"172.21.15.78:6825/3442991267","cluster_addr":"172.21.15.78:6827/3442991267","heartbeat_back_addr":"172.21.15.78:6831/3442991267","heartbeat_front_addr":"172.21.15.78:6829/3442991267","state":["exists","up"]},{"osd":4,"uuid":"5c62bc66-6b34-4b7f-a66b-9a743969138c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":802983577},{"type":"v1","addr":"172.21.15.179:6809","nonce":802983577}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":802983577},{"type":"v1","addr":"172.21.15.179:6811","nonce":802983577}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":802983577},{"type":"v1","addr":"172.21.15.179:6815","nonce":802983577}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":802983577},{"type":"v1","addr":"172.21.15.179:6813","nonce":802983577}]},"public_addr":"172.21.15.179:6809/802983577","cluster_addr":"172.21.15.179:6811/802983577","heartbeat_back_addr":"172.21.15.179:6815/802983577","heartbeat_front_addr":"172.21.15.179:6813/802983577","state":["exists","up"]},{"osd":5,"uuid":"67db6d36-f684-4079-b0cd-82b4dd61461f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":518192887},{"type":"v1","addr":"172.21.15.179:6818","nonce":518192887}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":518192887},{"type":"v1","addr":"172.21.15.179:6822","nonce":518192887}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":518192887},{"type":"v1","addr":"172.21.15.179:6829","nonce":518192887}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6824","nonce":518192887},{"type":"v1","addr":"172.21.15.179:6826","nonce":518192887}]},"public_addr":"172.21.15.179:6818/518192887","cluster_addr":"172.21.15.179:6822/518192887","heartbeat_back_addr":"172.21.15.179:6829/518192887","heartbeat_front_addr":"172.21.15.179:6826/518192887","state":["exists","up"]},{"osd":6,"uuid":"12e670af-5a16-4c81-9f97-defa66cab967","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":815435378},{"type":"v1","addr":"172.21.15.179:6801","nonce":815435378}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":815435378},{"type":"v1","addr":"172.21.15.179:6803","nonce":815435378}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":815435378},{"type":"v1","addr":"172.21.15.179:6807","nonce":815435378}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":815435378},{"type":"v1","addr":"172.21.15.179:6805","nonce":815435378}]},"public_addr":"172.21.15.179:6801/815435378","cluster_addr":"172.21.15.179:6803/815435378","heartbeat_back_addr":"172.21.15.179:6807/815435378","heartbeat_front_addr":"172.21.15.179:6805/815435378","state":["exists","up"]},{"osd":7,"uuid":"fe630650-2eb3-49ad-8676-c341e6332eb1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6817","nonce":2848432339},{"type":"v1","addr":"172.21.15.179:6819","nonce":2848432339}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6821","nonce":2848432339},{"type":"v1","addr":"172.21.15.179:6823","nonce":2848432339}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":2848432339},{"type":"v1","addr":"172.21.15.179:6831","nonce":2848432339}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6825","nonce":2848432339},{"type":"v1","addr":"172.21.15.179:6827","nonce":2848432339}]},"public_addr":"172.21.15.179:6819/2848432339","cluster_addr":"172.21.15.179:6823/2848432339","heartbeat_back_addr":"172.21.15.179:6831/2848432339","heartbeat_front_addr":"172.21.15.179:6827/2848432339","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:58:49.255433+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:58:49.412880+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:58:49.559295+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:58:49.245237+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:58:49.184557+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:58:49.329851+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:58:49.366012+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:58:49.349604+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-28T19:59:44.523 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:44.515+0000 7f75e6632640 1 -- 172.21.15.78:0/2938181967 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f75cc0664a0 msgr2=0x7f75cc068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:44.523 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:44.515+0000 7f75e6632640 1 --2- 172.21.15.78:0/2938181967 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f75cc0664a0 0x7f75cc068960 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f75d00aa000 tx=0x7f75d0001a80 comp rx=0 tx=0).stop 2023-11-28T19:59:44.523 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:44.515+0000 7f75e6632640 1 -- 172.21.15.78:0/2938181967 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f75e006fc20 msgr2=0x7f75e014a140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:44.523 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:44.515+0000 7f75e6632640 1 --2- 172.21.15.78:0/2938181967 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f75e006fc20 0x7f75e014a140 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f75e006b8a0 tx=0x7f75d8011f10 comp rx=0 tx=0).stop 2023-11-28T19:59:44.523 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:44.515+0000 7f75e6632640 1 -- 172.21.15.78:0/2938181967 shutdown_connections 2023-11-28T19:59:44.523 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:44.515+0000 7f75e6632640 1 --2- 172.21.15.78:0/2938181967 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f75cc0664a0 0x7f75cc068960 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:44.523 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:44.515+0000 7f75e6632640 1 --2- 172.21.15.78:0/2938181967 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f75e006fc20 0x7f75e014a140 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:44.523 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:44.515+0000 7f75e6632640 1 --2- 172.21.15.78:0/2938181967 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f75e00a7300 0x7f75e0149c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:44.523 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:44.515+0000 7f75e6632640 1 --2- 172.21.15.78:0/2938181967 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f75c8003980 0x7f75e014d1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:44.524 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:44.515+0000 7f75e6632640 1 -- 172.21.15.78:0/2938181967 >> 172.21.15.78:0/2938181967 conn(0x7f75e00a7810 msgr2=0x7f75e014f0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T19:59:44.524 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:44.515+0000 7f75e6632640 1 -- 172.21.15.78:0/2938181967 shutdown_connections 2023-11-28T19:59:44.524 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:44.519+0000 7f75e6632640 1 -- 172.21.15.78:0/2938181967 wait complete. 2023-11-28T19:59:44.542 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-28T19:58:54.011229+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-28T19:59:03.945559+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-11-28T19:59:04.481478+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-11-28T19:59:08.109152+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-11-28T19:59:44.542 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-28T19:59:44.682 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:44.675+0000 7f49a62b4640 1 Processor -- start 2023-11-28T19:59:44.682 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:44.675+0000 7f49a62b4640 1 -- start start 2023-11-28T19:59:44.683 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:44.679+0000 7f49a62b4640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f49a014e8e0 0x7f49a0154f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:44.683 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:44.679+0000 7f49a62b4640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f49a00c5160 0x7f49a006d140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:44.683 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:44.679+0000 7f49a62b4640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f49a00a53c0 con 0x7f49a00c0250 2023-11-28T19:59:44.684 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:44.679+0000 7f49a62b4640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f49a00a9140 con 0x7f49a00c5160 2023-11-28T19:59:44.684 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:44.679+0000 7f49a62b4640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f49a014ecc0 con 0x7f49a014e8e0 2023-11-28T19:59:44.684 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:44.679+0000 7f49a5ab3640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f49a00c5160 0x7f49a006d140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:44.684 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:44.679+0000 7f49a5ab3640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f49a00c5160 0x7f49a006d140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:37238/0 (socket says 172.21.15.78:37238) 2023-11-28T19:59:44.684 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:44.679+0000 7f49a5ab3640 1 -- 172.21.15.78:0/1170770095 learned_addr learned my addr 172.21.15.78:0/1170770095 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T19:59:44.684 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:44.679+0000 7f49a52b2640 1 --2- 172.21.15.78:0/1170770095 >> v2:172.21.15.179:3300/0 conn(0x7f49a014e8e0 0x7f49a0154f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:44.685 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:44.679+0000 7f49a5ab3640 1 -- 172.21.15.78:0/1170770095 >> v2:172.21.15.179:3300/0 conn(0x7f49a014e8e0 msgr2=0x7f49a0154f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T19:59:44.685 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:44.679+0000 7f49a5ab3640 1 --2- 172.21.15.78:0/1170770095 >> v2:172.21.15.179:3300/0 conn(0x7f49a014e8e0 0x7f49a0154f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:44.685 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:44.679+0000 7f49a5ab3640 1 -- 172.21.15.78:0/1170770095 >> v1:172.21.15.179:6789/0 conn(0x7f49a00c0250 legacy=0x7f49a006c670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:44.685 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:44.679+0000 7f49a5ab3640 1 -- 172.21.15.78:0/1170770095 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49a00a4e20 con 0x7f49a00c5160 2023-11-28T19:59:44.686 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:44.679+0000 7f49a5ab3640 1 --2- 172.21.15.78:0/1170770095 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f49a00c5160 0x7f49a006d140 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f49a0073cc0 tx=0x7f499801c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=36ce3c2a6067df4d server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:59:44.687 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:44.683+0000 7f4997fff640 1 -- 172.21.15.78:0/1170770095 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49980a5740 con 0x7f49a00c5160 2023-11-28T19:59:44.687 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:44.683+0000 7f4997fff640 1 -- 172.21.15.78:0/1170770095 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f49980a58a0 con 0x7f49a00c5160 2023-11-28T19:59:44.687 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:44.683+0000 7f4997fff640 1 -- 172.21.15.78:0/1170770095 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49980a5c30 con 0x7f49a00c5160 2023-11-28T19:59:44.688 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:44.683+0000 7f49a62b4640 1 -- 172.21.15.78:0/1170770095 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f49a00c5160 msgr2=0x7f49a006d140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:44.688 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:44.683+0000 7f49a62b4640 1 --2- 172.21.15.78:0/1170770095 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f49a00c5160 0x7f49a006d140 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f49a0073cc0 tx=0x7f499801c880 comp rx=0 tx=0).stop 2023-11-28T19:59:44.688 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:44.683+0000 7f49a62b4640 1 -- 172.21.15.78:0/1170770095 shutdown_connections 2023-11-28T19:59:44.688 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:44.683+0000 7f49a62b4640 1 --2- 172.21.15.78:0/1170770095 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f49a00c5160 0x7f49a006d140 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:44.688 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:44.683+0000 7f49a62b4640 1 --2- 172.21.15.78:0/1170770095 >> v2:172.21.15.179:3300/0 conn(0x7f49a014e8e0 0x7f49a0154f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:44.688 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:44.683+0000 7f49a62b4640 1 -- 172.21.15.78:0/1170770095 >> 172.21.15.78:0/1170770095 conn(0x7f49a00c2350 msgr2=0x7f49a00c2760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T19:59:44.688 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:44.683+0000 7f49a62b4640 1 -- 172.21.15.78:0/1170770095 shutdown_connections 2023-11-28T19:59:44.689 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:44.683+0000 7f49a62b4640 1 -- 172.21.15.78:0/1170770095 wait complete. 2023-11-28T19:59:44.689 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:44.683+0000 7f49a62b4640 1 Processor -- start 2023-11-28T19:59:44.689 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:44.683+0000 7f49a62b4640 1 -- start start 2023-11-28T19:59:44.691 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:44.683+0000 7f49a62b4640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f49a00c0250 0x7f49a0151340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:44.692 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:44.683+0000 7f49a62b4640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f49a00c5160 0x7f49a01ee440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:44.692 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:44.683+0000 7f49a62b4640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f49a014e8e0 0x7f49a01ee980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:44.692 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:44.683+0000 7f49a62b4640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49a00bf6f0 con 0x7f49a00c0250 2023-11-28T19:59:44.692 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:44.683+0000 7f49a62b4640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49a00ba9a0 con 0x7f49a00c5160 2023-11-28T19:59:44.693 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:44.683+0000 7f49a62b4640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f49a00bac80 con 0x7f49a014e8e0 2023-11-28T19:59:44.693 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:44.683+0000 7f49a52b2640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f49a00c0250 0x7f49a0151340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:44.693 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:44.683+0000 7f49a52b2640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f49a00c0250 0x7f49a0151340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:37248/0 (socket says 172.21.15.78:37248) 2023-11-28T19:59:44.693 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:44.683+0000 7f49a52b2640 1 -- 172.21.15.78:0/3252803850 learned_addr learned my addr 172.21.15.78:0/3252803850 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T19:59:44.693 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:44.683+0000 7f49a4ab1640 1 --2- 172.21.15.78:0/3252803850 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f49a00c5160 0x7f49a01ee440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:44.693 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:44.683+0000 7f49a5ab3640 1 --2- 172.21.15.78:0/3252803850 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f49a014e8e0 0x7f49a01ee980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:44.693 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:44.687+0000 7f49a52b2640 1 -- 172.21.15.78:0/3252803850 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f49a014e8e0 msgr2=0x7f49a01ee980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:44.693 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:44.687+0000 7f49a52b2640 1 --2- 172.21.15.78:0/3252803850 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f49a014e8e0 0x7f49a01ee980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:44.693 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:44.687+0000 7f49a52b2640 1 -- 172.21.15.78:0/3252803850 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f49a00c5160 msgr2=0x7f49a01ee440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:44.693 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:44.687+0000 7f49a52b2640 1 --2- 172.21.15.78:0/3252803850 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f49a00c5160 0x7f49a01ee440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:44.693 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:44.687+0000 7f49a52b2640 1 -- 172.21.15.78:0/3252803850 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4998009b30 con 0x7f49a00c0250 2023-11-28T19:59:44.694 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:44.687+0000 7f49a4ab1640 1 --2- 172.21.15.78:0/3252803850 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f49a00c5160 0x7f49a01ee440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T19:59:44.694 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:44.687+0000 7f49a5ab3640 1 --2- 172.21.15.78:0/3252803850 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f49a014e8e0 0x7f49a01ee980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T19:59:44.694 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:44.687+0000 7f49a52b2640 1 --2- 172.21.15.78:0/3252803850 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f49a00c0250 0x7f49a0151340 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f499c00e930 tx=0x7f499c00edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:59:44.694 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:44.687+0000 7f4995ffb640 1 -- 172.21.15.78:0/3252803850 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f499c009690 con 0x7f49a00c0250 2023-11-28T19:59:44.694 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:44.687+0000 7f4995ffb640 1 -- 172.21.15.78:0/3252803850 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f499c00ca00 con 0x7f49a00c0250 2023-11-28T19:59:44.694 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:44.687+0000 7f49a62b4640 1 -- 172.21.15.78:0/3252803850 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f49a00bf940 con 0x7f49a00c0250 2023-11-28T19:59:44.694 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:44.687+0000 7f4995ffb640 1 -- 172.21.15.78:0/3252803850 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f499c00cd70 con 0x7f49a00c0250 2023-11-28T19:59:44.694 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:44.687+0000 7f49a62b4640 1 -- 172.21.15.78:0/3252803850 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f49a01eeec0 con 0x7f49a00c0250 2023-11-28T19:59:44.695 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:44.687+0000 7f49a62b4640 1 -- 172.21.15.78:0/3252803850 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f49a01ee290 con 0x7f49a00c0250 2023-11-28T19:59:44.695 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:44.687+0000 7f4995ffb640 1 -- 172.21.15.78:0/3252803850 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f499c013470 con 0x7f49a00c0250 2023-11-28T19:59:44.696 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:44.687+0000 7f4995ffb640 1 --2- 172.21.15.78:0/3252803850 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f4984066470 0x7f4984068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:44.696 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:44.687+0000 7f4995ffb640 1 -- 172.21.15.78:0/3252803850 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f499c0843d0 con 0x7f49a00c0250 2023-11-28T19:59:44.696 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:44.687+0000 7f49a4ab1640 1 --2- 172.21.15.78:0/3252803850 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f4984066470 0x7f4984068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:44.696 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:44.691+0000 7f49a4ab1640 1 --2- 172.21.15.78:0/3252803850 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f4984066470 0x7f4984068930 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f49a00bbe00 tx=0x7f4990009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:59:44.698 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:44.691+0000 7f4995ffb640 1 -- 172.21.15.78:0/3252803850 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f499c051610 con 0x7f49a00c0250 2023-11-28T19:59:44.850 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:44.843+0000 7f49a62b4640 1 -- 172.21.15.78:0/3252803850 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f49a00674b0 con 0x7f49a00c0250 2023-11-28T19:59:44.850 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:44.843+0000 7f4995ffb640 1 -- 172.21.15.78:0/3252803850 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v25) v1 ==== 93+0+10 (secure 0 0 0) 0x7f499c054c30 con 0x7f49a00c0250 2023-11-28T19:59:44.851 INFO:teuthology.orchestra.run.smithi078.stdout:pg_num: 1 2023-11-28T19:59:44.853 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:44.847+0000 7f49a62b4640 1 -- 172.21.15.78:0/3252803850 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f4984066470 msgr2=0x7f4984068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:44.853 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:44.847+0000 7f49a62b4640 1 --2- 172.21.15.78:0/3252803850 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f4984066470 0x7f4984068930 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f49a00bbe00 tx=0x7f4990009040 comp rx=0 tx=0).stop 2023-11-28T19:59:44.853 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:44.847+0000 7f49a62b4640 1 -- 172.21.15.78:0/3252803850 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f49a00c0250 msgr2=0x7f49a0151340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:44.853 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:44.847+0000 7f49a62b4640 1 --2- 172.21.15.78:0/3252803850 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f49a00c0250 0x7f49a0151340 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f499c00e930 tx=0x7f499c00edf0 comp rx=0 tx=0).stop 2023-11-28T19:59:44.853 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:44.847+0000 7f49a62b4640 1 -- 172.21.15.78:0/3252803850 shutdown_connections 2023-11-28T19:59:44.853 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:44.847+0000 7f49a62b4640 1 --2- 172.21.15.78:0/3252803850 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f4984066470 0x7f4984068930 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:44.853 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:44.847+0000 7f49a62b4640 1 --2- 172.21.15.78:0/3252803850 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f49a014e8e0 0x7f49a01ee980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:44.854 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:44.847+0000 7f49a62b4640 1 --2- 172.21.15.78:0/3252803850 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f49a00c5160 0x7f49a01ee440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:44.854 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:44.847+0000 7f49a62b4640 1 --2- 172.21.15.78:0/3252803850 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f49a00c0250 0x7f49a0151340 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:44.854 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:44.847+0000 7f49a62b4640 1 -- 172.21.15.78:0/3252803850 >> 172.21.15.78:0/3252803850 conn(0x7f49a00c2350 msgr2=0x7f49a0073450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T19:59:44.854 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:44.847+0000 7f49a62b4640 1 -- 172.21.15.78:0/3252803850 shutdown_connections 2023-11-28T19:59:44.854 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:44.847+0000 7f49a62b4640 1 -- 172.21.15.78:0/3252803850 wait complete. 2023-11-28T19:59:44.871 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-28T19:59:45.012 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:45.007+0000 7fe15a4c9640 1 Processor -- start 2023-11-28T19:59:45.012 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:45.007+0000 7fe15a4c9640 1 -- start start 2023-11-28T19:59:45.013 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:45.007+0000 7fe15a4c9640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fe154159c40 0x7fe15415c030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:45.013 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:45.007+0000 7fe15a4c9640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe1540a4e20 con 0x7fe15414b1e0 2023-11-28T19:59:45.013 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:45.007+0000 7fe15a4c9640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe1540a50e0 con 0x7fe1540c5300 2023-11-28T19:59:45.013 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:45.007+0000 7fe15a4c9640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe1541558d0 con 0x7fe154159c40 2023-11-28T19:59:45.014 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:45.007+0000 7fe153fff640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7fe15414b1e0 0x7fe1540c1700 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:60820/0 (socket says 172.21.15.78:60820) 2023-11-28T19:59:45.014 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:45.007+0000 7fe153fff640 1 -- 172.21.15.78:0/1016531345 learned_addr learned my addr 172.21.15.78:0/1016531345 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-11-28T19:59:45.016 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:45.007+0000 7fe158a66640 1 --2- 172.21.15.78:0/1016531345 >> v2:172.21.15.179:3300/0 conn(0x7fe154159c40 0x7fe15415c030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:45.017 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:45.007+0000 7fe152ffd640 1 -- 172.21.15.78:0/1016531345 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 497837701 0 0) 0x7fe1540a4e20 con 0x7fe15414b1e0 2023-11-28T19:59:45.017 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:45.007+0000 7fe152ffd640 1 -- 172.21.15.78:0/1016531345 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe13c003530 con 0x7fe15414b1e0 2023-11-28T19:59:45.017 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:45.007+0000 7fe152ffd640 1 -- 172.21.15.78:0/1016531345 <== mon.0 v1:172.21.15.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2343450787 0 0) 0x7fe13c003530 con 0x7fe15414b1e0 2023-11-28T19:59:45.017 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:45.007+0000 7fe152ffd640 1 -- 172.21.15.78:0/1016531345 >> v2:172.21.15.179:3300/0 conn(0x7fe154159c40 msgr2=0x7fe15415c030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T19:59:45.017 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:45.007+0000 7fe152ffd640 1 --2- 172.21.15.78:0/1016531345 >> v2:172.21.15.179:3300/0 conn(0x7fe154159c40 0x7fe15415c030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:45.017 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:45.007+0000 7fe152ffd640 1 -- 172.21.15.78:0/1016531345 >> v1:172.21.15.179:6789/0 conn(0x7fe1540c5300 legacy=0x7fe1540a9c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:45.017 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:45.007+0000 7fe152ffd640 1 -- 172.21.15.78:0/1016531345 --> v1:172.21.15.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1540c0f00 con 0x7fe15414b1e0 2023-11-28T19:59:45.018 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:45.007+0000 7fe152ffd640 1 -- 172.21.15.78:0/1016531345 <== mon.0 v1:172.21.15.78:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3326804700 0 0) 0x7fe144001680 con 0x7fe15414b1e0 2023-11-28T19:59:45.018 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:45.007+0000 7fe158a66640 1 --2- 172.21.15.78:0/1016531345 >> v2:172.21.15.179:3300/0 conn(0x7fe154159c40 0x7fe15415c030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T19:59:45.018 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:45.007+0000 7fe152ffd640 1 -- 172.21.15.78:0/1016531345 >> v1:172.21.15.78:6789/0 conn(0x7fe15414b1e0 legacy=0x7fe1540c1700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:45.018 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:45.007+0000 7fe152ffd640 1 --2- 172.21.15.78:0/1016531345 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe13c003980 0x7fe13c003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:45.018 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:45.007+0000 7fe152ffd640 1 --2- 172.21.15.78:0/1016531345 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe13c0047d0 0x7fe13c004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:45.018 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:45.007+0000 7fe152ffd640 1 --2- 172.21.15.78:0/1016531345 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe13c005190 0x7fe13c00dba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:45.018 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:45.007+0000 7fe152ffd640 1 -- 172.21.15.78:0/1016531345 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1541558d0 con 0x7fe13c0047d0 2023-11-28T19:59:45.018 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:45.007+0000 7fe152ffd640 1 -- 172.21.15.78:0/1016531345 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe13c00e270 con 0x7fe13c005190 2023-11-28T19:59:45.018 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:45.007+0000 7fe152ffd640 1 -- 172.21.15.78:0/1016531345 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe13c00e430 con 0x7fe13c003980 2023-11-28T19:59:45.018 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:45.007+0000 7fe1537fe640 1 --2- 172.21.15.78:0/1016531345 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe13c0047d0 0x7fe13c004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:45.018 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:45.007+0000 7fe153fff640 1 --2- 172.21.15.78:0/1016531345 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe13c003980 0x7fe13c003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:45.019 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:45.007+0000 7fe158a66640 1 --2- 172.21.15.78:0/1016531345 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe13c005190 0x7fe13c00dba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:45.019 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:45.007+0000 7fe1537fe640 1 -- 172.21.15.78:0/1016531345 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe13c003980 msgr2=0x7fe13c003dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T19:59:45.019 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:45.007+0000 7fe1537fe640 1 --2- 172.21.15.78:0/1016531345 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe13c003980 0x7fe13c003dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:45.019 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:45.007+0000 7fe1537fe640 1 -- 172.21.15.78:0/1016531345 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe13c005190 msgr2=0x7fe13c00dba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T19:59:45.019 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:45.007+0000 7fe1537fe640 1 --2- 172.21.15.78:0/1016531345 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe13c005190 0x7fe13c00dba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:45.019 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:45.011+0000 7fe1537fe640 1 -- 172.21.15.78:0/1016531345 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe13c003530 con 0x7fe13c0047d0 2023-11-28T19:59:45.019 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:45.011+0000 7fe158a66640 1 --2- 172.21.15.78:0/1016531345 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe13c005190 0x7fe13c00dba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T19:59:45.019 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:45.011+0000 7fe158a66640 1 -- 172.21.15.78:0/1016531345 reap_dead start 2023-11-28T19:59:45.020 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:45.011+0000 7fe1537fe640 1 --2- 172.21.15.78:0/1016531345 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe13c0047d0 0x7fe13c004c50 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fe148001750 tx=0x7fe14801c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=feb7da5cb5e68d4c server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:59:45.021 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:45.011+0000 7fe152ffd640 1 -- 172.21.15.78:0/1016531345 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1480052d0 con 0x7fe13c0047d0 2023-11-28T19:59:45.021 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:45.011+0000 7fe152ffd640 1 -- 172.21.15.78:0/1016531345 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe1480a7050 con 0x7fe13c0047d0 2023-11-28T19:59:45.021 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:45.011+0000 7fe152ffd640 1 -- 172.21.15.78:0/1016531345 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe148003600 con 0x7fe13c0047d0 2023-11-28T19:59:45.021 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:45.011+0000 7fe15a4c9640 1 -- 172.21.15.78:0/1016531345 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe13c0047d0 msgr2=0x7fe13c004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:45.021 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:45.011+0000 7fe15a4c9640 1 --2- 172.21.15.78:0/1016531345 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe13c0047d0 0x7fe13c004c50 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fe148001750 tx=0x7fe14801c3a0 comp rx=0 tx=0).stop 2023-11-28T19:59:45.021 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:45.011+0000 7fe15a4c9640 1 -- 172.21.15.78:0/1016531345 shutdown_connections 2023-11-28T19:59:45.021 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:45.011+0000 7fe15a4c9640 1 --2- 172.21.15.78:0/1016531345 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe13c0047d0 0x7fe13c004c50 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:45.021 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:45.011+0000 7fe15a4c9640 1 -- 172.21.15.78:0/1016531345 >> 172.21.15.78:0/1016531345 conn(0x7fe1540c59f0 msgr2=0x7fe1540c5e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T19:59:45.021 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:45.011+0000 7fe15a4c9640 1 -- 172.21.15.78:0/1016531345 shutdown_connections 2023-11-28T19:59:45.021 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:45.011+0000 7fe15a4c9640 1 -- 172.21.15.78:0/1016531345 wait complete. 2023-11-28T19:59:45.022 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:45.015+0000 7fe15a4c9640 1 Processor -- start 2023-11-28T19:59:45.022 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:45.015+0000 7fe15a4c9640 1 -- start start 2023-11-28T19:59:45.024 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:45.015+0000 7fe15a4c9640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe13c0047d0 0x7fe1541eb310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:45.024 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:45.015+0000 7fe15a4c9640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe154144230 0x7fe1540a6810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:45.024 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:45.015+0000 7fe15a4c9640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe1540a6d50 0x7fe154143790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:45.024 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:45.015+0000 7fe15a4c9640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1541e1bf0 con 0x7fe13c0047d0 2023-11-28T19:59:45.024 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:45.015+0000 7fe15a4c9640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1540723e0 con 0x7fe1540a6d50 2023-11-28T19:59:45.024 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:45.015+0000 7fe15a4c9640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe154072630 con 0x7fe154144230 2023-11-28T19:59:45.024 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:45.015+0000 7fe153fff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe13c0047d0 0x7fe1541eb310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:45.024 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:45.015+0000 7fe153fff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe13c0047d0 0x7fe1541eb310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:37262/0 (socket says 172.21.15.78:37262) 2023-11-28T19:59:45.024 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:45.015+0000 7fe153fff640 1 -- 172.21.15.78:0/1416539445 learned_addr learned my addr 172.21.15.78:0/1416539445 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T19:59:45.025 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:45.015+0000 7fe1537fe640 1 --2- 172.21.15.78:0/1416539445 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe154144230 0x7fe1540a6810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:45.025 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:45.015+0000 7fe158a66640 1 --2- 172.21.15.78:0/1416539445 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe1540a6d50 0x7fe154143790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:45.025 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:45.015+0000 7fe153fff640 1 -- 172.21.15.78:0/1416539445 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe154144230 msgr2=0x7fe1540a6810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:45.025 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:45.015+0000 7fe153fff640 1 --2- 172.21.15.78:0/1416539445 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe154144230 0x7fe1540a6810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:45.025 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:45.015+0000 7fe153fff640 1 -- 172.21.15.78:0/1416539445 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe1540a6d50 msgr2=0x7fe154143790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:45.025 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:45.015+0000 7fe153fff640 1 --2- 172.21.15.78:0/1416539445 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe1540a6d50 0x7fe154143790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:45.025 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:45.015+0000 7fe153fff640 1 -- 172.21.15.78:0/1416539445 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe154072910 con 0x7fe13c0047d0 2023-11-28T19:59:45.025 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:45.015+0000 7fe153fff640 1 --2- 172.21.15.78:0/1416539445 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe13c0047d0 0x7fe1541eb310 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fe1440124f0 tx=0x7fe1440129b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:59:45.025 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:45.015+0000 7fe150ff9640 1 -- 172.21.15.78:0/1416539445 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe144014810 con 0x7fe13c0047d0 2023-11-28T19:59:45.025 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:45.015+0000 7fe150ff9640 1 -- 172.21.15.78:0/1416539445 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe144014990 con 0x7fe13c0047d0 2023-11-28T19:59:45.025 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:45.015+0000 7fe150ff9640 1 -- 172.21.15.78:0/1416539445 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe144014d40 con 0x7fe13c0047d0 2023-11-28T19:59:45.025 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:45.015+0000 7fe15a4c9640 1 -- 172.21.15.78:0/1416539445 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe1540a6010 con 0x7fe13c0047d0 2023-11-28T19:59:45.026 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:45.015+0000 7fe15a4c9640 1 -- 172.21.15.78:0/1416539445 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe1540a5ce0 con 0x7fe13c0047d0 2023-11-28T19:59:45.026 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:45.019+0000 7fe15a4c9640 1 -- 172.21.15.78:0/1416539445 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe154067630 con 0x7fe13c0047d0 2023-11-28T19:59:45.026 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:45.019+0000 7fe150ff9640 1 -- 172.21.15.78:0/1416539445 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fe1440153e0 con 0x7fe13c0047d0 2023-11-28T19:59:45.027 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:45.019+0000 7fe150ff9640 1 --2- 172.21.15.78:0/1416539445 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fe140066470 0x7fe140068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:45.027 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:45.019+0000 7fe150ff9640 1 -- 172.21.15.78:0/1416539445 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fe144086a20 con 0x7fe13c0047d0 2023-11-28T19:59:45.027 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:45.019+0000 7fe1537fe640 1 --2- 172.21.15.78:0/1416539445 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fe140066470 0x7fe140068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:45.027 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:45.019+0000 7fe1537fe640 1 --2- 172.21.15.78:0/1416539445 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fe140066470 0x7fe140068930 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fe1480ac000 tx=0x7fe1480011a0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:59:45.029 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:45.023+0000 7fe150ff9640 1 -- 172.21.15.78:0/1416539445 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fe144053bb0 con 0x7fe13c0047d0 2023-11-28T19:59:45.182 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:45.175+0000 7fe15a4c9640 1 -- 172.21.15.78:0/1416539445 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fe1541524a0 con 0x7fe13c0047d0 2023-11-28T19:59:45.183 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:45.179+0000 7fe150ff9640 1 -- 172.21.15.78:0/1416539445 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v25) v1 ==== 104+0+11 (secure 0 0 0) 0x7fe14401c0a0 con 0x7fe13c0047d0 2023-11-28T19:59:45.183 INFO:teuthology.orchestra.run.smithi078.stdout:pg_num: 32 2023-11-28T19:59:45.185 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:45.179+0000 7fe15a4c9640 1 -- 172.21.15.78:0/1416539445 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fe140066470 msgr2=0x7fe140068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:45.185 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:45.179+0000 7fe15a4c9640 1 --2- 172.21.15.78:0/1416539445 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fe140066470 0x7fe140068930 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fe1480ac000 tx=0x7fe1480011a0 comp rx=0 tx=0).stop 2023-11-28T19:59:45.185 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:45.179+0000 7fe15a4c9640 1 -- 172.21.15.78:0/1416539445 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe13c0047d0 msgr2=0x7fe1541eb310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:45.185 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:45.179+0000 7fe15a4c9640 1 --2- 172.21.15.78:0/1416539445 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe13c0047d0 0x7fe1541eb310 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fe1440124f0 tx=0x7fe1440129b0 comp rx=0 tx=0).stop 2023-11-28T19:59:45.185 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:45.179+0000 7fe15a4c9640 1 -- 172.21.15.78:0/1416539445 shutdown_connections 2023-11-28T19:59:45.185 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:45.179+0000 7fe15a4c9640 1 --2- 172.21.15.78:0/1416539445 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fe140066470 0x7fe140068930 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:45.186 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:45.179+0000 7fe15a4c9640 1 --2- 172.21.15.78:0/1416539445 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe154144230 0x7fe1540a6810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:45.186 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:45.179+0000 7fe15a4c9640 1 --2- 172.21.15.78:0/1416539445 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe1540a6d50 0x7fe154143790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:45.186 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:45.179+0000 7fe15a4c9640 1 --2- 172.21.15.78:0/1416539445 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe13c0047d0 0x7fe1541eb310 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:45.186 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:45.179+0000 7fe15a4c9640 1 -- 172.21.15.78:0/1416539445 >> 172.21.15.78:0/1416539445 conn(0x7fe1540c59f0 msgr2=0x7fe1540bf700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T19:59:45.186 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:45.179+0000 7fe15a4c9640 1 -- 172.21.15.78:0/1416539445 shutdown_connections 2023-11-28T19:59:45.186 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:45.179+0000 7fe15a4c9640 1 -- 172.21.15.78:0/1416539445 wait complete. 2023-11-28T19:59:45.204 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-28T19:59:45.343 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:45.343+0000 7f332cf2a640 1 Processor -- start 2023-11-28T19:59:45.344 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:45.343+0000 7f332cf2a640 1 -- start start 2023-11-28T19:59:45.345 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:45.343+0000 7f332cf2a640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f33280c5300 0x7f33280a9c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:45.345 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:45.343+0000 7f332cf2a640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f33280a4e20 con 0x7f33281548c0 2023-11-28T19:59:45.345 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:45.343+0000 7f332cf2a640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f33280a50e0 con 0x7f332814b1e0 2023-11-28T19:59:45.345 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:45.343+0000 7f332cf2a640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33280c0f00 con 0x7f33280c5300 2023-11-28T19:59:45.345 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:45.343+0000 7f3326d9d640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f33281548c0 0x7f3328154d50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:39322/0 (socket says 172.21.15.78:39322) 2023-11-28T19:59:45.345 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:45.343+0000 7f3326d9d640 1 -- 172.21.15.78:0/3227768804 learned_addr learned my addr 172.21.15.78:0/3227768804 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-11-28T19:59:45.346 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:45.343+0000 7f3325d9b640 1 --2- 172.21.15.78:0/3227768804 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f33280c5300 0x7f33280a9c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:45.347 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:45.343+0000 7f332559a640 1 -- 172.21.15.78:0/3227768804 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 772898555 0 0) 0x7f33280a4e20 con 0x7f33281548c0 2023-11-28T19:59:45.347 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:45.343+0000 7f332559a640 1 -- 172.21.15.78:0/3227768804 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3310003530 con 0x7f33281548c0 2023-11-28T19:59:45.347 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:45.343+0000 7f332559a640 1 -- 172.21.15.78:0/3227768804 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2300632625 0 0) 0x7f33280a50e0 con 0x7f332814b1e0 2023-11-28T19:59:45.347 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:45.343+0000 7f332559a640 1 -- 172.21.15.78:0/3227768804 --> v1:172.21.15.179:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f33280a4e20 con 0x7f332814b1e0 2023-11-28T19:59:45.347 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:45.343+0000 7f3325d9b640 1 -- 172.21.15.78:0/3227768804 >> v1:172.21.15.179:6789/0 conn(0x7f332814b1e0 legacy=0x7f33280c1700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:45.348 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:45.343+0000 7f3325d9b640 1 -- 172.21.15.78:0/3227768804 >> v1:172.21.15.78:6789/0 conn(0x7f33281548c0 legacy=0x7f3328154d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:45.348 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:45.343+0000 7f332559a640 1 -- 172.21.15.78:0/3227768804 <== mon.0 v1:172.21.15.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 362505616 0 0) 0x7f3310003530 con 0x7f33281548c0 2023-11-28T19:59:45.348 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:45.343+0000 7f3325d9b640 1 -- 172.21.15.78:0/3227768804 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33280c11e0 con 0x7f33280c5300 2023-11-28T19:59:45.348 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:45.343+0000 7f3325d9b640 1 --2- 172.21.15.78:0/3227768804 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f33280c5300 0x7f33280a9c30 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f331c0097f0 tx=0x7f331c01c3e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=436ffe64cd8e4252 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:59:45.349 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:45.343+0000 7f332559a640 1 -- 172.21.15.78:0/3227768804 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3320001a20 con 0x7f33280c5300 2023-11-28T19:59:45.349 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:45.343+0000 7f332559a640 1 -- 172.21.15.78:0/3227768804 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f331c0a7050 con 0x7f33280c5300 2023-11-28T19:59:45.350 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:45.343+0000 7f332559a640 1 -- 172.21.15.78:0/3227768804 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f331c0ab620 con 0x7f33280c5300 2023-11-28T19:59:45.351 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:45.343+0000 7f332cf2a640 1 -- 172.21.15.78:0/3227768804 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f33280c5300 msgr2=0x7f33280a9c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:45.351 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:45.343+0000 7f332cf2a640 1 --2- 172.21.15.78:0/3227768804 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f33280c5300 0x7f33280a9c30 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f331c0097f0 tx=0x7f331c01c3e0 comp rx=0 tx=0).stop 2023-11-28T19:59:45.351 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:45.343+0000 7f332cf2a640 1 -- 172.21.15.78:0/3227768804 shutdown_connections 2023-11-28T19:59:45.351 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:45.343+0000 7f332cf2a640 1 --2- 172.21.15.78:0/3227768804 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f33280c5300 0x7f33280a9c30 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:45.352 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:45.343+0000 7f332cf2a640 1 -- 172.21.15.78:0/3227768804 >> 172.21.15.78:0/3227768804 conn(0x7f33280c59f0 msgr2=0x7f33280c5e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T19:59:45.352 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:45.343+0000 7f332cf2a640 1 -- 172.21.15.78:0/3227768804 shutdown_connections 2023-11-28T19:59:45.352 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:45.343+0000 7f332cf2a640 1 -- 172.21.15.78:0/3227768804 wait complete. 2023-11-28T19:59:45.354 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:45.347+0000 7f332cf2a640 1 Processor -- start 2023-11-28T19:59:45.354 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:45.347+0000 7f332cf2a640 1 -- start start 2023-11-28T19:59:45.354 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:45.347+0000 7f332cf2a640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f33280c5300 0x7f3328152f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:45.355 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:45.347+0000 7f332cf2a640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f332814b1e0 0x7f33280707f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:45.355 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:45.347+0000 7f332cf2a640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f33281548c0 0x7f3328070d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:45.355 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:45.347+0000 7f332cf2a640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f332806fac0 con 0x7f332814b1e0 2023-11-28T19:59:45.355 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:45.347+0000 7f332cf2a640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f332814bcc0 con 0x7f33281548c0 2023-11-28T19:59:45.355 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:45.347+0000 7f332cf2a640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33280a6e50 con 0x7f33280c5300 2023-11-28T19:59:45.355 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:45.347+0000 7f3325d9b640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f332814b1e0 0x7f33280707f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:45.355 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:45.347+0000 7f3325d9b640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f332814b1e0 0x7f33280707f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:45158/0 (socket says 172.21.15.78:45158) 2023-11-28T19:59:45.355 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:45.347+0000 7f3325d9b640 1 -- 172.21.15.78:0/3878008674 learned_addr learned my addr 172.21.15.78:0/3878008674 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T19:59:45.355 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:45.347+0000 7f3326d9d640 1 --2- 172.21.15.78:0/3878008674 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f33281548c0 0x7f3328070d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:45.355 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:45.347+0000 7f3325d9b640 1 -- 172.21.15.78:0/3878008674 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f33280c5300 msgr2=0x7f3328152f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:45.355 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:45.347+0000 7f332659c640 1 --2- 172.21.15.78:0/3878008674 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f33280c5300 0x7f3328152f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:45.355 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:45.347+0000 7f3325d9b640 1 --2- 172.21.15.78:0/3878008674 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f33280c5300 0x7f3328152f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:45.356 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:45.347+0000 7f3325d9b640 1 -- 172.21.15.78:0/3878008674 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f33281548c0 msgr2=0x7f3328070d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:45.356 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:45.347+0000 7f3325d9b640 1 --2- 172.21.15.78:0/3878008674 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f33281548c0 0x7f3328070d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:45.356 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:45.347+0000 7f3325d9b640 1 -- 172.21.15.78:0/3878008674 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f331c009420 con 0x7f332814b1e0 2023-11-28T19:59:45.356 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:45.347+0000 7f332659c640 1 --2- 172.21.15.78:0/3878008674 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f33280c5300 0x7f3328152f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T19:59:45.356 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:45.347+0000 7f3326d9d640 1 --2- 172.21.15.78:0/3878008674 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f33281548c0 0x7f3328070d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T19:59:45.356 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:45.347+0000 7f3325d9b640 1 --2- 172.21.15.78:0/3878008674 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f332814b1e0 0x7f33280707f0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f331c0097f0 tx=0x7f331c019180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:59:45.356 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:45.347+0000 7f3316ffd640 1 -- 172.21.15.78:0/3878008674 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f331c0abce0 con 0x7f332814b1e0 2023-11-28T19:59:45.356 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:45.347+0000 7f3316ffd640 1 -- 172.21.15.78:0/3878008674 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f331c0abe40 con 0x7f332814b1e0 2023-11-28T19:59:45.356 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:45.347+0000 7f3316ffd640 1 -- 172.21.15.78:0/3878008674 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f331c004220 con 0x7f332814b1e0 2023-11-28T19:59:45.356 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:45.347+0000 7f332cf2a640 1 -- 172.21.15.78:0/3878008674 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f332806fd10 con 0x7f332814b1e0 2023-11-28T19:59:45.356 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:45.347+0000 7f332cf2a640 1 -- 172.21.15.78:0/3878008674 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f33280702d0 con 0x7f332814b1e0 2023-11-28T19:59:45.357 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:45.355+0000 7f332cf2a640 1 -- 172.21.15.78:0/3878008674 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3328067630 con 0x7f332814b1e0 2023-11-28T19:59:45.357 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:45.355+0000 7f3316ffd640 1 -- 172.21.15.78:0/3878008674 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f331c0b2040 con 0x7f332814b1e0 2023-11-28T19:59:45.358 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:45.355+0000 7f3316ffd640 1 --2- 172.21.15.78:0/3878008674 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f33080664a0 0x7f3308068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:45.358 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:45.355+0000 7f3316ffd640 1 -- 172.21.15.78:0/3878008674 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f331c11cfd0 con 0x7f332814b1e0 2023-11-28T19:59:45.358 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:45.355+0000 7f332659c640 1 --2- 172.21.15.78:0/3878008674 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f33080664a0 0x7f3308068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:45.358 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:45.355+0000 7f332659c640 1 --2- 172.21.15.78:0/3878008674 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f33080664a0 0x7f3308068960 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f33180011f0 tx=0x7f3318009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:59:45.360 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:45.355+0000 7f3316ffd640 1 -- 172.21.15.78:0/3878008674 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f331c0ea0c0 con 0x7f332814b1e0 2023-11-28T19:59:45.511 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:45.511+0000 7f332cf2a640 1 -- 172.21.15.78:0/3878008674 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f33280c6150 con 0x7f332814b1e0 2023-11-28T19:59:45.512 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:45.511+0000 7f3316ffd640 1 -- 172.21.15.78:0/3878008674 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v25) v1 ==== 100+0+11 (secure 0 0 0) 0x7f331c0bb0a0 con 0x7f332814b1e0 2023-11-28T19:59:45.512 INFO:teuthology.orchestra.run.smithi078.stdout:pg_num: 64 2023-11-28T19:59:45.514 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:45.511+0000 7f332cf2a640 1 -- 172.21.15.78:0/3878008674 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f33080664a0 msgr2=0x7f3308068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:45.514 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:45.511+0000 7f332cf2a640 1 --2- 172.21.15.78:0/3878008674 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f33080664a0 0x7f3308068960 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f33180011f0 tx=0x7f3318009040 comp rx=0 tx=0).stop 2023-11-28T19:59:45.514 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:45.511+0000 7f332cf2a640 1 -- 172.21.15.78:0/3878008674 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f332814b1e0 msgr2=0x7f33280707f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:45.514 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:45.511+0000 7f332cf2a640 1 --2- 172.21.15.78:0/3878008674 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f332814b1e0 0x7f33280707f0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f331c0097f0 tx=0x7f331c019180 comp rx=0 tx=0).stop 2023-11-28T19:59:45.514 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:45.511+0000 7f332cf2a640 1 -- 172.21.15.78:0/3878008674 shutdown_connections 2023-11-28T19:59:45.515 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:45.511+0000 7f332cf2a640 1 --2- 172.21.15.78:0/3878008674 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f33080664a0 0x7f3308068960 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:45.515 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:45.511+0000 7f332cf2a640 1 --2- 172.21.15.78:0/3878008674 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f33281548c0 0x7f3328070d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:45.515 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:45.511+0000 7f332cf2a640 1 --2- 172.21.15.78:0/3878008674 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f332814b1e0 0x7f33280707f0 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:45.515 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:45.511+0000 7f332cf2a640 1 --2- 172.21.15.78:0/3878008674 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f33280c5300 0x7f3328152f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:45.515 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:45.511+0000 7f332cf2a640 1 -- 172.21.15.78:0/3878008674 >> 172.21.15.78:0/3878008674 conn(0x7f33280c59f0 msgr2=0x7f3328149940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T19:59:45.515 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:45.511+0000 7f332cf2a640 1 -- 172.21.15.78:0/3878008674 shutdown_connections 2023-11-28T19:59:45.516 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:45.511+0000 7f332cf2a640 1 -- 172.21.15.78:0/3878008674 wait complete. 2023-11-28T19:59:45.533 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-11-28T19:59:45.673 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:45.671+0000 7f535ba79640 1 Processor -- start 2023-11-28T19:59:45.673 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:45.671+0000 7f535ba79640 1 -- start start 2023-11-28T19:59:45.675 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:45.671+0000 7f535ba79640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f535414f850 0x7f53540aacf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:45.675 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:45.671+0000 7f535ba79640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f535406d840 0x7f53540c43e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:45.676 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:45.671+0000 7f535ba79640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5354152910 con 0x7f535414fc30 2023-11-28T19:59:45.676 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:45.671+0000 7f535ba79640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f53540c2240 con 0x7f535414f850 2023-11-28T19:59:45.676 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:45.671+0000 7f535ba79640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5354152bf0 con 0x7f535406d840 2023-11-28T19:59:45.676 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:45.671+0000 7f5359815640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f535414f850 0x7f53540aacf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:45.676 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:45.671+0000 7f5359014640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f535414fc30 0x7f53540c3cd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:39328/0 (socket says 172.21.15.78:39328) 2023-11-28T19:59:45.676 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:45.671+0000 7f5359014640 1 -- 172.21.15.78:0/2511803232 learned_addr learned my addr 172.21.15.78:0/2511803232 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-11-28T19:59:45.676 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:45.671+0000 7f535a016640 1 --2- 172.21.15.78:0/2511803232 >> v2:172.21.15.179:3300/0 conn(0x7f535406d840 0x7f53540c43e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:45.677 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:45.671+0000 7f5359815640 1 -- 172.21.15.78:0/2511803232 >> v2:172.21.15.179:3300/0 conn(0x7f535406d840 msgr2=0x7f53540c43e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T19:59:45.677 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:45.671+0000 7f5359815640 1 --2- 172.21.15.78:0/2511803232 >> v2:172.21.15.179:3300/0 conn(0x7f535406d840 0x7f53540c43e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:45.677 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:45.671+0000 7f5358813640 1 -- 172.21.15.78:0/2511803232 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3866869234 0 0) 0x7f5354152910 con 0x7f535414fc30 2023-11-28T19:59:45.677 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:45.675+0000 7f5359815640 1 -- 172.21.15.78:0/2511803232 >> v1:172.21.15.78:6789/0 conn(0x7f535414fc30 legacy=0x7f53540c3cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:45.677 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:45.675+0000 7f5359815640 1 -- 172.21.15.78:0/2511803232 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5354152ed0 con 0x7f535414f850 2023-11-28T19:59:45.679 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:45.675+0000 7f5359815640 1 --2- 172.21.15.78:0/2511803232 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f535414f850 0x7f53540aacf0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f53540c2440 tx=0x7f535001c460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f14cc59e895504f7 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:59:45.679 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:45.675+0000 7f5358813640 1 -- 172.21.15.78:0/2511803232 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53500ab680 con 0x7f535414f850 2023-11-28T19:59:45.680 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:45.675+0000 7f5358813640 1 -- 172.21.15.78:0/2511803232 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f53500ab7e0 con 0x7f535414f850 2023-11-28T19:59:45.680 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:45.675+0000 7f5358813640 1 -- 172.21.15.78:0/2511803232 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53500abb70 con 0x7f535414f850 2023-11-28T19:59:45.680 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:45.675+0000 7f535ba79640 1 -- 172.21.15.78:0/2511803232 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f535414f850 msgr2=0x7f53540aacf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:45.680 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:45.675+0000 7f535ba79640 1 --2- 172.21.15.78:0/2511803232 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f535414f850 0x7f53540aacf0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f53540c2440 tx=0x7f535001c460 comp rx=0 tx=0).stop 2023-11-28T19:59:45.680 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:45.675+0000 7f535ba79640 1 -- 172.21.15.78:0/2511803232 shutdown_connections 2023-11-28T19:59:45.681 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:45.675+0000 7f535ba79640 1 --2- 172.21.15.78:0/2511803232 >> v2:172.21.15.179:3300/0 conn(0x7f535406d840 0x7f53540c43e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:45.681 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:45.675+0000 7f535ba79640 1 --2- 172.21.15.78:0/2511803232 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f535414f850 0x7f53540aacf0 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:45.681 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:45.675+0000 7f535ba79640 1 -- 172.21.15.78:0/2511803232 >> 172.21.15.78:0/2511803232 conn(0x7f53540c59f0 msgr2=0x7f53540c5e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T19:59:45.681 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:45.675+0000 7f535ba79640 1 -- 172.21.15.78:0/2511803232 shutdown_connections 2023-11-28T19:59:45.681 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:45.679+0000 7f535ba79640 1 -- 172.21.15.78:0/2511803232 wait complete. 2023-11-28T19:59:45.688 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:45.679+0000 7f535ba79640 1 Processor -- start 2023-11-28T19:59:45.688 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:45.679+0000 7f535ba79640 1 -- start start 2023-11-28T19:59:45.688 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:45.679+0000 7f535ba79640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f535406d840 0x7f53541586d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:45.688 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:45.679+0000 7f535ba79640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f535414f850 0x7f53540a5f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:45.688 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:45.679+0000 7f535ba79640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f535414fc30 0x7f535406fac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:45.688 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:45.679+0000 7f535ba79640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5354157220 con 0x7f535414fc30 2023-11-28T19:59:45.688 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:45.679+0000 7f535ba79640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f535414bf20 con 0x7f535414f850 2023-11-28T19:59:45.689 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:45.679+0000 7f535ba79640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53541565d0 con 0x7f535406d840 2023-11-28T19:59:45.689 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:45.679+0000 7f535a016640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f535414fc30 0x7f535406fac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:45.689 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:45.679+0000 7f535a016640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f535414fc30 0x7f535406fac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:45176/0 (socket says 172.21.15.78:45176) 2023-11-28T19:59:45.689 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:45.679+0000 7f535a016640 1 -- 172.21.15.78:0/4068783904 learned_addr learned my addr 172.21.15.78:0/4068783904 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T19:59:45.689 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:45.679+0000 7f5359014640 1 --2- 172.21.15.78:0/4068783904 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f535414f850 0x7f53540a5f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:45.689 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:45.679+0000 7f5359815640 1 --2- 172.21.15.78:0/4068783904 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f535406d840 0x7f53541586d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:45.690 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:45.679+0000 7f535a016640 1 -- 172.21.15.78:0/4068783904 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f535406d840 msgr2=0x7f53541586d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:45.690 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:45.679+0000 7f535a016640 1 --2- 172.21.15.78:0/4068783904 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f535406d840 0x7f53541586d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:45.690 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:45.679+0000 7f535a016640 1 -- 172.21.15.78:0/4068783904 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f535414f850 msgr2=0x7f53540a5f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:45.690 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:45.679+0000 7f535a016640 1 --2- 172.21.15.78:0/4068783904 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f535414f850 0x7f53540a5f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:45.690 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:45.679+0000 7f535a016640 1 -- 172.21.15.78:0/4068783904 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5350009420 con 0x7f535414fc30 2023-11-28T19:59:45.690 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:45.679+0000 7f5359815640 1 --2- 172.21.15.78:0/4068783904 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f535406d840 0x7f53541586d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T19:59:45.691 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:45.679+0000 7f535a016640 1 --2- 172.21.15.78:0/4068783904 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f535414fc30 0x7f535406fac0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f534c007e40 tx=0x7f534c00e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:59:45.691 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:45.679+0000 7f534a7fc640 1 -- 172.21.15.78:0/4068783904 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f534c014620 con 0x7f535414fc30 2023-11-28T19:59:45.691 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:45.679+0000 7f534a7fc640 1 -- 172.21.15.78:0/4068783904 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f534c00ee90 con 0x7f535414fc30 2023-11-28T19:59:45.691 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:45.679+0000 7f534a7fc640 1 -- 172.21.15.78:0/4068783904 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f534c0149e0 con 0x7f535414fc30 2023-11-28T19:59:45.691 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:45.679+0000 7f535ba79640 1 -- 172.21.15.78:0/4068783904 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f53541568b0 con 0x7f535414fc30 2023-11-28T19:59:45.691 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:45.679+0000 7f535ba79640 1 -- 172.21.15.78:0/4068783904 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f53540a6440 con 0x7f535414fc30 2023-11-28T19:59:45.691 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:45.683+0000 7f535ba79640 1 -- 172.21.15.78:0/4068783904 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5354067630 con 0x7f535414fc30 2023-11-28T19:59:45.691 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:45.683+0000 7f534a7fc640 1 -- 172.21.15.78:0/4068783904 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f534c014b40 con 0x7f535414fc30 2023-11-28T19:59:45.691 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:45.683+0000 7f534a7fc640 1 --2- 172.21.15.78:0/4068783904 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f53380664a0 0x7f5338068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:45.692 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:45.683+0000 7f534a7fc640 1 -- 172.21.15.78:0/4068783904 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f534c084a50 con 0x7f535414fc30 2023-11-28T19:59:45.692 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:45.683+0000 7f5359815640 1 --2- 172.21.15.78:0/4068783904 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f53380664a0 0x7f5338068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:45.692 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:45.683+0000 7f5359815640 1 --2- 172.21.15.78:0/4068783904 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f53380664a0 0x7f5338068960 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f53500af000 tx=0x7f53500a7000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:59:45.692 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:45.687+0000 7f534a7fc640 1 -- 172.21.15.78:0/4068783904 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f534c051c70 con 0x7f535414fc30 2023-11-28T19:59:45.848 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:45.847+0000 7f535ba79640 1 -- 172.21.15.78:0/4068783904 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f53540a4a90 con 0x7f535414fc30 2023-11-28T19:59:45.849 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:45.847+0000 7f534a7fc640 1 -- 172.21.15.78:0/4068783904 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v25) v1 ==== 103+0+11 (secure 0 0 0) 0x7f534c055290 con 0x7f535414fc30 2023-11-28T19:59:45.849 INFO:teuthology.orchestra.run.smithi078.stdout:pg_num: 32 2023-11-28T19:59:45.850 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:45.847+0000 7f535ba79640 1 -- 172.21.15.78:0/4068783904 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f53380664a0 msgr2=0x7f5338068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:45.851 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:45.847+0000 7f535ba79640 1 --2- 172.21.15.78:0/4068783904 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f53380664a0 0x7f5338068960 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f53500af000 tx=0x7f53500a7000 comp rx=0 tx=0).stop 2023-11-28T19:59:45.851 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:45.847+0000 7f535ba79640 1 -- 172.21.15.78:0/4068783904 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f535414fc30 msgr2=0x7f535406fac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:45.851 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:45.847+0000 7f535ba79640 1 --2- 172.21.15.78:0/4068783904 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f535414fc30 0x7f535406fac0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f534c007e40 tx=0x7f534c00e4b0 comp rx=0 tx=0).stop 2023-11-28T19:59:45.851 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:45.847+0000 7f535ba79640 1 -- 172.21.15.78:0/4068783904 shutdown_connections 2023-11-28T19:59:45.851 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:45.847+0000 7f535ba79640 1 --2- 172.21.15.78:0/4068783904 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f53380664a0 0x7f5338068960 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:45.851 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:45.847+0000 7f535ba79640 1 --2- 172.21.15.78:0/4068783904 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f535414fc30 0x7f535406fac0 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:45.851 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:45.847+0000 7f535ba79640 1 --2- 172.21.15.78:0/4068783904 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f535414f850 0x7f53540a5f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:45.851 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:45.847+0000 7f535ba79640 1 --2- 172.21.15.78:0/4068783904 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f535406d840 0x7f53541586d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:45.852 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:45.847+0000 7f535ba79640 1 -- 172.21.15.78:0/4068783904 >> 172.21.15.78:0/4068783904 conn(0x7f53540c59f0 msgr2=0x7f53540a5530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T19:59:45.852 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:45.847+0000 7f535ba79640 1 -- 172.21.15.78:0/4068783904 shutdown_connections 2023-11-28T19:59:45.852 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:45.847+0000 7f535ba79640 1 -- 172.21.15.78:0/4068783904 wait complete. 2023-11-28T19:59:45.927 INFO:tasks.cephfs_test_runner:Starting test: test_mount_all_caps_absent (tasks.cephfs.test_multifs_auth.TestClientsWithoutAuth) 2023-11-28T19:59:45.927 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-28T19:59:46.068 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:46.067+0000 7f81fd6fd640 1 Processor -- start 2023-11-28T19:59:46.068 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:46.067+0000 7f81fd6fd640 1 -- start start 2023-11-28T19:59:46.071 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:46.067+0000 7f81fd6fd640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f81f8151ec0 0x7f81f8155100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:46.071 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:46.067+0000 7f81fd6fd640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f81f8155640 con 0x7f81f806b320 2023-11-28T19:59:46.071 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:46.067+0000 7f81fd6fd640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f81f80c8aa0 con 0x7f81f80c47c0 2023-11-28T19:59:46.072 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:46.067+0000 7f81fd6fd640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81f80c9060 con 0x7f81f8151ec0 2023-11-28T19:59:46.072 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:46.067+0000 7f81f77fe640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f81f806b320 0x7f81f80c7f60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:39334/0 (socket says 172.21.15.78:39334) 2023-11-28T19:59:46.072 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:46.067+0000 7f81f77fe640 1 -- 172.21.15.78:0/3019064848 learned_addr learned my addr 172.21.15.78:0/3019064848 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-11-28T19:59:46.072 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:46.067+0000 7f81f6ffd640 1 --2- 172.21.15.78:0/3019064848 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f81f8151ec0 0x7f81f8155100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:46.072 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:46.067+0000 7f81f67fc640 1 -- 172.21.15.78:0/3019064848 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 674644687 0 0) 0x7f81f00014a0 con 0x7f81f806b320 2023-11-28T19:59:46.072 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:46.067+0000 7f81f67fc640 1 -- 172.21.15.78:0/3019064848 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f81e4003530 con 0x7f81f806b320 2023-11-28T19:59:46.072 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:46.067+0000 7f81f67fc640 1 -- 172.21.15.78:0/3019064848 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1934346097 0 0) 0x7f81f80c8aa0 con 0x7f81f80c47c0 2023-11-28T19:59:46.073 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:46.067+0000 7f81f67fc640 1 -- 172.21.15.78:0/3019064848 --> v1:172.21.15.179:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f81f00014a0 con 0x7f81f80c47c0 2023-11-28T19:59:46.073 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:46.067+0000 7f81f6ffd640 1 -- 172.21.15.78:0/3019064848 >> v1:172.21.15.179:6789/0 conn(0x7f81f80c47c0 legacy=0x7f81f80c94f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:46.073 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:46.067+0000 7f81f6ffd640 1 -- 172.21.15.78:0/3019064848 >> v1:172.21.15.78:6789/0 conn(0x7f81f806b320 legacy=0x7f81f80c7f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:46.073 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:46.067+0000 7f81f6ffd640 1 -- 172.21.15.78:0/3019064848 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81f80c4d30 con 0x7f81f8151ec0 2023-11-28T19:59:46.074 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:46.071+0000 7f81f6ffd640 1 --2- 172.21.15.78:0/3019064848 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f81f8151ec0 0x7f81f8155100 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f81e8009820 tx=0x7f81e801c4a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f6f41443c8f0771b server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:59:46.074 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:46.071+0000 7f81f67fc640 1 -- 172.21.15.78:0/3019064848 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81e80a6040 con 0x7f81f8151ec0 2023-11-28T19:59:46.074 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:46.071+0000 7f81f67fc640 1 -- 172.21.15.78:0/3019064848 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f81e80aa600 con 0x7f81f8151ec0 2023-11-28T19:59:46.074 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:46.071+0000 7f81f67fc640 1 -- 172.21.15.78:0/3019064848 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81e80aa990 con 0x7f81f8151ec0 2023-11-28T19:59:46.075 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:46.071+0000 7f81fd6fd640 1 -- 172.21.15.78:0/3019064848 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f81f8151ec0 msgr2=0x7f81f8155100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:46.075 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:46.071+0000 7f81fd6fd640 1 --2- 172.21.15.78:0/3019064848 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f81f8151ec0 0x7f81f8155100 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f81e8009820 tx=0x7f81e801c4a0 comp rx=0 tx=0).stop 2023-11-28T19:59:46.075 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:46.071+0000 7f81fd6fd640 1 -- 172.21.15.78:0/3019064848 shutdown_connections 2023-11-28T19:59:46.075 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:46.071+0000 7f81fd6fd640 1 --2- 172.21.15.78:0/3019064848 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f81f8151ec0 0x7f81f8155100 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:46.075 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:46.071+0000 7f81fd6fd640 1 -- 172.21.15.78:0/3019064848 >> 172.21.15.78:0/3019064848 conn(0x7f81f80c9e40 msgr2=0x7f81f80ca250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T19:59:46.075 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:46.071+0000 7f81fd6fd640 1 -- 172.21.15.78:0/3019064848 shutdown_connections 2023-11-28T19:59:46.075 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:46.071+0000 7f81fd6fd640 1 -- 172.21.15.78:0/3019064848 wait complete. 2023-11-28T19:59:46.076 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:46.075+0000 7f81fd6fd640 1 Processor -- start 2023-11-28T19:59:46.076 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:46.075+0000 7f81fd6fd640 1 -- start start 2023-11-28T19:59:46.078 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:46.075+0000 7f81fd6fd640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f81f806b320 0x7f81f81ed580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:46.078 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:46.075+0000 7f81fd6fd640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f81f80c47c0 0x7f81f806bf70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:46.078 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:46.075+0000 7f81fd6fd640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f81f8151ec0 0x7f81f814b580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:46.078 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:46.075+0000 7f81fd6fd640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81f8153740 con 0x7f81f80c47c0 2023-11-28T19:59:46.078 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:46.075+0000 7f81fd6fd640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81f81edac0 con 0x7f81f8151ec0 2023-11-28T19:59:46.078 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:46.075+0000 7f81fd6fd640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81f8144170 con 0x7f81f806b320 2023-11-28T19:59:46.078 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:46.075+0000 7f81effff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f81f80c47c0 0x7f81f806bf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:46.078 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:46.075+0000 7f81effff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f81f80c47c0 0x7f81f806bf70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:45180/0 (socket says 172.21.15.78:45180) 2023-11-28T19:59:46.078 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:46.075+0000 7f81effff640 1 -- 172.21.15.78:0/4008620087 learned_addr learned my addr 172.21.15.78:0/4008620087 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T19:59:46.078 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:46.075+0000 7f81f6ffd640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f81f806b320 0x7f81f81ed580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:46.078 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:46.075+0000 7f81f77fe640 1 --2- 172.21.15.78:0/4008620087 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f81f8151ec0 0x7f81f814b580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:46.079 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:46.075+0000 7f81effff640 1 -- 172.21.15.78:0/4008620087 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f81f806b320 msgr2=0x7f81f81ed580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:46.079 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:46.075+0000 7f81effff640 1 --2- 172.21.15.78:0/4008620087 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f81f806b320 0x7f81f81ed580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:46.079 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:46.075+0000 7f81effff640 1 -- 172.21.15.78:0/4008620087 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f81f8151ec0 msgr2=0x7f81f814b580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:46.079 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:46.075+0000 7f81effff640 1 --2- 172.21.15.78:0/4008620087 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f81f8151ec0 0x7f81f814b580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:46.079 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:46.075+0000 7f81effff640 1 -- 172.21.15.78:0/4008620087 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81e8009420 con 0x7f81f80c47c0 2023-11-28T19:59:46.079 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:46.075+0000 7f81effff640 1 --2- 172.21.15.78:0/4008620087 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f81f80c47c0 0x7f81f806bf70 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f81e000c490 tx=0x7f81e000c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:59:46.080 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:46.075+0000 7f81ef7fe640 1 -- 172.21.15.78:0/4008620087 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81e00052d0 con 0x7f81f80c47c0 2023-11-28T19:59:46.080 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:46.075+0000 7f81ef7fe640 1 -- 172.21.15.78:0/4008620087 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f81e0005430 con 0x7f81f80c47c0 2023-11-28T19:59:46.080 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:46.075+0000 7f81fd6fd640 1 -- 172.21.15.78:0/4008620087 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f81f8152dc0 con 0x7f81f80c47c0 2023-11-28T19:59:46.080 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:46.075+0000 7f81ef7fe640 1 -- 172.21.15.78:0/4008620087 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81e0012870 con 0x7f81f80c47c0 2023-11-28T19:59:46.080 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:46.075+0000 7f81fd6fd640 1 -- 172.21.15.78:0/4008620087 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f81f8144470 con 0x7f81f80c47c0 2023-11-28T19:59:46.080 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:46.079+0000 7f81fd6fd640 1 -- 172.21.15.78:0/4008620087 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f81f8067630 con 0x7f81f80c47c0 2023-11-28T19:59:46.081 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:46.079+0000 7f81ef7fe640 1 -- 172.21.15.78:0/4008620087 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f81e00129d0 con 0x7f81f80c47c0 2023-11-28T19:59:46.081 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:46.079+0000 7f81ef7fe640 1 --2- 172.21.15.78:0/4008620087 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f81d80664a0 0x7f81d8068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:46.081 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:46.079+0000 7f81ef7fe640 1 -- 172.21.15.78:0/4008620087 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f81e0083bc0 con 0x7f81f80c47c0 2023-11-28T19:59:46.081 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:46.079+0000 7f81f6ffd640 1 --2- 172.21.15.78:0/4008620087 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f81d80664a0 0x7f81d8068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:46.082 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:46.079+0000 7f81f6ffd640 1 --2- 172.21.15.78:0/4008620087 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f81d80664a0 0x7f81d8068960 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f81e80ae000 tx=0x7f81e80b5040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:59:46.085 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:46.083+0000 7f81ef7fe640 1 -- 172.21.15.78:0/4008620087 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f81e0050df0 con 0x7f81f80c47c0 2023-11-28T19:59:46.235 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:46.235+0000 7f81fd6fd640 1 -- 172.21.15.78:0/4008620087 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f81f8152b10 con 0x7f81f80c47c0 2023-11-28T19:59:46.237 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:46.235+0000 7f81ef7fe640 1 -- 172.21.15.78:0/4008620087 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+18322 (secure 0 0 0) 0x7f81e0054410 con 0x7f81f80c47c0 2023-11-28T19:59:46.237 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-11-28T19:59:46.237 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":25,"fsid":"dd9780e8-3bda-44fa-a9f0-fa07d19d901d","created":"2023-11-28T19:58:40.969556+0000","modified":"2023-11-28T19:59:10.474525+0000","last_up_change":"2023-11-28T19:58:52.596716+0000","last_in_change":"2023-11-28T19:58:43.609275+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-28T19:58:54.011229+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-28T19:59:03.945559+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-28T19:59:04.481478+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-11-28T19:59:08.109152+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"e84245ac-b5da-429e-af18-39acaa2b33e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6800","nonce":3358701235},{"type":"v1","addr":"172.21.15.78:6801","nonce":3358701235}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6802","nonce":3358701235},{"type":"v1","addr":"172.21.15.78:6803","nonce":3358701235}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6806","nonce":3358701235},{"type":"v1","addr":"172.21.15.78:6807","nonce":3358701235}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6804","nonce":3358701235},{"type":"v1","addr":"172.21.15.78:6805","nonce":3358701235}]},"public_addr":"172.21.15.78:6801/3358701235","cluster_addr":"172.21.15.78:6803/3358701235","heartbeat_back_addr":"172.21.15.78:6807/3358701235","heartbeat_front_addr":"172.21.15.78:6805/3358701235","state":["exists","up"]},{"osd":1,"uuid":"e634831d-c4e2-48d9-870c-9556ae162981","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6808","nonce":3211476654},{"type":"v1","addr":"172.21.15.78:6809","nonce":3211476654}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6810","nonce":3211476654},{"type":"v1","addr":"172.21.15.78:6811","nonce":3211476654}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6814","nonce":3211476654},{"type":"v1","addr":"172.21.15.78:6815","nonce":3211476654}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6812","nonce":3211476654},{"type":"v1","addr":"172.21.15.78:6813","nonce":3211476654}]},"public_addr":"172.21.15.78:6809/3211476654","cluster_addr":"172.21.15.78:6811/3211476654","heartbeat_back_addr":"172.21.15.78:6815/3211476654","heartbeat_front_addr":"172.21.15.78:6813/3211476654","state":["exists","up"]},{"osd":2,"uuid":"274c8395-6534-41f0-b8fb-a00af8985aa8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6816","nonce":2532904479},{"type":"v1","addr":"172.21.15.78:6817","nonce":2532904479}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6818","nonce":2532904479},{"type":"v1","addr":"172.21.15.78:6819","nonce":2532904479}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6822","nonce":2532904479},{"type":"v1","addr":"172.21.15.78:6823","nonce":2532904479}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6820","nonce":2532904479},{"type":"v1","addr":"172.21.15.78:6821","nonce":2532904479}]},"public_addr":"172.21.15.78:6817/2532904479","cluster_addr":"172.21.15.78:6819/2532904479","heartbeat_back_addr":"172.21.15.78:6823/2532904479","heartbeat_front_addr":"172.21.15.78:6821/2532904479","state":["exists","up"]},{"osd":3,"uuid":"77acc9af-7d4d-4b18-8cf5-d62f5971b7c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6824","nonce":3442991267},{"type":"v1","addr":"172.21.15.78:6825","nonce":3442991267}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6826","nonce":3442991267},{"type":"v1","addr":"172.21.15.78:6827","nonce":3442991267}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6830","nonce":3442991267},{"type":"v1","addr":"172.21.15.78:6831","nonce":3442991267}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6828","nonce":3442991267},{"type":"v1","addr":"172.21.15.78:6829","nonce":3442991267}]},"public_addr":"172.21.15.78:6825/3442991267","cluster_addr":"172.21.15.78:6827/3442991267","heartbeat_back_addr":"172.21.15.78:6831/3442991267","heartbeat_front_addr":"172.21.15.78:6829/3442991267","state":["exists","up"]},{"osd":4,"uuid":"5c62bc66-6b34-4b7f-a66b-9a743969138c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":802983577},{"type":"v1","addr":"172.21.15.179:6809","nonce":802983577}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":802983577},{"type":"v1","addr":"172.21.15.179:6811","nonce":802983577}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":802983577},{"type":"v1","addr":"172.21.15.179:6815","nonce":802983577}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":802983577},{"type":"v1","addr":"172.21.15.179:6813","nonce":802983577}]},"public_addr":"172.21.15.179:6809/802983577","cluster_addr":"172.21.15.179:6811/802983577","heartbeat_back_addr":"172.21.15.179:6815/802983577","heartbeat_front_addr":"172.21.15.179:6813/802983577","state":["exists","up"]},{"osd":5,"uuid":"67db6d36-f684-4079-b0cd-82b4dd61461f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":518192887},{"type":"v1","addr":"172.21.15.179:6818","nonce":518192887}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":518192887},{"type":"v1","addr":"172.21.15.179:6822","nonce":518192887}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":518192887},{"type":"v1","addr":"172.21.15.179:6829","nonce":518192887}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6824","nonce":518192887},{"type":"v1","addr":"172.21.15.179:6826","nonce":518192887}]},"public_addr":"172.21.15.179:6818/518192887","cluster_addr":"172.21.15.179:6822/518192887","heartbeat_back_addr":"172.21.15.179:6829/518192887","heartbeat_front_addr":"172.21.15.179:6826/518192887","state":["exists","up"]},{"osd":6,"uuid":"12e670af-5a16-4c81-9f97-defa66cab967","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":815435378},{"type":"v1","addr":"172.21.15.179:6801","nonce":815435378}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":815435378},{"type":"v1","addr":"172.21.15.179:6803","nonce":815435378}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":815435378},{"type":"v1","addr":"172.21.15.179:6807","nonce":815435378}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":815435378},{"type":"v1","addr":"172.21.15.179:6805","nonce":815435378}]},"public_addr":"172.21.15.179:6801/815435378","cluster_addr":"172.21.15.179:6803/815435378","heartbeat_back_addr":"172.21.15.179:6807/815435378","heartbeat_front_addr":"172.21.15.179:6805/815435378","state":["exists","up"]},{"osd":7,"uuid":"fe630650-2eb3-49ad-8676-c341e6332eb1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6817","nonce":2848432339},{"type":"v1","addr":"172.21.15.179:6819","nonce":2848432339}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6821","nonce":2848432339},{"type":"v1","addr":"172.21.15.179:6823","nonce":2848432339}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":2848432339},{"type":"v1","addr":"172.21.15.179:6831","nonce":2848432339}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6825","nonce":2848432339},{"type":"v1","addr":"172.21.15.179:6827","nonce":2848432339}]},"public_addr":"172.21.15.179:6819/2848432339","cluster_addr":"172.21.15.179:6823/2848432339","heartbeat_back_addr":"172.21.15.179:6831/2848432339","heartbeat_front_addr":"172.21.15.179:6827/2848432339","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:58:49.255433+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:58:49.412880+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:58:49.559295+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:58:49.245237+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:58:49.184557+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:58:49.329851+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:58:49.366012+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:58:49.349604+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-28T19:59:46.239 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:46.235+0000 7f81fd6fd640 1 -- 172.21.15.78:0/4008620087 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f81d80664a0 msgr2=0x7f81d8068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:46.239 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:46.235+0000 7f81fd6fd640 1 --2- 172.21.15.78:0/4008620087 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f81d80664a0 0x7f81d8068960 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f81e80ae000 tx=0x7f81e80b5040 comp rx=0 tx=0).stop 2023-11-28T19:59:46.239 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:46.235+0000 7f81fd6fd640 1 -- 172.21.15.78:0/4008620087 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f81f80c47c0 msgr2=0x7f81f806bf70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:46.239 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:46.235+0000 7f81fd6fd640 1 --2- 172.21.15.78:0/4008620087 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f81f80c47c0 0x7f81f806bf70 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f81e000c490 tx=0x7f81e000c950 comp rx=0 tx=0).stop 2023-11-28T19:59:46.239 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:46.235+0000 7f81fd6fd640 1 -- 172.21.15.78:0/4008620087 shutdown_connections 2023-11-28T19:59:46.240 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:46.235+0000 7f81fd6fd640 1 --2- 172.21.15.78:0/4008620087 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f81d80664a0 0x7f81d8068960 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:46.240 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:46.235+0000 7f81fd6fd640 1 --2- 172.21.15.78:0/4008620087 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f81f8151ec0 0x7f81f814b580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:46.240 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:46.235+0000 7f81fd6fd640 1 --2- 172.21.15.78:0/4008620087 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f81f80c47c0 0x7f81f806bf70 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:46.240 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:46.235+0000 7f81fd6fd640 1 --2- 172.21.15.78:0/4008620087 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f81f806b320 0x7f81f81ed580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:46.240 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:46.235+0000 7f81fd6fd640 1 -- 172.21.15.78:0/4008620087 >> 172.21.15.78:0/4008620087 conn(0x7f81f80c9e40 msgr2=0x7f81f814e300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T19:59:46.241 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:46.235+0000 7f81fd6fd640 1 -- 172.21.15.78:0/4008620087 shutdown_connections 2023-11-28T19:59:46.241 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:46.235+0000 7f81fd6fd640 1 -- 172.21.15.78:0/4008620087 wait complete. 2023-11-28T19:59:46.258 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-28T19:58:54.011229+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-28T19:59:03.945559+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-11-28T19:59:04.481478+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-11-28T19:59:08.109152+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-11-28T19:59:46.259 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-28T19:59:46.398 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:46.395+0000 7f64f0f3e640 1 Processor -- start 2023-11-28T19:59:46.399 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:46.395+0000 7f64f0f3e640 1 -- start start 2023-11-28T19:59:46.401 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:46.399+0000 7f64f0f3e640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f64ec1516a0 0x7f64ec0c4180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:46.401 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:46.399+0000 7f64f0f3e640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f64ec0c46c0 0x7f64ec06bc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:46.401 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:46.399+0000 7f64f0f3e640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f64ec151b20 con 0x7f64ec14e2a0 2023-11-28T19:59:46.401 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:46.399+0000 7f64f0f3e640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f64ec151210 con 0x7f64ec0c46c0 2023-11-28T19:59:46.401 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:46.399+0000 7f64f0f3e640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f64ec14e680 con 0x7f64ec1516a0 2023-11-28T19:59:46.401 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:46.399+0000 7f64ead9d640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f64ec0c46c0 0x7f64ec06bc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:46.401 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:46.399+0000 7f64ead9d640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f64ec0c46c0 0x7f64ec06bc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:45192/0 (socket says 172.21.15.78:45192) 2023-11-28T19:59:46.401 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:46.399+0000 7f64ead9d640 1 -- 172.21.15.78:0/809956723 learned_addr learned my addr 172.21.15.78:0/809956723 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T19:59:46.401 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:46.399+0000 7f64e9d9b640 1 --2- 172.21.15.78:0/809956723 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f64ec1516a0 0x7f64ec0c4180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:46.401 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:46.399+0000 7f64ead9d640 1 -- 172.21.15.78:0/809956723 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f64ec1516a0 msgr2=0x7f64ec0c4180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T19:59:46.402 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:46.399+0000 7f64ead9d640 1 --2- 172.21.15.78:0/809956723 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f64ec1516a0 0x7f64ec0c4180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:46.402 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:46.399+0000 7f64ead9d640 1 -- 172.21.15.78:0/809956723 >> v1:172.21.15.179:6789/0 conn(0x7f64ec14e2a0 legacy=0x7f64ec0a9460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T19:59:46.402 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:46.399+0000 7f64ead9d640 1 -- 172.21.15.78:0/809956723 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64ec0a9b70 con 0x7f64ec0c46c0 2023-11-28T19:59:46.402 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:46.399+0000 7f64e9d9b640 1 --2- 172.21.15.78:0/809956723 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f64ec1516a0 0x7f64ec0c4180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T19:59:46.403 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:46.403+0000 7f64ead9d640 1 --2- 172.21.15.78:0/809956723 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f64ec0c46c0 0x7f64ec06bc80 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f64e400bb10 tx=0x7f64e401ebd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ff9e33abd82fcc0e server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:59:46.404 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:46.403+0000 7f64e959a640 1 -- 172.21.15.78:0/809956723 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64e40a79e0 con 0x7f64ec0c46c0 2023-11-28T19:59:46.404 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:46.403+0000 7f64e959a640 1 -- 172.21.15.78:0/809956723 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f64e40a7b40 con 0x7f64ec0c46c0 2023-11-28T19:59:46.404 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:46.403+0000 7f64e959a640 1 -- 172.21.15.78:0/809956723 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64e40af440 con 0x7f64ec0c46c0 2023-11-28T19:59:46.405 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:46.403+0000 7f64f0f3e640 1 -- 172.21.15.78:0/809956723 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f64ec0c46c0 msgr2=0x7f64ec06bc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:46.405 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:46.403+0000 7f64f0f3e640 1 --2- 172.21.15.78:0/809956723 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f64ec0c46c0 0x7f64ec06bc80 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f64e400bb10 tx=0x7f64e401ebd0 comp rx=0 tx=0).stop 2023-11-28T19:59:46.405 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:46.403+0000 7f64f0f3e640 1 -- 172.21.15.78:0/809956723 shutdown_connections 2023-11-28T19:59:46.405 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:46.403+0000 7f64f0f3e640 1 --2- 172.21.15.78:0/809956723 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f64ec0c46c0 0x7f64ec06bc80 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:46.405 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:46.403+0000 7f64f0f3e640 1 --2- 172.21.15.78:0/809956723 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f64ec1516a0 0x7f64ec0c4180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:46.405 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:46.403+0000 7f64f0f3e640 1 -- 172.21.15.78:0/809956723 >> 172.21.15.78:0/809956723 conn(0x7f64ec0c59f0 msgr2=0x7f64ec0c5e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T19:59:46.405 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:46.403+0000 7f64f0f3e640 1 -- 172.21.15.78:0/809956723 shutdown_connections 2023-11-28T19:59:46.405 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:46.403+0000 7f64f0f3e640 1 -- 172.21.15.78:0/809956723 wait complete. 2023-11-28T19:59:46.406 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:46.403+0000 7f64f0f3e640 1 Processor -- start 2023-11-28T19:59:46.406 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:46.403+0000 7f64f0f3e640 1 -- start start 2023-11-28T19:59:46.408 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:46.407+0000 7f64f0f3e640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f64ec0c46c0 0x7f64ec14b5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:46.408 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:46.407+0000 7f64f0f3e640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f64ec14e2a0 0x7f64ec0717b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:46.408 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:46.407+0000 7f64f0f3e640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f64ec1516a0 0x7f64ec147060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:46.408 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:46.407+0000 7f64f0f3e640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64ec0720f0 con 0x7f64ec1516a0 2023-11-28T19:59:46.409 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:46.407+0000 7f64f0f3e640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64ec14da70 con 0x7f64ec0c46c0 2023-11-28T19:59:46.409 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:46.407+0000 7f64f0f3e640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f64ec06ff60 con 0x7f64ec14e2a0 2023-11-28T19:59:46.409 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:46.407+0000 7f64ead9d640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f64ec1516a0 0x7f64ec147060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:46.409 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:46.407+0000 7f64ead9d640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f64ec1516a0 0x7f64ec147060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:45198/0 (socket says 172.21.15.78:45198) 2023-11-28T19:59:46.409 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:46.407+0000 7f64ead9d640 1 -- 172.21.15.78:0/2341605558 learned_addr learned my addr 172.21.15.78:0/2341605558 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T19:59:46.409 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:46.407+0000 7f64e9d9b640 1 --2- 172.21.15.78:0/2341605558 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f64ec14e2a0 0x7f64ec0717b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:46.409 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:46.407+0000 7f64ea59c640 1 --2- 172.21.15.78:0/2341605558 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f64ec0c46c0 0x7f64ec14b5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:46.409 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:46.407+0000 7f64ead9d640 1 -- 172.21.15.78:0/2341605558 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f64ec14e2a0 msgr2=0x7f64ec0717b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:46.409 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:46.407+0000 7f64ead9d640 1 --2- 172.21.15.78:0/2341605558 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f64ec14e2a0 0x7f64ec0717b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:46.409 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:46.407+0000 7f64ead9d640 1 -- 172.21.15.78:0/2341605558 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f64ec0c46c0 msgr2=0x7f64ec14b5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:46.409 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:46.407+0000 7f64ead9d640 1 --2- 172.21.15.78:0/2341605558 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f64ec0c46c0 0x7f64ec14b5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:46.409 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:46.407+0000 7f64ead9d640 1 -- 172.21.15.78:0/2341605558 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64e400b770 con 0x7f64ec1516a0 2023-11-28T19:59:46.410 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:46.407+0000 7f64ead9d640 1 --2- 172.21.15.78:0/2341605558 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f64ec1516a0 0x7f64ec147060 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f64e401d280 tx=0x7f64e401d410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:59:46.410 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:46.407+0000 7f64daffd640 1 -- 172.21.15.78:0/2341605558 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64e40ba680 con 0x7f64ec1516a0 2023-11-28T19:59:46.411 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:46.407+0000 7f64daffd640 1 -- 172.21.15.78:0/2341605558 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f64e40ba800 con 0x7f64ec1516a0 2023-11-28T19:59:46.411 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:46.407+0000 7f64daffd640 1 -- 172.21.15.78:0/2341605558 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64e40babb0 con 0x7f64ec1516a0 2023-11-28T19:59:46.411 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:46.407+0000 7f64f0f3e640 1 -- 172.21.15.78:0/2341605558 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f64ec072340 con 0x7f64ec1516a0 2023-11-28T19:59:46.411 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:46.407+0000 7f64f0f3e640 1 -- 172.21.15.78:0/2341605558 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f64ec1508b0 con 0x7f64ec1516a0 2023-11-28T19:59:46.411 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:46.407+0000 7f64f0f3e640 1 -- 172.21.15.78:0/2341605558 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f64ec067630 con 0x7f64ec1516a0 2023-11-28T19:59:46.411 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:46.407+0000 7f64daffd640 1 -- 172.21.15.78:0/2341605558 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f64e40bad10 con 0x7f64ec1516a0 2023-11-28T19:59:46.412 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:46.411+0000 7f64daffd640 1 --2- 172.21.15.78:0/2341605558 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f64cc066470 0x7f64cc068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:46.412 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:46.411+0000 7f64daffd640 1 -- 172.21.15.78:0/2341605558 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f64e411f880 con 0x7f64ec1516a0 2023-11-28T19:59:46.412 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:46.411+0000 7f64ea59c640 1 --2- 172.21.15.78:0/2341605558 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f64cc066470 0x7f64cc068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:46.412 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:46.411+0000 7f64ea59c640 1 --2- 172.21.15.78:0/2341605558 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f64cc066470 0x7f64cc068930 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f64dc005680 tx=0x7f64dc003dd0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:59:46.416 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:46.415+0000 7f64daffd640 1 -- 172.21.15.78:0/2341605558 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f64e40ecab0 con 0x7f64ec1516a0 2023-11-28T19:59:46.567 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:46.563+0000 7f64f0f3e640 1 -- 172.21.15.78:0/2341605558 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f64ec151b20 con 0x7f64ec1516a0 2023-11-28T19:59:46.567 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:46.567+0000 7f64daffd640 1 -- 172.21.15.78:0/2341605558 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v25) v1 ==== 93+0+10 (secure 0 0 0) 0x7f64ec151b20 con 0x7f64ec1516a0 2023-11-28T19:59:46.568 INFO:teuthology.orchestra.run.smithi078.stdout:pg_num: 1 2023-11-28T19:59:46.570 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:46.567+0000 7f64f0f3e640 1 -- 172.21.15.78:0/2341605558 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f64cc066470 msgr2=0x7f64cc068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:46.570 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:46.567+0000 7f64f0f3e640 1 --2- 172.21.15.78:0/2341605558 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f64cc066470 0x7f64cc068930 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f64dc005680 tx=0x7f64dc003dd0 comp rx=0 tx=0).stop 2023-11-28T19:59:46.570 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:46.567+0000 7f64f0f3e640 1 -- 172.21.15.78:0/2341605558 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f64ec1516a0 msgr2=0x7f64ec147060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:46.570 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:46.567+0000 7f64f0f3e640 1 --2- 172.21.15.78:0/2341605558 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f64ec1516a0 0x7f64ec147060 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f64e401d280 tx=0x7f64e401d410 comp rx=0 tx=0).stop 2023-11-28T19:59:46.570 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:46.567+0000 7f64f0f3e640 1 -- 172.21.15.78:0/2341605558 shutdown_connections 2023-11-28T19:59:46.571 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:46.567+0000 7f64f0f3e640 1 --2- 172.21.15.78:0/2341605558 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f64cc066470 0x7f64cc068930 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:46.571 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:46.567+0000 7f64f0f3e640 1 --2- 172.21.15.78:0/2341605558 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f64ec14e2a0 0x7f64ec0717b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:46.571 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:46.567+0000 7f64f0f3e640 1 --2- 172.21.15.78:0/2341605558 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f64ec1516a0 0x7f64ec147060 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:46.571 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:46.567+0000 7f64f0f3e640 1 --2- 172.21.15.78:0/2341605558 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f64ec0c46c0 0x7f64ec14b5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:46.571 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:46.567+0000 7f64f0f3e640 1 -- 172.21.15.78:0/2341605558 >> 172.21.15.78:0/2341605558 conn(0x7f64ec0c59f0 msgr2=0x7f64ec06c8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T19:59:46.571 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:46.567+0000 7f64f0f3e640 1 -- 172.21.15.78:0/2341605558 shutdown_connections 2023-11-28T19:59:46.572 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:46.567+0000 7f64f0f3e640 1 -- 172.21.15.78:0/2341605558 wait complete. 2023-11-28T19:59:46.589 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-28T19:59:46.729 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:46.727+0000 7f5bd6432640 1 Processor -- start 2023-11-28T19:59:46.729 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:46.727+0000 7f5bd6432640 1 -- start start 2023-11-28T19:59:46.730 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:46.727+0000 7f5bd6432640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5bd014fc30 0x7f5bd00c3cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:46.730 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:46.727+0000 7f5bd6432640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5bd0152910 con 0x7f5bd014f850 2023-11-28T19:59:46.730 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:46.727+0000 7f5bd6432640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5bd0152bf0 con 0x7f5bd006d840 2023-11-28T19:59:46.730 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:46.727+0000 7f5bd6432640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5bd00c2240 con 0x7f5bd014fc30 2023-11-28T19:59:46.730 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:46.727+0000 7f5bcffff640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f5bd014f850 0x7f5bd00aacf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:39336/0 (socket says 172.21.15.78:39336) 2023-11-28T19:59:46.730 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:46.727+0000 7f5bcffff640 1 -- 172.21.15.78:0/2551271741 learned_addr learned my addr 172.21.15.78:0/2551271741 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-11-28T19:59:46.731 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:46.727+0000 7f5bcf7fe640 1 --2- 172.21.15.78:0/2551271741 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5bd014fc30 0x7f5bd00c3cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:46.731 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:46.727+0000 7f5bceffd640 1 -- 172.21.15.78:0/2551271741 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1684053531 0 0) 0x7f5bd0152910 con 0x7f5bd014f850 2023-11-28T19:59:46.731 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:46.727+0000 7f5bceffd640 1 -- 172.21.15.78:0/2551271741 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5bb8003530 con 0x7f5bd014f850 2023-11-28T19:59:46.732 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:46.727+0000 7f5bceffd640 1 -- 172.21.15.78:0/2551271741 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1373283344 0 0) 0x7f5bd0152bf0 con 0x7f5bd006d840 2023-11-28T19:59:46.732 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:46.727+0000 7f5bceffd640 1 -- 172.21.15.78:0/2551271741 --> v1:172.21.15.179:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5bd0152910 con 0x7f5bd006d840 2023-11-28T19:59:46.732 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:46.727+0000 7f5bceffd640 1 -- 172.21.15.78:0/2551271741 <== mon.0 v1:172.21.15.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 727135630 0 0) 0x7f5bb8003530 con 0x7f5bd014f850 2023-11-28T19:59:46.732 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:46.727+0000 7f5bcf7fe640 1 -- 172.21.15.78:0/2551271741 >> v1:172.21.15.179:6789/0 conn(0x7f5bd006d840 legacy=0x7f5bd00c4210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:46.732 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:46.727+0000 7f5bcf7fe640 1 -- 172.21.15.78:0/2551271741 >> v1:172.21.15.78:6789/0 conn(0x7f5bd014f850 legacy=0x7f5bd00aacf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:46.732 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:46.727+0000 7f5bcf7fe640 1 -- 172.21.15.78:0/2551271741 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5bd0152ed0 con 0x7f5bd014fc30 2023-11-28T19:59:46.734 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:46.731+0000 7f5bcf7fe640 1 --2- 172.21.15.78:0/2551271741 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5bd014fc30 0x7f5bd00c3cd0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f5bc40097f0 tx=0x7f5bc401c3e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=90493772ac8bfe24 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:59:46.734 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:46.731+0000 7f5bceffd640 1 -- 172.21.15.78:0/2551271741 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bc0001680 con 0x7f5bd014fc30 2023-11-28T19:59:46.734 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:46.731+0000 7f5bceffd640 1 -- 172.21.15.78:0/2551271741 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5bc40ad480 con 0x7f5bd014fc30 2023-11-28T19:59:46.734 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:46.731+0000 7f5bceffd640 1 -- 172.21.15.78:0/2551271741 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bc40ad810 con 0x7f5bd014fc30 2023-11-28T19:59:46.736 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:46.731+0000 7f5bd6432640 1 -- 172.21.15.78:0/2551271741 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5bd014fc30 msgr2=0x7f5bd00c3cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:46.736 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:46.731+0000 7f5bd6432640 1 --2- 172.21.15.78:0/2551271741 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5bd014fc30 0x7f5bd00c3cd0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f5bc40097f0 tx=0x7f5bc401c3e0 comp rx=0 tx=0).stop 2023-11-28T19:59:46.736 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:46.731+0000 7f5bd6432640 1 -- 172.21.15.78:0/2551271741 shutdown_connections 2023-11-28T19:59:46.736 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:46.731+0000 7f5bd6432640 1 --2- 172.21.15.78:0/2551271741 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5bd014fc30 0x7f5bd00c3cd0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:46.736 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:46.731+0000 7f5bd6432640 1 -- 172.21.15.78:0/2551271741 >> 172.21.15.78:0/2551271741 conn(0x7f5bd00c59f0 msgr2=0x7f5bd00c5e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T19:59:46.736 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:46.731+0000 7f5bd6432640 1 -- 172.21.15.78:0/2551271741 shutdown_connections 2023-11-28T19:59:46.736 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:46.731+0000 7f5bd6432640 1 -- 172.21.15.78:0/2551271741 wait complete. 2023-11-28T19:59:46.737 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:46.735+0000 7f5bd6432640 1 Processor -- start 2023-11-28T19:59:46.737 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:46.735+0000 7f5bd6432640 1 -- start start 2023-11-28T19:59:46.739 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:46.735+0000 7f5bd6432640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5bd006d840 0x7f5bd0153d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:46.739 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:46.735+0000 7f5bd6432640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5bd014f850 0x7f5bd0070cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:46.739 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:46.735+0000 7f5bd6432640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5bd014fc30 0x7f5bd014aa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:46.739 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:46.735+0000 7f5bd6432640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5bd0072510 con 0x7f5bd006d840 2023-11-28T19:59:46.739 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:46.735+0000 7f5bd6432640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5bd00727f0 con 0x7f5bd014fc30 2023-11-28T19:59:46.739 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:46.735+0000 7f5bd6432640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5bd00704d0 con 0x7f5bd014f850 2023-11-28T19:59:46.739 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:46.735+0000 7f5bcffff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5bd006d840 0x7f5bd0153d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:46.739 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:46.735+0000 7f5bcffff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5bd006d840 0x7f5bd0153d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:45210/0 (socket says 172.21.15.78:45210) 2023-11-28T19:59:46.739 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:46.735+0000 7f5bcffff640 1 -- 172.21.15.78:0/664292171 learned_addr learned my addr 172.21.15.78:0/664292171 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T19:59:46.739 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:46.735+0000 7f5bcf7fe640 1 --2- 172.21.15.78:0/664292171 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5bd014f850 0x7f5bd0070cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:46.739 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:46.735+0000 7f5bd49cf640 1 --2- 172.21.15.78:0/664292171 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5bd014fc30 0x7f5bd014aa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:46.740 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:46.735+0000 7f5bcffff640 1 -- 172.21.15.78:0/664292171 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5bd014f850 msgr2=0x7f5bd0070cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:46.740 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:46.735+0000 7f5bcffff640 1 --2- 172.21.15.78:0/664292171 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5bd014f850 0x7f5bd0070cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:46.740 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:46.735+0000 7f5bcffff640 1 -- 172.21.15.78:0/664292171 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5bd014fc30 msgr2=0x7f5bd014aa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:46.740 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:46.735+0000 7f5bcffff640 1 --2- 172.21.15.78:0/664292171 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5bd014fc30 0x7f5bd014aa10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:46.740 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:46.735+0000 7f5bcffff640 1 -- 172.21.15.78:0/664292171 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5bc4009420 con 0x7f5bd006d840 2023-11-28T19:59:46.740 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:46.735+0000 7f5bcffff640 1 --2- 172.21.15.78:0/664292171 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5bd006d840 0x7f5bd0153d80 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f5bc000c780 tx=0x7f5bc000cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:59:46.740 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:46.735+0000 7f5bccff9640 1 -- 172.21.15.78:0/664292171 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bc0005cf0 con 0x7f5bd006d840 2023-11-28T19:59:46.740 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:46.735+0000 7f5bccff9640 1 -- 172.21.15.78:0/664292171 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5bc0005e50 con 0x7f5bd006d840 2023-11-28T19:59:46.740 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:46.735+0000 7f5bccff9640 1 -- 172.21.15.78:0/664292171 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bc00072b0 con 0x7f5bd006d840 2023-11-28T19:59:46.740 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:46.735+0000 7f5bd6432640 1 -- 172.21.15.78:0/664292171 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5bd00707b0 con 0x7f5bd006d840 2023-11-28T19:59:46.740 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:46.735+0000 7f5bd6432640 1 -- 172.21.15.78:0/664292171 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5bd0071210 con 0x7f5bd006d840 2023-11-28T19:59:46.741 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:46.739+0000 7f5bd6432640 1 -- 172.21.15.78:0/664292171 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5bd0067630 con 0x7f5bd006d840 2023-11-28T19:59:46.741 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:46.739+0000 7f5bccff9640 1 -- 172.21.15.78:0/664292171 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f5bc0007410 con 0x7f5bd006d840 2023-11-28T19:59:46.741 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:46.739+0000 7f5bccff9640 1 --2- 172.21.15.78:0/664292171 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f5bbc066470 0x7f5bbc068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:46.742 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:46.739+0000 7f5bccff9640 1 -- 172.21.15.78:0/664292171 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f5bc00838b0 con 0x7f5bd006d840 2023-11-28T19:59:46.742 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:46.739+0000 7f5bcf7fe640 1 --2- 172.21.15.78:0/664292171 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f5bbc066470 0x7f5bbc068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:46.742 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:46.739+0000 7f5bcf7fe640 1 --2- 172.21.15.78:0/664292171 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f5bbc066470 0x7f5bbc068930 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f5bc40af000 tx=0x7f5bc40a7000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:59:46.745 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:46.743+0000 7f5bccff9640 1 -- 172.21.15.78:0/664292171 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f5bc0054570 con 0x7f5bd006d840 2023-11-28T19:59:46.903 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:46.903+0000 7f5bd6432640 1 -- 172.21.15.78:0/664292171 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f5bd0072650 con 0x7f5bd006d840 2023-11-28T19:59:46.904 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:46.903+0000 7f5bccff9640 1 -- 172.21.15.78:0/664292171 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v26) v1 ==== 104+0+11 (secure 0 0 0) 0x7f5bc0017020 con 0x7f5bd006d840 2023-11-28T19:59:46.904 INFO:teuthology.orchestra.run.smithi078.stdout:pg_num: 32 2023-11-28T19:59:46.906 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:46.903+0000 7f5bd6432640 1 -- 172.21.15.78:0/664292171 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f5bbc066470 msgr2=0x7f5bbc068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:46.906 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:46.903+0000 7f5bd6432640 1 --2- 172.21.15.78:0/664292171 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f5bbc066470 0x7f5bbc068930 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f5bc40af000 tx=0x7f5bc40a7000 comp rx=0 tx=0).stop 2023-11-28T19:59:46.906 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:46.903+0000 7f5bd6432640 1 -- 172.21.15.78:0/664292171 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5bd006d840 msgr2=0x7f5bd0153d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:46.906 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:46.903+0000 7f5bd6432640 1 --2- 172.21.15.78:0/664292171 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5bd006d840 0x7f5bd0153d80 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f5bc000c780 tx=0x7f5bc000cc40 comp rx=0 tx=0).stop 2023-11-28T19:59:46.906 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:46.903+0000 7f5bd6432640 1 -- 172.21.15.78:0/664292171 shutdown_connections 2023-11-28T19:59:46.906 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:46.903+0000 7f5bd6432640 1 --2- 172.21.15.78:0/664292171 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f5bbc066470 0x7f5bbc068930 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:46.907 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:46.903+0000 7f5bd6432640 1 --2- 172.21.15.78:0/664292171 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5bd014f850 0x7f5bd0070cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:46.907 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:46.903+0000 7f5bd6432640 1 --2- 172.21.15.78:0/664292171 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5bd014fc30 0x7f5bd014aa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:46.907 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:46.903+0000 7f5bd6432640 1 --2- 172.21.15.78:0/664292171 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5bd006d840 0x7f5bd0153d80 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:46.907 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:46.903+0000 7f5bd6432640 1 -- 172.21.15.78:0/664292171 >> 172.21.15.78:0/664292171 conn(0x7f5bd00c59f0 msgr2=0x7f5bd014f120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T19:59:46.907 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:46.903+0000 7f5bd6432640 1 -- 172.21.15.78:0/664292171 shutdown_connections 2023-11-28T19:59:46.907 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:46.903+0000 7f5bd6432640 1 -- 172.21.15.78:0/664292171 wait complete. 2023-11-28T19:59:46.925 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-28T19:59:47.065 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:47.063+0000 7f2f6c3aa640 1 Processor -- start 2023-11-28T19:59:47.065 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:47.063+0000 7f2f6c3aa640 1 -- start start 2023-11-28T19:59:47.067 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:47.063+0000 7f2f6c3aa640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f2f6414b1e0 0x7f2f640c1700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:47.067 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:47.063+0000 7f2f6c3aa640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2f640a4e20 con 0x7f2f641548c0 2023-11-28T19:59:47.067 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:47.063+0000 7f2f6c3aa640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2f640a50e0 con 0x7f2f640c5300 2023-11-28T19:59:47.067 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:47.063+0000 7f2f6c3aa640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2f640c0f00 con 0x7f2f6414b1e0 2023-11-28T19:59:47.067 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:47.063+0000 7f2f6a947640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f2f641548c0 0x7f2f64154d30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:39340/0 (socket says 172.21.15.78:39340) 2023-11-28T19:59:47.067 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:47.063+0000 7f2f6a947640 1 -- 172.21.15.78:0/3696959299 learned_addr learned my addr 172.21.15.78:0/3696959299 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-11-28T19:59:47.067 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:47.067+0000 7f2f6a146640 1 --2- 172.21.15.78:0/3696959299 >> v2:172.21.15.179:3300/0 conn(0x7f2f6414b1e0 0x7f2f640c1700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:47.068 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:47.067+0000 7f2f69144640 1 -- 172.21.15.78:0/3696959299 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 264471275 0 0) 0x7f2f640a4e20 con 0x7f2f641548c0 2023-11-28T19:59:47.068 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:47.067+0000 7f2f69144640 1 -- 172.21.15.78:0/3696959299 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2f50003530 con 0x7f2f641548c0 2023-11-28T19:59:47.068 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:47.067+0000 7f2f69144640 1 -- 172.21.15.78:0/3696959299 <== mon.0 v1:172.21.15.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3035899214 0 0) 0x7f2f50003530 con 0x7f2f641548c0 2023-11-28T19:59:47.069 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:47.067+0000 7f2f6a146640 1 -- 172.21.15.78:0/3696959299 >> v1:172.21.15.179:6789/0 conn(0x7f2f640c5300 legacy=0x7f2f640a9c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:47.069 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:47.067+0000 7f2f6a146640 1 -- 172.21.15.78:0/3696959299 >> v1:172.21.15.78:6789/0 conn(0x7f2f641548c0 legacy=0x7f2f64154d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:47.069 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:47.067+0000 7f2f6a146640 1 -- 172.21.15.78:0/3696959299 --> v2:172.21.15.179:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f640c11e0 con 0x7f2f6414b1e0 2023-11-28T19:59:47.072 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:47.067+0000 7f2f6a146640 1 --2- 172.21.15.78:0/3696959299 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2f6414b1e0 0x7f2f640c1700 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f2f600097c0 tx=0x7f2f6001c250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6196d2c3637461b6 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:59:47.073 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:47.067+0000 7f2f69144640 1 -- 172.21.15.78:0/3696959299 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f5c001a00 con 0x7f2f6414b1e0 2023-11-28T19:59:47.073 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:47.067+0000 7f2f69144640 1 -- 172.21.15.78:0/3696959299 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f600a7050 con 0x7f2f6414b1e0 2023-11-28T19:59:47.073 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:47.071+0000 7f2f69144640 1 -- 172.21.15.78:0/3696959299 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f600ab620 con 0x7f2f6414b1e0 2023-11-28T19:59:47.073 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:47.071+0000 7f2f6c3aa640 1 -- 172.21.15.78:0/3696959299 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2f6414b1e0 msgr2=0x7f2f640c1700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:47.073 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:47.071+0000 7f2f6c3aa640 1 --2- 172.21.15.78:0/3696959299 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2f6414b1e0 0x7f2f640c1700 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f2f600097c0 tx=0x7f2f6001c250 comp rx=0 tx=0).stop 2023-11-28T19:59:47.074 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:47.071+0000 7f2f6c3aa640 1 -- 172.21.15.78:0/3696959299 shutdown_connections 2023-11-28T19:59:47.074 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:47.071+0000 7f2f6c3aa640 1 --2- 172.21.15.78:0/3696959299 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2f6414b1e0 0x7f2f640c1700 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:47.074 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:47.071+0000 7f2f6c3aa640 1 -- 172.21.15.78:0/3696959299 >> 172.21.15.78:0/3696959299 conn(0x7f2f640c59f0 msgr2=0x7f2f640c5e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T19:59:47.074 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:47.071+0000 7f2f6c3aa640 1 -- 172.21.15.78:0/3696959299 shutdown_connections 2023-11-28T19:59:47.074 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:47.071+0000 7f2f6c3aa640 1 -- 172.21.15.78:0/3696959299 wait complete. 2023-11-28T19:59:47.077 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:47.071+0000 7f2f6c3aa640 1 Processor -- start 2023-11-28T19:59:47.077 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:47.071+0000 7f2f6c3aa640 1 -- start start 2023-11-28T19:59:47.077 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:47.071+0000 7f2f6c3aa640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2f640c5300 0x7f2f64141290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:47.077 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:47.071+0000 7f2f6c3aa640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2f6414b1e0 0x7f2f6406bc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:47.077 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:47.071+0000 7f2f6c3aa640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2f641548c0 0x7f2f641453b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:47.077 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:47.071+0000 7f2f6c3aa640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f64140460 con 0x7f2f6414b1e0 2023-11-28T19:59:47.077 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:47.071+0000 7f2f6c3aa640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f64141920 con 0x7f2f641548c0 2023-11-28T19:59:47.077 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:47.071+0000 7f2f6c3aa640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f64141c00 con 0x7f2f640c5300 2023-11-28T19:59:47.078 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:47.071+0000 7f2f69945640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2f6414b1e0 0x7f2f6406bc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:47.078 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:47.071+0000 7f2f69945640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2f6414b1e0 0x7f2f6406bc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:45224/0 (socket says 172.21.15.78:45224) 2023-11-28T19:59:47.078 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:47.071+0000 7f2f69945640 1 -- 172.21.15.78:0/2519286148 learned_addr learned my addr 172.21.15.78:0/2519286148 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T19:59:47.078 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:47.075+0000 7f2f69945640 1 -- 172.21.15.78:0/2519286148 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2f640c5300 msgr2=0x7f2f64141290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:47.078 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:47.075+0000 7f2f6a146640 1 --2- 172.21.15.78:0/2519286148 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2f640c5300 0x7f2f64141290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:47.078 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:47.075+0000 7f2f6a947640 1 --2- 172.21.15.78:0/2519286148 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2f641548c0 0x7f2f641453b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:47.078 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:47.075+0000 7f2f69945640 1 --2- 172.21.15.78:0/2519286148 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2f640c5300 0x7f2f64141290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:47.079 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:47.075+0000 7f2f69945640 1 -- 172.21.15.78:0/2519286148 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2f641548c0 msgr2=0x7f2f641453b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:47.079 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:47.075+0000 7f2f69945640 1 --2- 172.21.15.78:0/2519286148 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2f641548c0 0x7f2f641453b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:47.079 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:47.075+0000 7f2f69945640 1 -- 172.21.15.78:0/2519286148 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f60009420 con 0x7f2f6414b1e0 2023-11-28T19:59:47.079 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:47.075+0000 7f2f6a146640 1 --2- 172.21.15.78:0/2519286148 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2f640c5300 0x7f2f64141290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T19:59:47.079 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:47.075+0000 7f2f6a947640 1 --2- 172.21.15.78:0/2519286148 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2f641548c0 0x7f2f641453b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T19:59:47.079 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:47.075+0000 7f2f69945640 1 --2- 172.21.15.78:0/2519286148 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2f6414b1e0 0x7f2f6406bc10 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f2f54009e00 tx=0x7f2f5400c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:59:47.079 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:47.075+0000 7f2f5affd640 1 -- 172.21.15.78:0/2519286148 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f5400cdb0 con 0x7f2f6414b1e0 2023-11-28T19:59:47.079 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:47.075+0000 7f2f5affd640 1 -- 172.21.15.78:0/2519286148 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f54004020 con 0x7f2f6414b1e0 2023-11-28T19:59:47.079 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:47.075+0000 7f2f6c3aa640 1 -- 172.21.15.78:0/2519286148 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2f64141ee0 con 0x7f2f6414b1e0 2023-11-28T19:59:47.080 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:47.075+0000 7f2f5affd640 1 -- 172.21.15.78:0/2519286148 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f54004410 con 0x7f2f6414b1e0 2023-11-28T19:59:47.080 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:47.075+0000 7f2f6c3aa640 1 -- 172.21.15.78:0/2519286148 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2f641458f0 con 0x7f2f6414b1e0 2023-11-28T19:59:47.080 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:47.075+0000 7f2f6c3aa640 1 -- 172.21.15.78:0/2519286148 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2f64067630 con 0x7f2f6414b1e0 2023-11-28T19:59:47.081 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:47.075+0000 7f2f5affd640 1 -- 172.21.15.78:0/2519286148 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f2f54003600 con 0x7f2f6414b1e0 2023-11-28T19:59:47.081 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:47.075+0000 7f2f5affd640 1 --2- 172.21.15.78:0/2519286148 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f2f48066470 0x7f2f48068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:47.081 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:47.075+0000 7f2f5affd640 1 -- 172.21.15.78:0/2519286148 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f2f540866a0 con 0x7f2f6414b1e0 2023-11-28T19:59:47.081 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:47.075+0000 7f2f6a146640 1 --2- 172.21.15.78:0/2519286148 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f2f48066470 0x7f2f48068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:47.081 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:47.079+0000 7f2f6a146640 1 --2- 172.21.15.78:0/2519286148 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f2f48066470 0x7f2f48068930 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f2f600ad000 tx=0x7f2f60008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:59:47.082 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:47.079+0000 7f2f5affd640 1 -- 172.21.15.78:0/2519286148 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f2f54053630 con 0x7f2f6414b1e0 2023-11-28T19:59:47.232 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:47.231+0000 7f2f6c3aa640 1 -- 172.21.15.78:0/2519286148 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f2f640c0470 con 0x7f2f6414b1e0 2023-11-28T19:59:47.233 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:47.231+0000 7f2f5affd640 1 -- 172.21.15.78:0/2519286148 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v26) v1 ==== 100+0+11 (secure 0 0 0) 0x7f2f540180a0 con 0x7f2f6414b1e0 2023-11-28T19:59:47.233 INFO:teuthology.orchestra.run.smithi078.stdout:pg_num: 64 2023-11-28T19:59:47.234 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:47.231+0000 7f2f6c3aa640 1 -- 172.21.15.78:0/2519286148 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f2f48066470 msgr2=0x7f2f48068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:47.235 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:47.231+0000 7f2f6c3aa640 1 --2- 172.21.15.78:0/2519286148 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f2f48066470 0x7f2f48068930 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f2f600ad000 tx=0x7f2f60008040 comp rx=0 tx=0).stop 2023-11-28T19:59:47.235 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:47.231+0000 7f2f6c3aa640 1 -- 172.21.15.78:0/2519286148 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2f6414b1e0 msgr2=0x7f2f6406bc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:47.235 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:47.231+0000 7f2f6c3aa640 1 --2- 172.21.15.78:0/2519286148 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2f6414b1e0 0x7f2f6406bc10 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f2f54009e00 tx=0x7f2f5400c430 comp rx=0 tx=0).stop 2023-11-28T19:59:47.235 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:47.231+0000 7f2f6c3aa640 1 -- 172.21.15.78:0/2519286148 shutdown_connections 2023-11-28T19:59:47.235 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:47.231+0000 7f2f6c3aa640 1 --2- 172.21.15.78:0/2519286148 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f2f48066470 0x7f2f48068930 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:47.235 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:47.231+0000 7f2f6c3aa640 1 --2- 172.21.15.78:0/2519286148 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2f641548c0 0x7f2f641453b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:47.235 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:47.231+0000 7f2f6c3aa640 1 --2- 172.21.15.78:0/2519286148 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2f6414b1e0 0x7f2f6406bc10 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:47.235 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:47.231+0000 7f2f6c3aa640 1 --2- 172.21.15.78:0/2519286148 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2f640c5300 0x7f2f64141290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:47.235 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:47.231+0000 7f2f6c3aa640 1 -- 172.21.15.78:0/2519286148 >> 172.21.15.78:0/2519286148 conn(0x7f2f640c59f0 msgr2=0x7f2f640c49e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T19:59:47.236 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:47.231+0000 7f2f6c3aa640 1 -- 172.21.15.78:0/2519286148 shutdown_connections 2023-11-28T19:59:47.236 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:47.231+0000 7f2f6c3aa640 1 -- 172.21.15.78:0/2519286148 wait complete. 2023-11-28T19:59:47.254 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-11-28T19:59:47.395 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:47.391+0000 7f0e85c67640 1 Processor -- start 2023-11-28T19:59:47.395 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:47.391+0000 7f0e85c67640 1 -- start start 2023-11-28T19:59:47.398 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:47.395+0000 7f0e85c67640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f0e800c47c0 0x7f0e800a7290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:47.398 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:47.395+0000 7f0e85c67640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0e8006fba0 0x7f0e80156f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:47.398 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:47.395+0000 7f0e85c67640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0e800c3180 con 0x7f0e800c7640 2023-11-28T19:59:47.398 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:47.395+0000 7f0e85c67640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0e800c69e0 con 0x7f0e800c47c0 2023-11-28T19:59:47.398 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:47.395+0000 7f0e85c67640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e800c2bc0 con 0x7f0e8006fba0 2023-11-28T19:59:47.398 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:47.395+0000 7f0e77fff640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f0e800c7640 0x7f0e800c0f20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:39354/0 (socket says 172.21.15.78:39354) 2023-11-28T19:59:47.398 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:47.395+0000 7f0e77fff640 1 -- 172.21.15.78:0/1019827948 learned_addr learned my addr 172.21.15.78:0/1019827948 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-11-28T19:59:47.399 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:47.395+0000 7f0e84c65640 1 --2- 172.21.15.78:0/1019827948 >> v2:172.21.15.179:3300/0 conn(0x7f0e800c47c0 0x7f0e800a7290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:47.399 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:47.395+0000 7f0e85466640 1 --2- 172.21.15.78:0/1019827948 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0e8006fba0 0x7f0e80156f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:47.399 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:47.395+0000 7f0e777fe640 1 -- 172.21.15.78:0/1019827948 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2530160648 0 0) 0x7f0e70001120 con 0x7f0e800c7640 2023-11-28T19:59:47.399 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:47.395+0000 7f0e777fe640 1 -- 172.21.15.78:0/1019827948 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0e68003530 con 0x7f0e800c7640 2023-11-28T19:59:47.399 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:47.395+0000 7f0e777fe640 1 -- 172.21.15.78:0/1019827948 <== mon.0 v1:172.21.15.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 520373454 0 0) 0x7f0e68003530 con 0x7f0e800c7640 2023-11-28T19:59:47.400 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:47.395+0000 7f0e777fe640 1 -- 172.21.15.78:0/1019827948 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0e8006fba0 msgr2=0x7f0e80156f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T19:59:47.400 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:47.395+0000 7f0e777fe640 1 --2- 172.21.15.78:0/1019827948 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0e8006fba0 0x7f0e80156f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:47.400 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:47.395+0000 7f0e777fe640 1 -- 172.21.15.78:0/1019827948 >> v2:172.21.15.179:3300/0 conn(0x7f0e800c47c0 msgr2=0x7f0e800a7290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T19:59:47.400 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:47.395+0000 7f0e777fe640 1 --2- 172.21.15.78:0/1019827948 >> v2:172.21.15.179:3300/0 conn(0x7f0e800c47c0 0x7f0e800a7290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:47.400 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:47.395+0000 7f0e777fe640 1 -- 172.21.15.78:0/1019827948 --> v1:172.21.15.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e800c2ea0 con 0x7f0e800c7640 2023-11-28T19:59:47.400 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:47.395+0000 7f0e777fe640 1 -- 172.21.15.78:0/1019827948 <== mon.0 v1:172.21.15.78:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3326804700 0 0) 0x7f0e70001810 con 0x7f0e800c7640 2023-11-28T19:59:47.400 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:47.395+0000 7f0e777fe640 1 -- 172.21.15.78:0/1019827948 >> v1:172.21.15.78:6789/0 conn(0x7f0e800c7640 legacy=0x7f0e800c0f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:47.401 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:47.395+0000 7f0e777fe640 1 --2- 172.21.15.78:0/1019827948 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0e68003980 0x7f0e68003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:47.401 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:47.395+0000 7f0e777fe640 1 --2- 172.21.15.78:0/1019827948 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0e680047d0 0x7f0e68004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:47.401 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:47.395+0000 7f0e777fe640 1 --2- 172.21.15.78:0/1019827948 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0e8006fba0 0x7f0e68005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:47.401 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:47.395+0000 7f0e777fe640 1 -- 172.21.15.78:0/1019827948 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e800c69e0 con 0x7f0e680047d0 2023-11-28T19:59:47.401 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:47.395+0000 7f0e777fe640 1 -- 172.21.15.78:0/1019827948 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e800c2bc0 con 0x7f0e68003980 2023-11-28T19:59:47.401 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:47.395+0000 7f0e777fe640 1 -- 172.21.15.78:0/1019827948 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e6800b990 con 0x7f0e8006fba0 2023-11-28T19:59:47.402 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:47.395+0000 7f0e77fff640 1 --2- 172.21.15.78:0/1019827948 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0e680047d0 0x7f0e68004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:47.402 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:47.395+0000 7f0e85466640 1 --2- 172.21.15.78:0/1019827948 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0e8006fba0 0x7f0e68005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:47.402 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:47.395+0000 7f0e84c65640 1 --2- 172.21.15.78:0/1019827948 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0e68003980 0x7f0e68003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:47.402 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:47.395+0000 7f0e77fff640 1 -- 172.21.15.78:0/1019827948 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0e8006fba0 msgr2=0x7f0e68005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T19:59:47.402 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:47.395+0000 7f0e77fff640 1 --2- 172.21.15.78:0/1019827948 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0e8006fba0 0x7f0e68005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:47.402 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:47.395+0000 7f0e77fff640 1 -- 172.21.15.78:0/1019827948 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0e68003980 msgr2=0x7f0e68003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T19:59:47.402 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:47.395+0000 7f0e77fff640 1 --2- 172.21.15.78:0/1019827948 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0e68003980 0x7f0e68003da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:47.402 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:47.395+0000 7f0e77fff640 1 -- 172.21.15.78:0/1019827948 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e68003530 con 0x7f0e680047d0 2023-11-28T19:59:47.402 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:47.395+0000 7f0e85466640 1 --2- 172.21.15.78:0/1019827948 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0e8006fba0 0x7f0e68005190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T19:59:47.402 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:47.395+0000 7f0e84c65640 1 --2- 172.21.15.78:0/1019827948 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0e68003980 0x7f0e68003da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T19:59:47.405 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:47.399+0000 7f0e77fff640 1 --2- 172.21.15.78:0/1019827948 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0e680047d0 0x7f0e68004c50 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f0e7000c190 tx=0x7f0e7001f370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=16d2c4a5f38e230c server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:59:47.405 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:47.399+0000 7f0e777fe640 1 -- 172.21.15.78:0/1019827948 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e700a8e90 con 0x7f0e680047d0 2023-11-28T19:59:47.405 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:47.399+0000 7f0e777fe640 1 -- 172.21.15.78:0/1019827948 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e700058e0 con 0x7f0e680047d0 2023-11-28T19:59:47.405 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:47.399+0000 7f0e777fe640 1 -- 172.21.15.78:0/1019827948 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e70005c70 con 0x7f0e680047d0 2023-11-28T19:59:47.405 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:47.399+0000 7f0e85c67640 1 -- 172.21.15.78:0/1019827948 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0e680047d0 msgr2=0x7f0e68004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:47.405 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:47.399+0000 7f0e85c67640 1 --2- 172.21.15.78:0/1019827948 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0e680047d0 0x7f0e68004c50 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f0e7000c190 tx=0x7f0e7001f370 comp rx=0 tx=0).stop 2023-11-28T19:59:47.405 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:47.399+0000 7f0e85466640 1 -- 172.21.15.78:0/1019827948 reap_dead start 2023-11-28T19:59:47.405 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:47.399+0000 7f0e85c67640 1 -- 172.21.15.78:0/1019827948 shutdown_connections 2023-11-28T19:59:47.405 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:47.399+0000 7f0e85c67640 1 -- 172.21.15.78:0/1019827948 >> 172.21.15.78:0/1019827948 conn(0x7f0e800c7af0 msgr2=0x7f0e800c7f00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T19:59:47.406 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:47.399+0000 7f0e85c67640 1 -- 172.21.15.78:0/1019827948 shutdown_connections 2023-11-28T19:59:47.406 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:47.399+0000 7f0e85c67640 1 -- 172.21.15.78:0/1019827948 wait complete. 2023-11-28T19:59:47.406 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:47.399+0000 7f0e85c67640 1 Processor -- start 2023-11-28T19:59:47.406 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:47.403+0000 7f0e85c67640 1 -- start start 2023-11-28T19:59:47.406 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:47.403+0000 7f0e85c67640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0e680047d0 0x7f0e80144820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:47.406 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:47.403+0000 7f0e85c67640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0e80144d60 0x7f0e80150f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:47.406 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:47.403+0000 7f0e85c67640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0e801514b0 0x7f0e8006b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:47.406 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:47.403+0000 7f0e85c67640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e800abf20 con 0x7f0e801514b0 2023-11-28T19:59:47.406 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:47.403+0000 7f0e85c67640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e801ea9f0 con 0x7f0e680047d0 2023-11-28T19:59:47.406 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:47.403+0000 7f0e85c67640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e801e9de0 con 0x7f0e80144d60 2023-11-28T19:59:47.406 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:47.403+0000 7f0e85466640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0e801514b0 0x7f0e8006b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:47.407 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:47.403+0000 7f0e85466640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0e801514b0 0x7f0e8006b9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:45228/0 (socket says 172.21.15.78:45228) 2023-11-28T19:59:47.408 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:47.403+0000 7f0e85466640 1 -- 172.21.15.78:0/3695452032 learned_addr learned my addr 172.21.15.78:0/3695452032 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T19:59:47.408 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:47.403+0000 7f0e77fff640 1 --2- 172.21.15.78:0/3695452032 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0e80144d60 0x7f0e80150f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:47.408 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:47.403+0000 7f0e84c65640 1 --2- 172.21.15.78:0/3695452032 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0e680047d0 0x7f0e80144820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:47.408 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:47.403+0000 7f0e85466640 1 -- 172.21.15.78:0/3695452032 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0e80144d60 msgr2=0x7f0e80150f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:47.409 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:47.403+0000 7f0e85466640 1 --2- 172.21.15.78:0/3695452032 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0e80144d60 0x7f0e80150f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:47.409 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:47.403+0000 7f0e85466640 1 -- 172.21.15.78:0/3695452032 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0e680047d0 msgr2=0x7f0e80144820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:47.409 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:47.403+0000 7f0e85466640 1 --2- 172.21.15.78:0/3695452032 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0e680047d0 0x7f0e80144820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:47.409 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:47.403+0000 7f0e85466640 1 -- 172.21.15.78:0/3695452032 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e801ea0c0 con 0x7f0e801514b0 2023-11-28T19:59:47.409 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:47.403+0000 7f0e77fff640 1 --2- 172.21.15.78:0/3695452032 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0e80144d60 0x7f0e80150f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T19:59:47.410 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:47.403+0000 7f0e85466640 1 --2- 172.21.15.78:0/3695452032 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0e801514b0 0x7f0e8006b9a0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f0e80070030 tx=0x7f0e78009f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:59:47.412 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:47.403+0000 7f0e757fa640 1 -- 172.21.15.78:0/3695452032 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e7800e030 con 0x7f0e801514b0 2023-11-28T19:59:47.412 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:47.403+0000 7f0e757fa640 1 -- 172.21.15.78:0/3695452032 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e78011e30 con 0x7f0e801514b0 2023-11-28T19:59:47.412 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:47.403+0000 7f0e757fa640 1 -- 172.21.15.78:0/3695452032 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e780166b0 con 0x7f0e801514b0 2023-11-28T19:59:47.412 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:47.403+0000 7f0e85c67640 1 -- 172.21.15.78:0/3695452032 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0e801ea3a0 con 0x7f0e801514b0 2023-11-28T19:59:47.413 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:47.403+0000 7f0e85c67640 1 -- 172.21.15.78:0/3695452032 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0e801e9a90 con 0x7f0e801514b0 2023-11-28T19:59:47.413 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:47.403+0000 7f0e85c67640 1 -- 172.21.15.78:0/3695452032 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0e800674b0 con 0x7f0e801514b0 2023-11-28T19:59:47.413 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:47.407+0000 7f0e757fa640 1 -- 172.21.15.78:0/3695452032 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f0e78016810 con 0x7f0e801514b0 2023-11-28T19:59:47.413 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:47.407+0000 7f0e757fa640 1 --2- 172.21.15.78:0/3695452032 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f0e6c0664a0 0x7f0e6c068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:47.413 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:47.407+0000 7f0e757fa640 1 -- 172.21.15.78:0/3695452032 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f0e7800f070 con 0x7f0e801514b0 2023-11-28T19:59:47.413 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:47.407+0000 7f0e84c65640 1 --2- 172.21.15.78:0/3695452032 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f0e6c0664a0 0x7f0e6c068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:47.413 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:47.407+0000 7f0e84c65640 1 --2- 172.21.15.78:0/3695452032 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f0e6c0664a0 0x7f0e6c068960 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f0e7c006f90 tx=0x7f0e7c008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:59:47.413 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:47.411+0000 7f0e757fa640 1 -- 172.21.15.78:0/3695452032 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f0e78051de0 con 0x7f0e801514b0 2023-11-28T19:59:47.564 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:47.563+0000 7f0e85c67640 1 -- 172.21.15.78:0/3695452032 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f0e800a7320 con 0x7f0e801514b0 2023-11-28T19:59:47.565 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:47.563+0000 7f0e757fa640 1 -- 172.21.15.78:0/3695452032 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v26) v1 ==== 103+0+11 (secure 0 0 0) 0x7f0e7801a0a0 con 0x7f0e801514b0 2023-11-28T19:59:47.565 INFO:teuthology.orchestra.run.smithi078.stdout:pg_num: 32 2023-11-28T19:59:47.567 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:47.563+0000 7f0e85c67640 1 -- 172.21.15.78:0/3695452032 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f0e6c0664a0 msgr2=0x7f0e6c068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:47.567 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:47.563+0000 7f0e85c67640 1 --2- 172.21.15.78:0/3695452032 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f0e6c0664a0 0x7f0e6c068960 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f0e7c006f90 tx=0x7f0e7c008040 comp rx=0 tx=0).stop 2023-11-28T19:59:47.567 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:47.563+0000 7f0e85c67640 1 -- 172.21.15.78:0/3695452032 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0e801514b0 msgr2=0x7f0e8006b9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:47.567 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:47.563+0000 7f0e85c67640 1 --2- 172.21.15.78:0/3695452032 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0e801514b0 0x7f0e8006b9a0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f0e80070030 tx=0x7f0e78009f90 comp rx=0 tx=0).stop 2023-11-28T19:59:47.567 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:47.563+0000 7f0e85c67640 1 -- 172.21.15.78:0/3695452032 shutdown_connections 2023-11-28T19:59:47.568 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:47.563+0000 7f0e85c67640 1 --2- 172.21.15.78:0/3695452032 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f0e6c0664a0 0x7f0e6c068960 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:47.568 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:47.563+0000 7f0e85c67640 1 --2- 172.21.15.78:0/3695452032 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0e80144d60 0x7f0e80150f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:47.568 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:47.563+0000 7f0e85c67640 1 --2- 172.21.15.78:0/3695452032 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0e801514b0 0x7f0e8006b9a0 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:47.568 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:47.563+0000 7f0e85c67640 1 --2- 172.21.15.78:0/3695452032 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0e680047d0 0x7f0e80144820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:47.568 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:47.563+0000 7f0e85c67640 1 -- 172.21.15.78:0/3695452032 >> 172.21.15.78:0/3695452032 conn(0x7f0e800c7af0 msgr2=0x7f0e801563b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T19:59:47.568 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:47.563+0000 7f0e85c67640 1 -- 172.21.15.78:0/3695452032 shutdown_connections 2023-11-28T19:59:47.568 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:47.563+0000 7f0e85c67640 1 -- 172.21.15.78:0/3695452032 wait complete. 2023-11-28T19:59:47.586 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_multifs_auth.TestClientsWithoutAuth.test_mount_all_caps_absent' 2023-11-28T19:59:47.723 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:47.723+0000 7fdd44d72640 1 Processor -- start 2023-11-28T19:59:47.723 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:47.723+0000 7fdd44d72640 1 -- start start 2023-11-28T19:59:47.724 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:47.723+0000 7fdd44d72640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdd4014e3f0 0x7fdd400bfce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:47.725 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:47.723+0000 7fdd44d72640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdd40151690 con 0x7fdd4006bef0 2023-11-28T19:59:47.725 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:47.723+0000 7fdd44d72640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdd40151bc0 con 0x7fdd4006c5b0 2023-11-28T19:59:47.725 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:47.723+0000 7fdd44d72640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdd401518e0 con 0x7fdd4014e3f0 2023-11-28T19:59:47.725 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:47.723+0000 7fdd37fff640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7fdd4006bef0 0x7fdd400c41f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:39356/0 (socket says 172.21.15.78:39356) 2023-11-28T19:59:47.725 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:47.723+0000 7fdd37fff640 1 -- 172.21.15.78:0/2252780040 learned_addr learned my addr 172.21.15.78:0/2252780040 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-11-28T19:59:47.725 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:47.723+0000 7fdd3e59c640 1 --2- 172.21.15.78:0/2252780040 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdd4014e3f0 0x7fdd400bfce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:47.726 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:47.723+0000 7fdd3dd9b640 1 -- 172.21.15.78:0/2252780040 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1349982037 0 0) 0x7fdd40151690 con 0x7fdd4006bef0 2023-11-28T19:59:47.726 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:47.723+0000 7fdd3dd9b640 1 -- 172.21.15.78:0/2252780040 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdd2c003530 con 0x7fdd4006bef0 2023-11-28T19:59:47.726 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:47.723+0000 7fdd3e59c640 1 -- 172.21.15.78:0/2252780040 >> v1:172.21.15.179:6789/0 conn(0x7fdd4006c5b0 legacy=0x7fdd4006ca40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:47.726 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:47.723+0000 7fdd3dd9b640 1 -- 172.21.15.78:0/2252780040 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3915677660 0 0) 0x7fdd40151bc0 con 0x7fdd4006c5b0 2023-11-28T19:59:47.726 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:47.723+0000 7fdd3e59c640 1 -- 172.21.15.78:0/2252780040 >> v1:172.21.15.78:6789/0 conn(0x7fdd4006bef0 legacy=0x7fdd400c41f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:47.726 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:47.723+0000 7fdd3e59c640 1 -- 172.21.15.78:0/2252780040 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd400c1de0 con 0x7fdd4014e3f0 2023-11-28T19:59:47.728 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:47.727+0000 7fdd3e59c640 1 --2- 172.21.15.78:0/2252780040 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdd4014e3f0 0x7fdd400bfce0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fdd300097f0 tx=0x7fdd3001c400 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4f847229c2b5d64e server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:59:47.729 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:47.727+0000 7fdd3dd9b640 1 -- 172.21.15.78:0/2252780040 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd300ab600 con 0x7fdd4014e3f0 2023-11-28T19:59:47.729 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:47.727+0000 7fdd3dd9b640 1 -- 172.21.15.78:0/2252780040 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd300a7050 con 0x7fdd4014e3f0 2023-11-28T19:59:47.729 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:47.727+0000 7fdd3dd9b640 1 -- 172.21.15.78:0/2252780040 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd300ab980 con 0x7fdd4014e3f0 2023-11-28T19:59:47.730 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:47.727+0000 7fdd44d72640 1 -- 172.21.15.78:0/2252780040 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdd4014e3f0 msgr2=0x7fdd400bfce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:47.730 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:47.727+0000 7fdd44d72640 1 --2- 172.21.15.78:0/2252780040 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdd4014e3f0 0x7fdd400bfce0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fdd300097f0 tx=0x7fdd3001c400 comp rx=0 tx=0).stop 2023-11-28T19:59:47.730 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:47.727+0000 7fdd44d72640 1 -- 172.21.15.78:0/2252780040 shutdown_connections 2023-11-28T19:59:47.730 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:47.727+0000 7fdd44d72640 1 --2- 172.21.15.78:0/2252780040 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdd4014e3f0 0x7fdd400bfce0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:47.730 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:47.727+0000 7fdd44d72640 1 -- 172.21.15.78:0/2252780040 >> 172.21.15.78:0/2252780040 conn(0x7fdd400a7810 msgr2=0x7fdd400a7c20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T19:59:47.730 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:47.727+0000 7fdd44d72640 1 -- 172.21.15.78:0/2252780040 shutdown_connections 2023-11-28T19:59:47.731 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:47.727+0000 7fdd44d72640 1 -- 172.21.15.78:0/2252780040 wait complete. 2023-11-28T19:59:47.731 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:47.731+0000 7fdd44d72640 1 Processor -- start 2023-11-28T19:59:47.731 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:47.731+0000 7fdd44d72640 1 -- start start 2023-11-28T19:59:47.733 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:47.731+0000 7fdd44d72640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdd4006bef0 0x7fdd400bf0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:47.733 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:47.731+0000 7fdd44d72640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdd4006c5b0 0x7fdd401f0410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:47.734 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:47.731+0000 7fdd44d72640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdd4014e3f0 0x7fdd401f0950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:47.734 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:47.731+0000 7fdd44d72640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd40151f80 con 0x7fdd4006c5b0 2023-11-28T19:59:47.734 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:47.731+0000 7fdd44d72640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd40152900 con 0x7fdd4006bef0 2023-11-28T19:59:47.734 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:47.731+0000 7fdd44d72640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdd40152e30 con 0x7fdd4014e3f0 2023-11-28T19:59:47.734 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:47.731+0000 7fdd37fff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdd4006c5b0 0x7fdd401f0410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:47.734 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:47.731+0000 7fdd37fff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdd4006c5b0 0x7fdd401f0410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:45238/0 (socket says 172.21.15.78:45238) 2023-11-28T19:59:47.734 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:47.731+0000 7fdd37fff640 1 -- 172.21.15.78:0/864762939 learned_addr learned my addr 172.21.15.78:0/864762939 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T19:59:47.734 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:47.731+0000 7fdd3e59c640 1 --2- 172.21.15.78:0/864762939 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdd4006bef0 0x7fdd400bf0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:47.734 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:47.731+0000 7fdd3ed9d640 1 --2- 172.21.15.78:0/864762939 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdd4014e3f0 0x7fdd401f0950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:47.734 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:47.731+0000 7fdd37fff640 1 -- 172.21.15.78:0/864762939 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdd4014e3f0 msgr2=0x7fdd401f0950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:47.734 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:47.731+0000 7fdd37fff640 1 --2- 172.21.15.78:0/864762939 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdd4014e3f0 0x7fdd401f0950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:47.735 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:47.731+0000 7fdd37fff640 1 -- 172.21.15.78:0/864762939 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdd4006bef0 msgr2=0x7fdd400bf0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:47.735 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:47.731+0000 7fdd37fff640 1 --2- 172.21.15.78:0/864762939 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdd4006bef0 0x7fdd400bf0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:47.735 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:47.731+0000 7fdd37fff640 1 -- 172.21.15.78:0/864762939 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd30009420 con 0x7fdd4006c5b0 2023-11-28T19:59:47.735 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:47.731+0000 7fdd37fff640 1 --2- 172.21.15.78:0/864762939 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdd4006c5b0 0x7fdd401f0410 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fdd2800c450 tx=0x7fdd2800c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:59:47.735 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:47.731+0000 7fdd36ffd640 1 -- 172.21.15.78:0/864762939 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd28005cf0 con 0x7fdd4006c5b0 2023-11-28T19:59:47.735 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:47.731+0000 7fdd36ffd640 1 -- 172.21.15.78:0/864762939 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd28005e50 con 0x7fdd4006c5b0 2023-11-28T19:59:47.735 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:47.731+0000 7fdd36ffd640 1 -- 172.21.15.78:0/864762939 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd28007290 con 0x7fdd4006c5b0 2023-11-28T19:59:47.735 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:47.731+0000 7fdd44d72640 1 -- 172.21.15.78:0/864762939 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdd401eff80 con 0x7fdd4006c5b0 2023-11-28T19:59:47.735 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:47.731+0000 7fdd44d72640 1 -- 172.21.15.78:0/864762939 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdd40152b50 con 0x7fdd4006c5b0 2023-11-28T19:59:47.736 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:47.731+0000 7fdd44d72640 1 -- 172.21.15.78:0/864762939 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdd40067630 con 0x7fdd4006c5b0 2023-11-28T19:59:47.736 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:47.735+0000 7fdd36ffd640 1 -- 172.21.15.78:0/864762939 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fdd280073f0 con 0x7fdd4006c5b0 2023-11-28T19:59:47.736 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:47.735+0000 7fdd36ffd640 1 --2- 172.21.15.78:0/864762939 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fdd20066470 0x7fdd20068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:47.736 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:47.735+0000 7fdd36ffd640 1 -- 172.21.15.78:0/864762939 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fdd280836f0 con 0x7fdd4006c5b0 2023-11-28T19:59:47.737 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:47.735+0000 7fdd3e59c640 1 --2- 172.21.15.78:0/864762939 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fdd20066470 0x7fdd20068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:47.737 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:47.735+0000 7fdd3e59c640 1 --2- 172.21.15.78:0/864762939 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fdd20066470 0x7fdd20068930 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fdd300ad000 tx=0x7fdd30008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:59:47.741 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:47.739+0000 7fdd36ffd640 1 -- 172.21.15.78:0/864762939 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fdd280508f0 con 0x7fdd4006c5b0 2023-11-28T19:59:47.947 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:47.947+0000 7fdd44d72640 1 -- 172.21.15.78:0/864762939 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_multifs_auth.TestClientsWithoutAuth.test_mount_all_caps_absent"]} v 0) v1 -- 0x7fdd400c5370 con 0x7fdd4006c5b0 2023-11-28T19:59:48.050 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:48.047+0000 7fdd36ffd640 1 -- 172.21.15.78:0/864762939 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_multifs_auth.TestClientsWithoutAuth.test_mount_all_caps_absent"]}]=0 v64) v1 ==== 162+0+0 (secure 0 0 0) 0x7fdd280170e0 con 0x7fdd4006c5b0 2023-11-28T19:59:48.053 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:48.051+0000 7fdd44d72640 1 -- 172.21.15.78:0/864762939 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fdd20066470 msgr2=0x7fdd20068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:48.053 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:48.051+0000 7fdd44d72640 1 --2- 172.21.15.78:0/864762939 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fdd20066470 0x7fdd20068930 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fdd300ad000 tx=0x7fdd30008040 comp rx=0 tx=0).stop 2023-11-28T19:59:48.053 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:48.051+0000 7fdd44d72640 1 -- 172.21.15.78:0/864762939 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdd4006c5b0 msgr2=0x7fdd401f0410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:48.053 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:48.051+0000 7fdd44d72640 1 --2- 172.21.15.78:0/864762939 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdd4006c5b0 0x7fdd401f0410 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fdd2800c450 tx=0x7fdd2800c910 comp rx=0 tx=0).stop 2023-11-28T19:59:48.053 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:48.051+0000 7fdd44d72640 1 -- 172.21.15.78:0/864762939 shutdown_connections 2023-11-28T19:59:48.053 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:48.051+0000 7fdd44d72640 1 --2- 172.21.15.78:0/864762939 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fdd20066470 0x7fdd20068930 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:48.053 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:48.051+0000 7fdd44d72640 1 --2- 172.21.15.78:0/864762939 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdd4014e3f0 0x7fdd401f0950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:48.053 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:48.051+0000 7fdd44d72640 1 --2- 172.21.15.78:0/864762939 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdd4006c5b0 0x7fdd401f0410 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:48.053 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:48.051+0000 7fdd44d72640 1 --2- 172.21.15.78:0/864762939 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdd4006bef0 0x7fdd400bf0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:48.054 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:48.051+0000 7fdd44d72640 1 -- 172.21.15.78:0/864762939 >> 172.21.15.78:0/864762939 conn(0x7fdd400a7810 msgr2=0x7fdd400c41f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T19:59:48.054 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:48.051+0000 7fdd44d72640 1 -- 172.21.15.78:0/864762939 shutdown_connections 2023-11-28T19:59:48.054 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:48.051+0000 7fdd44d72640 1 -- 172.21.15.78:0/864762939 wait complete. 2023-11-28T19:59:48.072 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-11-28T19:59:48.211 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:48.207+0000 7f414249b640 1 Processor -- start 2023-11-28T19:59:48.211 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:48.211+0000 7f414249b640 1 -- start start 2023-11-28T19:59:48.212 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:48.211+0000 7f414249b640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f413c0c45a0 0x7f413c154e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:48.213 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:48.211+0000 7f414249b640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f413c151e40 con 0x7f413c0ca710 2023-11-28T19:59:48.213 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:48.211+0000 7f414249b640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f413c1553c0 con 0x7f413c0ca330 2023-11-28T19:59:48.213 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:48.211+0000 7f414249b640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f413c0c54b0 con 0x7f413c0c45a0 2023-11-28T19:59:48.213 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:48.211+0000 7f4140c98640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f413c0ca710 0x7f413c15cd30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:39358/0 (socket says 172.21.15.78:39358) 2023-11-28T19:59:48.213 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:48.211+0000 7f4140c98640 1 -- 172.21.15.78:0/3091739665 learned_addr learned my addr 172.21.15.78:0/3091739665 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-11-28T19:59:48.215 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:48.211+0000 7f4141c9a640 1 --2- 172.21.15.78:0/3091739665 >> v2:172.21.15.179:3300/0 conn(0x7f413c0c45a0 0x7f413c154e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:48.215 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:48.211+0000 7f4133fff640 1 -- 172.21.15.78:0/3091739665 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3566743074 0 0) 0x7f413c151e40 con 0x7f413c0ca710 2023-11-28T19:59:48.215 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:48.211+0000 7f4133fff640 1 -- 172.21.15.78:0/3091739665 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4128003530 con 0x7f413c0ca710 2023-11-28T19:59:48.215 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:48.211+0000 7f4133fff640 1 -- 172.21.15.78:0/3091739665 <== mon.0 v1:172.21.15.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2017329316 0 0) 0x7f4128003530 con 0x7f413c0ca710 2023-11-28T19:59:48.215 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:48.211+0000 7f4133fff640 1 -- 172.21.15.78:0/3091739665 >> v2:172.21.15.179:3300/0 conn(0x7f413c0c45a0 msgr2=0x7f413c154e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T19:59:48.215 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:48.211+0000 7f4133fff640 1 --2- 172.21.15.78:0/3091739665 >> v2:172.21.15.179:3300/0 conn(0x7f413c0c45a0 0x7f413c154e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:48.215 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:48.211+0000 7f4133fff640 1 -- 172.21.15.78:0/3091739665 >> v1:172.21.15.179:6789/0 conn(0x7f413c0ca330 legacy=0x7f413c0c7d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:48.215 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:48.211+0000 7f4133fff640 1 -- 172.21.15.78:0/3091739665 --> v1:172.21.15.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f413c0c4a30 con 0x7f413c0ca710 2023-11-28T19:59:48.215 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:48.211+0000 7f4133fff640 1 -- 172.21.15.78:0/3091739665 <== mon.0 v1:172.21.15.78:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3326804700 0 0) 0x7f412c001680 con 0x7f413c0ca710 2023-11-28T19:59:48.216 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:48.211+0000 7f4133fff640 1 -- 172.21.15.78:0/3091739665 >> v1:172.21.15.78:6789/0 conn(0x7f413c0ca710 legacy=0x7f413c15cd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:48.216 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:48.211+0000 7f4133fff640 1 --2- 172.21.15.78:0/3091739665 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f41280039d0 0x7f4128003df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:48.216 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:48.211+0000 7f4133fff640 1 --2- 172.21.15.78:0/3091739665 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f41280047d0 0x7f4128004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:48.216 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:48.211+0000 7f4133fff640 1 --2- 172.21.15.78:0/3091739665 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4128005190 0x7f412800b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:48.216 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:48.211+0000 7f4133fff640 1 -- 172.21.15.78:0/3091739665 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f413c0c54b0 con 0x7f4128005190 2023-11-28T19:59:48.216 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:48.211+0000 7f4133fff640 1 -- 172.21.15.78:0/3091739665 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f412800c070 con 0x7f41280047d0 2023-11-28T19:59:48.216 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:48.211+0000 7f4133fff640 1 -- 172.21.15.78:0/3091739665 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f412800c230 con 0x7f41280039d0 2023-11-28T19:59:48.216 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:48.211+0000 7f4141c9a640 1 --2- 172.21.15.78:0/3091739665 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4128005190 0x7f412800b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:48.216 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:48.211+0000 7f4141499640 1 --2- 172.21.15.78:0/3091739665 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f41280039d0 0x7f4128003df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:48.216 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:48.211+0000 7f4140c98640 1 --2- 172.21.15.78:0/3091739665 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f41280047d0 0x7f4128004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:48.216 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:48.211+0000 7f4141c9a640 1 -- 172.21.15.78:0/3091739665 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f41280039d0 msgr2=0x7f4128003df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T19:59:48.216 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:48.211+0000 7f4141c9a640 1 --2- 172.21.15.78:0/3091739665 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f41280039d0 0x7f4128003df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:48.217 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:48.211+0000 7f4141c9a640 1 -- 172.21.15.78:0/3091739665 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f41280047d0 msgr2=0x7f4128004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T19:59:48.217 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:48.211+0000 7f4141c9a640 1 --2- 172.21.15.78:0/3091739665 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f41280047d0 0x7f4128004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:48.217 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:48.211+0000 7f4141c9a640 1 -- 172.21.15.78:0/3091739665 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4128003530 con 0x7f4128005190 2023-11-28T19:59:48.218 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:48.215+0000 7f4141c9a640 1 -- 172.21.15.78:0/3091739665 reap_dead start 2023-11-28T19:59:48.218 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:48.215+0000 7f4141c9a640 1 --2- 172.21.15.78:0/3091739665 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4128005190 0x7f412800b990 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f4134009fc0 tx=0x7f413401cca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7bae546e759aba8d server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:59:48.218 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:48.215+0000 7f4133fff640 1 -- 172.21.15.78:0/3091739665 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41340a5cb0 con 0x7f4128005190 2023-11-28T19:59:48.218 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:48.215+0000 7f4133fff640 1 -- 172.21.15.78:0/3091739665 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f413400f040 con 0x7f4128005190 2023-11-28T19:59:48.218 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:48.215+0000 7f4133fff640 1 -- 172.21.15.78:0/3091739665 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4134003be0 con 0x7f4128005190 2023-11-28T19:59:48.218 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:48.215+0000 7f414249b640 1 -- 172.21.15.78:0/3091739665 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4128005190 msgr2=0x7f412800b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:48.218 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:48.215+0000 7f414249b640 1 --2- 172.21.15.78:0/3091739665 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4128005190 0x7f412800b990 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f4134009fc0 tx=0x7f413401cca0 comp rx=0 tx=0).stop 2023-11-28T19:59:48.219 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:48.215+0000 7f414249b640 1 -- 172.21.15.78:0/3091739665 shutdown_connections 2023-11-28T19:59:48.219 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:48.215+0000 7f414249b640 1 --2- 172.21.15.78:0/3091739665 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4128005190 0x7f412800b990 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:48.219 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:48.215+0000 7f414249b640 1 -- 172.21.15.78:0/3091739665 >> 172.21.15.78:0/3091739665 conn(0x7f413c0abdb0 msgr2=0x7f413c0c9c20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T19:59:48.219 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:48.215+0000 7f414249b640 1 -- 172.21.15.78:0/3091739665 shutdown_connections 2023-11-28T19:59:48.219 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:48.215+0000 7f414249b640 1 -- 172.21.15.78:0/3091739665 wait complete. 2023-11-28T19:59:48.220 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:48.219+0000 7f414249b640 1 Processor -- start 2023-11-28T19:59:48.220 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:48.219+0000 7f414249b640 1 -- start start 2023-11-28T19:59:48.221 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:48.219+0000 7f414249b640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4128005190 0x7f413c1ecfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:48.221 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:48.219+0000 7f414249b640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f413c1ed500 0x7f413c0c1b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:48.222 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:48.219+0000 7f414249b640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f413c0c3790 0x7f413c0c2090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:48.222 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:48.219+0000 7f414249b640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f413c0c25d0 con 0x7f413c1ed500 2023-11-28T19:59:48.222 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:48.219+0000 7f414249b640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f413c157a90 con 0x7f4128005190 2023-11-28T19:59:48.222 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:48.219+0000 7f414249b640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f413c0c1700 con 0x7f413c0c3790 2023-11-28T19:59:48.222 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:48.219+0000 7f4140c98640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f413c1ed500 0x7f413c0c1b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:48.222 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:48.219+0000 7f4140c98640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f413c1ed500 0x7f413c0c1b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:45252/0 (socket says 172.21.15.78:45252) 2023-11-28T19:59:48.222 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:48.219+0000 7f4140c98640 1 -- 172.21.15.78:0/2489869587 learned_addr learned my addr 172.21.15.78:0/2489869587 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T19:59:48.222 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:48.219+0000 7f4141499640 1 --2- 172.21.15.78:0/2489869587 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4128005190 0x7f413c1ecfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:48.222 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:48.219+0000 7f4141c9a640 1 --2- 172.21.15.78:0/2489869587 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f413c0c3790 0x7f413c0c2090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:48.222 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:48.219+0000 7f4140c98640 1 -- 172.21.15.78:0/2489869587 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f413c0c3790 msgr2=0x7f413c0c2090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:48.222 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:48.219+0000 7f4140c98640 1 --2- 172.21.15.78:0/2489869587 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f413c0c3790 0x7f413c0c2090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:48.223 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:48.219+0000 7f4140c98640 1 -- 172.21.15.78:0/2489869587 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4128005190 msgr2=0x7f413c1ecfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:48.223 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:48.219+0000 7f4140c98640 1 --2- 172.21.15.78:0/2489869587 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4128005190 0x7f413c1ecfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:48.223 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:48.219+0000 7f4140c98640 1 -- 172.21.15.78:0/2489869587 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f413c1edca0 con 0x7f413c1ed500 2023-11-28T19:59:48.223 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:48.219+0000 7f4141499640 1 --2- 172.21.15.78:0/2489869587 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4128005190 0x7f413c1ecfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T19:59:48.223 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:48.219+0000 7f4141c9a640 1 --2- 172.21.15.78:0/2489869587 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f413c0c3790 0x7f413c0c2090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T19:59:48.223 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:48.219+0000 7f4140c98640 1 --2- 172.21.15.78:0/2489869587 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f413c1ed500 0x7f413c0c1b50 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f412c00e780 tx=0x7f412c00ec40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:59:48.224 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:48.219+0000 7f4131ffb640 1 -- 172.21.15.78:0/2489869587 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f412c00c6c0 con 0x7f413c1ed500 2023-11-28T19:59:48.224 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:48.219+0000 7f4131ffb640 1 -- 172.21.15.78:0/2489869587 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f412c00c840 con 0x7f413c1ed500 2023-11-28T19:59:48.224 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:48.219+0000 7f4131ffb640 1 -- 172.21.15.78:0/2489869587 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f412c00cbf0 con 0x7f413c1ed500 2023-11-28T19:59:48.224 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:48.219+0000 7f414249b640 1 -- 172.21.15.78:0/2489869587 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f413c1ed9c0 con 0x7f413c1ed500 2023-11-28T19:59:48.224 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:48.219+0000 7f414249b640 1 -- 172.21.15.78:0/2489869587 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f413c0c31d0 con 0x7f413c1ed500 2023-11-28T19:59:48.224 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:48.223+0000 7f414249b640 1 -- 172.21.15.78:0/2489869587 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f413c0c1870 con 0x7f413c1ed500 2023-11-28T19:59:48.224 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:48.223+0000 7f4131ffb640 1 -- 172.21.15.78:0/2489869587 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f412c00cd50 con 0x7f413c1ed500 2023-11-28T19:59:48.225 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:48.223+0000 7f4131ffb640 1 --2- 172.21.15.78:0/2489869587 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f41200664a0 0x7f4120068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:48.225 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:48.223+0000 7f4131ffb640 1 -- 172.21.15.78:0/2489869587 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f412c084260 con 0x7f413c1ed500 2023-11-28T19:59:48.225 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:48.223+0000 7f4141499640 1 --2- 172.21.15.78:0/2489869587 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f41200664a0 0x7f4120068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:48.226 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:48.223+0000 7f4141499640 1 --2- 172.21.15.78:0/2489869587 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f41200664a0 0x7f4120068960 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f4138007fd0 tx=0x7f4138009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:59:48.228 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:48.227+0000 7f4131ffb640 1 -- 172.21.15.78:0/2489869587 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f413c0c1870 con 0x7f413c1ed500 2023-11-28T19:59:48.380 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:48.379+0000 7f414249b640 1 -- 172.21.15.78:0/2489869587 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f413c0c1870 con 0x7f413c1ed500 2023-11-28T19:59:48.385 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:48.383+0000 7f4131ffb640 1 -- 172.21.15.78:0/2489869587 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v10)=0 v10) v1 ==== 122+0+0 (secure 0 0 0) 0x7f413c0c1870 con 0x7f413c1ed500 2023-11-28T19:59:48.387 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:48.387+0000 7f414249b640 1 -- 172.21.15.78:0/2489869587 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f41200664a0 msgr2=0x7f4120068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:48.388 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:48.387+0000 7f414249b640 1 --2- 172.21.15.78:0/2489869587 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f41200664a0 0x7f4120068960 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f4138007fd0 tx=0x7f4138009040 comp rx=0 tx=0).stop 2023-11-28T19:59:48.388 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:48.387+0000 7f414249b640 1 -- 172.21.15.78:0/2489869587 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f413c1ed500 msgr2=0x7f413c0c1b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:48.388 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:48.387+0000 7f414249b640 1 --2- 172.21.15.78:0/2489869587 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f413c1ed500 0x7f413c0c1b50 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f412c00e780 tx=0x7f412c00ec40 comp rx=0 tx=0).stop 2023-11-28T19:59:48.388 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:48.387+0000 7f414249b640 1 -- 172.21.15.78:0/2489869587 shutdown_connections 2023-11-28T19:59:48.388 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:48.387+0000 7f414249b640 1 --2- 172.21.15.78:0/2489869587 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f41200664a0 0x7f4120068960 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:48.388 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:48.387+0000 7f414249b640 1 --2- 172.21.15.78:0/2489869587 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f413c0c3790 0x7f413c0c2090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:48.388 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:48.387+0000 7f414249b640 1 --2- 172.21.15.78:0/2489869587 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f413c1ed500 0x7f413c0c1b50 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:48.388 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:48.387+0000 7f414249b640 1 --2- 172.21.15.78:0/2489869587 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4128005190 0x7f413c1ecfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:48.388 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:48.387+0000 7f414249b640 1 -- 172.21.15.78:0/2489869587 >> 172.21.15.78:0/2489869587 conn(0x7f413c0abdb0 msgr2=0x7f413c0c7d40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T19:59:48.388 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:48.387+0000 7f414249b640 1 -- 172.21.15.78:0/2489869587 shutdown_connections 2023-11-28T19:59:48.389 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:48.387+0000 7f414249b640 1 -- 172.21.15.78:0/2489869587 wait complete. 2023-11-28T19:59:48.407 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-11-28T19:59:48.407 DEBUG:teuthology.orchestra.run.smithi078:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-11-28T19:59:48.493 DEBUG:teuthology.orchestra.run.smithi179:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-11-28T19:59:48.579 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-11-28T19:59:48.579 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2023-11-28T19:59:48.579 DEBUG:teuthology.orchestra.run.smithi078:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-28T19:59:48.588 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2023-11-28T19:59:48.588 DEBUG:teuthology.orchestra.run.smithi078:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-28T19:59:48.641 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2023-11-28T19:59:48.641 DEBUG:teuthology.orchestra.run.smithi078:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-28T19:59:48.692 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-28T19:59:48.871 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:48.867+0000 7fd6067b8640 1 Processor -- start 2023-11-28T19:59:48.871 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:48.871+0000 7fd6067b8640 1 -- start start 2023-11-28T19:59:48.872 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:48.871+0000 7fd6067b8640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd6000c5f60 0x7fd6000c4330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:48.873 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:48.871+0000 7fd6067b8640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fd6000c4870 0x7fd6000c6ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:48.873 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:48.871+0000 7fd6067b8640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd6000c6a10 con 0x7fd600155310 2023-11-28T19:59:48.873 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:48.871+0000 7fd6067b8640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd6000c2740 con 0x7fd6000c4870 2023-11-28T19:59:48.873 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:48.871+0000 7fd6067b8640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd60006bc80 con 0x7fd6000c5f60 2023-11-28T19:59:48.873 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:48.871+0000 7fd604d55640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fd6000c4870 0x7fd6000c6ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:48.874 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:48.871+0000 7fd5fffff640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7fd600155310 0x7fd600158590 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:39368/0 (socket says 172.21.15.78:39368) 2023-11-28T19:59:48.874 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:48.871+0000 7fd604d55640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fd6000c4870 0x7fd6000c6ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:45260/0 (socket says 172.21.15.78:45260) 2023-11-28T19:59:48.874 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:48.871+0000 7fd5fffff640 1 -- 172.21.15.78:0/488379973 learned_addr learned my addr 172.21.15.78:0/488379973 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-11-28T19:59:48.874 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:48.871+0000 7fd5f7fff640 1 --2- 172.21.15.78:0/488379973 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd6000c5f60 0x7fd6000c4330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:48.875 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:48.871+0000 7fd604d55640 1 -- 172.21.15.78:0/488379973 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd6000c5f60 msgr2=0x7fd6000c4330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T19:59:48.875 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:48.871+0000 7fd604d55640 1 --2- 172.21.15.78:0/488379973 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd6000c5f60 0x7fd6000c4330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:48.875 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:48.871+0000 7fd604d55640 1 -- 172.21.15.78:0/488379973 >> v1:172.21.15.78:6789/0 conn(0x7fd600155310 legacy=0x7fd600158590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:48.876 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:48.871+0000 7fd604d55640 1 -- 172.21.15.78:0/488379973 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6000c2f80 con 0x7fd6000c4870 2023-11-28T19:59:48.876 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:48.871+0000 7fd5ff7fe640 1 -- 172.21.15.78:0/488379973 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3070438123 0 0) 0x7fd6000c6a10 con 0x7fd600155310 2023-11-28T19:59:48.877 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:48.875+0000 7fd604d55640 1 --2- 172.21.15.78:0/488379973 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd6000c4870 0x7fd6000c6ea0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fd5f8009d90 tx=0x7fd5f801c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3b677b9da02c55e8 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:59:48.877 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:48.875+0000 7fd5ff7fe640 1 -- 172.21.15.78:0/488379973 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5f80a59e0 con 0x7fd6000c4870 2023-11-28T19:59:48.878 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:48.875+0000 7fd5ff7fe640 1 -- 172.21.15.78:0/488379973 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd5f80a5b40 con 0x7fd6000c4870 2023-11-28T19:59:48.878 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:48.875+0000 7fd5ff7fe640 1 -- 172.21.15.78:0/488379973 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5f80ad440 con 0x7fd6000c4870 2023-11-28T19:59:48.878 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:48.875+0000 7fd6067b8640 1 -- 172.21.15.78:0/488379973 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd6000c4870 msgr2=0x7fd6000c6ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:48.878 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:48.875+0000 7fd6067b8640 1 --2- 172.21.15.78:0/488379973 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd6000c4870 0x7fd6000c6ea0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fd5f8009d90 tx=0x7fd5f801c920 comp rx=0 tx=0).stop 2023-11-28T19:59:48.879 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:48.875+0000 7fd6067b8640 1 -- 172.21.15.78:0/488379973 shutdown_connections 2023-11-28T19:59:48.879 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:48.875+0000 7fd6067b8640 1 --2- 172.21.15.78:0/488379973 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd6000c4870 0x7fd6000c6ea0 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:48.879 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:48.875+0000 7fd6067b8640 1 --2- 172.21.15.78:0/488379973 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd6000c5f60 0x7fd6000c4330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:48.879 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:48.875+0000 7fd6067b8640 1 -- 172.21.15.78:0/488379973 >> 172.21.15.78:0/488379973 conn(0x7fd6000a9830 msgr2=0x7fd6000a9c40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T19:59:48.879 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:48.875+0000 7fd6067b8640 1 -- 172.21.15.78:0/488379973 shutdown_connections 2023-11-28T19:59:48.879 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:48.875+0000 7fd6067b8640 1 -- 172.21.15.78:0/488379973 wait complete. 2023-11-28T19:59:48.882 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:48.875+0000 7fd6067b8640 1 Processor -- start 2023-11-28T19:59:48.882 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:48.875+0000 7fd6067b8640 1 -- start start 2023-11-28T19:59:48.882 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:48.879+0000 7fd6067b8640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd6000c4870 0x7fd6001f1090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:48.883 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:48.879+0000 7fd6067b8640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd6000c5f60 0x7fd600155a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:48.883 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:48.879+0000 7fd6067b8640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd600155310 0x7fd6000c7ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:48.883 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:48.879+0000 7fd6067b8640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd600158a40 con 0x7fd6000c4870 2023-11-28T19:59:48.883 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:48.879+0000 7fd6067b8640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6001f0640 con 0x7fd600155310 2023-11-28T19:59:48.883 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:48.879+0000 7fd6067b8640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd6001f0c00 con 0x7fd6000c5f60 2023-11-28T19:59:48.883 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:48.879+0000 7fd5fffff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd6000c4870 0x7fd6001f1090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:48.884 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:48.879+0000 7fd5fffff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd6000c4870 0x7fd6001f1090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:45268/0 (socket says 172.21.15.78:45268) 2023-11-28T19:59:48.884 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:48.879+0000 7fd5fffff640 1 -- 172.21.15.78:0/587964110 learned_addr learned my addr 172.21.15.78:0/587964110 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T19:59:48.884 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:48.879+0000 7fd5f7fff640 1 --2- 172.21.15.78:0/587964110 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd6000c5f60 0x7fd600155a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:48.884 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:48.879+0000 7fd604d55640 1 --2- 172.21.15.78:0/587964110 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd600155310 0x7fd6000c7ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:48.884 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:48.879+0000 7fd5fffff640 1 -- 172.21.15.78:0/587964110 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd6000c5f60 msgr2=0x7fd600155a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:48.884 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:48.879+0000 7fd5fffff640 1 --2- 172.21.15.78:0/587964110 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd6000c5f60 0x7fd600155a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:48.884 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:48.879+0000 7fd5fffff640 1 -- 172.21.15.78:0/587964110 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd600155310 msgr2=0x7fd6000c7ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:48.884 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:48.879+0000 7fd5fffff640 1 --2- 172.21.15.78:0/587964110 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd600155310 0x7fd6000c7ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:48.885 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:48.879+0000 7fd5fffff640 1 -- 172.21.15.78:0/587964110 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5f8009a70 con 0x7fd6000c4870 2023-11-28T19:59:48.885 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:48.879+0000 7fd5fffff640 1 --2- 172.21.15.78:0/587964110 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd6000c4870 0x7fd6001f1090 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fd5f000c480 tx=0x7fd5f000c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:59:48.885 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:48.879+0000 7fd5fd7fa640 1 -- 172.21.15.78:0/587964110 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5f00074e0 con 0x7fd6000c4870 2023-11-28T19:59:48.885 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:48.879+0000 7fd5fd7fa640 1 -- 172.21.15.78:0/587964110 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd5f0007660 con 0x7fd6000c4870 2023-11-28T19:59:48.885 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:48.879+0000 7fd5fd7fa640 1 -- 172.21.15.78:0/587964110 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5f0004a30 con 0x7fd6000c4870 2023-11-28T19:59:48.886 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:48.879+0000 7fd6067b8640 1 -- 172.21.15.78:0/587964110 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd60014e9e0 con 0x7fd6000c4870 2023-11-28T19:59:48.886 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:48.879+0000 7fd6067b8640 1 -- 172.21.15.78:0/587964110 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd6001f0890 con 0x7fd6000c4870 2023-11-28T19:59:48.886 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:48.879+0000 7fd6067b8640 1 -- 172.21.15.78:0/587964110 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd600067630 con 0x7fd6000c4870 2023-11-28T19:59:48.887 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:48.879+0000 7fd5fd7fa640 1 -- 172.21.15.78:0/587964110 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fd5f0004b90 con 0x7fd6000c4870 2023-11-28T19:59:48.888 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:48.883+0000 7fd5fd7fa640 1 --2- 172.21.15.78:0/587964110 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fd5e0066470 0x7fd5e0068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:48.888 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:48.883+0000 7fd5fd7fa640 1 -- 172.21.15.78:0/587964110 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fd5f00832f0 con 0x7fd6000c4870 2023-11-28T19:59:48.888 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:48.883+0000 7fd5f7fff640 1 --2- 172.21.15.78:0/587964110 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fd5e0066470 0x7fd5e0068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:48.888 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:48.883+0000 7fd5f7fff640 1 --2- 172.21.15.78:0/587964110 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fd5e0066470 0x7fd5e0068930 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fd60006f690 tx=0x7fd5e8009190 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:59:48.888 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:48.887+0000 7fd5fd7fa640 1 -- 172.21.15.78:0/587964110 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fd5f0053f80 con 0x7fd6000c4870 2023-11-28T19:59:49.042 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:49.039+0000 7fd6067b8640 1 -- 172.21.15.78:0/587964110 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd6000c5d40 con 0x7fd6000c4870 2023-11-28T19:59:49.043 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:49.043+0000 7fd5fd7fa640 1 -- 172.21.15.78:0/587964110 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) v1 ==== 74+0+18711 (secure 0 0 0) 0x7fd5f0053b10 con 0x7fd6000c4870 2023-11-28T19:59:49.044 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-11-28T19:59:49.044 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":27,"fsid":"dd9780e8-3bda-44fa-a9f0-fa07d19d901d","created":"2023-11-28T19:58:40.969556+0000","modified":"2023-11-28T19:59:47.762261+0000","last_up_change":"2023-11-28T19:58:52.596716+0000","last_in_change":"2023-11-28T19:58:43.609275+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-28T19:58:54.011229+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-28T19:59:03.945559+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-28T19:59:04.481478+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-11-28T19:59:08.109152+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"e84245ac-b5da-429e-af18-39acaa2b33e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6800","nonce":3358701235},{"type":"v1","addr":"172.21.15.78:6801","nonce":3358701235}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6802","nonce":3358701235},{"type":"v1","addr":"172.21.15.78:6803","nonce":3358701235}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6806","nonce":3358701235},{"type":"v1","addr":"172.21.15.78:6807","nonce":3358701235}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6804","nonce":3358701235},{"type":"v1","addr":"172.21.15.78:6805","nonce":3358701235}]},"public_addr":"172.21.15.78:6801/3358701235","cluster_addr":"172.21.15.78:6803/3358701235","heartbeat_back_addr":"172.21.15.78:6807/3358701235","heartbeat_front_addr":"172.21.15.78:6805/3358701235","state":["exists","up"]},{"osd":1,"uuid":"e634831d-c4e2-48d9-870c-9556ae162981","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6808","nonce":3211476654},{"type":"v1","addr":"172.21.15.78:6809","nonce":3211476654}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6810","nonce":3211476654},{"type":"v1","addr":"172.21.15.78:6811","nonce":3211476654}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6814","nonce":3211476654},{"type":"v1","addr":"172.21.15.78:6815","nonce":3211476654}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6812","nonce":3211476654},{"type":"v1","addr":"172.21.15.78:6813","nonce":3211476654}]},"public_addr":"172.21.15.78:6809/3211476654","cluster_addr":"172.21.15.78:6811/3211476654","heartbeat_back_addr":"172.21.15.78:6815/3211476654","heartbeat_front_addr":"172.21.15.78:6813/3211476654","state":["exists","up"]},{"osd":2,"uuid":"274c8395-6534-41f0-b8fb-a00af8985aa8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6816","nonce":2532904479},{"type":"v1","addr":"172.21.15.78:6817","nonce":2532904479}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6818","nonce":2532904479},{"type":"v1","addr":"172.21.15.78:6819","nonce":2532904479}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6822","nonce":2532904479},{"type":"v1","addr":"172.21.15.78:6823","nonce":2532904479}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6820","nonce":2532904479},{"type":"v1","addr":"172.21.15.78:6821","nonce":2532904479}]},"public_addr":"172.21.15.78:6817/2532904479","cluster_addr":"172.21.15.78:6819/2532904479","heartbeat_back_addr":"172.21.15.78:6823/2532904479","heartbeat_front_addr":"172.21.15.78:6821/2532904479","state":["exists","up"]},{"osd":3,"uuid":"77acc9af-7d4d-4b18-8cf5-d62f5971b7c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6824","nonce":3442991267},{"type":"v1","addr":"172.21.15.78:6825","nonce":3442991267}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6826","nonce":3442991267},{"type":"v1","addr":"172.21.15.78:6827","nonce":3442991267}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6830","nonce":3442991267},{"type":"v1","addr":"172.21.15.78:6831","nonce":3442991267}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6828","nonce":3442991267},{"type":"v1","addr":"172.21.15.78:6829","nonce":3442991267}]},"public_addr":"172.21.15.78:6825/3442991267","cluster_addr":"172.21.15.78:6827/3442991267","heartbeat_back_addr":"172.21.15.78:6831/3442991267","heartbeat_front_addr":"172.21.15.78:6829/3442991267","state":["exists","up"]},{"osd":4,"uuid":"5c62bc66-6b34-4b7f-a66b-9a743969138c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":802983577},{"type":"v1","addr":"172.21.15.179:6809","nonce":802983577}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":802983577},{"type":"v1","addr":"172.21.15.179:6811","nonce":802983577}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":802983577},{"type":"v1","addr":"172.21.15.179:6815","nonce":802983577}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":802983577},{"type":"v1","addr":"172.21.15.179:6813","nonce":802983577}]},"public_addr":"172.21.15.179:6809/802983577","cluster_addr":"172.21.15.179:6811/802983577","heartbeat_back_addr":"172.21.15.179:6815/802983577","heartbeat_front_addr":"172.21.15.179:6813/802983577","state":["exists","up"]},{"osd":5,"uuid":"67db6d36-f684-4079-b0cd-82b4dd61461f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":518192887},{"type":"v1","addr":"172.21.15.179:6818","nonce":518192887}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":518192887},{"type":"v1","addr":"172.21.15.179:6822","nonce":518192887}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":518192887},{"type":"v1","addr":"172.21.15.179:6829","nonce":518192887}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6824","nonce":518192887},{"type":"v1","addr":"172.21.15.179:6826","nonce":518192887}]},"public_addr":"172.21.15.179:6818/518192887","cluster_addr":"172.21.15.179:6822/518192887","heartbeat_back_addr":"172.21.15.179:6829/518192887","heartbeat_front_addr":"172.21.15.179:6826/518192887","state":["exists","up"]},{"osd":6,"uuid":"12e670af-5a16-4c81-9f97-defa66cab967","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":815435378},{"type":"v1","addr":"172.21.15.179:6801","nonce":815435378}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":815435378},{"type":"v1","addr":"172.21.15.179:6803","nonce":815435378}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":815435378},{"type":"v1","addr":"172.21.15.179:6807","nonce":815435378}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":815435378},{"type":"v1","addr":"172.21.15.179:6805","nonce":815435378}]},"public_addr":"172.21.15.179:6801/815435378","cluster_addr":"172.21.15.179:6803/815435378","heartbeat_back_addr":"172.21.15.179:6807/815435378","heartbeat_front_addr":"172.21.15.179:6805/815435378","state":["exists","up"]},{"osd":7,"uuid":"fe630650-2eb3-49ad-8676-c341e6332eb1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6817","nonce":2848432339},{"type":"v1","addr":"172.21.15.179:6819","nonce":2848432339}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6821","nonce":2848432339},{"type":"v1","addr":"172.21.15.179:6823","nonce":2848432339}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":2848432339},{"type":"v1","addr":"172.21.15.179:6831","nonce":2848432339}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6825","nonce":2848432339},{"type":"v1","addr":"172.21.15.179:6827","nonce":2848432339}]},"public_addr":"172.21.15.179:6819/2848432339","cluster_addr":"172.21.15.179:6823/2848432339","heartbeat_back_addr":"172.21.15.179:6831/2848432339","heartbeat_front_addr":"172.21.15.179:6827/2848432339","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:58:49.255433+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:58:49.412880+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:58:49.559295+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:58:49.245237+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:58:49.184557+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:58:49.329851+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:58:49.366012+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:58:49.349604+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.2","mappings":[{"from":5,"to":1}]},{"pgid":"3.8","mappings":[{"from":3,"to":2}]},{"pgid":"3.26","mappings":[{"from":7,"to":2}]},{"pgid":"3.30","mappings":[{"from":5,"to":2}]},{"pgid":"4.10","mappings":[{"from":1,"to":2}]},{"pgid":"4.14","mappings":[{"from":1,"to":5}]},{"pgid":"4.1d","mappings":[{"from":1,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-28T19:59:49.046 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:49.043+0000 7fd6067b8640 1 -- 172.21.15.78:0/587964110 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fd5e0066470 msgr2=0x7fd5e0068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:49.046 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:49.043+0000 7fd6067b8640 1 --2- 172.21.15.78:0/587964110 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fd5e0066470 0x7fd5e0068930 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fd60006f690 tx=0x7fd5e8009190 comp rx=0 tx=0).stop 2023-11-28T19:59:49.046 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:49.043+0000 7fd6067b8640 1 -- 172.21.15.78:0/587964110 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd6000c4870 msgr2=0x7fd6001f1090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:49.046 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:49.043+0000 7fd6067b8640 1 --2- 172.21.15.78:0/587964110 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd6000c4870 0x7fd6001f1090 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fd5f000c480 tx=0x7fd5f000c940 comp rx=0 tx=0).stop 2023-11-28T19:59:49.046 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:49.043+0000 7fd6067b8640 1 -- 172.21.15.78:0/587964110 shutdown_connections 2023-11-28T19:59:49.047 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:49.043+0000 7fd6067b8640 1 --2- 172.21.15.78:0/587964110 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fd5e0066470 0x7fd5e0068930 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:49.047 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:49.043+0000 7fd6067b8640 1 --2- 172.21.15.78:0/587964110 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd6000c5f60 0x7fd600155a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:49.047 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:49.043+0000 7fd6067b8640 1 --2- 172.21.15.78:0/587964110 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd600155310 0x7fd6000c7ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:49.047 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:49.043+0000 7fd6067b8640 1 --2- 172.21.15.78:0/587964110 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd6000c4870 0x7fd6001f1090 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:49.047 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:49.043+0000 7fd6067b8640 1 -- 172.21.15.78:0/587964110 >> 172.21.15.78:0/587964110 conn(0x7fd6000a9830 msgr2=0x7fd6000a8f90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T19:59:49.047 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:49.043+0000 7fd6067b8640 1 -- 172.21.15.78:0/587964110 shutdown_connections 2023-11-28T19:59:49.047 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:49.043+0000 7fd6067b8640 1 -- 172.21.15.78:0/587964110 wait complete. 2023-11-28T19:59:49.066 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-28T19:58:54.011229+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-28T19:59:03.945559+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-11-28T19:59:04.481478+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-11-28T19:59:08.109152+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-11-28T19:59:49.067 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-28T19:59:49.206 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:49.203+0000 7f8b6805a640 1 Processor -- start 2023-11-28T19:59:49.207 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:49.203+0000 7f8b6805a640 1 -- start start 2023-11-28T19:59:49.208 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:49.207+0000 7f8b6805a640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f8b600c5300 0x7f8b600a9c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:49.208 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:49.207+0000 7f8b6805a640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8b601548c0 0x7f8b60154d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:49.208 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:49.207+0000 7f8b6805a640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8b600a4e20 con 0x7f8b6014b1e0 2023-11-28T19:59:49.208 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:49.207+0000 7f8b6805a640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8b600a50e0 con 0x7f8b600c5300 2023-11-28T19:59:49.208 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:49.207+0000 7f8b6805a640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b600c0f00 con 0x7f8b601548c0 2023-11-28T19:59:49.209 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:49.207+0000 7f8b655f5640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f8b600c5300 0x7f8b600a9c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:49.209 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:49.207+0000 7f8b665f7640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8b601548c0 0x7f8b60154d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:49.209 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:49.207+0000 7f8b655f5640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f8b600c5300 0x7f8b600a9c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.78:50048/0 (socket says 172.21.15.78:50048) 2023-11-28T19:59:49.209 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:49.207+0000 7f8b665f7640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8b601548c0 0x7f8b60154d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3301/0 says I am v2:172.21.15.78:43736/0 (socket says 172.21.15.78:43736) 2023-11-28T19:59:49.210 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:49.207+0000 7f8b655f5640 1 -- 172.21.15.78:0/3472361873 learned_addr learned my addr 172.21.15.78:0/3472361873 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T19:59:49.210 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:49.207+0000 7f8b655f5640 1 -- 172.21.15.78:0/3472361873 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8b601548c0 msgr2=0x7f8b60154d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T19:59:49.210 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:49.207+0000 7f8b655f5640 1 --2- 172.21.15.78:0/3472361873 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8b601548c0 0x7f8b60154d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:49.210 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:49.207+0000 7f8b655f5640 1 -- 172.21.15.78:0/3472361873 >> v1:172.21.15.179:6789/0 conn(0x7f8b6014b1e0 legacy=0x7f8b600c1700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:49.210 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:49.207+0000 7f8b655f5640 1 -- 172.21.15.78:0/3472361873 --> v2:172.21.15.179:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b600c11e0 con 0x7f8b600c5300 2023-11-28T19:59:49.212 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:49.211+0000 7f8b655f5640 1 --2- 172.21.15.78:0/3472361873 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8b600c5300 0x7f8b600a9c30 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f8b50009870 tx=0x7f8b5001c540 comp rx=0 tx=0).ready entity=mon.1 client_cookie=612ddedb904e69e0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:59:49.212 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:49.211+0000 7f8b64df4640 1 -- 172.21.15.78:0/3472361873 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b500ab650 con 0x7f8b600c5300 2023-11-28T19:59:49.213 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:49.211+0000 7f8b64df4640 1 -- 172.21.15.78:0/3472361873 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b500ab7b0 con 0x7f8b600c5300 2023-11-28T19:59:49.213 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:49.211+0000 7f8b64df4640 1 -- 172.21.15.78:0/3472361873 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b500abb40 con 0x7f8b600c5300 2023-11-28T19:59:49.213 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:49.211+0000 7f8b6805a640 1 -- 172.21.15.78:0/3472361873 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8b600c5300 msgr2=0x7f8b600a9c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:49.214 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:49.211+0000 7f8b6805a640 1 --2- 172.21.15.78:0/3472361873 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8b600c5300 0x7f8b600a9c30 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f8b50009870 tx=0x7f8b5001c540 comp rx=0 tx=0).stop 2023-11-28T19:59:49.214 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:49.211+0000 7f8b6805a640 1 -- 172.21.15.78:0/3472361873 shutdown_connections 2023-11-28T19:59:49.214 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:49.211+0000 7f8b6805a640 1 --2- 172.21.15.78:0/3472361873 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8b601548c0 0x7f8b60154d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:49.214 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:49.211+0000 7f8b6805a640 1 --2- 172.21.15.78:0/3472361873 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8b600c5300 0x7f8b600a9c30 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:49.214 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:49.211+0000 7f8b6805a640 1 -- 172.21.15.78:0/3472361873 >> 172.21.15.78:0/3472361873 conn(0x7f8b600c59f0 msgr2=0x7f8b600c5e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T19:59:49.214 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:49.211+0000 7f8b6805a640 1 -- 172.21.15.78:0/3472361873 shutdown_connections 2023-11-28T19:59:49.214 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:49.211+0000 7f8b6805a640 1 -- 172.21.15.78:0/3472361873 wait complete. 2023-11-28T19:59:49.215 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:49.211+0000 7f8b6805a640 1 Processor -- start 2023-11-28T19:59:49.215 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:49.215+0000 7f8b6805a640 1 -- start start 2023-11-28T19:59:49.216 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:49.215+0000 7f8b6805a640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8b600c5300 0x7f8b601f0e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:49.217 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:49.215+0000 7f8b6805a640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8b6014b1e0 0x7f8b6006d520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:49.217 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:49.215+0000 7f8b6805a640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8b601548c0 0x7f8b60140440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:49.218 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:49.215+0000 7f8b6805a640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b601f09f0 con 0x7f8b600c5300 2023-11-28T19:59:49.218 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:49.215+0000 7f8b6805a640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b6006b930 con 0x7f8b601548c0 2023-11-28T19:59:49.219 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:49.215+0000 7f8b6805a640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b6006bb40 con 0x7f8b6014b1e0 2023-11-28T19:59:49.219 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:49.215+0000 7f8b65df6640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8b600c5300 0x7f8b601f0e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:49.219 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:49.215+0000 7f8b65df6640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8b600c5300 0x7f8b601f0e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:45272/0 (socket says 172.21.15.78:45272) 2023-11-28T19:59:49.220 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:49.215+0000 7f8b65df6640 1 -- 172.21.15.78:0/3776672521 learned_addr learned my addr 172.21.15.78:0/3776672521 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T19:59:49.221 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:49.215+0000 7f8b655f5640 1 --2- 172.21.15.78:0/3776672521 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8b6014b1e0 0x7f8b6006d520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:49.221 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:49.215+0000 7f8b665f7640 1 --2- 172.21.15.78:0/3776672521 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8b601548c0 0x7f8b60140440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:49.221 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:49.215+0000 7f8b65df6640 1 -- 172.21.15.78:0/3776672521 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8b6014b1e0 msgr2=0x7f8b6006d520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:49.221 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:49.215+0000 7f8b65df6640 1 --2- 172.21.15.78:0/3776672521 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8b6014b1e0 0x7f8b6006d520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:49.221 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:49.215+0000 7f8b65df6640 1 -- 172.21.15.78:0/3776672521 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8b601548c0 msgr2=0x7f8b60140440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:49.221 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:49.215+0000 7f8b65df6640 1 --2- 172.21.15.78:0/3776672521 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8b601548c0 0x7f8b60140440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:49.221 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:49.215+0000 7f8b65df6640 1 -- 172.21.15.78:0/3776672521 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b500094d0 con 0x7f8b600c5300 2023-11-28T19:59:49.223 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:49.215+0000 7f8b65df6640 1 --2- 172.21.15.78:0/3776672521 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8b600c5300 0x7f8b601f0e10 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f8b5c00c450 tx=0x7f8b5c00c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:59:49.223 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:49.215+0000 7f8b567fc640 1 -- 172.21.15.78:0/3776672521 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b5c0052d0 con 0x7f8b600c5300 2023-11-28T19:59:49.223 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:49.215+0000 7f8b567fc640 1 -- 172.21.15.78:0/3776672521 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b5c005450 con 0x7f8b600c5300 2023-11-28T19:59:49.223 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:49.215+0000 7f8b567fc640 1 -- 172.21.15.78:0/3776672521 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b5c012870 con 0x7f8b600c5300 2023-11-28T19:59:49.223 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:49.215+0000 7f8b6805a640 1 -- 172.21.15.78:0/3776672521 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8b601f0330 con 0x7f8b600c5300 2023-11-28T19:59:49.223 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:49.215+0000 7f8b6805a640 1 -- 172.21.15.78:0/3776672521 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8b60140980 con 0x7f8b600c5300 2023-11-28T19:59:49.224 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:49.215+0000 7f8b6805a640 1 -- 172.21.15.78:0/3776672521 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8b601f0c60 con 0x7f8b600c5300 2023-11-28T19:59:49.224 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:49.219+0000 7f8b567fc640 1 -- 172.21.15.78:0/3776672521 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f8b5c0129d0 con 0x7f8b600c5300 2023-11-28T19:59:49.224 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:49.219+0000 7f8b567fc640 1 --2- 172.21.15.78:0/3776672521 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f8b440664a0 0x7f8b44068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:49.224 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:49.219+0000 7f8b567fc640 1 -- 172.21.15.78:0/3776672521 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f8b5c083c70 con 0x7f8b600c5300 2023-11-28T19:59:49.224 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:49.219+0000 7f8b655f5640 1 --2- 172.21.15.78:0/3776672521 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f8b440664a0 0x7f8b44068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:49.224 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:49.219+0000 7f8b655f5640 1 --2- 172.21.15.78:0/3776672521 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f8b440664a0 0x7f8b44068960 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f8b500af000 tx=0x7f8b500b6040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:59:49.224 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:49.223+0000 7f8b567fc640 1 -- 172.21.15.78:0/3776672521 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f8b5c050dc0 con 0x7f8b600c5300 2023-11-28T19:59:49.375 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:49.371+0000 7f8b6805a640 1 -- 172.21.15.78:0/3776672521 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f8b60067630 con 0x7f8b600c5300 2023-11-28T19:59:49.375 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:49.371+0000 7f8b567fc640 1 -- 172.21.15.78:0/3776672521 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v27) v1 ==== 93+0+10 (secure 0 0 0) 0x7f8b5c0543e0 con 0x7f8b600c5300 2023-11-28T19:59:49.375 INFO:teuthology.orchestra.run.smithi078.stdout:pg_num: 1 2023-11-28T19:59:49.377 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:49.375+0000 7f8b6805a640 1 -- 172.21.15.78:0/3776672521 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f8b440664a0 msgr2=0x7f8b44068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:49.377 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:49.375+0000 7f8b6805a640 1 --2- 172.21.15.78:0/3776672521 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f8b440664a0 0x7f8b44068960 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f8b500af000 tx=0x7f8b500b6040 comp rx=0 tx=0).stop 2023-11-28T19:59:49.377 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:49.375+0000 7f8b6805a640 1 -- 172.21.15.78:0/3776672521 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8b600c5300 msgr2=0x7f8b601f0e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:49.377 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:49.375+0000 7f8b6805a640 1 --2- 172.21.15.78:0/3776672521 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8b600c5300 0x7f8b601f0e10 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f8b5c00c450 tx=0x7f8b5c00c910 comp rx=0 tx=0).stop 2023-11-28T19:59:49.378 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:49.375+0000 7f8b6805a640 1 -- 172.21.15.78:0/3776672521 shutdown_connections 2023-11-28T19:59:49.378 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:49.375+0000 7f8b6805a640 1 --2- 172.21.15.78:0/3776672521 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f8b440664a0 0x7f8b44068960 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:49.378 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:49.375+0000 7f8b6805a640 1 --2- 172.21.15.78:0/3776672521 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8b6014b1e0 0x7f8b6006d520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:49.378 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:49.375+0000 7f8b6805a640 1 --2- 172.21.15.78:0/3776672521 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8b601548c0 0x7f8b60140440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:49.378 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:49.375+0000 7f8b6805a640 1 --2- 172.21.15.78:0/3776672521 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8b600c5300 0x7f8b601f0e10 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:49.378 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:49.375+0000 7f8b6805a640 1 -- 172.21.15.78:0/3776672521 >> 172.21.15.78:0/3776672521 conn(0x7f8b600c59f0 msgr2=0x7f8b601481c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T19:59:49.378 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:49.375+0000 7f8b6805a640 1 -- 172.21.15.78:0/3776672521 shutdown_connections 2023-11-28T19:59:49.378 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:49.375+0000 7f8b6805a640 1 -- 172.21.15.78:0/3776672521 wait complete. 2023-11-28T19:59:49.395 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-28T19:59:49.534 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:49.531+0000 7f3b3919d640 1 Processor -- start 2023-11-28T19:59:49.535 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:49.531+0000 7f3b3919d640 1 -- start start 2023-11-28T19:59:49.537 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:49.535+0000 7f3b3919d640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f3b3414f850 0x7f3b340aacf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:49.537 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:49.535+0000 7f3b3919d640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3b3414fc30 0x7f3b340c3cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:49.537 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:49.535+0000 7f3b3919d640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3b34152910 con 0x7f3b3406d840 2023-11-28T19:59:49.537 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:49.535+0000 7f3b3919d640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3b340c2240 con 0x7f3b3414f850 2023-11-28T19:59:49.537 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:49.535+0000 7f3b3919d640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b34152bf0 con 0x7f3b3414fc30 2023-11-28T19:59:49.538 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:49.535+0000 7f3b32d9d640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f3b3414f850 0x7f3b340aacf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:49.538 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:49.535+0000 7f3b32d9d640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f3b3414f850 0x7f3b340aacf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:45286/0 (socket says 172.21.15.78:45286) 2023-11-28T19:59:49.538 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:49.535+0000 7f3b32d9d640 1 -- 172.21.15.78:0/2232982455 learned_addr learned my addr 172.21.15.78:0/2232982455 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T19:59:49.538 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:49.535+0000 7f3b2bfff640 1 --2- 172.21.15.78:0/2232982455 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3b3414fc30 0x7f3b340c3cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:49.538 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:49.535+0000 7f3b32d9d640 1 -- 172.21.15.78:0/2232982455 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3b3414fc30 msgr2=0x7f3b340c3cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T19:59:49.538 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:49.535+0000 7f3b32d9d640 1 --2- 172.21.15.78:0/2232982455 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3b3414fc30 0x7f3b340c3cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:49.538 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:49.535+0000 7f3b32d9d640 1 -- 172.21.15.78:0/2232982455 >> v1:172.21.15.179:6789/0 conn(0x7f3b3406d840 legacy=0x7f3b340c4210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T19:59:49.538 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:49.535+0000 7f3b32d9d640 1 -- 172.21.15.78:0/2232982455 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b34152ed0 con 0x7f3b3414f850 2023-11-28T19:59:49.538 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:49.535+0000 7f3b2bfff640 1 --2- 172.21.15.78:0/2232982455 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3b3414fc30 0x7f3b340c3cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T19:59:49.539 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:49.539+0000 7f3b32d9d640 1 --2- 172.21.15.78:0/2232982455 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3b3414f850 0x7f3b340aacf0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f3b24009870 tx=0x7f3b2401c500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=94def07a9d829728 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:59:49.539 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:49.539+0000 7f3b3259c640 1 -- 172.21.15.78:0/2232982455 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b240aa640 con 0x7f3b3414f850 2023-11-28T19:59:49.540 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:49.539+0000 7f3b3259c640 1 -- 172.21.15.78:0/2232982455 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b240aa7a0 con 0x7f3b3414f850 2023-11-28T19:59:49.540 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:49.539+0000 7f3b3259c640 1 -- 172.21.15.78:0/2232982455 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b240aab30 con 0x7f3b3414f850 2023-11-28T19:59:49.540 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:49.539+0000 7f3b3919d640 1 -- 172.21.15.78:0/2232982455 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3b3414f850 msgr2=0x7f3b340aacf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:49.541 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:49.539+0000 7f3b3919d640 1 --2- 172.21.15.78:0/2232982455 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3b3414f850 0x7f3b340aacf0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f3b24009870 tx=0x7f3b2401c500 comp rx=0 tx=0).stop 2023-11-28T19:59:49.541 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:49.539+0000 7f3b3919d640 1 -- 172.21.15.78:0/2232982455 shutdown_connections 2023-11-28T19:59:49.541 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:49.539+0000 7f3b3919d640 1 --2- 172.21.15.78:0/2232982455 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3b3414fc30 0x7f3b340c3cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:49.541 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:49.539+0000 7f3b3919d640 1 --2- 172.21.15.78:0/2232982455 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3b3414f850 0x7f3b340aacf0 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:49.541 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:49.539+0000 7f3b3919d640 1 -- 172.21.15.78:0/2232982455 >> 172.21.15.78:0/2232982455 conn(0x7f3b340c59f0 msgr2=0x7f3b340c5e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T19:59:49.541 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:49.539+0000 7f3b3919d640 1 -- 172.21.15.78:0/2232982455 shutdown_connections 2023-11-28T19:59:49.541 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:49.539+0000 7f3b3919d640 1 -- 172.21.15.78:0/2232982455 wait complete. 2023-11-28T19:59:49.542 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:49.539+0000 7f3b3919d640 1 Processor -- start 2023-11-28T19:59:49.542 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:49.539+0000 7f3b3919d640 1 -- start start 2023-11-28T19:59:49.544 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:49.539+0000 7f3b3919d640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3b3406d840 0x7f3b3415b480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:49.545 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:49.539+0000 7f3b3919d640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3b3414f850 0x7f3b341f0ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:49.545 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:49.539+0000 7f3b3919d640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3b3414fc30 0x7f3b341efd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:49.545 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:49.539+0000 7f3b3919d640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b340aab90 con 0x7f3b3414fc30 2023-11-28T19:59:49.545 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:49.539+0000 7f3b3919d640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b340a9050 con 0x7f3b3406d840 2023-11-28T19:59:49.545 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:49.539+0000 7f3b3919d640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b341f0a40 con 0x7f3b3414f850 2023-11-28T19:59:49.545 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:49.539+0000 7f3b3359e640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3b3414fc30 0x7f3b341efd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:49.545 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:49.543+0000 7f3b3359e640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3b3414fc30 0x7f3b341efd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:45298/0 (socket says 172.21.15.78:45298) 2023-11-28T19:59:49.545 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:49.543+0000 7f3b3359e640 1 -- 172.21.15.78:0/2360761679 learned_addr learned my addr 172.21.15.78:0/2360761679 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T19:59:49.546 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:49.543+0000 7f3b2bfff640 1 --2- 172.21.15.78:0/2360761679 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3b3414f850 0x7f3b341f0ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:49.546 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:49.543+0000 7f3b3359e640 1 -- 172.21.15.78:0/2360761679 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3b3414f850 msgr2=0x7f3b341f0ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:49.546 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:49.543+0000 7f3b3359e640 1 --2- 172.21.15.78:0/2360761679 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3b3414f850 0x7f3b341f0ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:49.546 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:49.543+0000 7f3b3359e640 1 -- 172.21.15.78:0/2360761679 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3b3406d840 msgr2=0x7f3b3415b480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:49.546 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:49.543+0000 7f3b32d9d640 1 --2- 172.21.15.78:0/2360761679 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3b3406d840 0x7f3b3415b480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:49.546 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:49.543+0000 7f3b3359e640 1 --2- 172.21.15.78:0/2360761679 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3b3406d840 0x7f3b3415b480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:49.547 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:49.543+0000 7f3b3359e640 1 -- 172.21.15.78:0/2360761679 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b240094d0 con 0x7f3b3414fc30 2023-11-28T19:59:49.547 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:49.543+0000 7f3b32d9d640 1 --2- 172.21.15.78:0/2360761679 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3b3406d840 0x7f3b3415b480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T19:59:49.547 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:49.543+0000 7f3b3359e640 1 --2- 172.21.15.78:0/2360761679 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3b3414fc30 0x7f3b341efd00 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f3b2c00c780 tx=0x7f3b2c00cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:59:49.547 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:49.543+0000 7f3b2b7fe640 1 -- 172.21.15.78:0/2360761679 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b2c00a9f0 con 0x7f3b3414fc30 2023-11-28T19:59:49.547 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:49.543+0000 7f3b2b7fe640 1 -- 172.21.15.78:0/2360761679 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b2c00ce90 con 0x7f3b3414fc30 2023-11-28T19:59:49.547 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:49.543+0000 7f3b2b7fe640 1 -- 172.21.15.78:0/2360761679 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b2c00add0 con 0x7f3b3414fc30 2023-11-28T19:59:49.547 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:49.543+0000 7f3b3919d640 1 -- 172.21.15.78:0/2360761679 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3b340aa2f0 con 0x7f3b3414fc30 2023-11-28T19:59:49.547 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:49.543+0000 7f3b3919d640 1 -- 172.21.15.78:0/2360761679 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3b340aa8b0 con 0x7f3b3414fc30 2023-11-28T19:59:49.548 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:49.543+0000 7f3b3919d640 1 -- 172.21.15.78:0/2360761679 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3b341f0810 con 0x7f3b3414fc30 2023-11-28T19:59:49.548 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:49.543+0000 7f3b2b7fe640 1 -- 172.21.15.78:0/2360761679 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f3b2c012420 con 0x7f3b3414fc30 2023-11-28T19:59:49.548 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:49.547+0000 7f3b2b7fe640 1 --2- 172.21.15.78:0/2360761679 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f3b14066470 0x7f3b14068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:49.548 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:49.547+0000 7f3b2b7fe640 1 -- 172.21.15.78:0/2360761679 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f3b2c083fe0 con 0x7f3b3414fc30 2023-11-28T19:59:49.549 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:49.547+0000 7f3b32d9d640 1 --2- 172.21.15.78:0/2360761679 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f3b14066470 0x7f3b14068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:49.549 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:49.547+0000 7f3b32d9d640 1 --2- 172.21.15.78:0/2360761679 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f3b14066470 0x7f3b14068930 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f3b240ae000 tx=0x7f3b24008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:59:49.551 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:49.551+0000 7f3b2b7fe640 1 -- 172.21.15.78:0/2360761679 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f3b341f0810 con 0x7f3b3414fc30 2023-11-28T19:59:49.698 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:49.695+0000 7f3b3919d640 1 -- 172.21.15.78:0/2360761679 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f3b341f0bd0 con 0x7f3b3414fc30 2023-11-28T19:59:49.699 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:49.695+0000 7f3b2b7fe640 1 -- 172.21.15.78:0/2360761679 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v27) v1 ==== 104+0+11 (secure 0 0 0) 0x7f3b2c0510f0 con 0x7f3b3414fc30 2023-11-28T19:59:49.699 INFO:teuthology.orchestra.run.smithi078.stdout:pg_num: 32 2023-11-28T19:59:49.701 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:49.699+0000 7f3b3919d640 1 -- 172.21.15.78:0/2360761679 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f3b14066470 msgr2=0x7f3b14068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:49.701 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:49.699+0000 7f3b3919d640 1 --2- 172.21.15.78:0/2360761679 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f3b14066470 0x7f3b14068930 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f3b240ae000 tx=0x7f3b24008040 comp rx=0 tx=0).stop 2023-11-28T19:59:49.701 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:49.699+0000 7f3b3919d640 1 -- 172.21.15.78:0/2360761679 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3b3414fc30 msgr2=0x7f3b341efd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:49.702 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:49.699+0000 7f3b3919d640 1 --2- 172.21.15.78:0/2360761679 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3b3414fc30 0x7f3b341efd00 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f3b2c00c780 tx=0x7f3b2c00cc40 comp rx=0 tx=0).stop 2023-11-28T19:59:49.702 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:49.699+0000 7f3b3919d640 1 -- 172.21.15.78:0/2360761679 shutdown_connections 2023-11-28T19:59:49.702 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:49.699+0000 7f3b3919d640 1 --2- 172.21.15.78:0/2360761679 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f3b14066470 0x7f3b14068930 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:49.702 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:49.699+0000 7f3b3919d640 1 --2- 172.21.15.78:0/2360761679 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3b3414f850 0x7f3b341f0ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:49.702 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:49.699+0000 7f3b3919d640 1 --2- 172.21.15.78:0/2360761679 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3b3414fc30 0x7f3b341efd00 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:49.702 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:49.699+0000 7f3b3919d640 1 --2- 172.21.15.78:0/2360761679 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3b3406d840 0x7f3b3415b480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:49.703 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:49.699+0000 7f3b3919d640 1 -- 172.21.15.78:0/2360761679 >> 172.21.15.78:0/2360761679 conn(0x7f3b340c59f0 msgr2=0x7f3b341518e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T19:59:49.703 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:49.699+0000 7f3b3919d640 1 -- 172.21.15.78:0/2360761679 shutdown_connections 2023-11-28T19:59:49.703 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:49.699+0000 7f3b3919d640 1 -- 172.21.15.78:0/2360761679 wait complete. 2023-11-28T19:59:49.720 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-28T19:59:49.859 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:49.855+0000 7fcc21196640 1 Processor -- start 2023-11-28T19:59:49.859 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:49.855+0000 7fcc21196640 1 -- start start 2023-11-28T19:59:49.860 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:49.859+0000 7fcc21196640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fcc1c14f850 0x7fcc1c0aacf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:49.860 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:49.859+0000 7fcc21196640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcc1c14fc30 0x7fcc1c0c3cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:49.860 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:49.859+0000 7fcc21196640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fcc1c06d840 0x7fcc1c0c4210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:49.861 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:49.859+0000 7fcc21196640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcc1c0c2240 con 0x7fcc1c06d840 2023-11-28T19:59:49.861 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:49.859+0000 7fcc21196640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcc1c152910 con 0x7fcc1c14f850 2023-11-28T19:59:49.861 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:49.859+0000 7fcc21196640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcc1c152bf0 con 0x7fcc1c14fc30 2023-11-28T19:59:49.861 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:49.859+0000 7fcc1b59e640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fcc1c06d840 0x7fcc1c0c4210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:49.861 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:49.859+0000 7fcc1b59e640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fcc1c06d840 0x7fcc1c0c4210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:45310/0 (socket says 172.21.15.78:45310) 2023-11-28T19:59:49.861 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:49.859+0000 7fcc1b59e640 1 -- 172.21.15.78:0/2452865437 learned_addr learned my addr 172.21.15.78:0/2452865437 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T19:59:49.862 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:49.859+0000 7fcc1b59e640 1 -- 172.21.15.78:0/2452865437 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcc1c14fc30 msgr2=0x7fcc1c0c3cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T19:59:49.863 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:49.859+0000 7fcc1ad9d640 1 --2- 172.21.15.78:0/2452865437 >> v2:172.21.15.179:3300/0 conn(0x7fcc1c14f850 0x7fcc1c0aacf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:49.863 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:49.859+0000 7fcc1259c640 1 --2- 172.21.15.78:0/2452865437 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcc1c14fc30 0x7fcc1c0c3cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:49.863 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:49.859+0000 7fcc1b59e640 1 --2- 172.21.15.78:0/2452865437 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcc1c14fc30 0x7fcc1c0c3cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:49.863 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:49.859+0000 7fcc1b59e640 1 -- 172.21.15.78:0/2452865437 >> v2:172.21.15.179:3300/0 conn(0x7fcc1c14f850 msgr2=0x7fcc1c0aacf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T19:59:49.863 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:49.859+0000 7fcc1b59e640 1 --2- 172.21.15.78:0/2452865437 >> v2:172.21.15.179:3300/0 conn(0x7fcc1c14f850 0x7fcc1c0aacf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:49.863 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:49.859+0000 7fcc1b59e640 1 -- 172.21.15.78:0/2452865437 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc1c152ed0 con 0x7fcc1c06d840 2023-11-28T19:59:49.863 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:49.859+0000 7fcc1ad9d640 1 --2- 172.21.15.78:0/2452865437 >> v2:172.21.15.179:3300/0 conn(0x7fcc1c14f850 0x7fcc1c0aacf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T19:59:49.863 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:49.859+0000 7fcc1259c640 1 --2- 172.21.15.78:0/2452865437 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcc1c14fc30 0x7fcc1c0c3cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T19:59:49.863 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:49.863+0000 7fcc1b59e640 1 --2- 172.21.15.78:0/2452865437 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcc1c06d840 0x7fcc1c0c4210 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fcc1c066f50 tx=0x7fcc1401c500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=26919352a4787835 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:59:49.864 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:49.863+0000 7fcc1a59c640 1 -- 172.21.15.78:0/2452865437 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc140aa640 con 0x7fcc1c06d840 2023-11-28T19:59:49.865 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:49.863+0000 7fcc1a59c640 1 -- 172.21.15.78:0/2452865437 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc140aa7a0 con 0x7fcc1c06d840 2023-11-28T19:59:49.865 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:49.863+0000 7fcc1a59c640 1 -- 172.21.15.78:0/2452865437 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc140aab30 con 0x7fcc1c06d840 2023-11-28T19:59:49.865 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:49.863+0000 7fcc21196640 1 -- 172.21.15.78:0/2452865437 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcc1c06d840 msgr2=0x7fcc1c0c4210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:49.865 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:49.863+0000 7fcc21196640 1 --2- 172.21.15.78:0/2452865437 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcc1c06d840 0x7fcc1c0c4210 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fcc1c066f50 tx=0x7fcc1401c500 comp rx=0 tx=0).stop 2023-11-28T19:59:49.865 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:49.863+0000 7fcc21196640 1 -- 172.21.15.78:0/2452865437 shutdown_connections 2023-11-28T19:59:49.865 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:49.863+0000 7fcc21196640 1 --2- 172.21.15.78:0/2452865437 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcc1c06d840 0x7fcc1c0c4210 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:49.865 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:49.863+0000 7fcc21196640 1 --2- 172.21.15.78:0/2452865437 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcc1c14fc30 0x7fcc1c0c3cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:49.865 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:49.863+0000 7fcc21196640 1 --2- 172.21.15.78:0/2452865437 >> v2:172.21.15.179:3300/0 conn(0x7fcc1c14f850 0x7fcc1c0aacf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:49.865 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:49.863+0000 7fcc21196640 1 -- 172.21.15.78:0/2452865437 >> 172.21.15.78:0/2452865437 conn(0x7fcc1c0c59f0 msgr2=0x7fcc1c0c5e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T19:59:49.865 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:49.863+0000 7fcc21196640 1 -- 172.21.15.78:0/2452865437 shutdown_connections 2023-11-28T19:59:49.865 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:49.863+0000 7fcc21196640 1 -- 172.21.15.78:0/2452865437 wait complete. 2023-11-28T19:59:49.866 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:49.863+0000 7fcc21196640 1 Processor -- start 2023-11-28T19:59:49.866 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:49.863+0000 7fcc21196640 1 -- start start 2023-11-28T19:59:49.869 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:49.867+0000 7fcc21196640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcc1c06d840 0x7fcc1c1ebd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:49.869 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:49.867+0000 7fcc21196640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcc1c14f850 0x7fcc1c072420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:49.869 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:49.867+0000 7fcc21196640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcc1c14fc30 0x7fcc1c0706c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:49.870 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:49.867+0000 7fcc21196640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc1c06fe60 con 0x7fcc1c14f850 2023-11-28T19:59:49.870 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:49.867+0000 7fcc21196640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc1c0a6de0 con 0x7fcc1c14fc30 2023-11-28T19:59:49.870 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:49.867+0000 7fcc21196640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcc1c070280 con 0x7fcc1c06d840 2023-11-28T19:59:49.870 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:49.867+0000 7fcc1259c640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcc1c14f850 0x7fcc1c072420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:49.870 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:49.867+0000 7fcc1259c640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcc1c14f850 0x7fcc1c072420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:45324/0 (socket says 172.21.15.78:45324) 2023-11-28T19:59:49.870 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:49.867+0000 7fcc1259c640 1 -- 172.21.15.78:0/1271207293 learned_addr learned my addr 172.21.15.78:0/1271207293 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T19:59:49.871 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:49.867+0000 7fcc1ad9d640 1 --2- 172.21.15.78:0/1271207293 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcc1c06d840 0x7fcc1c1ebd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:49.871 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:49.867+0000 7fcc1b59e640 1 --2- 172.21.15.78:0/1271207293 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcc1c14fc30 0x7fcc1c0706c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:49.871 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:49.867+0000 7fcc1259c640 1 -- 172.21.15.78:0/1271207293 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcc1c06d840 msgr2=0x7fcc1c1ebd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:49.871 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:49.867+0000 7fcc1259c640 1 --2- 172.21.15.78:0/1271207293 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcc1c06d840 0x7fcc1c1ebd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:49.871 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:49.867+0000 7fcc1259c640 1 -- 172.21.15.78:0/1271207293 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcc1c14fc30 msgr2=0x7fcc1c0706c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:49.871 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:49.867+0000 7fcc1259c640 1 --2- 172.21.15.78:0/1271207293 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcc1c14fc30 0x7fcc1c0706c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:49.872 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:49.867+0000 7fcc1259c640 1 -- 172.21.15.78:0/1271207293 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc140094d0 con 0x7fcc1c14f850 2023-11-28T19:59:49.872 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:49.867+0000 7fcc1259c640 1 --2- 172.21.15.78:0/1271207293 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcc1c14f850 0x7fcc1c072420 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fcc0400c7f0 tx=0x7fcc0400ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:59:49.872 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:49.867+0000 7fcc13fff640 1 -- 172.21.15.78:0/1271207293 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc04007820 con 0x7fcc1c14f850 2023-11-28T19:59:49.872 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:49.867+0000 7fcc13fff640 1 -- 172.21.15.78:0/1271207293 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc04007980 con 0x7fcc1c14f850 2023-11-28T19:59:49.872 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:49.867+0000 7fcc21196640 1 -- 172.21.15.78:0/1271207293 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcc1c06fac0 con 0x7fcc1c14f850 2023-11-28T19:59:49.872 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:49.867+0000 7fcc13fff640 1 -- 172.21.15.78:0/1271207293 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc04007d30 con 0x7fcc1c14f850 2023-11-28T19:59:49.873 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:49.867+0000 7fcc21196640 1 -- 172.21.15.78:0/1271207293 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcc1c15bf00 con 0x7fcc1c14f850 2023-11-28T19:59:49.874 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:49.867+0000 7fcc21196640 1 -- 172.21.15.78:0/1271207293 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcc1c067630 con 0x7fcc1c14f850 2023-11-28T19:59:49.874 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:49.871+0000 7fcc13fff640 1 -- 172.21.15.78:0/1271207293 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fcc040113f0 con 0x7fcc1c14f850 2023-11-28T19:59:49.874 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:49.871+0000 7fcc13fff640 1 --2- 172.21.15.78:0/1271207293 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fcbfc066470 0x7fcbfc068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:49.874 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:49.871+0000 7fcc13fff640 1 -- 172.21.15.78:0/1271207293 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fcc04084480 con 0x7fcc1c14f850 2023-11-28T19:59:49.874 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:49.871+0000 7fcc1ad9d640 1 --2- 172.21.15.78:0/1271207293 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fcbfc066470 0x7fcbfc068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:49.874 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:49.871+0000 7fcc1ad9d640 1 --2- 172.21.15.78:0/1271207293 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fcbfc066470 0x7fcbfc068930 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fcc1c06bbd0 tx=0x7fcc0c0077c0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:59:49.876 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:49.875+0000 7fcc13fff640 1 -- 172.21.15.78:0/1271207293 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fcc040515f0 con 0x7fcc1c14f850 2023-11-28T19:59:50.028 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:50.027+0000 7fcc21196640 1 -- 172.21.15.78:0/1271207293 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fcc1c0a4a90 con 0x7fcc1c14f850 2023-11-28T19:59:50.028 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:50.027+0000 7fcc13fff640 1 -- 172.21.15.78:0/1271207293 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v27) v1 ==== 100+0+11 (secure 0 0 0) 0x7fcc04054c10 con 0x7fcc1c14f850 2023-11-28T19:59:50.029 INFO:teuthology.orchestra.run.smithi078.stdout:pg_num: 64 2023-11-28T19:59:50.030 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:50.027+0000 7fcc21196640 1 -- 172.21.15.78:0/1271207293 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fcbfc066470 msgr2=0x7fcbfc068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:50.031 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:50.027+0000 7fcc21196640 1 --2- 172.21.15.78:0/1271207293 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fcbfc066470 0x7fcbfc068930 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fcc1c06bbd0 tx=0x7fcc0c0077c0 comp rx=0 tx=0).stop 2023-11-28T19:59:50.031 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:50.027+0000 7fcc21196640 1 -- 172.21.15.78:0/1271207293 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcc1c14f850 msgr2=0x7fcc1c072420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:50.031 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:50.027+0000 7fcc21196640 1 --2- 172.21.15.78:0/1271207293 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcc1c14f850 0x7fcc1c072420 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fcc0400c7f0 tx=0x7fcc0400ccb0 comp rx=0 tx=0).stop 2023-11-28T19:59:50.031 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:50.027+0000 7fcc21196640 1 -- 172.21.15.78:0/1271207293 shutdown_connections 2023-11-28T19:59:50.031 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:50.027+0000 7fcc21196640 1 --2- 172.21.15.78:0/1271207293 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fcbfc066470 0x7fcbfc068930 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:50.031 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:50.027+0000 7fcc21196640 1 --2- 172.21.15.78:0/1271207293 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcc1c14fc30 0x7fcc1c0706c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:50.031 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:50.027+0000 7fcc21196640 1 --2- 172.21.15.78:0/1271207293 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcc1c14f850 0x7fcc1c072420 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:50.031 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:50.027+0000 7fcc21196640 1 --2- 172.21.15.78:0/1271207293 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcc1c06d840 0x7fcc1c1ebd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:50.031 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:50.027+0000 7fcc21196640 1 -- 172.21.15.78:0/1271207293 >> 172.21.15.78:0/1271207293 conn(0x7fcc1c0c59f0 msgr2=0x7fcc1c151430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T19:59:50.031 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:50.027+0000 7fcc21196640 1 -- 172.21.15.78:0/1271207293 shutdown_connections 2023-11-28T19:59:50.031 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:50.027+0000 7fcc21196640 1 -- 172.21.15.78:0/1271207293 wait complete. 2023-11-28T19:59:50.050 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-11-28T19:59:50.195 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:50.195+0000 7f17bd52a640 1 Processor -- start 2023-11-28T19:59:50.196 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:50.195+0000 7f17bd52a640 1 -- start start 2023-11-28T19:59:50.198 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:50.195+0000 7f17bd52a640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f17b814f850 0x7f17b80aacf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:50.198 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:50.195+0000 7f17bd52a640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f17b814fc30 0x7f17b80c3cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:50.199 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:50.195+0000 7f17bd52a640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f17b806d840 0x7f17b80c4210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:50.199 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:50.195+0000 7f17bd52a640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f17b80c2240 con 0x7f17b814f850 2023-11-28T19:59:50.199 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:50.195+0000 7f17bd52a640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f17b8152910 con 0x7f17b814fc30 2023-11-28T19:59:50.199 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:50.195+0000 7f17bd52a640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f17b8152bf0 con 0x7f17b806d840 2023-11-28T19:59:50.199 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:50.195+0000 7f17b6ffd640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f17b814f850 0x7f17b80aacf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:50.199 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:50.195+0000 7f17b6ffd640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f17b814f850 0x7f17b80aacf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:45334/0 (socket says 172.21.15.78:45334) 2023-11-28T19:59:50.199 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:50.195+0000 7f17b6ffd640 1 -- 172.21.15.78:0/3620406497 learned_addr learned my addr 172.21.15.78:0/3620406497 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T19:59:50.200 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:50.195+0000 7f17b67fc640 1 --2- 172.21.15.78:0/3620406497 >> v2:172.21.15.179:3300/0 conn(0x7f17b814fc30 0x7f17b80c3cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:50.200 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:50.195+0000 7f17b77fe640 1 --2- 172.21.15.78:0/3620406497 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f17b806d840 0x7f17b80c4210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:50.200 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:50.195+0000 7f17b6ffd640 1 -- 172.21.15.78:0/3620406497 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f17b806d840 msgr2=0x7f17b80c4210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T19:59:50.200 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:50.195+0000 7f17b6ffd640 1 --2- 172.21.15.78:0/3620406497 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f17b806d840 0x7f17b80c4210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:50.200 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:50.195+0000 7f17b6ffd640 1 -- 172.21.15.78:0/3620406497 >> v2:172.21.15.179:3300/0 conn(0x7f17b814fc30 msgr2=0x7f17b80c3cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T19:59:50.200 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:50.195+0000 7f17b6ffd640 1 --2- 172.21.15.78:0/3620406497 >> v2:172.21.15.179:3300/0 conn(0x7f17b814fc30 0x7f17b80c3cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:50.201 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:50.195+0000 7f17b6ffd640 1 -- 172.21.15.78:0/3620406497 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17b8152ed0 con 0x7f17b814f850 2023-11-28T19:59:50.201 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:50.195+0000 7f17b77fe640 1 --2- 172.21.15.78:0/3620406497 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f17b806d840 0x7f17b80c4210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T19:59:50.203 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:50.199+0000 7f17b6ffd640 1 --2- 172.21.15.78:0/3620406497 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f17b814f850 0x7f17b80aacf0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f17b806cac0 tx=0x7f17a801c500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3d8e17f88157d9c5 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:59:50.204 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:50.199+0000 7f17b5ffb640 1 -- 172.21.15.78:0/3620406497 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17a80aa640 con 0x7f17b814f850 2023-11-28T19:59:50.204 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:50.199+0000 7f17b5ffb640 1 -- 172.21.15.78:0/3620406497 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f17a80aa7a0 con 0x7f17b814f850 2023-11-28T19:59:50.204 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:50.199+0000 7f17b5ffb640 1 -- 172.21.15.78:0/3620406497 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17a80aab30 con 0x7f17b814f850 2023-11-28T19:59:50.204 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:50.199+0000 7f17bd52a640 1 -- 172.21.15.78:0/3620406497 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f17b814f850 msgr2=0x7f17b80aacf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:50.204 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:50.199+0000 7f17bd52a640 1 --2- 172.21.15.78:0/3620406497 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f17b814f850 0x7f17b80aacf0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f17b806cac0 tx=0x7f17a801c500 comp rx=0 tx=0).stop 2023-11-28T19:59:50.205 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:50.199+0000 7f17bd52a640 1 -- 172.21.15.78:0/3620406497 shutdown_connections 2023-11-28T19:59:50.205 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:50.199+0000 7f17bd52a640 1 --2- 172.21.15.78:0/3620406497 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f17b806d840 0x7f17b80c4210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:50.205 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:50.199+0000 7f17bd52a640 1 --2- 172.21.15.78:0/3620406497 >> v2:172.21.15.179:3300/0 conn(0x7f17b814fc30 0x7f17b80c3cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:50.205 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:50.199+0000 7f17bd52a640 1 --2- 172.21.15.78:0/3620406497 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f17b814f850 0x7f17b80aacf0 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:50.205 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:50.199+0000 7f17bd52a640 1 -- 172.21.15.78:0/3620406497 >> 172.21.15.78:0/3620406497 conn(0x7f17b80c59f0 msgr2=0x7f17b80c5e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T19:59:50.206 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:50.199+0000 7f17bd52a640 1 -- 172.21.15.78:0/3620406497 shutdown_connections 2023-11-28T19:59:50.206 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:50.199+0000 7f17bd52a640 1 -- 172.21.15.78:0/3620406497 wait complete. 2023-11-28T19:59:50.206 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:50.203+0000 7f17bd52a640 1 Processor -- start 2023-11-28T19:59:50.206 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:50.203+0000 7f17bd52a640 1 -- start start 2023-11-28T19:59:50.212 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:50.203+0000 7f17bd52a640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f17b806d840 0x7f17b80aa6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:50.212 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:50.203+0000 7f17bd52a640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f17b814f850 0x7f17b815b480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:50.212 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:50.203+0000 7f17bd52a640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f17b814fc30 0x7f17b8154290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:50.212 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:50.203+0000 7f17bd52a640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17b80a74d0 con 0x7f17b806d840 2023-11-28T19:59:50.213 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:50.203+0000 7f17bd52a640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17b80a5f40 con 0x7f17b814f850 2023-11-28T19:59:50.213 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:50.203+0000 7f17bd52a640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f17b80a71f0 con 0x7f17b814fc30 2023-11-28T19:59:50.213 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:50.203+0000 7f17b6ffd640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f17b806d840 0x7f17b80aa6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:50.213 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:50.203+0000 7f17b6ffd640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f17b806d840 0x7f17b80aa6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:45344/0 (socket says 172.21.15.78:45344) 2023-11-28T19:59:50.213 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:50.203+0000 7f17b6ffd640 1 -- 172.21.15.78:0/3335023741 learned_addr learned my addr 172.21.15.78:0/3335023741 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T19:59:50.214 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:50.203+0000 7f17b67fc640 1 --2- 172.21.15.78:0/3335023741 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f17b814f850 0x7f17b815b480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:50.214 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:50.203+0000 7f17b77fe640 1 --2- 172.21.15.78:0/3335023741 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f17b814fc30 0x7f17b8154290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:50.215 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:50.203+0000 7f17b6ffd640 1 -- 172.21.15.78:0/3335023741 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f17b814fc30 msgr2=0x7f17b8154290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:50.215 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:50.203+0000 7f17b6ffd640 1 --2- 172.21.15.78:0/3335023741 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f17b814fc30 0x7f17b8154290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:50.215 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:50.203+0000 7f17b6ffd640 1 -- 172.21.15.78:0/3335023741 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f17b814f850 msgr2=0x7f17b815b480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:50.215 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:50.203+0000 7f17b6ffd640 1 --2- 172.21.15.78:0/3335023741 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f17b814f850 0x7f17b815b480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:50.215 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:50.203+0000 7f17b6ffd640 1 -- 172.21.15.78:0/3335023741 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17a80094d0 con 0x7f17b806d840 2023-11-28T19:59:50.216 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:50.203+0000 7f17b6ffd640 1 --2- 172.21.15.78:0/3335023741 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f17b806d840 0x7f17b80aa6e0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f17a801abb0 tx=0x7f17a801ad40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:59:50.216 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:50.203+0000 7f179f7fe640 1 -- 172.21.15.78:0/3335023741 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17a80bd5f0 con 0x7f17b806d840 2023-11-28T19:59:50.216 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:50.203+0000 7f179f7fe640 1 -- 172.21.15.78:0/3335023741 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f17a80bd750 con 0x7f17b806d840 2023-11-28T19:59:50.216 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:50.203+0000 7f179f7fe640 1 -- 172.21.15.78:0/3335023741 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17a80bdb00 con 0x7f17b806d840 2023-11-28T19:59:50.216 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:50.203+0000 7f17bd52a640 1 -- 172.21.15.78:0/3335023741 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f17b80a8c80 con 0x7f17b806d840 2023-11-28T19:59:50.216 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:50.203+0000 7f17bd52a640 1 -- 172.21.15.78:0/3335023741 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f17b815b9c0 con 0x7f17b806d840 2023-11-28T19:59:50.217 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:50.203+0000 7f17bd52a640 1 -- 172.21.15.78:0/3335023741 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f17b80a8ae0 con 0x7f17b806d840 2023-11-28T19:59:50.217 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:50.207+0000 7f179f7fe640 1 -- 172.21.15.78:0/3335023741 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f17a80a8050 con 0x7f17b806d840 2023-11-28T19:59:50.217 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:50.207+0000 7f179f7fe640 1 --2- 172.21.15.78:0/3335023741 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f17a4066470 0x7f17a4068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:50.217 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:50.207+0000 7f179f7fe640 1 -- 172.21.15.78:0/3335023741 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f17a811e770 con 0x7f17b806d840 2023-11-28T19:59:50.217 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:50.207+0000 7f17b67fc640 1 --2- 172.21.15.78:0/3335023741 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f17a4066470 0x7f17a4068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:50.218 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:50.207+0000 7f17b67fc640 1 --2- 172.21.15.78:0/3335023741 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f17a4066470 0x7f17a4068930 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f17b80aae60 tx=0x7f17ac009190 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:59:50.218 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:50.211+0000 7f179f7fe640 1 -- 172.21.15.78:0/3335023741 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f17b80a8ae0 con 0x7f17b806d840 2023-11-28T19:59:50.366 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:50.363+0000 7f17bd52a640 1 -- 172.21.15.78:0/3335023741 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f17b81526d0 con 0x7f17b806d840 2023-11-28T19:59:50.366 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:50.363+0000 7f179f7fe640 1 -- 172.21.15.78:0/3335023741 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v27) v1 ==== 103+0+11 (secure 0 0 0) 0x7f17b81526d0 con 0x7f17b806d840 2023-11-28T19:59:50.366 INFO:teuthology.orchestra.run.smithi078.stdout:pg_num: 32 2023-11-28T19:59:50.368 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:50.367+0000 7f17bd52a640 1 -- 172.21.15.78:0/3335023741 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f17a4066470 msgr2=0x7f17a4068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:50.368 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:50.367+0000 7f17bd52a640 1 --2- 172.21.15.78:0/3335023741 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f17a4066470 0x7f17a4068930 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f17b80aae60 tx=0x7f17ac009190 comp rx=0 tx=0).stop 2023-11-28T19:59:50.368 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:50.367+0000 7f17bd52a640 1 -- 172.21.15.78:0/3335023741 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f17b806d840 msgr2=0x7f17b80aa6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:50.369 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:50.367+0000 7f17bd52a640 1 --2- 172.21.15.78:0/3335023741 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f17b806d840 0x7f17b80aa6e0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f17a801abb0 tx=0x7f17a801ad40 comp rx=0 tx=0).stop 2023-11-28T19:59:50.369 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:50.367+0000 7f17bd52a640 1 -- 172.21.15.78:0/3335023741 shutdown_connections 2023-11-28T19:59:50.369 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:50.367+0000 7f17bd52a640 1 --2- 172.21.15.78:0/3335023741 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f17a4066470 0x7f17a4068930 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:50.369 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:50.367+0000 7f17bd52a640 1 --2- 172.21.15.78:0/3335023741 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f17b814fc30 0x7f17b8154290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:50.369 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:50.367+0000 7f17bd52a640 1 --2- 172.21.15.78:0/3335023741 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f17b814f850 0x7f17b815b480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:50.370 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:50.367+0000 7f17bd52a640 1 --2- 172.21.15.78:0/3335023741 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f17b806d840 0x7f17b80aa6e0 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:50.370 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:50.367+0000 7f17bd52a640 1 -- 172.21.15.78:0/3335023741 >> 172.21.15.78:0/3335023741 conn(0x7f17b80c59f0 msgr2=0x7f17b806cf80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T19:59:50.370 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:50.367+0000 7f17bd52a640 1 -- 172.21.15.78:0/3335023741 shutdown_connections 2023-11-28T19:59:50.370 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:50.367+0000 7f17bd52a640 1 -- 172.21.15.78:0/3335023741 wait complete. 2023-11-28T19:59:50.387 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-11-28T19:59:50.525 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:50.523+0000 7f9005c17640 1 Processor -- start 2023-11-28T19:59:50.526 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:50.523+0000 7f9005c17640 1 -- start start 2023-11-28T19:59:50.526 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:50.523+0000 7f9005c17640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f90000c47c0 0x7f9000155100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:50.527 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:50.523+0000 7f9005c17640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f900006b320 0x7f90000c7f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:50.527 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:50.523+0000 7f9005c17640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9000155640 con 0x7f9000151ec0 2023-11-28T19:59:50.527 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:50.523+0000 7f9005c17640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f90000c8aa0 con 0x7f900006b320 2023-11-28T19:59:50.527 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:50.523+0000 7f9005c17640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f90000c9060 con 0x7f90000c47c0 2023-11-28T19:59:50.528 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:50.523+0000 7f8ffffff640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f900006b320 0x7f90000c7f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:50.528 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:50.523+0000 7f8ff7fff640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f90000c47c0 0x7f9000155100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:50.528 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:50.523+0000 7f8ffffff640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f900006b320 0x7f90000c7f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.78:50122/0 (socket says 172.21.15.78:50122) 2023-11-28T19:59:50.528 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:50.523+0000 7f8ffffff640 1 -- 172.21.15.78:0/596047405 learned_addr learned my addr 172.21.15.78:0/596047405 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T19:59:50.528 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:50.527+0000 7f8ffffff640 1 -- 172.21.15.78:0/596047405 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f90000c47c0 msgr2=0x7f9000155100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T19:59:50.528 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:50.527+0000 7f8ffffff640 1 --2- 172.21.15.78:0/596047405 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f90000c47c0 0x7f9000155100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:50.528 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:50.527+0000 7f8ffffff640 1 -- 172.21.15.78:0/596047405 >> v1:172.21.15.179:6789/0 conn(0x7f9000151ec0 legacy=0x7f90000c94f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:50.528 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:50.527+0000 7f8ffffff640 1 -- 172.21.15.78:0/596047405 --> v2:172.21.15.179:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90000c4d30 con 0x7f900006b320 2023-11-28T19:59:50.529 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:50.527+0000 7f8ffeffd640 1 -- 172.21.15.78:0/596047405 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1008795180 0 0) 0x7f8ff0001120 con 0x7f9000151ec0 2023-11-28T19:59:50.529 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:50.527+0000 7f8ff7fff640 1 --2- 172.21.15.78:0/596047405 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f90000c47c0 0x7f9000155100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T19:59:50.530 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:50.527+0000 7f8ffffff640 1 --2- 172.21.15.78:0/596047405 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f900006b320 0x7f90000c7f60 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f8ff8009e80 tx=0x7f8ff801c9f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2fa7933c06c8f786 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:59:50.531 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:50.527+0000 7f8ffeffd640 1 -- 172.21.15.78:0/596047405 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ff80a58b0 con 0x7f900006b320 2023-11-28T19:59:50.532 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:50.527+0000 7f8ffeffd640 1 -- 172.21.15.78:0/596047405 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ff80a5a10 con 0x7f900006b320 2023-11-28T19:59:50.532 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:50.527+0000 7f8ffeffd640 1 -- 172.21.15.78:0/596047405 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ff80a5da0 con 0x7f900006b320 2023-11-28T19:59:50.532 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:50.531+0000 7f9005c17640 1 -- 172.21.15.78:0/596047405 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f900006b320 msgr2=0x7f90000c7f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:50.532 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:50.531+0000 7f9005c17640 1 --2- 172.21.15.78:0/596047405 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f900006b320 0x7f90000c7f60 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f8ff8009e80 tx=0x7f8ff801c9f0 comp rx=0 tx=0).stop 2023-11-28T19:59:50.532 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:50.531+0000 7f9005c17640 1 -- 172.21.15.78:0/596047405 shutdown_connections 2023-11-28T19:59:50.532 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:50.531+0000 7f9005c17640 1 --2- 172.21.15.78:0/596047405 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f900006b320 0x7f90000c7f60 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:50.532 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:50.531+0000 7f9005c17640 1 --2- 172.21.15.78:0/596047405 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f90000c47c0 0x7f9000155100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:50.532 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:50.531+0000 7f9005c17640 1 -- 172.21.15.78:0/596047405 >> 172.21.15.78:0/596047405 conn(0x7f90000c9e40 msgr2=0x7f90000ca250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T19:59:50.532 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:50.531+0000 7f9005c17640 1 -- 172.21.15.78:0/596047405 shutdown_connections 2023-11-28T19:59:50.532 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:50.531+0000 7f9005c17640 1 -- 172.21.15.78:0/596047405 wait complete. 2023-11-28T19:59:50.533 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:50.531+0000 7f9005c17640 1 Processor -- start 2023-11-28T19:59:50.533 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:50.531+0000 7f9005c17640 1 -- start start 2023-11-28T19:59:50.534 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:50.531+0000 7f9005c17640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f900006b320 0x7f90001edc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:50.535 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:50.531+0000 7f9005c17640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f90000c47c0 0x7f90000c17b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:50.535 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:50.531+0000 7f9005c17640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9000151ec0 0x7f900014fb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:50.535 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:50.531+0000 7f9005c17640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90000c3060 con 0x7f9000151ec0 2023-11-28T19:59:50.535 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:50.531+0000 7f9005c17640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90001ed7b0 con 0x7f900006b320 2023-11-28T19:59:50.535 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:50.531+0000 7f9005c17640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f90000c22e0 con 0x7f90000c47c0 2023-11-28T19:59:50.535 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:50.531+0000 7f8ffffff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9000151ec0 0x7f900014fb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:50.535 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:50.531+0000 7f8ffffff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9000151ec0 0x7f900014fb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:45360/0 (socket says 172.21.15.78:45360) 2023-11-28T19:59:50.535 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:50.531+0000 7f8ffffff640 1 -- 172.21.15.78:0/1595436769 learned_addr learned my addr 172.21.15.78:0/1595436769 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T19:59:50.537 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:50.531+0000 7f8ff7fff640 1 --2- 172.21.15.78:0/1595436769 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f90000c47c0 0x7f90000c17b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:50.537 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:50.531+0000 7f8fff7fe640 1 --2- 172.21.15.78:0/1595436769 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f900006b320 0x7f90001edc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:50.537 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:50.531+0000 7f8ffffff640 1 -- 172.21.15.78:0/1595436769 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f90000c47c0 msgr2=0x7f90000c17b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:50.537 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:50.531+0000 7f8ffffff640 1 --2- 172.21.15.78:0/1595436769 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f90000c47c0 0x7f90000c17b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:50.537 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:50.531+0000 7f8ffffff640 1 -- 172.21.15.78:0/1595436769 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f900006b320 msgr2=0x7f90001edc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:50.537 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:50.531+0000 7f8ffffff640 1 --2- 172.21.15.78:0/1595436769 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f900006b320 0x7f90001edc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:50.538 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:50.531+0000 7f8ffffff640 1 -- 172.21.15.78:0/1595436769 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8fe8009420 con 0x7f9000151ec0 2023-11-28T19:59:50.538 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:50.531+0000 7f8ffffff640 1 --2- 172.21.15.78:0/1595436769 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9000151ec0 0x7f900014fb70 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f8ff80af040 tx=0x7f8ff8019790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:59:50.538 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:50.535+0000 7f8ffcff9640 1 -- 172.21.15.78:0/1595436769 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ff80bd070 con 0x7f9000151ec0 2023-11-28T19:59:50.538 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:50.535+0000 7f8ffcff9640 1 -- 172.21.15.78:0/1595436769 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ff80b8470 con 0x7f9000151ec0 2023-11-28T19:59:50.538 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:50.535+0000 7f9005c17640 1 -- 172.21.15.78:0/1595436769 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8ff8009b30 con 0x7f9000151ec0 2023-11-28T19:59:50.538 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:50.535+0000 7f8ffcff9640 1 -- 172.21.15.78:0/1595436769 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ff80b87e0 con 0x7f9000151ec0 2023-11-28T19:59:50.538 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:50.535+0000 7f9005c17640 1 -- 172.21.15.78:0/1595436769 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f90001ed440 con 0x7f9000151ec0 2023-11-28T19:59:50.538 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:50.535+0000 7f9005c17640 1 -- 172.21.15.78:0/1595436769 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f90001461d0 con 0x7f9000151ec0 2023-11-28T19:59:50.538 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:50.535+0000 7f8ffcff9640 1 -- 172.21.15.78:0/1595436769 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f8ff80b8940 con 0x7f9000151ec0 2023-11-28T19:59:50.539 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:50.535+0000 7f8ffcff9640 1 --2- 172.21.15.78:0/1595436769 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f8fe0066470 0x7f8fe0068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:50.539 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:50.535+0000 7f8ffcff9640 1 -- 172.21.15.78:0/1595436769 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f8ff811f040 con 0x7f9000151ec0 2023-11-28T19:59:50.539 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:50.535+0000 7f8fff7fe640 1 --2- 172.21.15.78:0/1595436769 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f8fe0066470 0x7f8fe0068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:50.539 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:50.535+0000 7f8fff7fe640 1 --2- 172.21.15.78:0/1595436769 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f8fe0066470 0x7f8fe0068930 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f8ff0000f70 tx=0x7f8ff0009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:59:50.542 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:50.539+0000 7f8ffcff9640 1 -- 172.21.15.78:0/1595436769 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f8ff80ec100 con 0x7f9000151ec0 2023-11-28T19:59:50.705 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:50.703+0000 7f9005c17640 1 -- 172.21.15.78:0/1595436769 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f90001ed940 con 0x7f9000151ec0 2023-11-28T19:59:50.705 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:50.703+0000 7f8ffcff9640 1 -- 172.21.15.78:0/1595436769 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v27) v1 ==== 80+0+0 (secure 0 0 0) 0x7f8ff80ace80 con 0x7f9000151ec0 2023-11-28T19:59:50.705 INFO:teuthology.orchestra.run.smithi078.stderr:listed 0 entries 2023-11-28T19:59:50.707 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:50.703+0000 7f9005c17640 1 -- 172.21.15.78:0/1595436769 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f8fe0066470 msgr2=0x7f8fe0068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:50.707 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:50.703+0000 7f9005c17640 1 --2- 172.21.15.78:0/1595436769 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f8fe0066470 0x7f8fe0068930 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f8ff0000f70 tx=0x7f8ff0009040 comp rx=0 tx=0).stop 2023-11-28T19:59:50.707 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:50.703+0000 7f9005c17640 1 -- 172.21.15.78:0/1595436769 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9000151ec0 msgr2=0x7f900014fb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:50.707 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:50.703+0000 7f9005c17640 1 --2- 172.21.15.78:0/1595436769 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9000151ec0 0x7f900014fb70 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f8ff80af040 tx=0x7f8ff8019790 comp rx=0 tx=0).stop 2023-11-28T19:59:50.707 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:50.703+0000 7f9005c17640 1 -- 172.21.15.78:0/1595436769 shutdown_connections 2023-11-28T19:59:50.707 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:50.703+0000 7f9005c17640 1 --2- 172.21.15.78:0/1595436769 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f8fe0066470 0x7f8fe0068930 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:50.708 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:50.703+0000 7f9005c17640 1 --2- 172.21.15.78:0/1595436769 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f90000c47c0 0x7f90000c17b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:50.708 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:50.703+0000 7f9005c17640 1 --2- 172.21.15.78:0/1595436769 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9000151ec0 0x7f900014fb70 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:50.708 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:50.703+0000 7f9005c17640 1 --2- 172.21.15.78:0/1595436769 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f900006b320 0x7f90001edc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:50.708 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:50.703+0000 7f9005c17640 1 -- 172.21.15.78:0/1595436769 >> 172.21.15.78:0/1595436769 conn(0x7f90000c9e40 msgr2=0x7f900015e550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T19:59:50.708 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:50.703+0000 7f9005c17640 1 -- 172.21.15.78:0/1595436769 shutdown_connections 2023-11-28T19:59:50.708 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:50.703+0000 7f9005c17640 1 -- 172.21.15.78:0/1595436769 wait complete. 2023-11-28T19:59:50.726 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-11-28T19:59:50.726 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T19:59:50.726 DEBUG:teuthology.orchestra.run.smithi078:> sudo umount /home/ubuntu/cephtest/mnt.0 -f 2023-11-28T19:59:50.763 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi078.front.sepia.ceph.com 2023-11-28T19:59:50.763 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T19:59:50.763 DEBUG:teuthology.orchestra.run.smithi078:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-11-28T19:59:50.812 DEBUG:teuthology.orchestra.run.smithi179:> set -ex 2023-11-28T19:59:50.812 DEBUG:teuthology.orchestra.run.smithi179:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-28T19:59:50.822 DEBUG:teuthology.orchestra.run.smithi179:> set -ex 2023-11-28T19:59:50.822 DEBUG:teuthology.orchestra.run.smithi179:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-28T19:59:50.877 DEBUG:teuthology.orchestra.run.smithi179:> set -ex 2023-11-28T19:59:50.877 DEBUG:teuthology.orchestra.run.smithi179:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-28T19:59:50.929 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-28T19:59:51.070 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:51.067+0000 7fef8d1d1640 1 Processor -- start 2023-11-28T19:59:51.070 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:51.067+0000 7fef8d1d1640 1 -- start start 2023-11-28T19:59:51.071 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:51.067+0000 7fef8d1d1640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fef88154f20 0x7fef8806b9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:51.071 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:51.067+0000 7fef8d1d1640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fef8806bf30 0x7fef8815ee20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:51.071 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:51.067+0000 7fef8d1d1640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fef8806c360 con 0x7fef880af4c0 2023-11-28T19:59:51.072 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:51.067+0000 7fef8d1d1640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fef880c4890 con 0x7fef88154f20 2023-11-28T19:59:51.072 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:51.067+0000 7fef8d1d1640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef881553d0 con 0x7fef8806bf30 2023-11-28T19:59:51.072 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:51.067+0000 7fef7ffff640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fef88154f20 0x7fef8806b9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:51.072 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:51.067+0000 7fef7ffff640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fef88154f20 0x7fef8806b9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:45376/0 (socket says 172.21.15.78:45376) 2023-11-28T19:59:51.072 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:51.067+0000 7fef7ffff640 1 -- 172.21.15.78:0/287794901 learned_addr learned my addr 172.21.15.78:0/287794901 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T19:59:51.072 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:51.071+0000 7fef8759e640 1 --2- 172.21.15.78:0/287794901 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fef8806bf30 0x7fef8815ee20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:51.072 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:51.071+0000 7fef7ffff640 1 -- 172.21.15.78:0/287794901 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fef8806bf30 msgr2=0x7fef8815ee20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T19:59:51.072 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:51.071+0000 7fef7ffff640 1 --2- 172.21.15.78:0/287794901 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fef8806bf30 0x7fef8815ee20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:51.072 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:51.071+0000 7fef7ffff640 1 -- 172.21.15.78:0/287794901 >> v1:172.21.15.179:6789/0 conn(0x7fef880af4c0 legacy=0x7fef880c67d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:51.072 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:51.071+0000 7fef7ffff640 1 -- 172.21.15.78:0/287794901 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef880af8a0 con 0x7fef88154f20 2023-11-28T19:59:51.074 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:51.071+0000 7fef7ffff640 1 --2- 172.21.15.78:0/287794901 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fef88154f20 0x7fef8806b9f0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fef70009870 tx=0x7fef7001c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=451b83180e0a7a6c server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:59:51.075 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:51.071+0000 7fef8659c640 1 -- 172.21.15.78:0/287794901 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef700ab680 con 0x7fef88154f20 2023-11-28T19:59:51.075 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:51.071+0000 7fef8659c640 1 -- 172.21.15.78:0/287794901 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef700ab7e0 con 0x7fef88154f20 2023-11-28T19:59:51.075 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:51.071+0000 7fef8659c640 1 -- 172.21.15.78:0/287794901 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef700abb70 con 0x7fef88154f20 2023-11-28T19:59:51.075 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:51.071+0000 7fef8d1d1640 1 -- 172.21.15.78:0/287794901 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fef88154f20 msgr2=0x7fef8806b9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:51.075 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:51.071+0000 7fef8d1d1640 1 --2- 172.21.15.78:0/287794901 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fef88154f20 0x7fef8806b9f0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fef70009870 tx=0x7fef7001c480 comp rx=0 tx=0).stop 2023-11-28T19:59:51.076 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:51.075+0000 7fef8d1d1640 1 -- 172.21.15.78:0/287794901 shutdown_connections 2023-11-28T19:59:51.076 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:51.075+0000 7fef8d1d1640 1 --2- 172.21.15.78:0/287794901 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fef8806bf30 0x7fef8815ee20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:51.076 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:51.075+0000 7fef8d1d1640 1 --2- 172.21.15.78:0/287794901 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fef88154f20 0x7fef8806b9f0 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:51.076 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:51.075+0000 7fef8d1d1640 1 -- 172.21.15.78:0/287794901 >> 172.21.15.78:0/287794901 conn(0x7fef880ab9d0 msgr2=0x7fef880abde0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T19:59:51.076 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:51.075+0000 7fef8d1d1640 1 -- 172.21.15.78:0/287794901 shutdown_connections 2023-11-28T19:59:51.076 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:51.075+0000 7fef8d1d1640 1 -- 172.21.15.78:0/287794901 wait complete. 2023-11-28T19:59:51.077 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:51.075+0000 7fef8d1d1640 1 Processor -- start 2023-11-28T19:59:51.077 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:51.075+0000 7fef8d1d1640 1 -- start start 2023-11-28T19:59:51.079 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:51.075+0000 7fef8d1d1640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fef8806bf30 0x7fef88150e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:51.079 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:51.075+0000 7fef8d1d1640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fef880af4c0 0x7fef881ece40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:51.079 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:51.075+0000 7fef8d1d1640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fef88154f20 0x7fef881ed380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:51.079 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:51.075+0000 7fef8d1d1640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef881531e0 con 0x7fef8806bf30 2023-11-28T19:59:51.079 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:51.075+0000 7fef8d1d1640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef881f0340 con 0x7fef880af4c0 2023-11-28T19:59:51.079 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:51.075+0000 7fef8d1d1640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef881f0620 con 0x7fef88154f20 2023-11-28T19:59:51.079 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:51.075+0000 7fef86d9d640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fef8806bf30 0x7fef88150e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:51.079 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:51.075+0000 7fef86d9d640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fef8806bf30 0x7fef88150e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:45386/0 (socket says 172.21.15.78:45386) 2023-11-28T19:59:51.079 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:51.075+0000 7fef86d9d640 1 -- 172.21.15.78:0/2877927601 learned_addr learned my addr 172.21.15.78:0/2877927601 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T19:59:51.080 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:51.075+0000 7fef7ffff640 1 --2- 172.21.15.78:0/2877927601 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fef880af4c0 0x7fef881ece40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:51.080 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:51.075+0000 7fef8759e640 1 --2- 172.21.15.78:0/2877927601 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fef88154f20 0x7fef881ed380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:51.080 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:51.075+0000 7fef86d9d640 1 -- 172.21.15.78:0/2877927601 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fef88154f20 msgr2=0x7fef881ed380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:51.080 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:51.075+0000 7fef86d9d640 1 --2- 172.21.15.78:0/2877927601 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fef88154f20 0x7fef881ed380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:51.080 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:51.075+0000 7fef86d9d640 1 -- 172.21.15.78:0/2877927601 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fef880af4c0 msgr2=0x7fef881ece40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:51.080 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:51.075+0000 7fef86d9d640 1 --2- 172.21.15.78:0/2877927601 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fef880af4c0 0x7fef881ece40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:51.080 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:51.075+0000 7fef86d9d640 1 -- 172.21.15.78:0/2877927601 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef700094d0 con 0x7fef8806bf30 2023-11-28T19:59:51.080 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:51.075+0000 7fef86d9d640 1 --2- 172.21.15.78:0/2877927601 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fef8806bf30 0x7fef88150e70 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fef7800c500 tx=0x7fef7800c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:59:51.081 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:51.079+0000 7fef7f7fe640 1 -- 172.21.15.78:0/2877927601 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef78005220 con 0x7fef8806bf30 2023-11-28T19:59:51.081 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:51.079+0000 7fef7f7fe640 1 -- 172.21.15.78:0/2877927601 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef78005380 con 0x7fef8806bf30 2023-11-28T19:59:51.081 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:51.079+0000 7fef8d1d1640 1 -- 172.21.15.78:0/2877927601 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fef881f0900 con 0x7fef8806bf30 2023-11-28T19:59:51.081 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:51.079+0000 7fef7f7fe640 1 -- 172.21.15.78:0/2877927601 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef78007270 con 0x7fef8806bf30 2023-11-28T19:59:51.081 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:51.079+0000 7fef8d1d1640 1 -- 172.21.15.78:0/2877927601 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fef881effd0 con 0x7fef8806bf30 2023-11-28T19:59:51.081 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:51.079+0000 7fef8d1d1640 1 -- 172.21.15.78:0/2877927601 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fef88067630 con 0x7fef8806bf30 2023-11-28T19:59:51.082 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:51.079+0000 7fef7f7fe640 1 -- 172.21.15.78:0/2877927601 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fef780073d0 con 0x7fef8806bf30 2023-11-28T19:59:51.082 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:51.079+0000 7fef7f7fe640 1 --2- 172.21.15.78:0/2877927601 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fef680664a0 0x7fef68068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:51.082 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:51.079+0000 7fef7f7fe640 1 -- 172.21.15.78:0/2877927601 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fef78083580 con 0x7fef8806bf30 2023-11-28T19:59:51.082 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:51.079+0000 7fef7ffff640 1 --2- 172.21.15.78:0/2877927601 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fef680664a0 0x7fef68068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:51.083 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:51.079+0000 7fef7ffff640 1 --2- 172.21.15.78:0/2877927601 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fef680664a0 0x7fef68068960 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fef700af000 tx=0x7fef700a7000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:59:51.086 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:51.083+0000 7fef7f7fe640 1 -- 172.21.15.78:0/2877927601 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fef78050650 con 0x7fef8806bf30 2023-11-28T19:59:51.236 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:51.235+0000 7fef8d1d1640 1 -- 172.21.15.78:0/2877927601 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fef881eca60 con 0x7fef8806bf30 2023-11-28T19:59:54.830 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:51.235+0000 7fef7f7fe640 1 -- 172.21.15.78:0/2877927601 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) v1 ==== 74+0+18711 (secure 0 0 0) 0x7fef78053c70 con 0x7fef8806bf30 2023-11-28T19:59:54.830 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-11-28T19:59:54.831 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":27,"fsid":"dd9780e8-3bda-44fa-a9f0-fa07d19d901d","created":"2023-11-28T19:58:40.969556+0000","modified":"2023-11-28T19:59:47.762261+0000","last_up_change":"2023-11-28T19:58:52.596716+0000","last_in_change":"2023-11-28T19:58:43.609275+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-28T19:58:54.011229+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-28T19:59:03.945559+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-28T19:59:04.481478+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-11-28T19:59:08.109152+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"e84245ac-b5da-429e-af18-39acaa2b33e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6800","nonce":3358701235},{"type":"v1","addr":"172.21.15.78:6801","nonce":3358701235}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6802","nonce":3358701235},{"type":"v1","addr":"172.21.15.78:6803","nonce":3358701235}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6806","nonce":3358701235},{"type":"v1","addr":"172.21.15.78:6807","nonce":3358701235}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6804","nonce":3358701235},{"type":"v1","addr":"172.21.15.78:6805","nonce":3358701235}]},"public_addr":"172.21.15.78:6801/3358701235","cluster_addr":"172.21.15.78:6803/3358701235","heartbeat_back_addr":"172.21.15.78:6807/3358701235","heartbeat_front_addr":"172.21.15.78:6805/3358701235","state":["exists","up"]},{"osd":1,"uuid":"e634831d-c4e2-48d9-870c-9556ae162981","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6808","nonce":3211476654},{"type":"v1","addr":"172.21.15.78:6809","nonce":3211476654}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6810","nonce":3211476654},{"type":"v1","addr":"172.21.15.78:6811","nonce":3211476654}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6814","nonce":3211476654},{"type":"v1","addr":"172.21.15.78:6815","nonce":3211476654}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6812","nonce":3211476654},{"type":"v1","addr":"172.21.15.78:6813","nonce":3211476654}]},"public_addr":"172.21.15.78:6809/3211476654","cluster_addr":"172.21.15.78:6811/3211476654","heartbeat_back_addr":"172.21.15.78:6815/3211476654","heartbeat_front_addr":"172.21.15.78:6813/3211476654","state":["exists","up"]},{"osd":2,"uuid":"274c8395-6534-41f0-b8fb-a00af8985aa8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6816","nonce":2532904479},{"type":"v1","addr":"172.21.15.78:6817","nonce":2532904479}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6818","nonce":2532904479},{"type":"v1","addr":"172.21.15.78:6819","nonce":2532904479}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6822","nonce":2532904479},{"type":"v1","addr":"172.21.15.78:6823","nonce":2532904479}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6820","nonce":2532904479},{"type":"v1","addr":"172.21.15.78:6821","nonce":2532904479}]},"public_addr":"172.21.15.78:6817/2532904479","cluster_addr":"172.21.15.78:6819/2532904479","heartbeat_back_addr":"172.21.15.78:6823/2532904479","heartbeat_front_addr":"172.21.15.78:6821/2532904479","state":["exists","up"]},{"osd":3,"uuid":"77acc9af-7d4d-4b18-8cf5-d62f5971b7c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6824","nonce":3442991267},{"type":"v1","addr":"172.21.15.78:6825","nonce":3442991267}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6826","nonce":3442991267},{"type":"v1","addr":"172.21.15.78:6827","nonce":3442991267}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6830","nonce":3442991267},{"type":"v1","addr":"172.21.15.78:6831","nonce":3442991267}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6828","nonce":3442991267},{"type":"v1","addr":"172.21.15.78:6829","nonce":3442991267}]},"public_addr":"172.21.15.78:6825/3442991267","cluster_addr":"172.21.15.78:6827/3442991267","heartbeat_back_addr":"172.21.15.78:6831/3442991267","heartbeat_front_addr":"172.21.15.78:6829/3442991267","state":["exists","up"]},{"osd":4,"uuid":"5c62bc66-6b34-4b7f-a66b-9a743969138c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":802983577},{"type":"v1","addr":"172.21.15.179:6809","nonce":802983577}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":802983577},{"type":"v1","addr":"172.21.15.179:6811","nonce":802983577}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":802983577},{"type":"v1","addr":"172.21.15.179:6815","nonce":802983577}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":802983577},{"type":"v1","addr":"172.21.15.179:6813","nonce":802983577}]},"public_addr":"172.21.15.179:6809/802983577","cluster_addr":"172.21.15.179:6811/802983577","heartbeat_back_addr":"172.21.15.179:6815/802983577","heartbeat_front_addr":"172.21.15.179:6813/802983577","state":["exists","up"]},{"osd":5,"uuid":"67db6d36-f684-4079-b0cd-82b4dd61461f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":518192887},{"type":"v1","addr":"172.21.15.179:6818","nonce":518192887}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":518192887},{"type":"v1","addr":"172.21.15.179:6822","nonce":518192887}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":518192887},{"type":"v1","addr":"172.21.15.179:6829","nonce":518192887}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6824","nonce":518192887},{"type":"v1","addr":"172.21.15.179:6826","nonce":518192887}]},"public_addr":"172.21.15.179:6818/518192887","cluster_addr":"172.21.15.179:6822/518192887","heartbeat_back_addr":"172.21.15.179:6829/518192887","heartbeat_front_addr":"172.21.15.179:6826/518192887","state":["exists","up"]},{"osd":6,"uuid":"12e670af-5a16-4c81-9f97-defa66cab967","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":815435378},{"type":"v1","addr":"172.21.15.179:6801","nonce":815435378}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":815435378},{"type":"v1","addr":"172.21.15.179:6803","nonce":815435378}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":815435378},{"type":"v1","addr":"172.21.15.179:6807","nonce":815435378}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":815435378},{"type":"v1","addr":"172.21.15.179:6805","nonce":815435378}]},"public_addr":"172.21.15.179:6801/815435378","cluster_addr":"172.21.15.179:6803/815435378","heartbeat_back_addr":"172.21.15.179:6807/815435378","heartbeat_front_addr":"172.21.15.179:6805/815435378","state":["exists","up"]},{"osd":7,"uuid":"fe630650-2eb3-49ad-8676-c341e6332eb1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6817","nonce":2848432339},{"type":"v1","addr":"172.21.15.179:6819","nonce":2848432339}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6821","nonce":2848432339},{"type":"v1","addr":"172.21.15.179:6823","nonce":2848432339}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":2848432339},{"type":"v1","addr":"172.21.15.179:6831","nonce":2848432339}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6825","nonce":2848432339},{"type":"v1","addr":"172.21.15.179:6827","nonce":2848432339}]},"public_addr":"172.21.15.179:6819/2848432339","cluster_addr":"172.21.15.179:6823/2848432339","heartbeat_back_addr":"172.21.15.179:6831/2848432339","heartbeat_front_addr":"172.21.15.179:6827/2848432339","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:58:49.255433+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:58:49.412880+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:58:49.559295+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:58:49.245237+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:58:49.184557+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:58:49.329851+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:58:49.366012+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:58:49.349604+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.2","mappings":[{"from":5,"to":1}]},{"pgid":"3.8","mappings":[{"from":3,"to":2}]},{"pgid":"3.26","mappings":[{"from":7,"to":2}]},{"pgid":"3.30","mappings":[{"from":5,"to":2}]},{"pgid":"4.10","mappings":[{"from":1,"to":2}]},{"pgid":"4.14","mappings":[{"from":1,"to":5}]},{"pgid":"4.1d","mappings":[{"from":1,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-28T19:59:54.833 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:51.239+0000 7fef8d1d1640 1 -- 172.21.15.78:0/2877927601 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fef680664a0 msgr2=0x7fef68068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:54.833 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:51.239+0000 7fef8d1d1640 1 --2- 172.21.15.78:0/2877927601 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fef680664a0 0x7fef68068960 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fef700af000 tx=0x7fef700a7000 comp rx=0 tx=0).stop 2023-11-28T19:59:54.834 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:51.239+0000 7fef8d1d1640 1 -- 172.21.15.78:0/2877927601 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fef8806bf30 msgr2=0x7fef88150e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:54.834 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:51.239+0000 7fef8d1d1640 1 --2- 172.21.15.78:0/2877927601 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fef8806bf30 0x7fef88150e70 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fef7800c500 tx=0x7fef7800c9c0 comp rx=0 tx=0).stop 2023-11-28T19:59:54.834 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:51.239+0000 7fef8d1d1640 1 -- 172.21.15.78:0/2877927601 shutdown_connections 2023-11-28T19:59:54.834 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:51.239+0000 7fef8d1d1640 1 --2- 172.21.15.78:0/2877927601 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fef680664a0 0x7fef68068960 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:54.834 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:51.239+0000 7fef8d1d1640 1 --2- 172.21.15.78:0/2877927601 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fef88154f20 0x7fef881ed380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:54.835 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:51.239+0000 7fef8d1d1640 1 --2- 172.21.15.78:0/2877927601 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fef880af4c0 0x7fef881ece40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:54.835 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:51.239+0000 7fef8d1d1640 1 --2- 172.21.15.78:0/2877927601 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fef8806bf30 0x7fef88150e70 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:54.835 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:51.239+0000 7fef8d1d1640 1 -- 172.21.15.78:0/2877927601 >> 172.21.15.78:0/2877927601 conn(0x7fef880ab9d0 msgr2=0x7fef880c6460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T19:59:54.835 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:51.239+0000 7fef8d1d1640 1 -- 172.21.15.78:0/2877927601 shutdown_connections 2023-11-28T19:59:54.835 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:51.239+0000 7fef8d1d1640 1 -- 172.21.15.78:0/2877927601 wait complete. 2023-11-28T19:59:54.836 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-28T19:58:54.011229+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-28T19:59:03.945559+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-11-28T19:59:04.481478+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-11-28T19:59:08.109152+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-11-28T19:59:54.837 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-28T19:59:54.988 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:54.986+0000 7f74d869c640 1 Processor -- start 2023-11-28T19:59:54.988 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:54.986+0000 7f74d869c640 1 -- start start 2023-11-28T19:59:54.995 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:54.986+0000 7f74d869c640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f74d00bed60 0x7f74d00bf140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:54.995 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:54.986+0000 7f74d869c640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f74d00a4f30 0x7f74d01585d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:54.995 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:54.986+0000 7f74d869c640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f74d0157b80 con 0x7f74d00c4b20 2023-11-28T19:59:54.995 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:54.986+0000 7f74d869c640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f74d0158b10 con 0x7f74d00bed60 2023-11-28T19:59:54.996 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:54.986+0000 7f74d869c640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f74d006d6c0 con 0x7f74d00a4f30 2023-11-28T19:59:54.996 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:54.986+0000 7f74d6c39640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f74d00c4b20 0x7f74d0154590 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:39382/0 (socket says 172.21.15.78:39382) 2023-11-28T19:59:54.996 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:54.986+0000 7f74d6c39640 1 -- 172.21.15.78:0/2306927147 learned_addr learned my addr 172.21.15.78:0/2306927147 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-11-28T19:59:54.996 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:54.986+0000 7f74d5c37640 1 --2- 172.21.15.78:0/2306927147 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f74d00a4f30 0x7f74d01585d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:54.996 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:54.986+0000 7f74d5436640 1 -- 172.21.15.78:0/2306927147 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3507175963 0 0) 0x7f74d0157b80 con 0x7f74d00c4b20 2023-11-28T19:59:54.996 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:54.986+0000 7f74d6438640 1 --2- 172.21.15.78:0/2306927147 >> v2:172.21.15.179:3300/0 conn(0x7f74d00bed60 0x7f74d00bf140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:54.996 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:54.986+0000 7f74d5436640 1 -- 172.21.15.78:0/2306927147 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f74bc003530 con 0x7f74d00c4b20 2023-11-28T19:59:54.996 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:54.986+0000 7f74d5436640 1 -- 172.21.15.78:0/2306927147 <== mon.0 v1:172.21.15.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2843570022 0 0) 0x7f74bc003530 con 0x7f74d00c4b20 2023-11-28T19:59:54.996 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:54.986+0000 7f74d5436640 1 -- 172.21.15.78:0/2306927147 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f74d00a4f30 msgr2=0x7f74d01585d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T19:59:54.996 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:54.986+0000 7f74d5436640 1 --2- 172.21.15.78:0/2306927147 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f74d00a4f30 0x7f74d01585d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:54.996 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:54.986+0000 7f74d5436640 1 -- 172.21.15.78:0/2306927147 >> v2:172.21.15.179:3300/0 conn(0x7f74d00bed60 msgr2=0x7f74d00bf140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T19:59:54.996 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:54.986+0000 7f74d5436640 1 --2- 172.21.15.78:0/2306927147 >> v2:172.21.15.179:3300/0 conn(0x7f74d00bed60 0x7f74d00bf140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:54.996 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:54.986+0000 7f74d5436640 1 -- 172.21.15.78:0/2306927147 --> v1:172.21.15.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74d006d960 con 0x7f74d00c4b20 2023-11-28T19:59:54.997 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:54.986+0000 7f74d5436640 1 -- 172.21.15.78:0/2306927147 <== mon.0 v1:172.21.15.78:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3326804700 0 0) 0x7f74c8001a00 con 0x7f74d00c4b20 2023-11-28T19:59:54.997 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:54.986+0000 7f74d5436640 1 -- 172.21.15.78:0/2306927147 >> v1:172.21.15.78:6789/0 conn(0x7f74d00c4b20 legacy=0x7f74d0154590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:54.997 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:54.986+0000 7f74d5436640 1 --2- 172.21.15.78:0/2306927147 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f74d00a4f30 0x7f74bc003980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:54.997 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:54.986+0000 7f74d5436640 1 --2- 172.21.15.78:0/2306927147 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f74bc003f00 0x7f74bc0047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:54.997 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:54.986+0000 7f74d5436640 1 --2- 172.21.15.78:0/2306927147 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f74bc004d10 0x7f74bc005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:54.997 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:54.986+0000 7f74d5436640 1 -- 172.21.15.78:0/2306927147 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74d0158b10 con 0x7f74bc004d10 2023-11-28T19:59:54.997 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:54.986+0000 7f74d5436640 1 -- 172.21.15.78:0/2306927147 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74d006d6c0 con 0x7f74bc003f00 2023-11-28T19:59:54.997 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:54.986+0000 7f74d5436640 1 -- 172.21.15.78:0/2306927147 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f74bc00b9e0 con 0x7f74d00a4f30 2023-11-28T19:59:54.997 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:54.986+0000 7f74d6c39640 1 --2- 172.21.15.78:0/2306927147 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f74bc004d10 0x7f74bc005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:54.997 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:54.986+0000 7f74d6438640 1 --2- 172.21.15.78:0/2306927147 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f74d00a4f30 0x7f74bc003980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:54.997 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:54.986+0000 7f74d5c37640 1 --2- 172.21.15.78:0/2306927147 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f74bc003f00 0x7f74bc0047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:54.997 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:54.986+0000 7f74d6c39640 1 -- 172.21.15.78:0/2306927147 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f74d00a4f30 msgr2=0x7f74bc003980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T19:59:54.997 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:54.986+0000 7f74d6c39640 1 --2- 172.21.15.78:0/2306927147 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f74d00a4f30 0x7f74bc003980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:54.998 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:54.986+0000 7f74d6c39640 1 -- 172.21.15.78:0/2306927147 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f74bc003f00 msgr2=0x7f74bc0047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T19:59:54.998 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:54.986+0000 7f74d6c39640 1 --2- 172.21.15.78:0/2306927147 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f74bc003f00 0x7f74bc0047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:54.998 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:54.986+0000 7f74d6c39640 1 -- 172.21.15.78:0/2306927147 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74bc003530 con 0x7f74bc004d10 2023-11-28T19:59:54.998 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:54.990+0000 7f74d6c39640 1 --2- 172.21.15.78:0/2306927147 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f74bc004d10 0x7f74bc005190 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f74c800a890 tx=0x7f74c801fac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cec3e1ea813db1dd server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:59:54.998 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:54.990+0000 7f74d5436640 1 -- 172.21.15.78:0/2306927147 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74c80aa6f0 con 0x7f74bc004d10 2023-11-28T19:59:54.998 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:54.990+0000 7f74d5436640 1 -- 172.21.15.78:0/2306927147 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f74c80aa850 con 0x7f74bc004d10 2023-11-28T19:59:54.998 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:54.990+0000 7f74d5436640 1 -- 172.21.15.78:0/2306927147 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74c80aac60 con 0x7f74bc004d10 2023-11-28T19:59:54.998 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:54.990+0000 7f74d869c640 1 -- 172.21.15.78:0/2306927147 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f74bc004d10 msgr2=0x7f74bc005190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:54.998 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:54.990+0000 7f74d869c640 1 --2- 172.21.15.78:0/2306927147 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f74bc004d10 0x7f74bc005190 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f74c800a890 tx=0x7f74c801fac0 comp rx=0 tx=0).stop 2023-11-28T19:59:54.998 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:54.990+0000 7f74d6c39640 1 -- 172.21.15.78:0/2306927147 reap_dead start 2023-11-28T19:59:54.998 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:54.990+0000 7f74d869c640 1 -- 172.21.15.78:0/2306927147 shutdown_connections 2023-11-28T19:59:54.999 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:54.990+0000 7f74d869c640 1 -- 172.21.15.78:0/2306927147 >> 172.21.15.78:0/2306927147 conn(0x7f74d00c59f0 msgr2=0x7f74d00c5e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T19:59:54.999 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:54.990+0000 7f74d869c640 1 -- 172.21.15.78:0/2306927147 shutdown_connections 2023-11-28T19:59:54.999 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:54.990+0000 7f74d869c640 1 -- 172.21.15.78:0/2306927147 wait complete. 2023-11-28T19:59:55.003 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:54.994+0000 7f74d869c640 1 Processor -- start 2023-11-28T19:59:55.003 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:54.994+0000 7f74d869c640 1 -- start start 2023-11-28T19:59:55.003 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:54.994+0000 7f74d869c640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f74bc004d10 0x7f74d00ab2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:55.003 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:54.994+0000 7f74d869c640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f74d00aa9f0 0x7f74d01ed4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:55.003 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:54.994+0000 7f74d869c640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f74d00a87d0 0x7f74d0152e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:55.003 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:54.994+0000 7f74d869c640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74d00c1580 con 0x7f74d00a87d0 2023-11-28T19:59:55.004 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:54.994+0000 7f74d869c640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74d00ab830 con 0x7f74d00aa9f0 2023-11-28T19:59:55.004 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:54.994+0000 7f74d869c640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f74d01edfd0 con 0x7f74bc004d10 2023-11-28T19:59:55.004 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:54.994+0000 7f74d6c39640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f74d00a87d0 0x7f74d0152e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:55.004 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:54.994+0000 7f74d6c39640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f74d00a87d0 0x7f74d0152e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:45412/0 (socket says 172.21.15.78:45412) 2023-11-28T19:59:55.004 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:54.994+0000 7f74d6c39640 1 -- 172.21.15.78:0/2046106813 learned_addr learned my addr 172.21.15.78:0/2046106813 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T19:59:55.004 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:54.994+0000 7f74d5c37640 1 --2- 172.21.15.78:0/2046106813 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f74d00aa9f0 0x7f74d01ed4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:55.004 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:54.994+0000 7f74d6c39640 1 -- 172.21.15.78:0/2046106813 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f74bc004d10 msgr2=0x7f74d00ab2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:55.004 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:54.994+0000 7f74d6438640 1 --2- 172.21.15.78:0/2046106813 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f74bc004d10 0x7f74d00ab2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:55.004 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:54.994+0000 7f74d6c39640 1 --2- 172.21.15.78:0/2046106813 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f74bc004d10 0x7f74d00ab2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:55.004 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:54.994+0000 7f74d6c39640 1 -- 172.21.15.78:0/2046106813 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f74d00aa9f0 msgr2=0x7f74d01ed4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:55.004 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:54.994+0000 7f74d6c39640 1 --2- 172.21.15.78:0/2046106813 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f74d00aa9f0 0x7f74d01ed4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:55.005 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:54.994+0000 7f74d6c39640 1 -- 172.21.15.78:0/2046106813 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74d00c12e0 con 0x7f74d00a87d0 2023-11-28T19:59:55.005 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:54.994+0000 7f74d5c37640 1 --2- 172.21.15.78:0/2046106813 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f74d00aa9f0 0x7f74d01ed4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T19:59:55.005 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:54.994+0000 7f74d6438640 1 --2- 172.21.15.78:0/2046106813 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f74bc004d10 0x7f74d00ab2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T19:59:55.005 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:54.994+0000 7f74d6c39640 1 --2- 172.21.15.78:0/2046106813 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f74d00a87d0 0x7f74d0152e50 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f74c800a830 tx=0x7f74bc005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:59:55.005 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:54.994+0000 7f74c6ffd640 1 -- 172.21.15.78:0/2046106813 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74c8001fe0 con 0x7f74d00a87d0 2023-11-28T19:59:55.005 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:54.994+0000 7f74c6ffd640 1 -- 172.21.15.78:0/2046106813 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f74c80aa4f0 con 0x7f74d00a87d0 2023-11-28T19:59:55.005 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:54.994+0000 7f74d869c640 1 -- 172.21.15.78:0/2046106813 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f74d01551c0 con 0x7f74d00a87d0 2023-11-28T19:59:55.005 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:54.994+0000 7f74c6ffd640 1 -- 172.21.15.78:0/2046106813 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74c80019c0 con 0x7f74d00a87d0 2023-11-28T19:59:55.005 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:54.994+0000 7f74d869c640 1 -- 172.21.15.78:0/2046106813 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f74d01edbe0 con 0x7f74d00a87d0 2023-11-28T19:59:55.005 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:54.998+0000 7f74d869c640 1 -- 172.21.15.78:0/2046106813 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f74d0155020 con 0x7f74d00a87d0 2023-11-28T19:59:55.005 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:54.998+0000 7f74c6ffd640 1 -- 172.21.15.78:0/2046106813 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f74c80b2400 con 0x7f74d00a87d0 2023-11-28T19:59:55.005 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:54.998+0000 7f74c6ffd640 1 --2- 172.21.15.78:0/2046106813 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f74b4066470 0x7f74b4068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:55.006 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:54.998+0000 7f74c6ffd640 1 -- 172.21.15.78:0/2046106813 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f74c81218f0 con 0x7f74d00a87d0 2023-11-28T19:59:55.006 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:54.998+0000 7f74d6438640 1 --2- 172.21.15.78:0/2046106813 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f74b4066470 0x7f74b4068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:55.006 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:54.998+0000 7f74d6438640 1 --2- 172.21.15.78:0/2046106813 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f74b4066470 0x7f74b4068930 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f74cc009ab0 tx=0x7f74cc008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:59:55.006 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:55.002+0000 7f74c6ffd640 1 -- 172.21.15.78:0/2046106813 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f74d0155020 con 0x7f74d00a87d0 2023-11-28T19:59:55.159 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:55.154+0000 7f74d869c640 1 -- 172.21.15.78:0/2046106813 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f74d0152b70 con 0x7f74d00a87d0 2023-11-28T19:59:55.159 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:55.154+0000 7f74c6ffd640 1 -- 172.21.15.78:0/2046106813 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v27) v1 ==== 93+0+10 (secure 0 0 0) 0x7f74d0152b70 con 0x7f74d00a87d0 2023-11-28T19:59:55.159 INFO:teuthology.orchestra.run.smithi078.stdout:pg_num: 1 2023-11-28T19:59:55.161 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:55.158+0000 7f74d869c640 1 -- 172.21.15.78:0/2046106813 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f74b4066470 msgr2=0x7f74b4068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:55.161 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:55.158+0000 7f74d869c640 1 --2- 172.21.15.78:0/2046106813 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f74b4066470 0x7f74b4068930 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f74cc009ab0 tx=0x7f74cc008040 comp rx=0 tx=0).stop 2023-11-28T19:59:55.161 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:55.158+0000 7f74d869c640 1 -- 172.21.15.78:0/2046106813 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f74d00a87d0 msgr2=0x7f74d0152e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:55.161 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:55.158+0000 7f74d869c640 1 --2- 172.21.15.78:0/2046106813 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f74d00a87d0 0x7f74d0152e50 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f74c800a830 tx=0x7f74bc005800 comp rx=0 tx=0).stop 2023-11-28T19:59:55.162 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:55.158+0000 7f74d869c640 1 -- 172.21.15.78:0/2046106813 shutdown_connections 2023-11-28T19:59:55.162 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:55.158+0000 7f74d869c640 1 --2- 172.21.15.78:0/2046106813 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f74b4066470 0x7f74b4068930 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:55.162 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:55.158+0000 7f74d869c640 1 --2- 172.21.15.78:0/2046106813 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f74d00a87d0 0x7f74d0152e50 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:55.162 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:55.158+0000 7f74d869c640 1 --2- 172.21.15.78:0/2046106813 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f74d00aa9f0 0x7f74d01ed4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:55.162 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:55.158+0000 7f74d869c640 1 --2- 172.21.15.78:0/2046106813 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f74bc004d10 0x7f74d00ab2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:55.162 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:55.158+0000 7f74d869c640 1 -- 172.21.15.78:0/2046106813 >> 172.21.15.78:0/2046106813 conn(0x7f74d00c59f0 msgr2=0x7f74d01514f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T19:59:55.162 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:55.158+0000 7f74d869c640 1 -- 172.21.15.78:0/2046106813 shutdown_connections 2023-11-28T19:59:55.162 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:55.158+0000 7f74d869c640 1 -- 172.21.15.78:0/2046106813 wait complete. 2023-11-28T19:59:55.180 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-28T19:59:55.321 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:55.318+0000 7feffaf2a640 1 Processor -- start 2023-11-28T19:59:55.322 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:55.318+0000 7feffaf2a640 1 -- start start 2023-11-28T19:59:55.322 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:55.318+0000 7feffaf2a640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7feff414b1e0 0x7feff40c1700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:55.323 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:55.318+0000 7feffaf2a640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7feff41548c0 0x7feff4154d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:55.323 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:55.318+0000 7feffaf2a640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feff40a4e20 con 0x7feff40c5300 2023-11-28T19:59:55.323 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:55.318+0000 7feffaf2a640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feff40a50e0 con 0x7feff414b1e0 2023-11-28T19:59:55.323 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:55.318+0000 7feffaf2a640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feff40c0f00 con 0x7feff41548c0 2023-11-28T19:59:55.324 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:55.318+0000 7feff8cc6640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7feff414b1e0 0x7feff40c1700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:55.324 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:55.318+0000 7feff94c7640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7feff41548c0 0x7feff4154d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:55.324 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:55.318+0000 7fefebfff640 1 --1- >> v1:172.21.15.179:6789/0 conn(0x7feff40c5300 0x7feff40a9c30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.179:6789/0 says I am v1:172.21.15.78:37360/0 (socket says 172.21.15.78:37360) 2023-11-28T19:59:55.324 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:55.318+0000 7feff94c7640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7feff41548c0 0x7feff4154d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3301/0 says I am v2:172.21.15.78:36530/0 (socket says 172.21.15.78:36530) 2023-11-28T19:59:55.324 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:55.318+0000 7fefebfff640 1 -- 172.21.15.78:0/1588076746 learned_addr learned my addr 172.21.15.78:0/1588076746 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-11-28T19:59:55.324 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:55.322+0000 7feff94c7640 1 -- 172.21.15.78:0/1588076746 >> v2:172.21.15.179:3300/0 conn(0x7feff414b1e0 msgr2=0x7feff40c1700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T19:59:55.324 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:55.322+0000 7feff94c7640 1 --2- 172.21.15.78:0/1588076746 >> v2:172.21.15.179:3300/0 conn(0x7feff414b1e0 0x7feff40c1700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:55.324 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:55.322+0000 7feff94c7640 1 -- 172.21.15.78:0/1588076746 >> v1:172.21.15.179:6789/0 conn(0x7feff40c5300 legacy=0x7feff40a9c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:55.324 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:55.322+0000 7feff94c7640 1 -- 172.21.15.78:0/1588076746 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feff40c11e0 con 0x7feff41548c0 2023-11-28T19:59:55.324 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:55.322+0000 7feff8cc6640 1 --2- 172.21.15.78:0/1588076746 >> v2:172.21.15.179:3300/0 conn(0x7feff414b1e0 0x7feff40c1700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T19:59:55.326 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:55.322+0000 7feff94c7640 1 --2- 172.21.15.78:0/1588076746 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7feff41548c0 0x7feff4154d30 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fefec009d90 tx=0x7fefec01c950 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a0669baa5f53aedc server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:59:55.327 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:55.322+0000 7fefeb7fe640 1 -- 172.21.15.78:0/1588076746 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefec0a5920 con 0x7feff41548c0 2023-11-28T19:59:55.327 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:55.322+0000 7fefeb7fe640 1 -- 172.21.15.78:0/1588076746 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fefec0a5a80 con 0x7feff41548c0 2023-11-28T19:59:55.327 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:55.322+0000 7fefeb7fe640 1 -- 172.21.15.78:0/1588076746 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefec0a5e10 con 0x7feff41548c0 2023-11-28T19:59:55.328 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:55.326+0000 7feffaf2a640 1 -- 172.21.15.78:0/1588076746 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7feff41548c0 msgr2=0x7feff4154d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:55.328 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:55.326+0000 7feffaf2a640 1 --2- 172.21.15.78:0/1588076746 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7feff41548c0 0x7feff4154d30 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fefec009d90 tx=0x7fefec01c950 comp rx=0 tx=0).stop 2023-11-28T19:59:55.328 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:55.326+0000 7feffaf2a640 1 -- 172.21.15.78:0/1588076746 shutdown_connections 2023-11-28T19:59:55.328 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:55.326+0000 7feffaf2a640 1 --2- 172.21.15.78:0/1588076746 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7feff41548c0 0x7feff4154d30 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:55.328 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:55.326+0000 7feffaf2a640 1 --2- 172.21.15.78:0/1588076746 >> v2:172.21.15.179:3300/0 conn(0x7feff414b1e0 0x7feff40c1700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:55.328 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:55.326+0000 7feffaf2a640 1 -- 172.21.15.78:0/1588076746 >> 172.21.15.78:0/1588076746 conn(0x7feff40c59f0 msgr2=0x7feff40c5e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T19:59:55.328 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:55.326+0000 7feffaf2a640 1 -- 172.21.15.78:0/1588076746 shutdown_connections 2023-11-28T19:59:55.329 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:55.326+0000 7feffaf2a640 1 -- 172.21.15.78:0/1588076746 wait complete. 2023-11-28T19:59:55.329 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:55.326+0000 7feffaf2a640 1 Processor -- start 2023-11-28T19:59:55.329 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:55.326+0000 7feffaf2a640 1 -- start start 2023-11-28T19:59:55.331 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:55.326+0000 7feffaf2a640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7feff40c5300 0x7feff4140b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:55.331 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:55.326+0000 7feffaf2a640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7feff414b1e0 0x7feff40a65d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:55.331 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:55.326+0000 7feffaf2a640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7feff41548c0 0x7feff4071ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:55.332 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:55.326+0000 7feffaf2a640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feff41ed370 con 0x7feff41548c0 2023-11-28T19:59:55.332 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:55.326+0000 7feffaf2a640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feff40727e0 con 0x7feff40c5300 2023-11-28T19:59:55.332 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:55.326+0000 7feffaf2a640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feff41ea6c0 con 0x7feff414b1e0 2023-11-28T19:59:55.332 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:55.326+0000 7feff94c7640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7feff41548c0 0x7feff4071ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:55.332 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:55.326+0000 7feff94c7640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7feff41548c0 0x7feff4071ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:48948/0 (socket says 172.21.15.78:48948) 2023-11-28T19:59:55.332 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:55.326+0000 7feff94c7640 1 -- 172.21.15.78:0/1713988334 learned_addr learned my addr 172.21.15.78:0/1713988334 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T19:59:55.332 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:55.326+0000 7feff8cc6640 1 --2- 172.21.15.78:0/1713988334 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7feff40c5300 0x7feff4140b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:55.332 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:55.330+0000 7fefebfff640 1 --2- 172.21.15.78:0/1713988334 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7feff414b1e0 0x7feff40a65d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:55.332 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:55.330+0000 7feff94c7640 1 -- 172.21.15.78:0/1713988334 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7feff414b1e0 msgr2=0x7feff40a65d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:55.332 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:55.330+0000 7feff94c7640 1 --2- 172.21.15.78:0/1713988334 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7feff414b1e0 0x7feff40a65d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:55.332 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:55.330+0000 7feff94c7640 1 -- 172.21.15.78:0/1713988334 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7feff40c5300 msgr2=0x7feff4140b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:55.332 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:55.330+0000 7feff94c7640 1 --2- 172.21.15.78:0/1713988334 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7feff40c5300 0x7feff4140b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:55.333 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:55.330+0000 7feff94c7640 1 -- 172.21.15.78:0/1713988334 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feff0009420 con 0x7feff41548c0 2023-11-28T19:59:55.333 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:55.330+0000 7fefebfff640 1 --2- 172.21.15.78:0/1713988334 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7feff414b1e0 0x7feff40a65d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T19:59:55.334 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:55.330+0000 7feff94c7640 1 --2- 172.21.15.78:0/1713988334 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7feff41548c0 0x7feff4071ae0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fefec009d90 tx=0x7fefec0196f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:59:55.334 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:55.330+0000 7fefe97fa640 1 -- 172.21.15.78:0/1713988334 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefec007000 con 0x7feff41548c0 2023-11-28T19:59:55.334 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:55.330+0000 7fefe97fa640 1 -- 172.21.15.78:0/1713988334 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fefec0aede0 con 0x7feff41548c0 2023-11-28T19:59:55.334 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:55.330+0000 7fefe97fa640 1 -- 172.21.15.78:0/1713988334 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefec0b7650 con 0x7feff41548c0 2023-11-28T19:59:55.334 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:55.330+0000 7feffaf2a640 1 -- 172.21.15.78:0/1713988334 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fefec009a70 con 0x7feff41548c0 2023-11-28T19:59:55.334 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:55.330+0000 7feffaf2a640 1 -- 172.21.15.78:0/1713988334 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feff406d440 con 0x7feff41548c0 2023-11-28T19:59:55.334 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:55.330+0000 7feffaf2a640 1 -- 172.21.15.78:0/1713988334 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feff4067630 con 0x7feff41548c0 2023-11-28T19:59:55.335 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:55.330+0000 7fefe97fa640 1 -- 172.21.15.78:0/1713988334 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fefec0b4050 con 0x7feff41548c0 2023-11-28T19:59:55.335 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:55.330+0000 7fefe97fa640 1 --2- 172.21.15.78:0/1713988334 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fefe0066470 0x7fefe0068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:55.335 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:55.330+0000 7fefe97fa640 1 -- 172.21.15.78:0/1713988334 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fefec11f430 con 0x7feff41548c0 2023-11-28T19:59:55.335 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:55.334+0000 7feff8cc6640 1 --2- 172.21.15.78:0/1713988334 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fefe0066470 0x7fefe0068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:55.335 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:55.334+0000 7feff8cc6640 1 --2- 172.21.15.78:0/1713988334 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fefe0066470 0x7fefe0068930 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7feff4149af0 tx=0x7feff0009190 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:59:55.339 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:55.334+0000 7fefe97fa640 1 -- 172.21.15.78:0/1713988334 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fefec0ec730 con 0x7feff41548c0 2023-11-28T19:59:55.487 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:55.486+0000 7feffaf2a640 1 -- 172.21.15.78:0/1713988334 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7feff4141e10 con 0x7feff41548c0 2023-11-28T19:59:55.488 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:55.486+0000 7fefe97fa640 1 -- 172.21.15.78:0/1713988334 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v27) v1 ==== 104+0+11 (secure 0 0 0) 0x7fefec009450 con 0x7feff41548c0 2023-11-28T19:59:55.488 INFO:teuthology.orchestra.run.smithi078.stdout:pg_num: 32 2023-11-28T19:59:55.490 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:55.486+0000 7feffaf2a640 1 -- 172.21.15.78:0/1713988334 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fefe0066470 msgr2=0x7fefe0068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:55.490 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:55.486+0000 7feffaf2a640 1 --2- 172.21.15.78:0/1713988334 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fefe0066470 0x7fefe0068930 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7feff4149af0 tx=0x7feff0009190 comp rx=0 tx=0).stop 2023-11-28T19:59:55.490 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:55.486+0000 7feffaf2a640 1 -- 172.21.15.78:0/1713988334 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7feff41548c0 msgr2=0x7feff4071ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:55.490 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:55.486+0000 7feffaf2a640 1 --2- 172.21.15.78:0/1713988334 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7feff41548c0 0x7feff4071ae0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fefec009d90 tx=0x7fefec0196f0 comp rx=0 tx=0).stop 2023-11-28T19:59:55.490 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:55.486+0000 7feffaf2a640 1 -- 172.21.15.78:0/1713988334 shutdown_connections 2023-11-28T19:59:55.490 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:55.486+0000 7feffaf2a640 1 --2- 172.21.15.78:0/1713988334 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fefe0066470 0x7fefe0068930 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:55.490 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:55.486+0000 7feffaf2a640 1 --2- 172.21.15.78:0/1713988334 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7feff414b1e0 0x7feff40a65d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:55.491 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:55.486+0000 7feffaf2a640 1 --2- 172.21.15.78:0/1713988334 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7feff41548c0 0x7feff4071ae0 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:55.491 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:55.486+0000 7feffaf2a640 1 --2- 172.21.15.78:0/1713988334 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7feff40c5300 0x7feff4140b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:55.491 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:55.486+0000 7feffaf2a640 1 -- 172.21.15.78:0/1713988334 >> 172.21.15.78:0/1713988334 conn(0x7feff40c59f0 msgr2=0x7feff40c46f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T19:59:55.491 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:55.486+0000 7feffaf2a640 1 -- 172.21.15.78:0/1713988334 shutdown_connections 2023-11-28T19:59:55.491 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:55.486+0000 7feffaf2a640 1 -- 172.21.15.78:0/1713988334 wait complete. 2023-11-28T19:59:55.509 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-28T19:59:55.649 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:55.646+0000 7f96b086b640 1 Processor -- start 2023-11-28T19:59:55.649 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:55.646+0000 7f96b086b640 1 -- start start 2023-11-28T19:59:55.650 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:55.646+0000 7f96b086b640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f96ac14b1e0 0x7f96ac0c1700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:55.651 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:55.646+0000 7f96b086b640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f96ac0a4e20 con 0x7f96ac1548c0 2023-11-28T19:59:55.651 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:55.646+0000 7f96b086b640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f96ac0a50e0 con 0x7f96ac0c5300 2023-11-28T19:59:55.651 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:55.646+0000 7f96b086b640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f96ac0c0f00 con 0x7f96ac14b1e0 2023-11-28T19:59:55.651 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:55.646+0000 7f96aa59c640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f96ac14b1e0 0x7f96ac0c1700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:55.651 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:55.646+0000 7f96aa59c640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f96ac14b1e0 0x7f96ac0c1700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:48960/0 (socket says 172.21.15.78:48960) 2023-11-28T19:59:55.651 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:55.646+0000 7f96aa59c640 1 -- 172.21.15.78:0/3460674559 learned_addr learned my addr 172.21.15.78:0/3460674559 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T19:59:55.651 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:55.646+0000 7f96aad9d640 1 --1- 172.21.15.78:0/3460674559 >> v1:172.21.15.78:6789/0 conn(0x7f96ac1548c0 0x7f96ac154d30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:45790/0 (socket says 172.21.15.78:45790) 2023-11-28T19:59:55.651 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:55.646+0000 7f96aa59c640 1 -- 172.21.15.78:0/3460674559 >> v1:172.21.15.179:6789/0 conn(0x7f96ac0c5300 legacy=0x7f96ac0a9c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:55.651 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:55.646+0000 7f96aa59c640 1 -- 172.21.15.78:0/3460674559 >> v1:172.21.15.78:6789/0 conn(0x7f96ac1548c0 legacy=0x7f96ac154d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:55.651 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:55.646+0000 7f96aa59c640 1 -- 172.21.15.78:0/3460674559 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96ac0c11e0 con 0x7f96ac14b1e0 2023-11-28T19:59:55.652 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:55.646+0000 7f96a9d9b640 1 -- 172.21.15.78:0/3460674559 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2503047870 0 0) 0x7f96ac0a4e20 con 0x7f96ac1548c0 2023-11-28T19:59:55.653 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:55.650+0000 7f96aa59c640 1 --2- 172.21.15.78:0/3460674559 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f96ac14b1e0 0x7f96ac0c1700 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f969c009870 tx=0x7f969c01c540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=43124d3740cec24b server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:59:55.654 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:55.650+0000 7f96a9d9b640 1 -- 172.21.15.78:0/3460674559 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f969c0ab600 con 0x7f96ac14b1e0 2023-11-28T19:59:55.654 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:55.650+0000 7f96a9d9b640 1 -- 172.21.15.78:0/3460674559 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f969c0a7050 con 0x7f96ac14b1e0 2023-11-28T19:59:55.654 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:55.650+0000 7f96a9d9b640 1 -- 172.21.15.78:0/3460674559 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f969c0ab980 con 0x7f96ac14b1e0 2023-11-28T19:59:55.655 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:55.650+0000 7f96b086b640 1 -- 172.21.15.78:0/3460674559 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f96ac14b1e0 msgr2=0x7f96ac0c1700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:55.655 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:55.650+0000 7f96b086b640 1 --2- 172.21.15.78:0/3460674559 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f96ac14b1e0 0x7f96ac0c1700 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f969c009870 tx=0x7f969c01c540 comp rx=0 tx=0).stop 2023-11-28T19:59:55.655 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:55.650+0000 7f96b086b640 1 -- 172.21.15.78:0/3460674559 shutdown_connections 2023-11-28T19:59:55.655 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:55.650+0000 7f96b086b640 1 --2- 172.21.15.78:0/3460674559 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f96ac14b1e0 0x7f96ac0c1700 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:55.655 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:55.650+0000 7f96b086b640 1 -- 172.21.15.78:0/3460674559 >> 172.21.15.78:0/3460674559 conn(0x7f96ac0c59f0 msgr2=0x7f96ac0c5e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T19:59:55.655 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:55.650+0000 7f96b086b640 1 -- 172.21.15.78:0/3460674559 shutdown_connections 2023-11-28T19:59:55.655 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:55.650+0000 7f96b086b640 1 -- 172.21.15.78:0/3460674559 wait complete. 2023-11-28T19:59:55.656 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:55.654+0000 7f96b086b640 1 Processor -- start 2023-11-28T19:59:55.656 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:55.654+0000 7f96b086b640 1 -- start start 2023-11-28T19:59:55.659 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:55.654+0000 7f96b086b640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f96ac0c5300 0x7f96ac144e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:55.659 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:55.654+0000 7f96b086b640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f96ac14b1e0 0x7f96ac06fac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:55.659 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:55.654+0000 7f96b086b640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f96ac1548c0 0x7f96ac070000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:55.659 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:55.654+0000 7f96b086b640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96ac070540 con 0x7f96ac1548c0 2023-11-28T19:59:55.659 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:55.654+0000 7f96b086b640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96ac151b20 con 0x7f96ac14b1e0 2023-11-28T19:59:55.659 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:55.654+0000 7f96b086b640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f96ac150f10 con 0x7f96ac0c5300 2023-11-28T19:59:55.659 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:55.654+0000 7f96aad9d640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f96ac1548c0 0x7f96ac070000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:55.659 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:55.654+0000 7f96aad9d640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f96ac1548c0 0x7f96ac070000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:48972/0 (socket says 172.21.15.78:48972) 2023-11-28T19:59:55.659 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:55.654+0000 7f96aad9d640 1 -- 172.21.15.78:0/2406270357 learned_addr learned my addr 172.21.15.78:0/2406270357 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T19:59:55.660 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:55.654+0000 7f96a1d9b640 1 --2- 172.21.15.78:0/2406270357 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f96ac14b1e0 0x7f96ac06fac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:55.660 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:55.654+0000 7f96aa59c640 1 --2- 172.21.15.78:0/2406270357 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f96ac0c5300 0x7f96ac144e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:55.660 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:55.654+0000 7f96aad9d640 1 -- 172.21.15.78:0/2406270357 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f96ac0c5300 msgr2=0x7f96ac144e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:55.660 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:55.654+0000 7f96aad9d640 1 --2- 172.21.15.78:0/2406270357 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f96ac0c5300 0x7f96ac144e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:55.660 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:55.654+0000 7f96aad9d640 1 -- 172.21.15.78:0/2406270357 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f96ac14b1e0 msgr2=0x7f96ac06fac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:55.660 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:55.654+0000 7f96aad9d640 1 --2- 172.21.15.78:0/2406270357 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f96ac14b1e0 0x7f96ac06fac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:55.660 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:55.654+0000 7f96aad9d640 1 -- 172.21.15.78:0/2406270357 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f969c0094d0 con 0x7f96ac1548c0 2023-11-28T19:59:55.660 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:55.654+0000 7f96a1d9b640 1 --2- 172.21.15.78:0/2406270357 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f96ac14b1e0 0x7f96ac06fac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T19:59:55.660 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:55.654+0000 7f96aa59c640 1 --2- 172.21.15.78:0/2406270357 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f96ac0c5300 0x7f96ac144e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T19:59:55.660 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:55.654+0000 7f96aad9d640 1 --2- 172.21.15.78:0/2406270357 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f96ac1548c0 0x7f96ac070000 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f96a400c3c0 tx=0x7f96a400c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:59:55.661 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:55.654+0000 7f96a37fe640 1 -- 172.21.15.78:0/2406270357 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96a40074e0 con 0x7f96ac1548c0 2023-11-28T19:59:55.661 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:55.654+0000 7f96a37fe640 1 -- 172.21.15.78:0/2406270357 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f96a4007640 con 0x7f96ac1548c0 2023-11-28T19:59:55.661 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:55.654+0000 7f96a37fe640 1 -- 172.21.15.78:0/2406270357 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96a4004a30 con 0x7f96ac1548c0 2023-11-28T19:59:55.661 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:55.654+0000 7f96b086b640 1 -- 172.21.15.78:0/2406270357 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f96ac1511f0 con 0x7f96ac1548c0 2023-11-28T19:59:55.661 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:55.654+0000 7f96b086b640 1 -- 172.21.15.78:0/2406270357 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f96ac1517b0 con 0x7f96ac1548c0 2023-11-28T19:59:55.662 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:55.658+0000 7f96b086b640 1 -- 172.21.15.78:0/2406270357 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f96ac151cb0 con 0x7f96ac1548c0 2023-11-28T19:59:55.662 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:55.658+0000 7f96a37fe640 1 -- 172.21.15.78:0/2406270357 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f96a4004b90 con 0x7f96ac1548c0 2023-11-28T19:59:55.662 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:55.658+0000 7f96a37fe640 1 --2- 172.21.15.78:0/2406270357 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f968c066470 0x7f968c068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:55.662 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:55.658+0000 7f96a37fe640 1 -- 172.21.15.78:0/2406270357 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f96a4083fa0 con 0x7f96ac1548c0 2023-11-28T19:59:55.662 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:55.658+0000 7f96aa59c640 1 --2- 172.21.15.78:0/2406270357 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f968c066470 0x7f968c068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:55.663 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:55.658+0000 7f96aa59c640 1 --2- 172.21.15.78:0/2406270357 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f968c066470 0x7f968c068930 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f96ac0c5850 tx=0x7f969c009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:59:55.665 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:55.662+0000 7f96a37fe640 1 -- 172.21.15.78:0/2406270357 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f96a40b5280 con 0x7f96ac1548c0 2023-11-28T19:59:55.817 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:55.814+0000 7f96b086b640 1 -- 172.21.15.78:0/2406270357 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f96ac067630 con 0x7f96ac1548c0 2023-11-28T19:59:55.817 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:55.814+0000 7f96a37fe640 1 -- 172.21.15.78:0/2406270357 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v27) v1 ==== 100+0+11 (secure 0 0 0) 0x7f96a40510f0 con 0x7f96ac1548c0 2023-11-28T19:59:55.818 INFO:teuthology.orchestra.run.smithi078.stdout:pg_num: 64 2023-11-28T19:59:55.819 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:55.814+0000 7f96b086b640 1 -- 172.21.15.78:0/2406270357 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f968c066470 msgr2=0x7f968c068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:55.820 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:55.814+0000 7f96b086b640 1 --2- 172.21.15.78:0/2406270357 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f968c066470 0x7f968c068930 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f96ac0c5850 tx=0x7f969c009040 comp rx=0 tx=0).stop 2023-11-28T19:59:55.820 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:55.814+0000 7f96b086b640 1 -- 172.21.15.78:0/2406270357 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f96ac1548c0 msgr2=0x7f96ac070000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:55.820 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:55.814+0000 7f96b086b640 1 --2- 172.21.15.78:0/2406270357 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f96ac1548c0 0x7f96ac070000 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f96a400c3c0 tx=0x7f96a400c880 comp rx=0 tx=0).stop 2023-11-28T19:59:55.820 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:55.818+0000 7f96b086b640 1 -- 172.21.15.78:0/2406270357 shutdown_connections 2023-11-28T19:59:55.820 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:55.818+0000 7f96b086b640 1 --2- 172.21.15.78:0/2406270357 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f968c066470 0x7f968c068930 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:55.820 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:55.818+0000 7f96b086b640 1 --2- 172.21.15.78:0/2406270357 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f96ac1548c0 0x7f96ac070000 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:55.820 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:55.818+0000 7f96b086b640 1 --2- 172.21.15.78:0/2406270357 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f96ac14b1e0 0x7f96ac06fac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:55.821 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:55.818+0000 7f96b086b640 1 --2- 172.21.15.78:0/2406270357 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f96ac0c5300 0x7f96ac144e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:55.821 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:55.818+0000 7f96b086b640 1 -- 172.21.15.78:0/2406270357 >> 172.21.15.78:0/2406270357 conn(0x7f96ac0c59f0 msgr2=0x7f96ac154d30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T19:59:55.821 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:55.818+0000 7f96b086b640 1 -- 172.21.15.78:0/2406270357 shutdown_connections 2023-11-28T19:59:55.821 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:55.818+0000 7f96b086b640 1 -- 172.21.15.78:0/2406270357 wait complete. 2023-11-28T19:59:55.839 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-11-28T19:59:55.980 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:55.978+0000 7fa359d2a640 1 Processor -- start 2023-11-28T19:59:55.980 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:55.978+0000 7fa359d2a640 1 -- start start 2023-11-28T19:59:55.982 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:55.978+0000 7fa359d2a640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fa3540c5300 0x7fa3540a9c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:55.982 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:55.978+0000 7fa359d2a640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa3541548c0 0x7fa354154d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:55.982 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:55.978+0000 7fa359d2a640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa3540a4e20 con 0x7fa35414b1e0 2023-11-28T19:59:55.982 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:55.978+0000 7fa359d2a640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa3540a50e0 con 0x7fa3540c5300 2023-11-28T19:59:55.983 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:55.978+0000 7fa359d2a640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa3540c0f00 con 0x7fa3541548c0 2023-11-28T19:59:55.983 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:55.978+0000 7fa353fff640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa3541548c0 0x7fa354154d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:55.983 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:55.978+0000 7fa3537fe640 1 --1- >> v1:172.21.15.179:6789/0 conn(0x7fa35414b1e0 0x7fa3540c1700 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.179:6789/0 says I am v1:172.21.15.78:37388/0 (socket says 172.21.15.78:37388) 2023-11-28T19:59:55.983 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:55.978+0000 7fa352ffd640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fa3540c5300 0x7fa3540a9c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:55.983 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:55.978+0000 7fa3537fe640 1 -- 172.21.15.78:0/3226974151 learned_addr learned my addr 172.21.15.78:0/3226974151 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-11-28T19:59:55.983 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:55.978+0000 7fa3527fc640 1 -- 172.21.15.78:0/3226974151 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3901199945 0 0) 0x7fa3540a4e20 con 0x7fa35414b1e0 2023-11-28T19:59:55.983 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:55.978+0000 7fa3527fc640 1 -- 172.21.15.78:0/3226974151 --> v1:172.21.15.179:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa33c003530 con 0x7fa35414b1e0 2023-11-28T19:59:55.983 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:55.978+0000 7fa353fff640 1 -- 172.21.15.78:0/3226974151 >> v2:172.21.15.179:3300/0 conn(0x7fa3540c5300 msgr2=0x7fa3540a9c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T19:59:55.983 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:55.978+0000 7fa353fff640 1 --2- 172.21.15.78:0/3226974151 >> v2:172.21.15.179:3300/0 conn(0x7fa3540c5300 0x7fa3540a9c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:55.983 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:55.978+0000 7fa353fff640 1 -- 172.21.15.78:0/3226974151 >> v1:172.21.15.179:6789/0 conn(0x7fa35414b1e0 legacy=0x7fa3540c1700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:55.983 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:55.978+0000 7fa353fff640 1 -- 172.21.15.78:0/3226974151 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3540c11e0 con 0x7fa3541548c0 2023-11-28T19:59:55.984 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:55.978+0000 7fa352ffd640 1 --2- 172.21.15.78:0/3226974151 >> v2:172.21.15.179:3300/0 conn(0x7fa3540c5300 0x7fa3540a9c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T19:59:55.984 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:55.982+0000 7fa353fff640 1 --2- 172.21.15.78:0/3226974151 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa3541548c0 0x7fa354154d30 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fa34c009d90 tx=0x7fa34c01c950 comp rx=0 tx=0).ready entity=mon.2 client_cookie=72c91a9196bbe08b server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:59:55.985 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:55.982+0000 7fa3527fc640 1 -- 172.21.15.78:0/3226974151 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa34c0a5920 con 0x7fa3541548c0 2023-11-28T19:59:55.985 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:55.982+0000 7fa3527fc640 1 -- 172.21.15.78:0/3226974151 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa34c0a5a80 con 0x7fa3541548c0 2023-11-28T19:59:55.985 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:55.982+0000 7fa3527fc640 1 -- 172.21.15.78:0/3226974151 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa34c0a5e10 con 0x7fa3541548c0 2023-11-28T19:59:55.986 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:55.982+0000 7fa359d2a640 1 -- 172.21.15.78:0/3226974151 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa3541548c0 msgr2=0x7fa354154d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:55.986 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:55.982+0000 7fa359d2a640 1 --2- 172.21.15.78:0/3226974151 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa3541548c0 0x7fa354154d30 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fa34c009d90 tx=0x7fa34c01c950 comp rx=0 tx=0).stop 2023-11-28T19:59:55.986 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:55.982+0000 7fa359d2a640 1 -- 172.21.15.78:0/3226974151 shutdown_connections 2023-11-28T19:59:55.986 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:55.982+0000 7fa359d2a640 1 --2- 172.21.15.78:0/3226974151 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa3541548c0 0x7fa354154d30 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:55.986 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:55.982+0000 7fa359d2a640 1 --2- 172.21.15.78:0/3226974151 >> v2:172.21.15.179:3300/0 conn(0x7fa3540c5300 0x7fa3540a9c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:55.986 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:55.982+0000 7fa359d2a640 1 -- 172.21.15.78:0/3226974151 >> 172.21.15.78:0/3226974151 conn(0x7fa3540c59f0 msgr2=0x7fa3540c5e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T19:59:55.987 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:55.982+0000 7fa359d2a640 1 -- 172.21.15.78:0/3226974151 shutdown_connections 2023-11-28T19:59:55.987 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:55.982+0000 7fa359d2a640 1 -- 172.21.15.78:0/3226974151 wait complete. 2023-11-28T19:59:55.987 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:55.986+0000 7fa359d2a640 1 Processor -- start 2023-11-28T19:59:55.987 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:55.986+0000 7fa359d2a640 1 -- start start 2023-11-28T19:59:55.990 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:55.986+0000 7fa359d2a640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa3540c5300 0x7fa3541eb7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:55.990 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:55.986+0000 7fa359d2a640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa35414b1e0 0x7fa3540aa660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:55.991 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:55.986+0000 7fa359d2a640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa3541548c0 0x7fa35414c7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:55.991 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:55.986+0000 7fa359d2a640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3541ead50 con 0x7fa3541548c0 2023-11-28T19:59:55.991 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:55.986+0000 7fa359d2a640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3541eed60 con 0x7fa3540c5300 2023-11-28T19:59:55.992 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:55.986+0000 7fa359d2a640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa3541eaff0 con 0x7fa35414b1e0 2023-11-28T19:59:55.992 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:55.986+0000 7fa353fff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa3541548c0 0x7fa35414c7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:55.992 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:55.986+0000 7fa353fff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa3541548c0 0x7fa35414c7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:48978/0 (socket says 172.21.15.78:48978) 2023-11-28T19:59:55.992 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:55.986+0000 7fa353fff640 1 -- 172.21.15.78:0/3800488273 learned_addr learned my addr 172.21.15.78:0/3800488273 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T19:59:55.993 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:55.986+0000 7fa352ffd640 1 --2- 172.21.15.78:0/3800488273 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa35414b1e0 0x7fa3540aa660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:55.993 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:55.986+0000 7fa3537fe640 1 --2- 172.21.15.78:0/3800488273 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa3540c5300 0x7fa3541eb7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:55.993 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:55.986+0000 7fa353fff640 1 -- 172.21.15.78:0/3800488273 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa35414b1e0 msgr2=0x7fa3540aa660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:55.993 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:55.986+0000 7fa353fff640 1 --2- 172.21.15.78:0/3800488273 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa35414b1e0 0x7fa3540aa660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:55.994 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:55.986+0000 7fa353fff640 1 -- 172.21.15.78:0/3800488273 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa3540c5300 msgr2=0x7fa3541eb7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:55.994 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:55.986+0000 7fa353fff640 1 --2- 172.21.15.78:0/3800488273 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa3540c5300 0x7fa3541eb7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:55.994 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:55.986+0000 7fa353fff640 1 -- 172.21.15.78:0/3800488273 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa348009420 con 0x7fa3541548c0 2023-11-28T19:59:55.994 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:55.986+0000 7fa353fff640 1 --2- 172.21.15.78:0/3800488273 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa3541548c0 0x7fa35414c7f0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fa34c009d90 tx=0x7fa34c0196f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:59:55.994 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:55.986+0000 7fa33bfff640 1 -- 172.21.15.78:0/3800488273 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa34c0aecd0 con 0x7fa3541548c0 2023-11-28T19:59:55.994 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:55.986+0000 7fa33bfff640 1 -- 172.21.15.78:0/3800488273 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa34c0aee30 con 0x7fa3541548c0 2023-11-28T19:59:55.994 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:55.986+0000 7fa359d2a640 1 -- 172.21.15.78:0/3800488273 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa34c009a70 con 0x7fa3541548c0 2023-11-28T19:59:55.994 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:55.986+0000 7fa33bfff640 1 -- 172.21.15.78:0/3800488273 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa34c0b7630 con 0x7fa3541548c0 2023-11-28T19:59:55.994 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:55.986+0000 7fa359d2a640 1 -- 172.21.15.78:0/3800488273 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa35414c110 con 0x7fa3541548c0 2023-11-28T19:59:55.995 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:55.986+0000 7fa359d2a640 1 -- 172.21.15.78:0/3800488273 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa3541eb510 con 0x7fa3541548c0 2023-11-28T19:59:55.995 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:55.990+0000 7fa33bfff640 1 -- 172.21.15.78:0/3800488273 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fa34c0b4050 con 0x7fa3541548c0 2023-11-28T19:59:55.996 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:55.990+0000 7fa33bfff640 1 --2- 172.21.15.78:0/3800488273 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fa3400664a0 0x7fa340068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:55.996 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:55.990+0000 7fa33bfff640 1 -- 172.21.15.78:0/3800488273 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fa34c11f340 con 0x7fa3541548c0 2023-11-28T19:59:55.996 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:55.990+0000 7fa3537fe640 1 --2- 172.21.15.78:0/3800488273 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fa3400664a0 0x7fa340068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:55.996 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:55.990+0000 7fa3537fe640 1 --2- 172.21.15.78:0/3800488273 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fa3400664a0 0x7fa340068960 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fa344005890 tx=0x7fa344009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:59:55.997 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:55.994+0000 7fa33bfff640 1 -- 172.21.15.78:0/3800488273 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fa3541eb510 con 0x7fa3541548c0 2023-11-28T19:59:56.149 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:56.146+0000 7fa359d2a640 1 -- 172.21.15.78:0/3800488273 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7fa3541eb510 con 0x7fa3541548c0 2023-11-28T19:59:56.149 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:56.146+0000 7fa33bfff640 1 -- 172.21.15.78:0/3800488273 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v27) v1 ==== 103+0+11 (secure 0 0 0) 0x7fa3541eb510 con 0x7fa3541548c0 2023-11-28T19:59:56.149 INFO:teuthology.orchestra.run.smithi078.stdout:pg_num: 32 2023-11-28T19:59:56.151 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:56.146+0000 7fa359d2a640 1 -- 172.21.15.78:0/3800488273 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fa3400664a0 msgr2=0x7fa340068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:56.152 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:56.146+0000 7fa359d2a640 1 --2- 172.21.15.78:0/3800488273 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fa3400664a0 0x7fa340068960 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fa344005890 tx=0x7fa344009040 comp rx=0 tx=0).stop 2023-11-28T19:59:56.152 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:56.146+0000 7fa359d2a640 1 -- 172.21.15.78:0/3800488273 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa3541548c0 msgr2=0x7fa35414c7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:56.152 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:56.146+0000 7fa359d2a640 1 --2- 172.21.15.78:0/3800488273 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa3541548c0 0x7fa35414c7f0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fa34c009d90 tx=0x7fa34c0196f0 comp rx=0 tx=0).stop 2023-11-28T19:59:56.152 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:56.150+0000 7fa359d2a640 1 -- 172.21.15.78:0/3800488273 shutdown_connections 2023-11-28T19:59:56.152 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:56.150+0000 7fa359d2a640 1 --2- 172.21.15.78:0/3800488273 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fa3400664a0 0x7fa340068960 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:56.152 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:56.150+0000 7fa359d2a640 1 --2- 172.21.15.78:0/3800488273 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa35414b1e0 0x7fa3540aa660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:56.152 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:56.150+0000 7fa359d2a640 1 --2- 172.21.15.78:0/3800488273 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa3541548c0 0x7fa35414c7f0 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:56.152 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:56.150+0000 7fa359d2a640 1 --2- 172.21.15.78:0/3800488273 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa3540c5300 0x7fa3541eb7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:56.152 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:56.150+0000 7fa359d2a640 1 -- 172.21.15.78:0/3800488273 >> 172.21.15.78:0/3800488273 conn(0x7fa3540c59f0 msgr2=0x7fa3540733c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T19:59:56.152 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:56.150+0000 7fa359d2a640 1 -- 172.21.15.78:0/3800488273 shutdown_connections 2023-11-28T19:59:56.152 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:56.150+0000 7fa359d2a640 1 -- 172.21.15.78:0/3800488273 wait complete. 2023-11-28T19:59:56.171 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-11-28T19:59:56.310 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:56.306+0000 7f2840479640 1 Processor -- start 2023-11-28T19:59:56.310 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:56.306+0000 7f2840479640 1 -- start start 2023-11-28T19:59:56.311 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:56.306+0000 7f2840479640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f2838154390 0x7f28380c4a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:56.311 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:56.306+0000 7f2840479640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f28380a93d0 con 0x7f28380c4f80 2023-11-28T19:59:56.311 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:56.306+0000 7f2840479640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f28380a9640 con 0x7f28380c2110 2023-11-28T19:59:56.311 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:56.306+0000 7f2840479640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f28380aa1c0 con 0x7f2838154390 2023-11-28T19:59:56.312 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:56.310+0000 7f283ea16640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f28380c4f80 0x7f283815bc60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:45794/0 (socket says 172.21.15.78:45794) 2023-11-28T19:59:56.312 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:56.310+0000 7f283ea16640 1 -- 172.21.15.78:0/3463378484 learned_addr learned my addr 172.21.15.78:0/3463378484 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-11-28T19:59:56.312 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:56.310+0000 7f283e215640 1 --2- 172.21.15.78:0/3463378484 >> v2:172.21.15.179:3300/0 conn(0x7f2838154390 0x7f28380c4a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:56.312 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:56.310+0000 7f283d213640 1 -- 172.21.15.78:0/3463378484 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2735627360 0 0) 0x7f28380a93d0 con 0x7f28380c4f80 2023-11-28T19:59:56.313 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:56.310+0000 7f283d213640 1 -- 172.21.15.78:0/3463378484 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2824003530 con 0x7f28380c4f80 2023-11-28T19:59:56.313 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:56.310+0000 7f283d213640 1 -- 172.21.15.78:0/3463378484 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1508519106 0 0) 0x7f28380a9640 con 0x7f28380c2110 2023-11-28T19:59:56.313 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:56.310+0000 7f283d213640 1 -- 172.21.15.78:0/3463378484 --> v1:172.21.15.179:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f28380a93d0 con 0x7f28380c2110 2023-11-28T19:59:56.313 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:56.310+0000 7f283d213640 1 -- 172.21.15.78:0/3463378484 <== mon.0 v1:172.21.15.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1964534682 0 0) 0x7f2824003530 con 0x7f28380c4f80 2023-11-28T19:59:56.313 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:56.310+0000 7f283e215640 1 -- 172.21.15.78:0/3463378484 >> v1:172.21.15.179:6789/0 conn(0x7f28380c2110 legacy=0x7f28380c5ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:56.313 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:56.310+0000 7f283e215640 1 -- 172.21.15.78:0/3463378484 >> v1:172.21.15.78:6789/0 conn(0x7f28380c4f80 legacy=0x7f283815bc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:56.313 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:56.310+0000 7f283e215640 1 -- 172.21.15.78:0/3463378484 --> v2:172.21.15.179:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28380a9920 con 0x7f2838154390 2023-11-28T19:59:56.315 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:56.310+0000 7f283e215640 1 --2- 172.21.15.78:0/3463378484 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2838154390 0x7f28380c4a40 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f28340097c0 tx=0x7f283401c3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=83b58393f4cf592 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:59:56.316 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:56.314+0000 7f283d213640 1 -- 172.21.15.78:0/3463378484 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2830001a00 con 0x7f2838154390 2023-11-28T19:59:56.316 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:56.314+0000 7f283d213640 1 -- 172.21.15.78:0/3463378484 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f28340a7050 con 0x7f2838154390 2023-11-28T19:59:56.316 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:56.314+0000 7f283d213640 1 -- 172.21.15.78:0/3463378484 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28340ab620 con 0x7f2838154390 2023-11-28T19:59:56.316 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:56.314+0000 7f2840479640 1 -- 172.21.15.78:0/3463378484 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2838154390 msgr2=0x7f28380c4a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:56.316 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:56.314+0000 7f2840479640 1 --2- 172.21.15.78:0/3463378484 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2838154390 0x7f28380c4a40 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f28340097c0 tx=0x7f283401c3a0 comp rx=0 tx=0).stop 2023-11-28T19:59:56.317 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:56.314+0000 7f2840479640 1 -- 172.21.15.78:0/3463378484 shutdown_connections 2023-11-28T19:59:56.317 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:56.314+0000 7f2840479640 1 --2- 172.21.15.78:0/3463378484 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2838154390 0x7f28380c4a40 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:56.317 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:56.314+0000 7f2840479640 1 -- 172.21.15.78:0/3463378484 >> 172.21.15.78:0/3463378484 conn(0x7f283806b220 msgr2=0x7f28380a77e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T19:59:56.317 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:56.314+0000 7f2840479640 1 -- 172.21.15.78:0/3463378484 shutdown_connections 2023-11-28T19:59:56.317 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:56.314+0000 7f2840479640 1 -- 172.21.15.78:0/3463378484 wait complete. 2023-11-28T19:59:56.318 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:56.314+0000 7f2840479640 1 Processor -- start 2023-11-28T19:59:56.318 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:56.314+0000 7f2840479640 1 -- start start 2023-11-28T19:59:56.319 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:56.314+0000 7f2840479640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f28380c2110 0x7f283815ccf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:56.319 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:56.314+0000 7f2840479640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f28380c4f80 0x7f2838070ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:56.319 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:56.314+0000 7f2840479640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2838154390 0x7f28381430d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:56.319 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:56.314+0000 7f2840479640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f283815d230 con 0x7f2838154390 2023-11-28T19:59:56.319 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:56.314+0000 7f2840479640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2838147200 con 0x7f28380c4f80 2023-11-28T19:59:56.320 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:56.314+0000 7f2840479640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2838144a20 con 0x7f28380c2110 2023-11-28T19:59:56.320 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:56.314+0000 7f283ea16640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2838154390 0x7f28381430d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:56.320 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:56.314+0000 7f283ea16640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2838154390 0x7f28381430d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:48986/0 (socket says 172.21.15.78:48986) 2023-11-28T19:59:56.320 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:56.318+0000 7f283ea16640 1 -- 172.21.15.78:0/2569422473 learned_addr learned my addr 172.21.15.78:0/2569422473 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T19:59:56.320 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:56.318+0000 7f283da14640 1 --2- 172.21.15.78:0/2569422473 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f28380c4f80 0x7f2838070ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:56.320 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:56.318+0000 7f283e215640 1 --2- 172.21.15.78:0/2569422473 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f28380c2110 0x7f283815ccf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:56.321 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:56.318+0000 7f283ea16640 1 -- 172.21.15.78:0/2569422473 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f28380c2110 msgr2=0x7f283815ccf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:56.321 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:56.318+0000 7f283ea16640 1 --2- 172.21.15.78:0/2569422473 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f28380c2110 0x7f283815ccf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:56.321 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:56.318+0000 7f283ea16640 1 -- 172.21.15.78:0/2569422473 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f28380c4f80 msgr2=0x7f2838070ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:56.322 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:56.318+0000 7f283ea16640 1 --2- 172.21.15.78:0/2569422473 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f28380c4f80 0x7f2838070ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:56.322 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:56.318+0000 7f283ea16640 1 -- 172.21.15.78:0/2569422473 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2834009420 con 0x7f2838154390 2023-11-28T19:59:56.322 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:56.318+0000 7f283da14640 1 --2- 172.21.15.78:0/2569422473 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f28380c4f80 0x7f2838070ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T19:59:56.322 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:56.318+0000 7f283ea16640 1 --2- 172.21.15.78:0/2569422473 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2838154390 0x7f28381430d0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f2830001fe0 tx=0x7f283000a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:59:56.322 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:56.318+0000 7f282effd640 1 -- 172.21.15.78:0/2569422473 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2830012400 con 0x7f2838154390 2023-11-28T19:59:56.322 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:56.318+0000 7f282effd640 1 -- 172.21.15.78:0/2569422473 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2830012560 con 0x7f2838154390 2023-11-28T19:59:56.322 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:56.318+0000 7f282effd640 1 -- 172.21.15.78:0/2569422473 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2830012910 con 0x7f2838154390 2023-11-28T19:59:56.322 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:56.318+0000 7f2840479640 1 -- 172.21.15.78:0/2569422473 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2838144cc0 con 0x7f2838154390 2023-11-28T19:59:56.322 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:56.318+0000 7f2840479640 1 -- 172.21.15.78:0/2569422473 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2838071b10 con 0x7f2838154390 2023-11-28T19:59:56.322 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:56.318+0000 7f2840479640 1 -- 172.21.15.78:0/2569422473 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f28380a8780 con 0x7f2838154390 2023-11-28T19:59:56.323 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:56.318+0000 7f282effd640 1 -- 172.21.15.78:0/2569422473 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f2830012a70 con 0x7f2838154390 2023-11-28T19:59:56.323 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:56.318+0000 7f282effd640 1 --2- 172.21.15.78:0/2569422473 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f281c0664a0 0x7f281c068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:56.323 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:56.318+0000 7f282effd640 1 -- 172.21.15.78:0/2569422473 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f28300849f0 con 0x7f2838154390 2023-11-28T19:59:56.323 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:56.322+0000 7f283e215640 1 --2- 172.21.15.78:0/2569422473 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f281c0664a0 0x7f281c068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:56.324 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:56.322+0000 7f283e215640 1 --2- 172.21.15.78:0/2569422473 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f281c0664a0 0x7f281c068960 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f28340ad000 tx=0x7f28340a6000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:59:56.327 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:56.322+0000 7f282effd640 1 -- 172.21.15.78:0/2569422473 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f28380a8780 con 0x7f2838154390 2023-11-28T19:59:56.488 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:56.486+0000 7f2840479640 1 -- 172.21.15.78:0/2569422473 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f28380a8780 con 0x7f2838154390 2023-11-28T19:59:56.488 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:56.486+0000 7f282effd640 1 -- 172.21.15.78:0/2569422473 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v27) v1 ==== 80+0+0 (secure 0 0 0) 0x7f28380a8780 con 0x7f2838154390 2023-11-28T19:59:56.488 INFO:teuthology.orchestra.run.smithi078.stderr:listed 0 entries 2023-11-28T19:59:56.490 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:56.486+0000 7f2840479640 1 -- 172.21.15.78:0/2569422473 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f281c0664a0 msgr2=0x7f281c068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:56.490 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:56.486+0000 7f2840479640 1 --2- 172.21.15.78:0/2569422473 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f281c0664a0 0x7f281c068960 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f28340ad000 tx=0x7f28340a6000 comp rx=0 tx=0).stop 2023-11-28T19:59:56.490 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:56.486+0000 7f2840479640 1 -- 172.21.15.78:0/2569422473 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2838154390 msgr2=0x7f28381430d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:56.491 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:56.486+0000 7f2840479640 1 --2- 172.21.15.78:0/2569422473 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2838154390 0x7f28381430d0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f2830001fe0 tx=0x7f283000a430 comp rx=0 tx=0).stop 2023-11-28T19:59:56.491 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:56.486+0000 7f2840479640 1 -- 172.21.15.78:0/2569422473 shutdown_connections 2023-11-28T19:59:56.491 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:56.486+0000 7f2840479640 1 --2- 172.21.15.78:0/2569422473 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f281c0664a0 0x7f281c068960 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:56.491 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:56.486+0000 7f2840479640 1 --2- 172.21.15.78:0/2569422473 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2838154390 0x7f28381430d0 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:56.491 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:56.486+0000 7f2840479640 1 --2- 172.21.15.78:0/2569422473 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f28380c4f80 0x7f2838070ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:56.491 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:56.486+0000 7f2840479640 1 --2- 172.21.15.78:0/2569422473 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f28380c2110 0x7f283815ccf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:56.491 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:56.486+0000 7f2840479640 1 -- 172.21.15.78:0/2569422473 >> 172.21.15.78:0/2569422473 conn(0x7f283806b220 msgr2=0x7f28380a6650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T19:59:56.491 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:56.486+0000 7f2840479640 1 -- 172.21.15.78:0/2569422473 shutdown_connections 2023-11-28T19:59:56.491 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:56.486+0000 7f2840479640 1 -- 172.21.15.78:0/2569422473 wait complete. 2023-11-28T19:59:56.509 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2023-11-28T19:59:56.509 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T19:59:56.509 DEBUG:teuthology.orchestra.run.smithi179:> sudo umount /home/ubuntu/cephtest/mnt.1 -f 2023-11-28T19:59:56.553 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi179.front.sepia.ceph.com 2023-11-28T19:59:56.553 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T19:59:56.553 DEBUG:teuthology.orchestra.run.smithi179:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-11-28T19:59:56.624 INFO:tasks.cephfs.cephfs_test_case:[, ] 2023-11-28T19:59:56.625 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-28T19:59:56.762 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:56.758+0000 7f303405f640 1 Processor -- start 2023-11-28T19:59:56.762 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:56.758+0000 7f303405f640 1 -- start start 2023-11-28T19:59:56.764 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:56.762+0000 7f303405f640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f302c0c3b80 0x7f302c06d690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:56.764 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:56.762+0000 7f303405f640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f302c06bb80 con 0x7f302c0c5300 2023-11-28T19:59:56.764 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:56.762+0000 7f303405f640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f302c0c5790 con 0x7f302c06d2b0 2023-11-28T19:59:56.764 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:56.762+0000 7f303405f640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f302c1515c0 con 0x7f302c0c3b80 2023-11-28T19:59:56.764 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:56.762+0000 7f30325fc640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f302c0c5300 0x7f302c06c730 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:45806/0 (socket says 172.21.15.78:45806) 2023-11-28T19:59:56.764 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:56.762+0000 7f30325fc640 1 -- 172.21.15.78:0/3299761766 learned_addr learned my addr 172.21.15.78:0/3299761766 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-11-28T19:59:56.764 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:56.762+0000 7f30315fa640 1 --2- 172.21.15.78:0/3299761766 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f302c0c3b80 0x7f302c06d690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:56.765 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:56.762+0000 7f3030df9640 1 -- 172.21.15.78:0/3299761766 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2886176564 0 0) 0x7f302c06bb80 con 0x7f302c0c5300 2023-11-28T19:59:56.765 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:56.762+0000 7f3030df9640 1 -- 172.21.15.78:0/3299761766 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3018003530 con 0x7f302c0c5300 2023-11-28T19:59:56.765 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:56.762+0000 7f3030df9640 1 -- 172.21.15.78:0/3299761766 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 236433457 0 0) 0x7f302c0c5790 con 0x7f302c06d2b0 2023-11-28T19:59:56.765 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:56.762+0000 7f3030df9640 1 -- 172.21.15.78:0/3299761766 --> v1:172.21.15.179:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f302c06bb80 con 0x7f302c06d2b0 2023-11-28T19:59:56.766 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:56.762+0000 7f30315fa640 1 -- 172.21.15.78:0/3299761766 >> v1:172.21.15.179:6789/0 conn(0x7f302c06d2b0 legacy=0x7f302c06c020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:56.766 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:56.762+0000 7f30315fa640 1 -- 172.21.15.78:0/3299761766 >> v1:172.21.15.78:6789/0 conn(0x7f302c0c5300 legacy=0x7f302c06c730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:56.766 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:56.762+0000 7f30315fa640 1 -- 172.21.15.78:0/3299761766 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f302c1518a0 con 0x7f302c0c3b80 2023-11-28T19:59:56.770 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:56.766+0000 7f30315fa640 1 --2- 172.21.15.78:0/3299761766 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f302c0c3b80 0x7f302c06d690 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f301c0097f0 tx=0x7f301c01c490 comp rx=0 tx=0).ready entity=mon.2 client_cookie=802269e3a624553d server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:59:56.771 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:56.766+0000 7f3030df9640 1 -- 172.21.15.78:0/3299761766 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f301c0aa5f0 con 0x7f302c0c3b80 2023-11-28T19:59:56.771 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:56.766+0000 7f3030df9640 1 -- 172.21.15.78:0/3299761766 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f301c0aa750 con 0x7f302c0c3b80 2023-11-28T19:59:56.771 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:56.766+0000 7f3030df9640 1 -- 172.21.15.78:0/3299761766 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f301c0aaae0 con 0x7f302c0c3b80 2023-11-28T19:59:56.771 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:56.766+0000 7f303405f640 1 -- 172.21.15.78:0/3299761766 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f302c0c3b80 msgr2=0x7f302c06d690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:56.771 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:56.766+0000 7f303405f640 1 --2- 172.21.15.78:0/3299761766 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f302c0c3b80 0x7f302c06d690 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f301c0097f0 tx=0x7f301c01c490 comp rx=0 tx=0).stop 2023-11-28T19:59:56.771 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:56.766+0000 7f303405f640 1 -- 172.21.15.78:0/3299761766 shutdown_connections 2023-11-28T19:59:56.771 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:56.766+0000 7f303405f640 1 --2- 172.21.15.78:0/3299761766 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f302c0c3b80 0x7f302c06d690 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:56.771 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:56.766+0000 7f303405f640 1 -- 172.21.15.78:0/3299761766 >> 172.21.15.78:0/3299761766 conn(0x7f302c0a7810 msgr2=0x7f302c0a7c20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T19:59:56.772 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:56.766+0000 7f303405f640 1 -- 172.21.15.78:0/3299761766 shutdown_connections 2023-11-28T19:59:56.772 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:56.766+0000 7f303405f640 1 -- 172.21.15.78:0/3299761766 wait complete. 2023-11-28T19:59:56.772 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:56.766+0000 7f303405f640 1 Processor -- start 2023-11-28T19:59:56.772 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:56.766+0000 7f303405f640 1 -- start start 2023-11-28T19:59:56.774 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:56.766+0000 7f303405f640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f302c06d2b0 0x7f302c0ab200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:56.775 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:56.770+0000 7f303405f640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f302c0c3b80 0x7f302c1eb1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:56.775 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:56.770+0000 7f303405f640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f302c0c5300 0x7f302c1eb700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:56.775 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:56.770+0000 7f303405f640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f302c0be090 con 0x7f302c06d2b0 2023-11-28T19:59:56.775 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:56.770+0000 7f303405f640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f302c0beea0 con 0x7f302c0c3b80 2023-11-28T19:59:56.775 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:56.770+0000 7f303405f640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f302c1ebc40 con 0x7f302c0c5300 2023-11-28T19:59:56.775 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:56.770+0000 7f3031dfb640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f302c06d2b0 0x7f302c0ab200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:56.775 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:56.770+0000 7f3031dfb640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f302c06d2b0 0x7f302c0ab200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:48994/0 (socket says 172.21.15.78:48994) 2023-11-28T19:59:56.775 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:56.770+0000 7f3031dfb640 1 -- 172.21.15.78:0/1785954578 learned_addr learned my addr 172.21.15.78:0/1785954578 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T19:59:56.775 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:56.770+0000 7f3031dfb640 1 -- 172.21.15.78:0/1785954578 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f302c0c5300 msgr2=0x7f302c1eb700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:56.775 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:56.770+0000 7f3031dfb640 1 --2- 172.21.15.78:0/1785954578 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f302c0c5300 0x7f302c1eb700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:56.776 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:56.770+0000 7f3031dfb640 1 -- 172.21.15.78:0/1785954578 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f302c0c3b80 msgr2=0x7f302c1eb1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:56.776 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:56.770+0000 7f3031dfb640 1 --2- 172.21.15.78:0/1785954578 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f302c0c3b80 0x7f302c1eb1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:56.776 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:56.770+0000 7f3031dfb640 1 -- 172.21.15.78:0/1785954578 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f301c009420 con 0x7f302c06d2b0 2023-11-28T19:59:56.776 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:56.770+0000 7f3031dfb640 1 --2- 172.21.15.78:0/1785954578 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f302c06d2b0 0x7f302c0ab200 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f302800c430 tx=0x7f302800c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:59:56.776 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:56.770+0000 7f30227fc640 1 -- 172.21.15.78:0/1785954578 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30280052d0 con 0x7f302c06d2b0 2023-11-28T19:59:56.776 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:56.770+0000 7f30227fc640 1 -- 172.21.15.78:0/1785954578 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3028005450 con 0x7f302c06d2b0 2023-11-28T19:59:56.776 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:56.770+0000 7f30227fc640 1 -- 172.21.15.78:0/1785954578 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3028003840 con 0x7f302c06d2b0 2023-11-28T19:59:56.777 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:56.770+0000 7f303405f640 1 -- 172.21.15.78:0/1785954578 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f302c14ef80 con 0x7f302c06d2b0 2023-11-28T19:59:56.777 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:56.770+0000 7f303405f640 1 -- 172.21.15.78:0/1785954578 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f302c0bf3b0 con 0x7f302c06d2b0 2023-11-28T19:59:56.777 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:56.770+0000 7f303405f640 1 -- 172.21.15.78:0/1785954578 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f302c067630 con 0x7f302c06d2b0 2023-11-28T19:59:56.777 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:56.770+0000 7f30227fc640 1 -- 172.21.15.78:0/1785954578 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f30280039a0 con 0x7f302c06d2b0 2023-11-28T19:59:56.778 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:56.774+0000 7f30227fc640 1 --2- 172.21.15.78:0/1785954578 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f30100664c0 0x7f3010068980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:56.779 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:56.774+0000 7f30227fc640 1 -- 172.21.15.78:0/1785954578 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f30280838e0 con 0x7f302c06d2b0 2023-11-28T19:59:56.779 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:56.774+0000 7f30315fa640 1 --2- 172.21.15.78:0/1785954578 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f30100664c0 0x7f3010068980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:56.779 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:56.774+0000 7f30315fa640 1 --2- 172.21.15.78:0/1785954578 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f30100664c0 0x7f3010068980 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f301c0ae000 tx=0x7f301c008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:59:56.779 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:56.778+0000 7f30227fc640 1 -- 172.21.15.78:0/1785954578 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f3028050980 con 0x7f302c06d2b0 2023-11-28T19:59:56.958 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:56.954+0000 7f303405f640 1 -- 172.21.15.78:0/1785954578 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f302c06bd70 con 0x7f302c06d2b0 2023-11-28T19:59:56.959 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:56.954+0000 7f30227fc640 1 -- 172.21.15.78:0/1785954578 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4915 (secure 0 0 0) 0x7f3028053fa0 con 0x7f302c06d2b0 2023-11-28T19:59:56.959 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-11-28T19:59:56.959 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4241,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6835/3089461479","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6833","nonce":3089461479},{"type":"v1","addr":"172.21.15.179:6835","nonce":3089461479}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4258,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6837/3153162191","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6834","nonce":3153162191},{"type":"v1","addr":"172.21.15.78:6837","nonce":3153162191}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4266,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6836/3073967897","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6835","nonce":3073967897},{"type":"v1","addr":"172.21.15.78:6836","nonce":3073967897}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-28T19:59:05.411488+0000","modified":"2023-11-28T19:59:23.150979+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4275},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4275":{"gid":4275,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.179:6834/1234044491","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6832","nonce":1234044491},{"type":"v1","addr":"172.21.15.179:6834","nonce":1234044491}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-11-28T19:59:56.960 INFO:teuthology.orchestra.run.smithi078.stderr:dumped fsmap epoch 9 2023-11-28T19:59:56.961 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:56.958+0000 7f303405f640 1 -- 172.21.15.78:0/1785954578 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f30100664c0 msgr2=0x7f3010068980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:56.961 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:56.958+0000 7f303405f640 1 --2- 172.21.15.78:0/1785954578 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f30100664c0 0x7f3010068980 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f301c0ae000 tx=0x7f301c008040 comp rx=0 tx=0).stop 2023-11-28T19:59:56.961 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:56.958+0000 7f303405f640 1 -- 172.21.15.78:0/1785954578 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f302c06d2b0 msgr2=0x7f302c0ab200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:56.961 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:56.958+0000 7f303405f640 1 --2- 172.21.15.78:0/1785954578 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f302c06d2b0 0x7f302c0ab200 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f302800c430 tx=0x7f302800c8f0 comp rx=0 tx=0).stop 2023-11-28T19:59:56.961 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:56.958+0000 7f303405f640 1 -- 172.21.15.78:0/1785954578 shutdown_connections 2023-11-28T19:59:56.961 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:56.958+0000 7f303405f640 1 --2- 172.21.15.78:0/1785954578 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f30100664c0 0x7f3010068980 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:56.961 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:56.958+0000 7f303405f640 1 --2- 172.21.15.78:0/1785954578 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f302c0c5300 0x7f302c1eb700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:56.962 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:56.958+0000 7f303405f640 1 --2- 172.21.15.78:0/1785954578 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f302c0c3b80 0x7f302c1eb1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:56.962 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:56.958+0000 7f303405f640 1 --2- 172.21.15.78:0/1785954578 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f302c06d2b0 0x7f302c0ab200 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:56.962 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:56.958+0000 7f303405f640 1 -- 172.21.15.78:0/1785954578 >> 172.21.15.78:0/1785954578 conn(0x7f302c0a7810 msgr2=0x7f302c0c2330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T19:59:56.962 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:56.958+0000 7f303405f640 1 -- 172.21.15.78:0/1785954578 shutdown_connections 2023-11-28T19:59:56.962 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:56.958+0000 7f303405f640 1 -- 172.21.15.78:0/1785954578 wait complete. 2023-11-28T19:59:56.980 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-28T19:59:57.120 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:57.118+0000 7f7ba6962640 1 Processor -- start 2023-11-28T19:59:57.120 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:57.118+0000 7f7ba6962640 1 -- start start 2023-11-28T19:59:57.121 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:57.118+0000 7f7ba6962640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7ba00c65f0 0x7f7ba00c69d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:57.121 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:57.118+0000 7f7ba6962640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f7ba00c9210 0x7f7ba015ecf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:57.121 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:57.118+0000 7f7ba6962640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7ba0151f20 con 0x7f7ba00c8200 2023-11-28T19:59:57.121 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:57.118+0000 7f7ba6962640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7ba0154450 con 0x7f7ba00c9210 2023-11-28T19:59:57.121 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:57.118+0000 7f7ba6962640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ba0154710 con 0x7f7ba00c65f0 2023-11-28T19:59:57.122 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:57.118+0000 7f7ba6161640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f7ba00c9210 0x7f7ba015ecf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:57.122 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:57.118+0000 7f7ba5960640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7ba00c65f0 0x7f7ba00c69d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:57.122 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:57.118+0000 7f7ba6161640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f7ba00c9210 0x7f7ba015ecf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.78:49464/0 (socket says 172.21.15.78:49464) 2023-11-28T19:59:57.122 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:57.118+0000 7f7ba6161640 1 -- 172.21.15.78:0/688060551 learned_addr learned my addr 172.21.15.78:0/688060551 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T19:59:57.122 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:57.118+0000 7f7ba6161640 1 -- 172.21.15.78:0/688060551 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7ba00c65f0 msgr2=0x7f7ba00c69d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T19:59:57.122 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:57.118+0000 7f7ba6161640 1 --2- 172.21.15.78:0/688060551 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7ba00c65f0 0x7f7ba00c69d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:57.122 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:57.118+0000 7f7ba6161640 1 -- 172.21.15.78:0/688060551 >> v1:172.21.15.179:6789/0 conn(0x7f7ba00c8200 legacy=0x7f7ba00c8b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:57.122 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:57.118+0000 7f7ba6161640 1 -- 172.21.15.78:0/688060551 --> v2:172.21.15.179:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ba01549f0 con 0x7f7ba00c9210 2023-11-28T19:59:57.125 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:57.122+0000 7f7ba6161640 1 --2- 172.21.15.78:0/688060551 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7ba00c9210 0x7f7ba015ecf0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f7b98009e50 tx=0x7f7b9801c950 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8314dafc9018d47d server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:59:57.125 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:57.122+0000 7f7ba495e640 1 -- 172.21.15.78:0/688060551 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b980a5810 con 0x7f7ba00c9210 2023-11-28T19:59:57.125 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:57.122+0000 7f7ba495e640 1 -- 172.21.15.78:0/688060551 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b980a5970 con 0x7f7ba00c9210 2023-11-28T19:59:57.125 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:57.122+0000 7f7ba495e640 1 -- 172.21.15.78:0/688060551 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b980a5d00 con 0x7f7ba00c9210 2023-11-28T19:59:57.126 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:57.122+0000 7f7ba6962640 1 -- 172.21.15.78:0/688060551 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7ba00c9210 msgr2=0x7f7ba015ecf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:57.126 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:57.122+0000 7f7ba6962640 1 --2- 172.21.15.78:0/688060551 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7ba00c9210 0x7f7ba015ecf0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f7b98009e50 tx=0x7f7b9801c950 comp rx=0 tx=0).stop 2023-11-28T19:59:57.126 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:57.122+0000 7f7ba6962640 1 -- 172.21.15.78:0/688060551 shutdown_connections 2023-11-28T19:59:57.126 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:57.122+0000 7f7ba6962640 1 --2- 172.21.15.78:0/688060551 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7ba00c9210 0x7f7ba015ecf0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:57.126 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:57.122+0000 7f7ba6962640 1 --2- 172.21.15.78:0/688060551 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7ba00c65f0 0x7f7ba00c69d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:57.127 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:57.122+0000 7f7ba6962640 1 -- 172.21.15.78:0/688060551 >> 172.21.15.78:0/688060551 conn(0x7f7ba00ab730 msgr2=0x7f7ba00abb40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T19:59:57.127 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:57.122+0000 7f7ba6962640 1 -- 172.21.15.78:0/688060551 shutdown_connections 2023-11-28T19:59:57.127 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:57.122+0000 7f7ba6962640 1 -- 172.21.15.78:0/688060551 wait complete. 2023-11-28T19:59:57.127 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:57.126+0000 7f7ba6962640 1 Processor -- start 2023-11-28T19:59:57.127 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:57.126+0000 7f7ba6962640 1 -- start start 2023-11-28T19:59:57.130 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:57.126+0000 7f7ba6962640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7ba00c65f0 0x7f7ba01edda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:57.130 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:57.126+0000 7f7ba6962640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7ba00c8200 0x7f7ba01ee2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:57.130 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:57.126+0000 7f7ba6962640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7ba00c9210 0x7f7ba01efea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:57.130 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:57.126+0000 7f7ba6962640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ba0157a10 con 0x7f7ba00c9210 2023-11-28T19:59:57.130 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:57.126+0000 7f7ba6962640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ba00ac850 con 0x7f7ba00c8200 2023-11-28T19:59:57.130 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:57.126+0000 7f7ba6962640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ba01f0de0 con 0x7f7ba00c65f0 2023-11-28T19:59:57.130 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:57.126+0000 7f7ba6161640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7ba00c9210 0x7f7ba01efea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:57.130 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:57.126+0000 7f7ba6161640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7ba00c9210 0x7f7ba01efea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:48998/0 (socket says 172.21.15.78:48998) 2023-11-28T19:59:57.130 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:57.126+0000 7f7ba6161640 1 -- 172.21.15.78:0/1705993576 learned_addr learned my addr 172.21.15.78:0/1705993576 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T19:59:57.130 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:57.126+0000 7f7ba515f640 1 --2- 172.21.15.78:0/1705993576 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7ba00c8200 0x7f7ba01ee2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:57.131 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:57.126+0000 7f7ba5960640 1 --2- 172.21.15.78:0/1705993576 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7ba00c65f0 0x7f7ba01edda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:57.131 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:57.126+0000 7f7ba6161640 1 -- 172.21.15.78:0/1705993576 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7ba00c65f0 msgr2=0x7f7ba01edda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:57.131 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:57.126+0000 7f7ba6161640 1 --2- 172.21.15.78:0/1705993576 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7ba00c65f0 0x7f7ba01edda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:57.131 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:57.126+0000 7f7ba6161640 1 -- 172.21.15.78:0/1705993576 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7ba00c8200 msgr2=0x7f7ba01ee2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:57.131 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:57.126+0000 7f7ba6161640 1 --2- 172.21.15.78:0/1705993576 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7ba00c8200 0x7f7ba01ee2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:57.131 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:57.126+0000 7f7ba6161640 1 -- 172.21.15.78:0/1705993576 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b98009b30 con 0x7f7ba00c9210 2023-11-28T19:59:57.131 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:57.126+0000 7f7ba5960640 1 --2- 172.21.15.78:0/1705993576 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7ba00c65f0 0x7f7ba01edda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T19:59:57.131 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:57.126+0000 7f7ba6161640 1 --2- 172.21.15.78:0/1705993576 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7ba00c9210 0x7f7ba01efea0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f7b980af040 tx=0x7f7b980196f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:59:57.131 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:57.126+0000 7f7b967fc640 1 -- 172.21.15.78:0/1705993576 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b980b8640 con 0x7f7ba00c9210 2023-11-28T19:59:57.131 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:57.126+0000 7f7b967fc640 1 -- 172.21.15.78:0/1705993576 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b980b87a0 con 0x7f7ba00c9210 2023-11-28T19:59:57.131 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:57.126+0000 7f7b967fc640 1 -- 172.21.15.78:0/1705993576 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b980b8b30 con 0x7f7ba00c9210 2023-11-28T19:59:57.131 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:57.126+0000 7f7ba6962640 1 -- 172.21.15.78:0/1705993576 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7ba00c0570 con 0x7f7ba00c9210 2023-11-28T19:59:57.132 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:57.126+0000 7f7ba6962640 1 -- 172.21.15.78:0/1705993576 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7ba0157350 con 0x7f7ba00c9210 2023-11-28T19:59:57.132 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:57.126+0000 7f7ba6962640 1 -- 172.21.15.78:0/1705993576 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7ba0157b50 con 0x7f7ba00c9210 2023-11-28T19:59:57.132 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:57.130+0000 7f7b967fc640 1 -- 172.21.15.78:0/1705993576 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f7b980b8c90 con 0x7f7ba00c9210 2023-11-28T19:59:57.133 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:57.130+0000 7f7b967fc640 1 --2- 172.21.15.78:0/1705993576 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f7b84066470 0x7f7b84068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:57.133 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:57.130+0000 7f7b967fc640 1 -- 172.21.15.78:0/1705993576 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f7b9811eea0 con 0x7f7ba00c9210 2023-11-28T19:59:57.133 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:57.130+0000 7f7ba5960640 1 --2- 172.21.15.78:0/1705993576 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f7b84066470 0x7f7b84068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:57.133 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:57.130+0000 7f7ba5960640 1 --2- 172.21.15.78:0/1705993576 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f7b84066470 0x7f7b84068930 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f7ba0151740 tx=0x7f7b9c008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:59:57.137 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:57.134+0000 7f7b967fc640 1 -- 172.21.15.78:0/1705993576 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f7ba0157b50 con 0x7f7ba00c9210 2023-11-28T19:59:57.286 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:57.282+0000 7f7ba6962640 1 -- 172.21.15.78:0/1705993576 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7ba0157b50 con 0x7f7ba00c9210 2023-11-28T19:59:57.287 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:57.286+0000 7f7b967fc640 1 -- 172.21.15.78:0/1705993576 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) v1 ==== 74+0+18711 (secure 0 0 0) 0x7f7ba0157b50 con 0x7f7ba00c9210 2023-11-28T19:59:57.288 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-11-28T19:59:57.288 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":27,"fsid":"dd9780e8-3bda-44fa-a9f0-fa07d19d901d","created":"2023-11-28T19:58:40.969556+0000","modified":"2023-11-28T19:59:47.762261+0000","last_up_change":"2023-11-28T19:58:52.596716+0000","last_in_change":"2023-11-28T19:58:43.609275+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-28T19:58:54.011229+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-28T19:59:03.945559+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-28T19:59:04.481478+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-11-28T19:59:08.109152+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"e84245ac-b5da-429e-af18-39acaa2b33e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6800","nonce":3358701235},{"type":"v1","addr":"172.21.15.78:6801","nonce":3358701235}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6802","nonce":3358701235},{"type":"v1","addr":"172.21.15.78:6803","nonce":3358701235}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6806","nonce":3358701235},{"type":"v1","addr":"172.21.15.78:6807","nonce":3358701235}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6804","nonce":3358701235},{"type":"v1","addr":"172.21.15.78:6805","nonce":3358701235}]},"public_addr":"172.21.15.78:6801/3358701235","cluster_addr":"172.21.15.78:6803/3358701235","heartbeat_back_addr":"172.21.15.78:6807/3358701235","heartbeat_front_addr":"172.21.15.78:6805/3358701235","state":["exists","up"]},{"osd":1,"uuid":"e634831d-c4e2-48d9-870c-9556ae162981","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6808","nonce":3211476654},{"type":"v1","addr":"172.21.15.78:6809","nonce":3211476654}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6810","nonce":3211476654},{"type":"v1","addr":"172.21.15.78:6811","nonce":3211476654}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6814","nonce":3211476654},{"type":"v1","addr":"172.21.15.78:6815","nonce":3211476654}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6812","nonce":3211476654},{"type":"v1","addr":"172.21.15.78:6813","nonce":3211476654}]},"public_addr":"172.21.15.78:6809/3211476654","cluster_addr":"172.21.15.78:6811/3211476654","heartbeat_back_addr":"172.21.15.78:6815/3211476654","heartbeat_front_addr":"172.21.15.78:6813/3211476654","state":["exists","up"]},{"osd":2,"uuid":"274c8395-6534-41f0-b8fb-a00af8985aa8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6816","nonce":2532904479},{"type":"v1","addr":"172.21.15.78:6817","nonce":2532904479}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6818","nonce":2532904479},{"type":"v1","addr":"172.21.15.78:6819","nonce":2532904479}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6822","nonce":2532904479},{"type":"v1","addr":"172.21.15.78:6823","nonce":2532904479}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6820","nonce":2532904479},{"type":"v1","addr":"172.21.15.78:6821","nonce":2532904479}]},"public_addr":"172.21.15.78:6817/2532904479","cluster_addr":"172.21.15.78:6819/2532904479","heartbeat_back_addr":"172.21.15.78:6823/2532904479","heartbeat_front_addr":"172.21.15.78:6821/2532904479","state":["exists","up"]},{"osd":3,"uuid":"77acc9af-7d4d-4b18-8cf5-d62f5971b7c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6824","nonce":3442991267},{"type":"v1","addr":"172.21.15.78:6825","nonce":3442991267}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6826","nonce":3442991267},{"type":"v1","addr":"172.21.15.78:6827","nonce":3442991267}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6830","nonce":3442991267},{"type":"v1","addr":"172.21.15.78:6831","nonce":3442991267}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6828","nonce":3442991267},{"type":"v1","addr":"172.21.15.78:6829","nonce":3442991267}]},"public_addr":"172.21.15.78:6825/3442991267","cluster_addr":"172.21.15.78:6827/3442991267","heartbeat_back_addr":"172.21.15.78:6831/3442991267","heartbeat_front_addr":"172.21.15.78:6829/3442991267","state":["exists","up"]},{"osd":4,"uuid":"5c62bc66-6b34-4b7f-a66b-9a743969138c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":802983577},{"type":"v1","addr":"172.21.15.179:6809","nonce":802983577}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":802983577},{"type":"v1","addr":"172.21.15.179:6811","nonce":802983577}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":802983577},{"type":"v1","addr":"172.21.15.179:6815","nonce":802983577}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":802983577},{"type":"v1","addr":"172.21.15.179:6813","nonce":802983577}]},"public_addr":"172.21.15.179:6809/802983577","cluster_addr":"172.21.15.179:6811/802983577","heartbeat_back_addr":"172.21.15.179:6815/802983577","heartbeat_front_addr":"172.21.15.179:6813/802983577","state":["exists","up"]},{"osd":5,"uuid":"67db6d36-f684-4079-b0cd-82b4dd61461f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":518192887},{"type":"v1","addr":"172.21.15.179:6818","nonce":518192887}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":518192887},{"type":"v1","addr":"172.21.15.179:6822","nonce":518192887}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":518192887},{"type":"v1","addr":"172.21.15.179:6829","nonce":518192887}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6824","nonce":518192887},{"type":"v1","addr":"172.21.15.179:6826","nonce":518192887}]},"public_addr":"172.21.15.179:6818/518192887","cluster_addr":"172.21.15.179:6822/518192887","heartbeat_back_addr":"172.21.15.179:6829/518192887","heartbeat_front_addr":"172.21.15.179:6826/518192887","state":["exists","up"]},{"osd":6,"uuid":"12e670af-5a16-4c81-9f97-defa66cab967","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":815435378},{"type":"v1","addr":"172.21.15.179:6801","nonce":815435378}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":815435378},{"type":"v1","addr":"172.21.15.179:6803","nonce":815435378}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":815435378},{"type":"v1","addr":"172.21.15.179:6807","nonce":815435378}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":815435378},{"type":"v1","addr":"172.21.15.179:6805","nonce":815435378}]},"public_addr":"172.21.15.179:6801/815435378","cluster_addr":"172.21.15.179:6803/815435378","heartbeat_back_addr":"172.21.15.179:6807/815435378","heartbeat_front_addr":"172.21.15.179:6805/815435378","state":["exists","up"]},{"osd":7,"uuid":"fe630650-2eb3-49ad-8676-c341e6332eb1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6817","nonce":2848432339},{"type":"v1","addr":"172.21.15.179:6819","nonce":2848432339}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6821","nonce":2848432339},{"type":"v1","addr":"172.21.15.179:6823","nonce":2848432339}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":2848432339},{"type":"v1","addr":"172.21.15.179:6831","nonce":2848432339}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6825","nonce":2848432339},{"type":"v1","addr":"172.21.15.179:6827","nonce":2848432339}]},"public_addr":"172.21.15.179:6819/2848432339","cluster_addr":"172.21.15.179:6823/2848432339","heartbeat_back_addr":"172.21.15.179:6831/2848432339","heartbeat_front_addr":"172.21.15.179:6827/2848432339","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:58:49.255433+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:58:49.412880+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:58:49.559295+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:58:49.245237+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:58:49.184557+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:58:49.329851+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:58:49.366012+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:58:49.349604+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.2","mappings":[{"from":5,"to":1}]},{"pgid":"3.8","mappings":[{"from":3,"to":2}]},{"pgid":"3.26","mappings":[{"from":7,"to":2}]},{"pgid":"3.30","mappings":[{"from":5,"to":2}]},{"pgid":"4.10","mappings":[{"from":1,"to":2}]},{"pgid":"4.14","mappings":[{"from":1,"to":5}]},{"pgid":"4.1d","mappings":[{"from":1,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-28T19:59:57.290 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:57.286+0000 7f7ba6962640 1 -- 172.21.15.78:0/1705993576 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f7b84066470 msgr2=0x7f7b84068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:57.290 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:57.286+0000 7f7ba6962640 1 --2- 172.21.15.78:0/1705993576 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f7b84066470 0x7f7b84068930 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f7ba0151740 tx=0x7f7b9c008040 comp rx=0 tx=0).stop 2023-11-28T19:59:57.290 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:57.286+0000 7f7ba6962640 1 -- 172.21.15.78:0/1705993576 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7ba00c9210 msgr2=0x7f7ba01efea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:57.290 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:57.286+0000 7f7ba6962640 1 --2- 172.21.15.78:0/1705993576 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7ba00c9210 0x7f7ba01efea0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f7b980af040 tx=0x7f7b980196f0 comp rx=0 tx=0).stop 2023-11-28T19:59:57.291 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:57.286+0000 7f7ba6962640 1 -- 172.21.15.78:0/1705993576 shutdown_connections 2023-11-28T19:59:57.291 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:57.286+0000 7f7ba6962640 1 --2- 172.21.15.78:0/1705993576 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f7b84066470 0x7f7b84068930 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:57.291 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:57.286+0000 7f7ba6962640 1 --2- 172.21.15.78:0/1705993576 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7ba00c9210 0x7f7ba01efea0 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:57.291 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:57.286+0000 7f7ba6962640 1 --2- 172.21.15.78:0/1705993576 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7ba00c8200 0x7f7ba01ee2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:57.291 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:57.286+0000 7f7ba6962640 1 --2- 172.21.15.78:0/1705993576 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7ba00c65f0 0x7f7ba01edda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:57.291 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:57.286+0000 7f7ba6962640 1 -- 172.21.15.78:0/1705993576 >> 172.21.15.78:0/1705993576 conn(0x7f7ba00ab730 msgr2=0x7f7ba00aa6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T19:59:57.291 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:57.286+0000 7f7ba6962640 1 -- 172.21.15.78:0/1705993576 shutdown_connections 2023-11-28T19:59:57.292 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:57.286+0000 7f7ba6962640 1 -- 172.21.15.78:0/1705993576 wait complete. 2023-11-28T19:59:57.309 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-28T19:58:54.011229+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-28T19:59:03.945559+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-11-28T19:59:04.481478+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-11-28T19:59:08.109152+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-11-28T19:59:57.309 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-28T19:59:57.450 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:57.446+0000 7fbbf806b640 1 Processor -- start 2023-11-28T19:59:57.450 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:57.446+0000 7fbbf806b640 1 -- start start 2023-11-28T19:59:57.452 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:57.446+0000 7fbbf806b640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbbf014f850 0x7fbbf00aacf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:57.452 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:57.446+0000 7fbbf806b640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fbbf014fc30 0x7fbbf00c3cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:57.452 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:57.446+0000 7fbbf806b640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbbf0152910 con 0x7fbbf006d840 2023-11-28T19:59:57.452 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:57.446+0000 7fbbf806b640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbbf00c2240 con 0x7fbbf014fc30 2023-11-28T19:59:57.453 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:57.446+0000 7fbbf806b640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbbf0152bf0 con 0x7fbbf014f850 2023-11-28T19:59:57.453 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:57.450+0000 7fbbf6608640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7fbbf006d840 0x7fbbf00c4210 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:45814/0 (socket says 172.21.15.78:45814) 2023-11-28T19:59:57.453 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:57.450+0000 7fbbf6608640 1 -- 172.21.15.78:0/1641547104 learned_addr learned my addr 172.21.15.78:0/1641547104 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-11-28T19:59:57.453 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:57.450+0000 7fbbf5606640 1 --2- 172.21.15.78:0/1641547104 >> v2:172.21.15.179:3300/0 conn(0x7fbbf014fc30 0x7fbbf00c3cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:57.453 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:57.450+0000 7fbbf5e07640 1 --2- 172.21.15.78:0/1641547104 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbbf014f850 0x7fbbf00aacf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:57.453 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:57.450+0000 7fbbf4e05640 1 -- 172.21.15.78:0/1641547104 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1396495348 0 0) 0x7fbbf0152910 con 0x7fbbf006d840 2023-11-28T19:59:57.454 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:57.450+0000 7fbbf4e05640 1 -- 172.21.15.78:0/1641547104 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbbdc003530 con 0x7fbbf006d840 2023-11-28T19:59:57.454 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:57.450+0000 7fbbf5606640 1 -- 172.21.15.78:0/1641547104 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbbf014f850 msgr2=0x7fbbf00aacf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T19:59:57.454 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:57.450+0000 7fbbf5606640 1 --2- 172.21.15.78:0/1641547104 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbbf014f850 0x7fbbf00aacf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:57.454 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:57.450+0000 7fbbf5606640 1 -- 172.21.15.78:0/1641547104 >> v1:172.21.15.78:6789/0 conn(0x7fbbf006d840 legacy=0x7fbbf00c4210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:57.455 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:57.450+0000 7fbbf5606640 1 -- 172.21.15.78:0/1641547104 --> v2:172.21.15.179:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbbf0152ed0 con 0x7fbbf014fc30 2023-11-28T19:59:57.455 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:57.454+0000 7fbbf5606640 1 --2- 172.21.15.78:0/1641547104 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbbf014fc30 0x7fbbf00c3cd0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fbbe00097c0 tx=0x7fbbe001c480 comp rx=0 tx=0).ready entity=mon.1 client_cookie=482eecdee0c7e61a server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:59:57.455 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:57.454+0000 7fbbf4e05640 1 -- 172.21.15.78:0/1641547104 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbe00a6040 con 0x7fbbf014fc30 2023-11-28T19:59:57.456 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:57.454+0000 7fbbf4e05640 1 -- 172.21.15.78:0/1641547104 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbbe00aa600 con 0x7fbbf014fc30 2023-11-28T19:59:57.456 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:57.454+0000 7fbbf4e05640 1 -- 172.21.15.78:0/1641547104 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbe00aa990 con 0x7fbbf014fc30 2023-11-28T19:59:57.456 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:57.454+0000 7fbbf806b640 1 -- 172.21.15.78:0/1641547104 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbbf014fc30 msgr2=0x7fbbf00c3cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:57.457 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:57.454+0000 7fbbf806b640 1 --2- 172.21.15.78:0/1641547104 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbbf014fc30 0x7fbbf00c3cd0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fbbe00097c0 tx=0x7fbbe001c480 comp rx=0 tx=0).stop 2023-11-28T19:59:57.457 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:57.454+0000 7fbbf806b640 1 -- 172.21.15.78:0/1641547104 shutdown_connections 2023-11-28T19:59:57.457 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:57.454+0000 7fbbf806b640 1 --2- 172.21.15.78:0/1641547104 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbbf014fc30 0x7fbbf00c3cd0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:57.457 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:57.454+0000 7fbbf806b640 1 --2- 172.21.15.78:0/1641547104 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbbf014f850 0x7fbbf00aacf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:57.457 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:57.454+0000 7fbbf806b640 1 -- 172.21.15.78:0/1641547104 >> 172.21.15.78:0/1641547104 conn(0x7fbbf00c59f0 msgr2=0x7fbbf00c5e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T19:59:57.457 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:57.454+0000 7fbbf806b640 1 -- 172.21.15.78:0/1641547104 shutdown_connections 2023-11-28T19:59:57.457 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:57.454+0000 7fbbf806b640 1 -- 172.21.15.78:0/1641547104 wait complete. 2023-11-28T19:59:57.458 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:57.454+0000 7fbbf806b640 1 Processor -- start 2023-11-28T19:59:57.458 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:57.454+0000 7fbbf806b640 1 -- start start 2023-11-28T19:59:57.461 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:57.454+0000 7fbbf806b640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbbf006d840 0x7fbbf00a6910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:57.461 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:57.454+0000 7fbbf806b640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbbf014f850 0x7fbbf01edd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:57.461 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:57.454+0000 7fbbf806b640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbbf014fc30 0x7fbbf01ee270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:57.461 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:57.454+0000 7fbbf806b640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbbf01ed910 con 0x7fbbf006d840 2023-11-28T19:59:57.461 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:57.454+0000 7fbbf806b640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbbf01f1b80 con 0x7fbbf014fc30 2023-11-28T19:59:57.461 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:57.454+0000 7fbbf806b640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbbf00aa060 con 0x7fbbf014f850 2023-11-28T19:59:57.461 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:57.458+0000 7fbbf5e07640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbbf006d840 0x7fbbf00a6910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:57.461 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:57.458+0000 7fbbf5e07640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbbf006d840 0x7fbbf00a6910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:49010/0 (socket says 172.21.15.78:49010) 2023-11-28T19:59:57.461 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:57.458+0000 7fbbf5e07640 1 -- 172.21.15.78:0/2041518604 learned_addr learned my addr 172.21.15.78:0/2041518604 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T19:59:57.461 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:57.458+0000 7fbbf5606640 1 --2- 172.21.15.78:0/2041518604 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbbf014f850 0x7fbbf01edd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:57.462 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:57.458+0000 7fbbf6608640 1 --2- 172.21.15.78:0/2041518604 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbbf014fc30 0x7fbbf01ee270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:57.462 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:57.458+0000 7fbbf5e07640 1 -- 172.21.15.78:0/2041518604 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbbf014f850 msgr2=0x7fbbf01edd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:57.462 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:57.458+0000 7fbbf5e07640 1 --2- 172.21.15.78:0/2041518604 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbbf014f850 0x7fbbf01edd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:57.462 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:57.458+0000 7fbbf5e07640 1 -- 172.21.15.78:0/2041518604 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbbf014fc30 msgr2=0x7fbbf01ee270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:57.462 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:57.458+0000 7fbbf5e07640 1 --2- 172.21.15.78:0/2041518604 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbbf014fc30 0x7fbbf01ee270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:57.462 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:57.458+0000 7fbbf5e07640 1 -- 172.21.15.78:0/2041518604 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbbe0009420 con 0x7fbbf006d840 2023-11-28T19:59:57.462 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:57.458+0000 7fbbf5606640 1 --2- 172.21.15.78:0/2041518604 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbbf014f850 0x7fbbf01edd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T19:59:57.462 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:57.458+0000 7fbbf6608640 1 --2- 172.21.15.78:0/2041518604 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbbf014fc30 0x7fbbf01ee270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T19:59:57.462 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:57.458+0000 7fbbf5e07640 1 --2- 172.21.15.78:0/2041518604 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbbf006d840 0x7fbbf00a6910 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7fbbec00e960 tx=0x7fbbec00ee20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:59:57.462 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:57.458+0000 7fbbe67fc640 1 -- 172.21.15.78:0/2041518604 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbec009690 con 0x7fbbf006d840 2023-11-28T19:59:57.462 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:57.458+0000 7fbbe67fc640 1 -- 172.21.15.78:0/2041518604 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbbec00ca00 con 0x7fbbf006d840 2023-11-28T19:59:57.463 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:57.458+0000 7fbbf806b640 1 -- 172.21.15.78:0/2041518604 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbbf00aa340 con 0x7fbbf006d840 2023-11-28T19:59:57.463 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:57.458+0000 7fbbe67fc640 1 -- 172.21.15.78:0/2041518604 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbec00cd70 con 0x7fbbf006d840 2023-11-28T19:59:57.463 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:57.458+0000 7fbbf806b640 1 -- 172.21.15.78:0/2041518604 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbbf00a6e50 con 0x7fbbf006d840 2023-11-28T19:59:57.464 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:57.458+0000 7fbbf806b640 1 -- 172.21.15.78:0/2041518604 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbbf0067630 con 0x7fbbf006d840 2023-11-28T19:59:57.464 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:57.458+0000 7fbbe67fc640 1 -- 172.21.15.78:0/2041518604 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fbbec013470 con 0x7fbbf006d840 2023-11-28T19:59:57.464 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:57.458+0000 7fbbe67fc640 1 --2- 172.21.15.78:0/2041518604 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fbbd4066470 0x7fbbd4068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:57.464 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:57.458+0000 7fbbe67fc640 1 -- 172.21.15.78:0/2041518604 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fbbec084480 con 0x7fbbf006d840 2023-11-28T19:59:57.464 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:57.458+0000 7fbbf5606640 1 --2- 172.21.15.78:0/2041518604 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fbbd4066470 0x7fbbd4068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:57.464 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:57.462+0000 7fbbf5606640 1 --2- 172.21.15.78:0/2041518604 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fbbd4066470 0x7fbbd4068930 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fbbe00ae000 tx=0x7fbbe00a7000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:59:57.467 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:57.462+0000 7fbbe67fc640 1 -- 172.21.15.78:0/2041518604 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fbbec051530 con 0x7fbbf006d840 2023-11-28T19:59:57.616 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:57.614+0000 7fbbf806b640 1 -- 172.21.15.78:0/2041518604 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fbbf01edb80 con 0x7fbbf006d840 2023-11-28T19:59:57.617 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:57.614+0000 7fbbe67fc640 1 -- 172.21.15.78:0/2041518604 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v27) v1 ==== 93+0+10 (secure 0 0 0) 0x7fbbec054b50 con 0x7fbbf006d840 2023-11-28T19:59:57.617 INFO:teuthology.orchestra.run.smithi078.stdout:pg_num: 1 2023-11-28T19:59:57.618 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:57.614+0000 7fbbf806b640 1 -- 172.21.15.78:0/2041518604 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fbbd4066470 msgr2=0x7fbbd4068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:57.619 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:57.614+0000 7fbbf806b640 1 --2- 172.21.15.78:0/2041518604 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fbbd4066470 0x7fbbd4068930 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fbbe00ae000 tx=0x7fbbe00a7000 comp rx=0 tx=0).stop 2023-11-28T19:59:57.619 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:57.614+0000 7fbbf806b640 1 -- 172.21.15.78:0/2041518604 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbbf006d840 msgr2=0x7fbbf00a6910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:57.619 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:57.614+0000 7fbbf806b640 1 --2- 172.21.15.78:0/2041518604 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbbf006d840 0x7fbbf00a6910 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7fbbec00e960 tx=0x7fbbec00ee20 comp rx=0 tx=0).stop 2023-11-28T19:59:57.619 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:57.614+0000 7fbbf806b640 1 -- 172.21.15.78:0/2041518604 shutdown_connections 2023-11-28T19:59:57.619 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:57.614+0000 7fbbf806b640 1 --2- 172.21.15.78:0/2041518604 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fbbd4066470 0x7fbbd4068930 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:57.619 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:57.614+0000 7fbbf806b640 1 --2- 172.21.15.78:0/2041518604 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbbf014f850 0x7fbbf01edd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:57.619 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:57.614+0000 7fbbf806b640 1 --2- 172.21.15.78:0/2041518604 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbbf014fc30 0x7fbbf01ee270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:57.620 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:57.614+0000 7fbbf806b640 1 --2- 172.21.15.78:0/2041518604 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbbf006d840 0x7fbbf00a6910 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:57.620 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:57.614+0000 7fbbf806b640 1 -- 172.21.15.78:0/2041518604 >> 172.21.15.78:0/2041518604 conn(0x7fbbf00c59f0 msgr2=0x7fbbf00c3cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T19:59:57.620 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:57.614+0000 7fbbf806b640 1 -- 172.21.15.78:0/2041518604 shutdown_connections 2023-11-28T19:59:57.620 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:57.614+0000 7fbbf806b640 1 -- 172.21.15.78:0/2041518604 wait complete. 2023-11-28T19:59:57.637 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-28T19:59:57.778 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:57.774+0000 7fb157380640 1 Processor -- start 2023-11-28T19:59:57.779 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:57.774+0000 7fb157380640 1 -- start start 2023-11-28T19:59:57.780 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:57.774+0000 7fb157380640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb150156200 0x7fb1500c0370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:57.780 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:57.774+0000 7fb157380640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fb1500c0e10 0x7fb1500c1b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:57.781 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:57.774+0000 7fb157380640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fb15015bf70 0x7fb15015c400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:57.781 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:57.774+0000 7fb157380640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb15006d8d0 con 0x7fb15015bf70 2023-11-28T19:59:57.781 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:57.774+0000 7fb157380640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb15006bce0 con 0x7fb1500c0e10 2023-11-28T19:59:57.781 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:57.774+0000 7fb157380640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb15015cc60 con 0x7fb150156200 2023-11-28T19:59:57.781 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:57.774+0000 7fb15591d640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fb15015bf70 0x7fb15015c400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:57.782 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:57.774+0000 7fb15591d640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fb15015bf70 0x7fb15015c400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:49022/0 (socket says 172.21.15.78:49022) 2023-11-28T19:59:57.782 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:57.774+0000 7fb15591d640 1 -- 172.21.15.78:0/734260310 learned_addr learned my addr 172.21.15.78:0/734260310 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T19:59:57.782 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:57.774+0000 7fb15511c640 1 --2- 172.21.15.78:0/734260310 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb150156200 0x7fb1500c0370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:57.782 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:57.774+0000 7fb15491b640 1 --2- 172.21.15.78:0/734260310 >> v2:172.21.15.179:3300/0 conn(0x7fb1500c0e10 0x7fb1500c1b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:57.782 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:57.778+0000 7fb15591d640 1 -- 172.21.15.78:0/734260310 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb150156200 msgr2=0x7fb1500c0370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T19:59:57.782 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:57.778+0000 7fb15591d640 1 --2- 172.21.15.78:0/734260310 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb150156200 0x7fb1500c0370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:57.783 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:57.778+0000 7fb15591d640 1 -- 172.21.15.78:0/734260310 >> v2:172.21.15.179:3300/0 conn(0x7fb1500c0e10 msgr2=0x7fb1500c1b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T19:59:57.783 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:57.778+0000 7fb15591d640 1 --2- 172.21.15.78:0/734260310 >> v2:172.21.15.179:3300/0 conn(0x7fb1500c0e10 0x7fb1500c1b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:57.783 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:57.778+0000 7fb15591d640 1 -- 172.21.15.78:0/734260310 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb15006bf30 con 0x7fb15015bf70 2023-11-28T19:59:57.784 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:57.778+0000 7fb15591d640 1 --2- 172.21.15.78:0/734260310 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb15015bf70 0x7fb15015c400 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7fb15006f790 tx=0x7fb14801c870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3c8d8856edaeaf8f server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:59:57.784 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:57.778+0000 7fb147fff640 1 -- 172.21.15.78:0/734260310 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1480a5640 con 0x7fb15015bf70 2023-11-28T19:59:57.784 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:57.778+0000 7fb147fff640 1 -- 172.21.15.78:0/734260310 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb1480a57a0 con 0x7fb15015bf70 2023-11-28T19:59:57.784 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:57.778+0000 7fb147fff640 1 -- 172.21.15.78:0/734260310 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1480a5b30 con 0x7fb15015bf70 2023-11-28T19:59:57.785 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:57.778+0000 7fb157380640 1 -- 172.21.15.78:0/734260310 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb15015bf70 msgr2=0x7fb15015c400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:57.785 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:57.778+0000 7fb157380640 1 --2- 172.21.15.78:0/734260310 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb15015bf70 0x7fb15015c400 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7fb15006f790 tx=0x7fb14801c870 comp rx=0 tx=0).stop 2023-11-28T19:59:57.785 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:57.778+0000 7fb157380640 1 -- 172.21.15.78:0/734260310 shutdown_connections 2023-11-28T19:59:57.785 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:57.778+0000 7fb157380640 1 --2- 172.21.15.78:0/734260310 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb15015bf70 0x7fb15015c400 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:57.785 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:57.778+0000 7fb157380640 1 --2- 172.21.15.78:0/734260310 >> v2:172.21.15.179:3300/0 conn(0x7fb1500c0e10 0x7fb1500c1b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:57.785 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:57.778+0000 7fb157380640 1 --2- 172.21.15.78:0/734260310 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb150156200 0x7fb1500c0370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:57.785 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:57.778+0000 7fb157380640 1 -- 172.21.15.78:0/734260310 >> 172.21.15.78:0/734260310 conn(0x7fb1500c59f0 msgr2=0x7fb1500c5e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T19:59:57.785 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:57.782+0000 7fb157380640 1 -- 172.21.15.78:0/734260310 shutdown_connections 2023-11-28T19:59:57.785 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:57.782+0000 7fb157380640 1 -- 172.21.15.78:0/734260310 wait complete. 2023-11-28T19:59:57.787 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:57.782+0000 7fb157380640 1 Processor -- start 2023-11-28T19:59:57.787 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:57.782+0000 7fb157380640 1 -- start start 2023-11-28T19:59:57.788 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:57.782+0000 7fb157380640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb1500c0e10 0x7fb150157af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:57.788 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:57.782+0000 7fb157380640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb150156200 0x7fb1501f47b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:57.788 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:57.782+0000 7fb157380640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb15015bf70 0x7fb1501f4cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:57.788 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:57.782+0000 7fb157380640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1501474b0 con 0x7fb150156200 2023-11-28T19:59:57.788 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:57.782+0000 7fb157380640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb150143920 con 0x7fb1500c0e10 2023-11-28T19:59:57.788 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:57.782+0000 7fb157380640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1501f4360 con 0x7fb15015bf70 2023-11-28T19:59:57.789 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:57.782+0000 7fb15491b640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb150156200 0x7fb1501f47b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:57.789 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:57.782+0000 7fb15491b640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb150156200 0x7fb1501f47b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:49030/0 (socket says 172.21.15.78:49030) 2023-11-28T19:59:57.789 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:57.782+0000 7fb15491b640 1 -- 172.21.15.78:0/1291420083 learned_addr learned my addr 172.21.15.78:0/1291420083 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T19:59:57.789 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:57.782+0000 7fb15591d640 1 --2- 172.21.15.78:0/1291420083 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb15015bf70 0x7fb1501f4cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:57.789 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:57.782+0000 7fb15511c640 1 --2- 172.21.15.78:0/1291420083 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb1500c0e10 0x7fb150157af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:57.789 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:57.782+0000 7fb15491b640 1 -- 172.21.15.78:0/1291420083 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb15015bf70 msgr2=0x7fb1501f4cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:57.789 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:57.782+0000 7fb15491b640 1 --2- 172.21.15.78:0/1291420083 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb15015bf70 0x7fb1501f4cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:57.789 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:57.782+0000 7fb15491b640 1 -- 172.21.15.78:0/1291420083 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb1500c0e10 msgr2=0x7fb150157af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:57.789 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:57.782+0000 7fb15491b640 1 --2- 172.21.15.78:0/1291420083 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb1500c0e10 0x7fb150157af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:57.790 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:57.782+0000 7fb15491b640 1 -- 172.21.15.78:0/1291420083 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb148009b30 con 0x7fb150156200 2023-11-28T19:59:57.790 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:57.782+0000 7fb15511c640 1 --2- 172.21.15.78:0/1291420083 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb1500c0e10 0x7fb150157af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T19:59:57.790 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:57.782+0000 7fb15491b640 1 --2- 172.21.15.78:0/1291420083 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb150156200 0x7fb1501f47b0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7fb14000d5f0 tx=0x7fb14000dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:59:57.790 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:57.782+0000 7fb145ffb640 1 -- 172.21.15.78:0/1291420083 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1400125f0 con 0x7fb150156200 2023-11-28T19:59:57.790 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:57.782+0000 7fb145ffb640 1 -- 172.21.15.78:0/1291420083 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb140012750 con 0x7fb150156200 2023-11-28T19:59:57.790 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:57.782+0000 7fb145ffb640 1 -- 172.21.15.78:0/1291420083 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb140012ae0 con 0x7fb150156200 2023-11-28T19:59:57.790 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:57.782+0000 7fb157380640 1 -- 172.21.15.78:0/1291420083 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb15015b120 con 0x7fb150156200 2023-11-28T19:59:57.790 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:57.786+0000 7fb157380640 1 -- 172.21.15.78:0/1291420083 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb15015b370 con 0x7fb150156200 2023-11-28T19:59:57.791 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:57.786+0000 7fb157380640 1 -- 172.21.15.78:0/1291420083 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb1501f44d0 con 0x7fb150156200 2023-11-28T19:59:57.791 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:57.786+0000 7fb145ffb640 1 -- 172.21.15.78:0/1291420083 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fb140012c40 con 0x7fb150156200 2023-11-28T19:59:57.792 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:57.786+0000 7fb145ffb640 1 --2- 172.21.15.78:0/1291420083 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fb134066470 0x7fb134068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:57.792 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:57.786+0000 7fb145ffb640 1 -- 172.21.15.78:0/1291420083 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fb140084680 con 0x7fb150156200 2023-11-28T19:59:57.792 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:57.786+0000 7fb15511c640 1 --2- 172.21.15.78:0/1291420083 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fb134066470 0x7fb134068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:57.792 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:57.786+0000 7fb15511c640 1 --2- 172.21.15.78:0/1291420083 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fb134066470 0x7fb134068930 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fb14c0079f0 tx=0x7fb14c008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:59:57.794 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:57.790+0000 7fb145ffb640 1 -- 172.21.15.78:0/1291420083 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fb1501f44d0 con 0x7fb150156200 2023-11-28T19:59:57.945 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:57.938+0000 7fb157380640 1 -- 172.21.15.78:0/1291420083 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fb1501f44a0 con 0x7fb150156200 2023-11-28T19:59:57.945 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:57.938+0000 7fb145ffb640 1 -- 172.21.15.78:0/1291420083 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v27) v1 ==== 104+0+11 (secure 0 0 0) 0x7fb140051730 con 0x7fb150156200 2023-11-28T19:59:57.946 INFO:teuthology.orchestra.run.smithi078.stdout:pg_num: 32 2023-11-28T19:59:57.947 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:57.942+0000 7fb157380640 1 -- 172.21.15.78:0/1291420083 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fb134066470 msgr2=0x7fb134068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:57.947 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:57.942+0000 7fb157380640 1 --2- 172.21.15.78:0/1291420083 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fb134066470 0x7fb134068930 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fb14c0079f0 tx=0x7fb14c008040 comp rx=0 tx=0).stop 2023-11-28T19:59:57.947 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:57.942+0000 7fb157380640 1 -- 172.21.15.78:0/1291420083 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb150156200 msgr2=0x7fb1501f47b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:57.947 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:57.942+0000 7fb157380640 1 --2- 172.21.15.78:0/1291420083 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb150156200 0x7fb1501f47b0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7fb14000d5f0 tx=0x7fb14000dab0 comp rx=0 tx=0).stop 2023-11-28T19:59:57.947 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:57.942+0000 7fb157380640 1 -- 172.21.15.78:0/1291420083 shutdown_connections 2023-11-28T19:59:57.947 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:57.942+0000 7fb157380640 1 --2- 172.21.15.78:0/1291420083 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fb134066470 0x7fb134068930 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:57.947 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:57.942+0000 7fb157380640 1 --2- 172.21.15.78:0/1291420083 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb15015bf70 0x7fb1501f4cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:57.947 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:57.942+0000 7fb157380640 1 --2- 172.21.15.78:0/1291420083 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb150156200 0x7fb1501f47b0 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:57.947 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:57.942+0000 7fb157380640 1 --2- 172.21.15.78:0/1291420083 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb1500c0e10 0x7fb150157af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:57.947 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:57.942+0000 7fb157380640 1 -- 172.21.15.78:0/1291420083 >> 172.21.15.78:0/1291420083 conn(0x7fb1500c59f0 msgr2=0x7fb15014c990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T19:59:57.947 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:57.942+0000 7fb157380640 1 -- 172.21.15.78:0/1291420083 shutdown_connections 2023-11-28T19:59:57.948 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:57.942+0000 7fb157380640 1 -- 172.21.15.78:0/1291420083 wait complete. 2023-11-28T19:59:57.964 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-28T19:59:58.106 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:58.102+0000 7f5a4ea9c640 1 Processor -- start 2023-11-28T19:59:58.106 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:58.102+0000 7f5a4ea9c640 1 -- start start 2023-11-28T19:59:58.107 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:58.106+0000 7f5a4ea9c640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f5a4806d840 0x7f5a480c43e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:58.107 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:58.106+0000 7f5a4ea9c640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5a48152910 con 0x7f5a4814fc30 2023-11-28T19:59:58.107 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:58.106+0000 7f5a4ea9c640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5a48152bf0 con 0x7f5a4814f850 2023-11-28T19:59:58.108 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:58.106+0000 7f5a4ea9c640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5a480c2240 con 0x7f5a4806d840 2023-11-28T19:59:58.108 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:58.106+0000 7f5a4c838640 1 --1- >> v1:172.21.15.179:6789/0 conn(0x7f5a4814f850 0x7f5a480aacf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.179:6789/0 says I am v1:172.21.15.78:37430/0 (socket says 172.21.15.78:37430) 2023-11-28T19:59:58.109 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:58.106+0000 7f5a4c838640 1 -- 172.21.15.78:0/188929871 learned_addr learned my addr 172.21.15.78:0/188929871 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-11-28T19:59:58.109 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:58.106+0000 7f5a4d039640 1 --2- 172.21.15.78:0/188929871 >> v2:172.21.15.78:3300/0 conn(0x7f5a4806d840 0x7f5a480c43e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:58.109 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:58.106+0000 7f5a477fe640 1 -- 172.21.15.78:0/188929871 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4253556117 0 0) 0x7f5a48152bf0 con 0x7f5a4814f850 2023-11-28T19:59:58.109 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:58.106+0000 7f5a477fe640 1 -- 172.21.15.78:0/188929871 --> v1:172.21.15.179:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5a38003530 con 0x7f5a4814f850 2023-11-28T19:59:58.109 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:58.106+0000 7f5a4d039640 1 -- 172.21.15.78:0/188929871 >> v1:172.21.15.179:6789/0 conn(0x7f5a4814f850 legacy=0x7f5a480aacf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:58.109 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:58.106+0000 7f5a4d039640 1 -- 172.21.15.78:0/188929871 >> v1:172.21.15.78:6789/0 conn(0x7f5a4814fc30 legacy=0x7f5a480c3cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:58.109 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:58.106+0000 7f5a4d039640 1 -- 172.21.15.78:0/188929871 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a48152ed0 con 0x7f5a4806d840 2023-11-28T19:59:58.111 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:58.110+0000 7f5a4d039640 1 --2- 172.21.15.78:0/188929871 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5a4806d840 0x7f5a480c43e0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f5a40009d90 tx=0x7f5a4001c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1930fb1358a3e9a1 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:59:58.113 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:58.110+0000 7f5a477fe640 1 -- 172.21.15.78:0/188929871 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a400a5a30 con 0x7f5a4806d840 2023-11-28T19:59:58.113 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:58.110+0000 7f5a477fe640 1 -- 172.21.15.78:0/188929871 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a400a5b90 con 0x7f5a4806d840 2023-11-28T19:59:58.113 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:58.110+0000 7f5a477fe640 1 -- 172.21.15.78:0/188929871 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a400ad440 con 0x7f5a4806d840 2023-11-28T19:59:58.113 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:58.110+0000 7f5a4ea9c640 1 -- 172.21.15.78:0/188929871 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5a4806d840 msgr2=0x7f5a480c43e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:58.113 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:58.110+0000 7f5a4ea9c640 1 --2- 172.21.15.78:0/188929871 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5a4806d840 0x7f5a480c43e0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f5a40009d90 tx=0x7f5a4001c950 comp rx=0 tx=0).stop 2023-11-28T19:59:58.113 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:58.110+0000 7f5a4ea9c640 1 -- 172.21.15.78:0/188929871 shutdown_connections 2023-11-28T19:59:58.113 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:58.110+0000 7f5a4ea9c640 1 --2- 172.21.15.78:0/188929871 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5a4806d840 0x7f5a480c43e0 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:58.113 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:58.110+0000 7f5a4ea9c640 1 -- 172.21.15.78:0/188929871 >> 172.21.15.78:0/188929871 conn(0x7f5a480c59f0 msgr2=0x7f5a480c5e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T19:59:58.113 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:58.110+0000 7f5a4ea9c640 1 -- 172.21.15.78:0/188929871 shutdown_connections 2023-11-28T19:59:58.114 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:58.110+0000 7f5a4ea9c640 1 -- 172.21.15.78:0/188929871 wait complete. 2023-11-28T19:59:58.114 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:58.110+0000 7f5a4ea9c640 1 Processor -- start 2023-11-28T19:59:58.114 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:58.110+0000 7f5a4ea9c640 1 -- start start 2023-11-28T19:59:58.117 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:58.114+0000 7f5a4ea9c640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5a4806d840 0x7f5a481477d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:58.117 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:58.114+0000 7f5a4ea9c640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5a4814f850 0x7f5a48147d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:58.117 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:58.114+0000 7f5a4ea9c640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5a4814fc30 0x7f5a481ee5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:58.117 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:58.114+0000 7f5a4ea9c640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a481565a0 con 0x7f5a4806d840 2023-11-28T19:59:58.117 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:58.114+0000 7f5a4ea9c640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a48070610 con 0x7f5a4814fc30 2023-11-28T19:59:58.117 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:58.114+0000 7f5a4ea9c640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5a48154170 con 0x7f5a4814f850 2023-11-28T19:59:58.118 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:58.114+0000 7f5a4c838640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5a4806d840 0x7f5a481477d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:58.118 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:58.114+0000 7f5a4c838640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5a4806d840 0x7f5a481477d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:49046/0 (socket says 172.21.15.78:49046) 2023-11-28T19:59:58.118 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:58.114+0000 7f5a4c838640 1 -- 172.21.15.78:0/2778018659 learned_addr learned my addr 172.21.15.78:0/2778018659 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T19:59:58.118 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:58.114+0000 7f5a4d039640 1 --2- 172.21.15.78:0/2778018659 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5a4814fc30 0x7f5a481ee5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:58.118 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:58.114+0000 7f5a47fff640 1 --2- 172.21.15.78:0/2778018659 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5a4814f850 0x7f5a48147d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:58.118 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:58.114+0000 7f5a4c838640 1 -- 172.21.15.78:0/2778018659 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5a4814f850 msgr2=0x7f5a48147d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:58.118 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:58.114+0000 7f5a4c838640 1 --2- 172.21.15.78:0/2778018659 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5a4814f850 0x7f5a48147d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:58.118 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:58.114+0000 7f5a4c838640 1 -- 172.21.15.78:0/2778018659 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5a4814fc30 msgr2=0x7f5a481ee5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:58.118 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:58.114+0000 7f5a4c838640 1 --2- 172.21.15.78:0/2778018659 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5a4814fc30 0x7f5a481ee5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:58.118 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:58.114+0000 7f5a4c838640 1 -- 172.21.15.78:0/2778018659 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a40009a70 con 0x7f5a4806d840 2023-11-28T19:59:58.118 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:58.114+0000 7f5a47fff640 1 --2- 172.21.15.78:0/2778018659 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5a4814f850 0x7f5a48147d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T19:59:58.119 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:58.114+0000 7f5a4c838640 1 --2- 172.21.15.78:0/2778018659 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5a4806d840 0x7f5a481477d0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f5a3c00c500 tx=0x7f5a3c00c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:59:58.119 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:58.114+0000 7f5a457fa640 1 -- 172.21.15.78:0/2778018659 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a3c005cf0 con 0x7f5a4806d840 2023-11-28T19:59:58.119 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:58.114+0000 7f5a457fa640 1 -- 172.21.15.78:0/2778018659 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a3c005e50 con 0x7f5a4806d840 2023-11-28T19:59:58.119 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:58.114+0000 7f5a4ea9c640 1 -- 172.21.15.78:0/2778018659 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5a48154410 con 0x7f5a4806d840 2023-11-28T19:59:58.119 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:58.114+0000 7f5a457fa640 1 -- 172.21.15.78:0/2778018659 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a3c0072f0 con 0x7f5a4806d840 2023-11-28T19:59:58.119 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:58.114+0000 7f5a4ea9c640 1 -- 172.21.15.78:0/2778018659 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5a480702a0 con 0x7f5a4806d840 2023-11-28T19:59:58.120 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:58.114+0000 7f5a4ea9c640 1 -- 172.21.15.78:0/2778018659 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5a48067630 con 0x7f5a4806d840 2023-11-28T19:59:58.120 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:58.118+0000 7f5a457fa640 1 -- 172.21.15.78:0/2778018659 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f5a3c007450 con 0x7f5a4806d840 2023-11-28T19:59:58.120 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:58.118+0000 7f5a457fa640 1 --2- 172.21.15.78:0/2778018659 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f5a2c066470 0x7f5a2c068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:58.121 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:58.118+0000 7f5a457fa640 1 -- 172.21.15.78:0/2778018659 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f5a3c0837d0 con 0x7f5a4806d840 2023-11-28T19:59:58.121 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:58.118+0000 7f5a47fff640 1 --2- 172.21.15.78:0/2778018659 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f5a2c066470 0x7f5a2c068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:58.121 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:58.118+0000 7f5a47fff640 1 --2- 172.21.15.78:0/2778018659 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f5a2c066470 0x7f5a2c068930 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f5a480bb5a0 tx=0x7f5a34009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:59:58.124 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:58.122+0000 7f5a457fa640 1 -- 172.21.15.78:0/2778018659 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f5a3c050930 con 0x7f5a4806d840 2023-11-28T19:59:58.276 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:58.274+0000 7f5a4ea9c640 1 -- 172.21.15.78:0/2778018659 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f5a480a4a90 con 0x7f5a4806d840 2023-11-28T19:59:58.276 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:58.274+0000 7f5a457fa640 1 -- 172.21.15.78:0/2778018659 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v27) v1 ==== 100+0+11 (secure 0 0 0) 0x7f5a3c053f50 con 0x7f5a4806d840 2023-11-28T19:59:58.276 INFO:teuthology.orchestra.run.smithi078.stdout:pg_num: 64 2023-11-28T19:59:58.278 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:58.274+0000 7f5a4ea9c640 1 -- 172.21.15.78:0/2778018659 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f5a2c066470 msgr2=0x7f5a2c068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:58.278 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:58.274+0000 7f5a4ea9c640 1 --2- 172.21.15.78:0/2778018659 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f5a2c066470 0x7f5a2c068930 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f5a480bb5a0 tx=0x7f5a34009040 comp rx=0 tx=0).stop 2023-11-28T19:59:58.278 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:58.274+0000 7f5a4ea9c640 1 -- 172.21.15.78:0/2778018659 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5a4806d840 msgr2=0x7f5a481477d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:58.279 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:58.274+0000 7f5a4ea9c640 1 --2- 172.21.15.78:0/2778018659 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5a4806d840 0x7f5a481477d0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f5a3c00c500 tx=0x7f5a3c00c9c0 comp rx=0 tx=0).stop 2023-11-28T19:59:58.279 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:58.274+0000 7f5a4ea9c640 1 -- 172.21.15.78:0/2778018659 shutdown_connections 2023-11-28T19:59:58.279 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:58.274+0000 7f5a4ea9c640 1 --2- 172.21.15.78:0/2778018659 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f5a2c066470 0x7f5a2c068930 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:58.279 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:58.274+0000 7f5a4ea9c640 1 --2- 172.21.15.78:0/2778018659 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5a4814f850 0x7f5a48147d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:58.279 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:58.274+0000 7f5a4ea9c640 1 --2- 172.21.15.78:0/2778018659 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5a4814fc30 0x7f5a481ee5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:58.279 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:58.274+0000 7f5a4ea9c640 1 --2- 172.21.15.78:0/2778018659 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5a4806d840 0x7f5a481477d0 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:58.279 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:58.274+0000 7f5a4ea9c640 1 -- 172.21.15.78:0/2778018659 >> 172.21.15.78:0/2778018659 conn(0x7f5a480c59f0 msgr2=0x7f5a4814ef10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T19:59:58.280 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:58.274+0000 7f5a4ea9c640 1 -- 172.21.15.78:0/2778018659 shutdown_connections 2023-11-28T19:59:58.280 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:58.274+0000 7f5a4ea9c640 1 -- 172.21.15.78:0/2778018659 wait complete. 2023-11-28T19:59:58.297 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-11-28T19:59:58.437 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:58.434+0000 7f1ddaf1d640 1 Processor -- start 2023-11-28T19:59:58.437 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:58.434+0000 7f1ddaf1d640 1 -- start start 2023-11-28T19:59:58.438 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:58.434+0000 7f1ddaf1d640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f1dd414b1e0 0x7f1dd40c1700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:58.438 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:58.434+0000 7f1ddaf1d640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1dd40c5300 0x7f1dd40a9c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:58.438 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:58.434+0000 7f1ddaf1d640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1dd40a4e20 con 0x7f1dd4151280 2023-11-28T19:59:58.438 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:58.434+0000 7f1ddaf1d640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1dd41558d0 con 0x7f1dd414b1e0 2023-11-28T19:59:58.438 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:58.434+0000 7f1ddaf1d640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1dd40a50e0 con 0x7f1dd40c5300 2023-11-28T19:59:58.439 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:58.434+0000 7f1dcbfff640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1dd40c5300 0x7f1dd40a9c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:58.439 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:58.434+0000 7f1dd8cb9640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f1dd414b1e0 0x7f1dd40c1700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:58.439 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:58.434+0000 7f1dd94ba640 1 --1- >> v1:172.21.15.179:6789/0 conn(0x7f1dd4151280 0x7f1dd4151710 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.179:6789/0 says I am v1:172.21.15.78:37442/0 (socket says 172.21.15.78:37442) 2023-11-28T19:59:58.440 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:58.434+0000 7f1dd94ba640 1 -- 172.21.15.78:0/218037407 learned_addr learned my addr 172.21.15.78:0/218037407 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-11-28T19:59:58.440 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:58.438+0000 7f1dcbfff640 1 -- 172.21.15.78:0/218037407 >> v2:172.21.15.179:3300/0 conn(0x7f1dd414b1e0 msgr2=0x7f1dd40c1700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T19:59:58.440 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:58.438+0000 7f1dcbfff640 1 --2- 172.21.15.78:0/218037407 >> v2:172.21.15.179:3300/0 conn(0x7f1dd414b1e0 0x7f1dd40c1700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:58.440 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:58.438+0000 7f1dcbfff640 1 -- 172.21.15.78:0/218037407 >> v1:172.21.15.179:6789/0 conn(0x7f1dd4151280 legacy=0x7f1dd4151710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:58.440 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:58.438+0000 7f1dcbfff640 1 -- 172.21.15.78:0/218037407 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1dd40c0f00 con 0x7f1dd40c5300 2023-11-28T19:59:58.442 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:58.438+0000 7f1dcbfff640 1 --2- 172.21.15.78:0/218037407 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1dd40c5300 0x7f1dd40a9c30 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f1dc40097c0 tx=0x7f1dc401e690 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2682046729d6a592 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:59:58.442 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:58.438+0000 7f1dcb7fe640 1 -- 172.21.15.78:0/218037407 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1dc40ac610 con 0x7f1dd40c5300 2023-11-28T19:59:58.442 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:58.438+0000 7f1dcb7fe640 1 -- 172.21.15.78:0/218037407 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1dc40a8040 con 0x7f1dd40c5300 2023-11-28T19:59:58.443 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:58.438+0000 7f1dcb7fe640 1 -- 172.21.15.78:0/218037407 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1dc40ac990 con 0x7f1dd40c5300 2023-11-28T19:59:58.443 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:58.438+0000 7f1ddaf1d640 1 -- 172.21.15.78:0/218037407 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1dd40c5300 msgr2=0x7f1dd40a9c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:58.443 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:58.438+0000 7f1ddaf1d640 1 --2- 172.21.15.78:0/218037407 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1dd40c5300 0x7f1dd40a9c30 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f1dc40097c0 tx=0x7f1dc401e690 comp rx=0 tx=0).stop 2023-11-28T19:59:58.443 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:58.438+0000 7f1ddaf1d640 1 -- 172.21.15.78:0/218037407 shutdown_connections 2023-11-28T19:59:58.444 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:58.438+0000 7f1ddaf1d640 1 --2- 172.21.15.78:0/218037407 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1dd40c5300 0x7f1dd40a9c30 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:58.444 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:58.438+0000 7f1ddaf1d640 1 --2- 172.21.15.78:0/218037407 >> v2:172.21.15.179:3300/0 conn(0x7f1dd414b1e0 0x7f1dd40c1700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:58.444 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:58.438+0000 7f1ddaf1d640 1 -- 172.21.15.78:0/218037407 >> 172.21.15.78:0/218037407 conn(0x7f1dd40c59f0 msgr2=0x7f1dd40c5e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T19:59:58.444 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:58.438+0000 7f1ddaf1d640 1 -- 172.21.15.78:0/218037407 shutdown_connections 2023-11-28T19:59:58.444 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:58.438+0000 7f1ddaf1d640 1 -- 172.21.15.78:0/218037407 wait complete. 2023-11-28T19:59:58.445 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:58.442+0000 7f1ddaf1d640 1 Processor -- start 2023-11-28T19:59:58.445 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:58.442+0000 7f1ddaf1d640 1 -- start start 2023-11-28T19:59:58.447 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:58.442+0000 7f1ddaf1d640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1dd40c5300 0x7f1dd41f0eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:58.447 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:58.442+0000 7f1ddaf1d640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1dd414b1e0 0x7f1dd40a65d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:58.447 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:58.442+0000 7f1ddaf1d640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1dd4151280 0x7f1dd41ece00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:58.447 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:58.442+0000 7f1ddaf1d640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1dd41f0410 con 0x7f1dd4151280 2023-11-28T19:59:58.447 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:58.442+0000 7f1ddaf1d640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1dd4072820 con 0x7f1dd414b1e0 2023-11-28T19:59:58.447 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:58.442+0000 7f1ddaf1d640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1dd41f06b0 con 0x7f1dd40c5300 2023-11-28T19:59:58.447 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:58.442+0000 7f1dd94ba640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1dd4151280 0x7f1dd41ece00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:58.448 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:58.442+0000 7f1dcbfff640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1dd414b1e0 0x7f1dd40a65d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:58.448 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:58.442+0000 7f1dd94ba640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1dd4151280 0x7f1dd41ece00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:49056/0 (socket says 172.21.15.78:49056) 2023-11-28T19:59:58.448 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:58.442+0000 7f1dd94ba640 1 -- 172.21.15.78:0/883043716 learned_addr learned my addr 172.21.15.78:0/883043716 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T19:59:58.448 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:58.442+0000 7f1dd8cb9640 1 --2- 172.21.15.78:0/883043716 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1dd40c5300 0x7f1dd41f0eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:58.448 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:58.442+0000 7f1dcbfff640 1 -- 172.21.15.78:0/883043716 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1dd40c5300 msgr2=0x7f1dd41f0eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:58.448 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:58.442+0000 7f1dcbfff640 1 --2- 172.21.15.78:0/883043716 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1dd40c5300 0x7f1dd41f0eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:58.448 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:58.442+0000 7f1dcbfff640 1 -- 172.21.15.78:0/883043716 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1dd4151280 msgr2=0x7f1dd41ece00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:58.448 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:58.442+0000 7f1dcbfff640 1 --2- 172.21.15.78:0/883043716 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1dd4151280 0x7f1dd41ece00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:58.448 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:58.442+0000 7f1dcbfff640 1 -- 172.21.15.78:0/883043716 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1dc4009420 con 0x7f1dd414b1e0 2023-11-28T19:59:58.448 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:58.442+0000 7f1dd94ba640 1 --2- 172.21.15.78:0/883043716 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1dd4151280 0x7f1dd41ece00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T19:59:58.448 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:58.442+0000 7f1dcbfff640 1 --2- 172.21.15.78:0/883043716 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1dd414b1e0 0x7f1dd40a65d0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f1dc40ad000 tx=0x7f1dc401ced0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:59:58.449 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:58.446+0000 7f1dc97fa640 1 -- 172.21.15.78:0/883043716 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1dc40b5620 con 0x7f1dd414b1e0 2023-11-28T19:59:58.449 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:58.446+0000 7f1dc97fa640 1 -- 172.21.15.78:0/883043716 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1dc40b57c0 con 0x7f1dd414b1e0 2023-11-28T19:59:58.449 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:58.446+0000 7f1dc97fa640 1 -- 172.21.15.78:0/883043716 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1dc40b5b70 con 0x7f1dd414b1e0 2023-11-28T19:59:58.449 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:58.446+0000 7f1ddaf1d640 1 -- 172.21.15.78:0/883043716 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1dd41f0990 con 0x7f1dd414b1e0 2023-11-28T19:59:58.449 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:58.446+0000 7f1ddaf1d640 1 -- 172.21.15.78:0/883043716 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1dd4072b00 con 0x7f1dd414b1e0 2023-11-28T19:59:58.450 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:58.446+0000 7f1ddaf1d640 1 -- 172.21.15.78:0/883043716 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1dd41f0b80 con 0x7f1dd414b1e0 2023-11-28T19:59:58.450 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:58.446+0000 7f1dc97fa640 1 -- 172.21.15.78:0/883043716 <== mon.1 v2:172.21.15.179:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f1dc40b5cd0 con 0x7f1dd414b1e0 2023-11-28T19:59:58.450 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:58.446+0000 7f1dc97fa640 1 --2- 172.21.15.78:0/883043716 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f1dc00664c0 0x7f1dc0068980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:58.451 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:58.446+0000 7f1dc97fa640 1 -- 172.21.15.78:0/883043716 <== mon.1 v2:172.21.15.179:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f1dc411eba0 con 0x7f1dd414b1e0 2023-11-28T19:59:58.451 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:58.446+0000 7f1dd8cb9640 1 --2- 172.21.15.78:0/883043716 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f1dc00664c0 0x7f1dc0068980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:58.452 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:58.450+0000 7f1dd8cb9640 1 --2- 172.21.15.78:0/883043716 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f1dc00664c0 0x7f1dc0068980 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f1dd0009b60 tx=0x7f1dd0009190 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:59:58.454 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:58.450+0000 7f1dc97fa640 1 -- 172.21.15.78:0/883043716 <== mon.1 v2:172.21.15.179:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f1dc40ebd80 con 0x7f1dd414b1e0 2023-11-28T19:59:58.603 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:58.598+0000 7f1ddaf1d640 1 -- 172.21.15.78:0/883043716 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f1dd4067630 con 0x7f1dd414b1e0 2023-11-28T19:59:58.604 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:58.602+0000 7f1dc97fa640 1 -- 172.21.15.78:0/883043716 <== mon.1 v2:172.21.15.179:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v27) v1 ==== 103+0+11 (secure 0 0 0) 0x7f1dc40bb0a0 con 0x7f1dd414b1e0 2023-11-28T19:59:58.604 INFO:teuthology.orchestra.run.smithi078.stdout:pg_num: 32 2023-11-28T19:59:58.606 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:58.602+0000 7f1ddaf1d640 1 -- 172.21.15.78:0/883043716 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f1dc00664c0 msgr2=0x7f1dc0068980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:58.607 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:58.602+0000 7f1ddaf1d640 1 --2- 172.21.15.78:0/883043716 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f1dc00664c0 0x7f1dc0068980 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f1dd0009b60 tx=0x7f1dd0009190 comp rx=0 tx=0).stop 2023-11-28T19:59:58.607 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:58.602+0000 7f1ddaf1d640 1 -- 172.21.15.78:0/883043716 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1dd414b1e0 msgr2=0x7f1dd40a65d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:58.607 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:58.602+0000 7f1ddaf1d640 1 --2- 172.21.15.78:0/883043716 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1dd414b1e0 0x7f1dd40a65d0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f1dc40ad000 tx=0x7f1dc401ced0 comp rx=0 tx=0).stop 2023-11-28T19:59:58.607 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:58.602+0000 7f1ddaf1d640 1 -- 172.21.15.78:0/883043716 shutdown_connections 2023-11-28T19:59:58.607 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:58.602+0000 7f1ddaf1d640 1 --2- 172.21.15.78:0/883043716 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f1dc00664c0 0x7f1dc0068980 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:58.607 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:58.602+0000 7f1ddaf1d640 1 --2- 172.21.15.78:0/883043716 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1dd4151280 0x7f1dd41ece00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:58.607 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:58.602+0000 7f1ddaf1d640 1 --2- 172.21.15.78:0/883043716 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1dd414b1e0 0x7f1dd40a65d0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:58.608 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:58.602+0000 7f1ddaf1d640 1 --2- 172.21.15.78:0/883043716 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1dd40c5300 0x7f1dd41f0eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:58.608 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:58.602+0000 7f1ddaf1d640 1 -- 172.21.15.78:0/883043716 >> 172.21.15.78:0/883043716 conn(0x7f1dd40c59f0 msgr2=0x7f1dd4151710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T19:59:58.608 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:58.602+0000 7f1ddaf1d640 1 -- 172.21.15.78:0/883043716 shutdown_connections 2023-11-28T19:59:58.608 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:58.602+0000 7f1ddaf1d640 1 -- 172.21.15.78:0/883043716 wait complete. 2023-11-28T19:59:58.625 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-28T19:59:58.762 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:58.758+0000 7f63bd4bb640 1 Processor -- start 2023-11-28T19:59:58.763 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:58.758+0000 7f63bd4bb640 1 -- start start 2023-11-28T19:59:58.764 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:58.762+0000 7f63bd4bb640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f63b814fd10 0x7f63b80a4dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:58.764 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:58.762+0000 7f63bd4bb640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f63b80a5300 0x7f63b8071e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:58.764 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:58.762+0000 7f63bd4bb640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f63b80c5710 con 0x7f63b8072370 2023-11-28T19:59:58.764 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:58.762+0000 7f63bd4bb640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f63b806c5e0 con 0x7f63b814fd10 2023-11-28T19:59:58.764 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:58.762+0000 7f63bd4bb640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f63b8155c80 con 0x7f63b80a5300 2023-11-28T19:59:58.765 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:58.762+0000 7f63ae7fc640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f63b80a5300 0x7f63b8071e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:58.765 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:58.762+0000 7f63b6ffd640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f63b814fd10 0x7f63b80a4dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:58.765 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:58.762+0000 7f63ae7fc640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f63b80a5300 0x7f63b8071e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3301/0 says I am v2:172.21.15.78:36718/0 (socket says 172.21.15.78:36718) 2023-11-28T19:59:58.765 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:58.762+0000 7f63ae7fc640 1 -- 172.21.15.78:0/808969423 learned_addr learned my addr 172.21.15.78:0/808969423 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T19:59:58.765 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:58.762+0000 7f63ae7fc640 1 -- 172.21.15.78:0/808969423 >> v2:172.21.15.179:3300/0 conn(0x7f63b814fd10 msgr2=0x7f63b80a4dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T19:59:58.766 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:58.762+0000 7f63ae7fc640 1 --2- 172.21.15.78:0/808969423 >> v2:172.21.15.179:3300/0 conn(0x7f63b814fd10 0x7f63b80a4dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:58.766 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:58.762+0000 7f63ae7fc640 1 -- 172.21.15.78:0/808969423 >> v1:172.21.15.179:6789/0 conn(0x7f63b8072370 legacy=0x7f63b8156110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:58.766 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:58.762+0000 7f63ae7fc640 1 -- 172.21.15.78:0/808969423 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63b80c4e70 con 0x7f63b80a5300 2023-11-28T19:59:58.767 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:58.766+0000 7f63ae7fc640 1 --2- 172.21.15.78:0/808969423 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f63b80a5300 0x7f63b8071e30 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f63a0009870 tx=0x7f63a001c3f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=eafe0972ec48576c server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:59:58.768 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:58.766+0000 7f63b67fc640 1 -- 172.21.15.78:0/808969423 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63a00ab5f0 con 0x7f63b80a5300 2023-11-28T19:59:58.768 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:58.766+0000 7f63b67fc640 1 -- 172.21.15.78:0/808969423 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f63a00ab750 con 0x7f63b80a5300 2023-11-28T19:59:58.768 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:58.766+0000 7f63b67fc640 1 -- 172.21.15.78:0/808969423 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63a00abae0 con 0x7f63b80a5300 2023-11-28T19:59:58.769 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:58.766+0000 7f63bd4bb640 1 -- 172.21.15.78:0/808969423 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f63b80a5300 msgr2=0x7f63b8071e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:58.769 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:58.766+0000 7f63bd4bb640 1 --2- 172.21.15.78:0/808969423 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f63b80a5300 0x7f63b8071e30 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f63a0009870 tx=0x7f63a001c3f0 comp rx=0 tx=0).stop 2023-11-28T19:59:58.769 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:58.766+0000 7f63bd4bb640 1 -- 172.21.15.78:0/808969423 shutdown_connections 2023-11-28T19:59:58.769 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:58.766+0000 7f63bd4bb640 1 --2- 172.21.15.78:0/808969423 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f63b80a5300 0x7f63b8071e30 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:58.769 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:58.766+0000 7f63bd4bb640 1 --2- 172.21.15.78:0/808969423 >> v2:172.21.15.179:3300/0 conn(0x7f63b814fd10 0x7f63b80a4dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:58.769 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:58.766+0000 7f63bd4bb640 1 -- 172.21.15.78:0/808969423 >> 172.21.15.78:0/808969423 conn(0x7f63b80a7810 msgr2=0x7f63b80a7c20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T19:59:58.769 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:58.766+0000 7f63bd4bb640 1 -- 172.21.15.78:0/808969423 shutdown_connections 2023-11-28T19:59:58.769 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:58.766+0000 7f63bd4bb640 1 -- 172.21.15.78:0/808969423 wait complete. 2023-11-28T19:59:58.770 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:58.766+0000 7f63bd4bb640 1 Processor -- start 2023-11-28T19:59:58.770 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:58.766+0000 7f63bd4bb640 1 -- start start 2023-11-28T19:59:58.772 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:58.770+0000 7f63bd4bb640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f63b8072370 0x7f63b80bf0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:58.772 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:58.770+0000 7f63bd4bb640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f63b80a5300 0x7f63b81ed4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:58.772 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:58.770+0000 7f63bd4bb640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f63b814fd10 0x7f63b81eda30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:58.772 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:58.770+0000 7f63bd4bb640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63b815c4f0 con 0x7f63b80a5300 2023-11-28T19:59:58.773 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:58.770+0000 7f63bd4bb640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63b81ecf10 con 0x7f63b814fd10 2023-11-28T19:59:58.773 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:58.770+0000 7f63bd4bb640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f63b806fd50 con 0x7f63b8072370 2023-11-28T19:59:58.773 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:58.770+0000 7f63ae7fc640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f63b80a5300 0x7f63b81ed4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:58.773 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:58.770+0000 7f63ae7fc640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f63b80a5300 0x7f63b81ed4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:49072/0 (socket says 172.21.15.78:49072) 2023-11-28T19:59:58.773 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:58.770+0000 7f63ae7fc640 1 -- 172.21.15.78:0/2004398133 learned_addr learned my addr 172.21.15.78:0/2004398133 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T19:59:58.773 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:58.770+0000 7f63b6ffd640 1 --2- 172.21.15.78:0/2004398133 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f63b8072370 0x7f63b80bf0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:58.773 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:58.770+0000 7f63b77fe640 1 --2- 172.21.15.78:0/2004398133 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f63b814fd10 0x7f63b81eda30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:58.773 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:58.770+0000 7f63ae7fc640 1 -- 172.21.15.78:0/2004398133 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f63b8072370 msgr2=0x7f63b80bf0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:58.773 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:58.770+0000 7f63ae7fc640 1 --2- 172.21.15.78:0/2004398133 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f63b8072370 0x7f63b80bf0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:58.773 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:58.770+0000 7f63ae7fc640 1 -- 172.21.15.78:0/2004398133 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f63b814fd10 msgr2=0x7f63b81eda30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:58.774 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:58.770+0000 7f63ae7fc640 1 --2- 172.21.15.78:0/2004398133 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f63b814fd10 0x7f63b81eda30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:58.774 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:58.770+0000 7f63ae7fc640 1 -- 172.21.15.78:0/2004398133 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63a00094d0 con 0x7f63b80a5300 2023-11-28T19:59:58.774 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:58.770+0000 7f63ae7fc640 1 --2- 172.21.15.78:0/2004398133 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f63b80a5300 0x7f63b81ed4f0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f63a00ad040 tx=0x7f63a001ac30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:59:58.774 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:58.770+0000 7f63affff640 1 -- 172.21.15.78:0/2004398133 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63a00be5f0 con 0x7f63b80a5300 2023-11-28T19:59:58.775 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:58.770+0000 7f63affff640 1 -- 172.21.15.78:0/2004398133 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f63a00be770 con 0x7f63b80a5300 2023-11-28T19:59:58.775 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:58.770+0000 7f63affff640 1 -- 172.21.15.78:0/2004398133 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63a00beb20 con 0x7f63b80a5300 2023-11-28T19:59:58.775 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:58.770+0000 7f63bd4bb640 1 -- 172.21.15.78:0/2004398133 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f63b8070030 con 0x7f63b80a5300 2023-11-28T19:59:58.775 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:58.770+0000 7f63bd4bb640 1 -- 172.21.15.78:0/2004398133 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f63b814f560 con 0x7f63b80a5300 2023-11-28T19:59:58.775 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:58.770+0000 7f63bd4bb640 1 -- 172.21.15.78:0/2004398133 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f63b8067630 con 0x7f63b80a5300 2023-11-28T19:59:58.775 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:58.770+0000 7f63affff640 1 -- 172.21.15.78:0/2004398133 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f63a00b43f0 con 0x7f63b80a5300 2023-11-28T19:59:58.776 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:58.774+0000 7f63affff640 1 --2- 172.21.15.78:0/2004398133 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f6398066470 0x7f6398068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:58.776 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:58.774+0000 7f63affff640 1 -- 172.21.15.78:0/2004398133 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f63a00a8050 con 0x7f63b80a5300 2023-11-28T19:59:58.776 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:58.774+0000 7f63b6ffd640 1 --2- 172.21.15.78:0/2004398133 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f6398066470 0x7f6398068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:58.777 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:58.774+0000 7f63b6ffd640 1 --2- 172.21.15.78:0/2004398133 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f6398066470 0x7f6398068930 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f63b80a7760 tx=0x7f63a800b040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:59:58.780 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:58.778+0000 7f63affff640 1 -- 172.21.15.78:0/2004398133 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f63a00ec1c0 con 0x7f63b80a5300 2023-11-28T19:59:58.961 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:58.958+0000 7f63bd4bb640 1 -- 172.21.15.78:0/2004398133 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f63b815cc30 con 0x7f63b80a5300 2023-11-28T19:59:58.962 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:58.958+0000 7f63affff640 1 -- 172.21.15.78:0/2004398133 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4915 (secure 0 0 0) 0x7f63a00ef7e0 con 0x7f63b80a5300 2023-11-28T19:59:58.962 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-11-28T19:59:58.962 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4241,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6835/3089461479","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6833","nonce":3089461479},{"type":"v1","addr":"172.21.15.179:6835","nonce":3089461479}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4258,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6837/3153162191","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6834","nonce":3153162191},{"type":"v1","addr":"172.21.15.78:6837","nonce":3153162191}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4266,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6836/3073967897","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6835","nonce":3073967897},{"type":"v1","addr":"172.21.15.78:6836","nonce":3073967897}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-28T19:59:05.411488+0000","modified":"2023-11-28T19:59:23.150979+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4275},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4275":{"gid":4275,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.179:6834/1234044491","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6832","nonce":1234044491},{"type":"v1","addr":"172.21.15.179:6834","nonce":1234044491}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-11-28T19:59:58.963 INFO:teuthology.orchestra.run.smithi078.stderr:dumped fsmap epoch 9 2023-11-28T19:59:58.964 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:58.962+0000 7f63bd4bb640 1 -- 172.21.15.78:0/2004398133 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f6398066470 msgr2=0x7f6398068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:58.964 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:58.962+0000 7f63bd4bb640 1 --2- 172.21.15.78:0/2004398133 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f6398066470 0x7f6398068930 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f63b80a7760 tx=0x7f63a800b040 comp rx=0 tx=0).stop 2023-11-28T19:59:58.964 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:58.962+0000 7f63bd4bb640 1 -- 172.21.15.78:0/2004398133 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f63b80a5300 msgr2=0x7f63b81ed4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:58.964 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:58.962+0000 7f63bd4bb640 1 --2- 172.21.15.78:0/2004398133 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f63b80a5300 0x7f63b81ed4f0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f63a00ad040 tx=0x7f63a001ac30 comp rx=0 tx=0).stop 2023-11-28T19:59:58.964 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:58.962+0000 7f63bd4bb640 1 -- 172.21.15.78:0/2004398133 shutdown_connections 2023-11-28T19:59:58.964 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:58.962+0000 7f63bd4bb640 1 --2- 172.21.15.78:0/2004398133 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f6398066470 0x7f6398068930 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:58.965 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:58.962+0000 7f63bd4bb640 1 --2- 172.21.15.78:0/2004398133 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f63b814fd10 0x7f63b81eda30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:58.965 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:58.962+0000 7f63bd4bb640 1 --2- 172.21.15.78:0/2004398133 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f63b80a5300 0x7f63b81ed4f0 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:58.965 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:58.962+0000 7f63bd4bb640 1 --2- 172.21.15.78:0/2004398133 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f63b8072370 0x7f63b80bf0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:58.965 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:58.962+0000 7f63bd4bb640 1 -- 172.21.15.78:0/2004398133 >> 172.21.15.78:0/2004398133 conn(0x7f63b80a7810 msgr2=0x7f63b8147f30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T19:59:58.965 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:58.962+0000 7f63bd4bb640 1 -- 172.21.15.78:0/2004398133 shutdown_connections 2023-11-28T19:59:58.965 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:58.962+0000 7f63bd4bb640 1 -- 172.21.15.78:0/2004398133 wait complete. 2023-11-28T19:59:58.983 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-28T19:59:59.121 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:59.118+0000 7f95bd279640 1 Processor -- start 2023-11-28T19:59:59.121 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:59.118+0000 7f95bd279640 1 -- start start 2023-11-28T19:59:59.123 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:59.118+0000 7f95bd279640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f95b8151e80 0x7f95b8072850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:59.123 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:59.118+0000 7f95bd279640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f95b80a6370 0x7f95b80c0010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:59.123 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:59.118+0000 7f95bd279640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f95b80c0550 0x7f95b8154520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:59.123 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:59.118+0000 7f95bd279640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f95b80a67b0 con 0x7f95b80c0550 2023-11-28T19:59:59.123 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:59.118+0000 7f95bd279640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f95b8070d30 con 0x7f95b8151e80 2023-11-28T19:59:59.123 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:59.118+0000 7f95bd279640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95b806b060 con 0x7f95b80a6370 2023-11-28T19:59:59.123 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:59.118+0000 7f95b77fe640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f95b80c0550 0x7f95b8154520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:59.124 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:59.118+0000 7f95b77fe640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f95b80c0550 0x7f95b8154520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:49078/0 (socket says 172.21.15.78:49078) 2023-11-28T19:59:59.124 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:59.118+0000 7f95b77fe640 1 -- 172.21.15.78:0/405376364 learned_addr learned my addr 172.21.15.78:0/405376364 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T19:59:59.124 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:59.118+0000 7f95ae7fc640 1 --2- 172.21.15.78:0/405376364 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f95b80a6370 0x7f95b80c0010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:59.124 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:59.118+0000 7f95b6ffd640 1 --2- 172.21.15.78:0/405376364 >> v2:172.21.15.179:3300/0 conn(0x7f95b8151e80 0x7f95b8072850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:59.124 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:59.118+0000 7f95b77fe640 1 -- 172.21.15.78:0/405376364 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f95b80a6370 msgr2=0x7f95b80c0010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T19:59:59.124 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:59.118+0000 7f95b77fe640 1 --2- 172.21.15.78:0/405376364 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f95b80a6370 0x7f95b80c0010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:59.124 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:59.118+0000 7f95b77fe640 1 -- 172.21.15.78:0/405376364 >> v2:172.21.15.179:3300/0 conn(0x7f95b8151e80 msgr2=0x7f95b8072850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T19:59:59.124 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:59.118+0000 7f95b77fe640 1 --2- 172.21.15.78:0/405376364 >> v2:172.21.15.179:3300/0 conn(0x7f95b8151e80 0x7f95b8072850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:59.124 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:59.118+0000 7f95b77fe640 1 -- 172.21.15.78:0/405376364 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95b806b300 con 0x7f95b80c0550 2023-11-28T19:59:59.124 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:59.118+0000 7f95b6ffd640 1 --2- 172.21.15.78:0/405376364 >> v2:172.21.15.179:3300/0 conn(0x7f95b8151e80 0x7f95b8072850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T19:59:59.124 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:59.118+0000 7f95ae7fc640 1 --2- 172.21.15.78:0/405376364 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f95b80a6370 0x7f95b80c0010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T19:59:59.125 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:59.122+0000 7f95b77fe640 1 --2- 172.21.15.78:0/405376364 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f95b80c0550 0x7f95b8154520 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f95b80c1140 tx=0x7f95b001c500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e703c850b69cd7de server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:59:59.126 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:59.122+0000 7f95b67fc640 1 -- 172.21.15.78:0/405376364 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95b00ac630 con 0x7f95b80c0550 2023-11-28T19:59:59.126 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:59.122+0000 7f95b67fc640 1 -- 172.21.15.78:0/405376364 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f95b00ac790 con 0x7f95b80c0550 2023-11-28T19:59:59.126 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:59.122+0000 7f95b67fc640 1 -- 172.21.15.78:0/405376364 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95b00acb20 con 0x7f95b80c0550 2023-11-28T19:59:59.126 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:59.122+0000 7f95bd279640 1 -- 172.21.15.78:0/405376364 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f95b80c0550 msgr2=0x7f95b8154520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:59.126 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:59.122+0000 7f95bd279640 1 --2- 172.21.15.78:0/405376364 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f95b80c0550 0x7f95b8154520 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f95b80c1140 tx=0x7f95b001c500 comp rx=0 tx=0).stop 2023-11-28T19:59:59.127 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:59.122+0000 7f95bd279640 1 -- 172.21.15.78:0/405376364 shutdown_connections 2023-11-28T19:59:59.127 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:59.122+0000 7f95bd279640 1 --2- 172.21.15.78:0/405376364 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f95b80c0550 0x7f95b8154520 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:59.127 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:59.122+0000 7f95bd279640 1 --2- 172.21.15.78:0/405376364 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f95b80a6370 0x7f95b80c0010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:59.128 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:59.122+0000 7f95bd279640 1 --2- 172.21.15.78:0/405376364 >> v2:172.21.15.179:3300/0 conn(0x7f95b8151e80 0x7f95b8072850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:59.128 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:59.122+0000 7f95bd279640 1 -- 172.21.15.78:0/405376364 >> 172.21.15.78:0/405376364 conn(0x7f95b80a8990 msgr2=0x7f95b80a8da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T19:59:59.128 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:59.122+0000 7f95bd279640 1 -- 172.21.15.78:0/405376364 shutdown_connections 2023-11-28T19:59:59.128 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:59.122+0000 7f95bd279640 1 -- 172.21.15.78:0/405376364 wait complete. 2023-11-28T19:59:59.129 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:59.126+0000 7f95bd279640 1 Processor -- start 2023-11-28T19:59:59.129 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:59.126+0000 7f95bd279640 1 -- start start 2023-11-28T19:59:59.131 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:59.126+0000 7f95bd279640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f95b80a6370 0x7f95b814dde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:59.131 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:59.126+0000 7f95bd279640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f95b80c0550 0x7f95b81f0470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:59.131 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:59.126+0000 7f95bd279640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f95b8151e80 0x7f95b81f09b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:59.132 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:59.126+0000 7f95bd279640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95b81effe0 con 0x7f95b80c0550 2023-11-28T19:59:59.132 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:59.126+0000 7f95bd279640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95b80aa5a0 con 0x7f95b8151e80 2023-11-28T19:59:59.133 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:59.126+0000 7f95bd279640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95b814ada0 con 0x7f95b80a6370 2023-11-28T19:59:59.133 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:59.126+0000 7f95ae7fc640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f95b80c0550 0x7f95b81f0470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:59.133 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:59.126+0000 7f95ae7fc640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f95b80c0550 0x7f95b81f0470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:49082/0 (socket says 172.21.15.78:49082) 2023-11-28T19:59:59.133 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:59.126+0000 7f95ae7fc640 1 -- 172.21.15.78:0/3381036586 learned_addr learned my addr 172.21.15.78:0/3381036586 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T19:59:59.133 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:59.126+0000 7f95b6ffd640 1 --2- 172.21.15.78:0/3381036586 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f95b80a6370 0x7f95b814dde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:59.133 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:59.126+0000 7f95b77fe640 1 --2- 172.21.15.78:0/3381036586 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f95b8151e80 0x7f95b81f09b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:59.133 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:59.126+0000 7f95ae7fc640 1 -- 172.21.15.78:0/3381036586 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f95b80a6370 msgr2=0x7f95b814dde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:59.133 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:59.126+0000 7f95ae7fc640 1 --2- 172.21.15.78:0/3381036586 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f95b80a6370 0x7f95b814dde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:59.133 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:59.126+0000 7f95ae7fc640 1 -- 172.21.15.78:0/3381036586 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f95b8151e80 msgr2=0x7f95b81f09b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:59.133 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:59.126+0000 7f95ae7fc640 1 --2- 172.21.15.78:0/3381036586 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f95b8151e80 0x7f95b81f09b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:59.133 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:59.126+0000 7f95ae7fc640 1 -- 172.21.15.78:0/3381036586 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95b00094d0 con 0x7f95b80c0550 2023-11-28T19:59:59.134 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:59.126+0000 7f95b6ffd640 1 --2- 172.21.15.78:0/3381036586 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f95b80a6370 0x7f95b814dde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T19:59:59.134 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:59.126+0000 7f95ae7fc640 1 --2- 172.21.15.78:0/3381036586 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f95b80c0550 0x7f95b81f0470 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f95a000c820 tx=0x7f95a000cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:59:59.134 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:59.126+0000 7f95affff640 1 -- 172.21.15.78:0/3381036586 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95a0004230 con 0x7f95b80c0550 2023-11-28T19:59:59.134 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:59.126+0000 7f95affff640 1 -- 172.21.15.78:0/3381036586 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f95a0004390 con 0x7f95b80c0550 2023-11-28T19:59:59.134 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:59.126+0000 7f95affff640 1 -- 172.21.15.78:0/3381036586 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95a0007a50 con 0x7f95b80c0550 2023-11-28T19:59:59.134 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:59.126+0000 7f95bd279640 1 -- 172.21.15.78:0/3381036586 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f95b814b080 con 0x7f95b80c0550 2023-11-28T19:59:59.134 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:59.126+0000 7f95bd279640 1 -- 172.21.15.78:0/3381036586 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f95b814e320 con 0x7f95b80c0550 2023-11-28T19:59:59.135 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:59.130+0000 7f95bd279640 1 -- 172.21.15.78:0/3381036586 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f95b81f0190 con 0x7f95b80c0550 2023-11-28T19:59:59.135 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:59.130+0000 7f95affff640 1 -- 172.21.15.78:0/3381036586 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f95a0007bb0 con 0x7f95b80c0550 2023-11-28T19:59:59.135 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:59.130+0000 7f95affff640 1 --2- 172.21.15.78:0/3381036586 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f9598066470 0x7f9598068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:59.135 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:59.130+0000 7f95affff640 1 -- 172.21.15.78:0/3381036586 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f95a0084160 con 0x7f95b80c0550 2023-11-28T19:59:59.135 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:59.130+0000 7f95b6ffd640 1 --2- 172.21.15.78:0/3381036586 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f9598066470 0x7f9598068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:59.136 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:59.130+0000 7f95b6ffd640 1 --2- 172.21.15.78:0/3381036586 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f9598066470 0x7f9598068930 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f95b814bd70 tx=0x7f95a8007640 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:59:59.137 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:59.134+0000 7f95affff640 1 -- 172.21.15.78:0/3381036586 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f95b81f0190 con 0x7f95b80c0550 2023-11-28T19:59:59.289 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:59.286+0000 7f95bd279640 1 -- 172.21.15.78:0/3381036586 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f95b8066d60 con 0x7f95b80c0550 2023-11-28T19:59:59.290 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:59.286+0000 7f95affff640 1 -- 172.21.15.78:0/3381036586 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) v1 ==== 74+0+18711 (secure 0 0 0) 0x7f95a00512c0 con 0x7f95b80c0550 2023-11-28T19:59:59.290 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-11-28T19:59:59.290 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":27,"fsid":"dd9780e8-3bda-44fa-a9f0-fa07d19d901d","created":"2023-11-28T19:58:40.969556+0000","modified":"2023-11-28T19:59:47.762261+0000","last_up_change":"2023-11-28T19:58:52.596716+0000","last_in_change":"2023-11-28T19:58:43.609275+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-28T19:58:54.011229+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-28T19:59:03.945559+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-28T19:59:04.481478+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-11-28T19:59:08.109152+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"e84245ac-b5da-429e-af18-39acaa2b33e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6800","nonce":3358701235},{"type":"v1","addr":"172.21.15.78:6801","nonce":3358701235}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6802","nonce":3358701235},{"type":"v1","addr":"172.21.15.78:6803","nonce":3358701235}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6806","nonce":3358701235},{"type":"v1","addr":"172.21.15.78:6807","nonce":3358701235}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6804","nonce":3358701235},{"type":"v1","addr":"172.21.15.78:6805","nonce":3358701235}]},"public_addr":"172.21.15.78:6801/3358701235","cluster_addr":"172.21.15.78:6803/3358701235","heartbeat_back_addr":"172.21.15.78:6807/3358701235","heartbeat_front_addr":"172.21.15.78:6805/3358701235","state":["exists","up"]},{"osd":1,"uuid":"e634831d-c4e2-48d9-870c-9556ae162981","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6808","nonce":3211476654},{"type":"v1","addr":"172.21.15.78:6809","nonce":3211476654}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6810","nonce":3211476654},{"type":"v1","addr":"172.21.15.78:6811","nonce":3211476654}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6814","nonce":3211476654},{"type":"v1","addr":"172.21.15.78:6815","nonce":3211476654}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6812","nonce":3211476654},{"type":"v1","addr":"172.21.15.78:6813","nonce":3211476654}]},"public_addr":"172.21.15.78:6809/3211476654","cluster_addr":"172.21.15.78:6811/3211476654","heartbeat_back_addr":"172.21.15.78:6815/3211476654","heartbeat_front_addr":"172.21.15.78:6813/3211476654","state":["exists","up"]},{"osd":2,"uuid":"274c8395-6534-41f0-b8fb-a00af8985aa8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6816","nonce":2532904479},{"type":"v1","addr":"172.21.15.78:6817","nonce":2532904479}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6818","nonce":2532904479},{"type":"v1","addr":"172.21.15.78:6819","nonce":2532904479}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6822","nonce":2532904479},{"type":"v1","addr":"172.21.15.78:6823","nonce":2532904479}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6820","nonce":2532904479},{"type":"v1","addr":"172.21.15.78:6821","nonce":2532904479}]},"public_addr":"172.21.15.78:6817/2532904479","cluster_addr":"172.21.15.78:6819/2532904479","heartbeat_back_addr":"172.21.15.78:6823/2532904479","heartbeat_front_addr":"172.21.15.78:6821/2532904479","state":["exists","up"]},{"osd":3,"uuid":"77acc9af-7d4d-4b18-8cf5-d62f5971b7c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6824","nonce":3442991267},{"type":"v1","addr":"172.21.15.78:6825","nonce":3442991267}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6826","nonce":3442991267},{"type":"v1","addr":"172.21.15.78:6827","nonce":3442991267}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6830","nonce":3442991267},{"type":"v1","addr":"172.21.15.78:6831","nonce":3442991267}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6828","nonce":3442991267},{"type":"v1","addr":"172.21.15.78:6829","nonce":3442991267}]},"public_addr":"172.21.15.78:6825/3442991267","cluster_addr":"172.21.15.78:6827/3442991267","heartbeat_back_addr":"172.21.15.78:6831/3442991267","heartbeat_front_addr":"172.21.15.78:6829/3442991267","state":["exists","up"]},{"osd":4,"uuid":"5c62bc66-6b34-4b7f-a66b-9a743969138c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":802983577},{"type":"v1","addr":"172.21.15.179:6809","nonce":802983577}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":802983577},{"type":"v1","addr":"172.21.15.179:6811","nonce":802983577}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":802983577},{"type":"v1","addr":"172.21.15.179:6815","nonce":802983577}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":802983577},{"type":"v1","addr":"172.21.15.179:6813","nonce":802983577}]},"public_addr":"172.21.15.179:6809/802983577","cluster_addr":"172.21.15.179:6811/802983577","heartbeat_back_addr":"172.21.15.179:6815/802983577","heartbeat_front_addr":"172.21.15.179:6813/802983577","state":["exists","up"]},{"osd":5,"uuid":"67db6d36-f684-4079-b0cd-82b4dd61461f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":518192887},{"type":"v1","addr":"172.21.15.179:6818","nonce":518192887}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":518192887},{"type":"v1","addr":"172.21.15.179:6822","nonce":518192887}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":518192887},{"type":"v1","addr":"172.21.15.179:6829","nonce":518192887}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6824","nonce":518192887},{"type":"v1","addr":"172.21.15.179:6826","nonce":518192887}]},"public_addr":"172.21.15.179:6818/518192887","cluster_addr":"172.21.15.179:6822/518192887","heartbeat_back_addr":"172.21.15.179:6829/518192887","heartbeat_front_addr":"172.21.15.179:6826/518192887","state":["exists","up"]},{"osd":6,"uuid":"12e670af-5a16-4c81-9f97-defa66cab967","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":815435378},{"type":"v1","addr":"172.21.15.179:6801","nonce":815435378}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":815435378},{"type":"v1","addr":"172.21.15.179:6803","nonce":815435378}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":815435378},{"type":"v1","addr":"172.21.15.179:6807","nonce":815435378}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":815435378},{"type":"v1","addr":"172.21.15.179:6805","nonce":815435378}]},"public_addr":"172.21.15.179:6801/815435378","cluster_addr":"172.21.15.179:6803/815435378","heartbeat_back_addr":"172.21.15.179:6807/815435378","heartbeat_front_addr":"172.21.15.179:6805/815435378","state":["exists","up"]},{"osd":7,"uuid":"fe630650-2eb3-49ad-8676-c341e6332eb1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6817","nonce":2848432339},{"type":"v1","addr":"172.21.15.179:6819","nonce":2848432339}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6821","nonce":2848432339},{"type":"v1","addr":"172.21.15.179:6823","nonce":2848432339}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":2848432339},{"type":"v1","addr":"172.21.15.179:6831","nonce":2848432339}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6825","nonce":2848432339},{"type":"v1","addr":"172.21.15.179:6827","nonce":2848432339}]},"public_addr":"172.21.15.179:6819/2848432339","cluster_addr":"172.21.15.179:6823/2848432339","heartbeat_back_addr":"172.21.15.179:6831/2848432339","heartbeat_front_addr":"172.21.15.179:6827/2848432339","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:58:49.255433+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:58:49.412880+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:58:49.559295+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:58:49.245237+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:58:49.184557+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:58:49.329851+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:58:49.366012+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:58:49.349604+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.2","mappings":[{"from":5,"to":1}]},{"pgid":"3.8","mappings":[{"from":3,"to":2}]},{"pgid":"3.26","mappings":[{"from":7,"to":2}]},{"pgid":"3.30","mappings":[{"from":5,"to":2}]},{"pgid":"4.10","mappings":[{"from":1,"to":2}]},{"pgid":"4.14","mappings":[{"from":1,"to":5}]},{"pgid":"4.1d","mappings":[{"from":1,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-28T19:59:59.292 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:59.290+0000 7f95bd279640 1 -- 172.21.15.78:0/3381036586 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f9598066470 msgr2=0x7f9598068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:59.292 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:59.290+0000 7f95bd279640 1 --2- 172.21.15.78:0/3381036586 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f9598066470 0x7f9598068930 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f95b814bd70 tx=0x7f95a8007640 comp rx=0 tx=0).stop 2023-11-28T19:59:59.293 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:59.290+0000 7f95bd279640 1 -- 172.21.15.78:0/3381036586 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f95b80c0550 msgr2=0x7f95b81f0470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:59.293 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:59.290+0000 7f95bd279640 1 --2- 172.21.15.78:0/3381036586 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f95b80c0550 0x7f95b81f0470 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f95a000c820 tx=0x7f95a000cce0 comp rx=0 tx=0).stop 2023-11-28T19:59:59.293 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:59.290+0000 7f95bd279640 1 -- 172.21.15.78:0/3381036586 shutdown_connections 2023-11-28T19:59:59.293 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:59.290+0000 7f95bd279640 1 --2- 172.21.15.78:0/3381036586 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f9598066470 0x7f9598068930 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:59.293 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:59.290+0000 7f95bd279640 1 --2- 172.21.15.78:0/3381036586 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f95b8151e80 0x7f95b81f09b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:59.293 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:59.290+0000 7f95bd279640 1 --2- 172.21.15.78:0/3381036586 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f95b80c0550 0x7f95b81f0470 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:59.293 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:59.290+0000 7f95bd279640 1 --2- 172.21.15.78:0/3381036586 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f95b80a6370 0x7f95b814dde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:59.293 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:59.290+0000 7f95bd279640 1 -- 172.21.15.78:0/3381036586 >> 172.21.15.78:0/3381036586 conn(0x7f95b80a8990 msgr2=0x7f95b80a7310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T19:59:59.293 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:59.290+0000 7f95bd279640 1 -- 172.21.15.78:0/3381036586 shutdown_connections 2023-11-28T19:59:59.293 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:59.290+0000 7f95bd279640 1 -- 172.21.15.78:0/3381036586 wait complete. 2023-11-28T19:59:59.312 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-11-28T19:59:59.312 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-28T19:59:59.449 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:59.446+0000 7f8ab5879640 1 Processor -- start 2023-11-28T19:59:59.449 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:59.446+0000 7f8ab5879640 1 -- start start 2023-11-28T19:59:59.450 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:59.446+0000 7f8ab5879640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f8ab0157b10 0x7f8ab0157f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:59.450 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:59.446+0000 7f8ab5879640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8ab0155110 con 0x7f8ab00c5e10 2023-11-28T19:59:59.450 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:59.446+0000 7f8ab5879640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8ab00c2f20 con 0x7f8ab014e7e0 2023-11-28T19:59:59.450 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:59.446+0000 7f8ab5879640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8ab0154520 con 0x7f8ab0157b10 2023-11-28T19:59:59.450 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:59.446+0000 7f8aaf7fe640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f8ab0157b10 0x7f8ab0157f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:59.451 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:59.446+0000 7f8aaf7fe640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f8ab0157b10 0x7f8ab0157f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:49092/0 (socket says 172.21.15.78:49092) 2023-11-28T19:59:59.451 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:59.446+0000 7f8aaf7fe640 1 -- 172.21.15.78:0/2218541163 learned_addr learned my addr 172.21.15.78:0/2218541163 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T19:59:59.451 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:59.446+0000 7f8aa67fc640 1 --1- 172.21.15.78:0/2218541163 >> v1:172.21.15.78:6789/0 conn(0x7f8ab00c5e10 0x7f8ab00a6ee0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:45828/0 (socket says 172.21.15.78:45828) 2023-11-28T19:59:59.451 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:59.446+0000 7f8aaf7fe640 1 -- 172.21.15.78:0/2218541163 >> v1:172.21.15.179:6789/0 conn(0x7f8ab014e7e0 legacy=0x7f8ab00c2810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:59.451 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:59.446+0000 7f8aaf7fe640 1 -- 172.21.15.78:0/2218541163 >> v1:172.21.15.78:6789/0 conn(0x7f8ab00c5e10 legacy=0x7f8ab00a6ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:59.451 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:59.446+0000 7f8aaf7fe640 1 -- 172.21.15.78:0/2218541163 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ab01547e0 con 0x7f8ab0157b10 2023-11-28T19:59:59.452 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:59.446+0000 7f8aae7fc640 1 -- 172.21.15.78:0/2218541163 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 599158692 0 0) 0x7f8ab0155110 con 0x7f8ab00c5e10 2023-11-28T19:59:59.454 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:59.450+0000 7f8aaf7fe640 1 --2- 172.21.15.78:0/2218541163 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8ab0157b10 0x7f8ab0157f80 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f8aa8009870 tx=0x7f8aa801c3f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3882776498cfadd0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:59:59.454 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:59.450+0000 7f8aae7fc640 1 -- 172.21.15.78:0/2218541163 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8aa80ab5f0 con 0x7f8ab0157b10 2023-11-28T19:59:59.454 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:59.450+0000 7f8aae7fc640 1 -- 172.21.15.78:0/2218541163 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8aa80ab750 con 0x7f8ab0157b10 2023-11-28T19:59:59.454 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:59.450+0000 7f8aae7fc640 1 -- 172.21.15.78:0/2218541163 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8aa80abae0 con 0x7f8ab0157b10 2023-11-28T19:59:59.455 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:59.450+0000 7f8ab5879640 1 -- 172.21.15.78:0/2218541163 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8ab0157b10 msgr2=0x7f8ab0157f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:59.455 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:59.450+0000 7f8ab5879640 1 --2- 172.21.15.78:0/2218541163 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8ab0157b10 0x7f8ab0157f80 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f8aa8009870 tx=0x7f8aa801c3f0 comp rx=0 tx=0).stop 2023-11-28T19:59:59.455 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:59.450+0000 7f8ab5879640 1 -- 172.21.15.78:0/2218541163 shutdown_connections 2023-11-28T19:59:59.455 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:59.450+0000 7f8ab5879640 1 --2- 172.21.15.78:0/2218541163 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8ab0157b10 0x7f8ab0157f80 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:59.455 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:59.450+0000 7f8ab5879640 1 -- 172.21.15.78:0/2218541163 >> 172.21.15.78:0/2218541163 conn(0x7f8ab00c7c60 msgr2=0x7f8ab00c8070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T19:59:59.455 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:59.450+0000 7f8ab5879640 1 -- 172.21.15.78:0/2218541163 shutdown_connections 2023-11-28T19:59:59.455 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:59.450+0000 7f8ab5879640 1 -- 172.21.15.78:0/2218541163 wait complete. 2023-11-28T19:59:59.456 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:59.454+0000 7f8ab5879640 1 Processor -- start 2023-11-28T19:59:59.456 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:59.454+0000 7f8ab5879640 1 -- start start 2023-11-28T19:59:59.458 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:59.454+0000 7f8ab5879640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8ab00c5e10 0x7f8ab01ed260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:59.459 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:59.454+0000 7f8ab5879640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8ab014e7e0 0x7f8ab01450d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:59.459 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:59.454+0000 7f8ab5879640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8ab0157b10 0x7f8ab00a8e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:59.459 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:59.454+0000 7f8ab5879640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ab0144a30 con 0x7f8ab0157b10 2023-11-28T19:59:59.459 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:59.454+0000 7f8ab5879640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ab01ed7a0 con 0x7f8ab014e7e0 2023-11-28T19:59:59.459 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:59.454+0000 7f8ab5879640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ab00a8970 con 0x7f8ab00c5e10 2023-11-28T19:59:59.459 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:59.454+0000 7f8aaf7fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8ab0157b10 0x7f8ab00a8e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:59.459 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:59.454+0000 7f8aaf7fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8ab0157b10 0x7f8ab00a8e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:49102/0 (socket says 172.21.15.78:49102) 2023-11-28T19:59:59.459 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:59.454+0000 7f8aaf7fe640 1 -- 172.21.15.78:0/3635870675 learned_addr learned my addr 172.21.15.78:0/3635870675 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T19:59:59.459 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:59.454+0000 7f8aa67fc640 1 --2- 172.21.15.78:0/3635870675 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8ab014e7e0 0x7f8ab01450d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:59.459 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:59.454+0000 7f8aaeffd640 1 --2- 172.21.15.78:0/3635870675 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8ab00c5e10 0x7f8ab01ed260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:59.460 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:59.454+0000 7f8aaf7fe640 1 -- 172.21.15.78:0/3635870675 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8ab00c5e10 msgr2=0x7f8ab01ed260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:59.460 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:59.454+0000 7f8aaf7fe640 1 --2- 172.21.15.78:0/3635870675 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8ab00c5e10 0x7f8ab01ed260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:59.460 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:59.454+0000 7f8aaf7fe640 1 -- 172.21.15.78:0/3635870675 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8ab014e7e0 msgr2=0x7f8ab01450d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:59.460 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:59.454+0000 7f8aaf7fe640 1 --2- 172.21.15.78:0/3635870675 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8ab014e7e0 0x7f8ab01450d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:59.460 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:59.454+0000 7f8aaf7fe640 1 -- 172.21.15.78:0/3635870675 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8aa80094d0 con 0x7f8ab0157b10 2023-11-28T19:59:59.460 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:59.454+0000 7f8aaf7fe640 1 --2- 172.21.15.78:0/3635870675 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8ab0157b10 0x7f8ab00a8e00 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f8aa80ad040 tx=0x7f8aa801ac30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:59:59.460 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:59.454+0000 7f8aacff9640 1 -- 172.21.15.78:0/3635870675 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8aa80be5f0 con 0x7f8ab0157b10 2023-11-28T19:59:59.460 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:59.454+0000 7f8aacff9640 1 -- 172.21.15.78:0/3635870675 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8aa80be770 con 0x7f8ab0157b10 2023-11-28T19:59:59.460 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:59.454+0000 7f8aacff9640 1 -- 172.21.15.78:0/3635870675 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8aa80beb20 con 0x7f8ab0157b10 2023-11-28T19:59:59.460 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:59.454+0000 7f8ab5879640 1 -- 172.21.15.78:0/3635870675 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8ab0146370 con 0x7f8ab0157b10 2023-11-28T19:59:59.460 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:59.454+0000 7f8ab5879640 1 -- 172.21.15.78:0/3635870675 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8ab0145db0 con 0x7f8ab0157b10 2023-11-28T19:59:59.461 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:59.458+0000 7f8ab5879640 1 -- 172.21.15.78:0/3635870675 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8ab00a8ae0 con 0x7f8ab0157b10 2023-11-28T19:59:59.461 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:59.458+0000 7f8aacff9640 1 -- 172.21.15.78:0/3635870675 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f8aa80b43f0 con 0x7f8ab0157b10 2023-11-28T19:59:59.461 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:59.458+0000 7f8aacff9640 1 --2- 172.21.15.78:0/3635870675 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f8a90066540 0x7f8a90068a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:59.462 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:59.458+0000 7f8aacff9640 1 -- 172.21.15.78:0/3635870675 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f8aa80a8050 con 0x7f8ab0157b10 2023-11-28T19:59:59.462 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:59.458+0000 7f8aaeffd640 1 --2- 172.21.15.78:0/3635870675 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f8a90066540 0x7f8a90068a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:59.462 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:59.458+0000 7f8aaeffd640 1 --2- 172.21.15.78:0/3635870675 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f8a90066540 0x7f8a90068a00 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f8aa0000f70 tx=0x7f8aa0009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:59:59.465 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:59.462+0000 7f8aacff9640 1 -- 172.21.15.78:0/3635870675 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f8aa80ec2a0 con 0x7f8ab0157b10 2023-11-28T19:59:59.644 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:59.642+0000 7f8ab5879640 1 -- 172.21.15.78:0/3635870675 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f8ab0067630 con 0x7f8ab0157b10 2023-11-28T19:59:59.645 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:59.642+0000 7f8aacff9640 1 -- 172.21.15.78:0/3635870675 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4915 (secure 0 0 0) 0x7f8aa80ef8c0 con 0x7f8ab0157b10 2023-11-28T19:59:59.645 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-11-28T19:59:59.645 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4241,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6835/3089461479","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6833","nonce":3089461479},{"type":"v1","addr":"172.21.15.179:6835","nonce":3089461479}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4258,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6837/3153162191","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6834","nonce":3153162191},{"type":"v1","addr":"172.21.15.78:6837","nonce":3153162191}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4266,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6836/3073967897","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6835","nonce":3073967897},{"type":"v1","addr":"172.21.15.78:6836","nonce":3073967897}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-28T19:59:05.411488+0000","modified":"2023-11-28T19:59:23.150979+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4275},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4275":{"gid":4275,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.179:6834/1234044491","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6832","nonce":1234044491},{"type":"v1","addr":"172.21.15.179:6834","nonce":1234044491}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-11-28T19:59:59.646 INFO:teuthology.orchestra.run.smithi078.stderr:dumped fsmap epoch 9 2023-11-28T19:59:59.647 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:59.642+0000 7f8ab5879640 1 -- 172.21.15.78:0/3635870675 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f8a90066540 msgr2=0x7f8a90068a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:59.647 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:59.642+0000 7f8ab5879640 1 --2- 172.21.15.78:0/3635870675 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f8a90066540 0x7f8a90068a00 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f8aa0000f70 tx=0x7f8aa0009040 comp rx=0 tx=0).stop 2023-11-28T19:59:59.647 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:59.642+0000 7f8ab5879640 1 -- 172.21.15.78:0/3635870675 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8ab0157b10 msgr2=0x7f8ab00a8e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:59.647 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:59.642+0000 7f8ab5879640 1 --2- 172.21.15.78:0/3635870675 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8ab0157b10 0x7f8ab00a8e00 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f8aa80ad040 tx=0x7f8aa801ac30 comp rx=0 tx=0).stop 2023-11-28T19:59:59.647 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:59.642+0000 7f8ab5879640 1 -- 172.21.15.78:0/3635870675 shutdown_connections 2023-11-28T19:59:59.647 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:59.642+0000 7f8ab5879640 1 --2- 172.21.15.78:0/3635870675 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f8a90066540 0x7f8a90068a00 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:59.648 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:59.642+0000 7f8ab5879640 1 --2- 172.21.15.78:0/3635870675 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8ab0157b10 0x7f8ab00a8e00 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:59.648 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:59.642+0000 7f8ab5879640 1 --2- 172.21.15.78:0/3635870675 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8ab014e7e0 0x7f8ab01450d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:59.648 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:59.642+0000 7f8ab5879640 1 --2- 172.21.15.78:0/3635870675 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8ab00c5e10 0x7f8ab01ed260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:59.648 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:59.642+0000 7f8ab5879640 1 -- 172.21.15.78:0/3635870675 >> 172.21.15.78:0/3635870675 conn(0x7f8ab00c7c60 msgr2=0x7f8ab00c46f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T19:59:59.648 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:59.642+0000 7f8ab5879640 1 -- 172.21.15.78:0/3635870675 shutdown_connections 2023-11-28T19:59:59.648 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:59.642+0000 7f8ab5879640 1 -- 172.21.15.78:0/3635870675 wait complete. 2023-11-28T19:59:59.668 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-28T19:59:59.805 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:59.802+0000 7f36a2879640 1 Processor -- start 2023-11-28T19:59:59.806 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:59.802+0000 7f36a2879640 1 -- start start 2023-11-28T19:59:59.806 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:59.802+0000 7f36a2879640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f369c14fd10 0x7f369c0a4dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:59.806 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:59.802+0000 7f36a2879640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f369c0c5710 con 0x7f369c0a5300 2023-11-28T19:59:59.807 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:59.802+0000 7f36a2879640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f369c155c80 con 0x7f369c156110 2023-11-28T19:59:59.807 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:59.802+0000 7f36a2879640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f369c06c5e0 con 0x7f369c14fd10 2023-11-28T19:59:59.808 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:59.802+0000 7f369b7fe640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f369c0a5300 0x7f369c071e30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:45830/0 (socket says 172.21.15.78:45830) 2023-11-28T19:59:59.809 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:59.802+0000 7f369b7fe640 1 -- 172.21.15.78:0/4065849150 learned_addr learned my addr 172.21.15.78:0/4065849150 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-11-28T19:59:59.809 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:59.802+0000 7f369bfff640 1 --2- 172.21.15.78:0/4065849150 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f369c14fd10 0x7f369c0a4dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:59.809 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:59.802+0000 7f369affd640 1 -- 172.21.15.78:0/4065849150 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3739212030 0 0) 0x7f369c0c5710 con 0x7f369c0a5300 2023-11-28T19:59:59.809 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:59.802+0000 7f369affd640 1 -- 172.21.15.78:0/4065849150 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3684003530 con 0x7f369c0a5300 2023-11-28T19:59:59.809 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:59.806+0000 7f369affd640 1 -- 172.21.15.78:0/4065849150 <== mon.0 v1:172.21.15.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 456766856 0 0) 0x7f3684003530 con 0x7f369c0a5300 2023-11-28T19:59:59.809 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:59.806+0000 7f369affd640 1 -- 172.21.15.78:0/4065849150 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f369c14fd10 msgr2=0x7f369c0a4dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T19:59:59.809 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:59.806+0000 7f369affd640 1 --2- 172.21.15.78:0/4065849150 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f369c14fd10 0x7f369c0a4dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:59.809 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:59.806+0000 7f369affd640 1 -- 172.21.15.78:0/4065849150 >> v1:172.21.15.179:6789/0 conn(0x7f369c156110 legacy=0x7f369c15ce50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:59.809 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:59.806+0000 7f369affd640 1 -- 172.21.15.78:0/4065849150 --> v1:172.21.15.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f369c0c4e70 con 0x7f369c0a5300 2023-11-28T19:59:59.809 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:59.806+0000 7f369affd640 1 -- 172.21.15.78:0/4065849150 <== mon.0 v1:172.21.15.78:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3326804700 0 0) 0x7f3690001680 con 0x7f369c0a5300 2023-11-28T19:59:59.809 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:59.806+0000 7f369affd640 1 -- 172.21.15.78:0/4065849150 >> v1:172.21.15.78:6789/0 conn(0x7f369c0a5300 legacy=0x7f369c071e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:59.810 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:59.806+0000 7f369affd640 1 --2- 172.21.15.78:0/4065849150 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f36840039b0 0x7f3684003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:59.810 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:59.806+0000 7f369affd640 1 --2- 172.21.15.78:0/4065849150 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f369c14fd10 0x7f36840047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:59.810 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:59.806+0000 7f369affd640 1 --2- 172.21.15.78:0/4065849150 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3684004d10 0x7f3684005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:59.810 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:59.806+0000 7f369affd640 1 -- 172.21.15.78:0/4065849150 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f368400bb20 con 0x7f3684004d10 2023-11-28T19:59:59.811 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:59.806+0000 7f369affd640 1 -- 172.21.15.78:0/4065849150 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f368400bc90 con 0x7f36840039b0 2023-11-28T19:59:59.811 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:59.806+0000 7f369affd640 1 -- 172.21.15.78:0/4065849150 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f368400be50 con 0x7f369c14fd10 2023-11-28T19:59:59.811 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:59.806+0000 7f369bfff640 1 --2- 172.21.15.78:0/4065849150 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f36840039b0 0x7f3684003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:59.811 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:59.806+0000 7f36a0e16640 1 --2- 172.21.15.78:0/4065849150 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3684004d10 0x7f3684005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:59.811 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:59.806+0000 7f369b7fe640 1 --2- 172.21.15.78:0/4065849150 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f369c14fd10 0x7f36840047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:59.811 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:59.806+0000 7f36a0e16640 1 -- 172.21.15.78:0/4065849150 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f369c14fd10 msgr2=0x7f36840047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T19:59:59.811 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:59.806+0000 7f36a0e16640 1 --2- 172.21.15.78:0/4065849150 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f369c14fd10 0x7f36840047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:59.811 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:59.806+0000 7f36a0e16640 1 -- 172.21.15.78:0/4065849150 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f36840039b0 msgr2=0x7f3684003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T19:59:59.811 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:59.806+0000 7f36a0e16640 1 --2- 172.21.15.78:0/4065849150 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f36840039b0 0x7f3684003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:59.812 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:59.806+0000 7f36a0e16640 1 -- 172.21.15.78:0/4065849150 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3684003530 con 0x7f3684004d10 2023-11-28T19:59:59.813 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:59.806+0000 7f36a0e16640 1 --2- 172.21.15.78:0/4065849150 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3684004d10 0x7f3684005190 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f3694001e70 tx=0x7f369401c730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=acc8aa58a12f4581 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:59:59.813 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:59.810+0000 7f369affd640 1 -- 172.21.15.78:0/4065849150 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3694003b80 con 0x7f3684004d10 2023-11-28T19:59:59.813 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:59.810+0000 7f369affd640 1 -- 172.21.15.78:0/4065849150 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3694003ce0 con 0x7f3684004d10 2023-11-28T19:59:59.813 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:59.810+0000 7f369affd640 1 -- 172.21.15.78:0/4065849150 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36940052c0 con 0x7f3684004d10 2023-11-28T19:59:59.813 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:59.810+0000 7f36a2879640 1 -- 172.21.15.78:0/4065849150 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3684004d10 msgr2=0x7f3684005190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:59.813 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:59.810+0000 7f36a2879640 1 --2- 172.21.15.78:0/4065849150 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3684004d10 0x7f3684005190 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f3694001e70 tx=0x7f369401c730 comp rx=0 tx=0).stop 2023-11-28T19:59:59.813 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:59.810+0000 7f36a0e16640 1 -- 172.21.15.78:0/4065849150 reap_dead start 2023-11-28T19:59:59.814 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:59.810+0000 7f36a2879640 1 -- 172.21.15.78:0/4065849150 shutdown_connections 2023-11-28T19:59:59.814 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:59.810+0000 7f36a2879640 1 -- 172.21.15.78:0/4065849150 >> 172.21.15.78:0/4065849150 conn(0x7f369c0a7810 msgr2=0x7f369c0a7c20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T19:59:59.814 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:59.810+0000 7f36a2879640 1 -- 172.21.15.78:0/4065849150 shutdown_connections 2023-11-28T19:59:59.814 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:59.810+0000 7f36a2879640 1 -- 172.21.15.78:0/4065849150 wait complete. 2023-11-28T19:59:59.815 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:59.810+0000 7f36a2879640 1 Processor -- start 2023-11-28T19:59:59.815 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:59.810+0000 7f36a2879640 1 -- start start 2023-11-28T19:59:59.815 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:59.810+0000 7f36a2879640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3684004d10 0x7f369c14eb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:59.815 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:59.810+0000 7f36a2879640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f369c1504e0 0x7f369c150960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:59.815 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:59.810+0000 7f36a2879640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f369c145d10 0x7f369c1461c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:59.815 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:59.810+0000 7f36a2879640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f369c153510 con 0x7f369c145d10 2023-11-28T19:59:59.815 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:59.810+0000 7f36a2879640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f369c153270 con 0x7f369c1504e0 2023-11-28T19:59:59.816 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:59.810+0000 7f36a2879640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f369c14bcd0 con 0x7f3684004d10 2023-11-28T19:59:59.816 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:59.810+0000 7f36a0e16640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f369c145d10 0x7f369c1461c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:59.816 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:59.810+0000 7f36a0e16640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f369c145d10 0x7f369c1461c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:49106/0 (socket says 172.21.15.78:49106) 2023-11-28T19:59:59.816 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:59.810+0000 7f36a0e16640 1 -- 172.21.15.78:0/4064041576 learned_addr learned my addr 172.21.15.78:0/4064041576 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T19:59:59.816 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:59.810+0000 7f369b7fe640 1 --2- 172.21.15.78:0/4064041576 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f369c1504e0 0x7f369c150960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:59.816 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:59.810+0000 7f369bfff640 1 --2- 172.21.15.78:0/4064041576 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3684004d10 0x7f369c14eb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:59.817 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:59.814+0000 7f36a0e16640 1 -- 172.21.15.78:0/4064041576 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3684004d10 msgr2=0x7f369c14eb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:59.817 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:59.814+0000 7f36a0e16640 1 --2- 172.21.15.78:0/4064041576 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3684004d10 0x7f369c14eb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:59.817 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:59.814+0000 7f36a0e16640 1 -- 172.21.15.78:0/4064041576 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f369c1504e0 msgr2=0x7f369c150960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:59:59.817 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:59.814+0000 7f36a0e16640 1 --2- 172.21.15.78:0/4064041576 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f369c1504e0 0x7f369c150960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:59:59.818 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:59.814+0000 7f36a0e16640 1 -- 172.21.15.78:0/4064041576 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f369c14f6d0 con 0x7f369c145d10 2023-11-28T19:59:59.818 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:59.814+0000 7f36a0e16640 1 --2- 172.21.15.78:0/4064041576 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f369c145d10 0x7f369c1461c0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f369401cc10 tx=0x7f3684005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:59:59.818 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:59.814+0000 7f3698ff9640 1 -- 172.21.15.78:0/4064041576 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3694003b80 con 0x7f369c145d10 2023-11-28T19:59:59.818 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:59.814+0000 7f3698ff9640 1 -- 172.21.15.78:0/4064041576 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3694001250 con 0x7f369c145d10 2023-11-28T19:59:59.818 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:59.814+0000 7f3698ff9640 1 -- 172.21.15.78:0/4064041576 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3694005250 con 0x7f369c145d10 2023-11-28T19:59:59.819 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:59.814+0000 7f36a2879640 1 -- 172.21.15.78:0/4064041576 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f369c14bf70 con 0x7f369c145d10 2023-11-28T19:59:59.819 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:59.814+0000 7f36a2879640 1 -- 172.21.15.78:0/4064041576 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f369c14c250 con 0x7f369c145d10 2023-11-28T19:59:59.819 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:59.814+0000 7f36a2879640 1 -- 172.21.15.78:0/4064041576 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f369c067630 con 0x7f369c145d10 2023-11-28T19:59:59.820 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:59.814+0000 7f3698ff9640 1 -- 172.21.15.78:0/4064041576 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f36940053b0 con 0x7f369c145d10 2023-11-28T19:59:59.820 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:59.814+0000 7f3698ff9640 1 --2- 172.21.15.78:0/4064041576 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f36880664a0 0x7f3688068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:59:59.820 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:59.814+0000 7f3698ff9640 1 -- 172.21.15.78:0/4064041576 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f369411e520 con 0x7f369c145d10 2023-11-28T19:59:59.820 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:59.814+0000 7f369bfff640 1 --2- 172.21.15.78:0/4064041576 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f36880664a0 0x7f3688068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:59:59.820 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:59.818+0000 7f369bfff640 1 --2- 172.21.15.78:0/4064041576 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f36880664a0 0x7f3688068960 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f369c14f450 tx=0x7f368c009190 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:59:59.823 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T19:59:59.818+0000 7f3698ff9640 1 -- 172.21.15.78:0/4064041576 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f36940eb7b0 con 0x7f369c145d10 2023-11-28T20:00:00.008 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:00.006+0000 7f36a2879640 1 -- 172.21.15.78:0/4064041576 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f369c153510 con 0x7f369c145d10 2023-11-28T20:00:00.008 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:00.006+0000 7f3698ff9640 1 -- 172.21.15.78:0/4064041576 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4915 (secure 0 0 0) 0x7f36940eedd0 con 0x7f369c145d10 2023-11-28T20:00:00.009 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-11-28T20:00:00.009 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4241,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6835/3089461479","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6833","nonce":3089461479},{"type":"v1","addr":"172.21.15.179:6835","nonce":3089461479}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4258,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6837/3153162191","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6834","nonce":3153162191},{"type":"v1","addr":"172.21.15.78:6837","nonce":3153162191}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4266,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6836/3073967897","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6835","nonce":3073967897},{"type":"v1","addr":"172.21.15.78:6836","nonce":3073967897}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-28T19:59:05.411488+0000","modified":"2023-11-28T19:59:23.150979+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4275},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4275":{"gid":4275,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.179:6834/1234044491","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6832","nonce":1234044491},{"type":"v1","addr":"172.21.15.179:6834","nonce":1234044491}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-11-28T20:00:00.009 INFO:teuthology.orchestra.run.smithi078.stderr:dumped fsmap epoch 9 2023-11-28T20:00:00.010 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:00.006+0000 7f36a2879640 1 -- 172.21.15.78:0/4064041576 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f36880664a0 msgr2=0x7f3688068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:00:00.010 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:00.006+0000 7f36a2879640 1 --2- 172.21.15.78:0/4064041576 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f36880664a0 0x7f3688068960 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f369c14f450 tx=0x7f368c009190 comp rx=0 tx=0).stop 2023-11-28T20:00:00.011 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:00.006+0000 7f36a2879640 1 -- 172.21.15.78:0/4064041576 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f369c145d10 msgr2=0x7f369c1461c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:00:00.011 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:00.006+0000 7f36a2879640 1 --2- 172.21.15.78:0/4064041576 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f369c145d10 0x7f369c1461c0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f369401cc10 tx=0x7f3684005800 comp rx=0 tx=0).stop 2023-11-28T20:00:00.011 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:00.006+0000 7f36a2879640 1 -- 172.21.15.78:0/4064041576 shutdown_connections 2023-11-28T20:00:00.011 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:00.006+0000 7f36a2879640 1 --2- 172.21.15.78:0/4064041576 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f36880664a0 0x7f3688068960 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:00.011 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:00.006+0000 7f36a2879640 1 --2- 172.21.15.78:0/4064041576 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f369c145d10 0x7f369c1461c0 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:00.011 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:00.006+0000 7f36a2879640 1 --2- 172.21.15.78:0/4064041576 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f369c1504e0 0x7f369c150960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:00.011 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:00.006+0000 7f36a2879640 1 --2- 172.21.15.78:0/4064041576 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3684004d10 0x7f369c14eb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:00.011 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:00.006+0000 7f36a2879640 1 -- 172.21.15.78:0/4064041576 >> 172.21.15.78:0/4064041576 conn(0x7f369c0a7810 msgr2=0x7f369c0a9bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:00:00.011 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:00.006+0000 7f36a2879640 1 -- 172.21.15.78:0/4064041576 shutdown_connections 2023-11-28T20:00:00.011 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:00.006+0000 7f36a2879640 1 -- 172.21.15.78:0/4064041576 wait complete. 2023-11-28T20:00:00.030 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-28T20:00:00.168 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:00.166+0000 7f4157701640 1 Processor -- start 2023-11-28T20:00:00.168 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:00.166+0000 7f4157701640 1 -- start start 2023-11-28T20:00:00.169 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:00.166+0000 7f4157701640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f415006d690 0x7f41500c5300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:00.169 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:00.166+0000 7f4157701640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f415006db20 con 0x7f41500c3b80 2023-11-28T20:00:00.169 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:00.166+0000 7f4157701640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f415006bb80 con 0x7f415006d2b0 2023-11-28T20:00:00.169 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:00.166+0000 7f4157701640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f41500c5840 con 0x7f415006d690 2023-11-28T20:00:00.169 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:00.166+0000 7f4154c9c640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f41500c3b80 0x7f415006c730 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:45844/0 (socket says 172.21.15.78:45844) 2023-11-28T20:00:00.169 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:00.166+0000 7f4154c9c640 1 -- 172.21.15.78:0/423040321 learned_addr learned my addr 172.21.15.78:0/423040321 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-11-28T20:00:00.171 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:00.166+0000 7f4155c9e640 1 --2- 172.21.15.78:0/423040321 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f415006d690 0x7f41500c5300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:00.171 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:00.166+0000 7f4147fff640 1 -- 172.21.15.78:0/423040321 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2071092120 0 0) 0x7f4140001120 con 0x7f41500c3b80 2023-11-28T20:00:00.171 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:00.166+0000 7f4147fff640 1 -- 172.21.15.78:0/423040321 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f413c005740 con 0x7f41500c3b80 2023-11-28T20:00:00.172 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:00.166+0000 7f4147fff640 1 -- 172.21.15.78:0/423040321 <== mon.0 v1:172.21.15.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3573238718 0 0) 0x7f413c005740 con 0x7f41500c3b80 2023-11-28T20:00:00.172 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:00.166+0000 7f4147fff640 1 -- 172.21.15.78:0/423040321 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f415006d690 msgr2=0x7f41500c5300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:00:00.172 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:00.166+0000 7f4147fff640 1 --2- 172.21.15.78:0/423040321 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f415006d690 0x7f41500c5300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:00.172 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:00.166+0000 7f4147fff640 1 -- 172.21.15.78:0/423040321 >> v1:172.21.15.179:6789/0 conn(0x7f415006d2b0 legacy=0x7f415006c020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:00:00.172 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:00.166+0000 7f4147fff640 1 -- 172.21.15.78:0/423040321 --> v1:172.21.15.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41501515c0 con 0x7f41500c3b80 2023-11-28T20:00:00.172 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:00.166+0000 7f4147fff640 1 -- 172.21.15.78:0/423040321 <== mon.0 v1:172.21.15.78:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3326804700 0 0) 0x7f4140001810 con 0x7f41500c3b80 2023-11-28T20:00:00.172 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:00.166+0000 7f4147fff640 1 -- 172.21.15.78:0/423040321 >> v1:172.21.15.78:6789/0 conn(0x7f41500c3b80 legacy=0x7f415006c730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:00:00.172 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:00.166+0000 7f4147fff640 1 --2- 172.21.15.78:0/423040321 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f413c005bc0 0x7f413c005fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:00.172 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:00.166+0000 7f4147fff640 1 --2- 172.21.15.78:0/423040321 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f413c0069e0 0x7f413c006e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:00.172 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:00.166+0000 7f4147fff640 1 --2- 172.21.15.78:0/423040321 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f413c0073a0 0x7f413c00dba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:00.172 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:00.166+0000 7f4147fff640 1 -- 172.21.15.78:0/423040321 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41500c5840 con 0x7f413c0073a0 2023-11-28T20:00:00.173 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:00.166+0000 7f4147fff640 1 -- 172.21.15.78:0/423040321 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f413c00e1c0 con 0x7f413c005bc0 2023-11-28T20:00:00.173 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:00.166+0000 7f4147fff640 1 -- 172.21.15.78:0/423040321 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f413c00e380 con 0x7f413c0069e0 2023-11-28T20:00:00.173 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:00.166+0000 7f4155c9e640 1 --2- 172.21.15.78:0/423040321 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f413c0073a0 0x7f413c00dba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:00.173 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:00.166+0000 7f415549d640 1 --2- 172.21.15.78:0/423040321 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f413c005bc0 0x7f413c005fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:00.173 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:00.166+0000 7f4154c9c640 1 --2- 172.21.15.78:0/423040321 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f413c0069e0 0x7f413c006e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:00.173 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:00.166+0000 7f4155c9e640 1 -- 172.21.15.78:0/423040321 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f413c0069e0 msgr2=0x7f413c006e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:00:00.173 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:00.166+0000 7f4155c9e640 1 --2- 172.21.15.78:0/423040321 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f413c0069e0 0x7f413c006e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:00.173 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:00.166+0000 7f4155c9e640 1 -- 172.21.15.78:0/423040321 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f413c005bc0 msgr2=0x7f413c005fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:00:00.173 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:00.166+0000 7f4155c9e640 1 --2- 172.21.15.78:0/423040321 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f413c005bc0 0x7f413c005fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:00.173 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:00.166+0000 7f4155c9e640 1 -- 172.21.15.78:0/423040321 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f413c005740 con 0x7f413c0073a0 2023-11-28T20:00:00.174 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:00.170+0000 7f4155c9e640 1 --2- 172.21.15.78:0/423040321 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f413c0073a0 0x7f413c00dba0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f415006da70 tx=0x7f414801cb60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dd34480e31ffb315 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:00:00.174 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:00.170+0000 7f4147fff640 1 -- 172.21.15.78:0/423040321 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41480a5b90 con 0x7f413c0073a0 2023-11-28T20:00:00.174 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:00.170+0000 7f4147fff640 1 -- 172.21.15.78:0/423040321 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f414800f040 con 0x7f413c0073a0 2023-11-28T20:00:00.174 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:00.170+0000 7f4147fff640 1 -- 172.21.15.78:0/423040321 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41480ad440 con 0x7f413c0073a0 2023-11-28T20:00:00.175 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:00.170+0000 7f4157701640 1 -- 172.21.15.78:0/423040321 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f413c0073a0 msgr2=0x7f413c00dba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:00:00.175 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:00.170+0000 7f4157701640 1 --2- 172.21.15.78:0/423040321 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f413c0073a0 0x7f413c00dba0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f415006da70 tx=0x7f414801cb60 comp rx=0 tx=0).stop 2023-11-28T20:00:00.175 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:00.170+0000 7f4155c9e640 1 -- 172.21.15.78:0/423040321 reap_dead start 2023-11-28T20:00:00.175 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:00.170+0000 7f4157701640 1 -- 172.21.15.78:0/423040321 shutdown_connections 2023-11-28T20:00:00.175 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:00.170+0000 7f4157701640 1 -- 172.21.15.78:0/423040321 >> 172.21.15.78:0/423040321 conn(0x7f41500a7810 msgr2=0x7f41500a7c20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:00:00.175 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:00.170+0000 7f4157701640 1 -- 172.21.15.78:0/423040321 shutdown_connections 2023-11-28T20:00:00.176 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:00.170+0000 7f4157701640 1 -- 172.21.15.78:0/423040321 wait complete. 2023-11-28T20:00:00.176 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:00.174+0000 7f4157701640 1 Processor -- start 2023-11-28T20:00:00.176 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:00.174+0000 7f4157701640 1 -- start start 2023-11-28T20:00:00.179 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:00.174+0000 7f4157701640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4150150700 0x7f41501ea6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:00.179 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:00.174+0000 7f4157701640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f41501552e0 0x7f41501ee440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:00.179 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:00.174+0000 7f4157701640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f41500a8730 0x7f41501dda60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:00.179 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:00.174+0000 7f4157701640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41501edfb0 con 0x7f41500a8730 2023-11-28T20:00:00.179 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:00.174+0000 7f4157701640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41500a9150 con 0x7f41501552e0 2023-11-28T20:00:00.179 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:00.174+0000 7f4157701640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f41500a9430 con 0x7f4150150700 2023-11-28T20:00:00.179 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:00.174+0000 7f4155c9e640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f41500a8730 0x7f41501dda60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:00.179 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:00.174+0000 7f4155c9e640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f41500a8730 0x7f41501dda60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:49112/0 (socket says 172.21.15.78:49112) 2023-11-28T20:00:00.179 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:00.174+0000 7f4155c9e640 1 -- 172.21.15.78:0/585551520 learned_addr learned my addr 172.21.15.78:0/585551520 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T20:00:00.180 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:00.174+0000 7f415549d640 1 --2- 172.21.15.78:0/585551520 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4150150700 0x7f41501ea6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:00.180 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:00.174+0000 7f4154c9c640 1 --2- 172.21.15.78:0/585551520 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f41501552e0 0x7f41501ee440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:00.180 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:00.174+0000 7f4155c9e640 1 -- 172.21.15.78:0/585551520 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4150150700 msgr2=0x7f41501ea6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:00:00.180 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:00.174+0000 7f4155c9e640 1 --2- 172.21.15.78:0/585551520 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4150150700 0x7f41501ea6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:00.180 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:00.174+0000 7f4155c9e640 1 -- 172.21.15.78:0/585551520 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f41501552e0 msgr2=0x7f41501ee440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:00:00.180 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:00.174+0000 7f4155c9e640 1 --2- 172.21.15.78:0/585551520 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f41501552e0 0x7f41501ee440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:00.180 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:00.174+0000 7f4155c9e640 1 -- 172.21.15.78:0/585551520 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41500a9710 con 0x7f41500a8730 2023-11-28T20:00:00.180 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:00.174+0000 7f4155c9e640 1 --2- 172.21.15.78:0/585551520 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f41500a8730 0x7f41501dda60 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f41480b0040 tx=0x7f4148009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:00:00.180 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:00.174+0000 7f4145ffb640 1 -- 172.21.15.78:0/585551520 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4148009470 con 0x7f41500a8730 2023-11-28T20:00:00.180 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:00.174+0000 7f4145ffb640 1 -- 172.21.15.78:0/585551520 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f41480ae990 con 0x7f41500a8730 2023-11-28T20:00:00.180 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:00.174+0000 7f4157701640 1 -- 172.21.15.78:0/585551520 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f41501edc40 con 0x7f41500a8730 2023-11-28T20:00:00.180 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:00.174+0000 7f4145ffb640 1 -- 172.21.15.78:0/585551520 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41480aed00 con 0x7f41500a8730 2023-11-28T20:00:00.181 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:00.174+0000 7f4157701640 1 -- 172.21.15.78:0/585551520 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f41501eeb50 con 0x7f41500a8730 2023-11-28T20:00:00.181 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:00.178+0000 7f4157701640 1 -- 172.21.15.78:0/585551520 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f41500a74a0 con 0x7f41500a8730 2023-11-28T20:00:00.181 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:00.178+0000 7f4145ffb640 1 -- 172.21.15.78:0/585551520 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f41480b4040 con 0x7f41500a8730 2023-11-28T20:00:00.182 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:00.178+0000 7f4145ffb640 1 --2- 172.21.15.78:0/585551520 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f41340664a0 0x7f4134068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:00.182 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:00.178+0000 7f4145ffb640 1 -- 172.21.15.78:0/585551520 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f414811ea90 con 0x7f41500a8730 2023-11-28T20:00:00.182 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:00.178+0000 7f415549d640 1 --2- 172.21.15.78:0/585551520 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f41340664a0 0x7f4134068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:00.183 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:00.178+0000 7f415549d640 1 --2- 172.21.15.78:0/585551520 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f41340664a0 0x7f4134068960 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f4150150f10 tx=0x7f414c009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:00:00.186 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:00.182+0000 7f4145ffb640 1 -- 172.21.15.78:0/585551520 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f41480ebcb0 con 0x7f41500a8730 2023-11-28T20:00:00.337 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:00.334+0000 7f4157701640 1 -- 172.21.15.78:0/585551520 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f415006bd70 con 0x7f41500a8730 2023-11-28T20:00:00.338 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:00.334+0000 7f4145ffb640 1 -- 172.21.15.78:0/585551520 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) v1 ==== 74+0+18711 (secure 0 0 0) 0x7f41480aee60 con 0x7f41500a8730 2023-11-28T20:00:00.338 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-11-28T20:00:00.338 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":27,"fsid":"dd9780e8-3bda-44fa-a9f0-fa07d19d901d","created":"2023-11-28T19:58:40.969556+0000","modified":"2023-11-28T19:59:47.762261+0000","last_up_change":"2023-11-28T19:58:52.596716+0000","last_in_change":"2023-11-28T19:58:43.609275+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-28T19:58:54.011229+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-28T19:59:03.945559+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-28T19:59:04.481478+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-11-28T19:59:08.109152+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"e84245ac-b5da-429e-af18-39acaa2b33e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6800","nonce":3358701235},{"type":"v1","addr":"172.21.15.78:6801","nonce":3358701235}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6802","nonce":3358701235},{"type":"v1","addr":"172.21.15.78:6803","nonce":3358701235}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6806","nonce":3358701235},{"type":"v1","addr":"172.21.15.78:6807","nonce":3358701235}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6804","nonce":3358701235},{"type":"v1","addr":"172.21.15.78:6805","nonce":3358701235}]},"public_addr":"172.21.15.78:6801/3358701235","cluster_addr":"172.21.15.78:6803/3358701235","heartbeat_back_addr":"172.21.15.78:6807/3358701235","heartbeat_front_addr":"172.21.15.78:6805/3358701235","state":["exists","up"]},{"osd":1,"uuid":"e634831d-c4e2-48d9-870c-9556ae162981","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6808","nonce":3211476654},{"type":"v1","addr":"172.21.15.78:6809","nonce":3211476654}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6810","nonce":3211476654},{"type":"v1","addr":"172.21.15.78:6811","nonce":3211476654}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6814","nonce":3211476654},{"type":"v1","addr":"172.21.15.78:6815","nonce":3211476654}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6812","nonce":3211476654},{"type":"v1","addr":"172.21.15.78:6813","nonce":3211476654}]},"public_addr":"172.21.15.78:6809/3211476654","cluster_addr":"172.21.15.78:6811/3211476654","heartbeat_back_addr":"172.21.15.78:6815/3211476654","heartbeat_front_addr":"172.21.15.78:6813/3211476654","state":["exists","up"]},{"osd":2,"uuid":"274c8395-6534-41f0-b8fb-a00af8985aa8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6816","nonce":2532904479},{"type":"v1","addr":"172.21.15.78:6817","nonce":2532904479}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6818","nonce":2532904479},{"type":"v1","addr":"172.21.15.78:6819","nonce":2532904479}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6822","nonce":2532904479},{"type":"v1","addr":"172.21.15.78:6823","nonce":2532904479}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6820","nonce":2532904479},{"type":"v1","addr":"172.21.15.78:6821","nonce":2532904479}]},"public_addr":"172.21.15.78:6817/2532904479","cluster_addr":"172.21.15.78:6819/2532904479","heartbeat_back_addr":"172.21.15.78:6823/2532904479","heartbeat_front_addr":"172.21.15.78:6821/2532904479","state":["exists","up"]},{"osd":3,"uuid":"77acc9af-7d4d-4b18-8cf5-d62f5971b7c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6824","nonce":3442991267},{"type":"v1","addr":"172.21.15.78:6825","nonce":3442991267}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6826","nonce":3442991267},{"type":"v1","addr":"172.21.15.78:6827","nonce":3442991267}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6830","nonce":3442991267},{"type":"v1","addr":"172.21.15.78:6831","nonce":3442991267}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6828","nonce":3442991267},{"type":"v1","addr":"172.21.15.78:6829","nonce":3442991267}]},"public_addr":"172.21.15.78:6825/3442991267","cluster_addr":"172.21.15.78:6827/3442991267","heartbeat_back_addr":"172.21.15.78:6831/3442991267","heartbeat_front_addr":"172.21.15.78:6829/3442991267","state":["exists","up"]},{"osd":4,"uuid":"5c62bc66-6b34-4b7f-a66b-9a743969138c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":802983577},{"type":"v1","addr":"172.21.15.179:6809","nonce":802983577}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":802983577},{"type":"v1","addr":"172.21.15.179:6811","nonce":802983577}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":802983577},{"type":"v1","addr":"172.21.15.179:6815","nonce":802983577}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":802983577},{"type":"v1","addr":"172.21.15.179:6813","nonce":802983577}]},"public_addr":"172.21.15.179:6809/802983577","cluster_addr":"172.21.15.179:6811/802983577","heartbeat_back_addr":"172.21.15.179:6815/802983577","heartbeat_front_addr":"172.21.15.179:6813/802983577","state":["exists","up"]},{"osd":5,"uuid":"67db6d36-f684-4079-b0cd-82b4dd61461f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":518192887},{"type":"v1","addr":"172.21.15.179:6818","nonce":518192887}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":518192887},{"type":"v1","addr":"172.21.15.179:6822","nonce":518192887}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":518192887},{"type":"v1","addr":"172.21.15.179:6829","nonce":518192887}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6824","nonce":518192887},{"type":"v1","addr":"172.21.15.179:6826","nonce":518192887}]},"public_addr":"172.21.15.179:6818/518192887","cluster_addr":"172.21.15.179:6822/518192887","heartbeat_back_addr":"172.21.15.179:6829/518192887","heartbeat_front_addr":"172.21.15.179:6826/518192887","state":["exists","up"]},{"osd":6,"uuid":"12e670af-5a16-4c81-9f97-defa66cab967","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":815435378},{"type":"v1","addr":"172.21.15.179:6801","nonce":815435378}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":815435378},{"type":"v1","addr":"172.21.15.179:6803","nonce":815435378}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":815435378},{"type":"v1","addr":"172.21.15.179:6807","nonce":815435378}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":815435378},{"type":"v1","addr":"172.21.15.179:6805","nonce":815435378}]},"public_addr":"172.21.15.179:6801/815435378","cluster_addr":"172.21.15.179:6803/815435378","heartbeat_back_addr":"172.21.15.179:6807/815435378","heartbeat_front_addr":"172.21.15.179:6805/815435378","state":["exists","up"]},{"osd":7,"uuid":"fe630650-2eb3-49ad-8676-c341e6332eb1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6817","nonce":2848432339},{"type":"v1","addr":"172.21.15.179:6819","nonce":2848432339}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6821","nonce":2848432339},{"type":"v1","addr":"172.21.15.179:6823","nonce":2848432339}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":2848432339},{"type":"v1","addr":"172.21.15.179:6831","nonce":2848432339}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6825","nonce":2848432339},{"type":"v1","addr":"172.21.15.179:6827","nonce":2848432339}]},"public_addr":"172.21.15.179:6819/2848432339","cluster_addr":"172.21.15.179:6823/2848432339","heartbeat_back_addr":"172.21.15.179:6831/2848432339","heartbeat_front_addr":"172.21.15.179:6827/2848432339","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:58:49.255433+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:58:49.412880+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:58:49.559295+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:58:49.245237+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:58:49.184557+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:58:49.329851+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:58:49.366012+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:58:49.349604+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.2","mappings":[{"from":5,"to":1}]},{"pgid":"3.8","mappings":[{"from":3,"to":2}]},{"pgid":"3.26","mappings":[{"from":7,"to":2}]},{"pgid":"3.30","mappings":[{"from":5,"to":2}]},{"pgid":"4.10","mappings":[{"from":1,"to":2}]},{"pgid":"4.14","mappings":[{"from":1,"to":5}]},{"pgid":"4.1d","mappings":[{"from":1,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-28T20:00:00.340 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:00.338+0000 7f4157701640 1 -- 172.21.15.78:0/585551520 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f41340664a0 msgr2=0x7f4134068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:00:00.340 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:00.338+0000 7f4157701640 1 --2- 172.21.15.78:0/585551520 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f41340664a0 0x7f4134068960 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f4150150f10 tx=0x7f414c009040 comp rx=0 tx=0).stop 2023-11-28T20:00:00.341 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:00.338+0000 7f4157701640 1 -- 172.21.15.78:0/585551520 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f41500a8730 msgr2=0x7f41501dda60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:00:00.341 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:00.338+0000 7f4157701640 1 --2- 172.21.15.78:0/585551520 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f41500a8730 0x7f41501dda60 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f41480b0040 tx=0x7f4148009750 comp rx=0 tx=0).stop 2023-11-28T20:00:00.341 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:00.338+0000 7f4157701640 1 -- 172.21.15.78:0/585551520 shutdown_connections 2023-11-28T20:00:00.341 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:00.338+0000 7f4157701640 1 --2- 172.21.15.78:0/585551520 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f41340664a0 0x7f4134068960 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:00.341 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:00.338+0000 7f4157701640 1 --2- 172.21.15.78:0/585551520 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f41500a8730 0x7f41501dda60 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:00.341 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:00.338+0000 7f4157701640 1 --2- 172.21.15.78:0/585551520 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f41501552e0 0x7f41501ee440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:00.341 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:00.338+0000 7f4157701640 1 --2- 172.21.15.78:0/585551520 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4150150700 0x7f41501ea6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:00.341 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:00.338+0000 7f4157701640 1 -- 172.21.15.78:0/585551520 >> 172.21.15.78:0/585551520 conn(0x7f41500a7810 msgr2=0x7f41500c41f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:00:00.341 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:00.338+0000 7f4157701640 1 -- 172.21.15.78:0/585551520 shutdown_connections 2023-11-28T20:00:00.342 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:00.338+0000 7f4157701640 1 -- 172.21.15.78:0/585551520 wait complete. 2023-11-28T20:00:00.359 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-11-28T20:00:00.497 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:00.494+0000 7f6038279640 1 Processor -- start 2023-11-28T20:00:00.497 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:00.494+0000 7f6038279640 1 -- start start 2023-11-28T20:00:00.498 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:00.494+0000 7f6038279640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f60300c4b90 0x7f6030155950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:00.498 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:00.494+0000 7f6038279640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f60300c6840 con 0x7f60300bd550 2023-11-28T20:00:00.498 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:00.494+0000 7f6038279640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6030158a00 con 0x7f60300c47b0 2023-11-28T20:00:00.498 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:00.494+0000 7f6038279640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f60300c4fa0 con 0x7f60300c4b90 2023-11-28T20:00:00.499 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:00.494+0000 7f6035814640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f60300bd550 0x7f60301582f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:45846/0 (socket says 172.21.15.78:45846) 2023-11-28T20:00:00.499 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:00.494+0000 7f6035814640 1 -- 172.21.15.78:0/646018566 learned_addr learned my addr 172.21.15.78:0/646018566 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-11-28T20:00:00.501 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:00.494+0000 7f6036816640 1 --2- 172.21.15.78:0/646018566 >> v2:172.21.15.179:3300/0 conn(0x7f60300c4b90 0x7f6030155950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:00.501 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:00.494+0000 7f6035013640 1 -- 172.21.15.78:0/646018566 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 839956957 0 0) 0x7f60300c6840 con 0x7f60300bd550 2023-11-28T20:00:00.501 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:00.494+0000 7f6035013640 1 -- 172.21.15.78:0/646018566 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f601c003530 con 0x7f60300bd550 2023-11-28T20:00:00.501 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:00.494+0000 7f6035013640 1 -- 172.21.15.78:0/646018566 <== mon.0 v1:172.21.15.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1556278824 0 0) 0x7f601c003530 con 0x7f60300bd550 2023-11-28T20:00:00.501 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:00.494+0000 7f6035013640 1 -- 172.21.15.78:0/646018566 >> v2:172.21.15.179:3300/0 conn(0x7f60300c4b90 msgr2=0x7f6030155950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:00:00.501 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:00.494+0000 7f6035013640 1 --2- 172.21.15.78:0/646018566 >> v2:172.21.15.179:3300/0 conn(0x7f60300c4b90 0x7f6030155950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:00.502 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:00.494+0000 7f6035013640 1 -- 172.21.15.78:0/646018566 >> v1:172.21.15.179:6789/0 conn(0x7f60300c47b0 legacy=0x7f6030154ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:00:00.502 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:00.494+0000 7f6035013640 1 -- 172.21.15.78:0/646018566 --> v1:172.21.15.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60300af870 con 0x7f60300bd550 2023-11-28T20:00:00.502 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:00.494+0000 7f6035013640 1 -- 172.21.15.78:0/646018566 <== mon.0 v1:172.21.15.78:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3326804700 0 0) 0x7f6020001680 con 0x7f60300bd550 2023-11-28T20:00:00.502 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:00.494+0000 7f6035013640 1 -- 172.21.15.78:0/646018566 >> v1:172.21.15.78:6789/0 conn(0x7f60300bd550 legacy=0x7f60301582f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:00:00.502 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:00.494+0000 7f6035013640 1 --2- 172.21.15.78:0/646018566 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f601c003980 0x7f601c003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:00.502 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:00.494+0000 7f6035013640 1 --2- 172.21.15.78:0/646018566 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f601c0047d0 0x7f601c004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:00.502 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:00.494+0000 7f6035013640 1 --2- 172.21.15.78:0/646018566 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f601c005190 0x7f601c00b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:00.502 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:00.494+0000 7f6035013640 1 -- 172.21.15.78:0/646018566 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60300c4fa0 con 0x7f601c003980 2023-11-28T20:00:00.502 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:00.494+0000 7f6035013640 1 -- 172.21.15.78:0/646018566 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f601c00c130 con 0x7f601c005190 2023-11-28T20:00:00.502 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:00.494+0000 7f6035013640 1 -- 172.21.15.78:0/646018566 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f601c00c2f0 con 0x7f601c0047d0 2023-11-28T20:00:00.502 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:00.498+0000 7f6036015640 1 --2- 172.21.15.78:0/646018566 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f601c003980 0x7f601c003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:00.503 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:00.498+0000 7f6036816640 1 --2- 172.21.15.78:0/646018566 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f601c005190 0x7f601c00b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:00.503 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:00.498+0000 7f6035814640 1 --2- 172.21.15.78:0/646018566 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f601c0047d0 0x7f601c004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:00.503 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:00.498+0000 7f6036015640 1 -- 172.21.15.78:0/646018566 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f601c0047d0 msgr2=0x7f601c004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:00:00.503 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:00.498+0000 7f6036015640 1 --2- 172.21.15.78:0/646018566 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f601c0047d0 0x7f601c004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:00.503 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:00.498+0000 7f6036015640 1 -- 172.21.15.78:0/646018566 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f601c005190 msgr2=0x7f601c00b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:00:00.503 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:00.498+0000 7f6036015640 1 --2- 172.21.15.78:0/646018566 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f601c005190 0x7f601c00b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:00.503 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:00.498+0000 7f6036015640 1 -- 172.21.15.78:0/646018566 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f601c003530 con 0x7f601c003980 2023-11-28T20:00:00.503 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:00.498+0000 7f6036816640 1 -- 172.21.15.78:0/646018566 reap_dead start 2023-11-28T20:00:00.503 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:00.498+0000 7f6035814640 1 --2- 172.21.15.78:0/646018566 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f601c0047d0 0x7f601c004c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T20:00:00.504 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:00.498+0000 7f6036015640 1 --2- 172.21.15.78:0/646018566 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f601c003980 0x7f601c003da0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f602c0015e0 tx=0x7f602c01c240 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b78dcf28a00264ad server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:00:00.504 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:00.498+0000 7f6035013640 1 -- 172.21.15.78:0/646018566 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f602c0052d0 con 0x7f601c003980 2023-11-28T20:00:00.505 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:00.498+0000 7f6035013640 1 -- 172.21.15.78:0/646018566 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f602c0a7050 con 0x7f601c003980 2023-11-28T20:00:00.505 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:00.498+0000 7f6035013640 1 -- 172.21.15.78:0/646018566 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f602c003600 con 0x7f601c003980 2023-11-28T20:00:00.505 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:00.502+0000 7f6038279640 1 -- 172.21.15.78:0/646018566 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f601c003980 msgr2=0x7f601c003da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:00:00.505 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:00.502+0000 7f6038279640 1 --2- 172.21.15.78:0/646018566 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f601c003980 0x7f601c003da0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f602c0015e0 tx=0x7f602c01c240 comp rx=0 tx=0).stop 2023-11-28T20:00:00.505 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:00.502+0000 7f6038279640 1 -- 172.21.15.78:0/646018566 shutdown_connections 2023-11-28T20:00:00.505 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:00.502+0000 7f6038279640 1 --2- 172.21.15.78:0/646018566 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f601c003980 0x7f601c003da0 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:00.505 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:00.502+0000 7f6038279640 1 -- 172.21.15.78:0/646018566 >> 172.21.15.78:0/646018566 conn(0x7f60300aba00 msgr2=0x7f60300abe10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:00:00.505 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:00.502+0000 7f6038279640 1 -- 172.21.15.78:0/646018566 shutdown_connections 2023-11-28T20:00:00.505 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:00.502+0000 7f6038279640 1 -- 172.21.15.78:0/646018566 wait complete. 2023-11-28T20:00:00.506 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:00.502+0000 7f6038279640 1 Processor -- start 2023-11-28T20:00:00.506 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:00.502+0000 7f6038279640 1 -- start start 2023-11-28T20:00:00.508 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:00.502+0000 7f6038279640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f601c003980 0x7f60301e24f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:00.508 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:00.502+0000 7f6038279640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f60301e1150 0x7f6030156c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:00.508 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:00.502+0000 7f6038279640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f60301e1570 0x7f60300bf8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:00.508 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:00.502+0000 7f6038279640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60301e2a30 con 0x7f60301e1570 2023-11-28T20:00:00.509 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:00.502+0000 7f6038279640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60300be4e0 con 0x7f60301e1150 2023-11-28T20:00:00.509 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:00.502+0000 7f6038279640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60301e2060 con 0x7f601c003980 2023-11-28T20:00:00.509 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:00.502+0000 7f6036816640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f60301e1570 0x7f60300bf8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:00.509 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:00.502+0000 7f6036816640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f60301e1570 0x7f60300bf8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:49132/0 (socket says 172.21.15.78:49132) 2023-11-28T20:00:00.509 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:00.502+0000 7f6036816640 1 -- 172.21.15.78:0/2470358074 learned_addr learned my addr 172.21.15.78:0/2470358074 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T20:00:00.509 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:00.502+0000 7f6036015640 1 --2- 172.21.15.78:0/2470358074 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f601c003980 0x7f60301e24f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:00.509 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:00.502+0000 7f6035814640 1 --2- 172.21.15.78:0/2470358074 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f60301e1150 0x7f6030156c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:00.509 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:00.502+0000 7f6036816640 1 -- 172.21.15.78:0/2470358074 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f601c003980 msgr2=0x7f60301e24f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:00:00.509 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:00.502+0000 7f6036816640 1 --2- 172.21.15.78:0/2470358074 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f601c003980 0x7f60301e24f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:00.509 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:00.502+0000 7f6036816640 1 -- 172.21.15.78:0/2470358074 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f60301e1150 msgr2=0x7f6030156c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:00:00.509 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:00.502+0000 7f6036816640 1 --2- 172.21.15.78:0/2470358074 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f60301e1150 0x7f6030156c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:00.509 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:00.502+0000 7f6036816640 1 -- 172.21.15.78:0/2470358074 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60300bf490 con 0x7f60301e1570 2023-11-28T20:00:00.510 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:00.506+0000 7f6036816640 1 --2- 172.21.15.78:0/2470358074 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f60301e1570 0x7f60300bf8b0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f60300a9760 tx=0x7f602800f580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:00:00.510 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:00.506+0000 7f6026ffd640 1 -- 172.21.15.78:0/2470358074 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f602800e040 con 0x7f60301e1570 2023-11-28T20:00:00.510 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:00.506+0000 7f6026ffd640 1 -- 172.21.15.78:0/2470358074 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f602800f040 con 0x7f60301e1570 2023-11-28T20:00:00.510 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:00.506+0000 7f6026ffd640 1 -- 172.21.15.78:0/2470358074 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6028015430 con 0x7f60301e1570 2023-11-28T20:00:00.510 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:00.506+0000 7f6038279640 1 -- 172.21.15.78:0/2470358074 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f60300a9d80 con 0x7f60301e1570 2023-11-28T20:00:00.510 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:00.506+0000 7f6038279640 1 -- 172.21.15.78:0/2470358074 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f60300bdd70 con 0x7f60301e1570 2023-11-28T20:00:00.512 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:00.506+0000 7f6038279640 1 -- 172.21.15.78:0/2470358074 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6030067630 con 0x7f60301e1570 2023-11-28T20:00:00.512 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:00.506+0000 7f6026ffd640 1 -- 172.21.15.78:0/2470358074 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f6028015590 con 0x7f60301e1570 2023-11-28T20:00:00.512 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:00.506+0000 7f6026ffd640 1 --2- 172.21.15.78:0/2470358074 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f60140664f0 0x7f60140689b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:00.512 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:00.506+0000 7f6026ffd640 1 -- 172.21.15.78:0/2470358074 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f6028084b00 con 0x7f60301e1570 2023-11-28T20:00:00.513 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:00.506+0000 7f6036015640 1 --2- 172.21.15.78:0/2470358074 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f60140664f0 0x7f60140689b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:00.513 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:00.510+0000 7f6036015640 1 --2- 172.21.15.78:0/2470358074 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f60140664f0 0x7f60140689b0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f602c0015b0 tx=0x7f602c0011a0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:00:00.514 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:00.510+0000 7f6026ffd640 1 -- 172.21.15.78:0/2470358074 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f6028051d30 con 0x7f60301e1570 2023-11-28T20:00:00.695 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:00.690+0000 7f6038279640 1 -- 172.21.15.78:0/2470358074 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f60301e21a0 con 0x7f60301e1570 2023-11-28T20:00:00.696 INFO:tasks.ceph.mon.a.smithi078.stderr:2023-11-28T20:00:00.694+0000 7f3f494a3640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-11-28T20:00:00.698 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:00.694+0000 7f6026ffd640 1 -- 172.21.15.78:0/2470358074 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v10) v1 ==== 161+0+0 (secure 0 0 0) 0x7f6028082e60 con 0x7f60301e1570 2023-11-28T20:00:00.698 INFO:teuthology.orchestra.run.smithi078.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-11-28T20:00:00.700 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:00.698+0000 7f6038279640 1 -- 172.21.15.78:0/2470358074 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f60140664f0 msgr2=0x7f60140689b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:00:00.701 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:00.698+0000 7f6038279640 1 --2- 172.21.15.78:0/2470358074 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f60140664f0 0x7f60140689b0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f602c0015b0 tx=0x7f602c0011a0 comp rx=0 tx=0).stop 2023-11-28T20:00:00.701 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:00.698+0000 7f6038279640 1 -- 172.21.15.78:0/2470358074 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f60301e1570 msgr2=0x7f60300bf8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:00:00.701 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:00.698+0000 7f6038279640 1 --2- 172.21.15.78:0/2470358074 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f60301e1570 0x7f60300bf8b0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f60300a9760 tx=0x7f602800f580 comp rx=0 tx=0).stop 2023-11-28T20:00:00.701 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:00.698+0000 7f6038279640 1 -- 172.21.15.78:0/2470358074 shutdown_connections 2023-11-28T20:00:00.701 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:00.698+0000 7f6038279640 1 --2- 172.21.15.78:0/2470358074 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f60140664f0 0x7f60140689b0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:00.701 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:00.698+0000 7f6038279640 1 --2- 172.21.15.78:0/2470358074 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f60301e1570 0x7f60300bf8b0 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:00.701 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:00.698+0000 7f6038279640 1 --2- 172.21.15.78:0/2470358074 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f60301e1150 0x7f6030156c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:00.701 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:00.698+0000 7f6038279640 1 --2- 172.21.15.78:0/2470358074 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f601c003980 0x7f60301e24f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:00.701 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:00.698+0000 7f6038279640 1 -- 172.21.15.78:0/2470358074 >> 172.21.15.78:0/2470358074 conn(0x7f60300aba00 msgr2=0x7f60300aacb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:00:00.702 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:00.698+0000 7f6038279640 1 -- 172.21.15.78:0/2470358074 shutdown_connections 2023-11-28T20:00:00.702 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:00.698+0000 7f6038279640 1 -- 172.21.15.78:0/2470358074 wait complete. 2023-11-28T20:00:00.710 INFO:tasks.ceph.mds.b.smithi179.stderr: -3358> 2023-11-28T19:59:10.326+0000 7fb7b8672640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-11-28T20:00:00.721 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-11-28T20:00:00.761 INFO:tasks.ceph.mds.b.smithi179.stdout:starting mds.b at 2023-11-28T20:00:00.862 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:00.858+0000 7f7222e79640 1 Processor -- start 2023-11-28T20:00:00.862 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:00.858+0000 7f7222e79640 1 -- start start 2023-11-28T20:00:00.863 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:00.858+0000 7f7222e79640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f721c14b1e0 0x7f721c0c1700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:00.863 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:00.858+0000 7f7222e79640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f721c1548c0 0x7f721c154d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:00.863 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:00.858+0000 7f7222e79640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f721c0a4e20 con 0x7f721c0c5300 2023-11-28T20:00:00.863 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:00.858+0000 7f7222e79640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f721c0a50e0 con 0x7f721c14b1e0 2023-11-28T20:00:00.863 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:00.858+0000 7f7222e79640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f721c0c0f00 con 0x7f721c1548c0 2023-11-28T20:00:00.863 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:00.858+0000 7f721bfff640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f721c0c5300 0x7f721c0a9c30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:45850/0 (socket says 172.21.15.78:45850) 2023-11-28T20:00:00.863 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:00.858+0000 7f721bfff640 1 -- 172.21.15.78:0/3014413554 learned_addr learned my addr 172.21.15.78:0/3014413554 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-11-28T20:00:00.863 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:00.858+0000 7f7220c15640 1 --2- 172.21.15.78:0/3014413554 >> v2:172.21.15.78:3300/0 conn(0x7f721c14b1e0 0x7f721c0c1700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:00.864 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:00.858+0000 7f7221416640 1 --2- 172.21.15.78:0/3014413554 >> v2:172.21.15.179:3300/0 conn(0x7f721c1548c0 0x7f721c154d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:00.864 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:00.862+0000 7f7220c15640 1 -- 172.21.15.78:0/3014413554 >> v2:172.21.15.179:3300/0 conn(0x7f721c1548c0 msgr2=0x7f721c154d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:00:00.864 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:00.862+0000 7f7220c15640 1 --2- 172.21.15.78:0/3014413554 >> v2:172.21.15.179:3300/0 conn(0x7f721c1548c0 0x7f721c154d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:00.864 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:00.862+0000 7f7220c15640 1 -- 172.21.15.78:0/3014413554 >> v1:172.21.15.78:6789/0 conn(0x7f721c0c5300 legacy=0x7f721c0a9c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:00:00.864 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:00.862+0000 7f7220c15640 1 -- 172.21.15.78:0/3014413554 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f721c0c11e0 con 0x7f721c14b1e0 2023-11-28T20:00:00.864 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:00.862+0000 7f721b7fe640 1 -- 172.21.15.78:0/3014413554 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 465017377 0 0) 0x7f721c0a4e20 con 0x7f721c0c5300 2023-11-28T20:00:00.866 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:00.862+0000 7f7220c15640 1 --2- 172.21.15.78:0/3014413554 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f721c14b1e0 0x7f721c0c1700 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f721c0c5850 tx=0x7f721001c460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e0dcd8d382cea06d server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:00:00.867 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:00.862+0000 7f721b7fe640 1 -- 172.21.15.78:0/3014413554 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72100ab600 con 0x7f721c14b1e0 2023-11-28T20:00:00.867 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:00.862+0000 7f721b7fe640 1 -- 172.21.15.78:0/3014413554 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f72100a7050 con 0x7f721c14b1e0 2023-11-28T20:00:00.867 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:00.862+0000 7f721b7fe640 1 -- 172.21.15.78:0/3014413554 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72100ab980 con 0x7f721c14b1e0 2023-11-28T20:00:00.868 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:00.862+0000 7f7222e79640 1 -- 172.21.15.78:0/3014413554 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f721c14b1e0 msgr2=0x7f721c0c1700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:00:00.869 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:00.862+0000 7f7222e79640 1 --2- 172.21.15.78:0/3014413554 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f721c14b1e0 0x7f721c0c1700 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f721c0c5850 tx=0x7f721001c460 comp rx=0 tx=0).stop 2023-11-28T20:00:00.869 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:00.866+0000 7f7222e79640 1 -- 172.21.15.78:0/3014413554 shutdown_connections 2023-11-28T20:00:00.869 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:00.866+0000 7f7222e79640 1 --2- 172.21.15.78:0/3014413554 >> v2:172.21.15.179:3300/0 conn(0x7f721c1548c0 0x7f721c154d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:00.869 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:00.866+0000 7f7222e79640 1 --2- 172.21.15.78:0/3014413554 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f721c14b1e0 0x7f721c0c1700 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:00.869 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:00.866+0000 7f7222e79640 1 -- 172.21.15.78:0/3014413554 >> 172.21.15.78:0/3014413554 conn(0x7f721c0c59f0 msgr2=0x7f721c0c5e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:00:00.869 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:00.866+0000 7f7222e79640 1 -- 172.21.15.78:0/3014413554 shutdown_connections 2023-11-28T20:00:00.869 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:00.866+0000 7f7222e79640 1 -- 172.21.15.78:0/3014413554 wait complete. 2023-11-28T20:00:00.869 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:00.866+0000 7f7222e79640 1 Processor -- start 2023-11-28T20:00:00.870 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:00.866+0000 7f7222e79640 1 -- start start 2023-11-28T20:00:00.871 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:00.866+0000 7f7222e79640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f721c0c5300 0x7f721c14f140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:00.871 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:00.866+0000 7f7222e79640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f721c14b1e0 0x7f721c0aac70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:00.872 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:00.866+0000 7f7222e79640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f721c1548c0 0x7f721c145d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:00.872 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:00.866+0000 7f7222e79640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f721c070fe0 con 0x7f721c0c5300 2023-11-28T20:00:00.872 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:00.866+0000 7f7222e79640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f721c070d00 con 0x7f721c1548c0 2023-11-28T20:00:00.872 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:00.866+0000 7f7222e79640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f721c150b50 con 0x7f721c14b1e0 2023-11-28T20:00:00.872 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:00.866+0000 7f7220c15640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f721c0c5300 0x7f721c14f140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:00.872 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:00.866+0000 7f7220c15640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f721c0c5300 0x7f721c14f140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:49146/0 (socket says 172.21.15.78:49146) 2023-11-28T20:00:00.872 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:00.866+0000 7f7220c15640 1 -- 172.21.15.78:0/2551284772 learned_addr learned my addr 172.21.15.78:0/2551284772 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T20:00:00.872 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:00.866+0000 7f7220c15640 1 -- 172.21.15.78:0/2551284772 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f721c14b1e0 msgr2=0x7f721c0aac70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:00:00.872 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:00.866+0000 7f7220c15640 1 --2- 172.21.15.78:0/2551284772 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f721c14b1e0 0x7f721c0aac70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:00.872 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:00.866+0000 7f7220c15640 1 -- 172.21.15.78:0/2551284772 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f721c1548c0 msgr2=0x7f721c145d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:00:00.872 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:00.866+0000 7f7220c15640 1 --2- 172.21.15.78:0/2551284772 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f721c1548c0 0x7f721c145d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:00.873 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:00.866+0000 7f7220c15640 1 -- 172.21.15.78:0/2551284772 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7210009420 con 0x7f721c0c5300 2023-11-28T20:00:00.873 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:00.866+0000 7f7220c15640 1 --2- 172.21.15.78:0/2551284772 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f721c0c5300 0x7f721c14f140 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f72100ae040 tx=0x7f7210019200 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:00:00.873 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:00.866+0000 7f72197fa640 1 -- 172.21.15.78:0/2551284772 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72100b4410 con 0x7f721c0c5300 2023-11-28T20:00:00.874 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:00.866+0000 7f72197fa640 1 -- 172.21.15.78:0/2551284772 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f72100b4570 con 0x7f721c0c5300 2023-11-28T20:00:00.874 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:00.870+0000 7f72197fa640 1 -- 172.21.15.78:0/2551284772 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72100b4900 con 0x7f721c0c5300 2023-11-28T20:00:00.874 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:00.870+0000 7f7222e79640 1 -- 172.21.15.78:0/2551284772 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f721c150e30 con 0x7f721c0c5300 2023-11-28T20:00:00.874 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:00.870+0000 7f7222e79640 1 -- 172.21.15.78:0/2551284772 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f721c0ab1b0 con 0x7f721c0c5300 2023-11-28T20:00:00.876 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:00.870+0000 7f7222e79640 1 -- 172.21.15.78:0/2551284772 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f721c150990 con 0x7f721c0c5300 2023-11-28T20:00:00.876 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:00.870+0000 7f72197fa640 1 -- 172.21.15.78:0/2551284772 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f72100b2040 con 0x7f721c0c5300 2023-11-28T20:00:00.876 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:00.870+0000 7f72197fa640 1 --2- 172.21.15.78:0/2551284772 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f7200066470 0x7f7200068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:00.876 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:00.870+0000 7f72197fa640 1 -- 172.21.15.78:0/2551284772 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6749+0+0 (secure 0 0 0) 0x7f721011e320 con 0x7f721c0c5300 2023-11-28T20:00:00.876 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:00.870+0000 7f721bfff640 1 --2- 172.21.15.78:0/2551284772 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f7200066470 0x7f7200068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:00.876 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:00.870+0000 7f721bfff640 1 --2- 172.21.15.78:0/2551284772 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f7200066470 0x7f7200068930 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f72080011f0 tx=0x7f7208007930 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:00:00.879 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:00.874+0000 7f72197fa640 1 -- 172.21.15.78:0/2551284772 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f72100eb4a0 con 0x7f721c0c5300 2023-11-28T20:00:01.066 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:01.062+0000 7f7222e79640 1 -- 172.21.15.78:0/2551284772 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f721c067630 con 0x7f721c0c5300 2023-11-28T20:00:01.759 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:01.754+0000 7f72197fa640 1 -- 172.21.15.78:0/2551284772 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v11) v1 ==== 104+0+0 (secure 0 0 0) 0x7f72100eeac0 con 0x7f721c0c5300 2023-11-28T20:00:01.763 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:01.758+0000 7f7222e79640 1 -- 172.21.15.78:0/2551284772 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f7200066470 msgr2=0x7f7200068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:00:01.763 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:01.758+0000 7f7222e79640 1 --2- 172.21.15.78:0/2551284772 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f7200066470 0x7f7200068930 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f72080011f0 tx=0x7f7208007930 comp rx=0 tx=0).stop 2023-11-28T20:00:01.763 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:01.758+0000 7f7222e79640 1 -- 172.21.15.78:0/2551284772 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f721c0c5300 msgr2=0x7f721c14f140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:00:01.763 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:01.758+0000 7f7222e79640 1 --2- 172.21.15.78:0/2551284772 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f721c0c5300 0x7f721c14f140 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f72100ae040 tx=0x7f7210019200 comp rx=0 tx=0).stop 2023-11-28T20:00:01.763 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:01.758+0000 7f7222e79640 1 -- 172.21.15.78:0/2551284772 shutdown_connections 2023-11-28T20:00:01.763 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:01.758+0000 7f7222e79640 1 --2- 172.21.15.78:0/2551284772 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f7200066470 0x7f7200068930 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:01.763 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:01.758+0000 7f7222e79640 1 --2- 172.21.15.78:0/2551284772 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f721c14b1e0 0x7f721c0aac70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:01.763 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:01.758+0000 7f7222e79640 1 --2- 172.21.15.78:0/2551284772 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f721c1548c0 0x7f721c145d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:01.763 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:01.758+0000 7f7222e79640 1 --2- 172.21.15.78:0/2551284772 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f721c0c5300 0x7f721c14f140 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:01.764 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:01.758+0000 7f7222e79640 1 -- 172.21.15.78:0/2551284772 >> 172.21.15.78:0/2551284772 conn(0x7f721c0c59f0 msgr2=0x7f721c1534b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:00:01.764 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:01.758+0000 7f7222e79640 1 -- 172.21.15.78:0/2551284772 shutdown_connections 2023-11-28T20:00:01.764 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:01.758+0000 7f7222e79640 1 -- 172.21.15.78:0/2551284772 wait complete. 2023-11-28T20:00:01.788 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-11-28T20:00:01.931 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:01.926+0000 7f5057ed6640 1 Processor -- start 2023-11-28T20:00:01.931 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:01.930+0000 7f5057ed6640 1 -- start start 2023-11-28T20:00:01.933 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:01.930+0000 7f5057ed6640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f505014b1e0 0x7f50500c1700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:01.933 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:01.930+0000 7f5057ed6640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f50500a4e20 con 0x7f50501548c0 2023-11-28T20:00:01.933 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:01.930+0000 7f5057ed6640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f50500a50e0 con 0x7f50500c5300 2023-11-28T20:00:01.933 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:01.930+0000 7f5057ed6640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f50500c0f00 con 0x7f505014b1e0 2023-11-28T20:00:01.934 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:01.930+0000 7f5056473640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f50501548c0 0x7f5050154d30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:45862/0 (socket says 172.21.15.78:45862) 2023-11-28T20:00:01.934 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:01.930+0000 7f5056473640 1 -- 172.21.15.78:0/3037896121 learned_addr learned my addr 172.21.15.78:0/3037896121 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-11-28T20:00:01.936 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:01.930+0000 7f5054c70640 1 -- 172.21.15.78:0/3037896121 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 394558971 0 0) 0x7f50500a4e20 con 0x7f50501548c0 2023-11-28T20:00:01.937 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:01.930+0000 7f5054c70640 1 -- 172.21.15.78:0/3037896121 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f503c003530 con 0x7f50501548c0 2023-11-28T20:00:01.937 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:01.930+0000 7f5055c72640 1 --2- 172.21.15.78:0/3037896121 >> v2:172.21.15.179:3300/0 conn(0x7f505014b1e0 0x7f50500c1700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:01.937 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:01.930+0000 7f5054c70640 1 -- 172.21.15.78:0/3037896121 <== mon.0 v1:172.21.15.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1000681300 0 0) 0x7f503c003530 con 0x7f50501548c0 2023-11-28T20:00:01.937 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:01.930+0000 7f5054c70640 1 -- 172.21.15.78:0/3037896121 >> v2:172.21.15.179:3300/0 conn(0x7f505014b1e0 msgr2=0x7f50500c1700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:00:01.938 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:01.930+0000 7f5054c70640 1 --2- 172.21.15.78:0/3037896121 >> v2:172.21.15.179:3300/0 conn(0x7f505014b1e0 0x7f50500c1700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:01.938 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:01.930+0000 7f5054c70640 1 -- 172.21.15.78:0/3037896121 >> v1:172.21.15.179:6789/0 conn(0x7f50500c5300 legacy=0x7f50500a9c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:00:01.938 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:01.930+0000 7f5054c70640 1 -- 172.21.15.78:0/3037896121 --> v1:172.21.15.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50500c11e0 con 0x7f50501548c0 2023-11-28T20:00:01.938 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:01.930+0000 7f5054c70640 1 -- 172.21.15.78:0/3037896121 <== mon.0 v1:172.21.15.78:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3326804700 0 0) 0x7f5048001a00 con 0x7f50501548c0 2023-11-28T20:00:01.939 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:01.930+0000 7f5054c70640 1 -- 172.21.15.78:0/3037896121 >> v1:172.21.15.78:6789/0 conn(0x7f50501548c0 legacy=0x7f5050154d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:00:01.939 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:01.930+0000 7f5054c70640 1 --2- 172.21.15.78:0/3037896121 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f503c003980 0x7f503c003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:01.939 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:01.930+0000 7f5054c70640 1 --2- 172.21.15.78:0/3037896121 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f503c0047d0 0x7f503c004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:01.939 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:01.930+0000 7f5054c70640 1 --2- 172.21.15.78:0/3037896121 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f503c005190 0x7f503c00b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:01.939 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:01.930+0000 7f5054c70640 1 -- 172.21.15.78:0/3037896121 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50500c0f00 con 0x7f503c005190 2023-11-28T20:00:01.940 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:01.930+0000 7f5054c70640 1 -- 172.21.15.78:0/3037896121 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f503c00c0e0 con 0x7f503c003980 2023-11-28T20:00:01.940 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:01.930+0000 7f5054c70640 1 -- 172.21.15.78:0/3037896121 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f503c00c2a0 con 0x7f503c0047d0 2023-11-28T20:00:01.940 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:01.930+0000 7f5056473640 1 --2- 172.21.15.78:0/3037896121 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f503c005190 0x7f503c00b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:01.940 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:01.930+0000 7f5055c72640 1 --2- 172.21.15.78:0/3037896121 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f503c003980 0x7f503c003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:01.941 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:01.930+0000 7f5055471640 1 --2- 172.21.15.78:0/3037896121 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f503c0047d0 0x7f503c004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:01.941 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:01.930+0000 7f5056473640 1 -- 172.21.15.78:0/3037896121 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f503c0047d0 msgr2=0x7f503c004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:00:01.941 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:01.930+0000 7f5056473640 1 --2- 172.21.15.78:0/3037896121 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f503c0047d0 0x7f503c004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:01.941 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:01.930+0000 7f5056473640 1 -- 172.21.15.78:0/3037896121 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f503c003980 msgr2=0x7f503c003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:00:01.941 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:01.930+0000 7f5056473640 1 --2- 172.21.15.78:0/3037896121 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f503c003980 0x7f503c003da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:01.942 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:01.930+0000 7f5056473640 1 -- 172.21.15.78:0/3037896121 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f503c003530 con 0x7f503c005190 2023-11-28T20:00:01.945 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:01.934+0000 7f5056473640 1 -- 172.21.15.78:0/3037896121 reap_dead start 2023-11-28T20:00:01.945 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:01.934+0000 7f5056473640 1 --2- 172.21.15.78:0/3037896121 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f503c005190 0x7f503c00b990 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f504800a830 tx=0x7f504801d340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6b98bc9cc2ac5159 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:00:01.946 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:01.934+0000 7f5054c70640 1 -- 172.21.15.78:0/3037896121 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50480072d0 con 0x7f503c005190 2023-11-28T20:00:01.946 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:01.934+0000 7f5054c70640 1 -- 172.21.15.78:0/3037896121 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f50480a8070 con 0x7f503c005190 2023-11-28T20:00:01.946 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:01.934+0000 7f5054c70640 1 -- 172.21.15.78:0/3037896121 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50480076b0 con 0x7f503c005190 2023-11-28T20:00:01.946 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:01.934+0000 7f5057ed6640 1 -- 172.21.15.78:0/3037896121 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f503c005190 msgr2=0x7f503c00b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:00:01.947 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:01.934+0000 7f5057ed6640 1 --2- 172.21.15.78:0/3037896121 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f503c005190 0x7f503c00b990 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f504800a830 tx=0x7f504801d340 comp rx=0 tx=0).stop 2023-11-28T20:00:01.947 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:01.934+0000 7f5057ed6640 1 -- 172.21.15.78:0/3037896121 shutdown_connections 2023-11-28T20:00:01.947 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:01.934+0000 7f5057ed6640 1 --2- 172.21.15.78:0/3037896121 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f503c005190 0x7f503c00b990 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:01.947 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:01.934+0000 7f5057ed6640 1 -- 172.21.15.78:0/3037896121 >> 172.21.15.78:0/3037896121 conn(0x7f50500c59f0 msgr2=0x7f50500c5e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:00:01.948 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:01.934+0000 7f5057ed6640 1 -- 172.21.15.78:0/3037896121 shutdown_connections 2023-11-28T20:00:01.948 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:01.934+0000 7f5057ed6640 1 -- 172.21.15.78:0/3037896121 wait complete. 2023-11-28T20:00:01.948 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:01.938+0000 7f5057ed6640 1 Processor -- start 2023-11-28T20:00:01.948 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:01.938+0000 7f5057ed6640 1 -- start start 2023-11-28T20:00:01.949 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:01.938+0000 7f5057ed6640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f503c005190 0x7f50501ed6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:01.949 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:01.938+0000 7f5057ed6640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f50501da7d0 0x7f50501dac30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:01.949 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:01.938+0000 7f5057ed6640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f505013d7c0 0x7f505013dc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:01.949 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:01.938+0000 7f5057ed6640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50501ee240 con 0x7f50501da7d0 2023-11-28T20:00:01.949 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:01.938+0000 7f5057ed6640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50501da0c0 con 0x7f503c005190 2023-11-28T20:00:01.950 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:01.938+0000 7f5057ed6640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f50501dc8b0 con 0x7f505013d7c0 2023-11-28T20:00:01.950 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:01.938+0000 7f5055471640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f50501da7d0 0x7f50501dac30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:01.950 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:01.938+0000 7f5055471640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f50501da7d0 0x7f50501dac30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:49172/0 (socket says 172.21.15.78:49172) 2023-11-28T20:00:01.950 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:01.938+0000 7f5055471640 1 -- 172.21.15.78:0/2016071381 learned_addr learned my addr 172.21.15.78:0/2016071381 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T20:00:01.950 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:01.938+0000 7f5056473640 1 --2- 172.21.15.78:0/2016071381 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f505013d7c0 0x7f505013dc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:01.951 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:01.938+0000 7f5055c72640 1 --2- 172.21.15.78:0/2016071381 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f503c005190 0x7f50501ed6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:01.951 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:01.938+0000 7f5055471640 1 -- 172.21.15.78:0/2016071381 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f505013d7c0 msgr2=0x7f505013dc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:00:01.951 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:01.938+0000 7f5055471640 1 --2- 172.21.15.78:0/2016071381 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f505013d7c0 0x7f505013dc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:01.951 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:01.938+0000 7f5055471640 1 -- 172.21.15.78:0/2016071381 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f503c005190 msgr2=0x7f50501ed6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:00:01.951 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:01.938+0000 7f5055471640 1 --2- 172.21.15.78:0/2016071381 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f503c005190 0x7f50501ed6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:01.952 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:01.938+0000 7f5055471640 1 -- 172.21.15.78:0/2016071381 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50501edfa0 con 0x7f50501da7d0 2023-11-28T20:00:01.952 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:01.938+0000 7f5055471640 1 --2- 172.21.15.78:0/2016071381 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f50501da7d0 0x7f50501dac30 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f504000f510 tx=0x7f504000f9d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:00:01.952 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:01.938+0000 7f50467fc640 1 -- 172.21.15.78:0/2016071381 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50400052e0 con 0x7f50501da7d0 2023-11-28T20:00:01.952 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:01.938+0000 7f50467fc640 1 -- 172.21.15.78:0/2016071381 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5040005440 con 0x7f50501da7d0 2023-11-28T20:00:01.952 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:01.938+0000 7f50467fc640 1 -- 172.21.15.78:0/2016071381 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5040003820 con 0x7f50501da7d0 2023-11-28T20:00:01.952 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:01.938+0000 7f5057ed6640 1 -- 172.21.15.78:0/2016071381 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f50501d9ba0 con 0x7f50501da7d0 2023-11-28T20:00:01.953 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:01.938+0000 7f5057ed6640 1 -- 172.21.15.78:0/2016071381 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f505006d500 con 0x7f50501da7d0 2023-11-28T20:00:01.953 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:01.938+0000 7f5057ed6640 1 -- 172.21.15.78:0/2016071381 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f50501d9a00 con 0x7f50501da7d0 2023-11-28T20:00:01.953 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:01.942+0000 7f50467fc640 1 -- 172.21.15.78:0/2016071381 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f5040003980 con 0x7f50501da7d0 2023-11-28T20:00:01.953 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:01.942+0000 7f50467fc640 1 --2- 172.21.15.78:0/2016071381 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f5034066490 0x7f5034068950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:01.953 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:01.942+0000 7f50467fc640 1 -- 172.21.15.78:0/2016071381 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6749+0+0 (secure 0 0 0) 0x7f5040083ef0 con 0x7f50501da7d0 2023-11-28T20:00:01.954 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:01.942+0000 7f5055c72640 1 --2- 172.21.15.78:0/2016071381 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f5034066490 0x7f5034068950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:01.954 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:01.942+0000 7f5055c72640 1 --2- 172.21.15.78:0/2016071381 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f5034066490 0x7f5034068950 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f504c003670 tx=0x7f504c008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:00:01.954 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:01.946+0000 7f50467fc640 1 -- 172.21.15.78:0/2016071381 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f50501d9a00 con 0x7f50501da7d0 2023-11-28T20:00:02.101 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:02.098+0000 7f5057ed6640 1 -- 172.21.15.78:0/2016071381 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f50501d9a00 con 0x7f50501da7d0 2023-11-28T20:00:03.057 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:03.054+0000 7f50467fc640 1 -- 172.21.15.78:0/2016071381 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v29) v1 ==== 181+0+0 (secure 0 0 0) 0x7f50501d9a00 con 0x7f50501da7d0 2023-11-28T20:00:03.057 INFO:teuthology.orchestra.run.smithi078.stderr:pool 'cephfs_metadata' removed 2023-11-28T20:00:03.060 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:03.054+0000 7f5057ed6640 1 -- 172.21.15.78:0/2016071381 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f5034066490 msgr2=0x7f5034068950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:00:03.060 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:03.054+0000 7f5057ed6640 1 --2- 172.21.15.78:0/2016071381 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f5034066490 0x7f5034068950 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f504c003670 tx=0x7f504c008040 comp rx=0 tx=0).stop 2023-11-28T20:00:03.061 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:03.054+0000 7f5057ed6640 1 -- 172.21.15.78:0/2016071381 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f50501da7d0 msgr2=0x7f50501dac30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:00:03.061 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:03.058+0000 7f5057ed6640 1 --2- 172.21.15.78:0/2016071381 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f50501da7d0 0x7f50501dac30 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f504000f510 tx=0x7f504000f9d0 comp rx=0 tx=0).stop 2023-11-28T20:00:03.061 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:03.058+0000 7f5057ed6640 1 -- 172.21.15.78:0/2016071381 shutdown_connections 2023-11-28T20:00:03.061 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:03.058+0000 7f5057ed6640 1 --2- 172.21.15.78:0/2016071381 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f5034066490 0x7f5034068950 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:03.061 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:03.058+0000 7f5057ed6640 1 --2- 172.21.15.78:0/2016071381 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f505013d7c0 0x7f505013dc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:03.062 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:03.058+0000 7f5057ed6640 1 --2- 172.21.15.78:0/2016071381 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f50501da7d0 0x7f50501dac30 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:03.062 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:03.058+0000 7f5057ed6640 1 --2- 172.21.15.78:0/2016071381 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f503c005190 0x7f50501ed6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:03.062 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:03.058+0000 7f5057ed6640 1 -- 172.21.15.78:0/2016071381 >> 172.21.15.78:0/2016071381 conn(0x7f50500c59f0 msgr2=0x7f50500c4180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:00:03.062 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:03.058+0000 7f5057ed6640 1 -- 172.21.15.78:0/2016071381 shutdown_connections 2023-11-28T20:00:03.062 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:03.058+0000 7f5057ed6640 1 -- 172.21.15.78:0/2016071381 wait complete. 2023-11-28T20:00:03.088 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-11-28T20:00:03.242 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:03.238+0000 7f460a432640 1 Processor -- start 2023-11-28T20:00:03.242 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:03.238+0000 7f460a432640 1 -- start start 2023-11-28T20:00:03.243 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:03.238+0000 7f460a432640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f460414b1e0 0x7f46040c1700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:03.243 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:03.238+0000 7f460a432640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f46040c5300 0x7f46040a9c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:03.244 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:03.238+0000 7f460a432640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f46040a4e20 con 0x7f4604151280 2023-11-28T20:00:03.244 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:03.238+0000 7f460a432640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f46041558d0 con 0x7f460414b1e0 2023-11-28T20:00:03.244 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:03.238+0000 7f460a432640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f46040a50e0 con 0x7f46040c5300 2023-11-28T20:00:03.244 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:03.242+0000 7f4603fff640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f460414b1e0 0x7f46040c1700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:03.244 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:03.242+0000 7f45fbfff640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f46040c5300 0x7f46040a9c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:03.245 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:03.242+0000 7f46089cf640 1 --1- >> v1:172.21.15.179:6789/0 conn(0x7f4604151280 0x7f4604151710 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.179:6789/0 says I am v1:172.21.15.78:37526/0 (socket says 172.21.15.78:37526) 2023-11-28T20:00:03.245 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:03.242+0000 7f46089cf640 1 -- 172.21.15.78:0/1352191007 learned_addr learned my addr 172.21.15.78:0/1352191007 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-11-28T20:00:03.246 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:03.242+0000 7f4603fff640 1 -- 172.21.15.78:0/1352191007 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f46040c5300 msgr2=0x7f46040a9c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:00:03.246 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:03.242+0000 7f4603fff640 1 --2- 172.21.15.78:0/1352191007 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f46040c5300 0x7f46040a9c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:03.246 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:03.242+0000 7f4603fff640 1 -- 172.21.15.78:0/1352191007 >> v1:172.21.15.179:6789/0 conn(0x7f4604151280 legacy=0x7f4604151710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:00:03.246 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:03.242+0000 7f4603fff640 1 -- 172.21.15.78:0/1352191007 --> v2:172.21.15.179:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46040c0f00 con 0x7f460414b1e0 2023-11-28T20:00:03.246 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:03.242+0000 7f45fbfff640 1 --2- 172.21.15.78:0/1352191007 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f46040c5300 0x7f46040a9c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T20:00:03.247 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:03.242+0000 7f4603fff640 1 --2- 172.21.15.78:0/1352191007 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f460414b1e0 0x7f46040c1700 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f45f40097c0 tx=0x7f45f401c480 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f2b1595ee805092 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:00:03.247 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:03.242+0000 7f46037fe640 1 -- 172.21.15.78:0/1352191007 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45f40ad640 con 0x7f460414b1e0 2023-11-28T20:00:03.248 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:03.242+0000 7f46037fe640 1 -- 172.21.15.78:0/1352191007 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f45f40ad7a0 con 0x7f460414b1e0 2023-11-28T20:00:03.248 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:03.246+0000 7f46037fe640 1 -- 172.21.15.78:0/1352191007 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45f40adb30 con 0x7f460414b1e0 2023-11-28T20:00:03.249 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:03.246+0000 7f460a432640 1 -- 172.21.15.78:0/1352191007 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f460414b1e0 msgr2=0x7f46040c1700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:00:03.249 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:03.246+0000 7f460a432640 1 --2- 172.21.15.78:0/1352191007 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f460414b1e0 0x7f46040c1700 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f45f40097c0 tx=0x7f45f401c480 comp rx=0 tx=0).stop 2023-11-28T20:00:03.249 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:03.246+0000 7f460a432640 1 -- 172.21.15.78:0/1352191007 shutdown_connections 2023-11-28T20:00:03.249 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:03.246+0000 7f460a432640 1 --2- 172.21.15.78:0/1352191007 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f46040c5300 0x7f46040a9c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:03.249 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:03.246+0000 7f460a432640 1 --2- 172.21.15.78:0/1352191007 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f460414b1e0 0x7f46040c1700 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:03.250 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:03.246+0000 7f460a432640 1 -- 172.21.15.78:0/1352191007 >> 172.21.15.78:0/1352191007 conn(0x7f46040c59f0 msgr2=0x7f46040c5e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:00:03.250 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:03.246+0000 7f460a432640 1 -- 172.21.15.78:0/1352191007 shutdown_connections 2023-11-28T20:00:03.250 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:03.246+0000 7f460a432640 1 -- 172.21.15.78:0/1352191007 wait complete. 2023-11-28T20:00:03.253 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:03.246+0000 7f460a432640 1 Processor -- start 2023-11-28T20:00:03.253 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:03.246+0000 7f460a432640 1 -- start start 2023-11-28T20:00:03.253 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:03.246+0000 7f460a432640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f46040c5300 0x7f4604145cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:03.253 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:03.246+0000 7f460a432640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f460414b1e0 0x7f4604144770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:03.253 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:03.246+0000 7f460a432640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4604151280 0x7f46041439a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:03.253 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:03.246+0000 7f460a432640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46041eaac0 con 0x7f460414b1e0 2023-11-28T20:00:03.254 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:03.246+0000 7f460a432640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f460413ea00 con 0x7f4604151280 2023-11-28T20:00:03.254 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:03.246+0000 7f460a432640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f46041eb2e0 con 0x7f46040c5300 2023-11-28T20:00:03.254 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:03.246+0000 7f45fbfff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f460414b1e0 0x7f4604144770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:03.254 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:03.246+0000 7f45fbfff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f460414b1e0 0x7f4604144770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:49176/0 (socket says 172.21.15.78:49176) 2023-11-28T20:00:03.254 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:03.246+0000 7f45fbfff640 1 -- 172.21.15.78:0/1483035560 learned_addr learned my addr 172.21.15.78:0/1483035560 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T20:00:03.254 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:03.246+0000 7f4603fff640 1 --2- 172.21.15.78:0/1483035560 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f46040c5300 0x7f4604145cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:03.255 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:03.246+0000 7f46089cf640 1 --2- 172.21.15.78:0/1483035560 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4604151280 0x7f46041439a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:03.255 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:03.250+0000 7f45fbfff640 1 -- 172.21.15.78:0/1483035560 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f46040c5300 msgr2=0x7f4604145cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:00:03.255 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:03.250+0000 7f45fbfff640 1 --2- 172.21.15.78:0/1483035560 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f46040c5300 0x7f4604145cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:03.255 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:03.250+0000 7f45fbfff640 1 -- 172.21.15.78:0/1483035560 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4604151280 msgr2=0x7f46041439a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:00:03.255 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:03.250+0000 7f45fbfff640 1 --2- 172.21.15.78:0/1483035560 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4604151280 0x7f46041439a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:03.256 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:03.250+0000 7f45fbfff640 1 -- 172.21.15.78:0/1483035560 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45ec009420 con 0x7f460414b1e0 2023-11-28T20:00:03.256 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:03.250+0000 7f45fbfff640 1 --2- 172.21.15.78:0/1483035560 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f460414b1e0 0x7f4604144770 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f45ec00e9b0 tx=0x7f45ec00ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:00:03.256 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:03.250+0000 7f46017fa640 1 -- 172.21.15.78:0/1483035560 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45ec00c9a0 con 0x7f460414b1e0 2023-11-28T20:00:03.256 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:03.250+0000 7f46017fa640 1 -- 172.21.15.78:0/1483035560 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f45ec00cb00 con 0x7f460414b1e0 2023-11-28T20:00:03.256 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:03.250+0000 7f460a432640 1 -- 172.21.15.78:0/1483035560 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f45f4009420 con 0x7f460414b1e0 2023-11-28T20:00:03.256 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:03.250+0000 7f46017fa640 1 -- 172.21.15.78:0/1483035560 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45ec013470 con 0x7f460414b1e0 2023-11-28T20:00:03.257 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:03.250+0000 7f460a432640 1 -- 172.21.15.78:0/1483035560 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4604072540 con 0x7f460414b1e0 2023-11-28T20:00:03.258 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:03.250+0000 7f460a432640 1 -- 172.21.15.78:0/1483035560 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4604067630 con 0x7f460414b1e0 2023-11-28T20:00:03.258 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:03.250+0000 7f46017fa640 1 -- 172.21.15.78:0/1483035560 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f45ec0135d0 con 0x7f460414b1e0 2023-11-28T20:00:03.258 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:03.250+0000 7f46017fa640 1 --2- 172.21.15.78:0/1483035560 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f45e4066470 0x7f45e4068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:03.258 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:03.250+0000 7f46017fa640 1 -- 172.21.15.78:0/1483035560 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6311+0+0 (secure 0 0 0) 0x7f45ec0841f0 con 0x7f460414b1e0 2023-11-28T20:00:03.258 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:03.250+0000 7f4603fff640 1 --2- 172.21.15.78:0/1483035560 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f45e4066470 0x7f45e4068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:03.259 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:03.254+0000 7f4603fff640 1 --2- 172.21.15.78:0/1483035560 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f45e4066470 0x7f45e4068930 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f45f40af000 tx=0x7f45f4008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:00:03.259 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:03.254+0000 7f46017fa640 1 -- 172.21.15.78:0/1483035560 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f45ec051550 con 0x7f460414b1e0 2023-11-28T20:00:03.410 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:03.406+0000 7f460a432640 1 -- 172.21.15.78:0/1483035560 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f46041eb420 con 0x7f460414b1e0 2023-11-28T20:00:04.065 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:04.062+0000 7f46017fa640 1 -- 172.21.15.78:0/1483035560 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v30) v1 ==== 169+0+0 (secure 0 0 0) 0x7f45ec054b70 con 0x7f460414b1e0 2023-11-28T20:00:04.065 INFO:teuthology.orchestra.run.smithi078.stderr:pool 'cephfs_data' removed 2023-11-28T20:00:04.067 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:04.062+0000 7f460a432640 1 -- 172.21.15.78:0/1483035560 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f45e4066470 msgr2=0x7f45e4068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:00:04.067 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:04.062+0000 7f460a432640 1 --2- 172.21.15.78:0/1483035560 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f45e4066470 0x7f45e4068930 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f45f40af000 tx=0x7f45f4008040 comp rx=0 tx=0).stop 2023-11-28T20:00:04.067 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:04.066+0000 7f460a432640 1 -- 172.21.15.78:0/1483035560 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f460414b1e0 msgr2=0x7f4604144770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:00:04.068 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:04.066+0000 7f460a432640 1 --2- 172.21.15.78:0/1483035560 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f460414b1e0 0x7f4604144770 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f45ec00e9b0 tx=0x7f45ec00ee70 comp rx=0 tx=0).stop 2023-11-28T20:00:04.068 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:04.066+0000 7f460a432640 1 -- 172.21.15.78:0/1483035560 shutdown_connections 2023-11-28T20:00:04.068 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:04.066+0000 7f460a432640 1 --2- 172.21.15.78:0/1483035560 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f45e4066470 0x7f45e4068930 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:04.068 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:04.066+0000 7f460a432640 1 --2- 172.21.15.78:0/1483035560 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4604151280 0x7f46041439a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:04.068 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:04.066+0000 7f460a432640 1 --2- 172.21.15.78:0/1483035560 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f460414b1e0 0x7f4604144770 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:04.068 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:04.066+0000 7f460a432640 1 --2- 172.21.15.78:0/1483035560 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f46040c5300 0x7f4604145cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:04.069 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:04.066+0000 7f460a432640 1 -- 172.21.15.78:0/1483035560 >> 172.21.15.78:0/1483035560 conn(0x7f46040c59f0 msgr2=0x7f46040c0270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:00:04.069 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:04.066+0000 7f460a432640 1 -- 172.21.15.78:0/1483035560 shutdown_connections 2023-11-28T20:00:04.069 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:04.066+0000 7f460a432640 1 -- 172.21.15.78:0/1483035560 wait complete. 2023-11-28T20:00:04.099 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data_ec cephfs_data_ec --yes-i-really-really-mean-it 2023-11-28T20:00:04.141 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T20:00:04.156 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T20:00:04.248 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:04.246+0000 7f65eaaaa640 1 Processor -- start 2023-11-28T20:00:04.249 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:04.246+0000 7f65eaaaa640 1 -- start start 2023-11-28T20:00:04.250 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:04.246+0000 7f65eaaaa640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f65e4151db0 0x7f65e40a5f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:04.250 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:04.246+0000 7f65eaaaa640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f65e40a65d0 con 0x7f65e4157b60 2023-11-28T20:00:04.250 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:04.246+0000 7f65eaaaa640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f65e4155520 con 0x7f65e40c4a20 2023-11-28T20:00:04.250 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:04.246+0000 7f65eaaaa640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f65e4154570 con 0x7f65e4151db0 2023-11-28T20:00:04.250 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:04.246+0000 7f65e8846640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f65e4151db0 0x7f65e40a5f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:04.250 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:04.246+0000 7f65e9047640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f65e4157b60 0x7f65e4157f90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:45870/0 (socket says 172.21.15.78:45870) 2023-11-28T20:00:04.250 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:04.246+0000 7f65e9047640 1 -- 172.21.15.78:0/853751701 learned_addr learned my addr 172.21.15.78:0/853751701 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-11-28T20:00:04.251 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:04.246+0000 7f65e8846640 1 -- 172.21.15.78:0/853751701 >> v1:172.21.15.179:6789/0 conn(0x7f65e40c4a20 legacy=0x7f65e40c14a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:00:04.251 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:04.246+0000 7f65e8846640 1 -- 172.21.15.78:0/853751701 >> v1:172.21.15.78:6789/0 conn(0x7f65e4157b60 legacy=0x7f65e4157f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:00:04.251 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:04.246+0000 7f65e8846640 1 -- 172.21.15.78:0/853751701 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65e41586a0 con 0x7f65e4151db0 2023-11-28T20:00:04.251 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:04.246+0000 7f65db7fe640 1 -- 172.21.15.78:0/853751701 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2803016923 0 0) 0x7f65e40a65d0 con 0x7f65e4157b60 2023-11-28T20:00:04.253 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:04.250+0000 7f65e8846640 1 --2- 172.21.15.78:0/853751701 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f65e4151db0 0x7f65e40a5f40 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f65e00097c0 tx=0x7f65e001c3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=18ceb8d3f4564461 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:00:04.253 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:04.250+0000 7f65db7fe640 1 -- 172.21.15.78:0/853751701 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65e00ab600 con 0x7f65e4151db0 2023-11-28T20:00:04.253 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:04.250+0000 7f65db7fe640 1 -- 172.21.15.78:0/853751701 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f65e00a7050 con 0x7f65e4151db0 2023-11-28T20:00:04.253 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:04.250+0000 7f65db7fe640 1 -- 172.21.15.78:0/853751701 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65e00ab980 con 0x7f65e4151db0 2023-11-28T20:00:04.254 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:04.250+0000 7f65eaaaa640 1 -- 172.21.15.78:0/853751701 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f65e4151db0 msgr2=0x7f65e40a5f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:00:04.254 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:04.250+0000 7f65eaaaa640 1 --2- 172.21.15.78:0/853751701 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f65e4151db0 0x7f65e40a5f40 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f65e00097c0 tx=0x7f65e001c3b0 comp rx=0 tx=0).stop 2023-11-28T20:00:04.254 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:04.250+0000 7f65eaaaa640 1 -- 172.21.15.78:0/853751701 shutdown_connections 2023-11-28T20:00:04.254 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:04.250+0000 7f65eaaaa640 1 --2- 172.21.15.78:0/853751701 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f65e4151db0 0x7f65e40a5f40 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:04.255 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:04.250+0000 7f65eaaaa640 1 -- 172.21.15.78:0/853751701 >> 172.21.15.78:0/853751701 conn(0x7f65e40c6b20 msgr2=0x7f65e40c6f30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:00:04.255 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:04.250+0000 7f65eaaaa640 1 -- 172.21.15.78:0/853751701 shutdown_connections 2023-11-28T20:00:04.255 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:04.250+0000 7f65eaaaa640 1 -- 172.21.15.78:0/853751701 wait complete. 2023-11-28T20:00:04.255 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:04.254+0000 7f65eaaaa640 1 Processor -- start 2023-11-28T20:00:04.255 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:04.254+0000 7f65eaaaa640 1 -- start start 2023-11-28T20:00:04.258 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:04.254+0000 7f65eaaaa640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f65e40c4a20 0x7f65e406e830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:04.258 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:04.254+0000 7f65eaaaa640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f65e4151db0 0x7f65e41f06e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:04.258 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:04.254+0000 7f65eaaaa640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f65e4157b60 0x7f65e41f0c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:04.258 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:04.254+0000 7f65eaaaa640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65e406ddb0 con 0x7f65e40c4a20 2023-11-28T20:00:04.259 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:04.254+0000 7f65eaaaa640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65e40ac810 con 0x7f65e4151db0 2023-11-28T20:00:04.259 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:04.254+0000 7f65eaaaa640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f65e40acad0 con 0x7f65e4157b60 2023-11-28T20:00:04.259 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:04.254+0000 7f65e8846640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f65e40c4a20 0x7f65e406e830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:04.259 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:04.254+0000 7f65e8846640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f65e40c4a20 0x7f65e406e830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:49186/0 (socket says 172.21.15.78:49186) 2023-11-28T20:00:04.259 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:04.254+0000 7f65e8846640 1 -- 172.21.15.78:0/1825442570 learned_addr learned my addr 172.21.15.78:0/1825442570 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T20:00:04.259 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:04.254+0000 7f65dbfff640 1 --2- 172.21.15.78:0/1825442570 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f65e4151db0 0x7f65e41f06e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:04.259 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:04.254+0000 7f65e9047640 1 --2- 172.21.15.78:0/1825442570 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f65e4157b60 0x7f65e41f0c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:04.259 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:04.254+0000 7f65e8846640 1 -- 172.21.15.78:0/1825442570 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f65e4157b60 msgr2=0x7f65e41f0c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:00:04.260 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:04.254+0000 7f65e8846640 1 --2- 172.21.15.78:0/1825442570 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f65e4157b60 0x7f65e41f0c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:04.260 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:04.254+0000 7f65e8846640 1 -- 172.21.15.78:0/1825442570 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f65e4151db0 msgr2=0x7f65e41f06e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:00:04.260 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:04.254+0000 7f65e8846640 1 --2- 172.21.15.78:0/1825442570 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f65e4151db0 0x7f65e41f06e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:04.260 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:04.254+0000 7f65e8846640 1 -- 172.21.15.78:0/1825442570 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65e0009420 con 0x7f65e40c4a20 2023-11-28T20:00:04.260 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:04.254+0000 7f65e8846640 1 --2- 172.21.15.78:0/1825442570 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f65e40c4a20 0x7f65e406e830 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f65e00ae040 tx=0x7f65e001abf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:00:04.260 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:04.254+0000 7f65d97fa640 1 -- 172.21.15.78:0/1825442570 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65e00b7650 con 0x7f65e40c4a20 2023-11-28T20:00:04.260 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:04.254+0000 7f65d97fa640 1 -- 172.21.15.78:0/1825442570 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f65e00b77b0 con 0x7f65e40c4a20 2023-11-28T20:00:04.260 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:04.254+0000 7f65eaaaa640 1 -- 172.21.15.78:0/1825442570 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f65e406d760 con 0x7f65e40c4a20 2023-11-28T20:00:04.260 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:04.254+0000 7f65d97fa640 1 -- 172.21.15.78:0/1825442570 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65e00b7b60 con 0x7f65e40c4a20 2023-11-28T20:00:04.260 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:04.254+0000 7f65eaaaa640 1 -- 172.21.15.78:0/1825442570 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f65e40abfe0 con 0x7f65e40c4a20 2023-11-28T20:00:04.261 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:04.254+0000 7f65eaaaa640 1 -- 172.21.15.78:0/1825442570 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f65e40acc40 con 0x7f65e40c4a20 2023-11-28T20:00:04.261 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:04.258+0000 7f65d97fa640 1 -- 172.21.15.78:0/1825442570 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f65e00b7cc0 con 0x7f65e40c4a20 2023-11-28T20:00:04.261 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:04.258+0000 7f65d97fa640 1 --2- 172.21.15.78:0/1825442570 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f65d0066470 0x7f65d0068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:04.261 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:04.258+0000 7f65d97fa640 1 -- 172.21.15.78:0/1825442570 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5781+0+0 (secure 0 0 0) 0x7f65e011e7a0 con 0x7f65e40c4a20 2023-11-28T20:00:04.262 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:04.258+0000 7f65dbfff640 1 --2- 172.21.15.78:0/1825442570 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f65d0066470 0x7f65d0068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:04.262 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:04.258+0000 7f65dbfff640 1 --2- 172.21.15.78:0/1825442570 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f65d0066470 0x7f65d0068930 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f65e414f0e0 tx=0x7f65d4007e40 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:00:04.267 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:04.262+0000 7f65d97fa640 1 -- 172.21.15.78:0/1825442570 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f65e40acc40 con 0x7f65e40c4a20 2023-11-28T20:00:04.432 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:04.430+0000 7f65eaaaa640 1 -- 172.21.15.78:0/1825442570 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f65e40acc10 con 0x7f65e40c4a20 2023-11-28T20:00:05.072 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:05.070+0000 7f65d97fa640 1 -- 172.21.15.78:0/1825442570 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data_ec' removed v31) v1 ==== 178+0+0 (secure 0 0 0) 0x7f65e00ebc70 con 0x7f65e40c4a20 2023-11-28T20:00:05.072 INFO:teuthology.orchestra.run.smithi078.stderr:pool 'cephfs_data_ec' removed 2023-11-28T20:00:05.075 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:05.074+0000 7f65eaaaa640 1 -- 172.21.15.78:0/1825442570 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f65d0066470 msgr2=0x7f65d0068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:00:05.076 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:05.074+0000 7f65eaaaa640 1 --2- 172.21.15.78:0/1825442570 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f65d0066470 0x7f65d0068930 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f65e414f0e0 tx=0x7f65d4007e40 comp rx=0 tx=0).stop 2023-11-28T20:00:05.076 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:05.074+0000 7f65eaaaa640 1 -- 172.21.15.78:0/1825442570 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f65e40c4a20 msgr2=0x7f65e406e830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:00:05.076 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:05.074+0000 7f65eaaaa640 1 --2- 172.21.15.78:0/1825442570 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f65e40c4a20 0x7f65e406e830 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f65e00ae040 tx=0x7f65e001abf0 comp rx=0 tx=0).stop 2023-11-28T20:00:05.076 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:05.074+0000 7f65eaaaa640 1 -- 172.21.15.78:0/1825442570 shutdown_connections 2023-11-28T20:00:05.076 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:05.074+0000 7f65eaaaa640 1 --2- 172.21.15.78:0/1825442570 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f65d0066470 0x7f65d0068930 secure :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f65e414f0e0 tx=0x7f65d4007e40 comp rx=0 tx=0).stop 2023-11-28T20:00:05.076 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:05.074+0000 7f65eaaaa640 1 --2- 172.21.15.78:0/1825442570 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f65e4157b60 0x7f65e41f0c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:05.077 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:05.074+0000 7f65eaaaa640 1 --2- 172.21.15.78:0/1825442570 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f65e4151db0 0x7f65e41f06e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:05.077 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:05.074+0000 7f65eaaaa640 1 --2- 172.21.15.78:0/1825442570 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f65e40c4a20 0x7f65e406e830 secure :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f65e00ae040 tx=0x7f65e001abf0 comp rx=0 tx=0).stop 2023-11-28T20:00:05.077 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:05.074+0000 7f65eaaaa640 1 -- 172.21.15.78:0/1825442570 >> 172.21.15.78:0/1825442570 conn(0x7f65e40c6b20 msgr2=0x7f65e40c5340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:00:05.077 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:05.074+0000 7f65eaaaa640 1 -- 172.21.15.78:0/1825442570 shutdown_connections 2023-11-28T20:00:05.077 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:05.074+0000 7f65eaaaa640 1 -- 172.21.15.78:0/1825442570 wait complete. 2023-11-28T20:00:05.098 INFO:tasks.ceph.mds.a:Restarting daemon 2023-11-28T20:00:05.098 INFO:tasks.ceph.mds.a:Stopping old one... 2023-11-28T20:00:05.098 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-11-28T20:00:05.098 INFO:teuthology.orchestra.run:waiting for 300 2023-11-28T20:00:05.098 INFO:tasks.ceph.mds.c:Restarting daemon 2023-11-28T20:00:05.099 INFO:tasks.ceph.mds.c:Stopping old one... 2023-11-28T20:00:05.099 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-11-28T20:00:05.099 INFO:teuthology.orchestra.run:waiting for 300 2023-11-28T20:00:05.099 INFO:tasks.ceph.mds.b:Restarting daemon 2023-11-28T20:00:05.099 INFO:tasks.ceph.mds.b:Stopping old one... 2023-11-28T20:00:05.099 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-11-28T20:00:05.099 INFO:teuthology.orchestra.run:waiting for 300 2023-11-28T20:00:05.100 INFO:tasks.ceph.mds.d:Restarting daemon 2023-11-28T20:00:05.100 INFO:tasks.ceph.mds.d:Stopping old one... 2023-11-28T20:00:05.100 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-11-28T20:00:05.100 INFO:teuthology.orchestra.run:waiting for 300 2023-11-28T20:00:05.122 INFO:tasks.ceph.mds.b:Stopped 2023-11-28T20:00:05.122 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-11-28T20:00:05.123 INFO:tasks.ceph.mds.c:Stopped 2023-11-28T20:00:05.123 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-11-28T20:00:05.125 INFO:tasks.ceph.mds.d:Stopped 2023-11-28T20:00:05.125 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-11-28T20:00:05.129 INFO:tasks.ceph.mds.a:Stopped 2023-11-28T20:00:05.129 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-11-28T20:00:05.171 INFO:tasks.ceph.mds.b:Started 2023-11-28T20:00:05.171 DEBUG:teuthology.parallel:result is None 2023-11-28T20:00:05.173 INFO:tasks.ceph.mds.c:Started 2023-11-28T20:00:05.174 DEBUG:teuthology.parallel:result is None 2023-11-28T20:00:05.174 INFO:tasks.ceph.mds.d:Started 2023-11-28T20:00:05.174 DEBUG:teuthology.parallel:result is None 2023-11-28T20:00:05.176 INFO:tasks.ceph.mds.a:Started 2023-11-28T20:00:05.176 DEBUG:teuthology.parallel:result is None 2023-11-28T20:00:05.176 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-11-28T20:00:05.260 INFO:tasks.ceph.mds.b.smithi179.stdout:starting mds.b at 2023-11-28T20:00:05.262 INFO:tasks.ceph.mds.d.smithi179.stdout:starting mds.d at 2023-11-28T20:00:05.262 INFO:tasks.ceph.mds.c.smithi078.stdout:starting mds.c at 2023-11-28T20:00:05.264 INFO:tasks.ceph.mds.a.smithi078.stdout:starting mds.a at 2023-11-28T20:00:05.321 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:05.318+0000 7f4d329c4640 1 Processor -- start 2023-11-28T20:00:05.322 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:05.318+0000 7f4d329c4640 1 -- start start 2023-11-28T20:00:05.322 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:05.318+0000 7f4d329c4640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f4d2c0c2110 0x7f4d2c0c5ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:05.323 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:05.318+0000 7f4d329c4640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4d2c0a93d0 con 0x7f4d2c154390 2023-11-28T20:00:05.323 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:05.318+0000 7f4d329c4640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4d2c0a9640 con 0x7f4d2c0c0c80 2023-11-28T20:00:05.323 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:05.318+0000 7f4d329c4640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4d2c0aa1c0 con 0x7f4d2c0c2110 2023-11-28T20:00:05.323 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:05.318+0000 7f4d2bfff640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f4d2c154390 0x7f4d2c0c4a40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:33220/0 (socket says 172.21.15.78:33220) 2023-11-28T20:00:05.323 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:05.318+0000 7f4d2bfff640 1 -- 172.21.15.78:0/455672354 learned_addr learned my addr 172.21.15.78:0/455672354 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-11-28T20:00:05.323 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:05.318+0000 7f4d2b7fe640 1 --2- 172.21.15.78:0/455672354 >> v2:172.21.15.78:3300/0 conn(0x7f4d2c0c2110 0x7f4d2c0c5ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:05.324 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:05.318+0000 7f4d2affd640 1 -- 172.21.15.78:0/455672354 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 611810045 0 0) 0x7f4d2c0a93d0 con 0x7f4d2c154390 2023-11-28T20:00:05.324 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:05.318+0000 7f4d2affd640 1 -- 172.21.15.78:0/455672354 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4d14003530 con 0x7f4d2c154390 2023-11-28T20:00:05.324 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:05.318+0000 7f4d2b7fe640 1 -- 172.21.15.78:0/455672354 >> v1:172.21.15.179:6789/0 conn(0x7f4d2c0c0c80 legacy=0x7f4d2c0c61e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:00:05.324 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:05.318+0000 7f4d2b7fe640 1 -- 172.21.15.78:0/455672354 >> v1:172.21.15.78:6789/0 conn(0x7f4d2c154390 legacy=0x7f4d2c0c4a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:00:05.324 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:05.318+0000 7f4d2b7fe640 1 -- 172.21.15.78:0/455672354 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d2c0a9920 con 0x7f4d2c0c2110 2023-11-28T20:00:05.326 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:05.322+0000 7f4d2b7fe640 1 --2- 172.21.15.78:0/455672354 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4d2c0c2110 0x7f4d2c0c5ca0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f4d200097c0 tx=0x7f4d2001c440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8590a3b39f9680ef server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:00:05.327 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:05.322+0000 7f4d2affd640 1 -- 172.21.15.78:0/455672354 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d20004230 con 0x7f4d2c0c2110 2023-11-28T20:00:05.327 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:05.322+0000 7f4d2affd640 1 -- 172.21.15.78:0/455672354 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d200a7050 con 0x7f4d2c0c2110 2023-11-28T20:00:05.327 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:05.322+0000 7f4d2affd640 1 -- 172.21.15.78:0/455672354 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d20003620 con 0x7f4d2c0c2110 2023-11-28T20:00:05.327 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:05.322+0000 7f4d329c4640 1 -- 172.21.15.78:0/455672354 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4d2c0c2110 msgr2=0x7f4d2c0c5ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:00:05.327 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:05.322+0000 7f4d329c4640 1 --2- 172.21.15.78:0/455672354 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4d2c0c2110 0x7f4d2c0c5ca0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f4d200097c0 tx=0x7f4d2001c440 comp rx=0 tx=0).stop 2023-11-28T20:00:05.327 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:05.322+0000 7f4d329c4640 1 -- 172.21.15.78:0/455672354 shutdown_connections 2023-11-28T20:00:05.327 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:05.322+0000 7f4d329c4640 1 --2- 172.21.15.78:0/455672354 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4d2c0c2110 0x7f4d2c0c5ca0 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:05.327 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:05.322+0000 7f4d329c4640 1 -- 172.21.15.78:0/455672354 >> 172.21.15.78:0/455672354 conn(0x7f4d2c06b220 msgr2=0x7f4d2c0a77e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:00:05.327 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:05.322+0000 7f4d329c4640 1 -- 172.21.15.78:0/455672354 shutdown_connections 2023-11-28T20:00:05.328 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:05.322+0000 7f4d329c4640 1 -- 172.21.15.78:0/455672354 wait complete. 2023-11-28T20:00:05.328 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:05.326+0000 7f4d329c4640 1 Processor -- start 2023-11-28T20:00:05.328 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:05.326+0000 7f4d329c4640 1 -- start start 2023-11-28T20:00:05.331 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:05.326+0000 7f4d329c4640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4d2c0c0c80 0x7f4d2c1476a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:05.331 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:05.326+0000 7f4d329c4640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4d2c0c2110 0x7f4d2c143c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:05.331 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:05.326+0000 7f4d329c4640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4d2c154390 0x7f4d2c1441d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:05.331 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:05.326+0000 7f4d329c4640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d2c144710 con 0x7f4d2c0c2110 2023-11-28T20:00:05.331 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:05.326+0000 7f4d329c4640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d2c0a6040 con 0x7f4d2c0c0c80 2023-11-28T20:00:05.331 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:05.326+0000 7f4d329c4640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d2c0a6600 con 0x7f4d2c154390 2023-11-28T20:00:05.331 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:05.326+0000 7f4d2b7fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4d2c0c2110 0x7f4d2c143c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:05.332 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:05.326+0000 7f4d2b7fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4d2c0c2110 0x7f4d2c143c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:36108/0 (socket says 172.21.15.78:36108) 2023-11-28T20:00:05.332 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:05.326+0000 7f4d2b7fe640 1 -- 172.21.15.78:0/748029968 learned_addr learned my addr 172.21.15.78:0/748029968 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T20:00:05.332 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:05.326+0000 7f4d2bfff640 1 --2- 172.21.15.78:0/748029968 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4d2c0c0c80 0x7f4d2c1476a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:05.332 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:05.326+0000 7f4d30f61640 1 --2- 172.21.15.78:0/748029968 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4d2c154390 0x7f4d2c1441d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:05.332 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:05.326+0000 7f4d2b7fe640 1 -- 172.21.15.78:0/748029968 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4d2c154390 msgr2=0x7f4d2c1441d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:00:05.332 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:05.326+0000 7f4d2b7fe640 1 --2- 172.21.15.78:0/748029968 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4d2c154390 0x7f4d2c1441d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:05.332 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:05.326+0000 7f4d2b7fe640 1 -- 172.21.15.78:0/748029968 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4d2c0c0c80 msgr2=0x7f4d2c1476a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:00:05.332 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:05.326+0000 7f4d2b7fe640 1 --2- 172.21.15.78:0/748029968 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4d2c0c0c80 0x7f4d2c1476a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:05.332 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:05.326+0000 7f4d2b7fe640 1 -- 172.21.15.78:0/748029968 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d20009420 con 0x7f4d2c0c2110 2023-11-28T20:00:05.332 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:05.326+0000 7f4d2bfff640 1 --2- 172.21.15.78:0/748029968 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4d2c0c0c80 0x7f4d2c1476a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T20:00:05.332 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:05.326+0000 7f4d2b7fe640 1 --2- 172.21.15.78:0/748029968 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4d2c0c2110 0x7f4d2c143c90 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f4d200ae040 tx=0x7f4d200191e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:00:05.332 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:05.326+0000 7f4d28ff9640 1 -- 172.21.15.78:0/748029968 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d20003b70 con 0x7f4d2c0c2110 2023-11-28T20:00:05.333 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:05.326+0000 7f4d28ff9640 1 -- 172.21.15.78:0/748029968 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d20003cd0 con 0x7f4d2c0c2110 2023-11-28T20:00:05.333 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:05.326+0000 7f4d28ff9640 1 -- 172.21.15.78:0/748029968 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d200ab660 con 0x7f4d2c0c2110 2023-11-28T20:00:05.333 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:05.326+0000 7f4d329c4640 1 -- 172.21.15.78:0/748029968 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4d2c1f0f70 con 0x7f4d2c0c2110 2023-11-28T20:00:05.333 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:05.326+0000 7f4d329c4640 1 -- 172.21.15.78:0/748029968 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4d2c0a6290 con 0x7f4d2c0c2110 2023-11-28T20:00:05.333 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:05.330+0000 7f4d329c4640 1 -- 172.21.15.78:0/748029968 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4d2c1f1420 con 0x7f4d2c0c2110 2023-11-28T20:00:05.333 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:05.330+0000 7f4d28ff9640 1 -- 172.21.15.78:0/748029968 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f4d200b2040 con 0x7f4d2c0c2110 2023-11-28T20:00:05.334 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:05.330+0000 7f4d28ff9640 1 --2- 172.21.15.78:0/748029968 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f4d180664a0 0x7f4d18068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:05.334 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:05.330+0000 7f4d28ff9640 1 -- 172.21.15.78:0/748029968 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5263+0+0 (secure 0 0 0) 0x7f4d2011d9c0 con 0x7f4d2c0c2110 2023-11-28T20:00:05.334 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:05.330+0000 7f4d2bfff640 1 --2- 172.21.15.78:0/748029968 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f4d180664a0 0x7f4d18068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:05.334 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:05.330+0000 7f4d2bfff640 1 --2- 172.21.15.78:0/748029968 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f4d180664a0 0x7f4d18068960 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f4d1c0011f0 tx=0x7f4d1c009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:00:05.337 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:05.334+0000 7f4d28ff9640 1 -- 172.21.15.78:0/748029968 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f4d200eb090 con 0x7f4d2c0c2110 2023-11-28T20:00:05.509 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:05.506+0000 7f4d329c4640 1 -- 172.21.15.78:0/748029968 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f4d2c067630 con 0x7f4d2c0c2110 2023-11-28T20:00:06.785 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:06.782+0000 7f4d28ff9640 1 -- 172.21.15.78:0/748029968 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v36) v1 ==== 97+0+0 (secure 0 0 0) 0x7f4d200ee6b0 con 0x7f4d2c0c2110 2023-11-28T20:00:06.786 INFO:teuthology.orchestra.run.smithi078.stderr: removed all blocklist entries 2023-11-28T20:00:06.788 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:06.786+0000 7f4d329c4640 1 -- 172.21.15.78:0/748029968 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f4d180664a0 msgr2=0x7f4d18068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:00:06.789 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:06.786+0000 7f4d329c4640 1 --2- 172.21.15.78:0/748029968 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f4d180664a0 0x7f4d18068960 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f4d1c0011f0 tx=0x7f4d1c009040 comp rx=0 tx=0).stop 2023-11-28T20:00:06.789 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:06.786+0000 7f4d329c4640 1 -- 172.21.15.78:0/748029968 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4d2c0c2110 msgr2=0x7f4d2c143c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:00:06.789 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:06.786+0000 7f4d329c4640 1 --2- 172.21.15.78:0/748029968 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4d2c0c2110 0x7f4d2c143c90 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f4d200ae040 tx=0x7f4d200191e0 comp rx=0 tx=0).stop 2023-11-28T20:00:06.789 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:06.786+0000 7f4d329c4640 1 -- 172.21.15.78:0/748029968 shutdown_connections 2023-11-28T20:00:06.789 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:06.786+0000 7f4d329c4640 1 --2- 172.21.15.78:0/748029968 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f4d180664a0 0x7f4d18068960 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:06.789 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:06.786+0000 7f4d329c4640 1 --2- 172.21.15.78:0/748029968 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4d2c154390 0x7f4d2c1441d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:06.789 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:06.786+0000 7f4d329c4640 1 --2- 172.21.15.78:0/748029968 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4d2c0c2110 0x7f4d2c143c90 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:06.789 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:06.786+0000 7f4d329c4640 1 --2- 172.21.15.78:0/748029968 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4d2c0c0c80 0x7f4d2c1476a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:06.789 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:06.786+0000 7f4d329c4640 1 -- 172.21.15.78:0/748029968 >> 172.21.15.78:0/748029968 conn(0x7f4d2c06b220 msgr2=0x7f4d2c06c800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:00:06.789 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:06.786+0000 7f4d329c4640 1 -- 172.21.15.78:0/748029968 shutdown_connections 2023-11-28T20:00:06.789 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:06.786+0000 7f4d329c4640 1 -- 172.21.15.78:0/748029968 wait complete. 2023-11-28T20:00:06.812 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-11-28T20:00:06.952 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:06.950+0000 7f2725417640 1 Processor -- start 2023-11-28T20:00:06.952 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:06.950+0000 7f2725417640 1 -- start start 2023-11-28T20:00:06.953 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:06.950+0000 7f2725417640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f272014fd10 0x7f27200a4dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:06.953 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:06.950+0000 7f2725417640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f27200c5710 con 0x7f2720156110 2023-11-28T20:00:06.953 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:06.950+0000 7f2725417640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2720155c80 con 0x7f27200a5300 2023-11-28T20:00:06.953 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:06.950+0000 7f2725417640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f272006c5e0 con 0x7f272014fd10 2023-11-28T20:00:06.954 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:06.950+0000 7f271effd640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f272014fd10 0x7f27200a4dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:06.954 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:06.950+0000 7f271f7fe640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f2720156110 0x7f272015ce50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:33236/0 (socket says 172.21.15.78:33236) 2023-11-28T20:00:06.954 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:06.950+0000 7f271effd640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f272014fd10 0x7f27200a4dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:36112/0 (socket says 172.21.15.78:36112) 2023-11-28T20:00:06.954 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:06.950+0000 7f271f7fe640 1 -- 172.21.15.78:0/1765919518 learned_addr learned my addr 172.21.15.78:0/1765919518 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-11-28T20:00:06.955 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:06.950+0000 7f271effd640 1 -- 172.21.15.78:0/1765919518 >> v1:172.21.15.179:6789/0 conn(0x7f27200a5300 legacy=0x7f2720071e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:00:06.955 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:06.950+0000 7f271effd640 1 -- 172.21.15.78:0/1765919518 >> v1:172.21.15.78:6789/0 conn(0x7f2720156110 legacy=0x7f272015ce50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:00:06.955 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:06.950+0000 7f271effd640 1 -- 172.21.15.78:0/1765919518 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27200c4e70 con 0x7f272014fd10 2023-11-28T20:00:06.955 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:06.950+0000 7f271e7fc640 1 -- 172.21.15.78:0/1765919518 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1563722947 0 0) 0x7f27200c5710 con 0x7f2720156110 2023-11-28T20:00:06.956 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:06.954+0000 7f271effd640 1 --2- 172.21.15.78:0/1765919518 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f272014fd10 0x7f27200a4dc0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f27080097c0 tx=0x7f270801c330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2237927bd4063098 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:00:06.957 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:06.954+0000 7f271e7fc640 1 -- 172.21.15.78:0/1765919518 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27080ab600 con 0x7f272014fd10 2023-11-28T20:00:06.957 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:06.954+0000 7f271e7fc640 1 -- 172.21.15.78:0/1765919518 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f27080a7050 con 0x7f272014fd10 2023-11-28T20:00:06.957 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:06.954+0000 7f271e7fc640 1 -- 172.21.15.78:0/1765919518 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27080ab980 con 0x7f272014fd10 2023-11-28T20:00:06.958 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:06.954+0000 7f2725417640 1 -- 172.21.15.78:0/1765919518 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f272014fd10 msgr2=0x7f27200a4dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:00:06.958 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:06.954+0000 7f2725417640 1 --2- 172.21.15.78:0/1765919518 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f272014fd10 0x7f27200a4dc0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f27080097c0 tx=0x7f270801c330 comp rx=0 tx=0).stop 2023-11-28T20:00:06.958 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:06.954+0000 7f2725417640 1 -- 172.21.15.78:0/1765919518 shutdown_connections 2023-11-28T20:00:06.958 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:06.954+0000 7f2725417640 1 --2- 172.21.15.78:0/1765919518 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f272014fd10 0x7f27200a4dc0 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:06.959 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:06.954+0000 7f2725417640 1 -- 172.21.15.78:0/1765919518 >> 172.21.15.78:0/1765919518 conn(0x7f27200a7810 msgr2=0x7f27200a7c20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:00:06.959 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:06.954+0000 7f2725417640 1 -- 172.21.15.78:0/1765919518 shutdown_connections 2023-11-28T20:00:06.959 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:06.954+0000 7f2725417640 1 -- 172.21.15.78:0/1765919518 wait complete. 2023-11-28T20:00:06.961 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:06.954+0000 7f2725417640 1 Processor -- start 2023-11-28T20:00:06.961 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:06.954+0000 7f2725417640 1 -- start start 2023-11-28T20:00:06.961 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:06.958+0000 7f2725417640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f27200a5300 0x7f272014f3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:06.961 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:06.958+0000 7f2725417640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f272014fd10 0x7f27200bf0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:06.961 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:06.958+0000 7f2725417640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2720156110 0x7f27201484b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:06.961 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:06.958+0000 7f2725417640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f272014f900 con 0x7f27200a5300 2023-11-28T20:00:06.961 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:06.958+0000 7f2725417640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2720148020 con 0x7f2720156110 2023-11-28T20:00:06.961 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:06.958+0000 7f2725417640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2720147d20 con 0x7f272014fd10 2023-11-28T20:00:06.961 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:06.958+0000 7f271effd640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f27200a5300 0x7f272014f3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:06.961 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:06.958+0000 7f271effd640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f27200a5300 0x7f272014f3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:36128/0 (socket says 172.21.15.78:36128) 2023-11-28T20:00:06.962 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:06.958+0000 7f271effd640 1 -- 172.21.15.78:0/74749499 learned_addr learned my addr 172.21.15.78:0/74749499 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T20:00:06.962 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:06.958+0000 7f271f7fe640 1 --2- 172.21.15.78:0/74749499 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2720156110 0x7f27201484b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:06.962 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:06.958+0000 7f27167fc640 1 --2- 172.21.15.78:0/74749499 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f272014fd10 0x7f27200bf0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:06.962 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:06.958+0000 7f271effd640 1 -- 172.21.15.78:0/74749499 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f272014fd10 msgr2=0x7f27200bf0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:00:06.962 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:06.958+0000 7f271effd640 1 --2- 172.21.15.78:0/74749499 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f272014fd10 0x7f27200bf0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:06.962 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:06.958+0000 7f271effd640 1 -- 172.21.15.78:0/74749499 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2720156110 msgr2=0x7f27201484b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:00:06.962 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:06.958+0000 7f271effd640 1 --2- 172.21.15.78:0/74749499 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2720156110 0x7f27201484b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:06.962 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:06.958+0000 7f271effd640 1 -- 172.21.15.78:0/74749499 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2708009420 con 0x7f27200a5300 2023-11-28T20:00:06.962 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:06.958+0000 7f27167fc640 1 --2- 172.21.15.78:0/74749499 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f272014fd10 0x7f27200bf0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T20:00:06.962 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:06.958+0000 7f271effd640 1 --2- 172.21.15.78:0/74749499 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f27200a5300 0x7f272014f3c0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f2708018f40 tx=0x7f27080190d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:00:06.963 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:06.958+0000 7f2717fff640 1 -- 172.21.15.78:0/74749499 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27080b4610 con 0x7f27200a5300 2023-11-28T20:00:06.963 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:06.958+0000 7f2717fff640 1 -- 172.21.15.78:0/74749499 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f27080b4790 con 0x7f27200a5300 2023-11-28T20:00:06.964 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:06.958+0000 7f2725417640 1 -- 172.21.15.78:0/74749499 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f27201ee190 con 0x7f27200a5300 2023-11-28T20:00:06.964 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:06.958+0000 7f2717fff640 1 -- 172.21.15.78:0/74749499 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27080b4b40 con 0x7f27200a5300 2023-11-28T20:00:06.964 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:06.958+0000 7f2725417640 1 -- 172.21.15.78:0/74749499 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f272014cd20 con 0x7f27200a5300 2023-11-28T20:00:06.964 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:06.958+0000 7f2725417640 1 -- 172.21.15.78:0/74749499 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f27200ab9a0 con 0x7f27200a5300 2023-11-28T20:00:06.964 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:06.962+0000 7f2717fff640 1 -- 172.21.15.78:0/74749499 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f27080b2040 con 0x7f27200a5300 2023-11-28T20:00:06.964 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:06.962+0000 7f2717fff640 1 --2- 172.21.15.78:0/74749499 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f27000664a0 0x7f2700068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:06.965 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:06.962+0000 7f2717fff640 1 -- 172.21.15.78:0/74749499 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5177+0+0 (secure 0 0 0) 0x7f270811dce0 con 0x7f27200a5300 2023-11-28T20:00:06.965 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:06.962+0000 7f27167fc640 1 --2- 172.21.15.78:0/74749499 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f27000664a0 0x7f2700068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:06.965 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:06.962+0000 7f27167fc640 1 --2- 172.21.15.78:0/74749499 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f27000664a0 0x7f2700068960 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f27200c24e0 tx=0x7f2710009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:00:06.968 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:06.966+0000 7f2717fff640 1 -- 172.21.15.78:0/74749499 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f27080eb400 con 0x7f27200a5300 2023-11-28T20:00:07.172 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:07.170+0000 7f2725417640 1 -- 172.21.15.78:0/74749499 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f2720067630 con 0x7f27200a5300 2023-11-28T20:00:07.172 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:07.170+0000 7f2717fff640 1 -- 172.21.15.78:0/74749499 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v6) v1 ==== 80+0+6065 (secure 0 0 0) 0x7f27080eea20 con 0x7f27200a5300 2023-11-28T20:00:07.173 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-11-28T20:00:07.173 INFO:teuthology.orchestra.run.smithi078.stdout:{ 2023-11-28T20:00:07.173 INFO:teuthology.orchestra.run.smithi078.stdout: "auth_dump": [ 2023-11-28T20:00:07.173 INFO:teuthology.orchestra.run.smithi078.stdout: { 2023-11-28T20:00:07.173 INFO:teuthology.orchestra.run.smithi078.stdout: "entity": "mds.a", 2023-11-28T20:00:07.173 INFO:teuthology.orchestra.run.smithi078.stdout: "key": "AQBORmZldezUHhAAmHx6/kut7l58IB6id26WJA==", 2023-11-28T20:00:07.174 INFO:teuthology.orchestra.run.smithi078.stdout: "caps": { 2023-11-28T20:00:07.174 INFO:teuthology.orchestra.run.smithi078.stdout: "mds": "allow", 2023-11-28T20:00:07.174 INFO:teuthology.orchestra.run.smithi078.stdout: "mgr": "allow *", 2023-11-28T20:00:07.174 INFO:teuthology.orchestra.run.smithi078.stdout: "mon": "allow *", 2023-11-28T20:00:07.174 INFO:teuthology.orchestra.run.smithi078.stdout: "osd": "allow *" 2023-11-28T20:00:07.174 INFO:teuthology.orchestra.run.smithi078.stdout: } 2023-11-28T20:00:07.174 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2023-11-28T20:00:07.175 INFO:teuthology.orchestra.run.smithi078.stdout: { 2023-11-28T20:00:07.175 INFO:teuthology.orchestra.run.smithi078.stdout: "entity": "mds.b", 2023-11-28T20:00:07.175 INFO:teuthology.orchestra.run.smithi078.stdout: "key": "AQBORmZltpo9KxAAF+26E+HxsJs4tdMBVMETKw==", 2023-11-28T20:00:07.175 INFO:teuthology.orchestra.run.smithi078.stdout: "caps": { 2023-11-28T20:00:07.175 INFO:teuthology.orchestra.run.smithi078.stdout: "mds": "allow", 2023-11-28T20:00:07.175 INFO:teuthology.orchestra.run.smithi078.stdout: "mgr": "allow *", 2023-11-28T20:00:07.175 INFO:teuthology.orchestra.run.smithi078.stdout: "mon": "allow *", 2023-11-28T20:00:07.175 INFO:teuthology.orchestra.run.smithi078.stdout: "osd": "allow *" 2023-11-28T20:00:07.176 INFO:teuthology.orchestra.run.smithi078.stdout: } 2023-11-28T20:00:07.176 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2023-11-28T20:00:07.176 INFO:teuthology.orchestra.run.smithi078.stdout: { 2023-11-28T20:00:07.176 INFO:teuthology.orchestra.run.smithi078.stdout: "entity": "mds.c", 2023-11-28T20:00:07.176 INFO:teuthology.orchestra.run.smithi078.stdout: "key": "AQBORmZlqQU8JhAAjJ7XKQDZbfNnj0FUsYHUXw==", 2023-11-28T20:00:07.177 INFO:teuthology.orchestra.run.smithi078.stdout: "caps": { 2023-11-28T20:00:07.177 INFO:teuthology.orchestra.run.smithi078.stdout: "mds": "allow", 2023-11-28T20:00:07.177 INFO:teuthology.orchestra.run.smithi078.stdout: "mgr": "allow *", 2023-11-28T20:00:07.177 INFO:teuthology.orchestra.run.smithi078.stdout: "mon": "allow *", 2023-11-28T20:00:07.177 INFO:teuthology.orchestra.run.smithi078.stdout: "osd": "allow *" 2023-11-28T20:00:07.177 INFO:teuthology.orchestra.run.smithi078.stdout: } 2023-11-28T20:00:07.178 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2023-11-28T20:00:07.178 INFO:teuthology.orchestra.run.smithi078.stdout: { 2023-11-28T20:00:07.178 INFO:teuthology.orchestra.run.smithi078.stdout: "entity": "mds.d", 2023-11-28T20:00:07.178 INFO:teuthology.orchestra.run.smithi078.stdout: "key": "AQBORmZlcOaPMhAAABmFnot+b8fMIUvIIJMrtA==", 2023-11-28T20:00:07.179 INFO:teuthology.orchestra.run.smithi078.stdout: "caps": { 2023-11-28T20:00:07.179 INFO:teuthology.orchestra.run.smithi078.stdout: "mds": "allow", 2023-11-28T20:00:07.179 INFO:teuthology.orchestra.run.smithi078.stdout: "mgr": "allow *", 2023-11-28T20:00:07.179 INFO:teuthology.orchestra.run.smithi078.stdout: "mon": "allow *", 2023-11-28T20:00:07.179 INFO:teuthology.orchestra.run.smithi078.stdout: "osd": "allow *" 2023-11-28T20:00:07.179 INFO:teuthology.orchestra.run.smithi078.stdout: } 2023-11-28T20:00:07.180 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2023-11-28T20:00:07.180 INFO:teuthology.orchestra.run.smithi078.stdout: { 2023-11-28T20:00:07.180 INFO:teuthology.orchestra.run.smithi078.stdout: "entity": "osd.0", 2023-11-28T20:00:07.180 INFO:teuthology.orchestra.run.smithi078.stdout: "key": "AQBSRmZllQa4CRAAUz2YsYjsIf+SX/HkkQjzNw==", 2023-11-28T20:00:07.180 INFO:teuthology.orchestra.run.smithi078.stdout: "caps": { 2023-11-28T20:00:07.180 INFO:teuthology.orchestra.run.smithi078.stdout: "mgr": "allow profile osd", 2023-11-28T20:00:07.180 INFO:teuthology.orchestra.run.smithi078.stdout: "mon": "allow profile osd", 2023-11-28T20:00:07.180 INFO:teuthology.orchestra.run.smithi078.stdout: "osd": "allow *" 2023-11-28T20:00:07.180 INFO:teuthology.orchestra.run.smithi078.stdout: } 2023-11-28T20:00:07.181 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2023-11-28T20:00:07.181 INFO:teuthology.orchestra.run.smithi078.stdout: { 2023-11-28T20:00:07.181 INFO:teuthology.orchestra.run.smithi078.stdout: "entity": "osd.1", 2023-11-28T20:00:07.181 INFO:teuthology.orchestra.run.smithi078.stdout: "key": "AQBVRmZlrRCFEBAA+6glXV0u+NS4bF4DEGymmg==", 2023-11-28T20:00:07.181 INFO:teuthology.orchestra.run.smithi078.stdout: "caps": { 2023-11-28T20:00:07.181 INFO:teuthology.orchestra.run.smithi078.stdout: "mgr": "allow profile osd", 2023-11-28T20:00:07.181 INFO:teuthology.orchestra.run.smithi078.stdout: "mon": "allow profile osd", 2023-11-28T20:00:07.181 INFO:teuthology.orchestra.run.smithi078.stdout: "osd": "allow *" 2023-11-28T20:00:07.181 INFO:teuthology.orchestra.run.smithi078.stdout: } 2023-11-28T20:00:07.181 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2023-11-28T20:00:07.181 INFO:teuthology.orchestra.run.smithi078.stdout: { 2023-11-28T20:00:07.181 INFO:teuthology.orchestra.run.smithi078.stdout: "entity": "osd.2", 2023-11-28T20:00:07.182 INFO:teuthology.orchestra.run.smithi078.stdout: "key": "AQBYRmZlfcFfFxAApsrWaESm1Utd6BLazDsCIw==", 2023-11-28T20:00:07.182 INFO:teuthology.orchestra.run.smithi078.stdout: "caps": { 2023-11-28T20:00:07.182 INFO:teuthology.orchestra.run.smithi078.stdout: "mgr": "allow profile osd", 2023-11-28T20:00:07.182 INFO:teuthology.orchestra.run.smithi078.stdout: "mon": "allow profile osd", 2023-11-28T20:00:07.182 INFO:teuthology.orchestra.run.smithi078.stdout: "osd": "allow *" 2023-11-28T20:00:07.182 INFO:teuthology.orchestra.run.smithi078.stdout: } 2023-11-28T20:00:07.182 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2023-11-28T20:00:07.182 INFO:teuthology.orchestra.run.smithi078.stdout: { 2023-11-28T20:00:07.182 INFO:teuthology.orchestra.run.smithi078.stdout: "entity": "osd.3", 2023-11-28T20:00:07.182 INFO:teuthology.orchestra.run.smithi078.stdout: "key": "AQBbRmZlc7KQHRAA4Y4BYxG7CSLpPpGx9mP5BA==", 2023-11-28T20:00:07.183 INFO:teuthology.orchestra.run.smithi078.stdout: "caps": { 2023-11-28T20:00:07.183 INFO:teuthology.orchestra.run.smithi078.stdout: "mgr": "allow profile osd", 2023-11-28T20:00:07.183 INFO:teuthology.orchestra.run.smithi078.stdout: "mon": "allow profile osd", 2023-11-28T20:00:07.183 INFO:teuthology.orchestra.run.smithi078.stdout: "osd": "allow *" 2023-11-28T20:00:07.183 INFO:teuthology.orchestra.run.smithi078.stdout: } 2023-11-28T20:00:07.183 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2023-11-28T20:00:07.183 INFO:teuthology.orchestra.run.smithi078.stdout: { 2023-11-28T20:00:07.183 INFO:teuthology.orchestra.run.smithi078.stdout: "entity": "osd.4", 2023-11-28T20:00:07.183 INFO:teuthology.orchestra.run.smithi078.stdout: "key": "AQBhRmZlU5jVJhAAnM5Ow5whdkZS0cY13ehg0Q==", 2023-11-28T20:00:07.183 INFO:teuthology.orchestra.run.smithi078.stdout: "caps": { 2023-11-28T20:00:07.183 INFO:teuthology.orchestra.run.smithi078.stdout: "mgr": "allow profile osd", 2023-11-28T20:00:07.183 INFO:teuthology.orchestra.run.smithi078.stdout: "mon": "allow profile osd", 2023-11-28T20:00:07.184 INFO:teuthology.orchestra.run.smithi078.stdout: "osd": "allow *" 2023-11-28T20:00:07.184 INFO:teuthology.orchestra.run.smithi078.stdout: } 2023-11-28T20:00:07.184 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2023-11-28T20:00:07.184 INFO:teuthology.orchestra.run.smithi078.stdout: { 2023-11-28T20:00:07.184 INFO:teuthology.orchestra.run.smithi078.stdout: "entity": "osd.5", 2023-11-28T20:00:07.184 INFO:teuthology.orchestra.run.smithi078.stdout: "key": "AQBkRmZlV0qxMBAAwuuKXOx2QOKWxJlY47Z8gw==", 2023-11-28T20:00:07.184 INFO:teuthology.orchestra.run.smithi078.stdout: "caps": { 2023-11-28T20:00:07.184 INFO:teuthology.orchestra.run.smithi078.stdout: "mgr": "allow profile osd", 2023-11-28T20:00:07.185 INFO:teuthology.orchestra.run.smithi078.stdout: "mon": "allow profile osd", 2023-11-28T20:00:07.185 INFO:teuthology.orchestra.run.smithi078.stdout: "osd": "allow *" 2023-11-28T20:00:07.185 INFO:teuthology.orchestra.run.smithi078.stdout: } 2023-11-28T20:00:07.185 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2023-11-28T20:00:07.185 INFO:teuthology.orchestra.run.smithi078.stdout: { 2023-11-28T20:00:07.185 INFO:teuthology.orchestra.run.smithi078.stdout: "entity": "osd.6", 2023-11-28T20:00:07.185 INFO:teuthology.orchestra.run.smithi078.stdout: "key": "AQBnRmZln6R8NhAAu+46Z8Qb0mXkyMx5W2U/oA==", 2023-11-28T20:00:07.185 INFO:teuthology.orchestra.run.smithi078.stdout: "caps": { 2023-11-28T20:00:07.185 INFO:teuthology.orchestra.run.smithi078.stdout: "mgr": "allow profile osd", 2023-11-28T20:00:07.186 INFO:teuthology.orchestra.run.smithi078.stdout: "mon": "allow profile osd", 2023-11-28T20:00:07.187 INFO:teuthology.orchestra.run.smithi078.stdout: "osd": "allow *" 2023-11-28T20:00:07.187 INFO:teuthology.orchestra.run.smithi078.stdout: } 2023-11-28T20:00:07.187 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2023-11-28T20:00:07.187 INFO:teuthology.orchestra.run.smithi078.stdout: { 2023-11-28T20:00:07.187 INFO:teuthology.orchestra.run.smithi078.stdout: "entity": "osd.7", 2023-11-28T20:00:07.187 INFO:teuthology.orchestra.run.smithi078.stdout: "key": "AQBrRmZl8+xEBBAAx7CjmIrEZseolpBrEDAJog==", 2023-11-28T20:00:07.187 INFO:teuthology.orchestra.run.smithi078.stdout: "caps": { 2023-11-28T20:00:07.187 INFO:teuthology.orchestra.run.smithi078.stdout: "mgr": "allow profile osd", 2023-11-28T20:00:07.187 INFO:teuthology.orchestra.run.smithi078.stdout: "mon": "allow profile osd", 2023-11-28T20:00:07.187 INFO:teuthology.orchestra.run.smithi078.stdout: "osd": "allow *" 2023-11-28T20:00:07.187 INFO:teuthology.orchestra.run.smithi078.stdout: } 2023-11-28T20:00:07.187 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2023-11-28T20:00:07.188 INFO:teuthology.orchestra.run.smithi078.stdout: { 2023-11-28T20:00:07.188 INFO:teuthology.orchestra.run.smithi078.stdout: "entity": "client.0", 2023-11-28T20:00:07.188 INFO:teuthology.orchestra.run.smithi078.stdout: "key": "AQBORmZlPLeINhAAMdB7hy84hvX1S/pHYfkeJg==", 2023-11-28T20:00:07.188 INFO:teuthology.orchestra.run.smithi078.stdout: "caps": { 2023-11-28T20:00:07.188 INFO:teuthology.orchestra.run.smithi078.stdout: "mds": "allow", 2023-11-28T20:00:07.188 INFO:teuthology.orchestra.run.smithi078.stdout: "mgr": "allow r", 2023-11-28T20:00:07.188 INFO:teuthology.orchestra.run.smithi078.stdout: "mon": "allow rw", 2023-11-28T20:00:07.188 INFO:teuthology.orchestra.run.smithi078.stdout: "osd": "allow rwx" 2023-11-28T20:00:07.188 INFO:teuthology.orchestra.run.smithi078.stdout: } 2023-11-28T20:00:07.188 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2023-11-28T20:00:07.188 INFO:teuthology.orchestra.run.smithi078.stdout: { 2023-11-28T20:00:07.188 INFO:teuthology.orchestra.run.smithi078.stdout: "entity": "client.1", 2023-11-28T20:00:07.189 INFO:teuthology.orchestra.run.smithi078.stdout: "key": "AQBORmZlzBgfOhAAm6M8Y+12MlLdVkJnMmK9BQ==", 2023-11-28T20:00:07.189 INFO:teuthology.orchestra.run.smithi078.stdout: "caps": { 2023-11-28T20:00:07.189 INFO:teuthology.orchestra.run.smithi078.stdout: "mds": "allow", 2023-11-28T20:00:07.189 INFO:teuthology.orchestra.run.smithi078.stdout: "mgr": "allow r", 2023-11-28T20:00:07.189 INFO:teuthology.orchestra.run.smithi078.stdout: "mon": "allow rw", 2023-11-28T20:00:07.189 INFO:teuthology.orchestra.run.smithi078.stdout: "osd": "allow rwx" 2023-11-28T20:00:07.189 INFO:teuthology.orchestra.run.smithi078.stdout: } 2023-11-28T20:00:07.189 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2023-11-28T20:00:07.189 INFO:teuthology.orchestra.run.smithi078.stdout: { 2023-11-28T20:00:07.189 INFO:teuthology.orchestra.run.smithi078.stdout: "entity": "client.admin", 2023-11-28T20:00:07.189 INFO:teuthology.orchestra.run.smithi078.stdout: "key": "AQBORmZl8EaQAhAAmfstKsxO4dpR94AlFoDQpg==", 2023-11-28T20:00:07.190 INFO:teuthology.orchestra.run.smithi078.stdout: "caps": { 2023-11-28T20:00:07.190 INFO:teuthology.orchestra.run.smithi078.stdout: "mds": "allow *", 2023-11-28T20:00:07.190 INFO:teuthology.orchestra.run.smithi078.stdout: "mgr": "allow *", 2023-11-28T20:00:07.190 INFO:teuthology.orchestra.run.smithi078.stdout: "mon": "allow *", 2023-11-28T20:00:07.190 INFO:teuthology.orchestra.run.smithi078.stdout: "osd": "allow *" 2023-11-28T20:00:07.190 INFO:teuthology.orchestra.run.smithi078.stdout: } 2023-11-28T20:00:07.190 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2023-11-28T20:00:07.190 INFO:teuthology.orchestra.run.smithi078.stdout: { 2023-11-28T20:00:07.190 INFO:teuthology.orchestra.run.smithi078.stdout: "entity": "client.bootstrap-mds", 2023-11-28T20:00:07.190 INFO:teuthology.orchestra.run.smithi078.stdout: "key": "AQBwRmZlQvjRORAACDFcOb+S6Kb0Sv0wCW8Nkg==", 2023-11-28T20:00:07.190 INFO:teuthology.orchestra.run.smithi078.stdout: "caps": { 2023-11-28T20:00:07.191 INFO:teuthology.orchestra.run.smithi078.stdout: "mon": "allow profile bootstrap-mds" 2023-11-28T20:00:07.191 INFO:teuthology.orchestra.run.smithi078.stdout: } 2023-11-28T20:00:07.191 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2023-11-28T20:00:07.191 INFO:teuthology.orchestra.run.smithi078.stdout: { 2023-11-28T20:00:07.191 INFO:teuthology.orchestra.run.smithi078.stdout: "entity": "client.bootstrap-mgr", 2023-11-28T20:00:07.191 INFO:teuthology.orchestra.run.smithi078.stdout: "key": "AQBwRmZlFQTSORAAcVekpmdk7GdeC78NZYq7Rg==", 2023-11-28T20:00:07.191 INFO:teuthology.orchestra.run.smithi078.stdout: "caps": { 2023-11-28T20:00:07.191 INFO:teuthology.orchestra.run.smithi078.stdout: "mon": "allow profile bootstrap-mgr" 2023-11-28T20:00:07.191 INFO:teuthology.orchestra.run.smithi078.stdout: } 2023-11-28T20:00:07.191 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2023-11-28T20:00:07.191 INFO:teuthology.orchestra.run.smithi078.stdout: { 2023-11-28T20:00:07.191 INFO:teuthology.orchestra.run.smithi078.stdout: "entity": "client.bootstrap-osd", 2023-11-28T20:00:07.192 INFO:teuthology.orchestra.run.smithi078.stdout: "key": "AQBwRmZlBw3SORAAC8L3orxglE6O5yaT/C67sQ==", 2023-11-28T20:00:07.192 INFO:teuthology.orchestra.run.smithi078.stdout: "caps": { 2023-11-28T20:00:07.192 INFO:teuthology.orchestra.run.smithi078.stdout: "mon": "allow profile bootstrap-osd" 2023-11-28T20:00:07.192 INFO:teuthology.orchestra.run.smithi078.stdout: } 2023-11-28T20:00:07.192 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2023-11-28T20:00:07.192 INFO:teuthology.orchestra.run.smithi078.stdout: { 2023-11-28T20:00:07.192 INFO:teuthology.orchestra.run.smithi078.stdout: "entity": "client.bootstrap-rbd", 2023-11-28T20:00:07.192 INFO:teuthology.orchestra.run.smithi078.stdout: "key": "AQBwRmZlfBXSORAApDwQB9TlWxBC3y/AM8t2eA==", 2023-11-28T20:00:07.192 INFO:teuthology.orchestra.run.smithi078.stdout: "caps": { 2023-11-28T20:00:07.192 INFO:teuthology.orchestra.run.smithi078.stdout: "mon": "allow profile bootstrap-rbd" 2023-11-28T20:00:07.192 INFO:teuthology.orchestra.run.smithi078.stdout: } 2023-11-28T20:00:07.192 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2023-11-28T20:00:07.193 INFO:teuthology.orchestra.run.smithi078.stdout: { 2023-11-28T20:00:07.193 INFO:teuthology.orchestra.run.smithi078.stdout: "entity": "client.bootstrap-rbd-mirror", 2023-11-28T20:00:07.193 INFO:teuthology.orchestra.run.smithi078.stdout: "key": "AQBwRmZlmh/SORAAIhqh/9UzCY/HhIUZShI+zQ==", 2023-11-28T20:00:07.193 INFO:teuthology.orchestra.run.smithi078.stdout: "caps": { 2023-11-28T20:00:07.193 INFO:teuthology.orchestra.run.smithi078.stdout: "mon": "allow profile bootstrap-rbd-mirror" 2023-11-28T20:00:07.193 INFO:teuthology.orchestra.run.smithi078.stdout: } 2023-11-28T20:00:07.193 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2023-11-28T20:00:07.193 INFO:teuthology.orchestra.run.smithi078.stdout: { 2023-11-28T20:00:07.193 INFO:teuthology.orchestra.run.smithi078.stdout: "entity": "client.bootstrap-rgw", 2023-11-28T20:00:07.193 INFO:teuthology.orchestra.run.smithi078.stdout: "key": "AQBwRmZliCjSORAAjHZu9CJ9iH+7fFyTKK1jqw==", 2023-11-28T20:00:07.194 INFO:teuthology.orchestra.run.smithi078.stdout: "caps": { 2023-11-28T20:00:07.194 INFO:teuthology.orchestra.run.smithi078.stdout: "mon": "allow profile bootstrap-rgw" 2023-11-28T20:00:07.194 INFO:teuthology.orchestra.run.smithi078.stdout: } 2023-11-28T20:00:07.194 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2023-11-28T20:00:07.194 INFO:teuthology.orchestra.run.smithi078.stdout: { 2023-11-28T20:00:07.194 INFO:teuthology.orchestra.run.smithi078.stdout: "entity": "mgr.x", 2023-11-28T20:00:07.194 INFO:teuthology.orchestra.run.smithi078.stdout: "key": "AQBORmZl1xbAGhAAVP5dcAqZPly145Skxk8QjA==", 2023-11-28T20:00:07.194 INFO:teuthology.orchestra.run.smithi078.stdout: "caps": { 2023-11-28T20:00:07.194 INFO:teuthology.orchestra.run.smithi078.stdout: "mds": "allow *", 2023-11-28T20:00:07.194 INFO:teuthology.orchestra.run.smithi078.stdout: "mon": "allow profile mgr", 2023-11-28T20:00:07.194 INFO:teuthology.orchestra.run.smithi078.stdout: "osd": "allow *" 2023-11-28T20:00:07.194 INFO:teuthology.orchestra.run.smithi078.stdout: } 2023-11-28T20:00:07.195 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2023-11-28T20:00:07.195 INFO:teuthology.orchestra.run.smithi078.stdout: { 2023-11-28T20:00:07.195 INFO:teuthology.orchestra.run.smithi078.stdout: "entity": "mgr.y", 2023-11-28T20:00:07.195 INFO:teuthology.orchestra.run.smithi078.stdout: "key": "AQBORmZlQkLqFhAA1lMuqxTImbm69hxar4QpXg==", 2023-11-28T20:00:07.195 INFO:teuthology.orchestra.run.smithi078.stdout: "caps": { 2023-11-28T20:00:07.195 INFO:teuthology.orchestra.run.smithi078.stdout: "mds": "allow *", 2023-11-28T20:00:07.195 INFO:teuthology.orchestra.run.smithi078.stdout: "mon": "allow profile mgr", 2023-11-28T20:00:07.195 INFO:teuthology.orchestra.run.smithi078.stdout: "osd": "allow *" 2023-11-28T20:00:07.195 INFO:teuthology.orchestra.run.smithi078.stdout: } 2023-11-28T20:00:07.195 INFO:teuthology.orchestra.run.smithi078.stdout: } 2023-11-28T20:00:07.195 INFO:teuthology.orchestra.run.smithi078.stdout: ] 2023-11-28T20:00:07.196 INFO:teuthology.orchestra.run.smithi078.stdout:} 2023-11-28T20:00:07.197 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:07.170+0000 7f2725417640 1 -- 172.21.15.78:0/74749499 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f27000664a0 msgr2=0x7f2700068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:00:07.197 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:07.170+0000 7f2725417640 1 --2- 172.21.15.78:0/74749499 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f27000664a0 0x7f2700068960 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f27200c24e0 tx=0x7f2710009040 comp rx=0 tx=0).stop 2023-11-28T20:00:07.197 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:07.170+0000 7f2725417640 1 -- 172.21.15.78:0/74749499 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f27200a5300 msgr2=0x7f272014f3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:00:07.198 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:07.170+0000 7f2725417640 1 --2- 172.21.15.78:0/74749499 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f27200a5300 0x7f272014f3c0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f2708018f40 tx=0x7f27080190d0 comp rx=0 tx=0).stop 2023-11-28T20:00:07.198 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:07.170+0000 7f2725417640 1 -- 172.21.15.78:0/74749499 shutdown_connections 2023-11-28T20:00:07.198 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:07.170+0000 7f2725417640 1 --2- 172.21.15.78:0/74749499 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f27000664a0 0x7f2700068960 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:07.198 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:07.170+0000 7f2725417640 1 --2- 172.21.15.78:0/74749499 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f272014fd10 0x7f27200bf0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:07.198 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:07.170+0000 7f2725417640 1 --2- 172.21.15.78:0/74749499 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2720156110 0x7f27201484b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:07.198 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:07.170+0000 7f2725417640 1 --2- 172.21.15.78:0/74749499 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f27200a5300 0x7f272014f3c0 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:07.198 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:07.170+0000 7f2725417640 1 -- 172.21.15.78:0/74749499 >> 172.21.15.78:0/74749499 conn(0x7f27200a7810 msgr2=0x7f27200a6bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:00:07.198 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:07.170+0000 7f2725417640 1 -- 172.21.15.78:0/74749499 shutdown_connections 2023-11-28T20:00:07.199 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:07.170+0000 7f2725417640 1 -- 172.21.15.78:0/74749499 wait complete. 2023-11-28T20:00:07.199 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mds 2023-11-28T20:00:07.336 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:07.334+0000 7f51e7a32640 1 Processor -- start 2023-11-28T20:00:07.337 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:07.334+0000 7f51e7a32640 1 -- start start 2023-11-28T20:00:07.338 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:07.334+0000 7f51e7a32640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f51e0154390 0x7f51e00c4a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:07.338 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:07.334+0000 7f51e7a32640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f51e00a93d0 con 0x7f51e00c4f80 2023-11-28T20:00:07.338 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:07.334+0000 7f51e7a32640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f51e00a9640 con 0x7f51e00c2110 2023-11-28T20:00:07.338 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:07.334+0000 7f51e7a32640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f51e00aa1c0 con 0x7f51e0154390 2023-11-28T20:00:07.338 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:07.334+0000 7f51e57ce640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f51e0154390 0x7f51e00c4a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:07.338 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:07.334+0000 7f51e5fcf640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f51e00c4f80 0x7f51e015bc60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:33250/0 (socket says 172.21.15.78:33250) 2023-11-28T20:00:07.338 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:07.334+0000 7f51e5fcf640 1 -- 172.21.15.78:0/2667714326 learned_addr learned my addr 172.21.15.78:0/2667714326 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-11-28T20:00:07.339 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:07.334+0000 7f51e57ce640 1 -- 172.21.15.78:0/2667714326 >> v1:172.21.15.179:6789/0 conn(0x7f51e00c2110 legacy=0x7f51e00c5ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:00:07.339 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:07.334+0000 7f51e57ce640 1 -- 172.21.15.78:0/2667714326 >> v1:172.21.15.78:6789/0 conn(0x7f51e00c4f80 legacy=0x7f51e015bc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:00:07.339 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:07.334+0000 7f51e57ce640 1 -- 172.21.15.78:0/2667714326 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51e00a9920 con 0x7f51e0154390 2023-11-28T20:00:07.339 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:07.334+0000 7f51d7fff640 1 -- 172.21.15.78:0/2667714326 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3800709719 0 0) 0x7f51e00a93d0 con 0x7f51e00c4f80 2023-11-28T20:00:07.341 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:07.338+0000 7f51e57ce640 1 --2- 172.21.15.78:0/2667714326 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f51e0154390 0x7f51e00c4a40 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f51dc0097c0 tx=0x7f51dc01c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=139b2cde12d0e7ef server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:00:07.341 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:07.338+0000 7f51d7fff640 1 -- 172.21.15.78:0/2667714326 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51dc0a8050 con 0x7f51e0154390 2023-11-28T20:00:07.341 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:07.338+0000 7f51d7fff640 1 -- 172.21.15.78:0/2667714326 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51dc0ac5f0 con 0x7f51e0154390 2023-11-28T20:00:07.342 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:07.338+0000 7f51d7fff640 1 -- 172.21.15.78:0/2667714326 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51dc0ac980 con 0x7f51e0154390 2023-11-28T20:00:07.342 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:07.338+0000 7f51e7a32640 1 -- 172.21.15.78:0/2667714326 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f51e0154390 msgr2=0x7f51e00c4a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:00:07.342 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:07.338+0000 7f51e7a32640 1 --2- 172.21.15.78:0/2667714326 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f51e0154390 0x7f51e00c4a40 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f51dc0097c0 tx=0x7f51dc01c480 comp rx=0 tx=0).stop 2023-11-28T20:00:07.343 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:07.338+0000 7f51e7a32640 1 -- 172.21.15.78:0/2667714326 shutdown_connections 2023-11-28T20:00:07.343 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:07.338+0000 7f51e7a32640 1 --2- 172.21.15.78:0/2667714326 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f51e0154390 0x7f51e00c4a40 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:07.343 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:07.338+0000 7f51e7a32640 1 -- 172.21.15.78:0/2667714326 >> 172.21.15.78:0/2667714326 conn(0x7f51e006b220 msgr2=0x7f51e00a77e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:00:07.343 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:07.338+0000 7f51e7a32640 1 -- 172.21.15.78:0/2667714326 shutdown_connections 2023-11-28T20:00:07.343 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:07.338+0000 7f51e7a32640 1 -- 172.21.15.78:0/2667714326 wait complete. 2023-11-28T20:00:07.344 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:07.342+0000 7f51e7a32640 1 Processor -- start 2023-11-28T20:00:07.344 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:07.342+0000 7f51e7a32640 1 -- start start 2023-11-28T20:00:07.345 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:07.342+0000 7f51e7a32640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f51e00c2110 0x7f51e01485d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:07.345 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:07.342+0000 7f51e7a32640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f51e00c4f80 0x7f51e0152a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:07.345 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:07.342+0000 7f51e7a32640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f51e0154390 0x7f51e01eb8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:07.345 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:07.342+0000 7f51e7a32640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51e01443e0 con 0x7f51e00c4f80 2023-11-28T20:00:07.345 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:07.342+0000 7f51e7a32640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51e01eedb0 con 0x7f51e00c2110 2023-11-28T20:00:07.345 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:07.342+0000 7f51e7a32640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51e01ef090 con 0x7f51e0154390 2023-11-28T20:00:07.345 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:07.342+0000 7f51e4fcd640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f51e00c4f80 0x7f51e0152a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:07.346 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:07.342+0000 7f51e4fcd640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f51e00c4f80 0x7f51e0152a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:36146/0 (socket says 172.21.15.78:36146) 2023-11-28T20:00:07.346 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:07.342+0000 7f51e4fcd640 1 -- 172.21.15.78:0/1094953304 learned_addr learned my addr 172.21.15.78:0/1094953304 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T20:00:07.347 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:07.342+0000 7f51e57ce640 1 --2- 172.21.15.78:0/1094953304 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f51e00c2110 0x7f51e01485d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:07.347 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:07.342+0000 7f51e5fcf640 1 --2- 172.21.15.78:0/1094953304 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f51e0154390 0x7f51e01eb8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:07.347 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:07.342+0000 7f51e4fcd640 1 -- 172.21.15.78:0/1094953304 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f51e0154390 msgr2=0x7f51e01eb8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:00:07.347 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:07.342+0000 7f51e4fcd640 1 --2- 172.21.15.78:0/1094953304 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f51e0154390 0x7f51e01eb8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:07.347 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:07.342+0000 7f51e4fcd640 1 -- 172.21.15.78:0/1094953304 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f51e00c2110 msgr2=0x7f51e01485d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:00:07.347 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:07.342+0000 7f51e4fcd640 1 --2- 172.21.15.78:0/1094953304 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f51e00c2110 0x7f51e01485d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:07.347 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:07.342+0000 7f51e4fcd640 1 -- 172.21.15.78:0/1094953304 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51dc009420 con 0x7f51e00c4f80 2023-11-28T20:00:07.348 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:07.342+0000 7f51e57ce640 1 --2- 172.21.15.78:0/1094953304 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f51e00c2110 0x7f51e01485d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T20:00:07.348 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:07.342+0000 7f51e4fcd640 1 --2- 172.21.15.78:0/1094953304 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f51e00c4f80 0x7f51e0152a00 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f51d000c500 tx=0x7f51d000c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:00:07.348 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:07.342+0000 7f51d5ffb640 1 -- 172.21.15.78:0/1094953304 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51d0005220 con 0x7f51e00c4f80 2023-11-28T20:00:07.348 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:07.342+0000 7f51d5ffb640 1 -- 172.21.15.78:0/1094953304 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51d0005380 con 0x7f51e00c4f80 2023-11-28T20:00:07.348 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:07.342+0000 7f51d5ffb640 1 -- 172.21.15.78:0/1094953304 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51d0007270 con 0x7f51e00c4f80 2023-11-28T20:00:07.348 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:07.342+0000 7f51e7a32640 1 -- 172.21.15.78:0/1094953304 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f51e01ef370 con 0x7f51e00c4f80 2023-11-28T20:00:07.348 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:07.342+0000 7f51e7a32640 1 -- 172.21.15.78:0/1094953304 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f51e01eea40 con 0x7f51e00c4f80 2023-11-28T20:00:07.349 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:07.346+0000 7f51e7a32640 1 -- 172.21.15.78:0/1094953304 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f51e0067630 con 0x7f51e00c4f80 2023-11-28T20:00:07.349 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:07.346+0000 7f51d5ffb640 1 -- 172.21.15.78:0/1094953304 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f51d00073d0 con 0x7f51e00c4f80 2023-11-28T20:00:07.349 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:07.346+0000 7f51d5ffb640 1 --2- 172.21.15.78:0/1094953304 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f51c4066470 0x7f51c4068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:07.349 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:07.346+0000 7f51d5ffb640 1 -- 172.21.15.78:0/1094953304 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5177+0+0 (secure 0 0 0) 0x7f51d0083060 con 0x7f51e00c4f80 2023-11-28T20:00:07.350 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:07.346+0000 7f51e57ce640 1 --2- 172.21.15.78:0/1094953304 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f51c4066470 0x7f51c4068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:07.350 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:07.346+0000 7f51e57ce640 1 --2- 172.21.15.78:0/1094953304 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f51c4066470 0x7f51c4068930 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f51dc0ae000 tx=0x7f51dc0a7000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:00:07.353 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:07.350+0000 7f51d5ffb640 1 -- 172.21.15.78:0/1094953304 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f51d00b4280 con 0x7f51e00c4f80 2023-11-28T20:00:07.555 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:07.550+0000 7f51e7a32640 1 -- 172.21.15.78:0/1094953304 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mds"} v 0) v1 -- 0x7f51e00c0800 con 0x7f51e00c4f80 2023-11-28T20:00:07.558 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:07.554+0000 7f51d5ffb640 1 -- 172.21.15.78:0/1094953304 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mds"}]=0 v7) v1 ==== 90+0+0 (secure 0 0 0) 0x7f51d0050660 con 0x7f51e00c4f80 2023-11-28T20:00:07.561 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:07.558+0000 7f51e7a32640 1 -- 172.21.15.78:0/1094953304 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f51c4066470 msgr2=0x7f51c4068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:00:07.561 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:07.558+0000 7f51e7a32640 1 --2- 172.21.15.78:0/1094953304 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f51c4066470 0x7f51c4068930 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f51dc0ae000 tx=0x7f51dc0a7000 comp rx=0 tx=0).stop 2023-11-28T20:00:07.561 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:07.558+0000 7f51e7a32640 1 -- 172.21.15.78:0/1094953304 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f51e00c4f80 msgr2=0x7f51e0152a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:00:07.561 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:07.558+0000 7f51e7a32640 1 --2- 172.21.15.78:0/1094953304 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f51e00c4f80 0x7f51e0152a00 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f51d000c500 tx=0x7f51d000c9c0 comp rx=0 tx=0).stop 2023-11-28T20:00:07.561 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:07.558+0000 7f51e7a32640 1 -- 172.21.15.78:0/1094953304 shutdown_connections 2023-11-28T20:00:07.562 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:07.558+0000 7f51e7a32640 1 --2- 172.21.15.78:0/1094953304 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f51c4066470 0x7f51c4068930 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:07.562 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:07.558+0000 7f51e7a32640 1 --2- 172.21.15.78:0/1094953304 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f51e0154390 0x7f51e01eb8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:07.562 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:07.558+0000 7f51e7a32640 1 --2- 172.21.15.78:0/1094953304 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f51e00c4f80 0x7f51e0152a00 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:07.562 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:07.558+0000 7f51e7a32640 1 --2- 172.21.15.78:0/1094953304 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f51e00c2110 0x7f51e01485d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:07.562 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:07.558+0000 7f51e7a32640 1 -- 172.21.15.78:0/1094953304 >> 172.21.15.78:0/1094953304 conn(0x7f51e006b220 msgr2=0x7f51e00c5ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:00:07.562 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:07.558+0000 7f51e7a32640 1 -- 172.21.15.78:0/1094953304 shutdown_connections 2023-11-28T20:00:07.563 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:07.558+0000 7f51e7a32640 1 -- 172.21.15.78:0/1094953304 wait complete. 2023-11-28T20:00:07.579 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mgr 2023-11-28T20:00:07.717 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:07.714+0000 7f86f270f640 1 Processor -- start 2023-11-28T20:00:07.718 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:07.714+0000 7f86f270f640 1 -- start start 2023-11-28T20:00:07.719 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:07.714+0000 7f86f270f640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f86ec0a4f90 0x7f86ec0c59c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:07.719 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:07.714+0000 7f86f270f640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f86ec0a5370 0x7f86ec14f870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:07.719 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:07.714+0000 7f86f270f640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f86ec072810 0x7f86ec14fdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:07.719 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:07.714+0000 7f86f270f640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f86ec1524b0 con 0x7f86ec0a5370 2023-11-28T20:00:07.720 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:07.714+0000 7f86f270f640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f86ec0c62f0 con 0x7f86ec072810 2023-11-28T20:00:07.720 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:07.714+0000 7f86f270f640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86ec152770 con 0x7f86ec0a4f90 2023-11-28T20:00:07.720 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:07.714+0000 7f86eb7fe640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f86ec0a5370 0x7f86ec14f870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:07.720 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:07.714+0000 7f86eb7fe640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f86ec0a5370 0x7f86ec14f870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:36158/0 (socket says 172.21.15.78:36158) 2023-11-28T20:00:07.720 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:07.714+0000 7f86eb7fe640 1 -- 172.21.15.78:0/3929525331 learned_addr learned my addr 172.21.15.78:0/3929525331 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T20:00:07.720 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:07.714+0000 7f86f0cac640 1 --2- 172.21.15.78:0/3929525331 >> v2:172.21.15.179:3300/0 conn(0x7f86ec072810 0x7f86ec14fdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:07.721 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:07.714+0000 7f86ebfff640 1 --2- 172.21.15.78:0/3929525331 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f86ec0a4f90 0x7f86ec0c59c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:07.721 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:07.714+0000 7f86eb7fe640 1 -- 172.21.15.78:0/3929525331 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f86ec0a4f90 msgr2=0x7f86ec0c59c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:00:07.721 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:07.714+0000 7f86eb7fe640 1 --2- 172.21.15.78:0/3929525331 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f86ec0a4f90 0x7f86ec0c59c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:07.721 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:07.714+0000 7f86eb7fe640 1 -- 172.21.15.78:0/3929525331 >> v2:172.21.15.179:3300/0 conn(0x7f86ec072810 msgr2=0x7f86ec14fdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:00:07.721 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:07.714+0000 7f86eb7fe640 1 --2- 172.21.15.78:0/3929525331 >> v2:172.21.15.179:3300/0 conn(0x7f86ec072810 0x7f86ec14fdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:07.721 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:07.714+0000 7f86eb7fe640 1 -- 172.21.15.78:0/3929525331 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86ec152a50 con 0x7f86ec0a5370 2023-11-28T20:00:07.722 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:07.718+0000 7f86eb7fe640 1 --2- 172.21.15.78:0/3929525331 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f86ec0a5370 0x7f86ec14f870 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f86ec0a8820 tx=0x7f86e001c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7d08cc76a52dc7e6 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:00:07.722 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:07.718+0000 7f86eaffd640 1 -- 172.21.15.78:0/3929525331 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86e00ab600 con 0x7f86ec0a5370 2023-11-28T20:00:07.723 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:07.718+0000 7f86eaffd640 1 -- 172.21.15.78:0/3929525331 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f86e00a7050 con 0x7f86ec0a5370 2023-11-28T20:00:07.723 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:07.718+0000 7f86eaffd640 1 -- 172.21.15.78:0/3929525331 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86e00ab980 con 0x7f86ec0a5370 2023-11-28T20:00:07.724 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:07.718+0000 7f86f270f640 1 -- 172.21.15.78:0/3929525331 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f86ec0a5370 msgr2=0x7f86ec14f870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:00:07.724 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:07.718+0000 7f86f270f640 1 --2- 172.21.15.78:0/3929525331 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f86ec0a5370 0x7f86ec14f870 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f86ec0a8820 tx=0x7f86e001c470 comp rx=0 tx=0).stop 2023-11-28T20:00:07.724 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:07.718+0000 7f86f270f640 1 -- 172.21.15.78:0/3929525331 shutdown_connections 2023-11-28T20:00:07.724 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:07.718+0000 7f86f270f640 1 --2- 172.21.15.78:0/3929525331 >> v2:172.21.15.179:3300/0 conn(0x7f86ec072810 0x7f86ec14fdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:07.724 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:07.718+0000 7f86f270f640 1 --2- 172.21.15.78:0/3929525331 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f86ec0a5370 0x7f86ec14f870 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:07.724 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:07.718+0000 7f86f270f640 1 --2- 172.21.15.78:0/3929525331 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f86ec0a4f90 0x7f86ec0c59c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:07.724 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:07.718+0000 7f86f270f640 1 -- 172.21.15.78:0/3929525331 >> 172.21.15.78:0/3929525331 conn(0x7f86ec06b220 msgr2=0x7f86ec0a77e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:00:07.725 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:07.718+0000 7f86f270f640 1 -- 172.21.15.78:0/3929525331 shutdown_connections 2023-11-28T20:00:07.725 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:07.718+0000 7f86f270f640 1 -- 172.21.15.78:0/3929525331 wait complete. 2023-11-28T20:00:07.725 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:07.722+0000 7f86f270f640 1 Processor -- start 2023-11-28T20:00:07.725 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:07.722+0000 7f86f270f640 1 -- start start 2023-11-28T20:00:07.727 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:07.722+0000 7f86f270f640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f86ec072810 0x7f86ec149bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:07.727 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:07.722+0000 7f86f270f640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f86ec0a4f90 0x7f86ec14ac20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:07.727 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:07.722+0000 7f86f270f640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f86ec0a5370 0x7f86ec1f04f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:07.727 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:07.722+0000 7f86f270f640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86ec151c90 con 0x7f86ec072810 2023-11-28T20:00:07.727 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:07.722+0000 7f86f270f640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86ec14b780 con 0x7f86ec0a4f90 2023-11-28T20:00:07.727 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:07.722+0000 7f86f270f640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86ec150ed0 con 0x7f86ec0a5370 2023-11-28T20:00:07.728 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:07.722+0000 7f86ebfff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f86ec072810 0x7f86ec149bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:07.728 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:07.722+0000 7f86ebfff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f86ec072810 0x7f86ec149bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:36166/0 (socket says 172.21.15.78:36166) 2023-11-28T20:00:07.728 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:07.722+0000 7f86ebfff640 1 -- 172.21.15.78:0/3825480772 learned_addr learned my addr 172.21.15.78:0/3825480772 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T20:00:07.728 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:07.722+0000 7f86eb7fe640 1 --2- 172.21.15.78:0/3825480772 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f86ec0a4f90 0x7f86ec14ac20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:07.728 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:07.722+0000 7f86f0cac640 1 --2- 172.21.15.78:0/3825480772 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f86ec0a5370 0x7f86ec1f04f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:07.728 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:07.722+0000 7f86ebfff640 1 -- 172.21.15.78:0/3825480772 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f86ec0a5370 msgr2=0x7f86ec1f04f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:00:07.728 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:07.722+0000 7f86ebfff640 1 --2- 172.21.15.78:0/3825480772 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f86ec0a5370 0x7f86ec1f04f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:07.728 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:07.722+0000 7f86ebfff640 1 -- 172.21.15.78:0/3825480772 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f86ec0a4f90 msgr2=0x7f86ec14ac20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:00:07.728 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:07.722+0000 7f86ebfff640 1 --2- 172.21.15.78:0/3825480772 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f86ec0a4f90 0x7f86ec14ac20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:07.728 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:07.722+0000 7f86ebfff640 1 -- 172.21.15.78:0/3825480772 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86e00094d0 con 0x7f86ec072810 2023-11-28T20:00:07.728 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:07.722+0000 7f86ebfff640 1 --2- 172.21.15.78:0/3825480772 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f86ec072810 0x7f86ec149bf0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f86dc00d800 tx=0x7f86dc00dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:00:07.730 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:07.722+0000 7f86e8ff9640 1 -- 172.21.15.78:0/3825480772 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86dc00b6c0 con 0x7f86ec072810 2023-11-28T20:00:07.730 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:07.722+0000 7f86e8ff9640 1 -- 172.21.15.78:0/3825480772 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f86dc00b820 con 0x7f86ec072810 2023-11-28T20:00:07.730 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:07.722+0000 7f86e8ff9640 1 -- 172.21.15.78:0/3825480772 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86dc00bb90 con 0x7f86ec072810 2023-11-28T20:00:07.730 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:07.722+0000 7f86f270f640 1 -- 172.21.15.78:0/3825480772 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f86ec1511b0 con 0x7f86ec072810 2023-11-28T20:00:07.730 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:07.726+0000 7f86f270f640 1 -- 172.21.15.78:0/3825480772 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f86ec151770 con 0x7f86ec072810 2023-11-28T20:00:07.730 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:07.726+0000 7f86f270f640 1 -- 172.21.15.78:0/3825480772 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f86ec151930 con 0x7f86ec072810 2023-11-28T20:00:07.730 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:07.726+0000 7f86e8ff9640 1 -- 172.21.15.78:0/3825480772 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f86dc00bcf0 con 0x7f86ec072810 2023-11-28T20:00:07.731 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:07.726+0000 7f86e8ff9640 1 --2- 172.21.15.78:0/3825480772 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f86d8066470 0x7f86d8068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:07.731 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:07.726+0000 7f86e8ff9640 1 -- 172.21.15.78:0/3825480772 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5177+0+0 (secure 0 0 0) 0x7f86dc0840c0 con 0x7f86ec072810 2023-11-28T20:00:07.731 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:07.726+0000 7f86eb7fe640 1 --2- 172.21.15.78:0/3825480772 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f86d8066470 0x7f86d8068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:07.731 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:07.730+0000 7f86eb7fe640 1 --2- 172.21.15.78:0/3825480772 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f86d8066470 0x7f86d8068930 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f86e00ad000 tx=0x7f86e0008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:00:07.734 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:07.730+0000 7f86e8ff9640 1 -- 172.21.15.78:0/3825480772 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f86dc051740 con 0x7f86ec072810 2023-11-28T20:00:07.935 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:07.930+0000 7f86f270f640 1 -- 172.21.15.78:0/3825480772 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mgr"} v 0) v1 -- 0x7f86ec067630 con 0x7f86ec072810 2023-11-28T20:00:07.937 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:07.934+0000 7f86e8ff9640 1 -- 172.21.15.78:0/3825480772 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mgr"}]=0 v8) v1 ==== 90+0+0 (secure 0 0 0) 0x7f86dc054d60 con 0x7f86ec072810 2023-11-28T20:00:07.940 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:07.938+0000 7f86f270f640 1 -- 172.21.15.78:0/3825480772 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f86d8066470 msgr2=0x7f86d8068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:00:07.940 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:07.938+0000 7f86f270f640 1 --2- 172.21.15.78:0/3825480772 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f86d8066470 0x7f86d8068930 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f86e00ad000 tx=0x7f86e0008040 comp rx=0 tx=0).stop 2023-11-28T20:00:07.940 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:07.938+0000 7f86f270f640 1 -- 172.21.15.78:0/3825480772 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f86ec072810 msgr2=0x7f86ec149bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:00:07.941 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:07.938+0000 7f86f270f640 1 --2- 172.21.15.78:0/3825480772 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f86ec072810 0x7f86ec149bf0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f86dc00d800 tx=0x7f86dc00dcc0 comp rx=0 tx=0).stop 2023-11-28T20:00:07.941 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:07.938+0000 7f86f270f640 1 -- 172.21.15.78:0/3825480772 shutdown_connections 2023-11-28T20:00:07.941 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:07.938+0000 7f86f270f640 1 --2- 172.21.15.78:0/3825480772 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f86d8066470 0x7f86d8068930 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:07.941 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:07.938+0000 7f86f270f640 1 --2- 172.21.15.78:0/3825480772 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f86ec0a5370 0x7f86ec1f04f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:07.941 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:07.938+0000 7f86f270f640 1 --2- 172.21.15.78:0/3825480772 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f86ec0a4f90 0x7f86ec14ac20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:07.941 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:07.938+0000 7f86f270f640 1 --2- 172.21.15.78:0/3825480772 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f86ec072810 0x7f86ec149bf0 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:07.941 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:07.938+0000 7f86f270f640 1 -- 172.21.15.78:0/3825480772 >> 172.21.15.78:0/3825480772 conn(0x7f86ec06b220 msgr2=0x7f86ec0a77c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:00:07.942 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:07.938+0000 7f86f270f640 1 -- 172.21.15.78:0/3825480772 shutdown_connections 2023-11-28T20:00:07.942 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:07.938+0000 7f86f270f640 1 -- 172.21.15.78:0/3825480772 wait complete. 2023-11-28T20:00:07.959 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-osd 2023-11-28T20:00:08.098 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:08.094+0000 7f15f4bb8640 1 Processor -- start 2023-11-28T20:00:08.098 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:08.094+0000 7f15f4bb8640 1 -- start start 2023-11-28T20:00:08.099 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:08.094+0000 7f15f4bb8640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f15f015cba0 0x7f15f006d160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:08.099 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:08.094+0000 7f15f4bb8640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f15f015c710 con 0x7f15f006d6a0 2023-11-28T20:00:08.100 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:08.094+0000 7f15f4bb8640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f15f00c4040 con 0x7f15f0152d30 2023-11-28T20:00:08.100 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:08.094+0000 7f15f4bb8640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f15f006c360 con 0x7f15f015cba0 2023-11-28T20:00:08.100 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:08.094+0000 7f15e7fff640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f15f015cba0 0x7f15f006d160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:08.100 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:08.094+0000 7f15e7fff640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f15f015cba0 0x7f15f006d160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:36180/0 (socket says 172.21.15.78:36180) 2023-11-28T20:00:08.100 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:08.094+0000 7f15e7fff640 1 -- 172.21.15.78:0/1152779297 learned_addr learned my addr 172.21.15.78:0/1152779297 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T20:00:08.100 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:08.094+0000 7f15eed9d640 1 --1- 172.21.15.78:0/1152779297 >> v1:172.21.15.78:6789/0 conn(0x7f15f006d6a0 0x7f15f00a9af0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:33260/0 (socket says 172.21.15.78:33260) 2023-11-28T20:00:08.100 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:08.098+0000 7f15e7fff640 1 -- 172.21.15.78:0/1152779297 >> v1:172.21.15.179:6789/0 conn(0x7f15f0152d30 legacy=0x7f15f00c3930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:00:08.100 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:08.098+0000 7f15e7fff640 1 -- 172.21.15.78:0/1152779297 >> v1:172.21.15.78:6789/0 conn(0x7f15f006d6a0 legacy=0x7f15f00a9af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:00:08.100 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:08.098+0000 7f15e7fff640 1 -- 172.21.15.78:0/1152779297 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15f00aa820 con 0x7f15f015cba0 2023-11-28T20:00:08.102 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:08.098+0000 7f15e7fff640 1 --2- 172.21.15.78:0/1152779297 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f15f015cba0 0x7f15f006d160 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f15d8009870 tx=0x7f15d801c540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2c03bfb0242d2952 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:00:08.103 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:08.098+0000 7f15edd9b640 1 -- 172.21.15.78:0/1152779297 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15d80ab650 con 0x7f15f015cba0 2023-11-28T20:00:08.103 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:08.098+0000 7f15edd9b640 1 -- 172.21.15.78:0/1152779297 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f15d80ab7b0 con 0x7f15f015cba0 2023-11-28T20:00:08.103 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:08.098+0000 7f15edd9b640 1 -- 172.21.15.78:0/1152779297 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15d80abb40 con 0x7f15f015cba0 2023-11-28T20:00:08.103 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:08.098+0000 7f15f4bb8640 1 -- 172.21.15.78:0/1152779297 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f15f015cba0 msgr2=0x7f15f006d160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:00:08.104 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:08.098+0000 7f15f4bb8640 1 --2- 172.21.15.78:0/1152779297 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f15f015cba0 0x7f15f006d160 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f15d8009870 tx=0x7f15d801c540 comp rx=0 tx=0).stop 2023-11-28T20:00:08.104 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:08.098+0000 7f15f4bb8640 1 -- 172.21.15.78:0/1152779297 shutdown_connections 2023-11-28T20:00:08.104 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:08.098+0000 7f15f4bb8640 1 --2- 172.21.15.78:0/1152779297 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f15f015cba0 0x7f15f006d160 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:08.104 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:08.098+0000 7f15f4bb8640 1 -- 172.21.15.78:0/1152779297 >> 172.21.15.78:0/1152779297 conn(0x7f15f006b220 msgr2=0x7f15f00a77e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:00:08.104 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:08.098+0000 7f15f4bb8640 1 -- 172.21.15.78:0/1152779297 shutdown_connections 2023-11-28T20:00:08.104 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:08.098+0000 7f15f4bb8640 1 -- 172.21.15.78:0/1152779297 wait complete. 2023-11-28T20:00:08.105 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:08.102+0000 7f15f4bb8640 1 Processor -- start 2023-11-28T20:00:08.105 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:08.102+0000 7f15f4bb8640 1 -- start start 2023-11-28T20:00:08.107 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:08.102+0000 7f15f4bb8640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f15f006d6a0 0x7f15f00a6ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:08.107 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:08.102+0000 7f15f4bb8640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f15f0152d30 0x7f15f014b400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:08.107 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:08.102+0000 7f15f4bb8640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f15f015cba0 0x7f15f014faf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:08.108 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:08.102+0000 7f15f4bb8640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15f0151fe0 con 0x7f15f0152d30 2023-11-28T20:00:08.108 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:08.102+0000 7f15f4bb8640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15f00a6630 con 0x7f15f015cba0 2023-11-28T20:00:08.108 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:08.102+0000 7f15f4bb8640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15f00a7800 con 0x7f15f006d6a0 2023-11-28T20:00:08.108 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:08.102+0000 7f15e7fff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f15f0152d30 0x7f15f014b400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:08.108 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:08.102+0000 7f15e7fff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f15f0152d30 0x7f15f014b400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:36196/0 (socket says 172.21.15.78:36196) 2023-11-28T20:00:08.108 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:08.102+0000 7f15e7fff640 1 -- 172.21.15.78:0/3378841501 learned_addr learned my addr 172.21.15.78:0/3378841501 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T20:00:08.108 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:08.102+0000 7f15eed9d640 1 --2- 172.21.15.78:0/3378841501 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f15f015cba0 0x7f15f014faf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:08.108 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:08.102+0000 7f15ee59c640 1 --2- 172.21.15.78:0/3378841501 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f15f006d6a0 0x7f15f00a6ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:08.108 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:08.102+0000 7f15e7fff640 1 -- 172.21.15.78:0/3378841501 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f15f006d6a0 msgr2=0x7f15f00a6ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:00:08.108 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:08.102+0000 7f15e7fff640 1 --2- 172.21.15.78:0/3378841501 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f15f006d6a0 0x7f15f00a6ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:08.108 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:08.102+0000 7f15e7fff640 1 -- 172.21.15.78:0/3378841501 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f15f015cba0 msgr2=0x7f15f014faf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:00:08.108 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:08.102+0000 7f15e7fff640 1 --2- 172.21.15.78:0/3378841501 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f15f015cba0 0x7f15f014faf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:08.109 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:08.102+0000 7f15e7fff640 1 -- 172.21.15.78:0/3378841501 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15d80094d0 con 0x7f15f0152d30 2023-11-28T20:00:08.109 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:08.102+0000 7f15e7fff640 1 --2- 172.21.15.78:0/3378841501 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f15f0152d30 0x7f15f014b400 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f15d80ad040 tx=0x7f15d80192e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:00:08.109 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:08.102+0000 7f15e6ffd640 1 -- 172.21.15.78:0/3378841501 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15d80b58d0 con 0x7f15f0152d30 2023-11-28T20:00:08.109 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:08.102+0000 7f15e6ffd640 1 -- 172.21.15.78:0/3378841501 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f15d80b5a70 con 0x7f15f0152d30 2023-11-28T20:00:08.109 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:08.102+0000 7f15e6ffd640 1 -- 172.21.15.78:0/3378841501 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15d80b5e20 con 0x7f15f0152d30 2023-11-28T20:00:08.109 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:08.102+0000 7f15f4bb8640 1 -- 172.21.15.78:0/3378841501 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f15f00a7ae0 con 0x7f15f0152d30 2023-11-28T20:00:08.109 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:08.106+0000 7f15f4bb8640 1 -- 172.21.15.78:0/3378841501 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f15f014a830 con 0x7f15f0152d30 2023-11-28T20:00:08.110 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:08.106+0000 7f15f4bb8640 1 -- 172.21.15.78:0/3378841501 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f15f00a67a0 con 0x7f15f0152d30 2023-11-28T20:00:08.110 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:08.106+0000 7f15e6ffd640 1 -- 172.21.15.78:0/3378841501 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f15d80b4390 con 0x7f15f0152d30 2023-11-28T20:00:08.110 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:08.106+0000 7f15e6ffd640 1 --2- 172.21.15.78:0/3378841501 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f15d00664a0 0x7f15d0068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:08.111 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:08.106+0000 7f15e6ffd640 1 -- 172.21.15.78:0/3378841501 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5177+0+0 (secure 0 0 0) 0x7f15d811e750 con 0x7f15f0152d30 2023-11-28T20:00:08.111 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:08.106+0000 7f15ee59c640 1 --2- 172.21.15.78:0/3378841501 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f15d00664a0 0x7f15d0068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:08.111 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:08.106+0000 7f15ee59c640 1 --2- 172.21.15.78:0/3378841501 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f15d00664a0 0x7f15d0068960 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f15f015b400 tx=0x7f15e0009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:00:08.114 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:08.110+0000 7f15e6ffd640 1 -- 172.21.15.78:0/3378841501 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f15d80ebfa0 con 0x7f15f0152d30 2023-11-28T20:00:08.315 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:08.310+0000 7f15f4bb8640 1 -- 172.21.15.78:0/3378841501 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-osd"} v 0) v1 -- 0x7f15f0067630 con 0x7f15f0152d30 2023-11-28T20:00:08.317 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:08.314+0000 7f15e6ffd640 1 -- 172.21.15.78:0/3378841501 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-osd"}]=0 v9) v1 ==== 90+0+0 (secure 0 0 0) 0x7f15d80ef5c0 con 0x7f15f0152d30 2023-11-28T20:00:08.320 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:08.318+0000 7f15f4bb8640 1 -- 172.21.15.78:0/3378841501 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f15d00664a0 msgr2=0x7f15d0068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:00:08.320 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:08.318+0000 7f15f4bb8640 1 --2- 172.21.15.78:0/3378841501 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f15d00664a0 0x7f15d0068960 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f15f015b400 tx=0x7f15e0009040 comp rx=0 tx=0).stop 2023-11-28T20:00:08.320 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:08.318+0000 7f15f4bb8640 1 -- 172.21.15.78:0/3378841501 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f15f0152d30 msgr2=0x7f15f014b400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:00:08.320 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:08.318+0000 7f15f4bb8640 1 --2- 172.21.15.78:0/3378841501 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f15f0152d30 0x7f15f014b400 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f15d80ad040 tx=0x7f15d80192e0 comp rx=0 tx=0).stop 2023-11-28T20:00:08.320 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:08.318+0000 7f15f4bb8640 1 -- 172.21.15.78:0/3378841501 shutdown_connections 2023-11-28T20:00:08.321 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:08.318+0000 7f15f4bb8640 1 --2- 172.21.15.78:0/3378841501 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f15d00664a0 0x7f15d0068960 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:08.321 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:08.318+0000 7f15f4bb8640 1 --2- 172.21.15.78:0/3378841501 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f15f015cba0 0x7f15f014faf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:08.321 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:08.318+0000 7f15f4bb8640 1 --2- 172.21.15.78:0/3378841501 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f15f0152d30 0x7f15f014b400 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:08.321 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:08.318+0000 7f15f4bb8640 1 --2- 172.21.15.78:0/3378841501 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f15f006d6a0 0x7f15f00a6ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:08.321 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:08.318+0000 7f15f4bb8640 1 -- 172.21.15.78:0/3378841501 >> 172.21.15.78:0/3378841501 conn(0x7f15f006b220 msgr2=0x7f15f00c5970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:00:08.321 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:08.318+0000 7f15f4bb8640 1 -- 172.21.15.78:0/3378841501 shutdown_connections 2023-11-28T20:00:08.321 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:08.318+0000 7f15f4bb8640 1 -- 172.21.15.78:0/3378841501 wait complete. 2023-11-28T20:00:08.339 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd 2023-11-28T20:00:08.477 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:08.474+0000 7f7f6cbb5640 1 Processor -- start 2023-11-28T20:00:08.478 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:08.474+0000 7f7f6cbb5640 1 -- start start 2023-11-28T20:00:08.479 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:08.474+0000 7f7f6cbb5640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f7f680bfc80 0x7f7f68150e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:08.479 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:08.474+0000 7f7f6cbb5640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7f6806d6c0 0x7f7f68151360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:08.480 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:08.474+0000 7f7f6cbb5640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7f68151e60 con 0x7f7f6814df90 2023-11-28T20:00:08.480 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:08.474+0000 7f7f6cbb5640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7f680c1b10 con 0x7f7f680bfc80 2023-11-28T20:00:08.480 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:08.474+0000 7f7f6cbb5640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f681509f0 con 0x7f7f6806d6c0 2023-11-28T20:00:08.480 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:08.474+0000 7f7f66ffd640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f7f680bfc80 0x7f7f68150e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:08.481 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:08.474+0000 7f7f66ffd640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f7f680bfc80 0x7f7f68150e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:36208/0 (socket says 172.21.15.78:36208) 2023-11-28T20:00:08.481 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:08.474+0000 7f7f66ffd640 1 -- 172.21.15.78:0/1193290642 learned_addr learned my addr 172.21.15.78:0/1193290642 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T20:00:08.481 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:08.474+0000 7f7f67fff640 1 --2- 172.21.15.78:0/1193290642 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7f6806d6c0 0x7f7f68151360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:08.481 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:08.474+0000 7f7f66ffd640 1 -- 172.21.15.78:0/1193290642 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7f6806d6c0 msgr2=0x7f7f68151360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:00:08.481 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:08.474+0000 7f7f66ffd640 1 --2- 172.21.15.78:0/1193290642 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7f6806d6c0 0x7f7f68151360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:08.481 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:08.474+0000 7f7f66ffd640 1 -- 172.21.15.78:0/1193290642 >> v1:172.21.15.179:6789/0 conn(0x7f7f6814df90 legacy=0x7f7f6806cb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:00:08.481 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:08.474+0000 7f7f66ffd640 1 -- 172.21.15.78:0/1193290642 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f680a8a40 con 0x7f7f680bfc80 2023-11-28T20:00:08.482 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:08.478+0000 7f7f66ffd640 1 --2- 172.21.15.78:0/1193290642 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7f680bfc80 0x7f7f68150e20 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f7f5c006fd0 tx=0x7f7f5c01e990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=91dfa34c1b377924 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:00:08.482 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:08.478+0000 7f7f667fc640 1 -- 172.21.15.78:0/1193290642 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f5c004230 con 0x7f7f680bfc80 2023-11-28T20:00:08.482 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:08.478+0000 7f7f667fc640 1 -- 172.21.15.78:0/1193290642 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f5c0ab070 con 0x7f7f680bfc80 2023-11-28T20:00:08.483 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:08.478+0000 7f7f667fc640 1 -- 172.21.15.78:0/1193290642 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f5c0a7710 con 0x7f7f680bfc80 2023-11-28T20:00:08.483 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:08.478+0000 7f7f6cbb5640 1 -- 172.21.15.78:0/1193290642 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7f680bfc80 msgr2=0x7f7f68150e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:00:08.483 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:08.478+0000 7f7f6cbb5640 1 --2- 172.21.15.78:0/1193290642 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7f680bfc80 0x7f7f68150e20 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f7f5c006fd0 tx=0x7f7f5c01e990 comp rx=0 tx=0).stop 2023-11-28T20:00:08.483 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:08.478+0000 7f7f6cbb5640 1 -- 172.21.15.78:0/1193290642 shutdown_connections 2023-11-28T20:00:08.484 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:08.478+0000 7f7f6cbb5640 1 --2- 172.21.15.78:0/1193290642 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7f6806d6c0 0x7f7f68151360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:08.484 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:08.478+0000 7f7f6cbb5640 1 --2- 172.21.15.78:0/1193290642 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7f680bfc80 0x7f7f68150e20 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:08.484 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:08.478+0000 7f7f6cbb5640 1 -- 172.21.15.78:0/1193290642 >> 172.21.15.78:0/1193290642 conn(0x7f7f680c2270 msgr2=0x7f7f680c2680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:00:08.484 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:08.478+0000 7f7f6cbb5640 1 -- 172.21.15.78:0/1193290642 shutdown_connections 2023-11-28T20:00:08.484 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:08.478+0000 7f7f6cbb5640 1 -- 172.21.15.78:0/1193290642 wait complete. 2023-11-28T20:00:08.484 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:08.482+0000 7f7f6cbb5640 1 Processor -- start 2023-11-28T20:00:08.485 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:08.482+0000 7f7f6cbb5640 1 -- start start 2023-11-28T20:00:08.487 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:08.482+0000 7f7f6cbb5640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7f6806d6c0 0x7f7f680a27c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:08.487 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:08.482+0000 7f7f6cbb5640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7f6814df90 0x7f7f6815ac50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:08.487 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:08.482+0000 7f7f6cbb5640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7f681f4da0 0x7f7f681ee500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:08.487 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:08.482+0000 7f7f6cbb5640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f680a46c0 con 0x7f7f681f4da0 2023-11-28T20:00:08.487 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:08.482+0000 7f7f6cbb5640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f680c4a20 con 0x7f7f6814df90 2023-11-28T20:00:08.487 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:08.482+0000 7f7f6cbb5640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f680c4d00 con 0x7f7f6806d6c0 2023-11-28T20:00:08.487 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:08.482+0000 7f7f67fff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7f681f4da0 0x7f7f681ee500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:08.487 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:08.482+0000 7f7f67fff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7f681f4da0 0x7f7f681ee500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:36212/0 (socket says 172.21.15.78:36212) 2023-11-28T20:00:08.487 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:08.482+0000 7f7f67fff640 1 -- 172.21.15.78:0/3622049476 learned_addr learned my addr 172.21.15.78:0/3622049476 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T20:00:08.488 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:08.482+0000 7f7f66ffd640 1 --2- 172.21.15.78:0/3622049476 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7f6814df90 0x7f7f6815ac50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:08.488 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:08.482+0000 7f7f677fe640 1 --2- 172.21.15.78:0/3622049476 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7f6806d6c0 0x7f7f680a27c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:08.488 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:08.482+0000 7f7f67fff640 1 -- 172.21.15.78:0/3622049476 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7f6806d6c0 msgr2=0x7f7f680a27c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:00:08.488 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:08.482+0000 7f7f67fff640 1 --2- 172.21.15.78:0/3622049476 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7f6806d6c0 0x7f7f680a27c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:08.488 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:08.482+0000 7f7f67fff640 1 -- 172.21.15.78:0/3622049476 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7f6814df90 msgr2=0x7f7f6815ac50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:00:08.488 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:08.482+0000 7f7f67fff640 1 --2- 172.21.15.78:0/3622049476 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7f6814df90 0x7f7f6815ac50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:08.488 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:08.482+0000 7f7f67fff640 1 -- 172.21.15.78:0/3622049476 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f5c00b780 con 0x7f7f681f4da0 2023-11-28T20:00:08.488 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:08.482+0000 7f7f67fff640 1 --2- 172.21.15.78:0/3622049476 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7f681f4da0 0x7f7f681ee500 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f7f60009fd0 tx=0x7f7f6000e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:00:08.489 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:08.482+0000 7f7f4ffff640 1 -- 172.21.15.78:0/3622049476 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f60014420 con 0x7f7f681f4da0 2023-11-28T20:00:08.489 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:08.482+0000 7f7f4ffff640 1 -- 172.21.15.78:0/3622049476 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f60014580 con 0x7f7f681f4da0 2023-11-28T20:00:08.489 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:08.482+0000 7f7f6cbb5640 1 -- 172.21.15.78:0/3622049476 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7f680c4fe0 con 0x7f7f681f4da0 2023-11-28T20:00:08.489 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:08.482+0000 7f7f4ffff640 1 -- 172.21.15.78:0/3622049476 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f60014930 con 0x7f7f681f4da0 2023-11-28T20:00:08.489 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:08.486+0000 7f7f6cbb5640 1 -- 172.21.15.78:0/3622049476 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7f681f5230 con 0x7f7f681f4da0 2023-11-28T20:00:08.489 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:08.486+0000 7f7f6cbb5640 1 -- 172.21.15.78:0/3622049476 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7f6806d1b0 con 0x7f7f681f4da0 2023-11-28T20:00:08.490 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:08.486+0000 7f7f4ffff640 1 -- 172.21.15.78:0/3622049476 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f7f60014a90 con 0x7f7f681f4da0 2023-11-28T20:00:08.490 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:08.486+0000 7f7f4ffff640 1 --2- 172.21.15.78:0/3622049476 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f7f54066470 0x7f7f54068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:08.491 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:08.486+0000 7f7f4ffff640 1 -- 172.21.15.78:0/3622049476 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5177+0+0 (secure 0 0 0) 0x7f7f60084490 con 0x7f7f681f4da0 2023-11-28T20:00:08.491 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:08.486+0000 7f7f677fe640 1 --2- 172.21.15.78:0/3622049476 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f7f54066470 0x7f7f54068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:08.491 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:08.486+0000 7f7f677fe640 1 --2- 172.21.15.78:0/3622049476 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f7f54066470 0x7f7f54068930 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f7f6814f870 tx=0x7f7f58007e40 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:00:08.494 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:08.490+0000 7f7f4ffff640 1 -- 172.21.15.78:0/3622049476 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f7f60051bc0 con 0x7f7f681f4da0 2023-11-28T20:00:08.695 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:08.690+0000 7f7f6cbb5640 1 -- 172.21.15.78:0/3622049476 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd"} v 0) v1 -- 0x7f7f680674b0 con 0x7f7f681f4da0 2023-11-28T20:00:08.699 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:08.698+0000 7f7f4ffff640 1 -- 172.21.15.78:0/3622049476 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd"}]=0 v10) v1 ==== 90+0+0 (secure 0 0 0) 0x7f7f600551e0 con 0x7f7f681f4da0 2023-11-28T20:00:08.703 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:08.698+0000 7f7f6cbb5640 1 -- 172.21.15.78:0/3622049476 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f7f54066470 msgr2=0x7f7f54068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:00:08.703 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:08.698+0000 7f7f6cbb5640 1 --2- 172.21.15.78:0/3622049476 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f7f54066470 0x7f7f54068930 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f7f6814f870 tx=0x7f7f58007e40 comp rx=0 tx=0).stop 2023-11-28T20:00:08.703 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:08.698+0000 7f7f6cbb5640 1 -- 172.21.15.78:0/3622049476 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7f681f4da0 msgr2=0x7f7f681ee500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:00:08.703 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:08.698+0000 7f7f6cbb5640 1 --2- 172.21.15.78:0/3622049476 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7f681f4da0 0x7f7f681ee500 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f7f60009fd0 tx=0x7f7f6000e4b0 comp rx=0 tx=0).stop 2023-11-28T20:00:08.703 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:08.698+0000 7f7f6cbb5640 1 -- 172.21.15.78:0/3622049476 shutdown_connections 2023-11-28T20:00:08.704 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:08.698+0000 7f7f6cbb5640 1 --2- 172.21.15.78:0/3622049476 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f7f54066470 0x7f7f54068930 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:08.704 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:08.698+0000 7f7f6cbb5640 1 --2- 172.21.15.78:0/3622049476 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7f681f4da0 0x7f7f681ee500 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:08.704 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:08.698+0000 7f7f6cbb5640 1 --2- 172.21.15.78:0/3622049476 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7f6814df90 0x7f7f6815ac50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:08.704 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:08.698+0000 7f7f6cbb5640 1 --2- 172.21.15.78:0/3622049476 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7f6806d6c0 0x7f7f680a27c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:08.704 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:08.698+0000 7f7f6cbb5640 1 -- 172.21.15.78:0/3622049476 >> 172.21.15.78:0/3622049476 conn(0x7f7f680c2270 msgr2=0x7f7f680c2650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:00:08.704 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:08.698+0000 7f7f6cbb5640 1 -- 172.21.15.78:0/3622049476 shutdown_connections 2023-11-28T20:00:08.704 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:08.698+0000 7f7f6cbb5640 1 -- 172.21.15.78:0/3622049476 wait complete. 2023-11-28T20:00:08.722 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd-mirror 2023-11-28T20:00:08.860 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:08.858+0000 7fb6740c9640 1 Processor -- start 2023-11-28T20:00:08.860 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:08.858+0000 7fb6740c9640 1 -- start start 2023-11-28T20:00:08.861 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:08.858+0000 7fb6740c9640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fb66c0c2110 0x7fb66c0c5ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:08.861 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:08.858+0000 7fb6740c9640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb66c0c0c80 0x7fb66c0c61e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:08.861 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:08.858+0000 7fb6740c9640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb66c0a93d0 con 0x7fb66c154390 2023-11-28T20:00:08.862 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:08.858+0000 7fb6740c9640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb66c0aa1c0 con 0x7fb66c0c2110 2023-11-28T20:00:08.862 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:08.858+0000 7fb6740c9640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb66c154770 con 0x7fb66c0c0c80 2023-11-28T20:00:08.862 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:08.858+0000 7fb671e65640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7fb66c154390 0x7fb66c0c4a40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:33270/0 (socket says 172.21.15.78:33270) 2023-11-28T20:00:08.862 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:08.858+0000 7fb671e65640 1 -- 172.21.15.78:0/2425684369 learned_addr learned my addr 172.21.15.78:0/2425684369 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-11-28T20:00:08.863 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:08.858+0000 7fb671664640 1 --2- 172.21.15.78:0/2425684369 >> v2:172.21.15.179:3300/0 conn(0x7fb66c0c2110 0x7fb66c0c5ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:08.863 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:08.858+0000 7fb672666640 1 --2- 172.21.15.78:0/2425684369 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb66c0c0c80 0x7fb66c0c61e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:08.863 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:08.858+0000 7fb670e63640 1 -- 172.21.15.78:0/2425684369 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 67759193 0 0) 0x7fb66c0a93d0 con 0x7fb66c154390 2023-11-28T20:00:08.863 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:08.858+0000 7fb670e63640 1 -- 172.21.15.78:0/2425684369 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb658003530 con 0x7fb66c154390 2023-11-28T20:00:08.863 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:08.858+0000 7fb671664640 1 -- 172.21.15.78:0/2425684369 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb66c0c0c80 msgr2=0x7fb66c0c61e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:00:08.863 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:08.858+0000 7fb671664640 1 --2- 172.21.15.78:0/2425684369 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb66c0c0c80 0x7fb66c0c61e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:08.863 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:08.858+0000 7fb671664640 1 -- 172.21.15.78:0/2425684369 >> v1:172.21.15.78:6789/0 conn(0x7fb66c154390 legacy=0x7fb66c0c4a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:00:08.863 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:08.858+0000 7fb671664640 1 -- 172.21.15.78:0/2425684369 --> v2:172.21.15.179:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb66c0a9640 con 0x7fb66c0c2110 2023-11-28T20:00:08.865 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:08.862+0000 7fb671664640 1 --2- 172.21.15.78:0/2425684369 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb66c0c2110 0x7fb66c0c5ca0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fb65c0097f0 tx=0x7fb65c01c480 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2e9d059ad342a2eb server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:00:08.865 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:08.862+0000 7fb670e63640 1 -- 172.21.15.78:0/2425684369 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb65c0ab680 con 0x7fb66c0c2110 2023-11-28T20:00:08.865 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:08.862+0000 7fb670e63640 1 -- 172.21.15.78:0/2425684369 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb65c0ab7e0 con 0x7fb66c0c2110 2023-11-28T20:00:08.866 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:08.862+0000 7fb670e63640 1 -- 172.21.15.78:0/2425684369 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb65c0abb70 con 0x7fb66c0c2110 2023-11-28T20:00:08.866 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:08.862+0000 7fb6740c9640 1 -- 172.21.15.78:0/2425684369 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb66c0c2110 msgr2=0x7fb66c0c5ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:00:08.866 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:08.862+0000 7fb6740c9640 1 --2- 172.21.15.78:0/2425684369 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb66c0c2110 0x7fb66c0c5ca0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fb65c0097f0 tx=0x7fb65c01c480 comp rx=0 tx=0).stop 2023-11-28T20:00:08.867 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:08.862+0000 7fb6740c9640 1 -- 172.21.15.78:0/2425684369 shutdown_connections 2023-11-28T20:00:08.867 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:08.862+0000 7fb6740c9640 1 --2- 172.21.15.78:0/2425684369 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb66c0c0c80 0x7fb66c0c61e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:08.867 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:08.862+0000 7fb6740c9640 1 --2- 172.21.15.78:0/2425684369 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb66c0c2110 0x7fb66c0c5ca0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:08.867 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:08.862+0000 7fb6740c9640 1 -- 172.21.15.78:0/2425684369 >> 172.21.15.78:0/2425684369 conn(0x7fb66c06b220 msgr2=0x7fb66c0a77e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:00:08.867 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:08.862+0000 7fb6740c9640 1 -- 172.21.15.78:0/2425684369 shutdown_connections 2023-11-28T20:00:08.867 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:08.862+0000 7fb6740c9640 1 -- 172.21.15.78:0/2425684369 wait complete. 2023-11-28T20:00:08.868 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:08.866+0000 7fb6740c9640 1 Processor -- start 2023-11-28T20:00:08.868 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:08.866+0000 7fb6740c9640 1 -- start start 2023-11-28T20:00:08.869 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:08.866+0000 7fb6740c9640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb66c0c0c80 0x7fb66c0bf0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:08.870 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:08.866+0000 7fb6740c9640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb66c0c2110 0x7fb66c148090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:08.870 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:08.866+0000 7fb6740c9640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb66c154390 0x7fb66c1ed070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:08.870 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:08.866+0000 7fb6740c9640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb66c14d100 con 0x7fb66c0c0c80 2023-11-28T20:00:08.870 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:08.866+0000 7fb6740c9640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb66c14e8b0 con 0x7fb66c0c2110 2023-11-28T20:00:08.870 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:08.866+0000 7fb6740c9640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb66c0a5730 con 0x7fb66c154390 2023-11-28T20:00:08.871 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:08.866+0000 7fb671e65640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb66c0c0c80 0x7fb66c0bf0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:08.871 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:08.866+0000 7fb671e65640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb66c0c0c80 0x7fb66c0bf0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:36214/0 (socket says 172.21.15.78:36214) 2023-11-28T20:00:08.871 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:08.866+0000 7fb671e65640 1 -- 172.21.15.78:0/3539201092 learned_addr learned my addr 172.21.15.78:0/3539201092 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T20:00:08.871 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:08.866+0000 7fb671664640 1 --2- 172.21.15.78:0/3539201092 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb66c0c2110 0x7fb66c148090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:08.871 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:08.866+0000 7fb672666640 1 --2- 172.21.15.78:0/3539201092 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb66c154390 0x7fb66c1ed070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:08.871 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:08.866+0000 7fb671e65640 1 -- 172.21.15.78:0/3539201092 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb66c154390 msgr2=0x7fb66c1ed070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:00:08.871 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:08.866+0000 7fb671e65640 1 --2- 172.21.15.78:0/3539201092 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb66c154390 0x7fb66c1ed070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:08.871 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:08.866+0000 7fb671e65640 1 -- 172.21.15.78:0/3539201092 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb66c0c2110 msgr2=0x7fb66c148090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:00:08.872 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:08.866+0000 7fb671e65640 1 --2- 172.21.15.78:0/3539201092 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb66c0c2110 0x7fb66c148090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:08.872 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:08.866+0000 7fb671e65640 1 -- 172.21.15.78:0/3539201092 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb65c009420 con 0x7fb66c0c0c80 2023-11-28T20:00:08.872 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:08.866+0000 7fb671e65640 1 --2- 172.21.15.78:0/3539201092 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb66c0c0c80 0x7fb66c0bf0c0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7fb66800c420 tx=0x7fb66800c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:00:08.873 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:08.866+0000 7fb6627fc640 1 -- 172.21.15.78:0/3539201092 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb668005cf0 con 0x7fb66c0c0c80 2023-11-28T20:00:08.873 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:08.866+0000 7fb6627fc640 1 -- 172.21.15.78:0/3539201092 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb668005e50 con 0x7fb66c0c0c80 2023-11-28T20:00:08.873 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:08.866+0000 7fb6740c9640 1 -- 172.21.15.78:0/3539201092 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb66c0a5980 con 0x7fb66c0c0c80 2023-11-28T20:00:08.873 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:08.866+0000 7fb6627fc640 1 -- 172.21.15.78:0/3539201092 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6680072d0 con 0x7fb66c0c0c80 2023-11-28T20:00:08.873 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:08.866+0000 7fb6740c9640 1 -- 172.21.15.78:0/3539201092 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb66c0a7120 con 0x7fb66c0c0c80 2023-11-28T20:00:08.873 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:08.866+0000 7fb6740c9640 1 -- 172.21.15.78:0/3539201092 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb66c0a6f80 con 0x7fb66c0c0c80 2023-11-28T20:00:08.873 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:08.870+0000 7fb6627fc640 1 -- 172.21.15.78:0/3539201092 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fb668007430 con 0x7fb66c0c0c80 2023-11-28T20:00:08.873 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:08.870+0000 7fb6627fc640 1 --2- 172.21.15.78:0/3539201092 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fb650066470 0x7fb650068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:08.873 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:08.870+0000 7fb6627fc640 1 -- 172.21.15.78:0/3539201092 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5177+0+0 (secure 0 0 0) 0x7fb668083080 con 0x7fb66c0c0c80 2023-11-28T20:00:08.874 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:08.870+0000 7fb671664640 1 --2- 172.21.15.78:0/3539201092 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fb650066470 0x7fb650068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:08.874 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:08.870+0000 7fb671664640 1 --2- 172.21.15.78:0/3539201092 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fb650066470 0x7fb650068930 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fb65c0af000 tx=0x7fb65c0a7000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:00:08.877 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:08.874+0000 7fb6627fc640 1 -- 172.21.15.78:0/3539201092 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fb66c0a6f80 con 0x7fb66c0c0c80 2023-11-28T20:00:09.082 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:09.078+0000 7fb6740c9640 1 -- 172.21.15.78:0/3539201092 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"} v 0) v1 -- 0x7fb66c0a6f80 con 0x7fb66c0c0c80 2023-11-28T20:00:09.086 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:09.082+0000 7fb6627fc640 1 -- 172.21.15.78:0/3539201092 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"}]=0 v11) v1 ==== 97+0+0 (secure 0 0 0) 0x7fb66c0a6f80 con 0x7fb66c0c0c80 2023-11-28T20:00:09.088 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:09.086+0000 7fb6740c9640 1 -- 172.21.15.78:0/3539201092 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fb650066470 msgr2=0x7fb650068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:00:09.088 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:09.086+0000 7fb6740c9640 1 --2- 172.21.15.78:0/3539201092 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fb650066470 0x7fb650068930 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fb65c0af000 tx=0x7fb65c0a7000 comp rx=0 tx=0).stop 2023-11-28T20:00:09.088 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:09.086+0000 7fb6740c9640 1 -- 172.21.15.78:0/3539201092 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb66c0c0c80 msgr2=0x7fb66c0bf0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:00:09.089 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:09.086+0000 7fb6740c9640 1 --2- 172.21.15.78:0/3539201092 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb66c0c0c80 0x7fb66c0bf0c0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7fb66800c420 tx=0x7fb66800c8e0 comp rx=0 tx=0).stop 2023-11-28T20:00:09.089 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:09.086+0000 7fb6740c9640 1 -- 172.21.15.78:0/3539201092 shutdown_connections 2023-11-28T20:00:09.089 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:09.086+0000 7fb6740c9640 1 --2- 172.21.15.78:0/3539201092 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fb650066470 0x7fb650068930 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:09.089 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:09.086+0000 7fb6740c9640 1 --2- 172.21.15.78:0/3539201092 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb66c154390 0x7fb66c1ed070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:09.089 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:09.086+0000 7fb6740c9640 1 --2- 172.21.15.78:0/3539201092 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb66c0c2110 0x7fb66c148090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:09.089 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:09.086+0000 7fb6740c9640 1 --2- 172.21.15.78:0/3539201092 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb66c0c0c80 0x7fb66c0bf0c0 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:09.089 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:09.086+0000 7fb6740c9640 1 -- 172.21.15.78:0/3539201092 >> 172.21.15.78:0/3539201092 conn(0x7fb66c06b220 msgr2=0x7fb66c06cab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:00:09.089 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:09.086+0000 7fb6740c9640 1 -- 172.21.15.78:0/3539201092 shutdown_connections 2023-11-28T20:00:09.089 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:09.086+0000 7fb6740c9640 1 -- 172.21.15.78:0/3539201092 wait complete. 2023-11-28T20:00:09.108 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rgw 2023-11-28T20:00:09.248 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:09.242+0000 7f2057f0f640 1 Processor -- start 2023-11-28T20:00:09.249 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:09.242+0000 7f2057f0f640 1 -- start start 2023-11-28T20:00:09.249 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:09.242+0000 7f2057f0f640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f20500a4f90 0x7f20500c59c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:09.249 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:09.242+0000 7f2057f0f640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f2050072810 0x7f20500c0800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:09.249 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:09.242+0000 7f2057f0f640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f20501524b0 con 0x7f20500a5370 2023-11-28T20:00:09.249 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:09.242+0000 7f2057f0f640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f20500c62f0 con 0x7f20500a4f90 2023-11-28T20:00:09.249 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:09.242+0000 7f2057f0f640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2050152770 con 0x7f2050072810 2023-11-28T20:00:09.249 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:09.242+0000 7f2055cab640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f20500a4f90 0x7f20500c59c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:09.249 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:09.242+0000 7f2055cab640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f20500a4f90 0x7f20500c59c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:36224/0 (socket says 172.21.15.78:36224) 2023-11-28T20:00:09.249 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:09.242+0000 7f2055cab640 1 -- 172.21.15.78:0/3442938968 learned_addr learned my addr 172.21.15.78:0/3442938968 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T20:00:09.249 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:09.246+0000 7f20564ac640 1 --2- 172.21.15.78:0/3442938968 >> v2:172.21.15.179:3300/0 conn(0x7f2050072810 0x7f20500c0800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:09.250 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:09.246+0000 7f2055cab640 1 -- 172.21.15.78:0/3442938968 >> v2:172.21.15.179:3300/0 conn(0x7f2050072810 msgr2=0x7f20500c0800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:00:09.250 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:09.246+0000 7f2055cab640 1 --2- 172.21.15.78:0/3442938968 >> v2:172.21.15.179:3300/0 conn(0x7f2050072810 0x7f20500c0800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:09.250 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:09.246+0000 7f2055cab640 1 -- 172.21.15.78:0/3442938968 >> v1:172.21.15.78:6789/0 conn(0x7f20500a5370 legacy=0x7f205014f870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:00:09.250 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:09.246+0000 7f2055cab640 1 -- 172.21.15.78:0/3442938968 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2050152a50 con 0x7f20500a4f90 2023-11-28T20:00:09.250 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:09.246+0000 7f2054ca9640 1 -- 172.21.15.78:0/3442938968 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1483743873 0 0) 0x7f20501524b0 con 0x7f20500a5370 2023-11-28T20:00:09.251 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:09.246+0000 7f2055cab640 1 --2- 172.21.15.78:0/3442938968 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f20500a4f90 0x7f20500c59c0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f205006dc90 tx=0x7f204c01c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ee1d5f2ddc38229 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:00:09.251 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:09.246+0000 7f2054ca9640 1 -- 172.21.15.78:0/3442938968 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f204c0ab600 con 0x7f20500a4f90 2023-11-28T20:00:09.251 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:09.246+0000 7f2054ca9640 1 -- 172.21.15.78:0/3442938968 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f204c0a7050 con 0x7f20500a4f90 2023-11-28T20:00:09.251 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:09.246+0000 7f2054ca9640 1 -- 172.21.15.78:0/3442938968 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f204c0ab980 con 0x7f20500a4f90 2023-11-28T20:00:09.252 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:09.246+0000 7f2057f0f640 1 -- 172.21.15.78:0/3442938968 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f20500a4f90 msgr2=0x7f20500c59c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:00:09.252 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:09.250+0000 7f2057f0f640 1 --2- 172.21.15.78:0/3442938968 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f20500a4f90 0x7f20500c59c0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f205006dc90 tx=0x7f204c01c470 comp rx=0 tx=0).stop 2023-11-28T20:00:09.252 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:09.250+0000 7f2057f0f640 1 -- 172.21.15.78:0/3442938968 shutdown_connections 2023-11-28T20:00:09.252 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:09.250+0000 7f2057f0f640 1 --2- 172.21.15.78:0/3442938968 >> v2:172.21.15.179:3300/0 conn(0x7f2050072810 0x7f20500c0800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:09.252 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:09.250+0000 7f2057f0f640 1 --2- 172.21.15.78:0/3442938968 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f20500a4f90 0x7f20500c59c0 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:09.252 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:09.250+0000 7f2057f0f640 1 -- 172.21.15.78:0/3442938968 >> 172.21.15.78:0/3442938968 conn(0x7f205006b220 msgr2=0x7f20500a77e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:00:09.252 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:09.250+0000 7f2057f0f640 1 -- 172.21.15.78:0/3442938968 shutdown_connections 2023-11-28T20:00:09.253 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:09.250+0000 7f2057f0f640 1 -- 172.21.15.78:0/3442938968 wait complete. 2023-11-28T20:00:09.253 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:09.250+0000 7f2057f0f640 1 Processor -- start 2023-11-28T20:00:09.253 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:09.250+0000 7f2057f0f640 1 -- start start 2023-11-28T20:00:09.255 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:09.250+0000 7f2057f0f640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2050072810 0x7f2050156200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:09.256 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:09.250+0000 7f2057f0f640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f20500a4f90 0x7f205015bc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:09.256 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:09.250+0000 7f2057f0f640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f20500a5370 0x7f20501eb4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:09.256 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:09.250+0000 7f2057f0f640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20501eb9e0 con 0x7f20500a4f90 2023-11-28T20:00:09.256 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:09.250+0000 7f2057f0f640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20501eaa50 con 0x7f2050072810 2023-11-28T20:00:09.256 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:09.250+0000 7f2057f0f640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f20501eea70 con 0x7f20500a5370 2023-11-28T20:00:09.256 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:09.250+0000 7f20554aa640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f20500a4f90 0x7f205015bc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:09.256 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:09.250+0000 7f20554aa640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f20500a4f90 0x7f205015bc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:36230/0 (socket says 172.21.15.78:36230) 2023-11-28T20:00:09.256 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:09.250+0000 7f20554aa640 1 -- 172.21.15.78:0/1508101638 learned_addr learned my addr 172.21.15.78:0/1508101638 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T20:00:09.256 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:09.250+0000 7f2055cab640 1 --2- 172.21.15.78:0/1508101638 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2050072810 0x7f2050156200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:09.256 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:09.250+0000 7f20564ac640 1 --2- 172.21.15.78:0/1508101638 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f20500a5370 0x7f20501eb4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:09.257 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:09.250+0000 7f20554aa640 1 -- 172.21.15.78:0/1508101638 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f20500a5370 msgr2=0x7f20501eb4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:00:09.257 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:09.250+0000 7f20554aa640 1 --2- 172.21.15.78:0/1508101638 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f20500a5370 0x7f20501eb4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:09.257 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:09.250+0000 7f20554aa640 1 -- 172.21.15.78:0/1508101638 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2050072810 msgr2=0x7f2050156200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:00:09.257 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:09.250+0000 7f20554aa640 1 --2- 172.21.15.78:0/1508101638 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2050072810 0x7f2050156200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:09.257 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:09.250+0000 7f20554aa640 1 -- 172.21.15.78:0/1508101638 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f204c0094d0 con 0x7f20500a4f90 2023-11-28T20:00:09.257 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:09.250+0000 7f20554aa640 1 --2- 172.21.15.78:0/1508101638 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f20500a4f90 0x7f205015bc10 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f2040001ec0 tx=0x7f204000c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:00:09.257 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:09.250+0000 7f20467fc640 1 -- 172.21.15.78:0/1508101638 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20400054e0 con 0x7f20500a4f90 2023-11-28T20:00:09.257 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:09.254+0000 7f20467fc640 1 -- 172.21.15.78:0/1508101638 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2040003600 con 0x7f20500a4f90 2023-11-28T20:00:09.257 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:09.254+0000 7f20467fc640 1 -- 172.21.15.78:0/1508101638 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20400039b0 con 0x7f20500a4f90 2023-11-28T20:00:09.257 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:09.254+0000 7f2057f0f640 1 -- 172.21.15.78:0/1508101638 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f20501eed50 con 0x7f20500a4f90 2023-11-28T20:00:09.257 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:09.254+0000 7f2057f0f640 1 -- 172.21.15.78:0/1508101638 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f20501eaf80 con 0x7f20500a4f90 2023-11-28T20:00:09.261 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:09.254+0000 7f2057f0f640 1 -- 172.21.15.78:0/1508101638 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2050067630 con 0x7f20500a4f90 2023-11-28T20:00:09.261 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:09.254+0000 7f20467fc640 1 -- 172.21.15.78:0/1508101638 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f2040003b10 con 0x7f20500a4f90 2023-11-28T20:00:09.261 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:09.254+0000 7f20467fc640 1 --2- 172.21.15.78:0/1508101638 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f2034066470 0x7f2034068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:09.262 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:09.254+0000 7f20467fc640 1 -- 172.21.15.78:0/1508101638 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5177+0+0 (secure 0 0 0) 0x7f20400832e0 con 0x7f20500a4f90 2023-11-28T20:00:09.262 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:09.254+0000 7f2055cab640 1 --2- 172.21.15.78:0/1508101638 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f2034066470 0x7f2034068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:09.262 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:09.254+0000 7f2055cab640 1 --2- 172.21.15.78:0/1508101638 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f2034066470 0x7f2034068930 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f204c0ad000 tx=0x7f204c0a6000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:00:09.262 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:09.258+0000 7f20467fc640 1 -- 172.21.15.78:0/1508101638 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f20400508f0 con 0x7f20500a4f90 2023-11-28T20:00:09.461 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:09.458+0000 7f2057f0f640 1 -- 172.21.15.78:0/1508101638 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rgw"} v 0) v1 -- 0x7f205006c6a0 con 0x7f20500a4f90 2023-11-28T20:00:09.465 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:09.462+0000 7f20467fc640 1 -- 172.21.15.78:0/1508101638 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rgw"}]=0 v12) v1 ==== 90+0+0 (secure 0 0 0) 0x7f2040017020 con 0x7f20500a4f90 2023-11-28T20:00:09.470 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:09.462+0000 7f2057f0f640 1 -- 172.21.15.78:0/1508101638 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f2034066470 msgr2=0x7f2034068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:00:09.470 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:09.462+0000 7f2057f0f640 1 --2- 172.21.15.78:0/1508101638 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f2034066470 0x7f2034068930 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f204c0ad000 tx=0x7f204c0a6000 comp rx=0 tx=0).stop 2023-11-28T20:00:09.470 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:09.462+0000 7f2057f0f640 1 -- 172.21.15.78:0/1508101638 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f20500a4f90 msgr2=0x7f205015bc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:00:09.470 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:09.462+0000 7f2057f0f640 1 --2- 172.21.15.78:0/1508101638 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f20500a4f90 0x7f205015bc10 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f2040001ec0 tx=0x7f204000c8e0 comp rx=0 tx=0).stop 2023-11-28T20:00:09.470 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:09.466+0000 7f2057f0f640 1 -- 172.21.15.78:0/1508101638 shutdown_connections 2023-11-28T20:00:09.470 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:09.466+0000 7f2057f0f640 1 --2- 172.21.15.78:0/1508101638 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f2034066470 0x7f2034068930 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:09.470 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:09.466+0000 7f2057f0f640 1 --2- 172.21.15.78:0/1508101638 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f20500a5370 0x7f20501eb4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:09.470 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:09.466+0000 7f2057f0f640 1 --2- 172.21.15.78:0/1508101638 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f20500a4f90 0x7f205015bc10 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:09.470 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:09.466+0000 7f2057f0f640 1 --2- 172.21.15.78:0/1508101638 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2050072810 0x7f2050156200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:09.470 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:09.466+0000 7f2057f0f640 1 -- 172.21.15.78:0/1508101638 >> 172.21.15.78:0/1508101638 conn(0x7f205006b220 msgr2=0x7f2050071c10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:00:09.471 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:09.466+0000 7f2057f0f640 1 -- 172.21.15.78:0/1508101638 shutdown_connections 2023-11-28T20:00:09.471 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:09.466+0000 7f2057f0f640 1 -- 172.21.15.78:0/1508101638 wait complete. 2023-11-28T20:00:09.487 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-28T20:00:09.624 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:09.622+0000 7ff030f80640 1 Processor -- start 2023-11-28T20:00:09.625 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:09.622+0000 7ff030f80640 1 -- start start 2023-11-28T20:00:09.626 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:09.622+0000 7ff030f80640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7ff02c06d2b0 0x7ff02c06d690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:09.626 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:09.622+0000 7ff030f80640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7ff02c0c3b80 0x7ff02c0c5300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:09.626 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:09.622+0000 7ff030f80640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff02c06c020 0x7ff02c06c4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:09.626 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:09.622+0000 7ff030f80640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff02c0c5840 con 0x7ff02c0c3b80 2023-11-28T20:00:09.626 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:09.622+0000 7ff030f80640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff02c06bb80 con 0x7ff02c06d2b0 2023-11-28T20:00:09.627 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:09.622+0000 7ff030f80640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff02c1515c0 con 0x7ff02c06c020 2023-11-28T20:00:09.627 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:09.622+0000 7ff029d9b640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7ff02c0c3b80 0x7ff02c0c5300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:09.627 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:09.622+0000 7ff029d9b640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7ff02c0c3b80 0x7ff02c0c5300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:36234/0 (socket says 172.21.15.78:36234) 2023-11-28T20:00:09.627 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:09.622+0000 7ff029d9b640 1 -- 172.21.15.78:0/2081587175 learned_addr learned my addr 172.21.15.78:0/2081587175 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T20:00:09.627 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:09.622+0000 7ff02ad9d640 1 --2- 172.21.15.78:0/2081587175 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff02c06c020 0x7ff02c06c4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:09.627 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:09.622+0000 7ff02a59c640 1 --2- 172.21.15.78:0/2081587175 >> v2:172.21.15.179:3300/0 conn(0x7ff02c06d2b0 0x7ff02c06d690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:09.627 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:09.622+0000 7ff029d9b640 1 -- 172.21.15.78:0/2081587175 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff02c06c020 msgr2=0x7ff02c06c4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:00:09.627 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:09.622+0000 7ff029d9b640 1 --2- 172.21.15.78:0/2081587175 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff02c06c020 0x7ff02c06c4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:09.627 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:09.622+0000 7ff029d9b640 1 -- 172.21.15.78:0/2081587175 >> v2:172.21.15.179:3300/0 conn(0x7ff02c06d2b0 msgr2=0x7ff02c06d690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:00:09.627 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:09.622+0000 7ff029d9b640 1 --2- 172.21.15.78:0/2081587175 >> v2:172.21.15.179:3300/0 conn(0x7ff02c06d2b0 0x7ff02c06d690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:09.627 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:09.622+0000 7ff029d9b640 1 -- 172.21.15.78:0/2081587175 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff02c1518a0 con 0x7ff02c0c3b80 2023-11-28T20:00:09.629 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:09.626+0000 7ff029d9b640 1 --2- 172.21.15.78:0/2081587175 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff02c0c3b80 0x7ff02c0c5300 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7ff02c0c2130 tx=0x7ff02001eba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d3d43a74d5462e98 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:00:09.629 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:09.626+0000 7ff02959a640 1 -- 172.21.15.78:0/2081587175 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0200a7c30 con 0x7ff02c0c3b80 2023-11-28T20:00:09.630 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:09.626+0000 7ff02959a640 1 -- 172.21.15.78:0/2081587175 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff0200a7d90 con 0x7ff02c0c3b80 2023-11-28T20:00:09.630 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:09.626+0000 7ff02959a640 1 -- 172.21.15.78:0/2081587175 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0200af660 con 0x7ff02c0c3b80 2023-11-28T20:00:09.630 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:09.626+0000 7ff030f80640 1 -- 172.21.15.78:0/2081587175 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff02c0c3b80 msgr2=0x7ff02c0c5300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:00:09.631 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:09.626+0000 7ff030f80640 1 --2- 172.21.15.78:0/2081587175 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff02c0c3b80 0x7ff02c0c5300 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7ff02c0c2130 tx=0x7ff02001eba0 comp rx=0 tx=0).stop 2023-11-28T20:00:09.631 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:09.626+0000 7ff030f80640 1 -- 172.21.15.78:0/2081587175 shutdown_connections 2023-11-28T20:00:09.631 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:09.626+0000 7ff030f80640 1 --2- 172.21.15.78:0/2081587175 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff02c06c020 0x7ff02c06c4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:09.631 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:09.626+0000 7ff030f80640 1 --2- 172.21.15.78:0/2081587175 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff02c0c3b80 0x7ff02c0c5300 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:09.631 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:09.626+0000 7ff030f80640 1 --2- 172.21.15.78:0/2081587175 >> v2:172.21.15.179:3300/0 conn(0x7ff02c06d2b0 0x7ff02c06d690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:09.631 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:09.626+0000 7ff030f80640 1 -- 172.21.15.78:0/2081587175 >> 172.21.15.78:0/2081587175 conn(0x7ff02c0a7810 msgr2=0x7ff02c0a7c20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:00:09.631 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:09.626+0000 7ff030f80640 1 -- 172.21.15.78:0/2081587175 shutdown_connections 2023-11-28T20:00:09.631 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:09.626+0000 7ff030f80640 1 -- 172.21.15.78:0/2081587175 wait complete. 2023-11-28T20:00:09.632 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:09.630+0000 7ff030f80640 1 Processor -- start 2023-11-28T20:00:09.632 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:09.630+0000 7ff030f80640 1 -- start start 2023-11-28T20:00:09.634 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:09.630+0000 7ff030f80640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff02c06c020 0x7ff02c14e250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:09.634 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:09.630+0000 7ff030f80640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff02c06d2b0 0x7ff02c1ecfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:09.635 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:09.630+0000 7ff030f80640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff02c0c3b80 0x7ff02c1e3d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:09.635 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:09.630+0000 7ff030f80640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff02c157420 con 0x7ff02c06c020 2023-11-28T20:00:09.635 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:09.630+0000 7ff030f80640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff02c156630 con 0x7ff02c0c3b80 2023-11-28T20:00:09.635 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:09.630+0000 7ff030f80640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff02c1f0880 con 0x7ff02c06d2b0 2023-11-28T20:00:09.635 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:09.630+0000 7ff02a59c640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff02c06c020 0x7ff02c14e250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:09.635 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:09.630+0000 7ff02a59c640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff02c06c020 0x7ff02c14e250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:36246/0 (socket says 172.21.15.78:36246) 2023-11-28T20:00:09.635 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:09.630+0000 7ff02a59c640 1 -- 172.21.15.78:0/1270917691 learned_addr learned my addr 172.21.15.78:0/1270917691 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T20:00:09.635 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:09.630+0000 7ff02ad9d640 1 --2- 172.21.15.78:0/1270917691 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff02c0c3b80 0x7ff02c1e3d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:09.635 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:09.630+0000 7ff029d9b640 1 --2- 172.21.15.78:0/1270917691 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff02c06d2b0 0x7ff02c1ecfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:09.635 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:09.630+0000 7ff02a59c640 1 -- 172.21.15.78:0/1270917691 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff02c06d2b0 msgr2=0x7ff02c1ecfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:00:09.636 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:09.630+0000 7ff02a59c640 1 --2- 172.21.15.78:0/1270917691 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff02c06d2b0 0x7ff02c1ecfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:09.636 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:09.630+0000 7ff02a59c640 1 -- 172.21.15.78:0/1270917691 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff02c0c3b80 msgr2=0x7ff02c1e3d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:00:09.636 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:09.630+0000 7ff02a59c640 1 --2- 172.21.15.78:0/1270917691 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff02c0c3b80 0x7ff02c1e3d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:09.636 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:09.630+0000 7ff02a59c640 1 -- 172.21.15.78:0/1270917691 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff02000b770 con 0x7ff02c06c020 2023-11-28T20:00:09.636 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:09.630+0000 7ff02ad9d640 1 --2- 172.21.15.78:0/1270917691 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff02c0c3b80 0x7ff02c1e3d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T20:00:09.636 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:09.630+0000 7ff02a59c640 1 --2- 172.21.15.78:0/1270917691 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff02c06c020 0x7ff02c14e250 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7ff01c00d830 tx=0x7ff01c00dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:00:09.636 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:09.630+0000 7ff01affd640 1 -- 172.21.15.78:0/1270917691 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff01c00b6c0 con 0x7ff02c06c020 2023-11-28T20:00:09.636 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:09.630+0000 7ff01affd640 1 -- 172.21.15.78:0/1270917691 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff01c00b820 con 0x7ff02c06c020 2023-11-28T20:00:09.636 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:09.630+0000 7ff01affd640 1 -- 172.21.15.78:0/1270917691 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff01c00bb90 con 0x7ff02c06c020 2023-11-28T20:00:09.637 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:09.630+0000 7ff030f80640 1 -- 172.21.15.78:0/1270917691 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff02c14ef80 con 0x7ff02c06c020 2023-11-28T20:00:09.637 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:09.630+0000 7ff030f80640 1 -- 172.21.15.78:0/1270917691 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff02c156b60 con 0x7ff02c06c020 2023-11-28T20:00:09.637 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:09.634+0000 7ff030f80640 1 -- 172.21.15.78:0/1270917691 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff02c067630 con 0x7ff02c06c020 2023-11-28T20:00:09.637 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:09.634+0000 7ff01affd640 1 -- 172.21.15.78:0/1270917691 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7ff01c01e460 con 0x7ff02c06c020 2023-11-28T20:00:09.638 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:09.634+0000 7ff01affd640 1 --2- 172.21.15.78:0/1270917691 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7ff00c0664a0 0x7ff00c068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:09.638 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:09.634+0000 7ff01affd640 1 -- 172.21.15.78:0/1270917691 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5177+0+0 (secure 0 0 0) 0x7ff01c084260 con 0x7ff02c06c020 2023-11-28T20:00:09.638 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:09.634+0000 7ff029d9b640 1 --2- 172.21.15.78:0/1270917691 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7ff00c0664a0 0x7ff00c068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:09.638 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:09.634+0000 7ff029d9b640 1 --2- 172.21.15.78:0/1270917691 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7ff00c0664a0 0x7ff00c068960 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7ff0200b1000 tx=0x7ff020008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:00:09.642 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:09.638+0000 7ff01affd640 1 -- 172.21.15.78:0/1270917691 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7ff01c051980 con 0x7ff02c06c020 2023-11-28T20:00:09.795 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:09.790+0000 7ff030f80640 1 -- 172.21.15.78:0/1270917691 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff02c072970 con 0x7ff02c06c020 2023-11-28T20:00:09.796 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:09.794+0000 7ff01affd640 1 -- 172.21.15.78:0/1270917691 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v36) v1 ==== 74+0+13038 (secure 0 0 0) 0x7ff01c054fa0 con 0x7ff02c06c020 2023-11-28T20:00:09.796 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-11-28T20:00:09.797 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":36,"fsid":"dd9780e8-3bda-44fa-a9f0-fa07d19d901d","created":"2023-11-28T19:58:40.969556+0000","modified":"2023-11-28T20:00:06.779148+0000","last_up_change":"2023-11-28T19:58:52.596716+0000","last_in_change":"2023-11-28T19:58:43.609275+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-28T19:58:54.011229+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e84245ac-b5da-429e-af18-39acaa2b33e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6800","nonce":3358701235},{"type":"v1","addr":"172.21.15.78:6801","nonce":3358701235}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6802","nonce":3358701235},{"type":"v1","addr":"172.21.15.78:6803","nonce":3358701235}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6806","nonce":3358701235},{"type":"v1","addr":"172.21.15.78:6807","nonce":3358701235}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6804","nonce":3358701235},{"type":"v1","addr":"172.21.15.78:6805","nonce":3358701235}]},"public_addr":"172.21.15.78:6801/3358701235","cluster_addr":"172.21.15.78:6803/3358701235","heartbeat_back_addr":"172.21.15.78:6807/3358701235","heartbeat_front_addr":"172.21.15.78:6805/3358701235","state":["exists","up"]},{"osd":1,"uuid":"e634831d-c4e2-48d9-870c-9556ae162981","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6808","nonce":3211476654},{"type":"v1","addr":"172.21.15.78:6809","nonce":3211476654}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6810","nonce":3211476654},{"type":"v1","addr":"172.21.15.78:6811","nonce":3211476654}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6814","nonce":3211476654},{"type":"v1","addr":"172.21.15.78:6815","nonce":3211476654}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6812","nonce":3211476654},{"type":"v1","addr":"172.21.15.78:6813","nonce":3211476654}]},"public_addr":"172.21.15.78:6809/3211476654","cluster_addr":"172.21.15.78:6811/3211476654","heartbeat_back_addr":"172.21.15.78:6815/3211476654","heartbeat_front_addr":"172.21.15.78:6813/3211476654","state":["exists","up"]},{"osd":2,"uuid":"274c8395-6534-41f0-b8fb-a00af8985aa8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6816","nonce":2532904479},{"type":"v1","addr":"172.21.15.78:6817","nonce":2532904479}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6818","nonce":2532904479},{"type":"v1","addr":"172.21.15.78:6819","nonce":2532904479}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6822","nonce":2532904479},{"type":"v1","addr":"172.21.15.78:6823","nonce":2532904479}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6820","nonce":2532904479},{"type":"v1","addr":"172.21.15.78:6821","nonce":2532904479}]},"public_addr":"172.21.15.78:6817/2532904479","cluster_addr":"172.21.15.78:6819/2532904479","heartbeat_back_addr":"172.21.15.78:6823/2532904479","heartbeat_front_addr":"172.21.15.78:6821/2532904479","state":["exists","up"]},{"osd":3,"uuid":"77acc9af-7d4d-4b18-8cf5-d62f5971b7c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6824","nonce":3442991267},{"type":"v1","addr":"172.21.15.78:6825","nonce":3442991267}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6826","nonce":3442991267},{"type":"v1","addr":"172.21.15.78:6827","nonce":3442991267}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6830","nonce":3442991267},{"type":"v1","addr":"172.21.15.78:6831","nonce":3442991267}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6828","nonce":3442991267},{"type":"v1","addr":"172.21.15.78:6829","nonce":3442991267}]},"public_addr":"172.21.15.78:6825/3442991267","cluster_addr":"172.21.15.78:6827/3442991267","heartbeat_back_addr":"172.21.15.78:6831/3442991267","heartbeat_front_addr":"172.21.15.78:6829/3442991267","state":["exists","up"]},{"osd":4,"uuid":"5c62bc66-6b34-4b7f-a66b-9a743969138c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":802983577},{"type":"v1","addr":"172.21.15.179:6809","nonce":802983577}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":802983577},{"type":"v1","addr":"172.21.15.179:6811","nonce":802983577}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":802983577},{"type":"v1","addr":"172.21.15.179:6815","nonce":802983577}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":802983577},{"type":"v1","addr":"172.21.15.179:6813","nonce":802983577}]},"public_addr":"172.21.15.179:6809/802983577","cluster_addr":"172.21.15.179:6811/802983577","heartbeat_back_addr":"172.21.15.179:6815/802983577","heartbeat_front_addr":"172.21.15.179:6813/802983577","state":["exists","up"]},{"osd":5,"uuid":"67db6d36-f684-4079-b0cd-82b4dd61461f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":518192887},{"type":"v1","addr":"172.21.15.179:6818","nonce":518192887}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":518192887},{"type":"v1","addr":"172.21.15.179:6822","nonce":518192887}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":518192887},{"type":"v1","addr":"172.21.15.179:6829","nonce":518192887}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6824","nonce":518192887},{"type":"v1","addr":"172.21.15.179:6826","nonce":518192887}]},"public_addr":"172.21.15.179:6818/518192887","cluster_addr":"172.21.15.179:6822/518192887","heartbeat_back_addr":"172.21.15.179:6829/518192887","heartbeat_front_addr":"172.21.15.179:6826/518192887","state":["exists","up"]},{"osd":6,"uuid":"12e670af-5a16-4c81-9f97-defa66cab967","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":815435378},{"type":"v1","addr":"172.21.15.179:6801","nonce":815435378}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":815435378},{"type":"v1","addr":"172.21.15.179:6803","nonce":815435378}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":815435378},{"type":"v1","addr":"172.21.15.179:6807","nonce":815435378}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":815435378},{"type":"v1","addr":"172.21.15.179:6805","nonce":815435378}]},"public_addr":"172.21.15.179:6801/815435378","cluster_addr":"172.21.15.179:6803/815435378","heartbeat_back_addr":"172.21.15.179:6807/815435378","heartbeat_front_addr":"172.21.15.179:6805/815435378","state":["exists","up"]},{"osd":7,"uuid":"fe630650-2eb3-49ad-8676-c341e6332eb1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6817","nonce":2848432339},{"type":"v1","addr":"172.21.15.179:6819","nonce":2848432339}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6821","nonce":2848432339},{"type":"v1","addr":"172.21.15.179:6823","nonce":2848432339}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":2848432339},{"type":"v1","addr":"172.21.15.179:6831","nonce":2848432339}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6825","nonce":2848432339},{"type":"v1","addr":"172.21.15.179:6827","nonce":2848432339}]},"public_addr":"172.21.15.179:6819/2848432339","cluster_addr":"172.21.15.179:6823/2848432339","heartbeat_back_addr":"172.21.15.179:6831/2848432339","heartbeat_front_addr":"172.21.15.179:6827/2848432339","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:58:49.255433+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:58:49.412880+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:58:49.559295+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:58:49.245237+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:58:49.184557+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:58:49.329851+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:58:49.366012+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:58:49.349604+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-28T20:00:09.798 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:09.794+0000 7ff030f80640 1 -- 172.21.15.78:0/1270917691 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7ff00c0664a0 msgr2=0x7ff00c068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:00:09.798 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:09.794+0000 7ff030f80640 1 --2- 172.21.15.78:0/1270917691 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7ff00c0664a0 0x7ff00c068960 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7ff0200b1000 tx=0x7ff020008040 comp rx=0 tx=0).stop 2023-11-28T20:00:09.799 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:09.794+0000 7ff030f80640 1 -- 172.21.15.78:0/1270917691 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff02c06c020 msgr2=0x7ff02c14e250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:00:09.799 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:09.794+0000 7ff030f80640 1 --2- 172.21.15.78:0/1270917691 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff02c06c020 0x7ff02c14e250 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7ff01c00d830 tx=0x7ff01c00dcf0 comp rx=0 tx=0).stop 2023-11-28T20:00:09.799 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:09.794+0000 7ff030f80640 1 -- 172.21.15.78:0/1270917691 shutdown_connections 2023-11-28T20:00:09.799 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:09.794+0000 7ff030f80640 1 --2- 172.21.15.78:0/1270917691 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7ff00c0664a0 0x7ff00c068960 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:09.799 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:09.794+0000 7ff030f80640 1 --2- 172.21.15.78:0/1270917691 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff02c06d2b0 0x7ff02c1ecfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:09.799 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:09.794+0000 7ff030f80640 1 --2- 172.21.15.78:0/1270917691 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff02c0c3b80 0x7ff02c1e3d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:09.799 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:09.794+0000 7ff030f80640 1 --2- 172.21.15.78:0/1270917691 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff02c06c020 0x7ff02c14e250 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:09.799 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:09.794+0000 7ff030f80640 1 -- 172.21.15.78:0/1270917691 >> 172.21.15.78:0/1270917691 conn(0x7ff02c0a7810 msgr2=0x7ff02c0bee90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:00:09.799 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:09.794+0000 7ff030f80640 1 -- 172.21.15.78:0/1270917691 shutdown_connections 2023-11-28T20:00:09.799 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:09.794+0000 7ff030f80640 1 -- 172.21.15.78:0/1270917691 wait complete. 2023-11-28T20:00:09.817 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-28T19:58:54.011229+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-28T20:00:09.818 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-28T20:00:09.957 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:09.954+0000 7f0113557640 1 Processor -- start 2023-11-28T20:00:09.957 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:09.954+0000 7f0113557640 1 -- start start 2023-11-28T20:00:09.958 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:09.954+0000 7f0113557640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f010c0a4f30 0x7f010c0bf140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:09.958 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:09.954+0000 7f0113557640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f010c0c4b20 0x7f010c1585d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:09.959 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:09.954+0000 7f0113557640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f010c157b80 con 0x7f010c0bed60 2023-11-28T20:00:09.959 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:09.954+0000 7f0113557640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f010c158b10 con 0x7f010c0c4b20 2023-11-28T20:00:09.959 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:09.954+0000 7f0113557640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f010c06d6c0 con 0x7f010c0a4f30 2023-11-28T20:00:09.960 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:09.954+0000 7f0111af4640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f010c0c4b20 0x7f010c1585d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:09.960 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:09.954+0000 7f0110af2640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f010c0a4f30 0x7f010c0bf140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:09.960 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:09.954+0000 7f0111af4640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f010c0c4b20 0x7f010c1585d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.78:46040/0 (socket says 172.21.15.78:46040) 2023-11-28T20:00:09.960 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:09.954+0000 7f0111af4640 1 -- 172.21.15.78:0/335381950 learned_addr learned my addr 172.21.15.78:0/335381950 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T20:00:09.960 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:09.954+0000 7f0111af4640 1 -- 172.21.15.78:0/335381950 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f010c0a4f30 msgr2=0x7f010c0bf140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:00:09.960 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:09.954+0000 7f0111af4640 1 --2- 172.21.15.78:0/335381950 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f010c0a4f30 0x7f010c0bf140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:09.960 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:09.954+0000 7f0111af4640 1 -- 172.21.15.78:0/335381950 >> v1:172.21.15.179:6789/0 conn(0x7f010c0bed60 legacy=0x7f010c154590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:00:09.960 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:09.954+0000 7f0111af4640 1 -- 172.21.15.78:0/335381950 --> v2:172.21.15.179:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f010c06d960 con 0x7f010c0c4b20 2023-11-28T20:00:09.962 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:09.958+0000 7f0111af4640 1 --2- 172.21.15.78:0/335381950 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f010c0c4b20 0x7f010c1585d0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f0104009e50 tx=0x7f010401c980 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a6923daa7bd6cad6 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:00:09.962 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:09.958+0000 7f0103fff640 1 -- 172.21.15.78:0/335381950 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01040a5730 con 0x7f010c0c4b20 2023-11-28T20:00:09.963 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:09.958+0000 7f0103fff640 1 -- 172.21.15.78:0/335381950 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f01040a5890 con 0x7f010c0c4b20 2023-11-28T20:00:09.963 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:09.958+0000 7f0103fff640 1 -- 172.21.15.78:0/335381950 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01040a5c20 con 0x7f010c0c4b20 2023-11-28T20:00:09.964 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:09.958+0000 7f0113557640 1 -- 172.21.15.78:0/335381950 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f010c0c4b20 msgr2=0x7f010c1585d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:00:09.964 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:09.958+0000 7f0113557640 1 --2- 172.21.15.78:0/335381950 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f010c0c4b20 0x7f010c1585d0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f0104009e50 tx=0x7f010401c980 comp rx=0 tx=0).stop 2023-11-28T20:00:09.964 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:09.958+0000 7f0113557640 1 -- 172.21.15.78:0/335381950 shutdown_connections 2023-11-28T20:00:09.964 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:09.958+0000 7f0113557640 1 --2- 172.21.15.78:0/335381950 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f010c0c4b20 0x7f010c1585d0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:09.964 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:09.958+0000 7f0113557640 1 --2- 172.21.15.78:0/335381950 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f010c0a4f30 0x7f010c0bf140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:09.964 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:09.958+0000 7f0113557640 1 -- 172.21.15.78:0/335381950 >> 172.21.15.78:0/335381950 conn(0x7f010c0c59f0 msgr2=0x7f010c0c5e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:00:09.964 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:09.958+0000 7f0113557640 1 -- 172.21.15.78:0/335381950 shutdown_connections 2023-11-28T20:00:09.964 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:09.962+0000 7f0113557640 1 -- 172.21.15.78:0/335381950 wait complete. 2023-11-28T20:00:09.965 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:09.962+0000 7f0113557640 1 Processor -- start 2023-11-28T20:00:09.965 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:09.962+0000 7f0113557640 1 -- start start 2023-11-28T20:00:09.966 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:09.962+0000 7f0113557640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f010c0a4f30 0x7f010c151180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:09.966 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:09.962+0000 7f0113557640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f010c0bed60 0x7f010c14f790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:09.966 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:09.962+0000 7f0113557640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f010c0c4b20 0x7f010c1f0370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:09.967 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:09.962+0000 7f0113557640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f010c072540 con 0x7f010c0bed60 2023-11-28T20:00:09.967 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:09.962+0000 7f0113557640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f010c1516c0 con 0x7f010c0a4f30 2023-11-28T20:00:09.967 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:09.962+0000 7f0113557640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f010c0721a0 con 0x7f010c0c4b20 2023-11-28T20:00:09.967 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:09.962+0000 7f0110af2640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f010c0bed60 0x7f010c14f790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:09.967 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:09.962+0000 7f0110af2640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f010c0bed60 0x7f010c14f790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:36256/0 (socket says 172.21.15.78:36256) 2023-11-28T20:00:09.967 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:09.962+0000 7f0110af2640 1 -- 172.21.15.78:0/1681056314 learned_addr learned my addr 172.21.15.78:0/1681056314 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T20:00:09.967 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:09.962+0000 7f0111af4640 1 --2- 172.21.15.78:0/1681056314 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f010c0c4b20 0x7f010c1f0370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:09.967 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:09.962+0000 7f01112f3640 1 --2- 172.21.15.78:0/1681056314 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f010c0a4f30 0x7f010c151180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:09.968 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:09.962+0000 7f0110af2640 1 -- 172.21.15.78:0/1681056314 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f010c0c4b20 msgr2=0x7f010c1f0370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:00:09.969 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:09.962+0000 7f0110af2640 1 --2- 172.21.15.78:0/1681056314 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f010c0c4b20 0x7f010c1f0370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:09.969 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:09.962+0000 7f0110af2640 1 -- 172.21.15.78:0/1681056314 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f010c0a4f30 msgr2=0x7f010c151180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:00:09.969 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:09.962+0000 7f0110af2640 1 --2- 172.21.15.78:0/1681056314 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f010c0a4f30 0x7f010c151180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:09.969 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:09.962+0000 7f0110af2640 1 -- 172.21.15.78:0/1681056314 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0104009b30 con 0x7f010c0bed60 2023-11-28T20:00:09.969 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:09.962+0000 7f0110af2640 1 --2- 172.21.15.78:0/1681056314 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f010c0bed60 0x7f010c14f790 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f00fc00e840 tx=0x7f00fc00ec40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:00:09.969 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:09.962+0000 7f0101ffb640 1 -- 172.21.15.78:0/1681056314 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00fc009510 con 0x7f010c0bed60 2023-11-28T20:00:09.969 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:09.962+0000 7f0101ffb640 1 -- 172.21.15.78:0/1681056314 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f00fc00ee90 con 0x7f010c0bed60 2023-11-28T20:00:09.969 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:09.962+0000 7f0113557640 1 -- 172.21.15.78:0/1681056314 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f010c152b60 con 0x7f010c0bed60 2023-11-28T20:00:09.969 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:09.962+0000 7f0101ffb640 1 -- 172.21.15.78:0/1681056314 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00fc00cb80 con 0x7f010c0bed60 2023-11-28T20:00:09.969 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:09.966+0000 7f0113557640 1 -- 172.21.15.78:0/1681056314 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f010c152880 con 0x7f010c0bed60 2023-11-28T20:00:09.970 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:09.966+0000 7f0113557640 1 -- 172.21.15.78:0/1681056314 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f010c072000 con 0x7f010c0bed60 2023-11-28T20:00:09.970 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:09.966+0000 7f0101ffb640 1 -- 172.21.15.78:0/1681056314 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f00fc00cce0 con 0x7f010c0bed60 2023-11-28T20:00:09.971 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:09.966+0000 7f0101ffb640 1 --2- 172.21.15.78:0/1681056314 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f00f0066470 0x7f00f0068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:09.971 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:09.966+0000 7f0101ffb640 1 -- 172.21.15.78:0/1681056314 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5177+0+0 (secure 0 0 0) 0x7f00fc083ff0 con 0x7f010c0bed60 2023-11-28T20:00:09.971 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:09.966+0000 7f01112f3640 1 --2- 172.21.15.78:0/1681056314 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f00f0066470 0x7f00f0068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:09.971 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:09.966+0000 7f01112f3640 1 --2- 172.21.15.78:0/1681056314 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f00f0066470 0x7f00f0068930 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f010c151110 tx=0x7f0108009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:00:09.974 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:09.970+0000 7f0101ffb640 1 -- 172.21.15.78:0/1681056314 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f00fc0b5280 con 0x7f010c0bed60 2023-11-28T20:00:10.128 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:10.126+0000 7f0113557640 1 -- 172.21.15.78:0/1681056314 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f010c067630 con 0x7f010c0bed60 2023-11-28T20:00:10.128 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:10.126+0000 7f0101ffb640 1 -- 172.21.15.78:0/1681056314 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v36) v1 ==== 93+0+10 (secure 0 0 0) 0x7f00fc0170a0 con 0x7f010c0bed60 2023-11-28T20:00:10.129 INFO:teuthology.orchestra.run.smithi078.stdout:pg_num: 1 2023-11-28T20:00:10.131 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:10.126+0000 7f0113557640 1 -- 172.21.15.78:0/1681056314 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f00f0066470 msgr2=0x7f00f0068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:00:10.131 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:10.126+0000 7f0113557640 1 --2- 172.21.15.78:0/1681056314 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f00f0066470 0x7f00f0068930 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f010c151110 tx=0x7f0108009040 comp rx=0 tx=0).stop 2023-11-28T20:00:10.131 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:10.126+0000 7f0113557640 1 -- 172.21.15.78:0/1681056314 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f010c0bed60 msgr2=0x7f010c14f790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:00:10.131 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:10.126+0000 7f0113557640 1 --2- 172.21.15.78:0/1681056314 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f010c0bed60 0x7f010c14f790 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f00fc00e840 tx=0x7f00fc00ec40 comp rx=0 tx=0).stop 2023-11-28T20:00:10.132 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:10.126+0000 7f0113557640 1 -- 172.21.15.78:0/1681056314 shutdown_connections 2023-11-28T20:00:10.132 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:10.126+0000 7f0113557640 1 --2- 172.21.15.78:0/1681056314 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f00f0066470 0x7f00f0068930 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:10.132 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:10.126+0000 7f0113557640 1 --2- 172.21.15.78:0/1681056314 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f010c0c4b20 0x7f010c1f0370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:10.132 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:10.126+0000 7f0113557640 1 --2- 172.21.15.78:0/1681056314 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f010c0bed60 0x7f010c14f790 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:10.132 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:10.126+0000 7f0113557640 1 --2- 172.21.15.78:0/1681056314 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f010c0a4f30 0x7f010c151180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:10.132 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:10.126+0000 7f0113557640 1 -- 172.21.15.78:0/1681056314 >> 172.21.15.78:0/1681056314 conn(0x7f010c0c59f0 msgr2=0x7f010c0c13f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:00:10.132 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:10.126+0000 7f0113557640 1 -- 172.21.15.78:0/1681056314 shutdown_connections 2023-11-28T20:00:10.132 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:10.126+0000 7f0113557640 1 -- 172.21.15.78:0/1681056314 wait complete. 2023-11-28T20:00:10.149 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-11-28T20:00:10.287 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:10.282+0000 7f8fc4fe6640 1 Processor -- start 2023-11-28T20:00:10.287 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:10.282+0000 7f8fc4fe6640 1 -- start start 2023-11-28T20:00:10.290 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:10.286+0000 7f8fc4fe6640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f8fc006d2b0 0x7f8fc006d690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:10.290 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:10.286+0000 7f8fc4fe6640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8fc00c5300 0x7f8fc006c730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:10.290 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:10.286+0000 7f8fc4fe6640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8fc006bb80 con 0x7f8fc00c3b80 2023-11-28T20:00:10.290 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:10.286+0000 7f8fc4fe6640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8fc006cc70 con 0x7f8fc006d2b0 2023-11-28T20:00:10.290 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:10.286+0000 7f8fc4fe6640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8fc00c5790 con 0x7f8fc00c5300 2023-11-28T20:00:10.291 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:10.286+0000 7f8fbe59c640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f8fc006d2b0 0x7f8fc006d690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:10.291 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:10.286+0000 7f8fbe59c640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f8fc006d2b0 0x7f8fc006d690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.78:46062/0 (socket says 172.21.15.78:46062) 2023-11-28T20:00:10.291 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:10.286+0000 7f8fb5d9b640 1 --1- >> v1:172.21.15.179:6789/0 conn(0x7f8fc00c3b80 0x7f8fc006c020 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.179:6789/0 says I am v1:172.21.15.78:55206/0 (socket says 172.21.15.78:55206) 2023-11-28T20:00:10.291 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:10.286+0000 7f8fbe59c640 1 -- 172.21.15.78:0/4294201243 learned_addr learned my addr 172.21.15.78:0/4294201243 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T20:00:10.291 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:10.286+0000 7f8fbed9d640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8fc00c5300 0x7f8fc006c730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:10.291 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:10.286+0000 7f8fbe59c640 1 -- 172.21.15.78:0/4294201243 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8fc00c5300 msgr2=0x7f8fc006c730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:00:10.291 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:10.286+0000 7f8fbe59c640 1 --2- 172.21.15.78:0/4294201243 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8fc00c5300 0x7f8fc006c730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:10.293 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:10.286+0000 7f8fbe59c640 1 -- 172.21.15.78:0/4294201243 >> v1:172.21.15.179:6789/0 conn(0x7f8fc00c3b80 legacy=0x7f8fc006c020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:00:10.293 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:10.286+0000 7f8fbe59c640 1 -- 172.21.15.78:0/4294201243 --> v2:172.21.15.179:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8fc01515c0 con 0x7f8fc006d2b0 2023-11-28T20:00:10.296 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:10.290+0000 7f8fbe59c640 1 --2- 172.21.15.78:0/4294201243 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8fc006d2b0 0x7f8fc006d690 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f8fb0009870 tx=0x7f8fb001c510 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f2ac310ac2e2993d server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:00:10.296 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:10.290+0000 7f8fbdd9b640 1 -- 172.21.15.78:0/4294201243 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fb00ab620 con 0x7f8fc006d2b0 2023-11-28T20:00:10.296 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:10.290+0000 7f8fbdd9b640 1 -- 172.21.15.78:0/4294201243 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8fb00ab780 con 0x7f8fc006d2b0 2023-11-28T20:00:10.296 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:10.290+0000 7f8fbdd9b640 1 -- 172.21.15.78:0/4294201243 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fb00abb10 con 0x7f8fc006d2b0 2023-11-28T20:00:10.296 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:10.290+0000 7f8fc4fe6640 1 -- 172.21.15.78:0/4294201243 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8fc006d2b0 msgr2=0x7f8fc006d690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:00:10.297 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:10.290+0000 7f8fc4fe6640 1 --2- 172.21.15.78:0/4294201243 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8fc006d2b0 0x7f8fc006d690 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f8fb0009870 tx=0x7f8fb001c510 comp rx=0 tx=0).stop 2023-11-28T20:00:10.297 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:10.290+0000 7f8fc4fe6640 1 -- 172.21.15.78:0/4294201243 shutdown_connections 2023-11-28T20:00:10.297 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:10.290+0000 7f8fc4fe6640 1 --2- 172.21.15.78:0/4294201243 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8fc00c5300 0x7f8fc006c730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:10.297 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:10.290+0000 7f8fc4fe6640 1 --2- 172.21.15.78:0/4294201243 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8fc006d2b0 0x7f8fc006d690 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:10.297 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:10.290+0000 7f8fc4fe6640 1 -- 172.21.15.78:0/4294201243 >> 172.21.15.78:0/4294201243 conn(0x7f8fc00a7810 msgr2=0x7f8fc00a7c20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:00:10.297 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:10.290+0000 7f8fc4fe6640 1 -- 172.21.15.78:0/4294201243 shutdown_connections 2023-11-28T20:00:10.298 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:10.290+0000 7f8fc4fe6640 1 -- 172.21.15.78:0/4294201243 wait complete. 2023-11-28T20:00:10.298 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:10.290+0000 7f8fc4fe6640 1 Processor -- start 2023-11-28T20:00:10.298 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:10.290+0000 7f8fc4fe6640 1 -- start start 2023-11-28T20:00:10.301 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:10.294+0000 7f8fc4fe6640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8fc006d2b0 0x7f8fc014c720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:10.302 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:10.294+0000 7f8fc4fe6640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8fc00c3b80 0x7f8fc014ffd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:10.302 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:10.294+0000 7f8fc4fe6640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8fc00c5300 0x7f8fc01f01c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:10.302 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:10.294+0000 7f8fc4fe6640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8fc014f420 con 0x7f8fc00c5300 2023-11-28T20:00:10.302 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:10.294+0000 7f8fc4fe6640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8fc014f670 con 0x7f8fc006d2b0 2023-11-28T20:00:10.302 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:10.294+0000 7f8fc4fe6640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8fc01ecfa0 con 0x7f8fc00c3b80 2023-11-28T20:00:10.302 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:10.294+0000 7f8fbed9d640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8fc00c5300 0x7f8fc01f01c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:10.303 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:10.294+0000 7f8fbed9d640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8fc00c5300 0x7f8fc01f01c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:36272/0 (socket says 172.21.15.78:36272) 2023-11-28T20:00:10.303 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:10.294+0000 7f8fbed9d640 1 -- 172.21.15.78:0/1117789304 learned_addr learned my addr 172.21.15.78:0/1117789304 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T20:00:10.303 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:10.294+0000 7f8fbe59c640 1 --2- 172.21.15.78:0/1117789304 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8fc006d2b0 0x7f8fc014c720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:10.303 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:10.294+0000 7f8fb5d9b640 1 --2- 172.21.15.78:0/1117789304 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8fc00c3b80 0x7f8fc014ffd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:10.303 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:10.294+0000 7f8fbed9d640 1 -- 172.21.15.78:0/1117789304 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8fc00c3b80 msgr2=0x7f8fc014ffd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:00:10.303 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:10.294+0000 7f8fbed9d640 1 --2- 172.21.15.78:0/1117789304 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8fc00c3b80 0x7f8fc014ffd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:10.304 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:10.294+0000 7f8fbed9d640 1 -- 172.21.15.78:0/1117789304 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8fc006d2b0 msgr2=0x7f8fc014c720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:00:10.304 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:10.294+0000 7f8fbed9d640 1 --2- 172.21.15.78:0/1117789304 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8fc006d2b0 0x7f8fc014c720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:10.304 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:10.294+0000 7f8fbed9d640 1 -- 172.21.15.78:0/1117789304 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8fb00094d0 con 0x7f8fc00c5300 2023-11-28T20:00:10.304 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:10.294+0000 7f8fb5d9b640 1 --2- 172.21.15.78:0/1117789304 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8fc00c3b80 0x7f8fc014ffd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T20:00:10.304 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:10.294+0000 7f8fbed9d640 1 --2- 172.21.15.78:0/1117789304 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8fc00c5300 0x7f8fc01f01c0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f8fb800ec10 tx=0x7f8fb800c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:00:10.304 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:10.294+0000 7f8fb77fe640 1 -- 172.21.15.78:0/1117789304 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fb800cd20 con 0x7f8fc00c5300 2023-11-28T20:00:10.304 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:10.294+0000 7f8fb77fe640 1 -- 172.21.15.78:0/1117789304 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8fb800f040 con 0x7f8fc00c5300 2023-11-28T20:00:10.305 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:10.294+0000 7f8fc4fe6640 1 -- 172.21.15.78:0/1117789304 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8fc014ef80 con 0x7f8fc00c5300 2023-11-28T20:00:10.305 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:10.294+0000 7f8fb77fe640 1 -- 172.21.15.78:0/1117789304 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fb80146c0 con 0x7f8fc00c5300 2023-11-28T20:00:10.305 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:10.294+0000 7f8fc4fe6640 1 -- 172.21.15.78:0/1117789304 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8fc01ed560 con 0x7f8fc00c5300 2023-11-28T20:00:10.305 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:10.294+0000 7f8fc4fe6640 1 -- 172.21.15.78:0/1117789304 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8fc01ed750 con 0x7f8fc00c5300 2023-11-28T20:00:10.305 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:10.298+0000 7f8fb77fe640 1 -- 172.21.15.78:0/1117789304 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f8fb8014820 con 0x7f8fc00c5300 2023-11-28T20:00:10.305 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:10.298+0000 7f8fb77fe640 1 --2- 172.21.15.78:0/1117789304 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f8fa0066470 0x7f8fa0068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:10.305 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:10.298+0000 7f8fb77fe640 1 -- 172.21.15.78:0/1117789304 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5177+0+0 (secure 0 0 0) 0x7f8fb80846e0 con 0x7f8fc00c5300 2023-11-28T20:00:10.306 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:10.298+0000 7f8fbe59c640 1 --2- 172.21.15.78:0/1117789304 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f8fa0066470 0x7f8fa0068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:10.306 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:10.298+0000 7f8fbe59c640 1 --2- 172.21.15.78:0/1117789304 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f8fa0066470 0x7f8fa0068930 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f8fb00af000 tx=0x7f8fb00a7000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:00:10.306 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:10.302+0000 7f8fb77fe640 1 -- 172.21.15.78:0/1117789304 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f8fb8051d60 con 0x7f8fc00c5300 2023-11-28T20:00:10.457 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:10.454+0000 7f8fc4fe6640 1 -- 172.21.15.78:0/1117789304 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f8fc0067630 con 0x7f8fc00c5300 2023-11-28T20:00:10.457 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:10.454+0000 7f8fb77fe640 1 -- 172.21.15.78:0/1117789304 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v36) v1 ==== 84+0+65 (secure 0 0 0) 0x7f8fb8018020 con 0x7f8fc00c5300 2023-11-28T20:00:10.457 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-11-28T20:00:10.458 INFO:teuthology.orchestra.run.smithi078.stdout:[ 2023-11-28T20:00:10.458 INFO:teuthology.orchestra.run.smithi078.stdout: { 2023-11-28T20:00:10.458 INFO:teuthology.orchestra.run.smithi078.stdout: "poolnum": 1, 2023-11-28T20:00:10.458 INFO:teuthology.orchestra.run.smithi078.stdout: "poolname": ".mgr" 2023-11-28T20:00:10.458 INFO:teuthology.orchestra.run.smithi078.stdout: } 2023-11-28T20:00:10.458 INFO:teuthology.orchestra.run.smithi078.stdout:] 2023-11-28T20:00:10.459 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:10.454+0000 7f8fc4fe6640 1 -- 172.21.15.78:0/1117789304 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f8fa0066470 msgr2=0x7f8fa0068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:00:10.460 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:10.454+0000 7f8fc4fe6640 1 --2- 172.21.15.78:0/1117789304 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f8fa0066470 0x7f8fa0068930 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f8fb00af000 tx=0x7f8fb00a7000 comp rx=0 tx=0).stop 2023-11-28T20:00:10.460 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:10.454+0000 7f8fc4fe6640 1 -- 172.21.15.78:0/1117789304 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8fc00c5300 msgr2=0x7f8fc01f01c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:00:10.460 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:10.454+0000 7f8fc4fe6640 1 --2- 172.21.15.78:0/1117789304 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8fc00c5300 0x7f8fc01f01c0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f8fb800ec10 tx=0x7f8fb800c490 comp rx=0 tx=0).stop 2023-11-28T20:00:10.460 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:10.454+0000 7f8fc4fe6640 1 -- 172.21.15.78:0/1117789304 shutdown_connections 2023-11-28T20:00:10.460 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:10.454+0000 7f8fc4fe6640 1 --2- 172.21.15.78:0/1117789304 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f8fa0066470 0x7f8fa0068930 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:10.460 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:10.454+0000 7f8fc4fe6640 1 --2- 172.21.15.78:0/1117789304 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8fc00c3b80 0x7f8fc014ffd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:10.460 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:10.454+0000 7f8fc4fe6640 1 --2- 172.21.15.78:0/1117789304 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8fc00c5300 0x7f8fc01f01c0 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:10.460 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:10.454+0000 7f8fc4fe6640 1 --2- 172.21.15.78:0/1117789304 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8fc006d2b0 0x7f8fc014c720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:10.460 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:10.454+0000 7f8fc4fe6640 1 -- 172.21.15.78:0/1117789304 >> 172.21.15.78:0/1117789304 conn(0x7f8fc00a7810 msgr2=0x7f8fc00a7bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:00:10.460 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:10.454+0000 7f8fc4fe6640 1 -- 172.21.15.78:0/1117789304 shutdown_connections 2023-11-28T20:00:10.460 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:10.454+0000 7f8fc4fe6640 1 -- 172.21.15.78:0/1117789304 wait complete. 2023-11-28T20:00:10.478 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-11-28T20:00:10.479 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-11-28T20:00:10.620 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:10.614+0000 7f50f319d640 1 Processor -- start 2023-11-28T20:00:10.620 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:10.618+0000 7f50f319d640 1 -- start start 2023-11-28T20:00:10.622 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:10.618+0000 7f50f319d640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f50ec14b1e0 0x7f50ec0c1700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:10.622 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:10.618+0000 7f50f319d640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f50ec1548c0 0x7f50ec154d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:10.622 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:10.618+0000 7f50f319d640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f50ec0a4e20 con 0x7f50ec0c5300 2023-11-28T20:00:10.622 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:10.618+0000 7f50f319d640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f50ec0a50e0 con 0x7f50ec1548c0 2023-11-28T20:00:10.622 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:10.618+0000 7f50f319d640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f50ec0c0f00 con 0x7f50ec14b1e0 2023-11-28T20:00:10.622 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:10.618+0000 7f50f173a640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f50ec1548c0 0x7f50ec154d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:10.623 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:10.618+0000 7f50f173a640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f50ec1548c0 0x7f50ec154d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:36278/0 (socket says 172.21.15.78:36278) 2023-11-28T20:00:10.623 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:10.618+0000 7f50f173a640 1 -- 172.21.15.78:0/2920240484 learned_addr learned my addr 172.21.15.78:0/2920240484 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T20:00:10.623 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:10.618+0000 7f50f0f39640 1 --2- 172.21.15.78:0/2920240484 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f50ec14b1e0 0x7f50ec0c1700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:10.623 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:10.618+0000 7f50f173a640 1 -- 172.21.15.78:0/2920240484 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f50ec14b1e0 msgr2=0x7f50ec0c1700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:00:10.623 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:10.618+0000 7f50f173a640 1 --2- 172.21.15.78:0/2920240484 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f50ec14b1e0 0x7f50ec0c1700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:10.623 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:10.618+0000 7f50f173a640 1 -- 172.21.15.78:0/2920240484 >> v1:172.21.15.179:6789/0 conn(0x7f50ec0c5300 legacy=0x7f50ec0a9c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:00:10.624 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:10.618+0000 7f50f173a640 1 -- 172.21.15.78:0/2920240484 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50ec0c11e0 con 0x7f50ec1548c0 2023-11-28T20:00:10.624 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:10.618+0000 7f50f0f39640 1 --2- 172.21.15.78:0/2920240484 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f50ec14b1e0 0x7f50ec0c1700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T20:00:10.626 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:10.622+0000 7f50f173a640 1 --2- 172.21.15.78:0/2920240484 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f50ec1548c0 0x7f50ec154d50 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f50ec0c3b30 tx=0x7f50e401c9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1baa5b382beca5dd server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:00:10.626 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:10.622+0000 7f50e37fe640 1 -- 172.21.15.78:0/2920240484 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50ec1558b0 con 0x7f50ec1548c0 2023-11-28T20:00:10.626 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:10.622+0000 7f50e37fe640 1 -- 172.21.15.78:0/2920240484 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f50e40a5740 con 0x7f50ec1548c0 2023-11-28T20:00:10.626 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:10.622+0000 7f50e37fe640 1 -- 172.21.15.78:0/2920240484 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50e40a5ad0 con 0x7f50ec1548c0 2023-11-28T20:00:10.626 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:10.622+0000 7f50f319d640 1 -- 172.21.15.78:0/2920240484 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f50ec1548c0 msgr2=0x7f50ec154d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:00:10.627 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:10.622+0000 7f50f319d640 1 --2- 172.21.15.78:0/2920240484 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f50ec1548c0 0x7f50ec154d50 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f50ec0c3b30 tx=0x7f50e401c9b0 comp rx=0 tx=0).stop 2023-11-28T20:00:10.627 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:10.622+0000 7f50f319d640 1 -- 172.21.15.78:0/2920240484 shutdown_connections 2023-11-28T20:00:10.627 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:10.622+0000 7f50f319d640 1 --2- 172.21.15.78:0/2920240484 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f50ec1548c0 0x7f50ec154d50 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:10.627 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:10.622+0000 7f50f319d640 1 --2- 172.21.15.78:0/2920240484 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f50ec14b1e0 0x7f50ec0c1700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:10.627 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:10.622+0000 7f50f319d640 1 -- 172.21.15.78:0/2920240484 >> 172.21.15.78:0/2920240484 conn(0x7f50ec0c59f0 msgr2=0x7f50ec0c5e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:00:10.627 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:10.622+0000 7f50f319d640 1 -- 172.21.15.78:0/2920240484 shutdown_connections 2023-11-28T20:00:10.627 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:10.622+0000 7f50f319d640 1 -- 172.21.15.78:0/2920240484 wait complete. 2023-11-28T20:00:10.629 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:10.622+0000 7f50f319d640 1 Processor -- start 2023-11-28T20:00:10.629 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:10.622+0000 7f50f319d640 1 -- start start 2023-11-28T20:00:10.630 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:10.626+0000 7f50f319d640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f50ec0c5300 0x7f50ec1508c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:10.630 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:10.626+0000 7f50f319d640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f50ec14b1e0 0x7f50ec145e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:10.630 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:10.626+0000 7f50f319d640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f50ec1548c0 0x7f50ec146350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:10.630 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:10.626+0000 7f50f319d640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50ec1416e0 con 0x7f50ec1548c0 2023-11-28T20:00:10.630 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:10.626+0000 7f50f319d640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50ec141e30 con 0x7f50ec14b1e0 2023-11-28T20:00:10.630 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:10.626+0000 7f50f319d640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f50ec06d170 con 0x7f50ec0c5300 2023-11-28T20:00:10.630 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:10.626+0000 7f50f173a640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f50ec1548c0 0x7f50ec146350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:10.630 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:10.626+0000 7f50f173a640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f50ec1548c0 0x7f50ec146350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:36286/0 (socket says 172.21.15.78:36286) 2023-11-28T20:00:10.630 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:10.626+0000 7f50f173a640 1 -- 172.21.15.78:0/3292057668 learned_addr learned my addr 172.21.15.78:0/3292057668 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T20:00:10.630 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:10.626+0000 7f50f0f39640 1 --2- 172.21.15.78:0/3292057668 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f50ec0c5300 0x7f50ec1508c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:10.631 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:10.626+0000 7f50e3fff640 1 --2- 172.21.15.78:0/3292057668 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f50ec14b1e0 0x7f50ec145e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:10.631 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:10.626+0000 7f50f173a640 1 -- 172.21.15.78:0/3292057668 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f50ec0c5300 msgr2=0x7f50ec1508c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:00:10.631 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:10.626+0000 7f50f173a640 1 --2- 172.21.15.78:0/3292057668 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f50ec0c5300 0x7f50ec1508c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:10.631 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:10.626+0000 7f50f173a640 1 -- 172.21.15.78:0/3292057668 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f50ec14b1e0 msgr2=0x7f50ec145e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:00:10.631 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:10.626+0000 7f50f173a640 1 --2- 172.21.15.78:0/3292057668 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f50ec14b1e0 0x7f50ec145e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:10.631 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:10.626+0000 7f50f173a640 1 -- 172.21.15.78:0/3292057668 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50e4009b30 con 0x7f50ec1548c0 2023-11-28T20:00:10.631 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:10.626+0000 7f50f173a640 1 --2- 172.21.15.78:0/3292057668 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f50ec1548c0 0x7f50ec146350 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f50e40af040 tx=0x7f50e4019750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:00:10.631 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:10.626+0000 7f50e17fa640 1 -- 172.21.15.78:0/3292057668 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50e40b8670 con 0x7f50ec1548c0 2023-11-28T20:00:10.631 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:10.626+0000 7f50e17fa640 1 -- 172.21.15.78:0/3292057668 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f50e40b87d0 con 0x7f50ec1548c0 2023-11-28T20:00:10.631 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:10.626+0000 7f50e17fa640 1 -- 172.21.15.78:0/3292057668 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50e40b8b60 con 0x7f50ec1548c0 2023-11-28T20:00:10.631 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:10.626+0000 7f50f319d640 1 -- 172.21.15.78:0/3292057668 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f50ec1511a0 con 0x7f50ec1548c0 2023-11-28T20:00:10.632 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:10.626+0000 7f50f319d640 1 -- 172.21.15.78:0/3292057668 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f50ec151760 con 0x7f50ec1548c0 2023-11-28T20:00:10.633 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:10.626+0000 7f50f319d640 1 -- 172.21.15.78:0/3292057668 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f50ec067630 con 0x7f50ec1548c0 2023-11-28T20:00:10.633 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:10.626+0000 7f50e17fa640 1 -- 172.21.15.78:0/3292057668 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f50e40b8cc0 con 0x7f50ec1548c0 2023-11-28T20:00:10.633 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:10.630+0000 7f50e17fa640 1 --2- 172.21.15.78:0/3292057668 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f50d8066470 0x7f50d8068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:10.633 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:10.630+0000 7f50e17fa640 1 -- 172.21.15.78:0/3292057668 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5177+0+0 (secure 0 0 0) 0x7f50e411f140 con 0x7f50ec1548c0 2023-11-28T20:00:10.633 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:10.630+0000 7f50f0f39640 1 --2- 172.21.15.78:0/3292057668 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f50d8066470 0x7f50d8068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:10.633 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:10.630+0000 7f50f0f39640 1 --2- 172.21.15.78:0/3292057668 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f50d8066470 0x7f50d8068930 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f50e800ab60 tx=0x7f50e8008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:00:10.636 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:10.634+0000 7f50e17fa640 1 -- 172.21.15.78:0/3292057668 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f50e40ec990 con 0x7f50ec1548c0 2023-11-28T20:00:10.789 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:10.786+0000 7f50f319d640 1 -- 172.21.15.78:0/3292057668 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f50ec067ea0 con 0x7f50ec1548c0 2023-11-28T20:00:11.764 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:11.762+0000 7f50e17fa640 1 -- 172.21.15.78:0/3292057668 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v37) v1 ==== 138+0+0 (secure 0 0 0) 0x7f50e40effb0 con 0x7f50ec1548c0 2023-11-28T20:00:11.764 INFO:teuthology.orchestra.run.smithi078.stderr:pool 'cephfs_metadata' created 2023-11-28T20:00:11.767 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:11.762+0000 7f50f319d640 1 -- 172.21.15.78:0/3292057668 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f50d8066470 msgr2=0x7f50d8068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:00:11.767 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:11.762+0000 7f50f319d640 1 --2- 172.21.15.78:0/3292057668 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f50d8066470 0x7f50d8068930 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f50e800ab60 tx=0x7f50e8008040 comp rx=0 tx=0).stop 2023-11-28T20:00:11.767 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:11.762+0000 7f50f319d640 1 -- 172.21.15.78:0/3292057668 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f50ec1548c0 msgr2=0x7f50ec146350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:00:11.767 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:11.762+0000 7f50f319d640 1 --2- 172.21.15.78:0/3292057668 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f50ec1548c0 0x7f50ec146350 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f50e40af040 tx=0x7f50e4019750 comp rx=0 tx=0).stop 2023-11-28T20:00:11.767 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:11.762+0000 7f50f319d640 1 -- 172.21.15.78:0/3292057668 shutdown_connections 2023-11-28T20:00:11.767 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:11.762+0000 7f50f319d640 1 --2- 172.21.15.78:0/3292057668 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f50d8066470 0x7f50d8068930 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:11.767 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:11.762+0000 7f50f319d640 1 --2- 172.21.15.78:0/3292057668 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f50ec1548c0 0x7f50ec146350 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:11.767 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:11.762+0000 7f50f319d640 1 --2- 172.21.15.78:0/3292057668 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f50ec14b1e0 0x7f50ec145e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:11.767 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:11.762+0000 7f50f319d640 1 --2- 172.21.15.78:0/3292057668 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f50ec0c5300 0x7f50ec1508c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:11.767 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:11.762+0000 7f50f319d640 1 -- 172.21.15.78:0/3292057668 >> 172.21.15.78:0/3292057668 conn(0x7f50ec0c59f0 msgr2=0x7f50ec14a0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:00:11.768 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:11.762+0000 7f50f319d640 1 -- 172.21.15.78:0/3292057668 shutdown_connections 2023-11-28T20:00:11.768 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:11.762+0000 7f50f319d640 1 -- 172.21.15.78:0/3292057668 wait complete. 2023-11-28T20:00:11.793 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-11-28T20:00:11.938 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:11.934+0000 7fcaaf4fd640 1 Processor -- start 2023-11-28T20:00:11.939 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:11.934+0000 7fcaaf4fd640 1 -- start start 2023-11-28T20:00:11.941 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:11.934+0000 7fcaaf4fd640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcaa8156200 0x7fcaa80c0370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:11.941 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:11.934+0000 7fcaaf4fd640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fcaa80c0e10 0x7fcaa80c1b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:11.941 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:11.934+0000 7fcaaf4fd640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcaa806bce0 con 0x7fcaa815bf70 2023-11-28T20:00:11.942 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:11.934+0000 7fcaaf4fd640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcaa806d8d0 con 0x7fcaa80c0e10 2023-11-28T20:00:11.942 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:11.934+0000 7fcaaf4fd640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcaa815cc60 con 0x7fcaa8156200 2023-11-28T20:00:11.942 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:11.938+0000 7fcaad299640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcaa8156200 0x7fcaa80c0370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:11.943 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:11.938+0000 7fcaaca98640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fcaa80c0e10 0x7fcaa80c1b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:11.943 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:11.938+0000 7fcaad299640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcaa8156200 0x7fcaa80c0370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3301/0 says I am v2:172.21.15.78:52460/0 (socket says 172.21.15.78:52460) 2023-11-28T20:00:11.943 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:11.938+0000 7fcaad299640 1 -- 172.21.15.78:0/709073747 learned_addr learned my addr 172.21.15.78:0/709073747 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T20:00:11.943 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:11.938+0000 7fcaada9a640 1 --1- 172.21.15.78:0/709073747 >> v1:172.21.15.179:6789/0 conn(0x7fcaa815bf70 0x7fcaa815c400 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.179:6789/0 says I am v1:172.21.15.78:55218/0 (socket says 172.21.15.78:55218) 2023-11-28T20:00:11.943 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:11.938+0000 7fca9ffff640 1 -- 172.21.15.78:0/709073747 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 617185006 0 0) 0x7fcaa806bce0 con 0x7fcaa815bf70 2023-11-28T20:00:11.944 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:11.938+0000 7fca9ffff640 1 -- 172.21.15.78:0/709073747 --> v1:172.21.15.179:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fca94003530 con 0x7fcaa815bf70 2023-11-28T20:00:11.944 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:11.938+0000 7fcaad299640 1 -- 172.21.15.78:0/709073747 >> v2:172.21.15.179:3300/0 conn(0x7fcaa80c0e10 msgr2=0x7fcaa80c1b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:00:11.944 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:11.938+0000 7fcaad299640 1 --2- 172.21.15.78:0/709073747 >> v2:172.21.15.179:3300/0 conn(0x7fcaa80c0e10 0x7fcaa80c1b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:11.944 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:11.938+0000 7fcaad299640 1 -- 172.21.15.78:0/709073747 >> v1:172.21.15.179:6789/0 conn(0x7fcaa815bf70 legacy=0x7fcaa815c400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:00:11.950 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:11.938+0000 7fcaad299640 1 -- 172.21.15.78:0/709073747 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcaa806bf30 con 0x7fcaa8156200 2023-11-28T20:00:11.950 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:11.938+0000 7fcaaca98640 1 --2- 172.21.15.78:0/709073747 >> v2:172.21.15.179:3300/0 conn(0x7fcaa80c0e10 0x7fcaa80c1b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T20:00:11.954 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:11.938+0000 7fcaad299640 1 --2- 172.21.15.78:0/709073747 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcaa8156200 0x7fcaa80c0370 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fcaa4009870 tx=0x7fcaa401c3e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6331926f0a48249 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:00:11.954 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:11.938+0000 7fca9ffff640 1 -- 172.21.15.78:0/709073747 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcaa40ab600 con 0x7fcaa8156200 2023-11-28T20:00:11.954 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:11.942+0000 7fca9ffff640 1 -- 172.21.15.78:0/709073747 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcaa40a7050 con 0x7fcaa8156200 2023-11-28T20:00:11.954 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:11.942+0000 7fca9ffff640 1 -- 172.21.15.78:0/709073747 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcaa40ab960 con 0x7fcaa8156200 2023-11-28T20:00:11.954 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:11.942+0000 7fcaaf4fd640 1 -- 172.21.15.78:0/709073747 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcaa8156200 msgr2=0x7fcaa80c0370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:00:11.954 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:11.942+0000 7fcaaf4fd640 1 --2- 172.21.15.78:0/709073747 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcaa8156200 0x7fcaa80c0370 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fcaa4009870 tx=0x7fcaa401c3e0 comp rx=0 tx=0).stop 2023-11-28T20:00:11.954 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:11.942+0000 7fcaaf4fd640 1 -- 172.21.15.78:0/709073747 shutdown_connections 2023-11-28T20:00:11.955 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:11.942+0000 7fcaaf4fd640 1 --2- 172.21.15.78:0/709073747 >> v2:172.21.15.179:3300/0 conn(0x7fcaa80c0e10 0x7fcaa80c1b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:11.955 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:11.942+0000 7fcaaf4fd640 1 --2- 172.21.15.78:0/709073747 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcaa8156200 0x7fcaa80c0370 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:11.955 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:11.942+0000 7fcaaf4fd640 1 -- 172.21.15.78:0/709073747 >> 172.21.15.78:0/709073747 conn(0x7fcaa80c59f0 msgr2=0x7fcaa80c5e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:00:11.955 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:11.942+0000 7fcaaf4fd640 1 -- 172.21.15.78:0/709073747 shutdown_connections 2023-11-28T20:00:11.955 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:11.942+0000 7fcaaf4fd640 1 -- 172.21.15.78:0/709073747 wait complete. 2023-11-28T20:00:11.955 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:11.942+0000 7fcaaf4fd640 1 Processor -- start 2023-11-28T20:00:11.955 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:11.942+0000 7fcaaf4fd640 1 -- start start 2023-11-28T20:00:11.955 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:11.942+0000 7fcaaf4fd640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcaa80c0e10 0x7fcaa8153e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:11.955 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:11.942+0000 7fcaaf4fd640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcaa8156200 0x7fcaa81471d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:11.955 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:11.942+0000 7fcaaf4fd640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcaa815bf70 0x7fcaa8147710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:11.956 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:11.942+0000 7fcaaf4fd640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcaa8154ae0 con 0x7fcaa8156200 2023-11-28T20:00:11.956 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:11.942+0000 7fcaaf4fd640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcaa81f4ca0 con 0x7fcaa815bf70 2023-11-28T20:00:11.956 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:11.942+0000 7fcaaf4fd640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcaa80ab2b0 con 0x7fcaa80c0e10 2023-11-28T20:00:11.956 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:11.942+0000 7fcaaca98640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcaa8156200 0x7fcaa81471d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:11.956 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:11.942+0000 7fcaad299640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcaa80c0e10 0x7fcaa8153e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:11.956 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:11.942+0000 7fcaaca98640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcaa8156200 0x7fcaa81471d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:36298/0 (socket says 172.21.15.78:36298) 2023-11-28T20:00:11.956 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:11.942+0000 7fcaaca98640 1 -- 172.21.15.78:0/513474698 learned_addr learned my addr 172.21.15.78:0/513474698 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T20:00:11.956 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:11.942+0000 7fcaada9a640 1 --2- 172.21.15.78:0/513474698 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcaa815bf70 0x7fcaa8147710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:11.956 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:11.946+0000 7fcaaca98640 1 -- 172.21.15.78:0/513474698 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcaa80c0e10 msgr2=0x7fcaa8153e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:00:11.956 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:11.946+0000 7fcaaca98640 1 --2- 172.21.15.78:0/513474698 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcaa80c0e10 0x7fcaa8153e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:11.956 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:11.946+0000 7fcaaca98640 1 -- 172.21.15.78:0/513474698 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcaa815bf70 msgr2=0x7fcaa8147710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:00:11.956 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:11.946+0000 7fcaaca98640 1 --2- 172.21.15.78:0/513474698 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcaa815bf70 0x7fcaa8147710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:11.956 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:11.946+0000 7fcaaca98640 1 -- 172.21.15.78:0/513474698 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca98009420 con 0x7fcaa8156200 2023-11-28T20:00:11.957 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:11.946+0000 7fcaaca98640 1 --2- 172.21.15.78:0/513474698 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcaa8156200 0x7fcaa81471d0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7fca9800e980 tx=0x7fca9800ee40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:00:11.957 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:11.946+0000 7fca9dffb640 1 -- 172.21.15.78:0/513474698 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca9800ca00 con 0x7fcaa8156200 2023-11-28T20:00:11.957 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:11.946+0000 7fca9dffb640 1 -- 172.21.15.78:0/513474698 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca9800cb60 con 0x7fcaa8156200 2023-11-28T20:00:11.957 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:11.946+0000 7fcaaf4fd640 1 -- 172.21.15.78:0/513474698 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcaa40094d0 con 0x7fcaa8156200 2023-11-28T20:00:11.957 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:11.946+0000 7fca9dffb640 1 -- 172.21.15.78:0/513474698 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca98013470 con 0x7fcaa8156200 2023-11-28T20:00:11.957 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:11.946+0000 7fcaaf4fd640 1 -- 172.21.15.78:0/513474698 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcaa81f3ee0 con 0x7fcaa8156200 2023-11-28T20:00:11.957 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:11.946+0000 7fcaaf4fd640 1 -- 172.21.15.78:0/513474698 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcaa8067630 con 0x7fcaa8156200 2023-11-28T20:00:11.957 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:11.946+0000 7fca9dffb640 1 -- 172.21.15.78:0/513474698 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fca980135d0 con 0x7fcaa8156200 2023-11-28T20:00:11.957 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:11.946+0000 7fca9dffb640 1 --2- 172.21.15.78:0/513474698 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fca8c066470 0x7fca8c068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:11.957 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:11.950+0000 7fca9dffb640 1 -- 172.21.15.78:0/513474698 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 5547+0+0 (secure 0 0 0) 0x7fca980847f0 con 0x7fcaa8156200 2023-11-28T20:00:11.957 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:11.950+0000 7fcaad299640 1 --2- 172.21.15.78:0/513474698 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fca8c066470 0x7fca8c068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:11.957 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:11.950+0000 7fcaad299640 1 --2- 172.21.15.78:0/513474698 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fca8c066470 0x7fca8c068930 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fcaa40ad000 tx=0x7fcaa40a6000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:00:11.958 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:11.950+0000 7fca9dffb640 1 -- 172.21.15.78:0/513474698 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fca98051da0 con 0x7fcaa8156200 2023-11-28T20:00:12.108 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:12.106+0000 7fcaaf4fd640 1 -- 172.21.15.78:0/513474698 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7fcaa8159c20 con 0x7fcaa8156200 2023-11-28T20:00:12.772 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:12.770+0000 7fca9dffb640 1 -- 172.21.15.78:0/513474698 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v38) v1 ==== 170+0+0 (secure 0 0 0) 0x7fca980553c0 con 0x7fcaa8156200 2023-11-28T20:00:12.773 INFO:teuthology.orchestra.run.smithi078.stderr:pool 'cephfs_data' created 2023-11-28T20:00:12.775 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:12.770+0000 7fcaaf4fd640 1 -- 172.21.15.78:0/513474698 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fca8c066470 msgr2=0x7fca8c068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:00:12.775 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:12.770+0000 7fcaaf4fd640 1 --2- 172.21.15.78:0/513474698 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fca8c066470 0x7fca8c068930 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fcaa40ad000 tx=0x7fcaa40a6000 comp rx=0 tx=0).stop 2023-11-28T20:00:12.775 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:12.770+0000 7fcaaf4fd640 1 -- 172.21.15.78:0/513474698 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcaa8156200 msgr2=0x7fcaa81471d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:00:12.775 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:12.770+0000 7fcaaf4fd640 1 --2- 172.21.15.78:0/513474698 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcaa8156200 0x7fcaa81471d0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7fca9800e980 tx=0x7fca9800ee40 comp rx=0 tx=0).stop 2023-11-28T20:00:12.775 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:12.770+0000 7fcaaf4fd640 1 -- 172.21.15.78:0/513474698 shutdown_connections 2023-11-28T20:00:12.775 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:12.770+0000 7fcaaf4fd640 1 --2- 172.21.15.78:0/513474698 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fca8c066470 0x7fca8c068930 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:12.775 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:12.770+0000 7fcaaf4fd640 1 --2- 172.21.15.78:0/513474698 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcaa815bf70 0x7fcaa8147710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:12.775 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:12.770+0000 7fcaaf4fd640 1 --2- 172.21.15.78:0/513474698 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcaa8156200 0x7fcaa81471d0 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:12.775 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:12.770+0000 7fcaaf4fd640 1 --2- 172.21.15.78:0/513474698 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcaa80c0e10 0x7fcaa8153e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:12.776 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:12.770+0000 7fcaaf4fd640 1 -- 172.21.15.78:0/513474698 >> 172.21.15.78:0/513474698 conn(0x7fcaa80c59f0 msgr2=0x7fcaa80c1680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:00:12.776 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:12.770+0000 7fcaaf4fd640 1 -- 172.21.15.78:0/513474698 shutdown_connections 2023-11-28T20:00:12.776 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:12.770+0000 7fcaaf4fd640 1 -- 172.21.15.78:0/513474698 wait complete. 2023-11-28T20:00:12.820 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-11-28T20:00:12.959 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:12.954+0000 7f61e64c9640 1 Processor -- start 2023-11-28T20:00:12.959 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:12.954+0000 7f61e64c9640 1 -- start start 2023-11-28T20:00:12.960 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:12.958+0000 7f61e64c9640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f61e014f850 0x7f61e00aacf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:12.961 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:12.958+0000 7f61e64c9640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f61e0152910 con 0x7f61e014fc30 2023-11-28T20:00:12.961 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:12.958+0000 7f61e64c9640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f61e0152bf0 con 0x7f61e006d840 2023-11-28T20:00:12.961 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:12.958+0000 7f61e64c9640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f61e00c2240 con 0x7f61e014f850 2023-11-28T20:00:12.961 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:12.958+0000 7f61df7fe640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f61e014fc30 0x7f61e00c3cd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:33292/0 (socket says 172.21.15.78:33292) 2023-11-28T20:00:12.961 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:12.958+0000 7f61df7fe640 1 -- 172.21.15.78:0/3321562384 learned_addr learned my addr 172.21.15.78:0/3321562384 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-11-28T20:00:12.961 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:12.958+0000 7f61dffff640 1 --2- 172.21.15.78:0/3321562384 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f61e014f850 0x7f61e00aacf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:12.962 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:12.958+0000 7f61deffd640 1 -- 172.21.15.78:0/3321562384 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 768220574 0 0) 0x7f61e0152910 con 0x7f61e014fc30 2023-11-28T20:00:12.962 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:12.958+0000 7f61deffd640 1 -- 172.21.15.78:0/3321562384 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f61c8003530 con 0x7f61e014fc30 2023-11-28T20:00:12.962 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:12.958+0000 7f61deffd640 1 -- 172.21.15.78:0/3321562384 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2751225733 0 0) 0x7f61e0152bf0 con 0x7f61e006d840 2023-11-28T20:00:12.962 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:12.958+0000 7f61deffd640 1 -- 172.21.15.78:0/3321562384 --> v1:172.21.15.179:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f61e0152910 con 0x7f61e006d840 2023-11-28T20:00:12.962 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:12.958+0000 7f61dffff640 1 -- 172.21.15.78:0/3321562384 >> v1:172.21.15.179:6789/0 conn(0x7f61e006d840 legacy=0x7f61e00c43e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:00:12.962 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:12.958+0000 7f61dffff640 1 -- 172.21.15.78:0/3321562384 >> v1:172.21.15.78:6789/0 conn(0x7f61e014fc30 legacy=0x7f61e00c3cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:00:12.962 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:12.958+0000 7f61dffff640 1 -- 172.21.15.78:0/3321562384 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61e0152ed0 con 0x7f61e014f850 2023-11-28T20:00:12.964 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:12.962+0000 7f61dffff640 1 --2- 172.21.15.78:0/3321562384 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f61e014f850 0x7f61e00aacf0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f61d00097f0 tx=0x7f61d001c430 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bac2822384d49585 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:00:12.965 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:12.962+0000 7f61deffd640 1 -- 172.21.15.78:0/3321562384 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61d00ab650 con 0x7f61e014f850 2023-11-28T20:00:12.965 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:12.962+0000 7f61deffd640 1 -- 172.21.15.78:0/3321562384 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f61d00ab7b0 con 0x7f61e014f850 2023-11-28T20:00:12.965 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:12.962+0000 7f61deffd640 1 -- 172.21.15.78:0/3321562384 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61d00abb40 con 0x7f61e014f850 2023-11-28T20:00:12.966 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:12.962+0000 7f61e64c9640 1 -- 172.21.15.78:0/3321562384 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f61e014f850 msgr2=0x7f61e00aacf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:00:12.966 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:12.962+0000 7f61e64c9640 1 --2- 172.21.15.78:0/3321562384 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f61e014f850 0x7f61e00aacf0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f61d00097f0 tx=0x7f61d001c430 comp rx=0 tx=0).stop 2023-11-28T20:00:12.966 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:12.962+0000 7f61e64c9640 1 -- 172.21.15.78:0/3321562384 shutdown_connections 2023-11-28T20:00:12.966 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:12.962+0000 7f61e64c9640 1 --2- 172.21.15.78:0/3321562384 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f61e014f850 0x7f61e00aacf0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:12.966 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:12.962+0000 7f61e64c9640 1 -- 172.21.15.78:0/3321562384 >> 172.21.15.78:0/3321562384 conn(0x7f61e00c59f0 msgr2=0x7f61e00c5e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:00:12.967 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:12.962+0000 7f61e64c9640 1 -- 172.21.15.78:0/3321562384 shutdown_connections 2023-11-28T20:00:12.967 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:12.962+0000 7f61e64c9640 1 -- 172.21.15.78:0/3321562384 wait complete. 2023-11-28T20:00:12.968 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:12.962+0000 7f61e64c9640 1 Processor -- start 2023-11-28T20:00:12.968 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:12.962+0000 7f61e64c9640 1 -- start start 2023-11-28T20:00:12.969 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:12.966+0000 7f61e64c9640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f61e006d840 0x7f61e00a5f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:12.970 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:12.966+0000 7f61e64c9640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f61e014f850 0x7f61e014ad50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:12.970 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:12.966+0000 7f61e64c9640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f61e014fc30 0x7f61e014b290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:12.970 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:12.966+0000 7f61e64c9640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61e01ed340 con 0x7f61e014fc30 2023-11-28T20:00:12.970 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:12.966+0000 7f61e64c9640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61e00a8ae0 con 0x7f61e006d840 2023-11-28T20:00:12.970 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:12.966+0000 7f61e64c9640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f61e0072150 con 0x7f61e014f850 2023-11-28T20:00:12.970 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:12.966+0000 7f61e4a66640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f61e014fc30 0x7f61e014b290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:12.970 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:12.966+0000 7f61e4a66640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f61e014fc30 0x7f61e014b290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:36300/0 (socket says 172.21.15.78:36300) 2023-11-28T20:00:12.970 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:12.966+0000 7f61e4a66640 1 -- 172.21.15.78:0/137407652 learned_addr learned my addr 172.21.15.78:0/137407652 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T20:00:12.971 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:12.966+0000 7f61df7fe640 1 --2- 172.21.15.78:0/137407652 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f61e014f850 0x7f61e014ad50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:12.971 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:12.966+0000 7f61dffff640 1 --2- 172.21.15.78:0/137407652 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f61e006d840 0x7f61e00a5f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:12.971 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:12.966+0000 7f61e4a66640 1 -- 172.21.15.78:0/137407652 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f61e014f850 msgr2=0x7f61e014ad50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:00:12.971 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:12.966+0000 7f61e4a66640 1 --2- 172.21.15.78:0/137407652 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f61e014f850 0x7f61e014ad50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:12.971 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:12.966+0000 7f61e4a66640 1 -- 172.21.15.78:0/137407652 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f61e006d840 msgr2=0x7f61e00a5f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:00:12.971 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:12.966+0000 7f61e4a66640 1 --2- 172.21.15.78:0/137407652 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f61e006d840 0x7f61e00a5f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:12.971 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:12.966+0000 7f61e4a66640 1 -- 172.21.15.78:0/137407652 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61d0009420 con 0x7f61e014fc30 2023-11-28T20:00:12.971 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:12.966+0000 7f61e4a66640 1 --2- 172.21.15.78:0/137407652 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f61e014fc30 0x7f61e014b290 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f61d800c7a0 tx=0x7f61d800cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:00:12.971 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:12.966+0000 7f61dcff9640 1 -- 172.21.15.78:0/137407652 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61d8003b80 con 0x7f61e014fc30 2023-11-28T20:00:12.971 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:12.966+0000 7f61dcff9640 1 -- 172.21.15.78:0/137407652 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f61d8003ce0 con 0x7f61e014fc30 2023-11-28T20:00:12.971 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:12.966+0000 7f61e64c9640 1 -- 172.21.15.78:0/137407652 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f61e01f1630 con 0x7f61e014fc30 2023-11-28T20:00:12.971 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:12.966+0000 7f61dcff9640 1 -- 172.21.15.78:0/137407652 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61d800aa90 con 0x7f61e014fc30 2023-11-28T20:00:12.972 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:12.966+0000 7f61e64c9640 1 -- 172.21.15.78:0/137407652 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f61e0072680 con 0x7f61e014fc30 2023-11-28T20:00:12.972 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:12.966+0000 7f61e64c9640 1 -- 172.21.15.78:0/137407652 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f61e01ed4b0 con 0x7f61e014fc30 2023-11-28T20:00:12.973 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:12.970+0000 7f61dcff9640 1 -- 172.21.15.78:0/137407652 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f61d800abf0 con 0x7f61e014fc30 2023-11-28T20:00:12.974 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:12.970+0000 7f61dcff9640 1 --2- 172.21.15.78:0/137407652 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f61cc066470 0x7f61cc068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:12.974 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:12.970+0000 7f61dcff9640 1 -- 172.21.15.78:0/137407652 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 5929+0+0 (secure 0 0 0) 0x7f61d8083c40 con 0x7f61e014fc30 2023-11-28T20:00:12.974 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:12.970+0000 7f61dffff640 1 --2- 172.21.15.78:0/137407652 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f61cc066470 0x7f61cc068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:12.974 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:12.970+0000 7f61dffff640 1 --2- 172.21.15.78:0/137407652 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f61cc066470 0x7f61cc068930 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f61d00af000 tx=0x7f61d00a7000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:00:12.978 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:12.974+0000 7f61dcff9640 1 -- 172.21.15.78:0/137407652 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f61e01ed4b0 con 0x7f61e014fc30 2023-11-28T20:00:13.162 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:13.158+0000 7f61e64c9640 1 -- 172.21.15.78:0/137407652 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f61e01ed4b0 con 0x7f61e014fc30 2023-11-28T20:00:13.774 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:13.770+0000 7f61dcff9640 1 -- 172.21.15.78:0/137407652 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 5 and data pool 6 v13) v1 ==== 172+0+0 (secure 0 0 0) 0x7f61e01ed4b0 con 0x7f61e014fc30 2023-11-28T20:00:13.774 INFO:teuthology.orchestra.run.smithi078.stderr:new fs with metadata pool 5 and data pool 6 2023-11-28T20:00:13.776 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:13.774+0000 7f61e64c9640 1 -- 172.21.15.78:0/137407652 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f61cc066470 msgr2=0x7f61cc068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:00:13.777 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:13.774+0000 7f61e64c9640 1 --2- 172.21.15.78:0/137407652 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f61cc066470 0x7f61cc068930 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f61d00af000 tx=0x7f61d00a7000 comp rx=0 tx=0).stop 2023-11-28T20:00:13.777 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:13.774+0000 7f61e64c9640 1 -- 172.21.15.78:0/137407652 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f61e014fc30 msgr2=0x7f61e014b290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:00:13.777 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:13.774+0000 7f61e64c9640 1 --2- 172.21.15.78:0/137407652 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f61e014fc30 0x7f61e014b290 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f61d800c7a0 tx=0x7f61d800cc60 comp rx=0 tx=0).stop 2023-11-28T20:00:13.777 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:13.774+0000 7f61e64c9640 1 -- 172.21.15.78:0/137407652 shutdown_connections 2023-11-28T20:00:13.777 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:13.774+0000 7f61e64c9640 1 --2- 172.21.15.78:0/137407652 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f61cc066470 0x7f61cc068930 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:13.777 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:13.774+0000 7f61e64c9640 1 --2- 172.21.15.78:0/137407652 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f61e014f850 0x7f61e014ad50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:13.777 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:13.774+0000 7f61e64c9640 1 --2- 172.21.15.78:0/137407652 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f61e014fc30 0x7f61e014b290 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:13.777 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:13.774+0000 7f61e64c9640 1 --2- 172.21.15.78:0/137407652 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f61e006d840 0x7f61e00a5f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:13.778 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:13.774+0000 7f61e64c9640 1 -- 172.21.15.78:0/137407652 >> 172.21.15.78:0/137407652 conn(0x7f61e00c59f0 msgr2=0x7f61e00a5530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:00:13.778 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:13.774+0000 7f61e64c9640 1 -- 172.21.15.78:0/137407652 shutdown_connections 2023-11-28T20:00:13.778 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:13.774+0000 7f61e64c9640 1 -- 172.21.15.78:0/137407652 wait complete. 2023-11-28T20:00:13.835 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-28T20:00:13.972 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:13.970+0000 7f5878cf5640 1 Processor -- start 2023-11-28T20:00:13.972 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:13.970+0000 7f5878cf5640 1 -- start start 2023-11-28T20:00:13.974 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:13.970+0000 7f5878cf5640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f58740c8200 0x7f58740c69d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:13.974 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:13.970+0000 7f5878cf5640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f58740c9210 0x7f587415ecf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:13.974 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:13.970+0000 7f5878cf5640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5874151f20 con 0x7f58740c65f0 2023-11-28T20:00:13.974 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:13.970+0000 7f5878cf5640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5874154450 con 0x7f58740c8200 2023-11-28T20:00:13.974 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:13.970+0000 7f5878cf5640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5874154710 con 0x7f58740c9210 2023-11-28T20:00:13.975 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:13.970+0000 7f58737fe640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f58740c65f0 0x7f58740c8b00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:33298/0 (socket says 172.21.15.78:33298) 2023-11-28T20:00:13.975 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:13.970+0000 7f58737fe640 1 -- 172.21.15.78:0/1015588978 learned_addr learned my addr 172.21.15.78:0/1015588978 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-11-28T20:00:13.975 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:13.970+0000 7f5872ffd640 1 --2- 172.21.15.78:0/1015588978 >> v2:172.21.15.78:3300/0 conn(0x7f58740c8200 0x7f58740c69d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:13.975 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:13.970+0000 7f5873fff640 1 --2- 172.21.15.78:0/1015588978 >> v2:172.21.15.179:3300/0 conn(0x7f58740c9210 0x7f587415ecf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:13.975 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:13.970+0000 7f58727fc640 1 -- 172.21.15.78:0/1015588978 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1267596412 0 0) 0x7f5874151f20 con 0x7f58740c65f0 2023-11-28T20:00:13.975 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:13.970+0000 7f58727fc640 1 -- 172.21.15.78:0/1015588978 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f585c003530 con 0x7f58740c65f0 2023-11-28T20:00:13.975 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:13.970+0000 7f5872ffd640 1 -- 172.21.15.78:0/1015588978 >> v2:172.21.15.179:3300/0 conn(0x7f58740c9210 msgr2=0x7f587415ecf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:00:13.976 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:13.970+0000 7f5872ffd640 1 --2- 172.21.15.78:0/1015588978 >> v2:172.21.15.179:3300/0 conn(0x7f58740c9210 0x7f587415ecf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:13.976 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:13.970+0000 7f5872ffd640 1 -- 172.21.15.78:0/1015588978 >> v1:172.21.15.78:6789/0 conn(0x7f58740c65f0 legacy=0x7f58740c8b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:00:13.976 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:13.970+0000 7f5872ffd640 1 -- 172.21.15.78:0/1015588978 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58741549f0 con 0x7f58740c8200 2023-11-28T20:00:13.977 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:13.974+0000 7f5872ffd640 1 --2- 172.21.15.78:0/1015588978 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f58740c8200 0x7f58740c69d0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f587406aa10 tx=0x7f586801c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=96c57914220ca1fa server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:00:13.977 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:13.974+0000 7f58727fc640 1 -- 172.21.15.78:0/1015588978 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58680ac600 con 0x7f58740c8200 2023-11-28T20:00:13.977 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:13.974+0000 7f58727fc640 1 -- 172.21.15.78:0/1015588978 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f58680a8050 con 0x7f58740c8200 2023-11-28T20:00:13.977 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:13.974+0000 7f58727fc640 1 -- 172.21.15.78:0/1015588978 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58680ac980 con 0x7f58740c8200 2023-11-28T20:00:13.978 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:13.974+0000 7f5878cf5640 1 -- 172.21.15.78:0/1015588978 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f58740c8200 msgr2=0x7f58740c69d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:00:13.978 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:13.974+0000 7f5878cf5640 1 --2- 172.21.15.78:0/1015588978 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f58740c8200 0x7f58740c69d0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f587406aa10 tx=0x7f586801c3a0 comp rx=0 tx=0).stop 2023-11-28T20:00:13.978 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:13.974+0000 7f5878cf5640 1 -- 172.21.15.78:0/1015588978 shutdown_connections 2023-11-28T20:00:13.978 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:13.974+0000 7f5878cf5640 1 --2- 172.21.15.78:0/1015588978 >> v2:172.21.15.179:3300/0 conn(0x7f58740c9210 0x7f587415ecf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:13.978 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:13.974+0000 7f5878cf5640 1 --2- 172.21.15.78:0/1015588978 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f58740c8200 0x7f58740c69d0 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:13.978 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:13.974+0000 7f5878cf5640 1 -- 172.21.15.78:0/1015588978 >> 172.21.15.78:0/1015588978 conn(0x7f58740ab730 msgr2=0x7f58740abb40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:00:13.979 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:13.974+0000 7f5878cf5640 1 -- 172.21.15.78:0/1015588978 shutdown_connections 2023-11-28T20:00:13.979 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:13.974+0000 7f5878cf5640 1 -- 172.21.15.78:0/1015588978 wait complete. 2023-11-28T20:00:13.979 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:13.974+0000 7f5878cf5640 1 Processor -- start 2023-11-28T20:00:13.979 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:13.978+0000 7f5878cf5640 1 -- start start 2023-11-28T20:00:13.982 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:13.978+0000 7f5878cf5640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f58740c65f0 0x7f58741ec7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:13.982 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:13.978+0000 7f5878cf5640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f58740c8200 0x7f5874144de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:13.982 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:13.978+0000 7f5878cf5640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f58740c9210 0x7f587414fda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:13.982 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:13.978+0000 7f5878cf5640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58741ed740 con 0x7f58740c9210 2023-11-28T20:00:13.982 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:13.978+0000 7f5878cf5640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f587414f910 con 0x7f58740c8200 2023-11-28T20:00:13.982 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:13.978+0000 7f5878cf5640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f58741ecea0 con 0x7f58740c65f0 2023-11-28T20:00:13.982 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:13.978+0000 7f5873fff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f58740c9210 0x7f587414fda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:13.982 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:13.978+0000 7f5873fff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f58740c9210 0x7f587414fda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:36322/0 (socket says 172.21.15.78:36322) 2023-11-28T20:00:13.982 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:13.978+0000 7f5873fff640 1 -- 172.21.15.78:0/2445912177 learned_addr learned my addr 172.21.15.78:0/2445912177 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T20:00:13.983 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:13.978+0000 7f58737fe640 1 --2- 172.21.15.78:0/2445912177 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f58740c65f0 0x7f58741ec7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:13.983 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:13.978+0000 7f5872ffd640 1 --2- 172.21.15.78:0/2445912177 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f58740c8200 0x7f5874144de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:13.983 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:13.978+0000 7f5873fff640 1 -- 172.21.15.78:0/2445912177 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f58740c65f0 msgr2=0x7f58741ec7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:00:13.983 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:13.978+0000 7f5873fff640 1 --2- 172.21.15.78:0/2445912177 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f58740c65f0 0x7f58741ec7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:13.983 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:13.978+0000 7f5873fff640 1 -- 172.21.15.78:0/2445912177 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f58740c8200 msgr2=0x7f5874144de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:00:13.983 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:13.978+0000 7f5873fff640 1 --2- 172.21.15.78:0/2445912177 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f58740c8200 0x7f5874144de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:13.983 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:13.978+0000 7f5873fff640 1 -- 172.21.15.78:0/2445912177 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5868009420 con 0x7f58740c9210 2023-11-28T20:00:13.983 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:13.978+0000 7f5873fff640 1 --2- 172.21.15.78:0/2445912177 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f58740c9210 0x7f587414fda0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f586c007e70 tx=0x7f586c00e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:00:13.983 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:13.978+0000 7f585bfff640 1 -- 172.21.15.78:0/2445912177 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f586c014620 con 0x7f58740c9210 2023-11-28T20:00:13.983 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:13.978+0000 7f585bfff640 1 -- 172.21.15.78:0/2445912177 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f586c0147a0 con 0x7f58740c9210 2023-11-28T20:00:13.983 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:13.978+0000 7f585bfff640 1 -- 172.21.15.78:0/2445912177 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f586c014b50 con 0x7f58740c9210 2023-11-28T20:00:13.983 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:13.978+0000 7f5878cf5640 1 -- 172.21.15.78:0/2445912177 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f58741ed180 con 0x7f58740c9210 2023-11-28T20:00:13.984 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:13.978+0000 7f5878cf5640 1 -- 172.21.15.78:0/2445912177 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5874149160 con 0x7f58740c9210 2023-11-28T20:00:13.984 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:13.978+0000 7f5878cf5640 1 -- 172.21.15.78:0/2445912177 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f587414faa0 con 0x7f58740c9210 2023-11-28T20:00:13.984 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:13.982+0000 7f585bfff640 1 -- 172.21.15.78:0/2445912177 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f586c014cb0 con 0x7f58740c9210 2023-11-28T20:00:13.985 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:13.982+0000 7f585bfff640 1 --2- 172.21.15.78:0/2445912177 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f58600664a0 0x7f5860068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:13.985 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:13.982+0000 7f585bfff640 1 -- 172.21.15.78:0/2445912177 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f586c0847f0 con 0x7f58740c9210 2023-11-28T20:00:13.985 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:13.982+0000 7f58737fe640 1 --2- 172.21.15.78:0/2445912177 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f58600664a0 0x7f5860068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:13.985 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:13.982+0000 7f58737fe640 1 --2- 172.21.15.78:0/2445912177 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f58600664a0 0x7f5860068960 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f58640011f0 tx=0x7f5864007d40 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:00:13.989 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:13.986+0000 7f585bfff640 1 -- 172.21.15.78:0/2445912177 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f586c051bd0 con 0x7f58740c9210 2023-11-28T20:00:14.139 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:14.134+0000 7f5878cf5640 1 -- 172.21.15.78:0/2445912177 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f58740674b0 con 0x7f58740c9210 2023-11-28T20:00:14.140 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:14.138+0000 7f585bfff640 1 -- 172.21.15.78:0/2445912177 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v39) v1 ==== 74+0+16763 (secure 0 0 0) 0x7f586c0551f0 con 0x7f58740c9210 2023-11-28T20:00:14.140 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-11-28T20:00:14.141 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":39,"fsid":"dd9780e8-3bda-44fa-a9f0-fa07d19d901d","created":"2023-11-28T19:58:40.969556+0000","modified":"2023-11-28T20:00:13.161913+0000","last_up_change":"2023-11-28T19:58:52.596716+0000","last_in_change":"2023-11-28T19:58:43.609275+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-28T19:58:54.011229+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2023-11-28T20:00:10.831194+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"39","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2023-11-28T20:00:12.150184+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"39","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e84245ac-b5da-429e-af18-39acaa2b33e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6800","nonce":3358701235},{"type":"v1","addr":"172.21.15.78:6801","nonce":3358701235}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6802","nonce":3358701235},{"type":"v1","addr":"172.21.15.78:6803","nonce":3358701235}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6806","nonce":3358701235},{"type":"v1","addr":"172.21.15.78:6807","nonce":3358701235}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6804","nonce":3358701235},{"type":"v1","addr":"172.21.15.78:6805","nonce":3358701235}]},"public_addr":"172.21.15.78:6801/3358701235","cluster_addr":"172.21.15.78:6803/3358701235","heartbeat_back_addr":"172.21.15.78:6807/3358701235","heartbeat_front_addr":"172.21.15.78:6805/3358701235","state":["exists","up"]},{"osd":1,"uuid":"e634831d-c4e2-48d9-870c-9556ae162981","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6808","nonce":3211476654},{"type":"v1","addr":"172.21.15.78:6809","nonce":3211476654}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6810","nonce":3211476654},{"type":"v1","addr":"172.21.15.78:6811","nonce":3211476654}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6814","nonce":3211476654},{"type":"v1","addr":"172.21.15.78:6815","nonce":3211476654}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6812","nonce":3211476654},{"type":"v1","addr":"172.21.15.78:6813","nonce":3211476654}]},"public_addr":"172.21.15.78:6809/3211476654","cluster_addr":"172.21.15.78:6811/3211476654","heartbeat_back_addr":"172.21.15.78:6815/3211476654","heartbeat_front_addr":"172.21.15.78:6813/3211476654","state":["exists","up"]},{"osd":2,"uuid":"274c8395-6534-41f0-b8fb-a00af8985aa8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6816","nonce":2532904479},{"type":"v1","addr":"172.21.15.78:6817","nonce":2532904479}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6818","nonce":2532904479},{"type":"v1","addr":"172.21.15.78:6819","nonce":2532904479}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6822","nonce":2532904479},{"type":"v1","addr":"172.21.15.78:6823","nonce":2532904479}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6820","nonce":2532904479},{"type":"v1","addr":"172.21.15.78:6821","nonce":2532904479}]},"public_addr":"172.21.15.78:6817/2532904479","cluster_addr":"172.21.15.78:6819/2532904479","heartbeat_back_addr":"172.21.15.78:6823/2532904479","heartbeat_front_addr":"172.21.15.78:6821/2532904479","state":["exists","up"]},{"osd":3,"uuid":"77acc9af-7d4d-4b18-8cf5-d62f5971b7c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6824","nonce":3442991267},{"type":"v1","addr":"172.21.15.78:6825","nonce":3442991267}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6826","nonce":3442991267},{"type":"v1","addr":"172.21.15.78:6827","nonce":3442991267}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6830","nonce":3442991267},{"type":"v1","addr":"172.21.15.78:6831","nonce":3442991267}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6828","nonce":3442991267},{"type":"v1","addr":"172.21.15.78:6829","nonce":3442991267}]},"public_addr":"172.21.15.78:6825/3442991267","cluster_addr":"172.21.15.78:6827/3442991267","heartbeat_back_addr":"172.21.15.78:6831/3442991267","heartbeat_front_addr":"172.21.15.78:6829/3442991267","state":["exists","up"]},{"osd":4,"uuid":"5c62bc66-6b34-4b7f-a66b-9a743969138c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":802983577},{"type":"v1","addr":"172.21.15.179:6809","nonce":802983577}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":802983577},{"type":"v1","addr":"172.21.15.179:6811","nonce":802983577}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":802983577},{"type":"v1","addr":"172.21.15.179:6815","nonce":802983577}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":802983577},{"type":"v1","addr":"172.21.15.179:6813","nonce":802983577}]},"public_addr":"172.21.15.179:6809/802983577","cluster_addr":"172.21.15.179:6811/802983577","heartbeat_back_addr":"172.21.15.179:6815/802983577","heartbeat_front_addr":"172.21.15.179:6813/802983577","state":["exists","up"]},{"osd":5,"uuid":"67db6d36-f684-4079-b0cd-82b4dd61461f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":518192887},{"type":"v1","addr":"172.21.15.179:6818","nonce":518192887}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":518192887},{"type":"v1","addr":"172.21.15.179:6822","nonce":518192887}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":518192887},{"type":"v1","addr":"172.21.15.179:6829","nonce":518192887}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6824","nonce":518192887},{"type":"v1","addr":"172.21.15.179:6826","nonce":518192887}]},"public_addr":"172.21.15.179:6818/518192887","cluster_addr":"172.21.15.179:6822/518192887","heartbeat_back_addr":"172.21.15.179:6829/518192887","heartbeat_front_addr":"172.21.15.179:6826/518192887","state":["exists","up"]},{"osd":6,"uuid":"12e670af-5a16-4c81-9f97-defa66cab967","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":815435378},{"type":"v1","addr":"172.21.15.179:6801","nonce":815435378}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":815435378},{"type":"v1","addr":"172.21.15.179:6803","nonce":815435378}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":815435378},{"type":"v1","addr":"172.21.15.179:6807","nonce":815435378}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":815435378},{"type":"v1","addr":"172.21.15.179:6805","nonce":815435378}]},"public_addr":"172.21.15.179:6801/815435378","cluster_addr":"172.21.15.179:6803/815435378","heartbeat_back_addr":"172.21.15.179:6807/815435378","heartbeat_front_addr":"172.21.15.179:6805/815435378","state":["exists","up"]},{"osd":7,"uuid":"fe630650-2eb3-49ad-8676-c341e6332eb1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6817","nonce":2848432339},{"type":"v1","addr":"172.21.15.179:6819","nonce":2848432339}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6821","nonce":2848432339},{"type":"v1","addr":"172.21.15.179:6823","nonce":2848432339}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":2848432339},{"type":"v1","addr":"172.21.15.179:6831","nonce":2848432339}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6825","nonce":2848432339},{"type":"v1","addr":"172.21.15.179:6827","nonce":2848432339}]},"public_addr":"172.21.15.179:6819/2848432339","cluster_addr":"172.21.15.179:6823/2848432339","heartbeat_back_addr":"172.21.15.179:6831/2848432339","heartbeat_front_addr":"172.21.15.179:6827/2848432339","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:58:49.255433+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:58:49.412880+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:58:49.559295+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:58:49.245237+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:58:49.184557+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:58:49.329851+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:58:49.366012+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:58:49.349604+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-28T20:00:14.142 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:14.138+0000 7f5878cf5640 1 -- 172.21.15.78:0/2445912177 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f58600664a0 msgr2=0x7f5860068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:00:14.142 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:14.138+0000 7f5878cf5640 1 --2- 172.21.15.78:0/2445912177 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f58600664a0 0x7f5860068960 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f58640011f0 tx=0x7f5864007d40 comp rx=0 tx=0).stop 2023-11-28T20:00:14.143 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:14.138+0000 7f5878cf5640 1 -- 172.21.15.78:0/2445912177 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f58740c9210 msgr2=0x7f587414fda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:00:14.143 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:14.138+0000 7f5878cf5640 1 --2- 172.21.15.78:0/2445912177 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f58740c9210 0x7f587414fda0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f586c007e70 tx=0x7f586c00e4b0 comp rx=0 tx=0).stop 2023-11-28T20:00:14.143 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:14.138+0000 7f5878cf5640 1 -- 172.21.15.78:0/2445912177 shutdown_connections 2023-11-28T20:00:14.143 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:14.138+0000 7f5878cf5640 1 --2- 172.21.15.78:0/2445912177 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f58600664a0 0x7f5860068960 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:14.143 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:14.138+0000 7f5878cf5640 1 --2- 172.21.15.78:0/2445912177 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f58740c9210 0x7f587414fda0 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:14.143 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:14.138+0000 7f5878cf5640 1 --2- 172.21.15.78:0/2445912177 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f58740c8200 0x7f5874144de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:14.143 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:14.138+0000 7f5878cf5640 1 --2- 172.21.15.78:0/2445912177 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f58740c65f0 0x7f58741ec7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:14.144 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:14.138+0000 7f5878cf5640 1 -- 172.21.15.78:0/2445912177 >> 172.21.15.78:0/2445912177 conn(0x7f58740ab730 msgr2=0x7f58740c8b00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:00:14.144 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:14.138+0000 7f5878cf5640 1 -- 172.21.15.78:0/2445912177 shutdown_connections 2023-11-28T20:00:14.144 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:14.138+0000 7f5878cf5640 1 -- 172.21.15.78:0/2445912177 wait complete. 2023-11-28T20:00:14.162 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-28T20:00:14.299 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:14.294+0000 7ff819f48640 1 Processor -- start 2023-11-28T20:00:14.300 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:14.294+0000 7ff819f48640 1 -- start start 2023-11-28T20:00:14.301 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:14.298+0000 7ff819f48640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7ff81406baf0 0x7ff81406bed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:14.301 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:14.298+0000 7ff819f48640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7ff8140c3750 0x7ff814151220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:14.301 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:14.298+0000 7ff819f48640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff8140c1b10 0x7ff814153dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:14.301 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:14.298+0000 7ff819f48640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff8140a53c0 con 0x7ff81406baf0 2023-11-28T20:00:14.302 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:14.298+0000 7ff819f48640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff8140c0b80 con 0x7ff8140c3750 2023-11-28T20:00:14.302 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:14.298+0000 7ff819f48640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8140c1680 con 0x7ff8140c1b10 2023-11-28T20:00:14.302 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:14.298+0000 7ff818f46640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7ff81406baf0 0x7ff81406bed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:14.302 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:14.298+0000 7ff818f46640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7ff81406baf0 0x7ff81406bed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:36332/0 (socket says 172.21.15.78:36332) 2023-11-28T20:00:14.302 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:14.298+0000 7ff818f46640 1 -- 172.21.15.78:0/3312401683 learned_addr learned my addr 172.21.15.78:0/3312401683 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T20:00:14.302 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:14.298+0000 7ff80bfff640 1 --2- 172.21.15.78:0/3312401683 >> v2:172.21.15.179:3300/0 conn(0x7ff8140c3750 0x7ff814151220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:14.302 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:14.298+0000 7ff819747640 1 --2- 172.21.15.78:0/3312401683 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff8140c1b10 0x7ff814153dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:14.302 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:14.298+0000 7ff818f46640 1 -- 172.21.15.78:0/3312401683 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff8140c1b10 msgr2=0x7ff814153dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:00:14.302 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:14.298+0000 7ff818f46640 1 --2- 172.21.15.78:0/3312401683 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff8140c1b10 0x7ff814153dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:14.302 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:14.298+0000 7ff818f46640 1 -- 172.21.15.78:0/3312401683 >> v2:172.21.15.179:3300/0 conn(0x7ff8140c3750 msgr2=0x7ff814151220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:00:14.303 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:14.298+0000 7ff818f46640 1 --2- 172.21.15.78:0/3312401683 >> v2:172.21.15.179:3300/0 conn(0x7ff8140c3750 0x7ff814151220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:14.303 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:14.298+0000 7ff818f46640 1 -- 172.21.15.78:0/3312401683 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff814151760 con 0x7ff81406baf0 2023-11-28T20:00:14.304 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:14.302+0000 7ff818f46640 1 --2- 172.21.15.78:0/3312401683 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff81406baf0 0x7ff81406bed0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7ff8140c6550 tx=0x7ff81001c3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7e1f42f0f44c7647 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:00:14.305 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:14.302+0000 7ff80b7fe640 1 -- 172.21.15.78:0/3312401683 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8100ab600 con 0x7ff81406baf0 2023-11-28T20:00:14.305 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:14.302+0000 7ff80b7fe640 1 -- 172.21.15.78:0/3312401683 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff8100a7050 con 0x7ff81406baf0 2023-11-28T20:00:14.306 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:14.302+0000 7ff80b7fe640 1 -- 172.21.15.78:0/3312401683 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8100ab980 con 0x7ff81406baf0 2023-11-28T20:00:14.306 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:14.302+0000 7ff819f48640 1 -- 172.21.15.78:0/3312401683 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff81406baf0 msgr2=0x7ff81406bed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:00:14.306 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:14.302+0000 7ff819f48640 1 --2- 172.21.15.78:0/3312401683 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff81406baf0 0x7ff81406bed0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7ff8140c6550 tx=0x7ff81001c3b0 comp rx=0 tx=0).stop 2023-11-28T20:00:14.306 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:14.302+0000 7ff819f48640 1 -- 172.21.15.78:0/3312401683 shutdown_connections 2023-11-28T20:00:14.307 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:14.302+0000 7ff819f48640 1 --2- 172.21.15.78:0/3312401683 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff8140c1b10 0x7ff814153dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:14.307 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:14.302+0000 7ff819f48640 1 --2- 172.21.15.78:0/3312401683 >> v2:172.21.15.179:3300/0 conn(0x7ff8140c3750 0x7ff814151220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:14.307 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:14.302+0000 7ff819f48640 1 --2- 172.21.15.78:0/3312401683 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff81406baf0 0x7ff81406bed0 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:14.307 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:14.302+0000 7ff819f48640 1 -- 172.21.15.78:0/3312401683 >> 172.21.15.78:0/3312401683 conn(0x7ff8140a7600 msgr2=0x7ff8140a7a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:00:14.307 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:14.302+0000 7ff819f48640 1 -- 172.21.15.78:0/3312401683 shutdown_connections 2023-11-28T20:00:14.307 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:14.302+0000 7ff819f48640 1 -- 172.21.15.78:0/3312401683 wait complete. 2023-11-28T20:00:14.310 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:14.302+0000 7ff819f48640 1 Processor -- start 2023-11-28T20:00:14.310 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:14.302+0000 7ff819f48640 1 -- start start 2023-11-28T20:00:14.310 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:14.306+0000 7ff819f48640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff81406baf0 0x7ff8141ee770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:14.310 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:14.306+0000 7ff819f48640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff8140c1b10 0x7ff8141ec990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:14.311 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:14.306+0000 7ff819f48640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff8140c3750 0x7ff8141eced0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:14.311 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:14.306+0000 7ff819f48640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8140a4fa0 con 0x7ff81406baf0 2023-11-28T20:00:14.311 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:14.306+0000 7ff819f48640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8141ec4b0 con 0x7ff8140c3750 2023-11-28T20:00:14.311 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:14.306+0000 7ff819f48640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8141ef050 con 0x7ff8140c1b10 2023-11-28T20:00:14.311 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:14.306+0000 7ff818f46640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff81406baf0 0x7ff8141ee770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:14.311 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:14.306+0000 7ff818f46640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff81406baf0 0x7ff8141ee770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:36342/0 (socket says 172.21.15.78:36342) 2023-11-28T20:00:14.312 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:14.306+0000 7ff818f46640 1 -- 172.21.15.78:0/1788639481 learned_addr learned my addr 172.21.15.78:0/1788639481 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T20:00:14.312 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:14.306+0000 7ff80bfff640 1 --2- 172.21.15.78:0/1788639481 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff8140c1b10 0x7ff8141ec990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:14.312 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:14.306+0000 7ff819747640 1 --2- 172.21.15.78:0/1788639481 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff8140c3750 0x7ff8141eced0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:14.312 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:14.306+0000 7ff818f46640 1 -- 172.21.15.78:0/1788639481 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff8140c1b10 msgr2=0x7ff8141ec990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:00:14.313 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:14.306+0000 7ff818f46640 1 --2- 172.21.15.78:0/1788639481 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff8140c1b10 0x7ff8141ec990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:14.313 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:14.306+0000 7ff818f46640 1 -- 172.21.15.78:0/1788639481 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff8140c3750 msgr2=0x7ff8141eced0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:00:14.313 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:14.306+0000 7ff818f46640 1 --2- 172.21.15.78:0/1788639481 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff8140c3750 0x7ff8141eced0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:14.313 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:14.306+0000 7ff818f46640 1 -- 172.21.15.78:0/1788639481 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8100094d0 con 0x7ff81406baf0 2023-11-28T20:00:14.313 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:14.306+0000 7ff819747640 1 --2- 172.21.15.78:0/1788639481 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff8140c3750 0x7ff8141eced0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T20:00:14.313 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:14.306+0000 7ff818f46640 1 --2- 172.21.15.78:0/1788639481 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff81406baf0 0x7ff8141ee770 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7ff8100ae040 tx=0x7ff81001abf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:00:14.314 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:14.306+0000 7ff8097fa640 1 -- 172.21.15.78:0/1788639481 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8100b6420 con 0x7ff81406baf0 2023-11-28T20:00:14.314 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:14.306+0000 7ff8097fa640 1 -- 172.21.15.78:0/1788639481 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff8100b6580 con 0x7ff81406baf0 2023-11-28T20:00:14.314 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:14.306+0000 7ff8097fa640 1 -- 172.21.15.78:0/1788639481 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8100b6930 con 0x7ff81406baf0 2023-11-28T20:00:14.314 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:14.306+0000 7ff819f48640 1 -- 172.21.15.78:0/1788639481 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff8140724b0 con 0x7ff81406baf0 2023-11-28T20:00:14.314 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:14.306+0000 7ff819f48640 1 -- 172.21.15.78:0/1788639481 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff814071500 con 0x7ff81406baf0 2023-11-28T20:00:14.315 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:14.306+0000 7ff819f48640 1 -- 172.21.15.78:0/1788639481 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff814072310 con 0x7ff81406baf0 2023-11-28T20:00:14.316 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:14.306+0000 7ff8097fa640 1 -- 172.21.15.78:0/1788639481 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7ff8100b2040 con 0x7ff81406baf0 2023-11-28T20:00:14.316 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:14.310+0000 7ff8097fa640 1 --2- 172.21.15.78:0/1788639481 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7ff800066470 0x7ff800068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:14.316 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:14.310+0000 7ff8097fa640 1 -- 172.21.15.78:0/1788639481 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6029+0+0 (secure 0 0 0) 0x7ff81011e280 con 0x7ff81406baf0 2023-11-28T20:00:14.316 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:14.310+0000 7ff80bfff640 1 --2- 172.21.15.78:0/1788639481 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7ff800066470 0x7ff800068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:14.316 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:14.310+0000 7ff80bfff640 1 --2- 172.21.15.78:0/1788639481 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7ff800066470 0x7ff800068930 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7ff81414ab80 tx=0x7ff804009190 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:00:14.316 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:14.314+0000 7ff8097fa640 1 -- 172.21.15.78:0/1788639481 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7ff814072310 con 0x7ff81406baf0 2023-11-28T20:00:14.466 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:14.462+0000 7ff819f48640 1 -- 172.21.15.78:0/1788639481 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff814072310 con 0x7ff81406baf0 2023-11-28T20:00:14.467 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:14.466+0000 7ff8097fa640 1 -- 172.21.15.78:0/1788639481 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v39) v1 ==== 74+0+16763 (secure 0 0 0) 0x7ff814072310 con 0x7ff81406baf0 2023-11-28T20:00:14.468 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-11-28T20:00:14.468 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":39,"fsid":"dd9780e8-3bda-44fa-a9f0-fa07d19d901d","created":"2023-11-28T19:58:40.969556+0000","modified":"2023-11-28T20:00:13.161913+0000","last_up_change":"2023-11-28T19:58:52.596716+0000","last_in_change":"2023-11-28T19:58:43.609275+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-28T19:58:54.011229+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2023-11-28T20:00:10.831194+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"39","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2023-11-28T20:00:12.150184+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"39","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e84245ac-b5da-429e-af18-39acaa2b33e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6800","nonce":3358701235},{"type":"v1","addr":"172.21.15.78:6801","nonce":3358701235}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6802","nonce":3358701235},{"type":"v1","addr":"172.21.15.78:6803","nonce":3358701235}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6806","nonce":3358701235},{"type":"v1","addr":"172.21.15.78:6807","nonce":3358701235}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6804","nonce":3358701235},{"type":"v1","addr":"172.21.15.78:6805","nonce":3358701235}]},"public_addr":"172.21.15.78:6801/3358701235","cluster_addr":"172.21.15.78:6803/3358701235","heartbeat_back_addr":"172.21.15.78:6807/3358701235","heartbeat_front_addr":"172.21.15.78:6805/3358701235","state":["exists","up"]},{"osd":1,"uuid":"e634831d-c4e2-48d9-870c-9556ae162981","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6808","nonce":3211476654},{"type":"v1","addr":"172.21.15.78:6809","nonce":3211476654}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6810","nonce":3211476654},{"type":"v1","addr":"172.21.15.78:6811","nonce":3211476654}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6814","nonce":3211476654},{"type":"v1","addr":"172.21.15.78:6815","nonce":3211476654}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6812","nonce":3211476654},{"type":"v1","addr":"172.21.15.78:6813","nonce":3211476654}]},"public_addr":"172.21.15.78:6809/3211476654","cluster_addr":"172.21.15.78:6811/3211476654","heartbeat_back_addr":"172.21.15.78:6815/3211476654","heartbeat_front_addr":"172.21.15.78:6813/3211476654","state":["exists","up"]},{"osd":2,"uuid":"274c8395-6534-41f0-b8fb-a00af8985aa8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6816","nonce":2532904479},{"type":"v1","addr":"172.21.15.78:6817","nonce":2532904479}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6818","nonce":2532904479},{"type":"v1","addr":"172.21.15.78:6819","nonce":2532904479}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6822","nonce":2532904479},{"type":"v1","addr":"172.21.15.78:6823","nonce":2532904479}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6820","nonce":2532904479},{"type":"v1","addr":"172.21.15.78:6821","nonce":2532904479}]},"public_addr":"172.21.15.78:6817/2532904479","cluster_addr":"172.21.15.78:6819/2532904479","heartbeat_back_addr":"172.21.15.78:6823/2532904479","heartbeat_front_addr":"172.21.15.78:6821/2532904479","state":["exists","up"]},{"osd":3,"uuid":"77acc9af-7d4d-4b18-8cf5-d62f5971b7c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6824","nonce":3442991267},{"type":"v1","addr":"172.21.15.78:6825","nonce":3442991267}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6826","nonce":3442991267},{"type":"v1","addr":"172.21.15.78:6827","nonce":3442991267}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6830","nonce":3442991267},{"type":"v1","addr":"172.21.15.78:6831","nonce":3442991267}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6828","nonce":3442991267},{"type":"v1","addr":"172.21.15.78:6829","nonce":3442991267}]},"public_addr":"172.21.15.78:6825/3442991267","cluster_addr":"172.21.15.78:6827/3442991267","heartbeat_back_addr":"172.21.15.78:6831/3442991267","heartbeat_front_addr":"172.21.15.78:6829/3442991267","state":["exists","up"]},{"osd":4,"uuid":"5c62bc66-6b34-4b7f-a66b-9a743969138c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":802983577},{"type":"v1","addr":"172.21.15.179:6809","nonce":802983577}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":802983577},{"type":"v1","addr":"172.21.15.179:6811","nonce":802983577}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":802983577},{"type":"v1","addr":"172.21.15.179:6815","nonce":802983577}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":802983577},{"type":"v1","addr":"172.21.15.179:6813","nonce":802983577}]},"public_addr":"172.21.15.179:6809/802983577","cluster_addr":"172.21.15.179:6811/802983577","heartbeat_back_addr":"172.21.15.179:6815/802983577","heartbeat_front_addr":"172.21.15.179:6813/802983577","state":["exists","up"]},{"osd":5,"uuid":"67db6d36-f684-4079-b0cd-82b4dd61461f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":518192887},{"type":"v1","addr":"172.21.15.179:6818","nonce":518192887}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":518192887},{"type":"v1","addr":"172.21.15.179:6822","nonce":518192887}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":518192887},{"type":"v1","addr":"172.21.15.179:6829","nonce":518192887}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6824","nonce":518192887},{"type":"v1","addr":"172.21.15.179:6826","nonce":518192887}]},"public_addr":"172.21.15.179:6818/518192887","cluster_addr":"172.21.15.179:6822/518192887","heartbeat_back_addr":"172.21.15.179:6829/518192887","heartbeat_front_addr":"172.21.15.179:6826/518192887","state":["exists","up"]},{"osd":6,"uuid":"12e670af-5a16-4c81-9f97-defa66cab967","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":815435378},{"type":"v1","addr":"172.21.15.179:6801","nonce":815435378}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":815435378},{"type":"v1","addr":"172.21.15.179:6803","nonce":815435378}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":815435378},{"type":"v1","addr":"172.21.15.179:6807","nonce":815435378}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":815435378},{"type":"v1","addr":"172.21.15.179:6805","nonce":815435378}]},"public_addr":"172.21.15.179:6801/815435378","cluster_addr":"172.21.15.179:6803/815435378","heartbeat_back_addr":"172.21.15.179:6807/815435378","heartbeat_front_addr":"172.21.15.179:6805/815435378","state":["exists","up"]},{"osd":7,"uuid":"fe630650-2eb3-49ad-8676-c341e6332eb1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6817","nonce":2848432339},{"type":"v1","addr":"172.21.15.179:6819","nonce":2848432339}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6821","nonce":2848432339},{"type":"v1","addr":"172.21.15.179:6823","nonce":2848432339}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":2848432339},{"type":"v1","addr":"172.21.15.179:6831","nonce":2848432339}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6825","nonce":2848432339},{"type":"v1","addr":"172.21.15.179:6827","nonce":2848432339}]},"public_addr":"172.21.15.179:6819/2848432339","cluster_addr":"172.21.15.179:6823/2848432339","heartbeat_back_addr":"172.21.15.179:6831/2848432339","heartbeat_front_addr":"172.21.15.179:6827/2848432339","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:58:49.255433+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:58:49.412880+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:58:49.559295+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:58:49.245237+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:58:49.184557+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:58:49.329851+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:58:49.366012+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:58:49.349604+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-28T20:00:14.470 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:14.466+0000 7ff819f48640 1 -- 172.21.15.78:0/1788639481 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7ff800066470 msgr2=0x7ff800068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:00:14.470 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:14.466+0000 7ff819f48640 1 --2- 172.21.15.78:0/1788639481 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7ff800066470 0x7ff800068930 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7ff81414ab80 tx=0x7ff804009190 comp rx=0 tx=0).stop 2023-11-28T20:00:14.470 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:14.466+0000 7ff819f48640 1 -- 172.21.15.78:0/1788639481 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff81406baf0 msgr2=0x7ff8141ee770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:00:14.470 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:14.466+0000 7ff819f48640 1 --2- 172.21.15.78:0/1788639481 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff81406baf0 0x7ff8141ee770 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7ff8100ae040 tx=0x7ff81001abf0 comp rx=0 tx=0).stop 2023-11-28T20:00:14.470 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:14.466+0000 7ff819f48640 1 -- 172.21.15.78:0/1788639481 shutdown_connections 2023-11-28T20:00:14.470 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:14.466+0000 7ff819f48640 1 --2- 172.21.15.78:0/1788639481 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7ff800066470 0x7ff800068930 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:14.470 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:14.466+0000 7ff819f48640 1 --2- 172.21.15.78:0/1788639481 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff8140c1b10 0x7ff8141ec990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:14.470 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:14.466+0000 7ff819f48640 1 --2- 172.21.15.78:0/1788639481 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff8140c3750 0x7ff8141eced0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:14.470 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:14.466+0000 7ff819f48640 1 --2- 172.21.15.78:0/1788639481 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff81406baf0 0x7ff8141ee770 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:14.470 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:14.466+0000 7ff819f48640 1 -- 172.21.15.78:0/1788639481 >> 172.21.15.78:0/1788639481 conn(0x7ff8140a7600 msgr2=0x7ff8140c46f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:00:14.471 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:14.466+0000 7ff819f48640 1 -- 172.21.15.78:0/1788639481 shutdown_connections 2023-11-28T20:00:14.471 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:14.466+0000 7ff819f48640 1 -- 172.21.15.78:0/1788639481 wait complete. 2023-11-28T20:00:14.489 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-11-28T20:00:14.630 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:14.626+0000 7feff5a79640 1 Processor -- start 2023-11-28T20:00:14.630 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:14.626+0000 7feff5a79640 1 -- start start 2023-11-28T20:00:14.631 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:14.626+0000 7feff5a79640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7feff00af4d0 0x7feff00c6840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:14.632 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:14.626+0000 7feff5a79640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7feff0154f00 0x7feff006be20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:14.632 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:14.626+0000 7feff5a79640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feff00c8450 con 0x7feff00c6d80 2023-11-28T20:00:14.632 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:14.626+0000 7feff5a79640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feff00af8b0 con 0x7feff0154f00 2023-11-28T20:00:14.633 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:14.626+0000 7feff5a79640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feff0155470 con 0x7feff00af4d0 2023-11-28T20:00:14.633 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:14.626+0000 7fefeffff640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7feff0154f00 0x7feff006be20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:14.633 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:14.626+0000 7fefeffff640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7feff0154f00 0x7feff006be20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:36348/0 (socket says 172.21.15.78:36348) 2023-11-28T20:00:14.634 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:14.626+0000 7fefeffff640 1 -- 172.21.15.78:0/2873223035 learned_addr learned my addr 172.21.15.78:0/2873223035 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T20:00:14.634 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:14.626+0000 7fefef7fe640 1 --2- 172.21.15.78:0/2873223035 >> v2:172.21.15.179:3300/0 conn(0x7feff00af4d0 0x7feff00c6840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:14.634 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:14.626+0000 7fefeffff640 1 -- 172.21.15.78:0/2873223035 >> v2:172.21.15.179:3300/0 conn(0x7feff00af4d0 msgr2=0x7feff00c6840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:00:14.634 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:14.626+0000 7fefeffff640 1 --2- 172.21.15.78:0/2873223035 >> v2:172.21.15.179:3300/0 conn(0x7feff00af4d0 0x7feff00c6840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:14.635 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:14.626+0000 7fefeffff640 1 -- 172.21.15.78:0/2873223035 >> v1:172.21.15.179:6789/0 conn(0x7feff00c6d80 legacy=0x7feff006b710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:00:14.635 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:14.626+0000 7fefeffff640 1 -- 172.21.15.78:0/2873223035 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feff00c48c0 con 0x7feff0154f00 2023-11-28T20:00:14.636 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:14.630+0000 7fefeffff640 1 --2- 172.21.15.78:0/2873223035 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7feff0154f00 0x7feff006be20 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7feff008b500 tx=0x7fefe801c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1867651ff6a2f5ef server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:00:14.636 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:14.630+0000 7fefeeffd640 1 -- 172.21.15.78:0/2873223035 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefe80a56f0 con 0x7feff0154f00 2023-11-28T20:00:14.637 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:14.630+0000 7fefeeffd640 1 -- 172.21.15.78:0/2873223035 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fefe80a5850 con 0x7feff0154f00 2023-11-28T20:00:14.637 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:14.630+0000 7fefeeffd640 1 -- 172.21.15.78:0/2873223035 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefe80a5be0 con 0x7feff0154f00 2023-11-28T20:00:14.637 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:14.630+0000 7feff5a79640 1 -- 172.21.15.78:0/2873223035 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7feff0154f00 msgr2=0x7feff006be20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:00:14.638 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:14.630+0000 7feff5a79640 1 --2- 172.21.15.78:0/2873223035 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7feff0154f00 0x7feff006be20 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7feff008b500 tx=0x7fefe801c940 comp rx=0 tx=0).stop 2023-11-28T20:00:14.638 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:14.630+0000 7feff5a79640 1 -- 172.21.15.78:0/2873223035 shutdown_connections 2023-11-28T20:00:14.638 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:14.630+0000 7feff5a79640 1 --2- 172.21.15.78:0/2873223035 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7feff0154f00 0x7feff006be20 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:14.639 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:14.630+0000 7feff5a79640 1 --2- 172.21.15.78:0/2873223035 >> v2:172.21.15.179:3300/0 conn(0x7feff00af4d0 0x7feff00c6840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:14.639 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:14.630+0000 7feff5a79640 1 -- 172.21.15.78:0/2873223035 >> 172.21.15.78:0/2873223035 conn(0x7feff00aba00 msgr2=0x7feff00abe10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:00:14.639 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:14.630+0000 7feff5a79640 1 -- 172.21.15.78:0/2873223035 shutdown_connections 2023-11-28T20:00:14.639 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:14.630+0000 7feff5a79640 1 -- 172.21.15.78:0/2873223035 wait complete. 2023-11-28T20:00:14.641 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:14.634+0000 7feff5a79640 1 Processor -- start 2023-11-28T20:00:14.641 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:14.634+0000 7feff5a79640 1 -- start start 2023-11-28T20:00:14.641 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:14.634+0000 7feff5a79640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7feff00af4d0 0x7feff0150f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:14.641 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:14.634+0000 7feff5a79640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7feff00c6d80 0x7feff014a250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:14.642 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:14.634+0000 7feff5a79640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7feff0154f00 0x7feff014a790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:14.642 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:14.634+0000 7feff5a79640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feff00c3ec0 con 0x7feff0154f00 2023-11-28T20:00:14.642 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:14.634+0000 7feff5a79640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feff00acaf0 con 0x7feff00af4d0 2023-11-28T20:00:14.642 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:14.634+0000 7feff5a79640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feff00acdd0 con 0x7feff00c6d80 2023-11-28T20:00:14.642 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:14.634+0000 7fefeffff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7feff0154f00 0x7feff014a790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:14.642 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:14.634+0000 7fefeffff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7feff0154f00 0x7feff014a790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:36360/0 (socket says 172.21.15.78:36360) 2023-11-28T20:00:14.642 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:14.634+0000 7fefeffff640 1 -- 172.21.15.78:0/2312721658 learned_addr learned my addr 172.21.15.78:0/2312721658 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T20:00:14.642 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:14.634+0000 7fefef7fe640 1 --2- 172.21.15.78:0/2312721658 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7feff00af4d0 0x7feff0150f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:14.642 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:14.634+0000 7fefe7fff640 1 --2- 172.21.15.78:0/2312721658 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7feff00c6d80 0x7feff014a250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:14.642 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:14.634+0000 7fefeffff640 1 -- 172.21.15.78:0/2312721658 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7feff00c6d80 msgr2=0x7feff014a250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:00:14.643 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:14.634+0000 7fefeffff640 1 --2- 172.21.15.78:0/2312721658 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7feff00c6d80 0x7feff014a250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:14.643 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:14.634+0000 7fefeffff640 1 -- 172.21.15.78:0/2312721658 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7feff00af4d0 msgr2=0x7feff0150f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:00:14.643 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:14.634+0000 7fefeffff640 1 --2- 172.21.15.78:0/2312721658 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7feff00af4d0 0x7feff0150f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:14.643 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:14.634+0000 7fefeffff640 1 -- 172.21.15.78:0/2312721658 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fefe8009b30 con 0x7feff0154f00 2023-11-28T20:00:14.643 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:14.634+0000 7fefe7fff640 1 --2- 172.21.15.78:0/2312721658 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7feff00c6d80 0x7feff014a250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T20:00:14.643 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:14.634+0000 7fefeffff640 1 --2- 172.21.15.78:0/2312721658 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7feff0154f00 0x7feff014a790 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7fefe80af040 tx=0x7fefe80196e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:00:14.643 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:14.634+0000 7fefecff9640 1 -- 172.21.15.78:0/2312721658 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefe80b8670 con 0x7feff0154f00 2023-11-28T20:00:14.643 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:14.634+0000 7fefecff9640 1 -- 172.21.15.78:0/2312721658 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fefe80b87d0 con 0x7feff0154f00 2023-11-28T20:00:14.643 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:14.634+0000 7fefecff9640 1 -- 172.21.15.78:0/2312721658 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefe80b8b80 con 0x7feff0154f00 2023-11-28T20:00:14.643 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:14.634+0000 7feff5a79640 1 -- 172.21.15.78:0/2312721658 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feff00c3870 con 0x7feff0154f00 2023-11-28T20:00:14.643 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:14.634+0000 7feff5a79640 1 -- 172.21.15.78:0/2312721658 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feff0151440 con 0x7feff0154f00 2023-11-28T20:00:14.643 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:14.638+0000 7feff5a79640 1 -- 172.21.15.78:0/2312721658 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feff0067630 con 0x7feff0154f00 2023-11-28T20:00:14.644 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:14.638+0000 7fefecff9640 1 -- 172.21.15.78:0/2312721658 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fefe80b8ce0 con 0x7feff0154f00 2023-11-28T20:00:14.645 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:14.638+0000 7fefecff9640 1 --2- 172.21.15.78:0/2312721658 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fefd0066470 0x7fefd0068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:14.645 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:14.638+0000 7fefecff9640 1 -- 172.21.15.78:0/2312721658 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6029+0+0 (secure 0 0 0) 0x7fefe811f450 con 0x7feff0154f00 2023-11-28T20:00:14.645 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:14.638+0000 7fefef7fe640 1 --2- 172.21.15.78:0/2312721658 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fefd0066470 0x7fefd0068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:14.645 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:14.638+0000 7fefef7fe640 1 --2- 172.21.15.78:0/2312721658 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fefd0066470 0x7fefd0068930 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7feff00c7b80 tx=0x7fefe0009190 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:00:14.646 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:14.642+0000 7fefecff9640 1 -- 172.21.15.78:0/2312721658 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fefe80ec8e0 con 0x7feff0154f00 2023-11-28T20:00:14.832 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:14.830+0000 7feff5a79640 1 -- 172.21.15.78:0/2312721658 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7feff006c880 con 0x7feff0154f00 2023-11-28T20:00:15.807 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:15.802+0000 7fefecff9640 1 -- 172.21.15.78:0/2312721658 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v16) v1 ==== 118+0+0 (secure 0 0 0) 0x7fefe8009510 con 0x7feff0154f00 2023-11-28T20:00:15.809 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:15.806+0000 7feff5a79640 1 -- 172.21.15.78:0/2312721658 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fefd0066470 msgr2=0x7fefd0068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:00:15.809 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:15.806+0000 7feff5a79640 1 --2- 172.21.15.78:0/2312721658 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fefd0066470 0x7fefd0068930 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7feff00c7b80 tx=0x7fefe0009190 comp rx=0 tx=0).stop 2023-11-28T20:00:15.810 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:15.806+0000 7feff5a79640 1 -- 172.21.15.78:0/2312721658 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7feff0154f00 msgr2=0x7feff014a790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:00:15.810 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:15.806+0000 7feff5a79640 1 --2- 172.21.15.78:0/2312721658 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7feff0154f00 0x7feff014a790 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7fefe80af040 tx=0x7fefe80196e0 comp rx=0 tx=0).stop 2023-11-28T20:00:15.810 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:15.806+0000 7feff5a79640 1 -- 172.21.15.78:0/2312721658 shutdown_connections 2023-11-28T20:00:15.810 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:15.806+0000 7feff5a79640 1 --2- 172.21.15.78:0/2312721658 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fefd0066470 0x7fefd0068930 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:15.810 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:15.806+0000 7feff5a79640 1 --2- 172.21.15.78:0/2312721658 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7feff00c6d80 0x7feff014a250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:15.810 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:15.806+0000 7feff5a79640 1 --2- 172.21.15.78:0/2312721658 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7feff0154f00 0x7feff014a790 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:15.811 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:15.806+0000 7feff5a79640 1 --2- 172.21.15.78:0/2312721658 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7feff00af4d0 0x7feff0150f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:15.811 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:15.806+0000 7feff5a79640 1 -- 172.21.15.78:0/2312721658 >> 172.21.15.78:0/2312721658 conn(0x7feff00aba00 msgr2=0x7feff00abde0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:00:15.811 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:15.806+0000 7feff5a79640 1 -- 172.21.15.78:0/2312721658 shutdown_connections 2023-11-28T20:00:15.811 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:15.806+0000 7feff5a79640 1 -- 172.21.15.78:0/2312721658 wait complete. 2023-11-28T20:00:15.831 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-11-28T20:00:15.831 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-11-28T20:00:15.973 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:15.970+0000 7fa2f7817640 1 Processor -- start 2023-11-28T20:00:15.974 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:15.970+0000 7fa2f7817640 1 -- start start 2023-11-28T20:00:15.975 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:15.970+0000 7fa2f7817640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa2f00c6030 0x7fa2f00c7cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:15.975 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:15.970+0000 7fa2f7817640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa2f0158780 con 0x7fa2f00c98f0 2023-11-28T20:00:15.975 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:15.970+0000 7fa2f7817640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa2f00c8910 con 0x7fa2f00bf2d0 2023-11-28T20:00:15.975 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:15.970+0000 7fa2f7817640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2f00c0300 con 0x7fa2f00c6030 2023-11-28T20:00:15.975 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:15.970+0000 7fa2f5db4640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7fa2f00c98f0 0x7fa2f00c8200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:56472/0 (socket says 172.21.15.78:56472) 2023-11-28T20:00:15.975 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:15.970+0000 7fa2f5db4640 1 -- 172.21.15.78:0/1986289801 learned_addr learned my addr 172.21.15.78:0/1986289801 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-11-28T20:00:15.977 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:15.970+0000 7fa2f4db2640 1 --2- 172.21.15.78:0/1986289801 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa2f00c6030 0x7fa2f00c7cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:15.977 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:15.970+0000 7fa2e7fff640 1 -- 172.21.15.78:0/1986289801 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1674750905 0 0) 0x7fa2f0158780 con 0x7fa2f00c98f0 2023-11-28T20:00:15.978 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:15.970+0000 7fa2e7fff640 1 -- 172.21.15.78:0/1986289801 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa2dc003530 con 0x7fa2f00c98f0 2023-11-28T20:00:15.978 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:15.974+0000 7fa2e7fff640 1 -- 172.21.15.78:0/1986289801 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 178886528 0 0) 0x7fa2f00c8910 con 0x7fa2f00bf2d0 2023-11-28T20:00:15.978 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:15.974+0000 7fa2e7fff640 1 -- 172.21.15.78:0/1986289801 --> v1:172.21.15.179:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa2f0158780 con 0x7fa2f00bf2d0 2023-11-28T20:00:15.978 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:15.974+0000 7fa2e7fff640 1 -- 172.21.15.78:0/1986289801 <== mon.0 v1:172.21.15.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4023893856 0 0) 0x7fa2dc003530 con 0x7fa2f00c98f0 2023-11-28T20:00:15.978 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:15.974+0000 7fa2e7fff640 1 -- 172.21.15.78:0/1986289801 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa2f00c6030 msgr2=0x7fa2f00c7cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:00:15.978 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:15.974+0000 7fa2e7fff640 1 --2- 172.21.15.78:0/1986289801 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa2f00c6030 0x7fa2f00c7cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:15.978 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:15.974+0000 7fa2e7fff640 1 -- 172.21.15.78:0/1986289801 >> v1:172.21.15.179:6789/0 conn(0x7fa2f00bf2d0 legacy=0x7fa2f0151970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:00:15.978 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:15.974+0000 7fa2e7fff640 1 -- 172.21.15.78:0/1986289801 --> v1:172.21.15.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2f0157b70 con 0x7fa2f00c98f0 2023-11-28T20:00:15.978 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:15.974+0000 7fa2e7fff640 1 -- 172.21.15.78:0/1986289801 <== mon.0 v1:172.21.15.78:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3326804700 0 0) 0x7fa2e8001a00 con 0x7fa2f00c98f0 2023-11-28T20:00:15.978 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:15.974+0000 7fa2e7fff640 1 -- 172.21.15.78:0/1986289801 >> v1:172.21.15.78:6789/0 conn(0x7fa2f00c98f0 legacy=0x7fa2f00c8200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:00:15.978 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:15.974+0000 7fa2e7fff640 1 --2- 172.21.15.78:0/1986289801 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa2dc003b40 0x7fa2dc003f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:15.979 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:15.974+0000 7fa2e7fff640 1 --2- 172.21.15.78:0/1986289801 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa2dc0047d0 0x7fa2dc004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:15.979 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:15.974+0000 7fa2e7fff640 1 --2- 172.21.15.78:0/1986289801 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa2f00c6030 0x7fa2dc005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:15.979 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:15.974+0000 7fa2e7fff640 1 -- 172.21.15.78:0/1986289801 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2dc00ba40 con 0x7fa2dc0047d0 2023-11-28T20:00:15.979 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:15.974+0000 7fa2e7fff640 1 -- 172.21.15.78:0/1986289801 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2dc00bb80 con 0x7fa2dc003b40 2023-11-28T20:00:15.979 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:15.974+0000 7fa2e7fff640 1 -- 172.21.15.78:0/1986289801 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2dc00bd10 con 0x7fa2f00c6030 2023-11-28T20:00:15.979 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:15.974+0000 7fa2f4db2640 1 --2- 172.21.15.78:0/1986289801 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa2dc0047d0 0x7fa2dc004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:15.979 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:15.974+0000 7fa2f5db4640 1 --2- 172.21.15.78:0/1986289801 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa2f00c6030 0x7fa2dc005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:15.979 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:15.974+0000 7fa2f55b3640 1 --2- 172.21.15.78:0/1986289801 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa2dc003b40 0x7fa2dc003f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:15.979 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:15.974+0000 7fa2f4db2640 1 -- 172.21.15.78:0/1986289801 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa2f00c6030 msgr2=0x7fa2dc005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:00:15.979 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:15.974+0000 7fa2f4db2640 1 --2- 172.21.15.78:0/1986289801 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa2f00c6030 0x7fa2dc005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:15.979 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:15.974+0000 7fa2f4db2640 1 -- 172.21.15.78:0/1986289801 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa2dc003b40 msgr2=0x7fa2dc003f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:00:15.979 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:15.974+0000 7fa2f4db2640 1 --2- 172.21.15.78:0/1986289801 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa2dc003b40 0x7fa2dc003f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:15.980 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:15.974+0000 7fa2f4db2640 1 -- 172.21.15.78:0/1986289801 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2dc003530 con 0x7fa2dc0047d0 2023-11-28T20:00:15.980 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:15.974+0000 7fa2f55b3640 1 --2- 172.21.15.78:0/1986289801 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa2dc003b40 0x7fa2dc003f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T20:00:15.981 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:15.978+0000 7fa2f4db2640 1 --2- 172.21.15.78:0/1986289801 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa2dc0047d0 0x7fa2dc004c50 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7fa2e0009ae0 tx=0x7fa2e001c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3767bbf8192cf9d1 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:00:15.981 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:15.978+0000 7fa2e7fff640 1 -- 172.21.15.78:0/1986289801 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2e00a55e0 con 0x7fa2dc0047d0 2023-11-28T20:00:15.981 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:15.978+0000 7fa2e7fff640 1 -- 172.21.15.78:0/1986289801 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa2e00a5740 con 0x7fa2dc0047d0 2023-11-28T20:00:15.981 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:15.978+0000 7fa2e7fff640 1 -- 172.21.15.78:0/1986289801 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2e00a5af0 con 0x7fa2dc0047d0 2023-11-28T20:00:15.981 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:15.978+0000 7fa2f7817640 1 -- 172.21.15.78:0/1986289801 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa2dc0047d0 msgr2=0x7fa2dc004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:00:15.981 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:15.978+0000 7fa2f7817640 1 --2- 172.21.15.78:0/1986289801 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa2dc0047d0 0x7fa2dc004c50 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7fa2e0009ae0 tx=0x7fa2e001c9f0 comp rx=0 tx=0).stop 2023-11-28T20:00:15.981 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:15.978+0000 7fa2f5db4640 1 -- 172.21.15.78:0/1986289801 reap_dead start 2023-11-28T20:00:15.981 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:15.978+0000 7fa2f7817640 1 -- 172.21.15.78:0/1986289801 shutdown_connections 2023-11-28T20:00:15.982 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:15.978+0000 7fa2f7817640 1 -- 172.21.15.78:0/1986289801 >> 172.21.15.78:0/1986289801 conn(0x7fa2f00c9dc0 msgr2=0x7fa2f00ca1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:00:15.982 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:15.978+0000 7fa2f7817640 1 -- 172.21.15.78:0/1986289801 shutdown_connections 2023-11-28T20:00:15.982 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:15.978+0000 7fa2f7817640 1 -- 172.21.15.78:0/1986289801 wait complete. 2023-11-28T20:00:15.982 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:15.978+0000 7fa2f7817640 1 Processor -- start 2023-11-28T20:00:15.982 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:15.978+0000 7fa2f7817640 1 -- start start 2023-11-28T20:00:15.984 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:15.978+0000 7fa2f7817640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa2dc0047d0 0x7fa2f006c540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:15.984 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:15.978+0000 7fa2f7817640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa2f0143cd0 0x7fa2f01433d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:15.984 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:15.978+0000 7fa2f7817640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa2f00accf0 0x7fa2f00ad170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:15.984 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:15.978+0000 7fa2f7817640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2f00afde0 con 0x7fa2f0143cd0 2023-11-28T20:00:15.984 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:15.978+0000 7fa2f7817640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2f01ea020 con 0x7fa2f00accf0 2023-11-28T20:00:15.984 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:15.978+0000 7fa2f7817640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2f01eaff0 con 0x7fa2dc0047d0 2023-11-28T20:00:15.984 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:15.982+0000 7fa2f4db2640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa2f0143cd0 0x7fa2f01433d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:15.985 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:15.982+0000 7fa2f4db2640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa2f0143cd0 0x7fa2f01433d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:52084/0 (socket says 172.21.15.78:52084) 2023-11-28T20:00:15.985 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:15.982+0000 7fa2f4db2640 1 -- 172.21.15.78:0/816979330 learned_addr learned my addr 172.21.15.78:0/816979330 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T20:00:15.985 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:15.982+0000 7fa2f55b3640 1 --2- 172.21.15.78:0/816979330 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa2dc0047d0 0x7fa2f006c540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:15.985 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:15.982+0000 7fa2f5db4640 1 --2- 172.21.15.78:0/816979330 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa2f00accf0 0x7fa2f00ad170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:15.985 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:15.982+0000 7fa2f4db2640 1 -- 172.21.15.78:0/816979330 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa2dc0047d0 msgr2=0x7fa2f006c540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:00:15.985 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:15.982+0000 7fa2f4db2640 1 --2- 172.21.15.78:0/816979330 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa2dc0047d0 0x7fa2f006c540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:15.985 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:15.982+0000 7fa2f4db2640 1 -- 172.21.15.78:0/816979330 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa2f00accf0 msgr2=0x7fa2f00ad170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:00:15.985 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:15.982+0000 7fa2f4db2640 1 --2- 172.21.15.78:0/816979330 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa2f00accf0 0x7fa2f00ad170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:15.985 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:15.982+0000 7fa2f4db2640 1 -- 172.21.15.78:0/816979330 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2f006ca80 con 0x7fa2f0143cd0 2023-11-28T20:00:15.986 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:15.982+0000 7fa2f4db2640 1 --2- 172.21.15.78:0/816979330 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa2f0143cd0 0x7fa2f01433d0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7fa2e00b0040 tx=0x7fa2dc005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:00:15.986 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:15.982+0000 7fa2e5ffb640 1 -- 172.21.15.78:0/816979330 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2e00a55e0 con 0x7fa2f0143cd0 2023-11-28T20:00:15.987 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:15.982+0000 7fa2e5ffb640 1 -- 172.21.15.78:0/816979330 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa2e0004240 con 0x7fa2f0143cd0 2023-11-28T20:00:15.987 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:15.982+0000 7fa2f7817640 1 -- 172.21.15.78:0/816979330 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa2f01ea230 con 0x7fa2f0143cd0 2023-11-28T20:00:15.987 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:15.982+0000 7fa2e5ffb640 1 -- 172.21.15.78:0/816979330 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2e0003620 con 0x7fa2f0143cd0 2023-11-28T20:00:15.987 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:15.982+0000 7fa2f7817640 1 -- 172.21.15.78:0/816979330 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa2f01ea7f0 con 0x7fa2f0143cd0 2023-11-28T20:00:15.987 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:15.982+0000 7fa2f7817640 1 -- 172.21.15.78:0/816979330 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa2f00c5380 con 0x7fa2f0143cd0 2023-11-28T20:00:15.988 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:15.982+0000 7fa2e5ffb640 1 -- 172.21.15.78:0/816979330 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fa2e00b4040 con 0x7fa2f0143cd0 2023-11-28T20:00:15.988 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:15.986+0000 7fa2e5ffb640 1 --2- 172.21.15.78:0/816979330 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fa2d4066470 0x7fa2d4068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:15.988 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:15.986+0000 7fa2e5ffb640 1 -- 172.21.15.78:0/816979330 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6029+0+0 (secure 0 0 0) 0x7fa2e011d810 con 0x7fa2f0143cd0 2023-11-28T20:00:15.988 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:15.986+0000 7fa2f55b3640 1 --2- 172.21.15.78:0/816979330 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fa2d4066470 0x7fa2d4068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:15.988 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:15.986+0000 7fa2f55b3640 1 --2- 172.21.15.78:0/816979330 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fa2d4066470 0x7fa2d4068930 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fa2ec000f70 tx=0x7fa2ec007200 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:00:15.992 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:15.990+0000 7fa2e5ffb640 1 -- 172.21.15.78:0/816979330 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fa2f00c5380 con 0x7fa2f0143cd0 2023-11-28T20:00:16.084 INFO:tasks.ceph.mds.c.smithi078.stderr:2023-11-28T20:00:16.082+0000 7f5a68561640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-11-28T20:00:16.174 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:16.170+0000 7fa2f7817640 1 -- 172.21.15.78:0/816979330 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7fa2f00c5380 con 0x7fa2f0143cd0 2023-11-28T20:00:16.813 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:16.810+0000 7fa2e5ffb640 1 -- 172.21.15.78:0/816979330 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v17) v1 ==== 122+0+0 (secure 0 0 0) 0x7fa2f00c5380 con 0x7fa2f0143cd0 2023-11-28T20:00:16.815 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:16.810+0000 7fa2f7817640 1 -- 172.21.15.78:0/816979330 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fa2d4066470 msgr2=0x7fa2d4068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:00:16.815 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:16.810+0000 7fa2f7817640 1 --2- 172.21.15.78:0/816979330 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fa2d4066470 0x7fa2d4068930 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fa2ec000f70 tx=0x7fa2ec007200 comp rx=0 tx=0).stop 2023-11-28T20:00:16.816 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:16.810+0000 7fa2f7817640 1 -- 172.21.15.78:0/816979330 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa2f0143cd0 msgr2=0x7fa2f01433d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:00:16.816 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:16.810+0000 7fa2f7817640 1 --2- 172.21.15.78:0/816979330 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa2f0143cd0 0x7fa2f01433d0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7fa2e00b0040 tx=0x7fa2dc005800 comp rx=0 tx=0).stop 2023-11-28T20:00:16.816 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:16.810+0000 7fa2f7817640 1 -- 172.21.15.78:0/816979330 shutdown_connections 2023-11-28T20:00:16.816 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:16.810+0000 7fa2f7817640 1 --2- 172.21.15.78:0/816979330 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fa2d4066470 0x7fa2d4068930 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:16.816 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:16.810+0000 7fa2f7817640 1 --2- 172.21.15.78:0/816979330 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa2f00accf0 0x7fa2f00ad170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:16.816 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:16.810+0000 7fa2f7817640 1 --2- 172.21.15.78:0/816979330 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa2f0143cd0 0x7fa2f01433d0 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:16.816 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:16.810+0000 7fa2f7817640 1 --2- 172.21.15.78:0/816979330 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa2dc0047d0 0x7fa2f006c540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:16.816 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:16.810+0000 7fa2f7817640 1 -- 172.21.15.78:0/816979330 >> 172.21.15.78:0/816979330 conn(0x7fa2f00c9dc0 msgr2=0x7fa2f00c67a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:00:16.816 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:16.810+0000 7fa2f7817640 1 -- 172.21.15.78:0/816979330 shutdown_connections 2023-11-28T20:00:16.816 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:16.810+0000 7fa2f7817640 1 -- 172.21.15.78:0/816979330 wait complete. 2023-11-28T20:00:16.835 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-11-28T20:00:16.835 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-28T20:00:16.973 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:16.970+0000 7fd6905e6640 1 Processor -- start 2023-11-28T20:00:16.973 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:16.970+0000 7fd6905e6640 1 -- start start 2023-11-28T20:00:16.975 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:16.970+0000 7fd6905e6640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fd6880af4c0 0x7fd688154f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:16.975 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:16.970+0000 7fd6905e6640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fd68806c100 0x7fd6880c6c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:16.975 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:16.970+0000 7fd6905e6640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd6880c4890 con 0x7fd6880c67d0 2023-11-28T20:00:16.975 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:16.970+0000 7fd6905e6640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd688155460 con 0x7fd6880af4c0 2023-11-28T20:00:16.975 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:16.970+0000 7fd6905e6640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd6880af8a0 con 0x7fd68806c100 2023-11-28T20:00:16.975 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:16.970+0000 7fd68e382640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fd6880af4c0 0x7fd688154f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:16.975 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:16.970+0000 7fd68e382640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fd6880af4c0 0x7fd688154f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:52096/0 (socket says 172.21.15.78:52096) 2023-11-28T20:00:16.975 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:16.970+0000 7fd68e382640 1 -- 172.21.15.78:0/831768911 learned_addr learned my addr 172.21.15.78:0/831768911 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T20:00:16.975 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:16.970+0000 7fd68db81640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7fd6880c67d0 0x7fd68806b9f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:56484/0 (socket says 172.21.15.78:56484) 2023-11-28T20:00:16.976 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:16.970+0000 7fd68eb83640 1 --2- 172.21.15.78:0/831768911 >> v2:172.21.15.179:3300/0 conn(0x7fd68806c100 0x7fd6880c6c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:16.976 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:16.970+0000 7fd68e382640 1 -- 172.21.15.78:0/831768911 >> v2:172.21.15.179:3300/0 conn(0x7fd68806c100 msgr2=0x7fd6880c6c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:00:16.976 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:16.970+0000 7fd68e382640 1 --2- 172.21.15.78:0/831768911 >> v2:172.21.15.179:3300/0 conn(0x7fd68806c100 0x7fd6880c6c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:16.976 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:16.970+0000 7fd68e382640 1 -- 172.21.15.78:0/831768911 >> v1:172.21.15.78:6789/0 conn(0x7fd6880c67d0 legacy=0x7fd68806b9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:00:16.976 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:16.970+0000 7fd68e382640 1 -- 172.21.15.78:0/831768911 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6880c4b30 con 0x7fd6880af4c0 2023-11-28T20:00:16.976 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:16.970+0000 7fd68d380640 1 -- 172.21.15.78:0/831768911 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1484889047 0 0) 0x7fd6880c4890 con 0x7fd6880c67d0 2023-11-28T20:00:16.977 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:16.974+0000 7fd68e382640 1 --2- 172.21.15.78:0/831768911 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd6880af4c0 0x7fd688154f20 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7fd6880c9d90 tx=0x7fd68401c440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f7d5229e3456edab server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:00:16.978 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:16.974+0000 7fd68d380640 1 -- 172.21.15.78:0/831768911 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6840ab640 con 0x7fd6880af4c0 2023-11-28T20:00:16.978 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:16.974+0000 7fd68d380640 1 -- 172.21.15.78:0/831768911 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd6840a7070 con 0x7fd6880af4c0 2023-11-28T20:00:16.978 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:16.974+0000 7fd68d380640 1 -- 172.21.15.78:0/831768911 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6840ab9c0 con 0x7fd6880af4c0 2023-11-28T20:00:16.979 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:16.974+0000 7fd6905e6640 1 -- 172.21.15.78:0/831768911 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd6880af4c0 msgr2=0x7fd688154f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:00:16.979 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:16.974+0000 7fd6905e6640 1 --2- 172.21.15.78:0/831768911 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd6880af4c0 0x7fd688154f20 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7fd6880c9d90 tx=0x7fd68401c440 comp rx=0 tx=0).stop 2023-11-28T20:00:16.979 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:16.974+0000 7fd6905e6640 1 -- 172.21.15.78:0/831768911 shutdown_connections 2023-11-28T20:00:16.979 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:16.974+0000 7fd6905e6640 1 --2- 172.21.15.78:0/831768911 >> v2:172.21.15.179:3300/0 conn(0x7fd68806c100 0x7fd6880c6c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:16.979 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:16.974+0000 7fd6905e6640 1 --2- 172.21.15.78:0/831768911 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd6880af4c0 0x7fd688154f20 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:16.979 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:16.974+0000 7fd6905e6640 1 -- 172.21.15.78:0/831768911 >> 172.21.15.78:0/831768911 conn(0x7fd6880ab9d0 msgr2=0x7fd6880abde0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:00:16.980 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:16.974+0000 7fd6905e6640 1 -- 172.21.15.78:0/831768911 shutdown_connections 2023-11-28T20:00:16.980 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:16.974+0000 7fd6905e6640 1 -- 172.21.15.78:0/831768911 wait complete. 2023-11-28T20:00:16.980 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:16.978+0000 7fd6905e6640 1 Processor -- start 2023-11-28T20:00:16.981 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:16.978+0000 7fd6905e6640 1 -- start start 2023-11-28T20:00:16.983 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:16.978+0000 7fd6905e6640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd68806c100 0x7fd688151580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:16.983 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:16.978+0000 7fd6905e6640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd6880af4c0 0x7fd6880bee20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:16.983 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:16.978+0000 7fd6905e6640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd6880c67d0 0x7fd688157a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:16.983 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:16.978+0000 7fd6905e6640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6880bf7e0 con 0x7fd6880af4c0 2023-11-28T20:00:16.983 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:16.978+0000 7fd6905e6640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6880c04f0 con 0x7fd68806c100 2023-11-28T20:00:16.984 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:16.978+0000 7fd6905e6640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd688151ac0 con 0x7fd6880c67d0 2023-11-28T20:00:16.984 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:16.978+0000 7fd68db81640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd6880af4c0 0x7fd6880bee20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:16.984 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:16.978+0000 7fd68db81640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd6880af4c0 0x7fd6880bee20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:52102/0 (socket says 172.21.15.78:52102) 2023-11-28T20:00:16.984 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:16.978+0000 7fd68db81640 1 -- 172.21.15.78:0/3026861908 learned_addr learned my addr 172.21.15.78:0/3026861908 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T20:00:16.984 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:16.978+0000 7fd68e382640 1 --2- 172.21.15.78:0/3026861908 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd68806c100 0x7fd688151580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:16.984 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:16.978+0000 7fd68eb83640 1 --2- 172.21.15.78:0/3026861908 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd6880c67d0 0x7fd688157a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:16.984 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:16.978+0000 7fd68db81640 1 -- 172.21.15.78:0/3026861908 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd6880c67d0 msgr2=0x7fd688157a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:00:16.984 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:16.978+0000 7fd68db81640 1 --2- 172.21.15.78:0/3026861908 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd6880c67d0 0x7fd688157a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:16.984 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:16.978+0000 7fd68db81640 1 -- 172.21.15.78:0/3026861908 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd68806c100 msgr2=0x7fd688151580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:00:16.984 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:16.978+0000 7fd68db81640 1 --2- 172.21.15.78:0/3026861908 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd68806c100 0x7fd688151580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:16.984 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:16.978+0000 7fd68db81640 1 -- 172.21.15.78:0/3026861908 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6840094d0 con 0x7fd6880af4c0 2023-11-28T20:00:16.984 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:16.978+0000 7fd68db81640 1 --2- 172.21.15.78:0/3026861908 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd6880af4c0 0x7fd6880bee20 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7fd67800c520 tx=0x7fd67800c9e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:00:16.985 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:16.978+0000 7fd67effd640 1 -- 172.21.15.78:0/3026861908 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6780074e0 con 0x7fd6880af4c0 2023-11-28T20:00:16.985 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:16.978+0000 7fd67effd640 1 -- 172.21.15.78:0/3026861908 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd678007640 con 0x7fd6880af4c0 2023-11-28T20:00:16.985 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:16.978+0000 7fd67effd640 1 -- 172.21.15.78:0/3026861908 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6780049f0 con 0x7fd6880af4c0 2023-11-28T20:00:16.985 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:16.978+0000 7fd6905e6640 1 -- 172.21.15.78:0/3026861908 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd6880bf360 con 0x7fd6880af4c0 2023-11-28T20:00:16.985 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:16.978+0000 7fd6905e6640 1 -- 172.21.15.78:0/3026861908 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd6880bfa10 con 0x7fd6880af4c0 2023-11-28T20:00:16.986 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:16.982+0000 7fd6905e6640 1 -- 172.21.15.78:0/3026861908 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd688067630 con 0x7fd6880af4c0 2023-11-28T20:00:16.986 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:16.982+0000 7fd67effd640 1 -- 172.21.15.78:0/3026861908 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fd678004b50 con 0x7fd6880af4c0 2023-11-28T20:00:16.986 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:16.982+0000 7fd67effd640 1 --2- 172.21.15.78:0/3026861908 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fd66c066470 0x7fd66c068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:16.986 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:16.982+0000 7fd67effd640 1 -- 172.21.15.78:0/3026861908 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6029+0+0 (secure 0 0 0) 0x7fd678083100 con 0x7fd6880af4c0 2023-11-28T20:00:16.986 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:16.982+0000 7fd68e382640 1 --2- 172.21.15.78:0/3026861908 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fd66c066470 0x7fd66c068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:16.987 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:16.982+0000 7fd68e382640 1 --2- 172.21.15.78:0/3026861908 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fd66c066470 0x7fd66c068930 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fd6840af000 tx=0x7fd6840a7000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:00:16.991 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:16.986+0000 7fd67effd640 1 -- 172.21.15.78:0/3026861908 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fd678050560 con 0x7fd6880af4c0 2023-11-28T20:00:17.173 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:17.170+0000 7fd6905e6640 1 -- 172.21.15.78:0/3026861908 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd68806c7a0 con 0x7fd6880af4c0 2023-11-28T20:00:17.174 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:17.170+0000 7fd67effd640 1 -- 172.21.15.78:0/3026861908 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) v1 ==== 94+0+4910 (secure 0 0 0) 0x7fd678053b80 con 0x7fd6880af4c0 2023-11-28T20:00:17.174 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-11-28T20:00:17.174 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":17,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4880,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6835/20894428","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6834","nonce":20894428},{"type":"v1","addr":"172.21.15.179:6835","nonce":20894428}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":4886,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6837/666703170","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6835","nonce":666703170},{"type":"v1","addr":"172.21.15.78:6837","nonce":666703170}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":5179,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6833/3446403084","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6832","nonce":3446403084},{"type":"v1","addr":"172.21.15.179:6833","nonce":3446403084}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-28T20:00:13.162273+0000","modified":"2023-11-28T20:00:16.174263+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5185},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5185":{"gid":5185,"name":"c","rank":0,"incarnation":13,"state":"up:active","state_seq":4,"addr":"172.21.15.78:6836/3508383403","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6834","nonce":3508383403},{"type":"v1","addr":"172.21.15.78:6836","nonce":3508383403}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-11-28T20:00:17.175 INFO:teuthology.orchestra.run.smithi078.stderr:dumped fsmap epoch 17 2023-11-28T20:00:17.175 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:17.170+0000 7fd6905e6640 1 -- 172.21.15.78:0/3026861908 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fd66c066470 msgr2=0x7fd66c068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:00:17.176 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:17.170+0000 7fd6905e6640 1 --2- 172.21.15.78:0/3026861908 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fd66c066470 0x7fd66c068930 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fd6840af000 tx=0x7fd6840a7000 comp rx=0 tx=0).stop 2023-11-28T20:00:17.176 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:17.170+0000 7fd6905e6640 1 -- 172.21.15.78:0/3026861908 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd6880af4c0 msgr2=0x7fd6880bee20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:00:17.176 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:17.170+0000 7fd6905e6640 1 --2- 172.21.15.78:0/3026861908 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd6880af4c0 0x7fd6880bee20 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7fd67800c520 tx=0x7fd67800c9e0 comp rx=0 tx=0).stop 2023-11-28T20:00:17.176 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:17.170+0000 7fd6905e6640 1 -- 172.21.15.78:0/3026861908 shutdown_connections 2023-11-28T20:00:17.176 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:17.170+0000 7fd6905e6640 1 --2- 172.21.15.78:0/3026861908 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fd66c066470 0x7fd66c068930 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:17.176 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:17.170+0000 7fd6905e6640 1 --2- 172.21.15.78:0/3026861908 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd6880c67d0 0x7fd688157a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:17.177 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:17.170+0000 7fd6905e6640 1 --2- 172.21.15.78:0/3026861908 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd6880af4c0 0x7fd6880bee20 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:17.177 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:17.170+0000 7fd6905e6640 1 --2- 172.21.15.78:0/3026861908 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd68806c100 0x7fd688151580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:17.177 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:17.170+0000 7fd6905e6640 1 -- 172.21.15.78:0/3026861908 >> 172.21.15.78:0/3026861908 conn(0x7fd6880ab9d0 msgr2=0x7fd688155cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:00:17.177 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:17.170+0000 7fd6905e6640 1 -- 172.21.15.78:0/3026861908 shutdown_connections 2023-11-28T20:00:17.177 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:17.170+0000 7fd6905e6640 1 -- 172.21.15.78:0/3026861908 wait complete. 2023-11-28T20:00:17.194 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-28T20:00:17.331 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:17.326+0000 7f29eefe6640 1 Processor -- start 2023-11-28T20:00:17.345 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:17.326+0000 7f29eefe6640 1 -- start start 2023-11-28T20:00:17.350 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:17.330+0000 7f29eefe6640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f29e814e3f0 0x7f29e80bfce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:17.350 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:17.330+0000 7f29eefe6640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f29e8151690 con 0x7f29e806bef0 2023-11-28T20:00:17.350 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:17.330+0000 7f29eefe6640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f29e8151bc0 con 0x7f29e806c5b0 2023-11-28T20:00:17.350 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:17.330+0000 7f29eefe6640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f29e81518e0 con 0x7f29e814e3f0 2023-11-28T20:00:17.350 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:17.330+0000 7f29ecd82640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f29e814e3f0 0x7f29e80bfce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:17.350 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:17.330+0000 7f29e7fff640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f29e806bef0 0x7f29e80c41f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:56494/0 (socket says 172.21.15.78:56494) 2023-11-28T20:00:17.351 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:17.330+0000 7f29e7fff640 1 -- 172.21.15.78:0/4024259814 learned_addr learned my addr 172.21.15.78:0/4024259814 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-11-28T20:00:17.351 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:17.330+0000 7f29ecd82640 1 -- 172.21.15.78:0/4024259814 >> v1:172.21.15.179:6789/0 conn(0x7f29e806c5b0 legacy=0x7f29e806ca20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:00:17.351 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:17.330+0000 7f29ecd82640 1 -- 172.21.15.78:0/4024259814 >> v1:172.21.15.78:6789/0 conn(0x7f29e806bef0 legacy=0x7f29e80c41f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:00:17.351 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:17.330+0000 7f29ecd82640 1 -- 172.21.15.78:0/4024259814 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29e80c1de0 con 0x7f29e814e3f0 2023-11-28T20:00:17.351 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:17.330+0000 7f29e77fe640 1 -- 172.21.15.78:0/4024259814 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3539316333 0 0) 0x7f29e8151690 con 0x7f29e806bef0 2023-11-28T20:00:17.352 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:17.334+0000 7f29ecd82640 1 --2- 172.21.15.78:0/4024259814 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f29e814e3f0 0x7f29e80bfce0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f29dc0097c0 tx=0x7f29dc01c380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b730304c9ca7e4b5 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:00:17.352 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:17.334+0000 7f29e77fe640 1 -- 172.21.15.78:0/4024259814 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29dc0a4ea0 con 0x7f29e814e3f0 2023-11-28T20:00:17.352 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:17.334+0000 7f29e77fe640 1 -- 172.21.15.78:0/4024259814 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f29dc0a7050 con 0x7f29e814e3f0 2023-11-28T20:00:17.352 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:17.334+0000 7f29e77fe640 1 -- 172.21.15.78:0/4024259814 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29dc0ab820 con 0x7f29e814e3f0 2023-11-28T20:00:17.353 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:17.334+0000 7f29eefe6640 1 -- 172.21.15.78:0/4024259814 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f29e814e3f0 msgr2=0x7f29e80bfce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:00:17.353 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:17.334+0000 7f29eefe6640 1 --2- 172.21.15.78:0/4024259814 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f29e814e3f0 0x7f29e80bfce0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f29dc0097c0 tx=0x7f29dc01c380 comp rx=0 tx=0).stop 2023-11-28T20:00:17.353 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:17.334+0000 7f29eefe6640 1 -- 172.21.15.78:0/4024259814 shutdown_connections 2023-11-28T20:00:17.353 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:17.334+0000 7f29eefe6640 1 --2- 172.21.15.78:0/4024259814 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f29e814e3f0 0x7f29e80bfce0 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:17.353 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:17.334+0000 7f29eefe6640 1 -- 172.21.15.78:0/4024259814 >> 172.21.15.78:0/4024259814 conn(0x7f29e80a7810 msgr2=0x7f29e80a7c20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:00:17.353 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:17.334+0000 7f29eefe6640 1 -- 172.21.15.78:0/4024259814 shutdown_connections 2023-11-28T20:00:17.354 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:17.334+0000 7f29eefe6640 1 -- 172.21.15.78:0/4024259814 wait complete. 2023-11-28T20:00:17.354 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:17.334+0000 7f29eefe6640 1 Processor -- start 2023-11-28T20:00:17.354 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:17.334+0000 7f29eefe6640 1 -- start start 2023-11-28T20:00:17.354 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:17.338+0000 7f29eefe6640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f29e806bef0 0x7f29e8160800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:17.354 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:17.338+0000 7f29eefe6640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f29e806c5b0 0x7f29e8160d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:17.354 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:17.338+0000 7f29eefe6640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f29e814e3f0 0x7f29e813fa50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:17.354 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:17.338+0000 7f29eefe6640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29e8144270 con 0x7f29e814e3f0 2023-11-28T20:00:17.354 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:17.338+0000 7f29eefe6640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29e8144510 con 0x7f29e806bef0 2023-11-28T20:00:17.354 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:17.338+0000 7f29eefe6640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f29e8142af0 con 0x7f29e806c5b0 2023-11-28T20:00:17.355 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:17.338+0000 7f29ed583640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f29e814e3f0 0x7f29e813fa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:17.355 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:17.338+0000 7f29ed583640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f29e814e3f0 0x7f29e813fa50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:52120/0 (socket says 172.21.15.78:52120) 2023-11-28T20:00:17.355 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:17.338+0000 7f29ed583640 1 -- 172.21.15.78:0/90915753 learned_addr learned my addr 172.21.15.78:0/90915753 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T20:00:17.355 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:17.338+0000 7f29ecd82640 1 --2- 172.21.15.78:0/90915753 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f29e806bef0 0x7f29e8160800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:17.355 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:17.338+0000 7f29e7fff640 1 --2- 172.21.15.78:0/90915753 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f29e806c5b0 0x7f29e8160d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:17.355 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:17.338+0000 7f29ed583640 1 -- 172.21.15.78:0/90915753 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f29e806c5b0 msgr2=0x7f29e8160d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:00:17.355 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:17.338+0000 7f29ed583640 1 --2- 172.21.15.78:0/90915753 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f29e806c5b0 0x7f29e8160d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:17.355 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:17.338+0000 7f29ed583640 1 -- 172.21.15.78:0/90915753 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f29e806bef0 msgr2=0x7f29e8160800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:00:17.356 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:17.338+0000 7f29ed583640 1 --2- 172.21.15.78:0/90915753 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f29e806bef0 0x7f29e8160800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:17.356 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:17.338+0000 7f29ed583640 1 -- 172.21.15.78:0/90915753 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29dc009420 con 0x7f29e814e3f0 2023-11-28T20:00:17.356 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:17.338+0000 7f29ed583640 1 --2- 172.21.15.78:0/90915753 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f29e814e3f0 0x7f29e813fa50 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f29e000c780 tx=0x7f29e000cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:00:17.356 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:17.338+0000 7f29e57fa640 1 -- 172.21.15.78:0/90915753 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29e0004b20 con 0x7f29e814e3f0 2023-11-28T20:00:17.356 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:17.338+0000 7f29e57fa640 1 -- 172.21.15.78:0/90915753 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f29e0004c80 con 0x7f29e814e3f0 2023-11-28T20:00:17.356 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:17.338+0000 7f29eefe6640 1 -- 172.21.15.78:0/90915753 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f29e8142dd0 con 0x7f29e814e3f0 2023-11-28T20:00:17.356 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:17.338+0000 7f29e57fa640 1 -- 172.21.15.78:0/90915753 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29e000aa90 con 0x7f29e814e3f0 2023-11-28T20:00:17.356 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:17.338+0000 7f29eefe6640 1 -- 172.21.15.78:0/90915753 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f29e8143640 con 0x7f29e814e3f0 2023-11-28T20:00:17.356 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:17.338+0000 7f29eefe6640 1 -- 172.21.15.78:0/90915753 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f29e8067630 con 0x7f29e814e3f0 2023-11-28T20:00:17.356 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:17.338+0000 7f29e57fa640 1 -- 172.21.15.78:0/90915753 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f29e000abf0 con 0x7f29e814e3f0 2023-11-28T20:00:17.357 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:17.342+0000 7f29e57fa640 1 --2- 172.21.15.78:0/90915753 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f29cc0664a0 0x7f29cc068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:17.357 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:17.342+0000 7f29e57fa640 1 -- 172.21.15.78:0/90915753 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f29e0083ff0 con 0x7f29e814e3f0 2023-11-28T20:00:17.357 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:17.342+0000 7f29ecd82640 1 --2- 172.21.15.78:0/90915753 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f29cc0664a0 0x7f29cc068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:17.357 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:17.342+0000 7f29ecd82640 1 --2- 172.21.15.78:0/90915753 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f29cc0664a0 0x7f29cc068960 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f29dc0ad000 tx=0x7f29dc008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:00:17.357 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:17.342+0000 7f29e57fa640 1 -- 172.21.15.78:0/90915753 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f29e0051310 con 0x7f29e814e3f0 2023-11-28T20:00:17.496 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:17.494+0000 7f29eefe6640 1 -- 172.21.15.78:0/90915753 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f29e80a7d90 con 0x7f29e814e3f0 2023-11-28T20:00:17.498 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:17.494+0000 7f29e57fa640 1 -- 172.21.15.78:0/90915753 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v40) v1 ==== 74+0+16750 (secure 0 0 0) 0x7f29e0054930 con 0x7f29e814e3f0 2023-11-28T20:00:17.498 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-11-28T20:00:17.498 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":40,"fsid":"dd9780e8-3bda-44fa-a9f0-fa07d19d901d","created":"2023-11-28T19:58:40.969556+0000","modified":"2023-11-28T20:00:14.786634+0000","last_up_change":"2023-11-28T19:58:52.596716+0000","last_in_change":"2023-11-28T19:58:43.609275+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-28T19:58:54.011229+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2023-11-28T20:00:10.831194+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"39","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2023-11-28T20:00:12.150184+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"40","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e84245ac-b5da-429e-af18-39acaa2b33e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6800","nonce":3358701235},{"type":"v1","addr":"172.21.15.78:6801","nonce":3358701235}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6802","nonce":3358701235},{"type":"v1","addr":"172.21.15.78:6803","nonce":3358701235}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6806","nonce":3358701235},{"type":"v1","addr":"172.21.15.78:6807","nonce":3358701235}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6804","nonce":3358701235},{"type":"v1","addr":"172.21.15.78:6805","nonce":3358701235}]},"public_addr":"172.21.15.78:6801/3358701235","cluster_addr":"172.21.15.78:6803/3358701235","heartbeat_back_addr":"172.21.15.78:6807/3358701235","heartbeat_front_addr":"172.21.15.78:6805/3358701235","state":["exists","up"]},{"osd":1,"uuid":"e634831d-c4e2-48d9-870c-9556ae162981","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6808","nonce":3211476654},{"type":"v1","addr":"172.21.15.78:6809","nonce":3211476654}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6810","nonce":3211476654},{"type":"v1","addr":"172.21.15.78:6811","nonce":3211476654}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6814","nonce":3211476654},{"type":"v1","addr":"172.21.15.78:6815","nonce":3211476654}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6812","nonce":3211476654},{"type":"v1","addr":"172.21.15.78:6813","nonce":3211476654}]},"public_addr":"172.21.15.78:6809/3211476654","cluster_addr":"172.21.15.78:6811/3211476654","heartbeat_back_addr":"172.21.15.78:6815/3211476654","heartbeat_front_addr":"172.21.15.78:6813/3211476654","state":["exists","up"]},{"osd":2,"uuid":"274c8395-6534-41f0-b8fb-a00af8985aa8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6816","nonce":2532904479},{"type":"v1","addr":"172.21.15.78:6817","nonce":2532904479}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6818","nonce":2532904479},{"type":"v1","addr":"172.21.15.78:6819","nonce":2532904479}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6822","nonce":2532904479},{"type":"v1","addr":"172.21.15.78:6823","nonce":2532904479}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6820","nonce":2532904479},{"type":"v1","addr":"172.21.15.78:6821","nonce":2532904479}]},"public_addr":"172.21.15.78:6817/2532904479","cluster_addr":"172.21.15.78:6819/2532904479","heartbeat_back_addr":"172.21.15.78:6823/2532904479","heartbeat_front_addr":"172.21.15.78:6821/2532904479","state":["exists","up"]},{"osd":3,"uuid":"77acc9af-7d4d-4b18-8cf5-d62f5971b7c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6824","nonce":3442991267},{"type":"v1","addr":"172.21.15.78:6825","nonce":3442991267}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6826","nonce":3442991267},{"type":"v1","addr":"172.21.15.78:6827","nonce":3442991267}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6830","nonce":3442991267},{"type":"v1","addr":"172.21.15.78:6831","nonce":3442991267}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6828","nonce":3442991267},{"type":"v1","addr":"172.21.15.78:6829","nonce":3442991267}]},"public_addr":"172.21.15.78:6825/3442991267","cluster_addr":"172.21.15.78:6827/3442991267","heartbeat_back_addr":"172.21.15.78:6831/3442991267","heartbeat_front_addr":"172.21.15.78:6829/3442991267","state":["exists","up"]},{"osd":4,"uuid":"5c62bc66-6b34-4b7f-a66b-9a743969138c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":802983577},{"type":"v1","addr":"172.21.15.179:6809","nonce":802983577}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":802983577},{"type":"v1","addr":"172.21.15.179:6811","nonce":802983577}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":802983577},{"type":"v1","addr":"172.21.15.179:6815","nonce":802983577}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":802983577},{"type":"v1","addr":"172.21.15.179:6813","nonce":802983577}]},"public_addr":"172.21.15.179:6809/802983577","cluster_addr":"172.21.15.179:6811/802983577","heartbeat_back_addr":"172.21.15.179:6815/802983577","heartbeat_front_addr":"172.21.15.179:6813/802983577","state":["exists","up"]},{"osd":5,"uuid":"67db6d36-f684-4079-b0cd-82b4dd61461f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":518192887},{"type":"v1","addr":"172.21.15.179:6818","nonce":518192887}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":518192887},{"type":"v1","addr":"172.21.15.179:6822","nonce":518192887}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":518192887},{"type":"v1","addr":"172.21.15.179:6829","nonce":518192887}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6824","nonce":518192887},{"type":"v1","addr":"172.21.15.179:6826","nonce":518192887}]},"public_addr":"172.21.15.179:6818/518192887","cluster_addr":"172.21.15.179:6822/518192887","heartbeat_back_addr":"172.21.15.179:6829/518192887","heartbeat_front_addr":"172.21.15.179:6826/518192887","state":["exists","up"]},{"osd":6,"uuid":"12e670af-5a16-4c81-9f97-defa66cab967","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":815435378},{"type":"v1","addr":"172.21.15.179:6801","nonce":815435378}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":815435378},{"type":"v1","addr":"172.21.15.179:6803","nonce":815435378}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":815435378},{"type":"v1","addr":"172.21.15.179:6807","nonce":815435378}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":815435378},{"type":"v1","addr":"172.21.15.179:6805","nonce":815435378}]},"public_addr":"172.21.15.179:6801/815435378","cluster_addr":"172.21.15.179:6803/815435378","heartbeat_back_addr":"172.21.15.179:6807/815435378","heartbeat_front_addr":"172.21.15.179:6805/815435378","state":["exists","up"]},{"osd":7,"uuid":"fe630650-2eb3-49ad-8676-c341e6332eb1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6817","nonce":2848432339},{"type":"v1","addr":"172.21.15.179:6819","nonce":2848432339}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6821","nonce":2848432339},{"type":"v1","addr":"172.21.15.179:6823","nonce":2848432339}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":2848432339},{"type":"v1","addr":"172.21.15.179:6831","nonce":2848432339}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6825","nonce":2848432339},{"type":"v1","addr":"172.21.15.179:6827","nonce":2848432339}]},"public_addr":"172.21.15.179:6819/2848432339","cluster_addr":"172.21.15.179:6823/2848432339","heartbeat_back_addr":"172.21.15.179:6831/2848432339","heartbeat_front_addr":"172.21.15.179:6827/2848432339","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:58:49.255433+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:58:49.412880+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:58:49.559295+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:58:49.245237+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:58:49.184557+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:58:49.329851+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:58:49.366012+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:58:49.349604+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-28T20:00:17.500 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:17.494+0000 7f29eefe6640 1 -- 172.21.15.78:0/90915753 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f29cc0664a0 msgr2=0x7f29cc068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:00:17.500 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:17.494+0000 7f29eefe6640 1 --2- 172.21.15.78:0/90915753 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f29cc0664a0 0x7f29cc068960 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f29dc0ad000 tx=0x7f29dc008040 comp rx=0 tx=0).stop 2023-11-28T20:00:17.500 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:17.494+0000 7f29eefe6640 1 -- 172.21.15.78:0/90915753 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f29e814e3f0 msgr2=0x7f29e813fa50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:00:17.500 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:17.494+0000 7f29eefe6640 1 --2- 172.21.15.78:0/90915753 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f29e814e3f0 0x7f29e813fa50 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f29e000c780 tx=0x7f29e000cc40 comp rx=0 tx=0).stop 2023-11-28T20:00:17.500 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:17.498+0000 7f29eefe6640 1 -- 172.21.15.78:0/90915753 shutdown_connections 2023-11-28T20:00:17.500 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:17.498+0000 7f29eefe6640 1 --2- 172.21.15.78:0/90915753 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f29cc0664a0 0x7f29cc068960 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:17.501 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:17.498+0000 7f29eefe6640 1 --2- 172.21.15.78:0/90915753 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f29e806c5b0 0x7f29e8160d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:17.501 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:17.498+0000 7f29eefe6640 1 --2- 172.21.15.78:0/90915753 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f29e814e3f0 0x7f29e813fa50 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:17.501 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:17.498+0000 7f29eefe6640 1 --2- 172.21.15.78:0/90915753 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f29e806bef0 0x7f29e8160800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:17.501 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:17.498+0000 7f29eefe6640 1 -- 172.21.15.78:0/90915753 >> 172.21.15.78:0/90915753 conn(0x7f29e80a7810 msgr2=0x7f29e80bee90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:00:17.501 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:17.498+0000 7f29eefe6640 1 -- 172.21.15.78:0/90915753 shutdown_connections 2023-11-28T20:00:17.501 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:17.498+0000 7f29eefe6640 1 -- 172.21.15.78:0/90915753 wait complete. 2023-11-28T20:00:17.519 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-11-28T20:00:17.519 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-28T20:00:17.657 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:17.654+0000 7f98c9cad640 1 Processor -- start 2023-11-28T20:00:17.657 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:17.654+0000 7f98c9cad640 1 -- start start 2023-11-28T20:00:17.658 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:17.654+0000 7f98c9cad640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f98c40af4c0 0x7f98c4154f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:17.658 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:17.654+0000 7f98c9cad640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f98c40c67d0 0x7f98c40c6c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:17.658 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:17.654+0000 7f98c9cad640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f98c40c4890 con 0x7f98c406b9f0 2023-11-28T20:00:17.658 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:17.654+0000 7f98c9cad640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f98c4155460 con 0x7f98c40c67d0 2023-11-28T20:00:17.658 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:17.654+0000 7f98c9cad640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f98c40af8a0 con 0x7f98c40af4c0 2023-11-28T20:00:17.659 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:17.654+0000 7f98c2ffd640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f98c40c67d0 0x7f98c40c6c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:17.659 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:17.654+0000 7f98c37fe640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f98c40af4c0 0x7f98c4154f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:17.659 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:17.654+0000 7f98c2ffd640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f98c40c67d0 0x7f98c40c6c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.78:54074/0 (socket says 172.21.15.78:54074) 2023-11-28T20:00:17.659 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:17.654+0000 7f98c2ffd640 1 -- 172.21.15.78:0/754241123 learned_addr learned my addr 172.21.15.78:0/754241123 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T20:00:17.659 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:17.654+0000 7f98c3fff640 1 --1- 172.21.15.78:0/754241123 >> v1:172.21.15.179:6789/0 conn(0x7f98c406b9f0 0x7f98c4157a90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.179:6789/0 says I am v1:172.21.15.78:38110/0 (socket says 172.21.15.78:38110) 2023-11-28T20:00:17.659 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:17.654+0000 7f98c2ffd640 1 -- 172.21.15.78:0/754241123 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f98c40af4c0 msgr2=0x7f98c4154f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:00:17.659 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:17.654+0000 7f98c2ffd640 1 --2- 172.21.15.78:0/754241123 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f98c40af4c0 0x7f98c4154f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:17.659 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:17.654+0000 7f98c2ffd640 1 -- 172.21.15.78:0/754241123 >> v1:172.21.15.179:6789/0 conn(0x7f98c406b9f0 legacy=0x7f98c4157a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:00:17.660 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:17.654+0000 7f98c2ffd640 1 -- 172.21.15.78:0/754241123 --> v2:172.21.15.179:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98c40c4b30 con 0x7f98c40c67d0 2023-11-28T20:00:17.661 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:17.658+0000 7f98c2ffd640 1 --2- 172.21.15.78:0/754241123 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f98c40c67d0 0x7f98c40c6c50 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f98b8009870 tx=0x7f98b801c480 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cdbd6058e10ec841 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:00:17.662 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:17.658+0000 7f98c27fc640 1 -- 172.21.15.78:0/754241123 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98b80ab680 con 0x7f98c40c67d0 2023-11-28T20:00:17.662 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:17.658+0000 7f98c27fc640 1 -- 172.21.15.78:0/754241123 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f98b80ab7e0 con 0x7f98c40c67d0 2023-11-28T20:00:17.662 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:17.658+0000 7f98c27fc640 1 -- 172.21.15.78:0/754241123 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98b80abb70 con 0x7f98c40c67d0 2023-11-28T20:00:17.663 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:17.658+0000 7f98c9cad640 1 -- 172.21.15.78:0/754241123 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f98c40c67d0 msgr2=0x7f98c40c6c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:00:17.663 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:17.658+0000 7f98c9cad640 1 --2- 172.21.15.78:0/754241123 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f98c40c67d0 0x7f98c40c6c50 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f98b8009870 tx=0x7f98b801c480 comp rx=0 tx=0).stop 2023-11-28T20:00:17.663 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:17.658+0000 7f98c9cad640 1 -- 172.21.15.78:0/754241123 shutdown_connections 2023-11-28T20:00:17.663 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:17.658+0000 7f98c9cad640 1 --2- 172.21.15.78:0/754241123 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f98c40c67d0 0x7f98c40c6c50 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:17.664 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:17.658+0000 7f98c9cad640 1 --2- 172.21.15.78:0/754241123 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f98c40af4c0 0x7f98c4154f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:17.664 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:17.658+0000 7f98c9cad640 1 -- 172.21.15.78:0/754241123 >> 172.21.15.78:0/754241123 conn(0x7f98c40ab9d0 msgr2=0x7f98c40abde0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:00:17.664 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:17.658+0000 7f98c9cad640 1 -- 172.21.15.78:0/754241123 shutdown_connections 2023-11-28T20:00:17.664 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:17.658+0000 7f98c9cad640 1 -- 172.21.15.78:0/754241123 wait complete. 2023-11-28T20:00:17.664 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:17.662+0000 7f98c9cad640 1 Processor -- start 2023-11-28T20:00:17.664 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:17.662+0000 7f98c9cad640 1 -- start start 2023-11-28T20:00:17.666 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:17.662+0000 7f98c9cad640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f98c406b9f0 0x7f98c414fe80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:17.666 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:17.662+0000 7f98c9cad640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f98c40af4c0 0x7f98c4152b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:17.666 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:17.662+0000 7f98c9cad640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f98c40c67d0 0x7f98c4149f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:17.666 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:17.662+0000 7f98c9cad640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98c41ed6a0 con 0x7f98c40af4c0 2023-11-28T20:00:17.667 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:17.662+0000 7f98c9cad640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98c4153e60 con 0x7f98c406b9f0 2023-11-28T20:00:17.667 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:17.662+0000 7f98c9cad640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f98c4153380 con 0x7f98c40c67d0 2023-11-28T20:00:17.667 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:17.662+0000 7f98c2ffd640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f98c40af4c0 0x7f98c4152b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:17.667 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:17.662+0000 7f98c2ffd640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f98c40af4c0 0x7f98c4152b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:52136/0 (socket says 172.21.15.78:52136) 2023-11-28T20:00:17.667 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:17.662+0000 7f98c2ffd640 1 -- 172.21.15.78:0/4261940732 learned_addr learned my addr 172.21.15.78:0/4261940732 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T20:00:17.667 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:17.662+0000 7f98c3fff640 1 --2- 172.21.15.78:0/4261940732 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f98c40c67d0 0x7f98c4149f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:17.667 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:17.662+0000 7f98c37fe640 1 --2- 172.21.15.78:0/4261940732 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f98c406b9f0 0x7f98c414fe80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:17.667 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:17.662+0000 7f98c2ffd640 1 -- 172.21.15.78:0/4261940732 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f98c40c67d0 msgr2=0x7f98c4149f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:00:17.667 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:17.662+0000 7f98c2ffd640 1 --2- 172.21.15.78:0/4261940732 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f98c40c67d0 0x7f98c4149f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:17.667 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:17.662+0000 7f98c2ffd640 1 -- 172.21.15.78:0/4261940732 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f98c406b9f0 msgr2=0x7f98c414fe80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:00:17.667 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:17.662+0000 7f98c2ffd640 1 --2- 172.21.15.78:0/4261940732 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f98c406b9f0 0x7f98c414fe80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:17.668 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:17.662+0000 7f98c2ffd640 1 -- 172.21.15.78:0/4261940732 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98b80094d0 con 0x7f98c40af4c0 2023-11-28T20:00:17.668 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:17.662+0000 7f98c2ffd640 1 --2- 172.21.15.78:0/4261940732 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f98c40af4c0 0x7f98c4152b30 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f98b80ad040 tx=0x7f98b8019220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:00:17.669 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:17.662+0000 7f98abfff640 1 -- 172.21.15.78:0/4261940732 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98b80b5810 con 0x7f98c40af4c0 2023-11-28T20:00:17.669 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:17.662+0000 7f98abfff640 1 -- 172.21.15.78:0/4261940732 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f98b80b59b0 con 0x7f98c40af4c0 2023-11-28T20:00:17.669 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:17.662+0000 7f98c9cad640 1 -- 172.21.15.78:0/4261940732 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f98c4153660 con 0x7f98c40af4c0 2023-11-28T20:00:17.669 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:17.662+0000 7f98abfff640 1 -- 172.21.15.78:0/4261940732 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98b80b5d60 con 0x7f98c40af4c0 2023-11-28T20:00:17.669 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:17.662+0000 7f98c9cad640 1 -- 172.21.15.78:0/4261940732 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f98c4153070 con 0x7f98c40af4c0 2023-11-28T20:00:17.669 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:17.666+0000 7f98c9cad640 1 -- 172.21.15.78:0/4261940732 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f98c4067630 con 0x7f98c40af4c0 2023-11-28T20:00:17.669 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:17.666+0000 7f98abfff640 1 -- 172.21.15.78:0/4261940732 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f98b80bf410 con 0x7f98c40af4c0 2023-11-28T20:00:17.670 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:17.666+0000 7f98abfff640 1 --2- 172.21.15.78:0/4261940732 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f98b0066470 0x7f98b0068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:17.670 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:17.666+0000 7f98abfff640 1 -- 172.21.15.78:0/4261940732 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f98b811ef60 con 0x7f98c40af4c0 2023-11-28T20:00:17.670 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:17.666+0000 7f98c37fe640 1 --2- 172.21.15.78:0/4261940732 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f98b0066470 0x7f98b0068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:17.670 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:17.666+0000 7f98c37fe640 1 --2- 172.21.15.78:0/4261940732 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f98b0066470 0x7f98b0068930 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f98c40c4680 tx=0x7f98b4008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:00:17.673 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:17.670+0000 7f98abfff640 1 -- 172.21.15.78:0/4261940732 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f98b80ec310 con 0x7f98c40af4c0 2023-11-28T20:00:17.821 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:17.818+0000 7f98c9cad640 1 -- 172.21.15.78:0/4261940732 --> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f98c406cae0 con 0x7f98b0066470 2023-11-28T20:00:17.829 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:17.826+0000 7f98abfff640 1 -- 172.21.15.78:0/4261940732 <== mgr.4106 v2:172.21.15.78:6832/2935380957 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+283258 (secure 0 0 0) 0x7f98b4011980 con 0x7f98b0066470 2023-11-28T20:00:17.832 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-11-28T20:00:17.833 INFO:teuthology.orchestra.run.smithi078.stderr:dumped all 2023-11-28T20:00:17.835 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:17.830+0000 7f98c9cad640 1 -- 172.21.15.78:0/4261940732 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f98b0066470 msgr2=0x7f98b0068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:00:17.835 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:17.830+0000 7f98c9cad640 1 --2- 172.21.15.78:0/4261940732 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f98b0066470 0x7f98b0068930 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f98c40c4680 tx=0x7f98b4008040 comp rx=0 tx=0).stop 2023-11-28T20:00:17.835 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:17.830+0000 7f98c9cad640 1 -- 172.21.15.78:0/4261940732 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f98c40af4c0 msgr2=0x7f98c4152b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:00:17.836 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:17.830+0000 7f98c9cad640 1 --2- 172.21.15.78:0/4261940732 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f98c40af4c0 0x7f98c4152b30 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f98b80ad040 tx=0x7f98b8019220 comp rx=0 tx=0).stop 2023-11-28T20:00:17.836 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:17.830+0000 7f98c9cad640 1 -- 172.21.15.78:0/4261940732 shutdown_connections 2023-11-28T20:00:17.836 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:17.830+0000 7f98c9cad640 1 --2- 172.21.15.78:0/4261940732 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f98b0066470 0x7f98b0068930 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:17.836 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:17.830+0000 7f98c9cad640 1 --2- 172.21.15.78:0/4261940732 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f98c40c67d0 0x7f98c4149f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:17.837 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:17.830+0000 7f98c9cad640 1 --2- 172.21.15.78:0/4261940732 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f98c40af4c0 0x7f98c4152b30 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:17.837 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:17.830+0000 7f98c9cad640 1 --2- 172.21.15.78:0/4261940732 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f98c406b9f0 0x7f98c414fe80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:17.837 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:17.830+0000 7f98c9cad640 1 -- 172.21.15.78:0/4261940732 >> 172.21.15.78:0/4261940732 conn(0x7f98c40ab9d0 msgr2=0x7f98c4157a90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:00:17.838 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:17.830+0000 7f98c9cad640 1 -- 172.21.15.78:0/4261940732 shutdown_connections 2023-11-28T20:00:17.838 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:17.830+0000 7f98c9cad640 1 -- 172.21.15.78:0/4261940732 wait complete. 2023-11-28T20:00:17.853 INFO:teuthology.orchestra.run.smithi078.stdout:{"pg_ready":true,"pg_map":{"version":75,"stamp":"2023-11-28T20:00:15.968538+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":48,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219616,"kb_used_data":3456,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755104,"statfs":{"total":773094113280,"available":772869226496,"internally_reserved":0,"allocated":3538944,"data_stored":2608512,"data_compressed":66748,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":28,"apply_latency_ms":28,"commit_latency_ns":28000000,"apply_latency_ns":28000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.204097"},"pg_stats":[{"pgid":"6.3f","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2023-11-28T20:00:12.786561+0000","last_change":"2023-11-28T20:00:12.786561+0000","last_active":"2023-11-28T20:00:12.764355+0000","last_peered":"2023-11-28T20:00:12.764355+0000","last_clean":"2023-11-28T20:00:12.764355+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:00:12.786561+0000","last_undegraded":"2023-11-28T20:00:12.786561+0000","last_fullsized":"2023-11-28T20:00:12.786561+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_clean_scrub_stamp":"2023-11-28T20:00:12.764355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2023-11-28T20:00:12.785251+0000","last_change":"2023-11-28T20:00:12.785251+0000","last_active":"2023-11-28T20:00:12.764355+0000","last_peered":"2023-11-28T20:00:12.764355+0000","last_clean":"2023-11-28T20:00:12.764355+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:00:12.785251+0000","last_undegraded":"2023-11-28T20:00:12.785251+0000","last_fullsized":"2023-11-28T20:00:12.785251+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_clean_scrub_stamp":"2023-11-28T20:00:12.764355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2023-11-28T20:00:12.784934+0000","last_change":"2023-11-28T20:00:12.784934+0000","last_active":"2023-11-28T20:00:12.764355+0000","last_peered":"2023-11-28T20:00:12.764355+0000","last_clean":"2023-11-28T20:00:12.764355+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:00:12.784934+0000","last_undegraded":"2023-11-28T20:00:12.784934+0000","last_fullsized":"2023-11-28T20:00:12.784934+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_clean_scrub_stamp":"2023-11-28T20:00:12.764355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.3c","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2023-11-28T20:00:12.786036+0000","last_change":"2023-11-28T20:00:12.786036+0000","last_active":"2023-11-28T20:00:12.764355+0000","last_peered":"2023-11-28T20:00:12.764355+0000","last_clean":"2023-11-28T20:00:12.764355+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:00:12.786036+0000","last_undegraded":"2023-11-28T20:00:12.786036+0000","last_fullsized":"2023-11-28T20:00:12.786036+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_clean_scrub_stamp":"2023-11-28T20:00:12.764355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2023-11-28T20:00:12.786007+0000","last_change":"2023-11-28T20:00:12.786007+0000","last_active":"2023-11-28T20:00:12.764355+0000","last_peered":"2023-11-28T20:00:12.764355+0000","last_clean":"2023-11-28T20:00:12.764355+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:00:12.786007+0000","last_undegraded":"2023-11-28T20:00:12.786007+0000","last_fullsized":"2023-11-28T20:00:12.786007+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_clean_scrub_stamp":"2023-11-28T20:00:12.764355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2023-11-28T20:00:12.784599+0000","last_change":"2023-11-28T20:00:12.784599+0000","last_active":"2023-11-28T20:00:12.764355+0000","last_peered":"2023-11-28T20:00:12.764355+0000","last_clean":"2023-11-28T20:00:12.764355+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:00:12.784599+0000","last_undegraded":"2023-11-28T20:00:12.784599+0000","last_fullsized":"2023-11-28T20:00:12.784599+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_clean_scrub_stamp":"2023-11-28T20:00:12.764355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2023-11-28T20:00:12.788606+0000","last_change":"2023-11-28T20:00:12.788606+0000","last_active":"2023-11-28T20:00:12.764355+0000","last_peered":"2023-11-28T20:00:12.764355+0000","last_clean":"2023-11-28T20:00:12.764355+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:00:12.788606+0000","last_undegraded":"2023-11-28T20:00:12.788606+0000","last_fullsized":"2023-11-28T20:00:12.788606+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_clean_scrub_stamp":"2023-11-28T20:00:12.764355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2023-11-28T20:00:12.782185+0000","last_change":"2023-11-28T20:00:12.782185+0000","last_active":"2023-11-28T20:00:12.764355+0000","last_peered":"2023-11-28T20:00:12.764355+0000","last_clean":"2023-11-28T20:00:12.764355+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:00:12.782185+0000","last_undegraded":"2023-11-28T20:00:12.782185+0000","last_fullsized":"2023-11-28T20:00:12.782185+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_clean_scrub_stamp":"2023-11-28T20:00:12.764355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2023-11-28T20:00:12.784258+0000","last_change":"2023-11-28T20:00:12.784258+0000","last_active":"2023-11-28T20:00:12.764355+0000","last_peered":"2023-11-28T20:00:12.764355+0000","last_clean":"2023-11-28T20:00:12.764355+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:00:12.784258+0000","last_undegraded":"2023-11-28T20:00:12.784258+0000","last_fullsized":"2023-11-28T20:00:12.784258+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_clean_scrub_stamp":"2023-11-28T20:00:12.764355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2023-11-28T20:00:12.796410+0000","last_change":"2023-11-28T20:00:12.796410+0000","last_active":"2023-11-28T20:00:12.764355+0000","last_peered":"2023-11-28T20:00:12.764355+0000","last_clean":"2023-11-28T20:00:12.764355+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:00:12.796410+0000","last_undegraded":"2023-11-28T20:00:12.796410+0000","last_fullsized":"2023-11-28T20:00:12.796410+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_clean_scrub_stamp":"2023-11-28T20:00:12.764355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2023-11-28T20:00:12.795967+0000","last_change":"2023-11-28T20:00:12.795967+0000","last_active":"2023-11-28T20:00:12.764355+0000","last_peered":"2023-11-28T20:00:12.764355+0000","last_clean":"2023-11-28T20:00:12.764355+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:00:12.795967+0000","last_undegraded":"2023-11-28T20:00:12.795967+0000","last_fullsized":"2023-11-28T20:00:12.795967+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_clean_scrub_stamp":"2023-11-28T20:00:12.764355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2023-11-28T20:00:12.784227+0000","last_change":"2023-11-28T20:00:12.784227+0000","last_active":"2023-11-28T20:00:12.764355+0000","last_peered":"2023-11-28T20:00:12.764355+0000","last_clean":"2023-11-28T20:00:12.764355+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:00:12.784227+0000","last_undegraded":"2023-11-28T20:00:12.784227+0000","last_fullsized":"2023-11-28T20:00:12.784227+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_clean_scrub_stamp":"2023-11-28T20:00:12.764355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2023-11-28T20:00:12.789120+0000","last_change":"2023-11-28T20:00:12.789120+0000","last_active":"2023-11-28T20:00:12.764355+0000","last_peered":"2023-11-28T20:00:12.764355+0000","last_clean":"2023-11-28T20:00:12.764355+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:00:12.789120+0000","last_undegraded":"2023-11-28T20:00:12.789120+0000","last_fullsized":"2023-11-28T20:00:12.789120+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_clean_scrub_stamp":"2023-11-28T20:00:12.764355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2023-11-28T20:00:12.783757+0000","last_change":"2023-11-28T20:00:12.783757+0000","last_active":"2023-11-28T20:00:12.764355+0000","last_peered":"2023-11-28T20:00:12.764355+0000","last_clean":"2023-11-28T20:00:12.764355+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:00:12.783757+0000","last_undegraded":"2023-11-28T20:00:12.783757+0000","last_fullsized":"2023-11-28T20:00:12.783757+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_clean_scrub_stamp":"2023-11-28T20:00:12.764355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2023-11-28T20:00:12.788137+0000","last_change":"2023-11-28T20:00:12.788137+0000","last_active":"2023-11-28T20:00:12.764355+0000","last_peered":"2023-11-28T20:00:12.764355+0000","last_clean":"2023-11-28T20:00:12.764355+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:00:12.788137+0000","last_undegraded":"2023-11-28T20:00:12.788137+0000","last_fullsized":"2023-11-28T20:00:12.788137+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_clean_scrub_stamp":"2023-11-28T20:00:12.764355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2023-11-28T20:00:12.786772+0000","last_change":"2023-11-28T20:00:12.786772+0000","last_active":"2023-11-28T20:00:12.764355+0000","last_peered":"2023-11-28T20:00:12.764355+0000","last_clean":"2023-11-28T20:00:12.764355+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:00:12.786772+0000","last_undegraded":"2023-11-28T20:00:12.786772+0000","last_fullsized":"2023-11-28T20:00:12.786772+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_clean_scrub_stamp":"2023-11-28T20:00:12.764355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2023-11-28T20:00:12.785537+0000","last_change":"2023-11-28T20:00:12.785537+0000","last_active":"2023-11-28T20:00:12.764355+0000","last_peered":"2023-11-28T20:00:12.764355+0000","last_clean":"2023-11-28T20:00:12.764355+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:00:12.785537+0000","last_undegraded":"2023-11-28T20:00:12.785537+0000","last_fullsized":"2023-11-28T20:00:12.785537+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_clean_scrub_stamp":"2023-11-28T20:00:12.764355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2023-11-28T20:00:12.778466+0000","last_change":"2023-11-28T20:00:12.778466+0000","last_active":"2023-11-28T20:00:12.764355+0000","last_peered":"2023-11-28T20:00:12.764355+0000","last_clean":"2023-11-28T20:00:12.764355+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:00:12.778466+0000","last_undegraded":"2023-11-28T20:00:12.778466+0000","last_fullsized":"2023-11-28T20:00:12.778466+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_clean_scrub_stamp":"2023-11-28T20:00:12.764355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2023-11-28T20:00:12.785360+0000","last_change":"2023-11-28T20:00:12.785360+0000","last_active":"2023-11-28T20:00:12.764355+0000","last_peered":"2023-11-28T20:00:12.764355+0000","last_clean":"2023-11-28T20:00:12.764355+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:00:12.785360+0000","last_undegraded":"2023-11-28T20:00:12.785360+0000","last_fullsized":"2023-11-28T20:00:12.785360+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_clean_scrub_stamp":"2023-11-28T20:00:12.764355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2023-11-28T20:00:12.779039+0000","last_change":"2023-11-28T20:00:12.779039+0000","last_active":"2023-11-28T20:00:12.764355+0000","last_peered":"2023-11-28T20:00:12.764355+0000","last_clean":"2023-11-28T20:00:12.764355+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:00:12.779039+0000","last_undegraded":"2023-11-28T20:00:12.779039+0000","last_fullsized":"2023-11-28T20:00:12.779039+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_clean_scrub_stamp":"2023-11-28T20:00:12.764355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2023-11-28T20:00:12.786544+0000","last_change":"2023-11-28T20:00:12.786544+0000","last_active":"2023-11-28T20:00:12.764355+0000","last_peered":"2023-11-28T20:00:12.764355+0000","last_clean":"2023-11-28T20:00:12.764355+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:00:12.786544+0000","last_undegraded":"2023-11-28T20:00:12.786544+0000","last_fullsized":"2023-11-28T20:00:12.786544+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_clean_scrub_stamp":"2023-11-28T20:00:12.764355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2023-11-28T20:00:12.782742+0000","last_change":"2023-11-28T20:00:12.782742+0000","last_active":"2023-11-28T20:00:12.764355+0000","last_peered":"2023-11-28T20:00:12.764355+0000","last_clean":"2023-11-28T20:00:12.764355+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:00:12.782742+0000","last_undegraded":"2023-11-28T20:00:12.782742+0000","last_fullsized":"2023-11-28T20:00:12.782742+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_clean_scrub_stamp":"2023-11-28T20:00:12.764355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2023-11-28T20:00:12.786852+0000","last_change":"2023-11-28T20:00:12.786852+0000","last_active":"2023-11-28T20:00:12.764355+0000","last_peered":"2023-11-28T20:00:12.764355+0000","last_clean":"2023-11-28T20:00:12.764355+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:00:12.786852+0000","last_undegraded":"2023-11-28T20:00:12.786852+0000","last_fullsized":"2023-11-28T20:00:12.786852+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_clean_scrub_stamp":"2023-11-28T20:00:12.764355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2023-11-28T20:00:12.778685+0000","last_change":"2023-11-28T20:00:12.778685+0000","last_active":"2023-11-28T20:00:12.764355+0000","last_peered":"2023-11-28T20:00:12.764355+0000","last_clean":"2023-11-28T20:00:12.764355+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:00:12.778685+0000","last_undegraded":"2023-11-28T20:00:12.778685+0000","last_fullsized":"2023-11-28T20:00:12.778685+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_clean_scrub_stamp":"2023-11-28T20:00:12.764355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2023-11-28T20:00:12.778411+0000","last_change":"2023-11-28T20:00:12.778411+0000","last_active":"2023-11-28T20:00:12.764355+0000","last_peered":"2023-11-28T20:00:12.764355+0000","last_clean":"2023-11-28T20:00:12.764355+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:00:12.778411+0000","last_undegraded":"2023-11-28T20:00:12.778411+0000","last_fullsized":"2023-11-28T20:00:12.778411+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_clean_scrub_stamp":"2023-11-28T20:00:12.764355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2023-11-28T20:00:12.784938+0000","last_change":"2023-11-28T20:00:12.784938+0000","last_active":"2023-11-28T20:00:12.764355+0000","last_peered":"2023-11-28T20:00:12.764355+0000","last_clean":"2023-11-28T20:00:12.764355+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:00:12.784938+0000","last_undegraded":"2023-11-28T20:00:12.784938+0000","last_fullsized":"2023-11-28T20:00:12.784938+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_clean_scrub_stamp":"2023-11-28T20:00:12.764355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2023-11-28T20:00:12.777818+0000","last_change":"2023-11-28T20:00:12.777818+0000","last_active":"2023-11-28T20:00:12.764355+0000","last_peered":"2023-11-28T20:00:12.764355+0000","last_clean":"2023-11-28T20:00:12.764355+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:00:12.777818+0000","last_undegraded":"2023-11-28T20:00:12.777818+0000","last_fullsized":"2023-11-28T20:00:12.777818+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_clean_scrub_stamp":"2023-11-28T20:00:12.764355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2023-11-28T20:00:12.787079+0000","last_change":"2023-11-28T20:00:12.787079+0000","last_active":"2023-11-28T20:00:12.764355+0000","last_peered":"2023-11-28T20:00:12.764355+0000","last_clean":"2023-11-28T20:00:12.764355+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:00:12.787079+0000","last_undegraded":"2023-11-28T20:00:12.787079+0000","last_fullsized":"2023-11-28T20:00:12.787079+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_clean_scrub_stamp":"2023-11-28T20:00:12.764355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2023-11-28T20:00:12.779329+0000","last_change":"2023-11-28T20:00:12.779329+0000","last_active":"2023-11-28T20:00:12.764355+0000","last_peered":"2023-11-28T20:00:12.764355+0000","last_clean":"2023-11-28T20:00:12.764355+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:00:12.779329+0000","last_undegraded":"2023-11-28T20:00:12.779329+0000","last_fullsized":"2023-11-28T20:00:12.779329+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_clean_scrub_stamp":"2023-11-28T20:00:12.764355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2023-11-28T20:00:12.778067+0000","last_change":"2023-11-28T20:00:12.778067+0000","last_active":"2023-11-28T20:00:12.764355+0000","last_peered":"2023-11-28T20:00:12.764355+0000","last_clean":"2023-11-28T20:00:12.764355+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:00:12.778067+0000","last_undegraded":"2023-11-28T20:00:12.778067+0000","last_fullsized":"2023-11-28T20:00:12.778067+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_clean_scrub_stamp":"2023-11-28T20:00:12.764355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2023-11-28T20:00:12.785172+0000","last_change":"2023-11-28T20:00:12.785172+0000","last_active":"2023-11-28T20:00:12.764355+0000","last_peered":"2023-11-28T20:00:12.764355+0000","last_clean":"2023-11-28T20:00:12.764355+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:00:12.785172+0000","last_undegraded":"2023-11-28T20:00:12.785172+0000","last_fullsized":"2023-11-28T20:00:12.785172+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_clean_scrub_stamp":"2023-11-28T20:00:12.764355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2023-11-28T20:00:12.783287+0000","last_change":"2023-11-28T20:00:12.783287+0000","last_active":"2023-11-28T20:00:12.764355+0000","last_peered":"2023-11-28T20:00:12.764355+0000","last_clean":"2023-11-28T20:00:12.764355+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:00:12.783287+0000","last_undegraded":"2023-11-28T20:00:12.783287+0000","last_fullsized":"2023-11-28T20:00:12.783287+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_clean_scrub_stamp":"2023-11-28T20:00:12.764355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2023-11-28T20:00:12.784405+0000","last_change":"2023-11-28T20:00:12.784405+0000","last_active":"2023-11-28T20:00:12.764355+0000","last_peered":"2023-11-28T20:00:12.764355+0000","last_clean":"2023-11-28T20:00:12.764355+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:00:12.784405+0000","last_undegraded":"2023-11-28T20:00:12.784405+0000","last_fullsized":"2023-11-28T20:00:12.784405+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_clean_scrub_stamp":"2023-11-28T20:00:12.764355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-28T20:00:12.802099+0000","last_change":"2023-11-28T20:00:12.794933+0000","last_active":"2023-11-28T20:00:12.802099+0000","last_peered":"2023-11-28T20:00:12.802099+0000","last_clean":"2023-11-28T20:00:12.802099+0000","last_became_active":"2023-11-28T20:00:12.794598+0000","last_became_peered":"2023-11-28T20:00:12.794598+0000","last_unstale":"2023-11-28T20:00:12.802099+0000","last_undegraded":"2023-11-28T20:00:12.802099+0000","last_fullsized":"2023-11-28T20:00:12.802099+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:11.760656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:11.760656+0000","last_clean_scrub_stamp":"2023-11-28T20:00:11.760656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:49:36.064771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2023-11-28T20:00:12.785747+0000","last_change":"2023-11-28T20:00:12.785747+0000","last_active":"2023-11-28T20:00:12.764355+0000","last_peered":"2023-11-28T20:00:12.764355+0000","last_clean":"2023-11-28T20:00:12.764355+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:00:12.785747+0000","last_undegraded":"2023-11-28T20:00:12.785747+0000","last_fullsized":"2023-11-28T20:00:12.785747+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_clean_scrub_stamp":"2023-11-28T20:00:12.764355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-28T20:00:12.796674+0000","last_change":"2023-11-28T20:00:12.794372+0000","last_active":"2023-11-28T20:00:12.796674+0000","last_peered":"2023-11-28T20:00:12.796674+0000","last_clean":"2023-11-28T20:00:12.796674+0000","last_became_active":"2023-11-28T20:00:12.794166+0000","last_became_peered":"2023-11-28T20:00:12.794166+0000","last_unstale":"2023-11-28T20:00:12.796674+0000","last_undegraded":"2023-11-28T20:00:12.796674+0000","last_fullsized":"2023-11-28T20:00:12.796674+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:11.760656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:11.760656+0000","last_clean_scrub_stamp":"2023-11-28T20:00:11.760656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:19:33.219723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2023-11-28T20:00:12.782867+0000","last_change":"2023-11-28T20:00:12.782867+0000","last_active":"2023-11-28T20:00:12.764355+0000","last_peered":"2023-11-28T20:00:12.764355+0000","last_clean":"2023-11-28T20:00:12.764355+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:00:12.782867+0000","last_undegraded":"2023-11-28T20:00:12.782867+0000","last_fullsized":"2023-11-28T20:00:12.782867+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_clean_scrub_stamp":"2023-11-28T20:00:12.764355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-28T20:00:12.802319+0000","last_change":"2023-11-28T20:00:12.797247+0000","last_active":"2023-11-28T20:00:12.802319+0000","last_peered":"2023-11-28T20:00:12.802319+0000","last_clean":"2023-11-28T20:00:12.802319+0000","last_became_active":"2023-11-28T20:00:12.797003+0000","last_became_peered":"2023-11-28T20:00:12.797003+0000","last_unstale":"2023-11-28T20:00:12.802319+0000","last_undegraded":"2023-11-28T20:00:12.802319+0000","last_fullsized":"2023-11-28T20:00:12.802319+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:11.760656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:11.760656+0000","last_clean_scrub_stamp":"2023-11-28T20:00:11.760656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:21:43.946565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2023-11-28T20:00:12.786170+0000","last_change":"2023-11-28T20:00:12.786170+0000","last_active":"2023-11-28T20:00:12.764355+0000","last_peered":"2023-11-28T20:00:12.764355+0000","last_clean":"2023-11-28T20:00:12.764355+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:00:12.786170+0000","last_undegraded":"2023-11-28T20:00:12.786170+0000","last_fullsized":"2023-11-28T20:00:12.786170+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_clean_scrub_stamp":"2023-11-28T20:00:12.764355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-28T20:00:12.800895+0000","last_change":"2023-11-28T20:00:12.799178+0000","last_active":"2023-11-28T20:00:12.800895+0000","last_peered":"2023-11-28T20:00:12.800895+0000","last_clean":"2023-11-28T20:00:12.800895+0000","last_became_active":"2023-11-28T20:00:12.798834+0000","last_became_peered":"2023-11-28T20:00:12.798834+0000","last_unstale":"2023-11-28T20:00:12.800895+0000","last_undegraded":"2023-11-28T20:00:12.800895+0000","last_fullsized":"2023-11-28T20:00:12.800895+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:11.760656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:11.760656+0000","last_clean_scrub_stamp":"2023-11-28T20:00:11.760656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:08:56.081544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2023-11-28T20:00:12.782917+0000","last_change":"2023-11-28T20:00:12.782917+0000","last_active":"2023-11-28T20:00:12.764355+0000","last_peered":"2023-11-28T20:00:12.764355+0000","last_clean":"2023-11-28T20:00:12.764355+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:00:12.782917+0000","last_undegraded":"2023-11-28T20:00:12.782917+0000","last_fullsized":"2023-11-28T20:00:12.782917+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_clean_scrub_stamp":"2023-11-28T20:00:12.764355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-28T20:00:12.807652+0000","last_change":"2023-11-28T20:00:12.804157+0000","last_active":"2023-11-28T20:00:12.807652+0000","last_peered":"2023-11-28T20:00:12.807652+0000","last_clean":"2023-11-28T20:00:12.807652+0000","last_became_active":"2023-11-28T20:00:12.803950+0000","last_became_peered":"2023-11-28T20:00:12.803950+0000","last_unstale":"2023-11-28T20:00:12.807652+0000","last_undegraded":"2023-11-28T20:00:12.807652+0000","last_fullsized":"2023-11-28T20:00:12.807652+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:11.760656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:11.760656+0000","last_clean_scrub_stamp":"2023-11-28T20:00:11.760656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:38:54.348106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2023-11-28T20:00:12.787659+0000","last_change":"2023-11-28T20:00:12.787659+0000","last_active":"2023-11-28T20:00:12.764355+0000","last_peered":"2023-11-28T20:00:12.764355+0000","last_clean":"2023-11-28T20:00:12.764355+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:00:12.787659+0000","last_undegraded":"2023-11-28T20:00:12.787659+0000","last_fullsized":"2023-11-28T20:00:12.787659+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_clean_scrub_stamp":"2023-11-28T20:00:12.764355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-28T20:00:12.799490+0000","last_change":"2023-11-28T20:00:12.797188+0000","last_active":"2023-11-28T20:00:12.799490+0000","last_peered":"2023-11-28T20:00:12.799490+0000","last_clean":"2023-11-28T20:00:12.799490+0000","last_became_active":"2023-11-28T20:00:12.796926+0000","last_became_peered":"2023-11-28T20:00:12.796926+0000","last_unstale":"2023-11-28T20:00:12.799490+0000","last_undegraded":"2023-11-28T20:00:12.799490+0000","last_fullsized":"2023-11-28T20:00:12.799490+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:11.760656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:11.760656+0000","last_clean_scrub_stamp":"2023-11-28T20:00:11.760656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:19:33.219723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2023-11-28T20:00:12.782226+0000","last_change":"2023-11-28T20:00:12.782226+0000","last_active":"2023-11-28T20:00:12.764355+0000","last_peered":"2023-11-28T20:00:12.764355+0000","last_clean":"2023-11-28T20:00:12.764355+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:00:12.782226+0000","last_undegraded":"2023-11-28T20:00:12.782226+0000","last_fullsized":"2023-11-28T20:00:12.782226+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_clean_scrub_stamp":"2023-11-28T20:00:12.764355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-28T20:00:12.809928+0000","last_change":"2023-11-28T20:00:12.805374+0000","last_active":"2023-11-28T20:00:12.809928+0000","last_peered":"2023-11-28T20:00:12.809928+0000","last_clean":"2023-11-28T20:00:12.809928+0000","last_became_active":"2023-11-28T20:00:12.805094+0000","last_became_peered":"2023-11-28T20:00:12.805094+0000","last_unstale":"2023-11-28T20:00:12.809928+0000","last_undegraded":"2023-11-28T20:00:12.809928+0000","last_fullsized":"2023-11-28T20:00:12.809928+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:11.760656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:11.760656+0000","last_clean_scrub_stamp":"2023-11-28T20:00:11.760656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:09:51.354913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2023-11-28T20:00:12.785875+0000","last_change":"2023-11-28T20:00:12.785875+0000","last_active":"2023-11-28T20:00:12.764355+0000","last_peered":"2023-11-28T20:00:12.764355+0000","last_clean":"2023-11-28T20:00:12.764355+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:00:12.785875+0000","last_undegraded":"2023-11-28T20:00:12.785875+0000","last_fullsized":"2023-11-28T20:00:12.785875+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_clean_scrub_stamp":"2023-11-28T20:00:12.764355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-28T20:00:12.799056+0000","last_change":"2023-11-28T20:00:12.797265+0000","last_active":"2023-11-28T20:00:12.799056+0000","last_peered":"2023-11-28T20:00:12.799056+0000","last_clean":"2023-11-28T20:00:12.799056+0000","last_became_active":"2023-11-28T20:00:12.794418+0000","last_became_peered":"2023-11-28T20:00:12.794418+0000","last_unstale":"2023-11-28T20:00:12.799056+0000","last_undegraded":"2023-11-28T20:00:12.799056+0000","last_fullsized":"2023-11-28T20:00:12.799056+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:11.760656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:11.760656+0000","last_clean_scrub_stamp":"2023-11-28T20:00:11.760656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:05:35.913865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2023-11-28T20:00:12.777621+0000","last_change":"2023-11-28T20:00:12.777621+0000","last_active":"2023-11-28T20:00:12.764355+0000","last_peered":"2023-11-28T20:00:12.764355+0000","last_clean":"2023-11-28T20:00:12.764355+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:00:12.777621+0000","last_undegraded":"2023-11-28T20:00:12.777621+0000","last_fullsized":"2023-11-28T20:00:12.777621+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_clean_scrub_stamp":"2023-11-28T20:00:12.764355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-28T20:00:12.802016+0000","last_change":"2023-11-28T20:00:12.796227+0000","last_active":"2023-11-28T20:00:12.802016+0000","last_peered":"2023-11-28T20:00:12.802016+0000","last_clean":"2023-11-28T20:00:12.802016+0000","last_became_active":"2023-11-28T20:00:12.795944+0000","last_became_peered":"2023-11-28T20:00:12.795944+0000","last_unstale":"2023-11-28T20:00:12.802016+0000","last_undegraded":"2023-11-28T20:00:12.802016+0000","last_fullsized":"2023-11-28T20:00:12.802016+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:11.760656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:11.760656+0000","last_clean_scrub_stamp":"2023-11-28T20:00:11.760656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:31:39.960893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2023-11-28T20:00:12.785784+0000","last_change":"2023-11-28T20:00:12.785784+0000","last_active":"2023-11-28T20:00:12.764355+0000","last_peered":"2023-11-28T20:00:12.764355+0000","last_clean":"2023-11-28T20:00:12.764355+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:00:12.785784+0000","last_undegraded":"2023-11-28T20:00:12.785784+0000","last_fullsized":"2023-11-28T20:00:12.785784+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_clean_scrub_stamp":"2023-11-28T20:00:12.764355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-28T20:00:12.807231+0000","last_change":"2023-11-28T20:00:12.803866+0000","last_active":"2023-11-28T20:00:12.807231+0000","last_peered":"2023-11-28T20:00:12.807231+0000","last_clean":"2023-11-28T20:00:12.807231+0000","last_became_active":"2023-11-28T20:00:12.803431+0000","last_became_peered":"2023-11-28T20:00:12.803431+0000","last_unstale":"2023-11-28T20:00:12.807231+0000","last_undegraded":"2023-11-28T20:00:12.807231+0000","last_fullsized":"2023-11-28T20:00:12.807231+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:11.760656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:11.760656+0000","last_clean_scrub_stamp":"2023-11-28T20:00:11.760656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:39:04.449924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2023-11-28T20:00:12.782260+0000","last_change":"2023-11-28T20:00:12.782260+0000","last_active":"2023-11-28T20:00:12.764355+0000","last_peered":"2023-11-28T20:00:12.764355+0000","last_clean":"2023-11-28T20:00:12.764355+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:00:12.782260+0000","last_undegraded":"2023-11-28T20:00:12.782260+0000","last_fullsized":"2023-11-28T20:00:12.782260+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_clean_scrub_stamp":"2023-11-28T20:00:12.764355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-28T20:00:12.807316+0000","last_change":"2023-11-28T20:00:12.804096+0000","last_active":"2023-11-28T20:00:12.807316+0000","last_peered":"2023-11-28T20:00:12.807316+0000","last_clean":"2023-11-28T20:00:12.807316+0000","last_became_active":"2023-11-28T20:00:12.803797+0000","last_became_peered":"2023-11-28T20:00:12.803797+0000","last_unstale":"2023-11-28T20:00:12.807316+0000","last_undegraded":"2023-11-28T20:00:12.807316+0000","last_fullsized":"2023-11-28T20:00:12.807316+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:11.760656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:11.760656+0000","last_clean_scrub_stamp":"2023-11-28T20:00:11.760656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:22:32.210725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2023-11-28T20:00:12.783554+0000","last_change":"2023-11-28T20:00:12.783554+0000","last_active":"2023-11-28T20:00:12.764355+0000","last_peered":"2023-11-28T20:00:12.764355+0000","last_clean":"2023-11-28T20:00:12.764355+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:00:12.783554+0000","last_undegraded":"2023-11-28T20:00:12.783554+0000","last_fullsized":"2023-11-28T20:00:12.783554+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_clean_scrub_stamp":"2023-11-28T20:00:12.764355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-28T20:00:12.802061+0000","last_change":"2023-11-28T20:00:12.797894+0000","last_active":"2023-11-28T20:00:12.802061+0000","last_peered":"2023-11-28T20:00:12.802061+0000","last_clean":"2023-11-28T20:00:12.802061+0000","last_became_active":"2023-11-28T20:00:12.797594+0000","last_became_peered":"2023-11-28T20:00:12.797594+0000","last_unstale":"2023-11-28T20:00:12.802061+0000","last_undegraded":"2023-11-28T20:00:12.802061+0000","last_fullsized":"2023-11-28T20:00:12.802061+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:11.760656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:11.760656+0000","last_clean_scrub_stamp":"2023-11-28T20:00:11.760656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:18:17.461220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2023-11-28T20:00:12.782220+0000","last_change":"2023-11-28T20:00:12.782220+0000","last_active":"2023-11-28T20:00:12.764355+0000","last_peered":"2023-11-28T20:00:12.764355+0000","last_clean":"2023-11-28T20:00:12.764355+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:00:12.782220+0000","last_undegraded":"2023-11-28T20:00:12.782220+0000","last_fullsized":"2023-11-28T20:00:12.782220+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_clean_scrub_stamp":"2023-11-28T20:00:12.764355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-28T20:00:12.801117+0000","last_change":"2023-11-28T20:00:12.794915+0000","last_active":"2023-11-28T20:00:12.801117+0000","last_peered":"2023-11-28T20:00:12.801117+0000","last_clean":"2023-11-28T20:00:12.801117+0000","last_became_active":"2023-11-28T20:00:12.793728+0000","last_became_peered":"2023-11-28T20:00:12.793728+0000","last_unstale":"2023-11-28T20:00:12.801117+0000","last_undegraded":"2023-11-28T20:00:12.801117+0000","last_fullsized":"2023-11-28T20:00:12.801117+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:11.760656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:11.760656+0000","last_clean_scrub_stamp":"2023-11-28T20:00:11.760656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:30:40.433274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2023-11-28T20:00:12.783042+0000","last_change":"2023-11-28T20:00:12.783042+0000","last_active":"2023-11-28T20:00:12.764355+0000","last_peered":"2023-11-28T20:00:12.764355+0000","last_clean":"2023-11-28T20:00:12.764355+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:00:12.783042+0000","last_undegraded":"2023-11-28T20:00:12.783042+0000","last_fullsized":"2023-11-28T20:00:12.783042+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_clean_scrub_stamp":"2023-11-28T20:00:12.764355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-28T20:00:12.809921+0000","last_change":"2023-11-28T20:00:12.805313+0000","last_active":"2023-11-28T20:00:12.809921+0000","last_peered":"2023-11-28T20:00:12.809921+0000","last_clean":"2023-11-28T20:00:12.809921+0000","last_became_active":"2023-11-28T20:00:12.804998+0000","last_became_peered":"2023-11-28T20:00:12.804998+0000","last_unstale":"2023-11-28T20:00:12.809921+0000","last_undegraded":"2023-11-28T20:00:12.809921+0000","last_fullsized":"2023-11-28T20:00:12.809921+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:11.760656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:11.760656+0000","last_clean_scrub_stamp":"2023-11-28T20:00:11.760656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:55:34.737227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2023-11-28T20:00:12.784155+0000","last_change":"2023-11-28T20:00:12.784155+0000","last_active":"2023-11-28T20:00:12.764355+0000","last_peered":"2023-11-28T20:00:12.764355+0000","last_clean":"2023-11-28T20:00:12.764355+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:00:12.784155+0000","last_undegraded":"2023-11-28T20:00:12.784155+0000","last_fullsized":"2023-11-28T20:00:12.784155+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_clean_scrub_stamp":"2023-11-28T20:00:12.764355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-28T20:00:12.792278+0000","last_change":"2023-11-28T20:00:12.789146+0000","last_active":"2023-11-28T20:00:12.792278+0000","last_peered":"2023-11-28T20:00:12.792278+0000","last_clean":"2023-11-28T20:00:12.792278+0000","last_became_active":"2023-11-28T20:00:12.788447+0000","last_became_peered":"2023-11-28T20:00:12.788447+0000","last_unstale":"2023-11-28T20:00:12.792278+0000","last_undegraded":"2023-11-28T20:00:12.792278+0000","last_fullsized":"2023-11-28T20:00:12.792278+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:11.760656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:11.760656+0000","last_clean_scrub_stamp":"2023-11-28T20:00:11.760656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:51:42.810996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2023-11-28T20:00:12.784798+0000","last_change":"2023-11-28T20:00:12.784798+0000","last_active":"2023-11-28T20:00:12.764355+0000","last_peered":"2023-11-28T20:00:12.764355+0000","last_clean":"2023-11-28T20:00:12.764355+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:00:12.784798+0000","last_undegraded":"2023-11-28T20:00:12.784798+0000","last_fullsized":"2023-11-28T20:00:12.784798+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_clean_scrub_stamp":"2023-11-28T20:00:12.764355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-28T20:00:12.800818+0000","last_change":"2023-11-28T20:00:12.799040+0000","last_active":"2023-11-28T20:00:12.800818+0000","last_peered":"2023-11-28T20:00:12.800818+0000","last_clean":"2023-11-28T20:00:12.800818+0000","last_became_active":"2023-11-28T20:00:12.798730+0000","last_became_peered":"2023-11-28T20:00:12.798730+0000","last_unstale":"2023-11-28T20:00:12.800818+0000","last_undegraded":"2023-11-28T20:00:12.800818+0000","last_fullsized":"2023-11-28T20:00:12.800818+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:11.760656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:11.760656+0000","last_clean_scrub_stamp":"2023-11-28T20:00:11.760656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T06:41:49.723414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2023-11-28T20:00:12.786939+0000","last_change":"2023-11-28T20:00:12.786939+0000","last_active":"2023-11-28T20:00:12.764355+0000","last_peered":"2023-11-28T20:00:12.764355+0000","last_clean":"2023-11-28T20:00:12.764355+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:00:12.786939+0000","last_undegraded":"2023-11-28T20:00:12.786939+0000","last_fullsized":"2023-11-28T20:00:12.786939+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_clean_scrub_stamp":"2023-11-28T20:00:12.764355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-28T20:00:12.807215+0000","last_change":"2023-11-28T20:00:12.803142+0000","last_active":"2023-11-28T20:00:12.807215+0000","last_peered":"2023-11-28T20:00:12.807215+0000","last_clean":"2023-11-28T20:00:12.807215+0000","last_became_active":"2023-11-28T20:00:12.802775+0000","last_became_peered":"2023-11-28T20:00:12.802775+0000","last_unstale":"2023-11-28T20:00:12.807215+0000","last_undegraded":"2023-11-28T20:00:12.807215+0000","last_fullsized":"2023-11-28T20:00:12.807215+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:11.760656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:11.760656+0000","last_clean_scrub_stamp":"2023-11-28T20:00:11.760656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:31:56.988459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2023-11-28T20:00:12.793965+0000","last_change":"2023-11-28T20:00:12.793965+0000","last_active":"2023-11-28T20:00:12.764355+0000","last_peered":"2023-11-28T20:00:12.764355+0000","last_clean":"2023-11-28T20:00:12.764355+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:00:12.793965+0000","last_undegraded":"2023-11-28T20:00:12.793965+0000","last_fullsized":"2023-11-28T20:00:12.793965+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_clean_scrub_stamp":"2023-11-28T20:00:12.764355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-28T20:00:12.807286+0000","last_change":"2023-11-28T20:00:12.806331+0000","last_active":"2023-11-28T20:00:12.807286+0000","last_peered":"2023-11-28T20:00:12.807286+0000","last_clean":"2023-11-28T20:00:12.807286+0000","last_became_active":"2023-11-28T20:00:12.805857+0000","last_became_peered":"2023-11-28T20:00:12.805857+0000","last_unstale":"2023-11-28T20:00:12.807286+0000","last_undegraded":"2023-11-28T20:00:12.807286+0000","last_fullsized":"2023-11-28T20:00:12.807286+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:11.760656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:11.760656+0000","last_clean_scrub_stamp":"2023-11-28T20:00:11.760656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:07:27.330964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2023-11-28T20:00:12.783371+0000","last_change":"2023-11-28T20:00:12.783371+0000","last_active":"2023-11-28T20:00:12.764355+0000","last_peered":"2023-11-28T20:00:12.764355+0000","last_clean":"2023-11-28T20:00:12.764355+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:00:12.783371+0000","last_undegraded":"2023-11-28T20:00:12.783371+0000","last_fullsized":"2023-11-28T20:00:12.783371+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_clean_scrub_stamp":"2023-11-28T20:00:12.764355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-28T20:00:12.802514+0000","last_change":"2023-11-28T20:00:12.796923+0000","last_active":"2023-11-28T20:00:12.802514+0000","last_peered":"2023-11-28T20:00:12.802514+0000","last_clean":"2023-11-28T20:00:12.802514+0000","last_became_active":"2023-11-28T20:00:12.796625+0000","last_became_peered":"2023-11-28T20:00:12.796625+0000","last_unstale":"2023-11-28T20:00:12.802514+0000","last_undegraded":"2023-11-28T20:00:12.802514+0000","last_fullsized":"2023-11-28T20:00:12.802514+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:11.760656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:11.760656+0000","last_clean_scrub_stamp":"2023-11-28T20:00:11.760656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:48:42.030591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2023-11-28T20:00:12.782363+0000","last_change":"2023-11-28T20:00:12.782363+0000","last_active":"2023-11-28T20:00:12.764355+0000","last_peered":"2023-11-28T20:00:12.764355+0000","last_clean":"2023-11-28T20:00:12.764355+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:00:12.782363+0000","last_undegraded":"2023-11-28T20:00:12.782363+0000","last_fullsized":"2023-11-28T20:00:12.782363+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_clean_scrub_stamp":"2023-11-28T20:00:12.764355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-28T20:00:12.801643+0000","last_change":"2023-11-28T20:00:12.796705+0000","last_active":"2023-11-28T20:00:12.801643+0000","last_peered":"2023-11-28T20:00:12.801643+0000","last_clean":"2023-11-28T20:00:12.801643+0000","last_became_active":"2023-11-28T20:00:12.796394+0000","last_became_peered":"2023-11-28T20:00:12.796394+0000","last_unstale":"2023-11-28T20:00:12.801643+0000","last_undegraded":"2023-11-28T20:00:12.801643+0000","last_fullsized":"2023-11-28T20:00:12.801643+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:11.760656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:11.760656+0000","last_clean_scrub_stamp":"2023-11-28T20:00:11.760656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T06:41:49.723414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2023-11-28T20:00:12.785552+0000","last_change":"2023-11-28T20:00:12.785552+0000","last_active":"2023-11-28T20:00:12.764355+0000","last_peered":"2023-11-28T20:00:12.764355+0000","last_clean":"2023-11-28T20:00:12.764355+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:00:12.785552+0000","last_undegraded":"2023-11-28T20:00:12.785552+0000","last_fullsized":"2023-11-28T20:00:12.785552+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_clean_scrub_stamp":"2023-11-28T20:00:12.764355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-28T20:00:12.791923+0000","last_change":"2023-11-28T20:00:12.787168+0000","last_active":"2023-11-28T20:00:12.791923+0000","last_peered":"2023-11-28T20:00:12.791923+0000","last_clean":"2023-11-28T20:00:12.791923+0000","last_became_active":"2023-11-28T20:00:12.786815+0000","last_became_peered":"2023-11-28T20:00:12.786815+0000","last_unstale":"2023-11-28T20:00:12.791923+0000","last_undegraded":"2023-11-28T20:00:12.791923+0000","last_fullsized":"2023-11-28T20:00:12.791923+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:11.760656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:11.760656+0000","last_clean_scrub_stamp":"2023-11-28T20:00:11.760656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T06:48:23.539826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2023-11-28T20:00:12.779217+0000","last_change":"2023-11-28T20:00:12.779217+0000","last_active":"2023-11-28T20:00:12.764355+0000","last_peered":"2023-11-28T20:00:12.764355+0000","last_clean":"2023-11-28T20:00:12.764355+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:00:12.779217+0000","last_undegraded":"2023-11-28T20:00:12.779217+0000","last_fullsized":"2023-11-28T20:00:12.779217+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_clean_scrub_stamp":"2023-11-28T20:00:12.764355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-28T20:00:12.792018+0000","last_change":"2023-11-28T20:00:12.789615+0000","last_active":"2023-11-28T20:00:12.792018+0000","last_peered":"2023-11-28T20:00:12.792018+0000","last_clean":"2023-11-28T20:00:12.792018+0000","last_became_active":"2023-11-28T20:00:12.789357+0000","last_became_peered":"2023-11-28T20:00:12.789357+0000","last_unstale":"2023-11-28T20:00:12.792018+0000","last_undegraded":"2023-11-28T20:00:12.792018+0000","last_fullsized":"2023-11-28T20:00:12.792018+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:11.760656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:11.760656+0000","last_clean_scrub_stamp":"2023-11-28T20:00:11.760656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:51:47.744006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2023-11-28T20:00:12.787340+0000","last_change":"2023-11-28T20:00:12.787340+0000","last_active":"2023-11-28T20:00:12.764355+0000","last_peered":"2023-11-28T20:00:12.764355+0000","last_clean":"2023-11-28T20:00:12.764355+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:00:12.787340+0000","last_undegraded":"2023-11-28T20:00:12.787340+0000","last_fullsized":"2023-11-28T20:00:12.787340+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_clean_scrub_stamp":"2023-11-28T20:00:12.764355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-28T20:00:12.797956+0000","last_change":"2023-11-28T20:00:12.794799+0000","last_active":"2023-11-28T20:00:12.797956+0000","last_peered":"2023-11-28T20:00:12.797956+0000","last_clean":"2023-11-28T20:00:12.797956+0000","last_became_active":"2023-11-28T20:00:12.794535+0000","last_became_peered":"2023-11-28T20:00:12.794535+0000","last_unstale":"2023-11-28T20:00:12.797956+0000","last_undegraded":"2023-11-28T20:00:12.797956+0000","last_fullsized":"2023-11-28T20:00:12.797956+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:11.760656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:11.760656+0000","last_clean_scrub_stamp":"2023-11-28T20:00:11.760656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:21:43.946565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2023-11-28T20:00:12.783254+0000","last_change":"2023-11-28T20:00:12.783254+0000","last_active":"2023-11-28T20:00:12.764355+0000","last_peered":"2023-11-28T20:00:12.764355+0000","last_clean":"2023-11-28T20:00:12.764355+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:00:12.783254+0000","last_undegraded":"2023-11-28T20:00:12.783254+0000","last_fullsized":"2023-11-28T20:00:12.783254+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_clean_scrub_stamp":"2023-11-28T20:00:12.764355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-28T20:00:12.791952+0000","last_change":"2023-11-28T20:00:12.787505+0000","last_active":"2023-11-28T20:00:12.791952+0000","last_peered":"2023-11-28T20:00:12.791952+0000","last_clean":"2023-11-28T20:00:12.791952+0000","last_became_active":"2023-11-28T20:00:12.786509+0000","last_became_peered":"2023-11-28T20:00:12.786509+0000","last_unstale":"2023-11-28T20:00:12.791952+0000","last_undegraded":"2023-11-28T20:00:12.791952+0000","last_fullsized":"2023-11-28T20:00:12.791952+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:11.760656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:11.760656+0000","last_clean_scrub_stamp":"2023-11-28T20:00:11.760656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:35:56.918733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2023-11-28T20:00:12.786470+0000","last_change":"2023-11-28T20:00:12.786470+0000","last_active":"2023-11-28T20:00:12.764355+0000","last_peered":"2023-11-28T20:00:12.764355+0000","last_clean":"2023-11-28T20:00:12.764355+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:00:12.786470+0000","last_undegraded":"2023-11-28T20:00:12.786470+0000","last_fullsized":"2023-11-28T20:00:12.786470+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_clean_scrub_stamp":"2023-11-28T20:00:12.764355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-28T20:00:12.807677+0000","last_change":"2023-11-28T20:00:12.804126+0000","last_active":"2023-11-28T20:00:12.807677+0000","last_peered":"2023-11-28T20:00:12.807677+0000","last_clean":"2023-11-28T20:00:12.807677+0000","last_became_active":"2023-11-28T20:00:12.803815+0000","last_became_peered":"2023-11-28T20:00:12.803815+0000","last_unstale":"2023-11-28T20:00:12.807677+0000","last_undegraded":"2023-11-28T20:00:12.807677+0000","last_fullsized":"2023-11-28T20:00:12.807677+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:11.760656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:11.760656+0000","last_clean_scrub_stamp":"2023-11-28T20:00:11.760656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T07:54:02.325947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2023-11-28T20:00:12.785219+0000","last_change":"2023-11-28T20:00:12.785219+0000","last_active":"2023-11-28T20:00:12.764355+0000","last_peered":"2023-11-28T20:00:12.764355+0000","last_clean":"2023-11-28T20:00:12.764355+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:00:12.785219+0000","last_undegraded":"2023-11-28T20:00:12.785219+0000","last_fullsized":"2023-11-28T20:00:12.785219+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_clean_scrub_stamp":"2023-11-28T20:00:12.764355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-28T20:00:12.807159+0000","last_change":"2023-11-28T20:00:12.804114+0000","last_active":"2023-11-28T20:00:12.807159+0000","last_peered":"2023-11-28T20:00:12.807159+0000","last_clean":"2023-11-28T20:00:12.807159+0000","last_became_active":"2023-11-28T20:00:12.803528+0000","last_became_peered":"2023-11-28T20:00:12.803528+0000","last_unstale":"2023-11-28T20:00:12.807159+0000","last_undegraded":"2023-11-28T20:00:12.807159+0000","last_fullsized":"2023-11-28T20:00:12.807159+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:11.760656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:11.760656+0000","last_clean_scrub_stamp":"2023-11-28T20:00:11.760656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:09:19.510844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2023-11-28T20:00:12.783641+0000","last_change":"2023-11-28T20:00:12.783641+0000","last_active":"2023-11-28T20:00:12.764355+0000","last_peered":"2023-11-28T20:00:12.764355+0000","last_clean":"2023-11-28T20:00:12.764355+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:00:12.783641+0000","last_undegraded":"2023-11-28T20:00:12.783641+0000","last_fullsized":"2023-11-28T20:00:12.783641+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_clean_scrub_stamp":"2023-11-28T20:00:12.764355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-28T20:00:12.797021+0000","last_change":"2023-11-28T20:00:12.795099+0000","last_active":"2023-11-28T20:00:12.797021+0000","last_peered":"2023-11-28T20:00:12.797021+0000","last_clean":"2023-11-28T20:00:12.797021+0000","last_became_active":"2023-11-28T20:00:12.794522+0000","last_became_peered":"2023-11-28T20:00:12.794522+0000","last_unstale":"2023-11-28T20:00:12.797021+0000","last_undegraded":"2023-11-28T20:00:12.797021+0000","last_fullsized":"2023-11-28T20:00:12.797021+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:11.760656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:11.760656+0000","last_clean_scrub_stamp":"2023-11-28T20:00:11.760656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:43:03.956082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2023-11-28T20:00:12.778768+0000","last_change":"2023-11-28T20:00:12.778768+0000","last_active":"2023-11-28T20:00:12.764355+0000","last_peered":"2023-11-28T20:00:12.764355+0000","last_clean":"2023-11-28T20:00:12.764355+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:00:12.778768+0000","last_undegraded":"2023-11-28T20:00:12.778768+0000","last_fullsized":"2023-11-28T20:00:12.778768+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_clean_scrub_stamp":"2023-11-28T20:00:12.764355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-28T20:00:12.795504+0000","last_change":"2023-11-28T20:00:12.792743+0000","last_active":"2023-11-28T20:00:12.795504+0000","last_peered":"2023-11-28T20:00:12.795504+0000","last_clean":"2023-11-28T20:00:12.795504+0000","last_became_active":"2023-11-28T20:00:12.792420+0000","last_became_peered":"2023-11-28T20:00:12.792420+0000","last_unstale":"2023-11-28T20:00:12.795504+0000","last_undegraded":"2023-11-28T20:00:12.795504+0000","last_fullsized":"2023-11-28T20:00:12.795504+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:11.760656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:11.760656+0000","last_clean_scrub_stamp":"2023-11-28T20:00:11.760656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:49:36.064771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2023-11-28T20:00:12.788073+0000","last_change":"2023-11-28T20:00:12.788073+0000","last_active":"2023-11-28T20:00:12.764355+0000","last_peered":"2023-11-28T20:00:12.764355+0000","last_clean":"2023-11-28T20:00:12.764355+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:00:12.788073+0000","last_undegraded":"2023-11-28T20:00:12.788073+0000","last_fullsized":"2023-11-28T20:00:12.788073+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_clean_scrub_stamp":"2023-11-28T20:00:12.764355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-28T20:00:12.801066+0000","last_change":"2023-11-28T20:00:12.793819+0000","last_active":"2023-11-28T20:00:12.801066+0000","last_peered":"2023-11-28T20:00:12.801066+0000","last_clean":"2023-11-28T20:00:12.801066+0000","last_became_active":"2023-11-28T20:00:12.793027+0000","last_became_peered":"2023-11-28T20:00:12.793027+0000","last_unstale":"2023-11-28T20:00:12.801066+0000","last_undegraded":"2023-11-28T20:00:12.801066+0000","last_fullsized":"2023-11-28T20:00:12.801066+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:11.760656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:11.760656+0000","last_clean_scrub_stamp":"2023-11-28T20:00:11.760656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:43:03.956082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2023-11-28T20:00:12.783249+0000","last_change":"2023-11-28T20:00:12.783249+0000","last_active":"2023-11-28T20:00:12.764355+0000","last_peered":"2023-11-28T20:00:12.764355+0000","last_clean":"2023-11-28T20:00:12.764355+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:00:12.783249+0000","last_undegraded":"2023-11-28T20:00:12.783249+0000","last_fullsized":"2023-11-28T20:00:12.783249+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_clean_scrub_stamp":"2023-11-28T20:00:12.764355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-28T20:00:12.796446+0000","last_change":"2023-11-28T20:00:12.790049+0000","last_active":"2023-11-28T20:00:12.796446+0000","last_peered":"2023-11-28T20:00:12.796446+0000","last_clean":"2023-11-28T20:00:12.796446+0000","last_became_active":"2023-11-28T20:00:12.789755+0000","last_became_peered":"2023-11-28T20:00:12.789755+0000","last_unstale":"2023-11-28T20:00:12.796446+0000","last_undegraded":"2023-11-28T20:00:12.796446+0000","last_fullsized":"2023-11-28T20:00:12.796446+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:11.760656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:11.760656+0000","last_clean_scrub_stamp":"2023-11-28T20:00:11.760656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:29:35.927577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2023-11-28T20:00:12.784248+0000","last_change":"2023-11-28T20:00:12.784248+0000","last_active":"2023-11-28T20:00:12.764355+0000","last_peered":"2023-11-28T20:00:12.764355+0000","last_clean":"2023-11-28T20:00:12.764355+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:00:12.784248+0000","last_undegraded":"2023-11-28T20:00:12.784248+0000","last_fullsized":"2023-11-28T20:00:12.784248+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_clean_scrub_stamp":"2023-11-28T20:00:12.764355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-28T20:00:12.801088+0000","last_change":"2023-11-28T20:00:12.794531+0000","last_active":"2023-11-28T20:00:12.801088+0000","last_peered":"2023-11-28T20:00:12.801088+0000","last_clean":"2023-11-28T20:00:12.801088+0000","last_became_active":"2023-11-28T20:00:12.794205+0000","last_became_peered":"2023-11-28T20:00:12.794205+0000","last_unstale":"2023-11-28T20:00:12.801088+0000","last_undegraded":"2023-11-28T20:00:12.801088+0000","last_fullsized":"2023-11-28T20:00:12.801088+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:11.760656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:11.760656+0000","last_clean_scrub_stamp":"2023-11-28T20:00:11.760656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:18:52.212443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2023-11-28T20:00:12.792646+0000","last_change":"2023-11-28T20:00:12.792646+0000","last_active":"2023-11-28T20:00:12.764355+0000","last_peered":"2023-11-28T20:00:12.764355+0000","last_clean":"2023-11-28T20:00:12.764355+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:00:12.792646+0000","last_undegraded":"2023-11-28T20:00:12.792646+0000","last_fullsized":"2023-11-28T20:00:12.792646+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_clean_scrub_stamp":"2023-11-28T20:00:12.764355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-28T20:00:12.797985+0000","last_change":"2023-11-28T20:00:12.795584+0000","last_active":"2023-11-28T20:00:12.797985+0000","last_peered":"2023-11-28T20:00:12.797985+0000","last_clean":"2023-11-28T20:00:12.797985+0000","last_became_active":"2023-11-28T20:00:12.795179+0000","last_became_peered":"2023-11-28T20:00:12.795179+0000","last_unstale":"2023-11-28T20:00:12.797985+0000","last_undegraded":"2023-11-28T20:00:12.797985+0000","last_fullsized":"2023-11-28T20:00:12.797985+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:11.760656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:11.760656+0000","last_clean_scrub_stamp":"2023-11-28T20:00:11.760656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:55:34.737227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":178,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-28T20:00:11.776047+0000","last_change":"2023-11-28T19:58:56.136501+0000","last_active":"2023-11-28T20:00:11.776047+0000","last_peered":"2023-11-28T20:00:11.776047+0000","last_clean":"2023-11-28T20:00:11.776047+0000","last_became_active":"2023-11-28T19:58:56.135998+0000","last_became_peered":"2023-11-28T19:58:56.135998+0000","last_unstale":"2023-11-28T20:00:11.776047+0000","last_undegraded":"2023-11-28T20:00:11.776047+0000","last_fullsized":"2023-11-28T20:00:11.776047+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:58:54.602349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:58:54.602349+0000","last_clean_scrub_stamp":"2023-11-28T19:58:54.602349+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:33:42.723349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":66748,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574868,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27500,"kb_used_data":480,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344340,"statfs":{"total":96636764160,"available":96608604160,"internally_reserved":0,"allocated":491520,"data_stored":768840,"data_compressed":33374,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 19:59:54 2023","interfaces":[{"interface":"back","average":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":0.90700000000000003,"5min":0.90700000000000003,"15min":0.90700000000000003},"last":0.76300000000000001},{"interface":"front","average":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"min":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":0.98999999999999999,"5min":0.98999999999999999,"15min":0.98999999999999999},"last":0.61299999999999999}]},{"osd":1,"last update":"Tue Nov 28 19:59:54 2023","interfaces":[{"interface":"back","average":{"1min":0.64600000000000002,"5min":0.64600000000000002,"15min":0.64600000000000002},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":0.89600000000000002,"5min":0.89600000000000002,"15min":0.89600000000000002},"last":0.82899999999999996},{"interface":"front","average":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.70199999999999996},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":1.0900000000000001,"5min":1.0900000000000001,"15min":1.0900000000000001},"last":0.68899999999999995}]},{"osd":2,"last update":"Tue Nov 28 19:59:54 2023","interfaces":[{"interface":"back","average":{"1min":0.73499999999999999,"5min":0.73499999999999999,"15min":0.73499999999999999},"min":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"max":{"1min":0.98799999999999999,"5min":0.98799999999999999,"15min":0.98799999999999999},"last":0.81499999999999995},{"interface":"front","average":{"1min":0.70699999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":1.0680000000000001,"5min":1.0680000000000001,"15min":1.0680000000000001},"last":0.85599999999999998}]},{"osd":3,"last update":"Tue Nov 28 19:59:54 2023","interfaces":[{"interface":"back","average":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"min":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":1.0449999999999999,"5min":1.0449999999999999,"15min":1.0449999999999999},"last":0.876},{"interface":"front","average":{"1min":0.79300000000000004,"5min":0.79300000000000004,"15min":0.79300000000000004},"min":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"max":{"1min":1.1299999999999999,"5min":1.1299999999999999,"15min":1.1299999999999999},"last":0.84599999999999997}]},{"osd":4,"last update":"Tue Nov 28 19:59:54 2023","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":1.018,"5min":1.018,"15min":1.018},"last":0.51500000000000001},{"interface":"front","average":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"min":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.1120000000000001,"5min":1.1120000000000001,"15min":1.1120000000000001},"last":0.56599999999999995}]},{"osd":5,"last update":"Tue Nov 28 19:59:54 2023","interfaces":[{"interface":"back","average":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":1.1699999999999999,"5min":1.1699999999999999,"15min":1.1699999999999999},"last":0.46000000000000002},{"interface":"front","average":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"min":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":1.1890000000000001,"5min":1.1890000000000001,"15min":1.1890000000000001},"last":0.57999999999999996}]},{"osd":6,"last update":"Tue Nov 28 19:59:54 2023","interfaces":[{"interface":"back","average":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.78200000000000003},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":1.1379999999999999,"5min":1.1379999999999999,"15min":1.1379999999999999},"last":0.63700000000000001},{"interface":"front","average":{"1min":0.747,"5min":0.747,"15min":0.747},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.23,"5min":1.23,"15min":1.23},"last":0.64700000000000002}]}]},{"osd":6,"up_from":13,"seq":55834574866,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27436,"kb_used_data":416,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344404,"statfs":{"total":96636764160,"available":96608669696,"internally_reserved":0,"allocated":425984,"data_stored":178472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 19:59:53 2023","interfaces":[{"interface":"back","average":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.61599999999999999},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.82599999999999996,"5min":0.82599999999999996,"15min":0.82599999999999996},"last":0.58899999999999997},{"interface":"front","average":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":0.98999999999999999,"5min":0.98999999999999999,"15min":0.98999999999999999},"last":0.78700000000000003}]},{"osd":1,"last update":"Tue Nov 28 19:59:53 2023","interfaces":[{"interface":"back","average":{"1min":0.79100000000000004,"5min":0.79100000000000004,"15min":0.79100000000000004},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.105,"5min":1.105,"15min":1.105},"last":0.75900000000000001},{"interface":"front","average":{"1min":0.68700000000000006,"5min":0.68700000000000006,"15min":0.68700000000000006},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.95899999999999996,"5min":0.95899999999999996,"15min":0.95899999999999996},"last":0.67400000000000004}]},{"osd":2,"last update":"Tue Nov 28 19:59:53 2023","interfaces":[{"interface":"back","average":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"min":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":0.93400000000000005,"5min":0.93400000000000005,"15min":0.93400000000000005},"last":0.71899999999999997},{"interface":"front","average":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"min":{"1min":0.505,"5min":0.505,"15min":0.505},"max":{"1min":1.006,"5min":1.006,"15min":1.006},"last":0.77600000000000002}]},{"osd":3,"last update":"Tue Nov 28 19:59:53 2023","interfaces":[{"interface":"back","average":{"1min":0.749,"5min":0.749,"15min":0.749},"min":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"max":{"1min":1.056,"5min":1.056,"15min":1.056},"last":0.68999999999999995},{"interface":"front","average":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":0.88900000000000001,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.65700000000000003}]},{"osd":4,"last update":"Tue Nov 28 19:59:53 2023","interfaces":[{"interface":"back","average":{"1min":0.63100000000000001,"5min":0.63100000000000001,"15min":0.63100000000000001},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":0.96999999999999997,"5min":0.96999999999999997,"15min":0.96999999999999997},"last":0.626},{"interface":"front","average":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":1.389,"5min":1.389,"15min":1.389},"last":0.42399999999999999}]},{"osd":5,"last update":"Tue Nov 28 19:59:53 2023","interfaces":[{"interface":"back","average":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":0.81699999999999995},"min":{"1min":0.5,"5min":0.5,"15min":0.5},"max":{"1min":1.4259999999999999,"5min":1.4259999999999999,"15min":1.4259999999999999},"last":0.47599999999999998},{"interface":"front","average":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"min":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":1.276,"5min":1.276,"15min":1.276},"last":0.56799999999999995}]},{"osd":7,"last update":"Tue Nov 28 19:59:53 2023","interfaces":[{"interface":"back","average":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.71499999999999997},"min":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":0.97599999999999998,"5min":0.97599999999999998,"15min":0.97599999999999998},"last":0.60699999999999998},{"interface":"front","average":{"1min":0.82999999999999996,"5min":0.82999999999999996,"15min":0.82999999999999996},"min":{"1min":0.65600000000000003,"5min":0.65600000000000003,"15min":0.65600000000000003},"max":{"1min":1.242,"5min":1.242,"15min":1.242},"last":0.73899999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574868,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27436,"kb_used_data":416,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344404,"statfs":{"total":96636764160,"available":96608669696,"internally_reserved":0,"allocated":425984,"data_stored":178472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 19:59:53 2023","interfaces":[{"interface":"back","average":{"1min":0.70999999999999996,"5min":0.70999999999999996,"15min":0.70999999999999996},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":0.997,"5min":0.997,"15min":0.997},"last":0.71399999999999997},{"interface":"front","average":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"min":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":1.149,"5min":1.149,"15min":1.149},"last":0.70199999999999996}]},{"osd":1,"last update":"Tue Nov 28 19:59:53 2023","interfaces":[{"interface":"back","average":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":0.92700000000000005,"5min":0.92700000000000005,"15min":0.92700000000000005},"last":0.68999999999999995},{"interface":"front","average":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":1.0940000000000001,"5min":1.0940000000000001,"15min":1.0940000000000001},"last":0.64700000000000002}]},{"osd":2,"last update":"Tue Nov 28 19:59:53 2023","interfaces":[{"interface":"back","average":{"1min":0.94599999999999995,"5min":0.94599999999999995,"15min":0.94599999999999995},"min":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":5.0880000000000001,"5min":5.0880000000000001,"15min":5.0880000000000001},"last":0.67200000000000004},{"interface":"front","average":{"1min":1.002,"5min":1.002,"15min":1.002},"min":{"1min":0.504,"5min":0.504,"15min":0.504},"max":{"1min":5.1399999999999997,"5min":5.1399999999999997,"15min":5.1399999999999997},"last":0.63600000000000001}]},{"osd":3,"last update":"Tue Nov 28 19:59:53 2023","interfaces":[{"interface":"back","average":{"1min":1.028,"5min":1.028,"15min":1.028},"min":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"max":{"1min":5.0469999999999997,"5min":5.0469999999999997,"15min":5.0469999999999997},"last":0.77500000000000002},{"interface":"front","average":{"1min":1.0009999999999999,"5min":1.0009999999999999,"15min":1.0009999999999999},"min":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":5.024,"5min":5.024,"15min":5.024},"last":0.60099999999999998}]},{"osd":4,"last update":"Tue Nov 28 19:59:53 2023","interfaces":[{"interface":"back","average":{"1min":0.67700000000000005,"5min":0.67700000000000005,"15min":0.67700000000000005},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":1.4810000000000001,"5min":1.4810000000000001,"15min":1.4810000000000001},"last":0.53400000000000003},{"interface":"front","average":{"1min":0.747,"5min":0.747,"15min":0.747},"min":{"1min":0.5,"5min":0.5,"15min":0.5},"max":{"1min":1.6339999999999999,"5min":1.6339999999999999,"15min":1.6339999999999999},"last":0.61599999999999999}]},{"osd":6,"last update":"Tue Nov 28 19:59:53 2023","interfaces":[{"interface":"back","average":{"1min":0.70699999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":0.97699999999999998,"5min":0.97699999999999998,"15min":0.97699999999999998},"last":0.55700000000000005},{"interface":"front","average":{"1min":0.748,"5min":0.748,"15min":0.748},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":1.099,"5min":1.099,"15min":1.099},"last":0.58599999999999997}]},{"osd":7,"last update":"Tue Nov 28 19:59:53 2023","interfaces":[{"interface":"back","average":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"min":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":1.236,"5min":1.236,"15min":1.236},"last":0.748},{"interface":"front","average":{"1min":0.80100000000000005,"5min":0.80100000000000005,"15min":0.80100000000000005},"min":{"1min":0.505,"5min":0.505,"15min":0.505},"max":{"1min":1.0760000000000001,"5min":1.0760000000000001,"15min":1.0760000000000001},"last":0.73199999999999998}]}]},{"osd":4,"up_from":13,"seq":55834574867,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27436,"kb_used_data":416,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344404,"statfs":{"total":96636764160,"available":96608669696,"internally_reserved":0,"allocated":425984,"data_stored":178472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 19:59:54 2023","interfaces":[{"interface":"back","average":{"1min":0.71099999999999997,"5min":0.71099999999999997,"15min":0.71099999999999997},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":1.0429999999999999,"5min":1.0429999999999999,"15min":1.0429999999999999},"last":0.71899999999999997},{"interface":"front","average":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":1.163,"5min":1.163,"15min":1.163},"last":0.59999999999999998}]},{"osd":1,"last update":"Tue Nov 28 19:59:54 2023","interfaces":[{"interface":"back","average":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"min":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":1.111,"5min":1.111,"15min":1.111},"last":0.74399999999999999},{"interface":"front","average":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"min":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":1.238,"5min":1.238,"15min":1.238},"last":0.79800000000000004}]},{"osd":2,"last update":"Tue Nov 28 19:59:54 2023","interfaces":[{"interface":"back","average":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":0.78300000000000003},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":1.0669999999999999,"5min":1.0669999999999999,"15min":1.0669999999999999},"last":0.66100000000000003},{"interface":"front","average":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":0.81699999999999995},"min":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":1.1180000000000001,"5min":1.1180000000000001,"15min":1.1180000000000001},"last":0.67600000000000005}]},{"osd":3,"last update":"Tue Nov 28 19:59:54 2023","interfaces":[{"interface":"back","average":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"min":{"1min":0.499,"5min":0.499,"15min":0.499},"max":{"1min":1.202,"5min":1.202,"15min":1.202},"last":0.64600000000000002},{"interface":"front","average":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"min":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":1.0589999999999999,"5min":1.0589999999999999,"15min":1.0589999999999999},"last":0.77900000000000003}]},{"osd":5,"last update":"Tue Nov 28 19:59:54 2023","interfaces":[{"interface":"back","average":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":0.95899999999999996,"5min":0.95899999999999996,"15min":0.95899999999999996},"last":0.623},{"interface":"front","average":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":1.034,"5min":1.034,"15min":1.034},"last":0.54400000000000004}]},{"osd":6,"last update":"Tue Nov 28 19:59:54 2023","interfaces":[{"interface":"back","average":{"1min":0.73499999999999999,"5min":0.73499999999999999,"15min":0.73499999999999999},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":1.0309999999999999,"5min":1.0309999999999999,"15min":1.0309999999999999},"last":0.57699999999999996},{"interface":"front","average":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":1.002,"5min":1.002,"15min":1.002},"last":0.76400000000000001}]},{"osd":7,"last update":"Tue Nov 28 19:59:54 2023","interfaces":[{"interface":"back","average":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"min":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":1.0620000000000001,"5min":1.0620000000000001,"15min":1.0620000000000001},"last":0.69399999999999995},{"interface":"front","average":{"1min":0.87,"5min":0.87,"15min":0.87},"min":{"1min":0.627,"5min":0.627,"15min":0.627},"max":{"1min":1.1459999999999999,"5min":1.1459999999999999,"15min":1.1459999999999999},"last":0.70399999999999996}]}]},{"osd":3,"up_from":13,"seq":55834574868,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27436,"kb_used_data":416,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344404,"statfs":{"total":96636764160,"available":96608669696,"internally_reserved":0,"allocated":425984,"data_stored":178472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 19:59:52 2023","interfaces":[{"interface":"back","average":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.70199999999999996},"last":0.45300000000000001},{"interface":"front","average":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"min":{"1min":0.312,"5min":0.312,"15min":0.312},"max":{"1min":0.82599999999999996,"5min":0.82599999999999996,"15min":0.82599999999999996},"last":0.32000000000000001}]},{"osd":1,"last update":"Tue Nov 28 19:59:52 2023","interfaces":[{"interface":"back","average":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.84399999999999997,"5min":0.84399999999999997,"15min":0.84399999999999997},"last":0.35899999999999999},{"interface":"front","average":{"1min":0.505,"5min":0.505,"15min":0.505},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.86099999999999999,"5min":0.86099999999999999,"15min":0.86099999999999999},"last":0.29199999999999998}]},{"osd":2,"last update":"Tue Nov 28 19:59:52 2023","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.85599999999999998,"5min":0.85599999999999998,"15min":0.85599999999999998},"last":0.46700000000000003},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.83699999999999997,"5min":0.83699999999999997,"15min":0.83699999999999997},"last":0.55900000000000005}]},{"osd":4,"last update":"Tue Nov 28 19:59:52 2023","interfaces":[{"interface":"back","average":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":1.206,"5min":1.206,"15min":1.206},"last":0.63500000000000001},{"interface":"front","average":{"1min":0.80300000000000005,"5min":0.80300000000000005,"15min":0.80300000000000005},"min":{"1min":0.503,"5min":0.503,"15min":0.503},"max":{"1min":1.222,"5min":1.222,"15min":1.222},"last":0.92700000000000005}]},{"osd":5,"last update":"Tue Nov 28 19:59:52 2023","interfaces":[{"interface":"back","average":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"min":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":1.151,"5min":1.151,"15min":1.151},"last":0.97499999999999998},{"interface":"front","average":{"1min":0.80300000000000005,"5min":0.80300000000000005,"15min":0.80300000000000005},"min":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":1.3100000000000001,"5min":1.3100000000000001,"15min":1.3100000000000001},"last":0.495}]},{"osd":6,"last update":"Tue Nov 28 19:59:52 2023","interfaces":[{"interface":"back","average":{"1min":0.84399999999999997,"5min":0.84399999999999997,"15min":0.84399999999999997},"min":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":1.361,"5min":1.361,"15min":1.361},"last":1.544},{"interface":"front","average":{"1min":0.749,"5min":0.749,"15min":0.749},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.125,"5min":1.125,"15min":1.125},"last":4.0679999999999996}]},{"osd":7,"last update":"Tue Nov 28 19:59:52 2023","interfaces":[{"interface":"back","average":{"1min":0.84999999999999998,"5min":0.84999999999999998,"15min":0.84999999999999998},"min":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"max":{"1min":1.2569999999999999,"5min":1.2569999999999999,"15min":1.2569999999999999},"last":4.0019999999999998},{"interface":"front","average":{"1min":0.89100000000000001,"5min":0.89100000000000001,"15min":0.89100000000000001},"min":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"max":{"1min":1.339,"5min":1.339,"15min":1.339},"last":1.1830000000000001}]}]},{"osd":2,"up_from":13,"seq":55834574866,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27436,"kb_used_data":416,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344404,"statfs":{"total":96636764160,"available":96608669696,"internally_reserved":0,"allocated":425984,"data_stored":178472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 19:59:54 2023","interfaces":[{"interface":"back","average":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"min":{"1min":0.26400000000000001,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"last":0.503},{"interface":"front","average":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.67700000000000005,"5min":0.67700000000000005,"15min":0.67700000000000005},"last":0.27900000000000003}]},{"osd":1,"last update":"Tue Nov 28 19:59:54 2023","interfaces":[{"interface":"back","average":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"min":{"1min":0.29899999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":1.0389999999999999,"5min":1.0389999999999999,"15min":1.0389999999999999},"last":0.38700000000000001},{"interface":"front","average":{"1min":0.505,"5min":0.505,"15min":0.505},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.70999999999999996,"5min":0.70999999999999996,"15min":0.70999999999999996},"last":0.32700000000000001}]},{"osd":3,"last update":"Tue Nov 28 19:59:54 2023","interfaces":[{"interface":"back","average":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"min":{"1min":0.28199999999999997,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.629,"5min":0.629,"15min":0.629},"last":0.36699999999999999},{"interface":"front","average":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.98499999999999999,"5min":0.98499999999999999,"15min":0.98499999999999999},"last":0.42799999999999999}]},{"osd":4,"last update":"Tue Nov 28 19:59:54 2023","interfaces":[{"interface":"back","average":{"1min":0.86199999999999999,"5min":0.86199999999999999,"15min":0.86199999999999999},"min":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"max":{"1min":1.139,"5min":1.139,"15min":1.139},"last":0.61099999999999999},{"interface":"front","average":{"1min":0.85299999999999998,"5min":0.85299999999999998,"15min":0.85299999999999998},"min":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":1.238,"5min":1.238,"15min":1.238},"last":0.629}]},{"osd":5,"last update":"Tue Nov 28 19:59:54 2023","interfaces":[{"interface":"back","average":{"1min":0.88500000000000001,"5min":0.88500000000000001,"15min":0.88500000000000001},"min":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":1.6180000000000001,"5min":1.6180000000000001,"15min":1.6180000000000001},"last":0.55100000000000005},{"interface":"front","average":{"1min":0.83499999999999996,"5min":0.83499999999999996,"15min":0.83499999999999996},"min":{"1min":0.496,"5min":0.496,"15min":0.496},"max":{"1min":1.339,"5min":1.339,"15min":1.339},"last":0.52200000000000002}]},{"osd":6,"last update":"Tue Nov 28 19:59:54 2023","interfaces":[{"interface":"back","average":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":0.80600000000000005},"min":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1.1839999999999999,"5min":1.1839999999999999,"15min":1.1839999999999999},"last":0.59699999999999998},{"interface":"front","average":{"1min":0.86199999999999999,"5min":0.86199999999999999,"15min":0.86199999999999999},"min":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":1.099,"5min":1.099,"15min":1.099},"last":0.56699999999999995}]},{"osd":7,"last update":"Tue Nov 28 19:59:54 2023","interfaces":[{"interface":"back","average":{"1min":0.89000000000000001,"5min":0.89000000000000001,"15min":0.89000000000000001},"min":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":1.4590000000000001,"5min":1.4590000000000001,"15min":1.4590000000000001},"last":0.58299999999999996},{"interface":"front","average":{"1min":0.86699999999999999,"5min":0.86699999999999999,"15min":0.86699999999999999},"min":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":1.387,"5min":1.387,"15min":1.387},"last":0.48799999999999999}]}]},{"osd":1,"up_from":13,"seq":55834574868,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27436,"kb_used_data":416,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344404,"statfs":{"total":96636764160,"available":96608669696,"internally_reserved":0,"allocated":425984,"data_stored":178472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 19:59:53 2023","interfaces":[{"interface":"back","average":{"1min":0.65800000000000003,"5min":0.65800000000000003,"15min":0.65800000000000003},"min":{"1min":0.31,"5min":0.31,"15min":0.31},"max":{"1min":3.8740000000000001,"5min":3.8740000000000001,"15min":3.8740000000000001},"last":0.28799999999999998},{"interface":"front","average":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"min":{"1min":0.25,"5min":0.25,"15min":0.25},"max":{"1min":2.0760000000000001,"5min":2.0760000000000001,"15min":2.0760000000000001},"last":0.38300000000000001}]},{"osd":2,"last update":"Tue Nov 28 19:59:53 2023","interfaces":[{"interface":"back","average":{"1min":0.65900000000000003,"5min":0.65900000000000003,"15min":0.65900000000000003},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":3.7320000000000002,"5min":3.7320000000000002,"15min":3.7320000000000002},"last":0.41999999999999998},{"interface":"front","average":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":3.9089999999999998,"5min":3.9089999999999998,"15min":3.9089999999999998},"last":0.35499999999999998}]},{"osd":3,"last update":"Tue Nov 28 19:59:53 2023","interfaces":[{"interface":"back","average":{"1min":0.68100000000000005,"5min":0.68100000000000005,"15min":0.68100000000000005},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":1.6399999999999999,"5min":1.6399999999999999,"15min":1.6399999999999999},"last":0.48899999999999999},{"interface":"front","average":{"1min":0.70299999999999996,"5min":0.70299999999999996,"15min":0.70299999999999996},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":2.5270000000000001,"5min":2.5270000000000001,"15min":2.5270000000000001},"last":0.443}]},{"osd":4,"last update":"Tue Nov 28 19:59:53 2023","interfaces":[{"interface":"back","average":{"1min":0.89500000000000002,"5min":0.89500000000000002,"15min":0.89500000000000002},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":3.1659999999999999,"5min":3.1659999999999999,"15min":3.1659999999999999},"last":0.64100000000000001},{"interface":"front","average":{"1min":0.94599999999999995,"5min":0.94599999999999995,"15min":0.94599999999999995},"min":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":3.7959999999999998,"5min":3.7959999999999998,"15min":3.7959999999999998},"last":0.54100000000000004}]},{"osd":5,"last update":"Tue Nov 28 19:59:53 2023","interfaces":[{"interface":"back","average":{"1min":0.98899999999999999,"5min":0.98899999999999999,"15min":0.98899999999999999},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":4.1479999999999997,"5min":4.1479999999999997,"15min":4.1479999999999997},"last":0.65700000000000003},{"interface":"front","average":{"1min":0.91000000000000003,"5min":0.91000000000000003,"15min":0.91000000000000003},"min":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":3.5569999999999999,"5min":3.5569999999999999,"15min":3.5569999999999999},"last":0.5}]},{"osd":6,"last update":"Tue Nov 28 19:59:53 2023","interfaces":[{"interface":"back","average":{"1min":0.99199999999999999,"5min":0.99199999999999999,"15min":0.99199999999999999},"min":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":2.863,"5min":2.863,"15min":2.863},"last":0.68500000000000005},{"interface":"front","average":{"1min":0.98299999999999998,"5min":0.98299999999999998,"15min":0.98299999999999998},"min":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"max":{"1min":3.371,"5min":3.371,"15min":3.371},"last":0.60099999999999998}]},{"osd":7,"last update":"Tue Nov 28 19:59:53 2023","interfaces":[{"interface":"back","average":{"1min":1.0129999999999999,"5min":1.0129999999999999,"15min":1.0129999999999999},"min":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"max":{"1min":3.8439999999999999,"5min":3.8439999999999999,"15min":3.8439999999999999},"last":0.624},{"interface":"front","average":{"1min":1.038,"5min":1.038,"15min":1.038},"min":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"max":{"1min":3.9689999999999999,"5min":3.9689999999999999,"15min":3.9689999999999999},"last":0.53000000000000003}]}]},{"osd":0,"up_from":13,"seq":55834574867,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27500,"kb_used_data":480,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344340,"statfs":{"total":96636764160,"available":96608604160,"internally_reserved":0,"allocated":491520,"data_stored":768840,"data_compressed":33374,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Nov 28 19:59:56 2023","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.68999999999999995,"15min":0.68999999999999995},"min":{"1min":0.29899999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":4.883,"5min":4.883,"15min":4.883},"last":0.27400000000000002},{"interface":"front","average":{"1min":0.878,"5min":0.878,"15min":0.878},"min":{"1min":0.29399999999999998,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":8.0800000000000001,"5min":8.0800000000000001,"15min":8.0800000000000001},"last":0.41699999999999998}]},{"osd":2,"last update":"Tue Nov 28 19:59:56 2023","interfaces":[{"interface":"back","average":{"1min":0.97399999999999998,"5min":0.97399999999999998,"15min":0.97399999999999998},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":8.1029999999999998,"5min":8.1029999999999998,"15min":8.1029999999999998},"last":0.46000000000000002},{"interface":"front","average":{"1min":0.98699999999999999,"5min":0.98699999999999999,"15min":0.98699999999999999},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":8.1310000000000002,"5min":8.1310000000000002,"15min":8.1310000000000002},"last":0.5}]},{"osd":3,"last update":"Tue Nov 28 19:59:56 2023","interfaces":[{"interface":"back","average":{"1min":0.747,"5min":0.747,"15min":0.747},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":4.3949999999999996,"5min":4.3949999999999996,"15min":4.3949999999999996},"last":0.441},{"interface":"front","average":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":4.3470000000000004,"5min":4.3470000000000004,"15min":4.3470000000000004},"last":0.51900000000000002}]},{"osd":4,"last update":"Tue Nov 28 19:59:56 2023","interfaces":[{"interface":"back","average":{"1min":1.0509999999999999,"5min":1.0509999999999999,"15min":1.0509999999999999},"min":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"max":{"1min":4.6360000000000001,"5min":4.6360000000000001,"15min":4.6360000000000001},"last":0.54100000000000004},{"interface":"front","average":{"1min":1.0529999999999999,"5min":1.0529999999999999,"15min":1.0529999999999999},"min":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":4.4710000000000001,"5min":4.4710000000000001,"15min":4.4710000000000001},"last":0.59899999999999998}]},{"osd":5,"last update":"Tue Nov 28 19:59:56 2023","interfaces":[{"interface":"back","average":{"1min":1.0649999999999999,"5min":1.0649999999999999,"15min":1.0649999999999999},"min":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":4.6120000000000001,"5min":4.6120000000000001,"15min":4.6120000000000001},"last":0.65400000000000003},{"interface":"front","average":{"1min":1.052,"5min":1.052,"15min":1.052},"min":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"max":{"1min":4.5449999999999999,"5min":4.5449999999999999,"15min":4.5449999999999999},"last":0.58999999999999997}]},{"osd":6,"last update":"Tue Nov 28 19:59:56 2023","interfaces":[{"interface":"back","average":{"1min":1.079,"5min":1.079,"15min":1.079},"min":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":4.657,"5min":4.657,"15min":4.657},"last":0.64500000000000002},{"interface":"front","average":{"1min":1.097,"5min":1.097,"15min":1.097},"min":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"max":{"1min":4.5259999999999998,"5min":4.5259999999999998,"15min":4.5259999999999998},"last":0.61599999999999999}]},{"osd":7,"last update":"Tue Nov 28 19:59:56 2023","interfaces":[{"interface":"back","average":{"1min":1.101,"5min":1.101,"15min":1.101},"min":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.60099999999999998},"max":{"1min":4.7320000000000002,"5min":4.7320000000000002,"15min":4.7320000000000002},"last":0.57199999999999995},{"interface":"front","average":{"1min":1.046,"5min":1.046,"15min":1.046},"min":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":4.4939999999999998,"5min":4.4939999999999998,"15min":4.4939999999999998},"last":0.67000000000000004}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33374,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33374,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-28T20:00:17.863 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-28T20:00:18.038 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:18.034+0000 7f921fa5a640 1 Processor -- start 2023-11-28T20:00:18.038 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:18.034+0000 7f921fa5a640 1 -- start start 2023-11-28T20:00:18.040 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:18.034+0000 7f921fa5a640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f92180722c0 0x7f921815de60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:18.040 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:18.038+0000 7f921fa5a640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f92180c5710 con 0x7f921814fd10 2023-11-28T20:00:18.040 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:18.038+0000 7f921fa5a640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9218155c80 con 0x7f9218071e30 2023-11-28T20:00:18.040 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:18.038+0000 7f921fa5a640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f921806c5e0 con 0x7f92180722c0 2023-11-28T20:00:18.040 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:18.038+0000 7f921d7f6640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f921814fd10 0x7f92180a4dc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:56506/0 (socket says 172.21.15.78:56506) 2023-11-28T20:00:18.040 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:18.038+0000 7f921d7f6640 1 -- 172.21.15.78:0/894621340 learned_addr learned my addr 172.21.15.78:0/894621340 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-11-28T20:00:18.040 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:18.038+0000 7f921dff7640 1 --2- 172.21.15.78:0/894621340 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f92180722c0 0x7f921815de60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:18.041 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:18.038+0000 7f920ffff640 1 -- 172.21.15.78:0/894621340 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 185859134 0 0) 0x7f92180c5710 con 0x7f921814fd10 2023-11-28T20:00:18.041 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:18.038+0000 7f920ffff640 1 -- 172.21.15.78:0/894621340 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9204003530 con 0x7f921814fd10 2023-11-28T20:00:18.041 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:18.038+0000 7f921dff7640 1 -- 172.21.15.78:0/894621340 >> v1:172.21.15.179:6789/0 conn(0x7f9218071e30 legacy=0x7f9218156110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:00:18.041 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:18.038+0000 7f921dff7640 1 -- 172.21.15.78:0/894621340 >> v1:172.21.15.78:6789/0 conn(0x7f921814fd10 legacy=0x7f92180a4dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:00:18.041 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:18.038+0000 7f921dff7640 1 -- 172.21.15.78:0/894621340 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92180c4e70 con 0x7f92180722c0 2023-11-28T20:00:18.043 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:18.038+0000 7f921dff7640 1 --2- 172.21.15.78:0/894621340 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f92180722c0 0x7f921815de60 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f9210009dc0 tx=0x7f921001c820 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3888d1f75aff1555 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:00:18.044 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:18.042+0000 7f920ffff640 1 -- 172.21.15.78:0/894621340 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92100a58e0 con 0x7f92180722c0 2023-11-28T20:00:18.044 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:18.042+0000 7f920ffff640 1 -- 172.21.15.78:0/894621340 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f92100a5a40 con 0x7f92180722c0 2023-11-28T20:00:18.044 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:18.042+0000 7f920ffff640 1 -- 172.21.15.78:0/894621340 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92100a5dd0 con 0x7f92180722c0 2023-11-28T20:00:18.045 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:18.042+0000 7f921fa5a640 1 -- 172.21.15.78:0/894621340 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f92180722c0 msgr2=0x7f921815de60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:00:18.046 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:18.042+0000 7f921fa5a640 1 --2- 172.21.15.78:0/894621340 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f92180722c0 0x7f921815de60 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f9210009dc0 tx=0x7f921001c820 comp rx=0 tx=0).stop 2023-11-28T20:00:18.046 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:18.042+0000 7f921fa5a640 1 -- 172.21.15.78:0/894621340 shutdown_connections 2023-11-28T20:00:18.046 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:18.042+0000 7f921fa5a640 1 --2- 172.21.15.78:0/894621340 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f92180722c0 0x7f921815de60 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:18.046 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:18.042+0000 7f921fa5a640 1 -- 172.21.15.78:0/894621340 >> 172.21.15.78:0/894621340 conn(0x7f92180a7810 msgr2=0x7f92180a7c20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:00:18.046 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:18.042+0000 7f921fa5a640 1 -- 172.21.15.78:0/894621340 shutdown_connections 2023-11-28T20:00:18.046 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:18.042+0000 7f921fa5a640 1 -- 172.21.15.78:0/894621340 wait complete. 2023-11-28T20:00:18.047 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:18.042+0000 7f921fa5a640 1 Processor -- start 2023-11-28T20:00:18.047 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:18.042+0000 7f921fa5a640 1 -- start start 2023-11-28T20:00:18.049 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:18.046+0000 7f921fa5a640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9218071e30 0x7f921813f3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:18.049 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:18.046+0000 7f921fa5a640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f92180722c0 0x7f921806fd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:18.050 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:18.046+0000 7f921fa5a640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f921814fd10 0x7f92180702d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:18.050 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:18.046+0000 7f921fa5a640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92181edb90 con 0x7f921814fd10 2023-11-28T20:00:18.050 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:18.046+0000 7f921fa5a640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92181eccc0 con 0x7f92180722c0 2023-11-28T20:00:18.050 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:18.046+0000 7f921fa5a640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f92181ecf10 con 0x7f9218071e30 2023-11-28T20:00:18.050 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:18.046+0000 7f921dff7640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f921814fd10 0x7f92180702d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:18.050 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:18.046+0000 7f921dff7640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f921814fd10 0x7f92180702d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:52148/0 (socket says 172.21.15.78:52148) 2023-11-28T20:00:18.050 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:18.046+0000 7f921dff7640 1 -- 172.21.15.78:0/3262398177 learned_addr learned my addr 172.21.15.78:0/3262398177 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T20:00:18.050 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:18.046+0000 7f921d7f6640 1 --2- 172.21.15.78:0/3262398177 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9218071e30 0x7f921813f3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:18.050 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:18.046+0000 7f921cff5640 1 --2- 172.21.15.78:0/3262398177 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f92180722c0 0x7f921806fd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:18.050 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:18.046+0000 7f921dff7640 1 -- 172.21.15.78:0/3262398177 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9218071e30 msgr2=0x7f921813f3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:00:18.051 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:18.046+0000 7f921dff7640 1 --2- 172.21.15.78:0/3262398177 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9218071e30 0x7f921813f3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:18.051 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:18.046+0000 7f921dff7640 1 -- 172.21.15.78:0/3262398177 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f92180722c0 msgr2=0x7f921806fd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:00:18.051 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:18.046+0000 7f921dff7640 1 --2- 172.21.15.78:0/3262398177 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f92180722c0 0x7f921806fd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:18.051 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:18.046+0000 7f921dff7640 1 -- 172.21.15.78:0/3262398177 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9210009a70 con 0x7f921814fd10 2023-11-28T20:00:18.051 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:18.046+0000 7f921cff5640 1 --2- 172.21.15.78:0/3262398177 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f92180722c0 0x7f921806fd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T20:00:18.051 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:18.046+0000 7f921dff7640 1 --2- 172.21.15.78:0/3262398177 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f921814fd10 0x7f92180702d0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f92100b0040 tx=0x7f92100195c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:00:18.051 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:18.046+0000 7f920dffb640 1 -- 172.21.15.78:0/3262398177 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92100b9860 con 0x7f921814fd10 2023-11-28T20:00:18.051 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:18.046+0000 7f920dffb640 1 -- 172.21.15.78:0/3262398177 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f92100b99c0 con 0x7f921814fd10 2023-11-28T20:00:18.051 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:18.046+0000 7f920dffb640 1 -- 172.21.15.78:0/3262398177 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92100b9d50 con 0x7f921814fd10 2023-11-28T20:00:18.051 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:18.046+0000 7f921fa5a640 1 -- 172.21.15.78:0/3262398177 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f92181ed1f0 con 0x7f921814fd10 2023-11-28T20:00:18.051 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:18.046+0000 7f921fa5a640 1 -- 172.21.15.78:0/3262398177 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f92181ed7b0 con 0x7f921814fd10 2023-11-28T20:00:18.052 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:18.046+0000 7f921fa5a640 1 -- 172.21.15.78:0/3262398177 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9218067630 con 0x7f921814fd10 2023-11-28T20:00:18.052 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:18.046+0000 7f920dffb640 1 -- 172.21.15.78:0/3262398177 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f92100ad440 con 0x7f921814fd10 2023-11-28T20:00:18.052 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:18.050+0000 7f920dffb640 1 --2- 172.21.15.78:0/3262398177 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f91fc066470 0x7f91fc068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:18.053 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:18.050+0000 7f920dffb640 1 -- 172.21.15.78:0/3262398177 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f921011f190 con 0x7f921814fd10 2023-11-28T20:00:18.053 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:18.050+0000 7f921d7f6640 1 --2- 172.21.15.78:0/3262398177 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f91fc066470 0x7f91fc068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:18.053 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:18.050+0000 7f921d7f6640 1 --2- 172.21.15.78:0/3262398177 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f91fc066470 0x7f91fc068930 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f92140011f0 tx=0x7f9214007d40 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:00:18.056 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:18.054+0000 7f920dffb640 1 -- 172.21.15.78:0/3262398177 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f92100ec680 con 0x7f921814fd10 2023-11-28T20:00:18.204 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:18.202+0000 7f921fa5a640 1 -- 172.21.15.78:0/3262398177 --> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f921806fc20 con 0x7f91fc066470 2023-11-28T20:00:18.211 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:18.206+0000 7f920dffb640 1 -- 172.21.15.78:0/3262398177 <== mgr.4106 v2:172.21.15.78:6832/2935380957 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+283258 (secure 0 0 0) 0x7f921806fc20 con 0x7f91fc066470 2023-11-28T20:00:18.214 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-11-28T20:00:18.215 INFO:teuthology.orchestra.run.smithi078.stderr:dumped all 2023-11-28T20:00:18.217 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:18.210+0000 7f921fa5a640 1 -- 172.21.15.78:0/3262398177 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f91fc066470 msgr2=0x7f91fc068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:00:18.217 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:18.210+0000 7f921fa5a640 1 --2- 172.21.15.78:0/3262398177 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f91fc066470 0x7f91fc068930 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f92140011f0 tx=0x7f9214007d40 comp rx=0 tx=0).stop 2023-11-28T20:00:18.217 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:18.210+0000 7f921fa5a640 1 -- 172.21.15.78:0/3262398177 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f921814fd10 msgr2=0x7f92180702d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:00:18.217 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:18.210+0000 7f921fa5a640 1 --2- 172.21.15.78:0/3262398177 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f921814fd10 0x7f92180702d0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f92100b0040 tx=0x7f92100195c0 comp rx=0 tx=0).stop 2023-11-28T20:00:18.217 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:18.210+0000 7f921fa5a640 1 -- 172.21.15.78:0/3262398177 shutdown_connections 2023-11-28T20:00:18.217 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:18.210+0000 7f921fa5a640 1 --2- 172.21.15.78:0/3262398177 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f91fc066470 0x7f91fc068930 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:18.217 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:18.210+0000 7f921fa5a640 1 --2- 172.21.15.78:0/3262398177 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f921814fd10 0x7f92180702d0 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:18.217 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:18.210+0000 7f921fa5a640 1 --2- 172.21.15.78:0/3262398177 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f92180722c0 0x7f921806fd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:18.217 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:18.210+0000 7f921fa5a640 1 --2- 172.21.15.78:0/3262398177 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9218071e30 0x7f921813f3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:18.217 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:18.210+0000 7f921fa5a640 1 -- 172.21.15.78:0/3262398177 >> 172.21.15.78:0/3262398177 conn(0x7f92180a7810 msgr2=0x7f921806d1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:00:18.217 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:18.210+0000 7f921fa5a640 1 -- 172.21.15.78:0/3262398177 shutdown_connections 2023-11-28T20:00:18.218 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:18.210+0000 7f921fa5a640 1 -- 172.21.15.78:0/3262398177 wait complete. 2023-11-28T20:00:18.234 INFO:teuthology.orchestra.run.smithi078.stdout:{"pg_ready":true,"pg_map":{"version":76,"stamp":"2023-11-28T20:00:17.968846+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":48,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219616,"kb_used_data":3456,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755104,"statfs":{"total":773094113280,"available":772869226496,"internally_reserved":0,"allocated":3538944,"data_stored":2608512,"data_compressed":66748,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":28,"apply_latency_ms":28,"commit_latency_ns":28000000,"apply_latency_ns":28000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.000955"},"pg_stats":[{"pgid":"6.3f","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2023-11-28T20:00:12.786561+0000","last_change":"2023-11-28T20:00:12.786561+0000","last_active":"2023-11-28T20:00:12.764355+0000","last_peered":"2023-11-28T20:00:12.764355+0000","last_clean":"2023-11-28T20:00:12.764355+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:00:12.786561+0000","last_undegraded":"2023-11-28T20:00:12.786561+0000","last_fullsized":"2023-11-28T20:00:12.786561+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_clean_scrub_stamp":"2023-11-28T20:00:12.764355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2023-11-28T20:00:12.785251+0000","last_change":"2023-11-28T20:00:12.785251+0000","last_active":"2023-11-28T20:00:12.764355+0000","last_peered":"2023-11-28T20:00:12.764355+0000","last_clean":"2023-11-28T20:00:12.764355+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:00:12.785251+0000","last_undegraded":"2023-11-28T20:00:12.785251+0000","last_fullsized":"2023-11-28T20:00:12.785251+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_clean_scrub_stamp":"2023-11-28T20:00:12.764355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2023-11-28T20:00:12.784934+0000","last_change":"2023-11-28T20:00:12.784934+0000","last_active":"2023-11-28T20:00:12.764355+0000","last_peered":"2023-11-28T20:00:12.764355+0000","last_clean":"2023-11-28T20:00:12.764355+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:00:12.784934+0000","last_undegraded":"2023-11-28T20:00:12.784934+0000","last_fullsized":"2023-11-28T20:00:12.784934+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_clean_scrub_stamp":"2023-11-28T20:00:12.764355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.3c","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2023-11-28T20:00:12.786036+0000","last_change":"2023-11-28T20:00:12.786036+0000","last_active":"2023-11-28T20:00:12.764355+0000","last_peered":"2023-11-28T20:00:12.764355+0000","last_clean":"2023-11-28T20:00:12.764355+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:00:12.786036+0000","last_undegraded":"2023-11-28T20:00:12.786036+0000","last_fullsized":"2023-11-28T20:00:12.786036+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_clean_scrub_stamp":"2023-11-28T20:00:12.764355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2023-11-28T20:00:12.786007+0000","last_change":"2023-11-28T20:00:12.786007+0000","last_active":"2023-11-28T20:00:12.764355+0000","last_peered":"2023-11-28T20:00:12.764355+0000","last_clean":"2023-11-28T20:00:12.764355+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:00:12.786007+0000","last_undegraded":"2023-11-28T20:00:12.786007+0000","last_fullsized":"2023-11-28T20:00:12.786007+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_clean_scrub_stamp":"2023-11-28T20:00:12.764355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2023-11-28T20:00:12.784599+0000","last_change":"2023-11-28T20:00:12.784599+0000","last_active":"2023-11-28T20:00:12.764355+0000","last_peered":"2023-11-28T20:00:12.764355+0000","last_clean":"2023-11-28T20:00:12.764355+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:00:12.784599+0000","last_undegraded":"2023-11-28T20:00:12.784599+0000","last_fullsized":"2023-11-28T20:00:12.784599+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_clean_scrub_stamp":"2023-11-28T20:00:12.764355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2023-11-28T20:00:12.788606+0000","last_change":"2023-11-28T20:00:12.788606+0000","last_active":"2023-11-28T20:00:12.764355+0000","last_peered":"2023-11-28T20:00:12.764355+0000","last_clean":"2023-11-28T20:00:12.764355+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:00:12.788606+0000","last_undegraded":"2023-11-28T20:00:12.788606+0000","last_fullsized":"2023-11-28T20:00:12.788606+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_clean_scrub_stamp":"2023-11-28T20:00:12.764355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2023-11-28T20:00:12.782185+0000","last_change":"2023-11-28T20:00:12.782185+0000","last_active":"2023-11-28T20:00:12.764355+0000","last_peered":"2023-11-28T20:00:12.764355+0000","last_clean":"2023-11-28T20:00:12.764355+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:00:12.782185+0000","last_undegraded":"2023-11-28T20:00:12.782185+0000","last_fullsized":"2023-11-28T20:00:12.782185+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_clean_scrub_stamp":"2023-11-28T20:00:12.764355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2023-11-28T20:00:12.784258+0000","last_change":"2023-11-28T20:00:12.784258+0000","last_active":"2023-11-28T20:00:12.764355+0000","last_peered":"2023-11-28T20:00:12.764355+0000","last_clean":"2023-11-28T20:00:12.764355+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:00:12.784258+0000","last_undegraded":"2023-11-28T20:00:12.784258+0000","last_fullsized":"2023-11-28T20:00:12.784258+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_clean_scrub_stamp":"2023-11-28T20:00:12.764355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2023-11-28T20:00:12.796410+0000","last_change":"2023-11-28T20:00:12.796410+0000","last_active":"2023-11-28T20:00:12.764355+0000","last_peered":"2023-11-28T20:00:12.764355+0000","last_clean":"2023-11-28T20:00:12.764355+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:00:12.796410+0000","last_undegraded":"2023-11-28T20:00:12.796410+0000","last_fullsized":"2023-11-28T20:00:12.796410+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_clean_scrub_stamp":"2023-11-28T20:00:12.764355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2023-11-28T20:00:12.795967+0000","last_change":"2023-11-28T20:00:12.795967+0000","last_active":"2023-11-28T20:00:12.764355+0000","last_peered":"2023-11-28T20:00:12.764355+0000","last_clean":"2023-11-28T20:00:12.764355+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:00:12.795967+0000","last_undegraded":"2023-11-28T20:00:12.795967+0000","last_fullsized":"2023-11-28T20:00:12.795967+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_clean_scrub_stamp":"2023-11-28T20:00:12.764355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2023-11-28T20:00:12.784227+0000","last_change":"2023-11-28T20:00:12.784227+0000","last_active":"2023-11-28T20:00:12.764355+0000","last_peered":"2023-11-28T20:00:12.764355+0000","last_clean":"2023-11-28T20:00:12.764355+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:00:12.784227+0000","last_undegraded":"2023-11-28T20:00:12.784227+0000","last_fullsized":"2023-11-28T20:00:12.784227+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_clean_scrub_stamp":"2023-11-28T20:00:12.764355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2023-11-28T20:00:12.789120+0000","last_change":"2023-11-28T20:00:12.789120+0000","last_active":"2023-11-28T20:00:12.764355+0000","last_peered":"2023-11-28T20:00:12.764355+0000","last_clean":"2023-11-28T20:00:12.764355+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:00:12.789120+0000","last_undegraded":"2023-11-28T20:00:12.789120+0000","last_fullsized":"2023-11-28T20:00:12.789120+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_clean_scrub_stamp":"2023-11-28T20:00:12.764355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2023-11-28T20:00:12.783757+0000","last_change":"2023-11-28T20:00:12.783757+0000","last_active":"2023-11-28T20:00:12.764355+0000","last_peered":"2023-11-28T20:00:12.764355+0000","last_clean":"2023-11-28T20:00:12.764355+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:00:12.783757+0000","last_undegraded":"2023-11-28T20:00:12.783757+0000","last_fullsized":"2023-11-28T20:00:12.783757+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_clean_scrub_stamp":"2023-11-28T20:00:12.764355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2023-11-28T20:00:12.788137+0000","last_change":"2023-11-28T20:00:12.788137+0000","last_active":"2023-11-28T20:00:12.764355+0000","last_peered":"2023-11-28T20:00:12.764355+0000","last_clean":"2023-11-28T20:00:12.764355+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:00:12.788137+0000","last_undegraded":"2023-11-28T20:00:12.788137+0000","last_fullsized":"2023-11-28T20:00:12.788137+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_clean_scrub_stamp":"2023-11-28T20:00:12.764355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2023-11-28T20:00:12.786772+0000","last_change":"2023-11-28T20:00:12.786772+0000","last_active":"2023-11-28T20:00:12.764355+0000","last_peered":"2023-11-28T20:00:12.764355+0000","last_clean":"2023-11-28T20:00:12.764355+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:00:12.786772+0000","last_undegraded":"2023-11-28T20:00:12.786772+0000","last_fullsized":"2023-11-28T20:00:12.786772+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_clean_scrub_stamp":"2023-11-28T20:00:12.764355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2023-11-28T20:00:12.785537+0000","last_change":"2023-11-28T20:00:12.785537+0000","last_active":"2023-11-28T20:00:12.764355+0000","last_peered":"2023-11-28T20:00:12.764355+0000","last_clean":"2023-11-28T20:00:12.764355+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:00:12.785537+0000","last_undegraded":"2023-11-28T20:00:12.785537+0000","last_fullsized":"2023-11-28T20:00:12.785537+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_clean_scrub_stamp":"2023-11-28T20:00:12.764355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2023-11-28T20:00:12.778466+0000","last_change":"2023-11-28T20:00:12.778466+0000","last_active":"2023-11-28T20:00:12.764355+0000","last_peered":"2023-11-28T20:00:12.764355+0000","last_clean":"2023-11-28T20:00:12.764355+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:00:12.778466+0000","last_undegraded":"2023-11-28T20:00:12.778466+0000","last_fullsized":"2023-11-28T20:00:12.778466+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_clean_scrub_stamp":"2023-11-28T20:00:12.764355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2023-11-28T20:00:12.785360+0000","last_change":"2023-11-28T20:00:12.785360+0000","last_active":"2023-11-28T20:00:12.764355+0000","last_peered":"2023-11-28T20:00:12.764355+0000","last_clean":"2023-11-28T20:00:12.764355+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:00:12.785360+0000","last_undegraded":"2023-11-28T20:00:12.785360+0000","last_fullsized":"2023-11-28T20:00:12.785360+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_clean_scrub_stamp":"2023-11-28T20:00:12.764355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2023-11-28T20:00:12.779039+0000","last_change":"2023-11-28T20:00:12.779039+0000","last_active":"2023-11-28T20:00:12.764355+0000","last_peered":"2023-11-28T20:00:12.764355+0000","last_clean":"2023-11-28T20:00:12.764355+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:00:12.779039+0000","last_undegraded":"2023-11-28T20:00:12.779039+0000","last_fullsized":"2023-11-28T20:00:12.779039+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_clean_scrub_stamp":"2023-11-28T20:00:12.764355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2023-11-28T20:00:12.786544+0000","last_change":"2023-11-28T20:00:12.786544+0000","last_active":"2023-11-28T20:00:12.764355+0000","last_peered":"2023-11-28T20:00:12.764355+0000","last_clean":"2023-11-28T20:00:12.764355+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:00:12.786544+0000","last_undegraded":"2023-11-28T20:00:12.786544+0000","last_fullsized":"2023-11-28T20:00:12.786544+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_clean_scrub_stamp":"2023-11-28T20:00:12.764355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2023-11-28T20:00:12.782742+0000","last_change":"2023-11-28T20:00:12.782742+0000","last_active":"2023-11-28T20:00:12.764355+0000","last_peered":"2023-11-28T20:00:12.764355+0000","last_clean":"2023-11-28T20:00:12.764355+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:00:12.782742+0000","last_undegraded":"2023-11-28T20:00:12.782742+0000","last_fullsized":"2023-11-28T20:00:12.782742+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_clean_scrub_stamp":"2023-11-28T20:00:12.764355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2023-11-28T20:00:12.786852+0000","last_change":"2023-11-28T20:00:12.786852+0000","last_active":"2023-11-28T20:00:12.764355+0000","last_peered":"2023-11-28T20:00:12.764355+0000","last_clean":"2023-11-28T20:00:12.764355+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:00:12.786852+0000","last_undegraded":"2023-11-28T20:00:12.786852+0000","last_fullsized":"2023-11-28T20:00:12.786852+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_clean_scrub_stamp":"2023-11-28T20:00:12.764355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2023-11-28T20:00:12.778685+0000","last_change":"2023-11-28T20:00:12.778685+0000","last_active":"2023-11-28T20:00:12.764355+0000","last_peered":"2023-11-28T20:00:12.764355+0000","last_clean":"2023-11-28T20:00:12.764355+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:00:12.778685+0000","last_undegraded":"2023-11-28T20:00:12.778685+0000","last_fullsized":"2023-11-28T20:00:12.778685+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_clean_scrub_stamp":"2023-11-28T20:00:12.764355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2023-11-28T20:00:12.778411+0000","last_change":"2023-11-28T20:00:12.778411+0000","last_active":"2023-11-28T20:00:12.764355+0000","last_peered":"2023-11-28T20:00:12.764355+0000","last_clean":"2023-11-28T20:00:12.764355+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:00:12.778411+0000","last_undegraded":"2023-11-28T20:00:12.778411+0000","last_fullsized":"2023-11-28T20:00:12.778411+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_clean_scrub_stamp":"2023-11-28T20:00:12.764355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2023-11-28T20:00:12.784938+0000","last_change":"2023-11-28T20:00:12.784938+0000","last_active":"2023-11-28T20:00:12.764355+0000","last_peered":"2023-11-28T20:00:12.764355+0000","last_clean":"2023-11-28T20:00:12.764355+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:00:12.784938+0000","last_undegraded":"2023-11-28T20:00:12.784938+0000","last_fullsized":"2023-11-28T20:00:12.784938+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_clean_scrub_stamp":"2023-11-28T20:00:12.764355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2023-11-28T20:00:12.777818+0000","last_change":"2023-11-28T20:00:12.777818+0000","last_active":"2023-11-28T20:00:12.764355+0000","last_peered":"2023-11-28T20:00:12.764355+0000","last_clean":"2023-11-28T20:00:12.764355+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:00:12.777818+0000","last_undegraded":"2023-11-28T20:00:12.777818+0000","last_fullsized":"2023-11-28T20:00:12.777818+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_clean_scrub_stamp":"2023-11-28T20:00:12.764355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2023-11-28T20:00:12.787079+0000","last_change":"2023-11-28T20:00:12.787079+0000","last_active":"2023-11-28T20:00:12.764355+0000","last_peered":"2023-11-28T20:00:12.764355+0000","last_clean":"2023-11-28T20:00:12.764355+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:00:12.787079+0000","last_undegraded":"2023-11-28T20:00:12.787079+0000","last_fullsized":"2023-11-28T20:00:12.787079+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_clean_scrub_stamp":"2023-11-28T20:00:12.764355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2023-11-28T20:00:12.779329+0000","last_change":"2023-11-28T20:00:12.779329+0000","last_active":"2023-11-28T20:00:12.764355+0000","last_peered":"2023-11-28T20:00:12.764355+0000","last_clean":"2023-11-28T20:00:12.764355+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:00:12.779329+0000","last_undegraded":"2023-11-28T20:00:12.779329+0000","last_fullsized":"2023-11-28T20:00:12.779329+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_clean_scrub_stamp":"2023-11-28T20:00:12.764355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2023-11-28T20:00:12.778067+0000","last_change":"2023-11-28T20:00:12.778067+0000","last_active":"2023-11-28T20:00:12.764355+0000","last_peered":"2023-11-28T20:00:12.764355+0000","last_clean":"2023-11-28T20:00:12.764355+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:00:12.778067+0000","last_undegraded":"2023-11-28T20:00:12.778067+0000","last_fullsized":"2023-11-28T20:00:12.778067+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_clean_scrub_stamp":"2023-11-28T20:00:12.764355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2023-11-28T20:00:12.785172+0000","last_change":"2023-11-28T20:00:12.785172+0000","last_active":"2023-11-28T20:00:12.764355+0000","last_peered":"2023-11-28T20:00:12.764355+0000","last_clean":"2023-11-28T20:00:12.764355+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:00:12.785172+0000","last_undegraded":"2023-11-28T20:00:12.785172+0000","last_fullsized":"2023-11-28T20:00:12.785172+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_clean_scrub_stamp":"2023-11-28T20:00:12.764355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2023-11-28T20:00:12.783287+0000","last_change":"2023-11-28T20:00:12.783287+0000","last_active":"2023-11-28T20:00:12.764355+0000","last_peered":"2023-11-28T20:00:12.764355+0000","last_clean":"2023-11-28T20:00:12.764355+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:00:12.783287+0000","last_undegraded":"2023-11-28T20:00:12.783287+0000","last_fullsized":"2023-11-28T20:00:12.783287+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_clean_scrub_stamp":"2023-11-28T20:00:12.764355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2023-11-28T20:00:12.784405+0000","last_change":"2023-11-28T20:00:12.784405+0000","last_active":"2023-11-28T20:00:12.764355+0000","last_peered":"2023-11-28T20:00:12.764355+0000","last_clean":"2023-11-28T20:00:12.764355+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:00:12.784405+0000","last_undegraded":"2023-11-28T20:00:12.784405+0000","last_fullsized":"2023-11-28T20:00:12.784405+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_clean_scrub_stamp":"2023-11-28T20:00:12.764355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-28T20:00:12.802099+0000","last_change":"2023-11-28T20:00:12.794933+0000","last_active":"2023-11-28T20:00:12.802099+0000","last_peered":"2023-11-28T20:00:12.802099+0000","last_clean":"2023-11-28T20:00:12.802099+0000","last_became_active":"2023-11-28T20:00:12.794598+0000","last_became_peered":"2023-11-28T20:00:12.794598+0000","last_unstale":"2023-11-28T20:00:12.802099+0000","last_undegraded":"2023-11-28T20:00:12.802099+0000","last_fullsized":"2023-11-28T20:00:12.802099+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:11.760656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:11.760656+0000","last_clean_scrub_stamp":"2023-11-28T20:00:11.760656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:49:36.064771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2023-11-28T20:00:12.785747+0000","last_change":"2023-11-28T20:00:12.785747+0000","last_active":"2023-11-28T20:00:12.764355+0000","last_peered":"2023-11-28T20:00:12.764355+0000","last_clean":"2023-11-28T20:00:12.764355+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:00:12.785747+0000","last_undegraded":"2023-11-28T20:00:12.785747+0000","last_fullsized":"2023-11-28T20:00:12.785747+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_clean_scrub_stamp":"2023-11-28T20:00:12.764355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-28T20:00:12.796674+0000","last_change":"2023-11-28T20:00:12.794372+0000","last_active":"2023-11-28T20:00:12.796674+0000","last_peered":"2023-11-28T20:00:12.796674+0000","last_clean":"2023-11-28T20:00:12.796674+0000","last_became_active":"2023-11-28T20:00:12.794166+0000","last_became_peered":"2023-11-28T20:00:12.794166+0000","last_unstale":"2023-11-28T20:00:12.796674+0000","last_undegraded":"2023-11-28T20:00:12.796674+0000","last_fullsized":"2023-11-28T20:00:12.796674+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:11.760656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:11.760656+0000","last_clean_scrub_stamp":"2023-11-28T20:00:11.760656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:19:33.219723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2023-11-28T20:00:12.782867+0000","last_change":"2023-11-28T20:00:12.782867+0000","last_active":"2023-11-28T20:00:12.764355+0000","last_peered":"2023-11-28T20:00:12.764355+0000","last_clean":"2023-11-28T20:00:12.764355+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:00:12.782867+0000","last_undegraded":"2023-11-28T20:00:12.782867+0000","last_fullsized":"2023-11-28T20:00:12.782867+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_clean_scrub_stamp":"2023-11-28T20:00:12.764355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-28T20:00:12.802319+0000","last_change":"2023-11-28T20:00:12.797247+0000","last_active":"2023-11-28T20:00:12.802319+0000","last_peered":"2023-11-28T20:00:12.802319+0000","last_clean":"2023-11-28T20:00:12.802319+0000","last_became_active":"2023-11-28T20:00:12.797003+0000","last_became_peered":"2023-11-28T20:00:12.797003+0000","last_unstale":"2023-11-28T20:00:12.802319+0000","last_undegraded":"2023-11-28T20:00:12.802319+0000","last_fullsized":"2023-11-28T20:00:12.802319+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:11.760656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:11.760656+0000","last_clean_scrub_stamp":"2023-11-28T20:00:11.760656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:21:43.946565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2023-11-28T20:00:12.786170+0000","last_change":"2023-11-28T20:00:12.786170+0000","last_active":"2023-11-28T20:00:12.764355+0000","last_peered":"2023-11-28T20:00:12.764355+0000","last_clean":"2023-11-28T20:00:12.764355+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:00:12.786170+0000","last_undegraded":"2023-11-28T20:00:12.786170+0000","last_fullsized":"2023-11-28T20:00:12.786170+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_clean_scrub_stamp":"2023-11-28T20:00:12.764355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-28T20:00:12.800895+0000","last_change":"2023-11-28T20:00:12.799178+0000","last_active":"2023-11-28T20:00:12.800895+0000","last_peered":"2023-11-28T20:00:12.800895+0000","last_clean":"2023-11-28T20:00:12.800895+0000","last_became_active":"2023-11-28T20:00:12.798834+0000","last_became_peered":"2023-11-28T20:00:12.798834+0000","last_unstale":"2023-11-28T20:00:12.800895+0000","last_undegraded":"2023-11-28T20:00:12.800895+0000","last_fullsized":"2023-11-28T20:00:12.800895+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:11.760656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:11.760656+0000","last_clean_scrub_stamp":"2023-11-28T20:00:11.760656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:08:56.081544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2023-11-28T20:00:12.782917+0000","last_change":"2023-11-28T20:00:12.782917+0000","last_active":"2023-11-28T20:00:12.764355+0000","last_peered":"2023-11-28T20:00:12.764355+0000","last_clean":"2023-11-28T20:00:12.764355+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:00:12.782917+0000","last_undegraded":"2023-11-28T20:00:12.782917+0000","last_fullsized":"2023-11-28T20:00:12.782917+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_clean_scrub_stamp":"2023-11-28T20:00:12.764355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-28T20:00:12.807652+0000","last_change":"2023-11-28T20:00:12.804157+0000","last_active":"2023-11-28T20:00:12.807652+0000","last_peered":"2023-11-28T20:00:12.807652+0000","last_clean":"2023-11-28T20:00:12.807652+0000","last_became_active":"2023-11-28T20:00:12.803950+0000","last_became_peered":"2023-11-28T20:00:12.803950+0000","last_unstale":"2023-11-28T20:00:12.807652+0000","last_undegraded":"2023-11-28T20:00:12.807652+0000","last_fullsized":"2023-11-28T20:00:12.807652+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:11.760656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:11.760656+0000","last_clean_scrub_stamp":"2023-11-28T20:00:11.760656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:38:54.348106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2023-11-28T20:00:12.787659+0000","last_change":"2023-11-28T20:00:12.787659+0000","last_active":"2023-11-28T20:00:12.764355+0000","last_peered":"2023-11-28T20:00:12.764355+0000","last_clean":"2023-11-28T20:00:12.764355+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:00:12.787659+0000","last_undegraded":"2023-11-28T20:00:12.787659+0000","last_fullsized":"2023-11-28T20:00:12.787659+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_clean_scrub_stamp":"2023-11-28T20:00:12.764355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-28T20:00:12.799490+0000","last_change":"2023-11-28T20:00:12.797188+0000","last_active":"2023-11-28T20:00:12.799490+0000","last_peered":"2023-11-28T20:00:12.799490+0000","last_clean":"2023-11-28T20:00:12.799490+0000","last_became_active":"2023-11-28T20:00:12.796926+0000","last_became_peered":"2023-11-28T20:00:12.796926+0000","last_unstale":"2023-11-28T20:00:12.799490+0000","last_undegraded":"2023-11-28T20:00:12.799490+0000","last_fullsized":"2023-11-28T20:00:12.799490+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:11.760656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:11.760656+0000","last_clean_scrub_stamp":"2023-11-28T20:00:11.760656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:19:33.219723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2023-11-28T20:00:12.782226+0000","last_change":"2023-11-28T20:00:12.782226+0000","last_active":"2023-11-28T20:00:12.764355+0000","last_peered":"2023-11-28T20:00:12.764355+0000","last_clean":"2023-11-28T20:00:12.764355+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:00:12.782226+0000","last_undegraded":"2023-11-28T20:00:12.782226+0000","last_fullsized":"2023-11-28T20:00:12.782226+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_clean_scrub_stamp":"2023-11-28T20:00:12.764355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-28T20:00:12.809928+0000","last_change":"2023-11-28T20:00:12.805374+0000","last_active":"2023-11-28T20:00:12.809928+0000","last_peered":"2023-11-28T20:00:12.809928+0000","last_clean":"2023-11-28T20:00:12.809928+0000","last_became_active":"2023-11-28T20:00:12.805094+0000","last_became_peered":"2023-11-28T20:00:12.805094+0000","last_unstale":"2023-11-28T20:00:12.809928+0000","last_undegraded":"2023-11-28T20:00:12.809928+0000","last_fullsized":"2023-11-28T20:00:12.809928+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:11.760656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:11.760656+0000","last_clean_scrub_stamp":"2023-11-28T20:00:11.760656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:09:51.354913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2023-11-28T20:00:12.785875+0000","last_change":"2023-11-28T20:00:12.785875+0000","last_active":"2023-11-28T20:00:12.764355+0000","last_peered":"2023-11-28T20:00:12.764355+0000","last_clean":"2023-11-28T20:00:12.764355+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:00:12.785875+0000","last_undegraded":"2023-11-28T20:00:12.785875+0000","last_fullsized":"2023-11-28T20:00:12.785875+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_clean_scrub_stamp":"2023-11-28T20:00:12.764355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-28T20:00:12.799056+0000","last_change":"2023-11-28T20:00:12.797265+0000","last_active":"2023-11-28T20:00:12.799056+0000","last_peered":"2023-11-28T20:00:12.799056+0000","last_clean":"2023-11-28T20:00:12.799056+0000","last_became_active":"2023-11-28T20:00:12.794418+0000","last_became_peered":"2023-11-28T20:00:12.794418+0000","last_unstale":"2023-11-28T20:00:12.799056+0000","last_undegraded":"2023-11-28T20:00:12.799056+0000","last_fullsized":"2023-11-28T20:00:12.799056+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:11.760656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:11.760656+0000","last_clean_scrub_stamp":"2023-11-28T20:00:11.760656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:05:35.913865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2023-11-28T20:00:12.777621+0000","last_change":"2023-11-28T20:00:12.777621+0000","last_active":"2023-11-28T20:00:12.764355+0000","last_peered":"2023-11-28T20:00:12.764355+0000","last_clean":"2023-11-28T20:00:12.764355+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:00:12.777621+0000","last_undegraded":"2023-11-28T20:00:12.777621+0000","last_fullsized":"2023-11-28T20:00:12.777621+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_clean_scrub_stamp":"2023-11-28T20:00:12.764355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-28T20:00:12.802016+0000","last_change":"2023-11-28T20:00:12.796227+0000","last_active":"2023-11-28T20:00:12.802016+0000","last_peered":"2023-11-28T20:00:12.802016+0000","last_clean":"2023-11-28T20:00:12.802016+0000","last_became_active":"2023-11-28T20:00:12.795944+0000","last_became_peered":"2023-11-28T20:00:12.795944+0000","last_unstale":"2023-11-28T20:00:12.802016+0000","last_undegraded":"2023-11-28T20:00:12.802016+0000","last_fullsized":"2023-11-28T20:00:12.802016+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:11.760656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:11.760656+0000","last_clean_scrub_stamp":"2023-11-28T20:00:11.760656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:31:39.960893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2023-11-28T20:00:12.785784+0000","last_change":"2023-11-28T20:00:12.785784+0000","last_active":"2023-11-28T20:00:12.764355+0000","last_peered":"2023-11-28T20:00:12.764355+0000","last_clean":"2023-11-28T20:00:12.764355+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:00:12.785784+0000","last_undegraded":"2023-11-28T20:00:12.785784+0000","last_fullsized":"2023-11-28T20:00:12.785784+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_clean_scrub_stamp":"2023-11-28T20:00:12.764355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-28T20:00:12.807231+0000","last_change":"2023-11-28T20:00:12.803866+0000","last_active":"2023-11-28T20:00:12.807231+0000","last_peered":"2023-11-28T20:00:12.807231+0000","last_clean":"2023-11-28T20:00:12.807231+0000","last_became_active":"2023-11-28T20:00:12.803431+0000","last_became_peered":"2023-11-28T20:00:12.803431+0000","last_unstale":"2023-11-28T20:00:12.807231+0000","last_undegraded":"2023-11-28T20:00:12.807231+0000","last_fullsized":"2023-11-28T20:00:12.807231+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:11.760656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:11.760656+0000","last_clean_scrub_stamp":"2023-11-28T20:00:11.760656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:39:04.449924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2023-11-28T20:00:12.782260+0000","last_change":"2023-11-28T20:00:12.782260+0000","last_active":"2023-11-28T20:00:12.764355+0000","last_peered":"2023-11-28T20:00:12.764355+0000","last_clean":"2023-11-28T20:00:12.764355+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:00:12.782260+0000","last_undegraded":"2023-11-28T20:00:12.782260+0000","last_fullsized":"2023-11-28T20:00:12.782260+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_clean_scrub_stamp":"2023-11-28T20:00:12.764355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-28T20:00:12.807316+0000","last_change":"2023-11-28T20:00:12.804096+0000","last_active":"2023-11-28T20:00:12.807316+0000","last_peered":"2023-11-28T20:00:12.807316+0000","last_clean":"2023-11-28T20:00:12.807316+0000","last_became_active":"2023-11-28T20:00:12.803797+0000","last_became_peered":"2023-11-28T20:00:12.803797+0000","last_unstale":"2023-11-28T20:00:12.807316+0000","last_undegraded":"2023-11-28T20:00:12.807316+0000","last_fullsized":"2023-11-28T20:00:12.807316+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:11.760656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:11.760656+0000","last_clean_scrub_stamp":"2023-11-28T20:00:11.760656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:22:32.210725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2023-11-28T20:00:12.783554+0000","last_change":"2023-11-28T20:00:12.783554+0000","last_active":"2023-11-28T20:00:12.764355+0000","last_peered":"2023-11-28T20:00:12.764355+0000","last_clean":"2023-11-28T20:00:12.764355+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:00:12.783554+0000","last_undegraded":"2023-11-28T20:00:12.783554+0000","last_fullsized":"2023-11-28T20:00:12.783554+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_clean_scrub_stamp":"2023-11-28T20:00:12.764355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-28T20:00:12.802061+0000","last_change":"2023-11-28T20:00:12.797894+0000","last_active":"2023-11-28T20:00:12.802061+0000","last_peered":"2023-11-28T20:00:12.802061+0000","last_clean":"2023-11-28T20:00:12.802061+0000","last_became_active":"2023-11-28T20:00:12.797594+0000","last_became_peered":"2023-11-28T20:00:12.797594+0000","last_unstale":"2023-11-28T20:00:12.802061+0000","last_undegraded":"2023-11-28T20:00:12.802061+0000","last_fullsized":"2023-11-28T20:00:12.802061+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:11.760656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:11.760656+0000","last_clean_scrub_stamp":"2023-11-28T20:00:11.760656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:18:17.461220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2023-11-28T20:00:12.782220+0000","last_change":"2023-11-28T20:00:12.782220+0000","last_active":"2023-11-28T20:00:12.764355+0000","last_peered":"2023-11-28T20:00:12.764355+0000","last_clean":"2023-11-28T20:00:12.764355+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:00:12.782220+0000","last_undegraded":"2023-11-28T20:00:12.782220+0000","last_fullsized":"2023-11-28T20:00:12.782220+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_clean_scrub_stamp":"2023-11-28T20:00:12.764355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-28T20:00:12.801117+0000","last_change":"2023-11-28T20:00:12.794915+0000","last_active":"2023-11-28T20:00:12.801117+0000","last_peered":"2023-11-28T20:00:12.801117+0000","last_clean":"2023-11-28T20:00:12.801117+0000","last_became_active":"2023-11-28T20:00:12.793728+0000","last_became_peered":"2023-11-28T20:00:12.793728+0000","last_unstale":"2023-11-28T20:00:12.801117+0000","last_undegraded":"2023-11-28T20:00:12.801117+0000","last_fullsized":"2023-11-28T20:00:12.801117+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:11.760656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:11.760656+0000","last_clean_scrub_stamp":"2023-11-28T20:00:11.760656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:30:40.433274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2023-11-28T20:00:12.783042+0000","last_change":"2023-11-28T20:00:12.783042+0000","last_active":"2023-11-28T20:00:12.764355+0000","last_peered":"2023-11-28T20:00:12.764355+0000","last_clean":"2023-11-28T20:00:12.764355+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:00:12.783042+0000","last_undegraded":"2023-11-28T20:00:12.783042+0000","last_fullsized":"2023-11-28T20:00:12.783042+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_clean_scrub_stamp":"2023-11-28T20:00:12.764355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-28T20:00:12.809921+0000","last_change":"2023-11-28T20:00:12.805313+0000","last_active":"2023-11-28T20:00:12.809921+0000","last_peered":"2023-11-28T20:00:12.809921+0000","last_clean":"2023-11-28T20:00:12.809921+0000","last_became_active":"2023-11-28T20:00:12.804998+0000","last_became_peered":"2023-11-28T20:00:12.804998+0000","last_unstale":"2023-11-28T20:00:12.809921+0000","last_undegraded":"2023-11-28T20:00:12.809921+0000","last_fullsized":"2023-11-28T20:00:12.809921+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:11.760656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:11.760656+0000","last_clean_scrub_stamp":"2023-11-28T20:00:11.760656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:55:34.737227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2023-11-28T20:00:12.784155+0000","last_change":"2023-11-28T20:00:12.784155+0000","last_active":"2023-11-28T20:00:12.764355+0000","last_peered":"2023-11-28T20:00:12.764355+0000","last_clean":"2023-11-28T20:00:12.764355+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:00:12.784155+0000","last_undegraded":"2023-11-28T20:00:12.784155+0000","last_fullsized":"2023-11-28T20:00:12.784155+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_clean_scrub_stamp":"2023-11-28T20:00:12.764355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-28T20:00:12.792278+0000","last_change":"2023-11-28T20:00:12.789146+0000","last_active":"2023-11-28T20:00:12.792278+0000","last_peered":"2023-11-28T20:00:12.792278+0000","last_clean":"2023-11-28T20:00:12.792278+0000","last_became_active":"2023-11-28T20:00:12.788447+0000","last_became_peered":"2023-11-28T20:00:12.788447+0000","last_unstale":"2023-11-28T20:00:12.792278+0000","last_undegraded":"2023-11-28T20:00:12.792278+0000","last_fullsized":"2023-11-28T20:00:12.792278+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:11.760656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:11.760656+0000","last_clean_scrub_stamp":"2023-11-28T20:00:11.760656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:51:42.810996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2023-11-28T20:00:12.784798+0000","last_change":"2023-11-28T20:00:12.784798+0000","last_active":"2023-11-28T20:00:12.764355+0000","last_peered":"2023-11-28T20:00:12.764355+0000","last_clean":"2023-11-28T20:00:12.764355+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:00:12.784798+0000","last_undegraded":"2023-11-28T20:00:12.784798+0000","last_fullsized":"2023-11-28T20:00:12.784798+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_clean_scrub_stamp":"2023-11-28T20:00:12.764355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-28T20:00:12.800818+0000","last_change":"2023-11-28T20:00:12.799040+0000","last_active":"2023-11-28T20:00:12.800818+0000","last_peered":"2023-11-28T20:00:12.800818+0000","last_clean":"2023-11-28T20:00:12.800818+0000","last_became_active":"2023-11-28T20:00:12.798730+0000","last_became_peered":"2023-11-28T20:00:12.798730+0000","last_unstale":"2023-11-28T20:00:12.800818+0000","last_undegraded":"2023-11-28T20:00:12.800818+0000","last_fullsized":"2023-11-28T20:00:12.800818+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:11.760656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:11.760656+0000","last_clean_scrub_stamp":"2023-11-28T20:00:11.760656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T06:41:49.723414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2023-11-28T20:00:12.786939+0000","last_change":"2023-11-28T20:00:12.786939+0000","last_active":"2023-11-28T20:00:12.764355+0000","last_peered":"2023-11-28T20:00:12.764355+0000","last_clean":"2023-11-28T20:00:12.764355+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:00:12.786939+0000","last_undegraded":"2023-11-28T20:00:12.786939+0000","last_fullsized":"2023-11-28T20:00:12.786939+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_clean_scrub_stamp":"2023-11-28T20:00:12.764355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-28T20:00:12.807215+0000","last_change":"2023-11-28T20:00:12.803142+0000","last_active":"2023-11-28T20:00:12.807215+0000","last_peered":"2023-11-28T20:00:12.807215+0000","last_clean":"2023-11-28T20:00:12.807215+0000","last_became_active":"2023-11-28T20:00:12.802775+0000","last_became_peered":"2023-11-28T20:00:12.802775+0000","last_unstale":"2023-11-28T20:00:12.807215+0000","last_undegraded":"2023-11-28T20:00:12.807215+0000","last_fullsized":"2023-11-28T20:00:12.807215+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:11.760656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:11.760656+0000","last_clean_scrub_stamp":"2023-11-28T20:00:11.760656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:31:56.988459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2023-11-28T20:00:12.793965+0000","last_change":"2023-11-28T20:00:12.793965+0000","last_active":"2023-11-28T20:00:12.764355+0000","last_peered":"2023-11-28T20:00:12.764355+0000","last_clean":"2023-11-28T20:00:12.764355+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:00:12.793965+0000","last_undegraded":"2023-11-28T20:00:12.793965+0000","last_fullsized":"2023-11-28T20:00:12.793965+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_clean_scrub_stamp":"2023-11-28T20:00:12.764355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-28T20:00:12.807286+0000","last_change":"2023-11-28T20:00:12.806331+0000","last_active":"2023-11-28T20:00:12.807286+0000","last_peered":"2023-11-28T20:00:12.807286+0000","last_clean":"2023-11-28T20:00:12.807286+0000","last_became_active":"2023-11-28T20:00:12.805857+0000","last_became_peered":"2023-11-28T20:00:12.805857+0000","last_unstale":"2023-11-28T20:00:12.807286+0000","last_undegraded":"2023-11-28T20:00:12.807286+0000","last_fullsized":"2023-11-28T20:00:12.807286+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:11.760656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:11.760656+0000","last_clean_scrub_stamp":"2023-11-28T20:00:11.760656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:07:27.330964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2023-11-28T20:00:12.783371+0000","last_change":"2023-11-28T20:00:12.783371+0000","last_active":"2023-11-28T20:00:12.764355+0000","last_peered":"2023-11-28T20:00:12.764355+0000","last_clean":"2023-11-28T20:00:12.764355+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:00:12.783371+0000","last_undegraded":"2023-11-28T20:00:12.783371+0000","last_fullsized":"2023-11-28T20:00:12.783371+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_clean_scrub_stamp":"2023-11-28T20:00:12.764355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-28T20:00:12.802514+0000","last_change":"2023-11-28T20:00:12.796923+0000","last_active":"2023-11-28T20:00:12.802514+0000","last_peered":"2023-11-28T20:00:12.802514+0000","last_clean":"2023-11-28T20:00:12.802514+0000","last_became_active":"2023-11-28T20:00:12.796625+0000","last_became_peered":"2023-11-28T20:00:12.796625+0000","last_unstale":"2023-11-28T20:00:12.802514+0000","last_undegraded":"2023-11-28T20:00:12.802514+0000","last_fullsized":"2023-11-28T20:00:12.802514+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:11.760656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:11.760656+0000","last_clean_scrub_stamp":"2023-11-28T20:00:11.760656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:48:42.030591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2023-11-28T20:00:12.782363+0000","last_change":"2023-11-28T20:00:12.782363+0000","last_active":"2023-11-28T20:00:12.764355+0000","last_peered":"2023-11-28T20:00:12.764355+0000","last_clean":"2023-11-28T20:00:12.764355+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:00:12.782363+0000","last_undegraded":"2023-11-28T20:00:12.782363+0000","last_fullsized":"2023-11-28T20:00:12.782363+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_clean_scrub_stamp":"2023-11-28T20:00:12.764355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-28T20:00:12.801643+0000","last_change":"2023-11-28T20:00:12.796705+0000","last_active":"2023-11-28T20:00:12.801643+0000","last_peered":"2023-11-28T20:00:12.801643+0000","last_clean":"2023-11-28T20:00:12.801643+0000","last_became_active":"2023-11-28T20:00:12.796394+0000","last_became_peered":"2023-11-28T20:00:12.796394+0000","last_unstale":"2023-11-28T20:00:12.801643+0000","last_undegraded":"2023-11-28T20:00:12.801643+0000","last_fullsized":"2023-11-28T20:00:12.801643+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:11.760656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:11.760656+0000","last_clean_scrub_stamp":"2023-11-28T20:00:11.760656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T06:41:49.723414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2023-11-28T20:00:12.785552+0000","last_change":"2023-11-28T20:00:12.785552+0000","last_active":"2023-11-28T20:00:12.764355+0000","last_peered":"2023-11-28T20:00:12.764355+0000","last_clean":"2023-11-28T20:00:12.764355+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:00:12.785552+0000","last_undegraded":"2023-11-28T20:00:12.785552+0000","last_fullsized":"2023-11-28T20:00:12.785552+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_clean_scrub_stamp":"2023-11-28T20:00:12.764355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-28T20:00:12.791923+0000","last_change":"2023-11-28T20:00:12.787168+0000","last_active":"2023-11-28T20:00:12.791923+0000","last_peered":"2023-11-28T20:00:12.791923+0000","last_clean":"2023-11-28T20:00:12.791923+0000","last_became_active":"2023-11-28T20:00:12.786815+0000","last_became_peered":"2023-11-28T20:00:12.786815+0000","last_unstale":"2023-11-28T20:00:12.791923+0000","last_undegraded":"2023-11-28T20:00:12.791923+0000","last_fullsized":"2023-11-28T20:00:12.791923+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:11.760656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:11.760656+0000","last_clean_scrub_stamp":"2023-11-28T20:00:11.760656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T06:48:23.539826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2023-11-28T20:00:12.779217+0000","last_change":"2023-11-28T20:00:12.779217+0000","last_active":"2023-11-28T20:00:12.764355+0000","last_peered":"2023-11-28T20:00:12.764355+0000","last_clean":"2023-11-28T20:00:12.764355+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:00:12.779217+0000","last_undegraded":"2023-11-28T20:00:12.779217+0000","last_fullsized":"2023-11-28T20:00:12.779217+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_clean_scrub_stamp":"2023-11-28T20:00:12.764355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-28T20:00:12.792018+0000","last_change":"2023-11-28T20:00:12.789615+0000","last_active":"2023-11-28T20:00:12.792018+0000","last_peered":"2023-11-28T20:00:12.792018+0000","last_clean":"2023-11-28T20:00:12.792018+0000","last_became_active":"2023-11-28T20:00:12.789357+0000","last_became_peered":"2023-11-28T20:00:12.789357+0000","last_unstale":"2023-11-28T20:00:12.792018+0000","last_undegraded":"2023-11-28T20:00:12.792018+0000","last_fullsized":"2023-11-28T20:00:12.792018+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:11.760656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:11.760656+0000","last_clean_scrub_stamp":"2023-11-28T20:00:11.760656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:51:47.744006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2023-11-28T20:00:12.787340+0000","last_change":"2023-11-28T20:00:12.787340+0000","last_active":"2023-11-28T20:00:12.764355+0000","last_peered":"2023-11-28T20:00:12.764355+0000","last_clean":"2023-11-28T20:00:12.764355+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:00:12.787340+0000","last_undegraded":"2023-11-28T20:00:12.787340+0000","last_fullsized":"2023-11-28T20:00:12.787340+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_clean_scrub_stamp":"2023-11-28T20:00:12.764355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-28T20:00:12.797956+0000","last_change":"2023-11-28T20:00:12.794799+0000","last_active":"2023-11-28T20:00:12.797956+0000","last_peered":"2023-11-28T20:00:12.797956+0000","last_clean":"2023-11-28T20:00:12.797956+0000","last_became_active":"2023-11-28T20:00:12.794535+0000","last_became_peered":"2023-11-28T20:00:12.794535+0000","last_unstale":"2023-11-28T20:00:12.797956+0000","last_undegraded":"2023-11-28T20:00:12.797956+0000","last_fullsized":"2023-11-28T20:00:12.797956+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:11.760656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:11.760656+0000","last_clean_scrub_stamp":"2023-11-28T20:00:11.760656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:21:43.946565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2023-11-28T20:00:12.783254+0000","last_change":"2023-11-28T20:00:12.783254+0000","last_active":"2023-11-28T20:00:12.764355+0000","last_peered":"2023-11-28T20:00:12.764355+0000","last_clean":"2023-11-28T20:00:12.764355+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:00:12.783254+0000","last_undegraded":"2023-11-28T20:00:12.783254+0000","last_fullsized":"2023-11-28T20:00:12.783254+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_clean_scrub_stamp":"2023-11-28T20:00:12.764355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-28T20:00:12.791952+0000","last_change":"2023-11-28T20:00:12.787505+0000","last_active":"2023-11-28T20:00:12.791952+0000","last_peered":"2023-11-28T20:00:12.791952+0000","last_clean":"2023-11-28T20:00:12.791952+0000","last_became_active":"2023-11-28T20:00:12.786509+0000","last_became_peered":"2023-11-28T20:00:12.786509+0000","last_unstale":"2023-11-28T20:00:12.791952+0000","last_undegraded":"2023-11-28T20:00:12.791952+0000","last_fullsized":"2023-11-28T20:00:12.791952+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:11.760656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:11.760656+0000","last_clean_scrub_stamp":"2023-11-28T20:00:11.760656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:35:56.918733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2023-11-28T20:00:12.786470+0000","last_change":"2023-11-28T20:00:12.786470+0000","last_active":"2023-11-28T20:00:12.764355+0000","last_peered":"2023-11-28T20:00:12.764355+0000","last_clean":"2023-11-28T20:00:12.764355+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:00:12.786470+0000","last_undegraded":"2023-11-28T20:00:12.786470+0000","last_fullsized":"2023-11-28T20:00:12.786470+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_clean_scrub_stamp":"2023-11-28T20:00:12.764355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-28T20:00:12.807677+0000","last_change":"2023-11-28T20:00:12.804126+0000","last_active":"2023-11-28T20:00:12.807677+0000","last_peered":"2023-11-28T20:00:12.807677+0000","last_clean":"2023-11-28T20:00:12.807677+0000","last_became_active":"2023-11-28T20:00:12.803815+0000","last_became_peered":"2023-11-28T20:00:12.803815+0000","last_unstale":"2023-11-28T20:00:12.807677+0000","last_undegraded":"2023-11-28T20:00:12.807677+0000","last_fullsized":"2023-11-28T20:00:12.807677+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:11.760656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:11.760656+0000","last_clean_scrub_stamp":"2023-11-28T20:00:11.760656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T07:54:02.325947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2023-11-28T20:00:12.785219+0000","last_change":"2023-11-28T20:00:12.785219+0000","last_active":"2023-11-28T20:00:12.764355+0000","last_peered":"2023-11-28T20:00:12.764355+0000","last_clean":"2023-11-28T20:00:12.764355+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:00:12.785219+0000","last_undegraded":"2023-11-28T20:00:12.785219+0000","last_fullsized":"2023-11-28T20:00:12.785219+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_clean_scrub_stamp":"2023-11-28T20:00:12.764355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-28T20:00:12.807159+0000","last_change":"2023-11-28T20:00:12.804114+0000","last_active":"2023-11-28T20:00:12.807159+0000","last_peered":"2023-11-28T20:00:12.807159+0000","last_clean":"2023-11-28T20:00:12.807159+0000","last_became_active":"2023-11-28T20:00:12.803528+0000","last_became_peered":"2023-11-28T20:00:12.803528+0000","last_unstale":"2023-11-28T20:00:12.807159+0000","last_undegraded":"2023-11-28T20:00:12.807159+0000","last_fullsized":"2023-11-28T20:00:12.807159+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:11.760656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:11.760656+0000","last_clean_scrub_stamp":"2023-11-28T20:00:11.760656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:09:19.510844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2023-11-28T20:00:12.783641+0000","last_change":"2023-11-28T20:00:12.783641+0000","last_active":"2023-11-28T20:00:12.764355+0000","last_peered":"2023-11-28T20:00:12.764355+0000","last_clean":"2023-11-28T20:00:12.764355+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:00:12.783641+0000","last_undegraded":"2023-11-28T20:00:12.783641+0000","last_fullsized":"2023-11-28T20:00:12.783641+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_clean_scrub_stamp":"2023-11-28T20:00:12.764355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-28T20:00:12.797021+0000","last_change":"2023-11-28T20:00:12.795099+0000","last_active":"2023-11-28T20:00:12.797021+0000","last_peered":"2023-11-28T20:00:12.797021+0000","last_clean":"2023-11-28T20:00:12.797021+0000","last_became_active":"2023-11-28T20:00:12.794522+0000","last_became_peered":"2023-11-28T20:00:12.794522+0000","last_unstale":"2023-11-28T20:00:12.797021+0000","last_undegraded":"2023-11-28T20:00:12.797021+0000","last_fullsized":"2023-11-28T20:00:12.797021+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:11.760656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:11.760656+0000","last_clean_scrub_stamp":"2023-11-28T20:00:11.760656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:43:03.956082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2023-11-28T20:00:12.778768+0000","last_change":"2023-11-28T20:00:12.778768+0000","last_active":"2023-11-28T20:00:12.764355+0000","last_peered":"2023-11-28T20:00:12.764355+0000","last_clean":"2023-11-28T20:00:12.764355+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:00:12.778768+0000","last_undegraded":"2023-11-28T20:00:12.778768+0000","last_fullsized":"2023-11-28T20:00:12.778768+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_clean_scrub_stamp":"2023-11-28T20:00:12.764355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-28T20:00:12.795504+0000","last_change":"2023-11-28T20:00:12.792743+0000","last_active":"2023-11-28T20:00:12.795504+0000","last_peered":"2023-11-28T20:00:12.795504+0000","last_clean":"2023-11-28T20:00:12.795504+0000","last_became_active":"2023-11-28T20:00:12.792420+0000","last_became_peered":"2023-11-28T20:00:12.792420+0000","last_unstale":"2023-11-28T20:00:12.795504+0000","last_undegraded":"2023-11-28T20:00:12.795504+0000","last_fullsized":"2023-11-28T20:00:12.795504+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:11.760656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:11.760656+0000","last_clean_scrub_stamp":"2023-11-28T20:00:11.760656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:49:36.064771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2023-11-28T20:00:12.788073+0000","last_change":"2023-11-28T20:00:12.788073+0000","last_active":"2023-11-28T20:00:12.764355+0000","last_peered":"2023-11-28T20:00:12.764355+0000","last_clean":"2023-11-28T20:00:12.764355+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:00:12.788073+0000","last_undegraded":"2023-11-28T20:00:12.788073+0000","last_fullsized":"2023-11-28T20:00:12.788073+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_clean_scrub_stamp":"2023-11-28T20:00:12.764355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-28T20:00:12.801066+0000","last_change":"2023-11-28T20:00:12.793819+0000","last_active":"2023-11-28T20:00:12.801066+0000","last_peered":"2023-11-28T20:00:12.801066+0000","last_clean":"2023-11-28T20:00:12.801066+0000","last_became_active":"2023-11-28T20:00:12.793027+0000","last_became_peered":"2023-11-28T20:00:12.793027+0000","last_unstale":"2023-11-28T20:00:12.801066+0000","last_undegraded":"2023-11-28T20:00:12.801066+0000","last_fullsized":"2023-11-28T20:00:12.801066+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:11.760656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:11.760656+0000","last_clean_scrub_stamp":"2023-11-28T20:00:11.760656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:43:03.956082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2023-11-28T20:00:12.783249+0000","last_change":"2023-11-28T20:00:12.783249+0000","last_active":"2023-11-28T20:00:12.764355+0000","last_peered":"2023-11-28T20:00:12.764355+0000","last_clean":"2023-11-28T20:00:12.764355+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:00:12.783249+0000","last_undegraded":"2023-11-28T20:00:12.783249+0000","last_fullsized":"2023-11-28T20:00:12.783249+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_clean_scrub_stamp":"2023-11-28T20:00:12.764355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-28T20:00:12.796446+0000","last_change":"2023-11-28T20:00:12.790049+0000","last_active":"2023-11-28T20:00:12.796446+0000","last_peered":"2023-11-28T20:00:12.796446+0000","last_clean":"2023-11-28T20:00:12.796446+0000","last_became_active":"2023-11-28T20:00:12.789755+0000","last_became_peered":"2023-11-28T20:00:12.789755+0000","last_unstale":"2023-11-28T20:00:12.796446+0000","last_undegraded":"2023-11-28T20:00:12.796446+0000","last_fullsized":"2023-11-28T20:00:12.796446+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:11.760656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:11.760656+0000","last_clean_scrub_stamp":"2023-11-28T20:00:11.760656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:29:35.927577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2023-11-28T20:00:12.784248+0000","last_change":"2023-11-28T20:00:12.784248+0000","last_active":"2023-11-28T20:00:12.764355+0000","last_peered":"2023-11-28T20:00:12.764355+0000","last_clean":"2023-11-28T20:00:12.764355+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:00:12.784248+0000","last_undegraded":"2023-11-28T20:00:12.784248+0000","last_fullsized":"2023-11-28T20:00:12.784248+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_clean_scrub_stamp":"2023-11-28T20:00:12.764355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-28T20:00:12.801088+0000","last_change":"2023-11-28T20:00:12.794531+0000","last_active":"2023-11-28T20:00:12.801088+0000","last_peered":"2023-11-28T20:00:12.801088+0000","last_clean":"2023-11-28T20:00:12.801088+0000","last_became_active":"2023-11-28T20:00:12.794205+0000","last_became_peered":"2023-11-28T20:00:12.794205+0000","last_unstale":"2023-11-28T20:00:12.801088+0000","last_undegraded":"2023-11-28T20:00:12.801088+0000","last_fullsized":"2023-11-28T20:00:12.801088+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:11.760656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:11.760656+0000","last_clean_scrub_stamp":"2023-11-28T20:00:11.760656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:18:52.212443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2023-11-28T20:00:12.792646+0000","last_change":"2023-11-28T20:00:12.792646+0000","last_active":"2023-11-28T20:00:12.764355+0000","last_peered":"2023-11-28T20:00:12.764355+0000","last_clean":"2023-11-28T20:00:12.764355+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:00:12.792646+0000","last_undegraded":"2023-11-28T20:00:12.792646+0000","last_fullsized":"2023-11-28T20:00:12.792646+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_clean_scrub_stamp":"2023-11-28T20:00:12.764355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-28T20:00:12.797985+0000","last_change":"2023-11-28T20:00:12.795584+0000","last_active":"2023-11-28T20:00:12.797985+0000","last_peered":"2023-11-28T20:00:12.797985+0000","last_clean":"2023-11-28T20:00:12.797985+0000","last_became_active":"2023-11-28T20:00:12.795179+0000","last_became_peered":"2023-11-28T20:00:12.795179+0000","last_unstale":"2023-11-28T20:00:12.797985+0000","last_undegraded":"2023-11-28T20:00:12.797985+0000","last_fullsized":"2023-11-28T20:00:12.797985+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:11.760656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:11.760656+0000","last_clean_scrub_stamp":"2023-11-28T20:00:11.760656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:55:34.737227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":178,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-28T20:00:11.776047+0000","last_change":"2023-11-28T19:58:56.136501+0000","last_active":"2023-11-28T20:00:11.776047+0000","last_peered":"2023-11-28T20:00:11.776047+0000","last_clean":"2023-11-28T20:00:11.776047+0000","last_became_active":"2023-11-28T19:58:56.135998+0000","last_became_peered":"2023-11-28T19:58:56.135998+0000","last_unstale":"2023-11-28T20:00:11.776047+0000","last_undegraded":"2023-11-28T20:00:11.776047+0000","last_fullsized":"2023-11-28T20:00:11.776047+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:58:54.602349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:58:54.602349+0000","last_clean_scrub_stamp":"2023-11-28T19:58:54.602349+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:33:42.723349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":66748,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574868,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27500,"kb_used_data":480,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344340,"statfs":{"total":96636764160,"available":96608604160,"internally_reserved":0,"allocated":491520,"data_stored":768840,"data_compressed":33374,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 19:59:54 2023","interfaces":[{"interface":"back","average":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":0.90700000000000003,"5min":0.90700000000000003,"15min":0.90700000000000003},"last":0.76300000000000001},{"interface":"front","average":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"min":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":0.98999999999999999,"5min":0.98999999999999999,"15min":0.98999999999999999},"last":0.61299999999999999}]},{"osd":1,"last update":"Tue Nov 28 19:59:54 2023","interfaces":[{"interface":"back","average":{"1min":0.64600000000000002,"5min":0.64600000000000002,"15min":0.64600000000000002},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":0.89600000000000002,"5min":0.89600000000000002,"15min":0.89600000000000002},"last":0.82899999999999996},{"interface":"front","average":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.70199999999999996},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":1.0900000000000001,"5min":1.0900000000000001,"15min":1.0900000000000001},"last":0.68899999999999995}]},{"osd":2,"last update":"Tue Nov 28 19:59:54 2023","interfaces":[{"interface":"back","average":{"1min":0.73499999999999999,"5min":0.73499999999999999,"15min":0.73499999999999999},"min":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"max":{"1min":0.98799999999999999,"5min":0.98799999999999999,"15min":0.98799999999999999},"last":0.81499999999999995},{"interface":"front","average":{"1min":0.70699999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":1.0680000000000001,"5min":1.0680000000000001,"15min":1.0680000000000001},"last":0.85599999999999998}]},{"osd":3,"last update":"Tue Nov 28 19:59:54 2023","interfaces":[{"interface":"back","average":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"min":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":1.0449999999999999,"5min":1.0449999999999999,"15min":1.0449999999999999},"last":0.876},{"interface":"front","average":{"1min":0.79300000000000004,"5min":0.79300000000000004,"15min":0.79300000000000004},"min":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"max":{"1min":1.1299999999999999,"5min":1.1299999999999999,"15min":1.1299999999999999},"last":0.84599999999999997}]},{"osd":4,"last update":"Tue Nov 28 19:59:54 2023","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":1.018,"5min":1.018,"15min":1.018},"last":0.51500000000000001},{"interface":"front","average":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"min":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.1120000000000001,"5min":1.1120000000000001,"15min":1.1120000000000001},"last":0.56599999999999995}]},{"osd":5,"last update":"Tue Nov 28 19:59:54 2023","interfaces":[{"interface":"back","average":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":1.1699999999999999,"5min":1.1699999999999999,"15min":1.1699999999999999},"last":0.46000000000000002},{"interface":"front","average":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"min":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":1.1890000000000001,"5min":1.1890000000000001,"15min":1.1890000000000001},"last":0.57999999999999996}]},{"osd":6,"last update":"Tue Nov 28 19:59:54 2023","interfaces":[{"interface":"back","average":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.78200000000000003},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":1.1379999999999999,"5min":1.1379999999999999,"15min":1.1379999999999999},"last":0.63700000000000001},{"interface":"front","average":{"1min":0.747,"5min":0.747,"15min":0.747},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.23,"5min":1.23,"15min":1.23},"last":0.64700000000000002}]}]},{"osd":6,"up_from":13,"seq":55834574866,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27436,"kb_used_data":416,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344404,"statfs":{"total":96636764160,"available":96608669696,"internally_reserved":0,"allocated":425984,"data_stored":178472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 19:59:53 2023","interfaces":[{"interface":"back","average":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.61599999999999999},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.82599999999999996,"5min":0.82599999999999996,"15min":0.82599999999999996},"last":0.58899999999999997},{"interface":"front","average":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":0.98999999999999999,"5min":0.98999999999999999,"15min":0.98999999999999999},"last":0.78700000000000003}]},{"osd":1,"last update":"Tue Nov 28 19:59:53 2023","interfaces":[{"interface":"back","average":{"1min":0.79100000000000004,"5min":0.79100000000000004,"15min":0.79100000000000004},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.105,"5min":1.105,"15min":1.105},"last":0.75900000000000001},{"interface":"front","average":{"1min":0.68700000000000006,"5min":0.68700000000000006,"15min":0.68700000000000006},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.95899999999999996,"5min":0.95899999999999996,"15min":0.95899999999999996},"last":0.67400000000000004}]},{"osd":2,"last update":"Tue Nov 28 19:59:53 2023","interfaces":[{"interface":"back","average":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"min":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":0.93400000000000005,"5min":0.93400000000000005,"15min":0.93400000000000005},"last":0.71899999999999997},{"interface":"front","average":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"min":{"1min":0.505,"5min":0.505,"15min":0.505},"max":{"1min":1.006,"5min":1.006,"15min":1.006},"last":0.77600000000000002}]},{"osd":3,"last update":"Tue Nov 28 19:59:53 2023","interfaces":[{"interface":"back","average":{"1min":0.749,"5min":0.749,"15min":0.749},"min":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"max":{"1min":1.056,"5min":1.056,"15min":1.056},"last":0.68999999999999995},{"interface":"front","average":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":0.88900000000000001,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.65700000000000003}]},{"osd":4,"last update":"Tue Nov 28 19:59:53 2023","interfaces":[{"interface":"back","average":{"1min":0.63100000000000001,"5min":0.63100000000000001,"15min":0.63100000000000001},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":0.96999999999999997,"5min":0.96999999999999997,"15min":0.96999999999999997},"last":0.626},{"interface":"front","average":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":1.389,"5min":1.389,"15min":1.389},"last":0.42399999999999999}]},{"osd":5,"last update":"Tue Nov 28 19:59:53 2023","interfaces":[{"interface":"back","average":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":0.81699999999999995},"min":{"1min":0.5,"5min":0.5,"15min":0.5},"max":{"1min":1.4259999999999999,"5min":1.4259999999999999,"15min":1.4259999999999999},"last":0.47599999999999998},{"interface":"front","average":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"min":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":1.276,"5min":1.276,"15min":1.276},"last":0.56799999999999995}]},{"osd":7,"last update":"Tue Nov 28 19:59:53 2023","interfaces":[{"interface":"back","average":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.71499999999999997},"min":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":0.97599999999999998,"5min":0.97599999999999998,"15min":0.97599999999999998},"last":0.60699999999999998},{"interface":"front","average":{"1min":0.82999999999999996,"5min":0.82999999999999996,"15min":0.82999999999999996},"min":{"1min":0.65600000000000003,"5min":0.65600000000000003,"15min":0.65600000000000003},"max":{"1min":1.242,"5min":1.242,"15min":1.242},"last":0.73899999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574868,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27436,"kb_used_data":416,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344404,"statfs":{"total":96636764160,"available":96608669696,"internally_reserved":0,"allocated":425984,"data_stored":178472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 19:59:53 2023","interfaces":[{"interface":"back","average":{"1min":0.70999999999999996,"5min":0.70999999999999996,"15min":0.70999999999999996},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":0.997,"5min":0.997,"15min":0.997},"last":0.71399999999999997},{"interface":"front","average":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"min":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":1.149,"5min":1.149,"15min":1.149},"last":0.70199999999999996}]},{"osd":1,"last update":"Tue Nov 28 19:59:53 2023","interfaces":[{"interface":"back","average":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":0.92700000000000005,"5min":0.92700000000000005,"15min":0.92700000000000005},"last":0.68999999999999995},{"interface":"front","average":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":1.0940000000000001,"5min":1.0940000000000001,"15min":1.0940000000000001},"last":0.64700000000000002}]},{"osd":2,"last update":"Tue Nov 28 19:59:53 2023","interfaces":[{"interface":"back","average":{"1min":0.94599999999999995,"5min":0.94599999999999995,"15min":0.94599999999999995},"min":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":5.0880000000000001,"5min":5.0880000000000001,"15min":5.0880000000000001},"last":0.67200000000000004},{"interface":"front","average":{"1min":1.002,"5min":1.002,"15min":1.002},"min":{"1min":0.504,"5min":0.504,"15min":0.504},"max":{"1min":5.1399999999999997,"5min":5.1399999999999997,"15min":5.1399999999999997},"last":0.63600000000000001}]},{"osd":3,"last update":"Tue Nov 28 19:59:53 2023","interfaces":[{"interface":"back","average":{"1min":1.028,"5min":1.028,"15min":1.028},"min":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"max":{"1min":5.0469999999999997,"5min":5.0469999999999997,"15min":5.0469999999999997},"last":0.77500000000000002},{"interface":"front","average":{"1min":1.0009999999999999,"5min":1.0009999999999999,"15min":1.0009999999999999},"min":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":5.024,"5min":5.024,"15min":5.024},"last":0.60099999999999998}]},{"osd":4,"last update":"Tue Nov 28 19:59:53 2023","interfaces":[{"interface":"back","average":{"1min":0.67700000000000005,"5min":0.67700000000000005,"15min":0.67700000000000005},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":1.4810000000000001,"5min":1.4810000000000001,"15min":1.4810000000000001},"last":0.53400000000000003},{"interface":"front","average":{"1min":0.747,"5min":0.747,"15min":0.747},"min":{"1min":0.5,"5min":0.5,"15min":0.5},"max":{"1min":1.6339999999999999,"5min":1.6339999999999999,"15min":1.6339999999999999},"last":0.61599999999999999}]},{"osd":6,"last update":"Tue Nov 28 19:59:53 2023","interfaces":[{"interface":"back","average":{"1min":0.70699999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":0.97699999999999998,"5min":0.97699999999999998,"15min":0.97699999999999998},"last":0.55700000000000005},{"interface":"front","average":{"1min":0.748,"5min":0.748,"15min":0.748},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":1.099,"5min":1.099,"15min":1.099},"last":0.58599999999999997}]},{"osd":7,"last update":"Tue Nov 28 19:59:53 2023","interfaces":[{"interface":"back","average":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"min":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":1.236,"5min":1.236,"15min":1.236},"last":0.748},{"interface":"front","average":{"1min":0.80100000000000005,"5min":0.80100000000000005,"15min":0.80100000000000005},"min":{"1min":0.505,"5min":0.505,"15min":0.505},"max":{"1min":1.0760000000000001,"5min":1.0760000000000001,"15min":1.0760000000000001},"last":0.73199999999999998}]}]},{"osd":4,"up_from":13,"seq":55834574867,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27436,"kb_used_data":416,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344404,"statfs":{"total":96636764160,"available":96608669696,"internally_reserved":0,"allocated":425984,"data_stored":178472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 19:59:54 2023","interfaces":[{"interface":"back","average":{"1min":0.71099999999999997,"5min":0.71099999999999997,"15min":0.71099999999999997},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":1.0429999999999999,"5min":1.0429999999999999,"15min":1.0429999999999999},"last":0.71899999999999997},{"interface":"front","average":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":1.163,"5min":1.163,"15min":1.163},"last":0.59999999999999998}]},{"osd":1,"last update":"Tue Nov 28 19:59:54 2023","interfaces":[{"interface":"back","average":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"min":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":1.111,"5min":1.111,"15min":1.111},"last":0.74399999999999999},{"interface":"front","average":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"min":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":1.238,"5min":1.238,"15min":1.238},"last":0.79800000000000004}]},{"osd":2,"last update":"Tue Nov 28 19:59:54 2023","interfaces":[{"interface":"back","average":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":0.78300000000000003},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":1.0669999999999999,"5min":1.0669999999999999,"15min":1.0669999999999999},"last":0.66100000000000003},{"interface":"front","average":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":0.81699999999999995},"min":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":1.1180000000000001,"5min":1.1180000000000001,"15min":1.1180000000000001},"last":0.67600000000000005}]},{"osd":3,"last update":"Tue Nov 28 19:59:54 2023","interfaces":[{"interface":"back","average":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"min":{"1min":0.499,"5min":0.499,"15min":0.499},"max":{"1min":1.202,"5min":1.202,"15min":1.202},"last":0.64600000000000002},{"interface":"front","average":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"min":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":1.0589999999999999,"5min":1.0589999999999999,"15min":1.0589999999999999},"last":0.77900000000000003}]},{"osd":5,"last update":"Tue Nov 28 19:59:54 2023","interfaces":[{"interface":"back","average":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":0.95899999999999996,"5min":0.95899999999999996,"15min":0.95899999999999996},"last":0.623},{"interface":"front","average":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":1.034,"5min":1.034,"15min":1.034},"last":0.54400000000000004}]},{"osd":6,"last update":"Tue Nov 28 19:59:54 2023","interfaces":[{"interface":"back","average":{"1min":0.73499999999999999,"5min":0.73499999999999999,"15min":0.73499999999999999},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":1.0309999999999999,"5min":1.0309999999999999,"15min":1.0309999999999999},"last":0.57699999999999996},{"interface":"front","average":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":1.002,"5min":1.002,"15min":1.002},"last":0.76400000000000001}]},{"osd":7,"last update":"Tue Nov 28 19:59:54 2023","interfaces":[{"interface":"back","average":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"min":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":1.0620000000000001,"5min":1.0620000000000001,"15min":1.0620000000000001},"last":0.69399999999999995},{"interface":"front","average":{"1min":0.87,"5min":0.87,"15min":0.87},"min":{"1min":0.627,"5min":0.627,"15min":0.627},"max":{"1min":1.1459999999999999,"5min":1.1459999999999999,"15min":1.1459999999999999},"last":0.70399999999999996}]}]},{"osd":3,"up_from":13,"seq":55834574868,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27436,"kb_used_data":416,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344404,"statfs":{"total":96636764160,"available":96608669696,"internally_reserved":0,"allocated":425984,"data_stored":178472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 19:59:52 2023","interfaces":[{"interface":"back","average":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.70199999999999996},"last":0.45300000000000001},{"interface":"front","average":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"min":{"1min":0.312,"5min":0.312,"15min":0.312},"max":{"1min":0.82599999999999996,"5min":0.82599999999999996,"15min":0.82599999999999996},"last":0.32000000000000001}]},{"osd":1,"last update":"Tue Nov 28 19:59:52 2023","interfaces":[{"interface":"back","average":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.84399999999999997,"5min":0.84399999999999997,"15min":0.84399999999999997},"last":0.35899999999999999},{"interface":"front","average":{"1min":0.505,"5min":0.505,"15min":0.505},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.86099999999999999,"5min":0.86099999999999999,"15min":0.86099999999999999},"last":0.29199999999999998}]},{"osd":2,"last update":"Tue Nov 28 19:59:52 2023","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.85599999999999998,"5min":0.85599999999999998,"15min":0.85599999999999998},"last":0.46700000000000003},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.83699999999999997,"5min":0.83699999999999997,"15min":0.83699999999999997},"last":0.55900000000000005}]},{"osd":4,"last update":"Tue Nov 28 19:59:52 2023","interfaces":[{"interface":"back","average":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":1.206,"5min":1.206,"15min":1.206},"last":0.63500000000000001},{"interface":"front","average":{"1min":0.80300000000000005,"5min":0.80300000000000005,"15min":0.80300000000000005},"min":{"1min":0.503,"5min":0.503,"15min":0.503},"max":{"1min":1.222,"5min":1.222,"15min":1.222},"last":0.92700000000000005}]},{"osd":5,"last update":"Tue Nov 28 19:59:52 2023","interfaces":[{"interface":"back","average":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"min":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":1.151,"5min":1.151,"15min":1.151},"last":0.97499999999999998},{"interface":"front","average":{"1min":0.80300000000000005,"5min":0.80300000000000005,"15min":0.80300000000000005},"min":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":1.3100000000000001,"5min":1.3100000000000001,"15min":1.3100000000000001},"last":0.495}]},{"osd":6,"last update":"Tue Nov 28 19:59:52 2023","interfaces":[{"interface":"back","average":{"1min":0.84399999999999997,"5min":0.84399999999999997,"15min":0.84399999999999997},"min":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":1.361,"5min":1.361,"15min":1.361},"last":1.544},{"interface":"front","average":{"1min":0.749,"5min":0.749,"15min":0.749},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.125,"5min":1.125,"15min":1.125},"last":4.0679999999999996}]},{"osd":7,"last update":"Tue Nov 28 19:59:52 2023","interfaces":[{"interface":"back","average":{"1min":0.84999999999999998,"5min":0.84999999999999998,"15min":0.84999999999999998},"min":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"max":{"1min":1.2569999999999999,"5min":1.2569999999999999,"15min":1.2569999999999999},"last":4.0019999999999998},{"interface":"front","average":{"1min":0.89100000000000001,"5min":0.89100000000000001,"15min":0.89100000000000001},"min":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"max":{"1min":1.339,"5min":1.339,"15min":1.339},"last":1.1830000000000001}]}]},{"osd":2,"up_from":13,"seq":55834574866,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27436,"kb_used_data":416,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344404,"statfs":{"total":96636764160,"available":96608669696,"internally_reserved":0,"allocated":425984,"data_stored":178472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 19:59:54 2023","interfaces":[{"interface":"back","average":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"min":{"1min":0.26400000000000001,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"last":0.503},{"interface":"front","average":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.67700000000000005,"5min":0.67700000000000005,"15min":0.67700000000000005},"last":0.27900000000000003}]},{"osd":1,"last update":"Tue Nov 28 19:59:54 2023","interfaces":[{"interface":"back","average":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"min":{"1min":0.29899999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":1.0389999999999999,"5min":1.0389999999999999,"15min":1.0389999999999999},"last":0.38700000000000001},{"interface":"front","average":{"1min":0.505,"5min":0.505,"15min":0.505},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.70999999999999996,"5min":0.70999999999999996,"15min":0.70999999999999996},"last":0.32700000000000001}]},{"osd":3,"last update":"Tue Nov 28 19:59:54 2023","interfaces":[{"interface":"back","average":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"min":{"1min":0.28199999999999997,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.629,"5min":0.629,"15min":0.629},"last":0.36699999999999999},{"interface":"front","average":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.98499999999999999,"5min":0.98499999999999999,"15min":0.98499999999999999},"last":0.42799999999999999}]},{"osd":4,"last update":"Tue Nov 28 19:59:54 2023","interfaces":[{"interface":"back","average":{"1min":0.86199999999999999,"5min":0.86199999999999999,"15min":0.86199999999999999},"min":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"max":{"1min":1.139,"5min":1.139,"15min":1.139},"last":0.61099999999999999},{"interface":"front","average":{"1min":0.85299999999999998,"5min":0.85299999999999998,"15min":0.85299999999999998},"min":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":1.238,"5min":1.238,"15min":1.238},"last":0.629}]},{"osd":5,"last update":"Tue Nov 28 19:59:54 2023","interfaces":[{"interface":"back","average":{"1min":0.88500000000000001,"5min":0.88500000000000001,"15min":0.88500000000000001},"min":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":1.6180000000000001,"5min":1.6180000000000001,"15min":1.6180000000000001},"last":0.55100000000000005},{"interface":"front","average":{"1min":0.83499999999999996,"5min":0.83499999999999996,"15min":0.83499999999999996},"min":{"1min":0.496,"5min":0.496,"15min":0.496},"max":{"1min":1.339,"5min":1.339,"15min":1.339},"last":0.52200000000000002}]},{"osd":6,"last update":"Tue Nov 28 19:59:54 2023","interfaces":[{"interface":"back","average":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":0.80600000000000005},"min":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1.1839999999999999,"5min":1.1839999999999999,"15min":1.1839999999999999},"last":0.59699999999999998},{"interface":"front","average":{"1min":0.86199999999999999,"5min":0.86199999999999999,"15min":0.86199999999999999},"min":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":1.099,"5min":1.099,"15min":1.099},"last":0.56699999999999995}]},{"osd":7,"last update":"Tue Nov 28 19:59:54 2023","interfaces":[{"interface":"back","average":{"1min":0.89000000000000001,"5min":0.89000000000000001,"15min":0.89000000000000001},"min":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":1.4590000000000001,"5min":1.4590000000000001,"15min":1.4590000000000001},"last":0.58299999999999996},{"interface":"front","average":{"1min":0.86699999999999999,"5min":0.86699999999999999,"15min":0.86699999999999999},"min":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":1.387,"5min":1.387,"15min":1.387},"last":0.48799999999999999}]}]},{"osd":1,"up_from":13,"seq":55834574868,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27436,"kb_used_data":416,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344404,"statfs":{"total":96636764160,"available":96608669696,"internally_reserved":0,"allocated":425984,"data_stored":178472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 19:59:53 2023","interfaces":[{"interface":"back","average":{"1min":0.65800000000000003,"5min":0.65800000000000003,"15min":0.65800000000000003},"min":{"1min":0.31,"5min":0.31,"15min":0.31},"max":{"1min":3.8740000000000001,"5min":3.8740000000000001,"15min":3.8740000000000001},"last":0.28799999999999998},{"interface":"front","average":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"min":{"1min":0.25,"5min":0.25,"15min":0.25},"max":{"1min":2.0760000000000001,"5min":2.0760000000000001,"15min":2.0760000000000001},"last":0.38300000000000001}]},{"osd":2,"last update":"Tue Nov 28 19:59:53 2023","interfaces":[{"interface":"back","average":{"1min":0.65900000000000003,"5min":0.65900000000000003,"15min":0.65900000000000003},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":3.7320000000000002,"5min":3.7320000000000002,"15min":3.7320000000000002},"last":0.41999999999999998},{"interface":"front","average":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":3.9089999999999998,"5min":3.9089999999999998,"15min":3.9089999999999998},"last":0.35499999999999998}]},{"osd":3,"last update":"Tue Nov 28 19:59:53 2023","interfaces":[{"interface":"back","average":{"1min":0.68100000000000005,"5min":0.68100000000000005,"15min":0.68100000000000005},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":1.6399999999999999,"5min":1.6399999999999999,"15min":1.6399999999999999},"last":0.48899999999999999},{"interface":"front","average":{"1min":0.70299999999999996,"5min":0.70299999999999996,"15min":0.70299999999999996},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":2.5270000000000001,"5min":2.5270000000000001,"15min":2.5270000000000001},"last":0.443}]},{"osd":4,"last update":"Tue Nov 28 19:59:53 2023","interfaces":[{"interface":"back","average":{"1min":0.89500000000000002,"5min":0.89500000000000002,"15min":0.89500000000000002},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":3.1659999999999999,"5min":3.1659999999999999,"15min":3.1659999999999999},"last":0.64100000000000001},{"interface":"front","average":{"1min":0.94599999999999995,"5min":0.94599999999999995,"15min":0.94599999999999995},"min":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":3.7959999999999998,"5min":3.7959999999999998,"15min":3.7959999999999998},"last":0.54100000000000004}]},{"osd":5,"last update":"Tue Nov 28 19:59:53 2023","interfaces":[{"interface":"back","average":{"1min":0.98899999999999999,"5min":0.98899999999999999,"15min":0.98899999999999999},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":4.1479999999999997,"5min":4.1479999999999997,"15min":4.1479999999999997},"last":0.65700000000000003},{"interface":"front","average":{"1min":0.91000000000000003,"5min":0.91000000000000003,"15min":0.91000000000000003},"min":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":3.5569999999999999,"5min":3.5569999999999999,"15min":3.5569999999999999},"last":0.5}]},{"osd":6,"last update":"Tue Nov 28 19:59:53 2023","interfaces":[{"interface":"back","average":{"1min":0.99199999999999999,"5min":0.99199999999999999,"15min":0.99199999999999999},"min":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":2.863,"5min":2.863,"15min":2.863},"last":0.68500000000000005},{"interface":"front","average":{"1min":0.98299999999999998,"5min":0.98299999999999998,"15min":0.98299999999999998},"min":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"max":{"1min":3.371,"5min":3.371,"15min":3.371},"last":0.60099999999999998}]},{"osd":7,"last update":"Tue Nov 28 19:59:53 2023","interfaces":[{"interface":"back","average":{"1min":1.0129999999999999,"5min":1.0129999999999999,"15min":1.0129999999999999},"min":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"max":{"1min":3.8439999999999999,"5min":3.8439999999999999,"15min":3.8439999999999999},"last":0.624},{"interface":"front","average":{"1min":1.038,"5min":1.038,"15min":1.038},"min":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"max":{"1min":3.9689999999999999,"5min":3.9689999999999999,"15min":3.9689999999999999},"last":0.53000000000000003}]}]},{"osd":0,"up_from":13,"seq":55834574867,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27500,"kb_used_data":480,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344340,"statfs":{"total":96636764160,"available":96608604160,"internally_reserved":0,"allocated":491520,"data_stored":768840,"data_compressed":33374,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Nov 28 19:59:56 2023","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.68999999999999995,"15min":0.68999999999999995},"min":{"1min":0.29899999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":4.883,"5min":4.883,"15min":4.883},"last":0.27400000000000002},{"interface":"front","average":{"1min":0.878,"5min":0.878,"15min":0.878},"min":{"1min":0.29399999999999998,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":8.0800000000000001,"5min":8.0800000000000001,"15min":8.0800000000000001},"last":0.41699999999999998}]},{"osd":2,"last update":"Tue Nov 28 19:59:56 2023","interfaces":[{"interface":"back","average":{"1min":0.97399999999999998,"5min":0.97399999999999998,"15min":0.97399999999999998},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":8.1029999999999998,"5min":8.1029999999999998,"15min":8.1029999999999998},"last":0.46000000000000002},{"interface":"front","average":{"1min":0.98699999999999999,"5min":0.98699999999999999,"15min":0.98699999999999999},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":8.1310000000000002,"5min":8.1310000000000002,"15min":8.1310000000000002},"last":0.5}]},{"osd":3,"last update":"Tue Nov 28 19:59:56 2023","interfaces":[{"interface":"back","average":{"1min":0.747,"5min":0.747,"15min":0.747},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":4.3949999999999996,"5min":4.3949999999999996,"15min":4.3949999999999996},"last":0.441},{"interface":"front","average":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":4.3470000000000004,"5min":4.3470000000000004,"15min":4.3470000000000004},"last":0.51900000000000002}]},{"osd":4,"last update":"Tue Nov 28 19:59:56 2023","interfaces":[{"interface":"back","average":{"1min":1.0509999999999999,"5min":1.0509999999999999,"15min":1.0509999999999999},"min":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"max":{"1min":4.6360000000000001,"5min":4.6360000000000001,"15min":4.6360000000000001},"last":0.54100000000000004},{"interface":"front","average":{"1min":1.0529999999999999,"5min":1.0529999999999999,"15min":1.0529999999999999},"min":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":4.4710000000000001,"5min":4.4710000000000001,"15min":4.4710000000000001},"last":0.59899999999999998}]},{"osd":5,"last update":"Tue Nov 28 19:59:56 2023","interfaces":[{"interface":"back","average":{"1min":1.0649999999999999,"5min":1.0649999999999999,"15min":1.0649999999999999},"min":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":4.6120000000000001,"5min":4.6120000000000001,"15min":4.6120000000000001},"last":0.65400000000000003},{"interface":"front","average":{"1min":1.052,"5min":1.052,"15min":1.052},"min":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"max":{"1min":4.5449999999999999,"5min":4.5449999999999999,"15min":4.5449999999999999},"last":0.58999999999999997}]},{"osd":6,"last update":"Tue Nov 28 19:59:56 2023","interfaces":[{"interface":"back","average":{"1min":1.079,"5min":1.079,"15min":1.079},"min":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":4.657,"5min":4.657,"15min":4.657},"last":0.64500000000000002},{"interface":"front","average":{"1min":1.097,"5min":1.097,"15min":1.097},"min":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"max":{"1min":4.5259999999999998,"5min":4.5259999999999998,"15min":4.5259999999999998},"last":0.61599999999999999}]},{"osd":7,"last update":"Tue Nov 28 19:59:56 2023","interfaces":[{"interface":"back","average":{"1min":1.101,"5min":1.101,"15min":1.101},"min":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.60099999999999998},"max":{"1min":4.7320000000000002,"5min":4.7320000000000002,"15min":4.7320000000000002},"last":0.57199999999999995},{"interface":"front","average":{"1min":1.046,"5min":1.046,"15min":1.046},"min":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":4.4939999999999998,"5min":4.4939999999999998,"15min":4.4939999999999998},"last":0.67000000000000004}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33374,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33374,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-28T20:00:18.239 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-28T20:00:18.412 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:18.410+0000 7f1174900640 1 Processor -- start 2023-11-28T20:00:18.412 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:18.410+0000 7f1174900640 1 -- start start 2023-11-28T20:00:18.413 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:18.410+0000 7f1174900640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f11700c65f0 0x7f11700c69d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:18.413 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:18.410+0000 7f1174900640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1170151f20 con 0x7f11700c8200 2023-11-28T20:00:18.413 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:18.410+0000 7f1174900640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1170154450 con 0x7f11700c9210 2023-11-28T20:00:18.413 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:18.410+0000 7f1174900640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1170154710 con 0x7f11700c65f0 2023-11-28T20:00:18.413 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:18.410+0000 7f116ed9d640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f11700c65f0 0x7f11700c69d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:18.414 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:18.410+0000 7f116ed9d640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f11700c65f0 0x7f11700c69d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:52150/0 (socket says 172.21.15.78:52150) 2023-11-28T20:00:18.414 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:18.410+0000 7f116ed9d640 1 -- 172.21.15.78:0/3601621725 learned_addr learned my addr 172.21.15.78:0/3601621725 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T20:00:18.414 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:18.410+0000 7f116e59c640 1 --1- 172.21.15.78:0/3601621725 >> v1:172.21.15.78:6789/0 conn(0x7f11700c8200 0x7f11700c8b00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:56508/0 (socket says 172.21.15.78:56508) 2023-11-28T20:00:18.414 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:18.410+0000 7f116ed9d640 1 -- 172.21.15.78:0/3601621725 >> v1:172.21.15.179:6789/0 conn(0x7f11700c9210 legacy=0x7f117015ecf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:00:18.414 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:18.410+0000 7f116ed9d640 1 -- 172.21.15.78:0/3601621725 >> v1:172.21.15.78:6789/0 conn(0x7f11700c8200 legacy=0x7f11700c8b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:00:18.414 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:18.410+0000 7f116ed9d640 1 -- 172.21.15.78:0/3601621725 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11701549f0 con 0x7f11700c65f0 2023-11-28T20:00:18.417 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:18.414+0000 7f116ed9d640 1 --2- 172.21.15.78:0/3601621725 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f11700c65f0 0x7f11700c69d0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f1160009870 tx=0x7f116001c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2d0c3a05473a05f3 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:00:18.417 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:18.414+0000 7f116dd9b640 1 -- 172.21.15.78:0/3601621725 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11600ab680 con 0x7f11700c65f0 2023-11-28T20:00:18.417 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:18.414+0000 7f116dd9b640 1 -- 172.21.15.78:0/3601621725 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f11600ab7e0 con 0x7f11700c65f0 2023-11-28T20:00:18.417 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:18.414+0000 7f116dd9b640 1 -- 172.21.15.78:0/3601621725 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11600abb70 con 0x7f11700c65f0 2023-11-28T20:00:18.417 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:18.414+0000 7f1174900640 1 -- 172.21.15.78:0/3601621725 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f11700c65f0 msgr2=0x7f11700c69d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:00:18.418 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:18.414+0000 7f1174900640 1 --2- 172.21.15.78:0/3601621725 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f11700c65f0 0x7f11700c69d0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f1160009870 tx=0x7f116001c480 comp rx=0 tx=0).stop 2023-11-28T20:00:18.418 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:18.414+0000 7f1174900640 1 -- 172.21.15.78:0/3601621725 shutdown_connections 2023-11-28T20:00:18.418 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:18.414+0000 7f1174900640 1 --2- 172.21.15.78:0/3601621725 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f11700c65f0 0x7f11700c69d0 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:18.418 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:18.414+0000 7f1174900640 1 -- 172.21.15.78:0/3601621725 >> 172.21.15.78:0/3601621725 conn(0x7f11700ab730 msgr2=0x7f11700abb40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:00:18.419 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:18.414+0000 7f1174900640 1 -- 172.21.15.78:0/3601621725 shutdown_connections 2023-11-28T20:00:18.419 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:18.414+0000 7f1174900640 1 -- 172.21.15.78:0/3601621725 wait complete. 2023-11-28T20:00:18.419 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:18.414+0000 7f1174900640 1 Processor -- start 2023-11-28T20:00:18.419 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:18.418+0000 7f1174900640 1 -- start start 2023-11-28T20:00:18.422 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:18.418+0000 7f1174900640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f11700c65f0 0x7f11700ae0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:18.422 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:18.418+0000 7f1174900640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f11700c8200 0x7f11701ee340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:18.422 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:18.418+0000 7f1174900640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f11700c9210 0x7f11701531e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:18.422 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:18.418+0000 7f1174900640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11700adc90 con 0x7f11700c8200 2023-11-28T20:00:18.422 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:18.418+0000 7f1174900640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11700aea10 con 0x7f11700c65f0 2023-11-28T20:00:18.422 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:18.418+0000 7f1174900640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f117014f1d0 con 0x7f11700c9210 2023-11-28T20:00:18.422 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:18.418+0000 7f116e59c640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f11700c8200 0x7f11701ee340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:18.422 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:18.418+0000 7f116e59c640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f11700c8200 0x7f11701ee340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:52158/0 (socket says 172.21.15.78:52158) 2023-11-28T20:00:18.422 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:18.418+0000 7f116e59c640 1 -- 172.21.15.78:0/1452644690 learned_addr learned my addr 172.21.15.78:0/1452644690 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T20:00:18.422 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:18.418+0000 7f116ed9d640 1 --2- 172.21.15.78:0/1452644690 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f11700c65f0 0x7f11700ae0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:18.423 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:18.418+0000 7f116f59e640 1 --2- 172.21.15.78:0/1452644690 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f11700c9210 0x7f11701531e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:18.423 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:18.418+0000 7f116e59c640 1 -- 172.21.15.78:0/1452644690 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f11700c9210 msgr2=0x7f11701531e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:00:18.423 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:18.418+0000 7f116e59c640 1 --2- 172.21.15.78:0/1452644690 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f11700c9210 0x7f11701531e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:18.423 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:18.418+0000 7f116e59c640 1 -- 172.21.15.78:0/1452644690 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f11700c65f0 msgr2=0x7f11700ae0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:00:18.423 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:18.418+0000 7f116e59c640 1 --2- 172.21.15.78:0/1452644690 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f11700c65f0 0x7f11700ae0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:18.423 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:18.418+0000 7f116e59c640 1 -- 172.21.15.78:0/1452644690 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11600094d0 con 0x7f11700c8200 2023-11-28T20:00:18.423 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:18.418+0000 7f116e59c640 1 --2- 172.21.15.78:0/1452644690 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f11700c8200 0x7f11701ee340 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f116400c460 tx=0x7f116400c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:00:18.423 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:18.418+0000 7f11577fe640 1 -- 172.21.15.78:0/1452644690 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11640074e0 con 0x7f11700c8200 2023-11-28T20:00:18.423 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:18.418+0000 7f11577fe640 1 -- 172.21.15.78:0/1452644690 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1164007640 con 0x7f11700c8200 2023-11-28T20:00:18.423 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:18.418+0000 7f11577fe640 1 -- 172.21.15.78:0/1452644690 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1164004a10 con 0x7f11700c8200 2023-11-28T20:00:18.423 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:18.418+0000 7f1174900640 1 -- 172.21.15.78:0/1452644690 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f11700ae5f0 con 0x7f11700c8200 2023-11-28T20:00:18.424 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:18.418+0000 7f1174900640 1 -- 172.21.15.78:0/1452644690 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f11700ad5d0 con 0x7f11700c8200 2023-11-28T20:00:18.424 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:18.418+0000 7f1174900640 1 -- 172.21.15.78:0/1452644690 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f11700addd0 con 0x7f11700c8200 2023-11-28T20:00:18.424 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:18.422+0000 7f11577fe640 1 -- 172.21.15.78:0/1452644690 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f1164004b70 con 0x7f11700c8200 2023-11-28T20:00:18.425 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:18.422+0000 7f11577fe640 1 --2- 172.21.15.78:0/1452644690 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f115c066470 0x7f115c068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:18.425 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:18.422+0000 7f11577fe640 1 -- 172.21.15.78:0/1452644690 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f11640837d0 con 0x7f11700c8200 2023-11-28T20:00:18.425 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:18.422+0000 7f116ed9d640 1 --2- 172.21.15.78:0/1452644690 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f115c066470 0x7f115c068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:18.425 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:18.422+0000 7f116ed9d640 1 --2- 172.21.15.78:0/1452644690 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f115c066470 0x7f115c068930 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f11600af000 tx=0x7f11600b6040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:00:18.429 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:18.426+0000 7f11577fe640 1 -- 172.21.15.78:0/1452644690 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f11700addd0 con 0x7f11700c8200 2023-11-28T20:00:18.575 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:18.570+0000 7f1174900640 1 -- 172.21.15.78:0/1452644690 --> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f11700addd0 con 0x7f115c066470 2023-11-28T20:00:18.582 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:18.578+0000 7f11577fe640 1 -- 172.21.15.78:0/1452644690 <== mgr.4106 v2:172.21.15.78:6832/2935380957 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+283258 (secure 0 0 0) 0x7f11700addd0 con 0x7f115c066470 2023-11-28T20:00:18.585 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-11-28T20:00:18.587 INFO:teuthology.orchestra.run.smithi078.stderr:dumped all 2023-11-28T20:00:18.588 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:18.582+0000 7f1174900640 1 -- 172.21.15.78:0/1452644690 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f115c066470 msgr2=0x7f115c068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:00:18.588 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:18.582+0000 7f1174900640 1 --2- 172.21.15.78:0/1452644690 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f115c066470 0x7f115c068930 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f11600af000 tx=0x7f11600b6040 comp rx=0 tx=0).stop 2023-11-28T20:00:18.588 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:18.582+0000 7f1174900640 1 -- 172.21.15.78:0/1452644690 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f11700c8200 msgr2=0x7f11701ee340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:00:18.588 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:18.582+0000 7f1174900640 1 --2- 172.21.15.78:0/1452644690 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f11700c8200 0x7f11701ee340 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f116400c460 tx=0x7f116400c920 comp rx=0 tx=0).stop 2023-11-28T20:00:18.588 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:18.582+0000 7f1174900640 1 -- 172.21.15.78:0/1452644690 shutdown_connections 2023-11-28T20:00:18.588 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:18.582+0000 7f1174900640 1 --2- 172.21.15.78:0/1452644690 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f115c066470 0x7f115c068930 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:18.589 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:18.582+0000 7f1174900640 1 --2- 172.21.15.78:0/1452644690 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f11700c9210 0x7f11701531e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:18.589 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:18.582+0000 7f1174900640 1 --2- 172.21.15.78:0/1452644690 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f11700c8200 0x7f11701ee340 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:18.589 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:18.582+0000 7f1174900640 1 --2- 172.21.15.78:0/1452644690 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f11700c65f0 0x7f11700ae0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:18.589 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:18.582+0000 7f1174900640 1 -- 172.21.15.78:0/1452644690 >> 172.21.15.78:0/1452644690 conn(0x7f11700ab730 msgr2=0x7f117006b0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:00:18.589 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:18.582+0000 7f1174900640 1 -- 172.21.15.78:0/1452644690 shutdown_connections 2023-11-28T20:00:18.589 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:18.582+0000 7f1174900640 1 -- 172.21.15.78:0/1452644690 wait complete. 2023-11-28T20:00:18.605 INFO:teuthology.orchestra.run.smithi078.stdout:{"pg_ready":true,"pg_map":{"version":76,"stamp":"2023-11-28T20:00:17.968846+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":48,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219616,"kb_used_data":3456,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755104,"statfs":{"total":773094113280,"available":772869226496,"internally_reserved":0,"allocated":3538944,"data_stored":2608512,"data_compressed":66748,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":28,"apply_latency_ms":28,"commit_latency_ns":28000000,"apply_latency_ns":28000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.000955"},"pg_stats":[{"pgid":"6.3f","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2023-11-28T20:00:12.786561+0000","last_change":"2023-11-28T20:00:12.786561+0000","last_active":"2023-11-28T20:00:12.764355+0000","last_peered":"2023-11-28T20:00:12.764355+0000","last_clean":"2023-11-28T20:00:12.764355+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:00:12.786561+0000","last_undegraded":"2023-11-28T20:00:12.786561+0000","last_fullsized":"2023-11-28T20:00:12.786561+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_clean_scrub_stamp":"2023-11-28T20:00:12.764355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2023-11-28T20:00:12.785251+0000","last_change":"2023-11-28T20:00:12.785251+0000","last_active":"2023-11-28T20:00:12.764355+0000","last_peered":"2023-11-28T20:00:12.764355+0000","last_clean":"2023-11-28T20:00:12.764355+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:00:12.785251+0000","last_undegraded":"2023-11-28T20:00:12.785251+0000","last_fullsized":"2023-11-28T20:00:12.785251+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_clean_scrub_stamp":"2023-11-28T20:00:12.764355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2023-11-28T20:00:12.784934+0000","last_change":"2023-11-28T20:00:12.784934+0000","last_active":"2023-11-28T20:00:12.764355+0000","last_peered":"2023-11-28T20:00:12.764355+0000","last_clean":"2023-11-28T20:00:12.764355+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:00:12.784934+0000","last_undegraded":"2023-11-28T20:00:12.784934+0000","last_fullsized":"2023-11-28T20:00:12.784934+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_clean_scrub_stamp":"2023-11-28T20:00:12.764355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.3c","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2023-11-28T20:00:12.786036+0000","last_change":"2023-11-28T20:00:12.786036+0000","last_active":"2023-11-28T20:00:12.764355+0000","last_peered":"2023-11-28T20:00:12.764355+0000","last_clean":"2023-11-28T20:00:12.764355+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:00:12.786036+0000","last_undegraded":"2023-11-28T20:00:12.786036+0000","last_fullsized":"2023-11-28T20:00:12.786036+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_clean_scrub_stamp":"2023-11-28T20:00:12.764355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2023-11-28T20:00:12.786007+0000","last_change":"2023-11-28T20:00:12.786007+0000","last_active":"2023-11-28T20:00:12.764355+0000","last_peered":"2023-11-28T20:00:12.764355+0000","last_clean":"2023-11-28T20:00:12.764355+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:00:12.786007+0000","last_undegraded":"2023-11-28T20:00:12.786007+0000","last_fullsized":"2023-11-28T20:00:12.786007+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_clean_scrub_stamp":"2023-11-28T20:00:12.764355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2023-11-28T20:00:12.784599+0000","last_change":"2023-11-28T20:00:12.784599+0000","last_active":"2023-11-28T20:00:12.764355+0000","last_peered":"2023-11-28T20:00:12.764355+0000","last_clean":"2023-11-28T20:00:12.764355+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:00:12.784599+0000","last_undegraded":"2023-11-28T20:00:12.784599+0000","last_fullsized":"2023-11-28T20:00:12.784599+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_clean_scrub_stamp":"2023-11-28T20:00:12.764355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2023-11-28T20:00:12.788606+0000","last_change":"2023-11-28T20:00:12.788606+0000","last_active":"2023-11-28T20:00:12.764355+0000","last_peered":"2023-11-28T20:00:12.764355+0000","last_clean":"2023-11-28T20:00:12.764355+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:00:12.788606+0000","last_undegraded":"2023-11-28T20:00:12.788606+0000","last_fullsized":"2023-11-28T20:00:12.788606+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_clean_scrub_stamp":"2023-11-28T20:00:12.764355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2023-11-28T20:00:12.782185+0000","last_change":"2023-11-28T20:00:12.782185+0000","last_active":"2023-11-28T20:00:12.764355+0000","last_peered":"2023-11-28T20:00:12.764355+0000","last_clean":"2023-11-28T20:00:12.764355+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:00:12.782185+0000","last_undegraded":"2023-11-28T20:00:12.782185+0000","last_fullsized":"2023-11-28T20:00:12.782185+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_clean_scrub_stamp":"2023-11-28T20:00:12.764355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2023-11-28T20:00:12.784258+0000","last_change":"2023-11-28T20:00:12.784258+0000","last_active":"2023-11-28T20:00:12.764355+0000","last_peered":"2023-11-28T20:00:12.764355+0000","last_clean":"2023-11-28T20:00:12.764355+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:00:12.784258+0000","last_undegraded":"2023-11-28T20:00:12.784258+0000","last_fullsized":"2023-11-28T20:00:12.784258+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_clean_scrub_stamp":"2023-11-28T20:00:12.764355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2023-11-28T20:00:12.796410+0000","last_change":"2023-11-28T20:00:12.796410+0000","last_active":"2023-11-28T20:00:12.764355+0000","last_peered":"2023-11-28T20:00:12.764355+0000","last_clean":"2023-11-28T20:00:12.764355+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:00:12.796410+0000","last_undegraded":"2023-11-28T20:00:12.796410+0000","last_fullsized":"2023-11-28T20:00:12.796410+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_clean_scrub_stamp":"2023-11-28T20:00:12.764355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2023-11-28T20:00:12.795967+0000","last_change":"2023-11-28T20:00:12.795967+0000","last_active":"2023-11-28T20:00:12.764355+0000","last_peered":"2023-11-28T20:00:12.764355+0000","last_clean":"2023-11-28T20:00:12.764355+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:00:12.795967+0000","last_undegraded":"2023-11-28T20:00:12.795967+0000","last_fullsized":"2023-11-28T20:00:12.795967+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_clean_scrub_stamp":"2023-11-28T20:00:12.764355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2023-11-28T20:00:12.784227+0000","last_change":"2023-11-28T20:00:12.784227+0000","last_active":"2023-11-28T20:00:12.764355+0000","last_peered":"2023-11-28T20:00:12.764355+0000","last_clean":"2023-11-28T20:00:12.764355+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:00:12.784227+0000","last_undegraded":"2023-11-28T20:00:12.784227+0000","last_fullsized":"2023-11-28T20:00:12.784227+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_clean_scrub_stamp":"2023-11-28T20:00:12.764355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2023-11-28T20:00:12.789120+0000","last_change":"2023-11-28T20:00:12.789120+0000","last_active":"2023-11-28T20:00:12.764355+0000","last_peered":"2023-11-28T20:00:12.764355+0000","last_clean":"2023-11-28T20:00:12.764355+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:00:12.789120+0000","last_undegraded":"2023-11-28T20:00:12.789120+0000","last_fullsized":"2023-11-28T20:00:12.789120+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_clean_scrub_stamp":"2023-11-28T20:00:12.764355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2023-11-28T20:00:12.783757+0000","last_change":"2023-11-28T20:00:12.783757+0000","last_active":"2023-11-28T20:00:12.764355+0000","last_peered":"2023-11-28T20:00:12.764355+0000","last_clean":"2023-11-28T20:00:12.764355+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:00:12.783757+0000","last_undegraded":"2023-11-28T20:00:12.783757+0000","last_fullsized":"2023-11-28T20:00:12.783757+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_clean_scrub_stamp":"2023-11-28T20:00:12.764355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2023-11-28T20:00:12.788137+0000","last_change":"2023-11-28T20:00:12.788137+0000","last_active":"2023-11-28T20:00:12.764355+0000","last_peered":"2023-11-28T20:00:12.764355+0000","last_clean":"2023-11-28T20:00:12.764355+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:00:12.788137+0000","last_undegraded":"2023-11-28T20:00:12.788137+0000","last_fullsized":"2023-11-28T20:00:12.788137+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_clean_scrub_stamp":"2023-11-28T20:00:12.764355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2023-11-28T20:00:12.786772+0000","last_change":"2023-11-28T20:00:12.786772+0000","last_active":"2023-11-28T20:00:12.764355+0000","last_peered":"2023-11-28T20:00:12.764355+0000","last_clean":"2023-11-28T20:00:12.764355+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:00:12.786772+0000","last_undegraded":"2023-11-28T20:00:12.786772+0000","last_fullsized":"2023-11-28T20:00:12.786772+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_clean_scrub_stamp":"2023-11-28T20:00:12.764355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2023-11-28T20:00:12.785537+0000","last_change":"2023-11-28T20:00:12.785537+0000","last_active":"2023-11-28T20:00:12.764355+0000","last_peered":"2023-11-28T20:00:12.764355+0000","last_clean":"2023-11-28T20:00:12.764355+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:00:12.785537+0000","last_undegraded":"2023-11-28T20:00:12.785537+0000","last_fullsized":"2023-11-28T20:00:12.785537+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_clean_scrub_stamp":"2023-11-28T20:00:12.764355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2023-11-28T20:00:12.778466+0000","last_change":"2023-11-28T20:00:12.778466+0000","last_active":"2023-11-28T20:00:12.764355+0000","last_peered":"2023-11-28T20:00:12.764355+0000","last_clean":"2023-11-28T20:00:12.764355+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:00:12.778466+0000","last_undegraded":"2023-11-28T20:00:12.778466+0000","last_fullsized":"2023-11-28T20:00:12.778466+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_clean_scrub_stamp":"2023-11-28T20:00:12.764355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2023-11-28T20:00:12.785360+0000","last_change":"2023-11-28T20:00:12.785360+0000","last_active":"2023-11-28T20:00:12.764355+0000","last_peered":"2023-11-28T20:00:12.764355+0000","last_clean":"2023-11-28T20:00:12.764355+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:00:12.785360+0000","last_undegraded":"2023-11-28T20:00:12.785360+0000","last_fullsized":"2023-11-28T20:00:12.785360+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_clean_scrub_stamp":"2023-11-28T20:00:12.764355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2023-11-28T20:00:12.779039+0000","last_change":"2023-11-28T20:00:12.779039+0000","last_active":"2023-11-28T20:00:12.764355+0000","last_peered":"2023-11-28T20:00:12.764355+0000","last_clean":"2023-11-28T20:00:12.764355+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:00:12.779039+0000","last_undegraded":"2023-11-28T20:00:12.779039+0000","last_fullsized":"2023-11-28T20:00:12.779039+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_clean_scrub_stamp":"2023-11-28T20:00:12.764355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2023-11-28T20:00:12.786544+0000","last_change":"2023-11-28T20:00:12.786544+0000","last_active":"2023-11-28T20:00:12.764355+0000","last_peered":"2023-11-28T20:00:12.764355+0000","last_clean":"2023-11-28T20:00:12.764355+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:00:12.786544+0000","last_undegraded":"2023-11-28T20:00:12.786544+0000","last_fullsized":"2023-11-28T20:00:12.786544+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_clean_scrub_stamp":"2023-11-28T20:00:12.764355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2023-11-28T20:00:12.782742+0000","last_change":"2023-11-28T20:00:12.782742+0000","last_active":"2023-11-28T20:00:12.764355+0000","last_peered":"2023-11-28T20:00:12.764355+0000","last_clean":"2023-11-28T20:00:12.764355+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:00:12.782742+0000","last_undegraded":"2023-11-28T20:00:12.782742+0000","last_fullsized":"2023-11-28T20:00:12.782742+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_clean_scrub_stamp":"2023-11-28T20:00:12.764355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2023-11-28T20:00:12.786852+0000","last_change":"2023-11-28T20:00:12.786852+0000","last_active":"2023-11-28T20:00:12.764355+0000","last_peered":"2023-11-28T20:00:12.764355+0000","last_clean":"2023-11-28T20:00:12.764355+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:00:12.786852+0000","last_undegraded":"2023-11-28T20:00:12.786852+0000","last_fullsized":"2023-11-28T20:00:12.786852+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_clean_scrub_stamp":"2023-11-28T20:00:12.764355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2023-11-28T20:00:12.778685+0000","last_change":"2023-11-28T20:00:12.778685+0000","last_active":"2023-11-28T20:00:12.764355+0000","last_peered":"2023-11-28T20:00:12.764355+0000","last_clean":"2023-11-28T20:00:12.764355+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:00:12.778685+0000","last_undegraded":"2023-11-28T20:00:12.778685+0000","last_fullsized":"2023-11-28T20:00:12.778685+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_clean_scrub_stamp":"2023-11-28T20:00:12.764355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2023-11-28T20:00:12.778411+0000","last_change":"2023-11-28T20:00:12.778411+0000","last_active":"2023-11-28T20:00:12.764355+0000","last_peered":"2023-11-28T20:00:12.764355+0000","last_clean":"2023-11-28T20:00:12.764355+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:00:12.778411+0000","last_undegraded":"2023-11-28T20:00:12.778411+0000","last_fullsized":"2023-11-28T20:00:12.778411+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_clean_scrub_stamp":"2023-11-28T20:00:12.764355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2023-11-28T20:00:12.784938+0000","last_change":"2023-11-28T20:00:12.784938+0000","last_active":"2023-11-28T20:00:12.764355+0000","last_peered":"2023-11-28T20:00:12.764355+0000","last_clean":"2023-11-28T20:00:12.764355+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:00:12.784938+0000","last_undegraded":"2023-11-28T20:00:12.784938+0000","last_fullsized":"2023-11-28T20:00:12.784938+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_clean_scrub_stamp":"2023-11-28T20:00:12.764355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2023-11-28T20:00:12.777818+0000","last_change":"2023-11-28T20:00:12.777818+0000","last_active":"2023-11-28T20:00:12.764355+0000","last_peered":"2023-11-28T20:00:12.764355+0000","last_clean":"2023-11-28T20:00:12.764355+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:00:12.777818+0000","last_undegraded":"2023-11-28T20:00:12.777818+0000","last_fullsized":"2023-11-28T20:00:12.777818+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_clean_scrub_stamp":"2023-11-28T20:00:12.764355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2023-11-28T20:00:12.787079+0000","last_change":"2023-11-28T20:00:12.787079+0000","last_active":"2023-11-28T20:00:12.764355+0000","last_peered":"2023-11-28T20:00:12.764355+0000","last_clean":"2023-11-28T20:00:12.764355+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:00:12.787079+0000","last_undegraded":"2023-11-28T20:00:12.787079+0000","last_fullsized":"2023-11-28T20:00:12.787079+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_clean_scrub_stamp":"2023-11-28T20:00:12.764355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2023-11-28T20:00:12.779329+0000","last_change":"2023-11-28T20:00:12.779329+0000","last_active":"2023-11-28T20:00:12.764355+0000","last_peered":"2023-11-28T20:00:12.764355+0000","last_clean":"2023-11-28T20:00:12.764355+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:00:12.779329+0000","last_undegraded":"2023-11-28T20:00:12.779329+0000","last_fullsized":"2023-11-28T20:00:12.779329+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_clean_scrub_stamp":"2023-11-28T20:00:12.764355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2023-11-28T20:00:12.778067+0000","last_change":"2023-11-28T20:00:12.778067+0000","last_active":"2023-11-28T20:00:12.764355+0000","last_peered":"2023-11-28T20:00:12.764355+0000","last_clean":"2023-11-28T20:00:12.764355+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:00:12.778067+0000","last_undegraded":"2023-11-28T20:00:12.778067+0000","last_fullsized":"2023-11-28T20:00:12.778067+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_clean_scrub_stamp":"2023-11-28T20:00:12.764355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2023-11-28T20:00:12.785172+0000","last_change":"2023-11-28T20:00:12.785172+0000","last_active":"2023-11-28T20:00:12.764355+0000","last_peered":"2023-11-28T20:00:12.764355+0000","last_clean":"2023-11-28T20:00:12.764355+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:00:12.785172+0000","last_undegraded":"2023-11-28T20:00:12.785172+0000","last_fullsized":"2023-11-28T20:00:12.785172+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_clean_scrub_stamp":"2023-11-28T20:00:12.764355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2023-11-28T20:00:12.783287+0000","last_change":"2023-11-28T20:00:12.783287+0000","last_active":"2023-11-28T20:00:12.764355+0000","last_peered":"2023-11-28T20:00:12.764355+0000","last_clean":"2023-11-28T20:00:12.764355+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:00:12.783287+0000","last_undegraded":"2023-11-28T20:00:12.783287+0000","last_fullsized":"2023-11-28T20:00:12.783287+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_clean_scrub_stamp":"2023-11-28T20:00:12.764355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2023-11-28T20:00:12.784405+0000","last_change":"2023-11-28T20:00:12.784405+0000","last_active":"2023-11-28T20:00:12.764355+0000","last_peered":"2023-11-28T20:00:12.764355+0000","last_clean":"2023-11-28T20:00:12.764355+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:00:12.784405+0000","last_undegraded":"2023-11-28T20:00:12.784405+0000","last_fullsized":"2023-11-28T20:00:12.784405+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_clean_scrub_stamp":"2023-11-28T20:00:12.764355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-28T20:00:12.802099+0000","last_change":"2023-11-28T20:00:12.794933+0000","last_active":"2023-11-28T20:00:12.802099+0000","last_peered":"2023-11-28T20:00:12.802099+0000","last_clean":"2023-11-28T20:00:12.802099+0000","last_became_active":"2023-11-28T20:00:12.794598+0000","last_became_peered":"2023-11-28T20:00:12.794598+0000","last_unstale":"2023-11-28T20:00:12.802099+0000","last_undegraded":"2023-11-28T20:00:12.802099+0000","last_fullsized":"2023-11-28T20:00:12.802099+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:11.760656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:11.760656+0000","last_clean_scrub_stamp":"2023-11-28T20:00:11.760656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:49:36.064771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2023-11-28T20:00:12.785747+0000","last_change":"2023-11-28T20:00:12.785747+0000","last_active":"2023-11-28T20:00:12.764355+0000","last_peered":"2023-11-28T20:00:12.764355+0000","last_clean":"2023-11-28T20:00:12.764355+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:00:12.785747+0000","last_undegraded":"2023-11-28T20:00:12.785747+0000","last_fullsized":"2023-11-28T20:00:12.785747+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_clean_scrub_stamp":"2023-11-28T20:00:12.764355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-28T20:00:12.796674+0000","last_change":"2023-11-28T20:00:12.794372+0000","last_active":"2023-11-28T20:00:12.796674+0000","last_peered":"2023-11-28T20:00:12.796674+0000","last_clean":"2023-11-28T20:00:12.796674+0000","last_became_active":"2023-11-28T20:00:12.794166+0000","last_became_peered":"2023-11-28T20:00:12.794166+0000","last_unstale":"2023-11-28T20:00:12.796674+0000","last_undegraded":"2023-11-28T20:00:12.796674+0000","last_fullsized":"2023-11-28T20:00:12.796674+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:11.760656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:11.760656+0000","last_clean_scrub_stamp":"2023-11-28T20:00:11.760656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:19:33.219723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2023-11-28T20:00:12.782867+0000","last_change":"2023-11-28T20:00:12.782867+0000","last_active":"2023-11-28T20:00:12.764355+0000","last_peered":"2023-11-28T20:00:12.764355+0000","last_clean":"2023-11-28T20:00:12.764355+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:00:12.782867+0000","last_undegraded":"2023-11-28T20:00:12.782867+0000","last_fullsized":"2023-11-28T20:00:12.782867+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_clean_scrub_stamp":"2023-11-28T20:00:12.764355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-28T20:00:12.802319+0000","last_change":"2023-11-28T20:00:12.797247+0000","last_active":"2023-11-28T20:00:12.802319+0000","last_peered":"2023-11-28T20:00:12.802319+0000","last_clean":"2023-11-28T20:00:12.802319+0000","last_became_active":"2023-11-28T20:00:12.797003+0000","last_became_peered":"2023-11-28T20:00:12.797003+0000","last_unstale":"2023-11-28T20:00:12.802319+0000","last_undegraded":"2023-11-28T20:00:12.802319+0000","last_fullsized":"2023-11-28T20:00:12.802319+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:11.760656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:11.760656+0000","last_clean_scrub_stamp":"2023-11-28T20:00:11.760656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:21:43.946565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2023-11-28T20:00:12.786170+0000","last_change":"2023-11-28T20:00:12.786170+0000","last_active":"2023-11-28T20:00:12.764355+0000","last_peered":"2023-11-28T20:00:12.764355+0000","last_clean":"2023-11-28T20:00:12.764355+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:00:12.786170+0000","last_undegraded":"2023-11-28T20:00:12.786170+0000","last_fullsized":"2023-11-28T20:00:12.786170+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_clean_scrub_stamp":"2023-11-28T20:00:12.764355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-28T20:00:12.800895+0000","last_change":"2023-11-28T20:00:12.799178+0000","last_active":"2023-11-28T20:00:12.800895+0000","last_peered":"2023-11-28T20:00:12.800895+0000","last_clean":"2023-11-28T20:00:12.800895+0000","last_became_active":"2023-11-28T20:00:12.798834+0000","last_became_peered":"2023-11-28T20:00:12.798834+0000","last_unstale":"2023-11-28T20:00:12.800895+0000","last_undegraded":"2023-11-28T20:00:12.800895+0000","last_fullsized":"2023-11-28T20:00:12.800895+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:11.760656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:11.760656+0000","last_clean_scrub_stamp":"2023-11-28T20:00:11.760656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:08:56.081544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2023-11-28T20:00:12.782917+0000","last_change":"2023-11-28T20:00:12.782917+0000","last_active":"2023-11-28T20:00:12.764355+0000","last_peered":"2023-11-28T20:00:12.764355+0000","last_clean":"2023-11-28T20:00:12.764355+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:00:12.782917+0000","last_undegraded":"2023-11-28T20:00:12.782917+0000","last_fullsized":"2023-11-28T20:00:12.782917+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_clean_scrub_stamp":"2023-11-28T20:00:12.764355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-28T20:00:12.807652+0000","last_change":"2023-11-28T20:00:12.804157+0000","last_active":"2023-11-28T20:00:12.807652+0000","last_peered":"2023-11-28T20:00:12.807652+0000","last_clean":"2023-11-28T20:00:12.807652+0000","last_became_active":"2023-11-28T20:00:12.803950+0000","last_became_peered":"2023-11-28T20:00:12.803950+0000","last_unstale":"2023-11-28T20:00:12.807652+0000","last_undegraded":"2023-11-28T20:00:12.807652+0000","last_fullsized":"2023-11-28T20:00:12.807652+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:11.760656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:11.760656+0000","last_clean_scrub_stamp":"2023-11-28T20:00:11.760656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:38:54.348106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2023-11-28T20:00:12.787659+0000","last_change":"2023-11-28T20:00:12.787659+0000","last_active":"2023-11-28T20:00:12.764355+0000","last_peered":"2023-11-28T20:00:12.764355+0000","last_clean":"2023-11-28T20:00:12.764355+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:00:12.787659+0000","last_undegraded":"2023-11-28T20:00:12.787659+0000","last_fullsized":"2023-11-28T20:00:12.787659+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_clean_scrub_stamp":"2023-11-28T20:00:12.764355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-28T20:00:12.799490+0000","last_change":"2023-11-28T20:00:12.797188+0000","last_active":"2023-11-28T20:00:12.799490+0000","last_peered":"2023-11-28T20:00:12.799490+0000","last_clean":"2023-11-28T20:00:12.799490+0000","last_became_active":"2023-11-28T20:00:12.796926+0000","last_became_peered":"2023-11-28T20:00:12.796926+0000","last_unstale":"2023-11-28T20:00:12.799490+0000","last_undegraded":"2023-11-28T20:00:12.799490+0000","last_fullsized":"2023-11-28T20:00:12.799490+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:11.760656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:11.760656+0000","last_clean_scrub_stamp":"2023-11-28T20:00:11.760656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:19:33.219723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2023-11-28T20:00:12.782226+0000","last_change":"2023-11-28T20:00:12.782226+0000","last_active":"2023-11-28T20:00:12.764355+0000","last_peered":"2023-11-28T20:00:12.764355+0000","last_clean":"2023-11-28T20:00:12.764355+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:00:12.782226+0000","last_undegraded":"2023-11-28T20:00:12.782226+0000","last_fullsized":"2023-11-28T20:00:12.782226+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_clean_scrub_stamp":"2023-11-28T20:00:12.764355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-28T20:00:12.809928+0000","last_change":"2023-11-28T20:00:12.805374+0000","last_active":"2023-11-28T20:00:12.809928+0000","last_peered":"2023-11-28T20:00:12.809928+0000","last_clean":"2023-11-28T20:00:12.809928+0000","last_became_active":"2023-11-28T20:00:12.805094+0000","last_became_peered":"2023-11-28T20:00:12.805094+0000","last_unstale":"2023-11-28T20:00:12.809928+0000","last_undegraded":"2023-11-28T20:00:12.809928+0000","last_fullsized":"2023-11-28T20:00:12.809928+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:11.760656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:11.760656+0000","last_clean_scrub_stamp":"2023-11-28T20:00:11.760656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:09:51.354913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2023-11-28T20:00:12.785875+0000","last_change":"2023-11-28T20:00:12.785875+0000","last_active":"2023-11-28T20:00:12.764355+0000","last_peered":"2023-11-28T20:00:12.764355+0000","last_clean":"2023-11-28T20:00:12.764355+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:00:12.785875+0000","last_undegraded":"2023-11-28T20:00:12.785875+0000","last_fullsized":"2023-11-28T20:00:12.785875+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_clean_scrub_stamp":"2023-11-28T20:00:12.764355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-28T20:00:12.799056+0000","last_change":"2023-11-28T20:00:12.797265+0000","last_active":"2023-11-28T20:00:12.799056+0000","last_peered":"2023-11-28T20:00:12.799056+0000","last_clean":"2023-11-28T20:00:12.799056+0000","last_became_active":"2023-11-28T20:00:12.794418+0000","last_became_peered":"2023-11-28T20:00:12.794418+0000","last_unstale":"2023-11-28T20:00:12.799056+0000","last_undegraded":"2023-11-28T20:00:12.799056+0000","last_fullsized":"2023-11-28T20:00:12.799056+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:11.760656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:11.760656+0000","last_clean_scrub_stamp":"2023-11-28T20:00:11.760656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:05:35.913865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2023-11-28T20:00:12.777621+0000","last_change":"2023-11-28T20:00:12.777621+0000","last_active":"2023-11-28T20:00:12.764355+0000","last_peered":"2023-11-28T20:00:12.764355+0000","last_clean":"2023-11-28T20:00:12.764355+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:00:12.777621+0000","last_undegraded":"2023-11-28T20:00:12.777621+0000","last_fullsized":"2023-11-28T20:00:12.777621+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_clean_scrub_stamp":"2023-11-28T20:00:12.764355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-28T20:00:12.802016+0000","last_change":"2023-11-28T20:00:12.796227+0000","last_active":"2023-11-28T20:00:12.802016+0000","last_peered":"2023-11-28T20:00:12.802016+0000","last_clean":"2023-11-28T20:00:12.802016+0000","last_became_active":"2023-11-28T20:00:12.795944+0000","last_became_peered":"2023-11-28T20:00:12.795944+0000","last_unstale":"2023-11-28T20:00:12.802016+0000","last_undegraded":"2023-11-28T20:00:12.802016+0000","last_fullsized":"2023-11-28T20:00:12.802016+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:11.760656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:11.760656+0000","last_clean_scrub_stamp":"2023-11-28T20:00:11.760656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:31:39.960893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2023-11-28T20:00:12.785784+0000","last_change":"2023-11-28T20:00:12.785784+0000","last_active":"2023-11-28T20:00:12.764355+0000","last_peered":"2023-11-28T20:00:12.764355+0000","last_clean":"2023-11-28T20:00:12.764355+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:00:12.785784+0000","last_undegraded":"2023-11-28T20:00:12.785784+0000","last_fullsized":"2023-11-28T20:00:12.785784+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_clean_scrub_stamp":"2023-11-28T20:00:12.764355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-28T20:00:12.807231+0000","last_change":"2023-11-28T20:00:12.803866+0000","last_active":"2023-11-28T20:00:12.807231+0000","last_peered":"2023-11-28T20:00:12.807231+0000","last_clean":"2023-11-28T20:00:12.807231+0000","last_became_active":"2023-11-28T20:00:12.803431+0000","last_became_peered":"2023-11-28T20:00:12.803431+0000","last_unstale":"2023-11-28T20:00:12.807231+0000","last_undegraded":"2023-11-28T20:00:12.807231+0000","last_fullsized":"2023-11-28T20:00:12.807231+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:11.760656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:11.760656+0000","last_clean_scrub_stamp":"2023-11-28T20:00:11.760656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:39:04.449924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2023-11-28T20:00:12.782260+0000","last_change":"2023-11-28T20:00:12.782260+0000","last_active":"2023-11-28T20:00:12.764355+0000","last_peered":"2023-11-28T20:00:12.764355+0000","last_clean":"2023-11-28T20:00:12.764355+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:00:12.782260+0000","last_undegraded":"2023-11-28T20:00:12.782260+0000","last_fullsized":"2023-11-28T20:00:12.782260+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_clean_scrub_stamp":"2023-11-28T20:00:12.764355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-28T20:00:12.807316+0000","last_change":"2023-11-28T20:00:12.804096+0000","last_active":"2023-11-28T20:00:12.807316+0000","last_peered":"2023-11-28T20:00:12.807316+0000","last_clean":"2023-11-28T20:00:12.807316+0000","last_became_active":"2023-11-28T20:00:12.803797+0000","last_became_peered":"2023-11-28T20:00:12.803797+0000","last_unstale":"2023-11-28T20:00:12.807316+0000","last_undegraded":"2023-11-28T20:00:12.807316+0000","last_fullsized":"2023-11-28T20:00:12.807316+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:11.760656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:11.760656+0000","last_clean_scrub_stamp":"2023-11-28T20:00:11.760656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:22:32.210725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2023-11-28T20:00:12.783554+0000","last_change":"2023-11-28T20:00:12.783554+0000","last_active":"2023-11-28T20:00:12.764355+0000","last_peered":"2023-11-28T20:00:12.764355+0000","last_clean":"2023-11-28T20:00:12.764355+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:00:12.783554+0000","last_undegraded":"2023-11-28T20:00:12.783554+0000","last_fullsized":"2023-11-28T20:00:12.783554+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_clean_scrub_stamp":"2023-11-28T20:00:12.764355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-28T20:00:12.802061+0000","last_change":"2023-11-28T20:00:12.797894+0000","last_active":"2023-11-28T20:00:12.802061+0000","last_peered":"2023-11-28T20:00:12.802061+0000","last_clean":"2023-11-28T20:00:12.802061+0000","last_became_active":"2023-11-28T20:00:12.797594+0000","last_became_peered":"2023-11-28T20:00:12.797594+0000","last_unstale":"2023-11-28T20:00:12.802061+0000","last_undegraded":"2023-11-28T20:00:12.802061+0000","last_fullsized":"2023-11-28T20:00:12.802061+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:11.760656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:11.760656+0000","last_clean_scrub_stamp":"2023-11-28T20:00:11.760656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:18:17.461220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2023-11-28T20:00:12.782220+0000","last_change":"2023-11-28T20:00:12.782220+0000","last_active":"2023-11-28T20:00:12.764355+0000","last_peered":"2023-11-28T20:00:12.764355+0000","last_clean":"2023-11-28T20:00:12.764355+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:00:12.782220+0000","last_undegraded":"2023-11-28T20:00:12.782220+0000","last_fullsized":"2023-11-28T20:00:12.782220+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_clean_scrub_stamp":"2023-11-28T20:00:12.764355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-28T20:00:12.801117+0000","last_change":"2023-11-28T20:00:12.794915+0000","last_active":"2023-11-28T20:00:12.801117+0000","last_peered":"2023-11-28T20:00:12.801117+0000","last_clean":"2023-11-28T20:00:12.801117+0000","last_became_active":"2023-11-28T20:00:12.793728+0000","last_became_peered":"2023-11-28T20:00:12.793728+0000","last_unstale":"2023-11-28T20:00:12.801117+0000","last_undegraded":"2023-11-28T20:00:12.801117+0000","last_fullsized":"2023-11-28T20:00:12.801117+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:11.760656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:11.760656+0000","last_clean_scrub_stamp":"2023-11-28T20:00:11.760656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:30:40.433274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2023-11-28T20:00:12.783042+0000","last_change":"2023-11-28T20:00:12.783042+0000","last_active":"2023-11-28T20:00:12.764355+0000","last_peered":"2023-11-28T20:00:12.764355+0000","last_clean":"2023-11-28T20:00:12.764355+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:00:12.783042+0000","last_undegraded":"2023-11-28T20:00:12.783042+0000","last_fullsized":"2023-11-28T20:00:12.783042+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_clean_scrub_stamp":"2023-11-28T20:00:12.764355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-28T20:00:12.809921+0000","last_change":"2023-11-28T20:00:12.805313+0000","last_active":"2023-11-28T20:00:12.809921+0000","last_peered":"2023-11-28T20:00:12.809921+0000","last_clean":"2023-11-28T20:00:12.809921+0000","last_became_active":"2023-11-28T20:00:12.804998+0000","last_became_peered":"2023-11-28T20:00:12.804998+0000","last_unstale":"2023-11-28T20:00:12.809921+0000","last_undegraded":"2023-11-28T20:00:12.809921+0000","last_fullsized":"2023-11-28T20:00:12.809921+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:11.760656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:11.760656+0000","last_clean_scrub_stamp":"2023-11-28T20:00:11.760656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:55:34.737227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2023-11-28T20:00:12.784155+0000","last_change":"2023-11-28T20:00:12.784155+0000","last_active":"2023-11-28T20:00:12.764355+0000","last_peered":"2023-11-28T20:00:12.764355+0000","last_clean":"2023-11-28T20:00:12.764355+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:00:12.784155+0000","last_undegraded":"2023-11-28T20:00:12.784155+0000","last_fullsized":"2023-11-28T20:00:12.784155+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_clean_scrub_stamp":"2023-11-28T20:00:12.764355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-28T20:00:12.792278+0000","last_change":"2023-11-28T20:00:12.789146+0000","last_active":"2023-11-28T20:00:12.792278+0000","last_peered":"2023-11-28T20:00:12.792278+0000","last_clean":"2023-11-28T20:00:12.792278+0000","last_became_active":"2023-11-28T20:00:12.788447+0000","last_became_peered":"2023-11-28T20:00:12.788447+0000","last_unstale":"2023-11-28T20:00:12.792278+0000","last_undegraded":"2023-11-28T20:00:12.792278+0000","last_fullsized":"2023-11-28T20:00:12.792278+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:11.760656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:11.760656+0000","last_clean_scrub_stamp":"2023-11-28T20:00:11.760656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:51:42.810996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2023-11-28T20:00:12.784798+0000","last_change":"2023-11-28T20:00:12.784798+0000","last_active":"2023-11-28T20:00:12.764355+0000","last_peered":"2023-11-28T20:00:12.764355+0000","last_clean":"2023-11-28T20:00:12.764355+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:00:12.784798+0000","last_undegraded":"2023-11-28T20:00:12.784798+0000","last_fullsized":"2023-11-28T20:00:12.784798+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_clean_scrub_stamp":"2023-11-28T20:00:12.764355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-28T20:00:12.800818+0000","last_change":"2023-11-28T20:00:12.799040+0000","last_active":"2023-11-28T20:00:12.800818+0000","last_peered":"2023-11-28T20:00:12.800818+0000","last_clean":"2023-11-28T20:00:12.800818+0000","last_became_active":"2023-11-28T20:00:12.798730+0000","last_became_peered":"2023-11-28T20:00:12.798730+0000","last_unstale":"2023-11-28T20:00:12.800818+0000","last_undegraded":"2023-11-28T20:00:12.800818+0000","last_fullsized":"2023-11-28T20:00:12.800818+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:11.760656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:11.760656+0000","last_clean_scrub_stamp":"2023-11-28T20:00:11.760656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T06:41:49.723414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2023-11-28T20:00:12.786939+0000","last_change":"2023-11-28T20:00:12.786939+0000","last_active":"2023-11-28T20:00:12.764355+0000","last_peered":"2023-11-28T20:00:12.764355+0000","last_clean":"2023-11-28T20:00:12.764355+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:00:12.786939+0000","last_undegraded":"2023-11-28T20:00:12.786939+0000","last_fullsized":"2023-11-28T20:00:12.786939+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_clean_scrub_stamp":"2023-11-28T20:00:12.764355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-28T20:00:12.807215+0000","last_change":"2023-11-28T20:00:12.803142+0000","last_active":"2023-11-28T20:00:12.807215+0000","last_peered":"2023-11-28T20:00:12.807215+0000","last_clean":"2023-11-28T20:00:12.807215+0000","last_became_active":"2023-11-28T20:00:12.802775+0000","last_became_peered":"2023-11-28T20:00:12.802775+0000","last_unstale":"2023-11-28T20:00:12.807215+0000","last_undegraded":"2023-11-28T20:00:12.807215+0000","last_fullsized":"2023-11-28T20:00:12.807215+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:11.760656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:11.760656+0000","last_clean_scrub_stamp":"2023-11-28T20:00:11.760656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:31:56.988459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2023-11-28T20:00:12.793965+0000","last_change":"2023-11-28T20:00:12.793965+0000","last_active":"2023-11-28T20:00:12.764355+0000","last_peered":"2023-11-28T20:00:12.764355+0000","last_clean":"2023-11-28T20:00:12.764355+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:00:12.793965+0000","last_undegraded":"2023-11-28T20:00:12.793965+0000","last_fullsized":"2023-11-28T20:00:12.793965+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_clean_scrub_stamp":"2023-11-28T20:00:12.764355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-28T20:00:12.807286+0000","last_change":"2023-11-28T20:00:12.806331+0000","last_active":"2023-11-28T20:00:12.807286+0000","last_peered":"2023-11-28T20:00:12.807286+0000","last_clean":"2023-11-28T20:00:12.807286+0000","last_became_active":"2023-11-28T20:00:12.805857+0000","last_became_peered":"2023-11-28T20:00:12.805857+0000","last_unstale":"2023-11-28T20:00:12.807286+0000","last_undegraded":"2023-11-28T20:00:12.807286+0000","last_fullsized":"2023-11-28T20:00:12.807286+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:11.760656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:11.760656+0000","last_clean_scrub_stamp":"2023-11-28T20:00:11.760656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:07:27.330964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2023-11-28T20:00:12.783371+0000","last_change":"2023-11-28T20:00:12.783371+0000","last_active":"2023-11-28T20:00:12.764355+0000","last_peered":"2023-11-28T20:00:12.764355+0000","last_clean":"2023-11-28T20:00:12.764355+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:00:12.783371+0000","last_undegraded":"2023-11-28T20:00:12.783371+0000","last_fullsized":"2023-11-28T20:00:12.783371+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_clean_scrub_stamp":"2023-11-28T20:00:12.764355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-28T20:00:12.802514+0000","last_change":"2023-11-28T20:00:12.796923+0000","last_active":"2023-11-28T20:00:12.802514+0000","last_peered":"2023-11-28T20:00:12.802514+0000","last_clean":"2023-11-28T20:00:12.802514+0000","last_became_active":"2023-11-28T20:00:12.796625+0000","last_became_peered":"2023-11-28T20:00:12.796625+0000","last_unstale":"2023-11-28T20:00:12.802514+0000","last_undegraded":"2023-11-28T20:00:12.802514+0000","last_fullsized":"2023-11-28T20:00:12.802514+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:11.760656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:11.760656+0000","last_clean_scrub_stamp":"2023-11-28T20:00:11.760656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:48:42.030591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2023-11-28T20:00:12.782363+0000","last_change":"2023-11-28T20:00:12.782363+0000","last_active":"2023-11-28T20:00:12.764355+0000","last_peered":"2023-11-28T20:00:12.764355+0000","last_clean":"2023-11-28T20:00:12.764355+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:00:12.782363+0000","last_undegraded":"2023-11-28T20:00:12.782363+0000","last_fullsized":"2023-11-28T20:00:12.782363+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_clean_scrub_stamp":"2023-11-28T20:00:12.764355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-28T20:00:12.801643+0000","last_change":"2023-11-28T20:00:12.796705+0000","last_active":"2023-11-28T20:00:12.801643+0000","last_peered":"2023-11-28T20:00:12.801643+0000","last_clean":"2023-11-28T20:00:12.801643+0000","last_became_active":"2023-11-28T20:00:12.796394+0000","last_became_peered":"2023-11-28T20:00:12.796394+0000","last_unstale":"2023-11-28T20:00:12.801643+0000","last_undegraded":"2023-11-28T20:00:12.801643+0000","last_fullsized":"2023-11-28T20:00:12.801643+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:11.760656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:11.760656+0000","last_clean_scrub_stamp":"2023-11-28T20:00:11.760656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T06:41:49.723414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2023-11-28T20:00:12.785552+0000","last_change":"2023-11-28T20:00:12.785552+0000","last_active":"2023-11-28T20:00:12.764355+0000","last_peered":"2023-11-28T20:00:12.764355+0000","last_clean":"2023-11-28T20:00:12.764355+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:00:12.785552+0000","last_undegraded":"2023-11-28T20:00:12.785552+0000","last_fullsized":"2023-11-28T20:00:12.785552+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_clean_scrub_stamp":"2023-11-28T20:00:12.764355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-28T20:00:12.791923+0000","last_change":"2023-11-28T20:00:12.787168+0000","last_active":"2023-11-28T20:00:12.791923+0000","last_peered":"2023-11-28T20:00:12.791923+0000","last_clean":"2023-11-28T20:00:12.791923+0000","last_became_active":"2023-11-28T20:00:12.786815+0000","last_became_peered":"2023-11-28T20:00:12.786815+0000","last_unstale":"2023-11-28T20:00:12.791923+0000","last_undegraded":"2023-11-28T20:00:12.791923+0000","last_fullsized":"2023-11-28T20:00:12.791923+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:11.760656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:11.760656+0000","last_clean_scrub_stamp":"2023-11-28T20:00:11.760656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T06:48:23.539826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2023-11-28T20:00:12.779217+0000","last_change":"2023-11-28T20:00:12.779217+0000","last_active":"2023-11-28T20:00:12.764355+0000","last_peered":"2023-11-28T20:00:12.764355+0000","last_clean":"2023-11-28T20:00:12.764355+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:00:12.779217+0000","last_undegraded":"2023-11-28T20:00:12.779217+0000","last_fullsized":"2023-11-28T20:00:12.779217+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_clean_scrub_stamp":"2023-11-28T20:00:12.764355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-28T20:00:12.792018+0000","last_change":"2023-11-28T20:00:12.789615+0000","last_active":"2023-11-28T20:00:12.792018+0000","last_peered":"2023-11-28T20:00:12.792018+0000","last_clean":"2023-11-28T20:00:12.792018+0000","last_became_active":"2023-11-28T20:00:12.789357+0000","last_became_peered":"2023-11-28T20:00:12.789357+0000","last_unstale":"2023-11-28T20:00:12.792018+0000","last_undegraded":"2023-11-28T20:00:12.792018+0000","last_fullsized":"2023-11-28T20:00:12.792018+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:11.760656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:11.760656+0000","last_clean_scrub_stamp":"2023-11-28T20:00:11.760656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:51:47.744006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2023-11-28T20:00:12.787340+0000","last_change":"2023-11-28T20:00:12.787340+0000","last_active":"2023-11-28T20:00:12.764355+0000","last_peered":"2023-11-28T20:00:12.764355+0000","last_clean":"2023-11-28T20:00:12.764355+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:00:12.787340+0000","last_undegraded":"2023-11-28T20:00:12.787340+0000","last_fullsized":"2023-11-28T20:00:12.787340+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_clean_scrub_stamp":"2023-11-28T20:00:12.764355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-28T20:00:12.797956+0000","last_change":"2023-11-28T20:00:12.794799+0000","last_active":"2023-11-28T20:00:12.797956+0000","last_peered":"2023-11-28T20:00:12.797956+0000","last_clean":"2023-11-28T20:00:12.797956+0000","last_became_active":"2023-11-28T20:00:12.794535+0000","last_became_peered":"2023-11-28T20:00:12.794535+0000","last_unstale":"2023-11-28T20:00:12.797956+0000","last_undegraded":"2023-11-28T20:00:12.797956+0000","last_fullsized":"2023-11-28T20:00:12.797956+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:11.760656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:11.760656+0000","last_clean_scrub_stamp":"2023-11-28T20:00:11.760656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:21:43.946565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2023-11-28T20:00:12.783254+0000","last_change":"2023-11-28T20:00:12.783254+0000","last_active":"2023-11-28T20:00:12.764355+0000","last_peered":"2023-11-28T20:00:12.764355+0000","last_clean":"2023-11-28T20:00:12.764355+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:00:12.783254+0000","last_undegraded":"2023-11-28T20:00:12.783254+0000","last_fullsized":"2023-11-28T20:00:12.783254+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_clean_scrub_stamp":"2023-11-28T20:00:12.764355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-28T20:00:12.791952+0000","last_change":"2023-11-28T20:00:12.787505+0000","last_active":"2023-11-28T20:00:12.791952+0000","last_peered":"2023-11-28T20:00:12.791952+0000","last_clean":"2023-11-28T20:00:12.791952+0000","last_became_active":"2023-11-28T20:00:12.786509+0000","last_became_peered":"2023-11-28T20:00:12.786509+0000","last_unstale":"2023-11-28T20:00:12.791952+0000","last_undegraded":"2023-11-28T20:00:12.791952+0000","last_fullsized":"2023-11-28T20:00:12.791952+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:11.760656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:11.760656+0000","last_clean_scrub_stamp":"2023-11-28T20:00:11.760656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:35:56.918733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2023-11-28T20:00:12.786470+0000","last_change":"2023-11-28T20:00:12.786470+0000","last_active":"2023-11-28T20:00:12.764355+0000","last_peered":"2023-11-28T20:00:12.764355+0000","last_clean":"2023-11-28T20:00:12.764355+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:00:12.786470+0000","last_undegraded":"2023-11-28T20:00:12.786470+0000","last_fullsized":"2023-11-28T20:00:12.786470+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_clean_scrub_stamp":"2023-11-28T20:00:12.764355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-28T20:00:12.807677+0000","last_change":"2023-11-28T20:00:12.804126+0000","last_active":"2023-11-28T20:00:12.807677+0000","last_peered":"2023-11-28T20:00:12.807677+0000","last_clean":"2023-11-28T20:00:12.807677+0000","last_became_active":"2023-11-28T20:00:12.803815+0000","last_became_peered":"2023-11-28T20:00:12.803815+0000","last_unstale":"2023-11-28T20:00:12.807677+0000","last_undegraded":"2023-11-28T20:00:12.807677+0000","last_fullsized":"2023-11-28T20:00:12.807677+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:11.760656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:11.760656+0000","last_clean_scrub_stamp":"2023-11-28T20:00:11.760656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T07:54:02.325947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2023-11-28T20:00:12.785219+0000","last_change":"2023-11-28T20:00:12.785219+0000","last_active":"2023-11-28T20:00:12.764355+0000","last_peered":"2023-11-28T20:00:12.764355+0000","last_clean":"2023-11-28T20:00:12.764355+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:00:12.785219+0000","last_undegraded":"2023-11-28T20:00:12.785219+0000","last_fullsized":"2023-11-28T20:00:12.785219+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_clean_scrub_stamp":"2023-11-28T20:00:12.764355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-28T20:00:12.807159+0000","last_change":"2023-11-28T20:00:12.804114+0000","last_active":"2023-11-28T20:00:12.807159+0000","last_peered":"2023-11-28T20:00:12.807159+0000","last_clean":"2023-11-28T20:00:12.807159+0000","last_became_active":"2023-11-28T20:00:12.803528+0000","last_became_peered":"2023-11-28T20:00:12.803528+0000","last_unstale":"2023-11-28T20:00:12.807159+0000","last_undegraded":"2023-11-28T20:00:12.807159+0000","last_fullsized":"2023-11-28T20:00:12.807159+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:11.760656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:11.760656+0000","last_clean_scrub_stamp":"2023-11-28T20:00:11.760656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:09:19.510844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2023-11-28T20:00:12.783641+0000","last_change":"2023-11-28T20:00:12.783641+0000","last_active":"2023-11-28T20:00:12.764355+0000","last_peered":"2023-11-28T20:00:12.764355+0000","last_clean":"2023-11-28T20:00:12.764355+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:00:12.783641+0000","last_undegraded":"2023-11-28T20:00:12.783641+0000","last_fullsized":"2023-11-28T20:00:12.783641+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_clean_scrub_stamp":"2023-11-28T20:00:12.764355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-28T20:00:12.797021+0000","last_change":"2023-11-28T20:00:12.795099+0000","last_active":"2023-11-28T20:00:12.797021+0000","last_peered":"2023-11-28T20:00:12.797021+0000","last_clean":"2023-11-28T20:00:12.797021+0000","last_became_active":"2023-11-28T20:00:12.794522+0000","last_became_peered":"2023-11-28T20:00:12.794522+0000","last_unstale":"2023-11-28T20:00:12.797021+0000","last_undegraded":"2023-11-28T20:00:12.797021+0000","last_fullsized":"2023-11-28T20:00:12.797021+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:11.760656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:11.760656+0000","last_clean_scrub_stamp":"2023-11-28T20:00:11.760656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:43:03.956082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2023-11-28T20:00:12.778768+0000","last_change":"2023-11-28T20:00:12.778768+0000","last_active":"2023-11-28T20:00:12.764355+0000","last_peered":"2023-11-28T20:00:12.764355+0000","last_clean":"2023-11-28T20:00:12.764355+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:00:12.778768+0000","last_undegraded":"2023-11-28T20:00:12.778768+0000","last_fullsized":"2023-11-28T20:00:12.778768+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_clean_scrub_stamp":"2023-11-28T20:00:12.764355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-28T20:00:12.795504+0000","last_change":"2023-11-28T20:00:12.792743+0000","last_active":"2023-11-28T20:00:12.795504+0000","last_peered":"2023-11-28T20:00:12.795504+0000","last_clean":"2023-11-28T20:00:12.795504+0000","last_became_active":"2023-11-28T20:00:12.792420+0000","last_became_peered":"2023-11-28T20:00:12.792420+0000","last_unstale":"2023-11-28T20:00:12.795504+0000","last_undegraded":"2023-11-28T20:00:12.795504+0000","last_fullsized":"2023-11-28T20:00:12.795504+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:11.760656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:11.760656+0000","last_clean_scrub_stamp":"2023-11-28T20:00:11.760656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:49:36.064771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2023-11-28T20:00:12.788073+0000","last_change":"2023-11-28T20:00:12.788073+0000","last_active":"2023-11-28T20:00:12.764355+0000","last_peered":"2023-11-28T20:00:12.764355+0000","last_clean":"2023-11-28T20:00:12.764355+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:00:12.788073+0000","last_undegraded":"2023-11-28T20:00:12.788073+0000","last_fullsized":"2023-11-28T20:00:12.788073+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_clean_scrub_stamp":"2023-11-28T20:00:12.764355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-28T20:00:12.801066+0000","last_change":"2023-11-28T20:00:12.793819+0000","last_active":"2023-11-28T20:00:12.801066+0000","last_peered":"2023-11-28T20:00:12.801066+0000","last_clean":"2023-11-28T20:00:12.801066+0000","last_became_active":"2023-11-28T20:00:12.793027+0000","last_became_peered":"2023-11-28T20:00:12.793027+0000","last_unstale":"2023-11-28T20:00:12.801066+0000","last_undegraded":"2023-11-28T20:00:12.801066+0000","last_fullsized":"2023-11-28T20:00:12.801066+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:11.760656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:11.760656+0000","last_clean_scrub_stamp":"2023-11-28T20:00:11.760656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:43:03.956082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2023-11-28T20:00:12.783249+0000","last_change":"2023-11-28T20:00:12.783249+0000","last_active":"2023-11-28T20:00:12.764355+0000","last_peered":"2023-11-28T20:00:12.764355+0000","last_clean":"2023-11-28T20:00:12.764355+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:00:12.783249+0000","last_undegraded":"2023-11-28T20:00:12.783249+0000","last_fullsized":"2023-11-28T20:00:12.783249+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_clean_scrub_stamp":"2023-11-28T20:00:12.764355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-28T20:00:12.796446+0000","last_change":"2023-11-28T20:00:12.790049+0000","last_active":"2023-11-28T20:00:12.796446+0000","last_peered":"2023-11-28T20:00:12.796446+0000","last_clean":"2023-11-28T20:00:12.796446+0000","last_became_active":"2023-11-28T20:00:12.789755+0000","last_became_peered":"2023-11-28T20:00:12.789755+0000","last_unstale":"2023-11-28T20:00:12.796446+0000","last_undegraded":"2023-11-28T20:00:12.796446+0000","last_fullsized":"2023-11-28T20:00:12.796446+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:11.760656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:11.760656+0000","last_clean_scrub_stamp":"2023-11-28T20:00:11.760656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:29:35.927577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2023-11-28T20:00:12.784248+0000","last_change":"2023-11-28T20:00:12.784248+0000","last_active":"2023-11-28T20:00:12.764355+0000","last_peered":"2023-11-28T20:00:12.764355+0000","last_clean":"2023-11-28T20:00:12.764355+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:00:12.784248+0000","last_undegraded":"2023-11-28T20:00:12.784248+0000","last_fullsized":"2023-11-28T20:00:12.784248+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_clean_scrub_stamp":"2023-11-28T20:00:12.764355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-28T20:00:12.801088+0000","last_change":"2023-11-28T20:00:12.794531+0000","last_active":"2023-11-28T20:00:12.801088+0000","last_peered":"2023-11-28T20:00:12.801088+0000","last_clean":"2023-11-28T20:00:12.801088+0000","last_became_active":"2023-11-28T20:00:12.794205+0000","last_became_peered":"2023-11-28T20:00:12.794205+0000","last_unstale":"2023-11-28T20:00:12.801088+0000","last_undegraded":"2023-11-28T20:00:12.801088+0000","last_fullsized":"2023-11-28T20:00:12.801088+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:11.760656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:11.760656+0000","last_clean_scrub_stamp":"2023-11-28T20:00:11.760656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:18:52.212443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2023-11-28T20:00:12.792646+0000","last_change":"2023-11-28T20:00:12.792646+0000","last_active":"2023-11-28T20:00:12.764355+0000","last_peered":"2023-11-28T20:00:12.764355+0000","last_clean":"2023-11-28T20:00:12.764355+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:00:12.792646+0000","last_undegraded":"2023-11-28T20:00:12.792646+0000","last_fullsized":"2023-11-28T20:00:12.792646+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_clean_scrub_stamp":"2023-11-28T20:00:12.764355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-28T20:00:12.797985+0000","last_change":"2023-11-28T20:00:12.795584+0000","last_active":"2023-11-28T20:00:12.797985+0000","last_peered":"2023-11-28T20:00:12.797985+0000","last_clean":"2023-11-28T20:00:12.797985+0000","last_became_active":"2023-11-28T20:00:12.795179+0000","last_became_peered":"2023-11-28T20:00:12.795179+0000","last_unstale":"2023-11-28T20:00:12.797985+0000","last_undegraded":"2023-11-28T20:00:12.797985+0000","last_fullsized":"2023-11-28T20:00:12.797985+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:11.760656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:11.760656+0000","last_clean_scrub_stamp":"2023-11-28T20:00:11.760656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:55:34.737227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":178,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-28T20:00:11.776047+0000","last_change":"2023-11-28T19:58:56.136501+0000","last_active":"2023-11-28T20:00:11.776047+0000","last_peered":"2023-11-28T20:00:11.776047+0000","last_clean":"2023-11-28T20:00:11.776047+0000","last_became_active":"2023-11-28T19:58:56.135998+0000","last_became_peered":"2023-11-28T19:58:56.135998+0000","last_unstale":"2023-11-28T20:00:11.776047+0000","last_undegraded":"2023-11-28T20:00:11.776047+0000","last_fullsized":"2023-11-28T20:00:11.776047+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:58:54.602349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:58:54.602349+0000","last_clean_scrub_stamp":"2023-11-28T19:58:54.602349+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:33:42.723349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":66748,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574868,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27500,"kb_used_data":480,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344340,"statfs":{"total":96636764160,"available":96608604160,"internally_reserved":0,"allocated":491520,"data_stored":768840,"data_compressed":33374,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 19:59:54 2023","interfaces":[{"interface":"back","average":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":0.90700000000000003,"5min":0.90700000000000003,"15min":0.90700000000000003},"last":0.76300000000000001},{"interface":"front","average":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"min":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":0.98999999999999999,"5min":0.98999999999999999,"15min":0.98999999999999999},"last":0.61299999999999999}]},{"osd":1,"last update":"Tue Nov 28 19:59:54 2023","interfaces":[{"interface":"back","average":{"1min":0.64600000000000002,"5min":0.64600000000000002,"15min":0.64600000000000002},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":0.89600000000000002,"5min":0.89600000000000002,"15min":0.89600000000000002},"last":0.82899999999999996},{"interface":"front","average":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.70199999999999996},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":1.0900000000000001,"5min":1.0900000000000001,"15min":1.0900000000000001},"last":0.68899999999999995}]},{"osd":2,"last update":"Tue Nov 28 19:59:54 2023","interfaces":[{"interface":"back","average":{"1min":0.73499999999999999,"5min":0.73499999999999999,"15min":0.73499999999999999},"min":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"max":{"1min":0.98799999999999999,"5min":0.98799999999999999,"15min":0.98799999999999999},"last":0.81499999999999995},{"interface":"front","average":{"1min":0.70699999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":1.0680000000000001,"5min":1.0680000000000001,"15min":1.0680000000000001},"last":0.85599999999999998}]},{"osd":3,"last update":"Tue Nov 28 19:59:54 2023","interfaces":[{"interface":"back","average":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"min":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":1.0449999999999999,"5min":1.0449999999999999,"15min":1.0449999999999999},"last":0.876},{"interface":"front","average":{"1min":0.79300000000000004,"5min":0.79300000000000004,"15min":0.79300000000000004},"min":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"max":{"1min":1.1299999999999999,"5min":1.1299999999999999,"15min":1.1299999999999999},"last":0.84599999999999997}]},{"osd":4,"last update":"Tue Nov 28 19:59:54 2023","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":1.018,"5min":1.018,"15min":1.018},"last":0.51500000000000001},{"interface":"front","average":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"min":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.1120000000000001,"5min":1.1120000000000001,"15min":1.1120000000000001},"last":0.56599999999999995}]},{"osd":5,"last update":"Tue Nov 28 19:59:54 2023","interfaces":[{"interface":"back","average":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":1.1699999999999999,"5min":1.1699999999999999,"15min":1.1699999999999999},"last":0.46000000000000002},{"interface":"front","average":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"min":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":1.1890000000000001,"5min":1.1890000000000001,"15min":1.1890000000000001},"last":0.57999999999999996}]},{"osd":6,"last update":"Tue Nov 28 19:59:54 2023","interfaces":[{"interface":"back","average":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.78200000000000003},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":1.1379999999999999,"5min":1.1379999999999999,"15min":1.1379999999999999},"last":0.63700000000000001},{"interface":"front","average":{"1min":0.747,"5min":0.747,"15min":0.747},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.23,"5min":1.23,"15min":1.23},"last":0.64700000000000002}]}]},{"osd":6,"up_from":13,"seq":55834574866,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27436,"kb_used_data":416,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344404,"statfs":{"total":96636764160,"available":96608669696,"internally_reserved":0,"allocated":425984,"data_stored":178472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 19:59:53 2023","interfaces":[{"interface":"back","average":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.61599999999999999},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.82599999999999996,"5min":0.82599999999999996,"15min":0.82599999999999996},"last":0.58899999999999997},{"interface":"front","average":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":0.98999999999999999,"5min":0.98999999999999999,"15min":0.98999999999999999},"last":0.78700000000000003}]},{"osd":1,"last update":"Tue Nov 28 19:59:53 2023","interfaces":[{"interface":"back","average":{"1min":0.79100000000000004,"5min":0.79100000000000004,"15min":0.79100000000000004},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.105,"5min":1.105,"15min":1.105},"last":0.75900000000000001},{"interface":"front","average":{"1min":0.68700000000000006,"5min":0.68700000000000006,"15min":0.68700000000000006},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.95899999999999996,"5min":0.95899999999999996,"15min":0.95899999999999996},"last":0.67400000000000004}]},{"osd":2,"last update":"Tue Nov 28 19:59:53 2023","interfaces":[{"interface":"back","average":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"min":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":0.93400000000000005,"5min":0.93400000000000005,"15min":0.93400000000000005},"last":0.71899999999999997},{"interface":"front","average":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"min":{"1min":0.505,"5min":0.505,"15min":0.505},"max":{"1min":1.006,"5min":1.006,"15min":1.006},"last":0.77600000000000002}]},{"osd":3,"last update":"Tue Nov 28 19:59:53 2023","interfaces":[{"interface":"back","average":{"1min":0.749,"5min":0.749,"15min":0.749},"min":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"max":{"1min":1.056,"5min":1.056,"15min":1.056},"last":0.68999999999999995},{"interface":"front","average":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":0.88900000000000001,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.65700000000000003}]},{"osd":4,"last update":"Tue Nov 28 19:59:53 2023","interfaces":[{"interface":"back","average":{"1min":0.63100000000000001,"5min":0.63100000000000001,"15min":0.63100000000000001},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":0.96999999999999997,"5min":0.96999999999999997,"15min":0.96999999999999997},"last":0.626},{"interface":"front","average":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":1.389,"5min":1.389,"15min":1.389},"last":0.42399999999999999}]},{"osd":5,"last update":"Tue Nov 28 19:59:53 2023","interfaces":[{"interface":"back","average":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":0.81699999999999995},"min":{"1min":0.5,"5min":0.5,"15min":0.5},"max":{"1min":1.4259999999999999,"5min":1.4259999999999999,"15min":1.4259999999999999},"last":0.47599999999999998},{"interface":"front","average":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"min":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":1.276,"5min":1.276,"15min":1.276},"last":0.56799999999999995}]},{"osd":7,"last update":"Tue Nov 28 19:59:53 2023","interfaces":[{"interface":"back","average":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.71499999999999997},"min":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":0.97599999999999998,"5min":0.97599999999999998,"15min":0.97599999999999998},"last":0.60699999999999998},{"interface":"front","average":{"1min":0.82999999999999996,"5min":0.82999999999999996,"15min":0.82999999999999996},"min":{"1min":0.65600000000000003,"5min":0.65600000000000003,"15min":0.65600000000000003},"max":{"1min":1.242,"5min":1.242,"15min":1.242},"last":0.73899999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574868,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27436,"kb_used_data":416,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344404,"statfs":{"total":96636764160,"available":96608669696,"internally_reserved":0,"allocated":425984,"data_stored":178472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 19:59:53 2023","interfaces":[{"interface":"back","average":{"1min":0.70999999999999996,"5min":0.70999999999999996,"15min":0.70999999999999996},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":0.997,"5min":0.997,"15min":0.997},"last":0.71399999999999997},{"interface":"front","average":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"min":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":1.149,"5min":1.149,"15min":1.149},"last":0.70199999999999996}]},{"osd":1,"last update":"Tue Nov 28 19:59:53 2023","interfaces":[{"interface":"back","average":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":0.92700000000000005,"5min":0.92700000000000005,"15min":0.92700000000000005},"last":0.68999999999999995},{"interface":"front","average":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":1.0940000000000001,"5min":1.0940000000000001,"15min":1.0940000000000001},"last":0.64700000000000002}]},{"osd":2,"last update":"Tue Nov 28 19:59:53 2023","interfaces":[{"interface":"back","average":{"1min":0.94599999999999995,"5min":0.94599999999999995,"15min":0.94599999999999995},"min":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":5.0880000000000001,"5min":5.0880000000000001,"15min":5.0880000000000001},"last":0.67200000000000004},{"interface":"front","average":{"1min":1.002,"5min":1.002,"15min":1.002},"min":{"1min":0.504,"5min":0.504,"15min":0.504},"max":{"1min":5.1399999999999997,"5min":5.1399999999999997,"15min":5.1399999999999997},"last":0.63600000000000001}]},{"osd":3,"last update":"Tue Nov 28 19:59:53 2023","interfaces":[{"interface":"back","average":{"1min":1.028,"5min":1.028,"15min":1.028},"min":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"max":{"1min":5.0469999999999997,"5min":5.0469999999999997,"15min":5.0469999999999997},"last":0.77500000000000002},{"interface":"front","average":{"1min":1.0009999999999999,"5min":1.0009999999999999,"15min":1.0009999999999999},"min":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":5.024,"5min":5.024,"15min":5.024},"last":0.60099999999999998}]},{"osd":4,"last update":"Tue Nov 28 19:59:53 2023","interfaces":[{"interface":"back","average":{"1min":0.67700000000000005,"5min":0.67700000000000005,"15min":0.67700000000000005},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":1.4810000000000001,"5min":1.4810000000000001,"15min":1.4810000000000001},"last":0.53400000000000003},{"interface":"front","average":{"1min":0.747,"5min":0.747,"15min":0.747},"min":{"1min":0.5,"5min":0.5,"15min":0.5},"max":{"1min":1.6339999999999999,"5min":1.6339999999999999,"15min":1.6339999999999999},"last":0.61599999999999999}]},{"osd":6,"last update":"Tue Nov 28 19:59:53 2023","interfaces":[{"interface":"back","average":{"1min":0.70699999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":0.97699999999999998,"5min":0.97699999999999998,"15min":0.97699999999999998},"last":0.55700000000000005},{"interface":"front","average":{"1min":0.748,"5min":0.748,"15min":0.748},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":1.099,"5min":1.099,"15min":1.099},"last":0.58599999999999997}]},{"osd":7,"last update":"Tue Nov 28 19:59:53 2023","interfaces":[{"interface":"back","average":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"min":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":1.236,"5min":1.236,"15min":1.236},"last":0.748},{"interface":"front","average":{"1min":0.80100000000000005,"5min":0.80100000000000005,"15min":0.80100000000000005},"min":{"1min":0.505,"5min":0.505,"15min":0.505},"max":{"1min":1.0760000000000001,"5min":1.0760000000000001,"15min":1.0760000000000001},"last":0.73199999999999998}]}]},{"osd":4,"up_from":13,"seq":55834574867,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27436,"kb_used_data":416,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344404,"statfs":{"total":96636764160,"available":96608669696,"internally_reserved":0,"allocated":425984,"data_stored":178472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 19:59:54 2023","interfaces":[{"interface":"back","average":{"1min":0.71099999999999997,"5min":0.71099999999999997,"15min":0.71099999999999997},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":1.0429999999999999,"5min":1.0429999999999999,"15min":1.0429999999999999},"last":0.71899999999999997},{"interface":"front","average":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":1.163,"5min":1.163,"15min":1.163},"last":0.59999999999999998}]},{"osd":1,"last update":"Tue Nov 28 19:59:54 2023","interfaces":[{"interface":"back","average":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"min":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":1.111,"5min":1.111,"15min":1.111},"last":0.74399999999999999},{"interface":"front","average":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"min":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":1.238,"5min":1.238,"15min":1.238},"last":0.79800000000000004}]},{"osd":2,"last update":"Tue Nov 28 19:59:54 2023","interfaces":[{"interface":"back","average":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":0.78300000000000003},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":1.0669999999999999,"5min":1.0669999999999999,"15min":1.0669999999999999},"last":0.66100000000000003},{"interface":"front","average":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":0.81699999999999995},"min":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":1.1180000000000001,"5min":1.1180000000000001,"15min":1.1180000000000001},"last":0.67600000000000005}]},{"osd":3,"last update":"Tue Nov 28 19:59:54 2023","interfaces":[{"interface":"back","average":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"min":{"1min":0.499,"5min":0.499,"15min":0.499},"max":{"1min":1.202,"5min":1.202,"15min":1.202},"last":0.64600000000000002},{"interface":"front","average":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"min":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":1.0589999999999999,"5min":1.0589999999999999,"15min":1.0589999999999999},"last":0.77900000000000003}]},{"osd":5,"last update":"Tue Nov 28 19:59:54 2023","interfaces":[{"interface":"back","average":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":0.95899999999999996,"5min":0.95899999999999996,"15min":0.95899999999999996},"last":0.623},{"interface":"front","average":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":1.034,"5min":1.034,"15min":1.034},"last":0.54400000000000004}]},{"osd":6,"last update":"Tue Nov 28 19:59:54 2023","interfaces":[{"interface":"back","average":{"1min":0.73499999999999999,"5min":0.73499999999999999,"15min":0.73499999999999999},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":1.0309999999999999,"5min":1.0309999999999999,"15min":1.0309999999999999},"last":0.57699999999999996},{"interface":"front","average":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":1.002,"5min":1.002,"15min":1.002},"last":0.76400000000000001}]},{"osd":7,"last update":"Tue Nov 28 19:59:54 2023","interfaces":[{"interface":"back","average":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"min":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":1.0620000000000001,"5min":1.0620000000000001,"15min":1.0620000000000001},"last":0.69399999999999995},{"interface":"front","average":{"1min":0.87,"5min":0.87,"15min":0.87},"min":{"1min":0.627,"5min":0.627,"15min":0.627},"max":{"1min":1.1459999999999999,"5min":1.1459999999999999,"15min":1.1459999999999999},"last":0.70399999999999996}]}]},{"osd":3,"up_from":13,"seq":55834574868,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27436,"kb_used_data":416,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344404,"statfs":{"total":96636764160,"available":96608669696,"internally_reserved":0,"allocated":425984,"data_stored":178472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 19:59:52 2023","interfaces":[{"interface":"back","average":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.70199999999999996},"last":0.45300000000000001},{"interface":"front","average":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"min":{"1min":0.312,"5min":0.312,"15min":0.312},"max":{"1min":0.82599999999999996,"5min":0.82599999999999996,"15min":0.82599999999999996},"last":0.32000000000000001}]},{"osd":1,"last update":"Tue Nov 28 19:59:52 2023","interfaces":[{"interface":"back","average":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.84399999999999997,"5min":0.84399999999999997,"15min":0.84399999999999997},"last":0.35899999999999999},{"interface":"front","average":{"1min":0.505,"5min":0.505,"15min":0.505},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.86099999999999999,"5min":0.86099999999999999,"15min":0.86099999999999999},"last":0.29199999999999998}]},{"osd":2,"last update":"Tue Nov 28 19:59:52 2023","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.85599999999999998,"5min":0.85599999999999998,"15min":0.85599999999999998},"last":0.46700000000000003},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.83699999999999997,"5min":0.83699999999999997,"15min":0.83699999999999997},"last":0.55900000000000005}]},{"osd":4,"last update":"Tue Nov 28 19:59:52 2023","interfaces":[{"interface":"back","average":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":1.206,"5min":1.206,"15min":1.206},"last":0.63500000000000001},{"interface":"front","average":{"1min":0.80300000000000005,"5min":0.80300000000000005,"15min":0.80300000000000005},"min":{"1min":0.503,"5min":0.503,"15min":0.503},"max":{"1min":1.222,"5min":1.222,"15min":1.222},"last":0.92700000000000005}]},{"osd":5,"last update":"Tue Nov 28 19:59:52 2023","interfaces":[{"interface":"back","average":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"min":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":1.151,"5min":1.151,"15min":1.151},"last":0.97499999999999998},{"interface":"front","average":{"1min":0.80300000000000005,"5min":0.80300000000000005,"15min":0.80300000000000005},"min":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":1.3100000000000001,"5min":1.3100000000000001,"15min":1.3100000000000001},"last":0.495}]},{"osd":6,"last update":"Tue Nov 28 19:59:52 2023","interfaces":[{"interface":"back","average":{"1min":0.84399999999999997,"5min":0.84399999999999997,"15min":0.84399999999999997},"min":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":1.361,"5min":1.361,"15min":1.361},"last":1.544},{"interface":"front","average":{"1min":0.749,"5min":0.749,"15min":0.749},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.125,"5min":1.125,"15min":1.125},"last":4.0679999999999996}]},{"osd":7,"last update":"Tue Nov 28 19:59:52 2023","interfaces":[{"interface":"back","average":{"1min":0.84999999999999998,"5min":0.84999999999999998,"15min":0.84999999999999998},"min":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"max":{"1min":1.2569999999999999,"5min":1.2569999999999999,"15min":1.2569999999999999},"last":4.0019999999999998},{"interface":"front","average":{"1min":0.89100000000000001,"5min":0.89100000000000001,"15min":0.89100000000000001},"min":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"max":{"1min":1.339,"5min":1.339,"15min":1.339},"last":1.1830000000000001}]}]},{"osd":2,"up_from":13,"seq":55834574866,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27436,"kb_used_data":416,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344404,"statfs":{"total":96636764160,"available":96608669696,"internally_reserved":0,"allocated":425984,"data_stored":178472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 19:59:54 2023","interfaces":[{"interface":"back","average":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"min":{"1min":0.26400000000000001,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"last":0.503},{"interface":"front","average":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.67700000000000005,"5min":0.67700000000000005,"15min":0.67700000000000005},"last":0.27900000000000003}]},{"osd":1,"last update":"Tue Nov 28 19:59:54 2023","interfaces":[{"interface":"back","average":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"min":{"1min":0.29899999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":1.0389999999999999,"5min":1.0389999999999999,"15min":1.0389999999999999},"last":0.38700000000000001},{"interface":"front","average":{"1min":0.505,"5min":0.505,"15min":0.505},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.70999999999999996,"5min":0.70999999999999996,"15min":0.70999999999999996},"last":0.32700000000000001}]},{"osd":3,"last update":"Tue Nov 28 19:59:54 2023","interfaces":[{"interface":"back","average":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"min":{"1min":0.28199999999999997,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.629,"5min":0.629,"15min":0.629},"last":0.36699999999999999},{"interface":"front","average":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.98499999999999999,"5min":0.98499999999999999,"15min":0.98499999999999999},"last":0.42799999999999999}]},{"osd":4,"last update":"Tue Nov 28 19:59:54 2023","interfaces":[{"interface":"back","average":{"1min":0.86199999999999999,"5min":0.86199999999999999,"15min":0.86199999999999999},"min":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"max":{"1min":1.139,"5min":1.139,"15min":1.139},"last":0.61099999999999999},{"interface":"front","average":{"1min":0.85299999999999998,"5min":0.85299999999999998,"15min":0.85299999999999998},"min":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":1.238,"5min":1.238,"15min":1.238},"last":0.629}]},{"osd":5,"last update":"Tue Nov 28 19:59:54 2023","interfaces":[{"interface":"back","average":{"1min":0.88500000000000001,"5min":0.88500000000000001,"15min":0.88500000000000001},"min":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":1.6180000000000001,"5min":1.6180000000000001,"15min":1.6180000000000001},"last":0.55100000000000005},{"interface":"front","average":{"1min":0.83499999999999996,"5min":0.83499999999999996,"15min":0.83499999999999996},"min":{"1min":0.496,"5min":0.496,"15min":0.496},"max":{"1min":1.339,"5min":1.339,"15min":1.339},"last":0.52200000000000002}]},{"osd":6,"last update":"Tue Nov 28 19:59:54 2023","interfaces":[{"interface":"back","average":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":0.80600000000000005},"min":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1.1839999999999999,"5min":1.1839999999999999,"15min":1.1839999999999999},"last":0.59699999999999998},{"interface":"front","average":{"1min":0.86199999999999999,"5min":0.86199999999999999,"15min":0.86199999999999999},"min":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":1.099,"5min":1.099,"15min":1.099},"last":0.56699999999999995}]},{"osd":7,"last update":"Tue Nov 28 19:59:54 2023","interfaces":[{"interface":"back","average":{"1min":0.89000000000000001,"5min":0.89000000000000001,"15min":0.89000000000000001},"min":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":1.4590000000000001,"5min":1.4590000000000001,"15min":1.4590000000000001},"last":0.58299999999999996},{"interface":"front","average":{"1min":0.86699999999999999,"5min":0.86699999999999999,"15min":0.86699999999999999},"min":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":1.387,"5min":1.387,"15min":1.387},"last":0.48799999999999999}]}]},{"osd":1,"up_from":13,"seq":55834574868,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27436,"kb_used_data":416,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344404,"statfs":{"total":96636764160,"available":96608669696,"internally_reserved":0,"allocated":425984,"data_stored":178472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 19:59:53 2023","interfaces":[{"interface":"back","average":{"1min":0.65800000000000003,"5min":0.65800000000000003,"15min":0.65800000000000003},"min":{"1min":0.31,"5min":0.31,"15min":0.31},"max":{"1min":3.8740000000000001,"5min":3.8740000000000001,"15min":3.8740000000000001},"last":0.28799999999999998},{"interface":"front","average":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"min":{"1min":0.25,"5min":0.25,"15min":0.25},"max":{"1min":2.0760000000000001,"5min":2.0760000000000001,"15min":2.0760000000000001},"last":0.38300000000000001}]},{"osd":2,"last update":"Tue Nov 28 19:59:53 2023","interfaces":[{"interface":"back","average":{"1min":0.65900000000000003,"5min":0.65900000000000003,"15min":0.65900000000000003},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":3.7320000000000002,"5min":3.7320000000000002,"15min":3.7320000000000002},"last":0.41999999999999998},{"interface":"front","average":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":3.9089999999999998,"5min":3.9089999999999998,"15min":3.9089999999999998},"last":0.35499999999999998}]},{"osd":3,"last update":"Tue Nov 28 19:59:53 2023","interfaces":[{"interface":"back","average":{"1min":0.68100000000000005,"5min":0.68100000000000005,"15min":0.68100000000000005},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":1.6399999999999999,"5min":1.6399999999999999,"15min":1.6399999999999999},"last":0.48899999999999999},{"interface":"front","average":{"1min":0.70299999999999996,"5min":0.70299999999999996,"15min":0.70299999999999996},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":2.5270000000000001,"5min":2.5270000000000001,"15min":2.5270000000000001},"last":0.443}]},{"osd":4,"last update":"Tue Nov 28 19:59:53 2023","interfaces":[{"interface":"back","average":{"1min":0.89500000000000002,"5min":0.89500000000000002,"15min":0.89500000000000002},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":3.1659999999999999,"5min":3.1659999999999999,"15min":3.1659999999999999},"last":0.64100000000000001},{"interface":"front","average":{"1min":0.94599999999999995,"5min":0.94599999999999995,"15min":0.94599999999999995},"min":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":3.7959999999999998,"5min":3.7959999999999998,"15min":3.7959999999999998},"last":0.54100000000000004}]},{"osd":5,"last update":"Tue Nov 28 19:59:53 2023","interfaces":[{"interface":"back","average":{"1min":0.98899999999999999,"5min":0.98899999999999999,"15min":0.98899999999999999},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":4.1479999999999997,"5min":4.1479999999999997,"15min":4.1479999999999997},"last":0.65700000000000003},{"interface":"front","average":{"1min":0.91000000000000003,"5min":0.91000000000000003,"15min":0.91000000000000003},"min":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":3.5569999999999999,"5min":3.5569999999999999,"15min":3.5569999999999999},"last":0.5}]},{"osd":6,"last update":"Tue Nov 28 19:59:53 2023","interfaces":[{"interface":"back","average":{"1min":0.99199999999999999,"5min":0.99199999999999999,"15min":0.99199999999999999},"min":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":2.863,"5min":2.863,"15min":2.863},"last":0.68500000000000005},{"interface":"front","average":{"1min":0.98299999999999998,"5min":0.98299999999999998,"15min":0.98299999999999998},"min":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"max":{"1min":3.371,"5min":3.371,"15min":3.371},"last":0.60099999999999998}]},{"osd":7,"last update":"Tue Nov 28 19:59:53 2023","interfaces":[{"interface":"back","average":{"1min":1.0129999999999999,"5min":1.0129999999999999,"15min":1.0129999999999999},"min":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"max":{"1min":3.8439999999999999,"5min":3.8439999999999999,"15min":3.8439999999999999},"last":0.624},{"interface":"front","average":{"1min":1.038,"5min":1.038,"15min":1.038},"min":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"max":{"1min":3.9689999999999999,"5min":3.9689999999999999,"15min":3.9689999999999999},"last":0.53000000000000003}]}]},{"osd":0,"up_from":13,"seq":55834574867,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27500,"kb_used_data":480,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344340,"statfs":{"total":96636764160,"available":96608604160,"internally_reserved":0,"allocated":491520,"data_stored":768840,"data_compressed":33374,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Nov 28 19:59:56 2023","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.68999999999999995,"15min":0.68999999999999995},"min":{"1min":0.29899999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":4.883,"5min":4.883,"15min":4.883},"last":0.27400000000000002},{"interface":"front","average":{"1min":0.878,"5min":0.878,"15min":0.878},"min":{"1min":0.29399999999999998,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":8.0800000000000001,"5min":8.0800000000000001,"15min":8.0800000000000001},"last":0.41699999999999998}]},{"osd":2,"last update":"Tue Nov 28 19:59:56 2023","interfaces":[{"interface":"back","average":{"1min":0.97399999999999998,"5min":0.97399999999999998,"15min":0.97399999999999998},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":8.1029999999999998,"5min":8.1029999999999998,"15min":8.1029999999999998},"last":0.46000000000000002},{"interface":"front","average":{"1min":0.98699999999999999,"5min":0.98699999999999999,"15min":0.98699999999999999},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":8.1310000000000002,"5min":8.1310000000000002,"15min":8.1310000000000002},"last":0.5}]},{"osd":3,"last update":"Tue Nov 28 19:59:56 2023","interfaces":[{"interface":"back","average":{"1min":0.747,"5min":0.747,"15min":0.747},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":4.3949999999999996,"5min":4.3949999999999996,"15min":4.3949999999999996},"last":0.441},{"interface":"front","average":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":4.3470000000000004,"5min":4.3470000000000004,"15min":4.3470000000000004},"last":0.51900000000000002}]},{"osd":4,"last update":"Tue Nov 28 19:59:56 2023","interfaces":[{"interface":"back","average":{"1min":1.0509999999999999,"5min":1.0509999999999999,"15min":1.0509999999999999},"min":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"max":{"1min":4.6360000000000001,"5min":4.6360000000000001,"15min":4.6360000000000001},"last":0.54100000000000004},{"interface":"front","average":{"1min":1.0529999999999999,"5min":1.0529999999999999,"15min":1.0529999999999999},"min":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":4.4710000000000001,"5min":4.4710000000000001,"15min":4.4710000000000001},"last":0.59899999999999998}]},{"osd":5,"last update":"Tue Nov 28 19:59:56 2023","interfaces":[{"interface":"back","average":{"1min":1.0649999999999999,"5min":1.0649999999999999,"15min":1.0649999999999999},"min":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":4.6120000000000001,"5min":4.6120000000000001,"15min":4.6120000000000001},"last":0.65400000000000003},{"interface":"front","average":{"1min":1.052,"5min":1.052,"15min":1.052},"min":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"max":{"1min":4.5449999999999999,"5min":4.5449999999999999,"15min":4.5449999999999999},"last":0.58999999999999997}]},{"osd":6,"last update":"Tue Nov 28 19:59:56 2023","interfaces":[{"interface":"back","average":{"1min":1.079,"5min":1.079,"15min":1.079},"min":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":4.657,"5min":4.657,"15min":4.657},"last":0.64500000000000002},{"interface":"front","average":{"1min":1.097,"5min":1.097,"15min":1.097},"min":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"max":{"1min":4.5259999999999998,"5min":4.5259999999999998,"15min":4.5259999999999998},"last":0.61599999999999999}]},{"osd":7,"last update":"Tue Nov 28 19:59:56 2023","interfaces":[{"interface":"back","average":{"1min":1.101,"5min":1.101,"15min":1.101},"min":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.60099999999999998},"max":{"1min":4.7320000000000002,"5min":4.7320000000000002,"15min":4.7320000000000002},"last":0.57199999999999995},{"interface":"front","average":{"1min":1.046,"5min":1.046,"15min":1.046},"min":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":4.4939999999999998,"5min":4.4939999999999998,"15min":4.4939999999999998},"last":0.67000000000000004}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33374,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33374,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-28T20:00:18.610 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.3f is not active+clean 2023-11-28T20:00:18.610 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.3f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 38, 'state': 'creating+peering', 'last_fresh': '2023-11-28T20:00:12.786561+0000', 'last_change': '2023-11-28T20:00:12.786561+0000', 'last_active': '2023-11-28T20:00:12.764355+0000', 'last_peered': '2023-11-28T20:00:12.764355+0000', 'last_clean': '2023-11-28T20:00:12.764355+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T20:00:12.786561+0000', 'last_undegraded': '2023-11-28T20:00:12.786561+0000', 'last_fullsized': '2023-11-28T20:00:12.786561+0000', 'mapping_epoch': 38, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 38, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T20:00:12.764355+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T20:00:12.764355+0000', 'last_clean_scrub_stamp': '2023-11-28T20:00:12.764355+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 0], 'acting': [3, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-11-28T20:00:18.610 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.3e is not active+clean 2023-11-28T20:00:18.610 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.3e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 38, 'state': 'creating+peering', 'last_fresh': '2023-11-28T20:00:12.785251+0000', 'last_change': '2023-11-28T20:00:12.785251+0000', 'last_active': '2023-11-28T20:00:12.764355+0000', 'last_peered': '2023-11-28T20:00:12.764355+0000', 'last_clean': '2023-11-28T20:00:12.764355+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T20:00:12.785251+0000', 'last_undegraded': '2023-11-28T20:00:12.785251+0000', 'last_fullsized': '2023-11-28T20:00:12.785251+0000', 'mapping_epoch': 38, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 38, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T20:00:12.764355+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T20:00:12.764355+0000', 'last_clean_scrub_stamp': '2023-11-28T20:00:12.764355+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 2], 'acting': [3, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-11-28T20:00:18.610 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.3d is not active+clean 2023-11-28T20:00:18.610 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.3d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 38, 'state': 'creating+peering', 'last_fresh': '2023-11-28T20:00:12.784934+0000', 'last_change': '2023-11-28T20:00:12.784934+0000', 'last_active': '2023-11-28T20:00:12.764355+0000', 'last_peered': '2023-11-28T20:00:12.764355+0000', 'last_clean': '2023-11-28T20:00:12.764355+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T20:00:12.784934+0000', 'last_undegraded': '2023-11-28T20:00:12.784934+0000', 'last_fullsized': '2023-11-28T20:00:12.784934+0000', 'mapping_epoch': 38, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 38, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T20:00:12.764355+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T20:00:12.764355+0000', 'last_clean_scrub_stamp': '2023-11-28T20:00:12.764355+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 5], 'acting': [0, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-11-28T20:00:18.610 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.3c is not active+clean 2023-11-28T20:00:18.610 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.3c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 38, 'state': 'creating+peering', 'last_fresh': '2023-11-28T20:00:12.786036+0000', 'last_change': '2023-11-28T20:00:12.786036+0000', 'last_active': '2023-11-28T20:00:12.764355+0000', 'last_peered': '2023-11-28T20:00:12.764355+0000', 'last_clean': '2023-11-28T20:00:12.764355+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T20:00:12.786036+0000', 'last_undegraded': '2023-11-28T20:00:12.786036+0000', 'last_fullsized': '2023-11-28T20:00:12.786036+0000', 'mapping_epoch': 38, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 38, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T20:00:12.764355+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T20:00:12.764355+0000', 'last_clean_scrub_stamp': '2023-11-28T20:00:12.764355+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 4], 'acting': [2, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-11-28T20:00:18.611 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.3b is not active+clean 2023-11-28T20:00:18.611 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.3b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 38, 'state': 'creating+peering', 'last_fresh': '2023-11-28T20:00:12.786007+0000', 'last_change': '2023-11-28T20:00:12.786007+0000', 'last_active': '2023-11-28T20:00:12.764355+0000', 'last_peered': '2023-11-28T20:00:12.764355+0000', 'last_clean': '2023-11-28T20:00:12.764355+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T20:00:12.786007+0000', 'last_undegraded': '2023-11-28T20:00:12.786007+0000', 'last_fullsized': '2023-11-28T20:00:12.786007+0000', 'mapping_epoch': 38, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 38, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T20:00:12.764355+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T20:00:12.764355+0000', 'last_clean_scrub_stamp': '2023-11-28T20:00:12.764355+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 4], 'acting': [2, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-11-28T20:00:18.611 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.3a is not active+clean 2023-11-28T20:00:18.611 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.3a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 38, 'state': 'creating+peering', 'last_fresh': '2023-11-28T20:00:12.784599+0000', 'last_change': '2023-11-28T20:00:12.784599+0000', 'last_active': '2023-11-28T20:00:12.764355+0000', 'last_peered': '2023-11-28T20:00:12.764355+0000', 'last_clean': '2023-11-28T20:00:12.764355+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T20:00:12.784599+0000', 'last_undegraded': '2023-11-28T20:00:12.784599+0000', 'last_fullsized': '2023-11-28T20:00:12.784599+0000', 'mapping_epoch': 38, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 38, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T20:00:12.764355+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T20:00:12.764355+0000', 'last_clean_scrub_stamp': '2023-11-28T20:00:12.764355+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 3], 'acting': [1, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-11-28T20:00:18.612 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.39 is not active+clean 2023-11-28T20:00:18.612 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.39', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 38, 'state': 'creating+peering', 'last_fresh': '2023-11-28T20:00:12.788606+0000', 'last_change': '2023-11-28T20:00:12.788606+0000', 'last_active': '2023-11-28T20:00:12.764355+0000', 'last_peered': '2023-11-28T20:00:12.764355+0000', 'last_clean': '2023-11-28T20:00:12.764355+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T20:00:12.788606+0000', 'last_undegraded': '2023-11-28T20:00:12.788606+0000', 'last_fullsized': '2023-11-28T20:00:12.788606+0000', 'mapping_epoch': 38, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 38, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T20:00:12.764355+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T20:00:12.764355+0000', 'last_clean_scrub_stamp': '2023-11-28T20:00:12.764355+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 3], 'acting': [5, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-11-28T20:00:18.612 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.38 is not active+clean 2023-11-28T20:00:18.613 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.38', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 38, 'state': 'creating+peering', 'last_fresh': '2023-11-28T20:00:12.782185+0000', 'last_change': '2023-11-28T20:00:12.782185+0000', 'last_active': '2023-11-28T20:00:12.764355+0000', 'last_peered': '2023-11-28T20:00:12.764355+0000', 'last_clean': '2023-11-28T20:00:12.764355+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T20:00:12.782185+0000', 'last_undegraded': '2023-11-28T20:00:12.782185+0000', 'last_fullsized': '2023-11-28T20:00:12.782185+0000', 'mapping_epoch': 38, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 38, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T20:00:12.764355+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T20:00:12.764355+0000', 'last_clean_scrub_stamp': '2023-11-28T20:00:12.764355+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 5], 'acting': [3, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-11-28T20:00:18.613 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.37 is not active+clean 2023-11-28T20:00:18.613 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.37', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 38, 'state': 'creating+peering', 'last_fresh': '2023-11-28T20:00:12.784258+0000', 'last_change': '2023-11-28T20:00:12.784258+0000', 'last_active': '2023-11-28T20:00:12.764355+0000', 'last_peered': '2023-11-28T20:00:12.764355+0000', 'last_clean': '2023-11-28T20:00:12.764355+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T20:00:12.784258+0000', 'last_undegraded': '2023-11-28T20:00:12.784258+0000', 'last_fullsized': '2023-11-28T20:00:12.784258+0000', 'mapping_epoch': 38, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 38, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T20:00:12.764355+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T20:00:12.764355+0000', 'last_clean_scrub_stamp': '2023-11-28T20:00:12.764355+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 5], 'acting': [0, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-11-28T20:00:18.613 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.36 is not active+clean 2023-11-28T20:00:18.614 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.36', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 38, 'state': 'creating+peering', 'last_fresh': '2023-11-28T20:00:12.796410+0000', 'last_change': '2023-11-28T20:00:12.796410+0000', 'last_active': '2023-11-28T20:00:12.764355+0000', 'last_peered': '2023-11-28T20:00:12.764355+0000', 'last_clean': '2023-11-28T20:00:12.764355+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T20:00:12.796410+0000', 'last_undegraded': '2023-11-28T20:00:12.796410+0000', 'last_fullsized': '2023-11-28T20:00:12.796410+0000', 'mapping_epoch': 38, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 38, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T20:00:12.764355+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T20:00:12.764355+0000', 'last_clean_scrub_stamp': '2023-11-28T20:00:12.764355+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 7], 'acting': [5, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-11-28T20:00:18.614 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.35 is not active+clean 2023-11-28T20:00:18.614 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.35', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 38, 'state': 'creating+peering', 'last_fresh': '2023-11-28T20:00:12.795967+0000', 'last_change': '2023-11-28T20:00:12.795967+0000', 'last_active': '2023-11-28T20:00:12.764355+0000', 'last_peered': '2023-11-28T20:00:12.764355+0000', 'last_clean': '2023-11-28T20:00:12.764355+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T20:00:12.795967+0000', 'last_undegraded': '2023-11-28T20:00:12.795967+0000', 'last_fullsized': '2023-11-28T20:00:12.795967+0000', 'mapping_epoch': 38, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 38, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T20:00:12.764355+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T20:00:12.764355+0000', 'last_clean_scrub_stamp': '2023-11-28T20:00:12.764355+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 4], 'acting': [5, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-11-28T20:00:18.614 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.34 is not active+clean 2023-11-28T20:00:18.615 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.34', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 38, 'state': 'creating+peering', 'last_fresh': '2023-11-28T20:00:12.784227+0000', 'last_change': '2023-11-28T20:00:12.784227+0000', 'last_active': '2023-11-28T20:00:12.764355+0000', 'last_peered': '2023-11-28T20:00:12.764355+0000', 'last_clean': '2023-11-28T20:00:12.764355+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T20:00:12.784227+0000', 'last_undegraded': '2023-11-28T20:00:12.784227+0000', 'last_fullsized': '2023-11-28T20:00:12.784227+0000', 'mapping_epoch': 38, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 38, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T20:00:12.764355+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T20:00:12.764355+0000', 'last_clean_scrub_stamp': '2023-11-28T20:00:12.764355+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-11-28T20:00:18.615 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.33 is not active+clean 2023-11-28T20:00:18.615 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.33', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 38, 'state': 'creating+peering', 'last_fresh': '2023-11-28T20:00:12.789120+0000', 'last_change': '2023-11-28T20:00:12.789120+0000', 'last_active': '2023-11-28T20:00:12.764355+0000', 'last_peered': '2023-11-28T20:00:12.764355+0000', 'last_clean': '2023-11-28T20:00:12.764355+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T20:00:12.789120+0000', 'last_undegraded': '2023-11-28T20:00:12.789120+0000', 'last_fullsized': '2023-11-28T20:00:12.789120+0000', 'mapping_epoch': 38, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 38, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T20:00:12.764355+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T20:00:12.764355+0000', 'last_clean_scrub_stamp': '2023-11-28T20:00:12.764355+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 7], 'acting': [5, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-11-28T20:00:18.615 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.32 is not active+clean 2023-11-28T20:00:18.616 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.32', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 38, 'state': 'creating+peering', 'last_fresh': '2023-11-28T20:00:12.783757+0000', 'last_change': '2023-11-28T20:00:12.783757+0000', 'last_active': '2023-11-28T20:00:12.764355+0000', 'last_peered': '2023-11-28T20:00:12.764355+0000', 'last_clean': '2023-11-28T20:00:12.764355+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T20:00:12.783757+0000', 'last_undegraded': '2023-11-28T20:00:12.783757+0000', 'last_fullsized': '2023-11-28T20:00:12.783757+0000', 'mapping_epoch': 38, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 38, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T20:00:12.764355+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T20:00:12.764355+0000', 'last_clean_scrub_stamp': '2023-11-28T20:00:12.764355+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 6], 'acting': [4, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-11-28T20:00:18.616 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.31 is not active+clean 2023-11-28T20:00:18.616 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.31', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 38, 'state': 'creating+peering', 'last_fresh': '2023-11-28T20:00:12.788137+0000', 'last_change': '2023-11-28T20:00:12.788137+0000', 'last_active': '2023-11-28T20:00:12.764355+0000', 'last_peered': '2023-11-28T20:00:12.764355+0000', 'last_clean': '2023-11-28T20:00:12.764355+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T20:00:12.788137+0000', 'last_undegraded': '2023-11-28T20:00:12.788137+0000', 'last_fullsized': '2023-11-28T20:00:12.788137+0000', 'mapping_epoch': 38, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 38, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T20:00:12.764355+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T20:00:12.764355+0000', 'last_clean_scrub_stamp': '2023-11-28T20:00:12.764355+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 2], 'acting': [5, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-11-28T20:00:18.616 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.30 is not active+clean 2023-11-28T20:00:18.617 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.30', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 38, 'state': 'creating+peering', 'last_fresh': '2023-11-28T20:00:12.786772+0000', 'last_change': '2023-11-28T20:00:12.786772+0000', 'last_active': '2023-11-28T20:00:12.764355+0000', 'last_peered': '2023-11-28T20:00:12.764355+0000', 'last_clean': '2023-11-28T20:00:12.764355+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T20:00:12.786772+0000', 'last_undegraded': '2023-11-28T20:00:12.786772+0000', 'last_fullsized': '2023-11-28T20:00:12.786772+0000', 'mapping_epoch': 38, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 38, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T20:00:12.764355+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T20:00:12.764355+0000', 'last_clean_scrub_stamp': '2023-11-28T20:00:12.764355+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 5], 'acting': [7, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-11-28T20:00:18.617 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.2f is not active+clean 2023-11-28T20:00:18.617 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.2f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 38, 'state': 'creating+peering', 'last_fresh': '2023-11-28T20:00:12.785537+0000', 'last_change': '2023-11-28T20:00:12.785537+0000', 'last_active': '2023-11-28T20:00:12.764355+0000', 'last_peered': '2023-11-28T20:00:12.764355+0000', 'last_clean': '2023-11-28T20:00:12.764355+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T20:00:12.785537+0000', 'last_undegraded': '2023-11-28T20:00:12.785537+0000', 'last_fullsized': '2023-11-28T20:00:12.785537+0000', 'mapping_epoch': 38, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 38, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T20:00:12.764355+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T20:00:12.764355+0000', 'last_clean_scrub_stamp': '2023-11-28T20:00:12.764355+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 5], 'acting': [7, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-11-28T20:00:18.617 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.2e is not active+clean 2023-11-28T20:00:18.617 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.2e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 38, 'state': 'creating+peering', 'last_fresh': '2023-11-28T20:00:12.778466+0000', 'last_change': '2023-11-28T20:00:12.778466+0000', 'last_active': '2023-11-28T20:00:12.764355+0000', 'last_peered': '2023-11-28T20:00:12.764355+0000', 'last_clean': '2023-11-28T20:00:12.764355+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T20:00:12.778466+0000', 'last_undegraded': '2023-11-28T20:00:12.778466+0000', 'last_fullsized': '2023-11-28T20:00:12.778466+0000', 'mapping_epoch': 38, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 38, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T20:00:12.764355+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T20:00:12.764355+0000', 'last_clean_scrub_stamp': '2023-11-28T20:00:12.764355+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 4], 'acting': [6, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-11-28T20:00:18.618 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.2d is not active+clean 2023-11-28T20:00:18.618 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.2d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 38, 'state': 'creating+peering', 'last_fresh': '2023-11-28T20:00:12.785360+0000', 'last_change': '2023-11-28T20:00:12.785360+0000', 'last_active': '2023-11-28T20:00:12.764355+0000', 'last_peered': '2023-11-28T20:00:12.764355+0000', 'last_clean': '2023-11-28T20:00:12.764355+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T20:00:12.785360+0000', 'last_undegraded': '2023-11-28T20:00:12.785360+0000', 'last_fullsized': '2023-11-28T20:00:12.785360+0000', 'mapping_epoch': 38, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 38, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T20:00:12.764355+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T20:00:12.764355+0000', 'last_clean_scrub_stamp': '2023-11-28T20:00:12.764355+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 1], 'acting': [2, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-11-28T20:00:18.618 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.2c is not active+clean 2023-11-28T20:00:18.618 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.2c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 38, 'state': 'creating+peering', 'last_fresh': '2023-11-28T20:00:12.779039+0000', 'last_change': '2023-11-28T20:00:12.779039+0000', 'last_active': '2023-11-28T20:00:12.764355+0000', 'last_peered': '2023-11-28T20:00:12.764355+0000', 'last_clean': '2023-11-28T20:00:12.764355+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T20:00:12.779039+0000', 'last_undegraded': '2023-11-28T20:00:12.779039+0000', 'last_fullsized': '2023-11-28T20:00:12.779039+0000', 'mapping_epoch': 38, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 38, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T20:00:12.764355+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T20:00:12.764355+0000', 'last_clean_scrub_stamp': '2023-11-28T20:00:12.764355+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 4], 'acting': [6, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-11-28T20:00:18.619 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.2b is not active+clean 2023-11-28T20:00:18.619 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.2b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 38, 'state': 'creating+peering', 'last_fresh': '2023-11-28T20:00:12.786544+0000', 'last_change': '2023-11-28T20:00:12.786544+0000', 'last_active': '2023-11-28T20:00:12.764355+0000', 'last_peered': '2023-11-28T20:00:12.764355+0000', 'last_clean': '2023-11-28T20:00:12.764355+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T20:00:12.786544+0000', 'last_undegraded': '2023-11-28T20:00:12.786544+0000', 'last_fullsized': '2023-11-28T20:00:12.786544+0000', 'mapping_epoch': 38, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 38, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T20:00:12.764355+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T20:00:12.764355+0000', 'last_clean_scrub_stamp': '2023-11-28T20:00:12.764355+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 1], 'acting': [5, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-11-28T20:00:18.619 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.2a is not active+clean 2023-11-28T20:00:18.619 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.2a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 38, 'state': 'creating+peering', 'last_fresh': '2023-11-28T20:00:12.782742+0000', 'last_change': '2023-11-28T20:00:12.782742+0000', 'last_active': '2023-11-28T20:00:12.764355+0000', 'last_peered': '2023-11-28T20:00:12.764355+0000', 'last_clean': '2023-11-28T20:00:12.764355+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T20:00:12.782742+0000', 'last_undegraded': '2023-11-28T20:00:12.782742+0000', 'last_fullsized': '2023-11-28T20:00:12.782742+0000', 'mapping_epoch': 38, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 38, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T20:00:12.764355+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T20:00:12.764355+0000', 'last_clean_scrub_stamp': '2023-11-28T20:00:12.764355+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 2], 'acting': [4, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-11-28T20:00:18.620 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.29 is not active+clean 2023-11-28T20:00:18.620 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.29', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 38, 'state': 'creating+peering', 'last_fresh': '2023-11-28T20:00:12.786852+0000', 'last_change': '2023-11-28T20:00:12.786852+0000', 'last_active': '2023-11-28T20:00:12.764355+0000', 'last_peered': '2023-11-28T20:00:12.764355+0000', 'last_clean': '2023-11-28T20:00:12.764355+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T20:00:12.786852+0000', 'last_undegraded': '2023-11-28T20:00:12.786852+0000', 'last_fullsized': '2023-11-28T20:00:12.786852+0000', 'mapping_epoch': 38, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 38, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T20:00:12.764355+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T20:00:12.764355+0000', 'last_clean_scrub_stamp': '2023-11-28T20:00:12.764355+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 2], 'acting': [7, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-11-28T20:00:18.620 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.28 is not active+clean 2023-11-28T20:00:18.620 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.28', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 38, 'state': 'creating+peering', 'last_fresh': '2023-11-28T20:00:12.778685+0000', 'last_change': '2023-11-28T20:00:12.778685+0000', 'last_active': '2023-11-28T20:00:12.764355+0000', 'last_peered': '2023-11-28T20:00:12.764355+0000', 'last_clean': '2023-11-28T20:00:12.764355+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T20:00:12.778685+0000', 'last_undegraded': '2023-11-28T20:00:12.778685+0000', 'last_fullsized': '2023-11-28T20:00:12.778685+0000', 'mapping_epoch': 38, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 38, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T20:00:12.764355+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T20:00:12.764355+0000', 'last_clean_scrub_stamp': '2023-11-28T20:00:12.764355+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 7], 'acting': [2, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-11-28T20:00:18.621 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.27 is not active+clean 2023-11-28T20:00:18.622 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.27', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 38, 'state': 'creating+peering', 'last_fresh': '2023-11-28T20:00:12.778411+0000', 'last_change': '2023-11-28T20:00:12.778411+0000', 'last_active': '2023-11-28T20:00:12.764355+0000', 'last_peered': '2023-11-28T20:00:12.764355+0000', 'last_clean': '2023-11-28T20:00:12.764355+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T20:00:12.778411+0000', 'last_undegraded': '2023-11-28T20:00:12.778411+0000', 'last_fullsized': '2023-11-28T20:00:12.778411+0000', 'mapping_epoch': 38, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 38, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T20:00:12.764355+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T20:00:12.764355+0000', 'last_clean_scrub_stamp': '2023-11-28T20:00:12.764355+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 0], 'acting': [6, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-11-28T20:00:18.622 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.26 is not active+clean 2023-11-28T20:00:18.622 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.26', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 38, 'state': 'creating+peering', 'last_fresh': '2023-11-28T20:00:12.784938+0000', 'last_change': '2023-11-28T20:00:12.784938+0000', 'last_active': '2023-11-28T20:00:12.764355+0000', 'last_peered': '2023-11-28T20:00:12.764355+0000', 'last_clean': '2023-11-28T20:00:12.764355+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T20:00:12.784938+0000', 'last_undegraded': '2023-11-28T20:00:12.784938+0000', 'last_fullsized': '2023-11-28T20:00:12.784938+0000', 'mapping_epoch': 38, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 38, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T20:00:12.764355+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T20:00:12.764355+0000', 'last_clean_scrub_stamp': '2023-11-28T20:00:12.764355+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 5], 'acting': [1, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-11-28T20:00:18.622 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.25 is not active+clean 2023-11-28T20:00:18.622 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.25', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 38, 'state': 'creating+peering', 'last_fresh': '2023-11-28T20:00:12.777818+0000', 'last_change': '2023-11-28T20:00:12.777818+0000', 'last_active': '2023-11-28T20:00:12.764355+0000', 'last_peered': '2023-11-28T20:00:12.764355+0000', 'last_clean': '2023-11-28T20:00:12.764355+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T20:00:12.777818+0000', 'last_undegraded': '2023-11-28T20:00:12.777818+0000', 'last_fullsized': '2023-11-28T20:00:12.777818+0000', 'mapping_epoch': 38, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 38, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T20:00:12.764355+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T20:00:12.764355+0000', 'last_clean_scrub_stamp': '2023-11-28T20:00:12.764355+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 2], 'acting': [6, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-11-28T20:00:18.622 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.24 is not active+clean 2023-11-28T20:00:18.622 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.24', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 38, 'state': 'creating+peering', 'last_fresh': '2023-11-28T20:00:12.787079+0000', 'last_change': '2023-11-28T20:00:12.787079+0000', 'last_active': '2023-11-28T20:00:12.764355+0000', 'last_peered': '2023-11-28T20:00:12.764355+0000', 'last_clean': '2023-11-28T20:00:12.764355+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T20:00:12.787079+0000', 'last_undegraded': '2023-11-28T20:00:12.787079+0000', 'last_fullsized': '2023-11-28T20:00:12.787079+0000', 'mapping_epoch': 38, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 38, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T20:00:12.764355+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T20:00:12.764355+0000', 'last_clean_scrub_stamp': '2023-11-28T20:00:12.764355+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 3], 'acting': [5, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-11-28T20:00:18.622 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.23 is not active+clean 2023-11-28T20:00:18.622 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.23', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 38, 'state': 'creating+peering', 'last_fresh': '2023-11-28T20:00:12.779329+0000', 'last_change': '2023-11-28T20:00:12.779329+0000', 'last_active': '2023-11-28T20:00:12.764355+0000', 'last_peered': '2023-11-28T20:00:12.764355+0000', 'last_clean': '2023-11-28T20:00:12.764355+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T20:00:12.779329+0000', 'last_undegraded': '2023-11-28T20:00:12.779329+0000', 'last_fullsized': '2023-11-28T20:00:12.779329+0000', 'mapping_epoch': 38, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 38, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T20:00:12.764355+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T20:00:12.764355+0000', 'last_clean_scrub_stamp': '2023-11-28T20:00:12.764355+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 1], 'acting': [6, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-11-28T20:00:18.623 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.22 is not active+clean 2023-11-28T20:00:18.623 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.22', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 38, 'state': 'creating+peering', 'last_fresh': '2023-11-28T20:00:12.778067+0000', 'last_change': '2023-11-28T20:00:12.778067+0000', 'last_active': '2023-11-28T20:00:12.764355+0000', 'last_peered': '2023-11-28T20:00:12.764355+0000', 'last_clean': '2023-11-28T20:00:12.764355+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T20:00:12.778067+0000', 'last_undegraded': '2023-11-28T20:00:12.778067+0000', 'last_fullsized': '2023-11-28T20:00:12.778067+0000', 'mapping_epoch': 38, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 38, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T20:00:12.764355+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T20:00:12.764355+0000', 'last_clean_scrub_stamp': '2023-11-28T20:00:12.764355+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 3], 'acting': [6, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-11-28T20:00:18.623 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.21 is not active+clean 2023-11-28T20:00:18.623 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.21', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 38, 'state': 'creating+peering', 'last_fresh': '2023-11-28T20:00:12.785172+0000', 'last_change': '2023-11-28T20:00:12.785172+0000', 'last_active': '2023-11-28T20:00:12.764355+0000', 'last_peered': '2023-11-28T20:00:12.764355+0000', 'last_clean': '2023-11-28T20:00:12.764355+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T20:00:12.785172+0000', 'last_undegraded': '2023-11-28T20:00:12.785172+0000', 'last_fullsized': '2023-11-28T20:00:12.785172+0000', 'mapping_epoch': 38, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 38, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T20:00:12.764355+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T20:00:12.764355+0000', 'last_clean_scrub_stamp': '2023-11-28T20:00:12.764355+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 2], 'acting': [7, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-11-28T20:00:18.623 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.20 is not active+clean 2023-11-28T20:00:18.623 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.20', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 38, 'state': 'creating+peering', 'last_fresh': '2023-11-28T20:00:12.783287+0000', 'last_change': '2023-11-28T20:00:12.783287+0000', 'last_active': '2023-11-28T20:00:12.764355+0000', 'last_peered': '2023-11-28T20:00:12.764355+0000', 'last_clean': '2023-11-28T20:00:12.764355+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T20:00:12.783287+0000', 'last_undegraded': '2023-11-28T20:00:12.783287+0000', 'last_fullsized': '2023-11-28T20:00:12.783287+0000', 'mapping_epoch': 38, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 38, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T20:00:12.764355+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T20:00:12.764355+0000', 'last_clean_scrub_stamp': '2023-11-28T20:00:12.764355+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 2], 'acting': [1, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-11-28T20:00:18.623 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.1c is not active+clean 2023-11-28T20:00:18.623 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.1c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 38, 'state': 'creating+peering', 'last_fresh': '2023-11-28T20:00:12.784405+0000', 'last_change': '2023-11-28T20:00:12.784405+0000', 'last_active': '2023-11-28T20:00:12.764355+0000', 'last_peered': '2023-11-28T20:00:12.764355+0000', 'last_clean': '2023-11-28T20:00:12.764355+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T20:00:12.784405+0000', 'last_undegraded': '2023-11-28T20:00:12.784405+0000', 'last_fullsized': '2023-11-28T20:00:12.784405+0000', 'mapping_epoch': 38, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 38, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T20:00:12.764355+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T20:00:12.764355+0000', 'last_clean_scrub_stamp': '2023-11-28T20:00:12.764355+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 5], 'acting': [7, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-11-28T20:00:18.623 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.1d is not active+clean 2023-11-28T20:00:18.624 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.1d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 38, 'state': 'creating+peering', 'last_fresh': '2023-11-28T20:00:12.785747+0000', 'last_change': '2023-11-28T20:00:12.785747+0000', 'last_active': '2023-11-28T20:00:12.764355+0000', 'last_peered': '2023-11-28T20:00:12.764355+0000', 'last_clean': '2023-11-28T20:00:12.764355+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T20:00:12.785747+0000', 'last_undegraded': '2023-11-28T20:00:12.785747+0000', 'last_fullsized': '2023-11-28T20:00:12.785747+0000', 'mapping_epoch': 38, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 38, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T20:00:12.764355+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T20:00:12.764355+0000', 'last_clean_scrub_stamp': '2023-11-28T20:00:12.764355+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 5], 'acting': [1, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-11-28T20:00:18.624 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.1e is not active+clean 2023-11-28T20:00:18.624 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.1e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 38, 'state': 'creating+peering', 'last_fresh': '2023-11-28T20:00:12.782867+0000', 'last_change': '2023-11-28T20:00:12.782867+0000', 'last_active': '2023-11-28T20:00:12.764355+0000', 'last_peered': '2023-11-28T20:00:12.764355+0000', 'last_clean': '2023-11-28T20:00:12.764355+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T20:00:12.782867+0000', 'last_undegraded': '2023-11-28T20:00:12.782867+0000', 'last_fullsized': '2023-11-28T20:00:12.782867+0000', 'mapping_epoch': 38, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 38, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T20:00:12.764355+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T20:00:12.764355+0000', 'last_clean_scrub_stamp': '2023-11-28T20:00:12.764355+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 6], 'acting': [4, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-11-28T20:00:18.624 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.1f is not active+clean 2023-11-28T20:00:18.624 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.1f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 38, 'state': 'creating+peering', 'last_fresh': '2023-11-28T20:00:12.786170+0000', 'last_change': '2023-11-28T20:00:12.786170+0000', 'last_active': '2023-11-28T20:00:12.764355+0000', 'last_peered': '2023-11-28T20:00:12.764355+0000', 'last_clean': '2023-11-28T20:00:12.764355+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T20:00:12.786170+0000', 'last_undegraded': '2023-11-28T20:00:12.786170+0000', 'last_fullsized': '2023-11-28T20:00:12.786170+0000', 'mapping_epoch': 38, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 38, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T20:00:12.764355+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T20:00:12.764355+0000', 'last_clean_scrub_stamp': '2023-11-28T20:00:12.764355+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 6], 'acting': [3, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-11-28T20:00:18.624 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.18 is not active+clean 2023-11-28T20:00:18.624 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.18', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 38, 'state': 'creating+peering', 'last_fresh': '2023-11-28T20:00:12.782917+0000', 'last_change': '2023-11-28T20:00:12.782917+0000', 'last_active': '2023-11-28T20:00:12.764355+0000', 'last_peered': '2023-11-28T20:00:12.764355+0000', 'last_clean': '2023-11-28T20:00:12.764355+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T20:00:12.782917+0000', 'last_undegraded': '2023-11-28T20:00:12.782917+0000', 'last_fullsized': '2023-11-28T20:00:12.782917+0000', 'mapping_epoch': 38, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 38, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T20:00:12.764355+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T20:00:12.764355+0000', 'last_clean_scrub_stamp': '2023-11-28T20:00:12.764355+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-11-28T20:00:18.624 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.19 is not active+clean 2023-11-28T20:00:18.624 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.19', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 38, 'state': 'creating+peering', 'last_fresh': '2023-11-28T20:00:12.787659+0000', 'last_change': '2023-11-28T20:00:12.787659+0000', 'last_active': '2023-11-28T20:00:12.764355+0000', 'last_peered': '2023-11-28T20:00:12.764355+0000', 'last_clean': '2023-11-28T20:00:12.764355+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T20:00:12.787659+0000', 'last_undegraded': '2023-11-28T20:00:12.787659+0000', 'last_fullsized': '2023-11-28T20:00:12.787659+0000', 'mapping_epoch': 38, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 38, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T20:00:12.764355+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T20:00:12.764355+0000', 'last_clean_scrub_stamp': '2023-11-28T20:00:12.764355+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 1], 'acting': [5, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-11-28T20:00:18.625 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.1a is not active+clean 2023-11-28T20:00:18.625 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.1a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 38, 'state': 'creating+peering', 'last_fresh': '2023-11-28T20:00:12.782226+0000', 'last_change': '2023-11-28T20:00:12.782226+0000', 'last_active': '2023-11-28T20:00:12.764355+0000', 'last_peered': '2023-11-28T20:00:12.764355+0000', 'last_clean': '2023-11-28T20:00:12.764355+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T20:00:12.782226+0000', 'last_undegraded': '2023-11-28T20:00:12.782226+0000', 'last_fullsized': '2023-11-28T20:00:12.782226+0000', 'mapping_epoch': 38, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 38, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T20:00:12.764355+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T20:00:12.764355+0000', 'last_clean_scrub_stamp': '2023-11-28T20:00:12.764355+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 5], 'acting': [4, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-11-28T20:00:18.625 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.1b is not active+clean 2023-11-28T20:00:18.625 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.1b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 38, 'state': 'creating+peering', 'last_fresh': '2023-11-28T20:00:12.785875+0000', 'last_change': '2023-11-28T20:00:12.785875+0000', 'last_active': '2023-11-28T20:00:12.764355+0000', 'last_peered': '2023-11-28T20:00:12.764355+0000', 'last_clean': '2023-11-28T20:00:12.764355+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T20:00:12.785875+0000', 'last_undegraded': '2023-11-28T20:00:12.785875+0000', 'last_fullsized': '2023-11-28T20:00:12.785875+0000', 'mapping_epoch': 38, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 38, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T20:00:12.764355+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T20:00:12.764355+0000', 'last_clean_scrub_stamp': '2023-11-28T20:00:12.764355+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 7], 'acting': [3, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-11-28T20:00:18.625 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.14 is not active+clean 2023-11-28T20:00:18.625 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.14', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 38, 'state': 'creating+peering', 'last_fresh': '2023-11-28T20:00:12.777621+0000', 'last_change': '2023-11-28T20:00:12.777621+0000', 'last_active': '2023-11-28T20:00:12.764355+0000', 'last_peered': '2023-11-28T20:00:12.764355+0000', 'last_clean': '2023-11-28T20:00:12.764355+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T20:00:12.777621+0000', 'last_undegraded': '2023-11-28T20:00:12.777621+0000', 'last_fullsized': '2023-11-28T20:00:12.777621+0000', 'mapping_epoch': 38, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 38, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T20:00:12.764355+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T20:00:12.764355+0000', 'last_clean_scrub_stamp': '2023-11-28T20:00:12.764355+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 4], 'acting': [2, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-11-28T20:00:18.625 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.15 is not active+clean 2023-11-28T20:00:18.625 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.15', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 38, 'state': 'creating+peering', 'last_fresh': '2023-11-28T20:00:12.785784+0000', 'last_change': '2023-11-28T20:00:12.785784+0000', 'last_active': '2023-11-28T20:00:12.764355+0000', 'last_peered': '2023-11-28T20:00:12.764355+0000', 'last_clean': '2023-11-28T20:00:12.764355+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T20:00:12.785784+0000', 'last_undegraded': '2023-11-28T20:00:12.785784+0000', 'last_fullsized': '2023-11-28T20:00:12.785784+0000', 'mapping_epoch': 38, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 38, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T20:00:12.764355+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T20:00:12.764355+0000', 'last_clean_scrub_stamp': '2023-11-28T20:00:12.764355+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 6], 'acting': [7, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-11-28T20:00:18.625 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.16 is not active+clean 2023-11-28T20:00:18.625 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.16', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 38, 'state': 'creating+peering', 'last_fresh': '2023-11-28T20:00:12.782260+0000', 'last_change': '2023-11-28T20:00:12.782260+0000', 'last_active': '2023-11-28T20:00:12.764355+0000', 'last_peered': '2023-11-28T20:00:12.764355+0000', 'last_clean': '2023-11-28T20:00:12.764355+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T20:00:12.782260+0000', 'last_undegraded': '2023-11-28T20:00:12.782260+0000', 'last_fullsized': '2023-11-28T20:00:12.782260+0000', 'mapping_epoch': 38, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 38, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T20:00:12.764355+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T20:00:12.764355+0000', 'last_clean_scrub_stamp': '2023-11-28T20:00:12.764355+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 7], 'acting': [0, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-11-28T20:00:18.626 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.17 is not active+clean 2023-11-28T20:00:18.626 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.17', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 38, 'state': 'creating+peering', 'last_fresh': '2023-11-28T20:00:12.783554+0000', 'last_change': '2023-11-28T20:00:12.783554+0000', 'last_active': '2023-11-28T20:00:12.764355+0000', 'last_peered': '2023-11-28T20:00:12.764355+0000', 'last_clean': '2023-11-28T20:00:12.764355+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T20:00:12.783554+0000', 'last_undegraded': '2023-11-28T20:00:12.783554+0000', 'last_fullsized': '2023-11-28T20:00:12.783554+0000', 'mapping_epoch': 38, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 38, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T20:00:12.764355+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T20:00:12.764355+0000', 'last_clean_scrub_stamp': '2023-11-28T20:00:12.764355+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 2], 'acting': [4, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-11-28T20:00:18.626 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.10 is not active+clean 2023-11-28T20:00:18.626 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.10', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 38, 'state': 'creating+peering', 'last_fresh': '2023-11-28T20:00:12.782220+0000', 'last_change': '2023-11-28T20:00:12.782220+0000', 'last_active': '2023-11-28T20:00:12.764355+0000', 'last_peered': '2023-11-28T20:00:12.764355+0000', 'last_clean': '2023-11-28T20:00:12.764355+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T20:00:12.782220+0000', 'last_undegraded': '2023-11-28T20:00:12.782220+0000', 'last_fullsized': '2023-11-28T20:00:12.782220+0000', 'mapping_epoch': 38, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 38, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T20:00:12.764355+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T20:00:12.764355+0000', 'last_clean_scrub_stamp': '2023-11-28T20:00:12.764355+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 5], 'acting': [0, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-11-28T20:00:18.626 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.11 is not active+clean 2023-11-28T20:00:18.626 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.11', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 38, 'state': 'creating+peering', 'last_fresh': '2023-11-28T20:00:12.783042+0000', 'last_change': '2023-11-28T20:00:12.783042+0000', 'last_active': '2023-11-28T20:00:12.764355+0000', 'last_peered': '2023-11-28T20:00:12.764355+0000', 'last_clean': '2023-11-28T20:00:12.764355+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T20:00:12.783042+0000', 'last_undegraded': '2023-11-28T20:00:12.783042+0000', 'last_fullsized': '2023-11-28T20:00:12.783042+0000', 'mapping_epoch': 38, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 38, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T20:00:12.764355+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T20:00:12.764355+0000', 'last_clean_scrub_stamp': '2023-11-28T20:00:12.764355+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 0], 'acting': [3, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-11-28T20:00:18.627 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.12 is not active+clean 2023-11-28T20:00:18.627 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.12', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 38, 'state': 'creating+peering', 'last_fresh': '2023-11-28T20:00:12.784155+0000', 'last_change': '2023-11-28T20:00:12.784155+0000', 'last_active': '2023-11-28T20:00:12.764355+0000', 'last_peered': '2023-11-28T20:00:12.764355+0000', 'last_clean': '2023-11-28T20:00:12.764355+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T20:00:12.784155+0000', 'last_undegraded': '2023-11-28T20:00:12.784155+0000', 'last_fullsized': '2023-11-28T20:00:12.784155+0000', 'mapping_epoch': 38, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 38, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T20:00:12.764355+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T20:00:12.764355+0000', 'last_clean_scrub_stamp': '2023-11-28T20:00:12.764355+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 2], 'acting': [7, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-11-28T20:00:18.627 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.13 is not active+clean 2023-11-28T20:00:18.627 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.13', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 38, 'state': 'creating+peering', 'last_fresh': '2023-11-28T20:00:12.784798+0000', 'last_change': '2023-11-28T20:00:12.784798+0000', 'last_active': '2023-11-28T20:00:12.764355+0000', 'last_peered': '2023-11-28T20:00:12.764355+0000', 'last_clean': '2023-11-28T20:00:12.764355+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T20:00:12.784798+0000', 'last_undegraded': '2023-11-28T20:00:12.784798+0000', 'last_fullsized': '2023-11-28T20:00:12.784798+0000', 'mapping_epoch': 38, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 38, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T20:00:12.764355+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T20:00:12.764355+0000', 'last_clean_scrub_stamp': '2023-11-28T20:00:12.764355+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 0], 'acting': [3, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-11-28T20:00:18.627 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.c is not active+clean 2023-11-28T20:00:18.627 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 38, 'state': 'creating+peering', 'last_fresh': '2023-11-28T20:00:12.786939+0000', 'last_change': '2023-11-28T20:00:12.786939+0000', 'last_active': '2023-11-28T20:00:12.764355+0000', 'last_peered': '2023-11-28T20:00:12.764355+0000', 'last_clean': '2023-11-28T20:00:12.764355+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T20:00:12.786939+0000', 'last_undegraded': '2023-11-28T20:00:12.786939+0000', 'last_fullsized': '2023-11-28T20:00:12.786939+0000', 'mapping_epoch': 38, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 38, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T20:00:12.764355+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T20:00:12.764355+0000', 'last_clean_scrub_stamp': '2023-11-28T20:00:12.764355+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 6], 'acting': [3, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-11-28T20:00:18.627 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.d is not active+clean 2023-11-28T20:00:18.627 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 38, 'state': 'creating+peering', 'last_fresh': '2023-11-28T20:00:12.793965+0000', 'last_change': '2023-11-28T20:00:12.793965+0000', 'last_active': '2023-11-28T20:00:12.764355+0000', 'last_peered': '2023-11-28T20:00:12.764355+0000', 'last_clean': '2023-11-28T20:00:12.764355+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T20:00:12.793965+0000', 'last_undegraded': '2023-11-28T20:00:12.793965+0000', 'last_fullsized': '2023-11-28T20:00:12.793965+0000', 'mapping_epoch': 38, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 38, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T20:00:12.764355+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T20:00:12.764355+0000', 'last_clean_scrub_stamp': '2023-11-28T20:00:12.764355+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 1], 'acting': [5, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-11-28T20:00:18.627 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.e is not active+clean 2023-11-28T20:00:18.627 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 38, 'state': 'creating+peering', 'last_fresh': '2023-11-28T20:00:12.783371+0000', 'last_change': '2023-11-28T20:00:12.783371+0000', 'last_active': '2023-11-28T20:00:12.764355+0000', 'last_peered': '2023-11-28T20:00:12.764355+0000', 'last_clean': '2023-11-28T20:00:12.764355+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T20:00:12.783371+0000', 'last_undegraded': '2023-11-28T20:00:12.783371+0000', 'last_fullsized': '2023-11-28T20:00:12.783371+0000', 'mapping_epoch': 38, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 38, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T20:00:12.764355+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T20:00:12.764355+0000', 'last_clean_scrub_stamp': '2023-11-28T20:00:12.764355+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 1], 'acting': [4, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-11-28T20:00:18.628 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.f is not active+clean 2023-11-28T20:00:18.628 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 38, 'state': 'creating+peering', 'last_fresh': '2023-11-28T20:00:12.782363+0000', 'last_change': '2023-11-28T20:00:12.782363+0000', 'last_active': '2023-11-28T20:00:12.764355+0000', 'last_peered': '2023-11-28T20:00:12.764355+0000', 'last_clean': '2023-11-28T20:00:12.764355+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T20:00:12.782363+0000', 'last_undegraded': '2023-11-28T20:00:12.782363+0000', 'last_fullsized': '2023-11-28T20:00:12.782363+0000', 'mapping_epoch': 38, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 38, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T20:00:12.764355+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T20:00:12.764355+0000', 'last_clean_scrub_stamp': '2023-11-28T20:00:12.764355+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 3], 'acting': [2, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-11-28T20:00:18.628 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.8 is not active+clean 2023-11-28T20:00:18.628 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.8', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 38, 'state': 'creating+peering', 'last_fresh': '2023-11-28T20:00:12.785552+0000', 'last_change': '2023-11-28T20:00:12.785552+0000', 'last_active': '2023-11-28T20:00:12.764355+0000', 'last_peered': '2023-11-28T20:00:12.764355+0000', 'last_clean': '2023-11-28T20:00:12.764355+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T20:00:12.785552+0000', 'last_undegraded': '2023-11-28T20:00:12.785552+0000', 'last_fullsized': '2023-11-28T20:00:12.785552+0000', 'mapping_epoch': 38, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 38, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T20:00:12.764355+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T20:00:12.764355+0000', 'last_clean_scrub_stamp': '2023-11-28T20:00:12.764355+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 2], 'acting': [7, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-11-28T20:00:18.628 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.9 is not active+clean 2023-11-28T20:00:18.628 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.9', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 38, 'state': 'creating+peering', 'last_fresh': '2023-11-28T20:00:12.779217+0000', 'last_change': '2023-11-28T20:00:12.779217+0000', 'last_active': '2023-11-28T20:00:12.764355+0000', 'last_peered': '2023-11-28T20:00:12.764355+0000', 'last_clean': '2023-11-28T20:00:12.764355+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T20:00:12.779217+0000', 'last_undegraded': '2023-11-28T20:00:12.779217+0000', 'last_fullsized': '2023-11-28T20:00:12.779217+0000', 'mapping_epoch': 38, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 38, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T20:00:12.764355+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T20:00:12.764355+0000', 'last_clean_scrub_stamp': '2023-11-28T20:00:12.764355+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 7], 'acting': [0, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-11-28T20:00:18.628 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.a is not active+clean 2023-11-28T20:00:18.628 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 38, 'state': 'creating+peering', 'last_fresh': '2023-11-28T20:00:12.787340+0000', 'last_change': '2023-11-28T20:00:12.787340+0000', 'last_active': '2023-11-28T20:00:12.764355+0000', 'last_peered': '2023-11-28T20:00:12.764355+0000', 'last_clean': '2023-11-28T20:00:12.764355+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T20:00:12.787340+0000', 'last_undegraded': '2023-11-28T20:00:12.787340+0000', 'last_fullsized': '2023-11-28T20:00:12.787340+0000', 'mapping_epoch': 38, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 38, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T20:00:12.764355+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T20:00:12.764355+0000', 'last_clean_scrub_stamp': '2023-11-28T20:00:12.764355+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 6], 'acting': [5, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-11-28T20:00:18.628 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.b is not active+clean 2023-11-28T20:00:18.628 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 38, 'state': 'creating+peering', 'last_fresh': '2023-11-28T20:00:12.783254+0000', 'last_change': '2023-11-28T20:00:12.783254+0000', 'last_active': '2023-11-28T20:00:12.764355+0000', 'last_peered': '2023-11-28T20:00:12.764355+0000', 'last_clean': '2023-11-28T20:00:12.764355+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T20:00:12.783254+0000', 'last_undegraded': '2023-11-28T20:00:12.783254+0000', 'last_fullsized': '2023-11-28T20:00:12.783254+0000', 'mapping_epoch': 38, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 38, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T20:00:12.764355+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T20:00:12.764355+0000', 'last_clean_scrub_stamp': '2023-11-28T20:00:12.764355+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 7], 'acting': [3, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-11-28T20:00:18.629 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.4 is not active+clean 2023-11-28T20:00:18.629 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.4', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 38, 'state': 'creating+peering', 'last_fresh': '2023-11-28T20:00:12.786470+0000', 'last_change': '2023-11-28T20:00:12.786470+0000', 'last_active': '2023-11-28T20:00:12.764355+0000', 'last_peered': '2023-11-28T20:00:12.764355+0000', 'last_clean': '2023-11-28T20:00:12.764355+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T20:00:12.786470+0000', 'last_undegraded': '2023-11-28T20:00:12.786470+0000', 'last_fullsized': '2023-11-28T20:00:12.786470+0000', 'mapping_epoch': 38, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 38, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T20:00:12.764355+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T20:00:12.764355+0000', 'last_clean_scrub_stamp': '2023-11-28T20:00:12.764355+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 5], 'acting': [1, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-11-28T20:00:18.629 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.5 is not active+clean 2023-11-28T20:00:18.629 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.5', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 38, 'state': 'creating+peering', 'last_fresh': '2023-11-28T20:00:12.785219+0000', 'last_change': '2023-11-28T20:00:12.785219+0000', 'last_active': '2023-11-28T20:00:12.764355+0000', 'last_peered': '2023-11-28T20:00:12.764355+0000', 'last_clean': '2023-11-28T20:00:12.764355+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T20:00:12.785219+0000', 'last_undegraded': '2023-11-28T20:00:12.785219+0000', 'last_fullsized': '2023-11-28T20:00:12.785219+0000', 'mapping_epoch': 38, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 38, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T20:00:12.764355+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T20:00:12.764355+0000', 'last_clean_scrub_stamp': '2023-11-28T20:00:12.764355+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 6], 'acting': [7, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-11-28T20:00:18.629 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.6 is not active+clean 2023-11-28T20:00:18.629 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.6', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 38, 'state': 'creating+peering', 'last_fresh': '2023-11-28T20:00:12.783641+0000', 'last_change': '2023-11-28T20:00:12.783641+0000', 'last_active': '2023-11-28T20:00:12.764355+0000', 'last_peered': '2023-11-28T20:00:12.764355+0000', 'last_clean': '2023-11-28T20:00:12.764355+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T20:00:12.783641+0000', 'last_undegraded': '2023-11-28T20:00:12.783641+0000', 'last_fullsized': '2023-11-28T20:00:12.783641+0000', 'mapping_epoch': 38, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 38, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T20:00:12.764355+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T20:00:12.764355+0000', 'last_clean_scrub_stamp': '2023-11-28T20:00:12.764355+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 4], 'acting': [3, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-11-28T20:00:18.629 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.0 is not active+clean 2023-11-28T20:00:18.629 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.0', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 38, 'state': 'creating+peering', 'last_fresh': '2023-11-28T20:00:12.778768+0000', 'last_change': '2023-11-28T20:00:12.778768+0000', 'last_active': '2023-11-28T20:00:12.764355+0000', 'last_peered': '2023-11-28T20:00:12.764355+0000', 'last_clean': '2023-11-28T20:00:12.764355+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T20:00:12.778768+0000', 'last_undegraded': '2023-11-28T20:00:12.778768+0000', 'last_fullsized': '2023-11-28T20:00:12.778768+0000', 'mapping_epoch': 38, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 38, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T20:00:12.764355+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T20:00:12.764355+0000', 'last_clean_scrub_stamp': '2023-11-28T20:00:12.764355+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 3], 'acting': [0, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-11-28T20:00:18.629 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.1 is not active+clean 2023-11-28T20:00:18.630 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.1', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 38, 'state': 'creating+peering', 'last_fresh': '2023-11-28T20:00:12.788073+0000', 'last_change': '2023-11-28T20:00:12.788073+0000', 'last_active': '2023-11-28T20:00:12.764355+0000', 'last_peered': '2023-11-28T20:00:12.764355+0000', 'last_clean': '2023-11-28T20:00:12.764355+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T20:00:12.788073+0000', 'last_undegraded': '2023-11-28T20:00:12.788073+0000', 'last_fullsized': '2023-11-28T20:00:12.788073+0000', 'mapping_epoch': 38, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 38, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T20:00:12.764355+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T20:00:12.764355+0000', 'last_clean_scrub_stamp': '2023-11-28T20:00:12.764355+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 6], 'acting': [1, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-11-28T20:00:18.630 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.2 is not active+clean 2023-11-28T20:00:18.630 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.2', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 38, 'state': 'creating+peering', 'last_fresh': '2023-11-28T20:00:12.783249+0000', 'last_change': '2023-11-28T20:00:12.783249+0000', 'last_active': '2023-11-28T20:00:12.764355+0000', 'last_peered': '2023-11-28T20:00:12.764355+0000', 'last_clean': '2023-11-28T20:00:12.764355+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T20:00:12.783249+0000', 'last_undegraded': '2023-11-28T20:00:12.783249+0000', 'last_fullsized': '2023-11-28T20:00:12.783249+0000', 'mapping_epoch': 38, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 38, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T20:00:12.764355+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T20:00:12.764355+0000', 'last_clean_scrub_stamp': '2023-11-28T20:00:12.764355+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 3], 'acting': [4, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-11-28T20:00:18.630 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.3 is not active+clean 2023-11-28T20:00:18.630 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.3', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 38, 'state': 'creating+peering', 'last_fresh': '2023-11-28T20:00:12.784248+0000', 'last_change': '2023-11-28T20:00:12.784248+0000', 'last_active': '2023-11-28T20:00:12.764355+0000', 'last_peered': '2023-11-28T20:00:12.764355+0000', 'last_clean': '2023-11-28T20:00:12.764355+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T20:00:12.784248+0000', 'last_undegraded': '2023-11-28T20:00:12.784248+0000', 'last_fullsized': '2023-11-28T20:00:12.784248+0000', 'mapping_epoch': 38, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 38, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T20:00:12.764355+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T20:00:12.764355+0000', 'last_clean_scrub_stamp': '2023-11-28T20:00:12.764355+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 6], 'acting': [7, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-11-28T20:00:18.630 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.7 is not active+clean 2023-11-28T20:00:18.631 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.7', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 38, 'state': 'creating+peering', 'last_fresh': '2023-11-28T20:00:12.792646+0000', 'last_change': '2023-11-28T20:00:12.792646+0000', 'last_active': '2023-11-28T20:00:12.764355+0000', 'last_peered': '2023-11-28T20:00:12.764355+0000', 'last_clean': '2023-11-28T20:00:12.764355+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T20:00:12.792646+0000', 'last_undegraded': '2023-11-28T20:00:12.792646+0000', 'last_fullsized': '2023-11-28T20:00:12.792646+0000', 'mapping_epoch': 38, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 38, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T20:00:12.764355+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T20:00:12.764355+0000', 'last_clean_scrub_stamp': '2023-11-28T20:00:12.764355+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 3], 'acting': [5, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-11-28T20:00:18.631 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2023-11-28T20:00:18.784 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:18.782+0000 7fc233576640 1 Processor -- start 2023-11-28T20:00:18.785 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:18.782+0000 7fc233576640 1 -- start start 2023-11-28T20:00:18.788 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:18.782+0000 7fc233576640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc22c0aa990 0x7fc22c0c0e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:18.788 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:18.782+0000 7fc233576640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fc22c0c5900 0x7fc22c0c5d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:18.788 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:18.782+0000 7fc233576640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc22c0c1520 con 0x7fc22c0a4e30 2023-11-28T20:00:18.788 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:18.782+0000 7fc233576640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc22c151c60 con 0x7fc22c0c5900 2023-11-28T20:00:18.788 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:18.782+0000 7fc233576640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc22c0c17c0 con 0x7fc22c0aa990 2023-11-28T20:00:18.789 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:18.782+0000 7fc231d73640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7fc22c0a4e30 0x7fc22c0c4860 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:56510/0 (socket says 172.21.15.78:56510) 2023-11-28T20:00:18.789 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:18.782+0000 7fc231d73640 1 -- 172.21.15.78:0/2796160400 learned_addr learned my addr 172.21.15.78:0/2796160400 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-11-28T20:00:18.789 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:18.782+0000 7fc232574640 1 --2- 172.21.15.78:0/2796160400 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc22c0aa990 0x7fc22c0c0e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:18.789 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:18.782+0000 7fc232d75640 1 --2- 172.21.15.78:0/2796160400 >> v2:172.21.15.179:3300/0 conn(0x7fc22c0c5900 0x7fc22c0c5d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:18.789 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:18.782+0000 7fc231572640 1 -- 172.21.15.78:0/2796160400 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3727639150 0 0) 0x7fc22c0c1520 con 0x7fc22c0a4e30 2023-11-28T20:00:18.790 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:18.782+0000 7fc231572640 1 -- 172.21.15.78:0/2796160400 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc218003530 con 0x7fc22c0a4e30 2023-11-28T20:00:18.790 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:18.782+0000 7fc231572640 1 -- 172.21.15.78:0/2796160400 <== mon.0 v1:172.21.15.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 694517583 0 0) 0x7fc218003530 con 0x7fc22c0a4e30 2023-11-28T20:00:18.790 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:18.782+0000 7fc231572640 1 -- 172.21.15.78:0/2796160400 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc22c0aa990 msgr2=0x7fc22c0c0e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:00:18.790 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:18.782+0000 7fc231572640 1 --2- 172.21.15.78:0/2796160400 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc22c0aa990 0x7fc22c0c0e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:18.790 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:18.782+0000 7fc231572640 1 -- 172.21.15.78:0/2796160400 >> v2:172.21.15.179:3300/0 conn(0x7fc22c0c5900 msgr2=0x7fc22c0c5d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:00:18.791 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:18.782+0000 7fc231572640 1 --2- 172.21.15.78:0/2796160400 >> v2:172.21.15.179:3300/0 conn(0x7fc22c0c5900 0x7fc22c0c5d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:18.791 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:18.782+0000 7fc231572640 1 -- 172.21.15.78:0/2796160400 --> v1:172.21.15.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc22c151f40 con 0x7fc22c0a4e30 2023-11-28T20:00:18.791 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:18.782+0000 7fc231572640 1 -- 172.21.15.78:0/2796160400 <== mon.0 v1:172.21.15.78:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3326804700 0 0) 0x7fc21c001680 con 0x7fc22c0a4e30 2023-11-28T20:00:18.791 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:18.782+0000 7fc231572640 1 -- 172.21.15.78:0/2796160400 >> v1:172.21.15.78:6789/0 conn(0x7fc22c0a4e30 legacy=0x7fc22c0c4860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:00:18.791 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:18.782+0000 7fc231572640 1 --2- 172.21.15.78:0/2796160400 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc218003980 0x7fc218003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:18.792 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:18.782+0000 7fc231572640 1 --2- 172.21.15.78:0/2796160400 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc2180047d0 0x7fc218004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:18.792 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:18.782+0000 7fc231572640 1 --2- 172.21.15.78:0/2796160400 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc218005190 0x7fc21800dba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:18.792 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:18.782+0000 7fc231572640 1 -- 172.21.15.78:0/2796160400 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc22c151c60 con 0x7fc218005190 2023-11-28T20:00:18.792 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:18.782+0000 7fc231572640 1 -- 172.21.15.78:0/2796160400 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc22c0c17c0 con 0x7fc218003980 2023-11-28T20:00:18.793 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:18.782+0000 7fc231572640 1 -- 172.21.15.78:0/2796160400 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc21800e130 con 0x7fc2180047d0 2023-11-28T20:00:18.793 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:18.782+0000 7fc232d75640 1 --2- 172.21.15.78:0/2796160400 >> v2:172.21.15.179:3300/0 conn(0x7fc22c0c5900 0x7fc22c0c5d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T20:00:18.793 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:18.782+0000 7fc232574640 1 --2- 172.21.15.78:0/2796160400 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc22c0aa990 0x7fc22c0c0e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T20:00:18.793 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:18.782+0000 7fc232d75640 1 --2- 172.21.15.78:0/2796160400 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc218005190 0x7fc21800dba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:18.793 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:18.782+0000 7fc232574640 1 --2- 172.21.15.78:0/2796160400 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc218003980 0x7fc218003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:18.793 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:18.782+0000 7fc231d73640 1 --2- 172.21.15.78:0/2796160400 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc2180047d0 0x7fc218004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:18.793 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:18.782+0000 7fc232d75640 1 -- 172.21.15.78:0/2796160400 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc2180047d0 msgr2=0x7fc218004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:00:18.793 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:18.782+0000 7fc232d75640 1 --2- 172.21.15.78:0/2796160400 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc2180047d0 0x7fc218004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:18.793 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:18.782+0000 7fc232d75640 1 -- 172.21.15.78:0/2796160400 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc218003980 msgr2=0x7fc218003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:00:18.794 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:18.782+0000 7fc232d75640 1 --2- 172.21.15.78:0/2796160400 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc218003980 0x7fc218003da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:18.794 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:18.782+0000 7fc232d75640 1 -- 172.21.15.78:0/2796160400 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc218003530 con 0x7fc218005190 2023-11-28T20:00:18.794 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:18.782+0000 7fc231d73640 1 --2- 172.21.15.78:0/2796160400 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc2180047d0 0x7fc218004c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T20:00:18.799 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:18.786+0000 7fc232d75640 1 --2- 172.21.15.78:0/2796160400 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc218005190 0x7fc21800dba0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7fc22400e380 tx=0x7fc22401ce20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f2ab09cbab77c260 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:00:18.800 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:18.786+0000 7fc231572640 1 -- 172.21.15.78:0/2796160400 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2240a5e30 con 0x7fc218005190 2023-11-28T20:00:18.800 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:18.786+0000 7fc231572640 1 -- 172.21.15.78:0/2796160400 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc22400f040 con 0x7fc218005190 2023-11-28T20:00:18.800 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:18.786+0000 7fc231572640 1 -- 172.21.15.78:0/2796160400 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc224003ba0 con 0x7fc218005190 2023-11-28T20:00:18.800 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:18.786+0000 7fc233576640 1 -- 172.21.15.78:0/2796160400 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc218005190 msgr2=0x7fc21800dba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:00:18.800 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:18.786+0000 7fc233576640 1 --2- 172.21.15.78:0/2796160400 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc218005190 0x7fc21800dba0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7fc22400e380 tx=0x7fc22401ce20 comp rx=0 tx=0).stop 2023-11-28T20:00:18.801 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:18.786+0000 7fc232d75640 1 -- 172.21.15.78:0/2796160400 reap_dead start 2023-11-28T20:00:18.801 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:18.786+0000 7fc233576640 1 -- 172.21.15.78:0/2796160400 shutdown_connections 2023-11-28T20:00:18.801 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:18.786+0000 7fc233576640 1 -- 172.21.15.78:0/2796160400 >> 172.21.15.78:0/2796160400 conn(0x7fc22c0a7600 msgr2=0x7fc22c0a7a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:00:18.801 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:18.786+0000 7fc233576640 1 -- 172.21.15.78:0/2796160400 shutdown_connections 2023-11-28T20:00:18.801 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:18.786+0000 7fc233576640 1 -- 172.21.15.78:0/2796160400 wait complete. 2023-11-28T20:00:18.802 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:18.790+0000 7fc233576640 1 Processor -- start 2023-11-28T20:00:18.802 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:18.790+0000 7fc233576640 1 -- start start 2023-11-28T20:00:18.802 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:18.790+0000 7fc233576640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc218005190 0x7fc22c0a6000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:18.802 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:18.790+0000 7fc233576640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc22c1ea090 0x7fc22c1ed240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:18.802 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:18.790+0000 7fc233576640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc22c152f80 0x7fc22c149980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:18.802 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:18.790+0000 7fc233576640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc22c1ea590 con 0x7fc22c1ea090 2023-11-28T20:00:18.803 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:18.790+0000 7fc233576640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc22c0bf920 con 0x7fc218005190 2023-11-28T20:00:18.803 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:18.790+0000 7fc233576640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc22c0bfc00 con 0x7fc22c152f80 2023-11-28T20:00:18.803 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:18.790+0000 7fc231d73640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc22c1ea090 0x7fc22c1ed240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:18.803 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:18.790+0000 7fc231d73640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc22c1ea090 0x7fc22c1ed240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:52188/0 (socket says 172.21.15.78:52188) 2023-11-28T20:00:18.803 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:18.790+0000 7fc231d73640 1 -- 172.21.15.78:0/1612782058 learned_addr learned my addr 172.21.15.78:0/1612782058 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T20:00:18.803 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:18.790+0000 7fc232d75640 1 --2- 172.21.15.78:0/1612782058 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc22c152f80 0x7fc22c149980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:18.804 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:18.790+0000 7fc232574640 1 --2- 172.21.15.78:0/1612782058 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc218005190 0x7fc22c0a6000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:18.804 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:18.790+0000 7fc231d73640 1 -- 172.21.15.78:0/1612782058 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc22c152f80 msgr2=0x7fc22c149980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:00:18.804 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:18.790+0000 7fc231d73640 1 --2- 172.21.15.78:0/1612782058 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc22c152f80 0x7fc22c149980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:18.804 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:18.790+0000 7fc231d73640 1 -- 172.21.15.78:0/1612782058 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc218005190 msgr2=0x7fc22c0a6000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:00:18.804 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:18.790+0000 7fc231d73640 1 --2- 172.21.15.78:0/1612782058 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc218005190 0x7fc22c0a6000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:18.804 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:18.790+0000 7fc231d73640 1 -- 172.21.15.78:0/1612782058 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc22c0a6540 con 0x7fc22c1ea090 2023-11-28T20:00:18.805 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:18.790+0000 7fc231d73640 1 --2- 172.21.15.78:0/1612782058 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc22c1ea090 0x7fc22c1ed240 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7fc21c001210 tx=0x7fc21c011ca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:00:18.805 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:18.790+0000 7fc222ffd640 1 -- 172.21.15.78:0/1612782058 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc21c00fb60 con 0x7fc22c1ea090 2023-11-28T20:00:18.805 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:18.790+0000 7fc222ffd640 1 -- 172.21.15.78:0/1612782058 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc21c00fcc0 con 0x7fc22c1ea090 2023-11-28T20:00:18.805 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:18.790+0000 7fc233576640 1 -- 172.21.15.78:0/1612782058 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc22c0becf0 con 0x7fc22c1ea090 2023-11-28T20:00:18.805 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:18.790+0000 7fc222ffd640 1 -- 172.21.15.78:0/1612782058 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc21c015610 con 0x7fc22c1ea090 2023-11-28T20:00:18.806 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:18.790+0000 7fc233576640 1 -- 172.21.15.78:0/1612782058 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc22c06fcb0 con 0x7fc22c1ea090 2023-11-28T20:00:18.806 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:18.794+0000 7fc233576640 1 -- 172.21.15.78:0/1612782058 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc22c1ecb80 con 0x7fc22c1ea090 2023-11-28T20:00:18.806 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:18.794+0000 7fc222ffd640 1 -- 172.21.15.78:0/1612782058 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fc21c015770 con 0x7fc22c1ea090 2023-11-28T20:00:18.806 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:18.794+0000 7fc222ffd640 1 --2- 172.21.15.78:0/1612782058 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fc2100664a0 0x7fc210068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:18.806 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:18.794+0000 7fc222ffd640 1 -- 172.21.15.78:0/1612782058 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6029+0+0 (secure 0 0 0) 0x7fc21c087260 con 0x7fc22c1ea090 2023-11-28T20:00:18.806 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:18.794+0000 7fc232574640 1 --2- 172.21.15.78:0/1612782058 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fc2100664a0 0x7fc210068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:18.806 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:18.794+0000 7fc232574640 1 --2- 172.21.15.78:0/1612782058 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fc2100664a0 0x7fc210068960 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fc22c06dd90 tx=0x7fc228008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:00:18.807 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:18.798+0000 7fc222ffd640 1 -- 172.21.15.78:0/1612782058 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fc21c054590 con 0x7fc22c1ea090 2023-11-28T20:00:19.005 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:19.002+0000 7fc233576640 1 -- 172.21.15.78:0/1612782058 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7fc22c0674b0 con 0x7fc22c1ea090 2023-11-28T20:00:19.006 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:19.002+0000 7fc222ffd640 1 -- 172.21.15.78:0/1612782058 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1193 (secure 0 0 0) 0x7fc21c057bb0 con 0x7fc22c1ea090 2023-11-28T20:00:19.006 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-11-28T20:00:19.006 INFO:teuthology.orchestra.run.smithi078.stdout:{"fsid":"dd9780e8-3bda-44fa-a9f0-fa07d19d901d","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":98,"monmap":{"epoch":1,"min_mon_release_name":"reef","num_mons":3},"osdmap":{"epoch":40,"num_osds":8,"num_up_osds":8,"osd_up_since":1701201532,"num_in_osds":8,"osd_in_since":1701201523,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"creating+peering","count":64},{"state_name":"active+clean","count":33}],"num_pgs":97,"num_pools":3,"num_objects":2,"data_bytes":590368,"bytes_used":224886784,"bytes_avail":772869226496,"bytes_total":773094113280,"inactive_pgs_ratio":0.65979379415512085},"fsmap":{"epoch":17,"id":2,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":2,"rank":0,"name":"c","status":"up:active","gid":5185}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":5,"modified":"2023-11-28T20:00:01.966196+0000","services":{"mds":{"daemons":{"summary":"","b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2023-11-28T20:00:19.008 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:19.002+0000 7fc233576640 1 -- 172.21.15.78:0/1612782058 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fc2100664a0 msgr2=0x7fc210068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:00:19.008 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:19.002+0000 7fc233576640 1 --2- 172.21.15.78:0/1612782058 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fc2100664a0 0x7fc210068960 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fc22c06dd90 tx=0x7fc228008040 comp rx=0 tx=0).stop 2023-11-28T20:00:19.008 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:19.002+0000 7fc233576640 1 -- 172.21.15.78:0/1612782058 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc22c1ea090 msgr2=0x7fc22c1ed240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:00:19.008 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:19.002+0000 7fc233576640 1 --2- 172.21.15.78:0/1612782058 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc22c1ea090 0x7fc22c1ed240 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7fc21c001210 tx=0x7fc21c011ca0 comp rx=0 tx=0).stop 2023-11-28T20:00:19.008 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:19.002+0000 7fc233576640 1 -- 172.21.15.78:0/1612782058 shutdown_connections 2023-11-28T20:00:19.009 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:19.002+0000 7fc233576640 1 --2- 172.21.15.78:0/1612782058 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fc2100664a0 0x7fc210068960 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:19.009 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:19.002+0000 7fc233576640 1 --2- 172.21.15.78:0/1612782058 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc22c152f80 0x7fc22c149980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:19.009 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:19.002+0000 7fc233576640 1 --2- 172.21.15.78:0/1612782058 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc22c1ea090 0x7fc22c1ed240 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:19.009 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:19.002+0000 7fc233576640 1 --2- 172.21.15.78:0/1612782058 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc218005190 0x7fc22c0a6000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:19.009 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:19.002+0000 7fc233576640 1 -- 172.21.15.78:0/1612782058 >> 172.21.15.78:0/1612782058 conn(0x7fc22c0a7600 msgr2=0x7fc22c0a7a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:00:19.010 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:19.006+0000 7fc233576640 1 -- 172.21.15.78:0/1612782058 shutdown_connections 2023-11-28T20:00:19.010 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:19.006+0000 7fc233576640 1 -- 172.21.15.78:0/1612782058 wait complete. 2023-11-28T20:00:19.027 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2023-11-28T20:00:19.028 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-28T20:00:19.164 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:19.162+0000 7f277ce6b640 1 Processor -- start 2023-11-28T20:00:19.165 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:19.162+0000 7f277ce6b640 1 -- start start 2023-11-28T20:00:19.166 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:19.162+0000 7f277ce6b640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f27780af4c0 0x7f2778154f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:19.166 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:19.162+0000 7f277ce6b640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f27780c67d0 0x7f27780c6c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:19.167 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:19.162+0000 7f277ce6b640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f277806b9f0 0x7f277806be40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:19.167 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:19.162+0000 7f277ce6b640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2778155460 con 0x7f277806b9f0 2023-11-28T20:00:19.167 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:19.162+0000 7f277ce6b640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f277806c380 con 0x7f27780af4c0 2023-11-28T20:00:19.167 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:19.162+0000 7f277ce6b640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f27780c4890 con 0x7f27780c67d0 2023-11-28T20:00:19.167 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:19.162+0000 7f2776d9d640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f277806b9f0 0x7f277806be40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:19.167 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:19.162+0000 7f2776d9d640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f277806b9f0 0x7f277806be40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:52194/0 (socket says 172.21.15.78:52194) 2023-11-28T20:00:19.167 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:19.162+0000 7f2776d9d640 1 -- 172.21.15.78:0/2651719074 learned_addr learned my addr 172.21.15.78:0/2651719074 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T20:00:19.167 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:19.162+0000 7f277659c640 1 --2- 172.21.15.78:0/2651719074 >> v2:172.21.15.179:3300/0 conn(0x7f27780af4c0 0x7f2778154f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:19.167 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:19.162+0000 7f276dd9b640 1 --2- 172.21.15.78:0/2651719074 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f27780c67d0 0x7f27780c6c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:19.167 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:19.162+0000 7f2776d9d640 1 -- 172.21.15.78:0/2651719074 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f27780c67d0 msgr2=0x7f27780c6c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:00:19.167 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:19.162+0000 7f2776d9d640 1 --2- 172.21.15.78:0/2651719074 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f27780c67d0 0x7f27780c6c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:19.167 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:19.162+0000 7f2776d9d640 1 -- 172.21.15.78:0/2651719074 >> v2:172.21.15.179:3300/0 conn(0x7f27780af4c0 msgr2=0x7f2778154f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:00:19.168 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:19.162+0000 7f2776d9d640 1 --2- 172.21.15.78:0/2651719074 >> v2:172.21.15.179:3300/0 conn(0x7f27780af4c0 0x7f2778154f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:19.168 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:19.162+0000 7f2776d9d640 1 -- 172.21.15.78:0/2651719074 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27780af8a0 con 0x7f277806b9f0 2023-11-28T20:00:19.169 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:19.166+0000 7f2776d9d640 1 --2- 172.21.15.78:0/2651719074 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f277806b9f0 0x7f277806be40 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f27780a9790 tx=0x7f277001c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=89104b5a75476fcc server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:00:19.169 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:19.166+0000 7f2775d9b640 1 -- 172.21.15.78:0/2651719074 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27700a5790 con 0x7f277806b9f0 2023-11-28T20:00:19.170 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:19.166+0000 7f2775d9b640 1 -- 172.21.15.78:0/2651719074 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f27700a58f0 con 0x7f277806b9f0 2023-11-28T20:00:19.170 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:19.166+0000 7f2775d9b640 1 -- 172.21.15.78:0/2651719074 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27700a5c80 con 0x7f277806b9f0 2023-11-28T20:00:19.170 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:19.166+0000 7f277ce6b640 1 -- 172.21.15.78:0/2651719074 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f277806b9f0 msgr2=0x7f277806be40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:00:19.171 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:19.166+0000 7f277ce6b640 1 --2- 172.21.15.78:0/2651719074 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f277806b9f0 0x7f277806be40 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f27780a9790 tx=0x7f277001c910 comp rx=0 tx=0).stop 2023-11-28T20:00:19.171 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:19.166+0000 7f277ce6b640 1 -- 172.21.15.78:0/2651719074 shutdown_connections 2023-11-28T20:00:19.171 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:19.166+0000 7f277ce6b640 1 --2- 172.21.15.78:0/2651719074 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f277806b9f0 0x7f277806be40 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:19.171 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:19.166+0000 7f277ce6b640 1 --2- 172.21.15.78:0/2651719074 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f27780c67d0 0x7f27780c6c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:19.171 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:19.166+0000 7f277ce6b640 1 --2- 172.21.15.78:0/2651719074 >> v2:172.21.15.179:3300/0 conn(0x7f27780af4c0 0x7f2778154f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:19.171 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:19.166+0000 7f277ce6b640 1 -- 172.21.15.78:0/2651719074 >> 172.21.15.78:0/2651719074 conn(0x7f27780ab9d0 msgr2=0x7f27780abde0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:00:19.171 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:19.166+0000 7f277ce6b640 1 -- 172.21.15.78:0/2651719074 shutdown_connections 2023-11-28T20:00:19.171 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:19.166+0000 7f277ce6b640 1 -- 172.21.15.78:0/2651719074 wait complete. 2023-11-28T20:00:19.172 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:19.170+0000 7f277ce6b640 1 Processor -- start 2023-11-28T20:00:19.172 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:19.170+0000 7f277ce6b640 1 -- start start 2023-11-28T20:00:19.174 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:19.170+0000 7f277ce6b640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f277806b9f0 0x7f27780ae360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:19.174 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:19.170+0000 7f277ce6b640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f27780af4c0 0x7f2778150840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:19.174 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:19.170+0000 7f277ce6b640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f27780c67d0 0x7f27780c2440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:19.174 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:19.170+0000 7f277ce6b640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f277814eb30 con 0x7f27780c67d0 2023-11-28T20:00:19.174 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:19.170+0000 7f277ce6b640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f277814df20 con 0x7f277806b9f0 2023-11-28T20:00:19.174 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:19.170+0000 7f277ce6b640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f277814e200 con 0x7f27780af4c0 2023-11-28T20:00:19.174 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:19.170+0000 7f2776d9d640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f27780c67d0 0x7f27780c2440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:19.174 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:19.170+0000 7f2776d9d640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f27780c67d0 0x7f27780c2440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:52206/0 (socket says 172.21.15.78:52206) 2023-11-28T20:00:19.174 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:19.170+0000 7f2776d9d640 1 -- 172.21.15.78:0/1652004442 learned_addr learned my addr 172.21.15.78:0/1652004442 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T20:00:19.175 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:19.170+0000 7f276dd9b640 1 --2- 172.21.15.78:0/1652004442 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f27780af4c0 0x7f2778150840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:19.175 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:19.170+0000 7f277659c640 1 --2- 172.21.15.78:0/1652004442 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f277806b9f0 0x7f27780ae360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:19.175 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:19.170+0000 7f2776d9d640 1 -- 172.21.15.78:0/1652004442 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f27780af4c0 msgr2=0x7f2778150840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:00:19.175 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:19.170+0000 7f2776d9d640 1 --2- 172.21.15.78:0/1652004442 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f27780af4c0 0x7f2778150840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:19.175 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:19.170+0000 7f2776d9d640 1 -- 172.21.15.78:0/1652004442 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f277806b9f0 msgr2=0x7f27780ae360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:00:19.175 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:19.170+0000 7f2776d9d640 1 --2- 172.21.15.78:0/1652004442 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f277806b9f0 0x7f27780ae360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:19.175 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:19.170+0000 7f2776d9d640 1 -- 172.21.15.78:0/1652004442 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2770009b30 con 0x7f27780c67d0 2023-11-28T20:00:19.175 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:19.170+0000 7f277659c640 1 --2- 172.21.15.78:0/1652004442 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f277806b9f0 0x7f27780ae360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T20:00:19.175 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:19.170+0000 7f2776d9d640 1 --2- 172.21.15.78:0/1652004442 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f27780c67d0 0x7f27780c2440 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f27700af040 tx=0x7f27700196b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:00:19.176 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:19.170+0000 7f276f7fe640 1 -- 172.21.15.78:0/1652004442 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27700b8670 con 0x7f27780c67d0 2023-11-28T20:00:19.176 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:19.170+0000 7f276f7fe640 1 -- 172.21.15.78:0/1652004442 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f27700b87f0 con 0x7f27780c67d0 2023-11-28T20:00:19.176 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:19.170+0000 7f276f7fe640 1 -- 172.21.15.78:0/1652004442 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27700b8ba0 con 0x7f27780c67d0 2023-11-28T20:00:19.176 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:19.170+0000 7f277ce6b640 1 -- 172.21.15.78:0/1652004442 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f277814e4e0 con 0x7f27780c67d0 2023-11-28T20:00:19.177 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:19.170+0000 7f277ce6b640 1 -- 172.21.15.78:0/1652004442 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f27780c1db0 con 0x7f27780c67d0 2023-11-28T20:00:19.177 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:19.170+0000 7f277ce6b640 1 -- 172.21.15.78:0/1652004442 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2778067630 con 0x7f27780c67d0 2023-11-28T20:00:19.177 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:19.174+0000 7f276f7fe640 1 -- 172.21.15.78:0/1652004442 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f27700b8d00 con 0x7f27780c67d0 2023-11-28T20:00:19.177 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:19.174+0000 7f276f7fe640 1 --2- 172.21.15.78:0/1652004442 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f2758066470 0x7f2758068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:19.177 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:19.174+0000 7f276f7fe640 1 -- 172.21.15.78:0/1652004442 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f277011f520 con 0x7f27780c67d0 2023-11-28T20:00:19.177 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:19.174+0000 7f277659c640 1 --2- 172.21.15.78:0/1652004442 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f2758066470 0x7f2758068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:19.178 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:19.174+0000 7f277659c640 1 --2- 172.21.15.78:0/1652004442 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f2758066470 0x7f2758068930 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f2778067a20 tx=0x7f2760008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:00:19.181 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:19.178+0000 7f276f7fe640 1 -- 172.21.15.78:0/1652004442 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f27700ec850 con 0x7f27780c67d0 2023-11-28T20:00:19.328 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:19.326+0000 7f277ce6b640 1 -- 172.21.15.78:0/1652004442 --> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f277815e100 con 0x7f2758066470 2023-11-28T20:00:19.335 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:19.330+0000 7f276f7fe640 1 -- 172.21.15.78:0/1652004442 <== mgr.4106 v2:172.21.15.78:6832/2935380957 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+283258 (secure 0 0 0) 0x7f277815e100 con 0x7f2758066470 2023-11-28T20:00:19.338 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-11-28T20:00:19.339 INFO:teuthology.orchestra.run.smithi078.stderr:dumped all 2023-11-28T20:00:19.341 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:19.334+0000 7f277ce6b640 1 -- 172.21.15.78:0/1652004442 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f2758066470 msgr2=0x7f2758068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:00:19.341 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:19.334+0000 7f277ce6b640 1 --2- 172.21.15.78:0/1652004442 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f2758066470 0x7f2758068930 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f2778067a20 tx=0x7f2760008040 comp rx=0 tx=0).stop 2023-11-28T20:00:19.341 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:19.334+0000 7f277ce6b640 1 -- 172.21.15.78:0/1652004442 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f27780c67d0 msgr2=0x7f27780c2440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:00:19.341 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:19.334+0000 7f277ce6b640 1 --2- 172.21.15.78:0/1652004442 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f27780c67d0 0x7f27780c2440 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f27700af040 tx=0x7f27700196b0 comp rx=0 tx=0).stop 2023-11-28T20:00:19.341 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:19.334+0000 7f277ce6b640 1 -- 172.21.15.78:0/1652004442 shutdown_connections 2023-11-28T20:00:19.341 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:19.334+0000 7f277ce6b640 1 --2- 172.21.15.78:0/1652004442 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f2758066470 0x7f2758068930 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:19.341 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:19.334+0000 7f277ce6b640 1 --2- 172.21.15.78:0/1652004442 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f27780af4c0 0x7f2778150840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:19.341 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:19.334+0000 7f277ce6b640 1 --2- 172.21.15.78:0/1652004442 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f27780c67d0 0x7f27780c2440 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:19.342 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:19.334+0000 7f277ce6b640 1 --2- 172.21.15.78:0/1652004442 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f277806b9f0 0x7f27780ae360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:19.342 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:19.334+0000 7f277ce6b640 1 -- 172.21.15.78:0/1652004442 >> 172.21.15.78:0/1652004442 conn(0x7f27780ab9d0 msgr2=0x7f2778155c90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:00:19.342 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:19.334+0000 7f277ce6b640 1 -- 172.21.15.78:0/1652004442 shutdown_connections 2023-11-28T20:00:19.342 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:19.334+0000 7f277ce6b640 1 -- 172.21.15.78:0/1652004442 wait complete. 2023-11-28T20:00:19.357 INFO:teuthology.orchestra.run.smithi078.stdout:{"pg_ready":true,"pg_map":{"version":76,"stamp":"2023-11-28T20:00:17.968846+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":48,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219616,"kb_used_data":3456,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755104,"statfs":{"total":773094113280,"available":772869226496,"internally_reserved":0,"allocated":3538944,"data_stored":2608512,"data_compressed":66748,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":28,"apply_latency_ms":28,"commit_latency_ns":28000000,"apply_latency_ns":28000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.000955"},"pg_stats":[{"pgid":"6.3f","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2023-11-28T20:00:12.786561+0000","last_change":"2023-11-28T20:00:12.786561+0000","last_active":"2023-11-28T20:00:12.764355+0000","last_peered":"2023-11-28T20:00:12.764355+0000","last_clean":"2023-11-28T20:00:12.764355+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:00:12.786561+0000","last_undegraded":"2023-11-28T20:00:12.786561+0000","last_fullsized":"2023-11-28T20:00:12.786561+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_clean_scrub_stamp":"2023-11-28T20:00:12.764355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2023-11-28T20:00:12.785251+0000","last_change":"2023-11-28T20:00:12.785251+0000","last_active":"2023-11-28T20:00:12.764355+0000","last_peered":"2023-11-28T20:00:12.764355+0000","last_clean":"2023-11-28T20:00:12.764355+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:00:12.785251+0000","last_undegraded":"2023-11-28T20:00:12.785251+0000","last_fullsized":"2023-11-28T20:00:12.785251+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_clean_scrub_stamp":"2023-11-28T20:00:12.764355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2023-11-28T20:00:12.784934+0000","last_change":"2023-11-28T20:00:12.784934+0000","last_active":"2023-11-28T20:00:12.764355+0000","last_peered":"2023-11-28T20:00:12.764355+0000","last_clean":"2023-11-28T20:00:12.764355+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:00:12.784934+0000","last_undegraded":"2023-11-28T20:00:12.784934+0000","last_fullsized":"2023-11-28T20:00:12.784934+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_clean_scrub_stamp":"2023-11-28T20:00:12.764355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.3c","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2023-11-28T20:00:12.786036+0000","last_change":"2023-11-28T20:00:12.786036+0000","last_active":"2023-11-28T20:00:12.764355+0000","last_peered":"2023-11-28T20:00:12.764355+0000","last_clean":"2023-11-28T20:00:12.764355+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:00:12.786036+0000","last_undegraded":"2023-11-28T20:00:12.786036+0000","last_fullsized":"2023-11-28T20:00:12.786036+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_clean_scrub_stamp":"2023-11-28T20:00:12.764355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2023-11-28T20:00:12.786007+0000","last_change":"2023-11-28T20:00:12.786007+0000","last_active":"2023-11-28T20:00:12.764355+0000","last_peered":"2023-11-28T20:00:12.764355+0000","last_clean":"2023-11-28T20:00:12.764355+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:00:12.786007+0000","last_undegraded":"2023-11-28T20:00:12.786007+0000","last_fullsized":"2023-11-28T20:00:12.786007+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_clean_scrub_stamp":"2023-11-28T20:00:12.764355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2023-11-28T20:00:12.784599+0000","last_change":"2023-11-28T20:00:12.784599+0000","last_active":"2023-11-28T20:00:12.764355+0000","last_peered":"2023-11-28T20:00:12.764355+0000","last_clean":"2023-11-28T20:00:12.764355+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:00:12.784599+0000","last_undegraded":"2023-11-28T20:00:12.784599+0000","last_fullsized":"2023-11-28T20:00:12.784599+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_clean_scrub_stamp":"2023-11-28T20:00:12.764355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2023-11-28T20:00:12.788606+0000","last_change":"2023-11-28T20:00:12.788606+0000","last_active":"2023-11-28T20:00:12.764355+0000","last_peered":"2023-11-28T20:00:12.764355+0000","last_clean":"2023-11-28T20:00:12.764355+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:00:12.788606+0000","last_undegraded":"2023-11-28T20:00:12.788606+0000","last_fullsized":"2023-11-28T20:00:12.788606+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_clean_scrub_stamp":"2023-11-28T20:00:12.764355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2023-11-28T20:00:12.782185+0000","last_change":"2023-11-28T20:00:12.782185+0000","last_active":"2023-11-28T20:00:12.764355+0000","last_peered":"2023-11-28T20:00:12.764355+0000","last_clean":"2023-11-28T20:00:12.764355+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:00:12.782185+0000","last_undegraded":"2023-11-28T20:00:12.782185+0000","last_fullsized":"2023-11-28T20:00:12.782185+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_clean_scrub_stamp":"2023-11-28T20:00:12.764355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2023-11-28T20:00:12.784258+0000","last_change":"2023-11-28T20:00:12.784258+0000","last_active":"2023-11-28T20:00:12.764355+0000","last_peered":"2023-11-28T20:00:12.764355+0000","last_clean":"2023-11-28T20:00:12.764355+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:00:12.784258+0000","last_undegraded":"2023-11-28T20:00:12.784258+0000","last_fullsized":"2023-11-28T20:00:12.784258+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_clean_scrub_stamp":"2023-11-28T20:00:12.764355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2023-11-28T20:00:12.796410+0000","last_change":"2023-11-28T20:00:12.796410+0000","last_active":"2023-11-28T20:00:12.764355+0000","last_peered":"2023-11-28T20:00:12.764355+0000","last_clean":"2023-11-28T20:00:12.764355+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:00:12.796410+0000","last_undegraded":"2023-11-28T20:00:12.796410+0000","last_fullsized":"2023-11-28T20:00:12.796410+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_clean_scrub_stamp":"2023-11-28T20:00:12.764355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2023-11-28T20:00:12.795967+0000","last_change":"2023-11-28T20:00:12.795967+0000","last_active":"2023-11-28T20:00:12.764355+0000","last_peered":"2023-11-28T20:00:12.764355+0000","last_clean":"2023-11-28T20:00:12.764355+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:00:12.795967+0000","last_undegraded":"2023-11-28T20:00:12.795967+0000","last_fullsized":"2023-11-28T20:00:12.795967+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_clean_scrub_stamp":"2023-11-28T20:00:12.764355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2023-11-28T20:00:12.784227+0000","last_change":"2023-11-28T20:00:12.784227+0000","last_active":"2023-11-28T20:00:12.764355+0000","last_peered":"2023-11-28T20:00:12.764355+0000","last_clean":"2023-11-28T20:00:12.764355+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:00:12.784227+0000","last_undegraded":"2023-11-28T20:00:12.784227+0000","last_fullsized":"2023-11-28T20:00:12.784227+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_clean_scrub_stamp":"2023-11-28T20:00:12.764355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2023-11-28T20:00:12.789120+0000","last_change":"2023-11-28T20:00:12.789120+0000","last_active":"2023-11-28T20:00:12.764355+0000","last_peered":"2023-11-28T20:00:12.764355+0000","last_clean":"2023-11-28T20:00:12.764355+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:00:12.789120+0000","last_undegraded":"2023-11-28T20:00:12.789120+0000","last_fullsized":"2023-11-28T20:00:12.789120+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_clean_scrub_stamp":"2023-11-28T20:00:12.764355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2023-11-28T20:00:12.783757+0000","last_change":"2023-11-28T20:00:12.783757+0000","last_active":"2023-11-28T20:00:12.764355+0000","last_peered":"2023-11-28T20:00:12.764355+0000","last_clean":"2023-11-28T20:00:12.764355+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:00:12.783757+0000","last_undegraded":"2023-11-28T20:00:12.783757+0000","last_fullsized":"2023-11-28T20:00:12.783757+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_clean_scrub_stamp":"2023-11-28T20:00:12.764355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2023-11-28T20:00:12.788137+0000","last_change":"2023-11-28T20:00:12.788137+0000","last_active":"2023-11-28T20:00:12.764355+0000","last_peered":"2023-11-28T20:00:12.764355+0000","last_clean":"2023-11-28T20:00:12.764355+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:00:12.788137+0000","last_undegraded":"2023-11-28T20:00:12.788137+0000","last_fullsized":"2023-11-28T20:00:12.788137+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_clean_scrub_stamp":"2023-11-28T20:00:12.764355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2023-11-28T20:00:12.786772+0000","last_change":"2023-11-28T20:00:12.786772+0000","last_active":"2023-11-28T20:00:12.764355+0000","last_peered":"2023-11-28T20:00:12.764355+0000","last_clean":"2023-11-28T20:00:12.764355+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:00:12.786772+0000","last_undegraded":"2023-11-28T20:00:12.786772+0000","last_fullsized":"2023-11-28T20:00:12.786772+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_clean_scrub_stamp":"2023-11-28T20:00:12.764355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2023-11-28T20:00:12.785537+0000","last_change":"2023-11-28T20:00:12.785537+0000","last_active":"2023-11-28T20:00:12.764355+0000","last_peered":"2023-11-28T20:00:12.764355+0000","last_clean":"2023-11-28T20:00:12.764355+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:00:12.785537+0000","last_undegraded":"2023-11-28T20:00:12.785537+0000","last_fullsized":"2023-11-28T20:00:12.785537+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_clean_scrub_stamp":"2023-11-28T20:00:12.764355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2023-11-28T20:00:12.778466+0000","last_change":"2023-11-28T20:00:12.778466+0000","last_active":"2023-11-28T20:00:12.764355+0000","last_peered":"2023-11-28T20:00:12.764355+0000","last_clean":"2023-11-28T20:00:12.764355+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:00:12.778466+0000","last_undegraded":"2023-11-28T20:00:12.778466+0000","last_fullsized":"2023-11-28T20:00:12.778466+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_clean_scrub_stamp":"2023-11-28T20:00:12.764355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2023-11-28T20:00:12.785360+0000","last_change":"2023-11-28T20:00:12.785360+0000","last_active":"2023-11-28T20:00:12.764355+0000","last_peered":"2023-11-28T20:00:12.764355+0000","last_clean":"2023-11-28T20:00:12.764355+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:00:12.785360+0000","last_undegraded":"2023-11-28T20:00:12.785360+0000","last_fullsized":"2023-11-28T20:00:12.785360+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_clean_scrub_stamp":"2023-11-28T20:00:12.764355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2023-11-28T20:00:12.779039+0000","last_change":"2023-11-28T20:00:12.779039+0000","last_active":"2023-11-28T20:00:12.764355+0000","last_peered":"2023-11-28T20:00:12.764355+0000","last_clean":"2023-11-28T20:00:12.764355+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:00:12.779039+0000","last_undegraded":"2023-11-28T20:00:12.779039+0000","last_fullsized":"2023-11-28T20:00:12.779039+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_clean_scrub_stamp":"2023-11-28T20:00:12.764355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2023-11-28T20:00:12.786544+0000","last_change":"2023-11-28T20:00:12.786544+0000","last_active":"2023-11-28T20:00:12.764355+0000","last_peered":"2023-11-28T20:00:12.764355+0000","last_clean":"2023-11-28T20:00:12.764355+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:00:12.786544+0000","last_undegraded":"2023-11-28T20:00:12.786544+0000","last_fullsized":"2023-11-28T20:00:12.786544+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_clean_scrub_stamp":"2023-11-28T20:00:12.764355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2023-11-28T20:00:12.782742+0000","last_change":"2023-11-28T20:00:12.782742+0000","last_active":"2023-11-28T20:00:12.764355+0000","last_peered":"2023-11-28T20:00:12.764355+0000","last_clean":"2023-11-28T20:00:12.764355+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:00:12.782742+0000","last_undegraded":"2023-11-28T20:00:12.782742+0000","last_fullsized":"2023-11-28T20:00:12.782742+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_clean_scrub_stamp":"2023-11-28T20:00:12.764355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2023-11-28T20:00:12.786852+0000","last_change":"2023-11-28T20:00:12.786852+0000","last_active":"2023-11-28T20:00:12.764355+0000","last_peered":"2023-11-28T20:00:12.764355+0000","last_clean":"2023-11-28T20:00:12.764355+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:00:12.786852+0000","last_undegraded":"2023-11-28T20:00:12.786852+0000","last_fullsized":"2023-11-28T20:00:12.786852+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_clean_scrub_stamp":"2023-11-28T20:00:12.764355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2023-11-28T20:00:12.778685+0000","last_change":"2023-11-28T20:00:12.778685+0000","last_active":"2023-11-28T20:00:12.764355+0000","last_peered":"2023-11-28T20:00:12.764355+0000","last_clean":"2023-11-28T20:00:12.764355+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:00:12.778685+0000","last_undegraded":"2023-11-28T20:00:12.778685+0000","last_fullsized":"2023-11-28T20:00:12.778685+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_clean_scrub_stamp":"2023-11-28T20:00:12.764355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2023-11-28T20:00:12.778411+0000","last_change":"2023-11-28T20:00:12.778411+0000","last_active":"2023-11-28T20:00:12.764355+0000","last_peered":"2023-11-28T20:00:12.764355+0000","last_clean":"2023-11-28T20:00:12.764355+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:00:12.778411+0000","last_undegraded":"2023-11-28T20:00:12.778411+0000","last_fullsized":"2023-11-28T20:00:12.778411+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_clean_scrub_stamp":"2023-11-28T20:00:12.764355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2023-11-28T20:00:12.784938+0000","last_change":"2023-11-28T20:00:12.784938+0000","last_active":"2023-11-28T20:00:12.764355+0000","last_peered":"2023-11-28T20:00:12.764355+0000","last_clean":"2023-11-28T20:00:12.764355+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:00:12.784938+0000","last_undegraded":"2023-11-28T20:00:12.784938+0000","last_fullsized":"2023-11-28T20:00:12.784938+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_clean_scrub_stamp":"2023-11-28T20:00:12.764355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2023-11-28T20:00:12.777818+0000","last_change":"2023-11-28T20:00:12.777818+0000","last_active":"2023-11-28T20:00:12.764355+0000","last_peered":"2023-11-28T20:00:12.764355+0000","last_clean":"2023-11-28T20:00:12.764355+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:00:12.777818+0000","last_undegraded":"2023-11-28T20:00:12.777818+0000","last_fullsized":"2023-11-28T20:00:12.777818+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_clean_scrub_stamp":"2023-11-28T20:00:12.764355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2023-11-28T20:00:12.787079+0000","last_change":"2023-11-28T20:00:12.787079+0000","last_active":"2023-11-28T20:00:12.764355+0000","last_peered":"2023-11-28T20:00:12.764355+0000","last_clean":"2023-11-28T20:00:12.764355+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:00:12.787079+0000","last_undegraded":"2023-11-28T20:00:12.787079+0000","last_fullsized":"2023-11-28T20:00:12.787079+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_clean_scrub_stamp":"2023-11-28T20:00:12.764355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2023-11-28T20:00:12.779329+0000","last_change":"2023-11-28T20:00:12.779329+0000","last_active":"2023-11-28T20:00:12.764355+0000","last_peered":"2023-11-28T20:00:12.764355+0000","last_clean":"2023-11-28T20:00:12.764355+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:00:12.779329+0000","last_undegraded":"2023-11-28T20:00:12.779329+0000","last_fullsized":"2023-11-28T20:00:12.779329+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_clean_scrub_stamp":"2023-11-28T20:00:12.764355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2023-11-28T20:00:12.778067+0000","last_change":"2023-11-28T20:00:12.778067+0000","last_active":"2023-11-28T20:00:12.764355+0000","last_peered":"2023-11-28T20:00:12.764355+0000","last_clean":"2023-11-28T20:00:12.764355+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:00:12.778067+0000","last_undegraded":"2023-11-28T20:00:12.778067+0000","last_fullsized":"2023-11-28T20:00:12.778067+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_clean_scrub_stamp":"2023-11-28T20:00:12.764355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2023-11-28T20:00:12.785172+0000","last_change":"2023-11-28T20:00:12.785172+0000","last_active":"2023-11-28T20:00:12.764355+0000","last_peered":"2023-11-28T20:00:12.764355+0000","last_clean":"2023-11-28T20:00:12.764355+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:00:12.785172+0000","last_undegraded":"2023-11-28T20:00:12.785172+0000","last_fullsized":"2023-11-28T20:00:12.785172+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_clean_scrub_stamp":"2023-11-28T20:00:12.764355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2023-11-28T20:00:12.783287+0000","last_change":"2023-11-28T20:00:12.783287+0000","last_active":"2023-11-28T20:00:12.764355+0000","last_peered":"2023-11-28T20:00:12.764355+0000","last_clean":"2023-11-28T20:00:12.764355+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:00:12.783287+0000","last_undegraded":"2023-11-28T20:00:12.783287+0000","last_fullsized":"2023-11-28T20:00:12.783287+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_clean_scrub_stamp":"2023-11-28T20:00:12.764355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2023-11-28T20:00:12.784405+0000","last_change":"2023-11-28T20:00:12.784405+0000","last_active":"2023-11-28T20:00:12.764355+0000","last_peered":"2023-11-28T20:00:12.764355+0000","last_clean":"2023-11-28T20:00:12.764355+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:00:12.784405+0000","last_undegraded":"2023-11-28T20:00:12.784405+0000","last_fullsized":"2023-11-28T20:00:12.784405+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_clean_scrub_stamp":"2023-11-28T20:00:12.764355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-28T20:00:12.802099+0000","last_change":"2023-11-28T20:00:12.794933+0000","last_active":"2023-11-28T20:00:12.802099+0000","last_peered":"2023-11-28T20:00:12.802099+0000","last_clean":"2023-11-28T20:00:12.802099+0000","last_became_active":"2023-11-28T20:00:12.794598+0000","last_became_peered":"2023-11-28T20:00:12.794598+0000","last_unstale":"2023-11-28T20:00:12.802099+0000","last_undegraded":"2023-11-28T20:00:12.802099+0000","last_fullsized":"2023-11-28T20:00:12.802099+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:11.760656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:11.760656+0000","last_clean_scrub_stamp":"2023-11-28T20:00:11.760656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:49:36.064771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2023-11-28T20:00:12.785747+0000","last_change":"2023-11-28T20:00:12.785747+0000","last_active":"2023-11-28T20:00:12.764355+0000","last_peered":"2023-11-28T20:00:12.764355+0000","last_clean":"2023-11-28T20:00:12.764355+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:00:12.785747+0000","last_undegraded":"2023-11-28T20:00:12.785747+0000","last_fullsized":"2023-11-28T20:00:12.785747+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_clean_scrub_stamp":"2023-11-28T20:00:12.764355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-28T20:00:12.796674+0000","last_change":"2023-11-28T20:00:12.794372+0000","last_active":"2023-11-28T20:00:12.796674+0000","last_peered":"2023-11-28T20:00:12.796674+0000","last_clean":"2023-11-28T20:00:12.796674+0000","last_became_active":"2023-11-28T20:00:12.794166+0000","last_became_peered":"2023-11-28T20:00:12.794166+0000","last_unstale":"2023-11-28T20:00:12.796674+0000","last_undegraded":"2023-11-28T20:00:12.796674+0000","last_fullsized":"2023-11-28T20:00:12.796674+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:11.760656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:11.760656+0000","last_clean_scrub_stamp":"2023-11-28T20:00:11.760656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:19:33.219723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2023-11-28T20:00:12.782867+0000","last_change":"2023-11-28T20:00:12.782867+0000","last_active":"2023-11-28T20:00:12.764355+0000","last_peered":"2023-11-28T20:00:12.764355+0000","last_clean":"2023-11-28T20:00:12.764355+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:00:12.782867+0000","last_undegraded":"2023-11-28T20:00:12.782867+0000","last_fullsized":"2023-11-28T20:00:12.782867+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_clean_scrub_stamp":"2023-11-28T20:00:12.764355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-28T20:00:12.802319+0000","last_change":"2023-11-28T20:00:12.797247+0000","last_active":"2023-11-28T20:00:12.802319+0000","last_peered":"2023-11-28T20:00:12.802319+0000","last_clean":"2023-11-28T20:00:12.802319+0000","last_became_active":"2023-11-28T20:00:12.797003+0000","last_became_peered":"2023-11-28T20:00:12.797003+0000","last_unstale":"2023-11-28T20:00:12.802319+0000","last_undegraded":"2023-11-28T20:00:12.802319+0000","last_fullsized":"2023-11-28T20:00:12.802319+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:11.760656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:11.760656+0000","last_clean_scrub_stamp":"2023-11-28T20:00:11.760656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:21:43.946565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2023-11-28T20:00:12.786170+0000","last_change":"2023-11-28T20:00:12.786170+0000","last_active":"2023-11-28T20:00:12.764355+0000","last_peered":"2023-11-28T20:00:12.764355+0000","last_clean":"2023-11-28T20:00:12.764355+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:00:12.786170+0000","last_undegraded":"2023-11-28T20:00:12.786170+0000","last_fullsized":"2023-11-28T20:00:12.786170+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_clean_scrub_stamp":"2023-11-28T20:00:12.764355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-28T20:00:12.800895+0000","last_change":"2023-11-28T20:00:12.799178+0000","last_active":"2023-11-28T20:00:12.800895+0000","last_peered":"2023-11-28T20:00:12.800895+0000","last_clean":"2023-11-28T20:00:12.800895+0000","last_became_active":"2023-11-28T20:00:12.798834+0000","last_became_peered":"2023-11-28T20:00:12.798834+0000","last_unstale":"2023-11-28T20:00:12.800895+0000","last_undegraded":"2023-11-28T20:00:12.800895+0000","last_fullsized":"2023-11-28T20:00:12.800895+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:11.760656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:11.760656+0000","last_clean_scrub_stamp":"2023-11-28T20:00:11.760656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:08:56.081544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2023-11-28T20:00:12.782917+0000","last_change":"2023-11-28T20:00:12.782917+0000","last_active":"2023-11-28T20:00:12.764355+0000","last_peered":"2023-11-28T20:00:12.764355+0000","last_clean":"2023-11-28T20:00:12.764355+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:00:12.782917+0000","last_undegraded":"2023-11-28T20:00:12.782917+0000","last_fullsized":"2023-11-28T20:00:12.782917+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_clean_scrub_stamp":"2023-11-28T20:00:12.764355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-28T20:00:12.807652+0000","last_change":"2023-11-28T20:00:12.804157+0000","last_active":"2023-11-28T20:00:12.807652+0000","last_peered":"2023-11-28T20:00:12.807652+0000","last_clean":"2023-11-28T20:00:12.807652+0000","last_became_active":"2023-11-28T20:00:12.803950+0000","last_became_peered":"2023-11-28T20:00:12.803950+0000","last_unstale":"2023-11-28T20:00:12.807652+0000","last_undegraded":"2023-11-28T20:00:12.807652+0000","last_fullsized":"2023-11-28T20:00:12.807652+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:11.760656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:11.760656+0000","last_clean_scrub_stamp":"2023-11-28T20:00:11.760656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:38:54.348106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2023-11-28T20:00:12.787659+0000","last_change":"2023-11-28T20:00:12.787659+0000","last_active":"2023-11-28T20:00:12.764355+0000","last_peered":"2023-11-28T20:00:12.764355+0000","last_clean":"2023-11-28T20:00:12.764355+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:00:12.787659+0000","last_undegraded":"2023-11-28T20:00:12.787659+0000","last_fullsized":"2023-11-28T20:00:12.787659+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_clean_scrub_stamp":"2023-11-28T20:00:12.764355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-28T20:00:12.799490+0000","last_change":"2023-11-28T20:00:12.797188+0000","last_active":"2023-11-28T20:00:12.799490+0000","last_peered":"2023-11-28T20:00:12.799490+0000","last_clean":"2023-11-28T20:00:12.799490+0000","last_became_active":"2023-11-28T20:00:12.796926+0000","last_became_peered":"2023-11-28T20:00:12.796926+0000","last_unstale":"2023-11-28T20:00:12.799490+0000","last_undegraded":"2023-11-28T20:00:12.799490+0000","last_fullsized":"2023-11-28T20:00:12.799490+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:11.760656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:11.760656+0000","last_clean_scrub_stamp":"2023-11-28T20:00:11.760656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:19:33.219723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2023-11-28T20:00:12.782226+0000","last_change":"2023-11-28T20:00:12.782226+0000","last_active":"2023-11-28T20:00:12.764355+0000","last_peered":"2023-11-28T20:00:12.764355+0000","last_clean":"2023-11-28T20:00:12.764355+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:00:12.782226+0000","last_undegraded":"2023-11-28T20:00:12.782226+0000","last_fullsized":"2023-11-28T20:00:12.782226+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_clean_scrub_stamp":"2023-11-28T20:00:12.764355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-28T20:00:12.809928+0000","last_change":"2023-11-28T20:00:12.805374+0000","last_active":"2023-11-28T20:00:12.809928+0000","last_peered":"2023-11-28T20:00:12.809928+0000","last_clean":"2023-11-28T20:00:12.809928+0000","last_became_active":"2023-11-28T20:00:12.805094+0000","last_became_peered":"2023-11-28T20:00:12.805094+0000","last_unstale":"2023-11-28T20:00:12.809928+0000","last_undegraded":"2023-11-28T20:00:12.809928+0000","last_fullsized":"2023-11-28T20:00:12.809928+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:11.760656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:11.760656+0000","last_clean_scrub_stamp":"2023-11-28T20:00:11.760656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:09:51.354913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2023-11-28T20:00:12.785875+0000","last_change":"2023-11-28T20:00:12.785875+0000","last_active":"2023-11-28T20:00:12.764355+0000","last_peered":"2023-11-28T20:00:12.764355+0000","last_clean":"2023-11-28T20:00:12.764355+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:00:12.785875+0000","last_undegraded":"2023-11-28T20:00:12.785875+0000","last_fullsized":"2023-11-28T20:00:12.785875+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_clean_scrub_stamp":"2023-11-28T20:00:12.764355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-28T20:00:12.799056+0000","last_change":"2023-11-28T20:00:12.797265+0000","last_active":"2023-11-28T20:00:12.799056+0000","last_peered":"2023-11-28T20:00:12.799056+0000","last_clean":"2023-11-28T20:00:12.799056+0000","last_became_active":"2023-11-28T20:00:12.794418+0000","last_became_peered":"2023-11-28T20:00:12.794418+0000","last_unstale":"2023-11-28T20:00:12.799056+0000","last_undegraded":"2023-11-28T20:00:12.799056+0000","last_fullsized":"2023-11-28T20:00:12.799056+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:11.760656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:11.760656+0000","last_clean_scrub_stamp":"2023-11-28T20:00:11.760656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:05:35.913865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2023-11-28T20:00:12.777621+0000","last_change":"2023-11-28T20:00:12.777621+0000","last_active":"2023-11-28T20:00:12.764355+0000","last_peered":"2023-11-28T20:00:12.764355+0000","last_clean":"2023-11-28T20:00:12.764355+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:00:12.777621+0000","last_undegraded":"2023-11-28T20:00:12.777621+0000","last_fullsized":"2023-11-28T20:00:12.777621+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_clean_scrub_stamp":"2023-11-28T20:00:12.764355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-28T20:00:12.802016+0000","last_change":"2023-11-28T20:00:12.796227+0000","last_active":"2023-11-28T20:00:12.802016+0000","last_peered":"2023-11-28T20:00:12.802016+0000","last_clean":"2023-11-28T20:00:12.802016+0000","last_became_active":"2023-11-28T20:00:12.795944+0000","last_became_peered":"2023-11-28T20:00:12.795944+0000","last_unstale":"2023-11-28T20:00:12.802016+0000","last_undegraded":"2023-11-28T20:00:12.802016+0000","last_fullsized":"2023-11-28T20:00:12.802016+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:11.760656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:11.760656+0000","last_clean_scrub_stamp":"2023-11-28T20:00:11.760656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:31:39.960893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2023-11-28T20:00:12.785784+0000","last_change":"2023-11-28T20:00:12.785784+0000","last_active":"2023-11-28T20:00:12.764355+0000","last_peered":"2023-11-28T20:00:12.764355+0000","last_clean":"2023-11-28T20:00:12.764355+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:00:12.785784+0000","last_undegraded":"2023-11-28T20:00:12.785784+0000","last_fullsized":"2023-11-28T20:00:12.785784+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_clean_scrub_stamp":"2023-11-28T20:00:12.764355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-28T20:00:12.807231+0000","last_change":"2023-11-28T20:00:12.803866+0000","last_active":"2023-11-28T20:00:12.807231+0000","last_peered":"2023-11-28T20:00:12.807231+0000","last_clean":"2023-11-28T20:00:12.807231+0000","last_became_active":"2023-11-28T20:00:12.803431+0000","last_became_peered":"2023-11-28T20:00:12.803431+0000","last_unstale":"2023-11-28T20:00:12.807231+0000","last_undegraded":"2023-11-28T20:00:12.807231+0000","last_fullsized":"2023-11-28T20:00:12.807231+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:11.760656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:11.760656+0000","last_clean_scrub_stamp":"2023-11-28T20:00:11.760656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:39:04.449924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2023-11-28T20:00:12.782260+0000","last_change":"2023-11-28T20:00:12.782260+0000","last_active":"2023-11-28T20:00:12.764355+0000","last_peered":"2023-11-28T20:00:12.764355+0000","last_clean":"2023-11-28T20:00:12.764355+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:00:12.782260+0000","last_undegraded":"2023-11-28T20:00:12.782260+0000","last_fullsized":"2023-11-28T20:00:12.782260+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_clean_scrub_stamp":"2023-11-28T20:00:12.764355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-28T20:00:12.807316+0000","last_change":"2023-11-28T20:00:12.804096+0000","last_active":"2023-11-28T20:00:12.807316+0000","last_peered":"2023-11-28T20:00:12.807316+0000","last_clean":"2023-11-28T20:00:12.807316+0000","last_became_active":"2023-11-28T20:00:12.803797+0000","last_became_peered":"2023-11-28T20:00:12.803797+0000","last_unstale":"2023-11-28T20:00:12.807316+0000","last_undegraded":"2023-11-28T20:00:12.807316+0000","last_fullsized":"2023-11-28T20:00:12.807316+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:11.760656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:11.760656+0000","last_clean_scrub_stamp":"2023-11-28T20:00:11.760656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:22:32.210725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2023-11-28T20:00:12.783554+0000","last_change":"2023-11-28T20:00:12.783554+0000","last_active":"2023-11-28T20:00:12.764355+0000","last_peered":"2023-11-28T20:00:12.764355+0000","last_clean":"2023-11-28T20:00:12.764355+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:00:12.783554+0000","last_undegraded":"2023-11-28T20:00:12.783554+0000","last_fullsized":"2023-11-28T20:00:12.783554+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_clean_scrub_stamp":"2023-11-28T20:00:12.764355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-28T20:00:12.802061+0000","last_change":"2023-11-28T20:00:12.797894+0000","last_active":"2023-11-28T20:00:12.802061+0000","last_peered":"2023-11-28T20:00:12.802061+0000","last_clean":"2023-11-28T20:00:12.802061+0000","last_became_active":"2023-11-28T20:00:12.797594+0000","last_became_peered":"2023-11-28T20:00:12.797594+0000","last_unstale":"2023-11-28T20:00:12.802061+0000","last_undegraded":"2023-11-28T20:00:12.802061+0000","last_fullsized":"2023-11-28T20:00:12.802061+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:11.760656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:11.760656+0000","last_clean_scrub_stamp":"2023-11-28T20:00:11.760656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:18:17.461220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2023-11-28T20:00:12.782220+0000","last_change":"2023-11-28T20:00:12.782220+0000","last_active":"2023-11-28T20:00:12.764355+0000","last_peered":"2023-11-28T20:00:12.764355+0000","last_clean":"2023-11-28T20:00:12.764355+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:00:12.782220+0000","last_undegraded":"2023-11-28T20:00:12.782220+0000","last_fullsized":"2023-11-28T20:00:12.782220+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_clean_scrub_stamp":"2023-11-28T20:00:12.764355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-28T20:00:12.801117+0000","last_change":"2023-11-28T20:00:12.794915+0000","last_active":"2023-11-28T20:00:12.801117+0000","last_peered":"2023-11-28T20:00:12.801117+0000","last_clean":"2023-11-28T20:00:12.801117+0000","last_became_active":"2023-11-28T20:00:12.793728+0000","last_became_peered":"2023-11-28T20:00:12.793728+0000","last_unstale":"2023-11-28T20:00:12.801117+0000","last_undegraded":"2023-11-28T20:00:12.801117+0000","last_fullsized":"2023-11-28T20:00:12.801117+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:11.760656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:11.760656+0000","last_clean_scrub_stamp":"2023-11-28T20:00:11.760656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:30:40.433274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2023-11-28T20:00:12.783042+0000","last_change":"2023-11-28T20:00:12.783042+0000","last_active":"2023-11-28T20:00:12.764355+0000","last_peered":"2023-11-28T20:00:12.764355+0000","last_clean":"2023-11-28T20:00:12.764355+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:00:12.783042+0000","last_undegraded":"2023-11-28T20:00:12.783042+0000","last_fullsized":"2023-11-28T20:00:12.783042+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_clean_scrub_stamp":"2023-11-28T20:00:12.764355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-28T20:00:12.809921+0000","last_change":"2023-11-28T20:00:12.805313+0000","last_active":"2023-11-28T20:00:12.809921+0000","last_peered":"2023-11-28T20:00:12.809921+0000","last_clean":"2023-11-28T20:00:12.809921+0000","last_became_active":"2023-11-28T20:00:12.804998+0000","last_became_peered":"2023-11-28T20:00:12.804998+0000","last_unstale":"2023-11-28T20:00:12.809921+0000","last_undegraded":"2023-11-28T20:00:12.809921+0000","last_fullsized":"2023-11-28T20:00:12.809921+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:11.760656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:11.760656+0000","last_clean_scrub_stamp":"2023-11-28T20:00:11.760656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:55:34.737227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2023-11-28T20:00:12.784155+0000","last_change":"2023-11-28T20:00:12.784155+0000","last_active":"2023-11-28T20:00:12.764355+0000","last_peered":"2023-11-28T20:00:12.764355+0000","last_clean":"2023-11-28T20:00:12.764355+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:00:12.784155+0000","last_undegraded":"2023-11-28T20:00:12.784155+0000","last_fullsized":"2023-11-28T20:00:12.784155+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_clean_scrub_stamp":"2023-11-28T20:00:12.764355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-28T20:00:12.792278+0000","last_change":"2023-11-28T20:00:12.789146+0000","last_active":"2023-11-28T20:00:12.792278+0000","last_peered":"2023-11-28T20:00:12.792278+0000","last_clean":"2023-11-28T20:00:12.792278+0000","last_became_active":"2023-11-28T20:00:12.788447+0000","last_became_peered":"2023-11-28T20:00:12.788447+0000","last_unstale":"2023-11-28T20:00:12.792278+0000","last_undegraded":"2023-11-28T20:00:12.792278+0000","last_fullsized":"2023-11-28T20:00:12.792278+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:11.760656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:11.760656+0000","last_clean_scrub_stamp":"2023-11-28T20:00:11.760656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:51:42.810996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2023-11-28T20:00:12.784798+0000","last_change":"2023-11-28T20:00:12.784798+0000","last_active":"2023-11-28T20:00:12.764355+0000","last_peered":"2023-11-28T20:00:12.764355+0000","last_clean":"2023-11-28T20:00:12.764355+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:00:12.784798+0000","last_undegraded":"2023-11-28T20:00:12.784798+0000","last_fullsized":"2023-11-28T20:00:12.784798+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_clean_scrub_stamp":"2023-11-28T20:00:12.764355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-28T20:00:12.800818+0000","last_change":"2023-11-28T20:00:12.799040+0000","last_active":"2023-11-28T20:00:12.800818+0000","last_peered":"2023-11-28T20:00:12.800818+0000","last_clean":"2023-11-28T20:00:12.800818+0000","last_became_active":"2023-11-28T20:00:12.798730+0000","last_became_peered":"2023-11-28T20:00:12.798730+0000","last_unstale":"2023-11-28T20:00:12.800818+0000","last_undegraded":"2023-11-28T20:00:12.800818+0000","last_fullsized":"2023-11-28T20:00:12.800818+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:11.760656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:11.760656+0000","last_clean_scrub_stamp":"2023-11-28T20:00:11.760656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T06:41:49.723414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2023-11-28T20:00:12.786939+0000","last_change":"2023-11-28T20:00:12.786939+0000","last_active":"2023-11-28T20:00:12.764355+0000","last_peered":"2023-11-28T20:00:12.764355+0000","last_clean":"2023-11-28T20:00:12.764355+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:00:12.786939+0000","last_undegraded":"2023-11-28T20:00:12.786939+0000","last_fullsized":"2023-11-28T20:00:12.786939+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_clean_scrub_stamp":"2023-11-28T20:00:12.764355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-28T20:00:12.807215+0000","last_change":"2023-11-28T20:00:12.803142+0000","last_active":"2023-11-28T20:00:12.807215+0000","last_peered":"2023-11-28T20:00:12.807215+0000","last_clean":"2023-11-28T20:00:12.807215+0000","last_became_active":"2023-11-28T20:00:12.802775+0000","last_became_peered":"2023-11-28T20:00:12.802775+0000","last_unstale":"2023-11-28T20:00:12.807215+0000","last_undegraded":"2023-11-28T20:00:12.807215+0000","last_fullsized":"2023-11-28T20:00:12.807215+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:11.760656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:11.760656+0000","last_clean_scrub_stamp":"2023-11-28T20:00:11.760656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:31:56.988459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2023-11-28T20:00:12.793965+0000","last_change":"2023-11-28T20:00:12.793965+0000","last_active":"2023-11-28T20:00:12.764355+0000","last_peered":"2023-11-28T20:00:12.764355+0000","last_clean":"2023-11-28T20:00:12.764355+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:00:12.793965+0000","last_undegraded":"2023-11-28T20:00:12.793965+0000","last_fullsized":"2023-11-28T20:00:12.793965+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_clean_scrub_stamp":"2023-11-28T20:00:12.764355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-28T20:00:12.807286+0000","last_change":"2023-11-28T20:00:12.806331+0000","last_active":"2023-11-28T20:00:12.807286+0000","last_peered":"2023-11-28T20:00:12.807286+0000","last_clean":"2023-11-28T20:00:12.807286+0000","last_became_active":"2023-11-28T20:00:12.805857+0000","last_became_peered":"2023-11-28T20:00:12.805857+0000","last_unstale":"2023-11-28T20:00:12.807286+0000","last_undegraded":"2023-11-28T20:00:12.807286+0000","last_fullsized":"2023-11-28T20:00:12.807286+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:11.760656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:11.760656+0000","last_clean_scrub_stamp":"2023-11-28T20:00:11.760656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:07:27.330964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2023-11-28T20:00:12.783371+0000","last_change":"2023-11-28T20:00:12.783371+0000","last_active":"2023-11-28T20:00:12.764355+0000","last_peered":"2023-11-28T20:00:12.764355+0000","last_clean":"2023-11-28T20:00:12.764355+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:00:12.783371+0000","last_undegraded":"2023-11-28T20:00:12.783371+0000","last_fullsized":"2023-11-28T20:00:12.783371+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_clean_scrub_stamp":"2023-11-28T20:00:12.764355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-28T20:00:12.802514+0000","last_change":"2023-11-28T20:00:12.796923+0000","last_active":"2023-11-28T20:00:12.802514+0000","last_peered":"2023-11-28T20:00:12.802514+0000","last_clean":"2023-11-28T20:00:12.802514+0000","last_became_active":"2023-11-28T20:00:12.796625+0000","last_became_peered":"2023-11-28T20:00:12.796625+0000","last_unstale":"2023-11-28T20:00:12.802514+0000","last_undegraded":"2023-11-28T20:00:12.802514+0000","last_fullsized":"2023-11-28T20:00:12.802514+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:11.760656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:11.760656+0000","last_clean_scrub_stamp":"2023-11-28T20:00:11.760656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:48:42.030591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2023-11-28T20:00:12.782363+0000","last_change":"2023-11-28T20:00:12.782363+0000","last_active":"2023-11-28T20:00:12.764355+0000","last_peered":"2023-11-28T20:00:12.764355+0000","last_clean":"2023-11-28T20:00:12.764355+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:00:12.782363+0000","last_undegraded":"2023-11-28T20:00:12.782363+0000","last_fullsized":"2023-11-28T20:00:12.782363+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_clean_scrub_stamp":"2023-11-28T20:00:12.764355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-28T20:00:12.801643+0000","last_change":"2023-11-28T20:00:12.796705+0000","last_active":"2023-11-28T20:00:12.801643+0000","last_peered":"2023-11-28T20:00:12.801643+0000","last_clean":"2023-11-28T20:00:12.801643+0000","last_became_active":"2023-11-28T20:00:12.796394+0000","last_became_peered":"2023-11-28T20:00:12.796394+0000","last_unstale":"2023-11-28T20:00:12.801643+0000","last_undegraded":"2023-11-28T20:00:12.801643+0000","last_fullsized":"2023-11-28T20:00:12.801643+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:11.760656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:11.760656+0000","last_clean_scrub_stamp":"2023-11-28T20:00:11.760656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T06:41:49.723414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2023-11-28T20:00:12.785552+0000","last_change":"2023-11-28T20:00:12.785552+0000","last_active":"2023-11-28T20:00:12.764355+0000","last_peered":"2023-11-28T20:00:12.764355+0000","last_clean":"2023-11-28T20:00:12.764355+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:00:12.785552+0000","last_undegraded":"2023-11-28T20:00:12.785552+0000","last_fullsized":"2023-11-28T20:00:12.785552+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_clean_scrub_stamp":"2023-11-28T20:00:12.764355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-28T20:00:12.791923+0000","last_change":"2023-11-28T20:00:12.787168+0000","last_active":"2023-11-28T20:00:12.791923+0000","last_peered":"2023-11-28T20:00:12.791923+0000","last_clean":"2023-11-28T20:00:12.791923+0000","last_became_active":"2023-11-28T20:00:12.786815+0000","last_became_peered":"2023-11-28T20:00:12.786815+0000","last_unstale":"2023-11-28T20:00:12.791923+0000","last_undegraded":"2023-11-28T20:00:12.791923+0000","last_fullsized":"2023-11-28T20:00:12.791923+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:11.760656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:11.760656+0000","last_clean_scrub_stamp":"2023-11-28T20:00:11.760656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T06:48:23.539826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2023-11-28T20:00:12.779217+0000","last_change":"2023-11-28T20:00:12.779217+0000","last_active":"2023-11-28T20:00:12.764355+0000","last_peered":"2023-11-28T20:00:12.764355+0000","last_clean":"2023-11-28T20:00:12.764355+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:00:12.779217+0000","last_undegraded":"2023-11-28T20:00:12.779217+0000","last_fullsized":"2023-11-28T20:00:12.779217+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_clean_scrub_stamp":"2023-11-28T20:00:12.764355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-28T20:00:12.792018+0000","last_change":"2023-11-28T20:00:12.789615+0000","last_active":"2023-11-28T20:00:12.792018+0000","last_peered":"2023-11-28T20:00:12.792018+0000","last_clean":"2023-11-28T20:00:12.792018+0000","last_became_active":"2023-11-28T20:00:12.789357+0000","last_became_peered":"2023-11-28T20:00:12.789357+0000","last_unstale":"2023-11-28T20:00:12.792018+0000","last_undegraded":"2023-11-28T20:00:12.792018+0000","last_fullsized":"2023-11-28T20:00:12.792018+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:11.760656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:11.760656+0000","last_clean_scrub_stamp":"2023-11-28T20:00:11.760656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:51:47.744006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2023-11-28T20:00:12.787340+0000","last_change":"2023-11-28T20:00:12.787340+0000","last_active":"2023-11-28T20:00:12.764355+0000","last_peered":"2023-11-28T20:00:12.764355+0000","last_clean":"2023-11-28T20:00:12.764355+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:00:12.787340+0000","last_undegraded":"2023-11-28T20:00:12.787340+0000","last_fullsized":"2023-11-28T20:00:12.787340+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_clean_scrub_stamp":"2023-11-28T20:00:12.764355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-28T20:00:12.797956+0000","last_change":"2023-11-28T20:00:12.794799+0000","last_active":"2023-11-28T20:00:12.797956+0000","last_peered":"2023-11-28T20:00:12.797956+0000","last_clean":"2023-11-28T20:00:12.797956+0000","last_became_active":"2023-11-28T20:00:12.794535+0000","last_became_peered":"2023-11-28T20:00:12.794535+0000","last_unstale":"2023-11-28T20:00:12.797956+0000","last_undegraded":"2023-11-28T20:00:12.797956+0000","last_fullsized":"2023-11-28T20:00:12.797956+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:11.760656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:11.760656+0000","last_clean_scrub_stamp":"2023-11-28T20:00:11.760656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:21:43.946565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2023-11-28T20:00:12.783254+0000","last_change":"2023-11-28T20:00:12.783254+0000","last_active":"2023-11-28T20:00:12.764355+0000","last_peered":"2023-11-28T20:00:12.764355+0000","last_clean":"2023-11-28T20:00:12.764355+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:00:12.783254+0000","last_undegraded":"2023-11-28T20:00:12.783254+0000","last_fullsized":"2023-11-28T20:00:12.783254+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_clean_scrub_stamp":"2023-11-28T20:00:12.764355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-28T20:00:12.791952+0000","last_change":"2023-11-28T20:00:12.787505+0000","last_active":"2023-11-28T20:00:12.791952+0000","last_peered":"2023-11-28T20:00:12.791952+0000","last_clean":"2023-11-28T20:00:12.791952+0000","last_became_active":"2023-11-28T20:00:12.786509+0000","last_became_peered":"2023-11-28T20:00:12.786509+0000","last_unstale":"2023-11-28T20:00:12.791952+0000","last_undegraded":"2023-11-28T20:00:12.791952+0000","last_fullsized":"2023-11-28T20:00:12.791952+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:11.760656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:11.760656+0000","last_clean_scrub_stamp":"2023-11-28T20:00:11.760656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:35:56.918733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2023-11-28T20:00:12.786470+0000","last_change":"2023-11-28T20:00:12.786470+0000","last_active":"2023-11-28T20:00:12.764355+0000","last_peered":"2023-11-28T20:00:12.764355+0000","last_clean":"2023-11-28T20:00:12.764355+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:00:12.786470+0000","last_undegraded":"2023-11-28T20:00:12.786470+0000","last_fullsized":"2023-11-28T20:00:12.786470+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_clean_scrub_stamp":"2023-11-28T20:00:12.764355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-28T20:00:12.807677+0000","last_change":"2023-11-28T20:00:12.804126+0000","last_active":"2023-11-28T20:00:12.807677+0000","last_peered":"2023-11-28T20:00:12.807677+0000","last_clean":"2023-11-28T20:00:12.807677+0000","last_became_active":"2023-11-28T20:00:12.803815+0000","last_became_peered":"2023-11-28T20:00:12.803815+0000","last_unstale":"2023-11-28T20:00:12.807677+0000","last_undegraded":"2023-11-28T20:00:12.807677+0000","last_fullsized":"2023-11-28T20:00:12.807677+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:11.760656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:11.760656+0000","last_clean_scrub_stamp":"2023-11-28T20:00:11.760656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T07:54:02.325947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2023-11-28T20:00:12.785219+0000","last_change":"2023-11-28T20:00:12.785219+0000","last_active":"2023-11-28T20:00:12.764355+0000","last_peered":"2023-11-28T20:00:12.764355+0000","last_clean":"2023-11-28T20:00:12.764355+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:00:12.785219+0000","last_undegraded":"2023-11-28T20:00:12.785219+0000","last_fullsized":"2023-11-28T20:00:12.785219+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_clean_scrub_stamp":"2023-11-28T20:00:12.764355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-28T20:00:12.807159+0000","last_change":"2023-11-28T20:00:12.804114+0000","last_active":"2023-11-28T20:00:12.807159+0000","last_peered":"2023-11-28T20:00:12.807159+0000","last_clean":"2023-11-28T20:00:12.807159+0000","last_became_active":"2023-11-28T20:00:12.803528+0000","last_became_peered":"2023-11-28T20:00:12.803528+0000","last_unstale":"2023-11-28T20:00:12.807159+0000","last_undegraded":"2023-11-28T20:00:12.807159+0000","last_fullsized":"2023-11-28T20:00:12.807159+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:11.760656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:11.760656+0000","last_clean_scrub_stamp":"2023-11-28T20:00:11.760656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:09:19.510844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2023-11-28T20:00:12.783641+0000","last_change":"2023-11-28T20:00:12.783641+0000","last_active":"2023-11-28T20:00:12.764355+0000","last_peered":"2023-11-28T20:00:12.764355+0000","last_clean":"2023-11-28T20:00:12.764355+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:00:12.783641+0000","last_undegraded":"2023-11-28T20:00:12.783641+0000","last_fullsized":"2023-11-28T20:00:12.783641+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_clean_scrub_stamp":"2023-11-28T20:00:12.764355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-28T20:00:12.797021+0000","last_change":"2023-11-28T20:00:12.795099+0000","last_active":"2023-11-28T20:00:12.797021+0000","last_peered":"2023-11-28T20:00:12.797021+0000","last_clean":"2023-11-28T20:00:12.797021+0000","last_became_active":"2023-11-28T20:00:12.794522+0000","last_became_peered":"2023-11-28T20:00:12.794522+0000","last_unstale":"2023-11-28T20:00:12.797021+0000","last_undegraded":"2023-11-28T20:00:12.797021+0000","last_fullsized":"2023-11-28T20:00:12.797021+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:11.760656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:11.760656+0000","last_clean_scrub_stamp":"2023-11-28T20:00:11.760656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:43:03.956082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2023-11-28T20:00:12.778768+0000","last_change":"2023-11-28T20:00:12.778768+0000","last_active":"2023-11-28T20:00:12.764355+0000","last_peered":"2023-11-28T20:00:12.764355+0000","last_clean":"2023-11-28T20:00:12.764355+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:00:12.778768+0000","last_undegraded":"2023-11-28T20:00:12.778768+0000","last_fullsized":"2023-11-28T20:00:12.778768+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_clean_scrub_stamp":"2023-11-28T20:00:12.764355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-28T20:00:12.795504+0000","last_change":"2023-11-28T20:00:12.792743+0000","last_active":"2023-11-28T20:00:12.795504+0000","last_peered":"2023-11-28T20:00:12.795504+0000","last_clean":"2023-11-28T20:00:12.795504+0000","last_became_active":"2023-11-28T20:00:12.792420+0000","last_became_peered":"2023-11-28T20:00:12.792420+0000","last_unstale":"2023-11-28T20:00:12.795504+0000","last_undegraded":"2023-11-28T20:00:12.795504+0000","last_fullsized":"2023-11-28T20:00:12.795504+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:11.760656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:11.760656+0000","last_clean_scrub_stamp":"2023-11-28T20:00:11.760656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:49:36.064771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2023-11-28T20:00:12.788073+0000","last_change":"2023-11-28T20:00:12.788073+0000","last_active":"2023-11-28T20:00:12.764355+0000","last_peered":"2023-11-28T20:00:12.764355+0000","last_clean":"2023-11-28T20:00:12.764355+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:00:12.788073+0000","last_undegraded":"2023-11-28T20:00:12.788073+0000","last_fullsized":"2023-11-28T20:00:12.788073+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_clean_scrub_stamp":"2023-11-28T20:00:12.764355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-28T20:00:12.801066+0000","last_change":"2023-11-28T20:00:12.793819+0000","last_active":"2023-11-28T20:00:12.801066+0000","last_peered":"2023-11-28T20:00:12.801066+0000","last_clean":"2023-11-28T20:00:12.801066+0000","last_became_active":"2023-11-28T20:00:12.793027+0000","last_became_peered":"2023-11-28T20:00:12.793027+0000","last_unstale":"2023-11-28T20:00:12.801066+0000","last_undegraded":"2023-11-28T20:00:12.801066+0000","last_fullsized":"2023-11-28T20:00:12.801066+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:11.760656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:11.760656+0000","last_clean_scrub_stamp":"2023-11-28T20:00:11.760656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:43:03.956082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2023-11-28T20:00:12.783249+0000","last_change":"2023-11-28T20:00:12.783249+0000","last_active":"2023-11-28T20:00:12.764355+0000","last_peered":"2023-11-28T20:00:12.764355+0000","last_clean":"2023-11-28T20:00:12.764355+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:00:12.783249+0000","last_undegraded":"2023-11-28T20:00:12.783249+0000","last_fullsized":"2023-11-28T20:00:12.783249+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_clean_scrub_stamp":"2023-11-28T20:00:12.764355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-28T20:00:12.796446+0000","last_change":"2023-11-28T20:00:12.790049+0000","last_active":"2023-11-28T20:00:12.796446+0000","last_peered":"2023-11-28T20:00:12.796446+0000","last_clean":"2023-11-28T20:00:12.796446+0000","last_became_active":"2023-11-28T20:00:12.789755+0000","last_became_peered":"2023-11-28T20:00:12.789755+0000","last_unstale":"2023-11-28T20:00:12.796446+0000","last_undegraded":"2023-11-28T20:00:12.796446+0000","last_fullsized":"2023-11-28T20:00:12.796446+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:11.760656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:11.760656+0000","last_clean_scrub_stamp":"2023-11-28T20:00:11.760656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:29:35.927577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2023-11-28T20:00:12.784248+0000","last_change":"2023-11-28T20:00:12.784248+0000","last_active":"2023-11-28T20:00:12.764355+0000","last_peered":"2023-11-28T20:00:12.764355+0000","last_clean":"2023-11-28T20:00:12.764355+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:00:12.784248+0000","last_undegraded":"2023-11-28T20:00:12.784248+0000","last_fullsized":"2023-11-28T20:00:12.784248+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_clean_scrub_stamp":"2023-11-28T20:00:12.764355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-28T20:00:12.801088+0000","last_change":"2023-11-28T20:00:12.794531+0000","last_active":"2023-11-28T20:00:12.801088+0000","last_peered":"2023-11-28T20:00:12.801088+0000","last_clean":"2023-11-28T20:00:12.801088+0000","last_became_active":"2023-11-28T20:00:12.794205+0000","last_became_peered":"2023-11-28T20:00:12.794205+0000","last_unstale":"2023-11-28T20:00:12.801088+0000","last_undegraded":"2023-11-28T20:00:12.801088+0000","last_fullsized":"2023-11-28T20:00:12.801088+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:11.760656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:11.760656+0000","last_clean_scrub_stamp":"2023-11-28T20:00:11.760656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:18:52.212443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2023-11-28T20:00:12.792646+0000","last_change":"2023-11-28T20:00:12.792646+0000","last_active":"2023-11-28T20:00:12.764355+0000","last_peered":"2023-11-28T20:00:12.764355+0000","last_clean":"2023-11-28T20:00:12.764355+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:00:12.792646+0000","last_undegraded":"2023-11-28T20:00:12.792646+0000","last_fullsized":"2023-11-28T20:00:12.792646+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_clean_scrub_stamp":"2023-11-28T20:00:12.764355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-28T20:00:12.797985+0000","last_change":"2023-11-28T20:00:12.795584+0000","last_active":"2023-11-28T20:00:12.797985+0000","last_peered":"2023-11-28T20:00:12.797985+0000","last_clean":"2023-11-28T20:00:12.797985+0000","last_became_active":"2023-11-28T20:00:12.795179+0000","last_became_peered":"2023-11-28T20:00:12.795179+0000","last_unstale":"2023-11-28T20:00:12.797985+0000","last_undegraded":"2023-11-28T20:00:12.797985+0000","last_fullsized":"2023-11-28T20:00:12.797985+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:11.760656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:11.760656+0000","last_clean_scrub_stamp":"2023-11-28T20:00:11.760656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:55:34.737227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":178,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-28T20:00:11.776047+0000","last_change":"2023-11-28T19:58:56.136501+0000","last_active":"2023-11-28T20:00:11.776047+0000","last_peered":"2023-11-28T20:00:11.776047+0000","last_clean":"2023-11-28T20:00:11.776047+0000","last_became_active":"2023-11-28T19:58:56.135998+0000","last_became_peered":"2023-11-28T19:58:56.135998+0000","last_unstale":"2023-11-28T20:00:11.776047+0000","last_undegraded":"2023-11-28T20:00:11.776047+0000","last_fullsized":"2023-11-28T20:00:11.776047+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:58:54.602349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:58:54.602349+0000","last_clean_scrub_stamp":"2023-11-28T19:58:54.602349+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:33:42.723349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":66748,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574868,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27500,"kb_used_data":480,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344340,"statfs":{"total":96636764160,"available":96608604160,"internally_reserved":0,"allocated":491520,"data_stored":768840,"data_compressed":33374,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 19:59:54 2023","interfaces":[{"interface":"back","average":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":0.90700000000000003,"5min":0.90700000000000003,"15min":0.90700000000000003},"last":0.76300000000000001},{"interface":"front","average":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"min":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":0.98999999999999999,"5min":0.98999999999999999,"15min":0.98999999999999999},"last":0.61299999999999999}]},{"osd":1,"last update":"Tue Nov 28 19:59:54 2023","interfaces":[{"interface":"back","average":{"1min":0.64600000000000002,"5min":0.64600000000000002,"15min":0.64600000000000002},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":0.89600000000000002,"5min":0.89600000000000002,"15min":0.89600000000000002},"last":0.82899999999999996},{"interface":"front","average":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.70199999999999996},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":1.0900000000000001,"5min":1.0900000000000001,"15min":1.0900000000000001},"last":0.68899999999999995}]},{"osd":2,"last update":"Tue Nov 28 19:59:54 2023","interfaces":[{"interface":"back","average":{"1min":0.73499999999999999,"5min":0.73499999999999999,"15min":0.73499999999999999},"min":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"max":{"1min":0.98799999999999999,"5min":0.98799999999999999,"15min":0.98799999999999999},"last":0.81499999999999995},{"interface":"front","average":{"1min":0.70699999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":1.0680000000000001,"5min":1.0680000000000001,"15min":1.0680000000000001},"last":0.85599999999999998}]},{"osd":3,"last update":"Tue Nov 28 19:59:54 2023","interfaces":[{"interface":"back","average":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"min":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":1.0449999999999999,"5min":1.0449999999999999,"15min":1.0449999999999999},"last":0.876},{"interface":"front","average":{"1min":0.79300000000000004,"5min":0.79300000000000004,"15min":0.79300000000000004},"min":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"max":{"1min":1.1299999999999999,"5min":1.1299999999999999,"15min":1.1299999999999999},"last":0.84599999999999997}]},{"osd":4,"last update":"Tue Nov 28 19:59:54 2023","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":1.018,"5min":1.018,"15min":1.018},"last":0.51500000000000001},{"interface":"front","average":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"min":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.1120000000000001,"5min":1.1120000000000001,"15min":1.1120000000000001},"last":0.56599999999999995}]},{"osd":5,"last update":"Tue Nov 28 19:59:54 2023","interfaces":[{"interface":"back","average":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":1.1699999999999999,"5min":1.1699999999999999,"15min":1.1699999999999999},"last":0.46000000000000002},{"interface":"front","average":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"min":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":1.1890000000000001,"5min":1.1890000000000001,"15min":1.1890000000000001},"last":0.57999999999999996}]},{"osd":6,"last update":"Tue Nov 28 19:59:54 2023","interfaces":[{"interface":"back","average":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.78200000000000003},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":1.1379999999999999,"5min":1.1379999999999999,"15min":1.1379999999999999},"last":0.63700000000000001},{"interface":"front","average":{"1min":0.747,"5min":0.747,"15min":0.747},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.23,"5min":1.23,"15min":1.23},"last":0.64700000000000002}]}]},{"osd":6,"up_from":13,"seq":55834574866,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27436,"kb_used_data":416,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344404,"statfs":{"total":96636764160,"available":96608669696,"internally_reserved":0,"allocated":425984,"data_stored":178472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 19:59:53 2023","interfaces":[{"interface":"back","average":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.61599999999999999},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.82599999999999996,"5min":0.82599999999999996,"15min":0.82599999999999996},"last":0.58899999999999997},{"interface":"front","average":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":0.98999999999999999,"5min":0.98999999999999999,"15min":0.98999999999999999},"last":0.78700000000000003}]},{"osd":1,"last update":"Tue Nov 28 19:59:53 2023","interfaces":[{"interface":"back","average":{"1min":0.79100000000000004,"5min":0.79100000000000004,"15min":0.79100000000000004},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.105,"5min":1.105,"15min":1.105},"last":0.75900000000000001},{"interface":"front","average":{"1min":0.68700000000000006,"5min":0.68700000000000006,"15min":0.68700000000000006},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.95899999999999996,"5min":0.95899999999999996,"15min":0.95899999999999996},"last":0.67400000000000004}]},{"osd":2,"last update":"Tue Nov 28 19:59:53 2023","interfaces":[{"interface":"back","average":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"min":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":0.93400000000000005,"5min":0.93400000000000005,"15min":0.93400000000000005},"last":0.71899999999999997},{"interface":"front","average":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"min":{"1min":0.505,"5min":0.505,"15min":0.505},"max":{"1min":1.006,"5min":1.006,"15min":1.006},"last":0.77600000000000002}]},{"osd":3,"last update":"Tue Nov 28 19:59:53 2023","interfaces":[{"interface":"back","average":{"1min":0.749,"5min":0.749,"15min":0.749},"min":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"max":{"1min":1.056,"5min":1.056,"15min":1.056},"last":0.68999999999999995},{"interface":"front","average":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":0.88900000000000001,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.65700000000000003}]},{"osd":4,"last update":"Tue Nov 28 19:59:53 2023","interfaces":[{"interface":"back","average":{"1min":0.63100000000000001,"5min":0.63100000000000001,"15min":0.63100000000000001},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":0.96999999999999997,"5min":0.96999999999999997,"15min":0.96999999999999997},"last":0.626},{"interface":"front","average":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":1.389,"5min":1.389,"15min":1.389},"last":0.42399999999999999}]},{"osd":5,"last update":"Tue Nov 28 19:59:53 2023","interfaces":[{"interface":"back","average":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":0.81699999999999995},"min":{"1min":0.5,"5min":0.5,"15min":0.5},"max":{"1min":1.4259999999999999,"5min":1.4259999999999999,"15min":1.4259999999999999},"last":0.47599999999999998},{"interface":"front","average":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"min":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":1.276,"5min":1.276,"15min":1.276},"last":0.56799999999999995}]},{"osd":7,"last update":"Tue Nov 28 19:59:53 2023","interfaces":[{"interface":"back","average":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.71499999999999997},"min":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":0.97599999999999998,"5min":0.97599999999999998,"15min":0.97599999999999998},"last":0.60699999999999998},{"interface":"front","average":{"1min":0.82999999999999996,"5min":0.82999999999999996,"15min":0.82999999999999996},"min":{"1min":0.65600000000000003,"5min":0.65600000000000003,"15min":0.65600000000000003},"max":{"1min":1.242,"5min":1.242,"15min":1.242},"last":0.73899999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574868,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27436,"kb_used_data":416,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344404,"statfs":{"total":96636764160,"available":96608669696,"internally_reserved":0,"allocated":425984,"data_stored":178472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 19:59:53 2023","interfaces":[{"interface":"back","average":{"1min":0.70999999999999996,"5min":0.70999999999999996,"15min":0.70999999999999996},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":0.997,"5min":0.997,"15min":0.997},"last":0.71399999999999997},{"interface":"front","average":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"min":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":1.149,"5min":1.149,"15min":1.149},"last":0.70199999999999996}]},{"osd":1,"last update":"Tue Nov 28 19:59:53 2023","interfaces":[{"interface":"back","average":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":0.92700000000000005,"5min":0.92700000000000005,"15min":0.92700000000000005},"last":0.68999999999999995},{"interface":"front","average":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":1.0940000000000001,"5min":1.0940000000000001,"15min":1.0940000000000001},"last":0.64700000000000002}]},{"osd":2,"last update":"Tue Nov 28 19:59:53 2023","interfaces":[{"interface":"back","average":{"1min":0.94599999999999995,"5min":0.94599999999999995,"15min":0.94599999999999995},"min":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":5.0880000000000001,"5min":5.0880000000000001,"15min":5.0880000000000001},"last":0.67200000000000004},{"interface":"front","average":{"1min":1.002,"5min":1.002,"15min":1.002},"min":{"1min":0.504,"5min":0.504,"15min":0.504},"max":{"1min":5.1399999999999997,"5min":5.1399999999999997,"15min":5.1399999999999997},"last":0.63600000000000001}]},{"osd":3,"last update":"Tue Nov 28 19:59:53 2023","interfaces":[{"interface":"back","average":{"1min":1.028,"5min":1.028,"15min":1.028},"min":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"max":{"1min":5.0469999999999997,"5min":5.0469999999999997,"15min":5.0469999999999997},"last":0.77500000000000002},{"interface":"front","average":{"1min":1.0009999999999999,"5min":1.0009999999999999,"15min":1.0009999999999999},"min":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":5.024,"5min":5.024,"15min":5.024},"last":0.60099999999999998}]},{"osd":4,"last update":"Tue Nov 28 19:59:53 2023","interfaces":[{"interface":"back","average":{"1min":0.67700000000000005,"5min":0.67700000000000005,"15min":0.67700000000000005},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":1.4810000000000001,"5min":1.4810000000000001,"15min":1.4810000000000001},"last":0.53400000000000003},{"interface":"front","average":{"1min":0.747,"5min":0.747,"15min":0.747},"min":{"1min":0.5,"5min":0.5,"15min":0.5},"max":{"1min":1.6339999999999999,"5min":1.6339999999999999,"15min":1.6339999999999999},"last":0.61599999999999999}]},{"osd":6,"last update":"Tue Nov 28 19:59:53 2023","interfaces":[{"interface":"back","average":{"1min":0.70699999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":0.97699999999999998,"5min":0.97699999999999998,"15min":0.97699999999999998},"last":0.55700000000000005},{"interface":"front","average":{"1min":0.748,"5min":0.748,"15min":0.748},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":1.099,"5min":1.099,"15min":1.099},"last":0.58599999999999997}]},{"osd":7,"last update":"Tue Nov 28 19:59:53 2023","interfaces":[{"interface":"back","average":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"min":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":1.236,"5min":1.236,"15min":1.236},"last":0.748},{"interface":"front","average":{"1min":0.80100000000000005,"5min":0.80100000000000005,"15min":0.80100000000000005},"min":{"1min":0.505,"5min":0.505,"15min":0.505},"max":{"1min":1.0760000000000001,"5min":1.0760000000000001,"15min":1.0760000000000001},"last":0.73199999999999998}]}]},{"osd":4,"up_from":13,"seq":55834574867,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27436,"kb_used_data":416,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344404,"statfs":{"total":96636764160,"available":96608669696,"internally_reserved":0,"allocated":425984,"data_stored":178472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 19:59:54 2023","interfaces":[{"interface":"back","average":{"1min":0.71099999999999997,"5min":0.71099999999999997,"15min":0.71099999999999997},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":1.0429999999999999,"5min":1.0429999999999999,"15min":1.0429999999999999},"last":0.71899999999999997},{"interface":"front","average":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":1.163,"5min":1.163,"15min":1.163},"last":0.59999999999999998}]},{"osd":1,"last update":"Tue Nov 28 19:59:54 2023","interfaces":[{"interface":"back","average":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"min":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":1.111,"5min":1.111,"15min":1.111},"last":0.74399999999999999},{"interface":"front","average":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"min":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":1.238,"5min":1.238,"15min":1.238},"last":0.79800000000000004}]},{"osd":2,"last update":"Tue Nov 28 19:59:54 2023","interfaces":[{"interface":"back","average":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":0.78300000000000003},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":1.0669999999999999,"5min":1.0669999999999999,"15min":1.0669999999999999},"last":0.66100000000000003},{"interface":"front","average":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":0.81699999999999995},"min":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":1.1180000000000001,"5min":1.1180000000000001,"15min":1.1180000000000001},"last":0.67600000000000005}]},{"osd":3,"last update":"Tue Nov 28 19:59:54 2023","interfaces":[{"interface":"back","average":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"min":{"1min":0.499,"5min":0.499,"15min":0.499},"max":{"1min":1.202,"5min":1.202,"15min":1.202},"last":0.64600000000000002},{"interface":"front","average":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"min":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":1.0589999999999999,"5min":1.0589999999999999,"15min":1.0589999999999999},"last":0.77900000000000003}]},{"osd":5,"last update":"Tue Nov 28 19:59:54 2023","interfaces":[{"interface":"back","average":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":0.95899999999999996,"5min":0.95899999999999996,"15min":0.95899999999999996},"last":0.623},{"interface":"front","average":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":1.034,"5min":1.034,"15min":1.034},"last":0.54400000000000004}]},{"osd":6,"last update":"Tue Nov 28 19:59:54 2023","interfaces":[{"interface":"back","average":{"1min":0.73499999999999999,"5min":0.73499999999999999,"15min":0.73499999999999999},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":1.0309999999999999,"5min":1.0309999999999999,"15min":1.0309999999999999},"last":0.57699999999999996},{"interface":"front","average":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":1.002,"5min":1.002,"15min":1.002},"last":0.76400000000000001}]},{"osd":7,"last update":"Tue Nov 28 19:59:54 2023","interfaces":[{"interface":"back","average":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"min":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":1.0620000000000001,"5min":1.0620000000000001,"15min":1.0620000000000001},"last":0.69399999999999995},{"interface":"front","average":{"1min":0.87,"5min":0.87,"15min":0.87},"min":{"1min":0.627,"5min":0.627,"15min":0.627},"max":{"1min":1.1459999999999999,"5min":1.1459999999999999,"15min":1.1459999999999999},"last":0.70399999999999996}]}]},{"osd":3,"up_from":13,"seq":55834574868,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27436,"kb_used_data":416,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344404,"statfs":{"total":96636764160,"available":96608669696,"internally_reserved":0,"allocated":425984,"data_stored":178472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 19:59:52 2023","interfaces":[{"interface":"back","average":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.70199999999999996},"last":0.45300000000000001},{"interface":"front","average":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"min":{"1min":0.312,"5min":0.312,"15min":0.312},"max":{"1min":0.82599999999999996,"5min":0.82599999999999996,"15min":0.82599999999999996},"last":0.32000000000000001}]},{"osd":1,"last update":"Tue Nov 28 19:59:52 2023","interfaces":[{"interface":"back","average":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.84399999999999997,"5min":0.84399999999999997,"15min":0.84399999999999997},"last":0.35899999999999999},{"interface":"front","average":{"1min":0.505,"5min":0.505,"15min":0.505},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.86099999999999999,"5min":0.86099999999999999,"15min":0.86099999999999999},"last":0.29199999999999998}]},{"osd":2,"last update":"Tue Nov 28 19:59:52 2023","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.85599999999999998,"5min":0.85599999999999998,"15min":0.85599999999999998},"last":0.46700000000000003},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.83699999999999997,"5min":0.83699999999999997,"15min":0.83699999999999997},"last":0.55900000000000005}]},{"osd":4,"last update":"Tue Nov 28 19:59:52 2023","interfaces":[{"interface":"back","average":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":1.206,"5min":1.206,"15min":1.206},"last":0.63500000000000001},{"interface":"front","average":{"1min":0.80300000000000005,"5min":0.80300000000000005,"15min":0.80300000000000005},"min":{"1min":0.503,"5min":0.503,"15min":0.503},"max":{"1min":1.222,"5min":1.222,"15min":1.222},"last":0.92700000000000005}]},{"osd":5,"last update":"Tue Nov 28 19:59:52 2023","interfaces":[{"interface":"back","average":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"min":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":1.151,"5min":1.151,"15min":1.151},"last":0.97499999999999998},{"interface":"front","average":{"1min":0.80300000000000005,"5min":0.80300000000000005,"15min":0.80300000000000005},"min":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":1.3100000000000001,"5min":1.3100000000000001,"15min":1.3100000000000001},"last":0.495}]},{"osd":6,"last update":"Tue Nov 28 19:59:52 2023","interfaces":[{"interface":"back","average":{"1min":0.84399999999999997,"5min":0.84399999999999997,"15min":0.84399999999999997},"min":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":1.361,"5min":1.361,"15min":1.361},"last":1.544},{"interface":"front","average":{"1min":0.749,"5min":0.749,"15min":0.749},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.125,"5min":1.125,"15min":1.125},"last":4.0679999999999996}]},{"osd":7,"last update":"Tue Nov 28 19:59:52 2023","interfaces":[{"interface":"back","average":{"1min":0.84999999999999998,"5min":0.84999999999999998,"15min":0.84999999999999998},"min":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"max":{"1min":1.2569999999999999,"5min":1.2569999999999999,"15min":1.2569999999999999},"last":4.0019999999999998},{"interface":"front","average":{"1min":0.89100000000000001,"5min":0.89100000000000001,"15min":0.89100000000000001},"min":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"max":{"1min":1.339,"5min":1.339,"15min":1.339},"last":1.1830000000000001}]}]},{"osd":2,"up_from":13,"seq":55834574866,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27436,"kb_used_data":416,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344404,"statfs":{"total":96636764160,"available":96608669696,"internally_reserved":0,"allocated":425984,"data_stored":178472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 19:59:54 2023","interfaces":[{"interface":"back","average":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"min":{"1min":0.26400000000000001,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"last":0.503},{"interface":"front","average":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.67700000000000005,"5min":0.67700000000000005,"15min":0.67700000000000005},"last":0.27900000000000003}]},{"osd":1,"last update":"Tue Nov 28 19:59:54 2023","interfaces":[{"interface":"back","average":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"min":{"1min":0.29899999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":1.0389999999999999,"5min":1.0389999999999999,"15min":1.0389999999999999},"last":0.38700000000000001},{"interface":"front","average":{"1min":0.505,"5min":0.505,"15min":0.505},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.70999999999999996,"5min":0.70999999999999996,"15min":0.70999999999999996},"last":0.32700000000000001}]},{"osd":3,"last update":"Tue Nov 28 19:59:54 2023","interfaces":[{"interface":"back","average":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"min":{"1min":0.28199999999999997,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.629,"5min":0.629,"15min":0.629},"last":0.36699999999999999},{"interface":"front","average":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.98499999999999999,"5min":0.98499999999999999,"15min":0.98499999999999999},"last":0.42799999999999999}]},{"osd":4,"last update":"Tue Nov 28 19:59:54 2023","interfaces":[{"interface":"back","average":{"1min":0.86199999999999999,"5min":0.86199999999999999,"15min":0.86199999999999999},"min":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"max":{"1min":1.139,"5min":1.139,"15min":1.139},"last":0.61099999999999999},{"interface":"front","average":{"1min":0.85299999999999998,"5min":0.85299999999999998,"15min":0.85299999999999998},"min":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":1.238,"5min":1.238,"15min":1.238},"last":0.629}]},{"osd":5,"last update":"Tue Nov 28 19:59:54 2023","interfaces":[{"interface":"back","average":{"1min":0.88500000000000001,"5min":0.88500000000000001,"15min":0.88500000000000001},"min":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":1.6180000000000001,"5min":1.6180000000000001,"15min":1.6180000000000001},"last":0.55100000000000005},{"interface":"front","average":{"1min":0.83499999999999996,"5min":0.83499999999999996,"15min":0.83499999999999996},"min":{"1min":0.496,"5min":0.496,"15min":0.496},"max":{"1min":1.339,"5min":1.339,"15min":1.339},"last":0.52200000000000002}]},{"osd":6,"last update":"Tue Nov 28 19:59:54 2023","interfaces":[{"interface":"back","average":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":0.80600000000000005},"min":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1.1839999999999999,"5min":1.1839999999999999,"15min":1.1839999999999999},"last":0.59699999999999998},{"interface":"front","average":{"1min":0.86199999999999999,"5min":0.86199999999999999,"15min":0.86199999999999999},"min":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":1.099,"5min":1.099,"15min":1.099},"last":0.56699999999999995}]},{"osd":7,"last update":"Tue Nov 28 19:59:54 2023","interfaces":[{"interface":"back","average":{"1min":0.89000000000000001,"5min":0.89000000000000001,"15min":0.89000000000000001},"min":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":1.4590000000000001,"5min":1.4590000000000001,"15min":1.4590000000000001},"last":0.58299999999999996},{"interface":"front","average":{"1min":0.86699999999999999,"5min":0.86699999999999999,"15min":0.86699999999999999},"min":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":1.387,"5min":1.387,"15min":1.387},"last":0.48799999999999999}]}]},{"osd":1,"up_from":13,"seq":55834574868,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27436,"kb_used_data":416,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344404,"statfs":{"total":96636764160,"available":96608669696,"internally_reserved":0,"allocated":425984,"data_stored":178472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 19:59:53 2023","interfaces":[{"interface":"back","average":{"1min":0.65800000000000003,"5min":0.65800000000000003,"15min":0.65800000000000003},"min":{"1min":0.31,"5min":0.31,"15min":0.31},"max":{"1min":3.8740000000000001,"5min":3.8740000000000001,"15min":3.8740000000000001},"last":0.28799999999999998},{"interface":"front","average":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"min":{"1min":0.25,"5min":0.25,"15min":0.25},"max":{"1min":2.0760000000000001,"5min":2.0760000000000001,"15min":2.0760000000000001},"last":0.38300000000000001}]},{"osd":2,"last update":"Tue Nov 28 19:59:53 2023","interfaces":[{"interface":"back","average":{"1min":0.65900000000000003,"5min":0.65900000000000003,"15min":0.65900000000000003},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":3.7320000000000002,"5min":3.7320000000000002,"15min":3.7320000000000002},"last":0.41999999999999998},{"interface":"front","average":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":3.9089999999999998,"5min":3.9089999999999998,"15min":3.9089999999999998},"last":0.35499999999999998}]},{"osd":3,"last update":"Tue Nov 28 19:59:53 2023","interfaces":[{"interface":"back","average":{"1min":0.68100000000000005,"5min":0.68100000000000005,"15min":0.68100000000000005},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":1.6399999999999999,"5min":1.6399999999999999,"15min":1.6399999999999999},"last":0.48899999999999999},{"interface":"front","average":{"1min":0.70299999999999996,"5min":0.70299999999999996,"15min":0.70299999999999996},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":2.5270000000000001,"5min":2.5270000000000001,"15min":2.5270000000000001},"last":0.443}]},{"osd":4,"last update":"Tue Nov 28 19:59:53 2023","interfaces":[{"interface":"back","average":{"1min":0.89500000000000002,"5min":0.89500000000000002,"15min":0.89500000000000002},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":3.1659999999999999,"5min":3.1659999999999999,"15min":3.1659999999999999},"last":0.64100000000000001},{"interface":"front","average":{"1min":0.94599999999999995,"5min":0.94599999999999995,"15min":0.94599999999999995},"min":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":3.7959999999999998,"5min":3.7959999999999998,"15min":3.7959999999999998},"last":0.54100000000000004}]},{"osd":5,"last update":"Tue Nov 28 19:59:53 2023","interfaces":[{"interface":"back","average":{"1min":0.98899999999999999,"5min":0.98899999999999999,"15min":0.98899999999999999},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":4.1479999999999997,"5min":4.1479999999999997,"15min":4.1479999999999997},"last":0.65700000000000003},{"interface":"front","average":{"1min":0.91000000000000003,"5min":0.91000000000000003,"15min":0.91000000000000003},"min":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":3.5569999999999999,"5min":3.5569999999999999,"15min":3.5569999999999999},"last":0.5}]},{"osd":6,"last update":"Tue Nov 28 19:59:53 2023","interfaces":[{"interface":"back","average":{"1min":0.99199999999999999,"5min":0.99199999999999999,"15min":0.99199999999999999},"min":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":2.863,"5min":2.863,"15min":2.863},"last":0.68500000000000005},{"interface":"front","average":{"1min":0.98299999999999998,"5min":0.98299999999999998,"15min":0.98299999999999998},"min":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"max":{"1min":3.371,"5min":3.371,"15min":3.371},"last":0.60099999999999998}]},{"osd":7,"last update":"Tue Nov 28 19:59:53 2023","interfaces":[{"interface":"back","average":{"1min":1.0129999999999999,"5min":1.0129999999999999,"15min":1.0129999999999999},"min":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"max":{"1min":3.8439999999999999,"5min":3.8439999999999999,"15min":3.8439999999999999},"last":0.624},{"interface":"front","average":{"1min":1.038,"5min":1.038,"15min":1.038},"min":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"max":{"1min":3.9689999999999999,"5min":3.9689999999999999,"15min":3.9689999999999999},"last":0.53000000000000003}]}]},{"osd":0,"up_from":13,"seq":55834574867,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27500,"kb_used_data":480,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344340,"statfs":{"total":96636764160,"available":96608604160,"internally_reserved":0,"allocated":491520,"data_stored":768840,"data_compressed":33374,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Nov 28 19:59:56 2023","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.68999999999999995,"15min":0.68999999999999995},"min":{"1min":0.29899999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":4.883,"5min":4.883,"15min":4.883},"last":0.27400000000000002},{"interface":"front","average":{"1min":0.878,"5min":0.878,"15min":0.878},"min":{"1min":0.29399999999999998,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":8.0800000000000001,"5min":8.0800000000000001,"15min":8.0800000000000001},"last":0.41699999999999998}]},{"osd":2,"last update":"Tue Nov 28 19:59:56 2023","interfaces":[{"interface":"back","average":{"1min":0.97399999999999998,"5min":0.97399999999999998,"15min":0.97399999999999998},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":8.1029999999999998,"5min":8.1029999999999998,"15min":8.1029999999999998},"last":0.46000000000000002},{"interface":"front","average":{"1min":0.98699999999999999,"5min":0.98699999999999999,"15min":0.98699999999999999},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":8.1310000000000002,"5min":8.1310000000000002,"15min":8.1310000000000002},"last":0.5}]},{"osd":3,"last update":"Tue Nov 28 19:59:56 2023","interfaces":[{"interface":"back","average":{"1min":0.747,"5min":0.747,"15min":0.747},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":4.3949999999999996,"5min":4.3949999999999996,"15min":4.3949999999999996},"last":0.441},{"interface":"front","average":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":4.3470000000000004,"5min":4.3470000000000004,"15min":4.3470000000000004},"last":0.51900000000000002}]},{"osd":4,"last update":"Tue Nov 28 19:59:56 2023","interfaces":[{"interface":"back","average":{"1min":1.0509999999999999,"5min":1.0509999999999999,"15min":1.0509999999999999},"min":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"max":{"1min":4.6360000000000001,"5min":4.6360000000000001,"15min":4.6360000000000001},"last":0.54100000000000004},{"interface":"front","average":{"1min":1.0529999999999999,"5min":1.0529999999999999,"15min":1.0529999999999999},"min":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":4.4710000000000001,"5min":4.4710000000000001,"15min":4.4710000000000001},"last":0.59899999999999998}]},{"osd":5,"last update":"Tue Nov 28 19:59:56 2023","interfaces":[{"interface":"back","average":{"1min":1.0649999999999999,"5min":1.0649999999999999,"15min":1.0649999999999999},"min":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":4.6120000000000001,"5min":4.6120000000000001,"15min":4.6120000000000001},"last":0.65400000000000003},{"interface":"front","average":{"1min":1.052,"5min":1.052,"15min":1.052},"min":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"max":{"1min":4.5449999999999999,"5min":4.5449999999999999,"15min":4.5449999999999999},"last":0.58999999999999997}]},{"osd":6,"last update":"Tue Nov 28 19:59:56 2023","interfaces":[{"interface":"back","average":{"1min":1.079,"5min":1.079,"15min":1.079},"min":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":4.657,"5min":4.657,"15min":4.657},"last":0.64500000000000002},{"interface":"front","average":{"1min":1.097,"5min":1.097,"15min":1.097},"min":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"max":{"1min":4.5259999999999998,"5min":4.5259999999999998,"15min":4.5259999999999998},"last":0.61599999999999999}]},{"osd":7,"last update":"Tue Nov 28 19:59:56 2023","interfaces":[{"interface":"back","average":{"1min":1.101,"5min":1.101,"15min":1.101},"min":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.60099999999999998},"max":{"1min":4.7320000000000002,"5min":4.7320000000000002,"15min":4.7320000000000002},"last":0.57199999999999995},{"interface":"front","average":{"1min":1.046,"5min":1.046,"15min":1.046},"min":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":4.4939999999999998,"5min":4.4939999999999998,"15min":4.4939999999999998},"last":0.67000000000000004}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33374,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33374,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-28T20:00:22.363 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-28T20:00:22.509 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:22.506+0000 7fb91ac9b640 1 Processor -- start 2023-11-28T20:00:22.509 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:22.506+0000 7fb91ac9b640 1 -- start start 2023-11-28T20:00:22.512 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:22.506+0000 7fb91ac9b640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fb9140c8200 0x7fb9140c69d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:22.512 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:22.506+0000 7fb91ac9b640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb9140c9210 0x7fb91415ecf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:22.512 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:22.506+0000 7fb91ac9b640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb914151f20 con 0x7fb9140c65f0 2023-11-28T20:00:22.512 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:22.506+0000 7fb91ac9b640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb914154450 con 0x7fb9140c8200 2023-11-28T20:00:22.512 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:22.506+0000 7fb91ac9b640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb914154710 con 0x7fb9140c9210 2023-11-28T20:00:22.513 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:22.506+0000 7fb919c99640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7fb9140c65f0 0x7fb9140c8b00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:56522/0 (socket says 172.21.15.78:56522) 2023-11-28T20:00:22.513 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:22.506+0000 7fb919c99640 1 -- 172.21.15.78:0/149572327 learned_addr learned my addr 172.21.15.78:0/149572327 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-11-28T20:00:22.513 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:22.506+0000 7fb91a49a640 1 --2- 172.21.15.78:0/149572327 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb9140c9210 0x7fb91415ecf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:22.513 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:22.506+0000 7fb919498640 1 --2- 172.21.15.78:0/149572327 >> v2:172.21.15.179:3300/0 conn(0x7fb9140c8200 0x7fb9140c69d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:22.513 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:22.506+0000 7fb918c97640 1 -- 172.21.15.78:0/149572327 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 673733838 0 0) 0x7fb914151f20 con 0x7fb9140c65f0 2023-11-28T20:00:22.513 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:22.506+0000 7fb918c97640 1 -- 172.21.15.78:0/149572327 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb900003530 con 0x7fb9140c65f0 2023-11-28T20:00:22.513 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:22.506+0000 7fb918c97640 1 -- 172.21.15.78:0/149572327 <== mon.0 v1:172.21.15.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4107463224 0 0) 0x7fb900003530 con 0x7fb9140c65f0 2023-11-28T20:00:22.513 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:22.506+0000 7fb918c97640 1 -- 172.21.15.78:0/149572327 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb9140c9210 msgr2=0x7fb91415ecf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:00:22.513 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:22.506+0000 7fb918c97640 1 --2- 172.21.15.78:0/149572327 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb9140c9210 0x7fb91415ecf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:22.513 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:22.506+0000 7fb918c97640 1 -- 172.21.15.78:0/149572327 >> v2:172.21.15.179:3300/0 conn(0x7fb9140c8200 msgr2=0x7fb9140c69d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:00:22.513 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:22.506+0000 7fb918c97640 1 --2- 172.21.15.78:0/149572327 >> v2:172.21.15.179:3300/0 conn(0x7fb9140c8200 0x7fb9140c69d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:22.514 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:22.506+0000 7fb918c97640 1 -- 172.21.15.78:0/149572327 --> v1:172.21.15.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9141549f0 con 0x7fb9140c65f0 2023-11-28T20:00:22.514 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:22.506+0000 7fb918c97640 1 -- 172.21.15.78:0/149572327 <== mon.0 v1:172.21.15.78:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3326804700 0 0) 0x7fb910001680 con 0x7fb9140c65f0 2023-11-28T20:00:22.514 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:22.506+0000 7fb918c97640 1 -- 172.21.15.78:0/149572327 >> v1:172.21.15.78:6789/0 conn(0x7fb9140c65f0 legacy=0x7fb9140c8b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:00:22.514 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:22.506+0000 7fb918c97640 1 --2- 172.21.15.78:0/149572327 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb900003980 0x7fb900003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:22.514 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:22.506+0000 7fb918c97640 1 --2- 172.21.15.78:0/149572327 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb9000047d0 0x7fb900004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:22.514 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:22.506+0000 7fb918c97640 1 --2- 172.21.15.78:0/149572327 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb9140c9210 0x7fb900005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:22.514 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:22.510+0000 7fb918c97640 1 -- 172.21.15.78:0/149572327 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb914154450 con 0x7fb9000047d0 2023-11-28T20:00:22.514 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:22.510+0000 7fb918c97640 1 -- 172.21.15.78:0/149572327 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb914154710 con 0x7fb900003980 2023-11-28T20:00:22.514 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:22.510+0000 7fb918c97640 1 -- 172.21.15.78:0/149572327 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb90000b9c0 con 0x7fb9140c9210 2023-11-28T20:00:22.514 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:22.510+0000 7fb919498640 1 --2- 172.21.15.78:0/149572327 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb9000047d0 0x7fb900004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:22.514 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:22.510+0000 7fb919c99640 1 --2- 172.21.15.78:0/149572327 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb900003980 0x7fb900003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:22.514 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:22.510+0000 7fb91a49a640 1 --2- 172.21.15.78:0/149572327 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb9140c9210 0x7fb900005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:22.515 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:22.510+0000 7fb919498640 1 -- 172.21.15.78:0/149572327 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb9140c9210 msgr2=0x7fb900005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:00:22.515 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:22.510+0000 7fb919498640 1 --2- 172.21.15.78:0/149572327 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb9140c9210 0x7fb900005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:22.515 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:22.510+0000 7fb919498640 1 -- 172.21.15.78:0/149572327 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb900003980 msgr2=0x7fb900003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:00:22.515 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:22.510+0000 7fb919498640 1 --2- 172.21.15.78:0/149572327 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb900003980 0x7fb900003da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:22.515 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:22.510+0000 7fb919498640 1 -- 172.21.15.78:0/149572327 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb900003530 con 0x7fb9000047d0 2023-11-28T20:00:22.516 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:22.510+0000 7fb919498640 1 --2- 172.21.15.78:0/149572327 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb9000047d0 0x7fb900004c50 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7fb904009ab0 tx=0x7fb90401c9e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=39dfcc08401a129f server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:00:22.516 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:22.510+0000 7fb918c97640 1 -- 172.21.15.78:0/149572327 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9040a5530 con 0x7fb9000047d0 2023-11-28T20:00:22.516 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:22.510+0000 7fb918c97640 1 -- 172.21.15.78:0/149572327 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb9040a5690 con 0x7fb9000047d0 2023-11-28T20:00:22.516 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:22.510+0000 7fb918c97640 1 -- 172.21.15.78:0/149572327 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9040a5a00 con 0x7fb9000047d0 2023-11-28T20:00:22.516 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:22.514+0000 7fb91ac9b640 1 -- 172.21.15.78:0/149572327 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb9000047d0 msgr2=0x7fb900004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:00:22.516 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:22.514+0000 7fb91ac9b640 1 --2- 172.21.15.78:0/149572327 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb9000047d0 0x7fb900004c50 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7fb904009ab0 tx=0x7fb90401c9e0 comp rx=0 tx=0).stop 2023-11-28T20:00:22.516 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:22.514+0000 7fb91a49a640 1 -- 172.21.15.78:0/149572327 reap_dead start 2023-11-28T20:00:22.516 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:22.514+0000 7fb91ac9b640 1 -- 172.21.15.78:0/149572327 shutdown_connections 2023-11-28T20:00:22.517 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:22.514+0000 7fb91ac9b640 1 -- 172.21.15.78:0/149572327 >> 172.21.15.78:0/149572327 conn(0x7fb9140ab730 msgr2=0x7fb9140abb40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:00:22.517 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:22.514+0000 7fb91ac9b640 1 -- 172.21.15.78:0/149572327 shutdown_connections 2023-11-28T20:00:22.517 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:22.514+0000 7fb91ac9b640 1 -- 172.21.15.78:0/149572327 wait complete. 2023-11-28T20:00:22.518 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:22.514+0000 7fb91ac9b640 1 Processor -- start 2023-11-28T20:00:22.518 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:22.514+0000 7fb91ac9b640 1 -- start start 2023-11-28T20:00:22.519 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:22.514+0000 7fb91ac9b640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb9000047d0 0x7fb914150e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:22.519 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:22.514+0000 7fb91ac9b640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb9141efee0 0x7fb914144b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:22.519 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:22.514+0000 7fb91ac9b640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb9141450c0 0x7fb914155e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:22.519 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:22.514+0000 7fb91ac9b640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb91415abf0 con 0x7fb9000047d0 2023-11-28T20:00:22.519 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:22.514+0000 7fb91ac9b640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb91415aed0 con 0x7fb9141efee0 2023-11-28T20:00:22.519 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:22.514+0000 7fb91ac9b640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb91415b1b0 con 0x7fb9141450c0 2023-11-28T20:00:22.519 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:22.514+0000 7fb919c99640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb9000047d0 0x7fb914150e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:22.520 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:22.514+0000 7fb919c99640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb9000047d0 0x7fb914150e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:52226/0 (socket says 172.21.15.78:52226) 2023-11-28T20:00:22.520 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:22.514+0000 7fb919c99640 1 -- 172.21.15.78:0/1098280437 learned_addr learned my addr 172.21.15.78:0/1098280437 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T20:00:22.521 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:22.514+0000 7fb919c99640 1 -- 172.21.15.78:0/1098280437 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb9141450c0 msgr2=0x7fb914155e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:00:22.521 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:22.514+0000 7fb919c99640 1 --2- 172.21.15.78:0/1098280437 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb9141450c0 0x7fb914155e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:22.521 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:22.514+0000 7fb919c99640 1 -- 172.21.15.78:0/1098280437 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb9141efee0 msgr2=0x7fb914144b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:00:22.521 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:22.514+0000 7fb919c99640 1 --2- 172.21.15.78:0/1098280437 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb9141efee0 0x7fb914144b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:22.521 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:22.514+0000 7fb919c99640 1 -- 172.21.15.78:0/1098280437 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb91415b490 con 0x7fb9000047d0 2023-11-28T20:00:22.521 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:22.518+0000 7fb919c99640 1 --2- 172.21.15.78:0/1098280437 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb9000047d0 0x7fb914150e80 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7fb910004f80 tx=0x7fb9100074f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:00:22.521 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:22.518+0000 7fb90a7fc640 1 -- 172.21.15.78:0/1098280437 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb910007740 con 0x7fb9000047d0 2023-11-28T20:00:22.521 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:22.518+0000 7fb90a7fc640 1 -- 172.21.15.78:0/1098280437 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb91000f940 con 0x7fb9000047d0 2023-11-28T20:00:22.521 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:22.518+0000 7fb90a7fc640 1 -- 172.21.15.78:0/1098280437 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb91000fcf0 con 0x7fb9000047d0 2023-11-28T20:00:22.521 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:22.518+0000 7fb91ac9b640 1 -- 172.21.15.78:0/1098280437 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb91415b770 con 0x7fb9000047d0 2023-11-28T20:00:22.522 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:22.518+0000 7fb91ac9b640 1 -- 172.21.15.78:0/1098280437 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb914155830 con 0x7fb9000047d0 2023-11-28T20:00:22.522 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:22.518+0000 7fb91ac9b640 1 -- 172.21.15.78:0/1098280437 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb9140674b0 con 0x7fb9000047d0 2023-11-28T20:00:22.522 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:22.518+0000 7fb90a7fc640 1 -- 172.21.15.78:0/1098280437 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fb91001d460 con 0x7fb9000047d0 2023-11-28T20:00:22.523 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:22.518+0000 7fb90a7fc640 1 --2- 172.21.15.78:0/1098280437 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fb8f80664a0 0x7fb8f8068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:22.523 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:22.518+0000 7fb90a7fc640 1 -- 172.21.15.78:0/1098280437 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6029+0+0 (secure 0 0 0) 0x7fb9100840c0 con 0x7fb9000047d0 2023-11-28T20:00:22.523 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:22.518+0000 7fb919498640 1 --2- 172.21.15.78:0/1098280437 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fb8f80664a0 0x7fb8f8068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:22.524 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:22.521+0000 7fb919498640 1 --2- 172.21.15.78:0/1098280437 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fb8f80664a0 0x7fb8f8068960 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fb9040af000 tx=0x7fb904004740 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:00:22.527 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:22.521+0000 7fb90a7fc640 1 -- 172.21.15.78:0/1098280437 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fb910051410 con 0x7fb9000047d0 2023-11-28T20:00:22.673 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:22.669+0000 7fb91ac9b640 1 -- 172.21.15.78:0/1098280437 --> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fb91406c650 con 0x7fb8f80664a0 2023-11-28T20:00:22.681 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:22.677+0000 7fb90a7fc640 1 -- 172.21.15.78:0/1098280437 <== mgr.4106 v2:172.21.15.78:6832/2935380957 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+288629 (secure 0 0 0) 0x7fb91406c650 con 0x7fb8f80664a0 2023-11-28T20:00:22.684 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-11-28T20:00:22.685 INFO:teuthology.orchestra.run.smithi078.stderr:dumped all 2023-11-28T20:00:22.686 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:22.681+0000 7fb91ac9b640 1 -- 172.21.15.78:0/1098280437 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fb8f80664a0 msgr2=0x7fb8f8068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:00:22.687 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:22.681+0000 7fb91ac9b640 1 --2- 172.21.15.78:0/1098280437 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fb8f80664a0 0x7fb8f8068960 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fb9040af000 tx=0x7fb904004740 comp rx=0 tx=0).stop 2023-11-28T20:00:22.687 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:22.681+0000 7fb91ac9b640 1 -- 172.21.15.78:0/1098280437 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb9000047d0 msgr2=0x7fb914150e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:00:22.687 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:22.681+0000 7fb91ac9b640 1 --2- 172.21.15.78:0/1098280437 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb9000047d0 0x7fb914150e80 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7fb910004f80 tx=0x7fb9100074f0 comp rx=0 tx=0).stop 2023-11-28T20:00:22.687 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:22.681+0000 7fb91ac9b640 1 -- 172.21.15.78:0/1098280437 shutdown_connections 2023-11-28T20:00:22.687 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:22.681+0000 7fb91ac9b640 1 --2- 172.21.15.78:0/1098280437 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fb8f80664a0 0x7fb8f8068960 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:22.687 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:22.681+0000 7fb91ac9b640 1 --2- 172.21.15.78:0/1098280437 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb9141450c0 0x7fb914155e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:22.687 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:22.681+0000 7fb91ac9b640 1 --2- 172.21.15.78:0/1098280437 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb9141efee0 0x7fb914144b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:22.687 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:22.681+0000 7fb91ac9b640 1 --2- 172.21.15.78:0/1098280437 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb9000047d0 0x7fb914150e80 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:22.687 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:22.681+0000 7fb91ac9b640 1 -- 172.21.15.78:0/1098280437 >> 172.21.15.78:0/1098280437 conn(0x7fb9140ab730 msgr2=0x7fb914153cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:00:22.687 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:22.681+0000 7fb91ac9b640 1 -- 172.21.15.78:0/1098280437 shutdown_connections 2023-11-28T20:00:22.687 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:22.681+0000 7fb91ac9b640 1 -- 172.21.15.78:0/1098280437 wait complete. 2023-11-28T20:00:22.704 INFO:teuthology.orchestra.run.smithi078.stdout:{"pg_ready":true,"pg_map":{"version":78,"stamp":"2023-11-28T20:00:21.969954+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219980,"kb_used_data":3808,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754754740,"statfs":{"total":773094113280,"available":772868853760,"internally_reserved":0,"allocated":3899392,"data_stored":2775812,"data_compressed":66748,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":46,"apply_latency_ms":46,"commit_latency_ns":46000000,"apply_latency_ns":46000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.193316"},"pg_stats":[{"pgid":"6.3f","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-11-28T20:00:14.800222+0000","last_change":"2023-11-28T20:00:13.804342+0000","last_active":"2023-11-28T20:00:14.800222+0000","last_peered":"2023-11-28T20:00:14.800222+0000","last_clean":"2023-11-28T20:00:14.800222+0000","last_became_active":"2023-11-28T20:00:13.803858+0000","last_became_peered":"2023-11-28T20:00:13.803858+0000","last_unstale":"2023-11-28T20:00:14.800222+0000","last_undegraded":"2023-11-28T20:00:14.800222+0000","last_fullsized":"2023-11-28T20:00:14.800222+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_clean_scrub_stamp":"2023-11-28T20:00:12.764355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:25:02.945127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-11-28T20:00:14.799878+0000","last_change":"2023-11-28T20:00:13.799903+0000","last_active":"2023-11-28T20:00:14.799878+0000","last_peered":"2023-11-28T20:00:14.799878+0000","last_clean":"2023-11-28T20:00:14.799878+0000","last_became_active":"2023-11-28T20:00:13.799607+0000","last_became_peered":"2023-11-28T20:00:13.799607+0000","last_unstale":"2023-11-28T20:00:14.799878+0000","last_undegraded":"2023-11-28T20:00:14.799878+0000","last_fullsized":"2023-11-28T20:00:14.799878+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_clean_scrub_stamp":"2023-11-28T20:00:12.764355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:10:57.174856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-11-28T20:00:15.001407+0000","last_change":"2023-11-28T20:00:13.810666+0000","last_active":"2023-11-28T20:00:15.001407+0000","last_peered":"2023-11-28T20:00:15.001407+0000","last_clean":"2023-11-28T20:00:15.001407+0000","last_became_active":"2023-11-28T20:00:13.810420+0000","last_became_peered":"2023-11-28T20:00:13.810420+0000","last_unstale":"2023-11-28T20:00:15.001407+0000","last_undegraded":"2023-11-28T20:00:15.001407+0000","last_fullsized":"2023-11-28T20:00:15.001407+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_clean_scrub_stamp":"2023-11-28T20:00:12.764355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T06:58:51.315382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.3c","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-11-28T20:00:15.001189+0000","last_change":"2023-11-28T20:00:13.805753+0000","last_active":"2023-11-28T20:00:15.001189+0000","last_peered":"2023-11-28T20:00:15.001189+0000","last_clean":"2023-11-28T20:00:15.001189+0000","last_became_active":"2023-11-28T20:00:13.805513+0000","last_became_peered":"2023-11-28T20:00:13.805513+0000","last_unstale":"2023-11-28T20:00:15.001189+0000","last_undegraded":"2023-11-28T20:00:15.001189+0000","last_fullsized":"2023-11-28T20:00:15.001189+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_clean_scrub_stamp":"2023-11-28T20:00:12.764355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:43:04.959781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-11-28T20:00:15.000956+0000","last_change":"2023-11-28T20:00:13.807494+0000","last_active":"2023-11-28T20:00:15.000956+0000","last_peered":"2023-11-28T20:00:15.000956+0000","last_clean":"2023-11-28T20:00:15.000956+0000","last_became_active":"2023-11-28T20:00:13.807215+0000","last_became_peered":"2023-11-28T20:00:13.807215+0000","last_unstale":"2023-11-28T20:00:15.000956+0000","last_undegraded":"2023-11-28T20:00:15.000956+0000","last_fullsized":"2023-11-28T20:00:15.000956+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_clean_scrub_stamp":"2023-11-28T20:00:12.764355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:49:37.068470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-11-28T20:00:15.000465+0000","last_change":"2023-11-28T20:00:13.808809+0000","last_active":"2023-11-28T20:00:15.000465+0000","last_peered":"2023-11-28T20:00:15.000465+0000","last_clean":"2023-11-28T20:00:15.000465+0000","last_became_active":"2023-11-28T20:00:13.808555+0000","last_became_peered":"2023-11-28T20:00:13.808555+0000","last_unstale":"2023-11-28T20:00:15.000465+0000","last_undegraded":"2023-11-28T20:00:15.000465+0000","last_fullsized":"2023-11-28T20:00:15.000465+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_clean_scrub_stamp":"2023-11-28T20:00:12.764355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:18:53.216142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-11-28T20:00:14.798957+0000","last_change":"2023-11-28T20:00:13.799749+0000","last_active":"2023-11-28T20:00:14.798957+0000","last_peered":"2023-11-28T20:00:14.798957+0000","last_clean":"2023-11-28T20:00:14.798957+0000","last_became_active":"2023-11-28T20:00:13.799461+0000","last_became_peered":"2023-11-28T20:00:13.799461+0000","last_unstale":"2023-11-28T20:00:14.798957+0000","last_undegraded":"2023-11-28T20:00:14.798957+0000","last_fullsized":"2023-11-28T20:00:14.798957+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_clean_scrub_stamp":"2023-11-28T20:00:12.764355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:40:01.114533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-11-28T20:00:14.799669+0000","last_change":"2023-11-28T20:00:13.790387+0000","last_active":"2023-11-28T20:00:14.799669+0000","last_peered":"2023-11-28T20:00:14.799669+0000","last_clean":"2023-11-28T20:00:14.799669+0000","last_became_active":"2023-11-28T20:00:13.790010+0000","last_became_peered":"2023-11-28T20:00:13.790010+0000","last_unstale":"2023-11-28T20:00:14.799669+0000","last_undegraded":"2023-11-28T20:00:14.799669+0000","last_fullsized":"2023-11-28T20:00:14.799669+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_clean_scrub_stamp":"2023-11-28T20:00:12.764355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:44:25.495847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-11-28T20:00:15.001296+0000","last_change":"2023-11-28T20:00:13.808555+0000","last_active":"2023-11-28T20:00:15.001296+0000","last_peered":"2023-11-28T20:00:15.001296+0000","last_clean":"2023-11-28T20:00:15.001296+0000","last_became_active":"2023-11-28T20:00:13.808267+0000","last_became_peered":"2023-11-28T20:00:13.808267+0000","last_unstale":"2023-11-28T20:00:15.001296+0000","last_undegraded":"2023-11-28T20:00:15.001296+0000","last_fullsized":"2023-11-28T20:00:15.001296+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_clean_scrub_stamp":"2023-11-28T20:00:12.764355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:20:11.234527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-11-28T20:00:14.800034+0000","last_change":"2023-11-28T20:00:13.821670+0000","last_active":"2023-11-28T20:00:14.800034+0000","last_peered":"2023-11-28T20:00:14.800034+0000","last_clean":"2023-11-28T20:00:14.800034+0000","last_became_active":"2023-11-28T20:00:13.821456+0000","last_became_peered":"2023-11-28T20:00:13.821456+0000","last_unstale":"2023-11-28T20:00:14.800034+0000","last_undegraded":"2023-11-28T20:00:14.800034+0000","last_fullsized":"2023-11-28T20:00:14.800034+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_clean_scrub_stamp":"2023-11-28T20:00:12.764355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:10:57.174856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-11-28T20:00:14.799790+0000","last_change":"2023-11-28T20:00:13.791296+0000","last_active":"2023-11-28T20:00:14.799790+0000","last_peered":"2023-11-28T20:00:14.799790+0000","last_clean":"2023-11-28T20:00:14.799790+0000","last_became_active":"2023-11-28T20:00:13.790916+0000","last_became_peered":"2023-11-28T20:00:13.790916+0000","last_unstale":"2023-11-28T20:00:14.799790+0000","last_undegraded":"2023-11-28T20:00:14.799790+0000","last_fullsized":"2023-11-28T20:00:14.799790+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_clean_scrub_stamp":"2023-11-28T20:00:12.764355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:44:25.495847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-11-28T20:00:15.001399+0000","last_change":"2023-11-28T20:00:13.800855+0000","last_active":"2023-11-28T20:00:15.001399+0000","last_peered":"2023-11-28T20:00:15.001399+0000","last_clean":"2023-11-28T20:00:15.001399+0000","last_became_active":"2023-11-28T20:00:13.800499+0000","last_became_peered":"2023-11-28T20:00:13.800499+0000","last_unstale":"2023-11-28T20:00:15.001399+0000","last_undegraded":"2023-11-28T20:00:15.001399+0000","last_fullsized":"2023-11-28T20:00:15.001399+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_clean_scrub_stamp":"2023-11-28T20:00:12.764355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:49:53.239354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-11-28T20:00:14.799478+0000","last_change":"2023-11-28T20:00:13.824858+0000","last_active":"2023-11-28T20:00:14.799478+0000","last_peered":"2023-11-28T20:00:14.799478+0000","last_clean":"2023-11-28T20:00:14.799478+0000","last_became_active":"2023-11-28T20:00:13.824569+0000","last_became_peered":"2023-11-28T20:00:13.824569+0000","last_unstale":"2023-11-28T20:00:14.799478+0000","last_undegraded":"2023-11-28T20:00:14.799478+0000","last_fullsized":"2023-11-28T20:00:14.799478+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_clean_scrub_stamp":"2023-11-28T20:00:12.764355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:00:42.063217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-11-28T20:00:14.798477+0000","last_change":"2023-11-28T20:00:13.808718+0000","last_active":"2023-11-28T20:00:14.798477+0000","last_peered":"2023-11-28T20:00:14.798477+0000","last_clean":"2023-11-28T20:00:14.798477+0000","last_became_active":"2023-11-28T20:00:13.808423+0000","last_became_peered":"2023-11-28T20:00:13.808423+0000","last_unstale":"2023-11-28T20:00:14.798477+0000","last_undegraded":"2023-11-28T20:00:14.798477+0000","last_fullsized":"2023-11-28T20:00:14.798477+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_clean_scrub_stamp":"2023-11-28T20:00:12.764355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:31:57.992158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-11-28T20:00:14.799542+0000","last_change":"2023-11-28T20:00:13.801043+0000","last_active":"2023-11-28T20:00:14.799542+0000","last_peered":"2023-11-28T20:00:14.799542+0000","last_clean":"2023-11-28T20:00:14.799542+0000","last_became_active":"2023-11-28T20:00:13.800680+0000","last_became_peered":"2023-11-28T20:00:13.800680+0000","last_unstale":"2023-11-28T20:00:14.799542+0000","last_undegraded":"2023-11-28T20:00:14.799542+0000","last_fullsized":"2023-11-28T20:00:14.799542+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_clean_scrub_stamp":"2023-11-28T20:00:12.764355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:22:53.309959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-11-28T20:00:15.001088+0000","last_change":"2023-11-28T20:00:13.827177+0000","last_active":"2023-11-28T20:00:15.001088+0000","last_peered":"2023-11-28T20:00:15.001088+0000","last_clean":"2023-11-28T20:00:15.001088+0000","last_became_active":"2023-11-28T20:00:13.826912+0000","last_became_peered":"2023-11-28T20:00:13.826912+0000","last_unstale":"2023-11-28T20:00:15.001088+0000","last_undegraded":"2023-11-28T20:00:15.001088+0000","last_fullsized":"2023-11-28T20:00:15.001088+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_clean_scrub_stamp":"2023-11-28T20:00:12.764355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:04:36.627323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-11-28T20:00:15.001564+0000","last_change":"2023-11-28T20:00:13.821822+0000","last_active":"2023-11-28T20:00:15.001564+0000","last_peered":"2023-11-28T20:00:15.001564+0000","last_clean":"2023-11-28T20:00:15.001564+0000","last_became_active":"2023-11-28T20:00:13.821511+0000","last_became_peered":"2023-11-28T20:00:13.821511+0000","last_unstale":"2023-11-28T20:00:15.001564+0000","last_undegraded":"2023-11-28T20:00:15.001564+0000","last_fullsized":"2023-11-28T20:00:15.001564+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_clean_scrub_stamp":"2023-11-28T20:00:12.764355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:09:58.925137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-11-28T20:00:15.002075+0000","last_change":"2023-11-28T20:00:13.818806+0000","last_active":"2023-11-28T20:00:15.002075+0000","last_peered":"2023-11-28T20:00:15.002075+0000","last_clean":"2023-11-28T20:00:15.002075+0000","last_became_active":"2023-11-28T20:00:13.818465+0000","last_became_peered":"2023-11-28T20:00:13.818465+0000","last_unstale":"2023-11-28T20:00:15.002075+0000","last_undegraded":"2023-11-28T20:00:15.002075+0000","last_fullsized":"2023-11-28T20:00:15.002075+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_clean_scrub_stamp":"2023-11-28T20:00:12.764355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:18:18.464919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-11-28T20:00:15.001566+0000","last_change":"2023-11-28T20:00:13.812943+0000","last_active":"2023-11-28T20:00:15.001566+0000","last_peered":"2023-11-28T20:00:15.001566+0000","last_clean":"2023-11-28T20:00:15.001566+0000","last_became_active":"2023-11-28T20:00:13.812599+0000","last_became_peered":"2023-11-28T20:00:13.812599+0000","last_unstale":"2023-11-28T20:00:15.001566+0000","last_undegraded":"2023-11-28T20:00:15.001566+0000","last_fullsized":"2023-11-28T20:00:15.001566+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_clean_scrub_stamp":"2023-11-28T20:00:12.764355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:55:35.740926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-11-28T20:00:15.001939+0000","last_change":"2023-11-28T20:00:13.818861+0000","last_active":"2023-11-28T20:00:15.001939+0000","last_peered":"2023-11-28T20:00:15.001939+0000","last_clean":"2023-11-28T20:00:15.001939+0000","last_became_active":"2023-11-28T20:00:13.818563+0000","last_became_peered":"2023-11-28T20:00:13.818563+0000","last_unstale":"2023-11-28T20:00:15.001939+0000","last_undegraded":"2023-11-28T20:00:15.001939+0000","last_fullsized":"2023-11-28T20:00:15.001939+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_clean_scrub_stamp":"2023-11-28T20:00:12.764355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:22:33.214424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-11-28T20:00:14.799629+0000","last_change":"2023-11-28T20:00:13.797412+0000","last_active":"2023-11-28T20:00:14.799629+0000","last_peered":"2023-11-28T20:00:14.799629+0000","last_clean":"2023-11-28T20:00:14.799629+0000","last_became_active":"2023-11-28T20:00:13.797078+0000","last_became_peered":"2023-11-28T20:00:13.797078+0000","last_unstale":"2023-11-28T20:00:14.799629+0000","last_undegraded":"2023-11-28T20:00:14.799629+0000","last_fullsized":"2023-11-28T20:00:14.799629+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_clean_scrub_stamp":"2023-11-28T20:00:12.764355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:29:20.384184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-11-28T20:00:14.798700+0000","last_change":"2023-11-28T20:00:13.805732+0000","last_active":"2023-11-28T20:00:14.798700+0000","last_peered":"2023-11-28T20:00:14.798700+0000","last_clean":"2023-11-28T20:00:14.798700+0000","last_became_active":"2023-11-28T20:00:13.805089+0000","last_became_peered":"2023-11-28T20:00:13.805089+0000","last_unstale":"2023-11-28T20:00:14.798700+0000","last_undegraded":"2023-11-28T20:00:14.798700+0000","last_fullsized":"2023-11-28T20:00:14.798700+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_clean_scrub_stamp":"2023-11-28T20:00:12.764355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:42:33.306843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-11-28T20:00:15.001195+0000","last_change":"2023-11-28T20:00:13.822451+0000","last_active":"2023-11-28T20:00:15.001195+0000","last_peered":"2023-11-28T20:00:15.001195+0000","last_clean":"2023-11-28T20:00:15.001195+0000","last_became_active":"2023-11-28T20:00:13.822186+0000","last_became_peered":"2023-11-28T20:00:13.822186+0000","last_unstale":"2023-11-28T20:00:15.001195+0000","last_undegraded":"2023-11-28T20:00:15.001195+0000","last_fullsized":"2023-11-28T20:00:15.001195+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_clean_scrub_stamp":"2023-11-28T20:00:12.764355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:27:21.391017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-11-28T20:00:15.000622+0000","last_change":"2023-11-28T20:00:13.821720+0000","last_active":"2023-11-28T20:00:15.000622+0000","last_peered":"2023-11-28T20:00:15.000622+0000","last_clean":"2023-11-28T20:00:15.000622+0000","last_became_active":"2023-11-28T20:00:13.820803+0000","last_became_peered":"2023-11-28T20:00:13.820803+0000","last_unstale":"2023-11-28T20:00:15.000622+0000","last_undegraded":"2023-11-28T20:00:15.000622+0000","last_fullsized":"2023-11-28T20:00:15.000622+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_clean_scrub_stamp":"2023-11-28T20:00:12.764355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:51:43.814695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-11-28T20:00:15.001996+0000","last_change":"2023-11-28T20:00:13.807416+0000","last_active":"2023-11-28T20:00:15.001996+0000","last_peered":"2023-11-28T20:00:15.001996+0000","last_clean":"2023-11-28T20:00:15.001996+0000","last_became_active":"2023-11-28T20:00:13.807141+0000","last_became_peered":"2023-11-28T20:00:13.807141+0000","last_unstale":"2023-11-28T20:00:15.001996+0000","last_undegraded":"2023-11-28T20:00:15.001996+0000","last_fullsized":"2023-11-28T20:00:15.001996+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_clean_scrub_stamp":"2023-11-28T20:00:12.764355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:42:33.306843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-11-28T20:00:15.001164+0000","last_change":"2023-11-28T20:00:13.812247+0000","last_active":"2023-11-28T20:00:15.001164+0000","last_peered":"2023-11-28T20:00:15.001164+0000","last_clean":"2023-11-28T20:00:15.001164+0000","last_became_active":"2023-11-28T20:00:13.812016+0000","last_became_peered":"2023-11-28T20:00:13.812016+0000","last_unstale":"2023-11-28T20:00:15.001164+0000","last_undegraded":"2023-11-28T20:00:15.001164+0000","last_fullsized":"2023-11-28T20:00:15.001164+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_clean_scrub_stamp":"2023-11-28T20:00:12.764355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:04:36.627323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-11-28T20:00:15.001990+0000","last_change":"2023-11-28T20:00:13.814802+0000","last_active":"2023-11-28T20:00:15.001990+0000","last_peered":"2023-11-28T20:00:15.001990+0000","last_clean":"2023-11-28T20:00:15.001990+0000","last_became_active":"2023-11-28T20:00:13.814522+0000","last_became_peered":"2023-11-28T20:00:13.814522+0000","last_unstale":"2023-11-28T20:00:15.001990+0000","last_undegraded":"2023-11-28T20:00:15.001990+0000","last_fullsized":"2023-11-28T20:00:15.001990+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_clean_scrub_stamp":"2023-11-28T20:00:12.764355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:30:41.436973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-11-28T20:00:14.799963+0000","last_change":"2023-11-28T20:00:13.801034+0000","last_active":"2023-11-28T20:00:14.799963+0000","last_peered":"2023-11-28T20:00:14.799963+0000","last_clean":"2023-11-28T20:00:14.799963+0000","last_became_active":"2023-11-28T20:00:13.798365+0000","last_became_peered":"2023-11-28T20:00:13.798365+0000","last_unstale":"2023-11-28T20:00:14.799963+0000","last_undegraded":"2023-11-28T20:00:14.799963+0000","last_fullsized":"2023-11-28T20:00:14.799963+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_clean_scrub_stamp":"2023-11-28T20:00:12.764355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:10:58.346942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-11-28T20:00:15.002044+0000","last_change":"2023-11-28T20:00:13.817271+0000","last_active":"2023-11-28T20:00:15.002044+0000","last_peered":"2023-11-28T20:00:15.002044+0000","last_clean":"2023-11-28T20:00:15.002044+0000","last_became_active":"2023-11-28T20:00:13.816910+0000","last_became_peered":"2023-11-28T20:00:13.816910+0000","last_unstale":"2023-11-28T20:00:15.002044+0000","last_undegraded":"2023-11-28T20:00:15.002044+0000","last_fullsized":"2023-11-28T20:00:15.002044+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_clean_scrub_stamp":"2023-11-28T20:00:12.764355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:31:40.964592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-11-28T20:00:15.001809+0000","last_change":"2023-11-28T20:00:13.814979+0000","last_active":"2023-11-28T20:00:15.001809+0000","last_peered":"2023-11-28T20:00:15.001809+0000","last_clean":"2023-11-28T20:00:15.001809+0000","last_became_active":"2023-11-28T20:00:13.812114+0000","last_became_peered":"2023-11-28T20:00:13.812114+0000","last_unstale":"2023-11-28T20:00:15.001809+0000","last_undegraded":"2023-11-28T20:00:15.001809+0000","last_fullsized":"2023-11-28T20:00:15.001809+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_clean_scrub_stamp":"2023-11-28T20:00:12.764355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:39:05.453623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-11-28T20:00:15.001257+0000","last_change":"2023-11-28T20:00:13.822997+0000","last_active":"2023-11-28T20:00:15.001257+0000","last_peered":"2023-11-28T20:00:15.001257+0000","last_clean":"2023-11-28T20:00:15.001257+0000","last_became_active":"2023-11-28T20:00:13.822640+0000","last_became_peered":"2023-11-28T20:00:13.822640+0000","last_unstale":"2023-11-28T20:00:15.001257+0000","last_undegraded":"2023-11-28T20:00:15.001257+0000","last_fullsized":"2023-11-28T20:00:15.001257+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_clean_scrub_stamp":"2023-11-28T20:00:12.764355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:49:03.707877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-11-28T20:00:15.000675+0000","last_change":"2023-11-28T20:00:13.801896+0000","last_active":"2023-11-28T20:00:15.000675+0000","last_peered":"2023-11-28T20:00:15.000675+0000","last_clean":"2023-11-28T20:00:15.000675+0000","last_became_active":"2023-11-28T20:00:13.801620+0000","last_became_peered":"2023-11-28T20:00:13.801620+0000","last_unstale":"2023-11-28T20:00:15.000675+0000","last_undegraded":"2023-11-28T20:00:15.000675+0000","last_fullsized":"2023-11-28T20:00:15.000675+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_clean_scrub_stamp":"2023-11-28T20:00:12.764355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:49:53.239354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-11-28T20:00:15.001371+0000","last_change":"2023-11-28T20:00:13.822133+0000","last_active":"2023-11-28T20:00:15.001371+0000","last_peered":"2023-11-28T20:00:15.001371+0000","last_clean":"2023-11-28T20:00:15.001371+0000","last_became_active":"2023-11-28T20:00:13.821824+0000","last_became_peered":"2023-11-28T20:00:13.821824+0000","last_unstale":"2023-11-28T20:00:15.001371+0000","last_undegraded":"2023-11-28T20:00:15.001371+0000","last_fullsized":"2023-11-28T20:00:15.001371+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_clean_scrub_stamp":"2023-11-28T20:00:12.764355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:32:45.544226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1f","version":"39'4","reported_seq":16,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-28T20:00:13.818530+0000","last_change":"2023-11-28T20:00:12.794933+0000","last_active":"2023-11-28T20:00:13.818530+0000","last_peered":"2023-11-28T20:00:13.818530+0000","last_clean":"2023-11-28T20:00:13.818530+0000","last_became_active":"2023-11-28T20:00:12.794598+0000","last_became_peered":"2023-11-28T20:00:12.794598+0000","last_unstale":"2023-11-28T20:00:13.818530+0000","last_undegraded":"2023-11-28T20:00:13.818530+0000","last_fullsized":"2023-11-28T20:00:13.818530+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:11.760656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:11.760656+0000","last_clean_scrub_stamp":"2023-11-28T20:00:11.760656+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:55:34.737227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-11-28T20:00:15.001199+0000","last_change":"2023-11-28T20:00:13.809500+0000","last_active":"2023-11-28T20:00:15.001199+0000","last_peered":"2023-11-28T20:00:15.001199+0000","last_clean":"2023-11-28T20:00:15.001199+0000","last_became_active":"2023-11-28T20:00:13.809149+0000","last_became_peered":"2023-11-28T20:00:13.809149+0000","last_unstale":"2023-11-28T20:00:15.001199+0000","last_undegraded":"2023-11-28T20:00:15.001199+0000","last_fullsized":"2023-11-28T20:00:15.001199+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_clean_scrub_stamp":"2023-11-28T20:00:12.764355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T07:13:21.710239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1e","version":"39'1","reported_seq":13,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-28T20:00:13.826280+0000","last_change":"2023-11-28T20:00:12.794372+0000","last_active":"2023-11-28T20:00:13.826280+0000","last_peered":"2023-11-28T20:00:13.826280+0000","last_clean":"2023-11-28T20:00:13.826280+0000","last_became_active":"2023-11-28T20:00:12.794166+0000","last_became_peered":"2023-11-28T20:00:12.794166+0000","last_unstale":"2023-11-28T20:00:13.826280+0000","last_undegraded":"2023-11-28T20:00:13.826280+0000","last_fullsized":"2023-11-28T20:00:13.826280+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:11.760656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:11.760656+0000","last_clean_scrub_stamp":"2023-11-28T20:00:11.760656+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:30:40.433274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-11-28T20:00:14.799565+0000","last_change":"2023-11-28T20:00:13.811214+0000","last_active":"2023-11-28T20:00:14.799565+0000","last_peered":"2023-11-28T20:00:14.799565+0000","last_clean":"2023-11-28T20:00:14.799565+0000","last_became_active":"2023-11-28T20:00:13.810824+0000","last_became_peered":"2023-11-28T20:00:13.810824+0000","last_unstale":"2023-11-28T20:00:14.799565+0000","last_undegraded":"2023-11-28T20:00:14.799565+0000","last_fullsized":"2023-11-28T20:00:14.799565+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_clean_scrub_stamp":"2023-11-28T20:00:12.764355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:18:18.464919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"39'2","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-28T20:00:13.816854+0000","last_change":"2023-11-28T20:00:12.797247+0000","last_active":"2023-11-28T20:00:13.816854+0000","last_peered":"2023-11-28T20:00:13.816854+0000","last_clean":"2023-11-28T20:00:13.816854+0000","last_became_active":"2023-11-28T20:00:12.797003+0000","last_became_peered":"2023-11-28T20:00:12.797003+0000","last_unstale":"2023-11-28T20:00:13.816854+0000","last_undegraded":"2023-11-28T20:00:13.816854+0000","last_fullsized":"2023-11-28T20:00:13.816854+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:11.760656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:11.760656+0000","last_clean_scrub_stamp":"2023-11-28T20:00:11.760656+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:39:04.449924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-11-28T20:00:14.800065+0000","last_change":"2023-11-28T20:00:13.807462+0000","last_active":"2023-11-28T20:00:14.800065+0000","last_peered":"2023-11-28T20:00:14.800065+0000","last_clean":"2023-11-28T20:00:14.800065+0000","last_became_active":"2023-11-28T20:00:13.807149+0000","last_became_peered":"2023-11-28T20:00:13.807149+0000","last_unstale":"2023-11-28T20:00:14.800065+0000","last_undegraded":"2023-11-28T20:00:14.800065+0000","last_fullsized":"2023-11-28T20:00:14.800065+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_clean_scrub_stamp":"2023-11-28T20:00:12.764355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T07:28:33.623680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1c","version":"39'2","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-28T20:00:13.806249+0000","last_change":"2023-11-28T20:00:12.799178+0000","last_active":"2023-11-28T20:00:13.806249+0000","last_peered":"2023-11-28T20:00:13.806249+0000","last_clean":"2023-11-28T20:00:13.806249+0000","last_became_active":"2023-11-28T20:00:12.798834+0000","last_became_peered":"2023-11-28T20:00:12.798834+0000","last_unstale":"2023-11-28T20:00:13.806249+0000","last_undegraded":"2023-11-28T20:00:13.806249+0000","last_fullsized":"2023-11-28T20:00:13.806249+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:11.760656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:11.760656+0000","last_clean_scrub_stamp":"2023-11-28T20:00:11.760656+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:26:43.439645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-11-28T20:00:15.000311+0000","last_change":"2023-11-28T20:00:13.804415+0000","last_active":"2023-11-28T20:00:15.000311+0000","last_peered":"2023-11-28T20:00:15.000311+0000","last_clean":"2023-11-28T20:00:15.000311+0000","last_became_active":"2023-11-28T20:00:13.803965+0000","last_became_peered":"2023-11-28T20:00:13.803965+0000","last_unstale":"2023-11-28T20:00:15.000311+0000","last_undegraded":"2023-11-28T20:00:15.000311+0000","last_fullsized":"2023-11-28T20:00:15.000311+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_clean_scrub_stamp":"2023-11-28T20:00:12.764355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:31:40.964592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1b","version":"39'1","reported_seq":13,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-28T20:00:13.810367+0000","last_change":"2023-11-28T20:00:12.804157+0000","last_active":"2023-11-28T20:00:13.810367+0000","last_peered":"2023-11-28T20:00:13.810367+0000","last_clean":"2023-11-28T20:00:13.810367+0000","last_became_active":"2023-11-28T20:00:12.803950+0000","last_became_peered":"2023-11-28T20:00:12.803950+0000","last_unstale":"2023-11-28T20:00:13.810367+0000","last_undegraded":"2023-11-28T20:00:13.810367+0000","last_fullsized":"2023-11-28T20:00:13.810367+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:11.760656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:11.760656+0000","last_clean_scrub_stamp":"2023-11-28T20:00:11.760656+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T07:13:20.706540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-11-28T20:00:14.799745+0000","last_change":"2023-11-28T20:00:13.797465+0000","last_active":"2023-11-28T20:00:14.799745+0000","last_peered":"2023-11-28T20:00:14.799745+0000","last_clean":"2023-11-28T20:00:14.799745+0000","last_became_active":"2023-11-28T20:00:13.797106+0000","last_became_peered":"2023-11-28T20:00:13.797106+0000","last_unstale":"2023-11-28T20:00:14.799745+0000","last_undegraded":"2023-11-28T20:00:14.799745+0000","last_fullsized":"2023-11-28T20:00:14.799745+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_clean_scrub_stamp":"2023-11-28T20:00:12.764355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T07:56:05.039809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"39'1","reported_seq":13,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-28T20:00:13.821179+0000","last_change":"2023-11-28T20:00:12.797188+0000","last_active":"2023-11-28T20:00:13.821179+0000","last_peered":"2023-11-28T20:00:13.821179+0000","last_clean":"2023-11-28T20:00:13.821179+0000","last_became_active":"2023-11-28T20:00:12.796926+0000","last_became_peered":"2023-11-28T20:00:12.796926+0000","last_unstale":"2023-11-28T20:00:13.821179+0000","last_undegraded":"2023-11-28T20:00:13.821179+0000","last_fullsized":"2023-11-28T20:00:13.821179+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:11.760656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:11.760656+0000","last_clean_scrub_stamp":"2023-11-28T20:00:11.760656+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:38:54.348106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-11-28T20:00:14.798698+0000","last_change":"2023-11-28T20:00:13.789303+0000","last_active":"2023-11-28T20:00:14.798698+0000","last_peered":"2023-11-28T20:00:14.798698+0000","last_clean":"2023-11-28T20:00:14.798698+0000","last_became_active":"2023-11-28T20:00:13.788505+0000","last_became_peered":"2023-11-28T20:00:13.788505+0000","last_unstale":"2023-11-28T20:00:14.798698+0000","last_undegraded":"2023-11-28T20:00:14.798698+0000","last_fullsized":"2023-11-28T20:00:14.798698+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_clean_scrub_stamp":"2023-11-28T20:00:12.764355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:22:33.214424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-28T20:00:13.787857+0000","last_change":"2023-11-28T20:00:12.805374+0000","last_active":"2023-11-28T20:00:13.787857+0000","last_peered":"2023-11-28T20:00:13.787857+0000","last_clean":"2023-11-28T20:00:13.787857+0000","last_became_active":"2023-11-28T20:00:12.805094+0000","last_became_peered":"2023-11-28T20:00:12.805094+0000","last_unstale":"2023-11-28T20:00:13.787857+0000","last_undegraded":"2023-11-28T20:00:13.787857+0000","last_fullsized":"2023-11-28T20:00:13.787857+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:11.760656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:11.760656+0000","last_clean_scrub_stamp":"2023-11-28T20:00:11.760656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T07:54:02.325947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-11-28T20:00:14.799820+0000","last_change":"2023-11-28T20:00:13.823014+0000","last_active":"2023-11-28T20:00:14.799820+0000","last_peered":"2023-11-28T20:00:14.799820+0000","last_clean":"2023-11-28T20:00:14.799820+0000","last_became_active":"2023-11-28T20:00:13.822506+0000","last_became_peered":"2023-11-28T20:00:13.822506+0000","last_unstale":"2023-11-28T20:00:14.799820+0000","last_undegraded":"2023-11-28T20:00:14.799820+0000","last_fullsized":"2023-11-28T20:00:14.799820+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_clean_scrub_stamp":"2023-11-28T20:00:12.764355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:05:44.634045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-28T20:00:13.782650+0000","last_change":"2023-11-28T20:00:12.797265+0000","last_active":"2023-11-28T20:00:13.782650+0000","last_peered":"2023-11-28T20:00:13.782650+0000","last_clean":"2023-11-28T20:00:13.782650+0000","last_became_active":"2023-11-28T20:00:12.794418+0000","last_became_peered":"2023-11-28T20:00:12.794418+0000","last_unstale":"2023-11-28T20:00:13.782650+0000","last_undegraded":"2023-11-28T20:00:13.782650+0000","last_fullsized":"2023-11-28T20:00:13.782650+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:11.760656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:11.760656+0000","last_clean_scrub_stamp":"2023-11-28T20:00:11.760656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:38:54.348106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-11-28T20:00:15.001355+0000","last_change":"2023-11-28T20:00:13.797846+0000","last_active":"2023-11-28T20:00:15.001355+0000","last_peered":"2023-11-28T20:00:15.001355+0000","last_clean":"2023-11-28T20:00:15.001355+0000","last_became_active":"2023-11-28T20:00:13.797542+0000","last_became_peered":"2023-11-28T20:00:13.797542+0000","last_unstale":"2023-11-28T20:00:15.001355+0000","last_undegraded":"2023-11-28T20:00:15.001355+0000","last_fullsized":"2023-11-28T20:00:15.001355+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_clean_scrub_stamp":"2023-11-28T20:00:12.764355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:19:34.223422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-28T20:00:13.781809+0000","last_change":"2023-11-28T20:00:12.796227+0000","last_active":"2023-11-28T20:00:13.781809+0000","last_peered":"2023-11-28T20:00:13.781809+0000","last_clean":"2023-11-28T20:00:13.781809+0000","last_became_active":"2023-11-28T20:00:12.795944+0000","last_became_peered":"2023-11-28T20:00:12.795944+0000","last_unstale":"2023-11-28T20:00:13.781809+0000","last_undegraded":"2023-11-28T20:00:13.781809+0000","last_fullsized":"2023-11-28T20:00:13.781809+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:11.760656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:11.760656+0000","last_clean_scrub_stamp":"2023-11-28T20:00:11.760656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:29:19.380485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-11-28T20:00:15.001552+0000","last_change":"2023-11-28T20:00:13.825114+0000","last_active":"2023-11-28T20:00:15.001552+0000","last_peered":"2023-11-28T20:00:15.001552+0000","last_clean":"2023-11-28T20:00:15.001552+0000","last_became_active":"2023-11-28T20:00:13.824561+0000","last_became_peered":"2023-11-28T20:00:13.824561+0000","last_unstale":"2023-11-28T20:00:15.001552+0000","last_undegraded":"2023-11-28T20:00:15.001552+0000","last_fullsized":"2023-11-28T20:00:15.001552+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_clean_scrub_stamp":"2023-11-28T20:00:12.764355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:40:01.114533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-28T20:00:13.784260+0000","last_change":"2023-11-28T20:00:12.803866+0000","last_active":"2023-11-28T20:00:13.784260+0000","last_peered":"2023-11-28T20:00:13.784260+0000","last_clean":"2023-11-28T20:00:13.784260+0000","last_became_active":"2023-11-28T20:00:12.803431+0000","last_became_peered":"2023-11-28T20:00:12.803431+0000","last_unstale":"2023-11-28T20:00:13.784260+0000","last_undegraded":"2023-11-28T20:00:13.784260+0000","last_fullsized":"2023-11-28T20:00:13.784260+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:11.760656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:11.760656+0000","last_clean_scrub_stamp":"2023-11-28T20:00:11.760656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:49:02.704178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-11-28T20:00:15.001527+0000","last_change":"2023-11-28T20:00:13.826789+0000","last_active":"2023-11-28T20:00:15.001527+0000","last_peered":"2023-11-28T20:00:15.001527+0000","last_clean":"2023-11-28T20:00:15.001527+0000","last_became_active":"2023-11-28T20:00:13.826523+0000","last_became_peered":"2023-11-28T20:00:13.826523+0000","last_unstale":"2023-11-28T20:00:15.001527+0000","last_undegraded":"2023-11-28T20:00:15.001527+0000","last_fullsized":"2023-11-28T20:00:15.001527+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_clean_scrub_stamp":"2023-11-28T20:00:12.764355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:04:36.627323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.15","version":"39'3","reported_seq":15,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-28T20:00:13.813705+0000","last_change":"2023-11-28T20:00:12.804096+0000","last_active":"2023-11-28T20:00:13.813705+0000","last_peered":"2023-11-28T20:00:13.813705+0000","last_clean":"2023-11-28T20:00:13.813705+0000","last_became_active":"2023-11-28T20:00:12.803797+0000","last_became_peered":"2023-11-28T20:00:12.803797+0000","last_unstale":"2023-11-28T20:00:13.813705+0000","last_undegraded":"2023-11-28T20:00:13.813705+0000","last_fullsized":"2023-11-28T20:00:13.813705+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:11.760656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:11.760656+0000","last_clean_scrub_stamp":"2023-11-28T20:00:11.760656+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:32:44.540527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-11-28T20:00:14.799359+0000","last_change":"2023-11-28T20:00:13.806380+0000","last_active":"2023-11-28T20:00:14.799359+0000","last_peered":"2023-11-28T20:00:14.799359+0000","last_clean":"2023-11-28T20:00:14.799359+0000","last_became_active":"2023-11-28T20:00:13.805390+0000","last_became_peered":"2023-11-28T20:00:13.805390+0000","last_unstale":"2023-11-28T20:00:14.799359+0000","last_undegraded":"2023-11-28T20:00:14.799359+0000","last_fullsized":"2023-11-28T20:00:14.799359+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_clean_scrub_stamp":"2023-11-28T20:00:12.764355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:30:41.436973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.14","version":"39'6","reported_seq":18,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-28T20:00:13.827481+0000","last_change":"2023-11-28T20:00:12.797894+0000","last_active":"2023-11-28T20:00:13.827481+0000","last_peered":"2023-11-28T20:00:13.827481+0000","last_clean":"2023-11-28T20:00:13.827481+0000","last_became_active":"2023-11-28T20:00:12.797594+0000","last_became_peered":"2023-11-28T20:00:12.797594+0000","last_unstale":"2023-11-28T20:00:13.827481+0000","last_undegraded":"2023-11-28T20:00:13.827481+0000","last_fullsized":"2023-11-28T20:00:13.827481+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:11.760656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:11.760656+0000","last_clean_scrub_stamp":"2023-11-28T20:00:11.760656+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:40:00.110834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-11-28T20:00:15.000312+0000","last_change":"2023-11-28T20:00:13.804236+0000","last_active":"2023-11-28T20:00:15.000312+0000","last_peered":"2023-11-28T20:00:15.000312+0000","last_clean":"2023-11-28T20:00:15.000312+0000","last_became_active":"2023-11-28T20:00:13.803605+0000","last_became_peered":"2023-11-28T20:00:13.803605+0000","last_unstale":"2023-11-28T20:00:15.000312+0000","last_undegraded":"2023-11-28T20:00:15.000312+0000","last_fullsized":"2023-11-28T20:00:15.000312+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_clean_scrub_stamp":"2023-11-28T20:00:12.764355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:18:18.464919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"39'2","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-28T20:00:13.804024+0000","last_change":"2023-11-28T20:00:12.794915+0000","last_active":"2023-11-28T20:00:13.804024+0000","last_peered":"2023-11-28T20:00:13.804024+0000","last_clean":"2023-11-28T20:00:13.804024+0000","last_became_active":"2023-11-28T20:00:12.793728+0000","last_became_peered":"2023-11-28T20:00:12.793728+0000","last_unstale":"2023-11-28T20:00:13.804024+0000","last_undegraded":"2023-11-28T20:00:13.804024+0000","last_fullsized":"2023-11-28T20:00:13.804024+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:11.760656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:11.760656+0000","last_clean_scrub_stamp":"2023-11-28T20:00:11.760656+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:18:26.871119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-11-28T20:00:14.799734+0000","last_change":"2023-11-28T20:00:13.804139+0000","last_active":"2023-11-28T20:00:14.799734+0000","last_peered":"2023-11-28T20:00:14.799734+0000","last_clean":"2023-11-28T20:00:14.799734+0000","last_became_active":"2023-11-28T20:00:13.803848+0000","last_became_peered":"2023-11-28T20:00:13.803848+0000","last_unstale":"2023-11-28T20:00:14.799734+0000","last_undegraded":"2023-11-28T20:00:14.799734+0000","last_fullsized":"2023-11-28T20:00:14.799734+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_clean_scrub_stamp":"2023-11-28T20:00:12.764355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:10:58.346942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-28T20:00:13.789546+0000","last_change":"2023-11-28T20:00:12.805313+0000","last_active":"2023-11-28T20:00:13.789546+0000","last_peered":"2023-11-28T20:00:13.789546+0000","last_clean":"2023-11-28T20:00:13.789546+0000","last_became_active":"2023-11-28T20:00:12.804998+0000","last_became_peered":"2023-11-28T20:00:12.804998+0000","last_unstale":"2023-11-28T20:00:13.789546+0000","last_undegraded":"2023-11-28T20:00:13.789546+0000","last_fullsized":"2023-11-28T20:00:13.789546+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:11.760656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:11.760656+0000","last_clean_scrub_stamp":"2023-11-28T20:00:11.760656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:42:32.303144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-11-28T20:00:15.001146+0000","last_change":"2023-11-28T20:00:13.822076+0000","last_active":"2023-11-28T20:00:15.001146+0000","last_peered":"2023-11-28T20:00:15.001146+0000","last_clean":"2023-11-28T20:00:15.001146+0000","last_became_active":"2023-11-28T20:00:13.821470+0000","last_became_peered":"2023-11-28T20:00:13.821470+0000","last_unstale":"2023-11-28T20:00:15.001146+0000","last_undegraded":"2023-11-28T20:00:15.001146+0000","last_fullsized":"2023-11-28T20:00:15.001146+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_clean_scrub_stamp":"2023-11-28T20:00:12.764355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T07:13:21.710239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-28T20:00:13.799805+0000","last_change":"2023-11-28T20:00:12.789146+0000","last_active":"2023-11-28T20:00:13.799805+0000","last_peered":"2023-11-28T20:00:13.799805+0000","last_clean":"2023-11-28T20:00:13.799805+0000","last_became_active":"2023-11-28T20:00:12.788447+0000","last_became_peered":"2023-11-28T20:00:12.788447+0000","last_unstale":"2023-11-28T20:00:13.799805+0000","last_undegraded":"2023-11-28T20:00:13.799805+0000","last_fullsized":"2023-11-28T20:00:13.799805+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:11.760656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:11.760656+0000","last_clean_scrub_stamp":"2023-11-28T20:00:11.760656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:09:51.354913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-11-28T20:00:14.799941+0000","last_change":"2023-11-28T20:00:13.804984+0000","last_active":"2023-11-28T20:00:14.799941+0000","last_peered":"2023-11-28T20:00:14.799941+0000","last_clean":"2023-11-28T20:00:14.799941+0000","last_became_active":"2023-11-28T20:00:13.804281+0000","last_became_peered":"2023-11-28T20:00:13.804281+0000","last_unstale":"2023-11-28T20:00:14.799941+0000","last_undegraded":"2023-11-28T20:00:14.799941+0000","last_fullsized":"2023-11-28T20:00:14.799941+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_clean_scrub_stamp":"2023-11-28T20:00:12.764355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:49:40.934392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"39'8","reported_seq":20,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-28T20:00:13.826858+0000","last_change":"2023-11-28T20:00:12.799040+0000","last_active":"2023-11-28T20:00:13.826858+0000","last_peered":"2023-11-28T20:00:13.826858+0000","last_clean":"2023-11-28T20:00:13.826858+0000","last_became_active":"2023-11-28T20:00:12.798730+0000","last_became_peered":"2023-11-28T20:00:12.798730+0000","last_unstale":"2023-11-28T20:00:13.826858+0000","last_undegraded":"2023-11-28T20:00:13.826858+0000","last_fullsized":"2023-11-28T20:00:13.826858+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:11.760656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:11.760656+0000","last_clean_scrub_stamp":"2023-11-28T20:00:11.760656+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:26:43.439645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-11-28T20:00:14.800182+0000","last_change":"2023-11-28T20:00:13.812428+0000","last_active":"2023-11-28T20:00:14.800182+0000","last_peered":"2023-11-28T20:00:14.800182+0000","last_clean":"2023-11-28T20:00:14.800182+0000","last_became_active":"2023-11-28T20:00:13.812074+0000","last_became_peered":"2023-11-28T20:00:13.812074+0000","last_unstale":"2023-11-28T20:00:14.800182+0000","last_undegraded":"2023-11-28T20:00:14.800182+0000","last_fullsized":"2023-11-28T20:00:14.800182+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_clean_scrub_stamp":"2023-11-28T20:00:12.764355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:21:55.649385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"39'1","reported_seq":13,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-28T20:00:13.816829+0000","last_change":"2023-11-28T20:00:12.803142+0000","last_active":"2023-11-28T20:00:13.816829+0000","last_peered":"2023-11-28T20:00:13.816829+0000","last_clean":"2023-11-28T20:00:13.816829+0000","last_became_active":"2023-11-28T20:00:12.802775+0000","last_became_peered":"2023-11-28T20:00:12.802775+0000","last_unstale":"2023-11-28T20:00:13.816829+0000","last_undegraded":"2023-11-28T20:00:13.816829+0000","last_fullsized":"2023-11-28T20:00:13.816829+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:11.760656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:11.760656+0000","last_clean_scrub_stamp":"2023-11-28T20:00:11.760656+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:18:26.871119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-11-28T20:00:14.799963+0000","last_change":"2023-11-28T20:00:13.815547+0000","last_active":"2023-11-28T20:00:14.799963+0000","last_peered":"2023-11-28T20:00:14.799963+0000","last_clean":"2023-11-28T20:00:14.799963+0000","last_became_active":"2023-11-28T20:00:13.813153+0000","last_became_peered":"2023-11-28T20:00:13.813153+0000","last_unstale":"2023-11-28T20:00:14.799963+0000","last_undegraded":"2023-11-28T20:00:14.799963+0000","last_fullsized":"2023-11-28T20:00:14.799963+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_clean_scrub_stamp":"2023-11-28T20:00:12.764355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:05:44.634045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.e","version":"39'2","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-28T20:00:13.807717+0000","last_change":"2023-11-28T20:00:12.806331+0000","last_active":"2023-11-28T20:00:13.807717+0000","last_peered":"2023-11-28T20:00:13.807717+0000","last_clean":"2023-11-28T20:00:13.807717+0000","last_became_active":"2023-11-28T20:00:12.805857+0000","last_became_peered":"2023-11-28T20:00:12.805857+0000","last_unstale":"2023-11-28T20:00:13.807717+0000","last_undegraded":"2023-11-28T20:00:13.807717+0000","last_fullsized":"2023-11-28T20:00:13.807717+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:11.760656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:11.760656+0000","last_clean_scrub_stamp":"2023-11-28T20:00:11.760656+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T07:54:02.325947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-11-28T20:00:14.799425+0000","last_change":"2023-11-28T20:00:13.797337+0000","last_active":"2023-11-28T20:00:14.799425+0000","last_peered":"2023-11-28T20:00:14.799425+0000","last_clean":"2023-11-28T20:00:14.799425+0000","last_became_active":"2023-11-28T20:00:13.797027+0000","last_became_peered":"2023-11-28T20:00:13.797027+0000","last_unstale":"2023-11-28T20:00:14.799425+0000","last_undegraded":"2023-11-28T20:00:14.799425+0000","last_fullsized":"2023-11-28T20:00:14.799425+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_clean_scrub_stamp":"2023-11-28T20:00:12.764355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:31:40.964592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"39'1","reported_seq":13,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-28T20:00:13.826284+0000","last_change":"2023-11-28T20:00:12.796923+0000","last_active":"2023-11-28T20:00:13.826284+0000","last_peered":"2023-11-28T20:00:13.826284+0000","last_clean":"2023-11-28T20:00:13.826284+0000","last_became_active":"2023-11-28T20:00:12.796625+0000","last_became_peered":"2023-11-28T20:00:12.796625+0000","last_unstale":"2023-11-28T20:00:13.826284+0000","last_undegraded":"2023-11-28T20:00:13.826284+0000","last_fullsized":"2023-11-28T20:00:13.826284+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:11.760656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:11.760656+0000","last_clean_scrub_stamp":"2023-11-28T20:00:11.760656+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:07:27.330964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-11-28T20:00:15.001668+0000","last_change":"2023-11-28T20:00:13.800009+0000","last_active":"2023-11-28T20:00:15.001668+0000","last_peered":"2023-11-28T20:00:15.001668+0000","last_clean":"2023-11-28T20:00:15.001668+0000","last_became_active":"2023-11-28T20:00:13.799753+0000","last_became_peered":"2023-11-28T20:00:13.799753+0000","last_unstale":"2023-11-28T20:00:15.001668+0000","last_undegraded":"2023-11-28T20:00:15.001668+0000","last_fullsized":"2023-11-28T20:00:15.001668+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_clean_scrub_stamp":"2023-11-28T20:00:12.764355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:21:44.950264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-28T20:00:13.789948+0000","last_change":"2023-11-28T20:00:12.796705+0000","last_active":"2023-11-28T20:00:13.789948+0000","last_peered":"2023-11-28T20:00:13.789948+0000","last_clean":"2023-11-28T20:00:13.789948+0000","last_became_active":"2023-11-28T20:00:12.796394+0000","last_became_peered":"2023-11-28T20:00:12.796394+0000","last_unstale":"2023-11-28T20:00:13.789948+0000","last_undegraded":"2023-11-28T20:00:13.789948+0000","last_fullsized":"2023-11-28T20:00:13.789948+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:11.760656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:11.760656+0000","last_clean_scrub_stamp":"2023-11-28T20:00:11.760656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:31:39.960893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-11-28T20:00:15.001264+0000","last_change":"2023-11-28T20:00:13.822221+0000","last_active":"2023-11-28T20:00:15.001264+0000","last_peered":"2023-11-28T20:00:15.001264+0000","last_clean":"2023-11-28T20:00:15.001264+0000","last_became_active":"2023-11-28T20:00:13.821752+0000","last_became_peered":"2023-11-28T20:00:13.821752+0000","last_unstale":"2023-11-28T20:00:15.001264+0000","last_undegraded":"2023-11-28T20:00:15.001264+0000","last_fullsized":"2023-11-28T20:00:15.001264+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_clean_scrub_stamp":"2023-11-28T20:00:12.764355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:02:33.438235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"39'2","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-28T20:00:13.804576+0000","last_change":"2023-11-28T20:00:12.787168+0000","last_active":"2023-11-28T20:00:13.804576+0000","last_peered":"2023-11-28T20:00:13.804576+0000","last_clean":"2023-11-28T20:00:13.804576+0000","last_became_active":"2023-11-28T20:00:12.786815+0000","last_became_peered":"2023-11-28T20:00:12.786815+0000","last_unstale":"2023-11-28T20:00:13.804576+0000","last_undegraded":"2023-11-28T20:00:13.804576+0000","last_fullsized":"2023-11-28T20:00:13.804576+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:11.760656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:11.760656+0000","last_clean_scrub_stamp":"2023-11-28T20:00:11.760656+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:29:35.927577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-11-28T20:00:15.001663+0000","last_change":"2023-11-28T20:00:13.821223+0000","last_active":"2023-11-28T20:00:15.001663+0000","last_peered":"2023-11-28T20:00:15.001663+0000","last_clean":"2023-11-28T20:00:15.001663+0000","last_became_active":"2023-11-28T20:00:13.820855+0000","last_became_peered":"2023-11-28T20:00:13.820855+0000","last_unstale":"2023-11-28T20:00:15.001663+0000","last_undegraded":"2023-11-28T20:00:15.001663+0000","last_fullsized":"2023-11-28T20:00:15.001663+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_clean_scrub_stamp":"2023-11-28T20:00:12.764355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T07:13:21.710239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-28T20:00:13.792567+0000","last_change":"2023-11-28T20:00:12.789615+0000","last_active":"2023-11-28T20:00:13.792567+0000","last_peered":"2023-11-28T20:00:13.792567+0000","last_clean":"2023-11-28T20:00:13.792567+0000","last_became_active":"2023-11-28T20:00:12.789357+0000","last_became_peered":"2023-11-28T20:00:12.789357+0000","last_unstale":"2023-11-28T20:00:13.792567+0000","last_undegraded":"2023-11-28T20:00:13.792567+0000","last_fullsized":"2023-11-28T20:00:13.792567+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:11.760656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:11.760656+0000","last_clean_scrub_stamp":"2023-11-28T20:00:11.760656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:49:23.488653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-11-28T20:00:14.799290+0000","last_change":"2023-11-28T20:00:13.809401+0000","last_active":"2023-11-28T20:00:14.799290+0000","last_peered":"2023-11-28T20:00:14.799290+0000","last_clean":"2023-11-28T20:00:14.799290+0000","last_became_active":"2023-11-28T20:00:13.808829+0000","last_became_peered":"2023-11-28T20:00:13.808829+0000","last_unstale":"2023-11-28T20:00:14.799290+0000","last_undegraded":"2023-11-28T20:00:14.799290+0000","last_fullsized":"2023-11-28T20:00:14.799290+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_clean_scrub_stamp":"2023-11-28T20:00:12.764355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:09:58.925137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-28T20:00:13.797276+0000","last_change":"2023-11-28T20:00:12.794799+0000","last_active":"2023-11-28T20:00:13.797276+0000","last_peered":"2023-11-28T20:00:13.797276+0000","last_clean":"2023-11-28T20:00:13.797276+0000","last_became_active":"2023-11-28T20:00:12.794535+0000","last_became_peered":"2023-11-28T20:00:12.794535+0000","last_unstale":"2023-11-28T20:00:13.797276+0000","last_undegraded":"2023-11-28T20:00:13.797276+0000","last_fullsized":"2023-11-28T20:00:13.797276+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:11.760656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:11.760656+0000","last_clean_scrub_stamp":"2023-11-28T20:00:11.760656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:42:32.303144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-11-28T20:00:14.800053+0000","last_change":"2023-11-28T20:00:13.821627+0000","last_active":"2023-11-28T20:00:14.800053+0000","last_peered":"2023-11-28T20:00:14.800053+0000","last_clean":"2023-11-28T20:00:14.800053+0000","last_became_active":"2023-11-28T20:00:13.821359+0000","last_became_peered":"2023-11-28T20:00:13.821359+0000","last_unstale":"2023-11-28T20:00:14.800053+0000","last_undegraded":"2023-11-28T20:00:14.800053+0000","last_fullsized":"2023-11-28T20:00:14.800053+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_clean_scrub_stamp":"2023-11-28T20:00:12.764355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:42:42.402639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-28T20:00:13.792713+0000","last_change":"2023-11-28T20:00:12.787505+0000","last_active":"2023-11-28T20:00:13.792713+0000","last_peered":"2023-11-28T20:00:13.792713+0000","last_clean":"2023-11-28T20:00:13.792713+0000","last_became_active":"2023-11-28T20:00:12.786509+0000","last_became_peered":"2023-11-28T20:00:12.786509+0000","last_unstale":"2023-11-28T20:00:13.792713+0000","last_undegraded":"2023-11-28T20:00:13.792713+0000","last_fullsized":"2023-11-28T20:00:13.792713+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:11.760656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:11.760656+0000","last_clean_scrub_stamp":"2023-11-28T20:00:11.760656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:05:35.913865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-11-28T20:00:15.001016+0000","last_change":"2023-11-28T20:00:13.802160+0000","last_active":"2023-11-28T20:00:15.001016+0000","last_peered":"2023-11-28T20:00:15.001016+0000","last_clean":"2023-11-28T20:00:15.001016+0000","last_became_active":"2023-11-28T20:00:13.801877+0000","last_became_peered":"2023-11-28T20:00:13.801877+0000","last_unstale":"2023-11-28T20:00:15.001016+0000","last_undegraded":"2023-11-28T20:00:15.001016+0000","last_fullsized":"2023-11-28T20:00:15.001016+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_clean_scrub_stamp":"2023-11-28T20:00:12.764355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T06:58:51.315382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"39'2","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-28T20:00:13.814879+0000","last_change":"2023-11-28T20:00:12.804126+0000","last_active":"2023-11-28T20:00:13.814879+0000","last_peered":"2023-11-28T20:00:13.814879+0000","last_clean":"2023-11-28T20:00:13.814879+0000","last_became_active":"2023-11-28T20:00:12.803815+0000","last_became_peered":"2023-11-28T20:00:12.803815+0000","last_unstale":"2023-11-28T20:00:13.814879+0000","last_undegraded":"2023-11-28T20:00:13.814879+0000","last_fullsized":"2023-11-28T20:00:13.814879+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:11.760656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:11.760656+0000","last_clean_scrub_stamp":"2023-11-28T20:00:11.760656+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T06:11:16.755424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-11-28T20:00:15.001516+0000","last_change":"2023-11-28T20:00:13.825316+0000","last_active":"2023-11-28T20:00:15.001516+0000","last_peered":"2023-11-28T20:00:15.001516+0000","last_clean":"2023-11-28T20:00:15.001516+0000","last_became_active":"2023-11-28T20:00:13.824862+0000","last_became_peered":"2023-11-28T20:00:13.824862+0000","last_unstale":"2023-11-28T20:00:15.001516+0000","last_undegraded":"2023-11-28T20:00:15.001516+0000","last_fullsized":"2023-11-28T20:00:15.001516+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_clean_scrub_stamp":"2023-11-28T20:00:12.764355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T06:11:17.759123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.6","version":"40'1","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-11-28T20:00:15.001619+0000","last_change":"2023-11-28T20:00:12.804114+0000","last_active":"2023-11-28T20:00:15.001619+0000","last_peered":"2023-11-28T20:00:15.001619+0000","last_clean":"2023-11-28T20:00:15.001619+0000","last_became_active":"2023-11-28T20:00:12.803528+0000","last_became_peered":"2023-11-28T20:00:12.803528+0000","last_unstale":"2023-11-28T20:00:15.001619+0000","last_undegraded":"2023-11-28T20:00:15.001619+0000","last_fullsized":"2023-11-28T20:00:15.001619+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:11.760656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:11.760656+0000","last_clean_scrub_stamp":"2023-11-28T20:00:11.760656+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:08:56.081544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-11-28T20:00:14.799954+0000","last_change":"2023-11-28T20:00:13.789592+0000","last_active":"2023-11-28T20:00:14.799954+0000","last_peered":"2023-11-28T20:00:14.799954+0000","last_clean":"2023-11-28T20:00:14.799954+0000","last_became_active":"2023-11-28T20:00:13.789304+0000","last_became_peered":"2023-11-28T20:00:13.789304+0000","last_unstale":"2023-11-28T20:00:14.799954+0000","last_undegraded":"2023-11-28T20:00:14.799954+0000","last_fullsized":"2023-11-28T20:00:14.799954+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_clean_scrub_stamp":"2023-11-28T20:00:12.764355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:59:35.199336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-28T20:00:13.798077+0000","last_change":"2023-11-28T20:00:12.795099+0000","last_active":"2023-11-28T20:00:13.798077+0000","last_peered":"2023-11-28T20:00:13.798077+0000","last_clean":"2023-11-28T20:00:13.798077+0000","last_became_active":"2023-11-28T20:00:12.794522+0000","last_became_peered":"2023-11-28T20:00:12.794522+0000","last_unstale":"2023-11-28T20:00:13.798077+0000","last_undegraded":"2023-11-28T20:00:13.798077+0000","last_fullsized":"2023-11-28T20:00:13.798077+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:11.760656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:11.760656+0000","last_clean_scrub_stamp":"2023-11-28T20:00:11.760656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:42:32.303144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-11-28T20:00:15.000457+0000","last_change":"2023-11-28T20:00:13.805383+0000","last_active":"2023-11-28T20:00:15.000457+0000","last_peered":"2023-11-28T20:00:15.000457+0000","last_clean":"2023-11-28T20:00:15.000457+0000","last_became_active":"2023-11-28T20:00:13.805090+0000","last_became_peered":"2023-11-28T20:00:13.805090+0000","last_unstale":"2023-11-28T20:00:15.000457+0000","last_undegraded":"2023-11-28T20:00:15.000457+0000","last_fullsized":"2023-11-28T20:00:15.000457+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_clean_scrub_stamp":"2023-11-28T20:00:12.764355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:18:53.216142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-28T20:00:13.795213+0000","last_change":"2023-11-28T20:00:12.792743+0000","last_active":"2023-11-28T20:00:13.795213+0000","last_peered":"2023-11-28T20:00:13.795213+0000","last_clean":"2023-11-28T20:00:13.795213+0000","last_became_active":"2023-11-28T20:00:12.792420+0000","last_became_peered":"2023-11-28T20:00:12.792420+0000","last_unstale":"2023-11-28T20:00:13.795213+0000","last_undegraded":"2023-11-28T20:00:13.795213+0000","last_fullsized":"2023-11-28T20:00:13.795213+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:11.760656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:11.760656+0000","last_clean_scrub_stamp":"2023-11-28T20:00:11.760656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T07:54:02.325947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-11-28T20:00:15.000505+0000","last_change":"2023-11-28T20:00:13.802746+0000","last_active":"2023-11-28T20:00:15.000505+0000","last_peered":"2023-11-28T20:00:15.000505+0000","last_clean":"2023-11-28T20:00:15.000505+0000","last_became_active":"2023-11-28T20:00:13.802510+0000","last_became_peered":"2023-11-28T20:00:13.802510+0000","last_unstale":"2023-11-28T20:00:15.000505+0000","last_undegraded":"2023-11-28T20:00:15.000505+0000","last_fullsized":"2023-11-28T20:00:15.000505+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_clean_scrub_stamp":"2023-11-28T20:00:12.764355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:20:11.234527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-28T20:00:13.799102+0000","last_change":"2023-11-28T20:00:12.793819+0000","last_active":"2023-11-28T20:00:13.799102+0000","last_peered":"2023-11-28T20:00:13.799102+0000","last_clean":"2023-11-28T20:00:13.799102+0000","last_became_active":"2023-11-28T20:00:12.793027+0000","last_became_peered":"2023-11-28T20:00:12.793027+0000","last_unstale":"2023-11-28T20:00:13.799102+0000","last_undegraded":"2023-11-28T20:00:13.799102+0000","last_fullsized":"2023-11-28T20:00:13.799102+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:11.760656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:11.760656+0000","last_clean_scrub_stamp":"2023-11-28T20:00:11.760656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T06:41:49.723414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-11-28T20:00:14.798506+0000","last_change":"2023-11-28T20:00:13.803188+0000","last_active":"2023-11-28T20:00:14.798506+0000","last_peered":"2023-11-28T20:00:14.798506+0000","last_clean":"2023-11-28T20:00:14.798506+0000","last_became_active":"2023-11-28T20:00:13.798040+0000","last_became_peered":"2023-11-28T20:00:13.798040+0000","last_unstale":"2023-11-28T20:00:14.798506+0000","last_undegraded":"2023-11-28T20:00:14.798506+0000","last_fullsized":"2023-11-28T20:00:14.798506+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_clean_scrub_stamp":"2023-11-28T20:00:12.764355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:39:05.453623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-28T20:00:13.782226+0000","last_change":"2023-11-28T20:00:12.790049+0000","last_active":"2023-11-28T20:00:13.782226+0000","last_peered":"2023-11-28T20:00:13.782226+0000","last_clean":"2023-11-28T20:00:13.782226+0000","last_became_active":"2023-11-28T20:00:12.789755+0000","last_became_peered":"2023-11-28T20:00:12.789755+0000","last_unstale":"2023-11-28T20:00:13.782226+0000","last_undegraded":"2023-11-28T20:00:13.782226+0000","last_fullsized":"2023-11-28T20:00:13.782226+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:11.760656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:11.760656+0000","last_clean_scrub_stamp":"2023-11-28T20:00:11.760656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T06:41:49.723414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-11-28T20:00:15.001519+0000","last_change":"2023-11-28T20:00:13.823182+0000","last_active":"2023-11-28T20:00:15.001519+0000","last_peered":"2023-11-28T20:00:15.001519+0000","last_clean":"2023-11-28T20:00:15.001519+0000","last_became_active":"2023-11-28T20:00:13.822797+0000","last_became_peered":"2023-11-28T20:00:13.822797+0000","last_unstale":"2023-11-28T20:00:15.001519+0000","last_undegraded":"2023-11-28T20:00:15.001519+0000","last_fullsized":"2023-11-28T20:00:15.001519+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_clean_scrub_stamp":"2023-11-28T20:00:12.764355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:18:27.874818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-28T20:00:13.779424+0000","last_change":"2023-11-28T20:00:12.794531+0000","last_active":"2023-11-28T20:00:13.779424+0000","last_peered":"2023-11-28T20:00:13.779424+0000","last_clean":"2023-11-28T20:00:13.779424+0000","last_became_active":"2023-11-28T20:00:12.794205+0000","last_became_peered":"2023-11-28T20:00:12.794205+0000","last_unstale":"2023-11-28T20:00:13.779424+0000","last_undegraded":"2023-11-28T20:00:13.779424+0000","last_fullsized":"2023-11-28T20:00:13.779424+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:11.760656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:11.760656+0000","last_clean_scrub_stamp":"2023-11-28T20:00:11.760656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T07:13:20.706540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-11-28T20:00:14.800128+0000","last_change":"2023-11-28T20:00:13.798633+0000","last_active":"2023-11-28T20:00:14.800128+0000","last_peered":"2023-11-28T20:00:14.800128+0000","last_clean":"2023-11-28T20:00:14.800128+0000","last_became_active":"2023-11-28T20:00:13.798291+0000","last_became_peered":"2023-11-28T20:00:13.798291+0000","last_unstale":"2023-11-28T20:00:14.800128+0000","last_undegraded":"2023-11-28T20:00:14.800128+0000","last_fullsized":"2023-11-28T20:00:14.800128+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_clean_scrub_stamp":"2023-11-28T20:00:12.764355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:49:40.934392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-28T20:00:13.797936+0000","last_change":"2023-11-28T20:00:12.795584+0000","last_active":"2023-11-28T20:00:13.797936+0000","last_peered":"2023-11-28T20:00:13.797936+0000","last_clean":"2023-11-28T20:00:13.797936+0000","last_became_active":"2023-11-28T20:00:12.795179+0000","last_became_peered":"2023-11-28T20:00:12.795179+0000","last_unstale":"2023-11-28T20:00:13.797936+0000","last_undegraded":"2023-11-28T20:00:13.797936+0000","last_fullsized":"2023-11-28T20:00:13.797936+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:11.760656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:11.760656+0000","last_clean_scrub_stamp":"2023-11-28T20:00:11.760656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:18:52.212443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":180,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-28T20:00:13.796334+0000","last_change":"2023-11-28T19:58:56.136501+0000","last_active":"2023-11-28T20:00:13.796334+0000","last_peered":"2023-11-28T20:00:13.796334+0000","last_clean":"2023-11-28T20:00:13.796334+0000","last_became_active":"2023-11-28T19:58:56.135998+0000","last_became_peered":"2023-11-28T19:58:56.135998+0000","last_unstale":"2023-11-28T20:00:13.796334+0000","last_undegraded":"2023-11-28T20:00:13.796334+0000","last_fullsized":"2023-11-28T20:00:13.796334+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:58:54.602349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:58:54.602349+0000","last_clean_scrub_stamp":"2023-11-28T19:58:54.602349+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:33:42.723349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":66748,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574869,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27556,"kb_used_data":532,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344284,"statfs":{"total":96636764160,"available":96608546816,"internally_reserved":0,"allocated":544768,"data_stored":790832,"data_compressed":33374,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":13,"apply_latency_ms":13,"commit_latency_ns":13000000,"apply_latency_ns":13000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 19:59:54 2023","interfaces":[{"interface":"back","average":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":0.90700000000000003,"5min":0.90700000000000003,"15min":0.90700000000000003},"last":0.63100000000000001},{"interface":"front","average":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"min":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":0.98999999999999999,"5min":0.98999999999999999,"15min":0.98999999999999999},"last":0.65400000000000003}]},{"osd":1,"last update":"Tue Nov 28 19:59:54 2023","interfaces":[{"interface":"back","average":{"1min":0.64600000000000002,"5min":0.64600000000000002,"15min":0.64600000000000002},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":0.89600000000000002,"5min":0.89600000000000002,"15min":0.89600000000000002},"last":0.60599999999999998},{"interface":"front","average":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.70199999999999996},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":1.0900000000000001,"5min":1.0900000000000001,"15min":1.0900000000000001},"last":0.70699999999999996}]},{"osd":2,"last update":"Tue Nov 28 19:59:54 2023","interfaces":[{"interface":"back","average":{"1min":0.73499999999999999,"5min":0.73499999999999999,"15min":0.73499999999999999},"min":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"max":{"1min":0.98799999999999999,"5min":0.98799999999999999,"15min":0.98799999999999999},"last":0.67800000000000005},{"interface":"front","average":{"1min":0.70699999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":1.0680000000000001,"5min":1.0680000000000001,"15min":1.0680000000000001},"last":0.752}]},{"osd":3,"last update":"Tue Nov 28 19:59:54 2023","interfaces":[{"interface":"back","average":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"min":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":1.0449999999999999,"5min":1.0449999999999999,"15min":1.0449999999999999},"last":0.73699999999999999},{"interface":"front","average":{"1min":0.79300000000000004,"5min":0.79300000000000004,"15min":0.79300000000000004},"min":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"max":{"1min":1.1299999999999999,"5min":1.1299999999999999,"15min":1.1299999999999999},"last":0.76600000000000001}]},{"osd":4,"last update":"Tue Nov 28 19:59:54 2023","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":1.018,"5min":1.018,"15min":1.018},"last":0.78100000000000003},{"interface":"front","average":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"min":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.1120000000000001,"5min":1.1120000000000001,"15min":1.1120000000000001},"last":0.54000000000000004}]},{"osd":5,"last update":"Tue Nov 28 19:59:54 2023","interfaces":[{"interface":"back","average":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":1.1699999999999999,"5min":1.1699999999999999,"15min":1.1699999999999999},"last":0.38100000000000001},{"interface":"front","average":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"min":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":1.1890000000000001,"5min":1.1890000000000001,"15min":1.1890000000000001},"last":0.51200000000000001}]},{"osd":6,"last update":"Tue Nov 28 19:59:54 2023","interfaces":[{"interface":"back","average":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.78200000000000003},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":1.1379999999999999,"5min":1.1379999999999999,"15min":1.1379999999999999},"last":0.71999999999999997},{"interface":"front","average":{"1min":0.747,"5min":0.747,"15min":0.747},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.23,"5min":1.23,"15min":1.23},"last":0.45900000000000002}]}]},{"osd":6,"up_from":13,"seq":55834574867,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27476,"kb_used_data":456,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344364,"statfs":{"total":96636764160,"available":96608628736,"internally_reserved":0,"allocated":466944,"data_stored":199364,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 19:59:53 2023","interfaces":[{"interface":"back","average":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.61599999999999999},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.82599999999999996,"5min":0.82599999999999996,"15min":0.82599999999999996},"last":0.63200000000000001},{"interface":"front","average":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":0.98999999999999999,"5min":0.98999999999999999,"15min":0.98999999999999999},"last":0.71599999999999997}]},{"osd":1,"last update":"Tue Nov 28 19:59:53 2023","interfaces":[{"interface":"back","average":{"1min":0.79100000000000004,"5min":0.79100000000000004,"15min":0.79100000000000004},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.105,"5min":1.105,"15min":1.105},"last":0.76200000000000001},{"interface":"front","average":{"1min":0.68700000000000006,"5min":0.68700000000000006,"15min":0.68700000000000006},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.95899999999999996,"5min":0.95899999999999996,"15min":0.95899999999999996},"last":0.53700000000000003}]},{"osd":2,"last update":"Tue Nov 28 19:59:53 2023","interfaces":[{"interface":"back","average":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"min":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":0.93400000000000005,"5min":0.93400000000000005,"15min":0.93400000000000005},"last":0.66700000000000004},{"interface":"front","average":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"min":{"1min":0.505,"5min":0.505,"15min":0.505},"max":{"1min":1.006,"5min":1.006,"15min":1.006},"last":0.65100000000000002}]},{"osd":3,"last update":"Tue Nov 28 19:59:53 2023","interfaces":[{"interface":"back","average":{"1min":0.749,"5min":0.749,"15min":0.749},"min":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"max":{"1min":1.056,"5min":1.056,"15min":1.056},"last":0.80400000000000005},{"interface":"front","average":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":0.88900000000000001,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.58299999999999996}]},{"osd":4,"last update":"Tue Nov 28 19:59:53 2023","interfaces":[{"interface":"back","average":{"1min":0.63100000000000001,"5min":0.63100000000000001,"15min":0.63100000000000001},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":0.96999999999999997,"5min":0.96999999999999997,"15min":0.96999999999999997},"last":0.78200000000000003},{"interface":"front","average":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":1.389,"5min":1.389,"15min":1.389},"last":0.51200000000000001}]},{"osd":5,"last update":"Tue Nov 28 19:59:53 2023","interfaces":[{"interface":"back","average":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":0.81699999999999995},"min":{"1min":0.5,"5min":0.5,"15min":0.5},"max":{"1min":1.4259999999999999,"5min":1.4259999999999999,"15min":1.4259999999999999},"last":0.83199999999999996},{"interface":"front","average":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"min":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":1.276,"5min":1.276,"15min":1.276},"last":0.69699999999999995}]},{"osd":7,"last update":"Tue Nov 28 19:59:53 2023","interfaces":[{"interface":"back","average":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.71499999999999997},"min":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":0.97599999999999998,"5min":0.97599999999999998,"15min":0.97599999999999998},"last":0.74099999999999999},{"interface":"front","average":{"1min":0.82999999999999996,"5min":0.82999999999999996,"15min":0.82999999999999996},"min":{"1min":0.65600000000000003,"5min":0.65600000000000003,"15min":0.65600000000000003},"max":{"1min":1.242,"5min":1.242,"15min":1.242},"last":0.61099999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574869,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27480,"kb_used_data":460,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344360,"statfs":{"total":96636764160,"available":96608624640,"internally_reserved":0,"allocated":471040,"data_stored":198894,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 19:59:53 2023","interfaces":[{"interface":"back","average":{"1min":0.70999999999999996,"5min":0.70999999999999996,"15min":0.70999999999999996},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":0.997,"5min":0.997,"15min":0.997},"last":0.61499999999999999},{"interface":"front","average":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"min":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":1.149,"5min":1.149,"15min":1.149},"last":0.68999999999999995}]},{"osd":1,"last update":"Tue Nov 28 19:59:53 2023","interfaces":[{"interface":"back","average":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":0.92700000000000005,"5min":0.92700000000000005,"15min":0.92700000000000005},"last":0.74299999999999999},{"interface":"front","average":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":1.0940000000000001,"5min":1.0940000000000001,"15min":1.0940000000000001},"last":0.51300000000000001}]},{"osd":2,"last update":"Tue Nov 28 19:59:53 2023","interfaces":[{"interface":"back","average":{"1min":0.94599999999999995,"5min":0.94599999999999995,"15min":0.94599999999999995},"min":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":5.0880000000000001,"5min":5.0880000000000001,"15min":5.0880000000000001},"last":0.91200000000000003},{"interface":"front","average":{"1min":1.002,"5min":1.002,"15min":1.002},"min":{"1min":0.504,"5min":0.504,"15min":0.504},"max":{"1min":5.1399999999999997,"5min":5.1399999999999997,"15min":5.1399999999999997},"last":0.59199999999999997}]},{"osd":3,"last update":"Tue Nov 28 19:59:53 2023","interfaces":[{"interface":"back","average":{"1min":1.028,"5min":1.028,"15min":1.028},"min":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"max":{"1min":5.0469999999999997,"5min":5.0469999999999997,"15min":5.0469999999999997},"last":0.76300000000000001},{"interface":"front","average":{"1min":1.0009999999999999,"5min":1.0009999999999999,"15min":1.0009999999999999},"min":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":5.024,"5min":5.024,"15min":5.024},"last":0.44700000000000001}]},{"osd":4,"last update":"Tue Nov 28 19:59:53 2023","interfaces":[{"interface":"back","average":{"1min":0.67700000000000005,"5min":0.67700000000000005,"15min":0.67700000000000005},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":1.4810000000000001,"5min":1.4810000000000001,"15min":1.4810000000000001},"last":0.43099999999999999},{"interface":"front","average":{"1min":0.747,"5min":0.747,"15min":0.747},"min":{"1min":0.5,"5min":0.5,"15min":0.5},"max":{"1min":1.6339999999999999,"5min":1.6339999999999999,"15min":1.6339999999999999},"last":0.872}]},{"osd":6,"last update":"Tue Nov 28 19:59:53 2023","interfaces":[{"interface":"back","average":{"1min":0.70699999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":0.97699999999999998,"5min":0.97699999999999998,"15min":0.97699999999999998},"last":0.63600000000000001},{"interface":"front","average":{"1min":0.748,"5min":0.748,"15min":0.748},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":1.099,"5min":1.099,"15min":1.099},"last":0.72099999999999997}]},{"osd":7,"last update":"Tue Nov 28 19:59:53 2023","interfaces":[{"interface":"back","average":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"min":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":1.236,"5min":1.236,"15min":1.236},"last":0.80800000000000005},{"interface":"front","average":{"1min":0.80100000000000005,"5min":0.80100000000000005,"15min":0.80100000000000005},"min":{"1min":0.505,"5min":0.505,"15min":0.505},"max":{"1min":1.0760000000000001,"5min":1.0760000000000001,"15min":1.0760000000000001},"last":0.84899999999999998}]}]},{"osd":4,"up_from":13,"seq":55834574868,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27480,"kb_used_data":460,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344360,"statfs":{"total":96636764160,"available":96608624640,"internally_reserved":0,"allocated":471040,"data_stored":199386,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 19:59:54 2023","interfaces":[{"interface":"back","average":{"1min":0.71099999999999997,"5min":0.71099999999999997,"15min":0.71099999999999997},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":1.0429999999999999,"5min":1.0429999999999999,"15min":1.0429999999999999},"last":0.52200000000000002},{"interface":"front","average":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":1.163,"5min":1.163,"15min":1.163},"last":0.54400000000000004}]},{"osd":1,"last update":"Tue Nov 28 19:59:54 2023","interfaces":[{"interface":"back","average":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"min":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":1.111,"5min":1.111,"15min":1.111},"last":0.41299999999999998},{"interface":"front","average":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"min":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":1.238,"5min":1.238,"15min":1.238},"last":0.61499999999999999}]},{"osd":2,"last update":"Tue Nov 28 19:59:54 2023","interfaces":[{"interface":"back","average":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":0.78300000000000003},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":1.0669999999999999,"5min":1.0669999999999999,"15min":1.0669999999999999},"last":0.57199999999999995},{"interface":"front","average":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":0.81699999999999995},"min":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":1.1180000000000001,"5min":1.1180000000000001,"15min":1.1180000000000001},"last":0.69699999999999995}]},{"osd":3,"last update":"Tue Nov 28 19:59:54 2023","interfaces":[{"interface":"back","average":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"min":{"1min":0.499,"5min":0.499,"15min":0.499},"max":{"1min":1.202,"5min":1.202,"15min":1.202},"last":0.59799999999999998},{"interface":"front","average":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"min":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":1.0589999999999999,"5min":1.0589999999999999,"15min":1.0589999999999999},"last":0.498}]},{"osd":5,"last update":"Tue Nov 28 19:59:54 2023","interfaces":[{"interface":"back","average":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":0.95899999999999996,"5min":0.95899999999999996,"15min":0.95899999999999996},"last":0.78900000000000003},{"interface":"front","average":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":1.034,"5min":1.034,"15min":1.034},"last":0.63900000000000001}]},{"osd":6,"last update":"Tue Nov 28 19:59:54 2023","interfaces":[{"interface":"back","average":{"1min":0.73499999999999999,"5min":0.73499999999999999,"15min":0.73499999999999999},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":1.0309999999999999,"5min":1.0309999999999999,"15min":1.0309999999999999},"last":0.47099999999999997},{"interface":"front","average":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":1.002,"5min":1.002,"15min":1.002},"last":0.746}]},{"osd":7,"last update":"Tue Nov 28 19:59:54 2023","interfaces":[{"interface":"back","average":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"min":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":1.0620000000000001,"5min":1.0620000000000001,"15min":1.0620000000000001},"last":0.67700000000000005},{"interface":"front","average":{"1min":0.87,"5min":0.87,"15min":0.87},"min":{"1min":0.627,"5min":0.627,"15min":0.627},"max":{"1min":1.1459999999999999,"5min":1.1459999999999999,"15min":1.1459999999999999},"last":0.65800000000000003}]}]},{"osd":3,"up_from":13,"seq":55834574869,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27488,"kb_used_data":468,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344352,"statfs":{"total":96636764160,"available":96608616448,"internally_reserved":0,"allocated":479232,"data_stored":200428,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 19:59:52 2023","interfaces":[{"interface":"back","average":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.70199999999999996},"last":0.41999999999999998},{"interface":"front","average":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"min":{"1min":0.312,"5min":0.312,"15min":0.312},"max":{"1min":0.82599999999999996,"5min":0.82599999999999996,"15min":0.82599999999999996},"last":0.28799999999999998}]},{"osd":1,"last update":"Tue Nov 28 19:59:52 2023","interfaces":[{"interface":"back","average":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.84399999999999997,"5min":0.84399999999999997,"15min":0.84399999999999997},"last":0.33400000000000002},{"interface":"front","average":{"1min":0.505,"5min":0.505,"15min":0.505},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.86099999999999999,"5min":0.86099999999999999,"15min":0.86099999999999999},"last":0.373}]},{"osd":2,"last update":"Tue Nov 28 19:59:52 2023","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.85599999999999998,"5min":0.85599999999999998,"15min":0.85599999999999998},"last":0.40699999999999997},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.83699999999999997,"5min":0.83699999999999997,"15min":0.83699999999999997},"last":0.44500000000000001}]},{"osd":4,"last update":"Tue Nov 28 19:59:52 2023","interfaces":[{"interface":"back","average":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":1.206,"5min":1.206,"15min":1.206},"last":0.85299999999999998},{"interface":"front","average":{"1min":0.80300000000000005,"5min":0.80300000000000005,"15min":0.80300000000000005},"min":{"1min":0.503,"5min":0.503,"15min":0.503},"max":{"1min":1.222,"5min":1.222,"15min":1.222},"last":0.89600000000000002}]},{"osd":5,"last update":"Tue Nov 28 19:59:52 2023","interfaces":[{"interface":"back","average":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"min":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":1.151,"5min":1.151,"15min":1.151},"last":0.92900000000000005},{"interface":"front","average":{"1min":0.80300000000000005,"5min":0.80300000000000005,"15min":0.80300000000000005},"min":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":1.3100000000000001,"5min":1.3100000000000001,"15min":1.3100000000000001},"last":0.78700000000000003}]},{"osd":6,"last update":"Tue Nov 28 19:59:52 2023","interfaces":[{"interface":"back","average":{"1min":0.84399999999999997,"5min":0.84399999999999997,"15min":0.84399999999999997},"min":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":1.361,"5min":1.361,"15min":1.361},"last":0.66000000000000003},{"interface":"front","average":{"1min":0.749,"5min":0.749,"15min":0.749},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.125,"5min":1.125,"15min":1.125},"last":0.88100000000000001}]},{"osd":7,"last update":"Tue Nov 28 19:59:52 2023","interfaces":[{"interface":"back","average":{"1min":0.84999999999999998,"5min":0.84999999999999998,"15min":0.84999999999999998},"min":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"max":{"1min":1.2569999999999999,"5min":1.2569999999999999,"15min":1.2569999999999999},"last":0.90700000000000003},{"interface":"front","average":{"1min":0.89100000000000001,"5min":0.89100000000000001,"15min":0.89100000000000001},"min":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"max":{"1min":1.339,"5min":1.339,"15min":1.339},"last":0.73899999999999999}]}]},{"osd":2,"up_from":13,"seq":55834574867,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27476,"kb_used_data":456,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344364,"statfs":{"total":96636764160,"available":96608628736,"internally_reserved":0,"allocated":466944,"data_stored":198852,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 19:59:54 2023","interfaces":[{"interface":"back","average":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"min":{"1min":0.26400000000000001,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"last":0.47899999999999998},{"interface":"front","average":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.67700000000000005,"5min":0.67700000000000005,"15min":0.67700000000000005},"last":0.30499999999999999}]},{"osd":1,"last update":"Tue Nov 28 19:59:54 2023","interfaces":[{"interface":"back","average":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"min":{"1min":0.29899999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":1.0389999999999999,"5min":1.0389999999999999,"15min":1.0389999999999999},"last":0.44500000000000001},{"interface":"front","average":{"1min":0.505,"5min":0.505,"15min":0.505},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.70999999999999996,"5min":0.70999999999999996,"15min":0.70999999999999996},"last":0.374}]},{"osd":3,"last update":"Tue Nov 28 19:59:54 2023","interfaces":[{"interface":"back","average":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"min":{"1min":0.28199999999999997,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.629,"5min":0.629,"15min":0.629},"last":0.40300000000000002},{"interface":"front","average":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.98499999999999999,"5min":0.98499999999999999,"15min":0.98499999999999999},"last":0.5}]},{"osd":4,"last update":"Tue Nov 28 19:59:54 2023","interfaces":[{"interface":"back","average":{"1min":0.86199999999999999,"5min":0.86199999999999999,"15min":0.86199999999999999},"min":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"max":{"1min":1.139,"5min":1.139,"15min":1.139},"last":0.76500000000000001},{"interface":"front","average":{"1min":0.85299999999999998,"5min":0.85299999999999998,"15min":0.85299999999999998},"min":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":1.238,"5min":1.238,"15min":1.238},"last":0.61799999999999999}]},{"osd":5,"last update":"Tue Nov 28 19:59:54 2023","interfaces":[{"interface":"back","average":{"1min":0.88500000000000001,"5min":0.88500000000000001,"15min":0.88500000000000001},"min":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":1.6180000000000001,"5min":1.6180000000000001,"15min":1.6180000000000001},"last":0.78300000000000003},{"interface":"front","average":{"1min":0.83499999999999996,"5min":0.83499999999999996,"15min":0.83499999999999996},"min":{"1min":0.496,"5min":0.496,"15min":0.496},"max":{"1min":1.339,"5min":1.339,"15min":1.339},"last":0.71399999999999997}]},{"osd":6,"last update":"Tue Nov 28 19:59:54 2023","interfaces":[{"interface":"back","average":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":0.80600000000000005},"min":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1.1839999999999999,"5min":1.1839999999999999,"15min":1.1839999999999999},"last":0.74099999999999999},{"interface":"front","average":{"1min":0.86199999999999999,"5min":0.86199999999999999,"15min":0.86199999999999999},"min":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":1.099,"5min":1.099,"15min":1.099},"last":0.66100000000000003}]},{"osd":7,"last update":"Tue Nov 28 19:59:54 2023","interfaces":[{"interface":"back","average":{"1min":0.89000000000000001,"5min":0.89000000000000001,"15min":0.89000000000000001},"min":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":1.4590000000000001,"5min":1.4590000000000001,"15min":1.4590000000000001},"last":0.81399999999999995},{"interface":"front","average":{"1min":0.86699999999999999,"5min":0.86699999999999999,"15min":0.86699999999999999},"min":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":1.387,"5min":1.387,"15min":1.387},"last":0.72399999999999998}]}]},{"osd":1,"up_from":13,"seq":55834574869,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27476,"kb_used_data":456,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344364,"statfs":{"total":96636764160,"available":96608628736,"internally_reserved":0,"allocated":466944,"data_stored":198872,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 19:59:53 2023","interfaces":[{"interface":"back","average":{"1min":0.65800000000000003,"5min":0.65800000000000003,"15min":0.65800000000000003},"min":{"1min":0.31,"5min":0.31,"15min":0.31},"max":{"1min":3.8740000000000001,"5min":3.8740000000000001,"15min":3.8740000000000001},"last":0.52800000000000002},{"interface":"front","average":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"min":{"1min":0.25,"5min":0.25,"15min":0.25},"max":{"1min":2.0760000000000001,"5min":2.0760000000000001,"15min":2.0760000000000001},"last":0.29199999999999998}]},{"osd":2,"last update":"Tue Nov 28 19:59:53 2023","interfaces":[{"interface":"back","average":{"1min":0.65900000000000003,"5min":0.65900000000000003,"15min":0.65900000000000003},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":3.7320000000000002,"5min":3.7320000000000002,"15min":3.7320000000000002},"last":0.51000000000000001},{"interface":"front","average":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":3.9089999999999998,"5min":3.9089999999999998,"15min":3.9089999999999998},"last":0.33200000000000002}]},{"osd":3,"last update":"Tue Nov 28 19:59:53 2023","interfaces":[{"interface":"back","average":{"1min":0.68100000000000005,"5min":0.68100000000000005,"15min":0.68100000000000005},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":1.6399999999999999,"5min":1.6399999999999999,"15min":1.6399999999999999},"last":0.45300000000000001},{"interface":"front","average":{"1min":0.70299999999999996,"5min":0.70299999999999996,"15min":0.70299999999999996},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":2.5270000000000001,"5min":2.5270000000000001,"15min":2.5270000000000001},"last":0.37}]},{"osd":4,"last update":"Tue Nov 28 19:59:53 2023","interfaces":[{"interface":"back","average":{"1min":0.89500000000000002,"5min":0.89500000000000002,"15min":0.89500000000000002},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":3.1659999999999999,"5min":3.1659999999999999,"15min":3.1659999999999999},"last":0.56200000000000006},{"interface":"front","average":{"1min":0.94599999999999995,"5min":0.94599999999999995,"15min":0.94599999999999995},"min":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":3.7959999999999998,"5min":3.7959999999999998,"15min":3.7959999999999998},"last":0.55200000000000005}]},{"osd":5,"last update":"Tue Nov 28 19:59:53 2023","interfaces":[{"interface":"back","average":{"1min":0.98899999999999999,"5min":0.98899999999999999,"15min":0.98899999999999999},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":4.1479999999999997,"5min":4.1479999999999997,"15min":4.1479999999999997},"last":0.54300000000000004},{"interface":"front","average":{"1min":0.91000000000000003,"5min":0.91000000000000003,"15min":0.91000000000000003},"min":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":3.5569999999999999,"5min":3.5569999999999999,"15min":3.5569999999999999},"last":0.66000000000000003}]},{"osd":6,"last update":"Tue Nov 28 19:59:53 2023","interfaces":[{"interface":"back","average":{"1min":0.99199999999999999,"5min":0.99199999999999999,"15min":0.99199999999999999},"min":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":2.863,"5min":2.863,"15min":2.863},"last":0.49299999999999999},{"interface":"front","average":{"1min":0.98299999999999998,"5min":0.98299999999999998,"15min":0.98299999999999998},"min":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"max":{"1min":3.371,"5min":3.371,"15min":3.371},"last":0.63700000000000001}]},{"osd":7,"last update":"Tue Nov 28 19:59:53 2023","interfaces":[{"interface":"back","average":{"1min":1.0129999999999999,"5min":1.0129999999999999,"15min":1.0129999999999999},"min":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"max":{"1min":3.8439999999999999,"5min":3.8439999999999999,"15min":3.8439999999999999},"last":0.64500000000000002},{"interface":"front","average":{"1min":1.038,"5min":1.038,"15min":1.038},"min":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"max":{"1min":3.9689999999999999,"5min":3.9689999999999999,"15min":3.9689999999999999},"last":0.67000000000000004}]}]},{"osd":0,"up_from":13,"seq":55834574868,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27548,"kb_used_data":520,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344292,"statfs":{"total":96636764160,"available":96608555008,"internally_reserved":0,"allocated":532480,"data_stored":789184,"data_compressed":33374,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Nov 28 19:59:56 2023","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.68999999999999995,"15min":0.68999999999999995},"min":{"1min":0.29899999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":4.883,"5min":4.883,"15min":4.883},"last":0.28399999999999997},{"interface":"front","average":{"1min":0.878,"5min":0.878,"15min":0.878},"min":{"1min":0.29399999999999998,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":8.0800000000000001,"5min":8.0800000000000001,"15min":8.0800000000000001},"last":0.47899999999999998}]},{"osd":2,"last update":"Tue Nov 28 19:59:56 2023","interfaces":[{"interface":"back","average":{"1min":0.97399999999999998,"5min":0.97399999999999998,"15min":0.97399999999999998},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":8.1029999999999998,"5min":8.1029999999999998,"15min":8.1029999999999998},"last":0.372},{"interface":"front","average":{"1min":0.98699999999999999,"5min":0.98699999999999999,"15min":0.98699999999999999},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":8.1310000000000002,"5min":8.1310000000000002,"15min":8.1310000000000002},"last":0.42099999999999999}]},{"osd":3,"last update":"Tue Nov 28 19:59:56 2023","interfaces":[{"interface":"back","average":{"1min":0.747,"5min":0.747,"15min":0.747},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":4.3949999999999996,"5min":4.3949999999999996,"15min":4.3949999999999996},"last":0.34999999999999998},{"interface":"front","average":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":4.3470000000000004,"5min":4.3470000000000004,"15min":4.3470000000000004},"last":0.439}]},{"osd":4,"last update":"Tue Nov 28 19:59:56 2023","interfaces":[{"interface":"back","average":{"1min":1.0509999999999999,"5min":1.0509999999999999,"15min":1.0509999999999999},"min":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"max":{"1min":4.6360000000000001,"5min":4.6360000000000001,"15min":4.6360000000000001},"last":0.84399999999999997},{"interface":"front","average":{"1min":1.0529999999999999,"5min":1.0529999999999999,"15min":1.0529999999999999},"min":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":4.4710000000000001,"5min":4.4710000000000001,"15min":4.4710000000000001},"last":0.74399999999999999}]},{"osd":5,"last update":"Tue Nov 28 19:59:56 2023","interfaces":[{"interface":"back","average":{"1min":1.0649999999999999,"5min":1.0649999999999999,"15min":1.0649999999999999},"min":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":4.6120000000000001,"5min":4.6120000000000001,"15min":4.6120000000000001},"last":0.91300000000000003},{"interface":"front","average":{"1min":1.052,"5min":1.052,"15min":1.052},"min":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"max":{"1min":4.5449999999999999,"5min":4.5449999999999999,"15min":4.5449999999999999},"last":0.78000000000000003}]},{"osd":6,"last update":"Tue Nov 28 19:59:56 2023","interfaces":[{"interface":"back","average":{"1min":1.079,"5min":1.079,"15min":1.079},"min":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":4.657,"5min":4.657,"15min":4.657},"last":0.81100000000000005},{"interface":"front","average":{"1min":1.097,"5min":1.097,"15min":1.097},"min":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"max":{"1min":4.5259999999999998,"5min":4.5259999999999998,"15min":4.5259999999999998},"last":0.85999999999999999}]},{"osd":7,"last update":"Tue Nov 28 19:59:56 2023","interfaces":[{"interface":"back","average":{"1min":1.101,"5min":1.101,"15min":1.101},"min":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.60099999999999998},"max":{"1min":4.7320000000000002,"5min":4.7320000000000002,"15min":4.7320000000000002},"last":0.83099999999999996},{"interface":"front","average":{"1min":1.046,"5min":1.046,"15min":1.046},"min":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":4.4939999999999998,"5min":4.4939999999999998,"15min":4.4939999999999998},"last":0.89900000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33374,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33374,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1646,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1682,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-28T20:00:22.709 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-11-28T20:00:22.709 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-11-28T20:00:22.890 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:22.885+0000 7ff8d672a640 1 Processor -- start 2023-11-28T20:00:22.891 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:22.885+0000 7ff8d672a640 1 -- start start 2023-11-28T20:00:22.892 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:22.885+0000 7ff8d672a640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff8d0159c40 0x7ff8d015c030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:22.892 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:22.885+0000 7ff8d672a640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff8d00a4e20 con 0x7ff8d00c5300 2023-11-28T20:00:22.892 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:22.885+0000 7ff8d672a640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff8d00a50e0 con 0x7ff8d014b1e0 2023-11-28T20:00:22.892 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:22.885+0000 7ff8d672a640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8d01558d0 con 0x7ff8d0159c40 2023-11-28T20:00:22.892 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:22.889+0000 7ff8cf7fe640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7ff8d00c5300 0x7ff8d00a9c30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:56532/0 (socket says 172.21.15.78:56532) 2023-11-28T20:00:22.892 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:22.889+0000 7ff8cf7fe640 1 -- 172.21.15.78:0/94971935 learned_addr learned my addr 172.21.15.78:0/94971935 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-11-28T20:00:22.892 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:22.889+0000 7ff8d4cc7640 1 --2- 172.21.15.78:0/94971935 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff8d0159c40 0x7ff8d015c030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:22.893 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:22.889+0000 7ff8ceffd640 1 -- 172.21.15.78:0/94971935 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4121881763 0 0) 0x7ff8d00a4e20 con 0x7ff8d00c5300 2023-11-28T20:00:22.893 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:22.889+0000 7ff8ceffd640 1 -- 172.21.15.78:0/94971935 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff8b8003530 con 0x7ff8d00c5300 2023-11-28T20:00:22.893 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:22.889+0000 7ff8ceffd640 1 -- 172.21.15.78:0/94971935 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3122980463 0 0) 0x7ff8d00a50e0 con 0x7ff8d014b1e0 2023-11-28T20:00:22.893 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:22.889+0000 7ff8ceffd640 1 -- 172.21.15.78:0/94971935 --> v1:172.21.15.179:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff8d00a4e20 con 0x7ff8d014b1e0 2023-11-28T20:00:22.894 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:22.889+0000 7ff8d4cc7640 1 -- 172.21.15.78:0/94971935 >> v1:172.21.15.179:6789/0 conn(0x7ff8d014b1e0 legacy=0x7ff8d00c1700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:00:22.894 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:22.889+0000 7ff8d4cc7640 1 -- 172.21.15.78:0/94971935 >> v1:172.21.15.78:6789/0 conn(0x7ff8d00c5300 legacy=0x7ff8d00a9c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:00:22.894 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:22.889+0000 7ff8d4cc7640 1 -- 172.21.15.78:0/94971935 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8d00c0f00 con 0x7ff8d0159c40 2023-11-28T20:00:22.895 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:22.893+0000 7ff8d4cc7640 1 --2- 172.21.15.78:0/94971935 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff8d0159c40 0x7ff8d015c030 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7ff8c8009dc0 tx=0x7ff8c801c970 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d49e6723049423b3 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:00:22.896 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:22.893+0000 7ff8ceffd640 1 -- 172.21.15.78:0/94971935 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8c80a5940 con 0x7ff8d0159c40 2023-11-28T20:00:22.896 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:22.893+0000 7ff8ceffd640 1 -- 172.21.15.78:0/94971935 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff8c80a5aa0 con 0x7ff8d0159c40 2023-11-28T20:00:22.896 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:22.893+0000 7ff8ceffd640 1 -- 172.21.15.78:0/94971935 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8c80a5e30 con 0x7ff8d0159c40 2023-11-28T20:00:22.897 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:22.893+0000 7ff8d672a640 1 -- 172.21.15.78:0/94971935 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff8d0159c40 msgr2=0x7ff8d015c030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:00:22.897 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:22.893+0000 7ff8d672a640 1 --2- 172.21.15.78:0/94971935 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff8d0159c40 0x7ff8d015c030 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7ff8c8009dc0 tx=0x7ff8c801c970 comp rx=0 tx=0).stop 2023-11-28T20:00:22.897 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:22.893+0000 7ff8d672a640 1 -- 172.21.15.78:0/94971935 shutdown_connections 2023-11-28T20:00:22.897 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:22.893+0000 7ff8d672a640 1 --2- 172.21.15.78:0/94971935 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff8d0159c40 0x7ff8d015c030 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:22.897 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:22.893+0000 7ff8d672a640 1 -- 172.21.15.78:0/94971935 >> 172.21.15.78:0/94971935 conn(0x7ff8d00c59f0 msgr2=0x7ff8d00c5e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:00:22.897 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:22.893+0000 7ff8d672a640 1 -- 172.21.15.78:0/94971935 shutdown_connections 2023-11-28T20:00:22.897 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:22.893+0000 7ff8d672a640 1 -- 172.21.15.78:0/94971935 wait complete. 2023-11-28T20:00:22.898 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:22.893+0000 7ff8d672a640 1 Processor -- start 2023-11-28T20:00:22.898 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:22.893+0000 7ff8d672a640 1 -- start start 2023-11-28T20:00:22.900 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:22.893+0000 7ff8d672a640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff8d00c5300 0x7ff8d0070690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:22.900 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:22.893+0000 7ff8d672a640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff8d014b1e0 0x7ff8d0071930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:22.900 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:22.893+0000 7ff8d672a640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff8d0159c40 0x7ff8d0141190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:22.900 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:22.893+0000 7ff8d672a640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8d0072170 con 0x7ff8d014b1e0 2023-11-28T20:00:22.900 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:22.893+0000 7ff8d672a640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8d0140d00 con 0x7ff8d00c5300 2023-11-28T20:00:22.900 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:22.893+0000 7ff8d672a640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8d0070cc0 con 0x7ff8d0159c40 2023-11-28T20:00:22.900 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:22.893+0000 7ff8cf7fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff8d014b1e0 0x7ff8d0071930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:22.901 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:22.893+0000 7ff8cf7fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff8d014b1e0 0x7ff8d0071930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:52228/0 (socket says 172.21.15.78:52228) 2023-11-28T20:00:22.901 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:22.893+0000 7ff8cf7fe640 1 -- 172.21.15.78:0/4271575910 learned_addr learned my addr 172.21.15.78:0/4271575910 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T20:00:22.901 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:22.897+0000 7ff8d4cc7640 1 --2- 172.21.15.78:0/4271575910 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff8d0159c40 0x7ff8d0141190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:22.901 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:22.897+0000 7ff8cffff640 1 --2- 172.21.15.78:0/4271575910 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff8d00c5300 0x7ff8d0070690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:22.901 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:22.897+0000 7ff8cf7fe640 1 -- 172.21.15.78:0/4271575910 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff8d0159c40 msgr2=0x7ff8d0141190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:00:22.901 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:22.897+0000 7ff8cf7fe640 1 --2- 172.21.15.78:0/4271575910 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff8d0159c40 0x7ff8d0141190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:22.901 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:22.897+0000 7ff8cf7fe640 1 -- 172.21.15.78:0/4271575910 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff8d00c5300 msgr2=0x7ff8d0070690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:00:22.901 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:22.897+0000 7ff8cf7fe640 1 --2- 172.21.15.78:0/4271575910 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff8d00c5300 0x7ff8d0070690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:22.901 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:22.897+0000 7ff8cf7fe640 1 -- 172.21.15.78:0/4271575910 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8c8009a70 con 0x7ff8d014b1e0 2023-11-28T20:00:22.901 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:22.897+0000 7ff8cffff640 1 --2- 172.21.15.78:0/4271575910 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff8d00c5300 0x7ff8d0070690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T20:00:22.901 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:22.897+0000 7ff8cf7fe640 1 --2- 172.21.15.78:0/4271575910 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff8d014b1e0 0x7ff8d0071930 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7ff8c400c4f0 tx=0x7ff8c400c9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:00:22.902 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:22.897+0000 7ff8ccff9640 1 -- 172.21.15.78:0/4271575910 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8c4005cf0 con 0x7ff8d014b1e0 2023-11-28T20:00:22.902 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:22.897+0000 7ff8ccff9640 1 -- 172.21.15.78:0/4271575910 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff8c4005e50 con 0x7ff8d014b1e0 2023-11-28T20:00:22.903 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:22.897+0000 7ff8ccff9640 1 -- 172.21.15.78:0/4271575910 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8c4007270 con 0x7ff8d014b1e0 2023-11-28T20:00:22.903 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:22.897+0000 7ff8d672a640 1 -- 172.21.15.78:0/4271575910 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff8d0070fa0 con 0x7ff8d014b1e0 2023-11-28T20:00:22.903 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:22.897+0000 7ff8d672a640 1 -- 172.21.15.78:0/4271575910 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff8d0140990 con 0x7ff8d014b1e0 2023-11-28T20:00:22.903 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:22.897+0000 7ff8d672a640 1 -- 172.21.15.78:0/4271575910 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff8d0067630 con 0x7ff8d014b1e0 2023-11-28T20:00:22.903 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:22.897+0000 7ff8ccff9640 1 -- 172.21.15.78:0/4271575910 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7ff8c40073d0 con 0x7ff8d014b1e0 2023-11-28T20:00:22.904 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:22.901+0000 7ff8ccff9640 1 --2- 172.21.15.78:0/4271575910 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7ff8bc0664a0 0x7ff8bc068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:22.904 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:22.901+0000 7ff8ccff9640 1 -- 172.21.15.78:0/4271575910 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6029+0+0 (secure 0 0 0) 0x7ff8c40833d0 con 0x7ff8d014b1e0 2023-11-28T20:00:22.904 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:22.901+0000 7ff8cffff640 1 --2- 172.21.15.78:0/4271575910 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7ff8bc0664a0 0x7ff8bc068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:22.904 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:22.901+0000 7ff8cffff640 1 --2- 172.21.15.78:0/4271575910 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7ff8bc0664a0 0x7ff8bc068960 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7ff8c00011f0 tx=0x7ff8c0009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:00:22.908 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:22.905+0000 7ff8ccff9640 1 -- 172.21.15.78:0/4271575910 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7ff8c40507c0 con 0x7ff8d014b1e0 2023-11-28T20:00:23.112 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:23.109+0000 7ff8d672a640 1 -- 172.21.15.78:0/4271575910 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7ff8d01496c0 con 0x7ff8d014b1e0 2023-11-28T20:00:23.114 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:23.109+0000 7ff8ccff9640 1 -- 172.21.15.78:0/4271575910 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v13) v1 ==== 190+0+147 (secure 0 0 0) 0x7ff8c40170b0 con 0x7ff8d014b1e0 2023-11-28T20:00:23.114 INFO:teuthology.orchestra.run.smithi078.stdout:[client.0] 2023-11-28T20:00:23.115 INFO:teuthology.orchestra.run.smithi078.stdout: key = AQBORmZlPLeINhAAMdB7hy84hvX1S/pHYfkeJg== 2023-11-28T20:00:23.115 INFO:teuthology.orchestra.run.smithi078.stdout: caps mds = "allow" 2023-11-28T20:00:23.115 INFO:teuthology.orchestra.run.smithi078.stdout: caps mon = "allow r" 2023-11-28T20:00:23.115 INFO:teuthology.orchestra.run.smithi078.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2023-11-28T20:00:23.115 INFO:teuthology.orchestra.run.smithi078.stderr:updated caps for client.0 2023-11-28T20:00:23.116 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:23.113+0000 7ff8d672a640 1 -- 172.21.15.78:0/4271575910 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7ff8bc0664a0 msgr2=0x7ff8bc068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:00:23.117 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:23.113+0000 7ff8d672a640 1 --2- 172.21.15.78:0/4271575910 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7ff8bc0664a0 0x7ff8bc068960 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7ff8c00011f0 tx=0x7ff8c0009040 comp rx=0 tx=0).stop 2023-11-28T20:00:23.117 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:23.113+0000 7ff8d672a640 1 -- 172.21.15.78:0/4271575910 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff8d014b1e0 msgr2=0x7ff8d0071930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:00:23.117 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:23.113+0000 7ff8d672a640 1 --2- 172.21.15.78:0/4271575910 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff8d014b1e0 0x7ff8d0071930 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7ff8c400c4f0 tx=0x7ff8c400c9b0 comp rx=0 tx=0).stop 2023-11-28T20:00:23.117 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:23.113+0000 7ff8d672a640 1 -- 172.21.15.78:0/4271575910 shutdown_connections 2023-11-28T20:00:23.117 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:23.113+0000 7ff8d672a640 1 --2- 172.21.15.78:0/4271575910 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7ff8bc0664a0 0x7ff8bc068960 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:23.117 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:23.113+0000 7ff8d672a640 1 --2- 172.21.15.78:0/4271575910 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff8d0159c40 0x7ff8d0141190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:23.117 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:23.113+0000 7ff8d672a640 1 --2- 172.21.15.78:0/4271575910 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff8d014b1e0 0x7ff8d0071930 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:23.117 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:23.113+0000 7ff8d672a640 1 --2- 172.21.15.78:0/4271575910 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff8d00c5300 0x7ff8d0070690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:23.117 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:23.113+0000 7ff8d672a640 1 -- 172.21.15.78:0/4271575910 >> 172.21.15.78:0/4271575910 conn(0x7ff8d00c59f0 msgr2=0x7ff8d0149be0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:00:23.117 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:23.113+0000 7ff8d672a640 1 -- 172.21.15.78:0/4271575910 shutdown_connections 2023-11-28T20:00:23.117 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:23.113+0000 7ff8d672a640 1 -- 172.21.15.78:0/4271575910 wait complete. 2023-11-28T20:00:23.135 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-28T20:00:23.272 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:23.269+0000 7fa754172640 1 Processor -- start 2023-11-28T20:00:23.272 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:23.269+0000 7fa754172640 1 -- start start 2023-11-28T20:00:23.273 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:23.269+0000 7fa754172640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fa74c06d2b0 0x7fa74c06d690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:23.274 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:23.269+0000 7fa754172640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa74c0c5300 0x7fa74c06c730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:23.274 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:23.269+0000 7fa754172640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa74c06bb80 con 0x7fa74c0c3b80 2023-11-28T20:00:23.274 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:23.269+0000 7fa754172640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa74c06cc70 con 0x7fa74c06d2b0 2023-11-28T20:00:23.274 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:23.269+0000 7fa754172640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa74c0c5790 con 0x7fa74c0c5300 2023-11-28T20:00:23.274 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:23.269+0000 7fa751f0e640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fa74c06d2b0 0x7fa74c06d690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:23.274 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:23.269+0000 7fa75270f640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa74c0c5300 0x7fa74c06c730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:23.275 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:23.269+0000 7fa75270f640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa74c0c5300 0x7fa74c06c730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3301/0 says I am v2:172.21.15.78:51914/0 (socket says 172.21.15.78:51914) 2023-11-28T20:00:23.275 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:23.269+0000 7fa751f0e640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fa74c06d2b0 0x7fa74c06d690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.78:54198/0 (socket says 172.21.15.78:54198) 2023-11-28T20:00:23.275 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:23.269+0000 7fa75170d640 1 --1- >> v1:172.21.15.179:6789/0 conn(0x7fa74c0c3b80 0x7fa74c06c020 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.179:6789/0 says I am v1:172.21.15.78:38144/0 (socket says 172.21.15.78:38144) 2023-11-28T20:00:23.275 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:23.269+0000 7fa75270f640 1 -- 172.21.15.78:0/1167702732 learned_addr learned my addr 172.21.15.78:0/1167702732 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T20:00:23.275 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:23.269+0000 7fa750f0c640 1 -- 172.21.15.78:0/1167702732 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1338253571 0 0) 0x7fa74c06bb80 con 0x7fa74c0c3b80 2023-11-28T20:00:23.276 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:23.269+0000 7fa75270f640 1 -- 172.21.15.78:0/1167702732 >> v2:172.21.15.179:3300/0 conn(0x7fa74c06d2b0 msgr2=0x7fa74c06d690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:00:23.276 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:23.269+0000 7fa75270f640 1 --2- 172.21.15.78:0/1167702732 >> v2:172.21.15.179:3300/0 conn(0x7fa74c06d2b0 0x7fa74c06d690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:23.276 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:23.269+0000 7fa75270f640 1 -- 172.21.15.78:0/1167702732 >> v1:172.21.15.179:6789/0 conn(0x7fa74c0c3b80 legacy=0x7fa74c06c020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:00:23.276 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:23.269+0000 7fa75270f640 1 -- 172.21.15.78:0/1167702732 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa74c1515c0 con 0x7fa74c0c5300 2023-11-28T20:00:23.278 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:23.273+0000 7fa75270f640 1 --2- 172.21.15.78:0/1167702732 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa74c0c5300 0x7fa74c06c730 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fa744009e50 tx=0x7fa74401c9e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e1998ca7c9601876 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:00:23.278 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:23.273+0000 7fa750f0c640 1 -- 172.21.15.78:0/1167702732 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7440a56c0 con 0x7fa74c0c5300 2023-11-28T20:00:23.278 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:23.273+0000 7fa750f0c640 1 -- 172.21.15.78:0/1167702732 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa7440a5820 con 0x7fa74c0c5300 2023-11-28T20:00:23.278 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:23.273+0000 7fa750f0c640 1 -- 172.21.15.78:0/1167702732 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7440a5bb0 con 0x7fa74c0c5300 2023-11-28T20:00:23.279 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:23.273+0000 7fa754172640 1 -- 172.21.15.78:0/1167702732 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa74c0c5300 msgr2=0x7fa74c06c730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:00:23.279 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:23.273+0000 7fa754172640 1 --2- 172.21.15.78:0/1167702732 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa74c0c5300 0x7fa74c06c730 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fa744009e50 tx=0x7fa74401c9e0 comp rx=0 tx=0).stop 2023-11-28T20:00:23.279 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:23.273+0000 7fa754172640 1 -- 172.21.15.78:0/1167702732 shutdown_connections 2023-11-28T20:00:23.279 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:23.273+0000 7fa754172640 1 --2- 172.21.15.78:0/1167702732 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa74c0c5300 0x7fa74c06c730 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:23.280 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:23.273+0000 7fa754172640 1 --2- 172.21.15.78:0/1167702732 >> v2:172.21.15.179:3300/0 conn(0x7fa74c06d2b0 0x7fa74c06d690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:23.280 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:23.273+0000 7fa754172640 1 -- 172.21.15.78:0/1167702732 >> 172.21.15.78:0/1167702732 conn(0x7fa74c0a7810 msgr2=0x7fa74c0a7c20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:00:23.280 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:23.273+0000 7fa754172640 1 -- 172.21.15.78:0/1167702732 shutdown_connections 2023-11-28T20:00:23.280 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:23.273+0000 7fa754172640 1 -- 172.21.15.78:0/1167702732 wait complete. 2023-11-28T20:00:23.280 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:23.277+0000 7fa754172640 1 Processor -- start 2023-11-28T20:00:23.281 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:23.277+0000 7fa754172640 1 -- start start 2023-11-28T20:00:23.283 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:23.277+0000 7fa754172640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa74c06d2b0 0x7fa74c157a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:23.283 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:23.277+0000 7fa754172640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa74c0c3b80 0x7fa74c153d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:23.283 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:23.277+0000 7fa754172640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa74c0c5300 0x7fa74c156830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:23.284 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:23.277+0000 7fa754172640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa74c157f70 con 0x7fa74c06d2b0 2023-11-28T20:00:23.284 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:23.277+0000 7fa754172640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa74c156250 con 0x7fa74c0c3b80 2023-11-28T20:00:23.284 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:23.277+0000 7fa754172640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa74c154270 con 0x7fa74c0c5300 2023-11-28T20:00:23.284 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:23.277+0000 7fa751f0e640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa74c06d2b0 0x7fa74c157a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:23.284 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:23.277+0000 7fa751f0e640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa74c06d2b0 0x7fa74c157a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:52236/0 (socket says 172.21.15.78:52236) 2023-11-28T20:00:23.284 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:23.277+0000 7fa751f0e640 1 -- 172.21.15.78:0/1089308086 learned_addr learned my addr 172.21.15.78:0/1089308086 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T20:00:23.284 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:23.277+0000 7fa751f0e640 1 -- 172.21.15.78:0/1089308086 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa74c0c5300 msgr2=0x7fa74c156830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:00:23.284 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:23.277+0000 7fa751f0e640 1 --2- 172.21.15.78:0/1089308086 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa74c0c5300 0x7fa74c156830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:23.284 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:23.277+0000 7fa751f0e640 1 -- 172.21.15.78:0/1089308086 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa74c0c3b80 msgr2=0x7fa74c153d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:00:23.284 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:23.277+0000 7fa75170d640 1 --2- 172.21.15.78:0/1089308086 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa74c0c3b80 0x7fa74c153d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:23.284 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:23.277+0000 7fa751f0e640 1 --2- 172.21.15.78:0/1089308086 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa74c0c3b80 0x7fa74c153d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:23.284 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:23.277+0000 7fa751f0e640 1 -- 172.21.15.78:0/1089308086 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa744009b30 con 0x7fa74c06d2b0 2023-11-28T20:00:23.285 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:23.277+0000 7fa75170d640 1 --2- 172.21.15.78:0/1089308086 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa74c0c3b80 0x7fa74c153d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T20:00:23.285 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:23.277+0000 7fa751f0e640 1 --2- 172.21.15.78:0/1089308086 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa74c06d2b0 0x7fa74c157a30 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7fa74800ed70 tx=0x7fa74800d720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:00:23.285 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:23.277+0000 7fa7427fc640 1 -- 172.21.15.78:0/1089308086 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa74800de30 con 0x7fa74c06d2b0 2023-11-28T20:00:23.285 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:23.277+0000 7fa7427fc640 1 -- 172.21.15.78:0/1089308086 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa748010650 con 0x7fa74c06d2b0 2023-11-28T20:00:23.285 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:23.277+0000 7fa7427fc640 1 -- 172.21.15.78:0/1089308086 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7480109c0 con 0x7fa74c06d2b0 2023-11-28T20:00:23.285 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:23.277+0000 7fa754172640 1 -- 172.21.15.78:0/1089308086 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa74c14ef80 con 0x7fa74c06d2b0 2023-11-28T20:00:23.285 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:23.277+0000 7fa754172640 1 -- 172.21.15.78:0/1089308086 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa74c155ee0 con 0x7fa74c06d2b0 2023-11-28T20:00:23.286 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:23.281+0000 7fa754172640 1 -- 172.21.15.78:0/1089308086 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa74c1f12a0 con 0x7fa74c06d2b0 2023-11-28T20:00:23.286 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:23.281+0000 7fa7427fc640 1 -- 172.21.15.78:0/1089308086 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fa748010b20 con 0x7fa74c06d2b0 2023-11-28T20:00:23.286 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:23.281+0000 7fa7427fc640 1 --2- 172.21.15.78:0/1089308086 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fa730066470 0x7fa730068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:23.286 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:23.281+0000 7fa7427fc640 1 -- 172.21.15.78:0/1089308086 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6029+0+0 (secure 0 0 0) 0x7fa7480849c0 con 0x7fa74c06d2b0 2023-11-28T20:00:23.286 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:23.281+0000 7fa75170d640 1 --2- 172.21.15.78:0/1089308086 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fa730066470 0x7fa730068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:23.287 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:23.281+0000 7fa75170d640 1 --2- 172.21.15.78:0/1089308086 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fa730066470 0x7fa730068930 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fa74c071550 tx=0x7fa73c009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:00:23.290 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:23.285+0000 7fa7427fc640 1 -- 172.21.15.78:0/1089308086 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fa748051db0 con 0x7fa74c06d2b0 2023-11-28T20:00:23.471 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:23.465+0000 7fa754172640 1 -- 172.21.15.78:0/1089308086 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa74c156390 con 0x7fa74c06d2b0 2023-11-28T20:00:23.471 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:23.465+0000 7fa7427fc640 1 -- 172.21.15.78:0/1089308086 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) v1 ==== 94+0+4910 (secure 0 0 0) 0x7fa74801d090 con 0x7fa74c06d2b0 2023-11-28T20:00:23.471 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-11-28T20:00:23.472 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":17,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4880,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6835/20894428","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6834","nonce":20894428},{"type":"v1","addr":"172.21.15.179:6835","nonce":20894428}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":4886,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6837/666703170","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6835","nonce":666703170},{"type":"v1","addr":"172.21.15.78:6837","nonce":666703170}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":5179,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6833/3446403084","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6832","nonce":3446403084},{"type":"v1","addr":"172.21.15.179:6833","nonce":3446403084}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-28T20:00:13.162273+0000","modified":"2023-11-28T20:00:16.174263+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5185},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5185":{"gid":5185,"name":"c","rank":0,"incarnation":13,"state":"up:active","state_seq":4,"addr":"172.21.15.78:6836/3508383403","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6834","nonce":3508383403},{"type":"v1","addr":"172.21.15.78:6836","nonce":3508383403}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-11-28T20:00:23.472 INFO:teuthology.orchestra.run.smithi078.stderr:dumped fsmap epoch 17 2023-11-28T20:00:23.473 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:23.469+0000 7fa754172640 1 -- 172.21.15.78:0/1089308086 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fa730066470 msgr2=0x7fa730068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:00:23.474 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:23.469+0000 7fa754172640 1 --2- 172.21.15.78:0/1089308086 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fa730066470 0x7fa730068930 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fa74c071550 tx=0x7fa73c009040 comp rx=0 tx=0).stop 2023-11-28T20:00:23.474 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:23.469+0000 7fa754172640 1 -- 172.21.15.78:0/1089308086 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa74c06d2b0 msgr2=0x7fa74c157a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:00:23.474 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:23.469+0000 7fa754172640 1 --2- 172.21.15.78:0/1089308086 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa74c06d2b0 0x7fa74c157a30 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7fa74800ed70 tx=0x7fa74800d720 comp rx=0 tx=0).stop 2023-11-28T20:00:23.474 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:23.469+0000 7fa754172640 1 -- 172.21.15.78:0/1089308086 shutdown_connections 2023-11-28T20:00:23.474 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:23.469+0000 7fa754172640 1 --2- 172.21.15.78:0/1089308086 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fa730066470 0x7fa730068930 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:23.474 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:23.469+0000 7fa754172640 1 --2- 172.21.15.78:0/1089308086 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa74c0c5300 0x7fa74c156830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:23.474 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:23.469+0000 7fa754172640 1 --2- 172.21.15.78:0/1089308086 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa74c0c3b80 0x7fa74c153d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:23.474 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:23.469+0000 7fa754172640 1 --2- 172.21.15.78:0/1089308086 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa74c06d2b0 0x7fa74c157a30 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:23.474 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:23.469+0000 7fa754172640 1 -- 172.21.15.78:0/1089308086 >> 172.21.15.78:0/1089308086 conn(0x7fa74c0a7810 msgr2=0x7fa74c071f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:00:23.474 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:23.469+0000 7fa754172640 1 -- 172.21.15.78:0/1089308086 shutdown_connections 2023-11-28T20:00:23.474 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:23.469+0000 7fa754172640 1 -- 172.21.15.78:0/1089308086 wait complete. 2023-11-28T20:00:23.894 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 17, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-11-28T20:00:13.162273+0000', 'modified': '2023-11-28T20:00:16.174263+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5185}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5185': {'gid': 5185, 'name': 'c', 'rank': 0, 'incarnation': 13, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.78:6836/3508383403', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.78:6834', 'nonce': 3508383403}, {'type': 'v1', 'addr': '172.21.15.78:6836', 'nonce': 3508383403}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [6], 'metadata_pool': 5, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-11-28T20:00:23.895 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-11-28T20:00:23.895 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2023-11-28T20:00:24.038 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:24.029+0000 7f5b91f2a640 1 Processor -- start 2023-11-28T20:00:24.039 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:24.029+0000 7f5b91f2a640 1 -- start start 2023-11-28T20:00:24.039 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:24.033+0000 7f5b91f2a640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5b8c0a4f90 0x7f5b8c0c59c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:24.039 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:24.033+0000 7f5b91f2a640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f5b8c0a5370 0x7f5b8c14f870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:24.039 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:24.033+0000 7f5b91f2a640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5b8c1524b0 con 0x7f5b8c072810 2023-11-28T20:00:24.039 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:24.033+0000 7f5b91f2a640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5b8c0c62f0 con 0x7f5b8c0a5370 2023-11-28T20:00:24.039 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:24.033+0000 7f5b91f2a640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b8c152770 con 0x7f5b8c0a4f90 2023-11-28T20:00:24.039 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:24.033+0000 7f5b8bfff640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f5b8c072810 0x7f5b8c0c0800 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:56538/0 (socket says 172.21.15.78:56538) 2023-11-28T20:00:24.039 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:24.033+0000 7f5b8bfff640 1 -- 172.21.15.78:0/1124365609 learned_addr learned my addr 172.21.15.78:0/1124365609 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-11-28T20:00:24.039 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:24.033+0000 7f5b8b7fe640 1 --2- 172.21.15.78:0/1124365609 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5b8c0a4f90 0x7f5b8c0c59c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:24.039 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:24.033+0000 7f5b8affd640 1 --2- 172.21.15.78:0/1124365609 >> v2:172.21.15.179:3300/0 conn(0x7f5b8c0a5370 0x7f5b8c14f870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:24.039 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:24.033+0000 7f5b8a7fc640 1 -- 172.21.15.78:0/1124365609 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1243117479 0 0) 0x7f5b8c1524b0 con 0x7f5b8c072810 2023-11-28T20:00:24.040 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:24.033+0000 7f5b8a7fc640 1 -- 172.21.15.78:0/1124365609 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5b74003530 con 0x7f5b8c072810 2023-11-28T20:00:24.040 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:24.033+0000 7f5b8affd640 1 -- 172.21.15.78:0/1124365609 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5b8c0a4f90 msgr2=0x7f5b8c0c59c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:00:24.040 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:24.033+0000 7f5b8affd640 1 --2- 172.21.15.78:0/1124365609 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5b8c0a4f90 0x7f5b8c0c59c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:24.040 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:24.033+0000 7f5b8affd640 1 -- 172.21.15.78:0/1124365609 >> v1:172.21.15.78:6789/0 conn(0x7f5b8c072810 legacy=0x7f5b8c0c0800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:00:24.040 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:24.033+0000 7f5b8a7fc640 1 -- 172.21.15.78:0/1124365609 <== mon.0 v1:172.21.15.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4277742397 0 0) 0x7f5b74003530 con 0x7f5b8c072810 2023-11-28T20:00:24.040 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:24.033+0000 7f5b8affd640 1 -- 172.21.15.78:0/1124365609 --> v2:172.21.15.179:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b8c152a50 con 0x7f5b8c0a5370 2023-11-28T20:00:24.041 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:24.037+0000 7f5b8affd640 1 --2- 172.21.15.78:0/1124365609 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5b8c0a5370 0x7f5b8c14f870 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f5b800097c0 tx=0x7f5b8001c310 comp rx=0 tx=0).ready entity=mon.1 client_cookie=97c6ac8d09bc6efc server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:00:24.041 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:24.037+0000 7f5b8a7fc640 1 -- 172.21.15.78:0/1124365609 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b84001a00 con 0x7f5b8c0a5370 2023-11-28T20:00:24.041 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:24.037+0000 7f5b8a7fc640 1 -- 172.21.15.78:0/1124365609 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b800a7050 con 0x7f5b8c0a5370 2023-11-28T20:00:24.041 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:24.037+0000 7f5b8a7fc640 1 -- 172.21.15.78:0/1124365609 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b800ab600 con 0x7f5b8c0a5370 2023-11-28T20:00:24.042 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:24.037+0000 7f5b91f2a640 1 -- 172.21.15.78:0/1124365609 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5b8c0a5370 msgr2=0x7f5b8c14f870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:00:24.042 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:24.037+0000 7f5b91f2a640 1 --2- 172.21.15.78:0/1124365609 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5b8c0a5370 0x7f5b8c14f870 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f5b800097c0 tx=0x7f5b8001c310 comp rx=0 tx=0).stop 2023-11-28T20:00:24.042 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:24.037+0000 7f5b91f2a640 1 -- 172.21.15.78:0/1124365609 shutdown_connections 2023-11-28T20:00:24.042 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:24.037+0000 7f5b91f2a640 1 --2- 172.21.15.78:0/1124365609 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5b8c0a5370 0x7f5b8c14f870 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:24.042 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:24.037+0000 7f5b91f2a640 1 --2- 172.21.15.78:0/1124365609 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5b8c0a4f90 0x7f5b8c0c59c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:24.042 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:24.037+0000 7f5b91f2a640 1 -- 172.21.15.78:0/1124365609 >> 172.21.15.78:0/1124365609 conn(0x7f5b8c06b220 msgr2=0x7f5b8c0a77e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:00:24.042 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:24.037+0000 7f5b91f2a640 1 -- 172.21.15.78:0/1124365609 shutdown_connections 2023-11-28T20:00:24.042 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:24.037+0000 7f5b91f2a640 1 -- 172.21.15.78:0/1124365609 wait complete. 2023-11-28T20:00:24.043 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:24.037+0000 7f5b91f2a640 1 Processor -- start 2023-11-28T20:00:24.043 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:24.037+0000 7f5b91f2a640 1 -- start start 2023-11-28T20:00:24.046 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:24.041+0000 7f5b91f2a640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5b8c072810 0x7f5b8c155c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:24.046 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:24.041+0000 7f5b91f2a640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5b8c0a4f90 0x7f5b8c14edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:24.046 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:24.041+0000 7f5b91f2a640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5b8c0a5370 0x7f5b8c14f2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:24.047 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:24.041+0000 7f5b91f2a640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b8c0c00d0 con 0x7f5b8c0a4f90 2023-11-28T20:00:24.047 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:24.041+0000 7f5b91f2a640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b8c1eb4d0 con 0x7f5b8c0a5370 2023-11-28T20:00:24.047 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:24.041+0000 7f5b91f2a640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b8c1eba00 con 0x7f5b8c072810 2023-11-28T20:00:24.047 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:24.041+0000 7f5b8affd640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5b8c0a4f90 0x7f5b8c14edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:24.047 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:24.041+0000 7f5b8affd640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5b8c0a4f90 0x7f5b8c14edb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:52238/0 (socket says 172.21.15.78:52238) 2023-11-28T20:00:24.047 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:24.041+0000 7f5b8affd640 1 -- 172.21.15.78:0/972835545 learned_addr learned my addr 172.21.15.78:0/972835545 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T20:00:24.047 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:24.041+0000 7f5b8bfff640 1 --2- 172.21.15.78:0/972835545 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5b8c0a5370 0x7f5b8c14f2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:24.048 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:24.041+0000 7f5b8b7fe640 1 --2- 172.21.15.78:0/972835545 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5b8c072810 0x7f5b8c155c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:24.048 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:24.041+0000 7f5b8affd640 1 -- 172.21.15.78:0/972835545 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5b8c072810 msgr2=0x7f5b8c155c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:00:24.048 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:24.041+0000 7f5b8affd640 1 --2- 172.21.15.78:0/972835545 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5b8c072810 0x7f5b8c155c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:24.048 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:24.041+0000 7f5b8affd640 1 -- 172.21.15.78:0/972835545 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5b8c0a5370 msgr2=0x7f5b8c14f2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:00:24.048 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:24.041+0000 7f5b8affd640 1 --2- 172.21.15.78:0/972835545 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5b8c0a5370 0x7f5b8c14f2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:24.048 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:24.041+0000 7f5b8affd640 1 -- 172.21.15.78:0/972835545 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b80009420 con 0x7f5b8c0a4f90 2023-11-28T20:00:24.048 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:24.041+0000 7f5b8affd640 1 --2- 172.21.15.78:0/972835545 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5b8c0a4f90 0x7f5b8c14edb0 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f5b8001a9c0 tx=0x7f5b800190b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:00:24.048 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:24.041+0000 7f5b73fff640 1 -- 172.21.15.78:0/972835545 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b80006e20 con 0x7f5b8c0a4f90 2023-11-28T20:00:24.049 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:24.041+0000 7f5b73fff640 1 -- 172.21.15.78:0/972835545 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b800b4400 con 0x7f5b8c0a4f90 2023-11-28T20:00:24.049 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:24.041+0000 7f5b91f2a640 1 -- 172.21.15.78:0/972835545 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5b8c0bfb50 con 0x7f5b8c0a4f90 2023-11-28T20:00:24.049 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:24.041+0000 7f5b73fff640 1 -- 172.21.15.78:0/972835545 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b800b4770 con 0x7f5b8c0a4f90 2023-11-28T20:00:24.049 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:24.041+0000 7f5b91f2a640 1 -- 172.21.15.78:0/972835545 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5b8c1eb720 con 0x7f5b8c0a4f90 2023-11-28T20:00:24.051 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:24.041+0000 7f5b73fff640 1 -- 172.21.15.78:0/972835545 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f5b800b2040 con 0x7f5b8c0a4f90 2023-11-28T20:00:24.051 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:24.045+0000 7f5b73fff640 1 --2- 172.21.15.78:0/972835545 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f5b78066470 0x7f5b78068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:24.051 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:24.045+0000 7f5b73fff640 1 -- 172.21.15.78:0/972835545 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f5b8011dd70 con 0x7f5b8c0a4f90 2023-11-28T20:00:24.051 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:24.045+0000 7f5b8b7fe640 1 --2- 172.21.15.78:0/972835545 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f5b78066470 0x7f5b78068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:24.051 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:24.045+0000 7f5b952b0000 1 Processor -- start 2023-11-28T20:00:24.052 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:24.045+0000 7f5b952b0000 1 -- start start 2023-11-28T20:00:24.052 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:24.045+0000 7f5b8b7fe640 1 --2- 172.21.15.78:0/972835545 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f5b78066470 0x7f5b78068930 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f5b7c009b60 tx=0x7f5b7c009190 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:00:24.052 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:24.045+0000 7f5b952b0000 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x561fa05bd920 0x561fa05bdd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:24.052 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:24.045+0000 7f5b952b0000 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x561fa05846f0 0x561fa0584ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:24.052 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:24.045+0000 7f5b952b0000 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x561fa0585010 0x561fa05853f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:24.052 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:24.045+0000 7f5b952b0000 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x561fa03ed130 con 0x561fa05bd920 2023-11-28T20:00:24.052 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:24.045+0000 7f5b952b0000 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x561fa03da9a0 con 0x561fa05846f0 2023-11-28T20:00:24.052 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:24.045+0000 7f5b952b0000 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x561fa03d7ed0 con 0x561fa0585010 2023-11-28T20:00:24.052 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:24.045+0000 7f5b8b7fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x561fa05bd920 0x561fa05bdd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:24.052 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:24.045+0000 7f5b8b7fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x561fa05bd920 0x561fa05bdd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:52242/0 (socket says 172.21.15.78:52242) 2023-11-28T20:00:24.053 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:24.045+0000 7f5b8b7fe640 1 -- 172.21.15.78:0/1107741270 learned_addr learned my addr 172.21.15.78:0/1107741270 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T20:00:24.053 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:24.045+0000 7f5b8bfff640 1 --2- 172.21.15.78:0/1107741270 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x561fa0585010 0x561fa05853f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:24.053 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:24.045+0000 7f5b8affd640 1 --2- 172.21.15.78:0/1107741270 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x561fa05846f0 0x561fa0584ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:24.053 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:24.045+0000 7f5b8b7fe640 1 -- 172.21.15.78:0/1107741270 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x561fa0585010 msgr2=0x561fa05853f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:00:24.053 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:24.045+0000 7f5b8b7fe640 1 --2- 172.21.15.78:0/1107741270 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x561fa0585010 0x561fa05853f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:24.053 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:24.045+0000 7f5b8b7fe640 1 -- 172.21.15.78:0/1107741270 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x561fa05846f0 msgr2=0x561fa0584ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:00:24.053 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:24.045+0000 7f5b8b7fe640 1 --2- 172.21.15.78:0/1107741270 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x561fa05846f0 0x561fa0584ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:24.054 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:24.045+0000 7f5b8b7fe640 1 -- 172.21.15.78:0/1107741270 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561fa00cb890 con 0x561fa05bd920 2023-11-28T20:00:24.054 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:24.045+0000 7f5b8b7fe640 1 --2- 172.21.15.78:0/1107741270 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x561fa05bd920 0x561fa05bdd00 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f5b7c011ec0 tx=0x7f5b7c014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a7db2c822d241cf2 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:00:24.054 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:24.045+0000 7f5b717fa640 1 -- 172.21.15.78:0/1107741270 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b7c01c040 con 0x561fa05bd920 2023-11-28T20:00:24.054 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:24.045+0000 7f5b717fa640 1 -- 172.21.15.78:0/1107741270 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b7c003830 con 0x561fa05bd920 2023-11-28T20:00:24.054 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:24.045+0000 7f5b717fa640 1 -- 172.21.15.78:0/1107741270 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b7c003ba0 con 0x561fa05bd920 2023-11-28T20:00:24.060 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:24.049+0000 7f5b952b0000 1 -- 172.21.15.78:0/1107741270 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x561fa05bd920 msgr2=0x561fa05bdd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:00:24.060 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:24.049+0000 7f5b952b0000 1 --2- 172.21.15.78:0/1107741270 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x561fa05bd920 0x561fa05bdd00 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f5b7c011ec0 tx=0x7f5b7c014000 comp rx=0 tx=0).stop 2023-11-28T20:00:24.060 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:24.049+0000 7f5b952b0000 1 -- 172.21.15.78:0/1107741270 shutdown_connections 2023-11-28T20:00:24.060 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:24.049+0000 7f5b952b0000 1 --2- 172.21.15.78:0/1107741270 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x561fa0585010 0x561fa05853f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:24.060 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:24.049+0000 7f5b952b0000 1 --2- 172.21.15.78:0/1107741270 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x561fa05846f0 0x561fa0584ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:24.060 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:24.049+0000 7f5b952b0000 1 --2- 172.21.15.78:0/1107741270 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x561fa05bd920 0x561fa05bdd00 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:24.060 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:24.049+0000 7f5b952b0000 1 -- 172.21.15.78:0/1107741270 >> 172.21.15.78:0/1107741270 conn(0x561fa0589190 msgr2=0x561fa05c07a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:00:24.061 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:24.049+0000 7f5b952b0000 1 -- 172.21.15.78:0/1107741270 shutdown_connections 2023-11-28T20:00:24.061 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:24.049+0000 7f5b952b0000 1 -- 172.21.15.78:0/1107741270 wait complete. 2023-11-28T20:00:24.061 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:24.049+0000 7f5b952b0000 1 -- start start 2023-11-28T20:00:24.061 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:24.049+0000 7f5b952b0000 1 Processor -- start 2023-11-28T20:00:24.061 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:24.049+0000 7f5b952b0000 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x561fa05846f0 0x561fa05bc740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:24.062 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:24.049+0000 7f5b952b0000 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x561fa0585010 0x561fa05bcc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:24.062 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:24.049+0000 7f5b952b0000 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x561fa05bd920 0x561fa05c2a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:24.062 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:24.049+0000 7f5b952b0000 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x561fa03d37c0 con 0x561fa0585010 2023-11-28T20:00:24.062 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:24.049+0000 7f5b952b0000 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x561fa038bbf0 con 0x561fa05846f0 2023-11-28T20:00:24.062 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:24.049+0000 7f5b952b0000 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x561fa0391a90 con 0x561fa05bd920 2023-11-28T20:00:24.063 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:24.049+0000 7f5b952b0000 10 client.0 _ll_register_callbacks cb 0x561fa056e3c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-28T20:00:24.063 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:24.049+0000 7f5b8affd640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x561fa0585010 0x561fa05bcc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:24.063 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:24.049+0000 7f5b8affd640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x561fa0585010 0x561fa05bcc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:52248/0 (socket says 172.21.15.78:52248) 2023-11-28T20:00:24.063 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:24.049+0000 7f5b8affd640 1 -- 172.21.15.78:0/868047484 learned_addr learned my addr 172.21.15.78:0/868047484 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T20:00:24.063 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:24.049+0000 7f5b8bfff640 1 --2- 172.21.15.78:0/868047484 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x561fa05bd920 0x561fa05c2a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:24.063 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:24.049+0000 7f5b8b7fe640 1 --2- 172.21.15.78:0/868047484 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x561fa05846f0 0x561fa05bc740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:24.064 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:24.049+0000 7f5b8affd640 1 -- 172.21.15.78:0/868047484 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x561fa05bd920 msgr2=0x561fa05c2a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:00:24.064 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:24.049+0000 7f5b8affd640 1 --2- 172.21.15.78:0/868047484 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x561fa05bd920 0x561fa05c2a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:24.064 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:24.049+0000 7f5b8affd640 1 -- 172.21.15.78:0/868047484 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x561fa05846f0 msgr2=0x561fa05bc740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:00:24.064 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:24.049+0000 7f5b8affd640 1 --2- 172.21.15.78:0/868047484 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x561fa05846f0 0x561fa05bc740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:24.064 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:24.049+0000 7f5b8affd640 1 -- 172.21.15.78:0/868047484 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5b7c011ba0 con 0x561fa0585010 2023-11-28T20:00:24.064 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:24.049+0000 7f5b8bfff640 1 --2- 172.21.15.78:0/868047484 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x561fa05bd920 0x561fa05c2a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T20:00:24.064 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:24.049+0000 7f5b8affd640 1 --2- 172.21.15.78:0/868047484 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x561fa0585010 0x561fa05bcc80 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f5b80000c10 tx=0x7f5b800eeed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1b3ceaf60bd82ab3 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:00:24.064 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:24.049+0000 7f5b6a7fc640 10 client.0 ms_handle_connect on v2:172.21.15.78:3300/0 2023-11-28T20:00:24.064 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:24.049+0000 7f5b6a7fc640 1 -- 172.21.15.78:0/868047484 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b800ee500 con 0x561fa0585010 2023-11-28T20:00:24.064 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:24.049+0000 7f5b6a7fc640 1 -- 172.21.15.78:0/868047484 <== mon.0 v2:172.21.15.78:3300/0 2 ==== osd_map(40..40 src has 1..40) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f5b800f7060 con 0x561fa0585010 2023-11-28T20:00:24.064 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:24.049+0000 7f5b952b0000 1 -- 172.21.15.78:0/868047484 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x561fa0395470 con 0x561fa0585010 2023-11-28T20:00:24.064 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:24.049+0000 7f5b6a7fc640 1 -- 172.21.15.78:0/868047484 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5b800f6bd0 con 0x561fa0585010 2023-11-28T20:00:24.065 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:24.049+0000 7f5b952b0000 10 client.5328 fetch_fsmap learned FSMap version 17 2023-11-28T20:00:24.065 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:24.049+0000 7f5b952b0000 1 -- 172.21.15.78:0/868047484 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) v3 -- 0x561fa0394190 con 0x561fa0585010 2023-11-28T20:00:24.065 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:24.049+0000 7f5b6a7fc640 1 -- 172.21.15.78:0/868047484 <== mon.0 v2:172.21.15.78:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x561fa0395470 con 0x561fa0585010 2023-11-28T20:00:24.065 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:24.049+0000 7f5b6a7fc640 1 -- 172.21.15.78:0/868047484 <== mon.0 v2:172.21.15.78:3300/0 5 ==== fsmap(e 17) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f5b800c5020 con 0x561fa0585010 2023-11-28T20:00:24.065 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:24.049+0000 7f5b952b0000 10 client.5328 fetch_fsmap finished waiting for FSMap version 17 2023-11-28T20:00:24.065 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:24.049+0000 7f5b952b0000 10 client.5328 resolve_mds: resolved name 'c' to daemon mds.c 2023-11-28T20:00:24.065 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:24.049+0000 7f5b952b0000 20 client.5328 populate_metadata read hostname 'smithi078' 2023-11-28T20:00:24.065 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:24.049+0000 7f5b952b0000 1 --2- 172.21.15.78:0/868047484 >> [v2:172.21.15.78:6834/3508383403,v1:172.21.15.78:6836/3508383403] conn(0x561fa05c3760 0x561fa05c3b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:24.065 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:24.049+0000 7f5b952b0000 4 client.5328 mds_command: new command op to 5185 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-11-28T20:00:24.065 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:24.049+0000 7f5b952b0000 1 -- 172.21.15.78:0/868047484 --> [v2:172.21.15.78:6834/3508383403,v1:172.21.15.78:6836/3508383403] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x561fa0398b50 con 0x561fa05c3760 2023-11-28T20:00:24.065 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:24.053+0000 7f5b8b7fe640 1 --2- 172.21.15.78:0/868047484 >> [v2:172.21.15.78:6834/3508383403,v1:172.21.15.78:6836/3508383403] conn(0x561fa05c3760 0x561fa05c3b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:24.066 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:24.053+0000 7f5b8b7fe640 1 --2- 172.21.15.78:0/868047484 >> [v2:172.21.15.78:6834/3508383403,v1:172.21.15.78:6836/3508383403] conn(0x561fa05c3760 0x561fa05c3b40 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9d5204fb7244901d server_cookie=586fac61b57f5ba4 in_seq=0 out_seq=0 2023-11-28T20:00:24.066 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:24.053+0000 7f5b6a7fc640 10 client.5328 ms_handle_connect on v2:172.21.15.78:6834/3508383403 2023-11-28T20:00:24.066 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:24.053+0000 7f5b6a7fc640 1 -- 172.21.15.78:0/868047484 <== mds.0 v2:172.21.15.78:6834/3508383403 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x561fa0398b50 con 0x561fa05c3760 2023-11-28T20:00:24.066 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:24.053+0000 7f5b6a7fc640 10 client.5328 handle_command_reply: tid=0 2023-11-28T20:00:24.066 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:24.053+0000 7f5b952b0000 1 client.5328 shutdown 2023-11-28T20:00:24.067 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:24.053+0000 7f5b952b0000 1 -- 172.21.15.78:0/868047484 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x561fa0585010 msgr2=0x561fa05bcc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:00:24.067 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:24.053+0000 7f5b952b0000 1 --2- 172.21.15.78:0/868047484 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x561fa0585010 0x561fa05bcc80 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f5b80000c10 tx=0x7f5b800eeed0 comp rx=0 tx=0).stop 2023-11-28T20:00:24.067 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:24.053+0000 7f5b952b0000 1 -- 172.21.15.78:0/868047484 shutdown_connections 2023-11-28T20:00:24.067 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:24.053+0000 7f5b952b0000 1 --2- 172.21.15.78:0/868047484 >> [v2:172.21.15.78:6834/3508383403,v1:172.21.15.78:6836/3508383403] conn(0x561fa05c3760 0x561fa05c3b40 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:24.067 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:24.053+0000 7f5b952b0000 1 --2- 172.21.15.78:0/868047484 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x561fa05bd920 0x561fa05c2a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:24.067 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:24.053+0000 7f5b952b0000 1 --2- 172.21.15.78:0/868047484 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x561fa0585010 0x561fa05bcc80 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:24.068 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:24.053+0000 7f5b952b0000 1 --2- 172.21.15.78:0/868047484 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x561fa05846f0 0x561fa05bc740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:24.068 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:24.053+0000 7f5b6a7fc640 0 client.5328 ms_handle_reset on v2:172.21.15.78:6834/3508383403 2023-11-28T20:00:24.068 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:24.053+0000 7f5b952b0000 1 -- 172.21.15.78:0/868047484 >> 172.21.15.78:0/868047484 conn(0x561fa0589190 msgr2=0x561fa057f2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:00:24.068 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:24.053+0000 7f5b952b0000 1 -- 172.21.15.78:0/868047484 shutdown_connections 2023-11-28T20:00:24.068 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:24.053+0000 7f5b952b0000 1 -- 172.21.15.78:0/868047484 wait complete. 2023-11-28T20:00:24.068 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:24.053+0000 7f5b952b0000 20 client.5328 trim_cache size 0 max 16384 2023-11-28T20:00:24.073 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:24.069+0000 7f5b952b0000 1 Processor -- start 2023-11-28T20:00:24.073 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:24.069+0000 7f5b952b0000 1 -- start start 2023-11-28T20:00:24.076 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:24.069+0000 7f5b952b0000 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x561fa0589190 0x561fa0585d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:24.076 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:24.069+0000 7f5b952b0000 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x561fa05846f0 0x561fa05df260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:24.076 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:24.069+0000 7f5b952b0000 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x561fa0585010 0x561fa05db220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:24.076 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:24.069+0000 7f5b952b0000 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x561fa05bc210 con 0x561fa0589190 2023-11-28T20:00:24.076 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:24.069+0000 7f5b952b0000 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x561fa008c940 con 0x561fa0585010 2023-11-28T20:00:24.076 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:24.069+0000 7f5b952b0000 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x561fa03db0c0 con 0x561fa05846f0 2023-11-28T20:00:24.076 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:24.069+0000 7f5b8b7fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x561fa0589190 0x561fa0585d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:24.076 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:24.069+0000 7f5b8b7fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x561fa0589190 0x561fa0585d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:52254/0 (socket says 172.21.15.78:52254) 2023-11-28T20:00:24.076 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:24.069+0000 7f5b8b7fe640 1 -- 172.21.15.78:0/2780510326 learned_addr learned my addr 172.21.15.78:0/2780510326 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T20:00:24.076 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:24.069+0000 7f5b8bfff640 1 --2- 172.21.15.78:0/2780510326 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x561fa0585010 0x561fa05db220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:24.076 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:24.069+0000 7f5b8affd640 1 --2- 172.21.15.78:0/2780510326 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x561fa05846f0 0x561fa05df260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:24.077 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:24.069+0000 7f5b8b7fe640 1 -- 172.21.15.78:0/2780510326 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x561fa05846f0 msgr2=0x561fa05df260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:00:24.077 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:24.069+0000 7f5b8b7fe640 1 --2- 172.21.15.78:0/2780510326 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x561fa05846f0 0x561fa05df260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:24.077 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:24.069+0000 7f5b8b7fe640 1 -- 172.21.15.78:0/2780510326 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x561fa0585010 msgr2=0x561fa05db220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:00:24.077 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:24.069+0000 7f5b8b7fe640 1 --2- 172.21.15.78:0/2780510326 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x561fa0585010 0x561fa05db220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:24.077 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:24.069+0000 7f5b8b7fe640 1 -- 172.21.15.78:0/2780510326 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561fa037a490 con 0x561fa0589190 2023-11-28T20:00:24.077 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:24.069+0000 7f5b8affd640 1 --2- 172.21.15.78:0/2780510326 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x561fa05846f0 0x561fa05df260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T20:00:24.077 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:24.069+0000 7f5b8b7fe640 1 --2- 172.21.15.78:0/2780510326 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x561fa0589190 0x561fa0585d10 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f5b7c011e90 tx=0x7f5b7c016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=24c16b0c99b1001d server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:00:24.077 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:24.069+0000 7f5b71ffb640 1 -- 172.21.15.78:0/2780510326 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b7c003dd0 con 0x561fa0589190 2023-11-28T20:00:24.077 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:24.069+0000 7f5b71ffb640 1 -- 172.21.15.78:0/2780510326 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b7c032040 con 0x561fa0589190 2023-11-28T20:00:24.077 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:24.069+0000 7f5b71ffb640 1 -- 172.21.15.78:0/2780510326 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b7c034d40 con 0x561fa0589190 2023-11-28T20:00:24.077 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:24.069+0000 7f5b952b0000 1 -- 172.21.15.78:0/2780510326 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x561fa0589190 msgr2=0x561fa0585d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:00:24.078 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:24.069+0000 7f5b952b0000 1 --2- 172.21.15.78:0/2780510326 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x561fa0589190 0x561fa0585d10 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f5b7c011e90 tx=0x7f5b7c016000 comp rx=0 tx=0).stop 2023-11-28T20:00:24.078 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:24.069+0000 7f5b952b0000 1 -- 172.21.15.78:0/2780510326 shutdown_connections 2023-11-28T20:00:24.078 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:24.069+0000 7f5b952b0000 1 --2- 172.21.15.78:0/2780510326 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x561fa05846f0 0x561fa05df260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:24.078 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:24.069+0000 7f5b952b0000 1 --2- 172.21.15.78:0/2780510326 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x561fa0585010 0x561fa05db220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:24.078 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:24.069+0000 7f5b952b0000 1 --2- 172.21.15.78:0/2780510326 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x561fa0589190 0x561fa0585d10 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:24.078 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:24.069+0000 7f5b952b0000 1 -- 172.21.15.78:0/2780510326 >> 172.21.15.78:0/2780510326 conn(0x561fa05d65f0 msgr2=0x561fa05853f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:00:24.078 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:24.073+0000 7f5b952b0000 1 -- 172.21.15.78:0/2780510326 shutdown_connections 2023-11-28T20:00:24.078 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:24.073+0000 7f5b952b0000 1 -- 172.21.15.78:0/2780510326 wait complete. 2023-11-28T20:00:24.082 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:24.073+0000 7f5b952b0000 1 -- start start 2023-11-28T20:00:24.083 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:24.073+0000 7f5b952b0000 1 Processor -- start 2023-11-28T20:00:24.083 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:24.073+0000 7f5b952b0000 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x561fa05846f0 0x561fa0626d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:24.083 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:24.073+0000 7f5b952b0000 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x561fa0585010 0x561fa0627270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:24.083 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:24.073+0000 7f5b952b0000 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x561fa0589190 0x561fa0627f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:24.083 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:24.073+0000 7f5b952b0000 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x561fa03cdca0 con 0x561fa05846f0 2023-11-28T20:00:24.083 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:24.073+0000 7f5b952b0000 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x561fa03d0bc0 con 0x561fa0585010 2023-11-28T20:00:24.083 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:24.073+0000 7f5b952b0000 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x561fa03d2650 con 0x561fa0589190 2023-11-28T20:00:24.083 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:24.073+0000 7f5b952b0000 10 client.0 _ll_register_callbacks cb 0x561fa054ebd0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-28T20:00:24.083 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:24.073+0000 7f5b8b7fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x561fa05846f0 0x561fa0626d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:24.083 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:24.073+0000 7f5b8b7fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x561fa05846f0 0x561fa0626d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:52256/0 (socket says 172.21.15.78:52256) 2023-11-28T20:00:24.083 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:24.073+0000 7f5b8b7fe640 1 -- 172.21.15.78:0/2203214838 learned_addr learned my addr 172.21.15.78:0/2203214838 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T20:00:24.084 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:24.073+0000 7f5b8affd640 1 --2- 172.21.15.78:0/2203214838 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x561fa0585010 0x561fa0627270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:24.084 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:24.073+0000 7f5b8bfff640 1 --2- 172.21.15.78:0/2203214838 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x561fa0589190 0x561fa0627f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:24.084 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:24.073+0000 7f5b8b7fe640 1 -- 172.21.15.78:0/2203214838 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x561fa0589190 msgr2=0x561fa0627f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:00:24.084 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:24.073+0000 7f5b8b7fe640 1 --2- 172.21.15.78:0/2203214838 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x561fa0589190 0x561fa0627f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:24.084 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:24.073+0000 7f5b8b7fe640 1 -- 172.21.15.78:0/2203214838 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x561fa0585010 msgr2=0x561fa0627270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:00:24.084 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:24.073+0000 7f5b8b7fe640 1 --2- 172.21.15.78:0/2203214838 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x561fa0585010 0x561fa0627270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:24.084 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:24.073+0000 7f5b8b7fe640 1 -- 172.21.15.78:0/2203214838 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x561fa00cb890 con 0x561fa05846f0 2023-11-28T20:00:24.084 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:24.073+0000 7f5b8b7fe640 1 --2- 172.21.15.78:0/2203214838 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x561fa05846f0 0x561fa0626d30 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f5b7c023000 tx=0x7f5b7c004740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=70a268d7aa9a5092 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:00:24.084 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:24.073+0000 7f5b6a7fc640 10 client.0 ms_handle_connect on v2:172.21.15.78:3300/0 2023-11-28T20:00:24.085 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:24.073+0000 7f5b6a7fc640 1 -- 172.21.15.78:0/2203214838 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b7c0038f0 con 0x561fa05846f0 2023-11-28T20:00:24.085 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:24.073+0000 7f5b6a7fc640 1 -- 172.21.15.78:0/2203214838 <== mon.0 v2:172.21.15.78:3300/0 2 ==== osd_map(40..40 src has 1..40) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f5b7c034b00 con 0x561fa05846f0 2023-11-28T20:00:24.085 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:24.073+0000 7f5b952b0000 1 -- 172.21.15.78:0/2203214838 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x561fa0588a50 con 0x561fa05846f0 2023-11-28T20:00:24.085 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:24.073+0000 7f5b6a7fc640 1 -- 172.21.15.78:0/2203214838 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5b7c034cc0 con 0x561fa05846f0 2023-11-28T20:00:24.085 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:24.073+0000 7f5b952b0000 10 client.5334 fetch_fsmap learned FSMap version 17 2023-11-28T20:00:24.085 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:24.073+0000 7f5b952b0000 1 -- 172.21.15.78:0/2203214838 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) v3 -- 0x561fa00cbcc0 con 0x561fa05846f0 2023-11-28T20:00:24.086 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:24.073+0000 7f5b6a7fc640 1 -- 172.21.15.78:0/2203214838 <== mon.0 v2:172.21.15.78:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x561fa0588a50 con 0x561fa05846f0 2023-11-28T20:00:24.086 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:24.073+0000 7f5b6a7fc640 1 -- 172.21.15.78:0/2203214838 <== mon.0 v2:172.21.15.78:3300/0 5 ==== fsmap(e 17) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f5b7c03c070 con 0x561fa05846f0 2023-11-28T20:00:24.086 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:24.073+0000 7f5b952b0000 10 client.5334 fetch_fsmap finished waiting for FSMap version 17 2023-11-28T20:00:24.086 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:24.073+0000 7f5b952b0000 10 client.5334 resolve_mds: resolved name 'c' to daemon mds.c 2023-11-28T20:00:24.086 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:24.073+0000 7f5b952b0000 20 client.5334 populate_metadata read hostname 'smithi078' 2023-11-28T20:00:24.086 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:24.073+0000 7f5b952b0000 1 --2- 172.21.15.78:0/2203214838 >> [v2:172.21.15.78:6834/3508383403,v1:172.21.15.78:6836/3508383403] conn(0x561fa05bd920 0x561fa0628490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:24.086 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:24.073+0000 7f5b952b0000 4 client.5334 mds_command: new command op to 5185 tid=0 multi_id=0 [{"prefix": "status"}] 2023-11-28T20:00:24.086 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:24.073+0000 7f5b952b0000 1 -- 172.21.15.78:0/2203214838 --> [v2:172.21.15.78:6834/3508383403,v1:172.21.15.78:6836/3508383403] -- command(tid 0: {"prefix": "status"}) v1 -- 0x561fa03d2110 con 0x561fa05bd920 2023-11-28T20:00:24.086 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:24.073+0000 7f5b8affd640 1 --2- 172.21.15.78:0/2203214838 >> [v2:172.21.15.78:6834/3508383403,v1:172.21.15.78:6836/3508383403] conn(0x561fa05bd920 0x561fa0628490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:24.086 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:24.077+0000 7f5b8affd640 1 --2- 172.21.15.78:0/2203214838 >> [v2:172.21.15.78:6834/3508383403,v1:172.21.15.78:6836/3508383403] conn(0x561fa05bd920 0x561fa0628490 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a56b425e33fa000a server_cookie=fb32b3df8eb730e8 in_seq=0 out_seq=0 2023-11-28T20:00:24.087 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:24.077+0000 7f5b6a7fc640 10 client.5334 ms_handle_connect on v2:172.21.15.78:6834/3508383403 2023-11-28T20:00:24.087 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:24.077+0000 7f5b6a7fc640 1 -- 172.21.15.78:0/2203214838 <== mds.0 v2:172.21.15.78:6834/3508383403 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+325 (crc 0 0 0) 0x561fa03d2110 con 0x561fa05bd920 2023-11-28T20:00:24.087 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:24.077+0000 7f5b6a7fc640 10 client.5334 handle_command_reply: tid=0 2023-11-28T20:00:24.087 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:24.077+0000 7f5b952b0000 1 client.5334 shutdown 2023-11-28T20:00:24.087 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:24.077+0000 7f5b952b0000 1 -- 172.21.15.78:0/2203214838 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x561fa05846f0 msgr2=0x561fa0626d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:00:24.087 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:24.077+0000 7f5b952b0000 1 --2- 172.21.15.78:0/2203214838 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x561fa05846f0 0x561fa0626d30 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f5b7c023000 tx=0x7f5b7c004740 comp rx=0 tx=0).stop 2023-11-28T20:00:24.087 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:24.077+0000 7f5b952b0000 1 -- 172.21.15.78:0/2203214838 shutdown_connections 2023-11-28T20:00:24.087 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:24.077+0000 7f5b952b0000 1 --2- 172.21.15.78:0/2203214838 >> [v2:172.21.15.78:6834/3508383403,v1:172.21.15.78:6836/3508383403] conn(0x561fa05bd920 0x561fa0628490 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:24.087 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:24.077+0000 7f5b952b0000 1 --2- 172.21.15.78:0/2203214838 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x561fa0589190 0x561fa0627f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:24.087 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:24.077+0000 7f5b952b0000 1 --2- 172.21.15.78:0/2203214838 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x561fa0585010 0x561fa0627270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:24.087 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:24.077+0000 7f5b6a7fc640 0 client.5334 ms_handle_reset on v2:172.21.15.78:6834/3508383403 2023-11-28T20:00:24.087 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:24.077+0000 7f5b952b0000 1 --2- 172.21.15.78:0/2203214838 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x561fa05846f0 0x561fa0626d30 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:24.088 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:24.077+0000 7f5b952b0000 1 -- 172.21.15.78:0/2203214838 >> 172.21.15.78:0/2203214838 conn(0x561fa05d65f0 msgr2=0x561fa057f7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:00:24.088 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:24.077+0000 7f5b952b0000 1 -- 172.21.15.78:0/2203214838 shutdown_connections 2023-11-28T20:00:24.088 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:24.077+0000 7f5b952b0000 1 -- 172.21.15.78:0/2203214838 wait complete. 2023-11-28T20:00:24.088 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:24.077+0000 7f5b952b0000 20 client.5334 trim_cache size 0 max 16384 2023-11-28T20:00:24.088 INFO:teuthology.orchestra.run.smithi078.stdout:{ 2023-11-28T20:00:24.088 INFO:teuthology.orchestra.run.smithi078.stdout: "cluster_fsid": "dd9780e8-3bda-44fa-a9f0-fa07d19d901d", 2023-11-28T20:00:24.088 INFO:teuthology.orchestra.run.smithi078.stdout: "whoami": 0, 2023-11-28T20:00:24.088 INFO:teuthology.orchestra.run.smithi078.stdout: "id": 5185, 2023-11-28T20:00:24.089 INFO:teuthology.orchestra.run.smithi078.stdout: "want_state": "up:active", 2023-11-28T20:00:24.089 INFO:teuthology.orchestra.run.smithi078.stdout: "state": "up:active", 2023-11-28T20:00:24.089 INFO:teuthology.orchestra.run.smithi078.stdout: "fs_name": "cephfs", 2023-11-28T20:00:24.089 INFO:teuthology.orchestra.run.smithi078.stdout: "rank_uptime": 10.304285276, 2023-11-28T20:00:24.089 INFO:teuthology.orchestra.run.smithi078.stdout: "mdsmap_epoch": 17, 2023-11-28T20:00:24.089 INFO:teuthology.orchestra.run.smithi078.stdout: "osdmap_epoch": 40, 2023-11-28T20:00:24.089 INFO:teuthology.orchestra.run.smithi078.stdout: "osdmap_epoch_barrier": 40, 2023-11-28T20:00:24.089 INFO:teuthology.orchestra.run.smithi078.stdout: "uptime": 18.813742397999999 2023-11-28T20:00:24.089 INFO:teuthology.orchestra.run.smithi078.stdout:} 2023-11-28T20:00:24.091 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:24.077+0000 7f5b91f2a640 1 -- 172.21.15.78:0/972835545 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f5b78066470 msgr2=0x7f5b78068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:00:24.091 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:24.077+0000 7f5b91f2a640 1 --2- 172.21.15.78:0/972835545 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f5b78066470 0x7f5b78068930 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f5b7c009b60 tx=0x7f5b7c009190 comp rx=0 tx=0).stop 2023-11-28T20:00:24.091 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:24.077+0000 7f5b91f2a640 1 -- 172.21.15.78:0/972835545 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5b8c0a4f90 msgr2=0x7f5b8c14edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:00:24.091 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:24.077+0000 7f5b91f2a640 1 --2- 172.21.15.78:0/972835545 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5b8c0a4f90 0x7f5b8c14edb0 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f5b8001a9c0 tx=0x7f5b800190b0 comp rx=0 tx=0).stop 2023-11-28T20:00:24.091 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:24.077+0000 7f5b91f2a640 1 -- 172.21.15.78:0/972835545 shutdown_connections 2023-11-28T20:00:24.091 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:24.077+0000 7f5b91f2a640 1 --2- 172.21.15.78:0/972835545 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f5b78066470 0x7f5b78068930 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:24.092 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:24.077+0000 7f5b91f2a640 1 --2- 172.21.15.78:0/972835545 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5b8c0a5370 0x7f5b8c14f2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:24.092 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:24.077+0000 7f5b91f2a640 1 --2- 172.21.15.78:0/972835545 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5b8c0a4f90 0x7f5b8c14edb0 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:24.092 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:24.077+0000 7f5b91f2a640 1 --2- 172.21.15.78:0/972835545 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5b8c072810 0x7f5b8c155c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:24.092 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:24.077+0000 7f5b91f2a640 1 -- 172.21.15.78:0/972835545 >> 172.21.15.78:0/972835545 conn(0x7f5b8c06b220 msgr2=0x7f5b8c0a7000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:00:24.092 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:24.077+0000 7f5b91f2a640 1 -- 172.21.15.78:0/972835545 shutdown_connections 2023-11-28T20:00:24.092 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:24.077+0000 7f5b91f2a640 1 -- 172.21.15.78:0/972835545 wait complete. 2023-11-28T20:00:24.100 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-11-28T20:00:24.237 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:24.233+0000 7fcd8aebb640 1 Processor -- start 2023-11-28T20:00:24.237 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:24.233+0000 7fcd8aebb640 1 -- start start 2023-11-28T20:00:24.243 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:24.233+0000 7fcd8aebb640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcd8414fd10 0x7fcd840a4dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:24.243 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:24.233+0000 7fcd8aebb640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fcd84156110 0x7fcd841565c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:24.243 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:24.233+0000 7fcd8aebb640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcd840c5710 con 0x7fcd840a5300 2023-11-28T20:00:24.243 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:24.233+0000 7fcd8aebb640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcd8406c5e0 con 0x7fcd84156110 2023-11-28T20:00:24.243 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:24.233+0000 7fcd8aebb640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd84155c80 con 0x7fcd8414fd10 2023-11-28T20:00:24.243 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:24.233+0000 7fcd89458640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fcd84156110 0x7fcd841565c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:24.243 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:24.233+0000 7fcd89458640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fcd84156110 0x7fcd841565c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:52264/0 (socket says 172.21.15.78:52264) 2023-11-28T20:00:24.243 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:24.233+0000 7fcd89458640 1 -- 172.21.15.78:0/1982661008 learned_addr learned my addr 172.21.15.78:0/1982661008 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T20:00:24.243 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:24.233+0000 7fcd88c57640 1 --2- 172.21.15.78:0/1982661008 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcd8414fd10 0x7fcd840a4dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:24.243 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:24.233+0000 7fcd89458640 1 -- 172.21.15.78:0/1982661008 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcd8414fd10 msgr2=0x7fcd840a4dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:00:24.243 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:24.233+0000 7fcd89458640 1 --2- 172.21.15.78:0/1982661008 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcd8414fd10 0x7fcd840a4dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:24.243 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:24.233+0000 7fcd89458640 1 -- 172.21.15.78:0/1982661008 >> v1:172.21.15.179:6789/0 conn(0x7fcd840a5300 legacy=0x7fcd84071e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:00:24.244 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:24.233+0000 7fcd89458640 1 -- 172.21.15.78:0/1982661008 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd840c4e70 con 0x7fcd84156110 2023-11-28T20:00:24.244 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:24.237+0000 7fcd89458640 1 --2- 172.21.15.78:0/1982661008 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcd84156110 0x7fcd841565c0 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7fcd7c009e50 tx=0x7fcd7c01c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4031e026941fc713 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:00:24.244 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:24.237+0000 7fcd7b7fe640 1 -- 172.21.15.78:0/1982661008 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd7c0a5780 con 0x7fcd84156110 2023-11-28T20:00:24.244 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:24.237+0000 7fcd7b7fe640 1 -- 172.21.15.78:0/1982661008 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd7c0a58e0 con 0x7fcd84156110 2023-11-28T20:00:24.244 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:24.237+0000 7fcd7b7fe640 1 -- 172.21.15.78:0/1982661008 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd7c0a5c70 con 0x7fcd84156110 2023-11-28T20:00:24.244 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:24.237+0000 7fcd8aebb640 1 -- 172.21.15.78:0/1982661008 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcd84156110 msgr2=0x7fcd841565c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:00:24.244 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:24.237+0000 7fcd8aebb640 1 --2- 172.21.15.78:0/1982661008 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcd84156110 0x7fcd841565c0 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7fcd7c009e50 tx=0x7fcd7c01c8c0 comp rx=0 tx=0).stop 2023-11-28T20:00:24.244 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:24.237+0000 7fcd8aebb640 1 -- 172.21.15.78:0/1982661008 shutdown_connections 2023-11-28T20:00:24.244 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:24.237+0000 7fcd8aebb640 1 --2- 172.21.15.78:0/1982661008 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcd84156110 0x7fcd841565c0 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:24.244 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:24.237+0000 7fcd8aebb640 1 --2- 172.21.15.78:0/1982661008 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcd8414fd10 0x7fcd840a4dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:24.244 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:24.237+0000 7fcd8aebb640 1 -- 172.21.15.78:0/1982661008 >> 172.21.15.78:0/1982661008 conn(0x7fcd840a7810 msgr2=0x7fcd840a7c20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:00:24.244 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:24.237+0000 7fcd8aebb640 1 -- 172.21.15.78:0/1982661008 shutdown_connections 2023-11-28T20:00:24.244 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:24.237+0000 7fcd8aebb640 1 -- 172.21.15.78:0/1982661008 wait complete. 2023-11-28T20:00:24.248 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:24.241+0000 7fcd8aebb640 1 Processor -- start 2023-11-28T20:00:24.248 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:24.241+0000 7fcd8aebb640 1 -- start start 2023-11-28T20:00:24.248 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:24.241+0000 7fcd8aebb640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcd840a5300 0x7fcd841f0150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:24.248 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:24.241+0000 7fcd8aebb640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcd8414fd10 0x7fcd8414a830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:24.248 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:24.241+0000 7fcd8aebb640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcd84156110 0x7fcd840a6610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:24.249 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:24.241+0000 7fcd8aebb640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd841f1080 con 0x7fcd840a5300 2023-11-28T20:00:24.249 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:24.241+0000 7fcd8aebb640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd840c3670 con 0x7fcd84156110 2023-11-28T20:00:24.249 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:24.241+0000 7fcd8aebb640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd84071c50 con 0x7fcd8414fd10 2023-11-28T20:00:24.249 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:24.241+0000 7fcd88c57640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcd840a5300 0x7fcd841f0150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:24.249 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:24.241+0000 7fcd88c57640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcd840a5300 0x7fcd841f0150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:52266/0 (socket says 172.21.15.78:52266) 2023-11-28T20:00:24.249 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:24.241+0000 7fcd88c57640 1 -- 172.21.15.78:0/1044865445 learned_addr learned my addr 172.21.15.78:0/1044865445 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T20:00:24.249 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:24.241+0000 7fcd7bfff640 1 --2- 172.21.15.78:0/1044865445 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcd8414fd10 0x7fcd8414a830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:24.249 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:24.241+0000 7fcd89458640 1 --2- 172.21.15.78:0/1044865445 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcd84156110 0x7fcd840a6610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:24.249 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:24.241+0000 7fcd88c57640 1 -- 172.21.15.78:0/1044865445 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcd8414fd10 msgr2=0x7fcd8414a830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:00:24.249 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:24.241+0000 7fcd88c57640 1 --2- 172.21.15.78:0/1044865445 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcd8414fd10 0x7fcd8414a830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:24.249 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:24.241+0000 7fcd88c57640 1 -- 172.21.15.78:0/1044865445 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcd84156110 msgr2=0x7fcd840a6610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:00:24.250 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:24.241+0000 7fcd88c57640 1 --2- 172.21.15.78:0/1044865445 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcd84156110 0x7fcd840a6610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:24.250 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:24.241+0000 7fcd88c57640 1 -- 172.21.15.78:0/1044865445 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd7c009b30 con 0x7fcd840a5300 2023-11-28T20:00:24.250 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:24.241+0000 7fcd89458640 1 --2- 172.21.15.78:0/1044865445 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcd84156110 0x7fcd840a6610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T20:00:24.250 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:24.241+0000 7fcd7bfff640 1 --2- 172.21.15.78:0/1044865445 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcd8414fd10 0x7fcd8414a830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T20:00:24.250 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:24.241+0000 7fcd88c57640 1 --2- 172.21.15.78:0/1044865445 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcd840a5300 0x7fcd841f0150 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7fcd8000e930 tx=0x7fcd8000edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:00:24.250 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:24.241+0000 7fcd797fa640 1 -- 172.21.15.78:0/1044865445 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd80009690 con 0x7fcd840a5300 2023-11-28T20:00:24.250 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:24.241+0000 7fcd797fa640 1 -- 172.21.15.78:0/1044865445 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd8000ca00 con 0x7fcd840a5300 2023-11-28T20:00:24.250 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:24.241+0000 7fcd797fa640 1 -- 172.21.15.78:0/1044865445 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd8000cd70 con 0x7fcd840a5300 2023-11-28T20:00:24.250 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:24.241+0000 7fcd8aebb640 1 -- 172.21.15.78:0/1044865445 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcd841f07e0 con 0x7fcd840a5300 2023-11-28T20:00:24.250 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:24.241+0000 7fcd8aebb640 1 -- 172.21.15.78:0/1044865445 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcd841f0da0 con 0x7fcd840a5300 2023-11-28T20:00:24.250 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:24.245+0000 7fcd8aebb640 1 -- 172.21.15.78:0/1044865445 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcd84067630 con 0x7fcd840a5300 2023-11-28T20:00:24.251 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:24.245+0000 7fcd797fa640 1 -- 172.21.15.78:0/1044865445 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fcd80013470 con 0x7fcd840a5300 2023-11-28T20:00:24.251 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:24.245+0000 7fcd797fa640 1 --2- 172.21.15.78:0/1044865445 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fcd70066470 0x7fcd70068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:24.251 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:24.245+0000 7fcd797fa640 1 -- 172.21.15.78:0/1044865445 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6029+0+0 (secure 0 0 0) 0x7fcd80084200 con 0x7fcd840a5300 2023-11-28T20:00:24.251 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:24.245+0000 7fcd7bfff640 1 --2- 172.21.15.78:0/1044865445 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fcd70066470 0x7fcd70068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:24.252 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:24.245+0000 7fcd7bfff640 1 --2- 172.21.15.78:0/1044865445 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fcd70066470 0x7fcd70068930 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fcd84071f70 tx=0x7fcd74009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:00:24.253 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:24.249+0000 7fcd797fa640 1 -- 172.21.15.78:0/1044865445 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fcd80051690 con 0x7fcd840a5300 2023-11-28T20:00:24.434 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:24.429+0000 7fcd8aebb640 1 -- 172.21.15.78:0/1044865445 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fcd840c4b20 con 0x7fcd840a5300 2023-11-28T20:00:24.435 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:24.429+0000 7fcd797fa640 1 -- 172.21.15.78:0/1044865445 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v17) v1 ==== 53+0+73 (secure 0 0 0) 0x7fcd80054cb0 con 0x7fcd840a5300 2023-11-28T20:00:24.435 INFO:teuthology.orchestra.run.smithi078.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-11-28T20:00:24.437 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:24.433+0000 7fcd8aebb640 1 -- 172.21.15.78:0/1044865445 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fcd70066470 msgr2=0x7fcd70068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:00:24.437 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:24.433+0000 7fcd8aebb640 1 --2- 172.21.15.78:0/1044865445 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fcd70066470 0x7fcd70068930 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fcd84071f70 tx=0x7fcd74009040 comp rx=0 tx=0).stop 2023-11-28T20:00:24.437 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:24.433+0000 7fcd8aebb640 1 -- 172.21.15.78:0/1044865445 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcd840a5300 msgr2=0x7fcd841f0150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:00:24.437 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:24.433+0000 7fcd8aebb640 1 --2- 172.21.15.78:0/1044865445 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcd840a5300 0x7fcd841f0150 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7fcd8000e930 tx=0x7fcd8000edf0 comp rx=0 tx=0).stop 2023-11-28T20:00:24.437 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:24.433+0000 7fcd8aebb640 1 -- 172.21.15.78:0/1044865445 shutdown_connections 2023-11-28T20:00:24.437 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:24.433+0000 7fcd8aebb640 1 --2- 172.21.15.78:0/1044865445 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fcd70066470 0x7fcd70068930 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:24.437 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:24.433+0000 7fcd8aebb640 1 --2- 172.21.15.78:0/1044865445 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcd8414fd10 0x7fcd8414a830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:24.437 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:24.433+0000 7fcd8aebb640 1 --2- 172.21.15.78:0/1044865445 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcd84156110 0x7fcd840a6610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:24.437 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:24.433+0000 7fcd8aebb640 1 --2- 172.21.15.78:0/1044865445 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcd840a5300 0x7fcd841f0150 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:24.438 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:24.433+0000 7fcd8aebb640 1 -- 172.21.15.78:0/1044865445 >> 172.21.15.78:0/1044865445 conn(0x7fcd840a7810 msgr2=0x7fcd8414f1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:00:24.438 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:24.433+0000 7fcd8aebb640 1 -- 172.21.15.78:0/1044865445 shutdown_connections 2023-11-28T20:00:24.438 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:24.433+0000 7fcd8aebb640 1 -- 172.21.15.78:0/1044865445 wait complete. 2023-11-28T20:00:24.456 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-11-28T20:00:24.456 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-11-28T20:00:24.456 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi078.front.sepia.ceph.com 2023-11-28T20:00:24.456 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-11-28T20:00:24.456 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-11-28T20:00:24.456 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-11-28T20:00:24.456 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-11-28T20:00:24.456 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-11-28T20:00:24.456 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-11-28T20:00:24.457 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T20:00:24.457 DEBUG:teuthology.orchestra.run.smithi078:> ip addr 2023-11-28T20:00:24.466 INFO:teuthology.orchestra.run.smithi078.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-11-28T20:00:24.466 INFO:teuthology.orchestra.run.smithi078.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-11-28T20:00:24.466 INFO:teuthology.orchestra.run.smithi078.stdout: inet 127.0.0.1/8 scope host lo 2023-11-28T20:00:24.467 INFO:teuthology.orchestra.run.smithi078.stdout: valid_lft forever preferred_lft forever 2023-11-28T20:00:24.467 INFO:teuthology.orchestra.run.smithi078.stdout: inet6 ::1/128 scope host 2023-11-28T20:00:24.467 INFO:teuthology.orchestra.run.smithi078.stdout: valid_lft forever preferred_lft forever 2023-11-28T20:00:24.467 INFO:teuthology.orchestra.run.smithi078.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-11-28T20:00:24.467 INFO:teuthology.orchestra.run.smithi078.stdout: link/ether 0c:c4:7a:d8:a1:22 brd ff:ff:ff:ff:ff:ff 2023-11-28T20:00:24.467 INFO:teuthology.orchestra.run.smithi078.stdout: altname enp7s0f0 2023-11-28T20:00:24.467 INFO:teuthology.orchestra.run.smithi078.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-11-28T20:00:24.467 INFO:teuthology.orchestra.run.smithi078.stdout: link/ether 0c:c4:7a:d8:a1:23 brd ff:ff:ff:ff:ff:ff 2023-11-28T20:00:24.467 INFO:teuthology.orchestra.run.smithi078.stdout: altname enp7s0f1 2023-11-28T20:00:24.468 INFO:teuthology.orchestra.run.smithi078.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-11-28T20:00:24.468 INFO:teuthology.orchestra.run.smithi078.stdout: link/ether 0c:c4:7a:8f:d4:dc brd ff:ff:ff:ff:ff:ff 2023-11-28T20:00:24.468 INFO:teuthology.orchestra.run.smithi078.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-11-28T20:00:24.468 INFO:teuthology.orchestra.run.smithi078.stdout: link/ether 0c:c4:7a:8f:d4:dd brd ff:ff:ff:ff:ff:ff 2023-11-28T20:00:24.468 INFO:teuthology.orchestra.run.smithi078.stdout: inet 172.21.15.78/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2023-11-28T20:00:24.468 INFO:teuthology.orchestra.run.smithi078.stdout: valid_lft 42347sec preferred_lft 42347sec 2023-11-28T20:00:24.469 INFO:teuthology.orchestra.run.smithi078.stdout: inet6 fe80::ec4:7aff:fe8f:d4dd/64 scope link 2023-11-28T20:00:24.469 INFO:teuthology.orchestra.run.smithi078.stdout: valid_lft forever preferred_lft forever 2023-11-28T20:00:24.469 INFO:teuthology.orchestra.run.smithi078.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-11-28T20:00:24.469 INFO:teuthology.orchestra.run.smithi078.stdout: link/ether 02:42:8f:cc:76:dd brd ff:ff:ff:ff:ff:ff 2023-11-28T20:00:24.469 INFO:teuthology.orchestra.run.smithi078.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-11-28T20:00:24.469 INFO:teuthology.orchestra.run.smithi078.stdout: valid_lft forever preferred_lft forever 2023-11-28T20:00:24.469 INFO:teuthology.orchestra.run.smithi078.stdout:9: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-11-28T20:00:24.470 INFO:teuthology.orchestra.run.smithi078.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2023-11-28T20:00:24.470 INFO:teuthology.orchestra.run.smithi078.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-11-28T20:00:24.470 INFO:teuthology.orchestra.run.smithi078.stdout: valid_lft forever preferred_lft forever 2023-11-28T20:00:24.470 INFO:teuthology.orchestra.run.smithi078.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2023-11-28T20:00:24.470 INFO:teuthology.orchestra.run.smithi078.stdout: valid_lft forever preferred_lft forever 2023-11-28T20:00:24.470 INFO:teuthology.orchestra.run.smithi078.stdout:10: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-11-28T20:00:24.471 INFO:teuthology.orchestra.run.smithi078.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-28T20:00:24.471 INFO:teuthology.orchestra.run.smithi078.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2023-11-28T20:00:24.472 INFO:teuthology.orchestra.run.smithi078.stdout: valid_lft forever preferred_lft forever 2023-11-28T20:00:24.473 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T20:00:24.473 DEBUG:teuthology.orchestra.run.smithi078:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-11-28T20:00:24.534 INFO:teuthology.orchestra.run.smithi078.stdout:1 2023-11-28T20:00:24.536 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T20:00:24.536 DEBUG:teuthology.orchestra.run.smithi078:> route 2023-11-28T20:00:24.589 INFO:teuthology.orchestra.run.smithi078.stdout:Kernel IP routing table 2023-11-28T20:00:24.590 INFO:teuthology.orchestra.run.smithi078.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-11-28T20:00:24.590 INFO:teuthology.orchestra.run.smithi078.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2023-11-28T20:00:24.590 INFO:teuthology.orchestra.run.smithi078.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-11-28T20:00:24.590 INFO:teuthology.orchestra.run.smithi078.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-11-28T20:00:24.590 INFO:teuthology.orchestra.run.smithi078.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-11-28T20:00:24.590 INFO:teuthology.orchestra.run.smithi078.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-11-28T20:00:24.590 INFO:teuthology.orchestra.run.smithi078.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-11-28T20:00:24.590 INFO:teuthology.orchestra.run.smithi078.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-11-28T20:00:24.590 INFO:teuthology.orchestra.run.smithi078.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-11-28T20:00:24.591 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T20:00:24.591 DEBUG:teuthology.orchestra.run.smithi078:> (cd / && exec bash -c ' 2023-11-28T20:00:24.591 DEBUG:teuthology.orchestra.run.smithi078:> set -e 2023-11-28T20:00:24.591 DEBUG:teuthology.orchestra.run.smithi078:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-11-28T20:00:24.591 DEBUG:teuthology.orchestra.run.smithi078:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-11-28T20:00:24.591 DEBUG:teuthology.orchestra.run.smithi078:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-11-28T20:00:24.592 DEBUG:teuthology.orchestra.run.smithi078:> ') 2023-11-28T20:00:24.683 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T20:00:24.683 DEBUG:teuthology.orchestra.run.smithi078:> ip netns list 2023-11-28T20:00:24.692 INFO:teuthology.orchestra.run.smithi078.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-11-28T20:00:24.693 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-11-28T20:00:24.693 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T20:00:24.693 DEBUG:teuthology.orchestra.run.smithi078:> sudo ip link set brx.0 up 2023-11-28T20:00:24.756 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-28T20:00:24.756 DEBUG:teuthology.orchestra.run.smithi078:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-11-28T20:00:24.808 INFO:teuthology.orchestra.run.smithi078.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-11-28T20:00:24.808 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-28T20:00:24.808 DEBUG:teuthology.orchestra.run.smithi078:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-11-28T20:00:24.865 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2023-11-28T20:00:24.866 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T20:00:24.866 DEBUG:teuthology.orchestra.run.smithi078:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-11-28T20:00:24.956 INFO:teuthology.orchestra.run.smithi078.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-11-28T20:00:24.956 INFO:teuthology.orchestra.run.smithi078.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-11-28T20:00:24.970 INFO:teuthology.orchestra.run.smithi078.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-11-28T20:00:24.970 INFO:teuthology.orchestra.run.smithi078.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-11-28T20:00:24.970 INFO:teuthology.orchestra.run.smithi078.stdout:mount.ceph: resolved to: "172.21.15.78:3300,172.21.15.179:3300,172.21.15.179:3301" 2023-11-28T20:00:24.970 INFO:teuthology.orchestra.run.smithi078.stdout:mount.ceph: trying mount with new device syntax: 0@dd9780e8-3bda-44fa-a9f0-fa07d19d901d.cephfs=/ 2023-11-28T20:00:24.971 INFO:teuthology.orchestra.run.smithi078.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.78:3300/172.21.15.179:3300/172.21.15.179:3301" will pass to kernel 2023-11-28T20:00:24.974 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-11-28T20:00:24.974 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T20:00:24.974 DEBUG:teuthology.orchestra.run.smithi078:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-11-28T20:00:24.995 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T20:00:24.996 DEBUG:teuthology.orchestra.run.smithi078:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-11-28T20:00:25.056 INFO:teuthology.orchestra.run.smithi078.stdout:client5380 2023-11-28T20:00:25.056 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2023-11-28T20:00:25.056 DEBUG:teuthology.orchestra.run.smithi078:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-28T20:00:25.108 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-11-28T20:00:25.291 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:25.285+0000 7f77244fd640 1 Processor -- start 2023-11-28T20:00:25.292 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:25.285+0000 7f77244fd640 1 -- start start 2023-11-28T20:00:25.293 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:25.289+0000 7f77244fd640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f771c06d2b0 0x7f771c06d690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:25.293 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:25.289+0000 7f77244fd640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f771c0c3b80 0x7f771c0c5300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:25.294 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:25.289+0000 7f77244fd640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f771c06bb80 con 0x7f771c06c020 2023-11-28T20:00:25.294 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:25.289+0000 7f77244fd640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f771c0c5840 con 0x7f771c06d2b0 2023-11-28T20:00:25.294 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:25.289+0000 7f77244fd640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f771c1515c0 con 0x7f771c0c3b80 2023-11-28T20:00:25.294 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:25.289+0000 7f7722299640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f771c06d2b0 0x7f771c06d690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:25.294 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:25.289+0000 7f7722299640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f771c06d2b0 0x7f771c06d690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:45740/0 (socket says 172.21.15.78:45740) 2023-11-28T20:00:25.294 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:25.289+0000 7f7722299640 1 -- 172.21.15.78:0/1484001618 learned_addr learned my addr 172.21.15.78:0/1484001618 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T20:00:25.294 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:25.289+0000 7f7721a98640 1 --2- 172.21.15.78:0/1484001618 >> v2:172.21.15.179:3300/0 conn(0x7f771c0c3b80 0x7f771c0c5300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:25.294 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:25.289+0000 7f7722299640 1 -- 172.21.15.78:0/1484001618 >> v2:172.21.15.179:3300/0 conn(0x7f771c0c3b80 msgr2=0x7f771c0c5300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:00:25.295 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:25.289+0000 7f7722299640 1 --2- 172.21.15.78:0/1484001618 >> v2:172.21.15.179:3300/0 conn(0x7f771c0c3b80 0x7f771c0c5300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:25.295 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:25.289+0000 7f7722299640 1 -- 172.21.15.78:0/1484001618 >> v1:172.21.15.179:6789/0 conn(0x7f771c06c020 legacy=0x7f771c06c4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:00:25.295 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:25.289+0000 7f7722299640 1 -- 172.21.15.78:0/1484001618 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f771c1518a0 con 0x7f771c06d2b0 2023-11-28T20:00:25.296 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:25.293+0000 7f7722299640 1 --2- 172.21.15.78:0/1484001618 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f771c06d2b0 0x7f771c06d690 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f771c06b5a0 tx=0x7f771801c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5ef32216dcbb07a4 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:00:25.297 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:25.293+0000 7f7721297640 1 -- 172.21.15.78:0/1484001618 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77180ac600 con 0x7f771c06d2b0 2023-11-28T20:00:25.297 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:25.293+0000 7f7721297640 1 -- 172.21.15.78:0/1484001618 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f77180a8050 con 0x7f771c06d2b0 2023-11-28T20:00:25.297 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:25.293+0000 7f7721297640 1 -- 172.21.15.78:0/1484001618 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77180ac980 con 0x7f771c06d2b0 2023-11-28T20:00:25.297 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:25.293+0000 7f77244fd640 1 -- 172.21.15.78:0/1484001618 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f771c06d2b0 msgr2=0x7f771c06d690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:00:25.297 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:25.293+0000 7f77244fd640 1 --2- 172.21.15.78:0/1484001618 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f771c06d2b0 0x7f771c06d690 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f771c06b5a0 tx=0x7f771801c490 comp rx=0 tx=0).stop 2023-11-28T20:00:25.298 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:25.293+0000 7f77244fd640 1 -- 172.21.15.78:0/1484001618 shutdown_connections 2023-11-28T20:00:25.298 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:25.293+0000 7f77244fd640 1 --2- 172.21.15.78:0/1484001618 >> v2:172.21.15.179:3300/0 conn(0x7f771c0c3b80 0x7f771c0c5300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:25.298 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:25.293+0000 7f77244fd640 1 --2- 172.21.15.78:0/1484001618 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f771c06d2b0 0x7f771c06d690 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:25.298 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:25.293+0000 7f77244fd640 1 -- 172.21.15.78:0/1484001618 >> 172.21.15.78:0/1484001618 conn(0x7f771c0a7810 msgr2=0x7f771c0a7c20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:00:25.298 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:25.293+0000 7f77244fd640 1 -- 172.21.15.78:0/1484001618 shutdown_connections 2023-11-28T20:00:25.298 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:25.293+0000 7f77244fd640 1 -- 172.21.15.78:0/1484001618 wait complete. 2023-11-28T20:00:25.299 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:25.293+0000 7f77244fd640 1 Processor -- start 2023-11-28T20:00:25.299 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:25.293+0000 7f77244fd640 1 -- start start 2023-11-28T20:00:25.302 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:25.297+0000 7f77244fd640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f771c06c020 0x7f771c1eeb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:25.302 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:25.297+0000 7f77244fd640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f771c06d2b0 0x7f771c14a3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:25.302 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:25.297+0000 7f77244fd640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f771c0c3b80 0x7f771c1eaa40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:25.303 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:25.297+0000 7f77244fd640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f771c157080 con 0x7f771c0c3b80 2023-11-28T20:00:25.303 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:25.297+0000 7f77244fd640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f771c14a8f0 con 0x7f771c06d2b0 2023-11-28T20:00:25.303 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:25.297+0000 7f77244fd640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f771c156040 con 0x7f771c06c020 2023-11-28T20:00:25.303 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:25.297+0000 7f7722a9a640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f771c0c3b80 0x7f771c1eaa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:25.303 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:25.297+0000 7f7722a9a640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f771c0c3b80 0x7f771c1eaa40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:45744/0 (socket says 172.21.15.78:45744) 2023-11-28T20:00:25.303 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:25.297+0000 7f7722a9a640 1 -- 172.21.15.78:0/371962837 learned_addr learned my addr 172.21.15.78:0/371962837 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T20:00:25.303 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:25.297+0000 7f7721a98640 1 --2- 172.21.15.78:0/371962837 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f771c06d2b0 0x7f771c14a3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:25.303 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:25.297+0000 7f7722299640 1 --2- 172.21.15.78:0/371962837 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f771c06c020 0x7f771c1eeb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:25.303 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:25.297+0000 7f7722a9a640 1 -- 172.21.15.78:0/371962837 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f771c06c020 msgr2=0x7f771c1eeb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:00:25.303 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:25.297+0000 7f7722a9a640 1 --2- 172.21.15.78:0/371962837 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f771c06c020 0x7f771c1eeb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:25.303 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:25.297+0000 7f7722a9a640 1 -- 172.21.15.78:0/371962837 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f771c06d2b0 msgr2=0x7f771c14a3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:00:25.304 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:25.297+0000 7f7722a9a640 1 --2- 172.21.15.78:0/371962837 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f771c06d2b0 0x7f771c14a3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:25.304 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:25.297+0000 7f7722a9a640 1 -- 172.21.15.78:0/371962837 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77180094d0 con 0x7f771c0c3b80 2023-11-28T20:00:25.304 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:25.297+0000 7f7721a98640 1 --2- 172.21.15.78:0/371962837 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f771c06d2b0 0x7f771c14a3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T20:00:25.304 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:25.297+0000 7f7722299640 1 --2- 172.21.15.78:0/371962837 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f771c06c020 0x7f771c1eeb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T20:00:25.304 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:25.297+0000 7f7722a9a640 1 --2- 172.21.15.78:0/371962837 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f771c0c3b80 0x7f771c1eaa40 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f771400c780 tx=0x7f771400cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:00:25.304 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:25.297+0000 7f7712ffd640 1 -- 172.21.15.78:0/371962837 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7714004b20 con 0x7f771c0c3b80 2023-11-28T20:00:25.304 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:25.297+0000 7f7712ffd640 1 -- 172.21.15.78:0/371962837 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7714004c80 con 0x7f771c0c3b80 2023-11-28T20:00:25.304 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:25.297+0000 7f77244fd640 1 -- 172.21.15.78:0/371962837 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f771c14ef80 con 0x7f771c0c3b80 2023-11-28T20:00:25.304 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:25.297+0000 7f7712ffd640 1 -- 172.21.15.78:0/371962837 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f771400aa30 con 0x7f771c0c3b80 2023-11-28T20:00:25.304 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:25.297+0000 7f77244fd640 1 -- 172.21.15.78:0/371962837 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f771c1ee330 con 0x7f771c0c3b80 2023-11-28T20:00:25.304 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:25.297+0000 7f77244fd640 1 -- 172.21.15.78:0/371962837 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f771c067630 con 0x7f771c0c3b80 2023-11-28T20:00:25.305 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:25.297+0000 7f7712ffd640 1 -- 172.21.15.78:0/371962837 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f771400ab90 con 0x7f771c0c3b80 2023-11-28T20:00:25.305 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:25.301+0000 7f7712ffd640 1 --2- 172.21.15.78:0/371962837 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f7700066470 0x7f7700068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:25.306 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:25.301+0000 7f7712ffd640 1 -- 172.21.15.78:0/371962837 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f7714084000 con 0x7f771c0c3b80 2023-11-28T20:00:25.306 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:25.301+0000 7f7722299640 1 --2- 172.21.15.78:0/371962837 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f7700066470 0x7f7700068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:25.306 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:25.301+0000 7f7722299640 1 --2- 172.21.15.78:0/371962837 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f7700066470 0x7f7700068930 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f77180ae000 tx=0x7f7718008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:00:25.308 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:25.305+0000 7f7712ffd640 1 -- 172.21.15.78:0/371962837 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f77140513d0 con 0x7f771c0c3b80 2023-11-28T20:00:25.505 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:25.501+0000 7f77244fd640 1 -- 172.21.15.78:0/371962837 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f771c06bd70 con 0x7f771c0c3b80 2023-11-28T20:00:25.506 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:25.501+0000 7f7712ffd640 1 -- 172.21.15.78:0/371962837 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v17) v1 ==== 53+0+73 (secure 0 0 0) 0x7f77140549f0 con 0x7f771c0c3b80 2023-11-28T20:00:25.506 INFO:teuthology.orchestra.run.smithi078.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-11-28T20:00:25.508 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:25.505+0000 7f77244fd640 1 -- 172.21.15.78:0/371962837 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f7700066470 msgr2=0x7f7700068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:00:25.508 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:25.505+0000 7f77244fd640 1 --2- 172.21.15.78:0/371962837 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f7700066470 0x7f7700068930 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f77180ae000 tx=0x7f7718008040 comp rx=0 tx=0).stop 2023-11-28T20:00:25.508 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:25.505+0000 7f77244fd640 1 -- 172.21.15.78:0/371962837 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f771c0c3b80 msgr2=0x7f771c1eaa40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:00:25.508 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:25.505+0000 7f77244fd640 1 --2- 172.21.15.78:0/371962837 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f771c0c3b80 0x7f771c1eaa40 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f771400c780 tx=0x7f771400cc40 comp rx=0 tx=0).stop 2023-11-28T20:00:25.509 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:25.505+0000 7f77244fd640 1 -- 172.21.15.78:0/371962837 shutdown_connections 2023-11-28T20:00:25.509 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:25.505+0000 7f77244fd640 1 --2- 172.21.15.78:0/371962837 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f7700066470 0x7f7700068930 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:25.509 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:25.505+0000 7f77244fd640 1 --2- 172.21.15.78:0/371962837 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f771c0c3b80 0x7f771c1eaa40 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:25.509 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:25.505+0000 7f77244fd640 1 --2- 172.21.15.78:0/371962837 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f771c06d2b0 0x7f771c14a3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:25.510 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:25.505+0000 7f77244fd640 1 --2- 172.21.15.78:0/371962837 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f771c06c020 0x7f771c1eeb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:25.510 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:25.505+0000 7f77244fd640 1 -- 172.21.15.78:0/371962837 >> 172.21.15.78:0/371962837 conn(0x7f771c0a7810 msgr2=0x7f771c0723f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:00:25.511 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:25.505+0000 7f77244fd640 1 -- 172.21.15.78:0/371962837 shutdown_connections 2023-11-28T20:00:25.511 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:25.505+0000 7f77244fd640 1 -- 172.21.15.78:0/371962837 wait complete. 2023-11-28T20:00:25.527 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-11-28T20:00:25.527 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-11-28T20:00:25.528 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi179.front.sepia.ceph.com 2023-11-28T20:00:25.528 INFO:tasks.cephfs.mount:self.client.name = client.1 2023-11-28T20:00:25.528 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-11-28T20:00:25.528 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-11-28T20:00:25.528 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-11-28T20:00:25.528 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-11-28T20:00:25.528 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-11-28T20:00:25.528 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T20:00:25.529 DEBUG:teuthology.orchestra.run.smithi179:> ip addr 2023-11-28T20:00:25.540 INFO:teuthology.orchestra.run.smithi179.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-11-28T20:00:25.540 INFO:teuthology.orchestra.run.smithi179.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-11-28T20:00:25.540 INFO:teuthology.orchestra.run.smithi179.stdout: inet 127.0.0.1/8 scope host lo 2023-11-28T20:00:25.540 INFO:teuthology.orchestra.run.smithi179.stdout: valid_lft forever preferred_lft forever 2023-11-28T20:00:25.540 INFO:teuthology.orchestra.run.smithi179.stdout: inet6 ::1/128 scope host 2023-11-28T20:00:25.540 INFO:teuthology.orchestra.run.smithi179.stdout: valid_lft forever preferred_lft forever 2023-11-28T20:00:25.541 INFO:teuthology.orchestra.run.smithi179.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-11-28T20:00:25.541 INFO:teuthology.orchestra.run.smithi179.stdout: link/ether 0c:c4:7a:d9:3b:34 brd ff:ff:ff:ff:ff:ff 2023-11-28T20:00:25.541 INFO:teuthology.orchestra.run.smithi179.stdout: altname enp7s0f0 2023-11-28T20:00:25.541 INFO:teuthology.orchestra.run.smithi179.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-11-28T20:00:25.541 INFO:teuthology.orchestra.run.smithi179.stdout: link/ether 0c:c4:7a:d9:3b:35 brd ff:ff:ff:ff:ff:ff 2023-11-28T20:00:25.541 INFO:teuthology.orchestra.run.smithi179.stdout: altname enp7s0f1 2023-11-28T20:00:25.541 INFO:teuthology.orchestra.run.smithi179.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-11-28T20:00:25.541 INFO:teuthology.orchestra.run.smithi179.stdout: link/ether 0c:c4:7a:88:72:5a brd ff:ff:ff:ff:ff:ff 2023-11-28T20:00:25.541 INFO:teuthology.orchestra.run.smithi179.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-11-28T20:00:25.541 INFO:teuthology.orchestra.run.smithi179.stdout: link/ether 0c:c4:7a:88:72:5b brd ff:ff:ff:ff:ff:ff 2023-11-28T20:00:25.541 INFO:teuthology.orchestra.run.smithi179.stdout: inet 172.21.15.179/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2023-11-28T20:00:25.542 INFO:teuthology.orchestra.run.smithi179.stdout: valid_lft 42357sec preferred_lft 42357sec 2023-11-28T20:00:25.542 INFO:teuthology.orchestra.run.smithi179.stdout: inet6 fe80::ec4:7aff:fe88:725b/64 scope link 2023-11-28T20:00:25.542 INFO:teuthology.orchestra.run.smithi179.stdout: valid_lft forever preferred_lft forever 2023-11-28T20:00:25.542 INFO:teuthology.orchestra.run.smithi179.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-11-28T20:00:25.542 INFO:teuthology.orchestra.run.smithi179.stdout: link/ether 02:42:75:f0:7b:8c brd ff:ff:ff:ff:ff:ff 2023-11-28T20:00:25.542 INFO:teuthology.orchestra.run.smithi179.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-11-28T20:00:25.542 INFO:teuthology.orchestra.run.smithi179.stdout: valid_lft forever preferred_lft forever 2023-11-28T20:00:25.542 INFO:teuthology.orchestra.run.smithi179.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-11-28T20:00:25.542 INFO:teuthology.orchestra.run.smithi179.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2023-11-28T20:00:25.542 INFO:teuthology.orchestra.run.smithi179.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-11-28T20:00:25.542 INFO:teuthology.orchestra.run.smithi179.stdout: valid_lft forever preferred_lft forever 2023-11-28T20:00:25.542 INFO:teuthology.orchestra.run.smithi179.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2023-11-28T20:00:25.543 INFO:teuthology.orchestra.run.smithi179.stdout: valid_lft forever preferred_lft forever 2023-11-28T20:00:25.543 INFO:teuthology.orchestra.run.smithi179.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-11-28T20:00:25.543 INFO:teuthology.orchestra.run.smithi179.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2023-11-28T20:00:25.543 INFO:teuthology.orchestra.run.smithi179.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2023-11-28T20:00:25.543 INFO:teuthology.orchestra.run.smithi179.stdout: valid_lft forever preferred_lft forever 2023-11-28T20:00:25.543 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T20:00:25.543 DEBUG:teuthology.orchestra.run.smithi179:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-11-28T20:00:25.605 INFO:teuthology.orchestra.run.smithi179.stdout:1 2023-11-28T20:00:25.607 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T20:00:25.607 DEBUG:teuthology.orchestra.run.smithi179:> route 2023-11-28T20:00:25.661 INFO:teuthology.orchestra.run.smithi179.stdout:Kernel IP routing table 2023-11-28T20:00:25.661 INFO:teuthology.orchestra.run.smithi179.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-11-28T20:00:25.661 INFO:teuthology.orchestra.run.smithi179.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2023-11-28T20:00:25.661 INFO:teuthology.orchestra.run.smithi179.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-11-28T20:00:25.661 INFO:teuthology.orchestra.run.smithi179.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-11-28T20:00:25.661 INFO:teuthology.orchestra.run.smithi179.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-11-28T20:00:25.662 INFO:teuthology.orchestra.run.smithi179.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-11-28T20:00:25.662 INFO:teuthology.orchestra.run.smithi179.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-11-28T20:00:25.662 INFO:teuthology.orchestra.run.smithi179.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-11-28T20:00:25.662 INFO:teuthology.orchestra.run.smithi179.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-11-28T20:00:25.662 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T20:00:25.662 DEBUG:teuthology.orchestra.run.smithi179:> (cd / && exec bash -c ' 2023-11-28T20:00:25.662 DEBUG:teuthology.orchestra.run.smithi179:> set -e 2023-11-28T20:00:25.662 DEBUG:teuthology.orchestra.run.smithi179:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-11-28T20:00:25.663 DEBUG:teuthology.orchestra.run.smithi179:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-11-28T20:00:25.663 DEBUG:teuthology.orchestra.run.smithi179:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-11-28T20:00:25.663 DEBUG:teuthology.orchestra.run.smithi179:> ') 2023-11-28T20:00:25.764 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T20:00:25.765 DEBUG:teuthology.orchestra.run.smithi179:> ip netns list 2023-11-28T20:00:25.774 INFO:teuthology.orchestra.run.smithi179.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-11-28T20:00:25.775 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-11-28T20:00:25.775 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T20:00:25.775 DEBUG:teuthology.orchestra.run.smithi179:> sudo ip link set brx.0 up 2023-11-28T20:00:25.844 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-28T20:00:25.844 DEBUG:teuthology.orchestra.run.smithi179:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2023-11-28T20:00:25.893 INFO:teuthology.orchestra.run.smithi179.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2023-11-28T20:00:25.893 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-28T20:00:25.893 DEBUG:teuthology.orchestra.run.smithi179:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2023-11-28T20:00:25.944 INFO:tasks.cephfs.kernel_mount:mounting using device: 1@.cephfs=/ 2023-11-28T20:00:25.945 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T20:00:25.945 DEBUG:teuthology.orchestra.run.smithi179:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 1@.cephfs=/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-11-28T20:00:26.041 INFO:teuthology.orchestra.run.smithi179.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-11-28T20:00:26.041 INFO:teuthology.orchestra.run.smithi179.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-11-28T20:00:26.054 INFO:teuthology.orchestra.run.smithi179.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-11-28T20:00:26.054 INFO:teuthology.orchestra.run.smithi179.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-11-28T20:00:26.055 INFO:teuthology.orchestra.run.smithi179.stdout:mount.ceph: resolved to: "172.21.15.78:3300,172.21.15.179:3300,172.21.15.179:3301" 2023-11-28T20:00:26.055 INFO:teuthology.orchestra.run.smithi179.stdout:mount.ceph: trying mount with new device syntax: 1@dd9780e8-3bda-44fa-a9f0-fa07d19d901d.cephfs=/ 2023-11-28T20:00:26.055 INFO:teuthology.orchestra.run.smithi179.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,ms_mode=prefer-crc,key=1,mon_addr=172.21.15.78:3300/172.21.15.179:3300/172.21.15.179:3301" will pass to kernel 2023-11-28T20:00:26.058 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-11-28T20:00:26.058 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T20:00:26.058 DEBUG:teuthology.orchestra.run.smithi179:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-11-28T20:00:26.079 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T20:00:26.079 DEBUG:teuthology.orchestra.run.smithi179:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-11-28T20:00:26.134 INFO:teuthology.orchestra.run.smithi179.stdout:client5389 2023-11-28T20:00:26.136 DEBUG:teuthology.orchestra.run.smithi179:> set -ex 2023-11-28T20:00:26.138 DEBUG:teuthology.orchestra.run.smithi179:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-28T20:00:26.189 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth rm client.testuser 2023-11-28T20:00:26.330 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:26.325+0000 7f125312a640 1 Processor -- start 2023-11-28T20:00:26.330 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:26.325+0000 7f125312a640 1 -- start start 2023-11-28T20:00:26.331 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:26.325+0000 7f125312a640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f124c1519f0 0x7f124c0c0fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:26.332 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:26.325+0000 7f125312a640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f124c1582a0 0x7f124c06b5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:26.332 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:26.325+0000 7f125312a640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f124c0c1500 con 0x7f124c155030 2023-11-28T20:00:26.332 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:26.325+0000 7f125312a640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f124c06e000 con 0x7f124c1519f0 2023-11-28T20:00:26.332 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:26.325+0000 7f125312a640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f124c06da80 con 0x7f124c1582a0 2023-11-28T20:00:26.332 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:26.325+0000 7f1250ec6640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f124c1519f0 0x7f124c0c0fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:26.332 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:26.329+0000 7f1250ec6640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f124c1519f0 0x7f124c0c0fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:45752/0 (socket says 172.21.15.78:45752) 2023-11-28T20:00:26.332 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:26.329+0000 7f1250ec6640 1 -- 172.21.15.78:0/1630104220 learned_addr learned my addr 172.21.15.78:0/1630104220 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T20:00:26.332 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:26.329+0000 7f12516c7640 1 --2- 172.21.15.78:0/1630104220 >> v2:172.21.15.179:3300/0 conn(0x7f124c1582a0 0x7f124c06b5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:26.333 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:26.329+0000 7f1250ec6640 1 -- 172.21.15.78:0/1630104220 >> v2:172.21.15.179:3300/0 conn(0x7f124c1582a0 msgr2=0x7f124c06b5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:00:26.333 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:26.329+0000 7f1250ec6640 1 --2- 172.21.15.78:0/1630104220 >> v2:172.21.15.179:3300/0 conn(0x7f124c1582a0 0x7f124c06b5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:26.333 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:26.329+0000 7f1250ec6640 1 -- 172.21.15.78:0/1630104220 >> v1:172.21.15.179:6789/0 conn(0x7f124c155030 legacy=0x7f124c06e8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:00:26.333 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:26.329+0000 7f1250ec6640 1 -- 172.21.15.78:0/1630104220 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f124c157ae0 con 0x7f124c1519f0 2023-11-28T20:00:26.335 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:26.329+0000 7f1250ec6640 1 --2- 172.21.15.78:0/1630104220 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f124c1519f0 0x7f124c0c0fc0 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f124c06f030 tx=0x7f124801c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8a4ccd314735bc91 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:00:26.336 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:26.329+0000 7f12437fe640 1 -- 172.21.15.78:0/1630104220 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12480ad660 con 0x7f124c1519f0 2023-11-28T20:00:26.336 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:26.329+0000 7f12437fe640 1 -- 172.21.15.78:0/1630104220 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f12480ad7c0 con 0x7f124c1519f0 2023-11-28T20:00:26.336 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:26.329+0000 7f12437fe640 1 -- 172.21.15.78:0/1630104220 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12480adb50 con 0x7f124c1519f0 2023-11-28T20:00:26.336 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:26.333+0000 7f125312a640 1 -- 172.21.15.78:0/1630104220 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f124c1519f0 msgr2=0x7f124c0c0fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:00:26.336 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:26.333+0000 7f125312a640 1 --2- 172.21.15.78:0/1630104220 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f124c1519f0 0x7f124c0c0fc0 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f124c06f030 tx=0x7f124801c470 comp rx=0 tx=0).stop 2023-11-28T20:00:26.336 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:26.333+0000 7f125312a640 1 -- 172.21.15.78:0/1630104220 shutdown_connections 2023-11-28T20:00:26.336 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:26.333+0000 7f125312a640 1 --2- 172.21.15.78:0/1630104220 >> v2:172.21.15.179:3300/0 conn(0x7f124c1582a0 0x7f124c06b5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:26.336 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:26.333+0000 7f125312a640 1 --2- 172.21.15.78:0/1630104220 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f124c1519f0 0x7f124c0c0fc0 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:26.337 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:26.333+0000 7f125312a640 1 -- 172.21.15.78:0/1630104220 >> 172.21.15.78:0/1630104220 conn(0x7f124c0c2e20 msgr2=0x7f124c0c3230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:00:26.337 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:26.333+0000 7f125312a640 1 -- 172.21.15.78:0/1630104220 shutdown_connections 2023-11-28T20:00:26.337 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:26.333+0000 7f125312a640 1 -- 172.21.15.78:0/1630104220 wait complete. 2023-11-28T20:00:26.337 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:26.333+0000 7f125312a640 1 Processor -- start 2023-11-28T20:00:26.337 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:26.333+0000 7f125312a640 1 -- start start 2023-11-28T20:00:26.340 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:26.333+0000 7f125312a640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f124c1519f0 0x7f124c1f0c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:26.340 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:26.333+0000 7f125312a640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f124c155030 0x7f124c1f1170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:26.340 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:26.333+0000 7f125312a640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f124c1582a0 0x7f124c149590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:26.340 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:26.333+0000 7f125312a640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f124c0a9350 con 0x7f124c1582a0 2023-11-28T20:00:26.340 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:26.333+0000 7f125312a640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f124c14cb50 con 0x7f124c155030 2023-11-28T20:00:26.340 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:26.333+0000 7f125312a640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f124c14bb90 con 0x7f124c1519f0 2023-11-28T20:00:26.341 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:26.333+0000 7f12516c7640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f124c1582a0 0x7f124c149590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:26.341 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:26.333+0000 7f12516c7640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f124c1582a0 0x7f124c149590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:45768/0 (socket says 172.21.15.78:45768) 2023-11-28T20:00:26.341 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:26.333+0000 7f12516c7640 1 -- 172.21.15.78:0/1784454543 learned_addr learned my addr 172.21.15.78:0/1784454543 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T20:00:26.341 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:26.333+0000 7f1250ec6640 1 --2- 172.21.15.78:0/1784454543 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f124c1519f0 0x7f124c1f0c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:26.341 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:26.333+0000 7f1243fff640 1 --2- 172.21.15.78:0/1784454543 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f124c155030 0x7f124c1f1170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:26.341 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:26.333+0000 7f12516c7640 1 -- 172.21.15.78:0/1784454543 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f124c1519f0 msgr2=0x7f124c1f0c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:00:26.341 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:26.333+0000 7f12516c7640 1 --2- 172.21.15.78:0/1784454543 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f124c1519f0 0x7f124c1f0c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:26.341 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:26.333+0000 7f12516c7640 1 -- 172.21.15.78:0/1784454543 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f124c155030 msgr2=0x7f124c1f1170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:00:26.341 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:26.333+0000 7f12516c7640 1 --2- 172.21.15.78:0/1784454543 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f124c155030 0x7f124c1f1170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:26.341 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:26.333+0000 7f12516c7640 1 -- 172.21.15.78:0/1784454543 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12480094d0 con 0x7f124c1582a0 2023-11-28T20:00:26.341 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:26.333+0000 7f12516c7640 1 --2- 172.21.15.78:0/1784454543 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f124c1582a0 0x7f124c149590 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f124400efc0 tx=0x7f124400c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:00:26.341 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:26.337+0000 7f12417fa640 1 -- 172.21.15.78:0/1784454543 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1244014480 con 0x7f124c1582a0 2023-11-28T20:00:26.342 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:26.337+0000 7f12417fa640 1 -- 172.21.15.78:0/1784454543 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f124400f040 con 0x7f124c1582a0 2023-11-28T20:00:26.342 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:26.337+0000 7f125312a640 1 -- 172.21.15.78:0/1784454543 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f124c14be70 con 0x7f124c1582a0 2023-11-28T20:00:26.342 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:26.337+0000 7f12417fa640 1 -- 172.21.15.78:0/1784454543 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1244014820 con 0x7f124c1582a0 2023-11-28T20:00:26.342 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:26.337+0000 7f125312a640 1 -- 172.21.15.78:0/1784454543 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f124c0aa050 con 0x7f124c1582a0 2023-11-28T20:00:26.343 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:26.337+0000 7f125312a640 1 -- 172.21.15.78:0/1784454543 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f124c154270 con 0x7f124c1582a0 2023-11-28T20:00:26.343 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:26.337+0000 7f12417fa640 1 -- 172.21.15.78:0/1784454543 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f1244014980 con 0x7f124c1582a0 2023-11-28T20:00:26.343 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:26.337+0000 7f12417fa640 1 --2- 172.21.15.78:0/1784454543 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f1238066470 0x7f1238068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:26.343 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:26.337+0000 7f12417fa640 1 -- 172.21.15.78:0/1784454543 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f1244084de0 con 0x7f124c1582a0 2023-11-28T20:00:26.343 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:26.337+0000 7f1250ec6640 1 --2- 172.21.15.78:0/1784454543 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f1238066470 0x7f1238068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:26.344 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:26.341+0000 7f1250ec6640 1 --2- 172.21.15.78:0/1784454543 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f1238066470 0x7f1238068930 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f12480af000 tx=0x7f12480a7000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:00:26.347 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:26.341+0000 7f12417fa640 1 -- 172.21.15.78:0/1784454543 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f1244052130 con 0x7f124c1582a0 2023-11-28T20:00:26.548 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:26.545+0000 7f125312a640 1 -- 172.21.15.78:0/1784454543 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "auth rm", "entity": "client.testuser"} v 0) v1 -- 0x7f124c06e730 con 0x7f124c1582a0 2023-11-28T20:00:26.548 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:26.545+0000 7f12417fa640 1 -- 172.21.15.78:0/1784454543 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "auth rm", "entity": "client.testuser"}]=0 v13) v1 ==== 84+0+0 (secure 0 0 0) 0x7f1244018090 con 0x7f124c1582a0 2023-11-28T20:00:26.550 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:26.545+0000 7f125312a640 1 -- 172.21.15.78:0/1784454543 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f1238066470 msgr2=0x7f1238068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:00:26.550 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:26.545+0000 7f125312a640 1 --2- 172.21.15.78:0/1784454543 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f1238066470 0x7f1238068930 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f12480af000 tx=0x7f12480a7000 comp rx=0 tx=0).stop 2023-11-28T20:00:26.550 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:26.545+0000 7f125312a640 1 -- 172.21.15.78:0/1784454543 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f124c1582a0 msgr2=0x7f124c149590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:00:26.550 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:26.545+0000 7f125312a640 1 --2- 172.21.15.78:0/1784454543 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f124c1582a0 0x7f124c149590 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f124400efc0 tx=0x7f124400c490 comp rx=0 tx=0).stop 2023-11-28T20:00:26.551 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:26.545+0000 7f125312a640 1 -- 172.21.15.78:0/1784454543 shutdown_connections 2023-11-28T20:00:26.551 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:26.545+0000 7f125312a640 1 --2- 172.21.15.78:0/1784454543 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f1238066470 0x7f1238068930 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:26.551 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:26.545+0000 7f125312a640 1 --2- 172.21.15.78:0/1784454543 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f124c1582a0 0x7f124c149590 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:26.551 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:26.545+0000 7f125312a640 1 --2- 172.21.15.78:0/1784454543 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f124c155030 0x7f124c1f1170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:26.551 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:26.545+0000 7f125312a640 1 --2- 172.21.15.78:0/1784454543 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f124c1519f0 0x7f124c1f0c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:26.551 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:26.545+0000 7f125312a640 1 -- 172.21.15.78:0/1784454543 >> 172.21.15.78:0/1784454543 conn(0x7f124c0c2e20 msgr2=0x7f124c0c3200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:00:26.551 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:26.545+0000 7f125312a640 1 -- 172.21.15.78:0/1784454543 shutdown_connections 2023-11-28T20:00:26.551 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:26.545+0000 7f125312a640 1 -- 172.21.15.78:0/1784454543 wait complete. 2023-11-28T20:00:26.569 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-28T20:00:26.708 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:26.701+0000 7f9b18180640 1 Processor -- start 2023-11-28T20:00:26.709 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:26.701+0000 7f9b18180640 1 -- start start 2023-11-28T20:00:26.709 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:26.701+0000 7f9b18180640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9b1014fd10 0x7f9b100a4dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:26.709 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:26.701+0000 7f9b18180640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f9b10156110 0x7f9b101565c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:26.709 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:26.701+0000 7f9b18180640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9b100c5710 con 0x7f9b100a5300 2023-11-28T20:00:26.709 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:26.701+0000 7f9b18180640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9b1006c5e0 con 0x7f9b10156110 2023-11-28T20:00:26.709 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:26.701+0000 7f9b18180640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b10155c80 con 0x7f9b1014fd10 2023-11-28T20:00:26.709 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:26.701+0000 7f9b1671d640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f9b10156110 0x7f9b101565c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:26.709 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:26.701+0000 7f9b1671d640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f9b10156110 0x7f9b101565c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.78:50594/0 (socket says 172.21.15.78:50594) 2023-11-28T20:00:26.709 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:26.701+0000 7f9b1671d640 1 -- 172.21.15.78:0/2136824122 learned_addr learned my addr 172.21.15.78:0/2136824122 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T20:00:26.709 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:26.701+0000 7f9b15f1c640 1 --2- 172.21.15.78:0/2136824122 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9b1014fd10 0x7f9b100a4dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:26.709 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:26.705+0000 7f9b1671d640 1 -- 172.21.15.78:0/2136824122 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9b1014fd10 msgr2=0x7f9b100a4dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:00:26.710 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:26.705+0000 7f9b1671d640 1 --2- 172.21.15.78:0/2136824122 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9b1014fd10 0x7f9b100a4dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:26.710 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:26.705+0000 7f9b1671d640 1 -- 172.21.15.78:0/2136824122 >> v1:172.21.15.179:6789/0 conn(0x7f9b100a5300 legacy=0x7f9b10071e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:00:26.710 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:26.705+0000 7f9b1671d640 1 -- 172.21.15.78:0/2136824122 --> v2:172.21.15.179:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b100c4e70 con 0x7f9b10156110 2023-11-28T20:00:26.710 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:26.705+0000 7f9b14f1a640 1 -- 172.21.15.78:0/2136824122 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3717339299 0 0) 0x7f9b100c5710 con 0x7f9b100a5300 2023-11-28T20:00:26.710 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:26.705+0000 7f9b1671d640 1 --2- 172.21.15.78:0/2136824122 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9b10156110 0x7f9b101565c0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f9b08009e50 tx=0x7f9b0801c8c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b96a53560163e43d server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:00:26.711 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:26.705+0000 7f9b14f1a640 1 -- 172.21.15.78:0/2136824122 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b080a5780 con 0x7f9b10156110 2023-11-28T20:00:26.711 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:26.705+0000 7f9b14f1a640 1 -- 172.21.15.78:0/2136824122 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b080a58e0 con 0x7f9b10156110 2023-11-28T20:00:26.711 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:26.705+0000 7f9b14f1a640 1 -- 172.21.15.78:0/2136824122 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b080a5c70 con 0x7f9b10156110 2023-11-28T20:00:26.713 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:26.709+0000 7f9b18180640 1 -- 172.21.15.78:0/2136824122 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9b10156110 msgr2=0x7f9b101565c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:00:26.713 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:26.709+0000 7f9b18180640 1 --2- 172.21.15.78:0/2136824122 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9b10156110 0x7f9b101565c0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f9b08009e50 tx=0x7f9b0801c8c0 comp rx=0 tx=0).stop 2023-11-28T20:00:26.713 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:26.709+0000 7f9b18180640 1 -- 172.21.15.78:0/2136824122 shutdown_connections 2023-11-28T20:00:26.713 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:26.709+0000 7f9b18180640 1 --2- 172.21.15.78:0/2136824122 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9b10156110 0x7f9b101565c0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:26.713 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:26.709+0000 7f9b18180640 1 --2- 172.21.15.78:0/2136824122 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9b1014fd10 0x7f9b100a4dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:26.713 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:26.709+0000 7f9b18180640 1 -- 172.21.15.78:0/2136824122 >> 172.21.15.78:0/2136824122 conn(0x7f9b100a7810 msgr2=0x7f9b100a7c20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:00:26.713 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:26.709+0000 7f9b18180640 1 -- 172.21.15.78:0/2136824122 shutdown_connections 2023-11-28T20:00:26.713 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:26.709+0000 7f9b18180640 1 -- 172.21.15.78:0/2136824122 wait complete. 2023-11-28T20:00:26.714 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:26.709+0000 7f9b18180640 1 Processor -- start 2023-11-28T20:00:26.714 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:26.709+0000 7f9b18180640 1 -- start start 2023-11-28T20:00:26.716 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:26.709+0000 7f9b18180640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9b100a5300 0x7f9b100bf0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:26.716 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:26.709+0000 7f9b18180640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9b1014fd10 0x7f9b10154930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:26.716 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:26.709+0000 7f9b18180640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9b10156110 0x7f9b1014cca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:26.716 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:26.709+0000 7f9b18180640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b101ec780 con 0x7f9b100a5300 2023-11-28T20:00:26.716 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:26.709+0000 7f9b18180640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b10153b20 con 0x7f9b1014fd10 2023-11-28T20:00:26.716 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:26.709+0000 7f9b18180640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b10154170 con 0x7f9b10156110 2023-11-28T20:00:26.716 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:26.709+0000 7f9b15f1c640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9b100a5300 0x7f9b100bf0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:26.716 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:26.709+0000 7f9b15f1c640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9b100a5300 0x7f9b100bf0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:45770/0 (socket says 172.21.15.78:45770) 2023-11-28T20:00:26.716 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:26.709+0000 7f9b15f1c640 1 -- 172.21.15.78:0/2839221396 learned_addr learned my addr 172.21.15.78:0/2839221396 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T20:00:26.717 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:26.709+0000 7f9b1571b640 1 --2- 172.21.15.78:0/2839221396 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9b1014fd10 0x7f9b10154930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:26.717 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:26.709+0000 7f9b1671d640 1 --2- 172.21.15.78:0/2839221396 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9b10156110 0x7f9b1014cca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:26.717 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:26.709+0000 7f9b15f1c640 1 -- 172.21.15.78:0/2839221396 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9b10156110 msgr2=0x7f9b1014cca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:00:26.717 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:26.709+0000 7f9b15f1c640 1 --2- 172.21.15.78:0/2839221396 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9b10156110 0x7f9b1014cca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:26.717 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:26.709+0000 7f9b15f1c640 1 -- 172.21.15.78:0/2839221396 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9b1014fd10 msgr2=0x7f9b10154930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:00:26.717 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:26.709+0000 7f9b15f1c640 1 --2- 172.21.15.78:0/2839221396 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9b1014fd10 0x7f9b10154930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:26.717 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:26.709+0000 7f9b15f1c640 1 -- 172.21.15.78:0/2839221396 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b08009b30 con 0x7f9b100a5300 2023-11-28T20:00:26.717 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:26.709+0000 7f9b1671d640 1 --2- 172.21.15.78:0/2839221396 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9b10156110 0x7f9b1014cca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T20:00:26.717 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:26.709+0000 7f9b15f1c640 1 --2- 172.21.15.78:0/2839221396 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9b100a5300 0x7f9b100bf0f0 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f9b0c00e930 tx=0x7f9b0c00edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:00:26.717 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:26.713+0000 7f9b067fc640 1 -- 172.21.15.78:0/2839221396 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b0c009690 con 0x7f9b100a5300 2023-11-28T20:00:26.717 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:26.713+0000 7f9b067fc640 1 -- 172.21.15.78:0/2839221396 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b0c00ca00 con 0x7f9b100a5300 2023-11-28T20:00:26.717 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:26.713+0000 7f9b067fc640 1 -- 172.21.15.78:0/2839221396 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b0c00cd70 con 0x7f9b100a5300 2023-11-28T20:00:26.718 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:26.713+0000 7f9b18180640 1 -- 172.21.15.78:0/2839221396 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9b1014f5e0 con 0x7f9b100a5300 2023-11-28T20:00:26.718 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:26.713+0000 7f9b18180640 1 -- 172.21.15.78:0/2839221396 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9b10154410 con 0x7f9b100a5300 2023-11-28T20:00:26.718 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:26.713+0000 7f9b18180640 1 -- 172.21.15.78:0/2839221396 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9b101545d0 con 0x7f9b100a5300 2023-11-28T20:00:26.719 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:26.713+0000 7f9b067fc640 1 -- 172.21.15.78:0/2839221396 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f9b0c013470 con 0x7f9b100a5300 2023-11-28T20:00:26.719 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:26.713+0000 7f9b067fc640 1 --2- 172.21.15.78:0/2839221396 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f9af4066470 0x7f9af4068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:26.719 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:26.713+0000 7f9b067fc640 1 -- 172.21.15.78:0/2839221396 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f9b0c0841c0 con 0x7f9b100a5300 2023-11-28T20:00:26.719 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:26.713+0000 7f9b1571b640 1 --2- 172.21.15.78:0/2839221396 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f9af4066470 0x7f9af4068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:26.719 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:26.713+0000 7f9b1571b640 1 --2- 172.21.15.78:0/2839221396 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f9af4066470 0x7f9af4068930 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f9b100a7230 tx=0x7f9b00009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:00:26.722 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:26.717+0000 7f9b067fc640 1 -- 172.21.15.78:0/2839221396 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f9b0c0515b0 con 0x7f9b100a5300 2023-11-28T20:00:26.874 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:26.869+0000 7f9b18180640 1 -- 172.21.15.78:0/2839221396 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9b10067630 con 0x7f9b100a5300 2023-11-28T20:00:26.875 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:26.869+0000 7f9b067fc640 1 -- 172.21.15.78:0/2839221396 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v40) v1 ==== 74+0+16750 (secure 0 0 0) 0x7f9b0c054bd0 con 0x7f9b100a5300 2023-11-28T20:00:26.875 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-11-28T20:00:26.875 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":40,"fsid":"dd9780e8-3bda-44fa-a9f0-fa07d19d901d","created":"2023-11-28T19:58:40.969556+0000","modified":"2023-11-28T20:00:14.786634+0000","last_up_change":"2023-11-28T19:58:52.596716+0000","last_in_change":"2023-11-28T19:58:43.609275+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-28T19:58:54.011229+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2023-11-28T20:00:10.831194+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"39","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2023-11-28T20:00:12.150184+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"40","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e84245ac-b5da-429e-af18-39acaa2b33e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6800","nonce":3358701235},{"type":"v1","addr":"172.21.15.78:6801","nonce":3358701235}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6802","nonce":3358701235},{"type":"v1","addr":"172.21.15.78:6803","nonce":3358701235}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6806","nonce":3358701235},{"type":"v1","addr":"172.21.15.78:6807","nonce":3358701235}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6804","nonce":3358701235},{"type":"v1","addr":"172.21.15.78:6805","nonce":3358701235}]},"public_addr":"172.21.15.78:6801/3358701235","cluster_addr":"172.21.15.78:6803/3358701235","heartbeat_back_addr":"172.21.15.78:6807/3358701235","heartbeat_front_addr":"172.21.15.78:6805/3358701235","state":["exists","up"]},{"osd":1,"uuid":"e634831d-c4e2-48d9-870c-9556ae162981","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6808","nonce":3211476654},{"type":"v1","addr":"172.21.15.78:6809","nonce":3211476654}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6810","nonce":3211476654},{"type":"v1","addr":"172.21.15.78:6811","nonce":3211476654}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6814","nonce":3211476654},{"type":"v1","addr":"172.21.15.78:6815","nonce":3211476654}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6812","nonce":3211476654},{"type":"v1","addr":"172.21.15.78:6813","nonce":3211476654}]},"public_addr":"172.21.15.78:6809/3211476654","cluster_addr":"172.21.15.78:6811/3211476654","heartbeat_back_addr":"172.21.15.78:6815/3211476654","heartbeat_front_addr":"172.21.15.78:6813/3211476654","state":["exists","up"]},{"osd":2,"uuid":"274c8395-6534-41f0-b8fb-a00af8985aa8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6816","nonce":2532904479},{"type":"v1","addr":"172.21.15.78:6817","nonce":2532904479}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6818","nonce":2532904479},{"type":"v1","addr":"172.21.15.78:6819","nonce":2532904479}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6822","nonce":2532904479},{"type":"v1","addr":"172.21.15.78:6823","nonce":2532904479}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6820","nonce":2532904479},{"type":"v1","addr":"172.21.15.78:6821","nonce":2532904479}]},"public_addr":"172.21.15.78:6817/2532904479","cluster_addr":"172.21.15.78:6819/2532904479","heartbeat_back_addr":"172.21.15.78:6823/2532904479","heartbeat_front_addr":"172.21.15.78:6821/2532904479","state":["exists","up"]},{"osd":3,"uuid":"77acc9af-7d4d-4b18-8cf5-d62f5971b7c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6824","nonce":3442991267},{"type":"v1","addr":"172.21.15.78:6825","nonce":3442991267}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6826","nonce":3442991267},{"type":"v1","addr":"172.21.15.78:6827","nonce":3442991267}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6830","nonce":3442991267},{"type":"v1","addr":"172.21.15.78:6831","nonce":3442991267}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6828","nonce":3442991267},{"type":"v1","addr":"172.21.15.78:6829","nonce":3442991267}]},"public_addr":"172.21.15.78:6825/3442991267","cluster_addr":"172.21.15.78:6827/3442991267","heartbeat_back_addr":"172.21.15.78:6831/3442991267","heartbeat_front_addr":"172.21.15.78:6829/3442991267","state":["exists","up"]},{"osd":4,"uuid":"5c62bc66-6b34-4b7f-a66b-9a743969138c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":802983577},{"type":"v1","addr":"172.21.15.179:6809","nonce":802983577}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":802983577},{"type":"v1","addr":"172.21.15.179:6811","nonce":802983577}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":802983577},{"type":"v1","addr":"172.21.15.179:6815","nonce":802983577}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":802983577},{"type":"v1","addr":"172.21.15.179:6813","nonce":802983577}]},"public_addr":"172.21.15.179:6809/802983577","cluster_addr":"172.21.15.179:6811/802983577","heartbeat_back_addr":"172.21.15.179:6815/802983577","heartbeat_front_addr":"172.21.15.179:6813/802983577","state":["exists","up"]},{"osd":5,"uuid":"67db6d36-f684-4079-b0cd-82b4dd61461f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":518192887},{"type":"v1","addr":"172.21.15.179:6818","nonce":518192887}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":518192887},{"type":"v1","addr":"172.21.15.179:6822","nonce":518192887}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":518192887},{"type":"v1","addr":"172.21.15.179:6829","nonce":518192887}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6824","nonce":518192887},{"type":"v1","addr":"172.21.15.179:6826","nonce":518192887}]},"public_addr":"172.21.15.179:6818/518192887","cluster_addr":"172.21.15.179:6822/518192887","heartbeat_back_addr":"172.21.15.179:6829/518192887","heartbeat_front_addr":"172.21.15.179:6826/518192887","state":["exists","up"]},{"osd":6,"uuid":"12e670af-5a16-4c81-9f97-defa66cab967","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":815435378},{"type":"v1","addr":"172.21.15.179:6801","nonce":815435378}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":815435378},{"type":"v1","addr":"172.21.15.179:6803","nonce":815435378}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":815435378},{"type":"v1","addr":"172.21.15.179:6807","nonce":815435378}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":815435378},{"type":"v1","addr":"172.21.15.179:6805","nonce":815435378}]},"public_addr":"172.21.15.179:6801/815435378","cluster_addr":"172.21.15.179:6803/815435378","heartbeat_back_addr":"172.21.15.179:6807/815435378","heartbeat_front_addr":"172.21.15.179:6805/815435378","state":["exists","up"]},{"osd":7,"uuid":"fe630650-2eb3-49ad-8676-c341e6332eb1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6817","nonce":2848432339},{"type":"v1","addr":"172.21.15.179:6819","nonce":2848432339}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6821","nonce":2848432339},{"type":"v1","addr":"172.21.15.179:6823","nonce":2848432339}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":2848432339},{"type":"v1","addr":"172.21.15.179:6831","nonce":2848432339}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6825","nonce":2848432339},{"type":"v1","addr":"172.21.15.179:6827","nonce":2848432339}]},"public_addr":"172.21.15.179:6819/2848432339","cluster_addr":"172.21.15.179:6823/2848432339","heartbeat_back_addr":"172.21.15.179:6831/2848432339","heartbeat_front_addr":"172.21.15.179:6827/2848432339","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:58:49.255433+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:58:49.412880+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:58:49.559295+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:58:49.245237+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:58:49.184557+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:58:49.329851+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:58:49.366012+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:58:49.349604+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-28T20:00:26.877 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:26.873+0000 7f9b18180640 1 -- 172.21.15.78:0/2839221396 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f9af4066470 msgr2=0x7f9af4068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:00:26.877 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:26.873+0000 7f9b18180640 1 --2- 172.21.15.78:0/2839221396 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f9af4066470 0x7f9af4068930 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f9b100a7230 tx=0x7f9b00009040 comp rx=0 tx=0).stop 2023-11-28T20:00:26.877 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:26.873+0000 7f9b18180640 1 -- 172.21.15.78:0/2839221396 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9b100a5300 msgr2=0x7f9b100bf0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:00:26.878 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:26.873+0000 7f9b18180640 1 --2- 172.21.15.78:0/2839221396 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9b100a5300 0x7f9b100bf0f0 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f9b0c00e930 tx=0x7f9b0c00edf0 comp rx=0 tx=0).stop 2023-11-28T20:00:26.878 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:26.873+0000 7f9b18180640 1 -- 172.21.15.78:0/2839221396 shutdown_connections 2023-11-28T20:00:26.878 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:26.873+0000 7f9b18180640 1 --2- 172.21.15.78:0/2839221396 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f9af4066470 0x7f9af4068930 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:26.878 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:26.873+0000 7f9b18180640 1 --2- 172.21.15.78:0/2839221396 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9b10156110 0x7f9b1014cca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:26.878 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:26.873+0000 7f9b18180640 1 --2- 172.21.15.78:0/2839221396 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9b1014fd10 0x7f9b10154930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:26.878 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:26.873+0000 7f9b18180640 1 --2- 172.21.15.78:0/2839221396 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9b100a5300 0x7f9b100bf0f0 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:26.878 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:26.873+0000 7f9b18180640 1 -- 172.21.15.78:0/2839221396 >> 172.21.15.78:0/2839221396 conn(0x7f9b100a7810 msgr2=0x7f9b100ab1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:00:26.878 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:26.873+0000 7f9b18180640 1 -- 172.21.15.78:0/2839221396 shutdown_connections 2023-11-28T20:00:26.878 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:26.873+0000 7f9b18180640 1 -- 172.21.15.78:0/2839221396 wait complete. 2023-11-28T20:00:26.896 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-28T19:58:54.011229+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-28T20:00:10.831194+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '39', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.25, 'score_stable': 1.25, 'optimal_score': 1, 'raw_score_acting': 1.25, 'raw_score_stable': 1.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 6, 'pool_name': 'cephfs_data', 'create_time': '2023-11-28T20:00:12.150184+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '40', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-28T20:00:26.897 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-28T20:00:27.038 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:27.033+0000 7fb5dc5f8640 1 Processor -- start 2023-11-28T20:00:27.038 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:27.033+0000 7fb5dc5f8640 1 -- start start 2023-11-28T20:00:27.040 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:27.033+0000 7fb5dc5f8640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb5d40bf2d0 0x7fb5d4151970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:27.040 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:27.033+0000 7fb5dc5f8640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fb5d40c6030 0x7fb5d4151eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:27.040 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:27.033+0000 7fb5dc5f8640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb5d4158780 con 0x7fb5d40c98f0 2023-11-28T20:00:27.040 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:27.033+0000 7fb5dc5f8640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb5d40c0300 con 0x7fb5d40c6030 2023-11-28T20:00:27.040 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:27.033+0000 7fb5dc5f8640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5d4157b70 con 0x7fb5d40bf2d0 2023-11-28T20:00:27.040 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:27.033+0000 7fb5d9b93640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fb5d40c6030 0x7fb5d4151eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:27.040 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:27.033+0000 7fb5da394640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb5d40bf2d0 0x7fb5d4151970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:27.041 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:27.033+0000 7fb5d9b93640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fb5d40c6030 0x7fb5d4151eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:45786/0 (socket says 172.21.15.78:45786) 2023-11-28T20:00:27.041 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:27.033+0000 7fb5d9b93640 1 -- 172.21.15.78:0/3192838299 learned_addr learned my addr 172.21.15.78:0/3192838299 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T20:00:27.041 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:27.037+0000 7fb5d9b93640 1 -- 172.21.15.78:0/3192838299 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb5d40bf2d0 msgr2=0x7fb5d4151970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:00:27.041 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:27.037+0000 7fb5d9b93640 1 --2- 172.21.15.78:0/3192838299 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb5d40bf2d0 0x7fb5d4151970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:27.041 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:27.037+0000 7fb5d9b93640 1 -- 172.21.15.78:0/3192838299 >> v1:172.21.15.179:6789/0 conn(0x7fb5d40c98f0 legacy=0x7fb5d40c7cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:00:27.041 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:27.037+0000 7fb5d9b93640 1 -- 172.21.15.78:0/3192838299 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5d4157e50 con 0x7fb5d40c6030 2023-11-28T20:00:27.041 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:27.037+0000 7fb5d9392640 1 -- 172.21.15.78:0/3192838299 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2815125421 0 0) 0x7fb5d4158780 con 0x7fb5d40c98f0 2023-11-28T20:00:27.043 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:27.037+0000 7fb5d9b93640 1 --2- 172.21.15.78:0/3192838299 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb5d40c6030 0x7fb5d4151eb0 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7fb5c4009870 tx=0x7fb5c401c510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=79776600b5b7c421 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:00:27.043 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:27.037+0000 7fb5d9392640 1 -- 172.21.15.78:0/3192838299 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5c40aa670 con 0x7fb5d40c6030 2023-11-28T20:00:27.043 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:27.037+0000 7fb5d9392640 1 -- 172.21.15.78:0/3192838299 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb5c40aa7d0 con 0x7fb5d40c6030 2023-11-28T20:00:27.043 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:27.037+0000 7fb5d9392640 1 -- 172.21.15.78:0/3192838299 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5c40aab60 con 0x7fb5d40c6030 2023-11-28T20:00:27.044 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:27.037+0000 7fb5dc5f8640 1 -- 172.21.15.78:0/3192838299 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb5d40c6030 msgr2=0x7fb5d4151eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:00:27.044 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:27.037+0000 7fb5dc5f8640 1 --2- 172.21.15.78:0/3192838299 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb5d40c6030 0x7fb5d4151eb0 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7fb5c4009870 tx=0x7fb5c401c510 comp rx=0 tx=0).stop 2023-11-28T20:00:27.044 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:27.041+0000 7fb5dc5f8640 1 -- 172.21.15.78:0/3192838299 shutdown_connections 2023-11-28T20:00:27.044 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:27.041+0000 7fb5dc5f8640 1 --2- 172.21.15.78:0/3192838299 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb5d40c6030 0x7fb5d4151eb0 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:27.044 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:27.041+0000 7fb5dc5f8640 1 --2- 172.21.15.78:0/3192838299 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb5d40bf2d0 0x7fb5d4151970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:27.044 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:27.041+0000 7fb5dc5f8640 1 -- 172.21.15.78:0/3192838299 >> 172.21.15.78:0/3192838299 conn(0x7fb5d40c9dc0 msgr2=0x7fb5d40ca1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:00:27.044 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:27.041+0000 7fb5dc5f8640 1 -- 172.21.15.78:0/3192838299 shutdown_connections 2023-11-28T20:00:27.045 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:27.041+0000 7fb5dc5f8640 1 -- 172.21.15.78:0/3192838299 wait complete. 2023-11-28T20:00:27.045 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:27.041+0000 7fb5dc5f8640 1 Processor -- start 2023-11-28T20:00:27.045 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:27.041+0000 7fb5dc5f8640 1 -- start start 2023-11-28T20:00:27.048 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:27.041+0000 7fb5dc5f8640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb5d40bf2d0 0x7fb5d40acf50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:27.048 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:27.041+0000 7fb5dc5f8640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb5d40c6030 0x7fb5d406b840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:27.048 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:27.041+0000 7fb5dc5f8640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb5d40c98f0 0x7fb5d406bd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:27.048 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:27.041+0000 7fb5dc5f8640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5d40ad7e0 con 0x7fb5d40bf2d0 2023-11-28T20:00:27.048 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:27.041+0000 7fb5dc5f8640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5d41ecc70 con 0x7fb5d40c6030 2023-11-28T20:00:27.048 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:27.041+0000 7fb5dc5f8640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5d406ad60 con 0x7fb5d40c98f0 2023-11-28T20:00:27.048 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:27.041+0000 7fb5da394640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb5d40bf2d0 0x7fb5d40acf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:27.049 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:27.041+0000 7fb5da394640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb5d40bf2d0 0x7fb5d40acf50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:45790/0 (socket says 172.21.15.78:45790) 2023-11-28T20:00:27.049 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:27.041+0000 7fb5da394640 1 -- 172.21.15.78:0/640931545 learned_addr learned my addr 172.21.15.78:0/640931545 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T20:00:27.049 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:27.041+0000 7fb5d9b93640 1 --2- 172.21.15.78:0/640931545 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb5d40c6030 0x7fb5d406b840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:27.049 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:27.041+0000 7fb5dab95640 1 --2- 172.21.15.78:0/640931545 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb5d40c98f0 0x7fb5d406bd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:27.049 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:27.041+0000 7fb5da394640 1 -- 172.21.15.78:0/640931545 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb5d40c98f0 msgr2=0x7fb5d406bd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:00:27.049 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:27.041+0000 7fb5da394640 1 --2- 172.21.15.78:0/640931545 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb5d40c98f0 0x7fb5d406bd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:27.049 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:27.041+0000 7fb5da394640 1 -- 172.21.15.78:0/640931545 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb5d40c6030 msgr2=0x7fb5d406b840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:00:27.049 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:27.041+0000 7fb5da394640 1 --2- 172.21.15.78:0/640931545 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb5d40c6030 0x7fb5d406b840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:27.049 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:27.041+0000 7fb5da394640 1 -- 172.21.15.78:0/640931545 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5c40094d0 con 0x7fb5d40bf2d0 2023-11-28T20:00:27.049 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:27.041+0000 7fb5dab95640 1 --2- 172.21.15.78:0/640931545 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb5d40c98f0 0x7fb5d406bd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T20:00:27.049 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:27.041+0000 7fb5da394640 1 --2- 172.21.15.78:0/640931545 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb5d40bf2d0 0x7fb5d40acf50 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7fb5d000e870 tx=0x7fb5d000ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:00:27.049 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:27.041+0000 7fb5caffd640 1 -- 172.21.15.78:0/640931545 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5d0009510 con 0x7fb5d40bf2d0 2023-11-28T20:00:27.050 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:27.045+0000 7fb5caffd640 1 -- 172.21.15.78:0/640931545 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb5d000eec0 con 0x7fb5d40bf2d0 2023-11-28T20:00:27.050 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:27.045+0000 7fb5dc5f8640 1 -- 172.21.15.78:0/640931545 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb5d41ecf30 con 0x7fb5d40bf2d0 2023-11-28T20:00:27.050 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:27.045+0000 7fb5caffd640 1 -- 172.21.15.78:0/640931545 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5d000cb40 con 0x7fb5d40bf2d0 2023-11-28T20:00:27.050 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:27.045+0000 7fb5dc5f8640 1 -- 172.21.15.78:0/640931545 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb5d41ed4f0 con 0x7fb5d40bf2d0 2023-11-28T20:00:27.051 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:27.045+0000 7fb5dc5f8640 1 -- 172.21.15.78:0/640931545 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb5d4067630 con 0x7fb5d40bf2d0 2023-11-28T20:00:27.051 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:27.045+0000 7fb5caffd640 1 -- 172.21.15.78:0/640931545 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fb5d000cca0 con 0x7fb5d40bf2d0 2023-11-28T20:00:27.051 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:27.045+0000 7fb5caffd640 1 --2- 172.21.15.78:0/640931545 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fb5b80664a0 0x7fb5b8068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:27.051 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:27.045+0000 7fb5caffd640 1 -- 172.21.15.78:0/640931545 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6029+0+0 (secure 0 0 0) 0x7fb5d0084120 con 0x7fb5d40bf2d0 2023-11-28T20:00:27.051 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:27.045+0000 7fb5d9b93640 1 --2- 172.21.15.78:0/640931545 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fb5b80664a0 0x7fb5b8068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:27.051 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:27.045+0000 7fb5d9b93640 1 --2- 172.21.15.78:0/640931545 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fb5b80664a0 0x7fb5b8068960 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fb5c40ae000 tx=0x7fb5c40a7000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:00:27.054 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:27.049+0000 7fb5caffd640 1 -- 172.21.15.78:0/640931545 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fb5d0051450 con 0x7fb5d40bf2d0 2023-11-28T20:00:27.207 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:27.201+0000 7fb5dc5f8640 1 -- 172.21.15.78:0/640931545 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fb5d4147e90 con 0x7fb5d40bf2d0 2023-11-28T20:00:27.207 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:27.201+0000 7fb5caffd640 1 -- 172.21.15.78:0/640931545 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v40) v1 ==== 93+0+10 (secure 0 0 0) 0x7fb5d0054a70 con 0x7fb5d40bf2d0 2023-11-28T20:00:27.208 INFO:teuthology.orchestra.run.smithi078.stdout:pg_num: 1 2023-11-28T20:00:27.209 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:27.205+0000 7fb5dc5f8640 1 -- 172.21.15.78:0/640931545 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fb5b80664a0 msgr2=0x7fb5b8068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:00:27.210 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:27.205+0000 7fb5dc5f8640 1 --2- 172.21.15.78:0/640931545 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fb5b80664a0 0x7fb5b8068960 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fb5c40ae000 tx=0x7fb5c40a7000 comp rx=0 tx=0).stop 2023-11-28T20:00:27.210 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:27.205+0000 7fb5dc5f8640 1 -- 172.21.15.78:0/640931545 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb5d40bf2d0 msgr2=0x7fb5d40acf50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:00:27.210 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:27.205+0000 7fb5dc5f8640 1 --2- 172.21.15.78:0/640931545 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb5d40bf2d0 0x7fb5d40acf50 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7fb5d000e870 tx=0x7fb5d000ec70 comp rx=0 tx=0).stop 2023-11-28T20:00:27.210 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:27.205+0000 7fb5dc5f8640 1 -- 172.21.15.78:0/640931545 shutdown_connections 2023-11-28T20:00:27.210 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:27.205+0000 7fb5dc5f8640 1 --2- 172.21.15.78:0/640931545 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fb5b80664a0 0x7fb5b8068960 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:27.210 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:27.205+0000 7fb5dc5f8640 1 --2- 172.21.15.78:0/640931545 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb5d40c98f0 0x7fb5d406bd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:27.210 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:27.205+0000 7fb5dc5f8640 1 --2- 172.21.15.78:0/640931545 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb5d40c6030 0x7fb5d406b840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:27.210 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:27.205+0000 7fb5dc5f8640 1 --2- 172.21.15.78:0/640931545 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb5d40bf2d0 0x7fb5d40acf50 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:27.210 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:27.205+0000 7fb5dc5f8640 1 -- 172.21.15.78:0/640931545 >> 172.21.15.78:0/640931545 conn(0x7fb5d40c9dc0 msgr2=0x7fb5d4148690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:00:27.210 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:27.205+0000 7fb5dc5f8640 1 -- 172.21.15.78:0/640931545 shutdown_connections 2023-11-28T20:00:27.211 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:27.205+0000 7fb5dc5f8640 1 -- 172.21.15.78:0/640931545 wait complete. 2023-11-28T20:00:27.228 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-28T20:00:27.368 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:27.365+0000 7f824a72a640 1 Processor -- start 2023-11-28T20:00:27.369 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:27.365+0000 7f824a72a640 1 -- start start 2023-11-28T20:00:27.370 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:27.365+0000 7f824a72a640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f824414b1e0 0x7f82440c1700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:27.370 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:27.365+0000 7f824a72a640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f82440c5300 0x7f82440a9c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:27.370 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:27.365+0000 7f824a72a640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f82440a4e20 con 0x7f8244151280 2023-11-28T20:00:27.370 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:27.365+0000 7f824a72a640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f82441558d0 con 0x7f824414b1e0 2023-11-28T20:00:27.371 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:27.365+0000 7f824a72a640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f82440a50e0 con 0x7f82440c5300 2023-11-28T20:00:27.371 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:27.365+0000 7f8243fff640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f824414b1e0 0x7f82440c1700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:27.371 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:27.365+0000 7f8243fff640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f824414b1e0 0x7f82440c1700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:45796/0 (socket says 172.21.15.78:45796) 2023-11-28T20:00:27.371 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:27.365+0000 7f8243fff640 1 -- 172.21.15.78:0/1842025211 learned_addr learned my addr 172.21.15.78:0/1842025211 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T20:00:27.371 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:27.365+0000 7f82437fe640 1 --2- 172.21.15.78:0/1842025211 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f82440c5300 0x7f82440a9c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:27.371 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:27.365+0000 7f8243fff640 1 -- 172.21.15.78:0/1842025211 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f82440c5300 msgr2=0x7f82440a9c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:00:27.371 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:27.365+0000 7f8243fff640 1 --2- 172.21.15.78:0/1842025211 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f82440c5300 0x7f82440a9c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:27.371 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:27.365+0000 7f8243fff640 1 -- 172.21.15.78:0/1842025211 >> v1:172.21.15.179:6789/0 conn(0x7f8244151280 legacy=0x7f8244151710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:00:27.371 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:27.365+0000 7f8243fff640 1 -- 172.21.15.78:0/1842025211 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82440c0f00 con 0x7f824414b1e0 2023-11-28T20:00:27.371 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:27.365+0000 7f82437fe640 1 --2- 172.21.15.78:0/1842025211 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f82440c5300 0x7f82440a9c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T20:00:27.373 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:27.369+0000 7f8243fff640 1 --2- 172.21.15.78:0/1842025211 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f824414b1e0 0x7f82440c1700 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f82440c4150 tx=0x7f823401eb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1d9584a39018a368 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:00:27.373 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:27.369+0000 7f8242ffd640 1 -- 172.21.15.78:0/1842025211 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82340a7a30 con 0x7f824414b1e0 2023-11-28T20:00:27.373 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:27.369+0000 7f8242ffd640 1 -- 172.21.15.78:0/1842025211 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f82340a7b90 con 0x7f824414b1e0 2023-11-28T20:00:27.373 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:27.369+0000 7f8242ffd640 1 -- 172.21.15.78:0/1842025211 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82340af440 con 0x7f824414b1e0 2023-11-28T20:00:27.374 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:27.369+0000 7f824a72a640 1 -- 172.21.15.78:0/1842025211 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f824414b1e0 msgr2=0x7f82440c1700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:00:27.374 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:27.369+0000 7f824a72a640 1 --2- 172.21.15.78:0/1842025211 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f824414b1e0 0x7f82440c1700 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f82440c4150 tx=0x7f823401eb90 comp rx=0 tx=0).stop 2023-11-28T20:00:27.374 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:27.369+0000 7f824a72a640 1 -- 172.21.15.78:0/1842025211 shutdown_connections 2023-11-28T20:00:27.375 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:27.369+0000 7f824a72a640 1 --2- 172.21.15.78:0/1842025211 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f82440c5300 0x7f82440a9c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:27.375 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:27.369+0000 7f824a72a640 1 --2- 172.21.15.78:0/1842025211 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f824414b1e0 0x7f82440c1700 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:27.375 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:27.369+0000 7f824a72a640 1 -- 172.21.15.78:0/1842025211 >> 172.21.15.78:0/1842025211 conn(0x7f82440c59f0 msgr2=0x7f82440c5e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:00:27.375 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:27.369+0000 7f824a72a640 1 -- 172.21.15.78:0/1842025211 shutdown_connections 2023-11-28T20:00:27.375 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:27.369+0000 7f824a72a640 1 -- 172.21.15.78:0/1842025211 wait complete. 2023-11-28T20:00:27.375 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:27.369+0000 7f824a72a640 1 Processor -- start 2023-11-28T20:00:27.376 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:27.373+0000 7f824a72a640 1 -- start start 2023-11-28T20:00:27.378 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:27.373+0000 7f824a72a640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f82440c5300 0x7f824406b930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:27.378 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:27.373+0000 7f824a72a640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f824414b1e0 0x7f82440befc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:27.378 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:27.373+0000 7f824a72a640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8244151280 0x7f82441f0c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:27.378 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:27.373+0000 7f824a72a640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82441f07b0 con 0x7f82440c5300 2023-11-28T20:00:27.378 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:27.373+0000 7f824a72a640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82441f0480 con 0x7f824414b1e0 2023-11-28T20:00:27.379 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:27.373+0000 7f824a72a640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f824406d1e0 con 0x7f8244151280 2023-11-28T20:00:27.379 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:27.373+0000 7f8243fff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f82440c5300 0x7f824406b930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:27.379 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:27.373+0000 7f8243fff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f82440c5300 0x7f824406b930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:45802/0 (socket says 172.21.15.78:45802) 2023-11-28T20:00:27.379 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:27.373+0000 7f8243fff640 1 -- 172.21.15.78:0/1010508221 learned_addr learned my addr 172.21.15.78:0/1010508221 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T20:00:27.379 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:27.373+0000 7f82437fe640 1 --2- 172.21.15.78:0/1010508221 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f824414b1e0 0x7f82440befc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:27.379 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:27.373+0000 7f8248cc7640 1 --2- 172.21.15.78:0/1010508221 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8244151280 0x7f82441f0c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:27.379 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:27.373+0000 7f8243fff640 1 -- 172.21.15.78:0/1010508221 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8244151280 msgr2=0x7f82441f0c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:00:27.379 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:27.373+0000 7f8243fff640 1 --2- 172.21.15.78:0/1010508221 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8244151280 0x7f82441f0c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:27.379 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:27.373+0000 7f8243fff640 1 -- 172.21.15.78:0/1010508221 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f824414b1e0 msgr2=0x7f82440befc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:00:27.379 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:27.373+0000 7f8243fff640 1 --2- 172.21.15.78:0/1010508221 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f824414b1e0 0x7f82440befc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:27.379 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:27.373+0000 7f8243fff640 1 -- 172.21.15.78:0/1010508221 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f823400b770 con 0x7f82440c5300 2023-11-28T20:00:27.380 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:27.373+0000 7f8248cc7640 1 --2- 172.21.15.78:0/1010508221 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8244151280 0x7f82441f0c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T20:00:27.380 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:27.373+0000 7f8243fff640 1 --2- 172.21.15.78:0/1010508221 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f82440c5300 0x7f824406b930 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f823400b2c0 tx=0x7f823401d3d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:00:27.380 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:27.373+0000 7f8240ff9640 1 -- 172.21.15.78:0/1010508221 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82340afea0 con 0x7f82440c5300 2023-11-28T20:00:27.380 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:27.373+0000 7f8240ff9640 1 -- 172.21.15.78:0/1010508221 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f82340ba480 con 0x7f82440c5300 2023-11-28T20:00:27.380 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:27.373+0000 7f824a72a640 1 -- 172.21.15.78:0/1010508221 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f824406d4c0 con 0x7f82440c5300 2023-11-28T20:00:27.380 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:27.373+0000 7f8240ff9640 1 -- 172.21.15.78:0/1010508221 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82340ba830 con 0x7f82440c5300 2023-11-28T20:00:27.380 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:27.373+0000 7f824a72a640 1 -- 172.21.15.78:0/1010508221 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f824406d7a0 con 0x7f82440c5300 2023-11-28T20:00:27.381 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:27.373+0000 7f824a72a640 1 -- 172.21.15.78:0/1010508221 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f82440c5fa0 con 0x7f82440c5300 2023-11-28T20:00:27.381 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:27.377+0000 7f8240ff9640 1 -- 172.21.15.78:0/1010508221 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f82340ba990 con 0x7f82440c5300 2023-11-28T20:00:27.381 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:27.377+0000 7f8240ff9640 1 --2- 172.21.15.78:0/1010508221 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f8230066470 0x7f8230068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:27.381 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:27.377+0000 7f8240ff9640 1 -- 172.21.15.78:0/1010508221 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f823411f650 con 0x7f82440c5300 2023-11-28T20:00:27.381 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:27.377+0000 7f82437fe640 1 --2- 172.21.15.78:0/1010508221 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f8230066470 0x7f8230068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:27.382 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:27.377+0000 7f82437fe640 1 --2- 172.21.15.78:0/1010508221 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f8230066470 0x7f8230068930 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f82441eacb0 tx=0x7f8238008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:00:27.385 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:27.381+0000 7f8240ff9640 1 -- 172.21.15.78:0/1010508221 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f82340ecab0 con 0x7f82440c5300 2023-11-28T20:00:27.534 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:27.529+0000 7f824a72a640 1 -- 172.21.15.78:0/1010508221 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f82440c5fa0 con 0x7f82440c5300 2023-11-28T20:00:27.534 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:27.529+0000 7f8240ff9640 1 -- 172.21.15.78:0/1010508221 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v40) v1 ==== 104+0+11 (secure 0 0 0) 0x7f823411de60 con 0x7f82440c5300 2023-11-28T20:00:27.534 INFO:teuthology.orchestra.run.smithi078.stdout:pg_num: 32 2023-11-28T20:00:27.536 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:27.533+0000 7f824a72a640 1 -- 172.21.15.78:0/1010508221 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f8230066470 msgr2=0x7f8230068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:00:27.536 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:27.533+0000 7f824a72a640 1 --2- 172.21.15.78:0/1010508221 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f8230066470 0x7f8230068930 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f82441eacb0 tx=0x7f8238008040 comp rx=0 tx=0).stop 2023-11-28T20:00:27.537 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:27.533+0000 7f824a72a640 1 -- 172.21.15.78:0/1010508221 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f82440c5300 msgr2=0x7f824406b930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:00:27.537 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:27.533+0000 7f824a72a640 1 --2- 172.21.15.78:0/1010508221 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f82440c5300 0x7f824406b930 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f823400b2c0 tx=0x7f823401d3d0 comp rx=0 tx=0).stop 2023-11-28T20:00:27.537 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:27.533+0000 7f824a72a640 1 -- 172.21.15.78:0/1010508221 shutdown_connections 2023-11-28T20:00:27.537 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:27.533+0000 7f824a72a640 1 --2- 172.21.15.78:0/1010508221 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f8230066470 0x7f8230068930 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:27.537 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:27.533+0000 7f824a72a640 1 --2- 172.21.15.78:0/1010508221 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8244151280 0x7f82441f0c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:27.537 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:27.533+0000 7f824a72a640 1 --2- 172.21.15.78:0/1010508221 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f824414b1e0 0x7f82440befc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:27.537 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:27.533+0000 7f824a72a640 1 --2- 172.21.15.78:0/1010508221 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f82440c5300 0x7f824406b930 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:27.537 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:27.533+0000 7f824a72a640 1 -- 172.21.15.78:0/1010508221 >> 172.21.15.78:0/1010508221 conn(0x7f82440c59f0 msgr2=0x7f82440c0340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:00:27.537 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:27.533+0000 7f824a72a640 1 -- 172.21.15.78:0/1010508221 shutdown_connections 2023-11-28T20:00:27.537 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:27.533+0000 7f824a72a640 1 -- 172.21.15.78:0/1010508221 wait complete. 2023-11-28T20:00:27.555 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-28T20:00:27.695 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:27.689+0000 7fb81ddf5640 1 Processor -- start 2023-11-28T20:00:27.695 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:27.689+0000 7fb81ddf5640 1 -- start start 2023-11-28T20:00:27.696 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:27.693+0000 7fb81ddf5640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb8180c5300 0x7fb8180a9c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:27.696 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:27.693+0000 7fb81ddf5640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb8180a4e20 con 0x7fb8181548c0 2023-11-28T20:00:27.697 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:27.693+0000 7fb81ddf5640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb8180a50e0 con 0x7fb81814b1e0 2023-11-28T20:00:27.697 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:27.693+0000 7fb81ddf5640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8180c0f00 con 0x7fb8180c5300 2023-11-28T20:00:27.697 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:27.693+0000 7fb817fff640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7fb8181548c0 0x7fb818154d50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:50176/0 (socket says 172.21.15.78:50176) 2023-11-28T20:00:27.697 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:27.693+0000 7fb817fff640 1 -- 172.21.15.78:0/1346653685 learned_addr learned my addr 172.21.15.78:0/1346653685 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-11-28T20:00:27.699 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:27.693+0000 7fb816ffd640 1 --2- 172.21.15.78:0/1346653685 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb8180c5300 0x7fb8180a9c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:27.699 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:27.693+0000 7fb8167fc640 1 -- 172.21.15.78:0/1346653685 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1015607656 0 0) 0x7fb8180a4e20 con 0x7fb8181548c0 2023-11-28T20:00:27.699 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:27.693+0000 7fb8167fc640 1 -- 172.21.15.78:0/1346653685 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb800003530 con 0x7fb8181548c0 2023-11-28T20:00:27.699 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:27.693+0000 7fb8167fc640 1 -- 172.21.15.78:0/1346653685 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1033175175 0 0) 0x7fb8180a50e0 con 0x7fb81814b1e0 2023-11-28T20:00:27.699 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:27.693+0000 7fb8167fc640 1 -- 172.21.15.78:0/1346653685 --> v1:172.21.15.179:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb8180a4e20 con 0x7fb81814b1e0 2023-11-28T20:00:27.699 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:27.693+0000 7fb8167fc640 1 -- 172.21.15.78:0/1346653685 <== mon.0 v1:172.21.15.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3701626142 0 0) 0x7fb800003530 con 0x7fb8181548c0 2023-11-28T20:00:27.699 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:27.693+0000 7fb8167fc640 1 -- 172.21.15.78:0/1346653685 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb8180c5300 msgr2=0x7fb8180a9c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:00:27.700 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:27.693+0000 7fb8167fc640 1 --2- 172.21.15.78:0/1346653685 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb8180c5300 0x7fb8180a9c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:27.700 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:27.693+0000 7fb8167fc640 1 -- 172.21.15.78:0/1346653685 >> v1:172.21.15.179:6789/0 conn(0x7fb81814b1e0 legacy=0x7fb8180c1700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:00:27.700 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:27.693+0000 7fb8167fc640 1 -- 172.21.15.78:0/1346653685 --> v1:172.21.15.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8180c11e0 con 0x7fb8181548c0 2023-11-28T20:00:27.700 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:27.693+0000 7fb8167fc640 1 -- 172.21.15.78:0/1346653685 <== mon.0 v1:172.21.15.78:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3326804700 0 0) 0x7fb810001a20 con 0x7fb8181548c0 2023-11-28T20:00:27.700 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:27.693+0000 7fb8167fc640 1 -- 172.21.15.78:0/1346653685 >> v1:172.21.15.78:6789/0 conn(0x7fb8181548c0 legacy=0x7fb818154d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:00:27.700 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:27.693+0000 7fb8167fc640 1 --2- 172.21.15.78:0/1346653685 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb800003b40 0x7fb800003f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:27.700 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:27.693+0000 7fb8167fc640 1 --2- 172.21.15.78:0/1346653685 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb8180c5300 0x7fb8000047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:27.700 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:27.693+0000 7fb8167fc640 1 --2- 172.21.15.78:0/1346653685 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb800004d10 0x7fb800005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:27.700 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:27.693+0000 7fb8167fc640 1 -- 172.21.15.78:0/1346653685 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8180c0f00 con 0x7fb800004d10 2023-11-28T20:00:27.701 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:27.693+0000 7fb8167fc640 1 -- 172.21.15.78:0/1346653685 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb80000ba40 con 0x7fb800003b40 2023-11-28T20:00:27.701 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:27.693+0000 7fb8167fc640 1 -- 172.21.15.78:0/1346653685 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb80000bc00 con 0x7fb8180c5300 2023-11-28T20:00:27.701 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:27.693+0000 7fb817fff640 1 --2- 172.21.15.78:0/1346653685 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb800004d10 0x7fb800005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:27.701 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:27.693+0000 7fb816ffd640 1 --2- 172.21.15.78:0/1346653685 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb8180c5300 0x7fb8000047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:27.701 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:27.693+0000 7fb8177fe640 1 --2- 172.21.15.78:0/1346653685 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb800003b40 0x7fb800003f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:27.701 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:27.693+0000 7fb817fff640 1 -- 172.21.15.78:0/1346653685 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb8180c5300 msgr2=0x7fb8000047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:00:27.701 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:27.693+0000 7fb817fff640 1 --2- 172.21.15.78:0/1346653685 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb8180c5300 0x7fb8000047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:27.701 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:27.693+0000 7fb817fff640 1 -- 172.21.15.78:0/1346653685 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb800003b40 msgr2=0x7fb800003f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:00:27.701 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:27.693+0000 7fb817fff640 1 --2- 172.21.15.78:0/1346653685 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb800003b40 0x7fb800003f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:27.701 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:27.693+0000 7fb817fff640 1 -- 172.21.15.78:0/1346653685 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb800003530 con 0x7fb800004d10 2023-11-28T20:00:27.701 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:27.693+0000 7fb8177fe640 1 --2- 172.21.15.78:0/1346653685 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb800003b40 0x7fb800003f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T20:00:27.701 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:27.693+0000 7fb816ffd640 1 --2- 172.21.15.78:0/1346653685 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb8180c5300 0x7fb8000047d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T20:00:27.703 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:27.697+0000 7fb817fff640 1 --2- 172.21.15.78:0/1346653685 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb800004d10 0x7fb800005190 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7fb8180c6a70 tx=0x7fb81001f920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=640c6531c35f43ad server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:00:27.703 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:27.697+0000 7fb8167fc640 1 -- 172.21.15.78:0/1346653685 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8100ad660 con 0x7fb800004d10 2023-11-28T20:00:27.703 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:27.697+0000 7fb8167fc640 1 -- 172.21.15.78:0/1346653685 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb8100ad7c0 con 0x7fb800004d10 2023-11-28T20:00:27.703 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:27.697+0000 7fb8167fc640 1 -- 172.21.15.78:0/1346653685 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8100adb30 con 0x7fb800004d10 2023-11-28T20:00:27.703 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:27.697+0000 7fb81ddf5640 1 -- 172.21.15.78:0/1346653685 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb800004d10 msgr2=0x7fb800005190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:00:27.703 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:27.697+0000 7fb81ddf5640 1 --2- 172.21.15.78:0/1346653685 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb800004d10 0x7fb800005190 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7fb8180c6a70 tx=0x7fb81001f920 comp rx=0 tx=0).stop 2023-11-28T20:00:27.703 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:27.697+0000 7fb817fff640 1 -- 172.21.15.78:0/1346653685 reap_dead start 2023-11-28T20:00:27.703 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:27.697+0000 7fb81ddf5640 1 -- 172.21.15.78:0/1346653685 shutdown_connections 2023-11-28T20:00:27.703 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:27.697+0000 7fb81ddf5640 1 -- 172.21.15.78:0/1346653685 >> 172.21.15.78:0/1346653685 conn(0x7fb8180c59f0 msgr2=0x7fb8180c5e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:00:27.703 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:27.697+0000 7fb81ddf5640 1 -- 172.21.15.78:0/1346653685 shutdown_connections 2023-11-28T20:00:27.703 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:27.697+0000 7fb81ddf5640 1 -- 172.21.15.78:0/1346653685 wait complete. 2023-11-28T20:00:27.704 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:27.701+0000 7fb81ddf5640 1 Processor -- start 2023-11-28T20:00:27.704 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:27.701+0000 7fb81ddf5640 1 -- start start 2023-11-28T20:00:27.705 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:27.701+0000 7fb81ddf5640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb800004d10 0x7fb8181e9f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:27.706 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:27.701+0000 7fb81ddf5640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb818070f30 0x7fb8180befc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:27.706 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:27.701+0000 7fb81ddf5640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb8180725e0 0x7fb8181ed100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:27.706 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:27.701+0000 7fb81ddf5640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb81806fb50 con 0x7fb818070f30 2023-11-28T20:00:27.706 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:27.701+0000 7fb81ddf5640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8181ecc70 con 0x7fb8180725e0 2023-11-28T20:00:27.706 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:27.701+0000 7fb81ddf5640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb81814a9b0 con 0x7fb800004d10 2023-11-28T20:00:27.706 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:27.701+0000 7fb816ffd640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb818070f30 0x7fb8180befc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:27.706 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:27.701+0000 7fb816ffd640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb818070f30 0x7fb8180befc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:45824/0 (socket says 172.21.15.78:45824) 2023-11-28T20:00:27.706 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:27.701+0000 7fb816ffd640 1 -- 172.21.15.78:0/3734701449 learned_addr learned my addr 172.21.15.78:0/3734701449 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T20:00:27.706 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:27.701+0000 7fb816ffd640 1 -- 172.21.15.78:0/3734701449 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb800004d10 msgr2=0x7fb8181e9f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:00:27.706 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:27.701+0000 7fb816ffd640 1 --2- 172.21.15.78:0/3734701449 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb800004d10 0x7fb8181e9f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:27.706 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:27.701+0000 7fb816ffd640 1 -- 172.21.15.78:0/3734701449 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb8180725e0 msgr2=0x7fb8181ed100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:00:27.707 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:27.701+0000 7fb816ffd640 1 --2- 172.21.15.78:0/3734701449 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb8180725e0 0x7fb8181ed100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:27.707 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:27.701+0000 7fb816ffd640 1 -- 172.21.15.78:0/3734701449 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb81806cbe0 con 0x7fb818070f30 2023-11-28T20:00:27.707 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:27.701+0000 7fb816ffd640 1 --2- 172.21.15.78:0/3734701449 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb818070f30 0x7fb8180befc0 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7fb80c011cd0 tx=0x7fb80c00f610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:00:27.707 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:27.701+0000 7fb7fffff640 1 -- 172.21.15.78:0/3734701449 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb80c00fca0 con 0x7fb818070f30 2023-11-28T20:00:27.708 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:27.701+0000 7fb7fffff640 1 -- 172.21.15.78:0/3734701449 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb80c00fe00 con 0x7fb818070f30 2023-11-28T20:00:27.708 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:27.701+0000 7fb7fffff640 1 -- 172.21.15.78:0/3734701449 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb80c004220 con 0x7fb818070f30 2023-11-28T20:00:27.708 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:27.701+0000 7fb81ddf5640 1 -- 172.21.15.78:0/3734701449 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb81806cec0 con 0x7fb818070f30 2023-11-28T20:00:27.708 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:27.701+0000 7fb81ddf5640 1 -- 172.21.15.78:0/3734701449 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb8180bf500 con 0x7fb818070f30 2023-11-28T20:00:27.708 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:27.701+0000 7fb81ddf5640 1 -- 172.21.15.78:0/3734701449 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb81806d3e0 con 0x7fb818070f30 2023-11-28T20:00:27.708 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:27.705+0000 7fb7fffff640 1 -- 172.21.15.78:0/3734701449 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fb80c004380 con 0x7fb818070f30 2023-11-28T20:00:27.709 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:27.705+0000 7fb7fffff640 1 --2- 172.21.15.78:0/3734701449 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fb804066470 0x7fb804068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:27.709 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:27.705+0000 7fb7fffff640 1 -- 172.21.15.78:0/3734701449 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6029+0+0 (secure 0 0 0) 0x7fb80c084770 con 0x7fb818070f30 2023-11-28T20:00:27.710 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:27.705+0000 7fb8177fe640 1 --2- 172.21.15.78:0/3734701449 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fb804066470 0x7fb804068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:27.710 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:27.705+0000 7fb8177fe640 1 --2- 172.21.15.78:0/3734701449 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fb804066470 0x7fb804068930 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fb808007fd0 tx=0x7fb808009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:00:27.713 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:27.709+0000 7fb7fffff640 1 -- 172.21.15.78:0/3734701449 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fb81806d3e0 con 0x7fb818070f30 2023-11-28T20:00:27.866 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:27.861+0000 7fb81ddf5640 1 -- 172.21.15.78:0/3734701449 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fb81806d3e0 con 0x7fb818070f30 2023-11-28T20:00:27.867 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:27.861+0000 7fb7fffff640 1 -- 172.21.15.78:0/3734701449 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v40) v1 ==== 100+0+11 (secure 0 0 0) 0x7fb81806d3e0 con 0x7fb818070f30 2023-11-28T20:00:27.867 INFO:teuthology.orchestra.run.smithi078.stdout:pg_num: 64 2023-11-28T20:00:27.869 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:27.865+0000 7fb81ddf5640 1 -- 172.21.15.78:0/3734701449 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fb804066470 msgr2=0x7fb804068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:00:27.869 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:27.865+0000 7fb81ddf5640 1 --2- 172.21.15.78:0/3734701449 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fb804066470 0x7fb804068930 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fb808007fd0 tx=0x7fb808009040 comp rx=0 tx=0).stop 2023-11-28T20:00:27.869 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:27.865+0000 7fb81ddf5640 1 -- 172.21.15.78:0/3734701449 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb818070f30 msgr2=0x7fb8180befc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:00:27.869 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:27.865+0000 7fb81ddf5640 1 --2- 172.21.15.78:0/3734701449 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb818070f30 0x7fb8180befc0 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7fb80c011cd0 tx=0x7fb80c00f610 comp rx=0 tx=0).stop 2023-11-28T20:00:27.869 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:27.865+0000 7fb81ddf5640 1 -- 172.21.15.78:0/3734701449 shutdown_connections 2023-11-28T20:00:27.870 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:27.865+0000 7fb81ddf5640 1 --2- 172.21.15.78:0/3734701449 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fb804066470 0x7fb804068930 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:27.870 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:27.865+0000 7fb81ddf5640 1 --2- 172.21.15.78:0/3734701449 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb8180725e0 0x7fb8181ed100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:27.870 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:27.865+0000 7fb81ddf5640 1 --2- 172.21.15.78:0/3734701449 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb818070f30 0x7fb8180befc0 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:27.870 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:27.865+0000 7fb81ddf5640 1 --2- 172.21.15.78:0/3734701449 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb800004d10 0x7fb8181e9f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:27.870 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:27.865+0000 7fb81ddf5640 1 -- 172.21.15.78:0/3734701449 >> 172.21.15.78:0/3734701449 conn(0x7fb8180c59f0 msgr2=0x7fb818148a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:00:27.870 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:27.865+0000 7fb81ddf5640 1 -- 172.21.15.78:0/3734701449 shutdown_connections 2023-11-28T20:00:27.870 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:27.865+0000 7fb81ddf5640 1 -- 172.21.15.78:0/3734701449 wait complete. 2023-11-28T20:00:27.888 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-11-28T20:00:28.026 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:28.021+0000 7f57290d6640 1 Processor -- start 2023-11-28T20:00:28.026 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:28.021+0000 7f57290d6640 1 -- start start 2023-11-28T20:00:28.028 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:28.021+0000 7f57290d6640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f572406d690 0x7f57240c5300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:28.028 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:28.021+0000 7f57290d6640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f572406db20 con 0x7f572406d2b0 2023-11-28T20:00:28.028 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:28.021+0000 7f57290d6640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f572406bb80 con 0x7f57240c3b80 2023-11-28T20:00:28.028 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:28.021+0000 7f57290d6640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f57240c5840 con 0x7f572406d690 2023-11-28T20:00:28.028 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:28.021+0000 7f5722d9d640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f572406d2b0 0x7f572406c020 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:50180/0 (socket says 172.21.15.78:50180) 2023-11-28T20:00:28.028 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:28.021+0000 7f5722d9d640 1 -- 172.21.15.78:0/108789787 learned_addr learned my addr 172.21.15.78:0/108789787 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-11-28T20:00:28.028 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:28.021+0000 7f572359e640 1 --2- 172.21.15.78:0/108789787 >> v2:172.21.15.78:3300/0 conn(0x7f572406d690 0x7f57240c5300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:28.028 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:28.025+0000 7f572259c640 1 -- 172.21.15.78:0/108789787 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1268211623 0 0) 0x7f5714001120 con 0x7f572406d2b0 2023-11-28T20:00:28.028 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:28.025+0000 7f572259c640 1 -- 172.21.15.78:0/108789787 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5710003530 con 0x7f572406d2b0 2023-11-28T20:00:28.029 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:28.025+0000 7f572359e640 1 -- 172.21.15.78:0/108789787 >> v1:172.21.15.179:6789/0 conn(0x7f57240c3b80 legacy=0x7f572406c730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:00:28.029 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:28.025+0000 7f572359e640 1 -- 172.21.15.78:0/108789787 >> v1:172.21.15.78:6789/0 conn(0x7f572406d2b0 legacy=0x7f572406c020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:00:28.029 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:28.025+0000 7f572359e640 1 -- 172.21.15.78:0/108789787 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57241515c0 con 0x7f572406d690 2023-11-28T20:00:28.030 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:28.025+0000 7f572359e640 1 --2- 172.21.15.78:0/108789787 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f572406d690 0x7f57240c5300 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f571c009d90 tx=0x7f571c01c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7cc8567f162e0799 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:00:28.031 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:28.025+0000 7f572259c640 1 -- 172.21.15.78:0/108789787 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f571c0a58f0 con 0x7f572406d690 2023-11-28T20:00:28.031 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:28.025+0000 7f572259c640 1 -- 172.21.15.78:0/108789787 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f571c0a5a50 con 0x7f572406d690 2023-11-28T20:00:28.031 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:28.025+0000 7f572259c640 1 -- 172.21.15.78:0/108789787 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f571c0a5de0 con 0x7f572406d690 2023-11-28T20:00:28.032 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:28.025+0000 7f57290d6640 1 -- 172.21.15.78:0/108789787 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f572406d690 msgr2=0x7f57240c5300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:00:28.032 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:28.025+0000 7f57290d6640 1 --2- 172.21.15.78:0/108789787 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f572406d690 0x7f57240c5300 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f571c009d90 tx=0x7f571c01c920 comp rx=0 tx=0).stop 2023-11-28T20:00:28.032 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:28.025+0000 7f57290d6640 1 -- 172.21.15.78:0/108789787 shutdown_connections 2023-11-28T20:00:28.032 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:28.025+0000 7f57290d6640 1 --2- 172.21.15.78:0/108789787 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f572406d690 0x7f57240c5300 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:28.032 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:28.025+0000 7f57290d6640 1 -- 172.21.15.78:0/108789787 >> 172.21.15.78:0/108789787 conn(0x7f57240a7810 msgr2=0x7f57240a7c20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:00:28.032 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:28.025+0000 7f57290d6640 1 -- 172.21.15.78:0/108789787 shutdown_connections 2023-11-28T20:00:28.032 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:28.025+0000 7f57290d6640 1 -- 172.21.15.78:0/108789787 wait complete. 2023-11-28T20:00:28.033 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:28.029+0000 7f57290d6640 1 Processor -- start 2023-11-28T20:00:28.033 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:28.029+0000 7f57290d6640 1 -- start start 2023-11-28T20:00:28.035 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:28.029+0000 7f57290d6640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f572406d2b0 0x7f57241502f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:28.035 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:28.029+0000 7f57290d6640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f572406d690 0x7f57241437c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:28.035 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:28.029+0000 7f57290d6640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f57240c3b80 0x7f5724160010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:28.035 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:28.029+0000 7f57290d6640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5724145e70 con 0x7f57240c3b80 2023-11-28T20:00:28.035 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:28.029+0000 7f57290d6640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57240a9120 con 0x7f572406d690 2023-11-28T20:00:28.035 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:28.029+0000 7f57290d6640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f57240c53c0 con 0x7f572406d2b0 2023-11-28T20:00:28.035 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:28.029+0000 7f572359e640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f57240c3b80 0x7f5724160010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:28.035 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:28.029+0000 7f5722d9d640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f572406d2b0 0x7f57241502f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:28.035 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:28.029+0000 7f572359e640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f57240c3b80 0x7f5724160010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:45842/0 (socket says 172.21.15.78:45842) 2023-11-28T20:00:28.036 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:28.029+0000 7f572359e640 1 -- 172.21.15.78:0/2323673727 learned_addr learned my addr 172.21.15.78:0/2323673727 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T20:00:28.036 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:28.029+0000 7f571a59c640 1 --2- 172.21.15.78:0/2323673727 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f572406d690 0x7f57241437c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:28.036 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:28.029+0000 7f572359e640 1 -- 172.21.15.78:0/2323673727 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f572406d2b0 msgr2=0x7f57241502f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:00:28.036 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:28.029+0000 7f572359e640 1 --2- 172.21.15.78:0/2323673727 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f572406d2b0 0x7f57241502f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:28.037 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:28.029+0000 7f572359e640 1 -- 172.21.15.78:0/2323673727 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f572406d690 msgr2=0x7f57241437c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:00:28.037 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:28.029+0000 7f572359e640 1 --2- 172.21.15.78:0/2323673727 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f572406d690 0x7f57241437c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:28.037 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:28.029+0000 7f572359e640 1 -- 172.21.15.78:0/2323673727 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f571c009a70 con 0x7f57240c3b80 2023-11-28T20:00:28.037 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:28.033+0000 7f572359e640 1 --2- 172.21.15.78:0/2323673727 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f57240c3b80 0x7f5724160010 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f571c009d90 tx=0x7f571c0196c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:00:28.038 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:28.033+0000 7f571bfff640 1 -- 172.21.15.78:0/2323673727 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f571c0b9860 con 0x7f57240c3b80 2023-11-28T20:00:28.038 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:28.033+0000 7f571bfff640 1 -- 172.21.15.78:0/2323673727 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f571c0b99c0 con 0x7f57240c3b80 2023-11-28T20:00:28.038 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:28.033+0000 7f571bfff640 1 -- 172.21.15.78:0/2323673727 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f571c0b9d70 con 0x7f57240c3b80 2023-11-28T20:00:28.038 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:28.033+0000 7f57290d6640 1 -- 172.21.15.78:0/2323673727 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f572414ef80 con 0x7f57240c3b80 2023-11-28T20:00:28.038 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:28.033+0000 7f57290d6640 1 -- 172.21.15.78:0/2323673727 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5724145b20 con 0x7f57240c3b80 2023-11-28T20:00:28.038 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:28.033+0000 7f57290d6640 1 -- 172.21.15.78:0/2323673727 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5724152120 con 0x7f57240c3b80 2023-11-28T20:00:28.039 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:28.033+0000 7f571bfff640 1 -- 172.21.15.78:0/2323673727 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f571c0ad440 con 0x7f57240c3b80 2023-11-28T20:00:28.040 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:28.037+0000 7f571bfff640 1 --2- 172.21.15.78:0/2323673727 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f5704066470 0x7f5704068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:28.040 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:28.037+0000 7f571bfff640 1 -- 172.21.15.78:0/2323673727 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f571c11f1f0 con 0x7f57240c3b80 2023-11-28T20:00:28.040 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:28.037+0000 7f5722d9d640 1 --2- 172.21.15.78:0/2323673727 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f5704066470 0x7f5704068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:28.040 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:28.037+0000 7f5722d9d640 1 --2- 172.21.15.78:0/2323673727 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f5704066470 0x7f5704068930 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f5714001280 tx=0x7f5714009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:00:28.043 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:28.037+0000 7f571bfff640 1 -- 172.21.15.78:0/2323673727 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f5724152120 con 0x7f57240c3b80 2023-11-28T20:00:28.196 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:28.189+0000 7f57290d6640 1 -- 172.21.15.78:0/2323673727 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f5724145fb0 con 0x7f57240c3b80 2023-11-28T20:00:28.196 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:28.193+0000 7f571bfff640 1 -- 172.21.15.78:0/2323673727 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v40) v1 ==== 84+0+207 (secure 0 0 0) 0x7f5724145fb0 con 0x7f57240c3b80 2023-11-28T20:00:28.196 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-11-28T20:00:28.197 INFO:teuthology.orchestra.run.smithi078.stdout:[ 2023-11-28T20:00:28.197 INFO:teuthology.orchestra.run.smithi078.stdout: { 2023-11-28T20:00:28.197 INFO:teuthology.orchestra.run.smithi078.stdout: "poolnum": 1, 2023-11-28T20:00:28.197 INFO:teuthology.orchestra.run.smithi078.stdout: "poolname": ".mgr" 2023-11-28T20:00:28.197 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2023-11-28T20:00:28.197 INFO:teuthology.orchestra.run.smithi078.stdout: { 2023-11-28T20:00:28.197 INFO:teuthology.orchestra.run.smithi078.stdout: "poolnum": 5, 2023-11-28T20:00:28.197 INFO:teuthology.orchestra.run.smithi078.stdout: "poolname": "cephfs_metadata" 2023-11-28T20:00:28.197 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2023-11-28T20:00:28.197 INFO:teuthology.orchestra.run.smithi078.stdout: { 2023-11-28T20:00:28.197 INFO:teuthology.orchestra.run.smithi078.stdout: "poolnum": 6, 2023-11-28T20:00:28.198 INFO:teuthology.orchestra.run.smithi078.stdout: "poolname": "cephfs_data" 2023-11-28T20:00:28.198 INFO:teuthology.orchestra.run.smithi078.stdout: } 2023-11-28T20:00:28.198 INFO:teuthology.orchestra.run.smithi078.stdout:] 2023-11-28T20:00:28.199 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:28.193+0000 7f57290d6640 1 -- 172.21.15.78:0/2323673727 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f5704066470 msgr2=0x7f5704068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:00:28.199 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:28.193+0000 7f57290d6640 1 --2- 172.21.15.78:0/2323673727 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f5704066470 0x7f5704068930 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f5714001280 tx=0x7f5714009040 comp rx=0 tx=0).stop 2023-11-28T20:00:28.199 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:28.193+0000 7f57290d6640 1 -- 172.21.15.78:0/2323673727 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f57240c3b80 msgr2=0x7f5724160010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:00:28.199 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:28.193+0000 7f57290d6640 1 --2- 172.21.15.78:0/2323673727 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f57240c3b80 0x7f5724160010 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f571c009d90 tx=0x7f571c0196c0 comp rx=0 tx=0).stop 2023-11-28T20:00:28.199 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:28.193+0000 7f57290d6640 1 -- 172.21.15.78:0/2323673727 shutdown_connections 2023-11-28T20:00:28.199 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:28.193+0000 7f57290d6640 1 --2- 172.21.15.78:0/2323673727 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f5704066470 0x7f5704068930 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:28.199 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:28.193+0000 7f57290d6640 1 --2- 172.21.15.78:0/2323673727 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f57240c3b80 0x7f5724160010 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:28.199 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:28.193+0000 7f57290d6640 1 --2- 172.21.15.78:0/2323673727 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f572406d690 0x7f57241437c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:28.199 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:28.193+0000 7f57290d6640 1 --2- 172.21.15.78:0/2323673727 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f572406d2b0 0x7f57241502f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:28.199 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:28.193+0000 7f57290d6640 1 -- 172.21.15.78:0/2323673727 >> 172.21.15.78:0/2323673727 conn(0x7f57240a7810 msgr2=0x7f57240c2330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:00:28.200 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:28.193+0000 7f57290d6640 1 -- 172.21.15.78:0/2323673727 shutdown_connections 2023-11-28T20:00:28.200 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:28.193+0000 7f57290d6640 1 -- 172.21.15.78:0/2323673727 wait complete. 2023-11-28T20:00:28.217 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs2' 2023-11-28T20:00:28.217 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs2_metadata --pg_num_min 64 2023-11-28T20:00:28.359 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:28.353+0000 7fbcec58d640 1 Processor -- start 2023-11-28T20:00:28.359 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:28.353+0000 7fbcec58d640 1 -- start start 2023-11-28T20:00:28.360 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:28.357+0000 7fbcec58d640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fbce414f850 0x7fbce40aacf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:28.360 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:28.357+0000 7fbcec58d640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbce406d840 0x7fbce40c43e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:28.360 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:28.357+0000 7fbcec58d640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbce4152910 con 0x7fbce414fc30 2023-11-28T20:00:28.360 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:28.357+0000 7fbcec58d640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbce40c2240 con 0x7fbce414f850 2023-11-28T20:00:28.360 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:28.357+0000 7fbcec58d640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbce4152bf0 con 0x7fbce406d840 2023-11-28T20:00:28.360 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:28.357+0000 7fbce9b28640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7fbce414fc30 0x7fbce40c3cd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:50184/0 (socket says 172.21.15.78:50184) 2023-11-28T20:00:28.360 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:28.357+0000 7fbce9b28640 1 -- 172.21.15.78:0/2042653718 learned_addr learned my addr 172.21.15.78:0/2042653718 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-11-28T20:00:28.362 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:28.357+0000 7fbce9327640 1 -- 172.21.15.78:0/2042653718 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3046708992 0 0) 0x7fbce4152910 con 0x7fbce414fc30 2023-11-28T20:00:28.362 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:28.357+0000 7fbceab2a640 1 --2- 172.21.15.78:0/2042653718 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbce406d840 0x7fbce40c43e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:28.363 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:28.357+0000 7fbcea329640 1 --2- 172.21.15.78:0/2042653718 >> v2:172.21.15.179:3300/0 conn(0x7fbce414f850 0x7fbce40aacf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:28.363 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:28.357+0000 7fbce9327640 1 -- 172.21.15.78:0/2042653718 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbcd0003530 con 0x7fbce414fc30 2023-11-28T20:00:28.363 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:28.357+0000 7fbce9327640 1 -- 172.21.15.78:0/2042653718 <== mon.0 v1:172.21.15.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3737335622 0 0) 0x7fbcd0003530 con 0x7fbce414fc30 2023-11-28T20:00:28.363 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:28.357+0000 7fbce9327640 1 -- 172.21.15.78:0/2042653718 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbce406d840 msgr2=0x7fbce40c43e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:00:28.363 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:28.357+0000 7fbce9327640 1 --2- 172.21.15.78:0/2042653718 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbce406d840 0x7fbce40c43e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:28.363 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:28.357+0000 7fbce9327640 1 -- 172.21.15.78:0/2042653718 >> v2:172.21.15.179:3300/0 conn(0x7fbce414f850 msgr2=0x7fbce40aacf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:00:28.363 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:28.357+0000 7fbce9327640 1 --2- 172.21.15.78:0/2042653718 >> v2:172.21.15.179:3300/0 conn(0x7fbce414f850 0x7fbce40aacf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:28.363 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:28.357+0000 7fbce9327640 1 -- 172.21.15.78:0/2042653718 --> v1:172.21.15.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbce4152ed0 con 0x7fbce414fc30 2023-11-28T20:00:28.363 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:28.357+0000 7fbce9327640 1 -- 172.21.15.78:0/2042653718 <== mon.0 v1:172.21.15.78:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3326804700 0 0) 0x7fbcd40016a0 con 0x7fbce414fc30 2023-11-28T20:00:28.363 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:28.357+0000 7fbce9327640 1 -- 172.21.15.78:0/2042653718 >> v1:172.21.15.78:6789/0 conn(0x7fbce414fc30 legacy=0x7fbce40c3cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:00:28.363 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:28.357+0000 7fbce9327640 1 --2- 172.21.15.78:0/2042653718 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbce406d840 0x7fbcd0003980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:28.363 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:28.357+0000 7fbce9327640 1 --2- 172.21.15.78:0/2042653718 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbcd0003f00 0x7fbcd00047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:28.364 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:28.357+0000 7fbce9327640 1 --2- 172.21.15.78:0/2042653718 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbcd0004d10 0x7fbcd0005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:28.364 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:28.357+0000 7fbce9327640 1 -- 172.21.15.78:0/2042653718 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbce40c2240 con 0x7fbcd0004d10 2023-11-28T20:00:28.364 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:28.357+0000 7fbce9327640 1 -- 172.21.15.78:0/2042653718 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbce4152bf0 con 0x7fbcd0003f00 2023-11-28T20:00:28.364 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:28.357+0000 7fbce9327640 1 -- 172.21.15.78:0/2042653718 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbcd000b990 con 0x7fbce406d840 2023-11-28T20:00:28.364 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:28.357+0000 7fbceab2a640 1 --2- 172.21.15.78:0/2042653718 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbcd0004d10 0x7fbcd0005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:28.364 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:28.357+0000 7fbcea329640 1 --2- 172.21.15.78:0/2042653718 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbce406d840 0x7fbcd0003980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:28.364 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:28.357+0000 7fbce9b28640 1 --2- 172.21.15.78:0/2042653718 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbcd0003f00 0x7fbcd00047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:28.364 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:28.357+0000 7fbceab2a640 1 -- 172.21.15.78:0/2042653718 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbce406d840 msgr2=0x7fbcd0003980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:00:28.364 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:28.357+0000 7fbceab2a640 1 --2- 172.21.15.78:0/2042653718 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbce406d840 0x7fbcd0003980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:28.364 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:28.357+0000 7fbceab2a640 1 -- 172.21.15.78:0/2042653718 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbcd0003f00 msgr2=0x7fbcd00047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:00:28.364 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:28.357+0000 7fbceab2a640 1 --2- 172.21.15.78:0/2042653718 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbcd0003f00 0x7fbcd00047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:28.365 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:28.357+0000 7fbceab2a640 1 -- 172.21.15.78:0/2042653718 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbcd0003530 con 0x7fbcd0004d10 2023-11-28T20:00:28.366 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:28.361+0000 7fbceab2a640 1 --2- 172.21.15.78:0/2042653718 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbcd0004d10 0x7fbcd0005190 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7fbcdc009fc0 tx=0x7fbcdc01cc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4ebee9fd74edb326 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:00:28.366 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:28.361+0000 7fbce9327640 1 -- 172.21.15.78:0/2042653718 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbcdc0a5c70 con 0x7fbcd0004d10 2023-11-28T20:00:28.366 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:28.361+0000 7fbce9327640 1 -- 172.21.15.78:0/2042653718 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbcdc00f040 con 0x7fbcd0004d10 2023-11-28T20:00:28.366 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:28.361+0000 7fbce9327640 1 -- 172.21.15.78:0/2042653718 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbcdc0ad440 con 0x7fbcd0004d10 2023-11-28T20:00:28.366 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:28.361+0000 7fbcec58d640 1 -- 172.21.15.78:0/2042653718 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbcd0004d10 msgr2=0x7fbcd0005190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:00:28.366 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:28.361+0000 7fbcec58d640 1 --2- 172.21.15.78:0/2042653718 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbcd0004d10 0x7fbcd0005190 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7fbcdc009fc0 tx=0x7fbcdc01cc00 comp rx=0 tx=0).stop 2023-11-28T20:00:28.366 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:28.361+0000 7fbceab2a640 1 -- 172.21.15.78:0/2042653718 reap_dead start 2023-11-28T20:00:28.366 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:28.361+0000 7fbcec58d640 1 -- 172.21.15.78:0/2042653718 shutdown_connections 2023-11-28T20:00:28.366 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:28.361+0000 7fbcec58d640 1 -- 172.21.15.78:0/2042653718 >> 172.21.15.78:0/2042653718 conn(0x7fbce40c59f0 msgr2=0x7fbce40c5e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:00:28.366 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:28.361+0000 7fbcec58d640 1 -- 172.21.15.78:0/2042653718 shutdown_connections 2023-11-28T20:00:28.367 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:28.361+0000 7fbcec58d640 1 -- 172.21.15.78:0/2042653718 wait complete. 2023-11-28T20:00:28.367 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:28.361+0000 7fbcec58d640 1 Processor -- start 2023-11-28T20:00:28.367 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:28.361+0000 7fbcec58d640 1 -- start start 2023-11-28T20:00:28.370 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:28.365+0000 7fbcec58d640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbcd0004d10 0x7fbce4151b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:28.370 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:28.365+0000 7fbcec58d640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbce4156050 0x7fbce4149f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:28.370 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:28.365+0000 7fbcec58d640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbce4072680 0x7fbce414a4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:28.370 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:28.365+0000 7fbcec58d640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbce4071930 con 0x7fbce4072680 2023-11-28T20:00:28.370 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:28.365+0000 7fbcec58d640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbce41ebd20 con 0x7fbce4156050 2023-11-28T20:00:28.370 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:28.365+0000 7fbcec58d640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbce4071b50 con 0x7fbcd0004d10 2023-11-28T20:00:28.370 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:28.365+0000 7fbceab2a640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbce4072680 0x7fbce414a4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:28.370 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:28.365+0000 7fbceab2a640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbce4072680 0x7fbce414a4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:45862/0 (socket says 172.21.15.78:45862) 2023-11-28T20:00:28.370 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:28.365+0000 7fbceab2a640 1 -- 172.21.15.78:0/356953278 learned_addr learned my addr 172.21.15.78:0/356953278 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T20:00:28.371 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:28.365+0000 7fbcea329640 1 --2- 172.21.15.78:0/356953278 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbcd0004d10 0x7fbce4151b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:28.371 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:28.365+0000 7fbce9b28640 1 --2- 172.21.15.78:0/356953278 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbce4156050 0x7fbce4149f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:28.371 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:28.365+0000 7fbceab2a640 1 -- 172.21.15.78:0/356953278 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbcd0004d10 msgr2=0x7fbce4151b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:00:28.371 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:28.365+0000 7fbceab2a640 1 --2- 172.21.15.78:0/356953278 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbcd0004d10 0x7fbce4151b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:28.371 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:28.365+0000 7fbceab2a640 1 -- 172.21.15.78:0/356953278 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbce4156050 msgr2=0x7fbce4149f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:00:28.371 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:28.365+0000 7fbceab2a640 1 --2- 172.21.15.78:0/356953278 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbce4156050 0x7fbce4149f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:28.371 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:28.365+0000 7fbceab2a640 1 -- 172.21.15.78:0/356953278 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbce41eb760 con 0x7fbce4072680 2023-11-28T20:00:28.371 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:28.365+0000 7fbceab2a640 1 --2- 172.21.15.78:0/356953278 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbce4072680 0x7fbce414a4b0 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7fbcdc002240 tx=0x7fbcdc009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:00:28.371 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:28.365+0000 7fbcdaffd640 1 -- 172.21.15.78:0/356953278 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbcdc0039a0 con 0x7fbce4072680 2023-11-28T20:00:28.371 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:28.365+0000 7fbcdaffd640 1 -- 172.21.15.78:0/356953278 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbcdc003b00 con 0x7fbce4072680 2023-11-28T20:00:28.371 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:28.365+0000 7fbcec58d640 1 -- 172.21.15.78:0/356953278 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbce41eba40 con 0x7fbce4072680 2023-11-28T20:00:28.371 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:28.365+0000 7fbcdaffd640 1 -- 172.21.15.78:0/356953278 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbcdc003e90 con 0x7fbce4072680 2023-11-28T20:00:28.372 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:28.365+0000 7fbcec58d640 1 -- 172.21.15.78:0/356953278 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbce41538b0 con 0x7fbce4072680 2023-11-28T20:00:28.372 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:28.365+0000 7fbcec58d640 1 -- 172.21.15.78:0/356953278 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbce4153ad0 con 0x7fbce4072680 2023-11-28T20:00:28.372 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:28.365+0000 7fbcdaffd640 1 -- 172.21.15.78:0/356953278 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fbcdc0b4040 con 0x7fbce4072680 2023-11-28T20:00:28.373 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:28.369+0000 7fbcdaffd640 1 --2- 172.21.15.78:0/356953278 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fbcc80664a0 0x7fbcc8068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:28.373 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:28.369+0000 7fbcdaffd640 1 -- 172.21.15.78:0/356953278 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6029+0+0 (secure 0 0 0) 0x7fbcdc11df60 con 0x7fbce4072680 2023-11-28T20:00:28.373 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:28.369+0000 7fbcea329640 1 --2- 172.21.15.78:0/356953278 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fbcc80664a0 0x7fbcc8068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:28.373 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:28.369+0000 7fbcea329640 1 --2- 172.21.15.78:0/356953278 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fbcc80664a0 0x7fbcc8068960 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fbce0009c60 tx=0x7fbce0009190 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:00:28.376 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:28.373+0000 7fbcdaffd640 1 -- 172.21.15.78:0/356953278 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fbcdc0eb340 con 0x7fbce4072680 2023-11-28T20:00:28.528 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:28.525+0000 7fbcec58d640 1 -- 172.21.15.78:0/356953278 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs2_metadata", "pg_num_min": 64} v 0) v1 -- 0x7fbce4067630 con 0x7fbce4072680 2023-11-28T20:00:29.048 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:29.041+0000 7fbcdaffd640 1 -- 172.21.15.78:0/356953278 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs2_metadata", "pg_num_min": 64}]=0 pool 'cephfs2_metadata' created v41) v1 ==== 140+0+0 (secure 0 0 0) 0x7fbcdc0b20b0 con 0x7fbce4072680 2023-11-28T20:00:29.048 INFO:teuthology.orchestra.run.smithi078.stderr:pool 'cephfs2_metadata' created 2023-11-28T20:00:29.050 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:29.045+0000 7fbcec58d640 1 -- 172.21.15.78:0/356953278 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fbcc80664a0 msgr2=0x7fbcc8068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:00:29.050 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:29.045+0000 7fbcec58d640 1 --2- 172.21.15.78:0/356953278 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fbcc80664a0 0x7fbcc8068960 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fbce0009c60 tx=0x7fbce0009190 comp rx=0 tx=0).stop 2023-11-28T20:00:29.050 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:29.045+0000 7fbcec58d640 1 -- 172.21.15.78:0/356953278 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbce4072680 msgr2=0x7fbce414a4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:00:29.050 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:29.045+0000 7fbcec58d640 1 --2- 172.21.15.78:0/356953278 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbce4072680 0x7fbce414a4b0 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7fbcdc002240 tx=0x7fbcdc009750 comp rx=0 tx=0).stop 2023-11-28T20:00:29.051 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:29.045+0000 7fbcec58d640 1 -- 172.21.15.78:0/356953278 shutdown_connections 2023-11-28T20:00:29.051 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:29.045+0000 7fbcec58d640 1 --2- 172.21.15.78:0/356953278 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fbcc80664a0 0x7fbcc8068960 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:29.051 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:29.045+0000 7fbcec58d640 1 --2- 172.21.15.78:0/356953278 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbce4072680 0x7fbce414a4b0 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:29.051 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:29.045+0000 7fbcec58d640 1 --2- 172.21.15.78:0/356953278 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbce4156050 0x7fbce4149f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:29.052 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:29.045+0000 7fbcec58d640 1 --2- 172.21.15.78:0/356953278 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbcd0004d10 0x7fbce4151b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:29.052 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:29.045+0000 7fbcec58d640 1 -- 172.21.15.78:0/356953278 >> 172.21.15.78:0/356953278 conn(0x7fbce40c59f0 msgr2=0x7fbce4150ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:00:29.052 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:29.045+0000 7fbcec58d640 1 -- 172.21.15.78:0/356953278 shutdown_connections 2023-11-28T20:00:29.052 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:29.045+0000 7fbcec58d640 1 -- 172.21.15.78:0/356953278 wait complete. 2023-11-28T20:00:29.080 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs2_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-11-28T20:00:29.224 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:29.221+0000 7f711be9e640 1 Processor -- start 2023-11-28T20:00:29.224 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:29.221+0000 7f711be9e640 1 -- start start 2023-11-28T20:00:29.225 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:29.221+0000 7f711be9e640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f71140c5300 0x7f71140a9c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:29.225 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:29.221+0000 7f711be9e640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f71140a4e20 con 0x7f71141548c0 2023-11-28T20:00:29.225 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:29.221+0000 7f711be9e640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f71140a50e0 con 0x7f711414b1e0 2023-11-28T20:00:29.225 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:29.221+0000 7f711be9e640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f71140c0f00 con 0x7f71140c5300 2023-11-28T20:00:29.225 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:29.221+0000 7f711a43b640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f71141548c0 0x7f7114154d30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:50194/0 (socket says 172.21.15.78:50194) 2023-11-28T20:00:29.226 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:29.221+0000 7f711a43b640 1 -- 172.21.15.78:0/3376295547 learned_addr learned my addr 172.21.15.78:0/3376295547 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-11-28T20:00:29.228 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:29.221+0000 7f7119439640 1 --2- 172.21.15.78:0/3376295547 >> v2:172.21.15.179:3300/0 conn(0x7f71140c5300 0x7f71140a9c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:29.228 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:29.221+0000 7f7118c38640 1 -- 172.21.15.78:0/3376295547 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 530793595 0 0) 0x7f71140a4e20 con 0x7f71141548c0 2023-11-28T20:00:29.228 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:29.221+0000 7f7118c38640 1 -- 172.21.15.78:0/3376295547 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7100003530 con 0x7f71141548c0 2023-11-28T20:00:29.228 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:29.221+0000 7f7118c38640 1 -- 172.21.15.78:0/3376295547 <== mon.0 v1:172.21.15.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 778403319 0 0) 0x7f7100003530 con 0x7f71141548c0 2023-11-28T20:00:29.229 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:29.221+0000 7f7118c38640 1 -- 172.21.15.78:0/3376295547 >> v2:172.21.15.179:3300/0 conn(0x7f71140c5300 msgr2=0x7f71140a9c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:00:29.229 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:29.221+0000 7f7118c38640 1 --2- 172.21.15.78:0/3376295547 >> v2:172.21.15.179:3300/0 conn(0x7f71140c5300 0x7f71140a9c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:29.229 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:29.221+0000 7f7118c38640 1 -- 172.21.15.78:0/3376295547 >> v1:172.21.15.179:6789/0 conn(0x7f711414b1e0 legacy=0x7f71140c1700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:00:29.229 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:29.221+0000 7f7118c38640 1 -- 172.21.15.78:0/3376295547 --> v1:172.21.15.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71140c11e0 con 0x7f71141548c0 2023-11-28T20:00:29.229 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:29.221+0000 7f7118c38640 1 -- 172.21.15.78:0/3376295547 <== mon.0 v1:172.21.15.78:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3326804700 0 0) 0x7f710c001a00 con 0x7f71141548c0 2023-11-28T20:00:29.229 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:29.221+0000 7f7118c38640 1 -- 172.21.15.78:0/3376295547 >> v1:172.21.15.78:6789/0 conn(0x7f71141548c0 legacy=0x7f7114154d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:00:29.229 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:29.221+0000 7f7118c38640 1 --2- 172.21.15.78:0/3376295547 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7100003980 0x7f7100003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:29.229 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:29.221+0000 7f7118c38640 1 --2- 172.21.15.78:0/3376295547 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f71000047d0 0x7f7100004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:29.229 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:29.221+0000 7f7118c38640 1 --2- 172.21.15.78:0/3376295547 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7100005190 0x7f710000dba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:29.229 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:29.221+0000 7f7118c38640 1 -- 172.21.15.78:0/3376295547 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71140c0f00 con 0x7f7100003980 2023-11-28T20:00:29.229 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:29.221+0000 7f7118c38640 1 -- 172.21.15.78:0/3376295547 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f710000e240 con 0x7f71000047d0 2023-11-28T20:00:29.230 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:29.221+0000 7f7118c38640 1 -- 172.21.15.78:0/3376295547 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f710000e400 con 0x7f7100005190 2023-11-28T20:00:29.230 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:29.221+0000 7f7119c3a640 1 --2- 172.21.15.78:0/3376295547 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7100003980 0x7f7100003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:29.230 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:29.221+0000 7f7119439640 1 --2- 172.21.15.78:0/3376295547 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f71000047d0 0x7f7100004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:29.230 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:29.221+0000 7f711a43b640 1 --2- 172.21.15.78:0/3376295547 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7100005190 0x7f710000dba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:29.230 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:29.221+0000 7f7119c3a640 1 -- 172.21.15.78:0/3376295547 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7100005190 msgr2=0x7f710000dba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:00:29.230 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:29.221+0000 7f7119c3a640 1 --2- 172.21.15.78:0/3376295547 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7100005190 0x7f710000dba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:29.230 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:29.221+0000 7f7119c3a640 1 -- 172.21.15.78:0/3376295547 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f71000047d0 msgr2=0x7f7100004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:00:29.230 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:29.221+0000 7f7119c3a640 1 --2- 172.21.15.78:0/3376295547 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f71000047d0 0x7f7100004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:29.231 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:29.221+0000 7f7119c3a640 1 -- 172.21.15.78:0/3376295547 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7100003530 con 0x7f7100003980 2023-11-28T20:00:29.231 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:29.221+0000 7f711a43b640 1 -- 172.21.15.78:0/3376295547 reap_dead start 2023-11-28T20:00:29.233 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:29.225+0000 7f7119c3a640 1 --2- 172.21.15.78:0/3376295547 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7100003980 0x7f7100003da0 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f7110001780 tx=0x7f711001c3e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a3eb8af96a364c4e server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:00:29.233 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:29.225+0000 7f7118c38640 1 -- 172.21.15.78:0/3376295547 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71100052d0 con 0x7f7100003980 2023-11-28T20:00:29.233 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:29.225+0000 7f7118c38640 1 -- 172.21.15.78:0/3376295547 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f71100a7050 con 0x7f7100003980 2023-11-28T20:00:29.233 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:29.225+0000 7f7118c38640 1 -- 172.21.15.78:0/3376295547 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7110003600 con 0x7f7100003980 2023-11-28T20:00:29.233 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:29.225+0000 7f711be9e640 1 -- 172.21.15.78:0/3376295547 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7100003980 msgr2=0x7f7100003da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:00:29.233 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:29.225+0000 7f711be9e640 1 --2- 172.21.15.78:0/3376295547 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7100003980 0x7f7100003da0 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f7110001780 tx=0x7f711001c3e0 comp rx=0 tx=0).stop 2023-11-28T20:00:29.233 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:29.225+0000 7f711be9e640 1 -- 172.21.15.78:0/3376295547 shutdown_connections 2023-11-28T20:00:29.233 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:29.225+0000 7f711be9e640 1 --2- 172.21.15.78:0/3376295547 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7100003980 0x7f7100003da0 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:29.233 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:29.225+0000 7f711be9e640 1 -- 172.21.15.78:0/3376295547 >> 172.21.15.78:0/3376295547 conn(0x7f71140c59f0 msgr2=0x7f71140c5e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:00:29.233 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:29.225+0000 7f711be9e640 1 -- 172.21.15.78:0/3376295547 shutdown_connections 2023-11-28T20:00:29.233 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:29.225+0000 7f711be9e640 1 -- 172.21.15.78:0/3376295547 wait complete. 2023-11-28T20:00:29.234 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:29.229+0000 7f711be9e640 1 Processor -- start 2023-11-28T20:00:29.234 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:29.229+0000 7f711be9e640 1 -- start start 2023-11-28T20:00:29.236 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:29.229+0000 7f711be9e640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7100003980 0x7f7114148a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:29.236 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:29.229+0000 7f711be9e640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f71140a7130 0x7f7114142d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:29.236 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:29.229+0000 7f711be9e640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f711406b970 0x7f71141419a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:29.236 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:29.229+0000 7f711be9e640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f711414a5b0 con 0x7f7100003980 2023-11-28T20:00:29.237 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:29.229+0000 7f711be9e640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71141492f0 con 0x7f711406b970 2023-11-28T20:00:29.237 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:29.229+0000 7f711be9e640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71141ed300 con 0x7f71140a7130 2023-11-28T20:00:29.237 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:29.229+0000 7f7119c3a640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7100003980 0x7f7114148a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:29.237 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:29.229+0000 7f7119c3a640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7100003980 0x7f7114148a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:45888/0 (socket says 172.21.15.78:45888) 2023-11-28T20:00:29.237 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:29.229+0000 7f7119c3a640 1 -- 172.21.15.78:0/751136064 learned_addr learned my addr 172.21.15.78:0/751136064 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T20:00:29.237 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:29.229+0000 7f7119439640 1 --2- 172.21.15.78:0/751136064 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f71140a7130 0x7f7114142d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:29.238 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:29.229+0000 7f711a43b640 1 --2- 172.21.15.78:0/751136064 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f711406b970 0x7f71141419a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:29.238 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:29.229+0000 7f7119c3a640 1 -- 172.21.15.78:0/751136064 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f71140a7130 msgr2=0x7f7114142d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:00:29.238 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:29.229+0000 7f7119c3a640 1 --2- 172.21.15.78:0/751136064 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f71140a7130 0x7f7114142d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:29.238 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:29.229+0000 7f7119c3a640 1 -- 172.21.15.78:0/751136064 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f711406b970 msgr2=0x7f71141419a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:00:29.238 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:29.229+0000 7f7119c3a640 1 --2- 172.21.15.78:0/751136064 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f711406b970 0x7f71141419a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:29.238 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:29.229+0000 7f7119c3a640 1 -- 172.21.15.78:0/751136064 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71140c1d20 con 0x7f7100003980 2023-11-28T20:00:29.239 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:29.229+0000 7f7119439640 1 --2- 172.21.15.78:0/751136064 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f71140a7130 0x7f7114142d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T20:00:29.239 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:29.229+0000 7f711a43b640 1 --2- 172.21.15.78:0/751136064 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f711406b970 0x7f71141419a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T20:00:29.239 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:29.229+0000 7f7119c3a640 1 --2- 172.21.15.78:0/751136064 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7100003980 0x7f7114148a10 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f711001c210 tx=0x7f7100005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:00:29.239 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:29.229+0000 7f710a7fc640 1 -- 172.21.15.78:0/751136064 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71100072f0 con 0x7f7100003980 2023-11-28T20:00:29.239 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:29.229+0000 7f710a7fc640 1 -- 172.21.15.78:0/751136064 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7110007450 con 0x7f7100003980 2023-11-28T20:00:29.239 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:29.229+0000 7f710a7fc640 1 -- 172.21.15.78:0/751136064 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71100067e0 con 0x7f7100003980 2023-11-28T20:00:29.240 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:29.229+0000 7f711be9e640 1 -- 172.21.15.78:0/751136064 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f711414a800 con 0x7f7100003980 2023-11-28T20:00:29.240 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:29.229+0000 7f711be9e640 1 -- 172.21.15.78:0/751136064 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f71141ed8a0 con 0x7f7100003980 2023-11-28T20:00:29.240 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:29.233+0000 7f711be9e640 1 -- 172.21.15.78:0/751136064 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7114067630 con 0x7f7100003980 2023-11-28T20:00:29.242 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:29.233+0000 7f710a7fc640 1 -- 172.21.15.78:0/751136064 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f7110006940 con 0x7f7100003980 2023-11-28T20:00:29.242 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:29.233+0000 7f710a7fc640 1 --2- 172.21.15.78:0/751136064 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f70f80664a0 0x7f70f8068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:29.242 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:29.233+0000 7f710a7fc640 1 -- 172.21.15.78:0/751136064 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6400+0+0 (secure 0 0 0) 0x7f711011e6b0 con 0x7f7100003980 2023-11-28T20:00:29.242 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:29.233+0000 7f7119439640 1 --2- 172.21.15.78:0/751136064 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f70f80664a0 0x7f70f8068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:29.242 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:29.233+0000 7f7119439640 1 --2- 172.21.15.78:0/751136064 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f70f80664a0 0x7f70f8068960 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f7104006d50 tx=0x7f7104008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:00:29.243 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:29.237+0000 7f710a7fc640 1 -- 172.21.15.78:0/751136064 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f71100eb910 con 0x7f7100003980 2023-11-28T20:00:29.394 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:29.389+0000 7f711be9e640 1 -- 172.21.15.78:0/751136064 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs2_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f71141521e0 con 0x7f7100003980 2023-11-28T20:00:30.050 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:30.045+0000 7f710a7fc640 1 -- 172.21.15.78:0/751136064 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs2_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs2_data' created v42) v1 ==== 172+0+0 (secure 0 0 0) 0x7f71100eef30 con 0x7f7100003980 2023-11-28T20:00:30.051 INFO:teuthology.orchestra.run.smithi078.stderr:pool 'cephfs2_data' created 2023-11-28T20:00:30.053 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:30.049+0000 7f711be9e640 1 -- 172.21.15.78:0/751136064 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f70f80664a0 msgr2=0x7f70f8068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:00:30.053 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:30.049+0000 7f711be9e640 1 --2- 172.21.15.78:0/751136064 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f70f80664a0 0x7f70f8068960 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f7104006d50 tx=0x7f7104008040 comp rx=0 tx=0).stop 2023-11-28T20:00:30.053 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:30.049+0000 7f711be9e640 1 -- 172.21.15.78:0/751136064 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7100003980 msgr2=0x7f7114148a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:00:30.053 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:30.049+0000 7f711be9e640 1 --2- 172.21.15.78:0/751136064 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7100003980 0x7f7114148a10 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f711001c210 tx=0x7f7100005800 comp rx=0 tx=0).stop 2023-11-28T20:00:30.053 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:30.049+0000 7f711be9e640 1 -- 172.21.15.78:0/751136064 shutdown_connections 2023-11-28T20:00:30.053 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:30.049+0000 7f711be9e640 1 --2- 172.21.15.78:0/751136064 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f70f80664a0 0x7f70f8068960 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:30.054 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:30.049+0000 7f711be9e640 1 --2- 172.21.15.78:0/751136064 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f71140a7130 0x7f7114142d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:30.054 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:30.049+0000 7f711be9e640 1 --2- 172.21.15.78:0/751136064 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f711406b970 0x7f71141419a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:30.054 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:30.049+0000 7f711be9e640 1 --2- 172.21.15.78:0/751136064 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7100003980 0x7f7114148a10 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:30.054 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:30.049+0000 7f711be9e640 1 -- 172.21.15.78:0/751136064 >> 172.21.15.78:0/751136064 conn(0x7f71140c59f0 msgr2=0x7f71140aa850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:00:30.054 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:30.049+0000 7f711be9e640 1 -- 172.21.15.78:0/751136064 shutdown_connections 2023-11-28T20:00:30.054 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:30.049+0000 7f711be9e640 1 -- 172.21.15.78:0/751136064 wait complete. 2023-11-28T20:00:30.092 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs2 cephfs2_metadata cephfs2_data 2023-11-28T20:00:30.233 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:30.229+0000 7f536a172640 1 Processor -- start 2023-11-28T20:00:30.234 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:30.229+0000 7f536a172640 1 -- start start 2023-11-28T20:00:30.234 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:30.229+0000 7f536a172640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f53640c5300 0x7f53640a9c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:30.235 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:30.229+0000 7f536a172640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f53640a4e20 con 0x7f53641548c0 2023-11-28T20:00:30.235 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:30.229+0000 7f536a172640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f53640a50e0 con 0x7f536414b1e0 2023-11-28T20:00:30.235 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:30.229+0000 7f536a172640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f53640c0f00 con 0x7f53640c5300 2023-11-28T20:00:30.236 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:30.229+0000 7f5362ffd640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f53640c5300 0x7f53640a9c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:30.236 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:30.229+0000 7f5362ffd640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f53640c5300 0x7f53640a9c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:45902/0 (socket says 172.21.15.78:45902) 2023-11-28T20:00:30.236 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:30.229+0000 7f5363fff640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f53641548c0 0x7f5364154d30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:50196/0 (socket says 172.21.15.78:50196) 2023-11-28T20:00:30.236 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:30.229+0000 7f5362ffd640 1 -- 172.21.15.78:0/2332572958 learned_addr learned my addr 172.21.15.78:0/2332572958 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T20:00:30.236 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:30.229+0000 7f5362ffd640 1 -- 172.21.15.78:0/2332572958 >> v1:172.21.15.179:6789/0 conn(0x7f536414b1e0 legacy=0x7f53640c1700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:00:30.236 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:30.229+0000 7f5362ffd640 1 -- 172.21.15.78:0/2332572958 >> v1:172.21.15.78:6789/0 conn(0x7f53641548c0 legacy=0x7f5364154d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:00:30.236 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:30.229+0000 7f5362ffd640 1 -- 172.21.15.78:0/2332572958 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53640c11e0 con 0x7f53640c5300 2023-11-28T20:00:30.238 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:30.233+0000 7f5362ffd640 1 --2- 172.21.15.78:0/2332572958 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f53640c5300 0x7f53640a9c30 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f5358009870 tx=0x7f535801c540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=70631da6b4d48127 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:00:30.238 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:30.233+0000 7f53627fc640 1 -- 172.21.15.78:0/2332572958 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53580ab600 con 0x7f53640c5300 2023-11-28T20:00:30.239 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:30.233+0000 7f53627fc640 1 -- 172.21.15.78:0/2332572958 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f53580a7050 con 0x7f53640c5300 2023-11-28T20:00:30.239 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:30.233+0000 7f53627fc640 1 -- 172.21.15.78:0/2332572958 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53580ab980 con 0x7f53640c5300 2023-11-28T20:00:30.239 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:30.233+0000 7f536a172640 1 -- 172.21.15.78:0/2332572958 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f53640c5300 msgr2=0x7f53640a9c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:00:30.240 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:30.233+0000 7f536a172640 1 --2- 172.21.15.78:0/2332572958 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f53640c5300 0x7f53640a9c30 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f5358009870 tx=0x7f535801c540 comp rx=0 tx=0).stop 2023-11-28T20:00:30.240 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:30.233+0000 7f536a172640 1 -- 172.21.15.78:0/2332572958 shutdown_connections 2023-11-28T20:00:30.240 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:30.233+0000 7f536a172640 1 --2- 172.21.15.78:0/2332572958 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f53640c5300 0x7f53640a9c30 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:30.240 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:30.233+0000 7f536a172640 1 -- 172.21.15.78:0/2332572958 >> 172.21.15.78:0/2332572958 conn(0x7f53640c59f0 msgr2=0x7f53640c5e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:00:30.240 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:30.233+0000 7f536a172640 1 -- 172.21.15.78:0/2332572958 shutdown_connections 2023-11-28T20:00:30.240 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:30.233+0000 7f536a172640 1 -- 172.21.15.78:0/2332572958 wait complete. 2023-11-28T20:00:30.241 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:30.237+0000 7f536a172640 1 Processor -- start 2023-11-28T20:00:30.241 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:30.237+0000 7f536a172640 1 -- start start 2023-11-28T20:00:30.243 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:30.237+0000 7f536a172640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f53640c5300 0x7f536413f750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:30.243 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:30.237+0000 7f536a172640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f536414b1e0 0x7f536406c9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:30.243 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:30.237+0000 7f536a172640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f53641548c0 0x7f5364070ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:30.244 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:30.237+0000 7f536a172640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f536406fac0 con 0x7f53640c5300 2023-11-28T20:00:30.244 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:30.237+0000 7f536a172640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5364070640 con 0x7f536414b1e0 2023-11-28T20:00:30.244 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:30.237+0000 7f536a172640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53641ee120 con 0x7f53641548c0 2023-11-28T20:00:30.244 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:30.237+0000 7f53637fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f53640c5300 0x7f536413f750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:30.244 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:30.237+0000 7f53637fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f53640c5300 0x7f536413f750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:45912/0 (socket says 172.21.15.78:45912) 2023-11-28T20:00:30.244 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:30.237+0000 7f53637fe640 1 -- 172.21.15.78:0/4068487661 learned_addr learned my addr 172.21.15.78:0/4068487661 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T20:00:30.244 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:30.237+0000 7f5362ffd640 1 --2- 172.21.15.78:0/4068487661 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f536414b1e0 0x7f536406c9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:30.244 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:30.237+0000 7f5363fff640 1 --2- 172.21.15.78:0/4068487661 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f53641548c0 0x7f5364070ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:30.244 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:30.237+0000 7f53637fe640 1 -- 172.21.15.78:0/4068487661 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f53641548c0 msgr2=0x7f5364070ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:00:30.244 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:30.237+0000 7f53637fe640 1 --2- 172.21.15.78:0/4068487661 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f53641548c0 0x7f5364070ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:30.244 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:30.237+0000 7f53637fe640 1 -- 172.21.15.78:0/4068487661 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f536414b1e0 msgr2=0x7f536406c9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:00:30.245 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:30.237+0000 7f53637fe640 1 --2- 172.21.15.78:0/4068487661 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f536414b1e0 0x7f536406c9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:30.245 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:30.237+0000 7f53637fe640 1 -- 172.21.15.78:0/4068487661 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53580094d0 con 0x7f53640c5300 2023-11-28T20:00:30.245 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:30.237+0000 7f53637fe640 1 --2- 172.21.15.78:0/4068487661 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f53640c5300 0x7f536413f750 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f535400c530 tx=0x7f535400c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:00:30.245 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:30.237+0000 7f534bfff640 1 -- 172.21.15.78:0/4068487661 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5354005220 con 0x7f53640c5300 2023-11-28T20:00:30.245 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:30.237+0000 7f534bfff640 1 -- 172.21.15.78:0/4068487661 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5354005380 con 0x7f53640c5300 2023-11-28T20:00:30.245 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:30.237+0000 7f534bfff640 1 -- 172.21.15.78:0/4068487661 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5354007270 con 0x7f53640c5300 2023-11-28T20:00:30.245 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:30.237+0000 7f536a172640 1 -- 172.21.15.78:0/4068487661 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f536406fd10 con 0x7f53640c5300 2023-11-28T20:00:30.245 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:30.237+0000 7f536a172640 1 -- 172.21.15.78:0/4068487661 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f53640702d0 con 0x7f53640c5300 2023-11-28T20:00:30.246 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:30.241+0000 7f536a172640 1 -- 172.21.15.78:0/4068487661 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5364067630 con 0x7f53640c5300 2023-11-28T20:00:30.246 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:30.241+0000 7f534bfff640 1 -- 172.21.15.78:0/4068487661 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f53540073d0 con 0x7f53640c5300 2023-11-28T20:00:30.246 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:30.241+0000 7f534bfff640 1 --2- 172.21.15.78:0/4068487661 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f53500664a0 0x7f5350068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:30.246 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:30.241+0000 7f534bfff640 1 -- 172.21.15.78:0/4068487661 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6783+0+0 (secure 0 0 0) 0x7f5354083b20 con 0x7f53640c5300 2023-11-28T20:00:30.246 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:30.241+0000 7f5362ffd640 1 --2- 172.21.15.78:0/4068487661 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f53500664a0 0x7f5350068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:30.247 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:30.241+0000 7f5362ffd640 1 --2- 172.21.15.78:0/4068487661 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f53500664a0 0x7f5350068960 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f53640c5850 tx=0x7f5358008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:00:30.251 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:30.245+0000 7f534bfff640 1 -- 172.21.15.78:0/4068487661 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f5354050b60 con 0x7f53640c5300 2023-11-28T20:00:30.436 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:30.433+0000 7f536a172640 1 -- 172.21.15.78:0/4068487661 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs2", "metadata": "cephfs2_metadata", "data": "cephfs2_data"} v 0) v1 -- 0x7f53640c6720 con 0x7f53640c5300 2023-11-28T20:00:31.090 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:31.085+0000 7f534bfff640 1 -- 172.21.15.78:0/4068487661 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs2", "metadata": "cephfs2_metadata", "data": "cephfs2_data"}]=0 new fs with metadata pool 7 and data pool 8 v18) v1 ==== 175+0+0 (secure 0 0 0) 0x7f5354054180 con 0x7f53640c5300 2023-11-28T20:00:31.090 INFO:teuthology.orchestra.run.smithi078.stderr:new fs with metadata pool 7 and data pool 8 2023-11-28T20:00:31.092 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:31.085+0000 7f536a172640 1 -- 172.21.15.78:0/4068487661 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f53500664a0 msgr2=0x7f5350068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:00:31.092 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:31.085+0000 7f536a172640 1 --2- 172.21.15.78:0/4068487661 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f53500664a0 0x7f5350068960 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f53640c5850 tx=0x7f5358008040 comp rx=0 tx=0).stop 2023-11-28T20:00:31.092 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:31.085+0000 7f536a172640 1 -- 172.21.15.78:0/4068487661 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f53640c5300 msgr2=0x7f536413f750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:00:31.092 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:31.085+0000 7f536a172640 1 --2- 172.21.15.78:0/4068487661 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f53640c5300 0x7f536413f750 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f535400c530 tx=0x7f535400c9f0 comp rx=0 tx=0).stop 2023-11-28T20:00:31.092 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:31.089+0000 7f536a172640 1 -- 172.21.15.78:0/4068487661 shutdown_connections 2023-11-28T20:00:31.092 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:31.089+0000 7f536a172640 1 --2- 172.21.15.78:0/4068487661 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f53500664a0 0x7f5350068960 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:31.093 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:31.089+0000 7f536a172640 1 --2- 172.21.15.78:0/4068487661 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f53641548c0 0x7f5364070ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:31.093 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:31.089+0000 7f536a172640 1 --2- 172.21.15.78:0/4068487661 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f536414b1e0 0x7f536406c9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:31.093 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:31.089+0000 7f536a172640 1 --2- 172.21.15.78:0/4068487661 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f53640c5300 0x7f536413f750 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:31.093 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:31.089+0000 7f536a172640 1 -- 172.21.15.78:0/4068487661 >> 172.21.15.78:0/4068487661 conn(0x7f53640c59f0 msgr2=0x7f53640aad10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:00:31.093 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:31.089+0000 7f536a172640 1 -- 172.21.15.78:0/4068487661 shutdown_connections 2023-11-28T20:00:31.093 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:31.089+0000 7f536a172640 1 -- 172.21.15.78:0/4068487661 wait complete. 2023-11-28T20:00:31.118 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-28T20:00:31.255 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:31.249+0000 7f524b0d6640 1 Processor -- start 2023-11-28T20:00:31.255 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:31.249+0000 7f524b0d6640 1 -- start start 2023-11-28T20:00:31.257 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:31.253+0000 7f524b0d6640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f524414fd10 0x7f52440a4dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:31.257 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:31.253+0000 7f524b0d6640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f52440a5300 0x7f5244071e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:31.257 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:31.253+0000 7f524b0d6640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5244072370 0x7f5244156110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:31.257 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:31.253+0000 7f524b0d6640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f524406c5e0 con 0x7f52440a5300 2023-11-28T20:00:31.257 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:31.253+0000 7f524b0d6640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f52440c5710 con 0x7f524414fd10 2023-11-28T20:00:31.257 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:31.253+0000 7f524b0d6640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5244155c80 con 0x7f5244072370 2023-11-28T20:00:31.257 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:31.253+0000 7f523bfff640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f52440a5300 0x7f5244071e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:31.257 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:31.253+0000 7f523bfff640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f52440a5300 0x7f5244071e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:45918/0 (socket says 172.21.15.78:45918) 2023-11-28T20:00:31.258 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:31.253+0000 7f523bfff640 1 -- 172.21.15.78:0/1588936541 learned_addr learned my addr 172.21.15.78:0/1588936541 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T20:00:31.258 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:31.253+0000 7f523bfff640 1 -- 172.21.15.78:0/1588936541 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5244072370 msgr2=0x7f5244156110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:00:31.258 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:31.253+0000 7f523bfff640 1 --2- 172.21.15.78:0/1588936541 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5244072370 0x7f5244156110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:31.258 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:31.253+0000 7f523bfff640 1 -- 172.21.15.78:0/1588936541 >> v2:172.21.15.179:3300/0 conn(0x7f524414fd10 msgr2=0x7f52440a4dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:00:31.258 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:31.253+0000 7f523bfff640 1 --2- 172.21.15.78:0/1588936541 >> v2:172.21.15.179:3300/0 conn(0x7f524414fd10 0x7f52440a4dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:31.258 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:31.253+0000 7f523bfff640 1 -- 172.21.15.78:0/1588936541 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52440c4e70 con 0x7f52440a5300 2023-11-28T20:00:31.259 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:31.257+0000 7f523bfff640 1 --2- 172.21.15.78:0/1588936541 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f52440a5300 0x7f5244071e30 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f524406b5a0 tx=0x7f523401c3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4854280c78d349e7 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:00:31.260 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:31.257+0000 7f523b7fe640 1 -- 172.21.15.78:0/1588936541 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52340ab600 con 0x7f52440a5300 2023-11-28T20:00:31.260 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:31.257+0000 7f523b7fe640 1 -- 172.21.15.78:0/1588936541 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f52340a7050 con 0x7f52440a5300 2023-11-28T20:00:31.260 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:31.257+0000 7f523b7fe640 1 -- 172.21.15.78:0/1588936541 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52340ab980 con 0x7f52440a5300 2023-11-28T20:00:31.261 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:31.257+0000 7f524b0d6640 1 -- 172.21.15.78:0/1588936541 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f52440a5300 msgr2=0x7f5244071e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:00:31.261 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:31.257+0000 7f524b0d6640 1 --2- 172.21.15.78:0/1588936541 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f52440a5300 0x7f5244071e30 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f524406b5a0 tx=0x7f523401c3b0 comp rx=0 tx=0).stop 2023-11-28T20:00:31.261 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:31.257+0000 7f524b0d6640 1 -- 172.21.15.78:0/1588936541 shutdown_connections 2023-11-28T20:00:31.261 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:31.257+0000 7f524b0d6640 1 --2- 172.21.15.78:0/1588936541 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5244072370 0x7f5244156110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:31.262 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:31.257+0000 7f524b0d6640 1 --2- 172.21.15.78:0/1588936541 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f52440a5300 0x7f5244071e30 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:31.262 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:31.257+0000 7f524b0d6640 1 --2- 172.21.15.78:0/1588936541 >> v2:172.21.15.179:3300/0 conn(0x7f524414fd10 0x7f52440a4dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:31.262 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:31.257+0000 7f524b0d6640 1 -- 172.21.15.78:0/1588936541 >> 172.21.15.78:0/1588936541 conn(0x7f52440a7810 msgr2=0x7f52440a7c20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:00:31.262 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:31.257+0000 7f524b0d6640 1 -- 172.21.15.78:0/1588936541 shutdown_connections 2023-11-28T20:00:31.262 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:31.257+0000 7f524b0d6640 1 -- 172.21.15.78:0/1588936541 wait complete. 2023-11-28T20:00:31.262 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:31.257+0000 7f524b0d6640 1 Processor -- start 2023-11-28T20:00:31.263 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:31.257+0000 7f524b0d6640 1 -- start start 2023-11-28T20:00:31.265 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:31.257+0000 7f524b0d6640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5244072370 0x7f52441edc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:31.265 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:31.257+0000 7f524b0d6640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f52440a5300 0x7f524414ef00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:31.265 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:31.257+0000 7f524b0d6640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f524414fd10 0x7f52440715a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:31.265 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:31.257+0000 7f524b0d6640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5244157950 con 0x7f5244072370 2023-11-28T20:00:31.265 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:31.257+0000 7f524b0d6640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f524415be60 con 0x7f52440a5300 2023-11-28T20:00:31.265 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:31.257+0000 7f524b0d6640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5244071110 con 0x7f524414fd10 2023-11-28T20:00:31.265 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:31.261+0000 7f5248e72640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5244072370 0x7f52441edc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:31.265 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:31.261+0000 7f5248e72640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5244072370 0x7f52441edc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:45924/0 (socket says 172.21.15.78:45924) 2023-11-28T20:00:31.266 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:31.261+0000 7f5248e72640 1 -- 172.21.15.78:0/3121825763 learned_addr learned my addr 172.21.15.78:0/3121825763 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T20:00:31.266 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:31.261+0000 7f523bfff640 1 --2- 172.21.15.78:0/3121825763 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f52440a5300 0x7f524414ef00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:31.266 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:31.261+0000 7f5249673640 1 --2- 172.21.15.78:0/3121825763 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f524414fd10 0x7f52440715a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:31.266 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:31.261+0000 7f5248e72640 1 -- 172.21.15.78:0/3121825763 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f524414fd10 msgr2=0x7f52440715a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:00:31.266 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:31.261+0000 7f5248e72640 1 --2- 172.21.15.78:0/3121825763 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f524414fd10 0x7f52440715a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:31.266 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:31.261+0000 7f5248e72640 1 -- 172.21.15.78:0/3121825763 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f52440a5300 msgr2=0x7f524414ef00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:00:31.266 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:31.261+0000 7f5248e72640 1 --2- 172.21.15.78:0/3121825763 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f52440a5300 0x7f524414ef00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:31.266 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:31.261+0000 7f5248e72640 1 -- 172.21.15.78:0/3121825763 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52340094d0 con 0x7f5244072370 2023-11-28T20:00:31.266 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:31.261+0000 7f5248e72640 1 --2- 172.21.15.78:0/3121825763 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5244072370 0x7f52441edc20 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f524000b410 tx=0x7f524000b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:00:31.267 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:31.261+0000 7f52397fa640 1 -- 172.21.15.78:0/3121825763 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5240011830 con 0x7f5244072370 2023-11-28T20:00:31.267 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:31.261+0000 7f52397fa640 1 -- 172.21.15.78:0/3121825763 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5240011990 con 0x7f5244072370 2023-11-28T20:00:31.267 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:31.261+0000 7f52397fa640 1 -- 172.21.15.78:0/3121825763 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5240011d40 con 0x7f5244072370 2023-11-28T20:00:31.267 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:31.261+0000 7f524b0d6640 1 -- 172.21.15.78:0/3121825763 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f52440a9350 con 0x7f5244072370 2023-11-28T20:00:31.267 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:31.261+0000 7f524b0d6640 1 -- 172.21.15.78:0/3121825763 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f52440a8d90 con 0x7f5244072370 2023-11-28T20:00:31.268 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:31.261+0000 7f524b0d6640 1 -- 172.21.15.78:0/3121825763 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5244067630 con 0x7f5244072370 2023-11-28T20:00:31.268 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:31.261+0000 7f52397fa640 1 -- 172.21.15.78:0/3121825763 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f524001a400 con 0x7f5244072370 2023-11-28T20:00:31.268 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:31.265+0000 7f52397fa640 1 --2- 172.21.15.78:0/3121825763 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f5230066470 0x7f5230068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:31.269 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:31.265+0000 7f52397fa640 1 -- 172.21.15.78:0/3121825763 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 6885+0+0 (secure 0 0 0) 0x7f5240084310 con 0x7f5244072370 2023-11-28T20:00:31.269 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:31.265+0000 7f523bfff640 1 --2- 172.21.15.78:0/3121825763 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f5230066470 0x7f5230068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:31.269 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:31.265+0000 7f523bfff640 1 --2- 172.21.15.78:0/3121825763 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f5230066470 0x7f5230068930 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f52340ad000 tx=0x7f5234004740 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:00:31.272 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:31.269+0000 7f52397fa640 1 -- 172.21.15.78:0/3121825763 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f5240051390 con 0x7f5244072370 2023-11-28T20:00:31.425 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:31.421+0000 7f524b0d6640 1 -- 172.21.15.78:0/3121825763 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f52440c4b20 con 0x7f5244072370 2023-11-28T20:00:31.429 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:31.421+0000 7f52397fa640 1 -- 172.21.15.78:0/3121825763 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v43) v1 ==== 74+0+20479 (secure 0 0 0) 0x7f52400549b0 con 0x7f5244072370 2023-11-28T20:00:31.430 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-11-28T20:00:31.430 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":43,"fsid":"dd9780e8-3bda-44fa-a9f0-fa07d19d901d","created":"2023-11-28T19:58:40.969556+0000","modified":"2023-11-28T20:00:30.435864+0000","last_up_change":"2023-11-28T19:58:52.596716+0000","last_in_change":"2023-11-28T19:58:43.609275+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-28T19:58:54.011229+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2023-11-28T20:00:10.831194+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"39","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2023-11-28T20:00:12.150184+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"40","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs2_metadata","create_time":"2023-11-28T20:00:28.571896+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"43","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs2_data","create_time":"2023-11-28T20:00:29.436453+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"43","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs2"}},"read_balance":{"score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e84245ac-b5da-429e-af18-39acaa2b33e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6800","nonce":3358701235},{"type":"v1","addr":"172.21.15.78:6801","nonce":3358701235}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6802","nonce":3358701235},{"type":"v1","addr":"172.21.15.78:6803","nonce":3358701235}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6806","nonce":3358701235},{"type":"v1","addr":"172.21.15.78:6807","nonce":3358701235}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6804","nonce":3358701235},{"type":"v1","addr":"172.21.15.78:6805","nonce":3358701235}]},"public_addr":"172.21.15.78:6801/3358701235","cluster_addr":"172.21.15.78:6803/3358701235","heartbeat_back_addr":"172.21.15.78:6807/3358701235","heartbeat_front_addr":"172.21.15.78:6805/3358701235","state":["exists","up"]},{"osd":1,"uuid":"e634831d-c4e2-48d9-870c-9556ae162981","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6808","nonce":3211476654},{"type":"v1","addr":"172.21.15.78:6809","nonce":3211476654}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6810","nonce":3211476654},{"type":"v1","addr":"172.21.15.78:6811","nonce":3211476654}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6814","nonce":3211476654},{"type":"v1","addr":"172.21.15.78:6815","nonce":3211476654}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6812","nonce":3211476654},{"type":"v1","addr":"172.21.15.78:6813","nonce":3211476654}]},"public_addr":"172.21.15.78:6809/3211476654","cluster_addr":"172.21.15.78:6811/3211476654","heartbeat_back_addr":"172.21.15.78:6815/3211476654","heartbeat_front_addr":"172.21.15.78:6813/3211476654","state":["exists","up"]},{"osd":2,"uuid":"274c8395-6534-41f0-b8fb-a00af8985aa8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6816","nonce":2532904479},{"type":"v1","addr":"172.21.15.78:6817","nonce":2532904479}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6818","nonce":2532904479},{"type":"v1","addr":"172.21.15.78:6819","nonce":2532904479}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6822","nonce":2532904479},{"type":"v1","addr":"172.21.15.78:6823","nonce":2532904479}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6820","nonce":2532904479},{"type":"v1","addr":"172.21.15.78:6821","nonce":2532904479}]},"public_addr":"172.21.15.78:6817/2532904479","cluster_addr":"172.21.15.78:6819/2532904479","heartbeat_back_addr":"172.21.15.78:6823/2532904479","heartbeat_front_addr":"172.21.15.78:6821/2532904479","state":["exists","up"]},{"osd":3,"uuid":"77acc9af-7d4d-4b18-8cf5-d62f5971b7c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6824","nonce":3442991267},{"type":"v1","addr":"172.21.15.78:6825","nonce":3442991267}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6826","nonce":3442991267},{"type":"v1","addr":"172.21.15.78:6827","nonce":3442991267}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6830","nonce":3442991267},{"type":"v1","addr":"172.21.15.78:6831","nonce":3442991267}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6828","nonce":3442991267},{"type":"v1","addr":"172.21.15.78:6829","nonce":3442991267}]},"public_addr":"172.21.15.78:6825/3442991267","cluster_addr":"172.21.15.78:6827/3442991267","heartbeat_back_addr":"172.21.15.78:6831/3442991267","heartbeat_front_addr":"172.21.15.78:6829/3442991267","state":["exists","up"]},{"osd":4,"uuid":"5c62bc66-6b34-4b7f-a66b-9a743969138c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":802983577},{"type":"v1","addr":"172.21.15.179:6809","nonce":802983577}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":802983577},{"type":"v1","addr":"172.21.15.179:6811","nonce":802983577}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":802983577},{"type":"v1","addr":"172.21.15.179:6815","nonce":802983577}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":802983577},{"type":"v1","addr":"172.21.15.179:6813","nonce":802983577}]},"public_addr":"172.21.15.179:6809/802983577","cluster_addr":"172.21.15.179:6811/802983577","heartbeat_back_addr":"172.21.15.179:6815/802983577","heartbeat_front_addr":"172.21.15.179:6813/802983577","state":["exists","up"]},{"osd":5,"uuid":"67db6d36-f684-4079-b0cd-82b4dd61461f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":518192887},{"type":"v1","addr":"172.21.15.179:6818","nonce":518192887}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":518192887},{"type":"v1","addr":"172.21.15.179:6822","nonce":518192887}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":518192887},{"type":"v1","addr":"172.21.15.179:6829","nonce":518192887}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6824","nonce":518192887},{"type":"v1","addr":"172.21.15.179:6826","nonce":518192887}]},"public_addr":"172.21.15.179:6818/518192887","cluster_addr":"172.21.15.179:6822/518192887","heartbeat_back_addr":"172.21.15.179:6829/518192887","heartbeat_front_addr":"172.21.15.179:6826/518192887","state":["exists","up"]},{"osd":6,"uuid":"12e670af-5a16-4c81-9f97-defa66cab967","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":815435378},{"type":"v1","addr":"172.21.15.179:6801","nonce":815435378}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":815435378},{"type":"v1","addr":"172.21.15.179:6803","nonce":815435378}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":815435378},{"type":"v1","addr":"172.21.15.179:6807","nonce":815435378}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":815435378},{"type":"v1","addr":"172.21.15.179:6805","nonce":815435378}]},"public_addr":"172.21.15.179:6801/815435378","cluster_addr":"172.21.15.179:6803/815435378","heartbeat_back_addr":"172.21.15.179:6807/815435378","heartbeat_front_addr":"172.21.15.179:6805/815435378","state":["exists","up"]},{"osd":7,"uuid":"fe630650-2eb3-49ad-8676-c341e6332eb1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6817","nonce":2848432339},{"type":"v1","addr":"172.21.15.179:6819","nonce":2848432339}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6821","nonce":2848432339},{"type":"v1","addr":"172.21.15.179:6823","nonce":2848432339}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":2848432339},{"type":"v1","addr":"172.21.15.179:6831","nonce":2848432339}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6825","nonce":2848432339},{"type":"v1","addr":"172.21.15.179:6827","nonce":2848432339}]},"public_addr":"172.21.15.179:6819/2848432339","cluster_addr":"172.21.15.179:6823/2848432339","heartbeat_back_addr":"172.21.15.179:6831/2848432339","heartbeat_front_addr":"172.21.15.179:6827/2848432339","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:58:49.255433+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:58:49.412880+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:58:49.559295+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:58:49.245237+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:58:49.184557+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:58:49.329851+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:58:49.366012+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:58:49.349604+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-28T20:00:31.432 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:31.425+0000 7f524b0d6640 1 -- 172.21.15.78:0/3121825763 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f5230066470 msgr2=0x7f5230068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:00:31.432 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:31.425+0000 7f524b0d6640 1 --2- 172.21.15.78:0/3121825763 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f5230066470 0x7f5230068930 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f52340ad000 tx=0x7f5234004740 comp rx=0 tx=0).stop 2023-11-28T20:00:31.432 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:31.425+0000 7f524b0d6640 1 -- 172.21.15.78:0/3121825763 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5244072370 msgr2=0x7f52441edc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:00:31.432 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:31.425+0000 7f524b0d6640 1 --2- 172.21.15.78:0/3121825763 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5244072370 0x7f52441edc20 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f524000b410 tx=0x7f524000b8d0 comp rx=0 tx=0).stop 2023-11-28T20:00:31.432 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:31.425+0000 7f524b0d6640 1 -- 172.21.15.78:0/3121825763 shutdown_connections 2023-11-28T20:00:31.432 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:31.425+0000 7f524b0d6640 1 --2- 172.21.15.78:0/3121825763 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f5230066470 0x7f5230068930 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:31.432 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:31.425+0000 7f524b0d6640 1 --2- 172.21.15.78:0/3121825763 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f524414fd10 0x7f52440715a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:31.433 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:31.425+0000 7f524b0d6640 1 --2- 172.21.15.78:0/3121825763 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f52440a5300 0x7f524414ef00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:31.433 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:31.425+0000 7f524b0d6640 1 --2- 172.21.15.78:0/3121825763 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5244072370 0x7f52441edc20 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:31.433 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:31.425+0000 7f524b0d6640 1 -- 172.21.15.78:0/3121825763 >> 172.21.15.78:0/3121825763 conn(0x7f52440a7810 msgr2=0x7f5244151ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:00:31.433 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:31.425+0000 7f524b0d6640 1 -- 172.21.15.78:0/3121825763 shutdown_connections 2023-11-28T20:00:31.433 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:31.425+0000 7f524b0d6640 1 -- 172.21.15.78:0/3121825763 wait complete. 2023-11-28T20:00:31.448 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-28T20:00:31.585 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:31.581+0000 7f9da74d6640 1 Processor -- start 2023-11-28T20:00:31.585 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:31.581+0000 7f9da74d6640 1 -- start start 2023-11-28T20:00:31.587 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:31.581+0000 7f9da74d6640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f9da014b2a0 0x7f9da00a4ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:31.587 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:31.581+0000 7f9da74d6640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9da00bf310 0x7f9da0154e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:31.588 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:31.581+0000 7f9da74d6640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9da0157cf0 con 0x7f9da00bee90 2023-11-28T20:00:31.588 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:31.581+0000 7f9da74d6640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9da006c3a0 con 0x7f9da014b2a0 2023-11-28T20:00:31.588 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:31.581+0000 7f9da74d6640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9da0157fd0 con 0x7f9da00bf310 2023-11-28T20:00:31.588 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:31.581+0000 7f9da5272640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f9da014b2a0 0x7f9da00a4ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:31.589 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:31.581+0000 7f9da4a71640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f9da00bee90 0x7f9da0154740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:50206/0 (socket says 172.21.15.78:50206) 2023-11-28T20:00:31.589 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:31.581+0000 7f9da4a71640 1 -- 172.21.15.78:0/1729290732 learned_addr learned my addr 172.21.15.78:0/1729290732 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-11-28T20:00:31.589 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:31.581+0000 7f9da5a73640 1 --2- 172.21.15.78:0/1729290732 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9da00bf310 0x7f9da0154e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:31.589 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:31.581+0000 7f9da5272640 1 -- 172.21.15.78:0/1729290732 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9da00bf310 msgr2=0x7f9da0154e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:00:31.589 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:31.581+0000 7f9da5272640 1 --2- 172.21.15.78:0/1729290732 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9da00bf310 0x7f9da0154e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:31.590 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:31.581+0000 7f9da5272640 1 -- 172.21.15.78:0/1729290732 >> v1:172.21.15.78:6789/0 conn(0x7f9da00bee90 legacy=0x7f9da0154740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:00:31.590 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:31.581+0000 7f9d97fff640 1 -- 172.21.15.78:0/1729290732 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1145847161 0 0) 0x7f9da0157cf0 con 0x7f9da00bee90 2023-11-28T20:00:31.590 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:31.581+0000 7f9da5272640 1 -- 172.21.15.78:0/1729290732 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9da01582b0 con 0x7f9da014b2a0 2023-11-28T20:00:31.596 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:31.585+0000 7f9da5272640 1 --2- 172.21.15.78:0/1729290732 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9da014b2a0 0x7f9da00a4ec0 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f9d9c0097c0 tx=0x7f9d9c01c360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=45220d1c688e6b9a server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:00:31.596 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:31.585+0000 7f9d97fff640 1 -- 172.21.15.78:0/1729290732 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d9c0ab600 con 0x7f9da014b2a0 2023-11-28T20:00:31.596 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:31.585+0000 7f9d97fff640 1 -- 172.21.15.78:0/1729290732 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d9c0a7050 con 0x7f9da014b2a0 2023-11-28T20:00:31.596 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:31.585+0000 7f9d97fff640 1 -- 172.21.15.78:0/1729290732 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d9c0ab980 con 0x7f9da014b2a0 2023-11-28T20:00:31.597 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:31.585+0000 7f9da74d6640 1 -- 172.21.15.78:0/1729290732 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9da014b2a0 msgr2=0x7f9da00a4ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:00:31.597 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:31.585+0000 7f9da74d6640 1 --2- 172.21.15.78:0/1729290732 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9da014b2a0 0x7f9da00a4ec0 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f9d9c0097c0 tx=0x7f9d9c01c360 comp rx=0 tx=0).stop 2023-11-28T20:00:31.597 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:31.585+0000 7f9da74d6640 1 -- 172.21.15.78:0/1729290732 shutdown_connections 2023-11-28T20:00:31.597 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:31.585+0000 7f9da74d6640 1 --2- 172.21.15.78:0/1729290732 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9da00bf310 0x7f9da0154e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:31.597 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:31.585+0000 7f9da74d6640 1 --2- 172.21.15.78:0/1729290732 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9da014b2a0 0x7f9da00a4ec0 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:31.598 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:31.585+0000 7f9da74d6640 1 -- 172.21.15.78:0/1729290732 >> 172.21.15.78:0/1729290732 conn(0x7f9da00a7810 msgr2=0x7f9da00a7c20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:00:31.598 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:31.585+0000 7f9da74d6640 1 -- 172.21.15.78:0/1729290732 shutdown_connections 2023-11-28T20:00:31.598 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:31.585+0000 7f9da74d6640 1 -- 172.21.15.78:0/1729290732 wait complete. 2023-11-28T20:00:31.598 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:31.589+0000 7f9da74d6640 1 Processor -- start 2023-11-28T20:00:31.599 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:31.589+0000 7f9da74d6640 1 -- start start 2023-11-28T20:00:31.599 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:31.589+0000 7f9da74d6640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9da00bee90 0x7f9da01ecc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:31.599 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:31.589+0000 7f9da74d6640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9da00bf310 0x7f9da0153820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:31.599 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:31.589+0000 7f9da74d6640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9da014b2a0 0x7f9da01f0960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:31.599 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:31.589+0000 7f9da74d6640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9da01429e0 con 0x7f9da00bf310 2023-11-28T20:00:31.600 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:31.589+0000 7f9da74d6640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9da00abe20 con 0x7f9da00bee90 2023-11-28T20:00:31.600 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:31.589+0000 7f9da74d6640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9da01477e0 con 0x7f9da014b2a0 2023-11-28T20:00:31.600 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:31.589+0000 7f9da4a71640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9da00bf310 0x7f9da0153820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:31.600 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:31.589+0000 7f9da4a71640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9da00bf310 0x7f9da0153820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:45946/0 (socket says 172.21.15.78:45946) 2023-11-28T20:00:31.600 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:31.589+0000 7f9da4a71640 1 -- 172.21.15.78:0/2503303736 learned_addr learned my addr 172.21.15.78:0/2503303736 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T20:00:31.601 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:31.589+0000 7f9da5272640 1 --2- 172.21.15.78:0/2503303736 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9da00bee90 0x7f9da01ecc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:31.601 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:31.589+0000 7f9da5a73640 1 --2- 172.21.15.78:0/2503303736 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9da014b2a0 0x7f9da01f0960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:31.601 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:31.589+0000 7f9da4a71640 1 -- 172.21.15.78:0/2503303736 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9da014b2a0 msgr2=0x7f9da01f0960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:00:31.601 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:31.589+0000 7f9da4a71640 1 --2- 172.21.15.78:0/2503303736 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9da014b2a0 0x7f9da01f0960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:31.601 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:31.589+0000 7f9da4a71640 1 -- 172.21.15.78:0/2503303736 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9da00bee90 msgr2=0x7f9da01ecc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:00:31.602 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:31.589+0000 7f9da4a71640 1 --2- 172.21.15.78:0/2503303736 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9da00bee90 0x7f9da01ecc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:31.602 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:31.589+0000 7f9da4a71640 1 -- 172.21.15.78:0/2503303736 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d9c009420 con 0x7f9da00bf310 2023-11-28T20:00:31.602 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:31.589+0000 7f9da4a71640 1 --2- 172.21.15.78:0/2503303736 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9da00bf310 0x7f9da0153820 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f9d9000c480 tx=0x7f9d9000c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:00:31.602 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:31.589+0000 7f9d95ffb640 1 -- 172.21.15.78:0/2503303736 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d900074e0 con 0x7f9da00bf310 2023-11-28T20:00:31.602 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:31.589+0000 7f9d95ffb640 1 -- 172.21.15.78:0/2503303736 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d90007660 con 0x7f9da00bf310 2023-11-28T20:00:31.603 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:31.589+0000 7f9d95ffb640 1 -- 172.21.15.78:0/2503303736 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d90004a30 con 0x7f9da00bf310 2023-11-28T20:00:31.603 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:31.589+0000 7f9da74d6640 1 -- 172.21.15.78:0/2503303736 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9da01f04d0 con 0x7f9da00bf310 2023-11-28T20:00:31.603 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:31.589+0000 7f9da74d6640 1 -- 172.21.15.78:0/2503303736 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9da0144600 con 0x7f9da00bf310 2023-11-28T20:00:31.603 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:31.589+0000 7f9da74d6640 1 -- 172.21.15.78:0/2503303736 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9da0067630 con 0x7f9da00bf310 2023-11-28T20:00:31.605 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:31.593+0000 7f9d95ffb640 1 -- 172.21.15.78:0/2503303736 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f9d90004b90 con 0x7f9da00bf310 2023-11-28T20:00:31.606 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:31.593+0000 7f9d95ffb640 1 --2- 172.21.15.78:0/2503303736 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f9d84066470 0x7f9d84068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:31.606 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:31.593+0000 7f9d95ffb640 1 -- 172.21.15.78:0/2503303736 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 6885+0+0 (secure 0 0 0) 0x7f9d90083430 con 0x7f9da00bf310 2023-11-28T20:00:31.606 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:31.593+0000 7f9da5272640 1 --2- 172.21.15.78:0/2503303736 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f9d84066470 0x7f9d84068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:31.606 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:31.593+0000 7f9da5272640 1 --2- 172.21.15.78:0/2503303736 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f9d84066470 0x7f9d84068930 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f9d9c0ad000 tx=0x7f9d9c0a6000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:00:31.606 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:31.597+0000 7f9d95ffb640 1 -- 172.21.15.78:0/2503303736 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f9d900504b0 con 0x7f9da00bf310 2023-11-28T20:00:31.751 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:31.745+0000 7f9da74d6640 1 -- 172.21.15.78:0/2503303736 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9da00c0010 con 0x7f9da00bf310 2023-11-28T20:00:31.753 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:31.749+0000 7f9d95ffb640 1 -- 172.21.15.78:0/2503303736 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v43) v1 ==== 74+0+20479 (secure 0 0 0) 0x7f9d90053ad0 con 0x7f9da00bf310 2023-11-28T20:00:31.753 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-11-28T20:00:31.753 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":43,"fsid":"dd9780e8-3bda-44fa-a9f0-fa07d19d901d","created":"2023-11-28T19:58:40.969556+0000","modified":"2023-11-28T20:00:30.435864+0000","last_up_change":"2023-11-28T19:58:52.596716+0000","last_in_change":"2023-11-28T19:58:43.609275+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-28T19:58:54.011229+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2023-11-28T20:00:10.831194+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"39","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2023-11-28T20:00:12.150184+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"40","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs2_metadata","create_time":"2023-11-28T20:00:28.571896+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"43","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs2_data","create_time":"2023-11-28T20:00:29.436453+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"43","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs2"}},"read_balance":{"score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e84245ac-b5da-429e-af18-39acaa2b33e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6800","nonce":3358701235},{"type":"v1","addr":"172.21.15.78:6801","nonce":3358701235}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6802","nonce":3358701235},{"type":"v1","addr":"172.21.15.78:6803","nonce":3358701235}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6806","nonce":3358701235},{"type":"v1","addr":"172.21.15.78:6807","nonce":3358701235}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6804","nonce":3358701235},{"type":"v1","addr":"172.21.15.78:6805","nonce":3358701235}]},"public_addr":"172.21.15.78:6801/3358701235","cluster_addr":"172.21.15.78:6803/3358701235","heartbeat_back_addr":"172.21.15.78:6807/3358701235","heartbeat_front_addr":"172.21.15.78:6805/3358701235","state":["exists","up"]},{"osd":1,"uuid":"e634831d-c4e2-48d9-870c-9556ae162981","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6808","nonce":3211476654},{"type":"v1","addr":"172.21.15.78:6809","nonce":3211476654}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6810","nonce":3211476654},{"type":"v1","addr":"172.21.15.78:6811","nonce":3211476654}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6814","nonce":3211476654},{"type":"v1","addr":"172.21.15.78:6815","nonce":3211476654}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6812","nonce":3211476654},{"type":"v1","addr":"172.21.15.78:6813","nonce":3211476654}]},"public_addr":"172.21.15.78:6809/3211476654","cluster_addr":"172.21.15.78:6811/3211476654","heartbeat_back_addr":"172.21.15.78:6815/3211476654","heartbeat_front_addr":"172.21.15.78:6813/3211476654","state":["exists","up"]},{"osd":2,"uuid":"274c8395-6534-41f0-b8fb-a00af8985aa8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6816","nonce":2532904479},{"type":"v1","addr":"172.21.15.78:6817","nonce":2532904479}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6818","nonce":2532904479},{"type":"v1","addr":"172.21.15.78:6819","nonce":2532904479}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6822","nonce":2532904479},{"type":"v1","addr":"172.21.15.78:6823","nonce":2532904479}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6820","nonce":2532904479},{"type":"v1","addr":"172.21.15.78:6821","nonce":2532904479}]},"public_addr":"172.21.15.78:6817/2532904479","cluster_addr":"172.21.15.78:6819/2532904479","heartbeat_back_addr":"172.21.15.78:6823/2532904479","heartbeat_front_addr":"172.21.15.78:6821/2532904479","state":["exists","up"]},{"osd":3,"uuid":"77acc9af-7d4d-4b18-8cf5-d62f5971b7c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6824","nonce":3442991267},{"type":"v1","addr":"172.21.15.78:6825","nonce":3442991267}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6826","nonce":3442991267},{"type":"v1","addr":"172.21.15.78:6827","nonce":3442991267}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6830","nonce":3442991267},{"type":"v1","addr":"172.21.15.78:6831","nonce":3442991267}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6828","nonce":3442991267},{"type":"v1","addr":"172.21.15.78:6829","nonce":3442991267}]},"public_addr":"172.21.15.78:6825/3442991267","cluster_addr":"172.21.15.78:6827/3442991267","heartbeat_back_addr":"172.21.15.78:6831/3442991267","heartbeat_front_addr":"172.21.15.78:6829/3442991267","state":["exists","up"]},{"osd":4,"uuid":"5c62bc66-6b34-4b7f-a66b-9a743969138c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":802983577},{"type":"v1","addr":"172.21.15.179:6809","nonce":802983577}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":802983577},{"type":"v1","addr":"172.21.15.179:6811","nonce":802983577}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":802983577},{"type":"v1","addr":"172.21.15.179:6815","nonce":802983577}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":802983577},{"type":"v1","addr":"172.21.15.179:6813","nonce":802983577}]},"public_addr":"172.21.15.179:6809/802983577","cluster_addr":"172.21.15.179:6811/802983577","heartbeat_back_addr":"172.21.15.179:6815/802983577","heartbeat_front_addr":"172.21.15.179:6813/802983577","state":["exists","up"]},{"osd":5,"uuid":"67db6d36-f684-4079-b0cd-82b4dd61461f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":518192887},{"type":"v1","addr":"172.21.15.179:6818","nonce":518192887}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":518192887},{"type":"v1","addr":"172.21.15.179:6822","nonce":518192887}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":518192887},{"type":"v1","addr":"172.21.15.179:6829","nonce":518192887}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6824","nonce":518192887},{"type":"v1","addr":"172.21.15.179:6826","nonce":518192887}]},"public_addr":"172.21.15.179:6818/518192887","cluster_addr":"172.21.15.179:6822/518192887","heartbeat_back_addr":"172.21.15.179:6829/518192887","heartbeat_front_addr":"172.21.15.179:6826/518192887","state":["exists","up"]},{"osd":6,"uuid":"12e670af-5a16-4c81-9f97-defa66cab967","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":815435378},{"type":"v1","addr":"172.21.15.179:6801","nonce":815435378}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":815435378},{"type":"v1","addr":"172.21.15.179:6803","nonce":815435378}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":815435378},{"type":"v1","addr":"172.21.15.179:6807","nonce":815435378}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":815435378},{"type":"v1","addr":"172.21.15.179:6805","nonce":815435378}]},"public_addr":"172.21.15.179:6801/815435378","cluster_addr":"172.21.15.179:6803/815435378","heartbeat_back_addr":"172.21.15.179:6807/815435378","heartbeat_front_addr":"172.21.15.179:6805/815435378","state":["exists","up"]},{"osd":7,"uuid":"fe630650-2eb3-49ad-8676-c341e6332eb1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6817","nonce":2848432339},{"type":"v1","addr":"172.21.15.179:6819","nonce":2848432339}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6821","nonce":2848432339},{"type":"v1","addr":"172.21.15.179:6823","nonce":2848432339}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":2848432339},{"type":"v1","addr":"172.21.15.179:6831","nonce":2848432339}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6825","nonce":2848432339},{"type":"v1","addr":"172.21.15.179:6827","nonce":2848432339}]},"public_addr":"172.21.15.179:6819/2848432339","cluster_addr":"172.21.15.179:6823/2848432339","heartbeat_back_addr":"172.21.15.179:6831/2848432339","heartbeat_front_addr":"172.21.15.179:6827/2848432339","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:58:49.255433+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:58:49.412880+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:58:49.559295+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:58:49.245237+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:58:49.184557+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:58:49.329851+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:58:49.366012+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:58:49.349604+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-28T20:00:31.755 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:31.749+0000 7f9da74d6640 1 -- 172.21.15.78:0/2503303736 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f9d84066470 msgr2=0x7f9d84068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:00:31.755 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:31.749+0000 7f9da74d6640 1 --2- 172.21.15.78:0/2503303736 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f9d84066470 0x7f9d84068930 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f9d9c0ad000 tx=0x7f9d9c0a6000 comp rx=0 tx=0).stop 2023-11-28T20:00:31.755 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:31.749+0000 7f9da74d6640 1 -- 172.21.15.78:0/2503303736 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9da00bf310 msgr2=0x7f9da0153820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:00:31.755 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:31.749+0000 7f9da74d6640 1 --2- 172.21.15.78:0/2503303736 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9da00bf310 0x7f9da0153820 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f9d9000c480 tx=0x7f9d9000c940 comp rx=0 tx=0).stop 2023-11-28T20:00:31.755 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:31.749+0000 7f9da74d6640 1 -- 172.21.15.78:0/2503303736 shutdown_connections 2023-11-28T20:00:31.755 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:31.749+0000 7f9da74d6640 1 --2- 172.21.15.78:0/2503303736 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f9d84066470 0x7f9d84068930 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:31.755 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:31.749+0000 7f9da74d6640 1 --2- 172.21.15.78:0/2503303736 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9da014b2a0 0x7f9da01f0960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:31.755 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:31.749+0000 7f9da74d6640 1 --2- 172.21.15.78:0/2503303736 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9da00bf310 0x7f9da0153820 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:31.756 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:31.749+0000 7f9da74d6640 1 --2- 172.21.15.78:0/2503303736 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9da00bee90 0x7f9da01ecc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:31.756 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:31.749+0000 7f9da74d6640 1 -- 172.21.15.78:0/2503303736 >> 172.21.15.78:0/2503303736 conn(0x7f9da00a7810 msgr2=0x7f9da00a7bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:00:31.756 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:31.749+0000 7f9da74d6640 1 -- 172.21.15.78:0/2503303736 shutdown_connections 2023-11-28T20:00:31.756 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:31.749+0000 7f9da74d6640 1 -- 172.21.15.78:0/2503303736 wait complete. 2023-11-28T20:00:31.775 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs2 standby_count_wanted 0 2023-11-28T20:00:31.914 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:31.909+0000 7fbcf7d80640 1 Processor -- start 2023-11-28T20:00:31.914 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:31.909+0000 7fbcf7d80640 1 -- start start 2023-11-28T20:00:31.918 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:31.909+0000 7fbcf7d80640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fbcf006d840 0x7fbcf00c43e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:31.918 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:31.909+0000 7fbcf7d80640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbcf0152910 con 0x7fbcf014f850 2023-11-28T20:00:31.918 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:31.909+0000 7fbcf7d80640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbcf0152bf0 con 0x7fbcf014fc30 2023-11-28T20:00:31.918 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:31.909+0000 7fbcf7d80640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbcf00c2240 con 0x7fbcf006d840 2023-11-28T20:00:31.918 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:31.909+0000 7fbcf5b1c640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7fbcf014f850 0x7fbcf00aacf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:50212/0 (socket says 172.21.15.78:50212) 2023-11-28T20:00:31.918 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:31.909+0000 7fbcf5b1c640 1 -- 172.21.15.78:0/2695635803 learned_addr learned my addr 172.21.15.78:0/2695635803 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-11-28T20:00:31.919 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:31.909+0000 7fbcf631d640 1 --2- 172.21.15.78:0/2695635803 >> v2:172.21.15.179:3300/0 conn(0x7fbcf006d840 0x7fbcf00c43e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:31.919 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:31.913+0000 7fbcf4b1a640 1 -- 172.21.15.78:0/2695635803 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1118168382 0 0) 0x7fbcf0152910 con 0x7fbcf014f850 2023-11-28T20:00:31.919 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:31.913+0000 7fbcf4b1a640 1 -- 172.21.15.78:0/2695635803 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbcdc003530 con 0x7fbcf014f850 2023-11-28T20:00:31.919 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:31.913+0000 7fbcf4b1a640 1 -- 172.21.15.78:0/2695635803 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 746014460 0 0) 0x7fbcf0152bf0 con 0x7fbcf014fc30 2023-11-28T20:00:31.919 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:31.913+0000 7fbcf4b1a640 1 -- 172.21.15.78:0/2695635803 --> v1:172.21.15.179:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbcf0152910 con 0x7fbcf014fc30 2023-11-28T20:00:31.919 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:31.913+0000 7fbcf4b1a640 1 -- 172.21.15.78:0/2695635803 <== mon.0 v1:172.21.15.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1456285579 0 0) 0x7fbcdc003530 con 0x7fbcf014f850 2023-11-28T20:00:31.919 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:31.913+0000 7fbcf4b1a640 1 -- 172.21.15.78:0/2695635803 >> v2:172.21.15.179:3300/0 conn(0x7fbcf006d840 msgr2=0x7fbcf00c43e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:00:31.919 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:31.913+0000 7fbcf4b1a640 1 --2- 172.21.15.78:0/2695635803 >> v2:172.21.15.179:3300/0 conn(0x7fbcf006d840 0x7fbcf00c43e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:31.919 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:31.913+0000 7fbcf4b1a640 1 -- 172.21.15.78:0/2695635803 >> v1:172.21.15.179:6789/0 conn(0x7fbcf014fc30 legacy=0x7fbcf00c3cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:00:31.919 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:31.913+0000 7fbcf4b1a640 1 -- 172.21.15.78:0/2695635803 --> v1:172.21.15.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbcf0152ed0 con 0x7fbcf014f850 2023-11-28T20:00:31.920 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:31.913+0000 7fbcf4b1a640 1 -- 172.21.15.78:0/2695635803 <== mon.0 v1:172.21.15.78:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3326804700 0 0) 0x7fbcec001680 con 0x7fbcf014f850 2023-11-28T20:00:31.920 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:31.913+0000 7fbcf4b1a640 1 -- 172.21.15.78:0/2695635803 >> v1:172.21.15.78:6789/0 conn(0x7fbcf014f850 legacy=0x7fbcf00aacf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:00:31.920 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:31.913+0000 7fbcf4b1a640 1 --2- 172.21.15.78:0/2695635803 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbcdc003b60 0x7fbcdc003f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:31.920 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:31.913+0000 7fbcf4b1a640 1 --2- 172.21.15.78:0/2695635803 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbcdc0047d0 0x7fbcdc004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:31.920 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:31.913+0000 7fbcf4b1a640 1 --2- 172.21.15.78:0/2695635803 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbcdc005190 0x7fbcdc00b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:31.920 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:31.913+0000 7fbcf4b1a640 1 -- 172.21.15.78:0/2695635803 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbcf00c2240 con 0x7fbcdc003b60 2023-11-28T20:00:31.920 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:31.913+0000 7fbcf4b1a640 1 -- 172.21.15.78:0/2695635803 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbcdc00c060 con 0x7fbcdc0047d0 2023-11-28T20:00:31.920 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:31.913+0000 7fbcf4b1a640 1 -- 172.21.15.78:0/2695635803 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbcdc00c220 con 0x7fbcdc005190 2023-11-28T20:00:31.920 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:31.913+0000 7fbcf631d640 1 --2- 172.21.15.78:0/2695635803 >> v2:172.21.15.179:3300/0 conn(0x7fbcf006d840 0x7fbcf00c43e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T20:00:31.920 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:31.913+0000 7fbcf5b1c640 1 --2- 172.21.15.78:0/2695635803 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbcdc003b60 0x7fbcdc003f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:31.921 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:31.913+0000 7fbcf531b640 1 --2- 172.21.15.78:0/2695635803 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbcdc0047d0 0x7fbcdc004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:31.921 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:31.913+0000 7fbcf631d640 1 --2- 172.21.15.78:0/2695635803 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbcdc005190 0x7fbcdc00b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:31.921 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:31.913+0000 7fbcf5b1c640 1 -- 172.21.15.78:0/2695635803 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbcdc005190 msgr2=0x7fbcdc00b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:00:31.921 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:31.913+0000 7fbcf5b1c640 1 --2- 172.21.15.78:0/2695635803 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbcdc005190 0x7fbcdc00b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:31.921 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:31.913+0000 7fbcf5b1c640 1 -- 172.21.15.78:0/2695635803 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbcdc0047d0 msgr2=0x7fbcdc004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:00:31.921 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:31.913+0000 7fbcf5b1c640 1 --2- 172.21.15.78:0/2695635803 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbcdc0047d0 0x7fbcdc004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:31.921 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:31.913+0000 7fbcf5b1c640 1 -- 172.21.15.78:0/2695635803 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbcdc003530 con 0x7fbcdc003b60 2023-11-28T20:00:31.921 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:31.913+0000 7fbcf631d640 1 --2- 172.21.15.78:0/2695635803 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbcdc005190 0x7fbcdc00b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T20:00:31.921 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:31.913+0000 7fbcf631d640 1 -- 172.21.15.78:0/2695635803 reap_dead start 2023-11-28T20:00:31.922 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:31.913+0000 7fbcf5b1c640 1 --2- 172.21.15.78:0/2695635803 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbcdc003b60 0x7fbcdc003f60 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7fbcec007fb0 tx=0x7fbcec01cb00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=29ff0caf2737e5f6 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:00:31.923 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:31.917+0000 7fbcf4b1a640 1 -- 172.21.15.78:0/2695635803 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbcec0058e0 con 0x7fbcdc003b60 2023-11-28T20:00:31.923 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:31.917+0000 7fbcf4b1a640 1 -- 172.21.15.78:0/2695635803 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbcec005a60 con 0x7fbcdc003b60 2023-11-28T20:00:31.923 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:31.917+0000 7fbcf4b1a640 1 -- 172.21.15.78:0/2695635803 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbcec005e50 con 0x7fbcdc003b60 2023-11-28T20:00:31.923 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:31.917+0000 7fbcf7d80640 1 -- 172.21.15.78:0/2695635803 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbcdc003b60 msgr2=0x7fbcdc003f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:00:31.923 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:31.917+0000 7fbcf7d80640 1 --2- 172.21.15.78:0/2695635803 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbcdc003b60 0x7fbcdc003f60 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7fbcec007fb0 tx=0x7fbcec01cb00 comp rx=0 tx=0).stop 2023-11-28T20:00:31.923 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:31.917+0000 7fbcf7d80640 1 -- 172.21.15.78:0/2695635803 shutdown_connections 2023-11-28T20:00:31.923 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:31.917+0000 7fbcf7d80640 1 --2- 172.21.15.78:0/2695635803 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbcdc003b60 0x7fbcdc003f60 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:31.923 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:31.917+0000 7fbcf7d80640 1 -- 172.21.15.78:0/2695635803 >> 172.21.15.78:0/2695635803 conn(0x7fbcf00c59f0 msgr2=0x7fbcf00c5e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:00:31.923 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:31.917+0000 7fbcf7d80640 1 -- 172.21.15.78:0/2695635803 shutdown_connections 2023-11-28T20:00:31.923 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:31.917+0000 7fbcf7d80640 1 -- 172.21.15.78:0/2695635803 wait complete. 2023-11-28T20:00:31.923 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:31.917+0000 7fbcf7d80640 1 Processor -- start 2023-11-28T20:00:31.924 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:31.917+0000 7fbcf7d80640 1 -- start start 2023-11-28T20:00:31.926 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:31.917+0000 7fbcf7d80640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbcdc003b60 0x7fbcf0153cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:31.926 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:31.917+0000 7fbcf7d80640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbcf0150870 0x7fbcf014ca30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:31.926 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:31.917+0000 7fbcf7d80640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbcf014dbb0 0x7fbcf014cf70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:31.926 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:31.917+0000 7fbcf7d80640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbcf014d680 con 0x7fbcdc003b60 2023-11-28T20:00:31.926 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:31.917+0000 7fbcf7d80640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbcf00724a0 con 0x7fbcf0150870 2023-11-28T20:00:31.926 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:31.917+0000 7fbcf7d80640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbcf014d4b0 con 0x7fbcf014dbb0 2023-11-28T20:00:31.927 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:31.917+0000 7fbcf5b1c640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbcdc003b60 0x7fbcf0153cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:31.927 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:31.917+0000 7fbcf5b1c640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbcdc003b60 0x7fbcf0153cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:45966/0 (socket says 172.21.15.78:45966) 2023-11-28T20:00:31.927 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:31.917+0000 7fbcf5b1c640 1 -- 172.21.15.78:0/4155534356 learned_addr learned my addr 172.21.15.78:0/4155534356 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T20:00:31.927 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:31.917+0000 7fbcf531b640 1 --2- 172.21.15.78:0/4155534356 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbcf0150870 0x7fbcf014ca30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:31.927 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:31.921+0000 7fbcf631d640 1 --2- 172.21.15.78:0/4155534356 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbcf014dbb0 0x7fbcf014cf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:31.927 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:31.921+0000 7fbcf5b1c640 1 -- 172.21.15.78:0/4155534356 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbcf014dbb0 msgr2=0x7fbcf014cf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:00:31.927 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:31.921+0000 7fbcf5b1c640 1 --2- 172.21.15.78:0/4155534356 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbcf014dbb0 0x7fbcf014cf70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:31.927 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:31.921+0000 7fbcf5b1c640 1 -- 172.21.15.78:0/4155534356 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbcf0150870 msgr2=0x7fbcf014ca30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:00:31.927 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:31.921+0000 7fbcf5b1c640 1 --2- 172.21.15.78:0/4155534356 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbcf0150870 0x7fbcf014ca30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:31.927 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:31.921+0000 7fbcf5b1c640 1 -- 172.21.15.78:0/4155534356 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbcf0072930 con 0x7fbcdc003b60 2023-11-28T20:00:31.927 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:31.921+0000 7fbcf531b640 1 --2- 172.21.15.78:0/4155534356 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbcf0150870 0x7fbcf014ca30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T20:00:31.928 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:31.921+0000 7fbcf5b1c640 1 --2- 172.21.15.78:0/4155534356 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbcdc003b60 0x7fbcf0153cd0 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7fbcec01c930 tx=0x7fbcdc005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:00:31.928 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:31.921+0000 7fbce67fc640 1 -- 172.21.15.78:0/4155534356 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbcec0b4070 con 0x7fbcdc003b60 2023-11-28T20:00:31.928 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:31.921+0000 7fbce67fc640 1 -- 172.21.15.78:0/4155534356 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbcec001480 con 0x7fbcdc003b60 2023-11-28T20:00:31.928 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:31.921+0000 7fbce67fc640 1 -- 172.21.15.78:0/4155534356 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbcec005dd0 con 0x7fbcdc003b60 2023-11-28T20:00:31.928 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:31.921+0000 7fbcf7d80640 1 -- 172.21.15.78:0/4155534356 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbcf014d8d0 con 0x7fbcdc003b60 2023-11-28T20:00:31.928 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:31.921+0000 7fbcf7d80640 1 -- 172.21.15.78:0/4155534356 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbcf0154210 con 0x7fbcdc003b60 2023-11-28T20:00:31.928 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:31.921+0000 7fbcf7d80640 1 -- 172.21.15.78:0/4155534356 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbcf0072290 con 0x7fbcdc003b60 2023-11-28T20:00:31.929 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:31.921+0000 7fbce67fc640 1 -- 172.21.15.78:0/4155534356 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fbcec0b7070 con 0x7fbcdc003b60 2023-11-28T20:00:31.930 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:31.921+0000 7fbce67fc640 1 --2- 172.21.15.78:0/4155534356 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fbcd4066470 0x7fbcd4068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:31.931 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:31.921+0000 7fbce67fc640 1 -- 172.21.15.78:0/4155534356 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 6885+0+0 (secure 0 0 0) 0x7fbcec11d400 con 0x7fbcdc003b60 2023-11-28T20:00:31.931 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:31.921+0000 7fbcf531b640 1 --2- 172.21.15.78:0/4155534356 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fbcd4066470 0x7fbcd4068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:31.932 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:31.925+0000 7fbcf531b640 1 --2- 172.21.15.78:0/4155534356 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fbcd4066470 0x7fbcd4068930 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fbcf0150c50 tx=0x7fbce0009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:00:31.933 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:31.925+0000 7fbce67fc640 1 -- 172.21.15.78:0/4155534356 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fbcec0ea340 con 0x7fbcdc003b60 2023-11-28T20:00:32.114 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:32.109+0000 7fbcf7d80640 1 -- 172.21.15.78:0/4155534356 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs2", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7fbcf01526d0 con 0x7fbcdc003b60 2023-11-28T20:00:33.110 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:33.105+0000 7fbce67fc640 1 -- 172.21.15.78:0/4155534356 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs2", "var": "standby_count_wanted", "val": "0"}]=0 v21) v1 ==== 119+0+0 (secure 0 0 0) 0x7fbcf01526d0 con 0x7fbcdc003b60 2023-11-28T20:00:33.113 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:33.109+0000 7fbcf7d80640 1 -- 172.21.15.78:0/4155534356 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fbcd4066470 msgr2=0x7fbcd4068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:00:33.113 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:33.109+0000 7fbcf7d80640 1 --2- 172.21.15.78:0/4155534356 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fbcd4066470 0x7fbcd4068930 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fbcf0150c50 tx=0x7fbce0009040 comp rx=0 tx=0).stop 2023-11-28T20:00:33.113 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:33.109+0000 7fbcf7d80640 1 -- 172.21.15.78:0/4155534356 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbcdc003b60 msgr2=0x7fbcf0153cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:00:33.114 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:33.109+0000 7fbcf7d80640 1 --2- 172.21.15.78:0/4155534356 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbcdc003b60 0x7fbcf0153cd0 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7fbcec01c930 tx=0x7fbcdc005800 comp rx=0 tx=0).stop 2023-11-28T20:00:33.114 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:33.109+0000 7fbcf7d80640 1 -- 172.21.15.78:0/4155534356 shutdown_connections 2023-11-28T20:00:33.114 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:33.109+0000 7fbcf7d80640 1 --2- 172.21.15.78:0/4155534356 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fbcd4066470 0x7fbcd4068930 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:33.114 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:33.109+0000 7fbcf7d80640 1 --2- 172.21.15.78:0/4155534356 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbcf014dbb0 0x7fbcf014cf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:33.114 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:33.109+0000 7fbcf7d80640 1 --2- 172.21.15.78:0/4155534356 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbcf0150870 0x7fbcf014ca30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:33.114 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:33.109+0000 7fbcf7d80640 1 --2- 172.21.15.78:0/4155534356 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbcdc003b60 0x7fbcf0153cd0 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:33.114 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:33.109+0000 7fbcf7d80640 1 -- 172.21.15.78:0/4155534356 >> 172.21.15.78:0/4155534356 conn(0x7fbcf00c59f0 msgr2=0x7fbcf006ce30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:00:33.114 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:33.109+0000 7fbcf7d80640 1 -- 172.21.15.78:0/4155534356 shutdown_connections 2023-11-28T20:00:33.114 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:33.109+0000 7fbcf7d80640 1 -- 172.21.15.78:0/4155534356 wait complete. 2023-11-28T20:00:33.135 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-11-28T20:00:33.135 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs2 allow_standby_replay false 2023-11-28T20:00:33.278 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:33.273+0000 7f8f2f2c8640 1 Processor -- start 2023-11-28T20:00:33.278 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:33.273+0000 7f8f2f2c8640 1 -- start start 2023-11-28T20:00:33.280 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:33.273+0000 7f8f2f2c8640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f8f280a6e70 0x7f8f280c49b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:33.280 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:33.273+0000 7f8f2f2c8640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8f280c6be0 con 0x7f8f280c45d0 2023-11-28T20:00:33.280 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:33.273+0000 7f8f2f2c8640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8f280a7680 con 0x7f8f280c3070 2023-11-28T20:00:33.280 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:33.273+0000 7f8f2f2c8640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8f280c7180 con 0x7f8f280a6e70 2023-11-28T20:00:33.280 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:33.273+0000 7f8f2e2c6640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f8f280c45d0 0x7f8f281542d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:50216/0 (socket says 172.21.15.78:50216) 2023-11-28T20:00:33.280 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:33.273+0000 7f8f2e2c6640 1 -- 172.21.15.78:0/2710814210 learned_addr learned my addr 172.21.15.78:0/2710814210 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-11-28T20:00:33.280 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:33.273+0000 7f8f2dac5640 1 --2- 172.21.15.78:0/2710814210 >> v2:172.21.15.78:3300/0 conn(0x7f8f280a6e70 0x7f8f280c49b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:33.281 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:33.277+0000 7f8f2d2c4640 1 -- 172.21.15.78:0/2710814210 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 206267823 0 0) 0x7f8f280c6be0 con 0x7f8f280c45d0 2023-11-28T20:00:33.281 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:33.277+0000 7f8f2d2c4640 1 -- 172.21.15.78:0/2710814210 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8f14003530 con 0x7f8f280c45d0 2023-11-28T20:00:33.281 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:33.277+0000 7f8f2dac5640 1 -- 172.21.15.78:0/2710814210 >> v1:172.21.15.179:6789/0 conn(0x7f8f280c3070 legacy=0x7f8f2815ebf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:00:33.281 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:33.277+0000 7f8f2dac5640 1 -- 172.21.15.78:0/2710814210 >> v1:172.21.15.78:6789/0 conn(0x7f8f280c45d0 legacy=0x7f8f281542d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:00:33.281 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:33.277+0000 7f8f2dac5640 1 -- 172.21.15.78:0/2710814210 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f280c6ea0 con 0x7f8f280a6e70 2023-11-28T20:00:33.283 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:33.277+0000 7f8f2dac5640 1 --2- 172.21.15.78:0/2710814210 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8f280a6e70 0x7f8f280c49b0 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f8f180097c0 tx=0x7f8f1801c3f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3aece31340ad5de1 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:00:33.283 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:33.277+0000 7f8f2d2c4640 1 -- 172.21.15.78:0/2710814210 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f180ab600 con 0x7f8f280a6e70 2023-11-28T20:00:33.283 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:33.277+0000 7f8f2d2c4640 1 -- 172.21.15.78:0/2710814210 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f180a7050 con 0x7f8f280a6e70 2023-11-28T20:00:33.283 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:33.277+0000 7f8f2d2c4640 1 -- 172.21.15.78:0/2710814210 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f180ab960 con 0x7f8f280a6e70 2023-11-28T20:00:33.284 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:33.277+0000 7f8f2f2c8640 1 -- 172.21.15.78:0/2710814210 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8f280a6e70 msgr2=0x7f8f280c49b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:00:33.284 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:33.277+0000 7f8f2f2c8640 1 --2- 172.21.15.78:0/2710814210 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8f280a6e70 0x7f8f280c49b0 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f8f180097c0 tx=0x7f8f1801c3f0 comp rx=0 tx=0).stop 2023-11-28T20:00:33.284 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:33.281+0000 7f8f2f2c8640 1 -- 172.21.15.78:0/2710814210 shutdown_connections 2023-11-28T20:00:33.284 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:33.281+0000 7f8f2f2c8640 1 --2- 172.21.15.78:0/2710814210 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8f280a6e70 0x7f8f280c49b0 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:33.284 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:33.281+0000 7f8f2f2c8640 1 -- 172.21.15.78:0/2710814210 >> 172.21.15.78:0/2710814210 conn(0x7f8f280c7c60 msgr2=0x7f8f280c8070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:00:33.284 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:33.281+0000 7f8f2f2c8640 1 -- 172.21.15.78:0/2710814210 shutdown_connections 2023-11-28T20:00:33.284 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:33.281+0000 7f8f2f2c8640 1 -- 172.21.15.78:0/2710814210 wait complete. 2023-11-28T20:00:33.285 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:33.281+0000 7f8f2f2c8640 1 Processor -- start 2023-11-28T20:00:33.285 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:33.281+0000 7f8f2f2c8640 1 -- start start 2023-11-28T20:00:33.287 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:33.281+0000 7f8f2f2c8640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8f280a6e70 0x7f8f28146570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:33.288 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:33.281+0000 7f8f2f2c8640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8f280c3070 0x7f8f28155e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:33.288 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:33.281+0000 7f8f2f2c8640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8f280c45d0 0x7f8f28145020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:33.288 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:33.281+0000 7f8f2f2c8640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f2814ce90 con 0x7f8f280c3070 2023-11-28T20:00:33.288 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:33.281+0000 7f8f2f2c8640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f28140c80 con 0x7f8f280c45d0 2023-11-28T20:00:33.288 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:33.281+0000 7f8f2f2c8640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8f28144b20 con 0x7f8f280a6e70 2023-11-28T20:00:33.288 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:33.281+0000 7f8f2dac5640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8f280c3070 0x7f8f28155e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:33.288 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:33.281+0000 7f8f2dac5640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8f280c3070 0x7f8f28155e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:45980/0 (socket says 172.21.15.78:45980) 2023-11-28T20:00:33.288 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:33.281+0000 7f8f2dac5640 1 -- 172.21.15.78:0/625150750 learned_addr learned my addr 172.21.15.78:0/625150750 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T20:00:33.288 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:33.281+0000 7f8f2e2c6640 1 --2- 172.21.15.78:0/625150750 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8f280a6e70 0x7f8f28146570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:33.288 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:33.281+0000 7f8f2eac7640 1 --2- 172.21.15.78:0/625150750 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8f280c45d0 0x7f8f28145020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:33.288 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:33.281+0000 7f8f2dac5640 1 -- 172.21.15.78:0/625150750 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8f280a6e70 msgr2=0x7f8f28146570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:00:33.289 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:33.281+0000 7f8f2dac5640 1 --2- 172.21.15.78:0/625150750 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8f280a6e70 0x7f8f28146570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:33.289 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:33.281+0000 7f8f2dac5640 1 -- 172.21.15.78:0/625150750 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8f280c45d0 msgr2=0x7f8f28145020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:00:33.289 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:33.281+0000 7f8f2dac5640 1 --2- 172.21.15.78:0/625150750 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8f280c45d0 0x7f8f28145020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:33.289 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:33.281+0000 7f8f2dac5640 1 -- 172.21.15.78:0/625150750 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f18009420 con 0x7f8f280c3070 2023-11-28T20:00:33.289 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:33.281+0000 7f8f2eac7640 1 --2- 172.21.15.78:0/625150750 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8f280c45d0 0x7f8f28145020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T20:00:33.289 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:33.281+0000 7f8f2dac5640 1 --2- 172.21.15.78:0/625150750 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8f280c3070 0x7f8f28155e80 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f8f1801a020 tx=0x7f8f18019190 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:00:33.289 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:33.281+0000 7f8f1effd640 1 -- 172.21.15.78:0/625150750 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f18006e20 con 0x7f8f280c3070 2023-11-28T20:00:33.289 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:33.281+0000 7f8f1effd640 1 -- 172.21.15.78:0/625150750 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f18004020 con 0x7f8f280c3070 2023-11-28T20:00:33.289 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:33.281+0000 7f8f1effd640 1 -- 172.21.15.78:0/625150750 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f18004390 con 0x7f8f280c3070 2023-11-28T20:00:33.289 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:33.281+0000 7f8f2f2c8640 1 -- 172.21.15.78:0/625150750 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8f28157da0 con 0x7f8f280c3070 2023-11-28T20:00:33.289 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:33.285+0000 7f8f2f2c8640 1 -- 172.21.15.78:0/625150750 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8f28158360 con 0x7f8f280c3070 2023-11-28T20:00:33.290 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:33.285+0000 7f8f2f2c8640 1 -- 172.21.15.78:0/625150750 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8f280c2ee0 con 0x7f8f280c3070 2023-11-28T20:00:33.290 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:33.285+0000 7f8f1effd640 1 -- 172.21.15.78:0/625150750 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f8f180b2040 con 0x7f8f280c3070 2023-11-28T20:00:33.290 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:33.285+0000 7f8f1effd640 1 --2- 172.21.15.78:0/625150750 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f8f0c066470 0x7f8f0c068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:33.291 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:33.285+0000 7f8f1effd640 1 -- 172.21.15.78:0/625150750 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 6885+0+0 (secure 0 0 0) 0x7f8f1811e220 con 0x7f8f280c3070 2023-11-28T20:00:33.291 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:33.285+0000 7f8f2e2c6640 1 --2- 172.21.15.78:0/625150750 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f8f0c066470 0x7f8f0c068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:33.291 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:33.285+0000 7f8f2e2c6640 1 --2- 172.21.15.78:0/625150750 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f8f0c066470 0x7f8f0c068930 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f8f240011f0 tx=0x7f8f24009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:00:33.294 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:33.289+0000 7f8f1effd640 1 -- 172.21.15.78:0/625150750 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f8f180eb160 con 0x7f8f280c3070 2023-11-28T20:00:33.476 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:33.473+0000 7f8f2f2c8640 1 -- 172.21.15.78:0/625150750 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs2", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f8f28144ce0 con 0x7f8f280c3070 2023-11-28T20:00:34.117 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:34.113+0000 7f8f1effd640 1 -- 172.21.15.78:0/625150750 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs2", "var": "allow_standby_replay", "val": "false"}]=0 v22) v1 ==== 123+0+0 (secure 0 0 0) 0x7f8f180044f0 con 0x7f8f280c3070 2023-11-28T20:00:34.119 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:34.113+0000 7f8f2f2c8640 1 -- 172.21.15.78:0/625150750 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f8f0c066470 msgr2=0x7f8f0c068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:00:34.119 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:34.113+0000 7f8f2f2c8640 1 --2- 172.21.15.78:0/625150750 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f8f0c066470 0x7f8f0c068930 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f8f240011f0 tx=0x7f8f24009040 comp rx=0 tx=0).stop 2023-11-28T20:00:34.120 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:34.113+0000 7f8f2f2c8640 1 -- 172.21.15.78:0/625150750 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8f280c3070 msgr2=0x7f8f28155e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:00:34.120 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:34.113+0000 7f8f2f2c8640 1 --2- 172.21.15.78:0/625150750 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8f280c3070 0x7f8f28155e80 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f8f1801a020 tx=0x7f8f18019190 comp rx=0 tx=0).stop 2023-11-28T20:00:34.120 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:34.113+0000 7f8f2f2c8640 1 -- 172.21.15.78:0/625150750 shutdown_connections 2023-11-28T20:00:34.120 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:34.113+0000 7f8f2f2c8640 1 --2- 172.21.15.78:0/625150750 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f8f0c066470 0x7f8f0c068930 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:34.120 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:34.113+0000 7f8f2f2c8640 1 --2- 172.21.15.78:0/625150750 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8f280c45d0 0x7f8f28145020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:34.120 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:34.113+0000 7f8f2f2c8640 1 --2- 172.21.15.78:0/625150750 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8f280c3070 0x7f8f28155e80 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:34.120 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:34.113+0000 7f8f2f2c8640 1 --2- 172.21.15.78:0/625150750 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8f280a6e70 0x7f8f28146570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:34.120 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:34.113+0000 7f8f2f2c8640 1 -- 172.21.15.78:0/625150750 >> 172.21.15.78:0/625150750 conn(0x7f8f280c7c60 msgr2=0x7f8f281498a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:00:34.120 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:34.113+0000 7f8f2f2c8640 1 -- 172.21.15.78:0/625150750 shutdown_connections 2023-11-28T20:00:34.120 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:34.113+0000 7f8f2f2c8640 1 -- 172.21.15.78:0/625150750 wait complete. 2023-11-28T20:00:34.140 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs2' 2023-11-28T20:00:34.140 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-28T20:00:34.231 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T20:00:34.235 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T20:00:34.279 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:34.273+0000 7f27939df640 1 Processor -- start 2023-11-28T20:00:34.279 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:34.273+0000 7f27939df640 1 -- start start 2023-11-28T20:00:34.281 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:34.277+0000 7f27939df640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f278c06d2b0 0x7f278c06d690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:34.281 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:34.277+0000 7f27939df640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f278c06bb80 con 0x7f278c0c3b80 2023-11-28T20:00:34.281 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:34.277+0000 7f27939df640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f278c0c5790 con 0x7f278c0c5300 2023-11-28T20:00:34.281 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:34.277+0000 7f27939df640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f278c1515c0 con 0x7f278c06d2b0 2023-11-28T20:00:34.281 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:34.277+0000 7f2790f7a640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f278c0c3b80 0x7f278c06c020 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:50222/0 (socket says 172.21.15.78:50222) 2023-11-28T20:00:34.281 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:34.277+0000 7f2790f7a640 1 -- 172.21.15.78:0/2043980570 learned_addr learned my addr 172.21.15.78:0/2043980570 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-11-28T20:00:34.282 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:34.277+0000 7f279177b640 1 --2- 172.21.15.78:0/2043980570 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f278c06d2b0 0x7f278c06d690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:34.283 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:34.277+0000 7f2783fff640 1 -- 172.21.15.78:0/2043980570 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1019707558 0 0) 0x7f278c06bb80 con 0x7f278c0c3b80 2023-11-28T20:00:34.283 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:34.277+0000 7f2783fff640 1 -- 172.21.15.78:0/2043980570 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2778003530 con 0x7f278c0c3b80 2023-11-28T20:00:34.283 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:34.277+0000 7f2783fff640 1 -- 172.21.15.78:0/2043980570 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1678091231 0 0) 0x7f278c0c5790 con 0x7f278c0c5300 2023-11-28T20:00:34.284 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:34.277+0000 7f2783fff640 1 -- 172.21.15.78:0/2043980570 --> v1:172.21.15.179:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f278c06bb80 con 0x7f278c0c5300 2023-11-28T20:00:34.284 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:34.277+0000 7f2783fff640 1 -- 172.21.15.78:0/2043980570 <== mon.0 v1:172.21.15.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 49120530 0 0) 0x7f2778003530 con 0x7f278c0c3b80 2023-11-28T20:00:34.284 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:34.277+0000 7f279177b640 1 -- 172.21.15.78:0/2043980570 >> v1:172.21.15.179:6789/0 conn(0x7f278c0c5300 legacy=0x7f278c06c730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:00:34.284 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:34.277+0000 7f279177b640 1 -- 172.21.15.78:0/2043980570 >> v1:172.21.15.78:6789/0 conn(0x7f278c0c3b80 legacy=0x7f278c06c020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:00:34.284 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:34.277+0000 7f279177b640 1 -- 172.21.15.78:0/2043980570 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f278c1518a0 con 0x7f278c06d2b0 2023-11-28T20:00:34.286 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:34.281+0000 7f279177b640 1 --2- 172.21.15.78:0/2043980570 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f278c06d2b0 0x7f278c06d690 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f27880097f0 tx=0x7f278801c3b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7700b9b6c5401636 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:00:34.286 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:34.281+0000 7f2783fff640 1 -- 172.21.15.78:0/2043980570 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f277c001680 con 0x7f278c06d2b0 2023-11-28T20:00:34.286 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:34.281+0000 7f2783fff640 1 -- 172.21.15.78:0/2043980570 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f27880a7050 con 0x7f278c06d2b0 2023-11-28T20:00:34.286 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:34.281+0000 7f2783fff640 1 -- 172.21.15.78:0/2043980570 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27880ab620 con 0x7f278c06d2b0 2023-11-28T20:00:34.287 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:34.281+0000 7f27939df640 1 -- 172.21.15.78:0/2043980570 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f278c06d2b0 msgr2=0x7f278c06d690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:00:34.287 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:34.281+0000 7f27939df640 1 --2- 172.21.15.78:0/2043980570 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f278c06d2b0 0x7f278c06d690 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f27880097f0 tx=0x7f278801c3b0 comp rx=0 tx=0).stop 2023-11-28T20:00:34.287 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:34.281+0000 7f27939df640 1 -- 172.21.15.78:0/2043980570 shutdown_connections 2023-11-28T20:00:34.287 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:34.281+0000 7f27939df640 1 --2- 172.21.15.78:0/2043980570 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f278c06d2b0 0x7f278c06d690 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:34.287 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:34.281+0000 7f27939df640 1 -- 172.21.15.78:0/2043980570 >> 172.21.15.78:0/2043980570 conn(0x7f278c0a7810 msgr2=0x7f278c0a7c20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:00:34.287 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:34.281+0000 7f27939df640 1 -- 172.21.15.78:0/2043980570 shutdown_connections 2023-11-28T20:00:34.287 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:34.281+0000 7f27939df640 1 -- 172.21.15.78:0/2043980570 wait complete. 2023-11-28T20:00:34.291 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:34.281+0000 7f27939df640 1 Processor -- start 2023-11-28T20:00:34.291 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:34.285+0000 7f27939df640 1 -- start start 2023-11-28T20:00:34.291 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:34.285+0000 7f27939df640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f278c06d2b0 0x7f278c149200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:34.291 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:34.285+0000 7f27939df640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f278c0c3b80 0x7f278c15c1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:34.292 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:34.285+0000 7f27939df640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f278c0c5300 0x7f278c14d340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:34.292 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:34.285+0000 7f27939df640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f278c14cf20 con 0x7f278c0c5300 2023-11-28T20:00:34.292 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:34.285+0000 7f27939df640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f278c1eb270 con 0x7f278c06d2b0 2023-11-28T20:00:34.292 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:34.285+0000 7f27939df640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f278c1eb7a0 con 0x7f278c0c3b80 2023-11-28T20:00:34.292 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:34.285+0000 7f2791f7c640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f278c0c5300 0x7f278c14d340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:34.292 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:34.285+0000 7f2791f7c640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f278c0c5300 0x7f278c14d340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:45982/0 (socket says 172.21.15.78:45982) 2023-11-28T20:00:34.293 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:34.285+0000 7f2791f7c640 1 -- 172.21.15.78:0/3910906675 learned_addr learned my addr 172.21.15.78:0/3910906675 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T20:00:34.293 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:34.285+0000 7f279177b640 1 --2- 172.21.15.78:0/3910906675 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f278c06d2b0 0x7f278c149200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:34.293 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:34.285+0000 7f2790f7a640 1 --2- 172.21.15.78:0/3910906675 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f278c0c3b80 0x7f278c15c1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:34.293 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:34.285+0000 7f2791f7c640 1 -- 172.21.15.78:0/3910906675 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f278c0c3b80 msgr2=0x7f278c15c1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:00:34.293 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:34.285+0000 7f2791f7c640 1 --2- 172.21.15.78:0/3910906675 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f278c0c3b80 0x7f278c15c1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:34.294 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:34.285+0000 7f2791f7c640 1 -- 172.21.15.78:0/3910906675 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f278c06d2b0 msgr2=0x7f278c149200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:00:34.294 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:34.285+0000 7f2791f7c640 1 --2- 172.21.15.78:0/3910906675 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f278c06d2b0 0x7f278c149200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:34.294 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:34.285+0000 7f2791f7c640 1 -- 172.21.15.78:0/3910906675 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2788009420 con 0x7f278c0c5300 2023-11-28T20:00:34.294 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:34.285+0000 7f2790f7a640 1 --2- 172.21.15.78:0/3910906675 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f278c0c3b80 0x7f278c15c1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T20:00:34.294 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:34.285+0000 7f2791f7c640 1 --2- 172.21.15.78:0/3910906675 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f278c0c5300 0x7f278c14d340 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f278400c760 tx=0x7f278400cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:00:34.294 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:34.285+0000 7f2781ffb640 1 -- 172.21.15.78:0/3910906675 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2784003b80 con 0x7f278c0c5300 2023-11-28T20:00:34.295 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:34.285+0000 7f2781ffb640 1 -- 172.21.15.78:0/3910906675 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2784003ce0 con 0x7f278c0c5300 2023-11-28T20:00:34.295 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:34.285+0000 7f27939df640 1 -- 172.21.15.78:0/3910906675 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f278c14ef80 con 0x7f278c0c5300 2023-11-28T20:00:34.295 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:34.285+0000 7f2781ffb640 1 -- 172.21.15.78:0/3910906675 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f278400aa90 con 0x7f278c0c5300 2023-11-28T20:00:34.295 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:34.285+0000 7f27939df640 1 -- 172.21.15.78:0/3910906675 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f278c0a8ab0 con 0x7f278c0c5300 2023-11-28T20:00:34.295 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:34.285+0000 7f27939df640 1 -- 172.21.15.78:0/3910906675 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f278c067630 con 0x7f278c0c5300 2023-11-28T20:00:34.297 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:34.289+0000 7f2781ffb640 1 -- 172.21.15.78:0/3910906675 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f278400abf0 con 0x7f278c0c5300 2023-11-28T20:00:34.297 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:34.289+0000 7f2781ffb640 1 --2- 172.21.15.78:0/3910906675 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f27700664a0 0x7f2770068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:34.298 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:34.289+0000 7f2781ffb640 1 -- 172.21.15.78:0/3910906675 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 6885+0+0 (secure 0 0 0) 0x7f2784084050 con 0x7f278c0c5300 2023-11-28T20:00:34.298 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:34.289+0000 7f279177b640 1 --2- 172.21.15.78:0/3910906675 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f27700664a0 0x7f2770068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:34.298 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:34.289+0000 7f279177b640 1 --2- 172.21.15.78:0/3910906675 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f27700664a0 0x7f2770068960 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f27880ad000 tx=0x7f2788008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:00:34.298 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:34.293+0000 7f2781ffb640 1 -- 172.21.15.78:0/3910906675 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f27840b5280 con 0x7f278c0c5300 2023-11-28T20:00:34.475 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:34.469+0000 7f27939df640 1 -- 172.21.15.78:0/3910906675 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f278c06bd70 con 0x7f278c0c5300 2023-11-28T20:00:34.476 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:34.473+0000 7f2781ffb640 1 -- 172.21.15.78:0/3910906675 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 22 v22) v1 ==== 94+0+6127 (secure 0 0 0) 0x7f2784051020 con 0x7f278c0c5300 2023-11-28T20:00:34.476 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-11-28T20:00:34.476 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":22,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4880,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6835/20894428","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6834","nonce":20894428},{"type":"v1","addr":"172.21.15.179:6835","nonce":20894428}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":4886,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6837/666703170","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6835","nonce":666703170},{"type":"v1","addr":"172.21.15.78:6837","nonce":666703170}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-28T20:00:13.162273+0000","modified":"2023-11-28T20:00:16.174263+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5185},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5185":{"gid":5185,"name":"c","rank":0,"incarnation":13,"state":"up:active","state_seq":4,"addr":"172.21.15.78:6836/3508383403","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6834","nonce":3508383403},{"type":"v1","addr":"172.21.15.78:6836","nonce":3508383403}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2},{"mdsmap":{"epoch":22,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-28T20:00:30.436267+0000","modified":"2023-11-28T20:00:33.475772+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5179},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5179":{"gid":5179,"name":"b","rank":0,"incarnation":18,"state":"up:active","state_seq":8,"addr":"172.21.15.179:6833/3446403084","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6832","nonce":3446403084},{"type":"v1","addr":"172.21.15.179:6833","nonce":3446403084}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs2","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2023-11-28T20:00:34.477 INFO:teuthology.orchestra.run.smithi078.stderr:dumped fsmap epoch 22 2023-11-28T20:00:34.478 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:34.473+0000 7f27939df640 1 -- 172.21.15.78:0/3910906675 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f27700664a0 msgr2=0x7f2770068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:00:34.478 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:34.473+0000 7f27939df640 1 --2- 172.21.15.78:0/3910906675 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f27700664a0 0x7f2770068960 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f27880ad000 tx=0x7f2788008040 comp rx=0 tx=0).stop 2023-11-28T20:00:34.479 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:34.473+0000 7f27939df640 1 -- 172.21.15.78:0/3910906675 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f278c0c5300 msgr2=0x7f278c14d340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:00:34.479 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:34.473+0000 7f27939df640 1 --2- 172.21.15.78:0/3910906675 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f278c0c5300 0x7f278c14d340 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f278400c760 tx=0x7f278400cc20 comp rx=0 tx=0).stop 2023-11-28T20:00:34.479 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:34.473+0000 7f27939df640 1 -- 172.21.15.78:0/3910906675 shutdown_connections 2023-11-28T20:00:34.479 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:34.473+0000 7f27939df640 1 --2- 172.21.15.78:0/3910906675 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f27700664a0 0x7f2770068960 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:34.479 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:34.473+0000 7f27939df640 1 --2- 172.21.15.78:0/3910906675 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f278c0c3b80 0x7f278c15c1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:34.479 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:34.473+0000 7f27939df640 1 --2- 172.21.15.78:0/3910906675 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f278c0c5300 0x7f278c14d340 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:34.479 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:34.473+0000 7f27939df640 1 --2- 172.21.15.78:0/3910906675 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f278c06d2b0 0x7f278c149200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:34.479 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:34.473+0000 7f27939df640 1 -- 172.21.15.78:0/3910906675 >> 172.21.15.78:0/3910906675 conn(0x7f278c0a7810 msgr2=0x7f278c0a7bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:00:34.479 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:34.473+0000 7f27939df640 1 -- 172.21.15.78:0/3910906675 shutdown_connections 2023-11-28T20:00:34.479 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:34.473+0000 7f27939df640 1 -- 172.21.15.78:0/3910906675 wait complete. 2023-11-28T20:00:34.497 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-28T20:00:34.677 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:34.673+0000 7ff1aacd6640 1 Processor -- start 2023-11-28T20:00:34.677 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:34.673+0000 7ff1aacd6640 1 -- start start 2023-11-28T20:00:34.678 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:34.673+0000 7ff1aacd6640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7ff1a40c49c0 0x7ff1a40c4da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:34.678 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:34.673+0000 7ff1aacd6640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7ff1a40c59a0 0x7ff1a40c8990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:34.678 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:34.673+0000 7ff1aacd6640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff1a40c62b0 con 0x7ff1a40bf690 2023-11-28T20:00:34.679 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:34.673+0000 7ff1aacd6640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff1a40c6590 con 0x7ff1a40c49c0 2023-11-28T20:00:34.679 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:34.673+0000 7ff1aacd6640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff1a41588d0 con 0x7ff1a40c59a0 2023-11-28T20:00:34.679 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:34.673+0000 7ff1a8a72640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7ff1a40c49c0 0x7ff1a40c4da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:34.679 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:34.673+0000 7ff1a8a72640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7ff1a40c49c0 0x7ff1a40c4da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:45998/0 (socket says 172.21.15.78:45998) 2023-11-28T20:00:34.679 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:34.673+0000 7ff1a8a72640 1 -- 172.21.15.78:0/1240540761 learned_addr learned my addr 172.21.15.78:0/1240540761 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T20:00:34.679 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:34.673+0000 7ff19bfff640 1 --1- 172.21.15.78:0/1240540761 >> v1:172.21.15.78:6789/0 conn(0x7ff1a40bf690 0x7ff1a40c8280 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:50226/0 (socket says 172.21.15.78:50226) 2023-11-28T20:00:34.679 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:34.673+0000 7ff1a8a72640 1 -- 172.21.15.78:0/1240540761 >> v2:172.21.15.179:3300/0 conn(0x7ff1a40c59a0 msgr2=0x7ff1a40c8990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:00:34.680 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:34.673+0000 7ff1a8a72640 1 --2- 172.21.15.78:0/1240540761 >> v2:172.21.15.179:3300/0 conn(0x7ff1a40c59a0 0x7ff1a40c8990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:34.680 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:34.673+0000 7ff1a8a72640 1 -- 172.21.15.78:0/1240540761 >> v1:172.21.15.78:6789/0 conn(0x7ff1a40bf690 legacy=0x7ff1a40c8280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:00:34.680 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:34.673+0000 7ff1a8a72640 1 -- 172.21.15.78:0/1240540761 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1a40c7d60 con 0x7ff1a40c49c0 2023-11-28T20:00:34.682 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:34.677+0000 7ff1a8a72640 1 --2- 172.21.15.78:0/1240540761 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff1a40c49c0 0x7ff1a40c4da0 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7ff1a40c7880 tx=0x7ff1a001c390 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2a0ba94e1f0288f9 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:00:34.682 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:34.677+0000 7ff19b7fe640 1 -- 172.21.15.78:0/1240540761 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1a00ab600 con 0x7ff1a40c49c0 2023-11-28T20:00:34.682 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:34.677+0000 7ff19b7fe640 1 -- 172.21.15.78:0/1240540761 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff1a00a7050 con 0x7ff1a40c49c0 2023-11-28T20:00:34.682 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:34.677+0000 7ff19b7fe640 1 -- 172.21.15.78:0/1240540761 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1a00ab980 con 0x7ff1a40c49c0 2023-11-28T20:00:34.683 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:34.677+0000 7ff1aacd6640 1 -- 172.21.15.78:0/1240540761 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff1a40c49c0 msgr2=0x7ff1a40c4da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:00:34.683 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:34.677+0000 7ff1aacd6640 1 --2- 172.21.15.78:0/1240540761 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff1a40c49c0 0x7ff1a40c4da0 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7ff1a40c7880 tx=0x7ff1a001c390 comp rx=0 tx=0).stop 2023-11-28T20:00:34.684 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:34.677+0000 7ff1aacd6640 1 -- 172.21.15.78:0/1240540761 shutdown_connections 2023-11-28T20:00:34.684 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:34.677+0000 7ff1aacd6640 1 --2- 172.21.15.78:0/1240540761 >> v2:172.21.15.179:3300/0 conn(0x7ff1a40c59a0 0x7ff1a40c8990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:34.684 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:34.677+0000 7ff1aacd6640 1 --2- 172.21.15.78:0/1240540761 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff1a40c49c0 0x7ff1a40c4da0 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:34.684 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:34.677+0000 7ff1aacd6640 1 -- 172.21.15.78:0/1240540761 >> 172.21.15.78:0/1240540761 conn(0x7ff1a40c6840 msgr2=0x7ff1a40c6c50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:00:34.685 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:34.677+0000 7ff1aacd6640 1 -- 172.21.15.78:0/1240540761 shutdown_connections 2023-11-28T20:00:34.685 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:34.677+0000 7ff1aacd6640 1 -- 172.21.15.78:0/1240540761 wait complete. 2023-11-28T20:00:34.687 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:34.681+0000 7ff1aacd6640 1 Processor -- start 2023-11-28T20:00:34.687 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:34.681+0000 7ff1aacd6640 1 -- start start 2023-11-28T20:00:34.687 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:34.681+0000 7ff1aacd6640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff1a40bf690 0x7ff1a41ea9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:34.687 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:34.681+0000 7ff1aacd6640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff1a40c49c0 0x7ff1a41e3f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:34.687 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:34.681+0000 7ff1aacd6640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff1a40c59a0 0x7ff1a4148b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:34.687 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:34.681+0000 7ff1aacd6640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1a4157090 con 0x7ff1a40c49c0 2023-11-28T20:00:34.687 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:34.681+0000 7ff1aacd6640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1a4157b80 con 0x7ff1a40bf690 2023-11-28T20:00:34.687 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:34.681+0000 7ff1aacd6640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff1a41ed6a0 con 0x7ff1a40c59a0 2023-11-28T20:00:34.688 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:34.681+0000 7ff19bfff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff1a40c49c0 0x7ff1a41e3f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:34.688 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:34.681+0000 7ff19bfff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff1a40c49c0 0x7ff1a41e3f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:46008/0 (socket says 172.21.15.78:46008) 2023-11-28T20:00:34.688 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:34.681+0000 7ff19bfff640 1 -- 172.21.15.78:0/3507807392 learned_addr learned my addr 172.21.15.78:0/3507807392 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T20:00:34.688 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:34.681+0000 7ff1a9273640 1 --2- 172.21.15.78:0/3507807392 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff1a40c59a0 0x7ff1a4148b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:34.688 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:34.681+0000 7ff1a8a72640 1 --2- 172.21.15.78:0/3507807392 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff1a40bf690 0x7ff1a41ea9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:34.688 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:34.681+0000 7ff19bfff640 1 -- 172.21.15.78:0/3507807392 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff1a40c59a0 msgr2=0x7ff1a4148b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:00:34.688 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:34.681+0000 7ff19bfff640 1 --2- 172.21.15.78:0/3507807392 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff1a40c59a0 0x7ff1a4148b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:34.688 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:34.681+0000 7ff19bfff640 1 -- 172.21.15.78:0/3507807392 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff1a40bf690 msgr2=0x7ff1a41ea9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:00:34.689 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:34.681+0000 7ff19bfff640 1 --2- 172.21.15.78:0/3507807392 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff1a40bf690 0x7ff1a41ea9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:34.689 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:34.681+0000 7ff19bfff640 1 -- 172.21.15.78:0/3507807392 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1a00094d0 con 0x7ff1a40c49c0 2023-11-28T20:00:34.689 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:34.681+0000 7ff19bfff640 1 --2- 172.21.15.78:0/3507807392 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff1a40c49c0 0x7ff1a41e3f80 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7ff194009ef0 tx=0x7ff19400c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:00:34.689 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:34.681+0000 7ff1997fa640 1 -- 172.21.15.78:0/3507807392 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff194007a30 con 0x7ff1a40c49c0 2023-11-28T20:00:34.689 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:34.681+0000 7ff1997fa640 1 -- 172.21.15.78:0/3507807392 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff194007b90 con 0x7ff1a40c49c0 2023-11-28T20:00:34.690 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:34.681+0000 7ff1997fa640 1 -- 172.21.15.78:0/3507807392 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff19400ce70 con 0x7ff1a40c49c0 2023-11-28T20:00:34.690 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:34.681+0000 7ff1aacd6640 1 -- 172.21.15.78:0/3507807392 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff1a41eaef0 con 0x7ff1a40c49c0 2023-11-28T20:00:34.690 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:34.681+0000 7ff1aacd6640 1 -- 172.21.15.78:0/3507807392 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff1a41575c0 con 0x7ff1a40c49c0 2023-11-28T20:00:34.691 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:34.685+0000 7ff1aacd6640 1 -- 172.21.15.78:0/3507807392 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff1a406d5c0 con 0x7ff1a40c49c0 2023-11-28T20:00:34.691 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:34.685+0000 7ff1997fa640 1 -- 172.21.15.78:0/3507807392 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7ff194009070 con 0x7ff1a40c49c0 2023-11-28T20:00:34.691 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:34.685+0000 7ff1997fa640 1 --2- 172.21.15.78:0/3507807392 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7ff1900664a0 0x7ff190068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:34.691 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:34.685+0000 7ff1997fa640 1 -- 172.21.15.78:0/3507807392 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 6885+0+0 (secure 0 0 0) 0x7ff1940861d0 con 0x7ff1a40c49c0 2023-11-28T20:00:34.691 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:34.685+0000 7ff1a8a72640 1 --2- 172.21.15.78:0/3507807392 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7ff1900664a0 0x7ff190068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:34.691 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:34.685+0000 7ff1a8a72640 1 --2- 172.21.15.78:0/3507807392 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7ff1900664a0 0x7ff190068960 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7ff1a00ad000 tx=0x7ff1a00a6000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:00:34.693 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:34.689+0000 7ff1997fa640 1 -- 172.21.15.78:0/3507807392 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7ff194053250 con 0x7ff1a40c49c0 2023-11-28T20:00:34.845 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:34.841+0000 7ff1aacd6640 1 -- 172.21.15.78:0/3507807392 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff1a4067630 con 0x7ff1a40c49c0 2023-11-28T20:00:34.847 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:34.841+0000 7ff1997fa640 1 -- 172.21.15.78:0/3507807392 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v44) v1 ==== 74+0+20466 (secure 0 0 0) 0x7ff194056870 con 0x7ff1a40c49c0 2023-11-28T20:00:34.847 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-11-28T20:00:34.847 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":44,"fsid":"dd9780e8-3bda-44fa-a9f0-fa07d19d901d","created":"2023-11-28T19:58:40.969556+0000","modified":"2023-11-28T20:00:31.764388+0000","last_up_change":"2023-11-28T19:58:52.596716+0000","last_in_change":"2023-11-28T19:58:43.609275+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-28T19:58:54.011229+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2023-11-28T20:00:10.831194+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"39","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2023-11-28T20:00:12.150184+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"40","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs2_metadata","create_time":"2023-11-28T20:00:28.571896+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"43","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs2_data","create_time":"2023-11-28T20:00:29.436453+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"44","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs2"}},"read_balance":{"score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e84245ac-b5da-429e-af18-39acaa2b33e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6800","nonce":3358701235},{"type":"v1","addr":"172.21.15.78:6801","nonce":3358701235}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6802","nonce":3358701235},{"type":"v1","addr":"172.21.15.78:6803","nonce":3358701235}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6806","nonce":3358701235},{"type":"v1","addr":"172.21.15.78:6807","nonce":3358701235}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6804","nonce":3358701235},{"type":"v1","addr":"172.21.15.78:6805","nonce":3358701235}]},"public_addr":"172.21.15.78:6801/3358701235","cluster_addr":"172.21.15.78:6803/3358701235","heartbeat_back_addr":"172.21.15.78:6807/3358701235","heartbeat_front_addr":"172.21.15.78:6805/3358701235","state":["exists","up"]},{"osd":1,"uuid":"e634831d-c4e2-48d9-870c-9556ae162981","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6808","nonce":3211476654},{"type":"v1","addr":"172.21.15.78:6809","nonce":3211476654}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6810","nonce":3211476654},{"type":"v1","addr":"172.21.15.78:6811","nonce":3211476654}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6814","nonce":3211476654},{"type":"v1","addr":"172.21.15.78:6815","nonce":3211476654}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6812","nonce":3211476654},{"type":"v1","addr":"172.21.15.78:6813","nonce":3211476654}]},"public_addr":"172.21.15.78:6809/3211476654","cluster_addr":"172.21.15.78:6811/3211476654","heartbeat_back_addr":"172.21.15.78:6815/3211476654","heartbeat_front_addr":"172.21.15.78:6813/3211476654","state":["exists","up"]},{"osd":2,"uuid":"274c8395-6534-41f0-b8fb-a00af8985aa8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6816","nonce":2532904479},{"type":"v1","addr":"172.21.15.78:6817","nonce":2532904479}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6818","nonce":2532904479},{"type":"v1","addr":"172.21.15.78:6819","nonce":2532904479}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6822","nonce":2532904479},{"type":"v1","addr":"172.21.15.78:6823","nonce":2532904479}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6820","nonce":2532904479},{"type":"v1","addr":"172.21.15.78:6821","nonce":2532904479}]},"public_addr":"172.21.15.78:6817/2532904479","cluster_addr":"172.21.15.78:6819/2532904479","heartbeat_back_addr":"172.21.15.78:6823/2532904479","heartbeat_front_addr":"172.21.15.78:6821/2532904479","state":["exists","up"]},{"osd":3,"uuid":"77acc9af-7d4d-4b18-8cf5-d62f5971b7c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6824","nonce":3442991267},{"type":"v1","addr":"172.21.15.78:6825","nonce":3442991267}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6826","nonce":3442991267},{"type":"v1","addr":"172.21.15.78:6827","nonce":3442991267}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6830","nonce":3442991267},{"type":"v1","addr":"172.21.15.78:6831","nonce":3442991267}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6828","nonce":3442991267},{"type":"v1","addr":"172.21.15.78:6829","nonce":3442991267}]},"public_addr":"172.21.15.78:6825/3442991267","cluster_addr":"172.21.15.78:6827/3442991267","heartbeat_back_addr":"172.21.15.78:6831/3442991267","heartbeat_front_addr":"172.21.15.78:6829/3442991267","state":["exists","up"]},{"osd":4,"uuid":"5c62bc66-6b34-4b7f-a66b-9a743969138c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":802983577},{"type":"v1","addr":"172.21.15.179:6809","nonce":802983577}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":802983577},{"type":"v1","addr":"172.21.15.179:6811","nonce":802983577}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":802983577},{"type":"v1","addr":"172.21.15.179:6815","nonce":802983577}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":802983577},{"type":"v1","addr":"172.21.15.179:6813","nonce":802983577}]},"public_addr":"172.21.15.179:6809/802983577","cluster_addr":"172.21.15.179:6811/802983577","heartbeat_back_addr":"172.21.15.179:6815/802983577","heartbeat_front_addr":"172.21.15.179:6813/802983577","state":["exists","up"]},{"osd":5,"uuid":"67db6d36-f684-4079-b0cd-82b4dd61461f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":518192887},{"type":"v1","addr":"172.21.15.179:6818","nonce":518192887}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":518192887},{"type":"v1","addr":"172.21.15.179:6822","nonce":518192887}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":518192887},{"type":"v1","addr":"172.21.15.179:6829","nonce":518192887}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6824","nonce":518192887},{"type":"v1","addr":"172.21.15.179:6826","nonce":518192887}]},"public_addr":"172.21.15.179:6818/518192887","cluster_addr":"172.21.15.179:6822/518192887","heartbeat_back_addr":"172.21.15.179:6829/518192887","heartbeat_front_addr":"172.21.15.179:6826/518192887","state":["exists","up"]},{"osd":6,"uuid":"12e670af-5a16-4c81-9f97-defa66cab967","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":815435378},{"type":"v1","addr":"172.21.15.179:6801","nonce":815435378}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":815435378},{"type":"v1","addr":"172.21.15.179:6803","nonce":815435378}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":815435378},{"type":"v1","addr":"172.21.15.179:6807","nonce":815435378}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":815435378},{"type":"v1","addr":"172.21.15.179:6805","nonce":815435378}]},"public_addr":"172.21.15.179:6801/815435378","cluster_addr":"172.21.15.179:6803/815435378","heartbeat_back_addr":"172.21.15.179:6807/815435378","heartbeat_front_addr":"172.21.15.179:6805/815435378","state":["exists","up"]},{"osd":7,"uuid":"fe630650-2eb3-49ad-8676-c341e6332eb1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6817","nonce":2848432339},{"type":"v1","addr":"172.21.15.179:6819","nonce":2848432339}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6821","nonce":2848432339},{"type":"v1","addr":"172.21.15.179:6823","nonce":2848432339}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":2848432339},{"type":"v1","addr":"172.21.15.179:6831","nonce":2848432339}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6825","nonce":2848432339},{"type":"v1","addr":"172.21.15.179:6827","nonce":2848432339}]},"public_addr":"172.21.15.179:6819/2848432339","cluster_addr":"172.21.15.179:6823/2848432339","heartbeat_back_addr":"172.21.15.179:6831/2848432339","heartbeat_front_addr":"172.21.15.179:6827/2848432339","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:58:49.255433+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:58:49.412880+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:58:49.559295+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:58:49.245237+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:58:49.184557+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:58:49.329851+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:58:49.366012+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:58:49.349604+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-28T20:00:34.849 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:34.845+0000 7ff1aacd6640 1 -- 172.21.15.78:0/3507807392 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7ff1900664a0 msgr2=0x7ff190068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:00:34.849 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:34.845+0000 7ff1aacd6640 1 --2- 172.21.15.78:0/3507807392 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7ff1900664a0 0x7ff190068960 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7ff1a00ad000 tx=0x7ff1a00a6000 comp rx=0 tx=0).stop 2023-11-28T20:00:34.849 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:34.845+0000 7ff1aacd6640 1 -- 172.21.15.78:0/3507807392 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff1a40c49c0 msgr2=0x7ff1a41e3f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:00:34.849 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:34.845+0000 7ff1aacd6640 1 --2- 172.21.15.78:0/3507807392 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff1a40c49c0 0x7ff1a41e3f80 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7ff194009ef0 tx=0x7ff19400c430 comp rx=0 tx=0).stop 2023-11-28T20:00:34.849 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:34.845+0000 7ff1aacd6640 1 -- 172.21.15.78:0/3507807392 shutdown_connections 2023-11-28T20:00:34.849 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:34.845+0000 7ff1aacd6640 1 --2- 172.21.15.78:0/3507807392 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7ff1900664a0 0x7ff190068960 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:34.850 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:34.845+0000 7ff1aacd6640 1 --2- 172.21.15.78:0/3507807392 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff1a40c59a0 0x7ff1a4148b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:34.850 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:34.845+0000 7ff1aacd6640 1 --2- 172.21.15.78:0/3507807392 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff1a40c49c0 0x7ff1a41e3f80 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:34.850 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:34.845+0000 7ff1aacd6640 1 --2- 172.21.15.78:0/3507807392 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff1a40bf690 0x7ff1a41ea9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:34.850 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:34.845+0000 7ff1aacd6640 1 -- 172.21.15.78:0/3507807392 >> 172.21.15.78:0/3507807392 conn(0x7ff1a40c6840 msgr2=0x7ff1a4151160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:00:34.850 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:34.845+0000 7ff1aacd6640 1 -- 172.21.15.78:0/3507807392 shutdown_connections 2023-11-28T20:00:34.850 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:34.845+0000 7ff1aacd6640 1 -- 172.21.15.78:0/3507807392 wait complete. 2023-11-28T20:00:34.869 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-11-28T20:00:34.869 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-28T20:00:35.007 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:35.001+0000 7f6456bd1640 1 Processor -- start 2023-11-28T20:00:35.007 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:35.001+0000 7f6456bd1640 1 -- start start 2023-11-28T20:00:35.008 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:35.005+0000 7f6456bd1640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f645006d2b0 0x7f645006d690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:35.009 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:35.005+0000 7f6456bd1640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f64500c3b80 0x7f64500c5300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:35.009 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:35.005+0000 7f6456bd1640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f645006bb80 con 0x7f645006c020 2023-11-28T20:00:35.009 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:35.005+0000 7f6456bd1640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f64500c5840 con 0x7f645006d2b0 2023-11-28T20:00:35.009 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:35.005+0000 7f6456bd1640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f64501515c0 con 0x7f64500c3b80 2023-11-28T20:00:35.009 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:35.005+0000 7f645496d640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f645006d2b0 0x7f645006d690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:35.009 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:35.005+0000 7f645496d640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f645006d2b0 0x7f645006d690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:46016/0 (socket says 172.21.15.78:46016) 2023-11-28T20:00:35.009 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:35.005+0000 7f645496d640 1 -- 172.21.15.78:0/2090590918 learned_addr learned my addr 172.21.15.78:0/2090590918 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T20:00:35.009 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:35.005+0000 7f644ffff640 1 --2- 172.21.15.78:0/2090590918 >> v2:172.21.15.179:3300/0 conn(0x7f64500c3b80 0x7f64500c5300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:35.010 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:35.005+0000 7f645496d640 1 -- 172.21.15.78:0/2090590918 >> v2:172.21.15.179:3300/0 conn(0x7f64500c3b80 msgr2=0x7f64500c5300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:00:35.010 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:35.005+0000 7f645496d640 1 --2- 172.21.15.78:0/2090590918 >> v2:172.21.15.179:3300/0 conn(0x7f64500c3b80 0x7f64500c5300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:35.010 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:35.005+0000 7f645496d640 1 -- 172.21.15.78:0/2090590918 >> v1:172.21.15.179:6789/0 conn(0x7f645006c020 legacy=0x7f645006c4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:00:35.010 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:35.005+0000 7f645496d640 1 -- 172.21.15.78:0/2090590918 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64501518a0 con 0x7f645006d2b0 2023-11-28T20:00:35.013 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:35.005+0000 7f645496d640 1 --2- 172.21.15.78:0/2090590918 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f645006d2b0 0x7f645006d690 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f645006b5a0 tx=0x7f644401c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1168d4c8ad306ef7 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:00:35.013 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:35.009+0000 7f644f7fe640 1 -- 172.21.15.78:0/2090590918 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64440ac600 con 0x7f645006d2b0 2023-11-28T20:00:35.014 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:35.009+0000 7f644f7fe640 1 -- 172.21.15.78:0/2090590918 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f64440a8050 con 0x7f645006d2b0 2023-11-28T20:00:35.014 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:35.009+0000 7f644f7fe640 1 -- 172.21.15.78:0/2090590918 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64440ac980 con 0x7f645006d2b0 2023-11-28T20:00:35.014 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:35.009+0000 7f6456bd1640 1 -- 172.21.15.78:0/2090590918 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f645006d2b0 msgr2=0x7f645006d690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:00:35.014 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:35.009+0000 7f6456bd1640 1 --2- 172.21.15.78:0/2090590918 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f645006d2b0 0x7f645006d690 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f645006b5a0 tx=0x7f644401c490 comp rx=0 tx=0).stop 2023-11-28T20:00:35.015 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:35.009+0000 7f6456bd1640 1 -- 172.21.15.78:0/2090590918 shutdown_connections 2023-11-28T20:00:35.015 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:35.009+0000 7f6456bd1640 1 --2- 172.21.15.78:0/2090590918 >> v2:172.21.15.179:3300/0 conn(0x7f64500c3b80 0x7f64500c5300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:35.015 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:35.009+0000 7f6456bd1640 1 --2- 172.21.15.78:0/2090590918 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f645006d2b0 0x7f645006d690 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:35.015 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:35.009+0000 7f6456bd1640 1 -- 172.21.15.78:0/2090590918 >> 172.21.15.78:0/2090590918 conn(0x7f64500a7810 msgr2=0x7f64500a7c20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:00:35.016 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:35.009+0000 7f6456bd1640 1 -- 172.21.15.78:0/2090590918 shutdown_connections 2023-11-28T20:00:35.016 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:35.009+0000 7f6456bd1640 1 -- 172.21.15.78:0/2090590918 wait complete. 2023-11-28T20:00:35.021 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:35.009+0000 7f6456bd1640 1 Processor -- start 2023-11-28T20:00:35.021 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:35.009+0000 7f6456bd1640 1 -- start start 2023-11-28T20:00:35.021 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:35.009+0000 7f6456bd1640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f645006c020 0x7f64501552d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:35.021 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:35.009+0000 7f6456bd1640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f645006d2b0 0x7f64500a87d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:35.022 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:35.009+0000 7f6456bd1640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f64500c3b80 0x7f645014dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:35.022 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:35.009+0000 7f6456bd1640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6450152bf0 con 0x7f64500c3b80 2023-11-28T20:00:35.022 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:35.009+0000 7f6456bd1640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6450154b20 con 0x7f645006d2b0 2023-11-28T20:00:35.022 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:35.009+0000 7f6456bd1640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f64501ed920 con 0x7f645006c020 2023-11-28T20:00:35.022 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:35.013+0000 7f645516e640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f64500c3b80 0x7f645014dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:35.023 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:35.013+0000 7f645516e640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f64500c3b80 0x7f645014dcd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:46022/0 (socket says 172.21.15.78:46022) 2023-11-28T20:00:35.023 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:35.013+0000 7f645516e640 1 -- 172.21.15.78:0/3569525084 learned_addr learned my addr 172.21.15.78:0/3569525084 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T20:00:35.023 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:35.013+0000 7f645496d640 1 --2- 172.21.15.78:0/3569525084 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f645006c020 0x7f64501552d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:35.023 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:35.013+0000 7f644ffff640 1 --2- 172.21.15.78:0/3569525084 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f645006d2b0 0x7f64500a87d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:35.023 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:35.013+0000 7f645516e640 1 -- 172.21.15.78:0/3569525084 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f645006c020 msgr2=0x7f64501552d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:00:35.023 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:35.013+0000 7f645516e640 1 --2- 172.21.15.78:0/3569525084 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f645006c020 0x7f64501552d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:35.024 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:35.013+0000 7f645516e640 1 -- 172.21.15.78:0/3569525084 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f645006d2b0 msgr2=0x7f64500a87d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:00:35.024 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:35.013+0000 7f645516e640 1 --2- 172.21.15.78:0/3569525084 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f645006d2b0 0x7f64500a87d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:35.024 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:35.013+0000 7f645516e640 1 -- 172.21.15.78:0/3569525084 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64440094d0 con 0x7f64500c3b80 2023-11-28T20:00:35.024 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:35.013+0000 7f645516e640 1 --2- 172.21.15.78:0/3569525084 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f64500c3b80 0x7f645014dcd0 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f644800c780 tx=0x7f644800cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:00:35.024 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:35.013+0000 7f644d7fa640 1 -- 172.21.15.78:0/3569525084 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6448004b20 con 0x7f64500c3b80 2023-11-28T20:00:35.024 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:35.013+0000 7f644d7fa640 1 -- 172.21.15.78:0/3569525084 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6448004c80 con 0x7f64500c3b80 2023-11-28T20:00:35.025 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:35.013+0000 7f6456bd1640 1 -- 172.21.15.78:0/3569525084 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f645014ef80 con 0x7f64500c3b80 2023-11-28T20:00:35.025 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:35.013+0000 7f644d7fa640 1 -- 172.21.15.78:0/3569525084 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f644800aa90 con 0x7f64500c3b80 2023-11-28T20:00:35.025 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:35.013+0000 7f6456bd1640 1 -- 172.21.15.78:0/3569525084 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6450152880 con 0x7f64500c3b80 2023-11-28T20:00:35.025 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:35.013+0000 7f6456bd1640 1 -- 172.21.15.78:0/3569525084 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6450152d60 con 0x7f64500c3b80 2023-11-28T20:00:35.025 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:35.013+0000 7f644d7fa640 1 -- 172.21.15.78:0/3569525084 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f644800abf0 con 0x7f64500c3b80 2023-11-28T20:00:35.025 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:35.017+0000 7f644d7fa640 1 --2- 172.21.15.78:0/3569525084 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f6434066470 0x7f6434068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:35.026 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:35.017+0000 7f644d7fa640 1 -- 172.21.15.78:0/3569525084 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 6885+0+0 (secure 0 0 0) 0x7f6448084270 con 0x7f64500c3b80 2023-11-28T20:00:35.026 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:35.017+0000 7f645496d640 1 --2- 172.21.15.78:0/3569525084 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f6434066470 0x7f6434068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:35.026 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:35.017+0000 7f645496d640 1 --2- 172.21.15.78:0/3569525084 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f6434066470 0x7f6434068930 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f64440ae000 tx=0x7f64440a7000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:00:35.027 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:35.021+0000 7f644d7fa640 1 -- 172.21.15.78:0/3569525084 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f6448051390 con 0x7f64500c3b80 2023-11-28T20:00:35.174 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:35.169+0000 7f6456bd1640 1 -- 172.21.15.78:0/3569525084 --> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f645014ee00 con 0x7f6434066470 2023-11-28T20:00:35.187 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:35.181+0000 7f644d7fa640 1 -- 172.21.15.78:0/3569525084 <== mgr.4106 v2:172.21.15.78:6832/2935380957 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+527047 (secure 0 0 0) 0x7f64440bc090 con 0x7f6434066470 2023-11-28T20:00:35.195 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-11-28T20:00:35.199 INFO:teuthology.orchestra.run.smithi078.stderr:dumped all 2023-11-28T20:00:35.200 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:35.189+0000 7f6456bd1640 1 -- 172.21.15.78:0/3569525084 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f6434066470 msgr2=0x7f6434068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:00:35.200 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:35.189+0000 7f6456bd1640 1 --2- 172.21.15.78:0/3569525084 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f6434066470 0x7f6434068930 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f64440ae000 tx=0x7f64440a7000 comp rx=0 tx=0).stop 2023-11-28T20:00:35.200 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:35.189+0000 7f6456bd1640 1 -- 172.21.15.78:0/3569525084 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f64500c3b80 msgr2=0x7f645014dcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:00:35.201 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:35.189+0000 7f6456bd1640 1 --2- 172.21.15.78:0/3569525084 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f64500c3b80 0x7f645014dcd0 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f644800c780 tx=0x7f644800cc40 comp rx=0 tx=0).stop 2023-11-28T20:00:35.201 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:35.189+0000 7f6456bd1640 1 -- 172.21.15.78:0/3569525084 shutdown_connections 2023-11-28T20:00:35.201 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:35.189+0000 7f6456bd1640 1 --2- 172.21.15.78:0/3569525084 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f6434066470 0x7f6434068930 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:35.201 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:35.189+0000 7f6456bd1640 1 --2- 172.21.15.78:0/3569525084 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f64500c3b80 0x7f645014dcd0 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:35.201 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:35.189+0000 7f6456bd1640 1 --2- 172.21.15.78:0/3569525084 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f645006d2b0 0x7f64500a87d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:35.201 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:35.189+0000 7f6456bd1640 1 --2- 172.21.15.78:0/3569525084 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f645006c020 0x7f64501552d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:35.201 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:35.189+0000 7f6456bd1640 1 -- 172.21.15.78:0/3569525084 >> 172.21.15.78:0/3569525084 conn(0x7f64500a7810 msgr2=0x7f6450071b10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:00:35.202 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:35.189+0000 7f6456bd1640 1 -- 172.21.15.78:0/3569525084 shutdown_connections 2023-11-28T20:00:35.202 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:35.189+0000 7f6456bd1640 1 -- 172.21.15.78:0/3569525084 wait complete. 2023-11-28T20:00:35.212 INFO:teuthology.orchestra.run.smithi078.stdout:{"pg_ready":true,"pg_map":{"version":88,"stamp":"2023-11-28T20:00:33.972150+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":596683,"num_objects":45,"num_object_clones":0,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":251,"num_write_kb":2447,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":27,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":197,"ondisk_log_size":197,"up":386,"acting":386,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":317,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":220416,"kb_used_data":4208,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754754304,"statfs":{"total":773094113280,"available":772868407296,"internally_reserved":0,"allocated":4308992,"data_stored":2992682,"data_compressed":66748,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":37,"apply_latency_ms":37,"commit_latency_ns":37000000,"apply_latency_ns":37000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.924523"},"pg_stats":[{"pgid":"8.31","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-28T20:00:32.539008+0000","last_change":"2023-11-28T20:00:30.796564+0000","last_active":"2023-11-28T20:00:32.539008+0000","last_peered":"2023-11-28T20:00:32.539008+0000","last_clean":"2023-11-28T20:00:32.539008+0000","last_became_active":"2023-11-28T20:00:30.796295+0000","last_became_peered":"2023-11-28T20:00:30.796295+0000","last_unstale":"2023-11-28T20:00:32.539008+0000","last_undegraded":"2023-11-28T20:00:32.539008+0000","last_fullsized":"2023-11-28T20:00:32.539008+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:30.046728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:30.046728+0000","last_clean_scrub_stamp":"2023-11-28T20:00:30.046728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:43:47.208125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.3f","version":"0'0","reported_seq":15,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-28T20:00:30.781176+0000","last_change":"2023-11-28T20:00:13.804342+0000","last_active":"2023-11-28T20:00:30.781176+0000","last_peered":"2023-11-28T20:00:30.781176+0000","last_clean":"2023-11-28T20:00:30.781176+0000","last_became_active":"2023-11-28T20:00:13.803858+0000","last_became_peered":"2023-11-28T20:00:13.803858+0000","last_unstale":"2023-11-28T20:00:30.781176+0000","last_undegraded":"2023-11-28T20:00:30.781176+0000","last_fullsized":"2023-11-28T20:00:30.781176+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_clean_scrub_stamp":"2023-11-28T20:00:12.764355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:25:02.945127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.30","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-28T20:00:32.537828+0000","last_change":"2023-11-28T20:00:30.788946+0000","last_active":"2023-11-28T20:00:32.537828+0000","last_peered":"2023-11-28T20:00:32.537828+0000","last_clean":"2023-11-28T20:00:32.537828+0000","last_became_active":"2023-11-28T20:00:30.788686+0000","last_became_peered":"2023-11-28T20:00:30.788686+0000","last_unstale":"2023-11-28T20:00:32.537828+0000","last_undegraded":"2023-11-28T20:00:32.537828+0000","last_fullsized":"2023-11-28T20:00:32.537828+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:30.046728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:30.046728+0000","last_clean_scrub_stamp":"2023-11-28T20:00:30.046728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:53:41.132014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":15,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-28T20:00:30.776196+0000","last_change":"2023-11-28T20:00:13.799903+0000","last_active":"2023-11-28T20:00:30.776196+0000","last_peered":"2023-11-28T20:00:30.776196+0000","last_clean":"2023-11-28T20:00:30.776196+0000","last_became_active":"2023-11-28T20:00:13.799607+0000","last_became_peered":"2023-11-28T20:00:13.799607+0000","last_unstale":"2023-11-28T20:00:30.776196+0000","last_undegraded":"2023-11-28T20:00:30.776196+0000","last_fullsized":"2023-11-28T20:00:30.776196+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_clean_scrub_stamp":"2023-11-28T20:00:12.764355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:10:57.174856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.33","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-28T20:00:32.539723+0000","last_change":"2023-11-28T20:00:30.785928+0000","last_active":"2023-11-28T20:00:32.539723+0000","last_peered":"2023-11-28T20:00:32.539723+0000","last_clean":"2023-11-28T20:00:32.539723+0000","last_became_active":"2023-11-28T20:00:30.785707+0000","last_became_peered":"2023-11-28T20:00:30.785707+0000","last_unstale":"2023-11-28T20:00:32.539723+0000","last_undegraded":"2023-11-28T20:00:32.539723+0000","last_fullsized":"2023-11-28T20:00:32.539723+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:30.046728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:30.046728+0000","last_clean_scrub_stamp":"2023-11-28T20:00:30.046728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:06:54.408654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":15,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-28T20:00:30.773955+0000","last_change":"2023-11-28T20:00:13.810666+0000","last_active":"2023-11-28T20:00:30.773955+0000","last_peered":"2023-11-28T20:00:30.773955+0000","last_clean":"2023-11-28T20:00:30.773955+0000","last_became_active":"2023-11-28T20:00:13.810420+0000","last_became_peered":"2023-11-28T20:00:13.810420+0000","last_unstale":"2023-11-28T20:00:30.773955+0000","last_undegraded":"2023-11-28T20:00:30.773955+0000","last_fullsized":"2023-11-28T20:00:30.773955+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_clean_scrub_stamp":"2023-11-28T20:00:12.764355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T06:58:51.315382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.32","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-28T20:00:32.538913+0000","last_change":"2023-11-28T20:00:30.790694+0000","last_active":"2023-11-28T20:00:32.538913+0000","last_peered":"2023-11-28T20:00:32.538913+0000","last_clean":"2023-11-28T20:00:32.538913+0000","last_became_active":"2023-11-28T20:00:30.789192+0000","last_became_peered":"2023-11-28T20:00:30.789192+0000","last_unstale":"2023-11-28T20:00:32.538913+0000","last_undegraded":"2023-11-28T20:00:32.538913+0000","last_fullsized":"2023-11-28T20:00:32.538913+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:30.046728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:30.046728+0000","last_clean_scrub_stamp":"2023-11-28T20:00:30.046728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T07:01:34.461518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.3c","version":"0'0","reported_seq":15,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-28T20:00:30.767553+0000","last_change":"2023-11-28T20:00:13.805753+0000","last_active":"2023-11-28T20:00:30.767553+0000","last_peered":"2023-11-28T20:00:30.767553+0000","last_clean":"2023-11-28T20:00:30.767553+0000","last_became_active":"2023-11-28T20:00:13.805513+0000","last_became_peered":"2023-11-28T20:00:13.805513+0000","last_unstale":"2023-11-28T20:00:30.767553+0000","last_undegraded":"2023-11-28T20:00:30.767553+0000","last_fullsized":"2023-11-28T20:00:30.767553+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_clean_scrub_stamp":"2023-11-28T20:00:12.764355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:43:04.959781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.35","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-28T20:00:31.770163+0000","last_change":"2023-11-28T20:00:30.791788+0000","last_active":"2023-11-28T20:00:31.770163+0000","last_peered":"2023-11-28T20:00:31.770163+0000","last_clean":"2023-11-28T20:00:31.770163+0000","last_became_active":"2023-11-28T20:00:30.791520+0000","last_became_peered":"2023-11-28T20:00:30.791520+0000","last_unstale":"2023-11-28T20:00:31.770163+0000","last_undegraded":"2023-11-28T20:00:31.770163+0000","last_fullsized":"2023-11-28T20:00:31.770163+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:30.046728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:30.046728+0000","last_clean_scrub_stamp":"2023-11-28T20:00:30.046728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:19:10.498515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":15,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-28T20:00:30.767589+0000","last_change":"2023-11-28T20:00:13.807494+0000","last_active":"2023-11-28T20:00:30.767589+0000","last_peered":"2023-11-28T20:00:30.767589+0000","last_clean":"2023-11-28T20:00:30.767589+0000","last_became_active":"2023-11-28T20:00:13.807215+0000","last_became_peered":"2023-11-28T20:00:13.807215+0000","last_unstale":"2023-11-28T20:00:30.767589+0000","last_undegraded":"2023-11-28T20:00:30.767589+0000","last_fullsized":"2023-11-28T20:00:30.767589+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_clean_scrub_stamp":"2023-11-28T20:00:12.764355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:49:37.068470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.34","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-28T20:00:32.539619+0000","last_change":"2023-11-28T20:00:30.793081+0000","last_active":"2023-11-28T20:00:32.539619+0000","last_peered":"2023-11-28T20:00:32.539619+0000","last_clean":"2023-11-28T20:00:32.539619+0000","last_became_active":"2023-11-28T20:00:30.792827+0000","last_became_peered":"2023-11-28T20:00:30.792827+0000","last_unstale":"2023-11-28T20:00:32.539619+0000","last_undegraded":"2023-11-28T20:00:32.539619+0000","last_fullsized":"2023-11-28T20:00:32.539619+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:30.046728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:30.046728+0000","last_clean_scrub_stamp":"2023-11-28T20:00:30.046728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:31:27.443576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":15,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-28T20:00:30.776853+0000","last_change":"2023-11-28T20:00:13.808809+0000","last_active":"2023-11-28T20:00:30.776853+0000","last_peered":"2023-11-28T20:00:30.776853+0000","last_clean":"2023-11-28T20:00:30.776853+0000","last_became_active":"2023-11-28T20:00:13.808555+0000","last_became_peered":"2023-11-28T20:00:13.808555+0000","last_unstale":"2023-11-28T20:00:30.776853+0000","last_undegraded":"2023-11-28T20:00:30.776853+0000","last_fullsized":"2023-11-28T20:00:30.776853+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_clean_scrub_stamp":"2023-11-28T20:00:12.764355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:18:53.216142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.37","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-28T20:00:32.540513+0000","last_change":"2023-11-28T20:00:30.790277+0000","last_active":"2023-11-28T20:00:32.540513+0000","last_peered":"2023-11-28T20:00:32.540513+0000","last_clean":"2023-11-28T20:00:32.540513+0000","last_became_active":"2023-11-28T20:00:30.790017+0000","last_became_peered":"2023-11-28T20:00:30.790017+0000","last_unstale":"2023-11-28T20:00:32.540513+0000","last_undegraded":"2023-11-28T20:00:32.540513+0000","last_fullsized":"2023-11-28T20:00:32.540513+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:30.046728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:30.046728+0000","last_clean_scrub_stamp":"2023-11-28T20:00:30.046728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:29:00.422211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":15,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-28T20:00:30.770719+0000","last_change":"2023-11-28T20:00:13.799749+0000","last_active":"2023-11-28T20:00:30.770719+0000","last_peered":"2023-11-28T20:00:30.770719+0000","last_clean":"2023-11-28T20:00:30.770719+0000","last_became_active":"2023-11-28T20:00:13.799461+0000","last_became_peered":"2023-11-28T20:00:13.799461+0000","last_unstale":"2023-11-28T20:00:30.770719+0000","last_undegraded":"2023-11-28T20:00:30.770719+0000","last_fullsized":"2023-11-28T20:00:30.770719+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_clean_scrub_stamp":"2023-11-28T20:00:12.764355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:40:01.114533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.36","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-28T20:00:32.539491+0000","last_change":"2023-11-28T20:00:30.791517+0000","last_active":"2023-11-28T20:00:32.539491+0000","last_peered":"2023-11-28T20:00:32.539491+0000","last_clean":"2023-11-28T20:00:32.539491+0000","last_became_active":"2023-11-28T20:00:30.787480+0000","last_became_peered":"2023-11-28T20:00:30.787480+0000","last_unstale":"2023-11-28T20:00:32.539491+0000","last_undegraded":"2023-11-28T20:00:32.539491+0000","last_fullsized":"2023-11-28T20:00:32.539491+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:30.046728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:30.046728+0000","last_clean_scrub_stamp":"2023-11-28T20:00:30.046728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:43:47.208125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":15,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-28T20:00:30.779602+0000","last_change":"2023-11-28T20:00:13.790387+0000","last_active":"2023-11-28T20:00:30.779602+0000","last_peered":"2023-11-28T20:00:30.779602+0000","last_clean":"2023-11-28T20:00:30.779602+0000","last_became_active":"2023-11-28T20:00:13.790010+0000","last_became_peered":"2023-11-28T20:00:13.790010+0000","last_unstale":"2023-11-28T20:00:30.779602+0000","last_undegraded":"2023-11-28T20:00:30.779602+0000","last_fullsized":"2023-11-28T20:00:30.779602+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_clean_scrub_stamp":"2023-11-28T20:00:12.764355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:44:25.495847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.39","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-28T20:00:32.538488+0000","last_change":"2023-11-28T20:00:30.796681+0000","last_active":"2023-11-28T20:00:32.538488+0000","last_peered":"2023-11-28T20:00:32.538488+0000","last_clean":"2023-11-28T20:00:32.538488+0000","last_became_active":"2023-11-28T20:00:30.796438+0000","last_became_peered":"2023-11-28T20:00:30.796438+0000","last_unstale":"2023-11-28T20:00:32.538488+0000","last_undegraded":"2023-11-28T20:00:32.538488+0000","last_fullsized":"2023-11-28T20:00:32.538488+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:30.046728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:30.046728+0000","last_clean_scrub_stamp":"2023-11-28T20:00:30.046728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:18:48.883776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":15,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-28T20:00:30.782203+0000","last_change":"2023-11-28T20:00:13.808555+0000","last_active":"2023-11-28T20:00:30.782203+0000","last_peered":"2023-11-28T20:00:30.782203+0000","last_clean":"2023-11-28T20:00:30.782203+0000","last_became_active":"2023-11-28T20:00:13.808267+0000","last_became_peered":"2023-11-28T20:00:13.808267+0000","last_unstale":"2023-11-28T20:00:30.782203+0000","last_undegraded":"2023-11-28T20:00:30.782203+0000","last_fullsized":"2023-11-28T20:00:30.782203+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_clean_scrub_stamp":"2023-11-28T20:00:12.764355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:20:11.234527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.38","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-28T20:00:32.538942+0000","last_change":"2023-11-28T20:00:30.786560+0000","last_active":"2023-11-28T20:00:32.538942+0000","last_peered":"2023-11-28T20:00:32.538942+0000","last_clean":"2023-11-28T20:00:32.538942+0000","last_became_active":"2023-11-28T20:00:30.786267+0000","last_became_peered":"2023-11-28T20:00:30.786267+0000","last_unstale":"2023-11-28T20:00:32.538942+0000","last_undegraded":"2023-11-28T20:00:32.538942+0000","last_fullsized":"2023-11-28T20:00:32.538942+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:30.046728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:30.046728+0000","last_clean_scrub_stamp":"2023-11-28T20:00:30.046728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:00:56.896478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":15,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-28T20:00:30.775098+0000","last_change":"2023-11-28T20:00:13.821670+0000","last_active":"2023-11-28T20:00:30.775098+0000","last_peered":"2023-11-28T20:00:30.775098+0000","last_clean":"2023-11-28T20:00:30.775098+0000","last_became_active":"2023-11-28T20:00:13.821456+0000","last_became_peered":"2023-11-28T20:00:13.821456+0000","last_unstale":"2023-11-28T20:00:30.775098+0000","last_undegraded":"2023-11-28T20:00:30.775098+0000","last_fullsized":"2023-11-28T20:00:30.775098+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_clean_scrub_stamp":"2023-11-28T20:00:12.764355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:10:57.174856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.3b","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-28T20:00:31.774512+0000","last_change":"2023-11-28T20:00:30.783116+0000","last_active":"2023-11-28T20:00:31.774512+0000","last_peered":"2023-11-28T20:00:31.774512+0000","last_clean":"2023-11-28T20:00:31.774512+0000","last_became_active":"2023-11-28T20:00:30.782835+0000","last_became_peered":"2023-11-28T20:00:30.782835+0000","last_unstale":"2023-11-28T20:00:31.774512+0000","last_undegraded":"2023-11-28T20:00:31.774512+0000","last_fullsized":"2023-11-28T20:00:31.774512+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:30.046728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:30.046728+0000","last_clean_scrub_stamp":"2023-11-28T20:00:30.046728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:49:58.216764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":15,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-28T20:00:30.774662+0000","last_change":"2023-11-28T20:00:13.791296+0000","last_active":"2023-11-28T20:00:30.774662+0000","last_peered":"2023-11-28T20:00:30.774662+0000","last_clean":"2023-11-28T20:00:30.774662+0000","last_became_active":"2023-11-28T20:00:13.790916+0000","last_became_peered":"2023-11-28T20:00:13.790916+0000","last_unstale":"2023-11-28T20:00:30.774662+0000","last_undegraded":"2023-11-28T20:00:30.774662+0000","last_fullsized":"2023-11-28T20:00:30.774662+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_clean_scrub_stamp":"2023-11-28T20:00:12.764355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:44:25.495847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.3a","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-28T20:00:32.538054+0000","last_change":"2023-11-28T20:00:30.794494+0000","last_active":"2023-11-28T20:00:32.538054+0000","last_peered":"2023-11-28T20:00:32.538054+0000","last_clean":"2023-11-28T20:00:32.538054+0000","last_became_active":"2023-11-28T20:00:30.794189+0000","last_became_peered":"2023-11-28T20:00:30.794189+0000","last_unstale":"2023-11-28T20:00:32.538054+0000","last_undegraded":"2023-11-28T20:00:32.538054+0000","last_fullsized":"2023-11-28T20:00:32.538054+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:30.046728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:30.046728+0000","last_clean_scrub_stamp":"2023-11-28T20:00:30.046728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:43:25.928043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":15,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-28T20:00:30.772582+0000","last_change":"2023-11-28T20:00:13.800855+0000","last_active":"2023-11-28T20:00:30.772582+0000","last_peered":"2023-11-28T20:00:30.772582+0000","last_clean":"2023-11-28T20:00:30.772582+0000","last_became_active":"2023-11-28T20:00:13.800499+0000","last_became_peered":"2023-11-28T20:00:13.800499+0000","last_unstale":"2023-11-28T20:00:30.772582+0000","last_undegraded":"2023-11-28T20:00:30.772582+0000","last_fullsized":"2023-11-28T20:00:30.772582+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_clean_scrub_stamp":"2023-11-28T20:00:12.764355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:49:53.239354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.3d","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-28T20:00:32.538375+0000","last_change":"2023-11-28T20:00:30.791065+0000","last_active":"2023-11-28T20:00:32.538375+0000","last_peered":"2023-11-28T20:00:32.538375+0000","last_clean":"2023-11-28T20:00:32.538375+0000","last_became_active":"2023-11-28T20:00:30.789651+0000","last_became_peered":"2023-11-28T20:00:30.789651+0000","last_unstale":"2023-11-28T20:00:32.538375+0000","last_undegraded":"2023-11-28T20:00:32.538375+0000","last_fullsized":"2023-11-28T20:00:32.538375+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:30.046728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:30.046728+0000","last_clean_scrub_stamp":"2023-11-28T20:00:30.046728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:34:55.679879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":15,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-28T20:00:30.772950+0000","last_change":"2023-11-28T20:00:13.824858+0000","last_active":"2023-11-28T20:00:30.772950+0000","last_peered":"2023-11-28T20:00:30.772950+0000","last_clean":"2023-11-28T20:00:30.772950+0000","last_became_active":"2023-11-28T20:00:13.824569+0000","last_became_peered":"2023-11-28T20:00:13.824569+0000","last_unstale":"2023-11-28T20:00:30.772950+0000","last_undegraded":"2023-11-28T20:00:30.772950+0000","last_fullsized":"2023-11-28T20:00:30.772950+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_clean_scrub_stamp":"2023-11-28T20:00:12.764355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:00:42.063217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.3c","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-28T20:00:32.540167+0000","last_change":"2023-11-28T20:00:30.790987+0000","last_active":"2023-11-28T20:00:32.540167+0000","last_peered":"2023-11-28T20:00:32.540167+0000","last_clean":"2023-11-28T20:00:32.540167+0000","last_became_active":"2023-11-28T20:00:30.790656+0000","last_became_peered":"2023-11-28T20:00:30.790656+0000","last_unstale":"2023-11-28T20:00:32.540167+0000","last_undegraded":"2023-11-28T20:00:32.540167+0000","last_fullsized":"2023-11-28T20:00:32.540167+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:30.046728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:30.046728+0000","last_clean_scrub_stamp":"2023-11-28T20:00:30.046728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:59:41.017533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":15,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-28T20:00:30.772138+0000","last_change":"2023-11-28T20:00:13.808718+0000","last_active":"2023-11-28T20:00:30.772138+0000","last_peered":"2023-11-28T20:00:30.772138+0000","last_clean":"2023-11-28T20:00:30.772138+0000","last_became_active":"2023-11-28T20:00:13.808423+0000","last_became_peered":"2023-11-28T20:00:13.808423+0000","last_unstale":"2023-11-28T20:00:30.772138+0000","last_undegraded":"2023-11-28T20:00:30.772138+0000","last_fullsized":"2023-11-28T20:00:30.772138+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_clean_scrub_stamp":"2023-11-28T20:00:12.764355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:31:57.992158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.3f","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-28T20:00:32.538670+0000","last_change":"2023-11-28T20:00:30.790273+0000","last_active":"2023-11-28T20:00:32.538670+0000","last_peered":"2023-11-28T20:00:32.538670+0000","last_clean":"2023-11-28T20:00:32.538670+0000","last_became_active":"2023-11-28T20:00:30.789088+0000","last_became_peered":"2023-11-28T20:00:30.789088+0000","last_unstale":"2023-11-28T20:00:32.538670+0000","last_undegraded":"2023-11-28T20:00:32.538670+0000","last_fullsized":"2023-11-28T20:00:32.538670+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:30.046728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:30.046728+0000","last_clean_scrub_stamp":"2023-11-28T20:00:30.046728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:16:38.581443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":15,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-28T20:00:30.770749+0000","last_change":"2023-11-28T20:00:13.801043+0000","last_active":"2023-11-28T20:00:30.770749+0000","last_peered":"2023-11-28T20:00:30.770749+0000","last_clean":"2023-11-28T20:00:30.770749+0000","last_became_active":"2023-11-28T20:00:13.800680+0000","last_became_peered":"2023-11-28T20:00:13.800680+0000","last_unstale":"2023-11-28T20:00:30.770749+0000","last_undegraded":"2023-11-28T20:00:30.770749+0000","last_fullsized":"2023-11-28T20:00:30.770749+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_clean_scrub_stamp":"2023-11-28T20:00:12.764355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:22:53.309959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.3e","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-28T20:00:32.539218+0000","last_change":"2023-11-28T20:00:30.793302+0000","last_active":"2023-11-28T20:00:32.539218+0000","last_peered":"2023-11-28T20:00:32.539218+0000","last_clean":"2023-11-28T20:00:32.539218+0000","last_became_active":"2023-11-28T20:00:30.790709+0000","last_became_peered":"2023-11-28T20:00:30.790709+0000","last_unstale":"2023-11-28T20:00:32.539218+0000","last_undegraded":"2023-11-28T20:00:32.539218+0000","last_fullsized":"2023-11-28T20:00:32.539218+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:30.046728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:30.046728+0000","last_clean_scrub_stamp":"2023-11-28T20:00:30.046728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:48:36.022786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":15,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-28T20:00:30.776511+0000","last_change":"2023-11-28T20:00:13.827177+0000","last_active":"2023-11-28T20:00:30.776511+0000","last_peered":"2023-11-28T20:00:30.776511+0000","last_clean":"2023-11-28T20:00:30.776511+0000","last_became_active":"2023-11-28T20:00:13.826912+0000","last_became_peered":"2023-11-28T20:00:13.826912+0000","last_unstale":"2023-11-28T20:00:30.776511+0000","last_undegraded":"2023-11-28T20:00:30.776511+0000","last_fullsized":"2023-11-28T20:00:30.776511+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_clean_scrub_stamp":"2023-11-28T20:00:12.764355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:04:36.627323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.21","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-28T20:00:32.539544+0000","last_change":"2023-11-28T20:00:30.796613+0000","last_active":"2023-11-28T20:00:32.539544+0000","last_peered":"2023-11-28T20:00:32.539544+0000","last_clean":"2023-11-28T20:00:32.539544+0000","last_became_active":"2023-11-28T20:00:30.796367+0000","last_became_peered":"2023-11-28T20:00:30.796367+0000","last_unstale":"2023-11-28T20:00:32.539544+0000","last_undegraded":"2023-11-28T20:00:32.539544+0000","last_fullsized":"2023-11-28T20:00:32.539544+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:30.046728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:30.046728+0000","last_clean_scrub_stamp":"2023-11-28T20:00:30.046728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:04:17.052330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":15,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-28T20:00:30.779727+0000","last_change":"2023-11-28T20:00:13.821822+0000","last_active":"2023-11-28T20:00:30.779727+0000","last_peered":"2023-11-28T20:00:30.779727+0000","last_clean":"2023-11-28T20:00:30.779727+0000","last_became_active":"2023-11-28T20:00:13.821511+0000","last_became_peered":"2023-11-28T20:00:13.821511+0000","last_unstale":"2023-11-28T20:00:30.779727+0000","last_undegraded":"2023-11-28T20:00:30.779727+0000","last_fullsized":"2023-11-28T20:00:30.779727+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_clean_scrub_stamp":"2023-11-28T20:00:12.764355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:09:58.925137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.20","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-28T20:00:32.539269+0000","last_change":"2023-11-28T20:00:30.784152+0000","last_active":"2023-11-28T20:00:32.539269+0000","last_peered":"2023-11-28T20:00:32.539269+0000","last_clean":"2023-11-28T20:00:32.539269+0000","last_became_active":"2023-11-28T20:00:30.783235+0000","last_became_peered":"2023-11-28T20:00:30.783235+0000","last_unstale":"2023-11-28T20:00:32.539269+0000","last_undegraded":"2023-11-28T20:00:32.539269+0000","last_fullsized":"2023-11-28T20:00:32.539269+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:30.046728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:30.046728+0000","last_clean_scrub_stamp":"2023-11-28T20:00:30.046728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:16:19.987995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":15,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-28T20:00:30.788184+0000","last_change":"2023-11-28T20:00:13.818806+0000","last_active":"2023-11-28T20:00:30.788184+0000","last_peered":"2023-11-28T20:00:30.788184+0000","last_clean":"2023-11-28T20:00:30.788184+0000","last_became_active":"2023-11-28T20:00:13.818465+0000","last_became_peered":"2023-11-28T20:00:13.818465+0000","last_unstale":"2023-11-28T20:00:30.788184+0000","last_undegraded":"2023-11-28T20:00:30.788184+0000","last_fullsized":"2023-11-28T20:00:30.788184+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_clean_scrub_stamp":"2023-11-28T20:00:12.764355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:18:18.464919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.23","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-28T20:00:32.538510+0000","last_change":"2023-11-28T20:00:30.795743+0000","last_active":"2023-11-28T20:00:32.538510+0000","last_peered":"2023-11-28T20:00:32.538510+0000","last_clean":"2023-11-28T20:00:32.538510+0000","last_became_active":"2023-11-28T20:00:30.795038+0000","last_became_peered":"2023-11-28T20:00:30.795038+0000","last_unstale":"2023-11-28T20:00:32.538510+0000","last_undegraded":"2023-11-28T20:00:32.538510+0000","last_fullsized":"2023-11-28T20:00:32.538510+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:30.046728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:30.046728+0000","last_clean_scrub_stamp":"2023-11-28T20:00:30.046728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:04:03.299727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":15,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-28T20:00:30.768079+0000","last_change":"2023-11-28T20:00:13.812943+0000","last_active":"2023-11-28T20:00:30.768079+0000","last_peered":"2023-11-28T20:00:30.768079+0000","last_clean":"2023-11-28T20:00:30.768079+0000","last_became_active":"2023-11-28T20:00:13.812599+0000","last_became_peered":"2023-11-28T20:00:13.812599+0000","last_unstale":"2023-11-28T20:00:30.768079+0000","last_undegraded":"2023-11-28T20:00:30.768079+0000","last_fullsized":"2023-11-28T20:00:30.768079+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_clean_scrub_stamp":"2023-11-28T20:00:12.764355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:55:35.740926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.22","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-28T20:00:32.539202+0000","last_change":"2023-11-28T20:00:30.792948+0000","last_active":"2023-11-28T20:00:32.539202+0000","last_peered":"2023-11-28T20:00:32.539202+0000","last_clean":"2023-11-28T20:00:32.539202+0000","last_became_active":"2023-11-28T20:00:30.791675+0000","last_became_peered":"2023-11-28T20:00:30.791675+0000","last_unstale":"2023-11-28T20:00:32.539202+0000","last_undegraded":"2023-11-28T20:00:32.539202+0000","last_fullsized":"2023-11-28T20:00:32.539202+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:30.046728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:30.046728+0000","last_clean_scrub_stamp":"2023-11-28T20:00:30.046728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:06:54.408654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":15,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-28T20:00:30.787636+0000","last_change":"2023-11-28T20:00:13.818861+0000","last_active":"2023-11-28T20:00:30.787636+0000","last_peered":"2023-11-28T20:00:30.787636+0000","last_clean":"2023-11-28T20:00:30.787636+0000","last_became_active":"2023-11-28T20:00:13.818563+0000","last_became_peered":"2023-11-28T20:00:13.818563+0000","last_unstale":"2023-11-28T20:00:30.787636+0000","last_undegraded":"2023-11-28T20:00:30.787636+0000","last_fullsized":"2023-11-28T20:00:30.787636+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_clean_scrub_stamp":"2023-11-28T20:00:12.764355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:22:33.214424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.25","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-28T20:00:32.538480+0000","last_change":"2023-11-28T20:00:30.794761+0000","last_active":"2023-11-28T20:00:32.538480+0000","last_peered":"2023-11-28T20:00:32.538480+0000","last_clean":"2023-11-28T20:00:32.538480+0000","last_became_active":"2023-11-28T20:00:30.791836+0000","last_became_peered":"2023-11-28T20:00:30.791836+0000","last_unstale":"2023-11-28T20:00:32.538480+0000","last_undegraded":"2023-11-28T20:00:32.538480+0000","last_fullsized":"2023-11-28T20:00:32.538480+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:30.046728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:30.046728+0000","last_clean_scrub_stamp":"2023-11-28T20:00:30.046728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:33:06.403022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":15,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-28T20:00:30.773055+0000","last_change":"2023-11-28T20:00:13.797412+0000","last_active":"2023-11-28T20:00:30.773055+0000","last_peered":"2023-11-28T20:00:30.773055+0000","last_clean":"2023-11-28T20:00:30.773055+0000","last_became_active":"2023-11-28T20:00:13.797078+0000","last_became_peered":"2023-11-28T20:00:13.797078+0000","last_unstale":"2023-11-28T20:00:30.773055+0000","last_undegraded":"2023-11-28T20:00:30.773055+0000","last_fullsized":"2023-11-28T20:00:30.773055+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_clean_scrub_stamp":"2023-11-28T20:00:12.764355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:29:20.384184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.24","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-28T20:00:31.774932+0000","last_change":"2023-11-28T20:00:30.796754+0000","last_active":"2023-11-28T20:00:31.774932+0000","last_peered":"2023-11-28T20:00:31.774932+0000","last_clean":"2023-11-28T20:00:31.774932+0000","last_became_active":"2023-11-28T20:00:30.796461+0000","last_became_peered":"2023-11-28T20:00:30.796461+0000","last_unstale":"2023-11-28T20:00:31.774932+0000","last_undegraded":"2023-11-28T20:00:31.774932+0000","last_fullsized":"2023-11-28T20:00:31.774932+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:30.046728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:30.046728+0000","last_clean_scrub_stamp":"2023-11-28T20:00:30.046728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:53:41.132014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":15,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-28T20:00:30.772426+0000","last_change":"2023-11-28T20:00:13.805732+0000","last_active":"2023-11-28T20:00:30.772426+0000","last_peered":"2023-11-28T20:00:30.772426+0000","last_clean":"2023-11-28T20:00:30.772426+0000","last_became_active":"2023-11-28T20:00:13.805089+0000","last_became_peered":"2023-11-28T20:00:13.805089+0000","last_unstale":"2023-11-28T20:00:30.772426+0000","last_undegraded":"2023-11-28T20:00:30.772426+0000","last_fullsized":"2023-11-28T20:00:30.772426+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_clean_scrub_stamp":"2023-11-28T20:00:12.764355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:42:33.306843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.27","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-28T20:00:32.540632+0000","last_change":"2023-11-28T20:00:30.790971+0000","last_active":"2023-11-28T20:00:32.540632+0000","last_peered":"2023-11-28T20:00:32.540632+0000","last_clean":"2023-11-28T20:00:32.540632+0000","last_became_active":"2023-11-28T20:00:30.790497+0000","last_became_peered":"2023-11-28T20:00:30.790497+0000","last_unstale":"2023-11-28T20:00:32.540632+0000","last_undegraded":"2023-11-28T20:00:32.540632+0000","last_fullsized":"2023-11-28T20:00:32.540632+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:30.046728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:30.046728+0000","last_clean_scrub_stamp":"2023-11-28T20:00:30.046728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:32:37.911634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":15,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-28T20:00:30.777026+0000","last_change":"2023-11-28T20:00:13.822451+0000","last_active":"2023-11-28T20:00:30.777026+0000","last_peered":"2023-11-28T20:00:30.777026+0000","last_clean":"2023-11-28T20:00:30.777026+0000","last_became_active":"2023-11-28T20:00:13.822186+0000","last_became_peered":"2023-11-28T20:00:13.822186+0000","last_unstale":"2023-11-28T20:00:30.777026+0000","last_undegraded":"2023-11-28T20:00:30.777026+0000","last_fullsized":"2023-11-28T20:00:30.777026+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_clean_scrub_stamp":"2023-11-28T20:00:12.764355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:27:21.391017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.26","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-28T20:00:32.539298+0000","last_change":"2023-11-28T20:00:30.795376+0000","last_active":"2023-11-28T20:00:32.539298+0000","last_peered":"2023-11-28T20:00:32.539298+0000","last_clean":"2023-11-28T20:00:32.539298+0000","last_became_active":"2023-11-28T20:00:30.795116+0000","last_became_peered":"2023-11-28T20:00:30.795116+0000","last_unstale":"2023-11-28T20:00:32.539298+0000","last_undegraded":"2023-11-28T20:00:32.539298+0000","last_fullsized":"2023-11-28T20:00:32.539298+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:30.046728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:30.046728+0000","last_clean_scrub_stamp":"2023-11-28T20:00:30.046728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:22:39.781488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":15,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-28T20:00:30.767263+0000","last_change":"2023-11-28T20:00:13.821720+0000","last_active":"2023-11-28T20:00:30.767263+0000","last_peered":"2023-11-28T20:00:30.767263+0000","last_clean":"2023-11-28T20:00:30.767263+0000","last_became_active":"2023-11-28T20:00:13.820803+0000","last_became_peered":"2023-11-28T20:00:13.820803+0000","last_unstale":"2023-11-28T20:00:30.767263+0000","last_undegraded":"2023-11-28T20:00:30.767263+0000","last_fullsized":"2023-11-28T20:00:30.767263+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_clean_scrub_stamp":"2023-11-28T20:00:12.764355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:51:43.814695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.29","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-28T20:00:31.769533+0000","last_change":"2023-11-28T20:00:30.794224+0000","last_active":"2023-11-28T20:00:31.769533+0000","last_peered":"2023-11-28T20:00:31.769533+0000","last_clean":"2023-11-28T20:00:31.769533+0000","last_became_active":"2023-11-28T20:00:30.793972+0000","last_became_peered":"2023-11-28T20:00:30.793972+0000","last_unstale":"2023-11-28T20:00:31.769533+0000","last_undegraded":"2023-11-28T20:00:31.769533+0000","last_fullsized":"2023-11-28T20:00:31.769533+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:30.046728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:30.046728+0000","last_clean_scrub_stamp":"2023-11-28T20:00:30.046728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:18:35.747292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":15,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-28T20:00:30.787745+0000","last_change":"2023-11-28T20:00:13.807416+0000","last_active":"2023-11-28T20:00:30.787745+0000","last_peered":"2023-11-28T20:00:30.787745+0000","last_clean":"2023-11-28T20:00:30.787745+0000","last_became_active":"2023-11-28T20:00:13.807141+0000","last_became_peered":"2023-11-28T20:00:13.807141+0000","last_unstale":"2023-11-28T20:00:30.787745+0000","last_undegraded":"2023-11-28T20:00:30.787745+0000","last_fullsized":"2023-11-28T20:00:30.787745+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_clean_scrub_stamp":"2023-11-28T20:00:12.764355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:42:33.306843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.28","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-28T20:00:32.538894+0000","last_change":"2023-11-28T20:00:30.797382+0000","last_active":"2023-11-28T20:00:32.538894+0000","last_peered":"2023-11-28T20:00:32.538894+0000","last_clean":"2023-11-28T20:00:32.538894+0000","last_became_active":"2023-11-28T20:00:30.797115+0000","last_became_peered":"2023-11-28T20:00:30.797115+0000","last_unstale":"2023-11-28T20:00:32.538894+0000","last_undegraded":"2023-11-28T20:00:32.538894+0000","last_fullsized":"2023-11-28T20:00:32.538894+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:30.046728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:30.046728+0000","last_clean_scrub_stamp":"2023-11-28T20:00:30.046728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:14:48.882313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":15,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-28T20:00:30.778390+0000","last_change":"2023-11-28T20:00:13.812247+0000","last_active":"2023-11-28T20:00:30.778390+0000","last_peered":"2023-11-28T20:00:30.778390+0000","last_clean":"2023-11-28T20:00:30.778390+0000","last_became_active":"2023-11-28T20:00:13.812016+0000","last_became_peered":"2023-11-28T20:00:13.812016+0000","last_unstale":"2023-11-28T20:00:30.778390+0000","last_undegraded":"2023-11-28T20:00:30.778390+0000","last_fullsized":"2023-11-28T20:00:30.778390+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_clean_scrub_stamp":"2023-11-28T20:00:12.764355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:04:36.627323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2b","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-28T20:00:31.774190+0000","last_change":"2023-11-28T20:00:30.797148+0000","last_active":"2023-11-28T20:00:31.774190+0000","last_peered":"2023-11-28T20:00:31.774190+0000","last_clean":"2023-11-28T20:00:31.774190+0000","last_became_active":"2023-11-28T20:00:30.796778+0000","last_became_peered":"2023-11-28T20:00:30.796778+0000","last_unstale":"2023-11-28T20:00:31.774190+0000","last_undegraded":"2023-11-28T20:00:31.774190+0000","last_fullsized":"2023-11-28T20:00:31.774190+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:30.046728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:30.046728+0000","last_clean_scrub_stamp":"2023-11-28T20:00:30.046728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:22:12.931757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":15,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-28T20:00:30.787935+0000","last_change":"2023-11-28T20:00:13.814802+0000","last_active":"2023-11-28T20:00:30.787935+0000","last_peered":"2023-11-28T20:00:30.787935+0000","last_clean":"2023-11-28T20:00:30.787935+0000","last_became_active":"2023-11-28T20:00:13.814522+0000","last_became_peered":"2023-11-28T20:00:13.814522+0000","last_unstale":"2023-11-28T20:00:30.787935+0000","last_undegraded":"2023-11-28T20:00:30.787935+0000","last_fullsized":"2023-11-28T20:00:30.787935+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_clean_scrub_stamp":"2023-11-28T20:00:12.764355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:30:41.436973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2a","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-28T20:00:32.539925+0000","last_change":"2023-11-28T20:00:30.786537+0000","last_active":"2023-11-28T20:00:32.539925+0000","last_peered":"2023-11-28T20:00:32.539925+0000","last_clean":"2023-11-28T20:00:32.539925+0000","last_became_active":"2023-11-28T20:00:30.786248+0000","last_became_peered":"2023-11-28T20:00:30.786248+0000","last_unstale":"2023-11-28T20:00:32.539925+0000","last_undegraded":"2023-11-28T20:00:32.539925+0000","last_fullsized":"2023-11-28T20:00:32.539925+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:30.046728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:30.046728+0000","last_clean_scrub_stamp":"2023-11-28T20:00:30.046728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:04:01.726100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":15,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-28T20:00:30.773526+0000","last_change":"2023-11-28T20:00:13.801034+0000","last_active":"2023-11-28T20:00:30.773526+0000","last_peered":"2023-11-28T20:00:30.773526+0000","last_clean":"2023-11-28T20:00:30.773526+0000","last_became_active":"2023-11-28T20:00:13.798365+0000","last_became_peered":"2023-11-28T20:00:13.798365+0000","last_unstale":"2023-11-28T20:00:30.773526+0000","last_undegraded":"2023-11-28T20:00:30.773526+0000","last_fullsized":"2023-11-28T20:00:30.773526+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_clean_scrub_stamp":"2023-11-28T20:00:12.764355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:10:58.346942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.2d","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-28T20:00:32.538509+0000","last_change":"2023-11-28T20:00:30.785487+0000","last_active":"2023-11-28T20:00:32.538509+0000","last_peered":"2023-11-28T20:00:32.538509+0000","last_clean":"2023-11-28T20:00:32.538509+0000","last_became_active":"2023-11-28T20:00:30.785226+0000","last_became_peered":"2023-11-28T20:00:30.785226+0000","last_unstale":"2023-11-28T20:00:32.538509+0000","last_undegraded":"2023-11-28T20:00:32.538509+0000","last_fullsized":"2023-11-28T20:00:32.538509+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:30.046728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:30.046728+0000","last_clean_scrub_stamp":"2023-11-28T20:00:30.046728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:56:02.591808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":15,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-28T20:00:30.787501+0000","last_change":"2023-11-28T20:00:13.817271+0000","last_active":"2023-11-28T20:00:30.787501+0000","last_peered":"2023-11-28T20:00:30.787501+0000","last_clean":"2023-11-28T20:00:30.787501+0000","last_became_active":"2023-11-28T20:00:13.816910+0000","last_became_peered":"2023-11-28T20:00:13.816910+0000","last_unstale":"2023-11-28T20:00:30.787501+0000","last_undegraded":"2023-11-28T20:00:30.787501+0000","last_fullsized":"2023-11-28T20:00:30.787501+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_clean_scrub_stamp":"2023-11-28T20:00:12.764355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:31:40.964592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2c","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-28T20:00:31.775047+0000","last_change":"2023-11-28T20:00:30.790154+0000","last_active":"2023-11-28T20:00:31.775047+0000","last_peered":"2023-11-28T20:00:31.775047+0000","last_clean":"2023-11-28T20:00:31.775047+0000","last_became_active":"2023-11-28T20:00:30.789822+0000","last_became_peered":"2023-11-28T20:00:30.789822+0000","last_unstale":"2023-11-28T20:00:31.775047+0000","last_undegraded":"2023-11-28T20:00:31.775047+0000","last_fullsized":"2023-11-28T20:00:31.775047+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:30.046728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:30.046728+0000","last_clean_scrub_stamp":"2023-11-28T20:00:30.046728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:43:25.928043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":15,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-28T20:00:30.787765+0000","last_change":"2023-11-28T20:00:13.814979+0000","last_active":"2023-11-28T20:00:30.787765+0000","last_peered":"2023-11-28T20:00:30.787765+0000","last_clean":"2023-11-28T20:00:30.787765+0000","last_became_active":"2023-11-28T20:00:13.812114+0000","last_became_peered":"2023-11-28T20:00:13.812114+0000","last_unstale":"2023-11-28T20:00:30.787765+0000","last_undegraded":"2023-11-28T20:00:30.787765+0000","last_fullsized":"2023-11-28T20:00:30.787765+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_clean_scrub_stamp":"2023-11-28T20:00:12.764355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:39:05.453623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2f","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-28T20:00:32.540512+0000","last_change":"2023-11-28T20:00:30.790780+0000","last_active":"2023-11-28T20:00:32.540512+0000","last_peered":"2023-11-28T20:00:32.540512+0000","last_clean":"2023-11-28T20:00:32.540512+0000","last_became_active":"2023-11-28T20:00:30.790158+0000","last_became_peered":"2023-11-28T20:00:30.790158+0000","last_unstale":"2023-11-28T20:00:32.540512+0000","last_undegraded":"2023-11-28T20:00:32.540512+0000","last_fullsized":"2023-11-28T20:00:32.540512+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:30.046728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:30.046728+0000","last_clean_scrub_stamp":"2023-11-28T20:00:30.046728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:56:15.664033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":15,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-28T20:00:30.777099+0000","last_change":"2023-11-28T20:00:13.822997+0000","last_active":"2023-11-28T20:00:30.777099+0000","last_peered":"2023-11-28T20:00:30.777099+0000","last_clean":"2023-11-28T20:00:30.777099+0000","last_became_active":"2023-11-28T20:00:13.822640+0000","last_became_peered":"2023-11-28T20:00:13.822640+0000","last_unstale":"2023-11-28T20:00:30.777099+0000","last_undegraded":"2023-11-28T20:00:30.777099+0000","last_fullsized":"2023-11-28T20:00:30.777099+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_clean_scrub_stamp":"2023-11-28T20:00:12.764355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:49:03.707877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.2e","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-28T20:00:32.539375+0000","last_change":"2023-11-28T20:00:30.794508+0000","last_active":"2023-11-28T20:00:32.539375+0000","last_peered":"2023-11-28T20:00:32.539375+0000","last_clean":"2023-11-28T20:00:32.539375+0000","last_became_active":"2023-11-28T20:00:30.793858+0000","last_became_peered":"2023-11-28T20:00:30.793858+0000","last_unstale":"2023-11-28T20:00:32.539375+0000","last_undegraded":"2023-11-28T20:00:32.539375+0000","last_fullsized":"2023-11-28T20:00:32.539375+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:30.046728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:30.046728+0000","last_clean_scrub_stamp":"2023-11-28T20:00:30.046728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:16:19.987995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":15,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-28T20:00:30.775632+0000","last_change":"2023-11-28T20:00:13.801896+0000","last_active":"2023-11-28T20:00:30.775632+0000","last_peered":"2023-11-28T20:00:30.775632+0000","last_clean":"2023-11-28T20:00:30.775632+0000","last_became_active":"2023-11-28T20:00:13.801620+0000","last_became_peered":"2023-11-28T20:00:13.801620+0000","last_unstale":"2023-11-28T20:00:30.775632+0000","last_undegraded":"2023-11-28T20:00:30.775632+0000","last_fullsized":"2023-11-28T20:00:30.775632+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_clean_scrub_stamp":"2023-11-28T20:00:12.764355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:49:53.239354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-28T20:00:31.774383+0000","last_change":"2023-11-28T20:00:30.796407+0000","last_active":"2023-11-28T20:00:31.774383+0000","last_peered":"2023-11-28T20:00:31.774383+0000","last_clean":"2023-11-28T20:00:31.774383+0000","last_became_active":"2023-11-28T20:00:30.795972+0000","last_became_peered":"2023-11-28T20:00:30.795972+0000","last_unstale":"2023-11-28T20:00:31.774383+0000","last_undegraded":"2023-11-28T20:00:31.774383+0000","last_fullsized":"2023-11-28T20:00:31.774383+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:30.046728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:30.046728+0000","last_clean_scrub_stamp":"2023-11-28T20:00:30.046728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:25:20.227499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1d","version":"43'2","reported_seq":14,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-28T20:00:32.539299+0000","last_change":"2023-11-28T20:00:30.080799+0000","last_active":"2023-11-28T20:00:32.539299+0000","last_peered":"2023-11-28T20:00:32.539299+0000","last_clean":"2023-11-28T20:00:32.539299+0000","last_became_active":"2023-11-28T20:00:30.080271+0000","last_became_peered":"2023-11-28T20:00:30.080271+0000","last_unstale":"2023-11-28T20:00:32.539299+0000","last_undegraded":"2023-11-28T20:00:32.539299+0000","last_fullsized":"2023-11-28T20:00:32.539299+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:29.043480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:29.043480+0000","last_clean_scrub_stamp":"2023-11-28T20:00:29.043480+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T07:28:49.902804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":15,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-28T20:00:30.777770+0000","last_change":"2023-11-28T20:00:13.822133+0000","last_active":"2023-11-28T20:00:30.777770+0000","last_peered":"2023-11-28T20:00:30.777770+0000","last_clean":"2023-11-28T20:00:30.777770+0000","last_became_active":"2023-11-28T20:00:13.821824+0000","last_became_peered":"2023-11-28T20:00:13.821824+0000","last_unstale":"2023-11-28T20:00:30.777770+0000","last_undegraded":"2023-11-28T20:00:30.777770+0000","last_fullsized":"2023-11-28T20:00:30.777770+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_clean_scrub_stamp":"2023-11-28T20:00:12.764355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:32:45.544226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1f","version":"39'4","reported_seq":20,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-28T20:00:30.787993+0000","last_change":"2023-11-28T20:00:12.794933+0000","last_active":"2023-11-28T20:00:30.787993+0000","last_peered":"2023-11-28T20:00:30.787993+0000","last_clean":"2023-11-28T20:00:30.787993+0000","last_became_active":"2023-11-28T20:00:12.794598+0000","last_became_peered":"2023-11-28T20:00:12.794598+0000","last_unstale":"2023-11-28T20:00:30.787993+0000","last_undegraded":"2023-11-28T20:00:30.787993+0000","last_fullsized":"2023-11-28T20:00:30.787993+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:11.760656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:11.760656+0000","last_clean_scrub_stamp":"2023-11-28T20:00:11.760656+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:55:34.737227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-28T20:00:32.539662+0000","last_change":"2023-11-28T20:00:30.789129+0000","last_active":"2023-11-28T20:00:32.539662+0000","last_peered":"2023-11-28T20:00:32.539662+0000","last_clean":"2023-11-28T20:00:32.539662+0000","last_became_active":"2023-11-28T20:00:30.787947+0000","last_became_peered":"2023-11-28T20:00:30.787947+0000","last_unstale":"2023-11-28T20:00:32.539662+0000","last_undegraded":"2023-11-28T20:00:32.539662+0000","last_fullsized":"2023-11-28T20:00:32.539662+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:30.046728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:30.046728+0000","last_clean_scrub_stamp":"2023-11-28T20:00:30.046728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:15:50.866774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1c","version":"43'2","reported_seq":14,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-28T20:00:32.540161+0000","last_change":"2023-11-28T20:00:30.078073+0000","last_active":"2023-11-28T20:00:32.540161+0000","last_peered":"2023-11-28T20:00:32.540161+0000","last_clean":"2023-11-28T20:00:32.540161+0000","last_became_active":"2023-11-28T20:00:30.077729+0000","last_became_peered":"2023-11-28T20:00:30.077729+0000","last_unstale":"2023-11-28T20:00:32.540161+0000","last_undegraded":"2023-11-28T20:00:32.540161+0000","last_fullsized":"2023-11-28T20:00:32.540161+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:29.043480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:29.043480+0000","last_clean_scrub_stamp":"2023-11-28T20:00:29.043480+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:48:35.019537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":15,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-28T20:00:30.776358+0000","last_change":"2023-11-28T20:00:13.809500+0000","last_active":"2023-11-28T20:00:30.776358+0000","last_peered":"2023-11-28T20:00:30.776358+0000","last_clean":"2023-11-28T20:00:30.776358+0000","last_became_active":"2023-11-28T20:00:13.809149+0000","last_became_peered":"2023-11-28T20:00:13.809149+0000","last_unstale":"2023-11-28T20:00:30.776358+0000","last_undegraded":"2023-11-28T20:00:30.776358+0000","last_fullsized":"2023-11-28T20:00:30.776358+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_clean_scrub_stamp":"2023-11-28T20:00:12.764355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T07:13:21.710239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1e","version":"39'1","reported_seq":17,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-28T20:00:30.773635+0000","last_change":"2023-11-28T20:00:12.794372+0000","last_active":"2023-11-28T20:00:30.773635+0000","last_peered":"2023-11-28T20:00:30.773635+0000","last_clean":"2023-11-28T20:00:30.773635+0000","last_became_active":"2023-11-28T20:00:12.794166+0000","last_became_peered":"2023-11-28T20:00:12.794166+0000","last_unstale":"2023-11-28T20:00:30.773635+0000","last_undegraded":"2023-11-28T20:00:30.773635+0000","last_fullsized":"2023-11-28T20:00:30.773635+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:11.760656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:11.760656+0000","last_clean_scrub_stamp":"2023-11-28T20:00:11.760656+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:30:40.433274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-28T20:00:32.538801+0000","last_change":"2023-11-28T20:00:30.791273+0000","last_active":"2023-11-28T20:00:32.538801+0000","last_peered":"2023-11-28T20:00:32.538801+0000","last_clean":"2023-11-28T20:00:32.538801+0000","last_became_active":"2023-11-28T20:00:30.790585+0000","last_became_peered":"2023-11-28T20:00:30.790585+0000","last_unstale":"2023-11-28T20:00:32.538801+0000","last_undegraded":"2023-11-28T20:00:32.538801+0000","last_fullsized":"2023-11-28T20:00:32.538801+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:30.046728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:30.046728+0000","last_clean_scrub_stamp":"2023-11-28T20:00:30.046728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:46:15.348906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1f","version":"43'4","reported_seq":16,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-28T20:00:31.775220+0000","last_change":"2023-11-28T20:00:30.076849+0000","last_active":"2023-11-28T20:00:31.775220+0000","last_peered":"2023-11-28T20:00:31.775220+0000","last_clean":"2023-11-28T20:00:31.775220+0000","last_became_active":"2023-11-28T20:00:30.076510+0000","last_became_peered":"2023-11-28T20:00:30.076510+0000","last_unstale":"2023-11-28T20:00:31.775220+0000","last_undegraded":"2023-11-28T20:00:31.775220+0000","last_fullsized":"2023-11-28T20:00:31.775220+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:29.043480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:29.043480+0000","last_clean_scrub_stamp":"2023-11-28T20:00:29.043480+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:49:57.213516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":15,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-28T20:00:30.772492+0000","last_change":"2023-11-28T20:00:13.811214+0000","last_active":"2023-11-28T20:00:30.772492+0000","last_peered":"2023-11-28T20:00:30.772492+0000","last_clean":"2023-11-28T20:00:30.772492+0000","last_became_active":"2023-11-28T20:00:13.810824+0000","last_became_peered":"2023-11-28T20:00:13.810824+0000","last_unstale":"2023-11-28T20:00:30.772492+0000","last_undegraded":"2023-11-28T20:00:30.772492+0000","last_fullsized":"2023-11-28T20:00:30.772492+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_clean_scrub_stamp":"2023-11-28T20:00:12.764355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:18:18.464919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"39'2","reported_seq":18,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-28T20:00:30.776674+0000","last_change":"2023-11-28T20:00:12.797247+0000","last_active":"2023-11-28T20:00:30.776674+0000","last_peered":"2023-11-28T20:00:30.776674+0000","last_clean":"2023-11-28T20:00:30.776674+0000","last_became_active":"2023-11-28T20:00:12.797003+0000","last_became_peered":"2023-11-28T20:00:12.797003+0000","last_unstale":"2023-11-28T20:00:30.776674+0000","last_undegraded":"2023-11-28T20:00:30.776674+0000","last_fullsized":"2023-11-28T20:00:30.776674+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:11.760656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:11.760656+0000","last_clean_scrub_stamp":"2023-11-28T20:00:11.760656+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:39:04.449924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-28T20:00:32.539630+0000","last_change":"2023-11-28T20:00:30.797161+0000","last_active":"2023-11-28T20:00:32.539630+0000","last_peered":"2023-11-28T20:00:32.539630+0000","last_clean":"2023-11-28T20:00:32.539630+0000","last_became_active":"2023-11-28T20:00:30.796876+0000","last_became_peered":"2023-11-28T20:00:30.796876+0000","last_unstale":"2023-11-28T20:00:32.539630+0000","last_undegraded":"2023-11-28T20:00:32.539630+0000","last_fullsized":"2023-11-28T20:00:32.539630+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:30.046728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:30.046728+0000","last_clean_scrub_stamp":"2023-11-28T20:00:30.046728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:34:55.679879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.1e","version":"43'1","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-28T20:00:32.539574+0000","last_change":"2023-11-28T20:00:30.080305+0000","last_active":"2023-11-28T20:00:32.539574+0000","last_peered":"2023-11-28T20:00:32.539574+0000","last_clean":"2023-11-28T20:00:32.539574+0000","last_became_active":"2023-11-28T20:00:30.076149+0000","last_became_peered":"2023-11-28T20:00:30.076149+0000","last_unstale":"2023-11-28T20:00:32.539574+0000","last_undegraded":"2023-11-28T20:00:32.539574+0000","last_fullsized":"2023-11-28T20:00:32.539574+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:29.043480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:29.043480+0000","last_clean_scrub_stamp":"2023-11-28T20:00:29.043480+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:25:19.224251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":15,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-28T20:00:30.781101+0000","last_change":"2023-11-28T20:00:13.807462+0000","last_active":"2023-11-28T20:00:30.781101+0000","last_peered":"2023-11-28T20:00:30.781101+0000","last_clean":"2023-11-28T20:00:30.781101+0000","last_became_active":"2023-11-28T20:00:13.807149+0000","last_became_peered":"2023-11-28T20:00:13.807149+0000","last_unstale":"2023-11-28T20:00:30.781101+0000","last_undegraded":"2023-11-28T20:00:30.781101+0000","last_fullsized":"2023-11-28T20:00:30.781101+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_clean_scrub_stamp":"2023-11-28T20:00:12.764355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T07:28:33.623680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1c","version":"39'2","reported_seq":18,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-28T20:00:30.772604+0000","last_change":"2023-11-28T20:00:12.799178+0000","last_active":"2023-11-28T20:00:30.772604+0000","last_peered":"2023-11-28T20:00:30.772604+0000","last_clean":"2023-11-28T20:00:30.772604+0000","last_became_active":"2023-11-28T20:00:12.798834+0000","last_became_peered":"2023-11-28T20:00:12.798834+0000","last_unstale":"2023-11-28T20:00:30.772604+0000","last_undegraded":"2023-11-28T20:00:30.772604+0000","last_fullsized":"2023-11-28T20:00:30.772604+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:11.760656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:11.760656+0000","last_clean_scrub_stamp":"2023-11-28T20:00:11.760656+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:26:43.439645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-28T20:00:32.540237+0000","last_change":"2023-11-28T20:00:30.788683+0000","last_active":"2023-11-28T20:00:32.540237+0000","last_peered":"2023-11-28T20:00:32.540237+0000","last_clean":"2023-11-28T20:00:32.540237+0000","last_became_active":"2023-11-28T20:00:30.788001+0000","last_became_peered":"2023-11-28T20:00:30.788001+0000","last_unstale":"2023-11-28T20:00:32.540237+0000","last_undegraded":"2023-11-28T20:00:32.540237+0000","last_fullsized":"2023-11-28T20:00:32.540237+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:30.046728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:30.046728+0000","last_clean_scrub_stamp":"2023-11-28T20:00:30.046728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:48:57.427285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-28T20:00:31.773710+0000","last_change":"2023-11-28T20:00:30.075475+0000","last_active":"2023-11-28T20:00:31.773710+0000","last_peered":"2023-11-28T20:00:31.773710+0000","last_clean":"2023-11-28T20:00:31.773710+0000","last_became_active":"2023-11-28T20:00:30.075161+0000","last_became_peered":"2023-11-28T20:00:30.075161+0000","last_unstale":"2023-11-28T20:00:31.773710+0000","last_undegraded":"2023-11-28T20:00:31.773710+0000","last_fullsized":"2023-11-28T20:00:31.773710+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:29.043480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:29.043480+0000","last_clean_scrub_stamp":"2023-11-28T20:00:29.043480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:11:14.626066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":15,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-28T20:00:30.773036+0000","last_change":"2023-11-28T20:00:13.804415+0000","last_active":"2023-11-28T20:00:30.773036+0000","last_peered":"2023-11-28T20:00:30.773036+0000","last_clean":"2023-11-28T20:00:30.773036+0000","last_became_active":"2023-11-28T20:00:13.803965+0000","last_became_peered":"2023-11-28T20:00:13.803965+0000","last_unstale":"2023-11-28T20:00:30.773036+0000","last_undegraded":"2023-11-28T20:00:30.773036+0000","last_fullsized":"2023-11-28T20:00:30.773036+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_clean_scrub_stamp":"2023-11-28T20:00:12.764355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:31:40.964592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1b","version":"39'1","reported_seq":17,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-28T20:00:30.773156+0000","last_change":"2023-11-28T20:00:12.804157+0000","last_active":"2023-11-28T20:00:30.773156+0000","last_peered":"2023-11-28T20:00:30.773156+0000","last_clean":"2023-11-28T20:00:30.773156+0000","last_became_active":"2023-11-28T20:00:12.803950+0000","last_became_peered":"2023-11-28T20:00:12.803950+0000","last_unstale":"2023-11-28T20:00:30.773156+0000","last_undegraded":"2023-11-28T20:00:30.773156+0000","last_fullsized":"2023-11-28T20:00:30.773156+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:11.760656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:11.760656+0000","last_clean_scrub_stamp":"2023-11-28T20:00:11.760656+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T07:13:20.706540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-28T20:00:32.539604+0000","last_change":"2023-11-28T20:00:30.793136+0000","last_active":"2023-11-28T20:00:32.539604+0000","last_peered":"2023-11-28T20:00:32.539604+0000","last_clean":"2023-11-28T20:00:32.539604+0000","last_became_active":"2023-11-28T20:00:30.792829+0000","last_became_peered":"2023-11-28T20:00:30.792829+0000","last_unstale":"2023-11-28T20:00:32.539604+0000","last_undegraded":"2023-11-28T20:00:32.539604+0000","last_fullsized":"2023-11-28T20:00:32.539604+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:30.046728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:30.046728+0000","last_clean_scrub_stamp":"2023-11-28T20:00:30.046728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:25:09.519117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-28T20:00:32.538442+0000","last_change":"2023-11-28T20:00:30.081130+0000","last_active":"2023-11-28T20:00:32.538442+0000","last_peered":"2023-11-28T20:00:32.538442+0000","last_clean":"2023-11-28T20:00:32.538442+0000","last_became_active":"2023-11-28T20:00:30.080871+0000","last_became_peered":"2023-11-28T20:00:30.080871+0000","last_unstale":"2023-11-28T20:00:32.538442+0000","last_undegraded":"2023-11-28T20:00:32.538442+0000","last_fullsized":"2023-11-28T20:00:32.538442+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:29.043480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:29.043480+0000","last_clean_scrub_stamp":"2023-11-28T20:00:29.043480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:17:59.027188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":15,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-28T20:00:30.770807+0000","last_change":"2023-11-28T20:00:13.797465+0000","last_active":"2023-11-28T20:00:30.770807+0000","last_peered":"2023-11-28T20:00:30.770807+0000","last_clean":"2023-11-28T20:00:30.770807+0000","last_became_active":"2023-11-28T20:00:13.797106+0000","last_became_peered":"2023-11-28T20:00:13.797106+0000","last_unstale":"2023-11-28T20:00:30.770807+0000","last_undegraded":"2023-11-28T20:00:30.770807+0000","last_fullsized":"2023-11-28T20:00:30.770807+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_clean_scrub_stamp":"2023-11-28T20:00:12.764355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T07:56:05.039809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"39'1","reported_seq":17,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-28T20:00:30.776973+0000","last_change":"2023-11-28T20:00:12.797188+0000","last_active":"2023-11-28T20:00:30.776973+0000","last_peered":"2023-11-28T20:00:30.776973+0000","last_clean":"2023-11-28T20:00:30.776973+0000","last_became_active":"2023-11-28T20:00:12.796926+0000","last_became_peered":"2023-11-28T20:00:12.796926+0000","last_unstale":"2023-11-28T20:00:30.776973+0000","last_undegraded":"2023-11-28T20:00:30.776973+0000","last_fullsized":"2023-11-28T20:00:30.776973+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:11.760656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:11.760656+0000","last_clean_scrub_stamp":"2023-11-28T20:00:11.760656+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:38:54.348106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-28T20:00:31.774813+0000","last_change":"2023-11-28T20:00:30.789486+0000","last_active":"2023-11-28T20:00:31.774813+0000","last_peered":"2023-11-28T20:00:31.774813+0000","last_clean":"2023-11-28T20:00:31.774813+0000","last_became_active":"2023-11-28T20:00:30.789180+0000","last_became_peered":"2023-11-28T20:00:30.789180+0000","last_unstale":"2023-11-28T20:00:31.774813+0000","last_undegraded":"2023-11-28T20:00:31.774813+0000","last_fullsized":"2023-11-28T20:00:31.774813+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:30.046728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:30.046728+0000","last_clean_scrub_stamp":"2023-11-28T20:00:30.046728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:42:59.685012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"43'1","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-28T20:00:32.538263+0000","last_change":"2023-11-28T20:00:30.083747+0000","last_active":"2023-11-28T20:00:32.538263+0000","last_peered":"2023-11-28T20:00:32.538263+0000","last_clean":"2023-11-28T20:00:32.538263+0000","last_became_active":"2023-11-28T20:00:30.083432+0000","last_became_peered":"2023-11-28T20:00:30.083432+0000","last_unstale":"2023-11-28T20:00:32.538263+0000","last_undegraded":"2023-11-28T20:00:32.538263+0000","last_fullsized":"2023-11-28T20:00:32.538263+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:29.043480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:29.043480+0000","last_clean_scrub_stamp":"2023-11-28T20:00:29.043480+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:43:46.204876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":15,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-28T20:00:30.772541+0000","last_change":"2023-11-28T20:00:13.789303+0000","last_active":"2023-11-28T20:00:30.772541+0000","last_peered":"2023-11-28T20:00:30.772541+0000","last_clean":"2023-11-28T20:00:30.772541+0000","last_became_active":"2023-11-28T20:00:13.788505+0000","last_became_peered":"2023-11-28T20:00:13.788505+0000","last_unstale":"2023-11-28T20:00:30.772541+0000","last_undegraded":"2023-11-28T20:00:30.772541+0000","last_fullsized":"2023-11-28T20:00:30.772541+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_clean_scrub_stamp":"2023-11-28T20:00:12.764355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:22:33.214424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":16,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-28T20:00:30.777036+0000","last_change":"2023-11-28T20:00:12.805374+0000","last_active":"2023-11-28T20:00:30.777036+0000","last_peered":"2023-11-28T20:00:30.777036+0000","last_clean":"2023-11-28T20:00:30.777036+0000","last_became_active":"2023-11-28T20:00:12.805094+0000","last_became_peered":"2023-11-28T20:00:12.805094+0000","last_unstale":"2023-11-28T20:00:30.777036+0000","last_undegraded":"2023-11-28T20:00:30.777036+0000","last_fullsized":"2023-11-28T20:00:30.777036+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:11.760656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:11.760656+0000","last_clean_scrub_stamp":"2023-11-28T20:00:11.760656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T07:54:02.325947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-28T20:00:32.540440+0000","last_change":"2023-11-28T20:00:30.795298+0000","last_active":"2023-11-28T20:00:32.540440+0000","last_peered":"2023-11-28T20:00:32.540440+0000","last_clean":"2023-11-28T20:00:32.540440+0000","last_became_active":"2023-11-28T20:00:30.795033+0000","last_became_peered":"2023-11-28T20:00:30.795033+0000","last_unstale":"2023-11-28T20:00:32.540440+0000","last_undegraded":"2023-11-28T20:00:32.540440+0000","last_fullsized":"2023-11-28T20:00:32.540440+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:30.046728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:30.046728+0000","last_clean_scrub_stamp":"2023-11-28T20:00:30.046728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:56:08.338193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1a","version":"43'1","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-28T20:00:31.774441+0000","last_change":"2023-11-28T20:00:30.078861+0000","last_active":"2023-11-28T20:00:31.774441+0000","last_peered":"2023-11-28T20:00:31.774441+0000","last_clean":"2023-11-28T20:00:31.774441+0000","last_became_active":"2023-11-28T20:00:30.078549+0000","last_became_peered":"2023-11-28T20:00:30.078549+0000","last_unstale":"2023-11-28T20:00:31.774441+0000","last_undegraded":"2023-11-28T20:00:31.774441+0000","last_fullsized":"2023-11-28T20:00:31.774441+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:29.043480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:29.043480+0000","last_clean_scrub_stamp":"2023-11-28T20:00:29.043480+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T07:56:21.318933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":15,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-28T20:00:30.775631+0000","last_change":"2023-11-28T20:00:13.823014+0000","last_active":"2023-11-28T20:00:30.775631+0000","last_peered":"2023-11-28T20:00:30.775631+0000","last_clean":"2023-11-28T20:00:30.775631+0000","last_became_active":"2023-11-28T20:00:13.822506+0000","last_became_peered":"2023-11-28T20:00:13.822506+0000","last_unstale":"2023-11-28T20:00:30.775631+0000","last_undegraded":"2023-11-28T20:00:30.775631+0000","last_fullsized":"2023-11-28T20:00:30.775631+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_clean_scrub_stamp":"2023-11-28T20:00:12.764355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:05:44.634045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":16,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-28T20:00:30.770920+0000","last_change":"2023-11-28T20:00:12.797265+0000","last_active":"2023-11-28T20:00:30.770920+0000","last_peered":"2023-11-28T20:00:30.770920+0000","last_clean":"2023-11-28T20:00:30.770920+0000","last_became_active":"2023-11-28T20:00:12.794418+0000","last_became_peered":"2023-11-28T20:00:12.794418+0000","last_unstale":"2023-11-28T20:00:30.770920+0000","last_undegraded":"2023-11-28T20:00:30.770920+0000","last_fullsized":"2023-11-28T20:00:30.770920+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:11.760656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:11.760656+0000","last_clean_scrub_stamp":"2023-11-28T20:00:11.760656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:38:54.348106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-28T20:00:32.538943+0000","last_change":"2023-11-28T20:00:30.794519+0000","last_active":"2023-11-28T20:00:32.538943+0000","last_peered":"2023-11-28T20:00:32.538943+0000","last_clean":"2023-11-28T20:00:32.538943+0000","last_became_active":"2023-11-28T20:00:30.793219+0000","last_became_peered":"2023-11-28T20:00:30.793219+0000","last_unstale":"2023-11-28T20:00:32.538943+0000","last_undegraded":"2023-11-28T20:00:32.538943+0000","last_fullsized":"2023-11-28T20:00:32.538943+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:30.046728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:30.046728+0000","last_clean_scrub_stamp":"2023-11-28T20:00:30.046728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:13:46.025769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.15","version":"43'3","reported_seq":15,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-28T20:00:32.540227+0000","last_change":"2023-11-28T20:00:30.082422+0000","last_active":"2023-11-28T20:00:32.540227+0000","last_peered":"2023-11-28T20:00:32.540227+0000","last_clean":"2023-11-28T20:00:32.540227+0000","last_became_active":"2023-11-28T20:00:30.082176+0000","last_became_peered":"2023-11-28T20:00:30.082176+0000","last_unstale":"2023-11-28T20:00:32.540227+0000","last_undegraded":"2023-11-28T20:00:32.540227+0000","last_fullsized":"2023-11-28T20:00:32.540227+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:29.043480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:29.043480+0000","last_clean_scrub_stamp":"2023-11-28T20:00:29.043480+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:33:05.399774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":15,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-28T20:00:30.767953+0000","last_change":"2023-11-28T20:00:13.797846+0000","last_active":"2023-11-28T20:00:30.767953+0000","last_peered":"2023-11-28T20:00:30.767953+0000","last_clean":"2023-11-28T20:00:30.767953+0000","last_became_active":"2023-11-28T20:00:13.797542+0000","last_became_peered":"2023-11-28T20:00:13.797542+0000","last_unstale":"2023-11-28T20:00:30.767953+0000","last_undegraded":"2023-11-28T20:00:30.767953+0000","last_fullsized":"2023-11-28T20:00:30.767953+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_clean_scrub_stamp":"2023-11-28T20:00:12.764355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:19:34.223422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":16,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-28T20:00:30.781254+0000","last_change":"2023-11-28T20:00:12.796227+0000","last_active":"2023-11-28T20:00:30.781254+0000","last_peered":"2023-11-28T20:00:30.781254+0000","last_clean":"2023-11-28T20:00:30.781254+0000","last_became_active":"2023-11-28T20:00:12.795944+0000","last_became_peered":"2023-11-28T20:00:12.795944+0000","last_unstale":"2023-11-28T20:00:30.781254+0000","last_undegraded":"2023-11-28T20:00:30.781254+0000","last_fullsized":"2023-11-28T20:00:30.781254+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:11.760656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:11.760656+0000","last_clean_scrub_stamp":"2023-11-28T20:00:11.760656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:29:19.380485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-28T20:00:31.774645+0000","last_change":"2023-11-28T20:00:30.781609+0000","last_active":"2023-11-28T20:00:31.774645+0000","last_peered":"2023-11-28T20:00:31.774645+0000","last_clean":"2023-11-28T20:00:31.774645+0000","last_became_active":"2023-11-28T20:00:30.781300+0000","last_became_peered":"2023-11-28T20:00:30.781300+0000","last_unstale":"2023-11-28T20:00:31.774645+0000","last_undegraded":"2023-11-28T20:00:31.774645+0000","last_fullsized":"2023-11-28T20:00:31.774645+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:30.046728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:30.046728+0000","last_clean_scrub_stamp":"2023-11-28T20:00:30.046728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:59:52.481708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.14","version":"43'6","reported_seq":18,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-28T20:00:32.539482+0000","last_change":"2023-11-28T20:00:30.076515+0000","last_active":"2023-11-28T20:00:32.539482+0000","last_peered":"2023-11-28T20:00:32.539482+0000","last_clean":"2023-11-28T20:00:32.539482+0000","last_became_active":"2023-11-28T20:00:30.076249+0000","last_became_peered":"2023-11-28T20:00:30.076249+0000","last_unstale":"2023-11-28T20:00:32.539482+0000","last_undegraded":"2023-11-28T20:00:32.539482+0000","last_fullsized":"2023-11-28T20:00:32.539482+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:29.043480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:29.043480+0000","last_clean_scrub_stamp":"2023-11-28T20:00:29.043480+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:14:47.879065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":15,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-28T20:00:30.781215+0000","last_change":"2023-11-28T20:00:13.825114+0000","last_active":"2023-11-28T20:00:30.781215+0000","last_peered":"2023-11-28T20:00:30.781215+0000","last_clean":"2023-11-28T20:00:30.781215+0000","last_became_active":"2023-11-28T20:00:13.824561+0000","last_became_peered":"2023-11-28T20:00:13.824561+0000","last_unstale":"2023-11-28T20:00:30.781215+0000","last_undegraded":"2023-11-28T20:00:30.781215+0000","last_fullsized":"2023-11-28T20:00:30.781215+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_clean_scrub_stamp":"2023-11-28T20:00:12.764355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:40:01.114533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":16,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-28T20:00:30.775240+0000","last_change":"2023-11-28T20:00:12.803866+0000","last_active":"2023-11-28T20:00:30.775240+0000","last_peered":"2023-11-28T20:00:30.775240+0000","last_clean":"2023-11-28T20:00:30.775240+0000","last_became_active":"2023-11-28T20:00:12.803431+0000","last_became_peered":"2023-11-28T20:00:12.803431+0000","last_unstale":"2023-11-28T20:00:30.775240+0000","last_undegraded":"2023-11-28T20:00:30.775240+0000","last_fullsized":"2023-11-28T20:00:30.775240+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:11.760656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:11.760656+0000","last_clean_scrub_stamp":"2023-11-28T20:00:11.760656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:49:02.704178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-28T20:00:31.773822+0000","last_change":"2023-11-28T20:00:30.785060+0000","last_active":"2023-11-28T20:00:31.773822+0000","last_peered":"2023-11-28T20:00:31.773822+0000","last_clean":"2023-11-28T20:00:31.773822+0000","last_became_active":"2023-11-28T20:00:30.784872+0000","last_became_peered":"2023-11-28T20:00:30.784872+0000","last_unstale":"2023-11-28T20:00:31.773822+0000","last_undegraded":"2023-11-28T20:00:31.773822+0000","last_fullsized":"2023-11-28T20:00:31.773822+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:30.046728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:30.046728+0000","last_clean_scrub_stamp":"2023-11-28T20:00:30.046728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:06:01.916418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-28T20:00:32.539655+0000","last_change":"2023-11-28T20:00:30.081533+0000","last_active":"2023-11-28T20:00:32.539655+0000","last_peered":"2023-11-28T20:00:32.539655+0000","last_clean":"2023-11-28T20:00:32.539655+0000","last_became_active":"2023-11-28T20:00:30.081223+0000","last_became_peered":"2023-11-28T20:00:30.081223+0000","last_unstale":"2023-11-28T20:00:32.539655+0000","last_undegraded":"2023-11-28T20:00:32.539655+0000","last_fullsized":"2023-11-28T20:00:32.539655+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:29.043480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:29.043480+0000","last_clean_scrub_stamp":"2023-11-28T20:00:29.043480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:13:38.598917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":15,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-28T20:00:30.773411+0000","last_change":"2023-11-28T20:00:13.826789+0000","last_active":"2023-11-28T20:00:30.773411+0000","last_peered":"2023-11-28T20:00:30.773411+0000","last_clean":"2023-11-28T20:00:30.773411+0000","last_became_active":"2023-11-28T20:00:13.826523+0000","last_became_peered":"2023-11-28T20:00:13.826523+0000","last_unstale":"2023-11-28T20:00:30.773411+0000","last_undegraded":"2023-11-28T20:00:30.773411+0000","last_fullsized":"2023-11-28T20:00:30.773411+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_clean_scrub_stamp":"2023-11-28T20:00:12.764355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:04:36.627323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.15","version":"39'3","reported_seq":19,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-28T20:00:30.774829+0000","last_change":"2023-11-28T20:00:12.804096+0000","last_active":"2023-11-28T20:00:30.774829+0000","last_peered":"2023-11-28T20:00:30.774829+0000","last_clean":"2023-11-28T20:00:30.774829+0000","last_became_active":"2023-11-28T20:00:12.803797+0000","last_became_peered":"2023-11-28T20:00:12.803797+0000","last_unstale":"2023-11-28T20:00:30.774829+0000","last_undegraded":"2023-11-28T20:00:30.774829+0000","last_fullsized":"2023-11-28T20:00:30.774829+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:11.760656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:11.760656+0000","last_clean_scrub_stamp":"2023-11-28T20:00:11.760656+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:32:44.540527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-28T20:00:32.539483+0000","last_change":"2023-11-28T20:00:30.784327+0000","last_active":"2023-11-28T20:00:32.539483+0000","last_peered":"2023-11-28T20:00:32.539483+0000","last_clean":"2023-11-28T20:00:32.539483+0000","last_became_active":"2023-11-28T20:00:30.784034+0000","last_became_peered":"2023-11-28T20:00:30.784034+0000","last_unstale":"2023-11-28T20:00:32.539483+0000","last_undegraded":"2023-11-28T20:00:32.539483+0000","last_fullsized":"2023-11-28T20:00:32.539483+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:30.046728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:30.046728+0000","last_clean_scrub_stamp":"2023-11-28T20:00:30.046728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:56:08.338193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-28T20:00:31.775044+0000","last_change":"2023-11-28T20:00:30.085221+0000","last_active":"2023-11-28T20:00:31.775044+0000","last_peered":"2023-11-28T20:00:31.775044+0000","last_clean":"2023-11-28T20:00:31.775044+0000","last_became_active":"2023-11-28T20:00:30.084954+0000","last_became_peered":"2023-11-28T20:00:30.084954+0000","last_unstale":"2023-11-28T20:00:31.775044+0000","last_undegraded":"2023-11-28T20:00:31.775044+0000","last_fullsized":"2023-11-28T20:00:31.775044+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:29.043480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:29.043480+0000","last_clean_scrub_stamp":"2023-11-28T20:00:29.043480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:44:41.774972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":15,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-28T20:00:30.772799+0000","last_change":"2023-11-28T20:00:13.806380+0000","last_active":"2023-11-28T20:00:30.772799+0000","last_peered":"2023-11-28T20:00:30.772799+0000","last_clean":"2023-11-28T20:00:30.772799+0000","last_became_active":"2023-11-28T20:00:13.805390+0000","last_became_peered":"2023-11-28T20:00:13.805390+0000","last_unstale":"2023-11-28T20:00:30.772799+0000","last_undegraded":"2023-11-28T20:00:30.772799+0000","last_fullsized":"2023-11-28T20:00:30.772799+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_clean_scrub_stamp":"2023-11-28T20:00:12.764355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:30:41.436973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.14","version":"40'9","reported_seq":25,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-28T20:00:30.776018+0000","last_change":"2023-11-28T20:00:12.797894+0000","last_active":"2023-11-28T20:00:30.776018+0000","last_peered":"2023-11-28T20:00:30.776018+0000","last_clean":"2023-11-28T20:00:30.776018+0000","last_became_active":"2023-11-28T20:00:12.797594+0000","last_became_peered":"2023-11-28T20:00:12.797594+0000","last_unstale":"2023-11-28T20:00:30.776018+0000","last_undegraded":"2023-11-28T20:00:30.776018+0000","last_fullsized":"2023-11-28T20:00:30.776018+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:11.760656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:11.760656+0000","last_clean_scrub_stamp":"2023-11-28T20:00:11.760656+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:40:00.110834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3107,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-28T20:00:32.539445+0000","last_change":"2023-11-28T20:00:30.791864+0000","last_active":"2023-11-28T20:00:32.539445+0000","last_peered":"2023-11-28T20:00:32.539445+0000","last_clean":"2023-11-28T20:00:32.539445+0000","last_became_active":"2023-11-28T20:00:30.791567+0000","last_became_peered":"2023-11-28T20:00:30.791567+0000","last_unstale":"2023-11-28T20:00:32.539445+0000","last_undegraded":"2023-11-28T20:00:32.539445+0000","last_fullsized":"2023-11-28T20:00:32.539445+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:30.046728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:30.046728+0000","last_clean_scrub_stamp":"2023-11-28T20:00:30.046728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T07:21:05.844805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-28T20:00:32.539401+0000","last_change":"2023-11-28T20:00:30.080284+0000","last_active":"2023-11-28T20:00:32.539401+0000","last_peered":"2023-11-28T20:00:32.539401+0000","last_clean":"2023-11-28T20:00:32.539401+0000","last_became_active":"2023-11-28T20:00:30.080044+0000","last_became_peered":"2023-11-28T20:00:30.080044+0000","last_unstale":"2023-11-28T20:00:32.539401+0000","last_undegraded":"2023-11-28T20:00:32.539401+0000","last_fullsized":"2023-11-28T20:00:32.539401+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:29.043480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:29.043480+0000","last_clean_scrub_stamp":"2023-11-28T20:00:29.043480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:25:19.224251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":15,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-28T20:00:30.773052+0000","last_change":"2023-11-28T20:00:13.804236+0000","last_active":"2023-11-28T20:00:30.773052+0000","last_peered":"2023-11-28T20:00:30.773052+0000","last_clean":"2023-11-28T20:00:30.773052+0000","last_became_active":"2023-11-28T20:00:13.803605+0000","last_became_peered":"2023-11-28T20:00:13.803605+0000","last_unstale":"2023-11-28T20:00:30.773052+0000","last_undegraded":"2023-11-28T20:00:30.773052+0000","last_fullsized":"2023-11-28T20:00:30.773052+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_clean_scrub_stamp":"2023-11-28T20:00:12.764355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:18:18.464919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"39'2","reported_seq":18,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-28T20:00:30.775885+0000","last_change":"2023-11-28T20:00:12.794915+0000","last_active":"2023-11-28T20:00:30.775885+0000","last_peered":"2023-11-28T20:00:30.775885+0000","last_clean":"2023-11-28T20:00:30.775885+0000","last_became_active":"2023-11-28T20:00:12.793728+0000","last_became_peered":"2023-11-28T20:00:12.793728+0000","last_unstale":"2023-11-28T20:00:30.775885+0000","last_undegraded":"2023-11-28T20:00:30.775885+0000","last_fullsized":"2023-11-28T20:00:30.775885+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:11.760656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:11.760656+0000","last_clean_scrub_stamp":"2023-11-28T20:00:11.760656+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:18:26.871119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-28T20:00:32.540901+0000","last_change":"2023-11-28T20:00:30.790841+0000","last_active":"2023-11-28T20:00:32.540901+0000","last_peered":"2023-11-28T20:00:32.540901+0000","last_clean":"2023-11-28T20:00:32.540901+0000","last_became_active":"2023-11-28T20:00:30.790458+0000","last_became_peered":"2023-11-28T20:00:30.790458+0000","last_unstale":"2023-11-28T20:00:32.540901+0000","last_undegraded":"2023-11-28T20:00:32.540901+0000","last_fullsized":"2023-11-28T20:00:32.540901+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:30.046728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:30.046728+0000","last_clean_scrub_stamp":"2023-11-28T20:00:30.046728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:22:39.781488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.10","version":"43'8","reported_seq":20,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-28T20:00:32.539219+0000","last_change":"2023-11-28T20:00:30.068372+0000","last_active":"2023-11-28T20:00:32.539219+0000","last_peered":"2023-11-28T20:00:32.539219+0000","last_clean":"2023-11-28T20:00:32.539219+0000","last_became_active":"2023-11-28T20:00:30.068144+0000","last_became_peered":"2023-11-28T20:00:30.068144+0000","last_unstale":"2023-11-28T20:00:32.539219+0000","last_undegraded":"2023-11-28T20:00:32.539219+0000","last_fullsized":"2023-11-28T20:00:32.539219+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:29.043480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:29.043480+0000","last_clean_scrub_stamp":"2023-11-28T20:00:29.043480+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T07:01:33.458270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":15,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-28T20:00:30.775729+0000","last_change":"2023-11-28T20:00:13.804139+0000","last_active":"2023-11-28T20:00:30.775729+0000","last_peered":"2023-11-28T20:00:30.775729+0000","last_clean":"2023-11-28T20:00:30.775729+0000","last_became_active":"2023-11-28T20:00:13.803848+0000","last_became_peered":"2023-11-28T20:00:13.803848+0000","last_unstale":"2023-11-28T20:00:30.775729+0000","last_undegraded":"2023-11-28T20:00:30.775729+0000","last_fullsized":"2023-11-28T20:00:30.775729+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_clean_scrub_stamp":"2023-11-28T20:00:12.764355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:10:58.346942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":16,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-28T20:00:30.776930+0000","last_change":"2023-11-28T20:00:12.805313+0000","last_active":"2023-11-28T20:00:30.776930+0000","last_peered":"2023-11-28T20:00:30.776930+0000","last_clean":"2023-11-28T20:00:30.776930+0000","last_became_active":"2023-11-28T20:00:12.804998+0000","last_became_peered":"2023-11-28T20:00:12.804998+0000","last_unstale":"2023-11-28T20:00:30.776930+0000","last_undegraded":"2023-11-28T20:00:30.776930+0000","last_fullsized":"2023-11-28T20:00:30.776930+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:11.760656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:11.760656+0000","last_clean_scrub_stamp":"2023-11-28T20:00:11.760656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:42:32.303144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-28T20:00:32.539918+0000","last_change":"2023-11-28T20:00:30.791310+0000","last_active":"2023-11-28T20:00:32.539918+0000","last_peered":"2023-11-28T20:00:32.539918+0000","last_clean":"2023-11-28T20:00:32.539918+0000","last_became_active":"2023-11-28T20:00:30.791007+0000","last_became_peered":"2023-11-28T20:00:30.791007+0000","last_unstale":"2023-11-28T20:00:32.539918+0000","last_undegraded":"2023-11-28T20:00:32.539918+0000","last_fullsized":"2023-11-28T20:00:32.539918+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:30.046728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:30.046728+0000","last_clean_scrub_stamp":"2023-11-28T20:00:30.046728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:00:10.316375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.13","version":"43'2","reported_seq":14,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-28T20:00:32.538365+0000","last_change":"2023-11-28T20:00:30.084053+0000","last_active":"2023-11-28T20:00:32.538365+0000","last_peered":"2023-11-28T20:00:32.538365+0000","last_clean":"2023-11-28T20:00:32.538365+0000","last_became_active":"2023-11-28T20:00:30.083833+0000","last_became_peered":"2023-11-28T20:00:30.083833+0000","last_unstale":"2023-11-28T20:00:32.538365+0000","last_undegraded":"2023-11-28T20:00:32.538365+0000","last_fullsized":"2023-11-28T20:00:32.538365+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:29.043480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:29.043480+0000","last_clean_scrub_stamp":"2023-11-28T20:00:29.043480+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:06:53.405406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":15,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-28T20:00:30.776844+0000","last_change":"2023-11-28T20:00:13.822076+0000","last_active":"2023-11-28T20:00:30.776844+0000","last_peered":"2023-11-28T20:00:30.776844+0000","last_clean":"2023-11-28T20:00:30.776844+0000","last_became_active":"2023-11-28T20:00:13.821470+0000","last_became_peered":"2023-11-28T20:00:13.821470+0000","last_unstale":"2023-11-28T20:00:30.776844+0000","last_undegraded":"2023-11-28T20:00:30.776844+0000","last_fullsized":"2023-11-28T20:00:30.776844+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_clean_scrub_stamp":"2023-11-28T20:00:12.764355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T07:13:21.710239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":16,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-28T20:00:30.784904+0000","last_change":"2023-11-28T20:00:12.789146+0000","last_active":"2023-11-28T20:00:30.784904+0000","last_peered":"2023-11-28T20:00:30.784904+0000","last_clean":"2023-11-28T20:00:30.784904+0000","last_became_active":"2023-11-28T20:00:12.788447+0000","last_became_peered":"2023-11-28T20:00:12.788447+0000","last_unstale":"2023-11-28T20:00:30.784904+0000","last_undegraded":"2023-11-28T20:00:30.784904+0000","last_fullsized":"2023-11-28T20:00:30.784904+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:11.760656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:11.760656+0000","last_clean_scrub_stamp":"2023-11-28T20:00:11.760656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:09:51.354913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-28T20:00:32.538648+0000","last_change":"2023-11-28T20:00:30.785021+0000","last_active":"2023-11-28T20:00:32.538648+0000","last_peered":"2023-11-28T20:00:32.538648+0000","last_clean":"2023-11-28T20:00:32.538648+0000","last_became_active":"2023-11-28T20:00:30.784733+0000","last_became_peered":"2023-11-28T20:00:30.784733+0000","last_unstale":"2023-11-28T20:00:32.538648+0000","last_undegraded":"2023-11-28T20:00:32.538648+0000","last_fullsized":"2023-11-28T20:00:32.538648+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:30.046728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:30.046728+0000","last_clean_scrub_stamp":"2023-11-28T20:00:30.046728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:03:01.615268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-28T20:00:31.774185+0000","last_change":"2023-11-28T20:00:30.084831+0000","last_active":"2023-11-28T20:00:31.774185+0000","last_peered":"2023-11-28T20:00:31.774185+0000","last_clean":"2023-11-28T20:00:31.774185+0000","last_became_active":"2023-11-28T20:00:30.084546+0000","last_became_peered":"2023-11-28T20:00:30.084546+0000","last_unstale":"2023-11-28T20:00:31.774185+0000","last_undegraded":"2023-11-28T20:00:31.774185+0000","last_fullsized":"2023-11-28T20:00:31.774185+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:29.043480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:29.043480+0000","last_clean_scrub_stamp":"2023-11-28T20:00:29.043480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:06:00.913169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":15,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-28T20:00:30.775713+0000","last_change":"2023-11-28T20:00:13.804984+0000","last_active":"2023-11-28T20:00:30.775713+0000","last_peered":"2023-11-28T20:00:30.775713+0000","last_clean":"2023-11-28T20:00:30.775713+0000","last_became_active":"2023-11-28T20:00:13.804281+0000","last_became_peered":"2023-11-28T20:00:13.804281+0000","last_unstale":"2023-11-28T20:00:30.775713+0000","last_undegraded":"2023-11-28T20:00:30.775713+0000","last_fullsized":"2023-11-28T20:00:30.775713+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_clean_scrub_stamp":"2023-11-28T20:00:12.764355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:49:40.934392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"39'8","reported_seq":24,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-28T20:00:30.776620+0000","last_change":"2023-11-28T20:00:12.799040+0000","last_active":"2023-11-28T20:00:30.776620+0000","last_peered":"2023-11-28T20:00:30.776620+0000","last_clean":"2023-11-28T20:00:30.776620+0000","last_became_active":"2023-11-28T20:00:12.798730+0000","last_became_peered":"2023-11-28T20:00:12.798730+0000","last_unstale":"2023-11-28T20:00:30.776620+0000","last_undegraded":"2023-11-28T20:00:30.776620+0000","last_fullsized":"2023-11-28T20:00:30.776620+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:11.760656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:11.760656+0000","last_clean_scrub_stamp":"2023-11-28T20:00:11.760656+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:26:43.439645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-28T20:00:31.774345+0000","last_change":"2023-11-28T20:00:30.789664+0000","last_active":"2023-11-28T20:00:31.774345+0000","last_peered":"2023-11-28T20:00:31.774345+0000","last_clean":"2023-11-28T20:00:31.774345+0000","last_became_active":"2023-11-28T20:00:30.789300+0000","last_became_peered":"2023-11-28T20:00:30.789300+0000","last_unstale":"2023-11-28T20:00:31.774345+0000","last_undegraded":"2023-11-28T20:00:31.774345+0000","last_fullsized":"2023-11-28T20:00:31.774345+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:30.046728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:30.046728+0000","last_clean_scrub_stamp":"2023-11-28T20:00:30.046728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:11:14.457229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.d","version":"43'1","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-28T20:00:31.774702+0000","last_change":"2023-11-28T20:00:30.077369+0000","last_active":"2023-11-28T20:00:31.774702+0000","last_peered":"2023-11-28T20:00:31.774702+0000","last_clean":"2023-11-28T20:00:31.774702+0000","last_became_active":"2023-11-28T20:00:30.077023+0000","last_became_peered":"2023-11-28T20:00:30.077023+0000","last_unstale":"2023-11-28T20:00:31.774702+0000","last_undegraded":"2023-11-28T20:00:31.774702+0000","last_fullsized":"2023-11-28T20:00:31.774702+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:29.043480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:29.043480+0000","last_clean_scrub_stamp":"2023-11-28T20:00:29.043480+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:59:51.478460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":15,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-28T20:00:30.775856+0000","last_change":"2023-11-28T20:00:13.812428+0000","last_active":"2023-11-28T20:00:30.775856+0000","last_peered":"2023-11-28T20:00:30.775856+0000","last_clean":"2023-11-28T20:00:30.775856+0000","last_became_active":"2023-11-28T20:00:13.812074+0000","last_became_peered":"2023-11-28T20:00:13.812074+0000","last_unstale":"2023-11-28T20:00:30.775856+0000","last_undegraded":"2023-11-28T20:00:30.775856+0000","last_fullsized":"2023-11-28T20:00:30.775856+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_clean_scrub_stamp":"2023-11-28T20:00:12.764355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:21:55.649385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"39'1","reported_seq":17,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-28T20:00:30.775379+0000","last_change":"2023-11-28T20:00:12.803142+0000","last_active":"2023-11-28T20:00:30.775379+0000","last_peered":"2023-11-28T20:00:30.775379+0000","last_clean":"2023-11-28T20:00:30.775379+0000","last_became_active":"2023-11-28T20:00:12.802775+0000","last_became_peered":"2023-11-28T20:00:12.802775+0000","last_unstale":"2023-11-28T20:00:30.775379+0000","last_undegraded":"2023-11-28T20:00:30.775379+0000","last_fullsized":"2023-11-28T20:00:30.775379+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:11.760656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:11.760656+0000","last_clean_scrub_stamp":"2023-11-28T20:00:11.760656+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:18:26.871119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-28T20:00:32.539219+0000","last_change":"2023-11-28T20:00:30.788314+0000","last_active":"2023-11-28T20:00:32.539219+0000","last_peered":"2023-11-28T20:00:32.539219+0000","last_clean":"2023-11-28T20:00:32.539219+0000","last_became_active":"2023-11-28T20:00:30.788071+0000","last_became_peered":"2023-11-28T20:00:30.788071+0000","last_unstale":"2023-11-28T20:00:32.539219+0000","last_undegraded":"2023-11-28T20:00:32.539219+0000","last_fullsized":"2023-11-28T20:00:32.539219+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:30.046728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:30.046728+0000","last_clean_scrub_stamp":"2023-11-28T20:00:30.046728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:46:15.348906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-28T20:00:31.774972+0000","last_change":"2023-11-28T20:00:30.077814+0000","last_active":"2023-11-28T20:00:31.774972+0000","last_peered":"2023-11-28T20:00:31.774972+0000","last_clean":"2023-11-28T20:00:31.774972+0000","last_became_active":"2023-11-28T20:00:30.077381+0000","last_became_peered":"2023-11-28T20:00:30.077381+0000","last_unstale":"2023-11-28T20:00:31.774972+0000","last_undegraded":"2023-11-28T20:00:31.774972+0000","last_fullsized":"2023-11-28T20:00:31.774972+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:29.043480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:29.043480+0000","last_clean_scrub_stamp":"2023-11-28T20:00:29.043480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:11:13.453981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":15,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-28T20:00:30.774742+0000","last_change":"2023-11-28T20:00:13.815547+0000","last_active":"2023-11-28T20:00:30.774742+0000","last_peered":"2023-11-28T20:00:30.774742+0000","last_clean":"2023-11-28T20:00:30.774742+0000","last_became_active":"2023-11-28T20:00:13.813153+0000","last_became_peered":"2023-11-28T20:00:13.813153+0000","last_unstale":"2023-11-28T20:00:30.774742+0000","last_undegraded":"2023-11-28T20:00:30.774742+0000","last_fullsized":"2023-11-28T20:00:30.774742+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_clean_scrub_stamp":"2023-11-28T20:00:12.764355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:05:44.634045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.e","version":"39'2","reported_seq":18,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-28T20:00:30.772582+0000","last_change":"2023-11-28T20:00:12.806331+0000","last_active":"2023-11-28T20:00:30.772582+0000","last_peered":"2023-11-28T20:00:30.772582+0000","last_clean":"2023-11-28T20:00:30.772582+0000","last_became_active":"2023-11-28T20:00:12.805857+0000","last_became_peered":"2023-11-28T20:00:12.805857+0000","last_unstale":"2023-11-28T20:00:30.772582+0000","last_undegraded":"2023-11-28T20:00:30.772582+0000","last_fullsized":"2023-11-28T20:00:30.772582+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:11.760656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:11.760656+0000","last_clean_scrub_stamp":"2023-11-28T20:00:11.760656+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T07:54:02.325947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-28T20:00:32.539068+0000","last_change":"2023-11-28T20:00:30.781213+0000","last_active":"2023-11-28T20:00:32.539068+0000","last_peered":"2023-11-28T20:00:32.539068+0000","last_clean":"2023-11-28T20:00:32.539068+0000","last_became_active":"2023-11-28T20:00:30.780900+0000","last_became_peered":"2023-11-28T20:00:30.780900+0000","last_unstale":"2023-11-28T20:00:32.539068+0000","last_undegraded":"2023-11-28T20:00:32.539068+0000","last_fullsized":"2023-11-28T20:00:32.539068+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:30.046728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:30.046728+0000","last_clean_scrub_stamp":"2023-11-28T20:00:30.046728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:56:15.664033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.f","version":"43'1","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-28T20:00:32.540713+0000","last_change":"2023-11-28T20:00:30.082748+0000","last_active":"2023-11-28T20:00:32.540713+0000","last_peered":"2023-11-28T20:00:32.540713+0000","last_clean":"2023-11-28T20:00:32.540713+0000","last_became_active":"2023-11-28T20:00:30.082416+0000","last_became_peered":"2023-11-28T20:00:30.082416+0000","last_unstale":"2023-11-28T20:00:32.540713+0000","last_undegraded":"2023-11-28T20:00:32.540713+0000","last_fullsized":"2023-11-28T20:00:32.540713+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:29.043480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:29.043480+0000","last_clean_scrub_stamp":"2023-11-28T20:00:29.043480+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:25:08.515869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":15,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-28T20:00:30.772403+0000","last_change":"2023-11-28T20:00:13.797337+0000","last_active":"2023-11-28T20:00:30.772403+0000","last_peered":"2023-11-28T20:00:30.772403+0000","last_clean":"2023-11-28T20:00:30.772403+0000","last_became_active":"2023-11-28T20:00:13.797027+0000","last_became_peered":"2023-11-28T20:00:13.797027+0000","last_unstale":"2023-11-28T20:00:30.772403+0000","last_undegraded":"2023-11-28T20:00:30.772403+0000","last_fullsized":"2023-11-28T20:00:30.772403+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_clean_scrub_stamp":"2023-11-28T20:00:12.764355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:31:40.964592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"39'1","reported_seq":17,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-28T20:00:30.768113+0000","last_change":"2023-11-28T20:00:12.796923+0000","last_active":"2023-11-28T20:00:30.768113+0000","last_peered":"2023-11-28T20:00:30.768113+0000","last_clean":"2023-11-28T20:00:30.768113+0000","last_became_active":"2023-11-28T20:00:12.796625+0000","last_became_peered":"2023-11-28T20:00:12.796625+0000","last_unstale":"2023-11-28T20:00:30.768113+0000","last_undegraded":"2023-11-28T20:00:30.768113+0000","last_fullsized":"2023-11-28T20:00:30.768113+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:11.760656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:11.760656+0000","last_clean_scrub_stamp":"2023-11-28T20:00:11.760656+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:07:27.330964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-28T20:00:32.538082+0000","last_change":"2023-11-28T20:00:30.791859+0000","last_active":"2023-11-28T20:00:32.538082+0000","last_peered":"2023-11-28T20:00:32.538082+0000","last_clean":"2023-11-28T20:00:32.538082+0000","last_became_active":"2023-11-28T20:00:30.791601+0000","last_became_peered":"2023-11-28T20:00:30.791601+0000","last_unstale":"2023-11-28T20:00:32.538082+0000","last_undegraded":"2023-11-28T20:00:32.538082+0000","last_fullsized":"2023-11-28T20:00:32.538082+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:30.046728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:30.046728+0000","last_clean_scrub_stamp":"2023-11-28T20:00:30.046728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:18:00.030437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.e","version":"43'2","reported_seq":14,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-28T20:00:31.770187+0000","last_change":"2023-11-28T20:00:30.076071+0000","last_active":"2023-11-28T20:00:31.770187+0000","last_peered":"2023-11-28T20:00:31.770187+0000","last_clean":"2023-11-28T20:00:31.770187+0000","last_became_active":"2023-11-28T20:00:30.075686+0000","last_became_peered":"2023-11-28T20:00:30.075686+0000","last_unstale":"2023-11-28T20:00:31.770187+0000","last_undegraded":"2023-11-28T20:00:31.770187+0000","last_fullsized":"2023-11-28T20:00:31.770187+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:29.043480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:29.043480+0000","last_clean_scrub_stamp":"2023-11-28T20:00:29.043480+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:30:57.716097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":15,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-28T20:00:30.767824+0000","last_change":"2023-11-28T20:00:13.800009+0000","last_active":"2023-11-28T20:00:30.767824+0000","last_peered":"2023-11-28T20:00:30.767824+0000","last_clean":"2023-11-28T20:00:30.767824+0000","last_became_active":"2023-11-28T20:00:13.799753+0000","last_became_peered":"2023-11-28T20:00:13.799753+0000","last_unstale":"2023-11-28T20:00:30.767824+0000","last_undegraded":"2023-11-28T20:00:30.767824+0000","last_fullsized":"2023-11-28T20:00:30.767824+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_clean_scrub_stamp":"2023-11-28T20:00:12.764355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:21:44.950264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":16,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-28T20:00:30.776240+0000","last_change":"2023-11-28T20:00:12.796705+0000","last_active":"2023-11-28T20:00:30.776240+0000","last_peered":"2023-11-28T20:00:30.776240+0000","last_clean":"2023-11-28T20:00:30.776240+0000","last_became_active":"2023-11-28T20:00:12.796394+0000","last_became_peered":"2023-11-28T20:00:12.796394+0000","last_unstale":"2023-11-28T20:00:30.776240+0000","last_undegraded":"2023-11-28T20:00:30.776240+0000","last_fullsized":"2023-11-28T20:00:30.776240+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:11.760656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:11.760656+0000","last_clean_scrub_stamp":"2023-11-28T20:00:11.760656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:31:39.960893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-28T20:00:32.540311+0000","last_change":"2023-11-28T20:00:30.795208+0000","last_active":"2023-11-28T20:00:32.540311+0000","last_peered":"2023-11-28T20:00:32.540311+0000","last_clean":"2023-11-28T20:00:32.540311+0000","last_became_active":"2023-11-28T20:00:30.794685+0000","last_became_peered":"2023-11-28T20:00:30.794685+0000","last_unstale":"2023-11-28T20:00:32.540311+0000","last_undegraded":"2023-11-28T20:00:32.540311+0000","last_fullsized":"2023-11-28T20:00:32.540311+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:30.046728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:30.046728+0000","last_clean_scrub_stamp":"2023-11-28T20:00:30.046728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:00:56.896478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-28T20:00:32.538323+0000","last_change":"2023-11-28T20:00:30.083965+0000","last_active":"2023-11-28T20:00:32.538323+0000","last_peered":"2023-11-28T20:00:32.538323+0000","last_clean":"2023-11-28T20:00:32.538323+0000","last_became_active":"2023-11-28T20:00:30.083560+0000","last_became_peered":"2023-11-28T20:00:30.083560+0000","last_unstale":"2023-11-28T20:00:32.538323+0000","last_undegraded":"2023-11-28T20:00:32.538323+0000","last_fullsized":"2023-11-28T20:00:32.538323+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:29.043480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:29.043480+0000","last_clean_scrub_stamp":"2023-11-28T20:00:29.043480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:22:11.928509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":15,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-28T20:00:30.776671+0000","last_change":"2023-11-28T20:00:13.822221+0000","last_active":"2023-11-28T20:00:30.776671+0000","last_peered":"2023-11-28T20:00:30.776671+0000","last_clean":"2023-11-28T20:00:30.776671+0000","last_became_active":"2023-11-28T20:00:13.821752+0000","last_became_peered":"2023-11-28T20:00:13.821752+0000","last_unstale":"2023-11-28T20:00:30.776671+0000","last_undegraded":"2023-11-28T20:00:30.776671+0000","last_fullsized":"2023-11-28T20:00:30.776671+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_clean_scrub_stamp":"2023-11-28T20:00:12.764355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:02:33.438235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"39'2","reported_seq":18,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-28T20:00:30.767510+0000","last_change":"2023-11-28T20:00:12.787168+0000","last_active":"2023-11-28T20:00:30.767510+0000","last_peered":"2023-11-28T20:00:30.767510+0000","last_clean":"2023-11-28T20:00:30.767510+0000","last_became_active":"2023-11-28T20:00:12.786815+0000","last_became_peered":"2023-11-28T20:00:12.786815+0000","last_unstale":"2023-11-28T20:00:30.767510+0000","last_undegraded":"2023-11-28T20:00:30.767510+0000","last_fullsized":"2023-11-28T20:00:30.767510+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:11.760656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:11.760656+0000","last_clean_scrub_stamp":"2023-11-28T20:00:11.760656+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:29:35.927577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-28T20:00:32.538785+0000","last_change":"2023-11-28T20:00:30.791018+0000","last_active":"2023-11-28T20:00:32.538785+0000","last_peered":"2023-11-28T20:00:32.538785+0000","last_clean":"2023-11-28T20:00:32.538785+0000","last_became_active":"2023-11-28T20:00:30.790772+0000","last_became_peered":"2023-11-28T20:00:30.790772+0000","last_unstale":"2023-11-28T20:00:32.538785+0000","last_undegraded":"2023-11-28T20:00:32.538785+0000","last_fullsized":"2023-11-28T20:00:32.538785+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:30.046728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:30.046728+0000","last_clean_scrub_stamp":"2023-11-28T20:00:30.046728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:18:03.465133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-28T20:00:31.769317+0000","last_change":"2023-11-28T20:00:30.072915+0000","last_active":"2023-11-28T20:00:31.769317+0000","last_peered":"2023-11-28T20:00:31.769317+0000","last_clean":"2023-11-28T20:00:31.769317+0000","last_became_active":"2023-11-28T20:00:30.072672+0000","last_became_peered":"2023-11-28T20:00:30.072672+0000","last_unstale":"2023-11-28T20:00:31.769317+0000","last_undegraded":"2023-11-28T20:00:31.769317+0000","last_fullsized":"2023-11-28T20:00:31.769317+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:29.043480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:29.043480+0000","last_clean_scrub_stamp":"2023-11-28T20:00:29.043480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:22:49.493549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":15,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-28T20:00:30.772639+0000","last_change":"2023-11-28T20:00:13.821223+0000","last_active":"2023-11-28T20:00:30.772639+0000","last_peered":"2023-11-28T20:00:30.772639+0000","last_clean":"2023-11-28T20:00:30.772639+0000","last_became_active":"2023-11-28T20:00:13.820855+0000","last_became_peered":"2023-11-28T20:00:13.820855+0000","last_unstale":"2023-11-28T20:00:30.772639+0000","last_undegraded":"2023-11-28T20:00:30.772639+0000","last_fullsized":"2023-11-28T20:00:30.772639+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_clean_scrub_stamp":"2023-11-28T20:00:12.764355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T07:13:21.710239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":16,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-28T20:00:30.767306+0000","last_change":"2023-11-28T20:00:12.789615+0000","last_active":"2023-11-28T20:00:30.767306+0000","last_peered":"2023-11-28T20:00:30.767306+0000","last_clean":"2023-11-28T20:00:30.767306+0000","last_became_active":"2023-11-28T20:00:12.789357+0000","last_became_peered":"2023-11-28T20:00:12.789357+0000","last_unstale":"2023-11-28T20:00:30.767306+0000","last_undegraded":"2023-11-28T20:00:30.767306+0000","last_fullsized":"2023-11-28T20:00:30.767306+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:11.760656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:11.760656+0000","last_clean_scrub_stamp":"2023-11-28T20:00:11.760656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:49:23.488653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-28T20:00:32.540059+0000","last_change":"2023-11-28T20:00:30.782694+0000","last_active":"2023-11-28T20:00:32.540059+0000","last_peered":"2023-11-28T20:00:32.540059+0000","last_clean":"2023-11-28T20:00:32.540059+0000","last_became_active":"2023-11-28T20:00:30.782371+0000","last_became_peered":"2023-11-28T20:00:30.782371+0000","last_unstale":"2023-11-28T20:00:32.540059+0000","last_undegraded":"2023-11-28T20:00:32.540059+0000","last_fullsized":"2023-11-28T20:00:32.540059+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:30.046728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:30.046728+0000","last_clean_scrub_stamp":"2023-11-28T20:00:30.046728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:18:48.883776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"43'2","reported_seq":14,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-28T20:00:32.539106+0000","last_change":"2023-11-28T20:00:30.070977+0000","last_active":"2023-11-28T20:00:32.539106+0000","last_peered":"2023-11-28T20:00:32.539106+0000","last_clean":"2023-11-28T20:00:32.539106+0000","last_became_active":"2023-11-28T20:00:30.070713+0000","last_became_peered":"2023-11-28T20:00:30.070713+0000","last_unstale":"2023-11-28T20:00:32.539106+0000","last_undegraded":"2023-11-28T20:00:32.539106+0000","last_fullsized":"2023-11-28T20:00:32.539106+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:29.043480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:29.043480+0000","last_clean_scrub_stamp":"2023-11-28T20:00:29.043480+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:11:13.453981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":15,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-28T20:00:30.770883+0000","last_change":"2023-11-28T20:00:13.809401+0000","last_active":"2023-11-28T20:00:30.770883+0000","last_peered":"2023-11-28T20:00:30.770883+0000","last_clean":"2023-11-28T20:00:30.770883+0000","last_became_active":"2023-11-28T20:00:13.808829+0000","last_became_peered":"2023-11-28T20:00:13.808829+0000","last_unstale":"2023-11-28T20:00:30.770883+0000","last_undegraded":"2023-11-28T20:00:30.770883+0000","last_fullsized":"2023-11-28T20:00:30.770883+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_clean_scrub_stamp":"2023-11-28T20:00:12.764355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:09:58.925137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":16,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-28T20:00:30.777155+0000","last_change":"2023-11-28T20:00:12.794799+0000","last_active":"2023-11-28T20:00:30.777155+0000","last_peered":"2023-11-28T20:00:30.777155+0000","last_clean":"2023-11-28T20:00:30.777155+0000","last_became_active":"2023-11-28T20:00:12.794535+0000","last_became_peered":"2023-11-28T20:00:12.794535+0000","last_unstale":"2023-11-28T20:00:30.777155+0000","last_undegraded":"2023-11-28T20:00:30.777155+0000","last_fullsized":"2023-11-28T20:00:30.777155+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:11.760656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:11.760656+0000","last_clean_scrub_stamp":"2023-11-28T20:00:11.760656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:42:32.303144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-28T20:00:31.774545+0000","last_change":"2023-11-28T20:00:30.792507+0000","last_active":"2023-11-28T20:00:31.774545+0000","last_peered":"2023-11-28T20:00:31.774545+0000","last_clean":"2023-11-28T20:00:31.774545+0000","last_became_active":"2023-11-28T20:00:30.792236+0000","last_became_peered":"2023-11-28T20:00:30.792236+0000","last_unstale":"2023-11-28T20:00:31.774545+0000","last_undegraded":"2023-11-28T20:00:31.774545+0000","last_fullsized":"2023-11-28T20:00:31.774545+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:30.046728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:30.046728+0000","last_clean_scrub_stamp":"2023-11-28T20:00:30.046728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:59:19.578650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-28T20:00:32.539651+0000","last_change":"2023-11-28T20:00:30.079032+0000","last_active":"2023-11-28T20:00:32.539651+0000","last_peered":"2023-11-28T20:00:32.539651+0000","last_clean":"2023-11-28T20:00:32.539651+0000","last_became_active":"2023-11-28T20:00:30.078730+0000","last_became_peered":"2023-11-28T20:00:30.078730+0000","last_unstale":"2023-11-28T20:00:32.539651+0000","last_undegraded":"2023-11-28T20:00:32.539651+0000","last_fullsized":"2023-11-28T20:00:32.539651+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:29.043480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:29.043480+0000","last_clean_scrub_stamp":"2023-11-28T20:00:29.043480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:13:45.022521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":15,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-28T20:00:30.775800+0000","last_change":"2023-11-28T20:00:13.821627+0000","last_active":"2023-11-28T20:00:30.775800+0000","last_peered":"2023-11-28T20:00:30.775800+0000","last_clean":"2023-11-28T20:00:30.775800+0000","last_became_active":"2023-11-28T20:00:13.821359+0000","last_became_peered":"2023-11-28T20:00:13.821359+0000","last_unstale":"2023-11-28T20:00:30.775800+0000","last_undegraded":"2023-11-28T20:00:30.775800+0000","last_fullsized":"2023-11-28T20:00:30.775800+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_clean_scrub_stamp":"2023-11-28T20:00:12.764355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:42:42.402639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":16,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-28T20:00:30.767269+0000","last_change":"2023-11-28T20:00:12.787505+0000","last_active":"2023-11-28T20:00:30.767269+0000","last_peered":"2023-11-28T20:00:30.767269+0000","last_clean":"2023-11-28T20:00:30.767269+0000","last_became_active":"2023-11-28T20:00:12.786509+0000","last_became_peered":"2023-11-28T20:00:12.786509+0000","last_unstale":"2023-11-28T20:00:30.767269+0000","last_undegraded":"2023-11-28T20:00:30.767269+0000","last_fullsized":"2023-11-28T20:00:30.767269+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:11.760656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:11.760656+0000","last_clean_scrub_stamp":"2023-11-28T20:00:11.760656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:05:35.913865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-28T20:00:32.538192+0000","last_change":"2023-11-28T20:00:30.798053+0000","last_active":"2023-11-28T20:00:32.538192+0000","last_peered":"2023-11-28T20:00:32.538192+0000","last_clean":"2023-11-28T20:00:32.538192+0000","last_became_active":"2023-11-28T20:00:30.797454+0000","last_became_peered":"2023-11-28T20:00:30.797454+0000","last_unstale":"2023-11-28T20:00:32.538192+0000","last_undegraded":"2023-11-28T20:00:32.538192+0000","last_fullsized":"2023-11-28T20:00:32.538192+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:30.046728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:30.046728+0000","last_clean_scrub_stamp":"2023-11-28T20:00:30.046728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:13:39.602165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-28T20:00:32.540232+0000","last_change":"2023-11-28T20:00:30.081655+0000","last_active":"2023-11-28T20:00:32.540232+0000","last_peered":"2023-11-28T20:00:32.540232+0000","last_clean":"2023-11-28T20:00:32.540232+0000","last_became_active":"2023-11-28T20:00:30.081162+0000","last_became_peered":"2023-11-28T20:00:30.081162+0000","last_unstale":"2023-11-28T20:00:32.540232+0000","last_undegraded":"2023-11-28T20:00:32.540232+0000","last_fullsized":"2023-11-28T20:00:32.540232+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:29.043480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:29.043480+0000","last_clean_scrub_stamp":"2023-11-28T20:00:29.043480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:16:37.578195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":15,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-28T20:00:30.776153+0000","last_change":"2023-11-28T20:00:13.802160+0000","last_active":"2023-11-28T20:00:30.776153+0000","last_peered":"2023-11-28T20:00:30.776153+0000","last_clean":"2023-11-28T20:00:30.776153+0000","last_became_active":"2023-11-28T20:00:13.801877+0000","last_became_peered":"2023-11-28T20:00:13.801877+0000","last_unstale":"2023-11-28T20:00:30.776153+0000","last_undegraded":"2023-11-28T20:00:30.776153+0000","last_fullsized":"2023-11-28T20:00:30.776153+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_clean_scrub_stamp":"2023-11-28T20:00:12.764355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T06:58:51.315382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"39'2","reported_seq":18,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-28T20:00:30.775521+0000","last_change":"2023-11-28T20:00:12.804126+0000","last_active":"2023-11-28T20:00:30.775521+0000","last_peered":"2023-11-28T20:00:30.775521+0000","last_clean":"2023-11-28T20:00:30.775521+0000","last_became_active":"2023-11-28T20:00:12.803815+0000","last_became_peered":"2023-11-28T20:00:12.803815+0000","last_unstale":"2023-11-28T20:00:30.775521+0000","last_undegraded":"2023-11-28T20:00:30.775521+0000","last_fullsized":"2023-11-28T20:00:30.775521+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:11.760656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:11.760656+0000","last_clean_scrub_stamp":"2023-11-28T20:00:11.760656+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T06:11:16.755424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-28T20:00:32.539231+0000","last_change":"2023-11-28T20:00:30.784644+0000","last_active":"2023-11-28T20:00:32.539231+0000","last_peered":"2023-11-28T20:00:32.539231+0000","last_clean":"2023-11-28T20:00:32.539231+0000","last_became_active":"2023-11-28T20:00:30.784360+0000","last_became_peered":"2023-11-28T20:00:30.784360+0000","last_unstale":"2023-11-28T20:00:32.539231+0000","last_undegraded":"2023-11-28T20:00:32.539231+0000","last_fullsized":"2023-11-28T20:00:32.539231+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:30.046728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:30.046728+0000","last_clean_scrub_stamp":"2023-11-28T20:00:30.046728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:32:37.911634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-28T20:00:32.538502+0000","last_change":"2023-11-28T20:00:30.085527+0000","last_active":"2023-11-28T20:00:32.538502+0000","last_peered":"2023-11-28T20:00:32.538502+0000","last_clean":"2023-11-28T20:00:32.538502+0000","last_became_active":"2023-11-28T20:00:30.085294+0000","last_became_peered":"2023-11-28T20:00:30.085294+0000","last_unstale":"2023-11-28T20:00:32.538502+0000","last_undegraded":"2023-11-28T20:00:32.538502+0000","last_fullsized":"2023-11-28T20:00:32.538502+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:29.043480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:29.043480+0000","last_clean_scrub_stamp":"2023-11-28T20:00:29.043480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:25:19.224251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":15,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-28T20:00:30.781313+0000","last_change":"2023-11-28T20:00:13.825316+0000","last_active":"2023-11-28T20:00:30.781313+0000","last_peered":"2023-11-28T20:00:30.781313+0000","last_clean":"2023-11-28T20:00:30.781313+0000","last_became_active":"2023-11-28T20:00:13.824862+0000","last_became_peered":"2023-11-28T20:00:13.824862+0000","last_unstale":"2023-11-28T20:00:30.781313+0000","last_undegraded":"2023-11-28T20:00:30.781313+0000","last_fullsized":"2023-11-28T20:00:30.781313+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_clean_scrub_stamp":"2023-11-28T20:00:12.764355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T06:11:17.759123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.6","version":"40'1","reported_seq":17,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-28T20:00:30.767760+0000","last_change":"2023-11-28T20:00:12.804114+0000","last_active":"2023-11-28T20:00:30.767760+0000","last_peered":"2023-11-28T20:00:30.767760+0000","last_clean":"2023-11-28T20:00:30.767760+0000","last_became_active":"2023-11-28T20:00:12.803528+0000","last_became_peered":"2023-11-28T20:00:12.803528+0000","last_unstale":"2023-11-28T20:00:30.767760+0000","last_undegraded":"2023-11-28T20:00:30.767760+0000","last_fullsized":"2023-11-28T20:00:30.767760+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:11.760656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:11.760656+0000","last_clean_scrub_stamp":"2023-11-28T20:00:11.760656+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:08:56.081544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-28T20:00:32.539423+0000","last_change":"2023-11-28T20:00:30.784336+0000","last_active":"2023-11-28T20:00:32.539423+0000","last_peered":"2023-11-28T20:00:32.539423+0000","last_clean":"2023-11-28T20:00:32.539423+0000","last_became_active":"2023-11-28T20:00:30.783618+0000","last_became_peered":"2023-11-28T20:00:30.783618+0000","last_unstale":"2023-11-28T20:00:32.539423+0000","last_undegraded":"2023-11-28T20:00:32.539423+0000","last_fullsized":"2023-11-28T20:00:32.539423+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:30.046728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:30.046728+0000","last_clean_scrub_stamp":"2023-11-28T20:00:30.046728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:59:41.017533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.7","version":"43'2","reported_seq":14,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-28T20:00:31.775400+0000","last_change":"2023-11-28T20:00:30.084977+0000","last_active":"2023-11-28T20:00:31.775400+0000","last_peered":"2023-11-28T20:00:31.775400+0000","last_clean":"2023-11-28T20:00:31.775400+0000","last_became_active":"2023-11-28T20:00:30.084704+0000","last_became_peered":"2023-11-28T20:00:30.084704+0000","last_unstale":"2023-11-28T20:00:31.775400+0000","last_undegraded":"2023-11-28T20:00:31.775400+0000","last_fullsized":"2023-11-28T20:00:31.775400+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:29.043480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:29.043480+0000","last_clean_scrub_stamp":"2023-11-28T20:00:29.043480+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:42:58.681764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":15,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-28T20:00:30.776271+0000","last_change":"2023-11-28T20:00:13.789592+0000","last_active":"2023-11-28T20:00:30.776271+0000","last_peered":"2023-11-28T20:00:30.776271+0000","last_clean":"2023-11-28T20:00:30.776271+0000","last_became_active":"2023-11-28T20:00:13.789304+0000","last_became_peered":"2023-11-28T20:00:13.789304+0000","last_unstale":"2023-11-28T20:00:30.776271+0000","last_undegraded":"2023-11-28T20:00:30.776271+0000","last_fullsized":"2023-11-28T20:00:30.776271+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_clean_scrub_stamp":"2023-11-28T20:00:12.764355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:59:35.199336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":16,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-28T20:00:30.774053+0000","last_change":"2023-11-28T20:00:12.795099+0000","last_active":"2023-11-28T20:00:30.774053+0000","last_peered":"2023-11-28T20:00:30.774053+0000","last_clean":"2023-11-28T20:00:30.774053+0000","last_became_active":"2023-11-28T20:00:12.794522+0000","last_became_peered":"2023-11-28T20:00:12.794522+0000","last_unstale":"2023-11-28T20:00:30.774053+0000","last_undegraded":"2023-11-28T20:00:30.774053+0000","last_fullsized":"2023-11-28T20:00:30.774053+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:11.760656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:11.760656+0000","last_clean_scrub_stamp":"2023-11-28T20:00:11.760656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:42:32.303144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-28T20:00:32.538374+0000","last_change":"2023-11-28T20:00:30.797617+0000","last_active":"2023-11-28T20:00:32.538374+0000","last_peered":"2023-11-28T20:00:32.538374+0000","last_clean":"2023-11-28T20:00:32.538374+0000","last_became_active":"2023-11-28T20:00:30.797343+0000","last_became_peered":"2023-11-28T20:00:30.797343+0000","last_unstale":"2023-11-28T20:00:32.538374+0000","last_undegraded":"2023-11-28T20:00:32.538374+0000","last_fullsized":"2023-11-28T20:00:32.538374+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:30.046728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:30.046728+0000","last_clean_scrub_stamp":"2023-11-28T20:00:30.046728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:56:08.338193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-28T20:00:31.773688+0000","last_change":"2023-11-28T20:00:30.073724+0000","last_active":"2023-11-28T20:00:31.773688+0000","last_peered":"2023-11-28T20:00:31.773688+0000","last_clean":"2023-11-28T20:00:31.773688+0000","last_became_active":"2023-11-28T20:00:30.072958+0000","last_became_peered":"2023-11-28T20:00:30.072958+0000","last_unstale":"2023-11-28T20:00:31.773688+0000","last_undegraded":"2023-11-28T20:00:31.773688+0000","last_fullsized":"2023-11-28T20:00:31.773688+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:29.043480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:29.043480+0000","last_clean_scrub_stamp":"2023-11-28T20:00:29.043480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:40:17.393657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":15,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-28T20:00:30.773158+0000","last_change":"2023-11-28T20:00:13.805383+0000","last_active":"2023-11-28T20:00:30.773158+0000","last_peered":"2023-11-28T20:00:30.773158+0000","last_clean":"2023-11-28T20:00:30.773158+0000","last_became_active":"2023-11-28T20:00:13.805090+0000","last_became_peered":"2023-11-28T20:00:13.805090+0000","last_unstale":"2023-11-28T20:00:30.773158+0000","last_undegraded":"2023-11-28T20:00:30.773158+0000","last_fullsized":"2023-11-28T20:00:30.773158+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_clean_scrub_stamp":"2023-11-28T20:00:12.764355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:18:53.216142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":16,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-28T20:00:30.774944+0000","last_change":"2023-11-28T20:00:12.792743+0000","last_active":"2023-11-28T20:00:30.774944+0000","last_peered":"2023-11-28T20:00:30.774944+0000","last_clean":"2023-11-28T20:00:30.774944+0000","last_became_active":"2023-11-28T20:00:12.792420+0000","last_became_peered":"2023-11-28T20:00:12.792420+0000","last_unstale":"2023-11-28T20:00:30.774944+0000","last_undegraded":"2023-11-28T20:00:30.774944+0000","last_fullsized":"2023-11-28T20:00:30.774944+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:11.760656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:11.760656+0000","last_clean_scrub_stamp":"2023-11-28T20:00:11.760656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T07:54:02.325947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-28T20:00:32.540546+0000","last_change":"2023-11-28T20:00:30.788386+0000","last_active":"2023-11-28T20:00:32.540546+0000","last_peered":"2023-11-28T20:00:32.540546+0000","last_clean":"2023-11-28T20:00:32.540546+0000","last_became_active":"2023-11-28T20:00:30.788038+0000","last_became_peered":"2023-11-28T20:00:30.788038+0000","last_unstale":"2023-11-28T20:00:32.540546+0000","last_undegraded":"2023-11-28T20:00:32.540546+0000","last_fullsized":"2023-11-28T20:00:32.540546+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:30.046728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:30.046728+0000","last_clean_scrub_stamp":"2023-11-28T20:00:30.046728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:36:38.082414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-28T20:00:32.539527+0000","last_change":"2023-11-28T20:00:30.076107+0000","last_active":"2023-11-28T20:00:32.539527+0000","last_peered":"2023-11-28T20:00:32.539527+0000","last_clean":"2023-11-28T20:00:32.539527+0000","last_became_active":"2023-11-28T20:00:30.075871+0000","last_became_peered":"2023-11-28T20:00:30.075871+0000","last_unstale":"2023-11-28T20:00:32.539527+0000","last_undegraded":"2023-11-28T20:00:32.539527+0000","last_fullsized":"2023-11-28T20:00:32.539527+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:29.043480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:29.043480+0000","last_clean_scrub_stamp":"2023-11-28T20:00:29.043480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:06:53.405406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":15,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-28T20:00:30.776957+0000","last_change":"2023-11-28T20:00:13.802746+0000","last_active":"2023-11-28T20:00:30.776957+0000","last_peered":"2023-11-28T20:00:30.776957+0000","last_clean":"2023-11-28T20:00:30.776957+0000","last_became_active":"2023-11-28T20:00:13.802510+0000","last_became_peered":"2023-11-28T20:00:13.802510+0000","last_unstale":"2023-11-28T20:00:30.776957+0000","last_undegraded":"2023-11-28T20:00:30.776957+0000","last_fullsized":"2023-11-28T20:00:30.776957+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_clean_scrub_stamp":"2023-11-28T20:00:12.764355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:20:11.234527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":16,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-28T20:00:30.787858+0000","last_change":"2023-11-28T20:00:12.793819+0000","last_active":"2023-11-28T20:00:30.787858+0000","last_peered":"2023-11-28T20:00:30.787858+0000","last_clean":"2023-11-28T20:00:30.787858+0000","last_became_active":"2023-11-28T20:00:12.793027+0000","last_became_peered":"2023-11-28T20:00:12.793027+0000","last_unstale":"2023-11-28T20:00:30.787858+0000","last_undegraded":"2023-11-28T20:00:30.787858+0000","last_fullsized":"2023-11-28T20:00:30.787858+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:11.760656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:11.760656+0000","last_clean_scrub_stamp":"2023-11-28T20:00:11.760656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T06:41:49.723414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-28T20:00:32.538417+0000","last_change":"2023-11-28T20:00:30.784590+0000","last_active":"2023-11-28T20:00:32.538417+0000","last_peered":"2023-11-28T20:00:32.538417+0000","last_clean":"2023-11-28T20:00:32.538417+0000","last_became_active":"2023-11-28T20:00:30.784286+0000","last_became_peered":"2023-11-28T20:00:30.784286+0000","last_unstale":"2023-11-28T20:00:32.538417+0000","last_undegraded":"2023-11-28T20:00:32.538417+0000","last_fullsized":"2023-11-28T20:00:32.538417+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:30.046728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:30.046728+0000","last_clean_scrub_stamp":"2023-11-28T20:00:30.046728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:00:10.316375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-28T20:00:32.539108+0000","last_change":"2023-11-28T20:00:30.077259+0000","last_active":"2023-11-28T20:00:32.539108+0000","last_peered":"2023-11-28T20:00:32.539108+0000","last_clean":"2023-11-28T20:00:32.539108+0000","last_became_active":"2023-11-28T20:00:30.077059+0000","last_became_peered":"2023-11-28T20:00:30.077059+0000","last_unstale":"2023-11-28T20:00:32.539108+0000","last_undegraded":"2023-11-28T20:00:32.539108+0000","last_fullsized":"2023-11-28T20:00:32.539108+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:29.043480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:29.043480+0000","last_clean_scrub_stamp":"2023-11-28T20:00:29.043480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:03:00.612020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":15,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-28T20:00:30.772231+0000","last_change":"2023-11-28T20:00:13.803188+0000","last_active":"2023-11-28T20:00:30.772231+0000","last_peered":"2023-11-28T20:00:30.772231+0000","last_clean":"2023-11-28T20:00:30.772231+0000","last_became_active":"2023-11-28T20:00:13.798040+0000","last_became_peered":"2023-11-28T20:00:13.798040+0000","last_unstale":"2023-11-28T20:00:30.772231+0000","last_undegraded":"2023-11-28T20:00:30.772231+0000","last_fullsized":"2023-11-28T20:00:30.772231+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_clean_scrub_stamp":"2023-11-28T20:00:12.764355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:39:05.453623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":16,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-28T20:00:30.771427+0000","last_change":"2023-11-28T20:00:12.790049+0000","last_active":"2023-11-28T20:00:30.771427+0000","last_peered":"2023-11-28T20:00:30.771427+0000","last_clean":"2023-11-28T20:00:30.771427+0000","last_became_active":"2023-11-28T20:00:12.789755+0000","last_became_peered":"2023-11-28T20:00:12.789755+0000","last_unstale":"2023-11-28T20:00:30.771427+0000","last_undegraded":"2023-11-28T20:00:30.771427+0000","last_fullsized":"2023-11-28T20:00:30.771427+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:11.760656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:11.760656+0000","last_clean_scrub_stamp":"2023-11-28T20:00:11.760656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T06:41:49.723414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-28T20:00:32.539354+0000","last_change":"2023-11-28T20:00:30.798659+0000","last_active":"2023-11-28T20:00:32.539354+0000","last_peered":"2023-11-28T20:00:32.539354+0000","last_clean":"2023-11-28T20:00:32.539354+0000","last_became_active":"2023-11-28T20:00:30.798315+0000","last_became_peered":"2023-11-28T20:00:30.798315+0000","last_unstale":"2023-11-28T20:00:32.539354+0000","last_undegraded":"2023-11-28T20:00:32.539354+0000","last_fullsized":"2023-11-28T20:00:32.539354+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:30.046728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:30.046728+0000","last_clean_scrub_stamp":"2023-11-28T20:00:30.046728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:25:09.519117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-28T20:00:32.539735+0000","last_change":"2023-11-28T20:00:30.076686+0000","last_active":"2023-11-28T20:00:32.539735+0000","last_peered":"2023-11-28T20:00:32.539735+0000","last_clean":"2023-11-28T20:00:32.539735+0000","last_became_active":"2023-11-28T20:00:30.076063+0000","last_became_peered":"2023-11-28T20:00:30.076063+0000","last_unstale":"2023-11-28T20:00:32.539735+0000","last_undegraded":"2023-11-28T20:00:32.539735+0000","last_fullsized":"2023-11-28T20:00:32.539735+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:29.043480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:29.043480+0000","last_clean_scrub_stamp":"2023-11-28T20:00:29.043480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:04:16.049081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":15,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-28T20:00:30.780056+0000","last_change":"2023-11-28T20:00:13.823182+0000","last_active":"2023-11-28T20:00:30.780056+0000","last_peered":"2023-11-28T20:00:30.780056+0000","last_clean":"2023-11-28T20:00:30.780056+0000","last_became_active":"2023-11-28T20:00:13.822797+0000","last_became_peered":"2023-11-28T20:00:13.822797+0000","last_unstale":"2023-11-28T20:00:30.780056+0000","last_undegraded":"2023-11-28T20:00:30.780056+0000","last_fullsized":"2023-11-28T20:00:30.780056+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_clean_scrub_stamp":"2023-11-28T20:00:12.764355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:18:27.874818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":16,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-28T20:00:30.779686+0000","last_change":"2023-11-28T20:00:12.794531+0000","last_active":"2023-11-28T20:00:30.779686+0000","last_peered":"2023-11-28T20:00:30.779686+0000","last_clean":"2023-11-28T20:00:30.779686+0000","last_became_active":"2023-11-28T20:00:12.794205+0000","last_became_peered":"2023-11-28T20:00:12.794205+0000","last_unstale":"2023-11-28T20:00:30.779686+0000","last_undegraded":"2023-11-28T20:00:30.779686+0000","last_fullsized":"2023-11-28T20:00:30.779686+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:11.760656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:11.760656+0000","last_clean_scrub_stamp":"2023-11-28T20:00:11.760656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T07:13:20.706540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-28T20:00:31.773629+0000","last_change":"2023-11-28T20:00:30.797266+0000","last_active":"2023-11-28T20:00:31.773629+0000","last_peered":"2023-11-28T20:00:31.773629+0000","last_clean":"2023-11-28T20:00:31.773629+0000","last_became_active":"2023-11-28T20:00:30.795782+0000","last_became_peered":"2023-11-28T20:00:30.795782+0000","last_unstale":"2023-11-28T20:00:31.773629+0000","last_undegraded":"2023-11-28T20:00:31.773629+0000","last_fullsized":"2023-11-28T20:00:31.773629+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:30.046728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:30.046728+0000","last_clean_scrub_stamp":"2023-11-28T20:00:30.046728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T07:28:50.906052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-28T20:00:32.540360+0000","last_change":"2023-11-28T20:00:30.084304+0000","last_active":"2023-11-28T20:00:32.540360+0000","last_peered":"2023-11-28T20:00:32.540360+0000","last_clean":"2023-11-28T20:00:32.540360+0000","last_became_active":"2023-11-28T20:00:30.084052+0000","last_became_peered":"2023-11-28T20:00:30.084052+0000","last_unstale":"2023-11-28T20:00:32.540360+0000","last_undegraded":"2023-11-28T20:00:32.540360+0000","last_fullsized":"2023-11-28T20:00:32.540360+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:29.043480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:29.043480+0000","last_clean_scrub_stamp":"2023-11-28T20:00:29.043480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:16:37.578195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":15,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-28T20:00:30.775042+0000","last_change":"2023-11-28T20:00:13.798633+0000","last_active":"2023-11-28T20:00:30.775042+0000","last_peered":"2023-11-28T20:00:30.775042+0000","last_clean":"2023-11-28T20:00:30.775042+0000","last_became_active":"2023-11-28T20:00:13.798291+0000","last_became_peered":"2023-11-28T20:00:13.798291+0000","last_unstale":"2023-11-28T20:00:30.775042+0000","last_undegraded":"2023-11-28T20:00:30.775042+0000","last_fullsized":"2023-11-28T20:00:30.775042+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_clean_scrub_stamp":"2023-11-28T20:00:12.764355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:49:40.934392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":16,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-28T20:00:30.777757+0000","last_change":"2023-11-28T20:00:12.795584+0000","last_active":"2023-11-28T20:00:30.777757+0000","last_peered":"2023-11-28T20:00:30.777757+0000","last_clean":"2023-11-28T20:00:30.777757+0000","last_became_active":"2023-11-28T20:00:12.795179+0000","last_became_peered":"2023-11-28T20:00:12.795179+0000","last_unstale":"2023-11-28T20:00:30.777757+0000","last_undegraded":"2023-11-28T20:00:30.777757+0000","last_fullsized":"2023-11-28T20:00:30.777757+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:11.760656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:11.760656+0000","last_clean_scrub_stamp":"2023-11-28T20:00:11.760656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:18:52.212443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":184,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-28T20:00:30.776715+0000","last_change":"2023-11-28T19:58:56.136501+0000","last_active":"2023-11-28T20:00:30.776715+0000","last_peered":"2023-11-28T20:00:30.776715+0000","last_clean":"2023-11-28T20:00:30.776715+0000","last_became_active":"2023-11-28T19:58:56.135998+0000","last_became_peered":"2023-11-28T19:58:56.135998+0000","last_unstale":"2023-11-28T20:00:30.776715+0000","last_undegraded":"2023-11-28T20:00:30.776715+0000","last_fullsized":"2023-11-28T20:00:30.776715+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:58:54.602349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:58:54.602349+0000","last_clean_scrub_stamp":"2023-11-28T19:58:54.602349+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:33:42.723349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":3905,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":7810,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":66748,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574872,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27604,"kb_used_data":576,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344236,"statfs":{"total":96636764160,"available":96608497664,"internally_reserved":0,"allocated":589824,"data_stored":814845,"data_compressed":33374,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 19:59:54 2023","interfaces":[{"interface":"back","average":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":0.90700000000000003,"5min":0.90700000000000003,"15min":0.90700000000000003},"last":0.69799999999999995},{"interface":"front","average":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"min":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":0.98999999999999999,"5min":0.98999999999999999,"15min":0.98999999999999999},"last":0.59699999999999998}]},{"osd":1,"last update":"Tue Nov 28 19:59:54 2023","interfaces":[{"interface":"back","average":{"1min":0.64600000000000002,"5min":0.64600000000000002,"15min":0.64600000000000002},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":0.89600000000000002,"5min":0.89600000000000002,"15min":0.89600000000000002},"last":0.57599999999999996},{"interface":"front","average":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.70199999999999996},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":1.0900000000000001,"5min":1.0900000000000001,"15min":1.0900000000000001},"last":0.73999999999999999}]},{"osd":2,"last update":"Tue Nov 28 19:59:54 2023","interfaces":[{"interface":"back","average":{"1min":0.73499999999999999,"5min":0.73499999999999999,"15min":0.73499999999999999},"min":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"max":{"1min":0.98799999999999999,"5min":0.98799999999999999,"15min":0.98799999999999999},"last":0.504},{"interface":"front","average":{"1min":0.70699999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":1.0680000000000001,"5min":1.0680000000000001,"15min":1.0680000000000001},"last":0.67200000000000004}]},{"osd":3,"last update":"Tue Nov 28 19:59:54 2023","interfaces":[{"interface":"back","average":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"min":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":1.0449999999999999,"5min":1.0449999999999999,"15min":1.0449999999999999},"last":0.68899999999999995},{"interface":"front","average":{"1min":0.79300000000000004,"5min":0.79300000000000004,"15min":0.79300000000000004},"min":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"max":{"1min":1.1299999999999999,"5min":1.1299999999999999,"15min":1.1299999999999999},"last":0.76600000000000001}]},{"osd":4,"last update":"Tue Nov 28 19:59:54 2023","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":1.018,"5min":1.018,"15min":1.018},"last":0.51900000000000002},{"interface":"front","average":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"min":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.1120000000000001,"5min":1.1120000000000001,"15min":1.1120000000000001},"last":0.72299999999999998}]},{"osd":5,"last update":"Tue Nov 28 19:59:54 2023","interfaces":[{"interface":"back","average":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":1.1699999999999999,"5min":1.1699999999999999,"15min":1.1699999999999999},"last":0.61599999999999999},{"interface":"front","average":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"min":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":1.1890000000000001,"5min":1.1890000000000001,"15min":1.1890000000000001},"last":0.55600000000000005}]},{"osd":6,"last update":"Tue Nov 28 19:59:54 2023","interfaces":[{"interface":"back","average":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.78200000000000003},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":1.1379999999999999,"5min":1.1379999999999999,"15min":1.1379999999999999},"last":0.47499999999999998},{"interface":"front","average":{"1min":0.747,"5min":0.747,"15min":0.747},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.23,"5min":1.23,"15min":1.23},"last":0.64700000000000002}]}]},{"osd":6,"up_from":13,"seq":55834574870,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27540,"kb_used_data":512,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344300,"statfs":{"total":96636764160,"available":96608563200,"internally_reserved":0,"allocated":524288,"data_stored":229887,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 19:59:53 2023","interfaces":[{"interface":"back","average":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.61599999999999999},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.82599999999999996,"5min":0.82599999999999996,"15min":0.82599999999999996},"last":0.60199999999999998},{"interface":"front","average":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":0.98999999999999999,"5min":0.98999999999999999,"15min":0.98999999999999999},"last":0.79000000000000004}]},{"osd":1,"last update":"Tue Nov 28 19:59:53 2023","interfaces":[{"interface":"back","average":{"1min":0.79100000000000004,"5min":0.79100000000000004,"15min":0.79100000000000004},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.105,"5min":1.105,"15min":1.105},"last":1.0940000000000001},{"interface":"front","average":{"1min":0.68700000000000006,"5min":0.68700000000000006,"15min":0.68700000000000006},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.95899999999999996,"5min":0.95899999999999996,"15min":0.95899999999999996},"last":0.755}]},{"osd":2,"last update":"Tue Nov 28 19:59:53 2023","interfaces":[{"interface":"back","average":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"min":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":0.93400000000000005,"5min":0.93400000000000005,"15min":0.93400000000000005},"last":0.72199999999999998},{"interface":"front","average":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"min":{"1min":0.505,"5min":0.505,"15min":0.505},"max":{"1min":1.006,"5min":1.006,"15min":1.006},"last":0.91800000000000004}]},{"osd":3,"last update":"Tue Nov 28 19:59:53 2023","interfaces":[{"interface":"back","average":{"1min":0.749,"5min":0.749,"15min":0.749},"min":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"max":{"1min":1.056,"5min":1.056,"15min":1.056},"last":1.04},{"interface":"front","average":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":0.88900000000000001,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.85599999999999998}]},{"osd":4,"last update":"Tue Nov 28 19:59:53 2023","interfaces":[{"interface":"back","average":{"1min":0.63100000000000001,"5min":0.63100000000000001,"15min":0.63100000000000001},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":0.96999999999999997,"5min":0.96999999999999997,"15min":0.96999999999999997},"last":0.57599999999999996},{"interface":"front","average":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":1.389,"5min":1.389,"15min":1.389},"last":1.1419999999999999}]},{"osd":5,"last update":"Tue Nov 28 19:59:53 2023","interfaces":[{"interface":"back","average":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":0.81699999999999995},"min":{"1min":0.5,"5min":0.5,"15min":0.5},"max":{"1min":1.4259999999999999,"5min":1.4259999999999999,"15min":1.4259999999999999},"last":0.89700000000000002},{"interface":"front","average":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"min":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":1.276,"5min":1.276,"15min":1.276},"last":0.81799999999999995}]},{"osd":7,"last update":"Tue Nov 28 19:59:53 2023","interfaces":[{"interface":"back","average":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.71499999999999997},"min":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":0.97599999999999998,"5min":0.97599999999999998,"15min":0.97599999999999998},"last":1.014},{"interface":"front","average":{"1min":0.82999999999999996,"5min":0.82999999999999996,"15min":0.82999999999999996},"min":{"1min":0.65600000000000003,"5min":0.65600000000000003,"15min":0.65600000000000003},"max":{"1min":1.242,"5min":1.242,"15min":1.242},"last":0.96699999999999997}]}]},{"osd":5,"up_from":13,"seq":55834574872,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27520,"kb_used_data":496,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344320,"statfs":{"total":96636764160,"available":96608583680,"internally_reserved":0,"allocated":507904,"data_stored":221288,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 19:59:53 2023","interfaces":[{"interface":"back","average":{"1min":0.70999999999999996,"5min":0.70999999999999996,"15min":0.70999999999999996},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":0.997,"5min":0.997,"15min":0.997},"last":0.50800000000000001},{"interface":"front","average":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"min":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":1.149,"5min":1.149,"15min":1.149},"last":0.41699999999999998}]},{"osd":1,"last update":"Tue Nov 28 19:59:53 2023","interfaces":[{"interface":"back","average":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":0.92700000000000005,"5min":0.92700000000000005,"15min":0.92700000000000005},"last":0.42899999999999999},{"interface":"front","average":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":1.0940000000000001,"5min":1.0940000000000001,"15min":1.0940000000000001},"last":0.38}]},{"osd":2,"last update":"Tue Nov 28 19:59:53 2023","interfaces":[{"interface":"back","average":{"1min":0.94599999999999995,"5min":0.94599999999999995,"15min":0.94599999999999995},"min":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":5.0880000000000001,"5min":5.0880000000000001,"15min":5.0880000000000001},"last":0.56200000000000006},{"interface":"front","average":{"1min":1.002,"5min":1.002,"15min":1.002},"min":{"1min":0.504,"5min":0.504,"15min":0.504},"max":{"1min":5.1399999999999997,"5min":5.1399999999999997,"15min":5.1399999999999997},"last":0.59399999999999997}]},{"osd":3,"last update":"Tue Nov 28 19:59:53 2023","interfaces":[{"interface":"back","average":{"1min":1.028,"5min":1.028,"15min":1.028},"min":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"max":{"1min":5.0469999999999997,"5min":5.0469999999999997,"15min":5.0469999999999997},"last":0.52600000000000002},{"interface":"front","average":{"1min":1.0009999999999999,"5min":1.0009999999999999,"15min":1.0009999999999999},"min":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":5.024,"5min":5.024,"15min":5.024},"last":0.66100000000000003}]},{"osd":4,"last update":"Tue Nov 28 19:59:53 2023","interfaces":[{"interface":"back","average":{"1min":0.67700000000000005,"5min":0.67700000000000005,"15min":0.67700000000000005},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":1.4810000000000001,"5min":1.4810000000000001,"15min":1.4810000000000001},"last":0.32900000000000001},{"interface":"front","average":{"1min":0.747,"5min":0.747,"15min":0.747},"min":{"1min":0.5,"5min":0.5,"15min":0.5},"max":{"1min":1.6339999999999999,"5min":1.6339999999999999,"15min":1.6339999999999999},"last":0.44500000000000001}]},{"osd":6,"last update":"Tue Nov 28 19:59:53 2023","interfaces":[{"interface":"back","average":{"1min":0.70699999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":0.97699999999999998,"5min":0.97699999999999998,"15min":0.97699999999999998},"last":0.628},{"interface":"front","average":{"1min":0.748,"5min":0.748,"15min":0.748},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":1.099,"5min":1.099,"15min":1.099},"last":0.46300000000000002}]},{"osd":7,"last update":"Tue Nov 28 19:59:53 2023","interfaces":[{"interface":"back","average":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"min":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":1.236,"5min":1.236,"15min":1.236},"last":0.48499999999999999},{"interface":"front","average":{"1min":0.80100000000000005,"5min":0.80100000000000005,"15min":0.80100000000000005},"min":{"1min":0.505,"5min":0.505,"15min":0.505},"max":{"1min":1.0760000000000001,"5min":1.0760000000000001,"15min":1.0760000000000001},"last":0.54000000000000004}]}]},{"osd":4,"up_from":13,"seq":55834574871,"num_pgs":45,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27540,"kb_used_data":512,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344300,"statfs":{"total":96636764160,"available":96608563200,"internally_reserved":0,"allocated":524288,"data_stored":229839,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 19:59:54 2023","interfaces":[{"interface":"back","average":{"1min":0.71099999999999997,"5min":0.71099999999999997,"15min":0.71099999999999997},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":1.0429999999999999,"5min":1.0429999999999999,"15min":1.0429999999999999},"last":0.71899999999999997},{"interface":"front","average":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":1.163,"5min":1.163,"15min":1.163},"last":0.48299999999999998}]},{"osd":1,"last update":"Tue Nov 28 19:59:54 2023","interfaces":[{"interface":"back","average":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"min":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":1.111,"5min":1.111,"15min":1.111},"last":0.56100000000000005},{"interface":"front","average":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"min":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":1.238,"5min":1.238,"15min":1.238},"last":0.66000000000000003}]},{"osd":2,"last update":"Tue Nov 28 19:59:54 2023","interfaces":[{"interface":"back","average":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":0.78300000000000003},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":1.0669999999999999,"5min":1.0669999999999999,"15min":1.0669999999999999},"last":0.624},{"interface":"front","average":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":0.81699999999999995},"min":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":1.1180000000000001,"5min":1.1180000000000001,"15min":1.1180000000000001},"last":0.58799999999999997}]},{"osd":3,"last update":"Tue Nov 28 19:59:54 2023","interfaces":[{"interface":"back","average":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"min":{"1min":0.499,"5min":0.499,"15min":0.499},"max":{"1min":1.202,"5min":1.202,"15min":1.202},"last":0.54400000000000004},{"interface":"front","average":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"min":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":1.0589999999999999,"5min":1.0589999999999999,"15min":1.0589999999999999},"last":0.69599999999999995}]},{"osd":5,"last update":"Tue Nov 28 19:59:54 2023","interfaces":[{"interface":"back","average":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":0.95899999999999996,"5min":0.95899999999999996,"15min":0.95899999999999996},"last":0.51100000000000001},{"interface":"front","average":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":1.034,"5min":1.034,"15min":1.034},"last":0.67900000000000005}]},{"osd":6,"last update":"Tue Nov 28 19:59:54 2023","interfaces":[{"interface":"back","average":{"1min":0.73499999999999999,"5min":0.73499999999999999,"15min":0.73499999999999999},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":1.0309999999999999,"5min":1.0309999999999999,"15min":1.0309999999999999},"last":0.73699999999999999},{"interface":"front","average":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":1.002,"5min":1.002,"15min":1.002},"last":0.78000000000000003}]},{"osd":7,"last update":"Tue Nov 28 19:59:54 2023","interfaces":[{"interface":"back","average":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"min":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":1.0620000000000001,"5min":1.0620000000000001,"15min":1.0620000000000001},"last":0.752},{"interface":"front","average":{"1min":0.87,"5min":0.87,"15min":0.87},"min":{"1min":0.627,"5min":0.627,"15min":0.627},"max":{"1min":1.1459999999999999,"5min":1.1459999999999999,"15min":1.1459999999999999},"last":0.80100000000000005}]}]},{"osd":3,"up_from":13,"seq":55834574872,"num_pgs":46,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27544,"kb_used_data":520,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344296,"statfs":{"total":96636764160,"available":96608559104,"internally_reserved":0,"allocated":532480,"data_stored":225951,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 19:59:52 2023","interfaces":[{"interface":"back","average":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.70199999999999996},"last":0.29999999999999999},{"interface":"front","average":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"min":{"1min":0.312,"5min":0.312,"15min":0.312},"max":{"1min":0.82599999999999996,"5min":0.82599999999999996,"15min":0.82599999999999996},"last":0.34000000000000002}]},{"osd":1,"last update":"Tue Nov 28 19:59:52 2023","interfaces":[{"interface":"back","average":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.84399999999999997,"5min":0.84399999999999997,"15min":0.84399999999999997},"last":0.26200000000000001},{"interface":"front","average":{"1min":0.505,"5min":0.505,"15min":0.505},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.86099999999999999,"5min":0.86099999999999999,"15min":0.86099999999999999},"last":0.44500000000000001}]},{"osd":2,"last update":"Tue Nov 28 19:59:52 2023","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.85599999999999998,"5min":0.85599999999999998,"15min":0.85599999999999998},"last":0.435},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.83699999999999997,"5min":0.83699999999999997,"15min":0.83699999999999997},"last":0.32100000000000001}]},{"osd":4,"last update":"Tue Nov 28 19:59:52 2023","interfaces":[{"interface":"back","average":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":1.206,"5min":1.206,"15min":1.206},"last":0.82199999999999995},{"interface":"front","average":{"1min":0.80300000000000005,"5min":0.80300000000000005,"15min":0.80300000000000005},"min":{"1min":0.503,"5min":0.503,"15min":0.503},"max":{"1min":1.222,"5min":1.222,"15min":1.222},"last":0.83599999999999997}]},{"osd":5,"last update":"Tue Nov 28 19:59:52 2023","interfaces":[{"interface":"back","average":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"min":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":1.151,"5min":1.151,"15min":1.151},"last":0.81000000000000005},{"interface":"front","average":{"1min":0.80300000000000005,"5min":0.80300000000000005,"15min":0.80300000000000005},"min":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":1.3100000000000001,"5min":1.3100000000000001,"15min":1.3100000000000001},"last":0.77500000000000002}]},{"osd":6,"last update":"Tue Nov 28 19:59:52 2023","interfaces":[{"interface":"back","average":{"1min":0.84399999999999997,"5min":0.84399999999999997,"15min":0.84399999999999997},"min":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":1.361,"5min":1.361,"15min":1.361},"last":0.877},{"interface":"front","average":{"1min":0.749,"5min":0.749,"15min":0.749},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.125,"5min":1.125,"15min":1.125},"last":0.86799999999999999}]},{"osd":7,"last update":"Tue Nov 28 19:59:52 2023","interfaces":[{"interface":"back","average":{"1min":0.84999999999999998,"5min":0.84999999999999998,"15min":0.84999999999999998},"min":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"max":{"1min":1.2569999999999999,"5min":1.2569999999999999,"15min":1.2569999999999999},"last":0.79200000000000004},{"interface":"front","average":{"1min":0.89100000000000001,"5min":0.89100000000000001,"15min":0.89100000000000001},"min":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"max":{"1min":1.339,"5min":1.339,"15min":1.339},"last":0.76300000000000001}]}]},{"osd":2,"up_from":13,"seq":55834574870,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27544,"kb_used_data":516,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344296,"statfs":{"total":96636764160,"available":96608559104,"internally_reserved":0,"allocated":528384,"data_stored":230335,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 19:59:54 2023","interfaces":[{"interface":"back","average":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"min":{"1min":0.26400000000000001,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"last":0.36099999999999999},{"interface":"front","average":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.67700000000000005,"5min":0.67700000000000005,"15min":0.67700000000000005},"last":0.53000000000000003}]},{"osd":1,"last update":"Tue Nov 28 19:59:54 2023","interfaces":[{"interface":"back","average":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"min":{"1min":0.29899999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":1.0389999999999999,"5min":1.0389999999999999,"15min":1.0389999999999999},"last":0.49099999999999999},{"interface":"front","average":{"1min":0.505,"5min":0.505,"15min":0.505},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.70999999999999996,"5min":0.70999999999999996,"15min":0.70999999999999996},"last":0.40000000000000002}]},{"osd":3,"last update":"Tue Nov 28 19:59:54 2023","interfaces":[{"interface":"back","average":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"min":{"1min":0.28199999999999997,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.629,"5min":0.629,"15min":0.629},"last":0.38100000000000001},{"interface":"front","average":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.98499999999999999,"5min":0.98499999999999999,"15min":0.98499999999999999},"last":0.57199999999999995}]},{"osd":4,"last update":"Tue Nov 28 19:59:54 2023","interfaces":[{"interface":"back","average":{"1min":0.86199999999999999,"5min":0.86199999999999999,"15min":0.86199999999999999},"min":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"max":{"1min":1.139,"5min":1.139,"15min":1.139},"last":0.59299999999999997},{"interface":"front","average":{"1min":0.85299999999999998,"5min":0.85299999999999998,"15min":0.85299999999999998},"min":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":1.238,"5min":1.238,"15min":1.238},"last":0.66800000000000004}]},{"osd":5,"last update":"Tue Nov 28 19:59:54 2023","interfaces":[{"interface":"back","average":{"1min":0.88500000000000001,"5min":0.88500000000000001,"15min":0.88500000000000001},"min":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":1.6180000000000001,"5min":1.6180000000000001,"15min":1.6180000000000001},"last":0.63300000000000001},{"interface":"front","average":{"1min":0.83499999999999996,"5min":0.83499999999999996,"15min":0.83499999999999996},"min":{"1min":0.496,"5min":0.496,"15min":0.496},"max":{"1min":1.339,"5min":1.339,"15min":1.339},"last":0.68200000000000005}]},{"osd":6,"last update":"Tue Nov 28 19:59:54 2023","interfaces":[{"interface":"back","average":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":0.80600000000000005},"min":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1.1839999999999999,"5min":1.1839999999999999,"15min":1.1839999999999999},"last":0.70499999999999996},{"interface":"front","average":{"1min":0.86199999999999999,"5min":0.86199999999999999,"15min":0.86199999999999999},"min":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":1.099,"5min":1.099,"15min":1.099},"last":0.78000000000000003}]},{"osd":7,"last update":"Tue Nov 28 19:59:54 2023","interfaces":[{"interface":"back","average":{"1min":0.89000000000000001,"5min":0.89000000000000001,"15min":0.89000000000000001},"min":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":1.4590000000000001,"5min":1.4590000000000001,"15min":1.4590000000000001},"last":0.72899999999999998},{"interface":"front","average":{"1min":0.86699999999999999,"5min":0.86699999999999999,"15min":0.86699999999999999},"min":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":1.387,"5min":1.387,"15min":1.387},"last":0.61399999999999999}]}]},{"osd":1,"up_from":13,"seq":55834574872,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27524,"kb_used_data":500,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344316,"statfs":{"total":96636764160,"available":96608579584,"internally_reserved":0,"allocated":512000,"data_stored":221426,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 19:59:53 2023","interfaces":[{"interface":"back","average":{"1min":0.65800000000000003,"5min":0.65800000000000003,"15min":0.65800000000000003},"min":{"1min":0.31,"5min":0.31,"15min":0.31},"max":{"1min":3.8740000000000001,"5min":3.8740000000000001,"15min":3.8740000000000001},"last":0.35799999999999998},{"interface":"front","average":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"min":{"1min":0.25,"5min":0.25,"15min":0.25},"max":{"1min":2.0760000000000001,"5min":2.0760000000000001,"15min":2.0760000000000001},"last":0.26200000000000001}]},{"osd":2,"last update":"Tue Nov 28 19:59:53 2023","interfaces":[{"interface":"back","average":{"1min":0.65900000000000003,"5min":0.65900000000000003,"15min":0.65900000000000003},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":3.7320000000000002,"5min":3.7320000000000002,"15min":3.7320000000000002},"last":0.311},{"interface":"front","average":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":3.9089999999999998,"5min":3.9089999999999998,"15min":3.9089999999999998},"last":0.39900000000000002}]},{"osd":3,"last update":"Tue Nov 28 19:59:53 2023","interfaces":[{"interface":"back","average":{"1min":0.68100000000000005,"5min":0.68100000000000005,"15min":0.68100000000000005},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":1.6399999999999999,"5min":1.6399999999999999,"15min":1.6399999999999999},"last":0.41999999999999998},{"interface":"front","average":{"1min":0.70299999999999996,"5min":0.70299999999999996,"15min":0.70299999999999996},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":2.5270000000000001,"5min":2.5270000000000001,"15min":2.5270000000000001},"last":0.38500000000000001}]},{"osd":4,"last update":"Tue Nov 28 19:59:53 2023","interfaces":[{"interface":"back","average":{"1min":0.89500000000000002,"5min":0.89500000000000002,"15min":0.89500000000000002},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":3.1659999999999999,"5min":3.1659999999999999,"15min":3.1659999999999999},"last":0.61399999999999999},{"interface":"front","average":{"1min":0.94599999999999995,"5min":0.94599999999999995,"15min":0.94599999999999995},"min":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":3.7959999999999998,"5min":3.7959999999999998,"15min":3.7959999999999998},"last":0.67600000000000005}]},{"osd":5,"last update":"Tue Nov 28 19:59:53 2023","interfaces":[{"interface":"back","average":{"1min":0.98899999999999999,"5min":0.98899999999999999,"15min":0.98899999999999999},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":4.1479999999999997,"5min":4.1479999999999997,"15min":4.1479999999999997},"last":0.66400000000000003},{"interface":"front","average":{"1min":0.91000000000000003,"5min":0.91000000000000003,"15min":0.91000000000000003},"min":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":3.5569999999999999,"5min":3.5569999999999999,"15min":3.5569999999999999},"last":0.76300000000000001}]},{"osd":6,"last update":"Tue Nov 28 19:59:53 2023","interfaces":[{"interface":"back","average":{"1min":0.99199999999999999,"5min":0.99199999999999999,"15min":0.99199999999999999},"min":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":2.863,"5min":2.863,"15min":2.863},"last":0.72199999999999998},{"interface":"front","average":{"1min":0.98299999999999998,"5min":0.98299999999999998,"15min":0.98299999999999998},"min":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"max":{"1min":3.371,"5min":3.371,"15min":3.371},"last":0.73799999999999999}]},{"osd":7,"last update":"Tue Nov 28 19:59:53 2023","interfaces":[{"interface":"back","average":{"1min":1.0129999999999999,"5min":1.0129999999999999,"15min":1.0129999999999999},"min":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"max":{"1min":3.8439999999999999,"5min":3.8439999999999999,"15min":3.8439999999999999},"last":0.70899999999999996},{"interface":"front","average":{"1min":1.038,"5min":1.038,"15min":1.038},"min":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"max":{"1min":3.9689999999999999,"5min":3.9689999999999999,"15min":3.9689999999999999},"last":0.69099999999999995}]}]},{"osd":0,"up_from":13,"seq":55834574871,"num_pgs":46,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27600,"kb_used_data":576,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344240,"statfs":{"total":96636764160,"available":96608501760,"internally_reserved":0,"allocated":589824,"data_stored":819111,"data_compressed":33374,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Nov 28 19:59:56 2023","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.68999999999999995,"15min":0.68999999999999995},"min":{"1min":0.29899999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":4.883,"5min":4.883,"15min":4.883},"last":0.40999999999999998},{"interface":"front","average":{"1min":0.878,"5min":0.878,"15min":0.878},"min":{"1min":0.29399999999999998,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":8.0800000000000001,"5min":8.0800000000000001,"15min":8.0800000000000001},"last":0.52300000000000002}]},{"osd":2,"last update":"Tue Nov 28 19:59:56 2023","interfaces":[{"interface":"back","average":{"1min":0.97399999999999998,"5min":0.97399999999999998,"15min":0.97399999999999998},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":8.1029999999999998,"5min":8.1029999999999998,"15min":8.1029999999999998},"last":0.45300000000000001},{"interface":"front","average":{"1min":0.98699999999999999,"5min":0.98699999999999999,"15min":0.98699999999999999},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":8.1310000000000002,"5min":8.1310000000000002,"15min":8.1310000000000002},"last":0.46200000000000002}]},{"osd":3,"last update":"Tue Nov 28 19:59:56 2023","interfaces":[{"interface":"back","average":{"1min":0.747,"5min":0.747,"15min":0.747},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":4.3949999999999996,"5min":4.3949999999999996,"15min":4.3949999999999996},"last":0.375},{"interface":"front","average":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":4.3470000000000004,"5min":4.3470000000000004,"15min":4.3470000000000004},"last":0.50600000000000001}]},{"osd":4,"last update":"Tue Nov 28 19:59:56 2023","interfaces":[{"interface":"back","average":{"1min":1.0509999999999999,"5min":1.0509999999999999,"15min":1.0509999999999999},"min":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"max":{"1min":4.6360000000000001,"5min":4.6360000000000001,"15min":4.6360000000000001},"last":0.53600000000000003},{"interface":"front","average":{"1min":1.0529999999999999,"5min":1.0529999999999999,"15min":1.0529999999999999},"min":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":4.4710000000000001,"5min":4.4710000000000001,"15min":4.4710000000000001},"last":0.64200000000000002}]},{"osd":5,"last update":"Tue Nov 28 19:59:56 2023","interfaces":[{"interface":"back","average":{"1min":1.0649999999999999,"5min":1.0649999999999999,"15min":1.0649999999999999},"min":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":4.6120000000000001,"5min":4.6120000000000001,"15min":4.6120000000000001},"last":0.65600000000000003},{"interface":"front","average":{"1min":1.052,"5min":1.052,"15min":1.052},"min":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"max":{"1min":4.5449999999999999,"5min":4.5449999999999999,"15min":4.5449999999999999},"last":0.57199999999999995}]},{"osd":6,"last update":"Tue Nov 28 19:59:56 2023","interfaces":[{"interface":"back","average":{"1min":1.079,"5min":1.079,"15min":1.079},"min":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":4.657,"5min":4.657,"15min":4.657},"last":0.54900000000000004},{"interface":"front","average":{"1min":1.097,"5min":1.097,"15min":1.097},"min":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"max":{"1min":4.5259999999999998,"5min":4.5259999999999998,"15min":4.5259999999999998},"last":0.61199999999999999}]},{"osd":7,"last update":"Tue Nov 28 19:59:56 2023","interfaces":[{"interface":"back","average":{"1min":1.101,"5min":1.101,"15min":1.101},"min":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.60099999999999998},"max":{"1min":4.7320000000000002,"5min":4.7320000000000002,"15min":4.7320000000000002},"last":0.56000000000000005},{"interface":"front","average":{"1min":1.046,"5min":1.046,"15min":1.046},"min":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":4.4939999999999998,"5min":4.4939999999999998,"15min":4.4939999999999998},"last":0.623}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33374,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33374,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":3141,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":3177,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-28T20:00:35.224 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-28T20:00:35.392 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:35.389+0000 7fa56edd8640 1 Processor -- start 2023-11-28T20:00:35.392 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:35.389+0000 7fa56edd8640 1 -- start start 2023-11-28T20:00:35.394 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:35.389+0000 7fa56edd8640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fa56806d2b0 0x7fa56806d690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:35.394 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:35.389+0000 7fa56edd8640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fa5680c3b80 0x7fa5680c5300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:35.394 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:35.389+0000 7fa56edd8640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa56806bb80 con 0x7fa56806c020 2023-11-28T20:00:35.394 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:35.389+0000 7fa56edd8640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa5680c5840 con 0x7fa56806d2b0 2023-11-28T20:00:35.394 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:35.389+0000 7fa56edd8640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa5681515c0 con 0x7fa5680c3b80 2023-11-28T20:00:35.394 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:35.389+0000 7fa56cb74640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fa56806d2b0 0x7fa56806d690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:35.394 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:35.389+0000 7fa56cb74640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fa56806d2b0 0x7fa56806d690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:58032/0 (socket says 172.21.15.78:58032) 2023-11-28T20:00:35.395 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:35.389+0000 7fa56cb74640 1 -- 172.21.15.78:0/1350562877 learned_addr learned my addr 172.21.15.78:0/1350562877 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T20:00:35.395 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:35.389+0000 7fa567fff640 1 --2- 172.21.15.78:0/1350562877 >> v2:172.21.15.179:3300/0 conn(0x7fa5680c3b80 0x7fa5680c5300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:35.395 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:35.389+0000 7fa56cb74640 1 -- 172.21.15.78:0/1350562877 >> v2:172.21.15.179:3300/0 conn(0x7fa5680c3b80 msgr2=0x7fa5680c5300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:00:35.395 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:35.389+0000 7fa56cb74640 1 --2- 172.21.15.78:0/1350562877 >> v2:172.21.15.179:3300/0 conn(0x7fa5680c3b80 0x7fa5680c5300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:35.395 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:35.389+0000 7fa56cb74640 1 -- 172.21.15.78:0/1350562877 >> v1:172.21.15.179:6789/0 conn(0x7fa56806c020 legacy=0x7fa56806c4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:00:35.395 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:35.389+0000 7fa56cb74640 1 -- 172.21.15.78:0/1350562877 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5681518a0 con 0x7fa56806d2b0 2023-11-28T20:00:35.395 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:35.389+0000 7fa567fff640 1 --2- 172.21.15.78:0/1350562877 >> v2:172.21.15.179:3300/0 conn(0x7fa5680c3b80 0x7fa5680c5300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T20:00:35.397 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:35.393+0000 7fa56cb74640 1 --2- 172.21.15.78:0/1350562877 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa56806d2b0 0x7fa56806d690 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7fa56806b5a0 tx=0x7fa55c01c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=95bc1c818af8e711 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:00:35.397 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:35.393+0000 7fa5677fe640 1 -- 172.21.15.78:0/1350562877 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa55c0ac600 con 0x7fa56806d2b0 2023-11-28T20:00:35.398 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:35.393+0000 7fa5677fe640 1 -- 172.21.15.78:0/1350562877 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa55c0a8050 con 0x7fa56806d2b0 2023-11-28T20:00:35.398 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:35.393+0000 7fa5677fe640 1 -- 172.21.15.78:0/1350562877 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa55c0ac980 con 0x7fa56806d2b0 2023-11-28T20:00:35.398 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:35.393+0000 7fa56edd8640 1 -- 172.21.15.78:0/1350562877 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa56806d2b0 msgr2=0x7fa56806d690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:00:35.399 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:35.393+0000 7fa56edd8640 1 --2- 172.21.15.78:0/1350562877 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa56806d2b0 0x7fa56806d690 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7fa56806b5a0 tx=0x7fa55c01c490 comp rx=0 tx=0).stop 2023-11-28T20:00:35.399 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:35.393+0000 7fa56edd8640 1 -- 172.21.15.78:0/1350562877 shutdown_connections 2023-11-28T20:00:35.399 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:35.393+0000 7fa56edd8640 1 --2- 172.21.15.78:0/1350562877 >> v2:172.21.15.179:3300/0 conn(0x7fa5680c3b80 0x7fa5680c5300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:35.399 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:35.393+0000 7fa56edd8640 1 --2- 172.21.15.78:0/1350562877 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa56806d2b0 0x7fa56806d690 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:35.399 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:35.393+0000 7fa56edd8640 1 -- 172.21.15.78:0/1350562877 >> 172.21.15.78:0/1350562877 conn(0x7fa5680a7810 msgr2=0x7fa5680a7c20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:00:35.399 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:35.393+0000 7fa56edd8640 1 -- 172.21.15.78:0/1350562877 shutdown_connections 2023-11-28T20:00:35.399 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:35.393+0000 7fa56edd8640 1 -- 172.21.15.78:0/1350562877 wait complete. 2023-11-28T20:00:35.400 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:35.397+0000 7fa56edd8640 1 Processor -- start 2023-11-28T20:00:35.400 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:35.397+0000 7fa56edd8640 1 -- start start 2023-11-28T20:00:35.402 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:35.397+0000 7fa56edd8640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa56806c020 0x7fa5680c4450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:35.402 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:35.397+0000 7fa56edd8640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa56806d2b0 0x7fa5681ed4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:35.402 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:35.397+0000 7fa56edd8640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa5680c3b80 0x7fa5681eda20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:35.402 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:35.397+0000 7fa56edd8640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa568152ba0 con 0x7fa5680c3b80 2023-11-28T20:00:35.402 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:35.397+0000 7fa56edd8640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa56814b0b0 con 0x7fa56806d2b0 2023-11-28T20:00:35.402 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:35.397+0000 7fa56edd8640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa5681f14b0 con 0x7fa56806c020 2023-11-28T20:00:35.402 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:35.397+0000 7fa56d375640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa5680c3b80 0x7fa5681eda20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:35.402 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:35.397+0000 7fa56d375640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa5680c3b80 0x7fa5681eda20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:58034/0 (socket says 172.21.15.78:58034) 2023-11-28T20:00:35.402 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:35.397+0000 7fa56d375640 1 -- 172.21.15.78:0/567328268 learned_addr learned my addr 172.21.15.78:0/567328268 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T20:00:35.402 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:35.397+0000 7fa56cb74640 1 --2- 172.21.15.78:0/567328268 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa56806c020 0x7fa5680c4450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:35.403 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:35.397+0000 7fa567fff640 1 --2- 172.21.15.78:0/567328268 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa56806d2b0 0x7fa5681ed4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:35.403 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:35.397+0000 7fa56d375640 1 -- 172.21.15.78:0/567328268 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa56806c020 msgr2=0x7fa5680c4450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:00:35.403 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:35.397+0000 7fa56d375640 1 --2- 172.21.15.78:0/567328268 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa56806c020 0x7fa5680c4450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:35.403 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:35.397+0000 7fa56d375640 1 -- 172.21.15.78:0/567328268 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa56806d2b0 msgr2=0x7fa5681ed4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:00:35.403 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:35.397+0000 7fa56d375640 1 --2- 172.21.15.78:0/567328268 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa56806d2b0 0x7fa5681ed4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:35.403 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:35.397+0000 7fa56d375640 1 -- 172.21.15.78:0/567328268 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa55c0094d0 con 0x7fa5680c3b80 2023-11-28T20:00:35.403 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:35.397+0000 7fa56d375640 1 --2- 172.21.15.78:0/567328268 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa5680c3b80 0x7fa5681eda20 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7fa56000c780 tx=0x7fa56000cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:00:35.404 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:35.397+0000 7fa5657fa640 1 -- 172.21.15.78:0/567328268 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa560004b20 con 0x7fa5680c3b80 2023-11-28T20:00:35.404 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:35.397+0000 7fa5657fa640 1 -- 172.21.15.78:0/567328268 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa560004c80 con 0x7fa5680c3b80 2023-11-28T20:00:35.405 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:35.397+0000 7fa56edd8640 1 -- 172.21.15.78:0/567328268 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa56814ef80 con 0x7fa5680c3b80 2023-11-28T20:00:35.405 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:35.397+0000 7fa5657fa640 1 -- 172.21.15.78:0/567328268 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa56000aa90 con 0x7fa5680c3b80 2023-11-28T20:00:35.405 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:35.397+0000 7fa56edd8640 1 -- 172.21.15.78:0/567328268 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa5681f1790 con 0x7fa5680c3b80 2023-11-28T20:00:35.405 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:35.397+0000 7fa56edd8640 1 -- 172.21.15.78:0/567328268 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa5680679d0 con 0x7fa5680c3b80 2023-11-28T20:00:35.406 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:35.401+0000 7fa5657fa640 1 -- 172.21.15.78:0/567328268 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fa56000abf0 con 0x7fa5680c3b80 2023-11-28T20:00:35.406 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:35.401+0000 7fa5657fa640 1 --2- 172.21.15.78:0/567328268 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fa54c066470 0x7fa54c068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:35.407 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:35.401+0000 7fa5657fa640 1 -- 172.21.15.78:0/567328268 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 6885+0+0 (secure 0 0 0) 0x7fa560084290 con 0x7fa5680c3b80 2023-11-28T20:00:35.407 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:35.401+0000 7fa56cb74640 1 --2- 172.21.15.78:0/567328268 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fa54c066470 0x7fa54c068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:35.407 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:35.401+0000 7fa56cb74640 1 --2- 172.21.15.78:0/567328268 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fa54c066470 0x7fa54c068930 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fa55c0ae000 tx=0x7fa55c0a7000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:00:35.409 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:35.405+0000 7fa5657fa640 1 -- 172.21.15.78:0/567328268 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fa5600513b0 con 0x7fa5680c3b80 2023-11-28T20:00:35.558 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:35.553+0000 7fa56edd8640 1 -- 172.21.15.78:0/567328268 --> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fa56814ee00 con 0x7fa54c066470 2023-11-28T20:00:35.571 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:35.565+0000 7fa5657fa640 1 -- 172.21.15.78:0/567328268 <== mgr.4106 v2:172.21.15.78:6832/2935380957 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+527047 (secure 0 0 0) 0x7fa55c0bc090 con 0x7fa54c066470 2023-11-28T20:00:35.576 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-11-28T20:00:35.584 INFO:teuthology.orchestra.run.smithi078.stderr:dumped all 2023-11-28T20:00:35.586 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:35.573+0000 7fa56edd8640 1 -- 172.21.15.78:0/567328268 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fa54c066470 msgr2=0x7fa54c068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:00:35.586 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:35.573+0000 7fa56edd8640 1 --2- 172.21.15.78:0/567328268 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fa54c066470 0x7fa54c068930 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fa55c0ae000 tx=0x7fa55c0a7000 comp rx=0 tx=0).stop 2023-11-28T20:00:35.586 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:35.573+0000 7fa56edd8640 1 -- 172.21.15.78:0/567328268 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa5680c3b80 msgr2=0x7fa5681eda20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:00:35.587 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:35.573+0000 7fa56edd8640 1 --2- 172.21.15.78:0/567328268 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa5680c3b80 0x7fa5681eda20 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7fa56000c780 tx=0x7fa56000cc40 comp rx=0 tx=0).stop 2023-11-28T20:00:35.587 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:35.573+0000 7fa56edd8640 1 -- 172.21.15.78:0/567328268 shutdown_connections 2023-11-28T20:00:35.587 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:35.573+0000 7fa56edd8640 1 --2- 172.21.15.78:0/567328268 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fa54c066470 0x7fa54c068930 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:35.587 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:35.573+0000 7fa56edd8640 1 --2- 172.21.15.78:0/567328268 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa5680c3b80 0x7fa5681eda20 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:35.588 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:35.573+0000 7fa56edd8640 1 --2- 172.21.15.78:0/567328268 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa56806d2b0 0x7fa5681ed4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:35.588 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:35.573+0000 7fa56edd8640 1 --2- 172.21.15.78:0/567328268 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa56806c020 0x7fa5680c4450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:35.588 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:35.573+0000 7fa56edd8640 1 -- 172.21.15.78:0/567328268 >> 172.21.15.78:0/567328268 conn(0x7fa5680a7810 msgr2=0x7fa5680a7bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:00:35.589 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:35.573+0000 7fa56edd8640 1 -- 172.21.15.78:0/567328268 shutdown_connections 2023-11-28T20:00:35.589 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:35.573+0000 7fa56edd8640 1 -- 172.21.15.78:0/567328268 wait complete. 2023-11-28T20:00:35.597 INFO:teuthology.orchestra.run.smithi078.stdout:{"pg_ready":true,"pg_map":{"version":88,"stamp":"2023-11-28T20:00:33.972150+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":596683,"num_objects":45,"num_object_clones":0,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":251,"num_write_kb":2447,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":27,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":197,"ondisk_log_size":197,"up":386,"acting":386,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":317,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":220416,"kb_used_data":4208,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754754304,"statfs":{"total":773094113280,"available":772868407296,"internally_reserved":0,"allocated":4308992,"data_stored":2992682,"data_compressed":66748,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":37,"apply_latency_ms":37,"commit_latency_ns":37000000,"apply_latency_ns":37000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.924523"},"pg_stats":[{"pgid":"8.31","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-28T20:00:32.539008+0000","last_change":"2023-11-28T20:00:30.796564+0000","last_active":"2023-11-28T20:00:32.539008+0000","last_peered":"2023-11-28T20:00:32.539008+0000","last_clean":"2023-11-28T20:00:32.539008+0000","last_became_active":"2023-11-28T20:00:30.796295+0000","last_became_peered":"2023-11-28T20:00:30.796295+0000","last_unstale":"2023-11-28T20:00:32.539008+0000","last_undegraded":"2023-11-28T20:00:32.539008+0000","last_fullsized":"2023-11-28T20:00:32.539008+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:30.046728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:30.046728+0000","last_clean_scrub_stamp":"2023-11-28T20:00:30.046728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:43:47.208125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.3f","version":"0'0","reported_seq":15,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-28T20:00:30.781176+0000","last_change":"2023-11-28T20:00:13.804342+0000","last_active":"2023-11-28T20:00:30.781176+0000","last_peered":"2023-11-28T20:00:30.781176+0000","last_clean":"2023-11-28T20:00:30.781176+0000","last_became_active":"2023-11-28T20:00:13.803858+0000","last_became_peered":"2023-11-28T20:00:13.803858+0000","last_unstale":"2023-11-28T20:00:30.781176+0000","last_undegraded":"2023-11-28T20:00:30.781176+0000","last_fullsized":"2023-11-28T20:00:30.781176+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_clean_scrub_stamp":"2023-11-28T20:00:12.764355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:25:02.945127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.30","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-28T20:00:32.537828+0000","last_change":"2023-11-28T20:00:30.788946+0000","last_active":"2023-11-28T20:00:32.537828+0000","last_peered":"2023-11-28T20:00:32.537828+0000","last_clean":"2023-11-28T20:00:32.537828+0000","last_became_active":"2023-11-28T20:00:30.788686+0000","last_became_peered":"2023-11-28T20:00:30.788686+0000","last_unstale":"2023-11-28T20:00:32.537828+0000","last_undegraded":"2023-11-28T20:00:32.537828+0000","last_fullsized":"2023-11-28T20:00:32.537828+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:30.046728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:30.046728+0000","last_clean_scrub_stamp":"2023-11-28T20:00:30.046728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:53:41.132014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":15,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-28T20:00:30.776196+0000","last_change":"2023-11-28T20:00:13.799903+0000","last_active":"2023-11-28T20:00:30.776196+0000","last_peered":"2023-11-28T20:00:30.776196+0000","last_clean":"2023-11-28T20:00:30.776196+0000","last_became_active":"2023-11-28T20:00:13.799607+0000","last_became_peered":"2023-11-28T20:00:13.799607+0000","last_unstale":"2023-11-28T20:00:30.776196+0000","last_undegraded":"2023-11-28T20:00:30.776196+0000","last_fullsized":"2023-11-28T20:00:30.776196+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_clean_scrub_stamp":"2023-11-28T20:00:12.764355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:10:57.174856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.33","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-28T20:00:32.539723+0000","last_change":"2023-11-28T20:00:30.785928+0000","last_active":"2023-11-28T20:00:32.539723+0000","last_peered":"2023-11-28T20:00:32.539723+0000","last_clean":"2023-11-28T20:00:32.539723+0000","last_became_active":"2023-11-28T20:00:30.785707+0000","last_became_peered":"2023-11-28T20:00:30.785707+0000","last_unstale":"2023-11-28T20:00:32.539723+0000","last_undegraded":"2023-11-28T20:00:32.539723+0000","last_fullsized":"2023-11-28T20:00:32.539723+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:30.046728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:30.046728+0000","last_clean_scrub_stamp":"2023-11-28T20:00:30.046728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:06:54.408654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":15,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-28T20:00:30.773955+0000","last_change":"2023-11-28T20:00:13.810666+0000","last_active":"2023-11-28T20:00:30.773955+0000","last_peered":"2023-11-28T20:00:30.773955+0000","last_clean":"2023-11-28T20:00:30.773955+0000","last_became_active":"2023-11-28T20:00:13.810420+0000","last_became_peered":"2023-11-28T20:00:13.810420+0000","last_unstale":"2023-11-28T20:00:30.773955+0000","last_undegraded":"2023-11-28T20:00:30.773955+0000","last_fullsized":"2023-11-28T20:00:30.773955+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_clean_scrub_stamp":"2023-11-28T20:00:12.764355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T06:58:51.315382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.32","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-28T20:00:32.538913+0000","last_change":"2023-11-28T20:00:30.790694+0000","last_active":"2023-11-28T20:00:32.538913+0000","last_peered":"2023-11-28T20:00:32.538913+0000","last_clean":"2023-11-28T20:00:32.538913+0000","last_became_active":"2023-11-28T20:00:30.789192+0000","last_became_peered":"2023-11-28T20:00:30.789192+0000","last_unstale":"2023-11-28T20:00:32.538913+0000","last_undegraded":"2023-11-28T20:00:32.538913+0000","last_fullsized":"2023-11-28T20:00:32.538913+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:30.046728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:30.046728+0000","last_clean_scrub_stamp":"2023-11-28T20:00:30.046728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T07:01:34.461518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.3c","version":"0'0","reported_seq":15,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-28T20:00:30.767553+0000","last_change":"2023-11-28T20:00:13.805753+0000","last_active":"2023-11-28T20:00:30.767553+0000","last_peered":"2023-11-28T20:00:30.767553+0000","last_clean":"2023-11-28T20:00:30.767553+0000","last_became_active":"2023-11-28T20:00:13.805513+0000","last_became_peered":"2023-11-28T20:00:13.805513+0000","last_unstale":"2023-11-28T20:00:30.767553+0000","last_undegraded":"2023-11-28T20:00:30.767553+0000","last_fullsized":"2023-11-28T20:00:30.767553+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_clean_scrub_stamp":"2023-11-28T20:00:12.764355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:43:04.959781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.35","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-28T20:00:31.770163+0000","last_change":"2023-11-28T20:00:30.791788+0000","last_active":"2023-11-28T20:00:31.770163+0000","last_peered":"2023-11-28T20:00:31.770163+0000","last_clean":"2023-11-28T20:00:31.770163+0000","last_became_active":"2023-11-28T20:00:30.791520+0000","last_became_peered":"2023-11-28T20:00:30.791520+0000","last_unstale":"2023-11-28T20:00:31.770163+0000","last_undegraded":"2023-11-28T20:00:31.770163+0000","last_fullsized":"2023-11-28T20:00:31.770163+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:30.046728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:30.046728+0000","last_clean_scrub_stamp":"2023-11-28T20:00:30.046728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:19:10.498515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":15,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-28T20:00:30.767589+0000","last_change":"2023-11-28T20:00:13.807494+0000","last_active":"2023-11-28T20:00:30.767589+0000","last_peered":"2023-11-28T20:00:30.767589+0000","last_clean":"2023-11-28T20:00:30.767589+0000","last_became_active":"2023-11-28T20:00:13.807215+0000","last_became_peered":"2023-11-28T20:00:13.807215+0000","last_unstale":"2023-11-28T20:00:30.767589+0000","last_undegraded":"2023-11-28T20:00:30.767589+0000","last_fullsized":"2023-11-28T20:00:30.767589+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_clean_scrub_stamp":"2023-11-28T20:00:12.764355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:49:37.068470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.34","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-28T20:00:32.539619+0000","last_change":"2023-11-28T20:00:30.793081+0000","last_active":"2023-11-28T20:00:32.539619+0000","last_peered":"2023-11-28T20:00:32.539619+0000","last_clean":"2023-11-28T20:00:32.539619+0000","last_became_active":"2023-11-28T20:00:30.792827+0000","last_became_peered":"2023-11-28T20:00:30.792827+0000","last_unstale":"2023-11-28T20:00:32.539619+0000","last_undegraded":"2023-11-28T20:00:32.539619+0000","last_fullsized":"2023-11-28T20:00:32.539619+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:30.046728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:30.046728+0000","last_clean_scrub_stamp":"2023-11-28T20:00:30.046728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:31:27.443576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":15,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-28T20:00:30.776853+0000","last_change":"2023-11-28T20:00:13.808809+0000","last_active":"2023-11-28T20:00:30.776853+0000","last_peered":"2023-11-28T20:00:30.776853+0000","last_clean":"2023-11-28T20:00:30.776853+0000","last_became_active":"2023-11-28T20:00:13.808555+0000","last_became_peered":"2023-11-28T20:00:13.808555+0000","last_unstale":"2023-11-28T20:00:30.776853+0000","last_undegraded":"2023-11-28T20:00:30.776853+0000","last_fullsized":"2023-11-28T20:00:30.776853+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_clean_scrub_stamp":"2023-11-28T20:00:12.764355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:18:53.216142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.37","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-28T20:00:32.540513+0000","last_change":"2023-11-28T20:00:30.790277+0000","last_active":"2023-11-28T20:00:32.540513+0000","last_peered":"2023-11-28T20:00:32.540513+0000","last_clean":"2023-11-28T20:00:32.540513+0000","last_became_active":"2023-11-28T20:00:30.790017+0000","last_became_peered":"2023-11-28T20:00:30.790017+0000","last_unstale":"2023-11-28T20:00:32.540513+0000","last_undegraded":"2023-11-28T20:00:32.540513+0000","last_fullsized":"2023-11-28T20:00:32.540513+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:30.046728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:30.046728+0000","last_clean_scrub_stamp":"2023-11-28T20:00:30.046728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:29:00.422211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":15,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-28T20:00:30.770719+0000","last_change":"2023-11-28T20:00:13.799749+0000","last_active":"2023-11-28T20:00:30.770719+0000","last_peered":"2023-11-28T20:00:30.770719+0000","last_clean":"2023-11-28T20:00:30.770719+0000","last_became_active":"2023-11-28T20:00:13.799461+0000","last_became_peered":"2023-11-28T20:00:13.799461+0000","last_unstale":"2023-11-28T20:00:30.770719+0000","last_undegraded":"2023-11-28T20:00:30.770719+0000","last_fullsized":"2023-11-28T20:00:30.770719+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_clean_scrub_stamp":"2023-11-28T20:00:12.764355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:40:01.114533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.36","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-28T20:00:32.539491+0000","last_change":"2023-11-28T20:00:30.791517+0000","last_active":"2023-11-28T20:00:32.539491+0000","last_peered":"2023-11-28T20:00:32.539491+0000","last_clean":"2023-11-28T20:00:32.539491+0000","last_became_active":"2023-11-28T20:00:30.787480+0000","last_became_peered":"2023-11-28T20:00:30.787480+0000","last_unstale":"2023-11-28T20:00:32.539491+0000","last_undegraded":"2023-11-28T20:00:32.539491+0000","last_fullsized":"2023-11-28T20:00:32.539491+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:30.046728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:30.046728+0000","last_clean_scrub_stamp":"2023-11-28T20:00:30.046728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:43:47.208125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":15,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-28T20:00:30.779602+0000","last_change":"2023-11-28T20:00:13.790387+0000","last_active":"2023-11-28T20:00:30.779602+0000","last_peered":"2023-11-28T20:00:30.779602+0000","last_clean":"2023-11-28T20:00:30.779602+0000","last_became_active":"2023-11-28T20:00:13.790010+0000","last_became_peered":"2023-11-28T20:00:13.790010+0000","last_unstale":"2023-11-28T20:00:30.779602+0000","last_undegraded":"2023-11-28T20:00:30.779602+0000","last_fullsized":"2023-11-28T20:00:30.779602+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_clean_scrub_stamp":"2023-11-28T20:00:12.764355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:44:25.495847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.39","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-28T20:00:32.538488+0000","last_change":"2023-11-28T20:00:30.796681+0000","last_active":"2023-11-28T20:00:32.538488+0000","last_peered":"2023-11-28T20:00:32.538488+0000","last_clean":"2023-11-28T20:00:32.538488+0000","last_became_active":"2023-11-28T20:00:30.796438+0000","last_became_peered":"2023-11-28T20:00:30.796438+0000","last_unstale":"2023-11-28T20:00:32.538488+0000","last_undegraded":"2023-11-28T20:00:32.538488+0000","last_fullsized":"2023-11-28T20:00:32.538488+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:30.046728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:30.046728+0000","last_clean_scrub_stamp":"2023-11-28T20:00:30.046728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:18:48.883776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":15,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-28T20:00:30.782203+0000","last_change":"2023-11-28T20:00:13.808555+0000","last_active":"2023-11-28T20:00:30.782203+0000","last_peered":"2023-11-28T20:00:30.782203+0000","last_clean":"2023-11-28T20:00:30.782203+0000","last_became_active":"2023-11-28T20:00:13.808267+0000","last_became_peered":"2023-11-28T20:00:13.808267+0000","last_unstale":"2023-11-28T20:00:30.782203+0000","last_undegraded":"2023-11-28T20:00:30.782203+0000","last_fullsized":"2023-11-28T20:00:30.782203+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_clean_scrub_stamp":"2023-11-28T20:00:12.764355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:20:11.234527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.38","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-28T20:00:32.538942+0000","last_change":"2023-11-28T20:00:30.786560+0000","last_active":"2023-11-28T20:00:32.538942+0000","last_peered":"2023-11-28T20:00:32.538942+0000","last_clean":"2023-11-28T20:00:32.538942+0000","last_became_active":"2023-11-28T20:00:30.786267+0000","last_became_peered":"2023-11-28T20:00:30.786267+0000","last_unstale":"2023-11-28T20:00:32.538942+0000","last_undegraded":"2023-11-28T20:00:32.538942+0000","last_fullsized":"2023-11-28T20:00:32.538942+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:30.046728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:30.046728+0000","last_clean_scrub_stamp":"2023-11-28T20:00:30.046728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:00:56.896478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":15,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-28T20:00:30.775098+0000","last_change":"2023-11-28T20:00:13.821670+0000","last_active":"2023-11-28T20:00:30.775098+0000","last_peered":"2023-11-28T20:00:30.775098+0000","last_clean":"2023-11-28T20:00:30.775098+0000","last_became_active":"2023-11-28T20:00:13.821456+0000","last_became_peered":"2023-11-28T20:00:13.821456+0000","last_unstale":"2023-11-28T20:00:30.775098+0000","last_undegraded":"2023-11-28T20:00:30.775098+0000","last_fullsized":"2023-11-28T20:00:30.775098+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_clean_scrub_stamp":"2023-11-28T20:00:12.764355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:10:57.174856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.3b","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-28T20:00:31.774512+0000","last_change":"2023-11-28T20:00:30.783116+0000","last_active":"2023-11-28T20:00:31.774512+0000","last_peered":"2023-11-28T20:00:31.774512+0000","last_clean":"2023-11-28T20:00:31.774512+0000","last_became_active":"2023-11-28T20:00:30.782835+0000","last_became_peered":"2023-11-28T20:00:30.782835+0000","last_unstale":"2023-11-28T20:00:31.774512+0000","last_undegraded":"2023-11-28T20:00:31.774512+0000","last_fullsized":"2023-11-28T20:00:31.774512+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:30.046728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:30.046728+0000","last_clean_scrub_stamp":"2023-11-28T20:00:30.046728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:49:58.216764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":15,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-28T20:00:30.774662+0000","last_change":"2023-11-28T20:00:13.791296+0000","last_active":"2023-11-28T20:00:30.774662+0000","last_peered":"2023-11-28T20:00:30.774662+0000","last_clean":"2023-11-28T20:00:30.774662+0000","last_became_active":"2023-11-28T20:00:13.790916+0000","last_became_peered":"2023-11-28T20:00:13.790916+0000","last_unstale":"2023-11-28T20:00:30.774662+0000","last_undegraded":"2023-11-28T20:00:30.774662+0000","last_fullsized":"2023-11-28T20:00:30.774662+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_clean_scrub_stamp":"2023-11-28T20:00:12.764355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:44:25.495847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.3a","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-28T20:00:32.538054+0000","last_change":"2023-11-28T20:00:30.794494+0000","last_active":"2023-11-28T20:00:32.538054+0000","last_peered":"2023-11-28T20:00:32.538054+0000","last_clean":"2023-11-28T20:00:32.538054+0000","last_became_active":"2023-11-28T20:00:30.794189+0000","last_became_peered":"2023-11-28T20:00:30.794189+0000","last_unstale":"2023-11-28T20:00:32.538054+0000","last_undegraded":"2023-11-28T20:00:32.538054+0000","last_fullsized":"2023-11-28T20:00:32.538054+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:30.046728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:30.046728+0000","last_clean_scrub_stamp":"2023-11-28T20:00:30.046728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:43:25.928043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":15,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-28T20:00:30.772582+0000","last_change":"2023-11-28T20:00:13.800855+0000","last_active":"2023-11-28T20:00:30.772582+0000","last_peered":"2023-11-28T20:00:30.772582+0000","last_clean":"2023-11-28T20:00:30.772582+0000","last_became_active":"2023-11-28T20:00:13.800499+0000","last_became_peered":"2023-11-28T20:00:13.800499+0000","last_unstale":"2023-11-28T20:00:30.772582+0000","last_undegraded":"2023-11-28T20:00:30.772582+0000","last_fullsized":"2023-11-28T20:00:30.772582+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_clean_scrub_stamp":"2023-11-28T20:00:12.764355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:49:53.239354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.3d","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-28T20:00:32.538375+0000","last_change":"2023-11-28T20:00:30.791065+0000","last_active":"2023-11-28T20:00:32.538375+0000","last_peered":"2023-11-28T20:00:32.538375+0000","last_clean":"2023-11-28T20:00:32.538375+0000","last_became_active":"2023-11-28T20:00:30.789651+0000","last_became_peered":"2023-11-28T20:00:30.789651+0000","last_unstale":"2023-11-28T20:00:32.538375+0000","last_undegraded":"2023-11-28T20:00:32.538375+0000","last_fullsized":"2023-11-28T20:00:32.538375+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:30.046728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:30.046728+0000","last_clean_scrub_stamp":"2023-11-28T20:00:30.046728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:34:55.679879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":15,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-28T20:00:30.772950+0000","last_change":"2023-11-28T20:00:13.824858+0000","last_active":"2023-11-28T20:00:30.772950+0000","last_peered":"2023-11-28T20:00:30.772950+0000","last_clean":"2023-11-28T20:00:30.772950+0000","last_became_active":"2023-11-28T20:00:13.824569+0000","last_became_peered":"2023-11-28T20:00:13.824569+0000","last_unstale":"2023-11-28T20:00:30.772950+0000","last_undegraded":"2023-11-28T20:00:30.772950+0000","last_fullsized":"2023-11-28T20:00:30.772950+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_clean_scrub_stamp":"2023-11-28T20:00:12.764355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:00:42.063217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.3c","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-28T20:00:32.540167+0000","last_change":"2023-11-28T20:00:30.790987+0000","last_active":"2023-11-28T20:00:32.540167+0000","last_peered":"2023-11-28T20:00:32.540167+0000","last_clean":"2023-11-28T20:00:32.540167+0000","last_became_active":"2023-11-28T20:00:30.790656+0000","last_became_peered":"2023-11-28T20:00:30.790656+0000","last_unstale":"2023-11-28T20:00:32.540167+0000","last_undegraded":"2023-11-28T20:00:32.540167+0000","last_fullsized":"2023-11-28T20:00:32.540167+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:30.046728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:30.046728+0000","last_clean_scrub_stamp":"2023-11-28T20:00:30.046728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:59:41.017533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":15,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-28T20:00:30.772138+0000","last_change":"2023-11-28T20:00:13.808718+0000","last_active":"2023-11-28T20:00:30.772138+0000","last_peered":"2023-11-28T20:00:30.772138+0000","last_clean":"2023-11-28T20:00:30.772138+0000","last_became_active":"2023-11-28T20:00:13.808423+0000","last_became_peered":"2023-11-28T20:00:13.808423+0000","last_unstale":"2023-11-28T20:00:30.772138+0000","last_undegraded":"2023-11-28T20:00:30.772138+0000","last_fullsized":"2023-11-28T20:00:30.772138+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_clean_scrub_stamp":"2023-11-28T20:00:12.764355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:31:57.992158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.3f","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-28T20:00:32.538670+0000","last_change":"2023-11-28T20:00:30.790273+0000","last_active":"2023-11-28T20:00:32.538670+0000","last_peered":"2023-11-28T20:00:32.538670+0000","last_clean":"2023-11-28T20:00:32.538670+0000","last_became_active":"2023-11-28T20:00:30.789088+0000","last_became_peered":"2023-11-28T20:00:30.789088+0000","last_unstale":"2023-11-28T20:00:32.538670+0000","last_undegraded":"2023-11-28T20:00:32.538670+0000","last_fullsized":"2023-11-28T20:00:32.538670+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:30.046728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:30.046728+0000","last_clean_scrub_stamp":"2023-11-28T20:00:30.046728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:16:38.581443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":15,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-28T20:00:30.770749+0000","last_change":"2023-11-28T20:00:13.801043+0000","last_active":"2023-11-28T20:00:30.770749+0000","last_peered":"2023-11-28T20:00:30.770749+0000","last_clean":"2023-11-28T20:00:30.770749+0000","last_became_active":"2023-11-28T20:00:13.800680+0000","last_became_peered":"2023-11-28T20:00:13.800680+0000","last_unstale":"2023-11-28T20:00:30.770749+0000","last_undegraded":"2023-11-28T20:00:30.770749+0000","last_fullsized":"2023-11-28T20:00:30.770749+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_clean_scrub_stamp":"2023-11-28T20:00:12.764355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:22:53.309959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.3e","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-28T20:00:32.539218+0000","last_change":"2023-11-28T20:00:30.793302+0000","last_active":"2023-11-28T20:00:32.539218+0000","last_peered":"2023-11-28T20:00:32.539218+0000","last_clean":"2023-11-28T20:00:32.539218+0000","last_became_active":"2023-11-28T20:00:30.790709+0000","last_became_peered":"2023-11-28T20:00:30.790709+0000","last_unstale":"2023-11-28T20:00:32.539218+0000","last_undegraded":"2023-11-28T20:00:32.539218+0000","last_fullsized":"2023-11-28T20:00:32.539218+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:30.046728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:30.046728+0000","last_clean_scrub_stamp":"2023-11-28T20:00:30.046728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:48:36.022786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":15,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-28T20:00:30.776511+0000","last_change":"2023-11-28T20:00:13.827177+0000","last_active":"2023-11-28T20:00:30.776511+0000","last_peered":"2023-11-28T20:00:30.776511+0000","last_clean":"2023-11-28T20:00:30.776511+0000","last_became_active":"2023-11-28T20:00:13.826912+0000","last_became_peered":"2023-11-28T20:00:13.826912+0000","last_unstale":"2023-11-28T20:00:30.776511+0000","last_undegraded":"2023-11-28T20:00:30.776511+0000","last_fullsized":"2023-11-28T20:00:30.776511+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_clean_scrub_stamp":"2023-11-28T20:00:12.764355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:04:36.627323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.21","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-28T20:00:32.539544+0000","last_change":"2023-11-28T20:00:30.796613+0000","last_active":"2023-11-28T20:00:32.539544+0000","last_peered":"2023-11-28T20:00:32.539544+0000","last_clean":"2023-11-28T20:00:32.539544+0000","last_became_active":"2023-11-28T20:00:30.796367+0000","last_became_peered":"2023-11-28T20:00:30.796367+0000","last_unstale":"2023-11-28T20:00:32.539544+0000","last_undegraded":"2023-11-28T20:00:32.539544+0000","last_fullsized":"2023-11-28T20:00:32.539544+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:30.046728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:30.046728+0000","last_clean_scrub_stamp":"2023-11-28T20:00:30.046728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:04:17.052330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":15,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-28T20:00:30.779727+0000","last_change":"2023-11-28T20:00:13.821822+0000","last_active":"2023-11-28T20:00:30.779727+0000","last_peered":"2023-11-28T20:00:30.779727+0000","last_clean":"2023-11-28T20:00:30.779727+0000","last_became_active":"2023-11-28T20:00:13.821511+0000","last_became_peered":"2023-11-28T20:00:13.821511+0000","last_unstale":"2023-11-28T20:00:30.779727+0000","last_undegraded":"2023-11-28T20:00:30.779727+0000","last_fullsized":"2023-11-28T20:00:30.779727+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_clean_scrub_stamp":"2023-11-28T20:00:12.764355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:09:58.925137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.20","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-28T20:00:32.539269+0000","last_change":"2023-11-28T20:00:30.784152+0000","last_active":"2023-11-28T20:00:32.539269+0000","last_peered":"2023-11-28T20:00:32.539269+0000","last_clean":"2023-11-28T20:00:32.539269+0000","last_became_active":"2023-11-28T20:00:30.783235+0000","last_became_peered":"2023-11-28T20:00:30.783235+0000","last_unstale":"2023-11-28T20:00:32.539269+0000","last_undegraded":"2023-11-28T20:00:32.539269+0000","last_fullsized":"2023-11-28T20:00:32.539269+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:30.046728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:30.046728+0000","last_clean_scrub_stamp":"2023-11-28T20:00:30.046728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:16:19.987995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":15,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-28T20:00:30.788184+0000","last_change":"2023-11-28T20:00:13.818806+0000","last_active":"2023-11-28T20:00:30.788184+0000","last_peered":"2023-11-28T20:00:30.788184+0000","last_clean":"2023-11-28T20:00:30.788184+0000","last_became_active":"2023-11-28T20:00:13.818465+0000","last_became_peered":"2023-11-28T20:00:13.818465+0000","last_unstale":"2023-11-28T20:00:30.788184+0000","last_undegraded":"2023-11-28T20:00:30.788184+0000","last_fullsized":"2023-11-28T20:00:30.788184+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_clean_scrub_stamp":"2023-11-28T20:00:12.764355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:18:18.464919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.23","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-28T20:00:32.538510+0000","last_change":"2023-11-28T20:00:30.795743+0000","last_active":"2023-11-28T20:00:32.538510+0000","last_peered":"2023-11-28T20:00:32.538510+0000","last_clean":"2023-11-28T20:00:32.538510+0000","last_became_active":"2023-11-28T20:00:30.795038+0000","last_became_peered":"2023-11-28T20:00:30.795038+0000","last_unstale":"2023-11-28T20:00:32.538510+0000","last_undegraded":"2023-11-28T20:00:32.538510+0000","last_fullsized":"2023-11-28T20:00:32.538510+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:30.046728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:30.046728+0000","last_clean_scrub_stamp":"2023-11-28T20:00:30.046728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:04:03.299727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":15,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-28T20:00:30.768079+0000","last_change":"2023-11-28T20:00:13.812943+0000","last_active":"2023-11-28T20:00:30.768079+0000","last_peered":"2023-11-28T20:00:30.768079+0000","last_clean":"2023-11-28T20:00:30.768079+0000","last_became_active":"2023-11-28T20:00:13.812599+0000","last_became_peered":"2023-11-28T20:00:13.812599+0000","last_unstale":"2023-11-28T20:00:30.768079+0000","last_undegraded":"2023-11-28T20:00:30.768079+0000","last_fullsized":"2023-11-28T20:00:30.768079+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_clean_scrub_stamp":"2023-11-28T20:00:12.764355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:55:35.740926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.22","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-28T20:00:32.539202+0000","last_change":"2023-11-28T20:00:30.792948+0000","last_active":"2023-11-28T20:00:32.539202+0000","last_peered":"2023-11-28T20:00:32.539202+0000","last_clean":"2023-11-28T20:00:32.539202+0000","last_became_active":"2023-11-28T20:00:30.791675+0000","last_became_peered":"2023-11-28T20:00:30.791675+0000","last_unstale":"2023-11-28T20:00:32.539202+0000","last_undegraded":"2023-11-28T20:00:32.539202+0000","last_fullsized":"2023-11-28T20:00:32.539202+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:30.046728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:30.046728+0000","last_clean_scrub_stamp":"2023-11-28T20:00:30.046728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:06:54.408654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":15,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-28T20:00:30.787636+0000","last_change":"2023-11-28T20:00:13.818861+0000","last_active":"2023-11-28T20:00:30.787636+0000","last_peered":"2023-11-28T20:00:30.787636+0000","last_clean":"2023-11-28T20:00:30.787636+0000","last_became_active":"2023-11-28T20:00:13.818563+0000","last_became_peered":"2023-11-28T20:00:13.818563+0000","last_unstale":"2023-11-28T20:00:30.787636+0000","last_undegraded":"2023-11-28T20:00:30.787636+0000","last_fullsized":"2023-11-28T20:00:30.787636+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_clean_scrub_stamp":"2023-11-28T20:00:12.764355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:22:33.214424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.25","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-28T20:00:32.538480+0000","last_change":"2023-11-28T20:00:30.794761+0000","last_active":"2023-11-28T20:00:32.538480+0000","last_peered":"2023-11-28T20:00:32.538480+0000","last_clean":"2023-11-28T20:00:32.538480+0000","last_became_active":"2023-11-28T20:00:30.791836+0000","last_became_peered":"2023-11-28T20:00:30.791836+0000","last_unstale":"2023-11-28T20:00:32.538480+0000","last_undegraded":"2023-11-28T20:00:32.538480+0000","last_fullsized":"2023-11-28T20:00:32.538480+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:30.046728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:30.046728+0000","last_clean_scrub_stamp":"2023-11-28T20:00:30.046728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:33:06.403022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":15,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-28T20:00:30.773055+0000","last_change":"2023-11-28T20:00:13.797412+0000","last_active":"2023-11-28T20:00:30.773055+0000","last_peered":"2023-11-28T20:00:30.773055+0000","last_clean":"2023-11-28T20:00:30.773055+0000","last_became_active":"2023-11-28T20:00:13.797078+0000","last_became_peered":"2023-11-28T20:00:13.797078+0000","last_unstale":"2023-11-28T20:00:30.773055+0000","last_undegraded":"2023-11-28T20:00:30.773055+0000","last_fullsized":"2023-11-28T20:00:30.773055+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_clean_scrub_stamp":"2023-11-28T20:00:12.764355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:29:20.384184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.24","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-28T20:00:31.774932+0000","last_change":"2023-11-28T20:00:30.796754+0000","last_active":"2023-11-28T20:00:31.774932+0000","last_peered":"2023-11-28T20:00:31.774932+0000","last_clean":"2023-11-28T20:00:31.774932+0000","last_became_active":"2023-11-28T20:00:30.796461+0000","last_became_peered":"2023-11-28T20:00:30.796461+0000","last_unstale":"2023-11-28T20:00:31.774932+0000","last_undegraded":"2023-11-28T20:00:31.774932+0000","last_fullsized":"2023-11-28T20:00:31.774932+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:30.046728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:30.046728+0000","last_clean_scrub_stamp":"2023-11-28T20:00:30.046728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:53:41.132014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":15,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-28T20:00:30.772426+0000","last_change":"2023-11-28T20:00:13.805732+0000","last_active":"2023-11-28T20:00:30.772426+0000","last_peered":"2023-11-28T20:00:30.772426+0000","last_clean":"2023-11-28T20:00:30.772426+0000","last_became_active":"2023-11-28T20:00:13.805089+0000","last_became_peered":"2023-11-28T20:00:13.805089+0000","last_unstale":"2023-11-28T20:00:30.772426+0000","last_undegraded":"2023-11-28T20:00:30.772426+0000","last_fullsized":"2023-11-28T20:00:30.772426+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_clean_scrub_stamp":"2023-11-28T20:00:12.764355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:42:33.306843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.27","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-28T20:00:32.540632+0000","last_change":"2023-11-28T20:00:30.790971+0000","last_active":"2023-11-28T20:00:32.540632+0000","last_peered":"2023-11-28T20:00:32.540632+0000","last_clean":"2023-11-28T20:00:32.540632+0000","last_became_active":"2023-11-28T20:00:30.790497+0000","last_became_peered":"2023-11-28T20:00:30.790497+0000","last_unstale":"2023-11-28T20:00:32.540632+0000","last_undegraded":"2023-11-28T20:00:32.540632+0000","last_fullsized":"2023-11-28T20:00:32.540632+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:30.046728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:30.046728+0000","last_clean_scrub_stamp":"2023-11-28T20:00:30.046728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:32:37.911634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":15,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-28T20:00:30.777026+0000","last_change":"2023-11-28T20:00:13.822451+0000","last_active":"2023-11-28T20:00:30.777026+0000","last_peered":"2023-11-28T20:00:30.777026+0000","last_clean":"2023-11-28T20:00:30.777026+0000","last_became_active":"2023-11-28T20:00:13.822186+0000","last_became_peered":"2023-11-28T20:00:13.822186+0000","last_unstale":"2023-11-28T20:00:30.777026+0000","last_undegraded":"2023-11-28T20:00:30.777026+0000","last_fullsized":"2023-11-28T20:00:30.777026+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_clean_scrub_stamp":"2023-11-28T20:00:12.764355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:27:21.391017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.26","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-28T20:00:32.539298+0000","last_change":"2023-11-28T20:00:30.795376+0000","last_active":"2023-11-28T20:00:32.539298+0000","last_peered":"2023-11-28T20:00:32.539298+0000","last_clean":"2023-11-28T20:00:32.539298+0000","last_became_active":"2023-11-28T20:00:30.795116+0000","last_became_peered":"2023-11-28T20:00:30.795116+0000","last_unstale":"2023-11-28T20:00:32.539298+0000","last_undegraded":"2023-11-28T20:00:32.539298+0000","last_fullsized":"2023-11-28T20:00:32.539298+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:30.046728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:30.046728+0000","last_clean_scrub_stamp":"2023-11-28T20:00:30.046728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:22:39.781488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":15,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-28T20:00:30.767263+0000","last_change":"2023-11-28T20:00:13.821720+0000","last_active":"2023-11-28T20:00:30.767263+0000","last_peered":"2023-11-28T20:00:30.767263+0000","last_clean":"2023-11-28T20:00:30.767263+0000","last_became_active":"2023-11-28T20:00:13.820803+0000","last_became_peered":"2023-11-28T20:00:13.820803+0000","last_unstale":"2023-11-28T20:00:30.767263+0000","last_undegraded":"2023-11-28T20:00:30.767263+0000","last_fullsized":"2023-11-28T20:00:30.767263+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_clean_scrub_stamp":"2023-11-28T20:00:12.764355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:51:43.814695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.29","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-28T20:00:31.769533+0000","last_change":"2023-11-28T20:00:30.794224+0000","last_active":"2023-11-28T20:00:31.769533+0000","last_peered":"2023-11-28T20:00:31.769533+0000","last_clean":"2023-11-28T20:00:31.769533+0000","last_became_active":"2023-11-28T20:00:30.793972+0000","last_became_peered":"2023-11-28T20:00:30.793972+0000","last_unstale":"2023-11-28T20:00:31.769533+0000","last_undegraded":"2023-11-28T20:00:31.769533+0000","last_fullsized":"2023-11-28T20:00:31.769533+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:30.046728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:30.046728+0000","last_clean_scrub_stamp":"2023-11-28T20:00:30.046728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:18:35.747292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":15,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-28T20:00:30.787745+0000","last_change":"2023-11-28T20:00:13.807416+0000","last_active":"2023-11-28T20:00:30.787745+0000","last_peered":"2023-11-28T20:00:30.787745+0000","last_clean":"2023-11-28T20:00:30.787745+0000","last_became_active":"2023-11-28T20:00:13.807141+0000","last_became_peered":"2023-11-28T20:00:13.807141+0000","last_unstale":"2023-11-28T20:00:30.787745+0000","last_undegraded":"2023-11-28T20:00:30.787745+0000","last_fullsized":"2023-11-28T20:00:30.787745+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_clean_scrub_stamp":"2023-11-28T20:00:12.764355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:42:33.306843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.28","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-28T20:00:32.538894+0000","last_change":"2023-11-28T20:00:30.797382+0000","last_active":"2023-11-28T20:00:32.538894+0000","last_peered":"2023-11-28T20:00:32.538894+0000","last_clean":"2023-11-28T20:00:32.538894+0000","last_became_active":"2023-11-28T20:00:30.797115+0000","last_became_peered":"2023-11-28T20:00:30.797115+0000","last_unstale":"2023-11-28T20:00:32.538894+0000","last_undegraded":"2023-11-28T20:00:32.538894+0000","last_fullsized":"2023-11-28T20:00:32.538894+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:30.046728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:30.046728+0000","last_clean_scrub_stamp":"2023-11-28T20:00:30.046728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:14:48.882313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":15,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-28T20:00:30.778390+0000","last_change":"2023-11-28T20:00:13.812247+0000","last_active":"2023-11-28T20:00:30.778390+0000","last_peered":"2023-11-28T20:00:30.778390+0000","last_clean":"2023-11-28T20:00:30.778390+0000","last_became_active":"2023-11-28T20:00:13.812016+0000","last_became_peered":"2023-11-28T20:00:13.812016+0000","last_unstale":"2023-11-28T20:00:30.778390+0000","last_undegraded":"2023-11-28T20:00:30.778390+0000","last_fullsized":"2023-11-28T20:00:30.778390+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_clean_scrub_stamp":"2023-11-28T20:00:12.764355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:04:36.627323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2b","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-28T20:00:31.774190+0000","last_change":"2023-11-28T20:00:30.797148+0000","last_active":"2023-11-28T20:00:31.774190+0000","last_peered":"2023-11-28T20:00:31.774190+0000","last_clean":"2023-11-28T20:00:31.774190+0000","last_became_active":"2023-11-28T20:00:30.796778+0000","last_became_peered":"2023-11-28T20:00:30.796778+0000","last_unstale":"2023-11-28T20:00:31.774190+0000","last_undegraded":"2023-11-28T20:00:31.774190+0000","last_fullsized":"2023-11-28T20:00:31.774190+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:30.046728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:30.046728+0000","last_clean_scrub_stamp":"2023-11-28T20:00:30.046728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:22:12.931757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":15,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-28T20:00:30.787935+0000","last_change":"2023-11-28T20:00:13.814802+0000","last_active":"2023-11-28T20:00:30.787935+0000","last_peered":"2023-11-28T20:00:30.787935+0000","last_clean":"2023-11-28T20:00:30.787935+0000","last_became_active":"2023-11-28T20:00:13.814522+0000","last_became_peered":"2023-11-28T20:00:13.814522+0000","last_unstale":"2023-11-28T20:00:30.787935+0000","last_undegraded":"2023-11-28T20:00:30.787935+0000","last_fullsized":"2023-11-28T20:00:30.787935+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_clean_scrub_stamp":"2023-11-28T20:00:12.764355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:30:41.436973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2a","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-28T20:00:32.539925+0000","last_change":"2023-11-28T20:00:30.786537+0000","last_active":"2023-11-28T20:00:32.539925+0000","last_peered":"2023-11-28T20:00:32.539925+0000","last_clean":"2023-11-28T20:00:32.539925+0000","last_became_active":"2023-11-28T20:00:30.786248+0000","last_became_peered":"2023-11-28T20:00:30.786248+0000","last_unstale":"2023-11-28T20:00:32.539925+0000","last_undegraded":"2023-11-28T20:00:32.539925+0000","last_fullsized":"2023-11-28T20:00:32.539925+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:30.046728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:30.046728+0000","last_clean_scrub_stamp":"2023-11-28T20:00:30.046728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:04:01.726100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":15,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-28T20:00:30.773526+0000","last_change":"2023-11-28T20:00:13.801034+0000","last_active":"2023-11-28T20:00:30.773526+0000","last_peered":"2023-11-28T20:00:30.773526+0000","last_clean":"2023-11-28T20:00:30.773526+0000","last_became_active":"2023-11-28T20:00:13.798365+0000","last_became_peered":"2023-11-28T20:00:13.798365+0000","last_unstale":"2023-11-28T20:00:30.773526+0000","last_undegraded":"2023-11-28T20:00:30.773526+0000","last_fullsized":"2023-11-28T20:00:30.773526+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_clean_scrub_stamp":"2023-11-28T20:00:12.764355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:10:58.346942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.2d","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-28T20:00:32.538509+0000","last_change":"2023-11-28T20:00:30.785487+0000","last_active":"2023-11-28T20:00:32.538509+0000","last_peered":"2023-11-28T20:00:32.538509+0000","last_clean":"2023-11-28T20:00:32.538509+0000","last_became_active":"2023-11-28T20:00:30.785226+0000","last_became_peered":"2023-11-28T20:00:30.785226+0000","last_unstale":"2023-11-28T20:00:32.538509+0000","last_undegraded":"2023-11-28T20:00:32.538509+0000","last_fullsized":"2023-11-28T20:00:32.538509+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:30.046728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:30.046728+0000","last_clean_scrub_stamp":"2023-11-28T20:00:30.046728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:56:02.591808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":15,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-28T20:00:30.787501+0000","last_change":"2023-11-28T20:00:13.817271+0000","last_active":"2023-11-28T20:00:30.787501+0000","last_peered":"2023-11-28T20:00:30.787501+0000","last_clean":"2023-11-28T20:00:30.787501+0000","last_became_active":"2023-11-28T20:00:13.816910+0000","last_became_peered":"2023-11-28T20:00:13.816910+0000","last_unstale":"2023-11-28T20:00:30.787501+0000","last_undegraded":"2023-11-28T20:00:30.787501+0000","last_fullsized":"2023-11-28T20:00:30.787501+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_clean_scrub_stamp":"2023-11-28T20:00:12.764355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:31:40.964592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2c","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-28T20:00:31.775047+0000","last_change":"2023-11-28T20:00:30.790154+0000","last_active":"2023-11-28T20:00:31.775047+0000","last_peered":"2023-11-28T20:00:31.775047+0000","last_clean":"2023-11-28T20:00:31.775047+0000","last_became_active":"2023-11-28T20:00:30.789822+0000","last_became_peered":"2023-11-28T20:00:30.789822+0000","last_unstale":"2023-11-28T20:00:31.775047+0000","last_undegraded":"2023-11-28T20:00:31.775047+0000","last_fullsized":"2023-11-28T20:00:31.775047+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:30.046728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:30.046728+0000","last_clean_scrub_stamp":"2023-11-28T20:00:30.046728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:43:25.928043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":15,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-28T20:00:30.787765+0000","last_change":"2023-11-28T20:00:13.814979+0000","last_active":"2023-11-28T20:00:30.787765+0000","last_peered":"2023-11-28T20:00:30.787765+0000","last_clean":"2023-11-28T20:00:30.787765+0000","last_became_active":"2023-11-28T20:00:13.812114+0000","last_became_peered":"2023-11-28T20:00:13.812114+0000","last_unstale":"2023-11-28T20:00:30.787765+0000","last_undegraded":"2023-11-28T20:00:30.787765+0000","last_fullsized":"2023-11-28T20:00:30.787765+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_clean_scrub_stamp":"2023-11-28T20:00:12.764355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:39:05.453623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2f","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-28T20:00:32.540512+0000","last_change":"2023-11-28T20:00:30.790780+0000","last_active":"2023-11-28T20:00:32.540512+0000","last_peered":"2023-11-28T20:00:32.540512+0000","last_clean":"2023-11-28T20:00:32.540512+0000","last_became_active":"2023-11-28T20:00:30.790158+0000","last_became_peered":"2023-11-28T20:00:30.790158+0000","last_unstale":"2023-11-28T20:00:32.540512+0000","last_undegraded":"2023-11-28T20:00:32.540512+0000","last_fullsized":"2023-11-28T20:00:32.540512+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:30.046728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:30.046728+0000","last_clean_scrub_stamp":"2023-11-28T20:00:30.046728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:56:15.664033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":15,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-28T20:00:30.777099+0000","last_change":"2023-11-28T20:00:13.822997+0000","last_active":"2023-11-28T20:00:30.777099+0000","last_peered":"2023-11-28T20:00:30.777099+0000","last_clean":"2023-11-28T20:00:30.777099+0000","last_became_active":"2023-11-28T20:00:13.822640+0000","last_became_peered":"2023-11-28T20:00:13.822640+0000","last_unstale":"2023-11-28T20:00:30.777099+0000","last_undegraded":"2023-11-28T20:00:30.777099+0000","last_fullsized":"2023-11-28T20:00:30.777099+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_clean_scrub_stamp":"2023-11-28T20:00:12.764355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:49:03.707877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.2e","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-28T20:00:32.539375+0000","last_change":"2023-11-28T20:00:30.794508+0000","last_active":"2023-11-28T20:00:32.539375+0000","last_peered":"2023-11-28T20:00:32.539375+0000","last_clean":"2023-11-28T20:00:32.539375+0000","last_became_active":"2023-11-28T20:00:30.793858+0000","last_became_peered":"2023-11-28T20:00:30.793858+0000","last_unstale":"2023-11-28T20:00:32.539375+0000","last_undegraded":"2023-11-28T20:00:32.539375+0000","last_fullsized":"2023-11-28T20:00:32.539375+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:30.046728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:30.046728+0000","last_clean_scrub_stamp":"2023-11-28T20:00:30.046728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:16:19.987995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":15,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-28T20:00:30.775632+0000","last_change":"2023-11-28T20:00:13.801896+0000","last_active":"2023-11-28T20:00:30.775632+0000","last_peered":"2023-11-28T20:00:30.775632+0000","last_clean":"2023-11-28T20:00:30.775632+0000","last_became_active":"2023-11-28T20:00:13.801620+0000","last_became_peered":"2023-11-28T20:00:13.801620+0000","last_unstale":"2023-11-28T20:00:30.775632+0000","last_undegraded":"2023-11-28T20:00:30.775632+0000","last_fullsized":"2023-11-28T20:00:30.775632+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_clean_scrub_stamp":"2023-11-28T20:00:12.764355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:49:53.239354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-28T20:00:31.774383+0000","last_change":"2023-11-28T20:00:30.796407+0000","last_active":"2023-11-28T20:00:31.774383+0000","last_peered":"2023-11-28T20:00:31.774383+0000","last_clean":"2023-11-28T20:00:31.774383+0000","last_became_active":"2023-11-28T20:00:30.795972+0000","last_became_peered":"2023-11-28T20:00:30.795972+0000","last_unstale":"2023-11-28T20:00:31.774383+0000","last_undegraded":"2023-11-28T20:00:31.774383+0000","last_fullsized":"2023-11-28T20:00:31.774383+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:30.046728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:30.046728+0000","last_clean_scrub_stamp":"2023-11-28T20:00:30.046728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:25:20.227499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1d","version":"43'2","reported_seq":14,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-28T20:00:32.539299+0000","last_change":"2023-11-28T20:00:30.080799+0000","last_active":"2023-11-28T20:00:32.539299+0000","last_peered":"2023-11-28T20:00:32.539299+0000","last_clean":"2023-11-28T20:00:32.539299+0000","last_became_active":"2023-11-28T20:00:30.080271+0000","last_became_peered":"2023-11-28T20:00:30.080271+0000","last_unstale":"2023-11-28T20:00:32.539299+0000","last_undegraded":"2023-11-28T20:00:32.539299+0000","last_fullsized":"2023-11-28T20:00:32.539299+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:29.043480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:29.043480+0000","last_clean_scrub_stamp":"2023-11-28T20:00:29.043480+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T07:28:49.902804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":15,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-28T20:00:30.777770+0000","last_change":"2023-11-28T20:00:13.822133+0000","last_active":"2023-11-28T20:00:30.777770+0000","last_peered":"2023-11-28T20:00:30.777770+0000","last_clean":"2023-11-28T20:00:30.777770+0000","last_became_active":"2023-11-28T20:00:13.821824+0000","last_became_peered":"2023-11-28T20:00:13.821824+0000","last_unstale":"2023-11-28T20:00:30.777770+0000","last_undegraded":"2023-11-28T20:00:30.777770+0000","last_fullsized":"2023-11-28T20:00:30.777770+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_clean_scrub_stamp":"2023-11-28T20:00:12.764355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:32:45.544226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1f","version":"39'4","reported_seq":20,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-28T20:00:30.787993+0000","last_change":"2023-11-28T20:00:12.794933+0000","last_active":"2023-11-28T20:00:30.787993+0000","last_peered":"2023-11-28T20:00:30.787993+0000","last_clean":"2023-11-28T20:00:30.787993+0000","last_became_active":"2023-11-28T20:00:12.794598+0000","last_became_peered":"2023-11-28T20:00:12.794598+0000","last_unstale":"2023-11-28T20:00:30.787993+0000","last_undegraded":"2023-11-28T20:00:30.787993+0000","last_fullsized":"2023-11-28T20:00:30.787993+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:11.760656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:11.760656+0000","last_clean_scrub_stamp":"2023-11-28T20:00:11.760656+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:55:34.737227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-28T20:00:32.539662+0000","last_change":"2023-11-28T20:00:30.789129+0000","last_active":"2023-11-28T20:00:32.539662+0000","last_peered":"2023-11-28T20:00:32.539662+0000","last_clean":"2023-11-28T20:00:32.539662+0000","last_became_active":"2023-11-28T20:00:30.787947+0000","last_became_peered":"2023-11-28T20:00:30.787947+0000","last_unstale":"2023-11-28T20:00:32.539662+0000","last_undegraded":"2023-11-28T20:00:32.539662+0000","last_fullsized":"2023-11-28T20:00:32.539662+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:30.046728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:30.046728+0000","last_clean_scrub_stamp":"2023-11-28T20:00:30.046728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:15:50.866774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1c","version":"43'2","reported_seq":14,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-28T20:00:32.540161+0000","last_change":"2023-11-28T20:00:30.078073+0000","last_active":"2023-11-28T20:00:32.540161+0000","last_peered":"2023-11-28T20:00:32.540161+0000","last_clean":"2023-11-28T20:00:32.540161+0000","last_became_active":"2023-11-28T20:00:30.077729+0000","last_became_peered":"2023-11-28T20:00:30.077729+0000","last_unstale":"2023-11-28T20:00:32.540161+0000","last_undegraded":"2023-11-28T20:00:32.540161+0000","last_fullsized":"2023-11-28T20:00:32.540161+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:29.043480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:29.043480+0000","last_clean_scrub_stamp":"2023-11-28T20:00:29.043480+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:48:35.019537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":15,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-28T20:00:30.776358+0000","last_change":"2023-11-28T20:00:13.809500+0000","last_active":"2023-11-28T20:00:30.776358+0000","last_peered":"2023-11-28T20:00:30.776358+0000","last_clean":"2023-11-28T20:00:30.776358+0000","last_became_active":"2023-11-28T20:00:13.809149+0000","last_became_peered":"2023-11-28T20:00:13.809149+0000","last_unstale":"2023-11-28T20:00:30.776358+0000","last_undegraded":"2023-11-28T20:00:30.776358+0000","last_fullsized":"2023-11-28T20:00:30.776358+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_clean_scrub_stamp":"2023-11-28T20:00:12.764355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T07:13:21.710239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1e","version":"39'1","reported_seq":17,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-28T20:00:30.773635+0000","last_change":"2023-11-28T20:00:12.794372+0000","last_active":"2023-11-28T20:00:30.773635+0000","last_peered":"2023-11-28T20:00:30.773635+0000","last_clean":"2023-11-28T20:00:30.773635+0000","last_became_active":"2023-11-28T20:00:12.794166+0000","last_became_peered":"2023-11-28T20:00:12.794166+0000","last_unstale":"2023-11-28T20:00:30.773635+0000","last_undegraded":"2023-11-28T20:00:30.773635+0000","last_fullsized":"2023-11-28T20:00:30.773635+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:11.760656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:11.760656+0000","last_clean_scrub_stamp":"2023-11-28T20:00:11.760656+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:30:40.433274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-28T20:00:32.538801+0000","last_change":"2023-11-28T20:00:30.791273+0000","last_active":"2023-11-28T20:00:32.538801+0000","last_peered":"2023-11-28T20:00:32.538801+0000","last_clean":"2023-11-28T20:00:32.538801+0000","last_became_active":"2023-11-28T20:00:30.790585+0000","last_became_peered":"2023-11-28T20:00:30.790585+0000","last_unstale":"2023-11-28T20:00:32.538801+0000","last_undegraded":"2023-11-28T20:00:32.538801+0000","last_fullsized":"2023-11-28T20:00:32.538801+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:30.046728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:30.046728+0000","last_clean_scrub_stamp":"2023-11-28T20:00:30.046728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:46:15.348906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1f","version":"43'4","reported_seq":16,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-28T20:00:31.775220+0000","last_change":"2023-11-28T20:00:30.076849+0000","last_active":"2023-11-28T20:00:31.775220+0000","last_peered":"2023-11-28T20:00:31.775220+0000","last_clean":"2023-11-28T20:00:31.775220+0000","last_became_active":"2023-11-28T20:00:30.076510+0000","last_became_peered":"2023-11-28T20:00:30.076510+0000","last_unstale":"2023-11-28T20:00:31.775220+0000","last_undegraded":"2023-11-28T20:00:31.775220+0000","last_fullsized":"2023-11-28T20:00:31.775220+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:29.043480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:29.043480+0000","last_clean_scrub_stamp":"2023-11-28T20:00:29.043480+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:49:57.213516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":15,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-28T20:00:30.772492+0000","last_change":"2023-11-28T20:00:13.811214+0000","last_active":"2023-11-28T20:00:30.772492+0000","last_peered":"2023-11-28T20:00:30.772492+0000","last_clean":"2023-11-28T20:00:30.772492+0000","last_became_active":"2023-11-28T20:00:13.810824+0000","last_became_peered":"2023-11-28T20:00:13.810824+0000","last_unstale":"2023-11-28T20:00:30.772492+0000","last_undegraded":"2023-11-28T20:00:30.772492+0000","last_fullsized":"2023-11-28T20:00:30.772492+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_clean_scrub_stamp":"2023-11-28T20:00:12.764355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:18:18.464919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"39'2","reported_seq":18,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-28T20:00:30.776674+0000","last_change":"2023-11-28T20:00:12.797247+0000","last_active":"2023-11-28T20:00:30.776674+0000","last_peered":"2023-11-28T20:00:30.776674+0000","last_clean":"2023-11-28T20:00:30.776674+0000","last_became_active":"2023-11-28T20:00:12.797003+0000","last_became_peered":"2023-11-28T20:00:12.797003+0000","last_unstale":"2023-11-28T20:00:30.776674+0000","last_undegraded":"2023-11-28T20:00:30.776674+0000","last_fullsized":"2023-11-28T20:00:30.776674+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:11.760656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:11.760656+0000","last_clean_scrub_stamp":"2023-11-28T20:00:11.760656+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:39:04.449924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-28T20:00:32.539630+0000","last_change":"2023-11-28T20:00:30.797161+0000","last_active":"2023-11-28T20:00:32.539630+0000","last_peered":"2023-11-28T20:00:32.539630+0000","last_clean":"2023-11-28T20:00:32.539630+0000","last_became_active":"2023-11-28T20:00:30.796876+0000","last_became_peered":"2023-11-28T20:00:30.796876+0000","last_unstale":"2023-11-28T20:00:32.539630+0000","last_undegraded":"2023-11-28T20:00:32.539630+0000","last_fullsized":"2023-11-28T20:00:32.539630+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:30.046728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:30.046728+0000","last_clean_scrub_stamp":"2023-11-28T20:00:30.046728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:34:55.679879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.1e","version":"43'1","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-28T20:00:32.539574+0000","last_change":"2023-11-28T20:00:30.080305+0000","last_active":"2023-11-28T20:00:32.539574+0000","last_peered":"2023-11-28T20:00:32.539574+0000","last_clean":"2023-11-28T20:00:32.539574+0000","last_became_active":"2023-11-28T20:00:30.076149+0000","last_became_peered":"2023-11-28T20:00:30.076149+0000","last_unstale":"2023-11-28T20:00:32.539574+0000","last_undegraded":"2023-11-28T20:00:32.539574+0000","last_fullsized":"2023-11-28T20:00:32.539574+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:29.043480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:29.043480+0000","last_clean_scrub_stamp":"2023-11-28T20:00:29.043480+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:25:19.224251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":15,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-28T20:00:30.781101+0000","last_change":"2023-11-28T20:00:13.807462+0000","last_active":"2023-11-28T20:00:30.781101+0000","last_peered":"2023-11-28T20:00:30.781101+0000","last_clean":"2023-11-28T20:00:30.781101+0000","last_became_active":"2023-11-28T20:00:13.807149+0000","last_became_peered":"2023-11-28T20:00:13.807149+0000","last_unstale":"2023-11-28T20:00:30.781101+0000","last_undegraded":"2023-11-28T20:00:30.781101+0000","last_fullsized":"2023-11-28T20:00:30.781101+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_clean_scrub_stamp":"2023-11-28T20:00:12.764355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T07:28:33.623680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1c","version":"39'2","reported_seq":18,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-28T20:00:30.772604+0000","last_change":"2023-11-28T20:00:12.799178+0000","last_active":"2023-11-28T20:00:30.772604+0000","last_peered":"2023-11-28T20:00:30.772604+0000","last_clean":"2023-11-28T20:00:30.772604+0000","last_became_active":"2023-11-28T20:00:12.798834+0000","last_became_peered":"2023-11-28T20:00:12.798834+0000","last_unstale":"2023-11-28T20:00:30.772604+0000","last_undegraded":"2023-11-28T20:00:30.772604+0000","last_fullsized":"2023-11-28T20:00:30.772604+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:11.760656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:11.760656+0000","last_clean_scrub_stamp":"2023-11-28T20:00:11.760656+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:26:43.439645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-28T20:00:32.540237+0000","last_change":"2023-11-28T20:00:30.788683+0000","last_active":"2023-11-28T20:00:32.540237+0000","last_peered":"2023-11-28T20:00:32.540237+0000","last_clean":"2023-11-28T20:00:32.540237+0000","last_became_active":"2023-11-28T20:00:30.788001+0000","last_became_peered":"2023-11-28T20:00:30.788001+0000","last_unstale":"2023-11-28T20:00:32.540237+0000","last_undegraded":"2023-11-28T20:00:32.540237+0000","last_fullsized":"2023-11-28T20:00:32.540237+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:30.046728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:30.046728+0000","last_clean_scrub_stamp":"2023-11-28T20:00:30.046728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:48:57.427285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-28T20:00:31.773710+0000","last_change":"2023-11-28T20:00:30.075475+0000","last_active":"2023-11-28T20:00:31.773710+0000","last_peered":"2023-11-28T20:00:31.773710+0000","last_clean":"2023-11-28T20:00:31.773710+0000","last_became_active":"2023-11-28T20:00:30.075161+0000","last_became_peered":"2023-11-28T20:00:30.075161+0000","last_unstale":"2023-11-28T20:00:31.773710+0000","last_undegraded":"2023-11-28T20:00:31.773710+0000","last_fullsized":"2023-11-28T20:00:31.773710+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:29.043480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:29.043480+0000","last_clean_scrub_stamp":"2023-11-28T20:00:29.043480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:11:14.626066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":15,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-28T20:00:30.773036+0000","last_change":"2023-11-28T20:00:13.804415+0000","last_active":"2023-11-28T20:00:30.773036+0000","last_peered":"2023-11-28T20:00:30.773036+0000","last_clean":"2023-11-28T20:00:30.773036+0000","last_became_active":"2023-11-28T20:00:13.803965+0000","last_became_peered":"2023-11-28T20:00:13.803965+0000","last_unstale":"2023-11-28T20:00:30.773036+0000","last_undegraded":"2023-11-28T20:00:30.773036+0000","last_fullsized":"2023-11-28T20:00:30.773036+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_clean_scrub_stamp":"2023-11-28T20:00:12.764355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:31:40.964592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1b","version":"39'1","reported_seq":17,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-28T20:00:30.773156+0000","last_change":"2023-11-28T20:00:12.804157+0000","last_active":"2023-11-28T20:00:30.773156+0000","last_peered":"2023-11-28T20:00:30.773156+0000","last_clean":"2023-11-28T20:00:30.773156+0000","last_became_active":"2023-11-28T20:00:12.803950+0000","last_became_peered":"2023-11-28T20:00:12.803950+0000","last_unstale":"2023-11-28T20:00:30.773156+0000","last_undegraded":"2023-11-28T20:00:30.773156+0000","last_fullsized":"2023-11-28T20:00:30.773156+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:11.760656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:11.760656+0000","last_clean_scrub_stamp":"2023-11-28T20:00:11.760656+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T07:13:20.706540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-28T20:00:32.539604+0000","last_change":"2023-11-28T20:00:30.793136+0000","last_active":"2023-11-28T20:00:32.539604+0000","last_peered":"2023-11-28T20:00:32.539604+0000","last_clean":"2023-11-28T20:00:32.539604+0000","last_became_active":"2023-11-28T20:00:30.792829+0000","last_became_peered":"2023-11-28T20:00:30.792829+0000","last_unstale":"2023-11-28T20:00:32.539604+0000","last_undegraded":"2023-11-28T20:00:32.539604+0000","last_fullsized":"2023-11-28T20:00:32.539604+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:30.046728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:30.046728+0000","last_clean_scrub_stamp":"2023-11-28T20:00:30.046728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:25:09.519117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-28T20:00:32.538442+0000","last_change":"2023-11-28T20:00:30.081130+0000","last_active":"2023-11-28T20:00:32.538442+0000","last_peered":"2023-11-28T20:00:32.538442+0000","last_clean":"2023-11-28T20:00:32.538442+0000","last_became_active":"2023-11-28T20:00:30.080871+0000","last_became_peered":"2023-11-28T20:00:30.080871+0000","last_unstale":"2023-11-28T20:00:32.538442+0000","last_undegraded":"2023-11-28T20:00:32.538442+0000","last_fullsized":"2023-11-28T20:00:32.538442+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:29.043480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:29.043480+0000","last_clean_scrub_stamp":"2023-11-28T20:00:29.043480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:17:59.027188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":15,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-28T20:00:30.770807+0000","last_change":"2023-11-28T20:00:13.797465+0000","last_active":"2023-11-28T20:00:30.770807+0000","last_peered":"2023-11-28T20:00:30.770807+0000","last_clean":"2023-11-28T20:00:30.770807+0000","last_became_active":"2023-11-28T20:00:13.797106+0000","last_became_peered":"2023-11-28T20:00:13.797106+0000","last_unstale":"2023-11-28T20:00:30.770807+0000","last_undegraded":"2023-11-28T20:00:30.770807+0000","last_fullsized":"2023-11-28T20:00:30.770807+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_clean_scrub_stamp":"2023-11-28T20:00:12.764355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T07:56:05.039809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"39'1","reported_seq":17,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-28T20:00:30.776973+0000","last_change":"2023-11-28T20:00:12.797188+0000","last_active":"2023-11-28T20:00:30.776973+0000","last_peered":"2023-11-28T20:00:30.776973+0000","last_clean":"2023-11-28T20:00:30.776973+0000","last_became_active":"2023-11-28T20:00:12.796926+0000","last_became_peered":"2023-11-28T20:00:12.796926+0000","last_unstale":"2023-11-28T20:00:30.776973+0000","last_undegraded":"2023-11-28T20:00:30.776973+0000","last_fullsized":"2023-11-28T20:00:30.776973+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:11.760656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:11.760656+0000","last_clean_scrub_stamp":"2023-11-28T20:00:11.760656+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:38:54.348106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-28T20:00:31.774813+0000","last_change":"2023-11-28T20:00:30.789486+0000","last_active":"2023-11-28T20:00:31.774813+0000","last_peered":"2023-11-28T20:00:31.774813+0000","last_clean":"2023-11-28T20:00:31.774813+0000","last_became_active":"2023-11-28T20:00:30.789180+0000","last_became_peered":"2023-11-28T20:00:30.789180+0000","last_unstale":"2023-11-28T20:00:31.774813+0000","last_undegraded":"2023-11-28T20:00:31.774813+0000","last_fullsized":"2023-11-28T20:00:31.774813+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:30.046728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:30.046728+0000","last_clean_scrub_stamp":"2023-11-28T20:00:30.046728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:42:59.685012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"43'1","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-28T20:00:32.538263+0000","last_change":"2023-11-28T20:00:30.083747+0000","last_active":"2023-11-28T20:00:32.538263+0000","last_peered":"2023-11-28T20:00:32.538263+0000","last_clean":"2023-11-28T20:00:32.538263+0000","last_became_active":"2023-11-28T20:00:30.083432+0000","last_became_peered":"2023-11-28T20:00:30.083432+0000","last_unstale":"2023-11-28T20:00:32.538263+0000","last_undegraded":"2023-11-28T20:00:32.538263+0000","last_fullsized":"2023-11-28T20:00:32.538263+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:29.043480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:29.043480+0000","last_clean_scrub_stamp":"2023-11-28T20:00:29.043480+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:43:46.204876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":15,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-28T20:00:30.772541+0000","last_change":"2023-11-28T20:00:13.789303+0000","last_active":"2023-11-28T20:00:30.772541+0000","last_peered":"2023-11-28T20:00:30.772541+0000","last_clean":"2023-11-28T20:00:30.772541+0000","last_became_active":"2023-11-28T20:00:13.788505+0000","last_became_peered":"2023-11-28T20:00:13.788505+0000","last_unstale":"2023-11-28T20:00:30.772541+0000","last_undegraded":"2023-11-28T20:00:30.772541+0000","last_fullsized":"2023-11-28T20:00:30.772541+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_clean_scrub_stamp":"2023-11-28T20:00:12.764355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:22:33.214424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":16,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-28T20:00:30.777036+0000","last_change":"2023-11-28T20:00:12.805374+0000","last_active":"2023-11-28T20:00:30.777036+0000","last_peered":"2023-11-28T20:00:30.777036+0000","last_clean":"2023-11-28T20:00:30.777036+0000","last_became_active":"2023-11-28T20:00:12.805094+0000","last_became_peered":"2023-11-28T20:00:12.805094+0000","last_unstale":"2023-11-28T20:00:30.777036+0000","last_undegraded":"2023-11-28T20:00:30.777036+0000","last_fullsized":"2023-11-28T20:00:30.777036+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:11.760656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:11.760656+0000","last_clean_scrub_stamp":"2023-11-28T20:00:11.760656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T07:54:02.325947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-28T20:00:32.540440+0000","last_change":"2023-11-28T20:00:30.795298+0000","last_active":"2023-11-28T20:00:32.540440+0000","last_peered":"2023-11-28T20:00:32.540440+0000","last_clean":"2023-11-28T20:00:32.540440+0000","last_became_active":"2023-11-28T20:00:30.795033+0000","last_became_peered":"2023-11-28T20:00:30.795033+0000","last_unstale":"2023-11-28T20:00:32.540440+0000","last_undegraded":"2023-11-28T20:00:32.540440+0000","last_fullsized":"2023-11-28T20:00:32.540440+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:30.046728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:30.046728+0000","last_clean_scrub_stamp":"2023-11-28T20:00:30.046728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:56:08.338193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1a","version":"43'1","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-28T20:00:31.774441+0000","last_change":"2023-11-28T20:00:30.078861+0000","last_active":"2023-11-28T20:00:31.774441+0000","last_peered":"2023-11-28T20:00:31.774441+0000","last_clean":"2023-11-28T20:00:31.774441+0000","last_became_active":"2023-11-28T20:00:30.078549+0000","last_became_peered":"2023-11-28T20:00:30.078549+0000","last_unstale":"2023-11-28T20:00:31.774441+0000","last_undegraded":"2023-11-28T20:00:31.774441+0000","last_fullsized":"2023-11-28T20:00:31.774441+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:29.043480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:29.043480+0000","last_clean_scrub_stamp":"2023-11-28T20:00:29.043480+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T07:56:21.318933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":15,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-28T20:00:30.775631+0000","last_change":"2023-11-28T20:00:13.823014+0000","last_active":"2023-11-28T20:00:30.775631+0000","last_peered":"2023-11-28T20:00:30.775631+0000","last_clean":"2023-11-28T20:00:30.775631+0000","last_became_active":"2023-11-28T20:00:13.822506+0000","last_became_peered":"2023-11-28T20:00:13.822506+0000","last_unstale":"2023-11-28T20:00:30.775631+0000","last_undegraded":"2023-11-28T20:00:30.775631+0000","last_fullsized":"2023-11-28T20:00:30.775631+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_clean_scrub_stamp":"2023-11-28T20:00:12.764355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:05:44.634045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":16,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-28T20:00:30.770920+0000","last_change":"2023-11-28T20:00:12.797265+0000","last_active":"2023-11-28T20:00:30.770920+0000","last_peered":"2023-11-28T20:00:30.770920+0000","last_clean":"2023-11-28T20:00:30.770920+0000","last_became_active":"2023-11-28T20:00:12.794418+0000","last_became_peered":"2023-11-28T20:00:12.794418+0000","last_unstale":"2023-11-28T20:00:30.770920+0000","last_undegraded":"2023-11-28T20:00:30.770920+0000","last_fullsized":"2023-11-28T20:00:30.770920+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:11.760656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:11.760656+0000","last_clean_scrub_stamp":"2023-11-28T20:00:11.760656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:38:54.348106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-28T20:00:32.538943+0000","last_change":"2023-11-28T20:00:30.794519+0000","last_active":"2023-11-28T20:00:32.538943+0000","last_peered":"2023-11-28T20:00:32.538943+0000","last_clean":"2023-11-28T20:00:32.538943+0000","last_became_active":"2023-11-28T20:00:30.793219+0000","last_became_peered":"2023-11-28T20:00:30.793219+0000","last_unstale":"2023-11-28T20:00:32.538943+0000","last_undegraded":"2023-11-28T20:00:32.538943+0000","last_fullsized":"2023-11-28T20:00:32.538943+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:30.046728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:30.046728+0000","last_clean_scrub_stamp":"2023-11-28T20:00:30.046728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:13:46.025769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.15","version":"43'3","reported_seq":15,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-28T20:00:32.540227+0000","last_change":"2023-11-28T20:00:30.082422+0000","last_active":"2023-11-28T20:00:32.540227+0000","last_peered":"2023-11-28T20:00:32.540227+0000","last_clean":"2023-11-28T20:00:32.540227+0000","last_became_active":"2023-11-28T20:00:30.082176+0000","last_became_peered":"2023-11-28T20:00:30.082176+0000","last_unstale":"2023-11-28T20:00:32.540227+0000","last_undegraded":"2023-11-28T20:00:32.540227+0000","last_fullsized":"2023-11-28T20:00:32.540227+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:29.043480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:29.043480+0000","last_clean_scrub_stamp":"2023-11-28T20:00:29.043480+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:33:05.399774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":15,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-28T20:00:30.767953+0000","last_change":"2023-11-28T20:00:13.797846+0000","last_active":"2023-11-28T20:00:30.767953+0000","last_peered":"2023-11-28T20:00:30.767953+0000","last_clean":"2023-11-28T20:00:30.767953+0000","last_became_active":"2023-11-28T20:00:13.797542+0000","last_became_peered":"2023-11-28T20:00:13.797542+0000","last_unstale":"2023-11-28T20:00:30.767953+0000","last_undegraded":"2023-11-28T20:00:30.767953+0000","last_fullsized":"2023-11-28T20:00:30.767953+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_clean_scrub_stamp":"2023-11-28T20:00:12.764355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:19:34.223422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":16,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-28T20:00:30.781254+0000","last_change":"2023-11-28T20:00:12.796227+0000","last_active":"2023-11-28T20:00:30.781254+0000","last_peered":"2023-11-28T20:00:30.781254+0000","last_clean":"2023-11-28T20:00:30.781254+0000","last_became_active":"2023-11-28T20:00:12.795944+0000","last_became_peered":"2023-11-28T20:00:12.795944+0000","last_unstale":"2023-11-28T20:00:30.781254+0000","last_undegraded":"2023-11-28T20:00:30.781254+0000","last_fullsized":"2023-11-28T20:00:30.781254+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:11.760656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:11.760656+0000","last_clean_scrub_stamp":"2023-11-28T20:00:11.760656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:29:19.380485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-28T20:00:31.774645+0000","last_change":"2023-11-28T20:00:30.781609+0000","last_active":"2023-11-28T20:00:31.774645+0000","last_peered":"2023-11-28T20:00:31.774645+0000","last_clean":"2023-11-28T20:00:31.774645+0000","last_became_active":"2023-11-28T20:00:30.781300+0000","last_became_peered":"2023-11-28T20:00:30.781300+0000","last_unstale":"2023-11-28T20:00:31.774645+0000","last_undegraded":"2023-11-28T20:00:31.774645+0000","last_fullsized":"2023-11-28T20:00:31.774645+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:30.046728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:30.046728+0000","last_clean_scrub_stamp":"2023-11-28T20:00:30.046728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:59:52.481708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.14","version":"43'6","reported_seq":18,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-28T20:00:32.539482+0000","last_change":"2023-11-28T20:00:30.076515+0000","last_active":"2023-11-28T20:00:32.539482+0000","last_peered":"2023-11-28T20:00:32.539482+0000","last_clean":"2023-11-28T20:00:32.539482+0000","last_became_active":"2023-11-28T20:00:30.076249+0000","last_became_peered":"2023-11-28T20:00:30.076249+0000","last_unstale":"2023-11-28T20:00:32.539482+0000","last_undegraded":"2023-11-28T20:00:32.539482+0000","last_fullsized":"2023-11-28T20:00:32.539482+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:29.043480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:29.043480+0000","last_clean_scrub_stamp":"2023-11-28T20:00:29.043480+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:14:47.879065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":15,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-28T20:00:30.781215+0000","last_change":"2023-11-28T20:00:13.825114+0000","last_active":"2023-11-28T20:00:30.781215+0000","last_peered":"2023-11-28T20:00:30.781215+0000","last_clean":"2023-11-28T20:00:30.781215+0000","last_became_active":"2023-11-28T20:00:13.824561+0000","last_became_peered":"2023-11-28T20:00:13.824561+0000","last_unstale":"2023-11-28T20:00:30.781215+0000","last_undegraded":"2023-11-28T20:00:30.781215+0000","last_fullsized":"2023-11-28T20:00:30.781215+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_clean_scrub_stamp":"2023-11-28T20:00:12.764355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:40:01.114533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":16,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-28T20:00:30.775240+0000","last_change":"2023-11-28T20:00:12.803866+0000","last_active":"2023-11-28T20:00:30.775240+0000","last_peered":"2023-11-28T20:00:30.775240+0000","last_clean":"2023-11-28T20:00:30.775240+0000","last_became_active":"2023-11-28T20:00:12.803431+0000","last_became_peered":"2023-11-28T20:00:12.803431+0000","last_unstale":"2023-11-28T20:00:30.775240+0000","last_undegraded":"2023-11-28T20:00:30.775240+0000","last_fullsized":"2023-11-28T20:00:30.775240+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:11.760656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:11.760656+0000","last_clean_scrub_stamp":"2023-11-28T20:00:11.760656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:49:02.704178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-28T20:00:31.773822+0000","last_change":"2023-11-28T20:00:30.785060+0000","last_active":"2023-11-28T20:00:31.773822+0000","last_peered":"2023-11-28T20:00:31.773822+0000","last_clean":"2023-11-28T20:00:31.773822+0000","last_became_active":"2023-11-28T20:00:30.784872+0000","last_became_peered":"2023-11-28T20:00:30.784872+0000","last_unstale":"2023-11-28T20:00:31.773822+0000","last_undegraded":"2023-11-28T20:00:31.773822+0000","last_fullsized":"2023-11-28T20:00:31.773822+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:30.046728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:30.046728+0000","last_clean_scrub_stamp":"2023-11-28T20:00:30.046728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:06:01.916418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-28T20:00:32.539655+0000","last_change":"2023-11-28T20:00:30.081533+0000","last_active":"2023-11-28T20:00:32.539655+0000","last_peered":"2023-11-28T20:00:32.539655+0000","last_clean":"2023-11-28T20:00:32.539655+0000","last_became_active":"2023-11-28T20:00:30.081223+0000","last_became_peered":"2023-11-28T20:00:30.081223+0000","last_unstale":"2023-11-28T20:00:32.539655+0000","last_undegraded":"2023-11-28T20:00:32.539655+0000","last_fullsized":"2023-11-28T20:00:32.539655+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:29.043480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:29.043480+0000","last_clean_scrub_stamp":"2023-11-28T20:00:29.043480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:13:38.598917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":15,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-28T20:00:30.773411+0000","last_change":"2023-11-28T20:00:13.826789+0000","last_active":"2023-11-28T20:00:30.773411+0000","last_peered":"2023-11-28T20:00:30.773411+0000","last_clean":"2023-11-28T20:00:30.773411+0000","last_became_active":"2023-11-28T20:00:13.826523+0000","last_became_peered":"2023-11-28T20:00:13.826523+0000","last_unstale":"2023-11-28T20:00:30.773411+0000","last_undegraded":"2023-11-28T20:00:30.773411+0000","last_fullsized":"2023-11-28T20:00:30.773411+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_clean_scrub_stamp":"2023-11-28T20:00:12.764355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:04:36.627323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.15","version":"39'3","reported_seq":19,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-28T20:00:30.774829+0000","last_change":"2023-11-28T20:00:12.804096+0000","last_active":"2023-11-28T20:00:30.774829+0000","last_peered":"2023-11-28T20:00:30.774829+0000","last_clean":"2023-11-28T20:00:30.774829+0000","last_became_active":"2023-11-28T20:00:12.803797+0000","last_became_peered":"2023-11-28T20:00:12.803797+0000","last_unstale":"2023-11-28T20:00:30.774829+0000","last_undegraded":"2023-11-28T20:00:30.774829+0000","last_fullsized":"2023-11-28T20:00:30.774829+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:11.760656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:11.760656+0000","last_clean_scrub_stamp":"2023-11-28T20:00:11.760656+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:32:44.540527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-28T20:00:32.539483+0000","last_change":"2023-11-28T20:00:30.784327+0000","last_active":"2023-11-28T20:00:32.539483+0000","last_peered":"2023-11-28T20:00:32.539483+0000","last_clean":"2023-11-28T20:00:32.539483+0000","last_became_active":"2023-11-28T20:00:30.784034+0000","last_became_peered":"2023-11-28T20:00:30.784034+0000","last_unstale":"2023-11-28T20:00:32.539483+0000","last_undegraded":"2023-11-28T20:00:32.539483+0000","last_fullsized":"2023-11-28T20:00:32.539483+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:30.046728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:30.046728+0000","last_clean_scrub_stamp":"2023-11-28T20:00:30.046728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:56:08.338193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-28T20:00:31.775044+0000","last_change":"2023-11-28T20:00:30.085221+0000","last_active":"2023-11-28T20:00:31.775044+0000","last_peered":"2023-11-28T20:00:31.775044+0000","last_clean":"2023-11-28T20:00:31.775044+0000","last_became_active":"2023-11-28T20:00:30.084954+0000","last_became_peered":"2023-11-28T20:00:30.084954+0000","last_unstale":"2023-11-28T20:00:31.775044+0000","last_undegraded":"2023-11-28T20:00:31.775044+0000","last_fullsized":"2023-11-28T20:00:31.775044+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:29.043480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:29.043480+0000","last_clean_scrub_stamp":"2023-11-28T20:00:29.043480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:44:41.774972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":15,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-28T20:00:30.772799+0000","last_change":"2023-11-28T20:00:13.806380+0000","last_active":"2023-11-28T20:00:30.772799+0000","last_peered":"2023-11-28T20:00:30.772799+0000","last_clean":"2023-11-28T20:00:30.772799+0000","last_became_active":"2023-11-28T20:00:13.805390+0000","last_became_peered":"2023-11-28T20:00:13.805390+0000","last_unstale":"2023-11-28T20:00:30.772799+0000","last_undegraded":"2023-11-28T20:00:30.772799+0000","last_fullsized":"2023-11-28T20:00:30.772799+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_clean_scrub_stamp":"2023-11-28T20:00:12.764355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:30:41.436973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.14","version":"40'9","reported_seq":25,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-28T20:00:30.776018+0000","last_change":"2023-11-28T20:00:12.797894+0000","last_active":"2023-11-28T20:00:30.776018+0000","last_peered":"2023-11-28T20:00:30.776018+0000","last_clean":"2023-11-28T20:00:30.776018+0000","last_became_active":"2023-11-28T20:00:12.797594+0000","last_became_peered":"2023-11-28T20:00:12.797594+0000","last_unstale":"2023-11-28T20:00:30.776018+0000","last_undegraded":"2023-11-28T20:00:30.776018+0000","last_fullsized":"2023-11-28T20:00:30.776018+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:11.760656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:11.760656+0000","last_clean_scrub_stamp":"2023-11-28T20:00:11.760656+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:40:00.110834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3107,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-28T20:00:32.539445+0000","last_change":"2023-11-28T20:00:30.791864+0000","last_active":"2023-11-28T20:00:32.539445+0000","last_peered":"2023-11-28T20:00:32.539445+0000","last_clean":"2023-11-28T20:00:32.539445+0000","last_became_active":"2023-11-28T20:00:30.791567+0000","last_became_peered":"2023-11-28T20:00:30.791567+0000","last_unstale":"2023-11-28T20:00:32.539445+0000","last_undegraded":"2023-11-28T20:00:32.539445+0000","last_fullsized":"2023-11-28T20:00:32.539445+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:30.046728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:30.046728+0000","last_clean_scrub_stamp":"2023-11-28T20:00:30.046728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T07:21:05.844805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-28T20:00:32.539401+0000","last_change":"2023-11-28T20:00:30.080284+0000","last_active":"2023-11-28T20:00:32.539401+0000","last_peered":"2023-11-28T20:00:32.539401+0000","last_clean":"2023-11-28T20:00:32.539401+0000","last_became_active":"2023-11-28T20:00:30.080044+0000","last_became_peered":"2023-11-28T20:00:30.080044+0000","last_unstale":"2023-11-28T20:00:32.539401+0000","last_undegraded":"2023-11-28T20:00:32.539401+0000","last_fullsized":"2023-11-28T20:00:32.539401+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:29.043480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:29.043480+0000","last_clean_scrub_stamp":"2023-11-28T20:00:29.043480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:25:19.224251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":15,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-28T20:00:30.773052+0000","last_change":"2023-11-28T20:00:13.804236+0000","last_active":"2023-11-28T20:00:30.773052+0000","last_peered":"2023-11-28T20:00:30.773052+0000","last_clean":"2023-11-28T20:00:30.773052+0000","last_became_active":"2023-11-28T20:00:13.803605+0000","last_became_peered":"2023-11-28T20:00:13.803605+0000","last_unstale":"2023-11-28T20:00:30.773052+0000","last_undegraded":"2023-11-28T20:00:30.773052+0000","last_fullsized":"2023-11-28T20:00:30.773052+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_clean_scrub_stamp":"2023-11-28T20:00:12.764355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:18:18.464919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"39'2","reported_seq":18,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-28T20:00:30.775885+0000","last_change":"2023-11-28T20:00:12.794915+0000","last_active":"2023-11-28T20:00:30.775885+0000","last_peered":"2023-11-28T20:00:30.775885+0000","last_clean":"2023-11-28T20:00:30.775885+0000","last_became_active":"2023-11-28T20:00:12.793728+0000","last_became_peered":"2023-11-28T20:00:12.793728+0000","last_unstale":"2023-11-28T20:00:30.775885+0000","last_undegraded":"2023-11-28T20:00:30.775885+0000","last_fullsized":"2023-11-28T20:00:30.775885+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:11.760656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:11.760656+0000","last_clean_scrub_stamp":"2023-11-28T20:00:11.760656+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:18:26.871119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-28T20:00:32.540901+0000","last_change":"2023-11-28T20:00:30.790841+0000","last_active":"2023-11-28T20:00:32.540901+0000","last_peered":"2023-11-28T20:00:32.540901+0000","last_clean":"2023-11-28T20:00:32.540901+0000","last_became_active":"2023-11-28T20:00:30.790458+0000","last_became_peered":"2023-11-28T20:00:30.790458+0000","last_unstale":"2023-11-28T20:00:32.540901+0000","last_undegraded":"2023-11-28T20:00:32.540901+0000","last_fullsized":"2023-11-28T20:00:32.540901+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:30.046728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:30.046728+0000","last_clean_scrub_stamp":"2023-11-28T20:00:30.046728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:22:39.781488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.10","version":"43'8","reported_seq":20,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-28T20:00:32.539219+0000","last_change":"2023-11-28T20:00:30.068372+0000","last_active":"2023-11-28T20:00:32.539219+0000","last_peered":"2023-11-28T20:00:32.539219+0000","last_clean":"2023-11-28T20:00:32.539219+0000","last_became_active":"2023-11-28T20:00:30.068144+0000","last_became_peered":"2023-11-28T20:00:30.068144+0000","last_unstale":"2023-11-28T20:00:32.539219+0000","last_undegraded":"2023-11-28T20:00:32.539219+0000","last_fullsized":"2023-11-28T20:00:32.539219+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:29.043480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:29.043480+0000","last_clean_scrub_stamp":"2023-11-28T20:00:29.043480+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T07:01:33.458270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":15,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-28T20:00:30.775729+0000","last_change":"2023-11-28T20:00:13.804139+0000","last_active":"2023-11-28T20:00:30.775729+0000","last_peered":"2023-11-28T20:00:30.775729+0000","last_clean":"2023-11-28T20:00:30.775729+0000","last_became_active":"2023-11-28T20:00:13.803848+0000","last_became_peered":"2023-11-28T20:00:13.803848+0000","last_unstale":"2023-11-28T20:00:30.775729+0000","last_undegraded":"2023-11-28T20:00:30.775729+0000","last_fullsized":"2023-11-28T20:00:30.775729+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_clean_scrub_stamp":"2023-11-28T20:00:12.764355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:10:58.346942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":16,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-28T20:00:30.776930+0000","last_change":"2023-11-28T20:00:12.805313+0000","last_active":"2023-11-28T20:00:30.776930+0000","last_peered":"2023-11-28T20:00:30.776930+0000","last_clean":"2023-11-28T20:00:30.776930+0000","last_became_active":"2023-11-28T20:00:12.804998+0000","last_became_peered":"2023-11-28T20:00:12.804998+0000","last_unstale":"2023-11-28T20:00:30.776930+0000","last_undegraded":"2023-11-28T20:00:30.776930+0000","last_fullsized":"2023-11-28T20:00:30.776930+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:11.760656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:11.760656+0000","last_clean_scrub_stamp":"2023-11-28T20:00:11.760656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:42:32.303144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-28T20:00:32.539918+0000","last_change":"2023-11-28T20:00:30.791310+0000","last_active":"2023-11-28T20:00:32.539918+0000","last_peered":"2023-11-28T20:00:32.539918+0000","last_clean":"2023-11-28T20:00:32.539918+0000","last_became_active":"2023-11-28T20:00:30.791007+0000","last_became_peered":"2023-11-28T20:00:30.791007+0000","last_unstale":"2023-11-28T20:00:32.539918+0000","last_undegraded":"2023-11-28T20:00:32.539918+0000","last_fullsized":"2023-11-28T20:00:32.539918+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:30.046728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:30.046728+0000","last_clean_scrub_stamp":"2023-11-28T20:00:30.046728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:00:10.316375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.13","version":"43'2","reported_seq":14,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-28T20:00:32.538365+0000","last_change":"2023-11-28T20:00:30.084053+0000","last_active":"2023-11-28T20:00:32.538365+0000","last_peered":"2023-11-28T20:00:32.538365+0000","last_clean":"2023-11-28T20:00:32.538365+0000","last_became_active":"2023-11-28T20:00:30.083833+0000","last_became_peered":"2023-11-28T20:00:30.083833+0000","last_unstale":"2023-11-28T20:00:32.538365+0000","last_undegraded":"2023-11-28T20:00:32.538365+0000","last_fullsized":"2023-11-28T20:00:32.538365+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:29.043480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:29.043480+0000","last_clean_scrub_stamp":"2023-11-28T20:00:29.043480+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:06:53.405406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":15,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-28T20:00:30.776844+0000","last_change":"2023-11-28T20:00:13.822076+0000","last_active":"2023-11-28T20:00:30.776844+0000","last_peered":"2023-11-28T20:00:30.776844+0000","last_clean":"2023-11-28T20:00:30.776844+0000","last_became_active":"2023-11-28T20:00:13.821470+0000","last_became_peered":"2023-11-28T20:00:13.821470+0000","last_unstale":"2023-11-28T20:00:30.776844+0000","last_undegraded":"2023-11-28T20:00:30.776844+0000","last_fullsized":"2023-11-28T20:00:30.776844+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_clean_scrub_stamp":"2023-11-28T20:00:12.764355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T07:13:21.710239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":16,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-28T20:00:30.784904+0000","last_change":"2023-11-28T20:00:12.789146+0000","last_active":"2023-11-28T20:00:30.784904+0000","last_peered":"2023-11-28T20:00:30.784904+0000","last_clean":"2023-11-28T20:00:30.784904+0000","last_became_active":"2023-11-28T20:00:12.788447+0000","last_became_peered":"2023-11-28T20:00:12.788447+0000","last_unstale":"2023-11-28T20:00:30.784904+0000","last_undegraded":"2023-11-28T20:00:30.784904+0000","last_fullsized":"2023-11-28T20:00:30.784904+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:11.760656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:11.760656+0000","last_clean_scrub_stamp":"2023-11-28T20:00:11.760656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:09:51.354913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-28T20:00:32.538648+0000","last_change":"2023-11-28T20:00:30.785021+0000","last_active":"2023-11-28T20:00:32.538648+0000","last_peered":"2023-11-28T20:00:32.538648+0000","last_clean":"2023-11-28T20:00:32.538648+0000","last_became_active":"2023-11-28T20:00:30.784733+0000","last_became_peered":"2023-11-28T20:00:30.784733+0000","last_unstale":"2023-11-28T20:00:32.538648+0000","last_undegraded":"2023-11-28T20:00:32.538648+0000","last_fullsized":"2023-11-28T20:00:32.538648+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:30.046728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:30.046728+0000","last_clean_scrub_stamp":"2023-11-28T20:00:30.046728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:03:01.615268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-28T20:00:31.774185+0000","last_change":"2023-11-28T20:00:30.084831+0000","last_active":"2023-11-28T20:00:31.774185+0000","last_peered":"2023-11-28T20:00:31.774185+0000","last_clean":"2023-11-28T20:00:31.774185+0000","last_became_active":"2023-11-28T20:00:30.084546+0000","last_became_peered":"2023-11-28T20:00:30.084546+0000","last_unstale":"2023-11-28T20:00:31.774185+0000","last_undegraded":"2023-11-28T20:00:31.774185+0000","last_fullsized":"2023-11-28T20:00:31.774185+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:29.043480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:29.043480+0000","last_clean_scrub_stamp":"2023-11-28T20:00:29.043480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:06:00.913169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":15,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-28T20:00:30.775713+0000","last_change":"2023-11-28T20:00:13.804984+0000","last_active":"2023-11-28T20:00:30.775713+0000","last_peered":"2023-11-28T20:00:30.775713+0000","last_clean":"2023-11-28T20:00:30.775713+0000","last_became_active":"2023-11-28T20:00:13.804281+0000","last_became_peered":"2023-11-28T20:00:13.804281+0000","last_unstale":"2023-11-28T20:00:30.775713+0000","last_undegraded":"2023-11-28T20:00:30.775713+0000","last_fullsized":"2023-11-28T20:00:30.775713+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_clean_scrub_stamp":"2023-11-28T20:00:12.764355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:49:40.934392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"39'8","reported_seq":24,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-28T20:00:30.776620+0000","last_change":"2023-11-28T20:00:12.799040+0000","last_active":"2023-11-28T20:00:30.776620+0000","last_peered":"2023-11-28T20:00:30.776620+0000","last_clean":"2023-11-28T20:00:30.776620+0000","last_became_active":"2023-11-28T20:00:12.798730+0000","last_became_peered":"2023-11-28T20:00:12.798730+0000","last_unstale":"2023-11-28T20:00:30.776620+0000","last_undegraded":"2023-11-28T20:00:30.776620+0000","last_fullsized":"2023-11-28T20:00:30.776620+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:11.760656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:11.760656+0000","last_clean_scrub_stamp":"2023-11-28T20:00:11.760656+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:26:43.439645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-28T20:00:31.774345+0000","last_change":"2023-11-28T20:00:30.789664+0000","last_active":"2023-11-28T20:00:31.774345+0000","last_peered":"2023-11-28T20:00:31.774345+0000","last_clean":"2023-11-28T20:00:31.774345+0000","last_became_active":"2023-11-28T20:00:30.789300+0000","last_became_peered":"2023-11-28T20:00:30.789300+0000","last_unstale":"2023-11-28T20:00:31.774345+0000","last_undegraded":"2023-11-28T20:00:31.774345+0000","last_fullsized":"2023-11-28T20:00:31.774345+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:30.046728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:30.046728+0000","last_clean_scrub_stamp":"2023-11-28T20:00:30.046728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:11:14.457229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.d","version":"43'1","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-28T20:00:31.774702+0000","last_change":"2023-11-28T20:00:30.077369+0000","last_active":"2023-11-28T20:00:31.774702+0000","last_peered":"2023-11-28T20:00:31.774702+0000","last_clean":"2023-11-28T20:00:31.774702+0000","last_became_active":"2023-11-28T20:00:30.077023+0000","last_became_peered":"2023-11-28T20:00:30.077023+0000","last_unstale":"2023-11-28T20:00:31.774702+0000","last_undegraded":"2023-11-28T20:00:31.774702+0000","last_fullsized":"2023-11-28T20:00:31.774702+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:29.043480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:29.043480+0000","last_clean_scrub_stamp":"2023-11-28T20:00:29.043480+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:59:51.478460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":15,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-28T20:00:30.775856+0000","last_change":"2023-11-28T20:00:13.812428+0000","last_active":"2023-11-28T20:00:30.775856+0000","last_peered":"2023-11-28T20:00:30.775856+0000","last_clean":"2023-11-28T20:00:30.775856+0000","last_became_active":"2023-11-28T20:00:13.812074+0000","last_became_peered":"2023-11-28T20:00:13.812074+0000","last_unstale":"2023-11-28T20:00:30.775856+0000","last_undegraded":"2023-11-28T20:00:30.775856+0000","last_fullsized":"2023-11-28T20:00:30.775856+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_clean_scrub_stamp":"2023-11-28T20:00:12.764355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:21:55.649385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"39'1","reported_seq":17,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-28T20:00:30.775379+0000","last_change":"2023-11-28T20:00:12.803142+0000","last_active":"2023-11-28T20:00:30.775379+0000","last_peered":"2023-11-28T20:00:30.775379+0000","last_clean":"2023-11-28T20:00:30.775379+0000","last_became_active":"2023-11-28T20:00:12.802775+0000","last_became_peered":"2023-11-28T20:00:12.802775+0000","last_unstale":"2023-11-28T20:00:30.775379+0000","last_undegraded":"2023-11-28T20:00:30.775379+0000","last_fullsized":"2023-11-28T20:00:30.775379+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:11.760656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:11.760656+0000","last_clean_scrub_stamp":"2023-11-28T20:00:11.760656+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:18:26.871119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-28T20:00:32.539219+0000","last_change":"2023-11-28T20:00:30.788314+0000","last_active":"2023-11-28T20:00:32.539219+0000","last_peered":"2023-11-28T20:00:32.539219+0000","last_clean":"2023-11-28T20:00:32.539219+0000","last_became_active":"2023-11-28T20:00:30.788071+0000","last_became_peered":"2023-11-28T20:00:30.788071+0000","last_unstale":"2023-11-28T20:00:32.539219+0000","last_undegraded":"2023-11-28T20:00:32.539219+0000","last_fullsized":"2023-11-28T20:00:32.539219+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:30.046728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:30.046728+0000","last_clean_scrub_stamp":"2023-11-28T20:00:30.046728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:46:15.348906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-28T20:00:31.774972+0000","last_change":"2023-11-28T20:00:30.077814+0000","last_active":"2023-11-28T20:00:31.774972+0000","last_peered":"2023-11-28T20:00:31.774972+0000","last_clean":"2023-11-28T20:00:31.774972+0000","last_became_active":"2023-11-28T20:00:30.077381+0000","last_became_peered":"2023-11-28T20:00:30.077381+0000","last_unstale":"2023-11-28T20:00:31.774972+0000","last_undegraded":"2023-11-28T20:00:31.774972+0000","last_fullsized":"2023-11-28T20:00:31.774972+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:29.043480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:29.043480+0000","last_clean_scrub_stamp":"2023-11-28T20:00:29.043480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:11:13.453981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":15,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-28T20:00:30.774742+0000","last_change":"2023-11-28T20:00:13.815547+0000","last_active":"2023-11-28T20:00:30.774742+0000","last_peered":"2023-11-28T20:00:30.774742+0000","last_clean":"2023-11-28T20:00:30.774742+0000","last_became_active":"2023-11-28T20:00:13.813153+0000","last_became_peered":"2023-11-28T20:00:13.813153+0000","last_unstale":"2023-11-28T20:00:30.774742+0000","last_undegraded":"2023-11-28T20:00:30.774742+0000","last_fullsized":"2023-11-28T20:00:30.774742+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_clean_scrub_stamp":"2023-11-28T20:00:12.764355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:05:44.634045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.e","version":"39'2","reported_seq":18,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-28T20:00:30.772582+0000","last_change":"2023-11-28T20:00:12.806331+0000","last_active":"2023-11-28T20:00:30.772582+0000","last_peered":"2023-11-28T20:00:30.772582+0000","last_clean":"2023-11-28T20:00:30.772582+0000","last_became_active":"2023-11-28T20:00:12.805857+0000","last_became_peered":"2023-11-28T20:00:12.805857+0000","last_unstale":"2023-11-28T20:00:30.772582+0000","last_undegraded":"2023-11-28T20:00:30.772582+0000","last_fullsized":"2023-11-28T20:00:30.772582+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:11.760656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:11.760656+0000","last_clean_scrub_stamp":"2023-11-28T20:00:11.760656+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T07:54:02.325947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-28T20:00:32.539068+0000","last_change":"2023-11-28T20:00:30.781213+0000","last_active":"2023-11-28T20:00:32.539068+0000","last_peered":"2023-11-28T20:00:32.539068+0000","last_clean":"2023-11-28T20:00:32.539068+0000","last_became_active":"2023-11-28T20:00:30.780900+0000","last_became_peered":"2023-11-28T20:00:30.780900+0000","last_unstale":"2023-11-28T20:00:32.539068+0000","last_undegraded":"2023-11-28T20:00:32.539068+0000","last_fullsized":"2023-11-28T20:00:32.539068+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:30.046728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:30.046728+0000","last_clean_scrub_stamp":"2023-11-28T20:00:30.046728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:56:15.664033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.f","version":"43'1","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-28T20:00:32.540713+0000","last_change":"2023-11-28T20:00:30.082748+0000","last_active":"2023-11-28T20:00:32.540713+0000","last_peered":"2023-11-28T20:00:32.540713+0000","last_clean":"2023-11-28T20:00:32.540713+0000","last_became_active":"2023-11-28T20:00:30.082416+0000","last_became_peered":"2023-11-28T20:00:30.082416+0000","last_unstale":"2023-11-28T20:00:32.540713+0000","last_undegraded":"2023-11-28T20:00:32.540713+0000","last_fullsized":"2023-11-28T20:00:32.540713+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:29.043480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:29.043480+0000","last_clean_scrub_stamp":"2023-11-28T20:00:29.043480+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:25:08.515869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":15,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-28T20:00:30.772403+0000","last_change":"2023-11-28T20:00:13.797337+0000","last_active":"2023-11-28T20:00:30.772403+0000","last_peered":"2023-11-28T20:00:30.772403+0000","last_clean":"2023-11-28T20:00:30.772403+0000","last_became_active":"2023-11-28T20:00:13.797027+0000","last_became_peered":"2023-11-28T20:00:13.797027+0000","last_unstale":"2023-11-28T20:00:30.772403+0000","last_undegraded":"2023-11-28T20:00:30.772403+0000","last_fullsized":"2023-11-28T20:00:30.772403+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_clean_scrub_stamp":"2023-11-28T20:00:12.764355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:31:40.964592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"39'1","reported_seq":17,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-28T20:00:30.768113+0000","last_change":"2023-11-28T20:00:12.796923+0000","last_active":"2023-11-28T20:00:30.768113+0000","last_peered":"2023-11-28T20:00:30.768113+0000","last_clean":"2023-11-28T20:00:30.768113+0000","last_became_active":"2023-11-28T20:00:12.796625+0000","last_became_peered":"2023-11-28T20:00:12.796625+0000","last_unstale":"2023-11-28T20:00:30.768113+0000","last_undegraded":"2023-11-28T20:00:30.768113+0000","last_fullsized":"2023-11-28T20:00:30.768113+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:11.760656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:11.760656+0000","last_clean_scrub_stamp":"2023-11-28T20:00:11.760656+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:07:27.330964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-28T20:00:32.538082+0000","last_change":"2023-11-28T20:00:30.791859+0000","last_active":"2023-11-28T20:00:32.538082+0000","last_peered":"2023-11-28T20:00:32.538082+0000","last_clean":"2023-11-28T20:00:32.538082+0000","last_became_active":"2023-11-28T20:00:30.791601+0000","last_became_peered":"2023-11-28T20:00:30.791601+0000","last_unstale":"2023-11-28T20:00:32.538082+0000","last_undegraded":"2023-11-28T20:00:32.538082+0000","last_fullsized":"2023-11-28T20:00:32.538082+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:30.046728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:30.046728+0000","last_clean_scrub_stamp":"2023-11-28T20:00:30.046728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:18:00.030437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.e","version":"43'2","reported_seq":14,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-28T20:00:31.770187+0000","last_change":"2023-11-28T20:00:30.076071+0000","last_active":"2023-11-28T20:00:31.770187+0000","last_peered":"2023-11-28T20:00:31.770187+0000","last_clean":"2023-11-28T20:00:31.770187+0000","last_became_active":"2023-11-28T20:00:30.075686+0000","last_became_peered":"2023-11-28T20:00:30.075686+0000","last_unstale":"2023-11-28T20:00:31.770187+0000","last_undegraded":"2023-11-28T20:00:31.770187+0000","last_fullsized":"2023-11-28T20:00:31.770187+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:29.043480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:29.043480+0000","last_clean_scrub_stamp":"2023-11-28T20:00:29.043480+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:30:57.716097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":15,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-28T20:00:30.767824+0000","last_change":"2023-11-28T20:00:13.800009+0000","last_active":"2023-11-28T20:00:30.767824+0000","last_peered":"2023-11-28T20:00:30.767824+0000","last_clean":"2023-11-28T20:00:30.767824+0000","last_became_active":"2023-11-28T20:00:13.799753+0000","last_became_peered":"2023-11-28T20:00:13.799753+0000","last_unstale":"2023-11-28T20:00:30.767824+0000","last_undegraded":"2023-11-28T20:00:30.767824+0000","last_fullsized":"2023-11-28T20:00:30.767824+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_clean_scrub_stamp":"2023-11-28T20:00:12.764355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:21:44.950264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":16,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-28T20:00:30.776240+0000","last_change":"2023-11-28T20:00:12.796705+0000","last_active":"2023-11-28T20:00:30.776240+0000","last_peered":"2023-11-28T20:00:30.776240+0000","last_clean":"2023-11-28T20:00:30.776240+0000","last_became_active":"2023-11-28T20:00:12.796394+0000","last_became_peered":"2023-11-28T20:00:12.796394+0000","last_unstale":"2023-11-28T20:00:30.776240+0000","last_undegraded":"2023-11-28T20:00:30.776240+0000","last_fullsized":"2023-11-28T20:00:30.776240+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:11.760656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:11.760656+0000","last_clean_scrub_stamp":"2023-11-28T20:00:11.760656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:31:39.960893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-28T20:00:32.540311+0000","last_change":"2023-11-28T20:00:30.795208+0000","last_active":"2023-11-28T20:00:32.540311+0000","last_peered":"2023-11-28T20:00:32.540311+0000","last_clean":"2023-11-28T20:00:32.540311+0000","last_became_active":"2023-11-28T20:00:30.794685+0000","last_became_peered":"2023-11-28T20:00:30.794685+0000","last_unstale":"2023-11-28T20:00:32.540311+0000","last_undegraded":"2023-11-28T20:00:32.540311+0000","last_fullsized":"2023-11-28T20:00:32.540311+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:30.046728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:30.046728+0000","last_clean_scrub_stamp":"2023-11-28T20:00:30.046728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:00:56.896478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-28T20:00:32.538323+0000","last_change":"2023-11-28T20:00:30.083965+0000","last_active":"2023-11-28T20:00:32.538323+0000","last_peered":"2023-11-28T20:00:32.538323+0000","last_clean":"2023-11-28T20:00:32.538323+0000","last_became_active":"2023-11-28T20:00:30.083560+0000","last_became_peered":"2023-11-28T20:00:30.083560+0000","last_unstale":"2023-11-28T20:00:32.538323+0000","last_undegraded":"2023-11-28T20:00:32.538323+0000","last_fullsized":"2023-11-28T20:00:32.538323+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:29.043480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:29.043480+0000","last_clean_scrub_stamp":"2023-11-28T20:00:29.043480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:22:11.928509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":15,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-28T20:00:30.776671+0000","last_change":"2023-11-28T20:00:13.822221+0000","last_active":"2023-11-28T20:00:30.776671+0000","last_peered":"2023-11-28T20:00:30.776671+0000","last_clean":"2023-11-28T20:00:30.776671+0000","last_became_active":"2023-11-28T20:00:13.821752+0000","last_became_peered":"2023-11-28T20:00:13.821752+0000","last_unstale":"2023-11-28T20:00:30.776671+0000","last_undegraded":"2023-11-28T20:00:30.776671+0000","last_fullsized":"2023-11-28T20:00:30.776671+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_clean_scrub_stamp":"2023-11-28T20:00:12.764355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:02:33.438235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"39'2","reported_seq":18,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-28T20:00:30.767510+0000","last_change":"2023-11-28T20:00:12.787168+0000","last_active":"2023-11-28T20:00:30.767510+0000","last_peered":"2023-11-28T20:00:30.767510+0000","last_clean":"2023-11-28T20:00:30.767510+0000","last_became_active":"2023-11-28T20:00:12.786815+0000","last_became_peered":"2023-11-28T20:00:12.786815+0000","last_unstale":"2023-11-28T20:00:30.767510+0000","last_undegraded":"2023-11-28T20:00:30.767510+0000","last_fullsized":"2023-11-28T20:00:30.767510+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:11.760656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:11.760656+0000","last_clean_scrub_stamp":"2023-11-28T20:00:11.760656+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:29:35.927577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-28T20:00:32.538785+0000","last_change":"2023-11-28T20:00:30.791018+0000","last_active":"2023-11-28T20:00:32.538785+0000","last_peered":"2023-11-28T20:00:32.538785+0000","last_clean":"2023-11-28T20:00:32.538785+0000","last_became_active":"2023-11-28T20:00:30.790772+0000","last_became_peered":"2023-11-28T20:00:30.790772+0000","last_unstale":"2023-11-28T20:00:32.538785+0000","last_undegraded":"2023-11-28T20:00:32.538785+0000","last_fullsized":"2023-11-28T20:00:32.538785+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:30.046728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:30.046728+0000","last_clean_scrub_stamp":"2023-11-28T20:00:30.046728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:18:03.465133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-28T20:00:31.769317+0000","last_change":"2023-11-28T20:00:30.072915+0000","last_active":"2023-11-28T20:00:31.769317+0000","last_peered":"2023-11-28T20:00:31.769317+0000","last_clean":"2023-11-28T20:00:31.769317+0000","last_became_active":"2023-11-28T20:00:30.072672+0000","last_became_peered":"2023-11-28T20:00:30.072672+0000","last_unstale":"2023-11-28T20:00:31.769317+0000","last_undegraded":"2023-11-28T20:00:31.769317+0000","last_fullsized":"2023-11-28T20:00:31.769317+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:29.043480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:29.043480+0000","last_clean_scrub_stamp":"2023-11-28T20:00:29.043480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:22:49.493549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":15,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-28T20:00:30.772639+0000","last_change":"2023-11-28T20:00:13.821223+0000","last_active":"2023-11-28T20:00:30.772639+0000","last_peered":"2023-11-28T20:00:30.772639+0000","last_clean":"2023-11-28T20:00:30.772639+0000","last_became_active":"2023-11-28T20:00:13.820855+0000","last_became_peered":"2023-11-28T20:00:13.820855+0000","last_unstale":"2023-11-28T20:00:30.772639+0000","last_undegraded":"2023-11-28T20:00:30.772639+0000","last_fullsized":"2023-11-28T20:00:30.772639+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_clean_scrub_stamp":"2023-11-28T20:00:12.764355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T07:13:21.710239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":16,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-28T20:00:30.767306+0000","last_change":"2023-11-28T20:00:12.789615+0000","last_active":"2023-11-28T20:00:30.767306+0000","last_peered":"2023-11-28T20:00:30.767306+0000","last_clean":"2023-11-28T20:00:30.767306+0000","last_became_active":"2023-11-28T20:00:12.789357+0000","last_became_peered":"2023-11-28T20:00:12.789357+0000","last_unstale":"2023-11-28T20:00:30.767306+0000","last_undegraded":"2023-11-28T20:00:30.767306+0000","last_fullsized":"2023-11-28T20:00:30.767306+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:11.760656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:11.760656+0000","last_clean_scrub_stamp":"2023-11-28T20:00:11.760656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:49:23.488653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-28T20:00:32.540059+0000","last_change":"2023-11-28T20:00:30.782694+0000","last_active":"2023-11-28T20:00:32.540059+0000","last_peered":"2023-11-28T20:00:32.540059+0000","last_clean":"2023-11-28T20:00:32.540059+0000","last_became_active":"2023-11-28T20:00:30.782371+0000","last_became_peered":"2023-11-28T20:00:30.782371+0000","last_unstale":"2023-11-28T20:00:32.540059+0000","last_undegraded":"2023-11-28T20:00:32.540059+0000","last_fullsized":"2023-11-28T20:00:32.540059+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:30.046728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:30.046728+0000","last_clean_scrub_stamp":"2023-11-28T20:00:30.046728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:18:48.883776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"43'2","reported_seq":14,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-28T20:00:32.539106+0000","last_change":"2023-11-28T20:00:30.070977+0000","last_active":"2023-11-28T20:00:32.539106+0000","last_peered":"2023-11-28T20:00:32.539106+0000","last_clean":"2023-11-28T20:00:32.539106+0000","last_became_active":"2023-11-28T20:00:30.070713+0000","last_became_peered":"2023-11-28T20:00:30.070713+0000","last_unstale":"2023-11-28T20:00:32.539106+0000","last_undegraded":"2023-11-28T20:00:32.539106+0000","last_fullsized":"2023-11-28T20:00:32.539106+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:29.043480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:29.043480+0000","last_clean_scrub_stamp":"2023-11-28T20:00:29.043480+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:11:13.453981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":15,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-28T20:00:30.770883+0000","last_change":"2023-11-28T20:00:13.809401+0000","last_active":"2023-11-28T20:00:30.770883+0000","last_peered":"2023-11-28T20:00:30.770883+0000","last_clean":"2023-11-28T20:00:30.770883+0000","last_became_active":"2023-11-28T20:00:13.808829+0000","last_became_peered":"2023-11-28T20:00:13.808829+0000","last_unstale":"2023-11-28T20:00:30.770883+0000","last_undegraded":"2023-11-28T20:00:30.770883+0000","last_fullsized":"2023-11-28T20:00:30.770883+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_clean_scrub_stamp":"2023-11-28T20:00:12.764355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:09:58.925137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":16,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-28T20:00:30.777155+0000","last_change":"2023-11-28T20:00:12.794799+0000","last_active":"2023-11-28T20:00:30.777155+0000","last_peered":"2023-11-28T20:00:30.777155+0000","last_clean":"2023-11-28T20:00:30.777155+0000","last_became_active":"2023-11-28T20:00:12.794535+0000","last_became_peered":"2023-11-28T20:00:12.794535+0000","last_unstale":"2023-11-28T20:00:30.777155+0000","last_undegraded":"2023-11-28T20:00:30.777155+0000","last_fullsized":"2023-11-28T20:00:30.777155+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:11.760656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:11.760656+0000","last_clean_scrub_stamp":"2023-11-28T20:00:11.760656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:42:32.303144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-28T20:00:31.774545+0000","last_change":"2023-11-28T20:00:30.792507+0000","last_active":"2023-11-28T20:00:31.774545+0000","last_peered":"2023-11-28T20:00:31.774545+0000","last_clean":"2023-11-28T20:00:31.774545+0000","last_became_active":"2023-11-28T20:00:30.792236+0000","last_became_peered":"2023-11-28T20:00:30.792236+0000","last_unstale":"2023-11-28T20:00:31.774545+0000","last_undegraded":"2023-11-28T20:00:31.774545+0000","last_fullsized":"2023-11-28T20:00:31.774545+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:30.046728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:30.046728+0000","last_clean_scrub_stamp":"2023-11-28T20:00:30.046728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:59:19.578650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-28T20:00:32.539651+0000","last_change":"2023-11-28T20:00:30.079032+0000","last_active":"2023-11-28T20:00:32.539651+0000","last_peered":"2023-11-28T20:00:32.539651+0000","last_clean":"2023-11-28T20:00:32.539651+0000","last_became_active":"2023-11-28T20:00:30.078730+0000","last_became_peered":"2023-11-28T20:00:30.078730+0000","last_unstale":"2023-11-28T20:00:32.539651+0000","last_undegraded":"2023-11-28T20:00:32.539651+0000","last_fullsized":"2023-11-28T20:00:32.539651+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:29.043480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:29.043480+0000","last_clean_scrub_stamp":"2023-11-28T20:00:29.043480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:13:45.022521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":15,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-28T20:00:30.775800+0000","last_change":"2023-11-28T20:00:13.821627+0000","last_active":"2023-11-28T20:00:30.775800+0000","last_peered":"2023-11-28T20:00:30.775800+0000","last_clean":"2023-11-28T20:00:30.775800+0000","last_became_active":"2023-11-28T20:00:13.821359+0000","last_became_peered":"2023-11-28T20:00:13.821359+0000","last_unstale":"2023-11-28T20:00:30.775800+0000","last_undegraded":"2023-11-28T20:00:30.775800+0000","last_fullsized":"2023-11-28T20:00:30.775800+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_clean_scrub_stamp":"2023-11-28T20:00:12.764355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:42:42.402639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":16,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-28T20:00:30.767269+0000","last_change":"2023-11-28T20:00:12.787505+0000","last_active":"2023-11-28T20:00:30.767269+0000","last_peered":"2023-11-28T20:00:30.767269+0000","last_clean":"2023-11-28T20:00:30.767269+0000","last_became_active":"2023-11-28T20:00:12.786509+0000","last_became_peered":"2023-11-28T20:00:12.786509+0000","last_unstale":"2023-11-28T20:00:30.767269+0000","last_undegraded":"2023-11-28T20:00:30.767269+0000","last_fullsized":"2023-11-28T20:00:30.767269+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:11.760656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:11.760656+0000","last_clean_scrub_stamp":"2023-11-28T20:00:11.760656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:05:35.913865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-28T20:00:32.538192+0000","last_change":"2023-11-28T20:00:30.798053+0000","last_active":"2023-11-28T20:00:32.538192+0000","last_peered":"2023-11-28T20:00:32.538192+0000","last_clean":"2023-11-28T20:00:32.538192+0000","last_became_active":"2023-11-28T20:00:30.797454+0000","last_became_peered":"2023-11-28T20:00:30.797454+0000","last_unstale":"2023-11-28T20:00:32.538192+0000","last_undegraded":"2023-11-28T20:00:32.538192+0000","last_fullsized":"2023-11-28T20:00:32.538192+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:30.046728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:30.046728+0000","last_clean_scrub_stamp":"2023-11-28T20:00:30.046728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:13:39.602165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-28T20:00:32.540232+0000","last_change":"2023-11-28T20:00:30.081655+0000","last_active":"2023-11-28T20:00:32.540232+0000","last_peered":"2023-11-28T20:00:32.540232+0000","last_clean":"2023-11-28T20:00:32.540232+0000","last_became_active":"2023-11-28T20:00:30.081162+0000","last_became_peered":"2023-11-28T20:00:30.081162+0000","last_unstale":"2023-11-28T20:00:32.540232+0000","last_undegraded":"2023-11-28T20:00:32.540232+0000","last_fullsized":"2023-11-28T20:00:32.540232+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:29.043480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:29.043480+0000","last_clean_scrub_stamp":"2023-11-28T20:00:29.043480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:16:37.578195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":15,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-28T20:00:30.776153+0000","last_change":"2023-11-28T20:00:13.802160+0000","last_active":"2023-11-28T20:00:30.776153+0000","last_peered":"2023-11-28T20:00:30.776153+0000","last_clean":"2023-11-28T20:00:30.776153+0000","last_became_active":"2023-11-28T20:00:13.801877+0000","last_became_peered":"2023-11-28T20:00:13.801877+0000","last_unstale":"2023-11-28T20:00:30.776153+0000","last_undegraded":"2023-11-28T20:00:30.776153+0000","last_fullsized":"2023-11-28T20:00:30.776153+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_clean_scrub_stamp":"2023-11-28T20:00:12.764355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T06:58:51.315382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"39'2","reported_seq":18,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-28T20:00:30.775521+0000","last_change":"2023-11-28T20:00:12.804126+0000","last_active":"2023-11-28T20:00:30.775521+0000","last_peered":"2023-11-28T20:00:30.775521+0000","last_clean":"2023-11-28T20:00:30.775521+0000","last_became_active":"2023-11-28T20:00:12.803815+0000","last_became_peered":"2023-11-28T20:00:12.803815+0000","last_unstale":"2023-11-28T20:00:30.775521+0000","last_undegraded":"2023-11-28T20:00:30.775521+0000","last_fullsized":"2023-11-28T20:00:30.775521+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:11.760656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:11.760656+0000","last_clean_scrub_stamp":"2023-11-28T20:00:11.760656+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T06:11:16.755424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-28T20:00:32.539231+0000","last_change":"2023-11-28T20:00:30.784644+0000","last_active":"2023-11-28T20:00:32.539231+0000","last_peered":"2023-11-28T20:00:32.539231+0000","last_clean":"2023-11-28T20:00:32.539231+0000","last_became_active":"2023-11-28T20:00:30.784360+0000","last_became_peered":"2023-11-28T20:00:30.784360+0000","last_unstale":"2023-11-28T20:00:32.539231+0000","last_undegraded":"2023-11-28T20:00:32.539231+0000","last_fullsized":"2023-11-28T20:00:32.539231+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:30.046728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:30.046728+0000","last_clean_scrub_stamp":"2023-11-28T20:00:30.046728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:32:37.911634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-28T20:00:32.538502+0000","last_change":"2023-11-28T20:00:30.085527+0000","last_active":"2023-11-28T20:00:32.538502+0000","last_peered":"2023-11-28T20:00:32.538502+0000","last_clean":"2023-11-28T20:00:32.538502+0000","last_became_active":"2023-11-28T20:00:30.085294+0000","last_became_peered":"2023-11-28T20:00:30.085294+0000","last_unstale":"2023-11-28T20:00:32.538502+0000","last_undegraded":"2023-11-28T20:00:32.538502+0000","last_fullsized":"2023-11-28T20:00:32.538502+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:29.043480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:29.043480+0000","last_clean_scrub_stamp":"2023-11-28T20:00:29.043480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:25:19.224251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":15,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-28T20:00:30.781313+0000","last_change":"2023-11-28T20:00:13.825316+0000","last_active":"2023-11-28T20:00:30.781313+0000","last_peered":"2023-11-28T20:00:30.781313+0000","last_clean":"2023-11-28T20:00:30.781313+0000","last_became_active":"2023-11-28T20:00:13.824862+0000","last_became_peered":"2023-11-28T20:00:13.824862+0000","last_unstale":"2023-11-28T20:00:30.781313+0000","last_undegraded":"2023-11-28T20:00:30.781313+0000","last_fullsized":"2023-11-28T20:00:30.781313+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_clean_scrub_stamp":"2023-11-28T20:00:12.764355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T06:11:17.759123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.6","version":"40'1","reported_seq":17,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-28T20:00:30.767760+0000","last_change":"2023-11-28T20:00:12.804114+0000","last_active":"2023-11-28T20:00:30.767760+0000","last_peered":"2023-11-28T20:00:30.767760+0000","last_clean":"2023-11-28T20:00:30.767760+0000","last_became_active":"2023-11-28T20:00:12.803528+0000","last_became_peered":"2023-11-28T20:00:12.803528+0000","last_unstale":"2023-11-28T20:00:30.767760+0000","last_undegraded":"2023-11-28T20:00:30.767760+0000","last_fullsized":"2023-11-28T20:00:30.767760+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:11.760656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:11.760656+0000","last_clean_scrub_stamp":"2023-11-28T20:00:11.760656+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:08:56.081544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-28T20:00:32.539423+0000","last_change":"2023-11-28T20:00:30.784336+0000","last_active":"2023-11-28T20:00:32.539423+0000","last_peered":"2023-11-28T20:00:32.539423+0000","last_clean":"2023-11-28T20:00:32.539423+0000","last_became_active":"2023-11-28T20:00:30.783618+0000","last_became_peered":"2023-11-28T20:00:30.783618+0000","last_unstale":"2023-11-28T20:00:32.539423+0000","last_undegraded":"2023-11-28T20:00:32.539423+0000","last_fullsized":"2023-11-28T20:00:32.539423+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:30.046728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:30.046728+0000","last_clean_scrub_stamp":"2023-11-28T20:00:30.046728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:59:41.017533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.7","version":"43'2","reported_seq":14,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-28T20:00:31.775400+0000","last_change":"2023-11-28T20:00:30.084977+0000","last_active":"2023-11-28T20:00:31.775400+0000","last_peered":"2023-11-28T20:00:31.775400+0000","last_clean":"2023-11-28T20:00:31.775400+0000","last_became_active":"2023-11-28T20:00:30.084704+0000","last_became_peered":"2023-11-28T20:00:30.084704+0000","last_unstale":"2023-11-28T20:00:31.775400+0000","last_undegraded":"2023-11-28T20:00:31.775400+0000","last_fullsized":"2023-11-28T20:00:31.775400+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:29.043480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:29.043480+0000","last_clean_scrub_stamp":"2023-11-28T20:00:29.043480+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:42:58.681764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":15,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-28T20:00:30.776271+0000","last_change":"2023-11-28T20:00:13.789592+0000","last_active":"2023-11-28T20:00:30.776271+0000","last_peered":"2023-11-28T20:00:30.776271+0000","last_clean":"2023-11-28T20:00:30.776271+0000","last_became_active":"2023-11-28T20:00:13.789304+0000","last_became_peered":"2023-11-28T20:00:13.789304+0000","last_unstale":"2023-11-28T20:00:30.776271+0000","last_undegraded":"2023-11-28T20:00:30.776271+0000","last_fullsized":"2023-11-28T20:00:30.776271+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_clean_scrub_stamp":"2023-11-28T20:00:12.764355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:59:35.199336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":16,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-28T20:00:30.774053+0000","last_change":"2023-11-28T20:00:12.795099+0000","last_active":"2023-11-28T20:00:30.774053+0000","last_peered":"2023-11-28T20:00:30.774053+0000","last_clean":"2023-11-28T20:00:30.774053+0000","last_became_active":"2023-11-28T20:00:12.794522+0000","last_became_peered":"2023-11-28T20:00:12.794522+0000","last_unstale":"2023-11-28T20:00:30.774053+0000","last_undegraded":"2023-11-28T20:00:30.774053+0000","last_fullsized":"2023-11-28T20:00:30.774053+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:11.760656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:11.760656+0000","last_clean_scrub_stamp":"2023-11-28T20:00:11.760656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:42:32.303144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-28T20:00:32.538374+0000","last_change":"2023-11-28T20:00:30.797617+0000","last_active":"2023-11-28T20:00:32.538374+0000","last_peered":"2023-11-28T20:00:32.538374+0000","last_clean":"2023-11-28T20:00:32.538374+0000","last_became_active":"2023-11-28T20:00:30.797343+0000","last_became_peered":"2023-11-28T20:00:30.797343+0000","last_unstale":"2023-11-28T20:00:32.538374+0000","last_undegraded":"2023-11-28T20:00:32.538374+0000","last_fullsized":"2023-11-28T20:00:32.538374+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:30.046728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:30.046728+0000","last_clean_scrub_stamp":"2023-11-28T20:00:30.046728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:56:08.338193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-28T20:00:31.773688+0000","last_change":"2023-11-28T20:00:30.073724+0000","last_active":"2023-11-28T20:00:31.773688+0000","last_peered":"2023-11-28T20:00:31.773688+0000","last_clean":"2023-11-28T20:00:31.773688+0000","last_became_active":"2023-11-28T20:00:30.072958+0000","last_became_peered":"2023-11-28T20:00:30.072958+0000","last_unstale":"2023-11-28T20:00:31.773688+0000","last_undegraded":"2023-11-28T20:00:31.773688+0000","last_fullsized":"2023-11-28T20:00:31.773688+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:29.043480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:29.043480+0000","last_clean_scrub_stamp":"2023-11-28T20:00:29.043480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:40:17.393657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":15,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-28T20:00:30.773158+0000","last_change":"2023-11-28T20:00:13.805383+0000","last_active":"2023-11-28T20:00:30.773158+0000","last_peered":"2023-11-28T20:00:30.773158+0000","last_clean":"2023-11-28T20:00:30.773158+0000","last_became_active":"2023-11-28T20:00:13.805090+0000","last_became_peered":"2023-11-28T20:00:13.805090+0000","last_unstale":"2023-11-28T20:00:30.773158+0000","last_undegraded":"2023-11-28T20:00:30.773158+0000","last_fullsized":"2023-11-28T20:00:30.773158+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_clean_scrub_stamp":"2023-11-28T20:00:12.764355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:18:53.216142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":16,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-28T20:00:30.774944+0000","last_change":"2023-11-28T20:00:12.792743+0000","last_active":"2023-11-28T20:00:30.774944+0000","last_peered":"2023-11-28T20:00:30.774944+0000","last_clean":"2023-11-28T20:00:30.774944+0000","last_became_active":"2023-11-28T20:00:12.792420+0000","last_became_peered":"2023-11-28T20:00:12.792420+0000","last_unstale":"2023-11-28T20:00:30.774944+0000","last_undegraded":"2023-11-28T20:00:30.774944+0000","last_fullsized":"2023-11-28T20:00:30.774944+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:11.760656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:11.760656+0000","last_clean_scrub_stamp":"2023-11-28T20:00:11.760656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T07:54:02.325947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-28T20:00:32.540546+0000","last_change":"2023-11-28T20:00:30.788386+0000","last_active":"2023-11-28T20:00:32.540546+0000","last_peered":"2023-11-28T20:00:32.540546+0000","last_clean":"2023-11-28T20:00:32.540546+0000","last_became_active":"2023-11-28T20:00:30.788038+0000","last_became_peered":"2023-11-28T20:00:30.788038+0000","last_unstale":"2023-11-28T20:00:32.540546+0000","last_undegraded":"2023-11-28T20:00:32.540546+0000","last_fullsized":"2023-11-28T20:00:32.540546+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:30.046728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:30.046728+0000","last_clean_scrub_stamp":"2023-11-28T20:00:30.046728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:36:38.082414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-28T20:00:32.539527+0000","last_change":"2023-11-28T20:00:30.076107+0000","last_active":"2023-11-28T20:00:32.539527+0000","last_peered":"2023-11-28T20:00:32.539527+0000","last_clean":"2023-11-28T20:00:32.539527+0000","last_became_active":"2023-11-28T20:00:30.075871+0000","last_became_peered":"2023-11-28T20:00:30.075871+0000","last_unstale":"2023-11-28T20:00:32.539527+0000","last_undegraded":"2023-11-28T20:00:32.539527+0000","last_fullsized":"2023-11-28T20:00:32.539527+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:29.043480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:29.043480+0000","last_clean_scrub_stamp":"2023-11-28T20:00:29.043480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:06:53.405406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":15,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-28T20:00:30.776957+0000","last_change":"2023-11-28T20:00:13.802746+0000","last_active":"2023-11-28T20:00:30.776957+0000","last_peered":"2023-11-28T20:00:30.776957+0000","last_clean":"2023-11-28T20:00:30.776957+0000","last_became_active":"2023-11-28T20:00:13.802510+0000","last_became_peered":"2023-11-28T20:00:13.802510+0000","last_unstale":"2023-11-28T20:00:30.776957+0000","last_undegraded":"2023-11-28T20:00:30.776957+0000","last_fullsized":"2023-11-28T20:00:30.776957+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_clean_scrub_stamp":"2023-11-28T20:00:12.764355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:20:11.234527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":16,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-28T20:00:30.787858+0000","last_change":"2023-11-28T20:00:12.793819+0000","last_active":"2023-11-28T20:00:30.787858+0000","last_peered":"2023-11-28T20:00:30.787858+0000","last_clean":"2023-11-28T20:00:30.787858+0000","last_became_active":"2023-11-28T20:00:12.793027+0000","last_became_peered":"2023-11-28T20:00:12.793027+0000","last_unstale":"2023-11-28T20:00:30.787858+0000","last_undegraded":"2023-11-28T20:00:30.787858+0000","last_fullsized":"2023-11-28T20:00:30.787858+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:11.760656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:11.760656+0000","last_clean_scrub_stamp":"2023-11-28T20:00:11.760656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T06:41:49.723414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-28T20:00:32.538417+0000","last_change":"2023-11-28T20:00:30.784590+0000","last_active":"2023-11-28T20:00:32.538417+0000","last_peered":"2023-11-28T20:00:32.538417+0000","last_clean":"2023-11-28T20:00:32.538417+0000","last_became_active":"2023-11-28T20:00:30.784286+0000","last_became_peered":"2023-11-28T20:00:30.784286+0000","last_unstale":"2023-11-28T20:00:32.538417+0000","last_undegraded":"2023-11-28T20:00:32.538417+0000","last_fullsized":"2023-11-28T20:00:32.538417+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:30.046728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:30.046728+0000","last_clean_scrub_stamp":"2023-11-28T20:00:30.046728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:00:10.316375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-28T20:00:32.539108+0000","last_change":"2023-11-28T20:00:30.077259+0000","last_active":"2023-11-28T20:00:32.539108+0000","last_peered":"2023-11-28T20:00:32.539108+0000","last_clean":"2023-11-28T20:00:32.539108+0000","last_became_active":"2023-11-28T20:00:30.077059+0000","last_became_peered":"2023-11-28T20:00:30.077059+0000","last_unstale":"2023-11-28T20:00:32.539108+0000","last_undegraded":"2023-11-28T20:00:32.539108+0000","last_fullsized":"2023-11-28T20:00:32.539108+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:29.043480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:29.043480+0000","last_clean_scrub_stamp":"2023-11-28T20:00:29.043480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:03:00.612020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":15,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-28T20:00:30.772231+0000","last_change":"2023-11-28T20:00:13.803188+0000","last_active":"2023-11-28T20:00:30.772231+0000","last_peered":"2023-11-28T20:00:30.772231+0000","last_clean":"2023-11-28T20:00:30.772231+0000","last_became_active":"2023-11-28T20:00:13.798040+0000","last_became_peered":"2023-11-28T20:00:13.798040+0000","last_unstale":"2023-11-28T20:00:30.772231+0000","last_undegraded":"2023-11-28T20:00:30.772231+0000","last_fullsized":"2023-11-28T20:00:30.772231+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_clean_scrub_stamp":"2023-11-28T20:00:12.764355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:39:05.453623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":16,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-28T20:00:30.771427+0000","last_change":"2023-11-28T20:00:12.790049+0000","last_active":"2023-11-28T20:00:30.771427+0000","last_peered":"2023-11-28T20:00:30.771427+0000","last_clean":"2023-11-28T20:00:30.771427+0000","last_became_active":"2023-11-28T20:00:12.789755+0000","last_became_peered":"2023-11-28T20:00:12.789755+0000","last_unstale":"2023-11-28T20:00:30.771427+0000","last_undegraded":"2023-11-28T20:00:30.771427+0000","last_fullsized":"2023-11-28T20:00:30.771427+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:11.760656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:11.760656+0000","last_clean_scrub_stamp":"2023-11-28T20:00:11.760656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T06:41:49.723414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-28T20:00:32.539354+0000","last_change":"2023-11-28T20:00:30.798659+0000","last_active":"2023-11-28T20:00:32.539354+0000","last_peered":"2023-11-28T20:00:32.539354+0000","last_clean":"2023-11-28T20:00:32.539354+0000","last_became_active":"2023-11-28T20:00:30.798315+0000","last_became_peered":"2023-11-28T20:00:30.798315+0000","last_unstale":"2023-11-28T20:00:32.539354+0000","last_undegraded":"2023-11-28T20:00:32.539354+0000","last_fullsized":"2023-11-28T20:00:32.539354+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:30.046728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:30.046728+0000","last_clean_scrub_stamp":"2023-11-28T20:00:30.046728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:25:09.519117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-28T20:00:32.539735+0000","last_change":"2023-11-28T20:00:30.076686+0000","last_active":"2023-11-28T20:00:32.539735+0000","last_peered":"2023-11-28T20:00:32.539735+0000","last_clean":"2023-11-28T20:00:32.539735+0000","last_became_active":"2023-11-28T20:00:30.076063+0000","last_became_peered":"2023-11-28T20:00:30.076063+0000","last_unstale":"2023-11-28T20:00:32.539735+0000","last_undegraded":"2023-11-28T20:00:32.539735+0000","last_fullsized":"2023-11-28T20:00:32.539735+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:29.043480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:29.043480+0000","last_clean_scrub_stamp":"2023-11-28T20:00:29.043480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:04:16.049081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":15,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-28T20:00:30.780056+0000","last_change":"2023-11-28T20:00:13.823182+0000","last_active":"2023-11-28T20:00:30.780056+0000","last_peered":"2023-11-28T20:00:30.780056+0000","last_clean":"2023-11-28T20:00:30.780056+0000","last_became_active":"2023-11-28T20:00:13.822797+0000","last_became_peered":"2023-11-28T20:00:13.822797+0000","last_unstale":"2023-11-28T20:00:30.780056+0000","last_undegraded":"2023-11-28T20:00:30.780056+0000","last_fullsized":"2023-11-28T20:00:30.780056+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_clean_scrub_stamp":"2023-11-28T20:00:12.764355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:18:27.874818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":16,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-28T20:00:30.779686+0000","last_change":"2023-11-28T20:00:12.794531+0000","last_active":"2023-11-28T20:00:30.779686+0000","last_peered":"2023-11-28T20:00:30.779686+0000","last_clean":"2023-11-28T20:00:30.779686+0000","last_became_active":"2023-11-28T20:00:12.794205+0000","last_became_peered":"2023-11-28T20:00:12.794205+0000","last_unstale":"2023-11-28T20:00:30.779686+0000","last_undegraded":"2023-11-28T20:00:30.779686+0000","last_fullsized":"2023-11-28T20:00:30.779686+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:11.760656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:11.760656+0000","last_clean_scrub_stamp":"2023-11-28T20:00:11.760656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T07:13:20.706540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-28T20:00:31.773629+0000","last_change":"2023-11-28T20:00:30.797266+0000","last_active":"2023-11-28T20:00:31.773629+0000","last_peered":"2023-11-28T20:00:31.773629+0000","last_clean":"2023-11-28T20:00:31.773629+0000","last_became_active":"2023-11-28T20:00:30.795782+0000","last_became_peered":"2023-11-28T20:00:30.795782+0000","last_unstale":"2023-11-28T20:00:31.773629+0000","last_undegraded":"2023-11-28T20:00:31.773629+0000","last_fullsized":"2023-11-28T20:00:31.773629+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:30.046728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:30.046728+0000","last_clean_scrub_stamp":"2023-11-28T20:00:30.046728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T07:28:50.906052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-28T20:00:32.540360+0000","last_change":"2023-11-28T20:00:30.084304+0000","last_active":"2023-11-28T20:00:32.540360+0000","last_peered":"2023-11-28T20:00:32.540360+0000","last_clean":"2023-11-28T20:00:32.540360+0000","last_became_active":"2023-11-28T20:00:30.084052+0000","last_became_peered":"2023-11-28T20:00:30.084052+0000","last_unstale":"2023-11-28T20:00:32.540360+0000","last_undegraded":"2023-11-28T20:00:32.540360+0000","last_fullsized":"2023-11-28T20:00:32.540360+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:29.043480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:29.043480+0000","last_clean_scrub_stamp":"2023-11-28T20:00:29.043480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:16:37.578195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":15,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-28T20:00:30.775042+0000","last_change":"2023-11-28T20:00:13.798633+0000","last_active":"2023-11-28T20:00:30.775042+0000","last_peered":"2023-11-28T20:00:30.775042+0000","last_clean":"2023-11-28T20:00:30.775042+0000","last_became_active":"2023-11-28T20:00:13.798291+0000","last_became_peered":"2023-11-28T20:00:13.798291+0000","last_unstale":"2023-11-28T20:00:30.775042+0000","last_undegraded":"2023-11-28T20:00:30.775042+0000","last_fullsized":"2023-11-28T20:00:30.775042+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:12.764355+0000","last_clean_scrub_stamp":"2023-11-28T20:00:12.764355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:49:40.934392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":16,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-28T20:00:30.777757+0000","last_change":"2023-11-28T20:00:12.795584+0000","last_active":"2023-11-28T20:00:30.777757+0000","last_peered":"2023-11-28T20:00:30.777757+0000","last_clean":"2023-11-28T20:00:30.777757+0000","last_became_active":"2023-11-28T20:00:12.795179+0000","last_became_peered":"2023-11-28T20:00:12.795179+0000","last_unstale":"2023-11-28T20:00:30.777757+0000","last_undegraded":"2023-11-28T20:00:30.777757+0000","last_fullsized":"2023-11-28T20:00:30.777757+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:00:11.760656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:00:11.760656+0000","last_clean_scrub_stamp":"2023-11-28T20:00:11.760656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:18:52.212443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":184,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-28T20:00:30.776715+0000","last_change":"2023-11-28T19:58:56.136501+0000","last_active":"2023-11-28T20:00:30.776715+0000","last_peered":"2023-11-28T20:00:30.776715+0000","last_clean":"2023-11-28T20:00:30.776715+0000","last_became_active":"2023-11-28T19:58:56.135998+0000","last_became_peered":"2023-11-28T19:58:56.135998+0000","last_unstale":"2023-11-28T20:00:30.776715+0000","last_undegraded":"2023-11-28T20:00:30.776715+0000","last_fullsized":"2023-11-28T20:00:30.776715+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:58:54.602349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:58:54.602349+0000","last_clean_scrub_stamp":"2023-11-28T19:58:54.602349+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:33:42.723349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":3905,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":7810,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":66748,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574872,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27604,"kb_used_data":576,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344236,"statfs":{"total":96636764160,"available":96608497664,"internally_reserved":0,"allocated":589824,"data_stored":814845,"data_compressed":33374,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 19:59:54 2023","interfaces":[{"interface":"back","average":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":0.90700000000000003,"5min":0.90700000000000003,"15min":0.90700000000000003},"last":0.69799999999999995},{"interface":"front","average":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"min":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":0.98999999999999999,"5min":0.98999999999999999,"15min":0.98999999999999999},"last":0.59699999999999998}]},{"osd":1,"last update":"Tue Nov 28 19:59:54 2023","interfaces":[{"interface":"back","average":{"1min":0.64600000000000002,"5min":0.64600000000000002,"15min":0.64600000000000002},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":0.89600000000000002,"5min":0.89600000000000002,"15min":0.89600000000000002},"last":0.57599999999999996},{"interface":"front","average":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.70199999999999996},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":1.0900000000000001,"5min":1.0900000000000001,"15min":1.0900000000000001},"last":0.73999999999999999}]},{"osd":2,"last update":"Tue Nov 28 19:59:54 2023","interfaces":[{"interface":"back","average":{"1min":0.73499999999999999,"5min":0.73499999999999999,"15min":0.73499999999999999},"min":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"max":{"1min":0.98799999999999999,"5min":0.98799999999999999,"15min":0.98799999999999999},"last":0.504},{"interface":"front","average":{"1min":0.70699999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":1.0680000000000001,"5min":1.0680000000000001,"15min":1.0680000000000001},"last":0.67200000000000004}]},{"osd":3,"last update":"Tue Nov 28 19:59:54 2023","interfaces":[{"interface":"back","average":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"min":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":1.0449999999999999,"5min":1.0449999999999999,"15min":1.0449999999999999},"last":0.68899999999999995},{"interface":"front","average":{"1min":0.79300000000000004,"5min":0.79300000000000004,"15min":0.79300000000000004},"min":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"max":{"1min":1.1299999999999999,"5min":1.1299999999999999,"15min":1.1299999999999999},"last":0.76600000000000001}]},{"osd":4,"last update":"Tue Nov 28 19:59:54 2023","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":1.018,"5min":1.018,"15min":1.018},"last":0.51900000000000002},{"interface":"front","average":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"min":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.1120000000000001,"5min":1.1120000000000001,"15min":1.1120000000000001},"last":0.72299999999999998}]},{"osd":5,"last update":"Tue Nov 28 19:59:54 2023","interfaces":[{"interface":"back","average":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":1.1699999999999999,"5min":1.1699999999999999,"15min":1.1699999999999999},"last":0.61599999999999999},{"interface":"front","average":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"min":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":1.1890000000000001,"5min":1.1890000000000001,"15min":1.1890000000000001},"last":0.55600000000000005}]},{"osd":6,"last update":"Tue Nov 28 19:59:54 2023","interfaces":[{"interface":"back","average":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.78200000000000003},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":1.1379999999999999,"5min":1.1379999999999999,"15min":1.1379999999999999},"last":0.47499999999999998},{"interface":"front","average":{"1min":0.747,"5min":0.747,"15min":0.747},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.23,"5min":1.23,"15min":1.23},"last":0.64700000000000002}]}]},{"osd":6,"up_from":13,"seq":55834574870,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27540,"kb_used_data":512,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344300,"statfs":{"total":96636764160,"available":96608563200,"internally_reserved":0,"allocated":524288,"data_stored":229887,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 19:59:53 2023","interfaces":[{"interface":"back","average":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.61599999999999999},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.82599999999999996,"5min":0.82599999999999996,"15min":0.82599999999999996},"last":0.60199999999999998},{"interface":"front","average":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":0.98999999999999999,"5min":0.98999999999999999,"15min":0.98999999999999999},"last":0.79000000000000004}]},{"osd":1,"last update":"Tue Nov 28 19:59:53 2023","interfaces":[{"interface":"back","average":{"1min":0.79100000000000004,"5min":0.79100000000000004,"15min":0.79100000000000004},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.105,"5min":1.105,"15min":1.105},"last":1.0940000000000001},{"interface":"front","average":{"1min":0.68700000000000006,"5min":0.68700000000000006,"15min":0.68700000000000006},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.95899999999999996,"5min":0.95899999999999996,"15min":0.95899999999999996},"last":0.755}]},{"osd":2,"last update":"Tue Nov 28 19:59:53 2023","interfaces":[{"interface":"back","average":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"min":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":0.93400000000000005,"5min":0.93400000000000005,"15min":0.93400000000000005},"last":0.72199999999999998},{"interface":"front","average":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"min":{"1min":0.505,"5min":0.505,"15min":0.505},"max":{"1min":1.006,"5min":1.006,"15min":1.006},"last":0.91800000000000004}]},{"osd":3,"last update":"Tue Nov 28 19:59:53 2023","interfaces":[{"interface":"back","average":{"1min":0.749,"5min":0.749,"15min":0.749},"min":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"max":{"1min":1.056,"5min":1.056,"15min":1.056},"last":1.04},{"interface":"front","average":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":0.88900000000000001,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.85599999999999998}]},{"osd":4,"last update":"Tue Nov 28 19:59:53 2023","interfaces":[{"interface":"back","average":{"1min":0.63100000000000001,"5min":0.63100000000000001,"15min":0.63100000000000001},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":0.96999999999999997,"5min":0.96999999999999997,"15min":0.96999999999999997},"last":0.57599999999999996},{"interface":"front","average":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":1.389,"5min":1.389,"15min":1.389},"last":1.1419999999999999}]},{"osd":5,"last update":"Tue Nov 28 19:59:53 2023","interfaces":[{"interface":"back","average":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":0.81699999999999995},"min":{"1min":0.5,"5min":0.5,"15min":0.5},"max":{"1min":1.4259999999999999,"5min":1.4259999999999999,"15min":1.4259999999999999},"last":0.89700000000000002},{"interface":"front","average":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"min":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":1.276,"5min":1.276,"15min":1.276},"last":0.81799999999999995}]},{"osd":7,"last update":"Tue Nov 28 19:59:53 2023","interfaces":[{"interface":"back","average":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.71499999999999997},"min":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":0.97599999999999998,"5min":0.97599999999999998,"15min":0.97599999999999998},"last":1.014},{"interface":"front","average":{"1min":0.82999999999999996,"5min":0.82999999999999996,"15min":0.82999999999999996},"min":{"1min":0.65600000000000003,"5min":0.65600000000000003,"15min":0.65600000000000003},"max":{"1min":1.242,"5min":1.242,"15min":1.242},"last":0.96699999999999997}]}]},{"osd":5,"up_from":13,"seq":55834574872,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27520,"kb_used_data":496,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344320,"statfs":{"total":96636764160,"available":96608583680,"internally_reserved":0,"allocated":507904,"data_stored":221288,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 19:59:53 2023","interfaces":[{"interface":"back","average":{"1min":0.70999999999999996,"5min":0.70999999999999996,"15min":0.70999999999999996},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":0.997,"5min":0.997,"15min":0.997},"last":0.50800000000000001},{"interface":"front","average":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"min":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":1.149,"5min":1.149,"15min":1.149},"last":0.41699999999999998}]},{"osd":1,"last update":"Tue Nov 28 19:59:53 2023","interfaces":[{"interface":"back","average":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":0.92700000000000005,"5min":0.92700000000000005,"15min":0.92700000000000005},"last":0.42899999999999999},{"interface":"front","average":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":1.0940000000000001,"5min":1.0940000000000001,"15min":1.0940000000000001},"last":0.38}]},{"osd":2,"last update":"Tue Nov 28 19:59:53 2023","interfaces":[{"interface":"back","average":{"1min":0.94599999999999995,"5min":0.94599999999999995,"15min":0.94599999999999995},"min":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":5.0880000000000001,"5min":5.0880000000000001,"15min":5.0880000000000001},"last":0.56200000000000006},{"interface":"front","average":{"1min":1.002,"5min":1.002,"15min":1.002},"min":{"1min":0.504,"5min":0.504,"15min":0.504},"max":{"1min":5.1399999999999997,"5min":5.1399999999999997,"15min":5.1399999999999997},"last":0.59399999999999997}]},{"osd":3,"last update":"Tue Nov 28 19:59:53 2023","interfaces":[{"interface":"back","average":{"1min":1.028,"5min":1.028,"15min":1.028},"min":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"max":{"1min":5.0469999999999997,"5min":5.0469999999999997,"15min":5.0469999999999997},"last":0.52600000000000002},{"interface":"front","average":{"1min":1.0009999999999999,"5min":1.0009999999999999,"15min":1.0009999999999999},"min":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":5.024,"5min":5.024,"15min":5.024},"last":0.66100000000000003}]},{"osd":4,"last update":"Tue Nov 28 19:59:53 2023","interfaces":[{"interface":"back","average":{"1min":0.67700000000000005,"5min":0.67700000000000005,"15min":0.67700000000000005},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":1.4810000000000001,"5min":1.4810000000000001,"15min":1.4810000000000001},"last":0.32900000000000001},{"interface":"front","average":{"1min":0.747,"5min":0.747,"15min":0.747},"min":{"1min":0.5,"5min":0.5,"15min":0.5},"max":{"1min":1.6339999999999999,"5min":1.6339999999999999,"15min":1.6339999999999999},"last":0.44500000000000001}]},{"osd":6,"last update":"Tue Nov 28 19:59:53 2023","interfaces":[{"interface":"back","average":{"1min":0.70699999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":0.97699999999999998,"5min":0.97699999999999998,"15min":0.97699999999999998},"last":0.628},{"interface":"front","average":{"1min":0.748,"5min":0.748,"15min":0.748},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":1.099,"5min":1.099,"15min":1.099},"last":0.46300000000000002}]},{"osd":7,"last update":"Tue Nov 28 19:59:53 2023","interfaces":[{"interface":"back","average":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"min":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":1.236,"5min":1.236,"15min":1.236},"last":0.48499999999999999},{"interface":"front","average":{"1min":0.80100000000000005,"5min":0.80100000000000005,"15min":0.80100000000000005},"min":{"1min":0.505,"5min":0.505,"15min":0.505},"max":{"1min":1.0760000000000001,"5min":1.0760000000000001,"15min":1.0760000000000001},"last":0.54000000000000004}]}]},{"osd":4,"up_from":13,"seq":55834574871,"num_pgs":45,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27540,"kb_used_data":512,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344300,"statfs":{"total":96636764160,"available":96608563200,"internally_reserved":0,"allocated":524288,"data_stored":229839,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 19:59:54 2023","interfaces":[{"interface":"back","average":{"1min":0.71099999999999997,"5min":0.71099999999999997,"15min":0.71099999999999997},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":1.0429999999999999,"5min":1.0429999999999999,"15min":1.0429999999999999},"last":0.71899999999999997},{"interface":"front","average":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":1.163,"5min":1.163,"15min":1.163},"last":0.48299999999999998}]},{"osd":1,"last update":"Tue Nov 28 19:59:54 2023","interfaces":[{"interface":"back","average":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"min":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":1.111,"5min":1.111,"15min":1.111},"last":0.56100000000000005},{"interface":"front","average":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"min":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":1.238,"5min":1.238,"15min":1.238},"last":0.66000000000000003}]},{"osd":2,"last update":"Tue Nov 28 19:59:54 2023","interfaces":[{"interface":"back","average":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":0.78300000000000003},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":1.0669999999999999,"5min":1.0669999999999999,"15min":1.0669999999999999},"last":0.624},{"interface":"front","average":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":0.81699999999999995},"min":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":1.1180000000000001,"5min":1.1180000000000001,"15min":1.1180000000000001},"last":0.58799999999999997}]},{"osd":3,"last update":"Tue Nov 28 19:59:54 2023","interfaces":[{"interface":"back","average":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"min":{"1min":0.499,"5min":0.499,"15min":0.499},"max":{"1min":1.202,"5min":1.202,"15min":1.202},"last":0.54400000000000004},{"interface":"front","average":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"min":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":1.0589999999999999,"5min":1.0589999999999999,"15min":1.0589999999999999},"last":0.69599999999999995}]},{"osd":5,"last update":"Tue Nov 28 19:59:54 2023","interfaces":[{"interface":"back","average":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":0.95899999999999996,"5min":0.95899999999999996,"15min":0.95899999999999996},"last":0.51100000000000001},{"interface":"front","average":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":1.034,"5min":1.034,"15min":1.034},"last":0.67900000000000005}]},{"osd":6,"last update":"Tue Nov 28 19:59:54 2023","interfaces":[{"interface":"back","average":{"1min":0.73499999999999999,"5min":0.73499999999999999,"15min":0.73499999999999999},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":1.0309999999999999,"5min":1.0309999999999999,"15min":1.0309999999999999},"last":0.73699999999999999},{"interface":"front","average":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":1.002,"5min":1.002,"15min":1.002},"last":0.78000000000000003}]},{"osd":7,"last update":"Tue Nov 28 19:59:54 2023","interfaces":[{"interface":"back","average":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"min":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":1.0620000000000001,"5min":1.0620000000000001,"15min":1.0620000000000001},"last":0.752},{"interface":"front","average":{"1min":0.87,"5min":0.87,"15min":0.87},"min":{"1min":0.627,"5min":0.627,"15min":0.627},"max":{"1min":1.1459999999999999,"5min":1.1459999999999999,"15min":1.1459999999999999},"last":0.80100000000000005}]}]},{"osd":3,"up_from":13,"seq":55834574872,"num_pgs":46,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27544,"kb_used_data":520,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344296,"statfs":{"total":96636764160,"available":96608559104,"internally_reserved":0,"allocated":532480,"data_stored":225951,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 19:59:52 2023","interfaces":[{"interface":"back","average":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.70199999999999996},"last":0.29999999999999999},{"interface":"front","average":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"min":{"1min":0.312,"5min":0.312,"15min":0.312},"max":{"1min":0.82599999999999996,"5min":0.82599999999999996,"15min":0.82599999999999996},"last":0.34000000000000002}]},{"osd":1,"last update":"Tue Nov 28 19:59:52 2023","interfaces":[{"interface":"back","average":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.84399999999999997,"5min":0.84399999999999997,"15min":0.84399999999999997},"last":0.26200000000000001},{"interface":"front","average":{"1min":0.505,"5min":0.505,"15min":0.505},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.86099999999999999,"5min":0.86099999999999999,"15min":0.86099999999999999},"last":0.44500000000000001}]},{"osd":2,"last update":"Tue Nov 28 19:59:52 2023","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.85599999999999998,"5min":0.85599999999999998,"15min":0.85599999999999998},"last":0.435},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.83699999999999997,"5min":0.83699999999999997,"15min":0.83699999999999997},"last":0.32100000000000001}]},{"osd":4,"last update":"Tue Nov 28 19:59:52 2023","interfaces":[{"interface":"back","average":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":1.206,"5min":1.206,"15min":1.206},"last":0.82199999999999995},{"interface":"front","average":{"1min":0.80300000000000005,"5min":0.80300000000000005,"15min":0.80300000000000005},"min":{"1min":0.503,"5min":0.503,"15min":0.503},"max":{"1min":1.222,"5min":1.222,"15min":1.222},"last":0.83599999999999997}]},{"osd":5,"last update":"Tue Nov 28 19:59:52 2023","interfaces":[{"interface":"back","average":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"min":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":1.151,"5min":1.151,"15min":1.151},"last":0.81000000000000005},{"interface":"front","average":{"1min":0.80300000000000005,"5min":0.80300000000000005,"15min":0.80300000000000005},"min":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":1.3100000000000001,"5min":1.3100000000000001,"15min":1.3100000000000001},"last":0.77500000000000002}]},{"osd":6,"last update":"Tue Nov 28 19:59:52 2023","interfaces":[{"interface":"back","average":{"1min":0.84399999999999997,"5min":0.84399999999999997,"15min":0.84399999999999997},"min":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":1.361,"5min":1.361,"15min":1.361},"last":0.877},{"interface":"front","average":{"1min":0.749,"5min":0.749,"15min":0.749},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.125,"5min":1.125,"15min":1.125},"last":0.86799999999999999}]},{"osd":7,"last update":"Tue Nov 28 19:59:52 2023","interfaces":[{"interface":"back","average":{"1min":0.84999999999999998,"5min":0.84999999999999998,"15min":0.84999999999999998},"min":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"max":{"1min":1.2569999999999999,"5min":1.2569999999999999,"15min":1.2569999999999999},"last":0.79200000000000004},{"interface":"front","average":{"1min":0.89100000000000001,"5min":0.89100000000000001,"15min":0.89100000000000001},"min":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"max":{"1min":1.339,"5min":1.339,"15min":1.339},"last":0.76300000000000001}]}]},{"osd":2,"up_from":13,"seq":55834574870,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27544,"kb_used_data":516,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344296,"statfs":{"total":96636764160,"available":96608559104,"internally_reserved":0,"allocated":528384,"data_stored":230335,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 19:59:54 2023","interfaces":[{"interface":"back","average":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"min":{"1min":0.26400000000000001,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"last":0.36099999999999999},{"interface":"front","average":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.67700000000000005,"5min":0.67700000000000005,"15min":0.67700000000000005},"last":0.53000000000000003}]},{"osd":1,"last update":"Tue Nov 28 19:59:54 2023","interfaces":[{"interface":"back","average":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"min":{"1min":0.29899999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":1.0389999999999999,"5min":1.0389999999999999,"15min":1.0389999999999999},"last":0.49099999999999999},{"interface":"front","average":{"1min":0.505,"5min":0.505,"15min":0.505},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.70999999999999996,"5min":0.70999999999999996,"15min":0.70999999999999996},"last":0.40000000000000002}]},{"osd":3,"last update":"Tue Nov 28 19:59:54 2023","interfaces":[{"interface":"back","average":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"min":{"1min":0.28199999999999997,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.629,"5min":0.629,"15min":0.629},"last":0.38100000000000001},{"interface":"front","average":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.98499999999999999,"5min":0.98499999999999999,"15min":0.98499999999999999},"last":0.57199999999999995}]},{"osd":4,"last update":"Tue Nov 28 19:59:54 2023","interfaces":[{"interface":"back","average":{"1min":0.86199999999999999,"5min":0.86199999999999999,"15min":0.86199999999999999},"min":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"max":{"1min":1.139,"5min":1.139,"15min":1.139},"last":0.59299999999999997},{"interface":"front","average":{"1min":0.85299999999999998,"5min":0.85299999999999998,"15min":0.85299999999999998},"min":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":1.238,"5min":1.238,"15min":1.238},"last":0.66800000000000004}]},{"osd":5,"last update":"Tue Nov 28 19:59:54 2023","interfaces":[{"interface":"back","average":{"1min":0.88500000000000001,"5min":0.88500000000000001,"15min":0.88500000000000001},"min":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":1.6180000000000001,"5min":1.6180000000000001,"15min":1.6180000000000001},"last":0.63300000000000001},{"interface":"front","average":{"1min":0.83499999999999996,"5min":0.83499999999999996,"15min":0.83499999999999996},"min":{"1min":0.496,"5min":0.496,"15min":0.496},"max":{"1min":1.339,"5min":1.339,"15min":1.339},"last":0.68200000000000005}]},{"osd":6,"last update":"Tue Nov 28 19:59:54 2023","interfaces":[{"interface":"back","average":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":0.80600000000000005},"min":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1.1839999999999999,"5min":1.1839999999999999,"15min":1.1839999999999999},"last":0.70499999999999996},{"interface":"front","average":{"1min":0.86199999999999999,"5min":0.86199999999999999,"15min":0.86199999999999999},"min":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":1.099,"5min":1.099,"15min":1.099},"last":0.78000000000000003}]},{"osd":7,"last update":"Tue Nov 28 19:59:54 2023","interfaces":[{"interface":"back","average":{"1min":0.89000000000000001,"5min":0.89000000000000001,"15min":0.89000000000000001},"min":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":1.4590000000000001,"5min":1.4590000000000001,"15min":1.4590000000000001},"last":0.72899999999999998},{"interface":"front","average":{"1min":0.86699999999999999,"5min":0.86699999999999999,"15min":0.86699999999999999},"min":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":1.387,"5min":1.387,"15min":1.387},"last":0.61399999999999999}]}]},{"osd":1,"up_from":13,"seq":55834574872,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27524,"kb_used_data":500,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344316,"statfs":{"total":96636764160,"available":96608579584,"internally_reserved":0,"allocated":512000,"data_stored":221426,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 19:59:53 2023","interfaces":[{"interface":"back","average":{"1min":0.65800000000000003,"5min":0.65800000000000003,"15min":0.65800000000000003},"min":{"1min":0.31,"5min":0.31,"15min":0.31},"max":{"1min":3.8740000000000001,"5min":3.8740000000000001,"15min":3.8740000000000001},"last":0.35799999999999998},{"interface":"front","average":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"min":{"1min":0.25,"5min":0.25,"15min":0.25},"max":{"1min":2.0760000000000001,"5min":2.0760000000000001,"15min":2.0760000000000001},"last":0.26200000000000001}]},{"osd":2,"last update":"Tue Nov 28 19:59:53 2023","interfaces":[{"interface":"back","average":{"1min":0.65900000000000003,"5min":0.65900000000000003,"15min":0.65900000000000003},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":3.7320000000000002,"5min":3.7320000000000002,"15min":3.7320000000000002},"last":0.311},{"interface":"front","average":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":3.9089999999999998,"5min":3.9089999999999998,"15min":3.9089999999999998},"last":0.39900000000000002}]},{"osd":3,"last update":"Tue Nov 28 19:59:53 2023","interfaces":[{"interface":"back","average":{"1min":0.68100000000000005,"5min":0.68100000000000005,"15min":0.68100000000000005},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":1.6399999999999999,"5min":1.6399999999999999,"15min":1.6399999999999999},"last":0.41999999999999998},{"interface":"front","average":{"1min":0.70299999999999996,"5min":0.70299999999999996,"15min":0.70299999999999996},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":2.5270000000000001,"5min":2.5270000000000001,"15min":2.5270000000000001},"last":0.38500000000000001}]},{"osd":4,"last update":"Tue Nov 28 19:59:53 2023","interfaces":[{"interface":"back","average":{"1min":0.89500000000000002,"5min":0.89500000000000002,"15min":0.89500000000000002},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":3.1659999999999999,"5min":3.1659999999999999,"15min":3.1659999999999999},"last":0.61399999999999999},{"interface":"front","average":{"1min":0.94599999999999995,"5min":0.94599999999999995,"15min":0.94599999999999995},"min":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":3.7959999999999998,"5min":3.7959999999999998,"15min":3.7959999999999998},"last":0.67600000000000005}]},{"osd":5,"last update":"Tue Nov 28 19:59:53 2023","interfaces":[{"interface":"back","average":{"1min":0.98899999999999999,"5min":0.98899999999999999,"15min":0.98899999999999999},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":4.1479999999999997,"5min":4.1479999999999997,"15min":4.1479999999999997},"last":0.66400000000000003},{"interface":"front","average":{"1min":0.91000000000000003,"5min":0.91000000000000003,"15min":0.91000000000000003},"min":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":3.5569999999999999,"5min":3.5569999999999999,"15min":3.5569999999999999},"last":0.76300000000000001}]},{"osd":6,"last update":"Tue Nov 28 19:59:53 2023","interfaces":[{"interface":"back","average":{"1min":0.99199999999999999,"5min":0.99199999999999999,"15min":0.99199999999999999},"min":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":2.863,"5min":2.863,"15min":2.863},"last":0.72199999999999998},{"interface":"front","average":{"1min":0.98299999999999998,"5min":0.98299999999999998,"15min":0.98299999999999998},"min":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"max":{"1min":3.371,"5min":3.371,"15min":3.371},"last":0.73799999999999999}]},{"osd":7,"last update":"Tue Nov 28 19:59:53 2023","interfaces":[{"interface":"back","average":{"1min":1.0129999999999999,"5min":1.0129999999999999,"15min":1.0129999999999999},"min":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"max":{"1min":3.8439999999999999,"5min":3.8439999999999999,"15min":3.8439999999999999},"last":0.70899999999999996},{"interface":"front","average":{"1min":1.038,"5min":1.038,"15min":1.038},"min":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"max":{"1min":3.9689999999999999,"5min":3.9689999999999999,"15min":3.9689999999999999},"last":0.69099999999999995}]}]},{"osd":0,"up_from":13,"seq":55834574871,"num_pgs":46,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27600,"kb_used_data":576,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344240,"statfs":{"total":96636764160,"available":96608501760,"internally_reserved":0,"allocated":589824,"data_stored":819111,"data_compressed":33374,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Nov 28 19:59:56 2023","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.68999999999999995,"15min":0.68999999999999995},"min":{"1min":0.29899999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":4.883,"5min":4.883,"15min":4.883},"last":0.40999999999999998},{"interface":"front","average":{"1min":0.878,"5min":0.878,"15min":0.878},"min":{"1min":0.29399999999999998,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":8.0800000000000001,"5min":8.0800000000000001,"15min":8.0800000000000001},"last":0.52300000000000002}]},{"osd":2,"last update":"Tue Nov 28 19:59:56 2023","interfaces":[{"interface":"back","average":{"1min":0.97399999999999998,"5min":0.97399999999999998,"15min":0.97399999999999998},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":8.1029999999999998,"5min":8.1029999999999998,"15min":8.1029999999999998},"last":0.45300000000000001},{"interface":"front","average":{"1min":0.98699999999999999,"5min":0.98699999999999999,"15min":0.98699999999999999},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":8.1310000000000002,"5min":8.1310000000000002,"15min":8.1310000000000002},"last":0.46200000000000002}]},{"osd":3,"last update":"Tue Nov 28 19:59:56 2023","interfaces":[{"interface":"back","average":{"1min":0.747,"5min":0.747,"15min":0.747},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":4.3949999999999996,"5min":4.3949999999999996,"15min":4.3949999999999996},"last":0.375},{"interface":"front","average":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":4.3470000000000004,"5min":4.3470000000000004,"15min":4.3470000000000004},"last":0.50600000000000001}]},{"osd":4,"last update":"Tue Nov 28 19:59:56 2023","interfaces":[{"interface":"back","average":{"1min":1.0509999999999999,"5min":1.0509999999999999,"15min":1.0509999999999999},"min":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"max":{"1min":4.6360000000000001,"5min":4.6360000000000001,"15min":4.6360000000000001},"last":0.53600000000000003},{"interface":"front","average":{"1min":1.0529999999999999,"5min":1.0529999999999999,"15min":1.0529999999999999},"min":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":4.4710000000000001,"5min":4.4710000000000001,"15min":4.4710000000000001},"last":0.64200000000000002}]},{"osd":5,"last update":"Tue Nov 28 19:59:56 2023","interfaces":[{"interface":"back","average":{"1min":1.0649999999999999,"5min":1.0649999999999999,"15min":1.0649999999999999},"min":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":4.6120000000000001,"5min":4.6120000000000001,"15min":4.6120000000000001},"last":0.65600000000000003},{"interface":"front","average":{"1min":1.052,"5min":1.052,"15min":1.052},"min":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"max":{"1min":4.5449999999999999,"5min":4.5449999999999999,"15min":4.5449999999999999},"last":0.57199999999999995}]},{"osd":6,"last update":"Tue Nov 28 19:59:56 2023","interfaces":[{"interface":"back","average":{"1min":1.079,"5min":1.079,"15min":1.079},"min":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":4.657,"5min":4.657,"15min":4.657},"last":0.54900000000000004},{"interface":"front","average":{"1min":1.097,"5min":1.097,"15min":1.097},"min":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"max":{"1min":4.5259999999999998,"5min":4.5259999999999998,"15min":4.5259999999999998},"last":0.61199999999999999}]},{"osd":7,"last update":"Tue Nov 28 19:59:56 2023","interfaces":[{"interface":"back","average":{"1min":1.101,"5min":1.101,"15min":1.101},"min":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.60099999999999998},"max":{"1min":4.7320000000000002,"5min":4.7320000000000002,"15min":4.7320000000000002},"last":0.56000000000000005},{"interface":"front","average":{"1min":1.046,"5min":1.046,"15min":1.046},"min":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":4.4939999999999998,"5min":4.4939999999999998,"15min":4.4939999999999998},"last":0.623}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33374,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33374,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":3141,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":3177,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-28T20:00:35.607 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-11-28T20:00:35.608 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.1 mon 'allow r' osd 'allow rw pool=cephfs2_data' mds allow 2023-11-28T20:00:35.783 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:35.777+0000 7f5a3a99d640 1 Processor -- start 2023-11-28T20:00:35.784 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:35.777+0000 7f5a3a99d640 1 -- start start 2023-11-28T20:00:35.785 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:35.781+0000 7f5a3a99d640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f5a3406d840 0x7f5a340c43e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:35.785 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:35.781+0000 7f5a3a99d640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5a34152910 con 0x7f5a3414f850 2023-11-28T20:00:35.785 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:35.781+0000 7f5a3a99d640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5a34152bf0 con 0x7f5a3414fc30 2023-11-28T20:00:35.785 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:35.781+0000 7f5a3a99d640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5a340c2240 con 0x7f5a3406d840 2023-11-28T20:00:35.785 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:35.781+0000 7f5a33fff640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f5a3414f850 0x7f5a340aacf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:34018/0 (socket says 172.21.15.78:34018) 2023-11-28T20:00:35.785 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:35.781+0000 7f5a33fff640 1 -- 172.21.15.78:0/1841811538 learned_addr learned my addr 172.21.15.78:0/1841811538 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-11-28T20:00:35.787 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:35.781+0000 7f5a32ffd640 1 -- 172.21.15.78:0/1841811538 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1011904817 0 0) 0x7f5a34152910 con 0x7f5a3414f850 2023-11-28T20:00:35.787 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:35.781+0000 7f5a38f3a640 1 --2- 172.21.15.78:0/1841811538 >> v2:172.21.15.179:3300/0 conn(0x7f5a3406d840 0x7f5a340c43e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:35.787 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:35.781+0000 7f5a32ffd640 1 -- 172.21.15.78:0/1841811538 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5a1c003530 con 0x7f5a3414f850 2023-11-28T20:00:35.787 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:35.781+0000 7f5a32ffd640 1 -- 172.21.15.78:0/1841811538 <== mon.0 v1:172.21.15.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 617929428 0 0) 0x7f5a1c003530 con 0x7f5a3414f850 2023-11-28T20:00:35.787 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:35.781+0000 7f5a32ffd640 1 -- 172.21.15.78:0/1841811538 >> v2:172.21.15.179:3300/0 conn(0x7f5a3406d840 msgr2=0x7f5a340c43e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:00:35.787 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:35.781+0000 7f5a32ffd640 1 --2- 172.21.15.78:0/1841811538 >> v2:172.21.15.179:3300/0 conn(0x7f5a3406d840 0x7f5a340c43e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:35.787 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:35.781+0000 7f5a32ffd640 1 -- 172.21.15.78:0/1841811538 >> v1:172.21.15.179:6789/0 conn(0x7f5a3414fc30 legacy=0x7f5a340c3cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:00:35.788 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:35.781+0000 7f5a32ffd640 1 -- 172.21.15.78:0/1841811538 --> v1:172.21.15.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a34152ed0 con 0x7f5a3414f850 2023-11-28T20:00:35.788 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:35.781+0000 7f5a32ffd640 1 -- 172.21.15.78:0/1841811538 <== mon.0 v1:172.21.15.78:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3326804700 0 0) 0x7f5a24001680 con 0x7f5a3414f850 2023-11-28T20:00:35.788 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:35.781+0000 7f5a32ffd640 1 -- 172.21.15.78:0/1841811538 >> v1:172.21.15.78:6789/0 conn(0x7f5a3414f850 legacy=0x7f5a340aacf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:00:35.788 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:35.781+0000 7f5a32ffd640 1 --2- 172.21.15.78:0/1841811538 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5a1c003980 0x7f5a1c003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:35.788 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:35.781+0000 7f5a32ffd640 1 --2- 172.21.15.78:0/1841811538 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5a1c0047d0 0x7f5a1c004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:35.788 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:35.781+0000 7f5a32ffd640 1 --2- 172.21.15.78:0/1841811538 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5a1c005190 0x7f5a1c00b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:35.788 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:35.781+0000 7f5a32ffd640 1 -- 172.21.15.78:0/1841811538 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a340c2240 con 0x7f5a1c005190 2023-11-28T20:00:35.788 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:35.781+0000 7f5a32ffd640 1 -- 172.21.15.78:0/1841811538 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a1c00c030 con 0x7f5a1c0047d0 2023-11-28T20:00:35.788 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:35.781+0000 7f5a32ffd640 1 -- 172.21.15.78:0/1841811538 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5a1c00c1f0 con 0x7f5a1c003980 2023-11-28T20:00:35.788 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:35.781+0000 7f5a38f3a640 1 --2- 172.21.15.78:0/1841811538 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5a1c005190 0x7f5a1c00b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:35.788 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:35.781+0000 7f5a33fff640 1 --2- 172.21.15.78:0/1841811538 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5a1c003980 0x7f5a1c003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:35.788 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:35.781+0000 7f5a337fe640 1 --2- 172.21.15.78:0/1841811538 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5a1c0047d0 0x7f5a1c004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:35.789 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:35.781+0000 7f5a38f3a640 1 -- 172.21.15.78:0/1841811538 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5a1c003980 msgr2=0x7f5a1c003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:00:35.789 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:35.781+0000 7f5a38f3a640 1 --2- 172.21.15.78:0/1841811538 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5a1c003980 0x7f5a1c003da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:35.789 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:35.781+0000 7f5a38f3a640 1 -- 172.21.15.78:0/1841811538 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5a1c0047d0 msgr2=0x7f5a1c004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:00:35.789 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:35.781+0000 7f5a38f3a640 1 --2- 172.21.15.78:0/1841811538 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5a1c0047d0 0x7f5a1c004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:35.789 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:35.781+0000 7f5a38f3a640 1 -- 172.21.15.78:0/1841811538 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a1c003530 con 0x7f5a1c005190 2023-11-28T20:00:35.789 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:35.781+0000 7f5a337fe640 1 --2- 172.21.15.78:0/1841811538 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5a1c0047d0 0x7f5a1c004c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T20:00:35.790 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:35.785+0000 7f5a38f3a640 1 -- 172.21.15.78:0/1841811538 reap_dead start 2023-11-28T20:00:35.790 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:35.785+0000 7f5a38f3a640 1 --2- 172.21.15.78:0/1841811538 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5a1c005190 0x7f5a1c00b990 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f5a2c009fc0 tx=0x7f5a2c01cca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b0de96168727a89e server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:00:35.790 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:35.785+0000 7f5a32ffd640 1 -- 172.21.15.78:0/1841811538 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a2c0a5cb0 con 0x7f5a1c005190 2023-11-28T20:00:35.790 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:35.785+0000 7f5a32ffd640 1 -- 172.21.15.78:0/1841811538 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a2c00f040 con 0x7f5a1c005190 2023-11-28T20:00:35.791 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:35.785+0000 7f5a32ffd640 1 -- 172.21.15.78:0/1841811538 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a2c003be0 con 0x7f5a1c005190 2023-11-28T20:00:35.791 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:35.785+0000 7f5a3a99d640 1 -- 172.21.15.78:0/1841811538 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5a1c005190 msgr2=0x7f5a1c00b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:00:35.791 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:35.785+0000 7f5a3a99d640 1 --2- 172.21.15.78:0/1841811538 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5a1c005190 0x7f5a1c00b990 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f5a2c009fc0 tx=0x7f5a2c01cca0 comp rx=0 tx=0).stop 2023-11-28T20:00:35.791 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:35.785+0000 7f5a3a99d640 1 -- 172.21.15.78:0/1841811538 shutdown_connections 2023-11-28T20:00:35.791 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:35.785+0000 7f5a3a99d640 1 --2- 172.21.15.78:0/1841811538 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5a1c005190 0x7f5a1c00b990 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:35.791 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:35.785+0000 7f5a3a99d640 1 -- 172.21.15.78:0/1841811538 >> 172.21.15.78:0/1841811538 conn(0x7f5a340c59f0 msgr2=0x7f5a340c5e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:00:35.791 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:35.785+0000 7f5a3a99d640 1 -- 172.21.15.78:0/1841811538 shutdown_connections 2023-11-28T20:00:35.791 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:35.785+0000 7f5a3a99d640 1 -- 172.21.15.78:0/1841811538 wait complete. 2023-11-28T20:00:35.791 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:35.789+0000 7f5a3a99d640 1 Processor -- start 2023-11-28T20:00:35.792 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:35.789+0000 7f5a3a99d640 1 -- start start 2023-11-28T20:00:35.793 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:35.789+0000 7f5a3a99d640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5a1c005190 0x7f5a341ea180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:35.794 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:35.789+0000 7f5a3a99d640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5a34071210 0x7f5a3406fac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:35.794 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:35.789+0000 7f5a3a99d640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5a34070860 0x7f5a34156270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:35.794 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:35.789+0000 7f5a3a99d640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a34155750 con 0x7f5a34071210 2023-11-28T20:00:35.794 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:35.789+0000 7f5a3a99d640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a341e9d60 con 0x7f5a1c005190 2023-11-28T20:00:35.794 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:35.789+0000 7f5a3a99d640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5a34071c90 con 0x7f5a34070860 2023-11-28T20:00:35.794 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:35.789+0000 7f5a337fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5a34071210 0x7f5a3406fac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:35.795 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:35.789+0000 7f5a337fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5a34071210 0x7f5a3406fac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:58060/0 (socket says 172.21.15.78:58060) 2023-11-28T20:00:35.795 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:35.789+0000 7f5a337fe640 1 -- 172.21.15.78:0/175683585 learned_addr learned my addr 172.21.15.78:0/175683585 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T20:00:35.795 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:35.789+0000 7f5a38f3a640 1 --2- 172.21.15.78:0/175683585 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5a34070860 0x7f5a34156270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:35.795 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:35.789+0000 7f5a33fff640 1 --2- 172.21.15.78:0/175683585 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5a1c005190 0x7f5a341ea180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:35.795 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:35.789+0000 7f5a337fe640 1 -- 172.21.15.78:0/175683585 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5a34070860 msgr2=0x7f5a34156270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:00:35.795 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:35.789+0000 7f5a337fe640 1 --2- 172.21.15.78:0/175683585 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5a34070860 0x7f5a34156270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:35.795 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:35.789+0000 7f5a337fe640 1 -- 172.21.15.78:0/175683585 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5a1c005190 msgr2=0x7f5a341ea180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:00:35.795 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:35.789+0000 7f5a337fe640 1 --2- 172.21.15.78:0/175683585 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5a1c005190 0x7f5a341ea180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:35.795 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:35.789+0000 7f5a337fe640 1 -- 172.21.15.78:0/175683585 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a341ea6c0 con 0x7f5a34071210 2023-11-28T20:00:35.795 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:35.789+0000 7f5a337fe640 1 --2- 172.21.15.78:0/175683585 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5a34071210 0x7f5a3406fac0 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f5a2800e480 tx=0x7f5a2800e940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:00:35.796 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:35.789+0000 7f5a30ff9640 1 -- 172.21.15.78:0/175683585 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a280052e0 con 0x7f5a34071210 2023-11-28T20:00:35.796 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:35.789+0000 7f5a30ff9640 1 -- 172.21.15.78:0/175683585 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a28005440 con 0x7f5a34071210 2023-11-28T20:00:35.796 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:35.789+0000 7f5a30ff9640 1 -- 172.21.15.78:0/175683585 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a28003820 con 0x7f5a34071210 2023-11-28T20:00:35.797 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:35.789+0000 7f5a3a99d640 1 -- 172.21.15.78:0/175683585 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5a340716d0 con 0x7f5a34071210 2023-11-28T20:00:35.797 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:35.789+0000 7f5a3a99d640 1 -- 172.21.15.78:0/175683585 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5a341e9980 con 0x7f5a34071210 2023-11-28T20:00:35.797 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:35.789+0000 7f5a3a99d640 1 -- 172.21.15.78:0/175683585 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5a341e9ea0 con 0x7f5a34071210 2023-11-28T20:00:35.797 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:35.793+0000 7f5a30ff9640 1 -- 172.21.15.78:0/175683585 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f5a28003980 con 0x7f5a34071210 2023-11-28T20:00:35.797 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:35.793+0000 7f5a30ff9640 1 --2- 172.21.15.78:0/175683585 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f5a20066470 0x7f5a20068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:35.798 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:35.793+0000 7f5a30ff9640 1 -- 172.21.15.78:0/175683585 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 6885+0+0 (secure 0 0 0) 0x7f5a28083a40 con 0x7f5a34071210 2023-11-28T20:00:35.798 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:35.793+0000 7f5a33fff640 1 --2- 172.21.15.78:0/175683585 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f5a20066470 0x7f5a20068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:35.798 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:35.793+0000 7f5a33fff640 1 --2- 172.21.15.78:0/175683585 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f5a20066470 0x7f5a20068930 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f5a240017b0 tx=0x7f5a24001660 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:00:35.802 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:35.797+0000 7f5a30ff9640 1 -- 172.21.15.78:0/175683585 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f5a341e9ea0 con 0x7f5a34071210 2023-11-28T20:00:36.006 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:36.001+0000 7f5a3a99d640 1 -- 172.21.15.78:0/175683585 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.1", "caps": ["mon", "allow r", "osd", "allow rw pool=cephfs2_data", "mds", "allow"]} v 0) v1 -- 0x7f5a341e9ea0 con 0x7f5a34071210 2023-11-28T20:00:36.009 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:36.005+0000 7f5a30ff9640 1 -- 172.21.15.78:0/175683585 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.1", "caps": ["mon", "allow r", "osd", "allow rw pool=cephfs2_data", "mds", "allow"]}]=0 updated caps for client.1 v14) v1 ==== 185+0+142 (secure 0 0 0) 0x7f5a341e9ea0 con 0x7f5a34071210 2023-11-28T20:00:36.009 INFO:teuthology.orchestra.run.smithi078.stdout:[client.1] 2023-11-28T20:00:36.009 INFO:teuthology.orchestra.run.smithi078.stdout: key = AQBORmZlzBgfOhAAm6M8Y+12MlLdVkJnMmK9BQ== 2023-11-28T20:00:36.009 INFO:teuthology.orchestra.run.smithi078.stdout: caps mds = "allow" 2023-11-28T20:00:36.010 INFO:teuthology.orchestra.run.smithi078.stdout: caps mon = "allow r" 2023-11-28T20:00:36.010 INFO:teuthology.orchestra.run.smithi078.stdout: caps osd = "allow rw pool=cephfs2_data" 2023-11-28T20:00:36.010 INFO:teuthology.orchestra.run.smithi078.stderr:updated caps for client.1 2023-11-28T20:00:36.012 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:36.005+0000 7f5a3a99d640 1 -- 172.21.15.78:0/175683585 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f5a20066470 msgr2=0x7f5a20068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:00:36.012 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:36.005+0000 7f5a3a99d640 1 --2- 172.21.15.78:0/175683585 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f5a20066470 0x7f5a20068930 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f5a240017b0 tx=0x7f5a24001660 comp rx=0 tx=0).stop 2023-11-28T20:00:36.012 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:36.005+0000 7f5a3a99d640 1 -- 172.21.15.78:0/175683585 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5a34071210 msgr2=0x7f5a3406fac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:00:36.012 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:36.005+0000 7f5a3a99d640 1 --2- 172.21.15.78:0/175683585 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5a34071210 0x7f5a3406fac0 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f5a2800e480 tx=0x7f5a2800e940 comp rx=0 tx=0).stop 2023-11-28T20:00:36.012 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:36.005+0000 7f5a3a99d640 1 -- 172.21.15.78:0/175683585 shutdown_connections 2023-11-28T20:00:36.012 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:36.005+0000 7f5a3a99d640 1 --2- 172.21.15.78:0/175683585 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f5a20066470 0x7f5a20068930 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:36.012 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:36.005+0000 7f5a3a99d640 1 --2- 172.21.15.78:0/175683585 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5a34070860 0x7f5a34156270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:36.012 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:36.005+0000 7f5a3a99d640 1 --2- 172.21.15.78:0/175683585 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5a34071210 0x7f5a3406fac0 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:36.013 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:36.005+0000 7f5a3a99d640 1 --2- 172.21.15.78:0/175683585 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5a1c005190 0x7f5a341ea180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:36.013 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:36.005+0000 7f5a3a99d640 1 -- 172.21.15.78:0/175683585 >> 172.21.15.78:0/175683585 conn(0x7f5a340c59f0 msgr2=0x7f5a340c5dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:00:36.013 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:36.005+0000 7f5a3a99d640 1 -- 172.21.15.78:0/175683585 shutdown_connections 2023-11-28T20:00:36.013 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:36.005+0000 7f5a3a99d640 1 -- 172.21.15.78:0/175683585 wait complete. 2023-11-28T20:00:36.031 DEBUG:teuthology.orchestra.run.smithi179:> set -ex 2023-11-28T20:00:36.031 DEBUG:teuthology.orchestra.run.smithi179:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-28T20:00:36.041 DEBUG:teuthology.orchestra.run.smithi179:> set -ex 2023-11-28T20:00:36.042 DEBUG:teuthology.orchestra.run.smithi179:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-28T20:00:36.088 INFO:tasks.ceph.mds.b.smithi179.stderr:2023-11-28T20:00:36.084+0000 7f023f456640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-11-28T20:00:36.097 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-28T20:00:36.234 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:36.229+0000 7f2896b16640 1 Processor -- start 2023-11-28T20:00:36.234 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:36.229+0000 7f2896b16640 1 -- start start 2023-11-28T20:00:36.235 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:36.229+0000 7f2896b16640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f289014b2a0 0x7f28900a4ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:36.235 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:36.229+0000 7f2896b16640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f28900bee90 0x7f28900bf310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:36.235 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:36.229+0000 7f2896b16640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2890154740 0x7f2890154bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:36.236 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:36.229+0000 7f2896b16640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f289006c3a0 con 0x7f28900bee90 2023-11-28T20:00:36.236 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:36.229+0000 7f2896b16640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2890157cf0 con 0x7f289014b2a0 2023-11-28T20:00:36.236 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:36.229+0000 7f2896b16640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2890157fd0 con 0x7f2890154740 2023-11-28T20:00:36.236 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:36.229+0000 7f2887fff640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f28900bee90 0x7f28900bf310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:36.236 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:36.229+0000 7f2887fff640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f28900bee90 0x7f28900bf310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:58064/0 (socket says 172.21.15.78:58064) 2023-11-28T20:00:36.236 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:36.229+0000 7f2887fff640 1 -- 172.21.15.78:0/2979115514 learned_addr learned my addr 172.21.15.78:0/2979115514 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T20:00:36.236 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:36.229+0000 7f28948b2640 1 --2- 172.21.15.78:0/2979115514 >> v2:172.21.15.179:3300/0 conn(0x7f289014b2a0 0x7f28900a4ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:36.236 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:36.229+0000 7f28950b3640 1 --2- 172.21.15.78:0/2979115514 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2890154740 0x7f2890154bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:36.236 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:36.229+0000 7f2887fff640 1 -- 172.21.15.78:0/2979115514 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2890154740 msgr2=0x7f2890154bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:00:36.236 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:36.229+0000 7f2887fff640 1 --2- 172.21.15.78:0/2979115514 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2890154740 0x7f2890154bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:36.236 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:36.229+0000 7f2887fff640 1 -- 172.21.15.78:0/2979115514 >> v2:172.21.15.179:3300/0 conn(0x7f289014b2a0 msgr2=0x7f28900a4ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:00:36.237 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:36.229+0000 7f2887fff640 1 --2- 172.21.15.78:0/2979115514 >> v2:172.21.15.179:3300/0 conn(0x7f289014b2a0 0x7f28900a4ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:36.237 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:36.229+0000 7f2887fff640 1 -- 172.21.15.78:0/2979115514 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28901582b0 con 0x7f28900bee90 2023-11-28T20:00:36.238 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:36.233+0000 7f2887fff640 1 --2- 172.21.15.78:0/2979115514 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f28900bee90 0x7f28900bf310 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f289006e3a0 tx=0x7f288001c3e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1dd86c796011e7e3 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:00:36.239 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:36.233+0000 7f28877fe640 1 -- 172.21.15.78:0/2979115514 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28800ab600 con 0x7f28900bee90 2023-11-28T20:00:36.239 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:36.233+0000 7f28877fe640 1 -- 172.21.15.78:0/2979115514 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f28800a7050 con 0x7f28900bee90 2023-11-28T20:00:36.239 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:36.233+0000 7f28877fe640 1 -- 172.21.15.78:0/2979115514 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28800ab980 con 0x7f28900bee90 2023-11-28T20:00:36.239 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:36.233+0000 7f2896b16640 1 -- 172.21.15.78:0/2979115514 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f28900bee90 msgr2=0x7f28900bf310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:00:36.239 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:36.233+0000 7f2896b16640 1 --2- 172.21.15.78:0/2979115514 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f28900bee90 0x7f28900bf310 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f289006e3a0 tx=0x7f288001c3e0 comp rx=0 tx=0).stop 2023-11-28T20:00:36.239 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:36.233+0000 7f2896b16640 1 -- 172.21.15.78:0/2979115514 shutdown_connections 2023-11-28T20:00:36.240 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:36.233+0000 7f2896b16640 1 --2- 172.21.15.78:0/2979115514 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2890154740 0x7f2890154bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:36.240 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:36.233+0000 7f2896b16640 1 --2- 172.21.15.78:0/2979115514 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f28900bee90 0x7f28900bf310 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:36.240 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:36.233+0000 7f2896b16640 1 --2- 172.21.15.78:0/2979115514 >> v2:172.21.15.179:3300/0 conn(0x7f289014b2a0 0x7f28900a4ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:36.240 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:36.233+0000 7f2896b16640 1 -- 172.21.15.78:0/2979115514 >> 172.21.15.78:0/2979115514 conn(0x7f28900a7810 msgr2=0x7f28900a7c20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:00:36.240 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:36.233+0000 7f2896b16640 1 -- 172.21.15.78:0/2979115514 shutdown_connections 2023-11-28T20:00:36.240 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:36.233+0000 7f2896b16640 1 -- 172.21.15.78:0/2979115514 wait complete. 2023-11-28T20:00:36.240 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:36.237+0000 7f2896b16640 1 Processor -- start 2023-11-28T20:00:36.241 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:36.237+0000 7f2896b16640 1 -- start start 2023-11-28T20:00:36.242 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:36.237+0000 7f2896b16640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f28900bee90 0x7f28901462c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:36.242 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:36.237+0000 7f2896b16640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f289014b2a0 0x7f28900c05c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:36.242 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:36.237+0000 7f2896b16640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2890154740 0x7f28901ed430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:36.242 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:36.237+0000 7f2896b16640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2890146800 con 0x7f28900bee90 2023-11-28T20:00:36.242 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:36.237+0000 7f2896b16640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28900712f0 con 0x7f289014b2a0 2023-11-28T20:00:36.243 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:36.237+0000 7f2896b16640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28900706a0 con 0x7f2890154740 2023-11-28T20:00:36.243 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:36.237+0000 7f28948b2640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f28900bee90 0x7f28901462c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:36.243 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:36.237+0000 7f28948b2640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f28900bee90 0x7f28901462c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:58080/0 (socket says 172.21.15.78:58080) 2023-11-28T20:00:36.243 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:36.237+0000 7f28948b2640 1 -- 172.21.15.78:0/3222371110 learned_addr learned my addr 172.21.15.78:0/3222371110 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T20:00:36.243 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:36.237+0000 7f2887fff640 1 --2- 172.21.15.78:0/3222371110 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f289014b2a0 0x7f28900c05c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:36.243 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:36.237+0000 7f28950b3640 1 --2- 172.21.15.78:0/3222371110 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2890154740 0x7f28901ed430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:36.244 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:36.237+0000 7f28948b2640 1 -- 172.21.15.78:0/3222371110 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2890154740 msgr2=0x7f28901ed430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:00:36.244 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:36.237+0000 7f28948b2640 1 --2- 172.21.15.78:0/3222371110 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2890154740 0x7f28901ed430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:36.244 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:36.237+0000 7f28948b2640 1 -- 172.21.15.78:0/3222371110 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f289014b2a0 msgr2=0x7f28900c05c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:00:36.244 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:36.237+0000 7f28948b2640 1 --2- 172.21.15.78:0/3222371110 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f289014b2a0 0x7f28900c05c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:36.244 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:36.237+0000 7f28948b2640 1 -- 172.21.15.78:0/3222371110 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28800094d0 con 0x7f28900bee90 2023-11-28T20:00:36.244 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:36.237+0000 7f28948b2640 1 --2- 172.21.15.78:0/3222371110 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f28900bee90 0x7f28901462c0 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f288c00d830 tx=0x7f288c00dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:00:36.244 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:36.237+0000 7f28857fa640 1 -- 172.21.15.78:0/3222371110 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f288c00b6c0 con 0x7f28900bee90 2023-11-28T20:00:36.245 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:36.237+0000 7f28857fa640 1 -- 172.21.15.78:0/3222371110 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f288c00b820 con 0x7f28900bee90 2023-11-28T20:00:36.245 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:36.237+0000 7f28857fa640 1 -- 172.21.15.78:0/3222371110 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f288c00bb90 con 0x7f28900bee90 2023-11-28T20:00:36.245 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:36.237+0000 7f2896b16640 1 -- 172.21.15.78:0/3222371110 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2890153d20 con 0x7f28900bee90 2023-11-28T20:00:36.245 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:36.237+0000 7f2896b16640 1 -- 172.21.15.78:0/3222371110 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f28901542e0 con 0x7f28900bee90 2023-11-28T20:00:36.245 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:36.241+0000 7f2896b16640 1 -- 172.21.15.78:0/3222371110 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2890151ca0 con 0x7f28900bee90 2023-11-28T20:00:36.245 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:36.241+0000 7f28857fa640 1 -- 172.21.15.78:0/3222371110 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f288c01e460 con 0x7f28900bee90 2023-11-28T20:00:36.246 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:36.241+0000 7f28857fa640 1 --2- 172.21.15.78:0/3222371110 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f287c066470 0x7f287c068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:36.246 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:36.241+0000 7f28857fa640 1 -- 172.21.15.78:0/3222371110 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 6885+0+0 (secure 0 0 0) 0x7f288c0849c0 con 0x7f28900bee90 2023-11-28T20:00:36.246 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:36.241+0000 7f2887fff640 1 --2- 172.21.15.78:0/3222371110 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f287c066470 0x7f287c068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:36.247 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:36.241+0000 7f2887fff640 1 --2- 172.21.15.78:0/3222371110 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f287c066470 0x7f287c068930 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f28800ad000 tx=0x7f2880008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:00:36.250 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:36.245+0000 7f28857fa640 1 -- 172.21.15.78:0/3222371110 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f288c051a40 con 0x7f28900bee90 2023-11-28T20:00:36.402 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:36.393+0000 7f2896b16640 1 -- 172.21.15.78:0/3222371110 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f28900c0010 con 0x7f28900bee90 2023-11-28T20:00:36.403 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:36.397+0000 7f28857fa640 1 -- 172.21.15.78:0/3222371110 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v44) v1 ==== 74+0+20466 (secure 0 0 0) 0x7f288c073010 con 0x7f28900bee90 2023-11-28T20:00:36.405 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-11-28T20:00:36.407 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":44,"fsid":"dd9780e8-3bda-44fa-a9f0-fa07d19d901d","created":"2023-11-28T19:58:40.969556+0000","modified":"2023-11-28T20:00:31.764388+0000","last_up_change":"2023-11-28T19:58:52.596716+0000","last_in_change":"2023-11-28T19:58:43.609275+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-28T19:58:54.011229+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2023-11-28T20:00:10.831194+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"39","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2023-11-28T20:00:12.150184+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"40","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs2_metadata","create_time":"2023-11-28T20:00:28.571896+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"43","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs2_data","create_time":"2023-11-28T20:00:29.436453+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"44","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs2"}},"read_balance":{"score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e84245ac-b5da-429e-af18-39acaa2b33e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6800","nonce":3358701235},{"type":"v1","addr":"172.21.15.78:6801","nonce":3358701235}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6802","nonce":3358701235},{"type":"v1","addr":"172.21.15.78:6803","nonce":3358701235}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6806","nonce":3358701235},{"type":"v1","addr":"172.21.15.78:6807","nonce":3358701235}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6804","nonce":3358701235},{"type":"v1","addr":"172.21.15.78:6805","nonce":3358701235}]},"public_addr":"172.21.15.78:6801/3358701235","cluster_addr":"172.21.15.78:6803/3358701235","heartbeat_back_addr":"172.21.15.78:6807/3358701235","heartbeat_front_addr":"172.21.15.78:6805/3358701235","state":["exists","up"]},{"osd":1,"uuid":"e634831d-c4e2-48d9-870c-9556ae162981","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6808","nonce":3211476654},{"type":"v1","addr":"172.21.15.78:6809","nonce":3211476654}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6810","nonce":3211476654},{"type":"v1","addr":"172.21.15.78:6811","nonce":3211476654}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6814","nonce":3211476654},{"type":"v1","addr":"172.21.15.78:6815","nonce":3211476654}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6812","nonce":3211476654},{"type":"v1","addr":"172.21.15.78:6813","nonce":3211476654}]},"public_addr":"172.21.15.78:6809/3211476654","cluster_addr":"172.21.15.78:6811/3211476654","heartbeat_back_addr":"172.21.15.78:6815/3211476654","heartbeat_front_addr":"172.21.15.78:6813/3211476654","state":["exists","up"]},{"osd":2,"uuid":"274c8395-6534-41f0-b8fb-a00af8985aa8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6816","nonce":2532904479},{"type":"v1","addr":"172.21.15.78:6817","nonce":2532904479}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6818","nonce":2532904479},{"type":"v1","addr":"172.21.15.78:6819","nonce":2532904479}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6822","nonce":2532904479},{"type":"v1","addr":"172.21.15.78:6823","nonce":2532904479}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6820","nonce":2532904479},{"type":"v1","addr":"172.21.15.78:6821","nonce":2532904479}]},"public_addr":"172.21.15.78:6817/2532904479","cluster_addr":"172.21.15.78:6819/2532904479","heartbeat_back_addr":"172.21.15.78:6823/2532904479","heartbeat_front_addr":"172.21.15.78:6821/2532904479","state":["exists","up"]},{"osd":3,"uuid":"77acc9af-7d4d-4b18-8cf5-d62f5971b7c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6824","nonce":3442991267},{"type":"v1","addr":"172.21.15.78:6825","nonce":3442991267}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6826","nonce":3442991267},{"type":"v1","addr":"172.21.15.78:6827","nonce":3442991267}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6830","nonce":3442991267},{"type":"v1","addr":"172.21.15.78:6831","nonce":3442991267}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6828","nonce":3442991267},{"type":"v1","addr":"172.21.15.78:6829","nonce":3442991267}]},"public_addr":"172.21.15.78:6825/3442991267","cluster_addr":"172.21.15.78:6827/3442991267","heartbeat_back_addr":"172.21.15.78:6831/3442991267","heartbeat_front_addr":"172.21.15.78:6829/3442991267","state":["exists","up"]},{"osd":4,"uuid":"5c62bc66-6b34-4b7f-a66b-9a743969138c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":802983577},{"type":"v1","addr":"172.21.15.179:6809","nonce":802983577}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":802983577},{"type":"v1","addr":"172.21.15.179:6811","nonce":802983577}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":802983577},{"type":"v1","addr":"172.21.15.179:6815","nonce":802983577}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":802983577},{"type":"v1","addr":"172.21.15.179:6813","nonce":802983577}]},"public_addr":"172.21.15.179:6809/802983577","cluster_addr":"172.21.15.179:6811/802983577","heartbeat_back_addr":"172.21.15.179:6815/802983577","heartbeat_front_addr":"172.21.15.179:6813/802983577","state":["exists","up"]},{"osd":5,"uuid":"67db6d36-f684-4079-b0cd-82b4dd61461f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":518192887},{"type":"v1","addr":"172.21.15.179:6818","nonce":518192887}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":518192887},{"type":"v1","addr":"172.21.15.179:6822","nonce":518192887}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":518192887},{"type":"v1","addr":"172.21.15.179:6829","nonce":518192887}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6824","nonce":518192887},{"type":"v1","addr":"172.21.15.179:6826","nonce":518192887}]},"public_addr":"172.21.15.179:6818/518192887","cluster_addr":"172.21.15.179:6822/518192887","heartbeat_back_addr":"172.21.15.179:6829/518192887","heartbeat_front_addr":"172.21.15.179:6826/518192887","state":["exists","up"]},{"osd":6,"uuid":"12e670af-5a16-4c81-9f97-defa66cab967","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":815435378},{"type":"v1","addr":"172.21.15.179:6801","nonce":815435378}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":815435378},{"type":"v1","addr":"172.21.15.179:6803","nonce":815435378}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":815435378},{"type":"v1","addr":"172.21.15.179:6807","nonce":815435378}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":815435378},{"type":"v1","addr":"172.21.15.179:6805","nonce":815435378}]},"public_addr":"172.21.15.179:6801/815435378","cluster_addr":"172.21.15.179:6803/815435378","heartbeat_back_addr":"172.21.15.179:6807/815435378","heartbeat_front_addr":"172.21.15.179:6805/815435378","state":["exists","up"]},{"osd":7,"uuid":"fe630650-2eb3-49ad-8676-c341e6332eb1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6817","nonce":2848432339},{"type":"v1","addr":"172.21.15.179:6819","nonce":2848432339}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6821","nonce":2848432339},{"type":"v1","addr":"172.21.15.179:6823","nonce":2848432339}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":2848432339},{"type":"v1","addr":"172.21.15.179:6831","nonce":2848432339}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6825","nonce":2848432339},{"type":"v1","addr":"172.21.15.179:6827","nonce":2848432339}]},"public_addr":"172.21.15.179:6819/2848432339","cluster_addr":"172.21.15.179:6823/2848432339","heartbeat_back_addr":"172.21.15.179:6831/2848432339","heartbeat_front_addr":"172.21.15.179:6827/2848432339","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:58:49.255433+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:58:49.412880+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:58:49.559295+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:58:49.245237+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:58:49.184557+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:58:49.329851+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:58:49.366012+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:58:49.349604+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-28T20:00:36.408 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:36.397+0000 7f2896b16640 1 -- 172.21.15.78:0/3222371110 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f287c066470 msgr2=0x7f287c068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:00:36.408 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:36.397+0000 7f2896b16640 1 --2- 172.21.15.78:0/3222371110 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f287c066470 0x7f287c068930 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f28800ad000 tx=0x7f2880008040 comp rx=0 tx=0).stop 2023-11-28T20:00:36.408 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:36.397+0000 7f2896b16640 1 -- 172.21.15.78:0/3222371110 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f28900bee90 msgr2=0x7f28901462c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:00:36.408 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:36.397+0000 7f2896b16640 1 --2- 172.21.15.78:0/3222371110 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f28900bee90 0x7f28901462c0 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f288c00d830 tx=0x7f288c00dcf0 comp rx=0 tx=0).stop 2023-11-28T20:00:36.408 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:36.397+0000 7f2896b16640 1 -- 172.21.15.78:0/3222371110 shutdown_connections 2023-11-28T20:00:36.408 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:36.397+0000 7f2896b16640 1 --2- 172.21.15.78:0/3222371110 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f287c066470 0x7f287c068930 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:36.408 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:36.397+0000 7f2896b16640 1 --2- 172.21.15.78:0/3222371110 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2890154740 0x7f28901ed430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:36.408 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:36.397+0000 7f2896b16640 1 --2- 172.21.15.78:0/3222371110 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f289014b2a0 0x7f28900c05c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:36.408 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:36.397+0000 7f2896b16640 1 --2- 172.21.15.78:0/3222371110 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f28900bee90 0x7f28901462c0 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:36.409 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:36.397+0000 7f2896b16640 1 -- 172.21.15.78:0/3222371110 >> 172.21.15.78:0/3222371110 conn(0x7f28900a7810 msgr2=0x7f28900a7bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:00:36.409 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:36.397+0000 7f2896b16640 1 -- 172.21.15.78:0/3222371110 shutdown_connections 2023-11-28T20:00:36.409 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:36.397+0000 7f2896b16640 1 -- 172.21.15.78:0/3222371110 wait complete. 2023-11-28T20:00:36.422 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-28T19:58:54.011229+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-28T20:00:10.831194+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '39', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.25, 'score_stable': 1.25, 'optimal_score': 1, 'raw_score_acting': 1.25, 'raw_score_stable': 1.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 6, 'pool_name': 'cephfs_data', 'create_time': '2023-11-28T20:00:12.150184+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '40', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 7, 'pool_name': 'cephfs2_metadata', 'create_time': '2023-11-28T20:00:28.571896+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '43', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs2'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 8, 'pool_name': 'cephfs2_data', 'create_time': '2023-11-28T20:00:29.436453+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '44', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs2'}}, 'read_balance': {'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-28T20:00:36.422 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-28T20:00:36.562 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:36.557+0000 7f8672d9d640 1 Processor -- start 2023-11-28T20:00:36.563 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:36.557+0000 7f8672d9d640 1 -- start start 2023-11-28T20:00:36.564 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:36.557+0000 7f8672d9d640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f866c14f850 0x7f866c0aacf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:36.564 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:36.557+0000 7f8672d9d640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f866c14fc30 0x7f866c0c3cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:36.564 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:36.557+0000 7f8672d9d640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f866c152910 con 0x7f866c06d840 2023-11-28T20:00:36.564 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:36.557+0000 7f8672d9d640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f866c0c2240 con 0x7f866c14f850 2023-11-28T20:00:36.564 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:36.557+0000 7f8672d9d640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f866c152bf0 con 0x7f866c14fc30 2023-11-28T20:00:36.564 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:36.561+0000 7f8670b39640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f866c14f850 0x7f866c0aacf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:36.564 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:36.561+0000 7f8670b39640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f866c14f850 0x7f866c0aacf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:58084/0 (socket says 172.21.15.78:58084) 2023-11-28T20:00:36.564 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:36.561+0000 7f8670b39640 1 -- 172.21.15.78:0/4094335551 learned_addr learned my addr 172.21.15.78:0/4094335551 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T20:00:36.565 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:36.561+0000 7f866bfff640 1 --2- 172.21.15.78:0/4094335551 >> v2:172.21.15.179:3300/0 conn(0x7f866c14fc30 0x7f866c0c3cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:36.565 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:36.561+0000 7f8670b39640 1 -- 172.21.15.78:0/4094335551 >> v2:172.21.15.179:3300/0 conn(0x7f866c14fc30 msgr2=0x7f866c0c3cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:00:36.565 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:36.561+0000 7f8670b39640 1 --2- 172.21.15.78:0/4094335551 >> v2:172.21.15.179:3300/0 conn(0x7f866c14fc30 0x7f866c0c3cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:36.565 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:36.561+0000 7f8670b39640 1 -- 172.21.15.78:0/4094335551 >> v1:172.21.15.179:6789/0 conn(0x7f866c06d840 legacy=0x7f866c0c4210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:00:36.565 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:36.561+0000 7f8670b39640 1 -- 172.21.15.78:0/4094335551 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f866c152ed0 con 0x7f866c14f850 2023-11-28T20:00:36.565 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:36.561+0000 7f866bfff640 1 --2- 172.21.15.78:0/4094335551 >> v2:172.21.15.179:3300/0 conn(0x7f866c14fc30 0x7f866c0c3cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T20:00:36.567 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:36.561+0000 7f8670b39640 1 --2- 172.21.15.78:0/4094335551 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f866c14f850 0x7f866c0aacf0 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f866c06cac0 tx=0x7f866001c4c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8807a6ed3ca3de95 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:00:36.567 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:36.561+0000 7f866b7fe640 1 -- 172.21.15.78:0/4094335551 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86600aa640 con 0x7f866c14f850 2023-11-28T20:00:36.567 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:36.561+0000 7f866b7fe640 1 -- 172.21.15.78:0/4094335551 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f86600aa7a0 con 0x7f866c14f850 2023-11-28T20:00:36.567 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:36.561+0000 7f866b7fe640 1 -- 172.21.15.78:0/4094335551 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86600aab30 con 0x7f866c14f850 2023-11-28T20:00:36.568 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:36.565+0000 7f8672d9d640 1 -- 172.21.15.78:0/4094335551 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f866c14f850 msgr2=0x7f866c0aacf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:00:36.568 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:36.565+0000 7f8672d9d640 1 --2- 172.21.15.78:0/4094335551 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f866c14f850 0x7f866c0aacf0 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f866c06cac0 tx=0x7f866001c4c0 comp rx=0 tx=0).stop 2023-11-28T20:00:36.568 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:36.565+0000 7f8672d9d640 1 -- 172.21.15.78:0/4094335551 shutdown_connections 2023-11-28T20:00:36.568 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:36.565+0000 7f8672d9d640 1 --2- 172.21.15.78:0/4094335551 >> v2:172.21.15.179:3300/0 conn(0x7f866c14fc30 0x7f866c0c3cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:36.568 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:36.565+0000 7f8672d9d640 1 --2- 172.21.15.78:0/4094335551 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f866c14f850 0x7f866c0aacf0 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:36.569 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:36.565+0000 7f8672d9d640 1 -- 172.21.15.78:0/4094335551 >> 172.21.15.78:0/4094335551 conn(0x7f866c0c59f0 msgr2=0x7f866c0c5e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:00:36.569 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:36.565+0000 7f8672d9d640 1 -- 172.21.15.78:0/4094335551 shutdown_connections 2023-11-28T20:00:36.569 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:36.565+0000 7f8672d9d640 1 -- 172.21.15.78:0/4094335551 wait complete. 2023-11-28T20:00:36.569 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:36.565+0000 7f8672d9d640 1 Processor -- start 2023-11-28T20:00:36.570 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:36.565+0000 7f8672d9d640 1 -- start start 2023-11-28T20:00:36.571 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:36.565+0000 7f8672d9d640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f866c06d840 0x7f866c1f0810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:36.571 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:36.565+0000 7f8672d9d640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f866c14f850 0x7f866c15b480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:36.571 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:36.565+0000 7f8672d9d640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f866c14fc30 0x7f866c071ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:36.571 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:36.565+0000 7f8672d9d640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f866c0704c0 con 0x7f866c14f850 2023-11-28T20:00:36.573 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:36.565+0000 7f8672d9d640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f866c0715b0 con 0x7f866c06d840 2023-11-28T20:00:36.573 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:36.565+0000 7f8672d9d640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f866c071850 con 0x7f866c14fc30 2023-11-28T20:00:36.573 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:36.565+0000 7f866bfff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f866c14f850 0x7f866c15b480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:36.573 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:36.565+0000 7f866bfff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f866c14f850 0x7f866c15b480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:58086/0 (socket says 172.21.15.78:58086) 2023-11-28T20:00:36.573 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:36.565+0000 7f866bfff640 1 -- 172.21.15.78:0/307286276 learned_addr learned my addr 172.21.15.78:0/307286276 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T20:00:36.573 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:36.565+0000 7f867133a640 1 --2- 172.21.15.78:0/307286276 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f866c14fc30 0x7f866c071ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:36.574 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:36.565+0000 7f8670b39640 1 --2- 172.21.15.78:0/307286276 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f866c06d840 0x7f866c1f0810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:36.574 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:36.565+0000 7f866bfff640 1 -- 172.21.15.78:0/307286276 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f866c14fc30 msgr2=0x7f866c071ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:00:36.574 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:36.565+0000 7f866bfff640 1 --2- 172.21.15.78:0/307286276 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f866c14fc30 0x7f866c071ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:36.574 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:36.565+0000 7f866bfff640 1 -- 172.21.15.78:0/307286276 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f866c06d840 msgr2=0x7f866c1f0810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:00:36.574 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:36.565+0000 7f866bfff640 1 --2- 172.21.15.78:0/307286276 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f866c06d840 0x7f866c1f0810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:36.574 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:36.565+0000 7f866bfff640 1 -- 172.21.15.78:0/307286276 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86600094d0 con 0x7f866c14f850 2023-11-28T20:00:36.574 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:36.565+0000 7f867133a640 1 --2- 172.21.15.78:0/307286276 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f866c14fc30 0x7f866c071ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T20:00:36.574 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:36.565+0000 7f8670b39640 1 --2- 172.21.15.78:0/307286276 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f866c06d840 0x7f866c1f0810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T20:00:36.574 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:36.569+0000 7f866bfff640 1 --2- 172.21.15.78:0/307286276 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f866c14f850 0x7f866c15b480 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f865800c7f0 tx=0x7f865800ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:00:36.574 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:36.569+0000 7f86697fa640 1 -- 172.21.15.78:0/307286276 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8658007820 con 0x7f866c14f850 2023-11-28T20:00:36.574 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:36.569+0000 7f86697fa640 1 -- 172.21.15.78:0/307286276 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8658007980 con 0x7f866c14f850 2023-11-28T20:00:36.575 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:36.569+0000 7f86697fa640 1 -- 172.21.15.78:0/307286276 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8658007d30 con 0x7f866c14f850 2023-11-28T20:00:36.575 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:36.569+0000 7f8672d9d640 1 -- 172.21.15.78:0/307286276 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f866c070120 con 0x7f866c14f850 2023-11-28T20:00:36.575 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:36.569+0000 7f8672d9d640 1 -- 172.21.15.78:0/307286276 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f866c1508d0 con 0x7f866c14f850 2023-11-28T20:00:36.575 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:36.569+0000 7f8672d9d640 1 -- 172.21.15.78:0/307286276 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f866c0719c0 con 0x7f866c14f850 2023-11-28T20:00:36.575 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:36.569+0000 7f86697fa640 1 -- 172.21.15.78:0/307286276 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f86580113f0 con 0x7f866c14f850 2023-11-28T20:00:36.576 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:36.569+0000 7f86697fa640 1 --2- 172.21.15.78:0/307286276 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f8650066470 0x7f8650068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:36.576 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:36.569+0000 7f86697fa640 1 -- 172.21.15.78:0/307286276 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 6885+0+0 (secure 0 0 0) 0x7f8658084400 con 0x7f866c14f850 2023-11-28T20:00:36.576 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:36.569+0000 7f8670b39640 1 --2- 172.21.15.78:0/307286276 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f8650066470 0x7f8650068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:36.576 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:36.573+0000 7f8670b39640 1 --2- 172.21.15.78:0/307286276 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f8650066470 0x7f8650068930 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f86600ae000 tx=0x7f8660008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:00:36.579 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:36.573+0000 7f86697fa640 1 -- 172.21.15.78:0/307286276 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f866c0719c0 con 0x7f866c14f850 2023-11-28T20:00:36.729 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:36.725+0000 7f8672d9d640 1 -- 172.21.15.78:0/307286276 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f866c0719c0 con 0x7f866c14f850 2023-11-28T20:00:36.730 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:36.725+0000 7f86697fa640 1 -- 172.21.15.78:0/307286276 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v44) v1 ==== 93+0+10 (secure 0 0 0) 0x7f866c0719c0 con 0x7f866c14f850 2023-11-28T20:00:36.730 INFO:teuthology.orchestra.run.smithi078.stdout:pg_num: 1 2023-11-28T20:00:36.732 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:36.729+0000 7f8672d9d640 1 -- 172.21.15.78:0/307286276 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f8650066470 msgr2=0x7f8650068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:00:36.732 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:36.729+0000 7f8672d9d640 1 --2- 172.21.15.78:0/307286276 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f8650066470 0x7f8650068930 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f86600ae000 tx=0x7f8660008040 comp rx=0 tx=0).stop 2023-11-28T20:00:36.732 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:36.729+0000 7f8672d9d640 1 -- 172.21.15.78:0/307286276 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f866c14f850 msgr2=0x7f866c15b480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:00:36.732 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:36.729+0000 7f8672d9d640 1 --2- 172.21.15.78:0/307286276 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f866c14f850 0x7f866c15b480 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f865800c7f0 tx=0x7f865800ccb0 comp rx=0 tx=0).stop 2023-11-28T20:00:36.733 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:36.729+0000 7f8672d9d640 1 -- 172.21.15.78:0/307286276 shutdown_connections 2023-11-28T20:00:36.733 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:36.729+0000 7f8672d9d640 1 --2- 172.21.15.78:0/307286276 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f8650066470 0x7f8650068930 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:36.733 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:36.729+0000 7f8672d9d640 1 --2- 172.21.15.78:0/307286276 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f866c14fc30 0x7f866c071ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:36.733 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:36.729+0000 7f8672d9d640 1 --2- 172.21.15.78:0/307286276 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f866c14f850 0x7f866c15b480 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:36.733 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:36.729+0000 7f8672d9d640 1 --2- 172.21.15.78:0/307286276 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f866c06d840 0x7f866c1f0810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:36.734 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:36.729+0000 7f8672d9d640 1 -- 172.21.15.78:0/307286276 >> 172.21.15.78:0/307286276 conn(0x7f866c0c59f0 msgr2=0x7f866c0c3cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:00:36.734 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:36.729+0000 7f8672d9d640 1 -- 172.21.15.78:0/307286276 shutdown_connections 2023-11-28T20:00:36.734 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:36.729+0000 7f8672d9d640 1 -- 172.21.15.78:0/307286276 wait complete. 2023-11-28T20:00:36.751 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-28T20:00:36.894 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:36.889+0000 7fb9e649c640 1 Processor -- start 2023-11-28T20:00:36.894 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:36.889+0000 7fb9e649c640 1 -- start start 2023-11-28T20:00:36.896 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:36.889+0000 7fb9e649c640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb9e014e2a0 0x7fb9e01516a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:36.896 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:36.889+0000 7fb9e649c640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fb9e00a9460 0x7fb9e00c4180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:36.896 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:36.889+0000 7fb9e649c640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb9e0151210 con 0x7fb9e00a98e0 2023-11-28T20:00:36.896 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:36.889+0000 7fb9e649c640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb9e014e680 con 0x7fb9e00a9460 2023-11-28T20:00:36.897 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:36.889+0000 7fb9e649c640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb9e0150be0 con 0x7fb9e014e2a0 2023-11-28T20:00:36.897 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:36.893+0000 7fb9df7fe640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fb9e00a9460 0x7fb9e00c4180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:36.897 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:36.893+0000 7fb9df7fe640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fb9e00a9460 0x7fb9e00c4180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:58092/0 (socket says 172.21.15.78:58092) 2023-11-28T20:00:36.897 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:36.893+0000 7fb9df7fe640 1 -- 172.21.15.78:0/1446858471 learned_addr learned my addr 172.21.15.78:0/1446858471 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T20:00:36.897 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:36.893+0000 7fb9dffff640 1 --2- 172.21.15.78:0/1446858471 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb9e014e2a0 0x7fb9e01516a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:36.897 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:36.893+0000 7fb9df7fe640 1 -- 172.21.15.78:0/1446858471 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb9e014e2a0 msgr2=0x7fb9e01516a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:00:36.897 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:36.893+0000 7fb9df7fe640 1 --2- 172.21.15.78:0/1446858471 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb9e014e2a0 0x7fb9e01516a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:36.897 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:36.893+0000 7fb9df7fe640 1 -- 172.21.15.78:0/1446858471 >> v1:172.21.15.78:6789/0 conn(0x7fb9e00a98e0 legacy=0x7fb9e006bc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:00:36.898 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:36.893+0000 7fb9df7fe640 1 -- 172.21.15.78:0/1446858471 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9e00c53c0 con 0x7fb9e00a9460 2023-11-28T20:00:36.899 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:36.893+0000 7fb9df7fe640 1 --2- 172.21.15.78:0/1446858471 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb9e00a9460 0x7fb9e00c4180 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7fb9d4006fd0 tx=0x7fb9d401e9d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5dc0cf6443ddc751 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:00:36.899 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:36.893+0000 7fb9deffd640 1 -- 172.21.15.78:0/1446858471 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9d4004230 con 0x7fb9e00a9460 2023-11-28T20:00:36.899 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:36.893+0000 7fb9deffd640 1 -- 172.21.15.78:0/1446858471 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb9d40ab070 con 0x7fb9e00a9460 2023-11-28T20:00:36.899 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:36.893+0000 7fb9deffd640 1 -- 172.21.15.78:0/1446858471 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9d40a7730 con 0x7fb9e00a9460 2023-11-28T20:00:36.900 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:36.897+0000 7fb9e649c640 1 -- 172.21.15.78:0/1446858471 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb9e00a9460 msgr2=0x7fb9e00c4180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:00:36.900 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:36.897+0000 7fb9e649c640 1 --2- 172.21.15.78:0/1446858471 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb9e00a9460 0x7fb9e00c4180 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7fb9d4006fd0 tx=0x7fb9d401e9d0 comp rx=0 tx=0).stop 2023-11-28T20:00:36.901 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:36.897+0000 7fb9e649c640 1 -- 172.21.15.78:0/1446858471 shutdown_connections 2023-11-28T20:00:36.901 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:36.897+0000 7fb9e649c640 1 --2- 172.21.15.78:0/1446858471 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb9e00a9460 0x7fb9e00c4180 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:36.901 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:36.897+0000 7fb9e649c640 1 --2- 172.21.15.78:0/1446858471 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb9e014e2a0 0x7fb9e01516a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:36.901 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:36.897+0000 7fb9e649c640 1 -- 172.21.15.78:0/1446858471 >> 172.21.15.78:0/1446858471 conn(0x7fb9e00c59f0 msgr2=0x7fb9e00c5e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:00:36.901 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:36.897+0000 7fb9e649c640 1 -- 172.21.15.78:0/1446858471 shutdown_connections 2023-11-28T20:00:36.902 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:36.897+0000 7fb9e649c640 1 -- 172.21.15.78:0/1446858471 wait complete. 2023-11-28T20:00:36.902 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:36.897+0000 7fb9e649c640 1 Processor -- start 2023-11-28T20:00:36.902 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:36.897+0000 7fb9e649c640 1 -- start start 2023-11-28T20:00:36.904 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:36.897+0000 7fb9e649c640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb9e00a9460 0x7fb9e00c0ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:36.904 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:36.897+0000 7fb9e649c640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb9e00a98e0 0x7fb9e01f10d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:36.904 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:36.897+0000 7fb9e649c640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb9e014e2a0 0x7fb9e0159ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:36.905 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:36.897+0000 7fb9e649c640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9e00c2610 con 0x7fb9e00a98e0 2023-11-28T20:00:36.905 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:36.897+0000 7fb9e649c640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9e01f1610 con 0x7fb9e014e2a0 2023-11-28T20:00:36.905 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:36.897+0000 7fb9e649c640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb9e0072630 con 0x7fb9e00a9460 2023-11-28T20:00:36.905 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:36.897+0000 7fb9df7fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb9e00a98e0 0x7fb9e01f10d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:36.905 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:36.897+0000 7fb9df7fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb9e00a98e0 0x7fb9e01f10d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:58100/0 (socket says 172.21.15.78:58100) 2023-11-28T20:00:36.906 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:36.897+0000 7fb9df7fe640 1 -- 172.21.15.78:0/2582575675 learned_addr learned my addr 172.21.15.78:0/2582575675 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T20:00:36.906 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:36.897+0000 7fb9df7fe640 1 -- 172.21.15.78:0/2582575675 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb9e00a9460 msgr2=0x7fb9e00c0ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:00:36.906 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:36.897+0000 7fb9df7fe640 1 --2- 172.21.15.78:0/2582575675 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb9e00a9460 0x7fb9e00c0ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:36.907 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:36.897+0000 7fb9df7fe640 1 -- 172.21.15.78:0/2582575675 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb9e014e2a0 msgr2=0x7fb9e0159ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:00:36.907 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:36.897+0000 7fb9df7fe640 1 --2- 172.21.15.78:0/2582575675 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb9e014e2a0 0x7fb9e0159ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:36.907 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:36.897+0000 7fb9df7fe640 1 -- 172.21.15.78:0/2582575675 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9d400b780 con 0x7fb9e00a98e0 2023-11-28T20:00:36.907 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:36.901+0000 7fb9df7fe640 1 --2- 172.21.15.78:0/2582575675 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb9e00a98e0 0x7fb9e01f10d0 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7fb9d4006fd0 tx=0x7fb9d401b770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:00:36.908 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:36.901+0000 7fb9dcff9640 1 -- 172.21.15.78:0/2582575675 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9d40a8ad0 con 0x7fb9e00a98e0 2023-11-28T20:00:36.908 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:36.901+0000 7fb9dcff9640 1 -- 172.21.15.78:0/2582575675 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb9d40a8c30 con 0x7fb9e00a98e0 2023-11-28T20:00:36.908 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:36.901+0000 7fb9e649c640 1 -- 172.21.15.78:0/2582575675 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb9e00c2330 con 0x7fb9e00a98e0 2023-11-28T20:00:36.908 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:36.901+0000 7fb9dcff9640 1 -- 172.21.15.78:0/2582575675 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9d4003620 con 0x7fb9e00a98e0 2023-11-28T20:00:36.908 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:36.901+0000 7fb9e649c640 1 -- 172.21.15.78:0/2582575675 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb9e00c06f0 con 0x7fb9e00a98e0 2023-11-28T20:00:36.909 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:36.901+0000 7fb9e649c640 1 -- 172.21.15.78:0/2582575675 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb9e00c0270 con 0x7fb9e00a98e0 2023-11-28T20:00:36.909 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:36.901+0000 7fb9dcff9640 1 -- 172.21.15.78:0/2582575675 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fb9d4003780 con 0x7fb9e00a98e0 2023-11-28T20:00:36.909 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:36.901+0000 7fb9dcff9640 1 --2- 172.21.15.78:0/2582575675 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fb9cc066470 0x7fb9cc068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:36.909 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:36.901+0000 7fb9dcff9640 1 -- 172.21.15.78:0/2582575675 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 6885+0+0 (secure 0 0 0) 0x7fb9d411eb10 con 0x7fb9e00a98e0 2023-11-28T20:00:36.910 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:36.901+0000 7fb9dffff640 1 --2- 172.21.15.78:0/2582575675 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fb9cc066470 0x7fb9cc068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:36.910 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:36.901+0000 7fb9dffff640 1 --2- 172.21.15.78:0/2582575675 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fb9cc066470 0x7fb9cc068930 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fb9d000b850 tx=0x7fb9d0008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:00:36.910 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:36.905+0000 7fb9dcff9640 1 -- 172.21.15.78:0/2582575675 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fb9e00c0270 con 0x7fb9e00a98e0 2023-11-28T20:00:37.062 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:37.057+0000 7fb9e649c640 1 -- 172.21.15.78:0/2582575675 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fb9e00c0270 con 0x7fb9e00a98e0 2023-11-28T20:00:37.062 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:37.057+0000 7fb9dcff9640 1 -- 172.21.15.78:0/2582575675 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v44) v1 ==== 104+0+11 (secure 0 0 0) 0x7fb9e00c0270 con 0x7fb9e00a98e0 2023-11-28T20:00:37.062 INFO:teuthology.orchestra.run.smithi078.stdout:pg_num: 32 2023-11-28T20:00:37.064 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:37.061+0000 7fb9e649c640 1 -- 172.21.15.78:0/2582575675 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fb9cc066470 msgr2=0x7fb9cc068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:00:37.064 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:37.061+0000 7fb9e649c640 1 --2- 172.21.15.78:0/2582575675 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fb9cc066470 0x7fb9cc068930 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fb9d000b850 tx=0x7fb9d0008040 comp rx=0 tx=0).stop 2023-11-28T20:00:37.064 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:37.061+0000 7fb9e649c640 1 -- 172.21.15.78:0/2582575675 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb9e00a98e0 msgr2=0x7fb9e01f10d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:00:37.064 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:37.061+0000 7fb9e649c640 1 --2- 172.21.15.78:0/2582575675 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb9e00a98e0 0x7fb9e01f10d0 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7fb9d4006fd0 tx=0x7fb9d401b770 comp rx=0 tx=0).stop 2023-11-28T20:00:37.065 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:37.061+0000 7fb9e649c640 1 -- 172.21.15.78:0/2582575675 shutdown_connections 2023-11-28T20:00:37.065 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:37.061+0000 7fb9e649c640 1 --2- 172.21.15.78:0/2582575675 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fb9cc066470 0x7fb9cc068930 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:37.065 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:37.061+0000 7fb9e649c640 1 --2- 172.21.15.78:0/2582575675 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb9e014e2a0 0x7fb9e0159ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:37.065 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:37.061+0000 7fb9e649c640 1 --2- 172.21.15.78:0/2582575675 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb9e00a98e0 0x7fb9e01f10d0 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:37.065 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:37.061+0000 7fb9e649c640 1 --2- 172.21.15.78:0/2582575675 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb9e00a9460 0x7fb9e00c0ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:37.065 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:37.061+0000 7fb9e649c640 1 -- 172.21.15.78:0/2582575675 >> 172.21.15.78:0/2582575675 conn(0x7fb9e00c59f0 msgr2=0x7fb9e00aac10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:00:37.065 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:37.061+0000 7fb9e649c640 1 -- 172.21.15.78:0/2582575675 shutdown_connections 2023-11-28T20:00:37.065 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:37.061+0000 7fb9e649c640 1 -- 172.21.15.78:0/2582575675 wait complete. 2023-11-28T20:00:37.083 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-28T20:00:37.223 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:37.217+0000 7fc6b13d1640 1 Processor -- start 2023-11-28T20:00:37.223 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:37.217+0000 7fc6b13d1640 1 -- start start 2023-11-28T20:00:37.225 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:37.221+0000 7fc6b13d1640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fc6ac14f850 0x7fc6ac0aacf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:37.225 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:37.221+0000 7fc6b13d1640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fc6ac06d840 0x7fc6ac0c43e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:37.225 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:37.221+0000 7fc6b13d1640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc6ac152910 con 0x7fc6ac14fc30 2023-11-28T20:00:37.225 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:37.221+0000 7fc6b13d1640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc6ac0c2240 con 0x7fc6ac06d840 2023-11-28T20:00:37.226 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:37.221+0000 7fc6b13d1640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc6ac152bf0 con 0x7fc6ac14f850 2023-11-28T20:00:37.226 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:37.221+0000 7fc6ab7fe640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fc6ac06d840 0x7fc6ac0c43e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:37.226 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:37.221+0000 7fc6ab7fe640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fc6ac06d840 0x7fc6ac0c43e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:58114/0 (socket says 172.21.15.78:58114) 2023-11-28T20:00:37.226 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:37.221+0000 7fc6ab7fe640 1 -- 172.21.15.78:0/1282691091 learned_addr learned my addr 172.21.15.78:0/1282691091 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T20:00:37.226 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:37.221+0000 7fc6aaffd640 1 --2- 172.21.15.78:0/1282691091 >> v2:172.21.15.179:3300/0 conn(0x7fc6ac14f850 0x7fc6ac0aacf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:37.226 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:37.221+0000 7fc6ab7fe640 1 -- 172.21.15.78:0/1282691091 >> v2:172.21.15.179:3300/0 conn(0x7fc6ac14f850 msgr2=0x7fc6ac0aacf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:00:37.226 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:37.221+0000 7fc6ab7fe640 1 --2- 172.21.15.78:0/1282691091 >> v2:172.21.15.179:3300/0 conn(0x7fc6ac14f850 0x7fc6ac0aacf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:37.226 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:37.221+0000 7fc6ab7fe640 1 -- 172.21.15.78:0/1282691091 >> v1:172.21.15.78:6789/0 conn(0x7fc6ac14fc30 legacy=0x7fc6ac0c3cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:00:37.226 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:37.221+0000 7fc6ab7fe640 1 -- 172.21.15.78:0/1282691091 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6ac152ed0 con 0x7fc6ac06d840 2023-11-28T20:00:37.226 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:37.221+0000 7fc6aa7fc640 1 -- 172.21.15.78:0/1282691091 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2156056799 0 0) 0x7fc6ac152910 con 0x7fc6ac14fc30 2023-11-28T20:00:37.228 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:37.225+0000 7fc6ab7fe640 1 --2- 172.21.15.78:0/1282691091 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc6ac06d840 0x7fc6ac0c43e0 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7fc6ac066f50 tx=0x7fc6a401c500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f473875147a79ef1 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:00:37.228 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:37.225+0000 7fc6aa7fc640 1 -- 172.21.15.78:0/1282691091 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6a40aa680 con 0x7fc6ac06d840 2023-11-28T20:00:37.228 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:37.225+0000 7fc6aa7fc640 1 -- 172.21.15.78:0/1282691091 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc6a40aa7e0 con 0x7fc6ac06d840 2023-11-28T20:00:37.228 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:37.225+0000 7fc6aa7fc640 1 -- 172.21.15.78:0/1282691091 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6a40aab70 con 0x7fc6ac06d840 2023-11-28T20:00:37.229 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:37.225+0000 7fc6b13d1640 1 -- 172.21.15.78:0/1282691091 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc6ac06d840 msgr2=0x7fc6ac0c43e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:00:37.229 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:37.225+0000 7fc6b13d1640 1 --2- 172.21.15.78:0/1282691091 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc6ac06d840 0x7fc6ac0c43e0 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7fc6ac066f50 tx=0x7fc6a401c500 comp rx=0 tx=0).stop 2023-11-28T20:00:37.229 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:37.225+0000 7fc6b13d1640 1 -- 172.21.15.78:0/1282691091 shutdown_connections 2023-11-28T20:00:37.230 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:37.225+0000 7fc6b13d1640 1 --2- 172.21.15.78:0/1282691091 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc6ac06d840 0x7fc6ac0c43e0 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:37.230 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:37.225+0000 7fc6b13d1640 1 --2- 172.21.15.78:0/1282691091 >> v2:172.21.15.179:3300/0 conn(0x7fc6ac14f850 0x7fc6ac0aacf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:37.230 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:37.225+0000 7fc6b13d1640 1 -- 172.21.15.78:0/1282691091 >> 172.21.15.78:0/1282691091 conn(0x7fc6ac0c59f0 msgr2=0x7fc6ac0c5e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:00:37.230 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:37.225+0000 7fc6b13d1640 1 -- 172.21.15.78:0/1282691091 shutdown_connections 2023-11-28T20:00:37.230 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:37.225+0000 7fc6b13d1640 1 -- 172.21.15.78:0/1282691091 wait complete. 2023-11-28T20:00:37.230 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:37.225+0000 7fc6b13d1640 1 Processor -- start 2023-11-28T20:00:37.231 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:37.225+0000 7fc6b13d1640 1 -- start start 2023-11-28T20:00:37.233 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:37.229+0000 7fc6b13d1640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc6ac06d840 0x7fc6ac14c0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:37.233 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:37.229+0000 7fc6b13d1640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc6ac14f850 0x7fc6ac072160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:37.233 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:37.229+0000 7fc6b13d1640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc6ac14fc30 0x7fc6ac1ee290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:37.233 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:37.229+0000 7fc6b13d1640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6ac14efb0 con 0x7fc6ac06d840 2023-11-28T20:00:37.233 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:37.229+0000 7fc6b13d1640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6ac1ef1d0 con 0x7fc6ac14fc30 2023-11-28T20:00:37.233 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:37.229+0000 7fc6b13d1640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6ac14f200 con 0x7fc6ac14f850 2023-11-28T20:00:37.233 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:37.229+0000 7fc6aaffd640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc6ac06d840 0x7fc6ac14c0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:37.233 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:37.229+0000 7fc6aaffd640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc6ac06d840 0x7fc6ac14c0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:58126/0 (socket says 172.21.15.78:58126) 2023-11-28T20:00:37.233 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:37.229+0000 7fc6aaffd640 1 -- 172.21.15.78:0/1246706689 learned_addr learned my addr 172.21.15.78:0/1246706689 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T20:00:37.233 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:37.229+0000 7fc6ab7fe640 1 --2- 172.21.15.78:0/1246706689 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc6ac14fc30 0x7fc6ac1ee290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:37.233 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:37.229+0000 7fc6a27fc640 1 --2- 172.21.15.78:0/1246706689 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc6ac14f850 0x7fc6ac072160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:37.234 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:37.229+0000 7fc6aaffd640 1 -- 172.21.15.78:0/1246706689 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc6ac14f850 msgr2=0x7fc6ac072160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:00:37.234 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:37.229+0000 7fc6aaffd640 1 --2- 172.21.15.78:0/1246706689 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc6ac14f850 0x7fc6ac072160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:37.234 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:37.229+0000 7fc6aaffd640 1 -- 172.21.15.78:0/1246706689 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc6ac14fc30 msgr2=0x7fc6ac1ee290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:00:37.234 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:37.229+0000 7fc6aaffd640 1 --2- 172.21.15.78:0/1246706689 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc6ac14fc30 0x7fc6ac1ee290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:37.234 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:37.229+0000 7fc6aaffd640 1 -- 172.21.15.78:0/1246706689 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6a40094d0 con 0x7fc6ac06d840 2023-11-28T20:00:37.235 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:37.229+0000 7fc6aaffd640 1 --2- 172.21.15.78:0/1246706689 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc6ac06d840 0x7fc6ac14c0b0 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7fc69c00d800 tx=0x7fc69c00dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:00:37.235 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:37.229+0000 7fc6a3fff640 1 -- 172.21.15.78:0/1246706689 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc69c00b6c0 con 0x7fc6ac06d840 2023-11-28T20:00:37.235 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:37.229+0000 7fc6a3fff640 1 -- 172.21.15.78:0/1246706689 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc69c00b820 con 0x7fc6ac06d840 2023-11-28T20:00:37.235 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:37.229+0000 7fc6a3fff640 1 -- 172.21.15.78:0/1246706689 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc69c00bb90 con 0x7fc6ac06d840 2023-11-28T20:00:37.235 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:37.229+0000 7fc6b13d1640 1 -- 172.21.15.78:0/1246706689 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc6ac1eeef0 con 0x7fc6ac06d840 2023-11-28T20:00:37.236 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:37.229+0000 7fc6b13d1640 1 -- 172.21.15.78:0/1246706689 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc6ac148950 con 0x7fc6ac06d840 2023-11-28T20:00:37.236 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:37.229+0000 7fc6b13d1640 1 -- 172.21.15.78:0/1246706689 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc6ac0c68d0 con 0x7fc6ac06d840 2023-11-28T20:00:37.236 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:37.229+0000 7fc6a3fff640 1 -- 172.21.15.78:0/1246706689 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fc69c00bcf0 con 0x7fc6ac06d840 2023-11-28T20:00:37.236 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:37.233+0000 7fc6a3fff640 1 --2- 172.21.15.78:0/1246706689 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fc68c0664a0 0x7fc68c068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:37.236 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:37.233+0000 7fc6a3fff640 1 -- 172.21.15.78:0/1246706689 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 6885+0+0 (secure 0 0 0) 0x7fc69c084620 con 0x7fc6ac06d840 2023-11-28T20:00:37.237 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:37.233+0000 7fc6a27fc640 1 --2- 172.21.15.78:0/1246706689 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fc68c0664a0 0x7fc68c068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:37.237 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:37.233+0000 7fc6a27fc640 1 --2- 172.21.15.78:0/1246706689 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fc68c0664a0 0x7fc68c068960 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fc6ac1e8b60 tx=0x7fc694009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:00:37.240 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:37.237+0000 7fc6a3fff640 1 -- 172.21.15.78:0/1246706689 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fc69c051740 con 0x7fc6ac06d840 2023-11-28T20:00:37.389 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:37.385+0000 7fc6b13d1640 1 -- 172.21.15.78:0/1246706689 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fc6ac067630 con 0x7fc6ac06d840 2023-11-28T20:00:37.389 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:37.385+0000 7fc6a3fff640 1 -- 172.21.15.78:0/1246706689 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v44) v1 ==== 100+0+11 (secure 0 0 0) 0x7fc69c054d60 con 0x7fc6ac06d840 2023-11-28T20:00:37.390 INFO:teuthology.orchestra.run.smithi078.stdout:pg_num: 64 2023-11-28T20:00:37.391 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:37.385+0000 7fc6b13d1640 1 -- 172.21.15.78:0/1246706689 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fc68c0664a0 msgr2=0x7fc68c068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:00:37.391 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:37.385+0000 7fc6b13d1640 1 --2- 172.21.15.78:0/1246706689 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fc68c0664a0 0x7fc68c068960 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fc6ac1e8b60 tx=0x7fc694009040 comp rx=0 tx=0).stop 2023-11-28T20:00:37.392 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:37.385+0000 7fc6b13d1640 1 -- 172.21.15.78:0/1246706689 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc6ac06d840 msgr2=0x7fc6ac14c0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:00:37.392 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:37.385+0000 7fc6b13d1640 1 --2- 172.21.15.78:0/1246706689 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc6ac06d840 0x7fc6ac14c0b0 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7fc69c00d800 tx=0x7fc69c00dcc0 comp rx=0 tx=0).stop 2023-11-28T20:00:37.392 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:37.385+0000 7fc6b13d1640 1 -- 172.21.15.78:0/1246706689 shutdown_connections 2023-11-28T20:00:37.392 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:37.385+0000 7fc6b13d1640 1 --2- 172.21.15.78:0/1246706689 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fc68c0664a0 0x7fc68c068960 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:37.392 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:37.385+0000 7fc6b13d1640 1 --2- 172.21.15.78:0/1246706689 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc6ac14f850 0x7fc6ac072160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:37.392 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:37.385+0000 7fc6b13d1640 1 --2- 172.21.15.78:0/1246706689 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc6ac14fc30 0x7fc6ac1ee290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:37.392 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:37.385+0000 7fc6b13d1640 1 --2- 172.21.15.78:0/1246706689 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc6ac06d840 0x7fc6ac14c0b0 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:37.392 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:37.385+0000 7fc6b13d1640 1 -- 172.21.15.78:0/1246706689 >> 172.21.15.78:0/1246706689 conn(0x7fc6ac0c59f0 msgr2=0x7fc6ac150330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:00:37.392 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:37.385+0000 7fc6b13d1640 1 -- 172.21.15.78:0/1246706689 shutdown_connections 2023-11-28T20:00:37.392 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:37.385+0000 7fc6b13d1640 1 -- 172.21.15.78:0/1246706689 wait complete. 2023-11-28T20:00:37.411 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs2_metadata pg_num 2023-11-28T20:00:37.550 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:37.545+0000 7fe125c17640 1 Processor -- start 2023-11-28T20:00:37.550 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:37.545+0000 7fe125c17640 1 -- start start 2023-11-28T20:00:37.551 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:37.545+0000 7fe125c17640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fe1201516a0 0x7fe1200c4180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:37.551 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:37.545+0000 7fe125c17640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe120151210 con 0x7fe12014e2a0 2023-11-28T20:00:37.552 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:37.545+0000 7fe125c17640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe12014e680 con 0x7fe1200c46c0 2023-11-28T20:00:37.552 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:37.545+0000 7fe125c17640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe120151b50 con 0x7fe1201516a0 2023-11-28T20:00:37.552 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:37.545+0000 7fe11f7fe640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7fe12014e2a0 0x7fe1200a9460 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:34044/0 (socket says 172.21.15.78:34044) 2023-11-28T20:00:37.552 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:37.545+0000 7fe11f7fe640 1 -- 172.21.15.78:0/1316890363 learned_addr learned my addr 172.21.15.78:0/1316890363 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-11-28T20:00:37.552 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:37.549+0000 7fe11effd640 1 --2- 172.21.15.78:0/1316890363 >> v2:172.21.15.179:3300/0 conn(0x7fe1201516a0 0x7fe1200c4180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:37.553 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:37.549+0000 7fe11e7fc640 1 -- 172.21.15.78:0/1316890363 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2096626544 0 0) 0x7fe120151210 con 0x7fe12014e2a0 2023-11-28T20:00:37.553 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:37.549+0000 7fe11e7fc640 1 -- 172.21.15.78:0/1316890363 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe108003450 con 0x7fe12014e2a0 2023-11-28T20:00:37.553 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:37.549+0000 7fe11effd640 1 -- 172.21.15.78:0/1316890363 >> v1:172.21.15.179:6789/0 conn(0x7fe1200c46c0 legacy=0x7fe12006bc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:00:37.553 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:37.549+0000 7fe11effd640 1 -- 172.21.15.78:0/1316890363 >> v1:172.21.15.78:6789/0 conn(0x7fe12014e2a0 legacy=0x7fe1200a9460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:00:37.553 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:37.549+0000 7fe11effd640 1 -- 172.21.15.78:0/1316890363 --> v2:172.21.15.179:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1200a9b70 con 0x7fe1201516a0 2023-11-28T20:00:37.555 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:37.549+0000 7fe11effd640 1 --2- 172.21.15.78:0/1316890363 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe1201516a0 0x7fe1200c4180 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fe1140097c0 tx=0x7fe11401c480 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8d05afae2c8d2e7e server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:00:37.555 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:37.549+0000 7fe11e7fc640 1 -- 172.21.15.78:0/1316890363 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1140ac640 con 0x7fe1201516a0 2023-11-28T20:00:37.556 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:37.553+0000 7fe11e7fc640 1 -- 172.21.15.78:0/1316890363 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe1140ac7a0 con 0x7fe1201516a0 2023-11-28T20:00:37.556 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:37.553+0000 7fe11e7fc640 1 -- 172.21.15.78:0/1316890363 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1140acb30 con 0x7fe1201516a0 2023-11-28T20:00:37.556 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:37.553+0000 7fe125c17640 1 -- 172.21.15.78:0/1316890363 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe1201516a0 msgr2=0x7fe1200c4180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:00:37.557 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:37.553+0000 7fe125c17640 1 --2- 172.21.15.78:0/1316890363 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe1201516a0 0x7fe1200c4180 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fe1140097c0 tx=0x7fe11401c480 comp rx=0 tx=0).stop 2023-11-28T20:00:37.557 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:37.553+0000 7fe125c17640 1 -- 172.21.15.78:0/1316890363 shutdown_connections 2023-11-28T20:00:37.557 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:37.553+0000 7fe125c17640 1 --2- 172.21.15.78:0/1316890363 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe1201516a0 0x7fe1200c4180 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:37.557 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:37.553+0000 7fe125c17640 1 -- 172.21.15.78:0/1316890363 >> 172.21.15.78:0/1316890363 conn(0x7fe1200c59f0 msgr2=0x7fe1200c5e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:00:37.557 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:37.553+0000 7fe125c17640 1 -- 172.21.15.78:0/1316890363 shutdown_connections 2023-11-28T20:00:37.557 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:37.553+0000 7fe125c17640 1 -- 172.21.15.78:0/1316890363 wait complete. 2023-11-28T20:00:37.557 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:37.553+0000 7fe125c17640 1 Processor -- start 2023-11-28T20:00:37.558 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:37.553+0000 7fe125c17640 1 -- start start 2023-11-28T20:00:37.559 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:37.553+0000 7fe125c17640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe1200c46c0 0x7fe1201ed7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:37.559 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:37.553+0000 7fe125c17640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe12014e2a0 0x7fe12014b580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:37.559 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:37.553+0000 7fe125c17640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe1201516a0 0x7fe120147bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:37.559 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:37.553+0000 7fe125c17640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1201edd10 con 0x7fe12014e2a0 2023-11-28T20:00:37.559 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:37.553+0000 7fe125c17640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe120148850 con 0x7fe1200c46c0 2023-11-28T20:00:37.560 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:37.553+0000 7fe125c17640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe120152590 con 0x7fe1201516a0 2023-11-28T20:00:37.560 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:37.553+0000 7fe11effd640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe12014e2a0 0x7fe12014b580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:37.560 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:37.553+0000 7fe11effd640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe12014e2a0 0x7fe12014b580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:58134/0 (socket says 172.21.15.78:58134) 2023-11-28T20:00:37.560 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:37.553+0000 7fe11effd640 1 -- 172.21.15.78:0/1066262853 learned_addr learned my addr 172.21.15.78:0/1066262853 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T20:00:37.560 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:37.553+0000 7fe11f7fe640 1 --2- 172.21.15.78:0/1066262853 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe1200c46c0 0x7fe1201ed7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:37.560 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:37.553+0000 7fe11ffff640 1 --2- 172.21.15.78:0/1066262853 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe1201516a0 0x7fe120147bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:37.561 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:37.557+0000 7fe11effd640 1 -- 172.21.15.78:0/1066262853 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe1201516a0 msgr2=0x7fe120147bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:00:37.561 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:37.557+0000 7fe11effd640 1 --2- 172.21.15.78:0/1066262853 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe1201516a0 0x7fe120147bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:37.561 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:37.557+0000 7fe11effd640 1 -- 172.21.15.78:0/1066262853 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe1200c46c0 msgr2=0x7fe1201ed7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:00:37.561 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:37.557+0000 7fe11effd640 1 --2- 172.21.15.78:0/1066262853 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe1200c46c0 0x7fe1201ed7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:37.561 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:37.557+0000 7fe11effd640 1 -- 172.21.15.78:0/1066262853 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe114009420 con 0x7fe12014e2a0 2023-11-28T20:00:37.561 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:37.557+0000 7fe11ffff640 1 --2- 172.21.15.78:0/1066262853 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe1201516a0 0x7fe120147bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T20:00:37.562 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:37.557+0000 7fe11effd640 1 --2- 172.21.15.78:0/1066262853 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe12014e2a0 0x7fe12014b580 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7fe114019090 tx=0x7fe114019220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:00:37.562 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:37.557+0000 7fe107fff640 1 -- 172.21.15.78:0/1066262853 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1140b6880 con 0x7fe12014e2a0 2023-11-28T20:00:37.562 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:37.557+0000 7fe107fff640 1 -- 172.21.15.78:0/1066262853 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe1140b6a00 con 0x7fe12014e2a0 2023-11-28T20:00:37.562 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:37.557+0000 7fe107fff640 1 -- 172.21.15.78:0/1066262853 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1140b6db0 con 0x7fe12014e2a0 2023-11-28T20:00:37.562 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:37.557+0000 7fe125c17640 1 -- 172.21.15.78:0/1066262853 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe120152830 con 0x7fe12014e2a0 2023-11-28T20:00:37.562 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:37.557+0000 7fe125c17640 1 -- 172.21.15.78:0/1066262853 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe1200c1d60 con 0x7fe12014e2a0 2023-11-28T20:00:37.562 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:37.557+0000 7fe125c17640 1 -- 172.21.15.78:0/1066262853 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe120067630 con 0x7fe12014e2a0 2023-11-28T20:00:37.563 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:37.557+0000 7fe107fff640 1 -- 172.21.15.78:0/1066262853 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fe1140b3040 con 0x7fe12014e2a0 2023-11-28T20:00:37.563 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:37.557+0000 7fe107fff640 1 --2- 172.21.15.78:0/1066262853 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fe10c066470 0x7fe10c068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:37.563 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:37.557+0000 7fe107fff640 1 -- 172.21.15.78:0/1066262853 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 6885+0+0 (secure 0 0 0) 0x7fe11411ea10 con 0x7fe12014e2a0 2023-11-28T20:00:37.563 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:37.557+0000 7fe11f7fe640 1 --2- 172.21.15.78:0/1066262853 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fe10c066470 0x7fe10c068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:37.564 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:37.561+0000 7fe11f7fe640 1 --2- 172.21.15.78:0/1066262853 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fe10c066470 0x7fe10c068930 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fe1100011f0 tx=0x7fe110007d40 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:00:37.567 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:37.561+0000 7fe107fff640 1 -- 172.21.15.78:0/1066262853 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fe1140eb9e0 con 0x7fe12014e2a0 2023-11-28T20:00:37.717 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:37.713+0000 7fe125c17640 1 -- 172.21.15.78:0/1066262853 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs2_metadata", "var": "pg_num"} v 0) v1 -- 0x7fe1200c4e90 con 0x7fe12014e2a0 2023-11-28T20:00:37.717 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:37.713+0000 7fe107fff640 1 -- 172.21.15.78:0/1066262853 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs2_metadata", "var": "pg_num"}]=0 v44) v1 ==== 105+0+11 (secure 0 0 0) 0x7fe1140bd0b0 con 0x7fe12014e2a0 2023-11-28T20:00:37.717 INFO:teuthology.orchestra.run.smithi078.stdout:pg_num: 32 2023-11-28T20:00:37.719 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:37.713+0000 7fe125c17640 1 -- 172.21.15.78:0/1066262853 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fe10c066470 msgr2=0x7fe10c068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:00:37.720 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:37.713+0000 7fe125c17640 1 --2- 172.21.15.78:0/1066262853 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fe10c066470 0x7fe10c068930 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fe1100011f0 tx=0x7fe110007d40 comp rx=0 tx=0).stop 2023-11-28T20:00:37.720 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:37.713+0000 7fe125c17640 1 -- 172.21.15.78:0/1066262853 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe12014e2a0 msgr2=0x7fe12014b580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:00:37.720 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:37.713+0000 7fe125c17640 1 --2- 172.21.15.78:0/1066262853 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe12014e2a0 0x7fe12014b580 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7fe114019090 tx=0x7fe114019220 comp rx=0 tx=0).stop 2023-11-28T20:00:37.720 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:37.713+0000 7fe125c17640 1 -- 172.21.15.78:0/1066262853 shutdown_connections 2023-11-28T20:00:37.720 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:37.713+0000 7fe125c17640 1 --2- 172.21.15.78:0/1066262853 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fe10c066470 0x7fe10c068930 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:37.720 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:37.713+0000 7fe125c17640 1 --2- 172.21.15.78:0/1066262853 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe1201516a0 0x7fe120147bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:37.720 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:37.713+0000 7fe125c17640 1 --2- 172.21.15.78:0/1066262853 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe12014e2a0 0x7fe12014b580 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:37.721 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:37.713+0000 7fe125c17640 1 --2- 172.21.15.78:0/1066262853 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe1200c46c0 0x7fe1201ed7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:37.721 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:37.713+0000 7fe125c17640 1 -- 172.21.15.78:0/1066262853 >> 172.21.15.78:0/1066262853 conn(0x7fe1200c59f0 msgr2=0x7fe12014c5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:00:37.721 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:37.713+0000 7fe125c17640 1 -- 172.21.15.78:0/1066262853 shutdown_connections 2023-11-28T20:00:37.721 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:37.713+0000 7fe125c17640 1 -- 172.21.15.78:0/1066262853 wait complete. 2023-11-28T20:00:37.738 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs2_data pg_num 2023-11-28T20:00:37.938 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:37.933+0000 7fb980b65640 1 Processor -- start 2023-11-28T20:00:37.938 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:37.933+0000 7fb980b65640 1 -- start start 2023-11-28T20:00:37.939 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:37.933+0000 7fb980b65640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb97c14b1e0 0x7fb97c0c1700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:37.939 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:37.933+0000 7fb980b65640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fb97c1548c0 0x7fb97c154d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:37.939 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:37.933+0000 7fb980b65640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb97c0a4e20 con 0x7fb97c0c5300 2023-11-28T20:00:37.939 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:37.933+0000 7fb980b65640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb97c0a50e0 con 0x7fb97c1548c0 2023-11-28T20:00:37.939 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:37.933+0000 7fb980b65640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb97c0c0f00 con 0x7fb97c14b1e0 2023-11-28T20:00:37.940 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:37.937+0000 7fb97ad9d640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fb97c1548c0 0x7fb97c154d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:37.940 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:37.937+0000 7fb97a59c640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb97c14b1e0 0x7fb97c0c1700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:37.941 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:37.937+0000 7fb97ad9d640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fb97c1548c0 0x7fb97c154d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.78:33820/0 (socket says 172.21.15.78:33820) 2023-11-28T20:00:37.941 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:37.937+0000 7fb97ad9d640 1 -- 172.21.15.78:0/3906683997 learned_addr learned my addr 172.21.15.78:0/3906683997 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T20:00:37.941 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:37.937+0000 7fb97a59c640 1 -- 172.21.15.78:0/3906683997 >> v2:172.21.15.179:3300/0 conn(0x7fb97c1548c0 msgr2=0x7fb97c154d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:00:37.941 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:37.937+0000 7fb97a59c640 1 --2- 172.21.15.78:0/3906683997 >> v2:172.21.15.179:3300/0 conn(0x7fb97c1548c0 0x7fb97c154d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:37.941 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:37.937+0000 7fb97a59c640 1 -- 172.21.15.78:0/3906683997 >> v1:172.21.15.179:6789/0 conn(0x7fb97c0c5300 legacy=0x7fb97c0a9c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:00:37.941 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:37.937+0000 7fb97a59c640 1 -- 172.21.15.78:0/3906683997 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb97c0c11e0 con 0x7fb97c14b1e0 2023-11-28T20:00:37.942 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:37.937+0000 7fb97ad9d640 1 --2- 172.21.15.78:0/3906683997 >> v2:172.21.15.179:3300/0 conn(0x7fb97c1548c0 0x7fb97c154d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T20:00:37.943 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:37.937+0000 7fb97a59c640 1 --2- 172.21.15.78:0/3906683997 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb97c14b1e0 0x7fb97c0c1700 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fb96c0097c0 tx=0x7fb96c01c480 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3fca87f0141c21c1 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:00:37.945 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:37.937+0000 7fb979d9b640 1 -- 172.21.15.78:0/3906683997 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb97c1558b0 con 0x7fb97c14b1e0 2023-11-28T20:00:37.945 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:37.941+0000 7fb979d9b640 1 -- 172.21.15.78:0/3906683997 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb96c0ad640 con 0x7fb97c14b1e0 2023-11-28T20:00:37.946 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:37.941+0000 7fb979d9b640 1 -- 172.21.15.78:0/3906683997 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb96c0ad9d0 con 0x7fb97c14b1e0 2023-11-28T20:00:37.946 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:37.941+0000 7fb980b65640 1 -- 172.21.15.78:0/3906683997 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb97c14b1e0 msgr2=0x7fb97c0c1700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:00:37.946 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:37.941+0000 7fb980b65640 1 --2- 172.21.15.78:0/3906683997 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb97c14b1e0 0x7fb97c0c1700 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fb96c0097c0 tx=0x7fb96c01c480 comp rx=0 tx=0).stop 2023-11-28T20:00:37.946 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:37.941+0000 7fb980b65640 1 -- 172.21.15.78:0/3906683997 shutdown_connections 2023-11-28T20:00:37.946 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:37.941+0000 7fb980b65640 1 --2- 172.21.15.78:0/3906683997 >> v2:172.21.15.179:3300/0 conn(0x7fb97c1548c0 0x7fb97c154d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:37.946 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:37.941+0000 7fb980b65640 1 --2- 172.21.15.78:0/3906683997 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb97c14b1e0 0x7fb97c0c1700 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:37.947 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:37.941+0000 7fb980b65640 1 -- 172.21.15.78:0/3906683997 >> 172.21.15.78:0/3906683997 conn(0x7fb97c0c59f0 msgr2=0x7fb97c0c5e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:00:37.947 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:37.941+0000 7fb980b65640 1 -- 172.21.15.78:0/3906683997 shutdown_connections 2023-11-28T20:00:37.947 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:37.941+0000 7fb980b65640 1 -- 172.21.15.78:0/3906683997 wait complete. 2023-11-28T20:00:37.950 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:37.941+0000 7fb980b65640 1 Processor -- start 2023-11-28T20:00:37.950 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:37.941+0000 7fb980b65640 1 -- start start 2023-11-28T20:00:37.950 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:37.941+0000 7fb980b65640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb97c0c5300 0x7fb97c0befc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:37.950 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:37.941+0000 7fb980b65640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb97c14b1e0 0x7fb97c1f0ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:37.951 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:37.941+0000 7fb980b65640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb97c1548c0 0x7fb97c0a6370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:37.951 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:37.941+0000 7fb980b65640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb97c06d0e0 con 0x7fb97c1548c0 2023-11-28T20:00:37.951 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:37.941+0000 7fb980b65640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb97c06c560 con 0x7fb97c14b1e0 2023-11-28T20:00:37.951 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:37.941+0000 7fb980b65640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb97c06c840 con 0x7fb97c0c5300 2023-11-28T20:00:37.951 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:37.945+0000 7fb97ad9d640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb97c1548c0 0x7fb97c0a6370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:37.951 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:37.945+0000 7fb97ad9d640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb97c1548c0 0x7fb97c0a6370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:58144/0 (socket says 172.21.15.78:58144) 2023-11-28T20:00:37.951 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:37.945+0000 7fb97ad9d640 1 -- 172.21.15.78:0/2148663169 learned_addr learned my addr 172.21.15.78:0/2148663169 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T20:00:37.951 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:37.945+0000 7fb97a59c640 1 --2- 172.21.15.78:0/2148663169 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb97c0c5300 0x7fb97c0befc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:37.951 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:37.945+0000 7fb971d9b640 1 --2- 172.21.15.78:0/2148663169 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb97c14b1e0 0x7fb97c1f0ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:37.951 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:37.945+0000 7fb97ad9d640 1 -- 172.21.15.78:0/2148663169 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb97c0c5300 msgr2=0x7fb97c0befc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:00:37.952 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:37.945+0000 7fb97ad9d640 1 --2- 172.21.15.78:0/2148663169 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb97c0c5300 0x7fb97c0befc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:37.952 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:37.945+0000 7fb97ad9d640 1 -- 172.21.15.78:0/2148663169 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb97c14b1e0 msgr2=0x7fb97c1f0ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:00:37.952 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:37.945+0000 7fb97ad9d640 1 --2- 172.21.15.78:0/2148663169 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb97c14b1e0 0x7fb97c1f0ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:37.952 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:37.945+0000 7fb97ad9d640 1 -- 172.21.15.78:0/2148663169 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb974009b30 con 0x7fb97c1548c0 2023-11-28T20:00:37.952 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:37.945+0000 7fb97a59c640 1 --2- 172.21.15.78:0/2148663169 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb97c0c5300 0x7fb97c0befc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T20:00:37.952 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:37.945+0000 7fb97ad9d640 1 --2- 172.21.15.78:0/2148663169 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb97c1548c0 0x7fb97c0a6370 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7fb97400efc0 tx=0x7fb97400c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:00:37.952 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:37.945+0000 7fb9737fe640 1 -- 172.21.15.78:0/2148663169 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb974018070 con 0x7fb97c1548c0 2023-11-28T20:00:37.952 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:37.945+0000 7fb9737fe640 1 -- 172.21.15.78:0/2148663169 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb97400f040 con 0x7fb97c1548c0 2023-11-28T20:00:37.952 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:37.945+0000 7fb980b65640 1 -- 172.21.15.78:0/2148663169 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb96c009420 con 0x7fb97c1548c0 2023-11-28T20:00:37.952 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:37.945+0000 7fb9737fe640 1 -- 172.21.15.78:0/2148663169 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb97400ce00 con 0x7fb97c1548c0 2023-11-28T20:00:37.953 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:37.945+0000 7fb980b65640 1 -- 172.21.15.78:0/2148663169 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb97c06ce00 con 0x7fb97c1548c0 2023-11-28T20:00:37.953 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:37.945+0000 7fb980b65640 1 -- 172.21.15.78:0/2148663169 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb97c067630 con 0x7fb97c1548c0 2023-11-28T20:00:37.953 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:37.945+0000 7fb9737fe640 1 -- 172.21.15.78:0/2148663169 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fb974014480 con 0x7fb97c1548c0 2023-11-28T20:00:37.954 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:37.949+0000 7fb9737fe640 1 --2- 172.21.15.78:0/2148663169 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fb95c0664a0 0x7fb95c068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:37.954 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:37.949+0000 7fb9737fe640 1 -- 172.21.15.78:0/2148663169 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 6885+0+0 (secure 0 0 0) 0x7fb974084440 con 0x7fb97c1548c0 2023-11-28T20:00:37.954 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:37.949+0000 7fb97a59c640 1 --2- 172.21.15.78:0/2148663169 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fb95c0664a0 0x7fb95c068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:37.954 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:37.949+0000 7fb97a59c640 1 --2- 172.21.15.78:0/2148663169 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fb95c0664a0 0x7fb95c068960 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fb96c0af000 tx=0x7fb96c008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:00:37.955 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:37.949+0000 7fb9737fe640 1 -- 172.21.15.78:0/2148663169 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fb9740514c0 con 0x7fb97c1548c0 2023-11-28T20:00:38.113 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:38.109+0000 7fb980b65640 1 -- 172.21.15.78:0/2148663169 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs2_data", "var": "pg_num"} v 0) v1 -- 0x7fb97c0a8b70 con 0x7fb97c1548c0 2023-11-28T20:00:38.114 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:38.109+0000 7fb9737fe640 1 -- 172.21.15.78:0/2148663169 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs2_data", "var": "pg_num"}]=0 v44) v1 ==== 101+0+11 (secure 0 0 0) 0x7fb974054ae0 con 0x7fb97c1548c0 2023-11-28T20:00:38.114 INFO:teuthology.orchestra.run.smithi078.stdout:pg_num: 64 2023-11-28T20:00:38.116 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:38.109+0000 7fb980b65640 1 -- 172.21.15.78:0/2148663169 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fb95c0664a0 msgr2=0x7fb95c068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:00:38.116 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:38.109+0000 7fb980b65640 1 --2- 172.21.15.78:0/2148663169 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fb95c0664a0 0x7fb95c068960 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fb96c0af000 tx=0x7fb96c008040 comp rx=0 tx=0).stop 2023-11-28T20:00:38.116 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:38.109+0000 7fb980b65640 1 -- 172.21.15.78:0/2148663169 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb97c1548c0 msgr2=0x7fb97c0a6370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:00:38.116 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:38.109+0000 7fb980b65640 1 --2- 172.21.15.78:0/2148663169 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb97c1548c0 0x7fb97c0a6370 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7fb97400efc0 tx=0x7fb97400c490 comp rx=0 tx=0).stop 2023-11-28T20:00:38.116 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:38.109+0000 7fb980b65640 1 -- 172.21.15.78:0/2148663169 shutdown_connections 2023-11-28T20:00:38.116 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:38.109+0000 7fb980b65640 1 --2- 172.21.15.78:0/2148663169 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fb95c0664a0 0x7fb95c068960 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:38.117 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:38.109+0000 7fb980b65640 1 --2- 172.21.15.78:0/2148663169 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb97c1548c0 0x7fb97c0a6370 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:38.117 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:38.109+0000 7fb980b65640 1 --2- 172.21.15.78:0/2148663169 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb97c14b1e0 0x7fb97c1f0ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:38.117 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:38.109+0000 7fb980b65640 1 --2- 172.21.15.78:0/2148663169 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb97c0c5300 0x7fb97c0befc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:38.117 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:38.109+0000 7fb980b65640 1 -- 172.21.15.78:0/2148663169 >> 172.21.15.78:0/2148663169 conn(0x7fb97c0c59f0 msgr2=0x7fb97c149a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:00:38.117 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:38.109+0000 7fb980b65640 1 -- 172.21.15.78:0/2148663169 shutdown_connections 2023-11-28T20:00:38.117 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:38.113+0000 7fb980b65640 1 -- 172.21.15.78:0/2148663169 wait complete. 2023-11-28T20:00:38.135 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-11-28T20:00:38.273 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:38.269+0000 7f8f18217640 1 Processor -- start 2023-11-28T20:00:38.273 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:38.269+0000 7f8f18217640 1 -- start start 2023-11-28T20:00:38.275 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:38.269+0000 7f8f18217640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8f10151d90 0x7f8f100c4530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:38.275 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:38.269+0000 7f8f18217640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f8f100c40c0 0x7f8f10155070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:38.275 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:38.269+0000 7f8f18217640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8f10152170 con 0x7f8f100a5200 2023-11-28T20:00:38.275 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:38.269+0000 7f8f18217640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8f10158630 con 0x7f8f100c40c0 2023-11-28T20:00:38.275 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:38.269+0000 7f8f18217640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8f10158b60 con 0x7f8f10151d90 2023-11-28T20:00:38.275 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:38.269+0000 7f8f15fb3640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8f10151d90 0x7f8f100c4530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:38.275 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:38.269+0000 7f8f167b4640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f8f100c40c0 0x7f8f10155070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:38.276 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:38.269+0000 7f8f15fb3640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8f10151d90 0x7f8f100c4530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3301/0 says I am v2:172.21.15.78:57492/0 (socket says 172.21.15.78:57492) 2023-11-28T20:00:38.276 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:38.269+0000 7f8f15fb3640 1 -- 172.21.15.78:0/922953068 learned_addr learned my addr 172.21.15.78:0/922953068 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T20:00:38.276 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:38.269+0000 7f8f15fb3640 1 -- 172.21.15.78:0/922953068 >> v2:172.21.15.179:3300/0 conn(0x7f8f100c40c0 msgr2=0x7f8f10155070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:00:38.276 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:38.269+0000 7f8f15fb3640 1 --2- 172.21.15.78:0/922953068 >> v2:172.21.15.179:3300/0 conn(0x7f8f100c40c0 0x7f8f10155070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:38.276 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:38.269+0000 7f8f15fb3640 1 -- 172.21.15.78:0/922953068 >> v1:172.21.15.179:6789/0 conn(0x7f8f100a5200 legacy=0x7f8f10154960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:00:38.276 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:38.269+0000 7f8f15fb3640 1 -- 172.21.15.78:0/922953068 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f10158880 con 0x7f8f10151d90 2023-11-28T20:00:38.276 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:38.269+0000 7f8f167b4640 1 --2- 172.21.15.78:0/922953068 >> v2:172.21.15.179:3300/0 conn(0x7f8f100c40c0 0x7f8f10155070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T20:00:38.278 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:38.273+0000 7f8f15fb3640 1 --2- 172.21.15.78:0/922953068 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8f10151d90 0x7f8f100c4530 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f8f0c009870 tx=0x7f8f0c01c3f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=250686dc0ae638df server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:00:38.279 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:38.273+0000 7f8f14fb1640 1 -- 172.21.15.78:0/922953068 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f0c0ab5f0 con 0x7f8f10151d90 2023-11-28T20:00:38.279 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:38.273+0000 7f8f14fb1640 1 -- 172.21.15.78:0/922953068 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f0c0ab750 con 0x7f8f10151d90 2023-11-28T20:00:38.279 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:38.273+0000 7f8f14fb1640 1 -- 172.21.15.78:0/922953068 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f0c0abae0 con 0x7f8f10151d90 2023-11-28T20:00:38.280 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:38.273+0000 7f8f18217640 1 -- 172.21.15.78:0/922953068 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8f10151d90 msgr2=0x7f8f100c4530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:00:38.280 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:38.273+0000 7f8f18217640 1 --2- 172.21.15.78:0/922953068 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8f10151d90 0x7f8f100c4530 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f8f0c009870 tx=0x7f8f0c01c3f0 comp rx=0 tx=0).stop 2023-11-28T20:00:38.280 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:38.273+0000 7f8f18217640 1 -- 172.21.15.78:0/922953068 shutdown_connections 2023-11-28T20:00:38.280 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:38.273+0000 7f8f18217640 1 --2- 172.21.15.78:0/922953068 >> v2:172.21.15.179:3300/0 conn(0x7f8f100c40c0 0x7f8f10155070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:38.280 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:38.273+0000 7f8f18217640 1 --2- 172.21.15.78:0/922953068 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8f10151d90 0x7f8f100c4530 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:38.280 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:38.273+0000 7f8f18217640 1 -- 172.21.15.78:0/922953068 >> 172.21.15.78:0/922953068 conn(0x7f8f1006b220 msgr2=0x7f8f100a77e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:00:38.280 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:38.273+0000 7f8f18217640 1 -- 172.21.15.78:0/922953068 shutdown_connections 2023-11-28T20:00:38.280 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:38.273+0000 7f8f18217640 1 -- 172.21.15.78:0/922953068 wait complete. 2023-11-28T20:00:38.281 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:38.277+0000 7f8f18217640 1 Processor -- start 2023-11-28T20:00:38.281 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:38.277+0000 7f8f18217640 1 -- start start 2023-11-28T20:00:38.283 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:38.277+0000 7f8f18217640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8f100c40c0 0x7f8f100c3160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:38.283 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:38.277+0000 7f8f18217640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8f10151d90 0x7f8f10156740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:38.283 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:38.277+0000 7f8f18217640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8f10072830 0x7f8f10156c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:38.283 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:38.277+0000 7f8f18217640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f1014d7a0 con 0x7f8f100c40c0 2023-11-28T20:00:38.283 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:38.277+0000 7f8f18217640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f10157f00 con 0x7f8f10151d90 2023-11-28T20:00:38.283 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:38.277+0000 7f8f18217640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8f1014bf40 con 0x7f8f10072830 2023-11-28T20:00:38.283 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:38.277+0000 7f8f15fb3640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8f100c40c0 0x7f8f100c3160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:38.283 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:38.277+0000 7f8f15fb3640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8f100c40c0 0x7f8f100c3160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:58158/0 (socket says 172.21.15.78:58158) 2023-11-28T20:00:38.283 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:38.277+0000 7f8f15fb3640 1 -- 172.21.15.78:0/1730493376 learned_addr learned my addr 172.21.15.78:0/1730493376 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T20:00:38.283 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:38.277+0000 7f8f167b4640 1 --2- 172.21.15.78:0/1730493376 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8f10072830 0x7f8f10156c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:38.283 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:38.277+0000 7f8f157b2640 1 --2- 172.21.15.78:0/1730493376 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8f10151d90 0x7f8f10156740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:38.284 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:38.277+0000 7f8f15fb3640 1 -- 172.21.15.78:0/1730493376 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8f10072830 msgr2=0x7f8f10156c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:00:38.284 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:38.277+0000 7f8f15fb3640 1 --2- 172.21.15.78:0/1730493376 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8f10072830 0x7f8f10156c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:38.284 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:38.277+0000 7f8f15fb3640 1 -- 172.21.15.78:0/1730493376 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8f10151d90 msgr2=0x7f8f10156740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:00:38.284 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:38.277+0000 7f8f15fb3640 1 --2- 172.21.15.78:0/1730493376 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8f10151d90 0x7f8f10156740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:38.284 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:38.277+0000 7f8f15fb3640 1 -- 172.21.15.78:0/1730493376 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f08009a70 con 0x7f8f100c40c0 2023-11-28T20:00:38.284 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:38.277+0000 7f8f15fb3640 1 --2- 172.21.15.78:0/1730493376 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8f100c40c0 0x7f8f100c3160 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f8f0c0ad040 tx=0x7f8f0c019190 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:00:38.285 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:38.277+0000 7f8f067fc640 1 -- 172.21.15.78:0/1730493376 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f0c0bf610 con 0x7f8f100c40c0 2023-11-28T20:00:38.285 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:38.277+0000 7f8f067fc640 1 -- 172.21.15.78:0/1730493376 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f0c0bf7b0 con 0x7f8f100c40c0 2023-11-28T20:00:38.285 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:38.277+0000 7f8f18217640 1 -- 172.21.15.78:0/1730493376 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8f0c0094d0 con 0x7f8f100c40c0 2023-11-28T20:00:38.285 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:38.277+0000 7f8f067fc640 1 -- 172.21.15.78:0/1730493376 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f0c0bfb60 con 0x7f8f100c40c0 2023-11-28T20:00:38.285 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:38.277+0000 7f8f18217640 1 -- 172.21.15.78:0/1730493376 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8f1014c7e0 con 0x7f8f100c40c0 2023-11-28T20:00:38.285 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:38.281+0000 7f8f18217640 1 -- 172.21.15.78:0/1730493376 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8f10067630 con 0x7f8f100c40c0 2023-11-28T20:00:38.285 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:38.281+0000 7f8f067fc640 1 -- 172.21.15.78:0/1730493376 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f8f0c0b5400 con 0x7f8f100c40c0 2023-11-28T20:00:38.286 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:38.281+0000 7f8f067fc640 1 --2- 172.21.15.78:0/1730493376 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f8ef40664a0 0x7f8ef4068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:38.286 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:38.281+0000 7f8f067fc640 1 -- 172.21.15.78:0/1730493376 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 6885+0+0 (secure 0 0 0) 0x7f8f0c0a8050 con 0x7f8f100c40c0 2023-11-28T20:00:38.286 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:38.281+0000 7f8f157b2640 1 --2- 172.21.15.78:0/1730493376 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f8ef40664a0 0x7f8ef4068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:38.287 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:38.281+0000 7f8f157b2640 1 --2- 172.21.15.78:0/1730493376 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f8ef40664a0 0x7f8ef4068960 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f8f1015e5c0 tx=0x7f8f00009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:00:38.290 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:38.285+0000 7f8f067fc640 1 -- 172.21.15.78:0/1730493376 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f8f0c0ec130 con 0x7f8f100c40c0 2023-11-28T20:00:38.450 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:38.445+0000 7f8f18217640 1 -- 172.21.15.78:0/1730493376 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f8f100c6850 con 0x7f8f100c40c0 2023-11-28T20:00:38.451 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:38.445+0000 7f8f067fc640 1 -- 172.21.15.78:0/1730493376 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v44) v1 ==== 80+0+0 (secure 0 0 0) 0x7f8f0c0ef750 con 0x7f8f100c40c0 2023-11-28T20:00:38.451 INFO:teuthology.orchestra.run.smithi078.stderr:listed 0 entries 2023-11-28T20:00:38.453 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:38.449+0000 7f8f18217640 1 -- 172.21.15.78:0/1730493376 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f8ef40664a0 msgr2=0x7f8ef4068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:00:38.453 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:38.449+0000 7f8f18217640 1 --2- 172.21.15.78:0/1730493376 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f8ef40664a0 0x7f8ef4068960 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f8f1015e5c0 tx=0x7f8f00009040 comp rx=0 tx=0).stop 2023-11-28T20:00:38.453 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:38.449+0000 7f8f18217640 1 -- 172.21.15.78:0/1730493376 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8f100c40c0 msgr2=0x7f8f100c3160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:00:38.453 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:38.449+0000 7f8f18217640 1 --2- 172.21.15.78:0/1730493376 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8f100c40c0 0x7f8f100c3160 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f8f0c0ad040 tx=0x7f8f0c019190 comp rx=0 tx=0).stop 2023-11-28T20:00:38.453 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:38.449+0000 7f8f18217640 1 -- 172.21.15.78:0/1730493376 shutdown_connections 2023-11-28T20:00:38.454 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:38.449+0000 7f8f18217640 1 --2- 172.21.15.78:0/1730493376 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f8ef40664a0 0x7f8ef4068960 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:38.454 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:38.449+0000 7f8f18217640 1 --2- 172.21.15.78:0/1730493376 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8f10072830 0x7f8f10156c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:38.454 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:38.449+0000 7f8f18217640 1 --2- 172.21.15.78:0/1730493376 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8f10151d90 0x7f8f10156740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:38.454 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:38.449+0000 7f8f18217640 1 --2- 172.21.15.78:0/1730493376 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8f100c40c0 0x7f8f100c3160 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:38.454 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:38.449+0000 7f8f18217640 1 -- 172.21.15.78:0/1730493376 >> 172.21.15.78:0/1730493376 conn(0x7f8f1006b220 msgr2=0x7f8f100a9fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:00:38.454 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:38.449+0000 7f8f18217640 1 -- 172.21.15.78:0/1730493376 shutdown_connections 2023-11-28T20:00:38.454 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:38.449+0000 7f8f18217640 1 -- 172.21.15.78:0/1730493376 wait complete. 2023-11-28T20:00:38.472 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2023-11-28T20:00:38.472 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T20:00:38.472 DEBUG:teuthology.orchestra.run.smithi179:> sudo umount /home/ubuntu/cephtest/mnt.1 2023-11-28T20:00:38.504 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi179.front.sepia.ceph.com 2023-11-28T20:00:38.504 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T20:00:38.504 DEBUG:teuthology.orchestra.run.smithi179:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-11-28T20:00:38.554 DEBUG:teuthology.orchestra.run.smithi179:> set -ex 2023-11-28T20:00:38.555 DEBUG:teuthology.orchestra.run.smithi179:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-28T20:00:38.610 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354628k,nr_inodes=4088657,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275376k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=3817 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275372k,nr_inodes=818843,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275376k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 2023-11-28T20:00:38.611 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-11-28T20:00:38.749 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:38.745+0000 7f586f054640 1 Processor -- start 2023-11-28T20:00:38.749 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:38.745+0000 7f586f054640 1 -- start start 2023-11-28T20:00:38.750 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:38.745+0000 7f586f054640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f58680af4c0 0x7f5868154f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:38.750 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:38.745+0000 7f586f054640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f586806c100 0x7f58680c6c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:38.751 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:38.745+0000 7f586f054640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f58680c4890 con 0x7f58680c67d0 2023-11-28T20:00:38.751 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:38.745+0000 7f586f054640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5868155460 con 0x7f58680af4c0 2023-11-28T20:00:38.751 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:38.745+0000 7f586f054640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f58680af8a0 con 0x7f586806c100 2023-11-28T20:00:38.751 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:38.745+0000 7f586cdf0640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f58680af4c0 0x7f5868154f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:38.751 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:38.745+0000 7f586cdf0640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f58680af4c0 0x7f5868154f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:58162/0 (socket says 172.21.15.78:58162) 2023-11-28T20:00:38.751 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:38.745+0000 7f586cdf0640 1 -- 172.21.15.78:0/1018590949 learned_addr learned my addr 172.21.15.78:0/1018590949 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T20:00:38.751 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:38.745+0000 7f586cdf0640 1 -- 172.21.15.78:0/1018590949 >> v2:172.21.15.179:3300/0 conn(0x7f586806c100 msgr2=0x7f58680c6c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:00:38.752 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:38.745+0000 7f586cdf0640 1 --2- 172.21.15.78:0/1018590949 >> v2:172.21.15.179:3300/0 conn(0x7f586806c100 0x7f58680c6c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:38.752 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:38.745+0000 7f586cdf0640 1 -- 172.21.15.78:0/1018590949 >> v1:172.21.15.179:6789/0 conn(0x7f58680c67d0 legacy=0x7f586806b9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:00:38.752 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:38.745+0000 7f586cdf0640 1 -- 172.21.15.78:0/1018590949 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58680c4b30 con 0x7f58680af4c0 2023-11-28T20:00:38.753 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:38.749+0000 7f586cdf0640 1 --2- 172.21.15.78:0/1018590949 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f58680af4c0 0x7f5868154f20 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f58680c9d90 tx=0x7f586401c400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5f717542a5ce96de server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:00:38.754 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:38.749+0000 7f585f7fe640 1 -- 172.21.15.78:0/1018590949 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58640ab600 con 0x7f58680af4c0 2023-11-28T20:00:38.755 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:38.749+0000 7f585f7fe640 1 -- 172.21.15.78:0/1018590949 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f58640ab760 con 0x7f58680af4c0 2023-11-28T20:00:38.755 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:38.749+0000 7f585f7fe640 1 -- 172.21.15.78:0/1018590949 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58640abaf0 con 0x7f58680af4c0 2023-11-28T20:00:38.755 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:38.749+0000 7f586f054640 1 -- 172.21.15.78:0/1018590949 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f58680af4c0 msgr2=0x7f5868154f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:00:38.755 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:38.749+0000 7f586f054640 1 --2- 172.21.15.78:0/1018590949 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f58680af4c0 0x7f5868154f20 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f58680c9d90 tx=0x7f586401c400 comp rx=0 tx=0).stop 2023-11-28T20:00:38.755 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:38.749+0000 7f586f054640 1 -- 172.21.15.78:0/1018590949 shutdown_connections 2023-11-28T20:00:38.755 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:38.749+0000 7f586f054640 1 --2- 172.21.15.78:0/1018590949 >> v2:172.21.15.179:3300/0 conn(0x7f586806c100 0x7f58680c6c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:38.755 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:38.749+0000 7f586f054640 1 --2- 172.21.15.78:0/1018590949 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f58680af4c0 0x7f5868154f20 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:38.756 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:38.749+0000 7f586f054640 1 -- 172.21.15.78:0/1018590949 >> 172.21.15.78:0/1018590949 conn(0x7f58680ab9d0 msgr2=0x7f58680abde0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:00:38.756 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:38.749+0000 7f586f054640 1 -- 172.21.15.78:0/1018590949 shutdown_connections 2023-11-28T20:00:38.756 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:38.749+0000 7f586f054640 1 -- 172.21.15.78:0/1018590949 wait complete. 2023-11-28T20:00:38.759 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:38.749+0000 7f586f054640 1 Processor -- start 2023-11-28T20:00:38.759 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:38.753+0000 7f586f054640 1 -- start start 2023-11-28T20:00:38.760 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:38.753+0000 7f586f054640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f586806c100 0x7f58680aded0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:38.760 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:38.753+0000 7f586f054640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f58680af4c0 0x7f58681ede60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:38.760 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:38.753+0000 7f586f054640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f58680c67d0 0x7f58681eff60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:38.760 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:38.753+0000 7f586f054640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58680adab0 con 0x7f58680c67d0 2023-11-28T20:00:38.760 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:38.753+0000 7f586f054640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58680ad430 con 0x7f586806c100 2023-11-28T20:00:38.761 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:38.753+0000 7f586f054640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f58681f0a10 con 0x7f58680af4c0 2023-11-28T20:00:38.761 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:38.753+0000 7f586d5f1640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f58680c67d0 0x7f58681eff60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:38.761 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:38.753+0000 7f586d5f1640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f58680c67d0 0x7f58681eff60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:58174/0 (socket says 172.21.15.78:58174) 2023-11-28T20:00:38.761 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:38.753+0000 7f586d5f1640 1 -- 172.21.15.78:0/1728312130 learned_addr learned my addr 172.21.15.78:0/1728312130 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T20:00:38.761 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:38.753+0000 7f586cdf0640 1 --2- 172.21.15.78:0/1728312130 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f586806c100 0x7f58680aded0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:38.761 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:38.753+0000 7f585ffff640 1 --2- 172.21.15.78:0/1728312130 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f58680af4c0 0x7f58681ede60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:38.762 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:38.753+0000 7f586d5f1640 1 -- 172.21.15.78:0/1728312130 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f58680af4c0 msgr2=0x7f58681ede60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:00:38.762 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:38.753+0000 7f586d5f1640 1 --2- 172.21.15.78:0/1728312130 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f58680af4c0 0x7f58681ede60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:38.762 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:38.753+0000 7f586d5f1640 1 -- 172.21.15.78:0/1728312130 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f586806c100 msgr2=0x7f58680aded0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:00:38.762 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:38.753+0000 7f586d5f1640 1 --2- 172.21.15.78:0/1728312130 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f586806c100 0x7f58680aded0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:38.762 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:38.753+0000 7f586d5f1640 1 -- 172.21.15.78:0/1728312130 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58640094d0 con 0x7f58680c67d0 2023-11-28T20:00:38.763 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:38.753+0000 7f586d5f1640 1 --2- 172.21.15.78:0/1728312130 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f58680c67d0 0x7f58681eff60 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f586000b970 tx=0x7f586000be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:00:38.763 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:38.753+0000 7f585d7fa640 1 -- 172.21.15.78:0/1728312130 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f586000cb40 con 0x7f58680c67d0 2023-11-28T20:00:38.763 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:38.753+0000 7f585d7fa640 1 -- 172.21.15.78:0/1728312130 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f586000ccc0 con 0x7f58680c67d0 2023-11-28T20:00:38.763 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:38.753+0000 7f586f054640 1 -- 172.21.15.78:0/1728312130 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f58681f0cf0 con 0x7f58680c67d0 2023-11-28T20:00:38.763 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:38.753+0000 7f585d7fa640 1 -- 172.21.15.78:0/1728312130 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5860014680 con 0x7f58680c67d0 2023-11-28T20:00:38.763 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:38.753+0000 7f586f054640 1 -- 172.21.15.78:0/1728312130 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f58680ab400 con 0x7f58680c67d0 2023-11-28T20:00:38.763 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:38.753+0000 7f586f054640 1 -- 172.21.15.78:0/1728312130 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f58680adbf0 con 0x7f58680c67d0 2023-11-28T20:00:38.764 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:38.757+0000 7f585d7fa640 1 -- 172.21.15.78:0/1728312130 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f586001d3b0 con 0x7f58680c67d0 2023-11-28T20:00:38.764 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:38.757+0000 7f585d7fa640 1 --2- 172.21.15.78:0/1728312130 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f5854066470 0x7f5854068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:38.765 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:38.757+0000 7f585d7fa640 1 -- 172.21.15.78:0/1728312130 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 6885+0+0 (secure 0 0 0) 0x7f58600841c0 con 0x7f58680c67d0 2023-11-28T20:00:38.765 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:38.757+0000 7f586cdf0640 1 --2- 172.21.15.78:0/1728312130 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f5854066470 0x7f5854068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:38.765 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:38.757+0000 7f586cdf0640 1 --2- 172.21.15.78:0/1728312130 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f5854066470 0x7f5854068930 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f58640af000 tx=0x7f58640b6040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:00:38.765 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:38.761+0000 7f585d7fa640 1 -- 172.21.15.78:0/1728312130 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f58680adbf0 con 0x7f58680c67d0 2023-11-28T20:00:38.953 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:38.949+0000 7f586f054640 1 -- 172.21.15.78:0/1728312130 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f58680adbf0 con 0x7f58680c67d0 2023-11-28T20:00:38.953 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:38.949+0000 7f585d7fa640 1 -- 172.21.15.78:0/1728312130 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v22) v1 ==== 53+0+149 (secure 0 0 0) 0x7f58680adbf0 con 0x7f58680c67d0 2023-11-28T20:00:38.954 INFO:teuthology.orchestra.run.smithi078.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-11-28T20:00:38.954 INFO:teuthology.orchestra.run.smithi078.stdout:name: cephfs2, metadata pool: cephfs2_metadata, data pools: [cephfs2_data ] 2023-11-28T20:00:38.956 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:38.949+0000 7f586f054640 1 -- 172.21.15.78:0/1728312130 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f5854066470 msgr2=0x7f5854068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:00:38.956 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:38.949+0000 7f586f054640 1 --2- 172.21.15.78:0/1728312130 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f5854066470 0x7f5854068930 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f58640af000 tx=0x7f58640b6040 comp rx=0 tx=0).stop 2023-11-28T20:00:38.956 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:38.949+0000 7f586f054640 1 -- 172.21.15.78:0/1728312130 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f58680c67d0 msgr2=0x7f58681eff60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:00:38.956 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:38.949+0000 7f586f054640 1 --2- 172.21.15.78:0/1728312130 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f58680c67d0 0x7f58681eff60 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f586000b970 tx=0x7f586000be30 comp rx=0 tx=0).stop 2023-11-28T20:00:38.956 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:38.949+0000 7f586f054640 1 -- 172.21.15.78:0/1728312130 shutdown_connections 2023-11-28T20:00:38.956 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:38.949+0000 7f586f054640 1 --2- 172.21.15.78:0/1728312130 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f5854066470 0x7f5854068930 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:38.956 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:38.949+0000 7f586f054640 1 --2- 172.21.15.78:0/1728312130 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f58680af4c0 0x7f58681ede60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:38.956 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:38.949+0000 7f586f054640 1 --2- 172.21.15.78:0/1728312130 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f58680c67d0 0x7f58681eff60 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:38.956 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:38.949+0000 7f586f054640 1 --2- 172.21.15.78:0/1728312130 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f586806c100 0x7f58680aded0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:38.957 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:38.949+0000 7f586f054640 1 -- 172.21.15.78:0/1728312130 >> 172.21.15.78:0/1728312130 conn(0x7f58680ab9d0 msgr2=0x7f5868157a90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:00:38.957 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:38.953+0000 7f586f054640 1 -- 172.21.15.78:0/1728312130 shutdown_connections 2023-11-28T20:00:38.957 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:38.953+0000 7f586f054640 1 -- 172.21.15.78:0/1728312130 wait complete. 2023-11-28T20:00:38.975 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs2; just confirmed its presence on cluster 2023-11-28T20:00:38.975 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-11-28T20:00:38.975 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi179.front.sepia.ceph.com 2023-11-28T20:00:38.976 INFO:tasks.cephfs.mount:self.client.name = client.1 2023-11-28T20:00:38.976 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-11-28T20:00:38.976 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs2 2023-11-28T20:00:38.976 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-11-28T20:00:38.976 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-11-28T20:00:38.976 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-11-28T20:00:38.976 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T20:00:38.977 DEBUG:teuthology.orchestra.run.smithi179:> ip addr 2023-11-28T20:00:38.987 INFO:teuthology.orchestra.run.smithi179.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-11-28T20:00:38.987 INFO:teuthology.orchestra.run.smithi179.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-11-28T20:00:38.987 INFO:teuthology.orchestra.run.smithi179.stdout: inet 127.0.0.1/8 scope host lo 2023-11-28T20:00:38.988 INFO:teuthology.orchestra.run.smithi179.stdout: valid_lft forever preferred_lft forever 2023-11-28T20:00:38.988 INFO:teuthology.orchestra.run.smithi179.stdout: inet6 ::1/128 scope host 2023-11-28T20:00:38.988 INFO:teuthology.orchestra.run.smithi179.stdout: valid_lft forever preferred_lft forever 2023-11-28T20:00:38.988 INFO:teuthology.orchestra.run.smithi179.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-11-28T20:00:38.988 INFO:teuthology.orchestra.run.smithi179.stdout: link/ether 0c:c4:7a:d9:3b:34 brd ff:ff:ff:ff:ff:ff 2023-11-28T20:00:38.988 INFO:teuthology.orchestra.run.smithi179.stdout: altname enp7s0f0 2023-11-28T20:00:38.988 INFO:teuthology.orchestra.run.smithi179.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-11-28T20:00:38.989 INFO:teuthology.orchestra.run.smithi179.stdout: link/ether 0c:c4:7a:d9:3b:35 brd ff:ff:ff:ff:ff:ff 2023-11-28T20:00:38.989 INFO:teuthology.orchestra.run.smithi179.stdout: altname enp7s0f1 2023-11-28T20:00:38.989 INFO:teuthology.orchestra.run.smithi179.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-11-28T20:00:38.989 INFO:teuthology.orchestra.run.smithi179.stdout: link/ether 0c:c4:7a:88:72:5a brd ff:ff:ff:ff:ff:ff 2023-11-28T20:00:38.989 INFO:teuthology.orchestra.run.smithi179.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-11-28T20:00:38.989 INFO:teuthology.orchestra.run.smithi179.stdout: link/ether 0c:c4:7a:88:72:5b brd ff:ff:ff:ff:ff:ff 2023-11-28T20:00:38.989 INFO:teuthology.orchestra.run.smithi179.stdout: inet 172.21.15.179/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2023-11-28T20:00:38.989 INFO:teuthology.orchestra.run.smithi179.stdout: valid_lft 42343sec preferred_lft 42343sec 2023-11-28T20:00:38.989 INFO:teuthology.orchestra.run.smithi179.stdout: inet6 fe80::ec4:7aff:fe88:725b/64 scope link 2023-11-28T20:00:38.989 INFO:teuthology.orchestra.run.smithi179.stdout: valid_lft forever preferred_lft forever 2023-11-28T20:00:38.989 INFO:teuthology.orchestra.run.smithi179.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-11-28T20:00:38.990 INFO:teuthology.orchestra.run.smithi179.stdout: link/ether 02:42:75:f0:7b:8c brd ff:ff:ff:ff:ff:ff 2023-11-28T20:00:38.990 INFO:teuthology.orchestra.run.smithi179.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-11-28T20:00:38.990 INFO:teuthology.orchestra.run.smithi179.stdout: valid_lft forever preferred_lft forever 2023-11-28T20:00:38.990 INFO:teuthology.orchestra.run.smithi179.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-11-28T20:00:38.990 INFO:teuthology.orchestra.run.smithi179.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2023-11-28T20:00:38.990 INFO:teuthology.orchestra.run.smithi179.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-11-28T20:00:38.990 INFO:teuthology.orchestra.run.smithi179.stdout: valid_lft forever preferred_lft forever 2023-11-28T20:00:38.990 INFO:teuthology.orchestra.run.smithi179.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2023-11-28T20:00:38.990 INFO:teuthology.orchestra.run.smithi179.stdout: valid_lft forever preferred_lft forever 2023-11-28T20:00:38.990 INFO:teuthology.orchestra.run.smithi179.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-11-28T20:00:38.990 INFO:teuthology.orchestra.run.smithi179.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2023-11-28T20:00:38.991 INFO:teuthology.orchestra.run.smithi179.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2023-11-28T20:00:38.991 INFO:teuthology.orchestra.run.smithi179.stdout: valid_lft forever preferred_lft forever 2023-11-28T20:00:38.992 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T20:00:38.992 DEBUG:teuthology.orchestra.run.smithi179:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-11-28T20:00:39.057 INFO:teuthology.orchestra.run.smithi179.stdout:1 2023-11-28T20:00:39.059 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T20:00:39.060 DEBUG:teuthology.orchestra.run.smithi179:> route 2023-11-28T20:00:39.117 INFO:teuthology.orchestra.run.smithi179.stdout:Kernel IP routing table 2023-11-28T20:00:39.117 INFO:teuthology.orchestra.run.smithi179.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-11-28T20:00:39.117 INFO:teuthology.orchestra.run.smithi179.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2023-11-28T20:00:39.117 INFO:teuthology.orchestra.run.smithi179.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-11-28T20:00:39.117 INFO:teuthology.orchestra.run.smithi179.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-11-28T20:00:39.117 INFO:teuthology.orchestra.run.smithi179.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-11-28T20:00:39.117 INFO:teuthology.orchestra.run.smithi179.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-11-28T20:00:39.118 INFO:teuthology.orchestra.run.smithi179.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-11-28T20:00:39.118 INFO:teuthology.orchestra.run.smithi179.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-11-28T20:00:39.118 INFO:teuthology.orchestra.run.smithi179.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-11-28T20:00:39.118 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T20:00:39.118 DEBUG:teuthology.orchestra.run.smithi179:> (cd / && exec bash -c ' 2023-11-28T20:00:39.118 DEBUG:teuthology.orchestra.run.smithi179:> set -e 2023-11-28T20:00:39.118 DEBUG:teuthology.orchestra.run.smithi179:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-11-28T20:00:39.118 DEBUG:teuthology.orchestra.run.smithi179:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-11-28T20:00:39.119 DEBUG:teuthology.orchestra.run.smithi179:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-11-28T20:00:39.119 DEBUG:teuthology.orchestra.run.smithi179:> ') 2023-11-28T20:00:39.215 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T20:00:39.216 DEBUG:teuthology.orchestra.run.smithi179:> ip netns list 2023-11-28T20:00:39.226 INFO:teuthology.orchestra.run.smithi179.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-11-28T20:00:39.226 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-11-28T20:00:39.227 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T20:00:39.227 DEBUG:teuthology.orchestra.run.smithi179:> sudo ip link set brx.0 up 2023-11-28T20:00:39.291 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-28T20:00:39.291 DEBUG:teuthology.orchestra.run.smithi179:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2023-11-28T20:00:39.341 INFO:teuthology.orchestra.run.smithi179.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2023-11-28T20:00:39.341 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-28T20:00:39.342 DEBUG:teuthology.orchestra.run.smithi179:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2023-11-28T20:00:39.392 INFO:tasks.cephfs.kernel_mount:mounting using device: 1@.cephfs2=/ 2023-11-28T20:00:39.393 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T20:00:39.393 DEBUG:teuthology.orchestra.run.smithi179:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 1@.cephfs2=/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-11-28T20:00:39.488 INFO:teuthology.orchestra.run.smithi179.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-11-28T20:00:39.489 INFO:teuthology.orchestra.run.smithi179.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-11-28T20:00:39.501 INFO:teuthology.orchestra.run.smithi179.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-11-28T20:00:39.501 INFO:teuthology.orchestra.run.smithi179.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-11-28T20:00:39.501 INFO:teuthology.orchestra.run.smithi179.stdout:mount.ceph: resolved to: "172.21.15.78:3300,172.21.15.179:3300,172.21.15.179:3301" 2023-11-28T20:00:39.501 INFO:teuthology.orchestra.run.smithi179.stdout:mount.ceph: trying mount with new device syntax: 1@dd9780e8-3bda-44fa-a9f0-fa07d19d901d.cephfs2=/ 2023-11-28T20:00:39.502 INFO:teuthology.orchestra.run.smithi179.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,ms_mode=prefer-crc,key=1,mon_addr=172.21.15.78:3300/172.21.15.179:3300/172.21.15.179:3301" will pass to kernel 2023-11-28T20:00:39.505 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-11-28T20:00:39.505 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T20:00:39.505 DEBUG:teuthology.orchestra.run.smithi179:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-11-28T20:00:39.527 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T20:00:39.527 DEBUG:teuthology.orchestra.run.smithi179:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-11-28T20:00:39.590 INFO:teuthology.orchestra.run.smithi179.stdout:client5536 2023-11-28T20:00:39.591 DEBUG:teuthology.orchestra.run.smithi179:> set -ex 2023-11-28T20:00:39.591 DEBUG:teuthology.orchestra.run.smithi179:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-28T20:00:39.642 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs authorize cephfs client.testuser / rw 2023-11-28T20:00:39.784 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:39.781+0000 7f5b408d6640 1 Processor -- start 2023-11-28T20:00:39.784 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:39.781+0000 7f5b408d6640 1 -- start start 2023-11-28T20:00:39.786 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:39.781+0000 7f5b408d6640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5b3c14b1e0 0x7f5b3c0c1700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:39.786 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:39.781+0000 7f5b408d6640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f5b3c0c5300 0x7f5b3c0a9c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:39.786 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:39.781+0000 7f5b408d6640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5b3c0a4e20 con 0x7f5b3c151280 2023-11-28T20:00:39.786 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:39.781+0000 7f5b408d6640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5b3c1558d0 con 0x7f5b3c0c5300 2023-11-28T20:00:39.787 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:39.781+0000 7f5b408d6640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b3c0a50e0 con 0x7f5b3c14b1e0 2023-11-28T20:00:39.787 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:39.781+0000 7f5b39d9b640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f5b3c0c5300 0x7f5b3c0a9c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:39.787 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:39.781+0000 7f5b39d9b640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f5b3c0c5300 0x7f5b3c0a9c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:58190/0 (socket says 172.21.15.78:58190) 2023-11-28T20:00:39.787 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:39.781+0000 7f5b39d9b640 1 -- 172.21.15.78:0/4289554457 learned_addr learned my addr 172.21.15.78:0/4289554457 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T20:00:39.787 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:39.781+0000 7f5b3a59c640 1 --2- 172.21.15.78:0/4289554457 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5b3c14b1e0 0x7f5b3c0c1700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:39.787 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:39.781+0000 7f5b39d9b640 1 -- 172.21.15.78:0/4289554457 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5b3c14b1e0 msgr2=0x7f5b3c0c1700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:00:39.787 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:39.781+0000 7f5b39d9b640 1 --2- 172.21.15.78:0/4289554457 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5b3c14b1e0 0x7f5b3c0c1700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:39.787 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:39.781+0000 7f5b39d9b640 1 -- 172.21.15.78:0/4289554457 >> v1:172.21.15.179:6789/0 conn(0x7f5b3c151280 legacy=0x7f5b3c151710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:00:39.787 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:39.781+0000 7f5b39d9b640 1 -- 172.21.15.78:0/4289554457 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b3c0c0f00 con 0x7f5b3c0c5300 2023-11-28T20:00:39.789 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:39.785+0000 7f5b39d9b640 1 --2- 172.21.15.78:0/4289554457 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5b3c0c5300 0x7f5b3c0a9c30 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f5b30009870 tx=0x7f5b3001c540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f4d01fe3c47eb129 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:00:39.789 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:39.785+0000 7f5b3959a640 1 -- 172.21.15.78:0/4289554457 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b300ab650 con 0x7f5b3c0c5300 2023-11-28T20:00:39.789 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:39.785+0000 7f5b3959a640 1 -- 172.21.15.78:0/4289554457 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b300ab7b0 con 0x7f5b3c0c5300 2023-11-28T20:00:39.789 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:39.785+0000 7f5b3959a640 1 -- 172.21.15.78:0/4289554457 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b300abb40 con 0x7f5b3c0c5300 2023-11-28T20:00:39.790 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:39.785+0000 7f5b408d6640 1 -- 172.21.15.78:0/4289554457 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5b3c0c5300 msgr2=0x7f5b3c0a9c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:00:39.790 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:39.785+0000 7f5b408d6640 1 --2- 172.21.15.78:0/4289554457 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5b3c0c5300 0x7f5b3c0a9c30 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f5b30009870 tx=0x7f5b3001c540 comp rx=0 tx=0).stop 2023-11-28T20:00:39.790 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:39.785+0000 7f5b408d6640 1 -- 172.21.15.78:0/4289554457 shutdown_connections 2023-11-28T20:00:39.790 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:39.785+0000 7f5b408d6640 1 --2- 172.21.15.78:0/4289554457 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5b3c0c5300 0x7f5b3c0a9c30 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:39.791 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:39.785+0000 7f5b408d6640 1 --2- 172.21.15.78:0/4289554457 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5b3c14b1e0 0x7f5b3c0c1700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:39.791 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:39.785+0000 7f5b408d6640 1 -- 172.21.15.78:0/4289554457 >> 172.21.15.78:0/4289554457 conn(0x7f5b3c0c59f0 msgr2=0x7f5b3c0c5e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:00:39.791 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:39.785+0000 7f5b408d6640 1 -- 172.21.15.78:0/4289554457 shutdown_connections 2023-11-28T20:00:39.791 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:39.785+0000 7f5b408d6640 1 -- 172.21.15.78:0/4289554457 wait complete. 2023-11-28T20:00:39.792 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:39.789+0000 7f5b408d6640 1 Processor -- start 2023-11-28T20:00:39.792 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:39.789+0000 7f5b408d6640 1 -- start start 2023-11-28T20:00:39.794 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:39.789+0000 7f5b408d6640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5b3c0c5300 0x7f5b3c152cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:39.794 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:39.789+0000 7f5b408d6640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5b3c14b1e0 0x7f5b3c14d030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:39.794 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:39.789+0000 7f5b408d6640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5b3c151280 0x7f5b3c14d570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:39.794 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:39.789+0000 7f5b408d6640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b3c072380 con 0x7f5b3c151280 2023-11-28T20:00:39.794 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:39.789+0000 7f5b408d6640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b3c144fd0 con 0x7f5b3c14b1e0 2023-11-28T20:00:39.795 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:39.789+0000 7f5b408d6640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b3c0715c0 con 0x7f5b3c0c5300 2023-11-28T20:00:39.795 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:39.789+0000 7f5b3ad9d640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5b3c151280 0x7f5b3c14d570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:39.795 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:39.789+0000 7f5b3a59c640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5b3c0c5300 0x7f5b3c152cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:39.795 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:39.789+0000 7f5b3ad9d640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5b3c151280 0x7f5b3c14d570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:58194/0 (socket says 172.21.15.78:58194) 2023-11-28T20:00:39.795 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:39.789+0000 7f5b3ad9d640 1 -- 172.21.15.78:0/3964575492 learned_addr learned my addr 172.21.15.78:0/3964575492 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T20:00:39.795 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:39.789+0000 7f5b39d9b640 1 --2- 172.21.15.78:0/3964575492 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5b3c14b1e0 0x7f5b3c14d030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:39.795 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:39.789+0000 7f5b3ad9d640 1 -- 172.21.15.78:0/3964575492 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5b3c0c5300 msgr2=0x7f5b3c152cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:00:39.795 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:39.789+0000 7f5b3ad9d640 1 --2- 172.21.15.78:0/3964575492 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5b3c0c5300 0x7f5b3c152cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:39.795 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:39.789+0000 7f5b3ad9d640 1 -- 172.21.15.78:0/3964575492 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5b3c14b1e0 msgr2=0x7f5b3c14d030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:00:39.795 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:39.789+0000 7f5b3ad9d640 1 --2- 172.21.15.78:0/3964575492 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5b3c14b1e0 0x7f5b3c14d030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:39.795 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:39.789+0000 7f5b3ad9d640 1 -- 172.21.15.78:0/3964575492 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b300094d0 con 0x7f5b3c151280 2023-11-28T20:00:39.796 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:39.789+0000 7f5b3ad9d640 1 --2- 172.21.15.78:0/3964575492 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5b3c151280 0x7f5b3c14d570 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f5b3400c730 tx=0x7f5b3400cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:00:39.796 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:39.789+0000 7f5b2affd640 1 -- 172.21.15.78:0/3964575492 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b34003ba0 con 0x7f5b3c151280 2023-11-28T20:00:39.796 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:39.789+0000 7f5b2affd640 1 -- 172.21.15.78:0/3964575492 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b34003d00 con 0x7f5b3c151280 2023-11-28T20:00:39.796 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:39.789+0000 7f5b408d6640 1 -- 172.21.15.78:0/3964575492 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5b3c0718a0 con 0x7f5b3c151280 2023-11-28T20:00:39.796 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:39.789+0000 7f5b2affd640 1 -- 172.21.15.78:0/3964575492 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b34005310 con 0x7f5b3c151280 2023-11-28T20:00:39.796 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:39.789+0000 7f5b408d6640 1 -- 172.21.15.78:0/3964575492 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5b3c071e60 con 0x7f5b3c151280 2023-11-28T20:00:39.797 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:39.789+0000 7f5b408d6640 1 -- 172.21.15.78:0/3964575492 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5b3c067630 con 0x7f5b3c151280 2023-11-28T20:00:39.797 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:39.793+0000 7f5b2affd640 1 -- 172.21.15.78:0/3964575492 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f5b34005680 con 0x7f5b3c151280 2023-11-28T20:00:39.797 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:39.793+0000 7f5b2affd640 1 --2- 172.21.15.78:0/3964575492 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f5b1c0664a0 0x7f5b1c068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:39.797 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:39.793+0000 7f5b2affd640 1 -- 172.21.15.78:0/3964575492 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 6885+0+0 (secure 0 0 0) 0x7f5b340840f0 con 0x7f5b3c151280 2023-11-28T20:00:39.797 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:39.793+0000 7f5b3a59c640 1 --2- 172.21.15.78:0/3964575492 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f5b1c0664a0 0x7f5b1c068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:39.798 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:39.793+0000 7f5b3a59c640 1 --2- 172.21.15.78:0/3964575492 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f5b1c0664a0 0x7f5b1c068960 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f5b3c145440 tx=0x7f5b2c009190 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:00:39.801 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:39.797+0000 7f5b2affd640 1 -- 172.21.15.78:0/3964575492 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f5b34051180 con 0x7f5b3c151280 2023-11-28T20:00:39.982 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:39.977+0000 7f5b408d6640 1 -- 172.21.15.78:0/3964575492 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs authorize", "filesystem": "cephfs", "entity": "client.testuser", "caps": ["/", "rw"]} v 0) v1 -- 0x7f5b3c072050 con 0x7f5b3c151280 2023-11-28T20:00:39.985 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:39.981+0000 7f5b2affd640 1 -- 172.21.15.78:0/3964575492 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "fs authorize", "filesystem": "cephfs", "entity": "client.testuser", "caps": ["/", "rw"]}]=0 v15) v1 ==== 134+0+185 (secure 0 0 0) 0x7f5b340547a0 con 0x7f5b3c151280 2023-11-28T20:00:39.985 INFO:teuthology.orchestra.run.smithi078.stdout:[client.testuser] 2023-11-28T20:00:39.985 INFO:teuthology.orchestra.run.smithi078.stdout: key = AQDnRmZlxPmOOhAABtFMizHRWLo0HdOMCPA14A== 2023-11-28T20:00:39.985 INFO:teuthology.orchestra.run.smithi078.stdout: caps mds = "allow rw fsname=cephfs" 2023-11-28T20:00:39.986 INFO:teuthology.orchestra.run.smithi078.stdout: caps mon = "allow r fsname=cephfs" 2023-11-28T20:00:39.986 INFO:teuthology.orchestra.run.smithi078.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2023-11-28T20:00:39.987 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:39.981+0000 7f5b408d6640 1 -- 172.21.15.78:0/3964575492 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f5b1c0664a0 msgr2=0x7f5b1c068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:00:39.988 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:39.981+0000 7f5b408d6640 1 --2- 172.21.15.78:0/3964575492 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f5b1c0664a0 0x7f5b1c068960 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f5b3c145440 tx=0x7f5b2c009190 comp rx=0 tx=0).stop 2023-11-28T20:00:39.988 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:39.981+0000 7f5b408d6640 1 -- 172.21.15.78:0/3964575492 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5b3c151280 msgr2=0x7f5b3c14d570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:00:39.988 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:39.981+0000 7f5b408d6640 1 --2- 172.21.15.78:0/3964575492 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5b3c151280 0x7f5b3c14d570 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f5b3400c730 tx=0x7f5b3400cbf0 comp rx=0 tx=0).stop 2023-11-28T20:00:39.988 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:39.981+0000 7f5b408d6640 1 -- 172.21.15.78:0/3964575492 shutdown_connections 2023-11-28T20:00:39.988 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:39.981+0000 7f5b408d6640 1 --2- 172.21.15.78:0/3964575492 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f5b1c0664a0 0x7f5b1c068960 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:39.988 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:39.981+0000 7f5b408d6640 1 --2- 172.21.15.78:0/3964575492 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5b3c151280 0x7f5b3c14d570 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:39.988 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:39.981+0000 7f5b408d6640 1 --2- 172.21.15.78:0/3964575492 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5b3c14b1e0 0x7f5b3c14d030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:39.988 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:39.981+0000 7f5b408d6640 1 --2- 172.21.15.78:0/3964575492 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5b3c0c5300 0x7f5b3c152cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:39.988 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:39.981+0000 7f5b408d6640 1 -- 172.21.15.78:0/3964575492 >> 172.21.15.78:0/3964575492 conn(0x7f5b3c0c59f0 msgr2=0x7f5b3c150b40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:00:39.988 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:39.981+0000 7f5b408d6640 1 -- 172.21.15.78:0/3964575492 shutdown_connections 2023-11-28T20:00:39.988 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:39.981+0000 7f5b408d6640 1 -- 172.21.15.78:0/3964575492 wait complete. 2023-11-28T20:00:40.009 DEBUG:teuthology.orchestra.run.smithi078:> mktemp 2023-11-28T20:00:40.018 INFO:teuthology.orchestra.run.smithi078.stdout:/tmp/tmp.rai2IxDqP4 2023-11-28T20:00:40.018 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2023-11-28T20:00:40.018 DEBUG:teuthology.orchestra.run.smithi078:> dd of=/tmp/tmp.rai2IxDqP4 2023-11-28T20:00:40.068 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2023-11-28T20:00:40.068 DEBUG:teuthology.orchestra.run.smithi078:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-28T20:00:40.120 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2023-11-28T20:00:40.120 DEBUG:teuthology.orchestra.run.smithi078:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-28T20:00:40.172 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-28T20:00:40.352 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:40.349+0000 7fa620a3a640 1 Processor -- start 2023-11-28T20:00:40.352 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:40.349+0000 7fa620a3a640 1 -- start start 2023-11-28T20:00:40.353 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:40.349+0000 7fa620a3a640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fa61c0aa990 0x7fa61c0c0e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:40.354 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:40.349+0000 7fa620a3a640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fa61c0c5900 0x7fa61c0c5d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:40.354 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:40.349+0000 7fa620a3a640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa61c0c1520 con 0x7fa61c0a4e30 2023-11-28T20:00:40.354 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:40.349+0000 7fa620a3a640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa61c151c60 con 0x7fa61c0aa990 2023-11-28T20:00:40.354 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:40.349+0000 7fa620a3a640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa61c0c17c0 con 0x7fa61c0c5900 2023-11-28T20:00:40.354 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:40.349+0000 7fa61b7fe640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fa61c0aa990 0x7fa61c0c0e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:40.354 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:40.349+0000 7fa61affd640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7fa61c0a4e30 0x7fa61c0c4860 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:34052/0 (socket says 172.21.15.78:34052) 2023-11-28T20:00:40.354 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:40.349+0000 7fa61affd640 1 -- 172.21.15.78:0/4250431526 learned_addr learned my addr 172.21.15.78:0/4250431526 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-11-28T20:00:40.354 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:40.349+0000 7fa61b7fe640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fa61c0aa990 0x7fa61c0c0e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:58198/0 (socket says 172.21.15.78:58198) 2023-11-28T20:00:40.355 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:40.349+0000 7fa61b7fe640 1 -- 172.21.15.78:0/4250431526 >> v2:172.21.15.179:3300/0 conn(0x7fa61c0c5900 msgr2=0x7fa61c0c5d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:00:40.355 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:40.349+0000 7fa61bfff640 1 --2- 172.21.15.78:0/4250431526 >> v2:172.21.15.179:3300/0 conn(0x7fa61c0c5900 0x7fa61c0c5d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:40.355 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:40.349+0000 7fa61a7fc640 1 -- 172.21.15.78:0/4250431526 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3528029177 0 0) 0x7fa61c0c1520 con 0x7fa61c0a4e30 2023-11-28T20:00:40.355 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:40.349+0000 7fa61b7fe640 1 --2- 172.21.15.78:0/4250431526 >> v2:172.21.15.179:3300/0 conn(0x7fa61c0c5900 0x7fa61c0c5d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:40.355 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:40.349+0000 7fa61b7fe640 1 -- 172.21.15.78:0/4250431526 >> v1:172.21.15.78:6789/0 conn(0x7fa61c0a4e30 legacy=0x7fa61c0c4860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:00:40.356 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:40.349+0000 7fa61b7fe640 1 -- 172.21.15.78:0/4250431526 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa61c151f40 con 0x7fa61c0aa990 2023-11-28T20:00:40.356 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:40.349+0000 7fa61bfff640 1 --2- 172.21.15.78:0/4250431526 >> v2:172.21.15.179:3300/0 conn(0x7fa61c0c5900 0x7fa61c0c5d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T20:00:40.357 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:40.353+0000 7fa61b7fe640 1 --2- 172.21.15.78:0/4250431526 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa61c0aa990 0x7fa61c0c0e10 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7fa61c0a8500 tx=0x7fa60c01c3d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d79fa3ae84eb099b server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:00:40.357 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:40.353+0000 7fa61a7fc640 1 -- 172.21.15.78:0/4250431526 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa60c0ab600 con 0x7fa61c0aa990 2023-11-28T20:00:40.357 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:40.353+0000 7fa61a7fc640 1 -- 172.21.15.78:0/4250431526 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa60c0a7050 con 0x7fa61c0aa990 2023-11-28T20:00:40.358 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:40.353+0000 7fa61a7fc640 1 -- 172.21.15.78:0/4250431526 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa60c0ab980 con 0x7fa61c0aa990 2023-11-28T20:00:40.358 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:40.353+0000 7fa620a3a640 1 -- 172.21.15.78:0/4250431526 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa61c0aa990 msgr2=0x7fa61c0c0e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:00:40.359 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:40.353+0000 7fa620a3a640 1 --2- 172.21.15.78:0/4250431526 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa61c0aa990 0x7fa61c0c0e10 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7fa61c0a8500 tx=0x7fa60c01c3d0 comp rx=0 tx=0).stop 2023-11-28T20:00:40.359 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:40.353+0000 7fa620a3a640 1 -- 172.21.15.78:0/4250431526 shutdown_connections 2023-11-28T20:00:40.359 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:40.353+0000 7fa620a3a640 1 --2- 172.21.15.78:0/4250431526 >> v2:172.21.15.179:3300/0 conn(0x7fa61c0c5900 0x7fa61c0c5d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:40.359 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:40.353+0000 7fa620a3a640 1 --2- 172.21.15.78:0/4250431526 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa61c0aa990 0x7fa61c0c0e10 unknown :-1 s=CLOSED pgs=472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:40.359 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:40.353+0000 7fa620a3a640 1 -- 172.21.15.78:0/4250431526 >> 172.21.15.78:0/4250431526 conn(0x7fa61c0a7600 msgr2=0x7fa61c0a7a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:00:40.359 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:40.353+0000 7fa620a3a640 1 -- 172.21.15.78:0/4250431526 shutdown_connections 2023-11-28T20:00:40.359 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:40.353+0000 7fa620a3a640 1 -- 172.21.15.78:0/4250431526 wait complete. 2023-11-28T20:00:40.360 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:40.353+0000 7fa620a3a640 1 Processor -- start 2023-11-28T20:00:40.360 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:40.357+0000 7fa620a3a640 1 -- start start 2023-11-28T20:00:40.362 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:40.357+0000 7fa620a3a640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa61c0a4e30 0x7fa61c0a59b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:40.362 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:40.357+0000 7fa620a3a640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa61c0aa990 0x7fa61c14baa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:40.362 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:40.357+0000 7fa620a3a640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa61c0c5900 0x7fa61c14bfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:40.362 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:40.357+0000 7fa620a3a640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa61c14c520 con 0x7fa61c0a4e30 2023-11-28T20:00:40.362 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:40.357+0000 7fa620a3a640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa61c155550 con 0x7fa61c0aa990 2023-11-28T20:00:40.363 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:40.357+0000 7fa620a3a640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa61c071790 con 0x7fa61c0c5900 2023-11-28T20:00:40.363 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:40.357+0000 7fa61b7fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa61c0a4e30 0x7fa61c0a59b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:40.363 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:40.357+0000 7fa61b7fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa61c0a4e30 0x7fa61c0a59b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:58212/0 (socket says 172.21.15.78:58212) 2023-11-28T20:00:40.363 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:40.357+0000 7fa61b7fe640 1 -- 172.21.15.78:0/772016531 learned_addr learned my addr 172.21.15.78:0/772016531 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T20:00:40.363 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:40.357+0000 7fa61affd640 1 --2- 172.21.15.78:0/772016531 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa61c0aa990 0x7fa61c14baa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:40.363 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:40.357+0000 7fa61bfff640 1 --2- 172.21.15.78:0/772016531 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa61c0c5900 0x7fa61c14bfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:40.363 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:40.357+0000 7fa61b7fe640 1 -- 172.21.15.78:0/772016531 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa61c0c5900 msgr2=0x7fa61c14bfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:00:40.363 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:40.357+0000 7fa61b7fe640 1 --2- 172.21.15.78:0/772016531 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa61c0c5900 0x7fa61c14bfe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:40.363 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:40.357+0000 7fa61b7fe640 1 -- 172.21.15.78:0/772016531 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa61c0aa990 msgr2=0x7fa61c14baa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:00:40.363 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:40.357+0000 7fa61b7fe640 1 --2- 172.21.15.78:0/772016531 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa61c0aa990 0x7fa61c14baa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:40.363 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:40.357+0000 7fa61b7fe640 1 -- 172.21.15.78:0/772016531 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa60c009420 con 0x7fa61c0a4e30 2023-11-28T20:00:40.363 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:40.357+0000 7fa61b7fe640 1 --2- 172.21.15.78:0/772016531 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa61c0a4e30 0x7fa61c0a59b0 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7fa60c0ae040 tx=0x7fa60c019170 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:00:40.364 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:40.357+0000 7fa603fff640 1 -- 172.21.15.78:0/772016531 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa60c0b4610 con 0x7fa61c0a4e30 2023-11-28T20:00:40.364 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:40.357+0000 7fa603fff640 1 -- 172.21.15.78:0/772016531 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa60c0abe90 con 0x7fa61c0a4e30 2023-11-28T20:00:40.364 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:40.357+0000 7fa603fff640 1 -- 172.21.15.78:0/772016531 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa60c0b4970 con 0x7fa61c0a4e30 2023-11-28T20:00:40.364 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:40.357+0000 7fa620a3a640 1 -- 172.21.15.78:0/772016531 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa61c151930 con 0x7fa61c0a4e30 2023-11-28T20:00:40.364 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:40.357+0000 7fa620a3a640 1 -- 172.21.15.78:0/772016531 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa61c0714b0 con 0x7fa61c0a4e30 2023-11-28T20:00:40.365 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:40.357+0000 7fa620a3a640 1 -- 172.21.15.78:0/772016531 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa61c0674b0 con 0x7fa61c0a4e30 2023-11-28T20:00:40.365 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:40.361+0000 7fa603fff640 1 -- 172.21.15.78:0/772016531 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fa60c0b2040 con 0x7fa61c0a4e30 2023-11-28T20:00:40.365 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:40.361+0000 7fa603fff640 1 --2- 172.21.15.78:0/772016531 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fa608066470 0x7fa608068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:40.365 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:40.361+0000 7fa603fff640 1 -- 172.21.15.78:0/772016531 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 6885+0+0 (secure 0 0 0) 0x7fa60c11e3e0 con 0x7fa61c0a4e30 2023-11-28T20:00:40.366 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:40.361+0000 7fa61affd640 1 --2- 172.21.15.78:0/772016531 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fa608066470 0x7fa608068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:40.366 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:40.361+0000 7fa61affd640 1 --2- 172.21.15.78:0/772016531 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fa608066470 0x7fa608068930 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fa61c0c3060 tx=0x7fa610007b80 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:00:40.369 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:40.365+0000 7fa603fff640 1 -- 172.21.15.78:0/772016531 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fa60c0eb3b0 con 0x7fa61c0a4e30 2023-11-28T20:00:40.521 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:40.517+0000 7fa620a3a640 1 -- 172.21.15.78:0/772016531 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa61c0c06a0 con 0x7fa61c0a4e30 2023-11-28T20:00:40.522 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:40.517+0000 7fa603fff640 1 -- 172.21.15.78:0/772016531 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v44) v1 ==== 74+0+20466 (secure 0 0 0) 0x7fa60c0ee9d0 con 0x7fa61c0a4e30 2023-11-28T20:00:40.522 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-11-28T20:00:40.523 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":44,"fsid":"dd9780e8-3bda-44fa-a9f0-fa07d19d901d","created":"2023-11-28T19:58:40.969556+0000","modified":"2023-11-28T20:00:31.764388+0000","last_up_change":"2023-11-28T19:58:52.596716+0000","last_in_change":"2023-11-28T19:58:43.609275+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-28T19:58:54.011229+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2023-11-28T20:00:10.831194+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"39","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2023-11-28T20:00:12.150184+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"40","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs2_metadata","create_time":"2023-11-28T20:00:28.571896+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"43","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs2_data","create_time":"2023-11-28T20:00:29.436453+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"44","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs2"}},"read_balance":{"score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e84245ac-b5da-429e-af18-39acaa2b33e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6800","nonce":3358701235},{"type":"v1","addr":"172.21.15.78:6801","nonce":3358701235}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6802","nonce":3358701235},{"type":"v1","addr":"172.21.15.78:6803","nonce":3358701235}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6806","nonce":3358701235},{"type":"v1","addr":"172.21.15.78:6807","nonce":3358701235}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6804","nonce":3358701235},{"type":"v1","addr":"172.21.15.78:6805","nonce":3358701235}]},"public_addr":"172.21.15.78:6801/3358701235","cluster_addr":"172.21.15.78:6803/3358701235","heartbeat_back_addr":"172.21.15.78:6807/3358701235","heartbeat_front_addr":"172.21.15.78:6805/3358701235","state":["exists","up"]},{"osd":1,"uuid":"e634831d-c4e2-48d9-870c-9556ae162981","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6808","nonce":3211476654},{"type":"v1","addr":"172.21.15.78:6809","nonce":3211476654}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6810","nonce":3211476654},{"type":"v1","addr":"172.21.15.78:6811","nonce":3211476654}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6814","nonce":3211476654},{"type":"v1","addr":"172.21.15.78:6815","nonce":3211476654}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6812","nonce":3211476654},{"type":"v1","addr":"172.21.15.78:6813","nonce":3211476654}]},"public_addr":"172.21.15.78:6809/3211476654","cluster_addr":"172.21.15.78:6811/3211476654","heartbeat_back_addr":"172.21.15.78:6815/3211476654","heartbeat_front_addr":"172.21.15.78:6813/3211476654","state":["exists","up"]},{"osd":2,"uuid":"274c8395-6534-41f0-b8fb-a00af8985aa8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6816","nonce":2532904479},{"type":"v1","addr":"172.21.15.78:6817","nonce":2532904479}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6818","nonce":2532904479},{"type":"v1","addr":"172.21.15.78:6819","nonce":2532904479}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6822","nonce":2532904479},{"type":"v1","addr":"172.21.15.78:6823","nonce":2532904479}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6820","nonce":2532904479},{"type":"v1","addr":"172.21.15.78:6821","nonce":2532904479}]},"public_addr":"172.21.15.78:6817/2532904479","cluster_addr":"172.21.15.78:6819/2532904479","heartbeat_back_addr":"172.21.15.78:6823/2532904479","heartbeat_front_addr":"172.21.15.78:6821/2532904479","state":["exists","up"]},{"osd":3,"uuid":"77acc9af-7d4d-4b18-8cf5-d62f5971b7c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6824","nonce":3442991267},{"type":"v1","addr":"172.21.15.78:6825","nonce":3442991267}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6826","nonce":3442991267},{"type":"v1","addr":"172.21.15.78:6827","nonce":3442991267}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6830","nonce":3442991267},{"type":"v1","addr":"172.21.15.78:6831","nonce":3442991267}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6828","nonce":3442991267},{"type":"v1","addr":"172.21.15.78:6829","nonce":3442991267}]},"public_addr":"172.21.15.78:6825/3442991267","cluster_addr":"172.21.15.78:6827/3442991267","heartbeat_back_addr":"172.21.15.78:6831/3442991267","heartbeat_front_addr":"172.21.15.78:6829/3442991267","state":["exists","up"]},{"osd":4,"uuid":"5c62bc66-6b34-4b7f-a66b-9a743969138c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":802983577},{"type":"v1","addr":"172.21.15.179:6809","nonce":802983577}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":802983577},{"type":"v1","addr":"172.21.15.179:6811","nonce":802983577}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":802983577},{"type":"v1","addr":"172.21.15.179:6815","nonce":802983577}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":802983577},{"type":"v1","addr":"172.21.15.179:6813","nonce":802983577}]},"public_addr":"172.21.15.179:6809/802983577","cluster_addr":"172.21.15.179:6811/802983577","heartbeat_back_addr":"172.21.15.179:6815/802983577","heartbeat_front_addr":"172.21.15.179:6813/802983577","state":["exists","up"]},{"osd":5,"uuid":"67db6d36-f684-4079-b0cd-82b4dd61461f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":518192887},{"type":"v1","addr":"172.21.15.179:6818","nonce":518192887}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":518192887},{"type":"v1","addr":"172.21.15.179:6822","nonce":518192887}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":518192887},{"type":"v1","addr":"172.21.15.179:6829","nonce":518192887}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6824","nonce":518192887},{"type":"v1","addr":"172.21.15.179:6826","nonce":518192887}]},"public_addr":"172.21.15.179:6818/518192887","cluster_addr":"172.21.15.179:6822/518192887","heartbeat_back_addr":"172.21.15.179:6829/518192887","heartbeat_front_addr":"172.21.15.179:6826/518192887","state":["exists","up"]},{"osd":6,"uuid":"12e670af-5a16-4c81-9f97-defa66cab967","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":815435378},{"type":"v1","addr":"172.21.15.179:6801","nonce":815435378}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":815435378},{"type":"v1","addr":"172.21.15.179:6803","nonce":815435378}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":815435378},{"type":"v1","addr":"172.21.15.179:6807","nonce":815435378}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":815435378},{"type":"v1","addr":"172.21.15.179:6805","nonce":815435378}]},"public_addr":"172.21.15.179:6801/815435378","cluster_addr":"172.21.15.179:6803/815435378","heartbeat_back_addr":"172.21.15.179:6807/815435378","heartbeat_front_addr":"172.21.15.179:6805/815435378","state":["exists","up"]},{"osd":7,"uuid":"fe630650-2eb3-49ad-8676-c341e6332eb1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6817","nonce":2848432339},{"type":"v1","addr":"172.21.15.179:6819","nonce":2848432339}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6821","nonce":2848432339},{"type":"v1","addr":"172.21.15.179:6823","nonce":2848432339}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":2848432339},{"type":"v1","addr":"172.21.15.179:6831","nonce":2848432339}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6825","nonce":2848432339},{"type":"v1","addr":"172.21.15.179:6827","nonce":2848432339}]},"public_addr":"172.21.15.179:6819/2848432339","cluster_addr":"172.21.15.179:6823/2848432339","heartbeat_back_addr":"172.21.15.179:6831/2848432339","heartbeat_front_addr":"172.21.15.179:6827/2848432339","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:58:49.255433+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:58:49.412880+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:58:49.559295+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:58:49.245237+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:58:49.184557+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:58:49.329851+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:58:49.366012+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:58:49.349604+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-28T20:00:40.524 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:40.521+0000 7fa620a3a640 1 -- 172.21.15.78:0/772016531 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fa608066470 msgr2=0x7fa608068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:00:40.525 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:40.521+0000 7fa620a3a640 1 --2- 172.21.15.78:0/772016531 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fa608066470 0x7fa608068930 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fa61c0c3060 tx=0x7fa610007b80 comp rx=0 tx=0).stop 2023-11-28T20:00:40.525 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:40.521+0000 7fa620a3a640 1 -- 172.21.15.78:0/772016531 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa61c0a4e30 msgr2=0x7fa61c0a59b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:00:40.525 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:40.521+0000 7fa620a3a640 1 --2- 172.21.15.78:0/772016531 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa61c0a4e30 0x7fa61c0a59b0 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7fa60c0ae040 tx=0x7fa60c019170 comp rx=0 tx=0).stop 2023-11-28T20:00:40.525 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:40.521+0000 7fa620a3a640 1 -- 172.21.15.78:0/772016531 shutdown_connections 2023-11-28T20:00:40.525 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:40.521+0000 7fa620a3a640 1 --2- 172.21.15.78:0/772016531 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fa608066470 0x7fa608068930 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:40.525 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:40.521+0000 7fa620a3a640 1 --2- 172.21.15.78:0/772016531 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa61c0c5900 0x7fa61c14bfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:40.525 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:40.521+0000 7fa620a3a640 1 --2- 172.21.15.78:0/772016531 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa61c0aa990 0x7fa61c14baa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:40.525 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:40.521+0000 7fa620a3a640 1 --2- 172.21.15.78:0/772016531 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa61c0a4e30 0x7fa61c0a59b0 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:40.525 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:40.521+0000 7fa620a3a640 1 -- 172.21.15.78:0/772016531 >> 172.21.15.78:0/772016531 conn(0x7fa61c0a7600 msgr2=0x7fa61c0c0e10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:00:40.525 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:40.521+0000 7fa620a3a640 1 -- 172.21.15.78:0/772016531 shutdown_connections 2023-11-28T20:00:40.525 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:40.521+0000 7fa620a3a640 1 -- 172.21.15.78:0/772016531 wait complete. 2023-11-28T20:00:40.544 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-28T19:58:54.011229+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-28T20:00:10.831194+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '39', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.25, 'score_stable': 1.25, 'optimal_score': 1, 'raw_score_acting': 1.25, 'raw_score_stable': 1.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 6, 'pool_name': 'cephfs_data', 'create_time': '2023-11-28T20:00:12.150184+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '40', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 7, 'pool_name': 'cephfs2_metadata', 'create_time': '2023-11-28T20:00:28.571896+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '43', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs2'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 8, 'pool_name': 'cephfs2_data', 'create_time': '2023-11-28T20:00:29.436453+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '44', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs2'}}, 'read_balance': {'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-28T20:00:40.544 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-28T20:00:40.685 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:40.681+0000 7f2cd599d640 1 Processor -- start 2023-11-28T20:00:40.685 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:40.681+0000 7f2cd599d640 1 -- start start 2023-11-28T20:00:40.687 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:40.681+0000 7f2cd599d640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f2cd006b820 0x7f2cd00a93d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:40.687 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:40.681+0000 7f2cd599d640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2cd00abe90 0x7f2cd0152ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:40.688 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:40.681+0000 7f2cd599d640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f2cd00c1290 0x7f2cd014f6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:40.688 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:40.681+0000 7f2cd599d640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2cd00ab760 con 0x7f2cd006b820 2023-11-28T20:00:40.688 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:40.681+0000 7f2cd599d640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2cd00aba40 con 0x7f2cd00c1290 2023-11-28T20:00:40.688 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:40.681+0000 7f2cd599d640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2cd0152410 con 0x7f2cd00abe90 2023-11-28T20:00:40.688 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:40.681+0000 7f2cceffd640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f2cd006b820 0x7f2cd00a93d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:40.689 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:40.681+0000 7f2cceffd640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f2cd006b820 0x7f2cd00a93d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:58218/0 (socket says 172.21.15.78:58218) 2023-11-28T20:00:40.689 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:40.681+0000 7f2cceffd640 1 -- 172.21.15.78:0/3094635302 learned_addr learned my addr 172.21.15.78:0/3094635302 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T20:00:40.689 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:40.681+0000 7f2cceffd640 1 -- 172.21.15.78:0/3094635302 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2cd00abe90 msgr2=0x7f2cd0152ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:00:40.689 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:40.681+0000 7f2cc67fc640 1 --2- 172.21.15.78:0/3094635302 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2cd00abe90 0x7f2cd0152ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:40.690 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:40.681+0000 7f2ccf7fe640 1 --2- 172.21.15.78:0/3094635302 >> v2:172.21.15.179:3300/0 conn(0x7f2cd00c1290 0x7f2cd014f6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:40.690 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:40.681+0000 7f2cceffd640 1 --2- 172.21.15.78:0/3094635302 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2cd00abe90 0x7f2cd0152ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:40.690 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:40.681+0000 7f2cceffd640 1 -- 172.21.15.78:0/3094635302 >> v2:172.21.15.179:3300/0 conn(0x7f2cd00c1290 msgr2=0x7f2cd014f6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:00:40.690 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:40.681+0000 7f2cceffd640 1 --2- 172.21.15.78:0/3094635302 >> v2:172.21.15.179:3300/0 conn(0x7f2cd00c1290 0x7f2cd014f6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:40.691 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:40.681+0000 7f2cceffd640 1 -- 172.21.15.78:0/3094635302 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2cd01526f0 con 0x7f2cd006b820 2023-11-28T20:00:40.691 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:40.681+0000 7f2cc67fc640 1 --2- 172.21.15.78:0/3094635302 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2cd00abe90 0x7f2cd0152ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T20:00:40.691 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:40.681+0000 7f2ccf7fe640 1 --2- 172.21.15.78:0/3094635302 >> v2:172.21.15.179:3300/0 conn(0x7f2cd00c1290 0x7f2cd014f6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T20:00:40.692 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:40.685+0000 7f2cceffd640 1 --2- 172.21.15.78:0/3094635302 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2cd006b820 0x7f2cd00a93d0 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f2cd0156990 tx=0x7f2cc001c3e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e854f6422296b587 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:00:40.692 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:40.685+0000 7f2cce7fc640 1 -- 172.21.15.78:0/3094635302 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cc00ab600 con 0x7f2cd006b820 2023-11-28T20:00:40.692 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:40.685+0000 7f2cce7fc640 1 -- 172.21.15.78:0/3094635302 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2cc00a7050 con 0x7f2cd006b820 2023-11-28T20:00:40.692 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:40.685+0000 7f2cce7fc640 1 -- 172.21.15.78:0/3094635302 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cc00ab980 con 0x7f2cd006b820 2023-11-28T20:00:40.693 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:40.685+0000 7f2cd599d640 1 -- 172.21.15.78:0/3094635302 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2cd006b820 msgr2=0x7f2cd00a93d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:00:40.693 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:40.685+0000 7f2cd599d640 1 --2- 172.21.15.78:0/3094635302 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2cd006b820 0x7f2cd00a93d0 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f2cd0156990 tx=0x7f2cc001c3e0 comp rx=0 tx=0).stop 2023-11-28T20:00:40.693 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:40.685+0000 7f2cd599d640 1 -- 172.21.15.78:0/3094635302 shutdown_connections 2023-11-28T20:00:40.693 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:40.685+0000 7f2cd599d640 1 --2- 172.21.15.78:0/3094635302 >> v2:172.21.15.179:3300/0 conn(0x7f2cd00c1290 0x7f2cd014f6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:40.693 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:40.685+0000 7f2cd599d640 1 --2- 172.21.15.78:0/3094635302 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2cd00abe90 0x7f2cd0152ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:40.693 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:40.685+0000 7f2cd599d640 1 --2- 172.21.15.78:0/3094635302 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2cd006b820 0x7f2cd00a93d0 unknown :-1 s=CLOSED pgs=474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:40.693 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:40.685+0000 7f2cd599d640 1 -- 172.21.15.78:0/3094635302 >> 172.21.15.78:0/3094635302 conn(0x7f2cd00c2e20 msgr2=0x7f2cd00c3230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:00:40.694 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:40.685+0000 7f2cd599d640 1 -- 172.21.15.78:0/3094635302 shutdown_connections 2023-11-28T20:00:40.694 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:40.685+0000 7f2cd599d640 1 -- 172.21.15.78:0/3094635302 wait complete. 2023-11-28T20:00:40.694 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:40.689+0000 7f2cd599d640 1 Processor -- start 2023-11-28T20:00:40.696 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:40.689+0000 7f2cd599d640 1 -- start start 2023-11-28T20:00:40.696 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:40.689+0000 7f2cd599d640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2cd006b820 0x7f2cd01540b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:40.697 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:40.689+0000 7f2cd599d640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2cd00abe90 0x7f2cd0148ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:40.697 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:40.689+0000 7f2cd599d640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2cd00c1290 0x7f2cd0144ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:40.697 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:40.689+0000 7f2cd599d640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2cd01547f0 con 0x7f2cd00abe90 2023-11-28T20:00:40.697 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:40.689+0000 7f2cd599d640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2cd01f04c0 con 0x7f2cd00c1290 2023-11-28T20:00:40.697 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:40.689+0000 7f2cd599d640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2cd01f0d60 con 0x7f2cd006b820 2023-11-28T20:00:40.697 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:40.689+0000 7f2cc67fc640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2cd00abe90 0x7f2cd0148ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:40.697 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:40.689+0000 7f2cc67fc640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2cd00abe90 0x7f2cd0148ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:58224/0 (socket says 172.21.15.78:58224) 2023-11-28T20:00:40.698 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:40.689+0000 7f2cc67fc640 1 -- 172.21.15.78:0/283844540 learned_addr learned my addr 172.21.15.78:0/283844540 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T20:00:40.698 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:40.689+0000 7f2cceffd640 1 --2- 172.21.15.78:0/283844540 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2cd006b820 0x7f2cd01540b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:40.698 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:40.689+0000 7f2ccf7fe640 1 --2- 172.21.15.78:0/283844540 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2cd00c1290 0x7f2cd0144ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:40.698 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:40.689+0000 7f2cc67fc640 1 -- 172.21.15.78:0/283844540 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2cd006b820 msgr2=0x7f2cd01540b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:00:40.698 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:40.689+0000 7f2cc67fc640 1 --2- 172.21.15.78:0/283844540 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2cd006b820 0x7f2cd01540b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:40.698 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:40.689+0000 7f2cc67fc640 1 -- 172.21.15.78:0/283844540 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2cd00c1290 msgr2=0x7f2cd0144ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:00:40.698 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:40.689+0000 7f2cc67fc640 1 --2- 172.21.15.78:0/283844540 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2cd00c1290 0x7f2cd0144ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:40.698 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:40.689+0000 7f2cc67fc640 1 -- 172.21.15.78:0/283844540 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2cc00094d0 con 0x7f2cd00abe90 2023-11-28T20:00:40.699 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:40.689+0000 7f2ccf7fe640 1 --2- 172.21.15.78:0/283844540 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2cd00c1290 0x7f2cd0144ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T20:00:40.699 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:40.689+0000 7f2cc67fc640 1 --2- 172.21.15.78:0/283844540 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2cd00abe90 0x7f2cd0148ec0 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f2cb800cf10 tx=0x7f2cb800a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:00:40.699 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:40.689+0000 7f2cccff9640 1 -- 172.21.15.78:0/283844540 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cb800d840 con 0x7f2cd00abe90 2023-11-28T20:00:40.699 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:40.689+0000 7f2cccff9640 1 -- 172.21.15.78:0/283844540 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2cb800d9a0 con 0x7f2cd00abe90 2023-11-28T20:00:40.699 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:40.689+0000 7f2cd599d640 1 -- 172.21.15.78:0/283844540 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2cd014efe0 con 0x7f2cd00abe90 2023-11-28T20:00:40.699 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:40.689+0000 7f2cccff9640 1 -- 172.21.15.78:0/283844540 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cb800dd30 con 0x7f2cd00abe90 2023-11-28T20:00:40.699 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:40.689+0000 7f2cd599d640 1 -- 172.21.15.78:0/283844540 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2cd01f09f0 con 0x7f2cd00abe90 2023-11-28T20:00:40.699 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:40.693+0000 7f2cd599d640 1 -- 172.21.15.78:0/283844540 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2cd0067630 con 0x7f2cd00abe90 2023-11-28T20:00:40.700 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:40.693+0000 7f2cccff9640 1 -- 172.21.15.78:0/283844540 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f2cb8015440 con 0x7f2cd00abe90 2023-11-28T20:00:40.700 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:40.693+0000 7f2cccff9640 1 --2- 172.21.15.78:0/283844540 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f2cb0066470 0x7f2cb0068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:40.701 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:40.693+0000 7f2cccff9640 1 -- 172.21.15.78:0/283844540 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 6885+0+0 (secure 0 0 0) 0x7f2cb8084c60 con 0x7f2cd00abe90 2023-11-28T20:00:40.701 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:40.693+0000 7f2cceffd640 1 --2- 172.21.15.78:0/283844540 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f2cb0066470 0x7f2cb0068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:40.701 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:40.693+0000 7f2cceffd640 1 --2- 172.21.15.78:0/283844540 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f2cb0066470 0x7f2cb0068930 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f2cc00ad000 tx=0x7f2cc0008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:00:40.702 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:40.697+0000 7f2cccff9640 1 -- 172.21.15.78:0/283844540 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f2cb8051ce0 con 0x7f2cd00abe90 2023-11-28T20:00:40.856 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:40.853+0000 7f2cd599d640 1 -- 172.21.15.78:0/283844540 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f2cd01f0ea0 con 0x7f2cd00abe90 2023-11-28T20:00:40.857 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:40.853+0000 7f2cccff9640 1 -- 172.21.15.78:0/283844540 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v44) v1 ==== 93+0+10 (secure 0 0 0) 0x7f2cb801a020 con 0x7f2cd00abe90 2023-11-28T20:00:40.857 INFO:teuthology.orchestra.run.smithi078.stdout:pg_num: 1 2023-11-28T20:00:40.859 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:40.853+0000 7f2cd599d640 1 -- 172.21.15.78:0/283844540 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f2cb0066470 msgr2=0x7f2cb0068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:00:40.859 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:40.853+0000 7f2cd599d640 1 --2- 172.21.15.78:0/283844540 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f2cb0066470 0x7f2cb0068930 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f2cc00ad000 tx=0x7f2cc0008040 comp rx=0 tx=0).stop 2023-11-28T20:00:40.859 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:40.853+0000 7f2cd599d640 1 -- 172.21.15.78:0/283844540 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2cd00abe90 msgr2=0x7f2cd0148ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:00:40.859 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:40.853+0000 7f2cd599d640 1 --2- 172.21.15.78:0/283844540 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2cd00abe90 0x7f2cd0148ec0 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f2cb800cf10 tx=0x7f2cb800a710 comp rx=0 tx=0).stop 2023-11-28T20:00:40.859 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:40.853+0000 7f2cd599d640 1 -- 172.21.15.78:0/283844540 shutdown_connections 2023-11-28T20:00:40.859 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:40.853+0000 7f2cd599d640 1 --2- 172.21.15.78:0/283844540 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f2cb0066470 0x7f2cb0068930 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:40.859 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:40.853+0000 7f2cd599d640 1 --2- 172.21.15.78:0/283844540 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2cd00c1290 0x7f2cd0144ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:40.859 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:40.853+0000 7f2cd599d640 1 --2- 172.21.15.78:0/283844540 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2cd00abe90 0x7f2cd0148ec0 unknown :-1 s=CLOSED pgs=475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:40.860 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:40.853+0000 7f2cd599d640 1 --2- 172.21.15.78:0/283844540 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2cd006b820 0x7f2cd01540b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:40.860 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:40.853+0000 7f2cd599d640 1 -- 172.21.15.78:0/283844540 >> 172.21.15.78:0/283844540 conn(0x7f2cd00c2e20 msgr2=0x7f2cd00733c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:00:40.860 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:40.853+0000 7f2cd599d640 1 -- 172.21.15.78:0/283844540 shutdown_connections 2023-11-28T20:00:40.860 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:40.853+0000 7f2cd599d640 1 -- 172.21.15.78:0/283844540 wait complete. 2023-11-28T20:00:40.877 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-28T20:00:41.018 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:41.013+0000 7f8b6b6c9640 1 Processor -- start 2023-11-28T20:00:41.018 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:41.013+0000 7f8b6b6c9640 1 -- start start 2023-11-28T20:00:41.019 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:41.013+0000 7f8b6b6c9640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f8b6414f850 0x7f8b640aacf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:41.020 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:41.013+0000 7f8b6b6c9640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8b6414fc30 0x7f8b640c3cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:41.020 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:41.013+0000 7f8b6b6c9640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8b64152910 con 0x7f8b6406d840 2023-11-28T20:00:41.020 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:41.013+0000 7f8b6b6c9640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8b640c2240 con 0x7f8b6414f850 2023-11-28T20:00:41.020 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:41.013+0000 7f8b6b6c9640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b64152bf0 con 0x7f8b6414fc30 2023-11-28T20:00:41.020 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:41.017+0000 7f8b69465640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f8b6414f850 0x7f8b640aacf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:41.021 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:41.017+0000 7f8b69465640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f8b6414f850 0x7f8b640aacf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:58236/0 (socket says 172.21.15.78:58236) 2023-11-28T20:00:41.021 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:41.017+0000 7f8b69465640 1 -- 172.21.15.78:0/3083302157 learned_addr learned my addr 172.21.15.78:0/3083302157 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T20:00:41.022 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:41.017+0000 7f8b68c64640 1 --2- 172.21.15.78:0/3083302157 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8b6414fc30 0x7f8b640c3cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:41.022 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:41.017+0000 7f8b69465640 1 -- 172.21.15.78:0/3083302157 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8b6414fc30 msgr2=0x7f8b640c3cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:00:41.022 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:41.017+0000 7f8b69465640 1 --2- 172.21.15.78:0/3083302157 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8b6414fc30 0x7f8b640c3cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:41.022 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:41.017+0000 7f8b69465640 1 -- 172.21.15.78:0/3083302157 >> v1:172.21.15.179:6789/0 conn(0x7f8b6406d840 legacy=0x7f8b640c4210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:00:41.022 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:41.017+0000 7f8b69465640 1 -- 172.21.15.78:0/3083302157 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b64152ed0 con 0x7f8b6414f850 2023-11-28T20:00:41.022 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:41.017+0000 7f8b68c64640 1 --2- 172.21.15.78:0/3083302157 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8b6414fc30 0x7f8b640c3cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T20:00:41.023 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:41.017+0000 7f8b69465640 1 --2- 172.21.15.78:0/3083302157 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8b6414f850 0x7f8b640aacf0 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f8b60009870 tx=0x7f8b6001c500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e805a622f5a9af40 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:00:41.023 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:41.017+0000 7f8b5bfff640 1 -- 172.21.15.78:0/3083302157 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b600aa640 con 0x7f8b6414f850 2023-11-28T20:00:41.023 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:41.017+0000 7f8b5bfff640 1 -- 172.21.15.78:0/3083302157 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b600aa7a0 con 0x7f8b6414f850 2023-11-28T20:00:41.024 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:41.017+0000 7f8b5bfff640 1 -- 172.21.15.78:0/3083302157 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b600aab30 con 0x7f8b6414f850 2023-11-28T20:00:41.024 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:41.021+0000 7f8b6b6c9640 1 -- 172.21.15.78:0/3083302157 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8b6414f850 msgr2=0x7f8b640aacf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:00:41.025 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:41.021+0000 7f8b6b6c9640 1 --2- 172.21.15.78:0/3083302157 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8b6414f850 0x7f8b640aacf0 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f8b60009870 tx=0x7f8b6001c500 comp rx=0 tx=0).stop 2023-11-28T20:00:41.025 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:41.021+0000 7f8b6b6c9640 1 -- 172.21.15.78:0/3083302157 shutdown_connections 2023-11-28T20:00:41.025 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:41.021+0000 7f8b6b6c9640 1 --2- 172.21.15.78:0/3083302157 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8b6414fc30 0x7f8b640c3cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:41.025 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:41.021+0000 7f8b6b6c9640 1 --2- 172.21.15.78:0/3083302157 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8b6414f850 0x7f8b640aacf0 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:41.025 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:41.021+0000 7f8b6b6c9640 1 -- 172.21.15.78:0/3083302157 >> 172.21.15.78:0/3083302157 conn(0x7f8b640c59f0 msgr2=0x7f8b640c5e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:00:41.025 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:41.021+0000 7f8b6b6c9640 1 -- 172.21.15.78:0/3083302157 shutdown_connections 2023-11-28T20:00:41.026 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:41.021+0000 7f8b6b6c9640 1 -- 172.21.15.78:0/3083302157 wait complete. 2023-11-28T20:00:41.027 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:41.021+0000 7f8b6b6c9640 1 Processor -- start 2023-11-28T20:00:41.028 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:41.021+0000 7f8b6b6c9640 1 -- start start 2023-11-28T20:00:41.028 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:41.021+0000 7f8b6b6c9640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8b6406d840 0x7f8b64071db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:41.028 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:41.021+0000 7f8b6b6c9640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8b6414f850 0x7f8b640722f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:41.028 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:41.021+0000 7f8b6b6c9640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8b6414fc30 0x7f8b641517d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:41.028 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:41.021+0000 7f8b6b6c9640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b64147b80 con 0x7f8b6414fc30 2023-11-28T20:00:41.028 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:41.021+0000 7f8b6b6c9640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b640a5f40 con 0x7f8b6414f850 2023-11-28T20:00:41.029 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:41.021+0000 7f8b6b6c9640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b640a7050 con 0x7f8b6406d840 2023-11-28T20:00:41.029 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:41.021+0000 7f8b69c66640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8b6414fc30 0x7f8b641517d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:41.029 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:41.021+0000 7f8b69465640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8b6406d840 0x7f8b64071db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:41.029 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:41.021+0000 7f8b69c66640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8b6414fc30 0x7f8b641517d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:58238/0 (socket says 172.21.15.78:58238) 2023-11-28T20:00:41.029 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:41.021+0000 7f8b69c66640 1 -- 172.21.15.78:0/3645057265 learned_addr learned my addr 172.21.15.78:0/3645057265 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T20:00:41.029 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:41.021+0000 7f8b68c64640 1 --2- 172.21.15.78:0/3645057265 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8b6414f850 0x7f8b640722f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:41.030 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:41.021+0000 7f8b69c66640 1 -- 172.21.15.78:0/3645057265 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8b6406d840 msgr2=0x7f8b64071db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:00:41.030 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:41.021+0000 7f8b69c66640 1 --2- 172.21.15.78:0/3645057265 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8b6406d840 0x7f8b64071db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:41.030 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:41.021+0000 7f8b69c66640 1 -- 172.21.15.78:0/3645057265 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8b6414f850 msgr2=0x7f8b640722f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:00:41.030 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:41.021+0000 7f8b69c66640 1 --2- 172.21.15.78:0/3645057265 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8b6414f850 0x7f8b640722f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:41.030 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:41.021+0000 7f8b69c66640 1 -- 172.21.15.78:0/3645057265 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b600094d0 con 0x7f8b6414fc30 2023-11-28T20:00:41.032 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:41.025+0000 7f8b69c66640 1 --2- 172.21.15.78:0/3645057265 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8b6414fc30 0x7f8b641517d0 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f8b5c00c780 tx=0x7f8b5c00cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:00:41.032 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:41.025+0000 7f8b59ffb640 1 -- 172.21.15.78:0/3645057265 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b5c00a9f0 con 0x7f8b6414fc30 2023-11-28T20:00:41.032 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:41.025+0000 7f8b59ffb640 1 -- 172.21.15.78:0/3645057265 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b5c00ce90 con 0x7f8b6414fc30 2023-11-28T20:00:41.032 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:41.025+0000 7f8b59ffb640 1 -- 172.21.15.78:0/3645057265 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b5c00add0 con 0x7f8b6414fc30 2023-11-28T20:00:41.032 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:41.025+0000 7f8b6b6c9640 1 -- 172.21.15.78:0/3645057265 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8b640a7330 con 0x7f8b6414fc30 2023-11-28T20:00:41.032 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:41.025+0000 7f8b6b6c9640 1 -- 172.21.15.78:0/3645057265 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8b640a64e0 con 0x7f8b6414fc30 2023-11-28T20:00:41.032 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:41.025+0000 7f8b6b6c9640 1 -- 172.21.15.78:0/3645057265 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8b64067630 con 0x7f8b6414fc30 2023-11-28T20:00:41.032 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:41.025+0000 7f8b59ffb640 1 -- 172.21.15.78:0/3645057265 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f8b5c012420 con 0x7f8b6414fc30 2023-11-28T20:00:41.032 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:41.025+0000 7f8b59ffb640 1 --2- 172.21.15.78:0/3645057265 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f8b48066470 0x7f8b48068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:41.033 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:41.025+0000 7f8b59ffb640 1 -- 172.21.15.78:0/3645057265 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 6885+0+0 (secure 0 0 0) 0x7f8b5c0840f0 con 0x7f8b6414fc30 2023-11-28T20:00:41.033 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:41.025+0000 7f8b69465640 1 --2- 172.21.15.78:0/3645057265 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f8b48066470 0x7f8b48068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:41.033 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:41.029+0000 7f8b69465640 1 --2- 172.21.15.78:0/3645057265 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f8b48066470 0x7f8b48068930 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f8b600ae000 tx=0x7f8b600b5040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:00:41.035 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:41.029+0000 7f8b59ffb640 1 -- 172.21.15.78:0/3645057265 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f8b5c0510f0 con 0x7f8b6414fc30 2023-11-28T20:00:41.185 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:41.181+0000 7f8b6b6c9640 1 -- 172.21.15.78:0/3645057265 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f8b640c4c80 con 0x7f8b6414fc30 2023-11-28T20:00:41.186 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:41.181+0000 7f8b59ffb640 1 -- 172.21.15.78:0/3645057265 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v44) v1 ==== 104+0+11 (secure 0 0 0) 0x7f8b5c016020 con 0x7f8b6414fc30 2023-11-28T20:00:41.186 INFO:teuthology.orchestra.run.smithi078.stdout:pg_num: 32 2023-11-28T20:00:41.188 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:41.181+0000 7f8b6b6c9640 1 -- 172.21.15.78:0/3645057265 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f8b48066470 msgr2=0x7f8b48068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:00:41.189 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:41.181+0000 7f8b6b6c9640 1 --2- 172.21.15.78:0/3645057265 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f8b48066470 0x7f8b48068930 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f8b600ae000 tx=0x7f8b600b5040 comp rx=0 tx=0).stop 2023-11-28T20:00:41.189 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:41.181+0000 7f8b6b6c9640 1 -- 172.21.15.78:0/3645057265 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8b6414fc30 msgr2=0x7f8b641517d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:00:41.189 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:41.181+0000 7f8b6b6c9640 1 --2- 172.21.15.78:0/3645057265 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8b6414fc30 0x7f8b641517d0 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f8b5c00c780 tx=0x7f8b5c00cc40 comp rx=0 tx=0).stop 2023-11-28T20:00:41.189 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:41.181+0000 7f8b6b6c9640 1 -- 172.21.15.78:0/3645057265 shutdown_connections 2023-11-28T20:00:41.189 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:41.181+0000 7f8b6b6c9640 1 --2- 172.21.15.78:0/3645057265 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f8b48066470 0x7f8b48068930 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:41.189 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:41.181+0000 7f8b6b6c9640 1 --2- 172.21.15.78:0/3645057265 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8b6414fc30 0x7f8b641517d0 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:41.190 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:41.181+0000 7f8b6b6c9640 1 --2- 172.21.15.78:0/3645057265 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8b6414f850 0x7f8b640722f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:41.190 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:41.181+0000 7f8b6b6c9640 1 --2- 172.21.15.78:0/3645057265 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8b6406d840 0x7f8b64071db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:41.190 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:41.181+0000 7f8b6b6c9640 1 -- 172.21.15.78:0/3645057265 >> 172.21.15.78:0/3645057265 conn(0x7f8b640c59f0 msgr2=0x7f8b6414f030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:00:41.190 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:41.185+0000 7f8b6b6c9640 1 -- 172.21.15.78:0/3645057265 shutdown_connections 2023-11-28T20:00:41.190 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:41.185+0000 7f8b6b6c9640 1 -- 172.21.15.78:0/3645057265 wait complete. 2023-11-28T20:00:41.207 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-28T20:00:41.348 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:41.341+0000 7f68404dd640 1 Processor -- start 2023-11-28T20:00:41.348 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:41.341+0000 7f68404dd640 1 -- start start 2023-11-28T20:00:41.349 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:41.345+0000 7f68404dd640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f683814b1e0 0x7f68380c1700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:41.349 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:41.345+0000 7f68404dd640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f68381548c0 0x7f6838154d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:41.350 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:41.345+0000 7f68404dd640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f68380a4e20 con 0x7f68380c5300 2023-11-28T20:00:41.350 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:41.345+0000 7f68404dd640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f68380a50e0 con 0x7f68381548c0 2023-11-28T20:00:41.350 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:41.345+0000 7f68404dd640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f68380c0f00 con 0x7f683814b1e0 2023-11-28T20:00:41.350 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:41.345+0000 7f683ea7a640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f68381548c0 0x7f6838154d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:41.350 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:41.345+0000 7f683ea7a640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f68381548c0 0x7f6838154d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:58244/0 (socket says 172.21.15.78:58244) 2023-11-28T20:00:41.350 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:41.345+0000 7f683ea7a640 1 -- 172.21.15.78:0/3400947375 learned_addr learned my addr 172.21.15.78:0/3400947375 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T20:00:41.350 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:41.345+0000 7f683e279640 1 --2- 172.21.15.78:0/3400947375 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f683814b1e0 0x7f68380c1700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:41.350 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:41.345+0000 7f683ea7a640 1 -- 172.21.15.78:0/3400947375 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f683814b1e0 msgr2=0x7f68380c1700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:00:41.350 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:41.345+0000 7f683ea7a640 1 --2- 172.21.15.78:0/3400947375 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f683814b1e0 0x7f68380c1700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:41.350 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:41.345+0000 7f683ea7a640 1 -- 172.21.15.78:0/3400947375 >> v1:172.21.15.179:6789/0 conn(0x7f68380c5300 legacy=0x7f68380a9c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:00:41.351 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:41.345+0000 7f683ea7a640 1 -- 172.21.15.78:0/3400947375 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68380c11e0 con 0x7f68381548c0 2023-11-28T20:00:41.352 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:41.349+0000 7f683ea7a640 1 --2- 172.21.15.78:0/3400947375 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f68381548c0 0x7f6838154d50 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f68380c3b30 tx=0x7f683001c9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=76e6581b3dad4ca8 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:00:41.353 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:41.349+0000 7f683d277640 1 -- 172.21.15.78:0/3400947375 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68381558b0 con 0x7f68381548c0 2023-11-28T20:00:41.353 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:41.349+0000 7f683d277640 1 -- 172.21.15.78:0/3400947375 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f68300a5740 con 0x7f68381548c0 2023-11-28T20:00:41.353 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:41.349+0000 7f683d277640 1 -- 172.21.15.78:0/3400947375 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68300a5ad0 con 0x7f68381548c0 2023-11-28T20:00:41.354 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:41.349+0000 7f68404dd640 1 -- 172.21.15.78:0/3400947375 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f68381548c0 msgr2=0x7f6838154d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:00:41.354 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:41.349+0000 7f68404dd640 1 --2- 172.21.15.78:0/3400947375 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f68381548c0 0x7f6838154d50 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f68380c3b30 tx=0x7f683001c9b0 comp rx=0 tx=0).stop 2023-11-28T20:00:41.354 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:41.349+0000 7f68404dd640 1 -- 172.21.15.78:0/3400947375 shutdown_connections 2023-11-28T20:00:41.354 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:41.349+0000 7f68404dd640 1 --2- 172.21.15.78:0/3400947375 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f68381548c0 0x7f6838154d50 unknown :-1 s=CLOSED pgs=478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:41.354 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:41.349+0000 7f68404dd640 1 --2- 172.21.15.78:0/3400947375 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f683814b1e0 0x7f68380c1700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:41.354 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:41.349+0000 7f68404dd640 1 -- 172.21.15.78:0/3400947375 >> 172.21.15.78:0/3400947375 conn(0x7f68380c59f0 msgr2=0x7f68380c5e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:00:41.354 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:41.349+0000 7f68404dd640 1 -- 172.21.15.78:0/3400947375 shutdown_connections 2023-11-28T20:00:41.354 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:41.349+0000 7f68404dd640 1 -- 172.21.15.78:0/3400947375 wait complete. 2023-11-28T20:00:41.355 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:41.349+0000 7f68404dd640 1 Processor -- start 2023-11-28T20:00:41.355 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:41.349+0000 7f68404dd640 1 -- start start 2023-11-28T20:00:41.357 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:41.353+0000 7f68404dd640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f68380c5300 0x7f68380befc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:41.357 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:41.353+0000 7f68404dd640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f683814b1e0 0x7f68381f0800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:41.357 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:41.353+0000 7f68404dd640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f68381548c0 0x7f6838141ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:41.358 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:41.353+0000 7f68404dd640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68380a6960 con 0x7f68380c5300 2023-11-28T20:00:41.358 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:41.353+0000 7f68404dd640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68380a6c40 con 0x7f683814b1e0 2023-11-28T20:00:41.358 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:41.353+0000 7f68404dd640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f68380a6f20 con 0x7f68381548c0 2023-11-28T20:00:41.358 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:41.353+0000 7f683e279640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f68380c5300 0x7f68380befc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:41.358 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:41.353+0000 7f683e279640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f68380c5300 0x7f68380befc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:58258/0 (socket says 172.21.15.78:58258) 2023-11-28T20:00:41.358 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:41.353+0000 7f683e279640 1 -- 172.21.15.78:0/2217934434 learned_addr learned my addr 172.21.15.78:0/2217934434 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T20:00:41.358 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:41.353+0000 7f683da78640 1 --2- 172.21.15.78:0/2217934434 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f683814b1e0 0x7f68381f0800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:41.358 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:41.353+0000 7f683ea7a640 1 --2- 172.21.15.78:0/2217934434 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f68381548c0 0x7f6838141ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:41.358 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:41.353+0000 7f683e279640 1 -- 172.21.15.78:0/2217934434 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f68381548c0 msgr2=0x7f6838141ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:00:41.358 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:41.353+0000 7f683e279640 1 --2- 172.21.15.78:0/2217934434 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f68381548c0 0x7f6838141ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:41.358 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:41.353+0000 7f683e279640 1 -- 172.21.15.78:0/2217934434 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f683814b1e0 msgr2=0x7f68381f0800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:00:41.358 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:41.353+0000 7f683e279640 1 --2- 172.21.15.78:0/2217934434 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f683814b1e0 0x7f68381f0800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:41.359 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:41.353+0000 7f683e279640 1 -- 172.21.15.78:0/2217934434 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6830009b30 con 0x7f68380c5300 2023-11-28T20:00:41.359 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:41.353+0000 7f683e279640 1 --2- 172.21.15.78:0/2217934434 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f68380c5300 0x7f68380befc0 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f683400d800 tx=0x7f683400dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:00:41.359 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:41.353+0000 7f682effd640 1 -- 172.21.15.78:0/2217934434 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f683400b6c0 con 0x7f68380c5300 2023-11-28T20:00:41.359 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:41.353+0000 7f682effd640 1 -- 172.21.15.78:0/2217934434 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f683400b820 con 0x7f68380c5300 2023-11-28T20:00:41.359 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:41.353+0000 7f682effd640 1 -- 172.21.15.78:0/2217934434 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f683400bb90 con 0x7f68380c5300 2023-11-28T20:00:41.359 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:41.353+0000 7f68404dd640 1 -- 172.21.15.78:0/2217934434 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f68381f02e0 con 0x7f68380c5300 2023-11-28T20:00:41.359 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:41.353+0000 7f68404dd640 1 -- 172.21.15.78:0/2217934434 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f68380bf8a0 con 0x7f68380c5300 2023-11-28T20:00:41.360 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:41.353+0000 7f68404dd640 1 -- 172.21.15.78:0/2217934434 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6838067630 con 0x7f68380c5300 2023-11-28T20:00:41.360 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:41.353+0000 7f682effd640 1 -- 172.21.15.78:0/2217934434 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f683400bcf0 con 0x7f68380c5300 2023-11-28T20:00:41.360 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:41.357+0000 7f682effd640 1 --2- 172.21.15.78:0/2217934434 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f681c066470 0x7f681c068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:41.360 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:41.357+0000 7f682effd640 1 -- 172.21.15.78:0/2217934434 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 6885+0+0 (secure 0 0 0) 0x7f6834084820 con 0x7f68380c5300 2023-11-28T20:00:41.360 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:41.357+0000 7f683da78640 1 --2- 172.21.15.78:0/2217934434 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f681c066470 0x7f681c068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:41.361 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:41.357+0000 7f683da78640 1 --2- 172.21.15.78:0/2217934434 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f681c066470 0x7f681c068930 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f6838149b80 tx=0x7f6828009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:00:41.364 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:41.361+0000 7f682effd640 1 -- 172.21.15.78:0/2217934434 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f6834051890 con 0x7f68380c5300 2023-11-28T20:00:41.512 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:41.509+0000 7f68404dd640 1 -- 172.21.15.78:0/2217934434 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f683806dc80 con 0x7f68380c5300 2023-11-28T20:00:41.512 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:41.509+0000 7f682effd640 1 -- 172.21.15.78:0/2217934434 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v44) v1 ==== 100+0+11 (secure 0 0 0) 0x7f6834011340 con 0x7f68380c5300 2023-11-28T20:00:41.512 INFO:teuthology.orchestra.run.smithi078.stdout:pg_num: 64 2023-11-28T20:00:41.514 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:41.509+0000 7f68404dd640 1 -- 172.21.15.78:0/2217934434 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f681c066470 msgr2=0x7f681c068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:00:41.514 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:41.509+0000 7f68404dd640 1 --2- 172.21.15.78:0/2217934434 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f681c066470 0x7f681c068930 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f6838149b80 tx=0x7f6828009040 comp rx=0 tx=0).stop 2023-11-28T20:00:41.514 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:41.509+0000 7f68404dd640 1 -- 172.21.15.78:0/2217934434 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f68380c5300 msgr2=0x7f68380befc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:00:41.515 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:41.509+0000 7f68404dd640 1 --2- 172.21.15.78:0/2217934434 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f68380c5300 0x7f68380befc0 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f683400d800 tx=0x7f683400dcc0 comp rx=0 tx=0).stop 2023-11-28T20:00:41.515 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:41.509+0000 7f68404dd640 1 -- 172.21.15.78:0/2217934434 shutdown_connections 2023-11-28T20:00:41.515 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:41.509+0000 7f68404dd640 1 --2- 172.21.15.78:0/2217934434 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f681c066470 0x7f681c068930 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:41.515 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:41.509+0000 7f68404dd640 1 --2- 172.21.15.78:0/2217934434 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f68381548c0 0x7f6838141ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:41.515 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:41.509+0000 7f68404dd640 1 --2- 172.21.15.78:0/2217934434 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f683814b1e0 0x7f68381f0800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:41.515 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:41.509+0000 7f68404dd640 1 --2- 172.21.15.78:0/2217934434 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f68380c5300 0x7f68380befc0 unknown :-1 s=CLOSED pgs=479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:41.515 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:41.509+0000 7f68404dd640 1 -- 172.21.15.78:0/2217934434 >> 172.21.15.78:0/2217934434 conn(0x7f68380c59f0 msgr2=0x7f6838145ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:00:41.515 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:41.509+0000 7f68404dd640 1 -- 172.21.15.78:0/2217934434 shutdown_connections 2023-11-28T20:00:41.515 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:41.509+0000 7f68404dd640 1 -- 172.21.15.78:0/2217934434 wait complete. 2023-11-28T20:00:41.533 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs2_metadata pg_num 2023-11-28T20:00:41.673 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:41.669+0000 7fd952b9d640 1 Processor -- start 2023-11-28T20:00:41.673 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:41.669+0000 7fd952b9d640 1 -- start start 2023-11-28T20:00:41.675 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:41.669+0000 7fd952b9d640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd94c0bf2d0 0x7fd94c151970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:41.675 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:41.669+0000 7fd952b9d640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fd94c0c98f0 0x7fd94c151eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:41.675 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:41.669+0000 7fd952b9d640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd94c158780 con 0x7fd94c0c6030 2023-11-28T20:00:41.675 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:41.669+0000 7fd952b9d640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd94c0c0300 con 0x7fd94c0c98f0 2023-11-28T20:00:41.675 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:41.669+0000 7fd952b9d640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd94c157b70 con 0x7fd94c0bf2d0 2023-11-28T20:00:41.675 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:41.669+0000 7fd95113a640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fd94c0c98f0 0x7fd94c151eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:41.675 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:41.669+0000 7fd95113a640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fd94c0c98f0 0x7fd94c151eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:58268/0 (socket says 172.21.15.78:58268) 2023-11-28T20:00:41.675 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:41.669+0000 7fd95113a640 1 -- 172.21.15.78:0/903856991 learned_addr learned my addr 172.21.15.78:0/903856991 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T20:00:41.676 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:41.669+0000 7fd950939640 1 --2- 172.21.15.78:0/903856991 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd94c0bf2d0 0x7fd94c151970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:41.676 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:41.669+0000 7fd95113a640 1 -- 172.21.15.78:0/903856991 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd94c0bf2d0 msgr2=0x7fd94c151970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:00:41.676 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:41.669+0000 7fd95113a640 1 --2- 172.21.15.78:0/903856991 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd94c0bf2d0 0x7fd94c151970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:41.676 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:41.669+0000 7fd95113a640 1 -- 172.21.15.78:0/903856991 >> v1:172.21.15.179:6789/0 conn(0x7fd94c0c6030 legacy=0x7fd94c0c7cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:00:41.676 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:41.669+0000 7fd95113a640 1 -- 172.21.15.78:0/903856991 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd94c157e50 con 0x7fd94c0c98f0 2023-11-28T20:00:41.678 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:41.673+0000 7fd95113a640 1 --2- 172.21.15.78:0/903856991 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd94c0c98f0 0x7fd94c151eb0 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7fd944009e50 tx=0x7fd94401c9e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=428da8353a07092f server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:00:41.678 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:41.673+0000 7fd9437fe640 1 -- 172.21.15.78:0/903856991 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9440a58a0 con 0x7fd94c0c98f0 2023-11-28T20:00:41.678 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:41.673+0000 7fd9437fe640 1 -- 172.21.15.78:0/903856991 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd9440a5a00 con 0x7fd94c0c98f0 2023-11-28T20:00:41.678 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:41.673+0000 7fd9437fe640 1 -- 172.21.15.78:0/903856991 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9440a5d90 con 0x7fd94c0c98f0 2023-11-28T20:00:41.679 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:41.673+0000 7fd952b9d640 1 -- 172.21.15.78:0/903856991 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd94c0c98f0 msgr2=0x7fd94c151eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:00:41.679 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:41.673+0000 7fd952b9d640 1 --2- 172.21.15.78:0/903856991 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd94c0c98f0 0x7fd94c151eb0 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7fd944009e50 tx=0x7fd94401c9e0 comp rx=0 tx=0).stop 2023-11-28T20:00:41.679 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:41.673+0000 7fd952b9d640 1 -- 172.21.15.78:0/903856991 shutdown_connections 2023-11-28T20:00:41.679 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:41.673+0000 7fd952b9d640 1 --2- 172.21.15.78:0/903856991 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd94c0c98f0 0x7fd94c151eb0 unknown :-1 s=CLOSED pgs=480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:41.680 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:41.673+0000 7fd952b9d640 1 --2- 172.21.15.78:0/903856991 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd94c0bf2d0 0x7fd94c151970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:41.680 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:41.673+0000 7fd952b9d640 1 -- 172.21.15.78:0/903856991 >> 172.21.15.78:0/903856991 conn(0x7fd94c0c9dc0 msgr2=0x7fd94c0ca1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:00:41.680 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:41.673+0000 7fd952b9d640 1 -- 172.21.15.78:0/903856991 shutdown_connections 2023-11-28T20:00:41.680 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:41.673+0000 7fd952b9d640 1 -- 172.21.15.78:0/903856991 wait complete. 2023-11-28T20:00:41.680 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:41.677+0000 7fd952b9d640 1 Processor -- start 2023-11-28T20:00:41.681 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:41.677+0000 7fd952b9d640 1 -- start start 2023-11-28T20:00:41.683 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:41.677+0000 7fd952b9d640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd94c0bf2d0 0x7fd94c1f0a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:41.683 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:41.677+0000 7fd952b9d640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd94c0c6030 0x7fd94c06c3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:41.683 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:41.677+0000 7fd952b9d640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd94c0c98f0 0x7fd94c06c930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:41.683 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:41.677+0000 7fd952b9d640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd94c14ab20 con 0x7fd94c0c98f0 2023-11-28T20:00:41.683 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:41.677+0000 7fd952b9d640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd94c0ab270 con 0x7fd94c0c6030 2023-11-28T20:00:41.683 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:41.677+0000 7fd952b9d640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd94c1f0f60 con 0x7fd94c0bf2d0 2023-11-28T20:00:41.683 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:41.677+0000 7fd95113a640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd94c0c98f0 0x7fd94c06c930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:41.684 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:41.677+0000 7fd95113a640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd94c0c98f0 0x7fd94c06c930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:58272/0 (socket says 172.21.15.78:58272) 2023-11-28T20:00:41.684 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:41.677+0000 7fd95113a640 1 -- 172.21.15.78:0/1269441374 learned_addr learned my addr 172.21.15.78:0/1269441374 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T20:00:41.684 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:41.677+0000 7fd950939640 1 --2- 172.21.15.78:0/1269441374 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd94c0bf2d0 0x7fd94c1f0a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:41.684 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:41.677+0000 7fd943fff640 1 --2- 172.21.15.78:0/1269441374 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd94c0c6030 0x7fd94c06c3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:41.684 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:41.677+0000 7fd95113a640 1 -- 172.21.15.78:0/1269441374 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd94c0bf2d0 msgr2=0x7fd94c1f0a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:00:41.684 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:41.677+0000 7fd95113a640 1 --2- 172.21.15.78:0/1269441374 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd94c0bf2d0 0x7fd94c1f0a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:41.684 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:41.677+0000 7fd95113a640 1 -- 172.21.15.78:0/1269441374 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd94c0c6030 msgr2=0x7fd94c06c3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:00:41.684 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:41.677+0000 7fd95113a640 1 --2- 172.21.15.78:0/1269441374 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd94c0c6030 0x7fd94c06c3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:41.684 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:41.677+0000 7fd95113a640 1 -- 172.21.15.78:0/1269441374 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd944009b30 con 0x7fd94c0c98f0 2023-11-28T20:00:41.684 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:41.677+0000 7fd95113a640 1 --2- 172.21.15.78:0/1269441374 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd94c0c98f0 0x7fd94c06c930 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7fd9440af040 tx=0x7fd944019780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:00:41.684 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:41.677+0000 7fd9417fa640 1 -- 172.21.15.78:0/1269441374 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9440b8670 con 0x7fd94c0c98f0 2023-11-28T20:00:41.684 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:41.677+0000 7fd9417fa640 1 -- 172.21.15.78:0/1269441374 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd9440b8830 con 0x7fd94c0c98f0 2023-11-28T20:00:41.685 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:41.677+0000 7fd9417fa640 1 -- 172.21.15.78:0/1269441374 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9440b8be0 con 0x7fd94c0c98f0 2023-11-28T20:00:41.685 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:41.677+0000 7fd952b9d640 1 -- 172.21.15.78:0/1269441374 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd94c149150 con 0x7fd94c0c98f0 2023-11-28T20:00:41.685 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:41.677+0000 7fd952b9d640 1 -- 172.21.15.78:0/1269441374 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd94c1493a0 con 0x7fd94c0c98f0 2023-11-28T20:00:41.685 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:41.681+0000 7fd952b9d640 1 -- 172.21.15.78:0/1269441374 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd94c1ecca0 con 0x7fd94c0c98f0 2023-11-28T20:00:41.685 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:41.681+0000 7fd9417fa640 1 -- 172.21.15.78:0/1269441374 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fd9440b8d40 con 0x7fd94c0c98f0 2023-11-28T20:00:41.686 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:41.681+0000 7fd9417fa640 1 --2- 172.21.15.78:0/1269441374 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fd938066470 0x7fd938068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:41.686 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:41.681+0000 7fd9417fa640 1 -- 172.21.15.78:0/1269441374 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 6885+0+0 (secure 0 0 0) 0x7fd94411f750 con 0x7fd94c0c98f0 2023-11-28T20:00:41.686 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:41.681+0000 7fd950939640 1 --2- 172.21.15.78:0/1269441374 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fd938066470 0x7fd938068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:41.690 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:41.681+0000 7fd950939640 1 --2- 172.21.15.78:0/1269441374 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fd938066470 0x7fd938068930 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fd94c156500 tx=0x7fd948008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:00:41.690 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:41.685+0000 7fd9417fa640 1 -- 172.21.15.78:0/1269441374 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fd9440ec8f0 con 0x7fd94c0c98f0 2023-11-28T20:00:41.841 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:41.837+0000 7fd952b9d640 1 -- 172.21.15.78:0/1269441374 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs2_metadata", "var": "pg_num"} v 0) v1 -- 0x7fd94c067630 con 0x7fd94c0c98f0 2023-11-28T20:00:41.842 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:41.837+0000 7fd9417fa640 1 -- 172.21.15.78:0/1269441374 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs2_metadata", "var": "pg_num"}]=0 v44) v1 ==== 105+0+11 (secure 0 0 0) 0x7fd9440bc0b0 con 0x7fd94c0c98f0 2023-11-28T20:00:41.842 INFO:teuthology.orchestra.run.smithi078.stdout:pg_num: 32 2023-11-28T20:00:41.844 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:41.837+0000 7fd952b9d640 1 -- 172.21.15.78:0/1269441374 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fd938066470 msgr2=0x7fd938068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:00:41.844 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:41.837+0000 7fd952b9d640 1 --2- 172.21.15.78:0/1269441374 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fd938066470 0x7fd938068930 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fd94c156500 tx=0x7fd948008040 comp rx=0 tx=0).stop 2023-11-28T20:00:41.844 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:41.837+0000 7fd952b9d640 1 -- 172.21.15.78:0/1269441374 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd94c0c98f0 msgr2=0x7fd94c06c930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:00:41.844 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:41.837+0000 7fd952b9d640 1 --2- 172.21.15.78:0/1269441374 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd94c0c98f0 0x7fd94c06c930 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7fd9440af040 tx=0x7fd944019780 comp rx=0 tx=0).stop 2023-11-28T20:00:41.844 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:41.841+0000 7fd952b9d640 1 -- 172.21.15.78:0/1269441374 shutdown_connections 2023-11-28T20:00:41.844 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:41.841+0000 7fd952b9d640 1 --2- 172.21.15.78:0/1269441374 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fd938066470 0x7fd938068930 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:41.844 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:41.841+0000 7fd952b9d640 1 --2- 172.21.15.78:0/1269441374 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd94c0c98f0 0x7fd94c06c930 unknown :-1 s=CLOSED pgs=481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:41.844 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:41.841+0000 7fd952b9d640 1 --2- 172.21.15.78:0/1269441374 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd94c0c6030 0x7fd94c06c3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:41.845 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:41.841+0000 7fd952b9d640 1 --2- 172.21.15.78:0/1269441374 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd94c0bf2d0 0x7fd94c1f0a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:41.845 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:41.841+0000 7fd952b9d640 1 -- 172.21.15.78:0/1269441374 >> 172.21.15.78:0/1269441374 conn(0x7fd94c0c9dc0 msgr2=0x7fd94c148760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:00:41.845 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:41.841+0000 7fd952b9d640 1 -- 172.21.15.78:0/1269441374 shutdown_connections 2023-11-28T20:00:41.845 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:41.841+0000 7fd952b9d640 1 -- 172.21.15.78:0/1269441374 wait complete. 2023-11-28T20:00:41.863 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs2_data pg_num 2023-11-28T20:00:42.004 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:41.997+0000 7f7e1c5d8640 1 Processor -- start 2023-11-28T20:00:42.004 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:42.001+0000 7f7e1c5d8640 1 -- start start 2023-11-28T20:00:42.006 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:42.001+0000 7f7e1c5d8640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f7e140c4c50 0x7f7e141563b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:42.006 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:42.001+0000 7f7e1c5d8640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f7e14152240 0x7f7e140aadf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:42.006 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:42.001+0000 7f7e1c5d8640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7e1406d740 con 0x7f7e1414f800 2023-11-28T20:00:42.006 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:42.001+0000 7f7e1c5d8640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7e14155f90 con 0x7f7e14152240 2023-11-28T20:00:42.006 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:42.001+0000 7f7e1c5d8640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7e141558d0 con 0x7f7e140c4c50 2023-11-28T20:00:42.006 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:42.001+0000 7f7e1a374640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f7e1414f800 0x7f7e1406ce60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:34062/0 (socket says 172.21.15.78:34062) 2023-11-28T20:00:42.007 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:42.001+0000 7f7e1a374640 1 -- 172.21.15.78:0/2886207918 learned_addr learned my addr 172.21.15.78:0/2886207918 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-11-28T20:00:42.007 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:42.001+0000 7f7e1ab75640 1 --2- 172.21.15.78:0/2886207918 >> v2:172.21.15.78:3300/0 conn(0x7f7e14152240 0x7f7e140aadf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:42.007 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:42.001+0000 7f7e19372640 1 -- 172.21.15.78:0/2886207918 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3149502034 0 0) 0x7f7e1406d740 con 0x7f7e1414f800 2023-11-28T20:00:42.007 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:42.001+0000 7f7e19b73640 1 --2- 172.21.15.78:0/2886207918 >> v2:172.21.15.179:3300/0 conn(0x7f7e140c4c50 0x7f7e141563b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:42.007 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:42.001+0000 7f7e19372640 1 -- 172.21.15.78:0/2886207918 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7e00003530 con 0x7f7e1414f800 2023-11-28T20:00:42.007 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:42.001+0000 7f7e1ab75640 1 -- 172.21.15.78:0/2886207918 >> v2:172.21.15.179:3300/0 conn(0x7f7e140c4c50 msgr2=0x7f7e141563b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:00:42.007 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:42.001+0000 7f7e1ab75640 1 --2- 172.21.15.78:0/2886207918 >> v2:172.21.15.179:3300/0 conn(0x7f7e140c4c50 0x7f7e141563b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:42.008 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:42.001+0000 7f7e1ab75640 1 -- 172.21.15.78:0/2886207918 >> v1:172.21.15.78:6789/0 conn(0x7f7e1414f800 legacy=0x7f7e1406ce60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:00:42.008 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:42.001+0000 7f7e1ab75640 1 -- 172.21.15.78:0/2886207918 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e14155bb0 con 0x7f7e14152240 2023-11-28T20:00:42.008 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:42.001+0000 7f7e19b73640 1 --2- 172.21.15.78:0/2886207918 >> v2:172.21.15.179:3300/0 conn(0x7f7e140c4c50 0x7f7e141563b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T20:00:42.010 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:42.005+0000 7f7e1ab75640 1 --2- 172.21.15.78:0/2886207918 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7e14152240 0x7f7e140aadf0 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f7e1406b4f0 tx=0x7f7e0c01c7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=75b6548e53feb4d server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:00:42.010 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:42.005+0000 7f7e19372640 1 -- 172.21.15.78:0/2886207918 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e0c0a5730 con 0x7f7e14152240 2023-11-28T20:00:42.010 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:42.005+0000 7f7e19372640 1 -- 172.21.15.78:0/2886207918 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e0c0a5890 con 0x7f7e14152240 2023-11-28T20:00:42.010 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:42.005+0000 7f7e19372640 1 -- 172.21.15.78:0/2886207918 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e0c0a5c20 con 0x7f7e14152240 2023-11-28T20:00:42.011 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:42.005+0000 7f7e1c5d8640 1 -- 172.21.15.78:0/2886207918 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7e14152240 msgr2=0x7f7e140aadf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:00:42.011 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:42.005+0000 7f7e1c5d8640 1 --2- 172.21.15.78:0/2886207918 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7e14152240 0x7f7e140aadf0 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f7e1406b4f0 tx=0x7f7e0c01c7f0 comp rx=0 tx=0).stop 2023-11-28T20:00:42.011 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:42.005+0000 7f7e1c5d8640 1 -- 172.21.15.78:0/2886207918 shutdown_connections 2023-11-28T20:00:42.011 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:42.005+0000 7f7e1c5d8640 1 --2- 172.21.15.78:0/2886207918 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7e14152240 0x7f7e140aadf0 unknown :-1 s=CLOSED pgs=483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:42.011 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:42.005+0000 7f7e1c5d8640 1 --2- 172.21.15.78:0/2886207918 >> v2:172.21.15.179:3300/0 conn(0x7f7e140c4c50 0x7f7e141563b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:42.011 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:42.005+0000 7f7e1c5d8640 1 -- 172.21.15.78:0/2886207918 >> 172.21.15.78:0/2886207918 conn(0x7f7e140c24a0 msgr2=0x7f7e140c28b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:00:42.012 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:42.005+0000 7f7e1c5d8640 1 -- 172.21.15.78:0/2886207918 shutdown_connections 2023-11-28T20:00:42.012 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:42.005+0000 7f7e1c5d8640 1 -- 172.21.15.78:0/2886207918 wait complete. 2023-11-28T20:00:42.016 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:42.005+0000 7f7e1c5d8640 1 Processor -- start 2023-11-28T20:00:42.016 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:42.005+0000 7f7e1c5d8640 1 -- start start 2023-11-28T20:00:42.016 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:42.009+0000 7f7e1c5d8640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7e140c4c50 0x7f7e1414e130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:42.016 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:42.009+0000 7f7e1c5d8640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7e1414f800 0x7f7e1414e670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:42.016 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:42.009+0000 7f7e1c5d8640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7e14152240 0x7f7e140a4090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:42.016 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:42.009+0000 7f7e1c5d8640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e140a7360 con 0x7f7e1414f800 2023-11-28T20:00:42.016 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:42.009+0000 7f7e1c5d8640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e141f22d0 con 0x7f7e14152240 2023-11-28T20:00:42.017 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:42.009+0000 7f7e1c5d8640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e1414f2a0 con 0x7f7e140c4c50 2023-11-28T20:00:42.017 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:42.009+0000 7f7e19b73640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7e1414f800 0x7f7e1414e670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:42.017 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:42.009+0000 7f7e19b73640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7e1414f800 0x7f7e1414e670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:58294/0 (socket says 172.21.15.78:58294) 2023-11-28T20:00:42.017 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:42.009+0000 7f7e19b73640 1 -- 172.21.15.78:0/1674660912 learned_addr learned my addr 172.21.15.78:0/1674660912 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T20:00:42.017 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:42.009+0000 7f7e1ab75640 1 --2- 172.21.15.78:0/1674660912 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7e14152240 0x7f7e140a4090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:42.017 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:42.009+0000 7f7e1a374640 1 --2- 172.21.15.78:0/1674660912 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7e140c4c50 0x7f7e1414e130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:42.017 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:42.009+0000 7f7e19b73640 1 -- 172.21.15.78:0/1674660912 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7e140c4c50 msgr2=0x7f7e1414e130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:00:42.018 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:42.009+0000 7f7e19b73640 1 --2- 172.21.15.78:0/1674660912 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7e140c4c50 0x7f7e1414e130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:42.018 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:42.009+0000 7f7e19b73640 1 -- 172.21.15.78:0/1674660912 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7e14152240 msgr2=0x7f7e140a4090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:00:42.019 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:42.009+0000 7f7e19b73640 1 --2- 172.21.15.78:0/1674660912 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7e14152240 0x7f7e140a4090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:42.019 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:42.009+0000 7f7e19b73640 1 -- 172.21.15.78:0/1674660912 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e0c009a70 con 0x7f7e1414f800 2023-11-28T20:00:42.019 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:42.009+0000 7f7e1ab75640 1 --2- 172.21.15.78:0/1674660912 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7e14152240 0x7f7e140a4090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T20:00:42.019 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:42.009+0000 7f7e1a374640 1 --2- 172.21.15.78:0/1674660912 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7e140c4c50 0x7f7e1414e130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T20:00:42.020 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:42.009+0000 7f7e19b73640 1 --2- 172.21.15.78:0/1674660912 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7e1414f800 0x7f7e1414e670 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f7e0400c7f0 tx=0x7f7e0400ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:00:42.020 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:42.009+0000 7f7e0affd640 1 -- 172.21.15.78:0/1674660912 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e04007820 con 0x7f7e1414f800 2023-11-28T20:00:42.020 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:42.009+0000 7f7e0affd640 1 -- 172.21.15.78:0/1674660912 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e04007980 con 0x7f7e1414f800 2023-11-28T20:00:42.020 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:42.009+0000 7f7e1c5d8640 1 -- 172.21.15.78:0/1674660912 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7e141f2570 con 0x7f7e1414f800 2023-11-28T20:00:42.020 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:42.009+0000 7f7e0affd640 1 -- 172.21.15.78:0/1674660912 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e04007d30 con 0x7f7e1414f800 2023-11-28T20:00:42.020 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:42.009+0000 7f7e1c5d8640 1 -- 172.21.15.78:0/1674660912 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7e1414f580 con 0x7f7e1414f800 2023-11-28T20:00:42.020 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:42.009+0000 7f7e1c5d8640 1 -- 172.21.15.78:0/1674660912 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7e140674b0 con 0x7f7e1414f800 2023-11-28T20:00:42.020 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:42.009+0000 7f7e0affd640 1 -- 172.21.15.78:0/1674660912 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f7e040113f0 con 0x7f7e1414f800 2023-11-28T20:00:42.021 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:42.013+0000 7f7e0affd640 1 --2- 172.21.15.78:0/1674660912 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f7df80664a0 0x7f7df8068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:42.021 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:42.013+0000 7f7e0affd640 1 -- 172.21.15.78:0/1674660912 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 6885+0+0 (secure 0 0 0) 0x7f7e04084540 con 0x7f7e1414f800 2023-11-28T20:00:42.022 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:42.013+0000 7f7e1a374640 1 --2- 172.21.15.78:0/1674660912 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f7df80664a0 0x7f7df8068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:42.022 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:42.013+0000 7f7e1a374640 1 --2- 172.21.15.78:0/1674660912 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f7df80664a0 0x7f7df8068960 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f7e100011f0 tx=0x7f7e10009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:00:42.022 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:42.017+0000 7f7e0affd640 1 -- 172.21.15.78:0/1674660912 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f7e040515b0 con 0x7f7e1414f800 2023-11-28T20:00:42.171 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:42.165+0000 7f7e1c5d8640 1 -- 172.21.15.78:0/1674660912 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs2_data", "var": "pg_num"} v 0) v1 -- 0x7f7e14156580 con 0x7f7e1414f800 2023-11-28T20:00:42.172 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:42.165+0000 7f7e0affd640 1 -- 172.21.15.78:0/1674660912 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs2_data", "var": "pg_num"}]=0 v44) v1 ==== 101+0+11 (secure 0 0 0) 0x7f7e04054bd0 con 0x7f7e1414f800 2023-11-28T20:00:42.172 INFO:teuthology.orchestra.run.smithi078.stdout:pg_num: 64 2023-11-28T20:00:42.174 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:42.169+0000 7f7e1c5d8640 1 -- 172.21.15.78:0/1674660912 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f7df80664a0 msgr2=0x7f7df8068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:00:42.174 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:42.169+0000 7f7e1c5d8640 1 --2- 172.21.15.78:0/1674660912 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f7df80664a0 0x7f7df8068960 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f7e100011f0 tx=0x7f7e10009040 comp rx=0 tx=0).stop 2023-11-28T20:00:42.174 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:42.169+0000 7f7e1c5d8640 1 -- 172.21.15.78:0/1674660912 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7e1414f800 msgr2=0x7f7e1414e670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:00:42.174 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:42.169+0000 7f7e1c5d8640 1 --2- 172.21.15.78:0/1674660912 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7e1414f800 0x7f7e1414e670 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f7e0400c7f0 tx=0x7f7e0400ccb0 comp rx=0 tx=0).stop 2023-11-28T20:00:42.174 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:42.169+0000 7f7e1c5d8640 1 -- 172.21.15.78:0/1674660912 shutdown_connections 2023-11-28T20:00:42.175 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:42.169+0000 7f7e1c5d8640 1 --2- 172.21.15.78:0/1674660912 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f7df80664a0 0x7f7df8068960 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:42.175 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:42.169+0000 7f7e1c5d8640 1 --2- 172.21.15.78:0/1674660912 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7e14152240 0x7f7e140a4090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:42.175 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:42.169+0000 7f7e1c5d8640 1 --2- 172.21.15.78:0/1674660912 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7e1414f800 0x7f7e1414e670 unknown :-1 s=CLOSED pgs=484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:42.175 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:42.169+0000 7f7e1c5d8640 1 --2- 172.21.15.78:0/1674660912 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7e140c4c50 0x7f7e1414e130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:42.175 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:42.169+0000 7f7e1c5d8640 1 -- 172.21.15.78:0/1674660912 >> 172.21.15.78:0/1674660912 conn(0x7f7e140c24a0 msgr2=0x7f7e140733c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:00:42.175 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:42.169+0000 7f7e1c5d8640 1 -- 172.21.15.78:0/1674660912 shutdown_connections 2023-11-28T20:00:42.175 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:42.169+0000 7f7e1c5d8640 1 -- 172.21.15.78:0/1674660912 wait complete. 2023-11-28T20:00:42.194 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-11-28T20:00:42.332 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:42.329+0000 7f6c8a916640 1 Processor -- start 2023-11-28T20:00:42.332 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:42.329+0000 7f6c8a916640 1 -- start start 2023-11-28T20:00:42.333 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:42.329+0000 7f6c8a916640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f6c840a4f90 0x7f6c840c59c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:42.333 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:42.329+0000 7f6c8a916640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6c841524b0 con 0x7f6c840a5370 2023-11-28T20:00:42.334 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:42.329+0000 7f6c8a916640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6c840c62f0 con 0x7f6c84072810 2023-11-28T20:00:42.334 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:42.329+0000 7f6c8a916640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6c84152770 con 0x7f6c840a4f90 2023-11-28T20:00:42.334 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:42.329+0000 7f6c83fff640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f6c840a4f90 0x7f6c840c59c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:42.334 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:42.329+0000 7f6c83fff640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f6c840a4f90 0x7f6c840c59c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:58310/0 (socket says 172.21.15.78:58310) 2023-11-28T20:00:42.334 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:42.329+0000 7f6c83fff640 1 -- 172.21.15.78:0/1727343301 learned_addr learned my addr 172.21.15.78:0/1727343301 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T20:00:42.335 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:42.329+0000 7f6c83fff640 1 -- 172.21.15.78:0/1727343301 >> v1:172.21.15.179:6789/0 conn(0x7f6c84072810 legacy=0x7f6c840c0800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:00:42.335 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:42.329+0000 7f6c83fff640 1 -- 172.21.15.78:0/1727343301 >> v1:172.21.15.78:6789/0 conn(0x7f6c840a5370 legacy=0x7f6c8414f870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:00:42.335 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:42.329+0000 7f6c83fff640 1 -- 172.21.15.78:0/1727343301 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c84152a50 con 0x7f6c840a4f90 2023-11-28T20:00:42.335 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:42.329+0000 7f6c82ffd640 1 -- 172.21.15.78:0/1727343301 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3472126317 0 0) 0x7f6c841524b0 con 0x7f6c840a5370 2023-11-28T20:00:42.337 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:42.333+0000 7f6c83fff640 1 --2- 172.21.15.78:0/1727343301 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6c840a4f90 0x7f6c840c59c0 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f6c841526a0 tx=0x7f6c7401c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=298dd7c4186a5894 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:00:42.337 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:42.333+0000 7f6c82ffd640 1 -- 172.21.15.78:0/1727343301 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c740ab600 con 0x7f6c840a4f90 2023-11-28T20:00:42.337 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:42.333+0000 7f6c82ffd640 1 -- 172.21.15.78:0/1727343301 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c740a7050 con 0x7f6c840a4f90 2023-11-28T20:00:42.337 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:42.333+0000 7f6c82ffd640 1 -- 172.21.15.78:0/1727343301 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c740ab980 con 0x7f6c840a4f90 2023-11-28T20:00:42.338 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:42.333+0000 7f6c8a916640 1 -- 172.21.15.78:0/1727343301 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6c840a4f90 msgr2=0x7f6c840c59c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:00:42.338 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:42.333+0000 7f6c8a916640 1 --2- 172.21.15.78:0/1727343301 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6c840a4f90 0x7f6c840c59c0 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f6c841526a0 tx=0x7f6c7401c450 comp rx=0 tx=0).stop 2023-11-28T20:00:42.338 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:42.333+0000 7f6c8a916640 1 -- 172.21.15.78:0/1727343301 shutdown_connections 2023-11-28T20:00:42.338 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:42.333+0000 7f6c8a916640 1 --2- 172.21.15.78:0/1727343301 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6c840a4f90 0x7f6c840c59c0 unknown :-1 s=CLOSED pgs=486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:42.338 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:42.333+0000 7f6c8a916640 1 -- 172.21.15.78:0/1727343301 >> 172.21.15.78:0/1727343301 conn(0x7f6c8406b220 msgr2=0x7f6c840a77e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:00:42.338 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:42.333+0000 7f6c8a916640 1 -- 172.21.15.78:0/1727343301 shutdown_connections 2023-11-28T20:00:42.338 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:42.333+0000 7f6c8a916640 1 -- 172.21.15.78:0/1727343301 wait complete. 2023-11-28T20:00:42.339 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:42.333+0000 7f6c8a916640 1 Processor -- start 2023-11-28T20:00:42.339 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:42.337+0000 7f6c8a916640 1 -- start start 2023-11-28T20:00:42.341 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:42.337+0000 7f6c8a916640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6c84072810 0x7f6c841490a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:42.341 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:42.337+0000 7f6c8a916640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6c840a4f90 0x7f6c841517a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:42.342 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:42.337+0000 7f6c8a916640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6c840a5370 0x7f6c840aa4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:42.342 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:42.337+0000 7f6c8a916640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c84147e40 con 0x7f6c84072810 2023-11-28T20:00:42.342 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:42.337+0000 7f6c8a916640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c84151310 con 0x7f6c840a4f90 2023-11-28T20:00:42.342 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:42.337+0000 7f6c8a916640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c841495e0 con 0x7f6c840a5370 2023-11-28T20:00:42.342 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:42.337+0000 7f6c83fff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6c84072810 0x7f6c841490a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:42.342 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:42.337+0000 7f6c83fff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6c84072810 0x7f6c841490a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:58326/0 (socket says 172.21.15.78:58326) 2023-11-28T20:00:42.342 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:42.337+0000 7f6c83fff640 1 -- 172.21.15.78:0/2634363929 learned_addr learned my addr 172.21.15.78:0/2634363929 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T20:00:42.342 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:42.337+0000 7f6c88eb3640 1 --2- 172.21.15.78:0/2634363929 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6c840a5370 0x7f6c840aa4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:42.342 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:42.337+0000 7f6c837fe640 1 --2- 172.21.15.78:0/2634363929 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6c840a4f90 0x7f6c841517a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:42.343 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:42.337+0000 7f6c83fff640 1 -- 172.21.15.78:0/2634363929 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6c840a5370 msgr2=0x7f6c840aa4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:00:42.343 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:42.337+0000 7f6c83fff640 1 --2- 172.21.15.78:0/2634363929 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6c840a5370 0x7f6c840aa4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:42.343 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:42.337+0000 7f6c83fff640 1 -- 172.21.15.78:0/2634363929 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6c840a4f90 msgr2=0x7f6c841517a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:00:42.343 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:42.337+0000 7f6c83fff640 1 --2- 172.21.15.78:0/2634363929 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6c840a4f90 0x7f6c841517a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:42.343 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:42.337+0000 7f6c83fff640 1 -- 172.21.15.78:0/2634363929 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c740094d0 con 0x7f6c84072810 2023-11-28T20:00:42.343 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:42.337+0000 7f6c837fe640 1 --2- 172.21.15.78:0/2634363929 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6c840a4f90 0x7f6c841517a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T20:00:42.343 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:42.337+0000 7f6c83fff640 1 --2- 172.21.15.78:0/2634363929 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6c84072810 0x7f6c841490a0 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f6c740ae040 tx=0x7f6c7401ac90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:00:42.344 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:42.337+0000 7f6c80ff9640 1 -- 172.21.15.78:0/2634363929 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c740b6620 con 0x7f6c84072810 2023-11-28T20:00:42.344 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:42.337+0000 7f6c80ff9640 1 -- 172.21.15.78:0/2634363929 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c740b67a0 con 0x7f6c84072810 2023-11-28T20:00:42.344 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:42.337+0000 7f6c80ff9640 1 -- 172.21.15.78:0/2634363929 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c740b6b50 con 0x7f6c84072810 2023-11-28T20:00:42.344 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:42.337+0000 7f6c8a916640 1 -- 172.21.15.78:0/2634363929 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6c84150fe0 con 0x7f6c84072810 2023-11-28T20:00:42.344 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:42.337+0000 7f6c8a916640 1 -- 172.21.15.78:0/2634363929 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6c84148020 con 0x7f6c84072810 2023-11-28T20:00:42.344 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:42.337+0000 7f6c8a916640 1 -- 172.21.15.78:0/2634363929 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6c84148210 con 0x7f6c84072810 2023-11-28T20:00:42.344 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:42.341+0000 7f6c80ff9640 1 -- 172.21.15.78:0/2634363929 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f6c740b2040 con 0x7f6c84072810 2023-11-28T20:00:42.345 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:42.341+0000 7f6c80ff9640 1 --2- 172.21.15.78:0/2634363929 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f6c70066470 0x7f6c70068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:42.345 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:42.341+0000 7f6c80ff9640 1 -- 172.21.15.78:0/2634363929 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 6885+0+0 (secure 0 0 0) 0x7f6c7411e740 con 0x7f6c84072810 2023-11-28T20:00:42.345 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:42.341+0000 7f6c837fe640 1 --2- 172.21.15.78:0/2634363929 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f6c70066470 0x7f6c70068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:42.346 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:42.341+0000 7f6c837fe640 1 --2- 172.21.15.78:0/2634363929 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f6c70066470 0x7f6c70068930 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f6c8414b190 tx=0x7f6c78009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:00:42.348 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:42.345+0000 7f6c80ff9640 1 -- 172.21.15.78:0/2634363929 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f6c740eb830 con 0x7f6c84072810 2023-11-28T20:00:42.508 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:42.501+0000 7f6c8a916640 1 -- 172.21.15.78:0/2634363929 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f6c84067630 con 0x7f6c84072810 2023-11-28T20:00:42.508 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:42.505+0000 7f6c80ff9640 1 -- 172.21.15.78:0/2634363929 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v44) v1 ==== 80+0+0 (secure 0 0 0) 0x7f6c740eee50 con 0x7f6c84072810 2023-11-28T20:00:42.508 INFO:teuthology.orchestra.run.smithi078.stderr:listed 0 entries 2023-11-28T20:00:42.510 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:42.505+0000 7f6c8a916640 1 -- 172.21.15.78:0/2634363929 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f6c70066470 msgr2=0x7f6c70068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:00:42.510 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:42.505+0000 7f6c8a916640 1 --2- 172.21.15.78:0/2634363929 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f6c70066470 0x7f6c70068930 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f6c8414b190 tx=0x7f6c78009040 comp rx=0 tx=0).stop 2023-11-28T20:00:42.510 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:42.505+0000 7f6c8a916640 1 -- 172.21.15.78:0/2634363929 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6c84072810 msgr2=0x7f6c841490a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:00:42.510 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:42.505+0000 7f6c8a916640 1 --2- 172.21.15.78:0/2634363929 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6c84072810 0x7f6c841490a0 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f6c740ae040 tx=0x7f6c7401ac90 comp rx=0 tx=0).stop 2023-11-28T20:00:42.510 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:42.505+0000 7f6c8a916640 1 -- 172.21.15.78:0/2634363929 shutdown_connections 2023-11-28T20:00:42.510 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:42.505+0000 7f6c8a916640 1 --2- 172.21.15.78:0/2634363929 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f6c70066470 0x7f6c70068930 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:42.510 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:42.505+0000 7f6c8a916640 1 --2- 172.21.15.78:0/2634363929 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6c840a5370 0x7f6c840aa4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:42.510 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:42.505+0000 7f6c8a916640 1 --2- 172.21.15.78:0/2634363929 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6c840a4f90 0x7f6c841517a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:42.511 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:42.505+0000 7f6c8a916640 1 --2- 172.21.15.78:0/2634363929 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6c84072810 0x7f6c841490a0 unknown :-1 s=CLOSED pgs=487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:42.511 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:42.505+0000 7f6c8a916640 1 -- 172.21.15.78:0/2634363929 >> 172.21.15.78:0/2634363929 conn(0x7f6c8406b220 msgr2=0x7f6c840c0800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:00:42.511 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:42.505+0000 7f6c8a916640 1 -- 172.21.15.78:0/2634363929 shutdown_connections 2023-11-28T20:00:42.511 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:42.505+0000 7f6c8a916640 1 -- 172.21.15.78:0/2634363929 wait complete. 2023-11-28T20:00:42.529 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-11-28T20:00:42.529 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T20:00:42.529 DEBUG:teuthology.orchestra.run.smithi078:> sudo umount /home/ubuntu/cephtest/mnt.0 2023-11-28T20:00:42.557 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi078.front.sepia.ceph.com 2023-11-28T20:00:42.557 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T20:00:42.558 DEBUG:teuthology.orchestra.run.smithi078:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-11-28T20:00:42.609 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2023-11-28T20:00:42.609 DEBUG:teuthology.orchestra.run.smithi078:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-28T20:00:42.660 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354608k,nr_inodes=4088652,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275372k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=5526 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275368k,nr_inodes=818842,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275372k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 2023-11-28T20:00:42.660 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-11-28T20:00:42.841 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:42.837+0000 7f5b047aa640 1 Processor -- start 2023-11-28T20:00:42.841 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:42.837+0000 7f5b047aa640 1 -- start start 2023-11-28T20:00:42.842 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:42.837+0000 7f5b047aa640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5afc072850 0x7f5afc0a6370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:42.842 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:42.837+0000 7f5b047aa640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5afc06b060 con 0x7f5afc151e80 2023-11-28T20:00:42.842 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:42.837+0000 7f5b047aa640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5afc06b300 con 0x7f5afc154520 2023-11-28T20:00:42.842 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:42.837+0000 7f5b047aa640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5afc070d30 con 0x7f5afc072850 2023-11-28T20:00:42.842 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:42.837+0000 7f5b02546640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f5afc151e80 0x7f5afc0c0010 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:34088/0 (socket says 172.21.15.78:34088) 2023-11-28T20:00:42.842 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:42.837+0000 7f5b02546640 1 -- 172.21.15.78:0/1470785796 learned_addr learned my addr 172.21.15.78:0/1470785796 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-11-28T20:00:42.844 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:42.837+0000 7f5b01d45640 1 --2- 172.21.15.78:0/1470785796 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5afc072850 0x7f5afc0a6370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:42.844 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:42.837+0000 7f5b01544640 1 -- 172.21.15.78:0/1470785796 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1955275032 0 0) 0x7f5afc06b060 con 0x7f5afc151e80 2023-11-28T20:00:42.844 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:42.837+0000 7f5b01544640 1 -- 172.21.15.78:0/1470785796 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5ae8003530 con 0x7f5afc151e80 2023-11-28T20:00:42.844 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:42.837+0000 7f5b01544640 1 -- 172.21.15.78:0/1470785796 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1228260804 0 0) 0x7f5afc06b300 con 0x7f5afc154520 2023-11-28T20:00:42.844 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:42.837+0000 7f5b01544640 1 -- 172.21.15.78:0/1470785796 --> v1:172.21.15.179:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5afc06b060 con 0x7f5afc154520 2023-11-28T20:00:42.845 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:42.837+0000 7f5b01544640 1 -- 172.21.15.78:0/1470785796 <== mon.0 v1:172.21.15.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2765230473 0 0) 0x7f5ae8003530 con 0x7f5afc151e80 2023-11-28T20:00:42.845 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:42.837+0000 7f5b01544640 1 -- 172.21.15.78:0/1470785796 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5afc072850 msgr2=0x7f5afc0a6370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:00:42.845 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:42.837+0000 7f5b01544640 1 --2- 172.21.15.78:0/1470785796 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5afc072850 0x7f5afc0a6370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:42.845 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:42.837+0000 7f5b01544640 1 -- 172.21.15.78:0/1470785796 >> v1:172.21.15.179:6789/0 conn(0x7f5afc154520 legacy=0x7f5afc1549a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:00:42.845 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:42.837+0000 7f5b01544640 1 -- 172.21.15.78:0/1470785796 --> v1:172.21.15.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5afc070f40 con 0x7f5afc151e80 2023-11-28T20:00:42.845 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:42.837+0000 7f5b01544640 1 -- 172.21.15.78:0/1470785796 <== mon.0 v1:172.21.15.78:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3326804700 0 0) 0x7f5af8001680 con 0x7f5afc151e80 2023-11-28T20:00:42.845 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:42.837+0000 7f5b01544640 1 -- 172.21.15.78:0/1470785796 >> v1:172.21.15.78:6789/0 conn(0x7f5afc151e80 legacy=0x7f5afc0c0010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:00:42.845 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:42.837+0000 7f5b01544640 1 --2- 172.21.15.78:0/1470785796 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5ae8003b40 0x7f5ae8003f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:42.845 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:42.837+0000 7f5b01544640 1 --2- 172.21.15.78:0/1470785796 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5afc072850 0x7f5ae80047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:42.845 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:42.837+0000 7f5b01544640 1 --2- 172.21.15.78:0/1470785796 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5ae8004d10 0x7f5ae8005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:42.845 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:42.837+0000 7f5b01544640 1 -- 172.21.15.78:0/1470785796 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5afc070d30 con 0x7f5ae8004d10 2023-11-28T20:00:42.846 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:42.837+0000 7f5b01544640 1 -- 172.21.15.78:0/1470785796 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ae800ba40 con 0x7f5ae8003b40 2023-11-28T20:00:42.846 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:42.837+0000 7f5b01544640 1 -- 172.21.15.78:0/1470785796 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ae800bbb0 con 0x7f5afc072850 2023-11-28T20:00:42.846 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:42.837+0000 7f5b02546640 1 --2- 172.21.15.78:0/1470785796 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5ae8003b40 0x7f5ae8003f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:42.846 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:42.837+0000 7f5b02d47640 1 --2- 172.21.15.78:0/1470785796 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5ae8004d10 0x7f5ae8005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:42.846 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:42.837+0000 7f5b01d45640 1 --2- 172.21.15.78:0/1470785796 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5afc072850 0x7f5ae80047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:42.846 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:42.841+0000 7f5b02546640 1 -- 172.21.15.78:0/1470785796 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5afc072850 msgr2=0x7f5ae80047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:00:42.846 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:42.841+0000 7f5b02546640 1 --2- 172.21.15.78:0/1470785796 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5afc072850 0x7f5ae80047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:42.846 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:42.841+0000 7f5b02546640 1 -- 172.21.15.78:0/1470785796 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5ae8004d10 msgr2=0x7f5ae8005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:00:42.846 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:42.841+0000 7f5b02546640 1 --2- 172.21.15.78:0/1470785796 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5ae8004d10 0x7f5ae8005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:42.846 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:42.841+0000 7f5b02546640 1 -- 172.21.15.78:0/1470785796 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ae8003530 con 0x7f5ae8003b40 2023-11-28T20:00:42.846 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:42.841+0000 7f5b02d47640 1 --2- 172.21.15.78:0/1470785796 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5ae8004d10 0x7f5ae8005190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T20:00:42.848 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:42.841+0000 7f5b02546640 1 --2- 172.21.15.78:0/1470785796 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5ae8003b40 0x7f5ae8003f40 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f5af800c160 tx=0x7f5af801f330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=63cc5a976b6f2342 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:00:42.848 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:42.841+0000 7f5b01544640 1 -- 172.21.15.78:0/1470785796 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5af8005ae0 con 0x7f5ae8003b40 2023-11-28T20:00:42.848 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:42.841+0000 7f5b01544640 1 -- 172.21.15.78:0/1470785796 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5af80ab070 con 0x7f5ae8003b40 2023-11-28T20:00:42.848 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:42.841+0000 7f5b01544640 1 -- 172.21.15.78:0/1470785796 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5af8005ea0 con 0x7f5ae8003b40 2023-11-28T20:00:42.848 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:42.841+0000 7f5b047aa640 1 -- 172.21.15.78:0/1470785796 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5ae8003b40 msgr2=0x7f5ae8003f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:00:42.849 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:42.841+0000 7f5b047aa640 1 --2- 172.21.15.78:0/1470785796 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5ae8003b40 0x7f5ae8003f40 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f5af800c160 tx=0x7f5af801f330 comp rx=0 tx=0).stop 2023-11-28T20:00:42.849 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:42.841+0000 7f5b02d47640 1 -- 172.21.15.78:0/1470785796 reap_dead start 2023-11-28T20:00:42.849 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:42.845+0000 7f5b047aa640 1 -- 172.21.15.78:0/1470785796 shutdown_connections 2023-11-28T20:00:42.849 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:42.845+0000 7f5b047aa640 1 -- 172.21.15.78:0/1470785796 >> 172.21.15.78:0/1470785796 conn(0x7f5afc0a8990 msgr2=0x7f5afc0a8da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:00:42.849 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:42.845+0000 7f5b047aa640 1 -- 172.21.15.78:0/1470785796 shutdown_connections 2023-11-28T20:00:42.849 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:42.845+0000 7f5b047aa640 1 -- 172.21.15.78:0/1470785796 wait complete. 2023-11-28T20:00:42.849 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:42.845+0000 7f5b047aa640 1 Processor -- start 2023-11-28T20:00:42.850 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:42.845+0000 7f5b047aa640 1 -- start start 2023-11-28T20:00:42.851 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:42.845+0000 7f5b047aa640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5ae8003b40 0x7f5afc1e9fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:42.851 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:42.845+0000 7f5b047aa640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5afc14f810 0x7f5afc06e480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:42.851 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:42.845+0000 7f5b047aa640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5afc14ebf0 0x7f5afc14f0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:42.851 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:42.845+0000 7f5b047aa640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5afc0ab8f0 con 0x7f5afc14f810 2023-11-28T20:00:42.851 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:42.845+0000 7f5b047aa640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5afc0ac0c0 con 0x7f5ae8003b40 2023-11-28T20:00:42.851 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:42.845+0000 7f5b047aa640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5afc1e71f0 con 0x7f5afc14ebf0 2023-11-28T20:00:42.852 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:42.845+0000 7f5b01d45640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5afc14f810 0x7f5afc06e480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:42.852 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:42.845+0000 7f5b01d45640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5afc14f810 0x7f5afc06e480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:58330/0 (socket says 172.21.15.78:58330) 2023-11-28T20:00:42.852 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:42.845+0000 7f5b01d45640 1 -- 172.21.15.78:0/2779796930 learned_addr learned my addr 172.21.15.78:0/2779796930 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T20:00:42.852 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:42.845+0000 7f5b02546640 1 --2- 172.21.15.78:0/2779796930 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5ae8003b40 0x7f5afc1e9fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:42.852 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:42.845+0000 7f5b02d47640 1 --2- 172.21.15.78:0/2779796930 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5afc14ebf0 0x7f5afc14f0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:42.852 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:42.845+0000 7f5b01d45640 1 -- 172.21.15.78:0/2779796930 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5afc14ebf0 msgr2=0x7f5afc14f0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:00:42.852 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:42.845+0000 7f5b01d45640 1 --2- 172.21.15.78:0/2779796930 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5afc14ebf0 0x7f5afc14f0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:42.852 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:42.845+0000 7f5b01d45640 1 -- 172.21.15.78:0/2779796930 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5ae8003b40 msgr2=0x7f5afc1e9fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:00:42.853 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:42.845+0000 7f5b01d45640 1 --2- 172.21.15.78:0/2779796930 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5ae8003b40 0x7f5afc1e9fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:42.854 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:42.845+0000 7f5b01d45640 1 -- 172.21.15.78:0/2779796930 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5afc0999e0 con 0x7f5afc14f810 2023-11-28T20:00:42.854 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:42.845+0000 7f5b01d45640 1 --2- 172.21.15.78:0/2779796930 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5afc14f810 0x7f5afc06e480 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f5aec011960 tx=0x7f5aec011e20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:00:42.860 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:42.845+0000 7f5af2ffd640 1 -- 172.21.15.78:0/2779796930 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5aec00faf0 con 0x7f5afc14f810 2023-11-28T20:00:42.860 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:42.845+0000 7f5af2ffd640 1 -- 172.21.15.78:0/2779796930 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5aec00fc50 con 0x7f5afc14f810 2023-11-28T20:00:42.860 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:42.849+0000 7f5b047aa640 1 -- 172.21.15.78:0/2779796930 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5afc0acb00 con 0x7f5afc14f810 2023-11-28T20:00:42.860 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:42.849+0000 7f5af2ffd640 1 -- 172.21.15.78:0/2779796930 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5aec014440 con 0x7f5afc14f810 2023-11-28T20:00:42.860 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:42.849+0000 7f5b047aa640 1 -- 172.21.15.78:0/2779796930 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5afc0abb00 con 0x7f5afc14f810 2023-11-28T20:00:42.860 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:42.849+0000 7f5b047aa640 1 -- 172.21.15.78:0/2779796930 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5afc067630 con 0x7f5afc14f810 2023-11-28T20:00:42.861 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:42.849+0000 7f5af2ffd640 1 -- 172.21.15.78:0/2779796930 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f5aec0145a0 con 0x7f5afc14f810 2023-11-28T20:00:42.861 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:42.849+0000 7f5af2ffd640 1 --2- 172.21.15.78:0/2779796930 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f5ae0066470 0x7f5ae0068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:42.861 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:42.849+0000 7f5af2ffd640 1 -- 172.21.15.78:0/2779796930 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 6885+0+0 (secure 0 0 0) 0x7f5aec084c90 con 0x7f5afc14f810 2023-11-28T20:00:42.861 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:42.849+0000 7f5b02546640 1 --2- 172.21.15.78:0/2779796930 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f5ae0066470 0x7f5ae0068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:42.861 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:42.849+0000 7f5b02546640 1 --2- 172.21.15.78:0/2779796930 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f5ae0066470 0x7f5ae0068930 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f5af80ae000 tx=0x7f5af8001a00 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:00:42.861 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:42.853+0000 7f5af2ffd640 1 -- 172.21.15.78:0/2779796930 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f5aec051c60 con 0x7f5afc14f810 2023-11-28T20:00:43.043 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:43.037+0000 7f5b047aa640 1 -- 172.21.15.78:0/2779796930 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f5afc154d80 con 0x7f5afc14f810 2023-11-28T20:00:43.043 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:43.037+0000 7f5af2ffd640 1 -- 172.21.15.78:0/2779796930 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v22) v1 ==== 53+0+149 (secure 0 0 0) 0x7f5aec055280 con 0x7f5afc14f810 2023-11-28T20:00:43.043 INFO:teuthology.orchestra.run.smithi078.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-11-28T20:00:43.043 INFO:teuthology.orchestra.run.smithi078.stdout:name: cephfs2, metadata pool: cephfs2_metadata, data pools: [cephfs2_data ] 2023-11-28T20:00:43.045 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:43.041+0000 7f5b047aa640 1 -- 172.21.15.78:0/2779796930 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f5ae0066470 msgr2=0x7f5ae0068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:00:43.045 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:43.041+0000 7f5b047aa640 1 --2- 172.21.15.78:0/2779796930 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f5ae0066470 0x7f5ae0068930 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f5af80ae000 tx=0x7f5af8001a00 comp rx=0 tx=0).stop 2023-11-28T20:00:43.045 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:43.041+0000 7f5b047aa640 1 -- 172.21.15.78:0/2779796930 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5afc14f810 msgr2=0x7f5afc06e480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:00:43.045 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:43.041+0000 7f5b047aa640 1 --2- 172.21.15.78:0/2779796930 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5afc14f810 0x7f5afc06e480 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f5aec011960 tx=0x7f5aec011e20 comp rx=0 tx=0).stop 2023-11-28T20:00:43.045 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:43.041+0000 7f5b047aa640 1 -- 172.21.15.78:0/2779796930 shutdown_connections 2023-11-28T20:00:43.045 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:43.041+0000 7f5b047aa640 1 --2- 172.21.15.78:0/2779796930 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f5ae0066470 0x7f5ae0068930 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:43.046 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:43.041+0000 7f5b047aa640 1 --2- 172.21.15.78:0/2779796930 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5afc14ebf0 0x7f5afc14f0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:43.046 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:43.041+0000 7f5b047aa640 1 --2- 172.21.15.78:0/2779796930 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5afc14f810 0x7f5afc06e480 unknown :-1 s=CLOSED pgs=489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:43.046 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:43.041+0000 7f5b047aa640 1 --2- 172.21.15.78:0/2779796930 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5ae8003b40 0x7f5afc1e9fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:43.046 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:43.041+0000 7f5b047aa640 1 -- 172.21.15.78:0/2779796930 >> 172.21.15.78:0/2779796930 conn(0x7f5afc0a8990 msgr2=0x7f5afc152390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:00:43.046 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:43.041+0000 7f5b047aa640 1 -- 172.21.15.78:0/2779796930 shutdown_connections 2023-11-28T20:00:43.046 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:43.041+0000 7f5b047aa640 1 -- 172.21.15.78:0/2779796930 wait complete. 2023-11-28T20:00:43.064 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs2; just confirmed its presence on cluster 2023-11-28T20:00:43.064 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-11-28T20:00:43.064 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi078.front.sepia.ceph.com 2023-11-28T20:00:43.064 INFO:tasks.cephfs.mount:self.client.name = client.testuser 2023-11-28T20:00:43.064 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-11-28T20:00:43.064 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs2 2023-11-28T20:00:43.064 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-11-28T20:00:43.065 INFO:tasks.cephfs.mount:self.client_keyring_path = /tmp/tmp.rai2IxDqP4 2023-11-28T20:00:43.065 DEBUG:teuthology.orchestra.run.smithi078:> mktemp 2023-11-28T20:00:43.074 INFO:teuthology.orchestra.run.smithi078.stdout:/tmp/tmp.FZ2Pschldb 2023-11-28T20:00:43.074 DEBUG:teuthology.orchestra.run.smithi078:> sudo cp /tmp/tmp.rai2IxDqP4 /tmp/tmp.FZ2Pschldb 2023-11-28T20:00:43.139 DEBUG:teuthology.orchestra.run.smithi078:> sudo chmod 0666 /tmp/tmp.FZ2Pschldb 2023-11-28T20:00:43.264 DEBUG:teuthology.orchestra.remote:smithi078:/tmp/tmp.FZ2Pschldb is 185B 2023-11-28T20:00:43.280 DEBUG:teuthology.orchestra.run.smithi078:> rm -fr /tmp/tmp.FZ2Pschldb 2023-11-28T20:00:43.289 INFO:tasks.cephfs.mount:keyring content - [client.testuser] key = AQDnRmZlxPmOOhAABtFMizHRWLo0HdOMCPA14A== caps mds = "allow rw fsname=cephfs" caps mon = "allow r fsname=cephfs" caps osd = "allow rw tag cephfs data=cephfs" 2023-11-28T20:00:43.289 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-11-28T20:00:43.289 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T20:00:43.289 DEBUG:teuthology.orchestra.run.smithi078:> ip addr 2023-11-28T20:00:43.345 INFO:teuthology.orchestra.run.smithi078.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-11-28T20:00:43.345 INFO:teuthology.orchestra.run.smithi078.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-11-28T20:00:43.345 INFO:teuthology.orchestra.run.smithi078.stdout: inet 127.0.0.1/8 scope host lo 2023-11-28T20:00:43.345 INFO:teuthology.orchestra.run.smithi078.stdout: valid_lft forever preferred_lft forever 2023-11-28T20:00:43.345 INFO:teuthology.orchestra.run.smithi078.stdout: inet6 ::1/128 scope host 2023-11-28T20:00:43.346 INFO:teuthology.orchestra.run.smithi078.stdout: valid_lft forever preferred_lft forever 2023-11-28T20:00:43.346 INFO:teuthology.orchestra.run.smithi078.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-11-28T20:00:43.346 INFO:teuthology.orchestra.run.smithi078.stdout: link/ether 0c:c4:7a:d8:a1:22 brd ff:ff:ff:ff:ff:ff 2023-11-28T20:00:43.346 INFO:teuthology.orchestra.run.smithi078.stdout: altname enp7s0f0 2023-11-28T20:00:43.346 INFO:teuthology.orchestra.run.smithi078.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-11-28T20:00:43.347 INFO:teuthology.orchestra.run.smithi078.stdout: link/ether 0c:c4:7a:d8:a1:23 brd ff:ff:ff:ff:ff:ff 2023-11-28T20:00:43.347 INFO:teuthology.orchestra.run.smithi078.stdout: altname enp7s0f1 2023-11-28T20:00:43.347 INFO:teuthology.orchestra.run.smithi078.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-11-28T20:00:43.347 INFO:teuthology.orchestra.run.smithi078.stdout: link/ether 0c:c4:7a:8f:d4:dc brd ff:ff:ff:ff:ff:ff 2023-11-28T20:00:43.347 INFO:teuthology.orchestra.run.smithi078.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-11-28T20:00:43.348 INFO:teuthology.orchestra.run.smithi078.stdout: link/ether 0c:c4:7a:8f:d4:dd brd ff:ff:ff:ff:ff:ff 2023-11-28T20:00:43.348 INFO:teuthology.orchestra.run.smithi078.stdout: inet 172.21.15.78/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2023-11-28T20:00:43.348 INFO:teuthology.orchestra.run.smithi078.stdout: valid_lft 42328sec preferred_lft 42328sec 2023-11-28T20:00:43.348 INFO:teuthology.orchestra.run.smithi078.stdout: inet6 fe80::ec4:7aff:fe8f:d4dd/64 scope link 2023-11-28T20:00:43.348 INFO:teuthology.orchestra.run.smithi078.stdout: valid_lft forever preferred_lft forever 2023-11-28T20:00:43.348 INFO:teuthology.orchestra.run.smithi078.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-11-28T20:00:43.349 INFO:teuthology.orchestra.run.smithi078.stdout: link/ether 02:42:8f:cc:76:dd brd ff:ff:ff:ff:ff:ff 2023-11-28T20:00:43.349 INFO:teuthology.orchestra.run.smithi078.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-11-28T20:00:43.349 INFO:teuthology.orchestra.run.smithi078.stdout: valid_lft forever preferred_lft forever 2023-11-28T20:00:43.349 INFO:teuthology.orchestra.run.smithi078.stdout:9: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-11-28T20:00:43.349 INFO:teuthology.orchestra.run.smithi078.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2023-11-28T20:00:43.350 INFO:teuthology.orchestra.run.smithi078.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-11-28T20:00:43.350 INFO:teuthology.orchestra.run.smithi078.stdout: valid_lft forever preferred_lft forever 2023-11-28T20:00:43.350 INFO:teuthology.orchestra.run.smithi078.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2023-11-28T20:00:43.350 INFO:teuthology.orchestra.run.smithi078.stdout: valid_lft forever preferred_lft forever 2023-11-28T20:00:43.350 INFO:teuthology.orchestra.run.smithi078.stdout:10: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-11-28T20:00:43.350 INFO:teuthology.orchestra.run.smithi078.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-28T20:00:43.351 INFO:teuthology.orchestra.run.smithi078.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2023-11-28T20:00:43.351 INFO:teuthology.orchestra.run.smithi078.stdout: valid_lft forever preferred_lft forever 2023-11-28T20:00:43.351 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T20:00:43.351 DEBUG:teuthology.orchestra.run.smithi078:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-11-28T20:00:43.408 INFO:teuthology.orchestra.run.smithi078.stdout:1 2023-11-28T20:00:43.410 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T20:00:43.411 DEBUG:teuthology.orchestra.run.smithi078:> route 2023-11-28T20:00:43.463 INFO:teuthology.orchestra.run.smithi078.stdout:Kernel IP routing table 2023-11-28T20:00:43.463 INFO:teuthology.orchestra.run.smithi078.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-11-28T20:00:43.463 INFO:teuthology.orchestra.run.smithi078.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2023-11-28T20:00:43.463 INFO:teuthology.orchestra.run.smithi078.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-11-28T20:00:43.463 INFO:teuthology.orchestra.run.smithi078.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-11-28T20:00:43.463 INFO:teuthology.orchestra.run.smithi078.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-11-28T20:00:43.463 INFO:teuthology.orchestra.run.smithi078.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-11-28T20:00:43.463 INFO:teuthology.orchestra.run.smithi078.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-11-28T20:00:43.463 INFO:teuthology.orchestra.run.smithi078.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-11-28T20:00:43.464 INFO:teuthology.orchestra.run.smithi078.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-11-28T20:00:43.464 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T20:00:43.464 DEBUG:teuthology.orchestra.run.smithi078:> (cd / && exec bash -c ' 2023-11-28T20:00:43.464 DEBUG:teuthology.orchestra.run.smithi078:> set -e 2023-11-28T20:00:43.464 DEBUG:teuthology.orchestra.run.smithi078:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-11-28T20:00:43.464 DEBUG:teuthology.orchestra.run.smithi078:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-11-28T20:00:43.464 DEBUG:teuthology.orchestra.run.smithi078:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-11-28T20:00:43.464 DEBUG:teuthology.orchestra.run.smithi078:> ') 2023-11-28T20:00:43.554 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T20:00:43.555 DEBUG:teuthology.orchestra.run.smithi078:> ip netns list 2023-11-28T20:00:43.565 INFO:teuthology.orchestra.run.smithi078.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-11-28T20:00:43.565 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-11-28T20:00:43.566 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T20:00:43.566 DEBUG:teuthology.orchestra.run.smithi078:> sudo ip link set brx.0 up 2023-11-28T20:00:43.628 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-28T20:00:43.628 DEBUG:teuthology.orchestra.run.smithi078:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-11-28T20:00:43.680 INFO:teuthology.orchestra.run.smithi078.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-11-28T20:00:43.680 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-28T20:00:43.680 DEBUG:teuthology.orchestra.run.smithi078:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-11-28T20:00:43.735 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2023-11-28T20:00:43.735 DEBUG:teuthology.orchestra.run.smithi078:> dd if=/tmp/tmp.rai2IxDqP4 of=/dev/stdout 2023-11-28T20:00:43.787 INFO:tasks.cephfs.kernel_mount:mounting using device: testuser@.cephfs2=/ 2023-11-28T20:00:43.788 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T20:00:43.788 DEBUG:teuthology.orchestra.run.smithi078:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph testuser@.cephfs2=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,secret=AQDnRmZlxPmOOhAABtFMizHRWLo0HdOMCPA14A==,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-11-28T20:00:43.881 INFO:teuthology.orchestra.run.smithi078.stdout:parsing options: rw,norequire_active_mds,secret=AQDnRmZlxPmOOhAABtFMizHRWLo0HdOMCPA14A==,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-11-28T20:00:43.882 INFO:teuthology.orchestra.run.smithi078.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-11-28T20:00:43.882 INFO:teuthology.orchestra.run.smithi078.stdout:keyring.get_secret failed 2023-11-28T20:00:43.891 INFO:teuthology.orchestra.run.smithi078.stderr:mount.ceph: kernel BUG! 2023-11-28T20:00:43.891 INFO:teuthology.orchestra.run.smithi078.stderr:mount error: no mds server is up or the cluster is laggy 2023-11-28T20:00:43.892 INFO:teuthology.orchestra.run.smithi078.stdout:parsing options: rw,norequire_active_mds,secret=AQDnRmZlxPmOOhAABtFMizHRWLo0HdOMCPA14A==,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-11-28T20:00:43.892 INFO:teuthology.orchestra.run.smithi078.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-11-28T20:00:43.892 INFO:teuthology.orchestra.run.smithi078.stdout:mount.ceph: resolved to: "172.21.15.78:3300,172.21.15.179:3300,172.21.15.179:3301" 2023-11-28T20:00:43.893 INFO:teuthology.orchestra.run.smithi078.stdout:mount.ceph: trying mount with new device syntax: testuser@dd9780e8-3bda-44fa-a9f0-fa07d19d901d.cephfs2=/ 2023-11-28T20:00:43.893 INFO:teuthology.orchestra.run.smithi078.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=testuser,ms_mode=prefer-crc,key=testuser,mon_addr=172.21.15.78:3300/172.21.15.179:3300/172.21.15.179:3301" will pass to kernel 2023-11-28T20:00:43.896 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-11-28T20:00:43.896 INFO:tasks.cephfs.kernel_mount:mount command failed 2023-11-28T20:00:43.897 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-11-28T20:00:43.897 DEBUG:teuthology.orchestra.run.smithi078:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-11-28T20:00:43.995 DEBUG:teuthology.orchestra.run.smithi179:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-11-28T20:00:44.052 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-11-28T20:00:44.052 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2023-11-28T20:00:44.053 DEBUG:teuthology.orchestra.run.smithi078:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-28T20:00:44.062 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354608k,nr_inodes=4088652,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275372k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=5526 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275368k,nr_inodes=818842,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275372k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 2023-11-28T20:00:44.063 DEBUG:teuthology.orchestra.run.smithi179:> set -ex 2023-11-28T20:00:44.063 DEBUG:teuthology.orchestra.run.smithi179:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-28T20:00:44.072 DEBUG:teuthology.orchestra.run.smithi179:> set -ex 2023-11-28T20:00:44.073 DEBUG:teuthology.orchestra.run.smithi179:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-28T20:00:44.125 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-28T20:00:44.264 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:44.257+0000 7f92e5156640 1 Processor -- start 2023-11-28T20:00:44.264 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:44.257+0000 7f92e5156640 1 -- start start 2023-11-28T20:00:44.265 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:44.261+0000 7f92e5156640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f92e00a4e30 0x7f92e00c0e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:44.266 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:44.261+0000 7f92e5156640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f92e00c5900 0x7f92e00c5d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:44.266 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:44.261+0000 7f92e5156640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f92e00c1520 con 0x7f92e00aa990 2023-11-28T20:00:44.266 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:44.261+0000 7f92e5156640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f92e0151c60 con 0x7f92e00c5900 2023-11-28T20:00:44.267 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:44.261+0000 7f92e5156640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f92e00c17c0 con 0x7f92e00a4e30 2023-11-28T20:00:44.267 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:44.261+0000 7f92e4955640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f92e00c5900 0x7f92e00c5d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:44.267 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:44.261+0000 7f92e4955640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f92e00c5900 0x7f92e00c5d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:58344/0 (socket says 172.21.15.78:58344) 2023-11-28T20:00:44.267 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:44.261+0000 7f92e4955640 1 -- 172.21.15.78:0/1343280056 learned_addr learned my addr 172.21.15.78:0/1343280056 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T20:00:44.268 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:44.261+0000 7f92d7fff640 1 --2- 172.21.15.78:0/1343280056 >> v2:172.21.15.179:3300/0 conn(0x7f92e00a4e30 0x7f92e00c0e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:44.268 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:44.261+0000 7f92e4955640 1 -- 172.21.15.78:0/1343280056 >> v2:172.21.15.179:3300/0 conn(0x7f92e00a4e30 msgr2=0x7f92e00c0e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:00:44.268 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:44.261+0000 7f92e4955640 1 --2- 172.21.15.78:0/1343280056 >> v2:172.21.15.179:3300/0 conn(0x7f92e00a4e30 0x7f92e00c0e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:44.268 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:44.261+0000 7f92e4955640 1 -- 172.21.15.78:0/1343280056 >> v1:172.21.15.179:6789/0 conn(0x7f92e00aa990 legacy=0x7f92e00c4860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:00:44.269 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:44.261+0000 7f92e4955640 1 -- 172.21.15.78:0/1343280056 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92e0151f40 con 0x7f92e00c5900 2023-11-28T20:00:44.270 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:44.265+0000 7f92e4955640 1 --2- 172.21.15.78:0/1343280056 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f92e00c5900 0x7f92e00c5d70 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f92e006e260 tx=0x7f92d801eb40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1a1254fdeacae7d1 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:00:44.270 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:44.265+0000 7f92df7fe640 1 -- 172.21.15.78:0/1343280056 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92d800b2d0 con 0x7f92e00c5900 2023-11-28T20:00:44.270 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:44.265+0000 7f92df7fe640 1 -- 172.21.15.78:0/1343280056 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f92d800b430 con 0x7f92e00c5900 2023-11-28T20:00:44.271 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:44.265+0000 7f92df7fe640 1 -- 172.21.15.78:0/1343280056 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92d80a7930 con 0x7f92e00c5900 2023-11-28T20:00:44.271 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:44.265+0000 7f92e5156640 1 -- 172.21.15.78:0/1343280056 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f92e00c5900 msgr2=0x7f92e00c5d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:00:44.271 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:44.265+0000 7f92e5156640 1 --2- 172.21.15.78:0/1343280056 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f92e00c5900 0x7f92e00c5d70 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f92e006e260 tx=0x7f92d801eb40 comp rx=0 tx=0).stop 2023-11-28T20:00:44.272 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:44.265+0000 7f92e5156640 1 -- 172.21.15.78:0/1343280056 shutdown_connections 2023-11-28T20:00:44.272 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:44.265+0000 7f92e5156640 1 --2- 172.21.15.78:0/1343280056 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f92e00c5900 0x7f92e00c5d70 unknown :-1 s=CLOSED pgs=490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:44.272 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:44.265+0000 7f92e5156640 1 --2- 172.21.15.78:0/1343280056 >> v2:172.21.15.179:3300/0 conn(0x7f92e00a4e30 0x7f92e00c0e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:44.272 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:44.265+0000 7f92e5156640 1 -- 172.21.15.78:0/1343280056 >> 172.21.15.78:0/1343280056 conn(0x7f92e00a7600 msgr2=0x7f92e00a7a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:00:44.272 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:44.265+0000 7f92e5156640 1 -- 172.21.15.78:0/1343280056 shutdown_connections 2023-11-28T20:00:44.272 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:44.265+0000 7f92e5156640 1 -- 172.21.15.78:0/1343280056 wait complete. 2023-11-28T20:00:44.275 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:44.265+0000 7f92e5156640 1 Processor -- start 2023-11-28T20:00:44.275 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:44.265+0000 7f92e5156640 1 -- start start 2023-11-28T20:00:44.275 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:44.269+0000 7f92e5156640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f92e00a4e30 0x7f92e00beee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:44.275 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:44.269+0000 7f92e5156640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f92e00aa990 0x7f92e01476b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:44.275 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:44.269+0000 7f92e5156640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f92e00c5900 0x7f92e0147bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:44.275 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:44.269+0000 7f92e5156640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92e01f0fb0 con 0x7f92e00a4e30 2023-11-28T20:00:44.275 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:44.269+0000 7f92e5156640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92e01f0a50 con 0x7f92e00aa990 2023-11-28T20:00:44.275 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:44.269+0000 7f92e5156640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f92e0148130 con 0x7f92e00c5900 2023-11-28T20:00:44.275 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:44.269+0000 7f92dffff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f92e00a4e30 0x7f92e00beee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:44.275 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:44.269+0000 7f92dffff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f92e00a4e30 0x7f92e00beee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:58350/0 (socket says 172.21.15.78:58350) 2023-11-28T20:00:44.275 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:44.269+0000 7f92dffff640 1 -- 172.21.15.78:0/2101120226 learned_addr learned my addr 172.21.15.78:0/2101120226 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T20:00:44.276 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:44.269+0000 7f92d7fff640 1 --2- 172.21.15.78:0/2101120226 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f92e00aa990 0x7f92e01476b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:44.276 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:44.269+0000 7f92e4955640 1 --2- 172.21.15.78:0/2101120226 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f92e00c5900 0x7f92e0147bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:44.276 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:44.269+0000 7f92dffff640 1 -- 172.21.15.78:0/2101120226 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f92e00c5900 msgr2=0x7f92e0147bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:00:44.276 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:44.269+0000 7f92dffff640 1 --2- 172.21.15.78:0/2101120226 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f92e00c5900 0x7f92e0147bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:44.276 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:44.269+0000 7f92dffff640 1 -- 172.21.15.78:0/2101120226 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f92e00aa990 msgr2=0x7f92e01476b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:00:44.276 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:44.269+0000 7f92dffff640 1 --2- 172.21.15.78:0/2101120226 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f92e00aa990 0x7f92e01476b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:44.276 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:44.269+0000 7f92dffff640 1 -- 172.21.15.78:0/2101120226 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92d800bd40 con 0x7f92e00a4e30 2023-11-28T20:00:44.276 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:44.269+0000 7f92dffff640 1 --2- 172.21.15.78:0/2101120226 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f92e00a4e30 0x7f92e00beee0 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f92d000c500 tx=0x7f92d000c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:00:44.276 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:44.269+0000 7f92dd7fa640 1 -- 172.21.15.78:0/2101120226 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92d0005220 con 0x7f92e00a4e30 2023-11-28T20:00:44.276 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:44.269+0000 7f92dd7fa640 1 -- 172.21.15.78:0/2101120226 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f92d0005380 con 0x7f92e00a4e30 2023-11-28T20:00:44.277 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:44.269+0000 7f92e5156640 1 -- 172.21.15.78:0/2101120226 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f92e01f0cd0 con 0x7f92e00a4e30 2023-11-28T20:00:44.277 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:44.269+0000 7f92dd7fa640 1 -- 172.21.15.78:0/2101120226 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92d0007270 con 0x7f92e00a4e30 2023-11-28T20:00:44.277 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:44.269+0000 7f92e5156640 1 -- 172.21.15.78:0/2101120226 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f92e006fef0 con 0x7f92e00a4e30 2023-11-28T20:00:44.277 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:44.269+0000 7f92e5156640 1 -- 172.21.15.78:0/2101120226 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f92e01ecb00 con 0x7f92e00a4e30 2023-11-28T20:00:44.277 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:44.269+0000 7f92dd7fa640 1 -- 172.21.15.78:0/2101120226 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f92d00073d0 con 0x7f92e00a4e30 2023-11-28T20:00:44.278 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:44.269+0000 7f92dd7fa640 1 --2- 172.21.15.78:0/2101120226 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f92c0066470 0x7f92c0068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:44.278 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:44.273+0000 7f92dd7fa640 1 -- 172.21.15.78:0/2101120226 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 6885+0+0 (secure 0 0 0) 0x7f92d00836d0 con 0x7f92e00a4e30 2023-11-28T20:00:44.278 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:44.273+0000 7f92d7fff640 1 --2- 172.21.15.78:0/2101120226 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f92c0066470 0x7f92c0068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:44.278 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:44.273+0000 7f92d7fff640 1 --2- 172.21.15.78:0/2101120226 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f92c0066470 0x7f92c0068930 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f92e00a4dc0 tx=0x7f92c8008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:00:44.279 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:44.273+0000 7f92dd7fa640 1 -- 172.21.15.78:0/2101120226 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f92d00506d0 con 0x7f92e00a4e30 2023-11-28T20:00:44.430 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:44.425+0000 7f92e5156640 1 -- 172.21.15.78:0/2101120226 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f92e00674b0 con 0x7f92e00a4e30 2023-11-28T20:00:44.431 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:44.425+0000 7f92dd7fa640 1 -- 172.21.15.78:0/2101120226 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v44) v1 ==== 74+0+20466 (secure 0 0 0) 0x7f92d005a070 con 0x7f92e00a4e30 2023-11-28T20:00:44.432 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-11-28T20:00:44.432 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":44,"fsid":"dd9780e8-3bda-44fa-a9f0-fa07d19d901d","created":"2023-11-28T19:58:40.969556+0000","modified":"2023-11-28T20:00:31.764388+0000","last_up_change":"2023-11-28T19:58:52.596716+0000","last_in_change":"2023-11-28T19:58:43.609275+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-28T19:58:54.011229+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2023-11-28T20:00:10.831194+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"39","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2023-11-28T20:00:12.150184+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"40","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs2_metadata","create_time":"2023-11-28T20:00:28.571896+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"43","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs2_data","create_time":"2023-11-28T20:00:29.436453+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"44","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs2"}},"read_balance":{"score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e84245ac-b5da-429e-af18-39acaa2b33e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6800","nonce":3358701235},{"type":"v1","addr":"172.21.15.78:6801","nonce":3358701235}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6802","nonce":3358701235},{"type":"v1","addr":"172.21.15.78:6803","nonce":3358701235}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6806","nonce":3358701235},{"type":"v1","addr":"172.21.15.78:6807","nonce":3358701235}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6804","nonce":3358701235},{"type":"v1","addr":"172.21.15.78:6805","nonce":3358701235}]},"public_addr":"172.21.15.78:6801/3358701235","cluster_addr":"172.21.15.78:6803/3358701235","heartbeat_back_addr":"172.21.15.78:6807/3358701235","heartbeat_front_addr":"172.21.15.78:6805/3358701235","state":["exists","up"]},{"osd":1,"uuid":"e634831d-c4e2-48d9-870c-9556ae162981","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6808","nonce":3211476654},{"type":"v1","addr":"172.21.15.78:6809","nonce":3211476654}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6810","nonce":3211476654},{"type":"v1","addr":"172.21.15.78:6811","nonce":3211476654}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6814","nonce":3211476654},{"type":"v1","addr":"172.21.15.78:6815","nonce":3211476654}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6812","nonce":3211476654},{"type":"v1","addr":"172.21.15.78:6813","nonce":3211476654}]},"public_addr":"172.21.15.78:6809/3211476654","cluster_addr":"172.21.15.78:6811/3211476654","heartbeat_back_addr":"172.21.15.78:6815/3211476654","heartbeat_front_addr":"172.21.15.78:6813/3211476654","state":["exists","up"]},{"osd":2,"uuid":"274c8395-6534-41f0-b8fb-a00af8985aa8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6816","nonce":2532904479},{"type":"v1","addr":"172.21.15.78:6817","nonce":2532904479}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6818","nonce":2532904479},{"type":"v1","addr":"172.21.15.78:6819","nonce":2532904479}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6822","nonce":2532904479},{"type":"v1","addr":"172.21.15.78:6823","nonce":2532904479}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6820","nonce":2532904479},{"type":"v1","addr":"172.21.15.78:6821","nonce":2532904479}]},"public_addr":"172.21.15.78:6817/2532904479","cluster_addr":"172.21.15.78:6819/2532904479","heartbeat_back_addr":"172.21.15.78:6823/2532904479","heartbeat_front_addr":"172.21.15.78:6821/2532904479","state":["exists","up"]},{"osd":3,"uuid":"77acc9af-7d4d-4b18-8cf5-d62f5971b7c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6824","nonce":3442991267},{"type":"v1","addr":"172.21.15.78:6825","nonce":3442991267}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6826","nonce":3442991267},{"type":"v1","addr":"172.21.15.78:6827","nonce":3442991267}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6830","nonce":3442991267},{"type":"v1","addr":"172.21.15.78:6831","nonce":3442991267}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6828","nonce":3442991267},{"type":"v1","addr":"172.21.15.78:6829","nonce":3442991267}]},"public_addr":"172.21.15.78:6825/3442991267","cluster_addr":"172.21.15.78:6827/3442991267","heartbeat_back_addr":"172.21.15.78:6831/3442991267","heartbeat_front_addr":"172.21.15.78:6829/3442991267","state":["exists","up"]},{"osd":4,"uuid":"5c62bc66-6b34-4b7f-a66b-9a743969138c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":802983577},{"type":"v1","addr":"172.21.15.179:6809","nonce":802983577}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":802983577},{"type":"v1","addr":"172.21.15.179:6811","nonce":802983577}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":802983577},{"type":"v1","addr":"172.21.15.179:6815","nonce":802983577}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":802983577},{"type":"v1","addr":"172.21.15.179:6813","nonce":802983577}]},"public_addr":"172.21.15.179:6809/802983577","cluster_addr":"172.21.15.179:6811/802983577","heartbeat_back_addr":"172.21.15.179:6815/802983577","heartbeat_front_addr":"172.21.15.179:6813/802983577","state":["exists","up"]},{"osd":5,"uuid":"67db6d36-f684-4079-b0cd-82b4dd61461f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":518192887},{"type":"v1","addr":"172.21.15.179:6818","nonce":518192887}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":518192887},{"type":"v1","addr":"172.21.15.179:6822","nonce":518192887}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":518192887},{"type":"v1","addr":"172.21.15.179:6829","nonce":518192887}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6824","nonce":518192887},{"type":"v1","addr":"172.21.15.179:6826","nonce":518192887}]},"public_addr":"172.21.15.179:6818/518192887","cluster_addr":"172.21.15.179:6822/518192887","heartbeat_back_addr":"172.21.15.179:6829/518192887","heartbeat_front_addr":"172.21.15.179:6826/518192887","state":["exists","up"]},{"osd":6,"uuid":"12e670af-5a16-4c81-9f97-defa66cab967","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":815435378},{"type":"v1","addr":"172.21.15.179:6801","nonce":815435378}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":815435378},{"type":"v1","addr":"172.21.15.179:6803","nonce":815435378}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":815435378},{"type":"v1","addr":"172.21.15.179:6807","nonce":815435378}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":815435378},{"type":"v1","addr":"172.21.15.179:6805","nonce":815435378}]},"public_addr":"172.21.15.179:6801/815435378","cluster_addr":"172.21.15.179:6803/815435378","heartbeat_back_addr":"172.21.15.179:6807/815435378","heartbeat_front_addr":"172.21.15.179:6805/815435378","state":["exists","up"]},{"osd":7,"uuid":"fe630650-2eb3-49ad-8676-c341e6332eb1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6817","nonce":2848432339},{"type":"v1","addr":"172.21.15.179:6819","nonce":2848432339}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6821","nonce":2848432339},{"type":"v1","addr":"172.21.15.179:6823","nonce":2848432339}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":2848432339},{"type":"v1","addr":"172.21.15.179:6831","nonce":2848432339}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6825","nonce":2848432339},{"type":"v1","addr":"172.21.15.179:6827","nonce":2848432339}]},"public_addr":"172.21.15.179:6819/2848432339","cluster_addr":"172.21.15.179:6823/2848432339","heartbeat_back_addr":"172.21.15.179:6831/2848432339","heartbeat_front_addr":"172.21.15.179:6827/2848432339","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:58:49.255433+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:58:49.412880+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:58:49.559295+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:58:49.245237+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:58:49.184557+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:58:49.329851+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:58:49.366012+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:58:49.349604+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-28T20:00:44.433 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:44.429+0000 7f92e5156640 1 -- 172.21.15.78:0/2101120226 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f92c0066470 msgr2=0x7f92c0068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:00:44.434 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:44.429+0000 7f92e5156640 1 --2- 172.21.15.78:0/2101120226 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f92c0066470 0x7f92c0068930 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f92e00a4dc0 tx=0x7f92c8008040 comp rx=0 tx=0).stop 2023-11-28T20:00:44.434 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:44.429+0000 7f92e5156640 1 -- 172.21.15.78:0/2101120226 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f92e00a4e30 msgr2=0x7f92e00beee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:00:44.434 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:44.429+0000 7f92e5156640 1 --2- 172.21.15.78:0/2101120226 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f92e00a4e30 0x7f92e00beee0 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f92d000c500 tx=0x7f92d000c9c0 comp rx=0 tx=0).stop 2023-11-28T20:00:44.434 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:44.429+0000 7f92e5156640 1 -- 172.21.15.78:0/2101120226 shutdown_connections 2023-11-28T20:00:44.434 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:44.429+0000 7f92e5156640 1 --2- 172.21.15.78:0/2101120226 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f92c0066470 0x7f92c0068930 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:44.434 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:44.429+0000 7f92e5156640 1 --2- 172.21.15.78:0/2101120226 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f92e00c5900 0x7f92e0147bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:44.434 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:44.429+0000 7f92e5156640 1 --2- 172.21.15.78:0/2101120226 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f92e00aa990 0x7f92e01476b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:44.434 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:44.429+0000 7f92e5156640 1 --2- 172.21.15.78:0/2101120226 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f92e00a4e30 0x7f92e00beee0 unknown :-1 s=CLOSED pgs=491 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:44.434 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:44.429+0000 7f92e5156640 1 -- 172.21.15.78:0/2101120226 >> 172.21.15.78:0/2101120226 conn(0x7f92e00a7600 msgr2=0x7f92e00c0e10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:00:44.434 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:44.429+0000 7f92e5156640 1 -- 172.21.15.78:0/2101120226 shutdown_connections 2023-11-28T20:00:44.434 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:44.429+0000 7f92e5156640 1 -- 172.21.15.78:0/2101120226 wait complete. 2023-11-28T20:00:44.453 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-28T19:58:54.011229+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-28T20:00:10.831194+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '39', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.25, 'score_stable': 1.25, 'optimal_score': 1, 'raw_score_acting': 1.25, 'raw_score_stable': 1.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 6, 'pool_name': 'cephfs_data', 'create_time': '2023-11-28T20:00:12.150184+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '40', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 7, 'pool_name': 'cephfs2_metadata', 'create_time': '2023-11-28T20:00:28.571896+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '43', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs2'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 8, 'pool_name': 'cephfs2_data', 'create_time': '2023-11-28T20:00:29.436453+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '44', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs2'}}, 'read_balance': {'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-28T20:00:44.454 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-28T20:00:44.594 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:44.589+0000 7f2554faa640 1 Processor -- start 2023-11-28T20:00:44.594 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:44.589+0000 7f2554faa640 1 -- start start 2023-11-28T20:00:44.596 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:44.589+0000 7f2554faa640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f255014fc30 0x7f25500c3cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:44.596 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:44.589+0000 7f2554faa640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2550152910 con 0x7f255006d840 2023-11-28T20:00:44.597 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:44.589+0000 7f2554faa640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2550152bf0 con 0x7f255014f850 2023-11-28T20:00:44.597 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:44.589+0000 7f2554faa640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25500c2240 con 0x7f255014fc30 2023-11-28T20:00:44.597 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:44.589+0000 7f254ed9d640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f255006d840 0x7f25500c4210 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:34090/0 (socket says 172.21.15.78:34090) 2023-11-28T20:00:44.597 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:44.589+0000 7f254ed9d640 1 -- 172.21.15.78:0/381786305 learned_addr learned my addr 172.21.15.78:0/381786305 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-11-28T20:00:44.597 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:44.593+0000 7f2547fff640 1 --2- 172.21.15.78:0/381786305 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f255014fc30 0x7f25500c3cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:44.597 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:44.593+0000 7f254dd9b640 1 -- 172.21.15.78:0/381786305 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3764735684 0 0) 0x7f2550152910 con 0x7f255006d840 2023-11-28T20:00:44.597 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:44.593+0000 7f254dd9b640 1 -- 172.21.15.78:0/381786305 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f253c003530 con 0x7f255006d840 2023-11-28T20:00:44.597 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:44.593+0000 7f254dd9b640 1 -- 172.21.15.78:0/381786305 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2749085547 0 0) 0x7f2550152bf0 con 0x7f255014f850 2023-11-28T20:00:44.597 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:44.593+0000 7f254dd9b640 1 -- 172.21.15.78:0/381786305 --> v1:172.21.15.179:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2550152910 con 0x7f255014f850 2023-11-28T20:00:44.597 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:44.593+0000 7f2547fff640 1 -- 172.21.15.78:0/381786305 >> v1:172.21.15.179:6789/0 conn(0x7f255014f850 legacy=0x7f25500aacf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:00:44.597 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:44.593+0000 7f2547fff640 1 -- 172.21.15.78:0/381786305 >> v1:172.21.15.78:6789/0 conn(0x7f255006d840 legacy=0x7f25500c4210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:00:44.597 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:44.593+0000 7f254dd9b640 1 -- 172.21.15.78:0/381786305 <== mon.0 v1:172.21.15.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1939533924 0 0) 0x7f253c003530 con 0x7f255006d840 2023-11-28T20:00:44.598 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:44.593+0000 7f2547fff640 1 -- 172.21.15.78:0/381786305 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2550152ed0 con 0x7f255014fc30 2023-11-28T20:00:44.599 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:44.593+0000 7f2547fff640 1 --2- 172.21.15.78:0/381786305 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f255014fc30 0x7f25500c3cd0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f25380097f0 tx=0x7f253801c3e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c3235c6c008753df server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:00:44.599 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:44.593+0000 7f254dd9b640 1 -- 172.21.15.78:0/381786305 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2548001a00 con 0x7f255014fc30 2023-11-28T20:00:44.599 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:44.593+0000 7f254dd9b640 1 -- 172.21.15.78:0/381786305 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25380ad480 con 0x7f255014fc30 2023-11-28T20:00:44.600 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:44.593+0000 7f254dd9b640 1 -- 172.21.15.78:0/381786305 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25380ad810 con 0x7f255014fc30 2023-11-28T20:00:44.600 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:44.597+0000 7f2554faa640 1 -- 172.21.15.78:0/381786305 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f255014fc30 msgr2=0x7f25500c3cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:00:44.600 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:44.597+0000 7f2554faa640 1 --2- 172.21.15.78:0/381786305 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f255014fc30 0x7f25500c3cd0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f25380097f0 tx=0x7f253801c3e0 comp rx=0 tx=0).stop 2023-11-28T20:00:44.601 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:44.597+0000 7f2554faa640 1 -- 172.21.15.78:0/381786305 shutdown_connections 2023-11-28T20:00:44.601 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:44.597+0000 7f2554faa640 1 --2- 172.21.15.78:0/381786305 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f255014fc30 0x7f25500c3cd0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:44.601 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:44.597+0000 7f2554faa640 1 -- 172.21.15.78:0/381786305 >> 172.21.15.78:0/381786305 conn(0x7f25500c59f0 msgr2=0x7f25500c5e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:00:44.601 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:44.597+0000 7f2554faa640 1 -- 172.21.15.78:0/381786305 shutdown_connections 2023-11-28T20:00:44.601 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:44.597+0000 7f2554faa640 1 -- 172.21.15.78:0/381786305 wait complete. 2023-11-28T20:00:44.602 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:44.597+0000 7f2554faa640 1 Processor -- start 2023-11-28T20:00:44.602 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:44.597+0000 7f2554faa640 1 -- start start 2023-11-28T20:00:44.603 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:44.597+0000 7f2554faa640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f255006d840 0x7f255014af80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:44.604 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:44.597+0000 7f2554faa640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f255014f850 0x7f255006fd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:44.604 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:44.597+0000 7f2554faa640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f255014fc30 0x7f2550140fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:44.604 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:44.597+0000 7f2554faa640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f255014ab60 con 0x7f255006d840 2023-11-28T20:00:44.604 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:44.597+0000 7f2554faa640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2550147a10 con 0x7f255014f850 2023-11-28T20:00:44.604 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:44.597+0000 7f2554faa640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2550147450 con 0x7f255014fc30 2023-11-28T20:00:44.604 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:44.597+0000 7f254e59c640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f255006d840 0x7f255014af80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:44.605 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:44.597+0000 7f254e59c640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f255006d840 0x7f255014af80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:58358/0 (socket says 172.21.15.78:58358) 2023-11-28T20:00:44.605 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:44.597+0000 7f254e59c640 1 -- 172.21.15.78:0/951599409 learned_addr learned my addr 172.21.15.78:0/951599409 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T20:00:44.605 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:44.597+0000 7f254ed9d640 1 --2- 172.21.15.78:0/951599409 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f255014fc30 0x7f2550140fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:44.605 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:44.597+0000 7f2547fff640 1 --2- 172.21.15.78:0/951599409 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f255014f850 0x7f255006fd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:44.605 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:44.601+0000 7f254e59c640 1 -- 172.21.15.78:0/951599409 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f255014fc30 msgr2=0x7f2550140fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:00:44.605 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:44.601+0000 7f254e59c640 1 --2- 172.21.15.78:0/951599409 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f255014fc30 0x7f2550140fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:44.605 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:44.601+0000 7f254e59c640 1 -- 172.21.15.78:0/951599409 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f255014f850 msgr2=0x7f255006fd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:00:44.605 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:44.601+0000 7f254e59c640 1 --2- 172.21.15.78:0/951599409 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f255014f850 0x7f255006fd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:44.605 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:44.601+0000 7f254e59c640 1 -- 172.21.15.78:0/951599409 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2538009420 con 0x7f255006d840 2023-11-28T20:00:44.606 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:44.601+0000 7f254e59c640 1 --2- 172.21.15.78:0/951599409 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f255006d840 0x7f255014af80 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f254000c490 tx=0x7f254000c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:00:44.606 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:44.601+0000 7f2546ffd640 1 -- 172.21.15.78:0/951599409 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25400052d0 con 0x7f255006d840 2023-11-28T20:00:44.606 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:44.601+0000 7f2546ffd640 1 -- 172.21.15.78:0/951599409 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2540005430 con 0x7f255006d840 2023-11-28T20:00:44.607 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:44.601+0000 7f2554faa640 1 -- 172.21.15.78:0/951599409 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2550147730 con 0x7f255006d840 2023-11-28T20:00:44.607 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:44.601+0000 7f2546ffd640 1 -- 172.21.15.78:0/951599409 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2540012870 con 0x7f255006d840 2023-11-28T20:00:44.607 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:44.601+0000 7f2554faa640 1 -- 172.21.15.78:0/951599409 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2550147ba0 con 0x7f255006d840 2023-11-28T20:00:44.607 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:44.601+0000 7f2554faa640 1 -- 172.21.15.78:0/951599409 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f255014a5e0 con 0x7f255006d840 2023-11-28T20:00:44.607 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:44.601+0000 7f2546ffd640 1 -- 172.21.15.78:0/951599409 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f25400129d0 con 0x7f255006d840 2023-11-28T20:00:44.607 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:44.601+0000 7f2546ffd640 1 --2- 172.21.15.78:0/951599409 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f2530066470 0x7f2530068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:44.608 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:44.601+0000 7f2546ffd640 1 -- 172.21.15.78:0/951599409 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 6885+0+0 (secure 0 0 0) 0x7f2540083e20 con 0x7f255006d840 2023-11-28T20:00:44.608 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:44.601+0000 7f2547fff640 1 --2- 172.21.15.78:0/951599409 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f2530066470 0x7f2530068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:44.608 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:44.605+0000 7f2547fff640 1 --2- 172.21.15.78:0/951599409 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f2530066470 0x7f2530068930 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f25380af000 tx=0x7f25380a7000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:00:44.611 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:44.605+0000 7f2546ffd640 1 -- 172.21.15.78:0/951599409 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f255014a5e0 con 0x7f255006d840 2023-11-28T20:00:44.765 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:44.761+0000 7f2554faa640 1 -- 172.21.15.78:0/951599409 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f255014a5e0 con 0x7f255006d840 2023-11-28T20:00:44.766 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:44.761+0000 7f2546ffd640 1 -- 172.21.15.78:0/951599409 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v44) v1 ==== 93+0+10 (secure 0 0 0) 0x7f255014a5e0 con 0x7f255006d840 2023-11-28T20:00:44.766 INFO:teuthology.orchestra.run.smithi078.stdout:pg_num: 1 2023-11-28T20:00:44.768 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:44.761+0000 7f2554faa640 1 -- 172.21.15.78:0/951599409 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f2530066470 msgr2=0x7f2530068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:00:44.768 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:44.761+0000 7f2554faa640 1 --2- 172.21.15.78:0/951599409 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f2530066470 0x7f2530068930 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f25380af000 tx=0x7f25380a7000 comp rx=0 tx=0).stop 2023-11-28T20:00:44.768 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:44.761+0000 7f2554faa640 1 -- 172.21.15.78:0/951599409 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f255006d840 msgr2=0x7f255014af80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:00:44.768 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:44.761+0000 7f2554faa640 1 --2- 172.21.15.78:0/951599409 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f255006d840 0x7f255014af80 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f254000c490 tx=0x7f254000c950 comp rx=0 tx=0).stop 2023-11-28T20:00:44.768 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:44.761+0000 7f2554faa640 1 -- 172.21.15.78:0/951599409 shutdown_connections 2023-11-28T20:00:44.768 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:44.761+0000 7f2554faa640 1 --2- 172.21.15.78:0/951599409 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f2530066470 0x7f2530068930 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:44.769 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:44.761+0000 7f2554faa640 1 --2- 172.21.15.78:0/951599409 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f255014fc30 0x7f2550140fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:44.769 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:44.761+0000 7f2554faa640 1 --2- 172.21.15.78:0/951599409 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f255014f850 0x7f255006fd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:44.769 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:44.761+0000 7f2554faa640 1 --2- 172.21.15.78:0/951599409 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f255006d840 0x7f255014af80 unknown :-1 s=CLOSED pgs=493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:44.769 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:44.761+0000 7f2554faa640 1 -- 172.21.15.78:0/951599409 >> 172.21.15.78:0/951599409 conn(0x7f25500c59f0 msgr2=0x7f2550150330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:00:44.769 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:44.765+0000 7f2554faa640 1 -- 172.21.15.78:0/951599409 shutdown_connections 2023-11-28T20:00:44.769 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:44.765+0000 7f2554faa640 1 -- 172.21.15.78:0/951599409 wait complete. 2023-11-28T20:00:44.786 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-28T20:00:44.928 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:44.925+0000 7f92644fd640 1 Processor -- start 2023-11-28T20:00:44.928 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:44.925+0000 7f92644fd640 1 -- start start 2023-11-28T20:00:44.930 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:44.925+0000 7f92644fd640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f925c14f850 0x7f925c0aacf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:44.930 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:44.925+0000 7f92644fd640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f925c06d840 0x7f925c0c43e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:44.930 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:44.925+0000 7f92644fd640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f925c152910 con 0x7f925c14fc30 2023-11-28T20:00:44.930 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:44.925+0000 7f92644fd640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f925c0c2240 con 0x7f925c06d840 2023-11-28T20:00:44.930 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:44.925+0000 7f92644fd640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f925c152bf0 con 0x7f925c14f850 2023-11-28T20:00:44.930 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:44.925+0000 7f9262a9a640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f925c06d840 0x7f925c0c43e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:44.930 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:44.925+0000 7f9261a98640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f925c14fc30 0x7f925c0c3cd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:34092/0 (socket says 172.21.15.78:34092) 2023-11-28T20:00:44.930 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:44.925+0000 7f9261a98640 1 -- 172.21.15.78:0/3470695513 learned_addr learned my addr 172.21.15.78:0/3470695513 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-11-28T20:00:44.930 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:44.925+0000 7f9262299640 1 --2- 172.21.15.78:0/3470695513 >> v2:172.21.15.179:3300/0 conn(0x7f925c14f850 0x7f925c0aacf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:44.931 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:44.925+0000 7f9262a9a640 1 -- 172.21.15.78:0/3470695513 >> v2:172.21.15.179:3300/0 conn(0x7f925c14f850 msgr2=0x7f925c0aacf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:00:44.931 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:44.925+0000 7f9262a9a640 1 --2- 172.21.15.78:0/3470695513 >> v2:172.21.15.179:3300/0 conn(0x7f925c14f850 0x7f925c0aacf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:44.931 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:44.925+0000 7f9262a9a640 1 -- 172.21.15.78:0/3470695513 >> v1:172.21.15.78:6789/0 conn(0x7f925c14fc30 legacy=0x7f925c0c3cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:00:44.931 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:44.925+0000 7f9262a9a640 1 -- 172.21.15.78:0/3470695513 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f925c152ed0 con 0x7f925c06d840 2023-11-28T20:00:44.931 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:44.925+0000 7f9262299640 1 --2- 172.21.15.78:0/3470695513 >> v2:172.21.15.179:3300/0 conn(0x7f925c14f850 0x7f925c0aacf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T20:00:44.933 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:44.929+0000 7f9262a9a640 1 --2- 172.21.15.78:0/3470695513 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f925c06d840 0x7f925c0c43e0 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f925c066f50 tx=0x7f925401c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2baeddcf9c0dfc96 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:00:44.933 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:44.929+0000 7f9261297640 1 -- 172.21.15.78:0/3470695513 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92540a59f0 con 0x7f925c06d840 2023-11-28T20:00:44.933 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:44.929+0000 7f9261297640 1 -- 172.21.15.78:0/3470695513 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f92540a5b50 con 0x7f925c06d840 2023-11-28T20:00:44.933 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:44.929+0000 7f9261297640 1 -- 172.21.15.78:0/3470695513 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92540ad440 con 0x7f925c06d840 2023-11-28T20:00:44.934 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:44.929+0000 7f92644fd640 1 -- 172.21.15.78:0/3470695513 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f925c06d840 msgr2=0x7f925c0c43e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:00:44.934 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:44.929+0000 7f92644fd640 1 --2- 172.21.15.78:0/3470695513 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f925c06d840 0x7f925c0c43e0 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f925c066f50 tx=0x7f925401c910 comp rx=0 tx=0).stop 2023-11-28T20:00:44.934 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:44.929+0000 7f92644fd640 1 -- 172.21.15.78:0/3470695513 shutdown_connections 2023-11-28T20:00:44.934 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:44.929+0000 7f92644fd640 1 --2- 172.21.15.78:0/3470695513 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f925c06d840 0x7f925c0c43e0 unknown :-1 s=CLOSED pgs=495 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:44.934 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:44.929+0000 7f92644fd640 1 --2- 172.21.15.78:0/3470695513 >> v2:172.21.15.179:3300/0 conn(0x7f925c14f850 0x7f925c0aacf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:44.934 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:44.929+0000 7f92644fd640 1 -- 172.21.15.78:0/3470695513 >> 172.21.15.78:0/3470695513 conn(0x7f925c0c59f0 msgr2=0x7f925c0c5e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:00:44.934 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:44.929+0000 7f92644fd640 1 -- 172.21.15.78:0/3470695513 shutdown_connections 2023-11-28T20:00:44.935 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:44.929+0000 7f92644fd640 1 -- 172.21.15.78:0/3470695513 wait complete. 2023-11-28T20:00:44.935 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:44.929+0000 7f92644fd640 1 Processor -- start 2023-11-28T20:00:44.935 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:44.929+0000 7f92644fd640 1 -- start start 2023-11-28T20:00:44.937 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:44.933+0000 7f92644fd640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f925c06d840 0x7f925c0700f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:44.938 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:44.933+0000 7f92644fd640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f925c14f850 0x7f925c1f0ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:44.938 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:44.933+0000 7f92644fd640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f925c14fc30 0x7f925c1499d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:44.938 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:44.933+0000 7f92644fd640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f925c0aa630 con 0x7f925c14f850 2023-11-28T20:00:44.938 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:44.933+0000 7f92644fd640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f925c144ab0 con 0x7f925c06d840 2023-11-28T20:00:44.938 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:44.933+0000 7f92644fd640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f925c0aa880 con 0x7f925c14fc30 2023-11-28T20:00:44.938 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:44.933+0000 7f9261a98640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f925c14f850 0x7f925c1f0ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:44.939 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:44.933+0000 7f9261a98640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f925c14f850 0x7f925c1f0ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:58376/0 (socket says 172.21.15.78:58376) 2023-11-28T20:00:44.939 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:44.933+0000 7f9261a98640 1 -- 172.21.15.78:0/15335825 learned_addr learned my addr 172.21.15.78:0/15335825 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T20:00:44.939 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:44.933+0000 7f9262299640 1 --2- 172.21.15.78:0/15335825 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f925c06d840 0x7f925c0700f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:44.939 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:44.933+0000 7f9262a9a640 1 --2- 172.21.15.78:0/15335825 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f925c14fc30 0x7f925c1499d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:44.939 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:44.933+0000 7f9261a98640 1 -- 172.21.15.78:0/15335825 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f925c14fc30 msgr2=0x7f925c1499d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:00:44.939 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:44.933+0000 7f9261a98640 1 --2- 172.21.15.78:0/15335825 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f925c14fc30 0x7f925c1499d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:44.939 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:44.933+0000 7f9261a98640 1 -- 172.21.15.78:0/15335825 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f925c06d840 msgr2=0x7f925c0700f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:00:44.939 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:44.933+0000 7f9261a98640 1 --2- 172.21.15.78:0/15335825 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f925c06d840 0x7f925c0700f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:44.939 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:44.933+0000 7f9261a98640 1 -- 172.21.15.78:0/15335825 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9254009a70 con 0x7f925c14f850 2023-11-28T20:00:44.939 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:44.933+0000 7f9261a98640 1 --2- 172.21.15.78:0/15335825 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f925c14f850 0x7f925c1f0ed0 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f924c00c400 tx=0x7f924c00c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:00:44.939 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:44.933+0000 7f9252ffd640 1 -- 172.21.15.78:0/15335825 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f924c005cf0 con 0x7f925c14f850 2023-11-28T20:00:44.939 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:44.933+0000 7f9252ffd640 1 -- 172.21.15.78:0/15335825 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f924c005e50 con 0x7f925c14f850 2023-11-28T20:00:44.940 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:44.933+0000 7f92644fd640 1 -- 172.21.15.78:0/15335825 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f925c0a96e0 con 0x7f925c14f850 2023-11-28T20:00:44.940 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:44.933+0000 7f9252ffd640 1 -- 172.21.15.78:0/15335825 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f924c0072d0 con 0x7f925c14f850 2023-11-28T20:00:44.940 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:44.933+0000 7f92644fd640 1 -- 172.21.15.78:0/15335825 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f925c070630 con 0x7f925c14f850 2023-11-28T20:00:44.941 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:44.933+0000 7f92644fd640 1 -- 172.21.15.78:0/15335825 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f925c0a9b90 con 0x7f925c14f850 2023-11-28T20:00:44.941 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:44.933+0000 7f9252ffd640 1 -- 172.21.15.78:0/15335825 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f924c007430 con 0x7f925c14f850 2023-11-28T20:00:44.941 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:44.937+0000 7f9252ffd640 1 --2- 172.21.15.78:0/15335825 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f9240066470 0x7f9240068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:44.941 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:44.937+0000 7f9252ffd640 1 -- 172.21.15.78:0/15335825 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 6885+0+0 (secure 0 0 0) 0x7f924c0837f0 con 0x7f925c14f850 2023-11-28T20:00:44.941 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:44.937+0000 7f9262299640 1 --2- 172.21.15.78:0/15335825 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f9240066470 0x7f9240068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:44.941 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:44.937+0000 7f9262299640 1 --2- 172.21.15.78:0/15335825 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f9240066470 0x7f9240068930 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f925800a9a0 tx=0x7f9258008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:00:44.944 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:44.941+0000 7f9252ffd640 1 -- 172.21.15.78:0/15335825 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f925c0a9b90 con 0x7f925c14f850 2023-11-28T20:00:45.095 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:45.089+0000 7f92644fd640 1 -- 172.21.15.78:0/15335825 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f925c0a9b90 con 0x7f925c14f850 2023-11-28T20:00:45.096 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:45.089+0000 7f9252ffd640 1 -- 172.21.15.78:0/15335825 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v44) v1 ==== 104+0+11 (secure 0 0 0) 0x7f925c0a9b90 con 0x7f925c14f850 2023-11-28T20:00:45.096 INFO:teuthology.orchestra.run.smithi078.stdout:pg_num: 32 2023-11-28T20:00:45.097 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:45.093+0000 7f92644fd640 1 -- 172.21.15.78:0/15335825 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f9240066470 msgr2=0x7f9240068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:00:45.098 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:45.093+0000 7f92644fd640 1 --2- 172.21.15.78:0/15335825 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f9240066470 0x7f9240068930 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f925800a9a0 tx=0x7f9258008040 comp rx=0 tx=0).stop 2023-11-28T20:00:45.098 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:45.093+0000 7f92644fd640 1 -- 172.21.15.78:0/15335825 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f925c14f850 msgr2=0x7f925c1f0ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:00:45.098 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:45.093+0000 7f92644fd640 1 --2- 172.21.15.78:0/15335825 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f925c14f850 0x7f925c1f0ed0 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f924c00c400 tx=0x7f924c00c8c0 comp rx=0 tx=0).stop 2023-11-28T20:00:45.098 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:45.093+0000 7f92644fd640 1 -- 172.21.15.78:0/15335825 shutdown_connections 2023-11-28T20:00:45.098 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:45.093+0000 7f92644fd640 1 --2- 172.21.15.78:0/15335825 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f9240066470 0x7f9240068930 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:45.098 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:45.093+0000 7f92644fd640 1 --2- 172.21.15.78:0/15335825 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f925c14fc30 0x7f925c1499d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:45.099 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:45.093+0000 7f92644fd640 1 --2- 172.21.15.78:0/15335825 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f925c14f850 0x7f925c1f0ed0 unknown :-1 s=CLOSED pgs=496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:45.099 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:45.093+0000 7f92644fd640 1 --2- 172.21.15.78:0/15335825 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f925c06d840 0x7f925c0700f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:45.099 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:45.093+0000 7f92644fd640 1 -- 172.21.15.78:0/15335825 >> 172.21.15.78:0/15335825 conn(0x7f925c0c59f0 msgr2=0x7f925c0bee60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:00:45.099 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:45.093+0000 7f92644fd640 1 -- 172.21.15.78:0/15335825 shutdown_connections 2023-11-28T20:00:45.099 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:45.093+0000 7f92644fd640 1 -- 172.21.15.78:0/15335825 wait complete. 2023-11-28T20:00:45.116 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-28T20:00:45.256 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:45.253+0000 7f4dbec79640 1 Processor -- start 2023-11-28T20:00:45.256 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:45.253+0000 7f4dbec79640 1 -- start start 2023-11-28T20:00:45.258 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:45.253+0000 7f4dbec79640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4db814b1e0 0x7f4db80c1700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:45.258 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:45.253+0000 7f4dbec79640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f4db80c5300 0x7f4db80a9c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:45.258 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:45.253+0000 7f4dbec79640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f4db8151280 0x7f4db8151710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:45.258 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:45.253+0000 7f4dbec79640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4db80a4e20 con 0x7f4db8151280 2023-11-28T20:00:45.258 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:45.253+0000 7f4dbec79640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4db80a50e0 con 0x7f4db80c5300 2023-11-28T20:00:45.258 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:45.253+0000 7f4dbec79640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4db80c0f00 con 0x7f4db814b1e0 2023-11-28T20:00:45.258 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:45.253+0000 7f4dbd216640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f4db8151280 0x7f4db8151710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:45.258 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:45.253+0000 7f4dbd216640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f4db8151280 0x7f4db8151710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:39784/0 (socket says 172.21.15.78:39784) 2023-11-28T20:00:45.258 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:45.253+0000 7f4dbd216640 1 -- 172.21.15.78:0/701389474 learned_addr learned my addr 172.21.15.78:0/701389474 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T20:00:45.259 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:45.253+0000 7f4dbca15640 1 --2- 172.21.15.78:0/701389474 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4db814b1e0 0x7f4db80c1700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:45.259 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:45.253+0000 7f4daffff640 1 --2- 172.21.15.78:0/701389474 >> v2:172.21.15.179:3300/0 conn(0x7f4db80c5300 0x7f4db80a9c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:45.259 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:45.253+0000 7f4dbd216640 1 -- 172.21.15.78:0/701389474 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4db814b1e0 msgr2=0x7f4db80c1700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:00:45.259 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:45.253+0000 7f4dbd216640 1 --2- 172.21.15.78:0/701389474 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4db814b1e0 0x7f4db80c1700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:45.259 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:45.253+0000 7f4dbd216640 1 -- 172.21.15.78:0/701389474 >> v2:172.21.15.179:3300/0 conn(0x7f4db80c5300 msgr2=0x7f4db80a9c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:00:45.259 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:45.253+0000 7f4dbd216640 1 --2- 172.21.15.78:0/701389474 >> v2:172.21.15.179:3300/0 conn(0x7f4db80c5300 0x7f4db80a9c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:45.259 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:45.253+0000 7f4dbd216640 1 -- 172.21.15.78:0/701389474 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4db80c11e0 con 0x7f4db8151280 2023-11-28T20:00:45.262 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:45.257+0000 7f4dbd216640 1 --2- 172.21.15.78:0/701389474 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4db8151280 0x7f4db8151710 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f4db806f790 tx=0x7f4db001c9d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=384572e9cde1b2a9 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:00:45.262 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:45.257+0000 7f4daf7fe640 1 -- 172.21.15.78:0/701389474 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4db00a56e0 con 0x7f4db8151280 2023-11-28T20:00:45.262 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:45.257+0000 7f4daf7fe640 1 -- 172.21.15.78:0/701389474 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4db00a5840 con 0x7f4db8151280 2023-11-28T20:00:45.263 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:45.257+0000 7f4daf7fe640 1 -- 172.21.15.78:0/701389474 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4db00a5bd0 con 0x7f4db8151280 2023-11-28T20:00:45.263 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:45.257+0000 7f4dbec79640 1 -- 172.21.15.78:0/701389474 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4db8151280 msgr2=0x7f4db8151710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:00:45.264 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:45.257+0000 7f4dbec79640 1 --2- 172.21.15.78:0/701389474 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4db8151280 0x7f4db8151710 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f4db806f790 tx=0x7f4db001c9d0 comp rx=0 tx=0).stop 2023-11-28T20:00:45.264 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:45.257+0000 7f4dbec79640 1 -- 172.21.15.78:0/701389474 shutdown_connections 2023-11-28T20:00:45.264 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:45.257+0000 7f4dbec79640 1 --2- 172.21.15.78:0/701389474 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4db8151280 0x7f4db8151710 unknown :-1 s=CLOSED pgs=497 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:45.264 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:45.257+0000 7f4dbec79640 1 --2- 172.21.15.78:0/701389474 >> v2:172.21.15.179:3300/0 conn(0x7f4db80c5300 0x7f4db80a9c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:45.265 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:45.257+0000 7f4dbec79640 1 --2- 172.21.15.78:0/701389474 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4db814b1e0 0x7f4db80c1700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:45.265 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:45.257+0000 7f4dbec79640 1 -- 172.21.15.78:0/701389474 >> 172.21.15.78:0/701389474 conn(0x7f4db80c59f0 msgr2=0x7f4db80c5e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:00:45.265 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:45.257+0000 7f4dbec79640 1 -- 172.21.15.78:0/701389474 shutdown_connections 2023-11-28T20:00:45.265 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:45.257+0000 7f4dbec79640 1 -- 172.21.15.78:0/701389474 wait complete. 2023-11-28T20:00:45.270 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:45.257+0000 7f4dbec79640 1 Processor -- start 2023-11-28T20:00:45.271 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:45.257+0000 7f4dbec79640 1 -- start start 2023-11-28T20:00:45.271 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:45.261+0000 7f4dbec79640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4db80c5300 0x7f4db8149850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:45.271 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:45.261+0000 7f4dbec79640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4db814b1e0 0x7f4db81f04f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:45.271 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:45.261+0000 7f4dbec79640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4db8151280 0x7f4db8071aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:45.271 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:45.261+0000 7f4dbec79640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4db8154300 con 0x7f4db814b1e0 2023-11-28T20:00:45.272 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:45.261+0000 7f4dbec79640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4db8153fd0 con 0x7f4db80c5300 2023-11-28T20:00:45.272 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:45.261+0000 7f4dbec79640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4db81f0e40 con 0x7f4db8151280 2023-11-28T20:00:45.272 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:45.261+0000 7f4daffff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4db814b1e0 0x7f4db81f04f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:45.272 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:45.261+0000 7f4daffff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4db814b1e0 0x7f4db81f04f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:39800/0 (socket says 172.21.15.78:39800) 2023-11-28T20:00:45.272 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:45.261+0000 7f4daffff640 1 -- 172.21.15.78:0/4192624569 learned_addr learned my addr 172.21.15.78:0/4192624569 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T20:00:45.273 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:45.261+0000 7f4dbd216640 1 --2- 172.21.15.78:0/4192624569 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4db8151280 0x7f4db8071aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:45.273 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:45.261+0000 7f4dbca15640 1 --2- 172.21.15.78:0/4192624569 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4db80c5300 0x7f4db8149850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:45.273 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:45.261+0000 7f4daffff640 1 -- 172.21.15.78:0/4192624569 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4db8151280 msgr2=0x7f4db8071aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:00:45.273 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:45.261+0000 7f4daffff640 1 --2- 172.21.15.78:0/4192624569 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4db8151280 0x7f4db8071aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:45.274 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:45.261+0000 7f4daffff640 1 -- 172.21.15.78:0/4192624569 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4db80c5300 msgr2=0x7f4db8149850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:00:45.274 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:45.261+0000 7f4daffff640 1 --2- 172.21.15.78:0/4192624569 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4db80c5300 0x7f4db8149850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:45.274 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:45.261+0000 7f4daffff640 1 -- 172.21.15.78:0/4192624569 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4db0009b30 con 0x7f4db814b1e0 2023-11-28T20:00:45.274 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:45.261+0000 7f4daffff640 1 --2- 172.21.15.78:0/4192624569 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4db814b1e0 0x7f4db81f04f0 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f4da800d7d0 tx=0x7f4da800dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:00:45.275 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:45.261+0000 7f4dad7fa640 1 -- 172.21.15.78:0/4192624569 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4da80096a0 con 0x7f4db814b1e0 2023-11-28T20:00:45.275 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:45.261+0000 7f4dad7fa640 1 -- 172.21.15.78:0/4192624569 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4da8009800 con 0x7f4db814b1e0 2023-11-28T20:00:45.275 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:45.261+0000 7f4dad7fa640 1 -- 172.21.15.78:0/4192624569 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4da8009bb0 con 0x7f4db814b1e0 2023-11-28T20:00:45.275 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:45.261+0000 7f4dbec79640 1 -- 172.21.15.78:0/4192624569 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4db8147590 con 0x7f4db814b1e0 2023-11-28T20:00:45.275 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:45.261+0000 7f4dbec79640 1 -- 172.21.15.78:0/4192624569 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4db81f0a30 con 0x7f4db814b1e0 2023-11-28T20:00:45.276 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:45.261+0000 7f4dbec79640 1 -- 172.21.15.78:0/4192624569 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4db80aba00 con 0x7f4db814b1e0 2023-11-28T20:00:45.276 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:45.265+0000 7f4dad7fa640 1 -- 172.21.15.78:0/4192624569 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f4da8009d10 con 0x7f4db814b1e0 2023-11-28T20:00:45.276 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:45.265+0000 7f4dad7fa640 1 --2- 172.21.15.78:0/4192624569 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f4da4066470 0x7f4da4068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:45.276 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:45.265+0000 7f4dad7fa640 1 -- 172.21.15.78:0/4192624569 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 6885+0+0 (secure 0 0 0) 0x7f4da8084660 con 0x7f4db814b1e0 2023-11-28T20:00:45.277 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:45.265+0000 7f4dbca15640 1 --2- 172.21.15.78:0/4192624569 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f4da4066470 0x7f4da4068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:45.277 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:45.265+0000 7f4dbca15640 1 --2- 172.21.15.78:0/4192624569 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f4da4066470 0x7f4da4068930 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f4db4007a60 tx=0x7f4db4008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:00:45.277 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:45.269+0000 7f4dad7fa640 1 -- 172.21.15.78:0/4192624569 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f4da8051780 con 0x7f4db814b1e0 2023-11-28T20:00:45.423 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:45.417+0000 7f4dbec79640 1 -- 172.21.15.78:0/4192624569 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f4db8067630 con 0x7f4db814b1e0 2023-11-28T20:00:45.423 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:45.417+0000 7f4dad7fa640 1 -- 172.21.15.78:0/4192624569 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v44) v1 ==== 100+0+11 (secure 0 0 0) 0x7f4da8054da0 con 0x7f4db814b1e0 2023-11-28T20:00:45.424 INFO:teuthology.orchestra.run.smithi078.stdout:pg_num: 64 2023-11-28T20:00:45.425 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:45.421+0000 7f4dbec79640 1 -- 172.21.15.78:0/4192624569 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f4da4066470 msgr2=0x7f4da4068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:00:45.425 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:45.421+0000 7f4dbec79640 1 --2- 172.21.15.78:0/4192624569 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f4da4066470 0x7f4da4068930 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f4db4007a60 tx=0x7f4db4008040 comp rx=0 tx=0).stop 2023-11-28T20:00:45.425 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:45.421+0000 7f4dbec79640 1 -- 172.21.15.78:0/4192624569 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4db814b1e0 msgr2=0x7f4db81f04f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:00:45.425 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:45.421+0000 7f4dbec79640 1 --2- 172.21.15.78:0/4192624569 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4db814b1e0 0x7f4db81f04f0 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f4da800d7d0 tx=0x7f4da800dc90 comp rx=0 tx=0).stop 2023-11-28T20:00:45.425 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:45.421+0000 7f4dbec79640 1 -- 172.21.15.78:0/4192624569 shutdown_connections 2023-11-28T20:00:45.425 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:45.421+0000 7f4dbec79640 1 --2- 172.21.15.78:0/4192624569 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f4da4066470 0x7f4da4068930 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:45.425 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:45.421+0000 7f4dbec79640 1 --2- 172.21.15.78:0/4192624569 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4db8151280 0x7f4db8071aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:45.425 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:45.421+0000 7f4dbec79640 1 --2- 172.21.15.78:0/4192624569 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4db814b1e0 0x7f4db81f04f0 unknown :-1 s=CLOSED pgs=498 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:45.426 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:45.421+0000 7f4dbec79640 1 --2- 172.21.15.78:0/4192624569 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4db80c5300 0x7f4db8149850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:45.426 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:45.421+0000 7f4dbec79640 1 -- 172.21.15.78:0/4192624569 >> 172.21.15.78:0/4192624569 conn(0x7f4db80c59f0 msgr2=0x7f4db8146c80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:00:45.426 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:45.421+0000 7f4dbec79640 1 -- 172.21.15.78:0/4192624569 shutdown_connections 2023-11-28T20:00:45.426 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:45.421+0000 7f4dbec79640 1 -- 172.21.15.78:0/4192624569 wait complete. 2023-11-28T20:00:45.444 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs2_metadata pg_num 2023-11-28T20:00:45.585 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:45.581+0000 7f4e62432640 1 Processor -- start 2023-11-28T20:00:45.585 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:45.581+0000 7f4e62432640 1 -- start start 2023-11-28T20:00:45.586 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:45.581+0000 7f4e62432640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4e5c14f850 0x7f4e5c0aacf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:45.586 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:45.581+0000 7f4e62432640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f4e5c14fc30 0x7f4e5c0c3cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:45.586 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:45.581+0000 7f4e62432640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4e5c152910 con 0x7f4e5c06d840 2023-11-28T20:00:45.586 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:45.581+0000 7f4e62432640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4e5c0c2240 con 0x7f4e5c14fc30 2023-11-28T20:00:45.587 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:45.581+0000 7f4e62432640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e5c152bf0 con 0x7f4e5c14f850 2023-11-28T20:00:45.587 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:45.581+0000 7f4e5bfff640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4e5c14f850 0x7f4e5c0aacf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:45.587 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:45.581+0000 7f4e5b7fe640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f4e5c14fc30 0x7f4e5c0c3cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:45.587 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:45.581+0000 7f4e5bfff640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4e5c14f850 0x7f4e5c0aacf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3301/0 says I am v2:172.21.15.78:33664/0 (socket says 172.21.15.78:33664) 2023-11-28T20:00:45.587 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:45.581+0000 7f4e5bfff640 1 -- 172.21.15.78:0/2422294487 learned_addr learned my addr 172.21.15.78:0/2422294487 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T20:00:45.587 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:45.581+0000 7f4e5b7fe640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f4e5c14fc30 0x7f4e5c0c3cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.78:54212/0 (socket says 172.21.15.78:54212) 2023-11-28T20:00:45.589 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:45.581+0000 7f4e5bfff640 1 -- 172.21.15.78:0/2422294487 >> v2:172.21.15.179:3300/0 conn(0x7f4e5c14fc30 msgr2=0x7f4e5c0c3cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:00:45.589 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:45.581+0000 7f4e5bfff640 1 --2- 172.21.15.78:0/2422294487 >> v2:172.21.15.179:3300/0 conn(0x7f4e5c14fc30 0x7f4e5c0c3cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:45.589 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:45.581+0000 7f4e5bfff640 1 -- 172.21.15.78:0/2422294487 >> v1:172.21.15.179:6789/0 conn(0x7f4e5c06d840 legacy=0x7f4e5c0c4210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:00:45.590 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:45.581+0000 7f4e5bfff640 1 -- 172.21.15.78:0/2422294487 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e5c152ed0 con 0x7f4e5c14f850 2023-11-28T20:00:45.598 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:45.585+0000 7f4e5bfff640 1 --2- 172.21.15.78:0/2422294487 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4e5c14f850 0x7f4e5c0aacf0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f4e4c009870 tx=0x7f4e4c01c540 comp rx=0 tx=0).ready entity=mon.2 client_cookie=56e94d1501e366d1 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:00:45.598 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:45.585+0000 7f4e5affd640 1 -- 172.21.15.78:0/2422294487 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e4c0a9620 con 0x7f4e5c14f850 2023-11-28T20:00:45.598 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:45.585+0000 7f4e5affd640 1 -- 172.21.15.78:0/2422294487 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e4c0a9780 con 0x7f4e5c14f850 2023-11-28T20:00:45.598 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:45.585+0000 7f4e5affd640 1 -- 172.21.15.78:0/2422294487 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e4c0a9b10 con 0x7f4e5c14f850 2023-11-28T20:00:45.598 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:45.585+0000 7f4e62432640 1 -- 172.21.15.78:0/2422294487 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4e5c14f850 msgr2=0x7f4e5c0aacf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:00:45.598 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:45.585+0000 7f4e62432640 1 --2- 172.21.15.78:0/2422294487 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4e5c14f850 0x7f4e5c0aacf0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f4e4c009870 tx=0x7f4e4c01c540 comp rx=0 tx=0).stop 2023-11-28T20:00:45.598 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:45.585+0000 7f4e62432640 1 -- 172.21.15.78:0/2422294487 shutdown_connections 2023-11-28T20:00:45.598 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:45.585+0000 7f4e62432640 1 --2- 172.21.15.78:0/2422294487 >> v2:172.21.15.179:3300/0 conn(0x7f4e5c14fc30 0x7f4e5c0c3cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:45.599 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:45.585+0000 7f4e62432640 1 --2- 172.21.15.78:0/2422294487 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4e5c14f850 0x7f4e5c0aacf0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:45.599 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:45.585+0000 7f4e62432640 1 -- 172.21.15.78:0/2422294487 >> 172.21.15.78:0/2422294487 conn(0x7f4e5c0c59f0 msgr2=0x7f4e5c0c5e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:00:45.599 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:45.585+0000 7f4e62432640 1 -- 172.21.15.78:0/2422294487 shutdown_connections 2023-11-28T20:00:45.599 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:45.585+0000 7f4e62432640 1 -- 172.21.15.78:0/2422294487 wait complete. 2023-11-28T20:00:45.599 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:45.589+0000 7f4e62432640 1 Processor -- start 2023-11-28T20:00:45.599 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:45.589+0000 7f4e62432640 1 -- start start 2023-11-28T20:00:45.599 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:45.589+0000 7f4e62432640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4e5c06d840 0x7f4e5c149c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:45.599 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:45.589+0000 7f4e62432640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4e5c14f850 0x7f4e5c14a1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:45.599 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:45.589+0000 7f4e62432640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4e5c14fc30 0x7f4e5c070110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:45.599 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:45.589+0000 7f4e62432640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e5c147d60 con 0x7f4e5c14f850 2023-11-28T20:00:45.599 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:45.589+0000 7f4e62432640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e5c06fc80 con 0x7f4e5c06d840 2023-11-28T20:00:45.599 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:45.589+0000 7f4e62432640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e5c072910 con 0x7f4e5c14fc30 2023-11-28T20:00:45.600 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:45.589+0000 7f4e5b7fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4e5c14f850 0x7f4e5c14a1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:45.600 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:45.589+0000 7f4e5b7fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4e5c14f850 0x7f4e5c14a1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:39802/0 (socket says 172.21.15.78:39802) 2023-11-28T20:00:45.600 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:45.589+0000 7f4e5b7fe640 1 -- 172.21.15.78:0/2124353495 learned_addr learned my addr 172.21.15.78:0/2124353495 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T20:00:45.600 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:45.589+0000 7f4e5bfff640 1 --2- 172.21.15.78:0/2124353495 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4e5c06d840 0x7f4e5c149c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:45.600 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:45.589+0000 7f4e609cf640 1 --2- 172.21.15.78:0/2124353495 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4e5c14fc30 0x7f4e5c070110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:45.600 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:45.589+0000 7f4e5b7fe640 1 -- 172.21.15.78:0/2124353495 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4e5c14fc30 msgr2=0x7f4e5c070110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:00:45.600 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:45.589+0000 7f4e5b7fe640 1 --2- 172.21.15.78:0/2124353495 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4e5c14fc30 0x7f4e5c070110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:45.600 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:45.589+0000 7f4e5b7fe640 1 -- 172.21.15.78:0/2124353495 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4e5c06d840 msgr2=0x7f4e5c149c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:00:45.600 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:45.589+0000 7f4e5b7fe640 1 --2- 172.21.15.78:0/2124353495 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4e5c06d840 0x7f4e5c149c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:45.600 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:45.589+0000 7f4e5b7fe640 1 -- 172.21.15.78:0/2124353495 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e4c0094d0 con 0x7f4e5c14f850 2023-11-28T20:00:45.600 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:45.589+0000 7f4e5bfff640 1 --2- 172.21.15.78:0/2124353495 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4e5c06d840 0x7f4e5c149c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T20:00:45.600 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:45.589+0000 7f4e609cf640 1 --2- 172.21.15.78:0/2124353495 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4e5c14fc30 0x7f4e5c070110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T20:00:45.601 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:45.589+0000 7f4e5b7fe640 1 --2- 172.21.15.78:0/2124353495 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4e5c14f850 0x7f4e5c14a1a0 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f4e5000e8a0 tx=0x7f4e5000eca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:00:45.601 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:45.589+0000 7f4e58ff9640 1 -- 172.21.15.78:0/2124353495 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e50009510 con 0x7f4e5c14f850 2023-11-28T20:00:45.601 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:45.589+0000 7f4e58ff9640 1 -- 172.21.15.78:0/2124353495 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e5000c940 con 0x7f4e5c14f850 2023-11-28T20:00:45.601 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:45.589+0000 7f4e62432640 1 -- 172.21.15.78:0/2124353495 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4e5c0bfda0 con 0x7f4e5c14f850 2023-11-28T20:00:45.601 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:45.589+0000 7f4e58ff9640 1 -- 172.21.15.78:0/2124353495 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e5000ccb0 con 0x7f4e5c14f850 2023-11-28T20:00:45.601 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:45.589+0000 7f4e62432640 1 -- 172.21.15.78:0/2124353495 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4e5c072350 con 0x7f4e5c14f850 2023-11-28T20:00:45.601 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:45.593+0000 7f4e62432640 1 -- 172.21.15.78:0/2124353495 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4e5c06fe30 con 0x7f4e5c14f850 2023-11-28T20:00:45.601 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:45.593+0000 7f4e58ff9640 1 -- 172.21.15.78:0/2124353495 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f4e50013470 con 0x7f4e5c14f850 2023-11-28T20:00:45.601 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:45.593+0000 7f4e58ff9640 1 --2- 172.21.15.78:0/2124353495 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f4e48066470 0x7f4e48068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:45.601 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:45.593+0000 7f4e58ff9640 1 -- 172.21.15.78:0/2124353495 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 6885+0+0 (secure 0 0 0) 0x7f4e50084360 con 0x7f4e5c14f850 2023-11-28T20:00:45.601 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:45.593+0000 7f4e5bfff640 1 --2- 172.21.15.78:0/2124353495 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f4e48066470 0x7f4e48068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:45.602 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:45.593+0000 7f4e5bfff640 1 --2- 172.21.15.78:0/2124353495 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f4e48066470 0x7f4e48068930 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f4e4c0ae000 tx=0x7f4e4c0b3040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:00:45.602 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:45.597+0000 7f4e58ff9640 1 -- 172.21.15.78:0/2124353495 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f4e5c06fe30 con 0x7f4e5c14f850 2023-11-28T20:00:45.754 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:45.749+0000 7f4e62432640 1 -- 172.21.15.78:0/2124353495 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs2_metadata", "var": "pg_num"} v 0) v1 -- 0x7f4e5c06fe30 con 0x7f4e5c14f850 2023-11-28T20:00:45.755 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:45.749+0000 7f4e58ff9640 1 -- 172.21.15.78:0/2124353495 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs2_metadata", "var": "pg_num"}]=0 v44) v1 ==== 105+0+11 (secure 0 0 0) 0x7f4e5c06fe30 con 0x7f4e5c14f850 2023-11-28T20:00:45.755 INFO:teuthology.orchestra.run.smithi078.stdout:pg_num: 32 2023-11-28T20:00:45.757 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:45.753+0000 7f4e62432640 1 -- 172.21.15.78:0/2124353495 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f4e48066470 msgr2=0x7f4e48068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:00:45.757 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:45.753+0000 7f4e62432640 1 --2- 172.21.15.78:0/2124353495 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f4e48066470 0x7f4e48068930 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f4e4c0ae000 tx=0x7f4e4c0b3040 comp rx=0 tx=0).stop 2023-11-28T20:00:45.757 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:45.753+0000 7f4e62432640 1 -- 172.21.15.78:0/2124353495 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4e5c14f850 msgr2=0x7f4e5c14a1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:00:45.758 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:45.753+0000 7f4e62432640 1 --2- 172.21.15.78:0/2124353495 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4e5c14f850 0x7f4e5c14a1a0 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f4e5000e8a0 tx=0x7f4e5000eca0 comp rx=0 tx=0).stop 2023-11-28T20:00:45.758 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:45.753+0000 7f4e62432640 1 -- 172.21.15.78:0/2124353495 shutdown_connections 2023-11-28T20:00:45.758 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:45.753+0000 7f4e62432640 1 --2- 172.21.15.78:0/2124353495 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f4e48066470 0x7f4e48068930 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:45.758 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:45.753+0000 7f4e62432640 1 --2- 172.21.15.78:0/2124353495 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4e5c14fc30 0x7f4e5c070110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:45.758 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:45.753+0000 7f4e62432640 1 --2- 172.21.15.78:0/2124353495 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4e5c14f850 0x7f4e5c14a1a0 unknown :-1 s=CLOSED pgs=499 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:45.759 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:45.753+0000 7f4e62432640 1 --2- 172.21.15.78:0/2124353495 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4e5c06d840 0x7f4e5c149c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:45.759 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:45.753+0000 7f4e62432640 1 -- 172.21.15.78:0/2124353495 >> 172.21.15.78:0/2124353495 conn(0x7f4e5c0c59f0 msgr2=0x7f4e5c150330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:00:45.759 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:45.753+0000 7f4e62432640 1 -- 172.21.15.78:0/2124353495 shutdown_connections 2023-11-28T20:00:45.759 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:45.753+0000 7f4e62432640 1 -- 172.21.15.78:0/2124353495 wait complete. 2023-11-28T20:00:45.778 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs2_data pg_num 2023-11-28T20:00:45.922 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:45.917+0000 7f5560ad6640 1 Processor -- start 2023-11-28T20:00:45.923 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:45.917+0000 7f5560ad6640 1 -- start start 2023-11-28T20:00:45.925 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:45.917+0000 7f5560ad6640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f555c14b1e0 0x7f555c0c1700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:45.925 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:45.917+0000 7f5560ad6640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f555c0c5300 0x7f555c0a9c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:45.926 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:45.917+0000 7f5560ad6640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f555c0a4e20 con 0x7f555c151280 2023-11-28T20:00:45.926 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:45.917+0000 7f5560ad6640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f555c1558d0 con 0x7f555c14b1e0 2023-11-28T20:00:45.926 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:45.917+0000 7f5560ad6640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f555c0a50e0 con 0x7f555c0c5300 2023-11-28T20:00:45.926 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:45.921+0000 7f555a59c640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f555c14b1e0 0x7f555c0c1700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:45.926 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:45.921+0000 7f555a59c640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f555c14b1e0 0x7f555c0c1700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:39816/0 (socket says 172.21.15.78:39816) 2023-11-28T20:00:45.927 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:45.921+0000 7f555a59c640 1 -- 172.21.15.78:0/2745884701 learned_addr learned my addr 172.21.15.78:0/2745884701 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T20:00:45.927 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:45.921+0000 7f5551d9b640 1 --2- 172.21.15.78:0/2745884701 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f555c0c5300 0x7f555c0a9c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:45.927 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:45.921+0000 7f555a59c640 1 -- 172.21.15.78:0/2745884701 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f555c0c5300 msgr2=0x7f555c0a9c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:00:45.928 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:45.921+0000 7f555a59c640 1 --2- 172.21.15.78:0/2745884701 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f555c0c5300 0x7f555c0a9c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:45.928 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:45.921+0000 7f555a59c640 1 -- 172.21.15.78:0/2745884701 >> v1:172.21.15.179:6789/0 conn(0x7f555c151280 legacy=0x7f555c151710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:00:45.929 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:45.921+0000 7f555a59c640 1 -- 172.21.15.78:0/2745884701 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f555c0c0f00 con 0x7f555c14b1e0 2023-11-28T20:00:45.933 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:45.921+0000 7f555a59c640 1 --2- 172.21.15.78:0/2745884701 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f555c14b1e0 0x7f555c0c1700 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f554c00bb10 tx=0x7f554c01ec10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aa944354ad527016 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:00:45.933 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:45.921+0000 7f5559d9b640 1 -- 172.21.15.78:0/2745884701 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f554c0a7af0 con 0x7f555c14b1e0 2023-11-28T20:00:45.933 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:45.921+0000 7f5559d9b640 1 -- 172.21.15.78:0/2745884701 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f554c0a7c50 con 0x7f555c14b1e0 2023-11-28T20:00:45.933 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:45.921+0000 7f5559d9b640 1 -- 172.21.15.78:0/2745884701 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f554c0af440 con 0x7f555c14b1e0 2023-11-28T20:00:45.933 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:45.925+0000 7f5560ad6640 1 -- 172.21.15.78:0/2745884701 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f555c14b1e0 msgr2=0x7f555c0c1700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:00:45.933 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:45.925+0000 7f5560ad6640 1 --2- 172.21.15.78:0/2745884701 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f555c14b1e0 0x7f555c0c1700 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f554c00bb10 tx=0x7f554c01ec10 comp rx=0 tx=0).stop 2023-11-28T20:00:45.933 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:45.925+0000 7f5560ad6640 1 -- 172.21.15.78:0/2745884701 shutdown_connections 2023-11-28T20:00:45.934 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:45.925+0000 7f5560ad6640 1 --2- 172.21.15.78:0/2745884701 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f555c0c5300 0x7f555c0a9c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:45.934 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:45.925+0000 7f5560ad6640 1 --2- 172.21.15.78:0/2745884701 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f555c14b1e0 0x7f555c0c1700 unknown :-1 s=CLOSED pgs=500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:45.934 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:45.925+0000 7f5560ad6640 1 -- 172.21.15.78:0/2745884701 >> 172.21.15.78:0/2745884701 conn(0x7f555c0c59f0 msgr2=0x7f555c0c5e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:00:45.934 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:45.925+0000 7f5560ad6640 1 -- 172.21.15.78:0/2745884701 shutdown_connections 2023-11-28T20:00:45.934 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:45.925+0000 7f5560ad6640 1 -- 172.21.15.78:0/2745884701 wait complete. 2023-11-28T20:00:45.934 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:45.925+0000 7f5560ad6640 1 Processor -- start 2023-11-28T20:00:45.934 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:45.925+0000 7f5560ad6640 1 -- start start 2023-11-28T20:00:45.934 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:45.925+0000 7f5560ad6640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f555c0c5300 0x7f555c147e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:45.934 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:45.925+0000 7f5560ad6640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f555c14b1e0 0x7f555c1efd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:45.934 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:45.925+0000 7f5560ad6640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f555c151280 0x7f555c1f0290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:45.934 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:45.925+0000 7f5560ad6640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f555c1ef930 con 0x7f555c0c5300 2023-11-28T20:00:45.935 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:45.925+0000 7f5560ad6640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f555c06d510 con 0x7f555c151280 2023-11-28T20:00:45.935 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:45.925+0000 7f5560ad6640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f555c1eecb0 con 0x7f555c14b1e0 2023-11-28T20:00:45.935 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:45.925+0000 7f555a59c640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f555c0c5300 0x7f555c147e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:45.935 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:45.925+0000 7f555a59c640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f555c0c5300 0x7f555c147e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:39832/0 (socket says 172.21.15.78:39832) 2023-11-28T20:00:45.935 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:45.925+0000 7f555a59c640 1 -- 172.21.15.78:0/1879988039 learned_addr learned my addr 172.21.15.78:0/1879988039 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T20:00:45.935 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:45.925+0000 7f5551d9b640 1 --2- 172.21.15.78:0/1879988039 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f555c14b1e0 0x7f555c1efd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:45.935 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:45.925+0000 7f555ad9d640 1 --2- 172.21.15.78:0/1879988039 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f555c151280 0x7f555c1f0290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:45.935 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:45.925+0000 7f555a59c640 1 -- 172.21.15.78:0/1879988039 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f555c14b1e0 msgr2=0x7f555c1efd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:00:45.935 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:45.925+0000 7f555a59c640 1 --2- 172.21.15.78:0/1879988039 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f555c14b1e0 0x7f555c1efd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:45.935 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:45.925+0000 7f555a59c640 1 -- 172.21.15.78:0/1879988039 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f555c151280 msgr2=0x7f555c1f0290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:00:45.935 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:45.925+0000 7f555a59c640 1 --2- 172.21.15.78:0/1879988039 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f555c151280 0x7f555c1f0290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:45.936 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:45.925+0000 7f555a59c640 1 -- 172.21.15.78:0/1879988039 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f554c00b770 con 0x7f555c0c5300 2023-11-28T20:00:45.936 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:45.929+0000 7f555a59c640 1 --2- 172.21.15.78:0/1879988039 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f555c0c5300 0x7f555c147e10 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f554c00b2c0 tx=0x7f554c01d450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:00:45.936 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:45.929+0000 7f55537fe640 1 -- 172.21.15.78:0/1879988039 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f554c0a7af0 con 0x7f555c0c5300 2023-11-28T20:00:45.936 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:45.929+0000 7f55537fe640 1 -- 172.21.15.78:0/1879988039 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f554c0ba480 con 0x7f555c0c5300 2023-11-28T20:00:45.936 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:45.929+0000 7f5560ad6640 1 -- 172.21.15.78:0/1879988039 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f555c1eef90 con 0x7f555c0c5300 2023-11-28T20:00:45.936 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:45.929+0000 7f55537fe640 1 -- 172.21.15.78:0/1879988039 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f554c0ba850 con 0x7f555c0c5300 2023-11-28T20:00:45.936 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:45.929+0000 7f5560ad6640 1 -- 172.21.15.78:0/1879988039 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f555c1ef550 con 0x7f555c0c5300 2023-11-28T20:00:45.937 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:45.929+0000 7f5560ad6640 1 -- 172.21.15.78:0/1879988039 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f555c1efba0 con 0x7f555c0c5300 2023-11-28T20:00:45.937 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:45.929+0000 7f55537fe640 1 -- 172.21.15.78:0/1879988039 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f554c0ba9b0 con 0x7f555c0c5300 2023-11-28T20:00:45.938 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:45.929+0000 7f55537fe640 1 --2- 172.21.15.78:0/1879988039 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f553c066470 0x7f553c068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:45.938 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:45.929+0000 7f55537fe640 1 -- 172.21.15.78:0/1879988039 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 6885+0+0 (secure 0 0 0) 0x7f554c11f930 con 0x7f555c0c5300 2023-11-28T20:00:45.938 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:45.929+0000 7f5551d9b640 1 --2- 172.21.15.78:0/1879988039 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f553c066470 0x7f553c068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:45.938 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:45.933+0000 7f5551d9b640 1 --2- 172.21.15.78:0/1879988039 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f553c066470 0x7f553c068930 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f555c06d6a0 tx=0x7f5544008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:00:45.939 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:45.933+0000 7f55537fe640 1 -- 172.21.15.78:0/1879988039 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f554c0eca20 con 0x7f555c0c5300 2023-11-28T20:00:46.096 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:46.093+0000 7f5560ad6640 1 -- 172.21.15.78:0/1879988039 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs2_data", "var": "pg_num"} v 0) v1 -- 0x7f555c067630 con 0x7f555c0c5300 2023-11-28T20:00:46.096 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:46.093+0000 7f55537fe640 1 -- 172.21.15.78:0/1879988039 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs2_data", "var": "pg_num"}]=0 v44) v1 ==== 101+0+11 (secure 0 0 0) 0x7f554c0b4020 con 0x7f555c0c5300 2023-11-28T20:00:46.097 INFO:teuthology.orchestra.run.smithi078.stdout:pg_num: 64 2023-11-28T20:00:46.099 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:46.093+0000 7f5560ad6640 1 -- 172.21.15.78:0/1879988039 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f553c066470 msgr2=0x7f553c068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:00:46.099 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:46.093+0000 7f5560ad6640 1 --2- 172.21.15.78:0/1879988039 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f553c066470 0x7f553c068930 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f555c06d6a0 tx=0x7f5544008040 comp rx=0 tx=0).stop 2023-11-28T20:00:46.099 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:46.093+0000 7f5560ad6640 1 -- 172.21.15.78:0/1879988039 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f555c0c5300 msgr2=0x7f555c147e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:00:46.100 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:46.093+0000 7f5560ad6640 1 --2- 172.21.15.78:0/1879988039 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f555c0c5300 0x7f555c147e10 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f554c00b2c0 tx=0x7f554c01d450 comp rx=0 tx=0).stop 2023-11-28T20:00:46.100 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:46.093+0000 7f5560ad6640 1 -- 172.21.15.78:0/1879988039 shutdown_connections 2023-11-28T20:00:46.100 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:46.093+0000 7f5560ad6640 1 --2- 172.21.15.78:0/1879988039 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f553c066470 0x7f553c068930 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:46.100 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:46.093+0000 7f5560ad6640 1 --2- 172.21.15.78:0/1879988039 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f555c14b1e0 0x7f555c1efd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:46.100 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:46.093+0000 7f5560ad6640 1 --2- 172.21.15.78:0/1879988039 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f555c151280 0x7f555c1f0290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:46.100 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:46.093+0000 7f5560ad6640 1 --2- 172.21.15.78:0/1879988039 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f555c0c5300 0x7f555c147e10 unknown :-1 s=CLOSED pgs=501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:46.100 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:46.093+0000 7f5560ad6640 1 -- 172.21.15.78:0/1879988039 >> 172.21.15.78:0/1879988039 conn(0x7f555c0c59f0 msgr2=0x7f555c149d90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:00:46.100 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:46.093+0000 7f5560ad6640 1 -- 172.21.15.78:0/1879988039 shutdown_connections 2023-11-28T20:00:46.100 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:46.093+0000 7f5560ad6640 1 -- 172.21.15.78:0/1879988039 wait complete. 2023-11-28T20:00:46.118 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-11-28T20:00:46.257 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:46.253+0000 7fcc30009640 1 Processor -- start 2023-11-28T20:00:46.258 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:46.253+0000 7fcc30009640 1 -- start start 2023-11-28T20:00:46.259 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:46.253+0000 7fcc30009640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fcc280a5370 0x7fcc2814f870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:46.259 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:46.253+0000 7fcc30009640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fcc28072810 0x7fcc2814fdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:46.259 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:46.253+0000 7fcc30009640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcc281524b0 con 0x7fcc280a4f90 2023-11-28T20:00:46.260 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:46.253+0000 7fcc30009640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcc280c60d0 con 0x7fcc28072810 2023-11-28T20:00:46.260 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:46.253+0000 7fcc30009640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcc280c62f0 con 0x7fcc280a5370 2023-11-28T20:00:46.260 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:46.253+0000 7fcc2e5a6640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fcc28072810 0x7fcc2814fdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:46.260 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:46.253+0000 7fcc2e5a6640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fcc28072810 0x7fcc2814fdb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:39846/0 (socket says 172.21.15.78:39846) 2023-11-28T20:00:46.260 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:46.253+0000 7fcc2e5a6640 1 -- 172.21.15.78:0/460409920 learned_addr learned my addr 172.21.15.78:0/460409920 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T20:00:46.260 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:46.253+0000 7fcc2d5a4640 1 --2- 172.21.15.78:0/460409920 >> v2:172.21.15.179:3300/0 conn(0x7fcc280a5370 0x7fcc2814f870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:46.260 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:46.253+0000 7fcc2e5a6640 1 -- 172.21.15.78:0/460409920 >> v2:172.21.15.179:3300/0 conn(0x7fcc280a5370 msgr2=0x7fcc2814f870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:00:46.260 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:46.253+0000 7fcc2e5a6640 1 --2- 172.21.15.78:0/460409920 >> v2:172.21.15.179:3300/0 conn(0x7fcc280a5370 0x7fcc2814f870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:46.260 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:46.253+0000 7fcc2e5a6640 1 -- 172.21.15.78:0/460409920 >> v1:172.21.15.179:6789/0 conn(0x7fcc280a4f90 legacy=0x7fcc280c59c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:00:46.260 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:46.253+0000 7fcc2e5a6640 1 -- 172.21.15.78:0/460409920 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc28152770 con 0x7fcc28072810 2023-11-28T20:00:46.260 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:46.253+0000 7fcc2d5a4640 1 --2- 172.21.15.78:0/460409920 >> v2:172.21.15.179:3300/0 conn(0x7fcc280a5370 0x7fcc2814f870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T20:00:46.262 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:46.257+0000 7fcc2e5a6640 1 --2- 172.21.15.78:0/460409920 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcc28072810 0x7fcc2814fdb0 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7fcc280c6a60 tx=0x7fcc2001c900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=56fc1ad2269ad82c server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:00:46.262 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:46.257+0000 7fcc2cda3640 1 -- 172.21.15.78:0/460409920 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc200a55c0 con 0x7fcc28072810 2023-11-28T20:00:46.262 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:46.257+0000 7fcc2cda3640 1 -- 172.21.15.78:0/460409920 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc200a5720 con 0x7fcc28072810 2023-11-28T20:00:46.262 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:46.257+0000 7fcc2cda3640 1 -- 172.21.15.78:0/460409920 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc200a5ab0 con 0x7fcc28072810 2023-11-28T20:00:46.263 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:46.257+0000 7fcc30009640 1 -- 172.21.15.78:0/460409920 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcc28072810 msgr2=0x7fcc2814fdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:00:46.263 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:46.257+0000 7fcc30009640 1 --2- 172.21.15.78:0/460409920 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcc28072810 0x7fcc2814fdb0 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7fcc280c6a60 tx=0x7fcc2001c900 comp rx=0 tx=0).stop 2023-11-28T20:00:46.263 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:46.257+0000 7fcc30009640 1 -- 172.21.15.78:0/460409920 shutdown_connections 2023-11-28T20:00:46.263 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:46.257+0000 7fcc30009640 1 --2- 172.21.15.78:0/460409920 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcc28072810 0x7fcc2814fdb0 unknown :-1 s=CLOSED pgs=502 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:46.264 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:46.257+0000 7fcc30009640 1 --2- 172.21.15.78:0/460409920 >> v2:172.21.15.179:3300/0 conn(0x7fcc280a5370 0x7fcc2814f870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:46.264 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:46.257+0000 7fcc30009640 1 -- 172.21.15.78:0/460409920 >> 172.21.15.78:0/460409920 conn(0x7fcc2806b220 msgr2=0x7fcc280a77e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:00:46.264 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:46.257+0000 7fcc30009640 1 -- 172.21.15.78:0/460409920 shutdown_connections 2023-11-28T20:00:46.264 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:46.257+0000 7fcc30009640 1 -- 172.21.15.78:0/460409920 wait complete. 2023-11-28T20:00:46.265 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:46.261+0000 7fcc30009640 1 Processor -- start 2023-11-28T20:00:46.265 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:46.261+0000 7fcc30009640 1 -- start start 2023-11-28T20:00:46.267 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:46.261+0000 7fcc30009640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcc28072810 0x7fcc2814f3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:46.267 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:46.261+0000 7fcc30009640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcc280a4f90 0x7fcc281ee4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:46.267 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:46.261+0000 7fcc30009640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcc280a5370 0x7fcc28150d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:46.267 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:46.261+0000 7fcc30009640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc28148680 con 0x7fcc28072810 2023-11-28T20:00:46.267 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:46.261+0000 7fcc30009640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc281495e0 con 0x7fcc280a5370 2023-11-28T20:00:46.267 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:46.261+0000 7fcc30009640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcc281498a0 con 0x7fcc280a4f90 2023-11-28T20:00:46.268 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:46.261+0000 7fcc2dda5640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcc28072810 0x7fcc2814f3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:46.268 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:46.261+0000 7fcc2dda5640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcc28072810 0x7fcc2814f3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:39854/0 (socket says 172.21.15.78:39854) 2023-11-28T20:00:46.268 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:46.261+0000 7fcc2dda5640 1 -- 172.21.15.78:0/1055964206 learned_addr learned my addr 172.21.15.78:0/1055964206 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T20:00:46.268 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:46.261+0000 7fcc2e5a6640 1 --2- 172.21.15.78:0/1055964206 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcc280a5370 0x7fcc28150d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:46.268 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:46.261+0000 7fcc2d5a4640 1 --2- 172.21.15.78:0/1055964206 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcc280a4f90 0x7fcc281ee4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:46.268 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:46.261+0000 7fcc2dda5640 1 -- 172.21.15.78:0/1055964206 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcc280a4f90 msgr2=0x7fcc281ee4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:00:46.268 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:46.261+0000 7fcc2dda5640 1 --2- 172.21.15.78:0/1055964206 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcc280a4f90 0x7fcc281ee4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:46.268 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:46.261+0000 7fcc2dda5640 1 -- 172.21.15.78:0/1055964206 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcc280a5370 msgr2=0x7fcc28150d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:00:46.268 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:46.261+0000 7fcc2dda5640 1 --2- 172.21.15.78:0/1055964206 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcc280a5370 0x7fcc28150d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:46.268 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:46.261+0000 7fcc2dda5640 1 -- 172.21.15.78:0/1055964206 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc20009b30 con 0x7fcc28072810 2023-11-28T20:00:46.268 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:46.261+0000 7fcc2e5a6640 1 --2- 172.21.15.78:0/1055964206 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcc280a5370 0x7fcc28150d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T20:00:46.269 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:46.261+0000 7fcc2dda5640 1 --2- 172.21.15.78:0/1055964206 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcc28072810 0x7fcc2814f3d0 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7fcc2400c490 tx=0x7fcc24001e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:00:46.269 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:46.261+0000 7fcc1e7fc640 1 -- 172.21.15.78:0/1055964206 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc24003600 con 0x7fcc28072810 2023-11-28T20:00:46.269 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:46.261+0000 7fcc1e7fc640 1 -- 172.21.15.78:0/1055964206 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc24003780 con 0x7fcc28072810 2023-11-28T20:00:46.269 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:46.261+0000 7fcc30009640 1 -- 172.21.15.78:0/1055964206 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcc28148920 con 0x7fcc28072810 2023-11-28T20:00:46.269 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:46.261+0000 7fcc1e7fc640 1 -- 172.21.15.78:0/1055964206 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc24003b70 con 0x7fcc28072810 2023-11-28T20:00:46.269 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:46.261+0000 7fcc30009640 1 -- 172.21.15.78:0/1055964206 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcc2814f910 con 0x7fcc28072810 2023-11-28T20:00:46.270 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:46.265+0000 7fcc30009640 1 -- 172.21.15.78:0/1055964206 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcc2806dd40 con 0x7fcc28072810 2023-11-28T20:00:46.270 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:46.265+0000 7fcc1e7fc640 1 -- 172.21.15.78:0/1055964206 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fcc24003cd0 con 0x7fcc28072810 2023-11-28T20:00:46.270 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:46.265+0000 7fcc1e7fc640 1 --2- 172.21.15.78:0/1055964206 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fcc0c066470 0x7fcc0c068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:46.270 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:46.265+0000 7fcc1e7fc640 1 -- 172.21.15.78:0/1055964206 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 6885+0+0 (secure 0 0 0) 0x7fcc24083910 con 0x7fcc28072810 2023-11-28T20:00:46.270 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:46.265+0000 7fcc2d5a4640 1 --2- 172.21.15.78:0/1055964206 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fcc0c066470 0x7fcc0c068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:46.271 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:46.265+0000 7fcc2d5a4640 1 --2- 172.21.15.78:0/1055964206 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fcc0c066470 0x7fcc0c068930 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fcc18006fd0 tx=0x7fcc18008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:00:46.274 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:46.269+0000 7fcc1e7fc640 1 -- 172.21.15.78:0/1055964206 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fcc240508e0 con 0x7fcc28072810 2023-11-28T20:00:46.434 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:46.429+0000 7fcc30009640 1 -- 172.21.15.78:0/1055964206 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fcc28067630 con 0x7fcc28072810 2023-11-28T20:00:46.434 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:46.429+0000 7fcc1e7fc640 1 -- 172.21.15.78:0/1055964206 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v44) v1 ==== 80+0+0 (secure 0 0 0) 0x7fcc24017020 con 0x7fcc28072810 2023-11-28T20:00:46.434 INFO:teuthology.orchestra.run.smithi078.stderr:listed 0 entries 2023-11-28T20:00:46.436 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:46.433+0000 7fcc30009640 1 -- 172.21.15.78:0/1055964206 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fcc0c066470 msgr2=0x7fcc0c068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:00:46.436 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:46.433+0000 7fcc30009640 1 --2- 172.21.15.78:0/1055964206 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fcc0c066470 0x7fcc0c068930 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fcc18006fd0 tx=0x7fcc18008040 comp rx=0 tx=0).stop 2023-11-28T20:00:46.437 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:46.433+0000 7fcc30009640 1 -- 172.21.15.78:0/1055964206 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcc28072810 msgr2=0x7fcc2814f3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:00:46.437 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:46.433+0000 7fcc30009640 1 --2- 172.21.15.78:0/1055964206 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcc28072810 0x7fcc2814f3d0 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7fcc2400c490 tx=0x7fcc24001e80 comp rx=0 tx=0).stop 2023-11-28T20:00:46.437 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:46.433+0000 7fcc30009640 1 -- 172.21.15.78:0/1055964206 shutdown_connections 2023-11-28T20:00:46.437 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:46.433+0000 7fcc30009640 1 --2- 172.21.15.78:0/1055964206 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fcc0c066470 0x7fcc0c068930 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:46.437 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:46.433+0000 7fcc30009640 1 --2- 172.21.15.78:0/1055964206 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcc280a4f90 0x7fcc281ee4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:46.437 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:46.433+0000 7fcc30009640 1 --2- 172.21.15.78:0/1055964206 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcc280a5370 0x7fcc28150d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:46.437 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:46.433+0000 7fcc30009640 1 --2- 172.21.15.78:0/1055964206 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcc28072810 0x7fcc2814f3d0 unknown :-1 s=CLOSED pgs=503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:46.437 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:46.433+0000 7fcc30009640 1 -- 172.21.15.78:0/1055964206 >> 172.21.15.78:0/1055964206 conn(0x7fcc2806b220 msgr2=0x7fcc280a77c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:00:46.437 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:46.433+0000 7fcc30009640 1 -- 172.21.15.78:0/1055964206 shutdown_connections 2023-11-28T20:00:46.437 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:46.433+0000 7fcc30009640 1 -- 172.21.15.78:0/1055964206 wait complete. 2023-11-28T20:00:46.455 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2023-11-28T20:00:46.455 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T20:00:46.455 DEBUG:teuthology.orchestra.run.smithi179:> sudo umount /home/ubuntu/cephtest/mnt.1 2023-11-28T20:00:46.486 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi179.front.sepia.ceph.com 2023-11-28T20:00:46.486 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T20:00:46.486 DEBUG:teuthology.orchestra.run.smithi179:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-11-28T20:00:46.538 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-28T20:00:46.676 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:46.673+0000 7f2ca949e640 1 Processor -- start 2023-11-28T20:00:46.676 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:46.673+0000 7f2ca949e640 1 -- start start 2023-11-28T20:00:46.677 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:46.673+0000 7f2ca949e640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2ca406d2b0 0x7f2ca406d690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:46.677 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:46.673+0000 7f2ca949e640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f2ca40c3b80 0x7f2ca40c5300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:46.677 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:46.673+0000 7f2ca949e640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2ca406bb80 con 0x7f2ca406c020 2023-11-28T20:00:46.677 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:46.673+0000 7f2ca949e640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2ca40c5840 con 0x7f2ca40c3b80 2023-11-28T20:00:46.677 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:46.673+0000 7f2ca949e640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ca41515c0 con 0x7f2ca406d2b0 2023-11-28T20:00:46.678 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:46.673+0000 7f2ca27fc640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f2ca40c3b80 0x7f2ca40c5300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:46.678 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:46.673+0000 7f2ca2ffd640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2ca406d2b0 0x7f2ca406d690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:46.678 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:46.673+0000 7f2ca37fe640 1 --1- >> v1:172.21.15.179:6789/0 conn(0x7f2ca406c020 0x7f2ca406c4b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.179:6789/0 says I am v1:172.21.15.78:33440/0 (socket says 172.21.15.78:33440) 2023-11-28T20:00:46.679 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:46.673+0000 7f2ca37fe640 1 -- 172.21.15.78:0/2305675127 learned_addr learned my addr 172.21.15.78:0/2305675127 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-11-28T20:00:46.679 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:46.673+0000 7f2ca1ffb640 1 -- 172.21.15.78:0/2305675127 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3570496638 0 0) 0x7f2ca406bb80 con 0x7f2ca406c020 2023-11-28T20:00:46.679 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:46.673+0000 7f2ca1ffb640 1 -- 172.21.15.78:0/2305675127 --> v1:172.21.15.179:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2c8c003530 con 0x7f2ca406c020 2023-11-28T20:00:46.679 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:46.673+0000 7f2ca27fc640 1 -- 172.21.15.78:0/2305675127 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2ca406d2b0 msgr2=0x7f2ca406d690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:00:46.679 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:46.673+0000 7f2ca27fc640 1 --2- 172.21.15.78:0/2305675127 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2ca406d2b0 0x7f2ca406d690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:46.679 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:46.673+0000 7f2ca27fc640 1 -- 172.21.15.78:0/2305675127 >> v1:172.21.15.179:6789/0 conn(0x7f2ca406c020 legacy=0x7f2ca406c4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:00:46.679 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:46.673+0000 7f2ca27fc640 1 -- 172.21.15.78:0/2305675127 --> v2:172.21.15.179:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ca41518a0 con 0x7f2ca40c3b80 2023-11-28T20:00:46.679 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:46.673+0000 7f2ca2ffd640 1 --2- 172.21.15.78:0/2305675127 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2ca406d2b0 0x7f2ca406d690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T20:00:46.681 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:46.677+0000 7f2ca27fc640 1 --2- 172.21.15.78:0/2305675127 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2ca40c3b80 0x7f2ca40c5300 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f2c980097c0 tx=0x7f2c9801c450 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a4f2e2747819c990 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:00:46.681 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:46.677+0000 7f2ca1ffb640 1 -- 172.21.15.78:0/2305675127 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c980ab650 con 0x7f2ca40c3b80 2023-11-28T20:00:46.681 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:46.677+0000 7f2ca1ffb640 1 -- 172.21.15.78:0/2305675127 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c980ab7b0 con 0x7f2ca40c3b80 2023-11-28T20:00:46.681 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:46.677+0000 7f2ca1ffb640 1 -- 172.21.15.78:0/2305675127 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c980abb40 con 0x7f2ca40c3b80 2023-11-28T20:00:46.682 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:46.677+0000 7f2ca949e640 1 -- 172.21.15.78:0/2305675127 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2ca40c3b80 msgr2=0x7f2ca40c5300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:00:46.682 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:46.677+0000 7f2ca949e640 1 --2- 172.21.15.78:0/2305675127 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2ca40c3b80 0x7f2ca40c5300 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f2c980097c0 tx=0x7f2c9801c450 comp rx=0 tx=0).stop 2023-11-28T20:00:46.682 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:46.677+0000 7f2ca949e640 1 -- 172.21.15.78:0/2305675127 shutdown_connections 2023-11-28T20:00:46.683 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:46.677+0000 7f2ca949e640 1 --2- 172.21.15.78:0/2305675127 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2ca40c3b80 0x7f2ca40c5300 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:46.683 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:46.677+0000 7f2ca949e640 1 --2- 172.21.15.78:0/2305675127 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2ca406d2b0 0x7f2ca406d690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:46.683 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:46.677+0000 7f2ca949e640 1 -- 172.21.15.78:0/2305675127 >> 172.21.15.78:0/2305675127 conn(0x7f2ca40a7810 msgr2=0x7f2ca40a7c20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:00:46.683 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:46.677+0000 7f2ca949e640 1 -- 172.21.15.78:0/2305675127 shutdown_connections 2023-11-28T20:00:46.683 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:46.677+0000 7f2ca949e640 1 -- 172.21.15.78:0/2305675127 wait complete. 2023-11-28T20:00:46.683 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:46.681+0000 7f2ca949e640 1 Processor -- start 2023-11-28T20:00:46.684 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:46.681+0000 7f2ca949e640 1 -- start start 2023-11-28T20:00:46.685 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:46.681+0000 7f2ca949e640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2ca406c020 0x7f2ca415b1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:46.685 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:46.681+0000 7f2ca949e640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2ca406d2b0 0x7f2ca415a4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:46.685 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:46.681+0000 7f2ca949e640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2ca40c3b80 0x7f2ca414bc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:46.685 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:46.681+0000 7f2ca949e640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ca41f05f0 con 0x7f2ca40c3b80 2023-11-28T20:00:46.686 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:46.681+0000 7f2ca949e640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ca41f08d0 con 0x7f2ca406d2b0 2023-11-28T20:00:46.686 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:46.681+0000 7f2ca949e640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ca41f0bb0 con 0x7f2ca406c020 2023-11-28T20:00:46.686 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:46.681+0000 7f2ca37fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2ca40c3b80 0x7f2ca414bc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:46.686 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:46.681+0000 7f2ca2ffd640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2ca406c020 0x7f2ca415b1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:46.686 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:46.681+0000 7f2ca37fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2ca40c3b80 0x7f2ca414bc70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:39856/0 (socket says 172.21.15.78:39856) 2023-11-28T20:00:46.686 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:46.681+0000 7f2ca37fe640 1 -- 172.21.15.78:0/4181350789 learned_addr learned my addr 172.21.15.78:0/4181350789 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T20:00:46.686 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:46.681+0000 7f2ca27fc640 1 --2- 172.21.15.78:0/4181350789 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2ca406d2b0 0x7f2ca415a4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:46.686 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:46.681+0000 7f2ca37fe640 1 -- 172.21.15.78:0/4181350789 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2ca406c020 msgr2=0x7f2ca415b1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:00:46.686 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:46.681+0000 7f2ca37fe640 1 --2- 172.21.15.78:0/4181350789 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2ca406c020 0x7f2ca415b1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:46.686 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:46.681+0000 7f2ca37fe640 1 -- 172.21.15.78:0/4181350789 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2ca406d2b0 msgr2=0x7f2ca415a4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:00:46.686 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:46.681+0000 7f2ca37fe640 1 --2- 172.21.15.78:0/4181350789 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2ca406d2b0 0x7f2ca415a4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:46.686 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:46.681+0000 7f2ca37fe640 1 -- 172.21.15.78:0/4181350789 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c94009420 con 0x7f2ca40c3b80 2023-11-28T20:00:46.687 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:46.681+0000 7f2ca37fe640 1 --2- 172.21.15.78:0/4181350789 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2ca40c3b80 0x7f2ca414bc70 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f2c9c00caa0 tx=0x7f2c9c00cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:00:46.687 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:46.681+0000 7f2c8b7fe640 1 -- 172.21.15.78:0/4181350789 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c9c00ac00 con 0x7f2ca40c3b80 2023-11-28T20:00:46.688 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:46.681+0000 7f2c8b7fe640 1 -- 172.21.15.78:0/4181350789 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c9c00ad60 con 0x7f2ca40c3b80 2023-11-28T20:00:46.688 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:46.681+0000 7f2ca949e640 1 -- 172.21.15.78:0/4181350789 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2c98009420 con 0x7f2ca40c3b80 2023-11-28T20:00:46.688 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:46.681+0000 7f2c8b7fe640 1 -- 172.21.15.78:0/4181350789 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c9c012620 con 0x7f2ca40c3b80 2023-11-28T20:00:46.688 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:46.681+0000 7f2ca949e640 1 -- 172.21.15.78:0/4181350789 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2ca414ef80 con 0x7f2ca40c3b80 2023-11-28T20:00:46.688 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:46.681+0000 7f2ca949e640 1 -- 172.21.15.78:0/4181350789 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2ca4067630 con 0x7f2ca40c3b80 2023-11-28T20:00:46.688 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:46.685+0000 7f2c8b7fe640 1 -- 172.21.15.78:0/4181350789 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f2c9c007070 con 0x7f2ca40c3b80 2023-11-28T20:00:46.689 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:46.685+0000 7f2c8b7fe640 1 --2- 172.21.15.78:0/4181350789 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f2c90066470 0x7f2c90068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:46.690 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:46.685+0000 7f2c8b7fe640 1 -- 172.21.15.78:0/4181350789 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 6885+0+0 (secure 0 0 0) 0x7f2c9c084270 con 0x7f2ca40c3b80 2023-11-28T20:00:46.690 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:46.685+0000 7f2ca2ffd640 1 --2- 172.21.15.78:0/4181350789 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f2c90066470 0x7f2c90068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:46.690 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:46.685+0000 7f2ca2ffd640 1 --2- 172.21.15.78:0/4181350789 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f2c90066470 0x7f2c90068930 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f2ca40c0120 tx=0x7f2c94009190 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:00:46.693 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:46.689+0000 7f2c8b7fe640 1 -- 172.21.15.78:0/4181350789 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f2c9c0512f0 con 0x7f2ca40c3b80 2023-11-28T20:00:46.888 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:46.881+0000 7f2ca949e640 1 -- 172.21.15.78:0/4181350789 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f2ca40c30c0 con 0x7f2ca40c3b80 2023-11-28T20:00:46.888 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:46.885+0000 7f2c8b7fe640 1 -- 172.21.15.78:0/4181350789 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 22 v22) v1 ==== 94+0+6127 (secure 0 0 0) 0x7f2c9c054910 con 0x7f2ca40c3b80 2023-11-28T20:00:46.889 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-11-28T20:00:46.889 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":22,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4880,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6835/20894428","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6834","nonce":20894428},{"type":"v1","addr":"172.21.15.179:6835","nonce":20894428}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":4886,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6837/666703170","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6835","nonce":666703170},{"type":"v1","addr":"172.21.15.78:6837","nonce":666703170}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-28T20:00:13.162273+0000","modified":"2023-11-28T20:00:16.174263+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5185},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5185":{"gid":5185,"name":"c","rank":0,"incarnation":13,"state":"up:active","state_seq":4,"addr":"172.21.15.78:6836/3508383403","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6834","nonce":3508383403},{"type":"v1","addr":"172.21.15.78:6836","nonce":3508383403}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2},{"mdsmap":{"epoch":22,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-28T20:00:30.436267+0000","modified":"2023-11-28T20:00:33.475772+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5179},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5179":{"gid":5179,"name":"b","rank":0,"incarnation":18,"state":"up:active","state_seq":8,"addr":"172.21.15.179:6833/3446403084","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6832","nonce":3446403084},{"type":"v1","addr":"172.21.15.179:6833","nonce":3446403084}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs2","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2023-11-28T20:00:46.889 INFO:teuthology.orchestra.run.smithi078.stderr:dumped fsmap epoch 22 2023-11-28T20:00:46.890 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:46.885+0000 7f2ca949e640 1 -- 172.21.15.78:0/4181350789 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f2c90066470 msgr2=0x7f2c90068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:00:46.890 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:46.885+0000 7f2ca949e640 1 --2- 172.21.15.78:0/4181350789 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f2c90066470 0x7f2c90068930 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f2ca40c0120 tx=0x7f2c94009190 comp rx=0 tx=0).stop 2023-11-28T20:00:46.890 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:46.885+0000 7f2ca949e640 1 -- 172.21.15.78:0/4181350789 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2ca40c3b80 msgr2=0x7f2ca414bc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:00:46.891 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:46.885+0000 7f2ca949e640 1 --2- 172.21.15.78:0/4181350789 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2ca40c3b80 0x7f2ca414bc70 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f2c9c00caa0 tx=0x7f2c9c00cf60 comp rx=0 tx=0).stop 2023-11-28T20:00:46.891 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:46.885+0000 7f2ca949e640 1 -- 172.21.15.78:0/4181350789 shutdown_connections 2023-11-28T20:00:46.891 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:46.885+0000 7f2ca949e640 1 --2- 172.21.15.78:0/4181350789 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f2c90066470 0x7f2c90068930 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:46.891 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:46.885+0000 7f2ca949e640 1 --2- 172.21.15.78:0/4181350789 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2ca40c3b80 0x7f2ca414bc70 unknown :-1 s=CLOSED pgs=504 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:46.891 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:46.885+0000 7f2ca949e640 1 --2- 172.21.15.78:0/4181350789 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2ca406d2b0 0x7f2ca415a4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:46.891 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:46.885+0000 7f2ca949e640 1 --2- 172.21.15.78:0/4181350789 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2ca406c020 0x7f2ca415b1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:46.891 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:46.885+0000 7f2ca949e640 1 -- 172.21.15.78:0/4181350789 >> 172.21.15.78:0/4181350789 conn(0x7f2ca40a7810 msgr2=0x7f2ca40a7bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:00:46.891 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:46.885+0000 7f2ca949e640 1 -- 172.21.15.78:0/4181350789 shutdown_connections 2023-11-28T20:00:46.891 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:46.885+0000 7f2ca949e640 1 -- 172.21.15.78:0/4181350789 wait complete. 2023-11-28T20:00:46.909 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-28T20:00:47.048 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:47.045+0000 7f07fac9b640 1 Processor -- start 2023-11-28T20:00:47.048 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:47.045+0000 7f07fac9b640 1 -- start start 2023-11-28T20:00:47.049 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:47.045+0000 7f07fac9b640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f07f4151b40 0x7f07f40c7fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:47.049 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:47.045+0000 7f07fac9b640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f07f40c9f80 0x7f07f40ca3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:47.049 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:47.045+0000 7f07fac9b640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f07f41584b0 con 0x7f07f4157910 2023-11-28T20:00:47.049 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:47.045+0000 7f07fac9b640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f07f4154320 con 0x7f07f40c9f80 2023-11-28T20:00:47.049 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:47.045+0000 7f07fac9b640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f07f41552f0 con 0x7f07f4151b40 2023-11-28T20:00:47.051 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:47.045+0000 7f07f9498640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f07f40c9f80 0x7f07f40ca3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:47.051 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:47.045+0000 7f07f9c99640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f07f4151b40 0x7f07f40c7fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:47.051 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:47.045+0000 7f07fa49a640 1 --1- >> v1:172.21.15.179:6789/0 conn(0x7f07f4157910 0x7f07f4157da0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.179:6789/0 says I am v1:172.21.15.78:33444/0 (socket says 172.21.15.78:33444) 2023-11-28T20:00:47.051 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:47.045+0000 7f07fa49a640 1 -- 172.21.15.78:0/2415808434 learned_addr learned my addr 172.21.15.78:0/2415808434 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-11-28T20:00:47.051 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:47.045+0000 7f07f8c97640 1 -- 172.21.15.78:0/2415808434 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3728432601 0 0) 0x7f07f41584b0 con 0x7f07f4157910 2023-11-28T20:00:47.051 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:47.045+0000 7f07f8c97640 1 -- 172.21.15.78:0/2415808434 --> v1:172.21.15.179:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f07e0003530 con 0x7f07f4157910 2023-11-28T20:00:47.051 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:47.045+0000 7f07f9c99640 1 -- 172.21.15.78:0/2415808434 >> v2:172.21.15.179:3300/0 conn(0x7f07f40c9f80 msgr2=0x7f07f40ca3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:00:47.051 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:47.045+0000 7f07f9c99640 1 --2- 172.21.15.78:0/2415808434 >> v2:172.21.15.179:3300/0 conn(0x7f07f40c9f80 0x7f07f40ca3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:47.052 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:47.045+0000 7f07f9c99640 1 -- 172.21.15.78:0/2415808434 >> v1:172.21.15.179:6789/0 conn(0x7f07f4157910 legacy=0x7f07f4157da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:00:47.052 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:47.045+0000 7f07f9c99640 1 -- 172.21.15.78:0/2415808434 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07f4154530 con 0x7f07f4151b40 2023-11-28T20:00:47.052 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:47.045+0000 7f07f9498640 1 --2- 172.21.15.78:0/2415808434 >> v2:172.21.15.179:3300/0 conn(0x7f07f40c9f80 0x7f07f40ca3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T20:00:47.053 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:47.049+0000 7f07f9c99640 1 --2- 172.21.15.78:0/2415808434 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f07f4151b40 0x7f07f40c7fd0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f07f00097c0 tx=0x7f07f001c3f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5d877b475d43f53 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:00:47.055 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:47.049+0000 7f07f8c97640 1 -- 172.21.15.78:0/2415808434 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07f00ab600 con 0x7f07f4151b40 2023-11-28T20:00:47.055 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:47.049+0000 7f07f8c97640 1 -- 172.21.15.78:0/2415808434 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f07f00a7050 con 0x7f07f4151b40 2023-11-28T20:00:47.055 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:47.049+0000 7f07f8c97640 1 -- 172.21.15.78:0/2415808434 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07f00ab980 con 0x7f07f4151b40 2023-11-28T20:00:47.055 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:47.049+0000 7f07fac9b640 1 -- 172.21.15.78:0/2415808434 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f07f4151b40 msgr2=0x7f07f40c7fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:00:47.055 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:47.049+0000 7f07fac9b640 1 --2- 172.21.15.78:0/2415808434 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f07f4151b40 0x7f07f40c7fd0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f07f00097c0 tx=0x7f07f001c3f0 comp rx=0 tx=0).stop 2023-11-28T20:00:47.055 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:47.049+0000 7f07fac9b640 1 -- 172.21.15.78:0/2415808434 shutdown_connections 2023-11-28T20:00:47.056 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:47.049+0000 7f07fac9b640 1 --2- 172.21.15.78:0/2415808434 >> v2:172.21.15.179:3300/0 conn(0x7f07f40c9f80 0x7f07f40ca3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:47.056 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:47.049+0000 7f07fac9b640 1 --2- 172.21.15.78:0/2415808434 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f07f4151b40 0x7f07f40c7fd0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:47.056 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:47.049+0000 7f07fac9b640 1 -- 172.21.15.78:0/2415808434 >> 172.21.15.78:0/2415808434 conn(0x7f07f4066470 msgr2=0x7f07f4066880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:00:47.056 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:47.049+0000 7f07fac9b640 1 -- 172.21.15.78:0/2415808434 shutdown_connections 2023-11-28T20:00:47.056 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:47.049+0000 7f07fac9b640 1 -- 172.21.15.78:0/2415808434 wait complete. 2023-11-28T20:00:47.060 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:47.053+0000 7f07fac9b640 1 Processor -- start 2023-11-28T20:00:47.060 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:47.053+0000 7f07fac9b640 1 -- start start 2023-11-28T20:00:47.060 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:47.053+0000 7f07fac9b640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f07f40c9f80 0x7f07f414e390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:47.060 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:47.053+0000 7f07fac9b640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f07f4151b40 0x7f07f4147300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:47.060 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:47.053+0000 7f07fac9b640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f07f4157910 0x7f07f41ec8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:47.060 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:47.053+0000 7f07fac9b640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07f41513e0 con 0x7f07f4151b40 2023-11-28T20:00:47.060 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:47.053+0000 7f07fac9b640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07f414d340 con 0x7f07f40c9f80 2023-11-28T20:00:47.060 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:47.053+0000 7f07fac9b640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f07f41540d0 con 0x7f07f4157910 2023-11-28T20:00:47.060 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:47.053+0000 7f07f9498640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f07f4151b40 0x7f07f4147300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:47.060 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:47.053+0000 7f07f9498640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f07f4151b40 0x7f07f4147300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:39872/0 (socket says 172.21.15.78:39872) 2023-11-28T20:00:47.061 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:47.053+0000 7f07f9498640 1 -- 172.21.15.78:0/3961702341 learned_addr learned my addr 172.21.15.78:0/3961702341 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T20:00:47.061 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:47.053+0000 7f07f9c99640 1 --2- 172.21.15.78:0/3961702341 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f07f40c9f80 0x7f07f414e390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:47.061 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:47.053+0000 7f07fa49a640 1 --2- 172.21.15.78:0/3961702341 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f07f4157910 0x7f07f41ec8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:47.061 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:47.053+0000 7f07f9498640 1 -- 172.21.15.78:0/3961702341 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f07f4157910 msgr2=0x7f07f41ec8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:00:47.061 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:47.053+0000 7f07f9498640 1 --2- 172.21.15.78:0/3961702341 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f07f4157910 0x7f07f41ec8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:47.061 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:47.053+0000 7f07f9498640 1 -- 172.21.15.78:0/3961702341 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f07f40c9f80 msgr2=0x7f07f414e390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:00:47.061 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:47.053+0000 7f07f9498640 1 --2- 172.21.15.78:0/3961702341 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f07f40c9f80 0x7f07f414e390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:47.061 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:47.053+0000 7f07f9498640 1 -- 172.21.15.78:0/3961702341 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07e4009420 con 0x7f07f4151b40 2023-11-28T20:00:47.061 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:47.053+0000 7f07f9498640 1 --2- 172.21.15.78:0/3961702341 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f07f4151b40 0x7f07f4147300 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f07e400ec10 tx=0x7f07e400c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:00:47.062 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:47.053+0000 7f07ea7fc640 1 -- 172.21.15.78:0/3961702341 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07e400cc30 con 0x7f07f4151b40 2023-11-28T20:00:47.062 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:47.053+0000 7f07ea7fc640 1 -- 172.21.15.78:0/3961702341 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f07e400cd90 con 0x7f07f4151b40 2023-11-28T20:00:47.062 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:47.053+0000 7f07fac9b640 1 -- 172.21.15.78:0/3961702341 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f07f0009420 con 0x7f07f4151b40 2023-11-28T20:00:47.063 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:47.053+0000 7f07ea7fc640 1 -- 172.21.15.78:0/3961702341 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07e4013690 con 0x7f07f4151b40 2023-11-28T20:00:47.063 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:47.053+0000 7f07fac9b640 1 -- 172.21.15.78:0/3961702341 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f07f41f0b50 con 0x7f07f4151b40 2023-11-28T20:00:47.063 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:47.053+0000 7f07fac9b640 1 -- 172.21.15.78:0/3961702341 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f07f4067bc0 con 0x7f07f4151b40 2023-11-28T20:00:47.063 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:47.057+0000 7f07ea7fc640 1 -- 172.21.15.78:0/3961702341 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f07e40137f0 con 0x7f07f4151b40 2023-11-28T20:00:47.064 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:47.057+0000 7f07ea7fc640 1 --2- 172.21.15.78:0/3961702341 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f07d8066470 0x7f07d8068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:47.064 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:47.057+0000 7f07ea7fc640 1 -- 172.21.15.78:0/3961702341 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 6972+0+0 (secure 0 0 0) 0x7f07e40845c0 con 0x7f07f4151b40 2023-11-28T20:00:47.064 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:47.057+0000 7f07f9c99640 1 --2- 172.21.15.78:0/3961702341 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f07d8066470 0x7f07d8068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:47.064 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:47.057+0000 7f07f9c99640 1 --2- 172.21.15.78:0/3961702341 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f07d8066470 0x7f07d8068930 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f07f00ad000 tx=0x7f07f00a4f90 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:00:47.065 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:47.061+0000 7f07ea7fc640 1 -- 172.21.15.78:0/3961702341 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f07e40515f0 con 0x7f07f4151b40 2023-11-28T20:00:47.218 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:47.213+0000 7f07fac9b640 1 -- 172.21.15.78:0/3961702341 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f07f40ca4d0 con 0x7f07f4151b40 2023-11-28T20:00:47.219 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:47.213+0000 7f07ea7fc640 1 -- 172.21.15.78:0/3961702341 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v45) v1 ==== 74+0+20497 (secure 0 0 0) 0x7f07e4054c10 con 0x7f07f4151b40 2023-11-28T20:00:47.220 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-11-28T20:00:47.220 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":45,"fsid":"dd9780e8-3bda-44fa-a9f0-fa07d19d901d","created":"2023-11-28T19:58:40.969556+0000","modified":"2023-11-28T20:00:46.810416+0000","last_up_change":"2023-11-28T19:58:52.596716+0000","last_in_change":"2023-11-28T19:58:43.609275+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-28T19:58:54.011229+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2023-11-28T20:00:10.831194+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"39","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2023-11-28T20:00:12.150184+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"40","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs2_metadata","create_time":"2023-11-28T20:00:28.571896+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"43","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs2_data","create_time":"2023-11-28T20:00:29.436453+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"44","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs2"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e84245ac-b5da-429e-af18-39acaa2b33e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6800","nonce":3358701235},{"type":"v1","addr":"172.21.15.78:6801","nonce":3358701235}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6802","nonce":3358701235},{"type":"v1","addr":"172.21.15.78:6803","nonce":3358701235}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6806","nonce":3358701235},{"type":"v1","addr":"172.21.15.78:6807","nonce":3358701235}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6804","nonce":3358701235},{"type":"v1","addr":"172.21.15.78:6805","nonce":3358701235}]},"public_addr":"172.21.15.78:6801/3358701235","cluster_addr":"172.21.15.78:6803/3358701235","heartbeat_back_addr":"172.21.15.78:6807/3358701235","heartbeat_front_addr":"172.21.15.78:6805/3358701235","state":["exists","up"]},{"osd":1,"uuid":"e634831d-c4e2-48d9-870c-9556ae162981","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6808","nonce":3211476654},{"type":"v1","addr":"172.21.15.78:6809","nonce":3211476654}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6810","nonce":3211476654},{"type":"v1","addr":"172.21.15.78:6811","nonce":3211476654}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6814","nonce":3211476654},{"type":"v1","addr":"172.21.15.78:6815","nonce":3211476654}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6812","nonce":3211476654},{"type":"v1","addr":"172.21.15.78:6813","nonce":3211476654}]},"public_addr":"172.21.15.78:6809/3211476654","cluster_addr":"172.21.15.78:6811/3211476654","heartbeat_back_addr":"172.21.15.78:6815/3211476654","heartbeat_front_addr":"172.21.15.78:6813/3211476654","state":["exists","up"]},{"osd":2,"uuid":"274c8395-6534-41f0-b8fb-a00af8985aa8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6816","nonce":2532904479},{"type":"v1","addr":"172.21.15.78:6817","nonce":2532904479}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6818","nonce":2532904479},{"type":"v1","addr":"172.21.15.78:6819","nonce":2532904479}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6822","nonce":2532904479},{"type":"v1","addr":"172.21.15.78:6823","nonce":2532904479}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6820","nonce":2532904479},{"type":"v1","addr":"172.21.15.78:6821","nonce":2532904479}]},"public_addr":"172.21.15.78:6817/2532904479","cluster_addr":"172.21.15.78:6819/2532904479","heartbeat_back_addr":"172.21.15.78:6823/2532904479","heartbeat_front_addr":"172.21.15.78:6821/2532904479","state":["exists","up"]},{"osd":3,"uuid":"77acc9af-7d4d-4b18-8cf5-d62f5971b7c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6824","nonce":3442991267},{"type":"v1","addr":"172.21.15.78:6825","nonce":3442991267}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6826","nonce":3442991267},{"type":"v1","addr":"172.21.15.78:6827","nonce":3442991267}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6830","nonce":3442991267},{"type":"v1","addr":"172.21.15.78:6831","nonce":3442991267}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6828","nonce":3442991267},{"type":"v1","addr":"172.21.15.78:6829","nonce":3442991267}]},"public_addr":"172.21.15.78:6825/3442991267","cluster_addr":"172.21.15.78:6827/3442991267","heartbeat_back_addr":"172.21.15.78:6831/3442991267","heartbeat_front_addr":"172.21.15.78:6829/3442991267","state":["exists","up"]},{"osd":4,"uuid":"5c62bc66-6b34-4b7f-a66b-9a743969138c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":802983577},{"type":"v1","addr":"172.21.15.179:6809","nonce":802983577}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":802983577},{"type":"v1","addr":"172.21.15.179:6811","nonce":802983577}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":802983577},{"type":"v1","addr":"172.21.15.179:6815","nonce":802983577}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":802983577},{"type":"v1","addr":"172.21.15.179:6813","nonce":802983577}]},"public_addr":"172.21.15.179:6809/802983577","cluster_addr":"172.21.15.179:6811/802983577","heartbeat_back_addr":"172.21.15.179:6815/802983577","heartbeat_front_addr":"172.21.15.179:6813/802983577","state":["exists","up"]},{"osd":5,"uuid":"67db6d36-f684-4079-b0cd-82b4dd61461f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":518192887},{"type":"v1","addr":"172.21.15.179:6818","nonce":518192887}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":518192887},{"type":"v1","addr":"172.21.15.179:6822","nonce":518192887}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":518192887},{"type":"v1","addr":"172.21.15.179:6829","nonce":518192887}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6824","nonce":518192887},{"type":"v1","addr":"172.21.15.179:6826","nonce":518192887}]},"public_addr":"172.21.15.179:6818/518192887","cluster_addr":"172.21.15.179:6822/518192887","heartbeat_back_addr":"172.21.15.179:6829/518192887","heartbeat_front_addr":"172.21.15.179:6826/518192887","state":["exists","up"]},{"osd":6,"uuid":"12e670af-5a16-4c81-9f97-defa66cab967","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":815435378},{"type":"v1","addr":"172.21.15.179:6801","nonce":815435378}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":815435378},{"type":"v1","addr":"172.21.15.179:6803","nonce":815435378}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":815435378},{"type":"v1","addr":"172.21.15.179:6807","nonce":815435378}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":815435378},{"type":"v1","addr":"172.21.15.179:6805","nonce":815435378}]},"public_addr":"172.21.15.179:6801/815435378","cluster_addr":"172.21.15.179:6803/815435378","heartbeat_back_addr":"172.21.15.179:6807/815435378","heartbeat_front_addr":"172.21.15.179:6805/815435378","state":["exists","up"]},{"osd":7,"uuid":"fe630650-2eb3-49ad-8676-c341e6332eb1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6817","nonce":2848432339},{"type":"v1","addr":"172.21.15.179:6819","nonce":2848432339}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6821","nonce":2848432339},{"type":"v1","addr":"172.21.15.179:6823","nonce":2848432339}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":2848432339},{"type":"v1","addr":"172.21.15.179:6831","nonce":2848432339}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6825","nonce":2848432339},{"type":"v1","addr":"172.21.15.179:6827","nonce":2848432339}]},"public_addr":"172.21.15.179:6819/2848432339","cluster_addr":"172.21.15.179:6823/2848432339","heartbeat_back_addr":"172.21.15.179:6831/2848432339","heartbeat_front_addr":"172.21.15.179:6827/2848432339","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:58:49.255433+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:58:49.412880+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:58:49.559295+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:58:49.245237+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:58:49.184557+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:58:49.329851+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:58:49.366012+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:58:49.349604+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"6.2b","mappings":[{"from":5,"to":0}]},{"pgid":"8.28","mappings":[{"from":0,"to":6}]},{"pgid":"8.38","mappings":[{"from":0,"to":6}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-28T20:00:47.222 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:47.217+0000 7f07fac9b640 1 -- 172.21.15.78:0/3961702341 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f07d8066470 msgr2=0x7f07d8068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:00:47.223 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:47.217+0000 7f07fac9b640 1 --2- 172.21.15.78:0/3961702341 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f07d8066470 0x7f07d8068930 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f07f00ad000 tx=0x7f07f00a4f90 comp rx=0 tx=0).stop 2023-11-28T20:00:47.223 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:47.217+0000 7f07fac9b640 1 -- 172.21.15.78:0/3961702341 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f07f4151b40 msgr2=0x7f07f4147300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:00:47.223 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:47.217+0000 7f07fac9b640 1 --2- 172.21.15.78:0/3961702341 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f07f4151b40 0x7f07f4147300 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f07e400ec10 tx=0x7f07e400c520 comp rx=0 tx=0).stop 2023-11-28T20:00:47.223 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:47.217+0000 7f07fac9b640 1 -- 172.21.15.78:0/3961702341 shutdown_connections 2023-11-28T20:00:47.223 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:47.217+0000 7f07fac9b640 1 --2- 172.21.15.78:0/3961702341 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f07d8066470 0x7f07d8068930 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:47.223 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:47.217+0000 7f07fac9b640 1 --2- 172.21.15.78:0/3961702341 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f07f4157910 0x7f07f41ec8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:47.223 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:47.217+0000 7f07fac9b640 1 --2- 172.21.15.78:0/3961702341 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f07f4151b40 0x7f07f4147300 unknown :-1 s=CLOSED pgs=505 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:47.223 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:47.217+0000 7f07fac9b640 1 --2- 172.21.15.78:0/3961702341 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f07f40c9f80 0x7f07f414e390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:47.224 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:47.217+0000 7f07fac9b640 1 -- 172.21.15.78:0/3961702341 >> 172.21.15.78:0/3961702341 conn(0x7f07f4066470 msgr2=0x7f07f40ab730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:00:47.224 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:47.217+0000 7f07fac9b640 1 -- 172.21.15.78:0/3961702341 shutdown_connections 2023-11-28T20:00:47.224 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:47.217+0000 7f07fac9b640 1 -- 172.21.15.78:0/3961702341 wait complete. 2023-11-28T20:00:47.241 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-28T19:58:54.011229+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-28T20:00:10.831194+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '39', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.25, 'score_stable': 1.25, 'optimal_score': 1, 'raw_score_acting': 1.25, 'raw_score_stable': 1.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 6, 'pool_name': 'cephfs_data', 'create_time': '2023-11-28T20:00:12.150184+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '40', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.25, 'score_stable': 1.25, 'optimal_score': 1, 'raw_score_acting': 1.25, 'raw_score_stable': 1.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 7, 'pool_name': 'cephfs2_metadata', 'create_time': '2023-11-28T20:00:28.571896+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '43', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs2'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 8, 'pool_name': 'cephfs2_data', 'create_time': '2023-11-28T20:00:29.436453+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '44', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs2'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-28T20:00:47.242 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-28T20:00:47.382 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:47.377+0000 7f24bf6fd640 1 Processor -- start 2023-11-28T20:00:47.382 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:47.377+0000 7f24bf6fd640 1 -- start start 2023-11-28T20:00:47.383 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:47.377+0000 7f24bf6fd640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f24b8156200 0x7f24b80c0370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:47.383 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:47.377+0000 7f24bf6fd640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f24b806bce0 con 0x7f24b80c0e10 2023-11-28T20:00:47.383 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:47.377+0000 7f24bf6fd640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f24b80c2270 con 0x7f24b815bf70 2023-11-28T20:00:47.383 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:47.377+0000 7f24bf6fd640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f24b806d8d0 con 0x7f24b8156200 2023-11-28T20:00:47.384 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:47.377+0000 7f24bcc98640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f24b80c0e10 0x7f24b80c1b60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:36554/0 (socket says 172.21.15.78:36554) 2023-11-28T20:00:47.384 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:47.377+0000 7f24bcc98640 1 -- 172.21.15.78:0/1933778438 learned_addr learned my addr 172.21.15.78:0/1933778438 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-11-28T20:00:47.385 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:47.377+0000 7f24bd499640 1 --2- 172.21.15.78:0/1933778438 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f24b8156200 0x7f24b80c0370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:47.385 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:47.381+0000 7f24affff640 1 -- 172.21.15.78:0/1933778438 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 357048141 0 0) 0x7f24b806bce0 con 0x7f24b80c0e10 2023-11-28T20:00:47.385 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:47.381+0000 7f24affff640 1 -- 172.21.15.78:0/1933778438 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f24a4003530 con 0x7f24b80c0e10 2023-11-28T20:00:47.385 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:47.381+0000 7f24affff640 1 -- 172.21.15.78:0/1933778438 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3374027857 0 0) 0x7f24b80c2270 con 0x7f24b815bf70 2023-11-28T20:00:47.386 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:47.381+0000 7f24affff640 1 -- 172.21.15.78:0/1933778438 --> v1:172.21.15.179:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f24b806bce0 con 0x7f24b815bf70 2023-11-28T20:00:47.386 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:47.381+0000 7f24bd499640 1 -- 172.21.15.78:0/1933778438 >> v1:172.21.15.179:6789/0 conn(0x7f24b815bf70 legacy=0x7f24b815c400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:00:47.386 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:47.381+0000 7f24bd499640 1 -- 172.21.15.78:0/1933778438 >> v1:172.21.15.78:6789/0 conn(0x7f24b80c0e10 legacy=0x7f24b80c1b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:00:47.386 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:47.381+0000 7f24bd499640 1 -- 172.21.15.78:0/1933778438 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24b815cc60 con 0x7f24b8156200 2023-11-28T20:00:47.387 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:47.381+0000 7f24bd499640 1 --2- 172.21.15.78:0/1933778438 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f24b8156200 0x7f24b80c0370 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f24b40097f0 tx=0x7f24b401c370 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2301bfb9039dbdaf server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:00:47.388 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:47.381+0000 7f24affff640 1 -- 172.21.15.78:0/1933778438 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24b40ab600 con 0x7f24b8156200 2023-11-28T20:00:47.388 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:47.381+0000 7f24affff640 1 -- 172.21.15.78:0/1933778438 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f24b40a7050 con 0x7f24b8156200 2023-11-28T20:00:47.388 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:47.381+0000 7f24affff640 1 -- 172.21.15.78:0/1933778438 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24b40ab960 con 0x7f24b8156200 2023-11-28T20:00:47.388 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:47.385+0000 7f24bf6fd640 1 -- 172.21.15.78:0/1933778438 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f24b8156200 msgr2=0x7f24b80c0370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:00:47.388 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:47.385+0000 7f24bf6fd640 1 --2- 172.21.15.78:0/1933778438 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f24b8156200 0x7f24b80c0370 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f24b40097f0 tx=0x7f24b401c370 comp rx=0 tx=0).stop 2023-11-28T20:00:47.388 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:47.385+0000 7f24bf6fd640 1 -- 172.21.15.78:0/1933778438 shutdown_connections 2023-11-28T20:00:47.388 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:47.385+0000 7f24bf6fd640 1 --2- 172.21.15.78:0/1933778438 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f24b8156200 0x7f24b80c0370 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:47.388 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:47.385+0000 7f24bf6fd640 1 -- 172.21.15.78:0/1933778438 >> 172.21.15.78:0/1933778438 conn(0x7f24b80c59f0 msgr2=0x7f24b80c5e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:00:47.389 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:47.385+0000 7f24bf6fd640 1 -- 172.21.15.78:0/1933778438 shutdown_connections 2023-11-28T20:00:47.389 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:47.385+0000 7f24bf6fd640 1 -- 172.21.15.78:0/1933778438 wait complete. 2023-11-28T20:00:47.390 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:47.385+0000 7f24bf6fd640 1 Processor -- start 2023-11-28T20:00:47.390 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:47.385+0000 7f24bf6fd640 1 -- start start 2023-11-28T20:00:47.391 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:47.385+0000 7f24bf6fd640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f24b80c0e10 0x7f24b80a9e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:47.392 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:47.385+0000 7f24bf6fd640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f24b8156200 0x7f24b80aa3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:47.392 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:47.385+0000 7f24bf6fd640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f24b815bf70 0x7f24b81f4060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:47.392 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:47.385+0000 7f24bf6fd640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24b80a9a40 con 0x7f24b80c0e10 2023-11-28T20:00:47.392 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:47.385+0000 7f24bf6fd640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24b80a96a0 con 0x7f24b8156200 2023-11-28T20:00:47.392 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:47.385+0000 7f24bf6fd640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f24b81459c0 con 0x7f24b815bf70 2023-11-28T20:00:47.392 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:47.385+0000 7f24bd499640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f24b80c0e10 0x7f24b80a9e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:47.392 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:47.385+0000 7f24bd499640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f24b80c0e10 0x7f24b80a9e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:39888/0 (socket says 172.21.15.78:39888) 2023-11-28T20:00:47.393 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:47.385+0000 7f24bd499640 1 -- 172.21.15.78:0/2550324617 learned_addr learned my addr 172.21.15.78:0/2550324617 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T20:00:47.393 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:47.385+0000 7f24bcc98640 1 --2- 172.21.15.78:0/2550324617 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f24b8156200 0x7f24b80aa3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:47.393 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:47.385+0000 7f24bdc9a640 1 --2- 172.21.15.78:0/2550324617 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f24b815bf70 0x7f24b81f4060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:47.393 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:47.385+0000 7f24bd499640 1 -- 172.21.15.78:0/2550324617 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f24b815bf70 msgr2=0x7f24b81f4060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:00:47.394 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:47.385+0000 7f24bd499640 1 --2- 172.21.15.78:0/2550324617 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f24b815bf70 0x7f24b81f4060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:47.394 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:47.385+0000 7f24bd499640 1 -- 172.21.15.78:0/2550324617 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f24b8156200 msgr2=0x7f24b80aa3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:00:47.394 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:47.385+0000 7f24bd499640 1 --2- 172.21.15.78:0/2550324617 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f24b8156200 0x7f24b80aa3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:47.394 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:47.385+0000 7f24bd499640 1 -- 172.21.15.78:0/2550324617 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24b4009420 con 0x7f24b80c0e10 2023-11-28T20:00:47.394 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:47.385+0000 7f24bd499640 1 --2- 172.21.15.78:0/2550324617 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f24b80c0e10 0x7f24b80a9e60 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f24b4019fa0 tx=0x7f24b4019110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:00:47.394 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:47.389+0000 7f24adffb640 1 -- 172.21.15.78:0/2550324617 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24b4003a30 con 0x7f24b80c0e10 2023-11-28T20:00:47.395 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:47.389+0000 7f24adffb640 1 -- 172.21.15.78:0/2550324617 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f24b4003b90 con 0x7f24b80c0e10 2023-11-28T20:00:47.395 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:47.389+0000 7f24adffb640 1 -- 172.21.15.78:0/2550324617 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24b40b5410 con 0x7f24b80c0e10 2023-11-28T20:00:47.395 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:47.389+0000 7f24bf6fd640 1 -- 172.21.15.78:0/2550324617 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f24b8145ca0 con 0x7f24b80c0e10 2023-11-28T20:00:47.396 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:47.389+0000 7f24bf6fd640 1 -- 172.21.15.78:0/2550324617 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f24b8070c70 con 0x7f24b80c0e10 2023-11-28T20:00:47.396 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:47.389+0000 7f24bf6fd640 1 -- 172.21.15.78:0/2550324617 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f24b8067630 con 0x7f24b80c0e10 2023-11-28T20:00:47.396 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:47.389+0000 7f24adffb640 1 -- 172.21.15.78:0/2550324617 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f24b40b2050 con 0x7f24b80c0e10 2023-11-28T20:00:47.396 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:47.389+0000 7f24adffb640 1 --2- 172.21.15.78:0/2550324617 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f249c066470 0x7f249c068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:47.397 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:47.389+0000 7f24adffb640 1 -- 172.21.15.78:0/2550324617 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 6972+0+0 (secure 0 0 0) 0x7f24b411e690 con 0x7f24b80c0e10 2023-11-28T20:00:47.397 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:47.389+0000 7f24bcc98640 1 --2- 172.21.15.78:0/2550324617 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f249c066470 0x7f249c068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:47.397 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:47.393+0000 7f24bcc98640 1 --2- 172.21.15.78:0/2550324617 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f249c066470 0x7f249c068930 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f24b80aaf80 tx=0x7f24a8009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:00:47.398 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:47.393+0000 7f24adffb640 1 -- 172.21.15.78:0/2550324617 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f24b40eb740 con 0x7f24b80c0e10 2023-11-28T20:00:47.548 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:47.545+0000 7f24bf6fd640 1 -- 172.21.15.78:0/2550324617 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f24b8070e90 con 0x7f24b80c0e10 2023-11-28T20:00:47.549 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:47.545+0000 7f24adffb640 1 -- 172.21.15.78:0/2550324617 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v45) v1 ==== 93+0+10 (secure 0 0 0) 0x7f24b40eed60 con 0x7f24b80c0e10 2023-11-28T20:00:47.549 INFO:teuthology.orchestra.run.smithi078.stdout:pg_num: 1 2023-11-28T20:00:47.551 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:47.545+0000 7f24bf6fd640 1 -- 172.21.15.78:0/2550324617 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f249c066470 msgr2=0x7f249c068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:00:47.551 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:47.545+0000 7f24bf6fd640 1 --2- 172.21.15.78:0/2550324617 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f249c066470 0x7f249c068930 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f24b80aaf80 tx=0x7f24a8009040 comp rx=0 tx=0).stop 2023-11-28T20:00:47.551 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:47.545+0000 7f24bf6fd640 1 -- 172.21.15.78:0/2550324617 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f24b80c0e10 msgr2=0x7f24b80a9e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:00:47.551 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:47.545+0000 7f24bf6fd640 1 --2- 172.21.15.78:0/2550324617 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f24b80c0e10 0x7f24b80a9e60 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f24b4019fa0 tx=0x7f24b4019110 comp rx=0 tx=0).stop 2023-11-28T20:00:47.551 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:47.545+0000 7f24bf6fd640 1 -- 172.21.15.78:0/2550324617 shutdown_connections 2023-11-28T20:00:47.551 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:47.545+0000 7f24bf6fd640 1 --2- 172.21.15.78:0/2550324617 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f249c066470 0x7f249c068930 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:47.551 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:47.545+0000 7f24bf6fd640 1 --2- 172.21.15.78:0/2550324617 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f24b815bf70 0x7f24b81f4060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:47.552 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:47.545+0000 7f24bf6fd640 1 --2- 172.21.15.78:0/2550324617 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f24b8156200 0x7f24b80aa3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:47.552 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:47.545+0000 7f24bf6fd640 1 --2- 172.21.15.78:0/2550324617 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f24b80c0e10 0x7f24b80a9e60 unknown :-1 s=CLOSED pgs=507 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:47.552 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:47.545+0000 7f24bf6fd640 1 -- 172.21.15.78:0/2550324617 >> 172.21.15.78:0/2550324617 conn(0x7f24b80c59f0 msgr2=0x7f24b80c4480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:00:47.552 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:47.545+0000 7f24bf6fd640 1 -- 172.21.15.78:0/2550324617 shutdown_connections 2023-11-28T20:00:47.552 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:47.545+0000 7f24bf6fd640 1 -- 172.21.15.78:0/2550324617 wait complete. 2023-11-28T20:00:47.570 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-28T20:00:47.709 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:47.705+0000 7f01c7c32640 1 Processor -- start 2023-11-28T20:00:47.709 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:47.705+0000 7f01c7c32640 1 -- start start 2023-11-28T20:00:47.711 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:47.705+0000 7f01c7c32640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f01c0156200 0x7f01c00c0370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:47.711 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:47.705+0000 7f01c7c32640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f01c006bce0 con 0x7f01c015bf70 2023-11-28T20:00:47.711 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:47.705+0000 7f01c7c32640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f01c00c2270 con 0x7f01c00c0e10 2023-11-28T20:00:47.711 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:47.705+0000 7f01c7c32640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f01c006d8d0 con 0x7f01c0156200 2023-11-28T20:00:47.711 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:47.705+0000 7f01c61cf640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f01c015bf70 0x7f01c015c400 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:36566/0 (socket says 172.21.15.78:36566) 2023-11-28T20:00:47.712 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:47.705+0000 7f01c61cf640 1 -- 172.21.15.78:0/3257887144 learned_addr learned my addr 172.21.15.78:0/3257887144 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-11-28T20:00:47.712 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:47.705+0000 7f01c59ce640 1 --2- 172.21.15.78:0/3257887144 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f01c0156200 0x7f01c00c0370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:47.712 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:47.705+0000 7f01c49cc640 1 -- 172.21.15.78:0/3257887144 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 482168049 0 0) 0x7f01c006bce0 con 0x7f01c015bf70 2023-11-28T20:00:47.712 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:47.705+0000 7f01c49cc640 1 -- 172.21.15.78:0/3257887144 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f01ac003530 con 0x7f01c015bf70 2023-11-28T20:00:47.712 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:47.705+0000 7f01c49cc640 1 -- 172.21.15.78:0/3257887144 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 951131491 0 0) 0x7f01c00c2270 con 0x7f01c00c0e10 2023-11-28T20:00:47.712 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:47.705+0000 7f01c49cc640 1 -- 172.21.15.78:0/3257887144 --> v1:172.21.15.179:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f01c006bce0 con 0x7f01c00c0e10 2023-11-28T20:00:47.712 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:47.705+0000 7f01c59ce640 1 -- 172.21.15.78:0/3257887144 >> v1:172.21.15.179:6789/0 conn(0x7f01c00c0e10 legacy=0x7f01c00c1b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:00:47.712 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:47.705+0000 7f01c59ce640 1 -- 172.21.15.78:0/3257887144 >> v1:172.21.15.78:6789/0 conn(0x7f01c015bf70 legacy=0x7f01c015c400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:00:47.712 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:47.705+0000 7f01c59ce640 1 -- 172.21.15.78:0/3257887144 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01c015cc60 con 0x7f01c0156200 2023-11-28T20:00:47.714 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:47.709+0000 7f01c59ce640 1 --2- 172.21.15.78:0/3257887144 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f01c0156200 0x7f01c00c0370 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f01bc0097f0 tx=0x7f01bc01c370 comp rx=0 tx=0).ready entity=mon.2 client_cookie=10f2577a68d14bf2 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:00:47.715 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:47.709+0000 7f01c49cc640 1 -- 172.21.15.78:0/3257887144 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01bc0ab600 con 0x7f01c0156200 2023-11-28T20:00:47.715 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:47.709+0000 7f01c49cc640 1 -- 172.21.15.78:0/3257887144 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f01bc0a7050 con 0x7f01c0156200 2023-11-28T20:00:47.715 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:47.709+0000 7f01c49cc640 1 -- 172.21.15.78:0/3257887144 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01bc0ab960 con 0x7f01c0156200 2023-11-28T20:00:47.716 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:47.709+0000 7f01c7c32640 1 -- 172.21.15.78:0/3257887144 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f01c0156200 msgr2=0x7f01c00c0370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:00:47.716 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:47.709+0000 7f01c7c32640 1 --2- 172.21.15.78:0/3257887144 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f01c0156200 0x7f01c00c0370 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f01bc0097f0 tx=0x7f01bc01c370 comp rx=0 tx=0).stop 2023-11-28T20:00:47.716 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:47.709+0000 7f01c7c32640 1 -- 172.21.15.78:0/3257887144 shutdown_connections 2023-11-28T20:00:47.716 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:47.709+0000 7f01c7c32640 1 --2- 172.21.15.78:0/3257887144 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f01c0156200 0x7f01c00c0370 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:47.716 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:47.709+0000 7f01c7c32640 1 -- 172.21.15.78:0/3257887144 >> 172.21.15.78:0/3257887144 conn(0x7f01c00c59f0 msgr2=0x7f01c00c5e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:00:47.716 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:47.709+0000 7f01c7c32640 1 -- 172.21.15.78:0/3257887144 shutdown_connections 2023-11-28T20:00:47.716 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:47.713+0000 7f01c7c32640 1 -- 172.21.15.78:0/3257887144 wait complete. 2023-11-28T20:00:47.717 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:47.713+0000 7f01c7c32640 1 Processor -- start 2023-11-28T20:00:47.717 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:47.713+0000 7f01c7c32640 1 -- start start 2023-11-28T20:00:47.719 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:47.713+0000 7f01c7c32640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f01c00c0e10 0x7f01c01f4b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:47.719 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:47.713+0000 7f01c7c32640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f01c0156200 0x7f01c0158f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:47.719 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:47.713+0000 7f01c7c32640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f01c015bf70 0x7f01c01540d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:47.719 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:47.713+0000 7f01c7c32640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01c014c2d0 con 0x7f01c0156200 2023-11-28T20:00:47.720 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:47.713+0000 7f01c7c32640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01c00a9130 con 0x7f01c015bf70 2023-11-28T20:00:47.720 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:47.713+0000 7f01c7c32640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f01c0156db0 con 0x7f01c00c0e10 2023-11-28T20:00:47.720 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:47.713+0000 7f01c51cd640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f01c0156200 0x7f01c0158f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:47.720 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:47.713+0000 7f01c51cd640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f01c0156200 0x7f01c0158f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:39900/0 (socket says 172.21.15.78:39900) 2023-11-28T20:00:47.720 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:47.713+0000 7f01c51cd640 1 -- 172.21.15.78:0/109007588 learned_addr learned my addr 172.21.15.78:0/109007588 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T20:00:47.720 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:47.713+0000 7f01c51cd640 1 -- 172.21.15.78:0/109007588 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f01c00c0e10 msgr2=0x7f01c01f4b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:00:47.720 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:47.713+0000 7f01c51cd640 1 --2- 172.21.15.78:0/109007588 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f01c00c0e10 0x7f01c01f4b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:47.720 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:47.713+0000 7f01c51cd640 1 -- 172.21.15.78:0/109007588 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f01c015bf70 msgr2=0x7f01c01540d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:00:47.720 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:47.713+0000 7f01c51cd640 1 --2- 172.21.15.78:0/109007588 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f01c015bf70 0x7f01c01540d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:47.720 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:47.713+0000 7f01c51cd640 1 -- 172.21.15.78:0/109007588 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01bc009420 con 0x7f01c0156200 2023-11-28T20:00:47.720 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:47.713+0000 7f01c51cd640 1 --2- 172.21.15.78:0/109007588 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f01c0156200 0x7f01c0158f90 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f01b000c430 tx=0x7f01b000c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:00:47.721 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:47.713+0000 7f01b67fc640 1 -- 172.21.15.78:0/109007588 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01b00052d0 con 0x7f01c0156200 2023-11-28T20:00:47.721 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:47.713+0000 7f01b67fc640 1 -- 172.21.15.78:0/109007588 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f01b0005450 con 0x7f01c0156200 2023-11-28T20:00:47.721 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:47.713+0000 7f01b67fc640 1 -- 172.21.15.78:0/109007588 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01b0003840 con 0x7f01c0156200 2023-11-28T20:00:47.721 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:47.713+0000 7f01c7c32640 1 -- 172.21.15.78:0/109007588 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f01c0156830 con 0x7f01c0156200 2023-11-28T20:00:47.721 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:47.713+0000 7f01c7c32640 1 -- 172.21.15.78:0/109007588 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f01c00a8dc0 con 0x7f01c0156200 2023-11-28T20:00:47.722 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:47.717+0000 7f01c7c32640 1 -- 172.21.15.78:0/109007588 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f01c0067630 con 0x7f01c0156200 2023-11-28T20:00:47.722 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:47.717+0000 7f01b67fc640 1 -- 172.21.15.78:0/109007588 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f01b00039a0 con 0x7f01c0156200 2023-11-28T20:00:47.723 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:47.717+0000 7f01b67fc640 1 --2- 172.21.15.78:0/109007588 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f01a4066470 0x7f01a4068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:47.723 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:47.717+0000 7f01b67fc640 1 -- 172.21.15.78:0/109007588 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 6972+0+0 (secure 0 0 0) 0x7f01b0083970 con 0x7f01c0156200 2023-11-28T20:00:47.723 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:47.717+0000 7f01c59ce640 1 --2- 172.21.15.78:0/109007588 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f01a4066470 0x7f01a4068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:47.723 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:47.717+0000 7f01c59ce640 1 --2- 172.21.15.78:0/109007588 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f01a4066470 0x7f01a4068930 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f01bc0ad000 tx=0x7f01bc004740 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:00:47.726 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:47.721+0000 7f01b67fc640 1 -- 172.21.15.78:0/109007588 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f01b00508f0 con 0x7f01c0156200 2023-11-28T20:00:47.881 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:47.877+0000 7f01c7c32640 1 -- 172.21.15.78:0/109007588 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f01c00a9270 con 0x7f01c0156200 2023-11-28T20:00:47.881 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:47.877+0000 7f01b67fc640 1 -- 172.21.15.78:0/109007588 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v46) v1 ==== 104+0+11 (secure 0 0 0) 0x7f01b0053f10 con 0x7f01c0156200 2023-11-28T20:00:47.881 INFO:teuthology.orchestra.run.smithi078.stdout:pg_num: 32 2023-11-28T20:00:47.883 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:47.877+0000 7f01c7c32640 1 -- 172.21.15.78:0/109007588 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f01a4066470 msgr2=0x7f01a4068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:00:47.883 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:47.877+0000 7f01c7c32640 1 --2- 172.21.15.78:0/109007588 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f01a4066470 0x7f01a4068930 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f01bc0ad000 tx=0x7f01bc004740 comp rx=0 tx=0).stop 2023-11-28T20:00:47.883 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:47.877+0000 7f01c7c32640 1 -- 172.21.15.78:0/109007588 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f01c0156200 msgr2=0x7f01c0158f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:00:47.884 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:47.877+0000 7f01c7c32640 1 --2- 172.21.15.78:0/109007588 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f01c0156200 0x7f01c0158f90 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f01b000c430 tx=0x7f01b000c8f0 comp rx=0 tx=0).stop 2023-11-28T20:00:47.884 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:47.877+0000 7f01c7c32640 1 -- 172.21.15.78:0/109007588 shutdown_connections 2023-11-28T20:00:47.884 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:47.877+0000 7f01c7c32640 1 --2- 172.21.15.78:0/109007588 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f01a4066470 0x7f01a4068930 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:47.884 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:47.877+0000 7f01c7c32640 1 --2- 172.21.15.78:0/109007588 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f01c015bf70 0x7f01c01540d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:47.884 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:47.877+0000 7f01c7c32640 1 --2- 172.21.15.78:0/109007588 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f01c0156200 0x7f01c0158f90 unknown :-1 s=CLOSED pgs=509 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:47.884 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:47.877+0000 7f01c7c32640 1 --2- 172.21.15.78:0/109007588 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f01c00c0e10 0x7f01c01f4b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:47.884 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:47.877+0000 7f01c7c32640 1 -- 172.21.15.78:0/109007588 >> 172.21.15.78:0/109007588 conn(0x7f01c00c59f0 msgr2=0x7f01c015ab80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:00:47.884 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:47.877+0000 7f01c7c32640 1 -- 172.21.15.78:0/109007588 shutdown_connections 2023-11-28T20:00:47.884 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:47.877+0000 7f01c7c32640 1 -- 172.21.15.78:0/109007588 wait complete. 2023-11-28T20:00:47.902 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-28T20:00:48.044 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:48.041+0000 7f5788916640 1 Processor -- start 2023-11-28T20:00:48.044 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:48.041+0000 7f5788916640 1 -- start start 2023-11-28T20:00:48.045 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:48.041+0000 7f5788916640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f57841516a0 0x7f57840c4180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:48.045 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:48.041+0000 7f5788916640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5784151b20 con 0x7f57840c46c0 2023-11-28T20:00:48.045 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:48.041+0000 7f5788916640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5784151210 con 0x7f578414e2a0 2023-11-28T20:00:48.045 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:48.041+0000 7f5788916640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f578414e680 con 0x7f57841516a0 2023-11-28T20:00:48.046 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:48.041+0000 7f5782d9d640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f57840c46c0 0x7f578406bc80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:36576/0 (socket says 172.21.15.78:36576) 2023-11-28T20:00:48.046 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:48.041+0000 7f5782d9d640 1 -- 172.21.15.78:0/928003001 learned_addr learned my addr 172.21.15.78:0/928003001 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-11-28T20:00:48.047 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:48.041+0000 7f5781d9b640 1 --2- 172.21.15.78:0/928003001 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f57841516a0 0x7f57840c4180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:48.048 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:48.041+0000 7f578159a640 1 -- 172.21.15.78:0/928003001 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2350863698 0 0) 0x7f577c0014a0 con 0x7f57840c46c0 2023-11-28T20:00:48.048 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:48.041+0000 7f578159a640 1 -- 172.21.15.78:0/928003001 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f576c003450 con 0x7f57840c46c0 2023-11-28T20:00:48.048 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:48.041+0000 7f578159a640 1 -- 172.21.15.78:0/928003001 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1380364036 0 0) 0x7f5784151210 con 0x7f578414e2a0 2023-11-28T20:00:48.048 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:48.041+0000 7f578159a640 1 -- 172.21.15.78:0/928003001 --> v1:172.21.15.179:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f577c0014a0 con 0x7f578414e2a0 2023-11-28T20:00:48.048 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:48.041+0000 7f578159a640 1 -- 172.21.15.78:0/928003001 <== mon.0 v1:172.21.15.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 748923005 0 0) 0x7f576c003450 con 0x7f57840c46c0 2023-11-28T20:00:48.048 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:48.041+0000 7f578159a640 1 -- 172.21.15.78:0/928003001 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f57841516a0 msgr2=0x7f57840c4180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:00:48.048 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:48.041+0000 7f578159a640 1 --2- 172.21.15.78:0/928003001 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f57841516a0 0x7f57840c4180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:48.048 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:48.041+0000 7f578159a640 1 -- 172.21.15.78:0/928003001 >> v1:172.21.15.179:6789/0 conn(0x7f578414e2a0 legacy=0x7f57840a9460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:00:48.048 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:48.041+0000 7f578159a640 1 -- 172.21.15.78:0/928003001 --> v1:172.21.15.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57840a9b70 con 0x7f57840c46c0 2023-11-28T20:00:48.048 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:48.041+0000 7f578159a640 1 -- 172.21.15.78:0/928003001 <== mon.0 v1:172.21.15.78:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3326804700 0 0) 0x7f577c001b90 con 0x7f57840c46c0 2023-11-28T20:00:48.048 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:48.041+0000 7f578159a640 1 -- 172.21.15.78:0/928003001 >> v1:172.21.15.78:6789/0 conn(0x7f57840c46c0 legacy=0x7f578406bc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:00:48.048 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:48.041+0000 7f578159a640 1 --2- 172.21.15.78:0/928003001 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f57841516a0 0x7f576c003c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:48.049 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:48.041+0000 7f578159a640 1 --2- 172.21.15.78:0/928003001 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f576c008860 0x7f576c00ac50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:48.049 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:48.041+0000 7f578159a640 1 --2- 172.21.15.78:0/928003001 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f576c00b190 0x7f576c00d580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:48.049 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:48.041+0000 7f578159a640 1 -- 172.21.15.78:0/928003001 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f578414e680 con 0x7f576c00b190 2023-11-28T20:00:48.049 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:48.041+0000 7f578159a640 1 -- 172.21.15.78:0/928003001 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f576c00dc80 con 0x7f576c008860 2023-11-28T20:00:48.049 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:48.041+0000 7f578159a640 1 -- 172.21.15.78:0/928003001 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f576c00de40 con 0x7f57841516a0 2023-11-28T20:00:48.049 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:48.041+0000 7f5782d9d640 1 --2- 172.21.15.78:0/928003001 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f576c00b190 0x7f576c00d580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:48.050 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:48.041+0000 7f5781d9b640 1 --2- 172.21.15.78:0/928003001 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f576c008860 0x7f576c00ac50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:48.050 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:48.041+0000 7f578259c640 1 --2- 172.21.15.78:0/928003001 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f57841516a0 0x7f576c003c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:48.050 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:48.041+0000 7f5782d9d640 1 -- 172.21.15.78:0/928003001 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f57841516a0 msgr2=0x7f576c003c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:00:48.050 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:48.041+0000 7f5782d9d640 1 --2- 172.21.15.78:0/928003001 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f57841516a0 0x7f576c003c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:48.050 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:48.041+0000 7f5782d9d640 1 -- 172.21.15.78:0/928003001 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f576c008860 msgr2=0x7f576c00ac50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:00:48.051 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:48.041+0000 7f5782d9d640 1 --2- 172.21.15.78:0/928003001 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f576c008860 0x7f576c00ac50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:48.051 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:48.041+0000 7f5782d9d640 1 -- 172.21.15.78:0/928003001 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f576c003450 con 0x7f576c00b190 2023-11-28T20:00:48.053 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:48.045+0000 7f5782d9d640 1 --2- 172.21.15.78:0/928003001 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f576c00b190 0x7f576c00d580 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f577c00a790 tx=0x7f577c01f9e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5e131e7efa2334ce server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:00:48.053 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:48.045+0000 7f578159a640 1 -- 172.21.15.78:0/928003001 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f577c0aa610 con 0x7f576c00b190 2023-11-28T20:00:48.053 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:48.045+0000 7f578159a640 1 -- 172.21.15.78:0/928003001 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f577c0aa770 con 0x7f576c00b190 2023-11-28T20:00:48.054 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:48.045+0000 7f578159a640 1 -- 172.21.15.78:0/928003001 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f577c0aab60 con 0x7f576c00b190 2023-11-28T20:00:48.054 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:48.045+0000 7f5788916640 1 -- 172.21.15.78:0/928003001 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f576c00b190 msgr2=0x7f576c00d580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:00:48.054 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:48.045+0000 7f5788916640 1 --2- 172.21.15.78:0/928003001 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f576c00b190 0x7f576c00d580 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f577c00a790 tx=0x7f577c01f9e0 comp rx=0 tx=0).stop 2023-11-28T20:00:48.054 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:48.045+0000 7f5782d9d640 1 -- 172.21.15.78:0/928003001 reap_dead start 2023-11-28T20:00:48.054 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:48.045+0000 7f5788916640 1 -- 172.21.15.78:0/928003001 shutdown_connections 2023-11-28T20:00:48.054 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:48.045+0000 7f5788916640 1 -- 172.21.15.78:0/928003001 >> 172.21.15.78:0/928003001 conn(0x7f57840c59f0 msgr2=0x7f57840c5e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:00:48.054 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:48.045+0000 7f5788916640 1 -- 172.21.15.78:0/928003001 shutdown_connections 2023-11-28T20:00:48.055 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:48.045+0000 7f5788916640 1 -- 172.21.15.78:0/928003001 wait complete. 2023-11-28T20:00:48.055 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:48.049+0000 7f5788916640 1 Processor -- start 2023-11-28T20:00:48.055 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:48.049+0000 7f5788916640 1 -- start start 2023-11-28T20:00:48.057 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:48.049+0000 7f5788916640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f576c00b190 0x7f578414f890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:48.057 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:48.049+0000 7f5788916640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5784145c70 0x7f57841df3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:48.057 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:48.049+0000 7f5788916640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f57840c1dc0 0x7f57841df920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:48.057 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:48.049+0000 7f5788916640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57841edd80 con 0x7f57840c1dc0 2023-11-28T20:00:48.057 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:48.049+0000 7f5788916640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5784072ae0 con 0x7f5784145c70 2023-11-28T20:00:48.057 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:48.049+0000 7f5788916640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f57840725b0 con 0x7f576c00b190 2023-11-28T20:00:48.058 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:48.049+0000 7f5782d9d640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f57840c1dc0 0x7f57841df920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:48.058 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:48.049+0000 7f5782d9d640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f57840c1dc0 0x7f57841df920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:39916/0 (socket says 172.21.15.78:39916) 2023-11-28T20:00:48.058 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:48.049+0000 7f5782d9d640 1 -- 172.21.15.78:0/26864003 learned_addr learned my addr 172.21.15.78:0/26864003 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T20:00:48.058 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:48.049+0000 7f578259c640 1 --2- 172.21.15.78:0/26864003 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f576c00b190 0x7f578414f890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:48.058 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:48.049+0000 7f5781d9b640 1 --2- 172.21.15.78:0/26864003 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5784145c70 0x7f57841df3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:48.058 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:48.049+0000 7f5782d9d640 1 -- 172.21.15.78:0/26864003 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f576c00b190 msgr2=0x7f578414f890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:00:48.058 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:48.049+0000 7f5782d9d640 1 --2- 172.21.15.78:0/26864003 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f576c00b190 0x7f578414f890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:48.058 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:48.049+0000 7f5782d9d640 1 -- 172.21.15.78:0/26864003 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5784145c70 msgr2=0x7f57841df3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:00:48.058 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:48.049+0000 7f5782d9d640 1 --2- 172.21.15.78:0/26864003 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5784145c70 0x7f57841df3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:48.058 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:48.049+0000 7f5782d9d640 1 -- 172.21.15.78:0/26864003 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f578406fda0 con 0x7f57840c1dc0 2023-11-28T20:00:48.059 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:48.049+0000 7f5781d9b640 1 --2- 172.21.15.78:0/26864003 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5784145c70 0x7f57841df3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T20:00:48.059 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:48.049+0000 7f5782d9d640 1 --2- 172.21.15.78:0/26864003 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f57840c1dc0 0x7f57841df920 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f577c020280 tx=0x7f577c01c780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:00:48.059 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:48.049+0000 7f5772ffd640 1 -- 172.21.15.78:0/26864003 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f577c0aa610 con 0x7f57840c1dc0 2023-11-28T20:00:48.059 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:48.049+0000 7f5772ffd640 1 -- 172.21.15.78:0/26864003 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f577c0020d0 con 0x7f57840c1dc0 2023-11-28T20:00:48.059 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:48.049+0000 7f5772ffd640 1 -- 172.21.15.78:0/26864003 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f577c0aab00 con 0x7f57840c1dc0 2023-11-28T20:00:48.059 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:48.049+0000 7f5788916640 1 -- 172.21.15.78:0/26864003 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5784072800 con 0x7f57840c1dc0 2023-11-28T20:00:48.059 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:48.049+0000 7f5788916640 1 -- 172.21.15.78:0/26864003 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f57840c1b60 con 0x7f57840c1dc0 2023-11-28T20:00:48.059 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:48.053+0000 7f5788916640 1 -- 172.21.15.78:0/26864003 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f57840c16e0 con 0x7f57840c1dc0 2023-11-28T20:00:48.059 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:48.053+0000 7f5772ffd640 1 -- 172.21.15.78:0/26864003 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f577c0aac60 con 0x7f57840c1dc0 2023-11-28T20:00:48.060 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:48.053+0000 7f5772ffd640 1 --2- 172.21.15.78:0/26864003 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f5764066470 0x7f5764068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:48.060 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:48.053+0000 7f5772ffd640 1 -- 172.21.15.78:0/26864003 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 6972+0+0 (secure 0 0 0) 0x7f577c121900 con 0x7f57840c1dc0 2023-11-28T20:00:48.060 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:48.053+0000 7f578259c640 1 --2- 172.21.15.78:0/26864003 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f5764066470 0x7f5764068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:48.061 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:48.053+0000 7f578259c640 1 --2- 172.21.15.78:0/26864003 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f5764066470 0x7f5764068930 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f5774007fd0 tx=0x7f5774009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:00:48.062 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:48.057+0000 7f5772ffd640 1 -- 172.21.15.78:0/26864003 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f57840c16e0 con 0x7f57840c1dc0 2023-11-28T20:00:48.212 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:48.209+0000 7f5788916640 1 -- 172.21.15.78:0/26864003 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f57840c16e0 con 0x7f57840c1dc0 2023-11-28T20:00:48.212 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:48.209+0000 7f5772ffd640 1 -- 172.21.15.78:0/26864003 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v46) v1 ==== 100+0+11 (secure 0 0 0) 0x7f57840c16e0 con 0x7f57840c1dc0 2023-11-28T20:00:48.213 INFO:teuthology.orchestra.run.smithi078.stdout:pg_num: 64 2023-11-28T20:00:48.214 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:48.209+0000 7f5788916640 1 -- 172.21.15.78:0/26864003 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f5764066470 msgr2=0x7f5764068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:00:48.214 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:48.209+0000 7f5788916640 1 --2- 172.21.15.78:0/26864003 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f5764066470 0x7f5764068930 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f5774007fd0 tx=0x7f5774009040 comp rx=0 tx=0).stop 2023-11-28T20:00:48.215 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:48.209+0000 7f5788916640 1 -- 172.21.15.78:0/26864003 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f57840c1dc0 msgr2=0x7f57841df920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:00:48.215 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:48.209+0000 7f5788916640 1 --2- 172.21.15.78:0/26864003 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f57840c1dc0 0x7f57841df920 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f577c020280 tx=0x7f577c01c780 comp rx=0 tx=0).stop 2023-11-28T20:00:48.215 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:48.209+0000 7f5788916640 1 -- 172.21.15.78:0/26864003 shutdown_connections 2023-11-28T20:00:48.215 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:48.209+0000 7f5788916640 1 --2- 172.21.15.78:0/26864003 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f5764066470 0x7f5764068930 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:48.215 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:48.209+0000 7f5788916640 1 --2- 172.21.15.78:0/26864003 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f57840c1dc0 0x7f57841df920 unknown :-1 s=CLOSED pgs=512 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:48.215 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:48.209+0000 7f5788916640 1 --2- 172.21.15.78:0/26864003 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5784145c70 0x7f57841df3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:48.215 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:48.209+0000 7f5788916640 1 --2- 172.21.15.78:0/26864003 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f576c00b190 0x7f578414f890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:48.215 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:48.209+0000 7f5788916640 1 -- 172.21.15.78:0/26864003 >> 172.21.15.78:0/26864003 conn(0x7f57840c59f0 msgr2=0x7f57840bf5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:00:48.215 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:48.209+0000 7f5788916640 1 -- 172.21.15.78:0/26864003 shutdown_connections 2023-11-28T20:00:48.215 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:48.209+0000 7f5788916640 1 -- 172.21.15.78:0/26864003 wait complete. 2023-11-28T20:00:48.233 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs2_metadata pg_num 2023-11-28T20:00:48.375 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:48.369+0000 7f2328cc9640 1 Processor -- start 2023-11-28T20:00:48.376 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:48.369+0000 7f2328cc9640 1 -- start start 2023-11-28T20:00:48.377 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:48.373+0000 7f2328cc9640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f2324155310 0x7f2324158590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:48.377 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:48.373+0000 7f2328cc9640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f23240c5f60 0x7f23240c4330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:48.377 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:48.373+0000 7f2328cc9640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f23240c4870 0x7f23240c6ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:48.377 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:48.373+0000 7f2328cc9640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f23240c4c90 con 0x7f23240c5f60 2023-11-28T20:00:48.377 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:48.373+0000 7f2328cc9640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f23240c6a10 con 0x7f2324155310 2023-11-28T20:00:48.378 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:48.373+0000 7f2328cc9640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23240c2740 con 0x7f23240c4870 2023-11-28T20:00:48.378 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:48.373+0000 7f2319d9b640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f23240c5f60 0x7f23240c4330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:48.378 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:48.373+0000 7f2319d9b640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f23240c5f60 0x7f23240c4330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:39922/0 (socket says 172.21.15.78:39922) 2023-11-28T20:00:48.378 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:48.373+0000 7f2319d9b640 1 -- 172.21.15.78:0/3494495378 learned_addr learned my addr 172.21.15.78:0/3494495378 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T20:00:48.378 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:48.373+0000 7f232259c640 1 --2- 172.21.15.78:0/3494495378 >> v2:172.21.15.179:3300/0 conn(0x7f2324155310 0x7f2324158590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:48.378 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:48.373+0000 7f2322d9d640 1 --2- 172.21.15.78:0/3494495378 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f23240c4870 0x7f23240c6ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:48.378 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:48.373+0000 7f2319d9b640 1 -- 172.21.15.78:0/3494495378 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f23240c4870 msgr2=0x7f23240c6ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:00:48.378 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:48.373+0000 7f2319d9b640 1 --2- 172.21.15.78:0/3494495378 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f23240c4870 0x7f23240c6ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:48.378 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:48.373+0000 7f2319d9b640 1 -- 172.21.15.78:0/3494495378 >> v2:172.21.15.179:3300/0 conn(0x7f2324155310 msgr2=0x7f2324158590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:00:48.378 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:48.373+0000 7f2319d9b640 1 --2- 172.21.15.78:0/3494495378 >> v2:172.21.15.179:3300/0 conn(0x7f2324155310 0x7f2324158590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:48.378 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:48.373+0000 7f2319d9b640 1 -- 172.21.15.78:0/3494495378 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2324158ad0 con 0x7f23240c5f60 2023-11-28T20:00:48.380 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:48.377+0000 7f2319d9b640 1 --2- 172.21.15.78:0/3494495378 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f23240c5f60 0x7f23240c4330 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f2324070f20 tx=0x7f230c01c500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=db5b6751ae4e4533 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:00:48.380 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:48.377+0000 7f2321d9b640 1 -- 172.21.15.78:0/3494495378 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f230c0aa620 con 0x7f23240c5f60 2023-11-28T20:00:48.380 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:48.377+0000 7f2321d9b640 1 -- 172.21.15.78:0/3494495378 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f230c0aa780 con 0x7f23240c5f60 2023-11-28T20:00:48.381 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:48.377+0000 7f2321d9b640 1 -- 172.21.15.78:0/3494495378 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f230c0aab10 con 0x7f23240c5f60 2023-11-28T20:00:48.381 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:48.377+0000 7f2328cc9640 1 -- 172.21.15.78:0/3494495378 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f23240c5f60 msgr2=0x7f23240c4330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:00:48.381 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:48.377+0000 7f2328cc9640 1 --2- 172.21.15.78:0/3494495378 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f23240c5f60 0x7f23240c4330 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f2324070f20 tx=0x7f230c01c500 comp rx=0 tx=0).stop 2023-11-28T20:00:48.381 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:48.377+0000 7f2328cc9640 1 -- 172.21.15.78:0/3494495378 shutdown_connections 2023-11-28T20:00:48.382 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:48.377+0000 7f2328cc9640 1 --2- 172.21.15.78:0/3494495378 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f23240c4870 0x7f23240c6ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:48.382 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:48.377+0000 7f2328cc9640 1 --2- 172.21.15.78:0/3494495378 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f23240c5f60 0x7f23240c4330 unknown :-1 s=CLOSED pgs=513 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:48.382 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:48.377+0000 7f2328cc9640 1 --2- 172.21.15.78:0/3494495378 >> v2:172.21.15.179:3300/0 conn(0x7f2324155310 0x7f2324158590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:48.382 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:48.377+0000 7f2328cc9640 1 -- 172.21.15.78:0/3494495378 >> 172.21.15.78:0/3494495378 conn(0x7f23240a9830 msgr2=0x7f23240a9c40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:00:48.382 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:48.377+0000 7f2328cc9640 1 -- 172.21.15.78:0/3494495378 shutdown_connections 2023-11-28T20:00:48.382 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:48.377+0000 7f2328cc9640 1 -- 172.21.15.78:0/3494495378 wait complete. 2023-11-28T20:00:48.383 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:48.377+0000 7f2328cc9640 1 Processor -- start 2023-11-28T20:00:48.383 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:48.377+0000 7f2328cc9640 1 -- start start 2023-11-28T20:00:48.385 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:48.381+0000 7f2328cc9640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f23240c4870 0x7f23240a80d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:48.385 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:48.381+0000 7f2328cc9640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f23240c5f60 0x7f232406f520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:48.385 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:48.381+0000 7f2328cc9640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2324155310 0x7f232415d270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:48.386 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:48.381+0000 7f2328cc9640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23240a8610 con 0x7f23240c5f60 2023-11-28T20:00:48.386 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:48.381+0000 7f2328cc9640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f232415ce20 con 0x7f2324155310 2023-11-28T20:00:48.386 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:48.381+0000 7f2328cc9640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2324159000 con 0x7f23240c4870 2023-11-28T20:00:48.386 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:48.381+0000 7f2319d9b640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f23240c5f60 0x7f232406f520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:48.386 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:48.381+0000 7f2319d9b640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f23240c5f60 0x7f232406f520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:39932/0 (socket says 172.21.15.78:39932) 2023-11-28T20:00:48.386 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:48.381+0000 7f2319d9b640 1 -- 172.21.15.78:0/2105227923 learned_addr learned my addr 172.21.15.78:0/2105227923 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T20:00:48.386 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:48.381+0000 7f232259c640 1 --2- 172.21.15.78:0/2105227923 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f23240c4870 0x7f23240a80d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:48.386 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:48.381+0000 7f2322d9d640 1 --2- 172.21.15.78:0/2105227923 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2324155310 0x7f232415d270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:48.386 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:48.381+0000 7f2319d9b640 1 -- 172.21.15.78:0/2105227923 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f23240c4870 msgr2=0x7f23240a80d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:00:48.386 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:48.381+0000 7f2319d9b640 1 --2- 172.21.15.78:0/2105227923 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f23240c4870 0x7f23240a80d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:48.386 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:48.381+0000 7f2319d9b640 1 -- 172.21.15.78:0/2105227923 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2324155310 msgr2=0x7f232415d270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:00:48.386 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:48.381+0000 7f2319d9b640 1 --2- 172.21.15.78:0/2105227923 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2324155310 0x7f232415d270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:48.387 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:48.381+0000 7f2319d9b640 1 -- 172.21.15.78:0/2105227923 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f230c0094d0 con 0x7f23240c5f60 2023-11-28T20:00:48.387 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:48.381+0000 7f2322d9d640 1 --2- 172.21.15.78:0/2105227923 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2324155310 0x7f232415d270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T20:00:48.387 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:48.381+0000 7f2319d9b640 1 --2- 172.21.15.78:0/2105227923 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f23240c5f60 0x7f232406f520 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f230c01abb0 tx=0x7f230c01ad40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:00:48.387 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:48.381+0000 7f231b7fe640 1 -- 172.21.15.78:0/2105227923 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f230c0bd5f0 con 0x7f23240c5f60 2023-11-28T20:00:48.387 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:48.381+0000 7f231b7fe640 1 -- 172.21.15.78:0/2105227923 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f230c0bd750 con 0x7f23240c5f60 2023-11-28T20:00:48.387 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:48.381+0000 7f2328cc9640 1 -- 172.21.15.78:0/2105227923 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f23241592a0 con 0x7f23240c5f60 2023-11-28T20:00:48.387 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:48.381+0000 7f231b7fe640 1 -- 172.21.15.78:0/2105227923 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f230c0bdac0 con 0x7f23240c5f60 2023-11-28T20:00:48.387 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:48.381+0000 7f2328cc9640 1 -- 172.21.15.78:0/2105227923 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f23241f0e10 con 0x7f23240c5f60 2023-11-28T20:00:48.388 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:48.381+0000 7f2328cc9640 1 -- 172.21.15.78:0/2105227923 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2324067630 con 0x7f23240c5f60 2023-11-28T20:00:48.388 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:48.381+0000 7f231b7fe640 1 -- 172.21.15.78:0/2105227923 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f230c0b33f0 con 0x7f23240c5f60 2023-11-28T20:00:48.388 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:48.385+0000 7f231b7fe640 1 --2- 172.21.15.78:0/2105227923 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f2304066470 0x7f2304068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:48.388 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:48.385+0000 7f231b7fe640 1 -- 172.21.15.78:0/2105227923 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 6972+0+0 (secure 0 0 0) 0x7f230c11f220 con 0x7f23240c5f60 2023-11-28T20:00:48.388 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:48.385+0000 7f232259c640 1 --2- 172.21.15.78:0/2105227923 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f2304066470 0x7f2304068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:48.389 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:48.385+0000 7f232259c640 1 --2- 172.21.15.78:0/2105227923 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f2304066470 0x7f2304068930 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f23240aa870 tx=0x7f2314009830 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:00:48.392 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:48.389+0000 7f231b7fe640 1 -- 172.21.15.78:0/2105227923 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f230c0ec250 con 0x7f23240c5f60 2023-11-28T20:00:48.540 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:48.537+0000 7f2328cc9640 1 -- 172.21.15.78:0/2105227923 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs2_metadata", "var": "pg_num"} v 0) v1 -- 0x7f23240c5d40 con 0x7f23240c5f60 2023-11-28T20:00:48.540 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:48.537+0000 7f231b7fe640 1 -- 172.21.15.78:0/2105227923 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs2_metadata", "var": "pg_num"}]=0 v46) v1 ==== 105+0+11 (secure 0 0 0) 0x7f230c0ef870 con 0x7f23240c5f60 2023-11-28T20:00:48.541 INFO:teuthology.orchestra.run.smithi078.stdout:pg_num: 32 2023-11-28T20:00:48.542 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:48.537+0000 7f2328cc9640 1 -- 172.21.15.78:0/2105227923 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f2304066470 msgr2=0x7f2304068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:00:48.543 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:48.537+0000 7f2328cc9640 1 --2- 172.21.15.78:0/2105227923 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f2304066470 0x7f2304068930 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f23240aa870 tx=0x7f2314009830 comp rx=0 tx=0).stop 2023-11-28T20:00:48.543 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:48.537+0000 7f2328cc9640 1 -- 172.21.15.78:0/2105227923 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f23240c5f60 msgr2=0x7f232406f520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:00:48.543 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:48.537+0000 7f2328cc9640 1 --2- 172.21.15.78:0/2105227923 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f23240c5f60 0x7f232406f520 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f230c01abb0 tx=0x7f230c01ad40 comp rx=0 tx=0).stop 2023-11-28T20:00:48.543 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:48.537+0000 7f2328cc9640 1 -- 172.21.15.78:0/2105227923 shutdown_connections 2023-11-28T20:00:48.543 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:48.537+0000 7f2328cc9640 1 --2- 172.21.15.78:0/2105227923 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f2304066470 0x7f2304068930 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:48.543 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:48.537+0000 7f2328cc9640 1 --2- 172.21.15.78:0/2105227923 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2324155310 0x7f232415d270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:48.543 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:48.537+0000 7f2328cc9640 1 --2- 172.21.15.78:0/2105227923 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f23240c5f60 0x7f232406f520 unknown :-1 s=CLOSED pgs=514 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:48.543 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:48.537+0000 7f2328cc9640 1 --2- 172.21.15.78:0/2105227923 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f23240c4870 0x7f23240a80d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:48.543 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:48.537+0000 7f2328cc9640 1 -- 172.21.15.78:0/2105227923 >> 172.21.15.78:0/2105227923 conn(0x7f23240a9830 msgr2=0x7f232406c730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:00:48.543 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:48.537+0000 7f2328cc9640 1 -- 172.21.15.78:0/2105227923 shutdown_connections 2023-11-28T20:00:48.544 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:48.537+0000 7f2328cc9640 1 -- 172.21.15.78:0/2105227923 wait complete. 2023-11-28T20:00:48.561 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs2_data pg_num 2023-11-28T20:00:48.701 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:48.697+0000 7f238bff5640 1 Processor -- start 2023-11-28T20:00:48.701 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:48.697+0000 7f238bff5640 1 -- start start 2023-11-28T20:00:48.703 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:48.697+0000 7f238bff5640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f238414b1e0 0x7f23840c1700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:48.703 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:48.697+0000 7f238bff5640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f23840c5300 0x7f23840a9c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:48.703 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:48.697+0000 7f238bff5640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f2384151280 0x7f2384151710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:48.703 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:48.697+0000 7f238bff5640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f23840a4e20 con 0x7f238414b1e0 2023-11-28T20:00:48.703 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:48.697+0000 7f238bff5640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f23840a50e0 con 0x7f2384151280 2023-11-28T20:00:48.703 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:48.697+0000 7f238bff5640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23840c0f00 con 0x7f23840c5300 2023-11-28T20:00:48.703 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:48.697+0000 7f2389d91640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f238414b1e0 0x7f23840c1700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:48.704 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:48.697+0000 7f2389d91640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f238414b1e0 0x7f23840c1700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:39948/0 (socket says 172.21.15.78:39948) 2023-11-28T20:00:48.704 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:48.697+0000 7f2389d91640 1 -- 172.21.15.78:0/3207470357 learned_addr learned my addr 172.21.15.78:0/3207470357 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T20:00:48.704 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:48.697+0000 7f238a592640 1 --2- 172.21.15.78:0/3207470357 >> v2:172.21.15.179:3300/0 conn(0x7f2384151280 0x7f2384151710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:48.704 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:48.697+0000 7f2389590640 1 --2- 172.21.15.78:0/3207470357 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f23840c5300 0x7f23840a9c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:48.704 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:48.697+0000 7f2389d91640 1 -- 172.21.15.78:0/3207470357 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f23840c5300 msgr2=0x7f23840a9c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:00:48.704 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:48.697+0000 7f2389d91640 1 --2- 172.21.15.78:0/3207470357 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f23840c5300 0x7f23840a9c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:48.704 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:48.697+0000 7f2389d91640 1 -- 172.21.15.78:0/3207470357 >> v2:172.21.15.179:3300/0 conn(0x7f2384151280 msgr2=0x7f2384151710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:00:48.704 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:48.697+0000 7f2389d91640 1 --2- 172.21.15.78:0/3207470357 >> v2:172.21.15.179:3300/0 conn(0x7f2384151280 0x7f2384151710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:48.704 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:48.697+0000 7f2389d91640 1 -- 172.21.15.78:0/3207470357 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23840c11e0 con 0x7f238414b1e0 2023-11-28T20:00:48.704 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:48.697+0000 7f238a592640 1 --2- 172.21.15.78:0/3207470357 >> v2:172.21.15.179:3300/0 conn(0x7f2384151280 0x7f2384151710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T20:00:48.704 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:48.697+0000 7f2389590640 1 --2- 172.21.15.78:0/3207470357 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f23840c5300 0x7f23840a9c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T20:00:48.705 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:48.701+0000 7f2389d91640 1 --2- 172.21.15.78:0/3207470357 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f238414b1e0 0x7f23840c1700 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f23840c3b30 tx=0x7f238001ebd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3320878eecc61414 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:00:48.706 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:48.701+0000 7f2388d8f640 1 -- 172.21.15.78:0/3207470357 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23800a79f0 con 0x7f238414b1e0 2023-11-28T20:00:48.706 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:48.701+0000 7f2388d8f640 1 -- 172.21.15.78:0/3207470357 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f23800a7b50 con 0x7f238414b1e0 2023-11-28T20:00:48.706 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:48.701+0000 7f2388d8f640 1 -- 172.21.15.78:0/3207470357 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23800af440 con 0x7f238414b1e0 2023-11-28T20:00:48.707 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:48.701+0000 7f238bff5640 1 -- 172.21.15.78:0/3207470357 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f238414b1e0 msgr2=0x7f23840c1700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:00:48.707 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:48.701+0000 7f238bff5640 1 --2- 172.21.15.78:0/3207470357 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f238414b1e0 0x7f23840c1700 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f23840c3b30 tx=0x7f238001ebd0 comp rx=0 tx=0).stop 2023-11-28T20:00:48.707 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:48.701+0000 7f238bff5640 1 -- 172.21.15.78:0/3207470357 shutdown_connections 2023-11-28T20:00:48.707 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:48.701+0000 7f238bff5640 1 --2- 172.21.15.78:0/3207470357 >> v2:172.21.15.179:3300/0 conn(0x7f2384151280 0x7f2384151710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:48.707 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:48.701+0000 7f238bff5640 1 --2- 172.21.15.78:0/3207470357 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f23840c5300 0x7f23840a9c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:48.707 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:48.701+0000 7f238bff5640 1 --2- 172.21.15.78:0/3207470357 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f238414b1e0 0x7f23840c1700 unknown :-1 s=CLOSED pgs=515 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:48.707 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:48.701+0000 7f238bff5640 1 -- 172.21.15.78:0/3207470357 >> 172.21.15.78:0/3207470357 conn(0x7f23840c59f0 msgr2=0x7f23840c5e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:00:48.707 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:48.701+0000 7f238bff5640 1 -- 172.21.15.78:0/3207470357 shutdown_connections 2023-11-28T20:00:48.707 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:48.701+0000 7f238bff5640 1 -- 172.21.15.78:0/3207470357 wait complete. 2023-11-28T20:00:48.708 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:48.705+0000 7f238bff5640 1 Processor -- start 2023-11-28T20:00:48.708 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:48.705+0000 7f238bff5640 1 -- start start 2023-11-28T20:00:48.710 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:48.705+0000 7f238bff5640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f23840c5300 0x7f23841f04f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:48.710 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:48.705+0000 7f238bff5640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f238414b1e0 0x7f23840a64a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:48.710 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:48.705+0000 7f238bff5640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2384151280 0x7f23841ed5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:48.710 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:48.705+0000 7f238bff5640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23841ed190 con 0x7f2384151280 2023-11-28T20:00:48.710 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:48.705+0000 7f238bff5640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23841f0ad0 con 0x7f23840c5300 2023-11-28T20:00:48.710 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:48.705+0000 7f238bff5640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23841f0db0 con 0x7f238414b1e0 2023-11-28T20:00:48.711 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:48.705+0000 7f238a592640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2384151280 0x7f23841ed5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:48.711 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:48.705+0000 7f238a592640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2384151280 0x7f23841ed5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:39960/0 (socket says 172.21.15.78:39960) 2023-11-28T20:00:48.711 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:48.705+0000 7f238a592640 1 -- 172.21.15.78:0/4291469732 learned_addr learned my addr 172.21.15.78:0/4291469732 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T20:00:48.711 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:48.705+0000 7f2389590640 1 --2- 172.21.15.78:0/4291469732 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f238414b1e0 0x7f23840a64a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:48.711 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:48.705+0000 7f2389d91640 1 --2- 172.21.15.78:0/4291469732 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f23840c5300 0x7f23841f04f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:48.711 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:48.705+0000 7f238a592640 1 -- 172.21.15.78:0/4291469732 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f238414b1e0 msgr2=0x7f23840a64a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:00:48.711 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:48.705+0000 7f238a592640 1 --2- 172.21.15.78:0/4291469732 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f238414b1e0 0x7f23840a64a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:48.711 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:48.705+0000 7f238a592640 1 -- 172.21.15.78:0/4291469732 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f23840c5300 msgr2=0x7f23841f04f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:00:48.711 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:48.705+0000 7f238a592640 1 --2- 172.21.15.78:0/4291469732 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f23840c5300 0x7f23841f04f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:48.711 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:48.705+0000 7f238a592640 1 -- 172.21.15.78:0/4291469732 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f238000b770 con 0x7f2384151280 2023-11-28T20:00:48.711 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:48.705+0000 7f238a592640 1 --2- 172.21.15.78:0/4291469732 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2384151280 0x7f23841ed5b0 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f237c00cd50 tx=0x7f237c00a650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:00:48.712 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:48.705+0000 7f237a7fc640 1 -- 172.21.15.78:0/4291469732 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f237c00f680 con 0x7f2384151280 2023-11-28T20:00:48.712 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:48.705+0000 7f237a7fc640 1 -- 172.21.15.78:0/4291469732 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f237c00f800 con 0x7f2384151280 2023-11-28T20:00:48.712 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:48.705+0000 7f238bff5640 1 -- 172.21.15.78:0/4291469732 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f23841f1090 con 0x7f2384151280 2023-11-28T20:00:48.713 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:48.705+0000 7f237a7fc640 1 -- 172.21.15.78:0/4291469732 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f237c00fbb0 con 0x7f2384151280 2023-11-28T20:00:48.713 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:48.705+0000 7f238bff5640 1 -- 172.21.15.78:0/4291469732 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f238414f780 con 0x7f2384151280 2023-11-28T20:00:48.713 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:48.705+0000 7f238bff5640 1 -- 172.21.15.78:0/4291469732 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f23841ecf00 con 0x7f2384151280 2023-11-28T20:00:48.713 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:48.709+0000 7f237a7fc640 1 -- 172.21.15.78:0/4291469732 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f237c00b040 con 0x7f2384151280 2023-11-28T20:00:48.713 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:48.709+0000 7f237a7fc640 1 --2- 172.21.15.78:0/4291469732 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f2368066470 0x7f2368068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:48.714 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:48.709+0000 7f237a7fc640 1 -- 172.21.15.78:0/4291469732 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 6972+0+0 (secure 0 0 0) 0x7f237c084e00 con 0x7f2384151280 2023-11-28T20:00:48.714 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:48.709+0000 7f2389d91640 1 --2- 172.21.15.78:0/4291469732 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f2368066470 0x7f2368068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:48.714 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:48.709+0000 7f2389d91640 1 --2- 172.21.15.78:0/4291469732 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f2368066470 0x7f2368068930 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f23800b1000 tx=0x7f2380008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:00:48.717 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:48.713+0000 7f237a7fc640 1 -- 172.21.15.78:0/4291469732 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f237c051d80 con 0x7f2384151280 2023-11-28T20:00:48.876 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:48.869+0000 7f238bff5640 1 -- 172.21.15.78:0/4291469732 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs2_data", "var": "pg_num"} v 0) v1 -- 0x7f23840c3fc0 con 0x7f2384151280 2023-11-28T20:00:48.876 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:48.873+0000 7f237a7fc640 1 -- 172.21.15.78:0/4291469732 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs2_data", "var": "pg_num"}]=0 v46) v1 ==== 101+0+11 (secure 0 0 0) 0x7f237c01d020 con 0x7f2384151280 2023-11-28T20:00:48.877 INFO:teuthology.orchestra.run.smithi078.stdout:pg_num: 64 2023-11-28T20:00:48.879 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:48.873+0000 7f238bff5640 1 -- 172.21.15.78:0/4291469732 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f2368066470 msgr2=0x7f2368068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:00:48.879 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:48.873+0000 7f238bff5640 1 --2- 172.21.15.78:0/4291469732 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f2368066470 0x7f2368068930 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f23800b1000 tx=0x7f2380008040 comp rx=0 tx=0).stop 2023-11-28T20:00:48.879 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:48.873+0000 7f238bff5640 1 -- 172.21.15.78:0/4291469732 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2384151280 msgr2=0x7f23841ed5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:00:48.879 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:48.873+0000 7f238bff5640 1 --2- 172.21.15.78:0/4291469732 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2384151280 0x7f23841ed5b0 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f237c00cd50 tx=0x7f237c00a650 comp rx=0 tx=0).stop 2023-11-28T20:00:48.880 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:48.873+0000 7f238bff5640 1 -- 172.21.15.78:0/4291469732 shutdown_connections 2023-11-28T20:00:48.880 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:48.873+0000 7f238bff5640 1 --2- 172.21.15.78:0/4291469732 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f2368066470 0x7f2368068930 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:48.880 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:48.873+0000 7f238bff5640 1 --2- 172.21.15.78:0/4291469732 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f238414b1e0 0x7f23840a64a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:48.880 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:48.873+0000 7f238bff5640 1 --2- 172.21.15.78:0/4291469732 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2384151280 0x7f23841ed5b0 unknown :-1 s=CLOSED pgs=516 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:48.880 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:48.873+0000 7f238bff5640 1 --2- 172.21.15.78:0/4291469732 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f23840c5300 0x7f23841f04f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:48.880 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:48.873+0000 7f238bff5640 1 -- 172.21.15.78:0/4291469732 >> 172.21.15.78:0/4291469732 conn(0x7f23840c59f0 msgr2=0x7f23840bf800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:00:48.880 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:48.873+0000 7f238bff5640 1 -- 172.21.15.78:0/4291469732 shutdown_connections 2023-11-28T20:00:48.881 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:48.873+0000 7f238bff5640 1 -- 172.21.15.78:0/4291469732 wait complete. 2023-11-28T20:00:48.897 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-28T20:00:49.037 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:49.033+0000 7fde04b80640 1 Processor -- start 2023-11-28T20:00:49.037 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:49.033+0000 7fde04b80640 1 -- start start 2023-11-28T20:00:49.041 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:49.033+0000 7fde04b80640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fde000c59a0 0x7fde000c4da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:49.041 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:49.033+0000 7fde04b80640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fde000c62b0 con 0x7fde000bf690 2023-11-28T20:00:49.041 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:49.033+0000 7fde04b80640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fde001588d0 con 0x7fde000c49c0 2023-11-28T20:00:49.041 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:49.033+0000 7fde04b80640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde000c6590 con 0x7fde000c59a0 2023-11-28T20:00:49.041 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:49.033+0000 7fddf5d9b640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7fde000bf690 0x7fde000c8990 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:36578/0 (socket says 172.21.15.78:36578) 2023-11-28T20:00:49.041 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:49.033+0000 7fddf5d9b640 1 -- 172.21.15.78:0/1457773426 learned_addr learned my addr 172.21.15.78:0/1457773426 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-11-28T20:00:49.042 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:49.033+0000 7fddfdd9b640 1 -- 172.21.15.78:0/1457773426 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1301055492 0 0) 0x7fde000c62b0 con 0x7fde000bf690 2023-11-28T20:00:49.042 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:49.033+0000 7fddfed9d640 1 --2- 172.21.15.78:0/1457773426 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fde000c59a0 0x7fde000c4da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:49.042 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:49.033+0000 7fddfdd9b640 1 -- 172.21.15.78:0/1457773426 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fddec003530 con 0x7fde000bf690 2023-11-28T20:00:49.042 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:49.033+0000 7fddfdd9b640 1 -- 172.21.15.78:0/1457773426 <== mon.0 v1:172.21.15.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2834780411 0 0) 0x7fddec003530 con 0x7fde000bf690 2023-11-28T20:00:49.042 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:49.033+0000 7fddfdd9b640 1 -- 172.21.15.78:0/1457773426 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fde000c59a0 msgr2=0x7fde000c4da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:00:49.042 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:49.033+0000 7fddfdd9b640 1 --2- 172.21.15.78:0/1457773426 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fde000c59a0 0x7fde000c4da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:49.043 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:49.033+0000 7fddfdd9b640 1 -- 172.21.15.78:0/1457773426 >> v1:172.21.15.179:6789/0 conn(0x7fde000c49c0 legacy=0x7fde000c8280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:00:49.043 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:49.033+0000 7fddfdd9b640 1 -- 172.21.15.78:0/1457773426 --> v1:172.21.15.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde000c7d60 con 0x7fde000bf690 2023-11-28T20:00:49.043 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:49.033+0000 7fddfdd9b640 1 -- 172.21.15.78:0/1457773426 <== mon.0 v1:172.21.15.78:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3326804700 0 0) 0x7fdde8001a00 con 0x7fde000bf690 2023-11-28T20:00:49.043 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:49.033+0000 7fddfdd9b640 1 -- 172.21.15.78:0/1457773426 >> v1:172.21.15.78:6789/0 conn(0x7fde000bf690 legacy=0x7fde000c8990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:00:49.043 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:49.033+0000 7fddfdd9b640 1 --2- 172.21.15.78:0/1457773426 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fddec0039b0 0x7fddec003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:49.043 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:49.033+0000 7fddfdd9b640 1 --2- 172.21.15.78:0/1457773426 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fde000c59a0 0x7fddec0047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:49.043 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:49.033+0000 7fddfdd9b640 1 --2- 172.21.15.78:0/1457773426 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fddec004d10 0x7fddec005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:49.043 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:49.033+0000 7fddfdd9b640 1 -- 172.21.15.78:0/1457773426 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde000c6590 con 0x7fddec0039b0 2023-11-28T20:00:49.044 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:49.033+0000 7fddfdd9b640 1 -- 172.21.15.78:0/1457773426 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fddec00baf0 con 0x7fddec004d10 2023-11-28T20:00:49.044 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:49.033+0000 7fddfdd9b640 1 -- 172.21.15.78:0/1457773426 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fddec00bcb0 con 0x7fde000c59a0 2023-11-28T20:00:49.044 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:49.033+0000 7fddfe59c640 1 --2- 172.21.15.78:0/1457773426 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fddec0039b0 0x7fddec003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:49.044 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:49.033+0000 7fddf5d9b640 1 --2- 172.21.15.78:0/1457773426 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fde000c59a0 0x7fddec0047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:49.044 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:49.033+0000 7fddfed9d640 1 --2- 172.21.15.78:0/1457773426 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fddec004d10 0x7fddec005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:49.044 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:49.033+0000 7fddfe59c640 1 -- 172.21.15.78:0/1457773426 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fde000c59a0 msgr2=0x7fddec0047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:00:49.045 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:49.033+0000 7fddfe59c640 1 --2- 172.21.15.78:0/1457773426 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fde000c59a0 0x7fddec0047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:49.045 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:49.033+0000 7fddfe59c640 1 -- 172.21.15.78:0/1457773426 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fddec004d10 msgr2=0x7fddec005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:00:49.045 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:49.033+0000 7fddfe59c640 1 --2- 172.21.15.78:0/1457773426 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fddec004d10 0x7fddec005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:49.045 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:49.033+0000 7fddfe59c640 1 -- 172.21.15.78:0/1457773426 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fddec003530 con 0x7fddec0039b0 2023-11-28T20:00:49.048 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:49.037+0000 7fddfe59c640 1 --2- 172.21.15.78:0/1457773426 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fddec0039b0 0x7fddec003dd0 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7fddf0001780 tx=0x7fddf001c020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6afa86d19f69e309 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:00:49.048 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:49.037+0000 7fddfdd9b640 1 -- 172.21.15.78:0/1457773426 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde00152250 con 0x7fddec0039b0 2023-11-28T20:00:49.048 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:49.037+0000 7fddfdd9b640 1 -- 172.21.15.78:0/1457773426 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fddf00052f0 con 0x7fddec0039b0 2023-11-28T20:00:49.048 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:49.037+0000 7fddfdd9b640 1 -- 172.21.15.78:0/1457773426 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddf0003600 con 0x7fddec0039b0 2023-11-28T20:00:49.048 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:49.037+0000 7fde04b80640 1 -- 172.21.15.78:0/1457773426 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fddec0039b0 msgr2=0x7fddec003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:00:49.049 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:49.037+0000 7fde04b80640 1 --2- 172.21.15.78:0/1457773426 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fddec0039b0 0x7fddec003dd0 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7fddf0001780 tx=0x7fddf001c020 comp rx=0 tx=0).stop 2023-11-28T20:00:49.049 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:49.037+0000 7fddfed9d640 1 -- 172.21.15.78:0/1457773426 reap_dead start 2023-11-28T20:00:49.049 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:49.037+0000 7fde04b80640 1 -- 172.21.15.78:0/1457773426 shutdown_connections 2023-11-28T20:00:49.049 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:49.037+0000 7fde04b80640 1 -- 172.21.15.78:0/1457773426 >> 172.21.15.78:0/1457773426 conn(0x7fde000c6840 msgr2=0x7fde000c6c50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:00:49.049 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:49.037+0000 7fde04b80640 1 -- 172.21.15.78:0/1457773426 shutdown_connections 2023-11-28T20:00:49.049 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:49.037+0000 7fde04b80640 1 -- 172.21.15.78:0/1457773426 wait complete. 2023-11-28T20:00:49.049 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:49.041+0000 7fde04b80640 1 Processor -- start 2023-11-28T20:00:49.050 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:49.041+0000 7fde04b80640 1 -- start start 2023-11-28T20:00:49.050 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:49.041+0000 7fde04b80640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fddec0039b0 0x7fde001438f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:49.050 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:49.041+0000 7fde04b80640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fde000ac530 0x7fde0014bb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:49.050 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:49.041+0000 7fde04b80640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fde000ab8e0 0x7fde00151110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:49.050 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:49.041+0000 7fde04b80640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde000a9b90 con 0x7fde000ab8e0 2023-11-28T20:00:49.050 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:49.041+0000 7fde04b80640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde000aa8d0 con 0x7fde000ac530 2023-11-28T20:00:49.050 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:49.041+0000 7fde04b80640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde000aabb0 con 0x7fddec0039b0 2023-11-28T20:00:49.051 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:49.041+0000 7fddfed9d640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fde000ab8e0 0x7fde00151110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:49.051 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:49.041+0000 7fddfed9d640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fde000ab8e0 0x7fde00151110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:39978/0 (socket says 172.21.15.78:39978) 2023-11-28T20:00:49.051 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:49.041+0000 7fddfed9d640 1 -- 172.21.15.78:0/2183817394 learned_addr learned my addr 172.21.15.78:0/2183817394 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T20:00:49.051 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:49.041+0000 7fddfe59c640 1 --2- 172.21.15.78:0/2183817394 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fddec0039b0 0x7fde001438f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:49.051 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:49.041+0000 7fddf5d9b640 1 --2- 172.21.15.78:0/2183817394 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fde000ac530 0x7fde0014bb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:49.051 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:49.041+0000 7fddfed9d640 1 -- 172.21.15.78:0/2183817394 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fddec0039b0 msgr2=0x7fde001438f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:00:49.051 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:49.041+0000 7fddfed9d640 1 --2- 172.21.15.78:0/2183817394 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fddec0039b0 0x7fde001438f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:49.052 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:49.041+0000 7fddfed9d640 1 -- 172.21.15.78:0/2183817394 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fde000ac530 msgr2=0x7fde0014bb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:00:49.052 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:49.041+0000 7fddfed9d640 1 --2- 172.21.15.78:0/2183817394 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fde000ac530 0x7fde0014bb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:49.052 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:49.041+0000 7fddfed9d640 1 -- 172.21.15.78:0/2183817394 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde000aae90 con 0x7fde000ab8e0 2023-11-28T20:00:49.052 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:49.041+0000 7fddfed9d640 1 --2- 172.21.15.78:0/2183817394 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fde000ab8e0 0x7fde00151110 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7fde000c5d80 tx=0x7fddf8011920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:00:49.052 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:49.041+0000 7fddf77fe640 1 -- 172.21.15.78:0/2183817394 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddf8004500 con 0x7fde000ab8e0 2023-11-28T20:00:49.052 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:49.041+0000 7fddf77fe640 1 -- 172.21.15.78:0/2183817394 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fddf8003620 con 0x7fde000ab8e0 2023-11-28T20:00:49.053 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:49.041+0000 7fddf77fe640 1 -- 172.21.15.78:0/2183817394 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddf8003a10 con 0x7fde000ab8e0 2023-11-28T20:00:49.053 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:49.041+0000 7fde04b80640 1 -- 172.21.15.78:0/2183817394 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fde00150bf0 con 0x7fde000ab8e0 2023-11-28T20:00:49.053 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:49.041+0000 7fde04b80640 1 -- 172.21.15.78:0/2183817394 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fde0014c040 con 0x7fde000ab8e0 2023-11-28T20:00:49.054 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:49.045+0000 7fde04b80640 1 -- 172.21.15.78:0/2183817394 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fde0006d5c0 con 0x7fde000ab8e0 2023-11-28T20:00:49.054 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:49.045+0000 7fddf77fe640 1 -- 172.21.15.78:0/2183817394 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fddf8003b70 con 0x7fde000ab8e0 2023-11-28T20:00:49.055 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:49.045+0000 7fddf77fe640 1 --2- 172.21.15.78:0/2183817394 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fdde0066470 0x7fdde0068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:49.055 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:49.045+0000 7fddf77fe640 1 -- 172.21.15.78:0/2183817394 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 6972+0+0 (secure 0 0 0) 0x7fddf8084430 con 0x7fde000ab8e0 2023-11-28T20:00:49.055 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:49.045+0000 7fddfe59c640 1 --2- 172.21.15.78:0/2183817394 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fdde0066470 0x7fdde0068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:49.055 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:49.045+0000 7fddfe59c640 1 --2- 172.21.15.78:0/2183817394 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fdde0066470 0x7fdde0068930 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fddf0001750 tx=0x7fddf00011a0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:00:49.055 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:49.049+0000 7fddf77fe640 1 -- 172.21.15.78:0/2183817394 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fddf8051320 con 0x7fde000ab8e0 2023-11-28T20:00:49.231 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:49.225+0000 7fde04b80640 1 -- 172.21.15.78:0/2183817394 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fde00150de0 con 0x7fde000ab8e0 2023-11-28T20:00:49.232 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:49.229+0000 7fddf77fe640 1 -- 172.21.15.78:0/2183817394 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 22 v22) v1 ==== 94+0+6127 (secure 0 0 0) 0x7fddf8054940 con 0x7fde000ab8e0 2023-11-28T20:00:49.232 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-11-28T20:00:49.232 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":22,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4880,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6835/20894428","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6834","nonce":20894428},{"type":"v1","addr":"172.21.15.179:6835","nonce":20894428}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":4886,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6837/666703170","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6835","nonce":666703170},{"type":"v1","addr":"172.21.15.78:6837","nonce":666703170}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-28T20:00:13.162273+0000","modified":"2023-11-28T20:00:16.174263+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5185},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5185":{"gid":5185,"name":"c","rank":0,"incarnation":13,"state":"up:active","state_seq":4,"addr":"172.21.15.78:6836/3508383403","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6834","nonce":3508383403},{"type":"v1","addr":"172.21.15.78:6836","nonce":3508383403}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2},{"mdsmap":{"epoch":22,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-28T20:00:30.436267+0000","modified":"2023-11-28T20:00:33.475772+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5179},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5179":{"gid":5179,"name":"b","rank":0,"incarnation":18,"state":"up:active","state_seq":8,"addr":"172.21.15.179:6833/3446403084","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6832","nonce":3446403084},{"type":"v1","addr":"172.21.15.179:6833","nonce":3446403084}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs2","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2023-11-28T20:00:49.232 INFO:teuthology.orchestra.run.smithi078.stderr:dumped fsmap epoch 22 2023-11-28T20:00:49.234 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:49.229+0000 7fde04b80640 1 -- 172.21.15.78:0/2183817394 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fdde0066470 msgr2=0x7fdde0068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:00:49.234 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:49.229+0000 7fde04b80640 1 --2- 172.21.15.78:0/2183817394 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fdde0066470 0x7fdde0068930 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fddf0001750 tx=0x7fddf00011a0 comp rx=0 tx=0).stop 2023-11-28T20:00:49.234 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:49.229+0000 7fde04b80640 1 -- 172.21.15.78:0/2183817394 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fde000ab8e0 msgr2=0x7fde00151110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:00:49.234 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:49.229+0000 7fde04b80640 1 --2- 172.21.15.78:0/2183817394 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fde000ab8e0 0x7fde00151110 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7fde000c5d80 tx=0x7fddf8011920 comp rx=0 tx=0).stop 2023-11-28T20:00:49.235 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:49.229+0000 7fde04b80640 1 -- 172.21.15.78:0/2183817394 shutdown_connections 2023-11-28T20:00:49.235 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:49.229+0000 7fde04b80640 1 --2- 172.21.15.78:0/2183817394 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fdde0066470 0x7fdde0068930 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:49.235 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:49.229+0000 7fde04b80640 1 --2- 172.21.15.78:0/2183817394 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fde000ab8e0 0x7fde00151110 unknown :-1 s=CLOSED pgs=519 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:49.235 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:49.229+0000 7fde04b80640 1 --2- 172.21.15.78:0/2183817394 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fde000ac530 0x7fde0014bb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:49.235 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:49.229+0000 7fde04b80640 1 --2- 172.21.15.78:0/2183817394 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fddec0039b0 0x7fde001438f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:49.235 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:49.229+0000 7fde04b80640 1 -- 172.21.15.78:0/2183817394 >> 172.21.15.78:0/2183817394 conn(0x7fde000c6840 msgr2=0x7fde0014db80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:00:49.236 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:49.229+0000 7fde04b80640 1 -- 172.21.15.78:0/2183817394 shutdown_connections 2023-11-28T20:00:49.236 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:49.229+0000 7fde04b80640 1 -- 172.21.15.78:0/2183817394 wait complete. 2023-11-28T20:00:49.253 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-28T20:00:49.392 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:49.389+0000 7f2efc8c9640 1 Processor -- start 2023-11-28T20:00:49.392 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:49.389+0000 7f2efc8c9640 1 -- start start 2023-11-28T20:00:49.393 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:49.389+0000 7f2efc8c9640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2ef806bef0 0x7f2ef80bfce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:49.393 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:49.389+0000 7f2efc8c9640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f2ef806c5b0 0x7f2ef806ca40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:49.393 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:49.389+0000 7f2efc8c9640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2ef8151690 con 0x7f2ef814e3f0 2023-11-28T20:00:49.393 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:49.389+0000 7f2efc8c9640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2ef8151bc0 con 0x7f2ef806c5b0 2023-11-28T20:00:49.393 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:49.389+0000 7f2efc8c9640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ef81518e0 con 0x7f2ef806bef0 2023-11-28T20:00:49.394 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:49.389+0000 7f2ef6d9d640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f2ef806c5b0 0x7f2ef806ca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:49.394 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:49.389+0000 7f2ef5d9b640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2ef806bef0 0x7f2ef80bfce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:49.395 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:49.389+0000 7f2ef5d9b640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2ef806bef0 0x7f2ef80bfce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3301/0 says I am v2:172.21.15.78:33884/0 (socket says 172.21.15.78:33884) 2023-11-28T20:00:49.395 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:49.389+0000 7f2ef5d9b640 1 -- 172.21.15.78:0/3440888715 learned_addr learned my addr 172.21.15.78:0/3440888715 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T20:00:49.395 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:49.389+0000 7f2ef5d9b640 1 -- 172.21.15.78:0/3440888715 >> v2:172.21.15.179:3300/0 conn(0x7f2ef806c5b0 msgr2=0x7f2ef806ca40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:00:49.395 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:49.389+0000 7f2ef5d9b640 1 --2- 172.21.15.78:0/3440888715 >> v2:172.21.15.179:3300/0 conn(0x7f2ef806c5b0 0x7f2ef806ca40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:49.395 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:49.389+0000 7f2ef5d9b640 1 -- 172.21.15.78:0/3440888715 >> v1:172.21.15.179:6789/0 conn(0x7f2ef814e3f0 legacy=0x7f2ef80c41f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:00:49.395 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:49.389+0000 7f2ef5d9b640 1 -- 172.21.15.78:0/3440888715 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ef80c1de0 con 0x7f2ef806bef0 2023-11-28T20:00:49.395 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:49.389+0000 7f2ef559a640 1 -- 172.21.15.78:0/3440888715 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3091656717 0 0) 0x7f2ef8151690 con 0x7f2ef814e3f0 2023-11-28T20:00:49.397 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:49.393+0000 7f2ef5d9b640 1 --2- 172.21.15.78:0/3440888715 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2ef806bef0 0x7f2ef80bfce0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f2eec009870 tx=0x7f2eec01c480 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bc993ad9ed6b5fa9 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:00:49.398 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:49.393+0000 7f2ef559a640 1 -- 172.21.15.78:0/3440888715 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2eec0ad640 con 0x7f2ef806bef0 2023-11-28T20:00:49.398 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:49.393+0000 7f2ef559a640 1 -- 172.21.15.78:0/3440888715 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2eec0ad7a0 con 0x7f2ef806bef0 2023-11-28T20:00:49.398 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:49.393+0000 7f2ef559a640 1 -- 172.21.15.78:0/3440888715 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2eec0adb30 con 0x7f2ef806bef0 2023-11-28T20:00:49.399 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:49.393+0000 7f2efc8c9640 1 -- 172.21.15.78:0/3440888715 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2ef806bef0 msgr2=0x7f2ef80bfce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:00:49.399 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:49.393+0000 7f2efc8c9640 1 --2- 172.21.15.78:0/3440888715 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2ef806bef0 0x7f2ef80bfce0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f2eec009870 tx=0x7f2eec01c480 comp rx=0 tx=0).stop 2023-11-28T20:00:49.399 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:49.393+0000 7f2efc8c9640 1 -- 172.21.15.78:0/3440888715 shutdown_connections 2023-11-28T20:00:49.399 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:49.393+0000 7f2efc8c9640 1 --2- 172.21.15.78:0/3440888715 >> v2:172.21.15.179:3300/0 conn(0x7f2ef806c5b0 0x7f2ef806ca40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:49.399 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:49.393+0000 7f2efc8c9640 1 --2- 172.21.15.78:0/3440888715 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2ef806bef0 0x7f2ef80bfce0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:49.399 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:49.393+0000 7f2efc8c9640 1 -- 172.21.15.78:0/3440888715 >> 172.21.15.78:0/3440888715 conn(0x7f2ef80a7810 msgr2=0x7f2ef80a7c20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:00:49.399 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:49.393+0000 7f2efc8c9640 1 -- 172.21.15.78:0/3440888715 shutdown_connections 2023-11-28T20:00:49.399 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:49.393+0000 7f2efc8c9640 1 -- 172.21.15.78:0/3440888715 wait complete. 2023-11-28T20:00:49.400 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:49.397+0000 7f2efc8c9640 1 Processor -- start 2023-11-28T20:00:49.401 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:49.397+0000 7f2efc8c9640 1 -- start start 2023-11-28T20:00:49.403 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:49.397+0000 7f2efc8c9640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2ef806bef0 0x7f2ef8144a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:49.403 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:49.397+0000 7f2efc8c9640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2ef806c5b0 0x7f2ef8149ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:49.403 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:49.397+0000 7f2efc8c9640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2ef814e3f0 0x7f2ef81ed010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:49.403 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:49.397+0000 7f2efc8c9640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ef81ead00 con 0x7f2ef806bef0 2023-11-28T20:00:49.403 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:49.397+0000 7f2efc8c9640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ef814a720 con 0x7f2ef814e3f0 2023-11-28T20:00:49.404 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:49.397+0000 7f2efc8c9640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ef81525e0 con 0x7f2ef806c5b0 2023-11-28T20:00:49.404 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:49.397+0000 7f2ef659c640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2ef806bef0 0x7f2ef8144a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:49.404 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:49.397+0000 7f2ef659c640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2ef806bef0 0x7f2ef8144a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:39992/0 (socket says 172.21.15.78:39992) 2023-11-28T20:00:49.404 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:49.397+0000 7f2ef659c640 1 -- 172.21.15.78:0/3870173409 learned_addr learned my addr 172.21.15.78:0/3870173409 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T20:00:49.404 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:49.397+0000 7f2ef6d9d640 1 --2- 172.21.15.78:0/3870173409 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2ef814e3f0 0x7f2ef81ed010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:49.404 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:49.397+0000 7f2ef5d9b640 1 --2- 172.21.15.78:0/3870173409 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2ef806c5b0 0x7f2ef8149ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:49.404 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:49.397+0000 7f2ef659c640 1 -- 172.21.15.78:0/3870173409 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2ef806c5b0 msgr2=0x7f2ef8149ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:00:49.404 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:49.397+0000 7f2ef659c640 1 --2- 172.21.15.78:0/3870173409 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2ef806c5b0 0x7f2ef8149ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:49.404 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:49.397+0000 7f2ef659c640 1 -- 172.21.15.78:0/3870173409 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2ef814e3f0 msgr2=0x7f2ef81ed010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:00:49.404 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:49.397+0000 7f2ef659c640 1 --2- 172.21.15.78:0/3870173409 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2ef814e3f0 0x7f2ef81ed010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:49.404 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:49.397+0000 7f2ef659c640 1 -- 172.21.15.78:0/3870173409 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2eec0094d0 con 0x7f2ef806bef0 2023-11-28T20:00:49.404 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:49.397+0000 7f2ef659c640 1 --2- 172.21.15.78:0/3870173409 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2ef806bef0 0x7f2ef8144a30 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7f2ee800c450 tx=0x7f2ee800c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:00:49.405 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:49.397+0000 7f2ee6ffd640 1 -- 172.21.15.78:0/3870173409 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ee80054e0 con 0x7f2ef806bef0 2023-11-28T20:00:49.405 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:49.397+0000 7f2ee6ffd640 1 -- 172.21.15.78:0/3870173409 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ee8003600 con 0x7f2ef806bef0 2023-11-28T20:00:49.405 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:49.397+0000 7f2efc8c9640 1 -- 172.21.15.78:0/3870173409 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2ef8144f70 con 0x7f2ef806bef0 2023-11-28T20:00:49.405 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:49.397+0000 7f2ee6ffd640 1 -- 172.21.15.78:0/3870173409 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ee80039b0 con 0x7f2ef806bef0 2023-11-28T20:00:49.405 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:49.397+0000 7f2efc8c9640 1 -- 172.21.15.78:0/3870173409 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2ef8070880 con 0x7f2ef806bef0 2023-11-28T20:00:49.406 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:49.401+0000 7f2efc8c9640 1 -- 172.21.15.78:0/3870173409 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2ef8067630 con 0x7f2ef806bef0 2023-11-28T20:00:49.406 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:49.401+0000 7f2ee6ffd640 1 -- 172.21.15.78:0/3870173409 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f2ee8003b10 con 0x7f2ef806bef0 2023-11-28T20:00:49.406 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:49.401+0000 7f2ee6ffd640 1 --2- 172.21.15.78:0/3870173409 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f2ed8066470 0x7f2ed8068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:49.406 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:49.401+0000 7f2ee6ffd640 1 -- 172.21.15.78:0/3870173409 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 6972+0+0 (secure 0 0 0) 0x7f2ee80839d0 con 0x7f2ef806bef0 2023-11-28T20:00:49.406 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:49.401+0000 7f2ef5d9b640 1 --2- 172.21.15.78:0/3870173409 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f2ed8066470 0x7f2ed8068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:49.407 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:49.401+0000 7f2ef5d9b640 1 --2- 172.21.15.78:0/3870173409 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f2ed8066470 0x7f2ed8068930 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f2eec0af000 tx=0x7f2eec0a7070 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:00:49.409 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:49.405+0000 7f2ee6ffd640 1 -- 172.21.15.78:0/3870173409 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f2ee80508d0 con 0x7f2ef806bef0 2023-11-28T20:00:49.559 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:49.553+0000 7f2efc8c9640 1 -- 172.21.15.78:0/3870173409 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2ef80c5370 con 0x7f2ef806bef0 2023-11-28T20:00:49.561 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:49.557+0000 7f2ee6ffd640 1 -- 172.21.15.78:0/3870173409 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v46) v1 ==== 74+0+20497 (secure 0 0 0) 0x7f2ee8001130 con 0x7f2ef806bef0 2023-11-28T20:00:49.561 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-11-28T20:00:49.561 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":46,"fsid":"dd9780e8-3bda-44fa-a9f0-fa07d19d901d","created":"2023-11-28T19:58:40.969556+0000","modified":"2023-11-28T20:00:47.817604+0000","last_up_change":"2023-11-28T19:58:52.596716+0000","last_in_change":"2023-11-28T19:58:43.609275+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-28T19:58:54.011229+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2023-11-28T20:00:10.831194+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"39","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2023-11-28T20:00:12.150184+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"40","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs2_metadata","create_time":"2023-11-28T20:00:28.571896+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"43","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs2_data","create_time":"2023-11-28T20:00:29.436453+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"44","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs2"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e84245ac-b5da-429e-af18-39acaa2b33e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6800","nonce":3358701235},{"type":"v1","addr":"172.21.15.78:6801","nonce":3358701235}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6802","nonce":3358701235},{"type":"v1","addr":"172.21.15.78:6803","nonce":3358701235}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6806","nonce":3358701235},{"type":"v1","addr":"172.21.15.78:6807","nonce":3358701235}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6804","nonce":3358701235},{"type":"v1","addr":"172.21.15.78:6805","nonce":3358701235}]},"public_addr":"172.21.15.78:6801/3358701235","cluster_addr":"172.21.15.78:6803/3358701235","heartbeat_back_addr":"172.21.15.78:6807/3358701235","heartbeat_front_addr":"172.21.15.78:6805/3358701235","state":["exists","up"]},{"osd":1,"uuid":"e634831d-c4e2-48d9-870c-9556ae162981","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6808","nonce":3211476654},{"type":"v1","addr":"172.21.15.78:6809","nonce":3211476654}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6810","nonce":3211476654},{"type":"v1","addr":"172.21.15.78:6811","nonce":3211476654}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6814","nonce":3211476654},{"type":"v1","addr":"172.21.15.78:6815","nonce":3211476654}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6812","nonce":3211476654},{"type":"v1","addr":"172.21.15.78:6813","nonce":3211476654}]},"public_addr":"172.21.15.78:6809/3211476654","cluster_addr":"172.21.15.78:6811/3211476654","heartbeat_back_addr":"172.21.15.78:6815/3211476654","heartbeat_front_addr":"172.21.15.78:6813/3211476654","state":["exists","up"]},{"osd":2,"uuid":"274c8395-6534-41f0-b8fb-a00af8985aa8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6816","nonce":2532904479},{"type":"v1","addr":"172.21.15.78:6817","nonce":2532904479}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6818","nonce":2532904479},{"type":"v1","addr":"172.21.15.78:6819","nonce":2532904479}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6822","nonce":2532904479},{"type":"v1","addr":"172.21.15.78:6823","nonce":2532904479}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6820","nonce":2532904479},{"type":"v1","addr":"172.21.15.78:6821","nonce":2532904479}]},"public_addr":"172.21.15.78:6817/2532904479","cluster_addr":"172.21.15.78:6819/2532904479","heartbeat_back_addr":"172.21.15.78:6823/2532904479","heartbeat_front_addr":"172.21.15.78:6821/2532904479","state":["exists","up"]},{"osd":3,"uuid":"77acc9af-7d4d-4b18-8cf5-d62f5971b7c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6824","nonce":3442991267},{"type":"v1","addr":"172.21.15.78:6825","nonce":3442991267}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6826","nonce":3442991267},{"type":"v1","addr":"172.21.15.78:6827","nonce":3442991267}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6830","nonce":3442991267},{"type":"v1","addr":"172.21.15.78:6831","nonce":3442991267}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6828","nonce":3442991267},{"type":"v1","addr":"172.21.15.78:6829","nonce":3442991267}]},"public_addr":"172.21.15.78:6825/3442991267","cluster_addr":"172.21.15.78:6827/3442991267","heartbeat_back_addr":"172.21.15.78:6831/3442991267","heartbeat_front_addr":"172.21.15.78:6829/3442991267","state":["exists","up"]},{"osd":4,"uuid":"5c62bc66-6b34-4b7f-a66b-9a743969138c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":802983577},{"type":"v1","addr":"172.21.15.179:6809","nonce":802983577}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":802983577},{"type":"v1","addr":"172.21.15.179:6811","nonce":802983577}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":802983577},{"type":"v1","addr":"172.21.15.179:6815","nonce":802983577}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":802983577},{"type":"v1","addr":"172.21.15.179:6813","nonce":802983577}]},"public_addr":"172.21.15.179:6809/802983577","cluster_addr":"172.21.15.179:6811/802983577","heartbeat_back_addr":"172.21.15.179:6815/802983577","heartbeat_front_addr":"172.21.15.179:6813/802983577","state":["exists","up"]},{"osd":5,"uuid":"67db6d36-f684-4079-b0cd-82b4dd61461f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":518192887},{"type":"v1","addr":"172.21.15.179:6818","nonce":518192887}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":518192887},{"type":"v1","addr":"172.21.15.179:6822","nonce":518192887}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":518192887},{"type":"v1","addr":"172.21.15.179:6829","nonce":518192887}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6824","nonce":518192887},{"type":"v1","addr":"172.21.15.179:6826","nonce":518192887}]},"public_addr":"172.21.15.179:6818/518192887","cluster_addr":"172.21.15.179:6822/518192887","heartbeat_back_addr":"172.21.15.179:6829/518192887","heartbeat_front_addr":"172.21.15.179:6826/518192887","state":["exists","up"]},{"osd":6,"uuid":"12e670af-5a16-4c81-9f97-defa66cab967","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":815435378},{"type":"v1","addr":"172.21.15.179:6801","nonce":815435378}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":815435378},{"type":"v1","addr":"172.21.15.179:6803","nonce":815435378}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":815435378},{"type":"v1","addr":"172.21.15.179:6807","nonce":815435378}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":815435378},{"type":"v1","addr":"172.21.15.179:6805","nonce":815435378}]},"public_addr":"172.21.15.179:6801/815435378","cluster_addr":"172.21.15.179:6803/815435378","heartbeat_back_addr":"172.21.15.179:6807/815435378","heartbeat_front_addr":"172.21.15.179:6805/815435378","state":["exists","up"]},{"osd":7,"uuid":"fe630650-2eb3-49ad-8676-c341e6332eb1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6817","nonce":2848432339},{"type":"v1","addr":"172.21.15.179:6819","nonce":2848432339}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6821","nonce":2848432339},{"type":"v1","addr":"172.21.15.179:6823","nonce":2848432339}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":2848432339},{"type":"v1","addr":"172.21.15.179:6831","nonce":2848432339}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6825","nonce":2848432339},{"type":"v1","addr":"172.21.15.179:6827","nonce":2848432339}]},"public_addr":"172.21.15.179:6819/2848432339","cluster_addr":"172.21.15.179:6823/2848432339","heartbeat_back_addr":"172.21.15.179:6831/2848432339","heartbeat_front_addr":"172.21.15.179:6827/2848432339","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:58:49.255433+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:58:49.412880+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:58:49.559295+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:58:49.245237+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:58:49.184557+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:58:49.329851+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:58:49.366012+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:58:49.349604+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"6.2b","mappings":[{"from":5,"to":0}]},{"pgid":"8.28","mappings":[{"from":0,"to":6}]},{"pgid":"8.38","mappings":[{"from":0,"to":6}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-28T20:00:49.563 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:49.557+0000 7f2efc8c9640 1 -- 172.21.15.78:0/3870173409 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f2ed8066470 msgr2=0x7f2ed8068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:00:49.563 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:49.557+0000 7f2efc8c9640 1 --2- 172.21.15.78:0/3870173409 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f2ed8066470 0x7f2ed8068930 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f2eec0af000 tx=0x7f2eec0a7070 comp rx=0 tx=0).stop 2023-11-28T20:00:49.563 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:49.557+0000 7f2efc8c9640 1 -- 172.21.15.78:0/3870173409 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2ef806bef0 msgr2=0x7f2ef8144a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:00:49.563 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:49.557+0000 7f2efc8c9640 1 --2- 172.21.15.78:0/3870173409 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2ef806bef0 0x7f2ef8144a30 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7f2ee800c450 tx=0x7f2ee800c910 comp rx=0 tx=0).stop 2023-11-28T20:00:49.563 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:49.557+0000 7f2efc8c9640 1 -- 172.21.15.78:0/3870173409 shutdown_connections 2023-11-28T20:00:49.563 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:49.557+0000 7f2efc8c9640 1 --2- 172.21.15.78:0/3870173409 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f2ed8066470 0x7f2ed8068930 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:49.564 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:49.557+0000 7f2efc8c9640 1 --2- 172.21.15.78:0/3870173409 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2ef806c5b0 0x7f2ef8149ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:49.564 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:49.557+0000 7f2efc8c9640 1 --2- 172.21.15.78:0/3870173409 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2ef814e3f0 0x7f2ef81ed010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:49.564 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:49.557+0000 7f2efc8c9640 1 --2- 172.21.15.78:0/3870173409 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2ef806bef0 0x7f2ef8144a30 unknown :-1 s=CLOSED pgs=520 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:49.564 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:49.557+0000 7f2efc8c9640 1 -- 172.21.15.78:0/3870173409 >> 172.21.15.78:0/3870173409 conn(0x7f2ef80a7810 msgr2=0x7f2ef80c41f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:00:49.564 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:49.557+0000 7f2efc8c9640 1 -- 172.21.15.78:0/3870173409 shutdown_connections 2023-11-28T20:00:49.564 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:49.557+0000 7f2efc8c9640 1 -- 172.21.15.78:0/3870173409 wait complete. 2023-11-28T20:00:49.582 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-11-28T20:00:49.582 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-28T20:00:49.719 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:49.713+0000 7f1f80f57640 1 Processor -- start 2023-11-28T20:00:49.719 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:49.713+0000 7f1f80f57640 1 -- start start 2023-11-28T20:00:49.721 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:49.717+0000 7f1f80f57640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1f7c06d2b0 0x7f1f7c06d690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:49.721 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:49.717+0000 7f1f80f57640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f1f7c0c3b80 0x7f1f7c0c5300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:49.721 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:49.717+0000 7f1f80f57640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1f7c06bb80 con 0x7f1f7c06c020 2023-11-28T20:00:49.721 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:49.717+0000 7f1f80f57640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1f7c0c5840 con 0x7f1f7c0c3b80 2023-11-28T20:00:49.721 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:49.717+0000 7f1f80f57640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1f7c1515c0 con 0x7f1f7c06d2b0 2023-11-28T20:00:49.721 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:49.717+0000 7f1f79d9b640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f1f7c0c3b80 0x7f1f7c0c5300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:49.722 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:49.717+0000 7f1f79d9b640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f1f7c0c3b80 0x7f1f7c0c5300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:39996/0 (socket says 172.21.15.78:39996) 2023-11-28T20:00:49.722 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:49.717+0000 7f1f79d9b640 1 -- 172.21.15.78:0/354758913 learned_addr learned my addr 172.21.15.78:0/354758913 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T20:00:49.722 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:49.717+0000 7f1f7a59c640 1 --2- 172.21.15.78:0/354758913 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1f7c06d2b0 0x7f1f7c06d690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:49.722 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:49.717+0000 7f1f79d9b640 1 -- 172.21.15.78:0/354758913 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1f7c06d2b0 msgr2=0x7f1f7c06d690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:00:49.723 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:49.717+0000 7f1f79d9b640 1 --2- 172.21.15.78:0/354758913 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1f7c06d2b0 0x7f1f7c06d690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:49.723 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:49.717+0000 7f1f79d9b640 1 -- 172.21.15.78:0/354758913 >> v1:172.21.15.179:6789/0 conn(0x7f1f7c06c020 legacy=0x7f1f7c06c4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:00:49.723 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:49.717+0000 7f1f79d9b640 1 -- 172.21.15.78:0/354758913 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f7c1518a0 con 0x7f1f7c0c3b80 2023-11-28T20:00:49.724 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:49.721+0000 7f1f79d9b640 1 --2- 172.21.15.78:0/354758913 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1f7c0c3b80 0x7f1f7c0c5300 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f1f70009870 tx=0x7f1f7001c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7a0876f59b53c8f server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:00:49.725 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:49.721+0000 7f1f7959a640 1 -- 172.21.15.78:0/354758913 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f700aa5f0 con 0x7f1f7c0c3b80 2023-11-28T20:00:49.725 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:49.721+0000 7f1f7959a640 1 -- 172.21.15.78:0/354758913 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f700aa750 con 0x7f1f7c0c3b80 2023-11-28T20:00:49.725 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:49.721+0000 7f1f7959a640 1 -- 172.21.15.78:0/354758913 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f700aaae0 con 0x7f1f7c0c3b80 2023-11-28T20:00:49.726 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:49.721+0000 7f1f80f57640 1 -- 172.21.15.78:0/354758913 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1f7c0c3b80 msgr2=0x7f1f7c0c5300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:00:49.726 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:49.721+0000 7f1f80f57640 1 --2- 172.21.15.78:0/354758913 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1f7c0c3b80 0x7f1f7c0c5300 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f1f70009870 tx=0x7f1f7001c4d0 comp rx=0 tx=0).stop 2023-11-28T20:00:49.726 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:49.721+0000 7f1f80f57640 1 -- 172.21.15.78:0/354758913 shutdown_connections 2023-11-28T20:00:49.726 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:49.721+0000 7f1f80f57640 1 --2- 172.21.15.78:0/354758913 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1f7c0c3b80 0x7f1f7c0c5300 unknown :-1 s=CLOSED pgs=521 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:49.726 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:49.721+0000 7f1f80f57640 1 --2- 172.21.15.78:0/354758913 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1f7c06d2b0 0x7f1f7c06d690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:49.726 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:49.721+0000 7f1f80f57640 1 -- 172.21.15.78:0/354758913 >> 172.21.15.78:0/354758913 conn(0x7f1f7c0a7810 msgr2=0x7f1f7c0a7c20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:00:49.726 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:49.721+0000 7f1f80f57640 1 -- 172.21.15.78:0/354758913 shutdown_connections 2023-11-28T20:00:49.726 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:49.721+0000 7f1f80f57640 1 -- 172.21.15.78:0/354758913 wait complete. 2023-11-28T20:00:49.727 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:49.721+0000 7f1f80f57640 1 Processor -- start 2023-11-28T20:00:49.727 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:49.721+0000 7f1f80f57640 1 -- start start 2023-11-28T20:00:49.730 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:49.725+0000 7f1f80f57640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1f7c06c020 0x7f1f7c15b370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:49.730 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:49.725+0000 7f1f80f57640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1f7c06d2b0 0x7f1f7c146660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:49.730 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:49.725+0000 7f1f80f57640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1f7c0c3b80 0x7f1f7c146ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:49.731 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:49.725+0000 7f1f80f57640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f7c0ab210 con 0x7f1f7c0c3b80 2023-11-28T20:00:49.731 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:49.725+0000 7f1f80f57640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f7c14a630 con 0x7f1f7c06c020 2023-11-28T20:00:49.731 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:49.725+0000 7f1f80f57640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1f7c0ab420 con 0x7f1f7c06d2b0 2023-11-28T20:00:49.731 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:49.725+0000 7f1f7ad9d640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1f7c0c3b80 0x7f1f7c146ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:49.731 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:49.725+0000 7f1f7ad9d640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1f7c0c3b80 0x7f1f7c146ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:40002/0 (socket says 172.21.15.78:40002) 2023-11-28T20:00:49.732 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:49.725+0000 7f1f7ad9d640 1 -- 172.21.15.78:0/2058313397 learned_addr learned my addr 172.21.15.78:0/2058313397 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T20:00:49.732 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:49.725+0000 7f1f7a59c640 1 --2- 172.21.15.78:0/2058313397 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1f7c06c020 0x7f1f7c15b370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:49.732 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:49.725+0000 7f1f79d9b640 1 --2- 172.21.15.78:0/2058313397 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1f7c06d2b0 0x7f1f7c146660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:49.732 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:49.725+0000 7f1f7ad9d640 1 -- 172.21.15.78:0/2058313397 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1f7c06d2b0 msgr2=0x7f1f7c146660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:00:49.732 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:49.725+0000 7f1f7ad9d640 1 --2- 172.21.15.78:0/2058313397 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1f7c06d2b0 0x7f1f7c146660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:49.732 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:49.725+0000 7f1f7ad9d640 1 -- 172.21.15.78:0/2058313397 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1f7c06c020 msgr2=0x7f1f7c15b370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:00:49.733 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:49.725+0000 7f1f7ad9d640 1 --2- 172.21.15.78:0/2058313397 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1f7c06c020 0x7f1f7c15b370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:49.733 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:49.725+0000 7f1f7ad9d640 1 -- 172.21.15.78:0/2058313397 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f700094d0 con 0x7f1f7c0c3b80 2023-11-28T20:00:49.733 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:49.725+0000 7f1f7ad9d640 1 --2- 172.21.15.78:0/2058313397 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1f7c0c3b80 0x7f1f7c146ba0 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f1f7400c780 tx=0x7f1f7400cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:00:49.733 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:49.725+0000 7f1f6affd640 1 -- 172.21.15.78:0/2058313397 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f74004b20 con 0x7f1f7c0c3b80 2023-11-28T20:00:49.733 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:49.725+0000 7f1f6affd640 1 -- 172.21.15.78:0/2058313397 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f74004c80 con 0x7f1f7c0c3b80 2023-11-28T20:00:49.734 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:49.725+0000 7f1f6affd640 1 -- 172.21.15.78:0/2058313397 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f7400aa90 con 0x7f1f7c0c3b80 2023-11-28T20:00:49.734 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:49.725+0000 7f1f80f57640 1 -- 172.21.15.78:0/2058313397 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1f7c14ef80 con 0x7f1f7c0c3b80 2023-11-28T20:00:49.734 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:49.725+0000 7f1f80f57640 1 -- 172.21.15.78:0/2058313397 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1f7c15b8b0 con 0x7f1f7c0c3b80 2023-11-28T20:00:49.736 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:49.725+0000 7f1f80f57640 1 -- 172.21.15.78:0/2058313397 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1f7c0ab940 con 0x7f1f7c0c3b80 2023-11-28T20:00:49.736 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:49.729+0000 7f1f6affd640 1 -- 172.21.15.78:0/2058313397 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f1f7400abf0 con 0x7f1f7c0c3b80 2023-11-28T20:00:49.736 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:49.729+0000 7f1f6affd640 1 --2- 172.21.15.78:0/2058313397 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f1f5c066470 0x7f1f5c068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:49.736 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:49.729+0000 7f1f6affd640 1 -- 172.21.15.78:0/2058313397 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 6972+0+0 (secure 0 0 0) 0x7f1f740842e0 con 0x7f1f7c0c3b80 2023-11-28T20:00:49.737 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:49.729+0000 7f1f7a59c640 1 --2- 172.21.15.78:0/2058313397 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f1f5c066470 0x7f1f5c068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:49.737 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:49.729+0000 7f1f7a59c640 1 --2- 172.21.15.78:0/2058313397 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f1f5c066470 0x7f1f5c068930 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f1f6c007a60 tx=0x7f1f6c008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:00:49.738 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:49.733+0000 7f1f6affd640 1 -- 172.21.15.78:0/2058313397 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f1f7c0ab940 con 0x7f1f7c0c3b80 2023-11-28T20:00:49.917 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:49.913+0000 7f1f80f57640 1 -- 172.21.15.78:0/2058313397 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f1f7c0ab940 con 0x7f1f7c0c3b80 2023-11-28T20:00:49.918 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:49.913+0000 7f1f6affd640 1 -- 172.21.15.78:0/2058313397 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 22 v22) v1 ==== 94+0+6127 (secure 0 0 0) 0x7f1f7c0ab940 con 0x7f1f7c0c3b80 2023-11-28T20:00:49.918 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-11-28T20:00:49.918 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":22,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4880,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6835/20894428","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6834","nonce":20894428},{"type":"v1","addr":"172.21.15.179:6835","nonce":20894428}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":4886,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6837/666703170","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6835","nonce":666703170},{"type":"v1","addr":"172.21.15.78:6837","nonce":666703170}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-28T20:00:13.162273+0000","modified":"2023-11-28T20:00:16.174263+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5185},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5185":{"gid":5185,"name":"c","rank":0,"incarnation":13,"state":"up:active","state_seq":4,"addr":"172.21.15.78:6836/3508383403","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6834","nonce":3508383403},{"type":"v1","addr":"172.21.15.78:6836","nonce":3508383403}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2},{"mdsmap":{"epoch":22,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-28T20:00:30.436267+0000","modified":"2023-11-28T20:00:33.475772+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5179},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5179":{"gid":5179,"name":"b","rank":0,"incarnation":18,"state":"up:active","state_seq":8,"addr":"172.21.15.179:6833/3446403084","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6832","nonce":3446403084},{"type":"v1","addr":"172.21.15.179:6833","nonce":3446403084}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs2","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2023-11-28T20:00:49.919 INFO:teuthology.orchestra.run.smithi078.stderr:dumped fsmap epoch 22 2023-11-28T20:00:49.920 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:49.913+0000 7f1f80f57640 1 -- 172.21.15.78:0/2058313397 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f1f5c066470 msgr2=0x7f1f5c068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:00:49.920 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:49.913+0000 7f1f80f57640 1 --2- 172.21.15.78:0/2058313397 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f1f5c066470 0x7f1f5c068930 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f1f6c007a60 tx=0x7f1f6c008040 comp rx=0 tx=0).stop 2023-11-28T20:00:49.921 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:49.913+0000 7f1f80f57640 1 -- 172.21.15.78:0/2058313397 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1f7c0c3b80 msgr2=0x7f1f7c146ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:00:49.921 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:49.913+0000 7f1f80f57640 1 --2- 172.21.15.78:0/2058313397 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1f7c0c3b80 0x7f1f7c146ba0 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f1f7400c780 tx=0x7f1f7400cc40 comp rx=0 tx=0).stop 2023-11-28T20:00:49.921 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:49.917+0000 7f1f80f57640 1 -- 172.21.15.78:0/2058313397 shutdown_connections 2023-11-28T20:00:49.921 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:49.917+0000 7f1f80f57640 1 --2- 172.21.15.78:0/2058313397 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f1f5c066470 0x7f1f5c068930 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:49.921 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:49.917+0000 7f1f80f57640 1 --2- 172.21.15.78:0/2058313397 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1f7c06d2b0 0x7f1f7c146660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:49.921 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:49.917+0000 7f1f80f57640 1 --2- 172.21.15.78:0/2058313397 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1f7c0c3b80 0x7f1f7c146ba0 unknown :-1 s=CLOSED pgs=522 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:49.922 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:49.917+0000 7f1f80f57640 1 --2- 172.21.15.78:0/2058313397 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1f7c06c020 0x7f1f7c15b370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:49.922 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:49.917+0000 7f1f80f57640 1 -- 172.21.15.78:0/2058313397 >> 172.21.15.78:0/2058313397 conn(0x7f1f7c0a7810 msgr2=0x7f1f7c0a7bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:00:49.922 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:49.917+0000 7f1f80f57640 1 -- 172.21.15.78:0/2058313397 shutdown_connections 2023-11-28T20:00:49.922 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:49.917+0000 7f1f80f57640 1 -- 172.21.15.78:0/2058313397 wait complete. 2023-11-28T20:00:49.940 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-28T20:00:50.082 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:50.073+0000 7f3a58db8640 1 Processor -- start 2023-11-28T20:00:50.083 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:50.073+0000 7f3a58db8640 1 -- start start 2023-11-28T20:00:50.083 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:50.077+0000 7f3a58db8640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f3a5406d2b0 0x7f3a5406d690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:50.083 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:50.077+0000 7f3a58db8640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3a5406bb80 con 0x7f3a540c3b80 2023-11-28T20:00:50.083 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:50.077+0000 7f3a58db8640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3a540c5790 con 0x7f3a540c5300 2023-11-28T20:00:50.083 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:50.077+0000 7f3a58db8640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3a541515c0 con 0x7f3a5406d2b0 2023-11-28T20:00:50.083 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:50.077+0000 7f3a4bfff640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f3a540c3b80 0x7f3a5406c020 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:36594/0 (socket says 172.21.15.78:36594) 2023-11-28T20:00:50.083 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:50.077+0000 7f3a4bfff640 1 -- 172.21.15.78:0/1407608859 learned_addr learned my addr 172.21.15.78:0/1407608859 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-11-28T20:00:50.084 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:50.077+0000 7f3a5259c640 1 --2- 172.21.15.78:0/1407608859 >> v2:172.21.15.179:3300/0 conn(0x7f3a5406d2b0 0x7f3a5406d690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:50.084 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:50.077+0000 7f3a51d9b640 1 -- 172.21.15.78:0/1407608859 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1962800624 0 0) 0x7f3a5406bb80 con 0x7f3a540c3b80 2023-11-28T20:00:50.084 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:50.077+0000 7f3a51d9b640 1 -- 172.21.15.78:0/1407608859 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3a40003530 con 0x7f3a540c3b80 2023-11-28T20:00:50.084 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:50.077+0000 7f3a5259c640 1 -- 172.21.15.78:0/1407608859 >> v1:172.21.15.179:6789/0 conn(0x7f3a540c5300 legacy=0x7f3a5406c730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:00:50.084 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:50.077+0000 7f3a5259c640 1 -- 172.21.15.78:0/1407608859 >> v1:172.21.15.78:6789/0 conn(0x7f3a540c3b80 legacy=0x7f3a5406c020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:00:50.084 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:50.077+0000 7f3a5259c640 1 -- 172.21.15.78:0/1407608859 --> v2:172.21.15.179:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a541518a0 con 0x7f3a5406d2b0 2023-11-28T20:00:50.087 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:50.081+0000 7f3a5259c640 1 --2- 172.21.15.78:0/1407608859 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3a5406d2b0 0x7f3a5406d690 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f3a440097c0 tx=0x7f3a4401c450 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5ce1838fbf841d7f server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:00:50.087 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:50.081+0000 7f3a51d9b640 1 -- 172.21.15.78:0/1407608859 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a440ad660 con 0x7f3a5406d2b0 2023-11-28T20:00:50.087 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:50.081+0000 7f3a51d9b640 1 -- 172.21.15.78:0/1407608859 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a440ad7c0 con 0x7f3a5406d2b0 2023-11-28T20:00:50.087 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:50.081+0000 7f3a51d9b640 1 -- 172.21.15.78:0/1407608859 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a440adb50 con 0x7f3a5406d2b0 2023-11-28T20:00:50.087 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:50.081+0000 7f3a58db8640 1 -- 172.21.15.78:0/1407608859 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3a5406d2b0 msgr2=0x7f3a5406d690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:00:50.087 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:50.081+0000 7f3a58db8640 1 --2- 172.21.15.78:0/1407608859 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3a5406d2b0 0x7f3a5406d690 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f3a440097c0 tx=0x7f3a4401c450 comp rx=0 tx=0).stop 2023-11-28T20:00:50.087 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:50.081+0000 7f3a58db8640 1 -- 172.21.15.78:0/1407608859 shutdown_connections 2023-11-28T20:00:50.088 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:50.081+0000 7f3a58db8640 1 --2- 172.21.15.78:0/1407608859 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3a5406d2b0 0x7f3a5406d690 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:50.088 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:50.081+0000 7f3a58db8640 1 -- 172.21.15.78:0/1407608859 >> 172.21.15.78:0/1407608859 conn(0x7f3a540a7810 msgr2=0x7f3a540a7c20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:00:50.088 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:50.081+0000 7f3a58db8640 1 -- 172.21.15.78:0/1407608859 shutdown_connections 2023-11-28T20:00:50.088 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:50.081+0000 7f3a58db8640 1 -- 172.21.15.78:0/1407608859 wait complete. 2023-11-28T20:00:50.092 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:50.081+0000 7f3a58db8640 1 Processor -- start 2023-11-28T20:00:50.092 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:50.081+0000 7f3a58db8640 1 -- start start 2023-11-28T20:00:50.092 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:50.085+0000 7f3a58db8640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3a5406d2b0 0x7f3a5414fef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:50.092 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:50.085+0000 7f3a58db8640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3a540c3b80 0x7f3a5415b720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:50.092 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:50.085+0000 7f3a58db8640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3a540c5300 0x7f3a5414ac80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:50.092 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:50.085+0000 7f3a58db8640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a541edde0 con 0x7f3a540c3b80 2023-11-28T20:00:50.092 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:50.085+0000 7f3a58db8640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a541ecea0 con 0x7f3a5406d2b0 2023-11-28T20:00:50.092 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:50.085+0000 7f3a58db8640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3a541ed160 con 0x7f3a540c5300 2023-11-28T20:00:50.092 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:50.085+0000 7f3a4bfff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3a540c3b80 0x7f3a5415b720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:50.092 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:50.085+0000 7f3a4bfff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3a540c3b80 0x7f3a5415b720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:40006/0 (socket says 172.21.15.78:40006) 2023-11-28T20:00:50.093 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:50.085+0000 7f3a4bfff640 1 -- 172.21.15.78:0/204436720 learned_addr learned my addr 172.21.15.78:0/204436720 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T20:00:50.093 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:50.085+0000 7f3a5259c640 1 --2- 172.21.15.78:0/204436720 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3a5406d2b0 0x7f3a5414fef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:50.093 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:50.085+0000 7f3a52d9d640 1 --2- 172.21.15.78:0/204436720 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3a540c5300 0x7f3a5414ac80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:50.093 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:50.085+0000 7f3a4bfff640 1 -- 172.21.15.78:0/204436720 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3a540c5300 msgr2=0x7f3a5414ac80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:00:50.093 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:50.085+0000 7f3a4bfff640 1 --2- 172.21.15.78:0/204436720 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3a540c5300 0x7f3a5414ac80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:50.093 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:50.085+0000 7f3a4bfff640 1 -- 172.21.15.78:0/204436720 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3a5406d2b0 msgr2=0x7f3a5414fef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:00:50.093 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:50.085+0000 7f3a4bfff640 1 --2- 172.21.15.78:0/204436720 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3a5406d2b0 0x7f3a5414fef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:50.093 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:50.085+0000 7f3a4bfff640 1 -- 172.21.15.78:0/204436720 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a44009420 con 0x7f3a540c3b80 2023-11-28T20:00:50.093 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:50.085+0000 7f3a4bfff640 1 --2- 172.21.15.78:0/204436720 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3a540c3b80 0x7f3a5415b720 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f3a3c00c4d0 tx=0x7f3a3c00c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:00:50.093 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:50.085+0000 7f3a4affd640 1 -- 172.21.15.78:0/204436720 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a3c005cf0 con 0x7f3a540c3b80 2023-11-28T20:00:50.093 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:50.085+0000 7f3a4affd640 1 -- 172.21.15.78:0/204436720 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a3c005e50 con 0x7f3a540c3b80 2023-11-28T20:00:50.093 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:50.085+0000 7f3a4affd640 1 -- 172.21.15.78:0/204436720 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a3c007270 con 0x7f3a540c3b80 2023-11-28T20:00:50.094 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:50.085+0000 7f3a58db8640 1 -- 172.21.15.78:0/204436720 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3a5414ef80 con 0x7f3a540c3b80 2023-11-28T20:00:50.094 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:50.085+0000 7f3a58db8640 1 -- 172.21.15.78:0/204436720 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3a541ed720 con 0x7f3a540c3b80 2023-11-28T20:00:50.094 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:50.085+0000 7f3a58db8640 1 -- 172.21.15.78:0/204436720 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3a54153870 con 0x7f3a540c3b80 2023-11-28T20:00:50.094 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:50.085+0000 7f3a4affd640 1 -- 172.21.15.78:0/204436720 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f3a3c0073d0 con 0x7f3a540c3b80 2023-11-28T20:00:50.095 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:50.089+0000 7f3a4affd640 1 --2- 172.21.15.78:0/204436720 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f3a34066470 0x7f3a34068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:50.095 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:50.089+0000 7f3a4affd640 1 -- 172.21.15.78:0/204436720 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 6972+0+0 (secure 0 0 0) 0x7f3a3c0838d0 con 0x7f3a540c3b80 2023-11-28T20:00:50.095 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:50.089+0000 7f3a5259c640 1 --2- 172.21.15.78:0/204436720 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f3a34066470 0x7f3a34068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:50.095 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:50.089+0000 7f3a5259c640 1 --2- 172.21.15.78:0/204436720 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f3a34066470 0x7f3a34068930 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f3a440af000 tx=0x7f3a440a7000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:00:50.096 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:50.093+0000 7f3a4affd640 1 -- 172.21.15.78:0/204436720 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f3a3c050900 con 0x7f3a540c3b80 2023-11-28T20:00:50.279 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:50.273+0000 7f3a58db8640 1 -- 172.21.15.78:0/204436720 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f3a54067630 con 0x7f3a540c3b80 2023-11-28T20:00:50.279 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:50.273+0000 7f3a4affd640 1 -- 172.21.15.78:0/204436720 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 22 v22) v1 ==== 94+0+6127 (secure 0 0 0) 0x7f3a3c017090 con 0x7f3a540c3b80 2023-11-28T20:00:50.280 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-11-28T20:00:50.280 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":22,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4880,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6835/20894428","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6834","nonce":20894428},{"type":"v1","addr":"172.21.15.179:6835","nonce":20894428}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":4886,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6837/666703170","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6835","nonce":666703170},{"type":"v1","addr":"172.21.15.78:6837","nonce":666703170}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-28T20:00:13.162273+0000","modified":"2023-11-28T20:00:16.174263+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5185},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5185":{"gid":5185,"name":"c","rank":0,"incarnation":13,"state":"up:active","state_seq":4,"addr":"172.21.15.78:6836/3508383403","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6834","nonce":3508383403},{"type":"v1","addr":"172.21.15.78:6836","nonce":3508383403}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2},{"mdsmap":{"epoch":22,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-28T20:00:30.436267+0000","modified":"2023-11-28T20:00:33.475772+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5179},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5179":{"gid":5179,"name":"b","rank":0,"incarnation":18,"state":"up:active","state_seq":8,"addr":"172.21.15.179:6833/3446403084","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6832","nonce":3446403084},{"type":"v1","addr":"172.21.15.179:6833","nonce":3446403084}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs2","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2023-11-28T20:00:50.280 INFO:teuthology.orchestra.run.smithi078.stderr:dumped fsmap epoch 22 2023-11-28T20:00:50.281 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:50.277+0000 7f3a58db8640 1 -- 172.21.15.78:0/204436720 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f3a34066470 msgr2=0x7f3a34068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:00:50.281 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:50.277+0000 7f3a58db8640 1 --2- 172.21.15.78:0/204436720 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f3a34066470 0x7f3a34068930 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f3a440af000 tx=0x7f3a440a7000 comp rx=0 tx=0).stop 2023-11-28T20:00:50.282 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:50.277+0000 7f3a58db8640 1 -- 172.21.15.78:0/204436720 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3a540c3b80 msgr2=0x7f3a5415b720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:00:50.282 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:50.277+0000 7f3a58db8640 1 --2- 172.21.15.78:0/204436720 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3a540c3b80 0x7f3a5415b720 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f3a3c00c4d0 tx=0x7f3a3c00c990 comp rx=0 tx=0).stop 2023-11-28T20:00:50.282 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:50.277+0000 7f3a58db8640 1 -- 172.21.15.78:0/204436720 shutdown_connections 2023-11-28T20:00:50.282 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:50.277+0000 7f3a58db8640 1 --2- 172.21.15.78:0/204436720 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f3a34066470 0x7f3a34068930 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:50.282 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:50.277+0000 7f3a58db8640 1 --2- 172.21.15.78:0/204436720 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3a540c5300 0x7f3a5414ac80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:50.282 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:50.277+0000 7f3a58db8640 1 --2- 172.21.15.78:0/204436720 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3a540c3b80 0x7f3a5415b720 unknown :-1 s=CLOSED pgs=524 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:50.282 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:50.277+0000 7f3a58db8640 1 --2- 172.21.15.78:0/204436720 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3a5406d2b0 0x7f3a5414fef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:50.282 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:50.277+0000 7f3a58db8640 1 -- 172.21.15.78:0/204436720 >> 172.21.15.78:0/204436720 conn(0x7f3a540a7810 msgr2=0x7f3a5414f320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:00:50.282 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:50.277+0000 7f3a58db8640 1 -- 172.21.15.78:0/204436720 shutdown_connections 2023-11-28T20:00:50.282 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:50.277+0000 7f3a58db8640 1 -- 172.21.15.78:0/204436720 wait complete. 2023-11-28T20:00:50.301 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-28T20:00:50.439 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:50.433+0000 7f20a79b8640 1 Processor -- start 2023-11-28T20:00:50.440 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:50.433+0000 7f20a79b8640 1 -- start start 2023-11-28T20:00:50.441 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:50.437+0000 7f20a79b8640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f20a006d890 0x7f20a0154610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:50.441 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:50.437+0000 7f20a79b8640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f20a0154b50 0x7f20a015ee90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:50.441 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:50.437+0000 7f20a79b8640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f20a0158a40 con 0x7f20a0151bf0 2023-11-28T20:00:50.441 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:50.437+0000 7f20a79b8640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f20a01584c0 con 0x7f20a0154b50 2023-11-28T20:00:50.441 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:50.437+0000 7f20a79b8640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f20a0158760 con 0x7f20a006d890 2023-11-28T20:00:50.442 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:50.437+0000 7f20a4f53640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f20a006d890 0x7f20a0154610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:50.442 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:50.437+0000 7f20a5f55640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f20a0154b50 0x7f20a015ee90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:50.442 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:50.437+0000 7f20a4f53640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f20a006d890 0x7f20a0154610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3301/0 says I am v2:172.21.15.78:33934/0 (socket says 172.21.15.78:33934) 2023-11-28T20:00:50.442 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:50.437+0000 7f20a4f53640 1 -- 172.21.15.78:0/2426001959 learned_addr learned my addr 172.21.15.78:0/2426001959 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T20:00:50.442 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:50.437+0000 7f20a5754640 1 --1- >> v1:172.21.15.179:6789/0 conn(0x7f20a0151bf0 0x7f20a006b5c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.179:6789/0 says I am v1:172.21.15.78:33502/0 (socket says 172.21.15.78:33502) 2023-11-28T20:00:50.442 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:50.437+0000 7f20a4f53640 1 -- 172.21.15.78:0/2426001959 >> v2:172.21.15.179:3300/0 conn(0x7f20a0154b50 msgr2=0x7f20a015ee90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:00:50.443 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:50.437+0000 7f20a4f53640 1 --2- 172.21.15.78:0/2426001959 >> v2:172.21.15.179:3300/0 conn(0x7f20a0154b50 0x7f20a015ee90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:50.443 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:50.437+0000 7f20a4f53640 1 -- 172.21.15.78:0/2426001959 >> v1:172.21.15.179:6789/0 conn(0x7f20a0151bf0 legacy=0x7f20a006b5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:00:50.443 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:50.437+0000 7f20a4f53640 1 -- 172.21.15.78:0/2426001959 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20a00c0ce0 con 0x7f20a006d890 2023-11-28T20:00:50.444 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:50.441+0000 7f20a4f53640 1 --2- 172.21.15.78:0/2426001959 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f20a006d890 0x7f20a0154610 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f2090009870 tx=0x7f209001c510 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6996395e64c9a55e server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:00:50.446 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:50.441+0000 7f2097fff640 1 -- 172.21.15.78:0/2426001959 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20900ab620 con 0x7f20a006d890 2023-11-28T20:00:50.446 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:50.441+0000 7f2097fff640 1 -- 172.21.15.78:0/2426001959 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f20900ab780 con 0x7f20a006d890 2023-11-28T20:00:50.446 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:50.441+0000 7f2097fff640 1 -- 172.21.15.78:0/2426001959 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20900abb10 con 0x7f20a006d890 2023-11-28T20:00:50.446 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:50.441+0000 7f20a79b8640 1 -- 172.21.15.78:0/2426001959 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f20a006d890 msgr2=0x7f20a0154610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:00:50.446 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:50.441+0000 7f20a79b8640 1 --2- 172.21.15.78:0/2426001959 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f20a006d890 0x7f20a0154610 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f2090009870 tx=0x7f209001c510 comp rx=0 tx=0).stop 2023-11-28T20:00:50.446 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:50.441+0000 7f20a79b8640 1 -- 172.21.15.78:0/2426001959 shutdown_connections 2023-11-28T20:00:50.446 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:50.441+0000 7f20a79b8640 1 --2- 172.21.15.78:0/2426001959 >> v2:172.21.15.179:3300/0 conn(0x7f20a0154b50 0x7f20a015ee90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:50.446 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:50.441+0000 7f20a79b8640 1 --2- 172.21.15.78:0/2426001959 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f20a006d890 0x7f20a0154610 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:50.446 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:50.441+0000 7f20a79b8640 1 -- 172.21.15.78:0/2426001959 >> 172.21.15.78:0/2426001959 conn(0x7f20a00c61f0 msgr2=0x7f20a00c6600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:00:50.447 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:50.441+0000 7f20a79b8640 1 -- 172.21.15.78:0/2426001959 shutdown_connections 2023-11-28T20:00:50.447 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:50.441+0000 7f20a79b8640 1 -- 172.21.15.78:0/2426001959 wait complete. 2023-11-28T20:00:50.447 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:50.441+0000 7f20a79b8640 1 Processor -- start 2023-11-28T20:00:50.447 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:50.441+0000 7f20a79b8640 1 -- start start 2023-11-28T20:00:50.449 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:50.445+0000 7f20a79b8640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f20a006d890 0x7f20a00aadc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:50.449 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:50.445+0000 7f20a79b8640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f20a0151bf0 0x7f20a0147090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:50.449 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:50.445+0000 7f20a79b8640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f20a0154b50 0x7f20a01f0470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:50.449 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:50.445+0000 7f20a79b8640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20a0072470 con 0x7f20a0154b50 2023-11-28T20:00:50.449 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:50.445+0000 7f20a79b8640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20a0071860 con 0x7f20a006d890 2023-11-28T20:00:50.450 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:50.445+0000 7f20a79b8640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f20a0071b40 con 0x7f20a0151bf0 2023-11-28T20:00:50.450 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:50.445+0000 7f20a5f55640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f20a0154b50 0x7f20a01f0470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:50.450 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:50.445+0000 7f20a4f53640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f20a0151bf0 0x7f20a0147090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:50.450 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:50.445+0000 7f20a5f55640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f20a0154b50 0x7f20a01f0470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:40022/0 (socket says 172.21.15.78:40022) 2023-11-28T20:00:50.450 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:50.445+0000 7f20a5f55640 1 -- 172.21.15.78:0/638881292 learned_addr learned my addr 172.21.15.78:0/638881292 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T20:00:50.450 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:50.445+0000 7f20a5754640 1 --2- 172.21.15.78:0/638881292 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f20a006d890 0x7f20a00aadc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:50.450 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:50.445+0000 7f20a5f55640 1 -- 172.21.15.78:0/638881292 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f20a0151bf0 msgr2=0x7f20a0147090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:00:50.450 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:50.445+0000 7f20a5f55640 1 --2- 172.21.15.78:0/638881292 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f20a0151bf0 0x7f20a0147090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:50.450 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:50.445+0000 7f20a5f55640 1 -- 172.21.15.78:0/638881292 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f20a006d890 msgr2=0x7f20a00aadc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:00:50.450 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:50.445+0000 7f20a5f55640 1 --2- 172.21.15.78:0/638881292 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f20a006d890 0x7f20a00aadc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:50.450 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:50.445+0000 7f20a5f55640 1 -- 172.21.15.78:0/638881292 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20900094d0 con 0x7f20a0154b50 2023-11-28T20:00:50.451 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:50.445+0000 7f20a5f55640 1 --2- 172.21.15.78:0/638881292 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f20a0154b50 0x7f20a01f0470 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f209800efc0 tx=0x7f209800c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:00:50.451 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:50.445+0000 7f2095ffb640 1 -- 172.21.15.78:0/638881292 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2098014480 con 0x7f20a0154b50 2023-11-28T20:00:50.451 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:50.445+0000 7f2095ffb640 1 -- 172.21.15.78:0/638881292 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f209800f040 con 0x7f20a0154b50 2023-11-28T20:00:50.452 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:50.445+0000 7f2095ffb640 1 -- 172.21.15.78:0/638881292 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2098014820 con 0x7f20a0154b50 2023-11-28T20:00:50.452 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:50.445+0000 7f20a79b8640 1 -- 172.21.15.78:0/638881292 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f20a0071e20 con 0x7f20a0154b50 2023-11-28T20:00:50.452 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:50.445+0000 7f20a79b8640 1 -- 172.21.15.78:0/638881292 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f20a0147ac0 con 0x7f20a0154b50 2023-11-28T20:00:50.452 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:50.445+0000 7f20a79b8640 1 -- 172.21.15.78:0/638881292 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f20a0067630 con 0x7f20a0154b50 2023-11-28T20:00:50.452 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:50.449+0000 7f2095ffb640 1 -- 172.21.15.78:0/638881292 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f2098014980 con 0x7f20a0154b50 2023-11-28T20:00:50.453 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:50.449+0000 7f2095ffb640 1 --2- 172.21.15.78:0/638881292 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f2084066470 0x7f2084068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:50.453 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:50.449+0000 7f2095ffb640 1 -- 172.21.15.78:0/638881292 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 6972+0+0 (secure 0 0 0) 0x7f2098084dc0 con 0x7f20a0154b50 2023-11-28T20:00:50.453 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:50.449+0000 7f20a5754640 1 --2- 172.21.15.78:0/638881292 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f2084066470 0x7f2084068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:50.454 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:50.449+0000 7f20a5754640 1 --2- 172.21.15.78:0/638881292 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f2084066470 0x7f2084068930 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f209c000f70 tx=0x7f209c007e50 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:00:50.457 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:50.453+0000 7f2095ffb640 1 -- 172.21.15.78:0/638881292 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f2098051e90 con 0x7f20a0154b50 2023-11-28T20:00:50.608 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:50.605+0000 7f20a79b8640 1 -- 172.21.15.78:0/638881292 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f20a00725b0 con 0x7f20a0154b50 2023-11-28T20:00:50.610 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:50.605+0000 7f2095ffb640 1 -- 172.21.15.78:0/638881292 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v46) v1 ==== 74+0+20497 (secure 0 0 0) 0x7f20a00725b0 con 0x7f20a0154b50 2023-11-28T20:00:50.610 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-11-28T20:00:50.611 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":46,"fsid":"dd9780e8-3bda-44fa-a9f0-fa07d19d901d","created":"2023-11-28T19:58:40.969556+0000","modified":"2023-11-28T20:00:47.817604+0000","last_up_change":"2023-11-28T19:58:52.596716+0000","last_in_change":"2023-11-28T19:58:43.609275+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-28T19:58:54.011229+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2023-11-28T20:00:10.831194+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"39","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2023-11-28T20:00:12.150184+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"40","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs2_metadata","create_time":"2023-11-28T20:00:28.571896+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"43","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs2_data","create_time":"2023-11-28T20:00:29.436453+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"44","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs2"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e84245ac-b5da-429e-af18-39acaa2b33e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6800","nonce":3358701235},{"type":"v1","addr":"172.21.15.78:6801","nonce":3358701235}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6802","nonce":3358701235},{"type":"v1","addr":"172.21.15.78:6803","nonce":3358701235}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6806","nonce":3358701235},{"type":"v1","addr":"172.21.15.78:6807","nonce":3358701235}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6804","nonce":3358701235},{"type":"v1","addr":"172.21.15.78:6805","nonce":3358701235}]},"public_addr":"172.21.15.78:6801/3358701235","cluster_addr":"172.21.15.78:6803/3358701235","heartbeat_back_addr":"172.21.15.78:6807/3358701235","heartbeat_front_addr":"172.21.15.78:6805/3358701235","state":["exists","up"]},{"osd":1,"uuid":"e634831d-c4e2-48d9-870c-9556ae162981","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6808","nonce":3211476654},{"type":"v1","addr":"172.21.15.78:6809","nonce":3211476654}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6810","nonce":3211476654},{"type":"v1","addr":"172.21.15.78:6811","nonce":3211476654}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6814","nonce":3211476654},{"type":"v1","addr":"172.21.15.78:6815","nonce":3211476654}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6812","nonce":3211476654},{"type":"v1","addr":"172.21.15.78:6813","nonce":3211476654}]},"public_addr":"172.21.15.78:6809/3211476654","cluster_addr":"172.21.15.78:6811/3211476654","heartbeat_back_addr":"172.21.15.78:6815/3211476654","heartbeat_front_addr":"172.21.15.78:6813/3211476654","state":["exists","up"]},{"osd":2,"uuid":"274c8395-6534-41f0-b8fb-a00af8985aa8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6816","nonce":2532904479},{"type":"v1","addr":"172.21.15.78:6817","nonce":2532904479}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6818","nonce":2532904479},{"type":"v1","addr":"172.21.15.78:6819","nonce":2532904479}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6822","nonce":2532904479},{"type":"v1","addr":"172.21.15.78:6823","nonce":2532904479}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6820","nonce":2532904479},{"type":"v1","addr":"172.21.15.78:6821","nonce":2532904479}]},"public_addr":"172.21.15.78:6817/2532904479","cluster_addr":"172.21.15.78:6819/2532904479","heartbeat_back_addr":"172.21.15.78:6823/2532904479","heartbeat_front_addr":"172.21.15.78:6821/2532904479","state":["exists","up"]},{"osd":3,"uuid":"77acc9af-7d4d-4b18-8cf5-d62f5971b7c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6824","nonce":3442991267},{"type":"v1","addr":"172.21.15.78:6825","nonce":3442991267}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6826","nonce":3442991267},{"type":"v1","addr":"172.21.15.78:6827","nonce":3442991267}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6830","nonce":3442991267},{"type":"v1","addr":"172.21.15.78:6831","nonce":3442991267}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6828","nonce":3442991267},{"type":"v1","addr":"172.21.15.78:6829","nonce":3442991267}]},"public_addr":"172.21.15.78:6825/3442991267","cluster_addr":"172.21.15.78:6827/3442991267","heartbeat_back_addr":"172.21.15.78:6831/3442991267","heartbeat_front_addr":"172.21.15.78:6829/3442991267","state":["exists","up"]},{"osd":4,"uuid":"5c62bc66-6b34-4b7f-a66b-9a743969138c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":802983577},{"type":"v1","addr":"172.21.15.179:6809","nonce":802983577}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":802983577},{"type":"v1","addr":"172.21.15.179:6811","nonce":802983577}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":802983577},{"type":"v1","addr":"172.21.15.179:6815","nonce":802983577}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":802983577},{"type":"v1","addr":"172.21.15.179:6813","nonce":802983577}]},"public_addr":"172.21.15.179:6809/802983577","cluster_addr":"172.21.15.179:6811/802983577","heartbeat_back_addr":"172.21.15.179:6815/802983577","heartbeat_front_addr":"172.21.15.179:6813/802983577","state":["exists","up"]},{"osd":5,"uuid":"67db6d36-f684-4079-b0cd-82b4dd61461f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":518192887},{"type":"v1","addr":"172.21.15.179:6818","nonce":518192887}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":518192887},{"type":"v1","addr":"172.21.15.179:6822","nonce":518192887}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":518192887},{"type":"v1","addr":"172.21.15.179:6829","nonce":518192887}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6824","nonce":518192887},{"type":"v1","addr":"172.21.15.179:6826","nonce":518192887}]},"public_addr":"172.21.15.179:6818/518192887","cluster_addr":"172.21.15.179:6822/518192887","heartbeat_back_addr":"172.21.15.179:6829/518192887","heartbeat_front_addr":"172.21.15.179:6826/518192887","state":["exists","up"]},{"osd":6,"uuid":"12e670af-5a16-4c81-9f97-defa66cab967","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":815435378},{"type":"v1","addr":"172.21.15.179:6801","nonce":815435378}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":815435378},{"type":"v1","addr":"172.21.15.179:6803","nonce":815435378}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":815435378},{"type":"v1","addr":"172.21.15.179:6807","nonce":815435378}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":815435378},{"type":"v1","addr":"172.21.15.179:6805","nonce":815435378}]},"public_addr":"172.21.15.179:6801/815435378","cluster_addr":"172.21.15.179:6803/815435378","heartbeat_back_addr":"172.21.15.179:6807/815435378","heartbeat_front_addr":"172.21.15.179:6805/815435378","state":["exists","up"]},{"osd":7,"uuid":"fe630650-2eb3-49ad-8676-c341e6332eb1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6817","nonce":2848432339},{"type":"v1","addr":"172.21.15.179:6819","nonce":2848432339}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6821","nonce":2848432339},{"type":"v1","addr":"172.21.15.179:6823","nonce":2848432339}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":2848432339},{"type":"v1","addr":"172.21.15.179:6831","nonce":2848432339}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6825","nonce":2848432339},{"type":"v1","addr":"172.21.15.179:6827","nonce":2848432339}]},"public_addr":"172.21.15.179:6819/2848432339","cluster_addr":"172.21.15.179:6823/2848432339","heartbeat_back_addr":"172.21.15.179:6831/2848432339","heartbeat_front_addr":"172.21.15.179:6827/2848432339","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:58:49.255433+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:58:49.412880+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:58:49.559295+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:58:49.245237+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:58:49.184557+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:58:49.329851+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:58:49.366012+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:58:49.349604+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"6.2b","mappings":[{"from":5,"to":0}]},{"pgid":"8.28","mappings":[{"from":0,"to":6}]},{"pgid":"8.38","mappings":[{"from":0,"to":6}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-28T20:00:50.612 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:50.609+0000 7f20a79b8640 1 -- 172.21.15.78:0/638881292 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f2084066470 msgr2=0x7f2084068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:00:50.612 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:50.609+0000 7f20a79b8640 1 --2- 172.21.15.78:0/638881292 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f2084066470 0x7f2084068930 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f209c000f70 tx=0x7f209c007e50 comp rx=0 tx=0).stop 2023-11-28T20:00:50.613 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:50.609+0000 7f20a79b8640 1 -- 172.21.15.78:0/638881292 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f20a0154b50 msgr2=0x7f20a01f0470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:00:50.613 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:50.609+0000 7f20a79b8640 1 --2- 172.21.15.78:0/638881292 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f20a0154b50 0x7f20a01f0470 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f209800efc0 tx=0x7f209800c490 comp rx=0 tx=0).stop 2023-11-28T20:00:50.613 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:50.609+0000 7f20a79b8640 1 -- 172.21.15.78:0/638881292 shutdown_connections 2023-11-28T20:00:50.613 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:50.609+0000 7f20a79b8640 1 --2- 172.21.15.78:0/638881292 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f2084066470 0x7f2084068930 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:50.613 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:50.609+0000 7f20a79b8640 1 --2- 172.21.15.78:0/638881292 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f20a0151bf0 0x7f20a0147090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:50.613 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:50.609+0000 7f20a79b8640 1 --2- 172.21.15.78:0/638881292 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f20a0154b50 0x7f20a01f0470 unknown :-1 s=CLOSED pgs=525 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:50.613 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:50.609+0000 7f20a79b8640 1 --2- 172.21.15.78:0/638881292 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f20a006d890 0x7f20a00aadc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:50.613 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:50.609+0000 7f20a79b8640 1 -- 172.21.15.78:0/638881292 >> 172.21.15.78:0/638881292 conn(0x7f20a00c61f0 msgr2=0x7f20a006dc70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:00:50.613 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:50.609+0000 7f20a79b8640 1 -- 172.21.15.78:0/638881292 shutdown_connections 2023-11-28T20:00:50.613 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:50.609+0000 7f20a79b8640 1 -- 172.21.15.78:0/638881292 wait complete. 2023-11-28T20:00:50.632 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-11-28T20:00:50.770 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:50.765+0000 7f7523bb8640 1 Processor -- start 2023-11-28T20:00:50.770 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:50.765+0000 7f7523bb8640 1 -- start start 2023-11-28T20:00:50.772 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:50.765+0000 7f7523bb8640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f751c0a4f90 0x7f751c0c59c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:50.772 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:50.765+0000 7f7523bb8640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f751c072810 0x7f751c0c0800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:50.772 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:50.765+0000 7f7523bb8640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f751c1524b0 con 0x7f751c0a5370 2023-11-28T20:00:50.772 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:50.765+0000 7f7523bb8640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f751c0c62f0 con 0x7f751c072810 2023-11-28T20:00:50.772 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:50.765+0000 7f7523bb8640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f751c152770 con 0x7f751c0a4f90 2023-11-28T20:00:50.772 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:50.765+0000 7f7521153640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f751c0a5370 0x7f751c14f870 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:36596/0 (socket says 172.21.15.78:36596) 2023-11-28T20:00:50.772 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:50.765+0000 7f7521153640 1 -- 172.21.15.78:0/306798273 learned_addr learned my addr 172.21.15.78:0/306798273 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-11-28T20:00:50.773 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:50.765+0000 7f7521954640 1 --2- 172.21.15.78:0/306798273 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f751c0a4f90 0x7f751c0c59c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:50.773 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:50.765+0000 7f7522155640 1 --2- 172.21.15.78:0/306798273 >> v2:172.21.15.179:3300/0 conn(0x7f751c072810 0x7f751c0c0800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:50.773 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:50.769+0000 7f7520952640 1 -- 172.21.15.78:0/306798273 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1914404153 0 0) 0x7f751c1524b0 con 0x7f751c0a5370 2023-11-28T20:00:50.773 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:50.769+0000 7f7520952640 1 -- 172.21.15.78:0/306798273 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7508003530 con 0x7f751c0a5370 2023-11-28T20:00:50.773 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:50.769+0000 7f7521954640 1 -- 172.21.15.78:0/306798273 >> v2:172.21.15.179:3300/0 conn(0x7f751c072810 msgr2=0x7f751c0c0800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:00:50.773 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:50.769+0000 7f7521954640 1 --2- 172.21.15.78:0/306798273 >> v2:172.21.15.179:3300/0 conn(0x7f751c072810 0x7f751c0c0800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:50.773 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:50.769+0000 7f7521954640 1 -- 172.21.15.78:0/306798273 >> v1:172.21.15.78:6789/0 conn(0x7f751c0a5370 legacy=0x7f751c14f870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:00:50.773 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:50.769+0000 7f7521954640 1 -- 172.21.15.78:0/306798273 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f751c152a50 con 0x7f751c0a4f90 2023-11-28T20:00:50.775 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:50.769+0000 7f7521954640 1 --2- 172.21.15.78:0/306798273 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f751c0a4f90 0x7f751c0c59c0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f75180097c0 tx=0x7f751801c3f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3f41b02d6624f9d6 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:00:50.775 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:50.769+0000 7f7520952640 1 -- 172.21.15.78:0/306798273 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75180ab600 con 0x7f751c0a4f90 2023-11-28T20:00:50.775 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:50.769+0000 7f7520952640 1 -- 172.21.15.78:0/306798273 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f75180a7050 con 0x7f751c0a4f90 2023-11-28T20:00:50.775 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:50.769+0000 7f7520952640 1 -- 172.21.15.78:0/306798273 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75180ab980 con 0x7f751c0a4f90 2023-11-28T20:00:50.776 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:50.773+0000 7f7523bb8640 1 -- 172.21.15.78:0/306798273 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f751c0a4f90 msgr2=0x7f751c0c59c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:00:50.776 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:50.773+0000 7f7523bb8640 1 --2- 172.21.15.78:0/306798273 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f751c0a4f90 0x7f751c0c59c0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f75180097c0 tx=0x7f751801c3f0 comp rx=0 tx=0).stop 2023-11-28T20:00:50.776 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:50.773+0000 7f7523bb8640 1 -- 172.21.15.78:0/306798273 shutdown_connections 2023-11-28T20:00:50.777 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:50.773+0000 7f7523bb8640 1 --2- 172.21.15.78:0/306798273 >> v2:172.21.15.179:3300/0 conn(0x7f751c072810 0x7f751c0c0800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:50.777 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:50.773+0000 7f7523bb8640 1 --2- 172.21.15.78:0/306798273 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f751c0a4f90 0x7f751c0c59c0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:50.777 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:50.773+0000 7f7523bb8640 1 -- 172.21.15.78:0/306798273 >> 172.21.15.78:0/306798273 conn(0x7f751c06b220 msgr2=0x7f751c0a77e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:00:50.777 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:50.773+0000 7f7523bb8640 1 -- 172.21.15.78:0/306798273 shutdown_connections 2023-11-28T20:00:50.777 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:50.773+0000 7f7523bb8640 1 -- 172.21.15.78:0/306798273 wait complete. 2023-11-28T20:00:50.778 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:50.773+0000 7f7523bb8640 1 Processor -- start 2023-11-28T20:00:50.778 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:50.773+0000 7f7523bb8640 1 -- start start 2023-11-28T20:00:50.780 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:50.773+0000 7f7523bb8640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f751c072810 0x7f751c156fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:50.780 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:50.773+0000 7f7523bb8640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f751c0a4f90 0x7f751c14da80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:50.780 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:50.773+0000 7f7523bb8640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f751c0a5370 0x7f751c14dfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:50.780 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:50.773+0000 7f7523bb8640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f751c15b9c0 con 0x7f751c0a4f90 2023-11-28T20:00:50.780 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:50.773+0000 7f7523bb8640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f751c15b6e0 con 0x7f751c072810 2023-11-28T20:00:50.780 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:50.773+0000 7f7523bb8640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f751c1548b0 con 0x7f751c0a5370 2023-11-28T20:00:50.781 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:50.773+0000 7f7521153640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f751c0a4f90 0x7f751c14da80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:50.781 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:50.773+0000 7f7521153640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f751c0a4f90 0x7f751c14da80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:40038/0 (socket says 172.21.15.78:40038) 2023-11-28T20:00:50.781 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:50.773+0000 7f7521153640 1 -- 172.21.15.78:0/875817102 learned_addr learned my addr 172.21.15.78:0/875817102 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T20:00:50.781 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:50.773+0000 7f7522155640 1 --2- 172.21.15.78:0/875817102 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f751c0a5370 0x7f751c14dfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:50.781 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:50.773+0000 7f7521954640 1 --2- 172.21.15.78:0/875817102 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f751c072810 0x7f751c156fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:50.781 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:50.773+0000 7f7521153640 1 -- 172.21.15.78:0/875817102 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f751c0a5370 msgr2=0x7f751c14dfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:00:50.781 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:50.773+0000 7f7521153640 1 --2- 172.21.15.78:0/875817102 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f751c0a5370 0x7f751c14dfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:50.781 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:50.773+0000 7f7521153640 1 -- 172.21.15.78:0/875817102 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f751c072810 msgr2=0x7f751c156fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:00:50.781 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:50.773+0000 7f7521153640 1 --2- 172.21.15.78:0/875817102 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f751c072810 0x7f751c156fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:50.781 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:50.773+0000 7f7521153640 1 -- 172.21.15.78:0/875817102 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7518009420 con 0x7f751c0a4f90 2023-11-28T20:00:50.781 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:50.777+0000 7f7521153640 1 --2- 172.21.15.78:0/875817102 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f751c0a4f90 0x7f751c14da80 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7f750c00c420 tx=0x7f750c00c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:00:50.781 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:50.777+0000 7f75127fc640 1 -- 172.21.15.78:0/875817102 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f750c005cf0 con 0x7f751c0a4f90 2023-11-28T20:00:50.781 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:50.777+0000 7f75127fc640 1 -- 172.21.15.78:0/875817102 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f750c005e50 con 0x7f751c0a4f90 2023-11-28T20:00:50.782 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:50.777+0000 7f75127fc640 1 -- 172.21.15.78:0/875817102 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f750c0072d0 con 0x7f751c0a4f90 2023-11-28T20:00:50.782 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:50.777+0000 7f7523bb8640 1 -- 172.21.15.78:0/875817102 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f751c154b90 con 0x7f751c0a4f90 2023-11-28T20:00:50.782 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:50.777+0000 7f7523bb8640 1 -- 172.21.15.78:0/875817102 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f751c1574e0 con 0x7f751c0a4f90 2023-11-28T20:00:50.783 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:50.777+0000 7f7523bb8640 1 -- 172.21.15.78:0/875817102 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f751c067630 con 0x7f751c0a4f90 2023-11-28T20:00:50.783 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:50.777+0000 7f75127fc640 1 -- 172.21.15.78:0/875817102 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f750c007430 con 0x7f751c0a4f90 2023-11-28T20:00:50.783 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:50.777+0000 7f75127fc640 1 --2- 172.21.15.78:0/875817102 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f7500066470 0x7f7500068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:50.783 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:50.777+0000 7f75127fc640 1 -- 172.21.15.78:0/875817102 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 6972+0+0 (secure 0 0 0) 0x7f750c083880 con 0x7f751c0a4f90 2023-11-28T20:00:50.783 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:50.777+0000 7f7521954640 1 --2- 172.21.15.78:0/875817102 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f7500066470 0x7f7500068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:50.783 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:50.777+0000 7f7521954640 1 --2- 172.21.15.78:0/875817102 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f7500066470 0x7f7500068930 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f75180ad000 tx=0x7f7518008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:00:50.787 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:50.781+0000 7f75127fc640 1 -- 172.21.15.78:0/875817102 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f750c0508b0 con 0x7f751c0a4f90 2023-11-28T20:00:50.972 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:50.969+0000 7f7523bb8640 1 -- 172.21.15.78:0/875817102 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f751c06c6a0 con 0x7f751c0a4f90 2023-11-28T20:00:50.973 INFO:tasks.ceph.mon.a.smithi078.stderr:2023-11-28T20:00:50.969+0000 7f3f494a3640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-11-28T20:00:50.975 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:50.969+0000 7f75127fc640 1 -- 172.21.15.78:0/875817102 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v23) v1 ==== 161+0+0 (secure 0 0 0) 0x7f750c053ed0 con 0x7f751c0a4f90 2023-11-28T20:00:50.975 INFO:teuthology.orchestra.run.smithi078.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-11-28T20:00:50.979 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:50.973+0000 7f7523bb8640 1 -- 172.21.15.78:0/875817102 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f7500066470 msgr2=0x7f7500068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:00:50.979 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:50.973+0000 7f7523bb8640 1 --2- 172.21.15.78:0/875817102 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f7500066470 0x7f7500068930 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f75180ad000 tx=0x7f7518008040 comp rx=0 tx=0).stop 2023-11-28T20:00:50.979 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:50.973+0000 7f7523bb8640 1 -- 172.21.15.78:0/875817102 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f751c0a4f90 msgr2=0x7f751c14da80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:00:50.980 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:50.973+0000 7f7523bb8640 1 --2- 172.21.15.78:0/875817102 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f751c0a4f90 0x7f751c14da80 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7f750c00c420 tx=0x7f750c00c8e0 comp rx=0 tx=0).stop 2023-11-28T20:00:50.980 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:50.973+0000 7f7523bb8640 1 -- 172.21.15.78:0/875817102 shutdown_connections 2023-11-28T20:00:50.980 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:50.973+0000 7f7523bb8640 1 --2- 172.21.15.78:0/875817102 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f7500066470 0x7f7500068930 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:50.980 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:50.973+0000 7f7523bb8640 1 --2- 172.21.15.78:0/875817102 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f751c0a5370 0x7f751c14dfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:50.980 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:50.973+0000 7f7523bb8640 1 --2- 172.21.15.78:0/875817102 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f751c0a4f90 0x7f751c14da80 unknown :-1 s=CLOSED pgs=527 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:50.980 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:50.973+0000 7f7523bb8640 1 --2- 172.21.15.78:0/875817102 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f751c072810 0x7f751c156fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:50.981 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:50.973+0000 7f7523bb8640 1 -- 172.21.15.78:0/875817102 >> 172.21.15.78:0/875817102 conn(0x7f751c06b220 msgr2=0x7f751c151420 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:00:50.981 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:50.973+0000 7f7523bb8640 1 -- 172.21.15.78:0/875817102 shutdown_connections 2023-11-28T20:00:50.981 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:50.973+0000 7f7523bb8640 1 -- 172.21.15.78:0/875817102 wait complete. 2023-11-28T20:00:50.989 INFO:tasks.ceph.mds.c.smithi078.stderr: -2798> 2023-11-28T20:00:16.082+0000 7f5a68561640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-11-28T20:00:51.007 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-11-28T20:00:51.042 INFO:tasks.ceph.mds.c.smithi078.stdout:starting mds.c at 2023-11-28T20:00:51.152 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:51.145+0000 7f54797f8640 1 Processor -- start 2023-11-28T20:00:51.152 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:51.149+0000 7f54797f8640 1 -- start start 2023-11-28T20:00:51.153 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:51.149+0000 7f54797f8640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f547414fc30 0x7f54740c3cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:51.153 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:51.149+0000 7f54797f8640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f547406d840 0x7f54740c4210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:51.153 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:51.149+0000 7f54797f8640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5474152910 con 0x7f547414f850 2023-11-28T20:00:51.153 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:51.149+0000 7f54797f8640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f54740c2240 con 0x7f547406d840 2023-11-28T20:00:51.153 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:51.149+0000 7f54797f8640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5474152bf0 con 0x7f547414fc30 2023-11-28T20:00:51.153 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:51.149+0000 7f5472ffd640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f547414f850 0x7f54740aacf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:36616/0 (socket says 172.21.15.78:36616) 2023-11-28T20:00:51.153 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:51.149+0000 7f5472ffd640 1 -- 172.21.15.78:0/2335130823 learned_addr learned my addr 172.21.15.78:0/2335130823 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-11-28T20:00:51.154 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:51.149+0000 7f546a7fc640 1 --2- 172.21.15.78:0/2335130823 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f547414fc30 0x7f54740c3cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:51.154 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:51.149+0000 7f54737fe640 1 --2- 172.21.15.78:0/2335130823 >> v2:172.21.15.179:3300/0 conn(0x7f547406d840 0x7f54740c4210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:51.154 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:51.149+0000 7f54727fc640 1 -- 172.21.15.78:0/2335130823 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 82865259 0 0) 0x7f5474152910 con 0x7f547414f850 2023-11-28T20:00:51.154 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:51.149+0000 7f54727fc640 1 -- 172.21.15.78:0/2335130823 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5460003530 con 0x7f547414f850 2023-11-28T20:00:51.155 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:51.149+0000 7f54727fc640 1 -- 172.21.15.78:0/2335130823 <== mon.0 v1:172.21.15.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 425583614 0 0) 0x7f5460003530 con 0x7f547414f850 2023-11-28T20:00:51.155 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:51.149+0000 7f546a7fc640 1 -- 172.21.15.78:0/2335130823 >> v2:172.21.15.179:3300/0 conn(0x7f547406d840 msgr2=0x7f54740c4210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:00:51.155 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:51.149+0000 7f546a7fc640 1 --2- 172.21.15.78:0/2335130823 >> v2:172.21.15.179:3300/0 conn(0x7f547406d840 0x7f54740c4210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:51.155 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:51.149+0000 7f546a7fc640 1 -- 172.21.15.78:0/2335130823 >> v1:172.21.15.78:6789/0 conn(0x7f547414f850 legacy=0x7f54740aacf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:00:51.155 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:51.149+0000 7f546a7fc640 1 -- 172.21.15.78:0/2335130823 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5474152ed0 con 0x7f547414fc30 2023-11-28T20:00:51.156 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:51.153+0000 7f546a7fc640 1 --2- 172.21.15.78:0/2335130823 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f547414fc30 0x7f54740c3cd0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f545c0097c0 tx=0x7f545c01c3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a3ce7a7c825fd2b4 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:00:51.157 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:51.153+0000 7f54727fc640 1 -- 172.21.15.78:0/2335130823 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f545c0a4ea0 con 0x7f547414fc30 2023-11-28T20:00:51.157 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:51.153+0000 7f54727fc640 1 -- 172.21.15.78:0/2335130823 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f545c0a7050 con 0x7f547414fc30 2023-11-28T20:00:51.157 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:51.153+0000 7f54727fc640 1 -- 172.21.15.78:0/2335130823 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5464001680 con 0x7f547414fc30 2023-11-28T20:00:51.158 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:51.153+0000 7f54797f8640 1 -- 172.21.15.78:0/2335130823 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f547414fc30 msgr2=0x7f54740c3cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:00:51.158 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:51.153+0000 7f54797f8640 1 --2- 172.21.15.78:0/2335130823 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f547414fc30 0x7f54740c3cd0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f545c0097c0 tx=0x7f545c01c3a0 comp rx=0 tx=0).stop 2023-11-28T20:00:51.158 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:51.153+0000 7f54797f8640 1 -- 172.21.15.78:0/2335130823 shutdown_connections 2023-11-28T20:00:51.158 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:51.153+0000 7f54797f8640 1 --2- 172.21.15.78:0/2335130823 >> v2:172.21.15.179:3300/0 conn(0x7f547406d840 0x7f54740c4210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:51.158 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:51.153+0000 7f54797f8640 1 --2- 172.21.15.78:0/2335130823 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f547414fc30 0x7f54740c3cd0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:51.158 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:51.153+0000 7f54797f8640 1 -- 172.21.15.78:0/2335130823 >> 172.21.15.78:0/2335130823 conn(0x7f54740c59f0 msgr2=0x7f54740c5e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:00:51.159 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:51.153+0000 7f54797f8640 1 -- 172.21.15.78:0/2335130823 shutdown_connections 2023-11-28T20:00:51.159 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:51.153+0000 7f54797f8640 1 -- 172.21.15.78:0/2335130823 wait complete. 2023-11-28T20:00:51.159 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:51.153+0000 7f54797f8640 1 Processor -- start 2023-11-28T20:00:51.160 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:51.157+0000 7f54797f8640 1 -- start start 2023-11-28T20:00:51.161 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:51.157+0000 7f54797f8640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f547406d840 0x7f547414e460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:51.162 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:51.157+0000 7f54797f8640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f547414f850 0x7f547414a3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:51.162 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:51.157+0000 7f54797f8640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f547414fc30 0x7f547414a900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:51.162 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:51.157+0000 7f54797f8640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5474071d00 con 0x7f547414f850 2023-11-28T20:00:51.162 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:51.157+0000 7f54797f8640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5474071fe0 con 0x7f547414fc30 2023-11-28T20:00:51.162 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:51.157+0000 7f54797f8640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5474072800 con 0x7f547406d840 2023-11-28T20:00:51.162 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:51.157+0000 7f546a7fc640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f547414f850 0x7f547414a3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:51.162 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:51.157+0000 7f5472ffd640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f547406d840 0x7f547414e460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:51.162 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:51.157+0000 7f546a7fc640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f547414f850 0x7f547414a3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:40056/0 (socket says 172.21.15.78:40056) 2023-11-28T20:00:51.162 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:51.157+0000 7f546a7fc640 1 -- 172.21.15.78:0/648526313 learned_addr learned my addr 172.21.15.78:0/648526313 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T20:00:51.163 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:51.157+0000 7f54737fe640 1 --2- 172.21.15.78:0/648526313 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f547414fc30 0x7f547414a900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:51.163 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:51.157+0000 7f546a7fc640 1 -- 172.21.15.78:0/648526313 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f547406d840 msgr2=0x7f547414e460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:00:51.163 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:51.157+0000 7f546a7fc640 1 --2- 172.21.15.78:0/648526313 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f547406d840 0x7f547414e460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:51.163 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:51.157+0000 7f546a7fc640 1 -- 172.21.15.78:0/648526313 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f547414fc30 msgr2=0x7f547414a900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:00:51.163 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:51.157+0000 7f546a7fc640 1 --2- 172.21.15.78:0/648526313 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f547414fc30 0x7f547414a900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:51.163 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:51.157+0000 7f546a7fc640 1 -- 172.21.15.78:0/648526313 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f545c009420 con 0x7f547414f850 2023-11-28T20:00:51.163 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:51.157+0000 7f546a7fc640 1 --2- 172.21.15.78:0/648526313 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f547414f850 0x7f547414a3c0 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f545c01aa50 tx=0x7f545c019140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:00:51.164 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:51.157+0000 7f546bfff640 1 -- 172.21.15.78:0/648526313 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f545c0a4ea0 con 0x7f547414f850 2023-11-28T20:00:51.164 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:51.157+0000 7f546bfff640 1 -- 172.21.15.78:0/648526313 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f545c0b4410 con 0x7f547414f850 2023-11-28T20:00:51.165 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:51.157+0000 7f546bfff640 1 -- 172.21.15.78:0/648526313 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f545c0b47a0 con 0x7f547414f850 2023-11-28T20:00:51.165 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:51.157+0000 7f54797f8640 1 -- 172.21.15.78:0/648526313 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f547414c4a0 con 0x7f547414f850 2023-11-28T20:00:51.165 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:51.157+0000 7f54797f8640 1 -- 172.21.15.78:0/648526313 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f547414ae40 con 0x7f547414f850 2023-11-28T20:00:51.165 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:51.157+0000 7f54797f8640 1 -- 172.21.15.78:0/648526313 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5474067630 con 0x7f547414f850 2023-11-28T20:00:51.165 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:51.161+0000 7f546bfff640 1 -- 172.21.15.78:0/648526313 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f545c0b2040 con 0x7f547414f850 2023-11-28T20:00:51.166 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:51.161+0000 7f546bfff640 1 --2- 172.21.15.78:0/648526313 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f5454066470 0x7f5454068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:51.167 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:51.161+0000 7f546bfff640 1 -- 172.21.15.78:0/648526313 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 7058+0+0 (secure 0 0 0) 0x7f545c11e170 con 0x7f547414f850 2023-11-28T20:00:51.167 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:51.161+0000 7f5472ffd640 1 --2- 172.21.15.78:0/648526313 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f5454066470 0x7f5454068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:51.167 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:51.161+0000 7f5472ffd640 1 --2- 172.21.15.78:0/648526313 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f5454066470 0x7f5454068930 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f5464005890 tx=0x7f5464001660 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:00:51.169 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:51.165+0000 7f546bfff640 1 -- 172.21.15.78:0/648526313 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f545c0eb140 con 0x7f547414f850 2023-11-28T20:00:51.351 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:51.345+0000 7f54797f8640 1 -- 172.21.15.78:0/648526313 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f547415cc20 con 0x7f547414f850 2023-11-28T20:00:51.977 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:51.973+0000 7f546bfff640 1 -- 172.21.15.78:0/648526313 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v24) v1 ==== 104+0+0 (secure 0 0 0) 0x7f545c0ee760 con 0x7f547414f850 2023-11-28T20:00:51.980 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:51.977+0000 7f54797f8640 1 -- 172.21.15.78:0/648526313 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f5454066470 msgr2=0x7f5454068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:00:51.980 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:51.977+0000 7f54797f8640 1 --2- 172.21.15.78:0/648526313 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f5454066470 0x7f5454068930 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f5464005890 tx=0x7f5464001660 comp rx=0 tx=0).stop 2023-11-28T20:00:51.980 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:51.977+0000 7f54797f8640 1 -- 172.21.15.78:0/648526313 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f547414f850 msgr2=0x7f547414a3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:00:51.980 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:51.977+0000 7f54797f8640 1 --2- 172.21.15.78:0/648526313 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f547414f850 0x7f547414a3c0 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f545c01aa50 tx=0x7f545c019140 comp rx=0 tx=0).stop 2023-11-28T20:00:51.981 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:51.977+0000 7f54797f8640 1 -- 172.21.15.78:0/648526313 shutdown_connections 2023-11-28T20:00:51.981 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:51.977+0000 7f54797f8640 1 --2- 172.21.15.78:0/648526313 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f5454066470 0x7f5454068930 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:51.981 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:51.977+0000 7f54797f8640 1 --2- 172.21.15.78:0/648526313 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f547414fc30 0x7f547414a900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:51.981 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:51.977+0000 7f54797f8640 1 --2- 172.21.15.78:0/648526313 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f547414f850 0x7f547414a3c0 unknown :-1 s=CLOSED pgs=531 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:51.981 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:51.977+0000 7f54797f8640 1 --2- 172.21.15.78:0/648526313 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f547406d840 0x7f547414e460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:51.981 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:51.977+0000 7f54797f8640 1 -- 172.21.15.78:0/648526313 >> 172.21.15.78:0/648526313 conn(0x7f54740c59f0 msgr2=0x7f54740c5dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:00:51.981 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:51.977+0000 7f54797f8640 1 -- 172.21.15.78:0/648526313 shutdown_connections 2023-11-28T20:00:51.981 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:51.977+0000 7f54797f8640 1 -- 172.21.15.78:0/648526313 wait complete. 2023-11-28T20:00:52.005 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-11-28T20:00:52.192 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:52.185+0000 7f8d5c854640 1 Processor -- start 2023-11-28T20:00:52.192 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:52.185+0000 7f8d5c854640 1 -- start start 2023-11-28T20:00:52.194 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:52.189+0000 7f8d5c854640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f8d5814f850 0x7f8d580aacf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:52.195 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:52.189+0000 7f8d5c854640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8d5806d840 0x7f8d580c43e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:52.195 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:52.189+0000 7f8d5c854640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8d58152910 con 0x7f8d5814fc30 2023-11-28T20:00:52.195 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:52.189+0000 7f8d5c854640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8d580c2240 con 0x7f8d5814f850 2023-11-28T20:00:52.195 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:52.189+0000 7f8d5c854640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8d58152bf0 con 0x7f8d5806d840 2023-11-28T20:00:52.195 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:52.189+0000 7f8d4dd9b640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f8d5814fc30 0x7f8d580c3cd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:36620/0 (socket says 172.21.15.78:36620) 2023-11-28T20:00:52.196 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:52.189+0000 7f8d5659c640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f8d5814f850 0x7f8d580aacf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:52.196 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:52.189+0000 7f8d4dd9b640 1 -- 172.21.15.78:0/2166368801 learned_addr learned my addr 172.21.15.78:0/2166368801 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-11-28T20:00:52.196 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:52.189+0000 7f8d56d9d640 1 --2- 172.21.15.78:0/2166368801 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8d5806d840 0x7f8d580c43e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:52.196 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:52.189+0000 7f8d5659c640 1 -- 172.21.15.78:0/2166368801 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8d5806d840 msgr2=0x7f8d580c43e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:00:52.196 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:52.189+0000 7f8d5659c640 1 --2- 172.21.15.78:0/2166368801 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8d5806d840 0x7f8d580c43e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:52.196 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:52.189+0000 7f8d5659c640 1 -- 172.21.15.78:0/2166368801 >> v1:172.21.15.78:6789/0 conn(0x7f8d5814fc30 legacy=0x7f8d580c3cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:00:52.196 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:52.189+0000 7f8d5659c640 1 -- 172.21.15.78:0/2166368801 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d58152ed0 con 0x7f8d5814f850 2023-11-28T20:00:52.198 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:52.193+0000 7f8d5659c640 1 --2- 172.21.15.78:0/2166368801 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8d5814f850 0x7f8d580aacf0 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7f8d48009d90 tx=0x7f8d4801c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9876d1a9dfa50113 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:00:52.198 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:52.193+0000 7f8d55d9b640 1 -- 172.21.15.78:0/2166368801 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d480a5a30 con 0x7f8d5814f850 2023-11-28T20:00:52.198 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:52.193+0000 7f8d55d9b640 1 -- 172.21.15.78:0/2166368801 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d480a5b90 con 0x7f8d5814f850 2023-11-28T20:00:52.198 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:52.193+0000 7f8d55d9b640 1 -- 172.21.15.78:0/2166368801 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d480ad440 con 0x7f8d5814f850 2023-11-28T20:00:52.199 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:52.193+0000 7f8d5c854640 1 -- 172.21.15.78:0/2166368801 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8d5814f850 msgr2=0x7f8d580aacf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:00:52.199 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:52.193+0000 7f8d5c854640 1 --2- 172.21.15.78:0/2166368801 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8d5814f850 0x7f8d580aacf0 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7f8d48009d90 tx=0x7f8d4801c950 comp rx=0 tx=0).stop 2023-11-28T20:00:52.199 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:52.193+0000 7f8d5c854640 1 -- 172.21.15.78:0/2166368801 shutdown_connections 2023-11-28T20:00:52.199 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:52.193+0000 7f8d5c854640 1 --2- 172.21.15.78:0/2166368801 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8d5806d840 0x7f8d580c43e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:52.199 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:52.193+0000 7f8d5c854640 1 --2- 172.21.15.78:0/2166368801 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8d5814f850 0x7f8d580aacf0 unknown :-1 s=CLOSED pgs=533 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:52.199 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:52.193+0000 7f8d5c854640 1 -- 172.21.15.78:0/2166368801 >> 172.21.15.78:0/2166368801 conn(0x7f8d580c59f0 msgr2=0x7f8d580c5e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:00:52.200 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:52.193+0000 7f8d5c854640 1 -- 172.21.15.78:0/2166368801 shutdown_connections 2023-11-28T20:00:52.200 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:52.193+0000 7f8d5c854640 1 -- 172.21.15.78:0/2166368801 wait complete. 2023-11-28T20:00:52.203 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:52.193+0000 7f8d5c854640 1 Processor -- start 2023-11-28T20:00:52.203 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:52.193+0000 7f8d5c854640 1 -- start start 2023-11-28T20:00:52.203 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:52.197+0000 7f8d5c854640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8d5806d840 0x7f8d5806cd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:52.203 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:52.197+0000 7f8d5c854640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8d5814f850 0x7f8d5806fac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:52.203 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:52.197+0000 7f8d5c854640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8d5814fc30 0x7f8d58070000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:52.203 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:52.197+0000 7f8d5c854640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d58156670 con 0x7f8d5814f850 2023-11-28T20:00:52.203 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:52.197+0000 7f8d5c854640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d58148740 con 0x7f8d5814fc30 2023-11-28T20:00:52.204 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:52.197+0000 7f8d5c854640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8d58148a20 con 0x7f8d5806d840 2023-11-28T20:00:52.204 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:52.197+0000 7f8d4dd9b640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8d5814f850 0x7f8d5806fac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:52.204 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:52.197+0000 7f8d4dd9b640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8d5814f850 0x7f8d5806fac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:40072/0 (socket says 172.21.15.78:40072) 2023-11-28T20:00:52.204 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:52.197+0000 7f8d4dd9b640 1 -- 172.21.15.78:0/776663616 learned_addr learned my addr 172.21.15.78:0/776663616 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T20:00:52.204 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:52.197+0000 7f8d5659c640 1 --2- 172.21.15.78:0/776663616 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8d5806d840 0x7f8d5806cd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:52.204 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:52.197+0000 7f8d56d9d640 1 --2- 172.21.15.78:0/776663616 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8d5814fc30 0x7f8d58070000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:52.204 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:52.197+0000 7f8d4dd9b640 1 -- 172.21.15.78:0/776663616 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8d5806d840 msgr2=0x7f8d5806cd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:00:52.204 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:52.197+0000 7f8d4dd9b640 1 --2- 172.21.15.78:0/776663616 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8d5806d840 0x7f8d5806cd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:52.204 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:52.197+0000 7f8d4dd9b640 1 -- 172.21.15.78:0/776663616 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8d5814fc30 msgr2=0x7f8d58070000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:00:52.204 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:52.197+0000 7f8d4dd9b640 1 --2- 172.21.15.78:0/776663616 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8d5814fc30 0x7f8d58070000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:52.204 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:52.197+0000 7f8d4dd9b640 1 -- 172.21.15.78:0/776663616 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d48009a70 con 0x7f8d5814f850 2023-11-28T20:00:52.204 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:52.197+0000 7f8d56d9d640 1 --2- 172.21.15.78:0/776663616 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8d5814fc30 0x7f8d58070000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T20:00:52.205 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:52.197+0000 7f8d4dd9b640 1 --2- 172.21.15.78:0/776663616 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8d5814f850 0x7f8d5806fac0 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7f8d40007fd0 tx=0x7f8d4000c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:00:52.205 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:52.197+0000 7f8d4f7fe640 1 -- 172.21.15.78:0/776663616 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d40005cf0 con 0x7f8d5814f850 2023-11-28T20:00:52.205 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:52.197+0000 7f8d4f7fe640 1 -- 172.21.15.78:0/776663616 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d40005e70 con 0x7f8d5814f850 2023-11-28T20:00:52.205 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:52.197+0000 7f8d4f7fe640 1 -- 172.21.15.78:0/776663616 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d400072f0 con 0x7f8d5814f850 2023-11-28T20:00:52.205 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:52.197+0000 7f8d5c854640 1 -- 172.21.15.78:0/776663616 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8d58149e30 con 0x7f8d5814f850 2023-11-28T20:00:52.205 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:52.197+0000 7f8d5c854640 1 -- 172.21.15.78:0/776663616 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8d5814a3f0 con 0x7f8d5814f850 2023-11-28T20:00:52.205 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:52.197+0000 7f8d5c854640 1 -- 172.21.15.78:0/776663616 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8d58067630 con 0x7f8d5814f850 2023-11-28T20:00:52.206 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:52.201+0000 7f8d4f7fe640 1 -- 172.21.15.78:0/776663616 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f8d40007450 con 0x7f8d5814f850 2023-11-28T20:00:52.206 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:52.201+0000 7f8d4f7fe640 1 --2- 172.21.15.78:0/776663616 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f8d380664a0 0x7f8d38068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:52.206 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:52.201+0000 7f8d4f7fe640 1 -- 172.21.15.78:0/776663616 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 7058+0+0 (secure 0 0 0) 0x7f8d40083920 con 0x7f8d5814f850 2023-11-28T20:00:52.206 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:52.201+0000 7f8d5659c640 1 --2- 172.21.15.78:0/776663616 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f8d380664a0 0x7f8d38068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:52.206 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:52.201+0000 7f8d5659c640 1 --2- 172.21.15.78:0/776663616 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f8d380664a0 0x7f8d38068960 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f8d480af000 tx=0x7f8d480a7070 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:00:52.209 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:52.205+0000 7f8d4f7fe640 1 -- 172.21.15.78:0/776663616 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f8d40050860 con 0x7f8d5814f850 2023-11-28T20:00:52.361 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:52.353+0000 7f8d5c854640 1 -- 172.21.15.78:0/776663616 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f8d580c5150 con 0x7f8d5814f850 2023-11-28T20:00:52.985 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:52.981+0000 7f8d4f7fe640 1 -- 172.21.15.78:0/776663616 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v48) v1 ==== 181+0+0 (secure 0 0 0) 0x7f8d40053e80 con 0x7f8d5814f850 2023-11-28T20:00:52.985 INFO:teuthology.orchestra.run.smithi078.stderr:pool 'cephfs_metadata' removed 2023-11-28T20:00:52.987 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:52.981+0000 7f8d5c854640 1 -- 172.21.15.78:0/776663616 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f8d380664a0 msgr2=0x7f8d38068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:00:52.988 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:52.981+0000 7f8d5c854640 1 --2- 172.21.15.78:0/776663616 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f8d380664a0 0x7f8d38068960 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f8d480af000 tx=0x7f8d480a7070 comp rx=0 tx=0).stop 2023-11-28T20:00:52.988 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:52.981+0000 7f8d5c854640 1 -- 172.21.15.78:0/776663616 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8d5814f850 msgr2=0x7f8d5806fac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:00:52.988 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:52.981+0000 7f8d5c854640 1 --2- 172.21.15.78:0/776663616 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8d5814f850 0x7f8d5806fac0 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7f8d40007fd0 tx=0x7f8d4000c890 comp rx=0 tx=0).stop 2023-11-28T20:00:52.988 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:52.981+0000 7f8d5c854640 1 -- 172.21.15.78:0/776663616 shutdown_connections 2023-11-28T20:00:52.988 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:52.981+0000 7f8d5c854640 1 --2- 172.21.15.78:0/776663616 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f8d380664a0 0x7f8d38068960 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:52.988 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:52.981+0000 7f8d5c854640 1 --2- 172.21.15.78:0/776663616 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8d5814fc30 0x7f8d58070000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:52.988 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:52.981+0000 7f8d5c854640 1 --2- 172.21.15.78:0/776663616 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8d5814f850 0x7f8d5806fac0 unknown :-1 s=CLOSED pgs=534 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:52.988 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:52.981+0000 7f8d5c854640 1 --2- 172.21.15.78:0/776663616 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8d5806d840 0x7f8d5806cd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:52.988 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:52.981+0000 7f8d5c854640 1 -- 172.21.15.78:0/776663616 >> 172.21.15.78:0/776663616 conn(0x7f8d580c59f0 msgr2=0x7f8d5815c650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:00:52.989 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:52.981+0000 7f8d5c854640 1 -- 172.21.15.78:0/776663616 shutdown_connections 2023-11-28T20:00:52.989 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:52.981+0000 7f8d5c854640 1 -- 172.21.15.78:0/776663616 wait complete. 2023-11-28T20:00:53.014 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-11-28T20:00:53.156 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:53.153+0000 7fed64901640 1 Processor -- start 2023-11-28T20:00:53.156 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:53.153+0000 7fed64901640 1 -- start start 2023-11-28T20:00:53.158 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:53.153+0000 7fed64901640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fed6014e2a0 0x7fed601516a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:53.158 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:53.153+0000 7fed64901640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fed600a9460 0x7fed600c4180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:53.158 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:53.153+0000 7fed64901640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fed60151210 con 0x7fed600a9910 2023-11-28T20:00:53.158 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:53.153+0000 7fed64901640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fed6014e680 con 0x7fed6014e2a0 2023-11-28T20:00:53.158 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:53.153+0000 7fed64901640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fed60150be0 con 0x7fed600a9460 2023-11-28T20:00:53.158 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:53.153+0000 7fed5e59c640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fed6014e2a0 0x7fed601516a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:53.159 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:53.153+0000 7fed5e59c640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fed6014e2a0 0x7fed601516a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:40088/0 (socket says 172.21.15.78:40088) 2023-11-28T20:00:53.159 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:53.153+0000 7fed5e59c640 1 -- 172.21.15.78:0/2583658175 learned_addr learned my addr 172.21.15.78:0/2583658175 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T20:00:53.159 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:53.153+0000 7fed5dd9b640 1 --2- 172.21.15.78:0/2583658175 >> v2:172.21.15.179:3300/0 conn(0x7fed600a9460 0x7fed600c4180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:53.159 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:53.153+0000 7fed5e59c640 1 -- 172.21.15.78:0/2583658175 >> v2:172.21.15.179:3300/0 conn(0x7fed600a9460 msgr2=0x7fed600c4180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:00:53.159 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:53.153+0000 7fed5e59c640 1 --2- 172.21.15.78:0/2583658175 >> v2:172.21.15.179:3300/0 conn(0x7fed600a9460 0x7fed600c4180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:53.159 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:53.153+0000 7fed5e59c640 1 -- 172.21.15.78:0/2583658175 >> v1:172.21.15.179:6789/0 conn(0x7fed600a9910 legacy=0x7fed6006bc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:00:53.159 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:53.153+0000 7fed5e59c640 1 -- 172.21.15.78:0/2583658175 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed600c53c0 con 0x7fed6014e2a0 2023-11-28T20:00:53.161 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:53.157+0000 7fed5e59c640 1 --2- 172.21.15.78:0/2583658175 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fed6014e2a0 0x7fed601516a0 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7fed60066f50 tx=0x7fed5001c4c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=828e8d9eafaf5cc7 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:00:53.161 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:53.157+0000 7fed5d59a640 1 -- 172.21.15.78:0/2583658175 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed500ac630 con 0x7fed6014e2a0 2023-11-28T20:00:53.161 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:53.157+0000 7fed5d59a640 1 -- 172.21.15.78:0/2583658175 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed500ac790 con 0x7fed6014e2a0 2023-11-28T20:00:53.161 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:53.157+0000 7fed5d59a640 1 -- 172.21.15.78:0/2583658175 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed500acb20 con 0x7fed6014e2a0 2023-11-28T20:00:53.162 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:53.157+0000 7fed64901640 1 -- 172.21.15.78:0/2583658175 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fed6014e2a0 msgr2=0x7fed601516a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:00:53.162 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:53.157+0000 7fed64901640 1 --2- 172.21.15.78:0/2583658175 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fed6014e2a0 0x7fed601516a0 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7fed60066f50 tx=0x7fed5001c4c0 comp rx=0 tx=0).stop 2023-11-28T20:00:53.162 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:53.157+0000 7fed64901640 1 -- 172.21.15.78:0/2583658175 shutdown_connections 2023-11-28T20:00:53.163 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:53.157+0000 7fed64901640 1 --2- 172.21.15.78:0/2583658175 >> v2:172.21.15.179:3300/0 conn(0x7fed600a9460 0x7fed600c4180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:53.163 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:53.157+0000 7fed64901640 1 --2- 172.21.15.78:0/2583658175 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fed6014e2a0 0x7fed601516a0 unknown :-1 s=CLOSED pgs=535 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:53.163 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:53.157+0000 7fed64901640 1 -- 172.21.15.78:0/2583658175 >> 172.21.15.78:0/2583658175 conn(0x7fed600c59f0 msgr2=0x7fed600c5e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:00:53.163 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:53.157+0000 7fed64901640 1 -- 172.21.15.78:0/2583658175 shutdown_connections 2023-11-28T20:00:53.163 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:53.157+0000 7fed64901640 1 -- 172.21.15.78:0/2583658175 wait complete. 2023-11-28T20:00:53.164 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:53.161+0000 7fed64901640 1 Processor -- start 2023-11-28T20:00:53.164 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:53.161+0000 7fed64901640 1 -- start start 2023-11-28T20:00:53.165 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:53.161+0000 7fed64901640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fed600a9460 0x7fed6014d2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:53.166 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:53.161+0000 7fed64901640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fed600a9910 0x7fed6014c260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:53.166 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:53.161+0000 7fed64901640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fed6014e2a0 0x7fed6014c7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:53.166 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:53.161+0000 7fed64901640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed60072120 con 0x7fed600a9460 2023-11-28T20:00:53.166 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:53.161+0000 7fed64901640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed601479d0 con 0x7fed6014e2a0 2023-11-28T20:00:53.166 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:53.161+0000 7fed64901640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fed601ed740 con 0x7fed600a9910 2023-11-28T20:00:53.166 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:53.161+0000 7fed5e59c640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fed600a9460 0x7fed6014d2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:53.166 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:53.161+0000 7fed5e59c640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fed600a9460 0x7fed6014d2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:40100/0 (socket says 172.21.15.78:40100) 2023-11-28T20:00:53.166 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:53.161+0000 7fed5e59c640 1 -- 172.21.15.78:0/540083333 learned_addr learned my addr 172.21.15.78:0/540083333 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T20:00:53.166 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:53.161+0000 7fed5dd9b640 1 --2- 172.21.15.78:0/540083333 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fed600a9910 0x7fed6014c260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:53.166 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:53.161+0000 7fed5ed9d640 1 --2- 172.21.15.78:0/540083333 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fed6014e2a0 0x7fed6014c7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:53.166 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:53.161+0000 7fed5e59c640 1 -- 172.21.15.78:0/540083333 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fed600a9910 msgr2=0x7fed6014c260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:00:53.167 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:53.161+0000 7fed5e59c640 1 --2- 172.21.15.78:0/540083333 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fed600a9910 0x7fed6014c260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:53.167 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:53.161+0000 7fed5e59c640 1 -- 172.21.15.78:0/540083333 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fed6014e2a0 msgr2=0x7fed6014c7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:00:53.167 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:53.161+0000 7fed5e59c640 1 --2- 172.21.15.78:0/540083333 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fed6014e2a0 0x7fed6014c7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:53.167 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:53.161+0000 7fed5e59c640 1 -- 172.21.15.78:0/540083333 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed500094d0 con 0x7fed600a9460 2023-11-28T20:00:53.168 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:53.161+0000 7fed5e59c640 1 --2- 172.21.15.78:0/540083333 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fed600a9460 0x7fed6014d2f0 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7fed500af040 tx=0x7fed5001ad00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:00:53.168 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:53.161+0000 7fed4effd640 1 -- 172.21.15.78:0/540083333 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed500b7620 con 0x7fed600a9460 2023-11-28T20:00:53.168 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:53.161+0000 7fed4effd640 1 -- 172.21.15.78:0/540083333 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed500b77a0 con 0x7fed600a9460 2023-11-28T20:00:53.168 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:53.161+0000 7fed4effd640 1 -- 172.21.15.78:0/540083333 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed500b7b50 con 0x7fed600a9460 2023-11-28T20:00:53.168 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:53.161+0000 7fed64901640 1 -- 172.21.15.78:0/540083333 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fed6014cce0 con 0x7fed600a9460 2023-11-28T20:00:53.168 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:53.161+0000 7fed64901640 1 -- 172.21.15.78:0/540083333 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fed60154e70 con 0x7fed600a9460 2023-11-28T20:00:53.168 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:53.161+0000 7fed64901640 1 -- 172.21.15.78:0/540083333 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fed60067630 con 0x7fed600a9460 2023-11-28T20:00:53.169 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:53.165+0000 7fed4effd640 1 -- 172.21.15.78:0/540083333 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fed500b3040 con 0x7fed600a9460 2023-11-28T20:00:53.169 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:53.165+0000 7fed4effd640 1 --2- 172.21.15.78:0/540083333 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fed40066470 0x7fed40068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:53.169 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:53.165+0000 7fed4effd640 1 -- 172.21.15.78:0/540083333 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6620+0+0 (secure 0 0 0) 0x7fed5011e5f0 con 0x7fed600a9460 2023-11-28T20:00:53.169 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:53.165+0000 7fed5dd9b640 1 --2- 172.21.15.78:0/540083333 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fed40066470 0x7fed40068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:53.170 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:53.165+0000 7fed5dd9b640 1 --2- 172.21.15.78:0/540083333 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fed40066470 0x7fed40068930 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fed6006c230 tx=0x7fed54008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:00:53.173 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:53.169+0000 7fed4effd640 1 -- 172.21.15.78:0/540083333 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fed500eb8a0 con 0x7fed600a9460 2023-11-28T20:00:53.323 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:53.317+0000 7fed64901640 1 -- 172.21.15.78:0/540083333 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fed60148630 con 0x7fed600a9460 2023-11-28T20:00:53.991 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:53.985+0000 7fed4effd640 1 -- 172.21.15.78:0/540083333 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v49) v1 ==== 169+0+0 (secure 0 0 0) 0x7fed500eeec0 con 0x7fed600a9460 2023-11-28T20:00:53.992 INFO:teuthology.orchestra.run.smithi078.stderr:pool 'cephfs_data' removed 2023-11-28T20:00:53.994 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:53.989+0000 7fed64901640 1 -- 172.21.15.78:0/540083333 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fed40066470 msgr2=0x7fed40068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:00:53.994 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:53.989+0000 7fed64901640 1 --2- 172.21.15.78:0/540083333 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fed40066470 0x7fed40068930 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fed6006c230 tx=0x7fed54008040 comp rx=0 tx=0).stop 2023-11-28T20:00:53.994 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:53.989+0000 7fed64901640 1 -- 172.21.15.78:0/540083333 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fed600a9460 msgr2=0x7fed6014d2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:00:53.994 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:53.989+0000 7fed64901640 1 --2- 172.21.15.78:0/540083333 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fed600a9460 0x7fed6014d2f0 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7fed500af040 tx=0x7fed5001ad00 comp rx=0 tx=0).stop 2023-11-28T20:00:53.998 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:53.989+0000 7fed64901640 1 -- 172.21.15.78:0/540083333 shutdown_connections 2023-11-28T20:00:53.998 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:53.989+0000 7fed64901640 1 --2- 172.21.15.78:0/540083333 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fed40066470 0x7fed40068930 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:53.998 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:53.989+0000 7fed64901640 1 --2- 172.21.15.78:0/540083333 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fed600a9910 0x7fed6014c260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:53.998 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:53.989+0000 7fed64901640 1 --2- 172.21.15.78:0/540083333 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fed6014e2a0 0x7fed6014c7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:53.998 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:53.989+0000 7fed64901640 1 --2- 172.21.15.78:0/540083333 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fed600a9460 0x7fed6014d2f0 unknown :-1 s=CLOSED pgs=536 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:53.998 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:53.989+0000 7fed64901640 1 -- 172.21.15.78:0/540083333 >> 172.21.15.78:0/540083333 conn(0x7fed600c59f0 msgr2=0x7fed600c3c50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:00:53.998 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:53.993+0000 7fed64901640 1 -- 172.21.15.78:0/540083333 shutdown_connections 2023-11-28T20:00:53.999 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:53.993+0000 7fed64901640 1 -- 172.21.15.78:0/540083333 wait complete. 2023-11-28T20:00:54.018 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-28T20:00:54.157 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:54.153+0000 7fce03157640 1 Processor -- start 2023-11-28T20:00:54.158 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:54.153+0000 7fce03157640 1 -- start start 2023-11-28T20:00:54.159 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:54.153+0000 7fce03157640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fcdfc06d690 0x7fcdfc0c5300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:54.159 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:54.153+0000 7fce03157640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcdfc06db20 con 0x7fcdfc0c3b80 2023-11-28T20:00:54.159 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:54.153+0000 7fce03157640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcdfc06bb80 con 0x7fcdfc06d2b0 2023-11-28T20:00:54.159 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:54.153+0000 7fce03157640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcdfc0c5840 con 0x7fcdfc06d690 2023-11-28T20:00:54.159 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:54.153+0000 7fcdfbfff640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7fcdfc0c3b80 0x7fcdfc06c730 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:36636/0 (socket says 172.21.15.78:36636) 2023-11-28T20:00:54.159 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:54.153+0000 7fcdfbfff640 1 -- 172.21.15.78:0/2445605822 learned_addr learned my addr 172.21.15.78:0/2445605822 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-11-28T20:00:54.159 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:54.153+0000 7fce016f4640 1 --2- 172.21.15.78:0/2445605822 >> v2:172.21.15.78:3300/0 conn(0x7fcdfc06d690 0x7fcdfc0c5300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:54.160 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:54.153+0000 7fcdfb7fe640 1 -- 172.21.15.78:0/2445605822 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1183074772 0 0) 0x7fcde8001120 con 0x7fcdfc0c3b80 2023-11-28T20:00:54.160 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:54.153+0000 7fcdfb7fe640 1 -- 172.21.15.78:0/2445605822 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcdec005740 con 0x7fcdfc0c3b80 2023-11-28T20:00:54.160 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:54.153+0000 7fce016f4640 1 -- 172.21.15.78:0/2445605822 >> v1:172.21.15.179:6789/0 conn(0x7fcdfc06d2b0 legacy=0x7fcdfc06c020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:00:54.160 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:54.153+0000 7fce016f4640 1 -- 172.21.15.78:0/2445605822 >> v1:172.21.15.78:6789/0 conn(0x7fcdfc0c3b80 legacy=0x7fcdfc06c730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:00:54.160 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:54.153+0000 7fce016f4640 1 -- 172.21.15.78:0/2445605822 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcdfc1515c0 con 0x7fcdfc06d690 2023-11-28T20:00:54.162 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:54.157+0000 7fce016f4640 1 --2- 172.21.15.78:0/2445605822 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcdfc06d690 0x7fcdfc0c5300 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7fcdf4009d90 tx=0x7fcdf401c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=79802766b336dda6 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:00:54.163 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:54.157+0000 7fcdfb7fe640 1 -- 172.21.15.78:0/2445605822 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcdf40a57f0 con 0x7fcdfc06d690 2023-11-28T20:00:54.163 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:54.157+0000 7fcdfb7fe640 1 -- 172.21.15.78:0/2445605822 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcdf40a5950 con 0x7fcdfc06d690 2023-11-28T20:00:54.163 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:54.157+0000 7fcdfb7fe640 1 -- 172.21.15.78:0/2445605822 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcdf40a5ce0 con 0x7fcdfc06d690 2023-11-28T20:00:54.164 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:54.157+0000 7fce03157640 1 -- 172.21.15.78:0/2445605822 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcdfc06d690 msgr2=0x7fcdfc0c5300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:00:54.164 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:54.157+0000 7fce03157640 1 --2- 172.21.15.78:0/2445605822 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcdfc06d690 0x7fcdfc0c5300 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7fcdf4009d90 tx=0x7fcdf401c920 comp rx=0 tx=0).stop 2023-11-28T20:00:54.164 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:54.157+0000 7fce03157640 1 -- 172.21.15.78:0/2445605822 shutdown_connections 2023-11-28T20:00:54.164 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:54.157+0000 7fce03157640 1 --2- 172.21.15.78:0/2445605822 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcdfc06d690 0x7fcdfc0c5300 unknown :-1 s=CLOSED pgs=538 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:54.164 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:54.157+0000 7fce03157640 1 -- 172.21.15.78:0/2445605822 >> 172.21.15.78:0/2445605822 conn(0x7fcdfc0a7810 msgr2=0x7fcdfc0a7c20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:00:54.164 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:54.157+0000 7fce03157640 1 -- 172.21.15.78:0/2445605822 shutdown_connections 2023-11-28T20:00:54.164 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:54.157+0000 7fce03157640 1 -- 172.21.15.78:0/2445605822 wait complete. 2023-11-28T20:00:54.165 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:54.161+0000 7fce03157640 1 Processor -- start 2023-11-28T20:00:54.165 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:54.161+0000 7fce03157640 1 -- start start 2023-11-28T20:00:54.167 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:54.161+0000 7fce03157640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcdfc06d2b0 0x7fcdfc0bee90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:54.167 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:54.161+0000 7fce03157640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcdfc06d690 0x7fcdfc1ed0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:54.168 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:54.161+0000 7fce03157640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcdfc0c3b80 0x7fcdfc1ed610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:54.168 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:54.161+0000 7fce03157640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcdfc1ecc80 con 0x7fcdfc0c3b80 2023-11-28T20:00:54.168 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:54.161+0000 7fce03157640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcdfc1edb50 con 0x7fcdfc06d2b0 2023-11-28T20:00:54.168 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:54.161+0000 7fce03157640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcdfc1f0610 con 0x7fcdfc06d690 2023-11-28T20:00:54.168 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:54.161+0000 7fce016f4640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcdfc0c3b80 0x7fcdfc1ed610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:54.168 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:54.161+0000 7fce016f4640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcdfc0c3b80 0x7fcdfc1ed610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:40130/0 (socket says 172.21.15.78:40130) 2023-11-28T20:00:54.168 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:54.161+0000 7fce016f4640 1 -- 172.21.15.78:0/1777135314 learned_addr learned my addr 172.21.15.78:0/1777135314 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T20:00:54.168 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:54.161+0000 7fce00ef3640 1 --2- 172.21.15.78:0/1777135314 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcdfc06d2b0 0x7fcdfc0bee90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:54.169 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:54.161+0000 7fcdfbfff640 1 --2- 172.21.15.78:0/1777135314 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcdfc06d690 0x7fcdfc1ed0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:54.169 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:54.161+0000 7fce016f4640 1 -- 172.21.15.78:0/1777135314 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcdfc06d690 msgr2=0x7fcdfc1ed0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:00:54.169 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:54.161+0000 7fce016f4640 1 --2- 172.21.15.78:0/1777135314 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcdfc06d690 0x7fcdfc1ed0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:54.169 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:54.161+0000 7fce016f4640 1 -- 172.21.15.78:0/1777135314 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcdfc06d2b0 msgr2=0x7fcdfc0bee90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:00:54.169 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:54.161+0000 7fce016f4640 1 --2- 172.21.15.78:0/1777135314 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcdfc06d2b0 0x7fcdfc0bee90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:54.169 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:54.161+0000 7fce016f4640 1 -- 172.21.15.78:0/1777135314 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcdf4009a70 con 0x7fcdfc0c3b80 2023-11-28T20:00:54.169 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:54.161+0000 7fce016f4640 1 --2- 172.21.15.78:0/1777135314 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcdfc0c3b80 0x7fcdfc1ed610 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7fcdf40b0040 tx=0x7fcdf40196c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:00:54.169 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:54.161+0000 7fcdf97fa640 1 -- 172.21.15.78:0/1777135314 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcdf40b9650 con 0x7fcdfc0c3b80 2023-11-28T20:00:54.169 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:54.161+0000 7fcdf97fa640 1 -- 172.21.15.78:0/1777135314 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcdf40b97b0 con 0x7fcdfc0c3b80 2023-11-28T20:00:54.169 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:54.161+0000 7fce03157640 1 -- 172.21.15.78:0/1777135314 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcdfc14ef80 con 0x7fcdfc0c3b80 2023-11-28T20:00:54.169 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:54.161+0000 7fcdf97fa640 1 -- 172.21.15.78:0/1777135314 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcdf40b9b40 con 0x7fcdfc0c3b80 2023-11-28T20:00:54.169 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:54.161+0000 7fce03157640 1 -- 172.21.15.78:0/1777135314 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcdfc1f0bd0 con 0x7fcdfc0c3b80 2023-11-28T20:00:54.170 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:54.165+0000 7fce03157640 1 -- 172.21.15.78:0/1777135314 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcdfc0a7070 con 0x7fcdfc0c3b80 2023-11-28T20:00:54.170 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:54.165+0000 7fcdf97fa640 1 -- 172.21.15.78:0/1777135314 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fcdf40b9ca0 con 0x7fcdfc0c3b80 2023-11-28T20:00:54.170 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:54.165+0000 7fcdf97fa640 1 --2- 172.21.15.78:0/1777135314 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fcde0066470 0x7fcde0068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:54.171 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:54.165+0000 7fcdf97fa640 1 -- 172.21.15.78:0/1777135314 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6177+0+0 (secure 0 0 0) 0x7fcdf411f220 con 0x7fcdfc0c3b80 2023-11-28T20:00:54.171 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:54.165+0000 7fce00ef3640 1 --2- 172.21.15.78:0/1777135314 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fcde0066470 0x7fcde0068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:54.171 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:54.165+0000 7fce00ef3640 1 --2- 172.21.15.78:0/1777135314 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fcde0066470 0x7fcde0068930 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fcdf0000f70 tx=0x7fcdf0009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:00:54.174 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:54.169+0000 7fcdf97fa640 1 -- 172.21.15.78:0/1777135314 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fcdf40ec5d0 con 0x7fcdfc0c3b80 2023-11-28T20:00:54.325 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:54.321+0000 7fce03157640 1 -- 172.21.15.78:0/1777135314 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fcdfc1ecdc0 con 0x7fcdfc0c3b80 2023-11-28T20:00:54.326 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:54.321+0000 7fcdf97fa640 1 -- 172.21.15.78:0/1777135314 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v49) v1 ==== 74+0+16923 (secure 0 0 0) 0x7fcdf40efbf0 con 0x7fcdfc0c3b80 2023-11-28T20:00:54.326 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-11-28T20:00:54.327 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":49,"fsid":"dd9780e8-3bda-44fa-a9f0-fa07d19d901d","created":"2023-11-28T19:58:40.969556+0000","modified":"2023-11-28T20:00:53.984726+0000","last_up_change":"2023-11-28T19:58:52.596716+0000","last_in_change":"2023-11-28T19:58:43.609275+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-28T19:58:54.011229+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs2_metadata","create_time":"2023-11-28T20:00:28.571896+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"43","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs2_data","create_time":"2023-11-28T20:00:29.436453+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"44","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs2"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e84245ac-b5da-429e-af18-39acaa2b33e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6800","nonce":3358701235},{"type":"v1","addr":"172.21.15.78:6801","nonce":3358701235}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6802","nonce":3358701235},{"type":"v1","addr":"172.21.15.78:6803","nonce":3358701235}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6806","nonce":3358701235},{"type":"v1","addr":"172.21.15.78:6807","nonce":3358701235}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6804","nonce":3358701235},{"type":"v1","addr":"172.21.15.78:6805","nonce":3358701235}]},"public_addr":"172.21.15.78:6801/3358701235","cluster_addr":"172.21.15.78:6803/3358701235","heartbeat_back_addr":"172.21.15.78:6807/3358701235","heartbeat_front_addr":"172.21.15.78:6805/3358701235","state":["exists","up"]},{"osd":1,"uuid":"e634831d-c4e2-48d9-870c-9556ae162981","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6808","nonce":3211476654},{"type":"v1","addr":"172.21.15.78:6809","nonce":3211476654}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6810","nonce":3211476654},{"type":"v1","addr":"172.21.15.78:6811","nonce":3211476654}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6814","nonce":3211476654},{"type":"v1","addr":"172.21.15.78:6815","nonce":3211476654}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6812","nonce":3211476654},{"type":"v1","addr":"172.21.15.78:6813","nonce":3211476654}]},"public_addr":"172.21.15.78:6809/3211476654","cluster_addr":"172.21.15.78:6811/3211476654","heartbeat_back_addr":"172.21.15.78:6815/3211476654","heartbeat_front_addr":"172.21.15.78:6813/3211476654","state":["exists","up"]},{"osd":2,"uuid":"274c8395-6534-41f0-b8fb-a00af8985aa8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6816","nonce":2532904479},{"type":"v1","addr":"172.21.15.78:6817","nonce":2532904479}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6818","nonce":2532904479},{"type":"v1","addr":"172.21.15.78:6819","nonce":2532904479}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6822","nonce":2532904479},{"type":"v1","addr":"172.21.15.78:6823","nonce":2532904479}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6820","nonce":2532904479},{"type":"v1","addr":"172.21.15.78:6821","nonce":2532904479}]},"public_addr":"172.21.15.78:6817/2532904479","cluster_addr":"172.21.15.78:6819/2532904479","heartbeat_back_addr":"172.21.15.78:6823/2532904479","heartbeat_front_addr":"172.21.15.78:6821/2532904479","state":["exists","up"]},{"osd":3,"uuid":"77acc9af-7d4d-4b18-8cf5-d62f5971b7c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6824","nonce":3442991267},{"type":"v1","addr":"172.21.15.78:6825","nonce":3442991267}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6826","nonce":3442991267},{"type":"v1","addr":"172.21.15.78:6827","nonce":3442991267}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6830","nonce":3442991267},{"type":"v1","addr":"172.21.15.78:6831","nonce":3442991267}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6828","nonce":3442991267},{"type":"v1","addr":"172.21.15.78:6829","nonce":3442991267}]},"public_addr":"172.21.15.78:6825/3442991267","cluster_addr":"172.21.15.78:6827/3442991267","heartbeat_back_addr":"172.21.15.78:6831/3442991267","heartbeat_front_addr":"172.21.15.78:6829/3442991267","state":["exists","up"]},{"osd":4,"uuid":"5c62bc66-6b34-4b7f-a66b-9a743969138c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":802983577},{"type":"v1","addr":"172.21.15.179:6809","nonce":802983577}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":802983577},{"type":"v1","addr":"172.21.15.179:6811","nonce":802983577}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":802983577},{"type":"v1","addr":"172.21.15.179:6815","nonce":802983577}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":802983577},{"type":"v1","addr":"172.21.15.179:6813","nonce":802983577}]},"public_addr":"172.21.15.179:6809/802983577","cluster_addr":"172.21.15.179:6811/802983577","heartbeat_back_addr":"172.21.15.179:6815/802983577","heartbeat_front_addr":"172.21.15.179:6813/802983577","state":["exists","up"]},{"osd":5,"uuid":"67db6d36-f684-4079-b0cd-82b4dd61461f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":518192887},{"type":"v1","addr":"172.21.15.179:6818","nonce":518192887}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":518192887},{"type":"v1","addr":"172.21.15.179:6822","nonce":518192887}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":518192887},{"type":"v1","addr":"172.21.15.179:6829","nonce":518192887}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6824","nonce":518192887},{"type":"v1","addr":"172.21.15.179:6826","nonce":518192887}]},"public_addr":"172.21.15.179:6818/518192887","cluster_addr":"172.21.15.179:6822/518192887","heartbeat_back_addr":"172.21.15.179:6829/518192887","heartbeat_front_addr":"172.21.15.179:6826/518192887","state":["exists","up"]},{"osd":6,"uuid":"12e670af-5a16-4c81-9f97-defa66cab967","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":815435378},{"type":"v1","addr":"172.21.15.179:6801","nonce":815435378}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":815435378},{"type":"v1","addr":"172.21.15.179:6803","nonce":815435378}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":815435378},{"type":"v1","addr":"172.21.15.179:6807","nonce":815435378}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":815435378},{"type":"v1","addr":"172.21.15.179:6805","nonce":815435378}]},"public_addr":"172.21.15.179:6801/815435378","cluster_addr":"172.21.15.179:6803/815435378","heartbeat_back_addr":"172.21.15.179:6807/815435378","heartbeat_front_addr":"172.21.15.179:6805/815435378","state":["exists","up"]},{"osd":7,"uuid":"fe630650-2eb3-49ad-8676-c341e6332eb1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6817","nonce":2848432339},{"type":"v1","addr":"172.21.15.179:6819","nonce":2848432339}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6821","nonce":2848432339},{"type":"v1","addr":"172.21.15.179:6823","nonce":2848432339}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":2848432339},{"type":"v1","addr":"172.21.15.179:6831","nonce":2848432339}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6825","nonce":2848432339},{"type":"v1","addr":"172.21.15.179:6827","nonce":2848432339}]},"public_addr":"172.21.15.179:6819/2848432339","cluster_addr":"172.21.15.179:6823/2848432339","heartbeat_back_addr":"172.21.15.179:6831/2848432339","heartbeat_front_addr":"172.21.15.179:6827/2848432339","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:58:49.255433+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:58:49.412880+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:58:49.559295+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:58:49.245237+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:58:49.184557+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:58:49.329851+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:58:49.366012+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:58:49.349604+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"8.28","mappings":[{"from":0,"to":6}]},{"pgid":"8.38","mappings":[{"from":0,"to":6}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.78:6836/3508383403":"2023-11-29T20:00:50.972350+0000","172.21.15.78:6834/3508383403":"2023-11-29T20:00:50.972350+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-28T20:00:54.328 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:54.325+0000 7fce03157640 1 -- 172.21.15.78:0/1777135314 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fcde0066470 msgr2=0x7fcde0068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:00:54.328 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:54.325+0000 7fce03157640 1 --2- 172.21.15.78:0/1777135314 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fcde0066470 0x7fcde0068930 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fcdf0000f70 tx=0x7fcdf0009040 comp rx=0 tx=0).stop 2023-11-28T20:00:54.329 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:54.325+0000 7fce03157640 1 -- 172.21.15.78:0/1777135314 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcdfc0c3b80 msgr2=0x7fcdfc1ed610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:00:54.329 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:54.325+0000 7fce03157640 1 --2- 172.21.15.78:0/1777135314 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcdfc0c3b80 0x7fcdfc1ed610 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7fcdf40b0040 tx=0x7fcdf40196c0 comp rx=0 tx=0).stop 2023-11-28T20:00:54.329 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:54.325+0000 7fce03157640 1 -- 172.21.15.78:0/1777135314 shutdown_connections 2023-11-28T20:00:54.329 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:54.325+0000 7fce03157640 1 --2- 172.21.15.78:0/1777135314 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fcde0066470 0x7fcde0068930 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:54.329 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:54.325+0000 7fce03157640 1 --2- 172.21.15.78:0/1777135314 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcdfc06d690 0x7fcdfc1ed0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:54.329 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:54.325+0000 7fce03157640 1 --2- 172.21.15.78:0/1777135314 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcdfc0c3b80 0x7fcdfc1ed610 unknown :-1 s=CLOSED pgs=539 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:54.329 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:54.325+0000 7fce03157640 1 --2- 172.21.15.78:0/1777135314 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcdfc06d2b0 0x7fcdfc0bee90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:54.329 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:54.325+0000 7fce03157640 1 -- 172.21.15.78:0/1777135314 >> 172.21.15.78:0/1777135314 conn(0x7fcdfc0a7810 msgr2=0x7fcdfc150560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:00:54.329 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:54.325+0000 7fce03157640 1 -- 172.21.15.78:0/1777135314 shutdown_connections 2023-11-28T20:00:54.329 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:54.325+0000 7fce03157640 1 -- 172.21.15.78:0/1777135314 wait complete. 2023-11-28T20:00:54.348 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-28T19:58:54.011229+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 7, 'pool_name': 'cephfs2_metadata', 'create_time': '2023-11-28T20:00:28.571896+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '43', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs2'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 8, 'pool_name': 'cephfs2_data', 'create_time': '2023-11-28T20:00:29.436453+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '44', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs2'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-28T20:00:54.349 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-28T20:00:54.507 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:54.501+0000 7fe02193e640 1 Processor -- start 2023-11-28T20:00:54.507 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:54.501+0000 7fe02193e640 1 -- start start 2023-11-28T20:00:54.508 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:54.505+0000 7fe02193e640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe01c1516a0 0x7fe01c0c4180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:54.508 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:54.505+0000 7fe02193e640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe01c151b20 con 0x7fe01c14e2a0 2023-11-28T20:00:54.508 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:54.505+0000 7fe02193e640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe01c151210 con 0x7fe01c0c46c0 2023-11-28T20:00:54.508 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:54.505+0000 7fe02193e640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe01c14e680 con 0x7fe01c1516a0 2023-11-28T20:00:54.508 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:54.505+0000 7fe01affd640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7fe01c14e2a0 0x7fe01c0a9460 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:36638/0 (socket says 172.21.15.78:36638) 2023-11-28T20:00:54.509 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:54.505+0000 7fe01affd640 1 -- 172.21.15.78:0/2831598621 learned_addr learned my addr 172.21.15.78:0/2831598621 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-11-28T20:00:54.509 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:54.505+0000 7fe013fff640 1 --2- 172.21.15.78:0/2831598621 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe01c1516a0 0x7fe01c0c4180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:54.510 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:54.505+0000 7fe01a7fc640 1 -- 172.21.15.78:0/2831598621 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1076689756 0 0) 0x7fe00c001120 con 0x7fe01c14e2a0 2023-11-28T20:00:54.510 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:54.505+0000 7fe01a7fc640 1 -- 172.21.15.78:0/2831598621 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe008003530 con 0x7fe01c14e2a0 2023-11-28T20:00:54.510 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:54.505+0000 7fe01a7fc640 1 -- 172.21.15.78:0/2831598621 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3932853482 0 0) 0x7fe01c151210 con 0x7fe01c0c46c0 2023-11-28T20:00:54.510 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:54.505+0000 7fe01a7fc640 1 -- 172.21.15.78:0/2831598621 --> v1:172.21.15.179:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe00c001120 con 0x7fe01c0c46c0 2023-11-28T20:00:54.510 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:54.505+0000 7fe01a7fc640 1 -- 172.21.15.78:0/2831598621 <== mon.0 v1:172.21.15.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2940059910 0 0) 0x7fe008003530 con 0x7fe01c14e2a0 2023-11-28T20:00:54.510 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:54.505+0000 7fe013fff640 1 -- 172.21.15.78:0/2831598621 >> v1:172.21.15.179:6789/0 conn(0x7fe01c0c46c0 legacy=0x7fe01c06bc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:00:54.510 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:54.505+0000 7fe013fff640 1 -- 172.21.15.78:0/2831598621 >> v1:172.21.15.78:6789/0 conn(0x7fe01c14e2a0 legacy=0x7fe01c0a9460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:00:54.510 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:54.505+0000 7fe013fff640 1 -- 172.21.15.78:0/2831598621 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe01c0a9b70 con 0x7fe01c1516a0 2023-11-28T20:00:54.512 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:54.509+0000 7fe013fff640 1 --2- 172.21.15.78:0/2831598621 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe01c1516a0 0x7fe01c0c4180 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fe0040097f0 tx=0x7fe00401c510 comp rx=0 tx=0).ready entity=mon.2 client_cookie=334789a46e1daef3 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:00:54.512 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:54.509+0000 7fe01a7fc640 1 -- 172.21.15.78:0/2831598621 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0040a7070 con 0x7fe01c1516a0 2023-11-28T20:00:54.512 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:54.509+0000 7fe01a7fc640 1 -- 172.21.15.78:0/2831598621 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe0040ab430 con 0x7fe01c1516a0 2023-11-28T20:00:54.512 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:54.509+0000 7fe01a7fc640 1 -- 172.21.15.78:0/2831598621 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe00c001790 con 0x7fe01c1516a0 2023-11-28T20:00:54.513 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:54.509+0000 7fe02193e640 1 -- 172.21.15.78:0/2831598621 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe01c1516a0 msgr2=0x7fe01c0c4180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:00:54.513 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:54.509+0000 7fe02193e640 1 --2- 172.21.15.78:0/2831598621 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe01c1516a0 0x7fe01c0c4180 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fe0040097f0 tx=0x7fe00401c510 comp rx=0 tx=0).stop 2023-11-28T20:00:54.513 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:54.509+0000 7fe02193e640 1 -- 172.21.15.78:0/2831598621 shutdown_connections 2023-11-28T20:00:54.513 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:54.509+0000 7fe02193e640 1 --2- 172.21.15.78:0/2831598621 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe01c1516a0 0x7fe01c0c4180 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:54.513 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:54.509+0000 7fe02193e640 1 -- 172.21.15.78:0/2831598621 >> 172.21.15.78:0/2831598621 conn(0x7fe01c0c59f0 msgr2=0x7fe01c0c5e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:00:54.513 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:54.509+0000 7fe02193e640 1 -- 172.21.15.78:0/2831598621 shutdown_connections 2023-11-28T20:00:54.514 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:54.509+0000 7fe02193e640 1 -- 172.21.15.78:0/2831598621 wait complete. 2023-11-28T20:00:54.514 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:54.509+0000 7fe02193e640 1 Processor -- start 2023-11-28T20:00:54.514 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:54.509+0000 7fe02193e640 1 -- start start 2023-11-28T20:00:54.516 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:54.509+0000 7fe02193e640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe01c0c46c0 0x7fe01c1f0700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:54.516 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:54.509+0000 7fe02193e640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe01c14e2a0 0x7fe01c149190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:54.516 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:54.509+0000 7fe02193e640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe01c1516a0 0x7fe01c0718e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:54.517 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:54.509+0000 7fe02193e640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe01c1f0c40 con 0x7fe01c1516a0 2023-11-28T20:00:54.517 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:54.509+0000 7fe02193e640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe01c152940 con 0x7fe01c14e2a0 2023-11-28T20:00:54.517 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:54.509+0000 7fe02193e640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe01c070710 con 0x7fe01c0c46c0 2023-11-28T20:00:54.517 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:54.513+0000 7fe01b7fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe01c1516a0 0x7fe01c0718e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:54.517 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:54.513+0000 7fe01b7fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe01c1516a0 0x7fe01c0718e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:40138/0 (socket says 172.21.15.78:40138) 2023-11-28T20:00:54.517 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:54.513+0000 7fe01b7fe640 1 -- 172.21.15.78:0/650417409 learned_addr learned my addr 172.21.15.78:0/650417409 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T20:00:54.517 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:54.513+0000 7fe01affd640 1 --2- 172.21.15.78:0/650417409 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe01c0c46c0 0x7fe01c1f0700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:54.517 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:54.513+0000 7fe013fff640 1 --2- 172.21.15.78:0/650417409 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe01c14e2a0 0x7fe01c149190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:54.517 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:54.513+0000 7fe01b7fe640 1 -- 172.21.15.78:0/650417409 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe01c0c46c0 msgr2=0x7fe01c1f0700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:00:54.517 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:54.513+0000 7fe01b7fe640 1 --2- 172.21.15.78:0/650417409 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe01c0c46c0 0x7fe01c1f0700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:54.517 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:54.513+0000 7fe01b7fe640 1 -- 172.21.15.78:0/650417409 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe01c14e2a0 msgr2=0x7fe01c149190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:00:54.518 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:54.513+0000 7fe01b7fe640 1 --2- 172.21.15.78:0/650417409 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe01c14e2a0 0x7fe01c149190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:54.518 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:54.513+0000 7fe01b7fe640 1 -- 172.21.15.78:0/650417409 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe004009420 con 0x7fe01c1516a0 2023-11-28T20:00:54.518 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:54.513+0000 7fe01b7fe640 1 --2- 172.21.15.78:0/650417409 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe01c1516a0 0x7fe01c0718e0 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7fe01400c770 tx=0x7fe01400cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:00:54.519 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:54.513+0000 7fe018ff9640 1 -- 172.21.15.78:0/650417409 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe014003b80 con 0x7fe01c1516a0 2023-11-28T20:00:54.519 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:54.513+0000 7fe018ff9640 1 -- 172.21.15.78:0/650417409 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe014003ce0 con 0x7fe01c1516a0 2023-11-28T20:00:54.519 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:54.513+0000 7fe02193e640 1 -- 172.21.15.78:0/650417409 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe01c152380 con 0x7fe01c1516a0 2023-11-28T20:00:54.519 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:54.513+0000 7fe018ff9640 1 -- 172.21.15.78:0/650417409 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe01400aa90 con 0x7fe01c1516a0 2023-11-28T20:00:54.519 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:54.513+0000 7fe02193e640 1 -- 172.21.15.78:0/650417409 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe01c0709d0 con 0x7fe01c1516a0 2023-11-28T20:00:54.519 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:54.513+0000 7fe02193e640 1 -- 172.21.15.78:0/650417409 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe01c06b950 con 0x7fe01c1516a0 2023-11-28T20:00:54.519 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:54.513+0000 7fe018ff9640 1 -- 172.21.15.78:0/650417409 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fe01400abf0 con 0x7fe01c1516a0 2023-11-28T20:00:54.520 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:54.517+0000 7fe018ff9640 1 --2- 172.21.15.78:0/650417409 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fdffc0664a0 0x7fdffc068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:54.520 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:54.517+0000 7fe018ff9640 1 -- 172.21.15.78:0/650417409 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6177+0+0 (secure 0 0 0) 0x7fe014083dd0 con 0x7fe01c1516a0 2023-11-28T20:00:54.520 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:54.517+0000 7fe01affd640 1 --2- 172.21.15.78:0/650417409 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fdffc0664a0 0x7fdffc068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:54.520 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:54.517+0000 7fe01affd640 1 --2- 172.21.15.78:0/650417409 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fdffc0664a0 0x7fdffc068960 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fe00c0018c0 tx=0x7fe00c0012b0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:00:54.523 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:54.517+0000 7fe018ff9640 1 -- 172.21.15.78:0/650417409 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fe01c06b950 con 0x7fe01c1516a0 2023-11-28T20:00:54.674 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:54.669+0000 7fe02193e640 1 -- 172.21.15.78:0/650417409 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fe01c06b950 con 0x7fe01c1516a0 2023-11-28T20:00:54.675 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:54.669+0000 7fe018ff9640 1 -- 172.21.15.78:0/650417409 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v49) v1 ==== 93+0+10 (secure 0 0 0) 0x7fe01c06b950 con 0x7fe01c1516a0 2023-11-28T20:00:54.675 INFO:teuthology.orchestra.run.smithi078.stdout:pg_num: 1 2023-11-28T20:00:54.677 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:54.673+0000 7fe02193e640 1 -- 172.21.15.78:0/650417409 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fdffc0664a0 msgr2=0x7fdffc068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:00:54.677 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:54.673+0000 7fe02193e640 1 --2- 172.21.15.78:0/650417409 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fdffc0664a0 0x7fdffc068960 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fe00c0018c0 tx=0x7fe00c0012b0 comp rx=0 tx=0).stop 2023-11-28T20:00:54.677 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:54.673+0000 7fe02193e640 1 -- 172.21.15.78:0/650417409 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe01c1516a0 msgr2=0x7fe01c0718e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:00:54.677 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:54.673+0000 7fe02193e640 1 --2- 172.21.15.78:0/650417409 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe01c1516a0 0x7fe01c0718e0 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7fe01400c770 tx=0x7fe01400cc30 comp rx=0 tx=0).stop 2023-11-28T20:00:54.677 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:54.673+0000 7fe02193e640 1 -- 172.21.15.78:0/650417409 shutdown_connections 2023-11-28T20:00:54.678 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:54.673+0000 7fe02193e640 1 --2- 172.21.15.78:0/650417409 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fdffc0664a0 0x7fdffc068960 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:54.678 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:54.673+0000 7fe02193e640 1 --2- 172.21.15.78:0/650417409 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe01c1516a0 0x7fe01c0718e0 unknown :-1 s=CLOSED pgs=541 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:54.678 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:54.673+0000 7fe02193e640 1 --2- 172.21.15.78:0/650417409 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe01c14e2a0 0x7fe01c149190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:54.678 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:54.673+0000 7fe02193e640 1 --2- 172.21.15.78:0/650417409 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe01c0c46c0 0x7fe01c1f0700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:54.678 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:54.673+0000 7fe02193e640 1 -- 172.21.15.78:0/650417409 >> 172.21.15.78:0/650417409 conn(0x7fe01c0c59f0 msgr2=0x7fe01c14d3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:00:54.678 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:54.673+0000 7fe02193e640 1 -- 172.21.15.78:0/650417409 shutdown_connections 2023-11-28T20:00:54.678 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:54.673+0000 7fe02193e640 1 -- 172.21.15.78:0/650417409 wait complete. 2023-11-28T20:00:54.696 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs2_metadata pg_num 2023-11-28T20:00:54.840 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:54.837+0000 7fa2c12c9640 1 Processor -- start 2023-11-28T20:00:54.840 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:54.837+0000 7fa2c12c9640 1 -- start start 2023-11-28T20:00:54.842 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:54.837+0000 7fa2c12c9640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fa2bc0c47e0 0x7fa2bc0c4bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:54.842 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:54.837+0000 7fa2c12c9640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fa2bc0c92e0 0x7fa2bc15eec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:54.842 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:54.837+0000 7fa2c12c9640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa2bc155400 con 0x7fa2bc0c83d0 2023-11-28T20:00:54.842 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:54.837+0000 7fa2c12c9640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa2bc0c5830 con 0x7fa2bc0c47e0 2023-11-28T20:00:54.843 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:54.837+0000 7fa2c12c9640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa2bc154620 con 0x7fa2bc0c92e0 2023-11-28T20:00:54.843 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:54.837+0000 7fa2baffd640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fa2bc0c47e0 0x7fa2bc0c4bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:54.843 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:54.837+0000 7fa2ba7fc640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7fa2bc0c83d0 0x7fa2bc0c8bd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:36640/0 (socket says 172.21.15.78:36640) 2023-11-28T20:00:54.843 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:54.837+0000 7fa2ba7fc640 1 -- 172.21.15.78:0/83110000 learned_addr learned my addr 172.21.15.78:0/83110000 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-11-28T20:00:54.843 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:54.837+0000 7fa2bb7fe640 1 --2- 172.21.15.78:0/83110000 >> v2:172.21.15.179:3300/0 conn(0x7fa2bc0c92e0 0x7fa2bc15eec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:54.843 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:54.837+0000 7fa2baffd640 1 -- 172.21.15.78:0/83110000 >> v2:172.21.15.179:3300/0 conn(0x7fa2bc0c92e0 msgr2=0x7fa2bc15eec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:00:54.844 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:54.837+0000 7fa2baffd640 1 --2- 172.21.15.78:0/83110000 >> v2:172.21.15.179:3300/0 conn(0x7fa2bc0c92e0 0x7fa2bc15eec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:54.844 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:54.837+0000 7fa2baffd640 1 -- 172.21.15.78:0/83110000 >> v1:172.21.15.78:6789/0 conn(0x7fa2bc0c83d0 legacy=0x7fa2bc0c8bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:00:54.844 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:54.837+0000 7fa2baffd640 1 -- 172.21.15.78:0/83110000 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2bc154830 con 0x7fa2bc0c47e0 2023-11-28T20:00:54.844 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:54.837+0000 7fa2b9ffb640 1 -- 172.21.15.78:0/83110000 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2666570718 0 0) 0x7fa2bc155400 con 0x7fa2bc0c83d0 2023-11-28T20:00:54.845 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:54.841+0000 7fa2baffd640 1 --2- 172.21.15.78:0/83110000 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa2bc0c47e0 0x7fa2bc0c4bc0 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7fa2bc06a8a0 tx=0x7fa2ac01c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=82235e7a37940e4c server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:00:54.846 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:54.841+0000 7fa2b9ffb640 1 -- 172.21.15.78:0/83110000 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2ac0ac600 con 0x7fa2bc0c47e0 2023-11-28T20:00:54.846 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:54.841+0000 7fa2b9ffb640 1 -- 172.21.15.78:0/83110000 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa2ac0a8050 con 0x7fa2bc0c47e0 2023-11-28T20:00:54.846 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:54.841+0000 7fa2b9ffb640 1 -- 172.21.15.78:0/83110000 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2ac0ac980 con 0x7fa2bc0c47e0 2023-11-28T20:00:54.846 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:54.841+0000 7fa2c12c9640 1 -- 172.21.15.78:0/83110000 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa2bc0c47e0 msgr2=0x7fa2bc0c4bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:00:54.847 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:54.841+0000 7fa2c12c9640 1 --2- 172.21.15.78:0/83110000 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa2bc0c47e0 0x7fa2bc0c4bc0 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7fa2bc06a8a0 tx=0x7fa2ac01c3a0 comp rx=0 tx=0).stop 2023-11-28T20:00:54.847 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:54.841+0000 7fa2c12c9640 1 -- 172.21.15.78:0/83110000 shutdown_connections 2023-11-28T20:00:54.847 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:54.841+0000 7fa2c12c9640 1 --2- 172.21.15.78:0/83110000 >> v2:172.21.15.179:3300/0 conn(0x7fa2bc0c92e0 0x7fa2bc15eec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:54.847 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:54.841+0000 7fa2c12c9640 1 --2- 172.21.15.78:0/83110000 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa2bc0c47e0 0x7fa2bc0c4bc0 unknown :-1 s=CLOSED pgs=543 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:54.847 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:54.841+0000 7fa2c12c9640 1 -- 172.21.15.78:0/83110000 >> 172.21.15.78:0/83110000 conn(0x7fa2bc0ab920 msgr2=0x7fa2bc0abd30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:00:54.847 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:54.841+0000 7fa2c12c9640 1 -- 172.21.15.78:0/83110000 shutdown_connections 2023-11-28T20:00:54.847 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:54.841+0000 7fa2c12c9640 1 -- 172.21.15.78:0/83110000 wait complete. 2023-11-28T20:00:54.849 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:54.841+0000 7fa2c12c9640 1 Processor -- start 2023-11-28T20:00:54.849 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:54.845+0000 7fa2c12c9640 1 -- start start 2023-11-28T20:00:54.849 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:54.845+0000 7fa2c12c9640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa2bc0c47e0 0x7fa2bc0aca70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:54.849 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:54.845+0000 7fa2c12c9640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa2bc0c83d0 0x7fa2bc157ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:54.849 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:54.845+0000 7fa2c12c9640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa2bc0c92e0 0x7fa2bc156b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:54.849 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:54.845+0000 7fa2c12c9640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2bc0c3e90 con 0x7fa2bc0c47e0 2023-11-28T20:00:54.850 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:54.845+0000 7fa2c12c9640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2bc148170 con 0x7fa2bc0c92e0 2023-11-28T20:00:54.850 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:54.845+0000 7fa2c12c9640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2bc155ac0 con 0x7fa2bc0c83d0 2023-11-28T20:00:54.850 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:54.845+0000 7fa2baffd640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa2bc0c47e0 0x7fa2bc0aca70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:54.850 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:54.845+0000 7fa2baffd640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa2bc0c47e0 0x7fa2bc0aca70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:40164/0 (socket says 172.21.15.78:40164) 2023-11-28T20:00:54.850 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:54.845+0000 7fa2baffd640 1 -- 172.21.15.78:0/3327746246 learned_addr learned my addr 172.21.15.78:0/3327746246 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T20:00:54.851 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:54.845+0000 7fa2baffd640 1 -- 172.21.15.78:0/3327746246 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa2bc0c83d0 msgr2=0x7fa2bc157ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:00:54.851 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:54.845+0000 7fa2baffd640 1 --2- 172.21.15.78:0/3327746246 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa2bc0c83d0 0x7fa2bc157ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:54.851 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:54.845+0000 7fa2baffd640 1 -- 172.21.15.78:0/3327746246 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa2bc0c92e0 msgr2=0x7fa2bc156b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:00:54.851 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:54.845+0000 7fa2baffd640 1 --2- 172.21.15.78:0/3327746246 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa2bc0c92e0 0x7fa2bc156b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:54.852 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:54.845+0000 7fa2baffd640 1 -- 172.21.15.78:0/3327746246 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2ac009420 con 0x7fa2bc0c47e0 2023-11-28T20:00:54.852 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:54.845+0000 7fa2baffd640 1 --2- 172.21.15.78:0/3327746246 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa2bc0c47e0 0x7fa2bc0aca70 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7fa2ac019fd0 tx=0x7fa2ac01abe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:00:54.852 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:54.845+0000 7fa2a37fe640 1 -- 172.21.15.78:0/3327746246 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2ac0b7450 con 0x7fa2bc0c47e0 2023-11-28T20:00:54.852 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:54.845+0000 7fa2a37fe640 1 -- 172.21.15.78:0/3327746246 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa2ac0b75d0 con 0x7fa2bc0c47e0 2023-11-28T20:00:54.852 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:54.845+0000 7fa2c12c9640 1 -- 172.21.15.78:0/3327746246 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa2bc155da0 con 0x7fa2bc0c47e0 2023-11-28T20:00:54.852 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:54.845+0000 7fa2a37fe640 1 -- 172.21.15.78:0/3327746246 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2ac0b7980 con 0x7fa2bc0c47e0 2023-11-28T20:00:54.852 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:54.845+0000 7fa2c12c9640 1 -- 172.21.15.78:0/3327746246 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa2bc156360 con 0x7fa2bc0c47e0 2023-11-28T20:00:54.852 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:54.845+0000 7fa2c12c9640 1 -- 172.21.15.78:0/3327746246 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa2bc067630 con 0x7fa2bc0c47e0 2023-11-28T20:00:54.853 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:54.849+0000 7fa2a37fe640 1 -- 172.21.15.78:0/3327746246 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fa2ac0b3070 con 0x7fa2bc0c47e0 2023-11-28T20:00:54.853 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:54.849+0000 7fa2a37fe640 1 --2- 172.21.15.78:0/3327746246 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fa2a8066470 0x7fa2a8068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:54.854 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:54.849+0000 7fa2a37fe640 1 -- 172.21.15.78:0/3327746246 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6177+0+0 (secure 0 0 0) 0x7fa2ac11e2e0 con 0x7fa2bc0c47e0 2023-11-28T20:00:54.854 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:54.849+0000 7fa2ba7fc640 1 --2- 172.21.15.78:0/3327746246 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fa2a8066470 0x7fa2a8068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:54.854 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:54.849+0000 7fa2ba7fc640 1 --2- 172.21.15.78:0/3327746246 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fa2a8066470 0x7fa2a8068930 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fa2b00011f0 tx=0x7fa2b0007930 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:00:54.857 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:54.853+0000 7fa2a37fe640 1 -- 172.21.15.78:0/3327746246 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fa2ac0eb610 con 0x7fa2bc0c47e0 2023-11-28T20:00:55.006 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:55.001+0000 7fa2c12c9640 1 -- 172.21.15.78:0/3327746246 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs2_metadata", "var": "pg_num"} v 0) v1 -- 0x7fa2bc06c940 con 0x7fa2bc0c47e0 2023-11-28T20:00:55.007 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:55.001+0000 7fa2a37fe640 1 -- 172.21.15.78:0/3327746246 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs2_metadata", "var": "pg_num"}]=0 v49) v1 ==== 105+0+11 (secure 0 0 0) 0x7fa2ac0eec30 con 0x7fa2bc0c47e0 2023-11-28T20:00:55.007 INFO:teuthology.orchestra.run.smithi078.stdout:pg_num: 32 2023-11-28T20:00:55.009 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:55.005+0000 7fa2c12c9640 1 -- 172.21.15.78:0/3327746246 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fa2a8066470 msgr2=0x7fa2a8068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:00:55.009 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:55.005+0000 7fa2c12c9640 1 --2- 172.21.15.78:0/3327746246 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fa2a8066470 0x7fa2a8068930 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fa2b00011f0 tx=0x7fa2b0007930 comp rx=0 tx=0).stop 2023-11-28T20:00:55.009 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:55.005+0000 7fa2c12c9640 1 -- 172.21.15.78:0/3327746246 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa2bc0c47e0 msgr2=0x7fa2bc0aca70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:00:55.009 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:55.005+0000 7fa2c12c9640 1 --2- 172.21.15.78:0/3327746246 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa2bc0c47e0 0x7fa2bc0aca70 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7fa2ac019fd0 tx=0x7fa2ac01abe0 comp rx=0 tx=0).stop 2023-11-28T20:00:55.010 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:55.005+0000 7fa2c12c9640 1 -- 172.21.15.78:0/3327746246 shutdown_connections 2023-11-28T20:00:55.010 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:55.005+0000 7fa2c12c9640 1 --2- 172.21.15.78:0/3327746246 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fa2a8066470 0x7fa2a8068930 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:55.010 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:55.005+0000 7fa2c12c9640 1 --2- 172.21.15.78:0/3327746246 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa2bc0c83d0 0x7fa2bc157ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:55.010 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:55.005+0000 7fa2c12c9640 1 --2- 172.21.15.78:0/3327746246 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa2bc0c92e0 0x7fa2bc156b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:55.010 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:55.005+0000 7fa2c12c9640 1 --2- 172.21.15.78:0/3327746246 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa2bc0c47e0 0x7fa2bc0aca70 unknown :-1 s=CLOSED pgs=544 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:55.010 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:55.005+0000 7fa2c12c9640 1 -- 172.21.15.78:0/3327746246 >> 172.21.15.78:0/3327746246 conn(0x7fa2bc0ab920 msgr2=0x7fa2bc06b0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:00:55.010 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:55.005+0000 7fa2c12c9640 1 -- 172.21.15.78:0/3327746246 shutdown_connections 2023-11-28T20:00:55.010 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:55.005+0000 7fa2c12c9640 1 -- 172.21.15.78:0/3327746246 wait complete. 2023-11-28T20:00:55.028 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs2_data pg_num 2023-11-28T20:00:55.170 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:55.165+0000 7f91f02fe640 1 Processor -- start 2023-11-28T20:00:55.170 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:55.165+0000 7f91f02fe640 1 -- start start 2023-11-28T20:00:55.171 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:55.165+0000 7f91f02fe640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f91e814f850 0x7f91e80aacf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:55.171 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:55.165+0000 7f91f02fe640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f91e814fc30 0x7f91e80c3cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:55.171 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:55.165+0000 7f91f02fe640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f91e8152910 con 0x7f91e806d840 2023-11-28T20:00:55.172 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:55.165+0000 7f91f02fe640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f91e80c2240 con 0x7f91e814f850 2023-11-28T20:00:55.172 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:55.165+0000 7f91f02fe640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91e8152bf0 con 0x7f91e814fc30 2023-11-28T20:00:55.172 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:55.165+0000 7f91ee89b640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f91e806d840 0x7f91e80c4210 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:59206/0 (socket says 172.21.15.78:59206) 2023-11-28T20:00:55.172 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:55.165+0000 7f91ee89b640 1 -- 172.21.15.78:0/3468806216 learned_addr learned my addr 172.21.15.78:0/3468806216 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-11-28T20:00:55.176 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:55.169+0000 7f91ee09a640 1 --2- 172.21.15.78:0/3468806216 >> v2:172.21.15.179:3300/0 conn(0x7f91e814f850 0x7f91e80aacf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:55.176 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:55.169+0000 7f91ed899640 1 --2- 172.21.15.78:0/3468806216 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f91e814fc30 0x7f91e80c3cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:55.176 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:55.169+0000 7f91ed098640 1 -- 172.21.15.78:0/3468806216 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 19757878 0 0) 0x7f91e8152910 con 0x7f91e806d840 2023-11-28T20:00:55.176 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:55.169+0000 7f91ed098640 1 -- 172.21.15.78:0/3468806216 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f91d4003530 con 0x7f91e806d840 2023-11-28T20:00:55.176 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:55.169+0000 7f91ed098640 1 -- 172.21.15.78:0/3468806216 <== mon.0 v1:172.21.15.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2371384035 0 0) 0x7f91d4003530 con 0x7f91e806d840 2023-11-28T20:00:55.176 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:55.169+0000 7f91ed098640 1 -- 172.21.15.78:0/3468806216 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f91e814fc30 msgr2=0x7f91e80c3cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:00:55.176 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:55.169+0000 7f91ed098640 1 --2- 172.21.15.78:0/3468806216 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f91e814fc30 0x7f91e80c3cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:55.176 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:55.169+0000 7f91ed098640 1 -- 172.21.15.78:0/3468806216 >> v2:172.21.15.179:3300/0 conn(0x7f91e814f850 msgr2=0x7f91e80aacf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:00:55.177 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:55.169+0000 7f91ed098640 1 --2- 172.21.15.78:0/3468806216 >> v2:172.21.15.179:3300/0 conn(0x7f91e814f850 0x7f91e80aacf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:55.177 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:55.169+0000 7f91ed098640 1 -- 172.21.15.78:0/3468806216 --> v1:172.21.15.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91e8152ed0 con 0x7f91e806d840 2023-11-28T20:00:55.177 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:55.169+0000 7f91ed098640 1 -- 172.21.15.78:0/3468806216 <== mon.0 v1:172.21.15.78:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3326804700 0 0) 0x7f91e0001a00 con 0x7f91e806d840 2023-11-28T20:00:55.177 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:55.169+0000 7f91ed098640 1 -- 172.21.15.78:0/3468806216 >> v1:172.21.15.78:6789/0 conn(0x7f91e806d840 legacy=0x7f91e80c4210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:00:55.177 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:55.169+0000 7f91ed098640 1 --2- 172.21.15.78:0/3468806216 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f91d4003980 0x7f91d4003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:55.177 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:55.169+0000 7f91ed098640 1 --2- 172.21.15.78:0/3468806216 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f91e814fc30 0x7f91d40047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:55.177 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:55.169+0000 7f91ed098640 1 --2- 172.21.15.78:0/3468806216 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f91d4004d10 0x7f91d4005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:55.177 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:55.169+0000 7f91ed098640 1 -- 172.21.15.78:0/3468806216 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91e80c2240 con 0x7f91d4003980 2023-11-28T20:00:55.177 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:55.169+0000 7f91ed098640 1 -- 172.21.15.78:0/3468806216 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91e8152bf0 con 0x7f91d4004d10 2023-11-28T20:00:55.177 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:55.169+0000 7f91ed098640 1 -- 172.21.15.78:0/3468806216 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91d400b990 con 0x7f91e814fc30 2023-11-28T20:00:55.177 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:55.169+0000 7f91ee09a640 1 --2- 172.21.15.78:0/3468806216 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f91d4003980 0x7f91d4003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:55.177 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:55.169+0000 7f91ed899640 1 --2- 172.21.15.78:0/3468806216 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f91e814fc30 0x7f91d40047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:55.178 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:55.169+0000 7f91ee89b640 1 --2- 172.21.15.78:0/3468806216 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f91d4004d10 0x7f91d4005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:55.178 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:55.169+0000 7f91ee09a640 1 -- 172.21.15.78:0/3468806216 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f91e814fc30 msgr2=0x7f91d40047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:00:55.178 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:55.169+0000 7f91ee09a640 1 --2- 172.21.15.78:0/3468806216 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f91e814fc30 0x7f91d40047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:55.178 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:55.169+0000 7f91ee09a640 1 -- 172.21.15.78:0/3468806216 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f91d4004d10 msgr2=0x7f91d4005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:00:55.178 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:55.169+0000 7f91ee09a640 1 --2- 172.21.15.78:0/3468806216 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f91d4004d10 0x7f91d4005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:55.178 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:55.169+0000 7f91ee09a640 1 -- 172.21.15.78:0/3468806216 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91d4003530 con 0x7f91d4003980 2023-11-28T20:00:55.178 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:55.169+0000 7f91ee89b640 1 --2- 172.21.15.78:0/3468806216 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f91d4004d10 0x7f91d4005190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T20:00:55.178 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:55.173+0000 7f91ee09a640 1 --2- 172.21.15.78:0/3468806216 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f91d4003980 0x7f91d4003da0 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7f91e4009ae0 tx=0x7f91e401ca90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d5a3496dcfc9ef6d server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:00:55.178 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:55.173+0000 7f91ed098640 1 -- 172.21.15.78:0/3468806216 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91e40a5680 con 0x7f91d4003980 2023-11-28T20:00:55.179 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:55.173+0000 7f91ed098640 1 -- 172.21.15.78:0/3468806216 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f91e40a57e0 con 0x7f91d4003980 2023-11-28T20:00:55.179 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:55.173+0000 7f91ed098640 1 -- 172.21.15.78:0/3468806216 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91e40a5b90 con 0x7f91d4003980 2023-11-28T20:00:55.181 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:55.173+0000 7f91f02fe640 1 -- 172.21.15.78:0/3468806216 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f91d4003980 msgr2=0x7f91d4003da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:00:55.181 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:55.173+0000 7f91f02fe640 1 --2- 172.21.15.78:0/3468806216 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f91d4003980 0x7f91d4003da0 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7f91e4009ae0 tx=0x7f91e401ca90 comp rx=0 tx=0).stop 2023-11-28T20:00:55.181 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:55.173+0000 7f91ee89b640 1 -- 172.21.15.78:0/3468806216 reap_dead start 2023-11-28T20:00:55.181 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:55.173+0000 7f91f02fe640 1 -- 172.21.15.78:0/3468806216 shutdown_connections 2023-11-28T20:00:55.181 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:55.173+0000 7f91f02fe640 1 -- 172.21.15.78:0/3468806216 >> 172.21.15.78:0/3468806216 conn(0x7f91e80c59f0 msgr2=0x7f91e80c5e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:00:55.182 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:55.173+0000 7f91f02fe640 1 -- 172.21.15.78:0/3468806216 shutdown_connections 2023-11-28T20:00:55.182 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:55.173+0000 7f91f02fe640 1 -- 172.21.15.78:0/3468806216 wait complete. 2023-11-28T20:00:55.182 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:55.173+0000 7f91f02fe640 1 Processor -- start 2023-11-28T20:00:55.182 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:55.173+0000 7f91f02fe640 1 -- start start 2023-11-28T20:00:55.182 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:55.173+0000 7f91f02fe640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f91d4003980 0x7f91e814a8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:55.182 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:55.173+0000 7f91f02fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f91e81573d0 0x7f91e80a9fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:55.182 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:55.173+0000 7f91f02fe640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f91e8157f40 0x7f91e80aa520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:55.182 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:55.173+0000 7f91f02fe640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91e80a74e0 con 0x7f91e81573d0 2023-11-28T20:00:55.182 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:55.173+0000 7f91f02fe640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91e80bf830 con 0x7f91e8157f40 2023-11-28T20:00:55.183 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:55.173+0000 7f91f02fe640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91e80bef00 con 0x7f91d4003980 2023-11-28T20:00:55.183 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:55.177+0000 7f91ed899640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f91e81573d0 0x7f91e80a9fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:55.183 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:55.177+0000 7f91ed899640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f91e81573d0 0x7f91e80a9fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:40512/0 (socket says 172.21.15.78:40512) 2023-11-28T20:00:55.183 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:55.177+0000 7f91ed899640 1 -- 172.21.15.78:0/3110575569 learned_addr learned my addr 172.21.15.78:0/3110575569 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T20:00:55.183 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:55.177+0000 7f91ee09a640 1 --2- 172.21.15.78:0/3110575569 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f91d4003980 0x7f91e814a8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:55.183 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:55.177+0000 7f91ee89b640 1 --2- 172.21.15.78:0/3110575569 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f91e8157f40 0x7f91e80aa520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:55.183 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:55.177+0000 7f91ed899640 1 -- 172.21.15.78:0/3110575569 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f91d4003980 msgr2=0x7f91e814a8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:00:55.183 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:55.177+0000 7f91ed899640 1 --2- 172.21.15.78:0/3110575569 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f91d4003980 0x7f91e814a8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:55.183 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:55.177+0000 7f91ed899640 1 -- 172.21.15.78:0/3110575569 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f91e8157f40 msgr2=0x7f91e80aa520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:00:55.183 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:55.177+0000 7f91ed899640 1 --2- 172.21.15.78:0/3110575569 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f91e8157f40 0x7f91e80aa520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:55.183 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:55.177+0000 7f91ed899640 1 -- 172.21.15.78:0/3110575569 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91e80bf1e0 con 0x7f91e81573d0 2023-11-28T20:00:55.184 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:55.177+0000 7f91ed899640 1 --2- 172.21.15.78:0/3110575569 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f91e81573d0 0x7f91e80a9fe0 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7f91d80119d0 tx=0x7f91d8011dd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:00:55.184 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:55.177+0000 7f91deffd640 1 -- 172.21.15.78:0/3110575569 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91d800fa90 con 0x7f91e81573d0 2023-11-28T20:00:55.184 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:55.177+0000 7f91deffd640 1 -- 172.21.15.78:0/3110575569 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f91d800fbf0 con 0x7f91e81573d0 2023-11-28T20:00:55.184 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:55.177+0000 7f91deffd640 1 -- 172.21.15.78:0/3110575569 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91d8014440 con 0x7f91e81573d0 2023-11-28T20:00:55.184 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:55.177+0000 7f91f02fe640 1 -- 172.21.15.78:0/3110575569 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f91e80bf4c0 con 0x7f91e81573d0 2023-11-28T20:00:55.184 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:55.177+0000 7f91f02fe640 1 -- 172.21.15.78:0/3110575569 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f91e80a6d90 con 0x7f91e81573d0 2023-11-28T20:00:55.185 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:55.177+0000 7f91f02fe640 1 -- 172.21.15.78:0/3110575569 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f91e8067630 con 0x7f91e81573d0 2023-11-28T20:00:55.185 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:55.177+0000 7f91deffd640 1 -- 172.21.15.78:0/3110575569 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f91d80145a0 con 0x7f91e81573d0 2023-11-28T20:00:55.185 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:55.181+0000 7f91deffd640 1 --2- 172.21.15.78:0/3110575569 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f91cc0664a0 0x7f91cc068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:55.185 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:55.181+0000 7f91deffd640 1 -- 172.21.15.78:0/3110575569 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6177+0+0 (secure 0 0 0) 0x7f91d8084810 con 0x7f91e81573d0 2023-11-28T20:00:55.185 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:55.181+0000 7f91ee09a640 1 --2- 172.21.15.78:0/3110575569 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f91cc0664a0 0x7f91cc068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:55.186 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:55.181+0000 7f91ee09a640 1 --2- 172.21.15.78:0/3110575569 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f91cc0664a0 0x7f91cc068960 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f91e40af000 tx=0x7f91e40046d0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:00:55.188 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:55.185+0000 7f91deffd640 1 -- 172.21.15.78:0/3110575569 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f91d8051ad0 con 0x7f91e81573d0 2023-11-28T20:00:55.336 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:55.333+0000 7f91f02fe640 1 -- 172.21.15.78:0/3110575569 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs2_data", "var": "pg_num"} v 0) v1 -- 0x7f91e80bf040 con 0x7f91e81573d0 2023-11-28T20:00:55.337 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:55.333+0000 7f91deffd640 1 -- 172.21.15.78:0/3110575569 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs2_data", "var": "pg_num"}]=0 v49) v1 ==== 101+0+11 (secure 0 0 0) 0x7f91e80bf040 con 0x7f91e81573d0 2023-11-28T20:00:55.338 INFO:teuthology.orchestra.run.smithi078.stdout:pg_num: 64 2023-11-28T20:00:55.339 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:55.333+0000 7f91f02fe640 1 -- 172.21.15.78:0/3110575569 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f91cc0664a0 msgr2=0x7f91cc068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:00:55.340 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:55.333+0000 7f91f02fe640 1 --2- 172.21.15.78:0/3110575569 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f91cc0664a0 0x7f91cc068960 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f91e40af000 tx=0x7f91e40046d0 comp rx=0 tx=0).stop 2023-11-28T20:00:55.340 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:55.333+0000 7f91f02fe640 1 -- 172.21.15.78:0/3110575569 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f91e81573d0 msgr2=0x7f91e80a9fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:00:55.340 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:55.333+0000 7f91f02fe640 1 --2- 172.21.15.78:0/3110575569 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f91e81573d0 0x7f91e80a9fe0 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7f91d80119d0 tx=0x7f91d8011dd0 comp rx=0 tx=0).stop 2023-11-28T20:00:55.340 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:55.333+0000 7f91f02fe640 1 -- 172.21.15.78:0/3110575569 shutdown_connections 2023-11-28T20:00:55.340 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:55.333+0000 7f91f02fe640 1 --2- 172.21.15.78:0/3110575569 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f91cc0664a0 0x7f91cc068960 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:55.340 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:55.333+0000 7f91f02fe640 1 --2- 172.21.15.78:0/3110575569 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f91e8157f40 0x7f91e80aa520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:55.340 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:55.333+0000 7f91f02fe640 1 --2- 172.21.15.78:0/3110575569 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f91e81573d0 0x7f91e80a9fe0 unknown :-1 s=CLOSED pgs=547 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:55.340 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:55.333+0000 7f91f02fe640 1 --2- 172.21.15.78:0/3110575569 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f91d4003980 0x7f91e814a8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:55.341 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:55.333+0000 7f91f02fe640 1 -- 172.21.15.78:0/3110575569 >> 172.21.15.78:0/3110575569 conn(0x7f91e80c59f0 msgr2=0x7f91e806cd10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:00:55.341 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:55.333+0000 7f91f02fe640 1 -- 172.21.15.78:0/3110575569 shutdown_connections 2023-11-28T20:00:55.341 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:55.333+0000 7f91f02fe640 1 -- 172.21.15.78:0/3110575569 wait complete. 2023-11-28T20:00:55.358 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-28T20:00:55.495 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:55.489+0000 7f08f605f640 1 Processor -- start 2023-11-28T20:00:55.495 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:55.489+0000 7f08f605f640 1 -- start start 2023-11-28T20:00:55.496 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:55.493+0000 7f08f605f640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f08f014e3f0 0x7f08f015c5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:55.497 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:55.493+0000 7f08f605f640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f08f0151690 con 0x7f08f006bef0 2023-11-28T20:00:55.497 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:55.493+0000 7f08f605f640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f08f0151bc0 con 0x7f08f00bfce0 2023-11-28T20:00:55.497 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:55.493+0000 7f08f605f640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f08f014e860 con 0x7f08f014e3f0 2023-11-28T20:00:55.497 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:55.493+0000 7f08ef7fe640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f08f006bef0 0x7f08f006c5b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:59222/0 (socket says 172.21.15.78:59222) 2023-11-28T20:00:55.497 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:55.493+0000 7f08ef7fe640 1 -- 172.21.15.78:0/222965400 learned_addr learned my addr 172.21.15.78:0/222965400 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-11-28T20:00:55.498 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:55.493+0000 7f08effff640 1 --2- 172.21.15.78:0/222965400 >> v2:172.21.15.179:3300/0 conn(0x7f08f014e3f0 0x7f08f015c5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:55.499 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:55.493+0000 7f08ee7fc640 1 -- 172.21.15.78:0/222965400 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3495813601 0 0) 0x7f08f0151690 con 0x7f08f006bef0 2023-11-28T20:00:55.499 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:55.493+0000 7f08ee7fc640 1 -- 172.21.15.78:0/222965400 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f08d8003530 con 0x7f08f006bef0 2023-11-28T20:00:55.499 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:55.493+0000 7f08ee7fc640 1 -- 172.21.15.78:0/222965400 <== mon.0 v1:172.21.15.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1819951549 0 0) 0x7f08d8003530 con 0x7f08f006bef0 2023-11-28T20:00:55.499 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:55.493+0000 7f08ee7fc640 1 -- 172.21.15.78:0/222965400 >> v2:172.21.15.179:3300/0 conn(0x7f08f014e3f0 msgr2=0x7f08f015c5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:00:55.499 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:55.493+0000 7f08ee7fc640 1 --2- 172.21.15.78:0/222965400 >> v2:172.21.15.179:3300/0 conn(0x7f08f014e3f0 0x7f08f015c5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:55.499 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:55.493+0000 7f08ee7fc640 1 -- 172.21.15.78:0/222965400 >> v1:172.21.15.179:6789/0 conn(0x7f08f00bfce0 legacy=0x7f08f006ccc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:00:55.499 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:55.493+0000 7f08ee7fc640 1 -- 172.21.15.78:0/222965400 --> v1:172.21.15.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08f01518e0 con 0x7f08f006bef0 2023-11-28T20:00:55.499 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:55.493+0000 7f08ee7fc640 1 -- 172.21.15.78:0/222965400 <== mon.0 v1:172.21.15.78:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3326804700 0 0) 0x7f08e0001680 con 0x7f08f006bef0 2023-11-28T20:00:55.499 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:55.493+0000 7f08ee7fc640 1 -- 172.21.15.78:0/222965400 >> v1:172.21.15.78:6789/0 conn(0x7f08f006bef0 legacy=0x7f08f006c5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:00:55.499 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:55.493+0000 7f08ee7fc640 1 --2- 172.21.15.78:0/222965400 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f08d8003980 0x7f08d8003d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:55.499 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:55.493+0000 7f08ee7fc640 1 --2- 172.21.15.78:0/222965400 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f08d80047d0 0x7f08d8004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:55.500 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:55.493+0000 7f08ee7fc640 1 --2- 172.21.15.78:0/222965400 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f08d80051e0 0x7f08d800dba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:55.500 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:55.493+0000 7f08ee7fc640 1 -- 172.21.15.78:0/222965400 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08f014e860 con 0x7f08d80047d0 2023-11-28T20:00:55.500 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:55.493+0000 7f08ee7fc640 1 -- 172.21.15.78:0/222965400 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08d800e340 con 0x7f08d8003980 2023-11-28T20:00:55.500 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:55.493+0000 7f08ee7fc640 1 -- 172.21.15.78:0/222965400 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f08d800e500 con 0x7f08d80051e0 2023-11-28T20:00:55.500 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:55.493+0000 7f08eeffd640 1 --2- 172.21.15.78:0/222965400 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f08d80047d0 0x7f08d8004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:55.500 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:55.493+0000 7f08ef7fe640 1 --2- 172.21.15.78:0/222965400 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f08d8003980 0x7f08d8003d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:55.500 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:55.493+0000 7f08effff640 1 --2- 172.21.15.78:0/222965400 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f08d80051e0 0x7f08d800dba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:55.500 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:55.493+0000 7f08eeffd640 1 -- 172.21.15.78:0/222965400 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f08d80051e0 msgr2=0x7f08d800dba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:00:55.500 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:55.493+0000 7f08eeffd640 1 --2- 172.21.15.78:0/222965400 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f08d80051e0 0x7f08d800dba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:55.500 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:55.493+0000 7f08eeffd640 1 -- 172.21.15.78:0/222965400 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f08d8003980 msgr2=0x7f08d8003d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:00:55.500 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:55.493+0000 7f08eeffd640 1 --2- 172.21.15.78:0/222965400 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f08d8003980 0x7f08d8003d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:55.501 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:55.493+0000 7f08eeffd640 1 -- 172.21.15.78:0/222965400 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08d8003530 con 0x7f08d80047d0 2023-11-28T20:00:55.501 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:55.493+0000 7f08effff640 1 -- 172.21.15.78:0/222965400 reap_dead start 2023-11-28T20:00:55.501 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:55.497+0000 7f08eeffd640 1 --2- 172.21.15.78:0/222965400 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f08d80047d0 0x7f08d8004c50 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7f08e4001860 tx=0x7f08e401c4c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dca07970e48b6076 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:00:55.502 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:55.497+0000 7f08ee7fc640 1 -- 172.21.15.78:0/222965400 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08e40ab600 con 0x7f08d80047d0 2023-11-28T20:00:55.502 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:55.497+0000 7f08ee7fc640 1 -- 172.21.15.78:0/222965400 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f08e40a7050 con 0x7f08d80047d0 2023-11-28T20:00:55.502 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:55.497+0000 7f08ee7fc640 1 -- 172.21.15.78:0/222965400 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08e40ab9e0 con 0x7f08d80047d0 2023-11-28T20:00:55.503 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:55.497+0000 7f08f605f640 1 -- 172.21.15.78:0/222965400 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f08d80047d0 msgr2=0x7f08d8004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:00:55.503 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:55.497+0000 7f08f605f640 1 --2- 172.21.15.78:0/222965400 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f08d80047d0 0x7f08d8004c50 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7f08e4001860 tx=0x7f08e401c4c0 comp rx=0 tx=0).stop 2023-11-28T20:00:55.503 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:55.497+0000 7f08f605f640 1 -- 172.21.15.78:0/222965400 shutdown_connections 2023-11-28T20:00:55.503 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:55.497+0000 7f08f605f640 1 --2- 172.21.15.78:0/222965400 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f08d80047d0 0x7f08d8004c50 unknown :-1 s=CLOSED pgs=549 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:55.503 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:55.497+0000 7f08f605f640 1 -- 172.21.15.78:0/222965400 >> 172.21.15.78:0/222965400 conn(0x7f08f00a7810 msgr2=0x7f08f00a7c20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:00:55.503 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:55.497+0000 7f08f605f640 1 -- 172.21.15.78:0/222965400 shutdown_connections 2023-11-28T20:00:55.503 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:55.497+0000 7f08f605f640 1 -- 172.21.15.78:0/222965400 wait complete. 2023-11-28T20:00:55.504 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:55.501+0000 7f08f605f640 1 Processor -- start 2023-11-28T20:00:55.504 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:55.501+0000 7f08f605f640 1 -- start start 2023-11-28T20:00:55.505 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:55.501+0000 7f08f605f640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f08d80047d0 0x7f08f01454d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:55.506 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:55.501+0000 7f08f605f640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f08f0070880 0x7f08f014cc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:55.506 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:55.501+0000 7f08f605f640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f08f014d1b0 0x7f08f01ebae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:55.506 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:55.501+0000 7f08f605f640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08f0152430 con 0x7f08f0070880 2023-11-28T20:00:55.506 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:55.501+0000 7f08f605f640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08f01504a0 con 0x7f08d80047d0 2023-11-28T20:00:55.506 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:55.501+0000 7f08f605f640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f08f0150740 con 0x7f08f014d1b0 2023-11-28T20:00:55.506 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:55.501+0000 7f08eeffd640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f08f0070880 0x7f08f014cc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:55.506 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:55.501+0000 7f08eeffd640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f08f0070880 0x7f08f014cc70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:40522/0 (socket says 172.21.15.78:40522) 2023-11-28T20:00:55.506 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:55.501+0000 7f08eeffd640 1 -- 172.21.15.78:0/701947880 learned_addr learned my addr 172.21.15.78:0/701947880 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T20:00:55.506 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:55.501+0000 7f08effff640 1 --2- 172.21.15.78:0/701947880 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f08f014d1b0 0x7f08f01ebae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:55.506 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:55.501+0000 7f08ef7fe640 1 --2- 172.21.15.78:0/701947880 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f08d80047d0 0x7f08f01454d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:55.507 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:55.501+0000 7f08eeffd640 1 -- 172.21.15.78:0/701947880 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f08f014d1b0 msgr2=0x7f08f01ebae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:00:55.507 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:55.501+0000 7f08eeffd640 1 --2- 172.21.15.78:0/701947880 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f08f014d1b0 0x7f08f01ebae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:55.507 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:55.501+0000 7f08eeffd640 1 -- 172.21.15.78:0/701947880 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f08d80047d0 msgr2=0x7f08f01454d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:00:55.507 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:55.501+0000 7f08eeffd640 1 --2- 172.21.15.78:0/701947880 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f08d80047d0 0x7f08f01454d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:55.507 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:55.501+0000 7f08eeffd640 1 -- 172.21.15.78:0/701947880 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08f01462f0 con 0x7f08f0070880 2023-11-28T20:00:55.507 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:55.501+0000 7f08eeffd640 1 --2- 172.21.15.78:0/701947880 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f08f0070880 0x7f08f014cc70 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7f08e401c2f0 tx=0x7f08d8005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:00:55.508 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:55.501+0000 7f08d7fff640 1 -- 172.21.15.78:0/701947880 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08e4007240 con 0x7f08f0070880 2023-11-28T20:00:55.508 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:55.501+0000 7f08d7fff640 1 -- 172.21.15.78:0/701947880 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f08e40073a0 con 0x7f08f0070880 2023-11-28T20:00:55.508 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:55.501+0000 7f08f605f640 1 -- 172.21.15.78:0/701947880 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f08f0145df0 con 0x7f08f0070880 2023-11-28T20:00:55.508 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:55.501+0000 7f08d7fff640 1 -- 172.21.15.78:0/701947880 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08e4007710 con 0x7f08f0070880 2023-11-28T20:00:55.508 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:55.501+0000 7f08f605f640 1 -- 172.21.15.78:0/701947880 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f08f0146710 con 0x7f08f0070880 2023-11-28T20:00:55.509 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:55.501+0000 7f08f605f640 1 -- 172.21.15.78:0/701947880 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f08f0145fb0 con 0x7f08f0070880 2023-11-28T20:00:55.509 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:55.505+0000 7f08d7fff640 1 -- 172.21.15.78:0/701947880 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f08e40b2040 con 0x7f08f0070880 2023-11-28T20:00:55.509 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:55.505+0000 7f08d7fff640 1 --2- 172.21.15.78:0/701947880 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f08dc0664a0 0x7f08dc068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:55.509 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:55.505+0000 7f08d7fff640 1 -- 172.21.15.78:0/701947880 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6177+0+0 (secure 0 0 0) 0x7f08e411db10 con 0x7f08f0070880 2023-11-28T20:00:55.510 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:55.505+0000 7f08ef7fe640 1 --2- 172.21.15.78:0/701947880 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f08dc0664a0 0x7f08dc068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:55.510 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:55.505+0000 7f08ef7fe640 1 --2- 172.21.15.78:0/701947880 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f08dc0664a0 0x7f08dc068960 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f08e0007bb0 tx=0x7f08e0000f90 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:00:55.513 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:55.509+0000 7f08d7fff640 1 -- 172.21.15.78:0/701947880 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f08e40eae50 con 0x7f08f0070880 2023-11-28T20:00:55.692 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:55.689+0000 7f08f605f640 1 -- 172.21.15.78:0/701947880 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f08f0067630 con 0x7f08f0070880 2023-11-28T20:00:55.693 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:55.689+0000 7f08d7fff640 1 -- 172.21.15.78:0/701947880 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) v1 ==== 94+0+4912 (secure 0 0 0) 0x7f08e40b0090 con 0x7f08f0070880 2023-11-28T20:00:55.693 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-11-28T20:00:55.693 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":24,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4880,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6835/20894428","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6834","nonce":20894428},{"type":"v1","addr":"172.21.15.179:6835","nonce":20894428}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":4886,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6837/666703170","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6835","nonce":666703170},{"type":"v1","addr":"172.21.15.78:6837","nonce":666703170}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":5691,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6836/2246548406","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6834","nonce":2246548406},{"type":"v1","addr":"172.21.15.78:6836","nonce":2246548406}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":24}],"filesystems":[{"mdsmap":{"epoch":22,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-28T20:00:30.436267+0000","modified":"2023-11-28T20:00:33.475772+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5179},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5179":{"gid":5179,"name":"b","rank":0,"incarnation":18,"state":"up:active","state_seq":8,"addr":"172.21.15.179:6833/3446403084","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6832","nonce":3446403084},{"type":"v1","addr":"172.21.15.179:6833","nonce":3446403084}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs2","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2023-11-28T20:00:55.694 INFO:teuthology.orchestra.run.smithi078.stderr:dumped fsmap epoch 24 2023-11-28T20:00:55.695 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:55.689+0000 7f08f605f640 1 -- 172.21.15.78:0/701947880 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f08dc0664a0 msgr2=0x7f08dc068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:00:55.696 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:55.689+0000 7f08f605f640 1 --2- 172.21.15.78:0/701947880 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f08dc0664a0 0x7f08dc068960 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f08e0007bb0 tx=0x7f08e0000f90 comp rx=0 tx=0).stop 2023-11-28T20:00:55.696 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:55.689+0000 7f08f605f640 1 -- 172.21.15.78:0/701947880 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f08f0070880 msgr2=0x7f08f014cc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:00:55.696 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:55.689+0000 7f08f605f640 1 --2- 172.21.15.78:0/701947880 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f08f0070880 0x7f08f014cc70 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7f08e401c2f0 tx=0x7f08d8005800 comp rx=0 tx=0).stop 2023-11-28T20:00:55.696 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:55.689+0000 7f08f605f640 1 -- 172.21.15.78:0/701947880 shutdown_connections 2023-11-28T20:00:55.696 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:55.689+0000 7f08f605f640 1 --2- 172.21.15.78:0/701947880 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f08dc0664a0 0x7f08dc068960 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:55.696 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:55.689+0000 7f08f605f640 1 --2- 172.21.15.78:0/701947880 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f08f014d1b0 0x7f08f01ebae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:55.696 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:55.689+0000 7f08f605f640 1 --2- 172.21.15.78:0/701947880 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f08f0070880 0x7f08f014cc70 unknown :-1 s=CLOSED pgs=550 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:55.696 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:55.689+0000 7f08f605f640 1 --2- 172.21.15.78:0/701947880 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f08d80047d0 0x7f08f01454d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:55.696 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:55.689+0000 7f08f605f640 1 -- 172.21.15.78:0/701947880 >> 172.21.15.78:0/701947880 conn(0x7f08f00a7810 msgr2=0x7f08f00a6e50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:00:55.697 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:55.689+0000 7f08f605f640 1 -- 172.21.15.78:0/701947880 shutdown_connections 2023-11-28T20:00:55.697 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:55.689+0000 7f08f605f640 1 -- 172.21.15.78:0/701947880 wait complete. 2023-11-28T20:00:55.715 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-28T20:00:55.853 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:55.849+0000 7f127199d640 1 Processor -- start 2023-11-28T20:00:55.853 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:55.849+0000 7f127199d640 1 -- start start 2023-11-28T20:00:55.854 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:55.849+0000 7f127199d640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f126c0af4c0 0x7f126c154f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:55.855 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:55.849+0000 7f127199d640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f126c06c100 0x7f126c0c6c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:55.855 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:55.849+0000 7f127199d640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f126c0c4890 con 0x7f126c0c67d0 2023-11-28T20:00:55.855 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:55.849+0000 7f127199d640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f126c155460 con 0x7f126c06c100 2023-11-28T20:00:55.855 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:55.849+0000 7f127199d640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f126c0af8a0 con 0x7f126c0af4c0 2023-11-28T20:00:55.855 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:55.849+0000 7f126b7fe640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f126c06c100 0x7f126c0c6c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:55.855 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:55.849+0000 7f126b7fe640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f126c06c100 0x7f126c0c6c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:40534/0 (socket says 172.21.15.78:40534) 2023-11-28T20:00:55.855 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:55.849+0000 7f126b7fe640 1 -- 172.21.15.78:0/30293845 learned_addr learned my addr 172.21.15.78:0/30293845 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T20:00:55.855 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:55.849+0000 7f126affd640 1 --2- 172.21.15.78:0/30293845 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f126c0af4c0 0x7f126c154f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:55.856 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:55.849+0000 7f126b7fe640 1 -- 172.21.15.78:0/30293845 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f126c0af4c0 msgr2=0x7f126c154f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:00:55.856 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:55.849+0000 7f126b7fe640 1 --2- 172.21.15.78:0/30293845 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f126c0af4c0 0x7f126c154f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:55.856 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:55.849+0000 7f126b7fe640 1 -- 172.21.15.78:0/30293845 >> v1:172.21.15.179:6789/0 conn(0x7f126c0c67d0 legacy=0x7f126c06b9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:00:55.856 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:55.849+0000 7f126b7fe640 1 -- 172.21.15.78:0/30293845 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f126c0c4b30 con 0x7f126c06c100 2023-11-28T20:00:55.858 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:55.853+0000 7f126b7fe640 1 --2- 172.21.15.78:0/30293845 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f126c06c100 0x7f126c0c6c50 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7f1264009e50 tx=0x7f126401c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=753b7545d03478bb server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:00:55.858 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:55.853+0000 7f126a7fc640 1 -- 172.21.15.78:0/30293845 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12640a5810 con 0x7f126c06c100 2023-11-28T20:00:55.858 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:55.853+0000 7f126a7fc640 1 -- 172.21.15.78:0/30293845 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f12640a5970 con 0x7f126c06c100 2023-11-28T20:00:55.858 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:55.853+0000 7f126a7fc640 1 -- 172.21.15.78:0/30293845 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12640a5d00 con 0x7f126c06c100 2023-11-28T20:00:55.859 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:55.853+0000 7f127199d640 1 -- 172.21.15.78:0/30293845 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f126c06c100 msgr2=0x7f126c0c6c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:00:55.859 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:55.853+0000 7f127199d640 1 --2- 172.21.15.78:0/30293845 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f126c06c100 0x7f126c0c6c50 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7f1264009e50 tx=0x7f126401c950 comp rx=0 tx=0).stop 2023-11-28T20:00:55.859 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:55.853+0000 7f127199d640 1 -- 172.21.15.78:0/30293845 shutdown_connections 2023-11-28T20:00:55.859 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:55.853+0000 7f127199d640 1 --2- 172.21.15.78:0/30293845 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f126c06c100 0x7f126c0c6c50 unknown :-1 s=CLOSED pgs=551 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:55.859 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:55.853+0000 7f127199d640 1 --2- 172.21.15.78:0/30293845 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f126c0af4c0 0x7f126c154f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:55.860 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:55.853+0000 7f127199d640 1 -- 172.21.15.78:0/30293845 >> 172.21.15.78:0/30293845 conn(0x7f126c0ab9d0 msgr2=0x7f126c0abde0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:00:55.860 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:55.853+0000 7f127199d640 1 -- 172.21.15.78:0/30293845 shutdown_connections 2023-11-28T20:00:55.860 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:55.853+0000 7f127199d640 1 -- 172.21.15.78:0/30293845 wait complete. 2023-11-28T20:00:55.860 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:55.857+0000 7f127199d640 1 Processor -- start 2023-11-28T20:00:55.860 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:55.857+0000 7f127199d640 1 -- start start 2023-11-28T20:00:55.862 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:55.857+0000 7f127199d640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f126c06c100 0x7f126c1515b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:55.862 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:55.857+0000 7f127199d640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f126c0af4c0 0x7f126c15e540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:55.862 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:55.857+0000 7f127199d640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f126c0c67d0 0x7f126c1efc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:55.863 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:55.857+0000 7f127199d640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f126c0befd0 con 0x7f126c0c67d0 2023-11-28T20:00:55.863 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:55.857+0000 7f127199d640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f126c1544e0 con 0x7f126c0af4c0 2023-11-28T20:00:55.863 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:55.857+0000 7f127199d640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f126c154ca0 con 0x7f126c06c100 2023-11-28T20:00:55.863 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:55.857+0000 7f126b7fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f126c0c67d0 0x7f126c1efc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:55.863 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:55.857+0000 7f126b7fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f126c0c67d0 0x7f126c1efc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:40544/0 (socket says 172.21.15.78:40544) 2023-11-28T20:00:55.863 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:55.857+0000 7f126b7fe640 1 -- 172.21.15.78:0/3626846939 learned_addr learned my addr 172.21.15.78:0/3626846939 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T20:00:55.863 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:55.857+0000 7f126affd640 1 --2- 172.21.15.78:0/3626846939 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f126c06c100 0x7f126c1515b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:55.863 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:55.857+0000 7f1263fff640 1 --2- 172.21.15.78:0/3626846939 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f126c0af4c0 0x7f126c15e540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:55.863 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:55.857+0000 7f126b7fe640 1 -- 172.21.15.78:0/3626846939 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f126c06c100 msgr2=0x7f126c1515b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:00:55.863 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:55.857+0000 7f126b7fe640 1 --2- 172.21.15.78:0/3626846939 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f126c06c100 0x7f126c1515b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:55.863 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:55.857+0000 7f126b7fe640 1 -- 172.21.15.78:0/3626846939 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f126c0af4c0 msgr2=0x7f126c15e540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:00:55.864 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:55.857+0000 7f126b7fe640 1 --2- 172.21.15.78:0/3626846939 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f126c0af4c0 0x7f126c15e540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:55.864 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:55.857+0000 7f126b7fe640 1 -- 172.21.15.78:0/3626846939 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1264009b30 con 0x7f126c0c67d0 2023-11-28T20:00:55.864 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:55.857+0000 7f1263fff640 1 --2- 172.21.15.78:0/3626846939 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f126c0af4c0 0x7f126c15e540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T20:00:55.864 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:55.857+0000 7f126b7fe640 1 --2- 172.21.15.78:0/3626846939 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f126c0c67d0 0x7f126c1efc30 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7f126401a580 tx=0x7f12640196f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:00:55.865 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:55.857+0000 7f1268ff9640 1 -- 172.21.15.78:0/3626846939 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12640b8670 con 0x7f126c0c67d0 2023-11-28T20:00:55.865 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:55.857+0000 7f1268ff9640 1 -- 172.21.15.78:0/3626846939 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f12640b87d0 con 0x7f126c0c67d0 2023-11-28T20:00:55.865 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:55.857+0000 7f127199d640 1 -- 172.21.15.78:0/3626846939 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f126c0c0c50 con 0x7f126c0c67d0 2023-11-28T20:00:55.865 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:55.857+0000 7f1268ff9640 1 -- 172.21.15.78:0/3626846939 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12640b8b40 con 0x7f126c0c67d0 2023-11-28T20:00:55.865 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:55.857+0000 7f127199d640 1 -- 172.21.15.78:0/3626846939 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f126c153b20 con 0x7f126c0c67d0 2023-11-28T20:00:55.865 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:55.861+0000 7f127199d640 1 -- 172.21.15.78:0/3626846939 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f126c067630 con 0x7f126c0c67d0 2023-11-28T20:00:55.865 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:55.861+0000 7f1268ff9640 1 -- 172.21.15.78:0/3626846939 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f12640b8ca0 con 0x7f126c0c67d0 2023-11-28T20:00:55.866 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:55.861+0000 7f1268ff9640 1 --2- 172.21.15.78:0/3626846939 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f124c066470 0x7f124c068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:55.866 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:55.861+0000 7f1268ff9640 1 -- 172.21.15.78:0/3626846939 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6177+0+0 (secure 0 0 0) 0x7f126411f7a0 con 0x7f126c0c67d0 2023-11-28T20:00:55.866 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:55.861+0000 7f126affd640 1 --2- 172.21.15.78:0/3626846939 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f124c066470 0x7f124c068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:55.866 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:55.861+0000 7f126affd640 1 --2- 172.21.15.78:0/3626846939 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f124c066470 0x7f124c068930 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f126c157440 tx=0x7f125c008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:00:55.870 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:55.865+0000 7f1268ff9640 1 -- 172.21.15.78:0/3626846939 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f12640ecb50 con 0x7f126c0c67d0 2023-11-28T20:00:56.023 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:56.017+0000 7f127199d640 1 -- 172.21.15.78:0/3626846939 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f126c06c7a0 con 0x7f126c0c67d0 2023-11-28T20:00:56.024 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:56.021+0000 7f1268ff9640 1 -- 172.21.15.78:0/3626846939 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v49) v1 ==== 74+0+16923 (secure 0 0 0) 0x7f12640f0170 con 0x7f126c0c67d0 2023-11-28T20:00:56.024 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-11-28T20:00:56.025 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":49,"fsid":"dd9780e8-3bda-44fa-a9f0-fa07d19d901d","created":"2023-11-28T19:58:40.969556+0000","modified":"2023-11-28T20:00:53.984726+0000","last_up_change":"2023-11-28T19:58:52.596716+0000","last_in_change":"2023-11-28T19:58:43.609275+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-28T19:58:54.011229+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs2_metadata","create_time":"2023-11-28T20:00:28.571896+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"43","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs2_data","create_time":"2023-11-28T20:00:29.436453+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"44","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs2"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e84245ac-b5da-429e-af18-39acaa2b33e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6800","nonce":3358701235},{"type":"v1","addr":"172.21.15.78:6801","nonce":3358701235}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6802","nonce":3358701235},{"type":"v1","addr":"172.21.15.78:6803","nonce":3358701235}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6806","nonce":3358701235},{"type":"v1","addr":"172.21.15.78:6807","nonce":3358701235}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6804","nonce":3358701235},{"type":"v1","addr":"172.21.15.78:6805","nonce":3358701235}]},"public_addr":"172.21.15.78:6801/3358701235","cluster_addr":"172.21.15.78:6803/3358701235","heartbeat_back_addr":"172.21.15.78:6807/3358701235","heartbeat_front_addr":"172.21.15.78:6805/3358701235","state":["exists","up"]},{"osd":1,"uuid":"e634831d-c4e2-48d9-870c-9556ae162981","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6808","nonce":3211476654},{"type":"v1","addr":"172.21.15.78:6809","nonce":3211476654}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6810","nonce":3211476654},{"type":"v1","addr":"172.21.15.78:6811","nonce":3211476654}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6814","nonce":3211476654},{"type":"v1","addr":"172.21.15.78:6815","nonce":3211476654}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6812","nonce":3211476654},{"type":"v1","addr":"172.21.15.78:6813","nonce":3211476654}]},"public_addr":"172.21.15.78:6809/3211476654","cluster_addr":"172.21.15.78:6811/3211476654","heartbeat_back_addr":"172.21.15.78:6815/3211476654","heartbeat_front_addr":"172.21.15.78:6813/3211476654","state":["exists","up"]},{"osd":2,"uuid":"274c8395-6534-41f0-b8fb-a00af8985aa8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6816","nonce":2532904479},{"type":"v1","addr":"172.21.15.78:6817","nonce":2532904479}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6818","nonce":2532904479},{"type":"v1","addr":"172.21.15.78:6819","nonce":2532904479}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6822","nonce":2532904479},{"type":"v1","addr":"172.21.15.78:6823","nonce":2532904479}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6820","nonce":2532904479},{"type":"v1","addr":"172.21.15.78:6821","nonce":2532904479}]},"public_addr":"172.21.15.78:6817/2532904479","cluster_addr":"172.21.15.78:6819/2532904479","heartbeat_back_addr":"172.21.15.78:6823/2532904479","heartbeat_front_addr":"172.21.15.78:6821/2532904479","state":["exists","up"]},{"osd":3,"uuid":"77acc9af-7d4d-4b18-8cf5-d62f5971b7c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6824","nonce":3442991267},{"type":"v1","addr":"172.21.15.78:6825","nonce":3442991267}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6826","nonce":3442991267},{"type":"v1","addr":"172.21.15.78:6827","nonce":3442991267}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6830","nonce":3442991267},{"type":"v1","addr":"172.21.15.78:6831","nonce":3442991267}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6828","nonce":3442991267},{"type":"v1","addr":"172.21.15.78:6829","nonce":3442991267}]},"public_addr":"172.21.15.78:6825/3442991267","cluster_addr":"172.21.15.78:6827/3442991267","heartbeat_back_addr":"172.21.15.78:6831/3442991267","heartbeat_front_addr":"172.21.15.78:6829/3442991267","state":["exists","up"]},{"osd":4,"uuid":"5c62bc66-6b34-4b7f-a66b-9a743969138c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":802983577},{"type":"v1","addr":"172.21.15.179:6809","nonce":802983577}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":802983577},{"type":"v1","addr":"172.21.15.179:6811","nonce":802983577}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":802983577},{"type":"v1","addr":"172.21.15.179:6815","nonce":802983577}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":802983577},{"type":"v1","addr":"172.21.15.179:6813","nonce":802983577}]},"public_addr":"172.21.15.179:6809/802983577","cluster_addr":"172.21.15.179:6811/802983577","heartbeat_back_addr":"172.21.15.179:6815/802983577","heartbeat_front_addr":"172.21.15.179:6813/802983577","state":["exists","up"]},{"osd":5,"uuid":"67db6d36-f684-4079-b0cd-82b4dd61461f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":518192887},{"type":"v1","addr":"172.21.15.179:6818","nonce":518192887}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":518192887},{"type":"v1","addr":"172.21.15.179:6822","nonce":518192887}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":518192887},{"type":"v1","addr":"172.21.15.179:6829","nonce":518192887}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6824","nonce":518192887},{"type":"v1","addr":"172.21.15.179:6826","nonce":518192887}]},"public_addr":"172.21.15.179:6818/518192887","cluster_addr":"172.21.15.179:6822/518192887","heartbeat_back_addr":"172.21.15.179:6829/518192887","heartbeat_front_addr":"172.21.15.179:6826/518192887","state":["exists","up"]},{"osd":6,"uuid":"12e670af-5a16-4c81-9f97-defa66cab967","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":815435378},{"type":"v1","addr":"172.21.15.179:6801","nonce":815435378}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":815435378},{"type":"v1","addr":"172.21.15.179:6803","nonce":815435378}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":815435378},{"type":"v1","addr":"172.21.15.179:6807","nonce":815435378}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":815435378},{"type":"v1","addr":"172.21.15.179:6805","nonce":815435378}]},"public_addr":"172.21.15.179:6801/815435378","cluster_addr":"172.21.15.179:6803/815435378","heartbeat_back_addr":"172.21.15.179:6807/815435378","heartbeat_front_addr":"172.21.15.179:6805/815435378","state":["exists","up"]},{"osd":7,"uuid":"fe630650-2eb3-49ad-8676-c341e6332eb1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6817","nonce":2848432339},{"type":"v1","addr":"172.21.15.179:6819","nonce":2848432339}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6821","nonce":2848432339},{"type":"v1","addr":"172.21.15.179:6823","nonce":2848432339}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":2848432339},{"type":"v1","addr":"172.21.15.179:6831","nonce":2848432339}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6825","nonce":2848432339},{"type":"v1","addr":"172.21.15.179:6827","nonce":2848432339}]},"public_addr":"172.21.15.179:6819/2848432339","cluster_addr":"172.21.15.179:6823/2848432339","heartbeat_back_addr":"172.21.15.179:6831/2848432339","heartbeat_front_addr":"172.21.15.179:6827/2848432339","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:58:49.255433+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:58:49.412880+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:58:49.559295+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:58:49.245237+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:58:49.184557+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:58:49.329851+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:58:49.366012+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:58:49.349604+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"8.28","mappings":[{"from":0,"to":6}]},{"pgid":"8.38","mappings":[{"from":0,"to":6}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.78:6836/3508383403":"2023-11-29T20:00:50.972350+0000","172.21.15.78:6834/3508383403":"2023-11-29T20:00:50.972350+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-28T20:00:56.026 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:56.021+0000 7f127199d640 1 -- 172.21.15.78:0/3626846939 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f124c066470 msgr2=0x7f124c068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:00:56.026 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:56.021+0000 7f127199d640 1 --2- 172.21.15.78:0/3626846939 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f124c066470 0x7f124c068930 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f126c157440 tx=0x7f125c008040 comp rx=0 tx=0).stop 2023-11-28T20:00:56.026 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:56.021+0000 7f127199d640 1 -- 172.21.15.78:0/3626846939 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f126c0c67d0 msgr2=0x7f126c1efc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:00:56.026 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:56.021+0000 7f127199d640 1 --2- 172.21.15.78:0/3626846939 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f126c0c67d0 0x7f126c1efc30 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7f126401a580 tx=0x7f12640196f0 comp rx=0 tx=0).stop 2023-11-28T20:00:56.027 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:56.021+0000 7f127199d640 1 -- 172.21.15.78:0/3626846939 shutdown_connections 2023-11-28T20:00:56.027 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:56.021+0000 7f127199d640 1 --2- 172.21.15.78:0/3626846939 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f124c066470 0x7f124c068930 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:56.027 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:56.021+0000 7f127199d640 1 --2- 172.21.15.78:0/3626846939 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f126c0c67d0 0x7f126c1efc30 unknown :-1 s=CLOSED pgs=552 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:56.027 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:56.021+0000 7f127199d640 1 --2- 172.21.15.78:0/3626846939 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f126c0af4c0 0x7f126c15e540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:56.028 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:56.021+0000 7f127199d640 1 --2- 172.21.15.78:0/3626846939 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f126c06c100 0x7f126c1515b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:56.028 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:56.021+0000 7f127199d640 1 -- 172.21.15.78:0/3626846939 >> 172.21.15.78:0/3626846939 conn(0x7f126c0ab9d0 msgr2=0x7f126c0c8560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:00:56.028 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:56.021+0000 7f127199d640 1 -- 172.21.15.78:0/3626846939 shutdown_connections 2023-11-28T20:00:56.029 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:56.021+0000 7f127199d640 1 -- 172.21.15.78:0/3626846939 wait complete. 2023-11-28T20:00:56.050 INFO:tasks.cephfs.filesystem:Destroying file system cephfs2 and related pools 2023-11-28T20:00:56.050 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-28T20:00:56.190 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:56.185+0000 7f464b72a640 1 Processor -- start 2023-11-28T20:00:56.190 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:56.185+0000 7f464b72a640 1 -- start start 2023-11-28T20:00:56.191 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:56.185+0000 7f464b72a640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f46440c0f30 0x7f4644072580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:56.192 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:56.185+0000 7f464b72a640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f46440c1a50 con 0x7f46440c0460 2023-11-28T20:00:56.192 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:56.185+0000 7f464b72a640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4644159990 con 0x7f46440c3960 2023-11-28T20:00:56.192 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:56.185+0000 7f464b72a640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f46440c3de0 con 0x7f46440c0f30 2023-11-28T20:00:56.192 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:56.189+0000 7f46494c6640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f46440c0f30 0x7f4644072580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:56.192 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:56.189+0000 7f4649cc7640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f46440c0460 0x7f4644155ed0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:59226/0 (socket says 172.21.15.78:59226) 2023-11-28T20:00:56.192 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:56.189+0000 7f4649cc7640 1 -- 172.21.15.78:0/118661616 learned_addr learned my addr 172.21.15.78:0/118661616 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-11-28T20:00:56.193 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:56.189+0000 7f463bfff640 1 -- 172.21.15.78:0/118661616 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2506762773 0 0) 0x7f46440c1a50 con 0x7f46440c0460 2023-11-28T20:00:56.193 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:56.189+0000 7f463bfff640 1 -- 172.21.15.78:0/118661616 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4630003530 con 0x7f46440c0460 2023-11-28T20:00:56.193 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:56.189+0000 7f46494c6640 1 -- 172.21.15.78:0/118661616 >> v1:172.21.15.179:6789/0 conn(0x7f46440c3960 legacy=0x7f4644159280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:00:56.193 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:56.189+0000 7f46494c6640 1 -- 172.21.15.78:0/118661616 >> v1:172.21.15.78:6789/0 conn(0x7f46440c0460 legacy=0x7f4644155ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:00:56.194 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:56.189+0000 7f46494c6640 1 -- 172.21.15.78:0/118661616 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46440c0890 con 0x7f46440c0f30 2023-11-28T20:00:56.195 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:56.189+0000 7f46494c6640 1 --2- 172.21.15.78:0/118661616 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f46440c0f30 0x7f4644072580 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7f46400097c0 tx=0x7f464001c3f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a81f9ad545607a36 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:00:56.195 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:56.189+0000 7f463bfff640 1 -- 172.21.15.78:0/118661616 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46400ab5f0 con 0x7f46440c0f30 2023-11-28T20:00:56.195 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:56.189+0000 7f463bfff640 1 -- 172.21.15.78:0/118661616 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f46400ab750 con 0x7f46440c0f30 2023-11-28T20:00:56.195 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:56.189+0000 7f463bfff640 1 -- 172.21.15.78:0/118661616 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46400abac0 con 0x7f46440c0f30 2023-11-28T20:00:56.196 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:56.193+0000 7f464b72a640 1 -- 172.21.15.78:0/118661616 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f46440c0f30 msgr2=0x7f4644072580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:00:56.196 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:56.193+0000 7f464b72a640 1 --2- 172.21.15.78:0/118661616 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f46440c0f30 0x7f4644072580 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7f46400097c0 tx=0x7f464001c3f0 comp rx=0 tx=0).stop 2023-11-28T20:00:56.196 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:56.193+0000 7f464b72a640 1 -- 172.21.15.78:0/118661616 shutdown_connections 2023-11-28T20:00:56.196 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:56.193+0000 7f464b72a640 1 --2- 172.21.15.78:0/118661616 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f46440c0f30 0x7f4644072580 unknown :-1 s=CLOSED pgs=554 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:56.196 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:56.193+0000 7f464b72a640 1 -- 172.21.15.78:0/118661616 >> 172.21.15.78:0/118661616 conn(0x7f46440a7810 msgr2=0x7f46440a7c20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:00:56.197 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:56.193+0000 7f464b72a640 1 -- 172.21.15.78:0/118661616 shutdown_connections 2023-11-28T20:00:56.197 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:56.193+0000 7f464b72a640 1 -- 172.21.15.78:0/118661616 wait complete. 2023-11-28T20:00:56.197 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:56.193+0000 7f464b72a640 1 Processor -- start 2023-11-28T20:00:56.197 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:56.193+0000 7f464b72a640 1 -- start start 2023-11-28T20:00:56.200 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:56.193+0000 7f464b72a640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f46440c0460 0x7f4644071510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:56.200 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:56.193+0000 7f464b72a640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f46440c0f30 0x7f4644143ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:56.200 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:56.193+0000 7f464b72a640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f46440c3960 0x7f46441441e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:56.200 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:56.193+0000 7f464b72a640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4644144720 con 0x7f46440c0460 2023-11-28T20:00:56.200 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:56.193+0000 7f464b72a640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4644070000 con 0x7f46440c0f30 2023-11-28T20:00:56.200 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:56.193+0000 7f464b72a640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4644071af0 con 0x7f46440c3960 2023-11-28T20:00:56.200 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:56.193+0000 7f46494c6640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f46440c0460 0x7f4644071510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:56.200 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:56.193+0000 7f46494c6640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f46440c0460 0x7f4644071510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:40554/0 (socket says 172.21.15.78:40554) 2023-11-28T20:00:56.200 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:56.193+0000 7f46494c6640 1 -- 172.21.15.78:0/1647107336 learned_addr learned my addr 172.21.15.78:0/1647107336 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T20:00:56.201 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:56.193+0000 7f4648cc5640 1 --2- 172.21.15.78:0/1647107336 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f46440c0f30 0x7f4644143ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:56.201 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:56.193+0000 7f4649cc7640 1 --2- 172.21.15.78:0/1647107336 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f46440c3960 0x7f46441441e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:56.201 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:56.193+0000 7f46494c6640 1 -- 172.21.15.78:0/1647107336 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f46440c3960 msgr2=0x7f46441441e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:00:56.201 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:56.193+0000 7f46494c6640 1 --2- 172.21.15.78:0/1647107336 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f46440c3960 0x7f46441441e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:56.201 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:56.193+0000 7f46494c6640 1 -- 172.21.15.78:0/1647107336 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f46440c0f30 msgr2=0x7f4644143ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:00:56.201 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:56.193+0000 7f46494c6640 1 --2- 172.21.15.78:0/1647107336 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f46440c0f30 0x7f4644143ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:56.201 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:56.193+0000 7f46494c6640 1 -- 172.21.15.78:0/1647107336 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4640009420 con 0x7f46440c0460 2023-11-28T20:00:56.201 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:56.193+0000 7f4649cc7640 1 --2- 172.21.15.78:0/1647107336 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f46440c3960 0x7f46441441e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T20:00:56.201 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:56.193+0000 7f46494c6640 1 --2- 172.21.15.78:0/1647107336 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f46440c0460 0x7f4644071510 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7f46400097c0 tx=0x7f464001ac30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:00:56.201 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:56.197+0000 7f4639ffb640 1 -- 172.21.15.78:0/1647107336 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4640004220 con 0x7f46440c0460 2023-11-28T20:00:56.201 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:56.197+0000 7f4639ffb640 1 -- 172.21.15.78:0/1647107336 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f46400b9070 con 0x7f46440c0460 2023-11-28T20:00:56.201 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:56.197+0000 7f4639ffb640 1 -- 172.21.15.78:0/1647107336 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4640003620 con 0x7f46440c0460 2023-11-28T20:00:56.202 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:56.197+0000 7f464b72a640 1 -- 172.21.15.78:0/1647107336 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4644156760 con 0x7f46440c0460 2023-11-28T20:00:56.202 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:56.197+0000 7f464b72a640 1 -- 172.21.15.78:0/1647107336 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f464414ef00 con 0x7f46440c0460 2023-11-28T20:00:56.202 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:56.197+0000 7f464b72a640 1 -- 172.21.15.78:0/1647107336 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f46440c1a70 con 0x7f46440c0460 2023-11-28T20:00:56.202 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:56.197+0000 7f4639ffb640 1 -- 172.21.15.78:0/1647107336 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f4640003780 con 0x7f46440c0460 2023-11-28T20:00:56.203 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:56.197+0000 7f4639ffb640 1 --2- 172.21.15.78:0/1647107336 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f4628066470 0x7f4628068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:56.203 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:56.197+0000 7f4639ffb640 1 -- 172.21.15.78:0/1647107336 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6177+0+0 (secure 0 0 0) 0x7f46400bb070 con 0x7f46440c0460 2023-11-28T20:00:56.203 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:56.197+0000 7f4648cc5640 1 --2- 172.21.15.78:0/1647107336 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f4628066470 0x7f4628068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:56.203 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:56.201+0000 7f4648cc5640 1 --2- 172.21.15.78:0/1647107336 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f4628066470 0x7f4628068930 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f464414b3a0 tx=0x7f4634009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:00:56.206 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:56.201+0000 7f4639ffb640 1 -- 172.21.15.78:0/1647107336 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f46400ebba0 con 0x7f46440c0460 2023-11-28T20:00:56.388 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:56.381+0000 7f464b72a640 1 -- 172.21.15.78:0/1647107336 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f4644067630 con 0x7f46440c0460 2023-11-28T20:00:56.388 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:56.385+0000 7f4639ffb640 1 -- 172.21.15.78:0/1647107336 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) v1 ==== 94+0+4912 (secure 0 0 0) 0x7f46400c4090 con 0x7f46440c0460 2023-11-28T20:00:56.388 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-11-28T20:00:56.389 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":24,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4880,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6835/20894428","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6834","nonce":20894428},{"type":"v1","addr":"172.21.15.179:6835","nonce":20894428}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":4886,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6837/666703170","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6835","nonce":666703170},{"type":"v1","addr":"172.21.15.78:6837","nonce":666703170}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":5691,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6836/2246548406","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6834","nonce":2246548406},{"type":"v1","addr":"172.21.15.78:6836","nonce":2246548406}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":24}],"filesystems":[{"mdsmap":{"epoch":22,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-28T20:00:30.436267+0000","modified":"2023-11-28T20:00:33.475772+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5179},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5179":{"gid":5179,"name":"b","rank":0,"incarnation":18,"state":"up:active","state_seq":8,"addr":"172.21.15.179:6833/3446403084","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6832","nonce":3446403084},{"type":"v1","addr":"172.21.15.179:6833","nonce":3446403084}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs2","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2023-11-28T20:00:56.389 INFO:teuthology.orchestra.run.smithi078.stderr:dumped fsmap epoch 24 2023-11-28T20:00:56.390 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:56.385+0000 7f464b72a640 1 -- 172.21.15.78:0/1647107336 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f4628066470 msgr2=0x7f4628068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:00:56.390 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:56.385+0000 7f464b72a640 1 --2- 172.21.15.78:0/1647107336 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f4628066470 0x7f4628068930 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f464414b3a0 tx=0x7f4634009040 comp rx=0 tx=0).stop 2023-11-28T20:00:56.390 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:56.385+0000 7f464b72a640 1 -- 172.21.15.78:0/1647107336 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f46440c0460 msgr2=0x7f4644071510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:00:56.391 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:56.385+0000 7f464b72a640 1 --2- 172.21.15.78:0/1647107336 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f46440c0460 0x7f4644071510 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7f46400097c0 tx=0x7f464001ac30 comp rx=0 tx=0).stop 2023-11-28T20:00:56.391 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:56.385+0000 7f464b72a640 1 -- 172.21.15.78:0/1647107336 shutdown_connections 2023-11-28T20:00:56.391 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:56.385+0000 7f464b72a640 1 --2- 172.21.15.78:0/1647107336 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f4628066470 0x7f4628068930 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:56.391 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:56.385+0000 7f464b72a640 1 --2- 172.21.15.78:0/1647107336 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f46440c3960 0x7f46441441e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:56.391 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:56.385+0000 7f464b72a640 1 --2- 172.21.15.78:0/1647107336 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f46440c0f30 0x7f4644143ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:56.391 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:56.385+0000 7f464b72a640 1 --2- 172.21.15.78:0/1647107336 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f46440c0460 0x7f4644071510 unknown :-1 s=CLOSED pgs=555 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:56.391 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:56.385+0000 7f464b72a640 1 -- 172.21.15.78:0/1647107336 >> 172.21.15.78:0/1647107336 conn(0x7f46440a7810 msgr2=0x7f46440a7bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:00:56.391 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:56.385+0000 7f464b72a640 1 -- 172.21.15.78:0/1647107336 shutdown_connections 2023-11-28T20:00:56.391 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:56.385+0000 7f464b72a640 1 -- 172.21.15.78:0/1647107336 wait complete. 2023-11-28T20:00:56.409 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-28T20:00:56.546 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:56.541+0000 7f3537e9e640 1 Processor -- start 2023-11-28T20:00:56.546 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:56.541+0000 7f3537e9e640 1 -- start start 2023-11-28T20:00:56.547 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:56.541+0000 7f3537e9e640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f35300c3b80 0x7f353006d690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:56.547 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:56.541+0000 7f3537e9e640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f353006bb80 con 0x7f35300c5300 2023-11-28T20:00:56.547 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:56.541+0000 7f3537e9e640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f35300c5790 con 0x7f353006d2b0 2023-11-28T20:00:56.547 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:56.541+0000 7f3537e9e640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35301515c0 con 0x7f35300c3b80 2023-11-28T20:00:56.547 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:56.541+0000 7f353643b640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f35300c5300 0x7f353006c730 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:59240/0 (socket says 172.21.15.78:59240) 2023-11-28T20:00:56.547 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:56.541+0000 7f353643b640 1 -- 172.21.15.78:0/4249824500 learned_addr learned my addr 172.21.15.78:0/4249824500 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-11-28T20:00:56.549 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:56.541+0000 7f3535439640 1 --2- 172.21.15.78:0/4249824500 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f35300c3b80 0x7f353006d690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:56.550 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:56.545+0000 7f3534c38640 1 -- 172.21.15.78:0/4249824500 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3006209513 0 0) 0x7f353006bb80 con 0x7f35300c5300 2023-11-28T20:00:56.550 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:56.545+0000 7f3534c38640 1 -- 172.21.15.78:0/4249824500 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f351c003530 con 0x7f35300c5300 2023-11-28T20:00:56.550 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:56.545+0000 7f3534c38640 1 -- 172.21.15.78:0/4249824500 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2680881889 0 0) 0x7f35300c5790 con 0x7f353006d2b0 2023-11-28T20:00:56.550 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:56.545+0000 7f3534c38640 1 -- 172.21.15.78:0/4249824500 --> v1:172.21.15.179:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f353006bb80 con 0x7f353006d2b0 2023-11-28T20:00:56.550 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:56.545+0000 7f3534c38640 1 -- 172.21.15.78:0/4249824500 <== mon.0 v1:172.21.15.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2347104145 0 0) 0x7f351c003530 con 0x7f35300c5300 2023-11-28T20:00:56.550 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:56.545+0000 7f3534c38640 1 -- 172.21.15.78:0/4249824500 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f35300c3b80 msgr2=0x7f353006d690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:00:56.550 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:56.545+0000 7f3534c38640 1 --2- 172.21.15.78:0/4249824500 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f35300c3b80 0x7f353006d690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:56.550 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:56.545+0000 7f3534c38640 1 -- 172.21.15.78:0/4249824500 >> v1:172.21.15.179:6789/0 conn(0x7f353006d2b0 legacy=0x7f353006c020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:00:56.550 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:56.545+0000 7f3534c38640 1 -- 172.21.15.78:0/4249824500 --> v1:172.21.15.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35301518a0 con 0x7f35300c5300 2023-11-28T20:00:56.550 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:56.545+0000 7f3534c38640 1 -- 172.21.15.78:0/4249824500 <== mon.0 v1:172.21.15.78:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3326804700 0 0) 0x7f3528001a00 con 0x7f35300c5300 2023-11-28T20:00:56.551 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:56.545+0000 7f3534c38640 1 -- 172.21.15.78:0/4249824500 >> v1:172.21.15.78:6789/0 conn(0x7f35300c5300 legacy=0x7f353006c730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:00:56.551 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:56.545+0000 7f3534c38640 1 --2- 172.21.15.78:0/4249824500 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f35300c3b80 0x7f351c003b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:56.551 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:56.545+0000 7f3534c38640 1 --2- 172.21.15.78:0/4249824500 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f351c0040a0 0x7f351c0047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:56.551 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:56.545+0000 7f3534c38640 1 --2- 172.21.15.78:0/4249824500 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f351c004d10 0x7f351c005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:56.551 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:56.545+0000 7f3534c38640 1 -- 172.21.15.78:0/4249824500 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35301515c0 con 0x7f351c004d10 2023-11-28T20:00:56.551 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:56.545+0000 7f3534c38640 1 -- 172.21.15.78:0/4249824500 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f351c00ba70 con 0x7f351c0040a0 2023-11-28T20:00:56.551 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:56.545+0000 7f3534c38640 1 -- 172.21.15.78:0/4249824500 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f351c00bc30 con 0x7f35300c3b80 2023-11-28T20:00:56.551 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:56.545+0000 7f353643b640 1 --2- 172.21.15.78:0/4249824500 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f351c004d10 0x7f351c005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:56.551 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:56.545+0000 7f3535c3a640 1 --2- 172.21.15.78:0/4249824500 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f35300c3b80 0x7f351c003b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:56.551 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:56.545+0000 7f3535439640 1 --2- 172.21.15.78:0/4249824500 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f351c0040a0 0x7f351c0047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:56.551 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:56.545+0000 7f353643b640 1 -- 172.21.15.78:0/4249824500 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f35300c3b80 msgr2=0x7f351c003b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:00:56.552 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:56.545+0000 7f353643b640 1 --2- 172.21.15.78:0/4249824500 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f35300c3b80 0x7f351c003b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:56.552 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:56.545+0000 7f353643b640 1 -- 172.21.15.78:0/4249824500 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f351c0040a0 msgr2=0x7f351c0047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:00:56.552 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:56.545+0000 7f353643b640 1 --2- 172.21.15.78:0/4249824500 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f351c0040a0 0x7f351c0047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:56.552 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:56.545+0000 7f353643b640 1 -- 172.21.15.78:0/4249824500 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f351c003530 con 0x7f351c004d10 2023-11-28T20:00:56.553 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:56.549+0000 7f353643b640 1 --2- 172.21.15.78:0/4249824500 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f351c004d10 0x7f351c005190 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7f352800a7a0 tx=0x7f3528021c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c55eb44a83a597fa server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:00:56.553 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:56.549+0000 7f3534c38640 1 -- 172.21.15.78:0/4249824500 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35280ab630 con 0x7f351c004d10 2023-11-28T20:00:56.553 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:56.549+0000 7f3534c38640 1 -- 172.21.15.78:0/4249824500 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f35280ab7b0 con 0x7f351c004d10 2023-11-28T20:00:56.553 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:56.549+0000 7f3534c38640 1 -- 172.21.15.78:0/4249824500 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35280abba0 con 0x7f351c004d10 2023-11-28T20:00:56.553 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:56.549+0000 7f3537e9e640 1 -- 172.21.15.78:0/4249824500 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f351c004d10 msgr2=0x7f351c005190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:00:56.553 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:56.549+0000 7f3537e9e640 1 --2- 172.21.15.78:0/4249824500 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f351c004d10 0x7f351c005190 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7f352800a7a0 tx=0x7f3528021c10 comp rx=0 tx=0).stop 2023-11-28T20:00:56.553 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:56.549+0000 7f353643b640 1 -- 172.21.15.78:0/4249824500 reap_dead start 2023-11-28T20:00:56.554 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:56.549+0000 7f3537e9e640 1 -- 172.21.15.78:0/4249824500 shutdown_connections 2023-11-28T20:00:56.554 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:56.549+0000 7f3537e9e640 1 -- 172.21.15.78:0/4249824500 >> 172.21.15.78:0/4249824500 conn(0x7f35300a7810 msgr2=0x7f35300a7c20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:00:56.554 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:56.549+0000 7f3537e9e640 1 -- 172.21.15.78:0/4249824500 shutdown_connections 2023-11-28T20:00:56.554 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:56.549+0000 7f3537e9e640 1 -- 172.21.15.78:0/4249824500 wait complete. 2023-11-28T20:00:56.554 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:56.549+0000 7f3537e9e640 1 Processor -- start 2023-11-28T20:00:56.554 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:56.549+0000 7f3537e9e640 1 -- start start 2023-11-28T20:00:56.556 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:56.549+0000 7f3537e9e640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f351c004d10 0x7f353014c4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:56.556 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:56.549+0000 7f3537e9e640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f353014db80 0x7f353014cd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:56.556 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:56.549+0000 7f3537e9e640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3530153130 0x7f353014a4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:56.557 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:56.549+0000 7f3537e9e640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35301ea1a0 con 0x7f3530153130 2023-11-28T20:00:56.557 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:56.549+0000 7f3537e9e640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f353014b3b0 con 0x7f353014db80 2023-11-28T20:00:56.557 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:56.553+0000 7f3537e9e640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3530154820 con 0x7f351c004d10 2023-11-28T20:00:56.557 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:56.553+0000 7f353643b640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3530153130 0x7f353014a4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:56.557 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:56.553+0000 7f353643b640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3530153130 0x7f353014a4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:40574/0 (socket says 172.21.15.78:40574) 2023-11-28T20:00:56.557 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:56.553+0000 7f353643b640 1 -- 172.21.15.78:0/2707474702 learned_addr learned my addr 172.21.15.78:0/2707474702 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T20:00:56.557 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:56.553+0000 7f3535c3a640 1 --2- 172.21.15.78:0/2707474702 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f351c004d10 0x7f353014c4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:56.557 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:56.553+0000 7f3535439640 1 --2- 172.21.15.78:0/2707474702 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f353014db80 0x7f353014cd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:56.557 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:56.553+0000 7f353643b640 1 -- 172.21.15.78:0/2707474702 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f351c004d10 msgr2=0x7f353014c4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:00:56.557 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:56.553+0000 7f353643b640 1 --2- 172.21.15.78:0/2707474702 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f351c004d10 0x7f353014c4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:56.557 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:56.553+0000 7f353643b640 1 -- 172.21.15.78:0/2707474702 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f353014db80 msgr2=0x7f353014cd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:00:56.557 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:56.553+0000 7f353643b640 1 --2- 172.21.15.78:0/2707474702 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f353014db80 0x7f353014cd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:56.558 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:56.553+0000 7f353643b640 1 -- 172.21.15.78:0/2707474702 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f353014b870 con 0x7f3530153130 2023-11-28T20:00:56.558 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:56.553+0000 7f353643b640 1 --2- 172.21.15.78:0/2707474702 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3530153130 0x7f353014a4f0 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7f352800a7a0 tx=0x7f351c005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:00:56.558 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:56.553+0000 7f35267fc640 1 -- 172.21.15.78:0/2707474702 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3528001a00 con 0x7f3530153130 2023-11-28T20:00:56.559 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:56.553+0000 7f35267fc640 1 -- 172.21.15.78:0/2707474702 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f35280b8070 con 0x7f3530153130 2023-11-28T20:00:56.559 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:56.553+0000 7f35267fc640 1 -- 172.21.15.78:0/2707474702 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35280abb40 con 0x7f3530153130 2023-11-28T20:00:56.559 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:56.553+0000 7f3537e9e640 1 -- 172.21.15.78:0/2707474702 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f35300c1380 con 0x7f3530153130 2023-11-28T20:00:56.559 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:56.553+0000 7f3537e9e640 1 -- 172.21.15.78:0/2707474702 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f353014b0d0 con 0x7f3530153130 2023-11-28T20:00:56.559 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:56.553+0000 7f3537e9e640 1 -- 172.21.15.78:0/2707474702 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3530067630 con 0x7f3530153130 2023-11-28T20:00:56.559 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:56.553+0000 7f35267fc640 1 -- 172.21.15.78:0/2707474702 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f35280ba030 con 0x7f3530153130 2023-11-28T20:00:56.560 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:56.557+0000 7f35267fc640 1 --2- 172.21.15.78:0/2707474702 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f35140664a0 0x7f3514068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:56.560 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:56.557+0000 7f35267fc640 1 -- 172.21.15.78:0/2707474702 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6177+0+0 (secure 0 0 0) 0x7f3528121630 con 0x7f3530153130 2023-11-28T20:00:56.560 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:56.557+0000 7f3535c3a640 1 --2- 172.21.15.78:0/2707474702 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f35140664a0 0x7f3514068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:56.560 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:56.557+0000 7f3535c3a640 1 --2- 172.21.15.78:0/2707474702 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f35140664a0 0x7f3514068960 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f352c000c10 tx=0x7f352c009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:00:56.563 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:56.561+0000 7f35267fc640 1 -- 172.21.15.78:0/2707474702 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f35280ee980 con 0x7f3530153130 2023-11-28T20:00:56.744 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:56.737+0000 7f3537e9e640 1 -- 172.21.15.78:0/2707474702 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f353006bd70 con 0x7f3530153130 2023-11-28T20:00:56.744 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:56.741+0000 7f35267fc640 1 -- 172.21.15.78:0/2707474702 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) v1 ==== 94+0+4912 (secure 0 0 0) 0x7f3528001f60 con 0x7f3530153130 2023-11-28T20:00:56.744 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-11-28T20:00:56.745 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":24,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4880,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6835/20894428","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6834","nonce":20894428},{"type":"v1","addr":"172.21.15.179:6835","nonce":20894428}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":4886,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6837/666703170","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6835","nonce":666703170},{"type":"v1","addr":"172.21.15.78:6837","nonce":666703170}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":5691,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6836/2246548406","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6834","nonce":2246548406},{"type":"v1","addr":"172.21.15.78:6836","nonce":2246548406}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":24}],"filesystems":[{"mdsmap":{"epoch":22,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-28T20:00:30.436267+0000","modified":"2023-11-28T20:00:33.475772+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5179},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5179":{"gid":5179,"name":"b","rank":0,"incarnation":18,"state":"up:active","state_seq":8,"addr":"172.21.15.179:6833/3446403084","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6832","nonce":3446403084},{"type":"v1","addr":"172.21.15.179:6833","nonce":3446403084}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs2","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2023-11-28T20:00:56.745 INFO:teuthology.orchestra.run.smithi078.stderr:dumped fsmap epoch 24 2023-11-28T20:00:56.746 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:56.741+0000 7f3537e9e640 1 -- 172.21.15.78:0/2707474702 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f35140664a0 msgr2=0x7f3514068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:00:56.746 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:56.741+0000 7f3537e9e640 1 --2- 172.21.15.78:0/2707474702 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f35140664a0 0x7f3514068960 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f352c000c10 tx=0x7f352c009040 comp rx=0 tx=0).stop 2023-11-28T20:00:56.747 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:56.741+0000 7f3537e9e640 1 -- 172.21.15.78:0/2707474702 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3530153130 msgr2=0x7f353014a4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:00:56.747 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:56.741+0000 7f3537e9e640 1 --2- 172.21.15.78:0/2707474702 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3530153130 0x7f353014a4f0 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7f352800a7a0 tx=0x7f351c005800 comp rx=0 tx=0).stop 2023-11-28T20:00:56.747 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:56.741+0000 7f3537e9e640 1 -- 172.21.15.78:0/2707474702 shutdown_connections 2023-11-28T20:00:56.747 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:56.741+0000 7f3537e9e640 1 --2- 172.21.15.78:0/2707474702 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f35140664a0 0x7f3514068960 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:56.747 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:56.741+0000 7f3537e9e640 1 --2- 172.21.15.78:0/2707474702 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3530153130 0x7f353014a4f0 unknown :-1 s=CLOSED pgs=558 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:56.747 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:56.741+0000 7f3537e9e640 1 --2- 172.21.15.78:0/2707474702 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f353014db80 0x7f353014cd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:56.747 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:56.741+0000 7f3537e9e640 1 --2- 172.21.15.78:0/2707474702 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f351c004d10 0x7f353014c4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:56.747 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:56.741+0000 7f3537e9e640 1 -- 172.21.15.78:0/2707474702 >> 172.21.15.78:0/2707474702 conn(0x7f35300a7810 msgr2=0x7f35300c0210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:00:56.747 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:56.741+0000 7f3537e9e640 1 -- 172.21.15.78:0/2707474702 shutdown_connections 2023-11-28T20:00:56.747 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:56.741+0000 7f3537e9e640 1 -- 172.21.15.78:0/2707474702 wait complete. 2023-11-28T20:00:56.765 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-28T20:00:56.902 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:56.897+0000 7fdb08d96640 1 Processor -- start 2023-11-28T20:00:56.903 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:56.897+0000 7fdb08d96640 1 -- start start 2023-11-28T20:00:56.905 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:56.897+0000 7fdb08d96640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fdb0406d2b0 0x7fdb0406d690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:56.905 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:56.901+0000 7fdb08d96640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdb0406bb80 con 0x7fdb040c5300 2023-11-28T20:00:56.905 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:56.901+0000 7fdb08d96640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdb040c5790 con 0x7fdb040c3b80 2023-11-28T20:00:56.906 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:56.901+0000 7fdb08d96640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdb041515c0 con 0x7fdb0406d2b0 2023-11-28T20:00:56.906 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:56.901+0000 7fdb02d9d640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7fdb040c5300 0x7fdb0406c730 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:59246/0 (socket says 172.21.15.78:59246) 2023-11-28T20:00:56.906 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:56.901+0000 7fdb02d9d640 1 -- 172.21.15.78:0/1457179077 learned_addr learned my addr 172.21.15.78:0/1457179077 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-11-28T20:00:56.906 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:56.901+0000 7fdb0259c640 1 --2- 172.21.15.78:0/1457179077 >> v2:172.21.15.179:3300/0 conn(0x7fdb0406d2b0 0x7fdb0406d690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:56.906 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:56.901+0000 7fdb01d9b640 1 -- 172.21.15.78:0/1457179077 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2927588954 0 0) 0x7fdb0406bb80 con 0x7fdb040c5300 2023-11-28T20:00:56.906 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:56.901+0000 7fdb01d9b640 1 -- 172.21.15.78:0/1457179077 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdaf0003530 con 0x7fdb040c5300 2023-11-28T20:00:56.906 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:56.901+0000 7fdb01d9b640 1 -- 172.21.15.78:0/1457179077 <== mon.0 v1:172.21.15.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 714269439 0 0) 0x7fdaf0003530 con 0x7fdb040c5300 2023-11-28T20:00:56.906 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:56.901+0000 7fdb01d9b640 1 -- 172.21.15.78:0/1457179077 >> v2:172.21.15.179:3300/0 conn(0x7fdb0406d2b0 msgr2=0x7fdb0406d690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:00:56.906 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:56.901+0000 7fdb01d9b640 1 --2- 172.21.15.78:0/1457179077 >> v2:172.21.15.179:3300/0 conn(0x7fdb0406d2b0 0x7fdb0406d690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:56.906 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:56.901+0000 7fdb01d9b640 1 -- 172.21.15.78:0/1457179077 >> v1:172.21.15.179:6789/0 conn(0x7fdb040c3b80 legacy=0x7fdb0406c020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:00:56.906 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:56.901+0000 7fdb01d9b640 1 -- 172.21.15.78:0/1457179077 --> v1:172.21.15.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb041518a0 con 0x7fdb040c5300 2023-11-28T20:00:56.907 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:56.901+0000 7fdb01d9b640 1 -- 172.21.15.78:0/1457179077 <== mon.0 v1:172.21.15.78:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3326804700 0 0) 0x7fdafc001a00 con 0x7fdb040c5300 2023-11-28T20:00:56.907 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:56.901+0000 7fdb01d9b640 1 -- 172.21.15.78:0/1457179077 >> v1:172.21.15.78:6789/0 conn(0x7fdb040c5300 legacy=0x7fdb0406c730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:00:56.907 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:56.901+0000 7fdb01d9b640 1 --2- 172.21.15.78:0/1457179077 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdaf0003980 0x7fdaf0003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:56.907 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:56.901+0000 7fdb01d9b640 1 --2- 172.21.15.78:0/1457179077 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdaf00047d0 0x7fdaf0004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:56.907 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:56.901+0000 7fdb01d9b640 1 --2- 172.21.15.78:0/1457179077 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdaf0005190 0x7fdaf000dba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:56.907 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:56.901+0000 7fdb01d9b640 1 -- 172.21.15.78:0/1457179077 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb041515c0 con 0x7fdaf0005190 2023-11-28T20:00:56.907 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:56.901+0000 7fdb01d9b640 1 -- 172.21.15.78:0/1457179077 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdaf000e240 con 0x7fdaf0003980 2023-11-28T20:00:56.907 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:56.901+0000 7fdb01d9b640 1 -- 172.21.15.78:0/1457179077 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdaf000e400 con 0x7fdaf00047d0 2023-11-28T20:00:56.908 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:56.901+0000 7fdb02d9d640 1 --2- 172.21.15.78:0/1457179077 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdaf0005190 0x7fdaf000dba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:56.908 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:56.901+0000 7fdb0259c640 1 --2- 172.21.15.78:0/1457179077 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdaf0003980 0x7fdaf0003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:56.909 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:56.901+0000 7fdafbfff640 1 --2- 172.21.15.78:0/1457179077 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdaf00047d0 0x7fdaf0004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:56.909 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:56.901+0000 7fdb02d9d640 1 -- 172.21.15.78:0/1457179077 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdaf00047d0 msgr2=0x7fdaf0004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:00:56.910 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:56.901+0000 7fdb02d9d640 1 --2- 172.21.15.78:0/1457179077 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdaf00047d0 0x7fdaf0004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:56.910 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:56.901+0000 7fdb02d9d640 1 -- 172.21.15.78:0/1457179077 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdaf0003980 msgr2=0x7fdaf0003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:00:56.911 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:56.901+0000 7fdb02d9d640 1 --2- 172.21.15.78:0/1457179077 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdaf0003980 0x7fdaf0003da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:56.911 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:56.901+0000 7fdb02d9d640 1 -- 172.21.15.78:0/1457179077 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdaf0003530 con 0x7fdaf0005190 2023-11-28T20:00:56.916 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:56.905+0000 7fdb02d9d640 1 -- 172.21.15.78:0/1457179077 reap_dead start 2023-11-28T20:00:56.916 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:56.905+0000 7fdb02d9d640 1 --2- 172.21.15.78:0/1457179077 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdaf0005190 0x7fdaf000dba0 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7fdafc00a830 tx=0x7fdafc01d340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f7fcaf157ca66d39 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:00:56.916 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:56.905+0000 7fdb01d9b640 1 -- 172.21.15.78:0/1457179077 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdafc0072d0 con 0x7fdaf0005190 2023-11-28T20:00:56.916 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:56.905+0000 7fdb01d9b640 1 -- 172.21.15.78:0/1457179077 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdafc0a8070 con 0x7fdaf0005190 2023-11-28T20:00:56.916 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:56.905+0000 7fdb01d9b640 1 -- 172.21.15.78:0/1457179077 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdafc0076b0 con 0x7fdaf0005190 2023-11-28T20:00:56.917 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:56.905+0000 7fdb08d96640 1 -- 172.21.15.78:0/1457179077 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdaf0005190 msgr2=0x7fdaf000dba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:00:56.917 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:56.905+0000 7fdb08d96640 1 --2- 172.21.15.78:0/1457179077 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdaf0005190 0x7fdaf000dba0 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7fdafc00a830 tx=0x7fdafc01d340 comp rx=0 tx=0).stop 2023-11-28T20:00:56.917 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:56.905+0000 7fdb08d96640 1 -- 172.21.15.78:0/1457179077 shutdown_connections 2023-11-28T20:00:56.917 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:56.905+0000 7fdb08d96640 1 --2- 172.21.15.78:0/1457179077 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdaf0005190 0x7fdaf000dba0 unknown :-1 s=CLOSED pgs=560 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:56.917 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:56.905+0000 7fdb08d96640 1 -- 172.21.15.78:0/1457179077 >> 172.21.15.78:0/1457179077 conn(0x7fdb040a7810 msgr2=0x7fdb040a7c20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:00:56.917 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:56.905+0000 7fdb08d96640 1 -- 172.21.15.78:0/1457179077 shutdown_connections 2023-11-28T20:00:56.917 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:56.905+0000 7fdb08d96640 1 -- 172.21.15.78:0/1457179077 wait complete. 2023-11-28T20:00:56.917 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:56.905+0000 7fdb08d96640 1 Processor -- start 2023-11-28T20:00:56.917 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:56.905+0000 7fdb08d96640 1 -- start start 2023-11-28T20:00:56.918 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:56.909+0000 7fdb08d96640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdaf0005190 0x7fdb0414d860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:56.918 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:56.909+0000 7fdb08d96640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdb040a5dd0 0x7fdb041ea270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:56.918 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:56.909+0000 7fdb08d96640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdb041daa30 0x7fdb041ea7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:56.918 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:56.909+0000 7fdb08d96640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb04154ec0 con 0x7fdb041daa30 2023-11-28T20:00:56.918 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:56.909+0000 7fdb08d96640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb04155310 con 0x7fdb040a5dd0 2023-11-28T20:00:56.918 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:56.909+0000 7fdb08d96640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdb0414e200 con 0x7fdaf0005190 2023-11-28T20:00:56.918 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:56.909+0000 7fdb02d9d640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdb041daa30 0x7fdb041ea7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:56.918 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:56.909+0000 7fdb02d9d640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdb041daa30 0x7fdb041ea7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:40594/0 (socket says 172.21.15.78:40594) 2023-11-28T20:00:56.918 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:56.909+0000 7fdb02d9d640 1 -- 172.21.15.78:0/894196974 learned_addr learned my addr 172.21.15.78:0/894196974 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T20:00:56.919 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:56.909+0000 7fdb0259c640 1 --2- 172.21.15.78:0/894196974 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdaf0005190 0x7fdb0414d860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:56.919 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:56.909+0000 7fdafbfff640 1 --2- 172.21.15.78:0/894196974 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdb040a5dd0 0x7fdb041ea270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:56.919 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:56.909+0000 7fdb02d9d640 1 -- 172.21.15.78:0/894196974 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdaf0005190 msgr2=0x7fdb0414d860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:00:56.919 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:56.909+0000 7fdb02d9d640 1 --2- 172.21.15.78:0/894196974 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdaf0005190 0x7fdb0414d860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:56.919 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:56.909+0000 7fdb02d9d640 1 -- 172.21.15.78:0/894196974 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdb040a5dd0 msgr2=0x7fdb041ea270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:00:56.919 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:56.909+0000 7fdb02d9d640 1 --2- 172.21.15.78:0/894196974 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdb040a5dd0 0x7fdb041ea270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:56.919 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:56.909+0000 7fdb02d9d640 1 -- 172.21.15.78:0/894196974 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb041eae90 con 0x7fdb041daa30 2023-11-28T20:00:56.919 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:56.909+0000 7fdb0259c640 1 --2- 172.21.15.78:0/894196974 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdaf0005190 0x7fdb0414d860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T20:00:56.919 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:56.909+0000 7fdb02d9d640 1 --2- 172.21.15.78:0/894196974 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdb041daa30 0x7fdb041ea7b0 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7fdafc007040 tx=0x7fdaf0005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:00:56.919 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:56.909+0000 7fdafaffd640 1 -- 172.21.15.78:0/894196974 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdafc0019c0 con 0x7fdb041daa30 2023-11-28T20:00:56.920 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:56.909+0000 7fdafaffd640 1 -- 172.21.15.78:0/894196974 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdafc007450 con 0x7fdb041daa30 2023-11-28T20:00:56.920 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:56.909+0000 7fdb08d96640 1 -- 172.21.15.78:0/894196974 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdb041eb170 con 0x7fdb041daa30 2023-11-28T20:00:56.920 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:56.909+0000 7fdafaffd640 1 -- 172.21.15.78:0/894196974 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdafc007800 con 0x7fdb041daa30 2023-11-28T20:00:56.920 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:56.909+0000 7fdb08d96640 1 -- 172.21.15.78:0/894196974 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdb0414dda0 con 0x7fdb041daa30 2023-11-28T20:00:56.921 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:56.909+0000 7fdb08d96640 1 -- 172.21.15.78:0/894196974 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdb041eacf0 con 0x7fdb041daa30 2023-11-28T20:00:56.921 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:56.909+0000 7fdafaffd640 1 -- 172.21.15.78:0/894196974 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fdafc0aa070 con 0x7fdb041daa30 2023-11-28T20:00:56.921 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:56.913+0000 7fdafaffd640 1 --2- 172.21.15.78:0/894196974 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fdae4066470 0x7fdae4068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:56.921 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:56.913+0000 7fdafaffd640 1 -- 172.21.15.78:0/894196974 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6177+0+0 (secure 0 0 0) 0x7fdafc11d860 con 0x7fdb041daa30 2023-11-28T20:00:56.921 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:56.913+0000 7fdb0259c640 1 --2- 172.21.15.78:0/894196974 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fdae4066470 0x7fdae4068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:56.921 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:56.913+0000 7fdb0259c640 1 --2- 172.21.15.78:0/894196974 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fdae4066470 0x7fdae4068930 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fdb040ab210 tx=0x7fdaf4008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:00:56.922 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:56.917+0000 7fdafaffd640 1 -- 172.21.15.78:0/894196974 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fdb041eacf0 con 0x7fdb041daa30 2023-11-28T20:00:57.071 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:57.065+0000 7fdb08d96640 1 -- 172.21.15.78:0/894196974 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fdb041eacf0 con 0x7fdb041daa30 2023-11-28T20:00:57.072 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:57.069+0000 7fdafaffd640 1 -- 172.21.15.78:0/894196974 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v49) v1 ==== 74+0+16923 (secure 0 0 0) 0x7fdb041eacf0 con 0x7fdb041daa30 2023-11-28T20:00:57.073 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-11-28T20:00:57.073 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":49,"fsid":"dd9780e8-3bda-44fa-a9f0-fa07d19d901d","created":"2023-11-28T19:58:40.969556+0000","modified":"2023-11-28T20:00:53.984726+0000","last_up_change":"2023-11-28T19:58:52.596716+0000","last_in_change":"2023-11-28T19:58:43.609275+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-28T19:58:54.011229+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs2_metadata","create_time":"2023-11-28T20:00:28.571896+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"43","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs2_data","create_time":"2023-11-28T20:00:29.436453+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"44","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs2"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e84245ac-b5da-429e-af18-39acaa2b33e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6800","nonce":3358701235},{"type":"v1","addr":"172.21.15.78:6801","nonce":3358701235}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6802","nonce":3358701235},{"type":"v1","addr":"172.21.15.78:6803","nonce":3358701235}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6806","nonce":3358701235},{"type":"v1","addr":"172.21.15.78:6807","nonce":3358701235}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6804","nonce":3358701235},{"type":"v1","addr":"172.21.15.78:6805","nonce":3358701235}]},"public_addr":"172.21.15.78:6801/3358701235","cluster_addr":"172.21.15.78:6803/3358701235","heartbeat_back_addr":"172.21.15.78:6807/3358701235","heartbeat_front_addr":"172.21.15.78:6805/3358701235","state":["exists","up"]},{"osd":1,"uuid":"e634831d-c4e2-48d9-870c-9556ae162981","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6808","nonce":3211476654},{"type":"v1","addr":"172.21.15.78:6809","nonce":3211476654}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6810","nonce":3211476654},{"type":"v1","addr":"172.21.15.78:6811","nonce":3211476654}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6814","nonce":3211476654},{"type":"v1","addr":"172.21.15.78:6815","nonce":3211476654}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6812","nonce":3211476654},{"type":"v1","addr":"172.21.15.78:6813","nonce":3211476654}]},"public_addr":"172.21.15.78:6809/3211476654","cluster_addr":"172.21.15.78:6811/3211476654","heartbeat_back_addr":"172.21.15.78:6815/3211476654","heartbeat_front_addr":"172.21.15.78:6813/3211476654","state":["exists","up"]},{"osd":2,"uuid":"274c8395-6534-41f0-b8fb-a00af8985aa8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6816","nonce":2532904479},{"type":"v1","addr":"172.21.15.78:6817","nonce":2532904479}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6818","nonce":2532904479},{"type":"v1","addr":"172.21.15.78:6819","nonce":2532904479}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6822","nonce":2532904479},{"type":"v1","addr":"172.21.15.78:6823","nonce":2532904479}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6820","nonce":2532904479},{"type":"v1","addr":"172.21.15.78:6821","nonce":2532904479}]},"public_addr":"172.21.15.78:6817/2532904479","cluster_addr":"172.21.15.78:6819/2532904479","heartbeat_back_addr":"172.21.15.78:6823/2532904479","heartbeat_front_addr":"172.21.15.78:6821/2532904479","state":["exists","up"]},{"osd":3,"uuid":"77acc9af-7d4d-4b18-8cf5-d62f5971b7c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6824","nonce":3442991267},{"type":"v1","addr":"172.21.15.78:6825","nonce":3442991267}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6826","nonce":3442991267},{"type":"v1","addr":"172.21.15.78:6827","nonce":3442991267}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6830","nonce":3442991267},{"type":"v1","addr":"172.21.15.78:6831","nonce":3442991267}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6828","nonce":3442991267},{"type":"v1","addr":"172.21.15.78:6829","nonce":3442991267}]},"public_addr":"172.21.15.78:6825/3442991267","cluster_addr":"172.21.15.78:6827/3442991267","heartbeat_back_addr":"172.21.15.78:6831/3442991267","heartbeat_front_addr":"172.21.15.78:6829/3442991267","state":["exists","up"]},{"osd":4,"uuid":"5c62bc66-6b34-4b7f-a66b-9a743969138c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":802983577},{"type":"v1","addr":"172.21.15.179:6809","nonce":802983577}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":802983577},{"type":"v1","addr":"172.21.15.179:6811","nonce":802983577}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":802983577},{"type":"v1","addr":"172.21.15.179:6815","nonce":802983577}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":802983577},{"type":"v1","addr":"172.21.15.179:6813","nonce":802983577}]},"public_addr":"172.21.15.179:6809/802983577","cluster_addr":"172.21.15.179:6811/802983577","heartbeat_back_addr":"172.21.15.179:6815/802983577","heartbeat_front_addr":"172.21.15.179:6813/802983577","state":["exists","up"]},{"osd":5,"uuid":"67db6d36-f684-4079-b0cd-82b4dd61461f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":518192887},{"type":"v1","addr":"172.21.15.179:6818","nonce":518192887}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":518192887},{"type":"v1","addr":"172.21.15.179:6822","nonce":518192887}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":518192887},{"type":"v1","addr":"172.21.15.179:6829","nonce":518192887}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6824","nonce":518192887},{"type":"v1","addr":"172.21.15.179:6826","nonce":518192887}]},"public_addr":"172.21.15.179:6818/518192887","cluster_addr":"172.21.15.179:6822/518192887","heartbeat_back_addr":"172.21.15.179:6829/518192887","heartbeat_front_addr":"172.21.15.179:6826/518192887","state":["exists","up"]},{"osd":6,"uuid":"12e670af-5a16-4c81-9f97-defa66cab967","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":815435378},{"type":"v1","addr":"172.21.15.179:6801","nonce":815435378}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":815435378},{"type":"v1","addr":"172.21.15.179:6803","nonce":815435378}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":815435378},{"type":"v1","addr":"172.21.15.179:6807","nonce":815435378}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":815435378},{"type":"v1","addr":"172.21.15.179:6805","nonce":815435378}]},"public_addr":"172.21.15.179:6801/815435378","cluster_addr":"172.21.15.179:6803/815435378","heartbeat_back_addr":"172.21.15.179:6807/815435378","heartbeat_front_addr":"172.21.15.179:6805/815435378","state":["exists","up"]},{"osd":7,"uuid":"fe630650-2eb3-49ad-8676-c341e6332eb1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6817","nonce":2848432339},{"type":"v1","addr":"172.21.15.179:6819","nonce":2848432339}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6821","nonce":2848432339},{"type":"v1","addr":"172.21.15.179:6823","nonce":2848432339}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":2848432339},{"type":"v1","addr":"172.21.15.179:6831","nonce":2848432339}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6825","nonce":2848432339},{"type":"v1","addr":"172.21.15.179:6827","nonce":2848432339}]},"public_addr":"172.21.15.179:6819/2848432339","cluster_addr":"172.21.15.179:6823/2848432339","heartbeat_back_addr":"172.21.15.179:6831/2848432339","heartbeat_front_addr":"172.21.15.179:6827/2848432339","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:58:49.255433+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:58:49.412880+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:58:49.559295+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:58:49.245237+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:58:49.184557+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:58:49.329851+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:58:49.366012+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:58:49.349604+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"8.28","mappings":[{"from":0,"to":6}]},{"pgid":"8.38","mappings":[{"from":0,"to":6}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.78:6836/3508383403":"2023-11-29T20:00:50.972350+0000","172.21.15.78:6834/3508383403":"2023-11-29T20:00:50.972350+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-28T20:00:57.075 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:57.069+0000 7fdb08d96640 1 -- 172.21.15.78:0/894196974 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fdae4066470 msgr2=0x7fdae4068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:00:57.075 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:57.069+0000 7fdb08d96640 1 --2- 172.21.15.78:0/894196974 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fdae4066470 0x7fdae4068930 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fdb040ab210 tx=0x7fdaf4008040 comp rx=0 tx=0).stop 2023-11-28T20:00:57.075 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:57.069+0000 7fdb08d96640 1 -- 172.21.15.78:0/894196974 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdb041daa30 msgr2=0x7fdb041ea7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:00:57.075 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:57.069+0000 7fdb08d96640 1 --2- 172.21.15.78:0/894196974 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdb041daa30 0x7fdb041ea7b0 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7fdafc007040 tx=0x7fdaf0005800 comp rx=0 tx=0).stop 2023-11-28T20:00:57.075 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:57.069+0000 7fdb08d96640 1 -- 172.21.15.78:0/894196974 shutdown_connections 2023-11-28T20:00:57.075 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:57.069+0000 7fdb08d96640 1 --2- 172.21.15.78:0/894196974 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fdae4066470 0x7fdae4068930 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:57.075 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:57.069+0000 7fdb08d96640 1 --2- 172.21.15.78:0/894196974 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdb041daa30 0x7fdb041ea7b0 unknown :-1 s=CLOSED pgs=561 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:57.075 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:57.069+0000 7fdb08d96640 1 --2- 172.21.15.78:0/894196974 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdb040a5dd0 0x7fdb041ea270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:57.075 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:57.069+0000 7fdb08d96640 1 --2- 172.21.15.78:0/894196974 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdaf0005190 0x7fdb0414d860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:57.075 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:57.069+0000 7fdb08d96640 1 -- 172.21.15.78:0/894196974 >> 172.21.15.78:0/894196974 conn(0x7fdb040a7810 msgr2=0x7fdb040c2cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:00:57.075 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:57.069+0000 7fdb08d96640 1 -- 172.21.15.78:0/894196974 shutdown_connections 2023-11-28T20:00:57.075 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:57.069+0000 7fdb08d96640 1 -- 172.21.15.78:0/894196974 wait complete. 2023-11-28T20:00:57.094 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs2 2023-11-28T20:00:57.232 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:57.229+0000 7f4cfb380640 1 Processor -- start 2023-11-28T20:00:57.233 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:57.229+0000 7f4cfb380640 1 -- start start 2023-11-28T20:00:57.234 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:57.229+0000 7f4cfb380640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f4cf4151a20 0x7f4cf406df60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:57.234 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:57.229+0000 7f4cfb380640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4cf41580c0 0x7f4cf4158550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:57.235 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:57.229+0000 7f4cfb380640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4cf40c1980 con 0x7f4cf4154410 2023-11-28T20:00:57.235 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:57.229+0000 7f4cfb380640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4cf40c2640 con 0x7f4cf4151a20 2023-11-28T20:00:57.235 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:57.229+0000 7f4cfb380640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4cf40c2220 con 0x7f4cf41580c0 2023-11-28T20:00:57.235 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:57.229+0000 7f4cf911c640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f4cf4151a20 0x7f4cf406df60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:57.235 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:57.229+0000 7f4cf911c640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f4cf4151a20 0x7f4cf406df60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:40600/0 (socket says 172.21.15.78:40600) 2023-11-28T20:00:57.235 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:57.229+0000 7f4cf911c640 1 -- 172.21.15.78:0/3435997895 learned_addr learned my addr 172.21.15.78:0/3435997895 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T20:00:57.235 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:57.229+0000 7f4cf991d640 1 --2- 172.21.15.78:0/3435997895 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4cf41580c0 0x7f4cf4158550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:57.235 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:57.229+0000 7f4cf911c640 1 -- 172.21.15.78:0/3435997895 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4cf41580c0 msgr2=0x7f4cf4158550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:00:57.235 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:57.229+0000 7f4cf911c640 1 --2- 172.21.15.78:0/3435997895 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4cf41580c0 0x7f4cf4158550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:57.235 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:57.229+0000 7f4cf911c640 1 -- 172.21.15.78:0/3435997895 >> v1:172.21.15.179:6789/0 conn(0x7f4cf4154410 legacy=0x7f4cf406b5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:00:57.235 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:57.229+0000 7f4cf911c640 1 -- 172.21.15.78:0/3435997895 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4cf40c1c60 con 0x7f4cf4151a20 2023-11-28T20:00:57.236 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:57.229+0000 7f4cf991d640 1 --2- 172.21.15.78:0/3435997895 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4cf41580c0 0x7f4cf4158550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T20:00:57.237 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:57.233+0000 7f4cf911c640 1 --2- 172.21.15.78:0/3435997895 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4cf4151a20 0x7f4cf406df60 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7f4cf0009870 tx=0x7f4cf001c420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cf30b13f4eca1fdf server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:00:57.238 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:57.233+0000 7f4cebfff640 1 -- 172.21.15.78:0/3435997895 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4cf00ac640 con 0x7f4cf4151a20 2023-11-28T20:00:57.238 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:57.233+0000 7f4cebfff640 1 -- 172.21.15.78:0/3435997895 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4cf00ac7a0 con 0x7f4cf4151a20 2023-11-28T20:00:57.238 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:57.233+0000 7f4cebfff640 1 -- 172.21.15.78:0/3435997895 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4cf00acb30 con 0x7f4cf4151a20 2023-11-28T20:00:57.238 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:57.233+0000 7f4cfb380640 1 -- 172.21.15.78:0/3435997895 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4cf4151a20 msgr2=0x7f4cf406df60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:00:57.239 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:57.233+0000 7f4cfb380640 1 --2- 172.21.15.78:0/3435997895 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4cf4151a20 0x7f4cf406df60 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7f4cf0009870 tx=0x7f4cf001c420 comp rx=0 tx=0).stop 2023-11-28T20:00:57.239 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:57.233+0000 7f4cfb380640 1 -- 172.21.15.78:0/3435997895 shutdown_connections 2023-11-28T20:00:57.239 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:57.233+0000 7f4cfb380640 1 --2- 172.21.15.78:0/3435997895 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4cf41580c0 0x7f4cf4158550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:57.239 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:57.233+0000 7f4cfb380640 1 --2- 172.21.15.78:0/3435997895 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4cf4151a20 0x7f4cf406df60 unknown :-1 s=CLOSED pgs=562 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:57.239 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:57.233+0000 7f4cfb380640 1 -- 172.21.15.78:0/3435997895 >> 172.21.15.78:0/3435997895 conn(0x7f4cf40c2e20 msgr2=0x7f4cf40c3230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:00:57.239 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:57.233+0000 7f4cfb380640 1 -- 172.21.15.78:0/3435997895 shutdown_connections 2023-11-28T20:00:57.239 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:57.233+0000 7f4cfb380640 1 -- 172.21.15.78:0/3435997895 wait complete. 2023-11-28T20:00:57.240 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:57.237+0000 7f4cfb380640 1 Processor -- start 2023-11-28T20:00:57.240 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:57.237+0000 7f4cfb380640 1 -- start start 2023-11-28T20:00:57.241 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:57.237+0000 7f4cfb380640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4cf4151a20 0x7f4cf414fa20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:57.242 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:57.237+0000 7f4cfb380640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4cf4154410 0x7f4cf41efdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:57.242 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:57.237+0000 7f4cfb380640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4cf41580c0 0x7f4cf41f0310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:57.242 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:57.237+0000 7f4cfb380640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4cf40c4aa0 con 0x7f4cf4154410 2023-11-28T20:00:57.242 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:57.237+0000 7f4cfb380640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4cf41f0850 con 0x7f4cf4151a20 2023-11-28T20:00:57.242 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:57.237+0000 7f4cfb380640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4cf414f590 con 0x7f4cf41580c0 2023-11-28T20:00:57.242 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:57.237+0000 7f4cf891b640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4cf4154410 0x7f4cf41efdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:57.242 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:57.237+0000 7f4cf911c640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4cf4151a20 0x7f4cf414fa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:57.242 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:57.237+0000 7f4cf891b640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4cf4154410 0x7f4cf41efdd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:40610/0 (socket says 172.21.15.78:40610) 2023-11-28T20:00:57.242 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:57.237+0000 7f4cf891b640 1 -- 172.21.15.78:0/528527899 learned_addr learned my addr 172.21.15.78:0/528527899 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T20:00:57.242 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:57.237+0000 7f4cf991d640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4cf41580c0 0x7f4cf41f0310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:57.242 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:57.237+0000 7f4cf891b640 1 -- 172.21.15.78:0/528527899 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4cf41580c0 msgr2=0x7f4cf41f0310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:00:57.243 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:57.237+0000 7f4cf891b640 1 --2- 172.21.15.78:0/528527899 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4cf41580c0 0x7f4cf41f0310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:57.243 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:57.237+0000 7f4cf891b640 1 -- 172.21.15.78:0/528527899 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4cf4151a20 msgr2=0x7f4cf414fa20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:00:57.243 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:57.237+0000 7f4cf891b640 1 --2- 172.21.15.78:0/528527899 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4cf4151a20 0x7f4cf414fa20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:57.243 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:57.237+0000 7f4cf891b640 1 -- 172.21.15.78:0/528527899 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4cf00094d0 con 0x7f4cf4154410 2023-11-28T20:00:57.244 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:57.237+0000 7f4cf891b640 1 --2- 172.21.15.78:0/528527899 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4cf4154410 0x7f4cf41efdd0 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7f4ce400c430 tx=0x7f4ce400c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:00:57.244 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:57.237+0000 7f4ce9ffb640 1 -- 172.21.15.78:0/528527899 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ce40052d0 con 0x7f4cf4154410 2023-11-28T20:00:57.244 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:57.237+0000 7f4ce9ffb640 1 -- 172.21.15.78:0/528527899 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ce4005430 con 0x7f4cf4154410 2023-11-28T20:00:57.244 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:57.237+0000 7f4cfb380640 1 -- 172.21.15.78:0/528527899 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4cf40c4cf0 con 0x7f4cf4154410 2023-11-28T20:00:57.244 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:57.237+0000 7f4ce9ffb640 1 -- 172.21.15.78:0/528527899 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ce4003890 con 0x7f4cf4154410 2023-11-28T20:00:57.244 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:57.237+0000 7f4cfb380640 1 -- 172.21.15.78:0/528527899 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4cf414ed90 con 0x7f4cf4154410 2023-11-28T20:00:57.244 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:57.237+0000 7f4cfb380640 1 -- 172.21.15.78:0/528527899 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4cf40724b0 con 0x7f4cf4154410 2023-11-28T20:00:57.244 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:57.241+0000 7f4ce9ffb640 1 -- 172.21.15.78:0/528527899 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f4ce40039f0 con 0x7f4cf4154410 2023-11-28T20:00:57.245 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:57.241+0000 7f4ce9ffb640 1 --2- 172.21.15.78:0/528527899 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f4cd8066470 0x7f4cd8068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:57.245 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:57.241+0000 7f4ce9ffb640 1 -- 172.21.15.78:0/528527899 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6177+0+0 (secure 0 0 0) 0x7f4ce4083500 con 0x7f4cf4154410 2023-11-28T20:00:57.245 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:57.241+0000 7f4cf911c640 1 --2- 172.21.15.78:0/528527899 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f4cd8066470 0x7f4cd8068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:57.246 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:57.241+0000 7f4cf911c640 1 --2- 172.21.15.78:0/528527899 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f4cd8066470 0x7f4cd8068930 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f4cf00ae000 tx=0x7f4cf0008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:00:57.249 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:57.245+0000 7f4ce9ffb640 1 -- 172.21.15.78:0/528527899 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f4ce40508c0 con 0x7f4cf4154410 2023-11-28T20:00:57.431 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:57.425+0000 7f4cfb380640 1 -- 172.21.15.78:0/528527899 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs2"} v 0) v1 -- 0x7f4cf4067630 con 0x7f4cf4154410 2023-11-28T20:00:57.431 INFO:tasks.ceph.mon.a.smithi078.stderr:2023-11-28T20:00:57.425+0000 7f3f494a3640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-11-28T20:00:57.434 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:57.429+0000 7f4ce9ffb640 1 -- 172.21.15.78:0/528527899 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs2"}]=0 cephfs2 marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v25) v1 ==== 163+0+0 (secure 0 0 0) 0x7f4ce4053ee0 con 0x7f4cf4154410 2023-11-28T20:00:57.434 INFO:teuthology.orchestra.run.smithi078.stderr:cephfs2 marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-11-28T20:00:57.436 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:57.433+0000 7f4cfb380640 1 -- 172.21.15.78:0/528527899 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f4cd8066470 msgr2=0x7f4cd8068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:00:57.436 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:57.433+0000 7f4cfb380640 1 --2- 172.21.15.78:0/528527899 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f4cd8066470 0x7f4cd8068930 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f4cf00ae000 tx=0x7f4cf0008040 comp rx=0 tx=0).stop 2023-11-28T20:00:57.436 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:57.433+0000 7f4cfb380640 1 -- 172.21.15.78:0/528527899 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4cf4154410 msgr2=0x7f4cf41efdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:00:57.437 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:57.433+0000 7f4cfb380640 1 --2- 172.21.15.78:0/528527899 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4cf4154410 0x7f4cf41efdd0 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7f4ce400c430 tx=0x7f4ce400c8f0 comp rx=0 tx=0).stop 2023-11-28T20:00:57.437 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:57.433+0000 7f4cfb380640 1 -- 172.21.15.78:0/528527899 shutdown_connections 2023-11-28T20:00:57.437 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:57.433+0000 7f4cfb380640 1 --2- 172.21.15.78:0/528527899 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f4cd8066470 0x7f4cd8068930 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:57.437 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:57.433+0000 7f4cfb380640 1 --2- 172.21.15.78:0/528527899 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4cf41580c0 0x7f4cf41f0310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:57.438 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:57.433+0000 7f4cfb380640 1 --2- 172.21.15.78:0/528527899 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4cf4154410 0x7f4cf41efdd0 unknown :-1 s=CLOSED pgs=563 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:57.438 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:57.433+0000 7f4cfb380640 1 --2- 172.21.15.78:0/528527899 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4cf4151a20 0x7f4cf414fa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:57.438 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:57.433+0000 7f4cfb380640 1 -- 172.21.15.78:0/528527899 >> 172.21.15.78:0/528527899 conn(0x7f4cf40c2e20 msgr2=0x7f4cf406ab00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:00:57.438 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:57.433+0000 7f4cfb380640 1 -- 172.21.15.78:0/528527899 shutdown_connections 2023-11-28T20:00:57.438 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:57.433+0000 7f4cfb380640 1 -- 172.21.15.78:0/528527899 wait complete. 2023-11-28T20:00:57.445 INFO:tasks.ceph.mds.b.smithi179.stderr: -1937> 2023-11-28T20:00:36.084+0000 7f023f456640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-11-28T20:00:57.456 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs2 --yes-i-really-mean-it 2023-11-28T20:00:57.490 INFO:tasks.ceph.mds.b.smithi179.stdout:starting mds.b at 2023-11-28T20:00:57.599 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:57.593+0000 7fc0f4a54640 1 Processor -- start 2023-11-28T20:00:57.599 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:57.593+0000 7fc0f4a54640 1 -- start start 2023-11-28T20:00:57.602 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:57.597+0000 7fc0f4a54640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc0f014f850 0x7fc0f00aacf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:57.602 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:57.597+0000 7fc0f4a54640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc0f0152910 con 0x7fc0f014fc30 2023-11-28T20:00:57.603 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:57.597+0000 7fc0f4a54640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc0f0152bf0 con 0x7fc0f006d840 2023-11-28T20:00:57.603 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:57.597+0000 7fc0f4a54640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc0f00c2240 con 0x7fc0f014f850 2023-11-28T20:00:57.603 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:57.597+0000 7fc0e5d9b640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7fc0f014fc30 0x7fc0f00c3cd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:59260/0 (socket says 172.21.15.78:59260) 2023-11-28T20:00:57.603 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:57.597+0000 7fc0e5d9b640 1 -- 172.21.15.78:0/1921635302 learned_addr learned my addr 172.21.15.78:0/1921635302 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-11-28T20:00:57.604 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:57.597+0000 7fc0ee59c640 1 --2- 172.21.15.78:0/1921635302 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc0f014f850 0x7fc0f00aacf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:57.604 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:57.597+0000 7fc0edd9b640 1 -- 172.21.15.78:0/1921635302 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2477700813 0 0) 0x7fc0f0152910 con 0x7fc0f014fc30 2023-11-28T20:00:57.604 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:57.597+0000 7fc0edd9b640 1 -- 172.21.15.78:0/1921635302 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc0dc003530 con 0x7fc0f014fc30 2023-11-28T20:00:57.604 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:57.597+0000 7fc0ee59c640 1 -- 172.21.15.78:0/1921635302 >> v1:172.21.15.179:6789/0 conn(0x7fc0f006d840 legacy=0x7fc0f00c43e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:00:57.604 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:57.597+0000 7fc0edd9b640 1 -- 172.21.15.78:0/1921635302 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3974729837 0 0) 0x7fc0f0152bf0 con 0x7fc0f006d840 2023-11-28T20:00:57.604 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:57.597+0000 7fc0ee59c640 1 -- 172.21.15.78:0/1921635302 >> v1:172.21.15.78:6789/0 conn(0x7fc0f014fc30 legacy=0x7fc0f00c3cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:00:57.605 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:57.597+0000 7fc0ee59c640 1 -- 172.21.15.78:0/1921635302 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0f0152ed0 con 0x7fc0f014f850 2023-11-28T20:00:57.607 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:57.601+0000 7fc0ee59c640 1 --2- 172.21.15.78:0/1921635302 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc0f014f850 0x7fc0f00aacf0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fc0e0009dc0 tx=0x7fc0e001c8e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=dcfced47ce8be1fb server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:00:57.607 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:57.601+0000 7fc0edd9b640 1 -- 172.21.15.78:0/1921635302 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0e00a59c0 con 0x7fc0f014f850 2023-11-28T20:00:57.607 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:57.601+0000 7fc0edd9b640 1 -- 172.21.15.78:0/1921635302 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc0e00a5b20 con 0x7fc0f014f850 2023-11-28T20:00:57.608 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:57.601+0000 7fc0edd9b640 1 -- 172.21.15.78:0/1921635302 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0e00a5e90 con 0x7fc0f014f850 2023-11-28T20:00:57.608 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:57.601+0000 7fc0f4a54640 1 -- 172.21.15.78:0/1921635302 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc0f014f850 msgr2=0x7fc0f00aacf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:00:57.608 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:57.601+0000 7fc0f4a54640 1 --2- 172.21.15.78:0/1921635302 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc0f014f850 0x7fc0f00aacf0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fc0e0009dc0 tx=0x7fc0e001c8e0 comp rx=0 tx=0).stop 2023-11-28T20:00:57.608 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:57.601+0000 7fc0f4a54640 1 -- 172.21.15.78:0/1921635302 shutdown_connections 2023-11-28T20:00:57.608 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:57.601+0000 7fc0f4a54640 1 --2- 172.21.15.78:0/1921635302 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc0f014f850 0x7fc0f00aacf0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:57.609 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:57.601+0000 7fc0f4a54640 1 -- 172.21.15.78:0/1921635302 >> 172.21.15.78:0/1921635302 conn(0x7fc0f00c59f0 msgr2=0x7fc0f00c5e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:00:57.609 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:57.601+0000 7fc0f4a54640 1 -- 172.21.15.78:0/1921635302 shutdown_connections 2023-11-28T20:00:57.609 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:57.601+0000 7fc0f4a54640 1 -- 172.21.15.78:0/1921635302 wait complete. 2023-11-28T20:00:57.609 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:57.601+0000 7fc0f4a54640 1 Processor -- start 2023-11-28T20:00:57.609 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:57.601+0000 7fc0f4a54640 1 -- start start 2023-11-28T20:00:57.611 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:57.605+0000 7fc0f4a54640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc0f006d840 0x7fc0f01495e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:57.611 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:57.605+0000 7fc0f4a54640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc0f014f850 0x7fc0f01edbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:57.611 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:57.605+0000 7fc0f4a54640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc0f014fc30 0x7fc0f00befc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:57.612 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:57.605+0000 7fc0f4a54640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0f01ee120 con 0x7fc0f014f850 2023-11-28T20:00:57.612 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:57.605+0000 7fc0f4a54640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0f00a9ec0 con 0x7fc0f006d840 2023-11-28T20:00:57.612 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:57.605+0000 7fc0f4a54640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc0f00a8f80 con 0x7fc0f014fc30 2023-11-28T20:00:57.612 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:57.605+0000 7fc0e5d9b640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc0f014f850 0x7fc0f01edbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:57.612 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:57.605+0000 7fc0e5d9b640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc0f014f850 0x7fc0f01edbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:40612/0 (socket says 172.21.15.78:40612) 2023-11-28T20:00:57.612 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:57.605+0000 7fc0e5d9b640 1 -- 172.21.15.78:0/2667698713 learned_addr learned my addr 172.21.15.78:0/2667698713 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T20:00:57.612 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:57.605+0000 7fc0eed9d640 1 --2- 172.21.15.78:0/2667698713 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc0f014fc30 0x7fc0f00befc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:57.612 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:57.605+0000 7fc0ee59c640 1 --2- 172.21.15.78:0/2667698713 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc0f006d840 0x7fc0f01495e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:57.612 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:57.605+0000 7fc0e5d9b640 1 -- 172.21.15.78:0/2667698713 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc0f014fc30 msgr2=0x7fc0f00befc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:00:57.612 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:57.605+0000 7fc0e5d9b640 1 --2- 172.21.15.78:0/2667698713 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc0f014fc30 0x7fc0f00befc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:57.613 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:57.605+0000 7fc0e5d9b640 1 -- 172.21.15.78:0/2667698713 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc0f006d840 msgr2=0x7fc0f01495e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:00:57.613 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:57.605+0000 7fc0e5d9b640 1 --2- 172.21.15.78:0/2667698713 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc0f006d840 0x7fc0f01495e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:57.613 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:57.605+0000 7fc0e5d9b640 1 -- 172.21.15.78:0/2667698713 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0e0009a70 con 0x7fc0f014f850 2023-11-28T20:00:57.613 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:57.605+0000 7fc0ee59c640 1 --2- 172.21.15.78:0/2667698713 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc0f006d840 0x7fc0f01495e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T20:00:57.613 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:57.605+0000 7fc0e5d9b640 1 --2- 172.21.15.78:0/2667698713 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc0f014f850 0x7fc0f01edbe0 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7fc0d800c3c0 tx=0x7fc0d800c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:00:57.613 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:57.605+0000 7fc0e77fe640 1 -- 172.21.15.78:0/2667698713 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0d8005cf0 con 0x7fc0f014f850 2023-11-28T20:00:57.613 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:57.605+0000 7fc0e77fe640 1 -- 172.21.15.78:0/2667698713 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc0d8005e50 con 0x7fc0f014f850 2023-11-28T20:00:57.613 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:57.605+0000 7fc0f4a54640 1 -- 172.21.15.78:0/2667698713 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc0f00aa6d0 con 0x7fc0f014f850 2023-11-28T20:00:57.613 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:57.605+0000 7fc0e77fe640 1 -- 172.21.15.78:0/2667698713 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0d80072f0 con 0x7fc0f014f850 2023-11-28T20:00:57.614 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:57.605+0000 7fc0f4a54640 1 -- 172.21.15.78:0/2667698713 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc0f00aa3f0 con 0x7fc0f014f850 2023-11-28T20:00:57.614 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:57.605+0000 7fc0f4a54640 1 -- 172.21.15.78:0/2667698713 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc0f0067630 con 0x7fc0f014f850 2023-11-28T20:00:57.614 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:57.605+0000 7fc0e77fe640 1 -- 172.21.15.78:0/2667698713 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fc0d8007450 con 0x7fc0f014f850 2023-11-28T20:00:57.614 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:57.609+0000 7fc0e77fe640 1 --2- 172.21.15.78:0/2667698713 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fc0d0066470 0x7fc0d0068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:57.615 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:57.609+0000 7fc0e77fe640 1 -- 172.21.15.78:0/2667698713 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6263+0+0 (secure 0 0 0) 0x7fc0d80836b0 con 0x7fc0f014f850 2023-11-28T20:00:57.615 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:57.609+0000 7fc0ee59c640 1 --2- 172.21.15.78:0/2667698713 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fc0d0066470 0x7fc0d0068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:57.615 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:57.609+0000 7fc0ee59c640 1 --2- 172.21.15.78:0/2667698713 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fc0d0066470 0x7fc0d0068930 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fc0e00af000 tx=0x7fc0e00a7070 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:00:57.616 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:57.613+0000 7fc0e77fe640 1 -- 172.21.15.78:0/2667698713 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fc0d80508f0 con 0x7fc0f014f850 2023-11-28T20:00:57.796 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:57.793+0000 7fc0f4a54640 1 -- 172.21.15.78:0/2667698713 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs2", "yes_i_really_mean_it": true} v 0) v1 -- 0x7fc0f00a4a90 con 0x7fc0f014f850 2023-11-28T20:00:58.441 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:58.437+0000 7fc0e77fe640 1 -- 172.21.15.78:0/2667698713 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs2", "yes_i_really_mean_it": true}]=0 v26) v1 ==== 105+0+0 (secure 0 0 0) 0x7fc0d80170b0 con 0x7fc0f014f850 2023-11-28T20:00:58.443 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:58.437+0000 7fc0f4a54640 1 -- 172.21.15.78:0/2667698713 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fc0d0066470 msgr2=0x7fc0d0068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:00:58.444 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:58.437+0000 7fc0f4a54640 1 --2- 172.21.15.78:0/2667698713 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fc0d0066470 0x7fc0d0068930 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fc0e00af000 tx=0x7fc0e00a7070 comp rx=0 tx=0).stop 2023-11-28T20:00:58.444 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:58.437+0000 7fc0f4a54640 1 -- 172.21.15.78:0/2667698713 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc0f014f850 msgr2=0x7fc0f01edbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:00:58.444 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:58.437+0000 7fc0f4a54640 1 --2- 172.21.15.78:0/2667698713 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc0f014f850 0x7fc0f01edbe0 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7fc0d800c3c0 tx=0x7fc0d800c880 comp rx=0 tx=0).stop 2023-11-28T20:00:58.444 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:58.437+0000 7fc0f4a54640 1 -- 172.21.15.78:0/2667698713 shutdown_connections 2023-11-28T20:00:58.444 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:58.437+0000 7fc0f4a54640 1 --2- 172.21.15.78:0/2667698713 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fc0d0066470 0x7fc0d0068930 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:58.444 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:58.437+0000 7fc0f4a54640 1 --2- 172.21.15.78:0/2667698713 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc0f014fc30 0x7fc0f00befc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:58.444 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:58.437+0000 7fc0f4a54640 1 --2- 172.21.15.78:0/2667698713 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc0f014f850 0x7fc0f01edbe0 unknown :-1 s=CLOSED pgs=568 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:58.445 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:58.437+0000 7fc0f4a54640 1 --2- 172.21.15.78:0/2667698713 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc0f006d840 0x7fc0f01495e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:58.445 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:58.437+0000 7fc0f4a54640 1 -- 172.21.15.78:0/2667698713 >> 172.21.15.78:0/2667698713 conn(0x7fc0f00c59f0 msgr2=0x7fc0f00c2470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:00:58.445 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:58.437+0000 7fc0f4a54640 1 -- 172.21.15.78:0/2667698713 shutdown_connections 2023-11-28T20:00:58.445 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:58.437+0000 7fc0f4a54640 1 -- 172.21.15.78:0/2667698713 wait complete. 2023-11-28T20:00:58.464 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs2_metadata cephfs2_metadata --yes-i-really-really-mean-it 2023-11-28T20:00:58.606 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:58.601+0000 7f83f1032640 1 Processor -- start 2023-11-28T20:00:58.606 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:58.601+0000 7f83f1032640 1 -- start start 2023-11-28T20:00:58.608 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:58.601+0000 7f83f1032640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f83ec14f850 0x7f83ec0aacf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:58.608 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:58.601+0000 7f83f1032640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f83ec06d840 0x7f83ec0c43e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:58.608 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:58.601+0000 7f83f1032640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f83ec152910 con 0x7f83ec14fc30 2023-11-28T20:00:58.608 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:58.601+0000 7f83f1032640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f83ec0c2240 con 0x7f83ec06d840 2023-11-28T20:00:58.608 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:58.601+0000 7f83f1032640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83ec152bf0 con 0x7f83ec14f850 2023-11-28T20:00:58.608 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:58.601+0000 7f83eb59e640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f83ec06d840 0x7f83ec0c43e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:58.608 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:58.601+0000 7f83ea59c640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f83ec14fc30 0x7f83ec0c3cd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:59272/0 (socket says 172.21.15.78:59272) 2023-11-28T20:00:58.608 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:58.601+0000 7f83ea59c640 1 -- 172.21.15.78:0/2260165427 learned_addr learned my addr 172.21.15.78:0/2260165427 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-11-28T20:00:58.608 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:58.605+0000 7f83ead9d640 1 --2- 172.21.15.78:0/2260165427 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f83ec14f850 0x7f83ec0aacf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:58.608 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:58.605+0000 7f83eb59e640 1 -- 172.21.15.78:0/2260165427 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f83ec14f850 msgr2=0x7f83ec0aacf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:00:58.609 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:58.605+0000 7f83eb59e640 1 --2- 172.21.15.78:0/2260165427 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f83ec14f850 0x7f83ec0aacf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:58.609 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:58.605+0000 7f83eb59e640 1 -- 172.21.15.78:0/2260165427 >> v1:172.21.15.78:6789/0 conn(0x7f83ec14fc30 legacy=0x7f83ec0c3cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:00:58.609 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:58.605+0000 7f83eb59e640 1 -- 172.21.15.78:0/2260165427 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83ec152ed0 con 0x7f83ec06d840 2023-11-28T20:00:58.609 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:58.605+0000 7f83e9d9b640 1 -- 172.21.15.78:0/2260165427 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3195990529 0 0) 0x7f83ec152910 con 0x7f83ec14fc30 2023-11-28T20:00:58.609 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:58.605+0000 7f83ead9d640 1 --2- 172.21.15.78:0/2260165427 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f83ec14f850 0x7f83ec0aacf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T20:00:58.611 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:58.605+0000 7f83eb59e640 1 --2- 172.21.15.78:0/2260165427 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f83ec06d840 0x7f83ec0c43e0 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7f83e4009d90 tx=0x7f83e401c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9cd4062354705d2c server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:00:58.611 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:58.605+0000 7f83e9d9b640 1 -- 172.21.15.78:0/2260165427 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83e40a5a30 con 0x7f83ec06d840 2023-11-28T20:00:58.611 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:58.605+0000 7f83e9d9b640 1 -- 172.21.15.78:0/2260165427 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f83e40a5b90 con 0x7f83ec06d840 2023-11-28T20:00:58.611 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:58.605+0000 7f83e9d9b640 1 -- 172.21.15.78:0/2260165427 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83e40ad440 con 0x7f83ec06d840 2023-11-28T20:00:58.612 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:58.609+0000 7f83f1032640 1 -- 172.21.15.78:0/2260165427 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f83ec06d840 msgr2=0x7f83ec0c43e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:00:58.612 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:58.609+0000 7f83f1032640 1 --2- 172.21.15.78:0/2260165427 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f83ec06d840 0x7f83ec0c43e0 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7f83e4009d90 tx=0x7f83e401c950 comp rx=0 tx=0).stop 2023-11-28T20:00:58.612 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:58.609+0000 7f83f1032640 1 -- 172.21.15.78:0/2260165427 shutdown_connections 2023-11-28T20:00:58.612 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:58.609+0000 7f83f1032640 1 --2- 172.21.15.78:0/2260165427 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f83ec06d840 0x7f83ec0c43e0 unknown :-1 s=CLOSED pgs=570 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:58.612 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:58.609+0000 7f83f1032640 1 --2- 172.21.15.78:0/2260165427 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f83ec14f850 0x7f83ec0aacf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:58.612 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:58.609+0000 7f83f1032640 1 -- 172.21.15.78:0/2260165427 >> 172.21.15.78:0/2260165427 conn(0x7f83ec0c59f0 msgr2=0x7f83ec0c5e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:00:58.612 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:58.609+0000 7f83f1032640 1 -- 172.21.15.78:0/2260165427 shutdown_connections 2023-11-28T20:00:58.613 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:58.609+0000 7f83f1032640 1 -- 172.21.15.78:0/2260165427 wait complete. 2023-11-28T20:00:58.614 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:58.609+0000 7f83f1032640 1 Processor -- start 2023-11-28T20:00:58.614 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:58.609+0000 7f83f1032640 1 -- start start 2023-11-28T20:00:58.616 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:58.609+0000 7f83f1032640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f83ec06d840 0x7f83ec0a8ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:58.616 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:58.609+0000 7f83f1032640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f83ec14f850 0x7f83ec147d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:58.616 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:58.609+0000 7f83f1032640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f83ec14fc30 0x7f83ec14da70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:58.616 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:58.609+0000 7f83f1032640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83ec14d5e0 con 0x7f83ec14fc30 2023-11-28T20:00:58.616 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:58.609+0000 7f83f1032640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83ec0a5fe0 con 0x7f83ec14f850 2023-11-28T20:00:58.616 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:58.609+0000 7f83f1032640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83ec0a62c0 con 0x7f83ec06d840 2023-11-28T20:00:58.616 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:58.609+0000 7f83eb59e640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f83ec14fc30 0x7f83ec14da70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:58.616 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:58.609+0000 7f83eb59e640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f83ec14fc30 0x7f83ec14da70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:40630/0 (socket says 172.21.15.78:40630) 2023-11-28T20:00:58.616 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:58.609+0000 7f83eb59e640 1 -- 172.21.15.78:0/271348796 learned_addr learned my addr 172.21.15.78:0/271348796 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T20:00:58.616 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:58.609+0000 7f83ead9d640 1 --2- 172.21.15.78:0/271348796 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f83ec06d840 0x7f83ec0a8ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:58.616 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:58.609+0000 7f83ea59c640 1 --2- 172.21.15.78:0/271348796 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f83ec14f850 0x7f83ec147d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:58.617 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:58.609+0000 7f83eb59e640 1 -- 172.21.15.78:0/271348796 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f83ec06d840 msgr2=0x7f83ec0a8ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:00:58.617 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:58.609+0000 7f83eb59e640 1 --2- 172.21.15.78:0/271348796 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f83ec06d840 0x7f83ec0a8ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:58.617 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:58.609+0000 7f83eb59e640 1 -- 172.21.15.78:0/271348796 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f83ec14f850 msgr2=0x7f83ec147d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:00:58.617 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:58.609+0000 7f83eb59e640 1 --2- 172.21.15.78:0/271348796 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f83ec14f850 0x7f83ec147d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:58.617 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:58.609+0000 7f83eb59e640 1 -- 172.21.15.78:0/271348796 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83e4009a70 con 0x7f83ec14fc30 2023-11-28T20:00:58.617 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:58.613+0000 7f83eb59e640 1 --2- 172.21.15.78:0/271348796 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f83ec14fc30 0x7f83ec14da70 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7f83e40b0040 tx=0x7f83e40196f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:00:58.618 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:58.613+0000 7f83d37fe640 1 -- 172.21.15.78:0/271348796 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83e40ade40 con 0x7f83ec14fc30 2023-11-28T20:00:58.618 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:58.613+0000 7f83d37fe640 1 -- 172.21.15.78:0/271348796 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f83e4009450 con 0x7f83ec14fc30 2023-11-28T20:00:58.618 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:58.613+0000 7f83d37fe640 1 -- 172.21.15.78:0/271348796 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83e40b9690 con 0x7f83ec14fc30 2023-11-28T20:00:58.618 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:58.613+0000 7f83f1032640 1 -- 172.21.15.78:0/271348796 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f83ec14d270 con 0x7f83ec14fc30 2023-11-28T20:00:58.618 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:58.613+0000 7f83f1032640 1 -- 172.21.15.78:0/271348796 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f83ec1488b0 con 0x7f83ec14fc30 2023-11-28T20:00:58.618 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:58.613+0000 7f83f1032640 1 -- 172.21.15.78:0/271348796 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f83ec06d610 con 0x7f83ec14fc30 2023-11-28T20:00:58.618 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:58.613+0000 7f83d37fe640 1 -- 172.21.15.78:0/271348796 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f83e40b97f0 con 0x7f83ec14fc30 2023-11-28T20:00:58.619 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:58.613+0000 7f83d37fe640 1 --2- 172.21.15.78:0/271348796 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f83d8066470 0x7f83d8068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:58.619 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:58.613+0000 7f83d37fe640 1 -- 172.21.15.78:0/271348796 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6263+0+0 (secure 0 0 0) 0x7f83e411f690 con 0x7f83ec14fc30 2023-11-28T20:00:58.619 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:58.613+0000 7f83ead9d640 1 --2- 172.21.15.78:0/271348796 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f83d8066470 0x7f83d8068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:58.620 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:58.617+0000 7f83ead9d640 1 --2- 172.21.15.78:0/271348796 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f83d8066470 0x7f83d8068930 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f83dc009950 tx=0x7f83dc008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:00:58.623 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:58.617+0000 7f83d37fe640 1 -- 172.21.15.78:0/271348796 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f83e40ec990 con 0x7f83ec14fc30 2023-11-28T20:00:58.776 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:58.773+0000 7f83f1032640 1 -- 172.21.15.78:0/271348796 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs2_metadata", "pool2": "cephfs2_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f83ec067630 con 0x7f83ec14fc30 2023-11-28T20:00:59.443 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:59.437+0000 7f83d37fe640 1 -- 172.21.15.78:0/271348796 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs2_metadata", "pool2": "cephfs2_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs2_metadata' removed v51) v1 ==== 184+0+0 (secure 0 0 0) 0x7f83e40effb0 con 0x7f83ec14fc30 2023-11-28T20:00:59.443 INFO:teuthology.orchestra.run.smithi078.stderr:pool 'cephfs2_metadata' removed 2023-11-28T20:00:59.446 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:59.441+0000 7f83f1032640 1 -- 172.21.15.78:0/271348796 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f83d8066470 msgr2=0x7f83d8068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:00:59.446 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:59.441+0000 7f83f1032640 1 --2- 172.21.15.78:0/271348796 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f83d8066470 0x7f83d8068930 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f83dc009950 tx=0x7f83dc008040 comp rx=0 tx=0).stop 2023-11-28T20:00:59.446 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:59.441+0000 7f83f1032640 1 -- 172.21.15.78:0/271348796 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f83ec14fc30 msgr2=0x7f83ec14da70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:00:59.446 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:59.441+0000 7f83f1032640 1 --2- 172.21.15.78:0/271348796 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f83ec14fc30 0x7f83ec14da70 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7f83e40b0040 tx=0x7f83e40196f0 comp rx=0 tx=0).stop 2023-11-28T20:00:59.447 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:59.441+0000 7f83f1032640 1 -- 172.21.15.78:0/271348796 shutdown_connections 2023-11-28T20:00:59.447 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:59.441+0000 7f83f1032640 1 --2- 172.21.15.78:0/271348796 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f83d8066470 0x7f83d8068930 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:59.447 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:59.441+0000 7f83f1032640 1 --2- 172.21.15.78:0/271348796 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f83ec14fc30 0x7f83ec14da70 unknown :-1 s=CLOSED pgs=571 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:59.447 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:59.441+0000 7f83f1032640 1 --2- 172.21.15.78:0/271348796 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f83ec14f850 0x7f83ec147d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:59.447 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:59.441+0000 7f83f1032640 1 --2- 172.21.15.78:0/271348796 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f83ec06d840 0x7f83ec0a8ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:59.447 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:59.441+0000 7f83f1032640 1 -- 172.21.15.78:0/271348796 >> 172.21.15.78:0/271348796 conn(0x7f83ec0c59f0 msgr2=0x7f83ec0bedf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:00:59.448 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:59.441+0000 7f83f1032640 1 -- 172.21.15.78:0/271348796 shutdown_connections 2023-11-28T20:00:59.448 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:59.441+0000 7f83f1032640 1 -- 172.21.15.78:0/271348796 wait complete. 2023-11-28T20:00:59.471 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs2_data cephfs2_data --yes-i-really-really-mean-it 2023-11-28T20:00:59.615 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:59.609+0000 7fb8b9c9e640 1 Processor -- start 2023-11-28T20:00:59.615 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:59.609+0000 7fb8b9c9e640 1 -- start start 2023-11-28T20:00:59.617 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:59.613+0000 7fb8b9c9e640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb8b414f850 0x7fb8b40aacf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:59.617 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:59.613+0000 7fb8b9c9e640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fb8b414fc30 0x7fb8b40c3cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:59.617 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:59.613+0000 7fb8b9c9e640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fb8b406d840 0x7fb8b40c4210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:59.617 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:59.613+0000 7fb8b9c9e640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb8b40c2240 con 0x7fb8b414fc30 2023-11-28T20:00:59.617 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:59.613+0000 7fb8b9c9e640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb8b4152910 con 0x7fb8b406d840 2023-11-28T20:00:59.617 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:59.613+0000 7fb8b9c9e640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8b4152bf0 con 0x7fb8b414f850 2023-11-28T20:00:59.618 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:59.613+0000 7fb8b2ffd640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fb8b414fc30 0x7fb8b40c3cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:59.618 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:59.613+0000 7fb8b2ffd640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fb8b414fc30 0x7fb8b40c3cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:40638/0 (socket says 172.21.15.78:40638) 2023-11-28T20:00:59.618 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:59.613+0000 7fb8b2ffd640 1 -- 172.21.15.78:0/3160911711 learned_addr learned my addr 172.21.15.78:0/3160911711 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T20:00:59.618 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:59.613+0000 7fb8b37fe640 1 --2- 172.21.15.78:0/3160911711 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb8b414f850 0x7fb8b40aacf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:59.618 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:59.613+0000 7fb8b3fff640 1 --2- 172.21.15.78:0/3160911711 >> v2:172.21.15.179:3300/0 conn(0x7fb8b406d840 0x7fb8b40c4210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:59.618 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:59.613+0000 7fb8b2ffd640 1 -- 172.21.15.78:0/3160911711 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb8b414f850 msgr2=0x7fb8b40aacf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:00:59.618 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:59.613+0000 7fb8b2ffd640 1 --2- 172.21.15.78:0/3160911711 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb8b414f850 0x7fb8b40aacf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:59.618 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:59.613+0000 7fb8b2ffd640 1 -- 172.21.15.78:0/3160911711 >> v2:172.21.15.179:3300/0 conn(0x7fb8b406d840 msgr2=0x7fb8b40c4210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:00:59.618 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:59.613+0000 7fb8b2ffd640 1 --2- 172.21.15.78:0/3160911711 >> v2:172.21.15.179:3300/0 conn(0x7fb8b406d840 0x7fb8b40c4210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:59.618 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:59.613+0000 7fb8b2ffd640 1 -- 172.21.15.78:0/3160911711 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8b4152ed0 con 0x7fb8b414fc30 2023-11-28T20:00:59.618 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:59.613+0000 7fb8b3fff640 1 --2- 172.21.15.78:0/3160911711 >> v2:172.21.15.179:3300/0 conn(0x7fb8b406d840 0x7fb8b40c4210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T20:00:59.620 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:59.617+0000 7fb8b2ffd640 1 --2- 172.21.15.78:0/3160911711 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb8b414fc30 0x7fb8b40c3cd0 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7fb8b406e1a0 tx=0x7fb8a801c500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4d8997305224dba7 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:00:59.620 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:59.617+0000 7fb8b27fc640 1 -- 172.21.15.78:0/3160911711 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8a80aa640 con 0x7fb8b414fc30 2023-11-28T20:00:59.620 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:59.617+0000 7fb8b27fc640 1 -- 172.21.15.78:0/3160911711 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb8a80aa7a0 con 0x7fb8b414fc30 2023-11-28T20:00:59.620 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:59.617+0000 7fb8b27fc640 1 -- 172.21.15.78:0/3160911711 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8a80aab30 con 0x7fb8b414fc30 2023-11-28T20:00:59.621 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:59.617+0000 7fb8b9c9e640 1 -- 172.21.15.78:0/3160911711 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb8b414fc30 msgr2=0x7fb8b40c3cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:00:59.621 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:59.617+0000 7fb8b9c9e640 1 --2- 172.21.15.78:0/3160911711 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb8b414fc30 0x7fb8b40c3cd0 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7fb8b406e1a0 tx=0x7fb8a801c500 comp rx=0 tx=0).stop 2023-11-28T20:00:59.622 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:59.617+0000 7fb8b9c9e640 1 -- 172.21.15.78:0/3160911711 shutdown_connections 2023-11-28T20:00:59.622 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:59.617+0000 7fb8b9c9e640 1 --2- 172.21.15.78:0/3160911711 >> v2:172.21.15.179:3300/0 conn(0x7fb8b406d840 0x7fb8b40c4210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:59.622 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:59.617+0000 7fb8b9c9e640 1 --2- 172.21.15.78:0/3160911711 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb8b414fc30 0x7fb8b40c3cd0 unknown :-1 s=CLOSED pgs=572 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:59.622 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:59.617+0000 7fb8b9c9e640 1 --2- 172.21.15.78:0/3160911711 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb8b414f850 0x7fb8b40aacf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:59.622 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:59.617+0000 7fb8b9c9e640 1 -- 172.21.15.78:0/3160911711 >> 172.21.15.78:0/3160911711 conn(0x7fb8b40c59f0 msgr2=0x7fb8b40c5e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:00:59.622 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:59.617+0000 7fb8b9c9e640 1 -- 172.21.15.78:0/3160911711 shutdown_connections 2023-11-28T20:00:59.622 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:59.617+0000 7fb8b9c9e640 1 -- 172.21.15.78:0/3160911711 wait complete. 2023-11-28T20:00:59.622 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:59.617+0000 7fb8b9c9e640 1 Processor -- start 2023-11-28T20:00:59.623 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:59.617+0000 7fb8b9c9e640 1 -- start start 2023-11-28T20:00:59.630 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:59.621+0000 7fb8b9c9e640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb8b406d840 0x7fb8b4072680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:59.630 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:59.621+0000 7fb8b9c9e640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb8b414f850 0x7fb8b40aa8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:59.630 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:59.621+0000 7fb8b9c9e640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb8b414fc30 0x7fb8b40a9b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:59.630 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:59.621+0000 7fb8b9c9e640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8b41ed1c0 con 0x7fb8b414f850 2023-11-28T20:00:59.630 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:59.621+0000 7fb8b9c9e640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8b4149980 con 0x7fb8b414fc30 2023-11-28T20:00:59.630 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:59.621+0000 7fb8b9c9e640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8b414c6e0 con 0x7fb8b406d840 2023-11-28T20:00:59.630 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:59.621+0000 7fb8b2ffd640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb8b414f850 0x7fb8b40aa8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:59.631 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:59.621+0000 7fb8b2ffd640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb8b414f850 0x7fb8b40aa8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:40646/0 (socket says 172.21.15.78:40646) 2023-11-28T20:00:59.631 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:59.621+0000 7fb8b2ffd640 1 -- 172.21.15.78:0/805180337 learned_addr learned my addr 172.21.15.78:0/805180337 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T20:00:59.631 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:59.621+0000 7fb8b37fe640 1 --2- 172.21.15.78:0/805180337 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb8b406d840 0x7fb8b4072680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:59.631 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:59.621+0000 7fb8b3fff640 1 --2- 172.21.15.78:0/805180337 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb8b414fc30 0x7fb8b40a9b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:59.631 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:59.621+0000 7fb8b2ffd640 1 -- 172.21.15.78:0/805180337 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb8b406d840 msgr2=0x7fb8b4072680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:00:59.631 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:59.621+0000 7fb8b2ffd640 1 --2- 172.21.15.78:0/805180337 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb8b406d840 0x7fb8b4072680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:59.631 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:59.621+0000 7fb8b2ffd640 1 -- 172.21.15.78:0/805180337 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb8b414fc30 msgr2=0x7fb8b40a9b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:00:59.631 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:59.621+0000 7fb8b2ffd640 1 --2- 172.21.15.78:0/805180337 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb8b414fc30 0x7fb8b40a9b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:00:59.631 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:59.621+0000 7fb8b2ffd640 1 -- 172.21.15.78:0/805180337 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8a80094d0 con 0x7fb8b414f850 2023-11-28T20:00:59.631 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:59.621+0000 7fb8b2ffd640 1 --2- 172.21.15.78:0/805180337 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb8b414f850 0x7fb8b40aa8b0 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7fb8a801abb0 tx=0x7fb8a801ad40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:00:59.631 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:59.621+0000 7fb89bfff640 1 -- 172.21.15.78:0/805180337 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8a80bd5f0 con 0x7fb8b414f850 2023-11-28T20:00:59.632 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:59.621+0000 7fb89bfff640 1 -- 172.21.15.78:0/805180337 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb8a80bd770 con 0x7fb8b414f850 2023-11-28T20:00:59.632 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:59.621+0000 7fb89bfff640 1 -- 172.21.15.78:0/805180337 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8a80bdb20 con 0x7fb8b414f850 2023-11-28T20:00:59.632 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:59.621+0000 7fb8b9c9e640 1 -- 172.21.15.78:0/805180337 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb8b40aadf0 con 0x7fb8b414f850 2023-11-28T20:00:59.632 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:59.621+0000 7fb8b9c9e640 1 -- 172.21.15.78:0/805180337 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb8b41556d0 con 0x7fb8b414f850 2023-11-28T20:00:59.632 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:59.621+0000 7fb8b9c9e640 1 -- 172.21.15.78:0/805180337 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb8b41558c0 con 0x7fb8b414f850 2023-11-28T20:00:59.632 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:59.621+0000 7fb89bfff640 1 -- 172.21.15.78:0/805180337 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fb8a80a8050 con 0x7fb8b414f850 2023-11-28T20:00:59.632 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:59.625+0000 7fb89bfff640 1 --2- 172.21.15.78:0/805180337 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fb8a0066470 0x7fb8a0068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:00:59.632 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:59.625+0000 7fb89bfff640 1 -- 172.21.15.78:0/805180337 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 5823+0+0 (secure 0 0 0) 0x7fb8a811e490 con 0x7fb8b414f850 2023-11-28T20:00:59.632 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:59.625+0000 7fb8b37fe640 1 --2- 172.21.15.78:0/805180337 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fb8a0066470 0x7fb8a0068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:00:59.632 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:59.625+0000 7fb8b37fe640 1 --2- 172.21.15.78:0/805180337 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fb8a0066470 0x7fb8a0068930 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7fb8a4009b60 tx=0x7fb8a4009190 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:00:59.633 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:59.629+0000 7fb89bfff640 1 -- 172.21.15.78:0/805180337 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fb8a80ebb00 con 0x7fb8b414f850 2023-11-28T20:00:59.787 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:00:59.781+0000 7fb8b9c9e640 1 -- 172.21.15.78:0/805180337 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs2_data", "pool2": "cephfs2_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fb8b41526d0 con 0x7fb8b414f850 2023-11-28T20:01:00.449 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:00.445+0000 7fb89bfff640 1 -- 172.21.15.78:0/805180337 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs2_data", "pool2": "cephfs2_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs2_data' removed v52) v1 ==== 172+0+0 (secure 0 0 0) 0x7fb8b41526d0 con 0x7fb8b414f850 2023-11-28T20:01:00.449 INFO:teuthology.orchestra.run.smithi078.stderr:pool 'cephfs2_data' removed 2023-11-28T20:01:00.452 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:00.449+0000 7fb8b9c9e640 1 -- 172.21.15.78:0/805180337 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fb8a0066470 msgr2=0x7fb8a0068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:01:00.452 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:00.449+0000 7fb8b9c9e640 1 --2- 172.21.15.78:0/805180337 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fb8a0066470 0x7fb8a0068930 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7fb8a4009b60 tx=0x7fb8a4009190 comp rx=0 tx=0).stop 2023-11-28T20:01:00.453 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:00.449+0000 7fb8b9c9e640 1 -- 172.21.15.78:0/805180337 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb8b414f850 msgr2=0x7fb8b40aa8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:01:00.453 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:00.449+0000 7fb8b9c9e640 1 --2- 172.21.15.78:0/805180337 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb8b414f850 0x7fb8b40aa8b0 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7fb8a801abb0 tx=0x7fb8a801ad40 comp rx=0 tx=0).stop 2023-11-28T20:01:00.454 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:00.449+0000 7fb8b9c9e640 1 -- 172.21.15.78:0/805180337 shutdown_connections 2023-11-28T20:01:00.454 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:00.449+0000 7fb8b9c9e640 1 --2- 172.21.15.78:0/805180337 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fb8a0066470 0x7fb8a0068930 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:00.454 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:00.449+0000 7fb8b9c9e640 1 --2- 172.21.15.78:0/805180337 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb8b414fc30 0x7fb8b40a9b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:00.454 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:00.449+0000 7fb8b9c9e640 1 --2- 172.21.15.78:0/805180337 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb8b414f850 0x7fb8b40aa8b0 unknown :-1 s=CLOSED pgs=573 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:00.454 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:00.449+0000 7fb8b9c9e640 1 --2- 172.21.15.78:0/805180337 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb8b406d840 0x7fb8b4072680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:00.454 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:00.449+0000 7fb8b9c9e640 1 -- 172.21.15.78:0/805180337 >> 172.21.15.78:0/805180337 conn(0x7fb8b40c59f0 msgr2=0x7fb8b40c5dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:01:00.454 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:00.449+0000 7fb8b9c9e640 1 -- 172.21.15.78:0/805180337 shutdown_connections 2023-11-28T20:01:00.454 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:00.449+0000 7fb8b9c9e640 1 -- 172.21.15.78:0/805180337 wait complete. 2023-11-28T20:01:00.477 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-11-28T20:01:00.621 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:00.617+0000 7f5b62f16640 1 Processor -- start 2023-11-28T20:01:00.621 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:00.617+0000 7f5b62f16640 1 -- start start 2023-11-28T20:01:00.623 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:00.617+0000 7f5b62f16640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f5b5c154f20 0x7f5b5c158050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:00.623 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:00.617+0000 7f5b62f16640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5b5c1589c0 con 0x7f5b5c0af550 2023-11-28T20:01:00.623 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:00.617+0000 7f5b62f16640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5b5c0c67a0 con 0x7f5b5c158590 2023-11-28T20:01:00.623 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:00.617+0000 7f5b62f16640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5b5c1553d0 con 0x7f5b5c154f20 2023-11-28T20:01:00.623 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:00.617+0000 7f5b53fff640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f5b5c154f20 0x7f5b5c158050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:00.623 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:00.617+0000 7f5b53fff640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f5b5c154f20 0x7f5b5c158050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:40658/0 (socket says 172.21.15.78:40658) 2023-11-28T20:01:00.623 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:00.617+0000 7f5b60cb2640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f5b5c0af550 0x7f5b5c0c4710 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:59278/0 (socket says 172.21.15.78:59278) 2023-11-28T20:01:00.623 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:00.617+0000 7f5b53fff640 1 -- 172.21.15.78:0/1796674628 learned_addr learned my addr 172.21.15.78:0/1796674628 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T20:01:00.624 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:00.617+0000 7f5b53fff640 1 -- 172.21.15.78:0/1796674628 >> v1:172.21.15.179:6789/0 conn(0x7f5b5c158590 legacy=0x7f5b5c15ee20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:01:00.624 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:00.617+0000 7f5b53fff640 1 -- 172.21.15.78:0/1796674628 >> v1:172.21.15.78:6789/0 conn(0x7f5b5c0af550 legacy=0x7f5b5c0c4710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:01:00.624 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:00.617+0000 7f5b53fff640 1 -- 172.21.15.78:0/1796674628 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b5c0c69f0 con 0x7f5b5c154f20 2023-11-28T20:01:00.626 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:00.621+0000 7f5b53fff640 1 --2- 172.21.15.78:0/1796674628 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5b5c154f20 0x7f5b5c158050 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7f5b4c009870 tx=0x7f5b4c01c3e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=11582f7723c7f0d7 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:01:00.626 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:00.621+0000 7f5b537fe640 1 -- 172.21.15.78:0/1796674628 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b4c0ab600 con 0x7f5b5c154f20 2023-11-28T20:01:00.626 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:00.621+0000 7f5b537fe640 1 -- 172.21.15.78:0/1796674628 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b4c0a7050 con 0x7f5b5c154f20 2023-11-28T20:01:00.626 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:00.621+0000 7f5b537fe640 1 -- 172.21.15.78:0/1796674628 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b4c0ab980 con 0x7f5b5c154f20 2023-11-28T20:01:00.627 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:00.621+0000 7f5b62f16640 1 -- 172.21.15.78:0/1796674628 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5b5c154f20 msgr2=0x7f5b5c158050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:01:00.627 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:00.621+0000 7f5b62f16640 1 --2- 172.21.15.78:0/1796674628 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5b5c154f20 0x7f5b5c158050 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7f5b4c009870 tx=0x7f5b4c01c3e0 comp rx=0 tx=0).stop 2023-11-28T20:01:00.627 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:00.621+0000 7f5b62f16640 1 -- 172.21.15.78:0/1796674628 shutdown_connections 2023-11-28T20:01:00.628 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:00.621+0000 7f5b62f16640 1 --2- 172.21.15.78:0/1796674628 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5b5c154f20 0x7f5b5c158050 unknown :-1 s=CLOSED pgs=575 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:00.628 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:00.621+0000 7f5b62f16640 1 -- 172.21.15.78:0/1796674628 >> 172.21.15.78:0/1796674628 conn(0x7f5b5c0668d0 msgr2=0x7f5b5c0ab980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:01:00.628 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:00.621+0000 7f5b62f16640 1 -- 172.21.15.78:0/1796674628 shutdown_connections 2023-11-28T20:01:00.628 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:00.621+0000 7f5b62f16640 1 -- 172.21.15.78:0/1796674628 wait complete. 2023-11-28T20:01:00.629 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:00.625+0000 7f5b62f16640 1 Processor -- start 2023-11-28T20:01:00.629 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:00.625+0000 7f5b62f16640 1 -- start start 2023-11-28T20:01:00.630 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:00.625+0000 7f5b62f16640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5b5c0af550 0x7f5b5c144d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:00.630 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:00.625+0000 7f5b62f16640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5b5c154f20 0x7f5b5c145270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:00.630 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:00.625+0000 7f5b62f16640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5b5c158590 0x7f5b5c1f08d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:00.630 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:00.625+0000 7f5b62f16640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b5c0a9f50 con 0x7f5b5c154f20 2023-11-28T20:01:00.631 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:00.625+0000 7f5b62f16640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b5c0ac1c0 con 0x7f5b5c0af550 2023-11-28T20:01:00.631 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:00.625+0000 7f5b62f16640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b5c0a9890 con 0x7f5b5c158590 2023-11-28T20:01:00.631 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:00.625+0000 7f5b53fff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5b5c154f20 0x7f5b5c145270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:00.631 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:00.625+0000 7f5b53fff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5b5c154f20 0x7f5b5c145270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:40664/0 (socket says 172.21.15.78:40664) 2023-11-28T20:01:00.631 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:00.625+0000 7f5b53fff640 1 -- 172.21.15.78:0/3906431354 learned_addr learned my addr 172.21.15.78:0/3906431354 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T20:01:00.631 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:00.625+0000 7f5b53fff640 1 -- 172.21.15.78:0/3906431354 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5b5c158590 msgr2=0x7f5b5c1f08d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:01:00.631 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:00.625+0000 7f5b53fff640 1 --2- 172.21.15.78:0/3906431354 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5b5c158590 0x7f5b5c1f08d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:00.631 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:00.625+0000 7f5b53fff640 1 -- 172.21.15.78:0/3906431354 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5b5c0af550 msgr2=0x7f5b5c144d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:01:00.631 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:00.625+0000 7f5b53fff640 1 --2- 172.21.15.78:0/3906431354 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5b5c0af550 0x7f5b5c144d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:00.631 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:00.625+0000 7f5b53fff640 1 -- 172.21.15.78:0/3906431354 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b4c0094d0 con 0x7f5b5c154f20 2023-11-28T20:01:00.632 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:00.625+0000 7f5b53fff640 1 --2- 172.21.15.78:0/3906431354 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5b5c154f20 0x7f5b5c145270 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7f5b4c0ae040 tx=0x7f5b4c019180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:01:00.632 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:00.625+0000 7f5b517fa640 1 -- 172.21.15.78:0/3906431354 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b4c0b4640 con 0x7f5b5c154f20 2023-11-28T20:01:00.633 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:00.625+0000 7f5b517fa640 1 -- 172.21.15.78:0/3906431354 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b4c0b47a0 con 0x7f5b5c154f20 2023-11-28T20:01:00.633 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:00.625+0000 7f5b517fa640 1 -- 172.21.15.78:0/3906431354 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b4c0b4b50 con 0x7f5b5c154f20 2023-11-28T20:01:00.633 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:00.625+0000 7f5b62f16640 1 -- 172.21.15.78:0/3906431354 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5b5c0a9b70 con 0x7f5b5c154f20 2023-11-28T20:01:00.633 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:00.625+0000 7f5b62f16640 1 -- 172.21.15.78:0/3906431354 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5b5c0ac4a0 con 0x7f5b5c154f20 2023-11-28T20:01:00.633 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:00.629+0000 7f5b62f16640 1 -- 172.21.15.78:0/3906431354 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5b5c067630 con 0x7f5b5c154f20 2023-11-28T20:01:00.633 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:00.629+0000 7f5b517fa640 1 -- 172.21.15.78:0/3906431354 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f5b4c0b2070 con 0x7f5b5c154f20 2023-11-28T20:01:00.634 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:00.629+0000 7f5b517fa640 1 --2- 172.21.15.78:0/3906431354 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f5b48066470 0x7f5b48068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:00.634 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:00.629+0000 7f5b517fa640 1 -- 172.21.15.78:0/3906431354 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 5349+0+0 (secure 0 0 0) 0x7f5b4c11de20 con 0x7f5b5c154f20 2023-11-28T20:01:00.635 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:00.629+0000 7f5b60cb2640 1 --2- 172.21.15.78:0/3906431354 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f5b48066470 0x7f5b48068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:00.635 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:00.629+0000 7f5b60cb2640 1 --2- 172.21.15.78:0/3906431354 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f5b48066470 0x7f5b48068930 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f5b5c0bd540 tx=0x7f5b580079d0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:01:00.639 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:00.633+0000 7f5b517fa640 1 -- 172.21.15.78:0/3906431354 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f5b4c0eb3f0 con 0x7f5b5c154f20 2023-11-28T20:01:00.793 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:00.789+0000 7f5b62f16640 1 -- 172.21.15.78:0/3906431354 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f5b5c06c630 con 0x7f5b5c154f20 2023-11-28T20:01:00.797 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:00.793+0000 7f5b517fa640 1 -- 172.21.15.78:0/3906431354 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v11) v1 ==== 104+0+0 (secure 0 0 0) 0x7f5b4c0eea10 con 0x7f5b5c154f20 2023-11-28T20:01:00.799 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:00.793+0000 7f5b62f16640 1 -- 172.21.15.78:0/3906431354 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f5b48066470 msgr2=0x7f5b48068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:01:00.799 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:00.793+0000 7f5b62f16640 1 --2- 172.21.15.78:0/3906431354 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f5b48066470 0x7f5b48068930 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f5b5c0bd540 tx=0x7f5b580079d0 comp rx=0 tx=0).stop 2023-11-28T20:01:00.799 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:00.793+0000 7f5b62f16640 1 -- 172.21.15.78:0/3906431354 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5b5c154f20 msgr2=0x7f5b5c145270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:01:00.799 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:00.793+0000 7f5b62f16640 1 --2- 172.21.15.78:0/3906431354 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5b5c154f20 0x7f5b5c145270 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7f5b4c0ae040 tx=0x7f5b4c019180 comp rx=0 tx=0).stop 2023-11-28T20:01:00.800 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:00.793+0000 7f5b62f16640 1 -- 172.21.15.78:0/3906431354 shutdown_connections 2023-11-28T20:01:00.800 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:00.793+0000 7f5b62f16640 1 --2- 172.21.15.78:0/3906431354 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f5b48066470 0x7f5b48068930 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:00.800 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:00.793+0000 7f5b62f16640 1 --2- 172.21.15.78:0/3906431354 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5b5c158590 0x7f5b5c1f08d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:00.800 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:00.793+0000 7f5b62f16640 1 --2- 172.21.15.78:0/3906431354 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5b5c154f20 0x7f5b5c145270 unknown :-1 s=CLOSED pgs=576 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:00.800 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:00.793+0000 7f5b62f16640 1 --2- 172.21.15.78:0/3906431354 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5b5c0af550 0x7f5b5c144d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:00.800 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:00.793+0000 7f5b62f16640 1 -- 172.21.15.78:0/3906431354 >> 172.21.15.78:0/3906431354 conn(0x7f5b5c0668d0 msgr2=0x7f5b5c0ae040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:01:00.800 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:00.793+0000 7f5b62f16640 1 -- 172.21.15.78:0/3906431354 shutdown_connections 2023-11-28T20:01:00.800 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:00.793+0000 7f5b62f16640 1 -- 172.21.15.78:0/3906431354 wait complete. 2023-11-28T20:01:00.818 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_multifs_auth.TestClientsWithoutAuth.test_mount_all_caps_absent' 2023-11-28T20:01:00.955 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:00.949+0000 7f5d3385a640 1 Processor -- start 2023-11-28T20:01:00.956 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:00.953+0000 7f5d3385a640 1 -- start start 2023-11-28T20:01:00.957 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:00.953+0000 7f5d3385a640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5d2c06bef0 0x7f5d2c0bfce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:00.957 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:00.953+0000 7f5d3385a640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f5d2c06c5b0 0x7f5d2c06ca40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:00.958 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:00.953+0000 7f5d3385a640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5d2c151690 con 0x7f5d2c14e3f0 2023-11-28T20:01:00.958 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:00.953+0000 7f5d3385a640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5d2c151bc0 con 0x7f5d2c06c5b0 2023-11-28T20:01:00.958 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:00.953+0000 7f5d3385a640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5d2c1518e0 con 0x7f5d2c06bef0 2023-11-28T20:01:00.958 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:00.953+0000 7f5d315f6640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f5d2c14e3f0 0x7f5d2c0c41f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:59280/0 (socket says 172.21.15.78:59280) 2023-11-28T20:01:00.958 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:00.953+0000 7f5d315f6640 1 -- 172.21.15.78:0/2696885795 learned_addr learned my addr 172.21.15.78:0/2696885795 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-11-28T20:01:00.958 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:00.953+0000 7f5d31df7640 1 --2- 172.21.15.78:0/2696885795 >> v2:172.21.15.78:3300/0 conn(0x7f5d2c06c5b0 0x7f5d2c06ca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:00.958 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:00.953+0000 7f5d30df5640 1 --2- 172.21.15.78:0/2696885795 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5d2c06bef0 0x7f5d2c0bfce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:00.958 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:00.953+0000 7f5d31df7640 1 -- 172.21.15.78:0/2696885795 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5d2c06bef0 msgr2=0x7f5d2c0bfce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:01:00.958 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:00.953+0000 7f5d31df7640 1 --2- 172.21.15.78:0/2696885795 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5d2c06bef0 0x7f5d2c0bfce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:00.958 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:00.953+0000 7f5d31df7640 1 -- 172.21.15.78:0/2696885795 >> v1:172.21.15.78:6789/0 conn(0x7f5d2c14e3f0 legacy=0x7f5d2c0c41f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:01:00.958 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:00.953+0000 7f5d31df7640 1 -- 172.21.15.78:0/2696885795 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d2c0c1de0 con 0x7f5d2c06c5b0 2023-11-28T20:01:00.959 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:00.953+0000 7f5d23fff640 1 -- 172.21.15.78:0/2696885795 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1647274946 0 0) 0x7f5d2c151690 con 0x7f5d2c14e3f0 2023-11-28T20:01:00.960 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:00.957+0000 7f5d31df7640 1 --2- 172.21.15.78:0/2696885795 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5d2c06c5b0 0x7f5d2c06ca40 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7f5d24009d90 tx=0x7f5d2401c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e3d7023ae24e5040 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:01:00.960 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:00.957+0000 7f5d23fff640 1 -- 172.21.15.78:0/2696885795 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d240a66e0 con 0x7f5d2c06c5b0 2023-11-28T20:01:00.961 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:00.957+0000 7f5d23fff640 1 -- 172.21.15.78:0/2696885795 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d240a6840 con 0x7f5d2c06c5b0 2023-11-28T20:01:00.961 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:00.957+0000 7f5d23fff640 1 -- 172.21.15.78:0/2696885795 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d240a6bd0 con 0x7f5d2c06c5b0 2023-11-28T20:01:00.961 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:00.957+0000 7f5d3385a640 1 -- 172.21.15.78:0/2696885795 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5d2c06c5b0 msgr2=0x7f5d2c06ca40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:01:00.962 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:00.957+0000 7f5d3385a640 1 --2- 172.21.15.78:0/2696885795 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5d2c06c5b0 0x7f5d2c06ca40 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7f5d24009d90 tx=0x7f5d2401c890 comp rx=0 tx=0).stop 2023-11-28T20:01:00.962 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:00.957+0000 7f5d3385a640 1 -- 172.21.15.78:0/2696885795 shutdown_connections 2023-11-28T20:01:00.962 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:00.957+0000 7f5d3385a640 1 --2- 172.21.15.78:0/2696885795 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5d2c06c5b0 0x7f5d2c06ca40 unknown :-1 s=CLOSED pgs=578 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:00.963 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:00.957+0000 7f5d3385a640 1 --2- 172.21.15.78:0/2696885795 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5d2c06bef0 0x7f5d2c0bfce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:00.963 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:00.957+0000 7f5d3385a640 1 -- 172.21.15.78:0/2696885795 >> 172.21.15.78:0/2696885795 conn(0x7f5d2c0a7810 msgr2=0x7f5d2c0a7c20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:01:00.963 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:00.957+0000 7f5d3385a640 1 -- 172.21.15.78:0/2696885795 shutdown_connections 2023-11-28T20:01:00.964 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:00.957+0000 7f5d3385a640 1 -- 172.21.15.78:0/2696885795 wait complete. 2023-11-28T20:01:00.970 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:00.957+0000 7f5d3385a640 1 Processor -- start 2023-11-28T20:01:00.973 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:00.957+0000 7f5d3385a640 1 -- start start 2023-11-28T20:01:00.974 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:00.961+0000 7f5d3385a640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5d2c06bef0 0x7f5d2c0a9300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:00.974 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:00.961+0000 7f5d3385a640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5d2c06c5b0 0x7f5d2c1eb5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:00.974 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:00.961+0000 7f5d3385a640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5d2c14e3f0 0x7f5d2c0712a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:00.974 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:00.961+0000 7f5d3385a640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d2c0ab500 con 0x7f5d2c06c5b0 2023-11-28T20:01:00.974 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:00.961+0000 7f5d3385a640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d2c1ee640 con 0x7f5d2c14e3f0 2023-11-28T20:01:00.975 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:00.961+0000 7f5d3385a640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5d2c0a9840 con 0x7f5d2c06bef0 2023-11-28T20:01:00.975 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:00.961+0000 7f5d30df5640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5d2c06c5b0 0x7f5d2c1eb5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:00.975 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:00.961+0000 7f5d30df5640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5d2c06c5b0 0x7f5d2c1eb5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:40682/0 (socket says 172.21.15.78:40682) 2023-11-28T20:01:00.975 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:00.961+0000 7f5d30df5640 1 -- 172.21.15.78:0/4218727708 learned_addr learned my addr 172.21.15.78:0/4218727708 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T20:01:00.975 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:00.961+0000 7f5d315f6640 1 --2- 172.21.15.78:0/4218727708 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5d2c06bef0 0x7f5d2c0a9300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:00.976 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:00.961+0000 7f5d30df5640 1 -- 172.21.15.78:0/4218727708 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5d2c06bef0 msgr2=0x7f5d2c0a9300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:01:00.976 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:00.961+0000 7f5d30df5640 1 --2- 172.21.15.78:0/4218727708 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5d2c06bef0 0x7f5d2c0a9300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:00.976 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:00.961+0000 7f5d31df7640 1 --2- 172.21.15.78:0/4218727708 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5d2c14e3f0 0x7f5d2c0712a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:00.976 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:00.961+0000 7f5d30df5640 1 -- 172.21.15.78:0/4218727708 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5d2c14e3f0 msgr2=0x7f5d2c0712a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:01:00.976 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:00.961+0000 7f5d30df5640 1 --2- 172.21.15.78:0/4218727708 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5d2c14e3f0 0x7f5d2c0712a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:00.977 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:00.961+0000 7f5d30df5640 1 -- 172.21.15.78:0/4218727708 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d24009a70 con 0x7f5d2c06c5b0 2023-11-28T20:01:00.977 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:00.961+0000 7f5d315f6640 1 --2- 172.21.15.78:0/4218727708 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5d2c06bef0 0x7f5d2c0a9300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T20:01:00.977 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:00.961+0000 7f5d31df7640 1 --2- 172.21.15.78:0/4218727708 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5d2c14e3f0 0x7f5d2c0712a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T20:01:00.977 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:00.961+0000 7f5d30df5640 1 --2- 172.21.15.78:0/4218727708 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5d2c06c5b0 0x7f5d2c1eb5d0 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7f5d1c00d830 tx=0x7f5d1c00dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:01:00.977 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:00.961+0000 7f5d21ffb640 1 -- 172.21.15.78:0/4218727708 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d1c00b6c0 con 0x7f5d2c06c5b0 2023-11-28T20:01:00.978 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:00.961+0000 7f5d21ffb640 1 -- 172.21.15.78:0/4218727708 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d1c00b820 con 0x7f5d2c06c5b0 2023-11-28T20:01:00.978 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:00.961+0000 7f5d3385a640 1 -- 172.21.15.78:0/4218727708 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5d2c1ebb10 con 0x7f5d2c06c5b0 2023-11-28T20:01:00.978 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:00.961+0000 7f5d21ffb640 1 -- 172.21.15.78:0/4218727708 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d1c00bb90 con 0x7f5d2c06c5b0 2023-11-28T20:01:00.979 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:00.961+0000 7f5d3385a640 1 -- 172.21.15.78:0/4218727708 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5d2c0a6d10 con 0x7f5d2c06c5b0 2023-11-28T20:01:00.979 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:00.961+0000 7f5d3385a640 1 -- 172.21.15.78:0/4218727708 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5d2c1ee7f0 con 0x7f5d2c06c5b0 2023-11-28T20:01:00.979 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:00.961+0000 7f5d21ffb640 1 -- 172.21.15.78:0/4218727708 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f5d1c01e460 con 0x7f5d2c06c5b0 2023-11-28T20:01:00.979 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:00.965+0000 7f5d21ffb640 1 --2- 172.21.15.78:0/4218727708 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f5d10066470 0x7f5d10068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:00.979 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:00.965+0000 7f5d21ffb640 1 -- 172.21.15.78:0/4218727708 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 5349+0+0 (secure 0 0 0) 0x7f5d1c084470 con 0x7f5d2c06c5b0 2023-11-28T20:01:00.980 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:00.965+0000 7f5d315f6640 1 --2- 172.21.15.78:0/4218727708 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f5d10066470 0x7f5d10068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:00.980 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:00.965+0000 7f5d315f6640 1 --2- 172.21.15.78:0/4218727708 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f5d10066470 0x7f5d10068930 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f5d28007fd0 tx=0x7f5d28009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:01:00.981 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:00.969+0000 7f5d21ffb640 1 -- 172.21.15.78:0/4218727708 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f5d2c1ee7f0 con 0x7f5d2c06c5b0 2023-11-28T20:01:01.174 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:01.169+0000 7f5d3385a640 1 -- 172.21.15.78:0/4218727708 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_multifs_auth.TestClientsWithoutAuth.test_mount_all_caps_absent"]} v 0) v1 -- 0x7f5d2c1ee7f0 con 0x7f5d2c06c5b0 2023-11-28T20:01:01.451 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:01.445+0000 7f5d21ffb640 1 -- 172.21.15.78:0/4218727708 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_multifs_auth.TestClientsWithoutAuth.test_mount_all_caps_absent"]}]=0 v132) v1 ==== 159+0+0 (secure 0 0 0) 0x7f5d2c1ee7f0 con 0x7f5d2c06c5b0 2023-11-28T20:01:01.454 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:01.449+0000 7f5d3385a640 1 -- 172.21.15.78:0/4218727708 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f5d10066470 msgr2=0x7f5d10068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:01:01.454 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:01.449+0000 7f5d3385a640 1 --2- 172.21.15.78:0/4218727708 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f5d10066470 0x7f5d10068930 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f5d28007fd0 tx=0x7f5d28009040 comp rx=0 tx=0).stop 2023-11-28T20:01:01.454 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:01.449+0000 7f5d3385a640 1 -- 172.21.15.78:0/4218727708 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5d2c06c5b0 msgr2=0x7f5d2c1eb5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:01:01.454 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:01.449+0000 7f5d3385a640 1 --2- 172.21.15.78:0/4218727708 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5d2c06c5b0 0x7f5d2c1eb5d0 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7f5d1c00d830 tx=0x7f5d1c00dcf0 comp rx=0 tx=0).stop 2023-11-28T20:01:01.454 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:01.449+0000 7f5d3385a640 1 -- 172.21.15.78:0/4218727708 shutdown_connections 2023-11-28T20:01:01.454 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:01.449+0000 7f5d3385a640 1 --2- 172.21.15.78:0/4218727708 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f5d10066470 0x7f5d10068930 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:01.454 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:01.449+0000 7f5d3385a640 1 --2- 172.21.15.78:0/4218727708 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5d2c14e3f0 0x7f5d2c0712a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:01.454 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:01.449+0000 7f5d3385a640 1 --2- 172.21.15.78:0/4218727708 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5d2c06c5b0 0x7f5d2c1eb5d0 unknown :-1 s=CLOSED pgs=579 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:01.455 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:01.449+0000 7f5d3385a640 1 --2- 172.21.15.78:0/4218727708 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5d2c06bef0 0x7f5d2c0a9300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:01.455 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:01.449+0000 7f5d3385a640 1 -- 172.21.15.78:0/4218727708 >> 172.21.15.78:0/4218727708 conn(0x7f5d2c0a7810 msgr2=0x7f5d2c14a100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:01:01.455 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:01.449+0000 7f5d3385a640 1 -- 172.21.15.78:0/4218727708 shutdown_connections 2023-11-28T20:01:01.455 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:01.449+0000 7f5d3385a640 1 -- 172.21.15.78:0/4218727708 wait complete. 2023-11-28T20:01:01.473 INFO:tasks.cephfs_test_runner:test_mount_all_caps_absent (tasks.cephfs.test_multifs_auth.TestClientsWithoutAuth) ... ok 2023-11-28T20:01:01.473 INFO:tasks.cephfs_test_runner:Starting test: test_mount_mon_and_osd_caps_present_mds_caps_absent (tasks.cephfs.test_multifs_auth.TestClientsWithoutAuth) 2023-11-28T20:01:01.474 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-28T20:01:01.610 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:01.605+0000 7f3947b72640 1 Processor -- start 2023-11-28T20:01:01.611 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:01.605+0000 7f3947b72640 1 -- start start 2023-11-28T20:01:01.612 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:01.609+0000 7f3947b72640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f39400c0f30 0x7f3940072580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:01.613 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:01.609+0000 7f3947b72640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f39400c3960 0x7f39400c0460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:01.613 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:01.609+0000 7f3947b72640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f39400c1a50 con 0x7f3940159280 2023-11-28T20:01:01.613 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:01.609+0000 7f3947b72640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f39400c3de0 con 0x7f39400c0f30 2023-11-28T20:01:01.613 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:01.609+0000 7f3947b72640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f39400c1ca0 con 0x7f39400c3960 2023-11-28T20:01:01.613 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:01.609+0000 7f394590e640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f39400c0f30 0x7f3940072580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:01.613 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:01.609+0000 7f394590e640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f39400c0f30 0x7f3940072580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:40688/0 (socket says 172.21.15.78:40688) 2023-11-28T20:01:01.613 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:01.609+0000 7f394610f640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f3940159280 0x7f3940155ed0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:59296/0 (socket says 172.21.15.78:59296) 2023-11-28T20:01:01.613 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:01.609+0000 7f394590e640 1 -- 172.21.15.78:0/3989289962 learned_addr learned my addr 172.21.15.78:0/3989289962 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T20:01:01.613 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:01.609+0000 7f394510d640 1 --2- 172.21.15.78:0/3989289962 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f39400c3960 0x7f39400c0460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:01.613 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:01.609+0000 7f394590e640 1 -- 172.21.15.78:0/3989289962 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f39400c3960 msgr2=0x7f39400c0460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:01:01.613 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:01.609+0000 7f394590e640 1 --2- 172.21.15.78:0/3989289962 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f39400c3960 0x7f39400c0460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:01.614 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:01.609+0000 7f394590e640 1 -- 172.21.15.78:0/3989289962 >> v1:172.21.15.78:6789/0 conn(0x7f3940159280 legacy=0x7f3940155ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:01:01.614 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:01.609+0000 7f394590e640 1 -- 172.21.15.78:0/3989289962 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39400c1f80 con 0x7f39400c0f30 2023-11-28T20:01:01.615 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:01.609+0000 7f394590e640 1 --2- 172.21.15.78:0/3989289962 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f39400c0f30 0x7f3940072580 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7f393c009870 tx=0x7f393c01c4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c6a8dfd2d75cc69c server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:01:01.616 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:01.613+0000 7f394490c640 1 -- 172.21.15.78:0/3989289962 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f393c0aa430 con 0x7f39400c0f30 2023-11-28T20:01:01.616 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:01.613+0000 7f394490c640 1 -- 172.21.15.78:0/3989289962 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f393c0aa590 con 0x7f39400c0f30 2023-11-28T20:01:01.616 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:01.613+0000 7f394490c640 1 -- 172.21.15.78:0/3989289962 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f393c0aa920 con 0x7f39400c0f30 2023-11-28T20:01:01.617 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:01.613+0000 7f3947b72640 1 -- 172.21.15.78:0/3989289962 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f39400c0f30 msgr2=0x7f3940072580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:01:01.617 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:01.613+0000 7f3947b72640 1 --2- 172.21.15.78:0/3989289962 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f39400c0f30 0x7f3940072580 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7f393c009870 tx=0x7f393c01c4b0 comp rx=0 tx=0).stop 2023-11-28T20:01:01.617 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:01.613+0000 7f3947b72640 1 -- 172.21.15.78:0/3989289962 shutdown_connections 2023-11-28T20:01:01.617 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:01.613+0000 7f3947b72640 1 --2- 172.21.15.78:0/3989289962 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f39400c3960 0x7f39400c0460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:01.617 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:01.613+0000 7f3947b72640 1 --2- 172.21.15.78:0/3989289962 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f39400c0f30 0x7f3940072580 unknown :-1 s=CLOSED pgs=581 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:01.617 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:01.613+0000 7f3947b72640 1 -- 172.21.15.78:0/3989289962 >> 172.21.15.78:0/3989289962 conn(0x7f39400a7810 msgr2=0x7f39400a7c20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:01:01.617 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:01.613+0000 7f3947b72640 1 -- 172.21.15.78:0/3989289962 shutdown_connections 2023-11-28T20:01:01.617 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:01.613+0000 7f3947b72640 1 -- 172.21.15.78:0/3989289962 wait complete. 2023-11-28T20:01:01.618 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:01.613+0000 7f3947b72640 1 Processor -- start 2023-11-28T20:01:01.618 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:01.613+0000 7f3947b72640 1 -- start start 2023-11-28T20:01:01.620 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:01.613+0000 7f3947b72640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f39400c0f30 0x7f39401f4e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:01.620 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:01.613+0000 7f3947b72640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f39400c3960 0x7f3940156f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:01.620 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:01.613+0000 7f3947b72640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3940159280 0x7f39401532c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:01.621 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:01.613+0000 7f3947b72640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3940152e10 con 0x7f39400c0f30 2023-11-28T20:01:01.621 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:01.613+0000 7f3947b72640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39401f5350 con 0x7f39400c3960 2023-11-28T20:01:01.621 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:01.613+0000 7f3947b72640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3940154320 con 0x7f3940159280 2023-11-28T20:01:01.621 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:01.613+0000 7f394590e640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f39400c0f30 0x7f39401f4e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:01.621 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:01.613+0000 7f394590e640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f39400c0f30 0x7f39401f4e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:40692/0 (socket says 172.21.15.78:40692) 2023-11-28T20:01:01.621 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:01.613+0000 7f394590e640 1 -- 172.21.15.78:0/3768325540 learned_addr learned my addr 172.21.15.78:0/3768325540 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T20:01:01.621 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:01.613+0000 7f394510d640 1 --2- 172.21.15.78:0/3768325540 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f39400c3960 0x7f3940156f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:01.621 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:01.617+0000 7f394610f640 1 --2- 172.21.15.78:0/3768325540 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3940159280 0x7f39401532c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:01.621 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:01.617+0000 7f394590e640 1 -- 172.21.15.78:0/3768325540 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3940159280 msgr2=0x7f39401532c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:01:01.621 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:01.617+0000 7f394590e640 1 --2- 172.21.15.78:0/3768325540 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3940159280 0x7f39401532c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:01.621 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:01.617+0000 7f394590e640 1 -- 172.21.15.78:0/3768325540 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f39400c3960 msgr2=0x7f3940156f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:01:01.621 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:01.617+0000 7f394590e640 1 --2- 172.21.15.78:0/3768325540 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f39400c3960 0x7f3940156f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:01.622 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:01.617+0000 7f394590e640 1 -- 172.21.15.78:0/3768325540 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f393c0094d0 con 0x7f39400c0f30 2023-11-28T20:01:01.622 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:01.617+0000 7f394510d640 1 --2- 172.21.15.78:0/3768325540 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f39400c3960 0x7f3940156f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T20:01:01.622 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:01.617+0000 7f394590e640 1 --2- 172.21.15.78:0/3768325540 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f39400c0f30 0x7f39401f4e10 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7f393c0ac040 tx=0x7f393c01acf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:01:01.622 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:01.617+0000 7f39367fc640 1 -- 172.21.15.78:0/3768325540 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f393c0b3800 con 0x7f39400c0f30 2023-11-28T20:01:01.622 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:01.617+0000 7f39367fc640 1 -- 172.21.15.78:0/3768325540 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f393c0b3980 con 0x7f39400c0f30 2023-11-28T20:01:01.622 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:01.617+0000 7f3947b72640 1 -- 172.21.15.78:0/3768325540 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3940154600 con 0x7f39400c0f30 2023-11-28T20:01:01.622 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:01.617+0000 7f39367fc640 1 -- 172.21.15.78:0/3768325540 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f393c0b3d30 con 0x7f39400c0f30 2023-11-28T20:01:01.622 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:01.617+0000 7f3947b72640 1 -- 172.21.15.78:0/3768325540 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f39401574b0 con 0x7f39400c0f30 2023-11-28T20:01:01.623 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:01.617+0000 7f3947b72640 1 -- 172.21.15.78:0/3768325540 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3940152f80 con 0x7f39400c0f30 2023-11-28T20:01:01.623 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:01.617+0000 7f39367fc640 1 -- 172.21.15.78:0/3768325540 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f393c0c6440 con 0x7f39400c0f30 2023-11-28T20:01:01.623 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:01.617+0000 7f39367fc640 1 --2- 172.21.15.78:0/3768325540 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f39240664a0 0x7f3924068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:01.623 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:01.617+0000 7f39367fc640 1 -- 172.21.15.78:0/3768325540 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 5349+0+0 (secure 0 0 0) 0x7f393c11e6d0 con 0x7f39400c0f30 2023-11-28T20:01:01.623 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:01.621+0000 7f394510d640 1 --2- 172.21.15.78:0/3768325540 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f39240664a0 0x7f3924068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:01.624 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:01.621+0000 7f394510d640 1 --2- 172.21.15.78:0/3768325540 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f39240664a0 0x7f3924068960 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f394014f9a0 tx=0x7f3930008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:01:01.627 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:01.621+0000 7f39367fc640 1 -- 172.21.15.78:0/3768325540 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f393c0ebe60 con 0x7f39400c0f30 2023-11-28T20:01:01.778 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:01.773+0000 7f3947b72640 1 -- 172.21.15.78:0/3768325540 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3940067630 con 0x7f39400c0f30 2023-11-28T20:01:01.779 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:01.773+0000 7f39367fc640 1 -- 172.21.15.78:0/3768325540 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v52) v1 ==== 74+0+13299 (secure 0 0 0) 0x7f393c0ef480 con 0x7f39400c0f30 2023-11-28T20:01:01.779 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-11-28T20:01:01.779 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":52,"fsid":"dd9780e8-3bda-44fa-a9f0-fa07d19d901d","created":"2023-11-28T19:58:40.969556+0000","modified":"2023-11-28T20:01:00.443086+0000","last_up_change":"2023-11-28T19:58:52.596716+0000","last_in_change":"2023-11-28T19:58:43.609275+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-28T19:58:54.011229+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e84245ac-b5da-429e-af18-39acaa2b33e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6800","nonce":3358701235},{"type":"v1","addr":"172.21.15.78:6801","nonce":3358701235}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6802","nonce":3358701235},{"type":"v1","addr":"172.21.15.78:6803","nonce":3358701235}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6806","nonce":3358701235},{"type":"v1","addr":"172.21.15.78:6807","nonce":3358701235}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6804","nonce":3358701235},{"type":"v1","addr":"172.21.15.78:6805","nonce":3358701235}]},"public_addr":"172.21.15.78:6801/3358701235","cluster_addr":"172.21.15.78:6803/3358701235","heartbeat_back_addr":"172.21.15.78:6807/3358701235","heartbeat_front_addr":"172.21.15.78:6805/3358701235","state":["exists","up"]},{"osd":1,"uuid":"e634831d-c4e2-48d9-870c-9556ae162981","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6808","nonce":3211476654},{"type":"v1","addr":"172.21.15.78:6809","nonce":3211476654}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6810","nonce":3211476654},{"type":"v1","addr":"172.21.15.78:6811","nonce":3211476654}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6814","nonce":3211476654},{"type":"v1","addr":"172.21.15.78:6815","nonce":3211476654}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6812","nonce":3211476654},{"type":"v1","addr":"172.21.15.78:6813","nonce":3211476654}]},"public_addr":"172.21.15.78:6809/3211476654","cluster_addr":"172.21.15.78:6811/3211476654","heartbeat_back_addr":"172.21.15.78:6815/3211476654","heartbeat_front_addr":"172.21.15.78:6813/3211476654","state":["exists","up"]},{"osd":2,"uuid":"274c8395-6534-41f0-b8fb-a00af8985aa8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6816","nonce":2532904479},{"type":"v1","addr":"172.21.15.78:6817","nonce":2532904479}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6818","nonce":2532904479},{"type":"v1","addr":"172.21.15.78:6819","nonce":2532904479}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6822","nonce":2532904479},{"type":"v1","addr":"172.21.15.78:6823","nonce":2532904479}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6820","nonce":2532904479},{"type":"v1","addr":"172.21.15.78:6821","nonce":2532904479}]},"public_addr":"172.21.15.78:6817/2532904479","cluster_addr":"172.21.15.78:6819/2532904479","heartbeat_back_addr":"172.21.15.78:6823/2532904479","heartbeat_front_addr":"172.21.15.78:6821/2532904479","state":["exists","up"]},{"osd":3,"uuid":"77acc9af-7d4d-4b18-8cf5-d62f5971b7c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6824","nonce":3442991267},{"type":"v1","addr":"172.21.15.78:6825","nonce":3442991267}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6826","nonce":3442991267},{"type":"v1","addr":"172.21.15.78:6827","nonce":3442991267}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6830","nonce":3442991267},{"type":"v1","addr":"172.21.15.78:6831","nonce":3442991267}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6828","nonce":3442991267},{"type":"v1","addr":"172.21.15.78:6829","nonce":3442991267}]},"public_addr":"172.21.15.78:6825/3442991267","cluster_addr":"172.21.15.78:6827/3442991267","heartbeat_back_addr":"172.21.15.78:6831/3442991267","heartbeat_front_addr":"172.21.15.78:6829/3442991267","state":["exists","up"]},{"osd":4,"uuid":"5c62bc66-6b34-4b7f-a66b-9a743969138c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":802983577},{"type":"v1","addr":"172.21.15.179:6809","nonce":802983577}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":802983577},{"type":"v1","addr":"172.21.15.179:6811","nonce":802983577}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":802983577},{"type":"v1","addr":"172.21.15.179:6815","nonce":802983577}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":802983577},{"type":"v1","addr":"172.21.15.179:6813","nonce":802983577}]},"public_addr":"172.21.15.179:6809/802983577","cluster_addr":"172.21.15.179:6811/802983577","heartbeat_back_addr":"172.21.15.179:6815/802983577","heartbeat_front_addr":"172.21.15.179:6813/802983577","state":["exists","up"]},{"osd":5,"uuid":"67db6d36-f684-4079-b0cd-82b4dd61461f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":518192887},{"type":"v1","addr":"172.21.15.179:6818","nonce":518192887}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":518192887},{"type":"v1","addr":"172.21.15.179:6822","nonce":518192887}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":518192887},{"type":"v1","addr":"172.21.15.179:6829","nonce":518192887}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6824","nonce":518192887},{"type":"v1","addr":"172.21.15.179:6826","nonce":518192887}]},"public_addr":"172.21.15.179:6818/518192887","cluster_addr":"172.21.15.179:6822/518192887","heartbeat_back_addr":"172.21.15.179:6829/518192887","heartbeat_front_addr":"172.21.15.179:6826/518192887","state":["exists","up"]},{"osd":6,"uuid":"12e670af-5a16-4c81-9f97-defa66cab967","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":815435378},{"type":"v1","addr":"172.21.15.179:6801","nonce":815435378}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":815435378},{"type":"v1","addr":"172.21.15.179:6803","nonce":815435378}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":815435378},{"type":"v1","addr":"172.21.15.179:6807","nonce":815435378}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":815435378},{"type":"v1","addr":"172.21.15.179:6805","nonce":815435378}]},"public_addr":"172.21.15.179:6801/815435378","cluster_addr":"172.21.15.179:6803/815435378","heartbeat_back_addr":"172.21.15.179:6807/815435378","heartbeat_front_addr":"172.21.15.179:6805/815435378","state":["exists","up"]},{"osd":7,"uuid":"fe630650-2eb3-49ad-8676-c341e6332eb1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6817","nonce":2848432339},{"type":"v1","addr":"172.21.15.179:6819","nonce":2848432339}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6821","nonce":2848432339},{"type":"v1","addr":"172.21.15.179:6823","nonce":2848432339}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":2848432339},{"type":"v1","addr":"172.21.15.179:6831","nonce":2848432339}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6825","nonce":2848432339},{"type":"v1","addr":"172.21.15.179:6827","nonce":2848432339}]},"public_addr":"172.21.15.179:6819/2848432339","cluster_addr":"172.21.15.179:6823/2848432339","heartbeat_back_addr":"172.21.15.179:6831/2848432339","heartbeat_front_addr":"172.21.15.179:6827/2848432339","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:58:49.255433+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:58:49.412880+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:58:49.559295+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:58:49.245237+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:58:49.184557+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:58:49.329851+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:58:49.366012+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:58:49.349604+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.179:6833/3446403084":"2023-11-29T20:00:57.430945+0000","172.21.15.78:6836/3508383403":"2023-11-29T20:00:50.972350+0000","172.21.15.179:6832/3446403084":"2023-11-29T20:00:57.430945+0000","172.21.15.78:6834/3508383403":"2023-11-29T20:00:50.972350+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-28T20:01:01.781 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:01.777+0000 7f3947b72640 1 -- 172.21.15.78:0/3768325540 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f39240664a0 msgr2=0x7f3924068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:01:01.781 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:01.777+0000 7f3947b72640 1 --2- 172.21.15.78:0/3768325540 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f39240664a0 0x7f3924068960 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f394014f9a0 tx=0x7f3930008040 comp rx=0 tx=0).stop 2023-11-28T20:01:01.781 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:01.777+0000 7f3947b72640 1 -- 172.21.15.78:0/3768325540 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f39400c0f30 msgr2=0x7f39401f4e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:01:01.781 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:01.777+0000 7f3947b72640 1 --2- 172.21.15.78:0/3768325540 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f39400c0f30 0x7f39401f4e10 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7f393c0ac040 tx=0x7f393c01acf0 comp rx=0 tx=0).stop 2023-11-28T20:01:01.781 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:01.777+0000 7f3947b72640 1 -- 172.21.15.78:0/3768325540 shutdown_connections 2023-11-28T20:01:01.781 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:01.777+0000 7f3947b72640 1 --2- 172.21.15.78:0/3768325540 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f39240664a0 0x7f3924068960 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:01.781 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:01.777+0000 7f3947b72640 1 --2- 172.21.15.78:0/3768325540 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3940159280 0x7f39401532c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:01.781 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:01.777+0000 7f3947b72640 1 --2- 172.21.15.78:0/3768325540 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f39400c3960 0x7f3940156f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:01.782 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:01.777+0000 7f3947b72640 1 --2- 172.21.15.78:0/3768325540 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f39400c0f30 0x7f39401f4e10 unknown :-1 s=CLOSED pgs=582 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:01.782 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:01.777+0000 7f3947b72640 1 -- 172.21.15.78:0/3768325540 >> 172.21.15.78:0/3768325540 conn(0x7f39400a7810 msgr2=0x7f39400a7bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:01:01.782 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:01.777+0000 7f3947b72640 1 -- 172.21.15.78:0/3768325540 shutdown_connections 2023-11-28T20:01:01.782 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:01.777+0000 7f3947b72640 1 -- 172.21.15.78:0/3768325540 wait complete. 2023-11-28T20:01:01.800 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-28T19:58:54.011229+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-28T20:01:01.800 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-28T20:01:01.940 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:01.937+0000 7f80c4957640 1 Processor -- start 2023-11-28T20:01:01.940 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:01.937+0000 7f80c4957640 1 -- start start 2023-11-28T20:01:01.942 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:01.937+0000 7f80c4957640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f80c014b1e0 0x7f80c00c1700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:01.942 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:01.937+0000 7f80c4957640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f80c00c5300 0x7f80c00a9c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:01.942 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:01.937+0000 7f80c4957640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f80c0151280 0x7f80c01516f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:01.942 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:01.937+0000 7f80c4957640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f80c00a4e20 con 0x7f80c00c5300 2023-11-28T20:01:01.942 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:01.937+0000 7f80c4957640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f80c00a50e0 con 0x7f80c014b1e0 2023-11-28T20:01:01.942 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:01.937+0000 7f80c4957640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f80c00c0f00 con 0x7f80c0151280 2023-11-28T20:01:01.942 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:01.937+0000 7f80b5d9b640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f80c00c5300 0x7f80c00a9c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:01.942 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:01.937+0000 7f80b5d9b640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f80c00c5300 0x7f80c00a9c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:40708/0 (socket says 172.21.15.78:40708) 2023-11-28T20:01:01.942 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:01.937+0000 7f80b5d9b640 1 -- 172.21.15.78:0/4233381005 learned_addr learned my addr 172.21.15.78:0/4233381005 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T20:01:01.942 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:01.937+0000 7f80bed9d640 1 --2- 172.21.15.78:0/4233381005 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f80c0151280 0x7f80c01516f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:01.943 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:01.937+0000 7f80be59c640 1 --2- 172.21.15.78:0/4233381005 >> v2:172.21.15.179:3300/0 conn(0x7f80c014b1e0 0x7f80c00c1700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:01.943 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:01.937+0000 7f80b5d9b640 1 -- 172.21.15.78:0/4233381005 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f80c0151280 msgr2=0x7f80c01516f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:01:01.943 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:01.937+0000 7f80b5d9b640 1 --2- 172.21.15.78:0/4233381005 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f80c0151280 0x7f80c01516f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:01.943 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:01.937+0000 7f80b5d9b640 1 -- 172.21.15.78:0/4233381005 >> v2:172.21.15.179:3300/0 conn(0x7f80c014b1e0 msgr2=0x7f80c00c1700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:01:01.943 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:01.937+0000 7f80b5d9b640 1 --2- 172.21.15.78:0/4233381005 >> v2:172.21.15.179:3300/0 conn(0x7f80c014b1e0 0x7f80c00c1700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:01.943 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:01.937+0000 7f80b5d9b640 1 -- 172.21.15.78:0/4233381005 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80c00c11e0 con 0x7f80c00c5300 2023-11-28T20:01:01.944 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:01.941+0000 7f80b5d9b640 1 --2- 172.21.15.78:0/4233381005 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f80c00c5300 0x7f80c00a9c30 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7f80c00c4150 tx=0x7f80a801ebd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2d2e3a61b73d7653 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:01:01.945 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:01.941+0000 7f80bdd9b640 1 -- 172.21.15.78:0/4233381005 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80a80a79f0 con 0x7f80c00c5300 2023-11-28T20:01:01.945 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:01.941+0000 7f80bdd9b640 1 -- 172.21.15.78:0/4233381005 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f80a80a7b50 con 0x7f80c00c5300 2023-11-28T20:01:01.945 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:01.941+0000 7f80bdd9b640 1 -- 172.21.15.78:0/4233381005 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80a80af440 con 0x7f80c00c5300 2023-11-28T20:01:01.946 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:01.941+0000 7f80c4957640 1 -- 172.21.15.78:0/4233381005 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f80c00c5300 msgr2=0x7f80c00a9c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:01:01.946 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:01.941+0000 7f80c4957640 1 --2- 172.21.15.78:0/4233381005 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f80c00c5300 0x7f80c00a9c30 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7f80c00c4150 tx=0x7f80a801ebd0 comp rx=0 tx=0).stop 2023-11-28T20:01:01.946 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:01.941+0000 7f80c4957640 1 -- 172.21.15.78:0/4233381005 shutdown_connections 2023-11-28T20:01:01.946 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:01.941+0000 7f80c4957640 1 --2- 172.21.15.78:0/4233381005 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f80c0151280 0x7f80c01516f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:01.947 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:01.941+0000 7f80c4957640 1 --2- 172.21.15.78:0/4233381005 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f80c00c5300 0x7f80c00a9c30 unknown :-1 s=CLOSED pgs=583 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:01.947 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:01.941+0000 7f80c4957640 1 --2- 172.21.15.78:0/4233381005 >> v2:172.21.15.179:3300/0 conn(0x7f80c014b1e0 0x7f80c00c1700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:01.947 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:01.941+0000 7f80c4957640 1 -- 172.21.15.78:0/4233381005 >> 172.21.15.78:0/4233381005 conn(0x7f80c00c59f0 msgr2=0x7f80c00c5e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:01:01.947 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:01.941+0000 7f80c4957640 1 -- 172.21.15.78:0/4233381005 shutdown_connections 2023-11-28T20:01:01.947 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:01.941+0000 7f80c4957640 1 -- 172.21.15.78:0/4233381005 wait complete. 2023-11-28T20:01:01.951 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:01.945+0000 7f80c4957640 1 Processor -- start 2023-11-28T20:01:01.951 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:01.945+0000 7f80c4957640 1 -- start start 2023-11-28T20:01:01.951 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:01.945+0000 7f80c4957640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f80c00c5300 0x7f80c0145c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:01.951 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:01.945+0000 7f80c4957640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f80c014b1e0 0x7f80c00a6370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:01.952 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:01.945+0000 7f80c4957640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f80c0151280 0x7f80c01eced0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:01.952 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:01.945+0000 7f80c4957640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80c014ed60 con 0x7f80c0151280 2023-11-28T20:01:01.952 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:01.945+0000 7f80c4957640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80c014cb20 con 0x7f80c014b1e0 2023-11-28T20:01:01.952 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:01.945+0000 7f80c4957640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f80c014cd90 con 0x7f80c00c5300 2023-11-28T20:01:01.952 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:01.945+0000 7f80bed9d640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f80c0151280 0x7f80c01eced0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:01.952 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:01.945+0000 7f80bed9d640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f80c0151280 0x7f80c01eced0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:40712/0 (socket says 172.21.15.78:40712) 2023-11-28T20:01:01.952 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:01.945+0000 7f80bed9d640 1 -- 172.21.15.78:0/504523970 learned_addr learned my addr 172.21.15.78:0/504523970 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T20:01:01.953 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:01.945+0000 7f80b5d9b640 1 --2- 172.21.15.78:0/504523970 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f80c014b1e0 0x7f80c00a6370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:01.953 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:01.945+0000 7f80be59c640 1 --2- 172.21.15.78:0/504523970 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f80c00c5300 0x7f80c0145c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:01.953 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:01.945+0000 7f80bed9d640 1 -- 172.21.15.78:0/504523970 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f80c00c5300 msgr2=0x7f80c0145c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:01:01.953 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:01.945+0000 7f80bed9d640 1 --2- 172.21.15.78:0/504523970 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f80c00c5300 0x7f80c0145c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:01.953 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:01.945+0000 7f80bed9d640 1 -- 172.21.15.78:0/504523970 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f80c014b1e0 msgr2=0x7f80c00a6370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:01:01.953 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:01.945+0000 7f80bed9d640 1 --2- 172.21.15.78:0/504523970 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f80c014b1e0 0x7f80c00a6370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:01.953 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:01.945+0000 7f80bed9d640 1 -- 172.21.15.78:0/504523970 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80a800b770 con 0x7f80c0151280 2023-11-28T20:01:01.953 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:01.945+0000 7f80be59c640 1 --2- 172.21.15.78:0/504523970 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f80c00c5300 0x7f80c0145c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T20:01:01.953 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:01.945+0000 7f80bed9d640 1 --2- 172.21.15.78:0/504523970 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f80c0151280 0x7f80c01eced0 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7f80b800d560 tx=0x7f80b800da20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:01:01.953 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:01.945+0000 7f80b77fe640 1 -- 172.21.15.78:0/504523970 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80b80125f0 con 0x7f80c0151280 2023-11-28T20:01:01.953 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:01.945+0000 7f80b77fe640 1 -- 172.21.15.78:0/504523970 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f80b8012770 con 0x7f80c0151280 2023-11-28T20:01:01.954 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:01.945+0000 7f80b77fe640 1 -- 172.21.15.78:0/504523970 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80b8012b20 con 0x7f80c0151280 2023-11-28T20:01:01.954 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:01.945+0000 7f80c4957640 1 -- 172.21.15.78:0/504523970 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f80c01f0db0 con 0x7f80c0151280 2023-11-28T20:01:01.954 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:01.945+0000 7f80c4957640 1 -- 172.21.15.78:0/504523970 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f80c0070190 con 0x7f80c0151280 2023-11-28T20:01:01.954 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:01.945+0000 7f80c4957640 1 -- 172.21.15.78:0/504523970 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f80c0067630 con 0x7f80c0151280 2023-11-28T20:01:01.955 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:01.949+0000 7f80b77fe640 1 -- 172.21.15.78:0/504523970 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f80b8012c80 con 0x7f80c0151280 2023-11-28T20:01:01.955 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:01.949+0000 7f80b77fe640 1 --2- 172.21.15.78:0/504523970 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f80a0066470 0x7f80a0068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:01.955 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:01.949+0000 7f80b77fe640 1 -- 172.21.15.78:0/504523970 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 5349+0+0 (secure 0 0 0) 0x7f80b8084190 con 0x7f80c0151280 2023-11-28T20:01:01.955 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:01.949+0000 7f80be59c640 1 --2- 172.21.15.78:0/504523970 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f80a0066470 0x7f80a0068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:01.955 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:01.949+0000 7f80be59c640 1 --2- 172.21.15.78:0/504523970 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f80a0066470 0x7f80a0068930 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f80c00c07a0 tx=0x7f80b0003a20 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:01:01.956 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:01.953+0000 7f80b77fe640 1 -- 172.21.15.78:0/504523970 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f80b8051760 con 0x7f80c0151280 2023-11-28T20:01:02.115 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:02.109+0000 7f80c4957640 1 -- 172.21.15.78:0/504523970 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f80c00c1730 con 0x7f80c0151280 2023-11-28T20:01:02.115 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:02.109+0000 7f80b77fe640 1 -- 172.21.15.78:0/504523970 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v52) v1 ==== 93+0+10 (secure 0 0 0) 0x7f80b8054d80 con 0x7f80c0151280 2023-11-28T20:01:02.115 INFO:teuthology.orchestra.run.smithi078.stdout:pg_num: 1 2023-11-28T20:01:02.117 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:02.113+0000 7f80c4957640 1 -- 172.21.15.78:0/504523970 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f80a0066470 msgr2=0x7f80a0068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:01:02.117 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:02.113+0000 7f80c4957640 1 --2- 172.21.15.78:0/504523970 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f80a0066470 0x7f80a0068930 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f80c00c07a0 tx=0x7f80b0003a20 comp rx=0 tx=0).stop 2023-11-28T20:01:02.117 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:02.113+0000 7f80c4957640 1 -- 172.21.15.78:0/504523970 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f80c0151280 msgr2=0x7f80c01eced0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:01:02.117 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:02.113+0000 7f80c4957640 1 --2- 172.21.15.78:0/504523970 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f80c0151280 0x7f80c01eced0 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7f80b800d560 tx=0x7f80b800da20 comp rx=0 tx=0).stop 2023-11-28T20:01:02.117 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:02.113+0000 7f80c4957640 1 -- 172.21.15.78:0/504523970 shutdown_connections 2023-11-28T20:01:02.117 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:02.113+0000 7f80c4957640 1 --2- 172.21.15.78:0/504523970 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f80a0066470 0x7f80a0068930 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:02.117 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:02.113+0000 7f80c4957640 1 --2- 172.21.15.78:0/504523970 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f80c0151280 0x7f80c01eced0 unknown :-1 s=CLOSED pgs=584 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:02.117 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:02.113+0000 7f80c4957640 1 --2- 172.21.15.78:0/504523970 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f80c014b1e0 0x7f80c00a6370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:02.118 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:02.113+0000 7f80c4957640 1 --2- 172.21.15.78:0/504523970 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f80c00c5300 0x7f80c0145c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:02.118 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:02.113+0000 7f80c4957640 1 -- 172.21.15.78:0/504523970 >> 172.21.15.78:0/504523970 conn(0x7f80c00c59f0 msgr2=0x7f80c00c6190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:01:02.118 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:02.113+0000 7f80c4957640 1 -- 172.21.15.78:0/504523970 shutdown_connections 2023-11-28T20:01:02.118 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:02.113+0000 7f80c4957640 1 -- 172.21.15.78:0/504523970 wait complete. 2023-11-28T20:01:02.136 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_multifs_auth.TestClientsWithoutAuth.test_mount_mon_and_osd_caps_present_mds_caps_absent' 2023-11-28T20:01:02.273 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:02.269+0000 7f037ea32640 1 Processor -- start 2023-11-28T20:01:02.273 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:02.269+0000 7f037ea32640 1 -- start start 2023-11-28T20:01:02.274 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:02.269+0000 7f037ea32640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f03780af4c0 0x7f0378154f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:02.274 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:02.269+0000 7f037ea32640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f03780c67d0 0x7f03780c6c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:02.274 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:02.269+0000 7f037ea32640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f03780c4890 con 0x7f037806b9f0 2023-11-28T20:01:02.274 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:02.269+0000 7f037ea32640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0378155460 con 0x7f03780af4c0 2023-11-28T20:01:02.274 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:02.269+0000 7f037ea32640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f03780af8a0 con 0x7f03780c67d0 2023-11-28T20:01:02.274 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:02.269+0000 7f037cfcf640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f037806b9f0 0x7f0378157a90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:59312/0 (socket says 172.21.15.78:59312) 2023-11-28T20:01:02.275 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:02.269+0000 7f037cfcf640 1 -- 172.21.15.78:0/1956377222 learned_addr learned my addr 172.21.15.78:0/1956377222 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-11-28T20:01:02.277 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:02.269+0000 7f03777fe640 1 --2- 172.21.15.78:0/1956377222 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f03780c67d0 0x7f03780c6c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:02.277 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:02.269+0000 7f0377fff640 1 --2- 172.21.15.78:0/1956377222 >> v2:172.21.15.179:3300/0 conn(0x7f03780af4c0 0x7f0378154f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:02.277 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:02.269+0000 7f0376ffd640 1 -- 172.21.15.78:0/1956377222 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1781007056 0 0) 0x7f03780c4890 con 0x7f037806b9f0 2023-11-28T20:01:02.277 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:02.269+0000 7f0376ffd640 1 -- 172.21.15.78:0/1956377222 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0360003530 con 0x7f037806b9f0 2023-11-28T20:01:02.277 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:02.269+0000 7f0376ffd640 1 -- 172.21.15.78:0/1956377222 <== mon.0 v1:172.21.15.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3631148352 0 0) 0x7f0360003530 con 0x7f037806b9f0 2023-11-28T20:01:02.277 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:02.269+0000 7f0376ffd640 1 -- 172.21.15.78:0/1956377222 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f03780c67d0 msgr2=0x7f03780c6c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:01:02.277 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:02.269+0000 7f0376ffd640 1 --2- 172.21.15.78:0/1956377222 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f03780c67d0 0x7f03780c6c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:02.277 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:02.269+0000 7f0376ffd640 1 -- 172.21.15.78:0/1956377222 >> v2:172.21.15.179:3300/0 conn(0x7f03780af4c0 msgr2=0x7f0378154f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:01:02.278 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:02.269+0000 7f0376ffd640 1 --2- 172.21.15.78:0/1956377222 >> v2:172.21.15.179:3300/0 conn(0x7f03780af4c0 0x7f0378154f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:02.278 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:02.269+0000 7f0376ffd640 1 -- 172.21.15.78:0/1956377222 --> v1:172.21.15.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03780c4b30 con 0x7f037806b9f0 2023-11-28T20:01:02.278 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:02.269+0000 7f0376ffd640 1 -- 172.21.15.78:0/1956377222 <== mon.0 v1:172.21.15.78:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3326804700 0 0) 0x7f0370001a00 con 0x7f037806b9f0 2023-11-28T20:01:02.278 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:02.269+0000 7f0376ffd640 1 -- 172.21.15.78:0/1956377222 >> v1:172.21.15.78:6789/0 conn(0x7f037806b9f0 legacy=0x7f0378157a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:01:02.278 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:02.269+0000 7f0376ffd640 1 --2- 172.21.15.78:0/1956377222 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0360003980 0x7f0360003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:02.278 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:02.269+0000 7f0376ffd640 1 --2- 172.21.15.78:0/1956377222 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f03600047d0 0x7f0360004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:02.278 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:02.269+0000 7f0376ffd640 1 --2- 172.21.15.78:0/1956377222 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f03780c67d0 0x7f0360005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:02.278 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:02.269+0000 7f0376ffd640 1 -- 172.21.15.78:0/1956377222 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0378155460 con 0x7f0360003980 2023-11-28T20:01:02.279 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:02.269+0000 7f0376ffd640 1 -- 172.21.15.78:0/1956377222 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03780af8a0 con 0x7f03600047d0 2023-11-28T20:01:02.279 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:02.269+0000 7f0376ffd640 1 -- 172.21.15.78:0/1956377222 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f036000b9c0 con 0x7f03780c67d0 2023-11-28T20:01:02.279 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:02.269+0000 7f0377fff640 1 --2- 172.21.15.78:0/1956377222 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0360003980 0x7f0360003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:02.279 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:02.269+0000 7f03777fe640 1 --2- 172.21.15.78:0/1956377222 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f03600047d0 0x7f0360004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:02.279 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:02.269+0000 7f037cfcf640 1 --2- 172.21.15.78:0/1956377222 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f03780c67d0 0x7f0360005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:02.279 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:02.269+0000 7f0377fff640 1 -- 172.21.15.78:0/1956377222 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f03780c67d0 msgr2=0x7f0360005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:01:02.279 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:02.269+0000 7f0377fff640 1 --2- 172.21.15.78:0/1956377222 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f03780c67d0 0x7f0360005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:02.280 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:02.273+0000 7f0377fff640 1 -- 172.21.15.78:0/1956377222 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f03600047d0 msgr2=0x7f0360004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:01:02.280 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:02.273+0000 7f0377fff640 1 --2- 172.21.15.78:0/1956377222 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f03600047d0 0x7f0360004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:02.280 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:02.273+0000 7f0377fff640 1 -- 172.21.15.78:0/1956377222 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0360003530 con 0x7f0360003980 2023-11-28T20:01:02.281 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:02.273+0000 7f0377fff640 1 --2- 172.21.15.78:0/1956377222 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0360003980 0x7f0360003da0 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7f0368009ae0 tx=0x7f036801ca00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c336449db2cfc6c1 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:01:02.281 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:02.273+0000 7f0376ffd640 1 -- 172.21.15.78:0/1956377222 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03680a5550 con 0x7f0360003980 2023-11-28T20:01:02.281 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:02.273+0000 7f0376ffd640 1 -- 172.21.15.78:0/1956377222 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f03680a56b0 con 0x7f0360003980 2023-11-28T20:01:02.281 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:02.273+0000 7f0376ffd640 1 -- 172.21.15.78:0/1956377222 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03680a5a60 con 0x7f0360003980 2023-11-28T20:01:02.282 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:02.273+0000 7f037ea32640 1 -- 172.21.15.78:0/1956377222 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0360003980 msgr2=0x7f0360003da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:01:02.282 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:02.273+0000 7f037ea32640 1 --2- 172.21.15.78:0/1956377222 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0360003980 0x7f0360003da0 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7f0368009ae0 tx=0x7f036801ca00 comp rx=0 tx=0).stop 2023-11-28T20:01:02.282 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:02.273+0000 7f037cfcf640 1 -- 172.21.15.78:0/1956377222 reap_dead start 2023-11-28T20:01:02.282 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:02.273+0000 7f037ea32640 1 -- 172.21.15.78:0/1956377222 shutdown_connections 2023-11-28T20:01:02.282 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:02.273+0000 7f037ea32640 1 -- 172.21.15.78:0/1956377222 >> 172.21.15.78:0/1956377222 conn(0x7f03780ab9d0 msgr2=0x7f03780abde0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:01:02.282 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:02.273+0000 7f037ea32640 1 -- 172.21.15.78:0/1956377222 shutdown_connections 2023-11-28T20:01:02.282 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:02.273+0000 7f037ea32640 1 -- 172.21.15.78:0/1956377222 wait complete. 2023-11-28T20:01:02.283 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:02.277+0000 7f037ea32640 1 Processor -- start 2023-11-28T20:01:02.283 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:02.277+0000 7f037ea32640 1 -- start start 2023-11-28T20:01:02.284 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:02.277+0000 7f037ea32640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0360003980 0x7f037814bbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:02.285 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:02.277+0000 7f037ea32640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f03780ae750 0x7f037814cf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:02.285 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:02.277+0000 7f037ea32640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f037814d440 0x7f037814d970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:02.285 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:02.277+0000 7f037ea32640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03780c7bc0 con 0x7f03780ae750 2023-11-28T20:01:02.285 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:02.277+0000 7f037ea32640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f037814ed40 con 0x7f037814d440 2023-11-28T20:01:02.285 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:02.277+0000 7f037ea32640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f037814ea60 con 0x7f0360003980 2023-11-28T20:01:02.285 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:02.277+0000 7f03777fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f03780ae750 0x7f037814cf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:02.285 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:02.277+0000 7f03777fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f03780ae750 0x7f037814cf00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:40722/0 (socket says 172.21.15.78:40722) 2023-11-28T20:01:02.286 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:02.277+0000 7f03777fe640 1 -- 172.21.15.78:0/2797596478 learned_addr learned my addr 172.21.15.78:0/2797596478 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T20:01:02.286 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:02.277+0000 7f0377fff640 1 --2- 172.21.15.78:0/2797596478 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0360003980 0x7f037814bbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:02.286 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:02.277+0000 7f037cfcf640 1 --2- 172.21.15.78:0/2797596478 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f037814d440 0x7f037814d970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:02.286 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:02.277+0000 7f03777fe640 1 -- 172.21.15.78:0/2797596478 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0360003980 msgr2=0x7f037814bbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:01:02.286 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:02.277+0000 7f03777fe640 1 --2- 172.21.15.78:0/2797596478 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0360003980 0x7f037814bbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:02.287 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:02.277+0000 7f03777fe640 1 -- 172.21.15.78:0/2797596478 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f037814d440 msgr2=0x7f037814d970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:01:02.287 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:02.277+0000 7f03777fe640 1 --2- 172.21.15.78:0/2797596478 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f037814d440 0x7f037814d970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:02.287 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:02.277+0000 7f03777fe640 1 -- 172.21.15.78:0/2797596478 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03781f24a0 con 0x7f03780ae750 2023-11-28T20:01:02.287 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:02.277+0000 7f03777fe640 1 --2- 172.21.15.78:0/2797596478 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f03780ae750 0x7f037814cf00 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7f036c0115e0 tx=0x7f036c011aa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:01:02.287 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:02.277+0000 7f0374ff9640 1 -- 172.21.15.78:0/2797596478 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f036c00f8f0 con 0x7f03780ae750 2023-11-28T20:01:02.287 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:02.277+0000 7f0374ff9640 1 -- 172.21.15.78:0/2797596478 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f036c00fa50 con 0x7f03780ae750 2023-11-28T20:01:02.287 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:02.277+0000 7f0374ff9640 1 -- 172.21.15.78:0/2797596478 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f036c00fdc0 con 0x7f03780ae750 2023-11-28T20:01:02.287 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:02.277+0000 7f037ea32640 1 -- 172.21.15.78:0/2797596478 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f03781f2780 con 0x7f03780ae750 2023-11-28T20:01:02.288 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:02.281+0000 7f037ea32640 1 -- 172.21.15.78:0/2797596478 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f03780c0850 con 0x7f03780ae750 2023-11-28T20:01:02.288 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:02.281+0000 7f037ea32640 1 -- 172.21.15.78:0/2797596478 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f03781f2910 con 0x7f03780ae750 2023-11-28T20:01:02.289 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:02.281+0000 7f0374ff9640 1 -- 172.21.15.78:0/2797596478 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f036c015460 con 0x7f03780ae750 2023-11-28T20:01:02.289 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:02.281+0000 7f0374ff9640 1 --2- 172.21.15.78:0/2797596478 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f0364066470 0x7f0364068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:02.289 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:02.281+0000 7f0374ff9640 1 -- 172.21.15.78:0/2797596478 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 5349+0+0 (secure 0 0 0) 0x7f036c084060 con 0x7f03780ae750 2023-11-28T20:01:02.289 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:02.281+0000 7f0377fff640 1 --2- 172.21.15.78:0/2797596478 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f0364066470 0x7f0364068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:02.289 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:02.281+0000 7f0377fff640 1 --2- 172.21.15.78:0/2797596478 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f0364066470 0x7f0364068930 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f03680af000 tx=0x7f03680046d0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:01:02.290 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:02.285+0000 7f0374ff9640 1 -- 172.21.15.78:0/2797596478 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f036c051780 con 0x7f03780ae750 2023-11-28T20:01:02.493 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:02.489+0000 7f037ea32640 1 -- 172.21.15.78:0/2797596478 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_multifs_auth.TestClientsWithoutAuth.test_mount_mon_and_osd_caps_present_mds_caps_absent"]} v 0) v1 -- 0x7f0378067630 con 0x7f03780ae750 2023-11-28T20:01:03.461 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:03.457+0000 7f0374ff9640 1 -- 172.21.15.78:0/2797596478 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_multifs_auth.TestClientsWithoutAuth.test_mount_mon_and_osd_caps_present_mds_caps_absent"]}]=0 v134) v1 ==== 187+0+0 (secure 0 0 0) 0x7f036c054da0 con 0x7f03780ae750 2023-11-28T20:01:03.464 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:03.461+0000 7f037ea32640 1 -- 172.21.15.78:0/2797596478 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f0364066470 msgr2=0x7f0364068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:01:03.464 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:03.461+0000 7f037ea32640 1 --2- 172.21.15.78:0/2797596478 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f0364066470 0x7f0364068930 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f03680af000 tx=0x7f03680046d0 comp rx=0 tx=0).stop 2023-11-28T20:01:03.464 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:03.461+0000 7f037ea32640 1 -- 172.21.15.78:0/2797596478 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f03780ae750 msgr2=0x7f037814cf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:01:03.464 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:03.461+0000 7f037ea32640 1 --2- 172.21.15.78:0/2797596478 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f03780ae750 0x7f037814cf00 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7f036c0115e0 tx=0x7f036c011aa0 comp rx=0 tx=0).stop 2023-11-28T20:01:03.465 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:03.461+0000 7f037ea32640 1 -- 172.21.15.78:0/2797596478 shutdown_connections 2023-11-28T20:01:03.465 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:03.461+0000 7f037ea32640 1 --2- 172.21.15.78:0/2797596478 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f0364066470 0x7f0364068930 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:03.465 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:03.461+0000 7f037ea32640 1 --2- 172.21.15.78:0/2797596478 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f037814d440 0x7f037814d970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:03.465 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:03.461+0000 7f037ea32640 1 --2- 172.21.15.78:0/2797596478 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f03780ae750 0x7f037814cf00 unknown :-1 s=CLOSED pgs=587 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:03.465 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:03.461+0000 7f037ea32640 1 --2- 172.21.15.78:0/2797596478 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0360003980 0x7f037814bbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:03.465 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:03.461+0000 7f037ea32640 1 -- 172.21.15.78:0/2797596478 >> 172.21.15.78:0/2797596478 conn(0x7f03780ab9d0 msgr2=0x7f03780abde0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:01:03.465 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:03.461+0000 7f037ea32640 1 -- 172.21.15.78:0/2797596478 shutdown_connections 2023-11-28T20:01:03.465 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:03.461+0000 7f037ea32640 1 -- 172.21.15.78:0/2797596478 wait complete. 2023-11-28T20:01:03.487 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-11-28T20:01:03.632 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:03.629+0000 7fb8567df640 1 Processor -- start 2023-11-28T20:01:03.632 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:03.629+0000 7fb8567df640 1 -- start start 2023-11-28T20:01:03.634 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:03.629+0000 7fb8567df640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb8501516a0 0x7fb8500c4180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:03.634 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:03.629+0000 7fb8567df640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fb8500c46c0 0x7fb85006bc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:03.634 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:03.629+0000 7fb8567df640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb850151b20 con 0x7fb85014e2a0 2023-11-28T20:01:03.634 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:03.629+0000 7fb8567df640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb850151210 con 0x7fb8500c46c0 2023-11-28T20:01:03.634 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:03.629+0000 7fb8567df640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb85014e680 con 0x7fb8501516a0 2023-11-28T20:01:03.634 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:03.629+0000 7fb854d7c640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fb8500c46c0 0x7fb85006bc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:03.634 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:03.629+0000 7fb854d7c640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fb8500c46c0 0x7fb85006bc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:40732/0 (socket says 172.21.15.78:40732) 2023-11-28T20:01:03.634 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:03.629+0000 7fb854d7c640 1 -- 172.21.15.78:0/951249896 learned_addr learned my addr 172.21.15.78:0/951249896 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T20:01:03.635 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:03.629+0000 7fb84f7fe640 1 --2- 172.21.15.78:0/951249896 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb8501516a0 0x7fb8500c4180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:03.635 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:03.629+0000 7fb854d7c640 1 -- 172.21.15.78:0/951249896 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb8501516a0 msgr2=0x7fb8500c4180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:01:03.635 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:03.629+0000 7fb854d7c640 1 --2- 172.21.15.78:0/951249896 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb8501516a0 0x7fb8500c4180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:03.635 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:03.629+0000 7fb854d7c640 1 -- 172.21.15.78:0/951249896 >> v1:172.21.15.179:6789/0 conn(0x7fb85014e2a0 legacy=0x7fb8500a9460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:01:03.635 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:03.629+0000 7fb854d7c640 1 -- 172.21.15.78:0/951249896 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8500a9b70 con 0x7fb8500c46c0 2023-11-28T20:01:03.636 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:03.633+0000 7fb854d7c640 1 --2- 172.21.15.78:0/951249896 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb8500c46c0 0x7fb85006bc80 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7fb848009e50 tx=0x7fb84801ca10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=efc91a51389cd682 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:01:03.638 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:03.633+0000 7fb84effd640 1 -- 172.21.15.78:0/951249896 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8480a56e0 con 0x7fb8500c46c0 2023-11-28T20:01:03.639 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:03.633+0000 7fb84effd640 1 -- 172.21.15.78:0/951249896 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb8480a5840 con 0x7fb8500c46c0 2023-11-28T20:01:03.639 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:03.633+0000 7fb84effd640 1 -- 172.21.15.78:0/951249896 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8480a5bd0 con 0x7fb8500c46c0 2023-11-28T20:01:03.640 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:03.633+0000 7fb8567df640 1 -- 172.21.15.78:0/951249896 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb8500c46c0 msgr2=0x7fb85006bc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:01:03.640 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:03.633+0000 7fb8567df640 1 --2- 172.21.15.78:0/951249896 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb8500c46c0 0x7fb85006bc80 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7fb848009e50 tx=0x7fb84801ca10 comp rx=0 tx=0).stop 2023-11-28T20:01:03.640 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:03.633+0000 7fb8567df640 1 -- 172.21.15.78:0/951249896 shutdown_connections 2023-11-28T20:01:03.640 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:03.633+0000 7fb8567df640 1 --2- 172.21.15.78:0/951249896 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb8500c46c0 0x7fb85006bc80 unknown :-1 s=CLOSED pgs=588 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:03.641 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:03.633+0000 7fb8567df640 1 --2- 172.21.15.78:0/951249896 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb8501516a0 0x7fb8500c4180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:03.641 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:03.633+0000 7fb8567df640 1 -- 172.21.15.78:0/951249896 >> 172.21.15.78:0/951249896 conn(0x7fb8500c59f0 msgr2=0x7fb8500c5e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:01:03.641 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:03.633+0000 7fb8567df640 1 -- 172.21.15.78:0/951249896 shutdown_connections 2023-11-28T20:01:03.641 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:03.633+0000 7fb8567df640 1 -- 172.21.15.78:0/951249896 wait complete. 2023-11-28T20:01:03.643 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:03.633+0000 7fb8567df640 1 Processor -- start 2023-11-28T20:01:03.643 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:03.637+0000 7fb8567df640 1 -- start start 2023-11-28T20:01:03.644 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:03.637+0000 7fb8567df640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb8500c46c0 0x7fb850071640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:03.644 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:03.637+0000 7fb8567df640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb85014e2a0 0x7fb85014cc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:03.644 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:03.637+0000 7fb8567df640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb8501516a0 0x7fb8501525d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:03.644 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:03.637+0000 7fb8567df640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb850071b80 con 0x7fb8501516a0 2023-11-28T20:01:03.644 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:03.637+0000 7fb8567df640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb850070bf0 con 0x7fb8500c46c0 2023-11-28T20:01:03.644 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:03.637+0000 7fb8567df640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8500a7060 con 0x7fb85014e2a0 2023-11-28T20:01:03.644 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:03.637+0000 7fb854d7c640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb8501516a0 0x7fb8501525d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:03.644 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:03.637+0000 7fb854d7c640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb8501516a0 0x7fb8501525d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:40748/0 (socket says 172.21.15.78:40748) 2023-11-28T20:01:03.644 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:03.637+0000 7fb854d7c640 1 -- 172.21.15.78:0/1907514984 learned_addr learned my addr 172.21.15.78:0/1907514984 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T20:01:03.644 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:03.637+0000 7fb84ffff640 1 --2- 172.21.15.78:0/1907514984 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb8500c46c0 0x7fb850071640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:03.645 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:03.637+0000 7fb84f7fe640 1 --2- 172.21.15.78:0/1907514984 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb85014e2a0 0x7fb85014cc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:03.645 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:03.637+0000 7fb854d7c640 1 -- 172.21.15.78:0/1907514984 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb85014e2a0 msgr2=0x7fb85014cc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:01:03.645 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:03.637+0000 7fb854d7c640 1 --2- 172.21.15.78:0/1907514984 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb85014e2a0 0x7fb85014cc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:03.645 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:03.637+0000 7fb854d7c640 1 -- 172.21.15.78:0/1907514984 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb8500c46c0 msgr2=0x7fb850071640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:01:03.645 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:03.637+0000 7fb854d7c640 1 --2- 172.21.15.78:0/1907514984 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb8500c46c0 0x7fb850071640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:03.645 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:03.637+0000 7fb854d7c640 1 -- 172.21.15.78:0/1907514984 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb848009b30 con 0x7fb8501516a0 2023-11-28T20:01:03.645 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:03.637+0000 7fb854d7c640 1 --2- 172.21.15.78:0/1907514984 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb8501516a0 0x7fb8501525d0 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7fb8480af040 tx=0x7fb8480197b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:01:03.645 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:03.637+0000 7fb84cff9640 1 -- 172.21.15.78:0/1907514984 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8480b8880 con 0x7fb8501516a0 2023-11-28T20:01:03.645 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:03.637+0000 7fb84cff9640 1 -- 172.21.15.78:0/1907514984 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb8480b89e0 con 0x7fb8501516a0 2023-11-28T20:01:03.645 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:03.637+0000 7fb84cff9640 1 -- 172.21.15.78:0/1907514984 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8480b8d70 con 0x7fb8501516a0 2023-11-28T20:01:03.645 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:03.637+0000 7fb8567df640 1 -- 172.21.15.78:0/1907514984 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb8500a7300 con 0x7fb8501516a0 2023-11-28T20:01:03.646 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:03.637+0000 7fb8567df640 1 -- 172.21.15.78:0/1907514984 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb850071120 con 0x7fb8501516a0 2023-11-28T20:01:03.646 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:03.637+0000 7fb8567df640 1 -- 172.21.15.78:0/1907514984 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb8500a7490 con 0x7fb8501516a0 2023-11-28T20:01:03.646 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:03.641+0000 7fb84cff9640 1 -- 172.21.15.78:0/1907514984 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fb8480b6440 con 0x7fb8501516a0 2023-11-28T20:01:03.647 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:03.641+0000 7fb84cff9640 1 --2- 172.21.15.78:0/1907514984 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fb83c066470 0x7fb83c068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:03.647 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:03.641+0000 7fb84cff9640 1 -- 172.21.15.78:0/1907514984 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 5349+0+0 (secure 0 0 0) 0x7fb84811f330 con 0x7fb8501516a0 2023-11-28T20:01:03.647 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:03.641+0000 7fb84ffff640 1 --2- 172.21.15.78:0/1907514984 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fb83c066470 0x7fb83c068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:03.647 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:03.641+0000 7fb84ffff640 1 --2- 172.21.15.78:0/1907514984 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fb83c066470 0x7fb83c068930 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7fb8500ab570 tx=0x7fb840009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:01:03.648 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:03.645+0000 7fb84cff9640 1 -- 172.21.15.78:0/1907514984 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fb8480ecad0 con 0x7fb8501516a0 2023-11-28T20:01:03.799 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:03.793+0000 7fb8567df640 1 -- 172.21.15.78:0/1907514984 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7fb850067630 con 0x7fb8501516a0 2023-11-28T20:01:03.805 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:03.801+0000 7fb84cff9640 1 -- 172.21.15.78:0/1907514984 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v12)=0 v12) v1 ==== 122+0+0 (secure 0 0 0) 0x7fb848009510 con 0x7fb8501516a0 2023-11-28T20:01:03.808 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:03.801+0000 7fb8567df640 1 -- 172.21.15.78:0/1907514984 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fb83c066470 msgr2=0x7fb83c068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:01:03.808 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:03.801+0000 7fb8567df640 1 --2- 172.21.15.78:0/1907514984 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fb83c066470 0x7fb83c068930 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7fb8500ab570 tx=0x7fb840009040 comp rx=0 tx=0).stop 2023-11-28T20:01:03.808 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:03.801+0000 7fb8567df640 1 -- 172.21.15.78:0/1907514984 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb8501516a0 msgr2=0x7fb8501525d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:01:03.808 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:03.801+0000 7fb8567df640 1 --2- 172.21.15.78:0/1907514984 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb8501516a0 0x7fb8501525d0 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7fb8480af040 tx=0x7fb8480197b0 comp rx=0 tx=0).stop 2023-11-28T20:01:03.808 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:03.805+0000 7fb8567df640 1 -- 172.21.15.78:0/1907514984 shutdown_connections 2023-11-28T20:01:03.808 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:03.805+0000 7fb8567df640 1 --2- 172.21.15.78:0/1907514984 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fb83c066470 0x7fb83c068930 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:03.808 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:03.805+0000 7fb8567df640 1 --2- 172.21.15.78:0/1907514984 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb85014e2a0 0x7fb85014cc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:03.809 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:03.805+0000 7fb8567df640 1 --2- 172.21.15.78:0/1907514984 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb8501516a0 0x7fb8501525d0 unknown :-1 s=CLOSED pgs=589 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:03.809 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:03.805+0000 7fb8567df640 1 --2- 172.21.15.78:0/1907514984 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb8500c46c0 0x7fb850071640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:03.809 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:03.805+0000 7fb8567df640 1 -- 172.21.15.78:0/1907514984 >> 172.21.15.78:0/1907514984 conn(0x7fb8500c59f0 msgr2=0x7fb85006c910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:01:03.809 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:03.805+0000 7fb8567df640 1 -- 172.21.15.78:0/1907514984 shutdown_connections 2023-11-28T20:01:03.809 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:03.805+0000 7fb8567df640 1 -- 172.21.15.78:0/1907514984 wait complete. 2023-11-28T20:01:03.827 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-11-28T20:01:03.827 DEBUG:teuthology.orchestra.run.smithi078:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-11-28T20:01:03.907 DEBUG:teuthology.orchestra.run.smithi179:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-11-28T20:01:03.992 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-11-28T20:01:03.992 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2023-11-28T20:01:03.992 DEBUG:teuthology.orchestra.run.smithi078:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-28T20:01:04.001 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354608k,nr_inodes=4088652,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275372k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=5526 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275368k,nr_inodes=818842,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275372k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 2023-11-28T20:01:04.001 DEBUG:teuthology.orchestra.run.smithi179:> set -ex 2023-11-28T20:01:04.001 DEBUG:teuthology.orchestra.run.smithi179:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-28T20:01:04.011 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354628k,nr_inodes=4088657,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275376k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=3817 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275372k,nr_inodes=818843,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275376k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 2023-11-28T20:01:04.011 INFO:tasks.cephfs.cephfs_test_case:[, ] 2023-11-28T20:01:04.011 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-28T20:01:04.183 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:04.177+0000 7f9879e32640 1 Processor -- start 2023-11-28T20:01:04.184 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:04.177+0000 7f9879e32640 1 -- start start 2023-11-28T20:01:04.185 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:04.181+0000 7f9879e32640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f987406d2b0 0x7f987406d690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:04.186 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:04.181+0000 7f9879e32640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f98740c3b80 0x7f98740c5300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:04.186 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:04.181+0000 7f9879e32640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f987406bb80 con 0x7f987406c020 2023-11-28T20:01:04.186 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:04.181+0000 7f9879e32640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f98740c5840 con 0x7f98740c3b80 2023-11-28T20:01:04.186 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:04.181+0000 7f9879e32640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f98741515c0 con 0x7f987406d2b0 2023-11-28T20:01:04.187 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:04.181+0000 7f9872ffd640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f98740c3b80 0x7f98740c5300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:04.187 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:04.181+0000 7f9872ffd640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f98740c3b80 0x7f98740c5300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:40764/0 (socket says 172.21.15.78:40764) 2023-11-28T20:01:04.187 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:04.181+0000 7f9872ffd640 1 -- 172.21.15.78:0/687704118 learned_addr learned my addr 172.21.15.78:0/687704118 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T20:01:04.187 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:04.181+0000 7f98737fe640 1 --2- 172.21.15.78:0/687704118 >> v2:172.21.15.179:3300/0 conn(0x7f987406d2b0 0x7f987406d690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:04.187 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:04.181+0000 7f9872ffd640 1 -- 172.21.15.78:0/687704118 >> v2:172.21.15.179:3300/0 conn(0x7f987406d2b0 msgr2=0x7f987406d690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:01:04.187 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:04.181+0000 7f9872ffd640 1 --2- 172.21.15.78:0/687704118 >> v2:172.21.15.179:3300/0 conn(0x7f987406d2b0 0x7f987406d690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:04.188 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:04.181+0000 7f9872ffd640 1 -- 172.21.15.78:0/687704118 >> v1:172.21.15.179:6789/0 conn(0x7f987406c020 legacy=0x7f987406c4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:01:04.188 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:04.181+0000 7f9872ffd640 1 -- 172.21.15.78:0/687704118 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98741518a0 con 0x7f98740c3b80 2023-11-28T20:01:04.189 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:04.185+0000 7f9872ffd640 1 --2- 172.21.15.78:0/687704118 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f98740c3b80 0x7f98740c5300 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7f98740c2130 tx=0x7f986801eb60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a1efa815f24c4a02 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:01:04.189 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:04.185+0000 7f98727fc640 1 -- 172.21.15.78:0/687704118 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98680a7b30 con 0x7f98740c3b80 2023-11-28T20:01:04.190 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:04.185+0000 7f98727fc640 1 -- 172.21.15.78:0/687704118 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f98680a7c90 con 0x7f98740c3b80 2023-11-28T20:01:04.190 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:04.185+0000 7f98727fc640 1 -- 172.21.15.78:0/687704118 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98680af440 con 0x7f98740c3b80 2023-11-28T20:01:04.190 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:04.185+0000 7f9879e32640 1 -- 172.21.15.78:0/687704118 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f98740c3b80 msgr2=0x7f98740c5300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:01:04.190 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:04.185+0000 7f9879e32640 1 --2- 172.21.15.78:0/687704118 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f98740c3b80 0x7f98740c5300 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7f98740c2130 tx=0x7f986801eb60 comp rx=0 tx=0).stop 2023-11-28T20:01:04.190 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:04.185+0000 7f9879e32640 1 -- 172.21.15.78:0/687704118 shutdown_connections 2023-11-28T20:01:04.191 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:04.185+0000 7f9879e32640 1 --2- 172.21.15.78:0/687704118 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f98740c3b80 0x7f98740c5300 unknown :-1 s=CLOSED pgs=590 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:04.191 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:04.185+0000 7f9879e32640 1 --2- 172.21.15.78:0/687704118 >> v2:172.21.15.179:3300/0 conn(0x7f987406d2b0 0x7f987406d690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:04.191 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:04.185+0000 7f9879e32640 1 -- 172.21.15.78:0/687704118 >> 172.21.15.78:0/687704118 conn(0x7f98740a7810 msgr2=0x7f98740a7c20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:01:04.191 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:04.185+0000 7f9879e32640 1 -- 172.21.15.78:0/687704118 shutdown_connections 2023-11-28T20:01:04.191 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:04.185+0000 7f9879e32640 1 -- 172.21.15.78:0/687704118 wait complete. 2023-11-28T20:01:04.195 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:04.185+0000 7f9879e32640 1 Processor -- start 2023-11-28T20:01:04.195 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:04.185+0000 7f9879e32640 1 -- start start 2023-11-28T20:01:04.195 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:04.189+0000 7f9879e32640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f987406c020 0x7f987414ffd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:04.195 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:04.189+0000 7f9879e32640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f987406d2b0 0x7f98740a9cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:04.196 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:04.189+0000 7f9879e32640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f98740c3b80 0x7f98740aa230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:04.196 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:04.189+0000 7f9879e32640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98741f0910 con 0x7f98740c3b80 2023-11-28T20:01:04.196 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:04.189+0000 7f9879e32640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9874155d20 con 0x7f987406c020 2023-11-28T20:01:04.196 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:04.189+0000 7f9879e32640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9874156000 con 0x7f987406d2b0 2023-11-28T20:01:04.196 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:04.189+0000 7f9873fff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f98740c3b80 0x7f98740aa230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:04.196 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:04.189+0000 7f9873fff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f98740c3b80 0x7f98740aa230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:40770/0 (socket says 172.21.15.78:40770) 2023-11-28T20:01:04.196 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:04.189+0000 7f9873fff640 1 -- 172.21.15.78:0/2362635593 learned_addr learned my addr 172.21.15.78:0/2362635593 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T20:01:04.196 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:04.189+0000 7f98737fe640 1 --2- 172.21.15.78:0/2362635593 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f987406c020 0x7f987414ffd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:04.196 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:04.189+0000 7f9872ffd640 1 --2- 172.21.15.78:0/2362635593 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f987406d2b0 0x7f98740a9cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:04.196 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:04.189+0000 7f9873fff640 1 -- 172.21.15.78:0/2362635593 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f987406d2b0 msgr2=0x7f98740a9cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:01:04.196 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:04.189+0000 7f9873fff640 1 --2- 172.21.15.78:0/2362635593 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f987406d2b0 0x7f98740a9cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:04.197 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:04.189+0000 7f9873fff640 1 -- 172.21.15.78:0/2362635593 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f987406c020 msgr2=0x7f987414ffd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:01:04.197 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:04.189+0000 7f9873fff640 1 --2- 172.21.15.78:0/2362635593 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f987406c020 0x7f987414ffd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:04.197 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:04.189+0000 7f9873fff640 1 -- 172.21.15.78:0/2362635593 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f986800b770 con 0x7f98740c3b80 2023-11-28T20:01:04.197 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:04.189+0000 7f9873fff640 1 --2- 172.21.15.78:0/2362635593 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f98740c3b80 0x7f98740aa230 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7f986c00c780 tx=0x7f986c00cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:01:04.197 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:04.189+0000 7f985bfff640 1 -- 172.21.15.78:0/2362635593 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f986c004b20 con 0x7f98740c3b80 2023-11-28T20:01:04.197 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:04.189+0000 7f985bfff640 1 -- 172.21.15.78:0/2362635593 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f986c004c80 con 0x7f98740c3b80 2023-11-28T20:01:04.197 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:04.189+0000 7f985bfff640 1 -- 172.21.15.78:0/2362635593 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f986c00aa90 con 0x7f98740c3b80 2023-11-28T20:01:04.197 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:04.189+0000 7f9879e32640 1 -- 172.21.15.78:0/2362635593 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f987414ef80 con 0x7f98740c3b80 2023-11-28T20:01:04.197 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:04.189+0000 7f9879e32640 1 -- 172.21.15.78:0/2362635593 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f98741f02c0 con 0x7f98740c3b80 2023-11-28T20:01:04.197 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:04.189+0000 7f9879e32640 1 -- 172.21.15.78:0/2362635593 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f98741f0120 con 0x7f98740c3b80 2023-11-28T20:01:04.197 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:04.189+0000 7f985bfff640 1 -- 172.21.15.78:0/2362635593 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f986c00abf0 con 0x7f98740c3b80 2023-11-28T20:01:04.199 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:04.193+0000 7f985bfff640 1 --2- 172.21.15.78:0/2362635593 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f9860066470 0x7f9860068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:04.199 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:04.193+0000 7f985bfff640 1 -- 172.21.15.78:0/2362635593 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 5349+0+0 (secure 0 0 0) 0x7f986c083c40 con 0x7f98740c3b80 2023-11-28T20:01:04.199 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:04.193+0000 7f98737fe640 1 --2- 172.21.15.78:0/2362635593 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f9860066470 0x7f9860068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:04.199 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:04.193+0000 7f98737fe640 1 --2- 172.21.15.78:0/2362635593 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f9860066470 0x7f9860068930 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f987415b560 tx=0x7f9864008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:01:04.200 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:04.197+0000 7f985bfff640 1 -- 172.21.15.78:0/2362635593 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f98741f0120 con 0x7f98740c3b80 2023-11-28T20:01:04.298 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T20:01:04.301 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T20:01:04.381 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:04.377+0000 7f9879e32640 1 -- 172.21.15.78:0/2362635593 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f98741f0120 con 0x7f98740c3b80 2023-11-28T20:01:04.382 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:04.377+0000 7f985bfff640 1 -- 172.21.15.78:0/2362635593 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) v1 ==== 94+0+3696 (secure 0 0 0) 0x7f98741f0120 con 0x7f98740c3b80 2023-11-28T20:01:04.382 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-11-28T20:01:04.383 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":26,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4880,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6835/20894428","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6834","nonce":20894428},{"type":"v1","addr":"172.21.15.179:6835","nonce":20894428}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":4886,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6837/666703170","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6835","nonce":666703170},{"type":"v1","addr":"172.21.15.78:6837","nonce":666703170}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":5691,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6836/2246548406","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6834","nonce":2246548406},{"type":"v1","addr":"172.21.15.78:6836","nonce":2246548406}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":24},{"gid":5790,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6833/4030567526","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6832","nonce":4030567526},{"type":"v1","addr":"172.21.15.179:6833","nonce":4030567526}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":26}],"filesystems":[]} 2023-11-28T20:01:04.383 INFO:teuthology.orchestra.run.smithi078.stderr:dumped fsmap epoch 26 2023-11-28T20:01:04.384 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:04.381+0000 7f9879e32640 1 -- 172.21.15.78:0/2362635593 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f9860066470 msgr2=0x7f9860068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:01:04.384 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:04.381+0000 7f9879e32640 1 --2- 172.21.15.78:0/2362635593 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f9860066470 0x7f9860068930 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f987415b560 tx=0x7f9864008040 comp rx=0 tx=0).stop 2023-11-28T20:01:04.385 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:04.381+0000 7f9879e32640 1 -- 172.21.15.78:0/2362635593 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f98740c3b80 msgr2=0x7f98740aa230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:01:04.385 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:04.381+0000 7f9879e32640 1 --2- 172.21.15.78:0/2362635593 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f98740c3b80 0x7f98740aa230 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7f986c00c780 tx=0x7f986c00cc40 comp rx=0 tx=0).stop 2023-11-28T20:01:04.385 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:04.381+0000 7f9879e32640 1 -- 172.21.15.78:0/2362635593 shutdown_connections 2023-11-28T20:01:04.385 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:04.381+0000 7f9879e32640 1 --2- 172.21.15.78:0/2362635593 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f9860066470 0x7f9860068930 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:04.385 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:04.381+0000 7f9879e32640 1 --2- 172.21.15.78:0/2362635593 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f987406d2b0 0x7f98740a9cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:04.386 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:04.381+0000 7f9879e32640 1 --2- 172.21.15.78:0/2362635593 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f98740c3b80 0x7f98740aa230 unknown :-1 s=CLOSED pgs=591 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:04.386 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:04.381+0000 7f9879e32640 1 --2- 172.21.15.78:0/2362635593 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f987406c020 0x7f987414ffd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:04.386 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:04.381+0000 7f9879e32640 1 -- 172.21.15.78:0/2362635593 >> 172.21.15.78:0/2362635593 conn(0x7f98740a7810 msgr2=0x7f98740c0360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:01:04.386 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:04.381+0000 7f9879e32640 1 -- 172.21.15.78:0/2362635593 shutdown_connections 2023-11-28T20:01:04.386 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:04.381+0000 7f9879e32640 1 -- 172.21.15.78:0/2362635593 wait complete. 2023-11-28T20:01:04.403 INFO:tasks.ceph.mds.a:Restarting daemon 2023-11-28T20:01:04.404 INFO:tasks.ceph.mds.a:Stopping old one... 2023-11-28T20:01:04.404 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-11-28T20:01:04.404 INFO:teuthology.orchestra.run:waiting for 300 2023-11-28T20:01:04.404 INFO:tasks.ceph.mds.c:Restarting daemon 2023-11-28T20:01:04.405 INFO:tasks.ceph.mds.c:Stopping old one... 2023-11-28T20:01:04.405 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-11-28T20:01:04.405 INFO:teuthology.orchestra.run:waiting for 300 2023-11-28T20:01:04.405 INFO:tasks.ceph.mds.b:Restarting daemon 2023-11-28T20:01:04.406 INFO:tasks.ceph.mds.b:Stopping old one... 2023-11-28T20:01:04.406 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-11-28T20:01:04.406 INFO:teuthology.orchestra.run:waiting for 300 2023-11-28T20:01:04.406 INFO:tasks.ceph.mds.d:Restarting daemon 2023-11-28T20:01:04.407 INFO:tasks.ceph.mds.d:Stopping old one... 2023-11-28T20:01:04.407 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-11-28T20:01:04.407 INFO:teuthology.orchestra.run:waiting for 300 2023-11-28T20:01:04.421 INFO:tasks.ceph.mds.b:Stopped 2023-11-28T20:01:04.421 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-11-28T20:01:04.422 INFO:tasks.ceph.mds.d:Stopped 2023-11-28T20:01:04.422 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-11-28T20:01:04.455 INFO:tasks.ceph.mds.c:Stopped 2023-11-28T20:01:04.456 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-11-28T20:01:04.456 INFO:tasks.ceph.mds.a:Stopped 2023-11-28T20:01:04.457 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-11-28T20:01:04.472 INFO:tasks.ceph.mds.b:Started 2023-11-28T20:01:04.472 DEBUG:teuthology.parallel:result is None 2023-11-28T20:01:04.474 INFO:tasks.ceph.mds.d:Started 2023-11-28T20:01:04.474 DEBUG:teuthology.parallel:result is None 2023-11-28T20:01:04.507 INFO:tasks.ceph.mds.c:Started 2023-11-28T20:01:04.507 DEBUG:teuthology.parallel:result is None 2023-11-28T20:01:04.509 INFO:tasks.ceph.mds.a:Started 2023-11-28T20:01:04.509 DEBUG:teuthology.parallel:result is None 2023-11-28T20:01:04.509 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-11-28T20:01:04.565 INFO:tasks.ceph.mds.b.smithi179.stdout:starting mds.b at 2023-11-28T20:01:04.566 INFO:tasks.ceph.mds.d.smithi179.stdout:starting mds.d at 2023-11-28T20:01:04.594 INFO:tasks.ceph.mds.c.smithi078.stdout:starting mds.c at 2023-11-28T20:01:04.597 INFO:tasks.ceph.mds.a.smithi078.stdout:starting mds.a at 2023-11-28T20:01:04.656 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:04.653+0000 7f71bf9c4640 1 Processor -- start 2023-11-28T20:01:04.657 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:04.653+0000 7f71bf9c4640 1 -- start start 2023-11-28T20:01:04.659 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:04.653+0000 7f71bf9c4640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f71b80a4f90 0x7f71b80c59c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:04.659 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:04.653+0000 7f71bf9c4640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f71b80a5370 0x7f71b814f870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:04.659 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:04.653+0000 7f71bf9c4640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f71b8072810 0x7f71b814fdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:04.659 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:04.653+0000 7f71bf9c4640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f71b81524b0 con 0x7f71b8072810 2023-11-28T20:01:04.659 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:04.653+0000 7f71bf9c4640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f71b80c62f0 con 0x7f71b80a4f90 2023-11-28T20:01:04.660 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:04.653+0000 7f71bf9c4640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71b8152770 con 0x7f71b80a5370 2023-11-28T20:01:04.660 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:04.653+0000 7f71bdf61640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f71b8072810 0x7f71b814fdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:04.660 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:04.653+0000 7f71bdf61640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f71b8072810 0x7f71b814fdb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:40818/0 (socket says 172.21.15.78:40818) 2023-11-28T20:01:04.660 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:04.653+0000 7f71bdf61640 1 -- 172.21.15.78:0/1310289497 learned_addr learned my addr 172.21.15.78:0/1310289497 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T20:01:04.660 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:04.653+0000 7f71bd760640 1 --2- 172.21.15.78:0/1310289497 >> v2:172.21.15.179:3300/0 conn(0x7f71b80a4f90 0x7f71b80c59c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:04.660 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:04.653+0000 7f71bcf5f640 1 --2- 172.21.15.78:0/1310289497 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f71b80a5370 0x7f71b814f870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:04.660 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:04.653+0000 7f71bdf61640 1 -- 172.21.15.78:0/1310289497 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f71b80a5370 msgr2=0x7f71b814f870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:01:04.660 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:04.653+0000 7f71bdf61640 1 --2- 172.21.15.78:0/1310289497 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f71b80a5370 0x7f71b814f870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:04.661 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:04.653+0000 7f71bdf61640 1 -- 172.21.15.78:0/1310289497 >> v2:172.21.15.179:3300/0 conn(0x7f71b80a4f90 msgr2=0x7f71b80c59c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:01:04.661 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:04.653+0000 7f71bdf61640 1 --2- 172.21.15.78:0/1310289497 >> v2:172.21.15.179:3300/0 conn(0x7f71b80a4f90 0x7f71b80c59c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:04.661 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:04.653+0000 7f71bdf61640 1 -- 172.21.15.78:0/1310289497 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71b8152a50 con 0x7f71b8072810 2023-11-28T20:01:04.661 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:04.653+0000 7f71bd760640 1 --2- 172.21.15.78:0/1310289497 >> v2:172.21.15.179:3300/0 conn(0x7f71b80a4f90 0x7f71b80c59c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T20:01:04.663 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:04.657+0000 7f71bdf61640 1 --2- 172.21.15.78:0/1310289497 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f71b8072810 0x7f71b814fdb0 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7f71b80ab050 tx=0x7f71b001c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9d824d6235463315 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:01:04.663 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:04.657+0000 7f71affff640 1 -- 172.21.15.78:0/1310289497 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71b00a55c0 con 0x7f71b8072810 2023-11-28T20:01:04.663 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:04.657+0000 7f71affff640 1 -- 172.21.15.78:0/1310289497 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f71b00a5720 con 0x7f71b8072810 2023-11-28T20:01:04.663 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:04.657+0000 7f71affff640 1 -- 172.21.15.78:0/1310289497 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71b00a5ab0 con 0x7f71b8072810 2023-11-28T20:01:04.663 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:04.657+0000 7f71bf9c4640 1 -- 172.21.15.78:0/1310289497 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f71b8072810 msgr2=0x7f71b814fdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:01:04.664 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:04.657+0000 7f71bf9c4640 1 --2- 172.21.15.78:0/1310289497 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f71b8072810 0x7f71b814fdb0 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7f71b80ab050 tx=0x7f71b001c940 comp rx=0 tx=0).stop 2023-11-28T20:01:04.664 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:04.657+0000 7f71bf9c4640 1 -- 172.21.15.78:0/1310289497 shutdown_connections 2023-11-28T20:01:04.664 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:04.657+0000 7f71bf9c4640 1 --2- 172.21.15.78:0/1310289497 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f71b8072810 0x7f71b814fdb0 unknown :-1 s=CLOSED pgs=599 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:04.664 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:04.657+0000 7f71bf9c4640 1 --2- 172.21.15.78:0/1310289497 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f71b80a5370 0x7f71b814f870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:04.664 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:04.657+0000 7f71bf9c4640 1 --2- 172.21.15.78:0/1310289497 >> v2:172.21.15.179:3300/0 conn(0x7f71b80a4f90 0x7f71b80c59c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:04.664 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:04.657+0000 7f71bf9c4640 1 -- 172.21.15.78:0/1310289497 >> 172.21.15.78:0/1310289497 conn(0x7f71b806b220 msgr2=0x7f71b80a77e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:01:04.664 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:04.657+0000 7f71bf9c4640 1 -- 172.21.15.78:0/1310289497 shutdown_connections 2023-11-28T20:01:04.664 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:04.657+0000 7f71bf9c4640 1 -- 172.21.15.78:0/1310289497 wait complete. 2023-11-28T20:01:04.667 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:04.661+0000 7f71bf9c4640 1 Processor -- start 2023-11-28T20:01:04.667 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:04.661+0000 7f71bf9c4640 1 -- start start 2023-11-28T20:01:04.667 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:04.661+0000 7f71bf9c4640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f71b8072810 0x7f71b81f0430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:04.667 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:04.661+0000 7f71bf9c4640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f71b80a4f90 0x7f71b80c2cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:04.667 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:04.661+0000 7f71bf9c4640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f71b80a5370 0x7f71b80a8db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:04.668 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:04.661+0000 7f71bf9c4640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71b80705a0 con 0x7f71b8072810 2023-11-28T20:01:04.668 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:04.661+0000 7f71bf9c4640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71b806fc00 con 0x7f71b80a5370 2023-11-28T20:01:04.668 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:04.661+0000 7f71bf9c4640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71b81ed920 con 0x7f71b80a4f90 2023-11-28T20:01:04.668 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:04.661+0000 7f71bd760640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f71b8072810 0x7f71b81f0430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:04.668 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:04.661+0000 7f71bd760640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f71b8072810 0x7f71b81f0430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:40826/0 (socket says 172.21.15.78:40826) 2023-11-28T20:01:04.668 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:04.661+0000 7f71bd760640 1 -- 172.21.15.78:0/427775353 learned_addr learned my addr 172.21.15.78:0/427775353 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T20:01:04.668 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:04.661+0000 7f71bcf5f640 1 --2- 172.21.15.78:0/427775353 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f71b80a4f90 0x7f71b80c2cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:04.669 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:04.661+0000 7f71bdf61640 1 --2- 172.21.15.78:0/427775353 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f71b80a5370 0x7f71b80a8db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:04.669 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:04.661+0000 7f71bd760640 1 -- 172.21.15.78:0/427775353 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f71b80a4f90 msgr2=0x7f71b80c2cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:01:04.669 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:04.661+0000 7f71bd760640 1 --2- 172.21.15.78:0/427775353 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f71b80a4f90 0x7f71b80c2cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:04.669 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:04.661+0000 7f71bd760640 1 -- 172.21.15.78:0/427775353 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f71b80a5370 msgr2=0x7f71b80a8db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:01:04.669 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:04.661+0000 7f71bd760640 1 --2- 172.21.15.78:0/427775353 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f71b80a5370 0x7f71b80a8db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:04.669 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:04.661+0000 7f71bd760640 1 -- 172.21.15.78:0/427775353 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71b0009b30 con 0x7f71b8072810 2023-11-28T20:01:04.669 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:04.661+0000 7f71bd760640 1 --2- 172.21.15.78:0/427775353 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f71b8072810 0x7f71b81f0430 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7f71b400e870 tx=0x7f71b400ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:01:04.669 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:04.661+0000 7f71adffb640 1 -- 172.21.15.78:0/427775353 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71b400c8d0 con 0x7f71b8072810 2023-11-28T20:01:04.670 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:04.661+0000 7f71adffb640 1 -- 172.21.15.78:0/427775353 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f71b400ca30 con 0x7f71b8072810 2023-11-28T20:01:04.670 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:04.661+0000 7f71bf9c4640 1 -- 172.21.15.78:0/427775353 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f71b81edc00 con 0x7f71b8072810 2023-11-28T20:01:04.670 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:04.661+0000 7f71adffb640 1 -- 172.21.15.78:0/427775353 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71b400cde0 con 0x7f71b8072810 2023-11-28T20:01:04.670 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:04.661+0000 7f71bf9c4640 1 -- 172.21.15.78:0/427775353 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f71b806fe50 con 0x7f71b8072810 2023-11-28T20:01:04.670 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:04.661+0000 7f71bf9c4640 1 -- 172.21.15.78:0/427775353 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f71b8070040 con 0x7f71b8072810 2023-11-28T20:01:04.671 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:04.665+0000 7f71adffb640 1 -- 172.21.15.78:0/427775353 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f71b4013410 con 0x7f71b8072810 2023-11-28T20:01:04.671 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:04.665+0000 7f71adffb640 1 --2- 172.21.15.78:0/427775353 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f719c066470 0x7f719c068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:04.671 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:04.665+0000 7f71adffb640 1 -- 172.21.15.78:0/427775353 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 5349+0+0 (secure 0 0 0) 0x7f71b4083a30 con 0x7f71b8072810 2023-11-28T20:01:04.671 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:04.665+0000 7f71bcf5f640 1 --2- 172.21.15.78:0/427775353 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f719c066470 0x7f719c068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:04.672 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:04.665+0000 7f71bcf5f640 1 --2- 172.21.15.78:0/427775353 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f719c066470 0x7f719c068930 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f71b8151ef0 tx=0x7f71a8008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:01:04.673 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:04.669+0000 7f71adffb640 1 -- 172.21.15.78:0/427775353 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f71b4051150 con 0x7f71b8072810 2023-11-28T20:01:04.838 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:04.833+0000 7f71bf9c4640 1 -- 172.21.15.78:0/427775353 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f71b8067630 con 0x7f71b8072810 2023-11-28T20:01:05.834 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:05.829+0000 7f71adffb640 1 -- 172.21.15.78:0/427775353 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v57) v1 ==== 97+0+0 (secure 0 0 0) 0x7f71b4054770 con 0x7f71b8072810 2023-11-28T20:01:05.834 INFO:teuthology.orchestra.run.smithi078.stderr: removed all blocklist entries 2023-11-28T20:01:05.836 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:05.833+0000 7f71bf9c4640 1 -- 172.21.15.78:0/427775353 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f719c066470 msgr2=0x7f719c068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:01:05.837 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:05.833+0000 7f71bf9c4640 1 --2- 172.21.15.78:0/427775353 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f719c066470 0x7f719c068930 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f71b8151ef0 tx=0x7f71a8008040 comp rx=0 tx=0).stop 2023-11-28T20:01:05.837 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:05.833+0000 7f71bf9c4640 1 -- 172.21.15.78:0/427775353 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f71b8072810 msgr2=0x7f71b81f0430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:01:05.837 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:05.833+0000 7f71bf9c4640 1 --2- 172.21.15.78:0/427775353 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f71b8072810 0x7f71b81f0430 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7f71b400e870 tx=0x7f71b400ed30 comp rx=0 tx=0).stop 2023-11-28T20:01:05.837 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:05.833+0000 7f71bf9c4640 1 -- 172.21.15.78:0/427775353 shutdown_connections 2023-11-28T20:01:05.837 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:05.833+0000 7f71bf9c4640 1 --2- 172.21.15.78:0/427775353 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f719c066470 0x7f719c068930 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:05.837 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:05.833+0000 7f71bf9c4640 1 --2- 172.21.15.78:0/427775353 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f71b80a4f90 0x7f71b80c2cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:05.837 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:05.833+0000 7f71bf9c4640 1 --2- 172.21.15.78:0/427775353 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f71b80a5370 0x7f71b80a8db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:05.838 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:05.833+0000 7f71bf9c4640 1 --2- 172.21.15.78:0/427775353 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f71b8072810 0x7f71b81f0430 unknown :-1 s=CLOSED pgs=600 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:05.838 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:05.833+0000 7f71bf9c4640 1 -- 172.21.15.78:0/427775353 >> 172.21.15.78:0/427775353 conn(0x7f71b806b220 msgr2=0x7f71b80a77c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:01:05.838 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:05.833+0000 7f71bf9c4640 1 -- 172.21.15.78:0/427775353 shutdown_connections 2023-11-28T20:01:05.838 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:05.833+0000 7f71bf9c4640 1 -- 172.21.15.78:0/427775353 wait complete. 2023-11-28T20:01:05.860 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-11-28T20:01:06.001 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:05.997+0000 7f7a542c9640 1 Processor -- start 2023-11-28T20:01:06.001 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:05.997+0000 7f7a542c9640 1 -- start start 2023-11-28T20:01:06.003 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:05.997+0000 7f7a542c9640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f7a4c155100 0x7f7a4c06b320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:06.003 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:05.997+0000 7f7a542c9640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7a4c0c8aa0 con 0x7f7a4c0c47c0 2023-11-28T20:01:06.003 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:05.997+0000 7f7a542c9640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7a4c0c9060 con 0x7f7a4c151ec0 2023-11-28T20:01:06.003 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:05.997+0000 7f7a542c9640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7a4c06b860 con 0x7f7a4c155100 2023-11-28T20:01:06.003 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:05.997+0000 7f7a52866640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f7a4c155100 0x7f7a4c06b320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:06.004 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:05.997+0000 7f7a51864640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f7a4c0c47c0 0x7f7a4c0c7f60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:59728/0 (socket says 172.21.15.78:59728) 2023-11-28T20:01:06.004 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:05.997+0000 7f7a51864640 1 -- 172.21.15.78:0/1550385329 learned_addr learned my addr 172.21.15.78:0/1550385329 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-11-28T20:01:06.004 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:05.997+0000 7f7a52866640 1 -- 172.21.15.78:0/1550385329 >> v1:172.21.15.179:6789/0 conn(0x7f7a4c151ec0 legacy=0x7f7a4c0c94f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:01:06.004 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:05.997+0000 7f7a52866640 1 -- 172.21.15.78:0/1550385329 >> v1:172.21.15.78:6789/0 conn(0x7f7a4c0c47c0 legacy=0x7f7a4c0c7f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:01:06.004 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:05.997+0000 7f7a52866640 1 -- 172.21.15.78:0/1550385329 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a4c0c4d30 con 0x7f7a4c155100 2023-11-28T20:01:06.006 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:06.001+0000 7f7a52866640 1 --2- 172.21.15.78:0/1550385329 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7a4c155100 0x7f7a4c06b320 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7f7a44009d90 tx=0x7f7a4401c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=198c93dd524d7263 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:01:06.006 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:06.001+0000 7f7a51063640 1 -- 172.21.15.78:0/1550385329 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a440a59d0 con 0x7f7a4c155100 2023-11-28T20:01:06.006 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:06.001+0000 7f7a51063640 1 -- 172.21.15.78:0/1550385329 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a440a5b30 con 0x7f7a4c155100 2023-11-28T20:01:06.006 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:06.001+0000 7f7a51063640 1 -- 172.21.15.78:0/1550385329 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a440ad440 con 0x7f7a4c155100 2023-11-28T20:01:06.007 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:06.001+0000 7f7a542c9640 1 -- 172.21.15.78:0/1550385329 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7a4c155100 msgr2=0x7f7a4c06b320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:01:06.007 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:06.001+0000 7f7a542c9640 1 --2- 172.21.15.78:0/1550385329 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7a4c155100 0x7f7a4c06b320 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7f7a44009d90 tx=0x7f7a4401c910 comp rx=0 tx=0).stop 2023-11-28T20:01:06.007 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:06.001+0000 7f7a542c9640 1 -- 172.21.15.78:0/1550385329 shutdown_connections 2023-11-28T20:01:06.007 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:06.001+0000 7f7a542c9640 1 --2- 172.21.15.78:0/1550385329 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7a4c155100 0x7f7a4c06b320 unknown :-1 s=CLOSED pgs=602 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:06.007 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:06.001+0000 7f7a542c9640 1 -- 172.21.15.78:0/1550385329 >> 172.21.15.78:0/1550385329 conn(0x7f7a4c0c9e40 msgr2=0x7f7a4c0ca250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:01:06.008 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:06.001+0000 7f7a542c9640 1 -- 172.21.15.78:0/1550385329 shutdown_connections 2023-11-28T20:01:06.008 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:06.001+0000 7f7a542c9640 1 -- 172.21.15.78:0/1550385329 wait complete. 2023-11-28T20:01:06.009 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:06.005+0000 7f7a542c9640 1 Processor -- start 2023-11-28T20:01:06.010 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:06.005+0000 7f7a542c9640 1 -- start start 2023-11-28T20:01:06.012 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:06.005+0000 7f7a542c9640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7a4c0c47c0 0x7f7a4c0bed40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:06.012 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:06.005+0000 7f7a542c9640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7a4c151ec0 0x7f7a4c155ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:06.012 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:06.005+0000 7f7a542c9640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7a4c155100 0x7f7a4c0c23f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:06.012 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:06.005+0000 7f7a542c9640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a4c0c1f60 con 0x7f7a4c0c47c0 2023-11-28T20:01:06.012 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:06.005+0000 7f7a542c9640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a4c0bfd90 con 0x7f7a4c155100 2023-11-28T20:01:06.012 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:06.005+0000 7f7a542c9640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7a4c0c0070 con 0x7f7a4c151ec0 2023-11-28T20:01:06.013 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:06.005+0000 7f7a52065640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7a4c0c47c0 0x7f7a4c0bed40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:06.013 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:06.005+0000 7f7a52065640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7a4c0c47c0 0x7f7a4c0bed40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:55780/0 (socket says 172.21.15.78:55780) 2023-11-28T20:01:06.013 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:06.005+0000 7f7a52065640 1 -- 172.21.15.78:0/3246706786 learned_addr learned my addr 172.21.15.78:0/3246706786 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T20:01:06.013 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:06.005+0000 7f7a52866640 1 --2- 172.21.15.78:0/3246706786 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7a4c155100 0x7f7a4c0c23f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:06.013 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:06.005+0000 7f7a51864640 1 --2- 172.21.15.78:0/3246706786 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7a4c151ec0 0x7f7a4c155ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:06.013 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:06.005+0000 7f7a52065640 1 -- 172.21.15.78:0/3246706786 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7a4c151ec0 msgr2=0x7f7a4c155ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:01:06.013 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:06.005+0000 7f7a52065640 1 --2- 172.21.15.78:0/3246706786 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7a4c151ec0 0x7f7a4c155ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:06.013 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:06.005+0000 7f7a52065640 1 -- 172.21.15.78:0/3246706786 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7a4c155100 msgr2=0x7f7a4c0c23f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:01:06.013 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:06.005+0000 7f7a52065640 1 --2- 172.21.15.78:0/3246706786 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7a4c155100 0x7f7a4c0c23f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:06.013 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:06.005+0000 7f7a52065640 1 -- 172.21.15.78:0/3246706786 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a44009a70 con 0x7f7a4c0c47c0 2023-11-28T20:01:06.013 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:06.005+0000 7f7a52065640 1 --2- 172.21.15.78:0/3246706786 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7a4c0c47c0 0x7f7a4c0bed40 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7f7a4800c450 tx=0x7f7a4800c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:01:06.013 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:06.005+0000 7f7a42ffd640 1 -- 172.21.15.78:0/3246706786 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a48012830 con 0x7f7a4c0c47c0 2023-11-28T20:01:06.014 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:06.005+0000 7f7a42ffd640 1 -- 172.21.15.78:0/3246706786 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a480129b0 con 0x7f7a4c0c47c0 2023-11-28T20:01:06.014 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:06.005+0000 7f7a42ffd640 1 -- 172.21.15.78:0/3246706786 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a48012d60 con 0x7f7a4c0c47c0 2023-11-28T20:01:06.014 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:06.005+0000 7f7a542c9640 1 -- 172.21.15.78:0/3246706786 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7a4c0c0350 con 0x7f7a4c0c47c0 2023-11-28T20:01:06.014 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:06.005+0000 7f7a542c9640 1 -- 172.21.15.78:0/3246706786 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7a4c156530 con 0x7f7a4c0c47c0 2023-11-28T20:01:06.014 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:06.009+0000 7f7a542c9640 1 -- 172.21.15.78:0/3246706786 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7a4c067630 con 0x7f7a4c0c47c0 2023-11-28T20:01:06.015 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:06.009+0000 7f7a42ffd640 1 -- 172.21.15.78:0/3246706786 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f7a4801c460 con 0x7f7a4c0c47c0 2023-11-28T20:01:06.015 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:06.009+0000 7f7a42ffd640 1 --2- 172.21.15.78:0/3246706786 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f7a30066470 0x7f7a30068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:06.015 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:06.009+0000 7f7a42ffd640 1 -- 172.21.15.78:0/3246706786 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(57..57 src has 1..57) v4 ==== 5177+0+0 (secure 0 0 0) 0x7f7a480839e0 con 0x7f7a4c0c47c0 2023-11-28T20:01:06.015 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:06.009+0000 7f7a51864640 1 --2- 172.21.15.78:0/3246706786 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f7a30066470 0x7f7a30068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:06.015 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:06.009+0000 7f7a51864640 1 --2- 172.21.15.78:0/3246706786 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f7a30066470 0x7f7a30068930 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f7a4c0c84e0 tx=0x7f7a3c009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:01:06.018 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:06.013+0000 7f7a42ffd640 1 -- 172.21.15.78:0/3246706786 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f7a48051110 con 0x7f7a4c0c47c0 2023-11-28T20:01:06.219 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:06.213+0000 7f7a542c9640 1 -- 172.21.15.78:0/3246706786 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f7a4c0c20a0 con 0x7f7a4c0c47c0 2023-11-28T20:01:06.220 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:06.217+0000 7f7a42ffd640 1 -- 172.21.15.78:0/3246706786 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v15) v1 ==== 80+0+5021 (secure 0 0 0) 0x7f7a48054730 con 0x7f7a4c0c47c0 2023-11-28T20:01:06.220 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-11-28T20:01:06.221 INFO:teuthology.orchestra.run.smithi078.stdout:{ 2023-11-28T20:01:06.221 INFO:teuthology.orchestra.run.smithi078.stdout: "auth_dump": [ 2023-11-28T20:01:06.221 INFO:teuthology.orchestra.run.smithi078.stdout: { 2023-11-28T20:01:06.221 INFO:teuthology.orchestra.run.smithi078.stdout: "entity": "mds.a", 2023-11-28T20:01:06.221 INFO:teuthology.orchestra.run.smithi078.stdout: "key": "AQBORmZldezUHhAAmHx6/kut7l58IB6id26WJA==", 2023-11-28T20:01:06.222 INFO:teuthology.orchestra.run.smithi078.stdout: "caps": { 2023-11-28T20:01:06.222 INFO:teuthology.orchestra.run.smithi078.stdout: "mds": "allow", 2023-11-28T20:01:06.222 INFO:teuthology.orchestra.run.smithi078.stdout: "mgr": "allow *", 2023-11-28T20:01:06.222 INFO:teuthology.orchestra.run.smithi078.stdout: "mon": "allow *", 2023-11-28T20:01:06.222 INFO:teuthology.orchestra.run.smithi078.stdout: "osd": "allow *" 2023-11-28T20:01:06.222 INFO:teuthology.orchestra.run.smithi078.stdout: } 2023-11-28T20:01:06.222 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2023-11-28T20:01:06.222 INFO:teuthology.orchestra.run.smithi078.stdout: { 2023-11-28T20:01:06.222 INFO:teuthology.orchestra.run.smithi078.stdout: "entity": "mds.b", 2023-11-28T20:01:06.222 INFO:teuthology.orchestra.run.smithi078.stdout: "key": "AQBORmZltpo9KxAAF+26E+HxsJs4tdMBVMETKw==", 2023-11-28T20:01:06.223 INFO:teuthology.orchestra.run.smithi078.stdout: "caps": { 2023-11-28T20:01:06.223 INFO:teuthology.orchestra.run.smithi078.stdout: "mds": "allow", 2023-11-28T20:01:06.223 INFO:teuthology.orchestra.run.smithi078.stdout: "mgr": "allow *", 2023-11-28T20:01:06.223 INFO:teuthology.orchestra.run.smithi078.stdout: "mon": "allow *", 2023-11-28T20:01:06.223 INFO:teuthology.orchestra.run.smithi078.stdout: "osd": "allow *" 2023-11-28T20:01:06.223 INFO:teuthology.orchestra.run.smithi078.stdout: } 2023-11-28T20:01:06.223 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2023-11-28T20:01:06.223 INFO:teuthology.orchestra.run.smithi078.stdout: { 2023-11-28T20:01:06.223 INFO:teuthology.orchestra.run.smithi078.stdout: "entity": "mds.c", 2023-11-28T20:01:06.223 INFO:teuthology.orchestra.run.smithi078.stdout: "key": "AQBORmZlqQU8JhAAjJ7XKQDZbfNnj0FUsYHUXw==", 2023-11-28T20:01:06.223 INFO:teuthology.orchestra.run.smithi078.stdout: "caps": { 2023-11-28T20:01:06.224 INFO:teuthology.orchestra.run.smithi078.stdout: "mds": "allow", 2023-11-28T20:01:06.224 INFO:teuthology.orchestra.run.smithi078.stdout: "mgr": "allow *", 2023-11-28T20:01:06.224 INFO:teuthology.orchestra.run.smithi078.stdout: "mon": "allow *", 2023-11-28T20:01:06.224 INFO:teuthology.orchestra.run.smithi078.stdout: "osd": "allow *" 2023-11-28T20:01:06.224 INFO:teuthology.orchestra.run.smithi078.stdout: } 2023-11-28T20:01:06.224 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2023-11-28T20:01:06.224 INFO:teuthology.orchestra.run.smithi078.stdout: { 2023-11-28T20:01:06.224 INFO:teuthology.orchestra.run.smithi078.stdout: "entity": "mds.d", 2023-11-28T20:01:06.224 INFO:teuthology.orchestra.run.smithi078.stdout: "key": "AQBORmZlcOaPMhAAABmFnot+b8fMIUvIIJMrtA==", 2023-11-28T20:01:06.224 INFO:teuthology.orchestra.run.smithi078.stdout: "caps": { 2023-11-28T20:01:06.224 INFO:teuthology.orchestra.run.smithi078.stdout: "mds": "allow", 2023-11-28T20:01:06.224 INFO:teuthology.orchestra.run.smithi078.stdout: "mgr": "allow *", 2023-11-28T20:01:06.225 INFO:teuthology.orchestra.run.smithi078.stdout: "mon": "allow *", 2023-11-28T20:01:06.225 INFO:teuthology.orchestra.run.smithi078.stdout: "osd": "allow *" 2023-11-28T20:01:06.225 INFO:teuthology.orchestra.run.smithi078.stdout: } 2023-11-28T20:01:06.225 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2023-11-28T20:01:06.225 INFO:teuthology.orchestra.run.smithi078.stdout: { 2023-11-28T20:01:06.225 INFO:teuthology.orchestra.run.smithi078.stdout: "entity": "osd.0", 2023-11-28T20:01:06.225 INFO:teuthology.orchestra.run.smithi078.stdout: "key": "AQBSRmZllQa4CRAAUz2YsYjsIf+SX/HkkQjzNw==", 2023-11-28T20:01:06.225 INFO:teuthology.orchestra.run.smithi078.stdout: "caps": { 2023-11-28T20:01:06.225 INFO:teuthology.orchestra.run.smithi078.stdout: "mgr": "allow profile osd", 2023-11-28T20:01:06.225 INFO:teuthology.orchestra.run.smithi078.stdout: "mon": "allow profile osd", 2023-11-28T20:01:06.225 INFO:teuthology.orchestra.run.smithi078.stdout: "osd": "allow *" 2023-11-28T20:01:06.225 INFO:teuthology.orchestra.run.smithi078.stdout: } 2023-11-28T20:01:06.226 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2023-11-28T20:01:06.226 INFO:teuthology.orchestra.run.smithi078.stdout: { 2023-11-28T20:01:06.226 INFO:teuthology.orchestra.run.smithi078.stdout: "entity": "osd.1", 2023-11-28T20:01:06.226 INFO:teuthology.orchestra.run.smithi078.stdout: "key": "AQBVRmZlrRCFEBAA+6glXV0u+NS4bF4DEGymmg==", 2023-11-28T20:01:06.226 INFO:teuthology.orchestra.run.smithi078.stdout: "caps": { 2023-11-28T20:01:06.226 INFO:teuthology.orchestra.run.smithi078.stdout: "mgr": "allow profile osd", 2023-11-28T20:01:06.226 INFO:teuthology.orchestra.run.smithi078.stdout: "mon": "allow profile osd", 2023-11-28T20:01:06.226 INFO:teuthology.orchestra.run.smithi078.stdout: "osd": "allow *" 2023-11-28T20:01:06.226 INFO:teuthology.orchestra.run.smithi078.stdout: } 2023-11-28T20:01:06.226 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2023-11-28T20:01:06.226 INFO:teuthology.orchestra.run.smithi078.stdout: { 2023-11-28T20:01:06.227 INFO:teuthology.orchestra.run.smithi078.stdout: "entity": "osd.2", 2023-11-28T20:01:06.227 INFO:teuthology.orchestra.run.smithi078.stdout: "key": "AQBYRmZlfcFfFxAApsrWaESm1Utd6BLazDsCIw==", 2023-11-28T20:01:06.227 INFO:teuthology.orchestra.run.smithi078.stdout: "caps": { 2023-11-28T20:01:06.227 INFO:teuthology.orchestra.run.smithi078.stdout: "mgr": "allow profile osd", 2023-11-28T20:01:06.227 INFO:teuthology.orchestra.run.smithi078.stdout: "mon": "allow profile osd", 2023-11-28T20:01:06.227 INFO:teuthology.orchestra.run.smithi078.stdout: "osd": "allow *" 2023-11-28T20:01:06.227 INFO:teuthology.orchestra.run.smithi078.stdout: } 2023-11-28T20:01:06.227 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2023-11-28T20:01:06.227 INFO:teuthology.orchestra.run.smithi078.stdout: { 2023-11-28T20:01:06.227 INFO:teuthology.orchestra.run.smithi078.stdout: "entity": "osd.3", 2023-11-28T20:01:06.227 INFO:teuthology.orchestra.run.smithi078.stdout: "key": "AQBbRmZlc7KQHRAA4Y4BYxG7CSLpPpGx9mP5BA==", 2023-11-28T20:01:06.228 INFO:teuthology.orchestra.run.smithi078.stdout: "caps": { 2023-11-28T20:01:06.228 INFO:teuthology.orchestra.run.smithi078.stdout: "mgr": "allow profile osd", 2023-11-28T20:01:06.228 INFO:teuthology.orchestra.run.smithi078.stdout: "mon": "allow profile osd", 2023-11-28T20:01:06.228 INFO:teuthology.orchestra.run.smithi078.stdout: "osd": "allow *" 2023-11-28T20:01:06.228 INFO:teuthology.orchestra.run.smithi078.stdout: } 2023-11-28T20:01:06.229 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2023-11-28T20:01:06.229 INFO:teuthology.orchestra.run.smithi078.stdout: { 2023-11-28T20:01:06.229 INFO:teuthology.orchestra.run.smithi078.stdout: "entity": "osd.4", 2023-11-28T20:01:06.229 INFO:teuthology.orchestra.run.smithi078.stdout: "key": "AQBhRmZlU5jVJhAAnM5Ow5whdkZS0cY13ehg0Q==", 2023-11-28T20:01:06.229 INFO:teuthology.orchestra.run.smithi078.stdout: "caps": { 2023-11-28T20:01:06.229 INFO:teuthology.orchestra.run.smithi078.stdout: "mgr": "allow profile osd", 2023-11-28T20:01:06.229 INFO:teuthology.orchestra.run.smithi078.stdout: "mon": "allow profile osd", 2023-11-28T20:01:06.229 INFO:teuthology.orchestra.run.smithi078.stdout: "osd": "allow *" 2023-11-28T20:01:06.229 INFO:teuthology.orchestra.run.smithi078.stdout: } 2023-11-28T20:01:06.230 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2023-11-28T20:01:06.230 INFO:teuthology.orchestra.run.smithi078.stdout: { 2023-11-28T20:01:06.230 INFO:teuthology.orchestra.run.smithi078.stdout: "entity": "osd.5", 2023-11-28T20:01:06.230 INFO:teuthology.orchestra.run.smithi078.stdout: "key": "AQBkRmZlV0qxMBAAwuuKXOx2QOKWxJlY47Z8gw==", 2023-11-28T20:01:06.230 INFO:teuthology.orchestra.run.smithi078.stdout: "caps": { 2023-11-28T20:01:06.230 INFO:teuthology.orchestra.run.smithi078.stdout: "mgr": "allow profile osd", 2023-11-28T20:01:06.230 INFO:teuthology.orchestra.run.smithi078.stdout: "mon": "allow profile osd", 2023-11-28T20:01:06.231 INFO:teuthology.orchestra.run.smithi078.stdout: "osd": "allow *" 2023-11-28T20:01:06.231 INFO:teuthology.orchestra.run.smithi078.stdout: } 2023-11-28T20:01:06.231 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2023-11-28T20:01:06.231 INFO:teuthology.orchestra.run.smithi078.stdout: { 2023-11-28T20:01:06.231 INFO:teuthology.orchestra.run.smithi078.stdout: "entity": "osd.6", 2023-11-28T20:01:06.232 INFO:teuthology.orchestra.run.smithi078.stdout: "key": "AQBnRmZln6R8NhAAu+46Z8Qb0mXkyMx5W2U/oA==", 2023-11-28T20:01:06.232 INFO:teuthology.orchestra.run.smithi078.stdout: "caps": { 2023-11-28T20:01:06.232 INFO:teuthology.orchestra.run.smithi078.stdout: "mgr": "allow profile osd", 2023-11-28T20:01:06.232 INFO:teuthology.orchestra.run.smithi078.stdout: "mon": "allow profile osd", 2023-11-28T20:01:06.232 INFO:teuthology.orchestra.run.smithi078.stdout: "osd": "allow *" 2023-11-28T20:01:06.232 INFO:teuthology.orchestra.run.smithi078.stdout: } 2023-11-28T20:01:06.232 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2023-11-28T20:01:06.232 INFO:teuthology.orchestra.run.smithi078.stdout: { 2023-11-28T20:01:06.233 INFO:teuthology.orchestra.run.smithi078.stdout: "entity": "osd.7", 2023-11-28T20:01:06.233 INFO:teuthology.orchestra.run.smithi078.stdout: "key": "AQBrRmZl8+xEBBAAx7CjmIrEZseolpBrEDAJog==", 2023-11-28T20:01:06.233 INFO:teuthology.orchestra.run.smithi078.stdout: "caps": { 2023-11-28T20:01:06.233 INFO:teuthology.orchestra.run.smithi078.stdout: "mgr": "allow profile osd", 2023-11-28T20:01:06.233 INFO:teuthology.orchestra.run.smithi078.stdout: "mon": "allow profile osd", 2023-11-28T20:01:06.233 INFO:teuthology.orchestra.run.smithi078.stdout: "osd": "allow *" 2023-11-28T20:01:06.233 INFO:teuthology.orchestra.run.smithi078.stdout: } 2023-11-28T20:01:06.233 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2023-11-28T20:01:06.233 INFO:teuthology.orchestra.run.smithi078.stdout: { 2023-11-28T20:01:06.233 INFO:teuthology.orchestra.run.smithi078.stdout: "entity": "client.0", 2023-11-28T20:01:06.233 INFO:teuthology.orchestra.run.smithi078.stdout: "key": "AQBORmZlPLeINhAAMdB7hy84hvX1S/pHYfkeJg==", 2023-11-28T20:01:06.233 INFO:teuthology.orchestra.run.smithi078.stdout: "caps": { 2023-11-28T20:01:06.234 INFO:teuthology.orchestra.run.smithi078.stdout: "mds": "allow", 2023-11-28T20:01:06.234 INFO:teuthology.orchestra.run.smithi078.stdout: "mon": "allow r", 2023-11-28T20:01:06.234 INFO:teuthology.orchestra.run.smithi078.stdout: "osd": "allow rw tag cephfs data=cephfs" 2023-11-28T20:01:06.234 INFO:teuthology.orchestra.run.smithi078.stdout: } 2023-11-28T20:01:06.234 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2023-11-28T20:01:06.234 INFO:teuthology.orchestra.run.smithi078.stdout: { 2023-11-28T20:01:06.234 INFO:teuthology.orchestra.run.smithi078.stdout: "entity": "client.1", 2023-11-28T20:01:06.234 INFO:teuthology.orchestra.run.smithi078.stdout: "key": "AQBORmZlzBgfOhAAm6M8Y+12MlLdVkJnMmK9BQ==", 2023-11-28T20:01:06.234 INFO:teuthology.orchestra.run.smithi078.stdout: "caps": { 2023-11-28T20:01:06.234 INFO:teuthology.orchestra.run.smithi078.stdout: "mds": "allow", 2023-11-28T20:01:06.234 INFO:teuthology.orchestra.run.smithi078.stdout: "mon": "allow r", 2023-11-28T20:01:06.235 INFO:teuthology.orchestra.run.smithi078.stdout: "osd": "allow rw pool=cephfs2_data" 2023-11-28T20:01:06.235 INFO:teuthology.orchestra.run.smithi078.stdout: } 2023-11-28T20:01:06.235 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2023-11-28T20:01:06.235 INFO:teuthology.orchestra.run.smithi078.stdout: { 2023-11-28T20:01:06.235 INFO:teuthology.orchestra.run.smithi078.stdout: "entity": "client.admin", 2023-11-28T20:01:06.235 INFO:teuthology.orchestra.run.smithi078.stdout: "key": "AQBORmZl8EaQAhAAmfstKsxO4dpR94AlFoDQpg==", 2023-11-28T20:01:06.235 INFO:teuthology.orchestra.run.smithi078.stdout: "caps": { 2023-11-28T20:01:06.235 INFO:teuthology.orchestra.run.smithi078.stdout: "mds": "allow *", 2023-11-28T20:01:06.235 INFO:teuthology.orchestra.run.smithi078.stdout: "mgr": "allow *", 2023-11-28T20:01:06.235 INFO:teuthology.orchestra.run.smithi078.stdout: "mon": "allow *", 2023-11-28T20:01:06.235 INFO:teuthology.orchestra.run.smithi078.stdout: "osd": "allow *" 2023-11-28T20:01:06.236 INFO:teuthology.orchestra.run.smithi078.stdout: } 2023-11-28T20:01:06.236 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2023-11-28T20:01:06.236 INFO:teuthology.orchestra.run.smithi078.stdout: { 2023-11-28T20:01:06.236 INFO:teuthology.orchestra.run.smithi078.stdout: "entity": "client.testuser", 2023-11-28T20:01:06.236 INFO:teuthology.orchestra.run.smithi078.stdout: "key": "AQDnRmZlxPmOOhAABtFMizHRWLo0HdOMCPA14A==", 2023-11-28T20:01:06.236 INFO:teuthology.orchestra.run.smithi078.stdout: "caps": { 2023-11-28T20:01:06.236 INFO:teuthology.orchestra.run.smithi078.stdout: "mds": "allow rw fsname=cephfs", 2023-11-28T20:01:06.236 INFO:teuthology.orchestra.run.smithi078.stdout: "mon": "allow r fsname=cephfs", 2023-11-28T20:01:06.236 INFO:teuthology.orchestra.run.smithi078.stdout: "osd": "allow rw tag cephfs data=cephfs" 2023-11-28T20:01:06.236 INFO:teuthology.orchestra.run.smithi078.stdout: } 2023-11-28T20:01:06.236 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2023-11-28T20:01:06.236 INFO:teuthology.orchestra.run.smithi078.stdout: { 2023-11-28T20:01:06.237 INFO:teuthology.orchestra.run.smithi078.stdout: "entity": "mgr.x", 2023-11-28T20:01:06.237 INFO:teuthology.orchestra.run.smithi078.stdout: "key": "AQBORmZl1xbAGhAAVP5dcAqZPly145Skxk8QjA==", 2023-11-28T20:01:06.237 INFO:teuthology.orchestra.run.smithi078.stdout: "caps": { 2023-11-28T20:01:06.237 INFO:teuthology.orchestra.run.smithi078.stdout: "mds": "allow *", 2023-11-28T20:01:06.237 INFO:teuthology.orchestra.run.smithi078.stdout: "mon": "allow profile mgr", 2023-11-28T20:01:06.237 INFO:teuthology.orchestra.run.smithi078.stdout: "osd": "allow *" 2023-11-28T20:01:06.237 INFO:teuthology.orchestra.run.smithi078.stdout: } 2023-11-28T20:01:06.237 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2023-11-28T20:01:06.237 INFO:teuthology.orchestra.run.smithi078.stdout: { 2023-11-28T20:01:06.237 INFO:teuthology.orchestra.run.smithi078.stdout: "entity": "mgr.y", 2023-11-28T20:01:06.237 INFO:teuthology.orchestra.run.smithi078.stdout: "key": "AQBORmZlQkLqFhAA1lMuqxTImbm69hxar4QpXg==", 2023-11-28T20:01:06.238 INFO:teuthology.orchestra.run.smithi078.stdout: "caps": { 2023-11-28T20:01:06.238 INFO:teuthology.orchestra.run.smithi078.stdout: "mds": "allow *", 2023-11-28T20:01:06.238 INFO:teuthology.orchestra.run.smithi078.stdout: "mon": "allow profile mgr", 2023-11-28T20:01:06.238 INFO:teuthology.orchestra.run.smithi078.stdout: "osd": "allow *" 2023-11-28T20:01:06.238 INFO:teuthology.orchestra.run.smithi078.stdout: } 2023-11-28T20:01:06.238 INFO:teuthology.orchestra.run.smithi078.stdout: } 2023-11-28T20:01:06.239 INFO:teuthology.orchestra.run.smithi078.stdout: ] 2023-11-28T20:01:06.239 INFO:teuthology.orchestra.run.smithi078.stdout:} 2023-11-28T20:01:06.240 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:06.217+0000 7f7a542c9640 1 -- 172.21.15.78:0/3246706786 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f7a30066470 msgr2=0x7f7a30068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:01:06.240 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:06.217+0000 7f7a542c9640 1 --2- 172.21.15.78:0/3246706786 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f7a30066470 0x7f7a30068930 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f7a4c0c84e0 tx=0x7f7a3c009040 comp rx=0 tx=0).stop 2023-11-28T20:01:06.240 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:06.217+0000 7f7a542c9640 1 -- 172.21.15.78:0/3246706786 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7a4c0c47c0 msgr2=0x7f7a4c0bed40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:01:06.240 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:06.217+0000 7f7a542c9640 1 --2- 172.21.15.78:0/3246706786 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7a4c0c47c0 0x7f7a4c0bed40 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7f7a4800c450 tx=0x7f7a4800c910 comp rx=0 tx=0).stop 2023-11-28T20:01:06.240 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:06.217+0000 7f7a542c9640 1 -- 172.21.15.78:0/3246706786 shutdown_connections 2023-11-28T20:01:06.240 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:06.217+0000 7f7a542c9640 1 --2- 172.21.15.78:0/3246706786 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f7a30066470 0x7f7a30068930 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:06.240 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:06.217+0000 7f7a542c9640 1 --2- 172.21.15.78:0/3246706786 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7a4c151ec0 0x7f7a4c155ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:06.240 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:06.217+0000 7f7a542c9640 1 --2- 172.21.15.78:0/3246706786 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7a4c155100 0x7f7a4c0c23f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:06.241 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:06.217+0000 7f7a542c9640 1 --2- 172.21.15.78:0/3246706786 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7a4c0c47c0 0x7f7a4c0bed40 unknown :-1 s=CLOSED pgs=603 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:06.241 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:06.217+0000 7f7a542c9640 1 -- 172.21.15.78:0/3246706786 >> 172.21.15.78:0/3246706786 conn(0x7f7a4c0c9e40 msgr2=0x7f7a4c0a98f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:01:06.241 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:06.217+0000 7f7a542c9640 1 -- 172.21.15.78:0/3246706786 shutdown_connections 2023-11-28T20:01:06.241 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:06.217+0000 7f7a542c9640 1 -- 172.21.15.78:0/3246706786 wait complete. 2023-11-28T20:01:06.242 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.testuser 2023-11-28T20:01:06.380 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:06.377+0000 7f01aef2a640 1 Processor -- start 2023-11-28T20:01:06.380 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:06.377+0000 7f01aef2a640 1 -- start start 2023-11-28T20:01:06.381 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:06.377+0000 7f01aef2a640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f01a8154390 0x7f01a80c4a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:06.381 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:06.377+0000 7f01aef2a640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f01a80c2110 0x7f01a80c5ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:06.381 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:06.377+0000 7f01aef2a640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f01a80a93d0 con 0x7f01a80c4f80 2023-11-28T20:01:06.382 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:06.377+0000 7f01aef2a640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f01a80aa1c0 con 0x7f01a80c2110 2023-11-28T20:01:06.382 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:06.377+0000 7f01aef2a640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f01a8154770 con 0x7f01a8154390 2023-11-28T20:01:06.382 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:06.377+0000 7f01a7fff640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f01a80c2110 0x7f01a80c5ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:06.382 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:06.377+0000 7f01ad4c7640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f01a80c4f80 0x7f01a80c61e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:59740/0 (socket says 172.21.15.78:59740) 2023-11-28T20:01:06.382 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:06.377+0000 7f01ad4c7640 1 -- 172.21.15.78:0/1246222601 learned_addr learned my addr 172.21.15.78:0/1246222601 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-11-28T20:01:06.382 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:06.377+0000 7f01accc6640 1 --2- 172.21.15.78:0/1246222601 >> v2:172.21.15.179:3300/0 conn(0x7f01a8154390 0x7f01a80c4a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:06.383 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:06.377+0000 7f01a7fff640 1 -- 172.21.15.78:0/1246222601 >> v2:172.21.15.179:3300/0 conn(0x7f01a8154390 msgr2=0x7f01a80c4a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:01:06.383 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:06.377+0000 7f01a7fff640 1 --2- 172.21.15.78:0/1246222601 >> v2:172.21.15.179:3300/0 conn(0x7f01a8154390 0x7f01a80c4a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:06.383 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:06.377+0000 7f01a7fff640 1 -- 172.21.15.78:0/1246222601 >> v1:172.21.15.78:6789/0 conn(0x7f01a80c4f80 legacy=0x7f01a80c61e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:01:06.383 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:06.377+0000 7f01a77fe640 1 -- 172.21.15.78:0/1246222601 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3096467835 0 0) 0x7f01a80a93d0 con 0x7f01a80c4f80 2023-11-28T20:01:06.383 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:06.377+0000 7f01a7fff640 1 -- 172.21.15.78:0/1246222601 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01a80a9640 con 0x7f01a80c2110 2023-11-28T20:01:06.385 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:06.381+0000 7f01a7fff640 1 --2- 172.21.15.78:0/1246222601 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f01a80c2110 0x7f01a80c5ca0 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7f01a80a83b0 tx=0x7f019401eb10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a1e018b3776d6ff9 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:01:06.385 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:06.381+0000 7f01a77fe640 1 -- 172.21.15.78:0/1246222601 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01940a79f0 con 0x7f01a80c2110 2023-11-28T20:01:06.385 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:06.381+0000 7f01a77fe640 1 -- 172.21.15.78:0/1246222601 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f01940a7b50 con 0x7f01a80c2110 2023-11-28T20:01:06.385 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:06.381+0000 7f01a77fe640 1 -- 172.21.15.78:0/1246222601 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01940af440 con 0x7f01a80c2110 2023-11-28T20:01:06.386 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:06.381+0000 7f01aef2a640 1 -- 172.21.15.78:0/1246222601 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f01a80c2110 msgr2=0x7f01a80c5ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:01:06.386 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:06.381+0000 7f01aef2a640 1 --2- 172.21.15.78:0/1246222601 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f01a80c2110 0x7f01a80c5ca0 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7f01a80a83b0 tx=0x7f019401eb10 comp rx=0 tx=0).stop 2023-11-28T20:01:06.386 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:06.381+0000 7f01aef2a640 1 -- 172.21.15.78:0/1246222601 shutdown_connections 2023-11-28T20:01:06.386 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:06.381+0000 7f01aef2a640 1 --2- 172.21.15.78:0/1246222601 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f01a80c2110 0x7f01a80c5ca0 unknown :-1 s=CLOSED pgs=605 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:06.386 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:06.381+0000 7f01aef2a640 1 --2- 172.21.15.78:0/1246222601 >> v2:172.21.15.179:3300/0 conn(0x7f01a8154390 0x7f01a80c4a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:06.386 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:06.381+0000 7f01aef2a640 1 -- 172.21.15.78:0/1246222601 >> 172.21.15.78:0/1246222601 conn(0x7f01a806b220 msgr2=0x7f01a80a77e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:01:06.386 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:06.381+0000 7f01aef2a640 1 -- 172.21.15.78:0/1246222601 shutdown_connections 2023-11-28T20:01:06.386 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:06.381+0000 7f01aef2a640 1 -- 172.21.15.78:0/1246222601 wait complete. 2023-11-28T20:01:06.387 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:06.381+0000 7f01aef2a640 1 Processor -- start 2023-11-28T20:01:06.387 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:06.381+0000 7f01aef2a640 1 -- start start 2023-11-28T20:01:06.391 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:06.385+0000 7f01aef2a640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f01a80c2110 0x7f01a81f14c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:06.391 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:06.385+0000 7f01aef2a640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f01a80c4f80 0x7f01a814e8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:06.391 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:06.385+0000 7f01aef2a640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f01a8154390 0x7f01a81ee7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:06.391 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:06.385+0000 7f01aef2a640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01a81497e0 con 0x7f01a80c2110 2023-11-28T20:01:06.391 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:06.385+0000 7f01aef2a640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01a81490a0 con 0x7f01a80c4f80 2023-11-28T20:01:06.391 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:06.385+0000 7f01aef2a640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f01a81f09e0 con 0x7f01a8154390 2023-11-28T20:01:06.391 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:06.385+0000 7f01accc6640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f01a80c2110 0x7f01a81f14c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:06.391 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:06.385+0000 7f01accc6640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f01a80c2110 0x7f01a81f14c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:55794/0 (socket says 172.21.15.78:55794) 2023-11-28T20:01:06.391 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:06.385+0000 7f01accc6640 1 -- 172.21.15.78:0/1478588394 learned_addr learned my addr 172.21.15.78:0/1478588394 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T20:01:06.391 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:06.385+0000 7f01ad4c7640 1 --2- 172.21.15.78:0/1478588394 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f01a8154390 0x7f01a81ee7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:06.391 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:06.385+0000 7f01a7fff640 1 --2- 172.21.15.78:0/1478588394 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f01a80c4f80 0x7f01a814e8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:06.392 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:06.385+0000 7f01accc6640 1 -- 172.21.15.78:0/1478588394 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f01a8154390 msgr2=0x7f01a81ee7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:01:06.392 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:06.385+0000 7f01accc6640 1 --2- 172.21.15.78:0/1478588394 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f01a8154390 0x7f01a81ee7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:06.392 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:06.385+0000 7f01accc6640 1 -- 172.21.15.78:0/1478588394 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f01a80c4f80 msgr2=0x7f01a814e8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:01:06.392 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:06.385+0000 7f01accc6640 1 --2- 172.21.15.78:0/1478588394 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f01a80c4f80 0x7f01a814e8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:06.392 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:06.385+0000 7f01accc6640 1 -- 172.21.15.78:0/1478588394 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f019400b6c0 con 0x7f01a80c2110 2023-11-28T20:01:06.392 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:06.385+0000 7f01accc6640 1 --2- 172.21.15.78:0/1478588394 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f01a80c2110 0x7f01a81f14c0 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7f019c00e870 tx=0x7f019c00ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:01:06.392 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:06.385+0000 7f01a57fa640 1 -- 172.21.15.78:0/1478588394 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f019c009510 con 0x7f01a80c2110 2023-11-28T20:01:06.392 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:06.385+0000 7f01a57fa640 1 -- 172.21.15.78:0/1478588394 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f019c00eec0 con 0x7f01a80c2110 2023-11-28T20:01:06.392 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:06.385+0000 7f01aef2a640 1 -- 172.21.15.78:0/1478588394 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f01a81f0cc0 con 0x7f01a80c2110 2023-11-28T20:01:06.392 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:06.385+0000 7f01a57fa640 1 -- 172.21.15.78:0/1478588394 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f019c00cb40 con 0x7f01a80c2110 2023-11-28T20:01:06.392 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:06.385+0000 7f01aef2a640 1 -- 172.21.15.78:0/1478588394 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f01a8149380 con 0x7f01a80c2110 2023-11-28T20:01:06.392 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:06.385+0000 7f01aef2a640 1 -- 172.21.15.78:0/1478588394 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f01a8067630 con 0x7f01a80c2110 2023-11-28T20:01:06.393 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:06.389+0000 7f01a57fa640 1 -- 172.21.15.78:0/1478588394 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f019c00cca0 con 0x7f01a80c2110 2023-11-28T20:01:06.393 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:06.389+0000 7f01a57fa640 1 --2- 172.21.15.78:0/1478588394 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f018c066470 0x7f018c068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:06.393 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:06.389+0000 7f01a57fa640 1 -- 172.21.15.78:0/1478588394 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(57..57 src has 1..57) v4 ==== 5177+0+0 (secure 0 0 0) 0x7f019c083d40 con 0x7f01a80c2110 2023-11-28T20:01:06.394 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:06.389+0000 7f01a7fff640 1 --2- 172.21.15.78:0/1478588394 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f018c066470 0x7f018c068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:06.394 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:06.389+0000 7f01a7fff640 1 --2- 172.21.15.78:0/1478588394 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f018c066470 0x7f018c068930 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f01940b1000 tx=0x7f0194008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:01:06.396 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:06.393+0000 7f01a57fa640 1 -- 172.21.15.78:0/1478588394 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f019c0513d0 con 0x7f01a80c2110 2023-11-28T20:01:06.600 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:06.597+0000 7f01aef2a640 1 -- 172.21.15.78:0/1478588394 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.testuser"} v 0) v1 -- 0x7f01a80c0800 con 0x7f01a80c2110 2023-11-28T20:01:06.603 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:06.597+0000 7f01a57fa640 1 -- 172.21.15.78:0/1478588394 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.testuser"}]=0 v16) v1 ==== 85+0+0 (secure 0 0 0) 0x7f019c0549f0 con 0x7f01a80c2110 2023-11-28T20:01:06.605 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:06.601+0000 7f01aef2a640 1 -- 172.21.15.78:0/1478588394 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f018c066470 msgr2=0x7f018c068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:01:06.605 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:06.601+0000 7f01aef2a640 1 --2- 172.21.15.78:0/1478588394 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f018c066470 0x7f018c068930 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f01940b1000 tx=0x7f0194008040 comp rx=0 tx=0).stop 2023-11-28T20:01:06.605 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:06.601+0000 7f01aef2a640 1 -- 172.21.15.78:0/1478588394 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f01a80c2110 msgr2=0x7f01a81f14c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:01:06.606 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:06.601+0000 7f01aef2a640 1 --2- 172.21.15.78:0/1478588394 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f01a80c2110 0x7f01a81f14c0 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7f019c00e870 tx=0x7f019c00ec70 comp rx=0 tx=0).stop 2023-11-28T20:01:06.606 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:06.601+0000 7f01aef2a640 1 -- 172.21.15.78:0/1478588394 shutdown_connections 2023-11-28T20:01:06.606 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:06.601+0000 7f01aef2a640 1 --2- 172.21.15.78:0/1478588394 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f018c066470 0x7f018c068930 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:06.606 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:06.601+0000 7f01aef2a640 1 --2- 172.21.15.78:0/1478588394 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f01a8154390 0x7f01a81ee7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:06.606 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:06.601+0000 7f01aef2a640 1 --2- 172.21.15.78:0/1478588394 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f01a80c4f80 0x7f01a814e8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:06.606 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:06.601+0000 7f01aef2a640 1 --2- 172.21.15.78:0/1478588394 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f01a80c2110 0x7f01a81f14c0 unknown :-1 s=CLOSED pgs=606 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:06.606 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:06.601+0000 7f01aef2a640 1 -- 172.21.15.78:0/1478588394 >> 172.21.15.78:0/1478588394 conn(0x7f01a806b220 msgr2=0x7f01a80bf390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:01:06.606 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:06.601+0000 7f01aef2a640 1 -- 172.21.15.78:0/1478588394 shutdown_connections 2023-11-28T20:01:06.606 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:06.601+0000 7f01aef2a640 1 -- 172.21.15.78:0/1478588394 wait complete. 2023-11-28T20:01:06.624 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-28T20:01:06.761 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:06.757+0000 7fe481217640 1 Processor -- start 2023-11-28T20:01:06.761 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:06.757+0000 7fe481217640 1 -- start start 2023-11-28T20:01:06.762 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:06.757+0000 7fe481217640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fe47c0c33c0 0x7fe47c152280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:06.763 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:06.757+0000 7fe481217640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe47c1531b0 con 0x7fe47c0c2660 2023-11-28T20:01:06.763 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:06.757+0000 7fe481217640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe47c0c6000 con 0x7fe47c0c6fb0 2023-11-28T20:01:06.763 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:06.757+0000 7fe481217640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe47c06e900 con 0x7fe47c0c33c0 2023-11-28T20:01:06.763 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:06.757+0000 7fe473fff640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7fe47c0c2660 0x7fe47c0a6de0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:59752/0 (socket says 172.21.15.78:59752) 2023-11-28T20:01:06.763 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:06.757+0000 7fe473fff640 1 -- 172.21.15.78:0/2023730565 learned_addr learned my addr 172.21.15.78:0/2023730565 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-11-28T20:01:06.763 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:06.757+0000 7fe47ad9d640 1 --2- 172.21.15.78:0/2023730565 >> v2:172.21.15.179:3300/0 conn(0x7fe47c0c33c0 0x7fe47c152280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:06.764 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:06.757+0000 7fe47a59c640 1 -- 172.21.15.78:0/2023730565 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 506089231 0 0) 0x7fe47c1531b0 con 0x7fe47c0c2660 2023-11-28T20:01:06.764 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:06.757+0000 7fe47a59c640 1 -- 172.21.15.78:0/2023730565 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe468003530 con 0x7fe47c0c2660 2023-11-28T20:01:06.764 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:06.757+0000 7fe47a59c640 1 -- 172.21.15.78:0/2023730565 <== mon.0 v1:172.21.15.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2831639829 0 0) 0x7fe468003530 con 0x7fe47c0c2660 2023-11-28T20:01:06.764 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:06.757+0000 7fe47ad9d640 1 -- 172.21.15.78:0/2023730565 >> v1:172.21.15.179:6789/0 conn(0x7fe47c0c6fb0 legacy=0x7fe47c0c6490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:01:06.764 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:06.757+0000 7fe47ad9d640 1 -- 172.21.15.78:0/2023730565 >> v1:172.21.15.78:6789/0 conn(0x7fe47c0c2660 legacy=0x7fe47c0a6de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:01:06.764 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:06.757+0000 7fe47ad9d640 1 -- 172.21.15.78:0/2023730565 --> v2:172.21.15.179:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe47c152bf0 con 0x7fe47c0c33c0 2023-11-28T20:01:06.766 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:06.761+0000 7fe47ad9d640 1 --2- 172.21.15.78:0/2023730565 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe47c0c33c0 0x7fe47c152280 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fe46c0097c0 tx=0x7fe46c01c2e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7c309e16c6f53f48 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:01:06.766 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:06.761+0000 7fe47a59c640 1 -- 172.21.15.78:0/2023730565 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe464001680 con 0x7fe47c0c33c0 2023-11-28T20:01:06.767 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:06.761+0000 7fe47a59c640 1 -- 172.21.15.78:0/2023730565 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe46c0a7050 con 0x7fe47c0c33c0 2023-11-28T20:01:06.767 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:06.761+0000 7fe47a59c640 1 -- 172.21.15.78:0/2023730565 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe46c0ab600 con 0x7fe47c0c33c0 2023-11-28T20:01:06.767 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:06.761+0000 7fe481217640 1 -- 172.21.15.78:0/2023730565 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe47c0c33c0 msgr2=0x7fe47c152280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:01:06.768 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:06.761+0000 7fe481217640 1 --2- 172.21.15.78:0/2023730565 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe47c0c33c0 0x7fe47c152280 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fe46c0097c0 tx=0x7fe46c01c2e0 comp rx=0 tx=0).stop 2023-11-28T20:01:06.768 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:06.761+0000 7fe481217640 1 -- 172.21.15.78:0/2023730565 shutdown_connections 2023-11-28T20:01:06.768 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:06.761+0000 7fe481217640 1 --2- 172.21.15.78:0/2023730565 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe47c0c33c0 0x7fe47c152280 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:06.768 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:06.761+0000 7fe481217640 1 -- 172.21.15.78:0/2023730565 >> 172.21.15.78:0/2023730565 conn(0x7fe47c0c7c60 msgr2=0x7fe47c0c8070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:01:06.768 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:06.761+0000 7fe481217640 1 -- 172.21.15.78:0/2023730565 shutdown_connections 2023-11-28T20:01:06.769 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:06.761+0000 7fe481217640 1 -- 172.21.15.78:0/2023730565 wait complete. 2023-11-28T20:01:06.769 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:06.765+0000 7fe481217640 1 Processor -- start 2023-11-28T20:01:06.769 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:06.765+0000 7fe481217640 1 -- start start 2023-11-28T20:01:06.771 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:06.765+0000 7fe481217640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe47c0c2660 0x7fe47c1431e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:06.771 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:06.765+0000 7fe481217640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe47c0c33c0 0x7fe47c1eb9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:06.771 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:06.765+0000 7fe481217640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe47c0c6fb0 0x7fe47c1ebee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:06.771 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:06.765+0000 7fe481217640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe47c145240 con 0x7fe47c0c6fb0 2023-11-28T20:01:06.771 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:06.765+0000 7fe481217640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe47c1ec420 con 0x7fe47c0c2660 2023-11-28T20:01:06.771 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:06.765+0000 7fe481217640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe47c143720 con 0x7fe47c0c33c0 2023-11-28T20:01:06.771 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:06.765+0000 7fe47b59e640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe47c0c6fb0 0x7fe47c1ebee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:06.771 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:06.765+0000 7fe47b59e640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe47c0c6fb0 0x7fe47c1ebee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:55804/0 (socket says 172.21.15.78:55804) 2023-11-28T20:01:06.771 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:06.765+0000 7fe47b59e640 1 -- 172.21.15.78:0/2347898733 learned_addr learned my addr 172.21.15.78:0/2347898733 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T20:01:06.772 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:06.765+0000 7fe47ad9d640 1 --2- 172.21.15.78:0/2347898733 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe47c0c2660 0x7fe47c1431e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:06.772 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:06.765+0000 7fe473fff640 1 --2- 172.21.15.78:0/2347898733 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe47c0c33c0 0x7fe47c1eb9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:06.772 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:06.765+0000 7fe47b59e640 1 -- 172.21.15.78:0/2347898733 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe47c0c33c0 msgr2=0x7fe47c1eb9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:01:06.772 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:06.765+0000 7fe47b59e640 1 --2- 172.21.15.78:0/2347898733 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe47c0c33c0 0x7fe47c1eb9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:06.772 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:06.765+0000 7fe47b59e640 1 -- 172.21.15.78:0/2347898733 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe47c0c2660 msgr2=0x7fe47c1431e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:01:06.772 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:06.765+0000 7fe47b59e640 1 --2- 172.21.15.78:0/2347898733 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe47c0c2660 0x7fe47c1431e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:06.772 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:06.765+0000 7fe47b59e640 1 -- 172.21.15.78:0/2347898733 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe46c009420 con 0x7fe47c0c6fb0 2023-11-28T20:01:06.772 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:06.765+0000 7fe47ad9d640 1 --2- 172.21.15.78:0/2347898733 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe47c0c2660 0x7fe47c1431e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T20:01:06.772 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:06.765+0000 7fe47b59e640 1 --2- 172.21.15.78:0/2347898733 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe47c0c6fb0 0x7fe47c1ebee0 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7fe47400c7d0 tx=0x7fe47400cc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:01:06.773 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:06.765+0000 7fe4737fe640 1 -- 172.21.15.78:0/2347898733 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe474003b80 con 0x7fe47c0c6fb0 2023-11-28T20:01:06.773 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:06.765+0000 7fe4737fe640 1 -- 172.21.15.78:0/2347898733 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe474003ce0 con 0x7fe47c0c6fb0 2023-11-28T20:01:06.773 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:06.765+0000 7fe4737fe640 1 -- 172.21.15.78:0/2347898733 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe47400aa30 con 0x7fe47c0c6fb0 2023-11-28T20:01:06.773 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:06.765+0000 7fe481217640 1 -- 172.21.15.78:0/2347898733 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe47c1ee820 con 0x7fe47c0c6fb0 2023-11-28T20:01:06.774 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:06.769+0000 7fe481217640 1 -- 172.21.15.78:0/2347898733 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe47c144e60 con 0x7fe47c0c6fb0 2023-11-28T20:01:06.774 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:06.769+0000 7fe481217640 1 -- 172.21.15.78:0/2347898733 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe47c145380 con 0x7fe47c0c6fb0 2023-11-28T20:01:06.774 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:06.769+0000 7fe4737fe640 1 -- 172.21.15.78:0/2347898733 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fe47400ab90 con 0x7fe47c0c6fb0 2023-11-28T20:01:06.774 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:06.769+0000 7fe4737fe640 1 --2- 172.21.15.78:0/2347898733 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fe45c0664a0 0x7fe45c068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:06.774 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:06.769+0000 7fe4737fe640 1 -- 172.21.15.78:0/2347898733 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(57..57 src has 1..57) v4 ==== 5177+0+0 (secure 0 0 0) 0x7fe474083ac0 con 0x7fe47c0c6fb0 2023-11-28T20:01:06.775 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:06.769+0000 7fe47ad9d640 1 --2- 172.21.15.78:0/2347898733 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fe45c0664a0 0x7fe45c068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:06.775 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:06.769+0000 7fe47ad9d640 1 --2- 172.21.15.78:0/2347898733 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fe45c0664a0 0x7fe45c068960 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fe46c0ad000 tx=0x7fe46c0a6000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:01:06.778 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:06.773+0000 7fe4737fe640 1 -- 172.21.15.78:0/2347898733 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fe47c145380 con 0x7fe47c0c6fb0 2023-11-28T20:01:06.930 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:06.925+0000 7fe481217640 1 -- 172.21.15.78:0/2347898733 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe47c145380 con 0x7fe47c0c6fb0 2023-11-28T20:01:06.931 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:06.925+0000 7fe4737fe640 1 -- 172.21.15.78:0/2347898733 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v57) v1 ==== 74+0+13038 (secure 0 0 0) 0x7fe47c145380 con 0x7fe47c0c6fb0 2023-11-28T20:01:06.932 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-11-28T20:01:06.932 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":57,"fsid":"dd9780e8-3bda-44fa-a9f0-fa07d19d901d","created":"2023-11-28T19:58:40.969556+0000","modified":"2023-11-28T20:01:05.829430+0000","last_up_change":"2023-11-28T19:58:52.596716+0000","last_in_change":"2023-11-28T19:58:43.609275+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-28T19:58:54.011229+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e84245ac-b5da-429e-af18-39acaa2b33e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6800","nonce":3358701235},{"type":"v1","addr":"172.21.15.78:6801","nonce":3358701235}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6802","nonce":3358701235},{"type":"v1","addr":"172.21.15.78:6803","nonce":3358701235}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6806","nonce":3358701235},{"type":"v1","addr":"172.21.15.78:6807","nonce":3358701235}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6804","nonce":3358701235},{"type":"v1","addr":"172.21.15.78:6805","nonce":3358701235}]},"public_addr":"172.21.15.78:6801/3358701235","cluster_addr":"172.21.15.78:6803/3358701235","heartbeat_back_addr":"172.21.15.78:6807/3358701235","heartbeat_front_addr":"172.21.15.78:6805/3358701235","state":["exists","up"]},{"osd":1,"uuid":"e634831d-c4e2-48d9-870c-9556ae162981","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6808","nonce":3211476654},{"type":"v1","addr":"172.21.15.78:6809","nonce":3211476654}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6810","nonce":3211476654},{"type":"v1","addr":"172.21.15.78:6811","nonce":3211476654}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6814","nonce":3211476654},{"type":"v1","addr":"172.21.15.78:6815","nonce":3211476654}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6812","nonce":3211476654},{"type":"v1","addr":"172.21.15.78:6813","nonce":3211476654}]},"public_addr":"172.21.15.78:6809/3211476654","cluster_addr":"172.21.15.78:6811/3211476654","heartbeat_back_addr":"172.21.15.78:6815/3211476654","heartbeat_front_addr":"172.21.15.78:6813/3211476654","state":["exists","up"]},{"osd":2,"uuid":"274c8395-6534-41f0-b8fb-a00af8985aa8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6816","nonce":2532904479},{"type":"v1","addr":"172.21.15.78:6817","nonce":2532904479}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6818","nonce":2532904479},{"type":"v1","addr":"172.21.15.78:6819","nonce":2532904479}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6822","nonce":2532904479},{"type":"v1","addr":"172.21.15.78:6823","nonce":2532904479}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6820","nonce":2532904479},{"type":"v1","addr":"172.21.15.78:6821","nonce":2532904479}]},"public_addr":"172.21.15.78:6817/2532904479","cluster_addr":"172.21.15.78:6819/2532904479","heartbeat_back_addr":"172.21.15.78:6823/2532904479","heartbeat_front_addr":"172.21.15.78:6821/2532904479","state":["exists","up"]},{"osd":3,"uuid":"77acc9af-7d4d-4b18-8cf5-d62f5971b7c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6824","nonce":3442991267},{"type":"v1","addr":"172.21.15.78:6825","nonce":3442991267}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6826","nonce":3442991267},{"type":"v1","addr":"172.21.15.78:6827","nonce":3442991267}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6830","nonce":3442991267},{"type":"v1","addr":"172.21.15.78:6831","nonce":3442991267}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6828","nonce":3442991267},{"type":"v1","addr":"172.21.15.78:6829","nonce":3442991267}]},"public_addr":"172.21.15.78:6825/3442991267","cluster_addr":"172.21.15.78:6827/3442991267","heartbeat_back_addr":"172.21.15.78:6831/3442991267","heartbeat_front_addr":"172.21.15.78:6829/3442991267","state":["exists","up"]},{"osd":4,"uuid":"5c62bc66-6b34-4b7f-a66b-9a743969138c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":802983577},{"type":"v1","addr":"172.21.15.179:6809","nonce":802983577}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":802983577},{"type":"v1","addr":"172.21.15.179:6811","nonce":802983577}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":802983577},{"type":"v1","addr":"172.21.15.179:6815","nonce":802983577}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":802983577},{"type":"v1","addr":"172.21.15.179:6813","nonce":802983577}]},"public_addr":"172.21.15.179:6809/802983577","cluster_addr":"172.21.15.179:6811/802983577","heartbeat_back_addr":"172.21.15.179:6815/802983577","heartbeat_front_addr":"172.21.15.179:6813/802983577","state":["exists","up"]},{"osd":5,"uuid":"67db6d36-f684-4079-b0cd-82b4dd61461f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":518192887},{"type":"v1","addr":"172.21.15.179:6818","nonce":518192887}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":518192887},{"type":"v1","addr":"172.21.15.179:6822","nonce":518192887}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":518192887},{"type":"v1","addr":"172.21.15.179:6829","nonce":518192887}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6824","nonce":518192887},{"type":"v1","addr":"172.21.15.179:6826","nonce":518192887}]},"public_addr":"172.21.15.179:6818/518192887","cluster_addr":"172.21.15.179:6822/518192887","heartbeat_back_addr":"172.21.15.179:6829/518192887","heartbeat_front_addr":"172.21.15.179:6826/518192887","state":["exists","up"]},{"osd":6,"uuid":"12e670af-5a16-4c81-9f97-defa66cab967","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":815435378},{"type":"v1","addr":"172.21.15.179:6801","nonce":815435378}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":815435378},{"type":"v1","addr":"172.21.15.179:6803","nonce":815435378}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":815435378},{"type":"v1","addr":"172.21.15.179:6807","nonce":815435378}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":815435378},{"type":"v1","addr":"172.21.15.179:6805","nonce":815435378}]},"public_addr":"172.21.15.179:6801/815435378","cluster_addr":"172.21.15.179:6803/815435378","heartbeat_back_addr":"172.21.15.179:6807/815435378","heartbeat_front_addr":"172.21.15.179:6805/815435378","state":["exists","up"]},{"osd":7,"uuid":"fe630650-2eb3-49ad-8676-c341e6332eb1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6817","nonce":2848432339},{"type":"v1","addr":"172.21.15.179:6819","nonce":2848432339}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6821","nonce":2848432339},{"type":"v1","addr":"172.21.15.179:6823","nonce":2848432339}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":2848432339},{"type":"v1","addr":"172.21.15.179:6831","nonce":2848432339}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6825","nonce":2848432339},{"type":"v1","addr":"172.21.15.179:6827","nonce":2848432339}]},"public_addr":"172.21.15.179:6819/2848432339","cluster_addr":"172.21.15.179:6823/2848432339","heartbeat_back_addr":"172.21.15.179:6831/2848432339","heartbeat_front_addr":"172.21.15.179:6827/2848432339","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:58:49.255433+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:58:49.412880+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:58:49.559295+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:58:49.245237+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:58:49.184557+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:58:49.329851+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:58:49.366012+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:58:49.349604+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-28T20:01:06.933 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:06.929+0000 7fe481217640 1 -- 172.21.15.78:0/2347898733 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fe45c0664a0 msgr2=0x7fe45c068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:01:06.933 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:06.929+0000 7fe481217640 1 --2- 172.21.15.78:0/2347898733 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fe45c0664a0 0x7fe45c068960 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fe46c0ad000 tx=0x7fe46c0a6000 comp rx=0 tx=0).stop 2023-11-28T20:01:06.934 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:06.929+0000 7fe481217640 1 -- 172.21.15.78:0/2347898733 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe47c0c6fb0 msgr2=0x7fe47c1ebee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:01:06.934 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:06.929+0000 7fe481217640 1 --2- 172.21.15.78:0/2347898733 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe47c0c6fb0 0x7fe47c1ebee0 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7fe47400c7d0 tx=0x7fe47400cc90 comp rx=0 tx=0).stop 2023-11-28T20:01:06.934 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:06.929+0000 7fe481217640 1 -- 172.21.15.78:0/2347898733 shutdown_connections 2023-11-28T20:01:06.934 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:06.929+0000 7fe481217640 1 --2- 172.21.15.78:0/2347898733 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fe45c0664a0 0x7fe45c068960 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:06.934 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:06.929+0000 7fe481217640 1 --2- 172.21.15.78:0/2347898733 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe47c0c33c0 0x7fe47c1eb9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:06.934 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:06.929+0000 7fe481217640 1 --2- 172.21.15.78:0/2347898733 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe47c0c6fb0 0x7fe47c1ebee0 unknown :-1 s=CLOSED pgs=608 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:06.934 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:06.929+0000 7fe481217640 1 --2- 172.21.15.78:0/2347898733 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe47c0c2660 0x7fe47c1431e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:06.934 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:06.929+0000 7fe481217640 1 -- 172.21.15.78:0/2347898733 >> 172.21.15.78:0/2347898733 conn(0x7fe47c0c7c60 msgr2=0x7fe47c06f410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:01:06.934 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:06.929+0000 7fe481217640 1 -- 172.21.15.78:0/2347898733 shutdown_connections 2023-11-28T20:01:06.934 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:06.929+0000 7fe481217640 1 -- 172.21.15.78:0/2347898733 wait complete. 2023-11-28T20:01:06.953 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-28T19:58:54.011229+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-28T20:01:06.954 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-28T20:01:07.095 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:07.089+0000 7fdd00a67640 1 Processor -- start 2023-11-28T20:01:07.095 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:07.089+0000 7fdd00a67640 1 -- start start 2023-11-28T20:01:07.097 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:07.093+0000 7fdd00a67640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fdcfc0c45d0 0x7fdcfc0c49b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:07.097 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:07.093+0000 7fdd00a67640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fdcfc0c3070 0x7fdcfc1549e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:07.097 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:07.093+0000 7fdd00a67640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdcfc154f20 con 0x7fdcfc0a6e70 2023-11-28T20:01:07.097 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:07.093+0000 7fdd00a67640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdcfc0c7180 con 0x7fdcfc0c45d0 2023-11-28T20:01:07.097 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:07.093+0000 7fdd00a67640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdcfc0c7af0 con 0x7fdcfc0c3070 2023-11-28T20:01:07.097 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:07.093+0000 7fdcfb7fe640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fdcfc0c45d0 0x7fdcfc0c49b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:07.097 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:07.093+0000 7fdcfb7fe640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fdcfc0c45d0 0x7fdcfc0c49b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:55812/0 (socket says 172.21.15.78:55812) 2023-11-28T20:01:07.097 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:07.093+0000 7fdcfb7fe640 1 -- 172.21.15.78:0/1362578107 learned_addr learned my addr 172.21.15.78:0/1362578107 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T20:01:07.098 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:07.093+0000 7fdcfbfff640 1 --2- 172.21.15.78:0/1362578107 >> v2:172.21.15.179:3300/0 conn(0x7fdcfc0c3070 0x7fdcfc1549e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:07.098 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:07.093+0000 7fdcfb7fe640 1 -- 172.21.15.78:0/1362578107 >> v2:172.21.15.179:3300/0 conn(0x7fdcfc0c3070 msgr2=0x7fdcfc1549e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:01:07.098 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:07.093+0000 7fdcfb7fe640 1 --2- 172.21.15.78:0/1362578107 >> v2:172.21.15.179:3300/0 conn(0x7fdcfc0c3070 0x7fdcfc1549e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:07.098 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:07.093+0000 7fdcfb7fe640 1 -- 172.21.15.78:0/1362578107 >> v1:172.21.15.179:6789/0 conn(0x7fdcfc0a6e70 legacy=0x7fdcfc1542d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:01:07.098 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:07.093+0000 7fdcfb7fe640 1 -- 172.21.15.78:0/1362578107 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdcfc0c6be0 con 0x7fdcfc0c45d0 2023-11-28T20:01:07.099 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:07.097+0000 7fdcfb7fe640 1 --2- 172.21.15.78:0/1362578107 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdcfc0c45d0 0x7fdcfc0c49b0 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7fdcfc0c8bd0 tx=0x7fdcec01c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=680ed3872a88ed01 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:01:07.100 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:07.097+0000 7fdcfaffd640 1 -- 172.21.15.78:0/1362578107 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcec0ad660 con 0x7fdcfc0c45d0 2023-11-28T20:01:07.100 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:07.097+0000 7fdcfaffd640 1 -- 172.21.15.78:0/1362578107 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdcec0ad7c0 con 0x7fdcfc0c45d0 2023-11-28T20:01:07.100 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:07.097+0000 7fdcfaffd640 1 -- 172.21.15.78:0/1362578107 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcec0adb50 con 0x7fdcfc0c45d0 2023-11-28T20:01:07.101 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:07.097+0000 7fdd00a67640 1 -- 172.21.15.78:0/1362578107 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdcfc0c45d0 msgr2=0x7fdcfc0c49b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:01:07.101 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:07.097+0000 7fdd00a67640 1 --2- 172.21.15.78:0/1362578107 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdcfc0c45d0 0x7fdcfc0c49b0 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7fdcfc0c8bd0 tx=0x7fdcec01c470 comp rx=0 tx=0).stop 2023-11-28T20:01:07.101 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:07.097+0000 7fdd00a67640 1 -- 172.21.15.78:0/1362578107 shutdown_connections 2023-11-28T20:01:07.101 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:07.097+0000 7fdd00a67640 1 --2- 172.21.15.78:0/1362578107 >> v2:172.21.15.179:3300/0 conn(0x7fdcfc0c3070 0x7fdcfc1549e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:07.101 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:07.097+0000 7fdd00a67640 1 --2- 172.21.15.78:0/1362578107 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdcfc0c45d0 0x7fdcfc0c49b0 unknown :-1 s=CLOSED pgs=609 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:07.101 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:07.097+0000 7fdd00a67640 1 -- 172.21.15.78:0/1362578107 >> 172.21.15.78:0/1362578107 conn(0x7fdcfc0c7c60 msgr2=0x7fdcfc0c8070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:01:07.101 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:07.097+0000 7fdd00a67640 1 -- 172.21.15.78:0/1362578107 shutdown_connections 2023-11-28T20:01:07.102 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:07.097+0000 7fdd00a67640 1 -- 172.21.15.78:0/1362578107 wait complete. 2023-11-28T20:01:07.102 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:07.097+0000 7fdd00a67640 1 Processor -- start 2023-11-28T20:01:07.103 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:07.097+0000 7fdd00a67640 1 -- start start 2023-11-28T20:01:07.106 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:07.097+0000 7fdd00a67640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdcfc0a6e70 0x7fdcfc15e6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:07.106 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:07.097+0000 7fdd00a67640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdcfc0c3070 0x7fdcfc14ff60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:07.106 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:07.097+0000 7fdd00a67640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdcfc0c45d0 0x7fdcfc0a9c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:07.107 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:07.097+0000 7fdd00a67640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdcfc0a82e0 con 0x7fdcfc0a6e70 2023-11-28T20:01:07.107 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:07.097+0000 7fdd00a67640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdcfc06e8a0 con 0x7fdcfc0c3070 2023-11-28T20:01:07.107 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:07.097+0000 7fdd00a67640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdcfc06eb80 con 0x7fdcfc0c45d0 2023-11-28T20:01:07.107 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:07.097+0000 7fdcfb7fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdcfc0a6e70 0x7fdcfc15e6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:07.107 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:07.097+0000 7fdcfb7fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdcfc0a6e70 0x7fdcfc15e6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:55828/0 (socket says 172.21.15.78:55828) 2023-11-28T20:01:07.107 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:07.097+0000 7fdcfb7fe640 1 -- 172.21.15.78:0/2242880919 learned_addr learned my addr 172.21.15.78:0/2242880919 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T20:01:07.107 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:07.101+0000 7fdcf3fff640 1 --2- 172.21.15.78:0/2242880919 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdcfc0c3070 0x7fdcfc14ff60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:07.107 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:07.101+0000 7fdcfbfff640 1 --2- 172.21.15.78:0/2242880919 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdcfc0c45d0 0x7fdcfc0a9c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:07.108 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:07.101+0000 7fdcfb7fe640 1 -- 172.21.15.78:0/2242880919 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdcfc0c45d0 msgr2=0x7fdcfc0a9c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:01:07.108 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:07.101+0000 7fdcfb7fe640 1 --2- 172.21.15.78:0/2242880919 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdcfc0c45d0 0x7fdcfc0a9c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:07.108 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:07.101+0000 7fdcfb7fe640 1 -- 172.21.15.78:0/2242880919 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdcfc0c3070 msgr2=0x7fdcfc14ff60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:01:07.108 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:07.101+0000 7fdcfb7fe640 1 --2- 172.21.15.78:0/2242880919 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdcfc0c3070 0x7fdcfc14ff60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:07.108 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:07.101+0000 7fdcfb7fe640 1 -- 172.21.15.78:0/2242880919 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdcec0094d0 con 0x7fdcfc0a6e70 2023-11-28T20:01:07.108 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:07.101+0000 7fdcfb7fe640 1 --2- 172.21.15.78:0/2242880919 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdcfc0a6e70 0x7fdcfc15e6b0 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7fdcec019080 tx=0x7fdcec019210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:01:07.108 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:07.101+0000 7fdcf8ff9640 1 -- 172.21.15.78:0/2242880919 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcec0b6640 con 0x7fdcfc0a6e70 2023-11-28T20:01:07.108 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:07.101+0000 7fdcf8ff9640 1 -- 172.21.15.78:0/2242880919 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdcec0b67a0 con 0x7fdcfc0a6e70 2023-11-28T20:01:07.109 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:07.101+0000 7fdcf8ff9640 1 -- 172.21.15.78:0/2242880919 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcec0b6b30 con 0x7fdcfc0a6e70 2023-11-28T20:01:07.109 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:07.101+0000 7fdd00a67640 1 -- 172.21.15.78:0/2242880919 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdcfc0a7c20 con 0x7fdcfc0a6e70 2023-11-28T20:01:07.109 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:07.101+0000 7fdd00a67640 1 -- 172.21.15.78:0/2242880919 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdcfc1504a0 con 0x7fdcfc0a6e70 2023-11-28T20:01:07.109 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:07.101+0000 7fdd00a67640 1 -- 172.21.15.78:0/2242880919 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdcfc0c2ee0 con 0x7fdcfc0a6e70 2023-11-28T20:01:07.109 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:07.101+0000 7fdcf8ff9640 1 -- 172.21.15.78:0/2242880919 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fdcec0b4070 con 0x7fdcfc0a6e70 2023-11-28T20:01:07.110 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:07.101+0000 7fdcf8ff9640 1 --2- 172.21.15.78:0/2242880919 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fdcdc066470 0x7fdcdc068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:07.110 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:07.101+0000 7fdcf8ff9640 1 -- 172.21.15.78:0/2242880919 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(57..57 src has 1..57) v4 ==== 5177+0+0 (secure 0 0 0) 0x7fdcec11de20 con 0x7fdcfc0a6e70 2023-11-28T20:01:07.110 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:07.101+0000 7fdcf3fff640 1 --2- 172.21.15.78:0/2242880919 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fdcdc066470 0x7fdcdc068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:07.110 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:07.105+0000 7fdcf3fff640 1 --2- 172.21.15.78:0/2242880919 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fdcdc066470 0x7fdcdc068930 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7fdcfc14cf70 tx=0x7fdce4009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:01:07.113 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:07.105+0000 7fdcf8ff9640 1 -- 172.21.15.78:0/2242880919 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fdcec0eb4a0 con 0x7fdcfc0a6e70 2023-11-28T20:01:07.264 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:07.261+0000 7fdd00a67640 1 -- 172.21.15.78:0/2242880919 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fdcfc0674b0 con 0x7fdcfc0a6e70 2023-11-28T20:01:07.264 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:07.261+0000 7fdcf8ff9640 1 -- 172.21.15.78:0/2242880919 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v57) v1 ==== 93+0+10 (secure 0 0 0) 0x7fdcec0eeac0 con 0x7fdcfc0a6e70 2023-11-28T20:01:07.264 INFO:teuthology.orchestra.run.smithi078.stdout:pg_num: 1 2023-11-28T20:01:07.266 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:07.261+0000 7fdd00a67640 1 -- 172.21.15.78:0/2242880919 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fdcdc066470 msgr2=0x7fdcdc068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:01:07.266 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:07.261+0000 7fdd00a67640 1 --2- 172.21.15.78:0/2242880919 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fdcdc066470 0x7fdcdc068930 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7fdcfc14cf70 tx=0x7fdce4009040 comp rx=0 tx=0).stop 2023-11-28T20:01:07.266 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:07.261+0000 7fdd00a67640 1 -- 172.21.15.78:0/2242880919 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdcfc0a6e70 msgr2=0x7fdcfc15e6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:01:07.266 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:07.261+0000 7fdd00a67640 1 --2- 172.21.15.78:0/2242880919 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdcfc0a6e70 0x7fdcfc15e6b0 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7fdcec019080 tx=0x7fdcec019210 comp rx=0 tx=0).stop 2023-11-28T20:01:07.266 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:07.261+0000 7fdd00a67640 1 -- 172.21.15.78:0/2242880919 shutdown_connections 2023-11-28T20:01:07.267 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:07.261+0000 7fdd00a67640 1 --2- 172.21.15.78:0/2242880919 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fdcdc066470 0x7fdcdc068930 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:07.267 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:07.261+0000 7fdd00a67640 1 --2- 172.21.15.78:0/2242880919 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdcfc0c45d0 0x7fdcfc0a9c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:07.267 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:07.261+0000 7fdd00a67640 1 --2- 172.21.15.78:0/2242880919 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdcfc0c3070 0x7fdcfc14ff60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:07.267 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:07.261+0000 7fdd00a67640 1 --2- 172.21.15.78:0/2242880919 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdcfc0a6e70 0x7fdcfc15e6b0 unknown :-1 s=CLOSED pgs=610 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:07.267 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:07.261+0000 7fdd00a67640 1 -- 172.21.15.78:0/2242880919 >> 172.21.15.78:0/2242880919 conn(0x7fdcfc0c7c60 msgr2=0x7fdcfc14a910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:01:07.267 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:07.261+0000 7fdd00a67640 1 -- 172.21.15.78:0/2242880919 shutdown_connections 2023-11-28T20:01:07.267 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:07.261+0000 7fdd00a67640 1 -- 172.21.15.78:0/2242880919 wait complete. 2023-11-28T20:01:07.285 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-11-28T20:01:07.422 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:07.417+0000 7fec0e06b640 1 Processor -- start 2023-11-28T20:01:07.422 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:07.417+0000 7fec0e06b640 1 -- start start 2023-11-28T20:01:07.424 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:07.417+0000 7fec0e06b640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fec0806d2b0 0x7fec0806d690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:07.424 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:07.417+0000 7fec0e06b640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fec080c3b80 0x7fec080c5300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:07.425 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:07.417+0000 7fec0e06b640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fec0806bb80 con 0x7fec0806c020 2023-11-28T20:01:07.425 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:07.417+0000 7fec0e06b640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fec080c5840 con 0x7fec080c3b80 2023-11-28T20:01:07.425 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:07.417+0000 7fec0e06b640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fec081515c0 con 0x7fec0806d2b0 2023-11-28T20:01:07.425 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:07.421+0000 7fec06ffd640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fec080c3b80 0x7fec080c5300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:07.425 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:07.421+0000 7fec06ffd640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fec080c3b80 0x7fec080c5300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:55838/0 (socket says 172.21.15.78:55838) 2023-11-28T20:01:07.426 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:07.421+0000 7fec06ffd640 1 -- 172.21.15.78:0/3392219354 learned_addr learned my addr 172.21.15.78:0/3392219354 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T20:01:07.426 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:07.421+0000 7fec077fe640 1 --2- 172.21.15.78:0/3392219354 >> v2:172.21.15.179:3300/0 conn(0x7fec0806d2b0 0x7fec0806d690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:07.426 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:07.421+0000 7fec06ffd640 1 -- 172.21.15.78:0/3392219354 >> v2:172.21.15.179:3300/0 conn(0x7fec0806d2b0 msgr2=0x7fec0806d690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:01:07.426 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:07.421+0000 7fec06ffd640 1 --2- 172.21.15.78:0/3392219354 >> v2:172.21.15.179:3300/0 conn(0x7fec0806d2b0 0x7fec0806d690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:07.426 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:07.421+0000 7fec06ffd640 1 -- 172.21.15.78:0/3392219354 >> v1:172.21.15.179:6789/0 conn(0x7fec0806c020 legacy=0x7fec0806c4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:01:07.427 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:07.421+0000 7fec06ffd640 1 -- 172.21.15.78:0/3392219354 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec081518a0 con 0x7fec080c3b80 2023-11-28T20:01:07.427 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:07.421+0000 7fec077fe640 1 --2- 172.21.15.78:0/3392219354 >> v2:172.21.15.179:3300/0 conn(0x7fec0806d2b0 0x7fec0806d690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T20:01:07.428 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:07.421+0000 7fec06ffd640 1 --2- 172.21.15.78:0/3392219354 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fec080c3b80 0x7fec080c5300 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7fec080c2130 tx=0x7febfc01c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=da855896e6e45149 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:01:07.428 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:07.421+0000 7fec067fc640 1 -- 172.21.15.78:0/3392219354 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febfc0aa5f0 con 0x7fec080c3b80 2023-11-28T20:01:07.428 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:07.421+0000 7fec067fc640 1 -- 172.21.15.78:0/3392219354 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7febfc0aa750 con 0x7fec080c3b80 2023-11-28T20:01:07.428 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:07.421+0000 7fec067fc640 1 -- 172.21.15.78:0/3392219354 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febfc0aaae0 con 0x7fec080c3b80 2023-11-28T20:01:07.428 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:07.425+0000 7fec0e06b640 1 -- 172.21.15.78:0/3392219354 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fec080c3b80 msgr2=0x7fec080c5300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:01:07.428 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:07.425+0000 7fec0e06b640 1 --2- 172.21.15.78:0/3392219354 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fec080c3b80 0x7fec080c5300 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7fec080c2130 tx=0x7febfc01c490 comp rx=0 tx=0).stop 2023-11-28T20:01:07.428 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:07.425+0000 7fec0e06b640 1 -- 172.21.15.78:0/3392219354 shutdown_connections 2023-11-28T20:01:07.428 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:07.425+0000 7fec0e06b640 1 --2- 172.21.15.78:0/3392219354 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fec080c3b80 0x7fec080c5300 unknown :-1 s=CLOSED pgs=611 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:07.429 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:07.425+0000 7fec0e06b640 1 --2- 172.21.15.78:0/3392219354 >> v2:172.21.15.179:3300/0 conn(0x7fec0806d2b0 0x7fec0806d690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:07.429 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:07.425+0000 7fec0e06b640 1 -- 172.21.15.78:0/3392219354 >> 172.21.15.78:0/3392219354 conn(0x7fec080a7810 msgr2=0x7fec080a7c20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:01:07.429 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:07.425+0000 7fec0e06b640 1 -- 172.21.15.78:0/3392219354 shutdown_connections 2023-11-28T20:01:07.429 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:07.425+0000 7fec0e06b640 1 -- 172.21.15.78:0/3392219354 wait complete. 2023-11-28T20:01:07.429 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:07.425+0000 7fec0e06b640 1 Processor -- start 2023-11-28T20:01:07.430 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:07.425+0000 7fec0e06b640 1 -- start start 2023-11-28T20:01:07.431 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:07.425+0000 7fec0e06b640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fec0806c020 0x7fec080baa80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:07.431 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:07.425+0000 7fec0e06b640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fec0806d2b0 0x7fec081f0f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:07.431 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:07.425+0000 7fec0e06b640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fec080c3b80 0x7fec0814ba80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:07.431 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:07.425+0000 7fec0e06b640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec081f0530 con 0x7fec080c3b80 2023-11-28T20:01:07.431 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:07.425+0000 7fec0e06b640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec080c0800 con 0x7fec0806d2b0 2023-11-28T20:01:07.432 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:07.425+0000 7fec0e06b640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fec080c0ae0 con 0x7fec0806c020 2023-11-28T20:01:07.432 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:07.425+0000 7fec07fff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fec080c3b80 0x7fec0814ba80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:07.432 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:07.425+0000 7fec07fff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fec080c3b80 0x7fec0814ba80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:55846/0 (socket says 172.21.15.78:55846) 2023-11-28T20:01:07.432 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:07.425+0000 7fec07fff640 1 -- 172.21.15.78:0/1864302744 learned_addr learned my addr 172.21.15.78:0/1864302744 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T20:01:07.432 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:07.425+0000 7fec077fe640 1 --2- 172.21.15.78:0/1864302744 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fec0806c020 0x7fec080baa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:07.432 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:07.425+0000 7fec06ffd640 1 --2- 172.21.15.78:0/1864302744 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fec0806d2b0 0x7fec081f0f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:07.432 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:07.425+0000 7fec07fff640 1 -- 172.21.15.78:0/1864302744 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fec0806c020 msgr2=0x7fec080baa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:01:07.432 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:07.425+0000 7fec07fff640 1 --2- 172.21.15.78:0/1864302744 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fec0806c020 0x7fec080baa80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:07.432 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:07.425+0000 7fec07fff640 1 -- 172.21.15.78:0/1864302744 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fec0806d2b0 msgr2=0x7fec081f0f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:01:07.432 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:07.425+0000 7fec07fff640 1 --2- 172.21.15.78:0/1864302744 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fec0806d2b0 0x7fec081f0f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:07.432 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:07.425+0000 7fec07fff640 1 -- 172.21.15.78:0/1864302744 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7febfc0094d0 con 0x7fec080c3b80 2023-11-28T20:01:07.433 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:07.425+0000 7fec06ffd640 1 --2- 172.21.15.78:0/1864302744 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fec0806d2b0 0x7fec081f0f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T20:01:07.434 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:07.429+0000 7fec07fff640 1 --2- 172.21.15.78:0/1864302744 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fec080c3b80 0x7fec0814ba80 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7fec0000c780 tx=0x7fec0000cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:01:07.434 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:07.429+0000 7febeffff640 1 -- 172.21.15.78:0/1864302744 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec00004b20 con 0x7fec080c3b80 2023-11-28T20:01:07.434 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:07.429+0000 7febeffff640 1 -- 172.21.15.78:0/1864302744 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec00004c80 con 0x7fec080c3b80 2023-11-28T20:01:07.434 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:07.429+0000 7febeffff640 1 -- 172.21.15.78:0/1864302744 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec0000aa90 con 0x7fec080c3b80 2023-11-28T20:01:07.434 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:07.429+0000 7fec0e06b640 1 -- 172.21.15.78:0/1864302744 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fec0814ef80 con 0x7fec080c3b80 2023-11-28T20:01:07.434 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:07.429+0000 7fec0e06b640 1 -- 172.21.15.78:0/1864302744 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fec081f0a60 con 0x7fec080c3b80 2023-11-28T20:01:07.434 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:07.429+0000 7fec0e06b640 1 -- 172.21.15.78:0/1864302744 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fec080679d0 con 0x7fec080c3b80 2023-11-28T20:01:07.434 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:07.429+0000 7febeffff640 1 -- 172.21.15.78:0/1864302744 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fec0000abf0 con 0x7fec080c3b80 2023-11-28T20:01:07.435 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:07.429+0000 7febeffff640 1 --2- 172.21.15.78:0/1864302744 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7febf4066470 0x7febf4068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:07.435 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:07.429+0000 7febeffff640 1 -- 172.21.15.78:0/1864302744 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(57..57 src has 1..57) v4 ==== 5177+0+0 (secure 0 0 0) 0x7fec00083df0 con 0x7fec080c3b80 2023-11-28T20:01:07.435 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:07.433+0000 7fec077fe640 1 --2- 172.21.15.78:0/1864302744 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7febf4066470 0x7febf4068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:07.436 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:07.433+0000 7fec077fe640 1 --2- 172.21.15.78:0/1864302744 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7febf4066470 0x7febf4068930 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fec080680c0 tx=0x7febf8008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:01:07.439 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:07.433+0000 7febeffff640 1 -- 172.21.15.78:0/1864302744 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fec000513e0 con 0x7fec080c3b80 2023-11-28T20:01:07.591 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:07.589+0000 7fec0e06b640 1 -- 172.21.15.78:0/1864302744 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7fec080c0ca0 con 0x7fec080c3b80 2023-11-28T20:01:07.592 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:07.589+0000 7febeffff640 1 -- 172.21.15.78:0/1864302744 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v57) v1 ==== 84+0+65 (secure 0 0 0) 0x7fec00054a00 con 0x7fec080c3b80 2023-11-28T20:01:07.592 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-11-28T20:01:07.592 INFO:teuthology.orchestra.run.smithi078.stdout:[ 2023-11-28T20:01:07.592 INFO:teuthology.orchestra.run.smithi078.stdout: { 2023-11-28T20:01:07.593 INFO:teuthology.orchestra.run.smithi078.stdout: "poolnum": 1, 2023-11-28T20:01:07.593 INFO:teuthology.orchestra.run.smithi078.stdout: "poolname": ".mgr" 2023-11-28T20:01:07.593 INFO:teuthology.orchestra.run.smithi078.stdout: } 2023-11-28T20:01:07.593 INFO:teuthology.orchestra.run.smithi078.stdout:] 2023-11-28T20:01:07.594 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:07.589+0000 7fec0e06b640 1 -- 172.21.15.78:0/1864302744 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7febf4066470 msgr2=0x7febf4068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:01:07.594 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:07.589+0000 7fec0e06b640 1 --2- 172.21.15.78:0/1864302744 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7febf4066470 0x7febf4068930 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fec080680c0 tx=0x7febf8008040 comp rx=0 tx=0).stop 2023-11-28T20:01:07.594 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:07.589+0000 7fec0e06b640 1 -- 172.21.15.78:0/1864302744 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fec080c3b80 msgr2=0x7fec0814ba80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:01:07.594 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:07.589+0000 7fec0e06b640 1 --2- 172.21.15.78:0/1864302744 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fec080c3b80 0x7fec0814ba80 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7fec0000c780 tx=0x7fec0000cc40 comp rx=0 tx=0).stop 2023-11-28T20:01:07.594 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:07.589+0000 7fec0e06b640 1 -- 172.21.15.78:0/1864302744 shutdown_connections 2023-11-28T20:01:07.594 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:07.589+0000 7fec0e06b640 1 --2- 172.21.15.78:0/1864302744 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7febf4066470 0x7febf4068930 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:07.595 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:07.589+0000 7fec0e06b640 1 --2- 172.21.15.78:0/1864302744 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fec080c3b80 0x7fec0814ba80 unknown :-1 s=CLOSED pgs=612 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:07.595 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:07.589+0000 7fec0e06b640 1 --2- 172.21.15.78:0/1864302744 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fec0806d2b0 0x7fec081f0f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:07.595 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:07.589+0000 7fec0e06b640 1 --2- 172.21.15.78:0/1864302744 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fec0806c020 0x7fec080baa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:07.595 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:07.589+0000 7fec0e06b640 1 -- 172.21.15.78:0/1864302744 >> 172.21.15.78:0/1864302744 conn(0x7fec080a7810 msgr2=0x7fec0814e170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:01:07.595 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:07.589+0000 7fec0e06b640 1 -- 172.21.15.78:0/1864302744 shutdown_connections 2023-11-28T20:01:07.595 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:07.589+0000 7fec0e06b640 1 -- 172.21.15.78:0/1864302744 wait complete. 2023-11-28T20:01:07.613 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-11-28T20:01:07.613 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-11-28T20:01:07.754 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:07.749+0000 7f2de8cc9640 1 Processor -- start 2023-11-28T20:01:07.755 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:07.749+0000 7f2de8cc9640 1 -- start start 2023-11-28T20:01:07.755 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:07.753+0000 7f2de8cc9640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f2de414e2a0 0x7f2de41516a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:07.756 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:07.753+0000 7f2de8cc9640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2de40a9910 0x7f2de406bc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:07.756 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:07.753+0000 7f2de8cc9640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2de4151210 con 0x7f2de40a9460 2023-11-28T20:01:07.756 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:07.753+0000 7f2de8cc9640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2de414e680 con 0x7f2de414e2a0 2023-11-28T20:01:07.756 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:07.753+0000 7f2de8cc9640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2de4150be0 con 0x7f2de40a9910 2023-11-28T20:01:07.756 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:07.753+0000 7f2de1d9b640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f2de40a9460 0x7f2de40c4180 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:59758/0 (socket says 172.21.15.78:59758) 2023-11-28T20:01:07.756 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:07.753+0000 7f2de1d9b640 1 -- 172.21.15.78:0/2799705162 learned_addr learned my addr 172.21.15.78:0/2799705162 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-11-28T20:01:07.758 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:07.753+0000 7f2de259c640 1 --2- 172.21.15.78:0/2799705162 >> v2:172.21.15.179:3300/0 conn(0x7f2de414e2a0 0x7f2de41516a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:07.758 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:07.753+0000 7f2de2d9d640 1 --2- 172.21.15.78:0/2799705162 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2de40a9910 0x7f2de406bc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:07.758 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:07.753+0000 7f2de159a640 1 -- 172.21.15.78:0/2799705162 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1589541773 0 0) 0x7f2de4151210 con 0x7f2de40a9460 2023-11-28T20:01:07.758 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:07.753+0000 7f2de159a640 1 -- 172.21.15.78:0/2799705162 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2dcc003530 con 0x7f2de40a9460 2023-11-28T20:01:07.758 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:07.753+0000 7f2de159a640 1 -- 172.21.15.78:0/2799705162 <== mon.0 v1:172.21.15.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 248799006 0 0) 0x7f2dcc003530 con 0x7f2de40a9460 2023-11-28T20:01:07.758 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:07.753+0000 7f2de159a640 1 -- 172.21.15.78:0/2799705162 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2de40a9910 msgr2=0x7f2de406bc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:01:07.759 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:07.753+0000 7f2de159a640 1 --2- 172.21.15.78:0/2799705162 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2de40a9910 0x7f2de406bc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:07.759 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:07.753+0000 7f2de159a640 1 -- 172.21.15.78:0/2799705162 >> v2:172.21.15.179:3300/0 conn(0x7f2de414e2a0 msgr2=0x7f2de41516a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:01:07.759 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:07.753+0000 7f2de159a640 1 --2- 172.21.15.78:0/2799705162 >> v2:172.21.15.179:3300/0 conn(0x7f2de414e2a0 0x7f2de41516a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:07.759 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:07.753+0000 7f2de159a640 1 -- 172.21.15.78:0/2799705162 --> v1:172.21.15.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2de40c53c0 con 0x7f2de40a9460 2023-11-28T20:01:07.759 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:07.753+0000 7f2de159a640 1 -- 172.21.15.78:0/2799705162 <== mon.0 v1:172.21.15.78:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3326804700 0 0) 0x7f2dd8001680 con 0x7f2de40a9460 2023-11-28T20:01:07.759 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:07.753+0000 7f2de159a640 1 -- 172.21.15.78:0/2799705162 >> v1:172.21.15.78:6789/0 conn(0x7f2de40a9460 legacy=0x7f2de40c4180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:01:07.759 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:07.753+0000 7f2de159a640 1 --2- 172.21.15.78:0/2799705162 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2de40a9910 0x7f2dcc003980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:07.760 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:07.753+0000 7f2de159a640 1 --2- 172.21.15.78:0/2799705162 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2dcc003f00 0x7f2dcc0047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:07.760 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:07.753+0000 7f2de159a640 1 --2- 172.21.15.78:0/2799705162 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2dcc004d10 0x7f2dcc005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:07.760 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:07.753+0000 7f2de159a640 1 -- 172.21.15.78:0/2799705162 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2de414e680 con 0x7f2dcc003f00 2023-11-28T20:01:07.760 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:07.753+0000 7f2de159a640 1 -- 172.21.15.78:0/2799705162 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2de4150be0 con 0x7f2dcc004d10 2023-11-28T20:01:07.760 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:07.753+0000 7f2de159a640 1 -- 172.21.15.78:0/2799705162 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2dcc00b990 con 0x7f2de40a9910 2023-11-28T20:01:07.760 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:07.753+0000 7f2de1d9b640 1 --2- 172.21.15.78:0/2799705162 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2dcc003f00 0x7f2dcc0047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:07.760 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:07.753+0000 7f2de259c640 1 --2- 172.21.15.78:0/2799705162 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2de40a9910 0x7f2dcc003980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:07.760 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:07.753+0000 7f2de2d9d640 1 --2- 172.21.15.78:0/2799705162 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2dcc004d10 0x7f2dcc005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:07.760 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:07.753+0000 7f2de1d9b640 1 -- 172.21.15.78:0/2799705162 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2de40a9910 msgr2=0x7f2dcc003980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:01:07.760 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:07.753+0000 7f2de1d9b640 1 --2- 172.21.15.78:0/2799705162 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2de40a9910 0x7f2dcc003980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:07.760 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:07.753+0000 7f2de1d9b640 1 -- 172.21.15.78:0/2799705162 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2dcc004d10 msgr2=0x7f2dcc005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:01:07.761 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:07.753+0000 7f2de1d9b640 1 --2- 172.21.15.78:0/2799705162 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2dcc004d10 0x7f2dcc005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:07.761 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:07.753+0000 7f2de1d9b640 1 -- 172.21.15.78:0/2799705162 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2dcc003530 con 0x7f2dcc003f00 2023-11-28T20:01:07.762 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:07.757+0000 7f2de1d9b640 1 --2- 172.21.15.78:0/2799705162 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2dcc003f00 0x7f2dcc0047d0 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7f2dd800c210 tx=0x7f2dd801f350 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c02a989f586cd090 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:01:07.762 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:07.757+0000 7f2de159a640 1 -- 172.21.15.78:0/2799705162 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2dd8005ae0 con 0x7f2dcc003f00 2023-11-28T20:01:07.762 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:07.757+0000 7f2de159a640 1 -- 172.21.15.78:0/2799705162 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2dd80ab070 con 0x7f2dcc003f00 2023-11-28T20:01:07.762 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:07.757+0000 7f2de159a640 1 -- 172.21.15.78:0/2799705162 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2dd8007070 con 0x7f2dcc003f00 2023-11-28T20:01:07.762 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:07.757+0000 7f2de8cc9640 1 -- 172.21.15.78:0/2799705162 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2dcc003f00 msgr2=0x7f2dcc0047d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:01:07.762 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:07.757+0000 7f2de8cc9640 1 --2- 172.21.15.78:0/2799705162 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2dcc003f00 0x7f2dcc0047d0 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7f2dd800c210 tx=0x7f2dd801f350 comp rx=0 tx=0).stop 2023-11-28T20:01:07.762 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:07.757+0000 7f2de2d9d640 1 -- 172.21.15.78:0/2799705162 reap_dead start 2023-11-28T20:01:07.762 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:07.757+0000 7f2de8cc9640 1 -- 172.21.15.78:0/2799705162 shutdown_connections 2023-11-28T20:01:07.762 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:07.757+0000 7f2de8cc9640 1 -- 172.21.15.78:0/2799705162 >> 172.21.15.78:0/2799705162 conn(0x7f2de40c59f0 msgr2=0x7f2de40c5e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:01:07.763 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:07.757+0000 7f2de8cc9640 1 -- 172.21.15.78:0/2799705162 shutdown_connections 2023-11-28T20:01:07.763 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:07.757+0000 7f2de8cc9640 1 -- 172.21.15.78:0/2799705162 wait complete. 2023-11-28T20:01:07.763 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:07.757+0000 7f2de8cc9640 1 Processor -- start 2023-11-28T20:01:07.763 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:07.757+0000 7f2de8cc9640 1 -- start start 2023-11-28T20:01:07.765 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:07.761+0000 7f2de8cc9640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2dcc003f00 0x7f2de4072630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:07.766 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:07.761+0000 7f2de8cc9640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2de4070800 0x7f2de40c1650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:07.766 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:07.761+0000 7f2de8cc9640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2de4152260 0x7f2de414cad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:07.766 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:07.761+0000 7f2de8cc9640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2de4070c80 con 0x7f2dcc003f00 2023-11-28T20:01:07.766 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:07.761+0000 7f2de8cc9640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2de40721a0 con 0x7f2de4070800 2023-11-28T20:01:07.766 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:07.761+0000 7f2de8cc9640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2de4071b90 con 0x7f2de4152260 2023-11-28T20:01:07.766 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:07.761+0000 7f2de259c640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2dcc003f00 0x7f2de4072630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:07.766 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:07.761+0000 7f2de259c640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2dcc003f00 0x7f2de4072630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:55854/0 (socket says 172.21.15.78:55854) 2023-11-28T20:01:07.766 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:07.761+0000 7f2de259c640 1 -- 172.21.15.78:0/1280460188 learned_addr learned my addr 172.21.15.78:0/1280460188 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T20:01:07.766 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:07.761+0000 7f2de1d9b640 1 --2- 172.21.15.78:0/1280460188 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2de4070800 0x7f2de40c1650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:07.766 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:07.761+0000 7f2de2d9d640 1 --2- 172.21.15.78:0/1280460188 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2de4152260 0x7f2de414cad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:07.766 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:07.761+0000 7f2de259c640 1 -- 172.21.15.78:0/1280460188 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2de4152260 msgr2=0x7f2de414cad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:01:07.767 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:07.761+0000 7f2de259c640 1 --2- 172.21.15.78:0/1280460188 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2de4152260 0x7f2de414cad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:07.767 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:07.761+0000 7f2de259c640 1 -- 172.21.15.78:0/1280460188 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2de4070800 msgr2=0x7f2de40c1650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:01:07.767 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:07.761+0000 7f2de259c640 1 --2- 172.21.15.78:0/1280460188 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2de4070800 0x7f2de40c1650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:07.767 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:07.761+0000 7f2de259c640 1 -- 172.21.15.78:0/1280460188 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2de4150980 con 0x7f2dcc003f00 2023-11-28T20:01:07.767 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:07.761+0000 7f2de259c640 1 --2- 172.21.15.78:0/1280460188 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2dcc003f00 0x7f2de4072630 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7f2dd40119d0 tx=0x7f2dd4011e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:01:07.767 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:07.761+0000 7f2dd2ffd640 1 -- 172.21.15.78:0/1280460188 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2dd400fb50 con 0x7f2dcc003f00 2023-11-28T20:01:07.767 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:07.761+0000 7f2dd2ffd640 1 -- 172.21.15.78:0/1280460188 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2dd400fcb0 con 0x7f2dcc003f00 2023-11-28T20:01:07.767 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:07.761+0000 7f2de8cc9640 1 -- 172.21.15.78:0/1280460188 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2de4154cb0 con 0x7f2dcc003f00 2023-11-28T20:01:07.767 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:07.761+0000 7f2dd2ffd640 1 -- 172.21.15.78:0/1280460188 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2dd4014440 con 0x7f2dcc003f00 2023-11-28T20:01:07.767 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:07.761+0000 7f2de8cc9640 1 -- 172.21.15.78:0/1280460188 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2de4154f90 con 0x7f2dcc003f00 2023-11-28T20:01:07.768 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:07.761+0000 7f2de8cc9640 1 -- 172.21.15.78:0/1280460188 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2de414b4b0 con 0x7f2dcc003f00 2023-11-28T20:01:07.768 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:07.761+0000 7f2dd2ffd640 1 -- 172.21.15.78:0/1280460188 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f2dd40145a0 con 0x7f2dcc003f00 2023-11-28T20:01:07.768 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:07.765+0000 7f2dd2ffd640 1 --2- 172.21.15.78:0/1280460188 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f2dc40664a0 0x7f2dc4068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:07.768 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:07.765+0000 7f2dd2ffd640 1 -- 172.21.15.78:0/1280460188 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(57..57 src has 1..57) v4 ==== 5177+0+0 (secure 0 0 0) 0x7f2dd40843d0 con 0x7f2dcc003f00 2023-11-28T20:01:07.768 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:07.765+0000 7f2de1d9b640 1 --2- 172.21.15.78:0/1280460188 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f2dc40664a0 0x7f2dc4068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:07.769 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:07.765+0000 7f2de1d9b640 1 --2- 172.21.15.78:0/1280460188 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f2dc40664a0 0x7f2dc4068960 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f2dd80ae000 tx=0x7f2dd80b4040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:01:07.772 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:07.769+0000 7f2dd2ffd640 1 -- 172.21.15.78:0/1280460188 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f2dd4051bc0 con 0x7f2dcc003f00 2023-11-28T20:01:07.926 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:07.921+0000 7f2de8cc9640 1 -- 172.21.15.78:0/1280460188 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f2de4067630 con 0x7f2dcc003f00 2023-11-28T20:01:08.481 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:08.477+0000 7f2dd2ffd640 1 -- 172.21.15.78:0/1280460188 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v58) v1 ==== 138+0+0 (secure 0 0 0) 0x7f2dd40551e0 con 0x7f2dcc003f00 2023-11-28T20:01:08.496 INFO:teuthology.orchestra.run.smithi078.stderr:pool 'cephfs_metadata' created 2023-11-28T20:01:08.497 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:08.477+0000 7f2de8cc9640 1 -- 172.21.15.78:0/1280460188 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f2dc40664a0 msgr2=0x7f2dc4068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:01:08.497 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:08.477+0000 7f2de8cc9640 1 --2- 172.21.15.78:0/1280460188 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f2dc40664a0 0x7f2dc4068960 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f2dd80ae000 tx=0x7f2dd80b4040 comp rx=0 tx=0).stop 2023-11-28T20:01:08.497 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:08.477+0000 7f2de8cc9640 1 -- 172.21.15.78:0/1280460188 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2dcc003f00 msgr2=0x7f2de4072630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:01:08.497 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:08.477+0000 7f2de8cc9640 1 --2- 172.21.15.78:0/1280460188 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2dcc003f00 0x7f2de4072630 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7f2dd40119d0 tx=0x7f2dd4011e90 comp rx=0 tx=0).stop 2023-11-28T20:01:08.497 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:08.481+0000 7f2de8cc9640 1 -- 172.21.15.78:0/1280460188 shutdown_connections 2023-11-28T20:01:08.497 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:08.481+0000 7f2de8cc9640 1 --2- 172.21.15.78:0/1280460188 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f2dc40664a0 0x7f2dc4068960 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:08.497 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:08.481+0000 7f2de8cc9640 1 --2- 172.21.15.78:0/1280460188 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2de4152260 0x7f2de414cad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:08.497 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:08.481+0000 7f2de8cc9640 1 --2- 172.21.15.78:0/1280460188 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2de4070800 0x7f2de40c1650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:08.498 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:08.481+0000 7f2de8cc9640 1 --2- 172.21.15.78:0/1280460188 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2dcc003f00 0x7f2de4072630 unknown :-1 s=CLOSED pgs=615 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:08.498 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:08.481+0000 7f2de8cc9640 1 -- 172.21.15.78:0/1280460188 >> 172.21.15.78:0/1280460188 conn(0x7f2de40c59f0 msgr2=0x7f2de40a9d40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:01:08.498 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:08.481+0000 7f2de8cc9640 1 -- 172.21.15.78:0/1280460188 shutdown_connections 2023-11-28T20:01:08.498 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:08.481+0000 7f2de8cc9640 1 -- 172.21.15.78:0/1280460188 wait complete. 2023-11-28T20:01:08.510 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-11-28T20:01:08.655 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:08.649+0000 7f319511d640 1 Processor -- start 2023-11-28T20:01:08.655 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:08.649+0000 7f319511d640 1 -- start start 2023-11-28T20:01:08.657 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:08.653+0000 7f319511d640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f319014b1e0 0x7f31900c1700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:08.657 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:08.653+0000 7f319511d640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f31900c5300 0x7f31900a9c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:08.657 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:08.653+0000 7f319511d640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f31900a4e20 con 0x7f3190151280 2023-11-28T20:01:08.658 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:08.653+0000 7f319511d640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f31901558d0 con 0x7f319014b1e0 2023-11-28T20:01:08.658 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:08.653+0000 7f319511d640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31900a50e0 con 0x7f31900c5300 2023-11-28T20:01:08.658 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:08.653+0000 7f318ed9d640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f319014b1e0 0x7f31900c1700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:08.658 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:08.653+0000 7f318ed9d640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f319014b1e0 0x7f31900c1700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:55870/0 (socket says 172.21.15.78:55870) 2023-11-28T20:01:08.659 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:08.653+0000 7f318ed9d640 1 -- 172.21.15.78:0/1165430304 learned_addr learned my addr 172.21.15.78:0/1165430304 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T20:01:08.659 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:08.653+0000 7f318f59e640 1 --1- 172.21.15.78:0/1165430304 >> v1:172.21.15.78:6789/0 conn(0x7f3190151280 0x7f3190151710 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:59770/0 (socket says 172.21.15.78:59770) 2023-11-28T20:01:08.659 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:08.653+0000 7f318659c640 1 --2- 172.21.15.78:0/1165430304 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f31900c5300 0x7f31900a9c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:08.659 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:08.653+0000 7f318ed9d640 1 -- 172.21.15.78:0/1165430304 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f31900c5300 msgr2=0x7f31900a9c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:01:08.659 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:08.653+0000 7f318ed9d640 1 --2- 172.21.15.78:0/1165430304 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f31900c5300 0x7f31900a9c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:08.659 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:08.653+0000 7f318ed9d640 1 -- 172.21.15.78:0/1165430304 >> v1:172.21.15.78:6789/0 conn(0x7f3190151280 legacy=0x7f3190151710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:01:08.659 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:08.653+0000 7f318ed9d640 1 -- 172.21.15.78:0/1165430304 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31900c0f00 con 0x7f319014b1e0 2023-11-28T20:01:08.660 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:08.657+0000 7f318ed9d640 1 --2- 172.21.15.78:0/1165430304 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f319014b1e0 0x7f31900c1700 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7f3180009870 tx=0x7f318001c540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fdba4c2dacd965b2 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:01:08.660 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:08.657+0000 7f318e59c640 1 -- 172.21.15.78:0/1165430304 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31800ab650 con 0x7f319014b1e0 2023-11-28T20:01:08.661 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:08.657+0000 7f318e59c640 1 -- 172.21.15.78:0/1165430304 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f31800ab7b0 con 0x7f319014b1e0 2023-11-28T20:01:08.661 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:08.657+0000 7f318e59c640 1 -- 172.21.15.78:0/1165430304 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31800abb40 con 0x7f319014b1e0 2023-11-28T20:01:08.663 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:08.657+0000 7f319511d640 1 -- 172.21.15.78:0/1165430304 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f319014b1e0 msgr2=0x7f31900c1700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:01:08.663 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:08.657+0000 7f319511d640 1 --2- 172.21.15.78:0/1165430304 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f319014b1e0 0x7f31900c1700 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7f3180009870 tx=0x7f318001c540 comp rx=0 tx=0).stop 2023-11-28T20:01:08.663 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:08.657+0000 7f319511d640 1 -- 172.21.15.78:0/1165430304 shutdown_connections 2023-11-28T20:01:08.663 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:08.657+0000 7f319511d640 1 --2- 172.21.15.78:0/1165430304 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f31900c5300 0x7f31900a9c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:08.663 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:08.657+0000 7f319511d640 1 --2- 172.21.15.78:0/1165430304 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f319014b1e0 0x7f31900c1700 unknown :-1 s=CLOSED pgs=617 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:08.663 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:08.657+0000 7f319511d640 1 -- 172.21.15.78:0/1165430304 >> 172.21.15.78:0/1165430304 conn(0x7f31900c59f0 msgr2=0x7f31900c5e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:01:08.664 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:08.657+0000 7f319511d640 1 -- 172.21.15.78:0/1165430304 shutdown_connections 2023-11-28T20:01:08.664 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:08.657+0000 7f319511d640 1 -- 172.21.15.78:0/1165430304 wait complete. 2023-11-28T20:01:08.664 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:08.657+0000 7f319511d640 1 Processor -- start 2023-11-28T20:01:08.664 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:08.657+0000 7f319511d640 1 -- start start 2023-11-28T20:01:08.667 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:08.661+0000 7f319511d640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f31900c5300 0x7f319006cae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:08.667 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:08.661+0000 7f319511d640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f319014b1e0 0x7f31901ed540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:08.667 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:08.661+0000 7f319511d640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3190151280 0x7f31901eda80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:08.667 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:08.661+0000 7f319511d640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3190148d60 con 0x7f31900c5300 2023-11-28T20:01:08.667 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:08.661+0000 7f319511d640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31901ed0b0 con 0x7f3190151280 2023-11-28T20:01:08.667 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:08.661+0000 7f319511d640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3190148020 con 0x7f319014b1e0 2023-11-28T20:01:08.668 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:08.661+0000 7f318ed9d640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f31900c5300 0x7f319006cae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:08.668 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:08.661+0000 7f318ed9d640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f31900c5300 0x7f319006cae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:55880/0 (socket says 172.21.15.78:55880) 2023-11-28T20:01:08.668 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:08.661+0000 7f318ed9d640 1 -- 172.21.15.78:0/1275970796 learned_addr learned my addr 172.21.15.78:0/1275970796 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T20:01:08.668 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:08.661+0000 7f318659c640 1 --2- 172.21.15.78:0/1275970796 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f319014b1e0 0x7f31901ed540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:08.668 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:08.661+0000 7f318f59e640 1 --2- 172.21.15.78:0/1275970796 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3190151280 0x7f31901eda80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:08.668 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:08.661+0000 7f318ed9d640 1 -- 172.21.15.78:0/1275970796 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f319014b1e0 msgr2=0x7f31901ed540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:01:08.668 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:08.661+0000 7f318ed9d640 1 --2- 172.21.15.78:0/1275970796 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f319014b1e0 0x7f31901ed540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:08.669 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:08.661+0000 7f318ed9d640 1 -- 172.21.15.78:0/1275970796 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3190151280 msgr2=0x7f31901eda80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:01:08.669 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:08.661+0000 7f318ed9d640 1 --2- 172.21.15.78:0/1275970796 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3190151280 0x7f31901eda80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:08.669 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:08.661+0000 7f318ed9d640 1 -- 172.21.15.78:0/1275970796 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31800094d0 con 0x7f31900c5300 2023-11-28T20:01:08.669 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:08.661+0000 7f318ed9d640 1 --2- 172.21.15.78:0/1275970796 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f31900c5300 0x7f319006cae0 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7f31800ad040 tx=0x7f318001ad80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:01:08.669 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:08.661+0000 7f3187fff640 1 -- 172.21.15.78:0/1275970796 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31800b4800 con 0x7f31900c5300 2023-11-28T20:01:08.669 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:08.661+0000 7f3187fff640 1 -- 172.21.15.78:0/1275970796 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f31800b4960 con 0x7f31900c5300 2023-11-28T20:01:08.669 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:08.661+0000 7f3187fff640 1 -- 172.21.15.78:0/1275970796 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31800b4d10 con 0x7f31900c5300 2023-11-28T20:01:08.669 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:08.661+0000 7f319511d640 1 -- 172.21.15.78:0/1275970796 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f31901482e0 con 0x7f31900c5300 2023-11-28T20:01:08.670 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:08.661+0000 7f319511d640 1 -- 172.21.15.78:0/1275970796 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f319015e8c0 con 0x7f31900c5300 2023-11-28T20:01:08.670 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:08.661+0000 7f319511d640 1 -- 172.21.15.78:0/1275970796 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f31901ece80 con 0x7f31900c5300 2023-11-28T20:01:08.671 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:08.661+0000 7f3187fff640 1 -- 172.21.15.78:0/1275970796 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f31800b3380 con 0x7f31900c5300 2023-11-28T20:01:08.671 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:08.665+0000 7f3187fff640 1 --2- 172.21.15.78:0/1275970796 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f31700664a0 0x7f3170068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:08.671 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:08.665+0000 7f3187fff640 1 -- 172.21.15.78:0/1275970796 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 5547+0+0 (secure 0 0 0) 0x7f318011e8e0 con 0x7f31900c5300 2023-11-28T20:01:08.671 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:08.665+0000 7f318659c640 1 --2- 172.21.15.78:0/1275970796 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f31700664a0 0x7f3170068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:08.671 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:08.665+0000 7f318659c640 1 --2- 172.21.15.78:0/1275970796 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f31700664a0 0x7f3170068960 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f319006dea0 tx=0x7f3178008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:01:08.673 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:08.669+0000 7f3187fff640 1 -- 172.21.15.78:0/1275970796 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f31901ece80 con 0x7f31900c5300 2023-11-28T20:01:08.822 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:08.817+0000 7f319511d640 1 -- 172.21.15.78:0/1275970796 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f31901ece80 con 0x7f31900c5300 2023-11-28T20:01:09.488 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:09.485+0000 7f3187fff640 1 -- 172.21.15.78:0/1275970796 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v59) v1 ==== 170+0+0 (secure 0 0 0) 0x7f31901ece80 con 0x7f31900c5300 2023-11-28T20:01:09.488 INFO:teuthology.orchestra.run.smithi078.stderr:pool 'cephfs_data' created 2023-11-28T20:01:09.490 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:09.485+0000 7f319511d640 1 -- 172.21.15.78:0/1275970796 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f31700664a0 msgr2=0x7f3170068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:01:09.490 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:09.485+0000 7f319511d640 1 --2- 172.21.15.78:0/1275970796 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f31700664a0 0x7f3170068960 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f319006dea0 tx=0x7f3178008040 comp rx=0 tx=0).stop 2023-11-28T20:01:09.490 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:09.485+0000 7f319511d640 1 -- 172.21.15.78:0/1275970796 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f31900c5300 msgr2=0x7f319006cae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:01:09.490 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:09.485+0000 7f319511d640 1 --2- 172.21.15.78:0/1275970796 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f31900c5300 0x7f319006cae0 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7f31800ad040 tx=0x7f318001ad80 comp rx=0 tx=0).stop 2023-11-28T20:01:09.491 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:09.485+0000 7f319511d640 1 -- 172.21.15.78:0/1275970796 shutdown_connections 2023-11-28T20:01:09.491 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:09.485+0000 7f319511d640 1 --2- 172.21.15.78:0/1275970796 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f31700664a0 0x7f3170068960 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:09.491 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:09.485+0000 7f319511d640 1 --2- 172.21.15.78:0/1275970796 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f319014b1e0 0x7f31901ed540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:09.491 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:09.485+0000 7f319511d640 1 --2- 172.21.15.78:0/1275970796 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3190151280 0x7f31901eda80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:09.491 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:09.485+0000 7f319511d640 1 --2- 172.21.15.78:0/1275970796 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f31900c5300 0x7f319006cae0 unknown :-1 s=CLOSED pgs=618 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:09.491 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:09.485+0000 7f319511d640 1 -- 172.21.15.78:0/1275970796 >> 172.21.15.78:0/1275970796 conn(0x7f31900c59f0 msgr2=0x7f31900ab480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:01:09.492 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:09.489+0000 7f319511d640 1 -- 172.21.15.78:0/1275970796 shutdown_connections 2023-11-28T20:01:09.492 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:09.489+0000 7f319511d640 1 -- 172.21.15.78:0/1275970796 wait complete. 2023-11-28T20:01:09.529 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-11-28T20:01:09.670 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:09.665+0000 7f54fb0fd640 1 Processor -- start 2023-11-28T20:01:09.670 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:09.665+0000 7f54fb0fd640 1 -- start start 2023-11-28T20:01:09.671 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:09.665+0000 7f54fb0fd640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f54f414fc30 0x7f54f40c3cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:09.671 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:09.665+0000 7f54fb0fd640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f54f406d840 0x7f54f40c4210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:09.671 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:09.665+0000 7f54fb0fd640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f54f4152910 con 0x7f54f414f850 2023-11-28T20:01:09.671 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:09.665+0000 7f54fb0fd640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f54f40c2240 con 0x7f54f406d840 2023-11-28T20:01:09.672 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:09.665+0000 7f54fb0fd640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f54f4152bf0 con 0x7f54f414fc30 2023-11-28T20:01:09.672 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:09.665+0000 7f54f8e99640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f54f414f850 0x7f54f40aacf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:59776/0 (socket says 172.21.15.78:59776) 2023-11-28T20:01:09.672 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:09.665+0000 7f54f8e99640 1 -- 172.21.15.78:0/2659696506 learned_addr learned my addr 172.21.15.78:0/2659696506 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-11-28T20:01:09.672 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:09.665+0000 7f54f969a640 1 --2- 172.21.15.78:0/2659696506 >> v2:172.21.15.78:3300/0 conn(0x7f54f406d840 0x7f54f40c4210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:09.672 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:09.669+0000 7f54ebfff640 1 --2- 172.21.15.78:0/2659696506 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f54f414fc30 0x7f54f40c3cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:09.673 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:09.669+0000 7f54eb7fe640 1 -- 172.21.15.78:0/2659696506 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2163272308 0 0) 0x7f54f4152910 con 0x7f54f414f850 2023-11-28T20:01:09.673 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:09.669+0000 7f54eb7fe640 1 -- 172.21.15.78:0/2659696506 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f54dc003530 con 0x7f54f414f850 2023-11-28T20:01:09.673 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:09.669+0000 7f54f969a640 1 -- 172.21.15.78:0/2659696506 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f54f414fc30 msgr2=0x7f54f40c3cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:01:09.673 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:09.669+0000 7f54f969a640 1 --2- 172.21.15.78:0/2659696506 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f54f414fc30 0x7f54f40c3cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:09.673 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:09.669+0000 7f54f969a640 1 -- 172.21.15.78:0/2659696506 >> v1:172.21.15.78:6789/0 conn(0x7f54f414f850 legacy=0x7f54f40aacf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:01:09.673 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:09.669+0000 7f54f969a640 1 -- 172.21.15.78:0/2659696506 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54f4152ed0 con 0x7f54f406d840 2023-11-28T20:01:09.675 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:09.669+0000 7f54f969a640 1 --2- 172.21.15.78:0/2659696506 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f54f406d840 0x7f54f40c4210 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7f54ec009d90 tx=0x7f54ec01c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1b080517eaed1e51 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:01:09.675 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:09.669+0000 7f54eb7fe640 1 -- 172.21.15.78:0/2659696506 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54ec0a5940 con 0x7f54f406d840 2023-11-28T20:01:09.675 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:09.669+0000 7f54eb7fe640 1 -- 172.21.15.78:0/2659696506 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f54ec0a5aa0 con 0x7f54f406d840 2023-11-28T20:01:09.675 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:09.669+0000 7f54eb7fe640 1 -- 172.21.15.78:0/2659696506 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54ec0a5e30 con 0x7f54f406d840 2023-11-28T20:01:09.676 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:09.673+0000 7f54fb0fd640 1 -- 172.21.15.78:0/2659696506 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f54f406d840 msgr2=0x7f54f40c4210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:01:09.676 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:09.673+0000 7f54fb0fd640 1 --2- 172.21.15.78:0/2659696506 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f54f406d840 0x7f54f40c4210 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7f54ec009d90 tx=0x7f54ec01c950 comp rx=0 tx=0).stop 2023-11-28T20:01:09.676 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:09.673+0000 7f54fb0fd640 1 -- 172.21.15.78:0/2659696506 shutdown_connections 2023-11-28T20:01:09.676 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:09.673+0000 7f54fb0fd640 1 --2- 172.21.15.78:0/2659696506 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f54f406d840 0x7f54f40c4210 unknown :-1 s=CLOSED pgs=620 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:09.676 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:09.673+0000 7f54fb0fd640 1 --2- 172.21.15.78:0/2659696506 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f54f414fc30 0x7f54f40c3cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:09.677 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:09.673+0000 7f54fb0fd640 1 -- 172.21.15.78:0/2659696506 >> 172.21.15.78:0/2659696506 conn(0x7f54f40c59f0 msgr2=0x7f54f40c5e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:01:09.677 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:09.673+0000 7f54fb0fd640 1 -- 172.21.15.78:0/2659696506 shutdown_connections 2023-11-28T20:01:09.677 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:09.673+0000 7f54fb0fd640 1 -- 172.21.15.78:0/2659696506 wait complete. 2023-11-28T20:01:09.677 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:09.673+0000 7f54fb0fd640 1 Processor -- start 2023-11-28T20:01:09.677 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:09.673+0000 7f54fb0fd640 1 -- start start 2023-11-28T20:01:09.679 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:09.673+0000 7f54fb0fd640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f54f406d840 0x7f54f415b480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:09.679 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:09.673+0000 7f54fb0fd640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f54f414f850 0x7f54f40aa390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:09.679 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:09.673+0000 7f54fb0fd640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f54f414fc30 0x7f54f4146ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:09.679 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:09.673+0000 7f54fb0fd640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54f41ee3e0 con 0x7f54f414f850 2023-11-28T20:01:09.679 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:09.673+0000 7f54fb0fd640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54f406fac0 con 0x7f54f414fc30 2023-11-28T20:01:09.680 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:09.673+0000 7f54fb0fd640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f54f41ed860 con 0x7f54f406d840 2023-11-28T20:01:09.680 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:09.673+0000 7f54ebfff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f54f414f850 0x7f54f40aa390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:09.680 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:09.673+0000 7f54ebfff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f54f414f850 0x7f54f40aa390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:55886/0 (socket says 172.21.15.78:55886) 2023-11-28T20:01:09.680 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:09.673+0000 7f54ebfff640 1 -- 172.21.15.78:0/2293291067 learned_addr learned my addr 172.21.15.78:0/2293291067 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T20:01:09.680 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:09.673+0000 7f54f8e99640 1 --2- 172.21.15.78:0/2293291067 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f54f406d840 0x7f54f415b480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:09.680 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:09.673+0000 7f54f969a640 1 --2- 172.21.15.78:0/2293291067 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f54f414fc30 0x7f54f4146ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:09.680 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:09.673+0000 7f54ebfff640 1 -- 172.21.15.78:0/2293291067 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f54f406d840 msgr2=0x7f54f415b480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:01:09.680 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:09.673+0000 7f54ebfff640 1 --2- 172.21.15.78:0/2293291067 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f54f406d840 0x7f54f415b480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:09.680 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:09.673+0000 7f54ebfff640 1 -- 172.21.15.78:0/2293291067 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f54f414fc30 msgr2=0x7f54f4146ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:01:09.680 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:09.673+0000 7f54ebfff640 1 --2- 172.21.15.78:0/2293291067 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f54f414fc30 0x7f54f4146ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:09.680 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:09.673+0000 7f54ebfff640 1 -- 172.21.15.78:0/2293291067 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54ec009a70 con 0x7f54f414f850 2023-11-28T20:01:09.681 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:09.677+0000 7f54ebfff640 1 --2- 172.21.15.78:0/2293291067 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f54f414f850 0x7f54f40aa390 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7f54e400e870 tx=0x7f54e400ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:01:09.681 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:09.677+0000 7f54e97fa640 1 -- 172.21.15.78:0/2293291067 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54e4009510 con 0x7f54f414f850 2023-11-28T20:01:09.682 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:09.677+0000 7f54e97fa640 1 -- 172.21.15.78:0/2293291067 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f54e400eec0 con 0x7f54f414f850 2023-11-28T20:01:09.682 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:09.677+0000 7f54fb0fd640 1 -- 172.21.15.78:0/2293291067 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f54f41edb40 con 0x7f54f414f850 2023-11-28T20:01:09.682 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:09.677+0000 7f54e97fa640 1 -- 172.21.15.78:0/2293291067 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54e400cb40 con 0x7f54f414f850 2023-11-28T20:01:09.682 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:09.677+0000 7f54fb0fd640 1 -- 172.21.15.78:0/2293291067 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f54f41ee100 con 0x7f54f414f850 2023-11-28T20:01:09.682 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:09.677+0000 7f54fb0fd640 1 -- 172.21.15.78:0/2293291067 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f54f4067630 con 0x7f54f414f850 2023-11-28T20:01:09.682 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:09.677+0000 7f54e97fa640 1 -- 172.21.15.78:0/2293291067 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f54e400cca0 con 0x7f54f414f850 2023-11-28T20:01:09.683 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:09.677+0000 7f54e97fa640 1 --2- 172.21.15.78:0/2293291067 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f54e0066470 0x7f54e0068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:09.683 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:09.681+0000 7f54e97fa640 1 -- 172.21.15.78:0/2293291067 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 5929+0+0 (secure 0 0 0) 0x7f54e4084620 con 0x7f54f414f850 2023-11-28T20:01:09.684 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:09.681+0000 7f54f8e99640 1 --2- 172.21.15.78:0/2293291067 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f54e0066470 0x7f54e0068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:09.684 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:09.681+0000 7f54f8e99640 1 --2- 172.21.15.78:0/2293291067 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f54e0066470 0x7f54e0068930 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f54f00011f0 tx=0x7f54f0007d40 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:01:09.687 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:09.681+0000 7f54e97fa640 1 -- 172.21.15.78:0/2293291067 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f54e4051be0 con 0x7f54f414f850 2023-11-28T20:01:09.868 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:09.865+0000 7f54fb0fd640 1 -- 172.21.15.78:0/2293291067 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f54f41f0980 con 0x7f54f414f850 2023-11-28T20:01:10.521 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:10.517+0000 7f54e97fa640 1 -- 172.21.15.78:0/2293291067 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 9 and data pool 10 v28) v1 ==== 173+0+0 (secure 0 0 0) 0x7f54e4055200 con 0x7f54f414f850 2023-11-28T20:01:10.524 INFO:teuthology.orchestra.run.smithi078.stderr:new fs with metadata pool 9 and data pool 10 2023-11-28T20:01:10.527 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:10.521+0000 7f54fb0fd640 1 -- 172.21.15.78:0/2293291067 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f54e0066470 msgr2=0x7f54e0068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:01:10.527 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:10.521+0000 7f54fb0fd640 1 --2- 172.21.15.78:0/2293291067 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f54e0066470 0x7f54e0068930 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f54f00011f0 tx=0x7f54f0007d40 comp rx=0 tx=0).stop 2023-11-28T20:01:10.527 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:10.521+0000 7f54fb0fd640 1 -- 172.21.15.78:0/2293291067 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f54f414f850 msgr2=0x7f54f40aa390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:01:10.527 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:10.521+0000 7f54fb0fd640 1 --2- 172.21.15.78:0/2293291067 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f54f414f850 0x7f54f40aa390 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7f54e400e870 tx=0x7f54e400ec70 comp rx=0 tx=0).stop 2023-11-28T20:01:10.529 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:10.525+0000 7f54fb0fd640 1 -- 172.21.15.78:0/2293291067 shutdown_connections 2023-11-28T20:01:10.529 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:10.525+0000 7f54fb0fd640 1 --2- 172.21.15.78:0/2293291067 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f54e0066470 0x7f54e0068930 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:10.529 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:10.525+0000 7f54fb0fd640 1 --2- 172.21.15.78:0/2293291067 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f54f414fc30 0x7f54f4146ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:10.529 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:10.525+0000 7f54fb0fd640 1 --2- 172.21.15.78:0/2293291067 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f54f414f850 0x7f54f40aa390 unknown :-1 s=CLOSED pgs=621 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:10.529 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:10.525+0000 7f54fb0fd640 1 --2- 172.21.15.78:0/2293291067 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f54f406d840 0x7f54f415b480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:10.529 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:10.525+0000 7f54fb0fd640 1 -- 172.21.15.78:0/2293291067 >> 172.21.15.78:0/2293291067 conn(0x7f54f40c59f0 msgr2=0x7f54f406cd10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:01:10.530 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:10.525+0000 7f54fb0fd640 1 -- 172.21.15.78:0/2293291067 shutdown_connections 2023-11-28T20:01:10.530 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:10.525+0000 7f54fb0fd640 1 -- 172.21.15.78:0/2293291067 wait complete. 2023-11-28T20:01:10.564 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-28T20:01:10.703 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:10.697+0000 7f4e7dc79640 1 Processor -- start 2023-11-28T20:01:10.703 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:10.697+0000 7f4e7dc79640 1 -- start start 2023-11-28T20:01:10.704 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:10.701+0000 7f4e7dc79640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f4e7814e3f0 0x7f4e780bfce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:10.705 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:10.701+0000 7f4e7dc79640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4e7806c5b0 0x7f4e7806ca40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:10.705 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:10.701+0000 7f4e7dc79640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4e78151690 con 0x7f4e7806bef0 2023-11-28T20:01:10.705 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:10.701+0000 7f4e7dc79640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4e78151bc0 con 0x7f4e7814e3f0 2023-11-28T20:01:10.705 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:10.701+0000 7f4e7dc79640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e781518e0 con 0x7f4e7806c5b0 2023-11-28T20:01:10.705 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:10.701+0000 7f4e777fe640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f4e7814e3f0 0x7f4e780bfce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:10.705 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:10.701+0000 7f4e777fe640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f4e7814e3f0 0x7f4e780bfce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:55900/0 (socket says 172.21.15.78:55900) 2023-11-28T20:01:10.705 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:10.701+0000 7f4e777fe640 1 -- 172.21.15.78:0/3588951151 learned_addr learned my addr 172.21.15.78:0/3588951151 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T20:01:10.706 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:10.701+0000 7f4e777fe640 1 -- 172.21.15.78:0/3588951151 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4e7806c5b0 msgr2=0x7f4e7806ca40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:01:10.706 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:10.701+0000 7f4e77fff640 1 --2- 172.21.15.78:0/3588951151 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4e7806c5b0 0x7f4e7806ca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:10.706 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:10.701+0000 7f4e777fe640 1 --2- 172.21.15.78:0/3588951151 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4e7806c5b0 0x7f4e7806ca40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:10.706 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:10.701+0000 7f4e777fe640 1 -- 172.21.15.78:0/3588951151 >> v1:172.21.15.179:6789/0 conn(0x7f4e7806bef0 legacy=0x7f4e780c41f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:01:10.706 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:10.701+0000 7f4e777fe640 1 -- 172.21.15.78:0/3588951151 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e780c1de0 con 0x7f4e7814e3f0 2023-11-28T20:01:10.706 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:10.701+0000 7f4e77fff640 1 --2- 172.21.15.78:0/3588951151 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4e7806c5b0 0x7f4e7806ca40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T20:01:10.708 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:10.705+0000 7f4e777fe640 1 --2- 172.21.15.78:0/3588951151 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4e7814e3f0 0x7f4e780bfce0 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7f4e68009870 tx=0x7f4e6801c440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=23c40d0d295a14be server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:01:10.708 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:10.705+0000 7f4e767fc640 1 -- 172.21.15.78:0/3588951151 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e680ad640 con 0x7f4e7814e3f0 2023-11-28T20:01:10.708 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:10.705+0000 7f4e767fc640 1 -- 172.21.15.78:0/3588951151 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e680ad7a0 con 0x7f4e7814e3f0 2023-11-28T20:01:10.708 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:10.705+0000 7f4e767fc640 1 -- 172.21.15.78:0/3588951151 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e680adb30 con 0x7f4e7814e3f0 2023-11-28T20:01:10.709 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:10.705+0000 7f4e7dc79640 1 -- 172.21.15.78:0/3588951151 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4e7814e3f0 msgr2=0x7f4e780bfce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:01:10.709 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:10.705+0000 7f4e7dc79640 1 --2- 172.21.15.78:0/3588951151 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4e7814e3f0 0x7f4e780bfce0 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7f4e68009870 tx=0x7f4e6801c440 comp rx=0 tx=0).stop 2023-11-28T20:01:10.709 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:10.705+0000 7f4e7dc79640 1 -- 172.21.15.78:0/3588951151 shutdown_connections 2023-11-28T20:01:10.710 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:10.705+0000 7f4e7dc79640 1 --2- 172.21.15.78:0/3588951151 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4e7806c5b0 0x7f4e7806ca40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:10.710 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:10.705+0000 7f4e7dc79640 1 --2- 172.21.15.78:0/3588951151 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4e7814e3f0 0x7f4e780bfce0 unknown :-1 s=CLOSED pgs=622 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:10.710 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:10.705+0000 7f4e7dc79640 1 -- 172.21.15.78:0/3588951151 >> 172.21.15.78:0/3588951151 conn(0x7f4e780a7810 msgr2=0x7f4e780a7c20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:01:10.710 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:10.705+0000 7f4e7dc79640 1 -- 172.21.15.78:0/3588951151 shutdown_connections 2023-11-28T20:01:10.710 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:10.705+0000 7f4e7dc79640 1 -- 172.21.15.78:0/3588951151 wait complete. 2023-11-28T20:01:10.710 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:10.705+0000 7f4e7dc79640 1 Processor -- start 2023-11-28T20:01:10.711 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:10.705+0000 7f4e7dc79640 1 -- start start 2023-11-28T20:01:10.713 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:10.709+0000 7f4e7dc79640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4e7806bef0 0x7f4e7814d020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:10.714 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:10.709+0000 7f4e7dc79640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4e7806c5b0 0x7f4e781ed7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:10.714 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:10.709+0000 7f4e7dc79640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4e7814e3f0 0x7f4e781edd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:10.714 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:10.709+0000 7f4e7dc79640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e781ee250 con 0x7f4e7806bef0 2023-11-28T20:01:10.714 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:10.709+0000 7f4e7dc79640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e781f0d20 con 0x7f4e7814e3f0 2023-11-28T20:01:10.714 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:10.709+0000 7f4e7dc79640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e781f1000 con 0x7f4e7806c5b0 2023-11-28T20:01:10.714 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:10.709+0000 7f4e777fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4e7806bef0 0x7f4e7814d020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:10.714 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:10.709+0000 7f4e777fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4e7806bef0 0x7f4e7814d020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:55906/0 (socket says 172.21.15.78:55906) 2023-11-28T20:01:10.714 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:10.709+0000 7f4e777fe640 1 -- 172.21.15.78:0/3755407253 learned_addr learned my addr 172.21.15.78:0/3755407253 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T20:01:10.714 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:10.709+0000 7f4e77fff640 1 --2- 172.21.15.78:0/3755407253 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4e7814e3f0 0x7f4e781edd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:10.715 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:10.709+0000 7f4e76ffd640 1 --2- 172.21.15.78:0/3755407253 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4e7806c5b0 0x7f4e781ed7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:10.715 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:10.709+0000 7f4e777fe640 1 -- 172.21.15.78:0/3755407253 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4e7806c5b0 msgr2=0x7f4e781ed7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:01:10.715 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:10.709+0000 7f4e777fe640 1 --2- 172.21.15.78:0/3755407253 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4e7806c5b0 0x7f4e781ed7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:10.715 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:10.709+0000 7f4e777fe640 1 -- 172.21.15.78:0/3755407253 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4e7814e3f0 msgr2=0x7f4e781edd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:01:10.715 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:10.709+0000 7f4e777fe640 1 --2- 172.21.15.78:0/3755407253 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4e7814e3f0 0x7f4e781edd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:10.715 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:10.709+0000 7f4e777fe640 1 -- 172.21.15.78:0/3755407253 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e680094d0 con 0x7f4e7806bef0 2023-11-28T20:01:10.715 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:10.709+0000 7f4e77fff640 1 --2- 172.21.15.78:0/3755407253 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4e7814e3f0 0x7f4e781edd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T20:01:10.715 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:10.709+0000 7f4e76ffd640 1 --2- 172.21.15.78:0/3755407253 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4e7806c5b0 0x7f4e781ed7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T20:01:10.715 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:10.709+0000 7f4e777fe640 1 --2- 172.21.15.78:0/3755407253 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4e7806bef0 0x7f4e7814d020 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7f4e680b0040 tx=0x7f4e680191e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:01:10.715 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:10.709+0000 7f4e5ffff640 1 -- 172.21.15.78:0/3755407253 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e680bc070 con 0x7f4e7806bef0 2023-11-28T20:01:10.715 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:10.709+0000 7f4e5ffff640 1 -- 172.21.15.78:0/3755407253 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e680a6040 con 0x7f4e7806bef0 2023-11-28T20:01:10.716 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:10.709+0000 7f4e7dc79640 1 -- 172.21.15.78:0/3755407253 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4e781f12e0 con 0x7f4e7806bef0 2023-11-28T20:01:10.716 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:10.709+0000 7f4e5ffff640 1 -- 172.21.15.78:0/3755407253 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e680b7870 con 0x7f4e7806bef0 2023-11-28T20:01:10.716 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:10.709+0000 7f4e7dc79640 1 -- 172.21.15.78:0/3755407253 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4e7814d560 con 0x7f4e7806bef0 2023-11-28T20:01:10.717 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:10.709+0000 7f4e7dc79640 1 -- 172.21.15.78:0/3755407253 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4e780679d0 con 0x7f4e7806bef0 2023-11-28T20:01:10.717 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:10.709+0000 7f4e5ffff640 1 -- 172.21.15.78:0/3755407253 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f4e680b79d0 con 0x7f4e7806bef0 2023-11-28T20:01:10.717 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:10.713+0000 7f4e5ffff640 1 --2- 172.21.15.78:0/3755407253 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f4e64066470 0x7f4e64068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:10.717 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:10.713+0000 7f4e5ffff640 1 -- 172.21.15.78:0/3755407253 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f4e6811e500 con 0x7f4e7806bef0 2023-11-28T20:01:10.717 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:10.713+0000 7f4e76ffd640 1 --2- 172.21.15.78:0/3755407253 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f4e64066470 0x7f4e64068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:10.717 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:10.713+0000 7f4e76ffd640 1 --2- 172.21.15.78:0/3755407253 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f4e64066470 0x7f4e64068930 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f4e780c17a0 tx=0x7f4e6c009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:01:10.720 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:10.717+0000 7f4e5ffff640 1 -- 172.21.15.78:0/3755407253 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f4e680eb830 con 0x7f4e7806bef0 2023-11-28T20:01:10.872 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:10.869+0000 7f4e7dc79640 1 -- 172.21.15.78:0/3755407253 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f4e78067630 con 0x7f4e7806bef0 2023-11-28T20:01:10.873 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:10.869+0000 7f4e5ffff640 1 -- 172.21.15.78:0/3755407253 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v60) v1 ==== 74+0+16705 (secure 0 0 0) 0x7f4e680eee50 con 0x7f4e7806bef0 2023-11-28T20:01:10.874 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-11-28T20:01:10.874 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":60,"fsid":"dd9780e8-3bda-44fa-a9f0-fa07d19d901d","created":"2023-11-28T19:58:40.969556+0000","modified":"2023-11-28T20:01:09.868190+0000","last_up_change":"2023-11-28T19:58:52.596716+0000","last_in_change":"2023-11-28T19:58:43.609275+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":10,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-28T19:58:54.011229+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_metadata","create_time":"2023-11-28T20:01:07.969267+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"60","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_data","create_time":"2023-11-28T20:01:08.865465+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"60","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e84245ac-b5da-429e-af18-39acaa2b33e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6800","nonce":3358701235},{"type":"v1","addr":"172.21.15.78:6801","nonce":3358701235}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6802","nonce":3358701235},{"type":"v1","addr":"172.21.15.78:6803","nonce":3358701235}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6806","nonce":3358701235},{"type":"v1","addr":"172.21.15.78:6807","nonce":3358701235}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6804","nonce":3358701235},{"type":"v1","addr":"172.21.15.78:6805","nonce":3358701235}]},"public_addr":"172.21.15.78:6801/3358701235","cluster_addr":"172.21.15.78:6803/3358701235","heartbeat_back_addr":"172.21.15.78:6807/3358701235","heartbeat_front_addr":"172.21.15.78:6805/3358701235","state":["exists","up"]},{"osd":1,"uuid":"e634831d-c4e2-48d9-870c-9556ae162981","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6808","nonce":3211476654},{"type":"v1","addr":"172.21.15.78:6809","nonce":3211476654}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6810","nonce":3211476654},{"type":"v1","addr":"172.21.15.78:6811","nonce":3211476654}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6814","nonce":3211476654},{"type":"v1","addr":"172.21.15.78:6815","nonce":3211476654}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6812","nonce":3211476654},{"type":"v1","addr":"172.21.15.78:6813","nonce":3211476654}]},"public_addr":"172.21.15.78:6809/3211476654","cluster_addr":"172.21.15.78:6811/3211476654","heartbeat_back_addr":"172.21.15.78:6815/3211476654","heartbeat_front_addr":"172.21.15.78:6813/3211476654","state":["exists","up"]},{"osd":2,"uuid":"274c8395-6534-41f0-b8fb-a00af8985aa8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6816","nonce":2532904479},{"type":"v1","addr":"172.21.15.78:6817","nonce":2532904479}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6818","nonce":2532904479},{"type":"v1","addr":"172.21.15.78:6819","nonce":2532904479}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6822","nonce":2532904479},{"type":"v1","addr":"172.21.15.78:6823","nonce":2532904479}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6820","nonce":2532904479},{"type":"v1","addr":"172.21.15.78:6821","nonce":2532904479}]},"public_addr":"172.21.15.78:6817/2532904479","cluster_addr":"172.21.15.78:6819/2532904479","heartbeat_back_addr":"172.21.15.78:6823/2532904479","heartbeat_front_addr":"172.21.15.78:6821/2532904479","state":["exists","up"]},{"osd":3,"uuid":"77acc9af-7d4d-4b18-8cf5-d62f5971b7c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6824","nonce":3442991267},{"type":"v1","addr":"172.21.15.78:6825","nonce":3442991267}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6826","nonce":3442991267},{"type":"v1","addr":"172.21.15.78:6827","nonce":3442991267}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6830","nonce":3442991267},{"type":"v1","addr":"172.21.15.78:6831","nonce":3442991267}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6828","nonce":3442991267},{"type":"v1","addr":"172.21.15.78:6829","nonce":3442991267}]},"public_addr":"172.21.15.78:6825/3442991267","cluster_addr":"172.21.15.78:6827/3442991267","heartbeat_back_addr":"172.21.15.78:6831/3442991267","heartbeat_front_addr":"172.21.15.78:6829/3442991267","state":["exists","up"]},{"osd":4,"uuid":"5c62bc66-6b34-4b7f-a66b-9a743969138c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":802983577},{"type":"v1","addr":"172.21.15.179:6809","nonce":802983577}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":802983577},{"type":"v1","addr":"172.21.15.179:6811","nonce":802983577}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":802983577},{"type":"v1","addr":"172.21.15.179:6815","nonce":802983577}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":802983577},{"type":"v1","addr":"172.21.15.179:6813","nonce":802983577}]},"public_addr":"172.21.15.179:6809/802983577","cluster_addr":"172.21.15.179:6811/802983577","heartbeat_back_addr":"172.21.15.179:6815/802983577","heartbeat_front_addr":"172.21.15.179:6813/802983577","state":["exists","up"]},{"osd":5,"uuid":"67db6d36-f684-4079-b0cd-82b4dd61461f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":518192887},{"type":"v1","addr":"172.21.15.179:6818","nonce":518192887}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":518192887},{"type":"v1","addr":"172.21.15.179:6822","nonce":518192887}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":518192887},{"type":"v1","addr":"172.21.15.179:6829","nonce":518192887}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6824","nonce":518192887},{"type":"v1","addr":"172.21.15.179:6826","nonce":518192887}]},"public_addr":"172.21.15.179:6818/518192887","cluster_addr":"172.21.15.179:6822/518192887","heartbeat_back_addr":"172.21.15.179:6829/518192887","heartbeat_front_addr":"172.21.15.179:6826/518192887","state":["exists","up"]},{"osd":6,"uuid":"12e670af-5a16-4c81-9f97-defa66cab967","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":815435378},{"type":"v1","addr":"172.21.15.179:6801","nonce":815435378}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":815435378},{"type":"v1","addr":"172.21.15.179:6803","nonce":815435378}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":815435378},{"type":"v1","addr":"172.21.15.179:6807","nonce":815435378}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":815435378},{"type":"v1","addr":"172.21.15.179:6805","nonce":815435378}]},"public_addr":"172.21.15.179:6801/815435378","cluster_addr":"172.21.15.179:6803/815435378","heartbeat_back_addr":"172.21.15.179:6807/815435378","heartbeat_front_addr":"172.21.15.179:6805/815435378","state":["exists","up"]},{"osd":7,"uuid":"fe630650-2eb3-49ad-8676-c341e6332eb1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6817","nonce":2848432339},{"type":"v1","addr":"172.21.15.179:6819","nonce":2848432339}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6821","nonce":2848432339},{"type":"v1","addr":"172.21.15.179:6823","nonce":2848432339}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":2848432339},{"type":"v1","addr":"172.21.15.179:6831","nonce":2848432339}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6825","nonce":2848432339},{"type":"v1","addr":"172.21.15.179:6827","nonce":2848432339}]},"public_addr":"172.21.15.179:6819/2848432339","cluster_addr":"172.21.15.179:6823/2848432339","heartbeat_back_addr":"172.21.15.179:6831/2848432339","heartbeat_front_addr":"172.21.15.179:6827/2848432339","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:58:49.255433+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:58:49.412880+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:58:49.559295+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:58:49.245237+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:58:49.184557+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:58:49.329851+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:58:49.366012+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:58:49.349604+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-28T20:01:10.875 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:10.869+0000 7f4e7dc79640 1 -- 172.21.15.78:0/3755407253 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f4e64066470 msgr2=0x7f4e64068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:01:10.875 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:10.869+0000 7f4e7dc79640 1 --2- 172.21.15.78:0/3755407253 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f4e64066470 0x7f4e64068930 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f4e780c17a0 tx=0x7f4e6c009040 comp rx=0 tx=0).stop 2023-11-28T20:01:10.875 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:10.869+0000 7f4e7dc79640 1 -- 172.21.15.78:0/3755407253 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4e7806bef0 msgr2=0x7f4e7814d020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:01:10.875 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:10.869+0000 7f4e7dc79640 1 --2- 172.21.15.78:0/3755407253 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4e7806bef0 0x7f4e7814d020 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7f4e680b0040 tx=0x7f4e680191e0 comp rx=0 tx=0).stop 2023-11-28T20:01:10.876 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:10.869+0000 7f4e7dc79640 1 -- 172.21.15.78:0/3755407253 shutdown_connections 2023-11-28T20:01:10.876 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:10.869+0000 7f4e7dc79640 1 --2- 172.21.15.78:0/3755407253 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f4e64066470 0x7f4e64068930 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:10.876 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:10.869+0000 7f4e7dc79640 1 --2- 172.21.15.78:0/3755407253 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4e7806c5b0 0x7f4e781ed7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:10.876 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:10.869+0000 7f4e7dc79640 1 --2- 172.21.15.78:0/3755407253 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4e7814e3f0 0x7f4e781edd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:10.876 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:10.869+0000 7f4e7dc79640 1 --2- 172.21.15.78:0/3755407253 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4e7806bef0 0x7f4e7814d020 unknown :-1 s=CLOSED pgs=623 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:10.876 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:10.869+0000 7f4e7dc79640 1 -- 172.21.15.78:0/3755407253 >> 172.21.15.78:0/3755407253 conn(0x7f4e780a7810 msgr2=0x7f4e78072580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:01:10.876 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:10.869+0000 7f4e7dc79640 1 -- 172.21.15.78:0/3755407253 shutdown_connections 2023-11-28T20:01:10.877 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:10.869+0000 7f4e7dc79640 1 -- 172.21.15.78:0/3755407253 wait complete. 2023-11-28T20:01:10.895 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-28T20:01:11.032 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:11.029+0000 7f6c365d1640 1 Processor -- start 2023-11-28T20:01:11.033 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:11.029+0000 7f6c365d1640 1 -- start start 2023-11-28T20:01:11.034 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:11.029+0000 7f6c365d1640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f6c3014e3f0 0x7f6c300bfce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:11.034 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:11.029+0000 7f6c365d1640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6c3006bef0 0x7f6c300c41f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:11.034 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:11.029+0000 7f6c365d1640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f6c300c4730 0x7f6c3006c5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:11.034 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:11.029+0000 7f6c365d1640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6c30151690 con 0x7f6c300c4730 2023-11-28T20:01:11.034 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:11.029+0000 7f6c365d1640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6c30151bc0 con 0x7f6c3014e3f0 2023-11-28T20:01:11.034 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:11.029+0000 7f6c365d1640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c301518e0 con 0x7f6c3006bef0 2023-11-28T20:01:11.035 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:11.029+0000 7f6c34b6e640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f6c300c4730 0x7f6c3006c5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:11.035 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:11.029+0000 7f6c34b6e640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f6c300c4730 0x7f6c3006c5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:55920/0 (socket says 172.21.15.78:55920) 2023-11-28T20:01:11.035 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:11.029+0000 7f6c34b6e640 1 -- 172.21.15.78:0/1162783564 learned_addr learned my addr 172.21.15.78:0/1162783564 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T20:01:11.036 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:11.029+0000 7f6c2f7fe640 1 --2- 172.21.15.78:0/1162783564 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6c3006bef0 0x7f6c300c41f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:11.037 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:11.029+0000 7f6c2ffff640 1 --2- 172.21.15.78:0/1162783564 >> v2:172.21.15.179:3300/0 conn(0x7f6c3014e3f0 0x7f6c300bfce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:11.037 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:11.029+0000 7f6c34b6e640 1 -- 172.21.15.78:0/1162783564 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6c3006bef0 msgr2=0x7f6c300c41f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:01:11.037 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:11.029+0000 7f6c34b6e640 1 --2- 172.21.15.78:0/1162783564 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6c3006bef0 0x7f6c300c41f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:11.037 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:11.029+0000 7f6c34b6e640 1 -- 172.21.15.78:0/1162783564 >> v2:172.21.15.179:3300/0 conn(0x7f6c3014e3f0 msgr2=0x7f6c300bfce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:01:11.037 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:11.029+0000 7f6c34b6e640 1 --2- 172.21.15.78:0/1162783564 >> v2:172.21.15.179:3300/0 conn(0x7f6c3014e3f0 0x7f6c300bfce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:11.038 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:11.029+0000 7f6c34b6e640 1 -- 172.21.15.78:0/1162783564 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c300c1de0 con 0x7f6c300c4730 2023-11-28T20:01:11.040 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:11.033+0000 7f6c34b6e640 1 --2- 172.21.15.78:0/1162783564 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6c300c4730 0x7f6c3006c5b0 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7f6c3006f630 tx=0x7f6c2801c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8215d61046dc619a server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:01:11.040 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:11.033+0000 7f6c2effd640 1 -- 172.21.15.78:0/1162783564 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c280a5620 con 0x7f6c300c4730 2023-11-28T20:01:11.040 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:11.033+0000 7f6c2effd640 1 -- 172.21.15.78:0/1162783564 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c280a5780 con 0x7f6c300c4730 2023-11-28T20:01:11.041 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:11.033+0000 7f6c2effd640 1 -- 172.21.15.78:0/1162783564 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c280a5b10 con 0x7f6c300c4730 2023-11-28T20:01:11.041 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:11.033+0000 7f6c365d1640 1 -- 172.21.15.78:0/1162783564 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6c300c4730 msgr2=0x7f6c3006c5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:01:11.041 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:11.033+0000 7f6c365d1640 1 --2- 172.21.15.78:0/1162783564 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6c300c4730 0x7f6c3006c5b0 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7f6c3006f630 tx=0x7f6c2801c910 comp rx=0 tx=0).stop 2023-11-28T20:01:11.041 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:11.033+0000 7f6c365d1640 1 -- 172.21.15.78:0/1162783564 shutdown_connections 2023-11-28T20:01:11.041 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:11.033+0000 7f6c365d1640 1 --2- 172.21.15.78:0/1162783564 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6c300c4730 0x7f6c3006c5b0 unknown :-1 s=CLOSED pgs=624 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:11.041 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:11.033+0000 7f6c365d1640 1 --2- 172.21.15.78:0/1162783564 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6c3006bef0 0x7f6c300c41f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:11.041 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:11.033+0000 7f6c365d1640 1 --2- 172.21.15.78:0/1162783564 >> v2:172.21.15.179:3300/0 conn(0x7f6c3014e3f0 0x7f6c300bfce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:11.042 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:11.033+0000 7f6c365d1640 1 -- 172.21.15.78:0/1162783564 >> 172.21.15.78:0/1162783564 conn(0x7f6c300a7810 msgr2=0x7f6c300a7c20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:01:11.042 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:11.033+0000 7f6c365d1640 1 -- 172.21.15.78:0/1162783564 shutdown_connections 2023-11-28T20:01:11.042 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:11.033+0000 7f6c365d1640 1 -- 172.21.15.78:0/1162783564 wait complete. 2023-11-28T20:01:11.042 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:11.037+0000 7f6c365d1640 1 Processor -- start 2023-11-28T20:01:11.042 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:11.037+0000 7f6c365d1640 1 -- start start 2023-11-28T20:01:11.045 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:11.037+0000 7f6c365d1640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6c3006bef0 0x7f6c300bf0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:11.045 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:11.037+0000 7f6c365d1640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6c300c4730 0x7f6c30141780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:11.045 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:11.037+0000 7f6c365d1640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6c3014e3f0 0x7f6c301f0a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:11.045 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:11.037+0000 7f6c365d1640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c301422b0 con 0x7f6c3014e3f0 2023-11-28T20:01:11.046 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:11.037+0000 7f6c365d1640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c30142e10 con 0x7f6c300c4730 2023-11-28T20:01:11.046 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:11.037+0000 7f6c365d1640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c30142570 con 0x7f6c3006bef0 2023-11-28T20:01:11.046 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:11.037+0000 7f6c34b6e640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6c3014e3f0 0x7f6c301f0a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:11.046 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:11.037+0000 7f6c34b6e640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6c3014e3f0 0x7f6c301f0a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:55922/0 (socket says 172.21.15.78:55922) 2023-11-28T20:01:11.046 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:11.037+0000 7f6c34b6e640 1 -- 172.21.15.78:0/2116725473 learned_addr learned my addr 172.21.15.78:0/2116725473 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T20:01:11.046 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:11.037+0000 7f6c2f7fe640 1 --2- 172.21.15.78:0/2116725473 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6c300c4730 0x7f6c30141780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:11.046 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:11.037+0000 7f6c2ffff640 1 --2- 172.21.15.78:0/2116725473 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6c3006bef0 0x7f6c300bf0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:11.046 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:11.037+0000 7f6c34b6e640 1 -- 172.21.15.78:0/2116725473 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6c3006bef0 msgr2=0x7f6c300bf0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:01:11.046 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:11.037+0000 7f6c34b6e640 1 --2- 172.21.15.78:0/2116725473 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6c3006bef0 0x7f6c300bf0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:11.046 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:11.037+0000 7f6c34b6e640 1 -- 172.21.15.78:0/2116725473 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6c300c4730 msgr2=0x7f6c30141780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:01:11.047 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:11.037+0000 7f6c34b6e640 1 --2- 172.21.15.78:0/2116725473 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6c300c4730 0x7f6c30141780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:11.047 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:11.037+0000 7f6c34b6e640 1 -- 172.21.15.78:0/2116725473 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c28009b30 con 0x7f6c3014e3f0 2023-11-28T20:01:11.047 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:11.037+0000 7f6c34b6e640 1 --2- 172.21.15.78:0/2116725473 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6c3014e3f0 0x7f6c301f0a50 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7f6c280af040 tx=0x7f6c280196b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:01:11.047 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:11.037+0000 7f6c2cff9640 1 -- 172.21.15.78:0/2116725473 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c280b8670 con 0x7f6c3014e3f0 2023-11-28T20:01:11.047 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:11.037+0000 7f6c2cff9640 1 -- 172.21.15.78:0/2116725473 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c280b87d0 con 0x7f6c3014e3f0 2023-11-28T20:01:11.047 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:11.037+0000 7f6c2cff9640 1 -- 172.21.15.78:0/2116725473 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c280b8b80 con 0x7f6c3014e3f0 2023-11-28T20:01:11.047 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:11.037+0000 7f6c365d1640 1 -- 172.21.15.78:0/2116725473 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6c30142850 con 0x7f6c3014e3f0 2023-11-28T20:01:11.047 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:11.037+0000 7f6c365d1640 1 -- 172.21.15.78:0/2116725473 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6c301f0530 con 0x7f6c3014e3f0 2023-11-28T20:01:11.047 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:11.037+0000 7f6c365d1640 1 -- 172.21.15.78:0/2116725473 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6c300a8280 con 0x7f6c3014e3f0 2023-11-28T20:01:11.047 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:11.041+0000 7f6c2cff9640 1 -- 172.21.15.78:0/2116725473 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f6c280b8ce0 con 0x7f6c3014e3f0 2023-11-28T20:01:11.048 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:11.041+0000 7f6c2cff9640 1 --2- 172.21.15.78:0/2116725473 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f6c1c066470 0x7f6c1c068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:11.048 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:11.041+0000 7f6c2cff9640 1 -- 172.21.15.78:0/2116725473 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f6c2811f1d0 con 0x7f6c3014e3f0 2023-11-28T20:01:11.048 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:11.041+0000 7f6c2ffff640 1 --2- 172.21.15.78:0/2116725473 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f6c1c066470 0x7f6c1c068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:11.048 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:11.041+0000 7f6c2ffff640 1 --2- 172.21.15.78:0/2116725473 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f6c1c066470 0x7f6c1c068930 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f6c2000ba90 tx=0x7f6c20008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:01:11.049 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:11.045+0000 7f6c2cff9640 1 -- 172.21.15.78:0/2116725473 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f6c280ec830 con 0x7f6c3014e3f0 2023-11-28T20:01:11.198 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:11.193+0000 7f6c365d1640 1 -- 172.21.15.78:0/2116725473 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f6c30067630 con 0x7f6c3014e3f0 2023-11-28T20:01:11.199 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:11.197+0000 7f6c2cff9640 1 -- 172.21.15.78:0/2116725473 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v60) v1 ==== 74+0+16705 (secure 0 0 0) 0x7f6c28009510 con 0x7f6c3014e3f0 2023-11-28T20:01:11.200 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-11-28T20:01:11.200 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":60,"fsid":"dd9780e8-3bda-44fa-a9f0-fa07d19d901d","created":"2023-11-28T19:58:40.969556+0000","modified":"2023-11-28T20:01:09.868190+0000","last_up_change":"2023-11-28T19:58:52.596716+0000","last_in_change":"2023-11-28T19:58:43.609275+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":10,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-28T19:58:54.011229+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_metadata","create_time":"2023-11-28T20:01:07.969267+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"60","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_data","create_time":"2023-11-28T20:01:08.865465+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"60","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e84245ac-b5da-429e-af18-39acaa2b33e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6800","nonce":3358701235},{"type":"v1","addr":"172.21.15.78:6801","nonce":3358701235}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6802","nonce":3358701235},{"type":"v1","addr":"172.21.15.78:6803","nonce":3358701235}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6806","nonce":3358701235},{"type":"v1","addr":"172.21.15.78:6807","nonce":3358701235}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6804","nonce":3358701235},{"type":"v1","addr":"172.21.15.78:6805","nonce":3358701235}]},"public_addr":"172.21.15.78:6801/3358701235","cluster_addr":"172.21.15.78:6803/3358701235","heartbeat_back_addr":"172.21.15.78:6807/3358701235","heartbeat_front_addr":"172.21.15.78:6805/3358701235","state":["exists","up"]},{"osd":1,"uuid":"e634831d-c4e2-48d9-870c-9556ae162981","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6808","nonce":3211476654},{"type":"v1","addr":"172.21.15.78:6809","nonce":3211476654}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6810","nonce":3211476654},{"type":"v1","addr":"172.21.15.78:6811","nonce":3211476654}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6814","nonce":3211476654},{"type":"v1","addr":"172.21.15.78:6815","nonce":3211476654}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6812","nonce":3211476654},{"type":"v1","addr":"172.21.15.78:6813","nonce":3211476654}]},"public_addr":"172.21.15.78:6809/3211476654","cluster_addr":"172.21.15.78:6811/3211476654","heartbeat_back_addr":"172.21.15.78:6815/3211476654","heartbeat_front_addr":"172.21.15.78:6813/3211476654","state":["exists","up"]},{"osd":2,"uuid":"274c8395-6534-41f0-b8fb-a00af8985aa8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6816","nonce":2532904479},{"type":"v1","addr":"172.21.15.78:6817","nonce":2532904479}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6818","nonce":2532904479},{"type":"v1","addr":"172.21.15.78:6819","nonce":2532904479}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6822","nonce":2532904479},{"type":"v1","addr":"172.21.15.78:6823","nonce":2532904479}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6820","nonce":2532904479},{"type":"v1","addr":"172.21.15.78:6821","nonce":2532904479}]},"public_addr":"172.21.15.78:6817/2532904479","cluster_addr":"172.21.15.78:6819/2532904479","heartbeat_back_addr":"172.21.15.78:6823/2532904479","heartbeat_front_addr":"172.21.15.78:6821/2532904479","state":["exists","up"]},{"osd":3,"uuid":"77acc9af-7d4d-4b18-8cf5-d62f5971b7c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6824","nonce":3442991267},{"type":"v1","addr":"172.21.15.78:6825","nonce":3442991267}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6826","nonce":3442991267},{"type":"v1","addr":"172.21.15.78:6827","nonce":3442991267}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6830","nonce":3442991267},{"type":"v1","addr":"172.21.15.78:6831","nonce":3442991267}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6828","nonce":3442991267},{"type":"v1","addr":"172.21.15.78:6829","nonce":3442991267}]},"public_addr":"172.21.15.78:6825/3442991267","cluster_addr":"172.21.15.78:6827/3442991267","heartbeat_back_addr":"172.21.15.78:6831/3442991267","heartbeat_front_addr":"172.21.15.78:6829/3442991267","state":["exists","up"]},{"osd":4,"uuid":"5c62bc66-6b34-4b7f-a66b-9a743969138c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":802983577},{"type":"v1","addr":"172.21.15.179:6809","nonce":802983577}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":802983577},{"type":"v1","addr":"172.21.15.179:6811","nonce":802983577}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":802983577},{"type":"v1","addr":"172.21.15.179:6815","nonce":802983577}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":802983577},{"type":"v1","addr":"172.21.15.179:6813","nonce":802983577}]},"public_addr":"172.21.15.179:6809/802983577","cluster_addr":"172.21.15.179:6811/802983577","heartbeat_back_addr":"172.21.15.179:6815/802983577","heartbeat_front_addr":"172.21.15.179:6813/802983577","state":["exists","up"]},{"osd":5,"uuid":"67db6d36-f684-4079-b0cd-82b4dd61461f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":518192887},{"type":"v1","addr":"172.21.15.179:6818","nonce":518192887}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":518192887},{"type":"v1","addr":"172.21.15.179:6822","nonce":518192887}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":518192887},{"type":"v1","addr":"172.21.15.179:6829","nonce":518192887}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6824","nonce":518192887},{"type":"v1","addr":"172.21.15.179:6826","nonce":518192887}]},"public_addr":"172.21.15.179:6818/518192887","cluster_addr":"172.21.15.179:6822/518192887","heartbeat_back_addr":"172.21.15.179:6829/518192887","heartbeat_front_addr":"172.21.15.179:6826/518192887","state":["exists","up"]},{"osd":6,"uuid":"12e670af-5a16-4c81-9f97-defa66cab967","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":815435378},{"type":"v1","addr":"172.21.15.179:6801","nonce":815435378}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":815435378},{"type":"v1","addr":"172.21.15.179:6803","nonce":815435378}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":815435378},{"type":"v1","addr":"172.21.15.179:6807","nonce":815435378}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":815435378},{"type":"v1","addr":"172.21.15.179:6805","nonce":815435378}]},"public_addr":"172.21.15.179:6801/815435378","cluster_addr":"172.21.15.179:6803/815435378","heartbeat_back_addr":"172.21.15.179:6807/815435378","heartbeat_front_addr":"172.21.15.179:6805/815435378","state":["exists","up"]},{"osd":7,"uuid":"fe630650-2eb3-49ad-8676-c341e6332eb1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6817","nonce":2848432339},{"type":"v1","addr":"172.21.15.179:6819","nonce":2848432339}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6821","nonce":2848432339},{"type":"v1","addr":"172.21.15.179:6823","nonce":2848432339}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":2848432339},{"type":"v1","addr":"172.21.15.179:6831","nonce":2848432339}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6825","nonce":2848432339},{"type":"v1","addr":"172.21.15.179:6827","nonce":2848432339}]},"public_addr":"172.21.15.179:6819/2848432339","cluster_addr":"172.21.15.179:6823/2848432339","heartbeat_back_addr":"172.21.15.179:6831/2848432339","heartbeat_front_addr":"172.21.15.179:6827/2848432339","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:58:49.255433+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:58:49.412880+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:58:49.559295+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:58:49.245237+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:58:49.184557+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:58:49.329851+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:58:49.366012+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:58:49.349604+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-28T20:01:11.202 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:11.197+0000 7f6c365d1640 1 -- 172.21.15.78:0/2116725473 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f6c1c066470 msgr2=0x7f6c1c068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:01:11.202 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:11.197+0000 7f6c365d1640 1 --2- 172.21.15.78:0/2116725473 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f6c1c066470 0x7f6c1c068930 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f6c2000ba90 tx=0x7f6c20008040 comp rx=0 tx=0).stop 2023-11-28T20:01:11.202 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:11.197+0000 7f6c365d1640 1 -- 172.21.15.78:0/2116725473 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6c3014e3f0 msgr2=0x7f6c301f0a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:01:11.202 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:11.197+0000 7f6c365d1640 1 --2- 172.21.15.78:0/2116725473 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6c3014e3f0 0x7f6c301f0a50 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7f6c280af040 tx=0x7f6c280196b0 comp rx=0 tx=0).stop 2023-11-28T20:01:11.202 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:11.197+0000 7f6c365d1640 1 -- 172.21.15.78:0/2116725473 shutdown_connections 2023-11-28T20:01:11.202 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:11.197+0000 7f6c365d1640 1 --2- 172.21.15.78:0/2116725473 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f6c1c066470 0x7f6c1c068930 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:11.202 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:11.197+0000 7f6c365d1640 1 --2- 172.21.15.78:0/2116725473 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6c3014e3f0 0x7f6c301f0a50 unknown :-1 s=CLOSED pgs=625 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:11.202 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:11.197+0000 7f6c365d1640 1 --2- 172.21.15.78:0/2116725473 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6c300c4730 0x7f6c30141780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:11.203 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:11.197+0000 7f6c365d1640 1 --2- 172.21.15.78:0/2116725473 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6c3006bef0 0x7f6c300bf0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:11.203 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:11.197+0000 7f6c365d1640 1 -- 172.21.15.78:0/2116725473 >> 172.21.15.78:0/2116725473 conn(0x7f6c300a7810 msgr2=0x7f6c300c0340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:01:11.203 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:11.197+0000 7f6c365d1640 1 -- 172.21.15.78:0/2116725473 shutdown_connections 2023-11-28T20:01:11.203 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:11.197+0000 7f6c365d1640 1 -- 172.21.15.78:0/2116725473 wait complete. 2023-11-28T20:01:11.221 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-11-28T20:01:11.360 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:11.357+0000 7f37bf5d1640 1 Processor -- start 2023-11-28T20:01:11.360 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:11.357+0000 7f37bf5d1640 1 -- start start 2023-11-28T20:01:11.362 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:11.357+0000 7f37bf5d1640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f37b80c0e10 0x7f37b80c0370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:11.362 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:11.357+0000 7f37bf5d1640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f37b815bf70 0x7f37b815c3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:11.362 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:11.357+0000 7f37bf5d1640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f37b806bce0 con 0x7f37b8156200 2023-11-28T20:01:11.362 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:11.357+0000 7f37bf5d1640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f37b806d8d0 con 0x7f37b80c0e10 2023-11-28T20:01:11.363 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:11.357+0000 7f37bf5d1640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f37b80c2270 con 0x7f37b815bf70 2023-11-28T20:01:11.363 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:11.357+0000 7f37bcb6c640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f37b80c0e10 0x7f37b80c0370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:11.363 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:11.357+0000 7f37bcb6c640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f37b80c0e10 0x7f37b80c0370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:55934/0 (socket says 172.21.15.78:55934) 2023-11-28T20:01:11.363 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:11.357+0000 7f37bcb6c640 1 -- 172.21.15.78:0/2873965668 learned_addr learned my addr 172.21.15.78:0/2873965668 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T20:01:11.363 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:11.357+0000 7f37bdb6e640 1 --2- 172.21.15.78:0/2873965668 >> v2:172.21.15.179:3300/0 conn(0x7f37b815bf70 0x7f37b815c3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:11.363 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:11.357+0000 7f37bcb6c640 1 -- 172.21.15.78:0/2873965668 >> v2:172.21.15.179:3300/0 conn(0x7f37b815bf70 msgr2=0x7f37b815c3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:01:11.363 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:11.357+0000 7f37bcb6c640 1 --2- 172.21.15.78:0/2873965668 >> v2:172.21.15.179:3300/0 conn(0x7f37b815bf70 0x7f37b815c3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:11.363 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:11.357+0000 7f37bcb6c640 1 -- 172.21.15.78:0/2873965668 >> v1:172.21.15.179:6789/0 conn(0x7f37b8156200 legacy=0x7f37b80c1b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:01:11.363 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:11.357+0000 7f37bcb6c640 1 -- 172.21.15.78:0/2873965668 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37b815cc60 con 0x7f37b80c0e10 2023-11-28T20:01:11.365 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:11.361+0000 7f37bcb6c640 1 --2- 172.21.15.78:0/2873965668 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f37b80c0e10 0x7f37b80c0370 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7f37b80c6ad0 tx=0x7f37a801c3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d341569d80390b36 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:01:11.365 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:11.361+0000 7f37affff640 1 -- 172.21.15.78:0/2873965668 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37a80a8050 con 0x7f37b80c0e10 2023-11-28T20:01:11.365 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:11.361+0000 7f37affff640 1 -- 172.21.15.78:0/2873965668 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f37a80ac5f0 con 0x7f37b80c0e10 2023-11-28T20:01:11.366 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:11.361+0000 7f37affff640 1 -- 172.21.15.78:0/2873965668 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37a80ac980 con 0x7f37b80c0e10 2023-11-28T20:01:11.366 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:11.361+0000 7f37bf5d1640 1 -- 172.21.15.78:0/2873965668 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f37b80c0e10 msgr2=0x7f37b80c0370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:01:11.366 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:11.361+0000 7f37bf5d1640 1 --2- 172.21.15.78:0/2873965668 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f37b80c0e10 0x7f37b80c0370 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7f37b80c6ad0 tx=0x7f37a801c3b0 comp rx=0 tx=0).stop 2023-11-28T20:01:11.367 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:11.361+0000 7f37bf5d1640 1 -- 172.21.15.78:0/2873965668 shutdown_connections 2023-11-28T20:01:11.367 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:11.361+0000 7f37bf5d1640 1 --2- 172.21.15.78:0/2873965668 >> v2:172.21.15.179:3300/0 conn(0x7f37b815bf70 0x7f37b815c3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:11.367 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:11.361+0000 7f37bf5d1640 1 --2- 172.21.15.78:0/2873965668 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f37b80c0e10 0x7f37b80c0370 unknown :-1 s=CLOSED pgs=626 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:11.367 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:11.361+0000 7f37bf5d1640 1 -- 172.21.15.78:0/2873965668 >> 172.21.15.78:0/2873965668 conn(0x7f37b80c59f0 msgr2=0x7f37b80c5e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:01:11.367 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:11.361+0000 7f37bf5d1640 1 -- 172.21.15.78:0/2873965668 shutdown_connections 2023-11-28T20:01:11.367 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:11.361+0000 7f37bf5d1640 1 -- 172.21.15.78:0/2873965668 wait complete. 2023-11-28T20:01:11.368 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:11.365+0000 7f37bf5d1640 1 Processor -- start 2023-11-28T20:01:11.368 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:11.365+0000 7f37bf5d1640 1 -- start start 2023-11-28T20:01:11.370 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:11.365+0000 7f37bf5d1640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f37b80c0e10 0x7f37b814aa30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:11.370 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:11.365+0000 7f37bf5d1640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f37b8156200 0x7f37b814af70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:11.370 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:11.365+0000 7f37bf5d1640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f37b815bf70 0x7f37b8158720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:11.370 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:11.365+0000 7f37bf5d1640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37b8156e90 con 0x7f37b815bf70 2023-11-28T20:01:11.371 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:11.365+0000 7f37bf5d1640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37b81513a0 con 0x7f37b80c0e10 2023-11-28T20:01:11.371 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:11.365+0000 7f37bf5d1640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f37b81f1b20 con 0x7f37b8156200 2023-11-28T20:01:11.371 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:11.365+0000 7f37bdb6e640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f37b815bf70 0x7f37b8158720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:11.371 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:11.365+0000 7f37bdb6e640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f37b815bf70 0x7f37b8158720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:55950/0 (socket says 172.21.15.78:55950) 2023-11-28T20:01:11.371 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:11.365+0000 7f37bdb6e640 1 -- 172.21.15.78:0/1029374886 learned_addr learned my addr 172.21.15.78:0/1029374886 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T20:01:11.371 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:11.365+0000 7f37bd36d640 1 --2- 172.21.15.78:0/1029374886 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f37b80c0e10 0x7f37b814aa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:11.371 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:11.365+0000 7f37bcb6c640 1 --2- 172.21.15.78:0/1029374886 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f37b8156200 0x7f37b814af70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:11.371 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:11.365+0000 7f37bdb6e640 1 -- 172.21.15.78:0/1029374886 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f37b8156200 msgr2=0x7f37b814af70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:01:11.371 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:11.365+0000 7f37bdb6e640 1 --2- 172.21.15.78:0/1029374886 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f37b8156200 0x7f37b814af70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:11.372 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:11.365+0000 7f37bdb6e640 1 -- 172.21.15.78:0/1029374886 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f37b80c0e10 msgr2=0x7f37b814aa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:01:11.372 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:11.365+0000 7f37bdb6e640 1 --2- 172.21.15.78:0/1029374886 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f37b80c0e10 0x7f37b814aa30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:11.372 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:11.365+0000 7f37bdb6e640 1 -- 172.21.15.78:0/1029374886 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37a80094d0 con 0x7f37b815bf70 2023-11-28T20:01:11.372 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:11.365+0000 7f37bdb6e640 1 --2- 172.21.15.78:0/1029374886 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f37b815bf70 0x7f37b8158720 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7f37b000efc0 tx=0x7f37b000c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:01:11.372 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:11.365+0000 7f37adffb640 1 -- 172.21.15.78:0/1029374886 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37b0014480 con 0x7f37b815bf70 2023-11-28T20:01:11.372 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:11.365+0000 7f37adffb640 1 -- 172.21.15.78:0/1029374886 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f37b000f040 con 0x7f37b815bf70 2023-11-28T20:01:11.372 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:11.365+0000 7f37adffb640 1 -- 172.21.15.78:0/1029374886 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37b0014820 con 0x7f37b815bf70 2023-11-28T20:01:11.372 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:11.365+0000 7f37bf5d1640 1 -- 172.21.15.78:0/1029374886 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f37b8157d70 con 0x7f37b815bf70 2023-11-28T20:01:11.373 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:11.365+0000 7f37bf5d1640 1 -- 172.21.15.78:0/1029374886 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f37b8156bb0 con 0x7f37b815bf70 2023-11-28T20:01:11.373 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:11.369+0000 7f37bf5d1640 1 -- 172.21.15.78:0/1029374886 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f37b8151510 con 0x7f37b815bf70 2023-11-28T20:01:11.373 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:11.369+0000 7f37adffb640 1 -- 172.21.15.78:0/1029374886 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f37b0014980 con 0x7f37b815bf70 2023-11-28T20:01:11.374 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:11.369+0000 7f37adffb640 1 --2- 172.21.15.78:0/1029374886 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f379c066470 0x7f379c068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:11.374 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:11.369+0000 7f37adffb640 1 -- 172.21.15.78:0/1029374886 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f37b00849d0 con 0x7f37b815bf70 2023-11-28T20:01:11.374 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:11.369+0000 7f37bd36d640 1 --2- 172.21.15.78:0/1029374886 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f379c066470 0x7f379c068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:11.375 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:11.369+0000 7f37bd36d640 1 --2- 172.21.15.78:0/1029374886 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f379c066470 0x7f379c068930 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f37b4007fd0 tx=0x7f37b4009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:01:11.378 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:11.373+0000 7f37adffb640 1 -- 172.21.15.78:0/1029374886 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f37b0051db0 con 0x7f37b815bf70 2023-11-28T20:01:11.565 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:11.561+0000 7f37bf5d1640 1 -- 172.21.15.78:0/1029374886 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f37b8067630 con 0x7f37b815bf70 2023-11-28T20:01:12.533 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:12.529+0000 7f37adffb640 1 -- 172.21.15.78:0/1029374886 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v30) v1 ==== 118+0+0 (secure 0 0 0) 0x7f37b0018020 con 0x7f37b815bf70 2023-11-28T20:01:12.537 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:12.533+0000 7f37bf5d1640 1 -- 172.21.15.78:0/1029374886 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f379c066470 msgr2=0x7f379c068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:01:12.537 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:12.533+0000 7f37bf5d1640 1 --2- 172.21.15.78:0/1029374886 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f379c066470 0x7f379c068930 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f37b4007fd0 tx=0x7f37b4009040 comp rx=0 tx=0).stop 2023-11-28T20:01:12.537 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:12.533+0000 7f37bf5d1640 1 -- 172.21.15.78:0/1029374886 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f37b815bf70 msgr2=0x7f37b8158720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:01:12.537 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:12.533+0000 7f37bf5d1640 1 --2- 172.21.15.78:0/1029374886 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f37b815bf70 0x7f37b8158720 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7f37b000efc0 tx=0x7f37b000c490 comp rx=0 tx=0).stop 2023-11-28T20:01:12.537 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:12.533+0000 7f37bf5d1640 1 -- 172.21.15.78:0/1029374886 shutdown_connections 2023-11-28T20:01:12.537 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:12.533+0000 7f37bf5d1640 1 --2- 172.21.15.78:0/1029374886 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f379c066470 0x7f379c068930 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:12.537 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:12.533+0000 7f37bf5d1640 1 --2- 172.21.15.78:0/1029374886 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f37b8156200 0x7f37b814af70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:12.537 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:12.533+0000 7f37bf5d1640 1 --2- 172.21.15.78:0/1029374886 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f37b815bf70 0x7f37b8158720 unknown :-1 s=CLOSED pgs=627 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:12.537 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:12.533+0000 7f37bf5d1640 1 --2- 172.21.15.78:0/1029374886 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f37b80c0e10 0x7f37b814aa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:12.537 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:12.533+0000 7f37bf5d1640 1 -- 172.21.15.78:0/1029374886 >> 172.21.15.78:0/1029374886 conn(0x7f37b80c59f0 msgr2=0x7f37b8150a70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:01:12.538 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:12.533+0000 7f37bf5d1640 1 -- 172.21.15.78:0/1029374886 shutdown_connections 2023-11-28T20:01:12.538 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:12.533+0000 7f37bf5d1640 1 -- 172.21.15.78:0/1029374886 wait complete. 2023-11-28T20:01:12.559 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-11-28T20:01:12.559 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-11-28T20:01:12.703 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:12.697+0000 7f580f65a640 1 Processor -- start 2023-11-28T20:01:12.703 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:12.697+0000 7f580f65a640 1 -- start start 2023-11-28T20:01:12.707 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:12.701+0000 7f580f65a640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f58081516a0 0x7f58080c4180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:12.707 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:12.701+0000 7f580f65a640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5808151210 con 0x7f580814e2a0 2023-11-28T20:01:12.707 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:12.701+0000 7f580f65a640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f580814e680 con 0x7f58080c46c0 2023-11-28T20:01:12.707 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:12.701+0000 7f580f65a640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5808151b50 con 0x7f58081516a0 2023-11-28T20:01:12.707 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:12.701+0000 7f580d3f6640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f580814e2a0 0x7f58080a9460 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:59792/0 (socket says 172.21.15.78:59792) 2023-11-28T20:01:12.707 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:12.701+0000 7f580d3f6640 1 -- 172.21.15.78:0/2488301055 learned_addr learned my addr 172.21.15.78:0/2488301055 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-11-28T20:01:12.708 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:12.701+0000 7f580cbf5640 1 --2- 172.21.15.78:0/2488301055 >> v2:172.21.15.179:3300/0 conn(0x7f58081516a0 0x7f58080c4180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:12.708 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:12.701+0000 7f57fffff640 1 -- 172.21.15.78:0/2488301055 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2141967924 0 0) 0x7f5808151210 con 0x7f580814e2a0 2023-11-28T20:01:12.708 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:12.701+0000 7f57fffff640 1 -- 172.21.15.78:0/2488301055 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f57f4003530 con 0x7f580814e2a0 2023-11-28T20:01:12.708 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:12.701+0000 7f57fffff640 1 -- 172.21.15.78:0/2488301055 <== mon.0 v1:172.21.15.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 312961584 0 0) 0x7f57f4003530 con 0x7f580814e2a0 2023-11-28T20:01:12.708 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:12.701+0000 7f57fffff640 1 -- 172.21.15.78:0/2488301055 >> v2:172.21.15.179:3300/0 conn(0x7f58081516a0 msgr2=0x7f58080c4180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:01:12.708 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:12.701+0000 7f57fffff640 1 --2- 172.21.15.78:0/2488301055 >> v2:172.21.15.179:3300/0 conn(0x7f58081516a0 0x7f58080c4180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:12.709 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:12.701+0000 7f57fffff640 1 -- 172.21.15.78:0/2488301055 >> v1:172.21.15.179:6789/0 conn(0x7f58080c46c0 legacy=0x7f580806bc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:01:12.709 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:12.701+0000 7f57fffff640 1 -- 172.21.15.78:0/2488301055 --> v1:172.21.15.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58080a9b70 con 0x7f580814e2a0 2023-11-28T20:01:12.709 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:12.701+0000 7f57fffff640 1 -- 172.21.15.78:0/2488301055 <== mon.0 v1:172.21.15.78:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3326804700 0 0) 0x7f5804001680 con 0x7f580814e2a0 2023-11-28T20:01:12.709 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:12.701+0000 7f57fffff640 1 -- 172.21.15.78:0/2488301055 >> v1:172.21.15.78:6789/0 conn(0x7f580814e2a0 legacy=0x7f58080a9460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:01:12.709 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:12.701+0000 7f57fffff640 1 --2- 172.21.15.78:0/2488301055 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f57f4003980 0x7f57f4003d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:12.709 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:12.701+0000 7f57fffff640 1 --2- 172.21.15.78:0/2488301055 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f57f4004380 0x7f57f4004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:12.709 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:12.701+0000 7f57fffff640 1 --2- 172.21.15.78:0/2488301055 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f57f4005050 0x7f57f400b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:12.709 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:12.701+0000 7f57fffff640 1 -- 172.21.15.78:0/2488301055 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5808151b50 con 0x7f57f4004380 2023-11-28T20:01:12.709 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:12.701+0000 7f57fffff640 1 -- 172.21.15.78:0/2488301055 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57f400bfb0 con 0x7f57f4005050 2023-11-28T20:01:12.709 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:12.701+0000 7f57fffff640 1 -- 172.21.15.78:0/2488301055 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f57f400c170 con 0x7f57f4003980 2023-11-28T20:01:12.709 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:12.701+0000 7f580cbf5640 1 --2- 172.21.15.78:0/2488301055 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f57f4004380 0x7f57f4004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:12.710 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:12.701+0000 7f580dbf7640 1 --2- 172.21.15.78:0/2488301055 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f57f4005050 0x7f57f400b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:12.710 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:12.701+0000 7f580d3f6640 1 --2- 172.21.15.78:0/2488301055 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f57f4003980 0x7f57f4003d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:12.710 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:12.701+0000 7f580cbf5640 1 -- 172.21.15.78:0/2488301055 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f57f4003980 msgr2=0x7f57f4003d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:01:12.710 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:12.701+0000 7f580cbf5640 1 --2- 172.21.15.78:0/2488301055 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f57f4003980 0x7f57f4003d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:12.710 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:12.701+0000 7f580cbf5640 1 -- 172.21.15.78:0/2488301055 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f57f4005050 msgr2=0x7f57f400b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:01:12.710 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:12.701+0000 7f580cbf5640 1 --2- 172.21.15.78:0/2488301055 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f57f4005050 0x7f57f400b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:12.710 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:12.701+0000 7f580cbf5640 1 -- 172.21.15.78:0/2488301055 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57f4003530 con 0x7f57f4004380 2023-11-28T20:01:12.710 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:12.701+0000 7f580dbf7640 1 -- 172.21.15.78:0/2488301055 reap_dead start 2023-11-28T20:01:12.711 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:12.705+0000 7f580cbf5640 1 --2- 172.21.15.78:0/2488301055 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f57f4004380 0x7f57f4004850 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7f57f8009ae0 tx=0x7f57f801ca50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7d608fd72786a3a5 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:01:12.711 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:12.705+0000 7f57fffff640 1 -- 172.21.15.78:0/2488301055 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57f80a5640 con 0x7f57f4004380 2023-11-28T20:01:12.712 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:12.705+0000 7f57fffff640 1 -- 172.21.15.78:0/2488301055 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f57f80a57a0 con 0x7f57f4004380 2023-11-28T20:01:12.712 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:12.705+0000 7f57fffff640 1 -- 172.21.15.78:0/2488301055 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57f80a5b50 con 0x7f57f4004380 2023-11-28T20:01:12.712 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:12.705+0000 7f580f65a640 1 -- 172.21.15.78:0/2488301055 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f57f4004380 msgr2=0x7f57f4004850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:01:12.712 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:12.705+0000 7f580f65a640 1 --2- 172.21.15.78:0/2488301055 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f57f4004380 0x7f57f4004850 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7f57f8009ae0 tx=0x7f57f801ca50 comp rx=0 tx=0).stop 2023-11-28T20:01:12.712 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:12.705+0000 7f580f65a640 1 -- 172.21.15.78:0/2488301055 shutdown_connections 2023-11-28T20:01:12.712 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:12.705+0000 7f580f65a640 1 --2- 172.21.15.78:0/2488301055 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f57f4004380 0x7f57f4004850 unknown :-1 s=CLOSED pgs=629 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:12.712 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:12.705+0000 7f580f65a640 1 -- 172.21.15.78:0/2488301055 >> 172.21.15.78:0/2488301055 conn(0x7f58080c59f0 msgr2=0x7f58080c5e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:01:12.712 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:12.705+0000 7f580f65a640 1 -- 172.21.15.78:0/2488301055 shutdown_connections 2023-11-28T20:01:12.712 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:12.705+0000 7f580f65a640 1 -- 172.21.15.78:0/2488301055 wait complete. 2023-11-28T20:01:12.714 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:12.709+0000 7f580f65a640 1 Processor -- start 2023-11-28T20:01:12.714 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:12.709+0000 7f580f65a640 1 -- start start 2023-11-28T20:01:12.715 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:12.709+0000 7f580f65a640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f57f4004380 0x7f5808154080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:12.715 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:12.709+0000 7f580f65a640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f58081545c0 0x7f58080c1850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:12.715 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:12.709+0000 7f580f65a640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f58080c1d90 0x7f5808152ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:12.715 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:12.709+0000 7f580f65a640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58080c2210 con 0x7f57f4004380 2023-11-28T20:01:12.715 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:12.709+0000 7f580f65a640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5808153760 con 0x7f58080c1d90 2023-11-28T20:01:12.715 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:12.709+0000 7f580f65a640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5808152640 con 0x7f58081545c0 2023-11-28T20:01:12.715 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:12.709+0000 7f580d3f6640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f57f4004380 0x7f5808154080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:12.715 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:12.709+0000 7f580d3f6640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f57f4004380 0x7f5808154080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:55960/0 (socket says 172.21.15.78:55960) 2023-11-28T20:01:12.715 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:12.709+0000 7f580d3f6640 1 -- 172.21.15.78:0/3872002328 learned_addr learned my addr 172.21.15.78:0/3872002328 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T20:01:12.715 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:12.709+0000 7f580cbf5640 1 --2- 172.21.15.78:0/3872002328 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f58081545c0 0x7f58080c1850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:12.715 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:12.709+0000 7f580dbf7640 1 --2- 172.21.15.78:0/3872002328 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f58080c1d90 0x7f5808152ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:12.716 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:12.709+0000 7f580d3f6640 1 -- 172.21.15.78:0/3872002328 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f58081545c0 msgr2=0x7f58080c1850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:01:12.716 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:12.709+0000 7f580d3f6640 1 --2- 172.21.15.78:0/3872002328 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f58081545c0 0x7f58080c1850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:12.716 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:12.709+0000 7f580d3f6640 1 -- 172.21.15.78:0/3872002328 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f58080c1d90 msgr2=0x7f5808152ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:01:12.716 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:12.709+0000 7f580d3f6640 1 --2- 172.21.15.78:0/3872002328 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f58080c1d90 0x7f5808152ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:12.716 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:12.709+0000 7f580d3f6640 1 -- 172.21.15.78:0/3872002328 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58081e9d90 con 0x7f57f4004380 2023-11-28T20:01:12.716 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:12.709+0000 7f580d3f6640 1 --2- 172.21.15.78:0/3872002328 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f57f4004380 0x7f5808154080 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7f580400e8c0 tx=0x7f580400ed80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:01:12.716 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:12.709+0000 7f57fdffb640 1 -- 172.21.15.78:0/3872002328 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f580400c8d0 con 0x7f57f4004380 2023-11-28T20:01:12.716 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:12.709+0000 7f57fdffb640 1 -- 172.21.15.78:0/3872002328 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f580400ca30 con 0x7f57f4004380 2023-11-28T20:01:12.716 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:12.709+0000 7f580f65a640 1 -- 172.21.15.78:0/3872002328 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5808151ff0 con 0x7f57f4004380 2023-11-28T20:01:12.716 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:12.709+0000 7f57fdffb640 1 -- 172.21.15.78:0/3872002328 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f580400cde0 con 0x7f57f4004380 2023-11-28T20:01:12.716 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:12.709+0000 7f580f65a640 1 -- 172.21.15.78:0/3872002328 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5808072ac0 con 0x7f57f4004380 2023-11-28T20:01:12.717 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:12.713+0000 7f580f65a640 1 -- 172.21.15.78:0/3872002328 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f580806b930 con 0x7f57f4004380 2023-11-28T20:01:12.717 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:12.713+0000 7f57fdffb640 1 -- 172.21.15.78:0/3872002328 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f580401d460 con 0x7f57f4004380 2023-11-28T20:01:12.717 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:12.713+0000 7f57fdffb640 1 --2- 172.21.15.78:0/3872002328 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f57ec066470 0x7f57ec068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:12.717 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:12.713+0000 7f57fdffb640 1 -- 172.21.15.78:0/3872002328 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f5804083f60 con 0x7f57f4004380 2023-11-28T20:01:12.718 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:12.713+0000 7f580cbf5640 1 --2- 172.21.15.78:0/3872002328 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f57ec066470 0x7f57ec068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:12.718 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:12.713+0000 7f580cbf5640 1 --2- 172.21.15.78:0/3872002328 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f57ec066470 0x7f57ec068930 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f57f80af000 tx=0x7f57f80046d0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:01:12.721 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:12.717+0000 7f57fdffb640 1 -- 172.21.15.78:0/3872002328 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f58040512b0 con 0x7f57f4004380 2023-11-28T20:01:12.908 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:12.905+0000 7f580f65a640 1 -- 172.21.15.78:0/3872002328 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f5808067630 con 0x7f57f4004380 2023-11-28T20:01:13.540 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:13.537+0000 7f57fdffb640 1 -- 172.21.15.78:0/3872002328 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v31) v1 ==== 122+0+0 (secure 0 0 0) 0x7f58040548d0 con 0x7f57f4004380 2023-11-28T20:01:13.544 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:13.541+0000 7f580f65a640 1 -- 172.21.15.78:0/3872002328 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f57ec066470 msgr2=0x7f57ec068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:01:13.544 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:13.541+0000 7f580f65a640 1 --2- 172.21.15.78:0/3872002328 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f57ec066470 0x7f57ec068930 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f57f80af000 tx=0x7f57f80046d0 comp rx=0 tx=0).stop 2023-11-28T20:01:13.544 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:13.541+0000 7f580f65a640 1 -- 172.21.15.78:0/3872002328 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f57f4004380 msgr2=0x7f5808154080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:01:13.544 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:13.541+0000 7f580f65a640 1 --2- 172.21.15.78:0/3872002328 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f57f4004380 0x7f5808154080 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7f580400e8c0 tx=0x7f580400ed80 comp rx=0 tx=0).stop 2023-11-28T20:01:13.544 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:13.541+0000 7f580f65a640 1 -- 172.21.15.78:0/3872002328 shutdown_connections 2023-11-28T20:01:13.544 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:13.541+0000 7f580f65a640 1 --2- 172.21.15.78:0/3872002328 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f57ec066470 0x7f57ec068930 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:13.545 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:13.541+0000 7f580f65a640 1 --2- 172.21.15.78:0/3872002328 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f58081545c0 0x7f58080c1850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:13.545 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:13.541+0000 7f580f65a640 1 --2- 172.21.15.78:0/3872002328 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f58080c1d90 0x7f5808152ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:13.545 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:13.541+0000 7f580f65a640 1 --2- 172.21.15.78:0/3872002328 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f57f4004380 0x7f5808154080 unknown :-1 s=CLOSED pgs=630 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:13.545 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:13.541+0000 7f580f65a640 1 -- 172.21.15.78:0/3872002328 >> 172.21.15.78:0/3872002328 conn(0x7f58080c59f0 msgr2=0x7f58080aaa80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:01:13.545 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:13.541+0000 7f580f65a640 1 -- 172.21.15.78:0/3872002328 shutdown_connections 2023-11-28T20:01:13.545 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:13.541+0000 7f580f65a640 1 -- 172.21.15.78:0/3872002328 wait complete. 2023-11-28T20:01:13.565 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-11-28T20:01:13.565 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-28T20:01:13.703 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:13.701+0000 7fbb6ddaa640 1 Processor -- start 2023-11-28T20:01:13.704 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:13.701+0000 7fbb6ddaa640 1 -- start start 2023-11-28T20:01:13.705 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:13.701+0000 7fbb6ddaa640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fbb6814e3f0 0x7fbb680bfce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:13.705 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:13.701+0000 7fbb6ddaa640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbb68151690 con 0x7fbb6806bef0 2023-11-28T20:01:13.705 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:13.701+0000 7fbb6ddaa640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbb68151bc0 con 0x7fbb6806c5b0 2023-11-28T20:01:13.705 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:13.701+0000 7fbb6ddaa640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbb681518e0 con 0x7fbb6814e3f0 2023-11-28T20:01:13.705 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:13.701+0000 7fbb677fe640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fbb6814e3f0 0x7fbb680bfce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:13.705 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:13.701+0000 7fbb677fe640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fbb6814e3f0 0x7fbb680bfce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:55968/0 (socket says 172.21.15.78:55968) 2023-11-28T20:01:13.706 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:13.701+0000 7fbb5ffff640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7fbb6806bef0 0x7fbb680c41f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:59802/0 (socket says 172.21.15.78:59802) 2023-11-28T20:01:13.706 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:13.701+0000 7fbb677fe640 1 -- 172.21.15.78:0/661770949 learned_addr learned my addr 172.21.15.78:0/661770949 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T20:01:13.706 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:13.701+0000 7fbb677fe640 1 -- 172.21.15.78:0/661770949 >> v1:172.21.15.179:6789/0 conn(0x7fbb6806c5b0 legacy=0x7fbb6806ca20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:01:13.706 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:13.701+0000 7fbb677fe640 1 -- 172.21.15.78:0/661770949 >> v1:172.21.15.78:6789/0 conn(0x7fbb6806bef0 legacy=0x7fbb680c41f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:01:13.707 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:13.701+0000 7fbb677fe640 1 -- 172.21.15.78:0/661770949 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb680c1de0 con 0x7fbb6814e3f0 2023-11-28T20:01:13.707 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:13.701+0000 7fbb66ffd640 1 -- 172.21.15.78:0/661770949 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4197930697 0 0) 0x7fbb68151690 con 0x7fbb6806bef0 2023-11-28T20:01:13.708 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:13.705+0000 7fbb677fe640 1 --2- 172.21.15.78:0/661770949 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbb6814e3f0 0x7fbb680bfce0 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7fbb5800aa10 tx=0x7fbb5801d850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c214ac32ae1af5aa server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:01:13.709 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:13.705+0000 7fbb66ffd640 1 -- 172.21.15.78:0/661770949 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb580a67b0 con 0x7fbb6814e3f0 2023-11-28T20:01:13.709 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:13.705+0000 7fbb66ffd640 1 -- 172.21.15.78:0/661770949 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb580a6910 con 0x7fbb6814e3f0 2023-11-28T20:01:13.709 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:13.705+0000 7fbb66ffd640 1 -- 172.21.15.78:0/661770949 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb580a6ca0 con 0x7fbb6814e3f0 2023-11-28T20:01:13.710 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:13.705+0000 7fbb6ddaa640 1 -- 172.21.15.78:0/661770949 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbb6814e3f0 msgr2=0x7fbb680bfce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:01:13.710 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:13.705+0000 7fbb6ddaa640 1 --2- 172.21.15.78:0/661770949 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbb6814e3f0 0x7fbb680bfce0 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7fbb5800aa10 tx=0x7fbb5801d850 comp rx=0 tx=0).stop 2023-11-28T20:01:13.710 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:13.705+0000 7fbb6ddaa640 1 -- 172.21.15.78:0/661770949 shutdown_connections 2023-11-28T20:01:13.710 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:13.705+0000 7fbb6ddaa640 1 --2- 172.21.15.78:0/661770949 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbb6814e3f0 0x7fbb680bfce0 unknown :-1 s=CLOSED pgs=632 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:13.710 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:13.705+0000 7fbb6ddaa640 1 -- 172.21.15.78:0/661770949 >> 172.21.15.78:0/661770949 conn(0x7fbb680a7810 msgr2=0x7fbb680a7c20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:01:13.710 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:13.705+0000 7fbb6ddaa640 1 -- 172.21.15.78:0/661770949 shutdown_connections 2023-11-28T20:01:13.710 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:13.705+0000 7fbb6ddaa640 1 -- 172.21.15.78:0/661770949 wait complete. 2023-11-28T20:01:13.711 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:13.705+0000 7fbb6ddaa640 1 Processor -- start 2023-11-28T20:01:13.711 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:13.705+0000 7fbb6ddaa640 1 -- start start 2023-11-28T20:01:13.713 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:13.709+0000 7fbb6ddaa640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbb6806bef0 0x7fbb6814f880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:13.713 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:13.709+0000 7fbb6ddaa640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbb6806c5b0 0x7fbb68145b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:13.713 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:13.709+0000 7fbb6ddaa640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbb6814e3f0 0x7fbb681f06b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:13.713 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:13.709+0000 7fbb6ddaa640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb681500d0 con 0x7fbb6814e3f0 2023-11-28T20:01:13.714 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:13.709+0000 7fbb6ddaa640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb681503b0 con 0x7fbb6806bef0 2023-11-28T20:01:13.714 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:13.709+0000 7fbb6ddaa640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb68150690 con 0x7fbb6806c5b0 2023-11-28T20:01:13.714 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:13.709+0000 7fbb67fff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbb6814e3f0 0x7fbb681f06b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:13.714 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:13.709+0000 7fbb67fff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbb6814e3f0 0x7fbb681f06b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:55972/0 (socket says 172.21.15.78:55972) 2023-11-28T20:01:13.714 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:13.709+0000 7fbb67fff640 1 -- 172.21.15.78:0/2366003220 learned_addr learned my addr 172.21.15.78:0/2366003220 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T20:01:13.714 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:13.709+0000 7fbb677fe640 1 --2- 172.21.15.78:0/2366003220 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbb6806bef0 0x7fbb6814f880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:13.714 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:13.709+0000 7fbb5ffff640 1 --2- 172.21.15.78:0/2366003220 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbb6806c5b0 0x7fbb68145b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:13.714 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:13.709+0000 7fbb67fff640 1 -- 172.21.15.78:0/2366003220 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbb6806c5b0 msgr2=0x7fbb68145b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:01:13.714 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:13.709+0000 7fbb67fff640 1 --2- 172.21.15.78:0/2366003220 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbb6806c5b0 0x7fbb68145b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:13.714 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:13.709+0000 7fbb67fff640 1 -- 172.21.15.78:0/2366003220 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbb6806bef0 msgr2=0x7fbb6814f880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:01:13.714 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:13.709+0000 7fbb67fff640 1 --2- 172.21.15.78:0/2366003220 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbb6806bef0 0x7fbb6814f880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:13.715 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:13.709+0000 7fbb67fff640 1 -- 172.21.15.78:0/2366003220 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb5800a670 con 0x7fbb6814e3f0 2023-11-28T20:01:13.715 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:13.709+0000 7fbb67fff640 1 --2- 172.21.15.78:0/2366003220 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbb6814e3f0 0x7fbb681f06b0 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7fbb6000c6c0 tx=0x7fbb6000cb80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:01:13.715 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:13.709+0000 7fbb64ff9640 1 -- 172.21.15.78:0/2366003220 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb60003b80 con 0x7fbb6814e3f0 2023-11-28T20:01:13.715 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:13.709+0000 7fbb64ff9640 1 -- 172.21.15.78:0/2366003220 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb60003ce0 con 0x7fbb6814e3f0 2023-11-28T20:01:13.715 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:13.709+0000 7fbb6ddaa640 1 -- 172.21.15.78:0/2366003220 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbb68150970 con 0x7fbb6814e3f0 2023-11-28T20:01:13.715 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:13.709+0000 7fbb64ff9640 1 -- 172.21.15.78:0/2366003220 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb600052f0 con 0x7fbb6814e3f0 2023-11-28T20:01:13.715 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:13.709+0000 7fbb6ddaa640 1 -- 172.21.15.78:0/2366003220 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbb6814fdc0 con 0x7fbb6814e3f0 2023-11-28T20:01:13.715 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:13.709+0000 7fbb6ddaa640 1 -- 172.21.15.78:0/2366003220 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbb68067630 con 0x7fbb6814e3f0 2023-11-28T20:01:13.716 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:13.709+0000 7fbb64ff9640 1 -- 172.21.15.78:0/2366003220 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fbb60005450 con 0x7fbb6814e3f0 2023-11-28T20:01:13.716 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:13.713+0000 7fbb64ff9640 1 --2- 172.21.15.78:0/2366003220 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fbb480664a0 0x7fbb48068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:13.716 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:13.713+0000 7fbb64ff9640 1 -- 172.21.15.78:0/2366003220 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 6029+0+0 (secure 0 0 0) 0x7fbb60083ba0 con 0x7fbb6814e3f0 2023-11-28T20:01:13.716 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:13.713+0000 7fbb677fe640 1 --2- 172.21.15.78:0/2366003220 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fbb480664a0 0x7fbb48068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:13.717 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:13.713+0000 7fbb677fe640 1 --2- 172.21.15.78:0/2366003220 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fbb480664a0 0x7fbb48068960 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7fbb580b0000 tx=0x7fbb58008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:01:13.720 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:13.717+0000 7fbb64ff9640 1 -- 172.21.15.78:0/2366003220 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fbb60050f90 con 0x7fbb6814e3f0 2023-11-28T20:01:13.901 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:13.897+0000 7fbb6ddaa640 1 -- 172.21.15.78:0/2366003220 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fbb68070af0 con 0x7fbb6814e3f0 2023-11-28T20:01:13.902 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:13.897+0000 7fbb64ff9640 1 -- 172.21.15.78:0/2366003220 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 31 v31) v1 ==== 94+0+4911 (secure 0 0 0) 0x7fbb600545b0 con 0x7fbb6814e3f0 2023-11-28T20:01:13.902 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-11-28T20:01:13.902 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":31,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5384,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6834/837155031","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6832","nonce":837155031},{"type":"v1","addr":"172.21.15.179:6834","nonce":837155031}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":27},{"gid":5387,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6835/752467462","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6833","nonce":752467462},{"type":"v1","addr":"172.21.15.179:6835","nonce":752467462}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":27},{"gid":5889,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6835/1997036463","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6834","nonce":1997036463},{"type":"v1","addr":"172.21.15.78:6835","nonce":1997036463}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":27}],"filesystems":[{"mdsmap":{"epoch":31,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-28T20:01:09.868520+0000","modified":"2023-11-28T20:01:12.907972+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5892},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5892":{"gid":5892,"name":"a","rank":0,"incarnation":28,"state":"up:active","state_seq":3,"addr":"172.21.15.78:6837/115607035","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6836","nonce":115607035},{"type":"v1","addr":"172.21.15.78:6837","nonce":115607035}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":4}]} 2023-11-28T20:01:13.902 INFO:teuthology.orchestra.run.smithi078.stderr:dumped fsmap epoch 31 2023-11-28T20:01:13.904 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:13.901+0000 7fbb6ddaa640 1 -- 172.21.15.78:0/2366003220 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fbb480664a0 msgr2=0x7fbb48068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:01:13.904 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:13.901+0000 7fbb6ddaa640 1 --2- 172.21.15.78:0/2366003220 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fbb480664a0 0x7fbb48068960 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7fbb580b0000 tx=0x7fbb58008040 comp rx=0 tx=0).stop 2023-11-28T20:01:13.904 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:13.901+0000 7fbb6ddaa640 1 -- 172.21.15.78:0/2366003220 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbb6814e3f0 msgr2=0x7fbb681f06b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:01:13.904 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:13.901+0000 7fbb6ddaa640 1 --2- 172.21.15.78:0/2366003220 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbb6814e3f0 0x7fbb681f06b0 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7fbb6000c6c0 tx=0x7fbb6000cb80 comp rx=0 tx=0).stop 2023-11-28T20:01:13.904 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:13.901+0000 7fbb6ddaa640 1 -- 172.21.15.78:0/2366003220 shutdown_connections 2023-11-28T20:01:13.904 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:13.901+0000 7fbb6ddaa640 1 --2- 172.21.15.78:0/2366003220 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fbb480664a0 0x7fbb48068960 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:13.905 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:13.901+0000 7fbb6ddaa640 1 --2- 172.21.15.78:0/2366003220 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbb6806c5b0 0x7fbb68145b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:13.905 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:13.901+0000 7fbb6ddaa640 1 --2- 172.21.15.78:0/2366003220 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbb6814e3f0 0x7fbb681f06b0 unknown :-1 s=CLOSED pgs=633 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:13.905 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:13.901+0000 7fbb6ddaa640 1 --2- 172.21.15.78:0/2366003220 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbb6806bef0 0x7fbb6814f880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:13.905 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:13.901+0000 7fbb6ddaa640 1 -- 172.21.15.78:0/2366003220 >> 172.21.15.78:0/2366003220 conn(0x7fbb680a7810 msgr2=0x7fbb680c41f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:01:13.905 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:13.901+0000 7fbb6ddaa640 1 -- 172.21.15.78:0/2366003220 shutdown_connections 2023-11-28T20:01:13.905 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:13.901+0000 7fbb6ddaa640 1 -- 172.21.15.78:0/2366003220 wait complete. 2023-11-28T20:01:13.923 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-28T20:01:14.061 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:14.057+0000 7f7966d96640 1 Processor -- start 2023-11-28T20:01:14.061 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:14.057+0000 7f7966d96640 1 -- start start 2023-11-28T20:01:14.062 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:14.057+0000 7f7966d96640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f796006bef0 0x7f79600bfce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:14.062 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:14.057+0000 7f7966d96640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f796014e3f0 0x7f796006c5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:14.062 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:14.057+0000 7f7966d96640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7960151690 con 0x7f796006caf0 2023-11-28T20:01:14.062 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:14.057+0000 7f7966d96640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7960151bc0 con 0x7f796006bef0 2023-11-28T20:01:14.062 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:14.057+0000 7f7966d96640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79601518e0 con 0x7f796014e3f0 2023-11-28T20:01:14.062 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:14.057+0000 7f7964b32640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f796006bef0 0x7f79600bfce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:14.063 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:14.057+0000 7f7964b32640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f796006bef0 0x7f79600bfce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.78:44282/0 (socket says 172.21.15.78:44282) 2023-11-28T20:01:14.063 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:14.057+0000 7f7964b32640 1 -- 172.21.15.78:0/3487479264 learned_addr learned my addr 172.21.15.78:0/3487479264 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T20:01:14.063 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:14.057+0000 7f795ffff640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f796014e3f0 0x7f796006c5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:14.063 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:14.057+0000 7f795ffff640 1 -- 172.21.15.78:0/3487479264 >> v2:172.21.15.179:3300/0 conn(0x7f796006bef0 msgr2=0x7f79600bfce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:01:14.063 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:14.057+0000 7f795ffff640 1 --2- 172.21.15.78:0/3487479264 >> v2:172.21.15.179:3300/0 conn(0x7f796006bef0 0x7f79600bfce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:14.064 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:14.057+0000 7f795ffff640 1 -- 172.21.15.78:0/3487479264 >> v1:172.21.15.179:6789/0 conn(0x7f796006caf0 legacy=0x7f7960154180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:01:14.064 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:14.057+0000 7f795ffff640 1 -- 172.21.15.78:0/3487479264 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79600c1de0 con 0x7f796014e3f0 2023-11-28T20:01:14.064 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:14.057+0000 7f7964b32640 1 --2- 172.21.15.78:0/3487479264 >> v2:172.21.15.179:3300/0 conn(0x7f796006bef0 0x7f79600bfce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T20:01:14.065 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:14.061+0000 7f795ffff640 1 --2- 172.21.15.78:0/3487479264 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f796014e3f0 0x7f796006c5b0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f794c0097c0 tx=0x7f794c01c3f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=91d19bfe696cb42f server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:01:14.066 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:14.061+0000 7f795f7fe640 1 -- 172.21.15.78:0/3487479264 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f794c0ab600 con 0x7f796014e3f0 2023-11-28T20:01:14.066 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:14.061+0000 7f795f7fe640 1 -- 172.21.15.78:0/3487479264 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f794c0a7050 con 0x7f796014e3f0 2023-11-28T20:01:14.066 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:14.061+0000 7f795f7fe640 1 -- 172.21.15.78:0/3487479264 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f794c0ab980 con 0x7f796014e3f0 2023-11-28T20:01:14.067 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:14.061+0000 7f7966d96640 1 -- 172.21.15.78:0/3487479264 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f796014e3f0 msgr2=0x7f796006c5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:01:14.067 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:14.061+0000 7f7966d96640 1 --2- 172.21.15.78:0/3487479264 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f796014e3f0 0x7f796006c5b0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f794c0097c0 tx=0x7f794c01c3f0 comp rx=0 tx=0).stop 2023-11-28T20:01:14.067 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:14.061+0000 7f7966d96640 1 -- 172.21.15.78:0/3487479264 shutdown_connections 2023-11-28T20:01:14.067 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:14.061+0000 7f7966d96640 1 --2- 172.21.15.78:0/3487479264 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f796014e3f0 0x7f796006c5b0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:14.067 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:14.061+0000 7f7966d96640 1 --2- 172.21.15.78:0/3487479264 >> v2:172.21.15.179:3300/0 conn(0x7f796006bef0 0x7f79600bfce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:14.068 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:14.061+0000 7f7966d96640 1 -- 172.21.15.78:0/3487479264 >> 172.21.15.78:0/3487479264 conn(0x7f79600a7810 msgr2=0x7f79600a7c20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:01:14.068 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:14.061+0000 7f7966d96640 1 -- 172.21.15.78:0/3487479264 shutdown_connections 2023-11-28T20:01:14.068 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:14.061+0000 7f7966d96640 1 -- 172.21.15.78:0/3487479264 wait complete. 2023-11-28T20:01:14.068 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:14.065+0000 7f7966d96640 1 Processor -- start 2023-11-28T20:01:14.068 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:14.065+0000 7f7966d96640 1 -- start start 2023-11-28T20:01:14.069 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:14.065+0000 7f7966d96640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f796006bef0 0x7f79601501e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:14.070 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:14.065+0000 7f7966d96640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f796006caf0 0x7f79600bee90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:14.070 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:14.065+0000 7f7966d96640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f796014e3f0 0x7f79601ed620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:14.070 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:14.065+0000 7f7966d96640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79601f18c0 con 0x7f796014e3f0 2023-11-28T20:01:14.070 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:14.065+0000 7f7966d96640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7960150720 con 0x7f796006bef0 2023-11-28T20:01:14.070 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:14.065+0000 7f7966d96640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7960143950 con 0x7f796006caf0 2023-11-28T20:01:14.070 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:14.065+0000 7f7965333640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f796014e3f0 0x7f79601ed620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:14.070 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:14.065+0000 7f7965333640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f796014e3f0 0x7f79601ed620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:55982/0 (socket says 172.21.15.78:55982) 2023-11-28T20:01:14.070 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:14.065+0000 7f795ffff640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f796006caf0 0x7f79600bee90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:14.070 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:14.065+0000 7f7965333640 1 -- 172.21.15.78:0/1838146106 learned_addr learned my addr 172.21.15.78:0/1838146106 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T20:01:14.070 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:14.065+0000 7f7964b32640 1 --2- 172.21.15.78:0/1838146106 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f796006bef0 0x7f79601501e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:14.072 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:14.065+0000 7f7965333640 1 -- 172.21.15.78:0/1838146106 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f796006caf0 msgr2=0x7f79600bee90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:01:14.072 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:14.065+0000 7f7965333640 1 --2- 172.21.15.78:0/1838146106 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f796006caf0 0x7f79600bee90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:14.072 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:14.065+0000 7f7965333640 1 -- 172.21.15.78:0/1838146106 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f796006bef0 msgr2=0x7f79601501e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:01:14.072 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:14.065+0000 7f7965333640 1 --2- 172.21.15.78:0/1838146106 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f796006bef0 0x7f79601501e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:14.072 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:14.065+0000 7f7965333640 1 -- 172.21.15.78:0/1838146106 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79540094d0 con 0x7f796014e3f0 2023-11-28T20:01:14.072 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:14.065+0000 7f7965333640 1 --2- 172.21.15.78:0/1838146106 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f796014e3f0 0x7f79601ed620 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7f795800c6c0 tx=0x7f795800cb80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:01:14.072 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:14.065+0000 7f795d7fa640 1 -- 172.21.15.78:0/1838146106 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7958003b80 con 0x7f796014e3f0 2023-11-28T20:01:14.072 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:14.065+0000 7f795d7fa640 1 -- 172.21.15.78:0/1838146106 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7958003ce0 con 0x7f796014e3f0 2023-11-28T20:01:14.072 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:14.065+0000 7f7966d96640 1 -- 172.21.15.78:0/1838146106 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f794c009420 con 0x7f796014e3f0 2023-11-28T20:01:14.072 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:14.065+0000 7f795d7fa640 1 -- 172.21.15.78:0/1838146106 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79580052f0 con 0x7f796014e3f0 2023-11-28T20:01:14.073 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:14.065+0000 7f7966d96640 1 -- 172.21.15.78:0/1838146106 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f79601f0c40 con 0x7f796014e3f0 2023-11-28T20:01:14.073 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:14.069+0000 7f7966d96640 1 -- 172.21.15.78:0/1838146106 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f79601ed470 con 0x7f796014e3f0 2023-11-28T20:01:14.073 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:14.069+0000 7f795d7fa640 1 -- 172.21.15.78:0/1838146106 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f7958005450 con 0x7f796014e3f0 2023-11-28T20:01:14.073 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:14.069+0000 7f795d7fa640 1 --2- 172.21.15.78:0/1838146106 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f7944066470 0x7f7944068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:14.074 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:14.069+0000 7f795d7fa640 1 -- 172.21.15.78:0/1838146106 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f7958083bb0 con 0x7f796014e3f0 2023-11-28T20:01:14.074 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:14.069+0000 7f7964b32640 1 --2- 172.21.15.78:0/1838146106 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f7944066470 0x7f7944068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:14.074 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:14.069+0000 7f7964b32640 1 --2- 172.21.15.78:0/1838146106 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f7944066470 0x7f7944068930 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f7954006cb0 tx=0x7f7954009240 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:01:14.077 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:14.073+0000 7f795d7fa640 1 -- 172.21.15.78:0/1838146106 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f7958050f90 con 0x7f796014e3f0 2023-11-28T20:01:14.228 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:14.225+0000 7f7966d96640 1 -- 172.21.15.78:0/1838146106 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7960067630 con 0x7f796014e3f0 2023-11-28T20:01:14.229 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:14.225+0000 7f795d7fa640 1 -- 172.21.15.78:0/1838146106 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v61) v1 ==== 74+0+16692 (secure 0 0 0) 0x7f79580545b0 con 0x7f796014e3f0 2023-11-28T20:01:14.229 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-11-28T20:01:14.230 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":61,"fsid":"dd9780e8-3bda-44fa-a9f0-fa07d19d901d","created":"2023-11-28T19:58:40.969556+0000","modified":"2023-11-28T20:01:11.516644+0000","last_up_change":"2023-11-28T19:58:52.596716+0000","last_in_change":"2023-11-28T19:58:43.609275+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":10,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-28T19:58:54.011229+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_metadata","create_time":"2023-11-28T20:01:07.969267+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"60","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_data","create_time":"2023-11-28T20:01:08.865465+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"61","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e84245ac-b5da-429e-af18-39acaa2b33e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6800","nonce":3358701235},{"type":"v1","addr":"172.21.15.78:6801","nonce":3358701235}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6802","nonce":3358701235},{"type":"v1","addr":"172.21.15.78:6803","nonce":3358701235}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6806","nonce":3358701235},{"type":"v1","addr":"172.21.15.78:6807","nonce":3358701235}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6804","nonce":3358701235},{"type":"v1","addr":"172.21.15.78:6805","nonce":3358701235}]},"public_addr":"172.21.15.78:6801/3358701235","cluster_addr":"172.21.15.78:6803/3358701235","heartbeat_back_addr":"172.21.15.78:6807/3358701235","heartbeat_front_addr":"172.21.15.78:6805/3358701235","state":["exists","up"]},{"osd":1,"uuid":"e634831d-c4e2-48d9-870c-9556ae162981","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6808","nonce":3211476654},{"type":"v1","addr":"172.21.15.78:6809","nonce":3211476654}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6810","nonce":3211476654},{"type":"v1","addr":"172.21.15.78:6811","nonce":3211476654}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6814","nonce":3211476654},{"type":"v1","addr":"172.21.15.78:6815","nonce":3211476654}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6812","nonce":3211476654},{"type":"v1","addr":"172.21.15.78:6813","nonce":3211476654}]},"public_addr":"172.21.15.78:6809/3211476654","cluster_addr":"172.21.15.78:6811/3211476654","heartbeat_back_addr":"172.21.15.78:6815/3211476654","heartbeat_front_addr":"172.21.15.78:6813/3211476654","state":["exists","up"]},{"osd":2,"uuid":"274c8395-6534-41f0-b8fb-a00af8985aa8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6816","nonce":2532904479},{"type":"v1","addr":"172.21.15.78:6817","nonce":2532904479}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6818","nonce":2532904479},{"type":"v1","addr":"172.21.15.78:6819","nonce":2532904479}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6822","nonce":2532904479},{"type":"v1","addr":"172.21.15.78:6823","nonce":2532904479}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6820","nonce":2532904479},{"type":"v1","addr":"172.21.15.78:6821","nonce":2532904479}]},"public_addr":"172.21.15.78:6817/2532904479","cluster_addr":"172.21.15.78:6819/2532904479","heartbeat_back_addr":"172.21.15.78:6823/2532904479","heartbeat_front_addr":"172.21.15.78:6821/2532904479","state":["exists","up"]},{"osd":3,"uuid":"77acc9af-7d4d-4b18-8cf5-d62f5971b7c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6824","nonce":3442991267},{"type":"v1","addr":"172.21.15.78:6825","nonce":3442991267}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6826","nonce":3442991267},{"type":"v1","addr":"172.21.15.78:6827","nonce":3442991267}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6830","nonce":3442991267},{"type":"v1","addr":"172.21.15.78:6831","nonce":3442991267}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6828","nonce":3442991267},{"type":"v1","addr":"172.21.15.78:6829","nonce":3442991267}]},"public_addr":"172.21.15.78:6825/3442991267","cluster_addr":"172.21.15.78:6827/3442991267","heartbeat_back_addr":"172.21.15.78:6831/3442991267","heartbeat_front_addr":"172.21.15.78:6829/3442991267","state":["exists","up"]},{"osd":4,"uuid":"5c62bc66-6b34-4b7f-a66b-9a743969138c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":802983577},{"type":"v1","addr":"172.21.15.179:6809","nonce":802983577}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":802983577},{"type":"v1","addr":"172.21.15.179:6811","nonce":802983577}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":802983577},{"type":"v1","addr":"172.21.15.179:6815","nonce":802983577}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":802983577},{"type":"v1","addr":"172.21.15.179:6813","nonce":802983577}]},"public_addr":"172.21.15.179:6809/802983577","cluster_addr":"172.21.15.179:6811/802983577","heartbeat_back_addr":"172.21.15.179:6815/802983577","heartbeat_front_addr":"172.21.15.179:6813/802983577","state":["exists","up"]},{"osd":5,"uuid":"67db6d36-f684-4079-b0cd-82b4dd61461f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":518192887},{"type":"v1","addr":"172.21.15.179:6818","nonce":518192887}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":518192887},{"type":"v1","addr":"172.21.15.179:6822","nonce":518192887}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":518192887},{"type":"v1","addr":"172.21.15.179:6829","nonce":518192887}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6824","nonce":518192887},{"type":"v1","addr":"172.21.15.179:6826","nonce":518192887}]},"public_addr":"172.21.15.179:6818/518192887","cluster_addr":"172.21.15.179:6822/518192887","heartbeat_back_addr":"172.21.15.179:6829/518192887","heartbeat_front_addr":"172.21.15.179:6826/518192887","state":["exists","up"]},{"osd":6,"uuid":"12e670af-5a16-4c81-9f97-defa66cab967","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":815435378},{"type":"v1","addr":"172.21.15.179:6801","nonce":815435378}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":815435378},{"type":"v1","addr":"172.21.15.179:6803","nonce":815435378}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":815435378},{"type":"v1","addr":"172.21.15.179:6807","nonce":815435378}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":815435378},{"type":"v1","addr":"172.21.15.179:6805","nonce":815435378}]},"public_addr":"172.21.15.179:6801/815435378","cluster_addr":"172.21.15.179:6803/815435378","heartbeat_back_addr":"172.21.15.179:6807/815435378","heartbeat_front_addr":"172.21.15.179:6805/815435378","state":["exists","up"]},{"osd":7,"uuid":"fe630650-2eb3-49ad-8676-c341e6332eb1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6817","nonce":2848432339},{"type":"v1","addr":"172.21.15.179:6819","nonce":2848432339}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6821","nonce":2848432339},{"type":"v1","addr":"172.21.15.179:6823","nonce":2848432339}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":2848432339},{"type":"v1","addr":"172.21.15.179:6831","nonce":2848432339}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6825","nonce":2848432339},{"type":"v1","addr":"172.21.15.179:6827","nonce":2848432339}]},"public_addr":"172.21.15.179:6819/2848432339","cluster_addr":"172.21.15.179:6823/2848432339","heartbeat_back_addr":"172.21.15.179:6831/2848432339","heartbeat_front_addr":"172.21.15.179:6827/2848432339","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:58:49.255433+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:58:49.412880+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:58:49.559295+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:58:49.245237+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:58:49.184557+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:58:49.329851+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:58:49.366012+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:58:49.349604+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-28T20:01:14.231 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:14.225+0000 7f7966d96640 1 -- 172.21.15.78:0/1838146106 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f7944066470 msgr2=0x7f7944068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:01:14.231 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:14.225+0000 7f7966d96640 1 --2- 172.21.15.78:0/1838146106 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f7944066470 0x7f7944068930 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f7954006cb0 tx=0x7f7954009240 comp rx=0 tx=0).stop 2023-11-28T20:01:14.232 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:14.225+0000 7f7966d96640 1 -- 172.21.15.78:0/1838146106 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f796014e3f0 msgr2=0x7f79601ed620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:01:14.232 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:14.225+0000 7f7966d96640 1 --2- 172.21.15.78:0/1838146106 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f796014e3f0 0x7f79601ed620 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7f795800c6c0 tx=0x7f795800cb80 comp rx=0 tx=0).stop 2023-11-28T20:01:14.232 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:14.225+0000 7f7966d96640 1 -- 172.21.15.78:0/1838146106 shutdown_connections 2023-11-28T20:01:14.232 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:14.225+0000 7f7966d96640 1 --2- 172.21.15.78:0/1838146106 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f7944066470 0x7f7944068930 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:14.232 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:14.225+0000 7f7966d96640 1 --2- 172.21.15.78:0/1838146106 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f796006caf0 0x7f79600bee90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:14.232 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:14.225+0000 7f7966d96640 1 --2- 172.21.15.78:0/1838146106 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f796014e3f0 0x7f79601ed620 unknown :-1 s=CLOSED pgs=634 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:14.232 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:14.225+0000 7f7966d96640 1 --2- 172.21.15.78:0/1838146106 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f796006bef0 0x7f79601501e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:14.232 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:14.225+0000 7f7966d96640 1 -- 172.21.15.78:0/1838146106 >> 172.21.15.78:0/1838146106 conn(0x7f79600a7810 msgr2=0x7f7960147070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:01:14.232 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:14.229+0000 7f7966d96640 1 -- 172.21.15.78:0/1838146106 shutdown_connections 2023-11-28T20:01:14.232 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:14.229+0000 7f7966d96640 1 -- 172.21.15.78:0/1838146106 wait complete. 2023-11-28T20:01:14.250 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-11-28T20:01:14.251 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-28T20:01:14.388 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:14.381+0000 7f2156eea640 1 Processor -- start 2023-11-28T20:01:14.388 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:14.385+0000 7f2156eea640 1 -- start start 2023-11-28T20:01:14.389 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:14.385+0000 7f2156eea640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f215014fd10 0x7f21500a4dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:14.389 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:14.385+0000 7f2156eea640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f2150156110 0x7f2150156580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:14.389 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:14.385+0000 7f2156eea640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f21500c5710 con 0x7f21500a5300 2023-11-28T20:01:14.389 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:14.385+0000 7f2156eea640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f215006c5e0 con 0x7f215014fd10 2023-11-28T20:01:14.390 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:14.385+0000 7f2156eea640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2150155c80 con 0x7f2150156110 2023-11-28T20:01:14.390 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:14.385+0000 7f2154c86640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f215014fd10 0x7f21500a4dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:14.390 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:14.385+0000 7f2154c86640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f215014fd10 0x7f21500a4dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:55986/0 (socket says 172.21.15.78:55986) 2023-11-28T20:01:14.390 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:14.385+0000 7f2154c86640 1 -- 172.21.15.78:0/3249724260 learned_addr learned my addr 172.21.15.78:0/3249724260 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T20:01:14.390 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:14.385+0000 7f214ffff640 1 --1- 172.21.15.78:0/3249724260 >> v1:172.21.15.78:6789/0 conn(0x7f21500a5300 0x7f2150071e30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:59806/0 (socket says 172.21.15.78:59806) 2023-11-28T20:01:14.390 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:14.385+0000 7f2155487640 1 --2- 172.21.15.78:0/3249724260 >> v2:172.21.15.179:3300/0 conn(0x7f2150156110 0x7f2150156580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:14.390 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:14.385+0000 7f2154c86640 1 -- 172.21.15.78:0/3249724260 >> v2:172.21.15.179:3300/0 conn(0x7f2150156110 msgr2=0x7f2150156580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:01:14.390 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:14.385+0000 7f2154c86640 1 --2- 172.21.15.78:0/3249724260 >> v2:172.21.15.179:3300/0 conn(0x7f2150156110 0x7f2150156580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:14.390 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:14.385+0000 7f2154c86640 1 -- 172.21.15.78:0/3249724260 >> v1:172.21.15.78:6789/0 conn(0x7f21500a5300 legacy=0x7f2150071e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:01:14.390 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:14.385+0000 7f214f7fe640 1 -- 172.21.15.78:0/3249724260 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3444602306 0 0) 0x7f21500c5710 con 0x7f21500a5300 2023-11-28T20:01:14.390 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:14.385+0000 7f2154c86640 1 -- 172.21.15.78:0/3249724260 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21500c4e70 con 0x7f215014fd10 2023-11-28T20:01:14.392 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:14.389+0000 7f2154c86640 1 --2- 172.21.15.78:0/3249724260 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f215014fd10 0x7f21500a4dc0 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7f215006e790 tx=0x7f214401c3e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=99121a7102c5e038 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:01:14.393 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:14.389+0000 7f214f7fe640 1 -- 172.21.15.78:0/3249724260 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21440ac640 con 0x7f215014fd10 2023-11-28T20:01:14.393 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:14.389+0000 7f214f7fe640 1 -- 172.21.15.78:0/3249724260 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f21440ac7a0 con 0x7f215014fd10 2023-11-28T20:01:14.393 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:14.389+0000 7f214f7fe640 1 -- 172.21.15.78:0/3249724260 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21440acb30 con 0x7f215014fd10 2023-11-28T20:01:14.393 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:14.389+0000 7f2156eea640 1 -- 172.21.15.78:0/3249724260 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f215014fd10 msgr2=0x7f21500a4dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:01:14.394 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:14.389+0000 7f2156eea640 1 --2- 172.21.15.78:0/3249724260 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f215014fd10 0x7f21500a4dc0 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7f215006e790 tx=0x7f214401c3e0 comp rx=0 tx=0).stop 2023-11-28T20:01:14.394 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:14.389+0000 7f2156eea640 1 -- 172.21.15.78:0/3249724260 shutdown_connections 2023-11-28T20:01:14.394 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:14.389+0000 7f2156eea640 1 --2- 172.21.15.78:0/3249724260 >> v2:172.21.15.179:3300/0 conn(0x7f2150156110 0x7f2150156580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:14.394 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:14.389+0000 7f2156eea640 1 --2- 172.21.15.78:0/3249724260 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f215014fd10 0x7f21500a4dc0 unknown :-1 s=CLOSED pgs=636 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:14.394 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:14.389+0000 7f2156eea640 1 -- 172.21.15.78:0/3249724260 >> 172.21.15.78:0/3249724260 conn(0x7f21500a7810 msgr2=0x7f21500a7c20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:01:14.394 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:14.389+0000 7f2156eea640 1 -- 172.21.15.78:0/3249724260 shutdown_connections 2023-11-28T20:01:14.394 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:14.389+0000 7f2156eea640 1 -- 172.21.15.78:0/3249724260 wait complete. 2023-11-28T20:01:14.395 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:14.389+0000 7f2156eea640 1 Processor -- start 2023-11-28T20:01:14.395 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:14.389+0000 7f2156eea640 1 -- start start 2023-11-28T20:01:14.397 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:14.393+0000 7f2156eea640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f21500a5300 0x7f215013cae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:14.398 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:14.393+0000 7f2156eea640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f215014fd10 0x7f21501f0a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:14.398 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:14.393+0000 7f2156eea640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2150156110 0x7f21501f0f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:14.398 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:14.393+0000 7f2156eea640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f215013bbb0 con 0x7f2150156110 2023-11-28T20:01:14.398 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:14.393+0000 7f2156eea640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21501f0550 con 0x7f21500a5300 2023-11-28T20:01:14.398 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:14.393+0000 7f2156eea640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f215013a6d0 con 0x7f215014fd10 2023-11-28T20:01:14.398 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:14.393+0000 7f2155487640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2150156110 0x7f21501f0f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:14.398 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:14.393+0000 7f2155487640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2150156110 0x7f21501f0f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:55992/0 (socket says 172.21.15.78:55992) 2023-11-28T20:01:14.398 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:14.393+0000 7f2155487640 1 -- 172.21.15.78:0/2551717598 learned_addr learned my addr 172.21.15.78:0/2551717598 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T20:01:14.398 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:14.393+0000 7f214ffff640 1 --2- 172.21.15.78:0/2551717598 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f215014fd10 0x7f21501f0a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:14.398 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:14.393+0000 7f2154c86640 1 --2- 172.21.15.78:0/2551717598 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f21500a5300 0x7f215013cae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:14.399 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:14.393+0000 7f2155487640 1 -- 172.21.15.78:0/2551717598 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f215014fd10 msgr2=0x7f21501f0a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:01:14.399 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:14.393+0000 7f2155487640 1 --2- 172.21.15.78:0/2551717598 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f215014fd10 0x7f21501f0a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:14.399 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:14.393+0000 7f2155487640 1 -- 172.21.15.78:0/2551717598 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f21500a5300 msgr2=0x7f215013cae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:01:14.399 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:14.393+0000 7f2155487640 1 --2- 172.21.15.78:0/2551717598 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f21500a5300 0x7f215013cae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:14.399 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:14.393+0000 7f2155487640 1 -- 172.21.15.78:0/2551717598 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21440094d0 con 0x7f2150156110 2023-11-28T20:01:14.399 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:14.393+0000 7f2155487640 1 --2- 172.21.15.78:0/2551717598 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2150156110 0x7f21501f0f40 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7f2148007cf0 tx=0x7f214800e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:01:14.399 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:14.393+0000 7f214d7fa640 1 -- 172.21.15.78:0/2551717598 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2148014420 con 0x7f2150156110 2023-11-28T20:01:14.399 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:14.393+0000 7f214d7fa640 1 -- 172.21.15.78:0/2551717598 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f21480145a0 con 0x7f2150156110 2023-11-28T20:01:14.399 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:14.393+0000 7f214d7fa640 1 -- 172.21.15.78:0/2551717598 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2148014950 con 0x7f2150156110 2023-11-28T20:01:14.399 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:14.393+0000 7f2156eea640 1 -- 172.21.15.78:0/2551717598 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f215013a3f0 con 0x7f2150156110 2023-11-28T20:01:14.399 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:14.393+0000 7f2156eea640 1 -- 172.21.15.78:0/2551717598 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f215013d020 con 0x7f2150156110 2023-11-28T20:01:14.400 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:14.393+0000 7f2156eea640 1 -- 172.21.15.78:0/2551717598 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f21501f0720 con 0x7f2150156110 2023-11-28T20:01:14.400 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:14.397+0000 7f214d7fa640 1 -- 172.21.15.78:0/2551717598 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f2148014ab0 con 0x7f2150156110 2023-11-28T20:01:14.400 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:14.397+0000 7f214d7fa640 1 --2- 172.21.15.78:0/2551717598 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f2134066470 0x7f2134068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:14.400 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:14.397+0000 7f214d7fa640 1 -- 172.21.15.78:0/2551717598 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f21480846c0 con 0x7f2150156110 2023-11-28T20:01:14.401 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:14.397+0000 7f2154c86640 1 --2- 172.21.15.78:0/2551717598 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f2134066470 0x7f2134068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:14.401 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:14.397+0000 7f2154c86640 1 --2- 172.21.15.78:0/2551717598 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f2134066470 0x7f2134068930 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f21440ae000 tx=0x7f21440a7000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:01:14.404 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:14.401+0000 7f214d7fa640 1 -- 172.21.15.78:0/2551717598 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f21501f0720 con 0x7f2150156110 2023-11-28T20:01:14.553 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:14.549+0000 7f2156eea640 1 -- 172.21.15.78:0/2551717598 --> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f21500c4170 con 0x7f2134066470 2023-11-28T20:01:14.561 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:14.557+0000 7f214d7fa640 1 -- 172.21.15.78:0/2551717598 <== mgr.4106 v2:172.21.15.78:6832/2935380957 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+289084 (secure 0 0 0) 0x7f21500c4170 con 0x7f2134066470 2023-11-28T20:01:14.564 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-11-28T20:01:14.566 INFO:teuthology.orchestra.run.smithi078.stderr:dumped all 2023-11-28T20:01:14.567 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:14.561+0000 7f2156eea640 1 -- 172.21.15.78:0/2551717598 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f2134066470 msgr2=0x7f2134068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:01:14.567 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:14.561+0000 7f2156eea640 1 --2- 172.21.15.78:0/2551717598 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f2134066470 0x7f2134068930 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f21440ae000 tx=0x7f21440a7000 comp rx=0 tx=0).stop 2023-11-28T20:01:14.567 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:14.561+0000 7f2156eea640 1 -- 172.21.15.78:0/2551717598 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2150156110 msgr2=0x7f21501f0f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:01:14.567 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:14.561+0000 7f2156eea640 1 --2- 172.21.15.78:0/2551717598 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2150156110 0x7f21501f0f40 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7f2148007cf0 tx=0x7f214800e4b0 comp rx=0 tx=0).stop 2023-11-28T20:01:14.568 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:14.561+0000 7f2156eea640 1 -- 172.21.15.78:0/2551717598 shutdown_connections 2023-11-28T20:01:14.568 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:14.561+0000 7f2156eea640 1 --2- 172.21.15.78:0/2551717598 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f2134066470 0x7f2134068930 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:14.568 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:14.561+0000 7f2156eea640 1 --2- 172.21.15.78:0/2551717598 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f215014fd10 0x7f21501f0a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:14.568 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:14.561+0000 7f2156eea640 1 --2- 172.21.15.78:0/2551717598 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2150156110 0x7f21501f0f40 unknown :-1 s=CLOSED pgs=637 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:14.568 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:14.561+0000 7f2156eea640 1 --2- 172.21.15.78:0/2551717598 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f21500a5300 0x7f215013cae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:14.568 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:14.561+0000 7f2156eea640 1 -- 172.21.15.78:0/2551717598 >> 172.21.15.78:0/2551717598 conn(0x7f21500a7810 msgr2=0x7f21500c0360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:01:14.568 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:14.561+0000 7f2156eea640 1 -- 172.21.15.78:0/2551717598 shutdown_connections 2023-11-28T20:01:14.568 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:14.561+0000 7f2156eea640 1 -- 172.21.15.78:0/2551717598 wait complete. 2023-11-28T20:01:14.584 INFO:teuthology.orchestra.run.smithi078.stdout:{"pg_ready":true,"pg_map":{"version":125,"stamp":"2023-11-28T20:01:13.980359+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":135,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":226272,"kb_used_data":5904,"kb_used_omap":12,"kb_used_meta":220211,"kb_avail":754748448,"statfs":{"total":773094113280,"available":772862410752,"internally_reserved":0,"allocated":6045696,"data_stored":3860780,"data_compressed":66748,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":12752,"internal_metadata":225496624},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":41,"apply_latency_ms":41,"commit_latency_ns":41000000,"apply_latency_ns":41000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.498939"},"pg_stats":[{"pgid":"10.3f","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-28T20:01:12.965969+0000","last_change":"2023-11-28T20:01:10.539211+0000","last_active":"2023-11-28T20:01:12.965969+0000","last_peered":"2023-11-28T20:01:12.965969+0000","last_clean":"2023-11-28T20:01:12.965969+0000","last_became_active":"2023-11-28T20:01:10.538932+0000","last_became_peered":"2023-11-28T20:01:10.538932+0000","last_unstale":"2023-11-28T20:01:12.965969+0000","last_undegraded":"2023-11-28T20:01:12.965969+0000","last_fullsized":"2023-11-28T20:01:12.965969+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_clean_scrub_stamp":"2023-11-28T20:01:09.480611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:10:00.034946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.3e","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-28T20:01:12.965824+0000","last_change":"2023-11-28T20:01:10.522069+0000","last_active":"2023-11-28T20:01:12.965824+0000","last_peered":"2023-11-28T20:01:12.965824+0000","last_clean":"2023-11-28T20:01:12.965824+0000","last_became_active":"2023-11-28T20:01:10.521785+0000","last_became_peered":"2023-11-28T20:01:10.521785+0000","last_unstale":"2023-11-28T20:01:12.965824+0000","last_undegraded":"2023-11-28T20:01:12.965824+0000","last_fullsized":"2023-11-28T20:01:12.965824+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_clean_scrub_stamp":"2023-11-28T20:01:09.480611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:00:30.789993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.3d","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-28T20:01:12.967554+0000","last_change":"2023-11-28T20:01:10.538353+0000","last_active":"2023-11-28T20:01:12.967554+0000","last_peered":"2023-11-28T20:01:12.967554+0000","last_clean":"2023-11-28T20:01:12.967554+0000","last_became_active":"2023-11-28T20:01:10.537756+0000","last_became_peered":"2023-11-28T20:01:10.537756+0000","last_unstale":"2023-11-28T20:01:12.967554+0000","last_undegraded":"2023-11-28T20:01:12.967554+0000","last_fullsized":"2023-11-28T20:01:12.967554+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_clean_scrub_stamp":"2023-11-28T20:01:09.480611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T06:29:13.579326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.3c","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-28T20:01:11.523945+0000","last_change":"2023-11-28T20:01:10.523152+0000","last_active":"2023-11-28T20:01:11.523945+0000","last_peered":"2023-11-28T20:01:11.523945+0000","last_clean":"2023-11-28T20:01:11.523945+0000","last_became_active":"2023-11-28T20:01:10.522874+0000","last_became_peered":"2023-11-28T20:01:10.522874+0000","last_unstale":"2023-11-28T20:01:11.523945+0000","last_undegraded":"2023-11-28T20:01:11.523945+0000","last_fullsized":"2023-11-28T20:01:11.523945+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_clean_scrub_stamp":"2023-11-28T20:01:09.480611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:56:55.097917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.3b","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-28T20:01:12.966950+0000","last_change":"2023-11-28T20:01:10.529938+0000","last_active":"2023-11-28T20:01:12.966950+0000","last_peered":"2023-11-28T20:01:12.966950+0000","last_clean":"2023-11-28T20:01:12.966950+0000","last_became_active":"2023-11-28T20:01:10.529188+0000","last_became_peered":"2023-11-28T20:01:10.529188+0000","last_unstale":"2023-11-28T20:01:12.966950+0000","last_undegraded":"2023-11-28T20:01:12.966950+0000","last_fullsized":"2023-11-28T20:01:12.966950+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_clean_scrub_stamp":"2023-11-28T20:01:09.480611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:47:13.274500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.3a","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-28T20:01:12.535549+0000","last_change":"2023-11-28T20:01:10.531000+0000","last_active":"2023-11-28T20:01:12.535549+0000","last_peered":"2023-11-28T20:01:12.535549+0000","last_clean":"2023-11-28T20:01:12.535549+0000","last_became_active":"2023-11-28T20:01:10.530754+0000","last_became_peered":"2023-11-28T20:01:10.530754+0000","last_unstale":"2023-11-28T20:01:12.535549+0000","last_undegraded":"2023-11-28T20:01:12.535549+0000","last_fullsized":"2023-11-28T20:01:12.535549+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_clean_scrub_stamp":"2023-11-28T20:01:09.480611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:44:34.399373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.39","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-28T20:01:11.521505+0000","last_change":"2023-11-28T20:01:10.535113+0000","last_active":"2023-11-28T20:01:11.521505+0000","last_peered":"2023-11-28T20:01:11.521505+0000","last_clean":"2023-11-28T20:01:11.521505+0000","last_became_active":"2023-11-28T20:01:10.534919+0000","last_became_peered":"2023-11-28T20:01:10.534919+0000","last_unstale":"2023-11-28T20:01:11.521505+0000","last_undegraded":"2023-11-28T20:01:11.521505+0000","last_fullsized":"2023-11-28T20:01:11.521505+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_clean_scrub_stamp":"2023-11-28T20:01:09.480611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:00:31.915592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.38","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-28T20:01:11.523432+0000","last_change":"2023-11-28T20:01:10.538054+0000","last_active":"2023-11-28T20:01:11.523432+0000","last_peered":"2023-11-28T20:01:11.523432+0000","last_clean":"2023-11-28T20:01:11.523432+0000","last_became_active":"2023-11-28T20:01:10.535363+0000","last_became_peered":"2023-11-28T20:01:10.535363+0000","last_unstale":"2023-11-28T20:01:11.523432+0000","last_undegraded":"2023-11-28T20:01:11.523432+0000","last_fullsized":"2023-11-28T20:01:11.523432+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_clean_scrub_stamp":"2023-11-28T20:01:09.480611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:06:36.994816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.37","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-28T20:01:12.967542+0000","last_change":"2023-11-28T20:01:10.543027+0000","last_active":"2023-11-28T20:01:12.967542+0000","last_peered":"2023-11-28T20:01:12.967542+0000","last_clean":"2023-11-28T20:01:12.967542+0000","last_became_active":"2023-11-28T20:01:10.541632+0000","last_became_peered":"2023-11-28T20:01:10.541632+0000","last_unstale":"2023-11-28T20:01:12.967542+0000","last_undegraded":"2023-11-28T20:01:12.967542+0000","last_fullsized":"2023-11-28T20:01:12.967542+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_clean_scrub_stamp":"2023-11-28T20:01:09.480611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:46:29.701039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.36","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-28T20:01:12.967814+0000","last_change":"2023-11-28T20:01:10.541712+0000","last_active":"2023-11-28T20:01:12.967814+0000","last_peered":"2023-11-28T20:01:12.967814+0000","last_clean":"2023-11-28T20:01:12.967814+0000","last_became_active":"2023-11-28T20:01:10.541389+0000","last_became_peered":"2023-11-28T20:01:10.541389+0000","last_unstale":"2023-11-28T20:01:12.967814+0000","last_undegraded":"2023-11-28T20:01:12.967814+0000","last_fullsized":"2023-11-28T20:01:12.967814+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_clean_scrub_stamp":"2023-11-28T20:01:09.480611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:54:30.269337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.35","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-28T20:01:11.524022+0000","last_change":"2023-11-28T20:01:10.520251+0000","last_active":"2023-11-28T20:01:11.524022+0000","last_peered":"2023-11-28T20:01:11.524022+0000","last_clean":"2023-11-28T20:01:11.524022+0000","last_became_active":"2023-11-28T20:01:10.519957+0000","last_became_peered":"2023-11-28T20:01:10.519957+0000","last_unstale":"2023-11-28T20:01:11.524022+0000","last_undegraded":"2023-11-28T20:01:11.524022+0000","last_fullsized":"2023-11-28T20:01:11.524022+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_clean_scrub_stamp":"2023-11-28T20:01:09.480611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:33:17.345518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.34","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-28T20:01:11.523926+0000","last_change":"2023-11-28T20:01:10.535199+0000","last_active":"2023-11-28T20:01:11.523926+0000","last_peered":"2023-11-28T20:01:11.523926+0000","last_clean":"2023-11-28T20:01:11.523926+0000","last_became_active":"2023-11-28T20:01:10.534856+0000","last_became_peered":"2023-11-28T20:01:10.534856+0000","last_unstale":"2023-11-28T20:01:11.523926+0000","last_undegraded":"2023-11-28T20:01:11.523926+0000","last_fullsized":"2023-11-28T20:01:11.523926+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_clean_scrub_stamp":"2023-11-28T20:01:09.480611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:07:03.844567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.33","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-28T20:01:11.523885+0000","last_change":"2023-11-28T20:01:10.529868+0000","last_active":"2023-11-28T20:01:11.523885+0000","last_peered":"2023-11-28T20:01:11.523885+0000","last_clean":"2023-11-28T20:01:11.523885+0000","last_became_active":"2023-11-28T20:01:10.529582+0000","last_became_peered":"2023-11-28T20:01:10.529582+0000","last_unstale":"2023-11-28T20:01:11.523885+0000","last_undegraded":"2023-11-28T20:01:11.523885+0000","last_fullsized":"2023-11-28T20:01:11.523885+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_clean_scrub_stamp":"2023-11-28T20:01:09.480611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T07:14:21.836133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.32","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-28T20:01:12.967741+0000","last_change":"2023-11-28T20:01:10.546075+0000","last_active":"2023-11-28T20:01:12.967741+0000","last_peered":"2023-11-28T20:01:12.967741+0000","last_clean":"2023-11-28T20:01:12.967741+0000","last_became_active":"2023-11-28T20:01:10.542038+0000","last_became_peered":"2023-11-28T20:01:10.542038+0000","last_unstale":"2023-11-28T20:01:12.967741+0000","last_undegraded":"2023-11-28T20:01:12.967741+0000","last_fullsized":"2023-11-28T20:01:12.967741+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_clean_scrub_stamp":"2023-11-28T20:01:09.480611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:44:34.399373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.31","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-28T20:01:12.967127+0000","last_change":"2023-11-28T20:01:10.535170+0000","last_active":"2023-11-28T20:01:12.967127+0000","last_peered":"2023-11-28T20:01:12.967127+0000","last_clean":"2023-11-28T20:01:12.967127+0000","last_became_active":"2023-11-28T20:01:10.534881+0000","last_became_peered":"2023-11-28T20:01:10.534881+0000","last_unstale":"2023-11-28T20:01:12.967127+0000","last_undegraded":"2023-11-28T20:01:12.967127+0000","last_fullsized":"2023-11-28T20:01:12.967127+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_clean_scrub_stamp":"2023-11-28T20:01:09.480611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:07:03.844567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.30","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-28T20:01:11.521440+0000","last_change":"2023-11-28T20:01:10.530998+0000","last_active":"2023-11-28T20:01:11.521440+0000","last_peered":"2023-11-28T20:01:11.521440+0000","last_clean":"2023-11-28T20:01:11.521440+0000","last_became_active":"2023-11-28T20:01:10.530709+0000","last_became_peered":"2023-11-28T20:01:10.530709+0000","last_unstale":"2023-11-28T20:01:11.521440+0000","last_undegraded":"2023-11-28T20:01:11.521440+0000","last_fullsized":"2023-11-28T20:01:11.521440+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_clean_scrub_stamp":"2023-11-28T20:01:09.480611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:11:53.891113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.2f","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-28T20:01:12.965984+0000","last_change":"2023-11-28T20:01:10.522350+0000","last_active":"2023-11-28T20:01:12.965984+0000","last_peered":"2023-11-28T20:01:12.965984+0000","last_clean":"2023-11-28T20:01:12.965984+0000","last_became_active":"2023-11-28T20:01:10.522075+0000","last_became_peered":"2023-11-28T20:01:10.522075+0000","last_unstale":"2023-11-28T20:01:12.965984+0000","last_undegraded":"2023-11-28T20:01:12.965984+0000","last_fullsized":"2023-11-28T20:01:12.965984+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_clean_scrub_stamp":"2023-11-28T20:01:09.480611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:18:49.627041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.2e","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-28T20:01:11.523447+0000","last_change":"2023-11-28T20:01:10.521611+0000","last_active":"2023-11-28T20:01:11.523447+0000","last_peered":"2023-11-28T20:01:11.523447+0000","last_clean":"2023-11-28T20:01:11.523447+0000","last_became_active":"2023-11-28T20:01:10.521162+0000","last_became_peered":"2023-11-28T20:01:10.521162+0000","last_unstale":"2023-11-28T20:01:11.523447+0000","last_undegraded":"2023-11-28T20:01:11.523447+0000","last_fullsized":"2023-11-28T20:01:11.523447+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_clean_scrub_stamp":"2023-11-28T20:01:09.480611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:04:56.486213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.2d","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-28T20:01:12.967004+0000","last_change":"2023-11-28T20:01:10.526160+0000","last_active":"2023-11-28T20:01:12.967004+0000","last_peered":"2023-11-28T20:01:12.967004+0000","last_clean":"2023-11-28T20:01:12.967004+0000","last_became_active":"2023-11-28T20:01:10.525887+0000","last_became_peered":"2023-11-28T20:01:10.525887+0000","last_unstale":"2023-11-28T20:01:12.967004+0000","last_undegraded":"2023-11-28T20:01:12.967004+0000","last_fullsized":"2023-11-28T20:01:12.967004+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_clean_scrub_stamp":"2023-11-28T20:01:09.480611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:49:02.557281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.2c","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-28T20:01:12.966157+0000","last_change":"2023-11-28T20:01:10.534338+0000","last_active":"2023-11-28T20:01:12.966157+0000","last_peered":"2023-11-28T20:01:12.966157+0000","last_clean":"2023-11-28T20:01:12.966157+0000","last_became_active":"2023-11-28T20:01:10.532397+0000","last_became_peered":"2023-11-28T20:01:10.532397+0000","last_unstale":"2023-11-28T20:01:12.966157+0000","last_undegraded":"2023-11-28T20:01:12.966157+0000","last_fullsized":"2023-11-28T20:01:12.966157+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_clean_scrub_stamp":"2023-11-28T20:01:09.480611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:51:36.724540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.2b","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-28T20:01:11.523960+0000","last_change":"2023-11-28T20:01:10.528780+0000","last_active":"2023-11-28T20:01:11.523960+0000","last_peered":"2023-11-28T20:01:11.523960+0000","last_clean":"2023-11-28T20:01:11.523960+0000","last_became_active":"2023-11-28T20:01:10.524555+0000","last_became_peered":"2023-11-28T20:01:10.524555+0000","last_unstale":"2023-11-28T20:01:11.523960+0000","last_undegraded":"2023-11-28T20:01:11.523960+0000","last_fullsized":"2023-11-28T20:01:11.523960+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_clean_scrub_stamp":"2023-11-28T20:01:09.480611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:30:22.791908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.2a","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-28T20:01:12.965449+0000","last_change":"2023-11-28T20:01:10.531958+0000","last_active":"2023-11-28T20:01:12.965449+0000","last_peered":"2023-11-28T20:01:12.965449+0000","last_clean":"2023-11-28T20:01:12.965449+0000","last_became_active":"2023-11-28T20:01:10.531111+0000","last_became_peered":"2023-11-28T20:01:10.531111+0000","last_unstale":"2023-11-28T20:01:12.965449+0000","last_undegraded":"2023-11-28T20:01:12.965449+0000","last_fullsized":"2023-11-28T20:01:12.965449+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_clean_scrub_stamp":"2023-11-28T20:01:09.480611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:52:31.642868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.29","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-28T20:01:12.965285+0000","last_change":"2023-11-28T20:01:10.533367+0000","last_active":"2023-11-28T20:01:12.965285+0000","last_peered":"2023-11-28T20:01:12.965285+0000","last_clean":"2023-11-28T20:01:12.965285+0000","last_became_active":"2023-11-28T20:01:10.532975+0000","last_became_peered":"2023-11-28T20:01:10.532975+0000","last_unstale":"2023-11-28T20:01:12.965285+0000","last_undegraded":"2023-11-28T20:01:12.965285+0000","last_fullsized":"2023-11-28T20:01:12.965285+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_clean_scrub_stamp":"2023-11-28T20:01:09.480611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:10:30.393696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.28","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-28T20:01:12.966588+0000","last_change":"2023-11-28T20:01:10.541445+0000","last_active":"2023-11-28T20:01:12.966588+0000","last_peered":"2023-11-28T20:01:12.966588+0000","last_clean":"2023-11-28T20:01:12.966588+0000","last_became_active":"2023-11-28T20:01:10.539375+0000","last_became_peered":"2023-11-28T20:01:10.539375+0000","last_unstale":"2023-11-28T20:01:12.966588+0000","last_undegraded":"2023-11-28T20:01:12.966588+0000","last_fullsized":"2023-11-28T20:01:12.966588+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_clean_scrub_stamp":"2023-11-28T20:01:09.480611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T07:14:21.836133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.27","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-28T20:01:11.524805+0000","last_change":"2023-11-28T20:01:10.531718+0000","last_active":"2023-11-28T20:01:11.524805+0000","last_peered":"2023-11-28T20:01:11.524805+0000","last_clean":"2023-11-28T20:01:11.524805+0000","last_became_active":"2023-11-28T20:01:10.529424+0000","last_became_peered":"2023-11-28T20:01:10.529424+0000","last_unstale":"2023-11-28T20:01:11.524805+0000","last_undegraded":"2023-11-28T20:01:11.524805+0000","last_fullsized":"2023-11-28T20:01:11.524805+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_clean_scrub_stamp":"2023-11-28T20:01:09.480611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:17:27.097887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.26","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-28T20:01:11.524184+0000","last_change":"2023-11-28T20:01:10.530284+0000","last_active":"2023-11-28T20:01:11.524184+0000","last_peered":"2023-11-28T20:01:11.524184+0000","last_clean":"2023-11-28T20:01:11.524184+0000","last_became_active":"2023-11-28T20:01:10.529805+0000","last_became_peered":"2023-11-28T20:01:10.529805+0000","last_unstale":"2023-11-28T20:01:11.524184+0000","last_undegraded":"2023-11-28T20:01:11.524184+0000","last_fullsized":"2023-11-28T20:01:11.524184+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_clean_scrub_stamp":"2023-11-28T20:01:09.480611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:46:29.701039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.25","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-28T20:01:11.524110+0000","last_change":"2023-11-28T20:01:10.519186+0000","last_active":"2023-11-28T20:01:11.524110+0000","last_peered":"2023-11-28T20:01:11.524110+0000","last_clean":"2023-11-28T20:01:11.524110+0000","last_became_active":"2023-11-28T20:01:10.518855+0000","last_became_peered":"2023-11-28T20:01:10.518855+0000","last_unstale":"2023-11-28T20:01:11.524110+0000","last_undegraded":"2023-11-28T20:01:11.524110+0000","last_fullsized":"2023-11-28T20:01:11.524110+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_clean_scrub_stamp":"2023-11-28T20:01:09.480611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:23:19.215371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.24","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-28T20:01:12.965681+0000","last_change":"2023-11-28T20:01:10.537687+0000","last_active":"2023-11-28T20:01:12.965681+0000","last_peered":"2023-11-28T20:01:12.965681+0000","last_clean":"2023-11-28T20:01:12.965681+0000","last_became_active":"2023-11-28T20:01:10.536233+0000","last_became_peered":"2023-11-28T20:01:10.536233+0000","last_unstale":"2023-11-28T20:01:12.965681+0000","last_undegraded":"2023-11-28T20:01:12.965681+0000","last_fullsized":"2023-11-28T20:01:12.965681+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_clean_scrub_stamp":"2023-11-28T20:01:09.480611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:18:17.108795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.23","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-28T20:01:12.967371+0000","last_change":"2023-11-28T20:01:10.534726+0000","last_active":"2023-11-28T20:01:12.967371+0000","last_peered":"2023-11-28T20:01:12.967371+0000","last_clean":"2023-11-28T20:01:12.967371+0000","last_became_active":"2023-11-28T20:01:10.534413+0000","last_became_peered":"2023-11-28T20:01:10.534413+0000","last_unstale":"2023-11-28T20:01:12.967371+0000","last_undegraded":"2023-11-28T20:01:12.967371+0000","last_fullsized":"2023-11-28T20:01:12.967371+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_clean_scrub_stamp":"2023-11-28T20:01:09.480611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:30:22.791908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.22","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-28T20:01:11.524788+0000","last_change":"2023-11-28T20:01:10.534050+0000","last_active":"2023-11-28T20:01:11.524788+0000","last_peered":"2023-11-28T20:01:11.524788+0000","last_clean":"2023-11-28T20:01:11.524788+0000","last_became_active":"2023-11-28T20:01:10.533704+0000","last_became_peered":"2023-11-28T20:01:10.533704+0000","last_unstale":"2023-11-28T20:01:11.524788+0000","last_undegraded":"2023-11-28T20:01:11.524788+0000","last_fullsized":"2023-11-28T20:01:11.524788+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_clean_scrub_stamp":"2023-11-28T20:01:09.480611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:50:58.589965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.21","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-28T20:01:11.523255+0000","last_change":"2023-11-28T20:01:10.520311+0000","last_active":"2023-11-28T20:01:11.523255+0000","last_peered":"2023-11-28T20:01:11.523255+0000","last_clean":"2023-11-28T20:01:11.523255+0000","last_became_active":"2023-11-28T20:01:10.519974+0000","last_became_peered":"2023-11-28T20:01:10.519974+0000","last_unstale":"2023-11-28T20:01:11.523255+0000","last_undegraded":"2023-11-28T20:01:11.523255+0000","last_fullsized":"2023-11-28T20:01:11.523255+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_clean_scrub_stamp":"2023-11-28T20:01:09.480611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T07:02:13.895402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.20","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-28T20:01:12.535244+0000","last_change":"2023-11-28T20:01:10.525223+0000","last_active":"2023-11-28T20:01:12.535244+0000","last_peered":"2023-11-28T20:01:12.535244+0000","last_clean":"2023-11-28T20:01:12.535244+0000","last_became_active":"2023-11-28T20:01:10.524750+0000","last_became_peered":"2023-11-28T20:01:10.524750+0000","last_unstale":"2023-11-28T20:01:12.535244+0000","last_undegraded":"2023-11-28T20:01:12.535244+0000","last_fullsized":"2023-11-28T20:01:12.535244+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_clean_scrub_stamp":"2023-11-28T20:01:09.480611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:50:58.589965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1c","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-28T20:01:12.966825+0000","last_change":"2023-11-28T20:01:10.528869+0000","last_active":"2023-11-28T20:01:12.966825+0000","last_peered":"2023-11-28T20:01:12.966825+0000","last_clean":"2023-11-28T20:01:12.966825+0000","last_became_active":"2023-11-28T20:01:10.528572+0000","last_became_peered":"2023-11-28T20:01:10.528572+0000","last_unstale":"2023-11-28T20:01:12.966825+0000","last_undegraded":"2023-11-28T20:01:12.966825+0000","last_fullsized":"2023-11-28T20:01:12.966825+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_clean_scrub_stamp":"2023-11-28T20:01:09.480611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:37:17.516298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.1f","version":"60'4","reported_seq":16,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-28T20:01:12.966133+0000","last_change":"2023-11-28T20:01:09.512544+0000","last_active":"2023-11-28T20:01:12.966133+0000","last_peered":"2023-11-28T20:01:12.966133+0000","last_clean":"2023-11-28T20:01:12.966133+0000","last_became_active":"2023-11-28T20:01:09.512197+0000","last_became_peered":"2023-11-28T20:01:09.512197+0000","last_unstale":"2023-11-28T20:01:12.966133+0000","last_undegraded":"2023-11-28T20:01:12.966133+0000","last_fullsized":"2023-11-28T20:01:12.966133+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:08.474257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:08.474257+0000","last_clean_scrub_stamp":"2023-11-28T20:01:08.474257+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:49:01.550926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.1d","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-28T20:01:11.524170+0000","last_change":"2023-11-28T20:01:10.528270+0000","last_active":"2023-11-28T20:01:11.524170+0000","last_peered":"2023-11-28T20:01:11.524170+0000","last_clean":"2023-11-28T20:01:11.524170+0000","last_became_active":"2023-11-28T20:01:10.527932+0000","last_became_peered":"2023-11-28T20:01:10.527932+0000","last_unstale":"2023-11-28T20:01:11.524170+0000","last_undegraded":"2023-11-28T20:01:11.524170+0000","last_fullsized":"2023-11-28T20:01:11.524170+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_clean_scrub_stamp":"2023-11-28T20:01:09.480611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T07:21:45.278688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1e","version":"60'1","reported_seq":13,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-28T20:01:12.536090+0000","last_change":"2023-11-28T20:01:09.516140+0000","last_active":"2023-11-28T20:01:12.536090+0000","last_peered":"2023-11-28T20:01:12.536090+0000","last_clean":"2023-11-28T20:01:12.536090+0000","last_became_active":"2023-11-28T20:01:09.514007+0000","last_became_peered":"2023-11-28T20:01:09.514007+0000","last_unstale":"2023-11-28T20:01:12.536090+0000","last_undegraded":"2023-11-28T20:01:12.536090+0000","last_fullsized":"2023-11-28T20:01:12.536090+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:08.474257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:08.474257+0000","last_clean_scrub_stamp":"2023-11-28T20:01:08.474257+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:30:21.785554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1e","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-28T20:01:12.536078+0000","last_change":"2023-11-28T20:01:10.526680+0000","last_active":"2023-11-28T20:01:12.536078+0000","last_peered":"2023-11-28T20:01:12.536078+0000","last_clean":"2023-11-28T20:01:12.536078+0000","last_became_active":"2023-11-28T20:01:10.526366+0000","last_became_peered":"2023-11-28T20:01:10.526366+0000","last_unstale":"2023-11-28T20:01:12.536078+0000","last_undegraded":"2023-11-28T20:01:12.536078+0000","last_fullsized":"2023-11-28T20:01:12.536078+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_clean_scrub_stamp":"2023-11-28T20:01:09.480611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:05:54.478424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1d","version":"60'2","reported_seq":14,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-28T20:01:12.535892+0000","last_change":"2023-11-28T20:01:09.510600+0000","last_active":"2023-11-28T20:01:12.535892+0000","last_peered":"2023-11-28T20:01:12.535892+0000","last_clean":"2023-11-28T20:01:12.535892+0000","last_became_active":"2023-11-28T20:01:09.510336+0000","last_became_peered":"2023-11-28T20:01:09.510336+0000","last_unstale":"2023-11-28T20:01:12.535892+0000","last_undegraded":"2023-11-28T20:01:12.535892+0000","last_fullsized":"2023-11-28T20:01:12.535892+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:08.474257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:08.474257+0000","last_clean_scrub_stamp":"2023-11-28T20:01:08.474257+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:56:14.988591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1f","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-28T20:01:12.967655+0000","last_change":"2023-11-28T20:01:10.541960+0000","last_active":"2023-11-28T20:01:12.967655+0000","last_peered":"2023-11-28T20:01:12.967655+0000","last_clean":"2023-11-28T20:01:12.967655+0000","last_became_active":"2023-11-28T20:01:10.541305+0000","last_became_peered":"2023-11-28T20:01:10.541305+0000","last_unstale":"2023-11-28T20:01:12.967655+0000","last_undegraded":"2023-11-28T20:01:12.967655+0000","last_fullsized":"2023-11-28T20:01:12.967655+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_clean_scrub_stamp":"2023-11-28T20:01:09.480611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:17:27.097887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.1c","version":"60'2","reported_seq":14,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-28T20:01:12.535798+0000","last_change":"2023-11-28T20:01:09.507988+0000","last_active":"2023-11-28T20:01:12.535798+0000","last_peered":"2023-11-28T20:01:12.535798+0000","last_clean":"2023-11-28T20:01:12.535798+0000","last_became_active":"2023-11-28T20:01:09.507762+0000","last_became_peered":"2023-11-28T20:01:09.507762+0000","last_unstale":"2023-11-28T20:01:12.535798+0000","last_undegraded":"2023-11-28T20:01:12.535798+0000","last_fullsized":"2023-11-28T20:01:12.535798+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:08.474257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:08.474257+0000","last_clean_scrub_stamp":"2023-11-28T20:01:08.474257+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T07:14:20.829778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-28T20:01:11.521536+0000","last_change":"2023-11-28T20:01:10.518032+0000","last_active":"2023-11-28T20:01:11.521536+0000","last_peered":"2023-11-28T20:01:11.521536+0000","last_clean":"2023-11-28T20:01:11.521536+0000","last_became_active":"2023-11-28T20:01:10.517780+0000","last_became_peered":"2023-11-28T20:01:10.517780+0000","last_unstale":"2023-11-28T20:01:11.521536+0000","last_undegraded":"2023-11-28T20:01:11.521536+0000","last_fullsized":"2023-11-28T20:01:11.521536+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_clean_scrub_stamp":"2023-11-28T20:01:09.480611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:43:39.118896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.1b","version":"60'1","reported_seq":13,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-28T20:01:12.965924+0000","last_change":"2023-11-28T20:01:09.514901+0000","last_active":"2023-11-28T20:01:12.965924+0000","last_peered":"2023-11-28T20:01:12.965924+0000","last_clean":"2023-11-28T20:01:12.965924+0000","last_became_active":"2023-11-28T20:01:09.514568+0000","last_became_peered":"2023-11-28T20:01:09.514568+0000","last_unstale":"2023-11-28T20:01:12.965924+0000","last_undegraded":"2023-11-28T20:01:12.965924+0000","last_fullsized":"2023-11-28T20:01:12.965924+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:08.474257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:08.474257+0000","last_clean_scrub_stamp":"2023-11-28T20:01:08.474257+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:44:33.393018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-28T20:01:12.965512+0000","last_change":"2023-11-28T20:01:10.522005+0000","last_active":"2023-11-28T20:01:12.965512+0000","last_peered":"2023-11-28T20:01:12.965512+0000","last_clean":"2023-11-28T20:01:12.965512+0000","last_became_active":"2023-11-28T20:01:10.521691+0000","last_became_peered":"2023-11-28T20:01:10.521691+0000","last_unstale":"2023-11-28T20:01:12.965512+0000","last_undegraded":"2023-11-28T20:01:12.965512+0000","last_fullsized":"2023-11-28T20:01:12.965512+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_clean_scrub_stamp":"2023-11-28T20:01:09.480611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:11:08.794514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1a","version":"60'1","reported_seq":13,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-28T20:01:12.965351+0000","last_change":"2023-11-28T20:01:09.510388+0000","last_active":"2023-11-28T20:01:12.965351+0000","last_peered":"2023-11-28T20:01:12.965351+0000","last_clean":"2023-11-28T20:01:12.965351+0000","last_became_active":"2023-11-28T20:01:09.510114+0000","last_became_peered":"2023-11-28T20:01:09.510114+0000","last_unstale":"2023-11-28T20:01:12.965351+0000","last_undegraded":"2023-11-28T20:01:12.965351+0000","last_fullsized":"2023-11-28T20:01:12.965351+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:08.474257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:08.474257+0000","last_clean_scrub_stamp":"2023-11-28T20:01:08.474257+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T06:29:12.572972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.1a","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-28T20:01:12.966791+0000","last_change":"2023-11-28T20:01:10.536831+0000","last_active":"2023-11-28T20:01:12.966791+0000","last_peered":"2023-11-28T20:01:12.966791+0000","last_clean":"2023-11-28T20:01:12.966791+0000","last_became_active":"2023-11-28T20:01:10.536506+0000","last_became_peered":"2023-11-28T20:01:10.536506+0000","last_unstale":"2023-11-28T20:01:12.966791+0000","last_undegraded":"2023-11-28T20:01:12.966791+0000","last_fullsized":"2023-11-28T20:01:12.966791+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_clean_scrub_stamp":"2023-11-28T20:01:09.480611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:29:39.856095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-28T20:01:12.965250+0000","last_change":"2023-11-28T20:01:09.514530+0000","last_active":"2023-11-28T20:01:12.965250+0000","last_peered":"2023-11-28T20:01:12.965250+0000","last_clean":"2023-11-28T20:01:12.965250+0000","last_became_active":"2023-11-28T20:01:09.514112+0000","last_became_peered":"2023-11-28T20:01:09.514112+0000","last_unstale":"2023-11-28T20:01:12.965250+0000","last_undegraded":"2023-11-28T20:01:12.965250+0000","last_fullsized":"2023-11-28T20:01:12.965250+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:08.474257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:08.474257+0000","last_clean_scrub_stamp":"2023-11-28T20:01:08.474257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:07:02.838212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.1b","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-28T20:01:12.965435+0000","last_change":"2023-11-28T20:01:10.522250+0000","last_active":"2023-11-28T20:01:12.965435+0000","last_peered":"2023-11-28T20:01:12.965435+0000","last_clean":"2023-11-28T20:01:12.965435+0000","last_became_active":"2023-11-28T20:01:10.521958+0000","last_became_peered":"2023-11-28T20:01:10.521958+0000","last_unstale":"2023-11-28T20:01:12.965435+0000","last_undegraded":"2023-11-28T20:01:12.965435+0000","last_fullsized":"2023-11-28T20:01:12.965435+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_clean_scrub_stamp":"2023-11-28T20:01:09.480611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:59:08.568724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-28T20:01:12.966531+0000","last_change":"2023-11-28T20:01:09.512078+0000","last_active":"2023-11-28T20:01:12.966531+0000","last_peered":"2023-11-28T20:01:12.966531+0000","last_clean":"2023-11-28T20:01:12.966531+0000","last_became_active":"2023-11-28T20:01:09.511733+0000","last_became_peered":"2023-11-28T20:01:09.511733+0000","last_unstale":"2023-11-28T20:01:12.966531+0000","last_undegraded":"2023-11-28T20:01:12.966531+0000","last_fullsized":"2023-11-28T20:01:12.966531+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:08.474257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:08.474257+0000","last_clean_scrub_stamp":"2023-11-28T20:01:08.474257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:16:29.294303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.14","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-28T20:01:12.965778+0000","last_change":"2023-11-28T20:01:10.517714+0000","last_active":"2023-11-28T20:01:12.965778+0000","last_peered":"2023-11-28T20:01:12.965778+0000","last_clean":"2023-11-28T20:01:12.965778+0000","last_became_active":"2023-11-28T20:01:10.517414+0000","last_became_peered":"2023-11-28T20:01:10.517414+0000","last_unstale":"2023-11-28T20:01:12.965778+0000","last_undegraded":"2023-11-28T20:01:12.965778+0000","last_fullsized":"2023-11-28T20:01:12.965778+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_clean_scrub_stamp":"2023-11-28T20:01:09.480611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T06:10:19.765319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-28T20:01:12.967778+0000","last_change":"2023-11-28T20:01:09.519465+0000","last_active":"2023-11-28T20:01:12.967778+0000","last_peered":"2023-11-28T20:01:12.967778+0000","last_clean":"2023-11-28T20:01:12.967778+0000","last_became_active":"2023-11-28T20:01:09.519233+0000","last_became_peered":"2023-11-28T20:01:09.519233+0000","last_unstale":"2023-11-28T20:01:12.967778+0000","last_undegraded":"2023-11-28T20:01:12.967778+0000","last_fullsized":"2023-11-28T20:01:12.967778+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:08.474257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:08.474257+0000","last_clean_scrub_stamp":"2023-11-28T20:01:08.474257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T07:34:36.168268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.15","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-28T20:01:12.966089+0000","last_change":"2023-11-28T20:01:10.533748+0000","last_active":"2023-11-28T20:01:12.966089+0000","last_peered":"2023-11-28T20:01:12.966089+0000","last_clean":"2023-11-28T20:01:12.966089+0000","last_became_active":"2023-11-28T20:01:10.533411+0000","last_became_peered":"2023-11-28T20:01:10.533411+0000","last_unstale":"2023-11-28T20:01:12.966089+0000","last_undegraded":"2023-11-28T20:01:12.966089+0000","last_fullsized":"2023-11-28T20:01:12.966089+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_clean_scrub_stamp":"2023-11-28T20:01:09.480611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:58:23.470366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-28T20:01:11.523750+0000","last_change":"2023-11-28T20:01:09.507203+0000","last_active":"2023-11-28T20:01:11.523750+0000","last_peered":"2023-11-28T20:01:11.523750+0000","last_clean":"2023-11-28T20:01:11.523750+0000","last_became_active":"2023-11-28T20:01:09.506901+0000","last_became_peered":"2023-11-28T20:01:09.506901+0000","last_unstale":"2023-11-28T20:01:11.523750+0000","last_undegraded":"2023-11-28T20:01:11.523750+0000","last_fullsized":"2023-11-28T20:01:11.523750+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:08.474257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:08.474257+0000","last_clean_scrub_stamp":"2023-11-28T20:01:08.474257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:15:27.309843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-28T20:01:12.966937+0000","last_change":"2023-11-28T20:01:10.537355+0000","last_active":"2023-11-28T20:01:12.966937+0000","last_peered":"2023-11-28T20:01:12.966937+0000","last_clean":"2023-11-28T20:01:12.966937+0000","last_became_active":"2023-11-28T20:01:10.536210+0000","last_became_peered":"2023-11-28T20:01:10.536210+0000","last_unstale":"2023-11-28T20:01:12.966937+0000","last_undegraded":"2023-11-28T20:01:12.966937+0000","last_fullsized":"2023-11-28T20:01:12.966937+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_clean_scrub_stamp":"2023-11-28T20:01:09.480611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T07:05:45.395904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.15","version":"60'3","reported_seq":15,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-28T20:01:12.967683+0000","last_change":"2023-11-28T20:01:09.519066+0000","last_active":"2023-11-28T20:01:12.967683+0000","last_peered":"2023-11-28T20:01:12.967683+0000","last_clean":"2023-11-28T20:01:12.967683+0000","last_became_active":"2023-11-28T20:01:09.518151+0000","last_became_peered":"2023-11-28T20:01:09.518151+0000","last_unstale":"2023-11-28T20:01:12.967683+0000","last_undegraded":"2023-11-28T20:01:12.967683+0000","last_fullsized":"2023-11-28T20:01:12.967683+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:08.474257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:08.474257+0000","last_clean_scrub_stamp":"2023-11-28T20:01:08.474257+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:00:29.783639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.17","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-28T20:01:11.524609+0000","last_change":"2023-11-28T20:01:10.521819+0000","last_active":"2023-11-28T20:01:11.524609+0000","last_peered":"2023-11-28T20:01:11.524609+0000","last_clean":"2023-11-28T20:01:11.524609+0000","last_became_active":"2023-11-28T20:01:10.521475+0000","last_became_peered":"2023-11-28T20:01:10.521475+0000","last_unstale":"2023-11-28T20:01:11.524609+0000","last_undegraded":"2023-11-28T20:01:11.524609+0000","last_fullsized":"2023-11-28T20:01:11.524609+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_clean_scrub_stamp":"2023-11-28T20:01:09.480611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:16:30.300658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.14","version":"60'6","reported_seq":18,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-28T20:01:12.965851+0000","last_change":"2023-11-28T20:01:09.511176+0000","last_active":"2023-11-28T20:01:12.965851+0000","last_peered":"2023-11-28T20:01:12.965851+0000","last_clean":"2023-11-28T20:01:12.965851+0000","last_became_active":"2023-11-28T20:01:09.510427+0000","last_became_peered":"2023-11-28T20:01:09.510427+0000","last_unstale":"2023-11-28T20:01:12.965851+0000","last_undegraded":"2023-11-28T20:01:12.965851+0000","last_fullsized":"2023-11-28T20:01:12.965851+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:08.474257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:08.474257+0000","last_clean_scrub_stamp":"2023-11-28T20:01:08.474257+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:47:12.268146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.10","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-28T20:01:11.524257+0000","last_change":"2023-11-28T20:01:10.533224+0000","last_active":"2023-11-28T20:01:11.524257+0000","last_peered":"2023-11-28T20:01:11.524257+0000","last_clean":"2023-11-28T20:01:11.524257+0000","last_became_active":"2023-11-28T20:01:10.532909+0000","last_became_peered":"2023-11-28T20:01:10.532909+0000","last_unstale":"2023-11-28T20:01:11.524257+0000","last_undegraded":"2023-11-28T20:01:11.524257+0000","last_fullsized":"2023-11-28T20:01:11.524257+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_clean_scrub_stamp":"2023-11-28T20:01:09.480611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:32:06.877460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.13","version":"60'2","reported_seq":14,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-28T20:01:12.967436+0000","last_change":"2023-11-28T20:01:09.518379+0000","last_active":"2023-11-28T20:01:12.967436+0000","last_peered":"2023-11-28T20:01:12.967436+0000","last_clean":"2023-11-28T20:01:12.967436+0000","last_became_active":"2023-11-28T20:01:09.518073+0000","last_became_peered":"2023-11-28T20:01:09.518073+0000","last_unstale":"2023-11-28T20:01:12.967436+0000","last_undegraded":"2023-11-28T20:01:12.967436+0000","last_fullsized":"2023-11-28T20:01:12.967436+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:08.474257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:08.474257+0000","last_clean_scrub_stamp":"2023-11-28T20:01:08.474257+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:11:07.788160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-28T20:01:11.523324+0000","last_change":"2023-11-28T20:01:10.520948+0000","last_active":"2023-11-28T20:01:11.523324+0000","last_peered":"2023-11-28T20:01:11.523324+0000","last_clean":"2023-11-28T20:01:11.523324+0000","last_became_active":"2023-11-28T20:01:10.520649+0000","last_became_peered":"2023-11-28T20:01:10.520649+0000","last_unstale":"2023-11-28T20:01:11.523324+0000","last_undegraded":"2023-11-28T20:01:11.523324+0000","last_fullsized":"2023-11-28T20:01:11.523324+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_clean_scrub_stamp":"2023-11-28T20:01:09.480611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:10:34.830531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-28T20:01:11.523539+0000","last_change":"2023-11-28T20:01:09.510604+0000","last_active":"2023-11-28T20:01:11.523539+0000","last_peered":"2023-11-28T20:01:11.523539+0000","last_clean":"2023-11-28T20:01:11.523539+0000","last_became_active":"2023-11-28T20:01:09.510326+0000","last_became_peered":"2023-11-28T20:01:09.510326+0000","last_unstale":"2023-11-28T20:01:11.523539+0000","last_undegraded":"2023-11-28T20:01:11.523539+0000","last_fullsized":"2023-11-28T20:01:11.523539+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:08.474257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:08.474257+0000","last_clean_scrub_stamp":"2023-11-28T20:01:08.474257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:56:14.988591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-28T20:01:12.966969+0000","last_change":"2023-11-28T20:01:10.527110+0000","last_active":"2023-11-28T20:01:12.966969+0000","last_peered":"2023-11-28T20:01:12.966969+0000","last_clean":"2023-11-28T20:01:12.966969+0000","last_became_active":"2023-11-28T20:01:10.525827+0000","last_became_peered":"2023-11-28T20:01:10.525827+0000","last_unstale":"2023-11-28T20:01:12.966969+0000","last_undegraded":"2023-11-28T20:01:12.966969+0000","last_fullsized":"2023-11-28T20:01:12.966969+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_clean_scrub_stamp":"2023-11-28T20:01:09.480611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:23:02.818476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-28T20:01:12.967514+0000","last_change":"2023-11-28T20:01:09.519626+0000","last_active":"2023-11-28T20:01:12.967514+0000","last_peered":"2023-11-28T20:01:12.967514+0000","last_clean":"2023-11-28T20:01:12.967514+0000","last_became_active":"2023-11-28T20:01:09.519349+0000","last_became_peered":"2023-11-28T20:01:09.519349+0000","last_unstale":"2023-11-28T20:01:12.967514+0000","last_undegraded":"2023-11-28T20:01:12.967514+0000","last_fullsized":"2023-11-28T20:01:12.967514+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:08.474257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:08.474257+0000","last_clean_scrub_stamp":"2023-11-28T20:01:08.474257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:04:51.492194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.13","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-28T20:01:12.965848+0000","last_change":"2023-11-28T20:01:10.535178+0000","last_active":"2023-11-28T20:01:12.965848+0000","last_peered":"2023-11-28T20:01:12.965848+0000","last_clean":"2023-11-28T20:01:12.965848+0000","last_became_active":"2023-11-28T20:01:10.534880+0000","last_became_peered":"2023-11-28T20:01:10.534880+0000","last_unstale":"2023-11-28T20:01:12.965848+0000","last_undegraded":"2023-11-28T20:01:12.965848+0000","last_fullsized":"2023-11-28T20:01:12.965848+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_clean_scrub_stamp":"2023-11-28T20:01:09.480611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:52:42.741966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.10","version":"60'8","reported_seq":20,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-28T20:01:11.524348+0000","last_change":"2023-11-28T20:01:09.511628+0000","last_active":"2023-11-28T20:01:11.524348+0000","last_peered":"2023-11-28T20:01:11.524348+0000","last_clean":"2023-11-28T20:01:11.524348+0000","last_became_active":"2023-11-28T20:01:09.511250+0000","last_became_peered":"2023-11-28T20:01:09.511250+0000","last_unstale":"2023-11-28T20:01:11.524348+0000","last_undegraded":"2023-11-28T20:01:11.524348+0000","last_fullsized":"2023-11-28T20:01:11.524348+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:08.474257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:08.474257+0000","last_clean_scrub_stamp":"2023-11-28T20:01:08.474257+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:35:34.107408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-28T20:01:12.967632+0000","last_change":"2023-11-28T20:01:10.537164+0000","last_active":"2023-11-28T20:01:12.967632+0000","last_peered":"2023-11-28T20:01:12.967632+0000","last_clean":"2023-11-28T20:01:12.967632+0000","last_became_active":"2023-11-28T20:01:10.536893+0000","last_became_peered":"2023-11-28T20:01:10.536893+0000","last_unstale":"2023-11-28T20:01:12.967632+0000","last_undegraded":"2023-11-28T20:01:12.967632+0000","last_fullsized":"2023-11-28T20:01:12.967632+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_clean_scrub_stamp":"2023-11-28T20:01:09.480611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:50:58.589965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.f","version":"60'1","reported_seq":13,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-28T20:01:11.524901+0000","last_change":"2023-11-28T20:01:09.510018+0000","last_active":"2023-11-28T20:01:11.524901+0000","last_peered":"2023-11-28T20:01:11.524901+0000","last_clean":"2023-11-28T20:01:11.524901+0000","last_became_active":"2023-11-28T20:01:09.509743+0000","last_became_peered":"2023-11-28T20:01:09.509743+0000","last_unstale":"2023-11-28T20:01:11.524901+0000","last_undegraded":"2023-11-28T20:01:11.524901+0000","last_fullsized":"2023-11-28T20:01:11.524901+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:08.474257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:08.474257+0000","last_clean_scrub_stamp":"2023-11-28T20:01:08.474257+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:09:59.028591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.d","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-28T20:01:12.967136+0000","last_change":"2023-11-28T20:01:10.537543+0000","last_active":"2023-11-28T20:01:12.967136+0000","last_peered":"2023-11-28T20:01:12.967136+0000","last_clean":"2023-11-28T20:01:12.967136+0000","last_became_active":"2023-11-28T20:01:10.537307+0000","last_became_peered":"2023-11-28T20:01:10.537307+0000","last_unstale":"2023-11-28T20:01:12.967136+0000","last_undegraded":"2023-11-28T20:01:12.967136+0000","last_fullsized":"2023-11-28T20:01:12.967136+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_clean_scrub_stamp":"2023-11-28T20:01:09.480611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:04:52.498548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.e","version":"60'2","reported_seq":14,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-28T20:01:12.967750+0000","last_change":"2023-11-28T20:01:09.519130+0000","last_active":"2023-11-28T20:01:12.967750+0000","last_peered":"2023-11-28T20:01:12.967750+0000","last_clean":"2023-11-28T20:01:12.967750+0000","last_became_active":"2023-11-28T20:01:09.517725+0000","last_became_peered":"2023-11-28T20:01:09.517725+0000","last_unstale":"2023-11-28T20:01:12.967750+0000","last_undegraded":"2023-11-28T20:01:12.967750+0000","last_fullsized":"2023-11-28T20:01:12.967750+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:08.474257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:08.474257+0000","last_clean_scrub_stamp":"2023-11-28T20:01:08.474257+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:05:31.573692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.e","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-28T20:01:11.523614+0000","last_change":"2023-11-28T20:01:10.530449+0000","last_active":"2023-11-28T20:01:11.523614+0000","last_peered":"2023-11-28T20:01:11.523614+0000","last_clean":"2023-11-28T20:01:11.523614+0000","last_became_active":"2023-11-28T20:01:10.530169+0000","last_became_peered":"2023-11-28T20:01:10.530169+0000","last_unstale":"2023-11-28T20:01:11.523614+0000","last_undegraded":"2023-11-28T20:01:11.523614+0000","last_fullsized":"2023-11-28T20:01:11.523614+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_clean_scrub_stamp":"2023-11-28T20:01:09.480611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:01:36.330362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.d","version":"60'1","reported_seq":13,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-28T20:01:12.967789+0000","last_change":"2023-11-28T20:01:09.519252+0000","last_active":"2023-11-28T20:01:12.967789+0000","last_peered":"2023-11-28T20:01:12.967789+0000","last_clean":"2023-11-28T20:01:12.967789+0000","last_became_active":"2023-11-28T20:01:09.518511+0000","last_became_peered":"2023-11-28T20:01:09.518511+0000","last_unstale":"2023-11-28T20:01:12.967789+0000","last_undegraded":"2023-11-28T20:01:12.967789+0000","last_fullsized":"2023-11-28T20:01:12.967789+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:08.474257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:08.474257+0000","last_clean_scrub_stamp":"2023-11-28T20:01:08.474257+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:52:41.735612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.f","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-28T20:01:12.966739+0000","last_change":"2023-11-28T20:01:10.523973+0000","last_active":"2023-11-28T20:01:12.966739+0000","last_peered":"2023-11-28T20:01:12.966739+0000","last_clean":"2023-11-28T20:01:12.966739+0000","last_became_active":"2023-11-28T20:01:10.523676+0000","last_became_peered":"2023-11-28T20:01:10.523676+0000","last_unstale":"2023-11-28T20:01:12.966739+0000","last_undegraded":"2023-11-28T20:01:12.966739+0000","last_fullsized":"2023-11-28T20:01:12.966739+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_clean_scrub_stamp":"2023-11-28T20:01:09.480611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:49:36.861168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-28T20:01:12.966013+0000","last_change":"2023-11-28T20:01:09.514931+0000","last_active":"2023-11-28T20:01:12.966013+0000","last_peered":"2023-11-28T20:01:12.966013+0000","last_clean":"2023-11-28T20:01:12.966013+0000","last_became_active":"2023-11-28T20:01:09.514702+0000","last_became_peered":"2023-11-28T20:01:09.514702+0000","last_unstale":"2023-11-28T20:01:12.966013+0000","last_undegraded":"2023-11-28T20:01:12.966013+0000","last_fullsized":"2023-11-28T20:01:12.966013+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:08.474257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:08.474257+0000","last_clean_scrub_stamp":"2023-11-28T20:01:08.474257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:30:37.298649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-28T20:01:12.535302+0000","last_change":"2023-11-28T20:01:10.525003+0000","last_active":"2023-11-28T20:01:12.535302+0000","last_peered":"2023-11-28T20:01:12.535302+0000","last_clean":"2023-11-28T20:01:12.535302+0000","last_became_active":"2023-11-28T20:01:10.524411+0000","last_became_peered":"2023-11-28T20:01:10.524411+0000","last_unstale":"2023-11-28T20:01:12.535302+0000","last_undegraded":"2023-11-28T20:01:12.535302+0000","last_fullsized":"2023-11-28T20:01:12.535302+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_clean_scrub_stamp":"2023-11-28T20:01:09.480611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:17:27.097887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.b","version":"60'2","reported_seq":14,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-28T20:01:12.535588+0000","last_change":"2023-11-28T20:01:09.511026+0000","last_active":"2023-11-28T20:01:12.535588+0000","last_peered":"2023-11-28T20:01:12.535588+0000","last_clean":"2023-11-28T20:01:12.535588+0000","last_became_active":"2023-11-28T20:01:09.510765+0000","last_became_peered":"2023-11-28T20:01:09.510765+0000","last_unstale":"2023-11-28T20:01:12.535588+0000","last_undegraded":"2023-11-28T20:01:12.535588+0000","last_fullsized":"2023-11-28T20:01:12.535588+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:08.474257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:08.474257+0000","last_clean_scrub_stamp":"2023-11-28T20:01:08.474257+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:06:35.988462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-28T20:01:11.523466+0000","last_change":"2023-11-28T20:01:10.523842+0000","last_active":"2023-11-28T20:01:11.523466+0000","last_peered":"2023-11-28T20:01:11.523466+0000","last_clean":"2023-11-28T20:01:11.523466+0000","last_became_active":"2023-11-28T20:01:10.523553+0000","last_became_peered":"2023-11-28T20:01:10.523553+0000","last_unstale":"2023-11-28T20:01:11.523466+0000","last_undegraded":"2023-11-28T20:01:11.523466+0000","last_fullsized":"2023-11-28T20:01:11.523466+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_clean_scrub_stamp":"2023-11-28T20:01:09.480611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T07:34:37.174623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-28T20:01:11.524098+0000","last_change":"2023-11-28T20:01:09.510719+0000","last_active":"2023-11-28T20:01:11.524098+0000","last_peered":"2023-11-28T20:01:11.524098+0000","last_clean":"2023-11-28T20:01:11.524098+0000","last_became_active":"2023-11-28T20:01:09.509874+0000","last_became_peered":"2023-11-28T20:01:09.509874+0000","last_unstale":"2023-11-28T20:01:11.524098+0000","last_undegraded":"2023-11-28T20:01:11.524098+0000","last_fullsized":"2023-11-28T20:01:11.524098+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:08.474257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:08.474257+0000","last_clean_scrub_stamp":"2023-11-28T20:01:08.474257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:21:20.189227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-28T20:01:12.967348+0000","last_change":"2023-11-28T20:01:10.530042+0000","last_active":"2023-11-28T20:01:12.967348+0000","last_peered":"2023-11-28T20:01:12.967348+0000","last_clean":"2023-11-28T20:01:12.967348+0000","last_became_active":"2023-11-28T20:01:10.529745+0000","last_became_peered":"2023-11-28T20:01:10.529745+0000","last_unstale":"2023-11-28T20:01:12.967348+0000","last_undegraded":"2023-11-28T20:01:12.967348+0000","last_fullsized":"2023-11-28T20:01:12.967348+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_clean_scrub_stamp":"2023-11-28T20:01:09.480611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:18:17.108795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-28T20:01:12.535455+0000","last_change":"2023-11-28T20:01:09.512327+0000","last_active":"2023-11-28T20:01:12.535455+0000","last_peered":"2023-11-28T20:01:12.535455+0000","last_clean":"2023-11-28T20:01:12.535455+0000","last_became_active":"2023-11-28T20:01:09.512065+0000","last_became_peered":"2023-11-28T20:01:09.512065+0000","last_unstale":"2023-11-28T20:01:12.535455+0000","last_undegraded":"2023-11-28T20:01:12.535455+0000","last_fullsized":"2023-11-28T20:01:12.535455+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:08.474257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:08.474257+0000","last_clean_scrub_stamp":"2023-11-28T20:01:08.474257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:46:28.694684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-28T20:01:12.535703+0000","last_change":"2023-11-28T20:01:10.526165+0000","last_active":"2023-11-28T20:01:12.535703+0000","last_peered":"2023-11-28T20:01:12.535703+0000","last_clean":"2023-11-28T20:01:12.535703+0000","last_became_active":"2023-11-28T20:01:10.525619+0000","last_became_peered":"2023-11-28T20:01:10.525619+0000","last_unstale":"2023-11-28T20:01:12.535703+0000","last_undegraded":"2023-11-28T20:01:12.535703+0000","last_fullsized":"2023-11-28T20:01:12.535703+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_clean_scrub_stamp":"2023-11-28T20:01:09.480611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:54:30.269337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.7","version":"60'2","reported_seq":14,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-28T20:01:11.525004+0000","last_change":"2023-11-28T20:01:09.514831+0000","last_active":"2023-11-28T20:01:11.525004+0000","last_peered":"2023-11-28T20:01:11.525004+0000","last_clean":"2023-11-28T20:01:11.525004+0000","last_became_active":"2023-11-28T20:01:09.514525+0000","last_became_peered":"2023-11-28T20:01:09.514525+0000","last_unstale":"2023-11-28T20:01:11.525004+0000","last_undegraded":"2023-11-28T20:01:11.525004+0000","last_fullsized":"2023-11-28T20:01:11.525004+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:08.474257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:08.474257+0000","last_clean_scrub_stamp":"2023-11-28T20:01:08.474257+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:05:31.573692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-28T20:01:11.521724+0000","last_change":"2023-11-28T20:01:10.533050+0000","last_active":"2023-11-28T20:01:11.521724+0000","last_peered":"2023-11-28T20:01:11.521724+0000","last_clean":"2023-11-28T20:01:11.521724+0000","last_became_active":"2023-11-28T20:01:10.532590+0000","last_became_peered":"2023-11-28T20:01:10.532590+0000","last_unstale":"2023-11-28T20:01:11.521724+0000","last_undegraded":"2023-11-28T20:01:11.521724+0000","last_fullsized":"2023-11-28T20:01:11.521724+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_clean_scrub_stamp":"2023-11-28T20:01:09.480611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T07:29:30.339936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-28T20:01:11.524430+0000","last_change":"2023-11-28T20:01:09.510397+0000","last_active":"2023-11-28T20:01:11.524430+0000","last_peered":"2023-11-28T20:01:11.524430+0000","last_clean":"2023-11-28T20:01:11.524430+0000","last_became_active":"2023-11-28T20:01:09.510136+0000","last_became_peered":"2023-11-28T20:01:09.510136+0000","last_unstale":"2023-11-28T20:01:11.524430+0000","last_undegraded":"2023-11-28T20:01:11.524430+0000","last_fullsized":"2023-11-28T20:01:11.524430+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:08.474257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:08.474257+0000","last_clean_scrub_stamp":"2023-11-28T20:01:08.474257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:18:48.620687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.6","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-28T20:01:11.524321+0000","last_change":"2023-11-28T20:01:10.530096+0000","last_active":"2023-11-28T20:01:11.524321+0000","last_peered":"2023-11-28T20:01:11.524321+0000","last_clean":"2023-11-28T20:01:11.524321+0000","last_became_active":"2023-11-28T20:01:10.529472+0000","last_became_peered":"2023-11-28T20:01:10.529472+0000","last_unstale":"2023-11-28T20:01:11.524321+0000","last_undegraded":"2023-11-28T20:01:11.524321+0000","last_fullsized":"2023-11-28T20:01:11.524321+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_clean_scrub_stamp":"2023-11-28T20:01:09.480611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T06:29:13.579326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-28T20:01:12.535910+0000","last_change":"2023-11-28T20:01:09.509983+0000","last_active":"2023-11-28T20:01:12.535910+0000","last_peered":"2023-11-28T20:01:12.535910+0000","last_clean":"2023-11-28T20:01:12.535910+0000","last_became_active":"2023-11-28T20:01:09.509675+0000","last_became_peered":"2023-11-28T20:01:09.509675+0000","last_unstale":"2023-11-28T20:01:12.535910+0000","last_undegraded":"2023-11-28T20:01:12.535910+0000","last_fullsized":"2023-11-28T20:01:12.535910+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:08.474257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:08.474257+0000","last_clean_scrub_stamp":"2023-11-28T20:01:08.474257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:21:20.189227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.7","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-28T20:01:12.967091+0000","last_change":"2023-11-28T20:01:10.535856+0000","last_active":"2023-11-28T20:01:12.967091+0000","last_peered":"2023-11-28T20:01:12.967091+0000","last_clean":"2023-11-28T20:01:12.967091+0000","last_became_active":"2023-11-28T20:01:10.530889+0000","last_became_peered":"2023-11-28T20:01:10.530889+0000","last_unstale":"2023-11-28T20:01:12.967091+0000","last_undegraded":"2023-11-28T20:01:12.967091+0000","last_fullsized":"2023-11-28T20:01:12.967091+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_clean_scrub_stamp":"2023-11-28T20:01:09.480611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:53:37.636427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-28T20:01:12.965882+0000","last_change":"2023-11-28T20:01:09.511368+0000","last_active":"2023-11-28T20:01:12.965882+0000","last_peered":"2023-11-28T20:01:12.965882+0000","last_clean":"2023-11-28T20:01:12.965882+0000","last_became_active":"2023-11-28T20:01:09.510765+0000","last_became_peered":"2023-11-28T20:01:09.510765+0000","last_unstale":"2023-11-28T20:01:12.965882+0000","last_undegraded":"2023-11-28T20:01:12.965882+0000","last_fullsized":"2023-11-28T20:01:12.965882+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:08.474257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:08.474257+0000","last_clean_scrub_stamp":"2023-11-28T20:01:08.474257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:23:01.812122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-28T20:01:12.966640+0000","last_change":"2023-11-28T20:01:10.530585+0000","last_active":"2023-11-28T20:01:12.966640+0000","last_peered":"2023-11-28T20:01:12.966640+0000","last_clean":"2023-11-28T20:01:12.966640+0000","last_became_active":"2023-11-28T20:01:10.530313+0000","last_became_peered":"2023-11-28T20:01:10.530313+0000","last_unstale":"2023-11-28T20:01:12.966640+0000","last_undegraded":"2023-11-28T20:01:12.966640+0000","last_fullsized":"2023-11-28T20:01:12.966640+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_clean_scrub_stamp":"2023-11-28T20:01:09.480611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:04:41.159984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-28T20:01:12.967578+0000","last_change":"2023-11-28T20:01:09.518318+0000","last_active":"2023-11-28T20:01:12.967578+0000","last_peered":"2023-11-28T20:01:12.967578+0000","last_clean":"2023-11-28T20:01:12.967578+0000","last_became_active":"2023-11-28T20:01:09.517761+0000","last_became_peered":"2023-11-28T20:01:09.517761+0000","last_unstale":"2023-11-28T20:01:12.967578+0000","last_undegraded":"2023-11-28T20:01:12.967578+0000","last_fullsized":"2023-11-28T20:01:12.967578+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:08.474257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:08.474257+0000","last_clean_scrub_stamp":"2023-11-28T20:01:08.474257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:18:16.102441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-28T20:01:11.523331+0000","last_change":"2023-11-28T20:01:10.533596+0000","last_active":"2023-11-28T20:01:11.523331+0000","last_peered":"2023-11-28T20:01:11.523331+0000","last_clean":"2023-11-28T20:01:11.523331+0000","last_became_active":"2023-11-28T20:01:10.533195+0000","last_became_peered":"2023-11-28T20:01:10.533195+0000","last_unstale":"2023-11-28T20:01:11.523331+0000","last_undegraded":"2023-11-28T20:01:11.523331+0000","last_fullsized":"2023-11-28T20:01:11.523331+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_clean_scrub_stamp":"2023-11-28T20:01:09.480611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:14:25.459653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-28T20:01:12.965440+0000","last_change":"2023-11-28T20:01:09.507413+0000","last_active":"2023-11-28T20:01:12.965440+0000","last_peered":"2023-11-28T20:01:12.965440+0000","last_clean":"2023-11-28T20:01:12.965440+0000","last_became_active":"2023-11-28T20:01:09.507080+0000","last_became_peered":"2023-11-28T20:01:09.507080+0000","last_unstale":"2023-11-28T20:01:12.965440+0000","last_undegraded":"2023-11-28T20:01:12.965440+0000","last_fullsized":"2023-11-28T20:01:12.965440+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:08.474257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:08.474257+0000","last_clean_scrub_stamp":"2023-11-28T20:01:08.474257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:54:29.262983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-28T20:01:12.965635+0000","last_change":"2023-11-28T20:01:10.518351+0000","last_active":"2023-11-28T20:01:12.965635+0000","last_peered":"2023-11-28T20:01:12.965635+0000","last_clean":"2023-11-28T20:01:12.965635+0000","last_became_active":"2023-11-28T20:01:10.518106+0000","last_became_peered":"2023-11-28T20:01:10.518106+0000","last_unstale":"2023-11-28T20:01:12.965635+0000","last_undegraded":"2023-11-28T20:01:12.965635+0000","last_fullsized":"2023-11-28T20:01:12.965635+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_clean_scrub_stamp":"2023-11-28T20:01:09.480611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:04:52.498548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-28T20:01:12.965332+0000","last_change":"2023-11-28T20:01:09.514346+0000","last_active":"2023-11-28T20:01:12.965332+0000","last_peered":"2023-11-28T20:01:12.965332+0000","last_clean":"2023-11-28T20:01:12.965332+0000","last_became_active":"2023-11-28T20:01:09.513791+0000","last_became_peered":"2023-11-28T20:01:09.513791+0000","last_unstale":"2023-11-28T20:01:12.965332+0000","last_undegraded":"2023-11-28T20:01:12.965332+0000","last_fullsized":"2023-11-28T20:01:12.965332+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:08.474257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:08.474257+0000","last_clean_scrub_stamp":"2023-11-28T20:01:08.474257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:17:26.091533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-28T20:01:11.521477+0000","last_change":"2023-11-28T20:01:10.531261+0000","last_active":"2023-11-28T20:01:11.521477+0000","last_peered":"2023-11-28T20:01:11.521477+0000","last_clean":"2023-11-28T20:01:11.521477+0000","last_became_active":"2023-11-28T20:01:10.531002+0000","last_became_peered":"2023-11-28T20:01:10.531002+0000","last_unstale":"2023-11-28T20:01:11.521477+0000","last_undegraded":"2023-11-28T20:01:11.521477+0000","last_fullsized":"2023-11-28T20:01:11.521477+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_clean_scrub_stamp":"2023-11-28T20:01:09.480611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:50:37.650648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-28T20:01:12.965308+0000","last_change":"2023-11-28T20:01:09.512031+0000","last_active":"2023-11-28T20:01:12.965308+0000","last_peered":"2023-11-28T20:01:12.965308+0000","last_clean":"2023-11-28T20:01:12.965308+0000","last_became_active":"2023-11-28T20:01:09.511366+0000","last_became_peered":"2023-11-28T20:01:09.511366+0000","last_unstale":"2023-11-28T20:01:12.965308+0000","last_undegraded":"2023-11-28T20:01:12.965308+0000","last_fullsized":"2023-11-28T20:01:12.965308+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:08.474257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:08.474257+0000","last_clean_scrub_stamp":"2023-11-28T20:01:08.474257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:29:38.849741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.b","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-28T20:01:12.967122+0000","last_change":"2023-11-28T20:01:10.530148+0000","last_active":"2023-11-28T20:01:12.967122+0000","last_peered":"2023-11-28T20:01:12.967122+0000","last_clean":"2023-11-28T20:01:12.967122+0000","last_became_active":"2023-11-28T20:01:10.529630+0000","last_became_peered":"2023-11-28T20:01:10.529630+0000","last_unstale":"2023-11-28T20:01:12.967122+0000","last_undegraded":"2023-11-28T20:01:12.967122+0000","last_fullsized":"2023-11-28T20:01:12.967122+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_clean_scrub_stamp":"2023-11-28T20:01:09.480611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:11:08.794514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-28T20:01:12.965173+0000","last_change":"2023-11-28T20:01:09.515708+0000","last_active":"2023-11-28T20:01:12.965173+0000","last_peered":"2023-11-28T20:01:12.965173+0000","last_clean":"2023-11-28T20:01:12.965173+0000","last_became_active":"2023-11-28T20:01:09.515449+0000","last_became_peered":"2023-11-28T20:01:09.515449+0000","last_unstale":"2023-11-28T20:01:12.965173+0000","last_undegraded":"2023-11-28T20:01:12.965173+0000","last_fullsized":"2023-11-28T20:01:12.965173+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:08.474257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:08.474257+0000","last_clean_scrub_stamp":"2023-11-28T20:01:08.474257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T07:14:20.829778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":199,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-28T20:01:10.525775+0000","last_change":"2023-11-28T19:58:56.136501+0000","last_active":"2023-11-28T20:01:10.525775+0000","last_peered":"2023-11-28T20:01:10.525775+0000","last_clean":"2023-11-28T20:01:10.525775+0000","last_became_active":"2023-11-28T19:58:56.135998+0000","last_became_peered":"2023-11-28T19:58:56.135998+0000","last_unstale":"2023-11-28T20:01:10.525775+0000","last_undegraded":"2023-11-28T20:01:10.525775+0000","last_fullsized":"2023-11-28T20:01:10.525775+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:58:54.602349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:58:54.602349+0000","last_clean_scrub_stamp":"2023-11-28T19:58:54.602349+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:33:42.723349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":10,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":9,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":66748,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574880,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27816,"kb_used_data":788,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344024,"statfs":{"total":96636764160,"available":96608280576,"internally_reserved":0,"allocated":806912,"data_stored":922237,"data_compressed":33374,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 20:00:55 2023","interfaces":[{"interface":"back","average":{"1min":0.66200000000000003,"5min":0.67500000000000004,"15min":0.67700000000000005},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":0.84699999999999998,"5min":0.90700000000000003,"15min":0.90700000000000003},"last":0.752},{"interface":"front","average":{"1min":0.63300000000000001,"5min":0.67400000000000004,"15min":0.68100000000000005},"min":{"1min":0.499,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":0.84099999999999997,"5min":0.98999999999999999,"15min":0.98999999999999999},"last":0.78300000000000003}]},{"osd":1,"last update":"Tue Nov 28 20:00:55 2023","interfaces":[{"interface":"back","average":{"1min":0.60599999999999998,"5min":0.63800000000000001,"15min":0.64300000000000002},"min":{"1min":0.44700000000000001,"5min":0.438,"15min":0.438},"max":{"1min":0.82899999999999996,"5min":0.89600000000000002,"15min":0.89600000000000002},"last":0.72799999999999998},{"interface":"front","average":{"1min":0.63900000000000001,"5min":0.68899999999999995,"15min":0.69699999999999995},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":0.78200000000000003,"5min":1.0900000000000001,"15min":1.0900000000000001},"last":0.83999999999999997}]},{"osd":2,"last update":"Tue Nov 28 20:00:55 2023","interfaces":[{"interface":"back","average":{"1min":0.64400000000000002,"5min":0.71599999999999997,"15min":0.72799999999999998},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.84699999999999998,"5min":0.98799999999999999,"15min":0.98799999999999999},"last":0.80100000000000005},{"interface":"front","average":{"1min":0.65100000000000002,"5min":0.69499999999999995,"15min":0.70299999999999996},"min":{"1min":0.48599999999999999,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":0.85599999999999998,"5min":1.0680000000000001,"15min":1.0680000000000001},"last":0.74299999999999999}]},{"osd":3,"last update":"Tue Nov 28 20:00:55 2023","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.70099999999999996,"15min":0.69999999999999996},"min":{"1min":0.56100000000000005,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":0.88900000000000001,"5min":1.0449999999999999,"15min":1.0449999999999999},"last":0.76700000000000002},{"interface":"front","average":{"1min":0.74199999999999999,"5min":0.78200000000000003,"15min":0.78900000000000003},"min":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":0.60699999999999998},"max":{"1min":0.879,"5min":1.1299999999999999,"15min":1.1299999999999999},"last":0.70999999999999996}]},{"osd":4,"last update":"Tue Nov 28 20:00:55 2023","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.63600000000000001,"15min":0.64000000000000001},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":0.83899999999999997,"5min":1.018,"15min":1.018},"last":0.68000000000000005},{"interface":"front","average":{"1min":0.67600000000000005,"5min":0.72199999999999998,"15min":0.72999999999999998},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":0.97899999999999998,"5min":1.1120000000000001,"15min":1.1120000000000001},"last":0.65700000000000003}]},{"osd":5,"last update":"Tue Nov 28 20:00:55 2023","interfaces":[{"interface":"back","average":{"1min":0.58699999999999997,"5min":0.66500000000000004,"15min":0.67800000000000005},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.871,"5min":1.1699999999999999,"15min":1.1699999999999999},"last":0.60399999999999998},{"interface":"front","average":{"1min":0.67900000000000005,"5min":0.748,"15min":0.76000000000000001},"min":{"1min":0.505,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":0.88500000000000001,"5min":1.1890000000000001,"15min":1.1890000000000001},"last":0.85699999999999998}]},{"osd":6,"last update":"Tue Nov 28 20:00:55 2023","interfaces":[{"interface":"back","average":{"1min":0.71399999999999997,"5min":0.76800000000000002,"15min":0.77700000000000002},"min":{"1min":0.47499999999999998,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.88200000000000001,"5min":1.1379999999999999,"15min":1.1379999999999999},"last":0.82099999999999995},{"interface":"front","average":{"1min":0.65000000000000002,"5min":0.72699999999999998,"15min":0.73999999999999999},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":0.93300000000000005,"5min":1.23,"15min":1.23},"last":0.58199999999999996}]}]},{"osd":6,"up_from":13,"seq":55834574878,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27736,"kb_used_data":712,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344104,"statfs":{"total":96636764160,"available":96608362496,"internally_reserved":0,"allocated":729088,"data_stored":331127,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 20:00:54 2023","interfaces":[{"interface":"back","average":{"1min":0.621,"5min":0.61699999999999999,"15min":0.61599999999999999},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.81699999999999995,"5min":0.82599999999999996,"15min":0.82599999999999996},"last":0.55700000000000005},{"interface":"front","average":{"1min":0.67300000000000004,"5min":0.66500000000000004,"15min":0.66400000000000003},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":0.88700000000000001,"5min":0.98999999999999999,"15min":0.98999999999999999},"last":0.58799999999999997}]},{"osd":1,"last update":"Tue Nov 28 20:00:54 2023","interfaces":[{"interface":"back","average":{"1min":0.745,"5min":0.78100000000000003,"15min":0.78700000000000003},"min":{"1min":0.56100000000000005,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.0940000000000001,"5min":1.105,"15min":1.105},"last":0.61699999999999999},{"interface":"front","average":{"1min":0.69999999999999996,"5min":0.68899999999999995,"15min":0.68700000000000006},"min":{"1min":0.53700000000000003,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.85599999999999998,"5min":0.95899999999999996,"15min":0.95899999999999996},"last":0.51800000000000002}]},{"osd":2,"last update":"Tue Nov 28 20:00:54 2023","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.69499999999999995,"15min":0.69799999999999995},"min":{"1min":0.54700000000000004,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":0.89700000000000002,"5min":0.93400000000000005,"15min":0.93400000000000005},"last":0.57499999999999996},{"interface":"front","average":{"1min":0.70499999999999996,"5min":0.71599999999999997,"15min":0.71799999999999997},"min":{"1min":0.53400000000000003,"5min":0.505,"15min":0.505},"max":{"1min":0.91800000000000004,"5min":1.006,"15min":1.006},"last":0.56699999999999995}]},{"osd":3,"last update":"Tue Nov 28 20:00:54 2023","interfaces":[{"interface":"back","average":{"1min":0.70999999999999996,"5min":0.74099999999999999,"15min":0.746},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.04,"5min":1.056,"15min":1.056},"last":0.53400000000000003},{"interface":"front","average":{"1min":0.66700000000000004,"5min":0.68100000000000005,"15min":0.68300000000000005},"min":{"1min":0.505,"5min":0.505,"15min":0.505},"max":{"1min":0.85599999999999998,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.54200000000000004}]},{"osd":4,"last update":"Tue Nov 28 20:00:54 2023","interfaces":[{"interface":"back","average":{"1min":0.61599999999999999,"5min":0.628,"15min":0.63},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":0.97599999999999998,"5min":0.97599999999999998,"15min":0.97599999999999998},"last":0.38600000000000001},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.71199999999999997,"15min":0.72999999999999998},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":1.1419999999999999,"5min":1.389,"15min":1.389},"last":0.41899999999999998}]},{"osd":5,"last update":"Tue Nov 28 20:00:54 2023","interfaces":[{"interface":"back","average":{"1min":0.71999999999999997,"5min":0.79700000000000004,"15min":0.81000000000000005},"min":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":1.147,"5min":1.4259999999999999,"15min":1.4259999999999999},"last":0.49199999999999999},{"interface":"front","average":{"1min":0.70699999999999996,"5min":0.751,"15min":0.75900000000000001},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.034,"5min":1.276,"15min":1.276},"last":0.60099999999999998}]},{"osd":7,"last update":"Tue Nov 28 20:00:54 2023","interfaces":[{"interface":"back","average":{"1min":0.64000000000000001,"5min":0.69999999999999996,"15min":0.70999999999999996},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":1.014,"5min":1.014,"15min":1.014},"last":0.628},{"interface":"front","average":{"1min":0.72599999999999998,"5min":0.80900000000000005,"15min":0.82299999999999995},"min":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":1.083,"5min":1.242,"15min":1.242},"last":0.46999999999999997}]}]},{"osd":5,"up_from":13,"seq":55834574880,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27752,"kb_used_data":724,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344088,"statfs":{"total":96636764160,"available":96608346112,"internally_reserved":0,"allocated":741376,"data_stored":337735,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 20:00:54 2023","interfaces":[{"interface":"back","average":{"1min":0.628,"5min":0.69299999999999995,"15min":0.70399999999999996},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.84699999999999998,"5min":0.997,"15min":0.997},"last":0.44400000000000001},{"interface":"front","average":{"1min":0.61899999999999999,"5min":0.69899999999999995,"15min":0.71199999999999997},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.78800000000000003,"5min":1.149,"15min":1.149},"last":0.58399999999999996}]},{"osd":1,"last update":"Tue Nov 28 20:00:54 2023","interfaces":[{"interface":"back","average":{"1min":0.66800000000000004,"5min":0.70399999999999996,"15min":0.70999999999999996},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.94499999999999995,"5min":0.94499999999999995,"15min":0.94499999999999995},"last":0.45900000000000002},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.70399999999999996,"15min":0.71999999999999997},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":0.71999999999999997,"5min":1.0940000000000001,"15min":1.0940000000000001},"last":0.53400000000000003}]},{"osd":2,"last update":"Tue Nov 28 20:00:54 2023","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.89200000000000002,"15min":0.92800000000000005},"min":{"1min":0.5,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":0.91200000000000003,"5min":5.0880000000000001,"15min":5.0880000000000001},"last":0.51400000000000001},{"interface":"front","average":{"1min":0.69599999999999995,"5min":0.93999999999999995,"15min":0.98099999999999998},"min":{"1min":0.59199999999999997,"5min":0.504,"15min":0.504},"max":{"1min":0.96199999999999997,"5min":5.1399999999999997,"15min":5.1399999999999997},"last":0.56399999999999995}]},{"osd":3,"last update":"Tue Nov 28 20:00:54 2023","interfaces":[{"interface":"back","average":{"1min":0.70999999999999996,"5min":0.96399999999999997,"15min":1.006},"min":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":0.91100000000000003,"5min":5.0469999999999997,"15min":5.0469999999999997},"last":0.69499999999999995},{"interface":"front","average":{"1min":0.69099999999999995,"5min":0.93899999999999995,"15min":0.97999999999999998},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":0.90000000000000002,"5min":5.024,"15min":5.024},"last":0.499}]},{"osd":4,"last update":"Tue Nov 28 20:00:54 2023","interfaces":[{"interface":"back","average":{"1min":0.58599999999999997,"5min":0.65800000000000003,"15min":0.67000000000000004},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.93300000000000005,"5min":1.4810000000000001,"15min":1.4810000000000001},"last":0.48299999999999998},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.73599999999999999,"15min":0.74299999999999999},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":0.95799999999999996,"5min":1.6339999999999999,"15min":1.6339999999999999},"last":0.64000000000000001}]},{"osd":6,"last update":"Tue Nov 28 20:00:54 2023","interfaces":[{"interface":"back","average":{"1min":0.70299999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"min":{"1min":0.47699999999999998,"5min":0.434,"15min":0.434},"max":{"1min":0.93899999999999995,"5min":0.97699999999999998,"15min":0.97699999999999998},"last":0.623},{"interface":"front","average":{"1min":0.69199999999999995,"5min":0.73599999999999999,"15min":0.74399999999999999},"min":{"1min":0.46300000000000002,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":0.86599999999999999,"5min":1.099,"15min":1.099},"last":0.60299999999999998}]},{"osd":7,"last update":"Tue Nov 28 20:00:54 2023","interfaces":[{"interface":"back","average":{"1min":0.77100000000000002,"5min":0.78300000000000003,"15min":0.78500000000000003},"min":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":0.95999999999999996,"5min":1.236,"15min":1.236},"last":0.67400000000000004},{"interface":"front","average":{"1min":0.77800000000000002,"5min":0.79600000000000004,"15min":0.79900000000000004},"min":{"1min":0.54000000000000004,"5min":0.505,"15min":0.505},"max":{"1min":0.98599999999999999,"5min":1.0760000000000001,"15min":1.0760000000000001},"last":0.66000000000000003}]}]},{"osd":4,"up_from":13,"seq":55834574879,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27760,"kb_used_data":732,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344080,"statfs":{"total":96636764160,"available":96608337920,"internally_reserved":0,"allocated":749568,"data_stored":339325,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 20:00:54 2023","interfaces":[{"interface":"back","average":{"1min":0.63200000000000001,"5min":0.69499999999999995,"15min":0.70499999999999996},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.82999999999999996,"5min":1.0429999999999999,"15min":1.0429999999999999},"last":0.78500000000000003},{"interface":"front","average":{"1min":0.64400000000000002,"5min":0.69999999999999996,"15min":0.70899999999999996},"min":{"1min":0.44900000000000001,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.93200000000000005,"5min":1.163,"15min":1.163},"last":0.501}]},{"osd":1,"last update":"Tue Nov 28 20:00:54 2023","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.73599999999999999,"15min":0.754},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.88500000000000001,"5min":1.111,"15min":1.111},"last":0.51900000000000002},{"interface":"front","average":{"1min":0.68300000000000005,"5min":0.78700000000000003,"15min":0.80500000000000005},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":0.90000000000000002,"5min":1.238,"15min":1.238},"last":0.67900000000000005}]},{"osd":2,"last update":"Tue Nov 28 20:00:54 2023","interfaces":[{"interface":"back","average":{"1min":0.70099999999999996,"5min":0.76600000000000001,"15min":0.77700000000000002},"min":{"1min":0.53300000000000003,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.97399999999999998,"5min":1.0669999999999999,"15min":1.0669999999999999},"last":0.65700000000000003},{"interface":"front","average":{"1min":0.66700000000000004,"5min":0.78700000000000003,"15min":0.80700000000000005},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.88100000000000001,"5min":1.1180000000000001,"15min":1.1180000000000001},"last":0.84599999999999997}]},{"osd":3,"last update":"Tue Nov 28 20:00:54 2023","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.76600000000000001,"15min":0.79000000000000004},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":0.89700000000000002,"5min":1.202,"15min":1.202},"last":0.63300000000000001},{"interface":"front","average":{"1min":0.67700000000000005,"5min":0.77200000000000002,"15min":0.78800000000000003},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":0.94599999999999995,"5min":1.0589999999999999,"15min":1.0589999999999999},"last":0.76400000000000001}]},{"osd":5,"last update":"Tue Nov 28 20:00:54 2023","interfaces":[{"interface":"back","average":{"1min":0.621,"5min":0.70299999999999996,"15min":0.71699999999999997},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.82499999999999996,"5min":0.95899999999999996,"15min":0.95899999999999996},"last":0.88400000000000001},{"interface":"front","average":{"1min":0.625,"5min":0.69599999999999995,"15min":0.70799999999999996},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.879,"5min":1.034,"15min":1.034},"last":0.70299999999999996}]},{"osd":6,"last update":"Tue Nov 28 20:00:54 2023","interfaces":[{"interface":"back","average":{"1min":0.60799999999999998,"5min":0.70899999999999996,"15min":0.72599999999999998},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":0.73799999999999999,"5min":1.0309999999999999,"15min":1.0309999999999999},"last":0.72199999999999998},{"interface":"front","average":{"1min":0.71899999999999997,"5min":0.77100000000000002,"15min":0.77900000000000003},"min":{"1min":0.49199999999999999,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":0.879,"5min":1.002,"15min":1.002},"last":0.90700000000000003}]},{"osd":7,"last update":"Tue Nov 28 20:00:54 2023","interfaces":[{"interface":"back","average":{"1min":0.70499999999999996,"5min":0.77100000000000002,"15min":0.78200000000000003},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":0.91000000000000003,"5min":1.0620000000000001,"15min":1.0620000000000001},"last":0.86499999999999999},{"interface":"front","average":{"1min":0.76000000000000001,"5min":0.84799999999999998,"15min":0.86199999999999999},"min":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":0.93400000000000005,"5min":1.1459999999999999,"15min":1.1459999999999999},"last":0.82599999999999996}]}]},{"osd":3,"up_from":13,"seq":55834574880,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27732,"kb_used_data":708,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344108,"statfs":{"total":96636764160,"available":96608366592,"internally_reserved":0,"allocated":724992,"data_stored":331093,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 20:00:55 2023","interfaces":[{"interface":"back","average":{"1min":0.41899999999999998,"5min":0.441,"15min":0.44500000000000001},"min":{"1min":0.29399999999999998,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.40200000000000002},{"interface":"front","average":{"1min":0.39600000000000002,"5min":0.45800000000000002,"15min":0.46800000000000003},"min":{"1min":0.28199999999999997,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.52800000000000002,"5min":0.82599999999999996,"15min":0.82599999999999996},"last":0.49099999999999999}]},{"osd":1,"last update":"Tue Nov 28 20:00:55 2023","interfaces":[{"interface":"back","average":{"1min":0.40000000000000002,"5min":0.46500000000000002,"15min":0.47599999999999998},"min":{"1min":0.26200000000000001,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.56999999999999995,"5min":0.84399999999999997,"15min":0.84399999999999997},"last":0.42399999999999999},{"interface":"front","average":{"1min":0.439,"5min":0.49099999999999999,"15min":0.5},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.74099999999999999,"5min":0.86099999999999999,"15min":0.86099999999999999},"last":0.503}]},{"osd":2,"last update":"Tue Nov 28 20:00:55 2023","interfaces":[{"interface":"back","average":{"1min":0.48799999999999999,"5min":0.52400000000000002,"15min":0.53000000000000003},"min":{"1min":0.375,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.64900000000000002,"5min":0.85599999999999998,"15min":0.85599999999999998},"last":0.51700000000000002},{"interface":"front","average":{"1min":0.48999999999999999,"5min":0.56599999999999995,"15min":0.57899999999999996},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.63500000000000001,"5min":0.83699999999999997,"15min":0.83699999999999997},"last":0.55800000000000005}]},{"osd":4,"last update":"Tue Nov 28 20:00:55 2023","interfaces":[{"interface":"back","average":{"1min":0.77700000000000002,"5min":0.76500000000000001,"15min":0.76300000000000001},"min":{"1min":0.60799999999999998,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":1.085,"5min":1.206,"15min":1.206},"last":0.92800000000000005},{"interface":"front","average":{"1min":0.80700000000000005,"5min":0.80300000000000005,"15min":0.80300000000000005},"min":{"1min":0.58999999999999997,"5min":0.503,"15min":0.503},"max":{"1min":1.173,"5min":1.222,"15min":1.222},"last":0.88800000000000001}]},{"osd":5,"last update":"Tue Nov 28 20:00:55 2023","interfaces":[{"interface":"back","average":{"1min":0.78300000000000003,"5min":0.79600000000000004,"15min":0.79800000000000004},"min":{"1min":0.57699999999999996,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":1.2509999999999999,"5min":1.2509999999999999,"15min":1.2509999999999999},"last":0.77800000000000002},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.79100000000000004,"15min":0.79900000000000004},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":1.0409999999999999,"5min":1.3100000000000001,"15min":1.3100000000000001},"last":0.83899999999999997}]},{"osd":6,"last update":"Tue Nov 28 20:00:55 2023","interfaces":[{"interface":"back","average":{"1min":0.81699999999999995,"5min":0.83799999999999997,"15min":0.84199999999999997},"min":{"1min":0.58799999999999997,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":1.544,"5min":1.544,"15min":1.544},"last":0.89700000000000002},{"interface":"front","average":{"1min":0.93100000000000005,"5min":0.78500000000000003,"15min":0.76100000000000001},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":4.0679999999999996,"5min":4.0679999999999996,"15min":4.0679999999999996},"last":0.90800000000000003}]},{"osd":7,"last update":"Tue Nov 28 20:00:55 2023","interfaces":[{"interface":"back","average":{"1min":0.97099999999999997,"5min":0.874,"15min":0.85799999999999998},"min":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":4.0019999999999998,"5min":4.0019999999999998,"15min":4.0019999999999998},"last":0.878},{"interface":"front","average":{"1min":0.80100000000000005,"5min":0.873,"15min":0.88500000000000001},"min":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.60299999999999998},"max":{"1min":1.1830000000000001,"5min":1.339,"15min":1.339},"last":0.85799999999999998}]}]},{"osd":2,"up_from":13,"seq":55834574878,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27748,"kb_used_data":720,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344092,"statfs":{"total":96636764160,"available":96608350208,"internally_reserved":0,"allocated":737280,"data_stored":337713,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 20:00:54 2023","interfaces":[{"interface":"back","average":{"1min":0.42599999999999999,"5min":0.45000000000000001,"15min":0.45400000000000001},"min":{"1min":0.33300000000000002,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.65100000000000002,"5min":0.74099999999999999,"15min":0.74099999999999999},"last":0.311},{"interface":"front","average":{"1min":0.42199999999999999,"5min":0.46999999999999997,"15min":0.47799999999999998},"min":{"1min":0.27900000000000003,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.61399999999999999,"5min":0.67700000000000005,"15min":0.67700000000000005},"last":0.495}]},{"osd":1,"last update":"Tue Nov 28 20:00:54 2023","interfaces":[{"interface":"back","average":{"1min":0.42899999999999999,"5min":0.497,"15min":0.50900000000000001},"min":{"1min":0.33300000000000002,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.57199999999999995,"5min":1.0389999999999999,"15min":1.0389999999999999},"last":0.44800000000000001},{"interface":"front","average":{"1min":0.435,"5min":0.49099999999999999,"15min":0.5},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.70299999999999996,"5min":0.70999999999999996,"15min":0.70999999999999996},"last":0.40799999999999997}]},{"osd":3,"last update":"Tue Nov 28 20:00:54 2023","interfaces":[{"interface":"back","average":{"1min":0.44,"5min":0.46600000000000003,"15min":0.46999999999999997},"min":{"1min":0.317,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.55200000000000005,"5min":0.629,"15min":0.629},"last":0.36899999999999999},{"interface":"front","average":{"1min":0.496,"5min":0.57199999999999995,"15min":0.58499999999999996},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.67800000000000005,"5min":0.98499999999999999,"15min":0.98499999999999999},"last":0.56899999999999995}]},{"osd":4,"last update":"Tue Nov 28 20:00:54 2023","interfaces":[{"interface":"back","average":{"1min":0.73899999999999999,"5min":0.83699999999999997,"15min":0.85299999999999998},"min":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"max":{"1min":0.98999999999999999,"5min":1.139,"15min":1.139},"last":0.78300000000000003},{"interface":"front","average":{"1min":0.71999999999999997,"5min":0.82599999999999996,"15min":0.84399999999999997},"min":{"1min":0.57299999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":0.97599999999999998,"5min":1.238,"15min":1.238},"last":0.97699999999999998}]},{"osd":5,"last update":"Tue Nov 28 20:00:54 2023","interfaces":[{"interface":"back","average":{"1min":0.69699999999999995,"5min":0.84699999999999998,"15min":0.872},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":0.83599999999999997,"5min":1.6180000000000001,"15min":1.6180000000000001},"last":0.93200000000000005},{"interface":"front","average":{"1min":0.71099999999999997,"5min":0.81000000000000005,"15min":0.82599999999999996},"min":{"1min":0.52200000000000002,"5min":0.496,"15min":0.496},"max":{"1min":0.96899999999999997,"5min":1.339,"15min":1.339},"last":0.80000000000000004}]},{"osd":6,"last update":"Tue Nov 28 20:00:54 2023","interfaces":[{"interface":"back","average":{"1min":0.73299999999999998,"5min":0.79100000000000004,"15min":0.80100000000000005},"min":{"1min":0.54600000000000004,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":0.98199999999999998,"5min":1.1839999999999999,"15min":1.1839999999999999},"last":0.877},{"interface":"front","average":{"1min":0.70599999999999996,"5min":0.82999999999999996,"15min":0.85099999999999998},"min":{"1min":0.497,"5min":0.497,"15min":0.497},"max":{"1min":0.94199999999999995,"5min":1.099,"15min":1.099},"last":0.96799999999999997}]},{"osd":7,"last update":"Tue Nov 28 20:00:54 2023","interfaces":[{"interface":"back","average":{"1min":0.746,"5min":0.86099999999999999,"15min":0.88},"min":{"1min":0.53300000000000003,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":0.84899999999999998,"5min":1.4590000000000001,"15min":1.4590000000000001},"last":0.81799999999999995},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.83599999999999997,"15min":0.85599999999999998},"min":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":0.96599999999999997,"5min":1.387,"15min":1.387},"last":0.91200000000000003}]}]},{"osd":1,"up_from":13,"seq":55834574880,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27760,"kb_used_data":736,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344080,"statfs":{"total":96636764160,"available":96608337920,"internally_reserved":0,"allocated":753664,"data_stored":333469,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 20:00:56 2023","interfaces":[{"interface":"back","average":{"1min":0.372,"5min":0.59999999999999998,"15min":0.63800000000000001},"min":{"1min":0.25900000000000001,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.53200000000000003,"5min":3.8740000000000001,"15min":3.8740000000000001},"last":0.46899999999999997},{"interface":"front","average":{"1min":0.41499999999999998,"5min":0.54000000000000004,"15min":0.56100000000000005},"min":{"1min":0.26200000000000001,"5min":0.25,"15min":0.25},"max":{"1min":0.64100000000000001,"5min":2.0760000000000001,"15min":2.0760000000000001},"last":0.60399999999999998}]},{"osd":2,"last update":"Tue Nov 28 20:00:56 2023","interfaces":[{"interface":"back","average":{"1min":0.40899999999999997,"5min":0.60899999999999999,"15min":0.64200000000000002},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":0.54500000000000004,"5min":3.7320000000000002,"15min":3.7320000000000002},"last":0.70799999999999996},{"interface":"front","average":{"1min":0.42199999999999999,"5min":0.69199999999999995,"15min":0.73699999999999999},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.54800000000000004,"5min":3.9089999999999998,"15min":3.9089999999999998},"last":0.67000000000000004}]},{"osd":3,"last update":"Tue Nov 28 20:00:56 2023","interfaces":[{"interface":"back","average":{"1min":0.52800000000000002,"5min":0.65000000000000002,"15min":0.67000000000000004},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.64700000000000002,"5min":1.6399999999999999,"15min":1.6399999999999999},"last":0.51500000000000001},{"interface":"front","average":{"1min":0.52000000000000002,"5min":0.66600000000000004,"15min":0.68999999999999995},"min":{"1min":0.37,"5min":0.317,"15min":0.317},"max":{"1min":0.748,"5min":2.5270000000000001,"15min":2.5270000000000001},"last":0.35399999999999998}]},{"osd":4,"last update":"Tue Nov 28 20:00:56 2023","interfaces":[{"interface":"back","average":{"1min":0.70199999999999996,"5min":0.85599999999999998,"15min":0.88200000000000001},"min":{"1min":0.46700000000000003,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":1.036,"5min":3.1659999999999999,"15min":3.1659999999999999},"last":0.75900000000000001},{"interface":"front","average":{"1min":0.68700000000000006,"5min":0.89400000000000002,"15min":0.92800000000000005},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.93700000000000006,"5min":3.7959999999999998,"15min":3.7959999999999998},"last":0.58499999999999996}]},{"osd":5,"last update":"Tue Nov 28 20:00:56 2023","interfaces":[{"interface":"back","average":{"1min":0.69799999999999995,"5min":0.93000000000000005,"15min":0.96899999999999997},"min":{"1min":0.50800000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":0.95599999999999996,"5min":4.1479999999999997,"15min":4.1479999999999997},"last":0.57399999999999995},{"interface":"front","average":{"1min":0.70299999999999996,"5min":0.86799999999999999,"15min":0.89600000000000002},"min":{"1min":0.499,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":1.052,"5min":3.5569999999999999,"15min":3.5569999999999999},"last":0.79200000000000004}]},{"osd":6,"last update":"Tue Nov 28 20:00:56 2023","interfaces":[{"interface":"back","average":{"1min":0.73999999999999999,"5min":0.94099999999999995,"15min":0.97499999999999998},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":1.004,"5min":2.863,"15min":2.863},"last":0.628},{"interface":"front","average":{"1min":0.77400000000000002,"5min":0.94099999999999995,"15min":0.96899999999999997},"min":{"1min":0.58099999999999996,"5min":0.56899999999999995,"15min":0.56899999999999995},"max":{"1min":1.075,"5min":3.371,"15min":3.371},"last":0.82199999999999995}]},{"osd":7,"last update":"Tue Nov 28 20:00:56 2023","interfaces":[{"interface":"back","average":{"1min":0.71599999999999997,"5min":0.95299999999999996,"15min":0.99299999999999999},"min":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":0.96899999999999997,"5min":3.8439999999999999,"15min":3.8439999999999999},"last":0.55500000000000005},{"interface":"front","average":{"1min":0.72699999999999998,"5min":0.97499999999999998,"15min":1.0169999999999999},"min":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":1.0569999999999999,"5min":3.9689999999999999,"15min":3.9689999999999999},"last":0.65500000000000003}]}]},{"osd":0,"up_from":13,"seq":55834574879,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31968,"kb_used_data":784,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339872,"statfs":{"total":96636764160,"available":96604028928,"internally_reserved":0,"allocated":802816,"data_stored":928081,"data_compressed":33374,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Nov 28 20:00:56 2023","interfaces":[{"interface":"back","average":{"1min":0.41299999999999998,"5min":0.63400000000000001,"15min":0.67100000000000004},"min":{"1min":0.27400000000000002,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.55800000000000005,"5min":4.883,"15min":4.883},"last":0.48999999999999999},{"interface":"front","average":{"1min":0.44,"5min":0.79000000000000004,"15min":0.84799999999999998},"min":{"1min":0.30199999999999999,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.63200000000000001,"5min":8.0800000000000001,"15min":8.0800000000000001},"last":0.432}]},{"osd":2,"last update":"Tue Nov 28 20:00:56 2023","interfaces":[{"interface":"back","average":{"1min":0.443,"5min":0.86699999999999999,"15min":0.93799999999999994},"min":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.59899999999999998,"5min":8.1029999999999998,"15min":8.1029999999999998},"last":0.77300000000000002},{"interface":"front","average":{"1min":0.47599999999999998,"5min":0.88400000000000001,"15min":0.95199999999999996},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.67600000000000005,"5min":8.1310000000000002,"15min":8.1310000000000002},"last":0.54900000000000004}]},{"osd":3,"last update":"Tue Nov 28 20:00:56 2023","interfaces":[{"interface":"back","average":{"1min":0.42899999999999999,"5min":0.68300000000000005,"15min":0.72499999999999998},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.57599999999999996,"5min":4.3949999999999996,"15min":4.3949999999999996},"last":0.61799999999999999},{"interface":"front","average":{"1min":0.48899999999999999,"5min":0.70299999999999996,"15min":0.73899999999999999},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.69899999999999995,"5min":4.3470000000000004,"15min":4.3470000000000004},"last":0.64000000000000001}]},{"osd":4,"last update":"Tue Nov 28 20:00:56 2023","interfaces":[{"interface":"back","average":{"1min":0.71999999999999997,"5min":0.98399999999999999,"15min":1.028},"min":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":1.123,"5min":4.6360000000000001,"15min":4.6360000000000001},"last":0.96199999999999997},{"interface":"front","average":{"1min":0.747,"5min":0.99099999999999999,"15min":1.032},"min":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":0.996,"5min":4.4710000000000001,"15min":4.4710000000000001},"last":0.82499999999999996}]},{"osd":5,"last update":"Tue Nov 28 20:00:56 2023","interfaces":[{"interface":"back","average":{"1min":0.74299999999999999,"5min":1,"15min":1.0429999999999999},"min":{"1min":0.54800000000000004,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":0.96399999999999997,"5min":4.6120000000000001,"15min":4.6120000000000001},"last":0.751},{"interface":"front","average":{"1min":0.74199999999999999,"5min":0.98999999999999999,"15min":1.0309999999999999},"min":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"max":{"1min":1.1659999999999999,"5min":4.5449999999999999,"15min":4.5449999999999999},"last":0.91200000000000003}]},{"osd":6,"last update":"Tue Nov 28 20:00:56 2023","interfaces":[{"interface":"back","average":{"1min":0.73499999999999999,"5min":1.01,"15min":1.056},"min":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":1.143,"5min":4.657,"15min":4.657},"last":0.88100000000000001},{"interface":"front","average":{"1min":0.74199999999999999,"5min":1.026,"15min":1.073},"min":{"1min":0.61199999999999999,"5min":0.58899999999999997,"15min":0.58899999999999997},"max":{"1min":1.0109999999999999,"5min":4.5259999999999998,"15min":4.5259999999999998},"last":0.66700000000000004}]},{"osd":7,"last update":"Tue Nov 28 20:00:56 2023","interfaces":[{"interface":"back","average":{"1min":0.72199999999999998,"5min":1.0249999999999999,"15min":1.075},"min":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":1.036,"5min":4.7320000000000002,"15min":4.7320000000000002},"last":0.80000000000000004},{"interface":"front","average":{"1min":0.755,"5min":0.98699999999999999,"15min":1.026},"min":{"1min":0.57499999999999996,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":1.1919999999999999,"5min":4.4939999999999998,"15min":4.4939999999999998},"last":0.72899999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33374,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33374,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":2376,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":776,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-28T20:01:14.589 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-28T20:01:14.768 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:14.765+0000 7fd811d96640 1 Processor -- start 2023-11-28T20:01:14.768 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:14.765+0000 7fd811d96640 1 -- start start 2023-11-28T20:01:14.769 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:14.765+0000 7fd811d96640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd80c0c65f0 0x7fd80c0c69d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:14.769 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:14.765+0000 7fd811d96640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd80c151f20 con 0x7fd80c0c8200 2023-11-28T20:01:14.769 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:14.765+0000 7fd811d96640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd80c154450 con 0x7fd80c0c9210 2023-11-28T20:01:14.769 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:14.765+0000 7fd811d96640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd80c154710 con 0x7fd80c0c65f0 2023-11-28T20:01:14.769 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:14.765+0000 7fd80bfff640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7fd80c0c8200 0x7fd80c0c8b00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:59820/0 (socket says 172.21.15.78:59820) 2023-11-28T20:01:14.769 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:14.765+0000 7fd80bfff640 1 -- 172.21.15.78:0/92999980 learned_addr learned my addr 172.21.15.78:0/92999980 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-11-28T20:01:14.771 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:14.765+0000 7fd810d94640 1 --2- 172.21.15.78:0/92999980 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd80c0c65f0 0x7fd80c0c69d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:14.771 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:14.765+0000 7fd80b7fe640 1 -- 172.21.15.78:0/92999980 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2398201374 0 0) 0x7fd80c151f20 con 0x7fd80c0c8200 2023-11-28T20:01:14.771 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:14.765+0000 7fd80b7fe640 1 -- 172.21.15.78:0/92999980 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd7fc003530 con 0x7fd80c0c8200 2023-11-28T20:01:14.772 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:14.765+0000 7fd80b7fe640 1 -- 172.21.15.78:0/92999980 <== mon.0 v1:172.21.15.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 743668554 0 0) 0x7fd7fc003530 con 0x7fd80c0c8200 2023-11-28T20:01:14.772 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:14.765+0000 7fd80b7fe640 1 -- 172.21.15.78:0/92999980 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd80c0c65f0 msgr2=0x7fd80c0c69d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:01:14.772 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:14.765+0000 7fd80b7fe640 1 --2- 172.21.15.78:0/92999980 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd80c0c65f0 0x7fd80c0c69d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:14.772 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:14.765+0000 7fd80b7fe640 1 -- 172.21.15.78:0/92999980 >> v1:172.21.15.179:6789/0 conn(0x7fd80c0c9210 legacy=0x7fd80c15ecf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:01:14.772 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:14.765+0000 7fd80b7fe640 1 -- 172.21.15.78:0/92999980 --> v1:172.21.15.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd80c1549f0 con 0x7fd80c0c8200 2023-11-28T20:01:14.772 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:14.765+0000 7fd80b7fe640 1 -- 172.21.15.78:0/92999980 <== mon.0 v1:172.21.15.78:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3326804700 0 0) 0x7fd7f8001680 con 0x7fd80c0c8200 2023-11-28T20:01:14.772 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:14.765+0000 7fd80b7fe640 1 -- 172.21.15.78:0/92999980 >> v1:172.21.15.78:6789/0 conn(0x7fd80c0c8200 legacy=0x7fd80c0c8b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:01:14.772 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:14.765+0000 7fd80b7fe640 1 --2- 172.21.15.78:0/92999980 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd7fc0039b0 0x7fd7fc003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:14.772 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:14.765+0000 7fd80b7fe640 1 --2- 172.21.15.78:0/92999980 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd80c0c65f0 0x7fd7fc0047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:14.772 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:14.765+0000 7fd80b7fe640 1 --2- 172.21.15.78:0/92999980 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd7fc004d10 0x7fd7fc005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:14.773 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:14.765+0000 7fd80b7fe640 1 -- 172.21.15.78:0/92999980 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd80c154710 con 0x7fd7fc0039b0 2023-11-28T20:01:14.773 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:14.765+0000 7fd80b7fe640 1 -- 172.21.15.78:0/92999980 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7fc00bac0 con 0x7fd7fc004d10 2023-11-28T20:01:14.773 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:14.765+0000 7fd80b7fe640 1 -- 172.21.15.78:0/92999980 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd7fc00bc80 con 0x7fd80c0c65f0 2023-11-28T20:01:14.773 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:14.765+0000 7fd810d94640 1 --2- 172.21.15.78:0/92999980 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd7fc0039b0 0x7fd7fc003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:14.773 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:14.765+0000 7fd80bfff640 1 --2- 172.21.15.78:0/92999980 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd80c0c65f0 0x7fd7fc0047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:14.773 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:14.765+0000 7fd811595640 1 --2- 172.21.15.78:0/92999980 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd7fc004d10 0x7fd7fc005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:14.773 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:14.765+0000 7fd810d94640 1 -- 172.21.15.78:0/92999980 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd80c0c65f0 msgr2=0x7fd7fc0047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:01:14.773 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:14.765+0000 7fd810d94640 1 --2- 172.21.15.78:0/92999980 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd80c0c65f0 0x7fd7fc0047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:14.773 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:14.765+0000 7fd810d94640 1 -- 172.21.15.78:0/92999980 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd7fc004d10 msgr2=0x7fd7fc005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:01:14.774 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:14.765+0000 7fd810d94640 1 --2- 172.21.15.78:0/92999980 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd7fc004d10 0x7fd7fc005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:14.774 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:14.765+0000 7fd810d94640 1 -- 172.21.15.78:0/92999980 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7fc003530 con 0x7fd7fc0039b0 2023-11-28T20:01:14.774 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:14.765+0000 7fd811595640 1 --2- 172.21.15.78:0/92999980 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd7fc004d10 0x7fd7fc005190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T20:01:14.775 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:14.769+0000 7fd810d94640 1 --2- 172.21.15.78:0/92999980 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd7fc0039b0 0x7fd7fc003dd0 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7fd800009ae0 tx=0x7fd80001c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=29f65877b07b6762 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:01:14.775 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:14.769+0000 7fd80b7fe640 1 -- 172.21.15.78:0/92999980 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8000a5550 con 0x7fd7fc0039b0 2023-11-28T20:01:14.775 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:14.769+0000 7fd80b7fe640 1 -- 172.21.15.78:0/92999980 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd8000a56b0 con 0x7fd7fc0039b0 2023-11-28T20:01:14.775 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:14.769+0000 7fd80b7fe640 1 -- 172.21.15.78:0/92999980 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8000a5a60 con 0x7fd7fc0039b0 2023-11-28T20:01:14.775 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:14.769+0000 7fd811d96640 1 -- 172.21.15.78:0/92999980 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd7fc0039b0 msgr2=0x7fd7fc003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:01:14.775 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:14.769+0000 7fd811d96640 1 --2- 172.21.15.78:0/92999980 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd7fc0039b0 0x7fd7fc003dd0 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7fd800009ae0 tx=0x7fd80001c960 comp rx=0 tx=0).stop 2023-11-28T20:01:14.775 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:14.769+0000 7fd811595640 1 -- 172.21.15.78:0/92999980 reap_dead start 2023-11-28T20:01:14.775 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:14.769+0000 7fd811d96640 1 -- 172.21.15.78:0/92999980 shutdown_connections 2023-11-28T20:01:14.776 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:14.769+0000 7fd811d96640 1 -- 172.21.15.78:0/92999980 >> 172.21.15.78:0/92999980 conn(0x7fd80c0ab730 msgr2=0x7fd80c0abb40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:01:14.776 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:14.769+0000 7fd811d96640 1 -- 172.21.15.78:0/92999980 shutdown_connections 2023-11-28T20:01:14.776 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:14.769+0000 7fd811d96640 1 -- 172.21.15.78:0/92999980 wait complete. 2023-11-28T20:01:14.776 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:14.773+0000 7fd811d96640 1 Processor -- start 2023-11-28T20:01:14.776 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:14.773+0000 7fd811d96640 1 -- start start 2023-11-28T20:01:14.779 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:14.773+0000 7fd811d96640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd7fc0039b0 0x7fd80c1499a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:14.779 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:14.773+0000 7fd811d96640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd80c1f04e0 0x7fd80c1f0960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:14.779 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:14.773+0000 7fd811d96640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd80c14a6a0 0x7fd80c14ab20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:14.779 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:14.773+0000 7fd811d96640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd80c0af700 con 0x7fd7fc0039b0 2023-11-28T20:01:14.779 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:14.773+0000 7fd811d96640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd80c14a210 con 0x7fd80c14a6a0 2023-11-28T20:01:14.779 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:14.773+0000 7fd811d96640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd80c14b7e0 con 0x7fd80c1f04e0 2023-11-28T20:01:14.779 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:14.773+0000 7fd810d94640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd7fc0039b0 0x7fd80c1499a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:14.779 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:14.773+0000 7fd810d94640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd7fc0039b0 0x7fd80c1499a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:56006/0 (socket says 172.21.15.78:56006) 2023-11-28T20:01:14.779 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:14.773+0000 7fd810d94640 1 -- 172.21.15.78:0/2734943128 learned_addr learned my addr 172.21.15.78:0/2734943128 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T20:01:14.779 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:14.773+0000 7fd811595640 1 --2- 172.21.15.78:0/2734943128 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd80c14a6a0 0x7fd80c14ab20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:14.780 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:14.773+0000 7fd810d94640 1 -- 172.21.15.78:0/2734943128 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd80c1f04e0 msgr2=0x7fd80c1f0960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:01:14.780 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:14.773+0000 7fd80bfff640 1 --2- 172.21.15.78:0/2734943128 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd80c1f04e0 0x7fd80c1f0960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:14.780 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:14.773+0000 7fd810d94640 1 --2- 172.21.15.78:0/2734943128 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd80c1f04e0 0x7fd80c1f0960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:14.780 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:14.773+0000 7fd810d94640 1 -- 172.21.15.78:0/2734943128 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd80c14a6a0 msgr2=0x7fd80c14ab20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:01:14.780 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:14.773+0000 7fd810d94640 1 --2- 172.21.15.78:0/2734943128 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd80c14a6a0 0x7fd80c14ab20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:14.780 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:14.773+0000 7fd810d94640 1 -- 172.21.15.78:0/2734943128 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd80c1f0ea0 con 0x7fd7fc0039b0 2023-11-28T20:01:14.780 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:14.773+0000 7fd811595640 1 --2- 172.21.15.78:0/2734943128 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd80c14a6a0 0x7fd80c14ab20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T20:01:14.781 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:14.773+0000 7fd810d94640 1 --2- 172.21.15.78:0/2734943128 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd7fc0039b0 0x7fd80c1499a0 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7fd80001c790 tx=0x7fd7fc005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:01:14.781 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:14.773+0000 7fd8097fa640 1 -- 172.21.15.78:0/2734943128 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8000bc070 con 0x7fd7fc0039b0 2023-11-28T20:01:14.781 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:14.773+0000 7fd8097fa640 1 -- 172.21.15.78:0/2734943128 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd800004020 con 0x7fd7fc0039b0 2023-11-28T20:01:14.781 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:14.773+0000 7fd811d96640 1 -- 172.21.15.78:0/2734943128 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd80c0ad1a0 con 0x7fd7fc0039b0 2023-11-28T20:01:14.781 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:14.773+0000 7fd8097fa640 1 -- 172.21.15.78:0/2734943128 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8000a5ea0 con 0x7fd7fc0039b0 2023-11-28T20:01:14.781 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:14.773+0000 7fd811d96640 1 -- 172.21.15.78:0/2734943128 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd80c0ad760 con 0x7fd7fc0039b0 2023-11-28T20:01:14.782 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:14.777+0000 7fd811d96640 1 -- 172.21.15.78:0/2734943128 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd80c0674b0 con 0x7fd7fc0039b0 2023-11-28T20:01:14.782 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:14.777+0000 7fd8097fa640 1 -- 172.21.15.78:0/2734943128 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fd8000b4040 con 0x7fd7fc0039b0 2023-11-28T20:01:14.782 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:14.777+0000 7fd8097fa640 1 --2- 172.21.15.78:0/2734943128 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fd7f0066470 0x7fd7f0068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:14.782 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:14.777+0000 7fd8097fa640 1 -- 172.21.15.78:0/2734943128 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 6029+0+0 (secure 0 0 0) 0x7fd80011db10 con 0x7fd7fc0039b0 2023-11-28T20:01:14.782 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:14.777+0000 7fd80bfff640 1 --2- 172.21.15.78:0/2734943128 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fd7f0066470 0x7fd7f0068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:14.783 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:14.777+0000 7fd80bfff640 1 --2- 172.21.15.78:0/2734943128 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fd7f0066470 0x7fd7f0068930 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7fd80c06cc10 tx=0x7fd7f8009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:01:14.785 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:14.781+0000 7fd8097fa640 1 -- 172.21.15.78:0/2734943128 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fd8000eaee0 con 0x7fd7fc0039b0 2023-11-28T20:01:14.932 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:14.929+0000 7fd811d96640 1 -- 172.21.15.78:0/2734943128 --> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fd80c155290 con 0x7fd7f0066470 2023-11-28T20:01:14.940 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:14.937+0000 7fd8097fa640 1 -- 172.21.15.78:0/2734943128 <== mgr.4106 v2:172.21.15.78:6832/2935380957 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+289084 (secure 0 0 0) 0x7fd7f8001b30 con 0x7fd7f0066470 2023-11-28T20:01:14.943 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-11-28T20:01:14.944 INFO:teuthology.orchestra.run.smithi078.stderr:dumped all 2023-11-28T20:01:14.945 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:14.937+0000 7fd811d96640 1 -- 172.21.15.78:0/2734943128 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fd7f0066470 msgr2=0x7fd7f0068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:01:14.946 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:14.937+0000 7fd811d96640 1 --2- 172.21.15.78:0/2734943128 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fd7f0066470 0x7fd7f0068930 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7fd80c06cc10 tx=0x7fd7f8009040 comp rx=0 tx=0).stop 2023-11-28T20:01:14.946 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:14.937+0000 7fd811d96640 1 -- 172.21.15.78:0/2734943128 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd7fc0039b0 msgr2=0x7fd80c1499a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:01:14.946 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:14.937+0000 7fd811d96640 1 --2- 172.21.15.78:0/2734943128 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd7fc0039b0 0x7fd80c1499a0 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7fd80001c790 tx=0x7fd7fc005800 comp rx=0 tx=0).stop 2023-11-28T20:01:14.946 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:14.941+0000 7fd811d96640 1 -- 172.21.15.78:0/2734943128 shutdown_connections 2023-11-28T20:01:14.946 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:14.941+0000 7fd811d96640 1 --2- 172.21.15.78:0/2734943128 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fd7f0066470 0x7fd7f0068930 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:14.946 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:14.941+0000 7fd811d96640 1 --2- 172.21.15.78:0/2734943128 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd80c1f04e0 0x7fd80c1f0960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:14.946 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:14.941+0000 7fd811d96640 1 --2- 172.21.15.78:0/2734943128 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd80c14a6a0 0x7fd80c14ab20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:14.946 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:14.941+0000 7fd811d96640 1 --2- 172.21.15.78:0/2734943128 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd7fc0039b0 0x7fd80c1499a0 unknown :-1 s=CLOSED pgs=640 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:14.946 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:14.941+0000 7fd811d96640 1 -- 172.21.15.78:0/2734943128 >> 172.21.15.78:0/2734943128 conn(0x7fd80c0ab730 msgr2=0x7fd80c152d40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:01:14.946 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:14.941+0000 7fd811d96640 1 -- 172.21.15.78:0/2734943128 shutdown_connections 2023-11-28T20:01:14.946 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:14.941+0000 7fd811d96640 1 -- 172.21.15.78:0/2734943128 wait complete. 2023-11-28T20:01:14.963 INFO:teuthology.orchestra.run.smithi078.stdout:{"pg_ready":true,"pg_map":{"version":125,"stamp":"2023-11-28T20:01:13.980359+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":135,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":226272,"kb_used_data":5904,"kb_used_omap":12,"kb_used_meta":220211,"kb_avail":754748448,"statfs":{"total":773094113280,"available":772862410752,"internally_reserved":0,"allocated":6045696,"data_stored":3860780,"data_compressed":66748,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":12752,"internal_metadata":225496624},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":41,"apply_latency_ms":41,"commit_latency_ns":41000000,"apply_latency_ns":41000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.498939"},"pg_stats":[{"pgid":"10.3f","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-28T20:01:12.965969+0000","last_change":"2023-11-28T20:01:10.539211+0000","last_active":"2023-11-28T20:01:12.965969+0000","last_peered":"2023-11-28T20:01:12.965969+0000","last_clean":"2023-11-28T20:01:12.965969+0000","last_became_active":"2023-11-28T20:01:10.538932+0000","last_became_peered":"2023-11-28T20:01:10.538932+0000","last_unstale":"2023-11-28T20:01:12.965969+0000","last_undegraded":"2023-11-28T20:01:12.965969+0000","last_fullsized":"2023-11-28T20:01:12.965969+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_clean_scrub_stamp":"2023-11-28T20:01:09.480611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:10:00.034946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.3e","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-28T20:01:12.965824+0000","last_change":"2023-11-28T20:01:10.522069+0000","last_active":"2023-11-28T20:01:12.965824+0000","last_peered":"2023-11-28T20:01:12.965824+0000","last_clean":"2023-11-28T20:01:12.965824+0000","last_became_active":"2023-11-28T20:01:10.521785+0000","last_became_peered":"2023-11-28T20:01:10.521785+0000","last_unstale":"2023-11-28T20:01:12.965824+0000","last_undegraded":"2023-11-28T20:01:12.965824+0000","last_fullsized":"2023-11-28T20:01:12.965824+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_clean_scrub_stamp":"2023-11-28T20:01:09.480611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:00:30.789993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.3d","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-28T20:01:12.967554+0000","last_change":"2023-11-28T20:01:10.538353+0000","last_active":"2023-11-28T20:01:12.967554+0000","last_peered":"2023-11-28T20:01:12.967554+0000","last_clean":"2023-11-28T20:01:12.967554+0000","last_became_active":"2023-11-28T20:01:10.537756+0000","last_became_peered":"2023-11-28T20:01:10.537756+0000","last_unstale":"2023-11-28T20:01:12.967554+0000","last_undegraded":"2023-11-28T20:01:12.967554+0000","last_fullsized":"2023-11-28T20:01:12.967554+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_clean_scrub_stamp":"2023-11-28T20:01:09.480611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T06:29:13.579326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.3c","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-28T20:01:11.523945+0000","last_change":"2023-11-28T20:01:10.523152+0000","last_active":"2023-11-28T20:01:11.523945+0000","last_peered":"2023-11-28T20:01:11.523945+0000","last_clean":"2023-11-28T20:01:11.523945+0000","last_became_active":"2023-11-28T20:01:10.522874+0000","last_became_peered":"2023-11-28T20:01:10.522874+0000","last_unstale":"2023-11-28T20:01:11.523945+0000","last_undegraded":"2023-11-28T20:01:11.523945+0000","last_fullsized":"2023-11-28T20:01:11.523945+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_clean_scrub_stamp":"2023-11-28T20:01:09.480611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:56:55.097917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.3b","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-28T20:01:12.966950+0000","last_change":"2023-11-28T20:01:10.529938+0000","last_active":"2023-11-28T20:01:12.966950+0000","last_peered":"2023-11-28T20:01:12.966950+0000","last_clean":"2023-11-28T20:01:12.966950+0000","last_became_active":"2023-11-28T20:01:10.529188+0000","last_became_peered":"2023-11-28T20:01:10.529188+0000","last_unstale":"2023-11-28T20:01:12.966950+0000","last_undegraded":"2023-11-28T20:01:12.966950+0000","last_fullsized":"2023-11-28T20:01:12.966950+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_clean_scrub_stamp":"2023-11-28T20:01:09.480611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:47:13.274500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.3a","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-28T20:01:12.535549+0000","last_change":"2023-11-28T20:01:10.531000+0000","last_active":"2023-11-28T20:01:12.535549+0000","last_peered":"2023-11-28T20:01:12.535549+0000","last_clean":"2023-11-28T20:01:12.535549+0000","last_became_active":"2023-11-28T20:01:10.530754+0000","last_became_peered":"2023-11-28T20:01:10.530754+0000","last_unstale":"2023-11-28T20:01:12.535549+0000","last_undegraded":"2023-11-28T20:01:12.535549+0000","last_fullsized":"2023-11-28T20:01:12.535549+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_clean_scrub_stamp":"2023-11-28T20:01:09.480611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:44:34.399373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.39","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-28T20:01:11.521505+0000","last_change":"2023-11-28T20:01:10.535113+0000","last_active":"2023-11-28T20:01:11.521505+0000","last_peered":"2023-11-28T20:01:11.521505+0000","last_clean":"2023-11-28T20:01:11.521505+0000","last_became_active":"2023-11-28T20:01:10.534919+0000","last_became_peered":"2023-11-28T20:01:10.534919+0000","last_unstale":"2023-11-28T20:01:11.521505+0000","last_undegraded":"2023-11-28T20:01:11.521505+0000","last_fullsized":"2023-11-28T20:01:11.521505+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_clean_scrub_stamp":"2023-11-28T20:01:09.480611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:00:31.915592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.38","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-28T20:01:11.523432+0000","last_change":"2023-11-28T20:01:10.538054+0000","last_active":"2023-11-28T20:01:11.523432+0000","last_peered":"2023-11-28T20:01:11.523432+0000","last_clean":"2023-11-28T20:01:11.523432+0000","last_became_active":"2023-11-28T20:01:10.535363+0000","last_became_peered":"2023-11-28T20:01:10.535363+0000","last_unstale":"2023-11-28T20:01:11.523432+0000","last_undegraded":"2023-11-28T20:01:11.523432+0000","last_fullsized":"2023-11-28T20:01:11.523432+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_clean_scrub_stamp":"2023-11-28T20:01:09.480611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:06:36.994816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.37","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-28T20:01:12.967542+0000","last_change":"2023-11-28T20:01:10.543027+0000","last_active":"2023-11-28T20:01:12.967542+0000","last_peered":"2023-11-28T20:01:12.967542+0000","last_clean":"2023-11-28T20:01:12.967542+0000","last_became_active":"2023-11-28T20:01:10.541632+0000","last_became_peered":"2023-11-28T20:01:10.541632+0000","last_unstale":"2023-11-28T20:01:12.967542+0000","last_undegraded":"2023-11-28T20:01:12.967542+0000","last_fullsized":"2023-11-28T20:01:12.967542+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_clean_scrub_stamp":"2023-11-28T20:01:09.480611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:46:29.701039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.36","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-28T20:01:12.967814+0000","last_change":"2023-11-28T20:01:10.541712+0000","last_active":"2023-11-28T20:01:12.967814+0000","last_peered":"2023-11-28T20:01:12.967814+0000","last_clean":"2023-11-28T20:01:12.967814+0000","last_became_active":"2023-11-28T20:01:10.541389+0000","last_became_peered":"2023-11-28T20:01:10.541389+0000","last_unstale":"2023-11-28T20:01:12.967814+0000","last_undegraded":"2023-11-28T20:01:12.967814+0000","last_fullsized":"2023-11-28T20:01:12.967814+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_clean_scrub_stamp":"2023-11-28T20:01:09.480611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:54:30.269337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.35","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-28T20:01:11.524022+0000","last_change":"2023-11-28T20:01:10.520251+0000","last_active":"2023-11-28T20:01:11.524022+0000","last_peered":"2023-11-28T20:01:11.524022+0000","last_clean":"2023-11-28T20:01:11.524022+0000","last_became_active":"2023-11-28T20:01:10.519957+0000","last_became_peered":"2023-11-28T20:01:10.519957+0000","last_unstale":"2023-11-28T20:01:11.524022+0000","last_undegraded":"2023-11-28T20:01:11.524022+0000","last_fullsized":"2023-11-28T20:01:11.524022+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_clean_scrub_stamp":"2023-11-28T20:01:09.480611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:33:17.345518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.34","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-28T20:01:11.523926+0000","last_change":"2023-11-28T20:01:10.535199+0000","last_active":"2023-11-28T20:01:11.523926+0000","last_peered":"2023-11-28T20:01:11.523926+0000","last_clean":"2023-11-28T20:01:11.523926+0000","last_became_active":"2023-11-28T20:01:10.534856+0000","last_became_peered":"2023-11-28T20:01:10.534856+0000","last_unstale":"2023-11-28T20:01:11.523926+0000","last_undegraded":"2023-11-28T20:01:11.523926+0000","last_fullsized":"2023-11-28T20:01:11.523926+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_clean_scrub_stamp":"2023-11-28T20:01:09.480611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:07:03.844567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.33","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-28T20:01:11.523885+0000","last_change":"2023-11-28T20:01:10.529868+0000","last_active":"2023-11-28T20:01:11.523885+0000","last_peered":"2023-11-28T20:01:11.523885+0000","last_clean":"2023-11-28T20:01:11.523885+0000","last_became_active":"2023-11-28T20:01:10.529582+0000","last_became_peered":"2023-11-28T20:01:10.529582+0000","last_unstale":"2023-11-28T20:01:11.523885+0000","last_undegraded":"2023-11-28T20:01:11.523885+0000","last_fullsized":"2023-11-28T20:01:11.523885+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_clean_scrub_stamp":"2023-11-28T20:01:09.480611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T07:14:21.836133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.32","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-28T20:01:12.967741+0000","last_change":"2023-11-28T20:01:10.546075+0000","last_active":"2023-11-28T20:01:12.967741+0000","last_peered":"2023-11-28T20:01:12.967741+0000","last_clean":"2023-11-28T20:01:12.967741+0000","last_became_active":"2023-11-28T20:01:10.542038+0000","last_became_peered":"2023-11-28T20:01:10.542038+0000","last_unstale":"2023-11-28T20:01:12.967741+0000","last_undegraded":"2023-11-28T20:01:12.967741+0000","last_fullsized":"2023-11-28T20:01:12.967741+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_clean_scrub_stamp":"2023-11-28T20:01:09.480611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:44:34.399373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.31","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-28T20:01:12.967127+0000","last_change":"2023-11-28T20:01:10.535170+0000","last_active":"2023-11-28T20:01:12.967127+0000","last_peered":"2023-11-28T20:01:12.967127+0000","last_clean":"2023-11-28T20:01:12.967127+0000","last_became_active":"2023-11-28T20:01:10.534881+0000","last_became_peered":"2023-11-28T20:01:10.534881+0000","last_unstale":"2023-11-28T20:01:12.967127+0000","last_undegraded":"2023-11-28T20:01:12.967127+0000","last_fullsized":"2023-11-28T20:01:12.967127+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_clean_scrub_stamp":"2023-11-28T20:01:09.480611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:07:03.844567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.30","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-28T20:01:11.521440+0000","last_change":"2023-11-28T20:01:10.530998+0000","last_active":"2023-11-28T20:01:11.521440+0000","last_peered":"2023-11-28T20:01:11.521440+0000","last_clean":"2023-11-28T20:01:11.521440+0000","last_became_active":"2023-11-28T20:01:10.530709+0000","last_became_peered":"2023-11-28T20:01:10.530709+0000","last_unstale":"2023-11-28T20:01:11.521440+0000","last_undegraded":"2023-11-28T20:01:11.521440+0000","last_fullsized":"2023-11-28T20:01:11.521440+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_clean_scrub_stamp":"2023-11-28T20:01:09.480611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:11:53.891113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.2f","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-28T20:01:12.965984+0000","last_change":"2023-11-28T20:01:10.522350+0000","last_active":"2023-11-28T20:01:12.965984+0000","last_peered":"2023-11-28T20:01:12.965984+0000","last_clean":"2023-11-28T20:01:12.965984+0000","last_became_active":"2023-11-28T20:01:10.522075+0000","last_became_peered":"2023-11-28T20:01:10.522075+0000","last_unstale":"2023-11-28T20:01:12.965984+0000","last_undegraded":"2023-11-28T20:01:12.965984+0000","last_fullsized":"2023-11-28T20:01:12.965984+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_clean_scrub_stamp":"2023-11-28T20:01:09.480611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:18:49.627041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.2e","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-28T20:01:11.523447+0000","last_change":"2023-11-28T20:01:10.521611+0000","last_active":"2023-11-28T20:01:11.523447+0000","last_peered":"2023-11-28T20:01:11.523447+0000","last_clean":"2023-11-28T20:01:11.523447+0000","last_became_active":"2023-11-28T20:01:10.521162+0000","last_became_peered":"2023-11-28T20:01:10.521162+0000","last_unstale":"2023-11-28T20:01:11.523447+0000","last_undegraded":"2023-11-28T20:01:11.523447+0000","last_fullsized":"2023-11-28T20:01:11.523447+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_clean_scrub_stamp":"2023-11-28T20:01:09.480611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:04:56.486213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.2d","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-28T20:01:12.967004+0000","last_change":"2023-11-28T20:01:10.526160+0000","last_active":"2023-11-28T20:01:12.967004+0000","last_peered":"2023-11-28T20:01:12.967004+0000","last_clean":"2023-11-28T20:01:12.967004+0000","last_became_active":"2023-11-28T20:01:10.525887+0000","last_became_peered":"2023-11-28T20:01:10.525887+0000","last_unstale":"2023-11-28T20:01:12.967004+0000","last_undegraded":"2023-11-28T20:01:12.967004+0000","last_fullsized":"2023-11-28T20:01:12.967004+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_clean_scrub_stamp":"2023-11-28T20:01:09.480611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:49:02.557281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.2c","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-28T20:01:12.966157+0000","last_change":"2023-11-28T20:01:10.534338+0000","last_active":"2023-11-28T20:01:12.966157+0000","last_peered":"2023-11-28T20:01:12.966157+0000","last_clean":"2023-11-28T20:01:12.966157+0000","last_became_active":"2023-11-28T20:01:10.532397+0000","last_became_peered":"2023-11-28T20:01:10.532397+0000","last_unstale":"2023-11-28T20:01:12.966157+0000","last_undegraded":"2023-11-28T20:01:12.966157+0000","last_fullsized":"2023-11-28T20:01:12.966157+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_clean_scrub_stamp":"2023-11-28T20:01:09.480611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:51:36.724540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.2b","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-28T20:01:11.523960+0000","last_change":"2023-11-28T20:01:10.528780+0000","last_active":"2023-11-28T20:01:11.523960+0000","last_peered":"2023-11-28T20:01:11.523960+0000","last_clean":"2023-11-28T20:01:11.523960+0000","last_became_active":"2023-11-28T20:01:10.524555+0000","last_became_peered":"2023-11-28T20:01:10.524555+0000","last_unstale":"2023-11-28T20:01:11.523960+0000","last_undegraded":"2023-11-28T20:01:11.523960+0000","last_fullsized":"2023-11-28T20:01:11.523960+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_clean_scrub_stamp":"2023-11-28T20:01:09.480611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:30:22.791908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.2a","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-28T20:01:12.965449+0000","last_change":"2023-11-28T20:01:10.531958+0000","last_active":"2023-11-28T20:01:12.965449+0000","last_peered":"2023-11-28T20:01:12.965449+0000","last_clean":"2023-11-28T20:01:12.965449+0000","last_became_active":"2023-11-28T20:01:10.531111+0000","last_became_peered":"2023-11-28T20:01:10.531111+0000","last_unstale":"2023-11-28T20:01:12.965449+0000","last_undegraded":"2023-11-28T20:01:12.965449+0000","last_fullsized":"2023-11-28T20:01:12.965449+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_clean_scrub_stamp":"2023-11-28T20:01:09.480611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:52:31.642868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.29","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-28T20:01:12.965285+0000","last_change":"2023-11-28T20:01:10.533367+0000","last_active":"2023-11-28T20:01:12.965285+0000","last_peered":"2023-11-28T20:01:12.965285+0000","last_clean":"2023-11-28T20:01:12.965285+0000","last_became_active":"2023-11-28T20:01:10.532975+0000","last_became_peered":"2023-11-28T20:01:10.532975+0000","last_unstale":"2023-11-28T20:01:12.965285+0000","last_undegraded":"2023-11-28T20:01:12.965285+0000","last_fullsized":"2023-11-28T20:01:12.965285+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_clean_scrub_stamp":"2023-11-28T20:01:09.480611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:10:30.393696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.28","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-28T20:01:12.966588+0000","last_change":"2023-11-28T20:01:10.541445+0000","last_active":"2023-11-28T20:01:12.966588+0000","last_peered":"2023-11-28T20:01:12.966588+0000","last_clean":"2023-11-28T20:01:12.966588+0000","last_became_active":"2023-11-28T20:01:10.539375+0000","last_became_peered":"2023-11-28T20:01:10.539375+0000","last_unstale":"2023-11-28T20:01:12.966588+0000","last_undegraded":"2023-11-28T20:01:12.966588+0000","last_fullsized":"2023-11-28T20:01:12.966588+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_clean_scrub_stamp":"2023-11-28T20:01:09.480611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T07:14:21.836133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.27","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-28T20:01:11.524805+0000","last_change":"2023-11-28T20:01:10.531718+0000","last_active":"2023-11-28T20:01:11.524805+0000","last_peered":"2023-11-28T20:01:11.524805+0000","last_clean":"2023-11-28T20:01:11.524805+0000","last_became_active":"2023-11-28T20:01:10.529424+0000","last_became_peered":"2023-11-28T20:01:10.529424+0000","last_unstale":"2023-11-28T20:01:11.524805+0000","last_undegraded":"2023-11-28T20:01:11.524805+0000","last_fullsized":"2023-11-28T20:01:11.524805+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_clean_scrub_stamp":"2023-11-28T20:01:09.480611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:17:27.097887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.26","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-28T20:01:11.524184+0000","last_change":"2023-11-28T20:01:10.530284+0000","last_active":"2023-11-28T20:01:11.524184+0000","last_peered":"2023-11-28T20:01:11.524184+0000","last_clean":"2023-11-28T20:01:11.524184+0000","last_became_active":"2023-11-28T20:01:10.529805+0000","last_became_peered":"2023-11-28T20:01:10.529805+0000","last_unstale":"2023-11-28T20:01:11.524184+0000","last_undegraded":"2023-11-28T20:01:11.524184+0000","last_fullsized":"2023-11-28T20:01:11.524184+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_clean_scrub_stamp":"2023-11-28T20:01:09.480611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:46:29.701039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.25","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-28T20:01:11.524110+0000","last_change":"2023-11-28T20:01:10.519186+0000","last_active":"2023-11-28T20:01:11.524110+0000","last_peered":"2023-11-28T20:01:11.524110+0000","last_clean":"2023-11-28T20:01:11.524110+0000","last_became_active":"2023-11-28T20:01:10.518855+0000","last_became_peered":"2023-11-28T20:01:10.518855+0000","last_unstale":"2023-11-28T20:01:11.524110+0000","last_undegraded":"2023-11-28T20:01:11.524110+0000","last_fullsized":"2023-11-28T20:01:11.524110+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_clean_scrub_stamp":"2023-11-28T20:01:09.480611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:23:19.215371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.24","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-28T20:01:12.965681+0000","last_change":"2023-11-28T20:01:10.537687+0000","last_active":"2023-11-28T20:01:12.965681+0000","last_peered":"2023-11-28T20:01:12.965681+0000","last_clean":"2023-11-28T20:01:12.965681+0000","last_became_active":"2023-11-28T20:01:10.536233+0000","last_became_peered":"2023-11-28T20:01:10.536233+0000","last_unstale":"2023-11-28T20:01:12.965681+0000","last_undegraded":"2023-11-28T20:01:12.965681+0000","last_fullsized":"2023-11-28T20:01:12.965681+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_clean_scrub_stamp":"2023-11-28T20:01:09.480611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:18:17.108795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.23","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-28T20:01:12.967371+0000","last_change":"2023-11-28T20:01:10.534726+0000","last_active":"2023-11-28T20:01:12.967371+0000","last_peered":"2023-11-28T20:01:12.967371+0000","last_clean":"2023-11-28T20:01:12.967371+0000","last_became_active":"2023-11-28T20:01:10.534413+0000","last_became_peered":"2023-11-28T20:01:10.534413+0000","last_unstale":"2023-11-28T20:01:12.967371+0000","last_undegraded":"2023-11-28T20:01:12.967371+0000","last_fullsized":"2023-11-28T20:01:12.967371+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_clean_scrub_stamp":"2023-11-28T20:01:09.480611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:30:22.791908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.22","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-28T20:01:11.524788+0000","last_change":"2023-11-28T20:01:10.534050+0000","last_active":"2023-11-28T20:01:11.524788+0000","last_peered":"2023-11-28T20:01:11.524788+0000","last_clean":"2023-11-28T20:01:11.524788+0000","last_became_active":"2023-11-28T20:01:10.533704+0000","last_became_peered":"2023-11-28T20:01:10.533704+0000","last_unstale":"2023-11-28T20:01:11.524788+0000","last_undegraded":"2023-11-28T20:01:11.524788+0000","last_fullsized":"2023-11-28T20:01:11.524788+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_clean_scrub_stamp":"2023-11-28T20:01:09.480611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:50:58.589965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.21","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-28T20:01:11.523255+0000","last_change":"2023-11-28T20:01:10.520311+0000","last_active":"2023-11-28T20:01:11.523255+0000","last_peered":"2023-11-28T20:01:11.523255+0000","last_clean":"2023-11-28T20:01:11.523255+0000","last_became_active":"2023-11-28T20:01:10.519974+0000","last_became_peered":"2023-11-28T20:01:10.519974+0000","last_unstale":"2023-11-28T20:01:11.523255+0000","last_undegraded":"2023-11-28T20:01:11.523255+0000","last_fullsized":"2023-11-28T20:01:11.523255+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_clean_scrub_stamp":"2023-11-28T20:01:09.480611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T07:02:13.895402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.20","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-28T20:01:12.535244+0000","last_change":"2023-11-28T20:01:10.525223+0000","last_active":"2023-11-28T20:01:12.535244+0000","last_peered":"2023-11-28T20:01:12.535244+0000","last_clean":"2023-11-28T20:01:12.535244+0000","last_became_active":"2023-11-28T20:01:10.524750+0000","last_became_peered":"2023-11-28T20:01:10.524750+0000","last_unstale":"2023-11-28T20:01:12.535244+0000","last_undegraded":"2023-11-28T20:01:12.535244+0000","last_fullsized":"2023-11-28T20:01:12.535244+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_clean_scrub_stamp":"2023-11-28T20:01:09.480611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:50:58.589965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1c","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-28T20:01:12.966825+0000","last_change":"2023-11-28T20:01:10.528869+0000","last_active":"2023-11-28T20:01:12.966825+0000","last_peered":"2023-11-28T20:01:12.966825+0000","last_clean":"2023-11-28T20:01:12.966825+0000","last_became_active":"2023-11-28T20:01:10.528572+0000","last_became_peered":"2023-11-28T20:01:10.528572+0000","last_unstale":"2023-11-28T20:01:12.966825+0000","last_undegraded":"2023-11-28T20:01:12.966825+0000","last_fullsized":"2023-11-28T20:01:12.966825+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_clean_scrub_stamp":"2023-11-28T20:01:09.480611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:37:17.516298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.1f","version":"60'4","reported_seq":16,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-28T20:01:12.966133+0000","last_change":"2023-11-28T20:01:09.512544+0000","last_active":"2023-11-28T20:01:12.966133+0000","last_peered":"2023-11-28T20:01:12.966133+0000","last_clean":"2023-11-28T20:01:12.966133+0000","last_became_active":"2023-11-28T20:01:09.512197+0000","last_became_peered":"2023-11-28T20:01:09.512197+0000","last_unstale":"2023-11-28T20:01:12.966133+0000","last_undegraded":"2023-11-28T20:01:12.966133+0000","last_fullsized":"2023-11-28T20:01:12.966133+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:08.474257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:08.474257+0000","last_clean_scrub_stamp":"2023-11-28T20:01:08.474257+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:49:01.550926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.1d","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-28T20:01:11.524170+0000","last_change":"2023-11-28T20:01:10.528270+0000","last_active":"2023-11-28T20:01:11.524170+0000","last_peered":"2023-11-28T20:01:11.524170+0000","last_clean":"2023-11-28T20:01:11.524170+0000","last_became_active":"2023-11-28T20:01:10.527932+0000","last_became_peered":"2023-11-28T20:01:10.527932+0000","last_unstale":"2023-11-28T20:01:11.524170+0000","last_undegraded":"2023-11-28T20:01:11.524170+0000","last_fullsized":"2023-11-28T20:01:11.524170+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_clean_scrub_stamp":"2023-11-28T20:01:09.480611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T07:21:45.278688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1e","version":"60'1","reported_seq":13,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-28T20:01:12.536090+0000","last_change":"2023-11-28T20:01:09.516140+0000","last_active":"2023-11-28T20:01:12.536090+0000","last_peered":"2023-11-28T20:01:12.536090+0000","last_clean":"2023-11-28T20:01:12.536090+0000","last_became_active":"2023-11-28T20:01:09.514007+0000","last_became_peered":"2023-11-28T20:01:09.514007+0000","last_unstale":"2023-11-28T20:01:12.536090+0000","last_undegraded":"2023-11-28T20:01:12.536090+0000","last_fullsized":"2023-11-28T20:01:12.536090+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:08.474257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:08.474257+0000","last_clean_scrub_stamp":"2023-11-28T20:01:08.474257+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:30:21.785554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1e","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-28T20:01:12.536078+0000","last_change":"2023-11-28T20:01:10.526680+0000","last_active":"2023-11-28T20:01:12.536078+0000","last_peered":"2023-11-28T20:01:12.536078+0000","last_clean":"2023-11-28T20:01:12.536078+0000","last_became_active":"2023-11-28T20:01:10.526366+0000","last_became_peered":"2023-11-28T20:01:10.526366+0000","last_unstale":"2023-11-28T20:01:12.536078+0000","last_undegraded":"2023-11-28T20:01:12.536078+0000","last_fullsized":"2023-11-28T20:01:12.536078+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_clean_scrub_stamp":"2023-11-28T20:01:09.480611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:05:54.478424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1d","version":"60'2","reported_seq":14,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-28T20:01:12.535892+0000","last_change":"2023-11-28T20:01:09.510600+0000","last_active":"2023-11-28T20:01:12.535892+0000","last_peered":"2023-11-28T20:01:12.535892+0000","last_clean":"2023-11-28T20:01:12.535892+0000","last_became_active":"2023-11-28T20:01:09.510336+0000","last_became_peered":"2023-11-28T20:01:09.510336+0000","last_unstale":"2023-11-28T20:01:12.535892+0000","last_undegraded":"2023-11-28T20:01:12.535892+0000","last_fullsized":"2023-11-28T20:01:12.535892+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:08.474257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:08.474257+0000","last_clean_scrub_stamp":"2023-11-28T20:01:08.474257+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:56:14.988591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1f","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-28T20:01:12.967655+0000","last_change":"2023-11-28T20:01:10.541960+0000","last_active":"2023-11-28T20:01:12.967655+0000","last_peered":"2023-11-28T20:01:12.967655+0000","last_clean":"2023-11-28T20:01:12.967655+0000","last_became_active":"2023-11-28T20:01:10.541305+0000","last_became_peered":"2023-11-28T20:01:10.541305+0000","last_unstale":"2023-11-28T20:01:12.967655+0000","last_undegraded":"2023-11-28T20:01:12.967655+0000","last_fullsized":"2023-11-28T20:01:12.967655+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_clean_scrub_stamp":"2023-11-28T20:01:09.480611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:17:27.097887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.1c","version":"60'2","reported_seq":14,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-28T20:01:12.535798+0000","last_change":"2023-11-28T20:01:09.507988+0000","last_active":"2023-11-28T20:01:12.535798+0000","last_peered":"2023-11-28T20:01:12.535798+0000","last_clean":"2023-11-28T20:01:12.535798+0000","last_became_active":"2023-11-28T20:01:09.507762+0000","last_became_peered":"2023-11-28T20:01:09.507762+0000","last_unstale":"2023-11-28T20:01:12.535798+0000","last_undegraded":"2023-11-28T20:01:12.535798+0000","last_fullsized":"2023-11-28T20:01:12.535798+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:08.474257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:08.474257+0000","last_clean_scrub_stamp":"2023-11-28T20:01:08.474257+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T07:14:20.829778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-28T20:01:11.521536+0000","last_change":"2023-11-28T20:01:10.518032+0000","last_active":"2023-11-28T20:01:11.521536+0000","last_peered":"2023-11-28T20:01:11.521536+0000","last_clean":"2023-11-28T20:01:11.521536+0000","last_became_active":"2023-11-28T20:01:10.517780+0000","last_became_peered":"2023-11-28T20:01:10.517780+0000","last_unstale":"2023-11-28T20:01:11.521536+0000","last_undegraded":"2023-11-28T20:01:11.521536+0000","last_fullsized":"2023-11-28T20:01:11.521536+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_clean_scrub_stamp":"2023-11-28T20:01:09.480611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:43:39.118896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.1b","version":"60'1","reported_seq":13,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-28T20:01:12.965924+0000","last_change":"2023-11-28T20:01:09.514901+0000","last_active":"2023-11-28T20:01:12.965924+0000","last_peered":"2023-11-28T20:01:12.965924+0000","last_clean":"2023-11-28T20:01:12.965924+0000","last_became_active":"2023-11-28T20:01:09.514568+0000","last_became_peered":"2023-11-28T20:01:09.514568+0000","last_unstale":"2023-11-28T20:01:12.965924+0000","last_undegraded":"2023-11-28T20:01:12.965924+0000","last_fullsized":"2023-11-28T20:01:12.965924+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:08.474257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:08.474257+0000","last_clean_scrub_stamp":"2023-11-28T20:01:08.474257+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:44:33.393018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-28T20:01:12.965512+0000","last_change":"2023-11-28T20:01:10.522005+0000","last_active":"2023-11-28T20:01:12.965512+0000","last_peered":"2023-11-28T20:01:12.965512+0000","last_clean":"2023-11-28T20:01:12.965512+0000","last_became_active":"2023-11-28T20:01:10.521691+0000","last_became_peered":"2023-11-28T20:01:10.521691+0000","last_unstale":"2023-11-28T20:01:12.965512+0000","last_undegraded":"2023-11-28T20:01:12.965512+0000","last_fullsized":"2023-11-28T20:01:12.965512+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_clean_scrub_stamp":"2023-11-28T20:01:09.480611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:11:08.794514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1a","version":"60'1","reported_seq":13,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-28T20:01:12.965351+0000","last_change":"2023-11-28T20:01:09.510388+0000","last_active":"2023-11-28T20:01:12.965351+0000","last_peered":"2023-11-28T20:01:12.965351+0000","last_clean":"2023-11-28T20:01:12.965351+0000","last_became_active":"2023-11-28T20:01:09.510114+0000","last_became_peered":"2023-11-28T20:01:09.510114+0000","last_unstale":"2023-11-28T20:01:12.965351+0000","last_undegraded":"2023-11-28T20:01:12.965351+0000","last_fullsized":"2023-11-28T20:01:12.965351+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:08.474257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:08.474257+0000","last_clean_scrub_stamp":"2023-11-28T20:01:08.474257+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T06:29:12.572972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.1a","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-28T20:01:12.966791+0000","last_change":"2023-11-28T20:01:10.536831+0000","last_active":"2023-11-28T20:01:12.966791+0000","last_peered":"2023-11-28T20:01:12.966791+0000","last_clean":"2023-11-28T20:01:12.966791+0000","last_became_active":"2023-11-28T20:01:10.536506+0000","last_became_peered":"2023-11-28T20:01:10.536506+0000","last_unstale":"2023-11-28T20:01:12.966791+0000","last_undegraded":"2023-11-28T20:01:12.966791+0000","last_fullsized":"2023-11-28T20:01:12.966791+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_clean_scrub_stamp":"2023-11-28T20:01:09.480611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:29:39.856095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-28T20:01:12.965250+0000","last_change":"2023-11-28T20:01:09.514530+0000","last_active":"2023-11-28T20:01:12.965250+0000","last_peered":"2023-11-28T20:01:12.965250+0000","last_clean":"2023-11-28T20:01:12.965250+0000","last_became_active":"2023-11-28T20:01:09.514112+0000","last_became_peered":"2023-11-28T20:01:09.514112+0000","last_unstale":"2023-11-28T20:01:12.965250+0000","last_undegraded":"2023-11-28T20:01:12.965250+0000","last_fullsized":"2023-11-28T20:01:12.965250+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:08.474257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:08.474257+0000","last_clean_scrub_stamp":"2023-11-28T20:01:08.474257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:07:02.838212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.1b","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-28T20:01:12.965435+0000","last_change":"2023-11-28T20:01:10.522250+0000","last_active":"2023-11-28T20:01:12.965435+0000","last_peered":"2023-11-28T20:01:12.965435+0000","last_clean":"2023-11-28T20:01:12.965435+0000","last_became_active":"2023-11-28T20:01:10.521958+0000","last_became_peered":"2023-11-28T20:01:10.521958+0000","last_unstale":"2023-11-28T20:01:12.965435+0000","last_undegraded":"2023-11-28T20:01:12.965435+0000","last_fullsized":"2023-11-28T20:01:12.965435+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_clean_scrub_stamp":"2023-11-28T20:01:09.480611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:59:08.568724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-28T20:01:12.966531+0000","last_change":"2023-11-28T20:01:09.512078+0000","last_active":"2023-11-28T20:01:12.966531+0000","last_peered":"2023-11-28T20:01:12.966531+0000","last_clean":"2023-11-28T20:01:12.966531+0000","last_became_active":"2023-11-28T20:01:09.511733+0000","last_became_peered":"2023-11-28T20:01:09.511733+0000","last_unstale":"2023-11-28T20:01:12.966531+0000","last_undegraded":"2023-11-28T20:01:12.966531+0000","last_fullsized":"2023-11-28T20:01:12.966531+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:08.474257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:08.474257+0000","last_clean_scrub_stamp":"2023-11-28T20:01:08.474257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:16:29.294303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.14","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-28T20:01:12.965778+0000","last_change":"2023-11-28T20:01:10.517714+0000","last_active":"2023-11-28T20:01:12.965778+0000","last_peered":"2023-11-28T20:01:12.965778+0000","last_clean":"2023-11-28T20:01:12.965778+0000","last_became_active":"2023-11-28T20:01:10.517414+0000","last_became_peered":"2023-11-28T20:01:10.517414+0000","last_unstale":"2023-11-28T20:01:12.965778+0000","last_undegraded":"2023-11-28T20:01:12.965778+0000","last_fullsized":"2023-11-28T20:01:12.965778+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_clean_scrub_stamp":"2023-11-28T20:01:09.480611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T06:10:19.765319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-28T20:01:12.967778+0000","last_change":"2023-11-28T20:01:09.519465+0000","last_active":"2023-11-28T20:01:12.967778+0000","last_peered":"2023-11-28T20:01:12.967778+0000","last_clean":"2023-11-28T20:01:12.967778+0000","last_became_active":"2023-11-28T20:01:09.519233+0000","last_became_peered":"2023-11-28T20:01:09.519233+0000","last_unstale":"2023-11-28T20:01:12.967778+0000","last_undegraded":"2023-11-28T20:01:12.967778+0000","last_fullsized":"2023-11-28T20:01:12.967778+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:08.474257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:08.474257+0000","last_clean_scrub_stamp":"2023-11-28T20:01:08.474257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T07:34:36.168268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.15","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-28T20:01:12.966089+0000","last_change":"2023-11-28T20:01:10.533748+0000","last_active":"2023-11-28T20:01:12.966089+0000","last_peered":"2023-11-28T20:01:12.966089+0000","last_clean":"2023-11-28T20:01:12.966089+0000","last_became_active":"2023-11-28T20:01:10.533411+0000","last_became_peered":"2023-11-28T20:01:10.533411+0000","last_unstale":"2023-11-28T20:01:12.966089+0000","last_undegraded":"2023-11-28T20:01:12.966089+0000","last_fullsized":"2023-11-28T20:01:12.966089+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_clean_scrub_stamp":"2023-11-28T20:01:09.480611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:58:23.470366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-28T20:01:11.523750+0000","last_change":"2023-11-28T20:01:09.507203+0000","last_active":"2023-11-28T20:01:11.523750+0000","last_peered":"2023-11-28T20:01:11.523750+0000","last_clean":"2023-11-28T20:01:11.523750+0000","last_became_active":"2023-11-28T20:01:09.506901+0000","last_became_peered":"2023-11-28T20:01:09.506901+0000","last_unstale":"2023-11-28T20:01:11.523750+0000","last_undegraded":"2023-11-28T20:01:11.523750+0000","last_fullsized":"2023-11-28T20:01:11.523750+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:08.474257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:08.474257+0000","last_clean_scrub_stamp":"2023-11-28T20:01:08.474257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:15:27.309843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-28T20:01:12.966937+0000","last_change":"2023-11-28T20:01:10.537355+0000","last_active":"2023-11-28T20:01:12.966937+0000","last_peered":"2023-11-28T20:01:12.966937+0000","last_clean":"2023-11-28T20:01:12.966937+0000","last_became_active":"2023-11-28T20:01:10.536210+0000","last_became_peered":"2023-11-28T20:01:10.536210+0000","last_unstale":"2023-11-28T20:01:12.966937+0000","last_undegraded":"2023-11-28T20:01:12.966937+0000","last_fullsized":"2023-11-28T20:01:12.966937+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_clean_scrub_stamp":"2023-11-28T20:01:09.480611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T07:05:45.395904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.15","version":"60'3","reported_seq":15,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-28T20:01:12.967683+0000","last_change":"2023-11-28T20:01:09.519066+0000","last_active":"2023-11-28T20:01:12.967683+0000","last_peered":"2023-11-28T20:01:12.967683+0000","last_clean":"2023-11-28T20:01:12.967683+0000","last_became_active":"2023-11-28T20:01:09.518151+0000","last_became_peered":"2023-11-28T20:01:09.518151+0000","last_unstale":"2023-11-28T20:01:12.967683+0000","last_undegraded":"2023-11-28T20:01:12.967683+0000","last_fullsized":"2023-11-28T20:01:12.967683+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:08.474257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:08.474257+0000","last_clean_scrub_stamp":"2023-11-28T20:01:08.474257+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:00:29.783639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.17","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-28T20:01:11.524609+0000","last_change":"2023-11-28T20:01:10.521819+0000","last_active":"2023-11-28T20:01:11.524609+0000","last_peered":"2023-11-28T20:01:11.524609+0000","last_clean":"2023-11-28T20:01:11.524609+0000","last_became_active":"2023-11-28T20:01:10.521475+0000","last_became_peered":"2023-11-28T20:01:10.521475+0000","last_unstale":"2023-11-28T20:01:11.524609+0000","last_undegraded":"2023-11-28T20:01:11.524609+0000","last_fullsized":"2023-11-28T20:01:11.524609+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_clean_scrub_stamp":"2023-11-28T20:01:09.480611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:16:30.300658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.14","version":"60'6","reported_seq":18,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-28T20:01:12.965851+0000","last_change":"2023-11-28T20:01:09.511176+0000","last_active":"2023-11-28T20:01:12.965851+0000","last_peered":"2023-11-28T20:01:12.965851+0000","last_clean":"2023-11-28T20:01:12.965851+0000","last_became_active":"2023-11-28T20:01:09.510427+0000","last_became_peered":"2023-11-28T20:01:09.510427+0000","last_unstale":"2023-11-28T20:01:12.965851+0000","last_undegraded":"2023-11-28T20:01:12.965851+0000","last_fullsized":"2023-11-28T20:01:12.965851+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:08.474257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:08.474257+0000","last_clean_scrub_stamp":"2023-11-28T20:01:08.474257+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:47:12.268146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.10","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-28T20:01:11.524257+0000","last_change":"2023-11-28T20:01:10.533224+0000","last_active":"2023-11-28T20:01:11.524257+0000","last_peered":"2023-11-28T20:01:11.524257+0000","last_clean":"2023-11-28T20:01:11.524257+0000","last_became_active":"2023-11-28T20:01:10.532909+0000","last_became_peered":"2023-11-28T20:01:10.532909+0000","last_unstale":"2023-11-28T20:01:11.524257+0000","last_undegraded":"2023-11-28T20:01:11.524257+0000","last_fullsized":"2023-11-28T20:01:11.524257+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_clean_scrub_stamp":"2023-11-28T20:01:09.480611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:32:06.877460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.13","version":"60'2","reported_seq":14,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-28T20:01:12.967436+0000","last_change":"2023-11-28T20:01:09.518379+0000","last_active":"2023-11-28T20:01:12.967436+0000","last_peered":"2023-11-28T20:01:12.967436+0000","last_clean":"2023-11-28T20:01:12.967436+0000","last_became_active":"2023-11-28T20:01:09.518073+0000","last_became_peered":"2023-11-28T20:01:09.518073+0000","last_unstale":"2023-11-28T20:01:12.967436+0000","last_undegraded":"2023-11-28T20:01:12.967436+0000","last_fullsized":"2023-11-28T20:01:12.967436+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:08.474257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:08.474257+0000","last_clean_scrub_stamp":"2023-11-28T20:01:08.474257+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:11:07.788160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-28T20:01:11.523324+0000","last_change":"2023-11-28T20:01:10.520948+0000","last_active":"2023-11-28T20:01:11.523324+0000","last_peered":"2023-11-28T20:01:11.523324+0000","last_clean":"2023-11-28T20:01:11.523324+0000","last_became_active":"2023-11-28T20:01:10.520649+0000","last_became_peered":"2023-11-28T20:01:10.520649+0000","last_unstale":"2023-11-28T20:01:11.523324+0000","last_undegraded":"2023-11-28T20:01:11.523324+0000","last_fullsized":"2023-11-28T20:01:11.523324+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_clean_scrub_stamp":"2023-11-28T20:01:09.480611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:10:34.830531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-28T20:01:11.523539+0000","last_change":"2023-11-28T20:01:09.510604+0000","last_active":"2023-11-28T20:01:11.523539+0000","last_peered":"2023-11-28T20:01:11.523539+0000","last_clean":"2023-11-28T20:01:11.523539+0000","last_became_active":"2023-11-28T20:01:09.510326+0000","last_became_peered":"2023-11-28T20:01:09.510326+0000","last_unstale":"2023-11-28T20:01:11.523539+0000","last_undegraded":"2023-11-28T20:01:11.523539+0000","last_fullsized":"2023-11-28T20:01:11.523539+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:08.474257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:08.474257+0000","last_clean_scrub_stamp":"2023-11-28T20:01:08.474257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:56:14.988591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-28T20:01:12.966969+0000","last_change":"2023-11-28T20:01:10.527110+0000","last_active":"2023-11-28T20:01:12.966969+0000","last_peered":"2023-11-28T20:01:12.966969+0000","last_clean":"2023-11-28T20:01:12.966969+0000","last_became_active":"2023-11-28T20:01:10.525827+0000","last_became_peered":"2023-11-28T20:01:10.525827+0000","last_unstale":"2023-11-28T20:01:12.966969+0000","last_undegraded":"2023-11-28T20:01:12.966969+0000","last_fullsized":"2023-11-28T20:01:12.966969+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_clean_scrub_stamp":"2023-11-28T20:01:09.480611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:23:02.818476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-28T20:01:12.967514+0000","last_change":"2023-11-28T20:01:09.519626+0000","last_active":"2023-11-28T20:01:12.967514+0000","last_peered":"2023-11-28T20:01:12.967514+0000","last_clean":"2023-11-28T20:01:12.967514+0000","last_became_active":"2023-11-28T20:01:09.519349+0000","last_became_peered":"2023-11-28T20:01:09.519349+0000","last_unstale":"2023-11-28T20:01:12.967514+0000","last_undegraded":"2023-11-28T20:01:12.967514+0000","last_fullsized":"2023-11-28T20:01:12.967514+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:08.474257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:08.474257+0000","last_clean_scrub_stamp":"2023-11-28T20:01:08.474257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:04:51.492194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.13","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-28T20:01:12.965848+0000","last_change":"2023-11-28T20:01:10.535178+0000","last_active":"2023-11-28T20:01:12.965848+0000","last_peered":"2023-11-28T20:01:12.965848+0000","last_clean":"2023-11-28T20:01:12.965848+0000","last_became_active":"2023-11-28T20:01:10.534880+0000","last_became_peered":"2023-11-28T20:01:10.534880+0000","last_unstale":"2023-11-28T20:01:12.965848+0000","last_undegraded":"2023-11-28T20:01:12.965848+0000","last_fullsized":"2023-11-28T20:01:12.965848+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_clean_scrub_stamp":"2023-11-28T20:01:09.480611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:52:42.741966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.10","version":"60'8","reported_seq":20,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-28T20:01:11.524348+0000","last_change":"2023-11-28T20:01:09.511628+0000","last_active":"2023-11-28T20:01:11.524348+0000","last_peered":"2023-11-28T20:01:11.524348+0000","last_clean":"2023-11-28T20:01:11.524348+0000","last_became_active":"2023-11-28T20:01:09.511250+0000","last_became_peered":"2023-11-28T20:01:09.511250+0000","last_unstale":"2023-11-28T20:01:11.524348+0000","last_undegraded":"2023-11-28T20:01:11.524348+0000","last_fullsized":"2023-11-28T20:01:11.524348+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:08.474257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:08.474257+0000","last_clean_scrub_stamp":"2023-11-28T20:01:08.474257+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:35:34.107408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-28T20:01:12.967632+0000","last_change":"2023-11-28T20:01:10.537164+0000","last_active":"2023-11-28T20:01:12.967632+0000","last_peered":"2023-11-28T20:01:12.967632+0000","last_clean":"2023-11-28T20:01:12.967632+0000","last_became_active":"2023-11-28T20:01:10.536893+0000","last_became_peered":"2023-11-28T20:01:10.536893+0000","last_unstale":"2023-11-28T20:01:12.967632+0000","last_undegraded":"2023-11-28T20:01:12.967632+0000","last_fullsized":"2023-11-28T20:01:12.967632+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_clean_scrub_stamp":"2023-11-28T20:01:09.480611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:50:58.589965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.f","version":"60'1","reported_seq":13,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-28T20:01:11.524901+0000","last_change":"2023-11-28T20:01:09.510018+0000","last_active":"2023-11-28T20:01:11.524901+0000","last_peered":"2023-11-28T20:01:11.524901+0000","last_clean":"2023-11-28T20:01:11.524901+0000","last_became_active":"2023-11-28T20:01:09.509743+0000","last_became_peered":"2023-11-28T20:01:09.509743+0000","last_unstale":"2023-11-28T20:01:11.524901+0000","last_undegraded":"2023-11-28T20:01:11.524901+0000","last_fullsized":"2023-11-28T20:01:11.524901+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:08.474257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:08.474257+0000","last_clean_scrub_stamp":"2023-11-28T20:01:08.474257+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:09:59.028591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.d","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-28T20:01:12.967136+0000","last_change":"2023-11-28T20:01:10.537543+0000","last_active":"2023-11-28T20:01:12.967136+0000","last_peered":"2023-11-28T20:01:12.967136+0000","last_clean":"2023-11-28T20:01:12.967136+0000","last_became_active":"2023-11-28T20:01:10.537307+0000","last_became_peered":"2023-11-28T20:01:10.537307+0000","last_unstale":"2023-11-28T20:01:12.967136+0000","last_undegraded":"2023-11-28T20:01:12.967136+0000","last_fullsized":"2023-11-28T20:01:12.967136+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_clean_scrub_stamp":"2023-11-28T20:01:09.480611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:04:52.498548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.e","version":"60'2","reported_seq":14,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-28T20:01:12.967750+0000","last_change":"2023-11-28T20:01:09.519130+0000","last_active":"2023-11-28T20:01:12.967750+0000","last_peered":"2023-11-28T20:01:12.967750+0000","last_clean":"2023-11-28T20:01:12.967750+0000","last_became_active":"2023-11-28T20:01:09.517725+0000","last_became_peered":"2023-11-28T20:01:09.517725+0000","last_unstale":"2023-11-28T20:01:12.967750+0000","last_undegraded":"2023-11-28T20:01:12.967750+0000","last_fullsized":"2023-11-28T20:01:12.967750+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:08.474257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:08.474257+0000","last_clean_scrub_stamp":"2023-11-28T20:01:08.474257+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:05:31.573692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.e","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-28T20:01:11.523614+0000","last_change":"2023-11-28T20:01:10.530449+0000","last_active":"2023-11-28T20:01:11.523614+0000","last_peered":"2023-11-28T20:01:11.523614+0000","last_clean":"2023-11-28T20:01:11.523614+0000","last_became_active":"2023-11-28T20:01:10.530169+0000","last_became_peered":"2023-11-28T20:01:10.530169+0000","last_unstale":"2023-11-28T20:01:11.523614+0000","last_undegraded":"2023-11-28T20:01:11.523614+0000","last_fullsized":"2023-11-28T20:01:11.523614+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_clean_scrub_stamp":"2023-11-28T20:01:09.480611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:01:36.330362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.d","version":"60'1","reported_seq":13,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-28T20:01:12.967789+0000","last_change":"2023-11-28T20:01:09.519252+0000","last_active":"2023-11-28T20:01:12.967789+0000","last_peered":"2023-11-28T20:01:12.967789+0000","last_clean":"2023-11-28T20:01:12.967789+0000","last_became_active":"2023-11-28T20:01:09.518511+0000","last_became_peered":"2023-11-28T20:01:09.518511+0000","last_unstale":"2023-11-28T20:01:12.967789+0000","last_undegraded":"2023-11-28T20:01:12.967789+0000","last_fullsized":"2023-11-28T20:01:12.967789+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:08.474257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:08.474257+0000","last_clean_scrub_stamp":"2023-11-28T20:01:08.474257+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:52:41.735612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.f","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-28T20:01:12.966739+0000","last_change":"2023-11-28T20:01:10.523973+0000","last_active":"2023-11-28T20:01:12.966739+0000","last_peered":"2023-11-28T20:01:12.966739+0000","last_clean":"2023-11-28T20:01:12.966739+0000","last_became_active":"2023-11-28T20:01:10.523676+0000","last_became_peered":"2023-11-28T20:01:10.523676+0000","last_unstale":"2023-11-28T20:01:12.966739+0000","last_undegraded":"2023-11-28T20:01:12.966739+0000","last_fullsized":"2023-11-28T20:01:12.966739+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_clean_scrub_stamp":"2023-11-28T20:01:09.480611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:49:36.861168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-28T20:01:12.966013+0000","last_change":"2023-11-28T20:01:09.514931+0000","last_active":"2023-11-28T20:01:12.966013+0000","last_peered":"2023-11-28T20:01:12.966013+0000","last_clean":"2023-11-28T20:01:12.966013+0000","last_became_active":"2023-11-28T20:01:09.514702+0000","last_became_peered":"2023-11-28T20:01:09.514702+0000","last_unstale":"2023-11-28T20:01:12.966013+0000","last_undegraded":"2023-11-28T20:01:12.966013+0000","last_fullsized":"2023-11-28T20:01:12.966013+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:08.474257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:08.474257+0000","last_clean_scrub_stamp":"2023-11-28T20:01:08.474257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:30:37.298649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-28T20:01:12.535302+0000","last_change":"2023-11-28T20:01:10.525003+0000","last_active":"2023-11-28T20:01:12.535302+0000","last_peered":"2023-11-28T20:01:12.535302+0000","last_clean":"2023-11-28T20:01:12.535302+0000","last_became_active":"2023-11-28T20:01:10.524411+0000","last_became_peered":"2023-11-28T20:01:10.524411+0000","last_unstale":"2023-11-28T20:01:12.535302+0000","last_undegraded":"2023-11-28T20:01:12.535302+0000","last_fullsized":"2023-11-28T20:01:12.535302+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_clean_scrub_stamp":"2023-11-28T20:01:09.480611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:17:27.097887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.b","version":"60'2","reported_seq":14,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-28T20:01:12.535588+0000","last_change":"2023-11-28T20:01:09.511026+0000","last_active":"2023-11-28T20:01:12.535588+0000","last_peered":"2023-11-28T20:01:12.535588+0000","last_clean":"2023-11-28T20:01:12.535588+0000","last_became_active":"2023-11-28T20:01:09.510765+0000","last_became_peered":"2023-11-28T20:01:09.510765+0000","last_unstale":"2023-11-28T20:01:12.535588+0000","last_undegraded":"2023-11-28T20:01:12.535588+0000","last_fullsized":"2023-11-28T20:01:12.535588+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:08.474257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:08.474257+0000","last_clean_scrub_stamp":"2023-11-28T20:01:08.474257+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:06:35.988462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-28T20:01:11.523466+0000","last_change":"2023-11-28T20:01:10.523842+0000","last_active":"2023-11-28T20:01:11.523466+0000","last_peered":"2023-11-28T20:01:11.523466+0000","last_clean":"2023-11-28T20:01:11.523466+0000","last_became_active":"2023-11-28T20:01:10.523553+0000","last_became_peered":"2023-11-28T20:01:10.523553+0000","last_unstale":"2023-11-28T20:01:11.523466+0000","last_undegraded":"2023-11-28T20:01:11.523466+0000","last_fullsized":"2023-11-28T20:01:11.523466+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_clean_scrub_stamp":"2023-11-28T20:01:09.480611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T07:34:37.174623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-28T20:01:11.524098+0000","last_change":"2023-11-28T20:01:09.510719+0000","last_active":"2023-11-28T20:01:11.524098+0000","last_peered":"2023-11-28T20:01:11.524098+0000","last_clean":"2023-11-28T20:01:11.524098+0000","last_became_active":"2023-11-28T20:01:09.509874+0000","last_became_peered":"2023-11-28T20:01:09.509874+0000","last_unstale":"2023-11-28T20:01:11.524098+0000","last_undegraded":"2023-11-28T20:01:11.524098+0000","last_fullsized":"2023-11-28T20:01:11.524098+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:08.474257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:08.474257+0000","last_clean_scrub_stamp":"2023-11-28T20:01:08.474257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:21:20.189227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-28T20:01:12.967348+0000","last_change":"2023-11-28T20:01:10.530042+0000","last_active":"2023-11-28T20:01:12.967348+0000","last_peered":"2023-11-28T20:01:12.967348+0000","last_clean":"2023-11-28T20:01:12.967348+0000","last_became_active":"2023-11-28T20:01:10.529745+0000","last_became_peered":"2023-11-28T20:01:10.529745+0000","last_unstale":"2023-11-28T20:01:12.967348+0000","last_undegraded":"2023-11-28T20:01:12.967348+0000","last_fullsized":"2023-11-28T20:01:12.967348+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_clean_scrub_stamp":"2023-11-28T20:01:09.480611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:18:17.108795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-28T20:01:12.535455+0000","last_change":"2023-11-28T20:01:09.512327+0000","last_active":"2023-11-28T20:01:12.535455+0000","last_peered":"2023-11-28T20:01:12.535455+0000","last_clean":"2023-11-28T20:01:12.535455+0000","last_became_active":"2023-11-28T20:01:09.512065+0000","last_became_peered":"2023-11-28T20:01:09.512065+0000","last_unstale":"2023-11-28T20:01:12.535455+0000","last_undegraded":"2023-11-28T20:01:12.535455+0000","last_fullsized":"2023-11-28T20:01:12.535455+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:08.474257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:08.474257+0000","last_clean_scrub_stamp":"2023-11-28T20:01:08.474257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:46:28.694684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-28T20:01:12.535703+0000","last_change":"2023-11-28T20:01:10.526165+0000","last_active":"2023-11-28T20:01:12.535703+0000","last_peered":"2023-11-28T20:01:12.535703+0000","last_clean":"2023-11-28T20:01:12.535703+0000","last_became_active":"2023-11-28T20:01:10.525619+0000","last_became_peered":"2023-11-28T20:01:10.525619+0000","last_unstale":"2023-11-28T20:01:12.535703+0000","last_undegraded":"2023-11-28T20:01:12.535703+0000","last_fullsized":"2023-11-28T20:01:12.535703+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_clean_scrub_stamp":"2023-11-28T20:01:09.480611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:54:30.269337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.7","version":"60'2","reported_seq":14,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-28T20:01:11.525004+0000","last_change":"2023-11-28T20:01:09.514831+0000","last_active":"2023-11-28T20:01:11.525004+0000","last_peered":"2023-11-28T20:01:11.525004+0000","last_clean":"2023-11-28T20:01:11.525004+0000","last_became_active":"2023-11-28T20:01:09.514525+0000","last_became_peered":"2023-11-28T20:01:09.514525+0000","last_unstale":"2023-11-28T20:01:11.525004+0000","last_undegraded":"2023-11-28T20:01:11.525004+0000","last_fullsized":"2023-11-28T20:01:11.525004+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:08.474257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:08.474257+0000","last_clean_scrub_stamp":"2023-11-28T20:01:08.474257+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:05:31.573692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-28T20:01:11.521724+0000","last_change":"2023-11-28T20:01:10.533050+0000","last_active":"2023-11-28T20:01:11.521724+0000","last_peered":"2023-11-28T20:01:11.521724+0000","last_clean":"2023-11-28T20:01:11.521724+0000","last_became_active":"2023-11-28T20:01:10.532590+0000","last_became_peered":"2023-11-28T20:01:10.532590+0000","last_unstale":"2023-11-28T20:01:11.521724+0000","last_undegraded":"2023-11-28T20:01:11.521724+0000","last_fullsized":"2023-11-28T20:01:11.521724+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_clean_scrub_stamp":"2023-11-28T20:01:09.480611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T07:29:30.339936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-28T20:01:11.524430+0000","last_change":"2023-11-28T20:01:09.510397+0000","last_active":"2023-11-28T20:01:11.524430+0000","last_peered":"2023-11-28T20:01:11.524430+0000","last_clean":"2023-11-28T20:01:11.524430+0000","last_became_active":"2023-11-28T20:01:09.510136+0000","last_became_peered":"2023-11-28T20:01:09.510136+0000","last_unstale":"2023-11-28T20:01:11.524430+0000","last_undegraded":"2023-11-28T20:01:11.524430+0000","last_fullsized":"2023-11-28T20:01:11.524430+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:08.474257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:08.474257+0000","last_clean_scrub_stamp":"2023-11-28T20:01:08.474257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:18:48.620687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.6","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-28T20:01:11.524321+0000","last_change":"2023-11-28T20:01:10.530096+0000","last_active":"2023-11-28T20:01:11.524321+0000","last_peered":"2023-11-28T20:01:11.524321+0000","last_clean":"2023-11-28T20:01:11.524321+0000","last_became_active":"2023-11-28T20:01:10.529472+0000","last_became_peered":"2023-11-28T20:01:10.529472+0000","last_unstale":"2023-11-28T20:01:11.524321+0000","last_undegraded":"2023-11-28T20:01:11.524321+0000","last_fullsized":"2023-11-28T20:01:11.524321+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_clean_scrub_stamp":"2023-11-28T20:01:09.480611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T06:29:13.579326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-28T20:01:12.535910+0000","last_change":"2023-11-28T20:01:09.509983+0000","last_active":"2023-11-28T20:01:12.535910+0000","last_peered":"2023-11-28T20:01:12.535910+0000","last_clean":"2023-11-28T20:01:12.535910+0000","last_became_active":"2023-11-28T20:01:09.509675+0000","last_became_peered":"2023-11-28T20:01:09.509675+0000","last_unstale":"2023-11-28T20:01:12.535910+0000","last_undegraded":"2023-11-28T20:01:12.535910+0000","last_fullsized":"2023-11-28T20:01:12.535910+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:08.474257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:08.474257+0000","last_clean_scrub_stamp":"2023-11-28T20:01:08.474257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:21:20.189227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.7","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-28T20:01:12.967091+0000","last_change":"2023-11-28T20:01:10.535856+0000","last_active":"2023-11-28T20:01:12.967091+0000","last_peered":"2023-11-28T20:01:12.967091+0000","last_clean":"2023-11-28T20:01:12.967091+0000","last_became_active":"2023-11-28T20:01:10.530889+0000","last_became_peered":"2023-11-28T20:01:10.530889+0000","last_unstale":"2023-11-28T20:01:12.967091+0000","last_undegraded":"2023-11-28T20:01:12.967091+0000","last_fullsized":"2023-11-28T20:01:12.967091+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_clean_scrub_stamp":"2023-11-28T20:01:09.480611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:53:37.636427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-28T20:01:12.965882+0000","last_change":"2023-11-28T20:01:09.511368+0000","last_active":"2023-11-28T20:01:12.965882+0000","last_peered":"2023-11-28T20:01:12.965882+0000","last_clean":"2023-11-28T20:01:12.965882+0000","last_became_active":"2023-11-28T20:01:09.510765+0000","last_became_peered":"2023-11-28T20:01:09.510765+0000","last_unstale":"2023-11-28T20:01:12.965882+0000","last_undegraded":"2023-11-28T20:01:12.965882+0000","last_fullsized":"2023-11-28T20:01:12.965882+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:08.474257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:08.474257+0000","last_clean_scrub_stamp":"2023-11-28T20:01:08.474257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:23:01.812122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-28T20:01:12.966640+0000","last_change":"2023-11-28T20:01:10.530585+0000","last_active":"2023-11-28T20:01:12.966640+0000","last_peered":"2023-11-28T20:01:12.966640+0000","last_clean":"2023-11-28T20:01:12.966640+0000","last_became_active":"2023-11-28T20:01:10.530313+0000","last_became_peered":"2023-11-28T20:01:10.530313+0000","last_unstale":"2023-11-28T20:01:12.966640+0000","last_undegraded":"2023-11-28T20:01:12.966640+0000","last_fullsized":"2023-11-28T20:01:12.966640+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_clean_scrub_stamp":"2023-11-28T20:01:09.480611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:04:41.159984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-28T20:01:12.967578+0000","last_change":"2023-11-28T20:01:09.518318+0000","last_active":"2023-11-28T20:01:12.967578+0000","last_peered":"2023-11-28T20:01:12.967578+0000","last_clean":"2023-11-28T20:01:12.967578+0000","last_became_active":"2023-11-28T20:01:09.517761+0000","last_became_peered":"2023-11-28T20:01:09.517761+0000","last_unstale":"2023-11-28T20:01:12.967578+0000","last_undegraded":"2023-11-28T20:01:12.967578+0000","last_fullsized":"2023-11-28T20:01:12.967578+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:08.474257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:08.474257+0000","last_clean_scrub_stamp":"2023-11-28T20:01:08.474257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:18:16.102441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-28T20:01:11.523331+0000","last_change":"2023-11-28T20:01:10.533596+0000","last_active":"2023-11-28T20:01:11.523331+0000","last_peered":"2023-11-28T20:01:11.523331+0000","last_clean":"2023-11-28T20:01:11.523331+0000","last_became_active":"2023-11-28T20:01:10.533195+0000","last_became_peered":"2023-11-28T20:01:10.533195+0000","last_unstale":"2023-11-28T20:01:11.523331+0000","last_undegraded":"2023-11-28T20:01:11.523331+0000","last_fullsized":"2023-11-28T20:01:11.523331+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_clean_scrub_stamp":"2023-11-28T20:01:09.480611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:14:25.459653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-28T20:01:12.965440+0000","last_change":"2023-11-28T20:01:09.507413+0000","last_active":"2023-11-28T20:01:12.965440+0000","last_peered":"2023-11-28T20:01:12.965440+0000","last_clean":"2023-11-28T20:01:12.965440+0000","last_became_active":"2023-11-28T20:01:09.507080+0000","last_became_peered":"2023-11-28T20:01:09.507080+0000","last_unstale":"2023-11-28T20:01:12.965440+0000","last_undegraded":"2023-11-28T20:01:12.965440+0000","last_fullsized":"2023-11-28T20:01:12.965440+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:08.474257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:08.474257+0000","last_clean_scrub_stamp":"2023-11-28T20:01:08.474257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:54:29.262983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-28T20:01:12.965635+0000","last_change":"2023-11-28T20:01:10.518351+0000","last_active":"2023-11-28T20:01:12.965635+0000","last_peered":"2023-11-28T20:01:12.965635+0000","last_clean":"2023-11-28T20:01:12.965635+0000","last_became_active":"2023-11-28T20:01:10.518106+0000","last_became_peered":"2023-11-28T20:01:10.518106+0000","last_unstale":"2023-11-28T20:01:12.965635+0000","last_undegraded":"2023-11-28T20:01:12.965635+0000","last_fullsized":"2023-11-28T20:01:12.965635+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_clean_scrub_stamp":"2023-11-28T20:01:09.480611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:04:52.498548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-28T20:01:12.965332+0000","last_change":"2023-11-28T20:01:09.514346+0000","last_active":"2023-11-28T20:01:12.965332+0000","last_peered":"2023-11-28T20:01:12.965332+0000","last_clean":"2023-11-28T20:01:12.965332+0000","last_became_active":"2023-11-28T20:01:09.513791+0000","last_became_peered":"2023-11-28T20:01:09.513791+0000","last_unstale":"2023-11-28T20:01:12.965332+0000","last_undegraded":"2023-11-28T20:01:12.965332+0000","last_fullsized":"2023-11-28T20:01:12.965332+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:08.474257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:08.474257+0000","last_clean_scrub_stamp":"2023-11-28T20:01:08.474257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:17:26.091533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-28T20:01:11.521477+0000","last_change":"2023-11-28T20:01:10.531261+0000","last_active":"2023-11-28T20:01:11.521477+0000","last_peered":"2023-11-28T20:01:11.521477+0000","last_clean":"2023-11-28T20:01:11.521477+0000","last_became_active":"2023-11-28T20:01:10.531002+0000","last_became_peered":"2023-11-28T20:01:10.531002+0000","last_unstale":"2023-11-28T20:01:11.521477+0000","last_undegraded":"2023-11-28T20:01:11.521477+0000","last_fullsized":"2023-11-28T20:01:11.521477+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_clean_scrub_stamp":"2023-11-28T20:01:09.480611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:50:37.650648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-28T20:01:12.965308+0000","last_change":"2023-11-28T20:01:09.512031+0000","last_active":"2023-11-28T20:01:12.965308+0000","last_peered":"2023-11-28T20:01:12.965308+0000","last_clean":"2023-11-28T20:01:12.965308+0000","last_became_active":"2023-11-28T20:01:09.511366+0000","last_became_peered":"2023-11-28T20:01:09.511366+0000","last_unstale":"2023-11-28T20:01:12.965308+0000","last_undegraded":"2023-11-28T20:01:12.965308+0000","last_fullsized":"2023-11-28T20:01:12.965308+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:08.474257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:08.474257+0000","last_clean_scrub_stamp":"2023-11-28T20:01:08.474257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:29:38.849741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.b","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-28T20:01:12.967122+0000","last_change":"2023-11-28T20:01:10.530148+0000","last_active":"2023-11-28T20:01:12.967122+0000","last_peered":"2023-11-28T20:01:12.967122+0000","last_clean":"2023-11-28T20:01:12.967122+0000","last_became_active":"2023-11-28T20:01:10.529630+0000","last_became_peered":"2023-11-28T20:01:10.529630+0000","last_unstale":"2023-11-28T20:01:12.967122+0000","last_undegraded":"2023-11-28T20:01:12.967122+0000","last_fullsized":"2023-11-28T20:01:12.967122+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_clean_scrub_stamp":"2023-11-28T20:01:09.480611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:11:08.794514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-28T20:01:12.965173+0000","last_change":"2023-11-28T20:01:09.515708+0000","last_active":"2023-11-28T20:01:12.965173+0000","last_peered":"2023-11-28T20:01:12.965173+0000","last_clean":"2023-11-28T20:01:12.965173+0000","last_became_active":"2023-11-28T20:01:09.515449+0000","last_became_peered":"2023-11-28T20:01:09.515449+0000","last_unstale":"2023-11-28T20:01:12.965173+0000","last_undegraded":"2023-11-28T20:01:12.965173+0000","last_fullsized":"2023-11-28T20:01:12.965173+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:08.474257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:08.474257+0000","last_clean_scrub_stamp":"2023-11-28T20:01:08.474257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T07:14:20.829778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":199,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-28T20:01:10.525775+0000","last_change":"2023-11-28T19:58:56.136501+0000","last_active":"2023-11-28T20:01:10.525775+0000","last_peered":"2023-11-28T20:01:10.525775+0000","last_clean":"2023-11-28T20:01:10.525775+0000","last_became_active":"2023-11-28T19:58:56.135998+0000","last_became_peered":"2023-11-28T19:58:56.135998+0000","last_unstale":"2023-11-28T20:01:10.525775+0000","last_undegraded":"2023-11-28T20:01:10.525775+0000","last_fullsized":"2023-11-28T20:01:10.525775+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:58:54.602349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:58:54.602349+0000","last_clean_scrub_stamp":"2023-11-28T19:58:54.602349+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:33:42.723349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":10,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":9,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":66748,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574880,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27816,"kb_used_data":788,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344024,"statfs":{"total":96636764160,"available":96608280576,"internally_reserved":0,"allocated":806912,"data_stored":922237,"data_compressed":33374,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 20:00:55 2023","interfaces":[{"interface":"back","average":{"1min":0.66200000000000003,"5min":0.67500000000000004,"15min":0.67700000000000005},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":0.84699999999999998,"5min":0.90700000000000003,"15min":0.90700000000000003},"last":0.752},{"interface":"front","average":{"1min":0.63300000000000001,"5min":0.67400000000000004,"15min":0.68100000000000005},"min":{"1min":0.499,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":0.84099999999999997,"5min":0.98999999999999999,"15min":0.98999999999999999},"last":0.78300000000000003}]},{"osd":1,"last update":"Tue Nov 28 20:00:55 2023","interfaces":[{"interface":"back","average":{"1min":0.60599999999999998,"5min":0.63800000000000001,"15min":0.64300000000000002},"min":{"1min":0.44700000000000001,"5min":0.438,"15min":0.438},"max":{"1min":0.82899999999999996,"5min":0.89600000000000002,"15min":0.89600000000000002},"last":0.72799999999999998},{"interface":"front","average":{"1min":0.63900000000000001,"5min":0.68899999999999995,"15min":0.69699999999999995},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":0.78200000000000003,"5min":1.0900000000000001,"15min":1.0900000000000001},"last":0.83999999999999997}]},{"osd":2,"last update":"Tue Nov 28 20:00:55 2023","interfaces":[{"interface":"back","average":{"1min":0.64400000000000002,"5min":0.71599999999999997,"15min":0.72799999999999998},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.84699999999999998,"5min":0.98799999999999999,"15min":0.98799999999999999},"last":0.80100000000000005},{"interface":"front","average":{"1min":0.65100000000000002,"5min":0.69499999999999995,"15min":0.70299999999999996},"min":{"1min":0.48599999999999999,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":0.85599999999999998,"5min":1.0680000000000001,"15min":1.0680000000000001},"last":0.74299999999999999}]},{"osd":3,"last update":"Tue Nov 28 20:00:55 2023","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.70099999999999996,"15min":0.69999999999999996},"min":{"1min":0.56100000000000005,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":0.88900000000000001,"5min":1.0449999999999999,"15min":1.0449999999999999},"last":0.76700000000000002},{"interface":"front","average":{"1min":0.74199999999999999,"5min":0.78200000000000003,"15min":0.78900000000000003},"min":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":0.60699999999999998},"max":{"1min":0.879,"5min":1.1299999999999999,"15min":1.1299999999999999},"last":0.70999999999999996}]},{"osd":4,"last update":"Tue Nov 28 20:00:55 2023","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.63600000000000001,"15min":0.64000000000000001},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":0.83899999999999997,"5min":1.018,"15min":1.018},"last":0.68000000000000005},{"interface":"front","average":{"1min":0.67600000000000005,"5min":0.72199999999999998,"15min":0.72999999999999998},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":0.97899999999999998,"5min":1.1120000000000001,"15min":1.1120000000000001},"last":0.65700000000000003}]},{"osd":5,"last update":"Tue Nov 28 20:00:55 2023","interfaces":[{"interface":"back","average":{"1min":0.58699999999999997,"5min":0.66500000000000004,"15min":0.67800000000000005},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.871,"5min":1.1699999999999999,"15min":1.1699999999999999},"last":0.60399999999999998},{"interface":"front","average":{"1min":0.67900000000000005,"5min":0.748,"15min":0.76000000000000001},"min":{"1min":0.505,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":0.88500000000000001,"5min":1.1890000000000001,"15min":1.1890000000000001},"last":0.85699999999999998}]},{"osd":6,"last update":"Tue Nov 28 20:00:55 2023","interfaces":[{"interface":"back","average":{"1min":0.71399999999999997,"5min":0.76800000000000002,"15min":0.77700000000000002},"min":{"1min":0.47499999999999998,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.88200000000000001,"5min":1.1379999999999999,"15min":1.1379999999999999},"last":0.82099999999999995},{"interface":"front","average":{"1min":0.65000000000000002,"5min":0.72699999999999998,"15min":0.73999999999999999},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":0.93300000000000005,"5min":1.23,"15min":1.23},"last":0.58199999999999996}]}]},{"osd":6,"up_from":13,"seq":55834574878,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27736,"kb_used_data":712,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344104,"statfs":{"total":96636764160,"available":96608362496,"internally_reserved":0,"allocated":729088,"data_stored":331127,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 20:00:54 2023","interfaces":[{"interface":"back","average":{"1min":0.621,"5min":0.61699999999999999,"15min":0.61599999999999999},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.81699999999999995,"5min":0.82599999999999996,"15min":0.82599999999999996},"last":0.55700000000000005},{"interface":"front","average":{"1min":0.67300000000000004,"5min":0.66500000000000004,"15min":0.66400000000000003},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":0.88700000000000001,"5min":0.98999999999999999,"15min":0.98999999999999999},"last":0.58799999999999997}]},{"osd":1,"last update":"Tue Nov 28 20:00:54 2023","interfaces":[{"interface":"back","average":{"1min":0.745,"5min":0.78100000000000003,"15min":0.78700000000000003},"min":{"1min":0.56100000000000005,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.0940000000000001,"5min":1.105,"15min":1.105},"last":0.61699999999999999},{"interface":"front","average":{"1min":0.69999999999999996,"5min":0.68899999999999995,"15min":0.68700000000000006},"min":{"1min":0.53700000000000003,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.85599999999999998,"5min":0.95899999999999996,"15min":0.95899999999999996},"last":0.51800000000000002}]},{"osd":2,"last update":"Tue Nov 28 20:00:54 2023","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.69499999999999995,"15min":0.69799999999999995},"min":{"1min":0.54700000000000004,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":0.89700000000000002,"5min":0.93400000000000005,"15min":0.93400000000000005},"last":0.57499999999999996},{"interface":"front","average":{"1min":0.70499999999999996,"5min":0.71599999999999997,"15min":0.71799999999999997},"min":{"1min":0.53400000000000003,"5min":0.505,"15min":0.505},"max":{"1min":0.91800000000000004,"5min":1.006,"15min":1.006},"last":0.56699999999999995}]},{"osd":3,"last update":"Tue Nov 28 20:00:54 2023","interfaces":[{"interface":"back","average":{"1min":0.70999999999999996,"5min":0.74099999999999999,"15min":0.746},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.04,"5min":1.056,"15min":1.056},"last":0.53400000000000003},{"interface":"front","average":{"1min":0.66700000000000004,"5min":0.68100000000000005,"15min":0.68300000000000005},"min":{"1min":0.505,"5min":0.505,"15min":0.505},"max":{"1min":0.85599999999999998,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.54200000000000004}]},{"osd":4,"last update":"Tue Nov 28 20:00:54 2023","interfaces":[{"interface":"back","average":{"1min":0.61599999999999999,"5min":0.628,"15min":0.63},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":0.97599999999999998,"5min":0.97599999999999998,"15min":0.97599999999999998},"last":0.38600000000000001},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.71199999999999997,"15min":0.72999999999999998},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":1.1419999999999999,"5min":1.389,"15min":1.389},"last":0.41899999999999998}]},{"osd":5,"last update":"Tue Nov 28 20:00:54 2023","interfaces":[{"interface":"back","average":{"1min":0.71999999999999997,"5min":0.79700000000000004,"15min":0.81000000000000005},"min":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":1.147,"5min":1.4259999999999999,"15min":1.4259999999999999},"last":0.49199999999999999},{"interface":"front","average":{"1min":0.70699999999999996,"5min":0.751,"15min":0.75900000000000001},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.034,"5min":1.276,"15min":1.276},"last":0.60099999999999998}]},{"osd":7,"last update":"Tue Nov 28 20:00:54 2023","interfaces":[{"interface":"back","average":{"1min":0.64000000000000001,"5min":0.69999999999999996,"15min":0.70999999999999996},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":1.014,"5min":1.014,"15min":1.014},"last":0.628},{"interface":"front","average":{"1min":0.72599999999999998,"5min":0.80900000000000005,"15min":0.82299999999999995},"min":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":1.083,"5min":1.242,"15min":1.242},"last":0.46999999999999997}]}]},{"osd":5,"up_from":13,"seq":55834574880,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27752,"kb_used_data":724,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344088,"statfs":{"total":96636764160,"available":96608346112,"internally_reserved":0,"allocated":741376,"data_stored":337735,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 20:00:54 2023","interfaces":[{"interface":"back","average":{"1min":0.628,"5min":0.69299999999999995,"15min":0.70399999999999996},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.84699999999999998,"5min":0.997,"15min":0.997},"last":0.44400000000000001},{"interface":"front","average":{"1min":0.61899999999999999,"5min":0.69899999999999995,"15min":0.71199999999999997},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.78800000000000003,"5min":1.149,"15min":1.149},"last":0.58399999999999996}]},{"osd":1,"last update":"Tue Nov 28 20:00:54 2023","interfaces":[{"interface":"back","average":{"1min":0.66800000000000004,"5min":0.70399999999999996,"15min":0.70999999999999996},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.94499999999999995,"5min":0.94499999999999995,"15min":0.94499999999999995},"last":0.45900000000000002},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.70399999999999996,"15min":0.71999999999999997},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":0.71999999999999997,"5min":1.0940000000000001,"15min":1.0940000000000001},"last":0.53400000000000003}]},{"osd":2,"last update":"Tue Nov 28 20:00:54 2023","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.89200000000000002,"15min":0.92800000000000005},"min":{"1min":0.5,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":0.91200000000000003,"5min":5.0880000000000001,"15min":5.0880000000000001},"last":0.51400000000000001},{"interface":"front","average":{"1min":0.69599999999999995,"5min":0.93999999999999995,"15min":0.98099999999999998},"min":{"1min":0.59199999999999997,"5min":0.504,"15min":0.504},"max":{"1min":0.96199999999999997,"5min":5.1399999999999997,"15min":5.1399999999999997},"last":0.56399999999999995}]},{"osd":3,"last update":"Tue Nov 28 20:00:54 2023","interfaces":[{"interface":"back","average":{"1min":0.70999999999999996,"5min":0.96399999999999997,"15min":1.006},"min":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":0.91100000000000003,"5min":5.0469999999999997,"15min":5.0469999999999997},"last":0.69499999999999995},{"interface":"front","average":{"1min":0.69099999999999995,"5min":0.93899999999999995,"15min":0.97999999999999998},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":0.90000000000000002,"5min":5.024,"15min":5.024},"last":0.499}]},{"osd":4,"last update":"Tue Nov 28 20:00:54 2023","interfaces":[{"interface":"back","average":{"1min":0.58599999999999997,"5min":0.65800000000000003,"15min":0.67000000000000004},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.93300000000000005,"5min":1.4810000000000001,"15min":1.4810000000000001},"last":0.48299999999999998},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.73599999999999999,"15min":0.74299999999999999},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":0.95799999999999996,"5min":1.6339999999999999,"15min":1.6339999999999999},"last":0.64000000000000001}]},{"osd":6,"last update":"Tue Nov 28 20:00:54 2023","interfaces":[{"interface":"back","average":{"1min":0.70299999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"min":{"1min":0.47699999999999998,"5min":0.434,"15min":0.434},"max":{"1min":0.93899999999999995,"5min":0.97699999999999998,"15min":0.97699999999999998},"last":0.623},{"interface":"front","average":{"1min":0.69199999999999995,"5min":0.73599999999999999,"15min":0.74399999999999999},"min":{"1min":0.46300000000000002,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":0.86599999999999999,"5min":1.099,"15min":1.099},"last":0.60299999999999998}]},{"osd":7,"last update":"Tue Nov 28 20:00:54 2023","interfaces":[{"interface":"back","average":{"1min":0.77100000000000002,"5min":0.78300000000000003,"15min":0.78500000000000003},"min":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":0.95999999999999996,"5min":1.236,"15min":1.236},"last":0.67400000000000004},{"interface":"front","average":{"1min":0.77800000000000002,"5min":0.79600000000000004,"15min":0.79900000000000004},"min":{"1min":0.54000000000000004,"5min":0.505,"15min":0.505},"max":{"1min":0.98599999999999999,"5min":1.0760000000000001,"15min":1.0760000000000001},"last":0.66000000000000003}]}]},{"osd":4,"up_from":13,"seq":55834574879,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27760,"kb_used_data":732,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344080,"statfs":{"total":96636764160,"available":96608337920,"internally_reserved":0,"allocated":749568,"data_stored":339325,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 20:00:54 2023","interfaces":[{"interface":"back","average":{"1min":0.63200000000000001,"5min":0.69499999999999995,"15min":0.70499999999999996},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.82999999999999996,"5min":1.0429999999999999,"15min":1.0429999999999999},"last":0.78500000000000003},{"interface":"front","average":{"1min":0.64400000000000002,"5min":0.69999999999999996,"15min":0.70899999999999996},"min":{"1min":0.44900000000000001,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.93200000000000005,"5min":1.163,"15min":1.163},"last":0.501}]},{"osd":1,"last update":"Tue Nov 28 20:00:54 2023","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.73599999999999999,"15min":0.754},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.88500000000000001,"5min":1.111,"15min":1.111},"last":0.51900000000000002},{"interface":"front","average":{"1min":0.68300000000000005,"5min":0.78700000000000003,"15min":0.80500000000000005},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":0.90000000000000002,"5min":1.238,"15min":1.238},"last":0.67900000000000005}]},{"osd":2,"last update":"Tue Nov 28 20:00:54 2023","interfaces":[{"interface":"back","average":{"1min":0.70099999999999996,"5min":0.76600000000000001,"15min":0.77700000000000002},"min":{"1min":0.53300000000000003,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.97399999999999998,"5min":1.0669999999999999,"15min":1.0669999999999999},"last":0.65700000000000003},{"interface":"front","average":{"1min":0.66700000000000004,"5min":0.78700000000000003,"15min":0.80700000000000005},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.88100000000000001,"5min":1.1180000000000001,"15min":1.1180000000000001},"last":0.84599999999999997}]},{"osd":3,"last update":"Tue Nov 28 20:00:54 2023","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.76600000000000001,"15min":0.79000000000000004},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":0.89700000000000002,"5min":1.202,"15min":1.202},"last":0.63300000000000001},{"interface":"front","average":{"1min":0.67700000000000005,"5min":0.77200000000000002,"15min":0.78800000000000003},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":0.94599999999999995,"5min":1.0589999999999999,"15min":1.0589999999999999},"last":0.76400000000000001}]},{"osd":5,"last update":"Tue Nov 28 20:00:54 2023","interfaces":[{"interface":"back","average":{"1min":0.621,"5min":0.70299999999999996,"15min":0.71699999999999997},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.82499999999999996,"5min":0.95899999999999996,"15min":0.95899999999999996},"last":0.88400000000000001},{"interface":"front","average":{"1min":0.625,"5min":0.69599999999999995,"15min":0.70799999999999996},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.879,"5min":1.034,"15min":1.034},"last":0.70299999999999996}]},{"osd":6,"last update":"Tue Nov 28 20:00:54 2023","interfaces":[{"interface":"back","average":{"1min":0.60799999999999998,"5min":0.70899999999999996,"15min":0.72599999999999998},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":0.73799999999999999,"5min":1.0309999999999999,"15min":1.0309999999999999},"last":0.72199999999999998},{"interface":"front","average":{"1min":0.71899999999999997,"5min":0.77100000000000002,"15min":0.77900000000000003},"min":{"1min":0.49199999999999999,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":0.879,"5min":1.002,"15min":1.002},"last":0.90700000000000003}]},{"osd":7,"last update":"Tue Nov 28 20:00:54 2023","interfaces":[{"interface":"back","average":{"1min":0.70499999999999996,"5min":0.77100000000000002,"15min":0.78200000000000003},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":0.91000000000000003,"5min":1.0620000000000001,"15min":1.0620000000000001},"last":0.86499999999999999},{"interface":"front","average":{"1min":0.76000000000000001,"5min":0.84799999999999998,"15min":0.86199999999999999},"min":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":0.93400000000000005,"5min":1.1459999999999999,"15min":1.1459999999999999},"last":0.82599999999999996}]}]},{"osd":3,"up_from":13,"seq":55834574880,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27732,"kb_used_data":708,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344108,"statfs":{"total":96636764160,"available":96608366592,"internally_reserved":0,"allocated":724992,"data_stored":331093,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 20:00:55 2023","interfaces":[{"interface":"back","average":{"1min":0.41899999999999998,"5min":0.441,"15min":0.44500000000000001},"min":{"1min":0.29399999999999998,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.40200000000000002},{"interface":"front","average":{"1min":0.39600000000000002,"5min":0.45800000000000002,"15min":0.46800000000000003},"min":{"1min":0.28199999999999997,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.52800000000000002,"5min":0.82599999999999996,"15min":0.82599999999999996},"last":0.49099999999999999}]},{"osd":1,"last update":"Tue Nov 28 20:00:55 2023","interfaces":[{"interface":"back","average":{"1min":0.40000000000000002,"5min":0.46500000000000002,"15min":0.47599999999999998},"min":{"1min":0.26200000000000001,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.56999999999999995,"5min":0.84399999999999997,"15min":0.84399999999999997},"last":0.42399999999999999},{"interface":"front","average":{"1min":0.439,"5min":0.49099999999999999,"15min":0.5},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.74099999999999999,"5min":0.86099999999999999,"15min":0.86099999999999999},"last":0.503}]},{"osd":2,"last update":"Tue Nov 28 20:00:55 2023","interfaces":[{"interface":"back","average":{"1min":0.48799999999999999,"5min":0.52400000000000002,"15min":0.53000000000000003},"min":{"1min":0.375,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.64900000000000002,"5min":0.85599999999999998,"15min":0.85599999999999998},"last":0.51700000000000002},{"interface":"front","average":{"1min":0.48999999999999999,"5min":0.56599999999999995,"15min":0.57899999999999996},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.63500000000000001,"5min":0.83699999999999997,"15min":0.83699999999999997},"last":0.55800000000000005}]},{"osd":4,"last update":"Tue Nov 28 20:00:55 2023","interfaces":[{"interface":"back","average":{"1min":0.77700000000000002,"5min":0.76500000000000001,"15min":0.76300000000000001},"min":{"1min":0.60799999999999998,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":1.085,"5min":1.206,"15min":1.206},"last":0.92800000000000005},{"interface":"front","average":{"1min":0.80700000000000005,"5min":0.80300000000000005,"15min":0.80300000000000005},"min":{"1min":0.58999999999999997,"5min":0.503,"15min":0.503},"max":{"1min":1.173,"5min":1.222,"15min":1.222},"last":0.88800000000000001}]},{"osd":5,"last update":"Tue Nov 28 20:00:55 2023","interfaces":[{"interface":"back","average":{"1min":0.78300000000000003,"5min":0.79600000000000004,"15min":0.79800000000000004},"min":{"1min":0.57699999999999996,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":1.2509999999999999,"5min":1.2509999999999999,"15min":1.2509999999999999},"last":0.77800000000000002},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.79100000000000004,"15min":0.79900000000000004},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":1.0409999999999999,"5min":1.3100000000000001,"15min":1.3100000000000001},"last":0.83899999999999997}]},{"osd":6,"last update":"Tue Nov 28 20:00:55 2023","interfaces":[{"interface":"back","average":{"1min":0.81699999999999995,"5min":0.83799999999999997,"15min":0.84199999999999997},"min":{"1min":0.58799999999999997,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":1.544,"5min":1.544,"15min":1.544},"last":0.89700000000000002},{"interface":"front","average":{"1min":0.93100000000000005,"5min":0.78500000000000003,"15min":0.76100000000000001},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":4.0679999999999996,"5min":4.0679999999999996,"15min":4.0679999999999996},"last":0.90800000000000003}]},{"osd":7,"last update":"Tue Nov 28 20:00:55 2023","interfaces":[{"interface":"back","average":{"1min":0.97099999999999997,"5min":0.874,"15min":0.85799999999999998},"min":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":4.0019999999999998,"5min":4.0019999999999998,"15min":4.0019999999999998},"last":0.878},{"interface":"front","average":{"1min":0.80100000000000005,"5min":0.873,"15min":0.88500000000000001},"min":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.60299999999999998},"max":{"1min":1.1830000000000001,"5min":1.339,"15min":1.339},"last":0.85799999999999998}]}]},{"osd":2,"up_from":13,"seq":55834574878,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27748,"kb_used_data":720,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344092,"statfs":{"total":96636764160,"available":96608350208,"internally_reserved":0,"allocated":737280,"data_stored":337713,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 20:00:54 2023","interfaces":[{"interface":"back","average":{"1min":0.42599999999999999,"5min":0.45000000000000001,"15min":0.45400000000000001},"min":{"1min":0.33300000000000002,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.65100000000000002,"5min":0.74099999999999999,"15min":0.74099999999999999},"last":0.311},{"interface":"front","average":{"1min":0.42199999999999999,"5min":0.46999999999999997,"15min":0.47799999999999998},"min":{"1min":0.27900000000000003,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.61399999999999999,"5min":0.67700000000000005,"15min":0.67700000000000005},"last":0.495}]},{"osd":1,"last update":"Tue Nov 28 20:00:54 2023","interfaces":[{"interface":"back","average":{"1min":0.42899999999999999,"5min":0.497,"15min":0.50900000000000001},"min":{"1min":0.33300000000000002,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.57199999999999995,"5min":1.0389999999999999,"15min":1.0389999999999999},"last":0.44800000000000001},{"interface":"front","average":{"1min":0.435,"5min":0.49099999999999999,"15min":0.5},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.70299999999999996,"5min":0.70999999999999996,"15min":0.70999999999999996},"last":0.40799999999999997}]},{"osd":3,"last update":"Tue Nov 28 20:00:54 2023","interfaces":[{"interface":"back","average":{"1min":0.44,"5min":0.46600000000000003,"15min":0.46999999999999997},"min":{"1min":0.317,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.55200000000000005,"5min":0.629,"15min":0.629},"last":0.36899999999999999},{"interface":"front","average":{"1min":0.496,"5min":0.57199999999999995,"15min":0.58499999999999996},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.67800000000000005,"5min":0.98499999999999999,"15min":0.98499999999999999},"last":0.56899999999999995}]},{"osd":4,"last update":"Tue Nov 28 20:00:54 2023","interfaces":[{"interface":"back","average":{"1min":0.73899999999999999,"5min":0.83699999999999997,"15min":0.85299999999999998},"min":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"max":{"1min":0.98999999999999999,"5min":1.139,"15min":1.139},"last":0.78300000000000003},{"interface":"front","average":{"1min":0.71999999999999997,"5min":0.82599999999999996,"15min":0.84399999999999997},"min":{"1min":0.57299999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":0.97599999999999998,"5min":1.238,"15min":1.238},"last":0.97699999999999998}]},{"osd":5,"last update":"Tue Nov 28 20:00:54 2023","interfaces":[{"interface":"back","average":{"1min":0.69699999999999995,"5min":0.84699999999999998,"15min":0.872},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":0.83599999999999997,"5min":1.6180000000000001,"15min":1.6180000000000001},"last":0.93200000000000005},{"interface":"front","average":{"1min":0.71099999999999997,"5min":0.81000000000000005,"15min":0.82599999999999996},"min":{"1min":0.52200000000000002,"5min":0.496,"15min":0.496},"max":{"1min":0.96899999999999997,"5min":1.339,"15min":1.339},"last":0.80000000000000004}]},{"osd":6,"last update":"Tue Nov 28 20:00:54 2023","interfaces":[{"interface":"back","average":{"1min":0.73299999999999998,"5min":0.79100000000000004,"15min":0.80100000000000005},"min":{"1min":0.54600000000000004,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":0.98199999999999998,"5min":1.1839999999999999,"15min":1.1839999999999999},"last":0.877},{"interface":"front","average":{"1min":0.70599999999999996,"5min":0.82999999999999996,"15min":0.85099999999999998},"min":{"1min":0.497,"5min":0.497,"15min":0.497},"max":{"1min":0.94199999999999995,"5min":1.099,"15min":1.099},"last":0.96799999999999997}]},{"osd":7,"last update":"Tue Nov 28 20:00:54 2023","interfaces":[{"interface":"back","average":{"1min":0.746,"5min":0.86099999999999999,"15min":0.88},"min":{"1min":0.53300000000000003,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":0.84899999999999998,"5min":1.4590000000000001,"15min":1.4590000000000001},"last":0.81799999999999995},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.83599999999999997,"15min":0.85599999999999998},"min":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":0.96599999999999997,"5min":1.387,"15min":1.387},"last":0.91200000000000003}]}]},{"osd":1,"up_from":13,"seq":55834574880,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27760,"kb_used_data":736,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344080,"statfs":{"total":96636764160,"available":96608337920,"internally_reserved":0,"allocated":753664,"data_stored":333469,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 20:00:56 2023","interfaces":[{"interface":"back","average":{"1min":0.372,"5min":0.59999999999999998,"15min":0.63800000000000001},"min":{"1min":0.25900000000000001,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.53200000000000003,"5min":3.8740000000000001,"15min":3.8740000000000001},"last":0.46899999999999997},{"interface":"front","average":{"1min":0.41499999999999998,"5min":0.54000000000000004,"15min":0.56100000000000005},"min":{"1min":0.26200000000000001,"5min":0.25,"15min":0.25},"max":{"1min":0.64100000000000001,"5min":2.0760000000000001,"15min":2.0760000000000001},"last":0.60399999999999998}]},{"osd":2,"last update":"Tue Nov 28 20:00:56 2023","interfaces":[{"interface":"back","average":{"1min":0.40899999999999997,"5min":0.60899999999999999,"15min":0.64200000000000002},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":0.54500000000000004,"5min":3.7320000000000002,"15min":3.7320000000000002},"last":0.70799999999999996},{"interface":"front","average":{"1min":0.42199999999999999,"5min":0.69199999999999995,"15min":0.73699999999999999},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.54800000000000004,"5min":3.9089999999999998,"15min":3.9089999999999998},"last":0.67000000000000004}]},{"osd":3,"last update":"Tue Nov 28 20:00:56 2023","interfaces":[{"interface":"back","average":{"1min":0.52800000000000002,"5min":0.65000000000000002,"15min":0.67000000000000004},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.64700000000000002,"5min":1.6399999999999999,"15min":1.6399999999999999},"last":0.51500000000000001},{"interface":"front","average":{"1min":0.52000000000000002,"5min":0.66600000000000004,"15min":0.68999999999999995},"min":{"1min":0.37,"5min":0.317,"15min":0.317},"max":{"1min":0.748,"5min":2.5270000000000001,"15min":2.5270000000000001},"last":0.35399999999999998}]},{"osd":4,"last update":"Tue Nov 28 20:00:56 2023","interfaces":[{"interface":"back","average":{"1min":0.70199999999999996,"5min":0.85599999999999998,"15min":0.88200000000000001},"min":{"1min":0.46700000000000003,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":1.036,"5min":3.1659999999999999,"15min":3.1659999999999999},"last":0.75900000000000001},{"interface":"front","average":{"1min":0.68700000000000006,"5min":0.89400000000000002,"15min":0.92800000000000005},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.93700000000000006,"5min":3.7959999999999998,"15min":3.7959999999999998},"last":0.58499999999999996}]},{"osd":5,"last update":"Tue Nov 28 20:00:56 2023","interfaces":[{"interface":"back","average":{"1min":0.69799999999999995,"5min":0.93000000000000005,"15min":0.96899999999999997},"min":{"1min":0.50800000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":0.95599999999999996,"5min":4.1479999999999997,"15min":4.1479999999999997},"last":0.57399999999999995},{"interface":"front","average":{"1min":0.70299999999999996,"5min":0.86799999999999999,"15min":0.89600000000000002},"min":{"1min":0.499,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":1.052,"5min":3.5569999999999999,"15min":3.5569999999999999},"last":0.79200000000000004}]},{"osd":6,"last update":"Tue Nov 28 20:00:56 2023","interfaces":[{"interface":"back","average":{"1min":0.73999999999999999,"5min":0.94099999999999995,"15min":0.97499999999999998},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":1.004,"5min":2.863,"15min":2.863},"last":0.628},{"interface":"front","average":{"1min":0.77400000000000002,"5min":0.94099999999999995,"15min":0.96899999999999997},"min":{"1min":0.58099999999999996,"5min":0.56899999999999995,"15min":0.56899999999999995},"max":{"1min":1.075,"5min":3.371,"15min":3.371},"last":0.82199999999999995}]},{"osd":7,"last update":"Tue Nov 28 20:00:56 2023","interfaces":[{"interface":"back","average":{"1min":0.71599999999999997,"5min":0.95299999999999996,"15min":0.99299999999999999},"min":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":0.96899999999999997,"5min":3.8439999999999999,"15min":3.8439999999999999},"last":0.55500000000000005},{"interface":"front","average":{"1min":0.72699999999999998,"5min":0.97499999999999998,"15min":1.0169999999999999},"min":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":1.0569999999999999,"5min":3.9689999999999999,"15min":3.9689999999999999},"last":0.65500000000000003}]}]},{"osd":0,"up_from":13,"seq":55834574879,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31968,"kb_used_data":784,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339872,"statfs":{"total":96636764160,"available":96604028928,"internally_reserved":0,"allocated":802816,"data_stored":928081,"data_compressed":33374,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Nov 28 20:00:56 2023","interfaces":[{"interface":"back","average":{"1min":0.41299999999999998,"5min":0.63400000000000001,"15min":0.67100000000000004},"min":{"1min":0.27400000000000002,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.55800000000000005,"5min":4.883,"15min":4.883},"last":0.48999999999999999},{"interface":"front","average":{"1min":0.44,"5min":0.79000000000000004,"15min":0.84799999999999998},"min":{"1min":0.30199999999999999,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.63200000000000001,"5min":8.0800000000000001,"15min":8.0800000000000001},"last":0.432}]},{"osd":2,"last update":"Tue Nov 28 20:00:56 2023","interfaces":[{"interface":"back","average":{"1min":0.443,"5min":0.86699999999999999,"15min":0.93799999999999994},"min":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.59899999999999998,"5min":8.1029999999999998,"15min":8.1029999999999998},"last":0.77300000000000002},{"interface":"front","average":{"1min":0.47599999999999998,"5min":0.88400000000000001,"15min":0.95199999999999996},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.67600000000000005,"5min":8.1310000000000002,"15min":8.1310000000000002},"last":0.54900000000000004}]},{"osd":3,"last update":"Tue Nov 28 20:00:56 2023","interfaces":[{"interface":"back","average":{"1min":0.42899999999999999,"5min":0.68300000000000005,"15min":0.72499999999999998},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.57599999999999996,"5min":4.3949999999999996,"15min":4.3949999999999996},"last":0.61799999999999999},{"interface":"front","average":{"1min":0.48899999999999999,"5min":0.70299999999999996,"15min":0.73899999999999999},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.69899999999999995,"5min":4.3470000000000004,"15min":4.3470000000000004},"last":0.64000000000000001}]},{"osd":4,"last update":"Tue Nov 28 20:00:56 2023","interfaces":[{"interface":"back","average":{"1min":0.71999999999999997,"5min":0.98399999999999999,"15min":1.028},"min":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":1.123,"5min":4.6360000000000001,"15min":4.6360000000000001},"last":0.96199999999999997},{"interface":"front","average":{"1min":0.747,"5min":0.99099999999999999,"15min":1.032},"min":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":0.996,"5min":4.4710000000000001,"15min":4.4710000000000001},"last":0.82499999999999996}]},{"osd":5,"last update":"Tue Nov 28 20:00:56 2023","interfaces":[{"interface":"back","average":{"1min":0.74299999999999999,"5min":1,"15min":1.0429999999999999},"min":{"1min":0.54800000000000004,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":0.96399999999999997,"5min":4.6120000000000001,"15min":4.6120000000000001},"last":0.751},{"interface":"front","average":{"1min":0.74199999999999999,"5min":0.98999999999999999,"15min":1.0309999999999999},"min":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"max":{"1min":1.1659999999999999,"5min":4.5449999999999999,"15min":4.5449999999999999},"last":0.91200000000000003}]},{"osd":6,"last update":"Tue Nov 28 20:00:56 2023","interfaces":[{"interface":"back","average":{"1min":0.73499999999999999,"5min":1.01,"15min":1.056},"min":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":1.143,"5min":4.657,"15min":4.657},"last":0.88100000000000001},{"interface":"front","average":{"1min":0.74199999999999999,"5min":1.026,"15min":1.073},"min":{"1min":0.61199999999999999,"5min":0.58899999999999997,"15min":0.58899999999999997},"max":{"1min":1.0109999999999999,"5min":4.5259999999999998,"15min":4.5259999999999998},"last":0.66700000000000004}]},{"osd":7,"last update":"Tue Nov 28 20:00:56 2023","interfaces":[{"interface":"back","average":{"1min":0.72199999999999998,"5min":1.0249999999999999,"15min":1.075},"min":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":1.036,"5min":4.7320000000000002,"15min":4.7320000000000002},"last":0.80000000000000004},{"interface":"front","average":{"1min":0.755,"5min":0.98699999999999999,"15min":1.026},"min":{"1min":0.57499999999999996,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":1.1919999999999999,"5min":4.4939999999999998,"15min":4.4939999999999998},"last":0.72899999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33374,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33374,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":2376,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":776,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-28T20:01:14.968 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-11-28T20:01:14.968 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-11-28T20:01:15.155 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:15.149+0000 7f0c93e6b640 1 Processor -- start 2023-11-28T20:01:15.155 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:15.149+0000 7f0c93e6b640 1 -- start start 2023-11-28T20:01:15.157 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:15.153+0000 7f0c93e6b640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f0c8c14e2a0 0x7f0c8c1516a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:15.157 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:15.153+0000 7f0c93e6b640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f0c8c0a9910 0x7f0c8c0c38f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:15.157 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:15.153+0000 7f0c93e6b640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0c8c151210 con 0x7f0c8c0a9460 2023-11-28T20:01:15.157 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:15.153+0000 7f0c93e6b640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0c8c14e680 con 0x7f0c8c14e2a0 2023-11-28T20:01:15.157 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:15.153+0000 7f0c93e6b640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0c8c150be0 con 0x7f0c8c0a9910 2023-11-28T20:01:15.157 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:15.153+0000 7f0c91c07640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f0c8c14e2a0 0x7f0c8c1516a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:15.157 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:15.153+0000 7f0c91c07640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f0c8c14e2a0 0x7f0c8c1516a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:39936/0 (socket says 172.21.15.78:39936) 2023-11-28T20:01:15.157 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:15.153+0000 7f0c91c07640 1 -- 172.21.15.78:0/89339751 learned_addr learned my addr 172.21.15.78:0/89339751 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T20:01:15.157 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:15.153+0000 7f0c91c07640 1 -- 172.21.15.78:0/89339751 >> v2:172.21.15.179:3300/0 conn(0x7f0c8c0a9910 msgr2=0x7f0c8c0c38f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:01:15.158 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:15.153+0000 7f0c91c07640 1 --2- 172.21.15.78:0/89339751 >> v2:172.21.15.179:3300/0 conn(0x7f0c8c0a9910 0x7f0c8c0c38f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:15.158 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:15.153+0000 7f0c91c07640 1 -- 172.21.15.78:0/89339751 >> v1:172.21.15.179:6789/0 conn(0x7f0c8c0a9460 legacy=0x7f0c8c06bc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:01:15.158 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:15.153+0000 7f0c91c07640 1 -- 172.21.15.78:0/89339751 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c8c0c53c0 con 0x7f0c8c14e2a0 2023-11-28T20:01:15.159 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:15.157+0000 7f0c91c07640 1 --2- 172.21.15.78:0/89339751 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0c8c14e2a0 0x7f0c8c1516a0 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7f0c8c0a8e60 tx=0x7f0c8801c4c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d35a2a483bb6bbbe server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:01:15.160 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:15.157+0000 7f0c90c05640 1 -- 172.21.15.78:0/89339751 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c880ac630 con 0x7f0c8c14e2a0 2023-11-28T20:01:15.160 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:15.157+0000 7f0c90c05640 1 -- 172.21.15.78:0/89339751 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c880ac790 con 0x7f0c8c14e2a0 2023-11-28T20:01:15.160 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:15.157+0000 7f0c90c05640 1 -- 172.21.15.78:0/89339751 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c880acb20 con 0x7f0c8c14e2a0 2023-11-28T20:01:15.161 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:15.157+0000 7f0c93e6b640 1 -- 172.21.15.78:0/89339751 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0c8c14e2a0 msgr2=0x7f0c8c1516a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:01:15.161 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:15.157+0000 7f0c93e6b640 1 --2- 172.21.15.78:0/89339751 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0c8c14e2a0 0x7f0c8c1516a0 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7f0c8c0a8e60 tx=0x7f0c8801c4c0 comp rx=0 tx=0).stop 2023-11-28T20:01:15.162 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:15.157+0000 7f0c93e6b640 1 -- 172.21.15.78:0/89339751 shutdown_connections 2023-11-28T20:01:15.162 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:15.157+0000 7f0c93e6b640 1 --2- 172.21.15.78:0/89339751 >> v2:172.21.15.179:3300/0 conn(0x7f0c8c0a9910 0x7f0c8c0c38f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:15.162 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:15.157+0000 7f0c93e6b640 1 --2- 172.21.15.78:0/89339751 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0c8c14e2a0 0x7f0c8c1516a0 unknown :-1 s=CLOSED pgs=641 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:15.163 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:15.157+0000 7f0c93e6b640 1 -- 172.21.15.78:0/89339751 >> 172.21.15.78:0/89339751 conn(0x7f0c8c0c59f0 msgr2=0x7f0c8c0c5e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:01:15.163 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:15.157+0000 7f0c93e6b640 1 -- 172.21.15.78:0/89339751 shutdown_connections 2023-11-28T20:01:15.163 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:15.157+0000 7f0c93e6b640 1 -- 172.21.15.78:0/89339751 wait complete. 2023-11-28T20:01:15.165 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:15.157+0000 7f0c93e6b640 1 Processor -- start 2023-11-28T20:01:15.165 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:15.157+0000 7f0c93e6b640 1 -- start start 2023-11-28T20:01:15.165 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:15.157+0000 7f0c93e6b640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0c8c0a9460 0x7f0c8c1eb710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:15.165 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:15.157+0000 7f0c93e6b640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0c8c0a9910 0x7f0c8c1eeb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:15.165 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:15.157+0000 7f0c93e6b640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0c8c14e2a0 0x7f0c8c0aa4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:15.165 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:15.157+0000 7f0c93e6b640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c8c1eb280 con 0x7f0c8c0a9910 2023-11-28T20:01:15.165 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:15.157+0000 7f0c93e6b640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c8c1ef090 con 0x7f0c8c14e2a0 2023-11-28T20:01:15.165 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:15.157+0000 7f0c93e6b640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c8c1eac50 con 0x7f0c8c0a9460 2023-11-28T20:01:15.165 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:15.161+0000 7f0c91406640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0c8c0a9910 0x7f0c8c1eeb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:15.166 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:15.161+0000 7f0c91406640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0c8c0a9910 0x7f0c8c1eeb50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:39944/0 (socket says 172.21.15.78:39944) 2023-11-28T20:01:15.166 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:15.161+0000 7f0c91406640 1 -- 172.21.15.78:0/3862450881 learned_addr learned my addr 172.21.15.78:0/3862450881 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T20:01:15.166 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:15.161+0000 7f0c92408640 1 --2- 172.21.15.78:0/3862450881 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0c8c14e2a0 0x7f0c8c0aa4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:15.166 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:15.161+0000 7f0c91c07640 1 --2- 172.21.15.78:0/3862450881 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0c8c0a9460 0x7f0c8c1eb710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:15.166 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:15.161+0000 7f0c91406640 1 -- 172.21.15.78:0/3862450881 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0c8c0a9460 msgr2=0x7f0c8c1eb710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:01:15.166 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:15.161+0000 7f0c91406640 1 --2- 172.21.15.78:0/3862450881 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0c8c0a9460 0x7f0c8c1eb710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:15.166 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:15.161+0000 7f0c91406640 1 -- 172.21.15.78:0/3862450881 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0c8c14e2a0 msgr2=0x7f0c8c0aa4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:01:15.166 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:15.161+0000 7f0c91406640 1 --2- 172.21.15.78:0/3862450881 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0c8c14e2a0 0x7f0c8c0aa4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:15.166 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:15.161+0000 7f0c91406640 1 -- 172.21.15.78:0/3862450881 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c880094d0 con 0x7f0c8c0a9910 2023-11-28T20:01:15.167 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:15.161+0000 7f0c91406640 1 --2- 172.21.15.78:0/3862450881 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0c8c0a9910 0x7f0c8c1eeb50 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7f0c7c00c490 tx=0x7f0c7c001e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:01:15.167 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:15.161+0000 7f0c827fc640 1 -- 172.21.15.78:0/3862450881 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c7c003600 con 0x7f0c8c0a9910 2023-11-28T20:01:15.167 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:15.161+0000 7f0c827fc640 1 -- 172.21.15.78:0/3862450881 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c7c003780 con 0x7f0c8c0a9910 2023-11-28T20:01:15.167 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:15.161+0000 7f0c827fc640 1 -- 172.21.15.78:0/3862450881 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c7c003b70 con 0x7f0c8c0a9910 2023-11-28T20:01:15.167 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:15.161+0000 7f0c93e6b640 1 -- 172.21.15.78:0/3862450881 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0c8c072720 con 0x7f0c8c0a9910 2023-11-28T20:01:15.167 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:15.161+0000 7f0c93e6b640 1 -- 172.21.15.78:0/3862450881 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0c8c1eaf10 con 0x7f0c8c0a9910 2023-11-28T20:01:15.168 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:15.161+0000 7f0c93e6b640 1 -- 172.21.15.78:0/3862450881 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0c8c1eb430 con 0x7f0c8c0a9910 2023-11-28T20:01:15.169 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:15.161+0000 7f0c827fc640 1 -- 172.21.15.78:0/3862450881 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f0c7c003cd0 con 0x7f0c8c0a9910 2023-11-28T20:01:15.169 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:15.165+0000 7f0c827fc640 1 --2- 172.21.15.78:0/3862450881 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f0c70066470 0x7f0c70068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:15.169 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:15.165+0000 7f0c827fc640 1 -- 172.21.15.78:0/3862450881 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f0c7c0831c0 con 0x7f0c8c0a9910 2023-11-28T20:01:15.169 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:15.165+0000 7f0c91c07640 1 --2- 172.21.15.78:0/3862450881 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f0c70066470 0x7f0c70068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:15.169 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:15.165+0000 7f0c91c07640 1 --2- 172.21.15.78:0/3862450881 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f0c70066470 0x7f0c70068930 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f0c880ae000 tx=0x7f0c880a7000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:01:15.172 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:15.169+0000 7f0c827fc640 1 -- 172.21.15.78:0/3862450881 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f0c8c1eb430 con 0x7f0c8c0a9910 2023-11-28T20:01:15.373 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:15.369+0000 7f0c93e6b640 1 -- 172.21.15.78:0/3862450881 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7f0c8c067630 con 0x7f0c8c0a9910 2023-11-28T20:01:15.376 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:15.373+0000 7f0c827fc640 1 -- 172.21.15.78:0/3862450881 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v17) v1 ==== 190+0+147 (secure 0 0 0) 0x7f0c7c0170b0 con 0x7f0c8c0a9910 2023-11-28T20:01:15.376 INFO:teuthology.orchestra.run.smithi078.stdout:[client.0] 2023-11-28T20:01:15.376 INFO:teuthology.orchestra.run.smithi078.stdout: key = AQBORmZlPLeINhAAMdB7hy84hvX1S/pHYfkeJg== 2023-11-28T20:01:15.377 INFO:teuthology.orchestra.run.smithi078.stdout: caps mds = "allow" 2023-11-28T20:01:15.377 INFO:teuthology.orchestra.run.smithi078.stdout: caps mon = "allow r" 2023-11-28T20:01:15.377 INFO:teuthology.orchestra.run.smithi078.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2023-11-28T20:01:15.377 INFO:teuthology.orchestra.run.smithi078.stderr:updated caps for client.0 2023-11-28T20:01:15.379 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:15.373+0000 7f0c93e6b640 1 -- 172.21.15.78:0/3862450881 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f0c70066470 msgr2=0x7f0c70068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:01:15.379 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:15.373+0000 7f0c93e6b640 1 --2- 172.21.15.78:0/3862450881 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f0c70066470 0x7f0c70068930 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f0c880ae000 tx=0x7f0c880a7000 comp rx=0 tx=0).stop 2023-11-28T20:01:15.379 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:15.373+0000 7f0c93e6b640 1 -- 172.21.15.78:0/3862450881 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0c8c0a9910 msgr2=0x7f0c8c1eeb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:01:15.379 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:15.373+0000 7f0c93e6b640 1 --2- 172.21.15.78:0/3862450881 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0c8c0a9910 0x7f0c8c1eeb50 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7f0c7c00c490 tx=0x7f0c7c001e80 comp rx=0 tx=0).stop 2023-11-28T20:01:15.379 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:15.373+0000 7f0c93e6b640 1 -- 172.21.15.78:0/3862450881 shutdown_connections 2023-11-28T20:01:15.379 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:15.373+0000 7f0c93e6b640 1 --2- 172.21.15.78:0/3862450881 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f0c70066470 0x7f0c70068930 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:15.379 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:15.373+0000 7f0c93e6b640 1 --2- 172.21.15.78:0/3862450881 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0c8c14e2a0 0x7f0c8c0aa4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:15.379 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:15.373+0000 7f0c93e6b640 1 --2- 172.21.15.78:0/3862450881 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0c8c0a9910 0x7f0c8c1eeb50 unknown :-1 s=CLOSED pgs=642 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:15.379 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:15.373+0000 7f0c93e6b640 1 --2- 172.21.15.78:0/3862450881 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0c8c0a9460 0x7f0c8c1eb710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:15.379 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:15.373+0000 7f0c93e6b640 1 -- 172.21.15.78:0/3862450881 >> 172.21.15.78:0/3862450881 conn(0x7f0c8c0c59f0 msgr2=0x7f0c8c06bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:01:15.380 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:15.373+0000 7f0c93e6b640 1 -- 172.21.15.78:0/3862450881 shutdown_connections 2023-11-28T20:01:15.380 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:15.373+0000 7f0c93e6b640 1 -- 172.21.15.78:0/3862450881 wait complete. 2023-11-28T20:01:15.397 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-28T20:01:15.478 INFO:tasks.ceph.mds.a.smithi078.stderr:2023-11-28T20:01:15.473+0000 7fe2e56a9640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-11-28T20:01:15.539 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:15.533+0000 7fecfb9b8640 1 Processor -- start 2023-11-28T20:01:15.539 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:15.533+0000 7fecfb9b8640 1 -- start start 2023-11-28T20:01:15.541 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:15.537+0000 7fecfb9b8640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fecf4072580 0x7fecf40c3960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:15.541 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:15.537+0000 7fecfb9b8640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fecf40c0460 0x7fecf4155ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:15.541 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:15.537+0000 7fecfb9b8640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fecf40c1a50 con 0x7fecf40c0f30 2023-11-28T20:01:15.541 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:15.537+0000 7fecfb9b8640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fecf4159990 con 0x7fecf40c0460 2023-11-28T20:01:15.541 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:15.537+0000 7fecfb9b8640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fecf40c0890 con 0x7fecf4072580 2023-11-28T20:01:15.541 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:15.537+0000 7fecf9f55640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fecf40c0460 0x7fecf4155ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:15.541 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:15.537+0000 7fecf9754640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7fecf40c0f30 0x7fecf4159280 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:47370/0 (socket says 172.21.15.78:47370) 2023-11-28T20:01:15.541 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:15.537+0000 7fecf9754640 1 -- 172.21.15.78:0/3203846089 learned_addr learned my addr 172.21.15.78:0/3203846089 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-11-28T20:01:15.541 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:15.537+0000 7fecf8f53640 1 --2- 172.21.15.78:0/3203846089 >> v2:172.21.15.179:3300/0 conn(0x7fecf4072580 0x7fecf40c3960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:15.542 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:15.537+0000 7fecf9f55640 1 -- 172.21.15.78:0/3203846089 >> v2:172.21.15.179:3300/0 conn(0x7fecf4072580 msgr2=0x7fecf40c3960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:01:15.542 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:15.537+0000 7fecf9f55640 1 --2- 172.21.15.78:0/3203846089 >> v2:172.21.15.179:3300/0 conn(0x7fecf4072580 0x7fecf40c3960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:15.542 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:15.537+0000 7fecf9f55640 1 -- 172.21.15.78:0/3203846089 >> v1:172.21.15.78:6789/0 conn(0x7fecf40c0f30 legacy=0x7fecf4159280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:01:15.542 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:15.537+0000 7fecf9f55640 1 -- 172.21.15.78:0/3203846089 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fecf40c1ca0 con 0x7fecf40c0460 2023-11-28T20:01:15.544 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:15.541+0000 7fecf9f55640 1 --2- 172.21.15.78:0/3203846089 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fecf40c0460 0x7fecf4155ed0 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7fecf4066ed0 tx=0x7fecec01c710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=60ff5f6437a36aa5 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:01:15.544 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:15.541+0000 7fecebfff640 1 -- 172.21.15.78:0/3203846089 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecec0a6670 con 0x7fecf40c0460 2023-11-28T20:01:15.544 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:15.541+0000 7fecebfff640 1 -- 172.21.15.78:0/3203846089 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fecec0a67d0 con 0x7fecf40c0460 2023-11-28T20:01:15.544 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:15.541+0000 7fecebfff640 1 -- 172.21.15.78:0/3203846089 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecec0a6b60 con 0x7fecf40c0460 2023-11-28T20:01:15.545 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:15.541+0000 7fecfb9b8640 1 -- 172.21.15.78:0/3203846089 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fecf40c0460 msgr2=0x7fecf4155ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:01:15.545 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:15.541+0000 7fecfb9b8640 1 --2- 172.21.15.78:0/3203846089 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fecf40c0460 0x7fecf4155ed0 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7fecf4066ed0 tx=0x7fecec01c710 comp rx=0 tx=0).stop 2023-11-28T20:01:15.545 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:15.541+0000 7fecfb9b8640 1 -- 172.21.15.78:0/3203846089 shutdown_connections 2023-11-28T20:01:15.545 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:15.541+0000 7fecfb9b8640 1 --2- 172.21.15.78:0/3203846089 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fecf40c0460 0x7fecf4155ed0 unknown :-1 s=CLOSED pgs=644 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:15.545 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:15.541+0000 7fecfb9b8640 1 --2- 172.21.15.78:0/3203846089 >> v2:172.21.15.179:3300/0 conn(0x7fecf4072580 0x7fecf40c3960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:15.545 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:15.541+0000 7fecfb9b8640 1 -- 172.21.15.78:0/3203846089 >> 172.21.15.78:0/3203846089 conn(0x7fecf40a7810 msgr2=0x7fecf40a7c20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:01:15.545 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:15.541+0000 7fecfb9b8640 1 -- 172.21.15.78:0/3203846089 shutdown_connections 2023-11-28T20:01:15.545 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:15.541+0000 7fecfb9b8640 1 -- 172.21.15.78:0/3203846089 wait complete. 2023-11-28T20:01:15.546 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:15.541+0000 7fecfb9b8640 1 Processor -- start 2023-11-28T20:01:15.546 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:15.541+0000 7fecfb9b8640 1 -- start start 2023-11-28T20:01:15.549 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:15.541+0000 7fecfb9b8640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fecf4072580 0x7fecf40aad50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:15.549 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:15.541+0000 7fecfb9b8640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fecf40c0460 0x7fecf40a92c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:15.549 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:15.541+0000 7fecfb9b8640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fecf40c0f30 0x7fecf41531e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:15.549 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:15.545+0000 7fecfb9b8640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fecf40a9dc0 con 0x7fecf40c0460 2023-11-28T20:01:15.549 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:15.545+0000 7fecfb9b8640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fecf40aa0a0 con 0x7fecf4072580 2023-11-28T20:01:15.549 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:15.545+0000 7fecfb9b8640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fecf40aa380 con 0x7fecf40c0f30 2023-11-28T20:01:15.549 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:15.545+0000 7fecf8f53640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fecf40c0460 0x7fecf40a92c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:15.549 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:15.545+0000 7fecf8f53640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fecf40c0460 0x7fecf40a92c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:39958/0 (socket says 172.21.15.78:39958) 2023-11-28T20:01:15.549 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:15.545+0000 7fecf8f53640 1 -- 172.21.15.78:0/1688113024 learned_addr learned my addr 172.21.15.78:0/1688113024 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T20:01:15.550 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:15.545+0000 7fecf9f55640 1 --2- 172.21.15.78:0/1688113024 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fecf40c0f30 0x7fecf41531e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:15.550 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:15.545+0000 7fecf9754640 1 --2- 172.21.15.78:0/1688113024 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fecf4072580 0x7fecf40aad50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:15.550 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:15.545+0000 7fecf8f53640 1 -- 172.21.15.78:0/1688113024 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fecf40c0f30 msgr2=0x7fecf41531e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:01:15.550 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:15.545+0000 7fecf8f53640 1 --2- 172.21.15.78:0/1688113024 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fecf40c0f30 0x7fecf41531e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:15.550 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:15.545+0000 7fecf8f53640 1 -- 172.21.15.78:0/1688113024 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fecf4072580 msgr2=0x7fecf40aad50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:01:15.551 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:15.545+0000 7fecf8f53640 1 --2- 172.21.15.78:0/1688113024 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fecf4072580 0x7fecf40aad50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:15.551 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:15.545+0000 7fecf8f53640 1 -- 172.21.15.78:0/1688113024 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fecec009a70 con 0x7fecf40c0460 2023-11-28T20:01:15.551 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:15.545+0000 7fecf9f55640 1 --2- 172.21.15.78:0/1688113024 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fecf40c0f30 0x7fecf41531e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T20:01:15.551 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:15.545+0000 7fecf8f53640 1 --2- 172.21.15.78:0/1688113024 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fecf40c0460 0x7fecf40a92c0 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7fece400d5f0 tx=0x7fece400dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:01:15.551 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:15.545+0000 7fece9ffb640 1 -- 172.21.15.78:0/1688113024 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fece40125f0 con 0x7fecf40c0460 2023-11-28T20:01:15.552 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:15.545+0000 7fece9ffb640 1 -- 172.21.15.78:0/1688113024 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fece4012750 con 0x7fecf40c0460 2023-11-28T20:01:15.552 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:15.545+0000 7fece9ffb640 1 -- 172.21.15.78:0/1688113024 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fece4012ae0 con 0x7fecf40c0460 2023-11-28T20:01:15.552 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:15.545+0000 7fecfb9b8640 1 -- 172.21.15.78:0/1688113024 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fecf40aa660 con 0x7fecf40c0460 2023-11-28T20:01:15.552 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:15.545+0000 7fecfb9b8640 1 -- 172.21.15.78:0/1688113024 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fecf414fc40 con 0x7fecf40c0460 2023-11-28T20:01:15.554 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:15.545+0000 7fecfb9b8640 1 -- 172.21.15.78:0/1688113024 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fecf4067630 con 0x7fecf40c0460 2023-11-28T20:01:15.554 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:15.545+0000 7fece9ffb640 1 -- 172.21.15.78:0/1688113024 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fece4012c40 con 0x7fecf40c0460 2023-11-28T20:01:15.554 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:15.549+0000 7fece9ffb640 1 --2- 172.21.15.78:0/1688113024 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fecd80664a0 0x7fecd8068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:15.554 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:15.549+0000 7fece9ffb640 1 -- 172.21.15.78:0/1688113024 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 6029+0+0 (secure 0 0 0) 0x7fece40844c0 con 0x7fecf40c0460 2023-11-28T20:01:15.555 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:15.549+0000 7fecf9754640 1 --2- 172.21.15.78:0/1688113024 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fecd80664a0 0x7fecd8068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:15.555 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:15.549+0000 7fecf9754640 1 --2- 172.21.15.78:0/1688113024 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fecd80664a0 0x7fecd8068960 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7fecf0000f70 tx=0x7fecf0007c30 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:01:15.559 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:15.553+0000 7fece9ffb640 1 -- 172.21.15.78:0/1688113024 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fece4051800 con 0x7fecf40c0460 2023-11-28T20:01:15.760 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:15.757+0000 7fecfb9b8640 1 -- 172.21.15.78:0/1688113024 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fecf4159750 con 0x7fecf40c0460 2023-11-28T20:01:15.761 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:15.757+0000 7fece9ffb640 1 -- 172.21.15.78:0/1688113024 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 31 v31) v1 ==== 94+0+4911 (secure 0 0 0) 0x7fece4007380 con 0x7fecf40c0460 2023-11-28T20:01:15.761 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-11-28T20:01:15.761 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":31,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5384,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6834/837155031","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6832","nonce":837155031},{"type":"v1","addr":"172.21.15.179:6834","nonce":837155031}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":27},{"gid":5387,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6835/752467462","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6833","nonce":752467462},{"type":"v1","addr":"172.21.15.179:6835","nonce":752467462}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":27},{"gid":5889,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6835/1997036463","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6834","nonce":1997036463},{"type":"v1","addr":"172.21.15.78:6835","nonce":1997036463}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":27}],"filesystems":[{"mdsmap":{"epoch":31,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-28T20:01:09.868520+0000","modified":"2023-11-28T20:01:12.907972+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5892},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5892":{"gid":5892,"name":"a","rank":0,"incarnation":28,"state":"up:active","state_seq":3,"addr":"172.21.15.78:6837/115607035","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6836","nonce":115607035},{"type":"v1","addr":"172.21.15.78:6837","nonce":115607035}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":4}]} 2023-11-28T20:01:15.762 INFO:teuthology.orchestra.run.smithi078.stderr:dumped fsmap epoch 31 2023-11-28T20:01:15.763 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:15.757+0000 7fecfb9b8640 1 -- 172.21.15.78:0/1688113024 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fecd80664a0 msgr2=0x7fecd8068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:01:15.763 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:15.757+0000 7fecfb9b8640 1 --2- 172.21.15.78:0/1688113024 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fecd80664a0 0x7fecd8068960 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7fecf0000f70 tx=0x7fecf0007c30 comp rx=0 tx=0).stop 2023-11-28T20:01:15.763 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:15.757+0000 7fecfb9b8640 1 -- 172.21.15.78:0/1688113024 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fecf40c0460 msgr2=0x7fecf40a92c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:01:15.763 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:15.757+0000 7fecfb9b8640 1 --2- 172.21.15.78:0/1688113024 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fecf40c0460 0x7fecf40a92c0 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7fece400d5f0 tx=0x7fece400dab0 comp rx=0 tx=0).stop 2023-11-28T20:01:15.763 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:15.757+0000 7fecfb9b8640 1 -- 172.21.15.78:0/1688113024 shutdown_connections 2023-11-28T20:01:15.763 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:15.757+0000 7fecfb9b8640 1 --2- 172.21.15.78:0/1688113024 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fecd80664a0 0x7fecd8068960 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:15.764 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:15.757+0000 7fecfb9b8640 1 --2- 172.21.15.78:0/1688113024 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fecf40c0f30 0x7fecf41531e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:15.764 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:15.757+0000 7fecfb9b8640 1 --2- 172.21.15.78:0/1688113024 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fecf40c0460 0x7fecf40a92c0 unknown :-1 s=CLOSED pgs=645 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:15.764 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:15.757+0000 7fecfb9b8640 1 --2- 172.21.15.78:0/1688113024 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fecf4072580 0x7fecf40aad50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:15.764 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:15.757+0000 7fecfb9b8640 1 -- 172.21.15.78:0/1688113024 >> 172.21.15.78:0/1688113024 conn(0x7fecf40a7810 msgr2=0x7fecf406bdf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:01:15.764 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:15.757+0000 7fecfb9b8640 1 -- 172.21.15.78:0/1688113024 shutdown_connections 2023-11-28T20:01:15.764 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:15.757+0000 7fecfb9b8640 1 -- 172.21.15.78:0/1688113024 wait complete. 2023-11-28T20:01:16.187 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 31, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-11-28T20:01:09.868520+0000', 'modified': '2023-11-28T20:01:12.907972+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5892}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5892': {'gid': 5892, 'name': 'a', 'rank': 0, 'incarnation': 28, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.78:6837/115607035', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.78:6836', 'nonce': 115607035}, {'type': 'v1', 'addr': '172.21.15.78:6837', 'nonce': 115607035}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [10], 'metadata_pool': 9, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-11-28T20:01:16.187 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-11-28T20:01:16.188 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2023-11-28T20:01:16.326 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:16.321+0000 7f2b7b432640 1 Processor -- start 2023-11-28T20:01:16.326 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:16.321+0000 7f2b7b432640 1 -- start start 2023-11-28T20:01:16.328 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:16.321+0000 7f2b7b432640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f2b74152d30 0x7f2b7415cba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:16.328 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:16.321+0000 7f2b7b432640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2b740c3930 0x7f2b7406d160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:16.328 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:16.321+0000 7f2b7b432640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2b7415c710 con 0x7f2b740c3d90 2023-11-28T20:01:16.328 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:16.321+0000 7f2b7b432640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2b7406c360 con 0x7f2b74152d30 2023-11-28T20:01:16.328 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:16.321+0000 7f2b7b432640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2b740aa820 con 0x7f2b740c3930 2023-11-28T20:01:16.328 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:16.325+0000 7f2b791ce640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f2b74152d30 0x7f2b7415cba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:16.329 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:16.325+0000 7f2b799cf640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f2b740c3d90 0x7f2b740a9af0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:47382/0 (socket says 172.21.15.78:47382) 2023-11-28T20:01:16.329 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:16.325+0000 7f2b799cf640 1 -- 172.21.15.78:0/289075906 learned_addr learned my addr 172.21.15.78:0/289075906 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-11-28T20:01:16.329 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:16.325+0000 7f2b789cd640 1 --2- 172.21.15.78:0/289075906 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2b740c3930 0x7f2b7406d160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:16.329 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:16.325+0000 7f2b791ce640 1 -- 172.21.15.78:0/289075906 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2b740c3930 msgr2=0x7f2b7406d160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:01:16.329 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:16.325+0000 7f2b6bfff640 1 -- 172.21.15.78:0/289075906 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1758590411 0 0) 0x7f2b7415c710 con 0x7f2b740c3d90 2023-11-28T20:01:16.329 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:16.325+0000 7f2b791ce640 1 --2- 172.21.15.78:0/289075906 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2b740c3930 0x7f2b7406d160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:16.329 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:16.325+0000 7f2b791ce640 1 -- 172.21.15.78:0/289075906 >> v1:172.21.15.78:6789/0 conn(0x7f2b740c3d90 legacy=0x7f2b740a9af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:01:16.329 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:16.325+0000 7f2b791ce640 1 -- 172.21.15.78:0/289075906 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b7415c0c0 con 0x7f2b74152d30 2023-11-28T20:01:16.329 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:16.325+0000 7f2b789cd640 1 --2- 172.21.15.78:0/289075906 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2b740c3930 0x7f2b7406d160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T20:01:16.331 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:16.325+0000 7f2b791ce640 1 --2- 172.21.15.78:0/289075906 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2b74152d30 0x7f2b7415cba0 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7f2b700097c0 tx=0x7f2b7001c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=647952702042d3ae server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:01:16.331 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:16.325+0000 7f2b6bfff640 1 -- 172.21.15.78:0/289075906 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b700ad660 con 0x7f2b74152d30 2023-11-28T20:01:16.331 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:16.325+0000 7f2b6bfff640 1 -- 172.21.15.78:0/289075906 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b700ad7c0 con 0x7f2b74152d30 2023-11-28T20:01:16.331 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:16.325+0000 7f2b6bfff640 1 -- 172.21.15.78:0/289075906 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b700adb50 con 0x7f2b74152d30 2023-11-28T20:01:16.332 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:16.329+0000 7f2b7b432640 1 -- 172.21.15.78:0/289075906 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2b74152d30 msgr2=0x7f2b7415cba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:01:16.332 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:16.329+0000 7f2b7b432640 1 --2- 172.21.15.78:0/289075906 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2b74152d30 0x7f2b7415cba0 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7f2b700097c0 tx=0x7f2b7001c450 comp rx=0 tx=0).stop 2023-11-28T20:01:16.332 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:16.329+0000 7f2b7b432640 1 -- 172.21.15.78:0/289075906 shutdown_connections 2023-11-28T20:01:16.333 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:16.329+0000 7f2b7b432640 1 --2- 172.21.15.78:0/289075906 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2b740c3930 0x7f2b7406d160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:16.333 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:16.329+0000 7f2b7b432640 1 --2- 172.21.15.78:0/289075906 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2b74152d30 0x7f2b7415cba0 unknown :-1 s=CLOSED pgs=647 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:16.333 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:16.329+0000 7f2b7b432640 1 -- 172.21.15.78:0/289075906 >> 172.21.15.78:0/289075906 conn(0x7f2b7406b220 msgr2=0x7f2b740a77e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:01:16.333 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:16.329+0000 7f2b7b432640 1 -- 172.21.15.78:0/289075906 shutdown_connections 2023-11-28T20:01:16.333 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:16.329+0000 7f2b7b432640 1 -- 172.21.15.78:0/289075906 wait complete. 2023-11-28T20:01:16.333 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:16.329+0000 7f2b7b432640 1 Processor -- start 2023-11-28T20:01:16.334 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:16.329+0000 7f2b7b432640 1 -- start start 2023-11-28T20:01:16.336 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:16.329+0000 7f2b7b432640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2b740c3930 0x7f2b740a75b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:16.336 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:16.329+0000 7f2b7b432640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2b740c3d90 0x7f2b741520b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:16.336 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:16.329+0000 7f2b7b432640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2b74152d30 0x7f2b741efc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:16.337 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:16.329+0000 7f2b7b432640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b740a7af0 con 0x7f2b74152d30 2023-11-28T20:01:16.337 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:16.329+0000 7f2b7b432640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b741f5be0 con 0x7f2b740c3d90 2023-11-28T20:01:16.337 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:16.329+0000 7f2b7b432640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2b741f6110 con 0x7f2b740c3930 2023-11-28T20:01:16.337 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:16.329+0000 7f2b799cf640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2b74152d30 0x7f2b741efc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:16.337 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:16.329+0000 7f2b799cf640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2b74152d30 0x7f2b741efc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:39968/0 (socket says 172.21.15.78:39968) 2023-11-28T20:01:16.337 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:16.329+0000 7f2b799cf640 1 -- 172.21.15.78:0/1386064314 learned_addr learned my addr 172.21.15.78:0/1386064314 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T20:01:16.337 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:16.329+0000 7f2b791ce640 1 --2- 172.21.15.78:0/1386064314 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2b740c3930 0x7f2b740a75b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:16.337 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:16.333+0000 7f2b799cf640 1 -- 172.21.15.78:0/1386064314 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2b740c3930 msgr2=0x7f2b740a75b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:01:16.337 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:16.333+0000 7f2b789cd640 1 --2- 172.21.15.78:0/1386064314 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2b740c3d90 0x7f2b741520b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:16.337 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:16.333+0000 7f2b799cf640 1 --2- 172.21.15.78:0/1386064314 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2b740c3930 0x7f2b740a75b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:16.338 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:16.333+0000 7f2b799cf640 1 -- 172.21.15.78:0/1386064314 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2b740c3d90 msgr2=0x7f2b741520b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:01:16.338 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:16.333+0000 7f2b799cf640 1 --2- 172.21.15.78:0/1386064314 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2b740c3d90 0x7f2b741520b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:16.338 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:16.333+0000 7f2b799cf640 1 -- 172.21.15.78:0/1386064314 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b70009420 con 0x7f2b74152d30 2023-11-28T20:01:16.338 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:16.333+0000 7f2b791ce640 1 --2- 172.21.15.78:0/1386064314 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2b740c3930 0x7f2b740a75b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T20:01:16.338 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:16.333+0000 7f2b789cd640 1 --2- 172.21.15.78:0/1386064314 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2b740c3d90 0x7f2b741520b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T20:01:16.338 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:16.333+0000 7f2b799cf640 1 --2- 172.21.15.78:0/1386064314 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2b74152d30 0x7f2b741efc40 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7f2b6c00c7e0 tx=0x7f2b6c00cca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:01:16.338 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:16.333+0000 7f2b69ffb640 1 -- 172.21.15.78:0/1386064314 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b6c00a640 con 0x7f2b74152d30 2023-11-28T20:01:16.338 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:16.333+0000 7f2b69ffb640 1 -- 172.21.15.78:0/1386064314 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b6c00a7a0 con 0x7f2b74152d30 2023-11-28T20:01:16.338 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:16.333+0000 7f2b69ffb640 1 -- 172.21.15.78:0/1386064314 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b6c00ab50 con 0x7f2b74152d30 2023-11-28T20:01:16.338 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:16.333+0000 7f2b7b432640 1 -- 172.21.15.78:0/1386064314 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2b741f5e30 con 0x7f2b74152d30 2023-11-28T20:01:16.338 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:16.333+0000 7f2b7b432640 1 -- 172.21.15.78:0/1386064314 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2b741f20e0 con 0x7f2b74152d30 2023-11-28T20:01:16.339 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:16.333+0000 7f2b69ffb640 1 -- 172.21.15.78:0/1386064314 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f2b6c00acb0 con 0x7f2b74152d30 2023-11-28T20:01:16.339 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:16.337+0000 7f2b69ffb640 1 --2- 172.21.15.78:0/1386064314 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f2b58066470 0x7f2b58068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:16.340 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:16.337+0000 7f2b69ffb640 1 -- 172.21.15.78:0/1386064314 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f2b6c083460 con 0x7f2b74152d30 2023-11-28T20:01:16.340 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:16.337+0000 7f2b791ce640 1 --2- 172.21.15.78:0/1386064314 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f2b58066470 0x7f2b58068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:16.340 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:16.337+0000 7f2b7e7ac000 1 Processor -- start 2023-11-28T20:01:16.340 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:16.337+0000 7f2b7e7ac000 1 -- start start 2023-11-28T20:01:16.340 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:16.337+0000 7f2b791ce640 1 --2- 172.21.15.78:0/1386064314 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f2b58066470 0x7f2b58068930 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f2b700af000 tx=0x7f2b70008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:01:16.342 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:16.337+0000 7f2b7e7ac000 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5596a53172e0 0x5596a53176c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:16.342 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:16.337+0000 7f2b7e7ac000 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5596a5317c00 0x5596a5317fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:16.343 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:16.337+0000 7f2b7e7ac000 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5596a5318520 0x5596a5361a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:16.343 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:16.337+0000 7f2b7e7ac000 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x5596a5184130 con 0x5596a5317c00 2023-11-28T20:01:16.343 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:16.337+0000 7f2b7e7ac000 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x5596a51719a0 con 0x5596a53172e0 2023-11-28T20:01:16.343 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:16.337+0000 7f2b7e7ac000 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x5596a516eed0 con 0x5596a5318520 2023-11-28T20:01:16.343 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:16.337+0000 7f2b789cd640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5596a5317c00 0x5596a5317fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:16.343 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:16.337+0000 7f2b789cd640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5596a5317c00 0x5596a5317fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:39982/0 (socket says 172.21.15.78:39982) 2023-11-28T20:01:16.343 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:16.337+0000 7f2b789cd640 1 -- 172.21.15.78:0/882072092 learned_addr learned my addr 172.21.15.78:0/882072092 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T20:01:16.343 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:16.337+0000 7f2b791ce640 1 --2- 172.21.15.78:0/882072092 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5596a53172e0 0x5596a53176c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:16.343 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:16.337+0000 7f2b799cf640 1 --2- 172.21.15.78:0/882072092 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5596a5318520 0x5596a5361a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:16.343 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:16.337+0000 7f2b789cd640 1 -- 172.21.15.78:0/882072092 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5596a5318520 msgr2=0x5596a5361a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:01:16.344 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:16.337+0000 7f2b789cd640 1 --2- 172.21.15.78:0/882072092 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5596a5318520 0x5596a5361a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:16.344 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:16.337+0000 7f2b789cd640 1 -- 172.21.15.78:0/882072092 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5596a53172e0 msgr2=0x5596a53176c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:01:16.344 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:16.337+0000 7f2b789cd640 1 --2- 172.21.15.78:0/882072092 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5596a53172e0 0x5596a53176c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:16.344 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:16.337+0000 7f2b789cd640 1 -- 172.21.15.78:0/882072092 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5596a4e62890 con 0x5596a5317c00 2023-11-28T20:01:16.344 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:16.337+0000 7f2b799cf640 1 --2- 172.21.15.78:0/882072092 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5596a5318520 0x5596a5361a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T20:01:16.344 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:16.337+0000 7f2b789cd640 1 --2- 172.21.15.78:0/882072092 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5596a5317c00 0x5596a5317fe0 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7f2b6400b9d0 tx=0x7f2b6400be90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=97a6925a130cc31d server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:01:16.344 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:16.337+0000 7f2b56ffd640 1 -- 172.21.15.78:0/882072092 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b6400dcd0 con 0x5596a5317c00 2023-11-28T20:01:16.344 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:16.337+0000 7f2b56ffd640 1 -- 172.21.15.78:0/882072092 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b6400c040 con 0x5596a5317c00 2023-11-28T20:01:16.344 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:16.337+0000 7f2b56ffd640 1 -- 172.21.15.78:0/882072092 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b64012660 con 0x5596a5317c00 2023-11-28T20:01:16.347 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:16.337+0000 7f2b7e7ac000 1 -- 172.21.15.78:0/882072092 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5596a5317c00 msgr2=0x5596a5317fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:01:16.348 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:16.337+0000 7f2b7e7ac000 1 --2- 172.21.15.78:0/882072092 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5596a5317c00 0x5596a5317fe0 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7f2b6400b9d0 tx=0x7f2b6400be90 comp rx=0 tx=0).stop 2023-11-28T20:01:16.348 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:16.337+0000 7f2b7e7ac000 1 -- 172.21.15.78:0/882072092 shutdown_connections 2023-11-28T20:01:16.348 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:16.337+0000 7f2b7e7ac000 1 --2- 172.21.15.78:0/882072092 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5596a5318520 0x5596a5361a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:16.348 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:16.337+0000 7f2b7e7ac000 1 --2- 172.21.15.78:0/882072092 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5596a5317c00 0x5596a5317fe0 unknown :-1 s=CLOSED pgs=649 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:16.348 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:16.337+0000 7f2b7e7ac000 1 --2- 172.21.15.78:0/882072092 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5596a53172e0 0x5596a53176c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:16.348 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:16.337+0000 7f2b7e7ac000 1 -- 172.21.15.78:0/882072092 >> 172.21.15.78:0/882072092 conn(0x5596a5320190 msgr2=0x5596a53577a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:01:16.348 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:16.337+0000 7f2b7e7ac000 1 -- 172.21.15.78:0/882072092 shutdown_connections 2023-11-28T20:01:16.348 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:16.337+0000 7f2b7e7ac000 1 -- 172.21.15.78:0/882072092 wait complete. 2023-11-28T20:01:16.348 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:16.341+0000 7f2b7e7ac000 1 -- start start 2023-11-28T20:01:16.348 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:16.341+0000 7f2b7e7ac000 1 Processor -- start 2023-11-28T20:01:16.349 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:16.341+0000 7f2b7e7ac000 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5596a53172e0 0x5596a5354120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:16.349 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:16.341+0000 7f2b7e7ac000 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5596a5317c00 0x5596a531db00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:16.349 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:16.341+0000 7f2b7e7ac000 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5596a5318520 0x5596a531e040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:16.349 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:16.341+0000 7f2b7e7ac000 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x5596a516a7c0 con 0x5596a5317c00 2023-11-28T20:01:16.349 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:16.341+0000 7f2b7e7ac000 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x5596a5122bf0 con 0x5596a5318520 2023-11-28T20:01:16.349 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:16.341+0000 7f2b7e7ac000 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x5596a5128a90 con 0x5596a53172e0 2023-11-28T20:01:16.349 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:16.341+0000 7f2b7e7ac000 10 client.0 _ll_register_callbacks cb 0x5596a53053c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-28T20:01:16.349 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:16.341+0000 7f2b789cd640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5596a5317c00 0x5596a531db00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:16.349 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:16.341+0000 7f2b789cd640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5596a5317c00 0x5596a531db00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:39990/0 (socket says 172.21.15.78:39990) 2023-11-28T20:01:16.349 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:16.341+0000 7f2b789cd640 1 -- 172.21.15.78:0/1591876078 learned_addr learned my addr 172.21.15.78:0/1591876078 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T20:01:16.349 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:16.341+0000 7f2b791ce640 1 --2- 172.21.15.78:0/1591876078 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5596a53172e0 0x5596a5354120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:16.350 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:16.341+0000 7f2b799cf640 1 --2- 172.21.15.78:0/1591876078 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5596a5318520 0x5596a531e040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:16.350 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:16.341+0000 7f2b789cd640 1 -- 172.21.15.78:0/1591876078 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5596a53172e0 msgr2=0x5596a5354120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:01:16.350 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:16.341+0000 7f2b789cd640 1 --2- 172.21.15.78:0/1591876078 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5596a53172e0 0x5596a5354120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:16.350 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:16.341+0000 7f2b789cd640 1 -- 172.21.15.78:0/1591876078 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5596a5318520 msgr2=0x5596a531e040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:01:16.350 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:16.341+0000 7f2b789cd640 1 --2- 172.21.15.78:0/1591876078 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5596a5318520 0x5596a531e040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:16.350 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:16.341+0000 7f2b789cd640 1 -- 172.21.15.78:0/1591876078 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2b6400b600 con 0x5596a5317c00 2023-11-28T20:01:16.350 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:16.341+0000 7f2b789cd640 1 --2- 172.21.15.78:0/1591876078 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5596a5317c00 0x5596a531db00 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7f2b64008010 tx=0x7f2b64010000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d001486e4872e14b server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:01:16.350 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:16.341+0000 7f2b4ffff640 10 client.0 ms_handle_connect on v2:172.21.15.78:3300/0 2023-11-28T20:01:16.350 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:16.341+0000 7f2b4ffff640 1 -- 172.21.15.78:0/1591876078 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b64020070 con 0x5596a5317c00 2023-11-28T20:01:16.350 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:16.341+0000 7f2b4ffff640 1 -- 172.21.15.78:0/1591876078 <== mon.0 v2:172.21.15.78:3300/0 2 ==== osd_map(61..61 src has 1..61) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f2b640129a0 con 0x5596a5317c00 2023-11-28T20:01:16.350 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:16.341+0000 7f2b7e7ac000 1 -- 172.21.15.78:0/1591876078 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5596a512c470 con 0x5596a5317c00 2023-11-28T20:01:16.350 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:16.341+0000 7f2b4ffff640 1 -- 172.21.15.78:0/1591876078 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2b6400b200 con 0x5596a5317c00 2023-11-28T20:01:16.351 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:16.341+0000 7f2b7e7ac000 10 client.6039 fetch_fsmap learned FSMap version 31 2023-11-28T20:01:16.351 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:16.341+0000 7f2b7e7ac000 1 -- 172.21.15.78:0/1591876078 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=2+}) v3 -- 0x5596a512b190 con 0x5596a5317c00 2023-11-28T20:01:16.353 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:16.341+0000 7f2b4ffff640 1 -- 172.21.15.78:0/1591876078 <== mon.0 v2:172.21.15.78:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5596a512c470 con 0x5596a5317c00 2023-11-28T20:01:16.353 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:16.341+0000 7f2b4ffff640 1 -- 172.21.15.78:0/1591876078 <== mon.0 v2:172.21.15.78:3300/0 5 ==== fsmap(e 31) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f2b64012b60 con 0x5596a5317c00 2023-11-28T20:01:16.353 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:16.341+0000 7f2b7e7ac000 10 client.6039 fetch_fsmap finished waiting for FSMap version 31 2023-11-28T20:01:16.353 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:16.341+0000 7f2b7e7ac000 10 client.6039 resolve_mds: resolved name 'a' to daemon mds.a 2023-11-28T20:01:16.353 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:16.341+0000 7f2b7e7ac000 20 client.6039 populate_metadata read hostname 'smithi078' 2023-11-28T20:01:16.354 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:16.341+0000 7f2b7e7ac000 1 --2- 172.21.15.78:0/1591876078 >> [v2:172.21.15.78:6836/115607035,v1:172.21.15.78:6837/115607035] conn(0x5596a531ea50 0x5596a531ee30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:16.354 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:16.341+0000 7f2b7e7ac000 4 client.6039 mds_command: new command op to 5892 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-11-28T20:01:16.354 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:16.341+0000 7f2b7e7ac000 1 -- 172.21.15.78:0/1591876078 --> [v2:172.21.15.78:6836/115607035,v1:172.21.15.78:6837/115607035] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5596a512fb50 con 0x5596a531ea50 2023-11-28T20:01:16.354 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:16.341+0000 7f2b791ce640 1 --2- 172.21.15.78:0/1591876078 >> [v2:172.21.15.78:6836/115607035,v1:172.21.15.78:6837/115607035] conn(0x5596a531ea50 0x5596a531ee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:16.354 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:16.345+0000 7f2b791ce640 1 --2- 172.21.15.78:0/1591876078 >> [v2:172.21.15.78:6836/115607035,v1:172.21.15.78:6837/115607035] conn(0x5596a531ea50 0x5596a531ee30 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=17dc1e2d09121a22 server_cookie=769325d012e41fff in_seq=0 out_seq=0 2023-11-28T20:01:16.354 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:16.345+0000 7f2b4ffff640 10 client.6039 ms_handle_connect on v2:172.21.15.78:6836/115607035 2023-11-28T20:01:16.355 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:16.345+0000 7f2b4ffff640 1 -- 172.21.15.78:0/1591876078 <== mds.0 v2:172.21.15.78:6836/115607035 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x5596a512fb50 con 0x5596a531ea50 2023-11-28T20:01:16.355 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:16.345+0000 7f2b4ffff640 10 client.6039 handle_command_reply: tid=0 2023-11-28T20:01:16.356 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:16.345+0000 7f2b7e7ac000 1 client.6039 shutdown 2023-11-28T20:01:16.356 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:16.345+0000 7f2b7e7ac000 1 -- 172.21.15.78:0/1591876078 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5596a5317c00 msgr2=0x5596a531db00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:01:16.356 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:16.345+0000 7f2b7e7ac000 1 --2- 172.21.15.78:0/1591876078 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5596a5317c00 0x5596a531db00 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7f2b64008010 tx=0x7f2b64010000 comp rx=0 tx=0).stop 2023-11-28T20:01:16.356 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:16.345+0000 7f2b7e7ac000 1 -- 172.21.15.78:0/1591876078 shutdown_connections 2023-11-28T20:01:16.356 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:16.345+0000 7f2b7e7ac000 1 --2- 172.21.15.78:0/1591876078 >> [v2:172.21.15.78:6836/115607035,v1:172.21.15.78:6837/115607035] conn(0x5596a531ea50 0x5596a531ee30 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:16.356 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:16.345+0000 7f2b7e7ac000 1 --2- 172.21.15.78:0/1591876078 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5596a5318520 0x5596a531e040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:16.356 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:16.345+0000 7f2b7e7ac000 1 --2- 172.21.15.78:0/1591876078 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5596a5317c00 0x5596a531db00 unknown :-1 s=CLOSED pgs=650 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:16.356 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:16.345+0000 7f2b4ffff640 0 client.6039 ms_handle_reset on v2:172.21.15.78:6836/115607035 2023-11-28T20:01:16.357 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:16.345+0000 7f2b7e7ac000 1 --2- 172.21.15.78:0/1591876078 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5596a53172e0 0x5596a5354120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:16.357 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:16.345+0000 7f2b7e7ac000 1 -- 172.21.15.78:0/1591876078 >> 172.21.15.78:0/1591876078 conn(0x5596a5320190 msgr2=0x5596a53169d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:01:16.357 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:16.345+0000 7f2b7e7ac000 1 -- 172.21.15.78:0/1591876078 shutdown_connections 2023-11-28T20:01:16.357 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:16.345+0000 7f2b7e7ac000 1 -- 172.21.15.78:0/1591876078 wait complete. 2023-11-28T20:01:16.357 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:16.345+0000 7f2b7e7ac000 20 client.6039 trim_cache size 0 max 16384 2023-11-28T20:01:16.364 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:16.361+0000 7f2b7e7ac000 1 Processor -- start 2023-11-28T20:01:16.364 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:16.361+0000 7f2b7e7ac000 1 -- start start 2023-11-28T20:01:16.366 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:16.361+0000 7f2b7e7ac000 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5596a53172e0 0x5596a5372220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:16.366 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:16.361+0000 7f2b7e7ac000 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5596a5317c00 0x5596a531d8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:16.366 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:16.361+0000 7f2b7e7ac000 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5596a5318520 0x5596a531ddf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:16.366 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:16.361+0000 7f2b7e7ac000 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x5596a4e23940 con 0x5596a53172e0 2023-11-28T20:01:16.366 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:16.361+0000 7f2b7e7ac000 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x5596a5204600 con 0x5596a5318520 2023-11-28T20:01:16.366 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:16.361+0000 7f2b7e7ac000 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x5596a5143e10 con 0x5596a5317c00 2023-11-28T20:01:16.366 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:16.361+0000 7f2b791ce640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5596a53172e0 0x5596a5372220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:16.366 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:16.361+0000 7f2b791ce640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5596a53172e0 0x5596a5372220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:40004/0 (socket says 172.21.15.78:40004) 2023-11-28T20:01:16.366 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:16.361+0000 7f2b791ce640 1 -- 172.21.15.78:0/4122819607 learned_addr learned my addr 172.21.15.78:0/4122819607 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T20:01:16.367 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:16.361+0000 7f2b791ce640 1 -- 172.21.15.78:0/4122819607 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5596a5317c00 msgr2=0x5596a531d8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:01:16.367 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:16.361+0000 7f2b789cd640 1 --2- 172.21.15.78:0/4122819607 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5596a5317c00 0x5596a531d8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:16.367 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:16.361+0000 7f2b799cf640 1 --2- 172.21.15.78:0/4122819607 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5596a5318520 0x5596a531ddf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:16.367 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:16.361+0000 7f2b791ce640 1 --2- 172.21.15.78:0/4122819607 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5596a5317c00 0x5596a531d8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:16.367 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:16.361+0000 7f2b791ce640 1 -- 172.21.15.78:0/4122819607 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5596a5318520 msgr2=0x5596a531ddf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:01:16.367 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:16.361+0000 7f2b791ce640 1 --2- 172.21.15.78:0/4122819607 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5596a5318520 0x5596a531ddf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:16.367 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:16.361+0000 7f2b791ce640 1 -- 172.21.15.78:0/4122819607 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5596a5111490 con 0x5596a53172e0 2023-11-28T20:01:16.367 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:16.361+0000 7f2b789cd640 1 --2- 172.21.15.78:0/4122819607 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5596a5317c00 0x5596a531d8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T20:01:16.367 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:16.361+0000 7f2b799cf640 1 --2- 172.21.15.78:0/4122819607 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5596a5318520 0x5596a531ddf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T20:01:16.367 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:16.361+0000 7f2b791ce640 1 --2- 172.21.15.78:0/4122819607 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5596a53172e0 0x5596a5372220 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7f2b7001a080 tx=0x7f2b70004740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=89f4c03b1f201b1b server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:01:16.371 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:16.361+0000 7f2b577fe640 1 -- 172.21.15.78:0/4122819607 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b700bf030 con 0x5596a53172e0 2023-11-28T20:01:16.371 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:16.361+0000 7f2b577fe640 1 -- 172.21.15.78:0/4122819607 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b700c0040 con 0x5596a53172e0 2023-11-28T20:01:16.371 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:16.361+0000 7f2b577fe640 1 -- 172.21.15.78:0/4122819607 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b70003820 con 0x5596a53172e0 2023-11-28T20:01:16.371 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:16.361+0000 7f2b7e7ac000 1 -- 172.21.15.78:0/4122819607 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5596a53172e0 msgr2=0x5596a5372220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:01:16.371 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:16.361+0000 7f2b7e7ac000 1 --2- 172.21.15.78:0/4122819607 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5596a53172e0 0x5596a5372220 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7f2b7001a080 tx=0x7f2b70004740 comp rx=0 tx=0).stop 2023-11-28T20:01:16.372 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:16.361+0000 7f2b7e7ac000 1 -- 172.21.15.78:0/4122819607 shutdown_connections 2023-11-28T20:01:16.372 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:16.361+0000 7f2b7e7ac000 1 --2- 172.21.15.78:0/4122819607 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5596a5317c00 0x5596a531d8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:16.372 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:16.361+0000 7f2b7e7ac000 1 --2- 172.21.15.78:0/4122819607 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5596a5318520 0x5596a531ddf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:16.372 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:16.361+0000 7f2b7e7ac000 1 --2- 172.21.15.78:0/4122819607 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5596a53172e0 0x5596a5372220 unknown :-1 s=CLOSED pgs=651 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:16.372 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:16.361+0000 7f2b7e7ac000 1 -- 172.21.15.78:0/4122819607 >> 172.21.15.78:0/4122819607 conn(0x5596a5320190 msgr2=0x5596a531ee30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:01:16.372 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:16.361+0000 7f2b7e7ac000 1 -- 172.21.15.78:0/4122819607 shutdown_connections 2023-11-28T20:01:16.373 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:16.361+0000 7f2b7e7ac000 1 -- 172.21.15.78:0/4122819607 wait complete. 2023-11-28T20:01:16.373 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:16.365+0000 7f2b7e7ac000 1 -- start start 2023-11-28T20:01:16.373 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:16.365+0000 7f2b7e7ac000 1 Processor -- start 2023-11-28T20:01:16.373 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:16.365+0000 7f2b7e7ac000 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5596a53172e0 0x5596a536e3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:16.373 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:16.365+0000 7f2b7e7ac000 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5596a5317c00 0x5596a536e900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:16.373 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:16.365+0000 7f2b7e7ac000 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5596a5318520 0x5596a536ee40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:16.374 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:16.365+0000 7f2b7e7ac000 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x5596a5355440 con 0x5596a53172e0 2023-11-28T20:01:16.374 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:16.365+0000 7f2b7e7ac000 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x5596a5169650 con 0x5596a5317c00 2023-11-28T20:01:16.374 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:16.365+0000 7f2b7e7ac000 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x5596a5123d60 con 0x5596a5318520 2023-11-28T20:01:16.374 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:16.365+0000 7f2b7e7ac000 10 client.0 _ll_register_callbacks cb 0x5596a52e5bd0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-28T20:01:16.374 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:16.365+0000 7f2b791ce640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5596a53172e0 0x5596a536e3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:16.374 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:16.365+0000 7f2b791ce640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5596a53172e0 0x5596a536e3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:40008/0 (socket says 172.21.15.78:40008) 2023-11-28T20:01:16.374 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:16.365+0000 7f2b791ce640 1 -- 172.21.15.78:0/1023950223 learned_addr learned my addr 172.21.15.78:0/1023950223 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T20:01:16.374 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:16.365+0000 7f2b789cd640 1 --2- 172.21.15.78:0/1023950223 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5596a5317c00 0x5596a536e900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:16.374 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:16.365+0000 7f2b799cf640 1 --2- 172.21.15.78:0/1023950223 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5596a5318520 0x5596a536ee40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:16.374 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:16.365+0000 7f2b791ce640 1 -- 172.21.15.78:0/1023950223 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5596a5318520 msgr2=0x5596a536ee40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:01:16.374 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:16.365+0000 7f2b791ce640 1 --2- 172.21.15.78:0/1023950223 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5596a5318520 0x5596a536ee40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:16.375 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:16.365+0000 7f2b791ce640 1 -- 172.21.15.78:0/1023950223 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5596a5317c00 msgr2=0x5596a536e900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:01:16.375 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:16.365+0000 7f2b791ce640 1 --2- 172.21.15.78:0/1023950223 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5596a5317c00 0x5596a536e900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:16.375 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:16.365+0000 7f2b791ce640 1 -- 172.21.15.78:0/1023950223 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2b7415c0c0 con 0x5596a53172e0 2023-11-28T20:01:16.375 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:16.365+0000 7f2b791ce640 1 --2- 172.21.15.78:0/1023950223 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5596a53172e0 0x5596a536e3c0 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7f2b70008010 tx=0x7f2b7001ac90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e89757202d584ff7 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:01:16.375 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:16.365+0000 7f2b4ffff640 10 client.0 ms_handle_connect on v2:172.21.15.78:3300/0 2023-11-28T20:01:16.375 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:16.365+0000 7f2b4ffff640 1 -- 172.21.15.78:0/1023950223 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b700bf040 con 0x5596a53172e0 2023-11-28T20:01:16.375 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:16.365+0000 7f2b4ffff640 1 -- 172.21.15.78:0/1023950223 <== mon.0 v2:172.21.15.78:3300/0 2 ==== osd_map(61..61 src has 1..61) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f2b700039e0 con 0x5596a53172e0 2023-11-28T20:01:16.375 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:16.365+0000 7f2b7e7ac000 1 -- 172.21.15.78:0/1023950223 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5596a5169110 con 0x5596a53172e0 2023-11-28T20:01:16.375 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:16.365+0000 7f2b4ffff640 1 -- 172.21.15.78:0/1023950223 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2b70003ba0 con 0x5596a53172e0 2023-11-28T20:01:16.375 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:16.365+0000 7f2b7e7ac000 10 client.6045 fetch_fsmap learned FSMap version 31 2023-11-28T20:01:16.375 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:16.365+0000 7f2b7e7ac000 1 -- 172.21.15.78:0/1023950223 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=2+}) v3 -- 0x5596a4e62cc0 con 0x5596a53172e0 2023-11-28T20:01:16.376 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:16.365+0000 7f2b4ffff640 1 -- 172.21.15.78:0/1023950223 <== mon.0 v2:172.21.15.78:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5596a5169110 con 0x5596a53172e0 2023-11-28T20:01:16.376 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:16.365+0000 7f2b4ffff640 1 -- 172.21.15.78:0/1023950223 <== mon.0 v2:172.21.15.78:3300/0 5 ==== fsmap(e 31) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f2b70003d00 con 0x5596a53172e0 2023-11-28T20:01:16.376 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:16.365+0000 7f2b7e7ac000 10 client.6045 fetch_fsmap finished waiting for FSMap version 31 2023-11-28T20:01:16.376 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:16.365+0000 7f2b7e7ac000 10 client.6045 resolve_mds: resolved name 'a' to daemon mds.a 2023-11-28T20:01:16.376 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:16.365+0000 7f2b7e7ac000 20 client.6045 populate_metadata read hostname 'smithi078' 2023-11-28T20:01:16.376 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:16.365+0000 7f2b7e7ac000 1 --2- 172.21.15.78:0/1023950223 >> [v2:172.21.15.78:6836/115607035,v1:172.21.15.78:6837/115607035] conn(0x5596a536f7d0 0x5596a53c4b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:16.376 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:16.365+0000 7f2b7e7ac000 4 client.6045 mds_command: new command op to 5892 tid=0 multi_id=0 [{"prefix": "status"}] 2023-11-28T20:01:16.376 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:16.365+0000 7f2b7e7ac000 1 -- 172.21.15.78:0/1023950223 --> [v2:172.21.15.78:6836/115607035,v1:172.21.15.78:6837/115607035] -- command(tid 0: {"prefix": "status"}) v1 -- 0x5596a51989a0 con 0x5596a536f7d0 2023-11-28T20:01:16.376 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:16.365+0000 7f2b789cd640 1 --2- 172.21.15.78:0/1023950223 >> [v2:172.21.15.78:6836/115607035,v1:172.21.15.78:6837/115607035] conn(0x5596a536f7d0 0x5596a53c4b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:16.377 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:16.365+0000 7f2b789cd640 1 --2- 172.21.15.78:0/1023950223 >> [v2:172.21.15.78:6836/115607035,v1:172.21.15.78:6837/115607035] conn(0x5596a536f7d0 0x5596a53c4b40 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a04fca01ab71da90 server_cookie=3336804ab167ecdd in_seq=0 out_seq=0 2023-11-28T20:01:16.378 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:16.365+0000 7f2b4ffff640 10 client.6045 ms_handle_connect on v2:172.21.15.78:6836/115607035 2023-11-28T20:01:16.378 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:16.369+0000 7f2b4ffff640 1 -- 172.21.15.78:0/1023950223 <== mds.0 v2:172.21.15.78:6836/115607035 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+331 (crc 0 0 0) 0x5596a51989a0 con 0x5596a536f7d0 2023-11-28T20:01:16.378 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:16.369+0000 7f2b4ffff640 10 client.6045 handle_command_reply: tid=0 2023-11-28T20:01:16.378 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:16.369+0000 7f2b7e7ac000 1 client.6045 shutdown 2023-11-28T20:01:16.378 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:16.369+0000 7f2b7e7ac000 1 -- 172.21.15.78:0/1023950223 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5596a53172e0 msgr2=0x5596a536e3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:01:16.378 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:16.369+0000 7f2b7e7ac000 1 --2- 172.21.15.78:0/1023950223 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5596a53172e0 0x5596a536e3c0 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7f2b70008010 tx=0x7f2b7001ac90 comp rx=0 tx=0).stop 2023-11-28T20:01:16.378 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:16.369+0000 7f2b7e7ac000 1 -- 172.21.15.78:0/1023950223 shutdown_connections 2023-11-28T20:01:16.378 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:16.369+0000 7f2b7e7ac000 1 --2- 172.21.15.78:0/1023950223 >> [v2:172.21.15.78:6836/115607035,v1:172.21.15.78:6837/115607035] conn(0x5596a536f7d0 0x5596a53c4b40 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:16.379 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:16.369+0000 7f2b7e7ac000 1 --2- 172.21.15.78:0/1023950223 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5596a5318520 0x5596a536ee40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:16.379 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:16.369+0000 7f2b7e7ac000 1 --2- 172.21.15.78:0/1023950223 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5596a5317c00 0x5596a536e900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:16.379 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:16.369+0000 7f2b4ffff640 0 client.6045 ms_handle_reset on v2:172.21.15.78:6836/115607035 2023-11-28T20:01:16.379 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:16.369+0000 7f2b7e7ac000 1 --2- 172.21.15.78:0/1023950223 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5596a53172e0 0x5596a536e3c0 unknown :-1 s=CLOSED pgs=652 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:16.379 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:16.369+0000 7f2b7e7ac000 1 -- 172.21.15.78:0/1023950223 >> 172.21.15.78:0/1023950223 conn(0x5596a5320190 msgr2=0x5596a5315a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:01:16.379 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:16.369+0000 7f2b7e7ac000 1 -- 172.21.15.78:0/1023950223 shutdown_connections 2023-11-28T20:01:16.379 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:16.369+0000 7f2b7e7ac000 1 -- 172.21.15.78:0/1023950223 wait complete. 2023-11-28T20:01:16.379 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:16.369+0000 7f2b7e7ac000 20 client.6045 trim_cache size 0 max 16384 2023-11-28T20:01:16.380 INFO:teuthology.orchestra.run.smithi078.stdout:{ 2023-11-28T20:01:16.380 INFO:teuthology.orchestra.run.smithi078.stdout: "cluster_fsid": "dd9780e8-3bda-44fa-a9f0-fa07d19d901d", 2023-11-28T20:01:16.380 INFO:teuthology.orchestra.run.smithi078.stdout: "whoami": 0, 2023-11-28T20:01:16.380 INFO:teuthology.orchestra.run.smithi078.stdout: "id": 5892, 2023-11-28T20:01:16.380 INFO:teuthology.orchestra.run.smithi078.stdout: "want_state": "up:active", 2023-11-28T20:01:16.380 INFO:teuthology.orchestra.run.smithi078.stdout: "state": "up:active", 2023-11-28T20:01:16.380 INFO:teuthology.orchestra.run.smithi078.stdout: "fs_name": "cephfs", 2023-11-28T20:01:16.380 INFO:teuthology.orchestra.run.smithi078.stdout: "rank_uptime": 5.8533481930000004, 2023-11-28T20:01:16.381 INFO:teuthology.orchestra.run.smithi078.stdout: "mdsmap_epoch": 31, 2023-11-28T20:01:16.381 INFO:teuthology.orchestra.run.smithi078.stdout: "osdmap_epoch": 61, 2023-11-28T20:01:16.381 INFO:teuthology.orchestra.run.smithi078.stdout: "osdmap_epoch_barrier": 61, 2023-11-28T20:01:16.381 INFO:teuthology.orchestra.run.smithi078.stdout: "uptime": 11.769271249000001 2023-11-28T20:01:16.381 INFO:teuthology.orchestra.run.smithi078.stdout:} 2023-11-28T20:01:16.382 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:16.369+0000 7f2b7b432640 1 -- 172.21.15.78:0/1386064314 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f2b58066470 msgr2=0x7f2b58068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:01:16.382 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:16.369+0000 7f2b7b432640 1 --2- 172.21.15.78:0/1386064314 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f2b58066470 0x7f2b58068930 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f2b700af000 tx=0x7f2b70008040 comp rx=0 tx=0).stop 2023-11-28T20:01:16.382 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:16.369+0000 7f2b7b432640 1 -- 172.21.15.78:0/1386064314 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2b74152d30 msgr2=0x7f2b741efc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:01:16.382 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:16.369+0000 7f2b7b432640 1 --2- 172.21.15.78:0/1386064314 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2b74152d30 0x7f2b741efc40 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7f2b6c00c7e0 tx=0x7f2b6c00cca0 comp rx=0 tx=0).stop 2023-11-28T20:01:16.382 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:16.369+0000 7f2b7b432640 1 -- 172.21.15.78:0/1386064314 shutdown_connections 2023-11-28T20:01:16.382 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:16.369+0000 7f2b7b432640 1 --2- 172.21.15.78:0/1386064314 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f2b58066470 0x7f2b58068930 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:16.382 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:16.369+0000 7f2b7b432640 1 --2- 172.21.15.78:0/1386064314 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2b74152d30 0x7f2b741efc40 unknown :-1 s=CLOSED pgs=648 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:16.382 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:16.369+0000 7f2b7b432640 1 --2- 172.21.15.78:0/1386064314 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2b740c3d90 0x7f2b741520b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:16.382 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:16.369+0000 7f2b7b432640 1 --2- 172.21.15.78:0/1386064314 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2b740c3930 0x7f2b740a75b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:16.383 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:16.369+0000 7f2b7b432640 1 -- 172.21.15.78:0/1386064314 >> 172.21.15.78:0/1386064314 conn(0x7f2b7406b220 msgr2=0x7f2b7415b6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:01:16.383 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:16.369+0000 7f2b7b432640 1 -- 172.21.15.78:0/1386064314 shutdown_connections 2023-11-28T20:01:16.383 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:16.369+0000 7f2b7b432640 1 -- 172.21.15.78:0/1386064314 wait complete. 2023-11-28T20:01:16.392 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-11-28T20:01:16.529 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:16.525+0000 7f688566b640 1 Processor -- start 2023-11-28T20:01:16.530 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:16.525+0000 7f688566b640 1 -- start start 2023-11-28T20:01:16.531 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:16.525+0000 7f688566b640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f688006d2b0 0x7f688006d690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:16.532 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:16.525+0000 7f688566b640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f68800c3b80 0x7f68800c5300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:16.532 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:16.525+0000 7f688566b640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f688006bb80 con 0x7f688006c020 2023-11-28T20:01:16.532 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:16.525+0000 7f688566b640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f68800c5840 con 0x7f688006d2b0 2023-11-28T20:01:16.532 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:16.525+0000 7f688566b640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f68801515c0 con 0x7f68800c3b80 2023-11-28T20:01:16.532 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:16.525+0000 7f687effd640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f688006d2b0 0x7f688006d690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:16.533 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:16.525+0000 7f687effd640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f688006d2b0 0x7f688006d690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:40010/0 (socket says 172.21.15.78:40010) 2023-11-28T20:01:16.533 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:16.525+0000 7f687effd640 1 -- 172.21.15.78:0/2309149650 learned_addr learned my addr 172.21.15.78:0/2309149650 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T20:01:16.533 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:16.525+0000 7f687e7fc640 1 --2- 172.21.15.78:0/2309149650 >> v2:172.21.15.179:3300/0 conn(0x7f68800c3b80 0x7f68800c5300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:16.533 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:16.525+0000 7f687effd640 1 -- 172.21.15.78:0/2309149650 >> v2:172.21.15.179:3300/0 conn(0x7f68800c3b80 msgr2=0x7f68800c5300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:01:16.533 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:16.525+0000 7f687effd640 1 --2- 172.21.15.78:0/2309149650 >> v2:172.21.15.179:3300/0 conn(0x7f68800c3b80 0x7f68800c5300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:16.533 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:16.525+0000 7f687effd640 1 -- 172.21.15.78:0/2309149650 >> v1:172.21.15.179:6789/0 conn(0x7f688006c020 legacy=0x7f688006c4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:01:16.534 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:16.529+0000 7f687effd640 1 -- 172.21.15.78:0/2309149650 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68801518a0 con 0x7f688006d2b0 2023-11-28T20:01:16.535 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:16.529+0000 7f687effd640 1 --2- 172.21.15.78:0/2309149650 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f688006d2b0 0x7f688006d690 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7f688006b5a0 tx=0x7f687001c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6ed29154493df9d9 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:01:16.535 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:16.529+0000 7f687dffb640 1 -- 172.21.15.78:0/2309149650 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68700ac600 con 0x7f688006d2b0 2023-11-28T20:01:16.535 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:16.529+0000 7f687dffb640 1 -- 172.21.15.78:0/2309149650 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f68700a8050 con 0x7f688006d2b0 2023-11-28T20:01:16.535 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:16.529+0000 7f687dffb640 1 -- 172.21.15.78:0/2309149650 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68700ac980 con 0x7f688006d2b0 2023-11-28T20:01:16.535 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:16.529+0000 7f688566b640 1 -- 172.21.15.78:0/2309149650 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f688006d2b0 msgr2=0x7f688006d690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:01:16.536 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:16.529+0000 7f688566b640 1 --2- 172.21.15.78:0/2309149650 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f688006d2b0 0x7f688006d690 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7f688006b5a0 tx=0x7f687001c490 comp rx=0 tx=0).stop 2023-11-28T20:01:16.537 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:16.529+0000 7f688566b640 1 -- 172.21.15.78:0/2309149650 shutdown_connections 2023-11-28T20:01:16.537 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:16.529+0000 7f688566b640 1 --2- 172.21.15.78:0/2309149650 >> v2:172.21.15.179:3300/0 conn(0x7f68800c3b80 0x7f68800c5300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:16.537 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:16.529+0000 7f688566b640 1 --2- 172.21.15.78:0/2309149650 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f688006d2b0 0x7f688006d690 unknown :-1 s=CLOSED pgs=653 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:16.537 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:16.529+0000 7f688566b640 1 -- 172.21.15.78:0/2309149650 >> 172.21.15.78:0/2309149650 conn(0x7f68800a7810 msgr2=0x7f68800a7c20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:01:16.537 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:16.529+0000 7f688566b640 1 -- 172.21.15.78:0/2309149650 shutdown_connections 2023-11-28T20:01:16.538 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:16.529+0000 7f688566b640 1 -- 172.21.15.78:0/2309149650 wait complete. 2023-11-28T20:01:16.540 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:16.533+0000 7f688566b640 1 Processor -- start 2023-11-28T20:01:16.540 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:16.533+0000 7f688566b640 1 -- start start 2023-11-28T20:01:16.540 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:16.533+0000 7f688566b640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f688006c020 0x7f68800a91e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:16.541 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:16.533+0000 7f688566b640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f688006d2b0 0x7f68801eb650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:16.541 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:16.533+0000 7f688566b640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f68800c3b80 0x7f68801ee1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:16.541 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:16.533+0000 7f688566b640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6880072170 con 0x7f688006c020 2023-11-28T20:01:16.541 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:16.533+0000 7f688566b640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68801eac20 con 0x7f688006d2b0 2023-11-28T20:01:16.541 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:16.533+0000 7f688566b640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f68801ebb90 con 0x7f68800c3b80 2023-11-28T20:01:16.541 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:16.533+0000 7f687effd640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f688006c020 0x7f68800a91e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:16.541 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:16.533+0000 7f687effd640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f688006c020 0x7f68800a91e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:40026/0 (socket says 172.21.15.78:40026) 2023-11-28T20:01:16.541 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:16.533+0000 7f687effd640 1 -- 172.21.15.78:0/4285434528 learned_addr learned my addr 172.21.15.78:0/4285434528 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T20:01:16.541 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:16.533+0000 7f687f7fe640 1 --2- 172.21.15.78:0/4285434528 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f68800c3b80 0x7f68801ee1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:16.542 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:16.533+0000 7f687e7fc640 1 --2- 172.21.15.78:0/4285434528 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f688006d2b0 0x7f68801eb650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:16.542 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:16.533+0000 7f687effd640 1 -- 172.21.15.78:0/4285434528 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f68800c3b80 msgr2=0x7f68801ee1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:01:16.542 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:16.533+0000 7f687effd640 1 --2- 172.21.15.78:0/4285434528 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f68800c3b80 0x7f68801ee1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:16.542 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:16.533+0000 7f687effd640 1 -- 172.21.15.78:0/4285434528 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f688006d2b0 msgr2=0x7f68801eb650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:01:16.542 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:16.533+0000 7f687effd640 1 --2- 172.21.15.78:0/4285434528 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f688006d2b0 0x7f68801eb650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:16.542 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:16.533+0000 7f687effd640 1 -- 172.21.15.78:0/4285434528 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68700094d0 con 0x7f688006c020 2023-11-28T20:01:16.542 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:16.533+0000 7f687effd640 1 --2- 172.21.15.78:0/4285434528 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f688006c020 0x7f68800a91e0 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7f687001a0c0 tx=0x7f687001acd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:01:16.543 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:16.533+0000 7f68677fe640 1 -- 172.21.15.78:0/4285434528 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68700b7650 con 0x7f688006c020 2023-11-28T20:01:16.543 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:16.533+0000 7f68677fe640 1 -- 172.21.15.78:0/4285434528 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f68700b77b0 con 0x7f688006c020 2023-11-28T20:01:16.543 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:16.533+0000 7f68677fe640 1 -- 172.21.15.78:0/4285434528 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68700b7b20 con 0x7f688006c020 2023-11-28T20:01:16.543 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:16.533+0000 7f688566b640 1 -- 172.21.15.78:0/4285434528 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f688014ef80 con 0x7f688006c020 2023-11-28T20:01:16.544 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:16.537+0000 7f688566b640 1 -- 172.21.15.78:0/4285434528 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f68800aae10 con 0x7f688006c020 2023-11-28T20:01:16.544 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:16.537+0000 7f688566b640 1 -- 172.21.15.78:0/4285434528 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6880067630 con 0x7f688006c020 2023-11-28T20:01:16.545 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:16.537+0000 7f68677fe640 1 -- 172.21.15.78:0/4285434528 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f68700b3070 con 0x7f688006c020 2023-11-28T20:01:16.546 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:16.537+0000 7f68677fe640 1 --2- 172.21.15.78:0/4285434528 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f686c066470 0x7f686c068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:16.546 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:16.537+0000 7f68677fe640 1 -- 172.21.15.78:0/4285434528 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f687011e620 con 0x7f688006c020 2023-11-28T20:01:16.547 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:16.537+0000 7f687e7fc640 1 --2- 172.21.15.78:0/4285434528 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f686c066470 0x7f686c068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:16.547 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:16.537+0000 7f687e7fc640 1 --2- 172.21.15.78:0/4285434528 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f686c066470 0x7f686c068930 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f68800bfe70 tx=0x7f6874008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:01:16.548 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:16.541+0000 7f68677fe640 1 -- 172.21.15.78:0/4285434528 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f68700eb950 con 0x7f688006c020 2023-11-28T20:01:16.734 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:16.729+0000 7f688566b640 1 -- 172.21.15.78:0/4285434528 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f688006bd70 con 0x7f688006c020 2023-11-28T20:01:16.734 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:16.729+0000 7f68677fe640 1 -- 172.21.15.78:0/4285434528 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v31) v1 ==== 53+0+73 (secure 0 0 0) 0x7f68700eef70 con 0x7f688006c020 2023-11-28T20:01:16.734 INFO:teuthology.orchestra.run.smithi078.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-11-28T20:01:16.737 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:16.733+0000 7f688566b640 1 -- 172.21.15.78:0/4285434528 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f686c066470 msgr2=0x7f686c068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:01:16.737 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:16.733+0000 7f688566b640 1 --2- 172.21.15.78:0/4285434528 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f686c066470 0x7f686c068930 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f68800bfe70 tx=0x7f6874008040 comp rx=0 tx=0).stop 2023-11-28T20:01:16.737 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:16.733+0000 7f688566b640 1 -- 172.21.15.78:0/4285434528 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f688006c020 msgr2=0x7f68800a91e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:01:16.737 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:16.733+0000 7f688566b640 1 --2- 172.21.15.78:0/4285434528 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f688006c020 0x7f68800a91e0 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7f687001a0c0 tx=0x7f687001acd0 comp rx=0 tx=0).stop 2023-11-28T20:01:16.737 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:16.733+0000 7f688566b640 1 -- 172.21.15.78:0/4285434528 shutdown_connections 2023-11-28T20:01:16.738 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:16.733+0000 7f688566b640 1 --2- 172.21.15.78:0/4285434528 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f686c066470 0x7f686c068930 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:16.738 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:16.733+0000 7f688566b640 1 --2- 172.21.15.78:0/4285434528 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f68800c3b80 0x7f68801ee1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:16.738 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:16.733+0000 7f688566b640 1 --2- 172.21.15.78:0/4285434528 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f688006d2b0 0x7f68801eb650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:16.738 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:16.733+0000 7f688566b640 1 --2- 172.21.15.78:0/4285434528 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f688006c020 0x7f68800a91e0 unknown :-1 s=CLOSED pgs=654 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:16.738 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:16.733+0000 7f688566b640 1 -- 172.21.15.78:0/4285434528 >> 172.21.15.78:0/4285434528 conn(0x7f68800a7810 msgr2=0x7f688006d690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:01:16.738 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:16.733+0000 7f688566b640 1 -- 172.21.15.78:0/4285434528 shutdown_connections 2023-11-28T20:01:16.738 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:16.733+0000 7f688566b640 1 -- 172.21.15.78:0/4285434528 wait complete. 2023-11-28T20:01:16.755 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-11-28T20:01:16.755 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-11-28T20:01:16.755 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi078.front.sepia.ceph.com 2023-11-28T20:01:16.755 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-11-28T20:01:16.755 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-11-28T20:01:16.755 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-11-28T20:01:16.755 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-11-28T20:01:16.755 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-11-28T20:01:16.756 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-11-28T20:01:16.756 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T20:01:16.756 DEBUG:teuthology.orchestra.run.smithi078:> ip addr 2023-11-28T20:01:16.765 INFO:teuthology.orchestra.run.smithi078.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-11-28T20:01:16.765 INFO:teuthology.orchestra.run.smithi078.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-11-28T20:01:16.765 INFO:teuthology.orchestra.run.smithi078.stdout: inet 127.0.0.1/8 scope host lo 2023-11-28T20:01:16.766 INFO:teuthology.orchestra.run.smithi078.stdout: valid_lft forever preferred_lft forever 2023-11-28T20:01:16.766 INFO:teuthology.orchestra.run.smithi078.stdout: inet6 ::1/128 scope host 2023-11-28T20:01:16.766 INFO:teuthology.orchestra.run.smithi078.stdout: valid_lft forever preferred_lft forever 2023-11-28T20:01:16.766 INFO:teuthology.orchestra.run.smithi078.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-11-28T20:01:16.766 INFO:teuthology.orchestra.run.smithi078.stdout: link/ether 0c:c4:7a:d8:a1:22 brd ff:ff:ff:ff:ff:ff 2023-11-28T20:01:16.766 INFO:teuthology.orchestra.run.smithi078.stdout: altname enp7s0f0 2023-11-28T20:01:16.766 INFO:teuthology.orchestra.run.smithi078.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-11-28T20:01:16.766 INFO:teuthology.orchestra.run.smithi078.stdout: link/ether 0c:c4:7a:d8:a1:23 brd ff:ff:ff:ff:ff:ff 2023-11-28T20:01:16.766 INFO:teuthology.orchestra.run.smithi078.stdout: altname enp7s0f1 2023-11-28T20:01:16.766 INFO:teuthology.orchestra.run.smithi078.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-11-28T20:01:16.766 INFO:teuthology.orchestra.run.smithi078.stdout: link/ether 0c:c4:7a:8f:d4:dc brd ff:ff:ff:ff:ff:ff 2023-11-28T20:01:16.766 INFO:teuthology.orchestra.run.smithi078.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-11-28T20:01:16.767 INFO:teuthology.orchestra.run.smithi078.stdout: link/ether 0c:c4:7a:8f:d4:dd brd ff:ff:ff:ff:ff:ff 2023-11-28T20:01:16.767 INFO:teuthology.orchestra.run.smithi078.stdout: inet 172.21.15.78/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2023-11-28T20:01:16.767 INFO:teuthology.orchestra.run.smithi078.stdout: valid_lft 42295sec preferred_lft 42295sec 2023-11-28T20:01:16.767 INFO:teuthology.orchestra.run.smithi078.stdout: inet6 fe80::ec4:7aff:fe8f:d4dd/64 scope link 2023-11-28T20:01:16.767 INFO:teuthology.orchestra.run.smithi078.stdout: valid_lft forever preferred_lft forever 2023-11-28T20:01:16.767 INFO:teuthology.orchestra.run.smithi078.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-11-28T20:01:16.767 INFO:teuthology.orchestra.run.smithi078.stdout: link/ether 02:42:8f:cc:76:dd brd ff:ff:ff:ff:ff:ff 2023-11-28T20:01:16.767 INFO:teuthology.orchestra.run.smithi078.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-11-28T20:01:16.767 INFO:teuthology.orchestra.run.smithi078.stdout: valid_lft forever preferred_lft forever 2023-11-28T20:01:16.767 INFO:teuthology.orchestra.run.smithi078.stdout:9: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-11-28T20:01:16.767 INFO:teuthology.orchestra.run.smithi078.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2023-11-28T20:01:16.767 INFO:teuthology.orchestra.run.smithi078.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-11-28T20:01:16.768 INFO:teuthology.orchestra.run.smithi078.stdout: valid_lft forever preferred_lft forever 2023-11-28T20:01:16.768 INFO:teuthology.orchestra.run.smithi078.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2023-11-28T20:01:16.768 INFO:teuthology.orchestra.run.smithi078.stdout: valid_lft forever preferred_lft forever 2023-11-28T20:01:16.768 INFO:teuthology.orchestra.run.smithi078.stdout:10: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-11-28T20:01:16.768 INFO:teuthology.orchestra.run.smithi078.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-28T20:01:16.768 INFO:teuthology.orchestra.run.smithi078.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2023-11-28T20:01:16.768 INFO:teuthology.orchestra.run.smithi078.stdout: valid_lft forever preferred_lft forever 2023-11-28T20:01:16.769 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T20:01:16.769 DEBUG:teuthology.orchestra.run.smithi078:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-11-28T20:01:16.830 INFO:teuthology.orchestra.run.smithi078.stdout:1 2023-11-28T20:01:16.832 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T20:01:16.832 DEBUG:teuthology.orchestra.run.smithi078:> route 2023-11-28T20:01:16.890 INFO:teuthology.orchestra.run.smithi078.stdout:Kernel IP routing table 2023-11-28T20:01:16.890 INFO:teuthology.orchestra.run.smithi078.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-11-28T20:01:16.890 INFO:teuthology.orchestra.run.smithi078.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2023-11-28T20:01:16.890 INFO:teuthology.orchestra.run.smithi078.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-11-28T20:01:16.891 INFO:teuthology.orchestra.run.smithi078.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-11-28T20:01:16.891 INFO:teuthology.orchestra.run.smithi078.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-11-28T20:01:16.891 INFO:teuthology.orchestra.run.smithi078.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-11-28T20:01:16.891 INFO:teuthology.orchestra.run.smithi078.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-11-28T20:01:16.891 INFO:teuthology.orchestra.run.smithi078.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-11-28T20:01:16.891 INFO:teuthology.orchestra.run.smithi078.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-11-28T20:01:16.891 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T20:01:16.891 DEBUG:teuthology.orchestra.run.smithi078:> (cd / && exec bash -c ' 2023-11-28T20:01:16.891 DEBUG:teuthology.orchestra.run.smithi078:> set -e 2023-11-28T20:01:16.892 DEBUG:teuthology.orchestra.run.smithi078:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-11-28T20:01:16.892 DEBUG:teuthology.orchestra.run.smithi078:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-11-28T20:01:16.892 DEBUG:teuthology.orchestra.run.smithi078:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-11-28T20:01:16.892 DEBUG:teuthology.orchestra.run.smithi078:> ') 2023-11-28T20:01:16.981 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T20:01:16.982 DEBUG:teuthology.orchestra.run.smithi078:> ip netns list 2023-11-28T20:01:16.991 INFO:teuthology.orchestra.run.smithi078.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-11-28T20:01:16.992 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-11-28T20:01:16.992 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T20:01:16.992 DEBUG:teuthology.orchestra.run.smithi078:> sudo ip link set brx.0 up 2023-11-28T20:01:17.055 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-28T20:01:17.056 DEBUG:teuthology.orchestra.run.smithi078:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-11-28T20:01:17.107 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-28T20:01:17.107 DEBUG:teuthology.orchestra.run.smithi078:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-11-28T20:01:17.159 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2023-11-28T20:01:17.159 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T20:01:17.159 DEBUG:teuthology.orchestra.run.smithi078:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-11-28T20:01:17.248 INFO:teuthology.orchestra.run.smithi078.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-11-28T20:01:17.249 INFO:teuthology.orchestra.run.smithi078.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-11-28T20:01:17.262 INFO:teuthology.orchestra.run.smithi078.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-11-28T20:01:17.262 INFO:teuthology.orchestra.run.smithi078.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-11-28T20:01:17.262 INFO:teuthology.orchestra.run.smithi078.stdout:mount.ceph: resolved to: "172.21.15.78:3300,172.21.15.179:3300,172.21.15.179:3301" 2023-11-28T20:01:17.262 INFO:teuthology.orchestra.run.smithi078.stdout:mount.ceph: trying mount with new device syntax: 0@dd9780e8-3bda-44fa-a9f0-fa07d19d901d.cephfs=/ 2023-11-28T20:01:17.263 INFO:teuthology.orchestra.run.smithi078.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.78:3300/172.21.15.179:3300/172.21.15.179:3301" will pass to kernel 2023-11-28T20:01:17.266 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-11-28T20:01:17.266 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T20:01:17.266 DEBUG:teuthology.orchestra.run.smithi078:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-11-28T20:01:17.288 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T20:01:17.288 DEBUG:teuthology.orchestra.run.smithi078:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-11-28T20:01:17.352 INFO:teuthology.orchestra.run.smithi078.stdout:client6054 2023-11-28T20:01:17.352 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2023-11-28T20:01:17.352 DEBUG:teuthology.orchestra.run.smithi078:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-28T20:01:17.407 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-11-28T20:01:17.591 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:17.585+0000 7fc4b4632640 1 Processor -- start 2023-11-28T20:01:17.591 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:17.585+0000 7fc4b4632640 1 -- start start 2023-11-28T20:01:17.593 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:17.589+0000 7fc4b4632640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fc4ac151bf0 0x7fc4ac06b5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:17.593 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:17.589+0000 7fc4b4632640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc4ac06bb00 0x7fc4ac154d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:17.593 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:17.589+0000 7fc4b4632640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc4ac158a40 con 0x7fc4ac06d890 2023-11-28T20:01:17.593 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:17.589+0000 7fc4b4632640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc4ac1584c0 con 0x7fc4ac151bf0 2023-11-28T20:01:17.593 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:17.589+0000 7fc4b4632640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc4ac155260 con 0x7fc4ac06bb00 2023-11-28T20:01:17.593 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:17.589+0000 7fc4b23ce640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fc4ac151bf0 0x7fc4ac06b5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:17.593 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:17.589+0000 7fc4b23ce640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fc4ac151bf0 0x7fc4ac06b5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:40030/0 (socket says 172.21.15.78:40030) 2023-11-28T20:01:17.593 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:17.589+0000 7fc4b23ce640 1 -- 172.21.15.78:0/1347478511 learned_addr learned my addr 172.21.15.78:0/1347478511 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T20:01:17.594 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:17.589+0000 7fc4b2bcf640 1 --2- 172.21.15.78:0/1347478511 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc4ac06bb00 0x7fc4ac154d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:17.594 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:17.589+0000 7fc4b23ce640 1 -- 172.21.15.78:0/1347478511 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc4ac06bb00 msgr2=0x7fc4ac154d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:01:17.594 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:17.589+0000 7fc4b23ce640 1 --2- 172.21.15.78:0/1347478511 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc4ac06bb00 0x7fc4ac154d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:17.594 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:17.589+0000 7fc4b23ce640 1 -- 172.21.15.78:0/1347478511 >> v1:172.21.15.179:6789/0 conn(0x7fc4ac06d890 legacy=0x7fc4ac154610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:01:17.594 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:17.589+0000 7fc4b23ce640 1 -- 172.21.15.78:0/1347478511 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4ac158760 con 0x7fc4ac151bf0 2023-11-28T20:01:17.596 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:17.593+0000 7fc4b23ce640 1 --2- 172.21.15.78:0/1347478511 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc4ac151bf0 0x7fc4ac06b5c0 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7fc4a8009870 tx=0x7fc4a801c510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=632d59f960281af3 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:01:17.596 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:17.593+0000 7fc4b13cc640 1 -- 172.21.15.78:0/1347478511 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4a80aa670 con 0x7fc4ac151bf0 2023-11-28T20:01:17.597 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:17.593+0000 7fc4b13cc640 1 -- 172.21.15.78:0/1347478511 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc4a80aa7d0 con 0x7fc4ac151bf0 2023-11-28T20:01:17.597 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:17.593+0000 7fc4b13cc640 1 -- 172.21.15.78:0/1347478511 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4a80aab60 con 0x7fc4ac151bf0 2023-11-28T20:01:17.597 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:17.593+0000 7fc4b4632640 1 -- 172.21.15.78:0/1347478511 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc4ac151bf0 msgr2=0x7fc4ac06b5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:01:17.597 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:17.593+0000 7fc4b4632640 1 --2- 172.21.15.78:0/1347478511 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc4ac151bf0 0x7fc4ac06b5c0 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7fc4a8009870 tx=0x7fc4a801c510 comp rx=0 tx=0).stop 2023-11-28T20:01:17.597 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:17.593+0000 7fc4b4632640 1 -- 172.21.15.78:0/1347478511 shutdown_connections 2023-11-28T20:01:17.598 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:17.593+0000 7fc4b4632640 1 --2- 172.21.15.78:0/1347478511 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc4ac06bb00 0x7fc4ac154d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:17.598 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:17.593+0000 7fc4b4632640 1 --2- 172.21.15.78:0/1347478511 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc4ac151bf0 0x7fc4ac06b5c0 unknown :-1 s=CLOSED pgs=656 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:17.598 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:17.593+0000 7fc4b4632640 1 -- 172.21.15.78:0/1347478511 >> 172.21.15.78:0/1347478511 conn(0x7fc4ac0c61f0 msgr2=0x7fc4ac0c6600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:01:17.598 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:17.593+0000 7fc4b4632640 1 -- 172.21.15.78:0/1347478511 shutdown_connections 2023-11-28T20:01:17.598 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:17.593+0000 7fc4b4632640 1 -- 172.21.15.78:0/1347478511 wait complete. 2023-11-28T20:01:17.603 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:17.593+0000 7fc4b4632640 1 Processor -- start 2023-11-28T20:01:17.603 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:17.593+0000 7fc4b4632640 1 -- start start 2023-11-28T20:01:17.603 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:17.597+0000 7fc4b4632640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc4ac06bb00 0x7fc4ac0a98a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:17.603 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:17.597+0000 7fc4b4632640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc4ac06d890 0x7fc4ac0704d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:17.604 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:17.597+0000 7fc4b4632640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc4ac151bf0 0x7fc4ac147a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:17.604 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:17.597+0000 7fc4b4632640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4ac1eff60 con 0x7fc4ac151bf0 2023-11-28T20:01:17.604 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:17.597+0000 7fc4b4632640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4ac1f01b0 con 0x7fc4ac06d890 2023-11-28T20:01:17.604 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:17.597+0000 7fc4b4632640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc4ac1f0490 con 0x7fc4ac06bb00 2023-11-28T20:01:17.604 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:17.597+0000 7fc4b2bcf640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc4ac151bf0 0x7fc4ac147a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:17.604 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:17.597+0000 7fc4b2bcf640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc4ac151bf0 0x7fc4ac147a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:40042/0 (socket says 172.21.15.78:40042) 2023-11-28T20:01:17.604 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:17.597+0000 7fc4b2bcf640 1 -- 172.21.15.78:0/4126189452 learned_addr learned my addr 172.21.15.78:0/4126189452 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T20:01:17.604 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:17.597+0000 7fc4b23ce640 1 --2- 172.21.15.78:0/4126189452 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc4ac06bb00 0x7fc4ac0a98a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:17.604 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:17.597+0000 7fc4b1bcd640 1 --2- 172.21.15.78:0/4126189452 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc4ac06d890 0x7fc4ac0704d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:17.604 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:17.597+0000 7fc4b2bcf640 1 -- 172.21.15.78:0/4126189452 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc4ac06bb00 msgr2=0x7fc4ac0a98a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:01:17.604 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:17.597+0000 7fc4b2bcf640 1 --2- 172.21.15.78:0/4126189452 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc4ac06bb00 0x7fc4ac0a98a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:17.604 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:17.597+0000 7fc4b2bcf640 1 -- 172.21.15.78:0/4126189452 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc4ac06d890 msgr2=0x7fc4ac0704d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:01:17.605 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:17.597+0000 7fc4b2bcf640 1 --2- 172.21.15.78:0/4126189452 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc4ac06d890 0x7fc4ac0704d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:17.605 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:17.597+0000 7fc4b2bcf640 1 -- 172.21.15.78:0/4126189452 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4a80094d0 con 0x7fc4ac151bf0 2023-11-28T20:01:17.605 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:17.597+0000 7fc4b2bcf640 1 --2- 172.21.15.78:0/4126189452 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc4ac151bf0 0x7fc4ac147a90 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7fc4a4007e60 tx=0x7fc4a400e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:01:17.605 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:17.597+0000 7fc4a2ffd640 1 -- 172.21.15.78:0/4126189452 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4a4014420 con 0x7fc4ac151bf0 2023-11-28T20:01:17.605 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:17.597+0000 7fc4a2ffd640 1 -- 172.21.15.78:0/4126189452 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc4a40145a0 con 0x7fc4ac151bf0 2023-11-28T20:01:17.605 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:17.597+0000 7fc4b4632640 1 -- 172.21.15.78:0/4126189452 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc4ac1f0770 con 0x7fc4ac151bf0 2023-11-28T20:01:17.605 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:17.597+0000 7fc4a2ffd640 1 -- 172.21.15.78:0/4126189452 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4a4014950 con 0x7fc4ac151bf0 2023-11-28T20:01:17.605 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:17.597+0000 7fc4b4632640 1 -- 172.21.15.78:0/4126189452 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc4ac1f0d30 con 0x7fc4ac151bf0 2023-11-28T20:01:17.605 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:17.597+0000 7fc4b4632640 1 -- 172.21.15.78:0/4126189452 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc4ac0679d0 con 0x7fc4ac151bf0 2023-11-28T20:01:17.605 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:17.597+0000 7fc4a2ffd640 1 -- 172.21.15.78:0/4126189452 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fc4a4014ab0 con 0x7fc4ac151bf0 2023-11-28T20:01:17.606 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:17.601+0000 7fc4a2ffd640 1 --2- 172.21.15.78:0/4126189452 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fc490066470 0x7fc490068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:17.606 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:17.601+0000 7fc4a2ffd640 1 -- 172.21.15.78:0/4126189452 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 6029+0+0 (secure 0 0 0) 0x7fc4a40847e0 con 0x7fc4ac151bf0 2023-11-28T20:01:17.606 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:17.601+0000 7fc4b23ce640 1 --2- 172.21.15.78:0/4126189452 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fc490066470 0x7fc490068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:17.606 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:17.601+0000 7fc4b23ce640 1 --2- 172.21.15.78:0/4126189452 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fc490066470 0x7fc490068930 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7fc4a80ae000 tx=0x7fc4a80b5040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:01:17.608 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:17.605+0000 7fc4a2ffd640 1 -- 172.21.15.78:0/4126189452 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fc4a4051b30 con 0x7fc4ac151bf0 2023-11-28T20:01:17.790 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:17.785+0000 7fc4b4632640 1 -- 172.21.15.78:0/4126189452 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fc4ac1ec9f0 con 0x7fc4ac151bf0 2023-11-28T20:01:17.790 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:17.785+0000 7fc4a2ffd640 1 -- 172.21.15.78:0/4126189452 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v31) v1 ==== 53+0+73 (secure 0 0 0) 0x7fc4a4055150 con 0x7fc4ac151bf0 2023-11-28T20:01:17.790 INFO:teuthology.orchestra.run.smithi078.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-11-28T20:01:17.792 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:17.789+0000 7fc4b4632640 1 -- 172.21.15.78:0/4126189452 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fc490066470 msgr2=0x7fc490068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:01:17.792 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:17.789+0000 7fc4b4632640 1 --2- 172.21.15.78:0/4126189452 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fc490066470 0x7fc490068930 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7fc4a80ae000 tx=0x7fc4a80b5040 comp rx=0 tx=0).stop 2023-11-28T20:01:17.792 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:17.789+0000 7fc4b4632640 1 -- 172.21.15.78:0/4126189452 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc4ac151bf0 msgr2=0x7fc4ac147a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:01:17.792 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:17.789+0000 7fc4b4632640 1 --2- 172.21.15.78:0/4126189452 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc4ac151bf0 0x7fc4ac147a90 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7fc4a4007e60 tx=0x7fc4a400e4b0 comp rx=0 tx=0).stop 2023-11-28T20:01:17.792 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:17.789+0000 7fc4b4632640 1 -- 172.21.15.78:0/4126189452 shutdown_connections 2023-11-28T20:01:17.792 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:17.789+0000 7fc4b4632640 1 --2- 172.21.15.78:0/4126189452 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fc490066470 0x7fc490068930 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:17.793 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:17.789+0000 7fc4b4632640 1 --2- 172.21.15.78:0/4126189452 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc4ac151bf0 0x7fc4ac147a90 unknown :-1 s=CLOSED pgs=657 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:17.793 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:17.789+0000 7fc4b4632640 1 --2- 172.21.15.78:0/4126189452 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc4ac06d890 0x7fc4ac0704d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:17.793 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:17.789+0000 7fc4b4632640 1 --2- 172.21.15.78:0/4126189452 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc4ac06bb00 0x7fc4ac0a98a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:17.793 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:17.789+0000 7fc4b4632640 1 -- 172.21.15.78:0/4126189452 >> 172.21.15.78:0/4126189452 conn(0x7fc4ac0c61f0 msgr2=0x7fc4ac06b0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:01:17.793 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:17.789+0000 7fc4b4632640 1 -- 172.21.15.78:0/4126189452 shutdown_connections 2023-11-28T20:01:17.793 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:17.789+0000 7fc4b4632640 1 -- 172.21.15.78:0/4126189452 wait complete. 2023-11-28T20:01:17.811 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-11-28T20:01:17.811 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-11-28T20:01:17.811 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi179.front.sepia.ceph.com 2023-11-28T20:01:17.811 INFO:tasks.cephfs.mount:self.client.name = client.1 2023-11-28T20:01:17.811 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-11-28T20:01:17.811 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-11-28T20:01:17.811 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-11-28T20:01:17.811 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-11-28T20:01:17.811 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-11-28T20:01:17.812 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T20:01:17.812 DEBUG:teuthology.orchestra.run.smithi179:> ip addr 2023-11-28T20:01:17.822 INFO:teuthology.orchestra.run.smithi179.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-11-28T20:01:17.822 INFO:teuthology.orchestra.run.smithi179.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-11-28T20:01:17.822 INFO:teuthology.orchestra.run.smithi179.stdout: inet 127.0.0.1/8 scope host lo 2023-11-28T20:01:17.822 INFO:teuthology.orchestra.run.smithi179.stdout: valid_lft forever preferred_lft forever 2023-11-28T20:01:17.823 INFO:teuthology.orchestra.run.smithi179.stdout: inet6 ::1/128 scope host 2023-11-28T20:01:17.823 INFO:teuthology.orchestra.run.smithi179.stdout: valid_lft forever preferred_lft forever 2023-11-28T20:01:17.823 INFO:teuthology.orchestra.run.smithi179.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-11-28T20:01:17.823 INFO:teuthology.orchestra.run.smithi179.stdout: link/ether 0c:c4:7a:d9:3b:34 brd ff:ff:ff:ff:ff:ff 2023-11-28T20:01:17.823 INFO:teuthology.orchestra.run.smithi179.stdout: altname enp7s0f0 2023-11-28T20:01:17.823 INFO:teuthology.orchestra.run.smithi179.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-11-28T20:01:17.823 INFO:teuthology.orchestra.run.smithi179.stdout: link/ether 0c:c4:7a:d9:3b:35 brd ff:ff:ff:ff:ff:ff 2023-11-28T20:01:17.823 INFO:teuthology.orchestra.run.smithi179.stdout: altname enp7s0f1 2023-11-28T20:01:17.823 INFO:teuthology.orchestra.run.smithi179.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-11-28T20:01:17.823 INFO:teuthology.orchestra.run.smithi179.stdout: link/ether 0c:c4:7a:88:72:5a brd ff:ff:ff:ff:ff:ff 2023-11-28T20:01:17.823 INFO:teuthology.orchestra.run.smithi179.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-11-28T20:01:17.824 INFO:teuthology.orchestra.run.smithi179.stdout: link/ether 0c:c4:7a:88:72:5b brd ff:ff:ff:ff:ff:ff 2023-11-28T20:01:17.824 INFO:teuthology.orchestra.run.smithi179.stdout: inet 172.21.15.179/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2023-11-28T20:01:17.824 INFO:teuthology.orchestra.run.smithi179.stdout: valid_lft 42305sec preferred_lft 42305sec 2023-11-28T20:01:17.824 INFO:teuthology.orchestra.run.smithi179.stdout: inet6 fe80::ec4:7aff:fe88:725b/64 scope link 2023-11-28T20:01:17.824 INFO:teuthology.orchestra.run.smithi179.stdout: valid_lft forever preferred_lft forever 2023-11-28T20:01:17.824 INFO:teuthology.orchestra.run.smithi179.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-11-28T20:01:17.824 INFO:teuthology.orchestra.run.smithi179.stdout: link/ether 02:42:75:f0:7b:8c brd ff:ff:ff:ff:ff:ff 2023-11-28T20:01:17.824 INFO:teuthology.orchestra.run.smithi179.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-11-28T20:01:17.824 INFO:teuthology.orchestra.run.smithi179.stdout: valid_lft forever preferred_lft forever 2023-11-28T20:01:17.824 INFO:teuthology.orchestra.run.smithi179.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-11-28T20:01:17.824 INFO:teuthology.orchestra.run.smithi179.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2023-11-28T20:01:17.824 INFO:teuthology.orchestra.run.smithi179.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-11-28T20:01:17.825 INFO:teuthology.orchestra.run.smithi179.stdout: valid_lft forever preferred_lft forever 2023-11-28T20:01:17.825 INFO:teuthology.orchestra.run.smithi179.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2023-11-28T20:01:17.825 INFO:teuthology.orchestra.run.smithi179.stdout: valid_lft forever preferred_lft forever 2023-11-28T20:01:17.825 INFO:teuthology.orchestra.run.smithi179.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-11-28T20:01:17.825 INFO:teuthology.orchestra.run.smithi179.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2023-11-28T20:01:17.825 INFO:teuthology.orchestra.run.smithi179.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2023-11-28T20:01:17.825 INFO:teuthology.orchestra.run.smithi179.stdout: valid_lft forever preferred_lft forever 2023-11-28T20:01:17.826 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T20:01:17.826 DEBUG:teuthology.orchestra.run.smithi179:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-11-28T20:01:17.894 INFO:teuthology.orchestra.run.smithi179.stdout:1 2023-11-28T20:01:17.896 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T20:01:17.896 DEBUG:teuthology.orchestra.run.smithi179:> route 2023-11-28T20:01:17.948 INFO:teuthology.orchestra.run.smithi179.stdout:Kernel IP routing table 2023-11-28T20:01:17.948 INFO:teuthology.orchestra.run.smithi179.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-11-28T20:01:17.949 INFO:teuthology.orchestra.run.smithi179.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2023-11-28T20:01:17.949 INFO:teuthology.orchestra.run.smithi179.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-11-28T20:01:17.949 INFO:teuthology.orchestra.run.smithi179.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-11-28T20:01:17.949 INFO:teuthology.orchestra.run.smithi179.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-11-28T20:01:17.949 INFO:teuthology.orchestra.run.smithi179.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-11-28T20:01:17.949 INFO:teuthology.orchestra.run.smithi179.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-11-28T20:01:17.949 INFO:teuthology.orchestra.run.smithi179.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-11-28T20:01:17.949 INFO:teuthology.orchestra.run.smithi179.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-11-28T20:01:17.950 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T20:01:17.950 DEBUG:teuthology.orchestra.run.smithi179:> (cd / && exec bash -c ' 2023-11-28T20:01:17.950 DEBUG:teuthology.orchestra.run.smithi179:> set -e 2023-11-28T20:01:17.950 DEBUG:teuthology.orchestra.run.smithi179:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-11-28T20:01:17.950 DEBUG:teuthology.orchestra.run.smithi179:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-11-28T20:01:17.950 DEBUG:teuthology.orchestra.run.smithi179:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-11-28T20:01:17.950 DEBUG:teuthology.orchestra.run.smithi179:> ') 2023-11-28T20:01:18.050 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T20:01:18.050 DEBUG:teuthology.orchestra.run.smithi179:> ip netns list 2023-11-28T20:01:18.059 INFO:teuthology.orchestra.run.smithi179.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-11-28T20:01:18.061 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-11-28T20:01:18.061 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T20:01:18.061 DEBUG:teuthology.orchestra.run.smithi179:> sudo ip link set brx.0 up 2023-11-28T20:01:18.126 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-28T20:01:18.126 DEBUG:teuthology.orchestra.run.smithi179:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2023-11-28T20:01:18.181 INFO:teuthology.orchestra.run.smithi179.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2023-11-28T20:01:18.181 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-28T20:01:18.181 DEBUG:teuthology.orchestra.run.smithi179:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2023-11-28T20:01:18.232 INFO:tasks.cephfs.kernel_mount:mounting using device: 1@.cephfs=/ 2023-11-28T20:01:18.232 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T20:01:18.233 DEBUG:teuthology.orchestra.run.smithi179:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 1@.cephfs=/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-11-28T20:01:18.324 INFO:teuthology.orchestra.run.smithi179.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-11-28T20:01:18.324 INFO:teuthology.orchestra.run.smithi179.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-11-28T20:01:18.340 INFO:teuthology.orchestra.run.smithi179.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-11-28T20:01:18.340 INFO:teuthology.orchestra.run.smithi179.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-11-28T20:01:18.340 INFO:teuthology.orchestra.run.smithi179.stdout:mount.ceph: resolved to: "172.21.15.78:3300,172.21.15.179:3300,172.21.15.179:3301" 2023-11-28T20:01:18.340 INFO:teuthology.orchestra.run.smithi179.stdout:mount.ceph: trying mount with new device syntax: 1@dd9780e8-3bda-44fa-a9f0-fa07d19d901d.cephfs=/ 2023-11-28T20:01:18.341 INFO:teuthology.orchestra.run.smithi179.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,ms_mode=prefer-crc,key=1,mon_addr=172.21.15.78:3300/172.21.15.179:3300/172.21.15.179:3301" will pass to kernel 2023-11-28T20:01:18.345 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-11-28T20:01:18.345 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T20:01:18.345 DEBUG:teuthology.orchestra.run.smithi179:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-11-28T20:01:18.366 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T20:01:18.366 DEBUG:teuthology.orchestra.run.smithi179:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-11-28T20:01:18.424 INFO:teuthology.orchestra.run.smithi179.stdout:client6063 2023-11-28T20:01:18.425 DEBUG:teuthology.orchestra.run.smithi179:> set -ex 2023-11-28T20:01:18.425 DEBUG:teuthology.orchestra.run.smithi179:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-28T20:01:18.481 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth rm client.testuser 2023-11-28T20:01:18.630 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:18.625+0000 7f3f4a6dd640 1 Processor -- start 2023-11-28T20:01:18.630 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:18.625+0000 7f3f4a6dd640 1 -- start start 2023-11-28T20:01:18.631 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:18.625+0000 7f3f4a6dd640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f3f44154390 0x7f3f440c4a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:18.631 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:18.625+0000 7f3f4a6dd640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f3f440c2110 0x7f3f440c5ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:18.631 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:18.625+0000 7f3f4a6dd640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3f440a93d0 con 0x7f3f440c4f80 2023-11-28T20:01:18.631 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:18.625+0000 7f3f4a6dd640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3f440aa1c0 con 0x7f3f440c2110 2023-11-28T20:01:18.631 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:18.625+0000 7f3f4a6dd640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3f44154770 con 0x7f3f44154390 2023-11-28T20:01:18.631 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:18.625+0000 7f3f437fe640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f3f440c2110 0x7f3f440c5ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:18.631 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:18.625+0000 7f3f437fe640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f3f440c2110 0x7f3f440c5ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:40046/0 (socket says 172.21.15.78:40046) 2023-11-28T20:01:18.632 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:18.625+0000 7f3f437fe640 1 -- 172.21.15.78:0/1884395134 learned_addr learned my addr 172.21.15.78:0/1884395134 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T20:01:18.632 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:18.625+0000 7f3f43fff640 1 --2- 172.21.15.78:0/1884395134 >> v2:172.21.15.179:3300/0 conn(0x7f3f44154390 0x7f3f440c4a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:18.632 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:18.629+0000 7f3f437fe640 1 -- 172.21.15.78:0/1884395134 >> v2:172.21.15.179:3300/0 conn(0x7f3f44154390 msgr2=0x7f3f440c4a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:01:18.632 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:18.629+0000 7f3f437fe640 1 --2- 172.21.15.78:0/1884395134 >> v2:172.21.15.179:3300/0 conn(0x7f3f44154390 0x7f3f440c4a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:18.632 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:18.629+0000 7f3f437fe640 1 -- 172.21.15.78:0/1884395134 >> v1:172.21.15.179:6789/0 conn(0x7f3f440c4f80 legacy=0x7f3f440c61e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:01:18.632 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:18.629+0000 7f3f437fe640 1 -- 172.21.15.78:0/1884395134 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f440a9640 con 0x7f3f440c2110 2023-11-28T20:01:18.634 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:18.629+0000 7f3f437fe640 1 --2- 172.21.15.78:0/1884395134 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3f440c2110 0x7f3f440c5ca0 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7f3f440a83b0 tx=0x7f3f3801e710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=793bae85959087b0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:01:18.634 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:18.629+0000 7f3f42ffd640 1 -- 172.21.15.78:0/1884395134 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f380ab5f0 con 0x7f3f440c2110 2023-11-28T20:01:18.635 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:18.629+0000 7f3f42ffd640 1 -- 172.21.15.78:0/1884395134 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f380ab750 con 0x7f3f440c2110 2023-11-28T20:01:18.635 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:18.629+0000 7f3f42ffd640 1 -- 172.21.15.78:0/1884395134 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f380abae0 con 0x7f3f440c2110 2023-11-28T20:01:18.635 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:18.629+0000 7f3f4a6dd640 1 -- 172.21.15.78:0/1884395134 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3f440c2110 msgr2=0x7f3f440c5ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:01:18.636 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:18.629+0000 7f3f4a6dd640 1 --2- 172.21.15.78:0/1884395134 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3f440c2110 0x7f3f440c5ca0 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7f3f440a83b0 tx=0x7f3f3801e710 comp rx=0 tx=0).stop 2023-11-28T20:01:18.636 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:18.629+0000 7f3f4a6dd640 1 -- 172.21.15.78:0/1884395134 shutdown_connections 2023-11-28T20:01:18.636 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:18.629+0000 7f3f4a6dd640 1 --2- 172.21.15.78:0/1884395134 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3f440c2110 0x7f3f440c5ca0 unknown :-1 s=CLOSED pgs=659 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:18.636 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:18.629+0000 7f3f4a6dd640 1 --2- 172.21.15.78:0/1884395134 >> v2:172.21.15.179:3300/0 conn(0x7f3f44154390 0x7f3f440c4a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:18.636 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:18.629+0000 7f3f4a6dd640 1 -- 172.21.15.78:0/1884395134 >> 172.21.15.78:0/1884395134 conn(0x7f3f4406b220 msgr2=0x7f3f440a77e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:01:18.636 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:18.629+0000 7f3f4a6dd640 1 -- 172.21.15.78:0/1884395134 shutdown_connections 2023-11-28T20:01:18.636 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:18.633+0000 7f3f4a6dd640 1 -- 172.21.15.78:0/1884395134 wait complete. 2023-11-28T20:01:18.637 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:18.633+0000 7f3f4a6dd640 1 Processor -- start 2023-11-28T20:01:18.637 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:18.633+0000 7f3f4a6dd640 1 -- start start 2023-11-28T20:01:18.639 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:18.633+0000 7f3f4a6dd640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3f440c2110 0x7f3f44071f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:18.640 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:18.633+0000 7f3f4a6dd640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3f440c4f80 0x7f3f441eac30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:18.640 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:18.633+0000 7f3f4a6dd640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3f44154390 0x7f3f44070a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:18.640 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:18.633+0000 7f3f4a6dd640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f441428c0 con 0x7f3f44154390 2023-11-28T20:01:18.640 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:18.633+0000 7f3f4a6dd640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f44070780 con 0x7f3f440c4f80 2023-11-28T20:01:18.640 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:18.633+0000 7f3f4a6dd640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f441ee3e0 con 0x7f3f440c2110 2023-11-28T20:01:18.640 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:18.633+0000 7f3f48c7a640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3f44154390 0x7f3f44070a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:18.640 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:18.633+0000 7f3f437fe640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3f440c4f80 0x7f3f441eac30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:18.640 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:18.633+0000 7f3f48c7a640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3f44154390 0x7f3f44070a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:40052/0 (socket says 172.21.15.78:40052) 2023-11-28T20:01:18.640 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:18.633+0000 7f3f437fe640 1 --2- 172.21.15.78:0/3941042405 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3f440c4f80 0x7f3f441eac30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.78:57562/0 (socket says 172.21.15.78:57562) 2023-11-28T20:01:18.640 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:18.633+0000 7f3f48c7a640 1 -- 172.21.15.78:0/3941042405 learned_addr learned my addr 172.21.15.78:0/3941042405 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T20:01:18.640 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:18.633+0000 7f3f43fff640 1 --2- 172.21.15.78:0/3941042405 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3f440c2110 0x7f3f44071f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:18.641 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:18.633+0000 7f3f437fe640 1 -- 172.21.15.78:0/3941042405 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3f440c2110 msgr2=0x7f3f44071f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:01:18.641 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:18.633+0000 7f3f437fe640 1 --2- 172.21.15.78:0/3941042405 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3f440c2110 0x7f3f44071f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:18.641 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:18.633+0000 7f3f437fe640 1 -- 172.21.15.78:0/3941042405 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3f44154390 msgr2=0x7f3f44070a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:01:18.641 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:18.633+0000 7f3f437fe640 1 --2- 172.21.15.78:0/3941042405 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3f44154390 0x7f3f44070a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:18.641 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:18.633+0000 7f3f437fe640 1 -- 172.21.15.78:0/3941042405 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f380094d0 con 0x7f3f440c4f80 2023-11-28T20:01:18.641 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:18.633+0000 7f3f48c7a640 1 --2- 172.21.15.78:0/3941042405 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3f44154390 0x7f3f44070a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T20:01:18.641 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:18.633+0000 7f3f437fe640 1 --2- 172.21.15.78:0/3941042405 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3f440c4f80 0x7f3f441eac30 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f3f380ac000 tx=0x7f3f3801cf50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:01:18.641 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:18.637+0000 7f3f40ff9640 1 -- 172.21.15.78:0/3941042405 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f380bd5f0 con 0x7f3f440c4f80 2023-11-28T20:01:18.641 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:18.637+0000 7f3f40ff9640 1 -- 172.21.15.78:0/3941042405 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f380bd750 con 0x7f3f440c4f80 2023-11-28T20:01:18.641 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:18.637+0000 7f3f4a6dd640 1 -- 172.21.15.78:0/3941042405 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3f441ed7f0 con 0x7f3f440c4f80 2023-11-28T20:01:18.641 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:18.637+0000 7f3f40ff9640 1 -- 172.21.15.78:0/3941042405 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f380bdb00 con 0x7f3f440c4f80 2023-11-28T20:01:18.641 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:18.637+0000 7f3f4a6dd640 1 -- 172.21.15.78:0/3941042405 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3f441edd90 con 0x7f3f440c4f80 2023-11-28T20:01:18.642 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:18.637+0000 7f3f4a6dd640 1 -- 172.21.15.78:0/3941042405 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3f441ee550 con 0x7f3f440c4f80 2023-11-28T20:01:18.644 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:18.637+0000 7f3f40ff9640 1 -- 172.21.15.78:0/3941042405 <== mon.1 v2:172.21.15.179:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f3f380b33f0 con 0x7f3f440c4f80 2023-11-28T20:01:18.645 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:18.637+0000 7f3f40ff9640 1 --2- 172.21.15.78:0/3941042405 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f3f30066470 0x7f3f30068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:18.645 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:18.637+0000 7f3f40ff9640 1 -- 172.21.15.78:0/3941042405 <== mon.1 v2:172.21.15.179:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f3f3811ea10 con 0x7f3f440c4f80 2023-11-28T20:01:18.645 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:18.637+0000 7f3f43fff640 1 --2- 172.21.15.78:0/3941042405 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f3f30066470 0x7f3f30068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:18.645 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:18.637+0000 7f3f43fff640 1 --2- 172.21.15.78:0/3941042405 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f3f30066470 0x7f3f30068930 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f3f34009ac0 tx=0x7f3f34009190 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:01:18.647 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:18.641+0000 7f3f40ff9640 1 -- 172.21.15.78:0/3941042405 <== mon.1 v2:172.21.15.179:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f3f380ebf10 con 0x7f3f440c4f80 2023-11-28T20:01:18.848 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:18.845+0000 7f3f4a6dd640 1 -- 172.21.15.78:0/3941042405 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "auth rm", "entity": "client.testuser"} v 0) v1 -- 0x7f3f44067630 con 0x7f3f440c4f80 2023-11-28T20:01:18.850 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:18.845+0000 7f3f40ff9640 1 -- 172.21.15.78:0/3941042405 <== mon.1 v2:172.21.15.179:3300/0 7 ==== mon_command_ack([{"prefix": "auth rm", "entity": "client.testuser"}]=0 v17) v1 ==== 84+0+0 (secure 0 0 0) 0x7f3f380c3090 con 0x7f3f440c4f80 2023-11-28T20:01:18.852 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:18.849+0000 7f3f4a6dd640 1 -- 172.21.15.78:0/3941042405 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f3f30066470 msgr2=0x7f3f30068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:01:18.852 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:18.849+0000 7f3f4a6dd640 1 --2- 172.21.15.78:0/3941042405 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f3f30066470 0x7f3f30068930 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f3f34009ac0 tx=0x7f3f34009190 comp rx=0 tx=0).stop 2023-11-28T20:01:18.852 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:18.849+0000 7f3f4a6dd640 1 -- 172.21.15.78:0/3941042405 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3f440c4f80 msgr2=0x7f3f441eac30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:01:18.852 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:18.849+0000 7f3f4a6dd640 1 --2- 172.21.15.78:0/3941042405 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3f440c4f80 0x7f3f441eac30 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f3f380ac000 tx=0x7f3f3801cf50 comp rx=0 tx=0).stop 2023-11-28T20:01:18.852 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:18.849+0000 7f3f4a6dd640 1 -- 172.21.15.78:0/3941042405 shutdown_connections 2023-11-28T20:01:18.852 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:18.849+0000 7f3f4a6dd640 1 --2- 172.21.15.78:0/3941042405 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f3f30066470 0x7f3f30068930 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:18.852 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:18.849+0000 7f3f4a6dd640 1 --2- 172.21.15.78:0/3941042405 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3f44154390 0x7f3f44070a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:18.853 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:18.849+0000 7f3f4a6dd640 1 --2- 172.21.15.78:0/3941042405 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3f440c4f80 0x7f3f441eac30 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:18.853 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:18.849+0000 7f3f4a6dd640 1 --2- 172.21.15.78:0/3941042405 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3f440c2110 0x7f3f44071f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:18.853 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:18.849+0000 7f3f4a6dd640 1 -- 172.21.15.78:0/3941042405 >> 172.21.15.78:0/3941042405 conn(0x7f3f4406b220 msgr2=0x7f3f44152b40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:01:18.853 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:18.849+0000 7f3f4a6dd640 1 -- 172.21.15.78:0/3941042405 shutdown_connections 2023-11-28T20:01:18.853 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:18.849+0000 7f3f4a6dd640 1 -- 172.21.15.78:0/3941042405 wait complete. 2023-11-28T20:01:18.872 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-28T20:01:19.009 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:19.005+0000 7fcf5d1aa640 1 Processor -- start 2023-11-28T20:01:19.010 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:19.005+0000 7fcf5d1aa640 1 -- start start 2023-11-28T20:01:19.015 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:19.005+0000 7fcf5d1aa640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcf580bee90 0x7fcf580bf310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:19.015 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:19.005+0000 7fcf5d1aa640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcf58157cf0 con 0x7fcf5814b2a0 2023-11-28T20:01:19.015 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:19.005+0000 7fcf5d1aa640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcf58157fd0 con 0x7fcf58154740 2023-11-28T20:01:19.015 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:19.005+0000 7fcf5d1aa640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf5806c3a0 con 0x7fcf580bee90 2023-11-28T20:01:19.015 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:19.005+0000 7fcf56d9d640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7fcf5814b2a0 0x7fcf580a4ec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:47394/0 (socket says 172.21.15.78:47394) 2023-11-28T20:01:19.016 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:19.005+0000 7fcf56d9d640 1 -- 172.21.15.78:0/2546294941 learned_addr learned my addr 172.21.15.78:0/2546294941 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-11-28T20:01:19.016 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:19.005+0000 7fcf4e59c640 1 --2- 172.21.15.78:0/2546294941 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcf580bee90 0x7fcf580bf310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:19.016 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:19.005+0000 7fcf5659c640 1 -- 172.21.15.78:0/2546294941 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1903076799 0 0) 0x7fcf58157cf0 con 0x7fcf5814b2a0 2023-11-28T20:01:19.016 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:19.005+0000 7fcf5659c640 1 -- 172.21.15.78:0/2546294941 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcf44003530 con 0x7fcf5814b2a0 2023-11-28T20:01:19.016 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:19.005+0000 7fcf5659c640 1 -- 172.21.15.78:0/2546294941 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3082480574 0 0) 0x7fcf58157fd0 con 0x7fcf58154740 2023-11-28T20:01:19.016 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:19.005+0000 7fcf4e59c640 1 -- 172.21.15.78:0/2546294941 >> v1:172.21.15.179:6789/0 conn(0x7fcf58154740 legacy=0x7fcf58154bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:01:19.017 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:19.005+0000 7fcf4e59c640 1 -- 172.21.15.78:0/2546294941 >> v1:172.21.15.78:6789/0 conn(0x7fcf5814b2a0 legacy=0x7fcf580a4ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:01:19.017 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:19.005+0000 7fcf4e59c640 1 -- 172.21.15.78:0/2546294941 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf581582b0 con 0x7fcf580bee90 2023-11-28T20:01:19.017 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:19.009+0000 7fcf4e59c640 1 --2- 172.21.15.78:0/2546294941 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcf580bee90 0x7fcf580bf310 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fcf40009dc0 tx=0x7fcf4001c850 comp rx=0 tx=0).ready entity=mon.2 client_cookie=79d72d56d468655f server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:01:19.018 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:19.009+0000 7fcf5659c640 1 -- 172.21.15.78:0/2546294941 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf400a5710 con 0x7fcf580bee90 2023-11-28T20:01:19.018 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:19.009+0000 7fcf5659c640 1 -- 172.21.15.78:0/2546294941 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf400a5870 con 0x7fcf580bee90 2023-11-28T20:01:19.018 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:19.009+0000 7fcf5659c640 1 -- 172.21.15.78:0/2546294941 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf400a5be0 con 0x7fcf580bee90 2023-11-28T20:01:19.021 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:19.009+0000 7fcf5d1aa640 1 -- 172.21.15.78:0/2546294941 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcf580bee90 msgr2=0x7fcf580bf310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:01:19.021 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:19.009+0000 7fcf5d1aa640 1 --2- 172.21.15.78:0/2546294941 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcf580bee90 0x7fcf580bf310 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fcf40009dc0 tx=0x7fcf4001c850 comp rx=0 tx=0).stop 2023-11-28T20:01:19.021 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:19.009+0000 7fcf5d1aa640 1 -- 172.21.15.78:0/2546294941 shutdown_connections 2023-11-28T20:01:19.021 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:19.009+0000 7fcf5d1aa640 1 --2- 172.21.15.78:0/2546294941 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcf580bee90 0x7fcf580bf310 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:19.021 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:19.009+0000 7fcf5d1aa640 1 -- 172.21.15.78:0/2546294941 >> 172.21.15.78:0/2546294941 conn(0x7fcf580a7810 msgr2=0x7fcf580a7c20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:01:19.021 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:19.013+0000 7fcf5d1aa640 1 -- 172.21.15.78:0/2546294941 shutdown_connections 2023-11-28T20:01:19.022 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:19.013+0000 7fcf5d1aa640 1 -- 172.21.15.78:0/2546294941 wait complete. 2023-11-28T20:01:19.022 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:19.013+0000 7fcf5d1aa640 1 Processor -- start 2023-11-28T20:01:19.022 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:19.013+0000 7fcf5d1aa640 1 -- start start 2023-11-28T20:01:19.022 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:19.013+0000 7fcf5d1aa640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcf580bee90 0x7fcf5813f8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:19.022 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:19.013+0000 7fcf5d1aa640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcf5814b2a0 0x7fcf581536f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:19.022 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:19.013+0000 7fcf5d1aa640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcf58154740 0x7fcf58146680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:19.023 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:19.013+0000 7fcf5d1aa640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf58156dc0 con 0x7fcf580bee90 2023-11-28T20:01:19.023 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:19.013+0000 7fcf5d1aa640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf581575d0 con 0x7fcf58154740 2023-11-28T20:01:19.023 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:19.013+0000 7fcf5d1aa640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf58157010 con 0x7fcf5814b2a0 2023-11-28T20:01:19.023 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:19.013+0000 7fcf56d9d640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcf580bee90 0x7fcf5813f8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:19.023 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:19.013+0000 7fcf56d9d640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcf580bee90 0x7fcf5813f8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:40064/0 (socket says 172.21.15.78:40064) 2023-11-28T20:01:19.023 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:19.013+0000 7fcf56d9d640 1 -- 172.21.15.78:0/1208095602 learned_addr learned my addr 172.21.15.78:0/1208095602 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T20:01:19.024 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:19.013+0000 7fcf4e59c640 1 --2- 172.21.15.78:0/1208095602 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcf5814b2a0 0x7fcf581536f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:19.024 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:19.013+0000 7fcf5759e640 1 --2- 172.21.15.78:0/1208095602 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcf58154740 0x7fcf58146680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:19.024 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:19.013+0000 7fcf56d9d640 1 -- 172.21.15.78:0/1208095602 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcf5814b2a0 msgr2=0x7fcf581536f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:01:19.024 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:19.013+0000 7fcf56d9d640 1 --2- 172.21.15.78:0/1208095602 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcf5814b2a0 0x7fcf581536f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:19.025 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:19.013+0000 7fcf56d9d640 1 -- 172.21.15.78:0/1208095602 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcf58154740 msgr2=0x7fcf58146680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:01:19.025 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:19.013+0000 7fcf56d9d640 1 --2- 172.21.15.78:0/1208095602 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcf58154740 0x7fcf58146680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:19.025 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:19.013+0000 7fcf56d9d640 1 -- 172.21.15.78:0/1208095602 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf40009a70 con 0x7fcf580bee90 2023-11-28T20:01:19.025 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:19.013+0000 7fcf4e59c640 1 --2- 172.21.15.78:0/1208095602 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcf5814b2a0 0x7fcf581536f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T20:01:19.026 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:19.013+0000 7fcf5759e640 1 --2- 172.21.15.78:0/1208095602 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcf58154740 0x7fcf58146680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T20:01:19.026 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:19.013+0000 7fcf56d9d640 1 --2- 172.21.15.78:0/1208095602 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcf580bee90 0x7fcf5813f8f0 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7fcf4800c3c0 tx=0x7fcf4800c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:01:19.026 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:19.013+0000 7fcf4ffff640 1 -- 172.21.15.78:0/1208095602 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf48005cf0 con 0x7fcf580bee90 2023-11-28T20:01:19.027 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:19.017+0000 7fcf4ffff640 1 -- 172.21.15.78:0/1208095602 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf48005e50 con 0x7fcf580bee90 2023-11-28T20:01:19.027 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:19.017+0000 7fcf5d1aa640 1 -- 172.21.15.78:0/1208095602 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcf581572f0 con 0x7fcf580bee90 2023-11-28T20:01:19.027 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:19.017+0000 7fcf4ffff640 1 -- 172.21.15.78:0/1208095602 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf480072f0 con 0x7fcf580bee90 2023-11-28T20:01:19.027 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:19.017+0000 7fcf5d1aa640 1 -- 172.21.15.78:0/1208095602 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcf58153c30 con 0x7fcf580bee90 2023-11-28T20:01:19.028 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:19.017+0000 7fcf5d1aa640 1 -- 172.21.15.78:0/1208095602 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcf58154b90 con 0x7fcf580bee90 2023-11-28T20:01:19.029 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:19.017+0000 7fcf4ffff640 1 -- 172.21.15.78:0/1208095602 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fcf48007450 con 0x7fcf580bee90 2023-11-28T20:01:19.029 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:19.017+0000 7fcf4ffff640 1 --2- 172.21.15.78:0/1208095602 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fcf38066470 0x7fcf38068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:19.029 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:19.017+0000 7fcf4ffff640 1 -- 172.21.15.78:0/1208095602 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 6029+0+0 (secure 0 0 0) 0x7fcf480835c0 con 0x7fcf580bee90 2023-11-28T20:01:19.029 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:19.017+0000 7fcf4e59c640 1 --2- 172.21.15.78:0/1208095602 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fcf38066470 0x7fcf38068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:19.030 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:19.017+0000 7fcf4e59c640 1 --2- 172.21.15.78:0/1208095602 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fcf38066470 0x7fcf38068930 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7fcf400af000 tx=0x7fcf400a7070 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:01:19.030 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:19.021+0000 7fcf4ffff640 1 -- 172.21.15.78:0/1208095602 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fcf480508f0 con 0x7fcf580bee90 2023-11-28T20:01:19.174 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:19.169+0000 7fcf5d1aa640 1 -- 172.21.15.78:0/1208095602 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fcf581463a0 con 0x7fcf580bee90 2023-11-28T20:01:19.176 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:19.169+0000 7fcf4ffff640 1 -- 172.21.15.78:0/1208095602 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v61) v1 ==== 74+0+16692 (secure 0 0 0) 0x7fcf48017090 con 0x7fcf580bee90 2023-11-28T20:01:19.176 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-11-28T20:01:19.176 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":61,"fsid":"dd9780e8-3bda-44fa-a9f0-fa07d19d901d","created":"2023-11-28T19:58:40.969556+0000","modified":"2023-11-28T20:01:11.516644+0000","last_up_change":"2023-11-28T19:58:52.596716+0000","last_in_change":"2023-11-28T19:58:43.609275+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":10,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-28T19:58:54.011229+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_metadata","create_time":"2023-11-28T20:01:07.969267+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"60","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_data","create_time":"2023-11-28T20:01:08.865465+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"61","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e84245ac-b5da-429e-af18-39acaa2b33e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6800","nonce":3358701235},{"type":"v1","addr":"172.21.15.78:6801","nonce":3358701235}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6802","nonce":3358701235},{"type":"v1","addr":"172.21.15.78:6803","nonce":3358701235}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6806","nonce":3358701235},{"type":"v1","addr":"172.21.15.78:6807","nonce":3358701235}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6804","nonce":3358701235},{"type":"v1","addr":"172.21.15.78:6805","nonce":3358701235}]},"public_addr":"172.21.15.78:6801/3358701235","cluster_addr":"172.21.15.78:6803/3358701235","heartbeat_back_addr":"172.21.15.78:6807/3358701235","heartbeat_front_addr":"172.21.15.78:6805/3358701235","state":["exists","up"]},{"osd":1,"uuid":"e634831d-c4e2-48d9-870c-9556ae162981","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6808","nonce":3211476654},{"type":"v1","addr":"172.21.15.78:6809","nonce":3211476654}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6810","nonce":3211476654},{"type":"v1","addr":"172.21.15.78:6811","nonce":3211476654}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6814","nonce":3211476654},{"type":"v1","addr":"172.21.15.78:6815","nonce":3211476654}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6812","nonce":3211476654},{"type":"v1","addr":"172.21.15.78:6813","nonce":3211476654}]},"public_addr":"172.21.15.78:6809/3211476654","cluster_addr":"172.21.15.78:6811/3211476654","heartbeat_back_addr":"172.21.15.78:6815/3211476654","heartbeat_front_addr":"172.21.15.78:6813/3211476654","state":["exists","up"]},{"osd":2,"uuid":"274c8395-6534-41f0-b8fb-a00af8985aa8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6816","nonce":2532904479},{"type":"v1","addr":"172.21.15.78:6817","nonce":2532904479}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6818","nonce":2532904479},{"type":"v1","addr":"172.21.15.78:6819","nonce":2532904479}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6822","nonce":2532904479},{"type":"v1","addr":"172.21.15.78:6823","nonce":2532904479}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6820","nonce":2532904479},{"type":"v1","addr":"172.21.15.78:6821","nonce":2532904479}]},"public_addr":"172.21.15.78:6817/2532904479","cluster_addr":"172.21.15.78:6819/2532904479","heartbeat_back_addr":"172.21.15.78:6823/2532904479","heartbeat_front_addr":"172.21.15.78:6821/2532904479","state":["exists","up"]},{"osd":3,"uuid":"77acc9af-7d4d-4b18-8cf5-d62f5971b7c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6824","nonce":3442991267},{"type":"v1","addr":"172.21.15.78:6825","nonce":3442991267}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6826","nonce":3442991267},{"type":"v1","addr":"172.21.15.78:6827","nonce":3442991267}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6830","nonce":3442991267},{"type":"v1","addr":"172.21.15.78:6831","nonce":3442991267}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6828","nonce":3442991267},{"type":"v1","addr":"172.21.15.78:6829","nonce":3442991267}]},"public_addr":"172.21.15.78:6825/3442991267","cluster_addr":"172.21.15.78:6827/3442991267","heartbeat_back_addr":"172.21.15.78:6831/3442991267","heartbeat_front_addr":"172.21.15.78:6829/3442991267","state":["exists","up"]},{"osd":4,"uuid":"5c62bc66-6b34-4b7f-a66b-9a743969138c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":802983577},{"type":"v1","addr":"172.21.15.179:6809","nonce":802983577}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":802983577},{"type":"v1","addr":"172.21.15.179:6811","nonce":802983577}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":802983577},{"type":"v1","addr":"172.21.15.179:6815","nonce":802983577}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":802983577},{"type":"v1","addr":"172.21.15.179:6813","nonce":802983577}]},"public_addr":"172.21.15.179:6809/802983577","cluster_addr":"172.21.15.179:6811/802983577","heartbeat_back_addr":"172.21.15.179:6815/802983577","heartbeat_front_addr":"172.21.15.179:6813/802983577","state":["exists","up"]},{"osd":5,"uuid":"67db6d36-f684-4079-b0cd-82b4dd61461f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":518192887},{"type":"v1","addr":"172.21.15.179:6818","nonce":518192887}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":518192887},{"type":"v1","addr":"172.21.15.179:6822","nonce":518192887}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":518192887},{"type":"v1","addr":"172.21.15.179:6829","nonce":518192887}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6824","nonce":518192887},{"type":"v1","addr":"172.21.15.179:6826","nonce":518192887}]},"public_addr":"172.21.15.179:6818/518192887","cluster_addr":"172.21.15.179:6822/518192887","heartbeat_back_addr":"172.21.15.179:6829/518192887","heartbeat_front_addr":"172.21.15.179:6826/518192887","state":["exists","up"]},{"osd":6,"uuid":"12e670af-5a16-4c81-9f97-defa66cab967","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":815435378},{"type":"v1","addr":"172.21.15.179:6801","nonce":815435378}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":815435378},{"type":"v1","addr":"172.21.15.179:6803","nonce":815435378}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":815435378},{"type":"v1","addr":"172.21.15.179:6807","nonce":815435378}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":815435378},{"type":"v1","addr":"172.21.15.179:6805","nonce":815435378}]},"public_addr":"172.21.15.179:6801/815435378","cluster_addr":"172.21.15.179:6803/815435378","heartbeat_back_addr":"172.21.15.179:6807/815435378","heartbeat_front_addr":"172.21.15.179:6805/815435378","state":["exists","up"]},{"osd":7,"uuid":"fe630650-2eb3-49ad-8676-c341e6332eb1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6817","nonce":2848432339},{"type":"v1","addr":"172.21.15.179:6819","nonce":2848432339}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6821","nonce":2848432339},{"type":"v1","addr":"172.21.15.179:6823","nonce":2848432339}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":2848432339},{"type":"v1","addr":"172.21.15.179:6831","nonce":2848432339}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6825","nonce":2848432339},{"type":"v1","addr":"172.21.15.179:6827","nonce":2848432339}]},"public_addr":"172.21.15.179:6819/2848432339","cluster_addr":"172.21.15.179:6823/2848432339","heartbeat_back_addr":"172.21.15.179:6831/2848432339","heartbeat_front_addr":"172.21.15.179:6827/2848432339","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:58:49.255433+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:58:49.412880+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:58:49.559295+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:58:49.245237+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:58:49.184557+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:58:49.329851+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:58:49.366012+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:58:49.349604+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-28T20:01:19.178 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:19.173+0000 7fcf5d1aa640 1 -- 172.21.15.78:0/1208095602 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fcf38066470 msgr2=0x7fcf38068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:01:19.178 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:19.173+0000 7fcf5d1aa640 1 --2- 172.21.15.78:0/1208095602 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fcf38066470 0x7fcf38068930 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7fcf400af000 tx=0x7fcf400a7070 comp rx=0 tx=0).stop 2023-11-28T20:01:19.178 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:19.173+0000 7fcf5d1aa640 1 -- 172.21.15.78:0/1208095602 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcf580bee90 msgr2=0x7fcf5813f8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:01:19.178 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:19.173+0000 7fcf5d1aa640 1 --2- 172.21.15.78:0/1208095602 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcf580bee90 0x7fcf5813f8f0 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7fcf4800c3c0 tx=0x7fcf4800c880 comp rx=0 tx=0).stop 2023-11-28T20:01:19.179 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:19.173+0000 7fcf5d1aa640 1 -- 172.21.15.78:0/1208095602 shutdown_connections 2023-11-28T20:01:19.179 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:19.173+0000 7fcf5d1aa640 1 --2- 172.21.15.78:0/1208095602 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fcf38066470 0x7fcf38068930 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:19.179 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:19.173+0000 7fcf5d1aa640 1 --2- 172.21.15.78:0/1208095602 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcf5814b2a0 0x7fcf581536f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:19.179 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:19.173+0000 7fcf5d1aa640 1 --2- 172.21.15.78:0/1208095602 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcf58154740 0x7fcf58146680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:19.179 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:19.173+0000 7fcf5d1aa640 1 --2- 172.21.15.78:0/1208095602 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcf580bee90 0x7fcf5813f8f0 unknown :-1 s=CLOSED pgs=661 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:19.179 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:19.173+0000 7fcf5d1aa640 1 -- 172.21.15.78:0/1208095602 >> 172.21.15.78:0/1208095602 conn(0x7fcf580a7810 msgr2=0x7fcf580c0bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:01:19.179 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:19.173+0000 7fcf5d1aa640 1 -- 172.21.15.78:0/1208095602 shutdown_connections 2023-11-28T20:01:19.179 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:19.173+0000 7fcf5d1aa640 1 -- 172.21.15.78:0/1208095602 wait complete. 2023-11-28T20:01:19.197 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-28T19:58:54.011229+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 9, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-28T20:01:07.969267+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '60', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 10, 'pool_name': 'cephfs_data', 'create_time': '2023-11-28T20:01:08.865465+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '61', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-28T20:01:19.198 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-28T20:01:19.337 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:19.333+0000 7f435ecfd640 1 Processor -- start 2023-11-28T20:01:19.338 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:19.333+0000 7f435ecfd640 1 -- start start 2023-11-28T20:01:19.339 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:19.333+0000 7f435ecfd640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f435814fc30 0x7f43580c3cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:19.339 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:19.333+0000 7f435ecfd640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f435806d840 0x7f43580c4210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:19.339 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:19.333+0000 7f435ecfd640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4358152910 con 0x7f435814f850 2023-11-28T20:01:19.339 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:19.333+0000 7f435ecfd640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f43580c2240 con 0x7f435814fc30 2023-11-28T20:01:19.340 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:19.333+0000 7f435ecfd640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4358152bf0 con 0x7f435806d840 2023-11-28T20:01:19.340 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:19.333+0000 7f434ffff640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f435814fc30 0x7f43580c3cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:19.340 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:19.333+0000 7f434ffff640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f435814fc30 0x7f43580c3cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:40070/0 (socket says 172.21.15.78:40070) 2023-11-28T20:01:19.340 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:19.333+0000 7f434ffff640 1 -- 172.21.15.78:0/221450540 learned_addr learned my addr 172.21.15.78:0/221450540 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T20:01:19.340 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:19.333+0000 7f435d29a640 1 --2- 172.21.15.78:0/221450540 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f435806d840 0x7f43580c4210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:19.340 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:19.333+0000 7f434ffff640 1 -- 172.21.15.78:0/221450540 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f435806d840 msgr2=0x7f43580c4210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:01:19.340 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:19.333+0000 7f434ffff640 1 --2- 172.21.15.78:0/221450540 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f435806d840 0x7f43580c4210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:19.341 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:19.333+0000 7f434ffff640 1 -- 172.21.15.78:0/221450540 >> v1:172.21.15.179:6789/0 conn(0x7f435814f850 legacy=0x7f43580aacf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:01:19.341 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:19.333+0000 7f434ffff640 1 -- 172.21.15.78:0/221450540 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4358152ed0 con 0x7f435814fc30 2023-11-28T20:01:19.342 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:19.337+0000 7f434ffff640 1 --2- 172.21.15.78:0/221450540 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f435814fc30 0x7f43580c3cd0 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7f4348009870 tx=0x7f434801c540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3dd8d6ab568892d0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:01:19.343 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:19.337+0000 7f434f7fe640 1 -- 172.21.15.78:0/221450540 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43480ab670 con 0x7f435814fc30 2023-11-28T20:01:19.343 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:19.337+0000 7f434f7fe640 1 -- 172.21.15.78:0/221450540 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f43480ab7d0 con 0x7f435814fc30 2023-11-28T20:01:19.344 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:19.337+0000 7f434f7fe640 1 -- 172.21.15.78:0/221450540 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43480abb60 con 0x7f435814fc30 2023-11-28T20:01:19.344 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:19.337+0000 7f435ecfd640 1 -- 172.21.15.78:0/221450540 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f435814fc30 msgr2=0x7f43580c3cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:01:19.344 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:19.337+0000 7f435ecfd640 1 --2- 172.21.15.78:0/221450540 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f435814fc30 0x7f43580c3cd0 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7f4348009870 tx=0x7f434801c540 comp rx=0 tx=0).stop 2023-11-28T20:01:19.344 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:19.337+0000 7f435ecfd640 1 -- 172.21.15.78:0/221450540 shutdown_connections 2023-11-28T20:01:19.344 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:19.337+0000 7f435ecfd640 1 --2- 172.21.15.78:0/221450540 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f435806d840 0x7f43580c4210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:19.344 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:19.337+0000 7f435ecfd640 1 --2- 172.21.15.78:0/221450540 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f435814fc30 0x7f43580c3cd0 unknown :-1 s=CLOSED pgs=662 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:19.345 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:19.337+0000 7f435ecfd640 1 -- 172.21.15.78:0/221450540 >> 172.21.15.78:0/221450540 conn(0x7f43580c59f0 msgr2=0x7f43580c5e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:01:19.345 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:19.337+0000 7f435ecfd640 1 -- 172.21.15.78:0/221450540 shutdown_connections 2023-11-28T20:01:19.345 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:19.337+0000 7f435ecfd640 1 -- 172.21.15.78:0/221450540 wait complete. 2023-11-28T20:01:19.345 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:19.341+0000 7f435ecfd640 1 Processor -- start 2023-11-28T20:01:19.346 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:19.341+0000 7f435ecfd640 1 -- start start 2023-11-28T20:01:19.347 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:19.341+0000 7f435ecfd640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f435806d840 0x7f4358147e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:19.347 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:19.341+0000 7f435ecfd640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f435814f850 0x7f4358071940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:19.347 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:19.341+0000 7f435ecfd640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f435814fc30 0x7f4358071e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:19.348 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:19.341+0000 7f435ecfd640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43581f1170 con 0x7f435806d840 2023-11-28T20:01:19.348 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:19.341+0000 7f435ecfd640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43580714b0 con 0x7f435814fc30 2023-11-28T20:01:19.348 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:19.341+0000 7f435ecfd640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f43580a8ae0 con 0x7f435814f850 2023-11-28T20:01:19.348 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:19.341+0000 7f435ca99640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f435806d840 0x7f4358147e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:19.348 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:19.341+0000 7f435ca99640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f435806d840 0x7f4358147e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:40076/0 (socket says 172.21.15.78:40076) 2023-11-28T20:01:19.348 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:19.341+0000 7f435ca99640 1 -- 172.21.15.78:0/2251614248 learned_addr learned my addr 172.21.15.78:0/2251614248 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T20:01:19.348 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:19.341+0000 7f435d29a640 1 --2- 172.21.15.78:0/2251614248 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f435814fc30 0x7f4358071e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:19.348 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:19.341+0000 7f434ffff640 1 --2- 172.21.15.78:0/2251614248 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f435814f850 0x7f4358071940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:19.348 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:19.341+0000 7f435ca99640 1 -- 172.21.15.78:0/2251614248 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f435814f850 msgr2=0x7f4358071940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:01:19.348 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:19.341+0000 7f435ca99640 1 --2- 172.21.15.78:0/2251614248 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f435814f850 0x7f4358071940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:19.348 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:19.341+0000 7f435ca99640 1 -- 172.21.15.78:0/2251614248 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f435814fc30 msgr2=0x7f4358071e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:01:19.349 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:19.341+0000 7f435ca99640 1 --2- 172.21.15.78:0/2251614248 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f435814fc30 0x7f4358071e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:19.349 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:19.341+0000 7f435ca99640 1 -- 172.21.15.78:0/2251614248 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43480094d0 con 0x7f435806d840 2023-11-28T20:01:19.349 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:19.341+0000 7f435ca99640 1 --2- 172.21.15.78:0/2251614248 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f435806d840 0x7f4358147e30 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7f435400c480 tx=0x7f435400c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:01:19.349 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:19.341+0000 7f434d7fa640 1 -- 172.21.15.78:0/2251614248 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43540052d0 con 0x7f435806d840 2023-11-28T20:01:19.349 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:19.341+0000 7f434d7fa640 1 -- 172.21.15.78:0/2251614248 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4354005450 con 0x7f435806d840 2023-11-28T20:01:19.349 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:19.341+0000 7f434d7fa640 1 -- 172.21.15.78:0/2251614248 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4354012870 con 0x7f435806d840 2023-11-28T20:01:19.349 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:19.341+0000 7f435ecfd640 1 -- 172.21.15.78:0/2251614248 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f43581f0e90 con 0x7f435806d840 2023-11-28T20:01:19.349 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:19.345+0000 7f435ecfd640 1 -- 172.21.15.78:0/2251614248 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4358148370 con 0x7f435806d840 2023-11-28T20:01:19.350 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:19.345+0000 7f435ecfd640 1 -- 172.21.15.78:0/2251614248 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4358071260 con 0x7f435806d840 2023-11-28T20:01:19.350 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:19.345+0000 7f434d7fa640 1 -- 172.21.15.78:0/2251614248 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f43540129d0 con 0x7f435806d840 2023-11-28T20:01:19.350 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:19.345+0000 7f434d7fa640 1 --2- 172.21.15.78:0/2251614248 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f43440664a0 0x7f4344068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:19.350 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:19.345+0000 7f434d7fa640 1 -- 172.21.15.78:0/2251614248 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f4354083ab0 con 0x7f435806d840 2023-11-28T20:01:19.350 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:19.345+0000 7f434ffff640 1 --2- 172.21.15.78:0/2251614248 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f43440664a0 0x7f4344068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:19.351 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:19.345+0000 7f434ffff640 1 --2- 172.21.15.78:0/2251614248 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f43440664a0 0x7f4344068960 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f43480af000 tx=0x7f43480b6040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:01:19.354 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:19.349+0000 7f434d7fa640 1 -- 172.21.15.78:0/2251614248 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f4354050e00 con 0x7f435806d840 2023-11-28T20:01:19.503 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:19.501+0000 7f435ecfd640 1 -- 172.21.15.78:0/2251614248 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f4358067630 con 0x7f435806d840 2023-11-28T20:01:19.504 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:19.501+0000 7f434d7fa640 1 -- 172.21.15.78:0/2251614248 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v61) v1 ==== 93+0+10 (secure 0 0 0) 0x7f4354054420 con 0x7f435806d840 2023-11-28T20:01:19.504 INFO:teuthology.orchestra.run.smithi078.stdout:pg_num: 1 2023-11-28T20:01:19.506 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:19.501+0000 7f435ecfd640 1 -- 172.21.15.78:0/2251614248 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f43440664a0 msgr2=0x7f4344068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:01:19.506 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:19.501+0000 7f435ecfd640 1 --2- 172.21.15.78:0/2251614248 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f43440664a0 0x7f4344068960 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f43480af000 tx=0x7f43480b6040 comp rx=0 tx=0).stop 2023-11-28T20:01:19.506 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:19.501+0000 7f435ecfd640 1 -- 172.21.15.78:0/2251614248 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f435806d840 msgr2=0x7f4358147e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:01:19.506 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:19.501+0000 7f435ecfd640 1 --2- 172.21.15.78:0/2251614248 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f435806d840 0x7f4358147e30 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7f435400c480 tx=0x7f435400c940 comp rx=0 tx=0).stop 2023-11-28T20:01:19.507 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:19.501+0000 7f435ecfd640 1 -- 172.21.15.78:0/2251614248 shutdown_connections 2023-11-28T20:01:19.507 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:19.501+0000 7f435ecfd640 1 --2- 172.21.15.78:0/2251614248 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f43440664a0 0x7f4344068960 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:19.507 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:19.501+0000 7f435ecfd640 1 --2- 172.21.15.78:0/2251614248 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f435814f850 0x7f4358071940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:19.507 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:19.501+0000 7f435ecfd640 1 --2- 172.21.15.78:0/2251614248 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f435814fc30 0x7f4358071e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:19.507 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:19.501+0000 7f435ecfd640 1 --2- 172.21.15.78:0/2251614248 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f435806d840 0x7f4358147e30 unknown :-1 s=CLOSED pgs=663 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:19.507 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:19.501+0000 7f435ecfd640 1 -- 172.21.15.78:0/2251614248 >> 172.21.15.78:0/2251614248 conn(0x7f43580c59f0 msgr2=0x7f435814ed50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:01:19.507 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:19.501+0000 7f435ecfd640 1 -- 172.21.15.78:0/2251614248 shutdown_connections 2023-11-28T20:01:19.507 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:19.501+0000 7f435ecfd640 1 -- 172.21.15.78:0/2251614248 wait complete. 2023-11-28T20:01:19.525 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-28T20:01:19.666 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:19.661+0000 7fb5b1d3e640 1 Processor -- start 2023-11-28T20:01:19.666 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:19.661+0000 7fb5b1d3e640 1 -- start start 2023-11-28T20:01:19.667 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:19.661+0000 7fb5b1d3e640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fb5ac14b1e0 0x7fb5ac0c1700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:19.667 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:19.661+0000 7fb5b1d3e640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb5ac0a4e20 con 0x7fb5ac0c5300 2023-11-28T20:01:19.667 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:19.661+0000 7fb5b1d3e640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb5ac0a50e0 con 0x7fb5ac1548c0 2023-11-28T20:01:19.667 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:19.661+0000 7fb5b1d3e640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb5ac0c0f00 con 0x7fb5ac14b1e0 2023-11-28T20:01:19.668 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:19.661+0000 7fb5aaffd640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7fb5ac0c5300 0x7fb5ac0a9c30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:47408/0 (socket says 172.21.15.78:47408) 2023-11-28T20:01:19.668 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:19.661+0000 7fb5aaffd640 1 -- 172.21.15.78:0/1619692412 learned_addr learned my addr 172.21.15.78:0/1619692412 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-11-28T20:01:19.668 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:19.661+0000 7fb5ab7fe640 1 --2- 172.21.15.78:0/1619692412 >> v2:172.21.15.78:3300/0 conn(0x7fb5ac14b1e0 0x7fb5ac0c1700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:19.668 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:19.665+0000 7fb5aa7fc640 1 -- 172.21.15.78:0/1619692412 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 300421889 0 0) 0x7fb5ac0a4e20 con 0x7fb5ac0c5300 2023-11-28T20:01:19.668 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:19.665+0000 7fb5ab7fe640 1 -- 172.21.15.78:0/1619692412 >> v1:172.21.15.179:6789/0 conn(0x7fb5ac1548c0 legacy=0x7fb5ac154d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:01:19.668 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:19.665+0000 7fb5ab7fe640 1 -- 172.21.15.78:0/1619692412 >> v1:172.21.15.78:6789/0 conn(0x7fb5ac0c5300 legacy=0x7fb5ac0a9c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:01:19.668 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:19.665+0000 7fb5ab7fe640 1 -- 172.21.15.78:0/1619692412 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5ac0c11e0 con 0x7fb5ac14b1e0 2023-11-28T20:01:19.671 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:19.665+0000 7fb5ab7fe640 1 --2- 172.21.15.78:0/1619692412 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb5ac14b1e0 0x7fb5ac0c1700 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7fb59c0097c0 tx=0x7fb59c01c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c7de6e0098d840 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:01:19.671 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:19.665+0000 7fb5aa7fc640 1 -- 172.21.15.78:0/1619692412 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb59c0ab600 con 0x7fb5ac14b1e0 2023-11-28T20:01:19.671 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:19.665+0000 7fb5aa7fc640 1 -- 172.21.15.78:0/1619692412 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb59c0a7050 con 0x7fb5ac14b1e0 2023-11-28T20:01:19.672 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:19.665+0000 7fb5aa7fc640 1 -- 172.21.15.78:0/1619692412 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb59c0ab980 con 0x7fb5ac14b1e0 2023-11-28T20:01:19.672 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:19.669+0000 7fb5b1d3e640 1 -- 172.21.15.78:0/1619692412 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb5ac14b1e0 msgr2=0x7fb5ac0c1700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:01:19.672 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:19.669+0000 7fb5b1d3e640 1 --2- 172.21.15.78:0/1619692412 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb5ac14b1e0 0x7fb5ac0c1700 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7fb59c0097c0 tx=0x7fb59c01c480 comp rx=0 tx=0).stop 2023-11-28T20:01:19.673 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:19.669+0000 7fb5b1d3e640 1 -- 172.21.15.78:0/1619692412 shutdown_connections 2023-11-28T20:01:19.673 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:19.669+0000 7fb5b1d3e640 1 --2- 172.21.15.78:0/1619692412 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb5ac14b1e0 0x7fb5ac0c1700 unknown :-1 s=CLOSED pgs=665 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:19.673 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:19.669+0000 7fb5b1d3e640 1 -- 172.21.15.78:0/1619692412 >> 172.21.15.78:0/1619692412 conn(0x7fb5ac0c59f0 msgr2=0x7fb5ac0c5e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:01:19.673 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:19.669+0000 7fb5b1d3e640 1 -- 172.21.15.78:0/1619692412 shutdown_connections 2023-11-28T20:01:19.673 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:19.669+0000 7fb5b1d3e640 1 -- 172.21.15.78:0/1619692412 wait complete. 2023-11-28T20:01:19.674 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:19.669+0000 7fb5b1d3e640 1 Processor -- start 2023-11-28T20:01:19.674 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:19.669+0000 7fb5b1d3e640 1 -- start start 2023-11-28T20:01:19.675 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:19.669+0000 7fb5b1d3e640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb5ac0c5300 0x7fb5ac1504c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:19.675 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:19.669+0000 7fb5b1d3e640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb5ac1548c0 0x7fb5ac1eafe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:19.676 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:19.669+0000 7fb5b1d3e640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb5ac141390 0x7fb5ac151820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:19.676 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:19.669+0000 7fb5b1d3e640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5ac1500a0 con 0x7fb5ac0c5300 2023-11-28T20:01:19.676 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:19.669+0000 7fb5b1d3e640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5ac150a00 con 0x7fb5ac141390 2023-11-28T20:01:19.676 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:19.669+0000 7fb5b1d3e640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5ac1445a0 con 0x7fb5ac1548c0 2023-11-28T20:01:19.676 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:19.669+0000 7fb5ab7fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb5ac0c5300 0x7fb5ac1504c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:19.676 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:19.669+0000 7fb5ab7fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb5ac0c5300 0x7fb5ac1504c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:40096/0 (socket says 172.21.15.78:40096) 2023-11-28T20:01:19.676 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:19.669+0000 7fb5ab7fe640 1 -- 172.21.15.78:0/3204111471 learned_addr learned my addr 172.21.15.78:0/3204111471 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T20:01:19.676 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:19.669+0000 7fb5abfff640 1 --2- 172.21.15.78:0/3204111471 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb5ac141390 0x7fb5ac151820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:19.676 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:19.669+0000 7fb5aaffd640 1 --2- 172.21.15.78:0/3204111471 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb5ac1548c0 0x7fb5ac1eafe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:19.677 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:19.669+0000 7fb5ab7fe640 1 -- 172.21.15.78:0/3204111471 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb5ac1548c0 msgr2=0x7fb5ac1eafe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:01:19.677 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:19.669+0000 7fb5ab7fe640 1 --2- 172.21.15.78:0/3204111471 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb5ac1548c0 0x7fb5ac1eafe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:19.677 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:19.669+0000 7fb5ab7fe640 1 -- 172.21.15.78:0/3204111471 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb5ac141390 msgr2=0x7fb5ac151820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:01:19.677 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:19.669+0000 7fb5ab7fe640 1 --2- 172.21.15.78:0/3204111471 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb5ac141390 0x7fb5ac151820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:19.677 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:19.669+0000 7fb5ab7fe640 1 -- 172.21.15.78:0/3204111471 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb59c009420 con 0x7fb5ac0c5300 2023-11-28T20:01:19.677 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:19.669+0000 7fb5aaffd640 1 --2- 172.21.15.78:0/3204111471 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb5ac1548c0 0x7fb5ac1eafe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T20:01:19.677 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:19.673+0000 7fb5ab7fe640 1 --2- 172.21.15.78:0/3204111471 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb5ac0c5300 0x7fb5ac1504c0 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7fb59c01a0b0 tx=0x7fb59c01acc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:01:19.678 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:19.673+0000 7fb593fff640 1 -- 172.21.15.78:0/3204111471 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb59c0b7650 con 0x7fb5ac0c5300 2023-11-28T20:01:19.678 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:19.673+0000 7fb593fff640 1 -- 172.21.15.78:0/3204111471 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb59c0b77d0 con 0x7fb5ac0c5300 2023-11-28T20:01:19.678 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:19.673+0000 7fb593fff640 1 -- 172.21.15.78:0/3204111471 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb59c0b7b80 con 0x7fb5ac0c5300 2023-11-28T20:01:19.678 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:19.673+0000 7fb5b1d3e640 1 -- 172.21.15.78:0/3204111471 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb5ac14f140 con 0x7fb5ac0c5300 2023-11-28T20:01:19.678 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:19.673+0000 7fb5b1d3e640 1 -- 172.21.15.78:0/3204111471 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb5ac14f700 con 0x7fb5ac0c5300 2023-11-28T20:01:19.679 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:19.673+0000 7fb5b1d3e640 1 -- 172.21.15.78:0/3204111471 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb5ac150310 con 0x7fb5ac0c5300 2023-11-28T20:01:19.679 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:19.673+0000 7fb593fff640 1 -- 172.21.15.78:0/3204111471 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fb59c0b7ce0 con 0x7fb5ac0c5300 2023-11-28T20:01:19.679 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:19.673+0000 7fb593fff640 1 --2- 172.21.15.78:0/3204111471 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fb598066470 0x7fb598068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:19.679 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:19.673+0000 7fb593fff640 1 -- 172.21.15.78:0/3204111471 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 6029+0+0 (secure 0 0 0) 0x7fb59c11eaa0 con 0x7fb5ac0c5300 2023-11-28T20:01:19.679 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:19.673+0000 7fb5aaffd640 1 --2- 172.21.15.78:0/3204111471 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fb598066470 0x7fb598068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:19.680 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:19.677+0000 7fb5aaffd640 1 --2- 172.21.15.78:0/3204111471 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fb598066470 0x7fb598068930 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7fb5ac1e7990 tx=0x7fb5a0009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:01:19.683 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:19.677+0000 7fb593fff640 1 -- 172.21.15.78:0/3204111471 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fb59c0ebef0 con 0x7fb5ac0c5300 2023-11-28T20:01:19.834 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:19.829+0000 7fb5b1d3e640 1 -- 172.21.15.78:0/3204111471 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fb5ac067630 con 0x7fb5ac0c5300 2023-11-28T20:01:19.835 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:19.829+0000 7fb593fff640 1 -- 172.21.15.78:0/3204111471 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v61) v1 ==== 104+0+11 (secure 0 0 0) 0x7fb59c0ef510 con 0x7fb5ac0c5300 2023-11-28T20:01:19.835 INFO:teuthology.orchestra.run.smithi078.stdout:pg_num: 32 2023-11-28T20:01:19.837 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:19.833+0000 7fb5b1d3e640 1 -- 172.21.15.78:0/3204111471 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fb598066470 msgr2=0x7fb598068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:01:19.837 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:19.833+0000 7fb5b1d3e640 1 --2- 172.21.15.78:0/3204111471 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fb598066470 0x7fb598068930 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7fb5ac1e7990 tx=0x7fb5a0009040 comp rx=0 tx=0).stop 2023-11-28T20:01:19.837 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:19.833+0000 7fb5b1d3e640 1 -- 172.21.15.78:0/3204111471 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb5ac0c5300 msgr2=0x7fb5ac1504c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:01:19.837 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:19.833+0000 7fb5b1d3e640 1 --2- 172.21.15.78:0/3204111471 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb5ac0c5300 0x7fb5ac1504c0 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7fb59c01a0b0 tx=0x7fb59c01acc0 comp rx=0 tx=0).stop 2023-11-28T20:01:19.837 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:19.833+0000 7fb5b1d3e640 1 -- 172.21.15.78:0/3204111471 shutdown_connections 2023-11-28T20:01:19.838 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:19.833+0000 7fb5b1d3e640 1 --2- 172.21.15.78:0/3204111471 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fb598066470 0x7fb598068930 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:19.838 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:19.833+0000 7fb5b1d3e640 1 --2- 172.21.15.78:0/3204111471 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb5ac1548c0 0x7fb5ac1eafe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:19.838 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:19.833+0000 7fb5b1d3e640 1 --2- 172.21.15.78:0/3204111471 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb5ac141390 0x7fb5ac151820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:19.838 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:19.833+0000 7fb5b1d3e640 1 --2- 172.21.15.78:0/3204111471 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb5ac0c5300 0x7fb5ac1504c0 unknown :-1 s=CLOSED pgs=666 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:19.838 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:19.833+0000 7fb5b1d3e640 1 -- 172.21.15.78:0/3204111471 >> 172.21.15.78:0/3204111471 conn(0x7fb5ac0c59f0 msgr2=0x7fb5ac153340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:01:19.839 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:19.833+0000 7fb5b1d3e640 1 -- 172.21.15.78:0/3204111471 shutdown_connections 2023-11-28T20:01:19.839 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:19.833+0000 7fb5b1d3e640 1 -- 172.21.15.78:0/3204111471 wait complete. 2023-11-28T20:01:19.855 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-28T20:01:19.995 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:19.989+0000 7fdd0b59e640 1 Processor -- start 2023-11-28T20:01:19.995 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:19.989+0000 7fdd0b59e640 1 -- start start 2023-11-28T20:01:19.997 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:19.993+0000 7fdd0b59e640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdd0c0ca330 0x7fdd0c0ca710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:19.997 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:19.993+0000 7fdd0b59e640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fdd0c0c45a0 0x7fdd0c154e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:19.997 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:19.993+0000 7fdd0b59e640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fdd0c06c480 0x7fdd0c0c7d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:19.997 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:19.993+0000 7fdd0b59e640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdd0c0c54b0 con 0x7fdd0c06c480 2023-11-28T20:01:19.997 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:19.993+0000 7fdd0b59e640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdd0c151e40 con 0x7fdd0c0c45a0 2023-11-28T20:01:19.998 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:19.993+0000 7fdd0b59e640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdd0c1553c0 con 0x7fdd0c0ca330 2023-11-28T20:01:19.998 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:19.993+0000 7fdd0ad9d640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fdd0c06c480 0x7fdd0c0c7d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:19.998 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:19.993+0000 7fdd09d9b640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fdd0c0c45a0 0x7fdd0c154e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:19.998 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:19.993+0000 7fdd09d9b640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fdd0c0c45a0 0x7fdd0c154e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.78:57594/0 (socket says 172.21.15.78:57594) 2023-11-28T20:01:19.998 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:19.993+0000 7fdd09d9b640 1 -- 172.21.15.78:0/2090136027 learned_addr learned my addr 172.21.15.78:0/2090136027 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T20:01:19.998 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:19.993+0000 7fdd0ad9d640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fdd0c06c480 0x7fdd0c0c7d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:40102/0 (socket says 172.21.15.78:40102) 2023-11-28T20:01:19.998 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:19.993+0000 7fdd0a59c640 1 --2- 172.21.15.78:0/2090136027 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdd0c0ca330 0x7fdd0c0ca710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:19.998 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:19.993+0000 7fdd0ad9d640 1 -- 172.21.15.78:0/2090136027 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdd0c0ca330 msgr2=0x7fdd0c0ca710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:01:19.998 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:19.993+0000 7fdd0ad9d640 1 --2- 172.21.15.78:0/2090136027 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdd0c0ca330 0x7fdd0c0ca710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:19.998 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:19.993+0000 7fdd0ad9d640 1 -- 172.21.15.78:0/2090136027 >> v2:172.21.15.179:3300/0 conn(0x7fdd0c0c45a0 msgr2=0x7fdd0c154e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:01:19.998 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:19.993+0000 7fdd0ad9d640 1 --2- 172.21.15.78:0/2090136027 >> v2:172.21.15.179:3300/0 conn(0x7fdd0c0c45a0 0x7fdd0c154e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:19.998 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:19.993+0000 7fdd0ad9d640 1 -- 172.21.15.78:0/2090136027 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd0c06b9e0 con 0x7fdd0c06c480 2023-11-28T20:01:20.000 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:19.997+0000 7fdd0ad9d640 1 --2- 172.21.15.78:0/2090136027 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdd0c06c480 0x7fdd0c0c7d40 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7fdd0c08b280 tx=0x7fdd0401c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=94fecea175684d8 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:01:20.000 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:19.997+0000 7fdd0959a640 1 -- 172.21.15.78:0/2090136027 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd040a5990 con 0x7fdd0c06c480 2023-11-28T20:01:20.000 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:19.997+0000 7fdd0959a640 1 -- 172.21.15.78:0/2090136027 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd040a5af0 con 0x7fdd0c06c480 2023-11-28T20:01:20.000 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:19.997+0000 7fdd0959a640 1 -- 172.21.15.78:0/2090136027 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd040a5e80 con 0x7fdd0c06c480 2023-11-28T20:01:20.001 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:19.997+0000 7fdd0b59e640 1 -- 172.21.15.78:0/2090136027 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdd0c06c480 msgr2=0x7fdd0c0c7d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:01:20.001 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:19.997+0000 7fdd0b59e640 1 --2- 172.21.15.78:0/2090136027 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdd0c06c480 0x7fdd0c0c7d40 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7fdd0c08b280 tx=0x7fdd0401c910 comp rx=0 tx=0).stop 2023-11-28T20:01:20.001 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:19.997+0000 7fdd0b59e640 1 -- 172.21.15.78:0/2090136027 shutdown_connections 2023-11-28T20:01:20.002 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:19.997+0000 7fdd0b59e640 1 --2- 172.21.15.78:0/2090136027 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdd0c06c480 0x7fdd0c0c7d40 unknown :-1 s=CLOSED pgs=667 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:20.002 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:19.997+0000 7fdd0b59e640 1 --2- 172.21.15.78:0/2090136027 >> v2:172.21.15.179:3300/0 conn(0x7fdd0c0c45a0 0x7fdd0c154e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:20.002 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:19.997+0000 7fdd0b59e640 1 --2- 172.21.15.78:0/2090136027 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdd0c0ca330 0x7fdd0c0ca710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:20.002 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:19.997+0000 7fdd0b59e640 1 -- 172.21.15.78:0/2090136027 >> 172.21.15.78:0/2090136027 conn(0x7fdd0c0abdb0 msgr2=0x7fdd0c0c9c20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:01:20.002 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:19.997+0000 7fdd0b59e640 1 -- 172.21.15.78:0/2090136027 shutdown_connections 2023-11-28T20:01:20.002 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:19.997+0000 7fdd0b59e640 1 -- 172.21.15.78:0/2090136027 wait complete. 2023-11-28T20:01:20.003 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:19.997+0000 7fdd0b59e640 1 Processor -- start 2023-11-28T20:01:20.003 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:19.997+0000 7fdd0b59e640 1 -- start start 2023-11-28T20:01:20.005 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:20.001+0000 7fdd0b59e640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdd0c06c480 0x7fdd0c156830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:20.005 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:20.001+0000 7fdd0b59e640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdd0c0c45a0 0x7fdd0c14a9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:20.005 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:20.001+0000 7fdd0b59e640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdd0c0ca330 0x7fdd0c14af30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:20.005 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:20.001+0000 7fdd0b59e640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd0c0c04e0 con 0x7fdd0c0c45a0 2023-11-28T20:01:20.006 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:20.001+0000 7fdd0b59e640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd0c0c3270 con 0x7fdd0c06c480 2023-11-28T20:01:20.006 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:20.001+0000 7fdd0b59e640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdd0c1f0b50 con 0x7fdd0c0ca330 2023-11-28T20:01:20.006 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:20.001+0000 7fdd09d9b640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdd0c0c45a0 0x7fdd0c14a9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:20.006 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:20.001+0000 7fdd0a59c640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdd0c06c480 0x7fdd0c156830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:20.006 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:20.001+0000 7fdd09d9b640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdd0c0c45a0 0x7fdd0c14a9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:40110/0 (socket says 172.21.15.78:40110) 2023-11-28T20:01:20.006 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:20.001+0000 7fdd09d9b640 1 -- 172.21.15.78:0/1195565248 learned_addr learned my addr 172.21.15.78:0/1195565248 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T20:01:20.006 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:20.001+0000 7fdd0ad9d640 1 --2- 172.21.15.78:0/1195565248 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdd0c0ca330 0x7fdd0c14af30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:20.006 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:20.001+0000 7fdd09d9b640 1 -- 172.21.15.78:0/1195565248 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdd0c0ca330 msgr2=0x7fdd0c14af30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:01:20.006 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:20.001+0000 7fdd09d9b640 1 --2- 172.21.15.78:0/1195565248 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdd0c0ca330 0x7fdd0c14af30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:20.007 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:20.001+0000 7fdd09d9b640 1 -- 172.21.15.78:0/1195565248 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdd0c06c480 msgr2=0x7fdd0c156830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:01:20.007 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:20.001+0000 7fdd09d9b640 1 --2- 172.21.15.78:0/1195565248 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdd0c06c480 0x7fdd0c156830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:20.007 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:20.001+0000 7fdd09d9b640 1 -- 172.21.15.78:0/1195565248 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd04009a70 con 0x7fdd0c0c45a0 2023-11-28T20:01:20.007 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:20.001+0000 7fdd09d9b640 1 --2- 172.21.15.78:0/1195565248 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdd0c0c45a0 0x7fdd0c14a9f0 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7fdd0000e8c0 tx=0x7fdd0000ed80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:01:20.007 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:20.001+0000 7fdcfaffd640 1 -- 172.21.15.78:0/1195565248 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd00009620 con 0x7fdd0c0c45a0 2023-11-28T20:01:20.007 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:20.001+0000 7fdcfaffd640 1 -- 172.21.15.78:0/1195565248 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd0000c940 con 0x7fdd0c0c45a0 2023-11-28T20:01:20.007 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:20.001+0000 7fdd0b59e640 1 -- 172.21.15.78:0/1195565248 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdd0c1f1040 con 0x7fdd0c0c45a0 2023-11-28T20:01:20.007 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:20.001+0000 7fdcfaffd640 1 -- 172.21.15.78:0/1195565248 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd0000ccf0 con 0x7fdd0c0c45a0 2023-11-28T20:01:20.007 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:20.001+0000 7fdd0b59e640 1 -- 172.21.15.78:0/1195565248 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdd0c153ab0 con 0x7fdd0c0c45a0 2023-11-28T20:01:20.008 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:20.001+0000 7fdd0b59e640 1 -- 172.21.15.78:0/1195565248 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdd0c0674b0 con 0x7fdd0c0c45a0 2023-11-28T20:01:20.008 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:20.001+0000 7fdcfaffd640 1 -- 172.21.15.78:0/1195565248 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fdd00013470 con 0x7fdd0c0c45a0 2023-11-28T20:01:20.008 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:20.005+0000 7fdcfaffd640 1 --2- 172.21.15.78:0/1195565248 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fdcec066470 0x7fdcec068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:20.008 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:20.005+0000 7fdcfaffd640 1 -- 172.21.15.78:0/1195565248 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 6029+0+0 (secure 0 0 0) 0x7fdd00084100 con 0x7fdd0c0c45a0 2023-11-28T20:01:20.008 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:20.005+0000 7fdd0a59c640 1 --2- 172.21.15.78:0/1195565248 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fdcec066470 0x7fdcec068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:20.009 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:20.005+0000 7fdd0a59c640 1 --2- 172.21.15.78:0/1195565248 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fdcec066470 0x7fdcec068930 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7fdcfc009a40 tx=0x7fdcfc009190 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:01:20.012 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:20.009+0000 7fdcfaffd640 1 -- 172.21.15.78:0/1195565248 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fdd000514e0 con 0x7fdd0c0c45a0 2023-11-28T20:01:20.161 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:20.157+0000 7fdd0b59e640 1 -- 172.21.15.78:0/1195565248 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fdd0c06d260 con 0x7fdd0c0c45a0 2023-11-28T20:01:20.162 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:20.157+0000 7fdcfaffd640 1 -- 172.21.15.78:0/1195565248 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v61) v1 ==== 100+0+11 (secure 0 0 0) 0x7fdd00054b00 con 0x7fdd0c0c45a0 2023-11-28T20:01:20.162 INFO:teuthology.orchestra.run.smithi078.stdout:pg_num: 64 2023-11-28T20:01:20.163 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:20.157+0000 7fdd0b59e640 1 -- 172.21.15.78:0/1195565248 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fdcec066470 msgr2=0x7fdcec068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:01:20.164 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:20.157+0000 7fdd0b59e640 1 --2- 172.21.15.78:0/1195565248 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fdcec066470 0x7fdcec068930 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7fdcfc009a40 tx=0x7fdcfc009190 comp rx=0 tx=0).stop 2023-11-28T20:01:20.164 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:20.161+0000 7fdd0b59e640 1 -- 172.21.15.78:0/1195565248 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdd0c0c45a0 msgr2=0x7fdd0c14a9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:01:20.164 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:20.161+0000 7fdd0b59e640 1 --2- 172.21.15.78:0/1195565248 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdd0c0c45a0 0x7fdd0c14a9f0 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7fdd0000e8c0 tx=0x7fdd0000ed80 comp rx=0 tx=0).stop 2023-11-28T20:01:20.164 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:20.161+0000 7fdd0b59e640 1 -- 172.21.15.78:0/1195565248 shutdown_connections 2023-11-28T20:01:20.164 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:20.161+0000 7fdd0b59e640 1 --2- 172.21.15.78:0/1195565248 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fdcec066470 0x7fdcec068930 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:20.164 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:20.161+0000 7fdd0b59e640 1 --2- 172.21.15.78:0/1195565248 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdd0c0ca330 0x7fdd0c14af30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:20.164 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:20.161+0000 7fdd0b59e640 1 --2- 172.21.15.78:0/1195565248 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdd0c0c45a0 0x7fdd0c14a9f0 unknown :-1 s=CLOSED pgs=668 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:20.164 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:20.161+0000 7fdd0b59e640 1 --2- 172.21.15.78:0/1195565248 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdd0c06c480 0x7fdd0c156830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:20.164 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:20.161+0000 7fdd0b59e640 1 -- 172.21.15.78:0/1195565248 >> 172.21.15.78:0/1195565248 conn(0x7fdd0c0abdb0 msgr2=0x7fdd0c1505b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:01:20.164 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:20.161+0000 7fdd0b59e640 1 -- 172.21.15.78:0/1195565248 shutdown_connections 2023-11-28T20:01:20.165 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:20.161+0000 7fdd0b59e640 1 -- 172.21.15.78:0/1195565248 wait complete. 2023-11-28T20:01:20.183 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-11-28T20:01:20.319 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:20.313+0000 7fa91cc09640 1 Processor -- start 2023-11-28T20:01:20.320 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:20.313+0000 7fa91cc09640 1 -- start start 2023-11-28T20:01:20.322 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:20.317+0000 7fa91cc09640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fa91814fd10 0x7fa9180a4dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:20.322 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:20.317+0000 7fa91cc09640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa9180c5710 con 0x7fa9180a5300 2023-11-28T20:01:20.322 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:20.317+0000 7fa91cc09640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa918155c80 con 0x7fa918156110 2023-11-28T20:01:20.323 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:20.317+0000 7fa91cc09640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa91806c5e0 con 0x7fa91814fd10 2023-11-28T20:01:20.323 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:20.317+0000 7fa915d9b640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7fa9180a5300 0x7fa918071e30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:47416/0 (socket says 172.21.15.78:47416) 2023-11-28T20:01:20.323 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:20.317+0000 7fa915d9b640 1 -- 172.21.15.78:0/326215522 learned_addr learned my addr 172.21.15.78:0/326215522 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-11-28T20:01:20.323 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:20.317+0000 7fa91659c640 1 --2- 172.21.15.78:0/326215522 >> v2:172.21.15.179:3300/0 conn(0x7fa91814fd10 0x7fa9180a4dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:20.323 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:20.317+0000 7fa91559a640 1 -- 172.21.15.78:0/326215522 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3286850200 0 0) 0x7fa9180c5710 con 0x7fa9180a5300 2023-11-28T20:01:20.323 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:20.317+0000 7fa91559a640 1 -- 172.21.15.78:0/326215522 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa900003530 con 0x7fa9180a5300 2023-11-28T20:01:20.323 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:20.317+0000 7fa91659c640 1 -- 172.21.15.78:0/326215522 >> v1:172.21.15.179:6789/0 conn(0x7fa918156110 legacy=0x7fa91815ce50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:01:20.323 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:20.317+0000 7fa91559a640 1 -- 172.21.15.78:0/326215522 <== mon.0 v1:172.21.15.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2075856849 0 0) 0x7fa900003530 con 0x7fa9180a5300 2023-11-28T20:01:20.323 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:20.317+0000 7fa91659c640 1 -- 172.21.15.78:0/326215522 >> v1:172.21.15.78:6789/0 conn(0x7fa9180a5300 legacy=0x7fa918071e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:01:20.323 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:20.317+0000 7fa91659c640 1 -- 172.21.15.78:0/326215522 --> v2:172.21.15.179:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9180c4e70 con 0x7fa91814fd10 2023-11-28T20:01:20.324 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:20.321+0000 7fa91659c640 1 --2- 172.21.15.78:0/326215522 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa91814fd10 0x7fa9180a4dc0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fa9080097c0 tx=0x7fa90801c250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=de89c0cad17d1070 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:01:20.325 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:20.321+0000 7fa91559a640 1 -- 172.21.15.78:0/326215522 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa90c001680 con 0x7fa91814fd10 2023-11-28T20:01:20.325 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:20.321+0000 7fa91559a640 1 -- 172.21.15.78:0/326215522 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa9080a7050 con 0x7fa91814fd10 2023-11-28T20:01:20.325 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:20.321+0000 7fa91559a640 1 -- 172.21.15.78:0/326215522 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9080ab620 con 0x7fa91814fd10 2023-11-28T20:01:20.326 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:20.321+0000 7fa91cc09640 1 -- 172.21.15.78:0/326215522 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa91814fd10 msgr2=0x7fa9180a4dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:01:20.326 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:20.321+0000 7fa91cc09640 1 --2- 172.21.15.78:0/326215522 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa91814fd10 0x7fa9180a4dc0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fa9080097c0 tx=0x7fa90801c250 comp rx=0 tx=0).stop 2023-11-28T20:01:20.326 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:20.321+0000 7fa91cc09640 1 -- 172.21.15.78:0/326215522 shutdown_connections 2023-11-28T20:01:20.326 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:20.321+0000 7fa91cc09640 1 --2- 172.21.15.78:0/326215522 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa91814fd10 0x7fa9180a4dc0 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:20.326 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:20.321+0000 7fa91cc09640 1 -- 172.21.15.78:0/326215522 >> 172.21.15.78:0/326215522 conn(0x7fa9180a7810 msgr2=0x7fa9180a7c20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:01:20.326 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:20.321+0000 7fa91cc09640 1 -- 172.21.15.78:0/326215522 shutdown_connections 2023-11-28T20:01:20.326 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:20.321+0000 7fa91cc09640 1 -- 172.21.15.78:0/326215522 wait complete. 2023-11-28T20:01:20.327 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:20.325+0000 7fa91cc09640 1 Processor -- start 2023-11-28T20:01:20.328 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:20.325+0000 7fa91cc09640 1 -- start start 2023-11-28T20:01:20.330 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:20.325+0000 7fa91cc09640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa9180a5300 0x7fa918143ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:20.330 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:20.325+0000 7fa91cc09640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa91814fd10 0x7fa918070ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:20.330 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:20.325+0000 7fa91cc09640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa918156110 0x7fa9180aaf60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:20.330 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:20.325+0000 7fa91cc09640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa918144410 con 0x7fa9180a5300 2023-11-28T20:01:20.330 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:20.325+0000 7fa91cc09640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa918071fb0 con 0x7fa918156110 2023-11-28T20:01:20.331 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:20.325+0000 7fa91cc09640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa9180a9180 con 0x7fa91814fd10 2023-11-28T20:01:20.331 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:20.325+0000 7fa91659c640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa9180a5300 0x7fa918143ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:20.331 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:20.325+0000 7fa91659c640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa9180a5300 0x7fa918143ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:40120/0 (socket says 172.21.15.78:40120) 2023-11-28T20:01:20.331 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:20.325+0000 7fa91659c640 1 -- 172.21.15.78:0/203195572 learned_addr learned my addr 172.21.15.78:0/203195572 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T20:01:20.331 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:20.325+0000 7fa915d9b640 1 --2- 172.21.15.78:0/203195572 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa91814fd10 0x7fa918070ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:20.331 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:20.325+0000 7fa916d9d640 1 --2- 172.21.15.78:0/203195572 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa918156110 0x7fa9180aaf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:20.331 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:20.325+0000 7fa91659c640 1 -- 172.21.15.78:0/203195572 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa91814fd10 msgr2=0x7fa918070ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:01:20.331 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:20.325+0000 7fa91659c640 1 --2- 172.21.15.78:0/203195572 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa91814fd10 0x7fa918070ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:20.331 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:20.325+0000 7fa91659c640 1 -- 172.21.15.78:0/203195572 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa918156110 msgr2=0x7fa9180aaf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:01:20.331 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:20.325+0000 7fa91659c640 1 --2- 172.21.15.78:0/203195572 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa918156110 0x7fa9180aaf60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:20.331 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:20.325+0000 7fa91659c640 1 -- 172.21.15.78:0/203195572 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa908009420 con 0x7fa9180a5300 2023-11-28T20:01:20.331 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:20.325+0000 7fa91659c640 1 --2- 172.21.15.78:0/203195572 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa9180a5300 0x7fa918143ed0 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7fa9080097c0 tx=0x7fa908018ff0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:01:20.332 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:20.325+0000 7fa906ffd640 1 -- 172.21.15.78:0/203195572 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa908004030 con 0x7fa9180a5300 2023-11-28T20:01:20.332 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:20.325+0000 7fa906ffd640 1 -- 172.21.15.78:0/203195572 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa908004190 con 0x7fa9180a5300 2023-11-28T20:01:20.332 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:20.325+0000 7fa906ffd640 1 -- 172.21.15.78:0/203195572 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa908004500 con 0x7fa9180a5300 2023-11-28T20:01:20.332 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:20.325+0000 7fa91cc09640 1 -- 172.21.15.78:0/203195572 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa9180a93d0 con 0x7fa9180a5300 2023-11-28T20:01:20.332 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:20.325+0000 7fa91cc09640 1 -- 172.21.15.78:0/203195572 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa918071a50 con 0x7fa9180a5300 2023-11-28T20:01:20.333 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:20.325+0000 7fa91cc09640 1 -- 172.21.15.78:0/203195572 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa918067630 con 0x7fa9180a5300 2023-11-28T20:01:20.333 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:20.329+0000 7fa906ffd640 1 -- 172.21.15.78:0/203195572 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fa9080b2040 con 0x7fa9180a5300 2023-11-28T20:01:20.333 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:20.329+0000 7fa906ffd640 1 --2- 172.21.15.78:0/203195572 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fa8f80664a0 0x7fa8f8068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:20.333 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:20.329+0000 7fa906ffd640 1 -- 172.21.15.78:0/203195572 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 6029+0+0 (secure 0 0 0) 0x7fa90811dc00 con 0x7fa9180a5300 2023-11-28T20:01:20.333 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:20.329+0000 7fa915d9b640 1 --2- 172.21.15.78:0/203195572 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fa8f80664a0 0x7fa8f8068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:20.334 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:20.329+0000 7fa915d9b640 1 --2- 172.21.15.78:0/203195572 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fa8f80664a0 0x7fa8f8068960 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7fa90c0014b0 tx=0x7fa90c009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:01:20.337 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:20.333+0000 7fa906ffd640 1 -- 172.21.15.78:0/203195572 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fa908124080 con 0x7fa9180a5300 2023-11-28T20:01:20.486 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:20.481+0000 7fa91cc09640 1 -- 172.21.15.78:0/203195572 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7fa918070900 con 0x7fa9180a5300 2023-11-28T20:01:20.487 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:20.481+0000 7fa906ffd640 1 -- 172.21.15.78:0/203195572 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v61) v1 ==== 84+0+208 (secure 0 0 0) 0x7fa9080eafd0 con 0x7fa9180a5300 2023-11-28T20:01:20.487 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-11-28T20:01:20.487 INFO:teuthology.orchestra.run.smithi078.stdout:[ 2023-11-28T20:01:20.487 INFO:teuthology.orchestra.run.smithi078.stdout: { 2023-11-28T20:01:20.488 INFO:teuthology.orchestra.run.smithi078.stdout: "poolnum": 1, 2023-11-28T20:01:20.488 INFO:teuthology.orchestra.run.smithi078.stdout: "poolname": ".mgr" 2023-11-28T20:01:20.488 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2023-11-28T20:01:20.488 INFO:teuthology.orchestra.run.smithi078.stdout: { 2023-11-28T20:01:20.488 INFO:teuthology.orchestra.run.smithi078.stdout: "poolnum": 9, 2023-11-28T20:01:20.488 INFO:teuthology.orchestra.run.smithi078.stdout: "poolname": "cephfs_metadata" 2023-11-28T20:01:20.488 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2023-11-28T20:01:20.488 INFO:teuthology.orchestra.run.smithi078.stdout: { 2023-11-28T20:01:20.488 INFO:teuthology.orchestra.run.smithi078.stdout: "poolnum": 10, 2023-11-28T20:01:20.488 INFO:teuthology.orchestra.run.smithi078.stdout: "poolname": "cephfs_data" 2023-11-28T20:01:20.488 INFO:teuthology.orchestra.run.smithi078.stdout: } 2023-11-28T20:01:20.488 INFO:teuthology.orchestra.run.smithi078.stdout:] 2023-11-28T20:01:20.489 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:20.485+0000 7fa91cc09640 1 -- 172.21.15.78:0/203195572 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fa8f80664a0 msgr2=0x7fa8f8068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:01:20.489 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:20.485+0000 7fa91cc09640 1 --2- 172.21.15.78:0/203195572 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fa8f80664a0 0x7fa8f8068960 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7fa90c0014b0 tx=0x7fa90c009040 comp rx=0 tx=0).stop 2023-11-28T20:01:20.489 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:20.485+0000 7fa91cc09640 1 -- 172.21.15.78:0/203195572 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa9180a5300 msgr2=0x7fa918143ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:01:20.489 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:20.485+0000 7fa91cc09640 1 --2- 172.21.15.78:0/203195572 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa9180a5300 0x7fa918143ed0 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7fa9080097c0 tx=0x7fa908018ff0 comp rx=0 tx=0).stop 2023-11-28T20:01:20.490 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:20.485+0000 7fa91cc09640 1 -- 172.21.15.78:0/203195572 shutdown_connections 2023-11-28T20:01:20.490 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:20.485+0000 7fa91cc09640 1 --2- 172.21.15.78:0/203195572 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fa8f80664a0 0x7fa8f8068960 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:20.490 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:20.485+0000 7fa91cc09640 1 --2- 172.21.15.78:0/203195572 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa91814fd10 0x7fa918070ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:20.490 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:20.485+0000 7fa91cc09640 1 --2- 172.21.15.78:0/203195572 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa918156110 0x7fa9180aaf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:20.490 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:20.485+0000 7fa91cc09640 1 --2- 172.21.15.78:0/203195572 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa9180a5300 0x7fa918143ed0 unknown :-1 s=CLOSED pgs=670 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:20.490 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:20.485+0000 7fa91cc09640 1 -- 172.21.15.78:0/203195572 >> 172.21.15.78:0/203195572 conn(0x7fa9180a7810 msgr2=0x7fa9181537a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:01:20.490 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:20.485+0000 7fa91cc09640 1 -- 172.21.15.78:0/203195572 shutdown_connections 2023-11-28T20:01:20.490 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:20.485+0000 7fa91cc09640 1 -- 172.21.15.78:0/203195572 wait complete. 2023-11-28T20:01:20.508 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs2' 2023-11-28T20:01:20.508 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs2_metadata --pg_num_min 64 2023-11-28T20:01:20.653 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:20.645+0000 7fc9cff57640 1 Processor -- start 2023-11-28T20:01:20.653 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:20.645+0000 7fc9cff57640 1 -- start start 2023-11-28T20:01:20.654 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:20.649+0000 7fc9cff57640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fc9c8156200 0x7fc9c80c0370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:20.654 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:20.649+0000 7fc9cff57640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fc9c80c0e10 0x7fc9c80c1b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:20.654 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:20.649+0000 7fc9cff57640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc9c815bf70 0x7fc9c815c3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:20.654 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:20.649+0000 7fc9cff57640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc9c806d8d0 con 0x7fc9c80c0e10 2023-11-28T20:01:20.654 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:20.649+0000 7fc9cff57640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc9c806bce0 con 0x7fc9c8156200 2023-11-28T20:01:20.654 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:20.649+0000 7fc9cff57640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9c815cc60 con 0x7fc9c815bf70 2023-11-28T20:01:20.654 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:20.649+0000 7fc9cd4f2640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fc9c80c0e10 0x7fc9c80c1b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:20.655 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:20.649+0000 7fc9cd4f2640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fc9c80c0e10 0x7fc9c80c1b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:40132/0 (socket says 172.21.15.78:40132) 2023-11-28T20:01:20.655 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:20.649+0000 7fc9cd4f2640 1 -- 172.21.15.78:0/2598909565 learned_addr learned my addr 172.21.15.78:0/2598909565 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T20:01:20.655 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:20.649+0000 7fc9cd4f2640 1 -- 172.21.15.78:0/2598909565 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc9c815bf70 msgr2=0x7fc9c815c3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:01:20.655 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:20.649+0000 7fc9cd4f2640 1 --2- 172.21.15.78:0/2598909565 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc9c815bf70 0x7fc9c815c3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:20.655 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:20.649+0000 7fc9cd4f2640 1 -- 172.21.15.78:0/2598909565 >> v2:172.21.15.179:3300/0 conn(0x7fc9c8156200 msgr2=0x7fc9c80c0370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:01:20.655 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:20.649+0000 7fc9cd4f2640 1 --2- 172.21.15.78:0/2598909565 >> v2:172.21.15.179:3300/0 conn(0x7fc9c8156200 0x7fc9c80c0370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:20.655 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:20.649+0000 7fc9cd4f2640 1 -- 172.21.15.78:0/2598909565 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9c806bf30 con 0x7fc9c80c0e10 2023-11-28T20:01:20.657 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:20.653+0000 7fc9cd4f2640 1 --2- 172.21.15.78:0/2598909565 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc9c80c0e10 0x7fc9c80c1b60 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7fc9c80c66a0 tx=0x7fc9b801c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2930fcc4f9828d7f server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:01:20.658 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:20.653+0000 7fc9cccf1640 1 -- 172.21.15.78:0/2598909565 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9b80ab600 con 0x7fc9c80c0e10 2023-11-28T20:01:20.658 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:20.653+0000 7fc9cccf1640 1 -- 172.21.15.78:0/2598909565 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc9b80a7050 con 0x7fc9c80c0e10 2023-11-28T20:01:20.658 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:20.653+0000 7fc9cccf1640 1 -- 172.21.15.78:0/2598909565 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9b80ab980 con 0x7fc9c80c0e10 2023-11-28T20:01:20.658 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:20.653+0000 7fc9cff57640 1 -- 172.21.15.78:0/2598909565 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc9c80c0e10 msgr2=0x7fc9c80c1b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:01:20.659 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:20.653+0000 7fc9cff57640 1 --2- 172.21.15.78:0/2598909565 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc9c80c0e10 0x7fc9c80c1b60 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7fc9c80c66a0 tx=0x7fc9b801c3a0 comp rx=0 tx=0).stop 2023-11-28T20:01:20.659 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:20.653+0000 7fc9cff57640 1 -- 172.21.15.78:0/2598909565 shutdown_connections 2023-11-28T20:01:20.659 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:20.653+0000 7fc9cff57640 1 --2- 172.21.15.78:0/2598909565 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc9c815bf70 0x7fc9c815c3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:20.659 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:20.653+0000 7fc9cff57640 1 --2- 172.21.15.78:0/2598909565 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc9c80c0e10 0x7fc9c80c1b60 unknown :-1 s=CLOSED pgs=671 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:20.661 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:20.653+0000 7fc9cff57640 1 --2- 172.21.15.78:0/2598909565 >> v2:172.21.15.179:3300/0 conn(0x7fc9c8156200 0x7fc9c80c0370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:20.661 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:20.653+0000 7fc9cff57640 1 -- 172.21.15.78:0/2598909565 >> 172.21.15.78:0/2598909565 conn(0x7fc9c80c59f0 msgr2=0x7fc9c80c5e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:01:20.661 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:20.653+0000 7fc9cff57640 1 -- 172.21.15.78:0/2598909565 shutdown_connections 2023-11-28T20:01:20.661 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:20.653+0000 7fc9cff57640 1 -- 172.21.15.78:0/2598909565 wait complete. 2023-11-28T20:01:20.664 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:20.653+0000 7fc9cff57640 1 Processor -- start 2023-11-28T20:01:20.664 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:20.653+0000 7fc9cff57640 1 -- start start 2023-11-28T20:01:20.665 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:20.653+0000 7fc9cff57640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc9c80c0e10 0x7fc9c814b810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:20.665 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:20.653+0000 7fc9cff57640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc9c8156200 0x7fc9c814bd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:20.665 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:20.653+0000 7fc9cff57640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc9c815bf70 0x7fc9c8151380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:20.665 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:20.653+0000 7fc9cff57640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9c80ab680 con 0x7fc9c815bf70 2023-11-28T20:01:20.665 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:20.653+0000 7fc9cff57640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9c80bfe60 con 0x7fc9c8156200 2023-11-28T20:01:20.665 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:20.653+0000 7fc9cff57640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9c814c290 con 0x7fc9c80c0e10 2023-11-28T20:01:20.665 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:20.657+0000 7fc9ce4f4640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc9c815bf70 0x7fc9c8151380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:20.665 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:20.657+0000 7fc9ce4f4640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc9c815bf70 0x7fc9c8151380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:40142/0 (socket says 172.21.15.78:40142) 2023-11-28T20:01:20.665 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:20.657+0000 7fc9ce4f4640 1 -- 172.21.15.78:0/1897299267 learned_addr learned my addr 172.21.15.78:0/1897299267 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T20:01:20.666 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:20.657+0000 7fc9cd4f2640 1 --2- 172.21.15.78:0/1897299267 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc9c8156200 0x7fc9c814bd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:20.666 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:20.657+0000 7fc9cdcf3640 1 --2- 172.21.15.78:0/1897299267 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc9c80c0e10 0x7fc9c814b810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:20.666 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:20.657+0000 7fc9ce4f4640 1 -- 172.21.15.78:0/1897299267 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc9c80c0e10 msgr2=0x7fc9c814b810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:01:20.666 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:20.657+0000 7fc9ce4f4640 1 --2- 172.21.15.78:0/1897299267 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc9c80c0e10 0x7fc9c814b810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:20.666 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:20.657+0000 7fc9ce4f4640 1 -- 172.21.15.78:0/1897299267 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc9c8156200 msgr2=0x7fc9c814bd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:01:20.666 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:20.657+0000 7fc9ce4f4640 1 --2- 172.21.15.78:0/1897299267 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc9c8156200 0x7fc9c814bd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:20.666 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:20.657+0000 7fc9ce4f4640 1 -- 172.21.15.78:0/1897299267 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9b80094d0 con 0x7fc9c815bf70 2023-11-28T20:01:20.667 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:20.657+0000 7fc9ce4f4640 1 --2- 172.21.15.78:0/1897299267 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc9c815bf70 0x7fc9c8151380 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7fc9c000b9a0 tx=0x7fc9c000be60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:01:20.667 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:20.657+0000 7fc9be7fc640 1 -- 172.21.15.78:0/1897299267 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9c000cba0 con 0x7fc9c815bf70 2023-11-28T20:01:20.667 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:20.657+0000 7fc9be7fc640 1 -- 172.21.15.78:0/1897299267 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc9c000cd20 con 0x7fc9c815bf70 2023-11-28T20:01:20.667 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:20.657+0000 7fc9be7fc640 1 -- 172.21.15.78:0/1897299267 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9c0014680 con 0x7fc9c815bf70 2023-11-28T20:01:20.667 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:20.657+0000 7fc9cff57640 1 -- 172.21.15.78:0/1897299267 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc9c80aace0 con 0x7fc9c815bf70 2023-11-28T20:01:20.667 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:20.657+0000 7fc9cff57640 1 -- 172.21.15.78:0/1897299267 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc9c81f1cb0 con 0x7fc9c815bf70 2023-11-28T20:01:20.667 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:20.657+0000 7fc9cff57640 1 -- 172.21.15.78:0/1897299267 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc9c80c2060 con 0x7fc9c815bf70 2023-11-28T20:01:20.667 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:20.657+0000 7fc9be7fc640 1 -- 172.21.15.78:0/1897299267 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fc9c001d3b0 con 0x7fc9c815bf70 2023-11-28T20:01:20.667 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:20.657+0000 7fc9be7fc640 1 --2- 172.21.15.78:0/1897299267 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fc9ac0664a0 0x7fc9ac068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:20.667 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:20.657+0000 7fc9be7fc640 1 -- 172.21.15.78:0/1897299267 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 6029+0+0 (secure 0 0 0) 0x7fc9c0083e40 con 0x7fc9c815bf70 2023-11-28T20:01:20.667 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:20.657+0000 7fc9cdcf3640 1 --2- 172.21.15.78:0/1897299267 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fc9ac0664a0 0x7fc9ac068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:20.668 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:20.661+0000 7fc9cdcf3640 1 --2- 172.21.15.78:0/1897299267 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fc9ac0664a0 0x7fc9ac068960 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7fc9c80c4d40 tx=0x7fc9c4009110 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:01:20.668 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:20.661+0000 7fc9be7fc640 1 -- 172.21.15.78:0/1897299267 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fc9c0051220 con 0x7fc9c815bf70 2023-11-28T20:01:20.820 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:20.817+0000 7fc9cff57640 1 -- 172.21.15.78:0/1897299267 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs2_metadata", "pg_num_min": 64} v 0) v1 -- 0x7fc9c8067630 con 0x7fc9c815bf70 2023-11-28T20:01:21.787 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:21.781+0000 7fc9be7fc640 1 -- 172.21.15.78:0/1897299267 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs2_metadata", "pg_num_min": 64}]=0 pool 'cephfs2_metadata' created v62) v1 ==== 140+0+0 (secure 0 0 0) 0x7fc9c00190b0 con 0x7fc9c815bf70 2023-11-28T20:01:21.787 INFO:teuthology.orchestra.run.smithi078.stderr:pool 'cephfs2_metadata' created 2023-11-28T20:01:21.789 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:21.785+0000 7fc9cff57640 1 -- 172.21.15.78:0/1897299267 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fc9ac0664a0 msgr2=0x7fc9ac068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:01:21.789 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:21.785+0000 7fc9cff57640 1 --2- 172.21.15.78:0/1897299267 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fc9ac0664a0 0x7fc9ac068960 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7fc9c80c4d40 tx=0x7fc9c4009110 comp rx=0 tx=0).stop 2023-11-28T20:01:21.789 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:21.785+0000 7fc9cff57640 1 -- 172.21.15.78:0/1897299267 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc9c815bf70 msgr2=0x7fc9c8151380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:01:21.790 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:21.785+0000 7fc9cff57640 1 --2- 172.21.15.78:0/1897299267 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc9c815bf70 0x7fc9c8151380 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7fc9c000b9a0 tx=0x7fc9c000be60 comp rx=0 tx=0).stop 2023-11-28T20:01:21.790 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:21.785+0000 7fc9cff57640 1 -- 172.21.15.78:0/1897299267 shutdown_connections 2023-11-28T20:01:21.790 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:21.785+0000 7fc9cff57640 1 --2- 172.21.15.78:0/1897299267 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fc9ac0664a0 0x7fc9ac068960 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:21.790 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:21.785+0000 7fc9cff57640 1 --2- 172.21.15.78:0/1897299267 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc9c815bf70 0x7fc9c8151380 unknown :-1 s=CLOSED pgs=672 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:21.790 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:21.785+0000 7fc9cff57640 1 --2- 172.21.15.78:0/1897299267 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc9c8156200 0x7fc9c814bd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:21.791 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:21.785+0000 7fc9cff57640 1 --2- 172.21.15.78:0/1897299267 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc9c80c0e10 0x7fc9c814b810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:21.791 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:21.785+0000 7fc9cff57640 1 -- 172.21.15.78:0/1897299267 >> 172.21.15.78:0/1897299267 conn(0x7fc9c80c59f0 msgr2=0x7fc9c80c5dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:01:21.791 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:21.785+0000 7fc9cff57640 1 -- 172.21.15.78:0/1897299267 shutdown_connections 2023-11-28T20:01:21.791 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:21.785+0000 7fc9cff57640 1 -- 172.21.15.78:0/1897299267 wait complete. 2023-11-28T20:01:21.819 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs2_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-11-28T20:01:21.966 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:21.961+0000 7fb47ad2a640 1 Processor -- start 2023-11-28T20:01:21.966 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:21.961+0000 7fb47ad2a640 1 -- start start 2023-11-28T20:01:21.967 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:21.961+0000 7fb47ad2a640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fb47414f850 0x7fb4740aacf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:21.967 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:21.961+0000 7fb47ad2a640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fb47406d840 0x7fb4740c43e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:21.967 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:21.961+0000 7fb47ad2a640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb474152910 con 0x7fb47414fc30 2023-11-28T20:01:21.968 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:21.961+0000 7fb47ad2a640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb4740c2240 con 0x7fb47406d840 2023-11-28T20:01:21.968 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:21.961+0000 7fb47ad2a640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb474152bf0 con 0x7fb47414f850 2023-11-28T20:01:21.968 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:21.965+0000 7fb4792c7640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fb47406d840 0x7fb4740c43e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:21.968 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:21.965+0000 7fb46bfff640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7fb47414fc30 0x7fb4740c3cd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:47426/0 (socket says 172.21.15.78:47426) 2023-11-28T20:01:21.968 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:21.965+0000 7fb46bfff640 1 -- 172.21.15.78:0/2481782928 learned_addr learned my addr 172.21.15.78:0/2481782928 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-11-28T20:01:21.968 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:21.965+0000 7fb478ac6640 1 --2- 172.21.15.78:0/2481782928 >> v2:172.21.15.179:3300/0 conn(0x7fb47414f850 0x7fb4740aacf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:21.968 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:21.965+0000 7fb4792c7640 1 -- 172.21.15.78:0/2481782928 >> v2:172.21.15.179:3300/0 conn(0x7fb47414f850 msgr2=0x7fb4740aacf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:01:21.969 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:21.965+0000 7fb4792c7640 1 --2- 172.21.15.78:0/2481782928 >> v2:172.21.15.179:3300/0 conn(0x7fb47414f850 0x7fb4740aacf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:21.969 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:21.965+0000 7fb4792c7640 1 -- 172.21.15.78:0/2481782928 >> v1:172.21.15.78:6789/0 conn(0x7fb47414fc30 legacy=0x7fb4740c3cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:01:21.969 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:21.965+0000 7fb4792c7640 1 -- 172.21.15.78:0/2481782928 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb474152ed0 con 0x7fb47406d840 2023-11-28T20:01:21.970 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:21.965+0000 7fb4792c7640 1 --2- 172.21.15.78:0/2481782928 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb47406d840 0x7fb4740c43e0 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7fb474066f50 tx=0x7fb46c01c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cea2dbb11182789c server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:01:21.971 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:21.965+0000 7fb46b7fe640 1 -- 172.21.15.78:0/2481782928 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb46c0a59f0 con 0x7fb47406d840 2023-11-28T20:01:21.971 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:21.965+0000 7fb46b7fe640 1 -- 172.21.15.78:0/2481782928 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb46c0a5b50 con 0x7fb47406d840 2023-11-28T20:01:21.971 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:21.965+0000 7fb46b7fe640 1 -- 172.21.15.78:0/2481782928 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb46c0ad440 con 0x7fb47406d840 2023-11-28T20:01:21.972 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:21.969+0000 7fb47ad2a640 1 -- 172.21.15.78:0/2481782928 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb47406d840 msgr2=0x7fb4740c43e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:01:21.972 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:21.969+0000 7fb47ad2a640 1 --2- 172.21.15.78:0/2481782928 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb47406d840 0x7fb4740c43e0 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7fb474066f50 tx=0x7fb46c01c910 comp rx=0 tx=0).stop 2023-11-28T20:01:21.972 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:21.969+0000 7fb47ad2a640 1 -- 172.21.15.78:0/2481782928 shutdown_connections 2023-11-28T20:01:21.972 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:21.969+0000 7fb47ad2a640 1 --2- 172.21.15.78:0/2481782928 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb47406d840 0x7fb4740c43e0 unknown :-1 s=CLOSED pgs=674 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:21.972 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:21.969+0000 7fb47ad2a640 1 --2- 172.21.15.78:0/2481782928 >> v2:172.21.15.179:3300/0 conn(0x7fb47414f850 0x7fb4740aacf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:21.972 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:21.969+0000 7fb47ad2a640 1 -- 172.21.15.78:0/2481782928 >> 172.21.15.78:0/2481782928 conn(0x7fb4740c59f0 msgr2=0x7fb4740c5e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:01:21.973 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:21.969+0000 7fb47ad2a640 1 -- 172.21.15.78:0/2481782928 shutdown_connections 2023-11-28T20:01:21.973 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:21.969+0000 7fb47ad2a640 1 -- 172.21.15.78:0/2481782928 wait complete. 2023-11-28T20:01:21.973 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:21.969+0000 7fb47ad2a640 1 Processor -- start 2023-11-28T20:01:21.973 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:21.969+0000 7fb47ad2a640 1 -- start start 2023-11-28T20:01:21.975 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:21.969+0000 7fb47ad2a640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb47406d840 0x7fb47414ba20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:21.975 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:21.969+0000 7fb47ad2a640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb47414f850 0x7fb4741f1230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:21.975 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:21.969+0000 7fb47ad2a640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb47414fc30 0x7fb4740a6760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:21.975 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:21.969+0000 7fb47ad2a640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb47414e060 con 0x7fb47414fc30 2023-11-28T20:01:21.975 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:21.969+0000 7fb47ad2a640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4741f1770 con 0x7fb47414f850 2023-11-28T20:01:21.975 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:21.969+0000 7fb47ad2a640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb4740a9030 con 0x7fb47406d840 2023-11-28T20:01:21.975 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:21.969+0000 7fb4792c7640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb47414fc30 0x7fb4740a6760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:21.975 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:21.969+0000 7fb4792c7640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb47414fc30 0x7fb4740a6760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:40160/0 (socket says 172.21.15.78:40160) 2023-11-28T20:01:21.975 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:21.969+0000 7fb4792c7640 1 -- 172.21.15.78:0/850276860 learned_addr learned my addr 172.21.15.78:0/850276860 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T20:01:21.976 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:21.969+0000 7fb478ac6640 1 --2- 172.21.15.78:0/850276860 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb47406d840 0x7fb47414ba20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:21.976 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:21.969+0000 7fb46bfff640 1 --2- 172.21.15.78:0/850276860 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb47414f850 0x7fb4741f1230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:21.977 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:21.969+0000 7fb4792c7640 1 -- 172.21.15.78:0/850276860 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb47406d840 msgr2=0x7fb47414ba20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:01:21.977 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:21.969+0000 7fb4792c7640 1 --2- 172.21.15.78:0/850276860 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb47406d840 0x7fb47414ba20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:21.977 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:21.969+0000 7fb4792c7640 1 -- 172.21.15.78:0/850276860 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb47414f850 msgr2=0x7fb4741f1230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:01:21.977 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:21.969+0000 7fb4792c7640 1 --2- 172.21.15.78:0/850276860 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb47414f850 0x7fb4741f1230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:21.977 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:21.969+0000 7fb4792c7640 1 -- 172.21.15.78:0/850276860 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb46c009a70 con 0x7fb47414fc30 2023-11-28T20:01:21.977 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:21.969+0000 7fb46bfff640 1 --2- 172.21.15.78:0/850276860 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb47414f850 0x7fb4741f1230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T20:01:21.977 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:21.973+0000 7fb4792c7640 1 --2- 172.21.15.78:0/850276860 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb47414fc30 0x7fb4740a6760 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7fb46c019520 tx=0x7fb46c0196b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:01:21.977 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:21.973+0000 7fb4697fa640 1 -- 172.21.15.78:0/850276860 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb46c0add70 con 0x7fb47414fc30 2023-11-28T20:01:21.978 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:21.973+0000 7fb4697fa640 1 -- 172.21.15.78:0/850276860 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb46c009450 con 0x7fb47414fc30 2023-11-28T20:01:21.978 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:21.973+0000 7fb4697fa640 1 -- 172.21.15.78:0/850276860 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb46c0b9690 con 0x7fb47414fc30 2023-11-28T20:01:21.978 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:21.973+0000 7fb47ad2a640 1 -- 172.21.15.78:0/850276860 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb4740a9310 con 0x7fb47414fc30 2023-11-28T20:01:21.978 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:21.973+0000 7fb47ad2a640 1 -- 172.21.15.78:0/850276860 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb4740a98d0 con 0x7fb47414fc30 2023-11-28T20:01:21.978 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:21.973+0000 7fb47ad2a640 1 -- 172.21.15.78:0/850276860 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb474067630 con 0x7fb47414fc30 2023-11-28T20:01:21.978 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:21.973+0000 7fb4697fa640 1 -- 172.21.15.78:0/850276860 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fb46c0b97f0 con 0x7fb47414fc30 2023-11-28T20:01:21.979 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:21.973+0000 7fb4697fa640 1 --2- 172.21.15.78:0/850276860 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fb4600664a0 0x7fb460068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:21.979 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:21.977+0000 7fb4697fa640 1 -- 172.21.15.78:0/850276860 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(62..62 src has 1..62) v4 ==== 6400+0+0 (secure 0 0 0) 0x7fb46c11fb20 con 0x7fb47414fc30 2023-11-28T20:01:21.979 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:21.977+0000 7fb478ac6640 1 --2- 172.21.15.78:0/850276860 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fb4600664a0 0x7fb460068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:21.980 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:21.977+0000 7fb478ac6640 1 --2- 172.21.15.78:0/850276860 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fb4600664a0 0x7fb460068960 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7fb470009b60 tx=0x7fb470009190 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:01:21.983 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:21.977+0000 7fb4697fa640 1 -- 172.21.15.78:0/850276860 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fb46c0ecd80 con 0x7fb47414fc30 2023-11-28T20:01:22.133 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:22.129+0000 7fb47ad2a640 1 -- 172.21.15.78:0/850276860 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs2_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7fb4740a4a90 con 0x7fb47414fc30 2023-11-28T20:01:22.794 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:22.789+0000 7fb4697fa640 1 -- 172.21.15.78:0/850276860 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs2_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs2_data' created v63) v1 ==== 172+0+0 (secure 0 0 0) 0x7fb46c0f03a0 con 0x7fb47414fc30 2023-11-28T20:01:22.794 INFO:teuthology.orchestra.run.smithi078.stderr:pool 'cephfs2_data' created 2023-11-28T20:01:22.796 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:22.793+0000 7fb47ad2a640 1 -- 172.21.15.78:0/850276860 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fb4600664a0 msgr2=0x7fb460068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:01:22.796 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:22.793+0000 7fb47ad2a640 1 --2- 172.21.15.78:0/850276860 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fb4600664a0 0x7fb460068960 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7fb470009b60 tx=0x7fb470009190 comp rx=0 tx=0).stop 2023-11-28T20:01:22.796 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:22.793+0000 7fb47ad2a640 1 -- 172.21.15.78:0/850276860 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb47414fc30 msgr2=0x7fb4740a6760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:01:22.796 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:22.793+0000 7fb47ad2a640 1 --2- 172.21.15.78:0/850276860 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb47414fc30 0x7fb4740a6760 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7fb46c019520 tx=0x7fb46c0196b0 comp rx=0 tx=0).stop 2023-11-28T20:01:22.796 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:22.793+0000 7fb47ad2a640 1 -- 172.21.15.78:0/850276860 shutdown_connections 2023-11-28T20:01:22.797 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:22.793+0000 7fb47ad2a640 1 --2- 172.21.15.78:0/850276860 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fb4600664a0 0x7fb460068960 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:22.797 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:22.793+0000 7fb47ad2a640 1 --2- 172.21.15.78:0/850276860 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb47414fc30 0x7fb4740a6760 unknown :-1 s=CLOSED pgs=675 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:22.797 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:22.793+0000 7fb47ad2a640 1 --2- 172.21.15.78:0/850276860 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb47414f850 0x7fb4741f1230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:22.797 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:22.793+0000 7fb47ad2a640 1 --2- 172.21.15.78:0/850276860 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb47406d840 0x7fb47414ba20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:22.797 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:22.793+0000 7fb47ad2a640 1 -- 172.21.15.78:0/850276860 >> 172.21.15.78:0/850276860 conn(0x7fb4740c59f0 msgr2=0x7fb4740bee80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:01:22.797 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:22.793+0000 7fb47ad2a640 1 -- 172.21.15.78:0/850276860 shutdown_connections 2023-11-28T20:01:22.797 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:22.793+0000 7fb47ad2a640 1 -- 172.21.15.78:0/850276860 wait complete. 2023-11-28T20:01:22.838 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs2 cephfs2_metadata cephfs2_data 2023-11-28T20:01:22.977 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:22.973+0000 7f14a0faa640 1 Processor -- start 2023-11-28T20:01:22.977 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:22.973+0000 7f14a0faa640 1 -- start start 2023-11-28T20:01:22.978 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:22.973+0000 7f14a0faa640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f149c14f850 0x7f149c0aacf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:22.978 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:22.973+0000 7f14a0faa640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f149c06d840 0x7f149c0c43e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:22.978 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:22.973+0000 7f14a0faa640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f149c152910 con 0x7f149c14fc30 2023-11-28T20:01:22.978 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:22.973+0000 7f14a0faa640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f149c0c2240 con 0x7f149c06d840 2023-11-28T20:01:22.979 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:22.973+0000 7f14a0faa640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f149c152bf0 con 0x7f149c14f850 2023-11-28T20:01:22.979 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:22.973+0000 7f149ad9d640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f149c06d840 0x7f149c0c43e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:22.980 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:22.973+0000 7f1491d9b640 1 --1- >> v1:172.21.15.179:6789/0 conn(0x7f149c14fc30 0x7f149c0c3cd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.179:6789/0 says I am v1:172.21.15.78:39350/0 (socket says 172.21.15.78:39350) 2023-11-28T20:01:22.980 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:22.973+0000 7f149ad9d640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f149c06d840 0x7f149c0c43e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.78:57660/0 (socket says 172.21.15.78:57660) 2023-11-28T20:01:22.980 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:22.973+0000 7f1491d9b640 1 -- 172.21.15.78:0/3500643103 learned_addr learned my addr 172.21.15.78:0/3500643103 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-11-28T20:01:22.980 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:22.973+0000 7f149a59c640 1 --2- 172.21.15.78:0/3500643103 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f149c14f850 0x7f149c0aacf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:22.980 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:22.973+0000 7f149ad9d640 1 -- 172.21.15.78:0/3500643103 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f149c14f850 msgr2=0x7f149c0aacf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:01:22.980 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:22.973+0000 7f149ad9d640 1 --2- 172.21.15.78:0/3500643103 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f149c14f850 0x7f149c0aacf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:22.980 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:22.973+0000 7f149ad9d640 1 -- 172.21.15.78:0/3500643103 >> v1:172.21.15.179:6789/0 conn(0x7f149c14fc30 legacy=0x7f149c0c3cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:01:22.980 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:22.973+0000 7f149ad9d640 1 -- 172.21.15.78:0/3500643103 --> v2:172.21.15.179:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f149c152ed0 con 0x7f149c06d840 2023-11-28T20:01:22.982 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:22.977+0000 7f149ad9d640 1 --2- 172.21.15.78:0/3500643103 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f149c06d840 0x7f149c0c43e0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f1494009d90 tx=0x7f149401c950 comp rx=0 tx=0).ready entity=mon.1 client_cookie=61ec952c5eba4f68 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:01:22.982 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:22.977+0000 7f1499d9b640 1 -- 172.21.15.78:0/3500643103 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14940a5a30 con 0x7f149c06d840 2023-11-28T20:01:22.983 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:22.977+0000 7f1499d9b640 1 -- 172.21.15.78:0/3500643103 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f14940a5b90 con 0x7f149c06d840 2023-11-28T20:01:22.983 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:22.977+0000 7f1499d9b640 1 -- 172.21.15.78:0/3500643103 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14940ad440 con 0x7f149c06d840 2023-11-28T20:01:22.983 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:22.977+0000 7f14a0faa640 1 -- 172.21.15.78:0/3500643103 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f149c06d840 msgr2=0x7f149c0c43e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:01:22.983 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:22.977+0000 7f14a0faa640 1 --2- 172.21.15.78:0/3500643103 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f149c06d840 0x7f149c0c43e0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f1494009d90 tx=0x7f149401c950 comp rx=0 tx=0).stop 2023-11-28T20:01:22.983 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:22.977+0000 7f14a0faa640 1 -- 172.21.15.78:0/3500643103 shutdown_connections 2023-11-28T20:01:22.984 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:22.977+0000 7f14a0faa640 1 --2- 172.21.15.78:0/3500643103 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f149c06d840 0x7f149c0c43e0 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:22.984 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:22.977+0000 7f14a0faa640 1 --2- 172.21.15.78:0/3500643103 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f149c14f850 0x7f149c0aacf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:22.984 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:22.977+0000 7f14a0faa640 1 -- 172.21.15.78:0/3500643103 >> 172.21.15.78:0/3500643103 conn(0x7f149c0c59f0 msgr2=0x7f149c0c5e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:01:22.984 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:22.977+0000 7f14a0faa640 1 -- 172.21.15.78:0/3500643103 shutdown_connections 2023-11-28T20:01:22.984 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:22.977+0000 7f14a0faa640 1 -- 172.21.15.78:0/3500643103 wait complete. 2023-11-28T20:01:22.985 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:22.981+0000 7f14a0faa640 1 Processor -- start 2023-11-28T20:01:22.985 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:22.981+0000 7f14a0faa640 1 -- start start 2023-11-28T20:01:22.988 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:22.981+0000 7f14a0faa640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f149c06d840 0x7f149c06fac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:22.988 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:22.981+0000 7f14a0faa640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f149c14f850 0x7f149c148580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:22.988 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:22.981+0000 7f14a0faa640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f149c14fc30 0x7f149c1eeff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:22.988 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:22.981+0000 7f14a0faa640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f149c0717b0 con 0x7f149c14f850 2023-11-28T20:01:22.988 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:22.981+0000 7f14a0faa640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f149c149d90 con 0x7f149c14fc30 2023-11-28T20:01:22.988 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:22.981+0000 7f14a0faa640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f149c072470 con 0x7f149c06d840 2023-11-28T20:01:22.989 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:22.981+0000 7f1491d9b640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f149c14f850 0x7f149c148580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:22.990 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:22.981+0000 7f1491d9b640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f149c14f850 0x7f149c148580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:40172/0 (socket says 172.21.15.78:40172) 2023-11-28T20:01:22.990 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:22.981+0000 7f1491d9b640 1 -- 172.21.15.78:0/4197622568 learned_addr learned my addr 172.21.15.78:0/4197622568 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T20:01:22.990 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:22.981+0000 7f149ad9d640 1 --2- 172.21.15.78:0/4197622568 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f149c14fc30 0x7f149c1eeff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:22.990 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:22.981+0000 7f149a59c640 1 --2- 172.21.15.78:0/4197622568 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f149c06d840 0x7f149c06fac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:22.990 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:22.981+0000 7f1491d9b640 1 -- 172.21.15.78:0/4197622568 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f149c06d840 msgr2=0x7f149c06fac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:01:22.990 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:22.981+0000 7f1491d9b640 1 --2- 172.21.15.78:0/4197622568 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f149c06d840 0x7f149c06fac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:22.991 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:22.981+0000 7f1491d9b640 1 -- 172.21.15.78:0/4197622568 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f149c14fc30 msgr2=0x7f149c1eeff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:01:22.991 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:22.981+0000 7f1491d9b640 1 --2- 172.21.15.78:0/4197622568 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f149c14fc30 0x7f149c1eeff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:22.991 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:22.981+0000 7f1491d9b640 1 -- 172.21.15.78:0/4197622568 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1494009a70 con 0x7f149c14f850 2023-11-28T20:01:22.991 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:22.985+0000 7f1491d9b640 1 --2- 172.21.15.78:0/4197622568 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f149c14f850 0x7f149c148580 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7f148c00c430 tx=0x7f148c00c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:01:22.991 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:22.985+0000 7f14937fe640 1 -- 172.21.15.78:0/4197622568 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f148c005cf0 con 0x7f149c14f850 2023-11-28T20:01:22.991 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:22.985+0000 7f14937fe640 1 -- 172.21.15.78:0/4197622568 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f148c005e50 con 0x7f149c14f850 2023-11-28T20:01:22.991 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:22.985+0000 7f14937fe640 1 -- 172.21.15.78:0/4197622568 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f148c0072d0 con 0x7f149c14f850 2023-11-28T20:01:22.991 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:22.985+0000 7f14a0faa640 1 -- 172.21.15.78:0/4197622568 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f149c149fe0 con 0x7f149c14f850 2023-11-28T20:01:22.992 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:22.985+0000 7f14a0faa640 1 -- 172.21.15.78:0/4197622568 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f149c14a5a0 con 0x7f149c14f850 2023-11-28T20:01:22.993 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:22.985+0000 7f14a0faa640 1 -- 172.21.15.78:0/4197622568 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f149c151490 con 0x7f149c14f850 2023-11-28T20:01:22.993 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:22.985+0000 7f14937fe640 1 -- 172.21.15.78:0/4197622568 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f148c007430 con 0x7f149c14f850 2023-11-28T20:01:22.993 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:22.989+0000 7f14937fe640 1 --2- 172.21.15.78:0/4197622568 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f147c066470 0x7f147c068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:22.993 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:22.989+0000 7f14937fe640 1 -- 172.21.15.78:0/4197622568 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 6783+0+0 (secure 0 0 0) 0x7f148c083a80 con 0x7f149c14f850 2023-11-28T20:01:22.993 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:22.989+0000 7f149a59c640 1 --2- 172.21.15.78:0/4197622568 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f147c066470 0x7f147c068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:22.993 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:22.989+0000 7f149a59c640 1 --2- 172.21.15.78:0/4197622568 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f147c066470 0x7f147c068930 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f1484009b60 tx=0x7f1484009190 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:01:22.995 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:22.993+0000 7f14937fe640 1 -- 172.21.15.78:0/4197622568 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f148c050cf0 con 0x7f149c14f850 2023-11-28T20:01:23.177 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:23.173+0000 7f14a0faa640 1 -- 172.21.15.78:0/4197622568 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs2", "metadata": "cephfs2_metadata", "data": "cephfs2_data"} v 0) v1 -- 0x7f149c067630 con 0x7f149c14f850 2023-11-28T20:01:23.797 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:23.793+0000 7f14937fe640 1 -- 172.21.15.78:0/4197622568 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs2", "metadata": "cephfs2_metadata", "data": "cephfs2_data"}]=0 new fs with metadata pool 11 and data pool 12 v32) v1 ==== 177+0+0 (secure 0 0 0) 0x7f148c054310 con 0x7f149c14f850 2023-11-28T20:01:23.797 INFO:teuthology.orchestra.run.smithi078.stderr:new fs with metadata pool 11 and data pool 12 2023-11-28T20:01:23.799 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:23.793+0000 7f14a0faa640 1 -- 172.21.15.78:0/4197622568 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f147c066470 msgr2=0x7f147c068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:01:23.799 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:23.793+0000 7f14a0faa640 1 --2- 172.21.15.78:0/4197622568 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f147c066470 0x7f147c068930 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f1484009b60 tx=0x7f1484009190 comp rx=0 tx=0).stop 2023-11-28T20:01:23.799 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:23.793+0000 7f14a0faa640 1 -- 172.21.15.78:0/4197622568 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f149c14f850 msgr2=0x7f149c148580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:01:23.799 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:23.793+0000 7f14a0faa640 1 --2- 172.21.15.78:0/4197622568 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f149c14f850 0x7f149c148580 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7f148c00c430 tx=0x7f148c00c8f0 comp rx=0 tx=0).stop 2023-11-28T20:01:23.800 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:23.793+0000 7f14a0faa640 1 -- 172.21.15.78:0/4197622568 shutdown_connections 2023-11-28T20:01:23.800 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:23.793+0000 7f14a0faa640 1 --2- 172.21.15.78:0/4197622568 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f147c066470 0x7f147c068930 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:23.800 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:23.793+0000 7f14a0faa640 1 --2- 172.21.15.78:0/4197622568 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f149c14fc30 0x7f149c1eeff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:23.800 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:23.793+0000 7f14a0faa640 1 --2- 172.21.15.78:0/4197622568 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f149c14f850 0x7f149c148580 unknown :-1 s=CLOSED pgs=676 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:23.800 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:23.793+0000 7f14a0faa640 1 --2- 172.21.15.78:0/4197622568 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f149c06d840 0x7f149c06fac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:23.800 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:23.793+0000 7f14a0faa640 1 -- 172.21.15.78:0/4197622568 >> 172.21.15.78:0/4197622568 conn(0x7f149c0c59f0 msgr2=0x7f149c0c3cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:01:23.801 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:23.797+0000 7f14a0faa640 1 -- 172.21.15.78:0/4197622568 shutdown_connections 2023-11-28T20:01:23.801 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:23.797+0000 7f14a0faa640 1 -- 172.21.15.78:0/4197622568 wait complete. 2023-11-28T20:01:23.845 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-28T20:01:23.982 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:23.977+0000 7f75bcdc4640 1 Processor -- start 2023-11-28T20:01:23.983 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:23.977+0000 7f75bcdc4640 1 -- start start 2023-11-28T20:01:23.984 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:23.981+0000 7f75bcdc4640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f75b806d2b0 0x7f75b806d690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:23.984 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:23.981+0000 7f75bcdc4640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f75b806bb80 con 0x7f75b80c5300 2023-11-28T20:01:23.984 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:23.981+0000 7f75bcdc4640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f75b80c5790 con 0x7f75b80c3b80 2023-11-28T20:01:23.984 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:23.981+0000 7f75bcdc4640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f75b81515c0 con 0x7f75b806d2b0 2023-11-28T20:01:23.984 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:23.981+0000 7f75b6d9d640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f75b80c5300 0x7f75b806c730 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:47430/0 (socket says 172.21.15.78:47430) 2023-11-28T20:01:23.984 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:23.981+0000 7f75b6d9d640 1 -- 172.21.15.78:0/4200402036 learned_addr learned my addr 172.21.15.78:0/4200402036 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-11-28T20:01:23.986 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:23.981+0000 7f75b659c640 1 --2- 172.21.15.78:0/4200402036 >> v2:172.21.15.179:3300/0 conn(0x7f75b806d2b0 0x7f75b806d690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:23.986 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:23.981+0000 7f75b5d9b640 1 -- 172.21.15.78:0/4200402036 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1103963433 0 0) 0x7f75b806bb80 con 0x7f75b80c5300 2023-11-28T20:01:23.986 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:23.981+0000 7f75b5d9b640 1 -- 172.21.15.78:0/4200402036 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f75a4003530 con 0x7f75b80c5300 2023-11-28T20:01:23.986 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:23.981+0000 7f75b5d9b640 1 -- 172.21.15.78:0/4200402036 <== mon.0 v1:172.21.15.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 40615687 0 0) 0x7f75a4003530 con 0x7f75b80c5300 2023-11-28T20:01:23.986 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:23.981+0000 7f75b5d9b640 1 -- 172.21.15.78:0/4200402036 >> v2:172.21.15.179:3300/0 conn(0x7f75b806d2b0 msgr2=0x7f75b806d690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:01:23.986 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:23.981+0000 7f75b5d9b640 1 --2- 172.21.15.78:0/4200402036 >> v2:172.21.15.179:3300/0 conn(0x7f75b806d2b0 0x7f75b806d690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:23.986 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:23.981+0000 7f75b5d9b640 1 -- 172.21.15.78:0/4200402036 >> v1:172.21.15.179:6789/0 conn(0x7f75b80c3b80 legacy=0x7f75b806c020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:01:23.986 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:23.981+0000 7f75b5d9b640 1 -- 172.21.15.78:0/4200402036 --> v1:172.21.15.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75b81518a0 con 0x7f75b80c5300 2023-11-28T20:01:23.987 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:23.981+0000 7f75b5d9b640 1 -- 172.21.15.78:0/4200402036 <== mon.0 v1:172.21.15.78:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3326804700 0 0) 0x7f75b0001a00 con 0x7f75b80c5300 2023-11-28T20:01:23.987 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:23.981+0000 7f75b5d9b640 1 -- 172.21.15.78:0/4200402036 >> v1:172.21.15.78:6789/0 conn(0x7f75b80c5300 legacy=0x7f75b806c730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:01:23.987 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:23.981+0000 7f75b5d9b640 1 --2- 172.21.15.78:0/4200402036 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f75a4003980 0x7f75a4003d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:23.987 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:23.981+0000 7f75b5d9b640 1 --2- 172.21.15.78:0/4200402036 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f75a4004380 0x7f75a4004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:23.987 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:23.981+0000 7f75b5d9b640 1 --2- 172.21.15.78:0/4200402036 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f75a4005050 0x7f75a400b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:23.987 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:23.981+0000 7f75b5d9b640 1 -- 172.21.15.78:0/4200402036 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75b81515c0 con 0x7f75a4003980 2023-11-28T20:01:23.987 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:23.981+0000 7f75b5d9b640 1 -- 172.21.15.78:0/4200402036 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75a400bfb0 con 0x7f75a4005050 2023-11-28T20:01:23.987 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:23.981+0000 7f75b5d9b640 1 -- 172.21.15.78:0/4200402036 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f75a400c170 con 0x7f75a4004380 2023-11-28T20:01:23.987 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:23.981+0000 7f75b659c640 1 --2- 172.21.15.78:0/4200402036 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f75a4003980 0x7f75a4003d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:23.987 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:23.981+0000 7f75affff640 1 --2- 172.21.15.78:0/4200402036 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f75a4004380 0x7f75a4004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:23.987 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:23.981+0000 7f75b6d9d640 1 --2- 172.21.15.78:0/4200402036 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f75a4005050 0x7f75a400b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:23.987 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:23.981+0000 7f75b659c640 1 -- 172.21.15.78:0/4200402036 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f75a4004380 msgr2=0x7f75a4004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:01:23.988 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:23.981+0000 7f75b659c640 1 --2- 172.21.15.78:0/4200402036 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f75a4004380 0x7f75a4004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:23.988 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:23.981+0000 7f75b659c640 1 -- 172.21.15.78:0/4200402036 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f75a4005050 msgr2=0x7f75a400b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:01:23.988 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:23.981+0000 7f75b659c640 1 --2- 172.21.15.78:0/4200402036 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f75a4005050 0x7f75a400b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:23.988 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:23.981+0000 7f75b6d9d640 1 -- 172.21.15.78:0/4200402036 reap_dead start 2023-11-28T20:01:23.988 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:23.981+0000 7f75b659c640 1 -- 172.21.15.78:0/4200402036 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75a4003530 con 0x7f75a4003980 2023-11-28T20:01:23.988 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:23.981+0000 7f75affff640 1 --2- 172.21.15.78:0/4200402036 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f75a4004380 0x7f75a4004850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T20:01:23.988 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:23.985+0000 7f75b659c640 1 --2- 172.21.15.78:0/4200402036 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f75a4003980 0x7f75a4003d60 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7f75a8009ae0 tx=0x7f75a801ca50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e06830062eb4ac0e server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:01:23.989 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:23.985+0000 7f75b5d9b640 1 -- 172.21.15.78:0/4200402036 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75a80a5640 con 0x7f75a4003980 2023-11-28T20:01:23.989 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:23.985+0000 7f75b5d9b640 1 -- 172.21.15.78:0/4200402036 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f75a80a57a0 con 0x7f75a4003980 2023-11-28T20:01:23.989 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:23.985+0000 7f75b5d9b640 1 -- 172.21.15.78:0/4200402036 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75a80a5b50 con 0x7f75a4003980 2023-11-28T20:01:23.990 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:23.985+0000 7f75bcdc4640 1 -- 172.21.15.78:0/4200402036 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f75a4003980 msgr2=0x7f75a4003d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:01:23.990 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:23.985+0000 7f75bcdc4640 1 --2- 172.21.15.78:0/4200402036 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f75a4003980 0x7f75a4003d60 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7f75a8009ae0 tx=0x7f75a801ca50 comp rx=0 tx=0).stop 2023-11-28T20:01:23.990 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:23.985+0000 7f75bcdc4640 1 -- 172.21.15.78:0/4200402036 shutdown_connections 2023-11-28T20:01:23.990 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:23.985+0000 7f75bcdc4640 1 --2- 172.21.15.78:0/4200402036 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f75a4003980 0x7f75a4003d60 unknown :-1 s=CLOSED pgs=678 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:23.990 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:23.985+0000 7f75bcdc4640 1 -- 172.21.15.78:0/4200402036 >> 172.21.15.78:0/4200402036 conn(0x7f75b80a7810 msgr2=0x7f75b80a7c20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:01:23.990 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:23.985+0000 7f75bcdc4640 1 -- 172.21.15.78:0/4200402036 shutdown_connections 2023-11-28T20:01:23.990 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:23.985+0000 7f75bcdc4640 1 -- 172.21.15.78:0/4200402036 wait complete. 2023-11-28T20:01:23.991 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:23.985+0000 7f75bcdc4640 1 Processor -- start 2023-11-28T20:01:23.991 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:23.989+0000 7f75bcdc4640 1 -- start start 2023-11-28T20:01:23.994 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:23.989+0000 7f75bcdc4640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f75a4003980 0x7f75b81eaac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:23.994 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:23.989+0000 7f75bcdc4640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f75b814d3f0 0x7f75b80aa7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:23.994 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:23.989+0000 7f75bcdc4640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f75b80aad30 0x7f75b814c850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:23.994 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:23.989+0000 7f75bcdc4640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75b80a8950 con 0x7f75b80aad30 2023-11-28T20:01:23.994 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:23.989+0000 7f75bcdc4640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75b80a8c30 con 0x7f75b814d3f0 2023-11-28T20:01:23.994 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:23.989+0000 7f75bcdc4640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f75b80a8f10 con 0x7f75a4003980 2023-11-28T20:01:23.994 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:23.989+0000 7f75b6d9d640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f75b80aad30 0x7f75b814c850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:23.994 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:23.989+0000 7f75b6d9d640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f75b80aad30 0x7f75b814c850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:40202/0 (socket says 172.21.15.78:40202) 2023-11-28T20:01:23.994 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:23.989+0000 7f75b6d9d640 1 -- 172.21.15.78:0/3412420868 learned_addr learned my addr 172.21.15.78:0/3412420868 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T20:01:23.995 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:23.989+0000 7f75affff640 1 --2- 172.21.15.78:0/3412420868 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f75b814d3f0 0x7f75b80aa7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:23.995 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:23.989+0000 7f75b659c640 1 --2- 172.21.15.78:0/3412420868 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f75a4003980 0x7f75b81eaac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:23.995 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:23.989+0000 7f75b6d9d640 1 -- 172.21.15.78:0/3412420868 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f75a4003980 msgr2=0x7f75b81eaac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:01:23.995 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:23.989+0000 7f75b6d9d640 1 --2- 172.21.15.78:0/3412420868 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f75a4003980 0x7f75b81eaac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:23.995 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:23.989+0000 7f75b6d9d640 1 -- 172.21.15.78:0/3412420868 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f75b814d3f0 msgr2=0x7f75b80aa7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:01:23.995 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:23.989+0000 7f75b6d9d640 1 --2- 172.21.15.78:0/3412420868 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f75b814d3f0 0x7f75b80aa7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:23.995 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:23.989+0000 7f75b6d9d640 1 -- 172.21.15.78:0/3412420868 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75b80a91f0 con 0x7f75b80aad30 2023-11-28T20:01:23.995 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:23.989+0000 7f75b659c640 1 --2- 172.21.15.78:0/3412420868 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f75a4003980 0x7f75b81eaac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T20:01:23.995 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:23.989+0000 7f75b6d9d640 1 --2- 172.21.15.78:0/3412420868 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f75b80aad30 0x7f75b814c850 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7f75b00012f0 tx=0x7f75b0007bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:01:23.996 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:23.989+0000 7f75aeffd640 1 -- 172.21.15.78:0/3412420868 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75b000eb00 con 0x7f75b80aad30 2023-11-28T20:01:23.996 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:23.989+0000 7f75aeffd640 1 -- 172.21.15.78:0/3412420868 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f75b000ec60 con 0x7f75b80aad30 2023-11-28T20:01:23.996 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:23.989+0000 7f75bcdc4640 1 -- 172.21.15.78:0/3412420868 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f75b81daa30 con 0x7f75b80aad30 2023-11-28T20:01:23.996 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:23.989+0000 7f75aeffd640 1 -- 172.21.15.78:0/3412420868 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75b0013420 con 0x7f75b80aad30 2023-11-28T20:01:23.996 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:23.989+0000 7f75bcdc4640 1 -- 172.21.15.78:0/3412420868 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f75b814cd90 con 0x7f75b80aad30 2023-11-28T20:01:23.997 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:23.989+0000 7f75bcdc4640 1 -- 172.21.15.78:0/3412420868 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f75b8067630 con 0x7f75b80aad30 2023-11-28T20:01:23.997 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:23.993+0000 7f75aeffd640 1 -- 172.21.15.78:0/3412420868 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f75b0013580 con 0x7f75b80aad30 2023-11-28T20:01:23.997 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:23.993+0000 7f75aeffd640 1 --2- 172.21.15.78:0/3412420868 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f7598066470 0x7f7598068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:23.997 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:23.993+0000 7f75aeffd640 1 -- 172.21.15.78:0/3412420868 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 6885+0+0 (secure 0 0 0) 0x7f75b00845f0 con 0x7f75b80aad30 2023-11-28T20:01:23.997 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:23.993+0000 7f75b659c640 1 --2- 172.21.15.78:0/3412420868 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f7598066470 0x7f7598068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:23.997 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:23.993+0000 7f75b659c640 1 --2- 172.21.15.78:0/3412420868 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f7598066470 0x7f7598068930 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f75a80af000 tx=0x7f75a8008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:01:24.000 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:23.997+0000 7f75aeffd640 1 -- 172.21.15.78:0/3412420868 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f75b0051660 con 0x7f75b80aad30 2023-11-28T20:01:24.150 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:24.145+0000 7f75bcdc4640 1 -- 172.21.15.78:0/3412420868 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f75b80a8a90 con 0x7f75b80aad30 2023-11-28T20:01:24.152 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:24.149+0000 7f75aeffd640 1 -- 172.21.15.78:0/3412420868 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v64) v1 ==== 74+0+20423 (secure 0 0 0) 0x7f75b80a8a90 con 0x7f75b80aad30 2023-11-28T20:01:24.152 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-11-28T20:01:24.152 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":64,"fsid":"dd9780e8-3bda-44fa-a9f0-fa07d19d901d","created":"2023-11-28T19:58:40.969556+0000","modified":"2023-11-28T20:01:23.177692+0000","last_up_change":"2023-11-28T19:58:52.596716+0000","last_in_change":"2023-11-28T19:58:43.609275+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":12,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-28T19:58:54.011229+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_metadata","create_time":"2023-11-28T20:01:07.969267+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"60","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_data","create_time":"2023-11-28T20:01:08.865465+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"61","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs2_metadata","create_time":"2023-11-28T20:01:20.863763+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"64","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs2_data","create_time":"2023-11-28T20:01:22.176918+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"64","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs2"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e84245ac-b5da-429e-af18-39acaa2b33e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6800","nonce":3358701235},{"type":"v1","addr":"172.21.15.78:6801","nonce":3358701235}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6802","nonce":3358701235},{"type":"v1","addr":"172.21.15.78:6803","nonce":3358701235}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6806","nonce":3358701235},{"type":"v1","addr":"172.21.15.78:6807","nonce":3358701235}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6804","nonce":3358701235},{"type":"v1","addr":"172.21.15.78:6805","nonce":3358701235}]},"public_addr":"172.21.15.78:6801/3358701235","cluster_addr":"172.21.15.78:6803/3358701235","heartbeat_back_addr":"172.21.15.78:6807/3358701235","heartbeat_front_addr":"172.21.15.78:6805/3358701235","state":["exists","up"]},{"osd":1,"uuid":"e634831d-c4e2-48d9-870c-9556ae162981","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6808","nonce":3211476654},{"type":"v1","addr":"172.21.15.78:6809","nonce":3211476654}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6810","nonce":3211476654},{"type":"v1","addr":"172.21.15.78:6811","nonce":3211476654}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6814","nonce":3211476654},{"type":"v1","addr":"172.21.15.78:6815","nonce":3211476654}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6812","nonce":3211476654},{"type":"v1","addr":"172.21.15.78:6813","nonce":3211476654}]},"public_addr":"172.21.15.78:6809/3211476654","cluster_addr":"172.21.15.78:6811/3211476654","heartbeat_back_addr":"172.21.15.78:6815/3211476654","heartbeat_front_addr":"172.21.15.78:6813/3211476654","state":["exists","up"]},{"osd":2,"uuid":"274c8395-6534-41f0-b8fb-a00af8985aa8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6816","nonce":2532904479},{"type":"v1","addr":"172.21.15.78:6817","nonce":2532904479}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6818","nonce":2532904479},{"type":"v1","addr":"172.21.15.78:6819","nonce":2532904479}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6822","nonce":2532904479},{"type":"v1","addr":"172.21.15.78:6823","nonce":2532904479}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6820","nonce":2532904479},{"type":"v1","addr":"172.21.15.78:6821","nonce":2532904479}]},"public_addr":"172.21.15.78:6817/2532904479","cluster_addr":"172.21.15.78:6819/2532904479","heartbeat_back_addr":"172.21.15.78:6823/2532904479","heartbeat_front_addr":"172.21.15.78:6821/2532904479","state":["exists","up"]},{"osd":3,"uuid":"77acc9af-7d4d-4b18-8cf5-d62f5971b7c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6824","nonce":3442991267},{"type":"v1","addr":"172.21.15.78:6825","nonce":3442991267}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6826","nonce":3442991267},{"type":"v1","addr":"172.21.15.78:6827","nonce":3442991267}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6830","nonce":3442991267},{"type":"v1","addr":"172.21.15.78:6831","nonce":3442991267}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6828","nonce":3442991267},{"type":"v1","addr":"172.21.15.78:6829","nonce":3442991267}]},"public_addr":"172.21.15.78:6825/3442991267","cluster_addr":"172.21.15.78:6827/3442991267","heartbeat_back_addr":"172.21.15.78:6831/3442991267","heartbeat_front_addr":"172.21.15.78:6829/3442991267","state":["exists","up"]},{"osd":4,"uuid":"5c62bc66-6b34-4b7f-a66b-9a743969138c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":802983577},{"type":"v1","addr":"172.21.15.179:6809","nonce":802983577}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":802983577},{"type":"v1","addr":"172.21.15.179:6811","nonce":802983577}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":802983577},{"type":"v1","addr":"172.21.15.179:6815","nonce":802983577}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":802983577},{"type":"v1","addr":"172.21.15.179:6813","nonce":802983577}]},"public_addr":"172.21.15.179:6809/802983577","cluster_addr":"172.21.15.179:6811/802983577","heartbeat_back_addr":"172.21.15.179:6815/802983577","heartbeat_front_addr":"172.21.15.179:6813/802983577","state":["exists","up"]},{"osd":5,"uuid":"67db6d36-f684-4079-b0cd-82b4dd61461f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":518192887},{"type":"v1","addr":"172.21.15.179:6818","nonce":518192887}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":518192887},{"type":"v1","addr":"172.21.15.179:6822","nonce":518192887}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":518192887},{"type":"v1","addr":"172.21.15.179:6829","nonce":518192887}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6824","nonce":518192887},{"type":"v1","addr":"172.21.15.179:6826","nonce":518192887}]},"public_addr":"172.21.15.179:6818/518192887","cluster_addr":"172.21.15.179:6822/518192887","heartbeat_back_addr":"172.21.15.179:6829/518192887","heartbeat_front_addr":"172.21.15.179:6826/518192887","state":["exists","up"]},{"osd":6,"uuid":"12e670af-5a16-4c81-9f97-defa66cab967","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":815435378},{"type":"v1","addr":"172.21.15.179:6801","nonce":815435378}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":815435378},{"type":"v1","addr":"172.21.15.179:6803","nonce":815435378}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":815435378},{"type":"v1","addr":"172.21.15.179:6807","nonce":815435378}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":815435378},{"type":"v1","addr":"172.21.15.179:6805","nonce":815435378}]},"public_addr":"172.21.15.179:6801/815435378","cluster_addr":"172.21.15.179:6803/815435378","heartbeat_back_addr":"172.21.15.179:6807/815435378","heartbeat_front_addr":"172.21.15.179:6805/815435378","state":["exists","up"]},{"osd":7,"uuid":"fe630650-2eb3-49ad-8676-c341e6332eb1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6817","nonce":2848432339},{"type":"v1","addr":"172.21.15.179:6819","nonce":2848432339}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6821","nonce":2848432339},{"type":"v1","addr":"172.21.15.179:6823","nonce":2848432339}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":2848432339},{"type":"v1","addr":"172.21.15.179:6831","nonce":2848432339}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6825","nonce":2848432339},{"type":"v1","addr":"172.21.15.179:6827","nonce":2848432339}]},"public_addr":"172.21.15.179:6819/2848432339","cluster_addr":"172.21.15.179:6823/2848432339","heartbeat_back_addr":"172.21.15.179:6831/2848432339","heartbeat_front_addr":"172.21.15.179:6827/2848432339","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:58:49.255433+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:58:49.412880+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:58:49.559295+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:58:49.245237+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:58:49.184557+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:58:49.329851+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:58:49.366012+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:58:49.349604+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-28T20:01:24.154 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:24.149+0000 7f75bcdc4640 1 -- 172.21.15.78:0/3412420868 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f7598066470 msgr2=0x7f7598068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:01:24.154 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:24.149+0000 7f75bcdc4640 1 --2- 172.21.15.78:0/3412420868 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f7598066470 0x7f7598068930 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f75a80af000 tx=0x7f75a8008040 comp rx=0 tx=0).stop 2023-11-28T20:01:24.155 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:24.149+0000 7f75bcdc4640 1 -- 172.21.15.78:0/3412420868 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f75b80aad30 msgr2=0x7f75b814c850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:01:24.155 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:24.149+0000 7f75bcdc4640 1 --2- 172.21.15.78:0/3412420868 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f75b80aad30 0x7f75b814c850 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7f75b00012f0 tx=0x7f75b0007bc0 comp rx=0 tx=0).stop 2023-11-28T20:01:24.155 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:24.149+0000 7f75bcdc4640 1 -- 172.21.15.78:0/3412420868 shutdown_connections 2023-11-28T20:01:24.155 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:24.149+0000 7f75bcdc4640 1 --2- 172.21.15.78:0/3412420868 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f7598066470 0x7f7598068930 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:24.155 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:24.149+0000 7f75bcdc4640 1 --2- 172.21.15.78:0/3412420868 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f75b80aad30 0x7f75b814c850 unknown :-1 s=CLOSED pgs=679 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:24.155 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:24.149+0000 7f75bcdc4640 1 --2- 172.21.15.78:0/3412420868 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f75b814d3f0 0x7f75b80aa7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:24.155 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:24.149+0000 7f75bcdc4640 1 --2- 172.21.15.78:0/3412420868 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f75a4003980 0x7f75b81eaac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:24.155 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:24.149+0000 7f75bcdc4640 1 -- 172.21.15.78:0/3412420868 >> 172.21.15.78:0/3412420868 conn(0x7f75b80a7810 msgr2=0x7f75b80bfb10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:01:24.155 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:24.149+0000 7f75bcdc4640 1 -- 172.21.15.78:0/3412420868 shutdown_connections 2023-11-28T20:01:24.155 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:24.149+0000 7f75bcdc4640 1 -- 172.21.15.78:0/3412420868 wait complete. 2023-11-28T20:01:24.174 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-28T20:01:24.311 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:24.305+0000 7f19a3d72640 1 Processor -- start 2023-11-28T20:01:24.311 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:24.309+0000 7f19a3d72640 1 -- start start 2023-11-28T20:01:24.312 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:24.309+0000 7f19a3d72640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f199c154f20 0x7f199c06b9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:24.312 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:24.309+0000 7f19a3d72640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f199c0c4890 con 0x7f199c0af4c0 2023-11-28T20:01:24.313 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:24.309+0000 7f19a3d72640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f199c1553d0 con 0x7f199c06bf30 2023-11-28T20:01:24.313 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:24.309+0000 7f19a3d72640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f199c06c340 con 0x7f199c154f20 2023-11-28T20:01:24.313 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:24.309+0000 7f19a130d640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f199c154f20 0x7f199c06b9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:24.314 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:24.309+0000 7f19a1b0e640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f199c0af4c0 0x7f199c0c67d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:47440/0 (socket says 172.21.15.78:47440) 2023-11-28T20:01:24.314 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:24.309+0000 7f19a1b0e640 1 -- 172.21.15.78:0/2737442601 learned_addr learned my addr 172.21.15.78:0/2737442601 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-11-28T20:01:24.314 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:24.309+0000 7f19a130d640 1 -- 172.21.15.78:0/2737442601 >> v1:172.21.15.179:6789/0 conn(0x7f199c06bf30 legacy=0x7f199c15ee20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:01:24.314 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:24.309+0000 7f19a130d640 1 -- 172.21.15.78:0/2737442601 >> v1:172.21.15.78:6789/0 conn(0x7f199c0af4c0 legacy=0x7f199c0c67d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:01:24.314 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:24.309+0000 7f19a130d640 1 -- 172.21.15.78:0/2737442601 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f199c0af8a0 con 0x7f199c154f20 2023-11-28T20:01:24.314 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:24.309+0000 7f19a0b0c640 1 -- 172.21.15.78:0/2737442601 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2815998987 0 0) 0x7f199c0c4890 con 0x7f199c0af4c0 2023-11-28T20:01:24.316 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:24.313+0000 7f19a130d640 1 --2- 172.21.15.78:0/2737442601 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f199c154f20 0x7f199c06b9f0 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7f198c0097c0 tx=0x7f198c01c3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6ed6c03a6e733a59 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:01:24.316 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:24.313+0000 7f19a0b0c640 1 -- 172.21.15.78:0/2737442601 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f198c0ac620 con 0x7f199c154f20 2023-11-28T20:01:24.316 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:24.313+0000 7f19a0b0c640 1 -- 172.21.15.78:0/2737442601 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f198c0ac780 con 0x7f199c154f20 2023-11-28T20:01:24.317 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:24.313+0000 7f19a0b0c640 1 -- 172.21.15.78:0/2737442601 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f198c0acb10 con 0x7f199c154f20 2023-11-28T20:01:24.317 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:24.313+0000 7f19a3d72640 1 -- 172.21.15.78:0/2737442601 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f199c154f20 msgr2=0x7f199c06b9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:01:24.317 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:24.313+0000 7f19a3d72640 1 --2- 172.21.15.78:0/2737442601 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f199c154f20 0x7f199c06b9f0 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7f198c0097c0 tx=0x7f198c01c3c0 comp rx=0 tx=0).stop 2023-11-28T20:01:24.318 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:24.313+0000 7f19a3d72640 1 -- 172.21.15.78:0/2737442601 shutdown_connections 2023-11-28T20:01:24.318 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:24.313+0000 7f19a3d72640 1 --2- 172.21.15.78:0/2737442601 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f199c154f20 0x7f199c06b9f0 unknown :-1 s=CLOSED pgs=681 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:24.318 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:24.313+0000 7f19a3d72640 1 -- 172.21.15.78:0/2737442601 >> 172.21.15.78:0/2737442601 conn(0x7f199c0ab9d0 msgr2=0x7f199c0abde0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:01:24.318 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:24.313+0000 7f19a3d72640 1 -- 172.21.15.78:0/2737442601 shutdown_connections 2023-11-28T20:01:24.318 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:24.313+0000 7f19a3d72640 1 -- 172.21.15.78:0/2737442601 wait complete. 2023-11-28T20:01:24.319 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:24.313+0000 7f19a3d72640 1 Processor -- start 2023-11-28T20:01:24.319 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:24.313+0000 7f19a3d72640 1 -- start start 2023-11-28T20:01:24.321 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:24.317+0000 7f19a3d72640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f199c06bf30 0x7f199c14a030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:24.321 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:24.317+0000 7f19a3d72640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f199c0af4c0 0x7f199c1f0d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:24.321 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:24.317+0000 7f19a3d72640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f199c154f20 0x7f199c0ae6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:24.321 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:24.317+0000 7f19a3d72640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f199c0aebe0 con 0x7f199c06bf30 2023-11-28T20:01:24.321 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:24.317+0000 7f19a3d72640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f199c1f0890 con 0x7f199c154f20 2023-11-28T20:01:24.321 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:24.317+0000 7f19a3d72640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f199c14a6c0 con 0x7f199c0af4c0 2023-11-28T20:01:24.321 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:24.317+0000 7f19a1b0e640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f199c06bf30 0x7f199c14a030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:24.321 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:24.317+0000 7f19a1b0e640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f199c06bf30 0x7f199c14a030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:40220/0 (socket says 172.21.15.78:40220) 2023-11-28T20:01:24.321 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:24.317+0000 7f19a1b0e640 1 -- 172.21.15.78:0/2544628440 learned_addr learned my addr 172.21.15.78:0/2544628440 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T20:01:24.321 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:24.317+0000 7f19a230f640 1 --2- 172.21.15.78:0/2544628440 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f199c154f20 0x7f199c0ae6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:24.321 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:24.317+0000 7f19a130d640 1 --2- 172.21.15.78:0/2544628440 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f199c0af4c0 0x7f199c1f0d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:24.322 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:24.317+0000 7f19a1b0e640 1 -- 172.21.15.78:0/2544628440 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f199c0af4c0 msgr2=0x7f199c1f0d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:01:24.322 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:24.317+0000 7f19a1b0e640 1 --2- 172.21.15.78:0/2544628440 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f199c0af4c0 0x7f199c1f0d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:24.322 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:24.317+0000 7f19a1b0e640 1 -- 172.21.15.78:0/2544628440 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f199c154f20 msgr2=0x7f199c0ae6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:01:24.322 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:24.317+0000 7f19a1b0e640 1 --2- 172.21.15.78:0/2544628440 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f199c154f20 0x7f199c0ae6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:24.322 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:24.317+0000 7f19a1b0e640 1 -- 172.21.15.78:0/2544628440 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f198c009420 con 0x7f199c06bf30 2023-11-28T20:01:24.322 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:24.317+0000 7f19a130d640 1 --2- 172.21.15.78:0/2544628440 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f199c0af4c0 0x7f199c1f0d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T20:01:24.322 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:24.317+0000 7f19a1b0e640 1 --2- 172.21.15.78:0/2544628440 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f199c06bf30 0x7f199c14a030 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7f199800c4a0 tx=0x7f199800c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:01:24.323 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:24.317+0000 7f19927fc640 1 -- 172.21.15.78:0/2544628440 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19980074e0 con 0x7f199c06bf30 2023-11-28T20:01:24.323 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:24.317+0000 7f19927fc640 1 -- 172.21.15.78:0/2544628440 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1998007640 con 0x7f199c06bf30 2023-11-28T20:01:24.323 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:24.317+0000 7f19a3d72640 1 -- 172.21.15.78:0/2544628440 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f199c14a9a0 con 0x7f199c06bf30 2023-11-28T20:01:24.323 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:24.317+0000 7f19927fc640 1 -- 172.21.15.78:0/2544628440 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1998004a30 con 0x7f199c06bf30 2023-11-28T20:01:24.323 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:24.317+0000 7f19a3d72640 1 -- 172.21.15.78:0/2544628440 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f199c1f0520 con 0x7f199c06bf30 2023-11-28T20:01:24.323 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:24.317+0000 7f19a3d72640 1 -- 172.21.15.78:0/2544628440 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f199c067630 con 0x7f199c06bf30 2023-11-28T20:01:24.324 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:24.317+0000 7f19927fc640 1 -- 172.21.15.78:0/2544628440 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f1998004b90 con 0x7f199c06bf30 2023-11-28T20:01:24.324 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:24.321+0000 7f19927fc640 1 --2- 172.21.15.78:0/2544628440 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f1980066470 0x7f1980068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:24.324 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:24.321+0000 7f19927fc640 1 -- 172.21.15.78:0/2544628440 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 6885+0+0 (secure 0 0 0) 0x7f1998083840 con 0x7f199c06bf30 2023-11-28T20:01:24.324 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:24.321+0000 7f19a130d640 1 --2- 172.21.15.78:0/2544628440 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f1980066470 0x7f1980068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:24.325 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:24.321+0000 7f19a130d640 1 --2- 172.21.15.78:0/2544628440 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f1980066470 0x7f1980068930 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f198c0ae000 tx=0x7f198c008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:01:24.329 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:24.325+0000 7f19927fc640 1 -- 172.21.15.78:0/2544628440 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f1998050830 con 0x7f199c06bf30 2023-11-28T20:01:24.478 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:24.473+0000 7f19a3d72640 1 -- 172.21.15.78:0/2544628440 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f199c06c7a0 con 0x7f199c06bf30 2023-11-28T20:01:24.480 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:24.477+0000 7f19927fc640 1 -- 172.21.15.78:0/2544628440 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v64) v1 ==== 74+0+20423 (secure 0 0 0) 0x7f1998053e50 con 0x7f199c06bf30 2023-11-28T20:01:24.480 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-11-28T20:01:24.480 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":64,"fsid":"dd9780e8-3bda-44fa-a9f0-fa07d19d901d","created":"2023-11-28T19:58:40.969556+0000","modified":"2023-11-28T20:01:23.177692+0000","last_up_change":"2023-11-28T19:58:52.596716+0000","last_in_change":"2023-11-28T19:58:43.609275+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":12,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-28T19:58:54.011229+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_metadata","create_time":"2023-11-28T20:01:07.969267+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"60","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_data","create_time":"2023-11-28T20:01:08.865465+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"61","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs2_metadata","create_time":"2023-11-28T20:01:20.863763+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"64","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs2_data","create_time":"2023-11-28T20:01:22.176918+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"64","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs2"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e84245ac-b5da-429e-af18-39acaa2b33e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6800","nonce":3358701235},{"type":"v1","addr":"172.21.15.78:6801","nonce":3358701235}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6802","nonce":3358701235},{"type":"v1","addr":"172.21.15.78:6803","nonce":3358701235}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6806","nonce":3358701235},{"type":"v1","addr":"172.21.15.78:6807","nonce":3358701235}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6804","nonce":3358701235},{"type":"v1","addr":"172.21.15.78:6805","nonce":3358701235}]},"public_addr":"172.21.15.78:6801/3358701235","cluster_addr":"172.21.15.78:6803/3358701235","heartbeat_back_addr":"172.21.15.78:6807/3358701235","heartbeat_front_addr":"172.21.15.78:6805/3358701235","state":["exists","up"]},{"osd":1,"uuid":"e634831d-c4e2-48d9-870c-9556ae162981","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6808","nonce":3211476654},{"type":"v1","addr":"172.21.15.78:6809","nonce":3211476654}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6810","nonce":3211476654},{"type":"v1","addr":"172.21.15.78:6811","nonce":3211476654}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6814","nonce":3211476654},{"type":"v1","addr":"172.21.15.78:6815","nonce":3211476654}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6812","nonce":3211476654},{"type":"v1","addr":"172.21.15.78:6813","nonce":3211476654}]},"public_addr":"172.21.15.78:6809/3211476654","cluster_addr":"172.21.15.78:6811/3211476654","heartbeat_back_addr":"172.21.15.78:6815/3211476654","heartbeat_front_addr":"172.21.15.78:6813/3211476654","state":["exists","up"]},{"osd":2,"uuid":"274c8395-6534-41f0-b8fb-a00af8985aa8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6816","nonce":2532904479},{"type":"v1","addr":"172.21.15.78:6817","nonce":2532904479}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6818","nonce":2532904479},{"type":"v1","addr":"172.21.15.78:6819","nonce":2532904479}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6822","nonce":2532904479},{"type":"v1","addr":"172.21.15.78:6823","nonce":2532904479}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6820","nonce":2532904479},{"type":"v1","addr":"172.21.15.78:6821","nonce":2532904479}]},"public_addr":"172.21.15.78:6817/2532904479","cluster_addr":"172.21.15.78:6819/2532904479","heartbeat_back_addr":"172.21.15.78:6823/2532904479","heartbeat_front_addr":"172.21.15.78:6821/2532904479","state":["exists","up"]},{"osd":3,"uuid":"77acc9af-7d4d-4b18-8cf5-d62f5971b7c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6824","nonce":3442991267},{"type":"v1","addr":"172.21.15.78:6825","nonce":3442991267}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6826","nonce":3442991267},{"type":"v1","addr":"172.21.15.78:6827","nonce":3442991267}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6830","nonce":3442991267},{"type":"v1","addr":"172.21.15.78:6831","nonce":3442991267}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6828","nonce":3442991267},{"type":"v1","addr":"172.21.15.78:6829","nonce":3442991267}]},"public_addr":"172.21.15.78:6825/3442991267","cluster_addr":"172.21.15.78:6827/3442991267","heartbeat_back_addr":"172.21.15.78:6831/3442991267","heartbeat_front_addr":"172.21.15.78:6829/3442991267","state":["exists","up"]},{"osd":4,"uuid":"5c62bc66-6b34-4b7f-a66b-9a743969138c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":802983577},{"type":"v1","addr":"172.21.15.179:6809","nonce":802983577}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":802983577},{"type":"v1","addr":"172.21.15.179:6811","nonce":802983577}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":802983577},{"type":"v1","addr":"172.21.15.179:6815","nonce":802983577}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":802983577},{"type":"v1","addr":"172.21.15.179:6813","nonce":802983577}]},"public_addr":"172.21.15.179:6809/802983577","cluster_addr":"172.21.15.179:6811/802983577","heartbeat_back_addr":"172.21.15.179:6815/802983577","heartbeat_front_addr":"172.21.15.179:6813/802983577","state":["exists","up"]},{"osd":5,"uuid":"67db6d36-f684-4079-b0cd-82b4dd61461f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":518192887},{"type":"v1","addr":"172.21.15.179:6818","nonce":518192887}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":518192887},{"type":"v1","addr":"172.21.15.179:6822","nonce":518192887}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":518192887},{"type":"v1","addr":"172.21.15.179:6829","nonce":518192887}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6824","nonce":518192887},{"type":"v1","addr":"172.21.15.179:6826","nonce":518192887}]},"public_addr":"172.21.15.179:6818/518192887","cluster_addr":"172.21.15.179:6822/518192887","heartbeat_back_addr":"172.21.15.179:6829/518192887","heartbeat_front_addr":"172.21.15.179:6826/518192887","state":["exists","up"]},{"osd":6,"uuid":"12e670af-5a16-4c81-9f97-defa66cab967","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":815435378},{"type":"v1","addr":"172.21.15.179:6801","nonce":815435378}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":815435378},{"type":"v1","addr":"172.21.15.179:6803","nonce":815435378}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":815435378},{"type":"v1","addr":"172.21.15.179:6807","nonce":815435378}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":815435378},{"type":"v1","addr":"172.21.15.179:6805","nonce":815435378}]},"public_addr":"172.21.15.179:6801/815435378","cluster_addr":"172.21.15.179:6803/815435378","heartbeat_back_addr":"172.21.15.179:6807/815435378","heartbeat_front_addr":"172.21.15.179:6805/815435378","state":["exists","up"]},{"osd":7,"uuid":"fe630650-2eb3-49ad-8676-c341e6332eb1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6817","nonce":2848432339},{"type":"v1","addr":"172.21.15.179:6819","nonce":2848432339}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6821","nonce":2848432339},{"type":"v1","addr":"172.21.15.179:6823","nonce":2848432339}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":2848432339},{"type":"v1","addr":"172.21.15.179:6831","nonce":2848432339}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6825","nonce":2848432339},{"type":"v1","addr":"172.21.15.179:6827","nonce":2848432339}]},"public_addr":"172.21.15.179:6819/2848432339","cluster_addr":"172.21.15.179:6823/2848432339","heartbeat_back_addr":"172.21.15.179:6831/2848432339","heartbeat_front_addr":"172.21.15.179:6827/2848432339","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:58:49.255433+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:58:49.412880+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:58:49.559295+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:58:49.245237+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:58:49.184557+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:58:49.329851+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:58:49.366012+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:58:49.349604+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-28T20:01:24.482 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:24.477+0000 7f19a3d72640 1 -- 172.21.15.78:0/2544628440 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f1980066470 msgr2=0x7f1980068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:01:24.482 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:24.477+0000 7f19a3d72640 1 --2- 172.21.15.78:0/2544628440 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f1980066470 0x7f1980068930 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f198c0ae000 tx=0x7f198c008040 comp rx=0 tx=0).stop 2023-11-28T20:01:24.482 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:24.477+0000 7f19a3d72640 1 -- 172.21.15.78:0/2544628440 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f199c06bf30 msgr2=0x7f199c14a030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:01:24.482 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:24.477+0000 7f19a3d72640 1 --2- 172.21.15.78:0/2544628440 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f199c06bf30 0x7f199c14a030 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7f199800c4a0 tx=0x7f199800c960 comp rx=0 tx=0).stop 2023-11-28T20:01:24.483 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:24.477+0000 7f19a3d72640 1 -- 172.21.15.78:0/2544628440 shutdown_connections 2023-11-28T20:01:24.483 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:24.477+0000 7f19a3d72640 1 --2- 172.21.15.78:0/2544628440 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f1980066470 0x7f1980068930 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:24.483 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:24.477+0000 7f19a3d72640 1 --2- 172.21.15.78:0/2544628440 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f199c0af4c0 0x7f199c1f0d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:24.483 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:24.477+0000 7f19a3d72640 1 --2- 172.21.15.78:0/2544628440 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f199c154f20 0x7f199c0ae6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:24.483 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:24.477+0000 7f19a3d72640 1 --2- 172.21.15.78:0/2544628440 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f199c06bf30 0x7f199c14a030 unknown :-1 s=CLOSED pgs=682 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:24.483 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:24.477+0000 7f19a3d72640 1 -- 172.21.15.78:0/2544628440 >> 172.21.15.78:0/2544628440 conn(0x7f199c0ab9d0 msgr2=0x7f199c0733c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:01:24.483 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:24.477+0000 7f19a3d72640 1 -- 172.21.15.78:0/2544628440 shutdown_connections 2023-11-28T20:01:24.483 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:24.477+0000 7f19a3d72640 1 -- 172.21.15.78:0/2544628440 wait complete. 2023-11-28T20:01:24.501 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs2 standby_count_wanted 0 2023-11-28T20:01:24.642 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:24.637+0000 7f4c1b4bb640 1 Processor -- start 2023-11-28T20:01:24.642 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:24.637+0000 7f4c1b4bb640 1 -- start start 2023-11-28T20:01:24.644 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:24.641+0000 7f4c1b4bb640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4c140c0250 0x7f4c1406c670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:24.644 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:24.641+0000 7f4c1b4bb640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f4c1406cbb0 0x7f4c1406d140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:24.644 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:24.641+0000 7f4c1b4bb640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4c140a53c0 con 0x7f4c1414e8e0 2023-11-28T20:01:24.644 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:24.641+0000 7f4c1b4bb640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4c140a9140 con 0x7f4c1406cbb0 2023-11-28T20:01:24.644 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:24.641+0000 7f4c1b4bb640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4c1414ecc0 con 0x7f4c140c0250 2023-11-28T20:01:24.645 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:24.641+0000 7f4c1a4b9640 1 --1- >> v1:172.21.15.179:6789/0 conn(0x7f4c1414e8e0 0x7f4c14154f80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.179:6789/0 says I am v1:172.21.15.78:39390/0 (socket says 172.21.15.78:39390) 2023-11-28T20:01:24.645 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:24.641+0000 7f4c19cb8640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4c140c0250 0x7f4c1406c670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:24.645 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:24.641+0000 7f4c1a4b9640 1 -- 172.21.15.78:0/4215672789 learned_addr learned my addr 172.21.15.78:0/4215672789 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-11-28T20:01:24.645 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:24.641+0000 7f4c1acba640 1 --2- 172.21.15.78:0/4215672789 >> v2:172.21.15.179:3300/0 conn(0x7f4c1406cbb0 0x7f4c1406d140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:24.645 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:24.641+0000 7f4c19cb8640 1 -- 172.21.15.78:0/4215672789 >> v2:172.21.15.179:3300/0 conn(0x7f4c1406cbb0 msgr2=0x7f4c1406d140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:01:24.645 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:24.641+0000 7f4c19cb8640 1 --2- 172.21.15.78:0/4215672789 >> v2:172.21.15.179:3300/0 conn(0x7f4c1406cbb0 0x7f4c1406d140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:24.645 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:24.641+0000 7f4c19cb8640 1 -- 172.21.15.78:0/4215672789 >> v1:172.21.15.179:6789/0 conn(0x7f4c1414e8e0 legacy=0x7f4c14154f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:01:24.645 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:24.641+0000 7f4c19cb8640 1 -- 172.21.15.78:0/4215672789 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c140a4e20 con 0x7f4c140c0250 2023-11-28T20:01:24.646 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:24.641+0000 7f4c194b7640 1 -- 172.21.15.78:0/4215672789 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2329053836 0 0) 0x7f4c140a53c0 con 0x7f4c1414e8e0 2023-11-28T20:01:24.648 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:24.645+0000 7f4c19cb8640 1 --2- 172.21.15.78:0/4215672789 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4c140c0250 0x7f4c1406c670 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f4c040097c0 tx=0x7f4c0401c330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4abb09c850137f10 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:01:24.648 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:24.645+0000 7f4c194b7640 1 -- 172.21.15.78:0/4215672789 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c040ab600 con 0x7f4c140c0250 2023-11-28T20:01:24.649 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:24.645+0000 7f4c194b7640 1 -- 172.21.15.78:0/4215672789 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c040a7050 con 0x7f4c140c0250 2023-11-28T20:01:24.649 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:24.645+0000 7f4c194b7640 1 -- 172.21.15.78:0/4215672789 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c040ab980 con 0x7f4c140c0250 2023-11-28T20:01:24.649 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:24.645+0000 7f4c1b4bb640 1 -- 172.21.15.78:0/4215672789 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4c140c0250 msgr2=0x7f4c1406c670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:01:24.649 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:24.645+0000 7f4c1b4bb640 1 --2- 172.21.15.78:0/4215672789 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4c140c0250 0x7f4c1406c670 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f4c040097c0 tx=0x7f4c0401c330 comp rx=0 tx=0).stop 2023-11-28T20:01:24.650 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:24.645+0000 7f4c1b4bb640 1 -- 172.21.15.78:0/4215672789 shutdown_connections 2023-11-28T20:01:24.650 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:24.645+0000 7f4c1b4bb640 1 --2- 172.21.15.78:0/4215672789 >> v2:172.21.15.179:3300/0 conn(0x7f4c1406cbb0 0x7f4c1406d140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:24.650 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:24.645+0000 7f4c1b4bb640 1 --2- 172.21.15.78:0/4215672789 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4c140c0250 0x7f4c1406c670 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:24.650 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:24.645+0000 7f4c1b4bb640 1 -- 172.21.15.78:0/4215672789 >> 172.21.15.78:0/4215672789 conn(0x7f4c140c2350 msgr2=0x7f4c140c2760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:01:24.650 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:24.645+0000 7f4c1b4bb640 1 -- 172.21.15.78:0/4215672789 shutdown_connections 2023-11-28T20:01:24.650 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:24.645+0000 7f4c1b4bb640 1 -- 172.21.15.78:0/4215672789 wait complete. 2023-11-28T20:01:24.651 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:24.645+0000 7f4c1b4bb640 1 Processor -- start 2023-11-28T20:01:24.651 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:24.645+0000 7f4c1b4bb640 1 -- start start 2023-11-28T20:01:24.653 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:24.649+0000 7f4c1b4bb640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4c1406cbb0 0x7f4c141f0a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:24.653 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:24.649+0000 7f4c1b4bb640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4c140c0250 0x7f4c140a57d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:24.653 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:24.649+0000 7f4c1b4bb640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4c1414e8e0 0x7f4c141edd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:24.653 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:24.649+0000 7f4c1b4bb640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c141ed350 con 0x7f4c140c0250 2023-11-28T20:01:24.653 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:24.649+0000 7f4c1b4bb640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c141ed880 con 0x7f4c1406cbb0 2023-11-28T20:01:24.653 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:24.649+0000 7f4c1b4bb640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4c141f05c0 con 0x7f4c1414e8e0 2023-11-28T20:01:24.653 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:24.649+0000 7f4c19cb8640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4c140c0250 0x7f4c140a57d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:24.653 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:24.649+0000 7f4c19cb8640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4c140c0250 0x7f4c140a57d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:40226/0 (socket says 172.21.15.78:40226) 2023-11-28T20:01:24.654 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:24.649+0000 7f4c19cb8640 1 -- 172.21.15.78:0/2654241927 learned_addr learned my addr 172.21.15.78:0/2654241927 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T20:01:24.654 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:24.649+0000 7f4c1a4b9640 1 --2- 172.21.15.78:0/2654241927 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4c1406cbb0 0x7f4c141f0a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:24.654 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:24.649+0000 7f4c1acba640 1 --2- 172.21.15.78:0/2654241927 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4c1414e8e0 0x7f4c141edd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:24.654 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:24.649+0000 7f4c19cb8640 1 -- 172.21.15.78:0/2654241927 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4c1414e8e0 msgr2=0x7f4c141edd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:01:24.654 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:24.649+0000 7f4c19cb8640 1 --2- 172.21.15.78:0/2654241927 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4c1414e8e0 0x7f4c141edd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:24.654 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:24.649+0000 7f4c19cb8640 1 -- 172.21.15.78:0/2654241927 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4c1406cbb0 msgr2=0x7f4c141f0a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:01:24.654 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:24.649+0000 7f4c19cb8640 1 --2- 172.21.15.78:0/2654241927 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4c1406cbb0 0x7f4c141f0a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:24.654 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:24.649+0000 7f4c19cb8640 1 -- 172.21.15.78:0/2654241927 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c04009420 con 0x7f4c140c0250 2023-11-28T20:01:24.654 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:24.649+0000 7f4c1a4b9640 1 --2- 172.21.15.78:0/2654241927 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4c1406cbb0 0x7f4c141f0a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T20:01:24.654 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:24.649+0000 7f4c19cb8640 1 --2- 172.21.15.78:0/2654241927 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4c140c0250 0x7f4c140a57d0 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7f4c04019f60 tx=0x7f4c0401ab70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:01:24.654 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:24.649+0000 7f4c0affd640 1 -- 172.21.15.78:0/2654241927 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c040b7450 con 0x7f4c140c0250 2023-11-28T20:01:24.655 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:24.649+0000 7f4c0affd640 1 -- 172.21.15.78:0/2654241927 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c040b75b0 con 0x7f4c140c0250 2023-11-28T20:01:24.655 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:24.649+0000 7f4c0affd640 1 -- 172.21.15.78:0/2654241927 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c040b7960 con 0x7f4c140c0250 2023-11-28T20:01:24.655 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:24.649+0000 7f4c1b4bb640 1 -- 172.21.15.78:0/2654241927 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4c140a5ff0 con 0x7f4c140c0250 2023-11-28T20:01:24.656 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:24.649+0000 7f4c1b4bb640 1 -- 172.21.15.78:0/2654241927 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4c141eff70 con 0x7f4c140c0250 2023-11-28T20:01:24.656 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:24.649+0000 7f4c1b4bb640 1 -- 172.21.15.78:0/2654241927 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4c141f0750 con 0x7f4c140c0250 2023-11-28T20:01:24.656 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:24.649+0000 7f4c0affd640 1 -- 172.21.15.78:0/2654241927 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f4c040b7ac0 con 0x7f4c140c0250 2023-11-28T20:01:24.656 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:24.653+0000 7f4c0affd640 1 --2- 172.21.15.78:0/2654241927 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f4bf80664a0 0x7f4bf8068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:24.656 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:24.653+0000 7f4c0affd640 1 -- 172.21.15.78:0/2654241927 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 6885+0+0 (secure 0 0 0) 0x7f4c0411e900 con 0x7f4c140c0250 2023-11-28T20:01:24.656 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:24.653+0000 7f4c1a4b9640 1 --2- 172.21.15.78:0/2654241927 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f4bf80664a0 0x7f4bf8068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:24.657 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:24.653+0000 7f4c1a4b9640 1 --2- 172.21.15.78:0/2654241927 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f4bf80664a0 0x7f4bf8068960 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f4c10007fd0 tx=0x7f4c10007c20 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:01:24.660 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:24.657+0000 7f4c0affd640 1 -- 172.21.15.78:0/2654241927 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f4c040eb970 con 0x7f4c140c0250 2023-11-28T20:01:24.842 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:24.837+0000 7f4c1b4bb640 1 -- 172.21.15.78:0/2654241927 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs2", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f4c140674b0 con 0x7f4c140c0250 2023-11-28T20:01:25.478 INFO:tasks.ceph.mds.c.smithi078.stderr:2023-11-28T20:01:25.473+0000 7f23f8d0e640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-11-28T20:01:25.825 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:25.821+0000 7f4c0affd640 1 -- 172.21.15.78:0/2654241927 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs2", "var": "standby_count_wanted", "val": "0"}]=0 v35) v1 ==== 119+0+0 (secure 0 0 0) 0x7f4c040bb0b0 con 0x7f4c140c0250 2023-11-28T20:01:25.827 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:25.821+0000 7f4c1b4bb640 1 -- 172.21.15.78:0/2654241927 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f4bf80664a0 msgr2=0x7f4bf8068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:01:25.828 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:25.821+0000 7f4c1b4bb640 1 --2- 172.21.15.78:0/2654241927 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f4bf80664a0 0x7f4bf8068960 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f4c10007fd0 tx=0x7f4c10007c20 comp rx=0 tx=0).stop 2023-11-28T20:01:25.828 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:25.821+0000 7f4c1b4bb640 1 -- 172.21.15.78:0/2654241927 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4c140c0250 msgr2=0x7f4c140a57d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:01:25.828 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:25.821+0000 7f4c1b4bb640 1 --2- 172.21.15.78:0/2654241927 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4c140c0250 0x7f4c140a57d0 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7f4c04019f60 tx=0x7f4c0401ab70 comp rx=0 tx=0).stop 2023-11-28T20:01:25.829 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:25.821+0000 7f4c1b4bb640 1 -- 172.21.15.78:0/2654241927 shutdown_connections 2023-11-28T20:01:25.829 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:25.825+0000 7f4c1b4bb640 1 --2- 172.21.15.78:0/2654241927 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f4bf80664a0 0x7f4bf8068960 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:25.829 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:25.825+0000 7f4c1b4bb640 1 --2- 172.21.15.78:0/2654241927 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4c1414e8e0 0x7f4c141edd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:25.829 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:25.825+0000 7f4c1b4bb640 1 --2- 172.21.15.78:0/2654241927 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4c140c0250 0x7f4c140a57d0 unknown :-1 s=CLOSED pgs=683 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:25.830 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:25.825+0000 7f4c1b4bb640 1 --2- 172.21.15.78:0/2654241927 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4c1406cbb0 0x7f4c141f0a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:25.830 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:25.825+0000 7f4c1b4bb640 1 -- 172.21.15.78:0/2654241927 >> 172.21.15.78:0/2654241927 conn(0x7f4c140c2350 msgr2=0x7f4c1414d9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:01:25.830 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:25.825+0000 7f4c1b4bb640 1 -- 172.21.15.78:0/2654241927 shutdown_connections 2023-11-28T20:01:25.830 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:25.825+0000 7f4c1b4bb640 1 -- 172.21.15.78:0/2654241927 wait complete. 2023-11-28T20:01:25.849 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-11-28T20:01:25.849 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs2 allow_standby_replay false 2023-11-28T20:01:25.992 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:25.989+0000 7fbd1102f640 1 Processor -- start 2023-11-28T20:01:25.992 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:25.989+0000 7fbd1102f640 1 -- start start 2023-11-28T20:01:25.993 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:25.989+0000 7fbd1102f640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fbd0c14f8f0 0x7fbd0c0aac10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:25.993 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:25.989+0000 7fbd1102f640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbd0c06d990 0x7fbd0c0c3b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:25.993 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:25.989+0000 7fbd1102f640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbd0c1525e0 con 0x7fbd0c1520e0 2023-11-28T20:01:25.993 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:25.989+0000 7fbd1102f640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbd0c1528c0 con 0x7fbd0c14f8f0 2023-11-28T20:01:25.993 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:25.989+0000 7fbd1102f640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd0c152ba0 con 0x7fbd0c06d990 2023-11-28T20:01:25.994 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:25.989+0000 7fbd0bfff640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fbd0c14f8f0 0x7fbd0c0aac10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:25.994 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:25.989+0000 7fbd0b7fe640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbd0c06d990 0x7fbd0c0c3b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:25.994 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:25.989+0000 7fbd1082e640 1 --1- >> v1:172.21.15.179:6789/0 conn(0x7fbd0c1520e0 0x7fbd0c0c4070 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.179:6789/0 says I am v1:172.21.15.78:48358/0 (socket says 172.21.15.78:48358) 2023-11-28T20:01:25.994 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:25.989+0000 7fbd1082e640 1 -- 172.21.15.78:0/326115455 learned_addr learned my addr 172.21.15.78:0/326115455 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-11-28T20:01:25.995 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:25.989+0000 7fbd0bfff640 1 --2- 172.21.15.78:0/326115455 >> v2:172.21.15.179:3300/0 conn(0x7fbd0c14f8f0 0x7fbd0c0aac10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.78:39476/0 (socket says 172.21.15.78:39476) 2023-11-28T20:01:25.995 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:25.989+0000 7fbd0b7fe640 1 -- 172.21.15.78:0/326115455 >> v2:172.21.15.179:3300/0 conn(0x7fbd0c14f8f0 msgr2=0x7fbd0c0aac10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:01:25.995 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:25.989+0000 7fbd0b7fe640 1 --2- 172.21.15.78:0/326115455 >> v2:172.21.15.179:3300/0 conn(0x7fbd0c14f8f0 0x7fbd0c0aac10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:25.995 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:25.989+0000 7fbd0b7fe640 1 -- 172.21.15.78:0/326115455 >> v1:172.21.15.179:6789/0 conn(0x7fbd0c1520e0 legacy=0x7fbd0c0c4070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:01:25.995 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:25.989+0000 7fbd0b7fe640 1 -- 172.21.15.78:0/326115455 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd0c152e80 con 0x7fbd0c06d990 2023-11-28T20:01:25.995 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:25.989+0000 7fbd0bfff640 1 --2- 172.21.15.78:0/326115455 >> v2:172.21.15.179:3300/0 conn(0x7fbd0c14f8f0 0x7fbd0c0aac10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T20:01:25.997 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:25.993+0000 7fbd0b7fe640 1 --2- 172.21.15.78:0/326115455 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbd0c06d990 0x7fbd0c0c3b30 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fbd000097c0 tx=0x7fbd0001ec70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d89e3d4e1720113b server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:01:25.997 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:25.993+0000 7fbd0affd640 1 -- 172.21.15.78:0/326115455 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd000a8970 con 0x7fbd0c06d990 2023-11-28T20:01:25.997 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:25.993+0000 7fbd0affd640 1 -- 172.21.15.78:0/326115455 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd000a8ad0 con 0x7fbd0c06d990 2023-11-28T20:01:25.997 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:25.993+0000 7fbd0affd640 1 -- 172.21.15.78:0/326115455 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd000a8e60 con 0x7fbd0c06d990 2023-11-28T20:01:25.998 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:25.993+0000 7fbd1102f640 1 -- 172.21.15.78:0/326115455 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbd0c06d990 msgr2=0x7fbd0c0c3b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:01:25.998 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:25.993+0000 7fbd1102f640 1 --2- 172.21.15.78:0/326115455 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbd0c06d990 0x7fbd0c0c3b30 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fbd000097c0 tx=0x7fbd0001ec70 comp rx=0 tx=0).stop 2023-11-28T20:01:25.998 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:25.993+0000 7fbd1102f640 1 -- 172.21.15.78:0/326115455 shutdown_connections 2023-11-28T20:01:25.998 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:25.993+0000 7fbd1102f640 1 --2- 172.21.15.78:0/326115455 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbd0c06d990 0x7fbd0c0c3b30 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:25.999 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:25.993+0000 7fbd1102f640 1 --2- 172.21.15.78:0/326115455 >> v2:172.21.15.179:3300/0 conn(0x7fbd0c14f8f0 0x7fbd0c0aac10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:25.999 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:25.993+0000 7fbd1102f640 1 -- 172.21.15.78:0/326115455 >> 172.21.15.78:0/326115455 conn(0x7fbd0c0c2350 msgr2=0x7fbd0c0c2760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:01:25.999 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:25.993+0000 7fbd1102f640 1 -- 172.21.15.78:0/326115455 shutdown_connections 2023-11-28T20:01:25.999 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:25.993+0000 7fbd1102f640 1 -- 172.21.15.78:0/326115455 wait complete. 2023-11-28T20:01:25.999 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:25.997+0000 7fbd1102f640 1 Processor -- start 2023-11-28T20:01:26.000 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:25.997+0000 7fbd1102f640 1 -- start start 2023-11-28T20:01:26.001 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:25.997+0000 7fbd1102f640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbd0c06d990 0x7fbd0c0a6ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:26.001 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:25.997+0000 7fbd1102f640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbd0c14f8f0 0x7fbd0c14ac50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:26.002 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:25.997+0000 7fbd1102f640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbd0c1520e0 0x7fbd0c14b190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:26.002 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:25.997+0000 7fbd1102f640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd0c155e30 con 0x7fbd0c14f8f0 2023-11-28T20:01:26.002 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:25.997+0000 7fbd1102f640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd0c155990 con 0x7fbd0c06d990 2023-11-28T20:01:26.002 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:25.997+0000 7fbd1102f640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd0c156080 con 0x7fbd0c1520e0 2023-11-28T20:01:26.002 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:25.997+0000 7fbd0b7fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbd0c14f8f0 0x7fbd0c14ac50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:26.002 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:25.997+0000 7fbd0b7fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbd0c14f8f0 0x7fbd0c14ac50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:36132/0 (socket says 172.21.15.78:36132) 2023-11-28T20:01:26.003 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:25.997+0000 7fbd0b7fe640 1 -- 172.21.15.78:0/4235327633 learned_addr learned my addr 172.21.15.78:0/4235327633 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T20:01:26.003 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:25.997+0000 7fbd1082e640 1 --2- 172.21.15.78:0/4235327633 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbd0c1520e0 0x7fbd0c14b190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:26.003 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:25.997+0000 7fbd0bfff640 1 --2- 172.21.15.78:0/4235327633 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbd0c06d990 0x7fbd0c0a6ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:26.003 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:25.997+0000 7fbd0b7fe640 1 -- 172.21.15.78:0/4235327633 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbd0c1520e0 msgr2=0x7fbd0c14b190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:01:26.003 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:25.997+0000 7fbd0b7fe640 1 --2- 172.21.15.78:0/4235327633 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbd0c1520e0 0x7fbd0c14b190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:26.003 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:25.997+0000 7fbd0b7fe640 1 -- 172.21.15.78:0/4235327633 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbd0c06d990 msgr2=0x7fbd0c0a6ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:01:26.003 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:25.997+0000 7fbd0b7fe640 1 --2- 172.21.15.78:0/4235327633 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbd0c06d990 0x7fbd0c0a6ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:26.003 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:25.997+0000 7fbd0b7fe640 1 -- 172.21.15.78:0/4235327633 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbcfc009420 con 0x7fbd0c14f8f0 2023-11-28T20:01:26.004 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:25.997+0000 7fbd0b7fe640 1 --2- 172.21.15.78:0/4235327633 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbd0c14f8f0 0x7fbd0c14ac50 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7fbd000b3040 tx=0x7fbd0001ba10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:01:26.004 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:25.997+0000 7fbd08ff9640 1 -- 172.21.15.78:0/4235327633 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd000b9630 con 0x7fbd0c14f8f0 2023-11-28T20:01:26.005 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:25.997+0000 7fbd08ff9640 1 -- 172.21.15.78:0/4235327633 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd000b97b0 con 0x7fbd0c14f8f0 2023-11-28T20:01:26.005 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:25.997+0000 7fbd1102f640 1 -- 172.21.15.78:0/4235327633 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbd00009420 con 0x7fbd0c14f8f0 2023-11-28T20:01:26.005 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:25.997+0000 7fbd08ff9640 1 -- 172.21.15.78:0/4235327633 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd000b9b60 con 0x7fbd0c14f8f0 2023-11-28T20:01:26.005 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:25.997+0000 7fbd1102f640 1 -- 172.21.15.78:0/4235327633 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbd0c155190 con 0x7fbd0c14f8f0 2023-11-28T20:01:26.005 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:25.997+0000 7fbd1102f640 1 -- 172.21.15.78:0/4235327633 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbd0c0674b0 con 0x7fbd0c14f8f0 2023-11-28T20:01:26.005 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:26.001+0000 7fbd08ff9640 1 -- 172.21.15.78:0/4235327633 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fbd000b7040 con 0x7fbd0c14f8f0 2023-11-28T20:01:26.006 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:26.001+0000 7fbd08ff9640 1 --2- 172.21.15.78:0/4235327633 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fbcf8066470 0x7fbcf8068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:26.006 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:26.001+0000 7fbd08ff9640 1 -- 172.21.15.78:0/4235327633 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 6885+0+0 (secure 0 0 0) 0x7fbd00122250 con 0x7fbd0c14f8f0 2023-11-28T20:01:26.006 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:26.001+0000 7fbd0bfff640 1 --2- 172.21.15.78:0/4235327633 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fbcf8066470 0x7fbcf8068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:26.006 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:26.001+0000 7fbd0bfff640 1 --2- 172.21.15.78:0/4235327633 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fbcf8066470 0x7fbcf8068930 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7fbcfc009be0 tx=0x7fbcfc008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:01:26.009 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:26.005+0000 7fbd08ff9640 1 -- 172.21.15.78:0/4235327633 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fbd000ef340 con 0x7fbd0c14f8f0 2023-11-28T20:01:26.193 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:26.189+0000 7fbd1102f640 1 -- 172.21.15.78:0/4235327633 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs2", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7fbd0c0c5150 con 0x7fbd0c14f8f0 2023-11-28T20:01:26.832 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:26.829+0000 7fbd08ff9640 1 -- 172.21.15.78:0/4235327633 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs2", "var": "allow_standby_replay", "val": "false"}]=0 v36) v1 ==== 123+0+0 (secure 0 0 0) 0x7fbd000f2960 con 0x7fbd0c14f8f0 2023-11-28T20:01:26.836 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:26.829+0000 7fbd1102f640 1 -- 172.21.15.78:0/4235327633 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fbcf8066470 msgr2=0x7fbcf8068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:01:26.836 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:26.829+0000 7fbd1102f640 1 --2- 172.21.15.78:0/4235327633 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fbcf8066470 0x7fbcf8068930 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7fbcfc009be0 tx=0x7fbcfc008040 comp rx=0 tx=0).stop 2023-11-28T20:01:26.836 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:26.829+0000 7fbd1102f640 1 -- 172.21.15.78:0/4235327633 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbd0c14f8f0 msgr2=0x7fbd0c14ac50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:01:26.838 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:26.829+0000 7fbd1102f640 1 --2- 172.21.15.78:0/4235327633 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbd0c14f8f0 0x7fbd0c14ac50 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7fbd000b3040 tx=0x7fbd0001ba10 comp rx=0 tx=0).stop 2023-11-28T20:01:26.838 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:26.829+0000 7fbd1102f640 1 -- 172.21.15.78:0/4235327633 shutdown_connections 2023-11-28T20:01:26.838 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:26.829+0000 7fbd1102f640 1 --2- 172.21.15.78:0/4235327633 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fbcf8066470 0x7fbcf8068930 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:26.838 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:26.829+0000 7fbd1102f640 1 --2- 172.21.15.78:0/4235327633 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbd0c1520e0 0x7fbd0c14b190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:26.838 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:26.829+0000 7fbd1102f640 1 --2- 172.21.15.78:0/4235327633 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbd0c14f8f0 0x7fbd0c14ac50 unknown :-1 s=CLOSED pgs=684 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:26.838 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:26.829+0000 7fbd1102f640 1 --2- 172.21.15.78:0/4235327633 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbd0c06d990 0x7fbd0c0a6ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:26.838 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:26.829+0000 7fbd1102f640 1 -- 172.21.15.78:0/4235327633 >> 172.21.15.78:0/4235327633 conn(0x7fbd0c0c2350 msgr2=0x7fbd0c150f50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:01:26.838 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:26.829+0000 7fbd1102f640 1 -- 172.21.15.78:0/4235327633 shutdown_connections 2023-11-28T20:01:26.838 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:26.829+0000 7fbd1102f640 1 -- 172.21.15.78:0/4235327633 wait complete. 2023-11-28T20:01:26.856 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs2' 2023-11-28T20:01:26.856 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-28T20:01:26.999 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:26.993+0000 7f74a1032640 1 Processor -- start 2023-11-28T20:01:27.000 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:26.993+0000 7f74a1032640 1 -- start start 2023-11-28T20:01:27.000 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:26.993+0000 7f74a1032640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f749c06d2b0 0x7f749c06d690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:27.000 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:26.993+0000 7f74a1032640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f749c0c3b80 0x7f749c0c5300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:27.000 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:26.993+0000 7f74a1032640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f749c06c020 0x7f749c06c4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:27.000 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:26.993+0000 7f74a1032640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f749c0c5840 con 0x7f749c06c020 2023-11-28T20:01:27.000 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:26.993+0000 7f74a1032640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f749c06bb80 con 0x7f749c0c3b80 2023-11-28T20:01:27.000 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:26.993+0000 7f74a1032640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f749c1515c0 con 0x7f749c06d2b0 2023-11-28T20:01:27.000 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:26.993+0000 7f749b59e640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f749c06c020 0x7f749c06c4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:27.000 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:26.993+0000 7f749b59e640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f749c06c020 0x7f749c06c4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:36138/0 (socket says 172.21.15.78:36138) 2023-11-28T20:01:27.000 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:26.993+0000 7f749b59e640 1 -- 172.21.15.78:0/1944077616 learned_addr learned my addr 172.21.15.78:0/1944077616 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T20:01:27.000 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:26.993+0000 7f749ad9d640 1 --2- 172.21.15.78:0/1944077616 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f749c06d2b0 0x7f749c06d690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:27.000 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:26.993+0000 7f749a59c640 1 --2- 172.21.15.78:0/1944077616 >> v2:172.21.15.179:3300/0 conn(0x7f749c0c3b80 0x7f749c0c5300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:27.001 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:26.993+0000 7f749b59e640 1 -- 172.21.15.78:0/1944077616 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f749c06d2b0 msgr2=0x7f749c06d690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:01:27.001 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:26.993+0000 7f749b59e640 1 --2- 172.21.15.78:0/1944077616 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f749c06d2b0 0x7f749c06d690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:27.001 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:26.993+0000 7f749b59e640 1 -- 172.21.15.78:0/1944077616 >> v2:172.21.15.179:3300/0 conn(0x7f749c0c3b80 msgr2=0x7f749c0c5300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:01:27.001 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:26.993+0000 7f749b59e640 1 --2- 172.21.15.78:0/1944077616 >> v2:172.21.15.179:3300/0 conn(0x7f749c0c3b80 0x7f749c0c5300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:27.001 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:26.993+0000 7f749b59e640 1 -- 172.21.15.78:0/1944077616 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f749c1518a0 con 0x7f749c06c020 2023-11-28T20:01:27.002 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:26.997+0000 7f749b59e640 1 --2- 172.21.15.78:0/1944077616 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f749c06c020 0x7f749c06c4b0 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7f749c0c59c0 tx=0x7f749401c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b7f5b6ae6984e3d4 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:01:27.002 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:26.997+0000 7f7499d9b640 1 -- 172.21.15.78:0/1944077616 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74940ac600 con 0x7f749c06c020 2023-11-28T20:01:27.002 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:26.997+0000 7f7499d9b640 1 -- 172.21.15.78:0/1944077616 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f74940a8050 con 0x7f749c06c020 2023-11-28T20:01:27.002 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:26.997+0000 7f7499d9b640 1 -- 172.21.15.78:0/1944077616 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74940ac980 con 0x7f749c06c020 2023-11-28T20:01:27.002 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:26.997+0000 7f74a1032640 1 -- 172.21.15.78:0/1944077616 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f749c06c020 msgr2=0x7f749c06c4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:01:27.003 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:26.997+0000 7f74a1032640 1 --2- 172.21.15.78:0/1944077616 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f749c06c020 0x7f749c06c4b0 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7f749c0c59c0 tx=0x7f749401c4d0 comp rx=0 tx=0).stop 2023-11-28T20:01:27.003 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:26.997+0000 7f74a1032640 1 -- 172.21.15.78:0/1944077616 shutdown_connections 2023-11-28T20:01:27.003 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:26.997+0000 7f74a1032640 1 --2- 172.21.15.78:0/1944077616 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f749c06c020 0x7f749c06c4b0 unknown :-1 s=CLOSED pgs=685 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:27.003 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:26.997+0000 7f74a1032640 1 --2- 172.21.15.78:0/1944077616 >> v2:172.21.15.179:3300/0 conn(0x7f749c0c3b80 0x7f749c0c5300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:27.003 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:26.997+0000 7f74a1032640 1 --2- 172.21.15.78:0/1944077616 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f749c06d2b0 0x7f749c06d690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:27.003 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:26.997+0000 7f74a1032640 1 -- 172.21.15.78:0/1944077616 >> 172.21.15.78:0/1944077616 conn(0x7f749c0a7810 msgr2=0x7f749c0a7c20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:01:27.003 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:26.997+0000 7f74a1032640 1 -- 172.21.15.78:0/1944077616 shutdown_connections 2023-11-28T20:01:27.003 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:26.997+0000 7f74a1032640 1 -- 172.21.15.78:0/1944077616 wait complete. 2023-11-28T20:01:27.004 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:27.001+0000 7f74a1032640 1 Processor -- start 2023-11-28T20:01:27.004 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:27.001+0000 7f74a1032640 1 -- start start 2023-11-28T20:01:27.006 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:27.001+0000 7f74a1032640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f749c06c020 0x7f749c155eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:27.006 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:27.001+0000 7f74a1032640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f749c06d2b0 0x7f749c14f580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:27.006 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:27.001+0000 7f74a1032640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f749c0c3b80 0x7f749c159c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:27.006 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:27.001+0000 7f74a1032640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f749c150080 con 0x7f749c06d2b0 2023-11-28T20:01:27.006 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:27.001+0000 7f74a1032640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f749c1eb990 con 0x7f749c0c3b80 2023-11-28T20:01:27.006 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:27.001+0000 7f74a1032640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f749c1ebec0 con 0x7f749c06c020 2023-11-28T20:01:27.006 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:27.001+0000 7f749a59c640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f749c06d2b0 0x7f749c14f580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:27.006 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:27.001+0000 7f749a59c640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f749c06d2b0 0x7f749c14f580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:36152/0 (socket says 172.21.15.78:36152) 2023-11-28T20:01:27.006 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:27.001+0000 7f749a59c640 1 -- 172.21.15.78:0/2454608421 learned_addr learned my addr 172.21.15.78:0/2454608421 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T20:01:27.006 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:27.001+0000 7f749b59e640 1 --2- 172.21.15.78:0/2454608421 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f749c0c3b80 0x7f749c159c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:27.007 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:27.001+0000 7f749ad9d640 1 --2- 172.21.15.78:0/2454608421 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f749c06c020 0x7f749c155eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:27.007 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:27.001+0000 7f749a59c640 1 -- 172.21.15.78:0/2454608421 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f749c06c020 msgr2=0x7f749c155eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:01:27.007 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:27.001+0000 7f749a59c640 1 --2- 172.21.15.78:0/2454608421 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f749c06c020 0x7f749c155eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:27.007 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:27.001+0000 7f749a59c640 1 -- 172.21.15.78:0/2454608421 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f749c0c3b80 msgr2=0x7f749c159c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:01:27.007 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:27.001+0000 7f749a59c640 1 --2- 172.21.15.78:0/2454608421 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f749c0c3b80 0x7f749c159c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:27.007 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:27.001+0000 7f749a59c640 1 -- 172.21.15.78:0/2454608421 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74940094d0 con 0x7f749c06d2b0 2023-11-28T20:01:27.007 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:27.001+0000 7f749a59c640 1 --2- 172.21.15.78:0/2454608421 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f749c06d2b0 0x7f749c14f580 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7f749000d620 tx=0x7f749000dae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:01:27.008 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:27.001+0000 7f74837fe640 1 -- 172.21.15.78:0/2454608421 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f749000b620 con 0x7f749c06d2b0 2023-11-28T20:01:27.008 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:27.001+0000 7f74837fe640 1 -- 172.21.15.78:0/2454608421 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f749000b780 con 0x7f749c06d2b0 2023-11-28T20:01:27.008 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:27.001+0000 7f74837fe640 1 -- 172.21.15.78:0/2454608421 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f749000bb10 con 0x7f749c06d2b0 2023-11-28T20:01:27.008 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:27.001+0000 7f74a1032640 1 -- 172.21.15.78:0/2454608421 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f749c14ef80 con 0x7f749c06d2b0 2023-11-28T20:01:27.008 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:27.001+0000 7f74a1032640 1 -- 172.21.15.78:0/2454608421 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f749c150390 con 0x7f749c06d2b0 2023-11-28T20:01:27.009 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:27.005+0000 7f74a1032640 1 -- 172.21.15.78:0/2454608421 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f749c067630 con 0x7f749c06d2b0 2023-11-28T20:01:27.009 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:27.005+0000 7f74837fe640 1 -- 172.21.15.78:0/2454608421 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f749000bc70 con 0x7f749c06d2b0 2023-11-28T20:01:27.009 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:27.005+0000 7f74837fe640 1 --2- 172.21.15.78:0/2454608421 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f7488066470 0x7f7488068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:27.009 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:27.005+0000 7f74837fe640 1 -- 172.21.15.78:0/2454608421 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 6885+0+0 (secure 0 0 0) 0x7f74900846c0 con 0x7f749c06d2b0 2023-11-28T20:01:27.009 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:27.005+0000 7f749ad9d640 1 --2- 172.21.15.78:0/2454608421 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f7488066470 0x7f7488068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:27.010 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:27.005+0000 7f749ad9d640 1 --2- 172.21.15.78:0/2454608421 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f7488066470 0x7f7488068930 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f748c003b90 tx=0x7f748c0098d0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:01:27.013 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:27.009+0000 7f74837fe640 1 -- 172.21.15.78:0/2454608421 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f7490051740 con 0x7f749c06d2b0 2023-11-28T20:01:27.196 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:27.193+0000 7f74a1032640 1 -- 172.21.15.78:0/2454608421 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f749c06bd70 con 0x7f749c06d2b0 2023-11-28T20:01:27.197 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:27.193+0000 7f74837fe640 1 -- 172.21.15.78:0/2454608421 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 36 v36) v1 ==== 94+0+6130 (secure 0 0 0) 0x7f7490007380 con 0x7f749c06d2b0 2023-11-28T20:01:27.198 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-11-28T20:01:27.198 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":36,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5384,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6834/837155031","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6832","nonce":837155031},{"type":"v1","addr":"172.21.15.179:6834","nonce":837155031}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":27},{"gid":5387,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6835/752467462","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6833","nonce":752467462},{"type":"v1","addr":"172.21.15.179:6835","nonce":752467462}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":27}],"filesystems":[{"mdsmap":{"epoch":31,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-28T20:01:09.868520+0000","modified":"2023-11-28T20:01:12.907972+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5892},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5892":{"gid":5892,"name":"a","rank":0,"incarnation":28,"state":"up:active","state_seq":3,"addr":"172.21.15.78:6837/115607035","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6836","nonce":115607035},{"type":"v1","addr":"172.21.15.78:6837","nonce":115607035}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":4},{"mdsmap":{"epoch":36,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-28T20:01:23.178057+0000","modified":"2023-11-28T20:01:26.193482+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5889},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5889":{"gid":5889,"name":"c","rank":0,"incarnation":32,"state":"up:active","state_seq":6,"addr":"172.21.15.78:6835/1997036463","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6834","nonce":1997036463},{"type":"v1","addr":"172.21.15.78:6835","nonce":1997036463}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs2","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":5}]} 2023-11-28T20:01:27.202 INFO:teuthology.orchestra.run.smithi078.stderr:dumped fsmap epoch 36 2023-11-28T20:01:27.203 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:27.193+0000 7f74a1032640 1 -- 172.21.15.78:0/2454608421 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f7488066470 msgr2=0x7f7488068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:01:27.203 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:27.193+0000 7f74a1032640 1 --2- 172.21.15.78:0/2454608421 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f7488066470 0x7f7488068930 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f748c003b90 tx=0x7f748c0098d0 comp rx=0 tx=0).stop 2023-11-28T20:01:27.203 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:27.193+0000 7f74a1032640 1 -- 172.21.15.78:0/2454608421 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f749c06d2b0 msgr2=0x7f749c14f580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:01:27.203 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:27.193+0000 7f74a1032640 1 --2- 172.21.15.78:0/2454608421 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f749c06d2b0 0x7f749c14f580 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7f749000d620 tx=0x7f749000dae0 comp rx=0 tx=0).stop 2023-11-28T20:01:27.204 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:27.193+0000 7f74a1032640 1 -- 172.21.15.78:0/2454608421 shutdown_connections 2023-11-28T20:01:27.204 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:27.193+0000 7f74a1032640 1 --2- 172.21.15.78:0/2454608421 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f7488066470 0x7f7488068930 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:27.204 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:27.193+0000 7f74a1032640 1 --2- 172.21.15.78:0/2454608421 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f749c0c3b80 0x7f749c159c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:27.204 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:27.193+0000 7f74a1032640 1 --2- 172.21.15.78:0/2454608421 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f749c06d2b0 0x7f749c14f580 unknown :-1 s=CLOSED pgs=686 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:27.204 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:27.193+0000 7f74a1032640 1 --2- 172.21.15.78:0/2454608421 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f749c06c020 0x7f749c155eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:27.204 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:27.193+0000 7f74a1032640 1 -- 172.21.15.78:0/2454608421 >> 172.21.15.78:0/2454608421 conn(0x7f749c0a7810 msgr2=0x7f749c0aaae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:01:27.205 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:27.193+0000 7f74a1032640 1 -- 172.21.15.78:0/2454608421 shutdown_connections 2023-11-28T20:01:27.205 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:27.193+0000 7f74a1032640 1 -- 172.21.15.78:0/2454608421 wait complete. 2023-11-28T20:01:27.220 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-28T20:01:27.357 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:27.353+0000 7fb70d45a640 1 Processor -- start 2023-11-28T20:01:27.357 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:27.353+0000 7fb70d45a640 1 -- start start 2023-11-28T20:01:27.360 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:27.353+0000 7fb70d45a640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fb7080af4c0 0x7fb708154f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:27.360 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:27.353+0000 7fb70d45a640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fb70806c100 0x7fb7080c6c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:27.360 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:27.353+0000 7fb70d45a640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb7080c4890 con 0x7fb7080c67d0 2023-11-28T20:01:27.360 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:27.353+0000 7fb70d45a640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb708155460 con 0x7fb70806c100 2023-11-28T20:01:27.360 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:27.353+0000 7fb70d45a640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb7080af8a0 con 0x7fb7080af4c0 2023-11-28T20:01:27.361 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:27.353+0000 7fb7077fe640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fb70806c100 0x7fb7080c6c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:27.361 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:27.353+0000 7fb6fe7fc640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7fb7080c67d0 0x7fb70806b9f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:37162/0 (socket says 172.21.15.78:37162) 2023-11-28T20:01:27.361 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:27.353+0000 7fb6fe7fc640 1 -- 172.21.15.78:0/798737375 learned_addr learned my addr 172.21.15.78:0/798737375 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-11-28T20:01:27.361 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:27.353+0000 7fb706ffd640 1 --2- 172.21.15.78:0/798737375 >> v2:172.21.15.179:3300/0 conn(0x7fb7080af4c0 0x7fb708154f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:27.361 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:27.353+0000 7fb7077fe640 1 -- 172.21.15.78:0/798737375 >> v2:172.21.15.179:3300/0 conn(0x7fb7080af4c0 msgr2=0x7fb708154f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:01:27.361 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:27.353+0000 7fb7077fe640 1 --2- 172.21.15.78:0/798737375 >> v2:172.21.15.179:3300/0 conn(0x7fb7080af4c0 0x7fb708154f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:27.362 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:27.353+0000 7fb7077fe640 1 -- 172.21.15.78:0/798737375 >> v1:172.21.15.78:6789/0 conn(0x7fb7080c67d0 legacy=0x7fb70806b9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:01:27.362 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:27.353+0000 7fb7077fe640 1 -- 172.21.15.78:0/798737375 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7080c4b30 con 0x7fb70806c100 2023-11-28T20:01:27.362 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:27.353+0000 7fb706ffd640 1 --2- 172.21.15.78:0/798737375 >> v2:172.21.15.179:3300/0 conn(0x7fb7080af4c0 0x7fb708154f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T20:01:27.362 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:27.353+0000 7fb7067fc640 1 -- 172.21.15.78:0/798737375 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1607427466 0 0) 0x7fb7080c4890 con 0x7fb7080c67d0 2023-11-28T20:01:27.363 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:27.357+0000 7fb7077fe640 1 --2- 172.21.15.78:0/798737375 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb70806c100 0x7fb7080c6c80 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7fb7080a9790 tx=0x7fb70001c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ea3752d9836701c1 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:01:27.363 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:27.357+0000 7fb7067fc640 1 -- 172.21.15.78:0/798737375 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7000a5910 con 0x7fb70806c100 2023-11-28T20:01:27.363 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:27.357+0000 7fb7067fc640 1 -- 172.21.15.78:0/798737375 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb7000a5a70 con 0x7fb70806c100 2023-11-28T20:01:27.364 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:27.357+0000 7fb7067fc640 1 -- 172.21.15.78:0/798737375 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7000a5e00 con 0x7fb70806c100 2023-11-28T20:01:27.364 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:27.357+0000 7fb70d45a640 1 -- 172.21.15.78:0/798737375 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb70806c100 msgr2=0x7fb7080c6c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:01:27.364 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:27.357+0000 7fb70d45a640 1 --2- 172.21.15.78:0/798737375 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb70806c100 0x7fb7080c6c80 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7fb7080a9790 tx=0x7fb70001c850 comp rx=0 tx=0).stop 2023-11-28T20:01:27.364 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:27.357+0000 7fb70d45a640 1 -- 172.21.15.78:0/798737375 shutdown_connections 2023-11-28T20:01:27.364 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:27.357+0000 7fb70d45a640 1 --2- 172.21.15.78:0/798737375 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb70806c100 0x7fb7080c6c80 unknown :-1 s=CLOSED pgs=688 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:27.364 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:27.357+0000 7fb70d45a640 1 --2- 172.21.15.78:0/798737375 >> v2:172.21.15.179:3300/0 conn(0x7fb7080af4c0 0x7fb708154f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:27.364 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:27.357+0000 7fb70d45a640 1 -- 172.21.15.78:0/798737375 >> 172.21.15.78:0/798737375 conn(0x7fb7080ab9d0 msgr2=0x7fb7080abde0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:01:27.364 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:27.357+0000 7fb70d45a640 1 -- 172.21.15.78:0/798737375 shutdown_connections 2023-11-28T20:01:27.364 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:27.357+0000 7fb70d45a640 1 -- 172.21.15.78:0/798737375 wait complete. 2023-11-28T20:01:27.365 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:27.361+0000 7fb70d45a640 1 Processor -- start 2023-11-28T20:01:27.365 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:27.361+0000 7fb70d45a640 1 -- start start 2023-11-28T20:01:27.367 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:27.361+0000 7fb70d45a640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb70806c100 0x7fb7081ed300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:27.367 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:27.361+0000 7fb70d45a640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb7080af4c0 0x7fb7081511f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:27.367 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:27.361+0000 7fb70d45a640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb7080c67d0 0x7fb70814f140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:27.367 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:27.361+0000 7fb70d45a640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7081ed840 con 0x7fb7080af4c0 2023-11-28T20:01:27.367 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:27.361+0000 7fb70d45a640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7080c8c10 con 0x7fb7080c67d0 2023-11-28T20:01:27.367 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:27.361+0000 7fb70d45a640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb7080c9f00 con 0x7fb70806c100 2023-11-28T20:01:27.368 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:27.361+0000 7fb6fe7fc640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb7080af4c0 0x7fb7081511f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:27.368 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:27.361+0000 7fb6fe7fc640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb7080af4c0 0x7fb7081511f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:36172/0 (socket says 172.21.15.78:36172) 2023-11-28T20:01:27.368 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:27.361+0000 7fb6fe7fc640 1 -- 172.21.15.78:0/3502681912 learned_addr learned my addr 172.21.15.78:0/3502681912 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T20:01:27.368 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:27.361+0000 7fb706ffd640 1 --2- 172.21.15.78:0/3502681912 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb70806c100 0x7fb7081ed300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:27.368 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:27.361+0000 7fb7077fe640 1 --2- 172.21.15.78:0/3502681912 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb7080c67d0 0x7fb70814f140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:27.368 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:27.361+0000 7fb6fe7fc640 1 -- 172.21.15.78:0/3502681912 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb70806c100 msgr2=0x7fb7081ed300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:01:27.368 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:27.361+0000 7fb6fe7fc640 1 --2- 172.21.15.78:0/3502681912 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb70806c100 0x7fb7081ed300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:27.368 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:27.361+0000 7fb6fe7fc640 1 -- 172.21.15.78:0/3502681912 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb7080c67d0 msgr2=0x7fb70814f140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:01:27.368 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:27.361+0000 7fb6fe7fc640 1 --2- 172.21.15.78:0/3502681912 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb7080c67d0 0x7fb70814f140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:27.368 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:27.361+0000 7fb6fe7fc640 1 -- 172.21.15.78:0/3502681912 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb700009a70 con 0x7fb7080af4c0 2023-11-28T20:01:27.368 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:27.361+0000 7fb706ffd640 1 --2- 172.21.15.78:0/3502681912 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb70806c100 0x7fb7081ed300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T20:01:27.369 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:27.361+0000 7fb6fe7fc640 1 --2- 172.21.15.78:0/3502681912 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb7080af4c0 0x7fb7081511f0 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7fb6f80011f0 tx=0x7fb6f800c9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:01:27.369 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:27.361+0000 7fb6fffff640 1 -- 172.21.15.78:0/3502681912 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6f80074e0 con 0x7fb7080af4c0 2023-11-28T20:01:27.369 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:27.361+0000 7fb6fffff640 1 -- 172.21.15.78:0/3502681912 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb6f8007640 con 0x7fb7080af4c0 2023-11-28T20:01:27.369 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:27.361+0000 7fb70d45a640 1 -- 172.21.15.78:0/3502681912 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb7080c8e60 con 0x7fb7080af4c0 2023-11-28T20:01:27.369 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:27.361+0000 7fb6fffff640 1 -- 172.21.15.78:0/3502681912 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6f8004a10 con 0x7fb7080af4c0 2023-11-28T20:01:27.369 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:27.361+0000 7fb70d45a640 1 -- 172.21.15.78:0/3502681912 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb7080c9420 con 0x7fb7080af4c0 2023-11-28T20:01:27.370 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:27.365+0000 7fb70d45a640 1 -- 172.21.15.78:0/3502681912 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb708067630 con 0x7fb7080af4c0 2023-11-28T20:01:27.370 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:27.365+0000 7fb6fffff640 1 -- 172.21.15.78:0/3502681912 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fb6f8004b70 con 0x7fb7080af4c0 2023-11-28T20:01:27.370 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:27.365+0000 7fb6fffff640 1 --2- 172.21.15.78:0/3502681912 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fb6e8066470 0x7fb6e8068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:27.370 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:27.365+0000 7fb6fffff640 1 -- 172.21.15.78:0/3502681912 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 6885+0+0 (secure 0 0 0) 0x7fb6f80835d0 con 0x7fb7080af4c0 2023-11-28T20:01:27.370 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:27.365+0000 7fb706ffd640 1 --2- 172.21.15.78:0/3502681912 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fb6e8066470 0x7fb6e8068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:27.371 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:27.365+0000 7fb706ffd640 1 --2- 172.21.15.78:0/3502681912 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fb6e8066470 0x7fb6e8068930 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7fb6f0009970 tx=0x7fb6f0008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:01:27.373 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:27.369+0000 7fb6fffff640 1 -- 172.21.15.78:0/3502681912 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fb6f80505d0 con 0x7fb7080af4c0 2023-11-28T20:01:27.523 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:27.517+0000 7fb70d45a640 1 -- 172.21.15.78:0/3502681912 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb7080acff0 con 0x7fb7080af4c0 2023-11-28T20:01:27.524 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:27.521+0000 7fb6fffff640 1 -- 172.21.15.78:0/3502681912 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v65) v1 ==== 74+0+20410 (secure 0 0 0) 0x7fb6f8053bf0 con 0x7fb7080af4c0 2023-11-28T20:01:27.524 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-11-28T20:01:27.524 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":65,"fsid":"dd9780e8-3bda-44fa-a9f0-fa07d19d901d","created":"2023-11-28T19:58:40.969556+0000","modified":"2023-11-28T20:01:24.807489+0000","last_up_change":"2023-11-28T19:58:52.596716+0000","last_in_change":"2023-11-28T19:58:43.609275+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":12,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-28T19:58:54.011229+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_metadata","create_time":"2023-11-28T20:01:07.969267+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"60","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_data","create_time":"2023-11-28T20:01:08.865465+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"61","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs2_metadata","create_time":"2023-11-28T20:01:20.863763+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"64","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs2_data","create_time":"2023-11-28T20:01:22.176918+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"65","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs2"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e84245ac-b5da-429e-af18-39acaa2b33e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6800","nonce":3358701235},{"type":"v1","addr":"172.21.15.78:6801","nonce":3358701235}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6802","nonce":3358701235},{"type":"v1","addr":"172.21.15.78:6803","nonce":3358701235}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6806","nonce":3358701235},{"type":"v1","addr":"172.21.15.78:6807","nonce":3358701235}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6804","nonce":3358701235},{"type":"v1","addr":"172.21.15.78:6805","nonce":3358701235}]},"public_addr":"172.21.15.78:6801/3358701235","cluster_addr":"172.21.15.78:6803/3358701235","heartbeat_back_addr":"172.21.15.78:6807/3358701235","heartbeat_front_addr":"172.21.15.78:6805/3358701235","state":["exists","up"]},{"osd":1,"uuid":"e634831d-c4e2-48d9-870c-9556ae162981","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6808","nonce":3211476654},{"type":"v1","addr":"172.21.15.78:6809","nonce":3211476654}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6810","nonce":3211476654},{"type":"v1","addr":"172.21.15.78:6811","nonce":3211476654}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6814","nonce":3211476654},{"type":"v1","addr":"172.21.15.78:6815","nonce":3211476654}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6812","nonce":3211476654},{"type":"v1","addr":"172.21.15.78:6813","nonce":3211476654}]},"public_addr":"172.21.15.78:6809/3211476654","cluster_addr":"172.21.15.78:6811/3211476654","heartbeat_back_addr":"172.21.15.78:6815/3211476654","heartbeat_front_addr":"172.21.15.78:6813/3211476654","state":["exists","up"]},{"osd":2,"uuid":"274c8395-6534-41f0-b8fb-a00af8985aa8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6816","nonce":2532904479},{"type":"v1","addr":"172.21.15.78:6817","nonce":2532904479}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6818","nonce":2532904479},{"type":"v1","addr":"172.21.15.78:6819","nonce":2532904479}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6822","nonce":2532904479},{"type":"v1","addr":"172.21.15.78:6823","nonce":2532904479}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6820","nonce":2532904479},{"type":"v1","addr":"172.21.15.78:6821","nonce":2532904479}]},"public_addr":"172.21.15.78:6817/2532904479","cluster_addr":"172.21.15.78:6819/2532904479","heartbeat_back_addr":"172.21.15.78:6823/2532904479","heartbeat_front_addr":"172.21.15.78:6821/2532904479","state":["exists","up"]},{"osd":3,"uuid":"77acc9af-7d4d-4b18-8cf5-d62f5971b7c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6824","nonce":3442991267},{"type":"v1","addr":"172.21.15.78:6825","nonce":3442991267}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6826","nonce":3442991267},{"type":"v1","addr":"172.21.15.78:6827","nonce":3442991267}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6830","nonce":3442991267},{"type":"v1","addr":"172.21.15.78:6831","nonce":3442991267}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6828","nonce":3442991267},{"type":"v1","addr":"172.21.15.78:6829","nonce":3442991267}]},"public_addr":"172.21.15.78:6825/3442991267","cluster_addr":"172.21.15.78:6827/3442991267","heartbeat_back_addr":"172.21.15.78:6831/3442991267","heartbeat_front_addr":"172.21.15.78:6829/3442991267","state":["exists","up"]},{"osd":4,"uuid":"5c62bc66-6b34-4b7f-a66b-9a743969138c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":802983577},{"type":"v1","addr":"172.21.15.179:6809","nonce":802983577}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":802983577},{"type":"v1","addr":"172.21.15.179:6811","nonce":802983577}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":802983577},{"type":"v1","addr":"172.21.15.179:6815","nonce":802983577}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":802983577},{"type":"v1","addr":"172.21.15.179:6813","nonce":802983577}]},"public_addr":"172.21.15.179:6809/802983577","cluster_addr":"172.21.15.179:6811/802983577","heartbeat_back_addr":"172.21.15.179:6815/802983577","heartbeat_front_addr":"172.21.15.179:6813/802983577","state":["exists","up"]},{"osd":5,"uuid":"67db6d36-f684-4079-b0cd-82b4dd61461f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":518192887},{"type":"v1","addr":"172.21.15.179:6818","nonce":518192887}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":518192887},{"type":"v1","addr":"172.21.15.179:6822","nonce":518192887}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":518192887},{"type":"v1","addr":"172.21.15.179:6829","nonce":518192887}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6824","nonce":518192887},{"type":"v1","addr":"172.21.15.179:6826","nonce":518192887}]},"public_addr":"172.21.15.179:6818/518192887","cluster_addr":"172.21.15.179:6822/518192887","heartbeat_back_addr":"172.21.15.179:6829/518192887","heartbeat_front_addr":"172.21.15.179:6826/518192887","state":["exists","up"]},{"osd":6,"uuid":"12e670af-5a16-4c81-9f97-defa66cab967","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":815435378},{"type":"v1","addr":"172.21.15.179:6801","nonce":815435378}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":815435378},{"type":"v1","addr":"172.21.15.179:6803","nonce":815435378}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":815435378},{"type":"v1","addr":"172.21.15.179:6807","nonce":815435378}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":815435378},{"type":"v1","addr":"172.21.15.179:6805","nonce":815435378}]},"public_addr":"172.21.15.179:6801/815435378","cluster_addr":"172.21.15.179:6803/815435378","heartbeat_back_addr":"172.21.15.179:6807/815435378","heartbeat_front_addr":"172.21.15.179:6805/815435378","state":["exists","up"]},{"osd":7,"uuid":"fe630650-2eb3-49ad-8676-c341e6332eb1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6817","nonce":2848432339},{"type":"v1","addr":"172.21.15.179:6819","nonce":2848432339}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6821","nonce":2848432339},{"type":"v1","addr":"172.21.15.179:6823","nonce":2848432339}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":2848432339},{"type":"v1","addr":"172.21.15.179:6831","nonce":2848432339}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6825","nonce":2848432339},{"type":"v1","addr":"172.21.15.179:6827","nonce":2848432339}]},"public_addr":"172.21.15.179:6819/2848432339","cluster_addr":"172.21.15.179:6823/2848432339","heartbeat_back_addr":"172.21.15.179:6831/2848432339","heartbeat_front_addr":"172.21.15.179:6827/2848432339","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:58:49.255433+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:58:49.412880+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:58:49.559295+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:58:49.245237+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:58:49.184557+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:58:49.329851+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:58:49.366012+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:58:49.349604+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-28T20:01:27.526 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:27.521+0000 7fb70d45a640 1 -- 172.21.15.78:0/3502681912 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fb6e8066470 msgr2=0x7fb6e8068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:01:27.526 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:27.521+0000 7fb70d45a640 1 --2- 172.21.15.78:0/3502681912 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fb6e8066470 0x7fb6e8068930 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7fb6f0009970 tx=0x7fb6f0008040 comp rx=0 tx=0).stop 2023-11-28T20:01:27.526 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:27.521+0000 7fb70d45a640 1 -- 172.21.15.78:0/3502681912 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb7080af4c0 msgr2=0x7fb7081511f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:01:27.526 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:27.521+0000 7fb70d45a640 1 --2- 172.21.15.78:0/3502681912 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb7080af4c0 0x7fb7081511f0 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7fb6f80011f0 tx=0x7fb6f800c9b0 comp rx=0 tx=0).stop 2023-11-28T20:01:27.527 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:27.521+0000 7fb70d45a640 1 -- 172.21.15.78:0/3502681912 shutdown_connections 2023-11-28T20:01:27.527 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:27.521+0000 7fb70d45a640 1 --2- 172.21.15.78:0/3502681912 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fb6e8066470 0x7fb6e8068930 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:27.527 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:27.521+0000 7fb70d45a640 1 --2- 172.21.15.78:0/3502681912 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb7080c67d0 0x7fb70814f140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:27.527 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:27.521+0000 7fb70d45a640 1 --2- 172.21.15.78:0/3502681912 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb7080af4c0 0x7fb7081511f0 unknown :-1 s=CLOSED pgs=689 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:27.527 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:27.521+0000 7fb70d45a640 1 --2- 172.21.15.78:0/3502681912 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb70806c100 0x7fb7081ed300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:27.527 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:27.521+0000 7fb70d45a640 1 -- 172.21.15.78:0/3502681912 >> 172.21.15.78:0/3502681912 conn(0x7fb7080ab9d0 msgr2=0x7fb7080abdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:01:27.527 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:27.521+0000 7fb70d45a640 1 -- 172.21.15.78:0/3502681912 shutdown_connections 2023-11-28T20:01:27.527 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:27.521+0000 7fb70d45a640 1 -- 172.21.15.78:0/3502681912 wait complete. 2023-11-28T20:01:27.545 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-11-28T20:01:27.546 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-28T20:01:27.682 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:27.677+0000 7fddcc8ea640 1 Processor -- start 2023-11-28T20:01:27.682 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:27.677+0000 7fddcc8ea640 1 -- start start 2023-11-28T20:01:27.683 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:27.677+0000 7fddcc8ea640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fddc806bef0 0x7fddc80bfce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:27.684 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:27.677+0000 7fddcc8ea640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fddc814e3f0 0x7fddc806c5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:27.684 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:27.677+0000 7fddcc8ea640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fddc8151690 con 0x7fddc806caf0 2023-11-28T20:01:27.684 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:27.677+0000 7fddcc8ea640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fddc8151bc0 con 0x7fddc806bef0 2023-11-28T20:01:27.684 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:27.677+0000 7fddcc8ea640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fddc81518e0 con 0x7fddc814e3f0 2023-11-28T20:01:27.684 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:27.681+0000 7fddc659c640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fddc806bef0 0x7fddc80bfce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:27.684 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:27.681+0000 7fddc6d9d640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7fddc806caf0 0x7fddc8154180 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:37168/0 (socket says 172.21.15.78:37168) 2023-11-28T20:01:27.684 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:27.681+0000 7fddc6d9d640 1 -- 172.21.15.78:0/1427213460 learned_addr learned my addr 172.21.15.78:0/1427213460 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-11-28T20:01:27.684 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:27.681+0000 7fddbdd9b640 1 --2- 172.21.15.78:0/1427213460 >> v2:172.21.15.179:3300/0 conn(0x7fddc814e3f0 0x7fddc806c5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:27.684 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:27.681+0000 7fddc659c640 1 -- 172.21.15.78:0/1427213460 >> v2:172.21.15.179:3300/0 conn(0x7fddc814e3f0 msgr2=0x7fddc806c5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:01:27.684 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:27.681+0000 7fddc659c640 1 --2- 172.21.15.78:0/1427213460 >> v2:172.21.15.179:3300/0 conn(0x7fddc814e3f0 0x7fddc806c5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:27.685 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:27.681+0000 7fddc659c640 1 -- 172.21.15.78:0/1427213460 >> v1:172.21.15.78:6789/0 conn(0x7fddc806caf0 legacy=0x7fddc8154180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:01:27.685 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:27.681+0000 7fddc659c640 1 -- 172.21.15.78:0/1427213460 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fddc80c1de0 con 0x7fddc806bef0 2023-11-28T20:01:27.687 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:27.681+0000 7fddc659c640 1 --2- 172.21.15.78:0/1427213460 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fddc806bef0 0x7fddc80bfce0 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7fddc806b520 tx=0x7fddb801c3d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7a9062c3d0489e9f server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:01:27.687 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:27.681+0000 7fddc5d9b640 1 -- 172.21.15.78:0/1427213460 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddb80ab600 con 0x7fddc806bef0 2023-11-28T20:01:27.687 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:27.681+0000 7fddc5d9b640 1 -- 172.21.15.78:0/1427213460 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fddb80a7050 con 0x7fddc806bef0 2023-11-28T20:01:27.687 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:27.681+0000 7fddc5d9b640 1 -- 172.21.15.78:0/1427213460 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddb80ab980 con 0x7fddc806bef0 2023-11-28T20:01:27.688 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:27.685+0000 7fddcc8ea640 1 -- 172.21.15.78:0/1427213460 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fddc806bef0 msgr2=0x7fddc80bfce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:01:27.688 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:27.685+0000 7fddcc8ea640 1 --2- 172.21.15.78:0/1427213460 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fddc806bef0 0x7fddc80bfce0 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7fddc806b520 tx=0x7fddb801c3d0 comp rx=0 tx=0).stop 2023-11-28T20:01:27.688 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:27.685+0000 7fddcc8ea640 1 -- 172.21.15.78:0/1427213460 shutdown_connections 2023-11-28T20:01:27.688 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:27.685+0000 7fddcc8ea640 1 --2- 172.21.15.78:0/1427213460 >> v2:172.21.15.179:3300/0 conn(0x7fddc814e3f0 0x7fddc806c5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:27.688 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:27.685+0000 7fddcc8ea640 1 --2- 172.21.15.78:0/1427213460 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fddc806bef0 0x7fddc80bfce0 unknown :-1 s=CLOSED pgs=691 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:27.688 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:27.685+0000 7fddcc8ea640 1 -- 172.21.15.78:0/1427213460 >> 172.21.15.78:0/1427213460 conn(0x7fddc80a7810 msgr2=0x7fddc80a7c20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:01:27.688 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:27.685+0000 7fddcc8ea640 1 -- 172.21.15.78:0/1427213460 shutdown_connections 2023-11-28T20:01:27.688 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:27.685+0000 7fddcc8ea640 1 -- 172.21.15.78:0/1427213460 wait complete. 2023-11-28T20:01:27.689 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:27.685+0000 7fddcc8ea640 1 Processor -- start 2023-11-28T20:01:27.689 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:27.685+0000 7fddcc8ea640 1 -- start start 2023-11-28T20:01:27.692 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:27.685+0000 7fddcc8ea640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fddc806bef0 0x7fddc8070880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:27.692 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:27.685+0000 7fddcc8ea640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fddc806caf0 0x7fddc80bf0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:27.692 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:27.685+0000 7fddcc8ea640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fddc814e3f0 0x7fddc81ed930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:27.692 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:27.685+0000 7fddcc8ea640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fddc8072140 con 0x7fddc806caf0 2023-11-28T20:01:27.692 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:27.685+0000 7fddcc8ea640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fddc81ed4a0 con 0x7fddc806bef0 2023-11-28T20:01:27.692 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:27.685+0000 7fddcc8ea640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fddc8072670 con 0x7fddc814e3f0 2023-11-28T20:01:27.692 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:27.685+0000 7fddbdd9b640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fddc806caf0 0x7fddc80bf0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:27.692 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:27.685+0000 7fddbdd9b640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fddc806caf0 0x7fddc80bf0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:36192/0 (socket says 172.21.15.78:36192) 2023-11-28T20:01:27.692 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:27.685+0000 7fddbdd9b640 1 -- 172.21.15.78:0/1660386096 learned_addr learned my addr 172.21.15.78:0/1660386096 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T20:01:27.693 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:27.685+0000 7fddc659c640 1 --2- 172.21.15.78:0/1660386096 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fddc806bef0 0x7fddc8070880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:27.693 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:27.685+0000 7fddc6d9d640 1 --2- 172.21.15.78:0/1660386096 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fddc814e3f0 0x7fddc81ed930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:27.693 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:27.685+0000 7fddbdd9b640 1 -- 172.21.15.78:0/1660386096 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fddc814e3f0 msgr2=0x7fddc81ed930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:01:27.693 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:27.685+0000 7fddbdd9b640 1 --2- 172.21.15.78:0/1660386096 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fddc814e3f0 0x7fddc81ed930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:27.693 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:27.685+0000 7fddbdd9b640 1 -- 172.21.15.78:0/1660386096 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fddc806bef0 msgr2=0x7fddc8070880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:01:27.693 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:27.685+0000 7fddbdd9b640 1 --2- 172.21.15.78:0/1660386096 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fddc806bef0 0x7fddc8070880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:27.693 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:27.685+0000 7fddbdd9b640 1 -- 172.21.15.78:0/1660386096 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fddb8009420 con 0x7fddc806caf0 2023-11-28T20:01:27.693 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:27.685+0000 7fddc6d9d640 1 --2- 172.21.15.78:0/1660386096 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fddc814e3f0 0x7fddc81ed930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T20:01:27.693 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:27.689+0000 7fddbdd9b640 1 --2- 172.21.15.78:0/1660386096 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fddc806caf0 0x7fddc80bf0f0 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7fddb000d620 tx=0x7fddb000dae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:01:27.693 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:27.689+0000 7fddbf7fe640 1 -- 172.21.15.78:0/1660386096 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddb000b620 con 0x7fddc806caf0 2023-11-28T20:01:27.693 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:27.689+0000 7fddbf7fe640 1 -- 172.21.15.78:0/1660386096 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fddb000b780 con 0x7fddc806caf0 2023-11-28T20:01:27.693 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:27.689+0000 7fddbf7fe640 1 -- 172.21.15.78:0/1660386096 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddb000bb10 con 0x7fddc806caf0 2023-11-28T20:01:27.694 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:27.689+0000 7fddcc8ea640 1 -- 172.21.15.78:0/1660386096 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fddc8072390 con 0x7fddc806caf0 2023-11-28T20:01:27.694 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:27.689+0000 7fddcc8ea640 1 -- 172.21.15.78:0/1660386096 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fddc80bf630 con 0x7fddc806caf0 2023-11-28T20:01:27.694 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:27.689+0000 7fddcc8ea640 1 -- 172.21.15.78:0/1660386096 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fddc81ed630 con 0x7fddc806caf0 2023-11-28T20:01:27.694 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:27.689+0000 7fddbf7fe640 1 -- 172.21.15.78:0/1660386096 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fddb000bc70 con 0x7fddc806caf0 2023-11-28T20:01:27.695 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:27.689+0000 7fddbf7fe640 1 --2- 172.21.15.78:0/1660386096 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fdda8066470 0x7fdda8068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:27.695 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:27.689+0000 7fddbf7fe640 1 -- 172.21.15.78:0/1660386096 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 6885+0+0 (secure 0 0 0) 0x7fddb0084720 con 0x7fddc806caf0 2023-11-28T20:01:27.695 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:27.693+0000 7fddc659c640 1 --2- 172.21.15.78:0/1660386096 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fdda8066470 0x7fdda8068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:27.696 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:27.693+0000 7fddc659c640 1 --2- 172.21.15.78:0/1660386096 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fdda8066470 0x7fdda8068930 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7fddb80ad000 tx=0x7fddb8008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:01:27.699 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:27.693+0000 7fddbf7fe640 1 -- 172.21.15.78:0/1660386096 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fddb00516f0 con 0x7fddc806caf0 2023-11-28T20:01:27.849 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:27.845+0000 7fddcc8ea640 1 -- 172.21.15.78:0/1660386096 --> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fddc814e7d0 con 0x7fdda8066470 2023-11-28T20:01:27.861 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:27.857+0000 7fddbf7fe640 1 -- 172.21.15.78:0/1660386096 <== mgr.4106 v2:172.21.15.78:6832/2935380957 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+522286 (secure 0 0 0) 0x7fddb80bb090 con 0x7fdda8066470 2023-11-28T20:01:27.867 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-11-28T20:01:27.871 INFO:teuthology.orchestra.run.smithi078.stderr:dumped all 2023-11-28T20:01:27.872 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:27.861+0000 7fddcc8ea640 1 -- 172.21.15.78:0/1660386096 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fdda8066470 msgr2=0x7fdda8068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:01:27.873 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:27.861+0000 7fddcc8ea640 1 --2- 172.21.15.78:0/1660386096 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fdda8066470 0x7fdda8068930 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7fddb80ad000 tx=0x7fddb8008040 comp rx=0 tx=0).stop 2023-11-28T20:01:27.873 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:27.861+0000 7fddcc8ea640 1 -- 172.21.15.78:0/1660386096 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fddc806caf0 msgr2=0x7fddc80bf0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:01:27.873 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:27.861+0000 7fddcc8ea640 1 --2- 172.21.15.78:0/1660386096 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fddc806caf0 0x7fddc80bf0f0 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7fddb000d620 tx=0x7fddb000dae0 comp rx=0 tx=0).stop 2023-11-28T20:01:27.873 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:27.861+0000 7fddcc8ea640 1 -- 172.21.15.78:0/1660386096 shutdown_connections 2023-11-28T20:01:27.873 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:27.861+0000 7fddcc8ea640 1 --2- 172.21.15.78:0/1660386096 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fdda8066470 0x7fdda8068930 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:27.873 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:27.861+0000 7fddcc8ea640 1 --2- 172.21.15.78:0/1660386096 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fddc814e3f0 0x7fddc81ed930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:27.873 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:27.861+0000 7fddcc8ea640 1 --2- 172.21.15.78:0/1660386096 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fddc806caf0 0x7fddc80bf0f0 unknown :-1 s=CLOSED pgs=692 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:27.873 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:27.861+0000 7fddcc8ea640 1 --2- 172.21.15.78:0/1660386096 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fddc806bef0 0x7fddc8070880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:27.873 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:27.861+0000 7fddcc8ea640 1 -- 172.21.15.78:0/1660386096 >> 172.21.15.78:0/1660386096 conn(0x7fddc80a7810 msgr2=0x7fddc80a5d00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:01:27.873 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:27.861+0000 7fddcc8ea640 1 -- 172.21.15.78:0/1660386096 shutdown_connections 2023-11-28T20:01:27.873 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:27.861+0000 7fddcc8ea640 1 -- 172.21.15.78:0/1660386096 wait complete. 2023-11-28T20:01:27.886 INFO:teuthology.orchestra.run.smithi078.stdout:{"pg_ready":true,"pg_map":{"version":135,"stamp":"2023-11-28T20:01:25.982383+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":594273,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":206,"num_write_kb":2433,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":158,"ondisk_log_size":158,"up":386,"acting":386,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":235,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":226368,"kb_used_data":6048,"kb_used_omap":12,"kb_used_meta":220211,"kb_avail":754748352,"statfs":{"total":773094113280,"available":772862312448,"internally_reserved":0,"allocated":6193152,"data_stored":3946178,"data_compressed":66748,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":12752,"internal_metadata":225496624},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":30,"apply_latency_ms":30,"commit_latency_ns":30000000,"apply_latency_ns":30000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1241,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.195196"},"pg_stats":[{"pgid":"12.39","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2023-11-28T20:01:22.802967+0000","last_change":"2023-11-28T20:01:22.802967+0000","last_active":"2023-11-28T20:01:22.787100+0000","last_peered":"2023-11-28T20:01:22.787100+0000","last_clean":"2023-11-28T20:01:22.787100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:01:22.802967+0000","last_undegraded":"2023-11-28T20:01:22.802967+0000","last_fullsized":"2023-11-28T20:01:22.802967+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:22.787100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:22.787100+0000","last_clean_scrub_stamp":"2023-11-28T20:01:22.787100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.3f","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-11-28T20:01:21.790302+0000","last_change":"2023-11-28T20:01:10.539211+0000","last_active":"2023-11-28T20:01:21.790302+0000","last_peered":"2023-11-28T20:01:21.790302+0000","last_clean":"2023-11-28T20:01:21.790302+0000","last_became_active":"2023-11-28T20:01:10.538932+0000","last_became_peered":"2023-11-28T20:01:10.538932+0000","last_unstale":"2023-11-28T20:01:21.790302+0000","last_undegraded":"2023-11-28T20:01:21.790302+0000","last_fullsized":"2023-11-28T20:01:21.790302+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_clean_scrub_stamp":"2023-11-28T20:01:09.480611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:10:00.034946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.38","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2023-11-28T20:01:22.800864+0000","last_change":"2023-11-28T20:01:22.800864+0000","last_active":"2023-11-28T20:01:22.787100+0000","last_peered":"2023-11-28T20:01:22.787100+0000","last_clean":"2023-11-28T20:01:22.787100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:01:22.800864+0000","last_undegraded":"2023-11-28T20:01:22.800864+0000","last_fullsized":"2023-11-28T20:01:22.800864+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:22.787100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:22.787100+0000","last_clean_scrub_stamp":"2023-11-28T20:01:22.787100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.3e","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-11-28T20:01:21.790168+0000","last_change":"2023-11-28T20:01:10.522069+0000","last_active":"2023-11-28T20:01:21.790168+0000","last_peered":"2023-11-28T20:01:21.790168+0000","last_clean":"2023-11-28T20:01:21.790168+0000","last_became_active":"2023-11-28T20:01:10.521785+0000","last_became_peered":"2023-11-28T20:01:10.521785+0000","last_unstale":"2023-11-28T20:01:21.790168+0000","last_undegraded":"2023-11-28T20:01:21.790168+0000","last_fullsized":"2023-11-28T20:01:21.790168+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_clean_scrub_stamp":"2023-11-28T20:01:09.480611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:00:30.789993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.3b","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2023-11-28T20:01:22.801987+0000","last_change":"2023-11-28T20:01:22.801987+0000","last_active":"2023-11-28T20:01:22.787100+0000","last_peered":"2023-11-28T20:01:22.787100+0000","last_clean":"2023-11-28T20:01:22.787100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:01:22.801987+0000","last_undegraded":"2023-11-28T20:01:22.801987+0000","last_fullsized":"2023-11-28T20:01:22.801987+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:22.787100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:22.787100+0000","last_clean_scrub_stamp":"2023-11-28T20:01:22.787100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.3d","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-11-28T20:01:21.798541+0000","last_change":"2023-11-28T20:01:10.538353+0000","last_active":"2023-11-28T20:01:21.798541+0000","last_peered":"2023-11-28T20:01:21.798541+0000","last_clean":"2023-11-28T20:01:21.798541+0000","last_became_active":"2023-11-28T20:01:10.537756+0000","last_became_peered":"2023-11-28T20:01:10.537756+0000","last_unstale":"2023-11-28T20:01:21.798541+0000","last_undegraded":"2023-11-28T20:01:21.798541+0000","last_fullsized":"2023-11-28T20:01:21.798541+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_clean_scrub_stamp":"2023-11-28T20:01:09.480611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T06:29:13.579326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.3a","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2023-11-28T20:01:22.804075+0000","last_change":"2023-11-28T20:01:22.804075+0000","last_active":"2023-11-28T20:01:22.787100+0000","last_peered":"2023-11-28T20:01:22.787100+0000","last_clean":"2023-11-28T20:01:22.787100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:01:22.804075+0000","last_undegraded":"2023-11-28T20:01:22.804075+0000","last_fullsized":"2023-11-28T20:01:22.804075+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:22.787100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:22.787100+0000","last_clean_scrub_stamp":"2023-11-28T20:01:22.787100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.3c","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-11-28T20:01:21.791845+0000","last_change":"2023-11-28T20:01:10.523152+0000","last_active":"2023-11-28T20:01:21.791845+0000","last_peered":"2023-11-28T20:01:21.791845+0000","last_clean":"2023-11-28T20:01:21.791845+0000","last_became_active":"2023-11-28T20:01:10.522874+0000","last_became_peered":"2023-11-28T20:01:10.522874+0000","last_unstale":"2023-11-28T20:01:21.791845+0000","last_undegraded":"2023-11-28T20:01:21.791845+0000","last_fullsized":"2023-11-28T20:01:21.791845+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_clean_scrub_stamp":"2023-11-28T20:01:09.480611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:56:55.097917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.3d","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2023-11-28T20:01:22.809244+0000","last_change":"2023-11-28T20:01:22.809244+0000","last_active":"2023-11-28T20:01:22.787100+0000","last_peered":"2023-11-28T20:01:22.787100+0000","last_clean":"2023-11-28T20:01:22.787100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:01:22.809244+0000","last_undegraded":"2023-11-28T20:01:22.809244+0000","last_fullsized":"2023-11-28T20:01:22.809244+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:22.787100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:22.787100+0000","last_clean_scrub_stamp":"2023-11-28T20:01:22.787100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.3b","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-11-28T20:01:21.801402+0000","last_change":"2023-11-28T20:01:10.529938+0000","last_active":"2023-11-28T20:01:21.801402+0000","last_peered":"2023-11-28T20:01:21.801402+0000","last_clean":"2023-11-28T20:01:21.801402+0000","last_became_active":"2023-11-28T20:01:10.529188+0000","last_became_peered":"2023-11-28T20:01:10.529188+0000","last_unstale":"2023-11-28T20:01:21.801402+0000","last_undegraded":"2023-11-28T20:01:21.801402+0000","last_fullsized":"2023-11-28T20:01:21.801402+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_clean_scrub_stamp":"2023-11-28T20:01:09.480611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:47:13.274500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.3c","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2023-11-28T20:01:22.810262+0000","last_change":"2023-11-28T20:01:22.810262+0000","last_active":"2023-11-28T20:01:22.787100+0000","last_peered":"2023-11-28T20:01:22.787100+0000","last_clean":"2023-11-28T20:01:22.787100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:01:22.810262+0000","last_undegraded":"2023-11-28T20:01:22.810262+0000","last_fullsized":"2023-11-28T20:01:22.810262+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:22.787100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:22.787100+0000","last_clean_scrub_stamp":"2023-11-28T20:01:22.787100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.3a","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-11-28T20:01:21.801203+0000","last_change":"2023-11-28T20:01:10.531000+0000","last_active":"2023-11-28T20:01:21.801203+0000","last_peered":"2023-11-28T20:01:21.801203+0000","last_clean":"2023-11-28T20:01:21.801203+0000","last_became_active":"2023-11-28T20:01:10.530754+0000","last_became_peered":"2023-11-28T20:01:10.530754+0000","last_unstale":"2023-11-28T20:01:21.801203+0000","last_undegraded":"2023-11-28T20:01:21.801203+0000","last_fullsized":"2023-11-28T20:01:21.801203+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_clean_scrub_stamp":"2023-11-28T20:01:09.480611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:44:34.399373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.3f","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2023-11-28T20:01:22.815237+0000","last_change":"2023-11-28T20:01:22.815237+0000","last_active":"2023-11-28T20:01:22.787100+0000","last_peered":"2023-11-28T20:01:22.787100+0000","last_clean":"2023-11-28T20:01:22.787100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:01:22.815237+0000","last_undegraded":"2023-11-28T20:01:22.815237+0000","last_fullsized":"2023-11-28T20:01:22.815237+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:22.787100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:22.787100+0000","last_clean_scrub_stamp":"2023-11-28T20:01:22.787100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.39","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-11-28T20:01:21.796927+0000","last_change":"2023-11-28T20:01:10.535113+0000","last_active":"2023-11-28T20:01:21.796927+0000","last_peered":"2023-11-28T20:01:21.796927+0000","last_clean":"2023-11-28T20:01:21.796927+0000","last_became_active":"2023-11-28T20:01:10.534919+0000","last_became_peered":"2023-11-28T20:01:10.534919+0000","last_unstale":"2023-11-28T20:01:21.796927+0000","last_undegraded":"2023-11-28T20:01:21.796927+0000","last_fullsized":"2023-11-28T20:01:21.796927+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_clean_scrub_stamp":"2023-11-28T20:01:09.480611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:00:31.915592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.3e","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2023-11-28T20:01:22.812285+0000","last_change":"2023-11-28T20:01:22.812285+0000","last_active":"2023-11-28T20:01:22.787100+0000","last_peered":"2023-11-28T20:01:22.787100+0000","last_clean":"2023-11-28T20:01:22.787100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:01:22.812285+0000","last_undegraded":"2023-11-28T20:01:22.812285+0000","last_fullsized":"2023-11-28T20:01:22.812285+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:22.787100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:22.787100+0000","last_clean_scrub_stamp":"2023-11-28T20:01:22.787100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.38","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-11-28T20:01:21.793498+0000","last_change":"2023-11-28T20:01:10.538054+0000","last_active":"2023-11-28T20:01:21.793498+0000","last_peered":"2023-11-28T20:01:21.793498+0000","last_clean":"2023-11-28T20:01:21.793498+0000","last_became_active":"2023-11-28T20:01:10.535363+0000","last_became_peered":"2023-11-28T20:01:10.535363+0000","last_unstale":"2023-11-28T20:01:21.793498+0000","last_undegraded":"2023-11-28T20:01:21.793498+0000","last_fullsized":"2023-11-28T20:01:21.793498+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_clean_scrub_stamp":"2023-11-28T20:01:09.480611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:06:36.994816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.31","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2023-11-28T20:01:22.805019+0000","last_change":"2023-11-28T20:01:22.805019+0000","last_active":"2023-11-28T20:01:22.787100+0000","last_peered":"2023-11-28T20:01:22.787100+0000","last_clean":"2023-11-28T20:01:22.787100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:01:22.805019+0000","last_undegraded":"2023-11-28T20:01:22.805019+0000","last_fullsized":"2023-11-28T20:01:22.805019+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:22.787100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:22.787100+0000","last_clean_scrub_stamp":"2023-11-28T20:01:22.787100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.37","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-11-28T20:01:21.799718+0000","last_change":"2023-11-28T20:01:10.543027+0000","last_active":"2023-11-28T20:01:21.799718+0000","last_peered":"2023-11-28T20:01:21.799718+0000","last_clean":"2023-11-28T20:01:21.799718+0000","last_became_active":"2023-11-28T20:01:10.541632+0000","last_became_peered":"2023-11-28T20:01:10.541632+0000","last_unstale":"2023-11-28T20:01:21.799718+0000","last_undegraded":"2023-11-28T20:01:21.799718+0000","last_fullsized":"2023-11-28T20:01:21.799718+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_clean_scrub_stamp":"2023-11-28T20:01:09.480611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:46:29.701039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.30","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2023-11-28T20:01:22.807023+0000","last_change":"2023-11-28T20:01:22.807023+0000","last_active":"2023-11-28T20:01:22.787100+0000","last_peered":"2023-11-28T20:01:22.787100+0000","last_clean":"2023-11-28T20:01:22.787100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:01:22.807023+0000","last_undegraded":"2023-11-28T20:01:22.807023+0000","last_fullsized":"2023-11-28T20:01:22.807023+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:22.787100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:22.787100+0000","last_clean_scrub_stamp":"2023-11-28T20:01:22.787100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.36","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-11-28T20:01:21.798466+0000","last_change":"2023-11-28T20:01:10.541712+0000","last_active":"2023-11-28T20:01:21.798466+0000","last_peered":"2023-11-28T20:01:21.798466+0000","last_clean":"2023-11-28T20:01:21.798466+0000","last_became_active":"2023-11-28T20:01:10.541389+0000","last_became_peered":"2023-11-28T20:01:10.541389+0000","last_unstale":"2023-11-28T20:01:21.798466+0000","last_undegraded":"2023-11-28T20:01:21.798466+0000","last_fullsized":"2023-11-28T20:01:21.798466+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_clean_scrub_stamp":"2023-11-28T20:01:09.480611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:54:30.269337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.33","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2023-11-28T20:01:22.801107+0000","last_change":"2023-11-28T20:01:22.801107+0000","last_active":"2023-11-28T20:01:22.787100+0000","last_peered":"2023-11-28T20:01:22.787100+0000","last_clean":"2023-11-28T20:01:22.787100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:01:22.801107+0000","last_undegraded":"2023-11-28T20:01:22.801107+0000","last_fullsized":"2023-11-28T20:01:22.801107+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:22.787100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:22.787100+0000","last_clean_scrub_stamp":"2023-11-28T20:01:22.787100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.35","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-11-28T20:01:21.791729+0000","last_change":"2023-11-28T20:01:10.520251+0000","last_active":"2023-11-28T20:01:21.791729+0000","last_peered":"2023-11-28T20:01:21.791729+0000","last_clean":"2023-11-28T20:01:21.791729+0000","last_became_active":"2023-11-28T20:01:10.519957+0000","last_became_peered":"2023-11-28T20:01:10.519957+0000","last_unstale":"2023-11-28T20:01:21.791729+0000","last_undegraded":"2023-11-28T20:01:21.791729+0000","last_fullsized":"2023-11-28T20:01:21.791729+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_clean_scrub_stamp":"2023-11-28T20:01:09.480611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:33:17.345518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.32","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2023-11-28T20:01:22.803669+0000","last_change":"2023-11-28T20:01:22.803669+0000","last_active":"2023-11-28T20:01:22.787100+0000","last_peered":"2023-11-28T20:01:22.787100+0000","last_clean":"2023-11-28T20:01:22.787100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:01:22.803669+0000","last_undegraded":"2023-11-28T20:01:22.803669+0000","last_fullsized":"2023-11-28T20:01:22.803669+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:22.787100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:22.787100+0000","last_clean_scrub_stamp":"2023-11-28T20:01:22.787100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.34","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-11-28T20:01:21.793709+0000","last_change":"2023-11-28T20:01:10.535199+0000","last_active":"2023-11-28T20:01:21.793709+0000","last_peered":"2023-11-28T20:01:21.793709+0000","last_clean":"2023-11-28T20:01:21.793709+0000","last_became_active":"2023-11-28T20:01:10.534856+0000","last_became_peered":"2023-11-28T20:01:10.534856+0000","last_unstale":"2023-11-28T20:01:21.793709+0000","last_undegraded":"2023-11-28T20:01:21.793709+0000","last_fullsized":"2023-11-28T20:01:21.793709+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_clean_scrub_stamp":"2023-11-28T20:01:09.480611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:07:03.844567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.35","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2023-11-28T20:01:22.809408+0000","last_change":"2023-11-28T20:01:22.809408+0000","last_active":"2023-11-28T20:01:22.787100+0000","last_peered":"2023-11-28T20:01:22.787100+0000","last_clean":"2023-11-28T20:01:22.787100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:01:22.809408+0000","last_undegraded":"2023-11-28T20:01:22.809408+0000","last_fullsized":"2023-11-28T20:01:22.809408+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:22.787100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:22.787100+0000","last_clean_scrub_stamp":"2023-11-28T20:01:22.787100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.33","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-11-28T20:01:21.793879+0000","last_change":"2023-11-28T20:01:10.529868+0000","last_active":"2023-11-28T20:01:21.793879+0000","last_peered":"2023-11-28T20:01:21.793879+0000","last_clean":"2023-11-28T20:01:21.793879+0000","last_became_active":"2023-11-28T20:01:10.529582+0000","last_became_peered":"2023-11-28T20:01:10.529582+0000","last_unstale":"2023-11-28T20:01:21.793879+0000","last_undegraded":"2023-11-28T20:01:21.793879+0000","last_fullsized":"2023-11-28T20:01:21.793879+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_clean_scrub_stamp":"2023-11-28T20:01:09.480611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T07:14:21.836133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.34","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2023-11-28T20:01:22.809821+0000","last_change":"2023-11-28T20:01:22.809821+0000","last_active":"2023-11-28T20:01:22.787100+0000","last_peered":"2023-11-28T20:01:22.787100+0000","last_clean":"2023-11-28T20:01:22.787100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:01:22.809821+0000","last_undegraded":"2023-11-28T20:01:22.809821+0000","last_fullsized":"2023-11-28T20:01:22.809821+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:22.787100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:22.787100+0000","last_clean_scrub_stamp":"2023-11-28T20:01:22.787100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.32","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-11-28T20:01:21.797969+0000","last_change":"2023-11-28T20:01:10.546075+0000","last_active":"2023-11-28T20:01:21.797969+0000","last_peered":"2023-11-28T20:01:21.797969+0000","last_clean":"2023-11-28T20:01:21.797969+0000","last_became_active":"2023-11-28T20:01:10.542038+0000","last_became_peered":"2023-11-28T20:01:10.542038+0000","last_unstale":"2023-11-28T20:01:21.797969+0000","last_undegraded":"2023-11-28T20:01:21.797969+0000","last_fullsized":"2023-11-28T20:01:21.797969+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_clean_scrub_stamp":"2023-11-28T20:01:09.480611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:44:34.399373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.37","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2023-11-28T20:01:22.806216+0000","last_change":"2023-11-28T20:01:22.806216+0000","last_active":"2023-11-28T20:01:22.787100+0000","last_peered":"2023-11-28T20:01:22.787100+0000","last_clean":"2023-11-28T20:01:22.787100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:01:22.806216+0000","last_undegraded":"2023-11-28T20:01:22.806216+0000","last_fullsized":"2023-11-28T20:01:22.806216+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:22.787100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:22.787100+0000","last_clean_scrub_stamp":"2023-11-28T20:01:22.787100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.31","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-11-28T20:01:21.798012+0000","last_change":"2023-11-28T20:01:10.535170+0000","last_active":"2023-11-28T20:01:21.798012+0000","last_peered":"2023-11-28T20:01:21.798012+0000","last_clean":"2023-11-28T20:01:21.798012+0000","last_became_active":"2023-11-28T20:01:10.534881+0000","last_became_peered":"2023-11-28T20:01:10.534881+0000","last_unstale":"2023-11-28T20:01:21.798012+0000","last_undegraded":"2023-11-28T20:01:21.798012+0000","last_fullsized":"2023-11-28T20:01:21.798012+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_clean_scrub_stamp":"2023-11-28T20:01:09.480611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:07:03.844567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.36","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2023-11-28T20:01:22.809354+0000","last_change":"2023-11-28T20:01:22.809354+0000","last_active":"2023-11-28T20:01:22.787100+0000","last_peered":"2023-11-28T20:01:22.787100+0000","last_clean":"2023-11-28T20:01:22.787100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:01:22.809354+0000","last_undegraded":"2023-11-28T20:01:22.809354+0000","last_fullsized":"2023-11-28T20:01:22.809354+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:22.787100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:22.787100+0000","last_clean_scrub_stamp":"2023-11-28T20:01:22.787100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.30","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-11-28T20:01:21.796113+0000","last_change":"2023-11-28T20:01:10.530998+0000","last_active":"2023-11-28T20:01:21.796113+0000","last_peered":"2023-11-28T20:01:21.796113+0000","last_clean":"2023-11-28T20:01:21.796113+0000","last_became_active":"2023-11-28T20:01:10.530709+0000","last_became_peered":"2023-11-28T20:01:10.530709+0000","last_unstale":"2023-11-28T20:01:21.796113+0000","last_undegraded":"2023-11-28T20:01:21.796113+0000","last_fullsized":"2023-11-28T20:01:21.796113+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_clean_scrub_stamp":"2023-11-28T20:01:09.480611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:11:53.891113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.29","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2023-11-28T20:01:22.805327+0000","last_change":"2023-11-28T20:01:22.805327+0000","last_active":"2023-11-28T20:01:22.787100+0000","last_peered":"2023-11-28T20:01:22.787100+0000","last_clean":"2023-11-28T20:01:22.787100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:01:22.805327+0000","last_undegraded":"2023-11-28T20:01:22.805327+0000","last_fullsized":"2023-11-28T20:01:22.805327+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:22.787100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:22.787100+0000","last_clean_scrub_stamp":"2023-11-28T20:01:22.787100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.2f","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-11-28T20:01:21.790410+0000","last_change":"2023-11-28T20:01:10.522350+0000","last_active":"2023-11-28T20:01:21.790410+0000","last_peered":"2023-11-28T20:01:21.790410+0000","last_clean":"2023-11-28T20:01:21.790410+0000","last_became_active":"2023-11-28T20:01:10.522075+0000","last_became_peered":"2023-11-28T20:01:10.522075+0000","last_unstale":"2023-11-28T20:01:21.790410+0000","last_undegraded":"2023-11-28T20:01:21.790410+0000","last_fullsized":"2023-11-28T20:01:21.790410+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_clean_scrub_stamp":"2023-11-28T20:01:09.480611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:18:49.627041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.28","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2023-11-28T20:01:22.805106+0000","last_change":"2023-11-28T20:01:22.805106+0000","last_active":"2023-11-28T20:01:22.787100+0000","last_peered":"2023-11-28T20:01:22.787100+0000","last_clean":"2023-11-28T20:01:22.787100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:01:22.805106+0000","last_undegraded":"2023-11-28T20:01:22.805106+0000","last_fullsized":"2023-11-28T20:01:22.805106+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:22.787100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:22.787100+0000","last_clean_scrub_stamp":"2023-11-28T20:01:22.787100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.2e","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-11-28T20:01:21.792752+0000","last_change":"2023-11-28T20:01:10.521611+0000","last_active":"2023-11-28T20:01:21.792752+0000","last_peered":"2023-11-28T20:01:21.792752+0000","last_clean":"2023-11-28T20:01:21.792752+0000","last_became_active":"2023-11-28T20:01:10.521162+0000","last_became_peered":"2023-11-28T20:01:10.521162+0000","last_unstale":"2023-11-28T20:01:21.792752+0000","last_undegraded":"2023-11-28T20:01:21.792752+0000","last_fullsized":"2023-11-28T20:01:21.792752+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_clean_scrub_stamp":"2023-11-28T20:01:09.480611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:04:56.486213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.2b","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2023-11-28T20:01:22.810297+0000","last_change":"2023-11-28T20:01:22.810297+0000","last_active":"2023-11-28T20:01:22.787100+0000","last_peered":"2023-11-28T20:01:22.787100+0000","last_clean":"2023-11-28T20:01:22.787100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:01:22.810297+0000","last_undegraded":"2023-11-28T20:01:22.810297+0000","last_fullsized":"2023-11-28T20:01:22.810297+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:22.787100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:22.787100+0000","last_clean_scrub_stamp":"2023-11-28T20:01:22.787100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.2d","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-11-28T20:01:21.801643+0000","last_change":"2023-11-28T20:01:10.526160+0000","last_active":"2023-11-28T20:01:21.801643+0000","last_peered":"2023-11-28T20:01:21.801643+0000","last_clean":"2023-11-28T20:01:21.801643+0000","last_became_active":"2023-11-28T20:01:10.525887+0000","last_became_peered":"2023-11-28T20:01:10.525887+0000","last_unstale":"2023-11-28T20:01:21.801643+0000","last_undegraded":"2023-11-28T20:01:21.801643+0000","last_fullsized":"2023-11-28T20:01:21.801643+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_clean_scrub_stamp":"2023-11-28T20:01:09.480611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:49:02.557281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.2a","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2023-11-28T20:01:22.800405+0000","last_change":"2023-11-28T20:01:22.800405+0000","last_active":"2023-11-28T20:01:22.787100+0000","last_peered":"2023-11-28T20:01:22.787100+0000","last_clean":"2023-11-28T20:01:22.787100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:01:22.800405+0000","last_undegraded":"2023-11-28T20:01:22.800405+0000","last_fullsized":"2023-11-28T20:01:22.800405+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:22.787100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:22.787100+0000","last_clean_scrub_stamp":"2023-11-28T20:01:22.787100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.2c","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-11-28T20:01:21.797188+0000","last_change":"2023-11-28T20:01:10.534338+0000","last_active":"2023-11-28T20:01:21.797188+0000","last_peered":"2023-11-28T20:01:21.797188+0000","last_clean":"2023-11-28T20:01:21.797188+0000","last_became_active":"2023-11-28T20:01:10.532397+0000","last_became_peered":"2023-11-28T20:01:10.532397+0000","last_unstale":"2023-11-28T20:01:21.797188+0000","last_undegraded":"2023-11-28T20:01:21.797188+0000","last_fullsized":"2023-11-28T20:01:21.797188+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_clean_scrub_stamp":"2023-11-28T20:01:09.480611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:51:36.724540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.2d","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2023-11-28T20:01:22.801543+0000","last_change":"2023-11-28T20:01:22.801543+0000","last_active":"2023-11-28T20:01:22.787100+0000","last_peered":"2023-11-28T20:01:22.787100+0000","last_clean":"2023-11-28T20:01:22.787100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:01:22.801543+0000","last_undegraded":"2023-11-28T20:01:22.801543+0000","last_fullsized":"2023-11-28T20:01:22.801543+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:22.787100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:22.787100+0000","last_clean_scrub_stamp":"2023-11-28T20:01:22.787100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.2b","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-11-28T20:01:21.793971+0000","last_change":"2023-11-28T20:01:10.528780+0000","last_active":"2023-11-28T20:01:21.793971+0000","last_peered":"2023-11-28T20:01:21.793971+0000","last_clean":"2023-11-28T20:01:21.793971+0000","last_became_active":"2023-11-28T20:01:10.524555+0000","last_became_peered":"2023-11-28T20:01:10.524555+0000","last_unstale":"2023-11-28T20:01:21.793971+0000","last_undegraded":"2023-11-28T20:01:21.793971+0000","last_fullsized":"2023-11-28T20:01:21.793971+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_clean_scrub_stamp":"2023-11-28T20:01:09.480611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:30:22.791908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.2c","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2023-11-28T20:01:22.800383+0000","last_change":"2023-11-28T20:01:22.800383+0000","last_active":"2023-11-28T20:01:22.787100+0000","last_peered":"2023-11-28T20:01:22.787100+0000","last_clean":"2023-11-28T20:01:22.787100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:01:22.800383+0000","last_undegraded":"2023-11-28T20:01:22.800383+0000","last_fullsized":"2023-11-28T20:01:22.800383+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:22.787100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:22.787100+0000","last_clean_scrub_stamp":"2023-11-28T20:01:22.787100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.2a","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-11-28T20:01:21.796467+0000","last_change":"2023-11-28T20:01:10.531958+0000","last_active":"2023-11-28T20:01:21.796467+0000","last_peered":"2023-11-28T20:01:21.796467+0000","last_clean":"2023-11-28T20:01:21.796467+0000","last_became_active":"2023-11-28T20:01:10.531111+0000","last_became_peered":"2023-11-28T20:01:10.531111+0000","last_unstale":"2023-11-28T20:01:21.796467+0000","last_undegraded":"2023-11-28T20:01:21.796467+0000","last_fullsized":"2023-11-28T20:01:21.796467+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_clean_scrub_stamp":"2023-11-28T20:01:09.480611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:52:31.642868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.2f","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2023-11-28T20:01:22.800411+0000","last_change":"2023-11-28T20:01:22.800411+0000","last_active":"2023-11-28T20:01:22.787100+0000","last_peered":"2023-11-28T20:01:22.787100+0000","last_clean":"2023-11-28T20:01:22.787100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:01:22.800411+0000","last_undegraded":"2023-11-28T20:01:22.800411+0000","last_fullsized":"2023-11-28T20:01:22.800411+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:22.787100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:22.787100+0000","last_clean_scrub_stamp":"2023-11-28T20:01:22.787100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.29","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-11-28T20:01:21.796452+0000","last_change":"2023-11-28T20:01:10.533367+0000","last_active":"2023-11-28T20:01:21.796452+0000","last_peered":"2023-11-28T20:01:21.796452+0000","last_clean":"2023-11-28T20:01:21.796452+0000","last_became_active":"2023-11-28T20:01:10.532975+0000","last_became_peered":"2023-11-28T20:01:10.532975+0000","last_unstale":"2023-11-28T20:01:21.796452+0000","last_undegraded":"2023-11-28T20:01:21.796452+0000","last_fullsized":"2023-11-28T20:01:21.796452+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_clean_scrub_stamp":"2023-11-28T20:01:09.480611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:10:30.393696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.2e","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2023-11-28T20:01:22.808991+0000","last_change":"2023-11-28T20:01:22.808991+0000","last_active":"2023-11-28T20:01:22.787100+0000","last_peered":"2023-11-28T20:01:22.787100+0000","last_clean":"2023-11-28T20:01:22.787100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:01:22.808991+0000","last_undegraded":"2023-11-28T20:01:22.808991+0000","last_fullsized":"2023-11-28T20:01:22.808991+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:22.787100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:22.787100+0000","last_clean_scrub_stamp":"2023-11-28T20:01:22.787100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.28","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-11-28T20:01:21.797562+0000","last_change":"2023-11-28T20:01:10.541445+0000","last_active":"2023-11-28T20:01:21.797562+0000","last_peered":"2023-11-28T20:01:21.797562+0000","last_clean":"2023-11-28T20:01:21.797562+0000","last_became_active":"2023-11-28T20:01:10.539375+0000","last_became_peered":"2023-11-28T20:01:10.539375+0000","last_unstale":"2023-11-28T20:01:21.797562+0000","last_undegraded":"2023-11-28T20:01:21.797562+0000","last_fullsized":"2023-11-28T20:01:21.797562+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_clean_scrub_stamp":"2023-11-28T20:01:09.480611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T07:14:21.836133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.21","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2023-11-28T20:01:22.806976+0000","last_change":"2023-11-28T20:01:22.806976+0000","last_active":"2023-11-28T20:01:22.787100+0000","last_peered":"2023-11-28T20:01:22.787100+0000","last_clean":"2023-11-28T20:01:22.787100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:01:22.806976+0000","last_undegraded":"2023-11-28T20:01:22.806976+0000","last_fullsized":"2023-11-28T20:01:22.806976+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:22.787100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:22.787100+0000","last_clean_scrub_stamp":"2023-11-28T20:01:22.787100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.27","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-11-28T20:01:21.794373+0000","last_change":"2023-11-28T20:01:10.531718+0000","last_active":"2023-11-28T20:01:21.794373+0000","last_peered":"2023-11-28T20:01:21.794373+0000","last_clean":"2023-11-28T20:01:21.794373+0000","last_became_active":"2023-11-28T20:01:10.529424+0000","last_became_peered":"2023-11-28T20:01:10.529424+0000","last_unstale":"2023-11-28T20:01:21.794373+0000","last_undegraded":"2023-11-28T20:01:21.794373+0000","last_fullsized":"2023-11-28T20:01:21.794373+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_clean_scrub_stamp":"2023-11-28T20:01:09.480611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:17:27.097887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.20","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2023-11-28T20:01:22.808081+0000","last_change":"2023-11-28T20:01:22.808081+0000","last_active":"2023-11-28T20:01:22.787100+0000","last_peered":"2023-11-28T20:01:22.787100+0000","last_clean":"2023-11-28T20:01:22.787100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:01:22.808081+0000","last_undegraded":"2023-11-28T20:01:22.808081+0000","last_fullsized":"2023-11-28T20:01:22.808081+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:22.787100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:22.787100+0000","last_clean_scrub_stamp":"2023-11-28T20:01:22.787100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.26","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-11-28T20:01:21.794270+0000","last_change":"2023-11-28T20:01:10.530284+0000","last_active":"2023-11-28T20:01:21.794270+0000","last_peered":"2023-11-28T20:01:21.794270+0000","last_clean":"2023-11-28T20:01:21.794270+0000","last_became_active":"2023-11-28T20:01:10.529805+0000","last_became_peered":"2023-11-28T20:01:10.529805+0000","last_unstale":"2023-11-28T20:01:21.794270+0000","last_undegraded":"2023-11-28T20:01:21.794270+0000","last_fullsized":"2023-11-28T20:01:21.794270+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_clean_scrub_stamp":"2023-11-28T20:01:09.480611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:46:29.701039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.23","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2023-11-28T20:01:22.808672+0000","last_change":"2023-11-28T20:01:22.808672+0000","last_active":"2023-11-28T20:01:22.787100+0000","last_peered":"2023-11-28T20:01:22.787100+0000","last_clean":"2023-11-28T20:01:22.787100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:01:22.808672+0000","last_undegraded":"2023-11-28T20:01:22.808672+0000","last_fullsized":"2023-11-28T20:01:22.808672+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:22.787100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:22.787100+0000","last_clean_scrub_stamp":"2023-11-28T20:01:22.787100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.25","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-11-28T20:01:21.791827+0000","last_change":"2023-11-28T20:01:10.519186+0000","last_active":"2023-11-28T20:01:21.791827+0000","last_peered":"2023-11-28T20:01:21.791827+0000","last_clean":"2023-11-28T20:01:21.791827+0000","last_became_active":"2023-11-28T20:01:10.518855+0000","last_became_peered":"2023-11-28T20:01:10.518855+0000","last_unstale":"2023-11-28T20:01:21.791827+0000","last_undegraded":"2023-11-28T20:01:21.791827+0000","last_fullsized":"2023-11-28T20:01:21.791827+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_clean_scrub_stamp":"2023-11-28T20:01:09.480611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:23:19.215371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.22","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2023-11-28T20:01:22.807092+0000","last_change":"2023-11-28T20:01:22.807092+0000","last_active":"2023-11-28T20:01:22.787100+0000","last_peered":"2023-11-28T20:01:22.787100+0000","last_clean":"2023-11-28T20:01:22.787100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:01:22.807092+0000","last_undegraded":"2023-11-28T20:01:22.807092+0000","last_fullsized":"2023-11-28T20:01:22.807092+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:22.787100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:22.787100+0000","last_clean_scrub_stamp":"2023-11-28T20:01:22.787100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.24","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-11-28T20:01:21.789959+0000","last_change":"2023-11-28T20:01:10.537687+0000","last_active":"2023-11-28T20:01:21.789959+0000","last_peered":"2023-11-28T20:01:21.789959+0000","last_clean":"2023-11-28T20:01:21.789959+0000","last_became_active":"2023-11-28T20:01:10.536233+0000","last_became_peered":"2023-11-28T20:01:10.536233+0000","last_unstale":"2023-11-28T20:01:21.789959+0000","last_undegraded":"2023-11-28T20:01:21.789959+0000","last_fullsized":"2023-11-28T20:01:21.789959+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_clean_scrub_stamp":"2023-11-28T20:01:09.480611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:18:17.108795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.25","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2023-11-28T20:01:22.815803+0000","last_change":"2023-11-28T20:01:22.815803+0000","last_active":"2023-11-28T20:01:22.787100+0000","last_peered":"2023-11-28T20:01:22.787100+0000","last_clean":"2023-11-28T20:01:22.787100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:01:22.815803+0000","last_undegraded":"2023-11-28T20:01:22.815803+0000","last_fullsized":"2023-11-28T20:01:22.815803+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:22.787100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:22.787100+0000","last_clean_scrub_stamp":"2023-11-28T20:01:22.787100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.23","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-11-28T20:01:21.798126+0000","last_change":"2023-11-28T20:01:10.534726+0000","last_active":"2023-11-28T20:01:21.798126+0000","last_peered":"2023-11-28T20:01:21.798126+0000","last_clean":"2023-11-28T20:01:21.798126+0000","last_became_active":"2023-11-28T20:01:10.534413+0000","last_became_peered":"2023-11-28T20:01:10.534413+0000","last_unstale":"2023-11-28T20:01:21.798126+0000","last_undegraded":"2023-11-28T20:01:21.798126+0000","last_fullsized":"2023-11-28T20:01:21.798126+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_clean_scrub_stamp":"2023-11-28T20:01:09.480611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:30:22.791908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.24","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2023-11-28T20:01:22.799856+0000","last_change":"2023-11-28T20:01:22.799856+0000","last_active":"2023-11-28T20:01:22.787100+0000","last_peered":"2023-11-28T20:01:22.787100+0000","last_clean":"2023-11-28T20:01:22.787100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:01:22.799856+0000","last_undegraded":"2023-11-28T20:01:22.799856+0000","last_fullsized":"2023-11-28T20:01:22.799856+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:22.787100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:22.787100+0000","last_clean_scrub_stamp":"2023-11-28T20:01:22.787100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.22","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-11-28T20:01:21.793740+0000","last_change":"2023-11-28T20:01:10.534050+0000","last_active":"2023-11-28T20:01:21.793740+0000","last_peered":"2023-11-28T20:01:21.793740+0000","last_clean":"2023-11-28T20:01:21.793740+0000","last_became_active":"2023-11-28T20:01:10.533704+0000","last_became_peered":"2023-11-28T20:01:10.533704+0000","last_unstale":"2023-11-28T20:01:21.793740+0000","last_undegraded":"2023-11-28T20:01:21.793740+0000","last_fullsized":"2023-11-28T20:01:21.793740+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_clean_scrub_stamp":"2023-11-28T20:01:09.480611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:50:58.589965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.27","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2023-11-28T20:01:22.804472+0000","last_change":"2023-11-28T20:01:22.804472+0000","last_active":"2023-11-28T20:01:22.787100+0000","last_peered":"2023-11-28T20:01:22.787100+0000","last_clean":"2023-11-28T20:01:22.787100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:01:22.804472+0000","last_undegraded":"2023-11-28T20:01:22.804472+0000","last_fullsized":"2023-11-28T20:01:22.804472+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:22.787100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:22.787100+0000","last_clean_scrub_stamp":"2023-11-28T20:01:22.787100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.21","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-11-28T20:01:21.791333+0000","last_change":"2023-11-28T20:01:10.520311+0000","last_active":"2023-11-28T20:01:21.791333+0000","last_peered":"2023-11-28T20:01:21.791333+0000","last_clean":"2023-11-28T20:01:21.791333+0000","last_became_active":"2023-11-28T20:01:10.519974+0000","last_became_peered":"2023-11-28T20:01:10.519974+0000","last_unstale":"2023-11-28T20:01:21.791333+0000","last_undegraded":"2023-11-28T20:01:21.791333+0000","last_fullsized":"2023-11-28T20:01:21.791333+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_clean_scrub_stamp":"2023-11-28T20:01:09.480611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T07:02:13.895402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.26","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2023-11-28T20:01:22.808714+0000","last_change":"2023-11-28T20:01:22.808714+0000","last_active":"2023-11-28T20:01:22.787100+0000","last_peered":"2023-11-28T20:01:22.787100+0000","last_clean":"2023-11-28T20:01:22.787100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:01:22.808714+0000","last_undegraded":"2023-11-28T20:01:22.808714+0000","last_fullsized":"2023-11-28T20:01:22.808714+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:22.787100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:22.787100+0000","last_clean_scrub_stamp":"2023-11-28T20:01:22.787100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.20","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-11-28T20:01:21.800585+0000","last_change":"2023-11-28T20:01:10.525223+0000","last_active":"2023-11-28T20:01:21.800585+0000","last_peered":"2023-11-28T20:01:21.800585+0000","last_clean":"2023-11-28T20:01:21.800585+0000","last_became_active":"2023-11-28T20:01:10.524750+0000","last_became_peered":"2023-11-28T20:01:10.524750+0000","last_unstale":"2023-11-28T20:01:21.800585+0000","last_undegraded":"2023-11-28T20:01:21.800585+0000","last_fullsized":"2023-11-28T20:01:21.800585+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_clean_scrub_stamp":"2023-11-28T20:01:09.480611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:50:58.589965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.1a","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2023-11-28T20:01:22.804950+0000","last_change":"2023-11-28T20:01:22.804950+0000","last_active":"2023-11-28T20:01:22.787100+0000","last_peered":"2023-11-28T20:01:22.787100+0000","last_clean":"2023-11-28T20:01:22.787100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:01:22.804950+0000","last_undegraded":"2023-11-28T20:01:22.804950+0000","last_fullsized":"2023-11-28T20:01:22.804950+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:22.787100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:22.787100+0000","last_clean_scrub_stamp":"2023-11-28T20:01:22.787100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1d","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-28T20:01:22.832104+0000","last_change":"2023-11-28T20:01:22.828333+0000","last_active":"2023-11-28T20:01:22.832104+0000","last_peered":"2023-11-28T20:01:22.832104+0000","last_clean":"2023-11-28T20:01:22.832104+0000","last_became_active":"2023-11-28T20:01:22.828042+0000","last_became_peered":"2023-11-28T20:01:22.828042+0000","last_unstale":"2023-11-28T20:01:22.832104+0000","last_undegraded":"2023-11-28T20:01:22.832104+0000","last_fullsized":"2023-11-28T20:01:22.832104+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:21.777981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:21.777981+0000","last_clean_scrub_stamp":"2023-11-28T20:01:21.777981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:51:49.021909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1c","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-11-28T20:01:21.801606+0000","last_change":"2023-11-28T20:01:10.528869+0000","last_active":"2023-11-28T20:01:21.801606+0000","last_peered":"2023-11-28T20:01:21.801606+0000","last_clean":"2023-11-28T20:01:21.801606+0000","last_became_active":"2023-11-28T20:01:10.528572+0000","last_became_peered":"2023-11-28T20:01:10.528572+0000","last_unstale":"2023-11-28T20:01:21.801606+0000","last_undegraded":"2023-11-28T20:01:21.801606+0000","last_fullsized":"2023-11-28T20:01:21.801606+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_clean_scrub_stamp":"2023-11-28T20:01:09.480611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:37:17.516298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.1f","version":"60'4","reported_seq":18,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-11-28T20:01:21.790597+0000","last_change":"2023-11-28T20:01:09.512544+0000","last_active":"2023-11-28T20:01:21.790597+0000","last_peered":"2023-11-28T20:01:21.790597+0000","last_clean":"2023-11-28T20:01:21.790597+0000","last_became_active":"2023-11-28T20:01:09.512197+0000","last_became_peered":"2023-11-28T20:01:09.512197+0000","last_unstale":"2023-11-28T20:01:21.790597+0000","last_undegraded":"2023-11-28T20:01:21.790597+0000","last_fullsized":"2023-11-28T20:01:21.790597+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:08.474257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:08.474257+0000","last_clean_scrub_stamp":"2023-11-28T20:01:08.474257+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:49:01.550926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.1b","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2023-11-28T20:01:22.806830+0000","last_change":"2023-11-28T20:01:22.806830+0000","last_active":"2023-11-28T20:01:22.787100+0000","last_peered":"2023-11-28T20:01:22.787100+0000","last_clean":"2023-11-28T20:01:22.787100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:01:22.806830+0000","last_undegraded":"2023-11-28T20:01:22.806830+0000","last_fullsized":"2023-11-28T20:01:22.806830+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:22.787100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:22.787100+0000","last_clean_scrub_stamp":"2023-11-28T20:01:22.787100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1c","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-28T20:01:22.827276+0000","last_change":"2023-11-28T20:01:22.821621+0000","last_active":"2023-11-28T20:01:22.827276+0000","last_peered":"2023-11-28T20:01:22.827276+0000","last_clean":"2023-11-28T20:01:22.827276+0000","last_became_active":"2023-11-28T20:01:22.821322+0000","last_became_peered":"2023-11-28T20:01:22.821322+0000","last_unstale":"2023-11-28T20:01:22.827276+0000","last_undegraded":"2023-11-28T20:01:22.827276+0000","last_fullsized":"2023-11-28T20:01:22.827276+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:21.777981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:21.777981+0000","last_clean_scrub_stamp":"2023-11-28T20:01:21.777981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:05:44.877415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.1d","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-11-28T20:01:21.791853+0000","last_change":"2023-11-28T20:01:10.528270+0000","last_active":"2023-11-28T20:01:21.791853+0000","last_peered":"2023-11-28T20:01:21.791853+0000","last_clean":"2023-11-28T20:01:21.791853+0000","last_became_active":"2023-11-28T20:01:10.527932+0000","last_became_peered":"2023-11-28T20:01:10.527932+0000","last_unstale":"2023-11-28T20:01:21.791853+0000","last_undegraded":"2023-11-28T20:01:21.791853+0000","last_fullsized":"2023-11-28T20:01:21.791853+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_clean_scrub_stamp":"2023-11-28T20:01:09.480611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T07:21:45.278688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1e","version":"60'1","reported_seq":15,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-11-28T20:01:21.801722+0000","last_change":"2023-11-28T20:01:09.516140+0000","last_active":"2023-11-28T20:01:21.801722+0000","last_peered":"2023-11-28T20:01:21.801722+0000","last_clean":"2023-11-28T20:01:21.801722+0000","last_became_active":"2023-11-28T20:01:09.514007+0000","last_became_peered":"2023-11-28T20:01:09.514007+0000","last_unstale":"2023-11-28T20:01:21.801722+0000","last_undegraded":"2023-11-28T20:01:21.801722+0000","last_fullsized":"2023-11-28T20:01:21.801722+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:08.474257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:08.474257+0000","last_clean_scrub_stamp":"2023-11-28T20:01:08.474257+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:30:21.785554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.18","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2023-11-28T20:01:22.807282+0000","last_change":"2023-11-28T20:01:22.807282+0000","last_active":"2023-11-28T20:01:22.787100+0000","last_peered":"2023-11-28T20:01:22.787100+0000","last_clean":"2023-11-28T20:01:22.787100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:01:22.807282+0000","last_undegraded":"2023-11-28T20:01:22.807282+0000","last_fullsized":"2023-11-28T20:01:22.807282+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:22.787100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:22.787100+0000","last_clean_scrub_stamp":"2023-11-28T20:01:22.787100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.1f","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-28T20:01:22.825882+0000","last_change":"2023-11-28T20:01:22.821923+0000","last_active":"2023-11-28T20:01:22.825882+0000","last_peered":"2023-11-28T20:01:22.825882+0000","last_clean":"2023-11-28T20:01:22.825882+0000","last_became_active":"2023-11-28T20:01:22.821642+0000","last_became_peered":"2023-11-28T20:01:22.821642+0000","last_unstale":"2023-11-28T20:01:22.825882+0000","last_undegraded":"2023-11-28T20:01:22.825882+0000","last_fullsized":"2023-11-28T20:01:22.825882+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:21.777981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:21.777981+0000","last_clean_scrub_stamp":"2023-11-28T20:01:21.777981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:17:30.312696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.1e","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-11-28T20:01:21.801669+0000","last_change":"2023-11-28T20:01:10.526680+0000","last_active":"2023-11-28T20:01:21.801669+0000","last_peered":"2023-11-28T20:01:21.801669+0000","last_clean":"2023-11-28T20:01:21.801669+0000","last_became_active":"2023-11-28T20:01:10.526366+0000","last_became_peered":"2023-11-28T20:01:10.526366+0000","last_unstale":"2023-11-28T20:01:21.801669+0000","last_undegraded":"2023-11-28T20:01:21.801669+0000","last_fullsized":"2023-11-28T20:01:21.801669+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_clean_scrub_stamp":"2023-11-28T20:01:09.480611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:05:54.478424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1d","version":"60'2","reported_seq":16,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-11-28T20:01:21.801620+0000","last_change":"2023-11-28T20:01:09.510600+0000","last_active":"2023-11-28T20:01:21.801620+0000","last_peered":"2023-11-28T20:01:21.801620+0000","last_clean":"2023-11-28T20:01:21.801620+0000","last_became_active":"2023-11-28T20:01:09.510336+0000","last_became_peered":"2023-11-28T20:01:09.510336+0000","last_unstale":"2023-11-28T20:01:21.801620+0000","last_undegraded":"2023-11-28T20:01:21.801620+0000","last_fullsized":"2023-11-28T20:01:21.801620+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:08.474257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:08.474257+0000","last_clean_scrub_stamp":"2023-11-28T20:01:08.474257+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:56:14.988591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.19","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2023-11-28T20:01:22.804536+0000","last_change":"2023-11-28T20:01:22.804536+0000","last_active":"2023-11-28T20:01:22.787100+0000","last_peered":"2023-11-28T20:01:22.787100+0000","last_clean":"2023-11-28T20:01:22.787100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:01:22.804536+0000","last_undegraded":"2023-11-28T20:01:22.804536+0000","last_fullsized":"2023-11-28T20:01:22.804536+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:22.787100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:22.787100+0000","last_clean_scrub_stamp":"2023-11-28T20:01:22.787100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1e","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-28T20:01:22.832207+0000","last_change":"2023-11-28T20:01:22.828784+0000","last_active":"2023-11-28T20:01:22.832207+0000","last_peered":"2023-11-28T20:01:22.832207+0000","last_clean":"2023-11-28T20:01:22.832207+0000","last_became_active":"2023-11-28T20:01:22.828228+0000","last_became_peered":"2023-11-28T20:01:22.828228+0000","last_unstale":"2023-11-28T20:01:22.832207+0000","last_undegraded":"2023-11-28T20:01:22.832207+0000","last_fullsized":"2023-11-28T20:01:22.832207+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:21.777981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:21.777981+0000","last_clean_scrub_stamp":"2023-11-28T20:01:21.777981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:02:43.254120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1f","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-11-28T20:01:21.799642+0000","last_change":"2023-11-28T20:01:10.541960+0000","last_active":"2023-11-28T20:01:21.799642+0000","last_peered":"2023-11-28T20:01:21.799642+0000","last_clean":"2023-11-28T20:01:21.799642+0000","last_became_active":"2023-11-28T20:01:10.541305+0000","last_became_peered":"2023-11-28T20:01:10.541305+0000","last_unstale":"2023-11-28T20:01:21.799642+0000","last_undegraded":"2023-11-28T20:01:21.799642+0000","last_fullsized":"2023-11-28T20:01:21.799642+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_clean_scrub_stamp":"2023-11-28T20:01:09.480611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:17:27.097887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.1c","version":"60'2","reported_seq":16,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-11-28T20:01:21.801386+0000","last_change":"2023-11-28T20:01:09.507988+0000","last_active":"2023-11-28T20:01:21.801386+0000","last_peered":"2023-11-28T20:01:21.801386+0000","last_clean":"2023-11-28T20:01:21.801386+0000","last_became_active":"2023-11-28T20:01:09.507762+0000","last_became_peered":"2023-11-28T20:01:09.507762+0000","last_unstale":"2023-11-28T20:01:21.801386+0000","last_undegraded":"2023-11-28T20:01:21.801386+0000","last_fullsized":"2023-11-28T20:01:21.801386+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:08.474257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:08.474257+0000","last_clean_scrub_stamp":"2023-11-28T20:01:08.474257+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T07:14:20.829778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.1e","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2023-11-28T20:01:22.806058+0000","last_change":"2023-11-28T20:01:22.806058+0000","last_active":"2023-11-28T20:01:22.787100+0000","last_peered":"2023-11-28T20:01:22.787100+0000","last_clean":"2023-11-28T20:01:22.787100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:01:22.806058+0000","last_undegraded":"2023-11-28T20:01:22.806058+0000","last_fullsized":"2023-11-28T20:01:22.806058+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:22.787100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:22.787100+0000","last_clean_scrub_stamp":"2023-11-28T20:01:22.787100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-28T20:01:22.821300+0000","last_change":"2023-11-28T20:01:22.818660+0000","last_active":"2023-11-28T20:01:22.821300+0000","last_peered":"2023-11-28T20:01:22.821300+0000","last_clean":"2023-11-28T20:01:22.821300+0000","last_became_active":"2023-11-28T20:01:22.818352+0000","last_became_peered":"2023-11-28T20:01:22.818352+0000","last_unstale":"2023-11-28T20:01:22.821300+0000","last_undegraded":"2023-11-28T20:01:22.821300+0000","last_fullsized":"2023-11-28T20:01:22.821300+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:21.777981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:21.777981+0000","last_clean_scrub_stamp":"2023-11-28T20:01:21.777981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:59:20.866094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-11-28T20:01:21.796193+0000","last_change":"2023-11-28T20:01:10.518032+0000","last_active":"2023-11-28T20:01:21.796193+0000","last_peered":"2023-11-28T20:01:21.796193+0000","last_clean":"2023-11-28T20:01:21.796193+0000","last_became_active":"2023-11-28T20:01:10.517780+0000","last_became_peered":"2023-11-28T20:01:10.517780+0000","last_unstale":"2023-11-28T20:01:21.796193+0000","last_undegraded":"2023-11-28T20:01:21.796193+0000","last_fullsized":"2023-11-28T20:01:21.796193+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_clean_scrub_stamp":"2023-11-28T20:01:09.480611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:43:39.118896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.1b","version":"60'1","reported_seq":15,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-11-28T20:01:21.797196+0000","last_change":"2023-11-28T20:01:09.514901+0000","last_active":"2023-11-28T20:01:21.797196+0000","last_peered":"2023-11-28T20:01:21.797196+0000","last_clean":"2023-11-28T20:01:21.797196+0000","last_became_active":"2023-11-28T20:01:09.514568+0000","last_became_peered":"2023-11-28T20:01:09.514568+0000","last_unstale":"2023-11-28T20:01:21.797196+0000","last_undegraded":"2023-11-28T20:01:21.797196+0000","last_fullsized":"2023-11-28T20:01:21.797196+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:08.474257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:08.474257+0000","last_clean_scrub_stamp":"2023-11-28T20:01:08.474257+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:44:33.393018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.1f","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2023-11-28T20:01:22.808178+0000","last_change":"2023-11-28T20:01:22.808178+0000","last_active":"2023-11-28T20:01:22.787100+0000","last_peered":"2023-11-28T20:01:22.787100+0000","last_clean":"2023-11-28T20:01:22.787100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:01:22.808178+0000","last_undegraded":"2023-11-28T20:01:22.808178+0000","last_fullsized":"2023-11-28T20:01:22.808178+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:22.787100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:22.787100+0000","last_clean_scrub_stamp":"2023-11-28T20:01:22.787100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-28T20:01:22.816804+0000","last_change":"2023-11-28T20:01:22.811015+0000","last_active":"2023-11-28T20:01:22.816804+0000","last_peered":"2023-11-28T20:01:22.816804+0000","last_clean":"2023-11-28T20:01:22.816804+0000","last_became_active":"2023-11-28T20:01:22.810559+0000","last_became_peered":"2023-11-28T20:01:22.810559+0000","last_unstale":"2023-11-28T20:01:22.816804+0000","last_undegraded":"2023-11-28T20:01:22.816804+0000","last_fullsized":"2023-11-28T20:01:22.816804+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:21.777981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:21.777981+0000","last_clean_scrub_stamp":"2023-11-28T20:01:21.777981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:14:31.333418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-11-28T20:01:21.789863+0000","last_change":"2023-11-28T20:01:10.522005+0000","last_active":"2023-11-28T20:01:21.789863+0000","last_peered":"2023-11-28T20:01:21.789863+0000","last_clean":"2023-11-28T20:01:21.789863+0000","last_became_active":"2023-11-28T20:01:10.521691+0000","last_became_peered":"2023-11-28T20:01:10.521691+0000","last_unstale":"2023-11-28T20:01:21.789863+0000","last_undegraded":"2023-11-28T20:01:21.789863+0000","last_fullsized":"2023-11-28T20:01:21.789863+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_clean_scrub_stamp":"2023-11-28T20:01:09.480611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:11:08.794514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1a","version":"60'1","reported_seq":15,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-11-28T20:01:21.796566+0000","last_change":"2023-11-28T20:01:09.510388+0000","last_active":"2023-11-28T20:01:21.796566+0000","last_peered":"2023-11-28T20:01:21.796566+0000","last_clean":"2023-11-28T20:01:21.796566+0000","last_became_active":"2023-11-28T20:01:09.510114+0000","last_became_peered":"2023-11-28T20:01:09.510114+0000","last_unstale":"2023-11-28T20:01:21.796566+0000","last_undegraded":"2023-11-28T20:01:21.796566+0000","last_fullsized":"2023-11-28T20:01:21.796566+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:08.474257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:08.474257+0000","last_clean_scrub_stamp":"2023-11-28T20:01:08.474257+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T06:29:12.572972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.1c","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2023-11-28T20:01:22.805361+0000","last_change":"2023-11-28T20:01:22.805361+0000","last_active":"2023-11-28T20:01:22.787100+0000","last_peered":"2023-11-28T20:01:22.787100+0000","last_clean":"2023-11-28T20:01:22.787100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:01:22.805361+0000","last_undegraded":"2023-11-28T20:01:22.805361+0000","last_fullsized":"2023-11-28T20:01:22.805361+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:22.787100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:22.787100+0000","last_clean_scrub_stamp":"2023-11-28T20:01:22.787100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1b","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-28T20:01:22.829871+0000","last_change":"2023-11-28T20:01:22.826731+0000","last_active":"2023-11-28T20:01:22.829871+0000","last_peered":"2023-11-28T20:01:22.829871+0000","last_clean":"2023-11-28T20:01:22.829871+0000","last_became_active":"2023-11-28T20:01:22.826278+0000","last_became_peered":"2023-11-28T20:01:22.826278+0000","last_unstale":"2023-11-28T20:01:22.829871+0000","last_undegraded":"2023-11-28T20:01:22.829871+0000","last_fullsized":"2023-11-28T20:01:22.829871+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:21.777981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:21.777981+0000","last_clean_scrub_stamp":"2023-11-28T20:01:21.777981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T07:05:57.693273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.1a","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-11-28T20:01:21.801060+0000","last_change":"2023-11-28T20:01:10.536831+0000","last_active":"2023-11-28T20:01:21.801060+0000","last_peered":"2023-11-28T20:01:21.801060+0000","last_clean":"2023-11-28T20:01:21.801060+0000","last_became_active":"2023-11-28T20:01:10.536506+0000","last_became_peered":"2023-11-28T20:01:10.536506+0000","last_unstale":"2023-11-28T20:01:21.801060+0000","last_undegraded":"2023-11-28T20:01:21.801060+0000","last_fullsized":"2023-11-28T20:01:21.801060+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_clean_scrub_stamp":"2023-11-28T20:01:09.480611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:29:39.856095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":14,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-11-28T20:01:21.796477+0000","last_change":"2023-11-28T20:01:09.514530+0000","last_active":"2023-11-28T20:01:21.796477+0000","last_peered":"2023-11-28T20:01:21.796477+0000","last_clean":"2023-11-28T20:01:21.796477+0000","last_became_active":"2023-11-28T20:01:09.514112+0000","last_became_peered":"2023-11-28T20:01:09.514112+0000","last_unstale":"2023-11-28T20:01:21.796477+0000","last_undegraded":"2023-11-28T20:01:21.796477+0000","last_fullsized":"2023-11-28T20:01:21.796477+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:08.474257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:08.474257+0000","last_clean_scrub_stamp":"2023-11-28T20:01:08.474257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:07:02.838212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.1d","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2023-11-28T20:01:22.804949+0000","last_change":"2023-11-28T20:01:22.804949+0000","last_active":"2023-11-28T20:01:22.787100+0000","last_peered":"2023-11-28T20:01:22.787100+0000","last_clean":"2023-11-28T20:01:22.787100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:01:22.804949+0000","last_undegraded":"2023-11-28T20:01:22.804949+0000","last_fullsized":"2023-11-28T20:01:22.804949+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:22.787100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:22.787100+0000","last_clean_scrub_stamp":"2023-11-28T20:01:22.787100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1a","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-28T20:01:22.827278+0000","last_change":"2023-11-28T20:01:22.823414+0000","last_active":"2023-11-28T20:01:22.827278+0000","last_peered":"2023-11-28T20:01:22.827278+0000","last_clean":"2023-11-28T20:01:22.827278+0000","last_became_active":"2023-11-28T20:01:22.823073+0000","last_became_peered":"2023-11-28T20:01:22.823073+0000","last_unstale":"2023-11-28T20:01:22.827278+0000","last_undegraded":"2023-11-28T20:01:22.827278+0000","last_fullsized":"2023-11-28T20:01:22.827278+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:21.777981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:21.777981+0000","last_clean_scrub_stamp":"2023-11-28T20:01:21.777981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:13:17.072225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.1b","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-11-28T20:01:21.797586+0000","last_change":"2023-11-28T20:01:10.522250+0000","last_active":"2023-11-28T20:01:21.797586+0000","last_peered":"2023-11-28T20:01:21.797586+0000","last_clean":"2023-11-28T20:01:21.797586+0000","last_became_active":"2023-11-28T20:01:10.521958+0000","last_became_peered":"2023-11-28T20:01:10.521958+0000","last_unstale":"2023-11-28T20:01:21.797586+0000","last_undegraded":"2023-11-28T20:01:21.797586+0000","last_fullsized":"2023-11-28T20:01:21.797586+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_clean_scrub_stamp":"2023-11-28T20:01:09.480611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:59:08.568724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":14,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-11-28T20:01:21.801005+0000","last_change":"2023-11-28T20:01:09.512078+0000","last_active":"2023-11-28T20:01:21.801005+0000","last_peered":"2023-11-28T20:01:21.801005+0000","last_clean":"2023-11-28T20:01:21.801005+0000","last_became_active":"2023-11-28T20:01:09.511733+0000","last_became_peered":"2023-11-28T20:01:09.511733+0000","last_unstale":"2023-11-28T20:01:21.801005+0000","last_undegraded":"2023-11-28T20:01:21.801005+0000","last_fullsized":"2023-11-28T20:01:21.801005+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:08.474257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:08.474257+0000","last_clean_scrub_stamp":"2023-11-28T20:01:08.474257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:16:29.294303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.12","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2023-11-28T20:01:22.801913+0000","last_change":"2023-11-28T20:01:22.801913+0000","last_active":"2023-11-28T20:01:22.787100+0000","last_peered":"2023-11-28T20:01:22.787100+0000","last_clean":"2023-11-28T20:01:22.787100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:01:22.801913+0000","last_undegraded":"2023-11-28T20:01:22.801913+0000","last_fullsized":"2023-11-28T20:01:22.801913+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:22.787100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:22.787100+0000","last_clean_scrub_stamp":"2023-11-28T20:01:22.787100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.15","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-28T20:01:22.828323+0000","last_change":"2023-11-28T20:01:22.818633+0000","last_active":"2023-11-28T20:01:22.828323+0000","last_peered":"2023-11-28T20:01:22.828323+0000","last_clean":"2023-11-28T20:01:22.828323+0000","last_became_active":"2023-11-28T20:01:22.818036+0000","last_became_peered":"2023-11-28T20:01:22.818036+0000","last_unstale":"2023-11-28T20:01:22.828323+0000","last_undegraded":"2023-11-28T20:01:22.828323+0000","last_fullsized":"2023-11-28T20:01:22.828323+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:21.777981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:21.777981+0000","last_clean_scrub_stamp":"2023-11-28T20:01:21.777981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:18:51.761689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.14","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-11-28T20:01:21.790040+0000","last_change":"2023-11-28T20:01:10.517714+0000","last_active":"2023-11-28T20:01:21.790040+0000","last_peered":"2023-11-28T20:01:21.790040+0000","last_clean":"2023-11-28T20:01:21.790040+0000","last_became_active":"2023-11-28T20:01:10.517414+0000","last_became_peered":"2023-11-28T20:01:10.517414+0000","last_unstale":"2023-11-28T20:01:21.790040+0000","last_undegraded":"2023-11-28T20:01:21.790040+0000","last_fullsized":"2023-11-28T20:01:21.790040+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_clean_scrub_stamp":"2023-11-28T20:01:09.480611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T06:10:19.765319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":14,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-11-28T20:01:21.799883+0000","last_change":"2023-11-28T20:01:09.519465+0000","last_active":"2023-11-28T20:01:21.799883+0000","last_peered":"2023-11-28T20:01:21.799883+0000","last_clean":"2023-11-28T20:01:21.799883+0000","last_became_active":"2023-11-28T20:01:09.519233+0000","last_became_peered":"2023-11-28T20:01:09.519233+0000","last_unstale":"2023-11-28T20:01:21.799883+0000","last_undegraded":"2023-11-28T20:01:21.799883+0000","last_fullsized":"2023-11-28T20:01:21.799883+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:08.474257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:08.474257+0000","last_clean_scrub_stamp":"2023-11-28T20:01:08.474257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T07:34:36.168268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.13","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2023-11-28T20:01:22.809235+0000","last_change":"2023-11-28T20:01:22.809235+0000","last_active":"2023-11-28T20:01:22.787100+0000","last_peered":"2023-11-28T20:01:22.787100+0000","last_clean":"2023-11-28T20:01:22.787100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:01:22.809235+0000","last_undegraded":"2023-11-28T20:01:22.809235+0000","last_fullsized":"2023-11-28T20:01:22.809235+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:22.787100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:22.787100+0000","last_clean_scrub_stamp":"2023-11-28T20:01:22.787100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.14","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-28T20:01:22.821306+0000","last_change":"2023-11-28T20:01:22.818713+0000","last_active":"2023-11-28T20:01:22.821306+0000","last_peered":"2023-11-28T20:01:22.821306+0000","last_clean":"2023-11-28T20:01:22.821306+0000","last_became_active":"2023-11-28T20:01:22.817121+0000","last_became_peered":"2023-11-28T20:01:22.817121+0000","last_unstale":"2023-11-28T20:01:22.821306+0000","last_undegraded":"2023-11-28T20:01:22.821306+0000","last_fullsized":"2023-11-28T20:01:22.821306+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:21.777981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:21.777981+0000","last_clean_scrub_stamp":"2023-11-28T20:01:21.777981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:56:28.292315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.15","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-11-28T20:01:21.797005+0000","last_change":"2023-11-28T20:01:10.533748+0000","last_active":"2023-11-28T20:01:21.797005+0000","last_peered":"2023-11-28T20:01:21.797005+0000","last_clean":"2023-11-28T20:01:21.797005+0000","last_became_active":"2023-11-28T20:01:10.533411+0000","last_became_peered":"2023-11-28T20:01:10.533411+0000","last_unstale":"2023-11-28T20:01:21.797005+0000","last_undegraded":"2023-11-28T20:01:21.797005+0000","last_fullsized":"2023-11-28T20:01:21.797005+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_clean_scrub_stamp":"2023-11-28T20:01:09.480611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:58:23.470366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":14,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-11-28T20:01:21.792925+0000","last_change":"2023-11-28T20:01:09.507203+0000","last_active":"2023-11-28T20:01:21.792925+0000","last_peered":"2023-11-28T20:01:21.792925+0000","last_clean":"2023-11-28T20:01:21.792925+0000","last_became_active":"2023-11-28T20:01:09.506901+0000","last_became_peered":"2023-11-28T20:01:09.506901+0000","last_unstale":"2023-11-28T20:01:21.792925+0000","last_undegraded":"2023-11-28T20:01:21.792925+0000","last_fullsized":"2023-11-28T20:01:21.792925+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:08.474257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:08.474257+0000","last_clean_scrub_stamp":"2023-11-28T20:01:08.474257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:15:27.309843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.10","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2023-11-28T20:01:22.804660+0000","last_change":"2023-11-28T20:01:22.804660+0000","last_active":"2023-11-28T20:01:22.787100+0000","last_peered":"2023-11-28T20:01:22.787100+0000","last_clean":"2023-11-28T20:01:22.787100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:01:22.804660+0000","last_undegraded":"2023-11-28T20:01:22.804660+0000","last_fullsized":"2023-11-28T20:01:22.804660+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:22.787100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:22.787100+0000","last_clean_scrub_stamp":"2023-11-28T20:01:22.787100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.17","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-28T20:01:22.832084+0000","last_change":"2023-11-28T20:01:22.828593+0000","last_active":"2023-11-28T20:01:22.832084+0000","last_peered":"2023-11-28T20:01:22.832084+0000","last_clean":"2023-11-28T20:01:22.832084+0000","last_became_active":"2023-11-28T20:01:22.828323+0000","last_became_peered":"2023-11-28T20:01:22.828323+0000","last_unstale":"2023-11-28T20:01:22.832084+0000","last_undegraded":"2023-11-28T20:01:22.832084+0000","last_fullsized":"2023-11-28T20:01:22.832084+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:21.777981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:21.777981+0000","last_clean_scrub_stamp":"2023-11-28T20:01:21.777981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:58:35.767735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-11-28T20:01:21.801739+0000","last_change":"2023-11-28T20:01:10.537355+0000","last_active":"2023-11-28T20:01:21.801739+0000","last_peered":"2023-11-28T20:01:21.801739+0000","last_clean":"2023-11-28T20:01:21.801739+0000","last_became_active":"2023-11-28T20:01:10.536210+0000","last_became_peered":"2023-11-28T20:01:10.536210+0000","last_unstale":"2023-11-28T20:01:21.801739+0000","last_undegraded":"2023-11-28T20:01:21.801739+0000","last_fullsized":"2023-11-28T20:01:21.801739+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_clean_scrub_stamp":"2023-11-28T20:01:09.480611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T07:05:45.395904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.15","version":"60'3","reported_seq":17,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-11-28T20:01:21.798567+0000","last_change":"2023-11-28T20:01:09.519066+0000","last_active":"2023-11-28T20:01:21.798567+0000","last_peered":"2023-11-28T20:01:21.798567+0000","last_clean":"2023-11-28T20:01:21.798567+0000","last_became_active":"2023-11-28T20:01:09.518151+0000","last_became_peered":"2023-11-28T20:01:09.518151+0000","last_unstale":"2023-11-28T20:01:21.798567+0000","last_undegraded":"2023-11-28T20:01:21.798567+0000","last_fullsized":"2023-11-28T20:01:21.798567+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:08.474257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:08.474257+0000","last_clean_scrub_stamp":"2023-11-28T20:01:08.474257+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:00:29.783639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.11","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2023-11-28T20:01:22.808212+0000","last_change":"2023-11-28T20:01:22.808212+0000","last_active":"2023-11-28T20:01:22.787100+0000","last_peered":"2023-11-28T20:01:22.787100+0000","last_clean":"2023-11-28T20:01:22.787100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:01:22.808212+0000","last_undegraded":"2023-11-28T20:01:22.808212+0000","last_fullsized":"2023-11-28T20:01:22.808212+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:22.787100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:22.787100+0000","last_clean_scrub_stamp":"2023-11-28T20:01:22.787100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-28T20:01:22.823605+0000","last_change":"2023-11-28T20:01:22.819332+0000","last_active":"2023-11-28T20:01:22.823605+0000","last_peered":"2023-11-28T20:01:22.823605+0000","last_clean":"2023-11-28T20:01:22.823605+0000","last_became_active":"2023-11-28T20:01:22.818798+0000","last_became_peered":"2023-11-28T20:01:22.818798+0000","last_unstale":"2023-11-28T20:01:22.823605+0000","last_undegraded":"2023-11-28T20:01:22.823605+0000","last_fullsized":"2023-11-28T20:01:22.823605+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:21.777981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:21.777981+0000","last_clean_scrub_stamp":"2023-11-28T20:01:21.777981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:30:50.602373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.17","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-11-28T20:01:21.791581+0000","last_change":"2023-11-28T20:01:10.521819+0000","last_active":"2023-11-28T20:01:21.791581+0000","last_peered":"2023-11-28T20:01:21.791581+0000","last_clean":"2023-11-28T20:01:21.791581+0000","last_became_active":"2023-11-28T20:01:10.521475+0000","last_became_peered":"2023-11-28T20:01:10.521475+0000","last_unstale":"2023-11-28T20:01:21.791581+0000","last_undegraded":"2023-11-28T20:01:21.791581+0000","last_fullsized":"2023-11-28T20:01:21.791581+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_clean_scrub_stamp":"2023-11-28T20:01:09.480611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:16:30.300658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.14","version":"61'8","reported_seq":22,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-11-28T20:01:21.790211+0000","last_change":"2023-11-28T20:01:09.511176+0000","last_active":"2023-11-28T20:01:21.790211+0000","last_peered":"2023-11-28T20:01:21.790211+0000","last_clean":"2023-11-28T20:01:21.790211+0000","last_became_active":"2023-11-28T20:01:09.510427+0000","last_became_peered":"2023-11-28T20:01:09.510427+0000","last_unstale":"2023-11-28T20:01:21.790211+0000","last_undegraded":"2023-11-28T20:01:21.790211+0000","last_fullsized":"2023-11-28T20:01:21.790211+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:08.474257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:08.474257+0000","last_clean_scrub_stamp":"2023-11-28T20:01:08.474257+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:47:12.268146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3107,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.16","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2023-11-28T20:01:22.802114+0000","last_change":"2023-11-28T20:01:22.802114+0000","last_active":"2023-11-28T20:01:22.787100+0000","last_peered":"2023-11-28T20:01:22.787100+0000","last_clean":"2023-11-28T20:01:22.787100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:01:22.802114+0000","last_undegraded":"2023-11-28T20:01:22.802114+0000","last_fullsized":"2023-11-28T20:01:22.802114+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:22.787100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:22.787100+0000","last_clean_scrub_stamp":"2023-11-28T20:01:22.787100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-28T20:01:22.817286+0000","last_change":"2023-11-28T20:01:22.812353+0000","last_active":"2023-11-28T20:01:22.817286+0000","last_peered":"2023-11-28T20:01:22.817286+0000","last_clean":"2023-11-28T20:01:22.817286+0000","last_became_active":"2023-11-28T20:01:22.812090+0000","last_became_peered":"2023-11-28T20:01:22.812090+0000","last_unstale":"2023-11-28T20:01:22.817286+0000","last_undegraded":"2023-11-28T20:01:22.817286+0000","last_fullsized":"2023-11-28T20:01:22.817286+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:21.777981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:21.777981+0000","last_clean_scrub_stamp":"2023-11-28T20:01:21.777981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:54:32.863267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.10","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-11-28T20:01:21.791194+0000","last_change":"2023-11-28T20:01:10.533224+0000","last_active":"2023-11-28T20:01:21.791194+0000","last_peered":"2023-11-28T20:01:21.791194+0000","last_clean":"2023-11-28T20:01:21.791194+0000","last_became_active":"2023-11-28T20:01:10.532909+0000","last_became_peered":"2023-11-28T20:01:10.532909+0000","last_unstale":"2023-11-28T20:01:21.791194+0000","last_undegraded":"2023-11-28T20:01:21.791194+0000","last_fullsized":"2023-11-28T20:01:21.791194+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_clean_scrub_stamp":"2023-11-28T20:01:09.480611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:32:06.877460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.13","version":"60'2","reported_seq":16,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-11-28T20:01:21.798151+0000","last_change":"2023-11-28T20:01:09.518379+0000","last_active":"2023-11-28T20:01:21.798151+0000","last_peered":"2023-11-28T20:01:21.798151+0000","last_clean":"2023-11-28T20:01:21.798151+0000","last_became_active":"2023-11-28T20:01:09.518073+0000","last_became_peered":"2023-11-28T20:01:09.518073+0000","last_unstale":"2023-11-28T20:01:21.798151+0000","last_undegraded":"2023-11-28T20:01:21.798151+0000","last_fullsized":"2023-11-28T20:01:21.798151+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:08.474257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:08.474257+0000","last_clean_scrub_stamp":"2023-11-28T20:01:08.474257+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:11:07.788160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.17","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2023-11-28T20:01:22.807329+0000","last_change":"2023-11-28T20:01:22.807329+0000","last_active":"2023-11-28T20:01:22.787100+0000","last_peered":"2023-11-28T20:01:22.787100+0000","last_clean":"2023-11-28T20:01:22.787100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:01:22.807329+0000","last_undegraded":"2023-11-28T20:01:22.807329+0000","last_fullsized":"2023-11-28T20:01:22.807329+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:22.787100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:22.787100+0000","last_clean_scrub_stamp":"2023-11-28T20:01:22.787100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.10","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-28T20:01:22.821250+0000","last_change":"2023-11-28T20:01:22.818135+0000","last_active":"2023-11-28T20:01:22.821250+0000","last_peered":"2023-11-28T20:01:22.821250+0000","last_clean":"2023-11-28T20:01:22.821250+0000","last_became_active":"2023-11-28T20:01:22.817952+0000","last_became_peered":"2023-11-28T20:01:22.817952+0000","last_unstale":"2023-11-28T20:01:22.821250+0000","last_undegraded":"2023-11-28T20:01:22.821250+0000","last_fullsized":"2023-11-28T20:01:22.821250+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:21.777981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:21.777981+0000","last_clean_scrub_stamp":"2023-11-28T20:01:21.777981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:10:42.691065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-11-28T20:01:21.793268+0000","last_change":"2023-11-28T20:01:10.520948+0000","last_active":"2023-11-28T20:01:21.793268+0000","last_peered":"2023-11-28T20:01:21.793268+0000","last_clean":"2023-11-28T20:01:21.793268+0000","last_became_active":"2023-11-28T20:01:10.520649+0000","last_became_peered":"2023-11-28T20:01:10.520649+0000","last_unstale":"2023-11-28T20:01:21.793268+0000","last_undegraded":"2023-11-28T20:01:21.793268+0000","last_fullsized":"2023-11-28T20:01:21.793268+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_clean_scrub_stamp":"2023-11-28T20:01:09.480611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:10:34.830531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":14,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-11-28T20:01:21.793840+0000","last_change":"2023-11-28T20:01:09.510604+0000","last_active":"2023-11-28T20:01:21.793840+0000","last_peered":"2023-11-28T20:01:21.793840+0000","last_clean":"2023-11-28T20:01:21.793840+0000","last_became_active":"2023-11-28T20:01:09.510326+0000","last_became_peered":"2023-11-28T20:01:09.510326+0000","last_unstale":"2023-11-28T20:01:21.793840+0000","last_undegraded":"2023-11-28T20:01:21.793840+0000","last_fullsized":"2023-11-28T20:01:21.793840+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:08.474257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:08.474257+0000","last_clean_scrub_stamp":"2023-11-28T20:01:08.474257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:56:14.988591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.14","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2023-11-28T20:01:22.809339+0000","last_change":"2023-11-28T20:01:22.809339+0000","last_active":"2023-11-28T20:01:22.787100+0000","last_peered":"2023-11-28T20:01:22.787100+0000","last_clean":"2023-11-28T20:01:22.787100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:01:22.809339+0000","last_undegraded":"2023-11-28T20:01:22.809339+0000","last_fullsized":"2023-11-28T20:01:22.809339+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:22.787100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:22.787100+0000","last_clean_scrub_stamp":"2023-11-28T20:01:22.787100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.13","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-28T20:01:22.823674+0000","last_change":"2023-11-28T20:01:22.820361+0000","last_active":"2023-11-28T20:01:22.823674+0000","last_peered":"2023-11-28T20:01:22.823674+0000","last_clean":"2023-11-28T20:01:22.823674+0000","last_became_active":"2023-11-28T20:01:22.820048+0000","last_became_peered":"2023-11-28T20:01:22.820048+0000","last_unstale":"2023-11-28T20:01:22.823674+0000","last_undegraded":"2023-11-28T20:01:22.823674+0000","last_fullsized":"2023-11-28T20:01:22.823674+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:21.777981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:21.777981+0000","last_clean_scrub_stamp":"2023-11-28T20:01:21.777981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:59:20.866094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-11-28T20:01:21.801157+0000","last_change":"2023-11-28T20:01:10.527110+0000","last_active":"2023-11-28T20:01:21.801157+0000","last_peered":"2023-11-28T20:01:21.801157+0000","last_clean":"2023-11-28T20:01:21.801157+0000","last_became_active":"2023-11-28T20:01:10.525827+0000","last_became_peered":"2023-11-28T20:01:10.525827+0000","last_unstale":"2023-11-28T20:01:21.801157+0000","last_undegraded":"2023-11-28T20:01:21.801157+0000","last_fullsized":"2023-11-28T20:01:21.801157+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_clean_scrub_stamp":"2023-11-28T20:01:09.480611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:23:02.818476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":14,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-11-28T20:01:21.798244+0000","last_change":"2023-11-28T20:01:09.519626+0000","last_active":"2023-11-28T20:01:21.798244+0000","last_peered":"2023-11-28T20:01:21.798244+0000","last_clean":"2023-11-28T20:01:21.798244+0000","last_became_active":"2023-11-28T20:01:09.519349+0000","last_became_peered":"2023-11-28T20:01:09.519349+0000","last_unstale":"2023-11-28T20:01:21.798244+0000","last_undegraded":"2023-11-28T20:01:21.798244+0000","last_fullsized":"2023-11-28T20:01:21.798244+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:08.474257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:08.474257+0000","last_clean_scrub_stamp":"2023-11-28T20:01:08.474257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:04:51.492194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.15","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2023-11-28T20:01:22.803505+0000","last_change":"2023-11-28T20:01:22.803505+0000","last_active":"2023-11-28T20:01:22.787100+0000","last_peered":"2023-11-28T20:01:22.787100+0000","last_clean":"2023-11-28T20:01:22.787100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:01:22.803505+0000","last_undegraded":"2023-11-28T20:01:22.803505+0000","last_fullsized":"2023-11-28T20:01:22.803505+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:22.787100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:22.787100+0000","last_clean_scrub_stamp":"2023-11-28T20:01:22.787100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.12","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-28T20:01:22.829149+0000","last_change":"2023-11-28T20:01:22.826285+0000","last_active":"2023-11-28T20:01:22.829149+0000","last_peered":"2023-11-28T20:01:22.829149+0000","last_clean":"2023-11-28T20:01:22.829149+0000","last_became_active":"2023-11-28T20:01:22.825975+0000","last_became_peered":"2023-11-28T20:01:22.825975+0000","last_unstale":"2023-11-28T20:01:22.829149+0000","last_undegraded":"2023-11-28T20:01:22.829149+0000","last_fullsized":"2023-11-28T20:01:22.829149+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:21.777981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:21.777981+0000","last_clean_scrub_stamp":"2023-11-28T20:01:21.777981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:10:42.691065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.13","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-11-28T20:01:21.790303+0000","last_change":"2023-11-28T20:01:10.535178+0000","last_active":"2023-11-28T20:01:21.790303+0000","last_peered":"2023-11-28T20:01:21.790303+0000","last_clean":"2023-11-28T20:01:21.790303+0000","last_became_active":"2023-11-28T20:01:10.534880+0000","last_became_peered":"2023-11-28T20:01:10.534880+0000","last_unstale":"2023-11-28T20:01:21.790303+0000","last_undegraded":"2023-11-28T20:01:21.790303+0000","last_fullsized":"2023-11-28T20:01:21.790303+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_clean_scrub_stamp":"2023-11-28T20:01:09.480611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:52:42.741966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.10","version":"60'8","reported_seq":22,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-11-28T20:01:21.791303+0000","last_change":"2023-11-28T20:01:09.511628+0000","last_active":"2023-11-28T20:01:21.791303+0000","last_peered":"2023-11-28T20:01:21.791303+0000","last_clean":"2023-11-28T20:01:21.791303+0000","last_became_active":"2023-11-28T20:01:09.511250+0000","last_became_peered":"2023-11-28T20:01:09.511250+0000","last_unstale":"2023-11-28T20:01:21.791303+0000","last_undegraded":"2023-11-28T20:01:21.791303+0000","last_fullsized":"2023-11-28T20:01:21.791303+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:08.474257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:08.474257+0000","last_clean_scrub_stamp":"2023-11-28T20:01:08.474257+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:35:34.107408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.a","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2023-11-28T20:01:22.799813+0000","last_change":"2023-11-28T20:01:22.799813+0000","last_active":"2023-11-28T20:01:22.787100+0000","last_peered":"2023-11-28T20:01:22.787100+0000","last_clean":"2023-11-28T20:01:22.787100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:01:22.799813+0000","last_undegraded":"2023-11-28T20:01:22.799813+0000","last_fullsized":"2023-11-28T20:01:22.799813+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:22.787100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:22.787100+0000","last_clean_scrub_stamp":"2023-11-28T20:01:22.787100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.d","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-28T20:01:22.824984+0000","last_change":"2023-11-28T20:01:22.818834+0000","last_active":"2023-11-28T20:01:22.824984+0000","last_peered":"2023-11-28T20:01:22.824984+0000","last_clean":"2023-11-28T20:01:22.824984+0000","last_became_active":"2023-11-28T20:01:22.818391+0000","last_became_peered":"2023-11-28T20:01:22.818391+0000","last_unstale":"2023-11-28T20:01:22.824984+0000","last_undegraded":"2023-11-28T20:01:22.824984+0000","last_fullsized":"2023-11-28T20:01:22.824984+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:21.777981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:21.777981+0000","last_clean_scrub_stamp":"2023-11-28T20:01:21.777981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:33:58.134275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-11-28T20:01:21.798469+0000","last_change":"2023-11-28T20:01:10.537164+0000","last_active":"2023-11-28T20:01:21.798469+0000","last_peered":"2023-11-28T20:01:21.798469+0000","last_clean":"2023-11-28T20:01:21.798469+0000","last_became_active":"2023-11-28T20:01:10.536893+0000","last_became_peered":"2023-11-28T20:01:10.536893+0000","last_unstale":"2023-11-28T20:01:21.798469+0000","last_undegraded":"2023-11-28T20:01:21.798469+0000","last_fullsized":"2023-11-28T20:01:21.798469+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_clean_scrub_stamp":"2023-11-28T20:01:09.480611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:50:58.589965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.f","version":"60'1","reported_seq":15,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-11-28T20:01:21.794381+0000","last_change":"2023-11-28T20:01:09.510018+0000","last_active":"2023-11-28T20:01:21.794381+0000","last_peered":"2023-11-28T20:01:21.794381+0000","last_clean":"2023-11-28T20:01:21.794381+0000","last_became_active":"2023-11-28T20:01:09.509743+0000","last_became_peered":"2023-11-28T20:01:09.509743+0000","last_unstale":"2023-11-28T20:01:21.794381+0000","last_undegraded":"2023-11-28T20:01:21.794381+0000","last_fullsized":"2023-11-28T20:01:21.794381+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:08.474257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:08.474257+0000","last_clean_scrub_stamp":"2023-11-28T20:01:08.474257+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:09:59.028591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.b","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2023-11-28T20:01:22.801666+0000","last_change":"2023-11-28T20:01:22.801666+0000","last_active":"2023-11-28T20:01:22.787100+0000","last_peered":"2023-11-28T20:01:22.787100+0000","last_clean":"2023-11-28T20:01:22.787100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:01:22.801666+0000","last_undegraded":"2023-11-28T20:01:22.801666+0000","last_fullsized":"2023-11-28T20:01:22.801666+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:22.787100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:22.787100+0000","last_clean_scrub_stamp":"2023-11-28T20:01:22.787100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-28T20:01:22.824090+0000","last_change":"2023-11-28T20:01:22.817493+0000","last_active":"2023-11-28T20:01:22.824090+0000","last_peered":"2023-11-28T20:01:22.824090+0000","last_clean":"2023-11-28T20:01:22.824090+0000","last_became_active":"2023-11-28T20:01:22.817204+0000","last_became_peered":"2023-11-28T20:01:22.817204+0000","last_unstale":"2023-11-28T20:01:22.824090+0000","last_undegraded":"2023-11-28T20:01:22.824090+0000","last_fullsized":"2023-11-28T20:01:22.824090+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:21.777981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:21.777981+0000","last_clean_scrub_stamp":"2023-11-28T20:01:21.777981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:21:33.492950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.d","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-11-28T20:01:21.801679+0000","last_change":"2023-11-28T20:01:10.537543+0000","last_active":"2023-11-28T20:01:21.801679+0000","last_peered":"2023-11-28T20:01:21.801679+0000","last_clean":"2023-11-28T20:01:21.801679+0000","last_became_active":"2023-11-28T20:01:10.537307+0000","last_became_peered":"2023-11-28T20:01:10.537307+0000","last_unstale":"2023-11-28T20:01:21.801679+0000","last_undegraded":"2023-11-28T20:01:21.801679+0000","last_fullsized":"2023-11-28T20:01:21.801679+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_clean_scrub_stamp":"2023-11-28T20:01:09.480611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:04:52.498548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.e","version":"60'2","reported_seq":16,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-11-28T20:01:21.800005+0000","last_change":"2023-11-28T20:01:09.519130+0000","last_active":"2023-11-28T20:01:21.800005+0000","last_peered":"2023-11-28T20:01:21.800005+0000","last_clean":"2023-11-28T20:01:21.800005+0000","last_became_active":"2023-11-28T20:01:09.517725+0000","last_became_peered":"2023-11-28T20:01:09.517725+0000","last_unstale":"2023-11-28T20:01:21.800005+0000","last_undegraded":"2023-11-28T20:01:21.800005+0000","last_fullsized":"2023-11-28T20:01:21.800005+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:08.474257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:08.474257+0000","last_clean_scrub_stamp":"2023-11-28T20:01:08.474257+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:05:31.573692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.8","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2023-11-28T20:01:22.801498+0000","last_change":"2023-11-28T20:01:22.801498+0000","last_active":"2023-11-28T20:01:22.787100+0000","last_peered":"2023-11-28T20:01:22.787100+0000","last_clean":"2023-11-28T20:01:22.787100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:01:22.801498+0000","last_undegraded":"2023-11-28T20:01:22.801498+0000","last_fullsized":"2023-11-28T20:01:22.801498+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:22.787100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:22.787100+0000","last_clean_scrub_stamp":"2023-11-28T20:01:22.787100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.f","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-28T20:01:22.832619+0000","last_change":"2023-11-28T20:01:22.830040+0000","last_active":"2023-11-28T20:01:22.832619+0000","last_peered":"2023-11-28T20:01:22.832619+0000","last_clean":"2023-11-28T20:01:22.832619+0000","last_became_active":"2023-11-28T20:01:22.829736+0000","last_became_peered":"2023-11-28T20:01:22.829736+0000","last_unstale":"2023-11-28T20:01:22.832619+0000","last_undegraded":"2023-11-28T20:01:22.832619+0000","last_fullsized":"2023-11-28T20:01:22.832619+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:21.777981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:21.777981+0000","last_clean_scrub_stamp":"2023-11-28T20:01:21.777981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:02:18.785671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.e","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-11-28T20:01:21.792843+0000","last_change":"2023-11-28T20:01:10.530449+0000","last_active":"2023-11-28T20:01:21.792843+0000","last_peered":"2023-11-28T20:01:21.792843+0000","last_clean":"2023-11-28T20:01:21.792843+0000","last_became_active":"2023-11-28T20:01:10.530169+0000","last_became_peered":"2023-11-28T20:01:10.530169+0000","last_unstale":"2023-11-28T20:01:21.792843+0000","last_undegraded":"2023-11-28T20:01:21.792843+0000","last_fullsized":"2023-11-28T20:01:21.792843+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_clean_scrub_stamp":"2023-11-28T20:01:09.480611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:01:36.330362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.d","version":"60'1","reported_seq":15,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-11-28T20:01:21.798612+0000","last_change":"2023-11-28T20:01:09.519252+0000","last_active":"2023-11-28T20:01:21.798612+0000","last_peered":"2023-11-28T20:01:21.798612+0000","last_clean":"2023-11-28T20:01:21.798612+0000","last_became_active":"2023-11-28T20:01:09.518511+0000","last_became_peered":"2023-11-28T20:01:09.518511+0000","last_unstale":"2023-11-28T20:01:21.798612+0000","last_undegraded":"2023-11-28T20:01:21.798612+0000","last_fullsized":"2023-11-28T20:01:21.798612+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:08.474257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:08.474257+0000","last_clean_scrub_stamp":"2023-11-28T20:01:08.474257+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:52:41.735612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.9","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2023-11-28T20:01:22.799812+0000","last_change":"2023-11-28T20:01:22.799812+0000","last_active":"2023-11-28T20:01:22.787100+0000","last_peered":"2023-11-28T20:01:22.787100+0000","last_clean":"2023-11-28T20:01:22.787100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:01:22.799812+0000","last_undegraded":"2023-11-28T20:01:22.799812+0000","last_fullsized":"2023-11-28T20:01:22.799812+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:22.787100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:22.787100+0000","last_clean_scrub_stamp":"2023-11-28T20:01:22.787100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.e","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-28T20:01:22.823606+0000","last_change":"2023-11-28T20:01:22.819046+0000","last_active":"2023-11-28T20:01:22.823606+0000","last_peered":"2023-11-28T20:01:22.823606+0000","last_clean":"2023-11-28T20:01:22.823606+0000","last_became_active":"2023-11-28T20:01:22.818775+0000","last_became_peered":"2023-11-28T20:01:22.818775+0000","last_unstale":"2023-11-28T20:01:22.823606+0000","last_undegraded":"2023-11-28T20:01:22.823606+0000","last_fullsized":"2023-11-28T20:01:22.823606+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:21.777981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:21.777981+0000","last_clean_scrub_stamp":"2023-11-28T20:01:21.777981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:37:29.813667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.f","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-11-28T20:01:21.801782+0000","last_change":"2023-11-28T20:01:10.523973+0000","last_active":"2023-11-28T20:01:21.801782+0000","last_peered":"2023-11-28T20:01:21.801782+0000","last_clean":"2023-11-28T20:01:21.801782+0000","last_became_active":"2023-11-28T20:01:10.523676+0000","last_became_peered":"2023-11-28T20:01:10.523676+0000","last_unstale":"2023-11-28T20:01:21.801782+0000","last_undegraded":"2023-11-28T20:01:21.801782+0000","last_fullsized":"2023-11-28T20:01:21.801782+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_clean_scrub_stamp":"2023-11-28T20:01:09.480611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:49:36.861168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":14,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-11-28T20:01:21.797278+0000","last_change":"2023-11-28T20:01:09.514931+0000","last_active":"2023-11-28T20:01:21.797278+0000","last_peered":"2023-11-28T20:01:21.797278+0000","last_clean":"2023-11-28T20:01:21.797278+0000","last_became_active":"2023-11-28T20:01:09.514702+0000","last_became_peered":"2023-11-28T20:01:09.514702+0000","last_unstale":"2023-11-28T20:01:21.797278+0000","last_undegraded":"2023-11-28T20:01:21.797278+0000","last_fullsized":"2023-11-28T20:01:21.797278+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:08.474257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:08.474257+0000","last_clean_scrub_stamp":"2023-11-28T20:01:08.474257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:30:37.298649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.e","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2023-11-28T20:01:22.808106+0000","last_change":"2023-11-28T20:01:22.808106+0000","last_active":"2023-11-28T20:01:22.787100+0000","last_peered":"2023-11-28T20:01:22.787100+0000","last_clean":"2023-11-28T20:01:22.787100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:01:22.808106+0000","last_undegraded":"2023-11-28T20:01:22.808106+0000","last_fullsized":"2023-11-28T20:01:22.808106+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:22.787100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:22.787100+0000","last_clean_scrub_stamp":"2023-11-28T20:01:22.787100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.9","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-28T20:01:22.821131+0000","last_change":"2023-11-28T20:01:22.816218+0000","last_active":"2023-11-28T20:01:22.821131+0000","last_peered":"2023-11-28T20:01:22.821131+0000","last_clean":"2023-11-28T20:01:22.821131+0000","last_became_active":"2023-11-28T20:01:22.815903+0000","last_became_peered":"2023-11-28T20:01:22.815903+0000","last_unstale":"2023-11-28T20:01:22.821131+0000","last_undegraded":"2023-11-28T20:01:22.821131+0000","last_fullsized":"2023-11-28T20:01:22.821131+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:21.777981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:21.777981+0000","last_clean_scrub_stamp":"2023-11-28T20:01:21.777981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:19:20.241462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-11-28T20:01:21.800738+0000","last_change":"2023-11-28T20:01:10.525003+0000","last_active":"2023-11-28T20:01:21.800738+0000","last_peered":"2023-11-28T20:01:21.800738+0000","last_clean":"2023-11-28T20:01:21.800738+0000","last_became_active":"2023-11-28T20:01:10.524411+0000","last_became_peered":"2023-11-28T20:01:10.524411+0000","last_unstale":"2023-11-28T20:01:21.800738+0000","last_undegraded":"2023-11-28T20:01:21.800738+0000","last_fullsized":"2023-11-28T20:01:21.800738+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_clean_scrub_stamp":"2023-11-28T20:01:09.480611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:17:27.097887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.b","version":"60'2","reported_seq":16,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-11-28T20:01:21.801281+0000","last_change":"2023-11-28T20:01:09.511026+0000","last_active":"2023-11-28T20:01:21.801281+0000","last_peered":"2023-11-28T20:01:21.801281+0000","last_clean":"2023-11-28T20:01:21.801281+0000","last_became_active":"2023-11-28T20:01:09.510765+0000","last_became_peered":"2023-11-28T20:01:09.510765+0000","last_unstale":"2023-11-28T20:01:21.801281+0000","last_undegraded":"2023-11-28T20:01:21.801281+0000","last_fullsized":"2023-11-28T20:01:21.801281+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:08.474257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:08.474257+0000","last_clean_scrub_stamp":"2023-11-28T20:01:08.474257+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:06:35.988462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.f","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2023-11-28T20:01:22.804656+0000","last_change":"2023-11-28T20:01:22.804656+0000","last_active":"2023-11-28T20:01:22.787100+0000","last_peered":"2023-11-28T20:01:22.787100+0000","last_clean":"2023-11-28T20:01:22.787100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:01:22.804656+0000","last_undegraded":"2023-11-28T20:01:22.804656+0000","last_fullsized":"2023-11-28T20:01:22.804656+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:22.787100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:22.787100+0000","last_clean_scrub_stamp":"2023-11-28T20:01:22.787100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-28T20:01:22.821031+0000","last_change":"2023-11-28T20:01:22.818671+0000","last_active":"2023-11-28T20:01:22.821031+0000","last_peered":"2023-11-28T20:01:22.821031+0000","last_clean":"2023-11-28T20:01:22.821031+0000","last_became_active":"2023-11-28T20:01:22.818413+0000","last_became_peered":"2023-11-28T20:01:22.818413+0000","last_unstale":"2023-11-28T20:01:22.821031+0000","last_undegraded":"2023-11-28T20:01:22.821031+0000","last_fullsized":"2023-11-28T20:01:22.821031+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:21.777981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:21.777981+0000","last_clean_scrub_stamp":"2023-11-28T20:01:21.777981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:39:31.956432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-11-28T20:01:21.793361+0000","last_change":"2023-11-28T20:01:10.523842+0000","last_active":"2023-11-28T20:01:21.793361+0000","last_peered":"2023-11-28T20:01:21.793361+0000","last_clean":"2023-11-28T20:01:21.793361+0000","last_became_active":"2023-11-28T20:01:10.523553+0000","last_became_peered":"2023-11-28T20:01:10.523553+0000","last_unstale":"2023-11-28T20:01:21.793361+0000","last_undegraded":"2023-11-28T20:01:21.793361+0000","last_fullsized":"2023-11-28T20:01:21.793361+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_clean_scrub_stamp":"2023-11-28T20:01:09.480611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T07:34:37.174623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":14,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-11-28T20:01:21.793934+0000","last_change":"2023-11-28T20:01:09.510719+0000","last_active":"2023-11-28T20:01:21.793934+0000","last_peered":"2023-11-28T20:01:21.793934+0000","last_clean":"2023-11-28T20:01:21.793934+0000","last_became_active":"2023-11-28T20:01:09.509874+0000","last_became_peered":"2023-11-28T20:01:09.509874+0000","last_unstale":"2023-11-28T20:01:21.793934+0000","last_undegraded":"2023-11-28T20:01:21.793934+0000","last_fullsized":"2023-11-28T20:01:21.793934+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:08.474257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:08.474257+0000","last_clean_scrub_stamp":"2023-11-28T20:01:08.474257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:21:20.189227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.c","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2023-11-28T20:01:22.804042+0000","last_change":"2023-11-28T20:01:22.804042+0000","last_active":"2023-11-28T20:01:22.787100+0000","last_peered":"2023-11-28T20:01:22.787100+0000","last_clean":"2023-11-28T20:01:22.787100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:01:22.804042+0000","last_undegraded":"2023-11-28T20:01:22.804042+0000","last_fullsized":"2023-11-28T20:01:22.804042+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:22.787100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:22.787100+0000","last_clean_scrub_stamp":"2023-11-28T20:01:22.787100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.b","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-28T20:01:22.825956+0000","last_change":"2023-11-28T20:01:22.821826+0000","last_active":"2023-11-28T20:01:22.825956+0000","last_peered":"2023-11-28T20:01:22.825956+0000","last_clean":"2023-11-28T20:01:22.825956+0000","last_became_active":"2023-11-28T20:01:22.821548+0000","last_became_peered":"2023-11-28T20:01:22.821548+0000","last_unstale":"2023-11-28T20:01:22.825956+0000","last_undegraded":"2023-11-28T20:01:22.825956+0000","last_fullsized":"2023-11-28T20:01:22.825956+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:21.777981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:21.777981+0000","last_clean_scrub_stamp":"2023-11-28T20:01:21.777981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:25:07.192596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-11-28T20:01:21.801265+0000","last_change":"2023-11-28T20:01:10.530042+0000","last_active":"2023-11-28T20:01:21.801265+0000","last_peered":"2023-11-28T20:01:21.801265+0000","last_clean":"2023-11-28T20:01:21.801265+0000","last_became_active":"2023-11-28T20:01:10.529745+0000","last_became_peered":"2023-11-28T20:01:10.529745+0000","last_unstale":"2023-11-28T20:01:21.801265+0000","last_undegraded":"2023-11-28T20:01:21.801265+0000","last_fullsized":"2023-11-28T20:01:21.801265+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_clean_scrub_stamp":"2023-11-28T20:01:09.480611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:18:17.108795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":14,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-11-28T20:01:21.800931+0000","last_change":"2023-11-28T20:01:09.512327+0000","last_active":"2023-11-28T20:01:21.800931+0000","last_peered":"2023-11-28T20:01:21.800931+0000","last_clean":"2023-11-28T20:01:21.800931+0000","last_became_active":"2023-11-28T20:01:09.512065+0000","last_became_peered":"2023-11-28T20:01:09.512065+0000","last_unstale":"2023-11-28T20:01:21.800931+0000","last_undegraded":"2023-11-28T20:01:21.800931+0000","last_fullsized":"2023-11-28T20:01:21.800931+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:08.474257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:08.474257+0000","last_clean_scrub_stamp":"2023-11-28T20:01:08.474257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:46:28.694684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.2","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2023-11-28T20:01:22.804217+0000","last_change":"2023-11-28T20:01:22.804217+0000","last_active":"2023-11-28T20:01:22.787100+0000","last_peered":"2023-11-28T20:01:22.787100+0000","last_clean":"2023-11-28T20:01:22.787100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:01:22.804217+0000","last_undegraded":"2023-11-28T20:01:22.804217+0000","last_fullsized":"2023-11-28T20:01:22.804217+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:22.787100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:22.787100+0000","last_clean_scrub_stamp":"2023-11-28T20:01:22.787100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.5","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-28T20:01:22.832081+0000","last_change":"2023-11-28T20:01:22.828000+0000","last_active":"2023-11-28T20:01:22.832081+0000","last_peered":"2023-11-28T20:01:22.832081+0000","last_clean":"2023-11-28T20:01:22.832081+0000","last_became_active":"2023-11-28T20:01:22.827704+0000","last_became_peered":"2023-11-28T20:01:22.827704+0000","last_unstale":"2023-11-28T20:01:22.832081+0000","last_undegraded":"2023-11-28T20:01:22.832081+0000","last_fullsized":"2023-11-28T20:01:22.832081+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:21.777981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:21.777981+0000","last_clean_scrub_stamp":"2023-11-28T20:01:21.777981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:52:43.940237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-11-28T20:01:21.801313+0000","last_change":"2023-11-28T20:01:10.526165+0000","last_active":"2023-11-28T20:01:21.801313+0000","last_peered":"2023-11-28T20:01:21.801313+0000","last_clean":"2023-11-28T20:01:21.801313+0000","last_became_active":"2023-11-28T20:01:10.525619+0000","last_became_peered":"2023-11-28T20:01:10.525619+0000","last_unstale":"2023-11-28T20:01:21.801313+0000","last_undegraded":"2023-11-28T20:01:21.801313+0000","last_fullsized":"2023-11-28T20:01:21.801313+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_clean_scrub_stamp":"2023-11-28T20:01:09.480611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:54:30.269337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.7","version":"60'2","reported_seq":16,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-11-28T20:01:21.794510+0000","last_change":"2023-11-28T20:01:09.514831+0000","last_active":"2023-11-28T20:01:21.794510+0000","last_peered":"2023-11-28T20:01:21.794510+0000","last_clean":"2023-11-28T20:01:21.794510+0000","last_became_active":"2023-11-28T20:01:09.514525+0000","last_became_peered":"2023-11-28T20:01:09.514525+0000","last_unstale":"2023-11-28T20:01:21.794510+0000","last_undegraded":"2023-11-28T20:01:21.794510+0000","last_fullsized":"2023-11-28T20:01:21.794510+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:08.474257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:08.474257+0000","last_clean_scrub_stamp":"2023-11-28T20:01:08.474257+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:05:31.573692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.3","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2023-11-28T20:01:22.804042+0000","last_change":"2023-11-28T20:01:22.804042+0000","last_active":"2023-11-28T20:01:22.787100+0000","last_peered":"2023-11-28T20:01:22.787100+0000","last_clean":"2023-11-28T20:01:22.787100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:01:22.804042+0000","last_undegraded":"2023-11-28T20:01:22.804042+0000","last_fullsized":"2023-11-28T20:01:22.804042+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:22.787100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:22.787100+0000","last_clean_scrub_stamp":"2023-11-28T20:01:22.787100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-28T20:01:22.832028+0000","last_change":"2023-11-28T20:01:22.827963+0000","last_active":"2023-11-28T20:01:22.832028+0000","last_peered":"2023-11-28T20:01:22.832028+0000","last_clean":"2023-11-28T20:01:22.832028+0000","last_became_active":"2023-11-28T20:01:22.827652+0000","last_became_peered":"2023-11-28T20:01:22.827652+0000","last_unstale":"2023-11-28T20:01:22.832028+0000","last_undegraded":"2023-11-28T20:01:22.832028+0000","last_fullsized":"2023-11-28T20:01:22.832028+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:21.777981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:21.777981+0000","last_clean_scrub_stamp":"2023-11-28T20:01:21.777981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:59:20.866094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-11-28T20:01:21.797523+0000","last_change":"2023-11-28T20:01:10.533050+0000","last_active":"2023-11-28T20:01:21.797523+0000","last_peered":"2023-11-28T20:01:21.797523+0000","last_clean":"2023-11-28T20:01:21.797523+0000","last_became_active":"2023-11-28T20:01:10.532590+0000","last_became_peered":"2023-11-28T20:01:10.532590+0000","last_unstale":"2023-11-28T20:01:21.797523+0000","last_undegraded":"2023-11-28T20:01:21.797523+0000","last_fullsized":"2023-11-28T20:01:21.797523+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_clean_scrub_stamp":"2023-11-28T20:01:09.480611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T07:29:30.339936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.6","version":"61'1","reported_seq":15,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-11-28T20:01:21.794444+0000","last_change":"2023-11-28T20:01:09.510397+0000","last_active":"2023-11-28T20:01:21.794444+0000","last_peered":"2023-11-28T20:01:21.794444+0000","last_clean":"2023-11-28T20:01:21.794444+0000","last_became_active":"2023-11-28T20:01:09.510136+0000","last_became_peered":"2023-11-28T20:01:09.510136+0000","last_unstale":"2023-11-28T20:01:21.794444+0000","last_undegraded":"2023-11-28T20:01:21.794444+0000","last_fullsized":"2023-11-28T20:01:21.794444+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:08.474257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:08.474257+0000","last_clean_scrub_stamp":"2023-11-28T20:01:08.474257+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:18:48.620687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.0","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2023-11-28T20:01:22.801672+0000","last_change":"2023-11-28T20:01:22.801672+0000","last_active":"2023-11-28T20:01:22.787100+0000","last_peered":"2023-11-28T20:01:22.787100+0000","last_clean":"2023-11-28T20:01:22.787100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:01:22.801672+0000","last_undegraded":"2023-11-28T20:01:22.801672+0000","last_fullsized":"2023-11-28T20:01:22.801672+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:22.787100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:22.787100+0000","last_clean_scrub_stamp":"2023-11-28T20:01:22.787100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.7","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-28T20:01:22.829667+0000","last_change":"2023-11-28T20:01:22.825335+0000","last_active":"2023-11-28T20:01:22.829667+0000","last_peered":"2023-11-28T20:01:22.829667+0000","last_clean":"2023-11-28T20:01:22.829667+0000","last_became_active":"2023-11-28T20:01:22.825033+0000","last_became_peered":"2023-11-28T20:01:22.825033+0000","last_unstale":"2023-11-28T20:01:22.829667+0000","last_undegraded":"2023-11-28T20:01:22.829667+0000","last_fullsized":"2023-11-28T20:01:22.829667+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:21.777981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:21.777981+0000","last_clean_scrub_stamp":"2023-11-28T20:01:21.777981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:10:42.691065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.6","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-11-28T20:01:21.794329+0000","last_change":"2023-11-28T20:01:10.530096+0000","last_active":"2023-11-28T20:01:21.794329+0000","last_peered":"2023-11-28T20:01:21.794329+0000","last_clean":"2023-11-28T20:01:21.794329+0000","last_became_active":"2023-11-28T20:01:10.529472+0000","last_became_peered":"2023-11-28T20:01:10.529472+0000","last_unstale":"2023-11-28T20:01:21.794329+0000","last_undegraded":"2023-11-28T20:01:21.794329+0000","last_fullsized":"2023-11-28T20:01:21.794329+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_clean_scrub_stamp":"2023-11-28T20:01:09.480611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T06:29:13.579326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":14,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-11-28T20:01:21.801672+0000","last_change":"2023-11-28T20:01:09.509983+0000","last_active":"2023-11-28T20:01:21.801672+0000","last_peered":"2023-11-28T20:01:21.801672+0000","last_clean":"2023-11-28T20:01:21.801672+0000","last_became_active":"2023-11-28T20:01:09.509675+0000","last_became_peered":"2023-11-28T20:01:09.509675+0000","last_unstale":"2023-11-28T20:01:21.801672+0000","last_undegraded":"2023-11-28T20:01:21.801672+0000","last_fullsized":"2023-11-28T20:01:21.801672+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:08.474257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:08.474257+0000","last_clean_scrub_stamp":"2023-11-28T20:01:08.474257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:21:20.189227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.1","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2023-11-28T20:01:22.802259+0000","last_change":"2023-11-28T20:01:22.802259+0000","last_active":"2023-11-28T20:01:22.787100+0000","last_peered":"2023-11-28T20:01:22.787100+0000","last_clean":"2023-11-28T20:01:22.787100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:01:22.802259+0000","last_undegraded":"2023-11-28T20:01:22.802259+0000","last_fullsized":"2023-11-28T20:01:22.802259+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:22.787100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:22.787100+0000","last_clean_scrub_stamp":"2023-11-28T20:01:22.787100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.6","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-28T20:01:22.821209+0000","last_change":"2023-11-28T20:01:22.817836+0000","last_active":"2023-11-28T20:01:22.821209+0000","last_peered":"2023-11-28T20:01:22.821209+0000","last_clean":"2023-11-28T20:01:22.821209+0000","last_became_active":"2023-11-28T20:01:22.817473+0000","last_became_peered":"2023-11-28T20:01:22.817473+0000","last_unstale":"2023-11-28T20:01:22.821209+0000","last_undegraded":"2023-11-28T20:01:22.821209+0000","last_fullsized":"2023-11-28T20:01:22.821209+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:21.777981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:21.777981+0000","last_clean_scrub_stamp":"2023-11-28T20:01:21.777981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:52:43.940237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.7","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-11-28T20:01:21.801808+0000","last_change":"2023-11-28T20:01:10.535856+0000","last_active":"2023-11-28T20:01:21.801808+0000","last_peered":"2023-11-28T20:01:21.801808+0000","last_clean":"2023-11-28T20:01:21.801808+0000","last_became_active":"2023-11-28T20:01:10.530889+0000","last_became_peered":"2023-11-28T20:01:10.530889+0000","last_unstale":"2023-11-28T20:01:21.801808+0000","last_undegraded":"2023-11-28T20:01:21.801808+0000","last_fullsized":"2023-11-28T20:01:21.801808+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_clean_scrub_stamp":"2023-11-28T20:01:09.480611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:53:37.636427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":14,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-11-28T20:01:21.790298+0000","last_change":"2023-11-28T20:01:09.511368+0000","last_active":"2023-11-28T20:01:21.790298+0000","last_peered":"2023-11-28T20:01:21.790298+0000","last_clean":"2023-11-28T20:01:21.790298+0000","last_became_active":"2023-11-28T20:01:09.510765+0000","last_became_peered":"2023-11-28T20:01:09.510765+0000","last_unstale":"2023-11-28T20:01:21.790298+0000","last_undegraded":"2023-11-28T20:01:21.790298+0000","last_fullsized":"2023-11-28T20:01:21.790298+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:08.474257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:08.474257+0000","last_clean_scrub_stamp":"2023-11-28T20:01:08.474257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:23:01.812122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.6","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2023-11-28T20:01:22.810260+0000","last_change":"2023-11-28T20:01:22.810260+0000","last_active":"2023-11-28T20:01:22.787100+0000","last_peered":"2023-11-28T20:01:22.787100+0000","last_clean":"2023-11-28T20:01:22.787100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:01:22.810260+0000","last_undegraded":"2023-11-28T20:01:22.810260+0000","last_fullsized":"2023-11-28T20:01:22.810260+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:22.787100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:22.787100+0000","last_clean_scrub_stamp":"2023-11-28T20:01:22.787100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.1","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-28T20:01:22.827254+0000","last_change":"2023-11-28T20:01:22.823098+0000","last_active":"2023-11-28T20:01:22.827254+0000","last_peered":"2023-11-28T20:01:22.827254+0000","last_clean":"2023-11-28T20:01:22.827254+0000","last_became_active":"2023-11-28T20:01:22.822775+0000","last_became_peered":"2023-11-28T20:01:22.822775+0000","last_unstale":"2023-11-28T20:01:22.827254+0000","last_undegraded":"2023-11-28T20:01:22.827254+0000","last_fullsized":"2023-11-28T20:01:22.827254+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:21.777981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:21.777981+0000","last_clean_scrub_stamp":"2023-11-28T20:01:21.777981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:19:01.924410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-11-28T20:01:21.800951+0000","last_change":"2023-11-28T20:01:10.530585+0000","last_active":"2023-11-28T20:01:21.800951+0000","last_peered":"2023-11-28T20:01:21.800951+0000","last_clean":"2023-11-28T20:01:21.800951+0000","last_became_active":"2023-11-28T20:01:10.530313+0000","last_became_peered":"2023-11-28T20:01:10.530313+0000","last_unstale":"2023-11-28T20:01:21.800951+0000","last_undegraded":"2023-11-28T20:01:21.800951+0000","last_fullsized":"2023-11-28T20:01:21.800951+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_clean_scrub_stamp":"2023-11-28T20:01:09.480611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:04:41.159984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":14,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-11-28T20:01:21.798227+0000","last_change":"2023-11-28T20:01:09.518318+0000","last_active":"2023-11-28T20:01:21.798227+0000","last_peered":"2023-11-28T20:01:21.798227+0000","last_clean":"2023-11-28T20:01:21.798227+0000","last_became_active":"2023-11-28T20:01:09.517761+0000","last_became_peered":"2023-11-28T20:01:09.517761+0000","last_unstale":"2023-11-28T20:01:21.798227+0000","last_undegraded":"2023-11-28T20:01:21.798227+0000","last_fullsized":"2023-11-28T20:01:21.798227+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:08.474257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:08.474257+0000","last_clean_scrub_stamp":"2023-11-28T20:01:08.474257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:18:16.102441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.7","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2023-11-28T20:01:22.807763+0000","last_change":"2023-11-28T20:01:22.807763+0000","last_active":"2023-11-28T20:01:22.787100+0000","last_peered":"2023-11-28T20:01:22.787100+0000","last_clean":"2023-11-28T20:01:22.787100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:01:22.807763+0000","last_undegraded":"2023-11-28T20:01:22.807763+0000","last_fullsized":"2023-11-28T20:01:22.807763+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:22.787100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:22.787100+0000","last_clean_scrub_stamp":"2023-11-28T20:01:22.787100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.0","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-28T20:01:22.826411+0000","last_change":"2023-11-28T20:01:22.822143+0000","last_active":"2023-11-28T20:01:22.826411+0000","last_peered":"2023-11-28T20:01:22.826411+0000","last_clean":"2023-11-28T20:01:22.826411+0000","last_became_active":"2023-11-28T20:01:22.821874+0000","last_became_peered":"2023-11-28T20:01:22.821874+0000","last_unstale":"2023-11-28T20:01:22.826411+0000","last_undegraded":"2023-11-28T20:01:22.826411+0000","last_fullsized":"2023-11-28T20:01:22.826411+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:21.777981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:21.777981+0000","last_clean_scrub_stamp":"2023-11-28T20:01:21.777981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:05:44.877415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-11-28T20:01:21.791432+0000","last_change":"2023-11-28T20:01:10.533596+0000","last_active":"2023-11-28T20:01:21.791432+0000","last_peered":"2023-11-28T20:01:21.791432+0000","last_clean":"2023-11-28T20:01:21.791432+0000","last_became_active":"2023-11-28T20:01:10.533195+0000","last_became_peered":"2023-11-28T20:01:10.533195+0000","last_unstale":"2023-11-28T20:01:21.791432+0000","last_undegraded":"2023-11-28T20:01:21.791432+0000","last_fullsized":"2023-11-28T20:01:21.791432+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_clean_scrub_stamp":"2023-11-28T20:01:09.480611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:14:25.459653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":14,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-11-28T20:01:21.796646+0000","last_change":"2023-11-28T20:01:09.507413+0000","last_active":"2023-11-28T20:01:21.796646+0000","last_peered":"2023-11-28T20:01:21.796646+0000","last_clean":"2023-11-28T20:01:21.796646+0000","last_became_active":"2023-11-28T20:01:09.507080+0000","last_became_peered":"2023-11-28T20:01:09.507080+0000","last_unstale":"2023-11-28T20:01:21.796646+0000","last_undegraded":"2023-11-28T20:01:21.796646+0000","last_fullsized":"2023-11-28T20:01:21.796646+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:08.474257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:08.474257+0000","last_clean_scrub_stamp":"2023-11-28T20:01:08.474257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:54:29.262983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.4","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2023-11-28T20:01:22.802494+0000","last_change":"2023-11-28T20:01:22.802494+0000","last_active":"2023-11-28T20:01:22.787100+0000","last_peered":"2023-11-28T20:01:22.787100+0000","last_clean":"2023-11-28T20:01:22.787100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:01:22.802494+0000","last_undegraded":"2023-11-28T20:01:22.802494+0000","last_fullsized":"2023-11-28T20:01:22.802494+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:22.787100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:22.787100+0000","last_clean_scrub_stamp":"2023-11-28T20:01:22.787100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.3","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-28T20:01:22.829695+0000","last_change":"2023-11-28T20:01:22.826550+0000","last_active":"2023-11-28T20:01:22.829695+0000","last_peered":"2023-11-28T20:01:22.829695+0000","last_clean":"2023-11-28T20:01:22.829695+0000","last_became_active":"2023-11-28T20:01:22.826247+0000","last_became_peered":"2023-11-28T20:01:22.826247+0000","last_unstale":"2023-11-28T20:01:22.829695+0000","last_undegraded":"2023-11-28T20:01:22.829695+0000","last_fullsized":"2023-11-28T20:01:22.829695+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:21.777981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:21.777981+0000","last_clean_scrub_stamp":"2023-11-28T20:01:21.777981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:21:33.492950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-11-28T20:01:21.789934+0000","last_change":"2023-11-28T20:01:10.518351+0000","last_active":"2023-11-28T20:01:21.789934+0000","last_peered":"2023-11-28T20:01:21.789934+0000","last_clean":"2023-11-28T20:01:21.789934+0000","last_became_active":"2023-11-28T20:01:10.518106+0000","last_became_peered":"2023-11-28T20:01:10.518106+0000","last_unstale":"2023-11-28T20:01:21.789934+0000","last_undegraded":"2023-11-28T20:01:21.789934+0000","last_fullsized":"2023-11-28T20:01:21.789934+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_clean_scrub_stamp":"2023-11-28T20:01:09.480611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:04:52.498548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":14,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-11-28T20:01:21.796549+0000","last_change":"2023-11-28T20:01:09.514346+0000","last_active":"2023-11-28T20:01:21.796549+0000","last_peered":"2023-11-28T20:01:21.796549+0000","last_clean":"2023-11-28T20:01:21.796549+0000","last_became_active":"2023-11-28T20:01:09.513791+0000","last_became_peered":"2023-11-28T20:01:09.513791+0000","last_unstale":"2023-11-28T20:01:21.796549+0000","last_undegraded":"2023-11-28T20:01:21.796549+0000","last_fullsized":"2023-11-28T20:01:21.796549+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:08.474257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:08.474257+0000","last_clean_scrub_stamp":"2023-11-28T20:01:08.474257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:17:26.091533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.5","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2023-11-28T20:01:22.803024+0000","last_change":"2023-11-28T20:01:22.803024+0000","last_active":"2023-11-28T20:01:22.787100+0000","last_peered":"2023-11-28T20:01:22.787100+0000","last_clean":"2023-11-28T20:01:22.787100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:01:22.803024+0000","last_undegraded":"2023-11-28T20:01:22.803024+0000","last_fullsized":"2023-11-28T20:01:22.803024+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:22.787100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:22.787100+0000","last_clean_scrub_stamp":"2023-11-28T20:01:22.787100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-28T20:01:22.826152+0000","last_change":"2023-11-28T20:01:22.821936+0000","last_active":"2023-11-28T20:01:22.826152+0000","last_peered":"2023-11-28T20:01:22.826152+0000","last_clean":"2023-11-28T20:01:22.826152+0000","last_became_active":"2023-11-28T20:01:22.821666+0000","last_became_peered":"2023-11-28T20:01:22.821666+0000","last_unstale":"2023-11-28T20:01:22.826152+0000","last_undegraded":"2023-11-28T20:01:22.826152+0000","last_fullsized":"2023-11-28T20:01:22.826152+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:21.777981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:21.777981+0000","last_clean_scrub_stamp":"2023-11-28T20:01:21.777981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:44:17.659296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-11-28T20:01:21.797041+0000","last_change":"2023-11-28T20:01:10.531261+0000","last_active":"2023-11-28T20:01:21.797041+0000","last_peered":"2023-11-28T20:01:21.797041+0000","last_clean":"2023-11-28T20:01:21.797041+0000","last_became_active":"2023-11-28T20:01:10.531002+0000","last_became_peered":"2023-11-28T20:01:10.531002+0000","last_unstale":"2023-11-28T20:01:21.797041+0000","last_undegraded":"2023-11-28T20:01:21.797041+0000","last_fullsized":"2023-11-28T20:01:21.797041+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_clean_scrub_stamp":"2023-11-28T20:01:09.480611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:50:37.650648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":14,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-11-28T20:01:21.789833+0000","last_change":"2023-11-28T20:01:09.512031+0000","last_active":"2023-11-28T20:01:21.789833+0000","last_peered":"2023-11-28T20:01:21.789833+0000","last_clean":"2023-11-28T20:01:21.789833+0000","last_became_active":"2023-11-28T20:01:09.511366+0000","last_became_peered":"2023-11-28T20:01:09.511366+0000","last_unstale":"2023-11-28T20:01:21.789833+0000","last_undegraded":"2023-11-28T20:01:21.789833+0000","last_fullsized":"2023-11-28T20:01:21.789833+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:08.474257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:08.474257+0000","last_clean_scrub_stamp":"2023-11-28T20:01:08.474257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:29:38.849741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.d","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2023-11-28T20:01:22.816355+0000","last_change":"2023-11-28T20:01:22.816355+0000","last_active":"2023-11-28T20:01:22.787100+0000","last_peered":"2023-11-28T20:01:22.787100+0000","last_clean":"2023-11-28T20:01:22.787100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:01:22.816355+0000","last_undegraded":"2023-11-28T20:01:22.816355+0000","last_fullsized":"2023-11-28T20:01:22.816355+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:22.787100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:22.787100+0000","last_clean_scrub_stamp":"2023-11-28T20:01:22.787100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-28T20:01:22.828665+0000","last_change":"2023-11-28T20:01:22.819303+0000","last_active":"2023-11-28T20:01:22.828665+0000","last_peered":"2023-11-28T20:01:22.828665+0000","last_clean":"2023-11-28T20:01:22.828665+0000","last_became_active":"2023-11-28T20:01:22.819098+0000","last_became_peered":"2023-11-28T20:01:22.819098+0000","last_unstale":"2023-11-28T20:01:22.828665+0000","last_undegraded":"2023-11-28T20:01:22.828665+0000","last_fullsized":"2023-11-28T20:01:22.828665+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:21.777981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:21.777981+0000","last_clean_scrub_stamp":"2023-11-28T20:01:21.777981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:55:36.425762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.b","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-11-28T20:01:21.801495+0000","last_change":"2023-11-28T20:01:10.530148+0000","last_active":"2023-11-28T20:01:21.801495+0000","last_peered":"2023-11-28T20:01:21.801495+0000","last_clean":"2023-11-28T20:01:21.801495+0000","last_became_active":"2023-11-28T20:01:10.529630+0000","last_became_peered":"2023-11-28T20:01:10.529630+0000","last_unstale":"2023-11-28T20:01:21.801495+0000","last_undegraded":"2023-11-28T20:01:21.801495+0000","last_fullsized":"2023-11-28T20:01:21.801495+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_clean_scrub_stamp":"2023-11-28T20:01:09.480611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:11:08.794514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":14,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-11-28T20:01:21.796083+0000","last_change":"2023-11-28T20:01:09.515708+0000","last_active":"2023-11-28T20:01:21.796083+0000","last_peered":"2023-11-28T20:01:21.796083+0000","last_clean":"2023-11-28T20:01:21.796083+0000","last_became_active":"2023-11-28T20:01:09.515449+0000","last_became_peered":"2023-11-28T20:01:09.515449+0000","last_unstale":"2023-11-28T20:01:21.796083+0000","last_undegraded":"2023-11-28T20:01:21.796083+0000","last_fullsized":"2023-11-28T20:01:21.796083+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:08.474257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:08.474257+0000","last_clean_scrub_stamp":"2023-11-28T20:01:08.474257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T07:14:20.829778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":201,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-11-28T20:01:21.797721+0000","last_change":"2023-11-28T19:58:56.136501+0000","last_active":"2023-11-28T20:01:21.797721+0000","last_peered":"2023-11-28T20:01:21.797721+0000","last_clean":"2023-11-28T20:01:21.797721+0000","last_became_active":"2023-11-28T19:58:56.135998+0000","last_became_peered":"2023-11-28T19:58:56.135998+0000","last_unstale":"2023-11-28T20:01:21.797721+0000","last_undegraded":"2023-11-28T20:01:21.797721+0000","last_fullsized":"2023-11-28T20:01:21.797721+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:58:54.602349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:58:54.602349+0000","last_clean_scrub_stamp":"2023-11-28T19:58:54.602349+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:33:42.723349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":12,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":11,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":10,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":9,"num_pg":32,"stat_sum":{"num_bytes":3905,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":47,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":7810,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":41,"ondisk_log_size":41,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":66748,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574882,"num_pgs":51,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27832,"kb_used_data":812,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344008,"statfs":{"total":96636764160,"available":96608264192,"internally_reserved":0,"allocated":831488,"data_stored":935848,"data_compressed":33374,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 20:00:55 2023","interfaces":[{"interface":"back","average":{"1min":0.66200000000000003,"5min":0.67500000000000004,"15min":0.67700000000000005},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":0.84699999999999998,"5min":0.90700000000000003,"15min":0.90700000000000003},"last":0.71099999999999997},{"interface":"front","average":{"1min":0.63300000000000001,"5min":0.67400000000000004,"15min":0.68100000000000005},"min":{"1min":0.499,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":0.84099999999999997,"5min":0.98999999999999999,"15min":0.98999999999999999},"last":0.69599999999999995}]},{"osd":1,"last update":"Tue Nov 28 20:00:55 2023","interfaces":[{"interface":"back","average":{"1min":0.60599999999999998,"5min":0.63800000000000001,"15min":0.64300000000000002},"min":{"1min":0.44700000000000001,"5min":0.438,"15min":0.438},"max":{"1min":0.82899999999999996,"5min":0.89600000000000002,"15min":0.89600000000000002},"last":0.72899999999999998},{"interface":"front","average":{"1min":0.63900000000000001,"5min":0.68899999999999995,"15min":0.69699999999999995},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":0.78200000000000003,"5min":1.0900000000000001,"15min":1.0900000000000001},"last":0.68000000000000005}]},{"osd":2,"last update":"Tue Nov 28 20:00:55 2023","interfaces":[{"interface":"back","average":{"1min":0.64400000000000002,"5min":0.71599999999999997,"15min":0.72799999999999998},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.84699999999999998,"5min":0.98799999999999999,"15min":0.98799999999999999},"last":0.79700000000000004},{"interface":"front","average":{"1min":0.65100000000000002,"5min":0.69499999999999995,"15min":0.70299999999999996},"min":{"1min":0.48599999999999999,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":0.85599999999999998,"5min":1.0680000000000001,"15min":1.0680000000000001},"last":0.65000000000000002}]},{"osd":3,"last update":"Tue Nov 28 20:00:55 2023","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.70099999999999996,"15min":0.69999999999999996},"min":{"1min":0.56100000000000005,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":0.88900000000000001,"5min":1.0449999999999999,"15min":1.0449999999999999},"last":0.63200000000000001},{"interface":"front","average":{"1min":0.74199999999999999,"5min":0.78200000000000003,"15min":0.78900000000000003},"min":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":0.60699999999999998},"max":{"1min":0.879,"5min":1.1299999999999999,"15min":1.1299999999999999},"last":0.77000000000000002}]},{"osd":4,"last update":"Tue Nov 28 20:00:55 2023","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.63600000000000001,"15min":0.64000000000000001},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":0.83899999999999997,"5min":1.018,"15min":1.018},"last":0.46999999999999997},{"interface":"front","average":{"1min":0.67600000000000005,"5min":0.72199999999999998,"15min":0.72999999999999998},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":0.97899999999999998,"5min":1.1120000000000001,"15min":1.1120000000000001},"last":0.66300000000000003}]},{"osd":5,"last update":"Tue Nov 28 20:00:55 2023","interfaces":[{"interface":"back","average":{"1min":0.58699999999999997,"5min":0.66500000000000004,"15min":0.67800000000000005},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.871,"5min":1.1699999999999999,"15min":1.1699999999999999},"last":0.59899999999999998},{"interface":"front","average":{"1min":0.67900000000000005,"5min":0.748,"15min":0.76000000000000001},"min":{"1min":0.505,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":0.88500000000000001,"5min":1.1890000000000001,"15min":1.1890000000000001},"last":0.747}]},{"osd":6,"last update":"Tue Nov 28 20:00:55 2023","interfaces":[{"interface":"back","average":{"1min":0.71399999999999997,"5min":0.76800000000000002,"15min":0.77700000000000002},"min":{"1min":0.47499999999999998,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.88200000000000001,"5min":1.1379999999999999,"15min":1.1379999999999999},"last":0.81100000000000005},{"interface":"front","average":{"1min":0.65000000000000002,"5min":0.72699999999999998,"15min":0.73999999999999999},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":0.93300000000000005,"5min":1.23,"15min":1.23},"last":0.57599999999999996}]}]},{"osd":6,"up_from":13,"seq":55834574880,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27756,"kb_used_data":736,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344084,"statfs":{"total":96636764160,"available":96608342016,"internally_reserved":0,"allocated":753664,"data_stored":344738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 20:00:54 2023","interfaces":[{"interface":"back","average":{"1min":0.621,"5min":0.61699999999999999,"15min":0.61599999999999999},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.81699999999999995,"5min":0.82599999999999996,"15min":0.82599999999999996},"last":0.70499999999999996},{"interface":"front","average":{"1min":0.67300000000000004,"5min":0.66500000000000004,"15min":0.66400000000000003},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":0.88700000000000001,"5min":0.98999999999999999,"15min":0.98999999999999999},"last":0.78500000000000003}]},{"osd":1,"last update":"Tue Nov 28 20:00:54 2023","interfaces":[{"interface":"back","average":{"1min":0.745,"5min":0.78100000000000003,"15min":0.78700000000000003},"min":{"1min":0.56100000000000005,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.0940000000000001,"5min":1.105,"15min":1.105},"last":0.81599999999999995},{"interface":"front","average":{"1min":0.69999999999999996,"5min":0.68899999999999995,"15min":0.68700000000000006},"min":{"1min":0.53700000000000003,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.85599999999999998,"5min":0.95899999999999996,"15min":0.95899999999999996},"last":0.72699999999999998}]},{"osd":2,"last update":"Tue Nov 28 20:00:54 2023","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.69499999999999995,"15min":0.69799999999999995},"min":{"1min":0.54700000000000004,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":0.89700000000000002,"5min":0.93400000000000005,"15min":0.93400000000000005},"last":0.76500000000000001},{"interface":"front","average":{"1min":0.70499999999999996,"5min":0.71599999999999997,"15min":0.71799999999999997},"min":{"1min":0.53400000000000003,"5min":0.505,"15min":0.505},"max":{"1min":0.91800000000000004,"5min":1.006,"15min":1.006},"last":0.66500000000000004}]},{"osd":3,"last update":"Tue Nov 28 20:00:54 2023","interfaces":[{"interface":"back","average":{"1min":0.70999999999999996,"5min":0.74099999999999999,"15min":0.746},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.04,"5min":1.056,"15min":1.056},"last":0.84499999999999997},{"interface":"front","average":{"1min":0.66700000000000004,"5min":0.68100000000000005,"15min":0.68300000000000005},"min":{"1min":0.505,"5min":0.505,"15min":0.505},"max":{"1min":0.85599999999999998,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.68300000000000005}]},{"osd":4,"last update":"Tue Nov 28 20:00:54 2023","interfaces":[{"interface":"back","average":{"1min":0.61599999999999999,"5min":0.628,"15min":0.63},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":0.97599999999999998,"5min":0.97599999999999998,"15min":0.97599999999999998},"last":0.52500000000000002},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.71199999999999997,"15min":0.72999999999999998},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":1.1419999999999999,"5min":1.389,"15min":1.389},"last":0.504}]},{"osd":5,"last update":"Tue Nov 28 20:00:54 2023","interfaces":[{"interface":"back","average":{"1min":0.71999999999999997,"5min":0.79700000000000004,"15min":0.81000000000000005},"min":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":1.147,"5min":1.4259999999999999,"15min":1.4259999999999999},"last":0.60799999999999998},{"interface":"front","average":{"1min":0.70699999999999996,"5min":0.751,"15min":0.75900000000000001},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.034,"5min":1.276,"15min":1.276},"last":0.627}]},{"osd":7,"last update":"Tue Nov 28 20:00:54 2023","interfaces":[{"interface":"back","average":{"1min":0.64000000000000001,"5min":0.69999999999999996,"15min":0.70999999999999996},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":1.014,"5min":1.014,"15min":1.014},"last":0.47699999999999998},{"interface":"front","average":{"1min":0.72599999999999998,"5min":0.80900000000000005,"15min":0.82299999999999995},"min":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":1.083,"5min":1.242,"15min":1.242},"last":0.58299999999999996}]}]},{"osd":5,"up_from":13,"seq":55834574882,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27756,"kb_used_data":736,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344084,"statfs":{"total":96636764160,"available":96608342016,"internally_reserved":0,"allocated":753664,"data_stored":344726,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 20:00:54 2023","interfaces":[{"interface":"back","average":{"1min":0.628,"5min":0.69299999999999995,"15min":0.70399999999999996},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.84699999999999998,"5min":0.997,"15min":0.997},"last":0.67100000000000004},{"interface":"front","average":{"1min":0.61899999999999999,"5min":0.69899999999999995,"15min":0.71199999999999997},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.78800000000000003,"5min":1.149,"15min":1.149},"last":0.622}]},{"osd":1,"last update":"Tue Nov 28 20:00:54 2023","interfaces":[{"interface":"back","average":{"1min":0.66800000000000004,"5min":0.70399999999999996,"15min":0.70999999999999996},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.94499999999999995,"5min":0.94499999999999995,"15min":0.94499999999999995},"last":0.70999999999999996},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.70399999999999996,"15min":0.71999999999999997},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":0.71999999999999997,"5min":1.0940000000000001,"15min":1.0940000000000001},"last":0.70199999999999996}]},{"osd":2,"last update":"Tue Nov 28 20:00:54 2023","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.89200000000000002,"15min":0.92800000000000005},"min":{"1min":0.5,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":0.91200000000000003,"5min":5.0880000000000001,"15min":5.0880000000000001},"last":0.73399999999999999},{"interface":"front","average":{"1min":0.69599999999999995,"5min":0.93999999999999995,"15min":0.98099999999999998},"min":{"1min":0.59199999999999997,"5min":0.504,"15min":0.504},"max":{"1min":0.96199999999999997,"5min":5.1399999999999997,"15min":5.1399999999999997},"last":0.76100000000000001}]},{"osd":3,"last update":"Tue Nov 28 20:00:54 2023","interfaces":[{"interface":"back","average":{"1min":0.70999999999999996,"5min":0.96399999999999997,"15min":1.006},"min":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":0.91100000000000003,"5min":5.0469999999999997,"15min":5.0469999999999997},"last":0.68899999999999995},{"interface":"front","average":{"1min":0.69099999999999995,"5min":0.93899999999999995,"15min":0.97999999999999998},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":0.90000000000000002,"5min":5.024,"15min":5.024},"last":0.79900000000000004}]},{"osd":4,"last update":"Tue Nov 28 20:00:54 2023","interfaces":[{"interface":"back","average":{"1min":0.58599999999999997,"5min":0.65800000000000003,"15min":0.67000000000000004},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.93300000000000005,"5min":1.4810000000000001,"15min":1.4810000000000001},"last":0.42899999999999999},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.73599999999999999,"15min":0.74299999999999999},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":0.95799999999999996,"5min":1.6339999999999999,"15min":1.6339999999999999},"last":0.496}]},{"osd":6,"last update":"Tue Nov 28 20:00:54 2023","interfaces":[{"interface":"back","average":{"1min":0.70299999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"min":{"1min":0.47699999999999998,"5min":0.434,"15min":0.434},"max":{"1min":0.93899999999999995,"5min":0.97699999999999998,"15min":0.97699999999999998},"last":0.64800000000000002},{"interface":"front","average":{"1min":0.69199999999999995,"5min":0.73599999999999999,"15min":0.74399999999999999},"min":{"1min":0.46300000000000002,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":0.86599999999999999,"5min":1.099,"15min":1.099},"last":0.47599999999999998}]},{"osd":7,"last update":"Tue Nov 28 20:00:54 2023","interfaces":[{"interface":"back","average":{"1min":0.77100000000000002,"5min":0.78300000000000003,"15min":0.78500000000000003},"min":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":0.95999999999999996,"5min":1.236,"15min":1.236},"last":0.55800000000000005},{"interface":"front","average":{"1min":0.77800000000000002,"5min":0.79600000000000004,"15min":0.79900000000000004},"min":{"1min":0.54000000000000004,"5min":0.505,"15min":0.505},"max":{"1min":0.98599999999999999,"5min":1.0760000000000001,"15min":1.0760000000000001},"last":0.53600000000000003}]}]},{"osd":4,"up_from":13,"seq":55834574881,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27764,"kb_used_data":744,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344076,"statfs":{"total":96636764160,"available":96608333824,"internally_reserved":0,"allocated":761856,"data_stored":347811,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 20:00:54 2023","interfaces":[{"interface":"back","average":{"1min":0.63200000000000001,"5min":0.69499999999999995,"15min":0.70499999999999996},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.82999999999999996,"5min":1.0429999999999999,"15min":1.0429999999999999},"last":0.76500000000000001},{"interface":"front","average":{"1min":0.64400000000000002,"5min":0.69999999999999996,"15min":0.70899999999999996},"min":{"1min":0.44900000000000001,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.93200000000000005,"5min":1.163,"15min":1.163},"last":0.56699999999999995}]},{"osd":1,"last update":"Tue Nov 28 20:00:54 2023","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.73599999999999999,"15min":0.754},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.88500000000000001,"5min":1.111,"15min":1.111},"last":0.54300000000000004},{"interface":"front","average":{"1min":0.68300000000000005,"5min":0.78700000000000003,"15min":0.80500000000000005},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":0.90000000000000002,"5min":1.238,"15min":1.238},"last":0.629}]},{"osd":2,"last update":"Tue Nov 28 20:00:54 2023","interfaces":[{"interface":"back","average":{"1min":0.70099999999999996,"5min":0.76600000000000001,"15min":0.77700000000000002},"min":{"1min":0.53300000000000003,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.97399999999999998,"5min":1.0669999999999999,"15min":1.0669999999999999},"last":0.58799999999999997},{"interface":"front","average":{"1min":0.66700000000000004,"5min":0.78700000000000003,"15min":0.80700000000000005},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.88100000000000001,"5min":1.1180000000000001,"15min":1.1180000000000001},"last":0.81000000000000005}]},{"osd":3,"last update":"Tue Nov 28 20:00:54 2023","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.76600000000000001,"15min":0.79000000000000004},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":0.89700000000000002,"5min":1.202,"15min":1.202},"last":0.61199999999999999},{"interface":"front","average":{"1min":0.67700000000000005,"5min":0.77200000000000002,"15min":0.78800000000000003},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":0.94599999999999995,"5min":1.0589999999999999,"15min":1.0589999999999999},"last":0.78800000000000003}]},{"osd":5,"last update":"Tue Nov 28 20:00:54 2023","interfaces":[{"interface":"back","average":{"1min":0.621,"5min":0.70299999999999996,"15min":0.71699999999999997},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.82499999999999996,"5min":0.95899999999999996,"15min":0.95899999999999996},"last":0.83199999999999996},{"interface":"front","average":{"1min":0.625,"5min":0.69599999999999995,"15min":0.70799999999999996},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.879,"5min":1.034,"15min":1.034},"last":0.65300000000000002}]},{"osd":6,"last update":"Tue Nov 28 20:00:54 2023","interfaces":[{"interface":"back","average":{"1min":0.60799999999999998,"5min":0.70899999999999996,"15min":0.72599999999999998},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":0.73799999999999999,"5min":1.0309999999999999,"15min":1.0309999999999999},"last":0.75700000000000001},{"interface":"front","average":{"1min":0.71899999999999997,"5min":0.77100000000000002,"15min":0.77900000000000003},"min":{"1min":0.49199999999999999,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":0.879,"5min":1.002,"15min":1.002},"last":0.68000000000000005}]},{"osd":7,"last update":"Tue Nov 28 20:00:54 2023","interfaces":[{"interface":"back","average":{"1min":0.70499999999999996,"5min":0.77100000000000002,"15min":0.78200000000000003},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":0.91000000000000003,"5min":1.0620000000000001,"15min":1.0620000000000001},"last":0.69799999999999995},{"interface":"front","average":{"1min":0.76000000000000001,"5min":0.84799999999999998,"15min":0.86199999999999999},"min":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":0.93400000000000005,"5min":1.1459999999999999,"15min":1.1459999999999999},"last":0.71499999999999997}]}]},{"osd":3,"up_from":13,"seq":55834574882,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27752,"kb_used_data":732,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344088,"statfs":{"total":96636764160,"available":96608346112,"internally_reserved":0,"allocated":749568,"data_stored":344704,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 20:00:55 2023","interfaces":[{"interface":"back","average":{"1min":0.41899999999999998,"5min":0.441,"15min":0.44500000000000001},"min":{"1min":0.29399999999999998,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":1.7130000000000001},{"interface":"front","average":{"1min":0.39600000000000002,"5min":0.45800000000000002,"15min":0.46800000000000003},"min":{"1min":0.28199999999999997,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.52800000000000002,"5min":0.82599999999999996,"15min":0.82599999999999996},"last":3.0630000000000002}]},{"osd":1,"last update":"Tue Nov 28 20:00:55 2023","interfaces":[{"interface":"back","average":{"1min":0.40000000000000002,"5min":0.46500000000000002,"15min":0.47599999999999998},"min":{"1min":0.26200000000000001,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.56999999999999995,"5min":0.84399999999999997,"15min":0.84399999999999997},"last":0.89200000000000002},{"interface":"front","average":{"1min":0.439,"5min":0.49099999999999999,"15min":0.5},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.74099999999999999,"5min":0.86099999999999999,"15min":0.86099999999999999},"last":5.8920000000000003}]},{"osd":2,"last update":"Tue Nov 28 20:00:55 2023","interfaces":[{"interface":"back","average":{"1min":0.48799999999999999,"5min":0.52400000000000002,"15min":0.53000000000000003},"min":{"1min":0.375,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.64900000000000002,"5min":0.85599999999999998,"15min":0.85599999999999998},"last":4.6390000000000002},{"interface":"front","average":{"1min":0.48999999999999999,"5min":0.56599999999999995,"15min":0.57899999999999996},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.63500000000000001,"5min":0.83699999999999997,"15min":0.83699999999999997},"last":11.593}]},{"osd":4,"last update":"Tue Nov 28 20:00:55 2023","interfaces":[{"interface":"back","average":{"1min":0.77700000000000002,"5min":0.76500000000000001,"15min":0.76300000000000001},"min":{"1min":0.60799999999999998,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":1.085,"5min":1.206,"15min":1.206},"last":5.5549999999999997},{"interface":"front","average":{"1min":0.80700000000000005,"5min":0.80300000000000005,"15min":0.80300000000000005},"min":{"1min":0.58999999999999997,"5min":0.503,"15min":0.503},"max":{"1min":1.173,"5min":1.222,"15min":1.222},"last":11.747}]},{"osd":5,"last update":"Tue Nov 28 20:00:55 2023","interfaces":[{"interface":"back","average":{"1min":0.78300000000000003,"5min":0.79600000000000004,"15min":0.79800000000000004},"min":{"1min":0.57699999999999996,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":1.2509999999999999,"5min":1.2509999999999999,"15min":1.2509999999999999},"last":11.705},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.79100000000000004,"15min":0.79900000000000004},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":1.0409999999999999,"5min":1.3100000000000001,"15min":1.3100000000000001},"last":1.0580000000000001}]},{"osd":6,"last update":"Tue Nov 28 20:00:55 2023","interfaces":[{"interface":"back","average":{"1min":0.81699999999999995,"5min":0.83799999999999997,"15min":0.84199999999999997},"min":{"1min":0.58799999999999997,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":1.544,"5min":1.544,"15min":1.544},"last":1.6639999999999999},{"interface":"front","average":{"1min":0.93100000000000005,"5min":0.78500000000000003,"15min":0.76100000000000001},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":4.0679999999999996,"5min":4.0679999999999996,"15min":4.0679999999999996},"last":3.1459999999999999}]},{"osd":7,"last update":"Tue Nov 28 20:00:55 2023","interfaces":[{"interface":"back","average":{"1min":0.97099999999999997,"5min":0.874,"15min":0.85799999999999998},"min":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":4.0019999999999998,"5min":4.0019999999999998,"15min":4.0019999999999998},"last":6.6619999999999999},{"interface":"front","average":{"1min":0.80100000000000005,"5min":0.873,"15min":0.88500000000000001},"min":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.60299999999999998},"max":{"1min":1.1830000000000001,"5min":1.339,"15min":1.339},"last":11.782}]}]},{"osd":2,"up_from":13,"seq":55834574880,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27752,"kb_used_data":732,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344088,"statfs":{"total":96636764160,"available":96608346112,"internally_reserved":0,"allocated":749568,"data_stored":344704,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 20:00:54 2023","interfaces":[{"interface":"back","average":{"1min":0.42599999999999999,"5min":0.45000000000000001,"15min":0.45400000000000001},"min":{"1min":0.33300000000000002,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.65100000000000002,"5min":0.74099999999999999,"15min":0.74099999999999999},"last":0.32500000000000001},{"interface":"front","average":{"1min":0.42199999999999999,"5min":0.46999999999999997,"15min":0.47799999999999998},"min":{"1min":0.27900000000000003,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.61399999999999999,"5min":0.67700000000000005,"15min":0.67700000000000005},"last":0.41899999999999998}]},{"osd":1,"last update":"Tue Nov 28 20:00:54 2023","interfaces":[{"interface":"back","average":{"1min":0.42899999999999999,"5min":0.497,"15min":0.50900000000000001},"min":{"1min":0.33300000000000002,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.57199999999999995,"5min":1.0389999999999999,"15min":1.0389999999999999},"last":0.377},{"interface":"front","average":{"1min":0.435,"5min":0.49099999999999999,"15min":0.5},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.70299999999999996,"5min":0.70999999999999996,"15min":0.70999999999999996},"last":0.58999999999999997}]},{"osd":3,"last update":"Tue Nov 28 20:00:54 2023","interfaces":[{"interface":"back","average":{"1min":0.44,"5min":0.46600000000000003,"15min":0.46999999999999997},"min":{"1min":0.317,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.55200000000000005,"5min":0.629,"15min":0.629},"last":0.60299999999999998},{"interface":"front","average":{"1min":0.496,"5min":0.57199999999999995,"15min":0.58499999999999996},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.67800000000000005,"5min":0.98499999999999999,"15min":0.98499999999999999},"last":0.5}]},{"osd":4,"last update":"Tue Nov 28 20:00:54 2023","interfaces":[{"interface":"back","average":{"1min":0.73899999999999999,"5min":0.83699999999999997,"15min":0.85299999999999998},"min":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"max":{"1min":0.98999999999999999,"5min":1.139,"15min":1.139},"last":0.53400000000000003},{"interface":"front","average":{"1min":0.71999999999999997,"5min":0.82599999999999996,"15min":0.84399999999999997},"min":{"1min":0.57299999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":0.97599999999999998,"5min":1.238,"15min":1.238},"last":0.64600000000000002}]},{"osd":5,"last update":"Tue Nov 28 20:00:54 2023","interfaces":[{"interface":"back","average":{"1min":0.69699999999999995,"5min":0.84699999999999998,"15min":0.872},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":0.83599999999999997,"5min":1.6180000000000001,"15min":1.6180000000000001},"last":0.51500000000000001},{"interface":"front","average":{"1min":0.71099999999999997,"5min":0.81000000000000005,"15min":0.82599999999999996},"min":{"1min":0.52200000000000002,"5min":0.496,"15min":0.496},"max":{"1min":0.96899999999999997,"5min":1.339,"15min":1.339},"last":0.77600000000000002}]},{"osd":6,"last update":"Tue Nov 28 20:00:54 2023","interfaces":[{"interface":"back","average":{"1min":0.73299999999999998,"5min":0.79100000000000004,"15min":0.80100000000000005},"min":{"1min":0.54600000000000004,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":0.98199999999999998,"5min":1.1839999999999999,"15min":1.1839999999999999},"last":0.82099999999999995},{"interface":"front","average":{"1min":0.70599999999999996,"5min":0.82999999999999996,"15min":0.85099999999999998},"min":{"1min":0.497,"5min":0.497,"15min":0.497},"max":{"1min":0.94199999999999995,"5min":1.099,"15min":1.099},"last":0.57199999999999995}]},{"osd":7,"last update":"Tue Nov 28 20:00:54 2023","interfaces":[{"interface":"back","average":{"1min":0.746,"5min":0.86099999999999999,"15min":0.88},"min":{"1min":0.53300000000000003,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":0.84899999999999998,"5min":1.4590000000000001,"15min":1.4590000000000001},"last":0.55300000000000005},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.83599999999999997,"15min":0.85599999999999998},"min":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":0.96599999999999997,"5min":1.387,"15min":1.387},"last":0.625}]}]},{"osd":1,"up_from":13,"seq":55834574882,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27780,"kb_used_data":760,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344060,"statfs":{"total":96636764160,"available":96608317440,"internally_reserved":0,"allocated":778240,"data_stored":348575,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 20:00:56 2023","interfaces":[{"interface":"back","average":{"1min":0.372,"5min":0.59999999999999998,"15min":0.63800000000000001},"min":{"1min":0.25900000000000001,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.53200000000000003,"5min":3.8740000000000001,"15min":3.8740000000000001},"last":0.27000000000000002},{"interface":"front","average":{"1min":0.41499999999999998,"5min":0.54000000000000004,"15min":0.56100000000000005},"min":{"1min":0.26200000000000001,"5min":0.25,"15min":0.25},"max":{"1min":0.64100000000000001,"5min":2.0760000000000001,"15min":2.0760000000000001},"last":0.36599999999999999}]},{"osd":2,"last update":"Tue Nov 28 20:00:56 2023","interfaces":[{"interface":"back","average":{"1min":0.40899999999999997,"5min":0.60899999999999999,"15min":0.64200000000000002},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":0.54500000000000004,"5min":3.7320000000000002,"15min":3.7320000000000002},"last":0.307},{"interface":"front","average":{"1min":0.42199999999999999,"5min":0.69199999999999995,"15min":0.73699999999999999},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.54800000000000004,"5min":3.9089999999999998,"15min":3.9089999999999998},"last":0.38600000000000001}]},{"osd":3,"last update":"Tue Nov 28 20:00:56 2023","interfaces":[{"interface":"back","average":{"1min":0.52800000000000002,"5min":0.65000000000000002,"15min":0.67000000000000004},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.64700000000000002,"5min":1.6399999999999999,"15min":1.6399999999999999},"last":0.436},{"interface":"front","average":{"1min":0.52000000000000002,"5min":0.66600000000000004,"15min":0.68999999999999995},"min":{"1min":0.37,"5min":0.317,"15min":0.317},"max":{"1min":0.748,"5min":2.5270000000000001,"15min":2.5270000000000001},"last":0.33300000000000002}]},{"osd":4,"last update":"Tue Nov 28 20:00:56 2023","interfaces":[{"interface":"back","average":{"1min":0.70199999999999996,"5min":0.85599999999999998,"15min":0.88200000000000001},"min":{"1min":0.46700000000000003,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":1.036,"5min":3.1659999999999999,"15min":3.1659999999999999},"last":0.51600000000000001},{"interface":"front","average":{"1min":0.68700000000000006,"5min":0.89400000000000002,"15min":0.92800000000000005},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.93700000000000006,"5min":3.7959999999999998,"15min":3.7959999999999998},"last":0.59999999999999998}]},{"osd":5,"last update":"Tue Nov 28 20:00:56 2023","interfaces":[{"interface":"back","average":{"1min":0.69799999999999995,"5min":0.93000000000000005,"15min":0.96899999999999997},"min":{"1min":0.50800000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":0.95599999999999996,"5min":4.1479999999999997,"15min":4.1479999999999997},"last":0.61899999999999999},{"interface":"front","average":{"1min":0.70299999999999996,"5min":0.86799999999999999,"15min":0.89600000000000002},"min":{"1min":0.499,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":1.052,"5min":3.5569999999999999,"15min":3.5569999999999999},"last":0.48199999999999998}]},{"osd":6,"last update":"Tue Nov 28 20:00:56 2023","interfaces":[{"interface":"back","average":{"1min":0.73999999999999999,"5min":0.94099999999999995,"15min":0.97499999999999998},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":1.004,"5min":2.863,"15min":2.863},"last":0.501},{"interface":"front","average":{"1min":0.77400000000000002,"5min":0.94099999999999995,"15min":0.96899999999999997},"min":{"1min":0.58099999999999996,"5min":0.56899999999999995,"15min":0.56899999999999995},"max":{"1min":1.075,"5min":3.371,"15min":3.371},"last":0.54500000000000004}]},{"osd":7,"last update":"Tue Nov 28 20:00:56 2023","interfaces":[{"interface":"back","average":{"1min":0.71599999999999997,"5min":0.95299999999999996,"15min":0.99299999999999999},"min":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":0.96899999999999997,"5min":3.8439999999999999,"15min":3.8439999999999999},"last":0.53100000000000003},{"interface":"front","average":{"1min":0.72699999999999998,"5min":0.97499999999999998,"15min":1.0169999999999999},"min":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":1.0569999999999999,"5min":3.9689999999999999,"15min":3.9689999999999999},"last":0.45000000000000001}]}]},{"osd":0,"up_from":13,"seq":55834574881,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31976,"kb_used_data":796,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339864,"statfs":{"total":96636764160,"available":96604020736,"internally_reserved":0,"allocated":815104,"data_stored":935072,"data_compressed":33374,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Nov 28 20:00:56 2023","interfaces":[{"interface":"back","average":{"1min":0.41299999999999998,"5min":0.63400000000000001,"15min":0.67100000000000004},"min":{"1min":0.27400000000000002,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.55800000000000005,"5min":4.883,"15min":4.883},"last":0.373},{"interface":"front","average":{"1min":0.44,"5min":0.79000000000000004,"15min":0.84799999999999998},"min":{"1min":0.30199999999999999,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.63200000000000001,"5min":8.0800000000000001,"15min":8.0800000000000001},"last":0.45900000000000002}]},{"osd":2,"last update":"Tue Nov 28 20:00:56 2023","interfaces":[{"interface":"back","average":{"1min":0.443,"5min":0.86699999999999999,"15min":0.93799999999999994},"min":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.59899999999999998,"5min":8.1029999999999998,"15min":8.1029999999999998},"last":0.45000000000000001},{"interface":"front","average":{"1min":0.47599999999999998,"5min":0.88400000000000001,"15min":0.95199999999999996},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.67600000000000005,"5min":8.1310000000000002,"15min":8.1310000000000002},"last":0.433}]},{"osd":3,"last update":"Tue Nov 28 20:00:56 2023","interfaces":[{"interface":"back","average":{"1min":0.42899999999999999,"5min":0.68300000000000005,"15min":0.72499999999999998},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.57599999999999996,"5min":4.3949999999999996,"15min":4.3949999999999996},"last":0.34999999999999998},{"interface":"front","average":{"1min":0.48899999999999999,"5min":0.70299999999999996,"15min":0.73899999999999999},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.69899999999999995,"5min":4.3470000000000004,"15min":4.3470000000000004},"last":0.41099999999999998}]},{"osd":4,"last update":"Tue Nov 28 20:00:56 2023","interfaces":[{"interface":"back","average":{"1min":0.71999999999999997,"5min":0.98399999999999999,"15min":1.028},"min":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":1.123,"5min":4.6360000000000001,"15min":4.6360000000000001},"last":0.71299999999999997},{"interface":"front","average":{"1min":0.747,"5min":0.99099999999999999,"15min":1.032},"min":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":0.996,"5min":4.4710000000000001,"15min":4.4710000000000001},"last":0.70099999999999996}]},{"osd":5,"last update":"Tue Nov 28 20:00:56 2023","interfaces":[{"interface":"back","average":{"1min":0.74299999999999999,"5min":1,"15min":1.0429999999999999},"min":{"1min":0.54800000000000004,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":0.96399999999999997,"5min":4.6120000000000001,"15min":4.6120000000000001},"last":0.73399999999999999},{"interface":"front","average":{"1min":0.74199999999999999,"5min":0.98999999999999999,"15min":1.0309999999999999},"min":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"max":{"1min":1.1659999999999999,"5min":4.5449999999999999,"15min":4.5449999999999999},"last":0.79800000000000004}]},{"osd":6,"last update":"Tue Nov 28 20:00:56 2023","interfaces":[{"interface":"back","average":{"1min":0.73499999999999999,"5min":1.01,"15min":1.056},"min":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":1.143,"5min":4.657,"15min":4.657},"last":0.67400000000000004},{"interface":"front","average":{"1min":0.74199999999999999,"5min":1.026,"15min":1.073},"min":{"1min":0.61199999999999999,"5min":0.58899999999999997,"15min":0.58899999999999997},"max":{"1min":1.0109999999999999,"5min":4.5259999999999998,"15min":4.5259999999999998},"last":0.77600000000000002}]},{"osd":7,"last update":"Tue Nov 28 20:00:56 2023","interfaces":[{"interface":"back","average":{"1min":0.72199999999999998,"5min":1.0249999999999999,"15min":1.075},"min":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":1.036,"5min":4.7320000000000002,"15min":4.7320000000000002},"last":0.66000000000000003},{"interface":"front","average":{"1min":0.755,"5min":0.98699999999999999,"15min":1.026},"min":{"1min":0.57499999999999996,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":1.1919999999999999,"5min":4.4939999999999998,"15min":4.4939999999999998},"last":0.75900000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33374,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33374,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":3871,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3107,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":776,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-28T20:01:27.897 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-28T20:01:28.066 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:28.061+0000 7f88396bb640 1 Processor -- start 2023-11-28T20:01:28.066 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:28.061+0000 7f88396bb640 1 -- start start 2023-11-28T20:01:28.067 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:28.061+0000 7f88396bb640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f883406bef0 0x7f88340bfce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:28.067 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:28.061+0000 7f88396bb640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f883406c5b0 0x7f883406ca20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:28.067 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:28.061+0000 7f88396bb640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8834151690 con 0x7f883414e3f0 2023-11-28T20:01:28.067 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:28.061+0000 7f88396bb640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8834151bc0 con 0x7f883406c5b0 2023-11-28T20:01:28.067 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:28.061+0000 7f88396bb640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f88341518e0 con 0x7f883406bef0 2023-11-28T20:01:28.067 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:28.061+0000 7f8832ffd640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f883414e3f0 0x7f88340c41f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:37172/0 (socket says 172.21.15.78:37172) 2023-11-28T20:01:28.067 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:28.061+0000 7f88337fe640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f883406c5b0 0x7f883406ca20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:28.068 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:28.061+0000 7f8832ffd640 1 -- 172.21.15.78:0/1523753403 learned_addr learned my addr 172.21.15.78:0/1523753403 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-11-28T20:01:28.068 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:28.065+0000 7f882a7fc640 1 --2- 172.21.15.78:0/1523753403 >> v2:172.21.15.179:3300/0 conn(0x7f883406bef0 0x7f88340bfce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:28.068 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:28.065+0000 7f88337fe640 1 -- 172.21.15.78:0/1523753403 >> v2:172.21.15.179:3300/0 conn(0x7f883406bef0 msgr2=0x7f88340bfce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:01:28.068 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:28.065+0000 7f88337fe640 1 --2- 172.21.15.78:0/1523753403 >> v2:172.21.15.179:3300/0 conn(0x7f883406bef0 0x7f88340bfce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:28.068 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:28.065+0000 7f88337fe640 1 -- 172.21.15.78:0/1523753403 >> v1:172.21.15.78:6789/0 conn(0x7f883414e3f0 legacy=0x7f88340c41f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:01:28.069 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:28.065+0000 7f88337fe640 1 -- 172.21.15.78:0/1523753403 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88340c1de0 con 0x7f883406c5b0 2023-11-28T20:01:28.070 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:28.065+0000 7f88337fe640 1 --2- 172.21.15.78:0/1523753403 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f883406c5b0 0x7f883406ca20 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7f883406b520 tx=0x7f882c01c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=64fc8155e72dd30b server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:01:28.071 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:28.065+0000 7f88327fc640 1 -- 172.21.15.78:0/1523753403 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f882c0ab600 con 0x7f883406c5b0 2023-11-28T20:01:28.071 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:28.065+0000 7f88327fc640 1 -- 172.21.15.78:0/1523753403 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f882c0a7050 con 0x7f883406c5b0 2023-11-28T20:01:28.071 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:28.065+0000 7f88327fc640 1 -- 172.21.15.78:0/1523753403 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f882c0ab980 con 0x7f883406c5b0 2023-11-28T20:01:28.072 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:28.065+0000 7f88396bb640 1 -- 172.21.15.78:0/1523753403 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f883406c5b0 msgr2=0x7f883406ca20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:01:28.072 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:28.065+0000 7f88396bb640 1 --2- 172.21.15.78:0/1523753403 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f883406c5b0 0x7f883406ca20 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7f883406b520 tx=0x7f882c01c3a0 comp rx=0 tx=0).stop 2023-11-28T20:01:28.072 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:28.069+0000 7f88396bb640 1 -- 172.21.15.78:0/1523753403 shutdown_connections 2023-11-28T20:01:28.072 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:28.069+0000 7f88396bb640 1 --2- 172.21.15.78:0/1523753403 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f883406c5b0 0x7f883406ca20 unknown :-1 s=CLOSED pgs=694 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:28.072 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:28.069+0000 7f88396bb640 1 --2- 172.21.15.78:0/1523753403 >> v2:172.21.15.179:3300/0 conn(0x7f883406bef0 0x7f88340bfce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:28.072 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:28.069+0000 7f88396bb640 1 -- 172.21.15.78:0/1523753403 >> 172.21.15.78:0/1523753403 conn(0x7f88340a7810 msgr2=0x7f88340a7c20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:01:28.072 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:28.069+0000 7f88396bb640 1 -- 172.21.15.78:0/1523753403 shutdown_connections 2023-11-28T20:01:28.072 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:28.069+0000 7f88396bb640 1 -- 172.21.15.78:0/1523753403 wait complete. 2023-11-28T20:01:28.073 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:28.069+0000 7f88396bb640 1 Processor -- start 2023-11-28T20:01:28.073 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:28.069+0000 7f88396bb640 1 -- start start 2023-11-28T20:01:28.075 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:28.069+0000 7f88396bb640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f883406bef0 0x7f8834143f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:28.075 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:28.069+0000 7f88396bb640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f883406c5b0 0x7f88341ede00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:28.075 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:28.069+0000 7f88396bb640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f883414e3f0 0x7f88341505c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:28.075 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:28.069+0000 7f88396bb640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8834146b60 con 0x7f883406c5b0 2023-11-28T20:01:28.075 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:28.069+0000 7f88396bb640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8834071be0 con 0x7f883414e3f0 2023-11-28T20:01:28.075 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:28.069+0000 7f88396bb640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8834071890 con 0x7f883406bef0 2023-11-28T20:01:28.075 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:28.069+0000 7f882a7fc640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f883406c5b0 0x7f88341ede00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:28.076 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:28.069+0000 7f882a7fc640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f883406c5b0 0x7f88341ede00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:36216/0 (socket says 172.21.15.78:36216) 2023-11-28T20:01:28.076 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:28.069+0000 7f882a7fc640 1 -- 172.21.15.78:0/1520278346 learned_addr learned my addr 172.21.15.78:0/1520278346 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T20:01:28.076 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:28.069+0000 7f8832ffd640 1 --2- 172.21.15.78:0/1520278346 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f883406bef0 0x7f8834143f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:28.076 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:28.069+0000 7f88337fe640 1 --2- 172.21.15.78:0/1520278346 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f883414e3f0 0x7f88341505c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:28.076 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:28.069+0000 7f882a7fc640 1 -- 172.21.15.78:0/1520278346 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f883406bef0 msgr2=0x7f8834143f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:01:28.076 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:28.069+0000 7f882a7fc640 1 --2- 172.21.15.78:0/1520278346 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f883406bef0 0x7f8834143f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:28.076 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:28.069+0000 7f882a7fc640 1 -- 172.21.15.78:0/1520278346 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f883414e3f0 msgr2=0x7f88341505c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:01:28.076 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:28.069+0000 7f882a7fc640 1 --2- 172.21.15.78:0/1520278346 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f883414e3f0 0x7f88341505c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:28.076 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:28.069+0000 7f882a7fc640 1 -- 172.21.15.78:0/1520278346 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f882c009420 con 0x7f883406c5b0 2023-11-28T20:01:28.076 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:28.069+0000 7f882a7fc640 1 --2- 172.21.15.78:0/1520278346 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f883406c5b0 0x7f88341ede00 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7f881c007f20 tx=0x7f881c00e570 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:01:28.077 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:28.073+0000 7f882bfff640 1 -- 172.21.15.78:0/1520278346 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f881c014620 con 0x7f883406c5b0 2023-11-28T20:01:28.077 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:28.073+0000 7f882bfff640 1 -- 172.21.15.78:0/1520278346 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f881c014780 con 0x7f883406c5b0 2023-11-28T20:01:28.077 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:28.073+0000 7f88396bb640 1 -- 172.21.15.78:0/1520278346 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8834070ff0 con 0x7f883406c5b0 2023-11-28T20:01:28.077 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:28.073+0000 7f882bfff640 1 -- 172.21.15.78:0/1520278346 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f881c014b30 con 0x7f883406c5b0 2023-11-28T20:01:28.078 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:28.073+0000 7f88396bb640 1 -- 172.21.15.78:0/1520278346 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f88340715b0 con 0x7f883406c5b0 2023-11-28T20:01:28.078 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:28.073+0000 7f88396bb640 1 -- 172.21.15.78:0/1520278346 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f883415b490 con 0x7f883406c5b0 2023-11-28T20:01:28.078 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:28.073+0000 7f882bfff640 1 -- 172.21.15.78:0/1520278346 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f881c014c90 con 0x7f883406c5b0 2023-11-28T20:01:28.079 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:28.073+0000 7f882bfff640 1 --2- 172.21.15.78:0/1520278346 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f8814066470 0x7f8814068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:28.079 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:28.073+0000 7f882bfff640 1 -- 172.21.15.78:0/1520278346 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 6885+0+0 (secure 0 0 0) 0x7f881c084c60 con 0x7f883406c5b0 2023-11-28T20:01:28.079 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:28.073+0000 7f8832ffd640 1 --2- 172.21.15.78:0/1520278346 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f8814066470 0x7f8814068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:28.079 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:28.077+0000 7f8832ffd640 1 --2- 172.21.15.78:0/1520278346 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f8814066470 0x7f8814068930 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f8824005890 tx=0x7f8824009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:01:28.082 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:28.077+0000 7f882bfff640 1 -- 172.21.15.78:0/1520278346 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f883415b490 con 0x7f883406c5b0 2023-11-28T20:01:28.231 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:28.225+0000 7f88396bb640 1 -- 172.21.15.78:0/1520278346 --> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f88341ee340 con 0x7f8814066470 2023-11-28T20:01:28.243 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:28.241+0000 7f882bfff640 1 -- 172.21.15.78:0/1520278346 <== mgr.4106 v2:172.21.15.78:6832/2935380957 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+522286 (secure 0 0 0) 0x7f88341ee340 con 0x7f8814066470 2023-11-28T20:01:28.248 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-11-28T20:01:28.252 INFO:teuthology.orchestra.run.smithi078.stderr:dumped all 2023-11-28T20:01:28.253 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:28.245+0000 7f88396bb640 1 -- 172.21.15.78:0/1520278346 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f8814066470 msgr2=0x7f8814068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:01:28.254 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:28.245+0000 7f88396bb640 1 --2- 172.21.15.78:0/1520278346 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f8814066470 0x7f8814068930 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f8824005890 tx=0x7f8824009040 comp rx=0 tx=0).stop 2023-11-28T20:01:28.254 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:28.245+0000 7f88396bb640 1 -- 172.21.15.78:0/1520278346 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f883406c5b0 msgr2=0x7f88341ede00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:01:28.254 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:28.245+0000 7f88396bb640 1 --2- 172.21.15.78:0/1520278346 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f883406c5b0 0x7f88341ede00 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7f881c007f20 tx=0x7f881c00e570 comp rx=0 tx=0).stop 2023-11-28T20:01:28.254 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:28.245+0000 7f88396bb640 1 -- 172.21.15.78:0/1520278346 shutdown_connections 2023-11-28T20:01:28.254 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:28.245+0000 7f88396bb640 1 --2- 172.21.15.78:0/1520278346 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f8814066470 0x7f8814068930 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:28.254 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:28.245+0000 7f88396bb640 1 --2- 172.21.15.78:0/1520278346 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f883414e3f0 0x7f88341505c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:28.254 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:28.245+0000 7f88396bb640 1 --2- 172.21.15.78:0/1520278346 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f883406c5b0 0x7f88341ede00 unknown :-1 s=CLOSED pgs=695 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:28.254 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:28.245+0000 7f88396bb640 1 --2- 172.21.15.78:0/1520278346 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f883406bef0 0x7f8834143f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:28.254 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:28.245+0000 7f88396bb640 1 -- 172.21.15.78:0/1520278346 >> 172.21.15.78:0/1520278346 conn(0x7f88340a7810 msgr2=0x7f88340a7bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:01:28.254 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:28.245+0000 7f88396bb640 1 -- 172.21.15.78:0/1520278346 shutdown_connections 2023-11-28T20:01:28.254 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:28.245+0000 7f88396bb640 1 -- 172.21.15.78:0/1520278346 wait complete. 2023-11-28T20:01:28.268 INFO:teuthology.orchestra.run.smithi078.stdout:{"pg_ready":true,"pg_map":{"version":136,"stamp":"2023-11-28T20:01:27.982712+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":594273,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":206,"num_write_kb":2433,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":158,"ondisk_log_size":158,"up":386,"acting":386,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":235,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":226368,"kb_used_data":6048,"kb_used_omap":12,"kb_used_meta":220211,"kb_avail":754748352,"statfs":{"total":773094113280,"available":772862312448,"internally_reserved":0,"allocated":6193152,"data_stored":3946178,"data_compressed":66748,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":12752,"internal_metadata":225496624},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":30,"apply_latency_ms":30,"commit_latency_ns":30000000,"apply_latency_ns":30000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1241,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001016"},"pg_stats":[{"pgid":"12.39","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2023-11-28T20:01:22.802967+0000","last_change":"2023-11-28T20:01:22.802967+0000","last_active":"2023-11-28T20:01:22.787100+0000","last_peered":"2023-11-28T20:01:22.787100+0000","last_clean":"2023-11-28T20:01:22.787100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:01:22.802967+0000","last_undegraded":"2023-11-28T20:01:22.802967+0000","last_fullsized":"2023-11-28T20:01:22.802967+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:22.787100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:22.787100+0000","last_clean_scrub_stamp":"2023-11-28T20:01:22.787100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.3f","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-11-28T20:01:21.790302+0000","last_change":"2023-11-28T20:01:10.539211+0000","last_active":"2023-11-28T20:01:21.790302+0000","last_peered":"2023-11-28T20:01:21.790302+0000","last_clean":"2023-11-28T20:01:21.790302+0000","last_became_active":"2023-11-28T20:01:10.538932+0000","last_became_peered":"2023-11-28T20:01:10.538932+0000","last_unstale":"2023-11-28T20:01:21.790302+0000","last_undegraded":"2023-11-28T20:01:21.790302+0000","last_fullsized":"2023-11-28T20:01:21.790302+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_clean_scrub_stamp":"2023-11-28T20:01:09.480611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:10:00.034946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.38","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2023-11-28T20:01:22.800864+0000","last_change":"2023-11-28T20:01:22.800864+0000","last_active":"2023-11-28T20:01:22.787100+0000","last_peered":"2023-11-28T20:01:22.787100+0000","last_clean":"2023-11-28T20:01:22.787100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:01:22.800864+0000","last_undegraded":"2023-11-28T20:01:22.800864+0000","last_fullsized":"2023-11-28T20:01:22.800864+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:22.787100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:22.787100+0000","last_clean_scrub_stamp":"2023-11-28T20:01:22.787100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.3e","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-11-28T20:01:21.790168+0000","last_change":"2023-11-28T20:01:10.522069+0000","last_active":"2023-11-28T20:01:21.790168+0000","last_peered":"2023-11-28T20:01:21.790168+0000","last_clean":"2023-11-28T20:01:21.790168+0000","last_became_active":"2023-11-28T20:01:10.521785+0000","last_became_peered":"2023-11-28T20:01:10.521785+0000","last_unstale":"2023-11-28T20:01:21.790168+0000","last_undegraded":"2023-11-28T20:01:21.790168+0000","last_fullsized":"2023-11-28T20:01:21.790168+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_clean_scrub_stamp":"2023-11-28T20:01:09.480611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:00:30.789993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.3b","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2023-11-28T20:01:22.801987+0000","last_change":"2023-11-28T20:01:22.801987+0000","last_active":"2023-11-28T20:01:22.787100+0000","last_peered":"2023-11-28T20:01:22.787100+0000","last_clean":"2023-11-28T20:01:22.787100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:01:22.801987+0000","last_undegraded":"2023-11-28T20:01:22.801987+0000","last_fullsized":"2023-11-28T20:01:22.801987+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:22.787100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:22.787100+0000","last_clean_scrub_stamp":"2023-11-28T20:01:22.787100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.3d","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-11-28T20:01:21.798541+0000","last_change":"2023-11-28T20:01:10.538353+0000","last_active":"2023-11-28T20:01:21.798541+0000","last_peered":"2023-11-28T20:01:21.798541+0000","last_clean":"2023-11-28T20:01:21.798541+0000","last_became_active":"2023-11-28T20:01:10.537756+0000","last_became_peered":"2023-11-28T20:01:10.537756+0000","last_unstale":"2023-11-28T20:01:21.798541+0000","last_undegraded":"2023-11-28T20:01:21.798541+0000","last_fullsized":"2023-11-28T20:01:21.798541+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_clean_scrub_stamp":"2023-11-28T20:01:09.480611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T06:29:13.579326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.3a","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2023-11-28T20:01:22.804075+0000","last_change":"2023-11-28T20:01:22.804075+0000","last_active":"2023-11-28T20:01:22.787100+0000","last_peered":"2023-11-28T20:01:22.787100+0000","last_clean":"2023-11-28T20:01:22.787100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:01:22.804075+0000","last_undegraded":"2023-11-28T20:01:22.804075+0000","last_fullsized":"2023-11-28T20:01:22.804075+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:22.787100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:22.787100+0000","last_clean_scrub_stamp":"2023-11-28T20:01:22.787100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.3c","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-11-28T20:01:21.791845+0000","last_change":"2023-11-28T20:01:10.523152+0000","last_active":"2023-11-28T20:01:21.791845+0000","last_peered":"2023-11-28T20:01:21.791845+0000","last_clean":"2023-11-28T20:01:21.791845+0000","last_became_active":"2023-11-28T20:01:10.522874+0000","last_became_peered":"2023-11-28T20:01:10.522874+0000","last_unstale":"2023-11-28T20:01:21.791845+0000","last_undegraded":"2023-11-28T20:01:21.791845+0000","last_fullsized":"2023-11-28T20:01:21.791845+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_clean_scrub_stamp":"2023-11-28T20:01:09.480611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:56:55.097917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.3d","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2023-11-28T20:01:22.809244+0000","last_change":"2023-11-28T20:01:22.809244+0000","last_active":"2023-11-28T20:01:22.787100+0000","last_peered":"2023-11-28T20:01:22.787100+0000","last_clean":"2023-11-28T20:01:22.787100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:01:22.809244+0000","last_undegraded":"2023-11-28T20:01:22.809244+0000","last_fullsized":"2023-11-28T20:01:22.809244+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:22.787100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:22.787100+0000","last_clean_scrub_stamp":"2023-11-28T20:01:22.787100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.3b","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-11-28T20:01:21.801402+0000","last_change":"2023-11-28T20:01:10.529938+0000","last_active":"2023-11-28T20:01:21.801402+0000","last_peered":"2023-11-28T20:01:21.801402+0000","last_clean":"2023-11-28T20:01:21.801402+0000","last_became_active":"2023-11-28T20:01:10.529188+0000","last_became_peered":"2023-11-28T20:01:10.529188+0000","last_unstale":"2023-11-28T20:01:21.801402+0000","last_undegraded":"2023-11-28T20:01:21.801402+0000","last_fullsized":"2023-11-28T20:01:21.801402+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_clean_scrub_stamp":"2023-11-28T20:01:09.480611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:47:13.274500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.3c","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2023-11-28T20:01:22.810262+0000","last_change":"2023-11-28T20:01:22.810262+0000","last_active":"2023-11-28T20:01:22.787100+0000","last_peered":"2023-11-28T20:01:22.787100+0000","last_clean":"2023-11-28T20:01:22.787100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:01:22.810262+0000","last_undegraded":"2023-11-28T20:01:22.810262+0000","last_fullsized":"2023-11-28T20:01:22.810262+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:22.787100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:22.787100+0000","last_clean_scrub_stamp":"2023-11-28T20:01:22.787100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.3a","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-11-28T20:01:21.801203+0000","last_change":"2023-11-28T20:01:10.531000+0000","last_active":"2023-11-28T20:01:21.801203+0000","last_peered":"2023-11-28T20:01:21.801203+0000","last_clean":"2023-11-28T20:01:21.801203+0000","last_became_active":"2023-11-28T20:01:10.530754+0000","last_became_peered":"2023-11-28T20:01:10.530754+0000","last_unstale":"2023-11-28T20:01:21.801203+0000","last_undegraded":"2023-11-28T20:01:21.801203+0000","last_fullsized":"2023-11-28T20:01:21.801203+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_clean_scrub_stamp":"2023-11-28T20:01:09.480611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:44:34.399373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.3f","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2023-11-28T20:01:22.815237+0000","last_change":"2023-11-28T20:01:22.815237+0000","last_active":"2023-11-28T20:01:22.787100+0000","last_peered":"2023-11-28T20:01:22.787100+0000","last_clean":"2023-11-28T20:01:22.787100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:01:22.815237+0000","last_undegraded":"2023-11-28T20:01:22.815237+0000","last_fullsized":"2023-11-28T20:01:22.815237+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:22.787100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:22.787100+0000","last_clean_scrub_stamp":"2023-11-28T20:01:22.787100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.39","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-11-28T20:01:21.796927+0000","last_change":"2023-11-28T20:01:10.535113+0000","last_active":"2023-11-28T20:01:21.796927+0000","last_peered":"2023-11-28T20:01:21.796927+0000","last_clean":"2023-11-28T20:01:21.796927+0000","last_became_active":"2023-11-28T20:01:10.534919+0000","last_became_peered":"2023-11-28T20:01:10.534919+0000","last_unstale":"2023-11-28T20:01:21.796927+0000","last_undegraded":"2023-11-28T20:01:21.796927+0000","last_fullsized":"2023-11-28T20:01:21.796927+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_clean_scrub_stamp":"2023-11-28T20:01:09.480611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:00:31.915592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.3e","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2023-11-28T20:01:22.812285+0000","last_change":"2023-11-28T20:01:22.812285+0000","last_active":"2023-11-28T20:01:22.787100+0000","last_peered":"2023-11-28T20:01:22.787100+0000","last_clean":"2023-11-28T20:01:22.787100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:01:22.812285+0000","last_undegraded":"2023-11-28T20:01:22.812285+0000","last_fullsized":"2023-11-28T20:01:22.812285+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:22.787100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:22.787100+0000","last_clean_scrub_stamp":"2023-11-28T20:01:22.787100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.38","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-11-28T20:01:21.793498+0000","last_change":"2023-11-28T20:01:10.538054+0000","last_active":"2023-11-28T20:01:21.793498+0000","last_peered":"2023-11-28T20:01:21.793498+0000","last_clean":"2023-11-28T20:01:21.793498+0000","last_became_active":"2023-11-28T20:01:10.535363+0000","last_became_peered":"2023-11-28T20:01:10.535363+0000","last_unstale":"2023-11-28T20:01:21.793498+0000","last_undegraded":"2023-11-28T20:01:21.793498+0000","last_fullsized":"2023-11-28T20:01:21.793498+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_clean_scrub_stamp":"2023-11-28T20:01:09.480611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:06:36.994816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.31","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2023-11-28T20:01:22.805019+0000","last_change":"2023-11-28T20:01:22.805019+0000","last_active":"2023-11-28T20:01:22.787100+0000","last_peered":"2023-11-28T20:01:22.787100+0000","last_clean":"2023-11-28T20:01:22.787100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:01:22.805019+0000","last_undegraded":"2023-11-28T20:01:22.805019+0000","last_fullsized":"2023-11-28T20:01:22.805019+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:22.787100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:22.787100+0000","last_clean_scrub_stamp":"2023-11-28T20:01:22.787100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.37","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-11-28T20:01:21.799718+0000","last_change":"2023-11-28T20:01:10.543027+0000","last_active":"2023-11-28T20:01:21.799718+0000","last_peered":"2023-11-28T20:01:21.799718+0000","last_clean":"2023-11-28T20:01:21.799718+0000","last_became_active":"2023-11-28T20:01:10.541632+0000","last_became_peered":"2023-11-28T20:01:10.541632+0000","last_unstale":"2023-11-28T20:01:21.799718+0000","last_undegraded":"2023-11-28T20:01:21.799718+0000","last_fullsized":"2023-11-28T20:01:21.799718+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_clean_scrub_stamp":"2023-11-28T20:01:09.480611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:46:29.701039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.30","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2023-11-28T20:01:22.807023+0000","last_change":"2023-11-28T20:01:22.807023+0000","last_active":"2023-11-28T20:01:22.787100+0000","last_peered":"2023-11-28T20:01:22.787100+0000","last_clean":"2023-11-28T20:01:22.787100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:01:22.807023+0000","last_undegraded":"2023-11-28T20:01:22.807023+0000","last_fullsized":"2023-11-28T20:01:22.807023+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:22.787100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:22.787100+0000","last_clean_scrub_stamp":"2023-11-28T20:01:22.787100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.36","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-11-28T20:01:21.798466+0000","last_change":"2023-11-28T20:01:10.541712+0000","last_active":"2023-11-28T20:01:21.798466+0000","last_peered":"2023-11-28T20:01:21.798466+0000","last_clean":"2023-11-28T20:01:21.798466+0000","last_became_active":"2023-11-28T20:01:10.541389+0000","last_became_peered":"2023-11-28T20:01:10.541389+0000","last_unstale":"2023-11-28T20:01:21.798466+0000","last_undegraded":"2023-11-28T20:01:21.798466+0000","last_fullsized":"2023-11-28T20:01:21.798466+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_clean_scrub_stamp":"2023-11-28T20:01:09.480611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:54:30.269337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.33","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2023-11-28T20:01:22.801107+0000","last_change":"2023-11-28T20:01:22.801107+0000","last_active":"2023-11-28T20:01:22.787100+0000","last_peered":"2023-11-28T20:01:22.787100+0000","last_clean":"2023-11-28T20:01:22.787100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:01:22.801107+0000","last_undegraded":"2023-11-28T20:01:22.801107+0000","last_fullsized":"2023-11-28T20:01:22.801107+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:22.787100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:22.787100+0000","last_clean_scrub_stamp":"2023-11-28T20:01:22.787100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.35","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-11-28T20:01:21.791729+0000","last_change":"2023-11-28T20:01:10.520251+0000","last_active":"2023-11-28T20:01:21.791729+0000","last_peered":"2023-11-28T20:01:21.791729+0000","last_clean":"2023-11-28T20:01:21.791729+0000","last_became_active":"2023-11-28T20:01:10.519957+0000","last_became_peered":"2023-11-28T20:01:10.519957+0000","last_unstale":"2023-11-28T20:01:21.791729+0000","last_undegraded":"2023-11-28T20:01:21.791729+0000","last_fullsized":"2023-11-28T20:01:21.791729+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_clean_scrub_stamp":"2023-11-28T20:01:09.480611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:33:17.345518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.32","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2023-11-28T20:01:22.803669+0000","last_change":"2023-11-28T20:01:22.803669+0000","last_active":"2023-11-28T20:01:22.787100+0000","last_peered":"2023-11-28T20:01:22.787100+0000","last_clean":"2023-11-28T20:01:22.787100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:01:22.803669+0000","last_undegraded":"2023-11-28T20:01:22.803669+0000","last_fullsized":"2023-11-28T20:01:22.803669+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:22.787100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:22.787100+0000","last_clean_scrub_stamp":"2023-11-28T20:01:22.787100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.34","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-11-28T20:01:21.793709+0000","last_change":"2023-11-28T20:01:10.535199+0000","last_active":"2023-11-28T20:01:21.793709+0000","last_peered":"2023-11-28T20:01:21.793709+0000","last_clean":"2023-11-28T20:01:21.793709+0000","last_became_active":"2023-11-28T20:01:10.534856+0000","last_became_peered":"2023-11-28T20:01:10.534856+0000","last_unstale":"2023-11-28T20:01:21.793709+0000","last_undegraded":"2023-11-28T20:01:21.793709+0000","last_fullsized":"2023-11-28T20:01:21.793709+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_clean_scrub_stamp":"2023-11-28T20:01:09.480611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:07:03.844567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.35","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2023-11-28T20:01:22.809408+0000","last_change":"2023-11-28T20:01:22.809408+0000","last_active":"2023-11-28T20:01:22.787100+0000","last_peered":"2023-11-28T20:01:22.787100+0000","last_clean":"2023-11-28T20:01:22.787100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:01:22.809408+0000","last_undegraded":"2023-11-28T20:01:22.809408+0000","last_fullsized":"2023-11-28T20:01:22.809408+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:22.787100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:22.787100+0000","last_clean_scrub_stamp":"2023-11-28T20:01:22.787100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.33","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-11-28T20:01:21.793879+0000","last_change":"2023-11-28T20:01:10.529868+0000","last_active":"2023-11-28T20:01:21.793879+0000","last_peered":"2023-11-28T20:01:21.793879+0000","last_clean":"2023-11-28T20:01:21.793879+0000","last_became_active":"2023-11-28T20:01:10.529582+0000","last_became_peered":"2023-11-28T20:01:10.529582+0000","last_unstale":"2023-11-28T20:01:21.793879+0000","last_undegraded":"2023-11-28T20:01:21.793879+0000","last_fullsized":"2023-11-28T20:01:21.793879+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_clean_scrub_stamp":"2023-11-28T20:01:09.480611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T07:14:21.836133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.34","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2023-11-28T20:01:22.809821+0000","last_change":"2023-11-28T20:01:22.809821+0000","last_active":"2023-11-28T20:01:22.787100+0000","last_peered":"2023-11-28T20:01:22.787100+0000","last_clean":"2023-11-28T20:01:22.787100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:01:22.809821+0000","last_undegraded":"2023-11-28T20:01:22.809821+0000","last_fullsized":"2023-11-28T20:01:22.809821+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:22.787100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:22.787100+0000","last_clean_scrub_stamp":"2023-11-28T20:01:22.787100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.32","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-11-28T20:01:21.797969+0000","last_change":"2023-11-28T20:01:10.546075+0000","last_active":"2023-11-28T20:01:21.797969+0000","last_peered":"2023-11-28T20:01:21.797969+0000","last_clean":"2023-11-28T20:01:21.797969+0000","last_became_active":"2023-11-28T20:01:10.542038+0000","last_became_peered":"2023-11-28T20:01:10.542038+0000","last_unstale":"2023-11-28T20:01:21.797969+0000","last_undegraded":"2023-11-28T20:01:21.797969+0000","last_fullsized":"2023-11-28T20:01:21.797969+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_clean_scrub_stamp":"2023-11-28T20:01:09.480611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:44:34.399373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.37","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2023-11-28T20:01:22.806216+0000","last_change":"2023-11-28T20:01:22.806216+0000","last_active":"2023-11-28T20:01:22.787100+0000","last_peered":"2023-11-28T20:01:22.787100+0000","last_clean":"2023-11-28T20:01:22.787100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:01:22.806216+0000","last_undegraded":"2023-11-28T20:01:22.806216+0000","last_fullsized":"2023-11-28T20:01:22.806216+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:22.787100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:22.787100+0000","last_clean_scrub_stamp":"2023-11-28T20:01:22.787100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.31","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-11-28T20:01:21.798012+0000","last_change":"2023-11-28T20:01:10.535170+0000","last_active":"2023-11-28T20:01:21.798012+0000","last_peered":"2023-11-28T20:01:21.798012+0000","last_clean":"2023-11-28T20:01:21.798012+0000","last_became_active":"2023-11-28T20:01:10.534881+0000","last_became_peered":"2023-11-28T20:01:10.534881+0000","last_unstale":"2023-11-28T20:01:21.798012+0000","last_undegraded":"2023-11-28T20:01:21.798012+0000","last_fullsized":"2023-11-28T20:01:21.798012+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_clean_scrub_stamp":"2023-11-28T20:01:09.480611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:07:03.844567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.36","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2023-11-28T20:01:22.809354+0000","last_change":"2023-11-28T20:01:22.809354+0000","last_active":"2023-11-28T20:01:22.787100+0000","last_peered":"2023-11-28T20:01:22.787100+0000","last_clean":"2023-11-28T20:01:22.787100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:01:22.809354+0000","last_undegraded":"2023-11-28T20:01:22.809354+0000","last_fullsized":"2023-11-28T20:01:22.809354+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:22.787100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:22.787100+0000","last_clean_scrub_stamp":"2023-11-28T20:01:22.787100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.30","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-11-28T20:01:21.796113+0000","last_change":"2023-11-28T20:01:10.530998+0000","last_active":"2023-11-28T20:01:21.796113+0000","last_peered":"2023-11-28T20:01:21.796113+0000","last_clean":"2023-11-28T20:01:21.796113+0000","last_became_active":"2023-11-28T20:01:10.530709+0000","last_became_peered":"2023-11-28T20:01:10.530709+0000","last_unstale":"2023-11-28T20:01:21.796113+0000","last_undegraded":"2023-11-28T20:01:21.796113+0000","last_fullsized":"2023-11-28T20:01:21.796113+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_clean_scrub_stamp":"2023-11-28T20:01:09.480611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:11:53.891113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.29","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2023-11-28T20:01:22.805327+0000","last_change":"2023-11-28T20:01:22.805327+0000","last_active":"2023-11-28T20:01:22.787100+0000","last_peered":"2023-11-28T20:01:22.787100+0000","last_clean":"2023-11-28T20:01:22.787100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:01:22.805327+0000","last_undegraded":"2023-11-28T20:01:22.805327+0000","last_fullsized":"2023-11-28T20:01:22.805327+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:22.787100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:22.787100+0000","last_clean_scrub_stamp":"2023-11-28T20:01:22.787100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.2f","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-11-28T20:01:21.790410+0000","last_change":"2023-11-28T20:01:10.522350+0000","last_active":"2023-11-28T20:01:21.790410+0000","last_peered":"2023-11-28T20:01:21.790410+0000","last_clean":"2023-11-28T20:01:21.790410+0000","last_became_active":"2023-11-28T20:01:10.522075+0000","last_became_peered":"2023-11-28T20:01:10.522075+0000","last_unstale":"2023-11-28T20:01:21.790410+0000","last_undegraded":"2023-11-28T20:01:21.790410+0000","last_fullsized":"2023-11-28T20:01:21.790410+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_clean_scrub_stamp":"2023-11-28T20:01:09.480611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:18:49.627041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.28","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2023-11-28T20:01:22.805106+0000","last_change":"2023-11-28T20:01:22.805106+0000","last_active":"2023-11-28T20:01:22.787100+0000","last_peered":"2023-11-28T20:01:22.787100+0000","last_clean":"2023-11-28T20:01:22.787100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:01:22.805106+0000","last_undegraded":"2023-11-28T20:01:22.805106+0000","last_fullsized":"2023-11-28T20:01:22.805106+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:22.787100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:22.787100+0000","last_clean_scrub_stamp":"2023-11-28T20:01:22.787100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.2e","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-11-28T20:01:21.792752+0000","last_change":"2023-11-28T20:01:10.521611+0000","last_active":"2023-11-28T20:01:21.792752+0000","last_peered":"2023-11-28T20:01:21.792752+0000","last_clean":"2023-11-28T20:01:21.792752+0000","last_became_active":"2023-11-28T20:01:10.521162+0000","last_became_peered":"2023-11-28T20:01:10.521162+0000","last_unstale":"2023-11-28T20:01:21.792752+0000","last_undegraded":"2023-11-28T20:01:21.792752+0000","last_fullsized":"2023-11-28T20:01:21.792752+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_clean_scrub_stamp":"2023-11-28T20:01:09.480611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:04:56.486213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.2b","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2023-11-28T20:01:22.810297+0000","last_change":"2023-11-28T20:01:22.810297+0000","last_active":"2023-11-28T20:01:22.787100+0000","last_peered":"2023-11-28T20:01:22.787100+0000","last_clean":"2023-11-28T20:01:22.787100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:01:22.810297+0000","last_undegraded":"2023-11-28T20:01:22.810297+0000","last_fullsized":"2023-11-28T20:01:22.810297+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:22.787100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:22.787100+0000","last_clean_scrub_stamp":"2023-11-28T20:01:22.787100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.2d","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-11-28T20:01:21.801643+0000","last_change":"2023-11-28T20:01:10.526160+0000","last_active":"2023-11-28T20:01:21.801643+0000","last_peered":"2023-11-28T20:01:21.801643+0000","last_clean":"2023-11-28T20:01:21.801643+0000","last_became_active":"2023-11-28T20:01:10.525887+0000","last_became_peered":"2023-11-28T20:01:10.525887+0000","last_unstale":"2023-11-28T20:01:21.801643+0000","last_undegraded":"2023-11-28T20:01:21.801643+0000","last_fullsized":"2023-11-28T20:01:21.801643+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_clean_scrub_stamp":"2023-11-28T20:01:09.480611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:49:02.557281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.2a","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2023-11-28T20:01:22.800405+0000","last_change":"2023-11-28T20:01:22.800405+0000","last_active":"2023-11-28T20:01:22.787100+0000","last_peered":"2023-11-28T20:01:22.787100+0000","last_clean":"2023-11-28T20:01:22.787100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:01:22.800405+0000","last_undegraded":"2023-11-28T20:01:22.800405+0000","last_fullsized":"2023-11-28T20:01:22.800405+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:22.787100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:22.787100+0000","last_clean_scrub_stamp":"2023-11-28T20:01:22.787100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.2c","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-11-28T20:01:21.797188+0000","last_change":"2023-11-28T20:01:10.534338+0000","last_active":"2023-11-28T20:01:21.797188+0000","last_peered":"2023-11-28T20:01:21.797188+0000","last_clean":"2023-11-28T20:01:21.797188+0000","last_became_active":"2023-11-28T20:01:10.532397+0000","last_became_peered":"2023-11-28T20:01:10.532397+0000","last_unstale":"2023-11-28T20:01:21.797188+0000","last_undegraded":"2023-11-28T20:01:21.797188+0000","last_fullsized":"2023-11-28T20:01:21.797188+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_clean_scrub_stamp":"2023-11-28T20:01:09.480611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:51:36.724540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.2d","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2023-11-28T20:01:22.801543+0000","last_change":"2023-11-28T20:01:22.801543+0000","last_active":"2023-11-28T20:01:22.787100+0000","last_peered":"2023-11-28T20:01:22.787100+0000","last_clean":"2023-11-28T20:01:22.787100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:01:22.801543+0000","last_undegraded":"2023-11-28T20:01:22.801543+0000","last_fullsized":"2023-11-28T20:01:22.801543+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:22.787100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:22.787100+0000","last_clean_scrub_stamp":"2023-11-28T20:01:22.787100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.2b","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-11-28T20:01:21.793971+0000","last_change":"2023-11-28T20:01:10.528780+0000","last_active":"2023-11-28T20:01:21.793971+0000","last_peered":"2023-11-28T20:01:21.793971+0000","last_clean":"2023-11-28T20:01:21.793971+0000","last_became_active":"2023-11-28T20:01:10.524555+0000","last_became_peered":"2023-11-28T20:01:10.524555+0000","last_unstale":"2023-11-28T20:01:21.793971+0000","last_undegraded":"2023-11-28T20:01:21.793971+0000","last_fullsized":"2023-11-28T20:01:21.793971+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_clean_scrub_stamp":"2023-11-28T20:01:09.480611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:30:22.791908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.2c","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2023-11-28T20:01:22.800383+0000","last_change":"2023-11-28T20:01:22.800383+0000","last_active":"2023-11-28T20:01:22.787100+0000","last_peered":"2023-11-28T20:01:22.787100+0000","last_clean":"2023-11-28T20:01:22.787100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:01:22.800383+0000","last_undegraded":"2023-11-28T20:01:22.800383+0000","last_fullsized":"2023-11-28T20:01:22.800383+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:22.787100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:22.787100+0000","last_clean_scrub_stamp":"2023-11-28T20:01:22.787100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.2a","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-11-28T20:01:21.796467+0000","last_change":"2023-11-28T20:01:10.531958+0000","last_active":"2023-11-28T20:01:21.796467+0000","last_peered":"2023-11-28T20:01:21.796467+0000","last_clean":"2023-11-28T20:01:21.796467+0000","last_became_active":"2023-11-28T20:01:10.531111+0000","last_became_peered":"2023-11-28T20:01:10.531111+0000","last_unstale":"2023-11-28T20:01:21.796467+0000","last_undegraded":"2023-11-28T20:01:21.796467+0000","last_fullsized":"2023-11-28T20:01:21.796467+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_clean_scrub_stamp":"2023-11-28T20:01:09.480611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:52:31.642868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.2f","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2023-11-28T20:01:22.800411+0000","last_change":"2023-11-28T20:01:22.800411+0000","last_active":"2023-11-28T20:01:22.787100+0000","last_peered":"2023-11-28T20:01:22.787100+0000","last_clean":"2023-11-28T20:01:22.787100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:01:22.800411+0000","last_undegraded":"2023-11-28T20:01:22.800411+0000","last_fullsized":"2023-11-28T20:01:22.800411+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:22.787100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:22.787100+0000","last_clean_scrub_stamp":"2023-11-28T20:01:22.787100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.29","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-11-28T20:01:21.796452+0000","last_change":"2023-11-28T20:01:10.533367+0000","last_active":"2023-11-28T20:01:21.796452+0000","last_peered":"2023-11-28T20:01:21.796452+0000","last_clean":"2023-11-28T20:01:21.796452+0000","last_became_active":"2023-11-28T20:01:10.532975+0000","last_became_peered":"2023-11-28T20:01:10.532975+0000","last_unstale":"2023-11-28T20:01:21.796452+0000","last_undegraded":"2023-11-28T20:01:21.796452+0000","last_fullsized":"2023-11-28T20:01:21.796452+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_clean_scrub_stamp":"2023-11-28T20:01:09.480611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:10:30.393696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.2e","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2023-11-28T20:01:22.808991+0000","last_change":"2023-11-28T20:01:22.808991+0000","last_active":"2023-11-28T20:01:22.787100+0000","last_peered":"2023-11-28T20:01:22.787100+0000","last_clean":"2023-11-28T20:01:22.787100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:01:22.808991+0000","last_undegraded":"2023-11-28T20:01:22.808991+0000","last_fullsized":"2023-11-28T20:01:22.808991+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:22.787100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:22.787100+0000","last_clean_scrub_stamp":"2023-11-28T20:01:22.787100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.28","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-11-28T20:01:21.797562+0000","last_change":"2023-11-28T20:01:10.541445+0000","last_active":"2023-11-28T20:01:21.797562+0000","last_peered":"2023-11-28T20:01:21.797562+0000","last_clean":"2023-11-28T20:01:21.797562+0000","last_became_active":"2023-11-28T20:01:10.539375+0000","last_became_peered":"2023-11-28T20:01:10.539375+0000","last_unstale":"2023-11-28T20:01:21.797562+0000","last_undegraded":"2023-11-28T20:01:21.797562+0000","last_fullsized":"2023-11-28T20:01:21.797562+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_clean_scrub_stamp":"2023-11-28T20:01:09.480611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T07:14:21.836133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.21","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2023-11-28T20:01:22.806976+0000","last_change":"2023-11-28T20:01:22.806976+0000","last_active":"2023-11-28T20:01:22.787100+0000","last_peered":"2023-11-28T20:01:22.787100+0000","last_clean":"2023-11-28T20:01:22.787100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:01:22.806976+0000","last_undegraded":"2023-11-28T20:01:22.806976+0000","last_fullsized":"2023-11-28T20:01:22.806976+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:22.787100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:22.787100+0000","last_clean_scrub_stamp":"2023-11-28T20:01:22.787100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.27","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-11-28T20:01:21.794373+0000","last_change":"2023-11-28T20:01:10.531718+0000","last_active":"2023-11-28T20:01:21.794373+0000","last_peered":"2023-11-28T20:01:21.794373+0000","last_clean":"2023-11-28T20:01:21.794373+0000","last_became_active":"2023-11-28T20:01:10.529424+0000","last_became_peered":"2023-11-28T20:01:10.529424+0000","last_unstale":"2023-11-28T20:01:21.794373+0000","last_undegraded":"2023-11-28T20:01:21.794373+0000","last_fullsized":"2023-11-28T20:01:21.794373+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_clean_scrub_stamp":"2023-11-28T20:01:09.480611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:17:27.097887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.20","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2023-11-28T20:01:22.808081+0000","last_change":"2023-11-28T20:01:22.808081+0000","last_active":"2023-11-28T20:01:22.787100+0000","last_peered":"2023-11-28T20:01:22.787100+0000","last_clean":"2023-11-28T20:01:22.787100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:01:22.808081+0000","last_undegraded":"2023-11-28T20:01:22.808081+0000","last_fullsized":"2023-11-28T20:01:22.808081+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:22.787100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:22.787100+0000","last_clean_scrub_stamp":"2023-11-28T20:01:22.787100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.26","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-11-28T20:01:21.794270+0000","last_change":"2023-11-28T20:01:10.530284+0000","last_active":"2023-11-28T20:01:21.794270+0000","last_peered":"2023-11-28T20:01:21.794270+0000","last_clean":"2023-11-28T20:01:21.794270+0000","last_became_active":"2023-11-28T20:01:10.529805+0000","last_became_peered":"2023-11-28T20:01:10.529805+0000","last_unstale":"2023-11-28T20:01:21.794270+0000","last_undegraded":"2023-11-28T20:01:21.794270+0000","last_fullsized":"2023-11-28T20:01:21.794270+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_clean_scrub_stamp":"2023-11-28T20:01:09.480611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:46:29.701039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.23","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2023-11-28T20:01:22.808672+0000","last_change":"2023-11-28T20:01:22.808672+0000","last_active":"2023-11-28T20:01:22.787100+0000","last_peered":"2023-11-28T20:01:22.787100+0000","last_clean":"2023-11-28T20:01:22.787100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:01:22.808672+0000","last_undegraded":"2023-11-28T20:01:22.808672+0000","last_fullsized":"2023-11-28T20:01:22.808672+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:22.787100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:22.787100+0000","last_clean_scrub_stamp":"2023-11-28T20:01:22.787100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.25","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-11-28T20:01:21.791827+0000","last_change":"2023-11-28T20:01:10.519186+0000","last_active":"2023-11-28T20:01:21.791827+0000","last_peered":"2023-11-28T20:01:21.791827+0000","last_clean":"2023-11-28T20:01:21.791827+0000","last_became_active":"2023-11-28T20:01:10.518855+0000","last_became_peered":"2023-11-28T20:01:10.518855+0000","last_unstale":"2023-11-28T20:01:21.791827+0000","last_undegraded":"2023-11-28T20:01:21.791827+0000","last_fullsized":"2023-11-28T20:01:21.791827+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_clean_scrub_stamp":"2023-11-28T20:01:09.480611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:23:19.215371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.22","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2023-11-28T20:01:22.807092+0000","last_change":"2023-11-28T20:01:22.807092+0000","last_active":"2023-11-28T20:01:22.787100+0000","last_peered":"2023-11-28T20:01:22.787100+0000","last_clean":"2023-11-28T20:01:22.787100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:01:22.807092+0000","last_undegraded":"2023-11-28T20:01:22.807092+0000","last_fullsized":"2023-11-28T20:01:22.807092+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:22.787100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:22.787100+0000","last_clean_scrub_stamp":"2023-11-28T20:01:22.787100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.24","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-11-28T20:01:21.789959+0000","last_change":"2023-11-28T20:01:10.537687+0000","last_active":"2023-11-28T20:01:21.789959+0000","last_peered":"2023-11-28T20:01:21.789959+0000","last_clean":"2023-11-28T20:01:21.789959+0000","last_became_active":"2023-11-28T20:01:10.536233+0000","last_became_peered":"2023-11-28T20:01:10.536233+0000","last_unstale":"2023-11-28T20:01:21.789959+0000","last_undegraded":"2023-11-28T20:01:21.789959+0000","last_fullsized":"2023-11-28T20:01:21.789959+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_clean_scrub_stamp":"2023-11-28T20:01:09.480611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:18:17.108795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.25","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2023-11-28T20:01:22.815803+0000","last_change":"2023-11-28T20:01:22.815803+0000","last_active":"2023-11-28T20:01:22.787100+0000","last_peered":"2023-11-28T20:01:22.787100+0000","last_clean":"2023-11-28T20:01:22.787100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:01:22.815803+0000","last_undegraded":"2023-11-28T20:01:22.815803+0000","last_fullsized":"2023-11-28T20:01:22.815803+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:22.787100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:22.787100+0000","last_clean_scrub_stamp":"2023-11-28T20:01:22.787100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.23","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-11-28T20:01:21.798126+0000","last_change":"2023-11-28T20:01:10.534726+0000","last_active":"2023-11-28T20:01:21.798126+0000","last_peered":"2023-11-28T20:01:21.798126+0000","last_clean":"2023-11-28T20:01:21.798126+0000","last_became_active":"2023-11-28T20:01:10.534413+0000","last_became_peered":"2023-11-28T20:01:10.534413+0000","last_unstale":"2023-11-28T20:01:21.798126+0000","last_undegraded":"2023-11-28T20:01:21.798126+0000","last_fullsized":"2023-11-28T20:01:21.798126+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_clean_scrub_stamp":"2023-11-28T20:01:09.480611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:30:22.791908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.24","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2023-11-28T20:01:22.799856+0000","last_change":"2023-11-28T20:01:22.799856+0000","last_active":"2023-11-28T20:01:22.787100+0000","last_peered":"2023-11-28T20:01:22.787100+0000","last_clean":"2023-11-28T20:01:22.787100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:01:22.799856+0000","last_undegraded":"2023-11-28T20:01:22.799856+0000","last_fullsized":"2023-11-28T20:01:22.799856+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:22.787100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:22.787100+0000","last_clean_scrub_stamp":"2023-11-28T20:01:22.787100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.22","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-11-28T20:01:21.793740+0000","last_change":"2023-11-28T20:01:10.534050+0000","last_active":"2023-11-28T20:01:21.793740+0000","last_peered":"2023-11-28T20:01:21.793740+0000","last_clean":"2023-11-28T20:01:21.793740+0000","last_became_active":"2023-11-28T20:01:10.533704+0000","last_became_peered":"2023-11-28T20:01:10.533704+0000","last_unstale":"2023-11-28T20:01:21.793740+0000","last_undegraded":"2023-11-28T20:01:21.793740+0000","last_fullsized":"2023-11-28T20:01:21.793740+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_clean_scrub_stamp":"2023-11-28T20:01:09.480611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:50:58.589965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.27","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2023-11-28T20:01:22.804472+0000","last_change":"2023-11-28T20:01:22.804472+0000","last_active":"2023-11-28T20:01:22.787100+0000","last_peered":"2023-11-28T20:01:22.787100+0000","last_clean":"2023-11-28T20:01:22.787100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:01:22.804472+0000","last_undegraded":"2023-11-28T20:01:22.804472+0000","last_fullsized":"2023-11-28T20:01:22.804472+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:22.787100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:22.787100+0000","last_clean_scrub_stamp":"2023-11-28T20:01:22.787100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.21","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-11-28T20:01:21.791333+0000","last_change":"2023-11-28T20:01:10.520311+0000","last_active":"2023-11-28T20:01:21.791333+0000","last_peered":"2023-11-28T20:01:21.791333+0000","last_clean":"2023-11-28T20:01:21.791333+0000","last_became_active":"2023-11-28T20:01:10.519974+0000","last_became_peered":"2023-11-28T20:01:10.519974+0000","last_unstale":"2023-11-28T20:01:21.791333+0000","last_undegraded":"2023-11-28T20:01:21.791333+0000","last_fullsized":"2023-11-28T20:01:21.791333+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_clean_scrub_stamp":"2023-11-28T20:01:09.480611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T07:02:13.895402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.26","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2023-11-28T20:01:22.808714+0000","last_change":"2023-11-28T20:01:22.808714+0000","last_active":"2023-11-28T20:01:22.787100+0000","last_peered":"2023-11-28T20:01:22.787100+0000","last_clean":"2023-11-28T20:01:22.787100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:01:22.808714+0000","last_undegraded":"2023-11-28T20:01:22.808714+0000","last_fullsized":"2023-11-28T20:01:22.808714+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:22.787100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:22.787100+0000","last_clean_scrub_stamp":"2023-11-28T20:01:22.787100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.20","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-11-28T20:01:21.800585+0000","last_change":"2023-11-28T20:01:10.525223+0000","last_active":"2023-11-28T20:01:21.800585+0000","last_peered":"2023-11-28T20:01:21.800585+0000","last_clean":"2023-11-28T20:01:21.800585+0000","last_became_active":"2023-11-28T20:01:10.524750+0000","last_became_peered":"2023-11-28T20:01:10.524750+0000","last_unstale":"2023-11-28T20:01:21.800585+0000","last_undegraded":"2023-11-28T20:01:21.800585+0000","last_fullsized":"2023-11-28T20:01:21.800585+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_clean_scrub_stamp":"2023-11-28T20:01:09.480611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:50:58.589965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.1a","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2023-11-28T20:01:22.804950+0000","last_change":"2023-11-28T20:01:22.804950+0000","last_active":"2023-11-28T20:01:22.787100+0000","last_peered":"2023-11-28T20:01:22.787100+0000","last_clean":"2023-11-28T20:01:22.787100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:01:22.804950+0000","last_undegraded":"2023-11-28T20:01:22.804950+0000","last_fullsized":"2023-11-28T20:01:22.804950+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:22.787100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:22.787100+0000","last_clean_scrub_stamp":"2023-11-28T20:01:22.787100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1d","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-28T20:01:22.832104+0000","last_change":"2023-11-28T20:01:22.828333+0000","last_active":"2023-11-28T20:01:22.832104+0000","last_peered":"2023-11-28T20:01:22.832104+0000","last_clean":"2023-11-28T20:01:22.832104+0000","last_became_active":"2023-11-28T20:01:22.828042+0000","last_became_peered":"2023-11-28T20:01:22.828042+0000","last_unstale":"2023-11-28T20:01:22.832104+0000","last_undegraded":"2023-11-28T20:01:22.832104+0000","last_fullsized":"2023-11-28T20:01:22.832104+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:21.777981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:21.777981+0000","last_clean_scrub_stamp":"2023-11-28T20:01:21.777981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:51:49.021909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1c","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-11-28T20:01:21.801606+0000","last_change":"2023-11-28T20:01:10.528869+0000","last_active":"2023-11-28T20:01:21.801606+0000","last_peered":"2023-11-28T20:01:21.801606+0000","last_clean":"2023-11-28T20:01:21.801606+0000","last_became_active":"2023-11-28T20:01:10.528572+0000","last_became_peered":"2023-11-28T20:01:10.528572+0000","last_unstale":"2023-11-28T20:01:21.801606+0000","last_undegraded":"2023-11-28T20:01:21.801606+0000","last_fullsized":"2023-11-28T20:01:21.801606+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_clean_scrub_stamp":"2023-11-28T20:01:09.480611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:37:17.516298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.1f","version":"60'4","reported_seq":18,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-11-28T20:01:21.790597+0000","last_change":"2023-11-28T20:01:09.512544+0000","last_active":"2023-11-28T20:01:21.790597+0000","last_peered":"2023-11-28T20:01:21.790597+0000","last_clean":"2023-11-28T20:01:21.790597+0000","last_became_active":"2023-11-28T20:01:09.512197+0000","last_became_peered":"2023-11-28T20:01:09.512197+0000","last_unstale":"2023-11-28T20:01:21.790597+0000","last_undegraded":"2023-11-28T20:01:21.790597+0000","last_fullsized":"2023-11-28T20:01:21.790597+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:08.474257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:08.474257+0000","last_clean_scrub_stamp":"2023-11-28T20:01:08.474257+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:49:01.550926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.1b","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2023-11-28T20:01:22.806830+0000","last_change":"2023-11-28T20:01:22.806830+0000","last_active":"2023-11-28T20:01:22.787100+0000","last_peered":"2023-11-28T20:01:22.787100+0000","last_clean":"2023-11-28T20:01:22.787100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:01:22.806830+0000","last_undegraded":"2023-11-28T20:01:22.806830+0000","last_fullsized":"2023-11-28T20:01:22.806830+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:22.787100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:22.787100+0000","last_clean_scrub_stamp":"2023-11-28T20:01:22.787100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1c","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-28T20:01:22.827276+0000","last_change":"2023-11-28T20:01:22.821621+0000","last_active":"2023-11-28T20:01:22.827276+0000","last_peered":"2023-11-28T20:01:22.827276+0000","last_clean":"2023-11-28T20:01:22.827276+0000","last_became_active":"2023-11-28T20:01:22.821322+0000","last_became_peered":"2023-11-28T20:01:22.821322+0000","last_unstale":"2023-11-28T20:01:22.827276+0000","last_undegraded":"2023-11-28T20:01:22.827276+0000","last_fullsized":"2023-11-28T20:01:22.827276+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:21.777981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:21.777981+0000","last_clean_scrub_stamp":"2023-11-28T20:01:21.777981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:05:44.877415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.1d","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-11-28T20:01:21.791853+0000","last_change":"2023-11-28T20:01:10.528270+0000","last_active":"2023-11-28T20:01:21.791853+0000","last_peered":"2023-11-28T20:01:21.791853+0000","last_clean":"2023-11-28T20:01:21.791853+0000","last_became_active":"2023-11-28T20:01:10.527932+0000","last_became_peered":"2023-11-28T20:01:10.527932+0000","last_unstale":"2023-11-28T20:01:21.791853+0000","last_undegraded":"2023-11-28T20:01:21.791853+0000","last_fullsized":"2023-11-28T20:01:21.791853+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_clean_scrub_stamp":"2023-11-28T20:01:09.480611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T07:21:45.278688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1e","version":"60'1","reported_seq":15,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-11-28T20:01:21.801722+0000","last_change":"2023-11-28T20:01:09.516140+0000","last_active":"2023-11-28T20:01:21.801722+0000","last_peered":"2023-11-28T20:01:21.801722+0000","last_clean":"2023-11-28T20:01:21.801722+0000","last_became_active":"2023-11-28T20:01:09.514007+0000","last_became_peered":"2023-11-28T20:01:09.514007+0000","last_unstale":"2023-11-28T20:01:21.801722+0000","last_undegraded":"2023-11-28T20:01:21.801722+0000","last_fullsized":"2023-11-28T20:01:21.801722+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:08.474257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:08.474257+0000","last_clean_scrub_stamp":"2023-11-28T20:01:08.474257+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:30:21.785554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.18","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2023-11-28T20:01:22.807282+0000","last_change":"2023-11-28T20:01:22.807282+0000","last_active":"2023-11-28T20:01:22.787100+0000","last_peered":"2023-11-28T20:01:22.787100+0000","last_clean":"2023-11-28T20:01:22.787100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:01:22.807282+0000","last_undegraded":"2023-11-28T20:01:22.807282+0000","last_fullsized":"2023-11-28T20:01:22.807282+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:22.787100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:22.787100+0000","last_clean_scrub_stamp":"2023-11-28T20:01:22.787100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.1f","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-28T20:01:22.825882+0000","last_change":"2023-11-28T20:01:22.821923+0000","last_active":"2023-11-28T20:01:22.825882+0000","last_peered":"2023-11-28T20:01:22.825882+0000","last_clean":"2023-11-28T20:01:22.825882+0000","last_became_active":"2023-11-28T20:01:22.821642+0000","last_became_peered":"2023-11-28T20:01:22.821642+0000","last_unstale":"2023-11-28T20:01:22.825882+0000","last_undegraded":"2023-11-28T20:01:22.825882+0000","last_fullsized":"2023-11-28T20:01:22.825882+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:21.777981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:21.777981+0000","last_clean_scrub_stamp":"2023-11-28T20:01:21.777981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:17:30.312696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.1e","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-11-28T20:01:21.801669+0000","last_change":"2023-11-28T20:01:10.526680+0000","last_active":"2023-11-28T20:01:21.801669+0000","last_peered":"2023-11-28T20:01:21.801669+0000","last_clean":"2023-11-28T20:01:21.801669+0000","last_became_active":"2023-11-28T20:01:10.526366+0000","last_became_peered":"2023-11-28T20:01:10.526366+0000","last_unstale":"2023-11-28T20:01:21.801669+0000","last_undegraded":"2023-11-28T20:01:21.801669+0000","last_fullsized":"2023-11-28T20:01:21.801669+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_clean_scrub_stamp":"2023-11-28T20:01:09.480611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:05:54.478424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1d","version":"60'2","reported_seq":16,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-11-28T20:01:21.801620+0000","last_change":"2023-11-28T20:01:09.510600+0000","last_active":"2023-11-28T20:01:21.801620+0000","last_peered":"2023-11-28T20:01:21.801620+0000","last_clean":"2023-11-28T20:01:21.801620+0000","last_became_active":"2023-11-28T20:01:09.510336+0000","last_became_peered":"2023-11-28T20:01:09.510336+0000","last_unstale":"2023-11-28T20:01:21.801620+0000","last_undegraded":"2023-11-28T20:01:21.801620+0000","last_fullsized":"2023-11-28T20:01:21.801620+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:08.474257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:08.474257+0000","last_clean_scrub_stamp":"2023-11-28T20:01:08.474257+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:56:14.988591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.19","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2023-11-28T20:01:22.804536+0000","last_change":"2023-11-28T20:01:22.804536+0000","last_active":"2023-11-28T20:01:22.787100+0000","last_peered":"2023-11-28T20:01:22.787100+0000","last_clean":"2023-11-28T20:01:22.787100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:01:22.804536+0000","last_undegraded":"2023-11-28T20:01:22.804536+0000","last_fullsized":"2023-11-28T20:01:22.804536+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:22.787100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:22.787100+0000","last_clean_scrub_stamp":"2023-11-28T20:01:22.787100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1e","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-28T20:01:22.832207+0000","last_change":"2023-11-28T20:01:22.828784+0000","last_active":"2023-11-28T20:01:22.832207+0000","last_peered":"2023-11-28T20:01:22.832207+0000","last_clean":"2023-11-28T20:01:22.832207+0000","last_became_active":"2023-11-28T20:01:22.828228+0000","last_became_peered":"2023-11-28T20:01:22.828228+0000","last_unstale":"2023-11-28T20:01:22.832207+0000","last_undegraded":"2023-11-28T20:01:22.832207+0000","last_fullsized":"2023-11-28T20:01:22.832207+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:21.777981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:21.777981+0000","last_clean_scrub_stamp":"2023-11-28T20:01:21.777981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:02:43.254120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1f","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-11-28T20:01:21.799642+0000","last_change":"2023-11-28T20:01:10.541960+0000","last_active":"2023-11-28T20:01:21.799642+0000","last_peered":"2023-11-28T20:01:21.799642+0000","last_clean":"2023-11-28T20:01:21.799642+0000","last_became_active":"2023-11-28T20:01:10.541305+0000","last_became_peered":"2023-11-28T20:01:10.541305+0000","last_unstale":"2023-11-28T20:01:21.799642+0000","last_undegraded":"2023-11-28T20:01:21.799642+0000","last_fullsized":"2023-11-28T20:01:21.799642+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_clean_scrub_stamp":"2023-11-28T20:01:09.480611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:17:27.097887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.1c","version":"60'2","reported_seq":16,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-11-28T20:01:21.801386+0000","last_change":"2023-11-28T20:01:09.507988+0000","last_active":"2023-11-28T20:01:21.801386+0000","last_peered":"2023-11-28T20:01:21.801386+0000","last_clean":"2023-11-28T20:01:21.801386+0000","last_became_active":"2023-11-28T20:01:09.507762+0000","last_became_peered":"2023-11-28T20:01:09.507762+0000","last_unstale":"2023-11-28T20:01:21.801386+0000","last_undegraded":"2023-11-28T20:01:21.801386+0000","last_fullsized":"2023-11-28T20:01:21.801386+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:08.474257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:08.474257+0000","last_clean_scrub_stamp":"2023-11-28T20:01:08.474257+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T07:14:20.829778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.1e","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2023-11-28T20:01:22.806058+0000","last_change":"2023-11-28T20:01:22.806058+0000","last_active":"2023-11-28T20:01:22.787100+0000","last_peered":"2023-11-28T20:01:22.787100+0000","last_clean":"2023-11-28T20:01:22.787100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:01:22.806058+0000","last_undegraded":"2023-11-28T20:01:22.806058+0000","last_fullsized":"2023-11-28T20:01:22.806058+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:22.787100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:22.787100+0000","last_clean_scrub_stamp":"2023-11-28T20:01:22.787100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-28T20:01:22.821300+0000","last_change":"2023-11-28T20:01:22.818660+0000","last_active":"2023-11-28T20:01:22.821300+0000","last_peered":"2023-11-28T20:01:22.821300+0000","last_clean":"2023-11-28T20:01:22.821300+0000","last_became_active":"2023-11-28T20:01:22.818352+0000","last_became_peered":"2023-11-28T20:01:22.818352+0000","last_unstale":"2023-11-28T20:01:22.821300+0000","last_undegraded":"2023-11-28T20:01:22.821300+0000","last_fullsized":"2023-11-28T20:01:22.821300+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:21.777981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:21.777981+0000","last_clean_scrub_stamp":"2023-11-28T20:01:21.777981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:59:20.866094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-11-28T20:01:21.796193+0000","last_change":"2023-11-28T20:01:10.518032+0000","last_active":"2023-11-28T20:01:21.796193+0000","last_peered":"2023-11-28T20:01:21.796193+0000","last_clean":"2023-11-28T20:01:21.796193+0000","last_became_active":"2023-11-28T20:01:10.517780+0000","last_became_peered":"2023-11-28T20:01:10.517780+0000","last_unstale":"2023-11-28T20:01:21.796193+0000","last_undegraded":"2023-11-28T20:01:21.796193+0000","last_fullsized":"2023-11-28T20:01:21.796193+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_clean_scrub_stamp":"2023-11-28T20:01:09.480611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:43:39.118896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.1b","version":"60'1","reported_seq":15,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-11-28T20:01:21.797196+0000","last_change":"2023-11-28T20:01:09.514901+0000","last_active":"2023-11-28T20:01:21.797196+0000","last_peered":"2023-11-28T20:01:21.797196+0000","last_clean":"2023-11-28T20:01:21.797196+0000","last_became_active":"2023-11-28T20:01:09.514568+0000","last_became_peered":"2023-11-28T20:01:09.514568+0000","last_unstale":"2023-11-28T20:01:21.797196+0000","last_undegraded":"2023-11-28T20:01:21.797196+0000","last_fullsized":"2023-11-28T20:01:21.797196+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:08.474257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:08.474257+0000","last_clean_scrub_stamp":"2023-11-28T20:01:08.474257+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:44:33.393018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.1f","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2023-11-28T20:01:22.808178+0000","last_change":"2023-11-28T20:01:22.808178+0000","last_active":"2023-11-28T20:01:22.787100+0000","last_peered":"2023-11-28T20:01:22.787100+0000","last_clean":"2023-11-28T20:01:22.787100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:01:22.808178+0000","last_undegraded":"2023-11-28T20:01:22.808178+0000","last_fullsized":"2023-11-28T20:01:22.808178+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:22.787100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:22.787100+0000","last_clean_scrub_stamp":"2023-11-28T20:01:22.787100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-28T20:01:22.816804+0000","last_change":"2023-11-28T20:01:22.811015+0000","last_active":"2023-11-28T20:01:22.816804+0000","last_peered":"2023-11-28T20:01:22.816804+0000","last_clean":"2023-11-28T20:01:22.816804+0000","last_became_active":"2023-11-28T20:01:22.810559+0000","last_became_peered":"2023-11-28T20:01:22.810559+0000","last_unstale":"2023-11-28T20:01:22.816804+0000","last_undegraded":"2023-11-28T20:01:22.816804+0000","last_fullsized":"2023-11-28T20:01:22.816804+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:21.777981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:21.777981+0000","last_clean_scrub_stamp":"2023-11-28T20:01:21.777981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:14:31.333418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-11-28T20:01:21.789863+0000","last_change":"2023-11-28T20:01:10.522005+0000","last_active":"2023-11-28T20:01:21.789863+0000","last_peered":"2023-11-28T20:01:21.789863+0000","last_clean":"2023-11-28T20:01:21.789863+0000","last_became_active":"2023-11-28T20:01:10.521691+0000","last_became_peered":"2023-11-28T20:01:10.521691+0000","last_unstale":"2023-11-28T20:01:21.789863+0000","last_undegraded":"2023-11-28T20:01:21.789863+0000","last_fullsized":"2023-11-28T20:01:21.789863+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_clean_scrub_stamp":"2023-11-28T20:01:09.480611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:11:08.794514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1a","version":"60'1","reported_seq":15,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-11-28T20:01:21.796566+0000","last_change":"2023-11-28T20:01:09.510388+0000","last_active":"2023-11-28T20:01:21.796566+0000","last_peered":"2023-11-28T20:01:21.796566+0000","last_clean":"2023-11-28T20:01:21.796566+0000","last_became_active":"2023-11-28T20:01:09.510114+0000","last_became_peered":"2023-11-28T20:01:09.510114+0000","last_unstale":"2023-11-28T20:01:21.796566+0000","last_undegraded":"2023-11-28T20:01:21.796566+0000","last_fullsized":"2023-11-28T20:01:21.796566+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:08.474257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:08.474257+0000","last_clean_scrub_stamp":"2023-11-28T20:01:08.474257+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T06:29:12.572972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.1c","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2023-11-28T20:01:22.805361+0000","last_change":"2023-11-28T20:01:22.805361+0000","last_active":"2023-11-28T20:01:22.787100+0000","last_peered":"2023-11-28T20:01:22.787100+0000","last_clean":"2023-11-28T20:01:22.787100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:01:22.805361+0000","last_undegraded":"2023-11-28T20:01:22.805361+0000","last_fullsized":"2023-11-28T20:01:22.805361+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:22.787100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:22.787100+0000","last_clean_scrub_stamp":"2023-11-28T20:01:22.787100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1b","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-28T20:01:22.829871+0000","last_change":"2023-11-28T20:01:22.826731+0000","last_active":"2023-11-28T20:01:22.829871+0000","last_peered":"2023-11-28T20:01:22.829871+0000","last_clean":"2023-11-28T20:01:22.829871+0000","last_became_active":"2023-11-28T20:01:22.826278+0000","last_became_peered":"2023-11-28T20:01:22.826278+0000","last_unstale":"2023-11-28T20:01:22.829871+0000","last_undegraded":"2023-11-28T20:01:22.829871+0000","last_fullsized":"2023-11-28T20:01:22.829871+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:21.777981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:21.777981+0000","last_clean_scrub_stamp":"2023-11-28T20:01:21.777981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T07:05:57.693273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.1a","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-11-28T20:01:21.801060+0000","last_change":"2023-11-28T20:01:10.536831+0000","last_active":"2023-11-28T20:01:21.801060+0000","last_peered":"2023-11-28T20:01:21.801060+0000","last_clean":"2023-11-28T20:01:21.801060+0000","last_became_active":"2023-11-28T20:01:10.536506+0000","last_became_peered":"2023-11-28T20:01:10.536506+0000","last_unstale":"2023-11-28T20:01:21.801060+0000","last_undegraded":"2023-11-28T20:01:21.801060+0000","last_fullsized":"2023-11-28T20:01:21.801060+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_clean_scrub_stamp":"2023-11-28T20:01:09.480611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:29:39.856095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":14,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-11-28T20:01:21.796477+0000","last_change":"2023-11-28T20:01:09.514530+0000","last_active":"2023-11-28T20:01:21.796477+0000","last_peered":"2023-11-28T20:01:21.796477+0000","last_clean":"2023-11-28T20:01:21.796477+0000","last_became_active":"2023-11-28T20:01:09.514112+0000","last_became_peered":"2023-11-28T20:01:09.514112+0000","last_unstale":"2023-11-28T20:01:21.796477+0000","last_undegraded":"2023-11-28T20:01:21.796477+0000","last_fullsized":"2023-11-28T20:01:21.796477+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:08.474257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:08.474257+0000","last_clean_scrub_stamp":"2023-11-28T20:01:08.474257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:07:02.838212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.1d","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2023-11-28T20:01:22.804949+0000","last_change":"2023-11-28T20:01:22.804949+0000","last_active":"2023-11-28T20:01:22.787100+0000","last_peered":"2023-11-28T20:01:22.787100+0000","last_clean":"2023-11-28T20:01:22.787100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:01:22.804949+0000","last_undegraded":"2023-11-28T20:01:22.804949+0000","last_fullsized":"2023-11-28T20:01:22.804949+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:22.787100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:22.787100+0000","last_clean_scrub_stamp":"2023-11-28T20:01:22.787100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1a","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-28T20:01:22.827278+0000","last_change":"2023-11-28T20:01:22.823414+0000","last_active":"2023-11-28T20:01:22.827278+0000","last_peered":"2023-11-28T20:01:22.827278+0000","last_clean":"2023-11-28T20:01:22.827278+0000","last_became_active":"2023-11-28T20:01:22.823073+0000","last_became_peered":"2023-11-28T20:01:22.823073+0000","last_unstale":"2023-11-28T20:01:22.827278+0000","last_undegraded":"2023-11-28T20:01:22.827278+0000","last_fullsized":"2023-11-28T20:01:22.827278+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:21.777981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:21.777981+0000","last_clean_scrub_stamp":"2023-11-28T20:01:21.777981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:13:17.072225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.1b","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-11-28T20:01:21.797586+0000","last_change":"2023-11-28T20:01:10.522250+0000","last_active":"2023-11-28T20:01:21.797586+0000","last_peered":"2023-11-28T20:01:21.797586+0000","last_clean":"2023-11-28T20:01:21.797586+0000","last_became_active":"2023-11-28T20:01:10.521958+0000","last_became_peered":"2023-11-28T20:01:10.521958+0000","last_unstale":"2023-11-28T20:01:21.797586+0000","last_undegraded":"2023-11-28T20:01:21.797586+0000","last_fullsized":"2023-11-28T20:01:21.797586+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_clean_scrub_stamp":"2023-11-28T20:01:09.480611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:59:08.568724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":14,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-11-28T20:01:21.801005+0000","last_change":"2023-11-28T20:01:09.512078+0000","last_active":"2023-11-28T20:01:21.801005+0000","last_peered":"2023-11-28T20:01:21.801005+0000","last_clean":"2023-11-28T20:01:21.801005+0000","last_became_active":"2023-11-28T20:01:09.511733+0000","last_became_peered":"2023-11-28T20:01:09.511733+0000","last_unstale":"2023-11-28T20:01:21.801005+0000","last_undegraded":"2023-11-28T20:01:21.801005+0000","last_fullsized":"2023-11-28T20:01:21.801005+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:08.474257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:08.474257+0000","last_clean_scrub_stamp":"2023-11-28T20:01:08.474257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:16:29.294303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.12","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2023-11-28T20:01:22.801913+0000","last_change":"2023-11-28T20:01:22.801913+0000","last_active":"2023-11-28T20:01:22.787100+0000","last_peered":"2023-11-28T20:01:22.787100+0000","last_clean":"2023-11-28T20:01:22.787100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:01:22.801913+0000","last_undegraded":"2023-11-28T20:01:22.801913+0000","last_fullsized":"2023-11-28T20:01:22.801913+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:22.787100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:22.787100+0000","last_clean_scrub_stamp":"2023-11-28T20:01:22.787100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.15","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-28T20:01:22.828323+0000","last_change":"2023-11-28T20:01:22.818633+0000","last_active":"2023-11-28T20:01:22.828323+0000","last_peered":"2023-11-28T20:01:22.828323+0000","last_clean":"2023-11-28T20:01:22.828323+0000","last_became_active":"2023-11-28T20:01:22.818036+0000","last_became_peered":"2023-11-28T20:01:22.818036+0000","last_unstale":"2023-11-28T20:01:22.828323+0000","last_undegraded":"2023-11-28T20:01:22.828323+0000","last_fullsized":"2023-11-28T20:01:22.828323+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:21.777981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:21.777981+0000","last_clean_scrub_stamp":"2023-11-28T20:01:21.777981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:18:51.761689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.14","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-11-28T20:01:21.790040+0000","last_change":"2023-11-28T20:01:10.517714+0000","last_active":"2023-11-28T20:01:21.790040+0000","last_peered":"2023-11-28T20:01:21.790040+0000","last_clean":"2023-11-28T20:01:21.790040+0000","last_became_active":"2023-11-28T20:01:10.517414+0000","last_became_peered":"2023-11-28T20:01:10.517414+0000","last_unstale":"2023-11-28T20:01:21.790040+0000","last_undegraded":"2023-11-28T20:01:21.790040+0000","last_fullsized":"2023-11-28T20:01:21.790040+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_clean_scrub_stamp":"2023-11-28T20:01:09.480611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T06:10:19.765319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":14,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-11-28T20:01:21.799883+0000","last_change":"2023-11-28T20:01:09.519465+0000","last_active":"2023-11-28T20:01:21.799883+0000","last_peered":"2023-11-28T20:01:21.799883+0000","last_clean":"2023-11-28T20:01:21.799883+0000","last_became_active":"2023-11-28T20:01:09.519233+0000","last_became_peered":"2023-11-28T20:01:09.519233+0000","last_unstale":"2023-11-28T20:01:21.799883+0000","last_undegraded":"2023-11-28T20:01:21.799883+0000","last_fullsized":"2023-11-28T20:01:21.799883+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:08.474257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:08.474257+0000","last_clean_scrub_stamp":"2023-11-28T20:01:08.474257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T07:34:36.168268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.13","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2023-11-28T20:01:22.809235+0000","last_change":"2023-11-28T20:01:22.809235+0000","last_active":"2023-11-28T20:01:22.787100+0000","last_peered":"2023-11-28T20:01:22.787100+0000","last_clean":"2023-11-28T20:01:22.787100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:01:22.809235+0000","last_undegraded":"2023-11-28T20:01:22.809235+0000","last_fullsized":"2023-11-28T20:01:22.809235+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:22.787100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:22.787100+0000","last_clean_scrub_stamp":"2023-11-28T20:01:22.787100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.14","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-28T20:01:22.821306+0000","last_change":"2023-11-28T20:01:22.818713+0000","last_active":"2023-11-28T20:01:22.821306+0000","last_peered":"2023-11-28T20:01:22.821306+0000","last_clean":"2023-11-28T20:01:22.821306+0000","last_became_active":"2023-11-28T20:01:22.817121+0000","last_became_peered":"2023-11-28T20:01:22.817121+0000","last_unstale":"2023-11-28T20:01:22.821306+0000","last_undegraded":"2023-11-28T20:01:22.821306+0000","last_fullsized":"2023-11-28T20:01:22.821306+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:21.777981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:21.777981+0000","last_clean_scrub_stamp":"2023-11-28T20:01:21.777981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:56:28.292315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.15","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-11-28T20:01:21.797005+0000","last_change":"2023-11-28T20:01:10.533748+0000","last_active":"2023-11-28T20:01:21.797005+0000","last_peered":"2023-11-28T20:01:21.797005+0000","last_clean":"2023-11-28T20:01:21.797005+0000","last_became_active":"2023-11-28T20:01:10.533411+0000","last_became_peered":"2023-11-28T20:01:10.533411+0000","last_unstale":"2023-11-28T20:01:21.797005+0000","last_undegraded":"2023-11-28T20:01:21.797005+0000","last_fullsized":"2023-11-28T20:01:21.797005+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_clean_scrub_stamp":"2023-11-28T20:01:09.480611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:58:23.470366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":14,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-11-28T20:01:21.792925+0000","last_change":"2023-11-28T20:01:09.507203+0000","last_active":"2023-11-28T20:01:21.792925+0000","last_peered":"2023-11-28T20:01:21.792925+0000","last_clean":"2023-11-28T20:01:21.792925+0000","last_became_active":"2023-11-28T20:01:09.506901+0000","last_became_peered":"2023-11-28T20:01:09.506901+0000","last_unstale":"2023-11-28T20:01:21.792925+0000","last_undegraded":"2023-11-28T20:01:21.792925+0000","last_fullsized":"2023-11-28T20:01:21.792925+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:08.474257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:08.474257+0000","last_clean_scrub_stamp":"2023-11-28T20:01:08.474257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:15:27.309843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.10","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2023-11-28T20:01:22.804660+0000","last_change":"2023-11-28T20:01:22.804660+0000","last_active":"2023-11-28T20:01:22.787100+0000","last_peered":"2023-11-28T20:01:22.787100+0000","last_clean":"2023-11-28T20:01:22.787100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:01:22.804660+0000","last_undegraded":"2023-11-28T20:01:22.804660+0000","last_fullsized":"2023-11-28T20:01:22.804660+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:22.787100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:22.787100+0000","last_clean_scrub_stamp":"2023-11-28T20:01:22.787100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.17","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-28T20:01:22.832084+0000","last_change":"2023-11-28T20:01:22.828593+0000","last_active":"2023-11-28T20:01:22.832084+0000","last_peered":"2023-11-28T20:01:22.832084+0000","last_clean":"2023-11-28T20:01:22.832084+0000","last_became_active":"2023-11-28T20:01:22.828323+0000","last_became_peered":"2023-11-28T20:01:22.828323+0000","last_unstale":"2023-11-28T20:01:22.832084+0000","last_undegraded":"2023-11-28T20:01:22.832084+0000","last_fullsized":"2023-11-28T20:01:22.832084+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:21.777981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:21.777981+0000","last_clean_scrub_stamp":"2023-11-28T20:01:21.777981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:58:35.767735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-11-28T20:01:21.801739+0000","last_change":"2023-11-28T20:01:10.537355+0000","last_active":"2023-11-28T20:01:21.801739+0000","last_peered":"2023-11-28T20:01:21.801739+0000","last_clean":"2023-11-28T20:01:21.801739+0000","last_became_active":"2023-11-28T20:01:10.536210+0000","last_became_peered":"2023-11-28T20:01:10.536210+0000","last_unstale":"2023-11-28T20:01:21.801739+0000","last_undegraded":"2023-11-28T20:01:21.801739+0000","last_fullsized":"2023-11-28T20:01:21.801739+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_clean_scrub_stamp":"2023-11-28T20:01:09.480611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T07:05:45.395904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.15","version":"60'3","reported_seq":17,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-11-28T20:01:21.798567+0000","last_change":"2023-11-28T20:01:09.519066+0000","last_active":"2023-11-28T20:01:21.798567+0000","last_peered":"2023-11-28T20:01:21.798567+0000","last_clean":"2023-11-28T20:01:21.798567+0000","last_became_active":"2023-11-28T20:01:09.518151+0000","last_became_peered":"2023-11-28T20:01:09.518151+0000","last_unstale":"2023-11-28T20:01:21.798567+0000","last_undegraded":"2023-11-28T20:01:21.798567+0000","last_fullsized":"2023-11-28T20:01:21.798567+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:08.474257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:08.474257+0000","last_clean_scrub_stamp":"2023-11-28T20:01:08.474257+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:00:29.783639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.11","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2023-11-28T20:01:22.808212+0000","last_change":"2023-11-28T20:01:22.808212+0000","last_active":"2023-11-28T20:01:22.787100+0000","last_peered":"2023-11-28T20:01:22.787100+0000","last_clean":"2023-11-28T20:01:22.787100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:01:22.808212+0000","last_undegraded":"2023-11-28T20:01:22.808212+0000","last_fullsized":"2023-11-28T20:01:22.808212+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:22.787100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:22.787100+0000","last_clean_scrub_stamp":"2023-11-28T20:01:22.787100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-28T20:01:22.823605+0000","last_change":"2023-11-28T20:01:22.819332+0000","last_active":"2023-11-28T20:01:22.823605+0000","last_peered":"2023-11-28T20:01:22.823605+0000","last_clean":"2023-11-28T20:01:22.823605+0000","last_became_active":"2023-11-28T20:01:22.818798+0000","last_became_peered":"2023-11-28T20:01:22.818798+0000","last_unstale":"2023-11-28T20:01:22.823605+0000","last_undegraded":"2023-11-28T20:01:22.823605+0000","last_fullsized":"2023-11-28T20:01:22.823605+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:21.777981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:21.777981+0000","last_clean_scrub_stamp":"2023-11-28T20:01:21.777981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:30:50.602373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.17","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-11-28T20:01:21.791581+0000","last_change":"2023-11-28T20:01:10.521819+0000","last_active":"2023-11-28T20:01:21.791581+0000","last_peered":"2023-11-28T20:01:21.791581+0000","last_clean":"2023-11-28T20:01:21.791581+0000","last_became_active":"2023-11-28T20:01:10.521475+0000","last_became_peered":"2023-11-28T20:01:10.521475+0000","last_unstale":"2023-11-28T20:01:21.791581+0000","last_undegraded":"2023-11-28T20:01:21.791581+0000","last_fullsized":"2023-11-28T20:01:21.791581+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_clean_scrub_stamp":"2023-11-28T20:01:09.480611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:16:30.300658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.14","version":"61'8","reported_seq":22,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-11-28T20:01:21.790211+0000","last_change":"2023-11-28T20:01:09.511176+0000","last_active":"2023-11-28T20:01:21.790211+0000","last_peered":"2023-11-28T20:01:21.790211+0000","last_clean":"2023-11-28T20:01:21.790211+0000","last_became_active":"2023-11-28T20:01:09.510427+0000","last_became_peered":"2023-11-28T20:01:09.510427+0000","last_unstale":"2023-11-28T20:01:21.790211+0000","last_undegraded":"2023-11-28T20:01:21.790211+0000","last_fullsized":"2023-11-28T20:01:21.790211+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:08.474257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:08.474257+0000","last_clean_scrub_stamp":"2023-11-28T20:01:08.474257+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:47:12.268146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3107,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.16","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2023-11-28T20:01:22.802114+0000","last_change":"2023-11-28T20:01:22.802114+0000","last_active":"2023-11-28T20:01:22.787100+0000","last_peered":"2023-11-28T20:01:22.787100+0000","last_clean":"2023-11-28T20:01:22.787100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:01:22.802114+0000","last_undegraded":"2023-11-28T20:01:22.802114+0000","last_fullsized":"2023-11-28T20:01:22.802114+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:22.787100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:22.787100+0000","last_clean_scrub_stamp":"2023-11-28T20:01:22.787100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-28T20:01:22.817286+0000","last_change":"2023-11-28T20:01:22.812353+0000","last_active":"2023-11-28T20:01:22.817286+0000","last_peered":"2023-11-28T20:01:22.817286+0000","last_clean":"2023-11-28T20:01:22.817286+0000","last_became_active":"2023-11-28T20:01:22.812090+0000","last_became_peered":"2023-11-28T20:01:22.812090+0000","last_unstale":"2023-11-28T20:01:22.817286+0000","last_undegraded":"2023-11-28T20:01:22.817286+0000","last_fullsized":"2023-11-28T20:01:22.817286+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:21.777981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:21.777981+0000","last_clean_scrub_stamp":"2023-11-28T20:01:21.777981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:54:32.863267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.10","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-11-28T20:01:21.791194+0000","last_change":"2023-11-28T20:01:10.533224+0000","last_active":"2023-11-28T20:01:21.791194+0000","last_peered":"2023-11-28T20:01:21.791194+0000","last_clean":"2023-11-28T20:01:21.791194+0000","last_became_active":"2023-11-28T20:01:10.532909+0000","last_became_peered":"2023-11-28T20:01:10.532909+0000","last_unstale":"2023-11-28T20:01:21.791194+0000","last_undegraded":"2023-11-28T20:01:21.791194+0000","last_fullsized":"2023-11-28T20:01:21.791194+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_clean_scrub_stamp":"2023-11-28T20:01:09.480611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:32:06.877460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.13","version":"60'2","reported_seq":16,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-11-28T20:01:21.798151+0000","last_change":"2023-11-28T20:01:09.518379+0000","last_active":"2023-11-28T20:01:21.798151+0000","last_peered":"2023-11-28T20:01:21.798151+0000","last_clean":"2023-11-28T20:01:21.798151+0000","last_became_active":"2023-11-28T20:01:09.518073+0000","last_became_peered":"2023-11-28T20:01:09.518073+0000","last_unstale":"2023-11-28T20:01:21.798151+0000","last_undegraded":"2023-11-28T20:01:21.798151+0000","last_fullsized":"2023-11-28T20:01:21.798151+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:08.474257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:08.474257+0000","last_clean_scrub_stamp":"2023-11-28T20:01:08.474257+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:11:07.788160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.17","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2023-11-28T20:01:22.807329+0000","last_change":"2023-11-28T20:01:22.807329+0000","last_active":"2023-11-28T20:01:22.787100+0000","last_peered":"2023-11-28T20:01:22.787100+0000","last_clean":"2023-11-28T20:01:22.787100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:01:22.807329+0000","last_undegraded":"2023-11-28T20:01:22.807329+0000","last_fullsized":"2023-11-28T20:01:22.807329+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:22.787100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:22.787100+0000","last_clean_scrub_stamp":"2023-11-28T20:01:22.787100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.10","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-28T20:01:22.821250+0000","last_change":"2023-11-28T20:01:22.818135+0000","last_active":"2023-11-28T20:01:22.821250+0000","last_peered":"2023-11-28T20:01:22.821250+0000","last_clean":"2023-11-28T20:01:22.821250+0000","last_became_active":"2023-11-28T20:01:22.817952+0000","last_became_peered":"2023-11-28T20:01:22.817952+0000","last_unstale":"2023-11-28T20:01:22.821250+0000","last_undegraded":"2023-11-28T20:01:22.821250+0000","last_fullsized":"2023-11-28T20:01:22.821250+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:21.777981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:21.777981+0000","last_clean_scrub_stamp":"2023-11-28T20:01:21.777981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:10:42.691065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-11-28T20:01:21.793268+0000","last_change":"2023-11-28T20:01:10.520948+0000","last_active":"2023-11-28T20:01:21.793268+0000","last_peered":"2023-11-28T20:01:21.793268+0000","last_clean":"2023-11-28T20:01:21.793268+0000","last_became_active":"2023-11-28T20:01:10.520649+0000","last_became_peered":"2023-11-28T20:01:10.520649+0000","last_unstale":"2023-11-28T20:01:21.793268+0000","last_undegraded":"2023-11-28T20:01:21.793268+0000","last_fullsized":"2023-11-28T20:01:21.793268+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_clean_scrub_stamp":"2023-11-28T20:01:09.480611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:10:34.830531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":14,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-11-28T20:01:21.793840+0000","last_change":"2023-11-28T20:01:09.510604+0000","last_active":"2023-11-28T20:01:21.793840+0000","last_peered":"2023-11-28T20:01:21.793840+0000","last_clean":"2023-11-28T20:01:21.793840+0000","last_became_active":"2023-11-28T20:01:09.510326+0000","last_became_peered":"2023-11-28T20:01:09.510326+0000","last_unstale":"2023-11-28T20:01:21.793840+0000","last_undegraded":"2023-11-28T20:01:21.793840+0000","last_fullsized":"2023-11-28T20:01:21.793840+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:08.474257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:08.474257+0000","last_clean_scrub_stamp":"2023-11-28T20:01:08.474257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:56:14.988591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.14","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2023-11-28T20:01:22.809339+0000","last_change":"2023-11-28T20:01:22.809339+0000","last_active":"2023-11-28T20:01:22.787100+0000","last_peered":"2023-11-28T20:01:22.787100+0000","last_clean":"2023-11-28T20:01:22.787100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:01:22.809339+0000","last_undegraded":"2023-11-28T20:01:22.809339+0000","last_fullsized":"2023-11-28T20:01:22.809339+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:22.787100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:22.787100+0000","last_clean_scrub_stamp":"2023-11-28T20:01:22.787100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.13","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-28T20:01:22.823674+0000","last_change":"2023-11-28T20:01:22.820361+0000","last_active":"2023-11-28T20:01:22.823674+0000","last_peered":"2023-11-28T20:01:22.823674+0000","last_clean":"2023-11-28T20:01:22.823674+0000","last_became_active":"2023-11-28T20:01:22.820048+0000","last_became_peered":"2023-11-28T20:01:22.820048+0000","last_unstale":"2023-11-28T20:01:22.823674+0000","last_undegraded":"2023-11-28T20:01:22.823674+0000","last_fullsized":"2023-11-28T20:01:22.823674+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:21.777981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:21.777981+0000","last_clean_scrub_stamp":"2023-11-28T20:01:21.777981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:59:20.866094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-11-28T20:01:21.801157+0000","last_change":"2023-11-28T20:01:10.527110+0000","last_active":"2023-11-28T20:01:21.801157+0000","last_peered":"2023-11-28T20:01:21.801157+0000","last_clean":"2023-11-28T20:01:21.801157+0000","last_became_active":"2023-11-28T20:01:10.525827+0000","last_became_peered":"2023-11-28T20:01:10.525827+0000","last_unstale":"2023-11-28T20:01:21.801157+0000","last_undegraded":"2023-11-28T20:01:21.801157+0000","last_fullsized":"2023-11-28T20:01:21.801157+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_clean_scrub_stamp":"2023-11-28T20:01:09.480611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:23:02.818476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":14,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-11-28T20:01:21.798244+0000","last_change":"2023-11-28T20:01:09.519626+0000","last_active":"2023-11-28T20:01:21.798244+0000","last_peered":"2023-11-28T20:01:21.798244+0000","last_clean":"2023-11-28T20:01:21.798244+0000","last_became_active":"2023-11-28T20:01:09.519349+0000","last_became_peered":"2023-11-28T20:01:09.519349+0000","last_unstale":"2023-11-28T20:01:21.798244+0000","last_undegraded":"2023-11-28T20:01:21.798244+0000","last_fullsized":"2023-11-28T20:01:21.798244+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:08.474257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:08.474257+0000","last_clean_scrub_stamp":"2023-11-28T20:01:08.474257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:04:51.492194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.15","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2023-11-28T20:01:22.803505+0000","last_change":"2023-11-28T20:01:22.803505+0000","last_active":"2023-11-28T20:01:22.787100+0000","last_peered":"2023-11-28T20:01:22.787100+0000","last_clean":"2023-11-28T20:01:22.787100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:01:22.803505+0000","last_undegraded":"2023-11-28T20:01:22.803505+0000","last_fullsized":"2023-11-28T20:01:22.803505+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:22.787100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:22.787100+0000","last_clean_scrub_stamp":"2023-11-28T20:01:22.787100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.12","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-28T20:01:22.829149+0000","last_change":"2023-11-28T20:01:22.826285+0000","last_active":"2023-11-28T20:01:22.829149+0000","last_peered":"2023-11-28T20:01:22.829149+0000","last_clean":"2023-11-28T20:01:22.829149+0000","last_became_active":"2023-11-28T20:01:22.825975+0000","last_became_peered":"2023-11-28T20:01:22.825975+0000","last_unstale":"2023-11-28T20:01:22.829149+0000","last_undegraded":"2023-11-28T20:01:22.829149+0000","last_fullsized":"2023-11-28T20:01:22.829149+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:21.777981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:21.777981+0000","last_clean_scrub_stamp":"2023-11-28T20:01:21.777981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:10:42.691065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.13","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-11-28T20:01:21.790303+0000","last_change":"2023-11-28T20:01:10.535178+0000","last_active":"2023-11-28T20:01:21.790303+0000","last_peered":"2023-11-28T20:01:21.790303+0000","last_clean":"2023-11-28T20:01:21.790303+0000","last_became_active":"2023-11-28T20:01:10.534880+0000","last_became_peered":"2023-11-28T20:01:10.534880+0000","last_unstale":"2023-11-28T20:01:21.790303+0000","last_undegraded":"2023-11-28T20:01:21.790303+0000","last_fullsized":"2023-11-28T20:01:21.790303+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_clean_scrub_stamp":"2023-11-28T20:01:09.480611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:52:42.741966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.10","version":"60'8","reported_seq":22,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-11-28T20:01:21.791303+0000","last_change":"2023-11-28T20:01:09.511628+0000","last_active":"2023-11-28T20:01:21.791303+0000","last_peered":"2023-11-28T20:01:21.791303+0000","last_clean":"2023-11-28T20:01:21.791303+0000","last_became_active":"2023-11-28T20:01:09.511250+0000","last_became_peered":"2023-11-28T20:01:09.511250+0000","last_unstale":"2023-11-28T20:01:21.791303+0000","last_undegraded":"2023-11-28T20:01:21.791303+0000","last_fullsized":"2023-11-28T20:01:21.791303+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:08.474257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:08.474257+0000","last_clean_scrub_stamp":"2023-11-28T20:01:08.474257+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:35:34.107408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.a","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2023-11-28T20:01:22.799813+0000","last_change":"2023-11-28T20:01:22.799813+0000","last_active":"2023-11-28T20:01:22.787100+0000","last_peered":"2023-11-28T20:01:22.787100+0000","last_clean":"2023-11-28T20:01:22.787100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:01:22.799813+0000","last_undegraded":"2023-11-28T20:01:22.799813+0000","last_fullsized":"2023-11-28T20:01:22.799813+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:22.787100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:22.787100+0000","last_clean_scrub_stamp":"2023-11-28T20:01:22.787100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.d","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-28T20:01:22.824984+0000","last_change":"2023-11-28T20:01:22.818834+0000","last_active":"2023-11-28T20:01:22.824984+0000","last_peered":"2023-11-28T20:01:22.824984+0000","last_clean":"2023-11-28T20:01:22.824984+0000","last_became_active":"2023-11-28T20:01:22.818391+0000","last_became_peered":"2023-11-28T20:01:22.818391+0000","last_unstale":"2023-11-28T20:01:22.824984+0000","last_undegraded":"2023-11-28T20:01:22.824984+0000","last_fullsized":"2023-11-28T20:01:22.824984+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:21.777981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:21.777981+0000","last_clean_scrub_stamp":"2023-11-28T20:01:21.777981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:33:58.134275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-11-28T20:01:21.798469+0000","last_change":"2023-11-28T20:01:10.537164+0000","last_active":"2023-11-28T20:01:21.798469+0000","last_peered":"2023-11-28T20:01:21.798469+0000","last_clean":"2023-11-28T20:01:21.798469+0000","last_became_active":"2023-11-28T20:01:10.536893+0000","last_became_peered":"2023-11-28T20:01:10.536893+0000","last_unstale":"2023-11-28T20:01:21.798469+0000","last_undegraded":"2023-11-28T20:01:21.798469+0000","last_fullsized":"2023-11-28T20:01:21.798469+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_clean_scrub_stamp":"2023-11-28T20:01:09.480611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:50:58.589965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.f","version":"60'1","reported_seq":15,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-11-28T20:01:21.794381+0000","last_change":"2023-11-28T20:01:09.510018+0000","last_active":"2023-11-28T20:01:21.794381+0000","last_peered":"2023-11-28T20:01:21.794381+0000","last_clean":"2023-11-28T20:01:21.794381+0000","last_became_active":"2023-11-28T20:01:09.509743+0000","last_became_peered":"2023-11-28T20:01:09.509743+0000","last_unstale":"2023-11-28T20:01:21.794381+0000","last_undegraded":"2023-11-28T20:01:21.794381+0000","last_fullsized":"2023-11-28T20:01:21.794381+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:08.474257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:08.474257+0000","last_clean_scrub_stamp":"2023-11-28T20:01:08.474257+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:09:59.028591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.b","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2023-11-28T20:01:22.801666+0000","last_change":"2023-11-28T20:01:22.801666+0000","last_active":"2023-11-28T20:01:22.787100+0000","last_peered":"2023-11-28T20:01:22.787100+0000","last_clean":"2023-11-28T20:01:22.787100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:01:22.801666+0000","last_undegraded":"2023-11-28T20:01:22.801666+0000","last_fullsized":"2023-11-28T20:01:22.801666+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:22.787100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:22.787100+0000","last_clean_scrub_stamp":"2023-11-28T20:01:22.787100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-28T20:01:22.824090+0000","last_change":"2023-11-28T20:01:22.817493+0000","last_active":"2023-11-28T20:01:22.824090+0000","last_peered":"2023-11-28T20:01:22.824090+0000","last_clean":"2023-11-28T20:01:22.824090+0000","last_became_active":"2023-11-28T20:01:22.817204+0000","last_became_peered":"2023-11-28T20:01:22.817204+0000","last_unstale":"2023-11-28T20:01:22.824090+0000","last_undegraded":"2023-11-28T20:01:22.824090+0000","last_fullsized":"2023-11-28T20:01:22.824090+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:21.777981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:21.777981+0000","last_clean_scrub_stamp":"2023-11-28T20:01:21.777981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:21:33.492950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.d","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-11-28T20:01:21.801679+0000","last_change":"2023-11-28T20:01:10.537543+0000","last_active":"2023-11-28T20:01:21.801679+0000","last_peered":"2023-11-28T20:01:21.801679+0000","last_clean":"2023-11-28T20:01:21.801679+0000","last_became_active":"2023-11-28T20:01:10.537307+0000","last_became_peered":"2023-11-28T20:01:10.537307+0000","last_unstale":"2023-11-28T20:01:21.801679+0000","last_undegraded":"2023-11-28T20:01:21.801679+0000","last_fullsized":"2023-11-28T20:01:21.801679+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_clean_scrub_stamp":"2023-11-28T20:01:09.480611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:04:52.498548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.e","version":"60'2","reported_seq":16,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-11-28T20:01:21.800005+0000","last_change":"2023-11-28T20:01:09.519130+0000","last_active":"2023-11-28T20:01:21.800005+0000","last_peered":"2023-11-28T20:01:21.800005+0000","last_clean":"2023-11-28T20:01:21.800005+0000","last_became_active":"2023-11-28T20:01:09.517725+0000","last_became_peered":"2023-11-28T20:01:09.517725+0000","last_unstale":"2023-11-28T20:01:21.800005+0000","last_undegraded":"2023-11-28T20:01:21.800005+0000","last_fullsized":"2023-11-28T20:01:21.800005+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:08.474257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:08.474257+0000","last_clean_scrub_stamp":"2023-11-28T20:01:08.474257+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:05:31.573692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.8","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2023-11-28T20:01:22.801498+0000","last_change":"2023-11-28T20:01:22.801498+0000","last_active":"2023-11-28T20:01:22.787100+0000","last_peered":"2023-11-28T20:01:22.787100+0000","last_clean":"2023-11-28T20:01:22.787100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:01:22.801498+0000","last_undegraded":"2023-11-28T20:01:22.801498+0000","last_fullsized":"2023-11-28T20:01:22.801498+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:22.787100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:22.787100+0000","last_clean_scrub_stamp":"2023-11-28T20:01:22.787100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.f","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-28T20:01:22.832619+0000","last_change":"2023-11-28T20:01:22.830040+0000","last_active":"2023-11-28T20:01:22.832619+0000","last_peered":"2023-11-28T20:01:22.832619+0000","last_clean":"2023-11-28T20:01:22.832619+0000","last_became_active":"2023-11-28T20:01:22.829736+0000","last_became_peered":"2023-11-28T20:01:22.829736+0000","last_unstale":"2023-11-28T20:01:22.832619+0000","last_undegraded":"2023-11-28T20:01:22.832619+0000","last_fullsized":"2023-11-28T20:01:22.832619+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:21.777981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:21.777981+0000","last_clean_scrub_stamp":"2023-11-28T20:01:21.777981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:02:18.785671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.e","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-11-28T20:01:21.792843+0000","last_change":"2023-11-28T20:01:10.530449+0000","last_active":"2023-11-28T20:01:21.792843+0000","last_peered":"2023-11-28T20:01:21.792843+0000","last_clean":"2023-11-28T20:01:21.792843+0000","last_became_active":"2023-11-28T20:01:10.530169+0000","last_became_peered":"2023-11-28T20:01:10.530169+0000","last_unstale":"2023-11-28T20:01:21.792843+0000","last_undegraded":"2023-11-28T20:01:21.792843+0000","last_fullsized":"2023-11-28T20:01:21.792843+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_clean_scrub_stamp":"2023-11-28T20:01:09.480611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:01:36.330362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.d","version":"60'1","reported_seq":15,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-11-28T20:01:21.798612+0000","last_change":"2023-11-28T20:01:09.519252+0000","last_active":"2023-11-28T20:01:21.798612+0000","last_peered":"2023-11-28T20:01:21.798612+0000","last_clean":"2023-11-28T20:01:21.798612+0000","last_became_active":"2023-11-28T20:01:09.518511+0000","last_became_peered":"2023-11-28T20:01:09.518511+0000","last_unstale":"2023-11-28T20:01:21.798612+0000","last_undegraded":"2023-11-28T20:01:21.798612+0000","last_fullsized":"2023-11-28T20:01:21.798612+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:08.474257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:08.474257+0000","last_clean_scrub_stamp":"2023-11-28T20:01:08.474257+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:52:41.735612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.9","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2023-11-28T20:01:22.799812+0000","last_change":"2023-11-28T20:01:22.799812+0000","last_active":"2023-11-28T20:01:22.787100+0000","last_peered":"2023-11-28T20:01:22.787100+0000","last_clean":"2023-11-28T20:01:22.787100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:01:22.799812+0000","last_undegraded":"2023-11-28T20:01:22.799812+0000","last_fullsized":"2023-11-28T20:01:22.799812+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:22.787100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:22.787100+0000","last_clean_scrub_stamp":"2023-11-28T20:01:22.787100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.e","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-28T20:01:22.823606+0000","last_change":"2023-11-28T20:01:22.819046+0000","last_active":"2023-11-28T20:01:22.823606+0000","last_peered":"2023-11-28T20:01:22.823606+0000","last_clean":"2023-11-28T20:01:22.823606+0000","last_became_active":"2023-11-28T20:01:22.818775+0000","last_became_peered":"2023-11-28T20:01:22.818775+0000","last_unstale":"2023-11-28T20:01:22.823606+0000","last_undegraded":"2023-11-28T20:01:22.823606+0000","last_fullsized":"2023-11-28T20:01:22.823606+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:21.777981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:21.777981+0000","last_clean_scrub_stamp":"2023-11-28T20:01:21.777981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:37:29.813667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.f","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-11-28T20:01:21.801782+0000","last_change":"2023-11-28T20:01:10.523973+0000","last_active":"2023-11-28T20:01:21.801782+0000","last_peered":"2023-11-28T20:01:21.801782+0000","last_clean":"2023-11-28T20:01:21.801782+0000","last_became_active":"2023-11-28T20:01:10.523676+0000","last_became_peered":"2023-11-28T20:01:10.523676+0000","last_unstale":"2023-11-28T20:01:21.801782+0000","last_undegraded":"2023-11-28T20:01:21.801782+0000","last_fullsized":"2023-11-28T20:01:21.801782+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_clean_scrub_stamp":"2023-11-28T20:01:09.480611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:49:36.861168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":14,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-11-28T20:01:21.797278+0000","last_change":"2023-11-28T20:01:09.514931+0000","last_active":"2023-11-28T20:01:21.797278+0000","last_peered":"2023-11-28T20:01:21.797278+0000","last_clean":"2023-11-28T20:01:21.797278+0000","last_became_active":"2023-11-28T20:01:09.514702+0000","last_became_peered":"2023-11-28T20:01:09.514702+0000","last_unstale":"2023-11-28T20:01:21.797278+0000","last_undegraded":"2023-11-28T20:01:21.797278+0000","last_fullsized":"2023-11-28T20:01:21.797278+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:08.474257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:08.474257+0000","last_clean_scrub_stamp":"2023-11-28T20:01:08.474257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:30:37.298649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.e","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2023-11-28T20:01:22.808106+0000","last_change":"2023-11-28T20:01:22.808106+0000","last_active":"2023-11-28T20:01:22.787100+0000","last_peered":"2023-11-28T20:01:22.787100+0000","last_clean":"2023-11-28T20:01:22.787100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:01:22.808106+0000","last_undegraded":"2023-11-28T20:01:22.808106+0000","last_fullsized":"2023-11-28T20:01:22.808106+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:22.787100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:22.787100+0000","last_clean_scrub_stamp":"2023-11-28T20:01:22.787100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.9","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-28T20:01:22.821131+0000","last_change":"2023-11-28T20:01:22.816218+0000","last_active":"2023-11-28T20:01:22.821131+0000","last_peered":"2023-11-28T20:01:22.821131+0000","last_clean":"2023-11-28T20:01:22.821131+0000","last_became_active":"2023-11-28T20:01:22.815903+0000","last_became_peered":"2023-11-28T20:01:22.815903+0000","last_unstale":"2023-11-28T20:01:22.821131+0000","last_undegraded":"2023-11-28T20:01:22.821131+0000","last_fullsized":"2023-11-28T20:01:22.821131+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:21.777981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:21.777981+0000","last_clean_scrub_stamp":"2023-11-28T20:01:21.777981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:19:20.241462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-11-28T20:01:21.800738+0000","last_change":"2023-11-28T20:01:10.525003+0000","last_active":"2023-11-28T20:01:21.800738+0000","last_peered":"2023-11-28T20:01:21.800738+0000","last_clean":"2023-11-28T20:01:21.800738+0000","last_became_active":"2023-11-28T20:01:10.524411+0000","last_became_peered":"2023-11-28T20:01:10.524411+0000","last_unstale":"2023-11-28T20:01:21.800738+0000","last_undegraded":"2023-11-28T20:01:21.800738+0000","last_fullsized":"2023-11-28T20:01:21.800738+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_clean_scrub_stamp":"2023-11-28T20:01:09.480611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:17:27.097887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.b","version":"60'2","reported_seq":16,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-11-28T20:01:21.801281+0000","last_change":"2023-11-28T20:01:09.511026+0000","last_active":"2023-11-28T20:01:21.801281+0000","last_peered":"2023-11-28T20:01:21.801281+0000","last_clean":"2023-11-28T20:01:21.801281+0000","last_became_active":"2023-11-28T20:01:09.510765+0000","last_became_peered":"2023-11-28T20:01:09.510765+0000","last_unstale":"2023-11-28T20:01:21.801281+0000","last_undegraded":"2023-11-28T20:01:21.801281+0000","last_fullsized":"2023-11-28T20:01:21.801281+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:08.474257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:08.474257+0000","last_clean_scrub_stamp":"2023-11-28T20:01:08.474257+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:06:35.988462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.f","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2023-11-28T20:01:22.804656+0000","last_change":"2023-11-28T20:01:22.804656+0000","last_active":"2023-11-28T20:01:22.787100+0000","last_peered":"2023-11-28T20:01:22.787100+0000","last_clean":"2023-11-28T20:01:22.787100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:01:22.804656+0000","last_undegraded":"2023-11-28T20:01:22.804656+0000","last_fullsized":"2023-11-28T20:01:22.804656+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:22.787100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:22.787100+0000","last_clean_scrub_stamp":"2023-11-28T20:01:22.787100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-28T20:01:22.821031+0000","last_change":"2023-11-28T20:01:22.818671+0000","last_active":"2023-11-28T20:01:22.821031+0000","last_peered":"2023-11-28T20:01:22.821031+0000","last_clean":"2023-11-28T20:01:22.821031+0000","last_became_active":"2023-11-28T20:01:22.818413+0000","last_became_peered":"2023-11-28T20:01:22.818413+0000","last_unstale":"2023-11-28T20:01:22.821031+0000","last_undegraded":"2023-11-28T20:01:22.821031+0000","last_fullsized":"2023-11-28T20:01:22.821031+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:21.777981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:21.777981+0000","last_clean_scrub_stamp":"2023-11-28T20:01:21.777981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:39:31.956432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-11-28T20:01:21.793361+0000","last_change":"2023-11-28T20:01:10.523842+0000","last_active":"2023-11-28T20:01:21.793361+0000","last_peered":"2023-11-28T20:01:21.793361+0000","last_clean":"2023-11-28T20:01:21.793361+0000","last_became_active":"2023-11-28T20:01:10.523553+0000","last_became_peered":"2023-11-28T20:01:10.523553+0000","last_unstale":"2023-11-28T20:01:21.793361+0000","last_undegraded":"2023-11-28T20:01:21.793361+0000","last_fullsized":"2023-11-28T20:01:21.793361+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_clean_scrub_stamp":"2023-11-28T20:01:09.480611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T07:34:37.174623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":14,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-11-28T20:01:21.793934+0000","last_change":"2023-11-28T20:01:09.510719+0000","last_active":"2023-11-28T20:01:21.793934+0000","last_peered":"2023-11-28T20:01:21.793934+0000","last_clean":"2023-11-28T20:01:21.793934+0000","last_became_active":"2023-11-28T20:01:09.509874+0000","last_became_peered":"2023-11-28T20:01:09.509874+0000","last_unstale":"2023-11-28T20:01:21.793934+0000","last_undegraded":"2023-11-28T20:01:21.793934+0000","last_fullsized":"2023-11-28T20:01:21.793934+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:08.474257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:08.474257+0000","last_clean_scrub_stamp":"2023-11-28T20:01:08.474257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:21:20.189227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.c","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2023-11-28T20:01:22.804042+0000","last_change":"2023-11-28T20:01:22.804042+0000","last_active":"2023-11-28T20:01:22.787100+0000","last_peered":"2023-11-28T20:01:22.787100+0000","last_clean":"2023-11-28T20:01:22.787100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:01:22.804042+0000","last_undegraded":"2023-11-28T20:01:22.804042+0000","last_fullsized":"2023-11-28T20:01:22.804042+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:22.787100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:22.787100+0000","last_clean_scrub_stamp":"2023-11-28T20:01:22.787100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.b","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-28T20:01:22.825956+0000","last_change":"2023-11-28T20:01:22.821826+0000","last_active":"2023-11-28T20:01:22.825956+0000","last_peered":"2023-11-28T20:01:22.825956+0000","last_clean":"2023-11-28T20:01:22.825956+0000","last_became_active":"2023-11-28T20:01:22.821548+0000","last_became_peered":"2023-11-28T20:01:22.821548+0000","last_unstale":"2023-11-28T20:01:22.825956+0000","last_undegraded":"2023-11-28T20:01:22.825956+0000","last_fullsized":"2023-11-28T20:01:22.825956+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:21.777981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:21.777981+0000","last_clean_scrub_stamp":"2023-11-28T20:01:21.777981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:25:07.192596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-11-28T20:01:21.801265+0000","last_change":"2023-11-28T20:01:10.530042+0000","last_active":"2023-11-28T20:01:21.801265+0000","last_peered":"2023-11-28T20:01:21.801265+0000","last_clean":"2023-11-28T20:01:21.801265+0000","last_became_active":"2023-11-28T20:01:10.529745+0000","last_became_peered":"2023-11-28T20:01:10.529745+0000","last_unstale":"2023-11-28T20:01:21.801265+0000","last_undegraded":"2023-11-28T20:01:21.801265+0000","last_fullsized":"2023-11-28T20:01:21.801265+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_clean_scrub_stamp":"2023-11-28T20:01:09.480611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:18:17.108795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":14,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-11-28T20:01:21.800931+0000","last_change":"2023-11-28T20:01:09.512327+0000","last_active":"2023-11-28T20:01:21.800931+0000","last_peered":"2023-11-28T20:01:21.800931+0000","last_clean":"2023-11-28T20:01:21.800931+0000","last_became_active":"2023-11-28T20:01:09.512065+0000","last_became_peered":"2023-11-28T20:01:09.512065+0000","last_unstale":"2023-11-28T20:01:21.800931+0000","last_undegraded":"2023-11-28T20:01:21.800931+0000","last_fullsized":"2023-11-28T20:01:21.800931+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:08.474257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:08.474257+0000","last_clean_scrub_stamp":"2023-11-28T20:01:08.474257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:46:28.694684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.2","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2023-11-28T20:01:22.804217+0000","last_change":"2023-11-28T20:01:22.804217+0000","last_active":"2023-11-28T20:01:22.787100+0000","last_peered":"2023-11-28T20:01:22.787100+0000","last_clean":"2023-11-28T20:01:22.787100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:01:22.804217+0000","last_undegraded":"2023-11-28T20:01:22.804217+0000","last_fullsized":"2023-11-28T20:01:22.804217+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:22.787100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:22.787100+0000","last_clean_scrub_stamp":"2023-11-28T20:01:22.787100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.5","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-28T20:01:22.832081+0000","last_change":"2023-11-28T20:01:22.828000+0000","last_active":"2023-11-28T20:01:22.832081+0000","last_peered":"2023-11-28T20:01:22.832081+0000","last_clean":"2023-11-28T20:01:22.832081+0000","last_became_active":"2023-11-28T20:01:22.827704+0000","last_became_peered":"2023-11-28T20:01:22.827704+0000","last_unstale":"2023-11-28T20:01:22.832081+0000","last_undegraded":"2023-11-28T20:01:22.832081+0000","last_fullsized":"2023-11-28T20:01:22.832081+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:21.777981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:21.777981+0000","last_clean_scrub_stamp":"2023-11-28T20:01:21.777981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:52:43.940237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-11-28T20:01:21.801313+0000","last_change":"2023-11-28T20:01:10.526165+0000","last_active":"2023-11-28T20:01:21.801313+0000","last_peered":"2023-11-28T20:01:21.801313+0000","last_clean":"2023-11-28T20:01:21.801313+0000","last_became_active":"2023-11-28T20:01:10.525619+0000","last_became_peered":"2023-11-28T20:01:10.525619+0000","last_unstale":"2023-11-28T20:01:21.801313+0000","last_undegraded":"2023-11-28T20:01:21.801313+0000","last_fullsized":"2023-11-28T20:01:21.801313+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_clean_scrub_stamp":"2023-11-28T20:01:09.480611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:54:30.269337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.7","version":"60'2","reported_seq":16,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-11-28T20:01:21.794510+0000","last_change":"2023-11-28T20:01:09.514831+0000","last_active":"2023-11-28T20:01:21.794510+0000","last_peered":"2023-11-28T20:01:21.794510+0000","last_clean":"2023-11-28T20:01:21.794510+0000","last_became_active":"2023-11-28T20:01:09.514525+0000","last_became_peered":"2023-11-28T20:01:09.514525+0000","last_unstale":"2023-11-28T20:01:21.794510+0000","last_undegraded":"2023-11-28T20:01:21.794510+0000","last_fullsized":"2023-11-28T20:01:21.794510+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:08.474257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:08.474257+0000","last_clean_scrub_stamp":"2023-11-28T20:01:08.474257+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:05:31.573692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.3","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2023-11-28T20:01:22.804042+0000","last_change":"2023-11-28T20:01:22.804042+0000","last_active":"2023-11-28T20:01:22.787100+0000","last_peered":"2023-11-28T20:01:22.787100+0000","last_clean":"2023-11-28T20:01:22.787100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:01:22.804042+0000","last_undegraded":"2023-11-28T20:01:22.804042+0000","last_fullsized":"2023-11-28T20:01:22.804042+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:22.787100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:22.787100+0000","last_clean_scrub_stamp":"2023-11-28T20:01:22.787100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-28T20:01:22.832028+0000","last_change":"2023-11-28T20:01:22.827963+0000","last_active":"2023-11-28T20:01:22.832028+0000","last_peered":"2023-11-28T20:01:22.832028+0000","last_clean":"2023-11-28T20:01:22.832028+0000","last_became_active":"2023-11-28T20:01:22.827652+0000","last_became_peered":"2023-11-28T20:01:22.827652+0000","last_unstale":"2023-11-28T20:01:22.832028+0000","last_undegraded":"2023-11-28T20:01:22.832028+0000","last_fullsized":"2023-11-28T20:01:22.832028+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:21.777981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:21.777981+0000","last_clean_scrub_stamp":"2023-11-28T20:01:21.777981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:59:20.866094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-11-28T20:01:21.797523+0000","last_change":"2023-11-28T20:01:10.533050+0000","last_active":"2023-11-28T20:01:21.797523+0000","last_peered":"2023-11-28T20:01:21.797523+0000","last_clean":"2023-11-28T20:01:21.797523+0000","last_became_active":"2023-11-28T20:01:10.532590+0000","last_became_peered":"2023-11-28T20:01:10.532590+0000","last_unstale":"2023-11-28T20:01:21.797523+0000","last_undegraded":"2023-11-28T20:01:21.797523+0000","last_fullsized":"2023-11-28T20:01:21.797523+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_clean_scrub_stamp":"2023-11-28T20:01:09.480611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T07:29:30.339936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.6","version":"61'1","reported_seq":15,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-11-28T20:01:21.794444+0000","last_change":"2023-11-28T20:01:09.510397+0000","last_active":"2023-11-28T20:01:21.794444+0000","last_peered":"2023-11-28T20:01:21.794444+0000","last_clean":"2023-11-28T20:01:21.794444+0000","last_became_active":"2023-11-28T20:01:09.510136+0000","last_became_peered":"2023-11-28T20:01:09.510136+0000","last_unstale":"2023-11-28T20:01:21.794444+0000","last_undegraded":"2023-11-28T20:01:21.794444+0000","last_fullsized":"2023-11-28T20:01:21.794444+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:08.474257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:08.474257+0000","last_clean_scrub_stamp":"2023-11-28T20:01:08.474257+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:18:48.620687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.0","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2023-11-28T20:01:22.801672+0000","last_change":"2023-11-28T20:01:22.801672+0000","last_active":"2023-11-28T20:01:22.787100+0000","last_peered":"2023-11-28T20:01:22.787100+0000","last_clean":"2023-11-28T20:01:22.787100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:01:22.801672+0000","last_undegraded":"2023-11-28T20:01:22.801672+0000","last_fullsized":"2023-11-28T20:01:22.801672+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:22.787100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:22.787100+0000","last_clean_scrub_stamp":"2023-11-28T20:01:22.787100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.7","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-28T20:01:22.829667+0000","last_change":"2023-11-28T20:01:22.825335+0000","last_active":"2023-11-28T20:01:22.829667+0000","last_peered":"2023-11-28T20:01:22.829667+0000","last_clean":"2023-11-28T20:01:22.829667+0000","last_became_active":"2023-11-28T20:01:22.825033+0000","last_became_peered":"2023-11-28T20:01:22.825033+0000","last_unstale":"2023-11-28T20:01:22.829667+0000","last_undegraded":"2023-11-28T20:01:22.829667+0000","last_fullsized":"2023-11-28T20:01:22.829667+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:21.777981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:21.777981+0000","last_clean_scrub_stamp":"2023-11-28T20:01:21.777981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:10:42.691065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.6","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-11-28T20:01:21.794329+0000","last_change":"2023-11-28T20:01:10.530096+0000","last_active":"2023-11-28T20:01:21.794329+0000","last_peered":"2023-11-28T20:01:21.794329+0000","last_clean":"2023-11-28T20:01:21.794329+0000","last_became_active":"2023-11-28T20:01:10.529472+0000","last_became_peered":"2023-11-28T20:01:10.529472+0000","last_unstale":"2023-11-28T20:01:21.794329+0000","last_undegraded":"2023-11-28T20:01:21.794329+0000","last_fullsized":"2023-11-28T20:01:21.794329+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_clean_scrub_stamp":"2023-11-28T20:01:09.480611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T06:29:13.579326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":14,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-11-28T20:01:21.801672+0000","last_change":"2023-11-28T20:01:09.509983+0000","last_active":"2023-11-28T20:01:21.801672+0000","last_peered":"2023-11-28T20:01:21.801672+0000","last_clean":"2023-11-28T20:01:21.801672+0000","last_became_active":"2023-11-28T20:01:09.509675+0000","last_became_peered":"2023-11-28T20:01:09.509675+0000","last_unstale":"2023-11-28T20:01:21.801672+0000","last_undegraded":"2023-11-28T20:01:21.801672+0000","last_fullsized":"2023-11-28T20:01:21.801672+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:08.474257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:08.474257+0000","last_clean_scrub_stamp":"2023-11-28T20:01:08.474257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:21:20.189227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.1","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2023-11-28T20:01:22.802259+0000","last_change":"2023-11-28T20:01:22.802259+0000","last_active":"2023-11-28T20:01:22.787100+0000","last_peered":"2023-11-28T20:01:22.787100+0000","last_clean":"2023-11-28T20:01:22.787100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:01:22.802259+0000","last_undegraded":"2023-11-28T20:01:22.802259+0000","last_fullsized":"2023-11-28T20:01:22.802259+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:22.787100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:22.787100+0000","last_clean_scrub_stamp":"2023-11-28T20:01:22.787100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.6","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-28T20:01:22.821209+0000","last_change":"2023-11-28T20:01:22.817836+0000","last_active":"2023-11-28T20:01:22.821209+0000","last_peered":"2023-11-28T20:01:22.821209+0000","last_clean":"2023-11-28T20:01:22.821209+0000","last_became_active":"2023-11-28T20:01:22.817473+0000","last_became_peered":"2023-11-28T20:01:22.817473+0000","last_unstale":"2023-11-28T20:01:22.821209+0000","last_undegraded":"2023-11-28T20:01:22.821209+0000","last_fullsized":"2023-11-28T20:01:22.821209+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:21.777981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:21.777981+0000","last_clean_scrub_stamp":"2023-11-28T20:01:21.777981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:52:43.940237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.7","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-11-28T20:01:21.801808+0000","last_change":"2023-11-28T20:01:10.535856+0000","last_active":"2023-11-28T20:01:21.801808+0000","last_peered":"2023-11-28T20:01:21.801808+0000","last_clean":"2023-11-28T20:01:21.801808+0000","last_became_active":"2023-11-28T20:01:10.530889+0000","last_became_peered":"2023-11-28T20:01:10.530889+0000","last_unstale":"2023-11-28T20:01:21.801808+0000","last_undegraded":"2023-11-28T20:01:21.801808+0000","last_fullsized":"2023-11-28T20:01:21.801808+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_clean_scrub_stamp":"2023-11-28T20:01:09.480611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:53:37.636427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":14,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-11-28T20:01:21.790298+0000","last_change":"2023-11-28T20:01:09.511368+0000","last_active":"2023-11-28T20:01:21.790298+0000","last_peered":"2023-11-28T20:01:21.790298+0000","last_clean":"2023-11-28T20:01:21.790298+0000","last_became_active":"2023-11-28T20:01:09.510765+0000","last_became_peered":"2023-11-28T20:01:09.510765+0000","last_unstale":"2023-11-28T20:01:21.790298+0000","last_undegraded":"2023-11-28T20:01:21.790298+0000","last_fullsized":"2023-11-28T20:01:21.790298+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:08.474257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:08.474257+0000","last_clean_scrub_stamp":"2023-11-28T20:01:08.474257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:23:01.812122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.6","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2023-11-28T20:01:22.810260+0000","last_change":"2023-11-28T20:01:22.810260+0000","last_active":"2023-11-28T20:01:22.787100+0000","last_peered":"2023-11-28T20:01:22.787100+0000","last_clean":"2023-11-28T20:01:22.787100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:01:22.810260+0000","last_undegraded":"2023-11-28T20:01:22.810260+0000","last_fullsized":"2023-11-28T20:01:22.810260+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:22.787100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:22.787100+0000","last_clean_scrub_stamp":"2023-11-28T20:01:22.787100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.1","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-28T20:01:22.827254+0000","last_change":"2023-11-28T20:01:22.823098+0000","last_active":"2023-11-28T20:01:22.827254+0000","last_peered":"2023-11-28T20:01:22.827254+0000","last_clean":"2023-11-28T20:01:22.827254+0000","last_became_active":"2023-11-28T20:01:22.822775+0000","last_became_peered":"2023-11-28T20:01:22.822775+0000","last_unstale":"2023-11-28T20:01:22.827254+0000","last_undegraded":"2023-11-28T20:01:22.827254+0000","last_fullsized":"2023-11-28T20:01:22.827254+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:21.777981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:21.777981+0000","last_clean_scrub_stamp":"2023-11-28T20:01:21.777981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:19:01.924410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-11-28T20:01:21.800951+0000","last_change":"2023-11-28T20:01:10.530585+0000","last_active":"2023-11-28T20:01:21.800951+0000","last_peered":"2023-11-28T20:01:21.800951+0000","last_clean":"2023-11-28T20:01:21.800951+0000","last_became_active":"2023-11-28T20:01:10.530313+0000","last_became_peered":"2023-11-28T20:01:10.530313+0000","last_unstale":"2023-11-28T20:01:21.800951+0000","last_undegraded":"2023-11-28T20:01:21.800951+0000","last_fullsized":"2023-11-28T20:01:21.800951+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_clean_scrub_stamp":"2023-11-28T20:01:09.480611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:04:41.159984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":14,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-11-28T20:01:21.798227+0000","last_change":"2023-11-28T20:01:09.518318+0000","last_active":"2023-11-28T20:01:21.798227+0000","last_peered":"2023-11-28T20:01:21.798227+0000","last_clean":"2023-11-28T20:01:21.798227+0000","last_became_active":"2023-11-28T20:01:09.517761+0000","last_became_peered":"2023-11-28T20:01:09.517761+0000","last_unstale":"2023-11-28T20:01:21.798227+0000","last_undegraded":"2023-11-28T20:01:21.798227+0000","last_fullsized":"2023-11-28T20:01:21.798227+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:08.474257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:08.474257+0000","last_clean_scrub_stamp":"2023-11-28T20:01:08.474257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:18:16.102441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.7","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2023-11-28T20:01:22.807763+0000","last_change":"2023-11-28T20:01:22.807763+0000","last_active":"2023-11-28T20:01:22.787100+0000","last_peered":"2023-11-28T20:01:22.787100+0000","last_clean":"2023-11-28T20:01:22.787100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:01:22.807763+0000","last_undegraded":"2023-11-28T20:01:22.807763+0000","last_fullsized":"2023-11-28T20:01:22.807763+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:22.787100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:22.787100+0000","last_clean_scrub_stamp":"2023-11-28T20:01:22.787100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.0","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-28T20:01:22.826411+0000","last_change":"2023-11-28T20:01:22.822143+0000","last_active":"2023-11-28T20:01:22.826411+0000","last_peered":"2023-11-28T20:01:22.826411+0000","last_clean":"2023-11-28T20:01:22.826411+0000","last_became_active":"2023-11-28T20:01:22.821874+0000","last_became_peered":"2023-11-28T20:01:22.821874+0000","last_unstale":"2023-11-28T20:01:22.826411+0000","last_undegraded":"2023-11-28T20:01:22.826411+0000","last_fullsized":"2023-11-28T20:01:22.826411+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:21.777981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:21.777981+0000","last_clean_scrub_stamp":"2023-11-28T20:01:21.777981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:05:44.877415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-11-28T20:01:21.791432+0000","last_change":"2023-11-28T20:01:10.533596+0000","last_active":"2023-11-28T20:01:21.791432+0000","last_peered":"2023-11-28T20:01:21.791432+0000","last_clean":"2023-11-28T20:01:21.791432+0000","last_became_active":"2023-11-28T20:01:10.533195+0000","last_became_peered":"2023-11-28T20:01:10.533195+0000","last_unstale":"2023-11-28T20:01:21.791432+0000","last_undegraded":"2023-11-28T20:01:21.791432+0000","last_fullsized":"2023-11-28T20:01:21.791432+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_clean_scrub_stamp":"2023-11-28T20:01:09.480611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:14:25.459653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":14,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-11-28T20:01:21.796646+0000","last_change":"2023-11-28T20:01:09.507413+0000","last_active":"2023-11-28T20:01:21.796646+0000","last_peered":"2023-11-28T20:01:21.796646+0000","last_clean":"2023-11-28T20:01:21.796646+0000","last_became_active":"2023-11-28T20:01:09.507080+0000","last_became_peered":"2023-11-28T20:01:09.507080+0000","last_unstale":"2023-11-28T20:01:21.796646+0000","last_undegraded":"2023-11-28T20:01:21.796646+0000","last_fullsized":"2023-11-28T20:01:21.796646+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:08.474257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:08.474257+0000","last_clean_scrub_stamp":"2023-11-28T20:01:08.474257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:54:29.262983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.4","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2023-11-28T20:01:22.802494+0000","last_change":"2023-11-28T20:01:22.802494+0000","last_active":"2023-11-28T20:01:22.787100+0000","last_peered":"2023-11-28T20:01:22.787100+0000","last_clean":"2023-11-28T20:01:22.787100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:01:22.802494+0000","last_undegraded":"2023-11-28T20:01:22.802494+0000","last_fullsized":"2023-11-28T20:01:22.802494+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:22.787100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:22.787100+0000","last_clean_scrub_stamp":"2023-11-28T20:01:22.787100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.3","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-28T20:01:22.829695+0000","last_change":"2023-11-28T20:01:22.826550+0000","last_active":"2023-11-28T20:01:22.829695+0000","last_peered":"2023-11-28T20:01:22.829695+0000","last_clean":"2023-11-28T20:01:22.829695+0000","last_became_active":"2023-11-28T20:01:22.826247+0000","last_became_peered":"2023-11-28T20:01:22.826247+0000","last_unstale":"2023-11-28T20:01:22.829695+0000","last_undegraded":"2023-11-28T20:01:22.829695+0000","last_fullsized":"2023-11-28T20:01:22.829695+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:21.777981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:21.777981+0000","last_clean_scrub_stamp":"2023-11-28T20:01:21.777981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:21:33.492950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-11-28T20:01:21.789934+0000","last_change":"2023-11-28T20:01:10.518351+0000","last_active":"2023-11-28T20:01:21.789934+0000","last_peered":"2023-11-28T20:01:21.789934+0000","last_clean":"2023-11-28T20:01:21.789934+0000","last_became_active":"2023-11-28T20:01:10.518106+0000","last_became_peered":"2023-11-28T20:01:10.518106+0000","last_unstale":"2023-11-28T20:01:21.789934+0000","last_undegraded":"2023-11-28T20:01:21.789934+0000","last_fullsized":"2023-11-28T20:01:21.789934+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_clean_scrub_stamp":"2023-11-28T20:01:09.480611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:04:52.498548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":14,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-11-28T20:01:21.796549+0000","last_change":"2023-11-28T20:01:09.514346+0000","last_active":"2023-11-28T20:01:21.796549+0000","last_peered":"2023-11-28T20:01:21.796549+0000","last_clean":"2023-11-28T20:01:21.796549+0000","last_became_active":"2023-11-28T20:01:09.513791+0000","last_became_peered":"2023-11-28T20:01:09.513791+0000","last_unstale":"2023-11-28T20:01:21.796549+0000","last_undegraded":"2023-11-28T20:01:21.796549+0000","last_fullsized":"2023-11-28T20:01:21.796549+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:08.474257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:08.474257+0000","last_clean_scrub_stamp":"2023-11-28T20:01:08.474257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:17:26.091533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.5","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2023-11-28T20:01:22.803024+0000","last_change":"2023-11-28T20:01:22.803024+0000","last_active":"2023-11-28T20:01:22.787100+0000","last_peered":"2023-11-28T20:01:22.787100+0000","last_clean":"2023-11-28T20:01:22.787100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:01:22.803024+0000","last_undegraded":"2023-11-28T20:01:22.803024+0000","last_fullsized":"2023-11-28T20:01:22.803024+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:22.787100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:22.787100+0000","last_clean_scrub_stamp":"2023-11-28T20:01:22.787100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-28T20:01:22.826152+0000","last_change":"2023-11-28T20:01:22.821936+0000","last_active":"2023-11-28T20:01:22.826152+0000","last_peered":"2023-11-28T20:01:22.826152+0000","last_clean":"2023-11-28T20:01:22.826152+0000","last_became_active":"2023-11-28T20:01:22.821666+0000","last_became_peered":"2023-11-28T20:01:22.821666+0000","last_unstale":"2023-11-28T20:01:22.826152+0000","last_undegraded":"2023-11-28T20:01:22.826152+0000","last_fullsized":"2023-11-28T20:01:22.826152+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:21.777981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:21.777981+0000","last_clean_scrub_stamp":"2023-11-28T20:01:21.777981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:44:17.659296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-11-28T20:01:21.797041+0000","last_change":"2023-11-28T20:01:10.531261+0000","last_active":"2023-11-28T20:01:21.797041+0000","last_peered":"2023-11-28T20:01:21.797041+0000","last_clean":"2023-11-28T20:01:21.797041+0000","last_became_active":"2023-11-28T20:01:10.531002+0000","last_became_peered":"2023-11-28T20:01:10.531002+0000","last_unstale":"2023-11-28T20:01:21.797041+0000","last_undegraded":"2023-11-28T20:01:21.797041+0000","last_fullsized":"2023-11-28T20:01:21.797041+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_clean_scrub_stamp":"2023-11-28T20:01:09.480611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:50:37.650648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":14,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-11-28T20:01:21.789833+0000","last_change":"2023-11-28T20:01:09.512031+0000","last_active":"2023-11-28T20:01:21.789833+0000","last_peered":"2023-11-28T20:01:21.789833+0000","last_clean":"2023-11-28T20:01:21.789833+0000","last_became_active":"2023-11-28T20:01:09.511366+0000","last_became_peered":"2023-11-28T20:01:09.511366+0000","last_unstale":"2023-11-28T20:01:21.789833+0000","last_undegraded":"2023-11-28T20:01:21.789833+0000","last_fullsized":"2023-11-28T20:01:21.789833+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:08.474257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:08.474257+0000","last_clean_scrub_stamp":"2023-11-28T20:01:08.474257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:29:38.849741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.d","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2023-11-28T20:01:22.816355+0000","last_change":"2023-11-28T20:01:22.816355+0000","last_active":"2023-11-28T20:01:22.787100+0000","last_peered":"2023-11-28T20:01:22.787100+0000","last_clean":"2023-11-28T20:01:22.787100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:01:22.816355+0000","last_undegraded":"2023-11-28T20:01:22.816355+0000","last_fullsized":"2023-11-28T20:01:22.816355+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:22.787100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:22.787100+0000","last_clean_scrub_stamp":"2023-11-28T20:01:22.787100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-28T20:01:22.828665+0000","last_change":"2023-11-28T20:01:22.819303+0000","last_active":"2023-11-28T20:01:22.828665+0000","last_peered":"2023-11-28T20:01:22.828665+0000","last_clean":"2023-11-28T20:01:22.828665+0000","last_became_active":"2023-11-28T20:01:22.819098+0000","last_became_peered":"2023-11-28T20:01:22.819098+0000","last_unstale":"2023-11-28T20:01:22.828665+0000","last_undegraded":"2023-11-28T20:01:22.828665+0000","last_fullsized":"2023-11-28T20:01:22.828665+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:21.777981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:21.777981+0000","last_clean_scrub_stamp":"2023-11-28T20:01:21.777981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:55:36.425762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.b","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-11-28T20:01:21.801495+0000","last_change":"2023-11-28T20:01:10.530148+0000","last_active":"2023-11-28T20:01:21.801495+0000","last_peered":"2023-11-28T20:01:21.801495+0000","last_clean":"2023-11-28T20:01:21.801495+0000","last_became_active":"2023-11-28T20:01:10.529630+0000","last_became_peered":"2023-11-28T20:01:10.529630+0000","last_unstale":"2023-11-28T20:01:21.801495+0000","last_undegraded":"2023-11-28T20:01:21.801495+0000","last_fullsized":"2023-11-28T20:01:21.801495+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_clean_scrub_stamp":"2023-11-28T20:01:09.480611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:11:08.794514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":14,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-11-28T20:01:21.796083+0000","last_change":"2023-11-28T20:01:09.515708+0000","last_active":"2023-11-28T20:01:21.796083+0000","last_peered":"2023-11-28T20:01:21.796083+0000","last_clean":"2023-11-28T20:01:21.796083+0000","last_became_active":"2023-11-28T20:01:09.515449+0000","last_became_peered":"2023-11-28T20:01:09.515449+0000","last_unstale":"2023-11-28T20:01:21.796083+0000","last_undegraded":"2023-11-28T20:01:21.796083+0000","last_fullsized":"2023-11-28T20:01:21.796083+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:08.474257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:08.474257+0000","last_clean_scrub_stamp":"2023-11-28T20:01:08.474257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T07:14:20.829778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":201,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-11-28T20:01:21.797721+0000","last_change":"2023-11-28T19:58:56.136501+0000","last_active":"2023-11-28T20:01:21.797721+0000","last_peered":"2023-11-28T20:01:21.797721+0000","last_clean":"2023-11-28T20:01:21.797721+0000","last_became_active":"2023-11-28T19:58:56.135998+0000","last_became_peered":"2023-11-28T19:58:56.135998+0000","last_unstale":"2023-11-28T20:01:21.797721+0000","last_undegraded":"2023-11-28T20:01:21.797721+0000","last_fullsized":"2023-11-28T20:01:21.797721+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:58:54.602349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:58:54.602349+0000","last_clean_scrub_stamp":"2023-11-28T19:58:54.602349+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:33:42.723349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":12,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":11,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":10,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":9,"num_pg":32,"stat_sum":{"num_bytes":3905,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":47,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":7810,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":41,"ondisk_log_size":41,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":66748,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574882,"num_pgs":51,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27832,"kb_used_data":812,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344008,"statfs":{"total":96636764160,"available":96608264192,"internally_reserved":0,"allocated":831488,"data_stored":935848,"data_compressed":33374,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 20:00:55 2023","interfaces":[{"interface":"back","average":{"1min":0.66200000000000003,"5min":0.67500000000000004,"15min":0.67700000000000005},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":0.84699999999999998,"5min":0.90700000000000003,"15min":0.90700000000000003},"last":0.71099999999999997},{"interface":"front","average":{"1min":0.63300000000000001,"5min":0.67400000000000004,"15min":0.68100000000000005},"min":{"1min":0.499,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":0.84099999999999997,"5min":0.98999999999999999,"15min":0.98999999999999999},"last":0.69599999999999995}]},{"osd":1,"last update":"Tue Nov 28 20:00:55 2023","interfaces":[{"interface":"back","average":{"1min":0.60599999999999998,"5min":0.63800000000000001,"15min":0.64300000000000002},"min":{"1min":0.44700000000000001,"5min":0.438,"15min":0.438},"max":{"1min":0.82899999999999996,"5min":0.89600000000000002,"15min":0.89600000000000002},"last":0.72899999999999998},{"interface":"front","average":{"1min":0.63900000000000001,"5min":0.68899999999999995,"15min":0.69699999999999995},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":0.78200000000000003,"5min":1.0900000000000001,"15min":1.0900000000000001},"last":0.68000000000000005}]},{"osd":2,"last update":"Tue Nov 28 20:00:55 2023","interfaces":[{"interface":"back","average":{"1min":0.64400000000000002,"5min":0.71599999999999997,"15min":0.72799999999999998},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.84699999999999998,"5min":0.98799999999999999,"15min":0.98799999999999999},"last":0.79700000000000004},{"interface":"front","average":{"1min":0.65100000000000002,"5min":0.69499999999999995,"15min":0.70299999999999996},"min":{"1min":0.48599999999999999,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":0.85599999999999998,"5min":1.0680000000000001,"15min":1.0680000000000001},"last":0.65000000000000002}]},{"osd":3,"last update":"Tue Nov 28 20:00:55 2023","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.70099999999999996,"15min":0.69999999999999996},"min":{"1min":0.56100000000000005,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":0.88900000000000001,"5min":1.0449999999999999,"15min":1.0449999999999999},"last":0.63200000000000001},{"interface":"front","average":{"1min":0.74199999999999999,"5min":0.78200000000000003,"15min":0.78900000000000003},"min":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":0.60699999999999998},"max":{"1min":0.879,"5min":1.1299999999999999,"15min":1.1299999999999999},"last":0.77000000000000002}]},{"osd":4,"last update":"Tue Nov 28 20:00:55 2023","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.63600000000000001,"15min":0.64000000000000001},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":0.83899999999999997,"5min":1.018,"15min":1.018},"last":0.46999999999999997},{"interface":"front","average":{"1min":0.67600000000000005,"5min":0.72199999999999998,"15min":0.72999999999999998},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":0.97899999999999998,"5min":1.1120000000000001,"15min":1.1120000000000001},"last":0.66300000000000003}]},{"osd":5,"last update":"Tue Nov 28 20:00:55 2023","interfaces":[{"interface":"back","average":{"1min":0.58699999999999997,"5min":0.66500000000000004,"15min":0.67800000000000005},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.871,"5min":1.1699999999999999,"15min":1.1699999999999999},"last":0.59899999999999998},{"interface":"front","average":{"1min":0.67900000000000005,"5min":0.748,"15min":0.76000000000000001},"min":{"1min":0.505,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":0.88500000000000001,"5min":1.1890000000000001,"15min":1.1890000000000001},"last":0.747}]},{"osd":6,"last update":"Tue Nov 28 20:00:55 2023","interfaces":[{"interface":"back","average":{"1min":0.71399999999999997,"5min":0.76800000000000002,"15min":0.77700000000000002},"min":{"1min":0.47499999999999998,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.88200000000000001,"5min":1.1379999999999999,"15min":1.1379999999999999},"last":0.81100000000000005},{"interface":"front","average":{"1min":0.65000000000000002,"5min":0.72699999999999998,"15min":0.73999999999999999},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":0.93300000000000005,"5min":1.23,"15min":1.23},"last":0.57599999999999996}]}]},{"osd":6,"up_from":13,"seq":55834574880,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27756,"kb_used_data":736,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344084,"statfs":{"total":96636764160,"available":96608342016,"internally_reserved":0,"allocated":753664,"data_stored":344738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 20:00:54 2023","interfaces":[{"interface":"back","average":{"1min":0.621,"5min":0.61699999999999999,"15min":0.61599999999999999},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.81699999999999995,"5min":0.82599999999999996,"15min":0.82599999999999996},"last":0.70499999999999996},{"interface":"front","average":{"1min":0.67300000000000004,"5min":0.66500000000000004,"15min":0.66400000000000003},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":0.88700000000000001,"5min":0.98999999999999999,"15min":0.98999999999999999},"last":0.78500000000000003}]},{"osd":1,"last update":"Tue Nov 28 20:00:54 2023","interfaces":[{"interface":"back","average":{"1min":0.745,"5min":0.78100000000000003,"15min":0.78700000000000003},"min":{"1min":0.56100000000000005,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.0940000000000001,"5min":1.105,"15min":1.105},"last":0.81599999999999995},{"interface":"front","average":{"1min":0.69999999999999996,"5min":0.68899999999999995,"15min":0.68700000000000006},"min":{"1min":0.53700000000000003,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.85599999999999998,"5min":0.95899999999999996,"15min":0.95899999999999996},"last":0.72699999999999998}]},{"osd":2,"last update":"Tue Nov 28 20:00:54 2023","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.69499999999999995,"15min":0.69799999999999995},"min":{"1min":0.54700000000000004,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":0.89700000000000002,"5min":0.93400000000000005,"15min":0.93400000000000005},"last":0.76500000000000001},{"interface":"front","average":{"1min":0.70499999999999996,"5min":0.71599999999999997,"15min":0.71799999999999997},"min":{"1min":0.53400000000000003,"5min":0.505,"15min":0.505},"max":{"1min":0.91800000000000004,"5min":1.006,"15min":1.006},"last":0.66500000000000004}]},{"osd":3,"last update":"Tue Nov 28 20:00:54 2023","interfaces":[{"interface":"back","average":{"1min":0.70999999999999996,"5min":0.74099999999999999,"15min":0.746},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.04,"5min":1.056,"15min":1.056},"last":0.84499999999999997},{"interface":"front","average":{"1min":0.66700000000000004,"5min":0.68100000000000005,"15min":0.68300000000000005},"min":{"1min":0.505,"5min":0.505,"15min":0.505},"max":{"1min":0.85599999999999998,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.68300000000000005}]},{"osd":4,"last update":"Tue Nov 28 20:00:54 2023","interfaces":[{"interface":"back","average":{"1min":0.61599999999999999,"5min":0.628,"15min":0.63},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":0.97599999999999998,"5min":0.97599999999999998,"15min":0.97599999999999998},"last":0.52500000000000002},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.71199999999999997,"15min":0.72999999999999998},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":1.1419999999999999,"5min":1.389,"15min":1.389},"last":0.504}]},{"osd":5,"last update":"Tue Nov 28 20:00:54 2023","interfaces":[{"interface":"back","average":{"1min":0.71999999999999997,"5min":0.79700000000000004,"15min":0.81000000000000005},"min":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":1.147,"5min":1.4259999999999999,"15min":1.4259999999999999},"last":0.60799999999999998},{"interface":"front","average":{"1min":0.70699999999999996,"5min":0.751,"15min":0.75900000000000001},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.034,"5min":1.276,"15min":1.276},"last":0.627}]},{"osd":7,"last update":"Tue Nov 28 20:00:54 2023","interfaces":[{"interface":"back","average":{"1min":0.64000000000000001,"5min":0.69999999999999996,"15min":0.70999999999999996},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":1.014,"5min":1.014,"15min":1.014},"last":0.47699999999999998},{"interface":"front","average":{"1min":0.72599999999999998,"5min":0.80900000000000005,"15min":0.82299999999999995},"min":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":1.083,"5min":1.242,"15min":1.242},"last":0.58299999999999996}]}]},{"osd":5,"up_from":13,"seq":55834574882,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27756,"kb_used_data":736,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344084,"statfs":{"total":96636764160,"available":96608342016,"internally_reserved":0,"allocated":753664,"data_stored":344726,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 20:00:54 2023","interfaces":[{"interface":"back","average":{"1min":0.628,"5min":0.69299999999999995,"15min":0.70399999999999996},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.84699999999999998,"5min":0.997,"15min":0.997},"last":0.67100000000000004},{"interface":"front","average":{"1min":0.61899999999999999,"5min":0.69899999999999995,"15min":0.71199999999999997},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.78800000000000003,"5min":1.149,"15min":1.149},"last":0.622}]},{"osd":1,"last update":"Tue Nov 28 20:00:54 2023","interfaces":[{"interface":"back","average":{"1min":0.66800000000000004,"5min":0.70399999999999996,"15min":0.70999999999999996},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.94499999999999995,"5min":0.94499999999999995,"15min":0.94499999999999995},"last":0.70999999999999996},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.70399999999999996,"15min":0.71999999999999997},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":0.71999999999999997,"5min":1.0940000000000001,"15min":1.0940000000000001},"last":0.70199999999999996}]},{"osd":2,"last update":"Tue Nov 28 20:00:54 2023","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.89200000000000002,"15min":0.92800000000000005},"min":{"1min":0.5,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":0.91200000000000003,"5min":5.0880000000000001,"15min":5.0880000000000001},"last":0.73399999999999999},{"interface":"front","average":{"1min":0.69599999999999995,"5min":0.93999999999999995,"15min":0.98099999999999998},"min":{"1min":0.59199999999999997,"5min":0.504,"15min":0.504},"max":{"1min":0.96199999999999997,"5min":5.1399999999999997,"15min":5.1399999999999997},"last":0.76100000000000001}]},{"osd":3,"last update":"Tue Nov 28 20:00:54 2023","interfaces":[{"interface":"back","average":{"1min":0.70999999999999996,"5min":0.96399999999999997,"15min":1.006},"min":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":0.91100000000000003,"5min":5.0469999999999997,"15min":5.0469999999999997},"last":0.68899999999999995},{"interface":"front","average":{"1min":0.69099999999999995,"5min":0.93899999999999995,"15min":0.97999999999999998},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":0.90000000000000002,"5min":5.024,"15min":5.024},"last":0.79900000000000004}]},{"osd":4,"last update":"Tue Nov 28 20:00:54 2023","interfaces":[{"interface":"back","average":{"1min":0.58599999999999997,"5min":0.65800000000000003,"15min":0.67000000000000004},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.93300000000000005,"5min":1.4810000000000001,"15min":1.4810000000000001},"last":0.42899999999999999},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.73599999999999999,"15min":0.74299999999999999},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":0.95799999999999996,"5min":1.6339999999999999,"15min":1.6339999999999999},"last":0.496}]},{"osd":6,"last update":"Tue Nov 28 20:00:54 2023","interfaces":[{"interface":"back","average":{"1min":0.70299999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"min":{"1min":0.47699999999999998,"5min":0.434,"15min":0.434},"max":{"1min":0.93899999999999995,"5min":0.97699999999999998,"15min":0.97699999999999998},"last":0.64800000000000002},{"interface":"front","average":{"1min":0.69199999999999995,"5min":0.73599999999999999,"15min":0.74399999999999999},"min":{"1min":0.46300000000000002,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":0.86599999999999999,"5min":1.099,"15min":1.099},"last":0.47599999999999998}]},{"osd":7,"last update":"Tue Nov 28 20:00:54 2023","interfaces":[{"interface":"back","average":{"1min":0.77100000000000002,"5min":0.78300000000000003,"15min":0.78500000000000003},"min":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":0.95999999999999996,"5min":1.236,"15min":1.236},"last":0.55800000000000005},{"interface":"front","average":{"1min":0.77800000000000002,"5min":0.79600000000000004,"15min":0.79900000000000004},"min":{"1min":0.54000000000000004,"5min":0.505,"15min":0.505},"max":{"1min":0.98599999999999999,"5min":1.0760000000000001,"15min":1.0760000000000001},"last":0.53600000000000003}]}]},{"osd":4,"up_from":13,"seq":55834574881,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27764,"kb_used_data":744,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344076,"statfs":{"total":96636764160,"available":96608333824,"internally_reserved":0,"allocated":761856,"data_stored":347811,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 20:00:54 2023","interfaces":[{"interface":"back","average":{"1min":0.63200000000000001,"5min":0.69499999999999995,"15min":0.70499999999999996},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.82999999999999996,"5min":1.0429999999999999,"15min":1.0429999999999999},"last":0.76500000000000001},{"interface":"front","average":{"1min":0.64400000000000002,"5min":0.69999999999999996,"15min":0.70899999999999996},"min":{"1min":0.44900000000000001,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.93200000000000005,"5min":1.163,"15min":1.163},"last":0.56699999999999995}]},{"osd":1,"last update":"Tue Nov 28 20:00:54 2023","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.73599999999999999,"15min":0.754},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.88500000000000001,"5min":1.111,"15min":1.111},"last":0.54300000000000004},{"interface":"front","average":{"1min":0.68300000000000005,"5min":0.78700000000000003,"15min":0.80500000000000005},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":0.90000000000000002,"5min":1.238,"15min":1.238},"last":0.629}]},{"osd":2,"last update":"Tue Nov 28 20:00:54 2023","interfaces":[{"interface":"back","average":{"1min":0.70099999999999996,"5min":0.76600000000000001,"15min":0.77700000000000002},"min":{"1min":0.53300000000000003,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.97399999999999998,"5min":1.0669999999999999,"15min":1.0669999999999999},"last":0.58799999999999997},{"interface":"front","average":{"1min":0.66700000000000004,"5min":0.78700000000000003,"15min":0.80700000000000005},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.88100000000000001,"5min":1.1180000000000001,"15min":1.1180000000000001},"last":0.81000000000000005}]},{"osd":3,"last update":"Tue Nov 28 20:00:54 2023","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.76600000000000001,"15min":0.79000000000000004},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":0.89700000000000002,"5min":1.202,"15min":1.202},"last":0.61199999999999999},{"interface":"front","average":{"1min":0.67700000000000005,"5min":0.77200000000000002,"15min":0.78800000000000003},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":0.94599999999999995,"5min":1.0589999999999999,"15min":1.0589999999999999},"last":0.78800000000000003}]},{"osd":5,"last update":"Tue Nov 28 20:00:54 2023","interfaces":[{"interface":"back","average":{"1min":0.621,"5min":0.70299999999999996,"15min":0.71699999999999997},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.82499999999999996,"5min":0.95899999999999996,"15min":0.95899999999999996},"last":0.83199999999999996},{"interface":"front","average":{"1min":0.625,"5min":0.69599999999999995,"15min":0.70799999999999996},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.879,"5min":1.034,"15min":1.034},"last":0.65300000000000002}]},{"osd":6,"last update":"Tue Nov 28 20:00:54 2023","interfaces":[{"interface":"back","average":{"1min":0.60799999999999998,"5min":0.70899999999999996,"15min":0.72599999999999998},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":0.73799999999999999,"5min":1.0309999999999999,"15min":1.0309999999999999},"last":0.75700000000000001},{"interface":"front","average":{"1min":0.71899999999999997,"5min":0.77100000000000002,"15min":0.77900000000000003},"min":{"1min":0.49199999999999999,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":0.879,"5min":1.002,"15min":1.002},"last":0.68000000000000005}]},{"osd":7,"last update":"Tue Nov 28 20:00:54 2023","interfaces":[{"interface":"back","average":{"1min":0.70499999999999996,"5min":0.77100000000000002,"15min":0.78200000000000003},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":0.91000000000000003,"5min":1.0620000000000001,"15min":1.0620000000000001},"last":0.69799999999999995},{"interface":"front","average":{"1min":0.76000000000000001,"5min":0.84799999999999998,"15min":0.86199999999999999},"min":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":0.93400000000000005,"5min":1.1459999999999999,"15min":1.1459999999999999},"last":0.71499999999999997}]}]},{"osd":3,"up_from":13,"seq":55834574882,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27752,"kb_used_data":732,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344088,"statfs":{"total":96636764160,"available":96608346112,"internally_reserved":0,"allocated":749568,"data_stored":344704,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 20:00:55 2023","interfaces":[{"interface":"back","average":{"1min":0.41899999999999998,"5min":0.441,"15min":0.44500000000000001},"min":{"1min":0.29399999999999998,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":1.7130000000000001},{"interface":"front","average":{"1min":0.39600000000000002,"5min":0.45800000000000002,"15min":0.46800000000000003},"min":{"1min":0.28199999999999997,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.52800000000000002,"5min":0.82599999999999996,"15min":0.82599999999999996},"last":3.0630000000000002}]},{"osd":1,"last update":"Tue Nov 28 20:00:55 2023","interfaces":[{"interface":"back","average":{"1min":0.40000000000000002,"5min":0.46500000000000002,"15min":0.47599999999999998},"min":{"1min":0.26200000000000001,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.56999999999999995,"5min":0.84399999999999997,"15min":0.84399999999999997},"last":0.89200000000000002},{"interface":"front","average":{"1min":0.439,"5min":0.49099999999999999,"15min":0.5},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.74099999999999999,"5min":0.86099999999999999,"15min":0.86099999999999999},"last":5.8920000000000003}]},{"osd":2,"last update":"Tue Nov 28 20:00:55 2023","interfaces":[{"interface":"back","average":{"1min":0.48799999999999999,"5min":0.52400000000000002,"15min":0.53000000000000003},"min":{"1min":0.375,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.64900000000000002,"5min":0.85599999999999998,"15min":0.85599999999999998},"last":4.6390000000000002},{"interface":"front","average":{"1min":0.48999999999999999,"5min":0.56599999999999995,"15min":0.57899999999999996},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.63500000000000001,"5min":0.83699999999999997,"15min":0.83699999999999997},"last":11.593}]},{"osd":4,"last update":"Tue Nov 28 20:00:55 2023","interfaces":[{"interface":"back","average":{"1min":0.77700000000000002,"5min":0.76500000000000001,"15min":0.76300000000000001},"min":{"1min":0.60799999999999998,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":1.085,"5min":1.206,"15min":1.206},"last":5.5549999999999997},{"interface":"front","average":{"1min":0.80700000000000005,"5min":0.80300000000000005,"15min":0.80300000000000005},"min":{"1min":0.58999999999999997,"5min":0.503,"15min":0.503},"max":{"1min":1.173,"5min":1.222,"15min":1.222},"last":11.747}]},{"osd":5,"last update":"Tue Nov 28 20:00:55 2023","interfaces":[{"interface":"back","average":{"1min":0.78300000000000003,"5min":0.79600000000000004,"15min":0.79800000000000004},"min":{"1min":0.57699999999999996,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":1.2509999999999999,"5min":1.2509999999999999,"15min":1.2509999999999999},"last":11.705},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.79100000000000004,"15min":0.79900000000000004},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":1.0409999999999999,"5min":1.3100000000000001,"15min":1.3100000000000001},"last":1.0580000000000001}]},{"osd":6,"last update":"Tue Nov 28 20:00:55 2023","interfaces":[{"interface":"back","average":{"1min":0.81699999999999995,"5min":0.83799999999999997,"15min":0.84199999999999997},"min":{"1min":0.58799999999999997,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":1.544,"5min":1.544,"15min":1.544},"last":1.6639999999999999},{"interface":"front","average":{"1min":0.93100000000000005,"5min":0.78500000000000003,"15min":0.76100000000000001},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":4.0679999999999996,"5min":4.0679999999999996,"15min":4.0679999999999996},"last":3.1459999999999999}]},{"osd":7,"last update":"Tue Nov 28 20:00:55 2023","interfaces":[{"interface":"back","average":{"1min":0.97099999999999997,"5min":0.874,"15min":0.85799999999999998},"min":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":4.0019999999999998,"5min":4.0019999999999998,"15min":4.0019999999999998},"last":6.6619999999999999},{"interface":"front","average":{"1min":0.80100000000000005,"5min":0.873,"15min":0.88500000000000001},"min":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.60299999999999998},"max":{"1min":1.1830000000000001,"5min":1.339,"15min":1.339},"last":11.782}]}]},{"osd":2,"up_from":13,"seq":55834574880,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27752,"kb_used_data":732,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344088,"statfs":{"total":96636764160,"available":96608346112,"internally_reserved":0,"allocated":749568,"data_stored":344704,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 20:00:54 2023","interfaces":[{"interface":"back","average":{"1min":0.42599999999999999,"5min":0.45000000000000001,"15min":0.45400000000000001},"min":{"1min":0.33300000000000002,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.65100000000000002,"5min":0.74099999999999999,"15min":0.74099999999999999},"last":0.32500000000000001},{"interface":"front","average":{"1min":0.42199999999999999,"5min":0.46999999999999997,"15min":0.47799999999999998},"min":{"1min":0.27900000000000003,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.61399999999999999,"5min":0.67700000000000005,"15min":0.67700000000000005},"last":0.41899999999999998}]},{"osd":1,"last update":"Tue Nov 28 20:00:54 2023","interfaces":[{"interface":"back","average":{"1min":0.42899999999999999,"5min":0.497,"15min":0.50900000000000001},"min":{"1min":0.33300000000000002,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.57199999999999995,"5min":1.0389999999999999,"15min":1.0389999999999999},"last":0.377},{"interface":"front","average":{"1min":0.435,"5min":0.49099999999999999,"15min":0.5},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.70299999999999996,"5min":0.70999999999999996,"15min":0.70999999999999996},"last":0.58999999999999997}]},{"osd":3,"last update":"Tue Nov 28 20:00:54 2023","interfaces":[{"interface":"back","average":{"1min":0.44,"5min":0.46600000000000003,"15min":0.46999999999999997},"min":{"1min":0.317,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.55200000000000005,"5min":0.629,"15min":0.629},"last":0.60299999999999998},{"interface":"front","average":{"1min":0.496,"5min":0.57199999999999995,"15min":0.58499999999999996},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.67800000000000005,"5min":0.98499999999999999,"15min":0.98499999999999999},"last":0.5}]},{"osd":4,"last update":"Tue Nov 28 20:00:54 2023","interfaces":[{"interface":"back","average":{"1min":0.73899999999999999,"5min":0.83699999999999997,"15min":0.85299999999999998},"min":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"max":{"1min":0.98999999999999999,"5min":1.139,"15min":1.139},"last":0.53400000000000003},{"interface":"front","average":{"1min":0.71999999999999997,"5min":0.82599999999999996,"15min":0.84399999999999997},"min":{"1min":0.57299999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":0.97599999999999998,"5min":1.238,"15min":1.238},"last":0.64600000000000002}]},{"osd":5,"last update":"Tue Nov 28 20:00:54 2023","interfaces":[{"interface":"back","average":{"1min":0.69699999999999995,"5min":0.84699999999999998,"15min":0.872},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":0.83599999999999997,"5min":1.6180000000000001,"15min":1.6180000000000001},"last":0.51500000000000001},{"interface":"front","average":{"1min":0.71099999999999997,"5min":0.81000000000000005,"15min":0.82599999999999996},"min":{"1min":0.52200000000000002,"5min":0.496,"15min":0.496},"max":{"1min":0.96899999999999997,"5min":1.339,"15min":1.339},"last":0.77600000000000002}]},{"osd":6,"last update":"Tue Nov 28 20:00:54 2023","interfaces":[{"interface":"back","average":{"1min":0.73299999999999998,"5min":0.79100000000000004,"15min":0.80100000000000005},"min":{"1min":0.54600000000000004,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":0.98199999999999998,"5min":1.1839999999999999,"15min":1.1839999999999999},"last":0.82099999999999995},{"interface":"front","average":{"1min":0.70599999999999996,"5min":0.82999999999999996,"15min":0.85099999999999998},"min":{"1min":0.497,"5min":0.497,"15min":0.497},"max":{"1min":0.94199999999999995,"5min":1.099,"15min":1.099},"last":0.57199999999999995}]},{"osd":7,"last update":"Tue Nov 28 20:00:54 2023","interfaces":[{"interface":"back","average":{"1min":0.746,"5min":0.86099999999999999,"15min":0.88},"min":{"1min":0.53300000000000003,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":0.84899999999999998,"5min":1.4590000000000001,"15min":1.4590000000000001},"last":0.55300000000000005},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.83599999999999997,"15min":0.85599999999999998},"min":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":0.96599999999999997,"5min":1.387,"15min":1.387},"last":0.625}]}]},{"osd":1,"up_from":13,"seq":55834574882,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27780,"kb_used_data":760,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344060,"statfs":{"total":96636764160,"available":96608317440,"internally_reserved":0,"allocated":778240,"data_stored":348575,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 20:00:56 2023","interfaces":[{"interface":"back","average":{"1min":0.372,"5min":0.59999999999999998,"15min":0.63800000000000001},"min":{"1min":0.25900000000000001,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.53200000000000003,"5min":3.8740000000000001,"15min":3.8740000000000001},"last":0.27000000000000002},{"interface":"front","average":{"1min":0.41499999999999998,"5min":0.54000000000000004,"15min":0.56100000000000005},"min":{"1min":0.26200000000000001,"5min":0.25,"15min":0.25},"max":{"1min":0.64100000000000001,"5min":2.0760000000000001,"15min":2.0760000000000001},"last":0.36599999999999999}]},{"osd":2,"last update":"Tue Nov 28 20:00:56 2023","interfaces":[{"interface":"back","average":{"1min":0.40899999999999997,"5min":0.60899999999999999,"15min":0.64200000000000002},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":0.54500000000000004,"5min":3.7320000000000002,"15min":3.7320000000000002},"last":0.307},{"interface":"front","average":{"1min":0.42199999999999999,"5min":0.69199999999999995,"15min":0.73699999999999999},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.54800000000000004,"5min":3.9089999999999998,"15min":3.9089999999999998},"last":0.38600000000000001}]},{"osd":3,"last update":"Tue Nov 28 20:00:56 2023","interfaces":[{"interface":"back","average":{"1min":0.52800000000000002,"5min":0.65000000000000002,"15min":0.67000000000000004},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.64700000000000002,"5min":1.6399999999999999,"15min":1.6399999999999999},"last":0.436},{"interface":"front","average":{"1min":0.52000000000000002,"5min":0.66600000000000004,"15min":0.68999999999999995},"min":{"1min":0.37,"5min":0.317,"15min":0.317},"max":{"1min":0.748,"5min":2.5270000000000001,"15min":2.5270000000000001},"last":0.33300000000000002}]},{"osd":4,"last update":"Tue Nov 28 20:00:56 2023","interfaces":[{"interface":"back","average":{"1min":0.70199999999999996,"5min":0.85599999999999998,"15min":0.88200000000000001},"min":{"1min":0.46700000000000003,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":1.036,"5min":3.1659999999999999,"15min":3.1659999999999999},"last":0.51600000000000001},{"interface":"front","average":{"1min":0.68700000000000006,"5min":0.89400000000000002,"15min":0.92800000000000005},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.93700000000000006,"5min":3.7959999999999998,"15min":3.7959999999999998},"last":0.59999999999999998}]},{"osd":5,"last update":"Tue Nov 28 20:00:56 2023","interfaces":[{"interface":"back","average":{"1min":0.69799999999999995,"5min":0.93000000000000005,"15min":0.96899999999999997},"min":{"1min":0.50800000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":0.95599999999999996,"5min":4.1479999999999997,"15min":4.1479999999999997},"last":0.61899999999999999},{"interface":"front","average":{"1min":0.70299999999999996,"5min":0.86799999999999999,"15min":0.89600000000000002},"min":{"1min":0.499,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":1.052,"5min":3.5569999999999999,"15min":3.5569999999999999},"last":0.48199999999999998}]},{"osd":6,"last update":"Tue Nov 28 20:00:56 2023","interfaces":[{"interface":"back","average":{"1min":0.73999999999999999,"5min":0.94099999999999995,"15min":0.97499999999999998},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":1.004,"5min":2.863,"15min":2.863},"last":0.501},{"interface":"front","average":{"1min":0.77400000000000002,"5min":0.94099999999999995,"15min":0.96899999999999997},"min":{"1min":0.58099999999999996,"5min":0.56899999999999995,"15min":0.56899999999999995},"max":{"1min":1.075,"5min":3.371,"15min":3.371},"last":0.54500000000000004}]},{"osd":7,"last update":"Tue Nov 28 20:00:56 2023","interfaces":[{"interface":"back","average":{"1min":0.71599999999999997,"5min":0.95299999999999996,"15min":0.99299999999999999},"min":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":0.96899999999999997,"5min":3.8439999999999999,"15min":3.8439999999999999},"last":0.53100000000000003},{"interface":"front","average":{"1min":0.72699999999999998,"5min":0.97499999999999998,"15min":1.0169999999999999},"min":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":1.0569999999999999,"5min":3.9689999999999999,"15min":3.9689999999999999},"last":0.45000000000000001}]}]},{"osd":0,"up_from":13,"seq":55834574881,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31976,"kb_used_data":796,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339864,"statfs":{"total":96636764160,"available":96604020736,"internally_reserved":0,"allocated":815104,"data_stored":935072,"data_compressed":33374,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Nov 28 20:00:56 2023","interfaces":[{"interface":"back","average":{"1min":0.41299999999999998,"5min":0.63400000000000001,"15min":0.67100000000000004},"min":{"1min":0.27400000000000002,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.55800000000000005,"5min":4.883,"15min":4.883},"last":0.373},{"interface":"front","average":{"1min":0.44,"5min":0.79000000000000004,"15min":0.84799999999999998},"min":{"1min":0.30199999999999999,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.63200000000000001,"5min":8.0800000000000001,"15min":8.0800000000000001},"last":0.45900000000000002}]},{"osd":2,"last update":"Tue Nov 28 20:00:56 2023","interfaces":[{"interface":"back","average":{"1min":0.443,"5min":0.86699999999999999,"15min":0.93799999999999994},"min":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.59899999999999998,"5min":8.1029999999999998,"15min":8.1029999999999998},"last":0.45000000000000001},{"interface":"front","average":{"1min":0.47599999999999998,"5min":0.88400000000000001,"15min":0.95199999999999996},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.67600000000000005,"5min":8.1310000000000002,"15min":8.1310000000000002},"last":0.433}]},{"osd":3,"last update":"Tue Nov 28 20:00:56 2023","interfaces":[{"interface":"back","average":{"1min":0.42899999999999999,"5min":0.68300000000000005,"15min":0.72499999999999998},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.57599999999999996,"5min":4.3949999999999996,"15min":4.3949999999999996},"last":0.34999999999999998},{"interface":"front","average":{"1min":0.48899999999999999,"5min":0.70299999999999996,"15min":0.73899999999999999},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.69899999999999995,"5min":4.3470000000000004,"15min":4.3470000000000004},"last":0.41099999999999998}]},{"osd":4,"last update":"Tue Nov 28 20:00:56 2023","interfaces":[{"interface":"back","average":{"1min":0.71999999999999997,"5min":0.98399999999999999,"15min":1.028},"min":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":1.123,"5min":4.6360000000000001,"15min":4.6360000000000001},"last":0.71299999999999997},{"interface":"front","average":{"1min":0.747,"5min":0.99099999999999999,"15min":1.032},"min":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":0.996,"5min":4.4710000000000001,"15min":4.4710000000000001},"last":0.70099999999999996}]},{"osd":5,"last update":"Tue Nov 28 20:00:56 2023","interfaces":[{"interface":"back","average":{"1min":0.74299999999999999,"5min":1,"15min":1.0429999999999999},"min":{"1min":0.54800000000000004,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":0.96399999999999997,"5min":4.6120000000000001,"15min":4.6120000000000001},"last":0.73399999999999999},{"interface":"front","average":{"1min":0.74199999999999999,"5min":0.98999999999999999,"15min":1.0309999999999999},"min":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"max":{"1min":1.1659999999999999,"5min":4.5449999999999999,"15min":4.5449999999999999},"last":0.79800000000000004}]},{"osd":6,"last update":"Tue Nov 28 20:00:56 2023","interfaces":[{"interface":"back","average":{"1min":0.73499999999999999,"5min":1.01,"15min":1.056},"min":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":1.143,"5min":4.657,"15min":4.657},"last":0.67400000000000004},{"interface":"front","average":{"1min":0.74199999999999999,"5min":1.026,"15min":1.073},"min":{"1min":0.61199999999999999,"5min":0.58899999999999997,"15min":0.58899999999999997},"max":{"1min":1.0109999999999999,"5min":4.5259999999999998,"15min":4.5259999999999998},"last":0.77600000000000002}]},{"osd":7,"last update":"Tue Nov 28 20:00:56 2023","interfaces":[{"interface":"back","average":{"1min":0.72199999999999998,"5min":1.0249999999999999,"15min":1.075},"min":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":1.036,"5min":4.7320000000000002,"15min":4.7320000000000002},"last":0.66000000000000003},{"interface":"front","average":{"1min":0.755,"5min":0.98699999999999999,"15min":1.026},"min":{"1min":0.57499999999999996,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":1.1919999999999999,"5min":4.4939999999999998,"15min":4.4939999999999998},"last":0.75900000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33374,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33374,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":3871,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3107,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":776,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-28T20:01:28.279 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-28T20:01:28.452 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:28.449+0000 7fccfd916640 1 Processor -- start 2023-11-28T20:01:28.452 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:28.449+0000 7fccfd916640 1 -- start start 2023-11-28T20:01:28.453 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:28.449+0000 7fccfd916640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fccf8154fd0 0x7fccf81584e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:28.453 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:28.449+0000 7fccfd916640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fccf80ca190 0x7fccf80ca5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:28.453 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:28.449+0000 7fccfd916640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fccf80c5140 con 0x7fccf814e570 2023-11-28T20:01:28.453 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:28.449+0000 7fccfd916640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fccf80c4b80 con 0x7fccf8154fd0 2023-11-28T20:01:28.453 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:28.449+0000 7fccfd916640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fccf80c4e60 con 0x7fccf80ca190 2023-11-28T20:01:28.453 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:28.449+0000 7fccf6ffd640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7fccf814e570 0x7fccf80c7cb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:37186/0 (socket says 172.21.15.78:37186) 2023-11-28T20:01:28.453 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:28.449+0000 7fccf6ffd640 1 -- 172.21.15.78:0/381090320 learned_addr learned my addr 172.21.15.78:0/381090320 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-11-28T20:01:28.455 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:28.449+0000 7fccf77fe640 1 --2- 172.21.15.78:0/381090320 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fccf80ca190 0x7fccf80ca5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:28.455 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:28.449+0000 7fccee7fc640 1 --2- 172.21.15.78:0/381090320 >> v2:172.21.15.179:3300/0 conn(0x7fccf8154fd0 0x7fccf81584e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:28.455 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:28.449+0000 7fccf67fc640 1 -- 172.21.15.78:0/381090320 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 396207743 0 0) 0x7fccf80c5140 con 0x7fccf814e570 2023-11-28T20:01:28.455 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:28.449+0000 7fccf67fc640 1 -- 172.21.15.78:0/381090320 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcce4003530 con 0x7fccf814e570 2023-11-28T20:01:28.455 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:28.449+0000 7fccf67fc640 1 -- 172.21.15.78:0/381090320 <== mon.0 v1:172.21.15.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1162416279 0 0) 0x7fcce4003530 con 0x7fccf814e570 2023-11-28T20:01:28.455 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:28.449+0000 7fccf67fc640 1 -- 172.21.15.78:0/381090320 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fccf80ca190 msgr2=0x7fccf80ca5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:01:28.455 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:28.449+0000 7fccf67fc640 1 --2- 172.21.15.78:0/381090320 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fccf80ca190 0x7fccf80ca5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:28.455 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:28.449+0000 7fccf67fc640 1 -- 172.21.15.78:0/381090320 >> v2:172.21.15.179:3300/0 conn(0x7fccf8154fd0 msgr2=0x7fccf81584e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:01:28.456 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:28.449+0000 7fccf67fc640 1 --2- 172.21.15.78:0/381090320 >> v2:172.21.15.179:3300/0 conn(0x7fccf8154fd0 0x7fccf81584e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:28.456 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:28.449+0000 7fccf67fc640 1 -- 172.21.15.78:0/381090320 --> v1:172.21.15.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fccf8157ce0 con 0x7fccf814e570 2023-11-28T20:01:28.456 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:28.449+0000 7fccf67fc640 1 -- 172.21.15.78:0/381090320 <== mon.0 v1:172.21.15.78:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3326804700 0 0) 0x7fcce0001680 con 0x7fccf814e570 2023-11-28T20:01:28.456 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:28.449+0000 7fccf67fc640 1 -- 172.21.15.78:0/381090320 >> v1:172.21.15.78:6789/0 conn(0x7fccf814e570 legacy=0x7fccf80c7cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:01:28.456 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:28.449+0000 7fccf67fc640 1 --2- 172.21.15.78:0/381090320 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fccf80ca190 0x7fcce4003980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:28.456 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:28.449+0000 7fccf67fc640 1 --2- 172.21.15.78:0/381090320 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcce4003f00 0x7fcce40047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:28.456 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:28.449+0000 7fccf67fc640 1 --2- 172.21.15.78:0/381090320 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcce4004d10 0x7fcce4005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:28.456 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:28.449+0000 7fccf67fc640 1 -- 172.21.15.78:0/381090320 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fccf80c4b80 con 0x7fcce4004d10 2023-11-28T20:01:28.456 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:28.449+0000 7fccf67fc640 1 -- 172.21.15.78:0/381090320 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fccf80c4e60 con 0x7fcce4003f00 2023-11-28T20:01:28.456 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:28.449+0000 7fccf67fc640 1 -- 172.21.15.78:0/381090320 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcce400b9e0 con 0x7fccf80ca190 2023-11-28T20:01:28.456 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:28.449+0000 7fccf77fe640 1 --2- 172.21.15.78:0/381090320 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcce4004d10 0x7fcce4005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:28.456 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:28.449+0000 7fccee7fc640 1 --2- 172.21.15.78:0/381090320 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcce4003f00 0x7fcce40047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:28.457 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:28.449+0000 7fccf6ffd640 1 --2- 172.21.15.78:0/381090320 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fccf80ca190 0x7fcce4003980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:28.457 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:28.449+0000 7fccf77fe640 1 -- 172.21.15.78:0/381090320 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fccf80ca190 msgr2=0x7fcce4003980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:01:28.457 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:28.449+0000 7fccf77fe640 1 --2- 172.21.15.78:0/381090320 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fccf80ca190 0x7fcce4003980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:28.457 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:28.449+0000 7fccf77fe640 1 -- 172.21.15.78:0/381090320 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcce4003f00 msgr2=0x7fcce40047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:01:28.457 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:28.449+0000 7fccf77fe640 1 --2- 172.21.15.78:0/381090320 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcce4003f00 0x7fcce40047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:28.457 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:28.449+0000 7fccf77fe640 1 -- 172.21.15.78:0/381090320 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcce4003530 con 0x7fcce4004d10 2023-11-28T20:01:28.458 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:28.453+0000 7fccf77fe640 1 --2- 172.21.15.78:0/381090320 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcce4004d10 0x7fcce4005190 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7fccf000e170 tx=0x7fccf001cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cab24a9f53bc4f5d server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:01:28.458 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:28.453+0000 7fccf67fc640 1 -- 172.21.15.78:0/381090320 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fccf00a5c50 con 0x7fcce4004d10 2023-11-28T20:01:28.458 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:28.453+0000 7fccf67fc640 1 -- 172.21.15.78:0/381090320 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fccf000f040 con 0x7fcce4004d10 2023-11-28T20:01:28.459 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:28.453+0000 7fccf67fc640 1 -- 172.21.15.78:0/381090320 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fccf00ad440 con 0x7fcce4004d10 2023-11-28T20:01:28.459 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:28.453+0000 7fccfd916640 1 -- 172.21.15.78:0/381090320 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcce4004d10 msgr2=0x7fcce4005190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:01:28.459 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:28.453+0000 7fccfd916640 1 --2- 172.21.15.78:0/381090320 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcce4004d10 0x7fcce4005190 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7fccf000e170 tx=0x7fccf001cc40 comp rx=0 tx=0).stop 2023-11-28T20:01:28.459 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:28.453+0000 7fccf77fe640 1 -- 172.21.15.78:0/381090320 reap_dead start 2023-11-28T20:01:28.459 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:28.453+0000 7fccfd916640 1 -- 172.21.15.78:0/381090320 shutdown_connections 2023-11-28T20:01:28.459 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:28.453+0000 7fccfd916640 1 -- 172.21.15.78:0/381090320 >> 172.21.15.78:0/381090320 conn(0x7fccf80abb10 msgr2=0x7fccf80abf20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:01:28.459 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:28.453+0000 7fccfd916640 1 -- 172.21.15.78:0/381090320 shutdown_connections 2023-11-28T20:01:28.459 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:28.453+0000 7fccfd916640 1 -- 172.21.15.78:0/381090320 wait complete. 2023-11-28T20:01:28.460 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:28.457+0000 7fccfd916640 1 Processor -- start 2023-11-28T20:01:28.460 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:28.457+0000 7fccfd916640 1 -- start start 2023-11-28T20:01:28.462 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:28.457+0000 7fccfd916640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcce4004d10 0x7fccf8156bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:28.462 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:28.457+0000 7fccfd916640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fccf8151430 0x7fccf814a380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:28.463 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:28.457+0000 7fccfd916640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fccf814a8c0 0x7fccf81e9810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:28.463 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:28.457+0000 7fccfd916640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fccf81eda60 con 0x7fccf814a8c0 2023-11-28T20:01:28.463 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:28.457+0000 7fccfd916640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fccf80ae800 con 0x7fcce4004d10 2023-11-28T20:01:28.463 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:28.457+0000 7fccfd916640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fccf81ece20 con 0x7fccf8151430 2023-11-28T20:01:28.463 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:28.457+0000 7fccf77fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fccf814a8c0 0x7fccf81e9810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:28.463 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:28.457+0000 7fccf77fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fccf814a8c0 0x7fccf81e9810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:36224/0 (socket says 172.21.15.78:36224) 2023-11-28T20:01:28.463 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:28.457+0000 7fccf77fe640 1 -- 172.21.15.78:0/3131358232 learned_addr learned my addr 172.21.15.78:0/3131358232 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T20:01:28.463 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:28.457+0000 7fccee7fc640 1 --2- 172.21.15.78:0/3131358232 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fccf8151430 0x7fccf814a380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:28.463 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:28.457+0000 7fccf6ffd640 1 --2- 172.21.15.78:0/3131358232 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcce4004d10 0x7fccf8156bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:28.463 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:28.457+0000 7fccf77fe640 1 -- 172.21.15.78:0/3131358232 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fccf8151430 msgr2=0x7fccf814a380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:01:28.463 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:28.457+0000 7fccf77fe640 1 --2- 172.21.15.78:0/3131358232 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fccf8151430 0x7fccf814a380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:28.463 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:28.457+0000 7fccf77fe640 1 -- 172.21.15.78:0/3131358232 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcce4004d10 msgr2=0x7fccf8156bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:01:28.464 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:28.457+0000 7fccf77fe640 1 --2- 172.21.15.78:0/3131358232 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcce4004d10 0x7fccf8156bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:28.464 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:28.457+0000 7fccf77fe640 1 -- 172.21.15.78:0/3131358232 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fccf81ed0c0 con 0x7fccf814a8c0 2023-11-28T20:01:28.464 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:28.457+0000 7fccf77fe640 1 --2- 172.21.15.78:0/3131358232 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fccf814a8c0 0x7fccf81e9810 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7fccf0009f90 tx=0x7fccf0009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:01:28.464 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:28.457+0000 7fccf4ff9640 1 -- 172.21.15.78:0/3131358232 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fccf00ba070 con 0x7fccf814a8c0 2023-11-28T20:01:28.464 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:28.457+0000 7fccf4ff9640 1 -- 172.21.15.78:0/3131358232 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fccf00039a0 con 0x7fccf814a8c0 2023-11-28T20:01:28.464 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:28.457+0000 7fccf4ff9640 1 -- 172.21.15.78:0/3131358232 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fccf0003b30 con 0x7fccf814a8c0 2023-11-28T20:01:28.464 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:28.457+0000 7fccfd916640 1 -- 172.21.15.78:0/3131358232 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fccf81ed3a0 con 0x7fccf814a8c0 2023-11-28T20:01:28.464 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:28.457+0000 7fccfd916640 1 -- 172.21.15.78:0/3131358232 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fccf8157130 con 0x7fccf814a8c0 2023-11-28T20:01:28.465 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:28.461+0000 7fccfd916640 1 -- 172.21.15.78:0/3131358232 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fccf8067630 con 0x7fccf814a8c0 2023-11-28T20:01:28.465 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:28.461+0000 7fccf4ff9640 1 -- 172.21.15.78:0/3131358232 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fccf00b4040 con 0x7fccf814a8c0 2023-11-28T20:01:28.465 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:28.461+0000 7fccf4ff9640 1 --2- 172.21.15.78:0/3131358232 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fccd8066470 0x7fccd8068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:28.466 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:28.461+0000 7fccf4ff9640 1 -- 172.21.15.78:0/3131358232 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 6885+0+0 (secure 0 0 0) 0x7fccf011e240 con 0x7fccf814a8c0 2023-11-28T20:01:28.466 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:28.461+0000 7fccf6ffd640 1 --2- 172.21.15.78:0/3131358232 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fccd8066470 0x7fccd8068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:28.466 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:28.461+0000 7fccf6ffd640 1 --2- 172.21.15.78:0/3131358232 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fccd8066470 0x7fccd8068930 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7fccf8154d80 tx=0x7fcce0007900 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:01:28.469 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:28.465+0000 7fccf4ff9640 1 -- 172.21.15.78:0/3131358232 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fccf00eb2d0 con 0x7fccf814a8c0 2023-11-28T20:01:28.617 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:28.613+0000 7fccfd916640 1 -- 172.21.15.78:0/3131358232 --> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fccf81545c0 con 0x7fccd8066470 2023-11-28T20:01:28.629 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:28.625+0000 7fccf4ff9640 1 -- 172.21.15.78:0/3131358232 <== mgr.4106 v2:172.21.15.78:6832/2935380957 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+522286 (secure 0 0 0) 0x7fccf81545c0 con 0x7fccd8066470 2023-11-28T20:01:28.637 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-11-28T20:01:28.641 INFO:teuthology.orchestra.run.smithi078.stderr:dumped all 2023-11-28T20:01:28.643 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:28.629+0000 7fccfd916640 1 -- 172.21.15.78:0/3131358232 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fccd8066470 msgr2=0x7fccd8068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:01:28.643 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:28.629+0000 7fccfd916640 1 --2- 172.21.15.78:0/3131358232 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fccd8066470 0x7fccd8068930 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7fccf8154d80 tx=0x7fcce0007900 comp rx=0 tx=0).stop 2023-11-28T20:01:28.643 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:28.629+0000 7fccfd916640 1 -- 172.21.15.78:0/3131358232 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fccf814a8c0 msgr2=0x7fccf81e9810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:01:28.643 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:28.629+0000 7fccfd916640 1 --2- 172.21.15.78:0/3131358232 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fccf814a8c0 0x7fccf81e9810 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7fccf0009f90 tx=0x7fccf0009750 comp rx=0 tx=0).stop 2023-11-28T20:01:28.643 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:28.629+0000 7fccfd916640 1 -- 172.21.15.78:0/3131358232 shutdown_connections 2023-11-28T20:01:28.643 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:28.629+0000 7fccfd916640 1 --2- 172.21.15.78:0/3131358232 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fccd8066470 0x7fccd8068930 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:28.643 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:28.629+0000 7fccfd916640 1 --2- 172.21.15.78:0/3131358232 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fccf8151430 0x7fccf814a380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:28.643 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:28.629+0000 7fccfd916640 1 --2- 172.21.15.78:0/3131358232 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fccf814a8c0 0x7fccf81e9810 unknown :-1 s=CLOSED pgs=698 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:28.644 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:28.629+0000 7fccfd916640 1 --2- 172.21.15.78:0/3131358232 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcce4004d10 0x7fccf8156bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:28.644 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:28.629+0000 7fccfd916640 1 -- 172.21.15.78:0/3131358232 >> 172.21.15.78:0/3131358232 conn(0x7fccf80abb10 msgr2=0x7fccf80ab1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:01:28.644 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:28.629+0000 7fccfd916640 1 -- 172.21.15.78:0/3131358232 shutdown_connections 2023-11-28T20:01:28.644 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:28.629+0000 7fccfd916640 1 -- 172.21.15.78:0/3131358232 wait complete. 2023-11-28T20:01:28.654 INFO:teuthology.orchestra.run.smithi078.stdout:{"pg_ready":true,"pg_map":{"version":136,"stamp":"2023-11-28T20:01:27.982712+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":594273,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":206,"num_write_kb":2433,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":158,"ondisk_log_size":158,"up":386,"acting":386,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":235,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":226368,"kb_used_data":6048,"kb_used_omap":12,"kb_used_meta":220211,"kb_avail":754748352,"statfs":{"total":773094113280,"available":772862312448,"internally_reserved":0,"allocated":6193152,"data_stored":3946178,"data_compressed":66748,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":12752,"internal_metadata":225496624},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":30,"apply_latency_ms":30,"commit_latency_ns":30000000,"apply_latency_ns":30000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1241,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001016"},"pg_stats":[{"pgid":"12.39","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2023-11-28T20:01:22.802967+0000","last_change":"2023-11-28T20:01:22.802967+0000","last_active":"2023-11-28T20:01:22.787100+0000","last_peered":"2023-11-28T20:01:22.787100+0000","last_clean":"2023-11-28T20:01:22.787100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:01:22.802967+0000","last_undegraded":"2023-11-28T20:01:22.802967+0000","last_fullsized":"2023-11-28T20:01:22.802967+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:22.787100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:22.787100+0000","last_clean_scrub_stamp":"2023-11-28T20:01:22.787100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.3f","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-11-28T20:01:21.790302+0000","last_change":"2023-11-28T20:01:10.539211+0000","last_active":"2023-11-28T20:01:21.790302+0000","last_peered":"2023-11-28T20:01:21.790302+0000","last_clean":"2023-11-28T20:01:21.790302+0000","last_became_active":"2023-11-28T20:01:10.538932+0000","last_became_peered":"2023-11-28T20:01:10.538932+0000","last_unstale":"2023-11-28T20:01:21.790302+0000","last_undegraded":"2023-11-28T20:01:21.790302+0000","last_fullsized":"2023-11-28T20:01:21.790302+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_clean_scrub_stamp":"2023-11-28T20:01:09.480611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:10:00.034946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.38","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2023-11-28T20:01:22.800864+0000","last_change":"2023-11-28T20:01:22.800864+0000","last_active":"2023-11-28T20:01:22.787100+0000","last_peered":"2023-11-28T20:01:22.787100+0000","last_clean":"2023-11-28T20:01:22.787100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:01:22.800864+0000","last_undegraded":"2023-11-28T20:01:22.800864+0000","last_fullsized":"2023-11-28T20:01:22.800864+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:22.787100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:22.787100+0000","last_clean_scrub_stamp":"2023-11-28T20:01:22.787100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.3e","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-11-28T20:01:21.790168+0000","last_change":"2023-11-28T20:01:10.522069+0000","last_active":"2023-11-28T20:01:21.790168+0000","last_peered":"2023-11-28T20:01:21.790168+0000","last_clean":"2023-11-28T20:01:21.790168+0000","last_became_active":"2023-11-28T20:01:10.521785+0000","last_became_peered":"2023-11-28T20:01:10.521785+0000","last_unstale":"2023-11-28T20:01:21.790168+0000","last_undegraded":"2023-11-28T20:01:21.790168+0000","last_fullsized":"2023-11-28T20:01:21.790168+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_clean_scrub_stamp":"2023-11-28T20:01:09.480611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:00:30.789993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.3b","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2023-11-28T20:01:22.801987+0000","last_change":"2023-11-28T20:01:22.801987+0000","last_active":"2023-11-28T20:01:22.787100+0000","last_peered":"2023-11-28T20:01:22.787100+0000","last_clean":"2023-11-28T20:01:22.787100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:01:22.801987+0000","last_undegraded":"2023-11-28T20:01:22.801987+0000","last_fullsized":"2023-11-28T20:01:22.801987+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:22.787100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:22.787100+0000","last_clean_scrub_stamp":"2023-11-28T20:01:22.787100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.3d","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-11-28T20:01:21.798541+0000","last_change":"2023-11-28T20:01:10.538353+0000","last_active":"2023-11-28T20:01:21.798541+0000","last_peered":"2023-11-28T20:01:21.798541+0000","last_clean":"2023-11-28T20:01:21.798541+0000","last_became_active":"2023-11-28T20:01:10.537756+0000","last_became_peered":"2023-11-28T20:01:10.537756+0000","last_unstale":"2023-11-28T20:01:21.798541+0000","last_undegraded":"2023-11-28T20:01:21.798541+0000","last_fullsized":"2023-11-28T20:01:21.798541+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_clean_scrub_stamp":"2023-11-28T20:01:09.480611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T06:29:13.579326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.3a","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2023-11-28T20:01:22.804075+0000","last_change":"2023-11-28T20:01:22.804075+0000","last_active":"2023-11-28T20:01:22.787100+0000","last_peered":"2023-11-28T20:01:22.787100+0000","last_clean":"2023-11-28T20:01:22.787100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:01:22.804075+0000","last_undegraded":"2023-11-28T20:01:22.804075+0000","last_fullsized":"2023-11-28T20:01:22.804075+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:22.787100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:22.787100+0000","last_clean_scrub_stamp":"2023-11-28T20:01:22.787100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.3c","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-11-28T20:01:21.791845+0000","last_change":"2023-11-28T20:01:10.523152+0000","last_active":"2023-11-28T20:01:21.791845+0000","last_peered":"2023-11-28T20:01:21.791845+0000","last_clean":"2023-11-28T20:01:21.791845+0000","last_became_active":"2023-11-28T20:01:10.522874+0000","last_became_peered":"2023-11-28T20:01:10.522874+0000","last_unstale":"2023-11-28T20:01:21.791845+0000","last_undegraded":"2023-11-28T20:01:21.791845+0000","last_fullsized":"2023-11-28T20:01:21.791845+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_clean_scrub_stamp":"2023-11-28T20:01:09.480611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:56:55.097917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.3d","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2023-11-28T20:01:22.809244+0000","last_change":"2023-11-28T20:01:22.809244+0000","last_active":"2023-11-28T20:01:22.787100+0000","last_peered":"2023-11-28T20:01:22.787100+0000","last_clean":"2023-11-28T20:01:22.787100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:01:22.809244+0000","last_undegraded":"2023-11-28T20:01:22.809244+0000","last_fullsized":"2023-11-28T20:01:22.809244+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:22.787100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:22.787100+0000","last_clean_scrub_stamp":"2023-11-28T20:01:22.787100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.3b","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-11-28T20:01:21.801402+0000","last_change":"2023-11-28T20:01:10.529938+0000","last_active":"2023-11-28T20:01:21.801402+0000","last_peered":"2023-11-28T20:01:21.801402+0000","last_clean":"2023-11-28T20:01:21.801402+0000","last_became_active":"2023-11-28T20:01:10.529188+0000","last_became_peered":"2023-11-28T20:01:10.529188+0000","last_unstale":"2023-11-28T20:01:21.801402+0000","last_undegraded":"2023-11-28T20:01:21.801402+0000","last_fullsized":"2023-11-28T20:01:21.801402+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_clean_scrub_stamp":"2023-11-28T20:01:09.480611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:47:13.274500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.3c","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2023-11-28T20:01:22.810262+0000","last_change":"2023-11-28T20:01:22.810262+0000","last_active":"2023-11-28T20:01:22.787100+0000","last_peered":"2023-11-28T20:01:22.787100+0000","last_clean":"2023-11-28T20:01:22.787100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:01:22.810262+0000","last_undegraded":"2023-11-28T20:01:22.810262+0000","last_fullsized":"2023-11-28T20:01:22.810262+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:22.787100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:22.787100+0000","last_clean_scrub_stamp":"2023-11-28T20:01:22.787100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.3a","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-11-28T20:01:21.801203+0000","last_change":"2023-11-28T20:01:10.531000+0000","last_active":"2023-11-28T20:01:21.801203+0000","last_peered":"2023-11-28T20:01:21.801203+0000","last_clean":"2023-11-28T20:01:21.801203+0000","last_became_active":"2023-11-28T20:01:10.530754+0000","last_became_peered":"2023-11-28T20:01:10.530754+0000","last_unstale":"2023-11-28T20:01:21.801203+0000","last_undegraded":"2023-11-28T20:01:21.801203+0000","last_fullsized":"2023-11-28T20:01:21.801203+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_clean_scrub_stamp":"2023-11-28T20:01:09.480611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:44:34.399373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.3f","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2023-11-28T20:01:22.815237+0000","last_change":"2023-11-28T20:01:22.815237+0000","last_active":"2023-11-28T20:01:22.787100+0000","last_peered":"2023-11-28T20:01:22.787100+0000","last_clean":"2023-11-28T20:01:22.787100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:01:22.815237+0000","last_undegraded":"2023-11-28T20:01:22.815237+0000","last_fullsized":"2023-11-28T20:01:22.815237+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:22.787100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:22.787100+0000","last_clean_scrub_stamp":"2023-11-28T20:01:22.787100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.39","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-11-28T20:01:21.796927+0000","last_change":"2023-11-28T20:01:10.535113+0000","last_active":"2023-11-28T20:01:21.796927+0000","last_peered":"2023-11-28T20:01:21.796927+0000","last_clean":"2023-11-28T20:01:21.796927+0000","last_became_active":"2023-11-28T20:01:10.534919+0000","last_became_peered":"2023-11-28T20:01:10.534919+0000","last_unstale":"2023-11-28T20:01:21.796927+0000","last_undegraded":"2023-11-28T20:01:21.796927+0000","last_fullsized":"2023-11-28T20:01:21.796927+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_clean_scrub_stamp":"2023-11-28T20:01:09.480611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:00:31.915592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.3e","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2023-11-28T20:01:22.812285+0000","last_change":"2023-11-28T20:01:22.812285+0000","last_active":"2023-11-28T20:01:22.787100+0000","last_peered":"2023-11-28T20:01:22.787100+0000","last_clean":"2023-11-28T20:01:22.787100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:01:22.812285+0000","last_undegraded":"2023-11-28T20:01:22.812285+0000","last_fullsized":"2023-11-28T20:01:22.812285+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:22.787100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:22.787100+0000","last_clean_scrub_stamp":"2023-11-28T20:01:22.787100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.38","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-11-28T20:01:21.793498+0000","last_change":"2023-11-28T20:01:10.538054+0000","last_active":"2023-11-28T20:01:21.793498+0000","last_peered":"2023-11-28T20:01:21.793498+0000","last_clean":"2023-11-28T20:01:21.793498+0000","last_became_active":"2023-11-28T20:01:10.535363+0000","last_became_peered":"2023-11-28T20:01:10.535363+0000","last_unstale":"2023-11-28T20:01:21.793498+0000","last_undegraded":"2023-11-28T20:01:21.793498+0000","last_fullsized":"2023-11-28T20:01:21.793498+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_clean_scrub_stamp":"2023-11-28T20:01:09.480611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:06:36.994816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.31","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2023-11-28T20:01:22.805019+0000","last_change":"2023-11-28T20:01:22.805019+0000","last_active":"2023-11-28T20:01:22.787100+0000","last_peered":"2023-11-28T20:01:22.787100+0000","last_clean":"2023-11-28T20:01:22.787100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:01:22.805019+0000","last_undegraded":"2023-11-28T20:01:22.805019+0000","last_fullsized":"2023-11-28T20:01:22.805019+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:22.787100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:22.787100+0000","last_clean_scrub_stamp":"2023-11-28T20:01:22.787100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.37","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-11-28T20:01:21.799718+0000","last_change":"2023-11-28T20:01:10.543027+0000","last_active":"2023-11-28T20:01:21.799718+0000","last_peered":"2023-11-28T20:01:21.799718+0000","last_clean":"2023-11-28T20:01:21.799718+0000","last_became_active":"2023-11-28T20:01:10.541632+0000","last_became_peered":"2023-11-28T20:01:10.541632+0000","last_unstale":"2023-11-28T20:01:21.799718+0000","last_undegraded":"2023-11-28T20:01:21.799718+0000","last_fullsized":"2023-11-28T20:01:21.799718+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_clean_scrub_stamp":"2023-11-28T20:01:09.480611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:46:29.701039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.30","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2023-11-28T20:01:22.807023+0000","last_change":"2023-11-28T20:01:22.807023+0000","last_active":"2023-11-28T20:01:22.787100+0000","last_peered":"2023-11-28T20:01:22.787100+0000","last_clean":"2023-11-28T20:01:22.787100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:01:22.807023+0000","last_undegraded":"2023-11-28T20:01:22.807023+0000","last_fullsized":"2023-11-28T20:01:22.807023+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:22.787100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:22.787100+0000","last_clean_scrub_stamp":"2023-11-28T20:01:22.787100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.36","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-11-28T20:01:21.798466+0000","last_change":"2023-11-28T20:01:10.541712+0000","last_active":"2023-11-28T20:01:21.798466+0000","last_peered":"2023-11-28T20:01:21.798466+0000","last_clean":"2023-11-28T20:01:21.798466+0000","last_became_active":"2023-11-28T20:01:10.541389+0000","last_became_peered":"2023-11-28T20:01:10.541389+0000","last_unstale":"2023-11-28T20:01:21.798466+0000","last_undegraded":"2023-11-28T20:01:21.798466+0000","last_fullsized":"2023-11-28T20:01:21.798466+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_clean_scrub_stamp":"2023-11-28T20:01:09.480611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:54:30.269337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.33","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2023-11-28T20:01:22.801107+0000","last_change":"2023-11-28T20:01:22.801107+0000","last_active":"2023-11-28T20:01:22.787100+0000","last_peered":"2023-11-28T20:01:22.787100+0000","last_clean":"2023-11-28T20:01:22.787100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:01:22.801107+0000","last_undegraded":"2023-11-28T20:01:22.801107+0000","last_fullsized":"2023-11-28T20:01:22.801107+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:22.787100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:22.787100+0000","last_clean_scrub_stamp":"2023-11-28T20:01:22.787100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.35","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-11-28T20:01:21.791729+0000","last_change":"2023-11-28T20:01:10.520251+0000","last_active":"2023-11-28T20:01:21.791729+0000","last_peered":"2023-11-28T20:01:21.791729+0000","last_clean":"2023-11-28T20:01:21.791729+0000","last_became_active":"2023-11-28T20:01:10.519957+0000","last_became_peered":"2023-11-28T20:01:10.519957+0000","last_unstale":"2023-11-28T20:01:21.791729+0000","last_undegraded":"2023-11-28T20:01:21.791729+0000","last_fullsized":"2023-11-28T20:01:21.791729+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_clean_scrub_stamp":"2023-11-28T20:01:09.480611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:33:17.345518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.32","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2023-11-28T20:01:22.803669+0000","last_change":"2023-11-28T20:01:22.803669+0000","last_active":"2023-11-28T20:01:22.787100+0000","last_peered":"2023-11-28T20:01:22.787100+0000","last_clean":"2023-11-28T20:01:22.787100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:01:22.803669+0000","last_undegraded":"2023-11-28T20:01:22.803669+0000","last_fullsized":"2023-11-28T20:01:22.803669+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:22.787100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:22.787100+0000","last_clean_scrub_stamp":"2023-11-28T20:01:22.787100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.34","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-11-28T20:01:21.793709+0000","last_change":"2023-11-28T20:01:10.535199+0000","last_active":"2023-11-28T20:01:21.793709+0000","last_peered":"2023-11-28T20:01:21.793709+0000","last_clean":"2023-11-28T20:01:21.793709+0000","last_became_active":"2023-11-28T20:01:10.534856+0000","last_became_peered":"2023-11-28T20:01:10.534856+0000","last_unstale":"2023-11-28T20:01:21.793709+0000","last_undegraded":"2023-11-28T20:01:21.793709+0000","last_fullsized":"2023-11-28T20:01:21.793709+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_clean_scrub_stamp":"2023-11-28T20:01:09.480611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:07:03.844567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.35","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2023-11-28T20:01:22.809408+0000","last_change":"2023-11-28T20:01:22.809408+0000","last_active":"2023-11-28T20:01:22.787100+0000","last_peered":"2023-11-28T20:01:22.787100+0000","last_clean":"2023-11-28T20:01:22.787100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:01:22.809408+0000","last_undegraded":"2023-11-28T20:01:22.809408+0000","last_fullsized":"2023-11-28T20:01:22.809408+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:22.787100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:22.787100+0000","last_clean_scrub_stamp":"2023-11-28T20:01:22.787100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.33","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-11-28T20:01:21.793879+0000","last_change":"2023-11-28T20:01:10.529868+0000","last_active":"2023-11-28T20:01:21.793879+0000","last_peered":"2023-11-28T20:01:21.793879+0000","last_clean":"2023-11-28T20:01:21.793879+0000","last_became_active":"2023-11-28T20:01:10.529582+0000","last_became_peered":"2023-11-28T20:01:10.529582+0000","last_unstale":"2023-11-28T20:01:21.793879+0000","last_undegraded":"2023-11-28T20:01:21.793879+0000","last_fullsized":"2023-11-28T20:01:21.793879+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_clean_scrub_stamp":"2023-11-28T20:01:09.480611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T07:14:21.836133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.34","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2023-11-28T20:01:22.809821+0000","last_change":"2023-11-28T20:01:22.809821+0000","last_active":"2023-11-28T20:01:22.787100+0000","last_peered":"2023-11-28T20:01:22.787100+0000","last_clean":"2023-11-28T20:01:22.787100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:01:22.809821+0000","last_undegraded":"2023-11-28T20:01:22.809821+0000","last_fullsized":"2023-11-28T20:01:22.809821+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:22.787100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:22.787100+0000","last_clean_scrub_stamp":"2023-11-28T20:01:22.787100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.32","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-11-28T20:01:21.797969+0000","last_change":"2023-11-28T20:01:10.546075+0000","last_active":"2023-11-28T20:01:21.797969+0000","last_peered":"2023-11-28T20:01:21.797969+0000","last_clean":"2023-11-28T20:01:21.797969+0000","last_became_active":"2023-11-28T20:01:10.542038+0000","last_became_peered":"2023-11-28T20:01:10.542038+0000","last_unstale":"2023-11-28T20:01:21.797969+0000","last_undegraded":"2023-11-28T20:01:21.797969+0000","last_fullsized":"2023-11-28T20:01:21.797969+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_clean_scrub_stamp":"2023-11-28T20:01:09.480611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:44:34.399373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.37","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2023-11-28T20:01:22.806216+0000","last_change":"2023-11-28T20:01:22.806216+0000","last_active":"2023-11-28T20:01:22.787100+0000","last_peered":"2023-11-28T20:01:22.787100+0000","last_clean":"2023-11-28T20:01:22.787100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:01:22.806216+0000","last_undegraded":"2023-11-28T20:01:22.806216+0000","last_fullsized":"2023-11-28T20:01:22.806216+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:22.787100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:22.787100+0000","last_clean_scrub_stamp":"2023-11-28T20:01:22.787100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.31","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-11-28T20:01:21.798012+0000","last_change":"2023-11-28T20:01:10.535170+0000","last_active":"2023-11-28T20:01:21.798012+0000","last_peered":"2023-11-28T20:01:21.798012+0000","last_clean":"2023-11-28T20:01:21.798012+0000","last_became_active":"2023-11-28T20:01:10.534881+0000","last_became_peered":"2023-11-28T20:01:10.534881+0000","last_unstale":"2023-11-28T20:01:21.798012+0000","last_undegraded":"2023-11-28T20:01:21.798012+0000","last_fullsized":"2023-11-28T20:01:21.798012+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_clean_scrub_stamp":"2023-11-28T20:01:09.480611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:07:03.844567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.36","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2023-11-28T20:01:22.809354+0000","last_change":"2023-11-28T20:01:22.809354+0000","last_active":"2023-11-28T20:01:22.787100+0000","last_peered":"2023-11-28T20:01:22.787100+0000","last_clean":"2023-11-28T20:01:22.787100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:01:22.809354+0000","last_undegraded":"2023-11-28T20:01:22.809354+0000","last_fullsized":"2023-11-28T20:01:22.809354+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:22.787100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:22.787100+0000","last_clean_scrub_stamp":"2023-11-28T20:01:22.787100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.30","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-11-28T20:01:21.796113+0000","last_change":"2023-11-28T20:01:10.530998+0000","last_active":"2023-11-28T20:01:21.796113+0000","last_peered":"2023-11-28T20:01:21.796113+0000","last_clean":"2023-11-28T20:01:21.796113+0000","last_became_active":"2023-11-28T20:01:10.530709+0000","last_became_peered":"2023-11-28T20:01:10.530709+0000","last_unstale":"2023-11-28T20:01:21.796113+0000","last_undegraded":"2023-11-28T20:01:21.796113+0000","last_fullsized":"2023-11-28T20:01:21.796113+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_clean_scrub_stamp":"2023-11-28T20:01:09.480611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:11:53.891113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.29","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2023-11-28T20:01:22.805327+0000","last_change":"2023-11-28T20:01:22.805327+0000","last_active":"2023-11-28T20:01:22.787100+0000","last_peered":"2023-11-28T20:01:22.787100+0000","last_clean":"2023-11-28T20:01:22.787100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:01:22.805327+0000","last_undegraded":"2023-11-28T20:01:22.805327+0000","last_fullsized":"2023-11-28T20:01:22.805327+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:22.787100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:22.787100+0000","last_clean_scrub_stamp":"2023-11-28T20:01:22.787100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.2f","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-11-28T20:01:21.790410+0000","last_change":"2023-11-28T20:01:10.522350+0000","last_active":"2023-11-28T20:01:21.790410+0000","last_peered":"2023-11-28T20:01:21.790410+0000","last_clean":"2023-11-28T20:01:21.790410+0000","last_became_active":"2023-11-28T20:01:10.522075+0000","last_became_peered":"2023-11-28T20:01:10.522075+0000","last_unstale":"2023-11-28T20:01:21.790410+0000","last_undegraded":"2023-11-28T20:01:21.790410+0000","last_fullsized":"2023-11-28T20:01:21.790410+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_clean_scrub_stamp":"2023-11-28T20:01:09.480611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:18:49.627041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.28","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2023-11-28T20:01:22.805106+0000","last_change":"2023-11-28T20:01:22.805106+0000","last_active":"2023-11-28T20:01:22.787100+0000","last_peered":"2023-11-28T20:01:22.787100+0000","last_clean":"2023-11-28T20:01:22.787100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:01:22.805106+0000","last_undegraded":"2023-11-28T20:01:22.805106+0000","last_fullsized":"2023-11-28T20:01:22.805106+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:22.787100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:22.787100+0000","last_clean_scrub_stamp":"2023-11-28T20:01:22.787100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.2e","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-11-28T20:01:21.792752+0000","last_change":"2023-11-28T20:01:10.521611+0000","last_active":"2023-11-28T20:01:21.792752+0000","last_peered":"2023-11-28T20:01:21.792752+0000","last_clean":"2023-11-28T20:01:21.792752+0000","last_became_active":"2023-11-28T20:01:10.521162+0000","last_became_peered":"2023-11-28T20:01:10.521162+0000","last_unstale":"2023-11-28T20:01:21.792752+0000","last_undegraded":"2023-11-28T20:01:21.792752+0000","last_fullsized":"2023-11-28T20:01:21.792752+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_clean_scrub_stamp":"2023-11-28T20:01:09.480611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:04:56.486213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.2b","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2023-11-28T20:01:22.810297+0000","last_change":"2023-11-28T20:01:22.810297+0000","last_active":"2023-11-28T20:01:22.787100+0000","last_peered":"2023-11-28T20:01:22.787100+0000","last_clean":"2023-11-28T20:01:22.787100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:01:22.810297+0000","last_undegraded":"2023-11-28T20:01:22.810297+0000","last_fullsized":"2023-11-28T20:01:22.810297+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:22.787100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:22.787100+0000","last_clean_scrub_stamp":"2023-11-28T20:01:22.787100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.2d","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-11-28T20:01:21.801643+0000","last_change":"2023-11-28T20:01:10.526160+0000","last_active":"2023-11-28T20:01:21.801643+0000","last_peered":"2023-11-28T20:01:21.801643+0000","last_clean":"2023-11-28T20:01:21.801643+0000","last_became_active":"2023-11-28T20:01:10.525887+0000","last_became_peered":"2023-11-28T20:01:10.525887+0000","last_unstale":"2023-11-28T20:01:21.801643+0000","last_undegraded":"2023-11-28T20:01:21.801643+0000","last_fullsized":"2023-11-28T20:01:21.801643+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_clean_scrub_stamp":"2023-11-28T20:01:09.480611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:49:02.557281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.2a","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2023-11-28T20:01:22.800405+0000","last_change":"2023-11-28T20:01:22.800405+0000","last_active":"2023-11-28T20:01:22.787100+0000","last_peered":"2023-11-28T20:01:22.787100+0000","last_clean":"2023-11-28T20:01:22.787100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:01:22.800405+0000","last_undegraded":"2023-11-28T20:01:22.800405+0000","last_fullsized":"2023-11-28T20:01:22.800405+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:22.787100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:22.787100+0000","last_clean_scrub_stamp":"2023-11-28T20:01:22.787100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.2c","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-11-28T20:01:21.797188+0000","last_change":"2023-11-28T20:01:10.534338+0000","last_active":"2023-11-28T20:01:21.797188+0000","last_peered":"2023-11-28T20:01:21.797188+0000","last_clean":"2023-11-28T20:01:21.797188+0000","last_became_active":"2023-11-28T20:01:10.532397+0000","last_became_peered":"2023-11-28T20:01:10.532397+0000","last_unstale":"2023-11-28T20:01:21.797188+0000","last_undegraded":"2023-11-28T20:01:21.797188+0000","last_fullsized":"2023-11-28T20:01:21.797188+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_clean_scrub_stamp":"2023-11-28T20:01:09.480611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:51:36.724540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.2d","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2023-11-28T20:01:22.801543+0000","last_change":"2023-11-28T20:01:22.801543+0000","last_active":"2023-11-28T20:01:22.787100+0000","last_peered":"2023-11-28T20:01:22.787100+0000","last_clean":"2023-11-28T20:01:22.787100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:01:22.801543+0000","last_undegraded":"2023-11-28T20:01:22.801543+0000","last_fullsized":"2023-11-28T20:01:22.801543+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:22.787100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:22.787100+0000","last_clean_scrub_stamp":"2023-11-28T20:01:22.787100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.2b","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-11-28T20:01:21.793971+0000","last_change":"2023-11-28T20:01:10.528780+0000","last_active":"2023-11-28T20:01:21.793971+0000","last_peered":"2023-11-28T20:01:21.793971+0000","last_clean":"2023-11-28T20:01:21.793971+0000","last_became_active":"2023-11-28T20:01:10.524555+0000","last_became_peered":"2023-11-28T20:01:10.524555+0000","last_unstale":"2023-11-28T20:01:21.793971+0000","last_undegraded":"2023-11-28T20:01:21.793971+0000","last_fullsized":"2023-11-28T20:01:21.793971+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_clean_scrub_stamp":"2023-11-28T20:01:09.480611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:30:22.791908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.2c","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2023-11-28T20:01:22.800383+0000","last_change":"2023-11-28T20:01:22.800383+0000","last_active":"2023-11-28T20:01:22.787100+0000","last_peered":"2023-11-28T20:01:22.787100+0000","last_clean":"2023-11-28T20:01:22.787100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:01:22.800383+0000","last_undegraded":"2023-11-28T20:01:22.800383+0000","last_fullsized":"2023-11-28T20:01:22.800383+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:22.787100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:22.787100+0000","last_clean_scrub_stamp":"2023-11-28T20:01:22.787100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.2a","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-11-28T20:01:21.796467+0000","last_change":"2023-11-28T20:01:10.531958+0000","last_active":"2023-11-28T20:01:21.796467+0000","last_peered":"2023-11-28T20:01:21.796467+0000","last_clean":"2023-11-28T20:01:21.796467+0000","last_became_active":"2023-11-28T20:01:10.531111+0000","last_became_peered":"2023-11-28T20:01:10.531111+0000","last_unstale":"2023-11-28T20:01:21.796467+0000","last_undegraded":"2023-11-28T20:01:21.796467+0000","last_fullsized":"2023-11-28T20:01:21.796467+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_clean_scrub_stamp":"2023-11-28T20:01:09.480611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:52:31.642868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.2f","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2023-11-28T20:01:22.800411+0000","last_change":"2023-11-28T20:01:22.800411+0000","last_active":"2023-11-28T20:01:22.787100+0000","last_peered":"2023-11-28T20:01:22.787100+0000","last_clean":"2023-11-28T20:01:22.787100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:01:22.800411+0000","last_undegraded":"2023-11-28T20:01:22.800411+0000","last_fullsized":"2023-11-28T20:01:22.800411+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:22.787100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:22.787100+0000","last_clean_scrub_stamp":"2023-11-28T20:01:22.787100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.29","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-11-28T20:01:21.796452+0000","last_change":"2023-11-28T20:01:10.533367+0000","last_active":"2023-11-28T20:01:21.796452+0000","last_peered":"2023-11-28T20:01:21.796452+0000","last_clean":"2023-11-28T20:01:21.796452+0000","last_became_active":"2023-11-28T20:01:10.532975+0000","last_became_peered":"2023-11-28T20:01:10.532975+0000","last_unstale":"2023-11-28T20:01:21.796452+0000","last_undegraded":"2023-11-28T20:01:21.796452+0000","last_fullsized":"2023-11-28T20:01:21.796452+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_clean_scrub_stamp":"2023-11-28T20:01:09.480611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:10:30.393696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.2e","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2023-11-28T20:01:22.808991+0000","last_change":"2023-11-28T20:01:22.808991+0000","last_active":"2023-11-28T20:01:22.787100+0000","last_peered":"2023-11-28T20:01:22.787100+0000","last_clean":"2023-11-28T20:01:22.787100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:01:22.808991+0000","last_undegraded":"2023-11-28T20:01:22.808991+0000","last_fullsized":"2023-11-28T20:01:22.808991+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:22.787100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:22.787100+0000","last_clean_scrub_stamp":"2023-11-28T20:01:22.787100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.28","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-11-28T20:01:21.797562+0000","last_change":"2023-11-28T20:01:10.541445+0000","last_active":"2023-11-28T20:01:21.797562+0000","last_peered":"2023-11-28T20:01:21.797562+0000","last_clean":"2023-11-28T20:01:21.797562+0000","last_became_active":"2023-11-28T20:01:10.539375+0000","last_became_peered":"2023-11-28T20:01:10.539375+0000","last_unstale":"2023-11-28T20:01:21.797562+0000","last_undegraded":"2023-11-28T20:01:21.797562+0000","last_fullsized":"2023-11-28T20:01:21.797562+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_clean_scrub_stamp":"2023-11-28T20:01:09.480611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T07:14:21.836133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.21","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2023-11-28T20:01:22.806976+0000","last_change":"2023-11-28T20:01:22.806976+0000","last_active":"2023-11-28T20:01:22.787100+0000","last_peered":"2023-11-28T20:01:22.787100+0000","last_clean":"2023-11-28T20:01:22.787100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:01:22.806976+0000","last_undegraded":"2023-11-28T20:01:22.806976+0000","last_fullsized":"2023-11-28T20:01:22.806976+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:22.787100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:22.787100+0000","last_clean_scrub_stamp":"2023-11-28T20:01:22.787100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.27","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-11-28T20:01:21.794373+0000","last_change":"2023-11-28T20:01:10.531718+0000","last_active":"2023-11-28T20:01:21.794373+0000","last_peered":"2023-11-28T20:01:21.794373+0000","last_clean":"2023-11-28T20:01:21.794373+0000","last_became_active":"2023-11-28T20:01:10.529424+0000","last_became_peered":"2023-11-28T20:01:10.529424+0000","last_unstale":"2023-11-28T20:01:21.794373+0000","last_undegraded":"2023-11-28T20:01:21.794373+0000","last_fullsized":"2023-11-28T20:01:21.794373+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_clean_scrub_stamp":"2023-11-28T20:01:09.480611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:17:27.097887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.20","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2023-11-28T20:01:22.808081+0000","last_change":"2023-11-28T20:01:22.808081+0000","last_active":"2023-11-28T20:01:22.787100+0000","last_peered":"2023-11-28T20:01:22.787100+0000","last_clean":"2023-11-28T20:01:22.787100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:01:22.808081+0000","last_undegraded":"2023-11-28T20:01:22.808081+0000","last_fullsized":"2023-11-28T20:01:22.808081+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:22.787100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:22.787100+0000","last_clean_scrub_stamp":"2023-11-28T20:01:22.787100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.26","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-11-28T20:01:21.794270+0000","last_change":"2023-11-28T20:01:10.530284+0000","last_active":"2023-11-28T20:01:21.794270+0000","last_peered":"2023-11-28T20:01:21.794270+0000","last_clean":"2023-11-28T20:01:21.794270+0000","last_became_active":"2023-11-28T20:01:10.529805+0000","last_became_peered":"2023-11-28T20:01:10.529805+0000","last_unstale":"2023-11-28T20:01:21.794270+0000","last_undegraded":"2023-11-28T20:01:21.794270+0000","last_fullsized":"2023-11-28T20:01:21.794270+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_clean_scrub_stamp":"2023-11-28T20:01:09.480611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:46:29.701039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.23","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2023-11-28T20:01:22.808672+0000","last_change":"2023-11-28T20:01:22.808672+0000","last_active":"2023-11-28T20:01:22.787100+0000","last_peered":"2023-11-28T20:01:22.787100+0000","last_clean":"2023-11-28T20:01:22.787100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:01:22.808672+0000","last_undegraded":"2023-11-28T20:01:22.808672+0000","last_fullsized":"2023-11-28T20:01:22.808672+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:22.787100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:22.787100+0000","last_clean_scrub_stamp":"2023-11-28T20:01:22.787100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.25","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-11-28T20:01:21.791827+0000","last_change":"2023-11-28T20:01:10.519186+0000","last_active":"2023-11-28T20:01:21.791827+0000","last_peered":"2023-11-28T20:01:21.791827+0000","last_clean":"2023-11-28T20:01:21.791827+0000","last_became_active":"2023-11-28T20:01:10.518855+0000","last_became_peered":"2023-11-28T20:01:10.518855+0000","last_unstale":"2023-11-28T20:01:21.791827+0000","last_undegraded":"2023-11-28T20:01:21.791827+0000","last_fullsized":"2023-11-28T20:01:21.791827+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_clean_scrub_stamp":"2023-11-28T20:01:09.480611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:23:19.215371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.22","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2023-11-28T20:01:22.807092+0000","last_change":"2023-11-28T20:01:22.807092+0000","last_active":"2023-11-28T20:01:22.787100+0000","last_peered":"2023-11-28T20:01:22.787100+0000","last_clean":"2023-11-28T20:01:22.787100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:01:22.807092+0000","last_undegraded":"2023-11-28T20:01:22.807092+0000","last_fullsized":"2023-11-28T20:01:22.807092+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:22.787100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:22.787100+0000","last_clean_scrub_stamp":"2023-11-28T20:01:22.787100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.24","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-11-28T20:01:21.789959+0000","last_change":"2023-11-28T20:01:10.537687+0000","last_active":"2023-11-28T20:01:21.789959+0000","last_peered":"2023-11-28T20:01:21.789959+0000","last_clean":"2023-11-28T20:01:21.789959+0000","last_became_active":"2023-11-28T20:01:10.536233+0000","last_became_peered":"2023-11-28T20:01:10.536233+0000","last_unstale":"2023-11-28T20:01:21.789959+0000","last_undegraded":"2023-11-28T20:01:21.789959+0000","last_fullsized":"2023-11-28T20:01:21.789959+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_clean_scrub_stamp":"2023-11-28T20:01:09.480611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:18:17.108795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.25","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2023-11-28T20:01:22.815803+0000","last_change":"2023-11-28T20:01:22.815803+0000","last_active":"2023-11-28T20:01:22.787100+0000","last_peered":"2023-11-28T20:01:22.787100+0000","last_clean":"2023-11-28T20:01:22.787100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:01:22.815803+0000","last_undegraded":"2023-11-28T20:01:22.815803+0000","last_fullsized":"2023-11-28T20:01:22.815803+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:22.787100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:22.787100+0000","last_clean_scrub_stamp":"2023-11-28T20:01:22.787100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.23","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-11-28T20:01:21.798126+0000","last_change":"2023-11-28T20:01:10.534726+0000","last_active":"2023-11-28T20:01:21.798126+0000","last_peered":"2023-11-28T20:01:21.798126+0000","last_clean":"2023-11-28T20:01:21.798126+0000","last_became_active":"2023-11-28T20:01:10.534413+0000","last_became_peered":"2023-11-28T20:01:10.534413+0000","last_unstale":"2023-11-28T20:01:21.798126+0000","last_undegraded":"2023-11-28T20:01:21.798126+0000","last_fullsized":"2023-11-28T20:01:21.798126+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_clean_scrub_stamp":"2023-11-28T20:01:09.480611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:30:22.791908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.24","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2023-11-28T20:01:22.799856+0000","last_change":"2023-11-28T20:01:22.799856+0000","last_active":"2023-11-28T20:01:22.787100+0000","last_peered":"2023-11-28T20:01:22.787100+0000","last_clean":"2023-11-28T20:01:22.787100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:01:22.799856+0000","last_undegraded":"2023-11-28T20:01:22.799856+0000","last_fullsized":"2023-11-28T20:01:22.799856+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:22.787100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:22.787100+0000","last_clean_scrub_stamp":"2023-11-28T20:01:22.787100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.22","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-11-28T20:01:21.793740+0000","last_change":"2023-11-28T20:01:10.534050+0000","last_active":"2023-11-28T20:01:21.793740+0000","last_peered":"2023-11-28T20:01:21.793740+0000","last_clean":"2023-11-28T20:01:21.793740+0000","last_became_active":"2023-11-28T20:01:10.533704+0000","last_became_peered":"2023-11-28T20:01:10.533704+0000","last_unstale":"2023-11-28T20:01:21.793740+0000","last_undegraded":"2023-11-28T20:01:21.793740+0000","last_fullsized":"2023-11-28T20:01:21.793740+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_clean_scrub_stamp":"2023-11-28T20:01:09.480611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:50:58.589965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.27","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2023-11-28T20:01:22.804472+0000","last_change":"2023-11-28T20:01:22.804472+0000","last_active":"2023-11-28T20:01:22.787100+0000","last_peered":"2023-11-28T20:01:22.787100+0000","last_clean":"2023-11-28T20:01:22.787100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:01:22.804472+0000","last_undegraded":"2023-11-28T20:01:22.804472+0000","last_fullsized":"2023-11-28T20:01:22.804472+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:22.787100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:22.787100+0000","last_clean_scrub_stamp":"2023-11-28T20:01:22.787100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.21","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-11-28T20:01:21.791333+0000","last_change":"2023-11-28T20:01:10.520311+0000","last_active":"2023-11-28T20:01:21.791333+0000","last_peered":"2023-11-28T20:01:21.791333+0000","last_clean":"2023-11-28T20:01:21.791333+0000","last_became_active":"2023-11-28T20:01:10.519974+0000","last_became_peered":"2023-11-28T20:01:10.519974+0000","last_unstale":"2023-11-28T20:01:21.791333+0000","last_undegraded":"2023-11-28T20:01:21.791333+0000","last_fullsized":"2023-11-28T20:01:21.791333+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_clean_scrub_stamp":"2023-11-28T20:01:09.480611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T07:02:13.895402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.26","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2023-11-28T20:01:22.808714+0000","last_change":"2023-11-28T20:01:22.808714+0000","last_active":"2023-11-28T20:01:22.787100+0000","last_peered":"2023-11-28T20:01:22.787100+0000","last_clean":"2023-11-28T20:01:22.787100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:01:22.808714+0000","last_undegraded":"2023-11-28T20:01:22.808714+0000","last_fullsized":"2023-11-28T20:01:22.808714+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:22.787100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:22.787100+0000","last_clean_scrub_stamp":"2023-11-28T20:01:22.787100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.20","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-11-28T20:01:21.800585+0000","last_change":"2023-11-28T20:01:10.525223+0000","last_active":"2023-11-28T20:01:21.800585+0000","last_peered":"2023-11-28T20:01:21.800585+0000","last_clean":"2023-11-28T20:01:21.800585+0000","last_became_active":"2023-11-28T20:01:10.524750+0000","last_became_peered":"2023-11-28T20:01:10.524750+0000","last_unstale":"2023-11-28T20:01:21.800585+0000","last_undegraded":"2023-11-28T20:01:21.800585+0000","last_fullsized":"2023-11-28T20:01:21.800585+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_clean_scrub_stamp":"2023-11-28T20:01:09.480611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:50:58.589965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.1a","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2023-11-28T20:01:22.804950+0000","last_change":"2023-11-28T20:01:22.804950+0000","last_active":"2023-11-28T20:01:22.787100+0000","last_peered":"2023-11-28T20:01:22.787100+0000","last_clean":"2023-11-28T20:01:22.787100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:01:22.804950+0000","last_undegraded":"2023-11-28T20:01:22.804950+0000","last_fullsized":"2023-11-28T20:01:22.804950+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:22.787100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:22.787100+0000","last_clean_scrub_stamp":"2023-11-28T20:01:22.787100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1d","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-28T20:01:22.832104+0000","last_change":"2023-11-28T20:01:22.828333+0000","last_active":"2023-11-28T20:01:22.832104+0000","last_peered":"2023-11-28T20:01:22.832104+0000","last_clean":"2023-11-28T20:01:22.832104+0000","last_became_active":"2023-11-28T20:01:22.828042+0000","last_became_peered":"2023-11-28T20:01:22.828042+0000","last_unstale":"2023-11-28T20:01:22.832104+0000","last_undegraded":"2023-11-28T20:01:22.832104+0000","last_fullsized":"2023-11-28T20:01:22.832104+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:21.777981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:21.777981+0000","last_clean_scrub_stamp":"2023-11-28T20:01:21.777981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:51:49.021909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1c","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-11-28T20:01:21.801606+0000","last_change":"2023-11-28T20:01:10.528869+0000","last_active":"2023-11-28T20:01:21.801606+0000","last_peered":"2023-11-28T20:01:21.801606+0000","last_clean":"2023-11-28T20:01:21.801606+0000","last_became_active":"2023-11-28T20:01:10.528572+0000","last_became_peered":"2023-11-28T20:01:10.528572+0000","last_unstale":"2023-11-28T20:01:21.801606+0000","last_undegraded":"2023-11-28T20:01:21.801606+0000","last_fullsized":"2023-11-28T20:01:21.801606+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_clean_scrub_stamp":"2023-11-28T20:01:09.480611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:37:17.516298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.1f","version":"60'4","reported_seq":18,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-11-28T20:01:21.790597+0000","last_change":"2023-11-28T20:01:09.512544+0000","last_active":"2023-11-28T20:01:21.790597+0000","last_peered":"2023-11-28T20:01:21.790597+0000","last_clean":"2023-11-28T20:01:21.790597+0000","last_became_active":"2023-11-28T20:01:09.512197+0000","last_became_peered":"2023-11-28T20:01:09.512197+0000","last_unstale":"2023-11-28T20:01:21.790597+0000","last_undegraded":"2023-11-28T20:01:21.790597+0000","last_fullsized":"2023-11-28T20:01:21.790597+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:08.474257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:08.474257+0000","last_clean_scrub_stamp":"2023-11-28T20:01:08.474257+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:49:01.550926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.1b","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2023-11-28T20:01:22.806830+0000","last_change":"2023-11-28T20:01:22.806830+0000","last_active":"2023-11-28T20:01:22.787100+0000","last_peered":"2023-11-28T20:01:22.787100+0000","last_clean":"2023-11-28T20:01:22.787100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:01:22.806830+0000","last_undegraded":"2023-11-28T20:01:22.806830+0000","last_fullsized":"2023-11-28T20:01:22.806830+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:22.787100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:22.787100+0000","last_clean_scrub_stamp":"2023-11-28T20:01:22.787100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1c","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-28T20:01:22.827276+0000","last_change":"2023-11-28T20:01:22.821621+0000","last_active":"2023-11-28T20:01:22.827276+0000","last_peered":"2023-11-28T20:01:22.827276+0000","last_clean":"2023-11-28T20:01:22.827276+0000","last_became_active":"2023-11-28T20:01:22.821322+0000","last_became_peered":"2023-11-28T20:01:22.821322+0000","last_unstale":"2023-11-28T20:01:22.827276+0000","last_undegraded":"2023-11-28T20:01:22.827276+0000","last_fullsized":"2023-11-28T20:01:22.827276+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:21.777981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:21.777981+0000","last_clean_scrub_stamp":"2023-11-28T20:01:21.777981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:05:44.877415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.1d","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-11-28T20:01:21.791853+0000","last_change":"2023-11-28T20:01:10.528270+0000","last_active":"2023-11-28T20:01:21.791853+0000","last_peered":"2023-11-28T20:01:21.791853+0000","last_clean":"2023-11-28T20:01:21.791853+0000","last_became_active":"2023-11-28T20:01:10.527932+0000","last_became_peered":"2023-11-28T20:01:10.527932+0000","last_unstale":"2023-11-28T20:01:21.791853+0000","last_undegraded":"2023-11-28T20:01:21.791853+0000","last_fullsized":"2023-11-28T20:01:21.791853+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_clean_scrub_stamp":"2023-11-28T20:01:09.480611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T07:21:45.278688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1e","version":"60'1","reported_seq":15,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-11-28T20:01:21.801722+0000","last_change":"2023-11-28T20:01:09.516140+0000","last_active":"2023-11-28T20:01:21.801722+0000","last_peered":"2023-11-28T20:01:21.801722+0000","last_clean":"2023-11-28T20:01:21.801722+0000","last_became_active":"2023-11-28T20:01:09.514007+0000","last_became_peered":"2023-11-28T20:01:09.514007+0000","last_unstale":"2023-11-28T20:01:21.801722+0000","last_undegraded":"2023-11-28T20:01:21.801722+0000","last_fullsized":"2023-11-28T20:01:21.801722+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:08.474257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:08.474257+0000","last_clean_scrub_stamp":"2023-11-28T20:01:08.474257+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:30:21.785554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.18","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2023-11-28T20:01:22.807282+0000","last_change":"2023-11-28T20:01:22.807282+0000","last_active":"2023-11-28T20:01:22.787100+0000","last_peered":"2023-11-28T20:01:22.787100+0000","last_clean":"2023-11-28T20:01:22.787100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:01:22.807282+0000","last_undegraded":"2023-11-28T20:01:22.807282+0000","last_fullsized":"2023-11-28T20:01:22.807282+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:22.787100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:22.787100+0000","last_clean_scrub_stamp":"2023-11-28T20:01:22.787100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.1f","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-28T20:01:22.825882+0000","last_change":"2023-11-28T20:01:22.821923+0000","last_active":"2023-11-28T20:01:22.825882+0000","last_peered":"2023-11-28T20:01:22.825882+0000","last_clean":"2023-11-28T20:01:22.825882+0000","last_became_active":"2023-11-28T20:01:22.821642+0000","last_became_peered":"2023-11-28T20:01:22.821642+0000","last_unstale":"2023-11-28T20:01:22.825882+0000","last_undegraded":"2023-11-28T20:01:22.825882+0000","last_fullsized":"2023-11-28T20:01:22.825882+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:21.777981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:21.777981+0000","last_clean_scrub_stamp":"2023-11-28T20:01:21.777981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:17:30.312696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.1e","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-11-28T20:01:21.801669+0000","last_change":"2023-11-28T20:01:10.526680+0000","last_active":"2023-11-28T20:01:21.801669+0000","last_peered":"2023-11-28T20:01:21.801669+0000","last_clean":"2023-11-28T20:01:21.801669+0000","last_became_active":"2023-11-28T20:01:10.526366+0000","last_became_peered":"2023-11-28T20:01:10.526366+0000","last_unstale":"2023-11-28T20:01:21.801669+0000","last_undegraded":"2023-11-28T20:01:21.801669+0000","last_fullsized":"2023-11-28T20:01:21.801669+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_clean_scrub_stamp":"2023-11-28T20:01:09.480611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:05:54.478424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1d","version":"60'2","reported_seq":16,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-11-28T20:01:21.801620+0000","last_change":"2023-11-28T20:01:09.510600+0000","last_active":"2023-11-28T20:01:21.801620+0000","last_peered":"2023-11-28T20:01:21.801620+0000","last_clean":"2023-11-28T20:01:21.801620+0000","last_became_active":"2023-11-28T20:01:09.510336+0000","last_became_peered":"2023-11-28T20:01:09.510336+0000","last_unstale":"2023-11-28T20:01:21.801620+0000","last_undegraded":"2023-11-28T20:01:21.801620+0000","last_fullsized":"2023-11-28T20:01:21.801620+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:08.474257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:08.474257+0000","last_clean_scrub_stamp":"2023-11-28T20:01:08.474257+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:56:14.988591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.19","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2023-11-28T20:01:22.804536+0000","last_change":"2023-11-28T20:01:22.804536+0000","last_active":"2023-11-28T20:01:22.787100+0000","last_peered":"2023-11-28T20:01:22.787100+0000","last_clean":"2023-11-28T20:01:22.787100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:01:22.804536+0000","last_undegraded":"2023-11-28T20:01:22.804536+0000","last_fullsized":"2023-11-28T20:01:22.804536+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:22.787100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:22.787100+0000","last_clean_scrub_stamp":"2023-11-28T20:01:22.787100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1e","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-28T20:01:22.832207+0000","last_change":"2023-11-28T20:01:22.828784+0000","last_active":"2023-11-28T20:01:22.832207+0000","last_peered":"2023-11-28T20:01:22.832207+0000","last_clean":"2023-11-28T20:01:22.832207+0000","last_became_active":"2023-11-28T20:01:22.828228+0000","last_became_peered":"2023-11-28T20:01:22.828228+0000","last_unstale":"2023-11-28T20:01:22.832207+0000","last_undegraded":"2023-11-28T20:01:22.832207+0000","last_fullsized":"2023-11-28T20:01:22.832207+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:21.777981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:21.777981+0000","last_clean_scrub_stamp":"2023-11-28T20:01:21.777981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:02:43.254120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1f","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-11-28T20:01:21.799642+0000","last_change":"2023-11-28T20:01:10.541960+0000","last_active":"2023-11-28T20:01:21.799642+0000","last_peered":"2023-11-28T20:01:21.799642+0000","last_clean":"2023-11-28T20:01:21.799642+0000","last_became_active":"2023-11-28T20:01:10.541305+0000","last_became_peered":"2023-11-28T20:01:10.541305+0000","last_unstale":"2023-11-28T20:01:21.799642+0000","last_undegraded":"2023-11-28T20:01:21.799642+0000","last_fullsized":"2023-11-28T20:01:21.799642+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_clean_scrub_stamp":"2023-11-28T20:01:09.480611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:17:27.097887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.1c","version":"60'2","reported_seq":16,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-11-28T20:01:21.801386+0000","last_change":"2023-11-28T20:01:09.507988+0000","last_active":"2023-11-28T20:01:21.801386+0000","last_peered":"2023-11-28T20:01:21.801386+0000","last_clean":"2023-11-28T20:01:21.801386+0000","last_became_active":"2023-11-28T20:01:09.507762+0000","last_became_peered":"2023-11-28T20:01:09.507762+0000","last_unstale":"2023-11-28T20:01:21.801386+0000","last_undegraded":"2023-11-28T20:01:21.801386+0000","last_fullsized":"2023-11-28T20:01:21.801386+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:08.474257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:08.474257+0000","last_clean_scrub_stamp":"2023-11-28T20:01:08.474257+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T07:14:20.829778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.1e","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2023-11-28T20:01:22.806058+0000","last_change":"2023-11-28T20:01:22.806058+0000","last_active":"2023-11-28T20:01:22.787100+0000","last_peered":"2023-11-28T20:01:22.787100+0000","last_clean":"2023-11-28T20:01:22.787100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:01:22.806058+0000","last_undegraded":"2023-11-28T20:01:22.806058+0000","last_fullsized":"2023-11-28T20:01:22.806058+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:22.787100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:22.787100+0000","last_clean_scrub_stamp":"2023-11-28T20:01:22.787100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-28T20:01:22.821300+0000","last_change":"2023-11-28T20:01:22.818660+0000","last_active":"2023-11-28T20:01:22.821300+0000","last_peered":"2023-11-28T20:01:22.821300+0000","last_clean":"2023-11-28T20:01:22.821300+0000","last_became_active":"2023-11-28T20:01:22.818352+0000","last_became_peered":"2023-11-28T20:01:22.818352+0000","last_unstale":"2023-11-28T20:01:22.821300+0000","last_undegraded":"2023-11-28T20:01:22.821300+0000","last_fullsized":"2023-11-28T20:01:22.821300+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:21.777981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:21.777981+0000","last_clean_scrub_stamp":"2023-11-28T20:01:21.777981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:59:20.866094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-11-28T20:01:21.796193+0000","last_change":"2023-11-28T20:01:10.518032+0000","last_active":"2023-11-28T20:01:21.796193+0000","last_peered":"2023-11-28T20:01:21.796193+0000","last_clean":"2023-11-28T20:01:21.796193+0000","last_became_active":"2023-11-28T20:01:10.517780+0000","last_became_peered":"2023-11-28T20:01:10.517780+0000","last_unstale":"2023-11-28T20:01:21.796193+0000","last_undegraded":"2023-11-28T20:01:21.796193+0000","last_fullsized":"2023-11-28T20:01:21.796193+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_clean_scrub_stamp":"2023-11-28T20:01:09.480611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:43:39.118896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.1b","version":"60'1","reported_seq":15,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-11-28T20:01:21.797196+0000","last_change":"2023-11-28T20:01:09.514901+0000","last_active":"2023-11-28T20:01:21.797196+0000","last_peered":"2023-11-28T20:01:21.797196+0000","last_clean":"2023-11-28T20:01:21.797196+0000","last_became_active":"2023-11-28T20:01:09.514568+0000","last_became_peered":"2023-11-28T20:01:09.514568+0000","last_unstale":"2023-11-28T20:01:21.797196+0000","last_undegraded":"2023-11-28T20:01:21.797196+0000","last_fullsized":"2023-11-28T20:01:21.797196+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:08.474257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:08.474257+0000","last_clean_scrub_stamp":"2023-11-28T20:01:08.474257+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:44:33.393018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.1f","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2023-11-28T20:01:22.808178+0000","last_change":"2023-11-28T20:01:22.808178+0000","last_active":"2023-11-28T20:01:22.787100+0000","last_peered":"2023-11-28T20:01:22.787100+0000","last_clean":"2023-11-28T20:01:22.787100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:01:22.808178+0000","last_undegraded":"2023-11-28T20:01:22.808178+0000","last_fullsized":"2023-11-28T20:01:22.808178+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:22.787100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:22.787100+0000","last_clean_scrub_stamp":"2023-11-28T20:01:22.787100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-28T20:01:22.816804+0000","last_change":"2023-11-28T20:01:22.811015+0000","last_active":"2023-11-28T20:01:22.816804+0000","last_peered":"2023-11-28T20:01:22.816804+0000","last_clean":"2023-11-28T20:01:22.816804+0000","last_became_active":"2023-11-28T20:01:22.810559+0000","last_became_peered":"2023-11-28T20:01:22.810559+0000","last_unstale":"2023-11-28T20:01:22.816804+0000","last_undegraded":"2023-11-28T20:01:22.816804+0000","last_fullsized":"2023-11-28T20:01:22.816804+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:21.777981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:21.777981+0000","last_clean_scrub_stamp":"2023-11-28T20:01:21.777981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:14:31.333418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-11-28T20:01:21.789863+0000","last_change":"2023-11-28T20:01:10.522005+0000","last_active":"2023-11-28T20:01:21.789863+0000","last_peered":"2023-11-28T20:01:21.789863+0000","last_clean":"2023-11-28T20:01:21.789863+0000","last_became_active":"2023-11-28T20:01:10.521691+0000","last_became_peered":"2023-11-28T20:01:10.521691+0000","last_unstale":"2023-11-28T20:01:21.789863+0000","last_undegraded":"2023-11-28T20:01:21.789863+0000","last_fullsized":"2023-11-28T20:01:21.789863+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_clean_scrub_stamp":"2023-11-28T20:01:09.480611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:11:08.794514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1a","version":"60'1","reported_seq":15,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-11-28T20:01:21.796566+0000","last_change":"2023-11-28T20:01:09.510388+0000","last_active":"2023-11-28T20:01:21.796566+0000","last_peered":"2023-11-28T20:01:21.796566+0000","last_clean":"2023-11-28T20:01:21.796566+0000","last_became_active":"2023-11-28T20:01:09.510114+0000","last_became_peered":"2023-11-28T20:01:09.510114+0000","last_unstale":"2023-11-28T20:01:21.796566+0000","last_undegraded":"2023-11-28T20:01:21.796566+0000","last_fullsized":"2023-11-28T20:01:21.796566+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:08.474257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:08.474257+0000","last_clean_scrub_stamp":"2023-11-28T20:01:08.474257+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T06:29:12.572972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.1c","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2023-11-28T20:01:22.805361+0000","last_change":"2023-11-28T20:01:22.805361+0000","last_active":"2023-11-28T20:01:22.787100+0000","last_peered":"2023-11-28T20:01:22.787100+0000","last_clean":"2023-11-28T20:01:22.787100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:01:22.805361+0000","last_undegraded":"2023-11-28T20:01:22.805361+0000","last_fullsized":"2023-11-28T20:01:22.805361+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:22.787100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:22.787100+0000","last_clean_scrub_stamp":"2023-11-28T20:01:22.787100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1b","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-28T20:01:22.829871+0000","last_change":"2023-11-28T20:01:22.826731+0000","last_active":"2023-11-28T20:01:22.829871+0000","last_peered":"2023-11-28T20:01:22.829871+0000","last_clean":"2023-11-28T20:01:22.829871+0000","last_became_active":"2023-11-28T20:01:22.826278+0000","last_became_peered":"2023-11-28T20:01:22.826278+0000","last_unstale":"2023-11-28T20:01:22.829871+0000","last_undegraded":"2023-11-28T20:01:22.829871+0000","last_fullsized":"2023-11-28T20:01:22.829871+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:21.777981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:21.777981+0000","last_clean_scrub_stamp":"2023-11-28T20:01:21.777981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T07:05:57.693273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.1a","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-11-28T20:01:21.801060+0000","last_change":"2023-11-28T20:01:10.536831+0000","last_active":"2023-11-28T20:01:21.801060+0000","last_peered":"2023-11-28T20:01:21.801060+0000","last_clean":"2023-11-28T20:01:21.801060+0000","last_became_active":"2023-11-28T20:01:10.536506+0000","last_became_peered":"2023-11-28T20:01:10.536506+0000","last_unstale":"2023-11-28T20:01:21.801060+0000","last_undegraded":"2023-11-28T20:01:21.801060+0000","last_fullsized":"2023-11-28T20:01:21.801060+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_clean_scrub_stamp":"2023-11-28T20:01:09.480611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:29:39.856095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":14,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-11-28T20:01:21.796477+0000","last_change":"2023-11-28T20:01:09.514530+0000","last_active":"2023-11-28T20:01:21.796477+0000","last_peered":"2023-11-28T20:01:21.796477+0000","last_clean":"2023-11-28T20:01:21.796477+0000","last_became_active":"2023-11-28T20:01:09.514112+0000","last_became_peered":"2023-11-28T20:01:09.514112+0000","last_unstale":"2023-11-28T20:01:21.796477+0000","last_undegraded":"2023-11-28T20:01:21.796477+0000","last_fullsized":"2023-11-28T20:01:21.796477+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:08.474257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:08.474257+0000","last_clean_scrub_stamp":"2023-11-28T20:01:08.474257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:07:02.838212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.1d","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2023-11-28T20:01:22.804949+0000","last_change":"2023-11-28T20:01:22.804949+0000","last_active":"2023-11-28T20:01:22.787100+0000","last_peered":"2023-11-28T20:01:22.787100+0000","last_clean":"2023-11-28T20:01:22.787100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:01:22.804949+0000","last_undegraded":"2023-11-28T20:01:22.804949+0000","last_fullsized":"2023-11-28T20:01:22.804949+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:22.787100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:22.787100+0000","last_clean_scrub_stamp":"2023-11-28T20:01:22.787100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1a","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-28T20:01:22.827278+0000","last_change":"2023-11-28T20:01:22.823414+0000","last_active":"2023-11-28T20:01:22.827278+0000","last_peered":"2023-11-28T20:01:22.827278+0000","last_clean":"2023-11-28T20:01:22.827278+0000","last_became_active":"2023-11-28T20:01:22.823073+0000","last_became_peered":"2023-11-28T20:01:22.823073+0000","last_unstale":"2023-11-28T20:01:22.827278+0000","last_undegraded":"2023-11-28T20:01:22.827278+0000","last_fullsized":"2023-11-28T20:01:22.827278+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:21.777981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:21.777981+0000","last_clean_scrub_stamp":"2023-11-28T20:01:21.777981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:13:17.072225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.1b","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-11-28T20:01:21.797586+0000","last_change":"2023-11-28T20:01:10.522250+0000","last_active":"2023-11-28T20:01:21.797586+0000","last_peered":"2023-11-28T20:01:21.797586+0000","last_clean":"2023-11-28T20:01:21.797586+0000","last_became_active":"2023-11-28T20:01:10.521958+0000","last_became_peered":"2023-11-28T20:01:10.521958+0000","last_unstale":"2023-11-28T20:01:21.797586+0000","last_undegraded":"2023-11-28T20:01:21.797586+0000","last_fullsized":"2023-11-28T20:01:21.797586+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_clean_scrub_stamp":"2023-11-28T20:01:09.480611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:59:08.568724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":14,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-11-28T20:01:21.801005+0000","last_change":"2023-11-28T20:01:09.512078+0000","last_active":"2023-11-28T20:01:21.801005+0000","last_peered":"2023-11-28T20:01:21.801005+0000","last_clean":"2023-11-28T20:01:21.801005+0000","last_became_active":"2023-11-28T20:01:09.511733+0000","last_became_peered":"2023-11-28T20:01:09.511733+0000","last_unstale":"2023-11-28T20:01:21.801005+0000","last_undegraded":"2023-11-28T20:01:21.801005+0000","last_fullsized":"2023-11-28T20:01:21.801005+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:08.474257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:08.474257+0000","last_clean_scrub_stamp":"2023-11-28T20:01:08.474257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:16:29.294303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.12","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2023-11-28T20:01:22.801913+0000","last_change":"2023-11-28T20:01:22.801913+0000","last_active":"2023-11-28T20:01:22.787100+0000","last_peered":"2023-11-28T20:01:22.787100+0000","last_clean":"2023-11-28T20:01:22.787100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:01:22.801913+0000","last_undegraded":"2023-11-28T20:01:22.801913+0000","last_fullsized":"2023-11-28T20:01:22.801913+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:22.787100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:22.787100+0000","last_clean_scrub_stamp":"2023-11-28T20:01:22.787100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.15","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-28T20:01:22.828323+0000","last_change":"2023-11-28T20:01:22.818633+0000","last_active":"2023-11-28T20:01:22.828323+0000","last_peered":"2023-11-28T20:01:22.828323+0000","last_clean":"2023-11-28T20:01:22.828323+0000","last_became_active":"2023-11-28T20:01:22.818036+0000","last_became_peered":"2023-11-28T20:01:22.818036+0000","last_unstale":"2023-11-28T20:01:22.828323+0000","last_undegraded":"2023-11-28T20:01:22.828323+0000","last_fullsized":"2023-11-28T20:01:22.828323+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:21.777981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:21.777981+0000","last_clean_scrub_stamp":"2023-11-28T20:01:21.777981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:18:51.761689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.14","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-11-28T20:01:21.790040+0000","last_change":"2023-11-28T20:01:10.517714+0000","last_active":"2023-11-28T20:01:21.790040+0000","last_peered":"2023-11-28T20:01:21.790040+0000","last_clean":"2023-11-28T20:01:21.790040+0000","last_became_active":"2023-11-28T20:01:10.517414+0000","last_became_peered":"2023-11-28T20:01:10.517414+0000","last_unstale":"2023-11-28T20:01:21.790040+0000","last_undegraded":"2023-11-28T20:01:21.790040+0000","last_fullsized":"2023-11-28T20:01:21.790040+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_clean_scrub_stamp":"2023-11-28T20:01:09.480611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T06:10:19.765319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":14,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-11-28T20:01:21.799883+0000","last_change":"2023-11-28T20:01:09.519465+0000","last_active":"2023-11-28T20:01:21.799883+0000","last_peered":"2023-11-28T20:01:21.799883+0000","last_clean":"2023-11-28T20:01:21.799883+0000","last_became_active":"2023-11-28T20:01:09.519233+0000","last_became_peered":"2023-11-28T20:01:09.519233+0000","last_unstale":"2023-11-28T20:01:21.799883+0000","last_undegraded":"2023-11-28T20:01:21.799883+0000","last_fullsized":"2023-11-28T20:01:21.799883+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:08.474257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:08.474257+0000","last_clean_scrub_stamp":"2023-11-28T20:01:08.474257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T07:34:36.168268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.13","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2023-11-28T20:01:22.809235+0000","last_change":"2023-11-28T20:01:22.809235+0000","last_active":"2023-11-28T20:01:22.787100+0000","last_peered":"2023-11-28T20:01:22.787100+0000","last_clean":"2023-11-28T20:01:22.787100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:01:22.809235+0000","last_undegraded":"2023-11-28T20:01:22.809235+0000","last_fullsized":"2023-11-28T20:01:22.809235+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:22.787100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:22.787100+0000","last_clean_scrub_stamp":"2023-11-28T20:01:22.787100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.14","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-28T20:01:22.821306+0000","last_change":"2023-11-28T20:01:22.818713+0000","last_active":"2023-11-28T20:01:22.821306+0000","last_peered":"2023-11-28T20:01:22.821306+0000","last_clean":"2023-11-28T20:01:22.821306+0000","last_became_active":"2023-11-28T20:01:22.817121+0000","last_became_peered":"2023-11-28T20:01:22.817121+0000","last_unstale":"2023-11-28T20:01:22.821306+0000","last_undegraded":"2023-11-28T20:01:22.821306+0000","last_fullsized":"2023-11-28T20:01:22.821306+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:21.777981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:21.777981+0000","last_clean_scrub_stamp":"2023-11-28T20:01:21.777981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:56:28.292315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.15","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-11-28T20:01:21.797005+0000","last_change":"2023-11-28T20:01:10.533748+0000","last_active":"2023-11-28T20:01:21.797005+0000","last_peered":"2023-11-28T20:01:21.797005+0000","last_clean":"2023-11-28T20:01:21.797005+0000","last_became_active":"2023-11-28T20:01:10.533411+0000","last_became_peered":"2023-11-28T20:01:10.533411+0000","last_unstale":"2023-11-28T20:01:21.797005+0000","last_undegraded":"2023-11-28T20:01:21.797005+0000","last_fullsized":"2023-11-28T20:01:21.797005+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_clean_scrub_stamp":"2023-11-28T20:01:09.480611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:58:23.470366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":14,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-11-28T20:01:21.792925+0000","last_change":"2023-11-28T20:01:09.507203+0000","last_active":"2023-11-28T20:01:21.792925+0000","last_peered":"2023-11-28T20:01:21.792925+0000","last_clean":"2023-11-28T20:01:21.792925+0000","last_became_active":"2023-11-28T20:01:09.506901+0000","last_became_peered":"2023-11-28T20:01:09.506901+0000","last_unstale":"2023-11-28T20:01:21.792925+0000","last_undegraded":"2023-11-28T20:01:21.792925+0000","last_fullsized":"2023-11-28T20:01:21.792925+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:08.474257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:08.474257+0000","last_clean_scrub_stamp":"2023-11-28T20:01:08.474257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:15:27.309843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.10","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2023-11-28T20:01:22.804660+0000","last_change":"2023-11-28T20:01:22.804660+0000","last_active":"2023-11-28T20:01:22.787100+0000","last_peered":"2023-11-28T20:01:22.787100+0000","last_clean":"2023-11-28T20:01:22.787100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:01:22.804660+0000","last_undegraded":"2023-11-28T20:01:22.804660+0000","last_fullsized":"2023-11-28T20:01:22.804660+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:22.787100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:22.787100+0000","last_clean_scrub_stamp":"2023-11-28T20:01:22.787100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.17","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-28T20:01:22.832084+0000","last_change":"2023-11-28T20:01:22.828593+0000","last_active":"2023-11-28T20:01:22.832084+0000","last_peered":"2023-11-28T20:01:22.832084+0000","last_clean":"2023-11-28T20:01:22.832084+0000","last_became_active":"2023-11-28T20:01:22.828323+0000","last_became_peered":"2023-11-28T20:01:22.828323+0000","last_unstale":"2023-11-28T20:01:22.832084+0000","last_undegraded":"2023-11-28T20:01:22.832084+0000","last_fullsized":"2023-11-28T20:01:22.832084+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:21.777981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:21.777981+0000","last_clean_scrub_stamp":"2023-11-28T20:01:21.777981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:58:35.767735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-11-28T20:01:21.801739+0000","last_change":"2023-11-28T20:01:10.537355+0000","last_active":"2023-11-28T20:01:21.801739+0000","last_peered":"2023-11-28T20:01:21.801739+0000","last_clean":"2023-11-28T20:01:21.801739+0000","last_became_active":"2023-11-28T20:01:10.536210+0000","last_became_peered":"2023-11-28T20:01:10.536210+0000","last_unstale":"2023-11-28T20:01:21.801739+0000","last_undegraded":"2023-11-28T20:01:21.801739+0000","last_fullsized":"2023-11-28T20:01:21.801739+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_clean_scrub_stamp":"2023-11-28T20:01:09.480611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T07:05:45.395904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.15","version":"60'3","reported_seq":17,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-11-28T20:01:21.798567+0000","last_change":"2023-11-28T20:01:09.519066+0000","last_active":"2023-11-28T20:01:21.798567+0000","last_peered":"2023-11-28T20:01:21.798567+0000","last_clean":"2023-11-28T20:01:21.798567+0000","last_became_active":"2023-11-28T20:01:09.518151+0000","last_became_peered":"2023-11-28T20:01:09.518151+0000","last_unstale":"2023-11-28T20:01:21.798567+0000","last_undegraded":"2023-11-28T20:01:21.798567+0000","last_fullsized":"2023-11-28T20:01:21.798567+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:08.474257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:08.474257+0000","last_clean_scrub_stamp":"2023-11-28T20:01:08.474257+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:00:29.783639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.11","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2023-11-28T20:01:22.808212+0000","last_change":"2023-11-28T20:01:22.808212+0000","last_active":"2023-11-28T20:01:22.787100+0000","last_peered":"2023-11-28T20:01:22.787100+0000","last_clean":"2023-11-28T20:01:22.787100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:01:22.808212+0000","last_undegraded":"2023-11-28T20:01:22.808212+0000","last_fullsized":"2023-11-28T20:01:22.808212+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:22.787100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:22.787100+0000","last_clean_scrub_stamp":"2023-11-28T20:01:22.787100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-28T20:01:22.823605+0000","last_change":"2023-11-28T20:01:22.819332+0000","last_active":"2023-11-28T20:01:22.823605+0000","last_peered":"2023-11-28T20:01:22.823605+0000","last_clean":"2023-11-28T20:01:22.823605+0000","last_became_active":"2023-11-28T20:01:22.818798+0000","last_became_peered":"2023-11-28T20:01:22.818798+0000","last_unstale":"2023-11-28T20:01:22.823605+0000","last_undegraded":"2023-11-28T20:01:22.823605+0000","last_fullsized":"2023-11-28T20:01:22.823605+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:21.777981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:21.777981+0000","last_clean_scrub_stamp":"2023-11-28T20:01:21.777981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:30:50.602373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.17","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-11-28T20:01:21.791581+0000","last_change":"2023-11-28T20:01:10.521819+0000","last_active":"2023-11-28T20:01:21.791581+0000","last_peered":"2023-11-28T20:01:21.791581+0000","last_clean":"2023-11-28T20:01:21.791581+0000","last_became_active":"2023-11-28T20:01:10.521475+0000","last_became_peered":"2023-11-28T20:01:10.521475+0000","last_unstale":"2023-11-28T20:01:21.791581+0000","last_undegraded":"2023-11-28T20:01:21.791581+0000","last_fullsized":"2023-11-28T20:01:21.791581+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_clean_scrub_stamp":"2023-11-28T20:01:09.480611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:16:30.300658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.14","version":"61'8","reported_seq":22,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-11-28T20:01:21.790211+0000","last_change":"2023-11-28T20:01:09.511176+0000","last_active":"2023-11-28T20:01:21.790211+0000","last_peered":"2023-11-28T20:01:21.790211+0000","last_clean":"2023-11-28T20:01:21.790211+0000","last_became_active":"2023-11-28T20:01:09.510427+0000","last_became_peered":"2023-11-28T20:01:09.510427+0000","last_unstale":"2023-11-28T20:01:21.790211+0000","last_undegraded":"2023-11-28T20:01:21.790211+0000","last_fullsized":"2023-11-28T20:01:21.790211+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:08.474257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:08.474257+0000","last_clean_scrub_stamp":"2023-11-28T20:01:08.474257+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:47:12.268146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3107,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.16","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2023-11-28T20:01:22.802114+0000","last_change":"2023-11-28T20:01:22.802114+0000","last_active":"2023-11-28T20:01:22.787100+0000","last_peered":"2023-11-28T20:01:22.787100+0000","last_clean":"2023-11-28T20:01:22.787100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:01:22.802114+0000","last_undegraded":"2023-11-28T20:01:22.802114+0000","last_fullsized":"2023-11-28T20:01:22.802114+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:22.787100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:22.787100+0000","last_clean_scrub_stamp":"2023-11-28T20:01:22.787100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-28T20:01:22.817286+0000","last_change":"2023-11-28T20:01:22.812353+0000","last_active":"2023-11-28T20:01:22.817286+0000","last_peered":"2023-11-28T20:01:22.817286+0000","last_clean":"2023-11-28T20:01:22.817286+0000","last_became_active":"2023-11-28T20:01:22.812090+0000","last_became_peered":"2023-11-28T20:01:22.812090+0000","last_unstale":"2023-11-28T20:01:22.817286+0000","last_undegraded":"2023-11-28T20:01:22.817286+0000","last_fullsized":"2023-11-28T20:01:22.817286+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:21.777981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:21.777981+0000","last_clean_scrub_stamp":"2023-11-28T20:01:21.777981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:54:32.863267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.10","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-11-28T20:01:21.791194+0000","last_change":"2023-11-28T20:01:10.533224+0000","last_active":"2023-11-28T20:01:21.791194+0000","last_peered":"2023-11-28T20:01:21.791194+0000","last_clean":"2023-11-28T20:01:21.791194+0000","last_became_active":"2023-11-28T20:01:10.532909+0000","last_became_peered":"2023-11-28T20:01:10.532909+0000","last_unstale":"2023-11-28T20:01:21.791194+0000","last_undegraded":"2023-11-28T20:01:21.791194+0000","last_fullsized":"2023-11-28T20:01:21.791194+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_clean_scrub_stamp":"2023-11-28T20:01:09.480611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:32:06.877460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.13","version":"60'2","reported_seq":16,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-11-28T20:01:21.798151+0000","last_change":"2023-11-28T20:01:09.518379+0000","last_active":"2023-11-28T20:01:21.798151+0000","last_peered":"2023-11-28T20:01:21.798151+0000","last_clean":"2023-11-28T20:01:21.798151+0000","last_became_active":"2023-11-28T20:01:09.518073+0000","last_became_peered":"2023-11-28T20:01:09.518073+0000","last_unstale":"2023-11-28T20:01:21.798151+0000","last_undegraded":"2023-11-28T20:01:21.798151+0000","last_fullsized":"2023-11-28T20:01:21.798151+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:08.474257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:08.474257+0000","last_clean_scrub_stamp":"2023-11-28T20:01:08.474257+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:11:07.788160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.17","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2023-11-28T20:01:22.807329+0000","last_change":"2023-11-28T20:01:22.807329+0000","last_active":"2023-11-28T20:01:22.787100+0000","last_peered":"2023-11-28T20:01:22.787100+0000","last_clean":"2023-11-28T20:01:22.787100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:01:22.807329+0000","last_undegraded":"2023-11-28T20:01:22.807329+0000","last_fullsized":"2023-11-28T20:01:22.807329+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:22.787100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:22.787100+0000","last_clean_scrub_stamp":"2023-11-28T20:01:22.787100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.10","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-28T20:01:22.821250+0000","last_change":"2023-11-28T20:01:22.818135+0000","last_active":"2023-11-28T20:01:22.821250+0000","last_peered":"2023-11-28T20:01:22.821250+0000","last_clean":"2023-11-28T20:01:22.821250+0000","last_became_active":"2023-11-28T20:01:22.817952+0000","last_became_peered":"2023-11-28T20:01:22.817952+0000","last_unstale":"2023-11-28T20:01:22.821250+0000","last_undegraded":"2023-11-28T20:01:22.821250+0000","last_fullsized":"2023-11-28T20:01:22.821250+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:21.777981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:21.777981+0000","last_clean_scrub_stamp":"2023-11-28T20:01:21.777981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:10:42.691065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-11-28T20:01:21.793268+0000","last_change":"2023-11-28T20:01:10.520948+0000","last_active":"2023-11-28T20:01:21.793268+0000","last_peered":"2023-11-28T20:01:21.793268+0000","last_clean":"2023-11-28T20:01:21.793268+0000","last_became_active":"2023-11-28T20:01:10.520649+0000","last_became_peered":"2023-11-28T20:01:10.520649+0000","last_unstale":"2023-11-28T20:01:21.793268+0000","last_undegraded":"2023-11-28T20:01:21.793268+0000","last_fullsized":"2023-11-28T20:01:21.793268+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_clean_scrub_stamp":"2023-11-28T20:01:09.480611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:10:34.830531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":14,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-11-28T20:01:21.793840+0000","last_change":"2023-11-28T20:01:09.510604+0000","last_active":"2023-11-28T20:01:21.793840+0000","last_peered":"2023-11-28T20:01:21.793840+0000","last_clean":"2023-11-28T20:01:21.793840+0000","last_became_active":"2023-11-28T20:01:09.510326+0000","last_became_peered":"2023-11-28T20:01:09.510326+0000","last_unstale":"2023-11-28T20:01:21.793840+0000","last_undegraded":"2023-11-28T20:01:21.793840+0000","last_fullsized":"2023-11-28T20:01:21.793840+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:08.474257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:08.474257+0000","last_clean_scrub_stamp":"2023-11-28T20:01:08.474257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:56:14.988591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.14","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2023-11-28T20:01:22.809339+0000","last_change":"2023-11-28T20:01:22.809339+0000","last_active":"2023-11-28T20:01:22.787100+0000","last_peered":"2023-11-28T20:01:22.787100+0000","last_clean":"2023-11-28T20:01:22.787100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:01:22.809339+0000","last_undegraded":"2023-11-28T20:01:22.809339+0000","last_fullsized":"2023-11-28T20:01:22.809339+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:22.787100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:22.787100+0000","last_clean_scrub_stamp":"2023-11-28T20:01:22.787100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.13","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-28T20:01:22.823674+0000","last_change":"2023-11-28T20:01:22.820361+0000","last_active":"2023-11-28T20:01:22.823674+0000","last_peered":"2023-11-28T20:01:22.823674+0000","last_clean":"2023-11-28T20:01:22.823674+0000","last_became_active":"2023-11-28T20:01:22.820048+0000","last_became_peered":"2023-11-28T20:01:22.820048+0000","last_unstale":"2023-11-28T20:01:22.823674+0000","last_undegraded":"2023-11-28T20:01:22.823674+0000","last_fullsized":"2023-11-28T20:01:22.823674+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:21.777981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:21.777981+0000","last_clean_scrub_stamp":"2023-11-28T20:01:21.777981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:59:20.866094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-11-28T20:01:21.801157+0000","last_change":"2023-11-28T20:01:10.527110+0000","last_active":"2023-11-28T20:01:21.801157+0000","last_peered":"2023-11-28T20:01:21.801157+0000","last_clean":"2023-11-28T20:01:21.801157+0000","last_became_active":"2023-11-28T20:01:10.525827+0000","last_became_peered":"2023-11-28T20:01:10.525827+0000","last_unstale":"2023-11-28T20:01:21.801157+0000","last_undegraded":"2023-11-28T20:01:21.801157+0000","last_fullsized":"2023-11-28T20:01:21.801157+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_clean_scrub_stamp":"2023-11-28T20:01:09.480611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:23:02.818476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":14,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-11-28T20:01:21.798244+0000","last_change":"2023-11-28T20:01:09.519626+0000","last_active":"2023-11-28T20:01:21.798244+0000","last_peered":"2023-11-28T20:01:21.798244+0000","last_clean":"2023-11-28T20:01:21.798244+0000","last_became_active":"2023-11-28T20:01:09.519349+0000","last_became_peered":"2023-11-28T20:01:09.519349+0000","last_unstale":"2023-11-28T20:01:21.798244+0000","last_undegraded":"2023-11-28T20:01:21.798244+0000","last_fullsized":"2023-11-28T20:01:21.798244+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:08.474257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:08.474257+0000","last_clean_scrub_stamp":"2023-11-28T20:01:08.474257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:04:51.492194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.15","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2023-11-28T20:01:22.803505+0000","last_change":"2023-11-28T20:01:22.803505+0000","last_active":"2023-11-28T20:01:22.787100+0000","last_peered":"2023-11-28T20:01:22.787100+0000","last_clean":"2023-11-28T20:01:22.787100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:01:22.803505+0000","last_undegraded":"2023-11-28T20:01:22.803505+0000","last_fullsized":"2023-11-28T20:01:22.803505+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:22.787100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:22.787100+0000","last_clean_scrub_stamp":"2023-11-28T20:01:22.787100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.12","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-28T20:01:22.829149+0000","last_change":"2023-11-28T20:01:22.826285+0000","last_active":"2023-11-28T20:01:22.829149+0000","last_peered":"2023-11-28T20:01:22.829149+0000","last_clean":"2023-11-28T20:01:22.829149+0000","last_became_active":"2023-11-28T20:01:22.825975+0000","last_became_peered":"2023-11-28T20:01:22.825975+0000","last_unstale":"2023-11-28T20:01:22.829149+0000","last_undegraded":"2023-11-28T20:01:22.829149+0000","last_fullsized":"2023-11-28T20:01:22.829149+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:21.777981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:21.777981+0000","last_clean_scrub_stamp":"2023-11-28T20:01:21.777981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:10:42.691065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.13","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-11-28T20:01:21.790303+0000","last_change":"2023-11-28T20:01:10.535178+0000","last_active":"2023-11-28T20:01:21.790303+0000","last_peered":"2023-11-28T20:01:21.790303+0000","last_clean":"2023-11-28T20:01:21.790303+0000","last_became_active":"2023-11-28T20:01:10.534880+0000","last_became_peered":"2023-11-28T20:01:10.534880+0000","last_unstale":"2023-11-28T20:01:21.790303+0000","last_undegraded":"2023-11-28T20:01:21.790303+0000","last_fullsized":"2023-11-28T20:01:21.790303+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_clean_scrub_stamp":"2023-11-28T20:01:09.480611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:52:42.741966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.10","version":"60'8","reported_seq":22,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-11-28T20:01:21.791303+0000","last_change":"2023-11-28T20:01:09.511628+0000","last_active":"2023-11-28T20:01:21.791303+0000","last_peered":"2023-11-28T20:01:21.791303+0000","last_clean":"2023-11-28T20:01:21.791303+0000","last_became_active":"2023-11-28T20:01:09.511250+0000","last_became_peered":"2023-11-28T20:01:09.511250+0000","last_unstale":"2023-11-28T20:01:21.791303+0000","last_undegraded":"2023-11-28T20:01:21.791303+0000","last_fullsized":"2023-11-28T20:01:21.791303+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:08.474257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:08.474257+0000","last_clean_scrub_stamp":"2023-11-28T20:01:08.474257+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:35:34.107408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.a","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2023-11-28T20:01:22.799813+0000","last_change":"2023-11-28T20:01:22.799813+0000","last_active":"2023-11-28T20:01:22.787100+0000","last_peered":"2023-11-28T20:01:22.787100+0000","last_clean":"2023-11-28T20:01:22.787100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:01:22.799813+0000","last_undegraded":"2023-11-28T20:01:22.799813+0000","last_fullsized":"2023-11-28T20:01:22.799813+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:22.787100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:22.787100+0000","last_clean_scrub_stamp":"2023-11-28T20:01:22.787100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.d","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-28T20:01:22.824984+0000","last_change":"2023-11-28T20:01:22.818834+0000","last_active":"2023-11-28T20:01:22.824984+0000","last_peered":"2023-11-28T20:01:22.824984+0000","last_clean":"2023-11-28T20:01:22.824984+0000","last_became_active":"2023-11-28T20:01:22.818391+0000","last_became_peered":"2023-11-28T20:01:22.818391+0000","last_unstale":"2023-11-28T20:01:22.824984+0000","last_undegraded":"2023-11-28T20:01:22.824984+0000","last_fullsized":"2023-11-28T20:01:22.824984+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:21.777981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:21.777981+0000","last_clean_scrub_stamp":"2023-11-28T20:01:21.777981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:33:58.134275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-11-28T20:01:21.798469+0000","last_change":"2023-11-28T20:01:10.537164+0000","last_active":"2023-11-28T20:01:21.798469+0000","last_peered":"2023-11-28T20:01:21.798469+0000","last_clean":"2023-11-28T20:01:21.798469+0000","last_became_active":"2023-11-28T20:01:10.536893+0000","last_became_peered":"2023-11-28T20:01:10.536893+0000","last_unstale":"2023-11-28T20:01:21.798469+0000","last_undegraded":"2023-11-28T20:01:21.798469+0000","last_fullsized":"2023-11-28T20:01:21.798469+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_clean_scrub_stamp":"2023-11-28T20:01:09.480611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:50:58.589965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.f","version":"60'1","reported_seq":15,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-11-28T20:01:21.794381+0000","last_change":"2023-11-28T20:01:09.510018+0000","last_active":"2023-11-28T20:01:21.794381+0000","last_peered":"2023-11-28T20:01:21.794381+0000","last_clean":"2023-11-28T20:01:21.794381+0000","last_became_active":"2023-11-28T20:01:09.509743+0000","last_became_peered":"2023-11-28T20:01:09.509743+0000","last_unstale":"2023-11-28T20:01:21.794381+0000","last_undegraded":"2023-11-28T20:01:21.794381+0000","last_fullsized":"2023-11-28T20:01:21.794381+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:08.474257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:08.474257+0000","last_clean_scrub_stamp":"2023-11-28T20:01:08.474257+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:09:59.028591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.b","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2023-11-28T20:01:22.801666+0000","last_change":"2023-11-28T20:01:22.801666+0000","last_active":"2023-11-28T20:01:22.787100+0000","last_peered":"2023-11-28T20:01:22.787100+0000","last_clean":"2023-11-28T20:01:22.787100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:01:22.801666+0000","last_undegraded":"2023-11-28T20:01:22.801666+0000","last_fullsized":"2023-11-28T20:01:22.801666+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:22.787100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:22.787100+0000","last_clean_scrub_stamp":"2023-11-28T20:01:22.787100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-28T20:01:22.824090+0000","last_change":"2023-11-28T20:01:22.817493+0000","last_active":"2023-11-28T20:01:22.824090+0000","last_peered":"2023-11-28T20:01:22.824090+0000","last_clean":"2023-11-28T20:01:22.824090+0000","last_became_active":"2023-11-28T20:01:22.817204+0000","last_became_peered":"2023-11-28T20:01:22.817204+0000","last_unstale":"2023-11-28T20:01:22.824090+0000","last_undegraded":"2023-11-28T20:01:22.824090+0000","last_fullsized":"2023-11-28T20:01:22.824090+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:21.777981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:21.777981+0000","last_clean_scrub_stamp":"2023-11-28T20:01:21.777981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:21:33.492950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.d","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-11-28T20:01:21.801679+0000","last_change":"2023-11-28T20:01:10.537543+0000","last_active":"2023-11-28T20:01:21.801679+0000","last_peered":"2023-11-28T20:01:21.801679+0000","last_clean":"2023-11-28T20:01:21.801679+0000","last_became_active":"2023-11-28T20:01:10.537307+0000","last_became_peered":"2023-11-28T20:01:10.537307+0000","last_unstale":"2023-11-28T20:01:21.801679+0000","last_undegraded":"2023-11-28T20:01:21.801679+0000","last_fullsized":"2023-11-28T20:01:21.801679+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_clean_scrub_stamp":"2023-11-28T20:01:09.480611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:04:52.498548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.e","version":"60'2","reported_seq":16,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-11-28T20:01:21.800005+0000","last_change":"2023-11-28T20:01:09.519130+0000","last_active":"2023-11-28T20:01:21.800005+0000","last_peered":"2023-11-28T20:01:21.800005+0000","last_clean":"2023-11-28T20:01:21.800005+0000","last_became_active":"2023-11-28T20:01:09.517725+0000","last_became_peered":"2023-11-28T20:01:09.517725+0000","last_unstale":"2023-11-28T20:01:21.800005+0000","last_undegraded":"2023-11-28T20:01:21.800005+0000","last_fullsized":"2023-11-28T20:01:21.800005+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:08.474257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:08.474257+0000","last_clean_scrub_stamp":"2023-11-28T20:01:08.474257+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:05:31.573692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.8","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2023-11-28T20:01:22.801498+0000","last_change":"2023-11-28T20:01:22.801498+0000","last_active":"2023-11-28T20:01:22.787100+0000","last_peered":"2023-11-28T20:01:22.787100+0000","last_clean":"2023-11-28T20:01:22.787100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:01:22.801498+0000","last_undegraded":"2023-11-28T20:01:22.801498+0000","last_fullsized":"2023-11-28T20:01:22.801498+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:22.787100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:22.787100+0000","last_clean_scrub_stamp":"2023-11-28T20:01:22.787100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.f","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-28T20:01:22.832619+0000","last_change":"2023-11-28T20:01:22.830040+0000","last_active":"2023-11-28T20:01:22.832619+0000","last_peered":"2023-11-28T20:01:22.832619+0000","last_clean":"2023-11-28T20:01:22.832619+0000","last_became_active":"2023-11-28T20:01:22.829736+0000","last_became_peered":"2023-11-28T20:01:22.829736+0000","last_unstale":"2023-11-28T20:01:22.832619+0000","last_undegraded":"2023-11-28T20:01:22.832619+0000","last_fullsized":"2023-11-28T20:01:22.832619+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:21.777981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:21.777981+0000","last_clean_scrub_stamp":"2023-11-28T20:01:21.777981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:02:18.785671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.e","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-11-28T20:01:21.792843+0000","last_change":"2023-11-28T20:01:10.530449+0000","last_active":"2023-11-28T20:01:21.792843+0000","last_peered":"2023-11-28T20:01:21.792843+0000","last_clean":"2023-11-28T20:01:21.792843+0000","last_became_active":"2023-11-28T20:01:10.530169+0000","last_became_peered":"2023-11-28T20:01:10.530169+0000","last_unstale":"2023-11-28T20:01:21.792843+0000","last_undegraded":"2023-11-28T20:01:21.792843+0000","last_fullsized":"2023-11-28T20:01:21.792843+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_clean_scrub_stamp":"2023-11-28T20:01:09.480611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:01:36.330362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.d","version":"60'1","reported_seq":15,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-11-28T20:01:21.798612+0000","last_change":"2023-11-28T20:01:09.519252+0000","last_active":"2023-11-28T20:01:21.798612+0000","last_peered":"2023-11-28T20:01:21.798612+0000","last_clean":"2023-11-28T20:01:21.798612+0000","last_became_active":"2023-11-28T20:01:09.518511+0000","last_became_peered":"2023-11-28T20:01:09.518511+0000","last_unstale":"2023-11-28T20:01:21.798612+0000","last_undegraded":"2023-11-28T20:01:21.798612+0000","last_fullsized":"2023-11-28T20:01:21.798612+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:08.474257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:08.474257+0000","last_clean_scrub_stamp":"2023-11-28T20:01:08.474257+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:52:41.735612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.9","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2023-11-28T20:01:22.799812+0000","last_change":"2023-11-28T20:01:22.799812+0000","last_active":"2023-11-28T20:01:22.787100+0000","last_peered":"2023-11-28T20:01:22.787100+0000","last_clean":"2023-11-28T20:01:22.787100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:01:22.799812+0000","last_undegraded":"2023-11-28T20:01:22.799812+0000","last_fullsized":"2023-11-28T20:01:22.799812+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:22.787100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:22.787100+0000","last_clean_scrub_stamp":"2023-11-28T20:01:22.787100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.e","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-28T20:01:22.823606+0000","last_change":"2023-11-28T20:01:22.819046+0000","last_active":"2023-11-28T20:01:22.823606+0000","last_peered":"2023-11-28T20:01:22.823606+0000","last_clean":"2023-11-28T20:01:22.823606+0000","last_became_active":"2023-11-28T20:01:22.818775+0000","last_became_peered":"2023-11-28T20:01:22.818775+0000","last_unstale":"2023-11-28T20:01:22.823606+0000","last_undegraded":"2023-11-28T20:01:22.823606+0000","last_fullsized":"2023-11-28T20:01:22.823606+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:21.777981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:21.777981+0000","last_clean_scrub_stamp":"2023-11-28T20:01:21.777981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:37:29.813667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.f","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-11-28T20:01:21.801782+0000","last_change":"2023-11-28T20:01:10.523973+0000","last_active":"2023-11-28T20:01:21.801782+0000","last_peered":"2023-11-28T20:01:21.801782+0000","last_clean":"2023-11-28T20:01:21.801782+0000","last_became_active":"2023-11-28T20:01:10.523676+0000","last_became_peered":"2023-11-28T20:01:10.523676+0000","last_unstale":"2023-11-28T20:01:21.801782+0000","last_undegraded":"2023-11-28T20:01:21.801782+0000","last_fullsized":"2023-11-28T20:01:21.801782+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_clean_scrub_stamp":"2023-11-28T20:01:09.480611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:49:36.861168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":14,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-11-28T20:01:21.797278+0000","last_change":"2023-11-28T20:01:09.514931+0000","last_active":"2023-11-28T20:01:21.797278+0000","last_peered":"2023-11-28T20:01:21.797278+0000","last_clean":"2023-11-28T20:01:21.797278+0000","last_became_active":"2023-11-28T20:01:09.514702+0000","last_became_peered":"2023-11-28T20:01:09.514702+0000","last_unstale":"2023-11-28T20:01:21.797278+0000","last_undegraded":"2023-11-28T20:01:21.797278+0000","last_fullsized":"2023-11-28T20:01:21.797278+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:08.474257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:08.474257+0000","last_clean_scrub_stamp":"2023-11-28T20:01:08.474257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:30:37.298649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.e","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2023-11-28T20:01:22.808106+0000","last_change":"2023-11-28T20:01:22.808106+0000","last_active":"2023-11-28T20:01:22.787100+0000","last_peered":"2023-11-28T20:01:22.787100+0000","last_clean":"2023-11-28T20:01:22.787100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:01:22.808106+0000","last_undegraded":"2023-11-28T20:01:22.808106+0000","last_fullsized":"2023-11-28T20:01:22.808106+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:22.787100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:22.787100+0000","last_clean_scrub_stamp":"2023-11-28T20:01:22.787100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.9","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-28T20:01:22.821131+0000","last_change":"2023-11-28T20:01:22.816218+0000","last_active":"2023-11-28T20:01:22.821131+0000","last_peered":"2023-11-28T20:01:22.821131+0000","last_clean":"2023-11-28T20:01:22.821131+0000","last_became_active":"2023-11-28T20:01:22.815903+0000","last_became_peered":"2023-11-28T20:01:22.815903+0000","last_unstale":"2023-11-28T20:01:22.821131+0000","last_undegraded":"2023-11-28T20:01:22.821131+0000","last_fullsized":"2023-11-28T20:01:22.821131+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:21.777981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:21.777981+0000","last_clean_scrub_stamp":"2023-11-28T20:01:21.777981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:19:20.241462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-11-28T20:01:21.800738+0000","last_change":"2023-11-28T20:01:10.525003+0000","last_active":"2023-11-28T20:01:21.800738+0000","last_peered":"2023-11-28T20:01:21.800738+0000","last_clean":"2023-11-28T20:01:21.800738+0000","last_became_active":"2023-11-28T20:01:10.524411+0000","last_became_peered":"2023-11-28T20:01:10.524411+0000","last_unstale":"2023-11-28T20:01:21.800738+0000","last_undegraded":"2023-11-28T20:01:21.800738+0000","last_fullsized":"2023-11-28T20:01:21.800738+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_clean_scrub_stamp":"2023-11-28T20:01:09.480611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:17:27.097887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.b","version":"60'2","reported_seq":16,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-11-28T20:01:21.801281+0000","last_change":"2023-11-28T20:01:09.511026+0000","last_active":"2023-11-28T20:01:21.801281+0000","last_peered":"2023-11-28T20:01:21.801281+0000","last_clean":"2023-11-28T20:01:21.801281+0000","last_became_active":"2023-11-28T20:01:09.510765+0000","last_became_peered":"2023-11-28T20:01:09.510765+0000","last_unstale":"2023-11-28T20:01:21.801281+0000","last_undegraded":"2023-11-28T20:01:21.801281+0000","last_fullsized":"2023-11-28T20:01:21.801281+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:08.474257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:08.474257+0000","last_clean_scrub_stamp":"2023-11-28T20:01:08.474257+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:06:35.988462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.f","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2023-11-28T20:01:22.804656+0000","last_change":"2023-11-28T20:01:22.804656+0000","last_active":"2023-11-28T20:01:22.787100+0000","last_peered":"2023-11-28T20:01:22.787100+0000","last_clean":"2023-11-28T20:01:22.787100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:01:22.804656+0000","last_undegraded":"2023-11-28T20:01:22.804656+0000","last_fullsized":"2023-11-28T20:01:22.804656+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:22.787100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:22.787100+0000","last_clean_scrub_stamp":"2023-11-28T20:01:22.787100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-28T20:01:22.821031+0000","last_change":"2023-11-28T20:01:22.818671+0000","last_active":"2023-11-28T20:01:22.821031+0000","last_peered":"2023-11-28T20:01:22.821031+0000","last_clean":"2023-11-28T20:01:22.821031+0000","last_became_active":"2023-11-28T20:01:22.818413+0000","last_became_peered":"2023-11-28T20:01:22.818413+0000","last_unstale":"2023-11-28T20:01:22.821031+0000","last_undegraded":"2023-11-28T20:01:22.821031+0000","last_fullsized":"2023-11-28T20:01:22.821031+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:21.777981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:21.777981+0000","last_clean_scrub_stamp":"2023-11-28T20:01:21.777981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:39:31.956432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-11-28T20:01:21.793361+0000","last_change":"2023-11-28T20:01:10.523842+0000","last_active":"2023-11-28T20:01:21.793361+0000","last_peered":"2023-11-28T20:01:21.793361+0000","last_clean":"2023-11-28T20:01:21.793361+0000","last_became_active":"2023-11-28T20:01:10.523553+0000","last_became_peered":"2023-11-28T20:01:10.523553+0000","last_unstale":"2023-11-28T20:01:21.793361+0000","last_undegraded":"2023-11-28T20:01:21.793361+0000","last_fullsized":"2023-11-28T20:01:21.793361+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_clean_scrub_stamp":"2023-11-28T20:01:09.480611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T07:34:37.174623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":14,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-11-28T20:01:21.793934+0000","last_change":"2023-11-28T20:01:09.510719+0000","last_active":"2023-11-28T20:01:21.793934+0000","last_peered":"2023-11-28T20:01:21.793934+0000","last_clean":"2023-11-28T20:01:21.793934+0000","last_became_active":"2023-11-28T20:01:09.509874+0000","last_became_peered":"2023-11-28T20:01:09.509874+0000","last_unstale":"2023-11-28T20:01:21.793934+0000","last_undegraded":"2023-11-28T20:01:21.793934+0000","last_fullsized":"2023-11-28T20:01:21.793934+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:08.474257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:08.474257+0000","last_clean_scrub_stamp":"2023-11-28T20:01:08.474257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:21:20.189227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.c","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2023-11-28T20:01:22.804042+0000","last_change":"2023-11-28T20:01:22.804042+0000","last_active":"2023-11-28T20:01:22.787100+0000","last_peered":"2023-11-28T20:01:22.787100+0000","last_clean":"2023-11-28T20:01:22.787100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:01:22.804042+0000","last_undegraded":"2023-11-28T20:01:22.804042+0000","last_fullsized":"2023-11-28T20:01:22.804042+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:22.787100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:22.787100+0000","last_clean_scrub_stamp":"2023-11-28T20:01:22.787100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.b","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-28T20:01:22.825956+0000","last_change":"2023-11-28T20:01:22.821826+0000","last_active":"2023-11-28T20:01:22.825956+0000","last_peered":"2023-11-28T20:01:22.825956+0000","last_clean":"2023-11-28T20:01:22.825956+0000","last_became_active":"2023-11-28T20:01:22.821548+0000","last_became_peered":"2023-11-28T20:01:22.821548+0000","last_unstale":"2023-11-28T20:01:22.825956+0000","last_undegraded":"2023-11-28T20:01:22.825956+0000","last_fullsized":"2023-11-28T20:01:22.825956+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:21.777981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:21.777981+0000","last_clean_scrub_stamp":"2023-11-28T20:01:21.777981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:25:07.192596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-11-28T20:01:21.801265+0000","last_change":"2023-11-28T20:01:10.530042+0000","last_active":"2023-11-28T20:01:21.801265+0000","last_peered":"2023-11-28T20:01:21.801265+0000","last_clean":"2023-11-28T20:01:21.801265+0000","last_became_active":"2023-11-28T20:01:10.529745+0000","last_became_peered":"2023-11-28T20:01:10.529745+0000","last_unstale":"2023-11-28T20:01:21.801265+0000","last_undegraded":"2023-11-28T20:01:21.801265+0000","last_fullsized":"2023-11-28T20:01:21.801265+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_clean_scrub_stamp":"2023-11-28T20:01:09.480611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:18:17.108795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":14,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-11-28T20:01:21.800931+0000","last_change":"2023-11-28T20:01:09.512327+0000","last_active":"2023-11-28T20:01:21.800931+0000","last_peered":"2023-11-28T20:01:21.800931+0000","last_clean":"2023-11-28T20:01:21.800931+0000","last_became_active":"2023-11-28T20:01:09.512065+0000","last_became_peered":"2023-11-28T20:01:09.512065+0000","last_unstale":"2023-11-28T20:01:21.800931+0000","last_undegraded":"2023-11-28T20:01:21.800931+0000","last_fullsized":"2023-11-28T20:01:21.800931+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:08.474257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:08.474257+0000","last_clean_scrub_stamp":"2023-11-28T20:01:08.474257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:46:28.694684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.2","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2023-11-28T20:01:22.804217+0000","last_change":"2023-11-28T20:01:22.804217+0000","last_active":"2023-11-28T20:01:22.787100+0000","last_peered":"2023-11-28T20:01:22.787100+0000","last_clean":"2023-11-28T20:01:22.787100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:01:22.804217+0000","last_undegraded":"2023-11-28T20:01:22.804217+0000","last_fullsized":"2023-11-28T20:01:22.804217+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:22.787100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:22.787100+0000","last_clean_scrub_stamp":"2023-11-28T20:01:22.787100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.5","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-28T20:01:22.832081+0000","last_change":"2023-11-28T20:01:22.828000+0000","last_active":"2023-11-28T20:01:22.832081+0000","last_peered":"2023-11-28T20:01:22.832081+0000","last_clean":"2023-11-28T20:01:22.832081+0000","last_became_active":"2023-11-28T20:01:22.827704+0000","last_became_peered":"2023-11-28T20:01:22.827704+0000","last_unstale":"2023-11-28T20:01:22.832081+0000","last_undegraded":"2023-11-28T20:01:22.832081+0000","last_fullsized":"2023-11-28T20:01:22.832081+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:21.777981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:21.777981+0000","last_clean_scrub_stamp":"2023-11-28T20:01:21.777981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:52:43.940237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-11-28T20:01:21.801313+0000","last_change":"2023-11-28T20:01:10.526165+0000","last_active":"2023-11-28T20:01:21.801313+0000","last_peered":"2023-11-28T20:01:21.801313+0000","last_clean":"2023-11-28T20:01:21.801313+0000","last_became_active":"2023-11-28T20:01:10.525619+0000","last_became_peered":"2023-11-28T20:01:10.525619+0000","last_unstale":"2023-11-28T20:01:21.801313+0000","last_undegraded":"2023-11-28T20:01:21.801313+0000","last_fullsized":"2023-11-28T20:01:21.801313+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_clean_scrub_stamp":"2023-11-28T20:01:09.480611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:54:30.269337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.7","version":"60'2","reported_seq":16,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-11-28T20:01:21.794510+0000","last_change":"2023-11-28T20:01:09.514831+0000","last_active":"2023-11-28T20:01:21.794510+0000","last_peered":"2023-11-28T20:01:21.794510+0000","last_clean":"2023-11-28T20:01:21.794510+0000","last_became_active":"2023-11-28T20:01:09.514525+0000","last_became_peered":"2023-11-28T20:01:09.514525+0000","last_unstale":"2023-11-28T20:01:21.794510+0000","last_undegraded":"2023-11-28T20:01:21.794510+0000","last_fullsized":"2023-11-28T20:01:21.794510+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:08.474257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:08.474257+0000","last_clean_scrub_stamp":"2023-11-28T20:01:08.474257+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:05:31.573692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.3","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2023-11-28T20:01:22.804042+0000","last_change":"2023-11-28T20:01:22.804042+0000","last_active":"2023-11-28T20:01:22.787100+0000","last_peered":"2023-11-28T20:01:22.787100+0000","last_clean":"2023-11-28T20:01:22.787100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:01:22.804042+0000","last_undegraded":"2023-11-28T20:01:22.804042+0000","last_fullsized":"2023-11-28T20:01:22.804042+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:22.787100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:22.787100+0000","last_clean_scrub_stamp":"2023-11-28T20:01:22.787100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-28T20:01:22.832028+0000","last_change":"2023-11-28T20:01:22.827963+0000","last_active":"2023-11-28T20:01:22.832028+0000","last_peered":"2023-11-28T20:01:22.832028+0000","last_clean":"2023-11-28T20:01:22.832028+0000","last_became_active":"2023-11-28T20:01:22.827652+0000","last_became_peered":"2023-11-28T20:01:22.827652+0000","last_unstale":"2023-11-28T20:01:22.832028+0000","last_undegraded":"2023-11-28T20:01:22.832028+0000","last_fullsized":"2023-11-28T20:01:22.832028+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:21.777981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:21.777981+0000","last_clean_scrub_stamp":"2023-11-28T20:01:21.777981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:59:20.866094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-11-28T20:01:21.797523+0000","last_change":"2023-11-28T20:01:10.533050+0000","last_active":"2023-11-28T20:01:21.797523+0000","last_peered":"2023-11-28T20:01:21.797523+0000","last_clean":"2023-11-28T20:01:21.797523+0000","last_became_active":"2023-11-28T20:01:10.532590+0000","last_became_peered":"2023-11-28T20:01:10.532590+0000","last_unstale":"2023-11-28T20:01:21.797523+0000","last_undegraded":"2023-11-28T20:01:21.797523+0000","last_fullsized":"2023-11-28T20:01:21.797523+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_clean_scrub_stamp":"2023-11-28T20:01:09.480611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T07:29:30.339936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.6","version":"61'1","reported_seq":15,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-11-28T20:01:21.794444+0000","last_change":"2023-11-28T20:01:09.510397+0000","last_active":"2023-11-28T20:01:21.794444+0000","last_peered":"2023-11-28T20:01:21.794444+0000","last_clean":"2023-11-28T20:01:21.794444+0000","last_became_active":"2023-11-28T20:01:09.510136+0000","last_became_peered":"2023-11-28T20:01:09.510136+0000","last_unstale":"2023-11-28T20:01:21.794444+0000","last_undegraded":"2023-11-28T20:01:21.794444+0000","last_fullsized":"2023-11-28T20:01:21.794444+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:08.474257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:08.474257+0000","last_clean_scrub_stamp":"2023-11-28T20:01:08.474257+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:18:48.620687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.0","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2023-11-28T20:01:22.801672+0000","last_change":"2023-11-28T20:01:22.801672+0000","last_active":"2023-11-28T20:01:22.787100+0000","last_peered":"2023-11-28T20:01:22.787100+0000","last_clean":"2023-11-28T20:01:22.787100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:01:22.801672+0000","last_undegraded":"2023-11-28T20:01:22.801672+0000","last_fullsized":"2023-11-28T20:01:22.801672+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:22.787100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:22.787100+0000","last_clean_scrub_stamp":"2023-11-28T20:01:22.787100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.7","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-28T20:01:22.829667+0000","last_change":"2023-11-28T20:01:22.825335+0000","last_active":"2023-11-28T20:01:22.829667+0000","last_peered":"2023-11-28T20:01:22.829667+0000","last_clean":"2023-11-28T20:01:22.829667+0000","last_became_active":"2023-11-28T20:01:22.825033+0000","last_became_peered":"2023-11-28T20:01:22.825033+0000","last_unstale":"2023-11-28T20:01:22.829667+0000","last_undegraded":"2023-11-28T20:01:22.829667+0000","last_fullsized":"2023-11-28T20:01:22.829667+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:21.777981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:21.777981+0000","last_clean_scrub_stamp":"2023-11-28T20:01:21.777981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:10:42.691065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.6","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-11-28T20:01:21.794329+0000","last_change":"2023-11-28T20:01:10.530096+0000","last_active":"2023-11-28T20:01:21.794329+0000","last_peered":"2023-11-28T20:01:21.794329+0000","last_clean":"2023-11-28T20:01:21.794329+0000","last_became_active":"2023-11-28T20:01:10.529472+0000","last_became_peered":"2023-11-28T20:01:10.529472+0000","last_unstale":"2023-11-28T20:01:21.794329+0000","last_undegraded":"2023-11-28T20:01:21.794329+0000","last_fullsized":"2023-11-28T20:01:21.794329+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_clean_scrub_stamp":"2023-11-28T20:01:09.480611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T06:29:13.579326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":14,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-11-28T20:01:21.801672+0000","last_change":"2023-11-28T20:01:09.509983+0000","last_active":"2023-11-28T20:01:21.801672+0000","last_peered":"2023-11-28T20:01:21.801672+0000","last_clean":"2023-11-28T20:01:21.801672+0000","last_became_active":"2023-11-28T20:01:09.509675+0000","last_became_peered":"2023-11-28T20:01:09.509675+0000","last_unstale":"2023-11-28T20:01:21.801672+0000","last_undegraded":"2023-11-28T20:01:21.801672+0000","last_fullsized":"2023-11-28T20:01:21.801672+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:08.474257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:08.474257+0000","last_clean_scrub_stamp":"2023-11-28T20:01:08.474257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:21:20.189227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.1","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2023-11-28T20:01:22.802259+0000","last_change":"2023-11-28T20:01:22.802259+0000","last_active":"2023-11-28T20:01:22.787100+0000","last_peered":"2023-11-28T20:01:22.787100+0000","last_clean":"2023-11-28T20:01:22.787100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:01:22.802259+0000","last_undegraded":"2023-11-28T20:01:22.802259+0000","last_fullsized":"2023-11-28T20:01:22.802259+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:22.787100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:22.787100+0000","last_clean_scrub_stamp":"2023-11-28T20:01:22.787100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.6","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-28T20:01:22.821209+0000","last_change":"2023-11-28T20:01:22.817836+0000","last_active":"2023-11-28T20:01:22.821209+0000","last_peered":"2023-11-28T20:01:22.821209+0000","last_clean":"2023-11-28T20:01:22.821209+0000","last_became_active":"2023-11-28T20:01:22.817473+0000","last_became_peered":"2023-11-28T20:01:22.817473+0000","last_unstale":"2023-11-28T20:01:22.821209+0000","last_undegraded":"2023-11-28T20:01:22.821209+0000","last_fullsized":"2023-11-28T20:01:22.821209+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:21.777981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:21.777981+0000","last_clean_scrub_stamp":"2023-11-28T20:01:21.777981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:52:43.940237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.7","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-11-28T20:01:21.801808+0000","last_change":"2023-11-28T20:01:10.535856+0000","last_active":"2023-11-28T20:01:21.801808+0000","last_peered":"2023-11-28T20:01:21.801808+0000","last_clean":"2023-11-28T20:01:21.801808+0000","last_became_active":"2023-11-28T20:01:10.530889+0000","last_became_peered":"2023-11-28T20:01:10.530889+0000","last_unstale":"2023-11-28T20:01:21.801808+0000","last_undegraded":"2023-11-28T20:01:21.801808+0000","last_fullsized":"2023-11-28T20:01:21.801808+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_clean_scrub_stamp":"2023-11-28T20:01:09.480611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:53:37.636427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":14,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-11-28T20:01:21.790298+0000","last_change":"2023-11-28T20:01:09.511368+0000","last_active":"2023-11-28T20:01:21.790298+0000","last_peered":"2023-11-28T20:01:21.790298+0000","last_clean":"2023-11-28T20:01:21.790298+0000","last_became_active":"2023-11-28T20:01:09.510765+0000","last_became_peered":"2023-11-28T20:01:09.510765+0000","last_unstale":"2023-11-28T20:01:21.790298+0000","last_undegraded":"2023-11-28T20:01:21.790298+0000","last_fullsized":"2023-11-28T20:01:21.790298+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:08.474257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:08.474257+0000","last_clean_scrub_stamp":"2023-11-28T20:01:08.474257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:23:01.812122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.6","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2023-11-28T20:01:22.810260+0000","last_change":"2023-11-28T20:01:22.810260+0000","last_active":"2023-11-28T20:01:22.787100+0000","last_peered":"2023-11-28T20:01:22.787100+0000","last_clean":"2023-11-28T20:01:22.787100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:01:22.810260+0000","last_undegraded":"2023-11-28T20:01:22.810260+0000","last_fullsized":"2023-11-28T20:01:22.810260+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:22.787100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:22.787100+0000","last_clean_scrub_stamp":"2023-11-28T20:01:22.787100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.1","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-28T20:01:22.827254+0000","last_change":"2023-11-28T20:01:22.823098+0000","last_active":"2023-11-28T20:01:22.827254+0000","last_peered":"2023-11-28T20:01:22.827254+0000","last_clean":"2023-11-28T20:01:22.827254+0000","last_became_active":"2023-11-28T20:01:22.822775+0000","last_became_peered":"2023-11-28T20:01:22.822775+0000","last_unstale":"2023-11-28T20:01:22.827254+0000","last_undegraded":"2023-11-28T20:01:22.827254+0000","last_fullsized":"2023-11-28T20:01:22.827254+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:21.777981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:21.777981+0000","last_clean_scrub_stamp":"2023-11-28T20:01:21.777981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:19:01.924410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-11-28T20:01:21.800951+0000","last_change":"2023-11-28T20:01:10.530585+0000","last_active":"2023-11-28T20:01:21.800951+0000","last_peered":"2023-11-28T20:01:21.800951+0000","last_clean":"2023-11-28T20:01:21.800951+0000","last_became_active":"2023-11-28T20:01:10.530313+0000","last_became_peered":"2023-11-28T20:01:10.530313+0000","last_unstale":"2023-11-28T20:01:21.800951+0000","last_undegraded":"2023-11-28T20:01:21.800951+0000","last_fullsized":"2023-11-28T20:01:21.800951+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_clean_scrub_stamp":"2023-11-28T20:01:09.480611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:04:41.159984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":14,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-11-28T20:01:21.798227+0000","last_change":"2023-11-28T20:01:09.518318+0000","last_active":"2023-11-28T20:01:21.798227+0000","last_peered":"2023-11-28T20:01:21.798227+0000","last_clean":"2023-11-28T20:01:21.798227+0000","last_became_active":"2023-11-28T20:01:09.517761+0000","last_became_peered":"2023-11-28T20:01:09.517761+0000","last_unstale":"2023-11-28T20:01:21.798227+0000","last_undegraded":"2023-11-28T20:01:21.798227+0000","last_fullsized":"2023-11-28T20:01:21.798227+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:08.474257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:08.474257+0000","last_clean_scrub_stamp":"2023-11-28T20:01:08.474257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:18:16.102441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.7","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2023-11-28T20:01:22.807763+0000","last_change":"2023-11-28T20:01:22.807763+0000","last_active":"2023-11-28T20:01:22.787100+0000","last_peered":"2023-11-28T20:01:22.787100+0000","last_clean":"2023-11-28T20:01:22.787100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:01:22.807763+0000","last_undegraded":"2023-11-28T20:01:22.807763+0000","last_fullsized":"2023-11-28T20:01:22.807763+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:22.787100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:22.787100+0000","last_clean_scrub_stamp":"2023-11-28T20:01:22.787100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.0","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-28T20:01:22.826411+0000","last_change":"2023-11-28T20:01:22.822143+0000","last_active":"2023-11-28T20:01:22.826411+0000","last_peered":"2023-11-28T20:01:22.826411+0000","last_clean":"2023-11-28T20:01:22.826411+0000","last_became_active":"2023-11-28T20:01:22.821874+0000","last_became_peered":"2023-11-28T20:01:22.821874+0000","last_unstale":"2023-11-28T20:01:22.826411+0000","last_undegraded":"2023-11-28T20:01:22.826411+0000","last_fullsized":"2023-11-28T20:01:22.826411+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:21.777981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:21.777981+0000","last_clean_scrub_stamp":"2023-11-28T20:01:21.777981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:05:44.877415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-11-28T20:01:21.791432+0000","last_change":"2023-11-28T20:01:10.533596+0000","last_active":"2023-11-28T20:01:21.791432+0000","last_peered":"2023-11-28T20:01:21.791432+0000","last_clean":"2023-11-28T20:01:21.791432+0000","last_became_active":"2023-11-28T20:01:10.533195+0000","last_became_peered":"2023-11-28T20:01:10.533195+0000","last_unstale":"2023-11-28T20:01:21.791432+0000","last_undegraded":"2023-11-28T20:01:21.791432+0000","last_fullsized":"2023-11-28T20:01:21.791432+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_clean_scrub_stamp":"2023-11-28T20:01:09.480611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:14:25.459653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":14,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-11-28T20:01:21.796646+0000","last_change":"2023-11-28T20:01:09.507413+0000","last_active":"2023-11-28T20:01:21.796646+0000","last_peered":"2023-11-28T20:01:21.796646+0000","last_clean":"2023-11-28T20:01:21.796646+0000","last_became_active":"2023-11-28T20:01:09.507080+0000","last_became_peered":"2023-11-28T20:01:09.507080+0000","last_unstale":"2023-11-28T20:01:21.796646+0000","last_undegraded":"2023-11-28T20:01:21.796646+0000","last_fullsized":"2023-11-28T20:01:21.796646+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:08.474257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:08.474257+0000","last_clean_scrub_stamp":"2023-11-28T20:01:08.474257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:54:29.262983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.4","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2023-11-28T20:01:22.802494+0000","last_change":"2023-11-28T20:01:22.802494+0000","last_active":"2023-11-28T20:01:22.787100+0000","last_peered":"2023-11-28T20:01:22.787100+0000","last_clean":"2023-11-28T20:01:22.787100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:01:22.802494+0000","last_undegraded":"2023-11-28T20:01:22.802494+0000","last_fullsized":"2023-11-28T20:01:22.802494+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:22.787100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:22.787100+0000","last_clean_scrub_stamp":"2023-11-28T20:01:22.787100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.3","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-28T20:01:22.829695+0000","last_change":"2023-11-28T20:01:22.826550+0000","last_active":"2023-11-28T20:01:22.829695+0000","last_peered":"2023-11-28T20:01:22.829695+0000","last_clean":"2023-11-28T20:01:22.829695+0000","last_became_active":"2023-11-28T20:01:22.826247+0000","last_became_peered":"2023-11-28T20:01:22.826247+0000","last_unstale":"2023-11-28T20:01:22.829695+0000","last_undegraded":"2023-11-28T20:01:22.829695+0000","last_fullsized":"2023-11-28T20:01:22.829695+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:21.777981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:21.777981+0000","last_clean_scrub_stamp":"2023-11-28T20:01:21.777981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:21:33.492950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-11-28T20:01:21.789934+0000","last_change":"2023-11-28T20:01:10.518351+0000","last_active":"2023-11-28T20:01:21.789934+0000","last_peered":"2023-11-28T20:01:21.789934+0000","last_clean":"2023-11-28T20:01:21.789934+0000","last_became_active":"2023-11-28T20:01:10.518106+0000","last_became_peered":"2023-11-28T20:01:10.518106+0000","last_unstale":"2023-11-28T20:01:21.789934+0000","last_undegraded":"2023-11-28T20:01:21.789934+0000","last_fullsized":"2023-11-28T20:01:21.789934+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_clean_scrub_stamp":"2023-11-28T20:01:09.480611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:04:52.498548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":14,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-11-28T20:01:21.796549+0000","last_change":"2023-11-28T20:01:09.514346+0000","last_active":"2023-11-28T20:01:21.796549+0000","last_peered":"2023-11-28T20:01:21.796549+0000","last_clean":"2023-11-28T20:01:21.796549+0000","last_became_active":"2023-11-28T20:01:09.513791+0000","last_became_peered":"2023-11-28T20:01:09.513791+0000","last_unstale":"2023-11-28T20:01:21.796549+0000","last_undegraded":"2023-11-28T20:01:21.796549+0000","last_fullsized":"2023-11-28T20:01:21.796549+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:08.474257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:08.474257+0000","last_clean_scrub_stamp":"2023-11-28T20:01:08.474257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:17:26.091533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.5","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2023-11-28T20:01:22.803024+0000","last_change":"2023-11-28T20:01:22.803024+0000","last_active":"2023-11-28T20:01:22.787100+0000","last_peered":"2023-11-28T20:01:22.787100+0000","last_clean":"2023-11-28T20:01:22.787100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:01:22.803024+0000","last_undegraded":"2023-11-28T20:01:22.803024+0000","last_fullsized":"2023-11-28T20:01:22.803024+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:22.787100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:22.787100+0000","last_clean_scrub_stamp":"2023-11-28T20:01:22.787100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-28T20:01:22.826152+0000","last_change":"2023-11-28T20:01:22.821936+0000","last_active":"2023-11-28T20:01:22.826152+0000","last_peered":"2023-11-28T20:01:22.826152+0000","last_clean":"2023-11-28T20:01:22.826152+0000","last_became_active":"2023-11-28T20:01:22.821666+0000","last_became_peered":"2023-11-28T20:01:22.821666+0000","last_unstale":"2023-11-28T20:01:22.826152+0000","last_undegraded":"2023-11-28T20:01:22.826152+0000","last_fullsized":"2023-11-28T20:01:22.826152+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:21.777981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:21.777981+0000","last_clean_scrub_stamp":"2023-11-28T20:01:21.777981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:44:17.659296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-11-28T20:01:21.797041+0000","last_change":"2023-11-28T20:01:10.531261+0000","last_active":"2023-11-28T20:01:21.797041+0000","last_peered":"2023-11-28T20:01:21.797041+0000","last_clean":"2023-11-28T20:01:21.797041+0000","last_became_active":"2023-11-28T20:01:10.531002+0000","last_became_peered":"2023-11-28T20:01:10.531002+0000","last_unstale":"2023-11-28T20:01:21.797041+0000","last_undegraded":"2023-11-28T20:01:21.797041+0000","last_fullsized":"2023-11-28T20:01:21.797041+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_clean_scrub_stamp":"2023-11-28T20:01:09.480611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:50:37.650648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":14,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-11-28T20:01:21.789833+0000","last_change":"2023-11-28T20:01:09.512031+0000","last_active":"2023-11-28T20:01:21.789833+0000","last_peered":"2023-11-28T20:01:21.789833+0000","last_clean":"2023-11-28T20:01:21.789833+0000","last_became_active":"2023-11-28T20:01:09.511366+0000","last_became_peered":"2023-11-28T20:01:09.511366+0000","last_unstale":"2023-11-28T20:01:21.789833+0000","last_undegraded":"2023-11-28T20:01:21.789833+0000","last_fullsized":"2023-11-28T20:01:21.789833+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:08.474257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:08.474257+0000","last_clean_scrub_stamp":"2023-11-28T20:01:08.474257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:29:38.849741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.d","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2023-11-28T20:01:22.816355+0000","last_change":"2023-11-28T20:01:22.816355+0000","last_active":"2023-11-28T20:01:22.787100+0000","last_peered":"2023-11-28T20:01:22.787100+0000","last_clean":"2023-11-28T20:01:22.787100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:01:22.816355+0000","last_undegraded":"2023-11-28T20:01:22.816355+0000","last_fullsized":"2023-11-28T20:01:22.816355+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:22.787100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:22.787100+0000","last_clean_scrub_stamp":"2023-11-28T20:01:22.787100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-28T20:01:22.828665+0000","last_change":"2023-11-28T20:01:22.819303+0000","last_active":"2023-11-28T20:01:22.828665+0000","last_peered":"2023-11-28T20:01:22.828665+0000","last_clean":"2023-11-28T20:01:22.828665+0000","last_became_active":"2023-11-28T20:01:22.819098+0000","last_became_peered":"2023-11-28T20:01:22.819098+0000","last_unstale":"2023-11-28T20:01:22.828665+0000","last_undegraded":"2023-11-28T20:01:22.828665+0000","last_fullsized":"2023-11-28T20:01:22.828665+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:21.777981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:21.777981+0000","last_clean_scrub_stamp":"2023-11-28T20:01:21.777981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:55:36.425762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.b","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-11-28T20:01:21.801495+0000","last_change":"2023-11-28T20:01:10.530148+0000","last_active":"2023-11-28T20:01:21.801495+0000","last_peered":"2023-11-28T20:01:21.801495+0000","last_clean":"2023-11-28T20:01:21.801495+0000","last_became_active":"2023-11-28T20:01:10.529630+0000","last_became_peered":"2023-11-28T20:01:10.529630+0000","last_unstale":"2023-11-28T20:01:21.801495+0000","last_undegraded":"2023-11-28T20:01:21.801495+0000","last_fullsized":"2023-11-28T20:01:21.801495+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_clean_scrub_stamp":"2023-11-28T20:01:09.480611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:11:08.794514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":14,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-11-28T20:01:21.796083+0000","last_change":"2023-11-28T20:01:09.515708+0000","last_active":"2023-11-28T20:01:21.796083+0000","last_peered":"2023-11-28T20:01:21.796083+0000","last_clean":"2023-11-28T20:01:21.796083+0000","last_became_active":"2023-11-28T20:01:09.515449+0000","last_became_peered":"2023-11-28T20:01:09.515449+0000","last_unstale":"2023-11-28T20:01:21.796083+0000","last_undegraded":"2023-11-28T20:01:21.796083+0000","last_fullsized":"2023-11-28T20:01:21.796083+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:08.474257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:08.474257+0000","last_clean_scrub_stamp":"2023-11-28T20:01:08.474257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T07:14:20.829778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":201,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-11-28T20:01:21.797721+0000","last_change":"2023-11-28T19:58:56.136501+0000","last_active":"2023-11-28T20:01:21.797721+0000","last_peered":"2023-11-28T20:01:21.797721+0000","last_clean":"2023-11-28T20:01:21.797721+0000","last_became_active":"2023-11-28T19:58:56.135998+0000","last_became_peered":"2023-11-28T19:58:56.135998+0000","last_unstale":"2023-11-28T20:01:21.797721+0000","last_undegraded":"2023-11-28T20:01:21.797721+0000","last_fullsized":"2023-11-28T20:01:21.797721+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:58:54.602349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:58:54.602349+0000","last_clean_scrub_stamp":"2023-11-28T19:58:54.602349+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:33:42.723349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":12,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":11,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":10,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":9,"num_pg":32,"stat_sum":{"num_bytes":3905,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":47,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":7810,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":41,"ondisk_log_size":41,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":66748,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574882,"num_pgs":51,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27832,"kb_used_data":812,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344008,"statfs":{"total":96636764160,"available":96608264192,"internally_reserved":0,"allocated":831488,"data_stored":935848,"data_compressed":33374,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 20:00:55 2023","interfaces":[{"interface":"back","average":{"1min":0.66200000000000003,"5min":0.67500000000000004,"15min":0.67700000000000005},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":0.84699999999999998,"5min":0.90700000000000003,"15min":0.90700000000000003},"last":0.71099999999999997},{"interface":"front","average":{"1min":0.63300000000000001,"5min":0.67400000000000004,"15min":0.68100000000000005},"min":{"1min":0.499,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":0.84099999999999997,"5min":0.98999999999999999,"15min":0.98999999999999999},"last":0.69599999999999995}]},{"osd":1,"last update":"Tue Nov 28 20:00:55 2023","interfaces":[{"interface":"back","average":{"1min":0.60599999999999998,"5min":0.63800000000000001,"15min":0.64300000000000002},"min":{"1min":0.44700000000000001,"5min":0.438,"15min":0.438},"max":{"1min":0.82899999999999996,"5min":0.89600000000000002,"15min":0.89600000000000002},"last":0.72899999999999998},{"interface":"front","average":{"1min":0.63900000000000001,"5min":0.68899999999999995,"15min":0.69699999999999995},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":0.78200000000000003,"5min":1.0900000000000001,"15min":1.0900000000000001},"last":0.68000000000000005}]},{"osd":2,"last update":"Tue Nov 28 20:00:55 2023","interfaces":[{"interface":"back","average":{"1min":0.64400000000000002,"5min":0.71599999999999997,"15min":0.72799999999999998},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.84699999999999998,"5min":0.98799999999999999,"15min":0.98799999999999999},"last":0.79700000000000004},{"interface":"front","average":{"1min":0.65100000000000002,"5min":0.69499999999999995,"15min":0.70299999999999996},"min":{"1min":0.48599999999999999,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":0.85599999999999998,"5min":1.0680000000000001,"15min":1.0680000000000001},"last":0.65000000000000002}]},{"osd":3,"last update":"Tue Nov 28 20:00:55 2023","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.70099999999999996,"15min":0.69999999999999996},"min":{"1min":0.56100000000000005,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":0.88900000000000001,"5min":1.0449999999999999,"15min":1.0449999999999999},"last":0.63200000000000001},{"interface":"front","average":{"1min":0.74199999999999999,"5min":0.78200000000000003,"15min":0.78900000000000003},"min":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":0.60699999999999998},"max":{"1min":0.879,"5min":1.1299999999999999,"15min":1.1299999999999999},"last":0.77000000000000002}]},{"osd":4,"last update":"Tue Nov 28 20:00:55 2023","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.63600000000000001,"15min":0.64000000000000001},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":0.83899999999999997,"5min":1.018,"15min":1.018},"last":0.46999999999999997},{"interface":"front","average":{"1min":0.67600000000000005,"5min":0.72199999999999998,"15min":0.72999999999999998},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":0.97899999999999998,"5min":1.1120000000000001,"15min":1.1120000000000001},"last":0.66300000000000003}]},{"osd":5,"last update":"Tue Nov 28 20:00:55 2023","interfaces":[{"interface":"back","average":{"1min":0.58699999999999997,"5min":0.66500000000000004,"15min":0.67800000000000005},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.871,"5min":1.1699999999999999,"15min":1.1699999999999999},"last":0.59899999999999998},{"interface":"front","average":{"1min":0.67900000000000005,"5min":0.748,"15min":0.76000000000000001},"min":{"1min":0.505,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":0.88500000000000001,"5min":1.1890000000000001,"15min":1.1890000000000001},"last":0.747}]},{"osd":6,"last update":"Tue Nov 28 20:00:55 2023","interfaces":[{"interface":"back","average":{"1min":0.71399999999999997,"5min":0.76800000000000002,"15min":0.77700000000000002},"min":{"1min":0.47499999999999998,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.88200000000000001,"5min":1.1379999999999999,"15min":1.1379999999999999},"last":0.81100000000000005},{"interface":"front","average":{"1min":0.65000000000000002,"5min":0.72699999999999998,"15min":0.73999999999999999},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":0.93300000000000005,"5min":1.23,"15min":1.23},"last":0.57599999999999996}]}]},{"osd":6,"up_from":13,"seq":55834574880,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27756,"kb_used_data":736,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344084,"statfs":{"total":96636764160,"available":96608342016,"internally_reserved":0,"allocated":753664,"data_stored":344738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 20:00:54 2023","interfaces":[{"interface":"back","average":{"1min":0.621,"5min":0.61699999999999999,"15min":0.61599999999999999},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.81699999999999995,"5min":0.82599999999999996,"15min":0.82599999999999996},"last":0.70499999999999996},{"interface":"front","average":{"1min":0.67300000000000004,"5min":0.66500000000000004,"15min":0.66400000000000003},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":0.88700000000000001,"5min":0.98999999999999999,"15min":0.98999999999999999},"last":0.78500000000000003}]},{"osd":1,"last update":"Tue Nov 28 20:00:54 2023","interfaces":[{"interface":"back","average":{"1min":0.745,"5min":0.78100000000000003,"15min":0.78700000000000003},"min":{"1min":0.56100000000000005,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.0940000000000001,"5min":1.105,"15min":1.105},"last":0.81599999999999995},{"interface":"front","average":{"1min":0.69999999999999996,"5min":0.68899999999999995,"15min":0.68700000000000006},"min":{"1min":0.53700000000000003,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.85599999999999998,"5min":0.95899999999999996,"15min":0.95899999999999996},"last":0.72699999999999998}]},{"osd":2,"last update":"Tue Nov 28 20:00:54 2023","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.69499999999999995,"15min":0.69799999999999995},"min":{"1min":0.54700000000000004,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":0.89700000000000002,"5min":0.93400000000000005,"15min":0.93400000000000005},"last":0.76500000000000001},{"interface":"front","average":{"1min":0.70499999999999996,"5min":0.71599999999999997,"15min":0.71799999999999997},"min":{"1min":0.53400000000000003,"5min":0.505,"15min":0.505},"max":{"1min":0.91800000000000004,"5min":1.006,"15min":1.006},"last":0.66500000000000004}]},{"osd":3,"last update":"Tue Nov 28 20:00:54 2023","interfaces":[{"interface":"back","average":{"1min":0.70999999999999996,"5min":0.74099999999999999,"15min":0.746},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.04,"5min":1.056,"15min":1.056},"last":0.84499999999999997},{"interface":"front","average":{"1min":0.66700000000000004,"5min":0.68100000000000005,"15min":0.68300000000000005},"min":{"1min":0.505,"5min":0.505,"15min":0.505},"max":{"1min":0.85599999999999998,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.68300000000000005}]},{"osd":4,"last update":"Tue Nov 28 20:00:54 2023","interfaces":[{"interface":"back","average":{"1min":0.61599999999999999,"5min":0.628,"15min":0.63},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":0.97599999999999998,"5min":0.97599999999999998,"15min":0.97599999999999998},"last":0.52500000000000002},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.71199999999999997,"15min":0.72999999999999998},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":1.1419999999999999,"5min":1.389,"15min":1.389},"last":0.504}]},{"osd":5,"last update":"Tue Nov 28 20:00:54 2023","interfaces":[{"interface":"back","average":{"1min":0.71999999999999997,"5min":0.79700000000000004,"15min":0.81000000000000005},"min":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":1.147,"5min":1.4259999999999999,"15min":1.4259999999999999},"last":0.60799999999999998},{"interface":"front","average":{"1min":0.70699999999999996,"5min":0.751,"15min":0.75900000000000001},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.034,"5min":1.276,"15min":1.276},"last":0.627}]},{"osd":7,"last update":"Tue Nov 28 20:00:54 2023","interfaces":[{"interface":"back","average":{"1min":0.64000000000000001,"5min":0.69999999999999996,"15min":0.70999999999999996},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":1.014,"5min":1.014,"15min":1.014},"last":0.47699999999999998},{"interface":"front","average":{"1min":0.72599999999999998,"5min":0.80900000000000005,"15min":0.82299999999999995},"min":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":1.083,"5min":1.242,"15min":1.242},"last":0.58299999999999996}]}]},{"osd":5,"up_from":13,"seq":55834574882,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27756,"kb_used_data":736,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344084,"statfs":{"total":96636764160,"available":96608342016,"internally_reserved":0,"allocated":753664,"data_stored":344726,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 20:00:54 2023","interfaces":[{"interface":"back","average":{"1min":0.628,"5min":0.69299999999999995,"15min":0.70399999999999996},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.84699999999999998,"5min":0.997,"15min":0.997},"last":0.67100000000000004},{"interface":"front","average":{"1min":0.61899999999999999,"5min":0.69899999999999995,"15min":0.71199999999999997},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.78800000000000003,"5min":1.149,"15min":1.149},"last":0.622}]},{"osd":1,"last update":"Tue Nov 28 20:00:54 2023","interfaces":[{"interface":"back","average":{"1min":0.66800000000000004,"5min":0.70399999999999996,"15min":0.70999999999999996},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.94499999999999995,"5min":0.94499999999999995,"15min":0.94499999999999995},"last":0.70999999999999996},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.70399999999999996,"15min":0.71999999999999997},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":0.71999999999999997,"5min":1.0940000000000001,"15min":1.0940000000000001},"last":0.70199999999999996}]},{"osd":2,"last update":"Tue Nov 28 20:00:54 2023","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.89200000000000002,"15min":0.92800000000000005},"min":{"1min":0.5,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":0.91200000000000003,"5min":5.0880000000000001,"15min":5.0880000000000001},"last":0.73399999999999999},{"interface":"front","average":{"1min":0.69599999999999995,"5min":0.93999999999999995,"15min":0.98099999999999998},"min":{"1min":0.59199999999999997,"5min":0.504,"15min":0.504},"max":{"1min":0.96199999999999997,"5min":5.1399999999999997,"15min":5.1399999999999997},"last":0.76100000000000001}]},{"osd":3,"last update":"Tue Nov 28 20:00:54 2023","interfaces":[{"interface":"back","average":{"1min":0.70999999999999996,"5min":0.96399999999999997,"15min":1.006},"min":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":0.91100000000000003,"5min":5.0469999999999997,"15min":5.0469999999999997},"last":0.68899999999999995},{"interface":"front","average":{"1min":0.69099999999999995,"5min":0.93899999999999995,"15min":0.97999999999999998},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":0.90000000000000002,"5min":5.024,"15min":5.024},"last":0.79900000000000004}]},{"osd":4,"last update":"Tue Nov 28 20:00:54 2023","interfaces":[{"interface":"back","average":{"1min":0.58599999999999997,"5min":0.65800000000000003,"15min":0.67000000000000004},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.93300000000000005,"5min":1.4810000000000001,"15min":1.4810000000000001},"last":0.42899999999999999},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.73599999999999999,"15min":0.74299999999999999},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":0.95799999999999996,"5min":1.6339999999999999,"15min":1.6339999999999999},"last":0.496}]},{"osd":6,"last update":"Tue Nov 28 20:00:54 2023","interfaces":[{"interface":"back","average":{"1min":0.70299999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"min":{"1min":0.47699999999999998,"5min":0.434,"15min":0.434},"max":{"1min":0.93899999999999995,"5min":0.97699999999999998,"15min":0.97699999999999998},"last":0.64800000000000002},{"interface":"front","average":{"1min":0.69199999999999995,"5min":0.73599999999999999,"15min":0.74399999999999999},"min":{"1min":0.46300000000000002,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":0.86599999999999999,"5min":1.099,"15min":1.099},"last":0.47599999999999998}]},{"osd":7,"last update":"Tue Nov 28 20:00:54 2023","interfaces":[{"interface":"back","average":{"1min":0.77100000000000002,"5min":0.78300000000000003,"15min":0.78500000000000003},"min":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":0.95999999999999996,"5min":1.236,"15min":1.236},"last":0.55800000000000005},{"interface":"front","average":{"1min":0.77800000000000002,"5min":0.79600000000000004,"15min":0.79900000000000004},"min":{"1min":0.54000000000000004,"5min":0.505,"15min":0.505},"max":{"1min":0.98599999999999999,"5min":1.0760000000000001,"15min":1.0760000000000001},"last":0.53600000000000003}]}]},{"osd":4,"up_from":13,"seq":55834574881,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27764,"kb_used_data":744,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344076,"statfs":{"total":96636764160,"available":96608333824,"internally_reserved":0,"allocated":761856,"data_stored":347811,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 20:00:54 2023","interfaces":[{"interface":"back","average":{"1min":0.63200000000000001,"5min":0.69499999999999995,"15min":0.70499999999999996},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.82999999999999996,"5min":1.0429999999999999,"15min":1.0429999999999999},"last":0.76500000000000001},{"interface":"front","average":{"1min":0.64400000000000002,"5min":0.69999999999999996,"15min":0.70899999999999996},"min":{"1min":0.44900000000000001,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.93200000000000005,"5min":1.163,"15min":1.163},"last":0.56699999999999995}]},{"osd":1,"last update":"Tue Nov 28 20:00:54 2023","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.73599999999999999,"15min":0.754},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.88500000000000001,"5min":1.111,"15min":1.111},"last":0.54300000000000004},{"interface":"front","average":{"1min":0.68300000000000005,"5min":0.78700000000000003,"15min":0.80500000000000005},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":0.90000000000000002,"5min":1.238,"15min":1.238},"last":0.629}]},{"osd":2,"last update":"Tue Nov 28 20:00:54 2023","interfaces":[{"interface":"back","average":{"1min":0.70099999999999996,"5min":0.76600000000000001,"15min":0.77700000000000002},"min":{"1min":0.53300000000000003,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.97399999999999998,"5min":1.0669999999999999,"15min":1.0669999999999999},"last":0.58799999999999997},{"interface":"front","average":{"1min":0.66700000000000004,"5min":0.78700000000000003,"15min":0.80700000000000005},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.88100000000000001,"5min":1.1180000000000001,"15min":1.1180000000000001},"last":0.81000000000000005}]},{"osd":3,"last update":"Tue Nov 28 20:00:54 2023","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.76600000000000001,"15min":0.79000000000000004},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":0.89700000000000002,"5min":1.202,"15min":1.202},"last":0.61199999999999999},{"interface":"front","average":{"1min":0.67700000000000005,"5min":0.77200000000000002,"15min":0.78800000000000003},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":0.94599999999999995,"5min":1.0589999999999999,"15min":1.0589999999999999},"last":0.78800000000000003}]},{"osd":5,"last update":"Tue Nov 28 20:00:54 2023","interfaces":[{"interface":"back","average":{"1min":0.621,"5min":0.70299999999999996,"15min":0.71699999999999997},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.82499999999999996,"5min":0.95899999999999996,"15min":0.95899999999999996},"last":0.83199999999999996},{"interface":"front","average":{"1min":0.625,"5min":0.69599999999999995,"15min":0.70799999999999996},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.879,"5min":1.034,"15min":1.034},"last":0.65300000000000002}]},{"osd":6,"last update":"Tue Nov 28 20:00:54 2023","interfaces":[{"interface":"back","average":{"1min":0.60799999999999998,"5min":0.70899999999999996,"15min":0.72599999999999998},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":0.73799999999999999,"5min":1.0309999999999999,"15min":1.0309999999999999},"last":0.75700000000000001},{"interface":"front","average":{"1min":0.71899999999999997,"5min":0.77100000000000002,"15min":0.77900000000000003},"min":{"1min":0.49199999999999999,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":0.879,"5min":1.002,"15min":1.002},"last":0.68000000000000005}]},{"osd":7,"last update":"Tue Nov 28 20:00:54 2023","interfaces":[{"interface":"back","average":{"1min":0.70499999999999996,"5min":0.77100000000000002,"15min":0.78200000000000003},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":0.91000000000000003,"5min":1.0620000000000001,"15min":1.0620000000000001},"last":0.69799999999999995},{"interface":"front","average":{"1min":0.76000000000000001,"5min":0.84799999999999998,"15min":0.86199999999999999},"min":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":0.93400000000000005,"5min":1.1459999999999999,"15min":1.1459999999999999},"last":0.71499999999999997}]}]},{"osd":3,"up_from":13,"seq":55834574882,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27752,"kb_used_data":732,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344088,"statfs":{"total":96636764160,"available":96608346112,"internally_reserved":0,"allocated":749568,"data_stored":344704,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 20:00:55 2023","interfaces":[{"interface":"back","average":{"1min":0.41899999999999998,"5min":0.441,"15min":0.44500000000000001},"min":{"1min":0.29399999999999998,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":1.7130000000000001},{"interface":"front","average":{"1min":0.39600000000000002,"5min":0.45800000000000002,"15min":0.46800000000000003},"min":{"1min":0.28199999999999997,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.52800000000000002,"5min":0.82599999999999996,"15min":0.82599999999999996},"last":3.0630000000000002}]},{"osd":1,"last update":"Tue Nov 28 20:00:55 2023","interfaces":[{"interface":"back","average":{"1min":0.40000000000000002,"5min":0.46500000000000002,"15min":0.47599999999999998},"min":{"1min":0.26200000000000001,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.56999999999999995,"5min":0.84399999999999997,"15min":0.84399999999999997},"last":0.89200000000000002},{"interface":"front","average":{"1min":0.439,"5min":0.49099999999999999,"15min":0.5},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.74099999999999999,"5min":0.86099999999999999,"15min":0.86099999999999999},"last":5.8920000000000003}]},{"osd":2,"last update":"Tue Nov 28 20:00:55 2023","interfaces":[{"interface":"back","average":{"1min":0.48799999999999999,"5min":0.52400000000000002,"15min":0.53000000000000003},"min":{"1min":0.375,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.64900000000000002,"5min":0.85599999999999998,"15min":0.85599999999999998},"last":4.6390000000000002},{"interface":"front","average":{"1min":0.48999999999999999,"5min":0.56599999999999995,"15min":0.57899999999999996},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.63500000000000001,"5min":0.83699999999999997,"15min":0.83699999999999997},"last":11.593}]},{"osd":4,"last update":"Tue Nov 28 20:00:55 2023","interfaces":[{"interface":"back","average":{"1min":0.77700000000000002,"5min":0.76500000000000001,"15min":0.76300000000000001},"min":{"1min":0.60799999999999998,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":1.085,"5min":1.206,"15min":1.206},"last":5.5549999999999997},{"interface":"front","average":{"1min":0.80700000000000005,"5min":0.80300000000000005,"15min":0.80300000000000005},"min":{"1min":0.58999999999999997,"5min":0.503,"15min":0.503},"max":{"1min":1.173,"5min":1.222,"15min":1.222},"last":11.747}]},{"osd":5,"last update":"Tue Nov 28 20:00:55 2023","interfaces":[{"interface":"back","average":{"1min":0.78300000000000003,"5min":0.79600000000000004,"15min":0.79800000000000004},"min":{"1min":0.57699999999999996,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":1.2509999999999999,"5min":1.2509999999999999,"15min":1.2509999999999999},"last":11.705},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.79100000000000004,"15min":0.79900000000000004},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":1.0409999999999999,"5min":1.3100000000000001,"15min":1.3100000000000001},"last":1.0580000000000001}]},{"osd":6,"last update":"Tue Nov 28 20:00:55 2023","interfaces":[{"interface":"back","average":{"1min":0.81699999999999995,"5min":0.83799999999999997,"15min":0.84199999999999997},"min":{"1min":0.58799999999999997,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":1.544,"5min":1.544,"15min":1.544},"last":1.6639999999999999},{"interface":"front","average":{"1min":0.93100000000000005,"5min":0.78500000000000003,"15min":0.76100000000000001},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":4.0679999999999996,"5min":4.0679999999999996,"15min":4.0679999999999996},"last":3.1459999999999999}]},{"osd":7,"last update":"Tue Nov 28 20:00:55 2023","interfaces":[{"interface":"back","average":{"1min":0.97099999999999997,"5min":0.874,"15min":0.85799999999999998},"min":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":4.0019999999999998,"5min":4.0019999999999998,"15min":4.0019999999999998},"last":6.6619999999999999},{"interface":"front","average":{"1min":0.80100000000000005,"5min":0.873,"15min":0.88500000000000001},"min":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.60299999999999998},"max":{"1min":1.1830000000000001,"5min":1.339,"15min":1.339},"last":11.782}]}]},{"osd":2,"up_from":13,"seq":55834574880,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27752,"kb_used_data":732,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344088,"statfs":{"total":96636764160,"available":96608346112,"internally_reserved":0,"allocated":749568,"data_stored":344704,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 20:00:54 2023","interfaces":[{"interface":"back","average":{"1min":0.42599999999999999,"5min":0.45000000000000001,"15min":0.45400000000000001},"min":{"1min":0.33300000000000002,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.65100000000000002,"5min":0.74099999999999999,"15min":0.74099999999999999},"last":0.32500000000000001},{"interface":"front","average":{"1min":0.42199999999999999,"5min":0.46999999999999997,"15min":0.47799999999999998},"min":{"1min":0.27900000000000003,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.61399999999999999,"5min":0.67700000000000005,"15min":0.67700000000000005},"last":0.41899999999999998}]},{"osd":1,"last update":"Tue Nov 28 20:00:54 2023","interfaces":[{"interface":"back","average":{"1min":0.42899999999999999,"5min":0.497,"15min":0.50900000000000001},"min":{"1min":0.33300000000000002,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.57199999999999995,"5min":1.0389999999999999,"15min":1.0389999999999999},"last":0.377},{"interface":"front","average":{"1min":0.435,"5min":0.49099999999999999,"15min":0.5},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.70299999999999996,"5min":0.70999999999999996,"15min":0.70999999999999996},"last":0.58999999999999997}]},{"osd":3,"last update":"Tue Nov 28 20:00:54 2023","interfaces":[{"interface":"back","average":{"1min":0.44,"5min":0.46600000000000003,"15min":0.46999999999999997},"min":{"1min":0.317,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.55200000000000005,"5min":0.629,"15min":0.629},"last":0.60299999999999998},{"interface":"front","average":{"1min":0.496,"5min":0.57199999999999995,"15min":0.58499999999999996},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.67800000000000005,"5min":0.98499999999999999,"15min":0.98499999999999999},"last":0.5}]},{"osd":4,"last update":"Tue Nov 28 20:00:54 2023","interfaces":[{"interface":"back","average":{"1min":0.73899999999999999,"5min":0.83699999999999997,"15min":0.85299999999999998},"min":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"max":{"1min":0.98999999999999999,"5min":1.139,"15min":1.139},"last":0.53400000000000003},{"interface":"front","average":{"1min":0.71999999999999997,"5min":0.82599999999999996,"15min":0.84399999999999997},"min":{"1min":0.57299999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":0.97599999999999998,"5min":1.238,"15min":1.238},"last":0.64600000000000002}]},{"osd":5,"last update":"Tue Nov 28 20:00:54 2023","interfaces":[{"interface":"back","average":{"1min":0.69699999999999995,"5min":0.84699999999999998,"15min":0.872},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":0.83599999999999997,"5min":1.6180000000000001,"15min":1.6180000000000001},"last":0.51500000000000001},{"interface":"front","average":{"1min":0.71099999999999997,"5min":0.81000000000000005,"15min":0.82599999999999996},"min":{"1min":0.52200000000000002,"5min":0.496,"15min":0.496},"max":{"1min":0.96899999999999997,"5min":1.339,"15min":1.339},"last":0.77600000000000002}]},{"osd":6,"last update":"Tue Nov 28 20:00:54 2023","interfaces":[{"interface":"back","average":{"1min":0.73299999999999998,"5min":0.79100000000000004,"15min":0.80100000000000005},"min":{"1min":0.54600000000000004,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":0.98199999999999998,"5min":1.1839999999999999,"15min":1.1839999999999999},"last":0.82099999999999995},{"interface":"front","average":{"1min":0.70599999999999996,"5min":0.82999999999999996,"15min":0.85099999999999998},"min":{"1min":0.497,"5min":0.497,"15min":0.497},"max":{"1min":0.94199999999999995,"5min":1.099,"15min":1.099},"last":0.57199999999999995}]},{"osd":7,"last update":"Tue Nov 28 20:00:54 2023","interfaces":[{"interface":"back","average":{"1min":0.746,"5min":0.86099999999999999,"15min":0.88},"min":{"1min":0.53300000000000003,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":0.84899999999999998,"5min":1.4590000000000001,"15min":1.4590000000000001},"last":0.55300000000000005},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.83599999999999997,"15min":0.85599999999999998},"min":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":0.96599999999999997,"5min":1.387,"15min":1.387},"last":0.625}]}]},{"osd":1,"up_from":13,"seq":55834574882,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27780,"kb_used_data":760,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344060,"statfs":{"total":96636764160,"available":96608317440,"internally_reserved":0,"allocated":778240,"data_stored":348575,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 20:00:56 2023","interfaces":[{"interface":"back","average":{"1min":0.372,"5min":0.59999999999999998,"15min":0.63800000000000001},"min":{"1min":0.25900000000000001,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.53200000000000003,"5min":3.8740000000000001,"15min":3.8740000000000001},"last":0.27000000000000002},{"interface":"front","average":{"1min":0.41499999999999998,"5min":0.54000000000000004,"15min":0.56100000000000005},"min":{"1min":0.26200000000000001,"5min":0.25,"15min":0.25},"max":{"1min":0.64100000000000001,"5min":2.0760000000000001,"15min":2.0760000000000001},"last":0.36599999999999999}]},{"osd":2,"last update":"Tue Nov 28 20:00:56 2023","interfaces":[{"interface":"back","average":{"1min":0.40899999999999997,"5min":0.60899999999999999,"15min":0.64200000000000002},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":0.54500000000000004,"5min":3.7320000000000002,"15min":3.7320000000000002},"last":0.307},{"interface":"front","average":{"1min":0.42199999999999999,"5min":0.69199999999999995,"15min":0.73699999999999999},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.54800000000000004,"5min":3.9089999999999998,"15min":3.9089999999999998},"last":0.38600000000000001}]},{"osd":3,"last update":"Tue Nov 28 20:00:56 2023","interfaces":[{"interface":"back","average":{"1min":0.52800000000000002,"5min":0.65000000000000002,"15min":0.67000000000000004},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.64700000000000002,"5min":1.6399999999999999,"15min":1.6399999999999999},"last":0.436},{"interface":"front","average":{"1min":0.52000000000000002,"5min":0.66600000000000004,"15min":0.68999999999999995},"min":{"1min":0.37,"5min":0.317,"15min":0.317},"max":{"1min":0.748,"5min":2.5270000000000001,"15min":2.5270000000000001},"last":0.33300000000000002}]},{"osd":4,"last update":"Tue Nov 28 20:00:56 2023","interfaces":[{"interface":"back","average":{"1min":0.70199999999999996,"5min":0.85599999999999998,"15min":0.88200000000000001},"min":{"1min":0.46700000000000003,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":1.036,"5min":3.1659999999999999,"15min":3.1659999999999999},"last":0.51600000000000001},{"interface":"front","average":{"1min":0.68700000000000006,"5min":0.89400000000000002,"15min":0.92800000000000005},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.93700000000000006,"5min":3.7959999999999998,"15min":3.7959999999999998},"last":0.59999999999999998}]},{"osd":5,"last update":"Tue Nov 28 20:00:56 2023","interfaces":[{"interface":"back","average":{"1min":0.69799999999999995,"5min":0.93000000000000005,"15min":0.96899999999999997},"min":{"1min":0.50800000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":0.95599999999999996,"5min":4.1479999999999997,"15min":4.1479999999999997},"last":0.61899999999999999},{"interface":"front","average":{"1min":0.70299999999999996,"5min":0.86799999999999999,"15min":0.89600000000000002},"min":{"1min":0.499,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":1.052,"5min":3.5569999999999999,"15min":3.5569999999999999},"last":0.48199999999999998}]},{"osd":6,"last update":"Tue Nov 28 20:00:56 2023","interfaces":[{"interface":"back","average":{"1min":0.73999999999999999,"5min":0.94099999999999995,"15min":0.97499999999999998},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":1.004,"5min":2.863,"15min":2.863},"last":0.501},{"interface":"front","average":{"1min":0.77400000000000002,"5min":0.94099999999999995,"15min":0.96899999999999997},"min":{"1min":0.58099999999999996,"5min":0.56899999999999995,"15min":0.56899999999999995},"max":{"1min":1.075,"5min":3.371,"15min":3.371},"last":0.54500000000000004}]},{"osd":7,"last update":"Tue Nov 28 20:00:56 2023","interfaces":[{"interface":"back","average":{"1min":0.71599999999999997,"5min":0.95299999999999996,"15min":0.99299999999999999},"min":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":0.96899999999999997,"5min":3.8439999999999999,"15min":3.8439999999999999},"last":0.53100000000000003},{"interface":"front","average":{"1min":0.72699999999999998,"5min":0.97499999999999998,"15min":1.0169999999999999},"min":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":1.0569999999999999,"5min":3.9689999999999999,"15min":3.9689999999999999},"last":0.45000000000000001}]}]},{"osd":0,"up_from":13,"seq":55834574881,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31976,"kb_used_data":796,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339864,"statfs":{"total":96636764160,"available":96604020736,"internally_reserved":0,"allocated":815104,"data_stored":935072,"data_compressed":33374,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Nov 28 20:00:56 2023","interfaces":[{"interface":"back","average":{"1min":0.41299999999999998,"5min":0.63400000000000001,"15min":0.67100000000000004},"min":{"1min":0.27400000000000002,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.55800000000000005,"5min":4.883,"15min":4.883},"last":0.373},{"interface":"front","average":{"1min":0.44,"5min":0.79000000000000004,"15min":0.84799999999999998},"min":{"1min":0.30199999999999999,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.63200000000000001,"5min":8.0800000000000001,"15min":8.0800000000000001},"last":0.45900000000000002}]},{"osd":2,"last update":"Tue Nov 28 20:00:56 2023","interfaces":[{"interface":"back","average":{"1min":0.443,"5min":0.86699999999999999,"15min":0.93799999999999994},"min":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.59899999999999998,"5min":8.1029999999999998,"15min":8.1029999999999998},"last":0.45000000000000001},{"interface":"front","average":{"1min":0.47599999999999998,"5min":0.88400000000000001,"15min":0.95199999999999996},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.67600000000000005,"5min":8.1310000000000002,"15min":8.1310000000000002},"last":0.433}]},{"osd":3,"last update":"Tue Nov 28 20:00:56 2023","interfaces":[{"interface":"back","average":{"1min":0.42899999999999999,"5min":0.68300000000000005,"15min":0.72499999999999998},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.57599999999999996,"5min":4.3949999999999996,"15min":4.3949999999999996},"last":0.34999999999999998},{"interface":"front","average":{"1min":0.48899999999999999,"5min":0.70299999999999996,"15min":0.73899999999999999},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.69899999999999995,"5min":4.3470000000000004,"15min":4.3470000000000004},"last":0.41099999999999998}]},{"osd":4,"last update":"Tue Nov 28 20:00:56 2023","interfaces":[{"interface":"back","average":{"1min":0.71999999999999997,"5min":0.98399999999999999,"15min":1.028},"min":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":1.123,"5min":4.6360000000000001,"15min":4.6360000000000001},"last":0.71299999999999997},{"interface":"front","average":{"1min":0.747,"5min":0.99099999999999999,"15min":1.032},"min":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":0.996,"5min":4.4710000000000001,"15min":4.4710000000000001},"last":0.70099999999999996}]},{"osd":5,"last update":"Tue Nov 28 20:00:56 2023","interfaces":[{"interface":"back","average":{"1min":0.74299999999999999,"5min":1,"15min":1.0429999999999999},"min":{"1min":0.54800000000000004,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":0.96399999999999997,"5min":4.6120000000000001,"15min":4.6120000000000001},"last":0.73399999999999999},{"interface":"front","average":{"1min":0.74199999999999999,"5min":0.98999999999999999,"15min":1.0309999999999999},"min":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"max":{"1min":1.1659999999999999,"5min":4.5449999999999999,"15min":4.5449999999999999},"last":0.79800000000000004}]},{"osd":6,"last update":"Tue Nov 28 20:00:56 2023","interfaces":[{"interface":"back","average":{"1min":0.73499999999999999,"5min":1.01,"15min":1.056},"min":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":1.143,"5min":4.657,"15min":4.657},"last":0.67400000000000004},{"interface":"front","average":{"1min":0.74199999999999999,"5min":1.026,"15min":1.073},"min":{"1min":0.61199999999999999,"5min":0.58899999999999997,"15min":0.58899999999999997},"max":{"1min":1.0109999999999999,"5min":4.5259999999999998,"15min":4.5259999999999998},"last":0.77600000000000002}]},{"osd":7,"last update":"Tue Nov 28 20:00:56 2023","interfaces":[{"interface":"back","average":{"1min":0.72199999999999998,"5min":1.0249999999999999,"15min":1.075},"min":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":1.036,"5min":4.7320000000000002,"15min":4.7320000000000002},"last":0.66000000000000003},{"interface":"front","average":{"1min":0.755,"5min":0.98699999999999999,"15min":1.026},"min":{"1min":0.57499999999999996,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":1.1919999999999999,"5min":4.4939999999999998,"15min":4.4939999999999998},"last":0.75900000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33374,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33374,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":3871,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3107,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":776,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-28T20:01:28.666 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.39 is not active+clean 2023-11-28T20:01:28.666 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.39', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 63, 'state': 'creating+peering', 'last_fresh': '2023-11-28T20:01:22.802967+0000', 'last_change': '2023-11-28T20:01:22.802967+0000', 'last_active': '2023-11-28T20:01:22.787100+0000', 'last_peered': '2023-11-28T20:01:22.787100+0000', 'last_clean': '2023-11-28T20:01:22.787100+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T20:01:22.802967+0000', 'last_undegraded': '2023-11-28T20:01:22.802967+0000', 'last_fullsized': '2023-11-28T20:01:22.802967+0000', 'mapping_epoch': 63, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 63, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T20:01:22.787100+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T20:01:22.787100+0000', 'last_clean_scrub_stamp': '2023-11-28T20:01:22.787100+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 2], 'acting': [6, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-11-28T20:01:28.667 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.38 is not active+clean 2023-11-28T20:01:28.667 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.38', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 63, 'state': 'creating+peering', 'last_fresh': '2023-11-28T20:01:22.800864+0000', 'last_change': '2023-11-28T20:01:22.800864+0000', 'last_active': '2023-11-28T20:01:22.787100+0000', 'last_peered': '2023-11-28T20:01:22.787100+0000', 'last_clean': '2023-11-28T20:01:22.787100+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T20:01:22.800864+0000', 'last_undegraded': '2023-11-28T20:01:22.800864+0000', 'last_fullsized': '2023-11-28T20:01:22.800864+0000', 'mapping_epoch': 63, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 63, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T20:01:22.787100+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T20:01:22.787100+0000', 'last_clean_scrub_stamp': '2023-11-28T20:01:22.787100+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 7], 'acting': [2, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-11-28T20:01:28.667 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.3b is not active+clean 2023-11-28T20:01:28.667 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.3b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 63, 'state': 'creating+peering', 'last_fresh': '2023-11-28T20:01:22.801987+0000', 'last_change': '2023-11-28T20:01:22.801987+0000', 'last_active': '2023-11-28T20:01:22.787100+0000', 'last_peered': '2023-11-28T20:01:22.787100+0000', 'last_clean': '2023-11-28T20:01:22.787100+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T20:01:22.801987+0000', 'last_undegraded': '2023-11-28T20:01:22.801987+0000', 'last_fullsized': '2023-11-28T20:01:22.801987+0000', 'mapping_epoch': 63, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 63, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T20:01:22.787100+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T20:01:22.787100+0000', 'last_clean_scrub_stamp': '2023-11-28T20:01:22.787100+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 7], 'acting': [2, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-11-28T20:01:28.667 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.3a is not active+clean 2023-11-28T20:01:28.667 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.3a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 63, 'state': 'creating+peering', 'last_fresh': '2023-11-28T20:01:22.804075+0000', 'last_change': '2023-11-28T20:01:22.804075+0000', 'last_active': '2023-11-28T20:01:22.787100+0000', 'last_peered': '2023-11-28T20:01:22.787100+0000', 'last_clean': '2023-11-28T20:01:22.787100+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T20:01:22.804075+0000', 'last_undegraded': '2023-11-28T20:01:22.804075+0000', 'last_fullsized': '2023-11-28T20:01:22.804075+0000', 'mapping_epoch': 63, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 63, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T20:01:22.787100+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T20:01:22.787100+0000', 'last_clean_scrub_stamp': '2023-11-28T20:01:22.787100+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 4], 'acting': [3, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-11-28T20:01:28.667 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.3d is not active+clean 2023-11-28T20:01:28.667 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.3d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 63, 'state': 'creating+peering', 'last_fresh': '2023-11-28T20:01:22.809244+0000', 'last_change': '2023-11-28T20:01:22.809244+0000', 'last_active': '2023-11-28T20:01:22.787100+0000', 'last_peered': '2023-11-28T20:01:22.787100+0000', 'last_clean': '2023-11-28T20:01:22.787100+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T20:01:22.809244+0000', 'last_undegraded': '2023-11-28T20:01:22.809244+0000', 'last_fullsized': '2023-11-28T20:01:22.809244+0000', 'mapping_epoch': 63, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 63, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T20:01:22.787100+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T20:01:22.787100+0000', 'last_clean_scrub_stamp': '2023-11-28T20:01:22.787100+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 0], 'acting': [1, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-11-28T20:01:28.668 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.3c is not active+clean 2023-11-28T20:01:28.668 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.3c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 63, 'state': 'creating+peering', 'last_fresh': '2023-11-28T20:01:22.810262+0000', 'last_change': '2023-11-28T20:01:22.810262+0000', 'last_active': '2023-11-28T20:01:22.787100+0000', 'last_peered': '2023-11-28T20:01:22.787100+0000', 'last_clean': '2023-11-28T20:01:22.787100+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T20:01:22.810262+0000', 'last_undegraded': '2023-11-28T20:01:22.810262+0000', 'last_fullsized': '2023-11-28T20:01:22.810262+0000', 'mapping_epoch': 63, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 63, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T20:01:22.787100+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T20:01:22.787100+0000', 'last_clean_scrub_stamp': '2023-11-28T20:01:22.787100+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 4], 'acting': [5, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-11-28T20:01:28.668 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.3f is not active+clean 2023-11-28T20:01:28.668 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.3f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 63, 'state': 'creating+peering', 'last_fresh': '2023-11-28T20:01:22.815237+0000', 'last_change': '2023-11-28T20:01:22.815237+0000', 'last_active': '2023-11-28T20:01:22.787100+0000', 'last_peered': '2023-11-28T20:01:22.787100+0000', 'last_clean': '2023-11-28T20:01:22.787100+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T20:01:22.815237+0000', 'last_undegraded': '2023-11-28T20:01:22.815237+0000', 'last_fullsized': '2023-11-28T20:01:22.815237+0000', 'mapping_epoch': 63, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 63, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T20:01:22.787100+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T20:01:22.787100+0000', 'last_clean_scrub_stamp': '2023-11-28T20:01:22.787100+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 4], 'acting': [7, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-11-28T20:01:28.668 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.3e is not active+clean 2023-11-28T20:01:28.668 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.3e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 63, 'state': 'creating+peering', 'last_fresh': '2023-11-28T20:01:22.812285+0000', 'last_change': '2023-11-28T20:01:22.812285+0000', 'last_active': '2023-11-28T20:01:22.787100+0000', 'last_peered': '2023-11-28T20:01:22.787100+0000', 'last_clean': '2023-11-28T20:01:22.787100+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T20:01:22.812285+0000', 'last_undegraded': '2023-11-28T20:01:22.812285+0000', 'last_fullsized': '2023-11-28T20:01:22.812285+0000', 'mapping_epoch': 63, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 63, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T20:01:22.787100+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T20:01:22.787100+0000', 'last_clean_scrub_stamp': '2023-11-28T20:01:22.787100+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-11-28T20:01:28.668 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.31 is not active+clean 2023-11-28T20:01:28.668 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.31', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 63, 'state': 'creating+peering', 'last_fresh': '2023-11-28T20:01:22.805019+0000', 'last_change': '2023-11-28T20:01:22.805019+0000', 'last_active': '2023-11-28T20:01:22.787100+0000', 'last_peered': '2023-11-28T20:01:22.787100+0000', 'last_clean': '2023-11-28T20:01:22.787100+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T20:01:22.805019+0000', 'last_undegraded': '2023-11-28T20:01:22.805019+0000', 'last_fullsized': '2023-11-28T20:01:22.805019+0000', 'mapping_epoch': 63, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 63, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T20:01:22.787100+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T20:01:22.787100+0000', 'last_clean_scrub_stamp': '2023-11-28T20:01:22.787100+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-11-28T20:01:28.668 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.30 is not active+clean 2023-11-28T20:01:28.669 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.30', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 63, 'state': 'creating+peering', 'last_fresh': '2023-11-28T20:01:22.807023+0000', 'last_change': '2023-11-28T20:01:22.807023+0000', 'last_active': '2023-11-28T20:01:22.787100+0000', 'last_peered': '2023-11-28T20:01:22.787100+0000', 'last_clean': '2023-11-28T20:01:22.787100+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T20:01:22.807023+0000', 'last_undegraded': '2023-11-28T20:01:22.807023+0000', 'last_fullsized': '2023-11-28T20:01:22.807023+0000', 'mapping_epoch': 63, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 63, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T20:01:22.787100+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T20:01:22.787100+0000', 'last_clean_scrub_stamp': '2023-11-28T20:01:22.787100+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 5], 'acting': [7, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-11-28T20:01:28.669 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.33 is not active+clean 2023-11-28T20:01:28.669 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.33', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 63, 'state': 'creating+peering', 'last_fresh': '2023-11-28T20:01:22.801107+0000', 'last_change': '2023-11-28T20:01:22.801107+0000', 'last_active': '2023-11-28T20:01:22.787100+0000', 'last_peered': '2023-11-28T20:01:22.787100+0000', 'last_clean': '2023-11-28T20:01:22.787100+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T20:01:22.801107+0000', 'last_undegraded': '2023-11-28T20:01:22.801107+0000', 'last_fullsized': '2023-11-28T20:01:22.801107+0000', 'mapping_epoch': 63, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 63, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T20:01:22.787100+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T20:01:22.787100+0000', 'last_clean_scrub_stamp': '2023-11-28T20:01:22.787100+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 3], 'acting': [2, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-11-28T20:01:28.669 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.32 is not active+clean 2023-11-28T20:01:28.669 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.32', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 63, 'state': 'creating+peering', 'last_fresh': '2023-11-28T20:01:22.803669+0000', 'last_change': '2023-11-28T20:01:22.803669+0000', 'last_active': '2023-11-28T20:01:22.787100+0000', 'last_peered': '2023-11-28T20:01:22.787100+0000', 'last_clean': '2023-11-28T20:01:22.787100+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T20:01:22.803669+0000', 'last_undegraded': '2023-11-28T20:01:22.803669+0000', 'last_fullsized': '2023-11-28T20:01:22.803669+0000', 'mapping_epoch': 63, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 63, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T20:01:22.787100+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T20:01:22.787100+0000', 'last_clean_scrub_stamp': '2023-11-28T20:01:22.787100+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 4], 'acting': [3, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-11-28T20:01:28.669 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.35 is not active+clean 2023-11-28T20:01:28.669 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.35', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 63, 'state': 'creating+peering', 'last_fresh': '2023-11-28T20:01:22.809408+0000', 'last_change': '2023-11-28T20:01:22.809408+0000', 'last_active': '2023-11-28T20:01:22.787100+0000', 'last_peered': '2023-11-28T20:01:22.787100+0000', 'last_clean': '2023-11-28T20:01:22.787100+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T20:01:22.809408+0000', 'last_undegraded': '2023-11-28T20:01:22.809408+0000', 'last_fullsized': '2023-11-28T20:01:22.809408+0000', 'mapping_epoch': 63, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 63, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T20:01:22.787100+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T20:01:22.787100+0000', 'last_clean_scrub_stamp': '2023-11-28T20:01:22.787100+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-11-28T20:01:28.669 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.34 is not active+clean 2023-11-28T20:01:28.669 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.34', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 63, 'state': 'creating+peering', 'last_fresh': '2023-11-28T20:01:22.809821+0000', 'last_change': '2023-11-28T20:01:22.809821+0000', 'last_active': '2023-11-28T20:01:22.787100+0000', 'last_peered': '2023-11-28T20:01:22.787100+0000', 'last_clean': '2023-11-28T20:01:22.787100+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T20:01:22.809821+0000', 'last_undegraded': '2023-11-28T20:01:22.809821+0000', 'last_fullsized': '2023-11-28T20:01:22.809821+0000', 'mapping_epoch': 63, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 63, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T20:01:22.787100+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T20:01:22.787100+0000', 'last_clean_scrub_stamp': '2023-11-28T20:01:22.787100+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 0], 'acting': [5, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-11-28T20:01:28.670 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.37 is not active+clean 2023-11-28T20:01:28.670 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.37', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 63, 'state': 'creating+peering', 'last_fresh': '2023-11-28T20:01:22.806216+0000', 'last_change': '2023-11-28T20:01:22.806216+0000', 'last_active': '2023-11-28T20:01:22.787100+0000', 'last_peered': '2023-11-28T20:01:22.787100+0000', 'last_clean': '2023-11-28T20:01:22.787100+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T20:01:22.806216+0000', 'last_undegraded': '2023-11-28T20:01:22.806216+0000', 'last_fullsized': '2023-11-28T20:01:22.806216+0000', 'mapping_epoch': 63, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 63, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T20:01:22.787100+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T20:01:22.787100+0000', 'last_clean_scrub_stamp': '2023-11-28T20:01:22.787100+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 3], 'acting': [4, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-11-28T20:01:28.670 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.36 is not active+clean 2023-11-28T20:01:28.670 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.36', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 63, 'state': 'creating+peering', 'last_fresh': '2023-11-28T20:01:22.809354+0000', 'last_change': '2023-11-28T20:01:22.809354+0000', 'last_active': '2023-11-28T20:01:22.787100+0000', 'last_peered': '2023-11-28T20:01:22.787100+0000', 'last_clean': '2023-11-28T20:01:22.787100+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T20:01:22.809354+0000', 'last_undegraded': '2023-11-28T20:01:22.809354+0000', 'last_fullsized': '2023-11-28T20:01:22.809354+0000', 'mapping_epoch': 63, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 63, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T20:01:22.787100+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T20:01:22.787100+0000', 'last_clean_scrub_stamp': '2023-11-28T20:01:22.787100+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 6], 'acting': [5, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-11-28T20:01:28.670 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.29 is not active+clean 2023-11-28T20:01:28.670 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.29', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 63, 'state': 'creating+peering', 'last_fresh': '2023-11-28T20:01:22.805327+0000', 'last_change': '2023-11-28T20:01:22.805327+0000', 'last_active': '2023-11-28T20:01:22.787100+0000', 'last_peered': '2023-11-28T20:01:22.787100+0000', 'last_clean': '2023-11-28T20:01:22.787100+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T20:01:22.805327+0000', 'last_undegraded': '2023-11-28T20:01:22.805327+0000', 'last_fullsized': '2023-11-28T20:01:22.805327+0000', 'mapping_epoch': 63, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 63, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T20:01:22.787100+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T20:01:22.787100+0000', 'last_clean_scrub_stamp': '2023-11-28T20:01:22.787100+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 5], 'acting': [4, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-11-28T20:01:28.670 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.28 is not active+clean 2023-11-28T20:01:28.670 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.28', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 63, 'state': 'creating+peering', 'last_fresh': '2023-11-28T20:01:22.805106+0000', 'last_change': '2023-11-28T20:01:22.805106+0000', 'last_active': '2023-11-28T20:01:22.787100+0000', 'last_peered': '2023-11-28T20:01:22.787100+0000', 'last_clean': '2023-11-28T20:01:22.787100+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T20:01:22.805106+0000', 'last_undegraded': '2023-11-28T20:01:22.805106+0000', 'last_fullsized': '2023-11-28T20:01:22.805106+0000', 'mapping_epoch': 63, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 63, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T20:01:22.787100+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T20:01:22.787100+0000', 'last_clean_scrub_stamp': '2023-11-28T20:01:22.787100+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 3], 'acting': [0, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-11-28T20:01:28.670 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.2b is not active+clean 2023-11-28T20:01:28.670 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.2b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 63, 'state': 'creating+peering', 'last_fresh': '2023-11-28T20:01:22.810297+0000', 'last_change': '2023-11-28T20:01:22.810297+0000', 'last_active': '2023-11-28T20:01:22.787100+0000', 'last_peered': '2023-11-28T20:01:22.787100+0000', 'last_clean': '2023-11-28T20:01:22.787100+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T20:01:22.810297+0000', 'last_undegraded': '2023-11-28T20:01:22.810297+0000', 'last_fullsized': '2023-11-28T20:01:22.810297+0000', 'mapping_epoch': 63, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 63, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T20:01:22.787100+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T20:01:22.787100+0000', 'last_clean_scrub_stamp': '2023-11-28T20:01:22.787100+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 1], 'acting': [4, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-11-28T20:01:28.671 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.2a is not active+clean 2023-11-28T20:01:28.671 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.2a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 63, 'state': 'creating+peering', 'last_fresh': '2023-11-28T20:01:22.800405+0000', 'last_change': '2023-11-28T20:01:22.800405+0000', 'last_active': '2023-11-28T20:01:22.787100+0000', 'last_peered': '2023-11-28T20:01:22.787100+0000', 'last_clean': '2023-11-28T20:01:22.787100+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T20:01:22.800405+0000', 'last_undegraded': '2023-11-28T20:01:22.800405+0000', 'last_fullsized': '2023-11-28T20:01:22.800405+0000', 'mapping_epoch': 63, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 63, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T20:01:22.787100+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T20:01:22.787100+0000', 'last_clean_scrub_stamp': '2023-11-28T20:01:22.787100+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 3], 'acting': [2, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-11-28T20:01:28.671 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.2d is not active+clean 2023-11-28T20:01:28.671 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.2d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 63, 'state': 'creating+peering', 'last_fresh': '2023-11-28T20:01:22.801543+0000', 'last_change': '2023-11-28T20:01:22.801543+0000', 'last_active': '2023-11-28T20:01:22.787100+0000', 'last_peered': '2023-11-28T20:01:22.787100+0000', 'last_clean': '2023-11-28T20:01:22.787100+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T20:01:22.801543+0000', 'last_undegraded': '2023-11-28T20:01:22.801543+0000', 'last_fullsized': '2023-11-28T20:01:22.801543+0000', 'mapping_epoch': 63, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 63, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T20:01:22.787100+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T20:01:22.787100+0000', 'last_clean_scrub_stamp': '2023-11-28T20:01:22.787100+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 2], 'acting': [3, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-11-28T20:01:28.671 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.2c is not active+clean 2023-11-28T20:01:28.671 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.2c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 63, 'state': 'creating+peering', 'last_fresh': '2023-11-28T20:01:22.800383+0000', 'last_change': '2023-11-28T20:01:22.800383+0000', 'last_active': '2023-11-28T20:01:22.787100+0000', 'last_peered': '2023-11-28T20:01:22.787100+0000', 'last_clean': '2023-11-28T20:01:22.787100+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T20:01:22.800383+0000', 'last_undegraded': '2023-11-28T20:01:22.800383+0000', 'last_fullsized': '2023-11-28T20:01:22.800383+0000', 'mapping_epoch': 63, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 63, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T20:01:22.787100+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T20:01:22.787100+0000', 'last_clean_scrub_stamp': '2023-11-28T20:01:22.787100+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 1], 'acting': [2, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-11-28T20:01:28.671 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.2f is not active+clean 2023-11-28T20:01:28.671 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.2f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 63, 'state': 'creating+peering', 'last_fresh': '2023-11-28T20:01:22.800411+0000', 'last_change': '2023-11-28T20:01:22.800411+0000', 'last_active': '2023-11-28T20:01:22.787100+0000', 'last_peered': '2023-11-28T20:01:22.787100+0000', 'last_clean': '2023-11-28T20:01:22.787100+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T20:01:22.800411+0000', 'last_undegraded': '2023-11-28T20:01:22.800411+0000', 'last_fullsized': '2023-11-28T20:01:22.800411+0000', 'mapping_epoch': 63, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 63, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T20:01:22.787100+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T20:01:22.787100+0000', 'last_clean_scrub_stamp': '2023-11-28T20:01:22.787100+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 6], 'acting': [2, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-11-28T20:01:28.672 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.2e is not active+clean 2023-11-28T20:01:28.672 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.2e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 63, 'state': 'creating+peering', 'last_fresh': '2023-11-28T20:01:22.808991+0000', 'last_change': '2023-11-28T20:01:22.808991+0000', 'last_active': '2023-11-28T20:01:22.787100+0000', 'last_peered': '2023-11-28T20:01:22.787100+0000', 'last_clean': '2023-11-28T20:01:22.787100+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T20:01:22.808991+0000', 'last_undegraded': '2023-11-28T20:01:22.808991+0000', 'last_fullsized': '2023-11-28T20:01:22.808991+0000', 'mapping_epoch': 63, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 63, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T20:01:22.787100+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T20:01:22.787100+0000', 'last_clean_scrub_stamp': '2023-11-28T20:01:22.787100+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 4], 'acting': [1, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-11-28T20:01:28.672 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.21 is not active+clean 2023-11-28T20:01:28.672 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.21', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 63, 'state': 'creating+peering', 'last_fresh': '2023-11-28T20:01:22.806976+0000', 'last_change': '2023-11-28T20:01:22.806976+0000', 'last_active': '2023-11-28T20:01:22.787100+0000', 'last_peered': '2023-11-28T20:01:22.787100+0000', 'last_clean': '2023-11-28T20:01:22.787100+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T20:01:22.806976+0000', 'last_undegraded': '2023-11-28T20:01:22.806976+0000', 'last_fullsized': '2023-11-28T20:01:22.806976+0000', 'mapping_epoch': 63, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 63, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T20:01:22.787100+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T20:01:22.787100+0000', 'last_clean_scrub_stamp': '2023-11-28T20:01:22.787100+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 6], 'acting': [1, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-11-28T20:01:28.672 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.20 is not active+clean 2023-11-28T20:01:28.672 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.20', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 63, 'state': 'creating+peering', 'last_fresh': '2023-11-28T20:01:22.808081+0000', 'last_change': '2023-11-28T20:01:22.808081+0000', 'last_active': '2023-11-28T20:01:22.787100+0000', 'last_peered': '2023-11-28T20:01:22.787100+0000', 'last_clean': '2023-11-28T20:01:22.787100+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T20:01:22.808081+0000', 'last_undegraded': '2023-11-28T20:01:22.808081+0000', 'last_fullsized': '2023-11-28T20:01:22.808081+0000', 'mapping_epoch': 63, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 63, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T20:01:22.787100+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T20:01:22.787100+0000', 'last_clean_scrub_stamp': '2023-11-28T20:01:22.787100+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 4], 'acting': [7, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-11-28T20:01:28.672 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.23 is not active+clean 2023-11-28T20:01:28.672 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.23', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 63, 'state': 'creating+peering', 'last_fresh': '2023-11-28T20:01:22.808672+0000', 'last_change': '2023-11-28T20:01:22.808672+0000', 'last_active': '2023-11-28T20:01:22.787100+0000', 'last_peered': '2023-11-28T20:01:22.787100+0000', 'last_clean': '2023-11-28T20:01:22.787100+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T20:01:22.808672+0000', 'last_undegraded': '2023-11-28T20:01:22.808672+0000', 'last_fullsized': '2023-11-28T20:01:22.808672+0000', 'mapping_epoch': 63, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 63, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T20:01:22.787100+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T20:01:22.787100+0000', 'last_clean_scrub_stamp': '2023-11-28T20:01:22.787100+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 6], 'acting': [0, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-11-28T20:01:28.672 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.22 is not active+clean 2023-11-28T20:01:28.673 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.22', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 63, 'state': 'creating+peering', 'last_fresh': '2023-11-28T20:01:22.807092+0000', 'last_change': '2023-11-28T20:01:22.807092+0000', 'last_active': '2023-11-28T20:01:22.787100+0000', 'last_peered': '2023-11-28T20:01:22.787100+0000', 'last_clean': '2023-11-28T20:01:22.787100+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T20:01:22.807092+0000', 'last_undegraded': '2023-11-28T20:01:22.807092+0000', 'last_fullsized': '2023-11-28T20:01:22.807092+0000', 'mapping_epoch': 63, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 63, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T20:01:22.787100+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T20:01:22.787100+0000', 'last_clean_scrub_stamp': '2023-11-28T20:01:22.787100+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 0], 'acting': [7, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-11-28T20:01:28.673 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.25 is not active+clean 2023-11-28T20:01:28.673 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.25', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 63, 'state': 'creating+peering', 'last_fresh': '2023-11-28T20:01:22.815803+0000', 'last_change': '2023-11-28T20:01:22.815803+0000', 'last_active': '2023-11-28T20:01:22.787100+0000', 'last_peered': '2023-11-28T20:01:22.787100+0000', 'last_clean': '2023-11-28T20:01:22.787100+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T20:01:22.815803+0000', 'last_undegraded': '2023-11-28T20:01:22.815803+0000', 'last_fullsized': '2023-11-28T20:01:22.815803+0000', 'mapping_epoch': 63, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 63, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T20:01:22.787100+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T20:01:22.787100+0000', 'last_clean_scrub_stamp': '2023-11-28T20:01:22.787100+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 5], 'acting': [7, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-11-28T20:01:28.673 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.24 is not active+clean 2023-11-28T20:01:28.673 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.24', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 63, 'state': 'creating+peering', 'last_fresh': '2023-11-28T20:01:22.799856+0000', 'last_change': '2023-11-28T20:01:22.799856+0000', 'last_active': '2023-11-28T20:01:22.787100+0000', 'last_peered': '2023-11-28T20:01:22.787100+0000', 'last_clean': '2023-11-28T20:01:22.787100+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T20:01:22.799856+0000', 'last_undegraded': '2023-11-28T20:01:22.799856+0000', 'last_fullsized': '2023-11-28T20:01:22.799856+0000', 'mapping_epoch': 63, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 63, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T20:01:22.787100+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T20:01:22.787100+0000', 'last_clean_scrub_stamp': '2023-11-28T20:01:22.787100+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 5], 'acting': [2, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-11-28T20:01:28.673 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.27 is not active+clean 2023-11-28T20:01:28.673 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.27', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 63, 'state': 'creating+peering', 'last_fresh': '2023-11-28T20:01:22.804472+0000', 'last_change': '2023-11-28T20:01:22.804472+0000', 'last_active': '2023-11-28T20:01:22.787100+0000', 'last_peered': '2023-11-28T20:01:22.787100+0000', 'last_clean': '2023-11-28T20:01:22.787100+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T20:01:22.804472+0000', 'last_undegraded': '2023-11-28T20:01:22.804472+0000', 'last_fullsized': '2023-11-28T20:01:22.804472+0000', 'mapping_epoch': 63, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 63, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T20:01:22.787100+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T20:01:22.787100+0000', 'last_clean_scrub_stamp': '2023-11-28T20:01:22.787100+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 3], 'acting': [0, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-11-28T20:01:28.673 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.26 is not active+clean 2023-11-28T20:01:28.673 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.26', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 63, 'state': 'creating+peering', 'last_fresh': '2023-11-28T20:01:22.808714+0000', 'last_change': '2023-11-28T20:01:22.808714+0000', 'last_active': '2023-11-28T20:01:22.787100+0000', 'last_peered': '2023-11-28T20:01:22.787100+0000', 'last_clean': '2023-11-28T20:01:22.787100+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T20:01:22.808714+0000', 'last_undegraded': '2023-11-28T20:01:22.808714+0000', 'last_fullsized': '2023-11-28T20:01:22.808714+0000', 'mapping_epoch': 63, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 63, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T20:01:22.787100+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T20:01:22.787100+0000', 'last_clean_scrub_stamp': '2023-11-28T20:01:22.787100+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 0], 'acting': [5, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-11-28T20:01:28.674 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.1a is not active+clean 2023-11-28T20:01:28.674 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.1a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 63, 'state': 'creating+peering', 'last_fresh': '2023-11-28T20:01:22.804950+0000', 'last_change': '2023-11-28T20:01:22.804950+0000', 'last_active': '2023-11-28T20:01:22.787100+0000', 'last_peered': '2023-11-28T20:01:22.787100+0000', 'last_clean': '2023-11-28T20:01:22.787100+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T20:01:22.804950+0000', 'last_undegraded': '2023-11-28T20:01:22.804950+0000', 'last_fullsized': '2023-11-28T20:01:22.804950+0000', 'mapping_epoch': 63, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 63, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T20:01:22.787100+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T20:01:22.787100+0000', 'last_clean_scrub_stamp': '2023-11-28T20:01:22.787100+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 3], 'acting': [4, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-11-28T20:01:28.674 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.1b is not active+clean 2023-11-28T20:01:28.674 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.1b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 63, 'state': 'creating+peering', 'last_fresh': '2023-11-28T20:01:22.806830+0000', 'last_change': '2023-11-28T20:01:22.806830+0000', 'last_active': '2023-11-28T20:01:22.787100+0000', 'last_peered': '2023-11-28T20:01:22.787100+0000', 'last_clean': '2023-11-28T20:01:22.787100+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T20:01:22.806830+0000', 'last_undegraded': '2023-11-28T20:01:22.806830+0000', 'last_fullsized': '2023-11-28T20:01:22.806830+0000', 'mapping_epoch': 63, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 63, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T20:01:22.787100+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T20:01:22.787100+0000', 'last_clean_scrub_stamp': '2023-11-28T20:01:22.787100+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 1], 'acting': [4, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-11-28T20:01:28.674 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.18 is not active+clean 2023-11-28T20:01:28.674 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.18', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 63, 'state': 'creating+peering', 'last_fresh': '2023-11-28T20:01:22.807282+0000', 'last_change': '2023-11-28T20:01:22.807282+0000', 'last_active': '2023-11-28T20:01:22.787100+0000', 'last_peered': '2023-11-28T20:01:22.787100+0000', 'last_clean': '2023-11-28T20:01:22.787100+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T20:01:22.807282+0000', 'last_undegraded': '2023-11-28T20:01:22.807282+0000', 'last_fullsized': '2023-11-28T20:01:22.807282+0000', 'mapping_epoch': 63, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 63, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T20:01:22.787100+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T20:01:22.787100+0000', 'last_clean_scrub_stamp': '2023-11-28T20:01:22.787100+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 4], 'acting': [1, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-11-28T20:01:28.674 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.19 is not active+clean 2023-11-28T20:01:28.674 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.19', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 63, 'state': 'creating+peering', 'last_fresh': '2023-11-28T20:01:22.804536+0000', 'last_change': '2023-11-28T20:01:22.804536+0000', 'last_active': '2023-11-28T20:01:22.787100+0000', 'last_peered': '2023-11-28T20:01:22.787100+0000', 'last_clean': '2023-11-28T20:01:22.787100+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T20:01:22.804536+0000', 'last_undegraded': '2023-11-28T20:01:22.804536+0000', 'last_fullsized': '2023-11-28T20:01:22.804536+0000', 'mapping_epoch': 63, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 63, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T20:01:22.787100+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T20:01:22.787100+0000', 'last_clean_scrub_stamp': '2023-11-28T20:01:22.787100+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 5], 'acting': [0, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-11-28T20:01:28.675 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.1e is not active+clean 2023-11-28T20:01:28.675 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.1e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 63, 'state': 'creating+peering', 'last_fresh': '2023-11-28T20:01:22.806058+0000', 'last_change': '2023-11-28T20:01:22.806058+0000', 'last_active': '2023-11-28T20:01:22.787100+0000', 'last_peered': '2023-11-28T20:01:22.787100+0000', 'last_clean': '2023-11-28T20:01:22.787100+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T20:01:22.806058+0000', 'last_undegraded': '2023-11-28T20:01:22.806058+0000', 'last_fullsized': '2023-11-28T20:01:22.806058+0000', 'mapping_epoch': 63, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 63, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T20:01:22.787100+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T20:01:22.787100+0000', 'last_clean_scrub_stamp': '2023-11-28T20:01:22.787100+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 3], 'acting': [4, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-11-28T20:01:28.675 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.1f is not active+clean 2023-11-28T20:01:28.675 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.1f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 63, 'state': 'creating+peering', 'last_fresh': '2023-11-28T20:01:22.808178+0000', 'last_change': '2023-11-28T20:01:22.808178+0000', 'last_active': '2023-11-28T20:01:22.787100+0000', 'last_peered': '2023-11-28T20:01:22.787100+0000', 'last_clean': '2023-11-28T20:01:22.787100+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T20:01:22.808178+0000', 'last_undegraded': '2023-11-28T20:01:22.808178+0000', 'last_fullsized': '2023-11-28T20:01:22.808178+0000', 'mapping_epoch': 63, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 63, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T20:01:22.787100+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T20:01:22.787100+0000', 'last_clean_scrub_stamp': '2023-11-28T20:01:22.787100+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 2], 'acting': [6, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-11-28T20:01:28.675 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.1c is not active+clean 2023-11-28T20:01:28.675 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.1c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 63, 'state': 'creating+peering', 'last_fresh': '2023-11-28T20:01:22.805361+0000', 'last_change': '2023-11-28T20:01:22.805361+0000', 'last_active': '2023-11-28T20:01:22.787100+0000', 'last_peered': '2023-11-28T20:01:22.787100+0000', 'last_clean': '2023-11-28T20:01:22.787100+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T20:01:22.805361+0000', 'last_undegraded': '2023-11-28T20:01:22.805361+0000', 'last_fullsized': '2023-11-28T20:01:22.805361+0000', 'mapping_epoch': 63, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 63, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T20:01:22.787100+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T20:01:22.787100+0000', 'last_clean_scrub_stamp': '2023-11-28T20:01:22.787100+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-11-28T20:01:28.675 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.1d is not active+clean 2023-11-28T20:01:28.675 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.1d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 63, 'state': 'creating+peering', 'last_fresh': '2023-11-28T20:01:22.804949+0000', 'last_change': '2023-11-28T20:01:22.804949+0000', 'last_active': '2023-11-28T20:01:22.787100+0000', 'last_peered': '2023-11-28T20:01:22.787100+0000', 'last_clean': '2023-11-28T20:01:22.787100+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T20:01:22.804949+0000', 'last_undegraded': '2023-11-28T20:01:22.804949+0000', 'last_fullsized': '2023-11-28T20:01:22.804949+0000', 'mapping_epoch': 63, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 63, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T20:01:22.787100+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T20:01:22.787100+0000', 'last_clean_scrub_stamp': '2023-11-28T20:01:22.787100+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-11-28T20:01:28.675 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.12 is not active+clean 2023-11-28T20:01:28.676 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.12', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 63, 'state': 'creating+peering', 'last_fresh': '2023-11-28T20:01:22.801913+0000', 'last_change': '2023-11-28T20:01:22.801913+0000', 'last_active': '2023-11-28T20:01:22.787100+0000', 'last_peered': '2023-11-28T20:01:22.787100+0000', 'last_clean': '2023-11-28T20:01:22.787100+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T20:01:22.801913+0000', 'last_undegraded': '2023-11-28T20:01:22.801913+0000', 'last_fullsized': '2023-11-28T20:01:22.801913+0000', 'mapping_epoch': 63, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 63, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T20:01:22.787100+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T20:01:22.787100+0000', 'last_clean_scrub_stamp': '2023-11-28T20:01:22.787100+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 1], 'acting': [3, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-11-28T20:01:28.676 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.13 is not active+clean 2023-11-28T20:01:28.676 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.13', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 63, 'state': 'creating+peering', 'last_fresh': '2023-11-28T20:01:22.809235+0000', 'last_change': '2023-11-28T20:01:22.809235+0000', 'last_active': '2023-11-28T20:01:22.787100+0000', 'last_peered': '2023-11-28T20:01:22.787100+0000', 'last_clean': '2023-11-28T20:01:22.787100+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T20:01:22.809235+0000', 'last_undegraded': '2023-11-28T20:01:22.809235+0000', 'last_fullsized': '2023-11-28T20:01:22.809235+0000', 'mapping_epoch': 63, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 63, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T20:01:22.787100+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T20:01:22.787100+0000', 'last_clean_scrub_stamp': '2023-11-28T20:01:22.787100+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 0], 'acting': [1, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-11-28T20:01:28.676 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.10 is not active+clean 2023-11-28T20:01:28.676 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.10', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 63, 'state': 'creating+peering', 'last_fresh': '2023-11-28T20:01:22.804660+0000', 'last_change': '2023-11-28T20:01:22.804660+0000', 'last_active': '2023-11-28T20:01:22.787100+0000', 'last_peered': '2023-11-28T20:01:22.787100+0000', 'last_clean': '2023-11-28T20:01:22.787100+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T20:01:22.804660+0000', 'last_undegraded': '2023-11-28T20:01:22.804660+0000', 'last_fullsized': '2023-11-28T20:01:22.804660+0000', 'mapping_epoch': 63, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 63, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T20:01:22.787100+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T20:01:22.787100+0000', 'last_clean_scrub_stamp': '2023-11-28T20:01:22.787100+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 7], 'acting': [0, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-11-28T20:01:28.676 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.11 is not active+clean 2023-11-28T20:01:28.676 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.11', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 63, 'state': 'creating+peering', 'last_fresh': '2023-11-28T20:01:22.808212+0000', 'last_change': '2023-11-28T20:01:22.808212+0000', 'last_active': '2023-11-28T20:01:22.787100+0000', 'last_peered': '2023-11-28T20:01:22.787100+0000', 'last_clean': '2023-11-28T20:01:22.787100+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T20:01:22.808212+0000', 'last_undegraded': '2023-11-28T20:01:22.808212+0000', 'last_fullsized': '2023-11-28T20:01:22.808212+0000', 'mapping_epoch': 63, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 63, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T20:01:22.787100+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T20:01:22.787100+0000', 'last_clean_scrub_stamp': '2023-11-28T20:01:22.787100+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 4], 'acting': [5, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-11-28T20:01:28.677 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.16 is not active+clean 2023-11-28T20:01:28.677 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.16', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 63, 'state': 'creating+peering', 'last_fresh': '2023-11-28T20:01:22.802114+0000', 'last_change': '2023-11-28T20:01:22.802114+0000', 'last_active': '2023-11-28T20:01:22.787100+0000', 'last_peered': '2023-11-28T20:01:22.787100+0000', 'last_clean': '2023-11-28T20:01:22.787100+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T20:01:22.802114+0000', 'last_undegraded': '2023-11-28T20:01:22.802114+0000', 'last_fullsized': '2023-11-28T20:01:22.802114+0000', 'mapping_epoch': 63, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 63, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T20:01:22.787100+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T20:01:22.787100+0000', 'last_clean_scrub_stamp': '2023-11-28T20:01:22.787100+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 4], 'acting': [6, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-11-28T20:01:28.677 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.17 is not active+clean 2023-11-28T20:01:28.677 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.17', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 63, 'state': 'creating+peering', 'last_fresh': '2023-11-28T20:01:22.807329+0000', 'last_change': '2023-11-28T20:01:22.807329+0000', 'last_active': '2023-11-28T20:01:22.787100+0000', 'last_peered': '2023-11-28T20:01:22.787100+0000', 'last_clean': '2023-11-28T20:01:22.787100+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T20:01:22.807329+0000', 'last_undegraded': '2023-11-28T20:01:22.807329+0000', 'last_fullsized': '2023-11-28T20:01:22.807329+0000', 'mapping_epoch': 63, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 63, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T20:01:22.787100+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T20:01:22.787100+0000', 'last_clean_scrub_stamp': '2023-11-28T20:01:22.787100+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 3], 'acting': [6, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-11-28T20:01:28.677 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.14 is not active+clean 2023-11-28T20:01:28.677 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.14', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 63, 'state': 'creating+peering', 'last_fresh': '2023-11-28T20:01:22.809339+0000', 'last_change': '2023-11-28T20:01:22.809339+0000', 'last_active': '2023-11-28T20:01:22.787100+0000', 'last_peered': '2023-11-28T20:01:22.787100+0000', 'last_clean': '2023-11-28T20:01:22.787100+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T20:01:22.809339+0000', 'last_undegraded': '2023-11-28T20:01:22.809339+0000', 'last_fullsized': '2023-11-28T20:01:22.809339+0000', 'mapping_epoch': 63, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 63, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T20:01:22.787100+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T20:01:22.787100+0000', 'last_clean_scrub_stamp': '2023-11-28T20:01:22.787100+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 3], 'acting': [5, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-11-28T20:01:28.677 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.15 is not active+clean 2023-11-28T20:01:28.677 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.15', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 63, 'state': 'creating+peering', 'last_fresh': '2023-11-28T20:01:22.803505+0000', 'last_change': '2023-11-28T20:01:22.803505+0000', 'last_active': '2023-11-28T20:01:22.787100+0000', 'last_peered': '2023-11-28T20:01:22.787100+0000', 'last_clean': '2023-11-28T20:01:22.787100+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T20:01:22.803505+0000', 'last_undegraded': '2023-11-28T20:01:22.803505+0000', 'last_fullsized': '2023-11-28T20:01:22.803505+0000', 'mapping_epoch': 63, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 63, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T20:01:22.787100+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T20:01:22.787100+0000', 'last_clean_scrub_stamp': '2023-11-28T20:01:22.787100+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 1], 'acting': [6, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-11-28T20:01:28.677 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.a is not active+clean 2023-11-28T20:01:28.677 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 63, 'state': 'creating+peering', 'last_fresh': '2023-11-28T20:01:22.799813+0000', 'last_change': '2023-11-28T20:01:22.799813+0000', 'last_active': '2023-11-28T20:01:22.787100+0000', 'last_peered': '2023-11-28T20:01:22.787100+0000', 'last_clean': '2023-11-28T20:01:22.787100+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T20:01:22.799813+0000', 'last_undegraded': '2023-11-28T20:01:22.799813+0000', 'last_fullsized': '2023-11-28T20:01:22.799813+0000', 'mapping_epoch': 63, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 63, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T20:01:22.787100+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T20:01:22.787100+0000', 'last_clean_scrub_stamp': '2023-11-28T20:01:22.787100+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 0], 'acting': [2, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-11-28T20:01:28.678 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.b is not active+clean 2023-11-28T20:01:28.678 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 63, 'state': 'creating+peering', 'last_fresh': '2023-11-28T20:01:22.801666+0000', 'last_change': '2023-11-28T20:01:22.801666+0000', 'last_active': '2023-11-28T20:01:22.787100+0000', 'last_peered': '2023-11-28T20:01:22.787100+0000', 'last_clean': '2023-11-28T20:01:22.787100+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T20:01:22.801666+0000', 'last_undegraded': '2023-11-28T20:01:22.801666+0000', 'last_fullsized': '2023-11-28T20:01:22.801666+0000', 'mapping_epoch': 63, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 63, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T20:01:22.787100+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T20:01:22.787100+0000', 'last_clean_scrub_stamp': '2023-11-28T20:01:22.787100+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 2], 'acting': [3, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-11-28T20:01:28.678 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.8 is not active+clean 2023-11-28T20:01:28.678 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.8', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 63, 'state': 'creating+peering', 'last_fresh': '2023-11-28T20:01:22.801498+0000', 'last_change': '2023-11-28T20:01:22.801498+0000', 'last_active': '2023-11-28T20:01:22.787100+0000', 'last_peered': '2023-11-28T20:01:22.787100+0000', 'last_clean': '2023-11-28T20:01:22.787100+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T20:01:22.801498+0000', 'last_undegraded': '2023-11-28T20:01:22.801498+0000', 'last_fullsized': '2023-11-28T20:01:22.801498+0000', 'mapping_epoch': 63, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 63, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T20:01:22.787100+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T20:01:22.787100+0000', 'last_clean_scrub_stamp': '2023-11-28T20:01:22.787100+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 2], 'acting': [3, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-11-28T20:01:28.678 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.9 is not active+clean 2023-11-28T20:01:28.678 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.9', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 63, 'state': 'creating+peering', 'last_fresh': '2023-11-28T20:01:22.799812+0000', 'last_change': '2023-11-28T20:01:22.799812+0000', 'last_active': '2023-11-28T20:01:22.787100+0000', 'last_peered': '2023-11-28T20:01:22.787100+0000', 'last_clean': '2023-11-28T20:01:22.787100+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T20:01:22.799812+0000', 'last_undegraded': '2023-11-28T20:01:22.799812+0000', 'last_fullsized': '2023-11-28T20:01:22.799812+0000', 'mapping_epoch': 63, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 63, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T20:01:22.787100+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T20:01:22.787100+0000', 'last_clean_scrub_stamp': '2023-11-28T20:01:22.787100+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 6], 'acting': [2, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-11-28T20:01:28.678 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.e is not active+clean 2023-11-28T20:01:28.678 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 63, 'state': 'creating+peering', 'last_fresh': '2023-11-28T20:01:22.808106+0000', 'last_change': '2023-11-28T20:01:22.808106+0000', 'last_active': '2023-11-28T20:01:22.787100+0000', 'last_peered': '2023-11-28T20:01:22.787100+0000', 'last_clean': '2023-11-28T20:01:22.787100+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T20:01:22.808106+0000', 'last_undegraded': '2023-11-28T20:01:22.808106+0000', 'last_fullsized': '2023-11-28T20:01:22.808106+0000', 'mapping_epoch': 63, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 63, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T20:01:22.787100+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T20:01:22.787100+0000', 'last_clean_scrub_stamp': '2023-11-28T20:01:22.787100+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 4], 'acting': [0, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-11-28T20:01:28.678 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.f is not active+clean 2023-11-28T20:01:28.679 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 63, 'state': 'creating+peering', 'last_fresh': '2023-11-28T20:01:22.804656+0000', 'last_change': '2023-11-28T20:01:22.804656+0000', 'last_active': '2023-11-28T20:01:22.787100+0000', 'last_peered': '2023-11-28T20:01:22.787100+0000', 'last_clean': '2023-11-28T20:01:22.787100+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T20:01:22.804656+0000', 'last_undegraded': '2023-11-28T20:01:22.804656+0000', 'last_fullsized': '2023-11-28T20:01:22.804656+0000', 'mapping_epoch': 63, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 63, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T20:01:22.787100+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T20:01:22.787100+0000', 'last_clean_scrub_stamp': '2023-11-28T20:01:22.787100+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 5], 'acting': [6, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-11-28T20:01:28.679 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.c is not active+clean 2023-11-28T20:01:28.679 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 63, 'state': 'creating+peering', 'last_fresh': '2023-11-28T20:01:22.804042+0000', 'last_change': '2023-11-28T20:01:22.804042+0000', 'last_active': '2023-11-28T20:01:22.787100+0000', 'last_peered': '2023-11-28T20:01:22.787100+0000', 'last_clean': '2023-11-28T20:01:22.787100+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T20:01:22.804042+0000', 'last_undegraded': '2023-11-28T20:01:22.804042+0000', 'last_fullsized': '2023-11-28T20:01:22.804042+0000', 'mapping_epoch': 63, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 63, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T20:01:22.787100+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T20:01:22.787100+0000', 'last_clean_scrub_stamp': '2023-11-28T20:01:22.787100+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 5], 'acting': [0, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-11-28T20:01:28.679 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.2 is not active+clean 2023-11-28T20:01:28.679 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.2', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 63, 'state': 'creating+peering', 'last_fresh': '2023-11-28T20:01:22.804217+0000', 'last_change': '2023-11-28T20:01:22.804217+0000', 'last_active': '2023-11-28T20:01:22.787100+0000', 'last_peered': '2023-11-28T20:01:22.787100+0000', 'last_clean': '2023-11-28T20:01:22.787100+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T20:01:22.804217+0000', 'last_undegraded': '2023-11-28T20:01:22.804217+0000', 'last_fullsized': '2023-11-28T20:01:22.804217+0000', 'mapping_epoch': 63, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 63, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T20:01:22.787100+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T20:01:22.787100+0000', 'last_clean_scrub_stamp': '2023-11-28T20:01:22.787100+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 3], 'acting': [4, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-11-28T20:01:28.679 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.3 is not active+clean 2023-11-28T20:01:28.679 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.3', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 63, 'state': 'creating+peering', 'last_fresh': '2023-11-28T20:01:22.804042+0000', 'last_change': '2023-11-28T20:01:22.804042+0000', 'last_active': '2023-11-28T20:01:22.787100+0000', 'last_peered': '2023-11-28T20:01:22.787100+0000', 'last_clean': '2023-11-28T20:01:22.787100+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T20:01:22.804042+0000', 'last_undegraded': '2023-11-28T20:01:22.804042+0000', 'last_fullsized': '2023-11-28T20:01:22.804042+0000', 'mapping_epoch': 63, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 63, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T20:01:22.787100+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T20:01:22.787100+0000', 'last_clean_scrub_stamp': '2023-11-28T20:01:22.787100+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 7], 'acting': [0, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-11-28T20:01:28.679 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.0 is not active+clean 2023-11-28T20:01:28.679 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.0', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 63, 'state': 'creating+peering', 'last_fresh': '2023-11-28T20:01:22.801672+0000', 'last_change': '2023-11-28T20:01:22.801672+0000', 'last_active': '2023-11-28T20:01:22.787100+0000', 'last_peered': '2023-11-28T20:01:22.787100+0000', 'last_clean': '2023-11-28T20:01:22.787100+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T20:01:22.801672+0000', 'last_undegraded': '2023-11-28T20:01:22.801672+0000', 'last_fullsized': '2023-11-28T20:01:22.801672+0000', 'mapping_epoch': 63, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 63, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T20:01:22.787100+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T20:01:22.787100+0000', 'last_clean_scrub_stamp': '2023-11-28T20:01:22.787100+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 6], 'acting': [4, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-11-28T20:01:28.679 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.1 is not active+clean 2023-11-28T20:01:28.680 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.1', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 63, 'state': 'creating+peering', 'last_fresh': '2023-11-28T20:01:22.802259+0000', 'last_change': '2023-11-28T20:01:22.802259+0000', 'last_active': '2023-11-28T20:01:22.787100+0000', 'last_peered': '2023-11-28T20:01:22.787100+0000', 'last_clean': '2023-11-28T20:01:22.787100+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T20:01:22.802259+0000', 'last_undegraded': '2023-11-28T20:01:22.802259+0000', 'last_fullsized': '2023-11-28T20:01:22.802259+0000', 'mapping_epoch': 63, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 63, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T20:01:22.787100+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T20:01:22.787100+0000', 'last_clean_scrub_stamp': '2023-11-28T20:01:22.787100+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 3], 'acting': [6, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-11-28T20:01:28.680 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.6 is not active+clean 2023-11-28T20:01:28.680 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.6', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 63, 'state': 'creating+peering', 'last_fresh': '2023-11-28T20:01:22.810260+0000', 'last_change': '2023-11-28T20:01:22.810260+0000', 'last_active': '2023-11-28T20:01:22.787100+0000', 'last_peered': '2023-11-28T20:01:22.787100+0000', 'last_clean': '2023-11-28T20:01:22.787100+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T20:01:22.810260+0000', 'last_undegraded': '2023-11-28T20:01:22.810260+0000', 'last_fullsized': '2023-11-28T20:01:22.810260+0000', 'mapping_epoch': 63, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 63, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T20:01:22.787100+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T20:01:22.787100+0000', 'last_clean_scrub_stamp': '2023-11-28T20:01:22.787100+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 0], 'acting': [1, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-11-28T20:01:28.680 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.7 is not active+clean 2023-11-28T20:01:28.680 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.7', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 63, 'state': 'creating+peering', 'last_fresh': '2023-11-28T20:01:22.807763+0000', 'last_change': '2023-11-28T20:01:22.807763+0000', 'last_active': '2023-11-28T20:01:22.787100+0000', 'last_peered': '2023-11-28T20:01:22.787100+0000', 'last_clean': '2023-11-28T20:01:22.787100+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T20:01:22.807763+0000', 'last_undegraded': '2023-11-28T20:01:22.807763+0000', 'last_fullsized': '2023-11-28T20:01:22.807763+0000', 'mapping_epoch': 63, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 63, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T20:01:22.787100+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T20:01:22.787100+0000', 'last_clean_scrub_stamp': '2023-11-28T20:01:22.787100+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 7], 'acting': [1, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-11-28T20:01:28.680 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.4 is not active+clean 2023-11-28T20:01:28.680 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.4', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 63, 'state': 'creating+peering', 'last_fresh': '2023-11-28T20:01:22.802494+0000', 'last_change': '2023-11-28T20:01:22.802494+0000', 'last_active': '2023-11-28T20:01:22.787100+0000', 'last_peered': '2023-11-28T20:01:22.787100+0000', 'last_clean': '2023-11-28T20:01:22.787100+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T20:01:22.802494+0000', 'last_undegraded': '2023-11-28T20:01:22.802494+0000', 'last_fullsized': '2023-11-28T20:01:22.802494+0000', 'mapping_epoch': 63, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 63, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T20:01:22.787100+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T20:01:22.787100+0000', 'last_clean_scrub_stamp': '2023-11-28T20:01:22.787100+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 3], 'acting': [6, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-11-28T20:01:28.680 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.5 is not active+clean 2023-11-28T20:01:28.680 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.5', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 63, 'state': 'creating+peering', 'last_fresh': '2023-11-28T20:01:22.803024+0000', 'last_change': '2023-11-28T20:01:22.803024+0000', 'last_active': '2023-11-28T20:01:22.787100+0000', 'last_peered': '2023-11-28T20:01:22.787100+0000', 'last_clean': '2023-11-28T20:01:22.787100+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T20:01:22.803024+0000', 'last_undegraded': '2023-11-28T20:01:22.803024+0000', 'last_fullsized': '2023-11-28T20:01:22.803024+0000', 'mapping_epoch': 63, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 63, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T20:01:22.787100+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T20:01:22.787100+0000', 'last_clean_scrub_stamp': '2023-11-28T20:01:22.787100+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 2], 'acting': [6, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-11-28T20:01:28.680 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.d is not active+clean 2023-11-28T20:01:28.681 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 63, 'state': 'creating+peering', 'last_fresh': '2023-11-28T20:01:22.816355+0000', 'last_change': '2023-11-28T20:01:22.816355+0000', 'last_active': '2023-11-28T20:01:22.787100+0000', 'last_peered': '2023-11-28T20:01:22.787100+0000', 'last_clean': '2023-11-28T20:01:22.787100+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T20:01:22.816355+0000', 'last_undegraded': '2023-11-28T20:01:22.816355+0000', 'last_fullsized': '2023-11-28T20:01:22.816355+0000', 'mapping_epoch': 63, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 63, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T20:01:22.787100+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T20:01:22.787100+0000', 'last_clean_scrub_stamp': '2023-11-28T20:01:22.787100+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 1], 'acting': [7, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-11-28T20:01:28.681 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2023-11-28T20:01:28.831 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:28.825+0000 7fd43b0fe640 1 Processor -- start 2023-11-28T20:01:28.832 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:28.829+0000 7fd43b0fe640 1 -- start start 2023-11-28T20:01:28.832 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:28.829+0000 7fd43b0fe640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd434154f20 0x7fd43406b9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:28.833 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:28.829+0000 7fd43b0fe640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fd43406bf30 0x7fd43415ee20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:28.833 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:28.829+0000 7fd43b0fe640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd43406c380 con 0x7fd4340af4c0 2023-11-28T20:01:28.833 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:28.829+0000 7fd43b0fe640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd4340c4890 con 0x7fd43406bf30 2023-11-28T20:01:28.833 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:28.829+0000 7fd43b0fe640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd4341553a0 con 0x7fd434154f20 2023-11-28T20:01:28.833 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:28.829+0000 7fd438e9a640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7fd4340af4c0 0x7fd4340c67d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:37198/0 (socket says 172.21.15.78:37198) 2023-11-28T20:01:28.833 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:28.829+0000 7fd438e9a640 1 -- 172.21.15.78:0/4076786279 learned_addr learned my addr 172.21.15.78:0/4076786279 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-11-28T20:01:28.835 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:28.829+0000 7fd42b7fe640 1 -- 172.21.15.78:0/4076786279 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2558088021 0 0) 0x7fd43406c380 con 0x7fd4340af4c0 2023-11-28T20:01:28.835 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:28.829+0000 7fd42b7fe640 1 -- 172.21.15.78:0/4076786279 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd41c003530 con 0x7fd4340af4c0 2023-11-28T20:01:28.836 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:28.829+0000 7fd43969b640 1 --2- 172.21.15.78:0/4076786279 >> v2:172.21.15.179:3300/0 conn(0x7fd43406bf30 0x7fd43415ee20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:28.836 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:28.829+0000 7fd42bfff640 1 --2- 172.21.15.78:0/4076786279 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd434154f20 0x7fd43406b9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:28.836 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:28.829+0000 7fd42b7fe640 1 -- 172.21.15.78:0/4076786279 <== mon.0 v1:172.21.15.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 712795535 0 0) 0x7fd41c003530 con 0x7fd4340af4c0 2023-11-28T20:01:28.836 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:28.829+0000 7fd42b7fe640 1 -- 172.21.15.78:0/4076786279 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd434154f20 msgr2=0x7fd43406b9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:01:28.836 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:28.829+0000 7fd42b7fe640 1 --2- 172.21.15.78:0/4076786279 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd434154f20 0x7fd43406b9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:28.836 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:28.829+0000 7fd42b7fe640 1 -- 172.21.15.78:0/4076786279 >> v2:172.21.15.179:3300/0 conn(0x7fd43406bf30 msgr2=0x7fd43415ee20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:01:28.836 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:28.829+0000 7fd42b7fe640 1 --2- 172.21.15.78:0/4076786279 >> v2:172.21.15.179:3300/0 conn(0x7fd43406bf30 0x7fd43415ee20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:28.836 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:28.829+0000 7fd42b7fe640 1 -- 172.21.15.78:0/4076786279 --> v1:172.21.15.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4340af8a0 con 0x7fd4340af4c0 2023-11-28T20:01:28.836 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:28.829+0000 7fd42b7fe640 1 -- 172.21.15.78:0/4076786279 <== mon.0 v1:172.21.15.78:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3326804700 0 0) 0x7fd430001680 con 0x7fd4340af4c0 2023-11-28T20:01:28.837 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:28.829+0000 7fd42b7fe640 1 -- 172.21.15.78:0/4076786279 >> v1:172.21.15.78:6789/0 conn(0x7fd4340af4c0 legacy=0x7fd4340c67d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:01:28.837 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:28.829+0000 7fd42b7fe640 1 --2- 172.21.15.78:0/4076786279 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd434154f20 0x7fd41c003980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:28.837 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:28.829+0000 7fd42b7fe640 1 --2- 172.21.15.78:0/4076786279 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd41c004000 0x7fd41c0047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:28.837 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:28.829+0000 7fd42b7fe640 1 --2- 172.21.15.78:0/4076786279 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd41c004d10 0x7fd41c005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:28.837 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:28.829+0000 7fd42b7fe640 1 -- 172.21.15.78:0/4076786279 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4340c4890 con 0x7fd41c004d10 2023-11-28T20:01:28.837 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:28.829+0000 7fd42b7fe640 1 -- 172.21.15.78:0/4076786279 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4341553a0 con 0x7fd41c004000 2023-11-28T20:01:28.837 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:28.829+0000 7fd42b7fe640 1 -- 172.21.15.78:0/4076786279 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd41c00bba0 con 0x7fd434154f20 2023-11-28T20:01:28.837 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:28.829+0000 7fd43969b640 1 --2- 172.21.15.78:0/4076786279 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd41c004d10 0x7fd41c005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:28.837 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:28.829+0000 7fd42bfff640 1 --2- 172.21.15.78:0/4076786279 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd41c004000 0x7fd41c0047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:28.837 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:28.829+0000 7fd438e9a640 1 --2- 172.21.15.78:0/4076786279 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd434154f20 0x7fd41c003980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:28.838 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:28.829+0000 7fd43969b640 1 -- 172.21.15.78:0/4076786279 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd434154f20 msgr2=0x7fd41c003980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:01:28.838 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:28.829+0000 7fd43969b640 1 --2- 172.21.15.78:0/4076786279 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd434154f20 0x7fd41c003980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:28.838 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:28.829+0000 7fd43969b640 1 -- 172.21.15.78:0/4076786279 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd41c004000 msgr2=0x7fd41c0047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:01:28.838 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:28.829+0000 7fd43969b640 1 --2- 172.21.15.78:0/4076786279 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd41c004000 0x7fd41c0047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:28.838 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:28.829+0000 7fd43969b640 1 -- 172.21.15.78:0/4076786279 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd41c003530 con 0x7fd41c004d10 2023-11-28T20:01:28.838 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:28.829+0000 7fd42bfff640 1 --2- 172.21.15.78:0/4076786279 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd41c004000 0x7fd41c0047d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T20:01:28.839 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:28.833+0000 7fd43969b640 1 --2- 172.21.15.78:0/4076786279 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd41c004d10 0x7fd41c005190 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7fd42c007360 tx=0x7fd42c01ce20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e99e988fafed49c0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:01:28.840 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:28.833+0000 7fd42b7fe640 1 -- 172.21.15.78:0/4076786279 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd42c0a5d60 con 0x7fd41c004d10 2023-11-28T20:01:28.840 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:28.833+0000 7fd42b7fe640 1 -- 172.21.15.78:0/4076786279 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd42c0ad440 con 0x7fd41c004d10 2023-11-28T20:01:28.840 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:28.833+0000 7fd42b7fe640 1 -- 172.21.15.78:0/4076786279 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd42c0ad7d0 con 0x7fd41c004d10 2023-11-28T20:01:28.840 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:28.833+0000 7fd43b0fe640 1 -- 172.21.15.78:0/4076786279 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd41c004d10 msgr2=0x7fd41c005190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:01:28.840 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:28.833+0000 7fd43b0fe640 1 --2- 172.21.15.78:0/4076786279 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd41c004d10 0x7fd41c005190 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7fd42c007360 tx=0x7fd42c01ce20 comp rx=0 tx=0).stop 2023-11-28T20:01:28.840 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:28.833+0000 7fd43969b640 1 -- 172.21.15.78:0/4076786279 reap_dead start 2023-11-28T20:01:28.840 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:28.833+0000 7fd43b0fe640 1 -- 172.21.15.78:0/4076786279 shutdown_connections 2023-11-28T20:01:28.841 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:28.833+0000 7fd43b0fe640 1 -- 172.21.15.78:0/4076786279 >> 172.21.15.78:0/4076786279 conn(0x7fd4340ab9d0 msgr2=0x7fd4340abde0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:01:28.841 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:28.833+0000 7fd43b0fe640 1 -- 172.21.15.78:0/4076786279 shutdown_connections 2023-11-28T20:01:28.841 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:28.833+0000 7fd43b0fe640 1 -- 172.21.15.78:0/4076786279 wait complete. 2023-11-28T20:01:28.844 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:28.837+0000 7fd43b0fe640 1 Processor -- start 2023-11-28T20:01:28.844 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:28.837+0000 7fd43b0fe640 1 -- start start 2023-11-28T20:01:28.844 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:28.837+0000 7fd43b0fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd41c004d10 0x7fd4340c3130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:28.844 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:28.837+0000 7fd43b0fe640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd4340c0eb0 0x7fd4341ecd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:28.844 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:28.837+0000 7fd43b0fe640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd4340ae110 0x7fd4341ea040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:28.844 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:28.837+0000 7fd43b0fe640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4340c15b0 con 0x7fd41c004d10 2023-11-28T20:01:28.844 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:28.837+0000 7fd43b0fe640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd434152310 con 0x7fd4340ae110 2023-11-28T20:01:28.845 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:28.837+0000 7fd43b0fe640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd4341525f0 con 0x7fd4340c0eb0 2023-11-28T20:01:28.845 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:28.837+0000 7fd438e9a640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd41c004d10 0x7fd4340c3130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:28.845 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:28.837+0000 7fd438e9a640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd41c004d10 0x7fd4340c3130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:36240/0 (socket says 172.21.15.78:36240) 2023-11-28T20:01:28.845 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:28.837+0000 7fd438e9a640 1 -- 172.21.15.78:0/3858645354 learned_addr learned my addr 172.21.15.78:0/3858645354 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T20:01:28.845 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:28.837+0000 7fd42bfff640 1 --2- 172.21.15.78:0/3858645354 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd4340c0eb0 0x7fd4341ecd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:28.845 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:28.837+0000 7fd43969b640 1 --2- 172.21.15.78:0/3858645354 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd4340ae110 0x7fd4341ea040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:28.845 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:28.837+0000 7fd438e9a640 1 -- 172.21.15.78:0/3858645354 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd4340c0eb0 msgr2=0x7fd4341ecd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:01:28.845 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:28.837+0000 7fd438e9a640 1 --2- 172.21.15.78:0/3858645354 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd4340c0eb0 0x7fd4341ecd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:28.846 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:28.837+0000 7fd438e9a640 1 -- 172.21.15.78:0/3858645354 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd4340ae110 msgr2=0x7fd4341ea040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:01:28.846 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:28.837+0000 7fd438e9a640 1 --2- 172.21.15.78:0/3858645354 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd4340ae110 0x7fd4341ea040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:28.846 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:28.837+0000 7fd438e9a640 1 -- 172.21.15.78:0/3858645354 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4341528d0 con 0x7fd41c004d10 2023-11-28T20:01:28.846 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:28.837+0000 7fd43969b640 1 --2- 172.21.15.78:0/3858645354 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd4340ae110 0x7fd4341ea040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T20:01:28.846 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:28.837+0000 7fd438e9a640 1 --2- 172.21.15.78:0/3858645354 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd41c004d10 0x7fd4340c3130 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7fd430011910 tx=0x7fd430011dd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:01:28.846 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:28.837+0000 7fd4297fa640 1 -- 172.21.15.78:0/3858645354 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4300016e0 con 0x7fd41c004d10 2023-11-28T20:01:28.846 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:28.837+0000 7fd4297fa640 1 -- 172.21.15.78:0/3858645354 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd43000fc60 con 0x7fd41c004d10 2023-11-28T20:01:28.846 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:28.837+0000 7fd43b0fe640 1 -- 172.21.15.78:0/3858645354 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd4341e9b20 con 0x7fd41c004d10 2023-11-28T20:01:28.846 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:28.837+0000 7fd4297fa640 1 -- 172.21.15.78:0/3858645354 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd430015410 con 0x7fd41c004d10 2023-11-28T20:01:28.847 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:28.837+0000 7fd43b0fe640 1 -- 172.21.15.78:0/3858645354 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd4341e97d0 con 0x7fd41c004d10 2023-11-28T20:01:28.847 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:28.841+0000 7fd43b0fe640 1 -- 172.21.15.78:0/3858645354 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd4341e9d10 con 0x7fd41c004d10 2023-11-28T20:01:28.847 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:28.841+0000 7fd4297fa640 1 -- 172.21.15.78:0/3858645354 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fd430015570 con 0x7fd41c004d10 2023-11-28T20:01:28.848 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:28.841+0000 7fd4297fa640 1 --2- 172.21.15.78:0/3858645354 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fd4200664a0 0x7fd420068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:28.848 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:28.841+0000 7fd4297fa640 1 -- 172.21.15.78:0/3858645354 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 6885+0+0 (secure 0 0 0) 0x7fd4300876c0 con 0x7fd41c004d10 2023-11-28T20:01:28.848 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:28.841+0000 7fd42bfff640 1 --2- 172.21.15.78:0/3858645354 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fd4200664a0 0x7fd420068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:28.848 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:28.841+0000 7fd42bfff640 1 --2- 172.21.15.78:0/3858645354 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fd4200664a0 0x7fd420068960 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7fd4341ede60 tx=0x7fd424008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:01:28.849 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:28.845+0000 7fd4297fa640 1 -- 172.21.15.78:0/3858645354 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fd430054690 con 0x7fd41c004d10 2023-11-28T20:01:29.054 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:29.049+0000 7fd43b0fe640 1 -- 172.21.15.78:0/3858645354 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7fd43406b1c0 con 0x7fd41c004d10 2023-11-28T20:01:29.054 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:29.049+0000 7fd4297fa640 1 -- 172.21.15.78:0/3858645354 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1619 (secure 0 0 0) 0x7fd430057cb0 con 0x7fd41c004d10 2023-11-28T20:01:29.054 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-11-28T20:01:29.054 INFO:teuthology.orchestra.run.smithi078.stdout:{"fsid":"dd9780e8-3bda-44fa-a9f0-fa07d19d901d","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":168,"monmap":{"epoch":1,"min_mon_release_name":"reef","num_mons":3},"osdmap":{"epoch":65,"num_osds":8,"num_up_osds":8,"osd_up_since":1701201532,"num_in_osds":8,"osd_in_since":1701201523,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":129},{"state_name":"creating+peering","count":64}],"num_pgs":193,"num_pools":5,"num_objects":24,"data_bytes":594273,"bytes_used":231800832,"bytes_avail":772862312448,"bytes_total":773094113280,"inactive_pgs_ratio":0.33160620927810669,"write_bytes_sec":341,"read_op_per_sec":0,"write_op_per_sec":0},"fsmap":{"epoch":36,"id":4,"up":1,"in":1,"max":1,"id":5,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":5,"rank":0,"name":"c","status":"up:active","gid":5889},{"filesystem_id":4,"rank":0,"name":"a","status":"up:active","gid":5892}],"up:standby":2},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":7,"modified":"2023-11-28T20:00:57.977828+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2023-11-28T20:01:29.056 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:29.053+0000 7fd43b0fe640 1 -- 172.21.15.78:0/3858645354 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fd4200664a0 msgr2=0x7fd420068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:01:29.056 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:29.053+0000 7fd43b0fe640 1 --2- 172.21.15.78:0/3858645354 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fd4200664a0 0x7fd420068960 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7fd4341ede60 tx=0x7fd424008040 comp rx=0 tx=0).stop 2023-11-28T20:01:29.056 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:29.053+0000 7fd43b0fe640 1 -- 172.21.15.78:0/3858645354 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd41c004d10 msgr2=0x7fd4340c3130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:01:29.056 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:29.053+0000 7fd43b0fe640 1 --2- 172.21.15.78:0/3858645354 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd41c004d10 0x7fd4340c3130 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7fd430011910 tx=0x7fd430011dd0 comp rx=0 tx=0).stop 2023-11-28T20:01:29.056 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:29.053+0000 7fd43b0fe640 1 -- 172.21.15.78:0/3858645354 shutdown_connections 2023-11-28T20:01:29.056 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:29.053+0000 7fd43b0fe640 1 --2- 172.21.15.78:0/3858645354 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fd4200664a0 0x7fd420068960 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:29.057 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:29.053+0000 7fd43b0fe640 1 --2- 172.21.15.78:0/3858645354 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd4340c0eb0 0x7fd4341ecd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:29.057 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:29.053+0000 7fd43b0fe640 1 --2- 172.21.15.78:0/3858645354 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd4340ae110 0x7fd4341ea040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:29.057 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:29.053+0000 7fd43b0fe640 1 --2- 172.21.15.78:0/3858645354 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd41c004d10 0x7fd4340c3130 unknown :-1 s=CLOSED pgs=701 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:29.057 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:29.053+0000 7fd43b0fe640 1 -- 172.21.15.78:0/3858645354 >> 172.21.15.78:0/3858645354 conn(0x7fd4340ab9d0 msgr2=0x7fd4340c6540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:01:29.057 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:29.053+0000 7fd43b0fe640 1 -- 172.21.15.78:0/3858645354 shutdown_connections 2023-11-28T20:01:29.057 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:29.053+0000 7fd43b0fe640 1 -- 172.21.15.78:0/3858645354 wait complete. 2023-11-28T20:01:29.075 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2023-11-28T20:01:29.075 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-28T20:01:29.212 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:29.209+0000 7f6aaf372640 1 Processor -- start 2023-11-28T20:01:29.213 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:29.209+0000 7f6aaf372640 1 -- start start 2023-11-28T20:01:29.217 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:29.209+0000 7f6aaf372640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6aa8151bf0 0x7f6aa806b5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:29.217 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:29.209+0000 7f6aaf372640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6aa8158a40 con 0x7f6aa806bb00 2023-11-28T20:01:29.217 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:29.209+0000 7f6aaf372640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6aa81584c0 con 0x7f6aa806d890 2023-11-28T20:01:29.217 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:29.209+0000 7f6aaf372640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6aa8158760 con 0x7f6aa8151bf0 2023-11-28T20:01:29.218 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:29.209+0000 7f6aad90f640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f6aa806bb00 0x7f6aa8154d20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:37212/0 (socket says 172.21.15.78:37212) 2023-11-28T20:01:29.218 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:29.209+0000 7f6aad90f640 1 -- 172.21.15.78:0/986643986 learned_addr learned my addr 172.21.15.78:0/986643986 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-11-28T20:01:29.218 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:29.209+0000 7f6aad10e640 1 --2- 172.21.15.78:0/986643986 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6aa8151bf0 0x7f6aa806b5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:29.218 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:29.209+0000 7f6a9ffff640 1 -- 172.21.15.78:0/986643986 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3446769603 0 0) 0x7f6aa8158a40 con 0x7f6aa806bb00 2023-11-28T20:01:29.218 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:29.209+0000 7f6a9ffff640 1 -- 172.21.15.78:0/986643986 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6a94003530 con 0x7f6aa806bb00 2023-11-28T20:01:29.218 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:29.209+0000 7f6a9ffff640 1 -- 172.21.15.78:0/986643986 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2568830536 0 0) 0x7f6aa81584c0 con 0x7f6aa806d890 2023-11-28T20:01:29.218 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:29.209+0000 7f6a9ffff640 1 -- 172.21.15.78:0/986643986 --> v1:172.21.15.179:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6aa8158a40 con 0x7f6aa806d890 2023-11-28T20:01:29.218 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:29.209+0000 7f6aad10e640 1 -- 172.21.15.78:0/986643986 >> v1:172.21.15.179:6789/0 conn(0x7f6aa806d890 legacy=0x7f6aa8154610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:01:29.218 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:29.209+0000 7f6aad10e640 1 -- 172.21.15.78:0/986643986 >> v1:172.21.15.78:6789/0 conn(0x7f6aa806bb00 legacy=0x7f6aa8154d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:01:29.218 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:29.209+0000 7f6aad10e640 1 -- 172.21.15.78:0/986643986 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6aa80c0ce0 con 0x7f6aa8151bf0 2023-11-28T20:01:29.220 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:29.213+0000 7f6aad10e640 1 --2- 172.21.15.78:0/986643986 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6aa8151bf0 0x7f6aa806b5c0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f6aa40097f0 tx=0x7f6aa401c490 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a0db4a9eb69831b server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:01:29.220 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:29.213+0000 7f6a9ffff640 1 -- 172.21.15.78:0/986643986 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6aa40aa5f0 con 0x7f6aa8151bf0 2023-11-28T20:01:29.220 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:29.213+0000 7f6a9ffff640 1 -- 172.21.15.78:0/986643986 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6aa40aa750 con 0x7f6aa8151bf0 2023-11-28T20:01:29.220 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:29.213+0000 7f6a9ffff640 1 -- 172.21.15.78:0/986643986 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6aa40aaae0 con 0x7f6aa8151bf0 2023-11-28T20:01:29.220 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:29.213+0000 7f6aaf372640 1 -- 172.21.15.78:0/986643986 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6aa8151bf0 msgr2=0x7f6aa806b5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:01:29.220 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:29.213+0000 7f6aaf372640 1 --2- 172.21.15.78:0/986643986 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6aa8151bf0 0x7f6aa806b5c0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f6aa40097f0 tx=0x7f6aa401c490 comp rx=0 tx=0).stop 2023-11-28T20:01:29.221 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:29.213+0000 7f6aaf372640 1 -- 172.21.15.78:0/986643986 shutdown_connections 2023-11-28T20:01:29.221 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:29.213+0000 7f6aaf372640 1 --2- 172.21.15.78:0/986643986 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6aa8151bf0 0x7f6aa806b5c0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:29.221 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:29.213+0000 7f6aaf372640 1 -- 172.21.15.78:0/986643986 >> 172.21.15.78:0/986643986 conn(0x7f6aa80c61f0 msgr2=0x7f6aa80c6600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:01:29.221 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:29.213+0000 7f6aaf372640 1 -- 172.21.15.78:0/986643986 shutdown_connections 2023-11-28T20:01:29.221 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:29.213+0000 7f6aaf372640 1 -- 172.21.15.78:0/986643986 wait complete. 2023-11-28T20:01:29.221 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:29.217+0000 7f6aaf372640 1 Processor -- start 2023-11-28T20:01:29.221 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:29.217+0000 7f6aaf372640 1 -- start start 2023-11-28T20:01:29.223 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:29.217+0000 7f6aaf372640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6aa806bb00 0x7f6aa81570a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:29.223 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:29.217+0000 7f6aaf372640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6aa806d890 0x7f6aa81efa90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:29.223 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:29.217+0000 7f6aaf372640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6aa8151bf0 0x7f6aa81effd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:29.223 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:29.217+0000 7f6aaf372640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6aa814c660 con 0x7f6aa806d890 2023-11-28T20:01:29.223 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:29.217+0000 7f6aaf372640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6aa814bde0 con 0x7f6aa806bb00 2023-11-28T20:01:29.224 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:29.217+0000 7f6aaf372640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6aa8147fb0 con 0x7f6aa8151bf0 2023-11-28T20:01:29.224 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:29.217+0000 7f6aac90d640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6aa806d890 0x7f6aa81efa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:29.224 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:29.217+0000 7f6aac90d640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6aa806d890 0x7f6aa81efa90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:36248/0 (socket says 172.21.15.78:36248) 2023-11-28T20:01:29.224 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:29.217+0000 7f6aac90d640 1 -- 172.21.15.78:0/3053960574 learned_addr learned my addr 172.21.15.78:0/3053960574 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T20:01:29.224 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:29.217+0000 7f6aad90f640 1 --2- 172.21.15.78:0/3053960574 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6aa8151bf0 0x7f6aa81effd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:29.224 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:29.217+0000 7f6aad10e640 1 --2- 172.21.15.78:0/3053960574 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6aa806bb00 0x7f6aa81570a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:29.224 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:29.217+0000 7f6aac90d640 1 -- 172.21.15.78:0/3053960574 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6aa8151bf0 msgr2=0x7f6aa81effd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:01:29.224 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:29.217+0000 7f6aac90d640 1 --2- 172.21.15.78:0/3053960574 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6aa8151bf0 0x7f6aa81effd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:29.224 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:29.217+0000 7f6aac90d640 1 -- 172.21.15.78:0/3053960574 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6aa806bb00 msgr2=0x7f6aa81570a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:01:29.224 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:29.217+0000 7f6aac90d640 1 --2- 172.21.15.78:0/3053960574 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6aa806bb00 0x7f6aa81570a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:29.224 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:29.217+0000 7f6aac90d640 1 -- 172.21.15.78:0/3053960574 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6aa4009420 con 0x7f6aa806d890 2023-11-28T20:01:29.224 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:29.217+0000 7f6aad10e640 1 --2- 172.21.15.78:0/3053960574 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6aa806bb00 0x7f6aa81570a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T20:01:29.225 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:29.217+0000 7f6aac90d640 1 --2- 172.21.15.78:0/3053960574 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6aa806d890 0x7f6aa81efa90 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7f6a9800c490 tx=0x7f6a9800c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:01:29.225 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:29.217+0000 7f6a9dffb640 1 -- 172.21.15.78:0/3053960574 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a980052d0 con 0x7f6aa806d890 2023-11-28T20:01:29.225 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:29.217+0000 7f6a9dffb640 1 -- 172.21.15.78:0/3053960574 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a98005430 con 0x7f6aa806d890 2023-11-28T20:01:29.225 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:29.217+0000 7f6a9dffb640 1 -- 172.21.15.78:0/3053960574 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a98012870 con 0x7f6aa806d890 2023-11-28T20:01:29.225 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:29.217+0000 7f6aaf372640 1 -- 172.21.15.78:0/3053960574 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6aa8070650 con 0x7f6aa806d890 2023-11-28T20:01:29.225 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:29.217+0000 7f6aaf372640 1 -- 172.21.15.78:0/3053960574 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6aa80aa7e0 con 0x7f6aa806d890 2023-11-28T20:01:29.225 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:29.217+0000 7f6aaf372640 1 -- 172.21.15.78:0/3053960574 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6aa814c7d0 con 0x7f6aa806d890 2023-11-28T20:01:29.226 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:29.221+0000 7f6a9dffb640 1 -- 172.21.15.78:0/3053960574 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f6a980129d0 con 0x7f6aa806d890 2023-11-28T20:01:29.226 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:29.221+0000 7f6a9dffb640 1 --2- 172.21.15.78:0/3053960574 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f6a8c0664a0 0x7f6a8c068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:29.226 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:29.221+0000 7f6a9dffb640 1 -- 172.21.15.78:0/3053960574 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 6885+0+0 (secure 0 0 0) 0x7f6a98083e20 con 0x7f6aa806d890 2023-11-28T20:01:29.226 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:29.221+0000 7f6aad10e640 1 --2- 172.21.15.78:0/3053960574 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f6a8c0664a0 0x7f6a8c068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:29.226 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:29.221+0000 7f6aad10e640 1 --2- 172.21.15.78:0/3053960574 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f6a8c0664a0 0x7f6a8c068960 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f6aa40ae000 tx=0x7f6aa40a7000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:01:29.228 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:29.225+0000 7f6a9dffb640 1 -- 172.21.15.78:0/3053960574 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f6a98050df0 con 0x7f6aa806d890 2023-11-28T20:01:29.374 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:29.369+0000 7f6aaf372640 1 -- 172.21.15.78:0/3053960574 --> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f6aa80704d0 con 0x7f6a8c0664a0 2023-11-28T20:01:29.387 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:29.381+0000 7f6a9dffb640 1 -- 172.21.15.78:0/3053960574 <== mgr.4106 v2:172.21.15.78:6832/2935380957 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+522286 (secure 0 0 0) 0x7f6aa40aa8c0 con 0x7f6a8c0664a0 2023-11-28T20:01:29.392 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-11-28T20:01:29.396 INFO:teuthology.orchestra.run.smithi078.stderr:dumped all 2023-11-28T20:01:29.397 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:29.389+0000 7f6aaf372640 1 -- 172.21.15.78:0/3053960574 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f6a8c0664a0 msgr2=0x7f6a8c068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:01:29.397 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:29.389+0000 7f6aaf372640 1 --2- 172.21.15.78:0/3053960574 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f6a8c0664a0 0x7f6a8c068960 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f6aa40ae000 tx=0x7f6aa40a7000 comp rx=0 tx=0).stop 2023-11-28T20:01:29.397 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:29.389+0000 7f6aaf372640 1 -- 172.21.15.78:0/3053960574 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6aa806d890 msgr2=0x7f6aa81efa90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:01:29.397 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:29.389+0000 7f6aaf372640 1 --2- 172.21.15.78:0/3053960574 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6aa806d890 0x7f6aa81efa90 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7f6a9800c490 tx=0x7f6a9800c950 comp rx=0 tx=0).stop 2023-11-28T20:01:29.397 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:29.389+0000 7f6aaf372640 1 -- 172.21.15.78:0/3053960574 shutdown_connections 2023-11-28T20:01:29.397 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:29.389+0000 7f6aaf372640 1 --2- 172.21.15.78:0/3053960574 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f6a8c0664a0 0x7f6a8c068960 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:29.397 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:29.389+0000 7f6aaf372640 1 --2- 172.21.15.78:0/3053960574 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6aa8151bf0 0x7f6aa81effd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:29.398 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:29.389+0000 7f6aaf372640 1 --2- 172.21.15.78:0/3053960574 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6aa806d890 0x7f6aa81efa90 unknown :-1 s=CLOSED pgs=703 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:29.398 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:29.389+0000 7f6aaf372640 1 --2- 172.21.15.78:0/3053960574 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6aa806bb00 0x7f6aa81570a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:29.398 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:29.389+0000 7f6aaf372640 1 -- 172.21.15.78:0/3053960574 >> 172.21.15.78:0/3053960574 conn(0x7f6aa80c61f0 msgr2=0x7f6aa80c5a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:01:29.398 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:29.389+0000 7f6aaf372640 1 -- 172.21.15.78:0/3053960574 shutdown_connections 2023-11-28T20:01:29.398 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:29.389+0000 7f6aaf372640 1 -- 172.21.15.78:0/3053960574 wait complete. 2023-11-28T20:01:29.412 INFO:teuthology.orchestra.run.smithi078.stdout:{"pg_ready":true,"pg_map":{"version":136,"stamp":"2023-11-28T20:01:27.982712+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":594273,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":206,"num_write_kb":2433,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":158,"ondisk_log_size":158,"up":386,"acting":386,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":235,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":226368,"kb_used_data":6048,"kb_used_omap":12,"kb_used_meta":220211,"kb_avail":754748352,"statfs":{"total":773094113280,"available":772862312448,"internally_reserved":0,"allocated":6193152,"data_stored":3946178,"data_compressed":66748,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":12752,"internal_metadata":225496624},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":30,"apply_latency_ms":30,"commit_latency_ns":30000000,"apply_latency_ns":30000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1241,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001016"},"pg_stats":[{"pgid":"12.39","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2023-11-28T20:01:22.802967+0000","last_change":"2023-11-28T20:01:22.802967+0000","last_active":"2023-11-28T20:01:22.787100+0000","last_peered":"2023-11-28T20:01:22.787100+0000","last_clean":"2023-11-28T20:01:22.787100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:01:22.802967+0000","last_undegraded":"2023-11-28T20:01:22.802967+0000","last_fullsized":"2023-11-28T20:01:22.802967+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:22.787100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:22.787100+0000","last_clean_scrub_stamp":"2023-11-28T20:01:22.787100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.3f","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-11-28T20:01:21.790302+0000","last_change":"2023-11-28T20:01:10.539211+0000","last_active":"2023-11-28T20:01:21.790302+0000","last_peered":"2023-11-28T20:01:21.790302+0000","last_clean":"2023-11-28T20:01:21.790302+0000","last_became_active":"2023-11-28T20:01:10.538932+0000","last_became_peered":"2023-11-28T20:01:10.538932+0000","last_unstale":"2023-11-28T20:01:21.790302+0000","last_undegraded":"2023-11-28T20:01:21.790302+0000","last_fullsized":"2023-11-28T20:01:21.790302+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_clean_scrub_stamp":"2023-11-28T20:01:09.480611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:10:00.034946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.38","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2023-11-28T20:01:22.800864+0000","last_change":"2023-11-28T20:01:22.800864+0000","last_active":"2023-11-28T20:01:22.787100+0000","last_peered":"2023-11-28T20:01:22.787100+0000","last_clean":"2023-11-28T20:01:22.787100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:01:22.800864+0000","last_undegraded":"2023-11-28T20:01:22.800864+0000","last_fullsized":"2023-11-28T20:01:22.800864+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:22.787100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:22.787100+0000","last_clean_scrub_stamp":"2023-11-28T20:01:22.787100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.3e","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-11-28T20:01:21.790168+0000","last_change":"2023-11-28T20:01:10.522069+0000","last_active":"2023-11-28T20:01:21.790168+0000","last_peered":"2023-11-28T20:01:21.790168+0000","last_clean":"2023-11-28T20:01:21.790168+0000","last_became_active":"2023-11-28T20:01:10.521785+0000","last_became_peered":"2023-11-28T20:01:10.521785+0000","last_unstale":"2023-11-28T20:01:21.790168+0000","last_undegraded":"2023-11-28T20:01:21.790168+0000","last_fullsized":"2023-11-28T20:01:21.790168+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_clean_scrub_stamp":"2023-11-28T20:01:09.480611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:00:30.789993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.3b","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2023-11-28T20:01:22.801987+0000","last_change":"2023-11-28T20:01:22.801987+0000","last_active":"2023-11-28T20:01:22.787100+0000","last_peered":"2023-11-28T20:01:22.787100+0000","last_clean":"2023-11-28T20:01:22.787100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:01:22.801987+0000","last_undegraded":"2023-11-28T20:01:22.801987+0000","last_fullsized":"2023-11-28T20:01:22.801987+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:22.787100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:22.787100+0000","last_clean_scrub_stamp":"2023-11-28T20:01:22.787100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.3d","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-11-28T20:01:21.798541+0000","last_change":"2023-11-28T20:01:10.538353+0000","last_active":"2023-11-28T20:01:21.798541+0000","last_peered":"2023-11-28T20:01:21.798541+0000","last_clean":"2023-11-28T20:01:21.798541+0000","last_became_active":"2023-11-28T20:01:10.537756+0000","last_became_peered":"2023-11-28T20:01:10.537756+0000","last_unstale":"2023-11-28T20:01:21.798541+0000","last_undegraded":"2023-11-28T20:01:21.798541+0000","last_fullsized":"2023-11-28T20:01:21.798541+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_clean_scrub_stamp":"2023-11-28T20:01:09.480611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T06:29:13.579326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.3a","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2023-11-28T20:01:22.804075+0000","last_change":"2023-11-28T20:01:22.804075+0000","last_active":"2023-11-28T20:01:22.787100+0000","last_peered":"2023-11-28T20:01:22.787100+0000","last_clean":"2023-11-28T20:01:22.787100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:01:22.804075+0000","last_undegraded":"2023-11-28T20:01:22.804075+0000","last_fullsized":"2023-11-28T20:01:22.804075+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:22.787100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:22.787100+0000","last_clean_scrub_stamp":"2023-11-28T20:01:22.787100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.3c","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-11-28T20:01:21.791845+0000","last_change":"2023-11-28T20:01:10.523152+0000","last_active":"2023-11-28T20:01:21.791845+0000","last_peered":"2023-11-28T20:01:21.791845+0000","last_clean":"2023-11-28T20:01:21.791845+0000","last_became_active":"2023-11-28T20:01:10.522874+0000","last_became_peered":"2023-11-28T20:01:10.522874+0000","last_unstale":"2023-11-28T20:01:21.791845+0000","last_undegraded":"2023-11-28T20:01:21.791845+0000","last_fullsized":"2023-11-28T20:01:21.791845+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_clean_scrub_stamp":"2023-11-28T20:01:09.480611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:56:55.097917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.3d","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2023-11-28T20:01:22.809244+0000","last_change":"2023-11-28T20:01:22.809244+0000","last_active":"2023-11-28T20:01:22.787100+0000","last_peered":"2023-11-28T20:01:22.787100+0000","last_clean":"2023-11-28T20:01:22.787100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:01:22.809244+0000","last_undegraded":"2023-11-28T20:01:22.809244+0000","last_fullsized":"2023-11-28T20:01:22.809244+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:22.787100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:22.787100+0000","last_clean_scrub_stamp":"2023-11-28T20:01:22.787100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.3b","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-11-28T20:01:21.801402+0000","last_change":"2023-11-28T20:01:10.529938+0000","last_active":"2023-11-28T20:01:21.801402+0000","last_peered":"2023-11-28T20:01:21.801402+0000","last_clean":"2023-11-28T20:01:21.801402+0000","last_became_active":"2023-11-28T20:01:10.529188+0000","last_became_peered":"2023-11-28T20:01:10.529188+0000","last_unstale":"2023-11-28T20:01:21.801402+0000","last_undegraded":"2023-11-28T20:01:21.801402+0000","last_fullsized":"2023-11-28T20:01:21.801402+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_clean_scrub_stamp":"2023-11-28T20:01:09.480611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:47:13.274500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.3c","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2023-11-28T20:01:22.810262+0000","last_change":"2023-11-28T20:01:22.810262+0000","last_active":"2023-11-28T20:01:22.787100+0000","last_peered":"2023-11-28T20:01:22.787100+0000","last_clean":"2023-11-28T20:01:22.787100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:01:22.810262+0000","last_undegraded":"2023-11-28T20:01:22.810262+0000","last_fullsized":"2023-11-28T20:01:22.810262+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:22.787100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:22.787100+0000","last_clean_scrub_stamp":"2023-11-28T20:01:22.787100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.3a","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-11-28T20:01:21.801203+0000","last_change":"2023-11-28T20:01:10.531000+0000","last_active":"2023-11-28T20:01:21.801203+0000","last_peered":"2023-11-28T20:01:21.801203+0000","last_clean":"2023-11-28T20:01:21.801203+0000","last_became_active":"2023-11-28T20:01:10.530754+0000","last_became_peered":"2023-11-28T20:01:10.530754+0000","last_unstale":"2023-11-28T20:01:21.801203+0000","last_undegraded":"2023-11-28T20:01:21.801203+0000","last_fullsized":"2023-11-28T20:01:21.801203+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_clean_scrub_stamp":"2023-11-28T20:01:09.480611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:44:34.399373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.3f","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2023-11-28T20:01:22.815237+0000","last_change":"2023-11-28T20:01:22.815237+0000","last_active":"2023-11-28T20:01:22.787100+0000","last_peered":"2023-11-28T20:01:22.787100+0000","last_clean":"2023-11-28T20:01:22.787100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:01:22.815237+0000","last_undegraded":"2023-11-28T20:01:22.815237+0000","last_fullsized":"2023-11-28T20:01:22.815237+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:22.787100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:22.787100+0000","last_clean_scrub_stamp":"2023-11-28T20:01:22.787100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.39","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-11-28T20:01:21.796927+0000","last_change":"2023-11-28T20:01:10.535113+0000","last_active":"2023-11-28T20:01:21.796927+0000","last_peered":"2023-11-28T20:01:21.796927+0000","last_clean":"2023-11-28T20:01:21.796927+0000","last_became_active":"2023-11-28T20:01:10.534919+0000","last_became_peered":"2023-11-28T20:01:10.534919+0000","last_unstale":"2023-11-28T20:01:21.796927+0000","last_undegraded":"2023-11-28T20:01:21.796927+0000","last_fullsized":"2023-11-28T20:01:21.796927+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_clean_scrub_stamp":"2023-11-28T20:01:09.480611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:00:31.915592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.3e","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2023-11-28T20:01:22.812285+0000","last_change":"2023-11-28T20:01:22.812285+0000","last_active":"2023-11-28T20:01:22.787100+0000","last_peered":"2023-11-28T20:01:22.787100+0000","last_clean":"2023-11-28T20:01:22.787100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:01:22.812285+0000","last_undegraded":"2023-11-28T20:01:22.812285+0000","last_fullsized":"2023-11-28T20:01:22.812285+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:22.787100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:22.787100+0000","last_clean_scrub_stamp":"2023-11-28T20:01:22.787100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.38","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-11-28T20:01:21.793498+0000","last_change":"2023-11-28T20:01:10.538054+0000","last_active":"2023-11-28T20:01:21.793498+0000","last_peered":"2023-11-28T20:01:21.793498+0000","last_clean":"2023-11-28T20:01:21.793498+0000","last_became_active":"2023-11-28T20:01:10.535363+0000","last_became_peered":"2023-11-28T20:01:10.535363+0000","last_unstale":"2023-11-28T20:01:21.793498+0000","last_undegraded":"2023-11-28T20:01:21.793498+0000","last_fullsized":"2023-11-28T20:01:21.793498+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_clean_scrub_stamp":"2023-11-28T20:01:09.480611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:06:36.994816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.31","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2023-11-28T20:01:22.805019+0000","last_change":"2023-11-28T20:01:22.805019+0000","last_active":"2023-11-28T20:01:22.787100+0000","last_peered":"2023-11-28T20:01:22.787100+0000","last_clean":"2023-11-28T20:01:22.787100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:01:22.805019+0000","last_undegraded":"2023-11-28T20:01:22.805019+0000","last_fullsized":"2023-11-28T20:01:22.805019+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:22.787100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:22.787100+0000","last_clean_scrub_stamp":"2023-11-28T20:01:22.787100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.37","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-11-28T20:01:21.799718+0000","last_change":"2023-11-28T20:01:10.543027+0000","last_active":"2023-11-28T20:01:21.799718+0000","last_peered":"2023-11-28T20:01:21.799718+0000","last_clean":"2023-11-28T20:01:21.799718+0000","last_became_active":"2023-11-28T20:01:10.541632+0000","last_became_peered":"2023-11-28T20:01:10.541632+0000","last_unstale":"2023-11-28T20:01:21.799718+0000","last_undegraded":"2023-11-28T20:01:21.799718+0000","last_fullsized":"2023-11-28T20:01:21.799718+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_clean_scrub_stamp":"2023-11-28T20:01:09.480611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:46:29.701039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.30","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2023-11-28T20:01:22.807023+0000","last_change":"2023-11-28T20:01:22.807023+0000","last_active":"2023-11-28T20:01:22.787100+0000","last_peered":"2023-11-28T20:01:22.787100+0000","last_clean":"2023-11-28T20:01:22.787100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:01:22.807023+0000","last_undegraded":"2023-11-28T20:01:22.807023+0000","last_fullsized":"2023-11-28T20:01:22.807023+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:22.787100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:22.787100+0000","last_clean_scrub_stamp":"2023-11-28T20:01:22.787100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.36","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-11-28T20:01:21.798466+0000","last_change":"2023-11-28T20:01:10.541712+0000","last_active":"2023-11-28T20:01:21.798466+0000","last_peered":"2023-11-28T20:01:21.798466+0000","last_clean":"2023-11-28T20:01:21.798466+0000","last_became_active":"2023-11-28T20:01:10.541389+0000","last_became_peered":"2023-11-28T20:01:10.541389+0000","last_unstale":"2023-11-28T20:01:21.798466+0000","last_undegraded":"2023-11-28T20:01:21.798466+0000","last_fullsized":"2023-11-28T20:01:21.798466+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_clean_scrub_stamp":"2023-11-28T20:01:09.480611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:54:30.269337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.33","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2023-11-28T20:01:22.801107+0000","last_change":"2023-11-28T20:01:22.801107+0000","last_active":"2023-11-28T20:01:22.787100+0000","last_peered":"2023-11-28T20:01:22.787100+0000","last_clean":"2023-11-28T20:01:22.787100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:01:22.801107+0000","last_undegraded":"2023-11-28T20:01:22.801107+0000","last_fullsized":"2023-11-28T20:01:22.801107+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:22.787100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:22.787100+0000","last_clean_scrub_stamp":"2023-11-28T20:01:22.787100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.35","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-11-28T20:01:21.791729+0000","last_change":"2023-11-28T20:01:10.520251+0000","last_active":"2023-11-28T20:01:21.791729+0000","last_peered":"2023-11-28T20:01:21.791729+0000","last_clean":"2023-11-28T20:01:21.791729+0000","last_became_active":"2023-11-28T20:01:10.519957+0000","last_became_peered":"2023-11-28T20:01:10.519957+0000","last_unstale":"2023-11-28T20:01:21.791729+0000","last_undegraded":"2023-11-28T20:01:21.791729+0000","last_fullsized":"2023-11-28T20:01:21.791729+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_clean_scrub_stamp":"2023-11-28T20:01:09.480611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:33:17.345518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.32","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2023-11-28T20:01:22.803669+0000","last_change":"2023-11-28T20:01:22.803669+0000","last_active":"2023-11-28T20:01:22.787100+0000","last_peered":"2023-11-28T20:01:22.787100+0000","last_clean":"2023-11-28T20:01:22.787100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:01:22.803669+0000","last_undegraded":"2023-11-28T20:01:22.803669+0000","last_fullsized":"2023-11-28T20:01:22.803669+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:22.787100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:22.787100+0000","last_clean_scrub_stamp":"2023-11-28T20:01:22.787100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.34","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-11-28T20:01:21.793709+0000","last_change":"2023-11-28T20:01:10.535199+0000","last_active":"2023-11-28T20:01:21.793709+0000","last_peered":"2023-11-28T20:01:21.793709+0000","last_clean":"2023-11-28T20:01:21.793709+0000","last_became_active":"2023-11-28T20:01:10.534856+0000","last_became_peered":"2023-11-28T20:01:10.534856+0000","last_unstale":"2023-11-28T20:01:21.793709+0000","last_undegraded":"2023-11-28T20:01:21.793709+0000","last_fullsized":"2023-11-28T20:01:21.793709+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_clean_scrub_stamp":"2023-11-28T20:01:09.480611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:07:03.844567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.35","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2023-11-28T20:01:22.809408+0000","last_change":"2023-11-28T20:01:22.809408+0000","last_active":"2023-11-28T20:01:22.787100+0000","last_peered":"2023-11-28T20:01:22.787100+0000","last_clean":"2023-11-28T20:01:22.787100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:01:22.809408+0000","last_undegraded":"2023-11-28T20:01:22.809408+0000","last_fullsized":"2023-11-28T20:01:22.809408+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:22.787100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:22.787100+0000","last_clean_scrub_stamp":"2023-11-28T20:01:22.787100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.33","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-11-28T20:01:21.793879+0000","last_change":"2023-11-28T20:01:10.529868+0000","last_active":"2023-11-28T20:01:21.793879+0000","last_peered":"2023-11-28T20:01:21.793879+0000","last_clean":"2023-11-28T20:01:21.793879+0000","last_became_active":"2023-11-28T20:01:10.529582+0000","last_became_peered":"2023-11-28T20:01:10.529582+0000","last_unstale":"2023-11-28T20:01:21.793879+0000","last_undegraded":"2023-11-28T20:01:21.793879+0000","last_fullsized":"2023-11-28T20:01:21.793879+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_clean_scrub_stamp":"2023-11-28T20:01:09.480611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T07:14:21.836133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.34","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2023-11-28T20:01:22.809821+0000","last_change":"2023-11-28T20:01:22.809821+0000","last_active":"2023-11-28T20:01:22.787100+0000","last_peered":"2023-11-28T20:01:22.787100+0000","last_clean":"2023-11-28T20:01:22.787100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:01:22.809821+0000","last_undegraded":"2023-11-28T20:01:22.809821+0000","last_fullsized":"2023-11-28T20:01:22.809821+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:22.787100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:22.787100+0000","last_clean_scrub_stamp":"2023-11-28T20:01:22.787100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.32","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-11-28T20:01:21.797969+0000","last_change":"2023-11-28T20:01:10.546075+0000","last_active":"2023-11-28T20:01:21.797969+0000","last_peered":"2023-11-28T20:01:21.797969+0000","last_clean":"2023-11-28T20:01:21.797969+0000","last_became_active":"2023-11-28T20:01:10.542038+0000","last_became_peered":"2023-11-28T20:01:10.542038+0000","last_unstale":"2023-11-28T20:01:21.797969+0000","last_undegraded":"2023-11-28T20:01:21.797969+0000","last_fullsized":"2023-11-28T20:01:21.797969+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_clean_scrub_stamp":"2023-11-28T20:01:09.480611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:44:34.399373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.37","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2023-11-28T20:01:22.806216+0000","last_change":"2023-11-28T20:01:22.806216+0000","last_active":"2023-11-28T20:01:22.787100+0000","last_peered":"2023-11-28T20:01:22.787100+0000","last_clean":"2023-11-28T20:01:22.787100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:01:22.806216+0000","last_undegraded":"2023-11-28T20:01:22.806216+0000","last_fullsized":"2023-11-28T20:01:22.806216+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:22.787100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:22.787100+0000","last_clean_scrub_stamp":"2023-11-28T20:01:22.787100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.31","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-11-28T20:01:21.798012+0000","last_change":"2023-11-28T20:01:10.535170+0000","last_active":"2023-11-28T20:01:21.798012+0000","last_peered":"2023-11-28T20:01:21.798012+0000","last_clean":"2023-11-28T20:01:21.798012+0000","last_became_active":"2023-11-28T20:01:10.534881+0000","last_became_peered":"2023-11-28T20:01:10.534881+0000","last_unstale":"2023-11-28T20:01:21.798012+0000","last_undegraded":"2023-11-28T20:01:21.798012+0000","last_fullsized":"2023-11-28T20:01:21.798012+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_clean_scrub_stamp":"2023-11-28T20:01:09.480611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:07:03.844567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.36","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2023-11-28T20:01:22.809354+0000","last_change":"2023-11-28T20:01:22.809354+0000","last_active":"2023-11-28T20:01:22.787100+0000","last_peered":"2023-11-28T20:01:22.787100+0000","last_clean":"2023-11-28T20:01:22.787100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:01:22.809354+0000","last_undegraded":"2023-11-28T20:01:22.809354+0000","last_fullsized":"2023-11-28T20:01:22.809354+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:22.787100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:22.787100+0000","last_clean_scrub_stamp":"2023-11-28T20:01:22.787100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.30","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-11-28T20:01:21.796113+0000","last_change":"2023-11-28T20:01:10.530998+0000","last_active":"2023-11-28T20:01:21.796113+0000","last_peered":"2023-11-28T20:01:21.796113+0000","last_clean":"2023-11-28T20:01:21.796113+0000","last_became_active":"2023-11-28T20:01:10.530709+0000","last_became_peered":"2023-11-28T20:01:10.530709+0000","last_unstale":"2023-11-28T20:01:21.796113+0000","last_undegraded":"2023-11-28T20:01:21.796113+0000","last_fullsized":"2023-11-28T20:01:21.796113+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_clean_scrub_stamp":"2023-11-28T20:01:09.480611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:11:53.891113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.29","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2023-11-28T20:01:22.805327+0000","last_change":"2023-11-28T20:01:22.805327+0000","last_active":"2023-11-28T20:01:22.787100+0000","last_peered":"2023-11-28T20:01:22.787100+0000","last_clean":"2023-11-28T20:01:22.787100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:01:22.805327+0000","last_undegraded":"2023-11-28T20:01:22.805327+0000","last_fullsized":"2023-11-28T20:01:22.805327+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:22.787100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:22.787100+0000","last_clean_scrub_stamp":"2023-11-28T20:01:22.787100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.2f","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-11-28T20:01:21.790410+0000","last_change":"2023-11-28T20:01:10.522350+0000","last_active":"2023-11-28T20:01:21.790410+0000","last_peered":"2023-11-28T20:01:21.790410+0000","last_clean":"2023-11-28T20:01:21.790410+0000","last_became_active":"2023-11-28T20:01:10.522075+0000","last_became_peered":"2023-11-28T20:01:10.522075+0000","last_unstale":"2023-11-28T20:01:21.790410+0000","last_undegraded":"2023-11-28T20:01:21.790410+0000","last_fullsized":"2023-11-28T20:01:21.790410+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_clean_scrub_stamp":"2023-11-28T20:01:09.480611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:18:49.627041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.28","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2023-11-28T20:01:22.805106+0000","last_change":"2023-11-28T20:01:22.805106+0000","last_active":"2023-11-28T20:01:22.787100+0000","last_peered":"2023-11-28T20:01:22.787100+0000","last_clean":"2023-11-28T20:01:22.787100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:01:22.805106+0000","last_undegraded":"2023-11-28T20:01:22.805106+0000","last_fullsized":"2023-11-28T20:01:22.805106+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:22.787100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:22.787100+0000","last_clean_scrub_stamp":"2023-11-28T20:01:22.787100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.2e","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-11-28T20:01:21.792752+0000","last_change":"2023-11-28T20:01:10.521611+0000","last_active":"2023-11-28T20:01:21.792752+0000","last_peered":"2023-11-28T20:01:21.792752+0000","last_clean":"2023-11-28T20:01:21.792752+0000","last_became_active":"2023-11-28T20:01:10.521162+0000","last_became_peered":"2023-11-28T20:01:10.521162+0000","last_unstale":"2023-11-28T20:01:21.792752+0000","last_undegraded":"2023-11-28T20:01:21.792752+0000","last_fullsized":"2023-11-28T20:01:21.792752+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_clean_scrub_stamp":"2023-11-28T20:01:09.480611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:04:56.486213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.2b","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2023-11-28T20:01:22.810297+0000","last_change":"2023-11-28T20:01:22.810297+0000","last_active":"2023-11-28T20:01:22.787100+0000","last_peered":"2023-11-28T20:01:22.787100+0000","last_clean":"2023-11-28T20:01:22.787100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:01:22.810297+0000","last_undegraded":"2023-11-28T20:01:22.810297+0000","last_fullsized":"2023-11-28T20:01:22.810297+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:22.787100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:22.787100+0000","last_clean_scrub_stamp":"2023-11-28T20:01:22.787100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.2d","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-11-28T20:01:21.801643+0000","last_change":"2023-11-28T20:01:10.526160+0000","last_active":"2023-11-28T20:01:21.801643+0000","last_peered":"2023-11-28T20:01:21.801643+0000","last_clean":"2023-11-28T20:01:21.801643+0000","last_became_active":"2023-11-28T20:01:10.525887+0000","last_became_peered":"2023-11-28T20:01:10.525887+0000","last_unstale":"2023-11-28T20:01:21.801643+0000","last_undegraded":"2023-11-28T20:01:21.801643+0000","last_fullsized":"2023-11-28T20:01:21.801643+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_clean_scrub_stamp":"2023-11-28T20:01:09.480611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:49:02.557281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.2a","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2023-11-28T20:01:22.800405+0000","last_change":"2023-11-28T20:01:22.800405+0000","last_active":"2023-11-28T20:01:22.787100+0000","last_peered":"2023-11-28T20:01:22.787100+0000","last_clean":"2023-11-28T20:01:22.787100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:01:22.800405+0000","last_undegraded":"2023-11-28T20:01:22.800405+0000","last_fullsized":"2023-11-28T20:01:22.800405+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:22.787100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:22.787100+0000","last_clean_scrub_stamp":"2023-11-28T20:01:22.787100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.2c","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-11-28T20:01:21.797188+0000","last_change":"2023-11-28T20:01:10.534338+0000","last_active":"2023-11-28T20:01:21.797188+0000","last_peered":"2023-11-28T20:01:21.797188+0000","last_clean":"2023-11-28T20:01:21.797188+0000","last_became_active":"2023-11-28T20:01:10.532397+0000","last_became_peered":"2023-11-28T20:01:10.532397+0000","last_unstale":"2023-11-28T20:01:21.797188+0000","last_undegraded":"2023-11-28T20:01:21.797188+0000","last_fullsized":"2023-11-28T20:01:21.797188+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_clean_scrub_stamp":"2023-11-28T20:01:09.480611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:51:36.724540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.2d","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2023-11-28T20:01:22.801543+0000","last_change":"2023-11-28T20:01:22.801543+0000","last_active":"2023-11-28T20:01:22.787100+0000","last_peered":"2023-11-28T20:01:22.787100+0000","last_clean":"2023-11-28T20:01:22.787100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:01:22.801543+0000","last_undegraded":"2023-11-28T20:01:22.801543+0000","last_fullsized":"2023-11-28T20:01:22.801543+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:22.787100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:22.787100+0000","last_clean_scrub_stamp":"2023-11-28T20:01:22.787100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.2b","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-11-28T20:01:21.793971+0000","last_change":"2023-11-28T20:01:10.528780+0000","last_active":"2023-11-28T20:01:21.793971+0000","last_peered":"2023-11-28T20:01:21.793971+0000","last_clean":"2023-11-28T20:01:21.793971+0000","last_became_active":"2023-11-28T20:01:10.524555+0000","last_became_peered":"2023-11-28T20:01:10.524555+0000","last_unstale":"2023-11-28T20:01:21.793971+0000","last_undegraded":"2023-11-28T20:01:21.793971+0000","last_fullsized":"2023-11-28T20:01:21.793971+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_clean_scrub_stamp":"2023-11-28T20:01:09.480611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:30:22.791908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.2c","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2023-11-28T20:01:22.800383+0000","last_change":"2023-11-28T20:01:22.800383+0000","last_active":"2023-11-28T20:01:22.787100+0000","last_peered":"2023-11-28T20:01:22.787100+0000","last_clean":"2023-11-28T20:01:22.787100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:01:22.800383+0000","last_undegraded":"2023-11-28T20:01:22.800383+0000","last_fullsized":"2023-11-28T20:01:22.800383+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:22.787100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:22.787100+0000","last_clean_scrub_stamp":"2023-11-28T20:01:22.787100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.2a","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-11-28T20:01:21.796467+0000","last_change":"2023-11-28T20:01:10.531958+0000","last_active":"2023-11-28T20:01:21.796467+0000","last_peered":"2023-11-28T20:01:21.796467+0000","last_clean":"2023-11-28T20:01:21.796467+0000","last_became_active":"2023-11-28T20:01:10.531111+0000","last_became_peered":"2023-11-28T20:01:10.531111+0000","last_unstale":"2023-11-28T20:01:21.796467+0000","last_undegraded":"2023-11-28T20:01:21.796467+0000","last_fullsized":"2023-11-28T20:01:21.796467+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_clean_scrub_stamp":"2023-11-28T20:01:09.480611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:52:31.642868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.2f","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2023-11-28T20:01:22.800411+0000","last_change":"2023-11-28T20:01:22.800411+0000","last_active":"2023-11-28T20:01:22.787100+0000","last_peered":"2023-11-28T20:01:22.787100+0000","last_clean":"2023-11-28T20:01:22.787100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:01:22.800411+0000","last_undegraded":"2023-11-28T20:01:22.800411+0000","last_fullsized":"2023-11-28T20:01:22.800411+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:22.787100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:22.787100+0000","last_clean_scrub_stamp":"2023-11-28T20:01:22.787100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.29","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-11-28T20:01:21.796452+0000","last_change":"2023-11-28T20:01:10.533367+0000","last_active":"2023-11-28T20:01:21.796452+0000","last_peered":"2023-11-28T20:01:21.796452+0000","last_clean":"2023-11-28T20:01:21.796452+0000","last_became_active":"2023-11-28T20:01:10.532975+0000","last_became_peered":"2023-11-28T20:01:10.532975+0000","last_unstale":"2023-11-28T20:01:21.796452+0000","last_undegraded":"2023-11-28T20:01:21.796452+0000","last_fullsized":"2023-11-28T20:01:21.796452+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_clean_scrub_stamp":"2023-11-28T20:01:09.480611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:10:30.393696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.2e","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2023-11-28T20:01:22.808991+0000","last_change":"2023-11-28T20:01:22.808991+0000","last_active":"2023-11-28T20:01:22.787100+0000","last_peered":"2023-11-28T20:01:22.787100+0000","last_clean":"2023-11-28T20:01:22.787100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:01:22.808991+0000","last_undegraded":"2023-11-28T20:01:22.808991+0000","last_fullsized":"2023-11-28T20:01:22.808991+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:22.787100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:22.787100+0000","last_clean_scrub_stamp":"2023-11-28T20:01:22.787100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.28","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-11-28T20:01:21.797562+0000","last_change":"2023-11-28T20:01:10.541445+0000","last_active":"2023-11-28T20:01:21.797562+0000","last_peered":"2023-11-28T20:01:21.797562+0000","last_clean":"2023-11-28T20:01:21.797562+0000","last_became_active":"2023-11-28T20:01:10.539375+0000","last_became_peered":"2023-11-28T20:01:10.539375+0000","last_unstale":"2023-11-28T20:01:21.797562+0000","last_undegraded":"2023-11-28T20:01:21.797562+0000","last_fullsized":"2023-11-28T20:01:21.797562+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_clean_scrub_stamp":"2023-11-28T20:01:09.480611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T07:14:21.836133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.21","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2023-11-28T20:01:22.806976+0000","last_change":"2023-11-28T20:01:22.806976+0000","last_active":"2023-11-28T20:01:22.787100+0000","last_peered":"2023-11-28T20:01:22.787100+0000","last_clean":"2023-11-28T20:01:22.787100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:01:22.806976+0000","last_undegraded":"2023-11-28T20:01:22.806976+0000","last_fullsized":"2023-11-28T20:01:22.806976+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:22.787100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:22.787100+0000","last_clean_scrub_stamp":"2023-11-28T20:01:22.787100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.27","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-11-28T20:01:21.794373+0000","last_change":"2023-11-28T20:01:10.531718+0000","last_active":"2023-11-28T20:01:21.794373+0000","last_peered":"2023-11-28T20:01:21.794373+0000","last_clean":"2023-11-28T20:01:21.794373+0000","last_became_active":"2023-11-28T20:01:10.529424+0000","last_became_peered":"2023-11-28T20:01:10.529424+0000","last_unstale":"2023-11-28T20:01:21.794373+0000","last_undegraded":"2023-11-28T20:01:21.794373+0000","last_fullsized":"2023-11-28T20:01:21.794373+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_clean_scrub_stamp":"2023-11-28T20:01:09.480611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:17:27.097887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.20","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2023-11-28T20:01:22.808081+0000","last_change":"2023-11-28T20:01:22.808081+0000","last_active":"2023-11-28T20:01:22.787100+0000","last_peered":"2023-11-28T20:01:22.787100+0000","last_clean":"2023-11-28T20:01:22.787100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:01:22.808081+0000","last_undegraded":"2023-11-28T20:01:22.808081+0000","last_fullsized":"2023-11-28T20:01:22.808081+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:22.787100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:22.787100+0000","last_clean_scrub_stamp":"2023-11-28T20:01:22.787100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.26","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-11-28T20:01:21.794270+0000","last_change":"2023-11-28T20:01:10.530284+0000","last_active":"2023-11-28T20:01:21.794270+0000","last_peered":"2023-11-28T20:01:21.794270+0000","last_clean":"2023-11-28T20:01:21.794270+0000","last_became_active":"2023-11-28T20:01:10.529805+0000","last_became_peered":"2023-11-28T20:01:10.529805+0000","last_unstale":"2023-11-28T20:01:21.794270+0000","last_undegraded":"2023-11-28T20:01:21.794270+0000","last_fullsized":"2023-11-28T20:01:21.794270+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_clean_scrub_stamp":"2023-11-28T20:01:09.480611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:46:29.701039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.23","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2023-11-28T20:01:22.808672+0000","last_change":"2023-11-28T20:01:22.808672+0000","last_active":"2023-11-28T20:01:22.787100+0000","last_peered":"2023-11-28T20:01:22.787100+0000","last_clean":"2023-11-28T20:01:22.787100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:01:22.808672+0000","last_undegraded":"2023-11-28T20:01:22.808672+0000","last_fullsized":"2023-11-28T20:01:22.808672+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:22.787100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:22.787100+0000","last_clean_scrub_stamp":"2023-11-28T20:01:22.787100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.25","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-11-28T20:01:21.791827+0000","last_change":"2023-11-28T20:01:10.519186+0000","last_active":"2023-11-28T20:01:21.791827+0000","last_peered":"2023-11-28T20:01:21.791827+0000","last_clean":"2023-11-28T20:01:21.791827+0000","last_became_active":"2023-11-28T20:01:10.518855+0000","last_became_peered":"2023-11-28T20:01:10.518855+0000","last_unstale":"2023-11-28T20:01:21.791827+0000","last_undegraded":"2023-11-28T20:01:21.791827+0000","last_fullsized":"2023-11-28T20:01:21.791827+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_clean_scrub_stamp":"2023-11-28T20:01:09.480611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:23:19.215371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.22","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2023-11-28T20:01:22.807092+0000","last_change":"2023-11-28T20:01:22.807092+0000","last_active":"2023-11-28T20:01:22.787100+0000","last_peered":"2023-11-28T20:01:22.787100+0000","last_clean":"2023-11-28T20:01:22.787100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:01:22.807092+0000","last_undegraded":"2023-11-28T20:01:22.807092+0000","last_fullsized":"2023-11-28T20:01:22.807092+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:22.787100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:22.787100+0000","last_clean_scrub_stamp":"2023-11-28T20:01:22.787100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.24","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-11-28T20:01:21.789959+0000","last_change":"2023-11-28T20:01:10.537687+0000","last_active":"2023-11-28T20:01:21.789959+0000","last_peered":"2023-11-28T20:01:21.789959+0000","last_clean":"2023-11-28T20:01:21.789959+0000","last_became_active":"2023-11-28T20:01:10.536233+0000","last_became_peered":"2023-11-28T20:01:10.536233+0000","last_unstale":"2023-11-28T20:01:21.789959+0000","last_undegraded":"2023-11-28T20:01:21.789959+0000","last_fullsized":"2023-11-28T20:01:21.789959+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_clean_scrub_stamp":"2023-11-28T20:01:09.480611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:18:17.108795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.25","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2023-11-28T20:01:22.815803+0000","last_change":"2023-11-28T20:01:22.815803+0000","last_active":"2023-11-28T20:01:22.787100+0000","last_peered":"2023-11-28T20:01:22.787100+0000","last_clean":"2023-11-28T20:01:22.787100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:01:22.815803+0000","last_undegraded":"2023-11-28T20:01:22.815803+0000","last_fullsized":"2023-11-28T20:01:22.815803+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:22.787100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:22.787100+0000","last_clean_scrub_stamp":"2023-11-28T20:01:22.787100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.23","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-11-28T20:01:21.798126+0000","last_change":"2023-11-28T20:01:10.534726+0000","last_active":"2023-11-28T20:01:21.798126+0000","last_peered":"2023-11-28T20:01:21.798126+0000","last_clean":"2023-11-28T20:01:21.798126+0000","last_became_active":"2023-11-28T20:01:10.534413+0000","last_became_peered":"2023-11-28T20:01:10.534413+0000","last_unstale":"2023-11-28T20:01:21.798126+0000","last_undegraded":"2023-11-28T20:01:21.798126+0000","last_fullsized":"2023-11-28T20:01:21.798126+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_clean_scrub_stamp":"2023-11-28T20:01:09.480611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:30:22.791908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.24","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2023-11-28T20:01:22.799856+0000","last_change":"2023-11-28T20:01:22.799856+0000","last_active":"2023-11-28T20:01:22.787100+0000","last_peered":"2023-11-28T20:01:22.787100+0000","last_clean":"2023-11-28T20:01:22.787100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:01:22.799856+0000","last_undegraded":"2023-11-28T20:01:22.799856+0000","last_fullsized":"2023-11-28T20:01:22.799856+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:22.787100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:22.787100+0000","last_clean_scrub_stamp":"2023-11-28T20:01:22.787100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.22","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-11-28T20:01:21.793740+0000","last_change":"2023-11-28T20:01:10.534050+0000","last_active":"2023-11-28T20:01:21.793740+0000","last_peered":"2023-11-28T20:01:21.793740+0000","last_clean":"2023-11-28T20:01:21.793740+0000","last_became_active":"2023-11-28T20:01:10.533704+0000","last_became_peered":"2023-11-28T20:01:10.533704+0000","last_unstale":"2023-11-28T20:01:21.793740+0000","last_undegraded":"2023-11-28T20:01:21.793740+0000","last_fullsized":"2023-11-28T20:01:21.793740+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_clean_scrub_stamp":"2023-11-28T20:01:09.480611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:50:58.589965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.27","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2023-11-28T20:01:22.804472+0000","last_change":"2023-11-28T20:01:22.804472+0000","last_active":"2023-11-28T20:01:22.787100+0000","last_peered":"2023-11-28T20:01:22.787100+0000","last_clean":"2023-11-28T20:01:22.787100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:01:22.804472+0000","last_undegraded":"2023-11-28T20:01:22.804472+0000","last_fullsized":"2023-11-28T20:01:22.804472+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:22.787100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:22.787100+0000","last_clean_scrub_stamp":"2023-11-28T20:01:22.787100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.21","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-11-28T20:01:21.791333+0000","last_change":"2023-11-28T20:01:10.520311+0000","last_active":"2023-11-28T20:01:21.791333+0000","last_peered":"2023-11-28T20:01:21.791333+0000","last_clean":"2023-11-28T20:01:21.791333+0000","last_became_active":"2023-11-28T20:01:10.519974+0000","last_became_peered":"2023-11-28T20:01:10.519974+0000","last_unstale":"2023-11-28T20:01:21.791333+0000","last_undegraded":"2023-11-28T20:01:21.791333+0000","last_fullsized":"2023-11-28T20:01:21.791333+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_clean_scrub_stamp":"2023-11-28T20:01:09.480611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T07:02:13.895402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.26","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2023-11-28T20:01:22.808714+0000","last_change":"2023-11-28T20:01:22.808714+0000","last_active":"2023-11-28T20:01:22.787100+0000","last_peered":"2023-11-28T20:01:22.787100+0000","last_clean":"2023-11-28T20:01:22.787100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:01:22.808714+0000","last_undegraded":"2023-11-28T20:01:22.808714+0000","last_fullsized":"2023-11-28T20:01:22.808714+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:22.787100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:22.787100+0000","last_clean_scrub_stamp":"2023-11-28T20:01:22.787100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.20","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-11-28T20:01:21.800585+0000","last_change":"2023-11-28T20:01:10.525223+0000","last_active":"2023-11-28T20:01:21.800585+0000","last_peered":"2023-11-28T20:01:21.800585+0000","last_clean":"2023-11-28T20:01:21.800585+0000","last_became_active":"2023-11-28T20:01:10.524750+0000","last_became_peered":"2023-11-28T20:01:10.524750+0000","last_unstale":"2023-11-28T20:01:21.800585+0000","last_undegraded":"2023-11-28T20:01:21.800585+0000","last_fullsized":"2023-11-28T20:01:21.800585+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_clean_scrub_stamp":"2023-11-28T20:01:09.480611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:50:58.589965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.1a","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2023-11-28T20:01:22.804950+0000","last_change":"2023-11-28T20:01:22.804950+0000","last_active":"2023-11-28T20:01:22.787100+0000","last_peered":"2023-11-28T20:01:22.787100+0000","last_clean":"2023-11-28T20:01:22.787100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:01:22.804950+0000","last_undegraded":"2023-11-28T20:01:22.804950+0000","last_fullsized":"2023-11-28T20:01:22.804950+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:22.787100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:22.787100+0000","last_clean_scrub_stamp":"2023-11-28T20:01:22.787100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1d","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-28T20:01:22.832104+0000","last_change":"2023-11-28T20:01:22.828333+0000","last_active":"2023-11-28T20:01:22.832104+0000","last_peered":"2023-11-28T20:01:22.832104+0000","last_clean":"2023-11-28T20:01:22.832104+0000","last_became_active":"2023-11-28T20:01:22.828042+0000","last_became_peered":"2023-11-28T20:01:22.828042+0000","last_unstale":"2023-11-28T20:01:22.832104+0000","last_undegraded":"2023-11-28T20:01:22.832104+0000","last_fullsized":"2023-11-28T20:01:22.832104+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:21.777981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:21.777981+0000","last_clean_scrub_stamp":"2023-11-28T20:01:21.777981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:51:49.021909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1c","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-11-28T20:01:21.801606+0000","last_change":"2023-11-28T20:01:10.528869+0000","last_active":"2023-11-28T20:01:21.801606+0000","last_peered":"2023-11-28T20:01:21.801606+0000","last_clean":"2023-11-28T20:01:21.801606+0000","last_became_active":"2023-11-28T20:01:10.528572+0000","last_became_peered":"2023-11-28T20:01:10.528572+0000","last_unstale":"2023-11-28T20:01:21.801606+0000","last_undegraded":"2023-11-28T20:01:21.801606+0000","last_fullsized":"2023-11-28T20:01:21.801606+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_clean_scrub_stamp":"2023-11-28T20:01:09.480611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:37:17.516298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.1f","version":"60'4","reported_seq":18,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-11-28T20:01:21.790597+0000","last_change":"2023-11-28T20:01:09.512544+0000","last_active":"2023-11-28T20:01:21.790597+0000","last_peered":"2023-11-28T20:01:21.790597+0000","last_clean":"2023-11-28T20:01:21.790597+0000","last_became_active":"2023-11-28T20:01:09.512197+0000","last_became_peered":"2023-11-28T20:01:09.512197+0000","last_unstale":"2023-11-28T20:01:21.790597+0000","last_undegraded":"2023-11-28T20:01:21.790597+0000","last_fullsized":"2023-11-28T20:01:21.790597+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:08.474257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:08.474257+0000","last_clean_scrub_stamp":"2023-11-28T20:01:08.474257+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:49:01.550926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.1b","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2023-11-28T20:01:22.806830+0000","last_change":"2023-11-28T20:01:22.806830+0000","last_active":"2023-11-28T20:01:22.787100+0000","last_peered":"2023-11-28T20:01:22.787100+0000","last_clean":"2023-11-28T20:01:22.787100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:01:22.806830+0000","last_undegraded":"2023-11-28T20:01:22.806830+0000","last_fullsized":"2023-11-28T20:01:22.806830+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:22.787100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:22.787100+0000","last_clean_scrub_stamp":"2023-11-28T20:01:22.787100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1c","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-28T20:01:22.827276+0000","last_change":"2023-11-28T20:01:22.821621+0000","last_active":"2023-11-28T20:01:22.827276+0000","last_peered":"2023-11-28T20:01:22.827276+0000","last_clean":"2023-11-28T20:01:22.827276+0000","last_became_active":"2023-11-28T20:01:22.821322+0000","last_became_peered":"2023-11-28T20:01:22.821322+0000","last_unstale":"2023-11-28T20:01:22.827276+0000","last_undegraded":"2023-11-28T20:01:22.827276+0000","last_fullsized":"2023-11-28T20:01:22.827276+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:21.777981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:21.777981+0000","last_clean_scrub_stamp":"2023-11-28T20:01:21.777981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:05:44.877415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.1d","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-11-28T20:01:21.791853+0000","last_change":"2023-11-28T20:01:10.528270+0000","last_active":"2023-11-28T20:01:21.791853+0000","last_peered":"2023-11-28T20:01:21.791853+0000","last_clean":"2023-11-28T20:01:21.791853+0000","last_became_active":"2023-11-28T20:01:10.527932+0000","last_became_peered":"2023-11-28T20:01:10.527932+0000","last_unstale":"2023-11-28T20:01:21.791853+0000","last_undegraded":"2023-11-28T20:01:21.791853+0000","last_fullsized":"2023-11-28T20:01:21.791853+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_clean_scrub_stamp":"2023-11-28T20:01:09.480611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T07:21:45.278688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1e","version":"60'1","reported_seq":15,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-11-28T20:01:21.801722+0000","last_change":"2023-11-28T20:01:09.516140+0000","last_active":"2023-11-28T20:01:21.801722+0000","last_peered":"2023-11-28T20:01:21.801722+0000","last_clean":"2023-11-28T20:01:21.801722+0000","last_became_active":"2023-11-28T20:01:09.514007+0000","last_became_peered":"2023-11-28T20:01:09.514007+0000","last_unstale":"2023-11-28T20:01:21.801722+0000","last_undegraded":"2023-11-28T20:01:21.801722+0000","last_fullsized":"2023-11-28T20:01:21.801722+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:08.474257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:08.474257+0000","last_clean_scrub_stamp":"2023-11-28T20:01:08.474257+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:30:21.785554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.18","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2023-11-28T20:01:22.807282+0000","last_change":"2023-11-28T20:01:22.807282+0000","last_active":"2023-11-28T20:01:22.787100+0000","last_peered":"2023-11-28T20:01:22.787100+0000","last_clean":"2023-11-28T20:01:22.787100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:01:22.807282+0000","last_undegraded":"2023-11-28T20:01:22.807282+0000","last_fullsized":"2023-11-28T20:01:22.807282+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:22.787100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:22.787100+0000","last_clean_scrub_stamp":"2023-11-28T20:01:22.787100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.1f","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-28T20:01:22.825882+0000","last_change":"2023-11-28T20:01:22.821923+0000","last_active":"2023-11-28T20:01:22.825882+0000","last_peered":"2023-11-28T20:01:22.825882+0000","last_clean":"2023-11-28T20:01:22.825882+0000","last_became_active":"2023-11-28T20:01:22.821642+0000","last_became_peered":"2023-11-28T20:01:22.821642+0000","last_unstale":"2023-11-28T20:01:22.825882+0000","last_undegraded":"2023-11-28T20:01:22.825882+0000","last_fullsized":"2023-11-28T20:01:22.825882+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:21.777981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:21.777981+0000","last_clean_scrub_stamp":"2023-11-28T20:01:21.777981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:17:30.312696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.1e","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-11-28T20:01:21.801669+0000","last_change":"2023-11-28T20:01:10.526680+0000","last_active":"2023-11-28T20:01:21.801669+0000","last_peered":"2023-11-28T20:01:21.801669+0000","last_clean":"2023-11-28T20:01:21.801669+0000","last_became_active":"2023-11-28T20:01:10.526366+0000","last_became_peered":"2023-11-28T20:01:10.526366+0000","last_unstale":"2023-11-28T20:01:21.801669+0000","last_undegraded":"2023-11-28T20:01:21.801669+0000","last_fullsized":"2023-11-28T20:01:21.801669+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_clean_scrub_stamp":"2023-11-28T20:01:09.480611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:05:54.478424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1d","version":"60'2","reported_seq":16,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-11-28T20:01:21.801620+0000","last_change":"2023-11-28T20:01:09.510600+0000","last_active":"2023-11-28T20:01:21.801620+0000","last_peered":"2023-11-28T20:01:21.801620+0000","last_clean":"2023-11-28T20:01:21.801620+0000","last_became_active":"2023-11-28T20:01:09.510336+0000","last_became_peered":"2023-11-28T20:01:09.510336+0000","last_unstale":"2023-11-28T20:01:21.801620+0000","last_undegraded":"2023-11-28T20:01:21.801620+0000","last_fullsized":"2023-11-28T20:01:21.801620+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:08.474257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:08.474257+0000","last_clean_scrub_stamp":"2023-11-28T20:01:08.474257+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:56:14.988591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.19","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2023-11-28T20:01:22.804536+0000","last_change":"2023-11-28T20:01:22.804536+0000","last_active":"2023-11-28T20:01:22.787100+0000","last_peered":"2023-11-28T20:01:22.787100+0000","last_clean":"2023-11-28T20:01:22.787100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:01:22.804536+0000","last_undegraded":"2023-11-28T20:01:22.804536+0000","last_fullsized":"2023-11-28T20:01:22.804536+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:22.787100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:22.787100+0000","last_clean_scrub_stamp":"2023-11-28T20:01:22.787100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1e","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-28T20:01:22.832207+0000","last_change":"2023-11-28T20:01:22.828784+0000","last_active":"2023-11-28T20:01:22.832207+0000","last_peered":"2023-11-28T20:01:22.832207+0000","last_clean":"2023-11-28T20:01:22.832207+0000","last_became_active":"2023-11-28T20:01:22.828228+0000","last_became_peered":"2023-11-28T20:01:22.828228+0000","last_unstale":"2023-11-28T20:01:22.832207+0000","last_undegraded":"2023-11-28T20:01:22.832207+0000","last_fullsized":"2023-11-28T20:01:22.832207+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:21.777981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:21.777981+0000","last_clean_scrub_stamp":"2023-11-28T20:01:21.777981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:02:43.254120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1f","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-11-28T20:01:21.799642+0000","last_change":"2023-11-28T20:01:10.541960+0000","last_active":"2023-11-28T20:01:21.799642+0000","last_peered":"2023-11-28T20:01:21.799642+0000","last_clean":"2023-11-28T20:01:21.799642+0000","last_became_active":"2023-11-28T20:01:10.541305+0000","last_became_peered":"2023-11-28T20:01:10.541305+0000","last_unstale":"2023-11-28T20:01:21.799642+0000","last_undegraded":"2023-11-28T20:01:21.799642+0000","last_fullsized":"2023-11-28T20:01:21.799642+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_clean_scrub_stamp":"2023-11-28T20:01:09.480611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:17:27.097887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.1c","version":"60'2","reported_seq":16,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-11-28T20:01:21.801386+0000","last_change":"2023-11-28T20:01:09.507988+0000","last_active":"2023-11-28T20:01:21.801386+0000","last_peered":"2023-11-28T20:01:21.801386+0000","last_clean":"2023-11-28T20:01:21.801386+0000","last_became_active":"2023-11-28T20:01:09.507762+0000","last_became_peered":"2023-11-28T20:01:09.507762+0000","last_unstale":"2023-11-28T20:01:21.801386+0000","last_undegraded":"2023-11-28T20:01:21.801386+0000","last_fullsized":"2023-11-28T20:01:21.801386+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:08.474257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:08.474257+0000","last_clean_scrub_stamp":"2023-11-28T20:01:08.474257+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T07:14:20.829778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.1e","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2023-11-28T20:01:22.806058+0000","last_change":"2023-11-28T20:01:22.806058+0000","last_active":"2023-11-28T20:01:22.787100+0000","last_peered":"2023-11-28T20:01:22.787100+0000","last_clean":"2023-11-28T20:01:22.787100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:01:22.806058+0000","last_undegraded":"2023-11-28T20:01:22.806058+0000","last_fullsized":"2023-11-28T20:01:22.806058+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:22.787100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:22.787100+0000","last_clean_scrub_stamp":"2023-11-28T20:01:22.787100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-28T20:01:22.821300+0000","last_change":"2023-11-28T20:01:22.818660+0000","last_active":"2023-11-28T20:01:22.821300+0000","last_peered":"2023-11-28T20:01:22.821300+0000","last_clean":"2023-11-28T20:01:22.821300+0000","last_became_active":"2023-11-28T20:01:22.818352+0000","last_became_peered":"2023-11-28T20:01:22.818352+0000","last_unstale":"2023-11-28T20:01:22.821300+0000","last_undegraded":"2023-11-28T20:01:22.821300+0000","last_fullsized":"2023-11-28T20:01:22.821300+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:21.777981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:21.777981+0000","last_clean_scrub_stamp":"2023-11-28T20:01:21.777981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:59:20.866094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-11-28T20:01:21.796193+0000","last_change":"2023-11-28T20:01:10.518032+0000","last_active":"2023-11-28T20:01:21.796193+0000","last_peered":"2023-11-28T20:01:21.796193+0000","last_clean":"2023-11-28T20:01:21.796193+0000","last_became_active":"2023-11-28T20:01:10.517780+0000","last_became_peered":"2023-11-28T20:01:10.517780+0000","last_unstale":"2023-11-28T20:01:21.796193+0000","last_undegraded":"2023-11-28T20:01:21.796193+0000","last_fullsized":"2023-11-28T20:01:21.796193+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_clean_scrub_stamp":"2023-11-28T20:01:09.480611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:43:39.118896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.1b","version":"60'1","reported_seq":15,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-11-28T20:01:21.797196+0000","last_change":"2023-11-28T20:01:09.514901+0000","last_active":"2023-11-28T20:01:21.797196+0000","last_peered":"2023-11-28T20:01:21.797196+0000","last_clean":"2023-11-28T20:01:21.797196+0000","last_became_active":"2023-11-28T20:01:09.514568+0000","last_became_peered":"2023-11-28T20:01:09.514568+0000","last_unstale":"2023-11-28T20:01:21.797196+0000","last_undegraded":"2023-11-28T20:01:21.797196+0000","last_fullsized":"2023-11-28T20:01:21.797196+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:08.474257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:08.474257+0000","last_clean_scrub_stamp":"2023-11-28T20:01:08.474257+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:44:33.393018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.1f","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2023-11-28T20:01:22.808178+0000","last_change":"2023-11-28T20:01:22.808178+0000","last_active":"2023-11-28T20:01:22.787100+0000","last_peered":"2023-11-28T20:01:22.787100+0000","last_clean":"2023-11-28T20:01:22.787100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:01:22.808178+0000","last_undegraded":"2023-11-28T20:01:22.808178+0000","last_fullsized":"2023-11-28T20:01:22.808178+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:22.787100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:22.787100+0000","last_clean_scrub_stamp":"2023-11-28T20:01:22.787100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-28T20:01:22.816804+0000","last_change":"2023-11-28T20:01:22.811015+0000","last_active":"2023-11-28T20:01:22.816804+0000","last_peered":"2023-11-28T20:01:22.816804+0000","last_clean":"2023-11-28T20:01:22.816804+0000","last_became_active":"2023-11-28T20:01:22.810559+0000","last_became_peered":"2023-11-28T20:01:22.810559+0000","last_unstale":"2023-11-28T20:01:22.816804+0000","last_undegraded":"2023-11-28T20:01:22.816804+0000","last_fullsized":"2023-11-28T20:01:22.816804+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:21.777981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:21.777981+0000","last_clean_scrub_stamp":"2023-11-28T20:01:21.777981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:14:31.333418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-11-28T20:01:21.789863+0000","last_change":"2023-11-28T20:01:10.522005+0000","last_active":"2023-11-28T20:01:21.789863+0000","last_peered":"2023-11-28T20:01:21.789863+0000","last_clean":"2023-11-28T20:01:21.789863+0000","last_became_active":"2023-11-28T20:01:10.521691+0000","last_became_peered":"2023-11-28T20:01:10.521691+0000","last_unstale":"2023-11-28T20:01:21.789863+0000","last_undegraded":"2023-11-28T20:01:21.789863+0000","last_fullsized":"2023-11-28T20:01:21.789863+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_clean_scrub_stamp":"2023-11-28T20:01:09.480611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:11:08.794514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1a","version":"60'1","reported_seq":15,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-11-28T20:01:21.796566+0000","last_change":"2023-11-28T20:01:09.510388+0000","last_active":"2023-11-28T20:01:21.796566+0000","last_peered":"2023-11-28T20:01:21.796566+0000","last_clean":"2023-11-28T20:01:21.796566+0000","last_became_active":"2023-11-28T20:01:09.510114+0000","last_became_peered":"2023-11-28T20:01:09.510114+0000","last_unstale":"2023-11-28T20:01:21.796566+0000","last_undegraded":"2023-11-28T20:01:21.796566+0000","last_fullsized":"2023-11-28T20:01:21.796566+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:08.474257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:08.474257+0000","last_clean_scrub_stamp":"2023-11-28T20:01:08.474257+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T06:29:12.572972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.1c","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2023-11-28T20:01:22.805361+0000","last_change":"2023-11-28T20:01:22.805361+0000","last_active":"2023-11-28T20:01:22.787100+0000","last_peered":"2023-11-28T20:01:22.787100+0000","last_clean":"2023-11-28T20:01:22.787100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:01:22.805361+0000","last_undegraded":"2023-11-28T20:01:22.805361+0000","last_fullsized":"2023-11-28T20:01:22.805361+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:22.787100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:22.787100+0000","last_clean_scrub_stamp":"2023-11-28T20:01:22.787100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1b","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-28T20:01:22.829871+0000","last_change":"2023-11-28T20:01:22.826731+0000","last_active":"2023-11-28T20:01:22.829871+0000","last_peered":"2023-11-28T20:01:22.829871+0000","last_clean":"2023-11-28T20:01:22.829871+0000","last_became_active":"2023-11-28T20:01:22.826278+0000","last_became_peered":"2023-11-28T20:01:22.826278+0000","last_unstale":"2023-11-28T20:01:22.829871+0000","last_undegraded":"2023-11-28T20:01:22.829871+0000","last_fullsized":"2023-11-28T20:01:22.829871+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:21.777981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:21.777981+0000","last_clean_scrub_stamp":"2023-11-28T20:01:21.777981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T07:05:57.693273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.1a","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-11-28T20:01:21.801060+0000","last_change":"2023-11-28T20:01:10.536831+0000","last_active":"2023-11-28T20:01:21.801060+0000","last_peered":"2023-11-28T20:01:21.801060+0000","last_clean":"2023-11-28T20:01:21.801060+0000","last_became_active":"2023-11-28T20:01:10.536506+0000","last_became_peered":"2023-11-28T20:01:10.536506+0000","last_unstale":"2023-11-28T20:01:21.801060+0000","last_undegraded":"2023-11-28T20:01:21.801060+0000","last_fullsized":"2023-11-28T20:01:21.801060+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_clean_scrub_stamp":"2023-11-28T20:01:09.480611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:29:39.856095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":14,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-11-28T20:01:21.796477+0000","last_change":"2023-11-28T20:01:09.514530+0000","last_active":"2023-11-28T20:01:21.796477+0000","last_peered":"2023-11-28T20:01:21.796477+0000","last_clean":"2023-11-28T20:01:21.796477+0000","last_became_active":"2023-11-28T20:01:09.514112+0000","last_became_peered":"2023-11-28T20:01:09.514112+0000","last_unstale":"2023-11-28T20:01:21.796477+0000","last_undegraded":"2023-11-28T20:01:21.796477+0000","last_fullsized":"2023-11-28T20:01:21.796477+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:08.474257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:08.474257+0000","last_clean_scrub_stamp":"2023-11-28T20:01:08.474257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:07:02.838212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.1d","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2023-11-28T20:01:22.804949+0000","last_change":"2023-11-28T20:01:22.804949+0000","last_active":"2023-11-28T20:01:22.787100+0000","last_peered":"2023-11-28T20:01:22.787100+0000","last_clean":"2023-11-28T20:01:22.787100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:01:22.804949+0000","last_undegraded":"2023-11-28T20:01:22.804949+0000","last_fullsized":"2023-11-28T20:01:22.804949+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:22.787100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:22.787100+0000","last_clean_scrub_stamp":"2023-11-28T20:01:22.787100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1a","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-28T20:01:22.827278+0000","last_change":"2023-11-28T20:01:22.823414+0000","last_active":"2023-11-28T20:01:22.827278+0000","last_peered":"2023-11-28T20:01:22.827278+0000","last_clean":"2023-11-28T20:01:22.827278+0000","last_became_active":"2023-11-28T20:01:22.823073+0000","last_became_peered":"2023-11-28T20:01:22.823073+0000","last_unstale":"2023-11-28T20:01:22.827278+0000","last_undegraded":"2023-11-28T20:01:22.827278+0000","last_fullsized":"2023-11-28T20:01:22.827278+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:21.777981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:21.777981+0000","last_clean_scrub_stamp":"2023-11-28T20:01:21.777981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:13:17.072225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.1b","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-11-28T20:01:21.797586+0000","last_change":"2023-11-28T20:01:10.522250+0000","last_active":"2023-11-28T20:01:21.797586+0000","last_peered":"2023-11-28T20:01:21.797586+0000","last_clean":"2023-11-28T20:01:21.797586+0000","last_became_active":"2023-11-28T20:01:10.521958+0000","last_became_peered":"2023-11-28T20:01:10.521958+0000","last_unstale":"2023-11-28T20:01:21.797586+0000","last_undegraded":"2023-11-28T20:01:21.797586+0000","last_fullsized":"2023-11-28T20:01:21.797586+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_clean_scrub_stamp":"2023-11-28T20:01:09.480611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:59:08.568724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":14,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-11-28T20:01:21.801005+0000","last_change":"2023-11-28T20:01:09.512078+0000","last_active":"2023-11-28T20:01:21.801005+0000","last_peered":"2023-11-28T20:01:21.801005+0000","last_clean":"2023-11-28T20:01:21.801005+0000","last_became_active":"2023-11-28T20:01:09.511733+0000","last_became_peered":"2023-11-28T20:01:09.511733+0000","last_unstale":"2023-11-28T20:01:21.801005+0000","last_undegraded":"2023-11-28T20:01:21.801005+0000","last_fullsized":"2023-11-28T20:01:21.801005+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:08.474257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:08.474257+0000","last_clean_scrub_stamp":"2023-11-28T20:01:08.474257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:16:29.294303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.12","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2023-11-28T20:01:22.801913+0000","last_change":"2023-11-28T20:01:22.801913+0000","last_active":"2023-11-28T20:01:22.787100+0000","last_peered":"2023-11-28T20:01:22.787100+0000","last_clean":"2023-11-28T20:01:22.787100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:01:22.801913+0000","last_undegraded":"2023-11-28T20:01:22.801913+0000","last_fullsized":"2023-11-28T20:01:22.801913+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:22.787100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:22.787100+0000","last_clean_scrub_stamp":"2023-11-28T20:01:22.787100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.15","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-28T20:01:22.828323+0000","last_change":"2023-11-28T20:01:22.818633+0000","last_active":"2023-11-28T20:01:22.828323+0000","last_peered":"2023-11-28T20:01:22.828323+0000","last_clean":"2023-11-28T20:01:22.828323+0000","last_became_active":"2023-11-28T20:01:22.818036+0000","last_became_peered":"2023-11-28T20:01:22.818036+0000","last_unstale":"2023-11-28T20:01:22.828323+0000","last_undegraded":"2023-11-28T20:01:22.828323+0000","last_fullsized":"2023-11-28T20:01:22.828323+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:21.777981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:21.777981+0000","last_clean_scrub_stamp":"2023-11-28T20:01:21.777981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:18:51.761689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.14","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-11-28T20:01:21.790040+0000","last_change":"2023-11-28T20:01:10.517714+0000","last_active":"2023-11-28T20:01:21.790040+0000","last_peered":"2023-11-28T20:01:21.790040+0000","last_clean":"2023-11-28T20:01:21.790040+0000","last_became_active":"2023-11-28T20:01:10.517414+0000","last_became_peered":"2023-11-28T20:01:10.517414+0000","last_unstale":"2023-11-28T20:01:21.790040+0000","last_undegraded":"2023-11-28T20:01:21.790040+0000","last_fullsized":"2023-11-28T20:01:21.790040+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_clean_scrub_stamp":"2023-11-28T20:01:09.480611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T06:10:19.765319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":14,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-11-28T20:01:21.799883+0000","last_change":"2023-11-28T20:01:09.519465+0000","last_active":"2023-11-28T20:01:21.799883+0000","last_peered":"2023-11-28T20:01:21.799883+0000","last_clean":"2023-11-28T20:01:21.799883+0000","last_became_active":"2023-11-28T20:01:09.519233+0000","last_became_peered":"2023-11-28T20:01:09.519233+0000","last_unstale":"2023-11-28T20:01:21.799883+0000","last_undegraded":"2023-11-28T20:01:21.799883+0000","last_fullsized":"2023-11-28T20:01:21.799883+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:08.474257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:08.474257+0000","last_clean_scrub_stamp":"2023-11-28T20:01:08.474257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T07:34:36.168268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.13","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2023-11-28T20:01:22.809235+0000","last_change":"2023-11-28T20:01:22.809235+0000","last_active":"2023-11-28T20:01:22.787100+0000","last_peered":"2023-11-28T20:01:22.787100+0000","last_clean":"2023-11-28T20:01:22.787100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:01:22.809235+0000","last_undegraded":"2023-11-28T20:01:22.809235+0000","last_fullsized":"2023-11-28T20:01:22.809235+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:22.787100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:22.787100+0000","last_clean_scrub_stamp":"2023-11-28T20:01:22.787100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.14","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-28T20:01:22.821306+0000","last_change":"2023-11-28T20:01:22.818713+0000","last_active":"2023-11-28T20:01:22.821306+0000","last_peered":"2023-11-28T20:01:22.821306+0000","last_clean":"2023-11-28T20:01:22.821306+0000","last_became_active":"2023-11-28T20:01:22.817121+0000","last_became_peered":"2023-11-28T20:01:22.817121+0000","last_unstale":"2023-11-28T20:01:22.821306+0000","last_undegraded":"2023-11-28T20:01:22.821306+0000","last_fullsized":"2023-11-28T20:01:22.821306+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:21.777981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:21.777981+0000","last_clean_scrub_stamp":"2023-11-28T20:01:21.777981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:56:28.292315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.15","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-11-28T20:01:21.797005+0000","last_change":"2023-11-28T20:01:10.533748+0000","last_active":"2023-11-28T20:01:21.797005+0000","last_peered":"2023-11-28T20:01:21.797005+0000","last_clean":"2023-11-28T20:01:21.797005+0000","last_became_active":"2023-11-28T20:01:10.533411+0000","last_became_peered":"2023-11-28T20:01:10.533411+0000","last_unstale":"2023-11-28T20:01:21.797005+0000","last_undegraded":"2023-11-28T20:01:21.797005+0000","last_fullsized":"2023-11-28T20:01:21.797005+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_clean_scrub_stamp":"2023-11-28T20:01:09.480611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:58:23.470366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":14,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-11-28T20:01:21.792925+0000","last_change":"2023-11-28T20:01:09.507203+0000","last_active":"2023-11-28T20:01:21.792925+0000","last_peered":"2023-11-28T20:01:21.792925+0000","last_clean":"2023-11-28T20:01:21.792925+0000","last_became_active":"2023-11-28T20:01:09.506901+0000","last_became_peered":"2023-11-28T20:01:09.506901+0000","last_unstale":"2023-11-28T20:01:21.792925+0000","last_undegraded":"2023-11-28T20:01:21.792925+0000","last_fullsized":"2023-11-28T20:01:21.792925+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:08.474257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:08.474257+0000","last_clean_scrub_stamp":"2023-11-28T20:01:08.474257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:15:27.309843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.10","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2023-11-28T20:01:22.804660+0000","last_change":"2023-11-28T20:01:22.804660+0000","last_active":"2023-11-28T20:01:22.787100+0000","last_peered":"2023-11-28T20:01:22.787100+0000","last_clean":"2023-11-28T20:01:22.787100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:01:22.804660+0000","last_undegraded":"2023-11-28T20:01:22.804660+0000","last_fullsized":"2023-11-28T20:01:22.804660+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:22.787100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:22.787100+0000","last_clean_scrub_stamp":"2023-11-28T20:01:22.787100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.17","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-28T20:01:22.832084+0000","last_change":"2023-11-28T20:01:22.828593+0000","last_active":"2023-11-28T20:01:22.832084+0000","last_peered":"2023-11-28T20:01:22.832084+0000","last_clean":"2023-11-28T20:01:22.832084+0000","last_became_active":"2023-11-28T20:01:22.828323+0000","last_became_peered":"2023-11-28T20:01:22.828323+0000","last_unstale":"2023-11-28T20:01:22.832084+0000","last_undegraded":"2023-11-28T20:01:22.832084+0000","last_fullsized":"2023-11-28T20:01:22.832084+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:21.777981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:21.777981+0000","last_clean_scrub_stamp":"2023-11-28T20:01:21.777981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:58:35.767735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-11-28T20:01:21.801739+0000","last_change":"2023-11-28T20:01:10.537355+0000","last_active":"2023-11-28T20:01:21.801739+0000","last_peered":"2023-11-28T20:01:21.801739+0000","last_clean":"2023-11-28T20:01:21.801739+0000","last_became_active":"2023-11-28T20:01:10.536210+0000","last_became_peered":"2023-11-28T20:01:10.536210+0000","last_unstale":"2023-11-28T20:01:21.801739+0000","last_undegraded":"2023-11-28T20:01:21.801739+0000","last_fullsized":"2023-11-28T20:01:21.801739+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_clean_scrub_stamp":"2023-11-28T20:01:09.480611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T07:05:45.395904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.15","version":"60'3","reported_seq":17,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-11-28T20:01:21.798567+0000","last_change":"2023-11-28T20:01:09.519066+0000","last_active":"2023-11-28T20:01:21.798567+0000","last_peered":"2023-11-28T20:01:21.798567+0000","last_clean":"2023-11-28T20:01:21.798567+0000","last_became_active":"2023-11-28T20:01:09.518151+0000","last_became_peered":"2023-11-28T20:01:09.518151+0000","last_unstale":"2023-11-28T20:01:21.798567+0000","last_undegraded":"2023-11-28T20:01:21.798567+0000","last_fullsized":"2023-11-28T20:01:21.798567+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:08.474257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:08.474257+0000","last_clean_scrub_stamp":"2023-11-28T20:01:08.474257+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:00:29.783639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.11","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2023-11-28T20:01:22.808212+0000","last_change":"2023-11-28T20:01:22.808212+0000","last_active":"2023-11-28T20:01:22.787100+0000","last_peered":"2023-11-28T20:01:22.787100+0000","last_clean":"2023-11-28T20:01:22.787100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:01:22.808212+0000","last_undegraded":"2023-11-28T20:01:22.808212+0000","last_fullsized":"2023-11-28T20:01:22.808212+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:22.787100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:22.787100+0000","last_clean_scrub_stamp":"2023-11-28T20:01:22.787100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-28T20:01:22.823605+0000","last_change":"2023-11-28T20:01:22.819332+0000","last_active":"2023-11-28T20:01:22.823605+0000","last_peered":"2023-11-28T20:01:22.823605+0000","last_clean":"2023-11-28T20:01:22.823605+0000","last_became_active":"2023-11-28T20:01:22.818798+0000","last_became_peered":"2023-11-28T20:01:22.818798+0000","last_unstale":"2023-11-28T20:01:22.823605+0000","last_undegraded":"2023-11-28T20:01:22.823605+0000","last_fullsized":"2023-11-28T20:01:22.823605+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:21.777981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:21.777981+0000","last_clean_scrub_stamp":"2023-11-28T20:01:21.777981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:30:50.602373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.17","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-11-28T20:01:21.791581+0000","last_change":"2023-11-28T20:01:10.521819+0000","last_active":"2023-11-28T20:01:21.791581+0000","last_peered":"2023-11-28T20:01:21.791581+0000","last_clean":"2023-11-28T20:01:21.791581+0000","last_became_active":"2023-11-28T20:01:10.521475+0000","last_became_peered":"2023-11-28T20:01:10.521475+0000","last_unstale":"2023-11-28T20:01:21.791581+0000","last_undegraded":"2023-11-28T20:01:21.791581+0000","last_fullsized":"2023-11-28T20:01:21.791581+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_clean_scrub_stamp":"2023-11-28T20:01:09.480611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:16:30.300658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.14","version":"61'8","reported_seq":22,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-11-28T20:01:21.790211+0000","last_change":"2023-11-28T20:01:09.511176+0000","last_active":"2023-11-28T20:01:21.790211+0000","last_peered":"2023-11-28T20:01:21.790211+0000","last_clean":"2023-11-28T20:01:21.790211+0000","last_became_active":"2023-11-28T20:01:09.510427+0000","last_became_peered":"2023-11-28T20:01:09.510427+0000","last_unstale":"2023-11-28T20:01:21.790211+0000","last_undegraded":"2023-11-28T20:01:21.790211+0000","last_fullsized":"2023-11-28T20:01:21.790211+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:08.474257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:08.474257+0000","last_clean_scrub_stamp":"2023-11-28T20:01:08.474257+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:47:12.268146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3107,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.16","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2023-11-28T20:01:22.802114+0000","last_change":"2023-11-28T20:01:22.802114+0000","last_active":"2023-11-28T20:01:22.787100+0000","last_peered":"2023-11-28T20:01:22.787100+0000","last_clean":"2023-11-28T20:01:22.787100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:01:22.802114+0000","last_undegraded":"2023-11-28T20:01:22.802114+0000","last_fullsized":"2023-11-28T20:01:22.802114+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:22.787100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:22.787100+0000","last_clean_scrub_stamp":"2023-11-28T20:01:22.787100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-28T20:01:22.817286+0000","last_change":"2023-11-28T20:01:22.812353+0000","last_active":"2023-11-28T20:01:22.817286+0000","last_peered":"2023-11-28T20:01:22.817286+0000","last_clean":"2023-11-28T20:01:22.817286+0000","last_became_active":"2023-11-28T20:01:22.812090+0000","last_became_peered":"2023-11-28T20:01:22.812090+0000","last_unstale":"2023-11-28T20:01:22.817286+0000","last_undegraded":"2023-11-28T20:01:22.817286+0000","last_fullsized":"2023-11-28T20:01:22.817286+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:21.777981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:21.777981+0000","last_clean_scrub_stamp":"2023-11-28T20:01:21.777981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:54:32.863267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.10","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-11-28T20:01:21.791194+0000","last_change":"2023-11-28T20:01:10.533224+0000","last_active":"2023-11-28T20:01:21.791194+0000","last_peered":"2023-11-28T20:01:21.791194+0000","last_clean":"2023-11-28T20:01:21.791194+0000","last_became_active":"2023-11-28T20:01:10.532909+0000","last_became_peered":"2023-11-28T20:01:10.532909+0000","last_unstale":"2023-11-28T20:01:21.791194+0000","last_undegraded":"2023-11-28T20:01:21.791194+0000","last_fullsized":"2023-11-28T20:01:21.791194+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_clean_scrub_stamp":"2023-11-28T20:01:09.480611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:32:06.877460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.13","version":"60'2","reported_seq":16,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-11-28T20:01:21.798151+0000","last_change":"2023-11-28T20:01:09.518379+0000","last_active":"2023-11-28T20:01:21.798151+0000","last_peered":"2023-11-28T20:01:21.798151+0000","last_clean":"2023-11-28T20:01:21.798151+0000","last_became_active":"2023-11-28T20:01:09.518073+0000","last_became_peered":"2023-11-28T20:01:09.518073+0000","last_unstale":"2023-11-28T20:01:21.798151+0000","last_undegraded":"2023-11-28T20:01:21.798151+0000","last_fullsized":"2023-11-28T20:01:21.798151+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:08.474257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:08.474257+0000","last_clean_scrub_stamp":"2023-11-28T20:01:08.474257+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:11:07.788160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.17","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2023-11-28T20:01:22.807329+0000","last_change":"2023-11-28T20:01:22.807329+0000","last_active":"2023-11-28T20:01:22.787100+0000","last_peered":"2023-11-28T20:01:22.787100+0000","last_clean":"2023-11-28T20:01:22.787100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:01:22.807329+0000","last_undegraded":"2023-11-28T20:01:22.807329+0000","last_fullsized":"2023-11-28T20:01:22.807329+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:22.787100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:22.787100+0000","last_clean_scrub_stamp":"2023-11-28T20:01:22.787100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.10","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-28T20:01:22.821250+0000","last_change":"2023-11-28T20:01:22.818135+0000","last_active":"2023-11-28T20:01:22.821250+0000","last_peered":"2023-11-28T20:01:22.821250+0000","last_clean":"2023-11-28T20:01:22.821250+0000","last_became_active":"2023-11-28T20:01:22.817952+0000","last_became_peered":"2023-11-28T20:01:22.817952+0000","last_unstale":"2023-11-28T20:01:22.821250+0000","last_undegraded":"2023-11-28T20:01:22.821250+0000","last_fullsized":"2023-11-28T20:01:22.821250+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:21.777981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:21.777981+0000","last_clean_scrub_stamp":"2023-11-28T20:01:21.777981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:10:42.691065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-11-28T20:01:21.793268+0000","last_change":"2023-11-28T20:01:10.520948+0000","last_active":"2023-11-28T20:01:21.793268+0000","last_peered":"2023-11-28T20:01:21.793268+0000","last_clean":"2023-11-28T20:01:21.793268+0000","last_became_active":"2023-11-28T20:01:10.520649+0000","last_became_peered":"2023-11-28T20:01:10.520649+0000","last_unstale":"2023-11-28T20:01:21.793268+0000","last_undegraded":"2023-11-28T20:01:21.793268+0000","last_fullsized":"2023-11-28T20:01:21.793268+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_clean_scrub_stamp":"2023-11-28T20:01:09.480611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:10:34.830531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":14,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-11-28T20:01:21.793840+0000","last_change":"2023-11-28T20:01:09.510604+0000","last_active":"2023-11-28T20:01:21.793840+0000","last_peered":"2023-11-28T20:01:21.793840+0000","last_clean":"2023-11-28T20:01:21.793840+0000","last_became_active":"2023-11-28T20:01:09.510326+0000","last_became_peered":"2023-11-28T20:01:09.510326+0000","last_unstale":"2023-11-28T20:01:21.793840+0000","last_undegraded":"2023-11-28T20:01:21.793840+0000","last_fullsized":"2023-11-28T20:01:21.793840+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:08.474257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:08.474257+0000","last_clean_scrub_stamp":"2023-11-28T20:01:08.474257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:56:14.988591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.14","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2023-11-28T20:01:22.809339+0000","last_change":"2023-11-28T20:01:22.809339+0000","last_active":"2023-11-28T20:01:22.787100+0000","last_peered":"2023-11-28T20:01:22.787100+0000","last_clean":"2023-11-28T20:01:22.787100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:01:22.809339+0000","last_undegraded":"2023-11-28T20:01:22.809339+0000","last_fullsized":"2023-11-28T20:01:22.809339+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:22.787100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:22.787100+0000","last_clean_scrub_stamp":"2023-11-28T20:01:22.787100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.13","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-28T20:01:22.823674+0000","last_change":"2023-11-28T20:01:22.820361+0000","last_active":"2023-11-28T20:01:22.823674+0000","last_peered":"2023-11-28T20:01:22.823674+0000","last_clean":"2023-11-28T20:01:22.823674+0000","last_became_active":"2023-11-28T20:01:22.820048+0000","last_became_peered":"2023-11-28T20:01:22.820048+0000","last_unstale":"2023-11-28T20:01:22.823674+0000","last_undegraded":"2023-11-28T20:01:22.823674+0000","last_fullsized":"2023-11-28T20:01:22.823674+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:21.777981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:21.777981+0000","last_clean_scrub_stamp":"2023-11-28T20:01:21.777981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:59:20.866094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-11-28T20:01:21.801157+0000","last_change":"2023-11-28T20:01:10.527110+0000","last_active":"2023-11-28T20:01:21.801157+0000","last_peered":"2023-11-28T20:01:21.801157+0000","last_clean":"2023-11-28T20:01:21.801157+0000","last_became_active":"2023-11-28T20:01:10.525827+0000","last_became_peered":"2023-11-28T20:01:10.525827+0000","last_unstale":"2023-11-28T20:01:21.801157+0000","last_undegraded":"2023-11-28T20:01:21.801157+0000","last_fullsized":"2023-11-28T20:01:21.801157+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_clean_scrub_stamp":"2023-11-28T20:01:09.480611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:23:02.818476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":14,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-11-28T20:01:21.798244+0000","last_change":"2023-11-28T20:01:09.519626+0000","last_active":"2023-11-28T20:01:21.798244+0000","last_peered":"2023-11-28T20:01:21.798244+0000","last_clean":"2023-11-28T20:01:21.798244+0000","last_became_active":"2023-11-28T20:01:09.519349+0000","last_became_peered":"2023-11-28T20:01:09.519349+0000","last_unstale":"2023-11-28T20:01:21.798244+0000","last_undegraded":"2023-11-28T20:01:21.798244+0000","last_fullsized":"2023-11-28T20:01:21.798244+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:08.474257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:08.474257+0000","last_clean_scrub_stamp":"2023-11-28T20:01:08.474257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:04:51.492194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.15","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2023-11-28T20:01:22.803505+0000","last_change":"2023-11-28T20:01:22.803505+0000","last_active":"2023-11-28T20:01:22.787100+0000","last_peered":"2023-11-28T20:01:22.787100+0000","last_clean":"2023-11-28T20:01:22.787100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:01:22.803505+0000","last_undegraded":"2023-11-28T20:01:22.803505+0000","last_fullsized":"2023-11-28T20:01:22.803505+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:22.787100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:22.787100+0000","last_clean_scrub_stamp":"2023-11-28T20:01:22.787100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.12","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-28T20:01:22.829149+0000","last_change":"2023-11-28T20:01:22.826285+0000","last_active":"2023-11-28T20:01:22.829149+0000","last_peered":"2023-11-28T20:01:22.829149+0000","last_clean":"2023-11-28T20:01:22.829149+0000","last_became_active":"2023-11-28T20:01:22.825975+0000","last_became_peered":"2023-11-28T20:01:22.825975+0000","last_unstale":"2023-11-28T20:01:22.829149+0000","last_undegraded":"2023-11-28T20:01:22.829149+0000","last_fullsized":"2023-11-28T20:01:22.829149+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:21.777981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:21.777981+0000","last_clean_scrub_stamp":"2023-11-28T20:01:21.777981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:10:42.691065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.13","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-11-28T20:01:21.790303+0000","last_change":"2023-11-28T20:01:10.535178+0000","last_active":"2023-11-28T20:01:21.790303+0000","last_peered":"2023-11-28T20:01:21.790303+0000","last_clean":"2023-11-28T20:01:21.790303+0000","last_became_active":"2023-11-28T20:01:10.534880+0000","last_became_peered":"2023-11-28T20:01:10.534880+0000","last_unstale":"2023-11-28T20:01:21.790303+0000","last_undegraded":"2023-11-28T20:01:21.790303+0000","last_fullsized":"2023-11-28T20:01:21.790303+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_clean_scrub_stamp":"2023-11-28T20:01:09.480611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:52:42.741966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.10","version":"60'8","reported_seq":22,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-11-28T20:01:21.791303+0000","last_change":"2023-11-28T20:01:09.511628+0000","last_active":"2023-11-28T20:01:21.791303+0000","last_peered":"2023-11-28T20:01:21.791303+0000","last_clean":"2023-11-28T20:01:21.791303+0000","last_became_active":"2023-11-28T20:01:09.511250+0000","last_became_peered":"2023-11-28T20:01:09.511250+0000","last_unstale":"2023-11-28T20:01:21.791303+0000","last_undegraded":"2023-11-28T20:01:21.791303+0000","last_fullsized":"2023-11-28T20:01:21.791303+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:08.474257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:08.474257+0000","last_clean_scrub_stamp":"2023-11-28T20:01:08.474257+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:35:34.107408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.a","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2023-11-28T20:01:22.799813+0000","last_change":"2023-11-28T20:01:22.799813+0000","last_active":"2023-11-28T20:01:22.787100+0000","last_peered":"2023-11-28T20:01:22.787100+0000","last_clean":"2023-11-28T20:01:22.787100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:01:22.799813+0000","last_undegraded":"2023-11-28T20:01:22.799813+0000","last_fullsized":"2023-11-28T20:01:22.799813+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:22.787100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:22.787100+0000","last_clean_scrub_stamp":"2023-11-28T20:01:22.787100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.d","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-28T20:01:22.824984+0000","last_change":"2023-11-28T20:01:22.818834+0000","last_active":"2023-11-28T20:01:22.824984+0000","last_peered":"2023-11-28T20:01:22.824984+0000","last_clean":"2023-11-28T20:01:22.824984+0000","last_became_active":"2023-11-28T20:01:22.818391+0000","last_became_peered":"2023-11-28T20:01:22.818391+0000","last_unstale":"2023-11-28T20:01:22.824984+0000","last_undegraded":"2023-11-28T20:01:22.824984+0000","last_fullsized":"2023-11-28T20:01:22.824984+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:21.777981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:21.777981+0000","last_clean_scrub_stamp":"2023-11-28T20:01:21.777981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:33:58.134275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-11-28T20:01:21.798469+0000","last_change":"2023-11-28T20:01:10.537164+0000","last_active":"2023-11-28T20:01:21.798469+0000","last_peered":"2023-11-28T20:01:21.798469+0000","last_clean":"2023-11-28T20:01:21.798469+0000","last_became_active":"2023-11-28T20:01:10.536893+0000","last_became_peered":"2023-11-28T20:01:10.536893+0000","last_unstale":"2023-11-28T20:01:21.798469+0000","last_undegraded":"2023-11-28T20:01:21.798469+0000","last_fullsized":"2023-11-28T20:01:21.798469+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_clean_scrub_stamp":"2023-11-28T20:01:09.480611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:50:58.589965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.f","version":"60'1","reported_seq":15,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-11-28T20:01:21.794381+0000","last_change":"2023-11-28T20:01:09.510018+0000","last_active":"2023-11-28T20:01:21.794381+0000","last_peered":"2023-11-28T20:01:21.794381+0000","last_clean":"2023-11-28T20:01:21.794381+0000","last_became_active":"2023-11-28T20:01:09.509743+0000","last_became_peered":"2023-11-28T20:01:09.509743+0000","last_unstale":"2023-11-28T20:01:21.794381+0000","last_undegraded":"2023-11-28T20:01:21.794381+0000","last_fullsized":"2023-11-28T20:01:21.794381+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:08.474257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:08.474257+0000","last_clean_scrub_stamp":"2023-11-28T20:01:08.474257+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:09:59.028591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.b","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2023-11-28T20:01:22.801666+0000","last_change":"2023-11-28T20:01:22.801666+0000","last_active":"2023-11-28T20:01:22.787100+0000","last_peered":"2023-11-28T20:01:22.787100+0000","last_clean":"2023-11-28T20:01:22.787100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:01:22.801666+0000","last_undegraded":"2023-11-28T20:01:22.801666+0000","last_fullsized":"2023-11-28T20:01:22.801666+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:22.787100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:22.787100+0000","last_clean_scrub_stamp":"2023-11-28T20:01:22.787100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-28T20:01:22.824090+0000","last_change":"2023-11-28T20:01:22.817493+0000","last_active":"2023-11-28T20:01:22.824090+0000","last_peered":"2023-11-28T20:01:22.824090+0000","last_clean":"2023-11-28T20:01:22.824090+0000","last_became_active":"2023-11-28T20:01:22.817204+0000","last_became_peered":"2023-11-28T20:01:22.817204+0000","last_unstale":"2023-11-28T20:01:22.824090+0000","last_undegraded":"2023-11-28T20:01:22.824090+0000","last_fullsized":"2023-11-28T20:01:22.824090+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:21.777981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:21.777981+0000","last_clean_scrub_stamp":"2023-11-28T20:01:21.777981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:21:33.492950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.d","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-11-28T20:01:21.801679+0000","last_change":"2023-11-28T20:01:10.537543+0000","last_active":"2023-11-28T20:01:21.801679+0000","last_peered":"2023-11-28T20:01:21.801679+0000","last_clean":"2023-11-28T20:01:21.801679+0000","last_became_active":"2023-11-28T20:01:10.537307+0000","last_became_peered":"2023-11-28T20:01:10.537307+0000","last_unstale":"2023-11-28T20:01:21.801679+0000","last_undegraded":"2023-11-28T20:01:21.801679+0000","last_fullsized":"2023-11-28T20:01:21.801679+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_clean_scrub_stamp":"2023-11-28T20:01:09.480611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:04:52.498548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.e","version":"60'2","reported_seq":16,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-11-28T20:01:21.800005+0000","last_change":"2023-11-28T20:01:09.519130+0000","last_active":"2023-11-28T20:01:21.800005+0000","last_peered":"2023-11-28T20:01:21.800005+0000","last_clean":"2023-11-28T20:01:21.800005+0000","last_became_active":"2023-11-28T20:01:09.517725+0000","last_became_peered":"2023-11-28T20:01:09.517725+0000","last_unstale":"2023-11-28T20:01:21.800005+0000","last_undegraded":"2023-11-28T20:01:21.800005+0000","last_fullsized":"2023-11-28T20:01:21.800005+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:08.474257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:08.474257+0000","last_clean_scrub_stamp":"2023-11-28T20:01:08.474257+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:05:31.573692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.8","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2023-11-28T20:01:22.801498+0000","last_change":"2023-11-28T20:01:22.801498+0000","last_active":"2023-11-28T20:01:22.787100+0000","last_peered":"2023-11-28T20:01:22.787100+0000","last_clean":"2023-11-28T20:01:22.787100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:01:22.801498+0000","last_undegraded":"2023-11-28T20:01:22.801498+0000","last_fullsized":"2023-11-28T20:01:22.801498+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:22.787100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:22.787100+0000","last_clean_scrub_stamp":"2023-11-28T20:01:22.787100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.f","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-28T20:01:22.832619+0000","last_change":"2023-11-28T20:01:22.830040+0000","last_active":"2023-11-28T20:01:22.832619+0000","last_peered":"2023-11-28T20:01:22.832619+0000","last_clean":"2023-11-28T20:01:22.832619+0000","last_became_active":"2023-11-28T20:01:22.829736+0000","last_became_peered":"2023-11-28T20:01:22.829736+0000","last_unstale":"2023-11-28T20:01:22.832619+0000","last_undegraded":"2023-11-28T20:01:22.832619+0000","last_fullsized":"2023-11-28T20:01:22.832619+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:21.777981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:21.777981+0000","last_clean_scrub_stamp":"2023-11-28T20:01:21.777981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:02:18.785671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.e","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-11-28T20:01:21.792843+0000","last_change":"2023-11-28T20:01:10.530449+0000","last_active":"2023-11-28T20:01:21.792843+0000","last_peered":"2023-11-28T20:01:21.792843+0000","last_clean":"2023-11-28T20:01:21.792843+0000","last_became_active":"2023-11-28T20:01:10.530169+0000","last_became_peered":"2023-11-28T20:01:10.530169+0000","last_unstale":"2023-11-28T20:01:21.792843+0000","last_undegraded":"2023-11-28T20:01:21.792843+0000","last_fullsized":"2023-11-28T20:01:21.792843+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_clean_scrub_stamp":"2023-11-28T20:01:09.480611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:01:36.330362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.d","version":"60'1","reported_seq":15,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-11-28T20:01:21.798612+0000","last_change":"2023-11-28T20:01:09.519252+0000","last_active":"2023-11-28T20:01:21.798612+0000","last_peered":"2023-11-28T20:01:21.798612+0000","last_clean":"2023-11-28T20:01:21.798612+0000","last_became_active":"2023-11-28T20:01:09.518511+0000","last_became_peered":"2023-11-28T20:01:09.518511+0000","last_unstale":"2023-11-28T20:01:21.798612+0000","last_undegraded":"2023-11-28T20:01:21.798612+0000","last_fullsized":"2023-11-28T20:01:21.798612+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:08.474257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:08.474257+0000","last_clean_scrub_stamp":"2023-11-28T20:01:08.474257+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:52:41.735612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.9","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2023-11-28T20:01:22.799812+0000","last_change":"2023-11-28T20:01:22.799812+0000","last_active":"2023-11-28T20:01:22.787100+0000","last_peered":"2023-11-28T20:01:22.787100+0000","last_clean":"2023-11-28T20:01:22.787100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:01:22.799812+0000","last_undegraded":"2023-11-28T20:01:22.799812+0000","last_fullsized":"2023-11-28T20:01:22.799812+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:22.787100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:22.787100+0000","last_clean_scrub_stamp":"2023-11-28T20:01:22.787100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.e","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-28T20:01:22.823606+0000","last_change":"2023-11-28T20:01:22.819046+0000","last_active":"2023-11-28T20:01:22.823606+0000","last_peered":"2023-11-28T20:01:22.823606+0000","last_clean":"2023-11-28T20:01:22.823606+0000","last_became_active":"2023-11-28T20:01:22.818775+0000","last_became_peered":"2023-11-28T20:01:22.818775+0000","last_unstale":"2023-11-28T20:01:22.823606+0000","last_undegraded":"2023-11-28T20:01:22.823606+0000","last_fullsized":"2023-11-28T20:01:22.823606+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:21.777981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:21.777981+0000","last_clean_scrub_stamp":"2023-11-28T20:01:21.777981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:37:29.813667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.f","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-11-28T20:01:21.801782+0000","last_change":"2023-11-28T20:01:10.523973+0000","last_active":"2023-11-28T20:01:21.801782+0000","last_peered":"2023-11-28T20:01:21.801782+0000","last_clean":"2023-11-28T20:01:21.801782+0000","last_became_active":"2023-11-28T20:01:10.523676+0000","last_became_peered":"2023-11-28T20:01:10.523676+0000","last_unstale":"2023-11-28T20:01:21.801782+0000","last_undegraded":"2023-11-28T20:01:21.801782+0000","last_fullsized":"2023-11-28T20:01:21.801782+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_clean_scrub_stamp":"2023-11-28T20:01:09.480611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:49:36.861168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":14,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-11-28T20:01:21.797278+0000","last_change":"2023-11-28T20:01:09.514931+0000","last_active":"2023-11-28T20:01:21.797278+0000","last_peered":"2023-11-28T20:01:21.797278+0000","last_clean":"2023-11-28T20:01:21.797278+0000","last_became_active":"2023-11-28T20:01:09.514702+0000","last_became_peered":"2023-11-28T20:01:09.514702+0000","last_unstale":"2023-11-28T20:01:21.797278+0000","last_undegraded":"2023-11-28T20:01:21.797278+0000","last_fullsized":"2023-11-28T20:01:21.797278+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:08.474257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:08.474257+0000","last_clean_scrub_stamp":"2023-11-28T20:01:08.474257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:30:37.298649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.e","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2023-11-28T20:01:22.808106+0000","last_change":"2023-11-28T20:01:22.808106+0000","last_active":"2023-11-28T20:01:22.787100+0000","last_peered":"2023-11-28T20:01:22.787100+0000","last_clean":"2023-11-28T20:01:22.787100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:01:22.808106+0000","last_undegraded":"2023-11-28T20:01:22.808106+0000","last_fullsized":"2023-11-28T20:01:22.808106+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:22.787100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:22.787100+0000","last_clean_scrub_stamp":"2023-11-28T20:01:22.787100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.9","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-28T20:01:22.821131+0000","last_change":"2023-11-28T20:01:22.816218+0000","last_active":"2023-11-28T20:01:22.821131+0000","last_peered":"2023-11-28T20:01:22.821131+0000","last_clean":"2023-11-28T20:01:22.821131+0000","last_became_active":"2023-11-28T20:01:22.815903+0000","last_became_peered":"2023-11-28T20:01:22.815903+0000","last_unstale":"2023-11-28T20:01:22.821131+0000","last_undegraded":"2023-11-28T20:01:22.821131+0000","last_fullsized":"2023-11-28T20:01:22.821131+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:21.777981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:21.777981+0000","last_clean_scrub_stamp":"2023-11-28T20:01:21.777981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:19:20.241462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-11-28T20:01:21.800738+0000","last_change":"2023-11-28T20:01:10.525003+0000","last_active":"2023-11-28T20:01:21.800738+0000","last_peered":"2023-11-28T20:01:21.800738+0000","last_clean":"2023-11-28T20:01:21.800738+0000","last_became_active":"2023-11-28T20:01:10.524411+0000","last_became_peered":"2023-11-28T20:01:10.524411+0000","last_unstale":"2023-11-28T20:01:21.800738+0000","last_undegraded":"2023-11-28T20:01:21.800738+0000","last_fullsized":"2023-11-28T20:01:21.800738+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_clean_scrub_stamp":"2023-11-28T20:01:09.480611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:17:27.097887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.b","version":"60'2","reported_seq":16,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-11-28T20:01:21.801281+0000","last_change":"2023-11-28T20:01:09.511026+0000","last_active":"2023-11-28T20:01:21.801281+0000","last_peered":"2023-11-28T20:01:21.801281+0000","last_clean":"2023-11-28T20:01:21.801281+0000","last_became_active":"2023-11-28T20:01:09.510765+0000","last_became_peered":"2023-11-28T20:01:09.510765+0000","last_unstale":"2023-11-28T20:01:21.801281+0000","last_undegraded":"2023-11-28T20:01:21.801281+0000","last_fullsized":"2023-11-28T20:01:21.801281+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:08.474257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:08.474257+0000","last_clean_scrub_stamp":"2023-11-28T20:01:08.474257+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:06:35.988462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.f","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2023-11-28T20:01:22.804656+0000","last_change":"2023-11-28T20:01:22.804656+0000","last_active":"2023-11-28T20:01:22.787100+0000","last_peered":"2023-11-28T20:01:22.787100+0000","last_clean":"2023-11-28T20:01:22.787100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:01:22.804656+0000","last_undegraded":"2023-11-28T20:01:22.804656+0000","last_fullsized":"2023-11-28T20:01:22.804656+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:22.787100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:22.787100+0000","last_clean_scrub_stamp":"2023-11-28T20:01:22.787100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-28T20:01:22.821031+0000","last_change":"2023-11-28T20:01:22.818671+0000","last_active":"2023-11-28T20:01:22.821031+0000","last_peered":"2023-11-28T20:01:22.821031+0000","last_clean":"2023-11-28T20:01:22.821031+0000","last_became_active":"2023-11-28T20:01:22.818413+0000","last_became_peered":"2023-11-28T20:01:22.818413+0000","last_unstale":"2023-11-28T20:01:22.821031+0000","last_undegraded":"2023-11-28T20:01:22.821031+0000","last_fullsized":"2023-11-28T20:01:22.821031+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:21.777981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:21.777981+0000","last_clean_scrub_stamp":"2023-11-28T20:01:21.777981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:39:31.956432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-11-28T20:01:21.793361+0000","last_change":"2023-11-28T20:01:10.523842+0000","last_active":"2023-11-28T20:01:21.793361+0000","last_peered":"2023-11-28T20:01:21.793361+0000","last_clean":"2023-11-28T20:01:21.793361+0000","last_became_active":"2023-11-28T20:01:10.523553+0000","last_became_peered":"2023-11-28T20:01:10.523553+0000","last_unstale":"2023-11-28T20:01:21.793361+0000","last_undegraded":"2023-11-28T20:01:21.793361+0000","last_fullsized":"2023-11-28T20:01:21.793361+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_clean_scrub_stamp":"2023-11-28T20:01:09.480611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T07:34:37.174623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":14,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-11-28T20:01:21.793934+0000","last_change":"2023-11-28T20:01:09.510719+0000","last_active":"2023-11-28T20:01:21.793934+0000","last_peered":"2023-11-28T20:01:21.793934+0000","last_clean":"2023-11-28T20:01:21.793934+0000","last_became_active":"2023-11-28T20:01:09.509874+0000","last_became_peered":"2023-11-28T20:01:09.509874+0000","last_unstale":"2023-11-28T20:01:21.793934+0000","last_undegraded":"2023-11-28T20:01:21.793934+0000","last_fullsized":"2023-11-28T20:01:21.793934+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:08.474257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:08.474257+0000","last_clean_scrub_stamp":"2023-11-28T20:01:08.474257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:21:20.189227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.c","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2023-11-28T20:01:22.804042+0000","last_change":"2023-11-28T20:01:22.804042+0000","last_active":"2023-11-28T20:01:22.787100+0000","last_peered":"2023-11-28T20:01:22.787100+0000","last_clean":"2023-11-28T20:01:22.787100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:01:22.804042+0000","last_undegraded":"2023-11-28T20:01:22.804042+0000","last_fullsized":"2023-11-28T20:01:22.804042+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:22.787100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:22.787100+0000","last_clean_scrub_stamp":"2023-11-28T20:01:22.787100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.b","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-28T20:01:22.825956+0000","last_change":"2023-11-28T20:01:22.821826+0000","last_active":"2023-11-28T20:01:22.825956+0000","last_peered":"2023-11-28T20:01:22.825956+0000","last_clean":"2023-11-28T20:01:22.825956+0000","last_became_active":"2023-11-28T20:01:22.821548+0000","last_became_peered":"2023-11-28T20:01:22.821548+0000","last_unstale":"2023-11-28T20:01:22.825956+0000","last_undegraded":"2023-11-28T20:01:22.825956+0000","last_fullsized":"2023-11-28T20:01:22.825956+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:21.777981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:21.777981+0000","last_clean_scrub_stamp":"2023-11-28T20:01:21.777981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:25:07.192596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-11-28T20:01:21.801265+0000","last_change":"2023-11-28T20:01:10.530042+0000","last_active":"2023-11-28T20:01:21.801265+0000","last_peered":"2023-11-28T20:01:21.801265+0000","last_clean":"2023-11-28T20:01:21.801265+0000","last_became_active":"2023-11-28T20:01:10.529745+0000","last_became_peered":"2023-11-28T20:01:10.529745+0000","last_unstale":"2023-11-28T20:01:21.801265+0000","last_undegraded":"2023-11-28T20:01:21.801265+0000","last_fullsized":"2023-11-28T20:01:21.801265+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_clean_scrub_stamp":"2023-11-28T20:01:09.480611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:18:17.108795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":14,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-11-28T20:01:21.800931+0000","last_change":"2023-11-28T20:01:09.512327+0000","last_active":"2023-11-28T20:01:21.800931+0000","last_peered":"2023-11-28T20:01:21.800931+0000","last_clean":"2023-11-28T20:01:21.800931+0000","last_became_active":"2023-11-28T20:01:09.512065+0000","last_became_peered":"2023-11-28T20:01:09.512065+0000","last_unstale":"2023-11-28T20:01:21.800931+0000","last_undegraded":"2023-11-28T20:01:21.800931+0000","last_fullsized":"2023-11-28T20:01:21.800931+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:08.474257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:08.474257+0000","last_clean_scrub_stamp":"2023-11-28T20:01:08.474257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:46:28.694684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.2","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2023-11-28T20:01:22.804217+0000","last_change":"2023-11-28T20:01:22.804217+0000","last_active":"2023-11-28T20:01:22.787100+0000","last_peered":"2023-11-28T20:01:22.787100+0000","last_clean":"2023-11-28T20:01:22.787100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:01:22.804217+0000","last_undegraded":"2023-11-28T20:01:22.804217+0000","last_fullsized":"2023-11-28T20:01:22.804217+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:22.787100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:22.787100+0000","last_clean_scrub_stamp":"2023-11-28T20:01:22.787100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.5","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-28T20:01:22.832081+0000","last_change":"2023-11-28T20:01:22.828000+0000","last_active":"2023-11-28T20:01:22.832081+0000","last_peered":"2023-11-28T20:01:22.832081+0000","last_clean":"2023-11-28T20:01:22.832081+0000","last_became_active":"2023-11-28T20:01:22.827704+0000","last_became_peered":"2023-11-28T20:01:22.827704+0000","last_unstale":"2023-11-28T20:01:22.832081+0000","last_undegraded":"2023-11-28T20:01:22.832081+0000","last_fullsized":"2023-11-28T20:01:22.832081+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:21.777981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:21.777981+0000","last_clean_scrub_stamp":"2023-11-28T20:01:21.777981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:52:43.940237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-11-28T20:01:21.801313+0000","last_change":"2023-11-28T20:01:10.526165+0000","last_active":"2023-11-28T20:01:21.801313+0000","last_peered":"2023-11-28T20:01:21.801313+0000","last_clean":"2023-11-28T20:01:21.801313+0000","last_became_active":"2023-11-28T20:01:10.525619+0000","last_became_peered":"2023-11-28T20:01:10.525619+0000","last_unstale":"2023-11-28T20:01:21.801313+0000","last_undegraded":"2023-11-28T20:01:21.801313+0000","last_fullsized":"2023-11-28T20:01:21.801313+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_clean_scrub_stamp":"2023-11-28T20:01:09.480611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:54:30.269337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.7","version":"60'2","reported_seq":16,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-11-28T20:01:21.794510+0000","last_change":"2023-11-28T20:01:09.514831+0000","last_active":"2023-11-28T20:01:21.794510+0000","last_peered":"2023-11-28T20:01:21.794510+0000","last_clean":"2023-11-28T20:01:21.794510+0000","last_became_active":"2023-11-28T20:01:09.514525+0000","last_became_peered":"2023-11-28T20:01:09.514525+0000","last_unstale":"2023-11-28T20:01:21.794510+0000","last_undegraded":"2023-11-28T20:01:21.794510+0000","last_fullsized":"2023-11-28T20:01:21.794510+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:08.474257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:08.474257+0000","last_clean_scrub_stamp":"2023-11-28T20:01:08.474257+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:05:31.573692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.3","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2023-11-28T20:01:22.804042+0000","last_change":"2023-11-28T20:01:22.804042+0000","last_active":"2023-11-28T20:01:22.787100+0000","last_peered":"2023-11-28T20:01:22.787100+0000","last_clean":"2023-11-28T20:01:22.787100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:01:22.804042+0000","last_undegraded":"2023-11-28T20:01:22.804042+0000","last_fullsized":"2023-11-28T20:01:22.804042+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:22.787100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:22.787100+0000","last_clean_scrub_stamp":"2023-11-28T20:01:22.787100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-28T20:01:22.832028+0000","last_change":"2023-11-28T20:01:22.827963+0000","last_active":"2023-11-28T20:01:22.832028+0000","last_peered":"2023-11-28T20:01:22.832028+0000","last_clean":"2023-11-28T20:01:22.832028+0000","last_became_active":"2023-11-28T20:01:22.827652+0000","last_became_peered":"2023-11-28T20:01:22.827652+0000","last_unstale":"2023-11-28T20:01:22.832028+0000","last_undegraded":"2023-11-28T20:01:22.832028+0000","last_fullsized":"2023-11-28T20:01:22.832028+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:21.777981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:21.777981+0000","last_clean_scrub_stamp":"2023-11-28T20:01:21.777981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:59:20.866094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-11-28T20:01:21.797523+0000","last_change":"2023-11-28T20:01:10.533050+0000","last_active":"2023-11-28T20:01:21.797523+0000","last_peered":"2023-11-28T20:01:21.797523+0000","last_clean":"2023-11-28T20:01:21.797523+0000","last_became_active":"2023-11-28T20:01:10.532590+0000","last_became_peered":"2023-11-28T20:01:10.532590+0000","last_unstale":"2023-11-28T20:01:21.797523+0000","last_undegraded":"2023-11-28T20:01:21.797523+0000","last_fullsized":"2023-11-28T20:01:21.797523+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_clean_scrub_stamp":"2023-11-28T20:01:09.480611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T07:29:30.339936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.6","version":"61'1","reported_seq":15,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-11-28T20:01:21.794444+0000","last_change":"2023-11-28T20:01:09.510397+0000","last_active":"2023-11-28T20:01:21.794444+0000","last_peered":"2023-11-28T20:01:21.794444+0000","last_clean":"2023-11-28T20:01:21.794444+0000","last_became_active":"2023-11-28T20:01:09.510136+0000","last_became_peered":"2023-11-28T20:01:09.510136+0000","last_unstale":"2023-11-28T20:01:21.794444+0000","last_undegraded":"2023-11-28T20:01:21.794444+0000","last_fullsized":"2023-11-28T20:01:21.794444+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:08.474257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:08.474257+0000","last_clean_scrub_stamp":"2023-11-28T20:01:08.474257+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:18:48.620687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.0","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2023-11-28T20:01:22.801672+0000","last_change":"2023-11-28T20:01:22.801672+0000","last_active":"2023-11-28T20:01:22.787100+0000","last_peered":"2023-11-28T20:01:22.787100+0000","last_clean":"2023-11-28T20:01:22.787100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:01:22.801672+0000","last_undegraded":"2023-11-28T20:01:22.801672+0000","last_fullsized":"2023-11-28T20:01:22.801672+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:22.787100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:22.787100+0000","last_clean_scrub_stamp":"2023-11-28T20:01:22.787100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.7","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-28T20:01:22.829667+0000","last_change":"2023-11-28T20:01:22.825335+0000","last_active":"2023-11-28T20:01:22.829667+0000","last_peered":"2023-11-28T20:01:22.829667+0000","last_clean":"2023-11-28T20:01:22.829667+0000","last_became_active":"2023-11-28T20:01:22.825033+0000","last_became_peered":"2023-11-28T20:01:22.825033+0000","last_unstale":"2023-11-28T20:01:22.829667+0000","last_undegraded":"2023-11-28T20:01:22.829667+0000","last_fullsized":"2023-11-28T20:01:22.829667+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:21.777981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:21.777981+0000","last_clean_scrub_stamp":"2023-11-28T20:01:21.777981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:10:42.691065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.6","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-11-28T20:01:21.794329+0000","last_change":"2023-11-28T20:01:10.530096+0000","last_active":"2023-11-28T20:01:21.794329+0000","last_peered":"2023-11-28T20:01:21.794329+0000","last_clean":"2023-11-28T20:01:21.794329+0000","last_became_active":"2023-11-28T20:01:10.529472+0000","last_became_peered":"2023-11-28T20:01:10.529472+0000","last_unstale":"2023-11-28T20:01:21.794329+0000","last_undegraded":"2023-11-28T20:01:21.794329+0000","last_fullsized":"2023-11-28T20:01:21.794329+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_clean_scrub_stamp":"2023-11-28T20:01:09.480611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T06:29:13.579326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":14,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-11-28T20:01:21.801672+0000","last_change":"2023-11-28T20:01:09.509983+0000","last_active":"2023-11-28T20:01:21.801672+0000","last_peered":"2023-11-28T20:01:21.801672+0000","last_clean":"2023-11-28T20:01:21.801672+0000","last_became_active":"2023-11-28T20:01:09.509675+0000","last_became_peered":"2023-11-28T20:01:09.509675+0000","last_unstale":"2023-11-28T20:01:21.801672+0000","last_undegraded":"2023-11-28T20:01:21.801672+0000","last_fullsized":"2023-11-28T20:01:21.801672+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:08.474257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:08.474257+0000","last_clean_scrub_stamp":"2023-11-28T20:01:08.474257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:21:20.189227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.1","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2023-11-28T20:01:22.802259+0000","last_change":"2023-11-28T20:01:22.802259+0000","last_active":"2023-11-28T20:01:22.787100+0000","last_peered":"2023-11-28T20:01:22.787100+0000","last_clean":"2023-11-28T20:01:22.787100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:01:22.802259+0000","last_undegraded":"2023-11-28T20:01:22.802259+0000","last_fullsized":"2023-11-28T20:01:22.802259+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:22.787100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:22.787100+0000","last_clean_scrub_stamp":"2023-11-28T20:01:22.787100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.6","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-28T20:01:22.821209+0000","last_change":"2023-11-28T20:01:22.817836+0000","last_active":"2023-11-28T20:01:22.821209+0000","last_peered":"2023-11-28T20:01:22.821209+0000","last_clean":"2023-11-28T20:01:22.821209+0000","last_became_active":"2023-11-28T20:01:22.817473+0000","last_became_peered":"2023-11-28T20:01:22.817473+0000","last_unstale":"2023-11-28T20:01:22.821209+0000","last_undegraded":"2023-11-28T20:01:22.821209+0000","last_fullsized":"2023-11-28T20:01:22.821209+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:21.777981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:21.777981+0000","last_clean_scrub_stamp":"2023-11-28T20:01:21.777981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:52:43.940237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.7","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-11-28T20:01:21.801808+0000","last_change":"2023-11-28T20:01:10.535856+0000","last_active":"2023-11-28T20:01:21.801808+0000","last_peered":"2023-11-28T20:01:21.801808+0000","last_clean":"2023-11-28T20:01:21.801808+0000","last_became_active":"2023-11-28T20:01:10.530889+0000","last_became_peered":"2023-11-28T20:01:10.530889+0000","last_unstale":"2023-11-28T20:01:21.801808+0000","last_undegraded":"2023-11-28T20:01:21.801808+0000","last_fullsized":"2023-11-28T20:01:21.801808+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_clean_scrub_stamp":"2023-11-28T20:01:09.480611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:53:37.636427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":14,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-11-28T20:01:21.790298+0000","last_change":"2023-11-28T20:01:09.511368+0000","last_active":"2023-11-28T20:01:21.790298+0000","last_peered":"2023-11-28T20:01:21.790298+0000","last_clean":"2023-11-28T20:01:21.790298+0000","last_became_active":"2023-11-28T20:01:09.510765+0000","last_became_peered":"2023-11-28T20:01:09.510765+0000","last_unstale":"2023-11-28T20:01:21.790298+0000","last_undegraded":"2023-11-28T20:01:21.790298+0000","last_fullsized":"2023-11-28T20:01:21.790298+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:08.474257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:08.474257+0000","last_clean_scrub_stamp":"2023-11-28T20:01:08.474257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:23:01.812122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.6","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2023-11-28T20:01:22.810260+0000","last_change":"2023-11-28T20:01:22.810260+0000","last_active":"2023-11-28T20:01:22.787100+0000","last_peered":"2023-11-28T20:01:22.787100+0000","last_clean":"2023-11-28T20:01:22.787100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:01:22.810260+0000","last_undegraded":"2023-11-28T20:01:22.810260+0000","last_fullsized":"2023-11-28T20:01:22.810260+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:22.787100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:22.787100+0000","last_clean_scrub_stamp":"2023-11-28T20:01:22.787100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.1","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-28T20:01:22.827254+0000","last_change":"2023-11-28T20:01:22.823098+0000","last_active":"2023-11-28T20:01:22.827254+0000","last_peered":"2023-11-28T20:01:22.827254+0000","last_clean":"2023-11-28T20:01:22.827254+0000","last_became_active":"2023-11-28T20:01:22.822775+0000","last_became_peered":"2023-11-28T20:01:22.822775+0000","last_unstale":"2023-11-28T20:01:22.827254+0000","last_undegraded":"2023-11-28T20:01:22.827254+0000","last_fullsized":"2023-11-28T20:01:22.827254+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:21.777981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:21.777981+0000","last_clean_scrub_stamp":"2023-11-28T20:01:21.777981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:19:01.924410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-11-28T20:01:21.800951+0000","last_change":"2023-11-28T20:01:10.530585+0000","last_active":"2023-11-28T20:01:21.800951+0000","last_peered":"2023-11-28T20:01:21.800951+0000","last_clean":"2023-11-28T20:01:21.800951+0000","last_became_active":"2023-11-28T20:01:10.530313+0000","last_became_peered":"2023-11-28T20:01:10.530313+0000","last_unstale":"2023-11-28T20:01:21.800951+0000","last_undegraded":"2023-11-28T20:01:21.800951+0000","last_fullsized":"2023-11-28T20:01:21.800951+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_clean_scrub_stamp":"2023-11-28T20:01:09.480611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:04:41.159984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":14,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-11-28T20:01:21.798227+0000","last_change":"2023-11-28T20:01:09.518318+0000","last_active":"2023-11-28T20:01:21.798227+0000","last_peered":"2023-11-28T20:01:21.798227+0000","last_clean":"2023-11-28T20:01:21.798227+0000","last_became_active":"2023-11-28T20:01:09.517761+0000","last_became_peered":"2023-11-28T20:01:09.517761+0000","last_unstale":"2023-11-28T20:01:21.798227+0000","last_undegraded":"2023-11-28T20:01:21.798227+0000","last_fullsized":"2023-11-28T20:01:21.798227+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:08.474257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:08.474257+0000","last_clean_scrub_stamp":"2023-11-28T20:01:08.474257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:18:16.102441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.7","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2023-11-28T20:01:22.807763+0000","last_change":"2023-11-28T20:01:22.807763+0000","last_active":"2023-11-28T20:01:22.787100+0000","last_peered":"2023-11-28T20:01:22.787100+0000","last_clean":"2023-11-28T20:01:22.787100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:01:22.807763+0000","last_undegraded":"2023-11-28T20:01:22.807763+0000","last_fullsized":"2023-11-28T20:01:22.807763+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:22.787100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:22.787100+0000","last_clean_scrub_stamp":"2023-11-28T20:01:22.787100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.0","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-28T20:01:22.826411+0000","last_change":"2023-11-28T20:01:22.822143+0000","last_active":"2023-11-28T20:01:22.826411+0000","last_peered":"2023-11-28T20:01:22.826411+0000","last_clean":"2023-11-28T20:01:22.826411+0000","last_became_active":"2023-11-28T20:01:22.821874+0000","last_became_peered":"2023-11-28T20:01:22.821874+0000","last_unstale":"2023-11-28T20:01:22.826411+0000","last_undegraded":"2023-11-28T20:01:22.826411+0000","last_fullsized":"2023-11-28T20:01:22.826411+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:21.777981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:21.777981+0000","last_clean_scrub_stamp":"2023-11-28T20:01:21.777981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:05:44.877415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-11-28T20:01:21.791432+0000","last_change":"2023-11-28T20:01:10.533596+0000","last_active":"2023-11-28T20:01:21.791432+0000","last_peered":"2023-11-28T20:01:21.791432+0000","last_clean":"2023-11-28T20:01:21.791432+0000","last_became_active":"2023-11-28T20:01:10.533195+0000","last_became_peered":"2023-11-28T20:01:10.533195+0000","last_unstale":"2023-11-28T20:01:21.791432+0000","last_undegraded":"2023-11-28T20:01:21.791432+0000","last_fullsized":"2023-11-28T20:01:21.791432+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_clean_scrub_stamp":"2023-11-28T20:01:09.480611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:14:25.459653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":14,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-11-28T20:01:21.796646+0000","last_change":"2023-11-28T20:01:09.507413+0000","last_active":"2023-11-28T20:01:21.796646+0000","last_peered":"2023-11-28T20:01:21.796646+0000","last_clean":"2023-11-28T20:01:21.796646+0000","last_became_active":"2023-11-28T20:01:09.507080+0000","last_became_peered":"2023-11-28T20:01:09.507080+0000","last_unstale":"2023-11-28T20:01:21.796646+0000","last_undegraded":"2023-11-28T20:01:21.796646+0000","last_fullsized":"2023-11-28T20:01:21.796646+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:08.474257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:08.474257+0000","last_clean_scrub_stamp":"2023-11-28T20:01:08.474257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:54:29.262983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.4","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2023-11-28T20:01:22.802494+0000","last_change":"2023-11-28T20:01:22.802494+0000","last_active":"2023-11-28T20:01:22.787100+0000","last_peered":"2023-11-28T20:01:22.787100+0000","last_clean":"2023-11-28T20:01:22.787100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:01:22.802494+0000","last_undegraded":"2023-11-28T20:01:22.802494+0000","last_fullsized":"2023-11-28T20:01:22.802494+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:22.787100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:22.787100+0000","last_clean_scrub_stamp":"2023-11-28T20:01:22.787100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.3","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-28T20:01:22.829695+0000","last_change":"2023-11-28T20:01:22.826550+0000","last_active":"2023-11-28T20:01:22.829695+0000","last_peered":"2023-11-28T20:01:22.829695+0000","last_clean":"2023-11-28T20:01:22.829695+0000","last_became_active":"2023-11-28T20:01:22.826247+0000","last_became_peered":"2023-11-28T20:01:22.826247+0000","last_unstale":"2023-11-28T20:01:22.829695+0000","last_undegraded":"2023-11-28T20:01:22.829695+0000","last_fullsized":"2023-11-28T20:01:22.829695+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:21.777981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:21.777981+0000","last_clean_scrub_stamp":"2023-11-28T20:01:21.777981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:21:33.492950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-11-28T20:01:21.789934+0000","last_change":"2023-11-28T20:01:10.518351+0000","last_active":"2023-11-28T20:01:21.789934+0000","last_peered":"2023-11-28T20:01:21.789934+0000","last_clean":"2023-11-28T20:01:21.789934+0000","last_became_active":"2023-11-28T20:01:10.518106+0000","last_became_peered":"2023-11-28T20:01:10.518106+0000","last_unstale":"2023-11-28T20:01:21.789934+0000","last_undegraded":"2023-11-28T20:01:21.789934+0000","last_fullsized":"2023-11-28T20:01:21.789934+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_clean_scrub_stamp":"2023-11-28T20:01:09.480611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:04:52.498548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":14,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-11-28T20:01:21.796549+0000","last_change":"2023-11-28T20:01:09.514346+0000","last_active":"2023-11-28T20:01:21.796549+0000","last_peered":"2023-11-28T20:01:21.796549+0000","last_clean":"2023-11-28T20:01:21.796549+0000","last_became_active":"2023-11-28T20:01:09.513791+0000","last_became_peered":"2023-11-28T20:01:09.513791+0000","last_unstale":"2023-11-28T20:01:21.796549+0000","last_undegraded":"2023-11-28T20:01:21.796549+0000","last_fullsized":"2023-11-28T20:01:21.796549+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:08.474257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:08.474257+0000","last_clean_scrub_stamp":"2023-11-28T20:01:08.474257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:17:26.091533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.5","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2023-11-28T20:01:22.803024+0000","last_change":"2023-11-28T20:01:22.803024+0000","last_active":"2023-11-28T20:01:22.787100+0000","last_peered":"2023-11-28T20:01:22.787100+0000","last_clean":"2023-11-28T20:01:22.787100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:01:22.803024+0000","last_undegraded":"2023-11-28T20:01:22.803024+0000","last_fullsized":"2023-11-28T20:01:22.803024+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:22.787100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:22.787100+0000","last_clean_scrub_stamp":"2023-11-28T20:01:22.787100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-28T20:01:22.826152+0000","last_change":"2023-11-28T20:01:22.821936+0000","last_active":"2023-11-28T20:01:22.826152+0000","last_peered":"2023-11-28T20:01:22.826152+0000","last_clean":"2023-11-28T20:01:22.826152+0000","last_became_active":"2023-11-28T20:01:22.821666+0000","last_became_peered":"2023-11-28T20:01:22.821666+0000","last_unstale":"2023-11-28T20:01:22.826152+0000","last_undegraded":"2023-11-28T20:01:22.826152+0000","last_fullsized":"2023-11-28T20:01:22.826152+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:21.777981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:21.777981+0000","last_clean_scrub_stamp":"2023-11-28T20:01:21.777981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:44:17.659296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-11-28T20:01:21.797041+0000","last_change":"2023-11-28T20:01:10.531261+0000","last_active":"2023-11-28T20:01:21.797041+0000","last_peered":"2023-11-28T20:01:21.797041+0000","last_clean":"2023-11-28T20:01:21.797041+0000","last_became_active":"2023-11-28T20:01:10.531002+0000","last_became_peered":"2023-11-28T20:01:10.531002+0000","last_unstale":"2023-11-28T20:01:21.797041+0000","last_undegraded":"2023-11-28T20:01:21.797041+0000","last_fullsized":"2023-11-28T20:01:21.797041+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_clean_scrub_stamp":"2023-11-28T20:01:09.480611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:50:37.650648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":14,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-11-28T20:01:21.789833+0000","last_change":"2023-11-28T20:01:09.512031+0000","last_active":"2023-11-28T20:01:21.789833+0000","last_peered":"2023-11-28T20:01:21.789833+0000","last_clean":"2023-11-28T20:01:21.789833+0000","last_became_active":"2023-11-28T20:01:09.511366+0000","last_became_peered":"2023-11-28T20:01:09.511366+0000","last_unstale":"2023-11-28T20:01:21.789833+0000","last_undegraded":"2023-11-28T20:01:21.789833+0000","last_fullsized":"2023-11-28T20:01:21.789833+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:08.474257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:08.474257+0000","last_clean_scrub_stamp":"2023-11-28T20:01:08.474257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:29:38.849741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.d","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2023-11-28T20:01:22.816355+0000","last_change":"2023-11-28T20:01:22.816355+0000","last_active":"2023-11-28T20:01:22.787100+0000","last_peered":"2023-11-28T20:01:22.787100+0000","last_clean":"2023-11-28T20:01:22.787100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:01:22.816355+0000","last_undegraded":"2023-11-28T20:01:22.816355+0000","last_fullsized":"2023-11-28T20:01:22.816355+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:22.787100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:22.787100+0000","last_clean_scrub_stamp":"2023-11-28T20:01:22.787100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-28T20:01:22.828665+0000","last_change":"2023-11-28T20:01:22.819303+0000","last_active":"2023-11-28T20:01:22.828665+0000","last_peered":"2023-11-28T20:01:22.828665+0000","last_clean":"2023-11-28T20:01:22.828665+0000","last_became_active":"2023-11-28T20:01:22.819098+0000","last_became_peered":"2023-11-28T20:01:22.819098+0000","last_unstale":"2023-11-28T20:01:22.828665+0000","last_undegraded":"2023-11-28T20:01:22.828665+0000","last_fullsized":"2023-11-28T20:01:22.828665+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:21.777981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:21.777981+0000","last_clean_scrub_stamp":"2023-11-28T20:01:21.777981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:55:36.425762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.b","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-11-28T20:01:21.801495+0000","last_change":"2023-11-28T20:01:10.530148+0000","last_active":"2023-11-28T20:01:21.801495+0000","last_peered":"2023-11-28T20:01:21.801495+0000","last_clean":"2023-11-28T20:01:21.801495+0000","last_became_active":"2023-11-28T20:01:10.529630+0000","last_became_peered":"2023-11-28T20:01:10.529630+0000","last_unstale":"2023-11-28T20:01:21.801495+0000","last_undegraded":"2023-11-28T20:01:21.801495+0000","last_fullsized":"2023-11-28T20:01:21.801495+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_clean_scrub_stamp":"2023-11-28T20:01:09.480611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:11:08.794514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":14,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-11-28T20:01:21.796083+0000","last_change":"2023-11-28T20:01:09.515708+0000","last_active":"2023-11-28T20:01:21.796083+0000","last_peered":"2023-11-28T20:01:21.796083+0000","last_clean":"2023-11-28T20:01:21.796083+0000","last_became_active":"2023-11-28T20:01:09.515449+0000","last_became_peered":"2023-11-28T20:01:09.515449+0000","last_unstale":"2023-11-28T20:01:21.796083+0000","last_undegraded":"2023-11-28T20:01:21.796083+0000","last_fullsized":"2023-11-28T20:01:21.796083+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:08.474257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:08.474257+0000","last_clean_scrub_stamp":"2023-11-28T20:01:08.474257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T07:14:20.829778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":201,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-11-28T20:01:21.797721+0000","last_change":"2023-11-28T19:58:56.136501+0000","last_active":"2023-11-28T20:01:21.797721+0000","last_peered":"2023-11-28T20:01:21.797721+0000","last_clean":"2023-11-28T20:01:21.797721+0000","last_became_active":"2023-11-28T19:58:56.135998+0000","last_became_peered":"2023-11-28T19:58:56.135998+0000","last_unstale":"2023-11-28T20:01:21.797721+0000","last_undegraded":"2023-11-28T20:01:21.797721+0000","last_fullsized":"2023-11-28T20:01:21.797721+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:58:54.602349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:58:54.602349+0000","last_clean_scrub_stamp":"2023-11-28T19:58:54.602349+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:33:42.723349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":12,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":11,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":10,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":9,"num_pg":32,"stat_sum":{"num_bytes":3905,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":47,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":7810,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":41,"ondisk_log_size":41,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":66748,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574882,"num_pgs":51,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27832,"kb_used_data":812,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344008,"statfs":{"total":96636764160,"available":96608264192,"internally_reserved":0,"allocated":831488,"data_stored":935848,"data_compressed":33374,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 20:00:55 2023","interfaces":[{"interface":"back","average":{"1min":0.66200000000000003,"5min":0.67500000000000004,"15min":0.67700000000000005},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":0.84699999999999998,"5min":0.90700000000000003,"15min":0.90700000000000003},"last":0.71099999999999997},{"interface":"front","average":{"1min":0.63300000000000001,"5min":0.67400000000000004,"15min":0.68100000000000005},"min":{"1min":0.499,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":0.84099999999999997,"5min":0.98999999999999999,"15min":0.98999999999999999},"last":0.69599999999999995}]},{"osd":1,"last update":"Tue Nov 28 20:00:55 2023","interfaces":[{"interface":"back","average":{"1min":0.60599999999999998,"5min":0.63800000000000001,"15min":0.64300000000000002},"min":{"1min":0.44700000000000001,"5min":0.438,"15min":0.438},"max":{"1min":0.82899999999999996,"5min":0.89600000000000002,"15min":0.89600000000000002},"last":0.72899999999999998},{"interface":"front","average":{"1min":0.63900000000000001,"5min":0.68899999999999995,"15min":0.69699999999999995},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":0.78200000000000003,"5min":1.0900000000000001,"15min":1.0900000000000001},"last":0.68000000000000005}]},{"osd":2,"last update":"Tue Nov 28 20:00:55 2023","interfaces":[{"interface":"back","average":{"1min":0.64400000000000002,"5min":0.71599999999999997,"15min":0.72799999999999998},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.84699999999999998,"5min":0.98799999999999999,"15min":0.98799999999999999},"last":0.79700000000000004},{"interface":"front","average":{"1min":0.65100000000000002,"5min":0.69499999999999995,"15min":0.70299999999999996},"min":{"1min":0.48599999999999999,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":0.85599999999999998,"5min":1.0680000000000001,"15min":1.0680000000000001},"last":0.65000000000000002}]},{"osd":3,"last update":"Tue Nov 28 20:00:55 2023","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.70099999999999996,"15min":0.69999999999999996},"min":{"1min":0.56100000000000005,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":0.88900000000000001,"5min":1.0449999999999999,"15min":1.0449999999999999},"last":0.63200000000000001},{"interface":"front","average":{"1min":0.74199999999999999,"5min":0.78200000000000003,"15min":0.78900000000000003},"min":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":0.60699999999999998},"max":{"1min":0.879,"5min":1.1299999999999999,"15min":1.1299999999999999},"last":0.77000000000000002}]},{"osd":4,"last update":"Tue Nov 28 20:00:55 2023","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.63600000000000001,"15min":0.64000000000000001},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":0.83899999999999997,"5min":1.018,"15min":1.018},"last":0.46999999999999997},{"interface":"front","average":{"1min":0.67600000000000005,"5min":0.72199999999999998,"15min":0.72999999999999998},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":0.97899999999999998,"5min":1.1120000000000001,"15min":1.1120000000000001},"last":0.66300000000000003}]},{"osd":5,"last update":"Tue Nov 28 20:00:55 2023","interfaces":[{"interface":"back","average":{"1min":0.58699999999999997,"5min":0.66500000000000004,"15min":0.67800000000000005},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.871,"5min":1.1699999999999999,"15min":1.1699999999999999},"last":0.59899999999999998},{"interface":"front","average":{"1min":0.67900000000000005,"5min":0.748,"15min":0.76000000000000001},"min":{"1min":0.505,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":0.88500000000000001,"5min":1.1890000000000001,"15min":1.1890000000000001},"last":0.747}]},{"osd":6,"last update":"Tue Nov 28 20:00:55 2023","interfaces":[{"interface":"back","average":{"1min":0.71399999999999997,"5min":0.76800000000000002,"15min":0.77700000000000002},"min":{"1min":0.47499999999999998,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.88200000000000001,"5min":1.1379999999999999,"15min":1.1379999999999999},"last":0.81100000000000005},{"interface":"front","average":{"1min":0.65000000000000002,"5min":0.72699999999999998,"15min":0.73999999999999999},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":0.93300000000000005,"5min":1.23,"15min":1.23},"last":0.57599999999999996}]}]},{"osd":6,"up_from":13,"seq":55834574880,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27756,"kb_used_data":736,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344084,"statfs":{"total":96636764160,"available":96608342016,"internally_reserved":0,"allocated":753664,"data_stored":344738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 20:00:54 2023","interfaces":[{"interface":"back","average":{"1min":0.621,"5min":0.61699999999999999,"15min":0.61599999999999999},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.81699999999999995,"5min":0.82599999999999996,"15min":0.82599999999999996},"last":0.70499999999999996},{"interface":"front","average":{"1min":0.67300000000000004,"5min":0.66500000000000004,"15min":0.66400000000000003},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":0.88700000000000001,"5min":0.98999999999999999,"15min":0.98999999999999999},"last":0.78500000000000003}]},{"osd":1,"last update":"Tue Nov 28 20:00:54 2023","interfaces":[{"interface":"back","average":{"1min":0.745,"5min":0.78100000000000003,"15min":0.78700000000000003},"min":{"1min":0.56100000000000005,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.0940000000000001,"5min":1.105,"15min":1.105},"last":0.81599999999999995},{"interface":"front","average":{"1min":0.69999999999999996,"5min":0.68899999999999995,"15min":0.68700000000000006},"min":{"1min":0.53700000000000003,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.85599999999999998,"5min":0.95899999999999996,"15min":0.95899999999999996},"last":0.72699999999999998}]},{"osd":2,"last update":"Tue Nov 28 20:00:54 2023","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.69499999999999995,"15min":0.69799999999999995},"min":{"1min":0.54700000000000004,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":0.89700000000000002,"5min":0.93400000000000005,"15min":0.93400000000000005},"last":0.76500000000000001},{"interface":"front","average":{"1min":0.70499999999999996,"5min":0.71599999999999997,"15min":0.71799999999999997},"min":{"1min":0.53400000000000003,"5min":0.505,"15min":0.505},"max":{"1min":0.91800000000000004,"5min":1.006,"15min":1.006},"last":0.66500000000000004}]},{"osd":3,"last update":"Tue Nov 28 20:00:54 2023","interfaces":[{"interface":"back","average":{"1min":0.70999999999999996,"5min":0.74099999999999999,"15min":0.746},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.04,"5min":1.056,"15min":1.056},"last":0.84499999999999997},{"interface":"front","average":{"1min":0.66700000000000004,"5min":0.68100000000000005,"15min":0.68300000000000005},"min":{"1min":0.505,"5min":0.505,"15min":0.505},"max":{"1min":0.85599999999999998,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.68300000000000005}]},{"osd":4,"last update":"Tue Nov 28 20:00:54 2023","interfaces":[{"interface":"back","average":{"1min":0.61599999999999999,"5min":0.628,"15min":0.63},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":0.97599999999999998,"5min":0.97599999999999998,"15min":0.97599999999999998},"last":0.52500000000000002},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.71199999999999997,"15min":0.72999999999999998},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":1.1419999999999999,"5min":1.389,"15min":1.389},"last":0.504}]},{"osd":5,"last update":"Tue Nov 28 20:00:54 2023","interfaces":[{"interface":"back","average":{"1min":0.71999999999999997,"5min":0.79700000000000004,"15min":0.81000000000000005},"min":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":1.147,"5min":1.4259999999999999,"15min":1.4259999999999999},"last":0.60799999999999998},{"interface":"front","average":{"1min":0.70699999999999996,"5min":0.751,"15min":0.75900000000000001},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.034,"5min":1.276,"15min":1.276},"last":0.627}]},{"osd":7,"last update":"Tue Nov 28 20:00:54 2023","interfaces":[{"interface":"back","average":{"1min":0.64000000000000001,"5min":0.69999999999999996,"15min":0.70999999999999996},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":1.014,"5min":1.014,"15min":1.014},"last":0.47699999999999998},{"interface":"front","average":{"1min":0.72599999999999998,"5min":0.80900000000000005,"15min":0.82299999999999995},"min":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":1.083,"5min":1.242,"15min":1.242},"last":0.58299999999999996}]}]},{"osd":5,"up_from":13,"seq":55834574882,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27756,"kb_used_data":736,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344084,"statfs":{"total":96636764160,"available":96608342016,"internally_reserved":0,"allocated":753664,"data_stored":344726,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 20:00:54 2023","interfaces":[{"interface":"back","average":{"1min":0.628,"5min":0.69299999999999995,"15min":0.70399999999999996},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.84699999999999998,"5min":0.997,"15min":0.997},"last":0.67100000000000004},{"interface":"front","average":{"1min":0.61899999999999999,"5min":0.69899999999999995,"15min":0.71199999999999997},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.78800000000000003,"5min":1.149,"15min":1.149},"last":0.622}]},{"osd":1,"last update":"Tue Nov 28 20:00:54 2023","interfaces":[{"interface":"back","average":{"1min":0.66800000000000004,"5min":0.70399999999999996,"15min":0.70999999999999996},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.94499999999999995,"5min":0.94499999999999995,"15min":0.94499999999999995},"last":0.70999999999999996},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.70399999999999996,"15min":0.71999999999999997},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":0.71999999999999997,"5min":1.0940000000000001,"15min":1.0940000000000001},"last":0.70199999999999996}]},{"osd":2,"last update":"Tue Nov 28 20:00:54 2023","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.89200000000000002,"15min":0.92800000000000005},"min":{"1min":0.5,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":0.91200000000000003,"5min":5.0880000000000001,"15min":5.0880000000000001},"last":0.73399999999999999},{"interface":"front","average":{"1min":0.69599999999999995,"5min":0.93999999999999995,"15min":0.98099999999999998},"min":{"1min":0.59199999999999997,"5min":0.504,"15min":0.504},"max":{"1min":0.96199999999999997,"5min":5.1399999999999997,"15min":5.1399999999999997},"last":0.76100000000000001}]},{"osd":3,"last update":"Tue Nov 28 20:00:54 2023","interfaces":[{"interface":"back","average":{"1min":0.70999999999999996,"5min":0.96399999999999997,"15min":1.006},"min":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":0.91100000000000003,"5min":5.0469999999999997,"15min":5.0469999999999997},"last":0.68899999999999995},{"interface":"front","average":{"1min":0.69099999999999995,"5min":0.93899999999999995,"15min":0.97999999999999998},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":0.90000000000000002,"5min":5.024,"15min":5.024},"last":0.79900000000000004}]},{"osd":4,"last update":"Tue Nov 28 20:00:54 2023","interfaces":[{"interface":"back","average":{"1min":0.58599999999999997,"5min":0.65800000000000003,"15min":0.67000000000000004},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.93300000000000005,"5min":1.4810000000000001,"15min":1.4810000000000001},"last":0.42899999999999999},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.73599999999999999,"15min":0.74299999999999999},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":0.95799999999999996,"5min":1.6339999999999999,"15min":1.6339999999999999},"last":0.496}]},{"osd":6,"last update":"Tue Nov 28 20:00:54 2023","interfaces":[{"interface":"back","average":{"1min":0.70299999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"min":{"1min":0.47699999999999998,"5min":0.434,"15min":0.434},"max":{"1min":0.93899999999999995,"5min":0.97699999999999998,"15min":0.97699999999999998},"last":0.64800000000000002},{"interface":"front","average":{"1min":0.69199999999999995,"5min":0.73599999999999999,"15min":0.74399999999999999},"min":{"1min":0.46300000000000002,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":0.86599999999999999,"5min":1.099,"15min":1.099},"last":0.47599999999999998}]},{"osd":7,"last update":"Tue Nov 28 20:00:54 2023","interfaces":[{"interface":"back","average":{"1min":0.77100000000000002,"5min":0.78300000000000003,"15min":0.78500000000000003},"min":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":0.95999999999999996,"5min":1.236,"15min":1.236},"last":0.55800000000000005},{"interface":"front","average":{"1min":0.77800000000000002,"5min":0.79600000000000004,"15min":0.79900000000000004},"min":{"1min":0.54000000000000004,"5min":0.505,"15min":0.505},"max":{"1min":0.98599999999999999,"5min":1.0760000000000001,"15min":1.0760000000000001},"last":0.53600000000000003}]}]},{"osd":4,"up_from":13,"seq":55834574881,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27764,"kb_used_data":744,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344076,"statfs":{"total":96636764160,"available":96608333824,"internally_reserved":0,"allocated":761856,"data_stored":347811,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 20:00:54 2023","interfaces":[{"interface":"back","average":{"1min":0.63200000000000001,"5min":0.69499999999999995,"15min":0.70499999999999996},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.82999999999999996,"5min":1.0429999999999999,"15min":1.0429999999999999},"last":0.76500000000000001},{"interface":"front","average":{"1min":0.64400000000000002,"5min":0.69999999999999996,"15min":0.70899999999999996},"min":{"1min":0.44900000000000001,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.93200000000000005,"5min":1.163,"15min":1.163},"last":0.56699999999999995}]},{"osd":1,"last update":"Tue Nov 28 20:00:54 2023","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.73599999999999999,"15min":0.754},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.88500000000000001,"5min":1.111,"15min":1.111},"last":0.54300000000000004},{"interface":"front","average":{"1min":0.68300000000000005,"5min":0.78700000000000003,"15min":0.80500000000000005},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":0.90000000000000002,"5min":1.238,"15min":1.238},"last":0.629}]},{"osd":2,"last update":"Tue Nov 28 20:00:54 2023","interfaces":[{"interface":"back","average":{"1min":0.70099999999999996,"5min":0.76600000000000001,"15min":0.77700000000000002},"min":{"1min":0.53300000000000003,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.97399999999999998,"5min":1.0669999999999999,"15min":1.0669999999999999},"last":0.58799999999999997},{"interface":"front","average":{"1min":0.66700000000000004,"5min":0.78700000000000003,"15min":0.80700000000000005},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.88100000000000001,"5min":1.1180000000000001,"15min":1.1180000000000001},"last":0.81000000000000005}]},{"osd":3,"last update":"Tue Nov 28 20:00:54 2023","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.76600000000000001,"15min":0.79000000000000004},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":0.89700000000000002,"5min":1.202,"15min":1.202},"last":0.61199999999999999},{"interface":"front","average":{"1min":0.67700000000000005,"5min":0.77200000000000002,"15min":0.78800000000000003},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":0.94599999999999995,"5min":1.0589999999999999,"15min":1.0589999999999999},"last":0.78800000000000003}]},{"osd":5,"last update":"Tue Nov 28 20:00:54 2023","interfaces":[{"interface":"back","average":{"1min":0.621,"5min":0.70299999999999996,"15min":0.71699999999999997},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.82499999999999996,"5min":0.95899999999999996,"15min":0.95899999999999996},"last":0.83199999999999996},{"interface":"front","average":{"1min":0.625,"5min":0.69599999999999995,"15min":0.70799999999999996},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.879,"5min":1.034,"15min":1.034},"last":0.65300000000000002}]},{"osd":6,"last update":"Tue Nov 28 20:00:54 2023","interfaces":[{"interface":"back","average":{"1min":0.60799999999999998,"5min":0.70899999999999996,"15min":0.72599999999999998},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":0.73799999999999999,"5min":1.0309999999999999,"15min":1.0309999999999999},"last":0.75700000000000001},{"interface":"front","average":{"1min":0.71899999999999997,"5min":0.77100000000000002,"15min":0.77900000000000003},"min":{"1min":0.49199999999999999,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":0.879,"5min":1.002,"15min":1.002},"last":0.68000000000000005}]},{"osd":7,"last update":"Tue Nov 28 20:00:54 2023","interfaces":[{"interface":"back","average":{"1min":0.70499999999999996,"5min":0.77100000000000002,"15min":0.78200000000000003},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":0.91000000000000003,"5min":1.0620000000000001,"15min":1.0620000000000001},"last":0.69799999999999995},{"interface":"front","average":{"1min":0.76000000000000001,"5min":0.84799999999999998,"15min":0.86199999999999999},"min":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":0.93400000000000005,"5min":1.1459999999999999,"15min":1.1459999999999999},"last":0.71499999999999997}]}]},{"osd":3,"up_from":13,"seq":55834574882,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27752,"kb_used_data":732,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344088,"statfs":{"total":96636764160,"available":96608346112,"internally_reserved":0,"allocated":749568,"data_stored":344704,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 20:00:55 2023","interfaces":[{"interface":"back","average":{"1min":0.41899999999999998,"5min":0.441,"15min":0.44500000000000001},"min":{"1min":0.29399999999999998,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":1.7130000000000001},{"interface":"front","average":{"1min":0.39600000000000002,"5min":0.45800000000000002,"15min":0.46800000000000003},"min":{"1min":0.28199999999999997,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.52800000000000002,"5min":0.82599999999999996,"15min":0.82599999999999996},"last":3.0630000000000002}]},{"osd":1,"last update":"Tue Nov 28 20:00:55 2023","interfaces":[{"interface":"back","average":{"1min":0.40000000000000002,"5min":0.46500000000000002,"15min":0.47599999999999998},"min":{"1min":0.26200000000000001,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.56999999999999995,"5min":0.84399999999999997,"15min":0.84399999999999997},"last":0.89200000000000002},{"interface":"front","average":{"1min":0.439,"5min":0.49099999999999999,"15min":0.5},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.74099999999999999,"5min":0.86099999999999999,"15min":0.86099999999999999},"last":5.8920000000000003}]},{"osd":2,"last update":"Tue Nov 28 20:00:55 2023","interfaces":[{"interface":"back","average":{"1min":0.48799999999999999,"5min":0.52400000000000002,"15min":0.53000000000000003},"min":{"1min":0.375,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.64900000000000002,"5min":0.85599999999999998,"15min":0.85599999999999998},"last":4.6390000000000002},{"interface":"front","average":{"1min":0.48999999999999999,"5min":0.56599999999999995,"15min":0.57899999999999996},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.63500000000000001,"5min":0.83699999999999997,"15min":0.83699999999999997},"last":11.593}]},{"osd":4,"last update":"Tue Nov 28 20:00:55 2023","interfaces":[{"interface":"back","average":{"1min":0.77700000000000002,"5min":0.76500000000000001,"15min":0.76300000000000001},"min":{"1min":0.60799999999999998,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":1.085,"5min":1.206,"15min":1.206},"last":5.5549999999999997},{"interface":"front","average":{"1min":0.80700000000000005,"5min":0.80300000000000005,"15min":0.80300000000000005},"min":{"1min":0.58999999999999997,"5min":0.503,"15min":0.503},"max":{"1min":1.173,"5min":1.222,"15min":1.222},"last":11.747}]},{"osd":5,"last update":"Tue Nov 28 20:00:55 2023","interfaces":[{"interface":"back","average":{"1min":0.78300000000000003,"5min":0.79600000000000004,"15min":0.79800000000000004},"min":{"1min":0.57699999999999996,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":1.2509999999999999,"5min":1.2509999999999999,"15min":1.2509999999999999},"last":11.705},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.79100000000000004,"15min":0.79900000000000004},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":1.0409999999999999,"5min":1.3100000000000001,"15min":1.3100000000000001},"last":1.0580000000000001}]},{"osd":6,"last update":"Tue Nov 28 20:00:55 2023","interfaces":[{"interface":"back","average":{"1min":0.81699999999999995,"5min":0.83799999999999997,"15min":0.84199999999999997},"min":{"1min":0.58799999999999997,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":1.544,"5min":1.544,"15min":1.544},"last":1.6639999999999999},{"interface":"front","average":{"1min":0.93100000000000005,"5min":0.78500000000000003,"15min":0.76100000000000001},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":4.0679999999999996,"5min":4.0679999999999996,"15min":4.0679999999999996},"last":3.1459999999999999}]},{"osd":7,"last update":"Tue Nov 28 20:00:55 2023","interfaces":[{"interface":"back","average":{"1min":0.97099999999999997,"5min":0.874,"15min":0.85799999999999998},"min":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":4.0019999999999998,"5min":4.0019999999999998,"15min":4.0019999999999998},"last":6.6619999999999999},{"interface":"front","average":{"1min":0.80100000000000005,"5min":0.873,"15min":0.88500000000000001},"min":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.60299999999999998},"max":{"1min":1.1830000000000001,"5min":1.339,"15min":1.339},"last":11.782}]}]},{"osd":2,"up_from":13,"seq":55834574880,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27752,"kb_used_data":732,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344088,"statfs":{"total":96636764160,"available":96608346112,"internally_reserved":0,"allocated":749568,"data_stored":344704,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 20:00:54 2023","interfaces":[{"interface":"back","average":{"1min":0.42599999999999999,"5min":0.45000000000000001,"15min":0.45400000000000001},"min":{"1min":0.33300000000000002,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.65100000000000002,"5min":0.74099999999999999,"15min":0.74099999999999999},"last":0.32500000000000001},{"interface":"front","average":{"1min":0.42199999999999999,"5min":0.46999999999999997,"15min":0.47799999999999998},"min":{"1min":0.27900000000000003,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.61399999999999999,"5min":0.67700000000000005,"15min":0.67700000000000005},"last":0.41899999999999998}]},{"osd":1,"last update":"Tue Nov 28 20:00:54 2023","interfaces":[{"interface":"back","average":{"1min":0.42899999999999999,"5min":0.497,"15min":0.50900000000000001},"min":{"1min":0.33300000000000002,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.57199999999999995,"5min":1.0389999999999999,"15min":1.0389999999999999},"last":0.377},{"interface":"front","average":{"1min":0.435,"5min":0.49099999999999999,"15min":0.5},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.70299999999999996,"5min":0.70999999999999996,"15min":0.70999999999999996},"last":0.58999999999999997}]},{"osd":3,"last update":"Tue Nov 28 20:00:54 2023","interfaces":[{"interface":"back","average":{"1min":0.44,"5min":0.46600000000000003,"15min":0.46999999999999997},"min":{"1min":0.317,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.55200000000000005,"5min":0.629,"15min":0.629},"last":0.60299999999999998},{"interface":"front","average":{"1min":0.496,"5min":0.57199999999999995,"15min":0.58499999999999996},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.67800000000000005,"5min":0.98499999999999999,"15min":0.98499999999999999},"last":0.5}]},{"osd":4,"last update":"Tue Nov 28 20:00:54 2023","interfaces":[{"interface":"back","average":{"1min":0.73899999999999999,"5min":0.83699999999999997,"15min":0.85299999999999998},"min":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"max":{"1min":0.98999999999999999,"5min":1.139,"15min":1.139},"last":0.53400000000000003},{"interface":"front","average":{"1min":0.71999999999999997,"5min":0.82599999999999996,"15min":0.84399999999999997},"min":{"1min":0.57299999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":0.97599999999999998,"5min":1.238,"15min":1.238},"last":0.64600000000000002}]},{"osd":5,"last update":"Tue Nov 28 20:00:54 2023","interfaces":[{"interface":"back","average":{"1min":0.69699999999999995,"5min":0.84699999999999998,"15min":0.872},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":0.83599999999999997,"5min":1.6180000000000001,"15min":1.6180000000000001},"last":0.51500000000000001},{"interface":"front","average":{"1min":0.71099999999999997,"5min":0.81000000000000005,"15min":0.82599999999999996},"min":{"1min":0.52200000000000002,"5min":0.496,"15min":0.496},"max":{"1min":0.96899999999999997,"5min":1.339,"15min":1.339},"last":0.77600000000000002}]},{"osd":6,"last update":"Tue Nov 28 20:00:54 2023","interfaces":[{"interface":"back","average":{"1min":0.73299999999999998,"5min":0.79100000000000004,"15min":0.80100000000000005},"min":{"1min":0.54600000000000004,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":0.98199999999999998,"5min":1.1839999999999999,"15min":1.1839999999999999},"last":0.82099999999999995},{"interface":"front","average":{"1min":0.70599999999999996,"5min":0.82999999999999996,"15min":0.85099999999999998},"min":{"1min":0.497,"5min":0.497,"15min":0.497},"max":{"1min":0.94199999999999995,"5min":1.099,"15min":1.099},"last":0.57199999999999995}]},{"osd":7,"last update":"Tue Nov 28 20:00:54 2023","interfaces":[{"interface":"back","average":{"1min":0.746,"5min":0.86099999999999999,"15min":0.88},"min":{"1min":0.53300000000000003,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":0.84899999999999998,"5min":1.4590000000000001,"15min":1.4590000000000001},"last":0.55300000000000005},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.83599999999999997,"15min":0.85599999999999998},"min":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":0.96599999999999997,"5min":1.387,"15min":1.387},"last":0.625}]}]},{"osd":1,"up_from":13,"seq":55834574882,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27780,"kb_used_data":760,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344060,"statfs":{"total":96636764160,"available":96608317440,"internally_reserved":0,"allocated":778240,"data_stored":348575,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 20:00:56 2023","interfaces":[{"interface":"back","average":{"1min":0.372,"5min":0.59999999999999998,"15min":0.63800000000000001},"min":{"1min":0.25900000000000001,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.53200000000000003,"5min":3.8740000000000001,"15min":3.8740000000000001},"last":0.27000000000000002},{"interface":"front","average":{"1min":0.41499999999999998,"5min":0.54000000000000004,"15min":0.56100000000000005},"min":{"1min":0.26200000000000001,"5min":0.25,"15min":0.25},"max":{"1min":0.64100000000000001,"5min":2.0760000000000001,"15min":2.0760000000000001},"last":0.36599999999999999}]},{"osd":2,"last update":"Tue Nov 28 20:00:56 2023","interfaces":[{"interface":"back","average":{"1min":0.40899999999999997,"5min":0.60899999999999999,"15min":0.64200000000000002},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":0.54500000000000004,"5min":3.7320000000000002,"15min":3.7320000000000002},"last":0.307},{"interface":"front","average":{"1min":0.42199999999999999,"5min":0.69199999999999995,"15min":0.73699999999999999},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.54800000000000004,"5min":3.9089999999999998,"15min":3.9089999999999998},"last":0.38600000000000001}]},{"osd":3,"last update":"Tue Nov 28 20:00:56 2023","interfaces":[{"interface":"back","average":{"1min":0.52800000000000002,"5min":0.65000000000000002,"15min":0.67000000000000004},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.64700000000000002,"5min":1.6399999999999999,"15min":1.6399999999999999},"last":0.436},{"interface":"front","average":{"1min":0.52000000000000002,"5min":0.66600000000000004,"15min":0.68999999999999995},"min":{"1min":0.37,"5min":0.317,"15min":0.317},"max":{"1min":0.748,"5min":2.5270000000000001,"15min":2.5270000000000001},"last":0.33300000000000002}]},{"osd":4,"last update":"Tue Nov 28 20:00:56 2023","interfaces":[{"interface":"back","average":{"1min":0.70199999999999996,"5min":0.85599999999999998,"15min":0.88200000000000001},"min":{"1min":0.46700000000000003,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":1.036,"5min":3.1659999999999999,"15min":3.1659999999999999},"last":0.51600000000000001},{"interface":"front","average":{"1min":0.68700000000000006,"5min":0.89400000000000002,"15min":0.92800000000000005},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.93700000000000006,"5min":3.7959999999999998,"15min":3.7959999999999998},"last":0.59999999999999998}]},{"osd":5,"last update":"Tue Nov 28 20:00:56 2023","interfaces":[{"interface":"back","average":{"1min":0.69799999999999995,"5min":0.93000000000000005,"15min":0.96899999999999997},"min":{"1min":0.50800000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":0.95599999999999996,"5min":4.1479999999999997,"15min":4.1479999999999997},"last":0.61899999999999999},{"interface":"front","average":{"1min":0.70299999999999996,"5min":0.86799999999999999,"15min":0.89600000000000002},"min":{"1min":0.499,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":1.052,"5min":3.5569999999999999,"15min":3.5569999999999999},"last":0.48199999999999998}]},{"osd":6,"last update":"Tue Nov 28 20:00:56 2023","interfaces":[{"interface":"back","average":{"1min":0.73999999999999999,"5min":0.94099999999999995,"15min":0.97499999999999998},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":1.004,"5min":2.863,"15min":2.863},"last":0.501},{"interface":"front","average":{"1min":0.77400000000000002,"5min":0.94099999999999995,"15min":0.96899999999999997},"min":{"1min":0.58099999999999996,"5min":0.56899999999999995,"15min":0.56899999999999995},"max":{"1min":1.075,"5min":3.371,"15min":3.371},"last":0.54500000000000004}]},{"osd":7,"last update":"Tue Nov 28 20:00:56 2023","interfaces":[{"interface":"back","average":{"1min":0.71599999999999997,"5min":0.95299999999999996,"15min":0.99299999999999999},"min":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":0.96899999999999997,"5min":3.8439999999999999,"15min":3.8439999999999999},"last":0.53100000000000003},{"interface":"front","average":{"1min":0.72699999999999998,"5min":0.97499999999999998,"15min":1.0169999999999999},"min":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":1.0569999999999999,"5min":3.9689999999999999,"15min":3.9689999999999999},"last":0.45000000000000001}]}]},{"osd":0,"up_from":13,"seq":55834574881,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31976,"kb_used_data":796,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339864,"statfs":{"total":96636764160,"available":96604020736,"internally_reserved":0,"allocated":815104,"data_stored":935072,"data_compressed":33374,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Nov 28 20:00:56 2023","interfaces":[{"interface":"back","average":{"1min":0.41299999999999998,"5min":0.63400000000000001,"15min":0.67100000000000004},"min":{"1min":0.27400000000000002,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.55800000000000005,"5min":4.883,"15min":4.883},"last":0.373},{"interface":"front","average":{"1min":0.44,"5min":0.79000000000000004,"15min":0.84799999999999998},"min":{"1min":0.30199999999999999,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.63200000000000001,"5min":8.0800000000000001,"15min":8.0800000000000001},"last":0.45900000000000002}]},{"osd":2,"last update":"Tue Nov 28 20:00:56 2023","interfaces":[{"interface":"back","average":{"1min":0.443,"5min":0.86699999999999999,"15min":0.93799999999999994},"min":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.59899999999999998,"5min":8.1029999999999998,"15min":8.1029999999999998},"last":0.45000000000000001},{"interface":"front","average":{"1min":0.47599999999999998,"5min":0.88400000000000001,"15min":0.95199999999999996},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.67600000000000005,"5min":8.1310000000000002,"15min":8.1310000000000002},"last":0.433}]},{"osd":3,"last update":"Tue Nov 28 20:00:56 2023","interfaces":[{"interface":"back","average":{"1min":0.42899999999999999,"5min":0.68300000000000005,"15min":0.72499999999999998},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.57599999999999996,"5min":4.3949999999999996,"15min":4.3949999999999996},"last":0.34999999999999998},{"interface":"front","average":{"1min":0.48899999999999999,"5min":0.70299999999999996,"15min":0.73899999999999999},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.69899999999999995,"5min":4.3470000000000004,"15min":4.3470000000000004},"last":0.41099999999999998}]},{"osd":4,"last update":"Tue Nov 28 20:00:56 2023","interfaces":[{"interface":"back","average":{"1min":0.71999999999999997,"5min":0.98399999999999999,"15min":1.028},"min":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":1.123,"5min":4.6360000000000001,"15min":4.6360000000000001},"last":0.71299999999999997},{"interface":"front","average":{"1min":0.747,"5min":0.99099999999999999,"15min":1.032},"min":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":0.996,"5min":4.4710000000000001,"15min":4.4710000000000001},"last":0.70099999999999996}]},{"osd":5,"last update":"Tue Nov 28 20:00:56 2023","interfaces":[{"interface":"back","average":{"1min":0.74299999999999999,"5min":1,"15min":1.0429999999999999},"min":{"1min":0.54800000000000004,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":0.96399999999999997,"5min":4.6120000000000001,"15min":4.6120000000000001},"last":0.73399999999999999},{"interface":"front","average":{"1min":0.74199999999999999,"5min":0.98999999999999999,"15min":1.0309999999999999},"min":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"max":{"1min":1.1659999999999999,"5min":4.5449999999999999,"15min":4.5449999999999999},"last":0.79800000000000004}]},{"osd":6,"last update":"Tue Nov 28 20:00:56 2023","interfaces":[{"interface":"back","average":{"1min":0.73499999999999999,"5min":1.01,"15min":1.056},"min":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":1.143,"5min":4.657,"15min":4.657},"last":0.67400000000000004},{"interface":"front","average":{"1min":0.74199999999999999,"5min":1.026,"15min":1.073},"min":{"1min":0.61199999999999999,"5min":0.58899999999999997,"15min":0.58899999999999997},"max":{"1min":1.0109999999999999,"5min":4.5259999999999998,"15min":4.5259999999999998},"last":0.77600000000000002}]},{"osd":7,"last update":"Tue Nov 28 20:00:56 2023","interfaces":[{"interface":"back","average":{"1min":0.72199999999999998,"5min":1.0249999999999999,"15min":1.075},"min":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":1.036,"5min":4.7320000000000002,"15min":4.7320000000000002},"last":0.66000000000000003},{"interface":"front","average":{"1min":0.755,"5min":0.98699999999999999,"15min":1.026},"min":{"1min":0.57499999999999996,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":1.1919999999999999,"5min":4.4939999999999998,"15min":4.4939999999999998},"last":0.75900000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33374,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33374,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":3871,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3107,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":776,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-28T20:01:32.423 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-28T20:01:32.569 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:32.565+0000 7f9daff3e640 1 Processor -- start 2023-11-28T20:01:32.569 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:32.565+0000 7f9daff3e640 1 -- start start 2023-11-28T20:01:32.570 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:32.565+0000 7f9daff3e640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9da806d2b0 0x7f9da806d690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:32.570 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:32.565+0000 7f9daff3e640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9da806bb80 con 0x7f9da80c3b80 2023-11-28T20:01:32.570 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:32.565+0000 7f9daff3e640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9da80c5790 con 0x7f9da80c5300 2023-11-28T20:01:32.570 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:32.565+0000 7f9daff3e640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9da81515c0 con 0x7f9da806d2b0 2023-11-28T20:01:32.570 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:32.565+0000 7f9dad4d9640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f9da80c3b80 0x7f9da806c020 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:37214/0 (socket says 172.21.15.78:37214) 2023-11-28T20:01:32.570 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:32.565+0000 7f9dad4d9640 1 -- 172.21.15.78:0/434435898 learned_addr learned my addr 172.21.15.78:0/434435898 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-11-28T20:01:32.572 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:32.565+0000 7f9dadcda640 1 --2- 172.21.15.78:0/434435898 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9da806d2b0 0x7f9da806d690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:32.572 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:32.565+0000 7f9daccd8640 1 -- 172.21.15.78:0/434435898 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 756417593 0 0) 0x7f9da806bb80 con 0x7f9da80c3b80 2023-11-28T20:01:32.572 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:32.565+0000 7f9daccd8640 1 -- 172.21.15.78:0/434435898 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9d94003530 con 0x7f9da80c3b80 2023-11-28T20:01:32.572 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:32.565+0000 7f9daccd8640 1 -- 172.21.15.78:0/434435898 <== mon.0 v1:172.21.15.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1069592006 0 0) 0x7f9d94003530 con 0x7f9da80c3b80 2023-11-28T20:01:32.572 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:32.565+0000 7f9daccd8640 1 -- 172.21.15.78:0/434435898 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9da806d2b0 msgr2=0x7f9da806d690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:01:32.572 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:32.565+0000 7f9daccd8640 1 --2- 172.21.15.78:0/434435898 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9da806d2b0 0x7f9da806d690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:32.573 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:32.565+0000 7f9daccd8640 1 -- 172.21.15.78:0/434435898 >> v1:172.21.15.179:6789/0 conn(0x7f9da80c5300 legacy=0x7f9da806c730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:01:32.573 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:32.565+0000 7f9daccd8640 1 -- 172.21.15.78:0/434435898 --> v1:172.21.15.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9da81518a0 con 0x7f9da80c3b80 2023-11-28T20:01:32.573 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:32.565+0000 7f9daccd8640 1 -- 172.21.15.78:0/434435898 <== mon.0 v1:172.21.15.78:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3326804700 0 0) 0x7f9d98001680 con 0x7f9da80c3b80 2023-11-28T20:01:32.573 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:32.565+0000 7f9daccd8640 1 -- 172.21.15.78:0/434435898 >> v1:172.21.15.78:6789/0 conn(0x7f9da80c3b80 legacy=0x7f9da806c020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:01:32.573 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:32.565+0000 7f9daccd8640 1 --2- 172.21.15.78:0/434435898 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9d940039b0 0x7f9d94003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:32.573 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:32.565+0000 7f9daccd8640 1 --2- 172.21.15.78:0/434435898 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9d940047d0 0x7f9d94004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:32.573 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:32.565+0000 7f9daccd8640 1 --2- 172.21.15.78:0/434435898 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9da806d2b0 0x7f9d94005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:32.573 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:32.565+0000 7f9daccd8640 1 -- 172.21.15.78:0/434435898 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9da81515c0 con 0x7f9d940039b0 2023-11-28T20:01:32.573 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:32.565+0000 7f9daccd8640 1 -- 172.21.15.78:0/434435898 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d9400dc50 con 0x7f9d940047d0 2023-11-28T20:01:32.573 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:32.565+0000 7f9daccd8640 1 -- 172.21.15.78:0/434435898 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d9400de10 con 0x7f9da806d2b0 2023-11-28T20:01:32.573 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:32.565+0000 7f9dadcda640 1 --2- 172.21.15.78:0/434435898 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9d940039b0 0x7f9d94003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:32.573 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:32.569+0000 7f9dad4d9640 1 --2- 172.21.15.78:0/434435898 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9d940047d0 0x7f9d94004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:32.574 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:32.569+0000 7f9dae4db640 1 --2- 172.21.15.78:0/434435898 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9da806d2b0 0x7f9d94005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:32.574 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:32.569+0000 7f9dadcda640 1 -- 172.21.15.78:0/434435898 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9da806d2b0 msgr2=0x7f9d94005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:01:32.574 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:32.569+0000 7f9dadcda640 1 --2- 172.21.15.78:0/434435898 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9da806d2b0 0x7f9d94005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:32.574 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:32.569+0000 7f9dadcda640 1 -- 172.21.15.78:0/434435898 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9d940047d0 msgr2=0x7f9d94004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:01:32.574 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:32.569+0000 7f9dadcda640 1 --2- 172.21.15.78:0/434435898 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9d940047d0 0x7f9d94004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:32.574 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:32.569+0000 7f9dadcda640 1 -- 172.21.15.78:0/434435898 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d94003530 con 0x7f9d940039b0 2023-11-28T20:01:32.575 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:32.569+0000 7f9dadcda640 1 --2- 172.21.15.78:0/434435898 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9d940039b0 0x7f9d94003dd0 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7f9da4009ab0 tx=0x7f9da401c9e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=459cdd33e48a9963 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:01:32.575 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:32.569+0000 7f9daccd8640 1 -- 172.21.15.78:0/434435898 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9da40a8430 con 0x7f9d940039b0 2023-11-28T20:01:32.575 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:32.569+0000 7f9daccd8640 1 -- 172.21.15.78:0/434435898 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9da40a8590 con 0x7f9d940039b0 2023-11-28T20:01:32.575 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:32.569+0000 7f9daccd8640 1 -- 172.21.15.78:0/434435898 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9da40a8940 con 0x7f9d940039b0 2023-11-28T20:01:32.575 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:32.573+0000 7f9daff3e640 1 -- 172.21.15.78:0/434435898 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9d940039b0 msgr2=0x7f9d94003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:01:32.575 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:32.573+0000 7f9daff3e640 1 --2- 172.21.15.78:0/434435898 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9d940039b0 0x7f9d94003dd0 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7f9da4009ab0 tx=0x7f9da401c9e0 comp rx=0 tx=0).stop 2023-11-28T20:01:32.576 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:32.573+0000 7f9dae4db640 1 -- 172.21.15.78:0/434435898 reap_dead start 2023-11-28T20:01:32.576 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:32.573+0000 7f9daff3e640 1 -- 172.21.15.78:0/434435898 shutdown_connections 2023-11-28T20:01:32.576 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:32.573+0000 7f9daff3e640 1 -- 172.21.15.78:0/434435898 >> 172.21.15.78:0/434435898 conn(0x7f9da80a7810 msgr2=0x7f9da80a7c20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:01:32.576 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:32.573+0000 7f9daff3e640 1 -- 172.21.15.78:0/434435898 shutdown_connections 2023-11-28T20:01:32.576 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:32.573+0000 7f9daff3e640 1 -- 172.21.15.78:0/434435898 wait complete. 2023-11-28T20:01:32.577 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:32.573+0000 7f9daff3e640 1 Processor -- start 2023-11-28T20:01:32.577 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:32.573+0000 7f9daff3e640 1 -- start start 2023-11-28T20:01:32.579 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:32.573+0000 7f9daff3e640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9d940039b0 0x7f9da8071b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:32.579 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:32.573+0000 7f9daff3e640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9da81ea5e0 0x7f9da80aa9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:32.579 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:32.573+0000 7f9daff3e640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9da81df170 0x7f9da81df620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:32.579 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:32.573+0000 7f9daff3e640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9da81e08d0 con 0x7f9da81ea5e0 2023-11-28T20:01:32.580 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:32.573+0000 7f9daff3e640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9da81dece0 con 0x7f9d940039b0 2023-11-28T20:01:32.580 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:32.573+0000 7f9daff3e640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9da81de0d0 con 0x7f9da81df170 2023-11-28T20:01:32.580 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:32.573+0000 7f9dad4d9640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9da81ea5e0 0x7f9da80aa9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:32.580 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:32.573+0000 7f9dad4d9640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9da81ea5e0 0x7f9da80aa9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:36276/0 (socket says 172.21.15.78:36276) 2023-11-28T20:01:32.580 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:32.573+0000 7f9dad4d9640 1 -- 172.21.15.78:0/2368468484 learned_addr learned my addr 172.21.15.78:0/2368468484 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T20:01:32.580 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:32.573+0000 7f9dae4db640 1 --2- 172.21.15.78:0/2368468484 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9da81df170 0x7f9da81df620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:32.580 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:32.573+0000 7f9dadcda640 1 --2- 172.21.15.78:0/2368468484 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9d940039b0 0x7f9da8071b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:32.580 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:32.573+0000 7f9dad4d9640 1 -- 172.21.15.78:0/2368468484 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9da81df170 msgr2=0x7f9da81df620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:01:32.580 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:32.573+0000 7f9dad4d9640 1 --2- 172.21.15.78:0/2368468484 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9da81df170 0x7f9da81df620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:32.580 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:32.573+0000 7f9dad4d9640 1 -- 172.21.15.78:0/2368468484 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9d940039b0 msgr2=0x7f9da8071b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:01:32.580 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:32.573+0000 7f9dad4d9640 1 --2- 172.21.15.78:0/2368468484 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9d940039b0 0x7f9da8071b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:32.580 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:32.573+0000 7f9dad4d9640 1 -- 172.21.15.78:0/2368468484 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9da814ef80 con 0x7f9da81ea5e0 2023-11-28T20:01:32.581 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:32.573+0000 7f9dad4d9640 1 --2- 172.21.15.78:0/2368468484 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9da81ea5e0 0x7f9da80aa9a0 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7f9d9800e8c0 tx=0x7f9d9800ed80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:01:32.581 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:32.577+0000 7f9d9e7fc640 1 -- 172.21.15.78:0/2368468484 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d9800c8d0 con 0x7f9da81ea5e0 2023-11-28T20:01:32.581 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:32.577+0000 7f9d9e7fc640 1 -- 172.21.15.78:0/2368468484 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d9800ca30 con 0x7f9da81ea5e0 2023-11-28T20:01:32.581 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:32.577+0000 7f9d9e7fc640 1 -- 172.21.15.78:0/2368468484 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d9800cde0 con 0x7f9da81ea5e0 2023-11-28T20:01:32.581 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:32.577+0000 7f9daff3e640 1 -- 172.21.15.78:0/2368468484 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9da81de3b0 con 0x7f9da81ea5e0 2023-11-28T20:01:32.581 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:32.577+0000 7f9daff3e640 1 -- 172.21.15.78:0/2368468484 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9da81de970 con 0x7f9da81ea5e0 2023-11-28T20:01:32.581 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:32.577+0000 7f9daff3e640 1 -- 172.21.15.78:0/2368468484 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9da80a82b0 con 0x7f9da81ea5e0 2023-11-28T20:01:32.582 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:32.577+0000 7f9d9e7fc640 1 -- 172.21.15.78:0/2368468484 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f9d9801d460 con 0x7f9da81ea5e0 2023-11-28T20:01:32.582 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:32.577+0000 7f9d9e7fc640 1 --2- 172.21.15.78:0/2368468484 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f9d8c066470 0x7f9d8c068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:32.582 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:32.577+0000 7f9d9e7fc640 1 -- 172.21.15.78:0/2368468484 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 6885+0+0 (secure 0 0 0) 0x7f9d98084460 con 0x7f9da81ea5e0 2023-11-28T20:01:32.582 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:32.577+0000 7f9dadcda640 1 --2- 172.21.15.78:0/2368468484 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f9d8c066470 0x7f9d8c068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:32.583 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:32.577+0000 7f9dadcda640 1 --2- 172.21.15.78:0/2368468484 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f9d8c066470 0x7f9d8c068930 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f9da40af000 tx=0x7f9da40b2040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:01:32.586 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:32.581+0000 7f9d9e7fc640 1 -- 172.21.15.78:0/2368468484 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f9d980513a0 con 0x7f9da81ea5e0 2023-11-28T20:01:32.732 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:32.729+0000 7f9daff3e640 1 -- 172.21.15.78:0/2368468484 --> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f9da8152380 con 0x7f9d8c066470 2023-11-28T20:01:32.745 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:32.741+0000 7f9d9e7fc640 1 -- 172.21.15.78:0/2368468484 <== mgr.4106 v2:172.21.15.78:6832/2935380957 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+527662 (secure 0 0 0) 0x7f9da8152380 con 0x7f9d8c066470 2023-11-28T20:01:32.751 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-11-28T20:01:32.755 INFO:teuthology.orchestra.run.smithi078.stderr:dumped all 2023-11-28T20:01:32.756 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:32.745+0000 7f9daff3e640 1 -- 172.21.15.78:0/2368468484 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f9d8c066470 msgr2=0x7f9d8c068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:01:32.756 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:32.745+0000 7f9daff3e640 1 --2- 172.21.15.78:0/2368468484 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f9d8c066470 0x7f9d8c068930 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f9da40af000 tx=0x7f9da40b2040 comp rx=0 tx=0).stop 2023-11-28T20:01:32.757 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:32.745+0000 7f9daff3e640 1 -- 172.21.15.78:0/2368468484 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9da81ea5e0 msgr2=0x7f9da80aa9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:01:32.757 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:32.745+0000 7f9daff3e640 1 --2- 172.21.15.78:0/2368468484 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9da81ea5e0 0x7f9da80aa9a0 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7f9d9800e8c0 tx=0x7f9d9800ed80 comp rx=0 tx=0).stop 2023-11-28T20:01:32.757 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:32.745+0000 7f9daff3e640 1 -- 172.21.15.78:0/2368468484 shutdown_connections 2023-11-28T20:01:32.757 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:32.745+0000 7f9daff3e640 1 --2- 172.21.15.78:0/2368468484 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f9d8c066470 0x7f9d8c068930 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:32.757 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:32.745+0000 7f9daff3e640 1 --2- 172.21.15.78:0/2368468484 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9da81df170 0x7f9da81df620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:32.757 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:32.745+0000 7f9daff3e640 1 --2- 172.21.15.78:0/2368468484 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9da81ea5e0 0x7f9da80aa9a0 unknown :-1 s=CLOSED pgs=706 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:32.757 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:32.745+0000 7f9daff3e640 1 --2- 172.21.15.78:0/2368468484 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9d940039b0 0x7f9da8071b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:32.757 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:32.745+0000 7f9daff3e640 1 -- 172.21.15.78:0/2368468484 >> 172.21.15.78:0/2368468484 conn(0x7f9da80a7810 msgr2=0x7f9da80c0360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:01:32.757 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:32.745+0000 7f9daff3e640 1 -- 172.21.15.78:0/2368468484 shutdown_connections 2023-11-28T20:01:32.757 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:32.745+0000 7f9daff3e640 1 -- 172.21.15.78:0/2368468484 wait complete. 2023-11-28T20:01:32.769 INFO:teuthology.orchestra.run.smithi078.stdout:{"pg_ready":true,"pg_map":{"version":138,"stamp":"2023-11-28T20:01:31.983977+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":596683,"num_objects":45,"num_object_clones":0,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":250,"num_write_kb":2447,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":27,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":196,"ondisk_log_size":196,"up":386,"acting":386,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":354,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":239220,"kb_used_data":6400,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754735500,"statfs":{"total":773094113280,"available":772849152000,"internally_reserved":0,"allocated":6553600,"data_stored":4134038,"data_compressed":66748,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":12752,"internal_metadata":238276144},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":59,"apply_latency_ms":59,"commit_latency_ns":59000000,"apply_latency_ns":59000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.186927"},"pg_stats":[{"pgid":"12.39","version":"0'0","reported_seq":11,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-11-28T20:01:25.213827+0000","last_change":"2023-11-28T20:01:23.834305+0000","last_active":"2023-11-28T20:01:25.213827+0000","last_peered":"2023-11-28T20:01:25.213827+0000","last_clean":"2023-11-28T20:01:25.213827+0000","last_became_active":"2023-11-28T20:01:23.834015+0000","last_became_peered":"2023-11-28T20:01:23.834015+0000","last_unstale":"2023-11-28T20:01:25.213827+0000","last_undegraded":"2023-11-28T20:01:25.213827+0000","last_fullsized":"2023-11-28T20:01:25.213827+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:22.787100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:22.787100+0000","last_clean_scrub_stamp":"2023-11-28T20:01:22.787100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:13:18.081344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.3f","version":"0'0","reported_seq":15,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-28T20:01:23.820638+0000","last_change":"2023-11-28T20:01:10.539211+0000","last_active":"2023-11-28T20:01:23.820638+0000","last_peered":"2023-11-28T20:01:23.820638+0000","last_clean":"2023-11-28T20:01:23.820638+0000","last_became_active":"2023-11-28T20:01:10.538932+0000","last_became_peered":"2023-11-28T20:01:10.538932+0000","last_unstale":"2023-11-28T20:01:23.820638+0000","last_undegraded":"2023-11-28T20:01:23.820638+0000","last_fullsized":"2023-11-28T20:01:23.820638+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_clean_scrub_stamp":"2023-11-28T20:01:09.480611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:10:00.034946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.38","version":"0'0","reported_seq":11,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-11-28T20:01:25.215189+0000","last_change":"2023-11-28T20:01:23.827174+0000","last_active":"2023-11-28T20:01:25.215189+0000","last_peered":"2023-11-28T20:01:25.215189+0000","last_clean":"2023-11-28T20:01:25.215189+0000","last_became_active":"2023-11-28T20:01:23.826907+0000","last_became_peered":"2023-11-28T20:01:23.826907+0000","last_unstale":"2023-11-28T20:01:25.215189+0000","last_undegraded":"2023-11-28T20:01:25.215189+0000","last_fullsized":"2023-11-28T20:01:25.215189+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:22.787100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:22.787100+0000","last_clean_scrub_stamp":"2023-11-28T20:01:22.787100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T07:02:27.201890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.3e","version":"0'0","reported_seq":15,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-28T20:01:23.819898+0000","last_change":"2023-11-28T20:01:10.522069+0000","last_active":"2023-11-28T20:01:23.819898+0000","last_peered":"2023-11-28T20:01:23.819898+0000","last_clean":"2023-11-28T20:01:23.819898+0000","last_became_active":"2023-11-28T20:01:10.521785+0000","last_became_peered":"2023-11-28T20:01:10.521785+0000","last_unstale":"2023-11-28T20:01:23.819898+0000","last_undegraded":"2023-11-28T20:01:23.819898+0000","last_fullsized":"2023-11-28T20:01:23.819898+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_clean_scrub_stamp":"2023-11-28T20:01:09.480611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:00:30.789993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.3b","version":"0'0","reported_seq":11,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-11-28T20:01:25.215513+0000","last_change":"2023-11-28T20:01:23.829077+0000","last_active":"2023-11-28T20:01:25.215513+0000","last_peered":"2023-11-28T20:01:25.215513+0000","last_clean":"2023-11-28T20:01:25.215513+0000","last_became_active":"2023-11-28T20:01:23.826941+0000","last_became_peered":"2023-11-28T20:01:23.826941+0000","last_unstale":"2023-11-28T20:01:25.215513+0000","last_undegraded":"2023-11-28T20:01:25.215513+0000","last_fullsized":"2023-11-28T20:01:25.215513+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:22.787100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:22.787100+0000","last_clean_scrub_stamp":"2023-11-28T20:01:22.787100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:05:09.792702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.3d","version":"0'0","reported_seq":15,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-28T20:01:23.816090+0000","last_change":"2023-11-28T20:01:10.538353+0000","last_active":"2023-11-28T20:01:23.816090+0000","last_peered":"2023-11-28T20:01:23.816090+0000","last_clean":"2023-11-28T20:01:23.816090+0000","last_became_active":"2023-11-28T20:01:10.537756+0000","last_became_peered":"2023-11-28T20:01:10.537756+0000","last_unstale":"2023-11-28T20:01:23.816090+0000","last_undegraded":"2023-11-28T20:01:23.816090+0000","last_fullsized":"2023-11-28T20:01:23.816090+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_clean_scrub_stamp":"2023-11-28T20:01:09.480611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T06:29:13.579326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.3a","version":"0'0","reported_seq":11,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-11-28T20:01:25.212632+0000","last_change":"2023-11-28T20:01:23.810864+0000","last_active":"2023-11-28T20:01:25.212632+0000","last_peered":"2023-11-28T20:01:25.212632+0000","last_clean":"2023-11-28T20:01:25.212632+0000","last_became_active":"2023-11-28T20:01:23.810298+0000","last_became_peered":"2023-11-28T20:01:23.810298+0000","last_unstale":"2023-11-28T20:01:25.212632+0000","last_undegraded":"2023-11-28T20:01:25.212632+0000","last_fullsized":"2023-11-28T20:01:25.212632+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:22.787100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:22.787100+0000","last_clean_scrub_stamp":"2023-11-28T20:01:22.787100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:24:37.975796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.3c","version":"0'0","reported_seq":15,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-28T20:01:23.806471+0000","last_change":"2023-11-28T20:01:10.523152+0000","last_active":"2023-11-28T20:01:23.806471+0000","last_peered":"2023-11-28T20:01:23.806471+0000","last_clean":"2023-11-28T20:01:23.806471+0000","last_became_active":"2023-11-28T20:01:10.522874+0000","last_became_peered":"2023-11-28T20:01:10.522874+0000","last_unstale":"2023-11-28T20:01:23.806471+0000","last_undegraded":"2023-11-28T20:01:23.806471+0000","last_fullsized":"2023-11-28T20:01:23.806471+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_clean_scrub_stamp":"2023-11-28T20:01:09.480611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:56:55.097917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.3d","version":"0'0","reported_seq":11,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-11-28T20:01:25.216733+0000","last_change":"2023-11-28T20:01:23.839331+0000","last_active":"2023-11-28T20:01:25.216733+0000","last_peered":"2023-11-28T20:01:25.216733+0000","last_clean":"2023-11-28T20:01:25.216733+0000","last_became_active":"2023-11-28T20:01:23.838708+0000","last_became_peered":"2023-11-28T20:01:23.838708+0000","last_unstale":"2023-11-28T20:01:25.216733+0000","last_undegraded":"2023-11-28T20:01:25.216733+0000","last_fullsized":"2023-11-28T20:01:25.216733+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:22.787100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:22.787100+0000","last_clean_scrub_stamp":"2023-11-28T20:01:22.787100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:59:21.875213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.3b","version":"0'0","reported_seq":15,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-28T20:01:23.809985+0000","last_change":"2023-11-28T20:01:10.529938+0000","last_active":"2023-11-28T20:01:23.809985+0000","last_peered":"2023-11-28T20:01:23.809985+0000","last_clean":"2023-11-28T20:01:23.809985+0000","last_became_active":"2023-11-28T20:01:10.529188+0000","last_became_peered":"2023-11-28T20:01:10.529188+0000","last_unstale":"2023-11-28T20:01:23.809985+0000","last_undegraded":"2023-11-28T20:01:23.809985+0000","last_fullsized":"2023-11-28T20:01:23.809985+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_clean_scrub_stamp":"2023-11-28T20:01:09.480611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:47:13.274500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.3c","version":"0'0","reported_seq":11,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-11-28T20:01:24.820937+0000","last_change":"2023-11-28T20:01:23.819887+0000","last_active":"2023-11-28T20:01:24.820937+0000","last_peered":"2023-11-28T20:01:24.820937+0000","last_clean":"2023-11-28T20:01:24.820937+0000","last_became_active":"2023-11-28T20:01:23.818120+0000","last_became_peered":"2023-11-28T20:01:23.818120+0000","last_unstale":"2023-11-28T20:01:24.820937+0000","last_undegraded":"2023-11-28T20:01:24.820937+0000","last_fullsized":"2023-11-28T20:01:24.820937+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:22.787100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:22.787100+0000","last_clean_scrub_stamp":"2023-11-28T20:01:22.787100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:25:08.201715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.3a","version":"0'0","reported_seq":15,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-28T20:01:23.811434+0000","last_change":"2023-11-28T20:01:10.531000+0000","last_active":"2023-11-28T20:01:23.811434+0000","last_peered":"2023-11-28T20:01:23.811434+0000","last_clean":"2023-11-28T20:01:23.811434+0000","last_became_active":"2023-11-28T20:01:10.530754+0000","last_became_peered":"2023-11-28T20:01:10.530754+0000","last_unstale":"2023-11-28T20:01:23.811434+0000","last_undegraded":"2023-11-28T20:01:23.811434+0000","last_fullsized":"2023-11-28T20:01:23.811434+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_clean_scrub_stamp":"2023-11-28T20:01:09.480611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:44:34.399373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.3f","version":"0'0","reported_seq":11,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-11-28T20:01:25.214113+0000","last_change":"2023-11-28T20:01:23.834339+0000","last_active":"2023-11-28T20:01:25.214113+0000","last_peered":"2023-11-28T20:01:25.214113+0000","last_clean":"2023-11-28T20:01:25.214113+0000","last_became_active":"2023-11-28T20:01:23.834031+0000","last_became_peered":"2023-11-28T20:01:23.834031+0000","last_unstale":"2023-11-28T20:01:25.214113+0000","last_undegraded":"2023-11-28T20:01:25.214113+0000","last_fullsized":"2023-11-28T20:01:25.214113+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:22.787100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:22.787100+0000","last_clean_scrub_stamp":"2023-11-28T20:01:22.787100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:25:23.868917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.39","version":"0'0","reported_seq":15,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-28T20:01:23.821212+0000","last_change":"2023-11-28T20:01:10.535113+0000","last_active":"2023-11-28T20:01:23.821212+0000","last_peered":"2023-11-28T20:01:23.821212+0000","last_clean":"2023-11-28T20:01:23.821212+0000","last_became_active":"2023-11-28T20:01:10.534919+0000","last_became_peered":"2023-11-28T20:01:10.534919+0000","last_unstale":"2023-11-28T20:01:23.821212+0000","last_undegraded":"2023-11-28T20:01:23.821212+0000","last_fullsized":"2023-11-28T20:01:23.821212+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_clean_scrub_stamp":"2023-11-28T20:01:09.480611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:00:31.915592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.3e","version":"0'0","reported_seq":11,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-11-28T20:01:24.819765+0000","last_change":"2023-11-28T20:01:23.834896+0000","last_active":"2023-11-28T20:01:24.819765+0000","last_peered":"2023-11-28T20:01:24.819765+0000","last_clean":"2023-11-28T20:01:24.819765+0000","last_became_active":"2023-11-28T20:01:23.834714+0000","last_became_peered":"2023-11-28T20:01:23.834714+0000","last_unstale":"2023-11-28T20:01:24.819765+0000","last_undegraded":"2023-11-28T20:01:24.819765+0000","last_fullsized":"2023-11-28T20:01:24.819765+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:22.787100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:22.787100+0000","last_clean_scrub_stamp":"2023-11-28T20:01:22.787100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:24:37.975796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.38","version":"0'0","reported_seq":15,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-28T20:01:23.803650+0000","last_change":"2023-11-28T20:01:10.538054+0000","last_active":"2023-11-28T20:01:23.803650+0000","last_peered":"2023-11-28T20:01:23.803650+0000","last_clean":"2023-11-28T20:01:23.803650+0000","last_became_active":"2023-11-28T20:01:10.535363+0000","last_became_peered":"2023-11-28T20:01:10.535363+0000","last_unstale":"2023-11-28T20:01:23.803650+0000","last_undegraded":"2023-11-28T20:01:23.803650+0000","last_fullsized":"2023-11-28T20:01:23.803650+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_clean_scrub_stamp":"2023-11-28T20:01:09.480611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:06:36.994816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.31","version":"0'0","reported_seq":11,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-11-28T20:01:24.819119+0000","last_change":"2023-11-28T20:01:23.822884+0000","last_active":"2023-11-28T20:01:24.819119+0000","last_peered":"2023-11-28T20:01:24.819119+0000","last_clean":"2023-11-28T20:01:24.819119+0000","last_became_active":"2023-11-28T20:01:23.822608+0000","last_became_peered":"2023-11-28T20:01:23.822608+0000","last_unstale":"2023-11-28T20:01:24.819119+0000","last_undegraded":"2023-11-28T20:01:24.819119+0000","last_fullsized":"2023-11-28T20:01:24.819119+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:22.787100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:22.787100+0000","last_clean_scrub_stamp":"2023-11-28T20:01:22.787100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:36:30.079855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.37","version":"0'0","reported_seq":15,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-28T20:01:23.818632+0000","last_change":"2023-11-28T20:01:10.543027+0000","last_active":"2023-11-28T20:01:23.818632+0000","last_peered":"2023-11-28T20:01:23.818632+0000","last_clean":"2023-11-28T20:01:23.818632+0000","last_became_active":"2023-11-28T20:01:10.541632+0000","last_became_peered":"2023-11-28T20:01:10.541632+0000","last_unstale":"2023-11-28T20:01:23.818632+0000","last_undegraded":"2023-11-28T20:01:23.818632+0000","last_fullsized":"2023-11-28T20:01:23.818632+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_clean_scrub_stamp":"2023-11-28T20:01:09.480611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:46:29.701039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.30","version":"0'0","reported_seq":11,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-11-28T20:01:25.213441+0000","last_change":"2023-11-28T20:01:23.825895+0000","last_active":"2023-11-28T20:01:25.213441+0000","last_peered":"2023-11-28T20:01:25.213441+0000","last_clean":"2023-11-28T20:01:25.213441+0000","last_became_active":"2023-11-28T20:01:23.825573+0000","last_became_peered":"2023-11-28T20:01:23.825573+0000","last_unstale":"2023-11-28T20:01:25.213441+0000","last_undegraded":"2023-11-28T20:01:25.213441+0000","last_fullsized":"2023-11-28T20:01:25.213441+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:22.787100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:22.787100+0000","last_clean_scrub_stamp":"2023-11-28T20:01:22.787100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:32:03.080192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.36","version":"0'0","reported_seq":15,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-28T20:01:23.820465+0000","last_change":"2023-11-28T20:01:10.541712+0000","last_active":"2023-11-28T20:01:23.820465+0000","last_peered":"2023-11-28T20:01:23.820465+0000","last_clean":"2023-11-28T20:01:23.820465+0000","last_became_active":"2023-11-28T20:01:10.541389+0000","last_became_peered":"2023-11-28T20:01:10.541389+0000","last_unstale":"2023-11-28T20:01:23.820465+0000","last_undegraded":"2023-11-28T20:01:23.820465+0000","last_fullsized":"2023-11-28T20:01:23.820465+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_clean_scrub_stamp":"2023-11-28T20:01:09.480611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:54:30.269337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.33","version":"0'0","reported_seq":11,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-11-28T20:01:25.215580+0000","last_change":"2023-11-28T20:01:23.833894+0000","last_active":"2023-11-28T20:01:25.215580+0000","last_peered":"2023-11-28T20:01:25.215580+0000","last_clean":"2023-11-28T20:01:25.215580+0000","last_became_active":"2023-11-28T20:01:23.833626+0000","last_became_peered":"2023-11-28T20:01:23.833626+0000","last_unstale":"2023-11-28T20:01:25.215580+0000","last_undegraded":"2023-11-28T20:01:25.215580+0000","last_fullsized":"2023-11-28T20:01:25.215580+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:22.787100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:22.787100+0000","last_clean_scrub_stamp":"2023-11-28T20:01:22.787100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:01:49.636850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.35","version":"0'0","reported_seq":15,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-28T20:01:23.806465+0000","last_change":"2023-11-28T20:01:10.520251+0000","last_active":"2023-11-28T20:01:23.806465+0000","last_peered":"2023-11-28T20:01:23.806465+0000","last_clean":"2023-11-28T20:01:23.806465+0000","last_became_active":"2023-11-28T20:01:10.519957+0000","last_became_peered":"2023-11-28T20:01:10.519957+0000","last_unstale":"2023-11-28T20:01:23.806465+0000","last_undegraded":"2023-11-28T20:01:23.806465+0000","last_fullsized":"2023-11-28T20:01:23.806465+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_clean_scrub_stamp":"2023-11-28T20:01:09.480611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:33:17.345518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.32","version":"0'0","reported_seq":11,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-11-28T20:01:25.212698+0000","last_change":"2023-11-28T20:01:23.811024+0000","last_active":"2023-11-28T20:01:25.212698+0000","last_peered":"2023-11-28T20:01:25.212698+0000","last_clean":"2023-11-28T20:01:25.212698+0000","last_became_active":"2023-11-28T20:01:23.810627+0000","last_became_peered":"2023-11-28T20:01:23.810627+0000","last_unstale":"2023-11-28T20:01:25.212698+0000","last_undegraded":"2023-11-28T20:01:25.212698+0000","last_fullsized":"2023-11-28T20:01:25.212698+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:22.787100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:22.787100+0000","last_clean_scrub_stamp":"2023-11-28T20:01:22.787100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:59:54.391535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.34","version":"0'0","reported_seq":15,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-28T20:01:23.805378+0000","last_change":"2023-11-28T20:01:10.535199+0000","last_active":"2023-11-28T20:01:23.805378+0000","last_peered":"2023-11-28T20:01:23.805378+0000","last_clean":"2023-11-28T20:01:23.805378+0000","last_became_active":"2023-11-28T20:01:10.534856+0000","last_became_peered":"2023-11-28T20:01:10.534856+0000","last_unstale":"2023-11-28T20:01:23.805378+0000","last_undegraded":"2023-11-28T20:01:23.805378+0000","last_fullsized":"2023-11-28T20:01:23.805378+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_clean_scrub_stamp":"2023-11-28T20:01:09.480611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:07:03.844567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.35","version":"0'0","reported_seq":11,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-11-28T20:01:24.819693+0000","last_change":"2023-11-28T20:01:23.832744+0000","last_active":"2023-11-28T20:01:24.819693+0000","last_peered":"2023-11-28T20:01:24.819693+0000","last_clean":"2023-11-28T20:01:24.819693+0000","last_became_active":"2023-11-28T20:01:23.832472+0000","last_became_peered":"2023-11-28T20:01:23.832472+0000","last_unstale":"2023-11-28T20:01:24.819693+0000","last_undegraded":"2023-11-28T20:01:24.819693+0000","last_fullsized":"2023-11-28T20:01:24.819693+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:22.787100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:22.787100+0000","last_clean_scrub_stamp":"2023-11-28T20:01:22.787100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:25:23.868917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.33","version":"0'0","reported_seq":15,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-28T20:01:23.804285+0000","last_change":"2023-11-28T20:01:10.529868+0000","last_active":"2023-11-28T20:01:23.804285+0000","last_peered":"2023-11-28T20:01:23.804285+0000","last_clean":"2023-11-28T20:01:23.804285+0000","last_became_active":"2023-11-28T20:01:10.529582+0000","last_became_peered":"2023-11-28T20:01:10.529582+0000","last_unstale":"2023-11-28T20:01:23.804285+0000","last_undegraded":"2023-11-28T20:01:23.804285+0000","last_fullsized":"2023-11-28T20:01:23.804285+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_clean_scrub_stamp":"2023-11-28T20:01:09.480611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T07:14:21.836133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.34","version":"0'0","reported_seq":11,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-11-28T20:01:24.820949+0000","last_change":"2023-11-28T20:01:23.816603+0000","last_active":"2023-11-28T20:01:24.820949+0000","last_peered":"2023-11-28T20:01:24.820949+0000","last_clean":"2023-11-28T20:01:24.820949+0000","last_became_active":"2023-11-28T20:01:23.816283+0000","last_became_peered":"2023-11-28T20:01:23.816283+0000","last_unstale":"2023-11-28T20:01:24.820949+0000","last_undegraded":"2023-11-28T20:01:24.820949+0000","last_fullsized":"2023-11-28T20:01:24.820949+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:22.787100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:22.787100+0000","last_clean_scrub_stamp":"2023-11-28T20:01:22.787100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:39:32.965551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.32","version":"0'0","reported_seq":15,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-28T20:01:23.814716+0000","last_change":"2023-11-28T20:01:10.546075+0000","last_active":"2023-11-28T20:01:23.814716+0000","last_peered":"2023-11-28T20:01:23.814716+0000","last_clean":"2023-11-28T20:01:23.814716+0000","last_became_active":"2023-11-28T20:01:10.542038+0000","last_became_peered":"2023-11-28T20:01:10.542038+0000","last_unstale":"2023-11-28T20:01:23.814716+0000","last_undegraded":"2023-11-28T20:01:23.814716+0000","last_fullsized":"2023-11-28T20:01:23.814716+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_clean_scrub_stamp":"2023-11-28T20:01:09.480611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:44:34.399373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.37","version":"0'0","reported_seq":11,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-11-28T20:01:24.820489+0000","last_change":"2023-11-28T20:01:23.831696+0000","last_active":"2023-11-28T20:01:24.820489+0000","last_peered":"2023-11-28T20:01:24.820489+0000","last_clean":"2023-11-28T20:01:24.820489+0000","last_became_active":"2023-11-28T20:01:23.831326+0000","last_became_peered":"2023-11-28T20:01:23.831326+0000","last_unstale":"2023-11-28T20:01:24.820489+0000","last_undegraded":"2023-11-28T20:01:24.820489+0000","last_fullsized":"2023-11-28T20:01:24.820489+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:22.787100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:22.787100+0000","last_clean_scrub_stamp":"2023-11-28T20:01:22.787100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T07:34:50.481111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.31","version":"0'0","reported_seq":15,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-28T20:01:23.814492+0000","last_change":"2023-11-28T20:01:10.535170+0000","last_active":"2023-11-28T20:01:23.814492+0000","last_peered":"2023-11-28T20:01:23.814492+0000","last_clean":"2023-11-28T20:01:23.814492+0000","last_became_active":"2023-11-28T20:01:10.534881+0000","last_became_peered":"2023-11-28T20:01:10.534881+0000","last_unstale":"2023-11-28T20:01:23.814492+0000","last_undegraded":"2023-11-28T20:01:23.814492+0000","last_fullsized":"2023-11-28T20:01:23.814492+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_clean_scrub_stamp":"2023-11-28T20:01:09.480611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:07:03.844567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.36","version":"0'0","reported_seq":11,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-11-28T20:01:24.821358+0000","last_change":"2023-11-28T20:01:23.830706+0000","last_active":"2023-11-28T20:01:24.821358+0000","last_peered":"2023-11-28T20:01:24.821358+0000","last_clean":"2023-11-28T20:01:24.821358+0000","last_became_active":"2023-11-28T20:01:23.830432+0000","last_became_peered":"2023-11-28T20:01:23.830432+0000","last_unstale":"2023-11-28T20:01:24.821358+0000","last_undegraded":"2023-11-28T20:01:24.821358+0000","last_fullsized":"2023-11-28T20:01:24.821358+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:22.787100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:22.787100+0000","last_clean_scrub_stamp":"2023-11-28T20:01:22.787100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:30:35.715920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.30","version":"0'0","reported_seq":15,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-28T20:01:23.820197+0000","last_change":"2023-11-28T20:01:10.530998+0000","last_active":"2023-11-28T20:01:23.820197+0000","last_peered":"2023-11-28T20:01:23.820197+0000","last_clean":"2023-11-28T20:01:23.820197+0000","last_became_active":"2023-11-28T20:01:10.530709+0000","last_became_peered":"2023-11-28T20:01:10.530709+0000","last_unstale":"2023-11-28T20:01:23.820197+0000","last_undegraded":"2023-11-28T20:01:23.820197+0000","last_fullsized":"2023-11-28T20:01:23.820197+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_clean_scrub_stamp":"2023-11-28T20:01:09.480611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:11:53.891113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.29","version":"0'0","reported_seq":11,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-11-28T20:01:24.819137+0000","last_change":"2023-11-28T20:01:23.819828+0000","last_active":"2023-11-28T20:01:24.819137+0000","last_peered":"2023-11-28T20:01:24.819137+0000","last_clean":"2023-11-28T20:01:24.819137+0000","last_became_active":"2023-11-28T20:01:23.817953+0000","last_became_peered":"2023-11-28T20:01:23.817953+0000","last_unstale":"2023-11-28T20:01:24.819137+0000","last_undegraded":"2023-11-28T20:01:24.819137+0000","last_fullsized":"2023-11-28T20:01:24.819137+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:22.787100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:22.787100+0000","last_clean_scrub_stamp":"2023-11-28T20:01:22.787100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:06:50.301304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.2f","version":"0'0","reported_seq":15,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-28T20:01:23.820728+0000","last_change":"2023-11-28T20:01:10.522350+0000","last_active":"2023-11-28T20:01:23.820728+0000","last_peered":"2023-11-28T20:01:23.820728+0000","last_clean":"2023-11-28T20:01:23.820728+0000","last_became_active":"2023-11-28T20:01:10.522075+0000","last_became_peered":"2023-11-28T20:01:10.522075+0000","last_unstale":"2023-11-28T20:01:23.820728+0000","last_undegraded":"2023-11-28T20:01:23.820728+0000","last_fullsized":"2023-11-28T20:01:23.820728+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_clean_scrub_stamp":"2023-11-28T20:01:09.480611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:18:49.627041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.28","version":"0'0","reported_seq":11,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-11-28T20:01:24.819054+0000","last_change":"2023-11-28T20:01:23.835649+0000","last_active":"2023-11-28T20:01:24.819054+0000","last_peered":"2023-11-28T20:01:24.819054+0000","last_clean":"2023-11-28T20:01:24.819054+0000","last_became_active":"2023-11-28T20:01:23.835385+0000","last_became_peered":"2023-11-28T20:01:23.835385+0000","last_unstale":"2023-11-28T20:01:24.819054+0000","last_undegraded":"2023-11-28T20:01:24.819054+0000","last_fullsized":"2023-11-28T20:01:24.819054+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:22.787100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:22.787100+0000","last_clean_scrub_stamp":"2023-11-28T20:01:22.787100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T07:18:15.140321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.2e","version":"0'0","reported_seq":15,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-28T20:01:23.806669+0000","last_change":"2023-11-28T20:01:10.521611+0000","last_active":"2023-11-28T20:01:23.806669+0000","last_peered":"2023-11-28T20:01:23.806669+0000","last_clean":"2023-11-28T20:01:23.806669+0000","last_became_active":"2023-11-28T20:01:10.521162+0000","last_became_peered":"2023-11-28T20:01:10.521162+0000","last_unstale":"2023-11-28T20:01:23.806669+0000","last_undegraded":"2023-11-28T20:01:23.806669+0000","last_fullsized":"2023-11-28T20:01:23.806669+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_clean_scrub_stamp":"2023-11-28T20:01:09.480611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:04:56.486213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.2b","version":"0'0","reported_seq":11,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-11-28T20:01:24.819561+0000","last_change":"2023-11-28T20:01:23.836256+0000","last_active":"2023-11-28T20:01:24.819561+0000","last_peered":"2023-11-28T20:01:24.819561+0000","last_clean":"2023-11-28T20:01:24.819561+0000","last_became_active":"2023-11-28T20:01:23.835618+0000","last_became_peered":"2023-11-28T20:01:23.835618+0000","last_unstale":"2023-11-28T20:01:24.819561+0000","last_undegraded":"2023-11-28T20:01:24.819561+0000","last_fullsized":"2023-11-28T20:01:24.819561+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:22.787100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:22.787100+0000","last_clean_scrub_stamp":"2023-11-28T20:01:22.787100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:21:34.502070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.2d","version":"0'0","reported_seq":15,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-28T20:01:23.812563+0000","last_change":"2023-11-28T20:01:10.526160+0000","last_active":"2023-11-28T20:01:23.812563+0000","last_peered":"2023-11-28T20:01:23.812563+0000","last_clean":"2023-11-28T20:01:23.812563+0000","last_became_active":"2023-11-28T20:01:10.525887+0000","last_became_peered":"2023-11-28T20:01:10.525887+0000","last_unstale":"2023-11-28T20:01:23.812563+0000","last_undegraded":"2023-11-28T20:01:23.812563+0000","last_fullsized":"2023-11-28T20:01:23.812563+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_clean_scrub_stamp":"2023-11-28T20:01:09.480611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:49:02.557281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.2a","version":"0'0","reported_seq":11,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-11-28T20:01:25.215472+0000","last_change":"2023-11-28T20:01:23.833861+0000","last_active":"2023-11-28T20:01:25.215472+0000","last_peered":"2023-11-28T20:01:25.215472+0000","last_clean":"2023-11-28T20:01:25.215472+0000","last_became_active":"2023-11-28T20:01:23.833545+0000","last_became_peered":"2023-11-28T20:01:23.833545+0000","last_unstale":"2023-11-28T20:01:25.215472+0000","last_undegraded":"2023-11-28T20:01:25.215472+0000","last_fullsized":"2023-11-28T20:01:25.215472+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:22.787100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:22.787100+0000","last_clean_scrub_stamp":"2023-11-28T20:01:22.787100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:14:38.766141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.2c","version":"0'0","reported_seq":15,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-28T20:01:23.803190+0000","last_change":"2023-11-28T20:01:10.534338+0000","last_active":"2023-11-28T20:01:23.803190+0000","last_peered":"2023-11-28T20:01:23.803190+0000","last_clean":"2023-11-28T20:01:23.803190+0000","last_became_active":"2023-11-28T20:01:10.532397+0000","last_became_peered":"2023-11-28T20:01:10.532397+0000","last_unstale":"2023-11-28T20:01:23.803190+0000","last_undegraded":"2023-11-28T20:01:23.803190+0000","last_fullsized":"2023-11-28T20:01:23.803190+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_clean_scrub_stamp":"2023-11-28T20:01:09.480611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:51:36.724540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.2d","version":"0'0","reported_seq":11,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-11-28T20:01:25.213063+0000","last_change":"2023-11-28T20:01:23.831798+0000","last_active":"2023-11-28T20:01:25.213063+0000","last_peered":"2023-11-28T20:01:25.213063+0000","last_clean":"2023-11-28T20:01:25.213063+0000","last_became_active":"2023-11-28T20:01:23.831544+0000","last_became_peered":"2023-11-28T20:01:23.831544+0000","last_unstale":"2023-11-28T20:01:25.213063+0000","last_undegraded":"2023-11-28T20:01:25.213063+0000","last_fullsized":"2023-11-28T20:01:25.213063+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:22.787100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:22.787100+0000","last_clean_scrub_stamp":"2023-11-28T20:01:22.787100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:57:53.479669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.2b","version":"0'0","reported_seq":15,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-28T20:01:23.804365+0000","last_change":"2023-11-28T20:01:10.528780+0000","last_active":"2023-11-28T20:01:23.804365+0000","last_peered":"2023-11-28T20:01:23.804365+0000","last_clean":"2023-11-28T20:01:23.804365+0000","last_became_active":"2023-11-28T20:01:10.524555+0000","last_became_peered":"2023-11-28T20:01:10.524555+0000","last_unstale":"2023-11-28T20:01:23.804365+0000","last_undegraded":"2023-11-28T20:01:23.804365+0000","last_fullsized":"2023-11-28T20:01:23.804365+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_clean_scrub_stamp":"2023-11-28T20:01:09.480611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:30:22.791908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.2c","version":"0'0","reported_seq":11,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-11-28T20:01:25.215884+0000","last_change":"2023-11-28T20:01:23.837177+0000","last_active":"2023-11-28T20:01:25.215884+0000","last_peered":"2023-11-28T20:01:25.215884+0000","last_clean":"2023-11-28T20:01:25.215884+0000","last_became_active":"2023-11-28T20:01:23.836912+0000","last_became_peered":"2023-11-28T20:01:23.836912+0000","last_unstale":"2023-11-28T20:01:25.215884+0000","last_undegraded":"2023-11-28T20:01:25.215884+0000","last_fullsized":"2023-11-28T20:01:25.215884+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:22.787100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:22.787100+0000","last_clean_scrub_stamp":"2023-11-28T20:01:22.787100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:23:32.521860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.2a","version":"0'0","reported_seq":15,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-28T20:01:23.801848+0000","last_change":"2023-11-28T20:01:10.531958+0000","last_active":"2023-11-28T20:01:23.801848+0000","last_peered":"2023-11-28T20:01:23.801848+0000","last_clean":"2023-11-28T20:01:23.801848+0000","last_became_active":"2023-11-28T20:01:10.531111+0000","last_became_peered":"2023-11-28T20:01:10.531111+0000","last_unstale":"2023-11-28T20:01:23.801848+0000","last_undegraded":"2023-11-28T20:01:23.801848+0000","last_fullsized":"2023-11-28T20:01:23.801848+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_clean_scrub_stamp":"2023-11-28T20:01:09.480611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:52:31.642868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.2f","version":"0'0","reported_seq":11,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-11-28T20:01:25.216625+0000","last_change":"2023-11-28T20:01:23.835521+0000","last_active":"2023-11-28T20:01:25.216625+0000","last_peered":"2023-11-28T20:01:25.216625+0000","last_clean":"2023-11-28T20:01:25.216625+0000","last_became_active":"2023-11-28T20:01:23.835243+0000","last_became_peered":"2023-11-28T20:01:23.835243+0000","last_unstale":"2023-11-28T20:01:25.216625+0000","last_undegraded":"2023-11-28T20:01:25.216625+0000","last_fullsized":"2023-11-28T20:01:25.216625+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:22.787100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:22.787100+0000","last_clean_scrub_stamp":"2023-11-28T20:01:22.787100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:32:20.183948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.29","version":"0'0","reported_seq":15,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-28T20:01:23.800690+0000","last_change":"2023-11-28T20:01:10.533367+0000","last_active":"2023-11-28T20:01:23.800690+0000","last_peered":"2023-11-28T20:01:23.800690+0000","last_clean":"2023-11-28T20:01:23.800690+0000","last_became_active":"2023-11-28T20:01:10.532975+0000","last_became_peered":"2023-11-28T20:01:10.532975+0000","last_unstale":"2023-11-28T20:01:23.800690+0000","last_undegraded":"2023-11-28T20:01:23.800690+0000","last_fullsized":"2023-11-28T20:01:23.800690+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_clean_scrub_stamp":"2023-11-28T20:01:09.480611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:10:30.393696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.2e","version":"0'0","reported_seq":11,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-11-28T20:01:25.216171+0000","last_change":"2023-11-28T20:01:23.833526+0000","last_active":"2023-11-28T20:01:25.216171+0000","last_peered":"2023-11-28T20:01:25.216171+0000","last_clean":"2023-11-28T20:01:25.216171+0000","last_became_active":"2023-11-28T20:01:23.833275+0000","last_became_peered":"2023-11-28T20:01:23.833275+0000","last_unstale":"2023-11-28T20:01:25.216171+0000","last_undegraded":"2023-11-28T20:01:25.216171+0000","last_fullsized":"2023-11-28T20:01:25.216171+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:22.787100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:22.787100+0000","last_clean_scrub_stamp":"2023-11-28T20:01:22.787100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:30:51.611492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.28","version":"0'0","reported_seq":15,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-28T20:01:23.814048+0000","last_change":"2023-11-28T20:01:10.541445+0000","last_active":"2023-11-28T20:01:23.814048+0000","last_peered":"2023-11-28T20:01:23.814048+0000","last_clean":"2023-11-28T20:01:23.814048+0000","last_became_active":"2023-11-28T20:01:10.539375+0000","last_became_peered":"2023-11-28T20:01:10.539375+0000","last_unstale":"2023-11-28T20:01:23.814048+0000","last_undegraded":"2023-11-28T20:01:23.814048+0000","last_fullsized":"2023-11-28T20:01:23.814048+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_clean_scrub_stamp":"2023-11-28T20:01:09.480611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T07:14:21.836133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.21","version":"0'0","reported_seq":11,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-11-28T20:01:25.215607+0000","last_change":"2023-11-28T20:01:23.832843+0000","last_active":"2023-11-28T20:01:25.215607+0000","last_peered":"2023-11-28T20:01:25.215607+0000","last_clean":"2023-11-28T20:01:25.215607+0000","last_became_active":"2023-11-28T20:01:23.832582+0000","last_became_peered":"2023-11-28T20:01:23.832582+0000","last_unstale":"2023-11-28T20:01:25.215607+0000","last_undegraded":"2023-11-28T20:01:25.215607+0000","last_fullsized":"2023-11-28T20:01:25.215607+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:22.787100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:22.787100+0000","last_clean_scrub_stamp":"2023-11-28T20:01:22.787100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:06:07.784912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.27","version":"0'0","reported_seq":15,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-28T20:01:23.804993+0000","last_change":"2023-11-28T20:01:10.531718+0000","last_active":"2023-11-28T20:01:23.804993+0000","last_peered":"2023-11-28T20:01:23.804993+0000","last_clean":"2023-11-28T20:01:23.804993+0000","last_became_active":"2023-11-28T20:01:10.529424+0000","last_became_peered":"2023-11-28T20:01:10.529424+0000","last_unstale":"2023-11-28T20:01:23.804993+0000","last_undegraded":"2023-11-28T20:01:23.804993+0000","last_fullsized":"2023-11-28T20:01:23.804993+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_clean_scrub_stamp":"2023-11-28T20:01:09.480611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:17:27.097887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.20","version":"0'0","reported_seq":11,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-11-28T20:01:25.213208+0000","last_change":"2023-11-28T20:01:23.826680+0000","last_active":"2023-11-28T20:01:25.213208+0000","last_peered":"2023-11-28T20:01:25.213208+0000","last_clean":"2023-11-28T20:01:25.213208+0000","last_became_active":"2023-11-28T20:01:23.826384+0000","last_became_peered":"2023-11-28T20:01:23.826384+0000","last_unstale":"2023-11-28T20:01:25.213208+0000","last_undegraded":"2023-11-28T20:01:25.213208+0000","last_fullsized":"2023-11-28T20:01:25.213208+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:22.787100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:22.787100+0000","last_clean_scrub_stamp":"2023-11-28T20:01:22.787100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T07:04:34.178570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.26","version":"0'0","reported_seq":15,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-28T20:01:23.805087+0000","last_change":"2023-11-28T20:01:10.530284+0000","last_active":"2023-11-28T20:01:23.805087+0000","last_peered":"2023-11-28T20:01:23.805087+0000","last_clean":"2023-11-28T20:01:23.805087+0000","last_became_active":"2023-11-28T20:01:10.529805+0000","last_became_peered":"2023-11-28T20:01:10.529805+0000","last_unstale":"2023-11-28T20:01:23.805087+0000","last_undegraded":"2023-11-28T20:01:23.805087+0000","last_fullsized":"2023-11-28T20:01:23.805087+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_clean_scrub_stamp":"2023-11-28T20:01:09.480611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:46:29.701039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.23","version":"0'0","reported_seq":11,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-11-28T20:01:24.819406+0000","last_change":"2023-11-28T20:01:23.831874+0000","last_active":"2023-11-28T20:01:24.819406+0000","last_peered":"2023-11-28T20:01:24.819406+0000","last_clean":"2023-11-28T20:01:24.819406+0000","last_became_active":"2023-11-28T20:01:23.831592+0000","last_became_peered":"2023-11-28T20:01:23.831592+0000","last_unstale":"2023-11-28T20:01:24.819406+0000","last_undegraded":"2023-11-28T20:01:24.819406+0000","last_fullsized":"2023-11-28T20:01:24.819406+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:22.787100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:22.787100+0000","last_clean_scrub_stamp":"2023-11-28T20:01:22.787100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T07:04:34.178570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.25","version":"0'0","reported_seq":15,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-28T20:01:23.806518+0000","last_change":"2023-11-28T20:01:10.519186+0000","last_active":"2023-11-28T20:01:23.806518+0000","last_peered":"2023-11-28T20:01:23.806518+0000","last_clean":"2023-11-28T20:01:23.806518+0000","last_became_active":"2023-11-28T20:01:10.518855+0000","last_became_peered":"2023-11-28T20:01:10.518855+0000","last_unstale":"2023-11-28T20:01:23.806518+0000","last_undegraded":"2023-11-28T20:01:23.806518+0000","last_fullsized":"2023-11-28T20:01:23.806518+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_clean_scrub_stamp":"2023-11-28T20:01:09.480611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:23:19.215371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.22","version":"0'0","reported_seq":11,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-11-28T20:01:25.213518+0000","last_change":"2023-11-28T20:01:23.834375+0000","last_active":"2023-11-28T20:01:25.213518+0000","last_peered":"2023-11-28T20:01:25.213518+0000","last_clean":"2023-11-28T20:01:25.213518+0000","last_became_active":"2023-11-28T20:01:23.834092+0000","last_became_peered":"2023-11-28T20:01:23.834092+0000","last_unstale":"2023-11-28T20:01:25.213518+0000","last_undegraded":"2023-11-28T20:01:25.213518+0000","last_fullsized":"2023-11-28T20:01:25.213518+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:22.787100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:22.787100+0000","last_clean_scrub_stamp":"2023-11-28T20:01:22.787100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T06:19:52.978004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.24","version":"0'0","reported_seq":15,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-28T20:01:23.820108+0000","last_change":"2023-11-28T20:01:10.537687+0000","last_active":"2023-11-28T20:01:23.820108+0000","last_peered":"2023-11-28T20:01:23.820108+0000","last_clean":"2023-11-28T20:01:23.820108+0000","last_became_active":"2023-11-28T20:01:10.536233+0000","last_became_peered":"2023-11-28T20:01:10.536233+0000","last_unstale":"2023-11-28T20:01:23.820108+0000","last_undegraded":"2023-11-28T20:01:23.820108+0000","last_fullsized":"2023-11-28T20:01:23.820108+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_clean_scrub_stamp":"2023-11-28T20:01:09.480611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:18:17.108795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.25","version":"0'0","reported_seq":11,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-11-28T20:01:25.214210+0000","last_change":"2023-11-28T20:01:23.827213+0000","last_active":"2023-11-28T20:01:25.214210+0000","last_peered":"2023-11-28T20:01:25.214210+0000","last_clean":"2023-11-28T20:01:25.214210+0000","last_became_active":"2023-11-28T20:01:23.826921+0000","last_became_peered":"2023-11-28T20:01:23.826921+0000","last_unstale":"2023-11-28T20:01:25.214210+0000","last_undegraded":"2023-11-28T20:01:25.214210+0000","last_fullsized":"2023-11-28T20:01:25.214210+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:22.787100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:22.787100+0000","last_clean_scrub_stamp":"2023-11-28T20:01:22.787100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:24:37.975796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.23","version":"0'0","reported_seq":15,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-28T20:01:23.815185+0000","last_change":"2023-11-28T20:01:10.534726+0000","last_active":"2023-11-28T20:01:23.815185+0000","last_peered":"2023-11-28T20:01:23.815185+0000","last_clean":"2023-11-28T20:01:23.815185+0000","last_became_active":"2023-11-28T20:01:10.534413+0000","last_became_peered":"2023-11-28T20:01:10.534413+0000","last_unstale":"2023-11-28T20:01:23.815185+0000","last_undegraded":"2023-11-28T20:01:23.815185+0000","last_fullsized":"2023-11-28T20:01:23.815185+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_clean_scrub_stamp":"2023-11-28T20:01:09.480611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:30:22.791908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.24","version":"0'0","reported_seq":11,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-11-28T20:01:25.215927+0000","last_change":"2023-11-28T20:01:23.827055+0000","last_active":"2023-11-28T20:01:25.215927+0000","last_peered":"2023-11-28T20:01:25.215927+0000","last_clean":"2023-11-28T20:01:25.215927+0000","last_became_active":"2023-11-28T20:01:23.826786+0000","last_became_peered":"2023-11-28T20:01:23.826786+0000","last_unstale":"2023-11-28T20:01:25.215927+0000","last_undegraded":"2023-11-28T20:01:25.215927+0000","last_fullsized":"2023-11-28T20:01:25.215927+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:22.787100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:22.787100+0000","last_clean_scrub_stamp":"2023-11-28T20:01:22.787100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T07:21:58.585177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.22","version":"0'0","reported_seq":15,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-28T20:01:23.804865+0000","last_change":"2023-11-28T20:01:10.534050+0000","last_active":"2023-11-28T20:01:23.804865+0000","last_peered":"2023-11-28T20:01:23.804865+0000","last_clean":"2023-11-28T20:01:23.804865+0000","last_became_active":"2023-11-28T20:01:10.533704+0000","last_became_peered":"2023-11-28T20:01:10.533704+0000","last_unstale":"2023-11-28T20:01:23.804865+0000","last_undegraded":"2023-11-28T20:01:23.804865+0000","last_fullsized":"2023-11-28T20:01:23.804865+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_clean_scrub_stamp":"2023-11-28T20:01:09.480611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:50:58.589965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.27","version":"0'0","reported_seq":11,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-11-28T20:01:24.820054+0000","last_change":"2023-11-28T20:01:23.832527+0000","last_active":"2023-11-28T20:01:24.820054+0000","last_peered":"2023-11-28T20:01:24.820054+0000","last_clean":"2023-11-28T20:01:24.820054+0000","last_became_active":"2023-11-28T20:01:23.832258+0000","last_became_peered":"2023-11-28T20:01:23.832258+0000","last_unstale":"2023-11-28T20:01:24.820054+0000","last_undegraded":"2023-11-28T20:01:24.820054+0000","last_fullsized":"2023-11-28T20:01:24.820054+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:22.787100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:22.787100+0000","last_clean_scrub_stamp":"2023-11-28T20:01:22.787100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:33:58.888901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.21","version":"0'0","reported_seq":15,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-28T20:01:23.801073+0000","last_change":"2023-11-28T20:01:10.520311+0000","last_active":"2023-11-28T20:01:23.801073+0000","last_peered":"2023-11-28T20:01:23.801073+0000","last_clean":"2023-11-28T20:01:23.801073+0000","last_became_active":"2023-11-28T20:01:10.519974+0000","last_became_peered":"2023-11-28T20:01:10.519974+0000","last_unstale":"2023-11-28T20:01:23.801073+0000","last_undegraded":"2023-11-28T20:01:23.801073+0000","last_fullsized":"2023-11-28T20:01:23.801073+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_clean_scrub_stamp":"2023-11-28T20:01:09.480611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T07:02:13.895402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.26","version":"0'0","reported_seq":11,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-11-28T20:01:24.821415+0000","last_change":"2023-11-28T20:01:23.821667+0000","last_active":"2023-11-28T20:01:24.821415+0000","last_peered":"2023-11-28T20:01:24.821415+0000","last_clean":"2023-11-28T20:01:24.821415+0000","last_became_active":"2023-11-28T20:01:23.821356+0000","last_became_peered":"2023-11-28T20:01:23.821356+0000","last_unstale":"2023-11-28T20:01:24.821415+0000","last_undegraded":"2023-11-28T20:01:24.821415+0000","last_fullsized":"2023-11-28T20:01:24.821415+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:22.787100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:22.787100+0000","last_clean_scrub_stamp":"2023-11-28T20:01:22.787100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:13:00.659542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.20","version":"0'0","reported_seq":15,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-28T20:01:23.808531+0000","last_change":"2023-11-28T20:01:10.525223+0000","last_active":"2023-11-28T20:01:23.808531+0000","last_peered":"2023-11-28T20:01:23.808531+0000","last_clean":"2023-11-28T20:01:23.808531+0000","last_became_active":"2023-11-28T20:01:10.524750+0000","last_became_peered":"2023-11-28T20:01:10.524750+0000","last_unstale":"2023-11-28T20:01:23.808531+0000","last_undegraded":"2023-11-28T20:01:23.808531+0000","last_fullsized":"2023-11-28T20:01:23.808531+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_clean_scrub_stamp":"2023-11-28T20:01:09.480611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:50:58.589965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.1a","version":"0'0","reported_seq":11,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-11-28T20:01:24.819247+0000","last_change":"2023-11-28T20:01:23.837024+0000","last_active":"2023-11-28T20:01:24.819247+0000","last_peered":"2023-11-28T20:01:24.819247+0000","last_clean":"2023-11-28T20:01:24.819247+0000","last_became_active":"2023-11-28T20:01:23.836702+0000","last_became_peered":"2023-11-28T20:01:23.836702+0000","last_unstale":"2023-11-28T20:01:24.819247+0000","last_undegraded":"2023-11-28T20:01:24.819247+0000","last_fullsized":"2023-11-28T20:01:24.819247+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:22.787100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:22.787100+0000","last_clean_scrub_stamp":"2023-11-28T20:01:22.787100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:56:29.301434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1d","version":"64'2","reported_seq":14,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-28T20:01:23.835425+0000","last_change":"2023-11-28T20:01:22.828333+0000","last_active":"2023-11-28T20:01:23.835425+0000","last_peered":"2023-11-28T20:01:23.835425+0000","last_clean":"2023-11-28T20:01:23.835425+0000","last_became_active":"2023-11-28T20:01:22.828042+0000","last_became_peered":"2023-11-28T20:01:22.828042+0000","last_unstale":"2023-11-28T20:01:23.835425+0000","last_undegraded":"2023-11-28T20:01:23.835425+0000","last_fullsized":"2023-11-28T20:01:23.835425+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:21.777981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:21.777981+0000","last_clean_scrub_stamp":"2023-11-28T20:01:21.777981+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:25:07.192596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1c","version":"0'0","reported_seq":15,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-28T20:01:23.811682+0000","last_change":"2023-11-28T20:01:10.528869+0000","last_active":"2023-11-28T20:01:23.811682+0000","last_peered":"2023-11-28T20:01:23.811682+0000","last_clean":"2023-11-28T20:01:23.811682+0000","last_became_active":"2023-11-28T20:01:10.528572+0000","last_became_peered":"2023-11-28T20:01:10.528572+0000","last_unstale":"2023-11-28T20:01:23.811682+0000","last_undegraded":"2023-11-28T20:01:23.811682+0000","last_fullsized":"2023-11-28T20:01:23.811682+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_clean_scrub_stamp":"2023-11-28T20:01:09.480611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:37:17.516298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.1f","version":"60'4","reported_seq":20,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-28T20:01:23.820865+0000","last_change":"2023-11-28T20:01:09.512544+0000","last_active":"2023-11-28T20:01:23.820865+0000","last_peered":"2023-11-28T20:01:23.820865+0000","last_clean":"2023-11-28T20:01:23.820865+0000","last_became_active":"2023-11-28T20:01:09.512197+0000","last_became_peered":"2023-11-28T20:01:09.512197+0000","last_unstale":"2023-11-28T20:01:23.820865+0000","last_undegraded":"2023-11-28T20:01:23.820865+0000","last_fullsized":"2023-11-28T20:01:23.820865+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:08.474257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:08.474257+0000","last_clean_scrub_stamp":"2023-11-28T20:01:08.474257+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:49:01.550926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.1b","version":"0'0","reported_seq":11,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-11-28T20:01:24.819835+0000","last_change":"2023-11-28T20:01:23.837191+0000","last_active":"2023-11-28T20:01:24.819835+0000","last_peered":"2023-11-28T20:01:24.819835+0000","last_clean":"2023-11-28T20:01:24.819835+0000","last_became_active":"2023-11-28T20:01:23.836884+0000","last_became_peered":"2023-11-28T20:01:23.836884+0000","last_unstale":"2023-11-28T20:01:24.819835+0000","last_undegraded":"2023-11-28T20:01:24.819835+0000","last_fullsized":"2023-11-28T20:01:24.819835+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:22.787100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:22.787100+0000","last_clean_scrub_stamp":"2023-11-28T20:01:22.787100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:10:48.137019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1c","version":"64'2","reported_seq":14,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-28T20:01:23.839642+0000","last_change":"2023-11-28T20:01:22.821621+0000","last_active":"2023-11-28T20:01:23.839642+0000","last_peered":"2023-11-28T20:01:23.839642+0000","last_clean":"2023-11-28T20:01:23.839642+0000","last_became_active":"2023-11-28T20:01:22.821322+0000","last_became_peered":"2023-11-28T20:01:22.821322+0000","last_unstale":"2023-11-28T20:01:23.839642+0000","last_undegraded":"2023-11-28T20:01:23.839642+0000","last_fullsized":"2023-11-28T20:01:23.839642+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:21.777981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:21.777981+0000","last_clean_scrub_stamp":"2023-11-28T20:01:21.777981+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:54:42.566706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.1d","version":"0'0","reported_seq":15,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-28T20:01:23.806563+0000","last_change":"2023-11-28T20:01:10.528270+0000","last_active":"2023-11-28T20:01:23.806563+0000","last_peered":"2023-11-28T20:01:23.806563+0000","last_clean":"2023-11-28T20:01:23.806563+0000","last_became_active":"2023-11-28T20:01:10.527932+0000","last_became_peered":"2023-11-28T20:01:10.527932+0000","last_unstale":"2023-11-28T20:01:23.806563+0000","last_undegraded":"2023-11-28T20:01:23.806563+0000","last_fullsized":"2023-11-28T20:01:23.806563+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_clean_scrub_stamp":"2023-11-28T20:01:09.480611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T07:21:45.278688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1e","version":"60'1","reported_seq":17,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-28T20:01:23.809322+0000","last_change":"2023-11-28T20:01:09.516140+0000","last_active":"2023-11-28T20:01:23.809322+0000","last_peered":"2023-11-28T20:01:23.809322+0000","last_clean":"2023-11-28T20:01:23.809322+0000","last_became_active":"2023-11-28T20:01:09.514007+0000","last_became_peered":"2023-11-28T20:01:09.514007+0000","last_unstale":"2023-11-28T20:01:23.809322+0000","last_undegraded":"2023-11-28T20:01:23.809322+0000","last_fullsized":"2023-11-28T20:01:23.809322+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:08.474257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:08.474257+0000","last_clean_scrub_stamp":"2023-11-28T20:01:08.474257+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:30:21.785554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.18","version":"0'0","reported_seq":11,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-11-28T20:01:25.215441+0000","last_change":"2023-11-28T20:01:23.829540+0000","last_active":"2023-11-28T20:01:25.215441+0000","last_peered":"2023-11-28T20:01:25.215441+0000","last_clean":"2023-11-28T20:01:25.215441+0000","last_became_active":"2023-11-28T20:01:23.829194+0000","last_became_peered":"2023-11-28T20:01:23.829194+0000","last_unstale":"2023-11-28T20:01:25.215441+0000","last_undegraded":"2023-11-28T20:01:25.215441+0000","last_fullsized":"2023-11-28T20:01:25.215441+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:22.787100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:22.787100+0000","last_clean_scrub_stamp":"2023-11-28T20:01:22.787100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:54:43.575825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.1f","version":"64'4","reported_seq":16,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-28T20:01:23.833894+0000","last_change":"2023-11-28T20:01:22.821923+0000","last_active":"2023-11-28T20:01:23.833894+0000","last_peered":"2023-11-28T20:01:23.833894+0000","last_clean":"2023-11-28T20:01:23.833894+0000","last_became_active":"2023-11-28T20:01:22.821642+0000","last_became_peered":"2023-11-28T20:01:22.821642+0000","last_unstale":"2023-11-28T20:01:23.833894+0000","last_undegraded":"2023-11-28T20:01:23.833894+0000","last_fullsized":"2023-11-28T20:01:23.833894+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:21.777981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:21.777981+0000","last_clean_scrub_stamp":"2023-11-28T20:01:21.777981+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:15:40.613566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.1e","version":"0'0","reported_seq":15,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-28T20:01:23.809202+0000","last_change":"2023-11-28T20:01:10.526680+0000","last_active":"2023-11-28T20:01:23.809202+0000","last_peered":"2023-11-28T20:01:23.809202+0000","last_clean":"2023-11-28T20:01:23.809202+0000","last_became_active":"2023-11-28T20:01:10.526366+0000","last_became_peered":"2023-11-28T20:01:10.526366+0000","last_unstale":"2023-11-28T20:01:23.809202+0000","last_undegraded":"2023-11-28T20:01:23.809202+0000","last_fullsized":"2023-11-28T20:01:23.809202+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_clean_scrub_stamp":"2023-11-28T20:01:09.480611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:05:54.478424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1d","version":"60'2","reported_seq":18,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-28T20:01:23.812114+0000","last_change":"2023-11-28T20:01:09.510600+0000","last_active":"2023-11-28T20:01:23.812114+0000","last_peered":"2023-11-28T20:01:23.812114+0000","last_clean":"2023-11-28T20:01:23.812114+0000","last_became_active":"2023-11-28T20:01:09.510336+0000","last_became_peered":"2023-11-28T20:01:09.510336+0000","last_unstale":"2023-11-28T20:01:23.812114+0000","last_undegraded":"2023-11-28T20:01:23.812114+0000","last_fullsized":"2023-11-28T20:01:23.812114+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:08.474257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:08.474257+0000","last_clean_scrub_stamp":"2023-11-28T20:01:08.474257+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:56:14.988591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.19","version":"0'0","reported_seq":11,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-11-28T20:01:24.819129+0000","last_change":"2023-11-28T20:01:23.814462+0000","last_active":"2023-11-28T20:01:24.819129+0000","last_peered":"2023-11-28T20:01:24.819129+0000","last_clean":"2023-11-28T20:01:24.819129+0000","last_became_active":"2023-11-28T20:01:23.814155+0000","last_became_peered":"2023-11-28T20:01:23.814155+0000","last_unstale":"2023-11-28T20:01:24.819129+0000","last_undegraded":"2023-11-28T20:01:24.819129+0000","last_fullsized":"2023-11-28T20:01:24.819129+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:22.787100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:22.787100+0000","last_clean_scrub_stamp":"2023-11-28T20:01:22.787100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:42:13.970838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1e","version":"64'1","reported_seq":13,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-28T20:01:23.830924+0000","last_change":"2023-11-28T20:01:22.828784+0000","last_active":"2023-11-28T20:01:23.830924+0000","last_peered":"2023-11-28T20:01:23.830924+0000","last_clean":"2023-11-28T20:01:23.830924+0000","last_became_active":"2023-11-28T20:01:22.828228+0000","last_became_peered":"2023-11-28T20:01:22.828228+0000","last_unstale":"2023-11-28T20:01:23.830924+0000","last_undegraded":"2023-11-28T20:01:23.830924+0000","last_fullsized":"2023-11-28T20:01:23.830924+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:21.777981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:21.777981+0000","last_clean_scrub_stamp":"2023-11-28T20:01:21.777981+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:42:12.961719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1f","version":"0'0","reported_seq":15,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-28T20:01:23.818500+0000","last_change":"2023-11-28T20:01:10.541960+0000","last_active":"2023-11-28T20:01:23.818500+0000","last_peered":"2023-11-28T20:01:23.818500+0000","last_clean":"2023-11-28T20:01:23.818500+0000","last_became_active":"2023-11-28T20:01:10.541305+0000","last_became_peered":"2023-11-28T20:01:10.541305+0000","last_unstale":"2023-11-28T20:01:23.818500+0000","last_undegraded":"2023-11-28T20:01:23.818500+0000","last_fullsized":"2023-11-28T20:01:23.818500+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_clean_scrub_stamp":"2023-11-28T20:01:09.480611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:17:27.097887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.1c","version":"60'2","reported_seq":18,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-28T20:01:23.812944+0000","last_change":"2023-11-28T20:01:09.507988+0000","last_active":"2023-11-28T20:01:23.812944+0000","last_peered":"2023-11-28T20:01:23.812944+0000","last_clean":"2023-11-28T20:01:23.812944+0000","last_became_active":"2023-11-28T20:01:09.507762+0000","last_became_peered":"2023-11-28T20:01:09.507762+0000","last_unstale":"2023-11-28T20:01:23.812944+0000","last_undegraded":"2023-11-28T20:01:23.812944+0000","last_fullsized":"2023-11-28T20:01:23.812944+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:08.474257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:08.474257+0000","last_clean_scrub_stamp":"2023-11-28T20:01:08.474257+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T07:14:20.829778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.1e","version":"0'0","reported_seq":11,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-11-28T20:01:24.820655+0000","last_change":"2023-11-28T20:01:23.820959+0000","last_active":"2023-11-28T20:01:24.820655+0000","last_peered":"2023-11-28T20:01:24.820655+0000","last_clean":"2023-11-28T20:01:24.820655+0000","last_became_active":"2023-11-28T20:01:23.820674+0000","last_became_peered":"2023-11-28T20:01:23.820674+0000","last_unstale":"2023-11-28T20:01:24.820655+0000","last_undegraded":"2023-11-28T20:01:24.820655+0000","last_fullsized":"2023-11-28T20:01:24.820655+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:22.787100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:22.787100+0000","last_clean_scrub_stamp":"2023-11-28T20:01:22.787100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T07:14:35.142621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":12,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-28T20:01:23.810797+0000","last_change":"2023-11-28T20:01:22.818660+0000","last_active":"2023-11-28T20:01:23.810797+0000","last_peered":"2023-11-28T20:01:23.810797+0000","last_clean":"2023-11-28T20:01:23.810797+0000","last_became_active":"2023-11-28T20:01:22.818352+0000","last_became_peered":"2023-11-28T20:01:22.818352+0000","last_unstale":"2023-11-28T20:01:23.810797+0000","last_undegraded":"2023-11-28T20:01:23.810797+0000","last_fullsized":"2023-11-28T20:01:23.810797+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:21.777981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:21.777981+0000","last_clean_scrub_stamp":"2023-11-28T20:01:21.777981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:12:59.650423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":15,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-28T20:01:23.820267+0000","last_change":"2023-11-28T20:01:10.518032+0000","last_active":"2023-11-28T20:01:23.820267+0000","last_peered":"2023-11-28T20:01:23.820267+0000","last_clean":"2023-11-28T20:01:23.820267+0000","last_became_active":"2023-11-28T20:01:10.517780+0000","last_became_peered":"2023-11-28T20:01:10.517780+0000","last_unstale":"2023-11-28T20:01:23.820267+0000","last_undegraded":"2023-11-28T20:01:23.820267+0000","last_fullsized":"2023-11-28T20:01:23.820267+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_clean_scrub_stamp":"2023-11-28T20:01:09.480611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:43:39.118896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.1b","version":"60'1","reported_seq":17,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-28T20:01:23.803450+0000","last_change":"2023-11-28T20:01:09.514901+0000","last_active":"2023-11-28T20:01:23.803450+0000","last_peered":"2023-11-28T20:01:23.803450+0000","last_clean":"2023-11-28T20:01:23.803450+0000","last_became_active":"2023-11-28T20:01:09.514568+0000","last_became_peered":"2023-11-28T20:01:09.514568+0000","last_unstale":"2023-11-28T20:01:23.803450+0000","last_undegraded":"2023-11-28T20:01:23.803450+0000","last_fullsized":"2023-11-28T20:01:23.803450+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:08.474257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:08.474257+0000","last_clean_scrub_stamp":"2023-11-28T20:01:08.474257+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:44:33.393018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.1f","version":"0'0","reported_seq":11,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-11-28T20:01:25.214995+0000","last_change":"2023-11-28T20:01:23.830349+0000","last_active":"2023-11-28T20:01:25.214995+0000","last_peered":"2023-11-28T20:01:25.214995+0000","last_clean":"2023-11-28T20:01:25.214995+0000","last_became_active":"2023-11-28T20:01:23.829950+0000","last_became_peered":"2023-11-28T20:01:23.829950+0000","last_unstale":"2023-11-28T20:01:25.214995+0000","last_undegraded":"2023-11-28T20:01:25.214995+0000","last_fullsized":"2023-11-28T20:01:25.214995+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:22.787100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:22.787100+0000","last_clean_scrub_stamp":"2023-11-28T20:01:22.787100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:58:36.776854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":12,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-28T20:01:23.820121+0000","last_change":"2023-11-28T20:01:22.811015+0000","last_active":"2023-11-28T20:01:23.820121+0000","last_peered":"2023-11-28T20:01:23.820121+0000","last_clean":"2023-11-28T20:01:23.820121+0000","last_became_active":"2023-11-28T20:01:22.810559+0000","last_became_peered":"2023-11-28T20:01:22.810559+0000","last_unstale":"2023-11-28T20:01:23.820121+0000","last_undegraded":"2023-11-28T20:01:23.820121+0000","last_fullsized":"2023-11-28T20:01:23.820121+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:21.777981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:21.777981+0000","last_clean_scrub_stamp":"2023-11-28T20:01:21.777981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:01:02.047628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":15,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-28T20:01:23.816953+0000","last_change":"2023-11-28T20:01:10.522005+0000","last_active":"2023-11-28T20:01:23.816953+0000","last_peered":"2023-11-28T20:01:23.816953+0000","last_clean":"2023-11-28T20:01:23.816953+0000","last_became_active":"2023-11-28T20:01:10.521691+0000","last_became_peered":"2023-11-28T20:01:10.521691+0000","last_unstale":"2023-11-28T20:01:23.816953+0000","last_undegraded":"2023-11-28T20:01:23.816953+0000","last_fullsized":"2023-11-28T20:01:23.816953+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_clean_scrub_stamp":"2023-11-28T20:01:09.480611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:11:08.794514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1a","version":"60'1","reported_seq":17,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-28T20:01:23.801930+0000","last_change":"2023-11-28T20:01:09.510388+0000","last_active":"2023-11-28T20:01:23.801930+0000","last_peered":"2023-11-28T20:01:23.801930+0000","last_clean":"2023-11-28T20:01:23.801930+0000","last_became_active":"2023-11-28T20:01:09.510114+0000","last_became_peered":"2023-11-28T20:01:09.510114+0000","last_unstale":"2023-11-28T20:01:23.801930+0000","last_undegraded":"2023-11-28T20:01:23.801930+0000","last_fullsized":"2023-11-28T20:01:23.801930+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:08.474257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:08.474257+0000","last_clean_scrub_stamp":"2023-11-28T20:01:08.474257+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T06:29:12.572972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.1c","version":"0'0","reported_seq":11,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-11-28T20:01:24.819472+0000","last_change":"2023-11-28T20:01:23.828145+0000","last_active":"2023-11-28T20:01:24.819472+0000","last_peered":"2023-11-28T20:01:24.819472+0000","last_clean":"2023-11-28T20:01:24.819472+0000","last_became_active":"2023-11-28T20:01:23.827879+0000","last_became_peered":"2023-11-28T20:01:23.827879+0000","last_unstale":"2023-11-28T20:01:24.819472+0000","last_undegraded":"2023-11-28T20:01:24.819472+0000","last_fullsized":"2023-11-28T20:01:24.819472+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:22.787100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:22.787100+0000","last_clean_scrub_stamp":"2023-11-28T20:01:22.787100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:32:03.080192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1b","version":"64'1","reported_seq":13,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-28T20:01:23.819271+0000","last_change":"2023-11-28T20:01:22.826731+0000","last_active":"2023-11-28T20:01:23.819271+0000","last_peered":"2023-11-28T20:01:23.819271+0000","last_clean":"2023-11-28T20:01:23.819271+0000","last_became_active":"2023-11-28T20:01:22.826278+0000","last_became_peered":"2023-11-28T20:01:22.826278+0000","last_unstale":"2023-11-28T20:01:23.819271+0000","last_undegraded":"2023-11-28T20:01:23.819271+0000","last_fullsized":"2023-11-28T20:01:23.819271+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:21.777981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:21.777981+0000","last_clean_scrub_stamp":"2023-11-28T20:01:21.777981+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:52:55.039336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.1a","version":"0'0","reported_seq":15,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-28T20:01:23.811016+0000","last_change":"2023-11-28T20:01:10.536831+0000","last_active":"2023-11-28T20:01:23.811016+0000","last_peered":"2023-11-28T20:01:23.811016+0000","last_clean":"2023-11-28T20:01:23.811016+0000","last_became_active":"2023-11-28T20:01:10.536506+0000","last_became_peered":"2023-11-28T20:01:10.536506+0000","last_unstale":"2023-11-28T20:01:23.811016+0000","last_undegraded":"2023-11-28T20:01:23.811016+0000","last_fullsized":"2023-11-28T20:01:23.811016+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_clean_scrub_stamp":"2023-11-28T20:01:09.480611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:29:39.856095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":16,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-28T20:01:23.800769+0000","last_change":"2023-11-28T20:01:09.514530+0000","last_active":"2023-11-28T20:01:23.800769+0000","last_peered":"2023-11-28T20:01:23.800769+0000","last_clean":"2023-11-28T20:01:23.800769+0000","last_became_active":"2023-11-28T20:01:09.514112+0000","last_became_peered":"2023-11-28T20:01:09.514112+0000","last_unstale":"2023-11-28T20:01:23.800769+0000","last_undegraded":"2023-11-28T20:01:23.800769+0000","last_fullsized":"2023-11-28T20:01:23.800769+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:08.474257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:08.474257+0000","last_clean_scrub_stamp":"2023-11-28T20:01:08.474257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:07:02.838212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.1d","version":"0'0","reported_seq":11,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-11-28T20:01:24.819818+0000","last_change":"2023-11-28T20:01:23.832564+0000","last_active":"2023-11-28T20:01:24.819818+0000","last_peered":"2023-11-28T20:01:24.819818+0000","last_clean":"2023-11-28T20:01:24.819818+0000","last_became_active":"2023-11-28T20:01:23.832014+0000","last_became_peered":"2023-11-28T20:01:23.832014+0000","last_unstale":"2023-11-28T20:01:24.819818+0000","last_undegraded":"2023-11-28T20:01:24.819818+0000","last_fullsized":"2023-11-28T20:01:24.819818+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:22.787100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:22.787100+0000","last_clean_scrub_stamp":"2023-11-28T20:01:22.787100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:59:54.391535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1a","version":"64'1","reported_seq":13,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-28T20:01:23.837484+0000","last_change":"2023-11-28T20:01:22.823414+0000","last_active":"2023-11-28T20:01:23.837484+0000","last_peered":"2023-11-28T20:01:23.837484+0000","last_clean":"2023-11-28T20:01:23.837484+0000","last_became_active":"2023-11-28T20:01:22.823073+0000","last_became_peered":"2023-11-28T20:01:22.823073+0000","last_unstale":"2023-11-28T20:01:23.837484+0000","last_undegraded":"2023-11-28T20:01:23.837484+0000","last_fullsized":"2023-11-28T20:01:23.837484+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:21.777981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:21.777981+0000","last_clean_scrub_stamp":"2023-11-28T20:01:21.777981+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T07:01:40.095053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.1b","version":"0'0","reported_seq":15,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-28T20:01:23.803717+0000","last_change":"2023-11-28T20:01:10.522250+0000","last_active":"2023-11-28T20:01:23.803717+0000","last_peered":"2023-11-28T20:01:23.803717+0000","last_clean":"2023-11-28T20:01:23.803717+0000","last_became_active":"2023-11-28T20:01:10.521958+0000","last_became_peered":"2023-11-28T20:01:10.521958+0000","last_unstale":"2023-11-28T20:01:23.803717+0000","last_undegraded":"2023-11-28T20:01:23.803717+0000","last_fullsized":"2023-11-28T20:01:23.803717+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_clean_scrub_stamp":"2023-11-28T20:01:09.480611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:59:08.568724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":16,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-28T20:01:23.810050+0000","last_change":"2023-11-28T20:01:09.512078+0000","last_active":"2023-11-28T20:01:23.810050+0000","last_peered":"2023-11-28T20:01:23.810050+0000","last_clean":"2023-11-28T20:01:23.810050+0000","last_became_active":"2023-11-28T20:01:09.511733+0000","last_became_peered":"2023-11-28T20:01:09.511733+0000","last_unstale":"2023-11-28T20:01:23.810050+0000","last_undegraded":"2023-11-28T20:01:23.810050+0000","last_fullsized":"2023-11-28T20:01:23.810050+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:08.474257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:08.474257+0000","last_clean_scrub_stamp":"2023-11-28T20:01:08.474257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:16:29.294303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.12","version":"0'0","reported_seq":11,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-11-28T20:01:25.212944+0000","last_change":"2023-11-28T20:01:23.823267+0000","last_active":"2023-11-28T20:01:25.212944+0000","last_peered":"2023-11-28T20:01:25.212944+0000","last_clean":"2023-11-28T20:01:25.212944+0000","last_became_active":"2023-11-28T20:01:23.822975+0000","last_became_peered":"2023-11-28T20:01:23.822975+0000","last_unstale":"2023-11-28T20:01:25.212944+0000","last_undegraded":"2023-11-28T20:01:25.212944+0000","last_fullsized":"2023-11-28T20:01:25.212944+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:22.787100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:22.787100+0000","last_clean_scrub_stamp":"2023-11-28T20:01:22.787100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:33:58.888901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.15","version":"64'3","reported_seq":15,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-28T20:01:23.836750+0000","last_change":"2023-11-28T20:01:22.818633+0000","last_active":"2023-11-28T20:01:23.836750+0000","last_peered":"2023-11-28T20:01:23.836750+0000","last_clean":"2023-11-28T20:01:23.836750+0000","last_became_active":"2023-11-28T20:01:22.818036+0000","last_became_peered":"2023-11-28T20:01:22.818036+0000","last_unstale":"2023-11-28T20:01:23.836750+0000","last_undegraded":"2023-11-28T20:01:23.836750+0000","last_fullsized":"2023-11-28T20:01:23.836750+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:21.777981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:21.777981+0000","last_clean_scrub_stamp":"2023-11-28T20:01:21.777981+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:56:54.323061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.14","version":"0'0","reported_seq":15,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-28T20:01:23.820187+0000","last_change":"2023-11-28T20:01:10.517714+0000","last_active":"2023-11-28T20:01:23.820187+0000","last_peered":"2023-11-28T20:01:23.820187+0000","last_clean":"2023-11-28T20:01:23.820187+0000","last_became_active":"2023-11-28T20:01:10.517414+0000","last_became_peered":"2023-11-28T20:01:10.517414+0000","last_unstale":"2023-11-28T20:01:23.820187+0000","last_undegraded":"2023-11-28T20:01:23.820187+0000","last_fullsized":"2023-11-28T20:01:23.820187+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_clean_scrub_stamp":"2023-11-28T20:01:09.480611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T06:10:19.765319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":16,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-28T20:01:23.818769+0000","last_change":"2023-11-28T20:01:09.519465+0000","last_active":"2023-11-28T20:01:23.818769+0000","last_peered":"2023-11-28T20:01:23.818769+0000","last_clean":"2023-11-28T20:01:23.818769+0000","last_became_active":"2023-11-28T20:01:09.519233+0000","last_became_peered":"2023-11-28T20:01:09.519233+0000","last_unstale":"2023-11-28T20:01:23.818769+0000","last_undegraded":"2023-11-28T20:01:23.818769+0000","last_fullsized":"2023-11-28T20:01:23.818769+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:08.474257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:08.474257+0000","last_clean_scrub_stamp":"2023-11-28T20:01:08.474257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T07:34:36.168268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.13","version":"0'0","reported_seq":11,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-11-28T20:01:25.216042+0000","last_change":"2023-11-28T20:01:23.839737+0000","last_active":"2023-11-28T20:01:25.216042+0000","last_peered":"2023-11-28T20:01:25.216042+0000","last_clean":"2023-11-28T20:01:25.216042+0000","last_became_active":"2023-11-28T20:01:23.839267+0000","last_became_peered":"2023-11-28T20:01:23.839267+0000","last_unstale":"2023-11-28T20:01:25.216042+0000","last_undegraded":"2023-11-28T20:01:25.216042+0000","last_fullsized":"2023-11-28T20:01:25.216042+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:22.787100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:22.787100+0000","last_clean_scrub_stamp":"2023-11-28T20:01:22.787100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:13:18.081344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.14","version":"64'6","reported_seq":18,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-28T20:01:23.844440+0000","last_change":"2023-11-28T20:01:22.818713+0000","last_active":"2023-11-28T20:01:23.844440+0000","last_peered":"2023-11-28T20:01:23.844440+0000","last_clean":"2023-11-28T20:01:23.844440+0000","last_became_active":"2023-11-28T20:01:22.817121+0000","last_became_peered":"2023-11-28T20:01:22.817121+0000","last_unstale":"2023-11-28T20:01:23.844440+0000","last_undegraded":"2023-11-28T20:01:23.844440+0000","last_fullsized":"2023-11-28T20:01:23.844440+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:21.777981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:21.777981+0000","last_clean_scrub_stamp":"2023-11-28T20:01:21.777981+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:06:06.775793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.15","version":"0'0","reported_seq":15,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-28T20:01:23.804957+0000","last_change":"2023-11-28T20:01:10.533748+0000","last_active":"2023-11-28T20:01:23.804957+0000","last_peered":"2023-11-28T20:01:23.804957+0000","last_clean":"2023-11-28T20:01:23.804957+0000","last_became_active":"2023-11-28T20:01:10.533411+0000","last_became_peered":"2023-11-28T20:01:10.533411+0000","last_unstale":"2023-11-28T20:01:23.804957+0000","last_undegraded":"2023-11-28T20:01:23.804957+0000","last_fullsized":"2023-11-28T20:01:23.804957+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_clean_scrub_stamp":"2023-11-28T20:01:09.480611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:58:23.470366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":16,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-28T20:01:23.806848+0000","last_change":"2023-11-28T20:01:09.507203+0000","last_active":"2023-11-28T20:01:23.806848+0000","last_peered":"2023-11-28T20:01:23.806848+0000","last_clean":"2023-11-28T20:01:23.806848+0000","last_became_active":"2023-11-28T20:01:09.506901+0000","last_became_peered":"2023-11-28T20:01:09.506901+0000","last_unstale":"2023-11-28T20:01:23.806848+0000","last_undegraded":"2023-11-28T20:01:23.806848+0000","last_fullsized":"2023-11-28T20:01:23.806848+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:08.474257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:08.474257+0000","last_clean_scrub_stamp":"2023-11-28T20:01:08.474257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:15:27.309843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.10","version":"0'0","reported_seq":11,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-11-28T20:01:24.819202+0000","last_change":"2023-11-28T20:01:23.826211+0000","last_active":"2023-11-28T20:01:24.819202+0000","last_peered":"2023-11-28T20:01:24.819202+0000","last_clean":"2023-11-28T20:01:24.819202+0000","last_became_active":"2023-11-28T20:01:23.825942+0000","last_became_peered":"2023-11-28T20:01:23.825942+0000","last_unstale":"2023-11-28T20:01:24.819202+0000","last_undegraded":"2023-11-28T20:01:24.819202+0000","last_fullsized":"2023-11-28T20:01:24.819202+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:22.787100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:22.787100+0000","last_clean_scrub_stamp":"2023-11-28T20:01:22.787100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:03:35.360729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.17","version":"0'0","reported_seq":12,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-28T20:01:23.818419+0000","last_change":"2023-11-28T20:01:22.828593+0000","last_active":"2023-11-28T20:01:23.818419+0000","last_peered":"2023-11-28T20:01:23.818419+0000","last_clean":"2023-11-28T20:01:23.818419+0000","last_became_active":"2023-11-28T20:01:22.828323+0000","last_became_peered":"2023-11-28T20:01:22.828323+0000","last_unstale":"2023-11-28T20:01:23.818419+0000","last_undegraded":"2023-11-28T20:01:23.818419+0000","last_fullsized":"2023-11-28T20:01:23.818419+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:21.777981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:21.777981+0000","last_clean_scrub_stamp":"2023-11-28T20:01:21.777981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T07:18:14.131202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":15,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-28T20:01:23.812588+0000","last_change":"2023-11-28T20:01:10.537355+0000","last_active":"2023-11-28T20:01:23.812588+0000","last_peered":"2023-11-28T20:01:23.812588+0000","last_clean":"2023-11-28T20:01:23.812588+0000","last_became_active":"2023-11-28T20:01:10.536210+0000","last_became_peered":"2023-11-28T20:01:10.536210+0000","last_unstale":"2023-11-28T20:01:23.812588+0000","last_undegraded":"2023-11-28T20:01:23.812588+0000","last_fullsized":"2023-11-28T20:01:23.812588+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_clean_scrub_stamp":"2023-11-28T20:01:09.480611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T07:05:45.395904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.15","version":"60'3","reported_seq":19,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-28T20:01:23.816541+0000","last_change":"2023-11-28T20:01:09.519066+0000","last_active":"2023-11-28T20:01:23.816541+0000","last_peered":"2023-11-28T20:01:23.816541+0000","last_clean":"2023-11-28T20:01:23.816541+0000","last_became_active":"2023-11-28T20:01:09.518151+0000","last_became_peered":"2023-11-28T20:01:09.518151+0000","last_unstale":"2023-11-28T20:01:23.816541+0000","last_undegraded":"2023-11-28T20:01:23.816541+0000","last_fullsized":"2023-11-28T20:01:23.816541+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:08.474257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:08.474257+0000","last_clean_scrub_stamp":"2023-11-28T20:01:08.474257+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:00:29.783639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.11","version":"0'0","reported_seq":11,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-11-28T20:01:24.819848+0000","last_change":"2023-11-28T20:01:23.819276+0000","last_active":"2023-11-28T20:01:24.819848+0000","last_peered":"2023-11-28T20:01:24.819848+0000","last_clean":"2023-11-28T20:01:24.819848+0000","last_became_active":"2023-11-28T20:01:23.818823+0000","last_became_peered":"2023-11-28T20:01:23.818823+0000","last_unstale":"2023-11-28T20:01:24.819848+0000","last_undegraded":"2023-11-28T20:01:24.819848+0000","last_fullsized":"2023-11-28T20:01:24.819848+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:22.787100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:22.787100+0000","last_clean_scrub_stamp":"2023-11-28T20:01:22.787100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:55:37.434881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":12,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-28T20:01:23.804990+0000","last_change":"2023-11-28T20:01:22.819332+0000","last_active":"2023-11-28T20:01:23.804990+0000","last_peered":"2023-11-28T20:01:23.804990+0000","last_clean":"2023-11-28T20:01:23.804990+0000","last_became_active":"2023-11-28T20:01:22.818798+0000","last_became_peered":"2023-11-28T20:01:22.818798+0000","last_unstale":"2023-11-28T20:01:23.804990+0000","last_undegraded":"2023-11-28T20:01:23.804990+0000","last_fullsized":"2023-11-28T20:01:23.804990+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:21.777981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:21.777981+0000","last_clean_scrub_stamp":"2023-11-28T20:01:21.777981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:19:20.241462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.17","version":"0'0","reported_seq":15,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-28T20:01:23.807287+0000","last_change":"2023-11-28T20:01:10.521819+0000","last_active":"2023-11-28T20:01:23.807287+0000","last_peered":"2023-11-28T20:01:23.807287+0000","last_clean":"2023-11-28T20:01:23.807287+0000","last_became_active":"2023-11-28T20:01:10.521475+0000","last_became_peered":"2023-11-28T20:01:10.521475+0000","last_unstale":"2023-11-28T20:01:23.807287+0000","last_undegraded":"2023-11-28T20:01:23.807287+0000","last_fullsized":"2023-11-28T20:01:23.807287+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_clean_scrub_stamp":"2023-11-28T20:01:09.480611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:16:30.300658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.14","version":"61'8","reported_seq":24,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-28T20:01:23.820331+0000","last_change":"2023-11-28T20:01:09.511176+0000","last_active":"2023-11-28T20:01:23.820331+0000","last_peered":"2023-11-28T20:01:23.820331+0000","last_clean":"2023-11-28T20:01:23.820331+0000","last_became_active":"2023-11-28T20:01:09.510427+0000","last_became_peered":"2023-11-28T20:01:09.510427+0000","last_unstale":"2023-11-28T20:01:23.820331+0000","last_undegraded":"2023-11-28T20:01:23.820331+0000","last_fullsized":"2023-11-28T20:01:23.820331+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:08.474257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:08.474257+0000","last_clean_scrub_stamp":"2023-11-28T20:01:08.474257+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:47:12.268146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3107,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.16","version":"0'0","reported_seq":11,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-11-28T20:01:25.215237+0000","last_change":"2023-11-28T20:01:23.829736+0000","last_active":"2023-11-28T20:01:25.215237+0000","last_peered":"2023-11-28T20:01:25.215237+0000","last_clean":"2023-11-28T20:01:25.215237+0000","last_became_active":"2023-11-28T20:01:23.829453+0000","last_became_peered":"2023-11-28T20:01:23.829453+0000","last_unstale":"2023-11-28T20:01:25.215237+0000","last_undegraded":"2023-11-28T20:01:25.215237+0000","last_fullsized":"2023-11-28T20:01:25.215237+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:22.787100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:22.787100+0000","last_clean_scrub_stamp":"2023-11-28T20:01:22.787100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:02:19.794790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":12,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-28T20:01:23.820514+0000","last_change":"2023-11-28T20:01:22.812353+0000","last_active":"2023-11-28T20:01:23.820514+0000","last_peered":"2023-11-28T20:01:23.820514+0000","last_clean":"2023-11-28T20:01:23.820514+0000","last_became_active":"2023-11-28T20:01:22.812090+0000","last_became_peered":"2023-11-28T20:01:22.812090+0000","last_unstale":"2023-11-28T20:01:23.820514+0000","last_undegraded":"2023-11-28T20:01:23.820514+0000","last_fullsized":"2023-11-28T20:01:23.820514+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:21.777981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:21.777981+0000","last_clean_scrub_stamp":"2023-11-28T20:01:21.777981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:19:40.615029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.10","version":"0'0","reported_seq":15,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-28T20:01:23.802845+0000","last_change":"2023-11-28T20:01:10.533224+0000","last_active":"2023-11-28T20:01:23.802845+0000","last_peered":"2023-11-28T20:01:23.802845+0000","last_clean":"2023-11-28T20:01:23.802845+0000","last_became_active":"2023-11-28T20:01:10.532909+0000","last_became_peered":"2023-11-28T20:01:10.532909+0000","last_unstale":"2023-11-28T20:01:23.802845+0000","last_undegraded":"2023-11-28T20:01:23.802845+0000","last_fullsized":"2023-11-28T20:01:23.802845+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_clean_scrub_stamp":"2023-11-28T20:01:09.480611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:32:06.877460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.13","version":"60'2","reported_seq":18,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-28T20:01:23.815270+0000","last_change":"2023-11-28T20:01:09.518379+0000","last_active":"2023-11-28T20:01:23.815270+0000","last_peered":"2023-11-28T20:01:23.815270+0000","last_clean":"2023-11-28T20:01:23.815270+0000","last_became_active":"2023-11-28T20:01:09.518073+0000","last_became_peered":"2023-11-28T20:01:09.518073+0000","last_unstale":"2023-11-28T20:01:23.815270+0000","last_undegraded":"2023-11-28T20:01:23.815270+0000","last_fullsized":"2023-11-28T20:01:23.815270+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:08.474257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:08.474257+0000","last_clean_scrub_stamp":"2023-11-28T20:01:08.474257+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:11:07.788160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.17","version":"0'0","reported_seq":11,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-11-28T20:01:25.215210+0000","last_change":"2023-11-28T20:01:23.838090+0000","last_active":"2023-11-28T20:01:25.215210+0000","last_peered":"2023-11-28T20:01:25.215210+0000","last_clean":"2023-11-28T20:01:25.215210+0000","last_became_active":"2023-11-28T20:01:23.837834+0000","last_became_peered":"2023-11-28T20:01:23.837834+0000","last_unstale":"2023-11-28T20:01:25.215210+0000","last_undegraded":"2023-11-28T20:01:25.215210+0000","last_fullsized":"2023-11-28T20:01:25.215210+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:22.787100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:22.787100+0000","last_clean_scrub_stamp":"2023-11-28T20:01:22.787100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:51:50.031028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.10","version":"64'8","reported_seq":20,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-28T20:01:23.837955+0000","last_change":"2023-11-28T20:01:22.818135+0000","last_active":"2023-11-28T20:01:23.837955+0000","last_peered":"2023-11-28T20:01:23.837955+0000","last_clean":"2023-11-28T20:01:23.837955+0000","last_became_active":"2023-11-28T20:01:22.817952+0000","last_became_peered":"2023-11-28T20:01:22.817952+0000","last_unstale":"2023-11-28T20:01:23.837955+0000","last_undegraded":"2023-11-28T20:01:23.837955+0000","last_fullsized":"2023-11-28T20:01:23.837955+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:21.777981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:21.777981+0000","last_clean_scrub_stamp":"2023-11-28T20:01:21.777981+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:39:31.956432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":15,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-28T20:01:23.803733+0000","last_change":"2023-11-28T20:01:10.520948+0000","last_active":"2023-11-28T20:01:23.803733+0000","last_peered":"2023-11-28T20:01:23.803733+0000","last_clean":"2023-11-28T20:01:23.803733+0000","last_became_active":"2023-11-28T20:01:10.520649+0000","last_became_peered":"2023-11-28T20:01:10.520649+0000","last_unstale":"2023-11-28T20:01:23.803733+0000","last_undegraded":"2023-11-28T20:01:23.803733+0000","last_fullsized":"2023-11-28T20:01:23.803733+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_clean_scrub_stamp":"2023-11-28T20:01:09.480611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:10:34.830531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":16,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-28T20:01:23.804496+0000","last_change":"2023-11-28T20:01:09.510604+0000","last_active":"2023-11-28T20:01:23.804496+0000","last_peered":"2023-11-28T20:01:23.804496+0000","last_clean":"2023-11-28T20:01:23.804496+0000","last_became_active":"2023-11-28T20:01:09.510326+0000","last_became_peered":"2023-11-28T20:01:09.510326+0000","last_unstale":"2023-11-28T20:01:23.804496+0000","last_undegraded":"2023-11-28T20:01:23.804496+0000","last_fullsized":"2023-11-28T20:01:23.804496+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:08.474257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:08.474257+0000","last_clean_scrub_stamp":"2023-11-28T20:01:08.474257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:56:14.988591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.14","version":"0'0","reported_seq":11,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-11-28T20:01:24.821264+0000","last_change":"2023-11-28T20:01:23.825236+0000","last_active":"2023-11-28T20:01:24.821264+0000","last_peered":"2023-11-28T20:01:24.821264+0000","last_clean":"2023-11-28T20:01:24.821264+0000","last_became_active":"2023-11-28T20:01:23.824908+0000","last_became_peered":"2023-11-28T20:01:23.824908+0000","last_unstale":"2023-11-28T20:01:24.821264+0000","last_undegraded":"2023-11-28T20:01:24.821264+0000","last_fullsized":"2023-11-28T20:01:24.821264+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:22.787100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:22.787100+0000","last_clean_scrub_stamp":"2023-11-28T20:01:22.787100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:05:02.784780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.13","version":"64'2","reported_seq":14,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-28T20:01:23.836428+0000","last_change":"2023-11-28T20:01:22.820361+0000","last_active":"2023-11-28T20:01:23.836428+0000","last_peered":"2023-11-28T20:01:23.836428+0000","last_clean":"2023-11-28T20:01:23.836428+0000","last_became_active":"2023-11-28T20:01:22.820048+0000","last_became_peered":"2023-11-28T20:01:22.820048+0000","last_unstale":"2023-11-28T20:01:23.836428+0000","last_undegraded":"2023-11-28T20:01:23.836428+0000","last_fullsized":"2023-11-28T20:01:23.836428+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:21.777981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:21.777981+0000","last_clean_scrub_stamp":"2023-11-28T20:01:21.777981+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:00:29.911428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":15,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-28T20:01:23.811111+0000","last_change":"2023-11-28T20:01:10.527110+0000","last_active":"2023-11-28T20:01:23.811111+0000","last_peered":"2023-11-28T20:01:23.811111+0000","last_clean":"2023-11-28T20:01:23.811111+0000","last_became_active":"2023-11-28T20:01:10.525827+0000","last_became_peered":"2023-11-28T20:01:10.525827+0000","last_unstale":"2023-11-28T20:01:23.811111+0000","last_undegraded":"2023-11-28T20:01:23.811111+0000","last_fullsized":"2023-11-28T20:01:23.811111+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_clean_scrub_stamp":"2023-11-28T20:01:09.480611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:23:02.818476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":16,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-28T20:01:23.814732+0000","last_change":"2023-11-28T20:01:09.519626+0000","last_active":"2023-11-28T20:01:23.814732+0000","last_peered":"2023-11-28T20:01:23.814732+0000","last_clean":"2023-11-28T20:01:23.814732+0000","last_became_active":"2023-11-28T20:01:09.519349+0000","last_became_peered":"2023-11-28T20:01:09.519349+0000","last_unstale":"2023-11-28T20:01:23.814732+0000","last_undegraded":"2023-11-28T20:01:23.814732+0000","last_fullsized":"2023-11-28T20:01:23.814732+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:08.474257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:08.474257+0000","last_clean_scrub_stamp":"2023-11-28T20:01:08.474257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:04:51.492194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.15","version":"0'0","reported_seq":11,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-11-28T20:01:25.214666+0000","last_change":"2023-11-28T20:01:23.833951+0000","last_active":"2023-11-28T20:01:25.214666+0000","last_peered":"2023-11-28T20:01:25.214666+0000","last_clean":"2023-11-28T20:01:25.214666+0000","last_became_active":"2023-11-28T20:01:23.833667+0000","last_became_peered":"2023-11-28T20:01:23.833667+0000","last_unstale":"2023-11-28T20:01:25.214666+0000","last_undegraded":"2023-11-28T20:01:25.214666+0000","last_fullsized":"2023-11-28T20:01:25.214666+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:22.787100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:22.787100+0000","last_clean_scrub_stamp":"2023-11-28T20:01:22.787100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:30:51.611492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.12","version":"0'0","reported_seq":12,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-28T20:01:23.814447+0000","last_change":"2023-11-28T20:01:22.826285+0000","last_active":"2023-11-28T20:01:23.814447+0000","last_peered":"2023-11-28T20:01:23.814447+0000","last_clean":"2023-11-28T20:01:23.814447+0000","last_became_active":"2023-11-28T20:01:22.825975+0000","last_became_peered":"2023-11-28T20:01:22.825975+0000","last_unstale":"2023-11-28T20:01:23.814447+0000","last_undegraded":"2023-11-28T20:01:23.814447+0000","last_fullsized":"2023-11-28T20:01:23.814447+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:21.777981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:21.777981+0000","last_clean_scrub_stamp":"2023-11-28T20:01:21.777981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:19:20.241462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.13","version":"0'0","reported_seq":15,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-28T20:01:23.819252+0000","last_change":"2023-11-28T20:01:10.535178+0000","last_active":"2023-11-28T20:01:23.819252+0000","last_peered":"2023-11-28T20:01:23.819252+0000","last_clean":"2023-11-28T20:01:23.819252+0000","last_became_active":"2023-11-28T20:01:10.534880+0000","last_became_peered":"2023-11-28T20:01:10.534880+0000","last_unstale":"2023-11-28T20:01:23.819252+0000","last_undegraded":"2023-11-28T20:01:23.819252+0000","last_fullsized":"2023-11-28T20:01:23.819252+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_clean_scrub_stamp":"2023-11-28T20:01:09.480611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:52:42.741966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.10","version":"60'8","reported_seq":24,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-28T20:01:23.802957+0000","last_change":"2023-11-28T20:01:09.511628+0000","last_active":"2023-11-28T20:01:23.802957+0000","last_peered":"2023-11-28T20:01:23.802957+0000","last_clean":"2023-11-28T20:01:23.802957+0000","last_became_active":"2023-11-28T20:01:09.511250+0000","last_became_peered":"2023-11-28T20:01:09.511250+0000","last_unstale":"2023-11-28T20:01:23.802957+0000","last_undegraded":"2023-11-28T20:01:23.802957+0000","last_fullsized":"2023-11-28T20:01:23.802957+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:08.474257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:08.474257+0000","last_clean_scrub_stamp":"2023-11-28T20:01:08.474257+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:35:34.107408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.a","version":"0'0","reported_seq":11,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-11-28T20:01:25.215793+0000","last_change":"2023-11-28T20:01:23.840312+0000","last_active":"2023-11-28T20:01:25.215793+0000","last_peered":"2023-11-28T20:01:25.215793+0000","last_clean":"2023-11-28T20:01:25.215793+0000","last_became_active":"2023-11-28T20:01:23.839255+0000","last_became_peered":"2023-11-28T20:01:23.839255+0000","last_unstale":"2023-11-28T20:01:25.215793+0000","last_undegraded":"2023-11-28T20:01:25.215793+0000","last_fullsized":"2023-11-28T20:01:25.215793+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:22.787100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:22.787100+0000","last_clean_scrub_stamp":"2023-11-28T20:01:22.787100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:33:30.652006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.d","version":"64'1","reported_seq":13,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-28T20:01:23.838428+0000","last_change":"2023-11-28T20:01:22.818834+0000","last_active":"2023-11-28T20:01:23.838428+0000","last_peered":"2023-11-28T20:01:23.838428+0000","last_clean":"2023-11-28T20:01:23.838428+0000","last_became_active":"2023-11-28T20:01:22.818391+0000","last_became_peered":"2023-11-28T20:01:22.818391+0000","last_unstale":"2023-11-28T20:01:23.838428+0000","last_undegraded":"2023-11-28T20:01:23.838428+0000","last_fullsized":"2023-11-28T20:01:23.838428+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:21.777981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:21.777981+0000","last_clean_scrub_stamp":"2023-11-28T20:01:21.777981+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:03:53.346521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":15,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-28T20:01:23.815288+0000","last_change":"2023-11-28T20:01:10.537164+0000","last_active":"2023-11-28T20:01:23.815288+0000","last_peered":"2023-11-28T20:01:23.815288+0000","last_clean":"2023-11-28T20:01:23.815288+0000","last_became_active":"2023-11-28T20:01:10.536893+0000","last_became_peered":"2023-11-28T20:01:10.536893+0000","last_unstale":"2023-11-28T20:01:23.815288+0000","last_undegraded":"2023-11-28T20:01:23.815288+0000","last_fullsized":"2023-11-28T20:01:23.815288+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_clean_scrub_stamp":"2023-11-28T20:01:09.480611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:50:58.589965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.f","version":"60'1","reported_seq":17,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-28T20:01:23.805097+0000","last_change":"2023-11-28T20:01:09.510018+0000","last_active":"2023-11-28T20:01:23.805097+0000","last_peered":"2023-11-28T20:01:23.805097+0000","last_clean":"2023-11-28T20:01:23.805097+0000","last_became_active":"2023-11-28T20:01:09.509743+0000","last_became_peered":"2023-11-28T20:01:09.509743+0000","last_unstale":"2023-11-28T20:01:23.805097+0000","last_undegraded":"2023-11-28T20:01:23.805097+0000","last_fullsized":"2023-11-28T20:01:23.805097+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:08.474257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:08.474257+0000","last_clean_scrub_stamp":"2023-11-28T20:01:08.474257+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:09:59.028591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.b","version":"0'0","reported_seq":11,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-11-28T20:01:25.212729+0000","last_change":"2023-11-28T20:01:23.830786+0000","last_active":"2023-11-28T20:01:25.212729+0000","last_peered":"2023-11-28T20:01:25.212729+0000","last_clean":"2023-11-28T20:01:25.212729+0000","last_became_active":"2023-11-28T20:01:23.830501+0000","last_became_peered":"2023-11-28T20:01:23.830501+0000","last_unstale":"2023-11-28T20:01:25.212729+0000","last_undegraded":"2023-11-28T20:01:25.212729+0000","last_fullsized":"2023-11-28T20:01:25.212729+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:22.787100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:22.787100+0000","last_clean_scrub_stamp":"2023-11-28T20:01:22.787100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:54:52.693309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":12,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-28T20:01:23.820018+0000","last_change":"2023-11-28T20:01:22.817493+0000","last_active":"2023-11-28T20:01:23.820018+0000","last_peered":"2023-11-28T20:01:23.820018+0000","last_clean":"2023-11-28T20:01:23.820018+0000","last_became_active":"2023-11-28T20:01:22.817204+0000","last_became_peered":"2023-11-28T20:01:22.817204+0000","last_unstale":"2023-11-28T20:01:23.820018+0000","last_undegraded":"2023-11-28T20:01:23.820018+0000","last_fullsized":"2023-11-28T20:01:23.820018+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:21.777981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:21.777981+0000","last_clean_scrub_stamp":"2023-11-28T20:01:21.777981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:17:39.395256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.d","version":"0'0","reported_seq":15,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-28T20:01:23.812645+0000","last_change":"2023-11-28T20:01:10.537543+0000","last_active":"2023-11-28T20:01:23.812645+0000","last_peered":"2023-11-28T20:01:23.812645+0000","last_clean":"2023-11-28T20:01:23.812645+0000","last_became_active":"2023-11-28T20:01:10.537307+0000","last_became_peered":"2023-11-28T20:01:10.537307+0000","last_unstale":"2023-11-28T20:01:23.812645+0000","last_undegraded":"2023-11-28T20:01:23.812645+0000","last_fullsized":"2023-11-28T20:01:23.812645+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_clean_scrub_stamp":"2023-11-28T20:01:09.480611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:04:52.498548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.e","version":"60'2","reported_seq":18,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-28T20:01:23.820621+0000","last_change":"2023-11-28T20:01:09.519130+0000","last_active":"2023-11-28T20:01:23.820621+0000","last_peered":"2023-11-28T20:01:23.820621+0000","last_clean":"2023-11-28T20:01:23.820621+0000","last_became_active":"2023-11-28T20:01:09.517725+0000","last_became_peered":"2023-11-28T20:01:09.517725+0000","last_unstale":"2023-11-28T20:01:23.820621+0000","last_undegraded":"2023-11-28T20:01:23.820621+0000","last_fullsized":"2023-11-28T20:01:23.820621+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:08.474257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:08.474257+0000","last_clean_scrub_stamp":"2023-11-28T20:01:08.474257+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:05:31.573692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.8","version":"0'0","reported_seq":11,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-11-28T20:01:25.212501+0000","last_change":"2023-11-28T20:01:23.828463+0000","last_active":"2023-11-28T20:01:25.212501+0000","last_peered":"2023-11-28T20:01:25.212501+0000","last_clean":"2023-11-28T20:01:25.212501+0000","last_became_active":"2023-11-28T20:01:23.828210+0000","last_became_peered":"2023-11-28T20:01:23.828210+0000","last_unstale":"2023-11-28T20:01:25.212501+0000","last_undegraded":"2023-11-28T20:01:25.212501+0000","last_fullsized":"2023-11-28T20:01:25.212501+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:22.787100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:22.787100+0000","last_clean_scrub_stamp":"2023-11-28T20:01:22.787100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:25:23.868917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.f","version":"64'1","reported_seq":13,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-28T20:01:23.836257+0000","last_change":"2023-11-28T20:01:22.830040+0000","last_active":"2023-11-28T20:01:23.836257+0000","last_peered":"2023-11-28T20:01:23.836257+0000","last_clean":"2023-11-28T20:01:23.836257+0000","last_became_active":"2023-11-28T20:01:22.829736+0000","last_became_peered":"2023-11-28T20:01:22.829736+0000","last_unstale":"2023-11-28T20:01:23.836257+0000","last_undegraded":"2023-11-28T20:01:23.836257+0000","last_fullsized":"2023-11-28T20:01:23.836257+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:21.777981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:21.777981+0000","last_clean_scrub_stamp":"2023-11-28T20:01:21.777981+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:36:29.070736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.e","version":"0'0","reported_seq":15,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-28T20:01:23.806709+0000","last_change":"2023-11-28T20:01:10.530449+0000","last_active":"2023-11-28T20:01:23.806709+0000","last_peered":"2023-11-28T20:01:23.806709+0000","last_clean":"2023-11-28T20:01:23.806709+0000","last_became_active":"2023-11-28T20:01:10.530169+0000","last_became_peered":"2023-11-28T20:01:10.530169+0000","last_unstale":"2023-11-28T20:01:23.806709+0000","last_undegraded":"2023-11-28T20:01:23.806709+0000","last_fullsized":"2023-11-28T20:01:23.806709+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_clean_scrub_stamp":"2023-11-28T20:01:09.480611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:01:36.330362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.d","version":"60'1","reported_seq":17,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-28T20:01:23.816633+0000","last_change":"2023-11-28T20:01:09.519252+0000","last_active":"2023-11-28T20:01:23.816633+0000","last_peered":"2023-11-28T20:01:23.816633+0000","last_clean":"2023-11-28T20:01:23.816633+0000","last_became_active":"2023-11-28T20:01:09.518511+0000","last_became_peered":"2023-11-28T20:01:09.518511+0000","last_unstale":"2023-11-28T20:01:23.816633+0000","last_undegraded":"2023-11-28T20:01:23.816633+0000","last_fullsized":"2023-11-28T20:01:23.816633+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:08.474257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:08.474257+0000","last_clean_scrub_stamp":"2023-11-28T20:01:08.474257+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:52:41.735612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.9","version":"0'0","reported_seq":11,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-11-28T20:01:25.215615+0000","last_change":"2023-11-28T20:01:23.829555+0000","last_active":"2023-11-28T20:01:25.215615+0000","last_peered":"2023-11-28T20:01:25.215615+0000","last_clean":"2023-11-28T20:01:25.215615+0000","last_became_active":"2023-11-28T20:01:23.829183+0000","last_became_peered":"2023-11-28T20:01:23.829183+0000","last_unstale":"2023-11-28T20:01:25.215615+0000","last_undegraded":"2023-11-28T20:01:25.215615+0000","last_fullsized":"2023-11-28T20:01:25.215615+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:22.787100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:22.787100+0000","last_clean_scrub_stamp":"2023-11-28T20:01:22.787100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:57:08.404405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.e","version":"64'2","reported_seq":14,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-28T20:01:23.837116+0000","last_change":"2023-11-28T20:01:22.819046+0000","last_active":"2023-11-28T20:01:23.837116+0000","last_peered":"2023-11-28T20:01:23.837116+0000","last_clean":"2023-11-28T20:01:23.837116+0000","last_became_active":"2023-11-28T20:01:22.818775+0000","last_became_peered":"2023-11-28T20:01:22.818775+0000","last_unstale":"2023-11-28T20:01:23.837116+0000","last_undegraded":"2023-11-28T20:01:23.837116+0000","last_fullsized":"2023-11-28T20:01:23.837116+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:21.777981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:21.777981+0000","last_clean_scrub_stamp":"2023-11-28T20:01:21.777981+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:10:12.332315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.f","version":"0'0","reported_seq":15,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-28T20:01:23.814337+0000","last_change":"2023-11-28T20:01:10.523973+0000","last_active":"2023-11-28T20:01:23.814337+0000","last_peered":"2023-11-28T20:01:23.814337+0000","last_clean":"2023-11-28T20:01:23.814337+0000","last_became_active":"2023-11-28T20:01:10.523676+0000","last_became_peered":"2023-11-28T20:01:10.523676+0000","last_unstale":"2023-11-28T20:01:23.814337+0000","last_undegraded":"2023-11-28T20:01:23.814337+0000","last_fullsized":"2023-11-28T20:01:23.814337+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_clean_scrub_stamp":"2023-11-28T20:01:09.480611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:49:36.861168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":16,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-28T20:01:23.803269+0000","last_change":"2023-11-28T20:01:09.514931+0000","last_active":"2023-11-28T20:01:23.803269+0000","last_peered":"2023-11-28T20:01:23.803269+0000","last_clean":"2023-11-28T20:01:23.803269+0000","last_became_active":"2023-11-28T20:01:09.514702+0000","last_became_peered":"2023-11-28T20:01:09.514702+0000","last_unstale":"2023-11-28T20:01:23.803269+0000","last_undegraded":"2023-11-28T20:01:23.803269+0000","last_fullsized":"2023-11-28T20:01:23.803269+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:08.474257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:08.474257+0000","last_clean_scrub_stamp":"2023-11-28T20:01:08.474257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:30:37.298649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.e","version":"0'0","reported_seq":11,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-11-28T20:01:24.819843+0000","last_change":"2023-11-28T20:01:23.826931+0000","last_active":"2023-11-28T20:01:24.819843+0000","last_peered":"2023-11-28T20:01:24.819843+0000","last_clean":"2023-11-28T20:01:24.819843+0000","last_became_active":"2023-11-28T20:01:23.826687+0000","last_became_peered":"2023-11-28T20:01:23.826687+0000","last_unstale":"2023-11-28T20:01:24.819843+0000","last_undegraded":"2023-11-28T20:01:24.819843+0000","last_fullsized":"2023-11-28T20:01:24.819843+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:22.787100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:22.787100+0000","last_clean_scrub_stamp":"2023-11-28T20:01:22.787100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:54:52.693309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.9","version":"0'0","reported_seq":12,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-28T20:01:23.800539+0000","last_change":"2023-11-28T20:01:22.816218+0000","last_active":"2023-11-28T20:01:23.800539+0000","last_peered":"2023-11-28T20:01:23.800539+0000","last_clean":"2023-11-28T20:01:23.800539+0000","last_became_active":"2023-11-28T20:01:22.815903+0000","last_became_peered":"2023-11-28T20:01:22.815903+0000","last_unstale":"2023-11-28T20:01:23.800539+0000","last_undegraded":"2023-11-28T20:01:23.800539+0000","last_fullsized":"2023-11-28T20:01:23.800539+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:21.777981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:21.777981+0000","last_clean_scrub_stamp":"2023-11-28T20:01:21.777981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T07:18:14.131202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":15,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-28T20:01:23.808619+0000","last_change":"2023-11-28T20:01:10.525003+0000","last_active":"2023-11-28T20:01:23.808619+0000","last_peered":"2023-11-28T20:01:23.808619+0000","last_clean":"2023-11-28T20:01:23.808619+0000","last_became_active":"2023-11-28T20:01:10.524411+0000","last_became_peered":"2023-11-28T20:01:10.524411+0000","last_unstale":"2023-11-28T20:01:23.808619+0000","last_undegraded":"2023-11-28T20:01:23.808619+0000","last_fullsized":"2023-11-28T20:01:23.808619+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_clean_scrub_stamp":"2023-11-28T20:01:09.480611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:17:27.097887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.b","version":"60'2","reported_seq":18,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-28T20:01:23.811144+0000","last_change":"2023-11-28T20:01:09.511026+0000","last_active":"2023-11-28T20:01:23.811144+0000","last_peered":"2023-11-28T20:01:23.811144+0000","last_clean":"2023-11-28T20:01:23.811144+0000","last_became_active":"2023-11-28T20:01:09.510765+0000","last_became_peered":"2023-11-28T20:01:09.510765+0000","last_unstale":"2023-11-28T20:01:23.811144+0000","last_undegraded":"2023-11-28T20:01:23.811144+0000","last_fullsized":"2023-11-28T20:01:23.811144+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:08.474257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:08.474257+0000","last_clean_scrub_stamp":"2023-11-28T20:01:08.474257+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:06:35.988462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.f","version":"0'0","reported_seq":11,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-11-28T20:01:25.215217+0000","last_change":"2023-11-28T20:01:23.826864+0000","last_active":"2023-11-28T20:01:25.215217+0000","last_peered":"2023-11-28T20:01:25.215217+0000","last_clean":"2023-11-28T20:01:25.215217+0000","last_became_active":"2023-11-28T20:01:23.826511+0000","last_became_peered":"2023-11-28T20:01:23.826511+0000","last_unstale":"2023-11-28T20:01:25.215217+0000","last_undegraded":"2023-11-28T20:01:25.215217+0000","last_fullsized":"2023-11-28T20:01:25.215217+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:22.787100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:22.787100+0000","last_clean_scrub_stamp":"2023-11-28T20:01:22.787100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:02:44.263239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":12,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-28T20:01:23.800137+0000","last_change":"2023-11-28T20:01:22.818671+0000","last_active":"2023-11-28T20:01:23.800137+0000","last_peered":"2023-11-28T20:01:23.800137+0000","last_clean":"2023-11-28T20:01:23.800137+0000","last_became_active":"2023-11-28T20:01:22.818413+0000","last_became_peered":"2023-11-28T20:01:22.818413+0000","last_unstale":"2023-11-28T20:01:23.800137+0000","last_undegraded":"2023-11-28T20:01:23.800137+0000","last_fullsized":"2023-11-28T20:01:23.800137+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:21.777981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:21.777981+0000","last_clean_scrub_stamp":"2023-11-28T20:01:21.777981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:12:59.650423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":15,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-28T20:01:23.803796+0000","last_change":"2023-11-28T20:01:10.523842+0000","last_active":"2023-11-28T20:01:23.803796+0000","last_peered":"2023-11-28T20:01:23.803796+0000","last_clean":"2023-11-28T20:01:23.803796+0000","last_became_active":"2023-11-28T20:01:10.523553+0000","last_became_peered":"2023-11-28T20:01:10.523553+0000","last_unstale":"2023-11-28T20:01:23.803796+0000","last_undegraded":"2023-11-28T20:01:23.803796+0000","last_fullsized":"2023-11-28T20:01:23.803796+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_clean_scrub_stamp":"2023-11-28T20:01:09.480611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T07:34:37.174623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":16,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-28T20:01:23.804585+0000","last_change":"2023-11-28T20:01:09.510719+0000","last_active":"2023-11-28T20:01:23.804585+0000","last_peered":"2023-11-28T20:01:23.804585+0000","last_clean":"2023-11-28T20:01:23.804585+0000","last_became_active":"2023-11-28T20:01:09.509874+0000","last_became_peered":"2023-11-28T20:01:09.509874+0000","last_unstale":"2023-11-28T20:01:23.804585+0000","last_undegraded":"2023-11-28T20:01:23.804585+0000","last_fullsized":"2023-11-28T20:01:23.804585+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:08.474257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:08.474257+0000","last_clean_scrub_stamp":"2023-11-28T20:01:08.474257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:21:20.189227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.c","version":"0'0","reported_seq":11,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-11-28T20:01:24.819611+0000","last_change":"2023-11-28T20:01:23.819446+0000","last_active":"2023-11-28T20:01:24.819611+0000","last_peered":"2023-11-28T20:01:24.819611+0000","last_clean":"2023-11-28T20:01:24.819611+0000","last_became_active":"2023-11-28T20:01:23.819132+0000","last_became_peered":"2023-11-28T20:01:23.819132+0000","last_unstale":"2023-11-28T20:01:24.819611+0000","last_undegraded":"2023-11-28T20:01:24.819611+0000","last_fullsized":"2023-11-28T20:01:24.819611+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:22.787100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:22.787100+0000","last_clean_scrub_stamp":"2023-11-28T20:01:22.787100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:47:59.097311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.b","version":"64'2","reported_seq":14,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-28T20:01:23.836280+0000","last_change":"2023-11-28T20:01:22.821826+0000","last_active":"2023-11-28T20:01:23.836280+0000","last_peered":"2023-11-28T20:01:23.836280+0000","last_clean":"2023-11-28T20:01:23.836280+0000","last_became_active":"2023-11-28T20:01:22.821548+0000","last_became_peered":"2023-11-28T20:01:22.821548+0000","last_unstale":"2023-11-28T20:01:23.836280+0000","last_undegraded":"2023-11-28T20:01:23.836280+0000","last_fullsized":"2023-11-28T20:01:23.836280+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:21.777981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:21.777981+0000","last_clean_scrub_stamp":"2023-11-28T20:01:21.777981+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:42:12.961719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":15,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-28T20:01:23.811193+0000","last_change":"2023-11-28T20:01:10.530042+0000","last_active":"2023-11-28T20:01:23.811193+0000","last_peered":"2023-11-28T20:01:23.811193+0000","last_clean":"2023-11-28T20:01:23.811193+0000","last_became_active":"2023-11-28T20:01:10.529745+0000","last_became_peered":"2023-11-28T20:01:10.529745+0000","last_unstale":"2023-11-28T20:01:23.811193+0000","last_undegraded":"2023-11-28T20:01:23.811193+0000","last_fullsized":"2023-11-28T20:01:23.811193+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_clean_scrub_stamp":"2023-11-28T20:01:09.480611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:18:17.108795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":16,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-28T20:01:23.810924+0000","last_change":"2023-11-28T20:01:09.512327+0000","last_active":"2023-11-28T20:01:23.810924+0000","last_peered":"2023-11-28T20:01:23.810924+0000","last_clean":"2023-11-28T20:01:23.810924+0000","last_became_active":"2023-11-28T20:01:09.512065+0000","last_became_peered":"2023-11-28T20:01:09.512065+0000","last_unstale":"2023-11-28T20:01:23.810924+0000","last_undegraded":"2023-11-28T20:01:23.810924+0000","last_fullsized":"2023-11-28T20:01:23.810924+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:08.474257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:08.474257+0000","last_clean_scrub_stamp":"2023-11-28T20:01:08.474257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:46:28.694684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.2","version":"0'0","reported_seq":11,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-11-28T20:01:24.819297+0000","last_change":"2023-11-28T20:01:23.826477+0000","last_active":"2023-11-28T20:01:24.819297+0000","last_peered":"2023-11-28T20:01:24.819297+0000","last_clean":"2023-11-28T20:01:24.819297+0000","last_became_active":"2023-11-28T20:01:23.826203+0000","last_became_peered":"2023-11-28T20:01:23.826203+0000","last_unstale":"2023-11-28T20:01:24.819297+0000","last_undegraded":"2023-11-28T20:01:24.819297+0000","last_fullsized":"2023-11-28T20:01:24.819297+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:22.787100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:22.787100+0000","last_clean_scrub_stamp":"2023-11-28T20:01:22.787100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:05:45.886534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.5","version":"0'0","reported_seq":12,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-28T20:01:23.816010+0000","last_change":"2023-11-28T20:01:22.828000+0000","last_active":"2023-11-28T20:01:23.816010+0000","last_peered":"2023-11-28T20:01:23.816010+0000","last_clean":"2023-11-28T20:01:23.816010+0000","last_became_active":"2023-11-28T20:01:22.827704+0000","last_became_peered":"2023-11-28T20:01:22.827704+0000","last_unstale":"2023-11-28T20:01:23.816010+0000","last_undegraded":"2023-11-28T20:01:23.816010+0000","last_fullsized":"2023-11-28T20:01:23.816010+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:21.777981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:21.777981+0000","last_clean_scrub_stamp":"2023-11-28T20:01:21.777981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:05:01.775661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":15,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-28T20:01:23.812860+0000","last_change":"2023-11-28T20:01:10.526165+0000","last_active":"2023-11-28T20:01:23.812860+0000","last_peered":"2023-11-28T20:01:23.812860+0000","last_clean":"2023-11-28T20:01:23.812860+0000","last_became_active":"2023-11-28T20:01:10.525619+0000","last_became_peered":"2023-11-28T20:01:10.525619+0000","last_unstale":"2023-11-28T20:01:23.812860+0000","last_undegraded":"2023-11-28T20:01:23.812860+0000","last_fullsized":"2023-11-28T20:01:23.812860+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_clean_scrub_stamp":"2023-11-28T20:01:09.480611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:54:30.269337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.7","version":"60'2","reported_seq":18,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-28T20:01:23.805304+0000","last_change":"2023-11-28T20:01:09.514831+0000","last_active":"2023-11-28T20:01:23.805304+0000","last_peered":"2023-11-28T20:01:23.805304+0000","last_clean":"2023-11-28T20:01:23.805304+0000","last_became_active":"2023-11-28T20:01:09.514525+0000","last_became_peered":"2023-11-28T20:01:09.514525+0000","last_unstale":"2023-11-28T20:01:23.805304+0000","last_undegraded":"2023-11-28T20:01:23.805304+0000","last_fullsized":"2023-11-28T20:01:23.805304+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:08.474257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:08.474257+0000","last_clean_scrub_stamp":"2023-11-28T20:01:08.474257+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:05:31.573692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.3","version":"0'0","reported_seq":11,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-11-28T20:01:24.819533+0000","last_change":"2023-11-28T20:01:23.828082+0000","last_active":"2023-11-28T20:01:24.819533+0000","last_peered":"2023-11-28T20:01:24.819533+0000","last_clean":"2023-11-28T20:01:24.819533+0000","last_became_active":"2023-11-28T20:01:23.827827+0000","last_became_peered":"2023-11-28T20:01:23.827827+0000","last_unstale":"2023-11-28T20:01:24.819533+0000","last_undegraded":"2023-11-28T20:01:24.819533+0000","last_fullsized":"2023-11-28T20:01:24.819533+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:22.787100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:22.787100+0000","last_clean_scrub_stamp":"2023-11-28T20:01:22.787100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T06:19:52.978004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":12,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-28T20:01:23.815150+0000","last_change":"2023-11-28T20:01:22.827963+0000","last_active":"2023-11-28T20:01:23.815150+0000","last_peered":"2023-11-28T20:01:23.815150+0000","last_clean":"2023-11-28T20:01:23.815150+0000","last_became_active":"2023-11-28T20:01:22.827652+0000","last_became_peered":"2023-11-28T20:01:22.827652+0000","last_unstale":"2023-11-28T20:01:23.815150+0000","last_undegraded":"2023-11-28T20:01:23.815150+0000","last_fullsized":"2023-11-28T20:01:23.815150+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:21.777981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:21.777981+0000","last_clean_scrub_stamp":"2023-11-28T20:01:21.777981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:55:36.425762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":15,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-28T20:01:23.822686+0000","last_change":"2023-11-28T20:01:10.533050+0000","last_active":"2023-11-28T20:01:23.822686+0000","last_peered":"2023-11-28T20:01:23.822686+0000","last_clean":"2023-11-28T20:01:23.822686+0000","last_became_active":"2023-11-28T20:01:10.532590+0000","last_became_peered":"2023-11-28T20:01:10.532590+0000","last_unstale":"2023-11-28T20:01:23.822686+0000","last_undegraded":"2023-11-28T20:01:23.822686+0000","last_fullsized":"2023-11-28T20:01:23.822686+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_clean_scrub_stamp":"2023-11-28T20:01:09.480611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T07:29:30.339936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.6","version":"61'1","reported_seq":17,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-28T20:01:23.805683+0000","last_change":"2023-11-28T20:01:09.510397+0000","last_active":"2023-11-28T20:01:23.805683+0000","last_peered":"2023-11-28T20:01:23.805683+0000","last_clean":"2023-11-28T20:01:23.805683+0000","last_became_active":"2023-11-28T20:01:09.510136+0000","last_became_peered":"2023-11-28T20:01:09.510136+0000","last_unstale":"2023-11-28T20:01:23.805683+0000","last_undegraded":"2023-11-28T20:01:23.805683+0000","last_fullsized":"2023-11-28T20:01:23.805683+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:08.474257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:08.474257+0000","last_clean_scrub_stamp":"2023-11-28T20:01:08.474257+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:18:48.620687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.0","version":"0'0","reported_seq":11,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-11-28T20:01:24.819127+0000","last_change":"2023-11-28T20:01:23.824112+0000","last_active":"2023-11-28T20:01:24.819127+0000","last_peered":"2023-11-28T20:01:24.819127+0000","last_clean":"2023-11-28T20:01:24.819127+0000","last_became_active":"2023-11-28T20:01:23.821373+0000","last_became_peered":"2023-11-28T20:01:23.821373+0000","last_unstale":"2023-11-28T20:01:24.819127+0000","last_undegraded":"2023-11-28T20:01:24.819127+0000","last_fullsized":"2023-11-28T20:01:24.819127+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:22.787100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:22.787100+0000","last_clean_scrub_stamp":"2023-11-28T20:01:22.787100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:19:02.933529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.7","version":"64'2","reported_seq":14,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-28T20:01:23.836192+0000","last_change":"2023-11-28T20:01:22.825335+0000","last_active":"2023-11-28T20:01:23.836192+0000","last_peered":"2023-11-28T20:01:23.836192+0000","last_clean":"2023-11-28T20:01:23.836192+0000","last_became_active":"2023-11-28T20:01:22.825033+0000","last_became_peered":"2023-11-28T20:01:22.825033+0000","last_unstale":"2023-11-28T20:01:23.836192+0000","last_undegraded":"2023-11-28T20:01:23.836192+0000","last_fullsized":"2023-11-28T20:01:23.836192+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:21.777981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:21.777981+0000","last_clean_scrub_stamp":"2023-11-28T20:01:21.777981+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:20:44.093161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.6","version":"0'0","reported_seq":15,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-28T20:01:23.805452+0000","last_change":"2023-11-28T20:01:10.530096+0000","last_active":"2023-11-28T20:01:23.805452+0000","last_peered":"2023-11-28T20:01:23.805452+0000","last_clean":"2023-11-28T20:01:23.805452+0000","last_became_active":"2023-11-28T20:01:10.529472+0000","last_became_peered":"2023-11-28T20:01:10.529472+0000","last_unstale":"2023-11-28T20:01:23.805452+0000","last_undegraded":"2023-11-28T20:01:23.805452+0000","last_fullsized":"2023-11-28T20:01:23.805452+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_clean_scrub_stamp":"2023-11-28T20:01:09.480611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T06:29:13.579326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":16,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-28T20:01:23.812193+0000","last_change":"2023-11-28T20:01:09.509983+0000","last_active":"2023-11-28T20:01:23.812193+0000","last_peered":"2023-11-28T20:01:23.812193+0000","last_clean":"2023-11-28T20:01:23.812193+0000","last_became_active":"2023-11-28T20:01:09.509675+0000","last_became_peered":"2023-11-28T20:01:09.509675+0000","last_unstale":"2023-11-28T20:01:23.812193+0000","last_undegraded":"2023-11-28T20:01:23.812193+0000","last_fullsized":"2023-11-28T20:01:23.812193+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:08.474257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:08.474257+0000","last_clean_scrub_stamp":"2023-11-28T20:01:08.474257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:21:20.189227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.1","version":"0'0","reported_seq":11,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-11-28T20:01:25.214771+0000","last_change":"2023-11-28T20:01:23.831264+0000","last_active":"2023-11-28T20:01:25.214771+0000","last_peered":"2023-11-28T20:01:25.214771+0000","last_clean":"2023-11-28T20:01:25.214771+0000","last_became_active":"2023-11-28T20:01:23.830870+0000","last_became_peered":"2023-11-28T20:01:23.830870+0000","last_unstale":"2023-11-28T20:01:25.214771+0000","last_undegraded":"2023-11-28T20:01:25.214771+0000","last_fullsized":"2023-11-28T20:01:25.214771+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:22.787100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:22.787100+0000","last_clean_scrub_stamp":"2023-11-28T20:01:22.787100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:10:43.700184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.6","version":"0'0","reported_seq":12,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-28T20:01:23.809035+0000","last_change":"2023-11-28T20:01:22.817836+0000","last_active":"2023-11-28T20:01:23.809035+0000","last_peered":"2023-11-28T20:01:23.809035+0000","last_clean":"2023-11-28T20:01:23.809035+0000","last_became_active":"2023-11-28T20:01:22.817473+0000","last_became_peered":"2023-11-28T20:01:22.817473+0000","last_unstale":"2023-11-28T20:01:23.809035+0000","last_undegraded":"2023-11-28T20:01:23.809035+0000","last_fullsized":"2023-11-28T20:01:23.809035+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:21.777981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:21.777981+0000","last_clean_scrub_stamp":"2023-11-28T20:01:21.777981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:05:01.775661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.7","version":"0'0","reported_seq":15,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-28T20:01:23.814413+0000","last_change":"2023-11-28T20:01:10.535856+0000","last_active":"2023-11-28T20:01:23.814413+0000","last_peered":"2023-11-28T20:01:23.814413+0000","last_clean":"2023-11-28T20:01:23.814413+0000","last_became_active":"2023-11-28T20:01:10.530889+0000","last_became_peered":"2023-11-28T20:01:10.530889+0000","last_unstale":"2023-11-28T20:01:23.814413+0000","last_undegraded":"2023-11-28T20:01:23.814413+0000","last_fullsized":"2023-11-28T20:01:23.814413+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_clean_scrub_stamp":"2023-11-28T20:01:09.480611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:53:37.636427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":16,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-28T20:01:23.820407+0000","last_change":"2023-11-28T20:01:09.511368+0000","last_active":"2023-11-28T20:01:23.820407+0000","last_peered":"2023-11-28T20:01:23.820407+0000","last_clean":"2023-11-28T20:01:23.820407+0000","last_became_active":"2023-11-28T20:01:09.510765+0000","last_became_peered":"2023-11-28T20:01:09.510765+0000","last_unstale":"2023-11-28T20:01:23.820407+0000","last_undegraded":"2023-11-28T20:01:23.820407+0000","last_fullsized":"2023-11-28T20:01:23.820407+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:08.474257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:08.474257+0000","last_clean_scrub_stamp":"2023-11-28T20:01:08.474257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:23:01.812122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.6","version":"0'0","reported_seq":11,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-11-28T20:01:25.216541+0000","last_change":"2023-11-28T20:01:23.840015+0000","last_active":"2023-11-28T20:01:25.216541+0000","last_peered":"2023-11-28T20:01:25.216541+0000","last_clean":"2023-11-28T20:01:25.216541+0000","last_became_active":"2023-11-28T20:01:23.838613+0000","last_became_peered":"2023-11-28T20:01:23.838613+0000","last_unstale":"2023-11-28T20:01:25.216541+0000","last_undegraded":"2023-11-28T20:01:25.216541+0000","last_fullsized":"2023-11-28T20:01:25.216541+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:22.787100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:22.787100+0000","last_clean_scrub_stamp":"2023-11-28T20:01:22.787100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:10:43.700184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.1","version":"0'0","reported_seq":12,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-28T20:01:23.810499+0000","last_change":"2023-11-28T20:01:22.823098+0000","last_active":"2023-11-28T20:01:23.810499+0000","last_peered":"2023-11-28T20:01:23.810499+0000","last_clean":"2023-11-28T20:01:23.810499+0000","last_became_active":"2023-11-28T20:01:22.822775+0000","last_became_peered":"2023-11-28T20:01:22.822775+0000","last_unstale":"2023-11-28T20:01:23.810499+0000","last_undegraded":"2023-11-28T20:01:23.810499+0000","last_fullsized":"2023-11-28T20:01:23.810499+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:21.777981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:21.777981+0000","last_clean_scrub_stamp":"2023-11-28T20:01:21.777981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:17:39.395256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":15,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-28T20:01:23.809949+0000","last_change":"2023-11-28T20:01:10.530585+0000","last_active":"2023-11-28T20:01:23.809949+0000","last_peered":"2023-11-28T20:01:23.809949+0000","last_clean":"2023-11-28T20:01:23.809949+0000","last_became_active":"2023-11-28T20:01:10.530313+0000","last_became_peered":"2023-11-28T20:01:10.530313+0000","last_unstale":"2023-11-28T20:01:23.809949+0000","last_undegraded":"2023-11-28T20:01:23.809949+0000","last_fullsized":"2023-11-28T20:01:23.809949+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_clean_scrub_stamp":"2023-11-28T20:01:09.480611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:04:41.159984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":16,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-28T20:01:23.815798+0000","last_change":"2023-11-28T20:01:09.518318+0000","last_active":"2023-11-28T20:01:23.815798+0000","last_peered":"2023-11-28T20:01:23.815798+0000","last_clean":"2023-11-28T20:01:23.815798+0000","last_became_active":"2023-11-28T20:01:09.517761+0000","last_became_peered":"2023-11-28T20:01:09.517761+0000","last_unstale":"2023-11-28T20:01:23.815798+0000","last_undegraded":"2023-11-28T20:01:23.815798+0000","last_fullsized":"2023-11-28T20:01:23.815798+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:08.474257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:08.474257+0000","last_clean_scrub_stamp":"2023-11-28T20:01:08.474257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:18:16.102441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.7","version":"0'0","reported_seq":11,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-11-28T20:01:25.216794+0000","last_change":"2023-11-28T20:01:23.830145+0000","last_active":"2023-11-28T20:01:25.216794+0000","last_peered":"2023-11-28T20:01:25.216794+0000","last_clean":"2023-11-28T20:01:25.216794+0000","last_became_active":"2023-11-28T20:01:23.829852+0000","last_became_peered":"2023-11-28T20:01:23.829852+0000","last_unstale":"2023-11-28T20:01:25.216794+0000","last_undegraded":"2023-11-28T20:01:25.216794+0000","last_fullsized":"2023-11-28T20:01:25.216794+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:22.787100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:22.787100+0000","last_clean_scrub_stamp":"2023-11-28T20:01:22.787100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:52:44.949356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.0","version":"0'0","reported_seq":12,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-28T20:01:23.817353+0000","last_change":"2023-11-28T20:01:22.822143+0000","last_active":"2023-11-28T20:01:23.817353+0000","last_peered":"2023-11-28T20:01:23.817353+0000","last_clean":"2023-11-28T20:01:23.817353+0000","last_became_active":"2023-11-28T20:01:22.821874+0000","last_became_peered":"2023-11-28T20:01:22.821874+0000","last_unstale":"2023-11-28T20:01:23.817353+0000","last_undegraded":"2023-11-28T20:01:23.817353+0000","last_fullsized":"2023-11-28T20:01:23.817353+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:21.777981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:21.777981+0000","last_clean_scrub_stamp":"2023-11-28T20:01:21.777981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:46:41.998408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":15,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-28T20:01:23.805358+0000","last_change":"2023-11-28T20:01:10.533596+0000","last_active":"2023-11-28T20:01:23.805358+0000","last_peered":"2023-11-28T20:01:23.805358+0000","last_clean":"2023-11-28T20:01:23.805358+0000","last_became_active":"2023-11-28T20:01:10.533195+0000","last_became_peered":"2023-11-28T20:01:10.533195+0000","last_unstale":"2023-11-28T20:01:23.805358+0000","last_undegraded":"2023-11-28T20:01:23.805358+0000","last_fullsized":"2023-11-28T20:01:23.805358+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_clean_scrub_stamp":"2023-11-28T20:01:09.480611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:14:25.459653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":16,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-28T20:01:23.802008+0000","last_change":"2023-11-28T20:01:09.507413+0000","last_active":"2023-11-28T20:01:23.802008+0000","last_peered":"2023-11-28T20:01:23.802008+0000","last_clean":"2023-11-28T20:01:23.802008+0000","last_became_active":"2023-11-28T20:01:09.507080+0000","last_became_peered":"2023-11-28T20:01:09.507080+0000","last_unstale":"2023-11-28T20:01:23.802008+0000","last_undegraded":"2023-11-28T20:01:23.802008+0000","last_fullsized":"2023-11-28T20:01:23.802008+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:08.474257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:08.474257+0000","last_clean_scrub_stamp":"2023-11-28T20:01:08.474257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:54:29.262983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.4","version":"0'0","reported_seq":11,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-11-28T20:01:25.214781+0000","last_change":"2023-11-28T20:01:23.838957+0000","last_active":"2023-11-28T20:01:25.214781+0000","last_peered":"2023-11-28T20:01:25.214781+0000","last_clean":"2023-11-28T20:01:25.214781+0000","last_became_active":"2023-11-28T20:01:23.838714+0000","last_became_peered":"2023-11-28T20:01:23.838714+0000","last_unstale":"2023-11-28T20:01:25.214781+0000","last_undegraded":"2023-11-28T20:01:25.214781+0000","last_fullsized":"2023-11-28T20:01:25.214781+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:22.787100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:22.787100+0000","last_clean_scrub_stamp":"2023-11-28T20:01:22.787100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:59:21.875213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.3","version":"0'0","reported_seq":12,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-28T20:01:23.809795+0000","last_change":"2023-11-28T20:01:22.826550+0000","last_active":"2023-11-28T20:01:23.809795+0000","last_peered":"2023-11-28T20:01:23.809795+0000","last_clean":"2023-11-28T20:01:23.809795+0000","last_became_active":"2023-11-28T20:01:22.826247+0000","last_became_peered":"2023-11-28T20:01:22.826247+0000","last_unstale":"2023-11-28T20:01:23.809795+0000","last_undegraded":"2023-11-28T20:01:23.809795+0000","last_fullsized":"2023-11-28T20:01:23.809795+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:21.777981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:21.777981+0000","last_clean_scrub_stamp":"2023-11-28T20:01:21.777981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:46:41.998408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":15,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-28T20:01:23.818011+0000","last_change":"2023-11-28T20:01:10.518351+0000","last_active":"2023-11-28T20:01:23.818011+0000","last_peered":"2023-11-28T20:01:23.818011+0000","last_clean":"2023-11-28T20:01:23.818011+0000","last_became_active":"2023-11-28T20:01:10.518106+0000","last_became_peered":"2023-11-28T20:01:10.518106+0000","last_unstale":"2023-11-28T20:01:23.818011+0000","last_undegraded":"2023-11-28T20:01:23.818011+0000","last_fullsized":"2023-11-28T20:01:23.818011+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_clean_scrub_stamp":"2023-11-28T20:01:09.480611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:04:52.498548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":16,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-28T20:01:23.800853+0000","last_change":"2023-11-28T20:01:09.514346+0000","last_active":"2023-11-28T20:01:23.800853+0000","last_peered":"2023-11-28T20:01:23.800853+0000","last_clean":"2023-11-28T20:01:23.800853+0000","last_became_active":"2023-11-28T20:01:09.513791+0000","last_became_peered":"2023-11-28T20:01:09.513791+0000","last_unstale":"2023-11-28T20:01:23.800853+0000","last_undegraded":"2023-11-28T20:01:23.800853+0000","last_fullsized":"2023-11-28T20:01:23.800853+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:08.474257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:08.474257+0000","last_clean_scrub_stamp":"2023-11-28T20:01:08.474257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:17:26.091533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.5","version":"0'0","reported_seq":11,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-11-28T20:01:25.214848+0000","last_change":"2023-11-28T20:01:23.833321+0000","last_active":"2023-11-28T20:01:25.214848+0000","last_peered":"2023-11-28T20:01:25.214848+0000","last_clean":"2023-11-28T20:01:25.214848+0000","last_became_active":"2023-11-28T20:01:23.832964+0000","last_became_peered":"2023-11-28T20:01:23.832964+0000","last_unstale":"2023-11-28T20:01:25.214848+0000","last_undegraded":"2023-11-28T20:01:25.214848+0000","last_fullsized":"2023-11-28T20:01:25.214848+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:22.787100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:22.787100+0000","last_clean_scrub_stamp":"2023-11-28T20:01:22.787100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:52:44.949356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":12,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-28T20:01:23.820815+0000","last_change":"2023-11-28T20:01:22.821936+0000","last_active":"2023-11-28T20:01:23.820815+0000","last_peered":"2023-11-28T20:01:23.820815+0000","last_clean":"2023-11-28T20:01:23.820815+0000","last_became_active":"2023-11-28T20:01:22.821666+0000","last_became_peered":"2023-11-28T20:01:22.821666+0000","last_unstale":"2023-11-28T20:01:23.820815+0000","last_undegraded":"2023-11-28T20:01:23.820815+0000","last_fullsized":"2023-11-28T20:01:23.820815+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:21.777981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:21.777981+0000","last_clean_scrub_stamp":"2023-11-28T20:01:21.777981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:04:55.030980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":15,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-28T20:01:23.821326+0000","last_change":"2023-11-28T20:01:10.531261+0000","last_active":"2023-11-28T20:01:23.821326+0000","last_peered":"2023-11-28T20:01:23.821326+0000","last_clean":"2023-11-28T20:01:23.821326+0000","last_became_active":"2023-11-28T20:01:10.531002+0000","last_became_peered":"2023-11-28T20:01:10.531002+0000","last_unstale":"2023-11-28T20:01:23.821326+0000","last_undegraded":"2023-11-28T20:01:23.821326+0000","last_fullsized":"2023-11-28T20:01:23.821326+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_clean_scrub_stamp":"2023-11-28T20:01:09.480611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:50:37.650648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":16,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-28T20:01:23.817548+0000","last_change":"2023-11-28T20:01:09.512031+0000","last_active":"2023-11-28T20:01:23.817548+0000","last_peered":"2023-11-28T20:01:23.817548+0000","last_clean":"2023-11-28T20:01:23.817548+0000","last_became_active":"2023-11-28T20:01:09.511366+0000","last_became_peered":"2023-11-28T20:01:09.511366+0000","last_unstale":"2023-11-28T20:01:23.817548+0000","last_undegraded":"2023-11-28T20:01:23.817548+0000","last_fullsized":"2023-11-28T20:01:23.817548+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:08.474257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:08.474257+0000","last_clean_scrub_stamp":"2023-11-28T20:01:08.474257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:29:38.849741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.d","version":"0'0","reported_seq":11,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-11-28T20:01:25.214026+0000","last_change":"2023-11-28T20:01:23.833055+0000","last_active":"2023-11-28T20:01:25.214026+0000","last_peered":"2023-11-28T20:01:25.214026+0000","last_clean":"2023-11-28T20:01:25.214026+0000","last_became_active":"2023-11-28T20:01:23.832789+0000","last_became_peered":"2023-11-28T20:01:23.832789+0000","last_unstale":"2023-11-28T20:01:25.214026+0000","last_undegraded":"2023-11-28T20:01:25.214026+0000","last_fullsized":"2023-11-28T20:01:25.214026+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:22.787100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:22.787100+0000","last_clean_scrub_stamp":"2023-11-28T20:01:22.787100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:47:59.097311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":12,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-28T20:01:23.801768+0000","last_change":"2023-11-28T20:01:22.819303+0000","last_active":"2023-11-28T20:01:23.801768+0000","last_peered":"2023-11-28T20:01:23.801768+0000","last_clean":"2023-11-28T20:01:23.801768+0000","last_became_active":"2023-11-28T20:01:22.819098+0000","last_became_peered":"2023-11-28T20:01:22.819098+0000","last_unstale":"2023-11-28T20:01:23.801768+0000","last_undegraded":"2023-11-28T20:01:23.801768+0000","last_fullsized":"2023-11-28T20:01:23.801768+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:21.777981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:21.777981+0000","last_clean_scrub_stamp":"2023-11-28T20:01:21.777981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:32:02.071072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.b","version":"0'0","reported_seq":15,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-28T20:01:23.810078+0000","last_change":"2023-11-28T20:01:10.530148+0000","last_active":"2023-11-28T20:01:23.810078+0000","last_peered":"2023-11-28T20:01:23.810078+0000","last_clean":"2023-11-28T20:01:23.810078+0000","last_became_active":"2023-11-28T20:01:10.529630+0000","last_became_peered":"2023-11-28T20:01:10.529630+0000","last_unstale":"2023-11-28T20:01:23.810078+0000","last_undegraded":"2023-11-28T20:01:23.810078+0000","last_fullsized":"2023-11-28T20:01:23.810078+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:09.480611+0000","last_clean_scrub_stamp":"2023-11-28T20:01:09.480611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:11:08.794514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":16,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-28T20:01:23.800217+0000","last_change":"2023-11-28T20:01:09.515708+0000","last_active":"2023-11-28T20:01:23.800217+0000","last_peered":"2023-11-28T20:01:23.800217+0000","last_clean":"2023-11-28T20:01:23.800217+0000","last_became_active":"2023-11-28T20:01:09.515449+0000","last_became_peered":"2023-11-28T20:01:09.515449+0000","last_unstale":"2023-11-28T20:01:23.800217+0000","last_undegraded":"2023-11-28T20:01:23.800217+0000","last_fullsized":"2023-11-28T20:01:23.800217+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:01:08.474257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:01:08.474257+0000","last_clean_scrub_stamp":"2023-11-28T20:01:08.474257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T07:14:20.829778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":203,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-28T20:01:23.814532+0000","last_change":"2023-11-28T19:58:56.136501+0000","last_active":"2023-11-28T20:01:23.814532+0000","last_peered":"2023-11-28T20:01:23.814532+0000","last_clean":"2023-11-28T20:01:23.814532+0000","last_became_active":"2023-11-28T19:58:56.135998+0000","last_became_peered":"2023-11-28T19:58:56.135998+0000","last_unstale":"2023-11-28T20:01:23.814532+0000","last_undegraded":"2023-11-28T20:01:23.814532+0000","last_fullsized":"2023-11-28T20:01:23.814532+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:58:54.602349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:58:54.602349+0000","last_clean_scrub_stamp":"2023-11-28T19:58:54.602349+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:33:42.723349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":12,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":11,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":10,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":9,"num_pg":32,"stat_sum":{"num_bytes":3905,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":47,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":7810,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":41,"ondisk_log_size":41,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":66748,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574883,"num_pgs":56,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27876,"kb_used_data":852,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343964,"statfs":{"total":96636764160,"available":96608219136,"internally_reserved":0,"allocated":872448,"data_stored":958750,"data_compressed":33374,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 20:00:55 2023","interfaces":[{"interface":"back","average":{"1min":0.66200000000000003,"5min":0.67500000000000004,"15min":0.67700000000000005},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":0.84699999999999998,"5min":0.90700000000000003,"15min":0.90700000000000003},"last":0.64200000000000002},{"interface":"front","average":{"1min":0.63300000000000001,"5min":0.67400000000000004,"15min":0.68100000000000005},"min":{"1min":0.499,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":0.84099999999999997,"5min":0.98999999999999999,"15min":0.98999999999999999},"last":0.45100000000000001}]},{"osd":1,"last update":"Tue Nov 28 20:00:55 2023","interfaces":[{"interface":"back","average":{"1min":0.60599999999999998,"5min":0.63800000000000001,"15min":0.64300000000000002},"min":{"1min":0.44700000000000001,"5min":0.438,"15min":0.438},"max":{"1min":0.82899999999999996,"5min":0.89600000000000002,"15min":0.89600000000000002},"last":0.76000000000000001},{"interface":"front","average":{"1min":0.63900000000000001,"5min":0.68899999999999995,"15min":0.69699999999999995},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":0.78200000000000003,"5min":1.0900000000000001,"15min":1.0900000000000001},"last":0.78000000000000003}]},{"osd":2,"last update":"Tue Nov 28 20:00:55 2023","interfaces":[{"interface":"back","average":{"1min":0.64400000000000002,"5min":0.71599999999999997,"15min":0.72799999999999998},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.84699999999999998,"5min":0.98799999999999999,"15min":0.98799999999999999},"last":0.81299999999999994},{"interface":"front","average":{"1min":0.65100000000000002,"5min":0.69499999999999995,"15min":0.70299999999999996},"min":{"1min":0.48599999999999999,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":0.85599999999999998,"5min":1.0680000000000001,"15min":1.0680000000000001},"last":0.56899999999999995}]},{"osd":3,"last update":"Tue Nov 28 20:00:55 2023","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.70099999999999996,"15min":0.69999999999999996},"min":{"1min":0.56100000000000005,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":0.88900000000000001,"5min":1.0449999999999999,"15min":1.0449999999999999},"last":0.66000000000000003},{"interface":"front","average":{"1min":0.74199999999999999,"5min":0.78200000000000003,"15min":0.78900000000000003},"min":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":0.60699999999999998},"max":{"1min":0.879,"5min":1.1299999999999999,"15min":1.1299999999999999},"last":0.71699999999999997}]},{"osd":4,"last update":"Tue Nov 28 20:00:55 2023","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.63600000000000001,"15min":0.64000000000000001},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":0.83899999999999997,"5min":1.018,"15min":1.018},"last":0.621},{"interface":"front","average":{"1min":0.67600000000000005,"5min":0.72199999999999998,"15min":0.72999999999999998},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":0.97899999999999998,"5min":1.1120000000000001,"15min":1.1120000000000001},"last":0.59599999999999997}]},{"osd":5,"last update":"Tue Nov 28 20:00:55 2023","interfaces":[{"interface":"back","average":{"1min":0.58699999999999997,"5min":0.66500000000000004,"15min":0.67800000000000005},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.871,"5min":1.1699999999999999,"15min":1.1699999999999999},"last":0.502},{"interface":"front","average":{"1min":0.67900000000000005,"5min":0.748,"15min":0.76000000000000001},"min":{"1min":0.505,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":0.88500000000000001,"5min":1.1890000000000001,"15min":1.1890000000000001},"last":0.68100000000000005}]},{"osd":6,"last update":"Tue Nov 28 20:00:55 2023","interfaces":[{"interface":"back","average":{"1min":0.71399999999999997,"5min":0.76800000000000002,"15min":0.77700000000000002},"min":{"1min":0.47499999999999998,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.88200000000000001,"5min":1.1379999999999999,"15min":1.1379999999999999},"last":0.73799999999999999},{"interface":"front","average":{"1min":0.65000000000000002,"5min":0.72699999999999998,"15min":0.73999999999999999},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":0.93300000000000005,"5min":1.23,"15min":1.23},"last":0.69999999999999996}]}]},{"osd":6,"up_from":13,"seq":55834574881,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27808,"kb_used_data":784,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344032,"statfs":{"total":96636764160,"available":96608288768,"internally_reserved":0,"allocated":802816,"data_stored":369230,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 20:00:54 2023","interfaces":[{"interface":"back","average":{"1min":0.621,"5min":0.61699999999999999,"15min":0.61599999999999999},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.81699999999999995,"5min":0.82599999999999996,"15min":0.82599999999999996},"last":0.70499999999999996},{"interface":"front","average":{"1min":0.67300000000000004,"5min":0.66500000000000004,"15min":0.66400000000000003},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":0.88700000000000001,"5min":0.98999999999999999,"15min":0.98999999999999999},"last":0.78500000000000003}]},{"osd":1,"last update":"Tue Nov 28 20:00:54 2023","interfaces":[{"interface":"back","average":{"1min":0.745,"5min":0.78100000000000003,"15min":0.78700000000000003},"min":{"1min":0.56100000000000005,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.0940000000000001,"5min":1.105,"15min":1.105},"last":0.81599999999999995},{"interface":"front","average":{"1min":0.69999999999999996,"5min":0.68899999999999995,"15min":0.68700000000000006},"min":{"1min":0.53700000000000003,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.85599999999999998,"5min":0.95899999999999996,"15min":0.95899999999999996},"last":0.72699999999999998}]},{"osd":2,"last update":"Tue Nov 28 20:00:54 2023","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.69499999999999995,"15min":0.69799999999999995},"min":{"1min":0.54700000000000004,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":0.89700000000000002,"5min":0.93400000000000005,"15min":0.93400000000000005},"last":0.76500000000000001},{"interface":"front","average":{"1min":0.70499999999999996,"5min":0.71599999999999997,"15min":0.71799999999999997},"min":{"1min":0.53400000000000003,"5min":0.505,"15min":0.505},"max":{"1min":0.91800000000000004,"5min":1.006,"15min":1.006},"last":0.66500000000000004}]},{"osd":3,"last update":"Tue Nov 28 20:00:54 2023","interfaces":[{"interface":"back","average":{"1min":0.70999999999999996,"5min":0.74099999999999999,"15min":0.746},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.04,"5min":1.056,"15min":1.056},"last":0.84499999999999997},{"interface":"front","average":{"1min":0.66700000000000004,"5min":0.68100000000000005,"15min":0.68300000000000005},"min":{"1min":0.505,"5min":0.505,"15min":0.505},"max":{"1min":0.85599999999999998,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.68300000000000005}]},{"osd":4,"last update":"Tue Nov 28 20:00:54 2023","interfaces":[{"interface":"back","average":{"1min":0.61599999999999999,"5min":0.628,"15min":0.63},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":0.97599999999999998,"5min":0.97599999999999998,"15min":0.97599999999999998},"last":0.52500000000000002},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.71199999999999997,"15min":0.72999999999999998},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":1.1419999999999999,"5min":1.389,"15min":1.389},"last":0.504}]},{"osd":5,"last update":"Tue Nov 28 20:00:54 2023","interfaces":[{"interface":"back","average":{"1min":0.71999999999999997,"5min":0.79700000000000004,"15min":0.81000000000000005},"min":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":1.147,"5min":1.4259999999999999,"15min":1.4259999999999999},"last":0.60799999999999998},{"interface":"front","average":{"1min":0.70699999999999996,"5min":0.751,"15min":0.75900000000000001},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.034,"5min":1.276,"15min":1.276},"last":0.627}]},{"osd":7,"last update":"Tue Nov 28 20:00:54 2023","interfaces":[{"interface":"back","average":{"1min":0.64000000000000001,"5min":0.69999999999999996,"15min":0.70999999999999996},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":1.014,"5min":1.014,"15min":1.014},"last":0.47699999999999998},{"interface":"front","average":{"1min":0.72599999999999998,"5min":0.80900000000000005,"15min":0.82299999999999995},"min":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":1.083,"5min":1.242,"15min":1.242},"last":0.58299999999999996}]}]},{"osd":5,"up_from":13,"seq":55834574883,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31960,"kb_used_data":776,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339880,"statfs":{"total":96636764160,"available":96604037120,"internally_reserved":0,"allocated":794624,"data_stored":367640,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 20:00:54 2023","interfaces":[{"interface":"back","average":{"1min":0.628,"5min":0.69299999999999995,"15min":0.70399999999999996},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.84699999999999998,"5min":0.997,"15min":0.997},"last":0.55900000000000005},{"interface":"front","average":{"1min":0.61899999999999999,"5min":0.69899999999999995,"15min":0.71199999999999997},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.78800000000000003,"5min":1.149,"15min":1.149},"last":0.66400000000000003}]},{"osd":1,"last update":"Tue Nov 28 20:00:54 2023","interfaces":[{"interface":"back","average":{"1min":0.66800000000000004,"5min":0.70399999999999996,"15min":0.70999999999999996},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.94499999999999995,"5min":0.94499999999999995,"15min":0.94499999999999995},"last":0.58799999999999997},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.70399999999999996,"15min":0.71999999999999997},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":0.71999999999999997,"5min":1.0940000000000001,"15min":1.0940000000000001},"last":0.69499999999999995}]},{"osd":2,"last update":"Tue Nov 28 20:00:54 2023","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.89200000000000002,"15min":0.92800000000000005},"min":{"1min":0.5,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":0.91200000000000003,"5min":5.0880000000000001,"15min":5.0880000000000001},"last":0.78200000000000003},{"interface":"front","average":{"1min":0.69599999999999995,"5min":0.93999999999999995,"15min":0.98099999999999998},"min":{"1min":0.59199999999999997,"5min":0.504,"15min":0.504},"max":{"1min":0.96199999999999997,"5min":5.1399999999999997,"15min":5.1399999999999997},"last":0.90800000000000003}]},{"osd":3,"last update":"Tue Nov 28 20:00:54 2023","interfaces":[{"interface":"back","average":{"1min":0.70999999999999996,"5min":0.96399999999999997,"15min":1.006},"min":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":0.91100000000000003,"5min":5.0469999999999997,"15min":5.0469999999999997},"last":0.86499999999999999},{"interface":"front","average":{"1min":0.69099999999999995,"5min":0.93899999999999995,"15min":0.97999999999999998},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":0.90000000000000002,"5min":5.024,"15min":5.024},"last":0.95899999999999996}]},{"osd":4,"last update":"Tue Nov 28 20:00:54 2023","interfaces":[{"interface":"back","average":{"1min":0.58599999999999997,"5min":0.65800000000000003,"15min":0.67000000000000004},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.93300000000000005,"5min":1.4810000000000001,"15min":1.4810000000000001},"last":0.752},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.73599999999999999,"15min":0.74299999999999999},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":0.95799999999999996,"5min":1.6339999999999999,"15min":1.6339999999999999},"last":0.97599999999999998}]},{"osd":6,"last update":"Tue Nov 28 20:00:54 2023","interfaces":[{"interface":"back","average":{"1min":0.70299999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"min":{"1min":0.47699999999999998,"5min":0.434,"15min":0.434},"max":{"1min":0.93899999999999995,"5min":0.97699999999999998,"15min":0.97699999999999998},"last":1.0489999999999999},{"interface":"front","average":{"1min":0.69199999999999995,"5min":0.73599999999999999,"15min":0.74399999999999999},"min":{"1min":0.46300000000000002,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":0.86599999999999999,"5min":1.099,"15min":1.099},"last":0.93200000000000005}]},{"osd":7,"last update":"Tue Nov 28 20:00:54 2023","interfaces":[{"interface":"back","average":{"1min":0.77100000000000002,"5min":0.78300000000000003,"15min":0.78500000000000003},"min":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":0.95999999999999996,"5min":1.236,"15min":1.236},"last":1.022},{"interface":"front","average":{"1min":0.77800000000000002,"5min":0.79600000000000004,"15min":0.79900000000000004},"min":{"1min":0.54000000000000004,"5min":0.505,"15min":0.505},"max":{"1min":0.98599999999999999,"5min":1.0760000000000001,"15min":1.0760000000000001},"last":1.1000000000000001}]}]},{"osd":4,"up_from":13,"seq":55834574882,"num_pgs":51,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31984,"kb_used_data":800,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339856,"statfs":{"total":96636764160,"available":96604012544,"internally_reserved":0,"allocated":819200,"data_stored":372407,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 20:00:54 2023","interfaces":[{"interface":"back","average":{"1min":0.63200000000000001,"5min":0.69499999999999995,"15min":0.70499999999999996},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.82999999999999996,"5min":1.0429999999999999,"15min":1.0429999999999999},"last":0.71999999999999997},{"interface":"front","average":{"1min":0.64400000000000002,"5min":0.69999999999999996,"15min":0.70899999999999996},"min":{"1min":0.44900000000000001,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.93200000000000005,"5min":1.163,"15min":1.163},"last":0.55400000000000005}]},{"osd":1,"last update":"Tue Nov 28 20:00:54 2023","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.73599999999999999,"15min":0.754},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.88500000000000001,"5min":1.111,"15min":1.111},"last":0.48199999999999998},{"interface":"front","average":{"1min":0.68300000000000005,"5min":0.78700000000000003,"15min":0.80500000000000005},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":0.90000000000000002,"5min":1.238,"15min":1.238},"last":0.64300000000000002}]},{"osd":2,"last update":"Tue Nov 28 20:00:54 2023","interfaces":[{"interface":"back","average":{"1min":0.70099999999999996,"5min":0.76600000000000001,"15min":0.77700000000000002},"min":{"1min":0.53300000000000003,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.97399999999999998,"5min":1.0669999999999999,"15min":1.0669999999999999},"last":0.70199999999999996},{"interface":"front","average":{"1min":0.66700000000000004,"5min":0.78700000000000003,"15min":0.80700000000000005},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.88100000000000001,"5min":1.1180000000000001,"15min":1.1180000000000001},"last":0.75900000000000001}]},{"osd":3,"last update":"Tue Nov 28 20:00:54 2023","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.76600000000000001,"15min":0.79000000000000004},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":0.89700000000000002,"5min":1.202,"15min":1.202},"last":0.59599999999999997},{"interface":"front","average":{"1min":0.67700000000000005,"5min":0.77200000000000002,"15min":0.78800000000000003},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":0.94599999999999995,"5min":1.0589999999999999,"15min":1.0589999999999999},"last":0.52800000000000002}]},{"osd":5,"last update":"Tue Nov 28 20:00:54 2023","interfaces":[{"interface":"back","average":{"1min":0.621,"5min":0.70299999999999996,"15min":0.71699999999999997},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.82499999999999996,"5min":0.95899999999999996,"15min":0.95899999999999996},"last":0.57499999999999996},{"interface":"front","average":{"1min":0.625,"5min":0.69599999999999995,"15min":0.70799999999999996},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.879,"5min":1.034,"15min":1.034},"last":0.45300000000000001}]},{"osd":6,"last update":"Tue Nov 28 20:00:54 2023","interfaces":[{"interface":"back","average":{"1min":0.60799999999999998,"5min":0.70899999999999996,"15min":0.72599999999999998},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":0.73799999999999999,"5min":1.0309999999999999,"15min":1.0309999999999999},"last":0.61699999999999999},{"interface":"front","average":{"1min":0.71899999999999997,"5min":0.77100000000000002,"15min":0.77900000000000003},"min":{"1min":0.49199999999999999,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":0.879,"5min":1.002,"15min":1.002},"last":0.68600000000000005}]},{"osd":7,"last update":"Tue Nov 28 20:00:54 2023","interfaces":[{"interface":"back","average":{"1min":0.70499999999999996,"5min":0.77100000000000002,"15min":0.78200000000000003},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":0.91000000000000003,"5min":1.0620000000000001,"15min":1.0620000000000001},"last":0.74299999999999999},{"interface":"front","average":{"1min":0.76000000000000001,"5min":0.84799999999999998,"15min":0.86199999999999999},"min":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":0.93400000000000005,"5min":1.1459999999999999,"15min":1.1459999999999999},"last":0.77600000000000002}]}]},{"osd":3,"up_from":13,"seq":55834574883,"num_pgs":45,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27796,"kb_used_data":772,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344044,"statfs":{"total":96636764160,"available":96608301056,"internally_reserved":0,"allocated":790528,"data_stored":368166,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 20:00:55 2023","interfaces":[{"interface":"back","average":{"1min":0.41899999999999998,"5min":0.441,"15min":0.44500000000000001},"min":{"1min":0.29399999999999998,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.40899999999999997},{"interface":"front","average":{"1min":0.39600000000000002,"5min":0.45800000000000002,"15min":0.46800000000000003},"min":{"1min":0.28199999999999997,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.52800000000000002,"5min":0.82599999999999996,"15min":0.82599999999999996},"last":0.44700000000000001}]},{"osd":1,"last update":"Tue Nov 28 20:00:55 2023","interfaces":[{"interface":"back","average":{"1min":0.40000000000000002,"5min":0.46500000000000002,"15min":0.47599999999999998},"min":{"1min":0.26200000000000001,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.56999999999999995,"5min":0.84399999999999997,"15min":0.84399999999999997},"last":0.42599999999999999},{"interface":"front","average":{"1min":0.439,"5min":0.49099999999999999,"15min":0.5},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.74099999999999999,"5min":0.86099999999999999,"15min":0.86099999999999999},"last":0.47399999999999998}]},{"osd":2,"last update":"Tue Nov 28 20:00:55 2023","interfaces":[{"interface":"back","average":{"1min":0.48799999999999999,"5min":0.52400000000000002,"15min":0.53000000000000003},"min":{"1min":0.375,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.64900000000000002,"5min":0.85599999999999998,"15min":0.85599999999999998},"last":0.498},{"interface":"front","average":{"1min":0.48999999999999999,"5min":0.56599999999999995,"15min":0.57899999999999996},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.63500000000000001,"5min":0.83699999999999997,"15min":0.83699999999999997},"last":0.56000000000000005}]},{"osd":4,"last update":"Tue Nov 28 20:00:55 2023","interfaces":[{"interface":"back","average":{"1min":0.77700000000000002,"5min":0.76500000000000001,"15min":0.76300000000000001},"min":{"1min":0.60799999999999998,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":1.085,"5min":1.206,"15min":1.206},"last":0.64600000000000002},{"interface":"front","average":{"1min":0.80700000000000005,"5min":0.80300000000000005,"15min":0.80300000000000005},"min":{"1min":0.58999999999999997,"5min":0.503,"15min":0.503},"max":{"1min":1.173,"5min":1.222,"15min":1.222},"last":0.65800000000000003}]},{"osd":5,"last update":"Tue Nov 28 20:00:55 2023","interfaces":[{"interface":"back","average":{"1min":0.78300000000000003,"5min":0.79600000000000004,"15min":0.79800000000000004},"min":{"1min":0.57699999999999996,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":1.2509999999999999,"5min":1.2509999999999999,"15min":1.2509999999999999},"last":0.61499999999999999},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.79100000000000004,"15min":0.79900000000000004},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":1.0409999999999999,"5min":1.3100000000000001,"15min":1.3100000000000001},"last":0.58199999999999996}]},{"osd":6,"last update":"Tue Nov 28 20:00:55 2023","interfaces":[{"interface":"back","average":{"1min":0.81699999999999995,"5min":0.83799999999999997,"15min":0.84199999999999997},"min":{"1min":0.58799999999999997,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":1.544,"5min":1.544,"15min":1.544},"last":0.60499999999999998},{"interface":"front","average":{"1min":0.93100000000000005,"5min":0.78500000000000003,"15min":0.76100000000000001},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":4.0679999999999996,"5min":4.0679999999999996,"15min":4.0679999999999996},"last":0.68000000000000005}]},{"osd":7,"last update":"Tue Nov 28 20:00:55 2023","interfaces":[{"interface":"back","average":{"1min":0.97099999999999997,"5min":0.874,"15min":0.85799999999999998},"min":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":4.0019999999999998,"5min":4.0019999999999998,"15min":4.0019999999999998},"last":0.72699999999999998},{"interface":"front","average":{"1min":0.80100000000000005,"5min":0.873,"15min":0.88500000000000001},"min":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.60299999999999998},"max":{"1min":1.1830000000000001,"5min":1.339,"15min":1.339},"last":0.76300000000000001}]}]},{"osd":2,"up_from":13,"seq":55834574881,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27800,"kb_used_data":780,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344040,"statfs":{"total":96636764160,"available":96608296960,"internally_reserved":0,"allocated":798720,"data_stored":368326,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 20:00:54 2023","interfaces":[{"interface":"back","average":{"1min":0.42599999999999999,"5min":0.45000000000000001,"15min":0.45400000000000001},"min":{"1min":0.33300000000000002,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.65100000000000002,"5min":0.74099999999999999,"15min":0.74099999999999999},"last":0.40100000000000002},{"interface":"front","average":{"1min":0.42199999999999999,"5min":0.46999999999999997,"15min":0.47799999999999998},"min":{"1min":0.27900000000000003,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.61399999999999999,"5min":0.67700000000000005,"15min":0.67700000000000005},"last":0.59599999999999997}]},{"osd":1,"last update":"Tue Nov 28 20:00:54 2023","interfaces":[{"interface":"back","average":{"1min":0.42899999999999999,"5min":0.497,"15min":0.50900000000000001},"min":{"1min":0.33300000000000002,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.57199999999999995,"5min":1.0389999999999999,"15min":1.0389999999999999},"last":0.54100000000000004},{"interface":"front","average":{"1min":0.435,"5min":0.49099999999999999,"15min":0.5},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.70299999999999996,"5min":0.70999999999999996,"15min":0.70999999999999996},"last":0.442}]},{"osd":3,"last update":"Tue Nov 28 20:00:54 2023","interfaces":[{"interface":"back","average":{"1min":0.44,"5min":0.46600000000000003,"15min":0.46999999999999997},"min":{"1min":0.317,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.55200000000000005,"5min":0.629,"15min":0.629},"last":0.55900000000000005},{"interface":"front","average":{"1min":0.496,"5min":0.57199999999999995,"15min":0.58499999999999996},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.67800000000000005,"5min":0.98499999999999999,"15min":0.98499999999999999},"last":0.57499999999999996}]},{"osd":4,"last update":"Tue Nov 28 20:00:54 2023","interfaces":[{"interface":"back","average":{"1min":0.73899999999999999,"5min":0.83699999999999997,"15min":0.85299999999999998},"min":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"max":{"1min":0.98999999999999999,"5min":1.139,"15min":1.139},"last":0.65100000000000002},{"interface":"front","average":{"1min":0.71999999999999997,"5min":0.82599999999999996,"15min":0.84399999999999997},"min":{"1min":0.57299999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":0.97599999999999998,"5min":1.238,"15min":1.238},"last":0.72999999999999998}]},{"osd":5,"last update":"Tue Nov 28 20:00:54 2023","interfaces":[{"interface":"back","average":{"1min":0.69699999999999995,"5min":0.84699999999999998,"15min":0.872},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":0.83599999999999997,"5min":1.6180000000000001,"15min":1.6180000000000001},"last":0.77100000000000002},{"interface":"front","average":{"1min":0.71099999999999997,"5min":0.81000000000000005,"15min":0.82599999999999996},"min":{"1min":0.52200000000000002,"5min":0.496,"15min":0.496},"max":{"1min":0.96899999999999997,"5min":1.339,"15min":1.339},"last":0.63}]},{"osd":6,"last update":"Tue Nov 28 20:00:54 2023","interfaces":[{"interface":"back","average":{"1min":0.73299999999999998,"5min":0.79100000000000004,"15min":0.80100000000000005},"min":{"1min":0.54600000000000004,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":0.98199999999999998,"5min":1.1839999999999999,"15min":1.1839999999999999},"last":0.68300000000000005},{"interface":"front","average":{"1min":0.70599999999999996,"5min":0.82999999999999996,"15min":0.85099999999999998},"min":{"1min":0.497,"5min":0.497,"15min":0.497},"max":{"1min":0.94199999999999995,"5min":1.099,"15min":1.099},"last":0.623}]},{"osd":7,"last update":"Tue Nov 28 20:00:54 2023","interfaces":[{"interface":"back","average":{"1min":0.746,"5min":0.86099999999999999,"15min":0.88},"min":{"1min":0.53300000000000003,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":0.84899999999999998,"5min":1.4590000000000001,"15min":1.4590000000000001},"last":0.80400000000000005},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.83599999999999997,"15min":0.85599999999999998},"min":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":0.96599999999999997,"5min":1.387,"15min":1.387},"last":0.67100000000000004}]}]},{"osd":1,"up_from":13,"seq":55834574883,"num_pgs":51,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31984,"kb_used_data":804,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339856,"statfs":{"total":96636764160,"available":96604012544,"internally_reserved":0,"allocated":823296,"data_stored":371567,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 20:00:56 2023","interfaces":[{"interface":"back","average":{"1min":0.372,"5min":0.59999999999999998,"15min":0.63800000000000001},"min":{"1min":0.25900000000000001,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.53200000000000003,"5min":3.8740000000000001,"15min":3.8740000000000001},"last":0.42299999999999999},{"interface":"front","average":{"1min":0.41499999999999998,"5min":0.54000000000000004,"15min":0.56100000000000005},"min":{"1min":0.26200000000000001,"5min":0.25,"15min":0.25},"max":{"1min":0.64100000000000001,"5min":2.0760000000000001,"15min":2.0760000000000001},"last":0.44600000000000001}]},{"osd":2,"last update":"Tue Nov 28 20:00:56 2023","interfaces":[{"interface":"back","average":{"1min":0.40899999999999997,"5min":0.60899999999999999,"15min":0.64200000000000002},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":0.54500000000000004,"5min":3.7320000000000002,"15min":3.7320000000000002},"last":0.39400000000000002},{"interface":"front","average":{"1min":0.42199999999999999,"5min":0.69199999999999995,"15min":0.73699999999999999},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.54800000000000004,"5min":3.9089999999999998,"15min":3.9089999999999998},"last":0.35999999999999999}]},{"osd":3,"last update":"Tue Nov 28 20:00:56 2023","interfaces":[{"interface":"back","average":{"1min":0.52800000000000002,"5min":0.65000000000000002,"15min":0.67000000000000004},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.64700000000000002,"5min":1.6399999999999999,"15min":1.6399999999999999},"last":0.48399999999999999},{"interface":"front","average":{"1min":0.52000000000000002,"5min":0.66600000000000004,"15min":0.68999999999999995},"min":{"1min":0.37,"5min":0.317,"15min":0.317},"max":{"1min":0.748,"5min":2.5270000000000001,"15min":2.5270000000000001},"last":0.50600000000000001}]},{"osd":4,"last update":"Tue Nov 28 20:00:56 2023","interfaces":[{"interface":"back","average":{"1min":0.70199999999999996,"5min":0.85599999999999998,"15min":0.88200000000000001},"min":{"1min":0.46700000000000003,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":1.036,"5min":3.1659999999999999,"15min":3.1659999999999999},"last":0.752},{"interface":"front","average":{"1min":0.68700000000000006,"5min":0.89400000000000002,"15min":0.92800000000000005},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.93700000000000006,"5min":3.7959999999999998,"15min":3.7959999999999998},"last":0.83699999999999997}]},{"osd":5,"last update":"Tue Nov 28 20:00:56 2023","interfaces":[{"interface":"back","average":{"1min":0.69799999999999995,"5min":0.93000000000000005,"15min":0.96899999999999997},"min":{"1min":0.50800000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":0.95599999999999996,"5min":4.1479999999999997,"15min":4.1479999999999997},"last":0.86499999999999999},{"interface":"front","average":{"1min":0.70299999999999996,"5min":0.86799999999999999,"15min":0.89600000000000002},"min":{"1min":0.499,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":1.052,"5min":3.5569999999999999,"15min":3.5569999999999999},"last":0.71199999999999997}]},{"osd":6,"last update":"Tue Nov 28 20:00:56 2023","interfaces":[{"interface":"back","average":{"1min":0.73999999999999999,"5min":0.94099999999999995,"15min":0.97499999999999998},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":1.004,"5min":2.863,"15min":2.863},"last":0.90900000000000003},{"interface":"front","average":{"1min":0.77400000000000002,"5min":0.94099999999999995,"15min":0.96899999999999997},"min":{"1min":0.58099999999999996,"5min":0.56899999999999995,"15min":0.56899999999999995},"max":{"1min":1.075,"5min":3.371,"15min":3.371},"last":0.79400000000000004}]},{"osd":7,"last update":"Tue Nov 28 20:00:56 2023","interfaces":[{"interface":"back","average":{"1min":0.71599999999999997,"5min":0.95299999999999996,"15min":0.99299999999999999},"min":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":0.96899999999999997,"5min":3.8439999999999999,"15min":3.8439999999999999},"last":0.78200000000000003},{"interface":"front","average":{"1min":0.72699999999999998,"5min":0.97499999999999998,"15min":1.0169999999999999},"min":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":1.0569999999999999,"5min":3.9689999999999999,"15min":3.9689999999999999},"last":0.93300000000000005}]}]},{"osd":0,"up_from":13,"seq":55834574882,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32012,"kb_used_data":832,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339828,"statfs":{"total":96636764160,"available":96603983872,"internally_reserved":0,"allocated":851968,"data_stored":957952,"data_compressed":33374,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Nov 28 20:00:56 2023","interfaces":[{"interface":"back","average":{"1min":0.41299999999999998,"5min":0.63400000000000001,"15min":0.67100000000000004},"min":{"1min":0.27400000000000002,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.55800000000000005,"5min":4.883,"15min":4.883},"last":0.30099999999999999},{"interface":"front","average":{"1min":0.44,"5min":0.79000000000000004,"15min":0.84799999999999998},"min":{"1min":0.30199999999999999,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.63200000000000001,"5min":8.0800000000000001,"15min":8.0800000000000001},"last":0.40200000000000002}]},{"osd":2,"last update":"Tue Nov 28 20:00:56 2023","interfaces":[{"interface":"back","average":{"1min":0.443,"5min":0.86699999999999999,"15min":0.93799999999999994},"min":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.59899999999999998,"5min":8.1029999999999998,"15min":8.1029999999999998},"last":0.41299999999999998},{"interface":"front","average":{"1min":0.47599999999999998,"5min":0.88400000000000001,"15min":0.95199999999999996},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.67600000000000005,"5min":8.1310000000000002,"15min":8.1310000000000002},"last":0.441}]},{"osd":3,"last update":"Tue Nov 28 20:00:56 2023","interfaces":[{"interface":"back","average":{"1min":0.42899999999999999,"5min":0.68300000000000005,"15min":0.72499999999999998},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.57599999999999996,"5min":4.3949999999999996,"15min":4.3949999999999996},"last":0.34999999999999998},{"interface":"front","average":{"1min":0.48899999999999999,"5min":0.70299999999999996,"15min":0.73899999999999999},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.69899999999999995,"5min":4.3470000000000004,"15min":4.3470000000000004},"last":0.37}]},{"osd":4,"last update":"Tue Nov 28 20:00:56 2023","interfaces":[{"interface":"back","average":{"1min":0.71999999999999997,"5min":0.98399999999999999,"15min":1.028},"min":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":1.123,"5min":4.6360000000000001,"15min":4.6360000000000001},"last":0.63800000000000001},{"interface":"front","average":{"1min":0.747,"5min":0.99099999999999999,"15min":1.032},"min":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":0.996,"5min":4.4710000000000001,"15min":4.4710000000000001},"last":0.52500000000000002}]},{"osd":5,"last update":"Tue Nov 28 20:00:56 2023","interfaces":[{"interface":"back","average":{"1min":0.74299999999999999,"5min":1,"15min":1.0429999999999999},"min":{"1min":0.54800000000000004,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":0.96399999999999997,"5min":4.6120000000000001,"15min":4.6120000000000001},"last":0.58999999999999997},{"interface":"front","average":{"1min":0.74199999999999999,"5min":0.98999999999999999,"15min":1.0309999999999999},"min":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"max":{"1min":1.1659999999999999,"5min":4.5449999999999999,"15min":4.5449999999999999},"last":0.55800000000000005}]},{"osd":6,"last update":"Tue Nov 28 20:00:56 2023","interfaces":[{"interface":"back","average":{"1min":0.73499999999999999,"5min":1.01,"15min":1.056},"min":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":1.143,"5min":4.657,"15min":4.657},"last":0.56799999999999995},{"interface":"front","average":{"1min":0.74199999999999999,"5min":1.026,"15min":1.073},"min":{"1min":0.61199999999999999,"5min":0.58899999999999997,"15min":0.58899999999999997},"max":{"1min":1.0109999999999999,"5min":4.5259999999999998,"15min":4.5259999999999998},"last":0.54100000000000004}]},{"osd":7,"last update":"Tue Nov 28 20:00:56 2023","interfaces":[{"interface":"back","average":{"1min":0.72199999999999998,"5min":1.0249999999999999,"15min":1.075},"min":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":1.036,"5min":4.7320000000000002,"15min":4.7320000000000002},"last":0.50700000000000001},{"interface":"front","average":{"1min":0.755,"5min":0.98699999999999999,"15min":1.026},"min":{"1min":0.57499999999999996,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":1.1919999999999999,"5min":4.4939999999999998,"15min":4.4939999999999998},"last":0.66100000000000003}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33374,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33374,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":3871,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3107,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":776,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":742,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1716,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-28T20:01:32.780 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-11-28T20:01:32.780 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.1 mon 'allow r' osd 'allow rw pool=cephfs2_data' mds allow 2023-11-28T20:01:32.959 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:32.953+0000 7f553f3d1640 1 Processor -- start 2023-11-28T20:01:32.959 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:32.953+0000 7f553f3d1640 1 -- start start 2023-11-28T20:01:32.961 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:32.957+0000 7f553f3d1640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f5538156200 0x7f55380c0370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:32.961 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:32.957+0000 7f553f3d1640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f553815bf70 0x7f553815c3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:32.961 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:32.957+0000 7f553f3d1640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f553806bce0 con 0x7f55380c0e10 2023-11-28T20:01:32.961 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:32.957+0000 7f553f3d1640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f553806d8d0 con 0x7f5538156200 2023-11-28T20:01:32.962 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:32.957+0000 7f553f3d1640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f55380c2270 con 0x7f553815bf70 2023-11-28T20:01:32.962 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:32.957+0000 7f553d96e640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f553815bf70 0x7f553815c3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:32.962 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:32.957+0000 7f553d16d640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f5538156200 0x7f55380c0370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:32.962 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:32.957+0000 7f553c96c640 1 --1- >> v1:172.21.15.179:6789/0 conn(0x7f55380c0e10 0x7f55380c1b60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.179:6789/0 says I am v1:172.21.15.78:48384/0 (socket says 172.21.15.78:48384) 2023-11-28T20:01:32.962 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:32.957+0000 7f553c96c640 1 -- 172.21.15.78:0/3719066714 learned_addr learned my addr 172.21.15.78:0/3719066714 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-11-28T20:01:32.963 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:32.957+0000 7f553d96e640 1 -- 172.21.15.78:0/3719066714 >> v2:172.21.15.179:3300/0 conn(0x7f5538156200 msgr2=0x7f55380c0370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:01:32.963 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:32.957+0000 7f552ffff640 1 -- 172.21.15.78:0/3719066714 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1179325318 0 0) 0x7f553806bce0 con 0x7f55380c0e10 2023-11-28T20:01:32.963 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:32.957+0000 7f553d96e640 1 --2- 172.21.15.78:0/3719066714 >> v2:172.21.15.179:3300/0 conn(0x7f5538156200 0x7f55380c0370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:32.963 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:32.957+0000 7f553d96e640 1 -- 172.21.15.78:0/3719066714 >> v1:172.21.15.179:6789/0 conn(0x7f55380c0e10 legacy=0x7f55380c1b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:01:32.963 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:32.957+0000 7f553d96e640 1 -- 172.21.15.78:0/3719066714 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f553815cc60 con 0x7f553815bf70 2023-11-28T20:01:32.963 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:32.957+0000 7f553d16d640 1 --2- 172.21.15.78:0/3719066714 >> v2:172.21.15.179:3300/0 conn(0x7f5538156200 0x7f55380c0370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T20:01:32.966 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:32.961+0000 7f553d96e640 1 --2- 172.21.15.78:0/3719066714 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f553815bf70 0x7f553815c3e0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f5530009d90 tx=0x7f553001c800 comp rx=0 tx=0).ready entity=mon.2 client_cookie=afe3504c29cedba server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:01:32.966 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:32.961+0000 7f552ffff640 1 -- 172.21.15.78:0/3719066714 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55300a57d0 con 0x7f553815bf70 2023-11-28T20:01:32.966 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:32.961+0000 7f552ffff640 1 -- 172.21.15.78:0/3719066714 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f55300a5930 con 0x7f553815bf70 2023-11-28T20:01:32.966 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:32.961+0000 7f552ffff640 1 -- 172.21.15.78:0/3719066714 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55300a5cc0 con 0x7f553815bf70 2023-11-28T20:01:32.966 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:32.961+0000 7f553f3d1640 1 -- 172.21.15.78:0/3719066714 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f553815bf70 msgr2=0x7f553815c3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:01:32.967 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:32.961+0000 7f553f3d1640 1 --2- 172.21.15.78:0/3719066714 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f553815bf70 0x7f553815c3e0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f5530009d90 tx=0x7f553001c800 comp rx=0 tx=0).stop 2023-11-28T20:01:32.967 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:32.961+0000 7f553f3d1640 1 -- 172.21.15.78:0/3719066714 shutdown_connections 2023-11-28T20:01:32.967 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:32.961+0000 7f553f3d1640 1 --2- 172.21.15.78:0/3719066714 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f553815bf70 0x7f553815c3e0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:32.967 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:32.961+0000 7f553f3d1640 1 --2- 172.21.15.78:0/3719066714 >> v2:172.21.15.179:3300/0 conn(0x7f5538156200 0x7f55380c0370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:32.967 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:32.961+0000 7f553f3d1640 1 -- 172.21.15.78:0/3719066714 >> 172.21.15.78:0/3719066714 conn(0x7f55380c59f0 msgr2=0x7f55380c5e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:01:32.968 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:32.961+0000 7f553f3d1640 1 -- 172.21.15.78:0/3719066714 shutdown_connections 2023-11-28T20:01:32.968 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:32.961+0000 7f553f3d1640 1 -- 172.21.15.78:0/3719066714 wait complete. 2023-11-28T20:01:32.973 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:32.961+0000 7f553f3d1640 1 Processor -- start 2023-11-28T20:01:32.973 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:32.961+0000 7f553f3d1640 1 -- start start 2023-11-28T20:01:32.973 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:32.961+0000 7f553f3d1640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f55380c0e10 0x7f55380a9f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:32.973 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:32.961+0000 7f553f3d1640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5538156200 0x7f55381f11b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:32.973 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:32.965+0000 7f553f3d1640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f553815bf70 0x7f55381f16f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:32.974 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:32.965+0000 7f553f3d1640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5538070fb0 con 0x7f5538156200 2023-11-28T20:01:32.974 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:32.965+0000 7f553f3d1640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5538071dc0 con 0x7f553815bf70 2023-11-28T20:01:32.974 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:32.965+0000 7f553f3d1640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f553814ec50 con 0x7f55380c0e10 2023-11-28T20:01:32.974 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:32.965+0000 7f553c96c640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5538156200 0x7f55381f11b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:32.974 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:32.965+0000 7f553c96c640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5538156200 0x7f55381f11b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:36282/0 (socket says 172.21.15.78:36282) 2023-11-28T20:01:32.974 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:32.965+0000 7f553c96c640 1 -- 172.21.15.78:0/2926405308 learned_addr learned my addr 172.21.15.78:0/2926405308 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T20:01:32.975 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:32.965+0000 7f553d96e640 1 --2- 172.21.15.78:0/2926405308 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f553815bf70 0x7f55381f16f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:32.975 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:32.965+0000 7f553d16d640 1 --2- 172.21.15.78:0/2926405308 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f55380c0e10 0x7f55380a9f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:32.975 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:32.965+0000 7f553c96c640 1 -- 172.21.15.78:0/2926405308 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f55380c0e10 msgr2=0x7f55380a9f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:01:32.975 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:32.965+0000 7f553c96c640 1 --2- 172.21.15.78:0/2926405308 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f55380c0e10 0x7f55380a9f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:32.975 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:32.965+0000 7f553c96c640 1 -- 172.21.15.78:0/2926405308 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f553815bf70 msgr2=0x7f55381f16f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:01:32.976 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:32.965+0000 7f553c96c640 1 --2- 172.21.15.78:0/2926405308 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f553815bf70 0x7f55381f16f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:32.976 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:32.965+0000 7f553c96c640 1 -- 172.21.15.78:0/2926405308 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5534009420 con 0x7f5538156200 2023-11-28T20:01:32.976 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:32.965+0000 7f553d96e640 1 --2- 172.21.15.78:0/2926405308 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f553815bf70 0x7f55381f16f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T20:01:32.976 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:32.965+0000 7f553c96c640 1 --2- 172.21.15.78:0/2926405308 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5538156200 0x7f55381f11b0 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7f552800c520 tx=0x7f552800c9e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:01:32.976 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:32.965+0000 7f552dffb640 1 -- 172.21.15.78:0/2926405308 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55280074e0 con 0x7f5538156200 2023-11-28T20:01:32.976 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:32.965+0000 7f552dffb640 1 -- 172.21.15.78:0/2926405308 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5528007640 con 0x7f5538156200 2023-11-28T20:01:32.977 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:32.965+0000 7f552dffb640 1 -- 172.21.15.78:0/2926405308 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55280049f0 con 0x7f5538156200 2023-11-28T20:01:32.977 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:32.965+0000 7f553f3d1640 1 -- 172.21.15.78:0/2926405308 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5530009a70 con 0x7f5538156200 2023-11-28T20:01:32.977 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:32.965+0000 7f553f3d1640 1 -- 172.21.15.78:0/2926405308 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5538072290 con 0x7f5538156200 2023-11-28T20:01:32.977 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:32.965+0000 7f553f3d1640 1 -- 172.21.15.78:0/2926405308 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5538067630 con 0x7f5538156200 2023-11-28T20:01:32.977 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:32.965+0000 7f552dffb640 1 -- 172.21.15.78:0/2926405308 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f5528004b50 con 0x7f5538156200 2023-11-28T20:01:32.978 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:32.969+0000 7f552dffb640 1 --2- 172.21.15.78:0/2926405308 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f551c066470 0x7f551c068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:32.978 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:32.969+0000 7f552dffb640 1 -- 172.21.15.78:0/2926405308 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 6885+0+0 (secure 0 0 0) 0x7f5528083510 con 0x7f5538156200 2023-11-28T20:01:32.978 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:32.969+0000 7f553d16d640 1 --2- 172.21.15.78:0/2926405308 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f551c066470 0x7f551c068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:32.978 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:32.969+0000 7f553d16d640 1 --2- 172.21.15.78:0/2926405308 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f551c066470 0x7f551c068930 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f5538149750 tx=0x7f5534008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:01:32.979 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:32.973+0000 7f552dffb640 1 -- 172.21.15.78:0/2926405308 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f5528050500 con 0x7f5538156200 2023-11-28T20:01:33.182 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:33.177+0000 7f553f3d1640 1 -- 172.21.15.78:0/2926405308 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.1", "caps": ["mon", "allow r", "osd", "allow rw pool=cephfs2_data", "mds", "allow"]} v 0) v1 -- 0x7f55380a74c0 con 0x7f5538156200 2023-11-28T20:01:33.185 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:33.181+0000 7f552dffb640 1 -- 172.21.15.78:0/2926405308 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.1", "caps": ["mon", "allow r", "osd", "allow rw pool=cephfs2_data", "mds", "allow"]}]=0 updated caps for client.1 v18) v1 ==== 185+0+142 (secure 0 0 0) 0x7f5528053b20 con 0x7f5538156200 2023-11-28T20:01:33.185 INFO:teuthology.orchestra.run.smithi078.stdout:[client.1] 2023-11-28T20:01:33.185 INFO:teuthology.orchestra.run.smithi078.stdout: key = AQBORmZlzBgfOhAAm6M8Y+12MlLdVkJnMmK9BQ== 2023-11-28T20:01:33.185 INFO:teuthology.orchestra.run.smithi078.stdout: caps mds = "allow" 2023-11-28T20:01:33.186 INFO:teuthology.orchestra.run.smithi078.stdout: caps mon = "allow r" 2023-11-28T20:01:33.186 INFO:teuthology.orchestra.run.smithi078.stdout: caps osd = "allow rw pool=cephfs2_data" 2023-11-28T20:01:33.186 INFO:teuthology.orchestra.run.smithi078.stderr:updated caps for client.1 2023-11-28T20:01:33.187 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:33.181+0000 7f553f3d1640 1 -- 172.21.15.78:0/2926405308 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f551c066470 msgr2=0x7f551c068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:01:33.188 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:33.181+0000 7f553f3d1640 1 --2- 172.21.15.78:0/2926405308 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f551c066470 0x7f551c068930 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f5538149750 tx=0x7f5534008040 comp rx=0 tx=0).stop 2023-11-28T20:01:33.188 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:33.181+0000 7f553f3d1640 1 -- 172.21.15.78:0/2926405308 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5538156200 msgr2=0x7f55381f11b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:01:33.188 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:33.181+0000 7f553f3d1640 1 --2- 172.21.15.78:0/2926405308 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5538156200 0x7f55381f11b0 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7f552800c520 tx=0x7f552800c9e0 comp rx=0 tx=0).stop 2023-11-28T20:01:33.188 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:33.181+0000 7f553f3d1640 1 -- 172.21.15.78:0/2926405308 shutdown_connections 2023-11-28T20:01:33.188 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:33.181+0000 7f553f3d1640 1 --2- 172.21.15.78:0/2926405308 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f551c066470 0x7f551c068930 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:33.188 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:33.181+0000 7f553f3d1640 1 --2- 172.21.15.78:0/2926405308 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f553815bf70 0x7f55381f16f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:33.188 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:33.181+0000 7f553f3d1640 1 --2- 172.21.15.78:0/2926405308 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5538156200 0x7f55381f11b0 unknown :-1 s=CLOSED pgs=707 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:33.188 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:33.181+0000 7f553f3d1640 1 --2- 172.21.15.78:0/2926405308 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f55380c0e10 0x7f55380a9f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:33.188 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:33.181+0000 7f553f3d1640 1 -- 172.21.15.78:0/2926405308 >> 172.21.15.78:0/2926405308 conn(0x7f55380c59f0 msgr2=0x7f55380c1680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:01:33.188 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:33.185+0000 7f553f3d1640 1 -- 172.21.15.78:0/2926405308 shutdown_connections 2023-11-28T20:01:33.188 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:33.185+0000 7f553f3d1640 1 -- 172.21.15.78:0/2926405308 wait complete. 2023-11-28T20:01:33.206 DEBUG:teuthology.orchestra.run.smithi179:> set -ex 2023-11-28T20:01:33.207 DEBUG:teuthology.orchestra.run.smithi179:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-28T20:01:33.217 DEBUG:teuthology.orchestra.run.smithi179:> set -ex 2023-11-28T20:01:33.217 DEBUG:teuthology.orchestra.run.smithi179:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-28T20:01:33.270 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-28T20:01:33.407 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:33.401+0000 7f917b2fe640 1 Processor -- start 2023-11-28T20:01:33.407 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:33.401+0000 7f917b2fe640 1 -- start start 2023-11-28T20:01:33.409 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:33.405+0000 7f917b2fe640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f91740c3b80 0x7f917406d690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:33.409 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:33.405+0000 7f917b2fe640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f91740c5300 0x7f917406c730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:33.409 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:33.405+0000 7f917b2fe640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f917406bb80 con 0x7f917406d2b0 2023-11-28T20:01:33.409 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:33.405+0000 7f917b2fe640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f917406cc70 con 0x7f91740c5300 2023-11-28T20:01:33.410 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:33.405+0000 7f917b2fe640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91740c5790 con 0x7f91740c3b80 2023-11-28T20:01:33.410 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:33.405+0000 7f917989b640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f91740c5300 0x7f917406c730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:33.410 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:33.405+0000 7f917989b640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f91740c5300 0x7f917406c730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:36296/0 (socket says 172.21.15.78:36296) 2023-11-28T20:01:33.410 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:33.405+0000 7f917989b640 1 -- 172.21.15.78:0/714529960 learned_addr learned my addr 172.21.15.78:0/714529960 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T20:01:33.410 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:33.405+0000 7f9178899640 1 --2- 172.21.15.78:0/714529960 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f91740c3b80 0x7f917406d690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:33.411 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:33.405+0000 7f917989b640 1 -- 172.21.15.78:0/714529960 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f91740c3b80 msgr2=0x7f917406d690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:01:33.411 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:33.405+0000 7f917989b640 1 --2- 172.21.15.78:0/714529960 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f91740c3b80 0x7f917406d690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:33.411 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:33.405+0000 7f917989b640 1 -- 172.21.15.78:0/714529960 >> v1:172.21.15.179:6789/0 conn(0x7f917406d2b0 legacy=0x7f917406c020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:01:33.411 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:33.405+0000 7f917989b640 1 -- 172.21.15.78:0/714529960 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91741515c0 con 0x7f91740c5300 2023-11-28T20:01:33.413 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:33.409+0000 7f917989b640 1 --2- 172.21.15.78:0/714529960 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f91740c5300 0x7f917406c730 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7f916c009e50 tx=0x7f916c01c9e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ceb1670d870716e8 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:01:33.413 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:33.409+0000 7f916bfff640 1 -- 172.21.15.78:0/714529960 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f916c0a57c0 con 0x7f91740c5300 2023-11-28T20:01:33.413 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:33.409+0000 7f916bfff640 1 -- 172.21.15.78:0/714529960 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f916c0a5920 con 0x7f91740c5300 2023-11-28T20:01:33.413 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:33.409+0000 7f916bfff640 1 -- 172.21.15.78:0/714529960 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f916c0a5cb0 con 0x7f91740c5300 2023-11-28T20:01:33.413 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:33.409+0000 7f917b2fe640 1 -- 172.21.15.78:0/714529960 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f91740c5300 msgr2=0x7f917406c730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:01:33.414 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:33.409+0000 7f917b2fe640 1 --2- 172.21.15.78:0/714529960 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f91740c5300 0x7f917406c730 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7f916c009e50 tx=0x7f916c01c9e0 comp rx=0 tx=0).stop 2023-11-28T20:01:33.414 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:33.409+0000 7f917b2fe640 1 -- 172.21.15.78:0/714529960 shutdown_connections 2023-11-28T20:01:33.414 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:33.409+0000 7f917b2fe640 1 --2- 172.21.15.78:0/714529960 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f91740c5300 0x7f917406c730 unknown :-1 s=CLOSED pgs=708 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:33.414 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:33.409+0000 7f917b2fe640 1 --2- 172.21.15.78:0/714529960 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f91740c3b80 0x7f917406d690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:33.414 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:33.409+0000 7f917b2fe640 1 -- 172.21.15.78:0/714529960 >> 172.21.15.78:0/714529960 conn(0x7f91740a7810 msgr2=0x7f91740a7c20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:01:33.414 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:33.409+0000 7f917b2fe640 1 -- 172.21.15.78:0/714529960 shutdown_connections 2023-11-28T20:01:33.414 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:33.409+0000 7f917b2fe640 1 -- 172.21.15.78:0/714529960 wait complete. 2023-11-28T20:01:33.415 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:33.409+0000 7f917b2fe640 1 Processor -- start 2023-11-28T20:01:33.415 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:33.409+0000 7f917b2fe640 1 -- start start 2023-11-28T20:01:33.417 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:33.413+0000 7f917b2fe640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f917406d2b0 0x7f9174150da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:33.417 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:33.413+0000 7f917b2fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f91740c3b80 0x7f91740c0500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:33.417 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:33.413+0000 7f917b2fe640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f91740c5300 0x7f9174146990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:33.417 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:33.413+0000 7f917b2fe640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91741512e0 con 0x7f91740c3b80 2023-11-28T20:01:33.417 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:33.413+0000 7f917b2fe640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f917415dea0 con 0x7f91740c5300 2023-11-28T20:01:33.418 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:33.413+0000 7f917b2fe640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91741ed010 con 0x7f917406d2b0 2023-11-28T20:01:33.418 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:33.413+0000 7f9178899640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f91740c3b80 0x7f91740c0500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:33.418 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:33.413+0000 7f9178899640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f91740c3b80 0x7f91740c0500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:36312/0 (socket says 172.21.15.78:36312) 2023-11-28T20:01:33.419 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:33.413+0000 7f9178899640 1 -- 172.21.15.78:0/1907392577 learned_addr learned my addr 172.21.15.78:0/1907392577 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T20:01:33.419 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:33.413+0000 7f917909a640 1 --2- 172.21.15.78:0/1907392577 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f917406d2b0 0x7f9174150da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:33.419 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:33.413+0000 7f917989b640 1 --2- 172.21.15.78:0/1907392577 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f91740c5300 0x7f9174146990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:33.420 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:33.413+0000 7f9178899640 1 -- 172.21.15.78:0/1907392577 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f917406d2b0 msgr2=0x7f9174150da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:01:33.420 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:33.413+0000 7f9178899640 1 --2- 172.21.15.78:0/1907392577 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f917406d2b0 0x7f9174150da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:33.420 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:33.413+0000 7f9178899640 1 -- 172.21.15.78:0/1907392577 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f91740c5300 msgr2=0x7f9174146990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:01:33.420 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:33.413+0000 7f9178899640 1 --2- 172.21.15.78:0/1907392577 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f91740c5300 0x7f9174146990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:33.421 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:33.413+0000 7f9178899640 1 -- 172.21.15.78:0/1907392577 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f916c009b30 con 0x7f91740c3b80 2023-11-28T20:01:33.421 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:33.413+0000 7f9178899640 1 --2- 172.21.15.78:0/1907392577 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f91740c3b80 0x7f91740c0500 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7f916400d800 tx=0x7f916400dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:01:33.421 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:33.413+0000 7f9169ffb640 1 -- 172.21.15.78:0/1907392577 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f916400b6c0 con 0x7f91740c3b80 2023-11-28T20:01:33.421 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:33.413+0000 7f9169ffb640 1 -- 172.21.15.78:0/1907392577 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f916400b860 con 0x7f91740c3b80 2023-11-28T20:01:33.422 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:33.413+0000 7f917b2fe640 1 -- 172.21.15.78:0/1907392577 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f917414ef80 con 0x7f91740c3b80 2023-11-28T20:01:33.422 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:33.413+0000 7f9169ffb640 1 -- 172.21.15.78:0/1907392577 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f916400bc10 con 0x7f91740c3b80 2023-11-28T20:01:33.422 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:33.413+0000 7f917b2fe640 1 -- 172.21.15.78:0/1907392577 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f917415d850 con 0x7f91740c3b80 2023-11-28T20:01:33.423 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:33.413+0000 7f917b2fe640 1 -- 172.21.15.78:0/1907392577 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9174067630 con 0x7f91740c3b80 2023-11-28T20:01:33.423 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:33.413+0000 7f9169ffb640 1 -- 172.21.15.78:0/1907392577 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f916401e460 con 0x7f91740c3b80 2023-11-28T20:01:33.423 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:33.417+0000 7f9169ffb640 1 --2- 172.21.15.78:0/1907392577 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f91580664a0 0x7f9158068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:33.423 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:33.417+0000 7f9169ffb640 1 -- 172.21.15.78:0/1907392577 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 6885+0+0 (secure 0 0 0) 0x7f91640846f0 con 0x7f91740c3b80 2023-11-28T20:01:33.423 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:33.417+0000 7f917909a640 1 --2- 172.21.15.78:0/1907392577 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f91580664a0 0x7f9158068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:33.424 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:33.417+0000 7f917909a640 1 --2- 172.21.15.78:0/1907392577 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f91580664a0 0x7f9158068960 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f9170007fd0 tx=0x7f9170009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:01:33.424 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:33.421+0000 7f9169ffb640 1 -- 172.21.15.78:0/1907392577 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f9164051810 con 0x7f91740c3b80 2023-11-28T20:01:33.577 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:33.573+0000 7f917b2fe640 1 -- 172.21.15.78:0/1907392577 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f917415dfe0 con 0x7f91740c3b80 2023-11-28T20:01:33.578 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:33.573+0000 7f9169ffb640 1 -- 172.21.15.78:0/1907392577 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v65) v1 ==== 74+0+20410 (secure 0 0 0) 0x7f9164054e30 con 0x7f91740c3b80 2023-11-28T20:01:33.578 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-11-28T20:01:33.579 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":65,"fsid":"dd9780e8-3bda-44fa-a9f0-fa07d19d901d","created":"2023-11-28T19:58:40.969556+0000","modified":"2023-11-28T20:01:24.807489+0000","last_up_change":"2023-11-28T19:58:52.596716+0000","last_in_change":"2023-11-28T19:58:43.609275+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":12,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-28T19:58:54.011229+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_metadata","create_time":"2023-11-28T20:01:07.969267+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"60","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_data","create_time":"2023-11-28T20:01:08.865465+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"61","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs2_metadata","create_time":"2023-11-28T20:01:20.863763+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"64","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs2_data","create_time":"2023-11-28T20:01:22.176918+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"65","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs2"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e84245ac-b5da-429e-af18-39acaa2b33e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6800","nonce":3358701235},{"type":"v1","addr":"172.21.15.78:6801","nonce":3358701235}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6802","nonce":3358701235},{"type":"v1","addr":"172.21.15.78:6803","nonce":3358701235}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6806","nonce":3358701235},{"type":"v1","addr":"172.21.15.78:6807","nonce":3358701235}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6804","nonce":3358701235},{"type":"v1","addr":"172.21.15.78:6805","nonce":3358701235}]},"public_addr":"172.21.15.78:6801/3358701235","cluster_addr":"172.21.15.78:6803/3358701235","heartbeat_back_addr":"172.21.15.78:6807/3358701235","heartbeat_front_addr":"172.21.15.78:6805/3358701235","state":["exists","up"]},{"osd":1,"uuid":"e634831d-c4e2-48d9-870c-9556ae162981","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6808","nonce":3211476654},{"type":"v1","addr":"172.21.15.78:6809","nonce":3211476654}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6810","nonce":3211476654},{"type":"v1","addr":"172.21.15.78:6811","nonce":3211476654}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6814","nonce":3211476654},{"type":"v1","addr":"172.21.15.78:6815","nonce":3211476654}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6812","nonce":3211476654},{"type":"v1","addr":"172.21.15.78:6813","nonce":3211476654}]},"public_addr":"172.21.15.78:6809/3211476654","cluster_addr":"172.21.15.78:6811/3211476654","heartbeat_back_addr":"172.21.15.78:6815/3211476654","heartbeat_front_addr":"172.21.15.78:6813/3211476654","state":["exists","up"]},{"osd":2,"uuid":"274c8395-6534-41f0-b8fb-a00af8985aa8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6816","nonce":2532904479},{"type":"v1","addr":"172.21.15.78:6817","nonce":2532904479}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6818","nonce":2532904479},{"type":"v1","addr":"172.21.15.78:6819","nonce":2532904479}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6822","nonce":2532904479},{"type":"v1","addr":"172.21.15.78:6823","nonce":2532904479}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6820","nonce":2532904479},{"type":"v1","addr":"172.21.15.78:6821","nonce":2532904479}]},"public_addr":"172.21.15.78:6817/2532904479","cluster_addr":"172.21.15.78:6819/2532904479","heartbeat_back_addr":"172.21.15.78:6823/2532904479","heartbeat_front_addr":"172.21.15.78:6821/2532904479","state":["exists","up"]},{"osd":3,"uuid":"77acc9af-7d4d-4b18-8cf5-d62f5971b7c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6824","nonce":3442991267},{"type":"v1","addr":"172.21.15.78:6825","nonce":3442991267}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6826","nonce":3442991267},{"type":"v1","addr":"172.21.15.78:6827","nonce":3442991267}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6830","nonce":3442991267},{"type":"v1","addr":"172.21.15.78:6831","nonce":3442991267}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6828","nonce":3442991267},{"type":"v1","addr":"172.21.15.78:6829","nonce":3442991267}]},"public_addr":"172.21.15.78:6825/3442991267","cluster_addr":"172.21.15.78:6827/3442991267","heartbeat_back_addr":"172.21.15.78:6831/3442991267","heartbeat_front_addr":"172.21.15.78:6829/3442991267","state":["exists","up"]},{"osd":4,"uuid":"5c62bc66-6b34-4b7f-a66b-9a743969138c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":802983577},{"type":"v1","addr":"172.21.15.179:6809","nonce":802983577}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":802983577},{"type":"v1","addr":"172.21.15.179:6811","nonce":802983577}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":802983577},{"type":"v1","addr":"172.21.15.179:6815","nonce":802983577}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":802983577},{"type":"v1","addr":"172.21.15.179:6813","nonce":802983577}]},"public_addr":"172.21.15.179:6809/802983577","cluster_addr":"172.21.15.179:6811/802983577","heartbeat_back_addr":"172.21.15.179:6815/802983577","heartbeat_front_addr":"172.21.15.179:6813/802983577","state":["exists","up"]},{"osd":5,"uuid":"67db6d36-f684-4079-b0cd-82b4dd61461f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":518192887},{"type":"v1","addr":"172.21.15.179:6818","nonce":518192887}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":518192887},{"type":"v1","addr":"172.21.15.179:6822","nonce":518192887}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":518192887},{"type":"v1","addr":"172.21.15.179:6829","nonce":518192887}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6824","nonce":518192887},{"type":"v1","addr":"172.21.15.179:6826","nonce":518192887}]},"public_addr":"172.21.15.179:6818/518192887","cluster_addr":"172.21.15.179:6822/518192887","heartbeat_back_addr":"172.21.15.179:6829/518192887","heartbeat_front_addr":"172.21.15.179:6826/518192887","state":["exists","up"]},{"osd":6,"uuid":"12e670af-5a16-4c81-9f97-defa66cab967","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":815435378},{"type":"v1","addr":"172.21.15.179:6801","nonce":815435378}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":815435378},{"type":"v1","addr":"172.21.15.179:6803","nonce":815435378}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":815435378},{"type":"v1","addr":"172.21.15.179:6807","nonce":815435378}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":815435378},{"type":"v1","addr":"172.21.15.179:6805","nonce":815435378}]},"public_addr":"172.21.15.179:6801/815435378","cluster_addr":"172.21.15.179:6803/815435378","heartbeat_back_addr":"172.21.15.179:6807/815435378","heartbeat_front_addr":"172.21.15.179:6805/815435378","state":["exists","up"]},{"osd":7,"uuid":"fe630650-2eb3-49ad-8676-c341e6332eb1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6817","nonce":2848432339},{"type":"v1","addr":"172.21.15.179:6819","nonce":2848432339}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6821","nonce":2848432339},{"type":"v1","addr":"172.21.15.179:6823","nonce":2848432339}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":2848432339},{"type":"v1","addr":"172.21.15.179:6831","nonce":2848432339}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6825","nonce":2848432339},{"type":"v1","addr":"172.21.15.179:6827","nonce":2848432339}]},"public_addr":"172.21.15.179:6819/2848432339","cluster_addr":"172.21.15.179:6823/2848432339","heartbeat_back_addr":"172.21.15.179:6831/2848432339","heartbeat_front_addr":"172.21.15.179:6827/2848432339","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:58:49.255433+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:58:49.412880+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:58:49.559295+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:58:49.245237+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:58:49.184557+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:58:49.329851+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:58:49.366012+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:58:49.349604+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-28T20:01:33.580 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:33.577+0000 7f917b2fe640 1 -- 172.21.15.78:0/1907392577 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f91580664a0 msgr2=0x7f9158068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:01:33.581 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:33.577+0000 7f917b2fe640 1 --2- 172.21.15.78:0/1907392577 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f91580664a0 0x7f9158068960 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f9170007fd0 tx=0x7f9170009040 comp rx=0 tx=0).stop 2023-11-28T20:01:33.581 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:33.577+0000 7f917b2fe640 1 -- 172.21.15.78:0/1907392577 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f91740c3b80 msgr2=0x7f91740c0500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:01:33.581 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:33.577+0000 7f917b2fe640 1 --2- 172.21.15.78:0/1907392577 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f91740c3b80 0x7f91740c0500 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7f916400d800 tx=0x7f916400dcc0 comp rx=0 tx=0).stop 2023-11-28T20:01:33.581 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:33.577+0000 7f917b2fe640 1 -- 172.21.15.78:0/1907392577 shutdown_connections 2023-11-28T20:01:33.581 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:33.577+0000 7f917b2fe640 1 --2- 172.21.15.78:0/1907392577 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f91580664a0 0x7f9158068960 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:33.582 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:33.577+0000 7f917b2fe640 1 --2- 172.21.15.78:0/1907392577 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f91740c5300 0x7f9174146990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:33.582 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:33.577+0000 7f917b2fe640 1 --2- 172.21.15.78:0/1907392577 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f91740c3b80 0x7f91740c0500 unknown :-1 s=CLOSED pgs=709 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:33.582 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:33.577+0000 7f917b2fe640 1 --2- 172.21.15.78:0/1907392577 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f917406d2b0 0x7f9174150da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:33.582 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:33.577+0000 7f917b2fe640 1 -- 172.21.15.78:0/1907392577 >> 172.21.15.78:0/1907392577 conn(0x7f91740a7810 msgr2=0x7f9174071970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:01:33.583 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:33.577+0000 7f917b2fe640 1 -- 172.21.15.78:0/1907392577 shutdown_connections 2023-11-28T20:01:33.583 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:33.577+0000 7f917b2fe640 1 -- 172.21.15.78:0/1907392577 wait complete. 2023-11-28T20:01:33.600 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-28T19:58:54.011229+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 9, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-28T20:01:07.969267+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '60', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 10, 'pool_name': 'cephfs_data', 'create_time': '2023-11-28T20:01:08.865465+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '61', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 11, 'pool_name': 'cephfs2_metadata', 'create_time': '2023-11-28T20:01:20.863763+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '64', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs2'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 12, 'pool_name': 'cephfs2_data', 'create_time': '2023-11-28T20:01:22.176918+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '65', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs2'}}, 'read_balance': {'score_acting': 1.6299999952316284, 'score_stable': 1.6299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.6299999952316284, 'raw_score_stable': 1.6299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-28T20:01:33.601 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-28T20:01:33.743 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:33.737+0000 7f184d90f640 1 Processor -- start 2023-11-28T20:01:33.743 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:33.737+0000 7f184d90f640 1 -- start start 2023-11-28T20:01:33.744 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:33.737+0000 7f184d90f640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f184814b1e0 0x7f18480c1700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:33.744 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:33.737+0000 7f184d90f640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f18480c5300 0x7f18480a9c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:33.744 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:33.737+0000 7f184d90f640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f18480a4e20 con 0x7f1848151280 2023-11-28T20:01:33.744 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:33.737+0000 7f184d90f640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f18481558d0 con 0x7f184814b1e0 2023-11-28T20:01:33.744 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:33.737+0000 7f184d90f640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f18480a50e0 con 0x7f18480c5300 2023-11-28T20:01:33.744 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:33.737+0000 7f1846ffd640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f184814b1e0 0x7f18480c1700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:33.745 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:33.737+0000 7f1846ffd640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f184814b1e0 0x7f18480c1700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:36322/0 (socket says 172.21.15.78:36322) 2023-11-28T20:01:33.745 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:33.737+0000 7f1846ffd640 1 -- 172.21.15.78:0/2167195211 learned_addr learned my addr 172.21.15.78:0/2167195211 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T20:01:33.745 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:33.737+0000 7f183e7fc640 1 --2- 172.21.15.78:0/2167195211 >> v2:172.21.15.179:3300/0 conn(0x7f18480c5300 0x7f18480a9c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:33.745 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:33.741+0000 7f1846ffd640 1 -- 172.21.15.78:0/2167195211 >> v2:172.21.15.179:3300/0 conn(0x7f18480c5300 msgr2=0x7f18480a9c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:01:33.745 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:33.741+0000 7f1846ffd640 1 --2- 172.21.15.78:0/2167195211 >> v2:172.21.15.179:3300/0 conn(0x7f18480c5300 0x7f18480a9c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:33.746 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:33.741+0000 7f1846ffd640 1 -- 172.21.15.78:0/2167195211 >> v1:172.21.15.179:6789/0 conn(0x7f1848151280 legacy=0x7f18481516f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:01:33.746 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:33.741+0000 7f1846ffd640 1 -- 172.21.15.78:0/2167195211 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18480c0f00 con 0x7f184814b1e0 2023-11-28T20:01:33.747 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:33.741+0000 7f1846ffd640 1 --2- 172.21.15.78:0/2167195211 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f184814b1e0 0x7f18480c1700 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7f18480a9650 tx=0x7f183801c4c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b4d265e2eef76349 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:01:33.747 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:33.741+0000 7f18467fc640 1 -- 172.21.15.78:0/2167195211 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18380ab600 con 0x7f184814b1e0 2023-11-28T20:01:33.747 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:33.741+0000 7f18467fc640 1 -- 172.21.15.78:0/2167195211 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f18380a7050 con 0x7f184814b1e0 2023-11-28T20:01:33.748 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:33.741+0000 7f18467fc640 1 -- 172.21.15.78:0/2167195211 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18380ab980 con 0x7f184814b1e0 2023-11-28T20:01:33.749 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:33.745+0000 7f184d90f640 1 -- 172.21.15.78:0/2167195211 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f184814b1e0 msgr2=0x7f18480c1700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:01:33.749 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:33.745+0000 7f184d90f640 1 --2- 172.21.15.78:0/2167195211 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f184814b1e0 0x7f18480c1700 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7f18480a9650 tx=0x7f183801c4c0 comp rx=0 tx=0).stop 2023-11-28T20:01:33.749 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:33.745+0000 7f184d90f640 1 -- 172.21.15.78:0/2167195211 shutdown_connections 2023-11-28T20:01:33.749 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:33.745+0000 7f184d90f640 1 --2- 172.21.15.78:0/2167195211 >> v2:172.21.15.179:3300/0 conn(0x7f18480c5300 0x7f18480a9c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:33.749 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:33.745+0000 7f184d90f640 1 --2- 172.21.15.78:0/2167195211 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f184814b1e0 0x7f18480c1700 unknown :-1 s=CLOSED pgs=710 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:33.749 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:33.745+0000 7f184d90f640 1 -- 172.21.15.78:0/2167195211 >> 172.21.15.78:0/2167195211 conn(0x7f18480c59f0 msgr2=0x7f18480c5e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:01:33.750 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:33.745+0000 7f184d90f640 1 -- 172.21.15.78:0/2167195211 shutdown_connections 2023-11-28T20:01:33.750 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:33.745+0000 7f184d90f640 1 -- 172.21.15.78:0/2167195211 wait complete. 2023-11-28T20:01:33.752 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:33.745+0000 7f184d90f640 1 Processor -- start 2023-11-28T20:01:33.752 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:33.745+0000 7f184d90f640 1 -- start start 2023-11-28T20:01:33.752 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:33.745+0000 7f184d90f640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f18480c5300 0x7f1848141770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:33.752 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:33.745+0000 7f184d90f640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f184814b1e0 0x7f1848147570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:33.752 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:33.745+0000 7f184d90f640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1848151280 0x7f1848142210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:33.753 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:33.745+0000 7f184d90f640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1848144e80 con 0x7f18480c5300 2023-11-28T20:01:33.753 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:33.745+0000 7f184d90f640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1848145160 con 0x7f1848151280 2023-11-28T20:01:33.753 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:33.745+0000 7f184d90f640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1848145440 con 0x7f184814b1e0 2023-11-28T20:01:33.753 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:33.745+0000 7f1846ffd640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f18480c5300 0x7f1848141770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:33.754 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:33.745+0000 7f1846ffd640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f18480c5300 0x7f1848141770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:36324/0 (socket says 172.21.15.78:36324) 2023-11-28T20:01:33.754 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:33.745+0000 7f1846ffd640 1 -- 172.21.15.78:0/364386731 learned_addr learned my addr 172.21.15.78:0/364386731 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T20:01:33.754 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:33.745+0000 7f183e7fc640 1 --2- 172.21.15.78:0/364386731 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f184814b1e0 0x7f1848147570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:33.755 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:33.745+0000 7f1846ffd640 1 -- 172.21.15.78:0/364386731 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f184814b1e0 msgr2=0x7f1848147570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:01:33.755 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:33.745+0000 7f1846ffd640 1 --2- 172.21.15.78:0/364386731 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f184814b1e0 0x7f1848147570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:33.755 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:33.745+0000 7f1846ffd640 1 -- 172.21.15.78:0/364386731 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1848151280 msgr2=0x7f1848142210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:01:33.755 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:33.745+0000 7f18477fe640 1 --2- 172.21.15.78:0/364386731 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1848151280 0x7f1848142210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:33.755 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:33.745+0000 7f1846ffd640 1 --2- 172.21.15.78:0/364386731 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1848151280 0x7f1848142210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:33.756 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:33.745+0000 7f1846ffd640 1 -- 172.21.15.78:0/364386731 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18380094d0 con 0x7f18480c5300 2023-11-28T20:01:33.756 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:33.745+0000 7f18477fe640 1 --2- 172.21.15.78:0/364386731 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1848151280 0x7f1848142210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T20:01:33.756 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:33.749+0000 7f1846ffd640 1 --2- 172.21.15.78:0/364386731 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f18480c5300 0x7f1848141770 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7f18380ae040 tx=0x7f183801ad00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:01:33.756 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:33.749+0000 7f1844ff9640 1 -- 172.21.15.78:0/364386731 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18380b6420 con 0x7f18480c5300 2023-11-28T20:01:33.756 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:33.749+0000 7f1844ff9640 1 -- 172.21.15.78:0/364386731 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f18380b6580 con 0x7f18480c5300 2023-11-28T20:01:33.757 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:33.749+0000 7f1844ff9640 1 -- 172.21.15.78:0/364386731 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18380b6910 con 0x7f18480c5300 2023-11-28T20:01:33.757 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:33.749+0000 7f184d90f640 1 -- 172.21.15.78:0/364386731 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1848145720 con 0x7f18480c5300 2023-11-28T20:01:33.757 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:33.749+0000 7f184d90f640 1 -- 172.21.15.78:0/364386731 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f18480726e0 con 0x7f18480c5300 2023-11-28T20:01:33.759 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:33.749+0000 7f184d90f640 1 -- 172.21.15.78:0/364386731 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1848067630 con 0x7f18480c5300 2023-11-28T20:01:33.759 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:33.749+0000 7f1844ff9640 1 -- 172.21.15.78:0/364386731 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f18380b2040 con 0x7f18480c5300 2023-11-28T20:01:33.759 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:33.749+0000 7f1844ff9640 1 --2- 172.21.15.78:0/364386731 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f182c066470 0x7f182c068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:33.759 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:33.749+0000 7f1844ff9640 1 -- 172.21.15.78:0/364386731 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 6885+0+0 (secure 0 0 0) 0x7f183811e750 con 0x7f18480c5300 2023-11-28T20:01:33.759 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:33.749+0000 7f183e7fc640 1 --2- 172.21.15.78:0/364386731 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f182c066470 0x7f182c068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:33.759 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:33.749+0000 7f183e7fc640 1 --2- 172.21.15.78:0/364386731 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f182c066470 0x7f182c068930 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f1848150590 tx=0x7f1830008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:01:33.759 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:33.753+0000 7f1844ff9640 1 -- 172.21.15.78:0/364386731 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f18380eb720 con 0x7f18480c5300 2023-11-28T20:01:33.909 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:33.905+0000 7f184d90f640 1 -- 172.21.15.78:0/364386731 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f18480c6450 con 0x7f18480c5300 2023-11-28T20:01:33.909 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:33.905+0000 7f1844ff9640 1 -- 172.21.15.78:0/364386731 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v65) v1 ==== 93+0+10 (secure 0 0 0) 0x7f18380eed40 con 0x7f18480c5300 2023-11-28T20:01:33.909 INFO:teuthology.orchestra.run.smithi078.stdout:pg_num: 1 2023-11-28T20:01:33.911 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:33.905+0000 7f184d90f640 1 -- 172.21.15.78:0/364386731 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f182c066470 msgr2=0x7f182c068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:01:33.911 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:33.905+0000 7f184d90f640 1 --2- 172.21.15.78:0/364386731 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f182c066470 0x7f182c068930 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f1848150590 tx=0x7f1830008040 comp rx=0 tx=0).stop 2023-11-28T20:01:33.911 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:33.905+0000 7f184d90f640 1 -- 172.21.15.78:0/364386731 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f18480c5300 msgr2=0x7f1848141770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:01:33.912 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:33.905+0000 7f184d90f640 1 --2- 172.21.15.78:0/364386731 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f18480c5300 0x7f1848141770 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7f18380ae040 tx=0x7f183801ad00 comp rx=0 tx=0).stop 2023-11-28T20:01:33.912 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:33.905+0000 7f184d90f640 1 -- 172.21.15.78:0/364386731 shutdown_connections 2023-11-28T20:01:33.912 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:33.905+0000 7f184d90f640 1 --2- 172.21.15.78:0/364386731 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f182c066470 0x7f182c068930 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:33.912 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:33.905+0000 7f184d90f640 1 --2- 172.21.15.78:0/364386731 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f184814b1e0 0x7f1848147570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:33.912 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:33.905+0000 7f184d90f640 1 --2- 172.21.15.78:0/364386731 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1848151280 0x7f1848142210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:33.912 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:33.905+0000 7f184d90f640 1 --2- 172.21.15.78:0/364386731 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f18480c5300 0x7f1848141770 unknown :-1 s=CLOSED pgs=711 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:33.912 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:33.905+0000 7f184d90f640 1 -- 172.21.15.78:0/364386731 >> 172.21.15.78:0/364386731 conn(0x7f18480c59f0 msgr2=0x7f184814a110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:01:33.912 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:33.905+0000 7f184d90f640 1 -- 172.21.15.78:0/364386731 shutdown_connections 2023-11-28T20:01:33.913 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:33.905+0000 7f184d90f640 1 -- 172.21.15.78:0/364386731 wait complete. 2023-11-28T20:01:33.930 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-28T20:01:34.071 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:34.065+0000 7fe3e372a640 1 Processor -- start 2023-11-28T20:01:34.071 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:34.069+0000 7fe3e372a640 1 -- start start 2023-11-28T20:01:34.073 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:34.069+0000 7fe3e372a640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fe3dc14f850 0x7fe3dc0aacf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:34.073 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:34.069+0000 7fe3e372a640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fe3dc06d840 0x7fe3dc0c43e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:34.073 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:34.069+0000 7fe3e372a640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe3dc152910 con 0x7fe3dc14fc30 2023-11-28T20:01:34.073 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:34.069+0000 7fe3e372a640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe3dc0c2240 con 0x7fe3dc06d840 2023-11-28T20:01:34.073 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:34.069+0000 7fe3e372a640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe3dc152bf0 con 0x7fe3dc14f850 2023-11-28T20:01:34.073 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:34.069+0000 7fe3e0cc5640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7fe3dc14fc30 0x7fe3dc0c3cd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:37226/0 (socket says 172.21.15.78:37226) 2023-11-28T20:01:34.073 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:34.069+0000 7fe3e1cc7640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fe3dc06d840 0x7fe3dc0c43e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:34.073 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:34.069+0000 7fe3e0cc5640 1 -- 172.21.15.78:0/44680857 learned_addr learned my addr 172.21.15.78:0/44680857 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-11-28T20:01:34.074 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:34.069+0000 7fe3e14c6640 1 --2- 172.21.15.78:0/44680857 >> v2:172.21.15.179:3300/0 conn(0x7fe3dc14f850 0x7fe3dc0aacf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:34.074 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:34.069+0000 7fe3e1cc7640 1 -- 172.21.15.78:0/44680857 >> v2:172.21.15.179:3300/0 conn(0x7fe3dc14f850 msgr2=0x7fe3dc0aacf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:01:34.074 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:34.069+0000 7fe3e1cc7640 1 --2- 172.21.15.78:0/44680857 >> v2:172.21.15.179:3300/0 conn(0x7fe3dc14f850 0x7fe3dc0aacf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:34.074 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:34.069+0000 7fe3e1cc7640 1 -- 172.21.15.78:0/44680857 >> v1:172.21.15.78:6789/0 conn(0x7fe3dc14fc30 legacy=0x7fe3dc0c3cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:01:34.075 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:34.069+0000 7fe3d3fff640 1 -- 172.21.15.78:0/44680857 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2124730478 0 0) 0x7fe3dc152910 con 0x7fe3dc14fc30 2023-11-28T20:01:34.075 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:34.069+0000 7fe3e1cc7640 1 -- 172.21.15.78:0/44680857 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3dc152ed0 con 0x7fe3dc06d840 2023-11-28T20:01:34.077 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:34.073+0000 7fe3e1cc7640 1 --2- 172.21.15.78:0/44680857 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe3dc06d840 0x7fe3dc0c43e0 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7fe3dc066f50 tx=0x7fe3d401c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=90dde36e6b87a995 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:01:34.077 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:34.073+0000 7fe3d3fff640 1 -- 172.21.15.78:0/44680857 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3d40a59f0 con 0x7fe3dc06d840 2023-11-28T20:01:34.077 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:34.073+0000 7fe3d3fff640 1 -- 172.21.15.78:0/44680857 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe3d40a5b50 con 0x7fe3dc06d840 2023-11-28T20:01:34.077 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:34.073+0000 7fe3d3fff640 1 -- 172.21.15.78:0/44680857 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3d40ad440 con 0x7fe3dc06d840 2023-11-28T20:01:34.078 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:34.073+0000 7fe3e372a640 1 -- 172.21.15.78:0/44680857 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe3dc06d840 msgr2=0x7fe3dc0c43e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:01:34.078 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:34.073+0000 7fe3e372a640 1 --2- 172.21.15.78:0/44680857 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe3dc06d840 0x7fe3dc0c43e0 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7fe3dc066f50 tx=0x7fe3d401c910 comp rx=0 tx=0).stop 2023-11-28T20:01:34.078 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:34.073+0000 7fe3e372a640 1 -- 172.21.15.78:0/44680857 shutdown_connections 2023-11-28T20:01:34.078 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:34.073+0000 7fe3e372a640 1 --2- 172.21.15.78:0/44680857 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe3dc06d840 0x7fe3dc0c43e0 unknown :-1 s=CLOSED pgs=713 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:34.078 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:34.073+0000 7fe3e372a640 1 --2- 172.21.15.78:0/44680857 >> v2:172.21.15.179:3300/0 conn(0x7fe3dc14f850 0x7fe3dc0aacf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:34.078 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:34.073+0000 7fe3e372a640 1 -- 172.21.15.78:0/44680857 >> 172.21.15.78:0/44680857 conn(0x7fe3dc0c59f0 msgr2=0x7fe3dc0c5e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:01:34.078 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:34.073+0000 7fe3e372a640 1 -- 172.21.15.78:0/44680857 shutdown_connections 2023-11-28T20:01:34.078 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:34.073+0000 7fe3e372a640 1 -- 172.21.15.78:0/44680857 wait complete. 2023-11-28T20:01:34.079 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:34.077+0000 7fe3e372a640 1 Processor -- start 2023-11-28T20:01:34.079 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:34.077+0000 7fe3e372a640 1 -- start start 2023-11-28T20:01:34.081 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:34.077+0000 7fe3e372a640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe3dc06d840 0x7fe3dc151a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:34.081 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:34.077+0000 7fe3e372a640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe3dc14f850 0x7fe3dc1f0ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:34.081 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:34.077+0000 7fe3e372a640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe3dc14fc30 0x7fe3dc1f11e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:34.081 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:34.077+0000 7fe3e372a640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3dc0a96a0 con 0x7fe3dc14f850 2023-11-28T20:01:34.081 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:34.077+0000 7fe3e372a640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3dc0aa380 con 0x7fe3dc14fc30 2023-11-28T20:01:34.081 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:34.077+0000 7fe3e372a640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe3dc1f0810 con 0x7fe3dc06d840 2023-11-28T20:01:34.082 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:34.077+0000 7fe3e0cc5640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe3dc14f850 0x7fe3dc1f0ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:34.082 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:34.077+0000 7fe3e0cc5640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe3dc14f850 0x7fe3dc1f0ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:36348/0 (socket says 172.21.15.78:36348) 2023-11-28T20:01:34.082 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:34.077+0000 7fe3e0cc5640 1 -- 172.21.15.78:0/1703774837 learned_addr learned my addr 172.21.15.78:0/1703774837 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T20:01:34.082 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:34.077+0000 7fe3e0cc5640 1 -- 172.21.15.78:0/1703774837 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe3dc06d840 msgr2=0x7fe3dc151a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:01:34.082 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:34.077+0000 7fe3e0cc5640 1 --2- 172.21.15.78:0/1703774837 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe3dc06d840 0x7fe3dc151a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:34.082 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:34.077+0000 7fe3e0cc5640 1 -- 172.21.15.78:0/1703774837 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe3dc14fc30 msgr2=0x7fe3dc1f11e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:01:34.082 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:34.077+0000 7fe3e0cc5640 1 --2- 172.21.15.78:0/1703774837 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe3dc14fc30 0x7fe3dc1f11e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:34.082 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:34.077+0000 7fe3e0cc5640 1 -- 172.21.15.78:0/1703774837 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3d4009a70 con 0x7fe3dc14f850 2023-11-28T20:01:34.082 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:34.077+0000 7fe3e0cc5640 1 --2- 172.21.15.78:0/1703774837 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe3dc14f850 0x7fe3dc1f0ca0 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7fe3cc00c480 tx=0x7fe3cc00c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:01:34.083 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:34.077+0000 7fe3d1ffb640 1 -- 172.21.15.78:0/1703774837 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3cc0074e0 con 0x7fe3dc14f850 2023-11-28T20:01:34.083 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:34.077+0000 7fe3d1ffb640 1 -- 172.21.15.78:0/1703774837 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe3cc007660 con 0x7fe3dc14f850 2023-11-28T20:01:34.083 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:34.077+0000 7fe3e372a640 1 -- 172.21.15.78:0/1703774837 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe3dc0a6de0 con 0x7fe3dc14f850 2023-11-28T20:01:34.084 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:34.077+0000 7fe3d1ffb640 1 -- 172.21.15.78:0/1703774837 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3cc004a30 con 0x7fe3dc14f850 2023-11-28T20:01:34.084 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:34.077+0000 7fe3e372a640 1 -- 172.21.15.78:0/1703774837 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe3dc0a70a0 con 0x7fe3dc14f850 2023-11-28T20:01:34.084 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:34.077+0000 7fe3e372a640 1 -- 172.21.15.78:0/1703774837 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe3dc067630 con 0x7fe3dc14f850 2023-11-28T20:01:34.084 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:34.081+0000 7fe3d1ffb640 1 -- 172.21.15.78:0/1703774837 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fe3cc004b90 con 0x7fe3dc14f850 2023-11-28T20:01:34.085 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:34.081+0000 7fe3d1ffb640 1 --2- 172.21.15.78:0/1703774837 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fe3c0066470 0x7fe3c0068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:34.085 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:34.081+0000 7fe3d1ffb640 1 -- 172.21.15.78:0/1703774837 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 6885+0+0 (secure 0 0 0) 0x7fe3cc083500 con 0x7fe3dc14f850 2023-11-28T20:01:34.085 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:34.081+0000 7fe3e14c6640 1 --2- 172.21.15.78:0/1703774837 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fe3c0066470 0x7fe3c0068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:34.086 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:34.081+0000 7fe3e14c6640 1 --2- 172.21.15.78:0/1703774837 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fe3c0066470 0x7fe3c0068930 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7fe3d80098f0 tx=0x7fe3d8008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:01:34.089 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:34.085+0000 7fe3d1ffb640 1 -- 172.21.15.78:0/1703774837 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fe3cc053f60 con 0x7fe3dc14f850 2023-11-28T20:01:34.241 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:34.237+0000 7fe3e372a640 1 -- 172.21.15.78:0/1703774837 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fe3dc1f0950 con 0x7fe3dc14f850 2023-11-28T20:01:34.241 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:34.237+0000 7fe3d1ffb640 1 -- 172.21.15.78:0/1703774837 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v65) v1 ==== 104+0+11 (secure 0 0 0) 0x7fe3cc053af0 con 0x7fe3dc14f850 2023-11-28T20:01:34.242 INFO:teuthology.orchestra.run.smithi078.stdout:pg_num: 32 2023-11-28T20:01:34.243 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:34.237+0000 7fe3e372a640 1 -- 172.21.15.78:0/1703774837 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fe3c0066470 msgr2=0x7fe3c0068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:01:34.243 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:34.237+0000 7fe3e372a640 1 --2- 172.21.15.78:0/1703774837 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fe3c0066470 0x7fe3c0068930 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7fe3d80098f0 tx=0x7fe3d8008040 comp rx=0 tx=0).stop 2023-11-28T20:01:34.243 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:34.237+0000 7fe3e372a640 1 -- 172.21.15.78:0/1703774837 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe3dc14f850 msgr2=0x7fe3dc1f0ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:01:34.244 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:34.237+0000 7fe3e372a640 1 --2- 172.21.15.78:0/1703774837 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe3dc14f850 0x7fe3dc1f0ca0 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7fe3cc00c480 tx=0x7fe3cc00c940 comp rx=0 tx=0).stop 2023-11-28T20:01:34.244 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:34.237+0000 7fe3e372a640 1 -- 172.21.15.78:0/1703774837 shutdown_connections 2023-11-28T20:01:34.244 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:34.237+0000 7fe3e372a640 1 --2- 172.21.15.78:0/1703774837 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fe3c0066470 0x7fe3c0068930 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:34.244 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:34.237+0000 7fe3e372a640 1 --2- 172.21.15.78:0/1703774837 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe3dc14fc30 0x7fe3dc1f11e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:34.244 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:34.237+0000 7fe3e372a640 1 --2- 172.21.15.78:0/1703774837 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe3dc14f850 0x7fe3dc1f0ca0 unknown :-1 s=CLOSED pgs=714 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:34.245 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:34.237+0000 7fe3e372a640 1 --2- 172.21.15.78:0/1703774837 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe3dc06d840 0x7fe3dc151a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:34.245 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:34.237+0000 7fe3e372a640 1 -- 172.21.15.78:0/1703774837 >> 172.21.15.78:0/1703774837 conn(0x7fe3dc0c59f0 msgr2=0x7fe3dc150330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:01:34.245 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:34.241+0000 7fe3e372a640 1 -- 172.21.15.78:0/1703774837 shutdown_connections 2023-11-28T20:01:34.245 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:34.241+0000 7fe3e372a640 1 -- 172.21.15.78:0/1703774837 wait complete. 2023-11-28T20:01:34.262 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-28T20:01:34.360 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T20:01:34.364 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T20:01:34.405 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:34.401+0000 7f9d1bf57640 1 Processor -- start 2023-11-28T20:01:34.405 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:34.401+0000 7f9d1bf57640 1 -- start start 2023-11-28T20:01:34.408 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:34.401+0000 7f9d1bf57640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f9d14151d80 0x7f9d14158560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:34.408 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:34.401+0000 7f9d1bf57640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f9d140c6210 0x7f9d140bf1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:34.408 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:34.401+0000 7f9d1bf57640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9d140c4b00 con 0x7f9d140bf6f0 2023-11-28T20:01:34.408 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:34.401+0000 7f9d1bf57640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9d140c9bf0 con 0x7f9d14151d80 2023-11-28T20:01:34.409 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:34.401+0000 7f9d1bf57640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9d140c5b60 con 0x7f9d140c6210 2023-11-28T20:01:34.409 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:34.401+0000 7f9d19cf3640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f9d14151d80 0x7f9d14158560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:34.409 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:34.401+0000 7f9d19cf3640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f9d14151d80 0x7f9d14158560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:36356/0 (socket says 172.21.15.78:36356) 2023-11-28T20:01:34.409 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:34.401+0000 7f9d19cf3640 1 -- 172.21.15.78:0/1901051147 learned_addr learned my addr 172.21.15.78:0/1901051147 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T20:01:34.409 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:34.401+0000 7f9d19cf3640 1 -- 172.21.15.78:0/1901051147 >> v2:172.21.15.179:3300/0 conn(0x7f9d140c6210 msgr2=0x7f9d140bf1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:01:34.409 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:34.401+0000 7f9d19cf3640 1 --2- 172.21.15.78:0/1901051147 >> v2:172.21.15.179:3300/0 conn(0x7f9d140c6210 0x7f9d140bf1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:34.409 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:34.401+0000 7f9d19cf3640 1 -- 172.21.15.78:0/1901051147 >> v1:172.21.15.179:6789/0 conn(0x7f9d140bf6f0 legacy=0x7f9d140c7cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:01:34.409 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:34.401+0000 7f9d19cf3640 1 -- 172.21.15.78:0/1901051147 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d140c4da0 con 0x7f9d14151d80 2023-11-28T20:01:34.411 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:34.405+0000 7f9d19cf3640 1 --2- 172.21.15.78:0/1901051147 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9d14151d80 0x7f9d14158560 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7f9d140672e0 tx=0x7f9d1001c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8f82c458e648ab7a server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:01:34.411 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:34.405+0000 7f9d18cf1640 1 -- 172.21.15.78:0/1901051147 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d100ab600 con 0x7f9d14151d80 2023-11-28T20:01:34.411 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:34.405+0000 7f9d18cf1640 1 -- 172.21.15.78:0/1901051147 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d100a7050 con 0x7f9d14151d80 2023-11-28T20:01:34.411 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:34.405+0000 7f9d18cf1640 1 -- 172.21.15.78:0/1901051147 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d100ab980 con 0x7f9d14151d80 2023-11-28T20:01:34.412 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:34.405+0000 7f9d1bf57640 1 -- 172.21.15.78:0/1901051147 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9d14151d80 msgr2=0x7f9d14158560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:01:34.412 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:34.405+0000 7f9d1bf57640 1 --2- 172.21.15.78:0/1901051147 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9d14151d80 0x7f9d14158560 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7f9d140672e0 tx=0x7f9d1001c430 comp rx=0 tx=0).stop 2023-11-28T20:01:34.412 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:34.405+0000 7f9d1bf57640 1 -- 172.21.15.78:0/1901051147 shutdown_connections 2023-11-28T20:01:34.412 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:34.405+0000 7f9d1bf57640 1 --2- 172.21.15.78:0/1901051147 >> v2:172.21.15.179:3300/0 conn(0x7f9d140c6210 0x7f9d140bf1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:34.412 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:34.405+0000 7f9d1bf57640 1 --2- 172.21.15.78:0/1901051147 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9d14151d80 0x7f9d14158560 unknown :-1 s=CLOSED pgs=715 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:34.412 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:34.405+0000 7f9d1bf57640 1 -- 172.21.15.78:0/1901051147 >> 172.21.15.78:0/1901051147 conn(0x7f9d140aba10 msgr2=0x7f9d140abe20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:01:34.412 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:34.405+0000 7f9d1bf57640 1 -- 172.21.15.78:0/1901051147 shutdown_connections 2023-11-28T20:01:34.412 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:34.405+0000 7f9d1bf57640 1 -- 172.21.15.78:0/1901051147 wait complete. 2023-11-28T20:01:34.413 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:34.409+0000 7f9d1bf57640 1 Processor -- start 2023-11-28T20:01:34.413 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:34.409+0000 7f9d1bf57640 1 -- start start 2023-11-28T20:01:34.414 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:34.409+0000 7f9d1bf57640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9d140bf6f0 0x7f9d140af460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:34.414 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:34.409+0000 7f9d1bf57640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9d140c6210 0x7f9d140af9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:34.414 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:34.409+0000 7f9d1bf57640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9d14151d80 0x7f9d14152710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:34.414 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:34.409+0000 7f9d1bf57640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d140aee90 con 0x7f9d140c6210 2023-11-28T20:01:34.414 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:34.409+0000 7f9d1bf57640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d14150f40 con 0x7f9d140bf6f0 2023-11-28T20:01:34.414 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:34.409+0000 7f9d1bf57640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d141f2550 con 0x7f9d14151d80 2023-11-28T20:01:34.414 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:34.409+0000 7f9d194f2640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9d140c6210 0x7f9d140af9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:34.414 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:34.409+0000 7f9d19cf3640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9d140bf6f0 0x7f9d140af460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:34.414 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:34.409+0000 7f9d19cf3640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9d140bf6f0 0x7f9d140af460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.78:39724/0 (socket says 172.21.15.78:39724) 2023-11-28T20:01:34.415 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:34.409+0000 7f9d19cf3640 1 -- 172.21.15.78:0/361043331 learned_addr learned my addr 172.21.15.78:0/361043331 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T20:01:34.415 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:34.409+0000 7f9d194f2640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9d140c6210 0x7f9d140af9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:36364/0 (socket says 172.21.15.78:36364) 2023-11-28T20:01:34.415 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:34.409+0000 7f9d1a4f4640 1 --2- 172.21.15.78:0/361043331 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9d14151d80 0x7f9d14152710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:34.416 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:34.409+0000 7f9d194f2640 1 -- 172.21.15.78:0/361043331 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9d14151d80 msgr2=0x7f9d14152710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:01:34.416 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:34.409+0000 7f9d194f2640 1 --2- 172.21.15.78:0/361043331 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9d14151d80 0x7f9d14152710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:34.416 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:34.409+0000 7f9d194f2640 1 -- 172.21.15.78:0/361043331 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9d140bf6f0 msgr2=0x7f9d140af460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:01:34.417 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:34.409+0000 7f9d194f2640 1 --2- 172.21.15.78:0/361043331 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9d140bf6f0 0x7f9d140af460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:34.417 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:34.409+0000 7f9d194f2640 1 -- 172.21.15.78:0/361043331 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d100094d0 con 0x7f9d140c6210 2023-11-28T20:01:34.417 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:34.409+0000 7f9d19cf3640 1 --2- 172.21.15.78:0/361043331 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9d140bf6f0 0x7f9d140af460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T20:01:34.418 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:34.409+0000 7f9d194f2640 1 --2- 172.21.15.78:0/361043331 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9d140c6210 0x7f9d140af9a0 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7f9d0400b410 tx=0x7f9d0400b810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:01:34.418 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:34.409+0000 7f9d0a7fc640 1 -- 172.21.15.78:0/361043331 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d04011830 con 0x7f9d140c6210 2023-11-28T20:01:34.418 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:34.409+0000 7f9d0a7fc640 1 -- 172.21.15.78:0/361043331 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d04011990 con 0x7f9d140c6210 2023-11-28T20:01:34.418 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:34.409+0000 7f9d1bf57640 1 -- 172.21.15.78:0/361043331 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9d141f2830 con 0x7f9d140c6210 2023-11-28T20:01:34.420 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:34.409+0000 7f9d0a7fc640 1 -- 172.21.15.78:0/361043331 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d04011d40 con 0x7f9d140c6210 2023-11-28T20:01:34.420 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:34.409+0000 7f9d1bf57640 1 -- 172.21.15.78:0/361043331 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9d14154b10 con 0x7f9d140c6210 2023-11-28T20:01:34.421 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:34.413+0000 7f9d1bf57640 1 -- 172.21.15.78:0/361043331 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9d1406d5c0 con 0x7f9d140c6210 2023-11-28T20:01:34.422 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:34.413+0000 7f9d0a7fc640 1 -- 172.21.15.78:0/361043331 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f9d0401a400 con 0x7f9d140c6210 2023-11-28T20:01:34.422 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:34.413+0000 7f9d0a7fc640 1 --2- 172.21.15.78:0/361043331 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f9cf8066470 0x7f9cf8068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:34.423 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:34.413+0000 7f9d0a7fc640 1 -- 172.21.15.78:0/361043331 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 6885+0+0 (secure 0 0 0) 0x7f9d04084270 con 0x7f9d140c6210 2023-11-28T20:01:34.423 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:34.413+0000 7f9d19cf3640 1 --2- 172.21.15.78:0/361043331 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f9cf8066470 0x7f9cf8068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:34.423 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:34.413+0000 7f9d19cf3640 1 --2- 172.21.15.78:0/361043331 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f9cf8066470 0x7f9cf8068930 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f9d10000c10 tx=0x7f9d100a6000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:01:34.424 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:34.417+0000 7f9d0a7fc640 1 -- 172.21.15.78:0/361043331 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f9d040512f0 con 0x7f9d140c6210 2023-11-28T20:01:34.577 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:34.573+0000 7f9d1bf57640 1 -- 172.21.15.78:0/361043331 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f9d140bed80 con 0x7f9d140c6210 2023-11-28T20:01:34.577 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:34.573+0000 7f9d0a7fc640 1 -- 172.21.15.78:0/361043331 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v65) v1 ==== 100+0+11 (secure 0 0 0) 0x7f9d04054910 con 0x7f9d140c6210 2023-11-28T20:01:34.578 INFO:teuthology.orchestra.run.smithi078.stdout:pg_num: 64 2023-11-28T20:01:34.579 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:34.573+0000 7f9d1bf57640 1 -- 172.21.15.78:0/361043331 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f9cf8066470 msgr2=0x7f9cf8068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:01:34.579 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:34.573+0000 7f9d1bf57640 1 --2- 172.21.15.78:0/361043331 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f9cf8066470 0x7f9cf8068930 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f9d10000c10 tx=0x7f9d100a6000 comp rx=0 tx=0).stop 2023-11-28T20:01:34.579 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:34.573+0000 7f9d1bf57640 1 -- 172.21.15.78:0/361043331 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9d140c6210 msgr2=0x7f9d140af9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:01:34.579 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:34.573+0000 7f9d1bf57640 1 --2- 172.21.15.78:0/361043331 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9d140c6210 0x7f9d140af9a0 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7f9d0400b410 tx=0x7f9d0400b810 comp rx=0 tx=0).stop 2023-11-28T20:01:34.580 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:34.573+0000 7f9d1bf57640 1 -- 172.21.15.78:0/361043331 shutdown_connections 2023-11-28T20:01:34.580 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:34.573+0000 7f9d1bf57640 1 --2- 172.21.15.78:0/361043331 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f9cf8066470 0x7f9cf8068930 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:34.580 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:34.573+0000 7f9d1bf57640 1 --2- 172.21.15.78:0/361043331 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9d14151d80 0x7f9d14152710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:34.580 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:34.573+0000 7f9d1bf57640 1 --2- 172.21.15.78:0/361043331 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9d140c6210 0x7f9d140af9a0 unknown :-1 s=CLOSED pgs=716 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:34.580 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:34.573+0000 7f9d1bf57640 1 --2- 172.21.15.78:0/361043331 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9d140bf6f0 0x7f9d140af460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:34.580 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:34.573+0000 7f9d1bf57640 1 -- 172.21.15.78:0/361043331 >> 172.21.15.78:0/361043331 conn(0x7f9d140aba10 msgr2=0x7f9d1406c400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:01:34.580 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:34.577+0000 7f9d1bf57640 1 -- 172.21.15.78:0/361043331 shutdown_connections 2023-11-28T20:01:34.580 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:34.577+0000 7f9d1bf57640 1 -- 172.21.15.78:0/361043331 wait complete. 2023-11-28T20:01:34.598 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs2_metadata pg_num 2023-11-28T20:01:34.780 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:34.777+0000 7fe2411b8640 1 Processor -- start 2023-11-28T20:01:34.780 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:34.777+0000 7fe2411b8640 1 -- start start 2023-11-28T20:01:34.781 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:34.777+0000 7fe2411b8640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe23c14f850 0x7fe23c0aacf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:34.781 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:34.777+0000 7fe2411b8640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fe23c06d840 0x7fe23c0c43e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:34.781 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:34.777+0000 7fe2411b8640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe23c152910 con 0x7fe23c14fc30 2023-11-28T20:01:34.781 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:34.777+0000 7fe2411b8640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe23c0c2240 con 0x7fe23c06d840 2023-11-28T20:01:34.781 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:34.777+0000 7fe2411b8640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe23c152bf0 con 0x7fe23c14f850 2023-11-28T20:01:34.782 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:34.777+0000 7fe23ad9d640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe23c14f850 0x7fe23c0aacf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:34.782 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:34.777+0000 7fe23b59e640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fe23c06d840 0x7fe23c0c43e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:34.782 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:34.777+0000 7fe23a59c640 1 --1- >> v1:172.21.15.179:6789/0 conn(0x7fe23c14fc30 0x7fe23c0c3cd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.179:6789/0 says I am v1:172.21.15.78:48418/0 (socket says 172.21.15.78:48418) 2023-11-28T20:01:34.782 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:34.777+0000 7fe23a59c640 1 -- 172.21.15.78:0/4287718172 learned_addr learned my addr 172.21.15.78:0/4287718172 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-11-28T20:01:34.782 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:34.777+0000 7fe239d9b640 1 -- 172.21.15.78:0/4287718172 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3649309567 0 0) 0x7fe23c152910 con 0x7fe23c14fc30 2023-11-28T20:01:34.783 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:34.777+0000 7fe239d9b640 1 -- 172.21.15.78:0/4287718172 --> v1:172.21.15.179:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe224003530 con 0x7fe23c14fc30 2023-11-28T20:01:34.783 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:34.777+0000 7fe23ad9d640 1 -- 172.21.15.78:0/4287718172 >> v2:172.21.15.179:3300/0 conn(0x7fe23c06d840 msgr2=0x7fe23c0c43e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:01:34.783 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:34.777+0000 7fe23ad9d640 1 --2- 172.21.15.78:0/4287718172 >> v2:172.21.15.179:3300/0 conn(0x7fe23c06d840 0x7fe23c0c43e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:34.783 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:34.777+0000 7fe23ad9d640 1 -- 172.21.15.78:0/4287718172 >> v1:172.21.15.179:6789/0 conn(0x7fe23c14fc30 legacy=0x7fe23c0c3cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:01:34.783 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:34.777+0000 7fe23ad9d640 1 -- 172.21.15.78:0/4287718172 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe23c152ed0 con 0x7fe23c14f850 2023-11-28T20:01:34.783 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:34.777+0000 7fe23b59e640 1 --2- 172.21.15.78:0/4287718172 >> v2:172.21.15.179:3300/0 conn(0x7fe23c06d840 0x7fe23c0c43e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T20:01:34.785 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:34.781+0000 7fe23ad9d640 1 --2- 172.21.15.78:0/4287718172 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe23c14f850 0x7fe23c0aacf0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fe22c0097c0 tx=0x7fe22c01c480 comp rx=0 tx=0).ready entity=mon.2 client_cookie=96f7239a1aaa7ee9 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:01:34.785 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:34.781+0000 7fe239d9b640 1 -- 172.21.15.78:0/4287718172 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe22c0a6040 con 0x7fe23c14f850 2023-11-28T20:01:34.785 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:34.781+0000 7fe239d9b640 1 -- 172.21.15.78:0/4287718172 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe22c0aa600 con 0x7fe23c14f850 2023-11-28T20:01:34.786 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:34.781+0000 7fe239d9b640 1 -- 172.21.15.78:0/4287718172 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe22c0aa990 con 0x7fe23c14f850 2023-11-28T20:01:34.786 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:34.781+0000 7fe2411b8640 1 -- 172.21.15.78:0/4287718172 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe23c14f850 msgr2=0x7fe23c0aacf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:01:34.786 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:34.781+0000 7fe2411b8640 1 --2- 172.21.15.78:0/4287718172 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe23c14f850 0x7fe23c0aacf0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fe22c0097c0 tx=0x7fe22c01c480 comp rx=0 tx=0).stop 2023-11-28T20:01:34.787 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:34.781+0000 7fe2411b8640 1 -- 172.21.15.78:0/4287718172 shutdown_connections 2023-11-28T20:01:34.787 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:34.781+0000 7fe2411b8640 1 --2- 172.21.15.78:0/4287718172 >> v2:172.21.15.179:3300/0 conn(0x7fe23c06d840 0x7fe23c0c43e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:34.787 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:34.781+0000 7fe2411b8640 1 --2- 172.21.15.78:0/4287718172 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe23c14f850 0x7fe23c0aacf0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:34.787 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:34.781+0000 7fe2411b8640 1 -- 172.21.15.78:0/4287718172 >> 172.21.15.78:0/4287718172 conn(0x7fe23c0c59f0 msgr2=0x7fe23c0c5e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:01:34.787 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:34.781+0000 7fe2411b8640 1 -- 172.21.15.78:0/4287718172 shutdown_connections 2023-11-28T20:01:34.787 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:34.781+0000 7fe2411b8640 1 -- 172.21.15.78:0/4287718172 wait complete. 2023-11-28T20:01:34.788 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:34.785+0000 7fe2411b8640 1 Processor -- start 2023-11-28T20:01:34.788 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:34.785+0000 7fe2411b8640 1 -- start start 2023-11-28T20:01:34.790 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:34.785+0000 7fe2411b8640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe23c06d840 0x7fe23c072160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:34.790 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:34.785+0000 7fe2411b8640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe23c14f850 0x7fe23c1f1ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:34.790 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:34.785+0000 7fe2411b8640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe23c14fc30 0x7fe23c14a370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:34.790 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:34.785+0000 7fe2411b8640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe23c0708c0 con 0x7fe23c14fc30 2023-11-28T20:01:34.790 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:34.785+0000 7fe2411b8640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe23c06fac0 con 0x7fe23c14f850 2023-11-28T20:01:34.790 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:34.785+0000 7fe2411b8640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe23c1f1a10 con 0x7fe23c06d840 2023-11-28T20:01:34.790 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:34.785+0000 7fe23b59e640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe23c14fc30 0x7fe23c14a370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:34.790 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:34.785+0000 7fe23b59e640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe23c14fc30 0x7fe23c14a370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:36370/0 (socket says 172.21.15.78:36370) 2023-11-28T20:01:34.790 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:34.785+0000 7fe23b59e640 1 -- 172.21.15.78:0/1076918101 learned_addr learned my addr 172.21.15.78:0/1076918101 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T20:01:34.791 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:34.785+0000 7fe23a59c640 1 --2- 172.21.15.78:0/1076918101 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe23c14f850 0x7fe23c1f1ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:34.791 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:34.785+0000 7fe23ad9d640 1 --2- 172.21.15.78:0/1076918101 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe23c06d840 0x7fe23c072160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:34.791 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:34.785+0000 7fe23b59e640 1 -- 172.21.15.78:0/1076918101 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe23c06d840 msgr2=0x7fe23c072160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:01:34.791 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:34.785+0000 7fe23b59e640 1 --2- 172.21.15.78:0/1076918101 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe23c06d840 0x7fe23c072160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:34.791 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:34.785+0000 7fe23b59e640 1 -- 172.21.15.78:0/1076918101 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe23c14f850 msgr2=0x7fe23c1f1ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:01:34.791 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:34.785+0000 7fe23b59e640 1 --2- 172.21.15.78:0/1076918101 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe23c14f850 0x7fe23c1f1ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:34.792 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:34.785+0000 7fe23b59e640 1 -- 172.21.15.78:0/1076918101 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe234009a70 con 0x7fe23c14fc30 2023-11-28T20:01:34.792 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:34.785+0000 7fe23ad9d640 1 --2- 172.21.15.78:0/1076918101 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe23c06d840 0x7fe23c072160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T20:01:34.792 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:34.785+0000 7fe23b59e640 1 --2- 172.21.15.78:0/1076918101 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe23c14fc30 0x7fe23c14a370 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7fe23400ef90 tx=0x7fe234009f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:01:34.793 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:34.785+0000 7fe2237fe640 1 -- 172.21.15.78:0/1076918101 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe234009d70 con 0x7fe23c14fc30 2023-11-28T20:01:34.793 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:34.785+0000 7fe2237fe640 1 -- 172.21.15.78:0/1076918101 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe23400f040 con 0x7fe23c14fc30 2023-11-28T20:01:34.794 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:34.785+0000 7fe2237fe640 1 -- 172.21.15.78:0/1076918101 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2340146c0 con 0x7fe23c14fc30 2023-11-28T20:01:34.794 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:34.785+0000 7fe2411b8640 1 -- 172.21.15.78:0/1076918101 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe22c009420 con 0x7fe23c14fc30 2023-11-28T20:01:34.794 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:34.785+0000 7fe2411b8640 1 -- 172.21.15.78:0/1076918101 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe23c06fd10 con 0x7fe23c14fc30 2023-11-28T20:01:34.794 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:34.789+0000 7fe2411b8640 1 -- 172.21.15.78:0/1076918101 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe23c1f1b80 con 0x7fe23c14fc30 2023-11-28T20:01:34.794 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:34.789+0000 7fe2237fe640 1 -- 172.21.15.78:0/1076918101 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fe234014820 con 0x7fe23c14fc30 2023-11-28T20:01:34.794 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:34.789+0000 7fe2237fe640 1 --2- 172.21.15.78:0/1076918101 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fe2280664a0 0x7fe228068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:34.794 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:34.789+0000 7fe2237fe640 1 -- 172.21.15.78:0/1076918101 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 6885+0+0 (secure 0 0 0) 0x7fe234085190 con 0x7fe23c14fc30 2023-11-28T20:01:34.795 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:34.789+0000 7fe23ad9d640 1 --2- 172.21.15.78:0/1076918101 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fe2280664a0 0x7fe228068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:34.795 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:34.789+0000 7fe23ad9d640 1 --2- 172.21.15.78:0/1076918101 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fe2280664a0 0x7fe228068960 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7fe22c0ae000 tx=0x7fe22c0b5040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:01:34.797 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:34.793+0000 7fe2237fe640 1 -- 172.21.15.78:0/1076918101 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fe234052210 con 0x7fe23c14fc30 2023-11-28T20:01:34.945 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:34.941+0000 7fe2411b8640 1 -- 172.21.15.78:0/1076918101 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs2_metadata", "var": "pg_num"} v 0) v1 -- 0x7fe23c067630 con 0x7fe23c14fc30 2023-11-28T20:01:34.946 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:34.941+0000 7fe2237fe640 1 -- 172.21.15.78:0/1076918101 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs2_metadata", "var": "pg_num"}]=0 v65) v1 ==== 105+0+11 (secure 0 0 0) 0x7fe234055830 con 0x7fe23c14fc30 2023-11-28T20:01:34.947 INFO:teuthology.orchestra.run.smithi078.stdout:pg_num: 32 2023-11-28T20:01:34.948 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:34.945+0000 7fe2411b8640 1 -- 172.21.15.78:0/1076918101 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fe2280664a0 msgr2=0x7fe228068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:01:34.949 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:34.945+0000 7fe2411b8640 1 --2- 172.21.15.78:0/1076918101 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fe2280664a0 0x7fe228068960 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7fe22c0ae000 tx=0x7fe22c0b5040 comp rx=0 tx=0).stop 2023-11-28T20:01:34.949 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:34.945+0000 7fe2411b8640 1 -- 172.21.15.78:0/1076918101 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe23c14fc30 msgr2=0x7fe23c14a370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:01:34.949 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:34.945+0000 7fe2411b8640 1 --2- 172.21.15.78:0/1076918101 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe23c14fc30 0x7fe23c14a370 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7fe23400ef90 tx=0x7fe234009f90 comp rx=0 tx=0).stop 2023-11-28T20:01:34.949 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:34.945+0000 7fe2411b8640 1 -- 172.21.15.78:0/1076918101 shutdown_connections 2023-11-28T20:01:34.949 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:34.945+0000 7fe2411b8640 1 --2- 172.21.15.78:0/1076918101 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fe2280664a0 0x7fe228068960 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:34.950 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:34.945+0000 7fe2411b8640 1 --2- 172.21.15.78:0/1076918101 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe23c14fc30 0x7fe23c14a370 unknown :-1 s=CLOSED pgs=717 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:34.950 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:34.945+0000 7fe2411b8640 1 --2- 172.21.15.78:0/1076918101 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe23c14f850 0x7fe23c1f1ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:34.950 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:34.945+0000 7fe2411b8640 1 --2- 172.21.15.78:0/1076918101 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe23c06d840 0x7fe23c072160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:34.950 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:34.945+0000 7fe2411b8640 1 -- 172.21.15.78:0/1076918101 >> 172.21.15.78:0/1076918101 conn(0x7fe23c0c59f0 msgr2=0x7fe23c06cd10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:01:34.950 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:34.945+0000 7fe2411b8640 1 -- 172.21.15.78:0/1076918101 shutdown_connections 2023-11-28T20:01:34.951 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:34.945+0000 7fe2411b8640 1 -- 172.21.15.78:0/1076918101 wait complete. 2023-11-28T20:01:34.967 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs2_data pg_num 2023-11-28T20:01:35.109 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:35.105+0000 7fd58ee9e640 1 Processor -- start 2023-11-28T20:01:35.109 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:35.105+0000 7fd58ee9e640 1 -- start start 2023-11-28T20:01:35.110 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:35.105+0000 7fd58ee9e640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd58814b1e0 0x7fd5880c1700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:35.110 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:35.105+0000 7fd58ee9e640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd5880a4e20 con 0x7fd5881548c0 2023-11-28T20:01:35.110 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:35.105+0000 7fd58ee9e640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd5880a50e0 con 0x7fd5880c5300 2023-11-28T20:01:35.110 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:35.105+0000 7fd58ee9e640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd5880c0f00 con 0x7fd58814b1e0 2023-11-28T20:01:35.110 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:35.105+0000 7fd58d43b640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7fd5881548c0 0x7fd588154d50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:37238/0 (socket says 172.21.15.78:37238) 2023-11-28T20:01:35.111 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:35.105+0000 7fd58d43b640 1 -- 172.21.15.78:0/778977744 learned_addr learned my addr 172.21.15.78:0/778977744 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-11-28T20:01:35.113 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:35.105+0000 7fd58cc3a640 1 --2- 172.21.15.78:0/778977744 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd58814b1e0 0x7fd5880c1700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:35.113 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:35.105+0000 7fd5877fe640 1 -- 172.21.15.78:0/778977744 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 877590034 0 0) 0x7fd5880a4e20 con 0x7fd5881548c0 2023-11-28T20:01:35.113 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:35.105+0000 7fd5877fe640 1 -- 172.21.15.78:0/778977744 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd578005740 con 0x7fd5881548c0 2023-11-28T20:01:35.113 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:35.105+0000 7fd5877fe640 1 -- 172.21.15.78:0/778977744 <== mon.0 v1:172.21.15.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3319662163 0 0) 0x7fd578005740 con 0x7fd5881548c0 2023-11-28T20:01:35.113 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:35.105+0000 7fd5877fe640 1 -- 172.21.15.78:0/778977744 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd58814b1e0 msgr2=0x7fd5880c1700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:01:35.113 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:35.105+0000 7fd5877fe640 1 --2- 172.21.15.78:0/778977744 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd58814b1e0 0x7fd5880c1700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:35.113 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:35.105+0000 7fd5877fe640 1 -- 172.21.15.78:0/778977744 >> v1:172.21.15.179:6789/0 conn(0x7fd5880c5300 legacy=0x7fd5880a9c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:01:35.114 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:35.109+0000 7fd5877fe640 1 -- 172.21.15.78:0/778977744 --> v1:172.21.15.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5880c11e0 con 0x7fd5881548c0 2023-11-28T20:01:35.114 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:35.109+0000 7fd5877fe640 1 -- 172.21.15.78:0/778977744 <== mon.0 v1:172.21.15.78:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3326804700 0 0) 0x7fd580001a20 con 0x7fd5881548c0 2023-11-28T20:01:35.114 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:35.109+0000 7fd5877fe640 1 -- 172.21.15.78:0/778977744 >> v1:172.21.15.78:6789/0 conn(0x7fd5881548c0 legacy=0x7fd588154d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:01:35.114 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:35.109+0000 7fd5877fe640 1 --2- 172.21.15.78:0/778977744 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd578005bc0 0x7fd578005fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:35.114 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:35.109+0000 7fd5877fe640 1 --2- 172.21.15.78:0/778977744 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd58814b1e0 0x7fd5780069e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:35.115 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:35.109+0000 7fd5877fe640 1 --2- 172.21.15.78:0/778977744 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd578006f20 0x7fd5780073a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:35.115 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:35.109+0000 7fd5877fe640 1 -- 172.21.15.78:0/778977744 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5880c0f00 con 0x7fd578006f20 2023-11-28T20:01:35.115 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:35.109+0000 7fd5877fe640 1 -- 172.21.15.78:0/778977744 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd57800dba0 con 0x7fd578005bc0 2023-11-28T20:01:35.115 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:35.109+0000 7fd5877fe640 1 -- 172.21.15.78:0/778977744 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd57800dd60 con 0x7fd58814b1e0 2023-11-28T20:01:35.115 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:35.109+0000 7fd58d43b640 1 --2- 172.21.15.78:0/778977744 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd578006f20 0x7fd5780073a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:35.115 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:35.109+0000 7fd58cc3a640 1 --2- 172.21.15.78:0/778977744 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd578005bc0 0x7fd578005fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:35.115 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:35.109+0000 7fd587fff640 1 --2- 172.21.15.78:0/778977744 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd58814b1e0 0x7fd5780069e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:35.116 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:35.109+0000 7fd58d43b640 1 -- 172.21.15.78:0/778977744 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd58814b1e0 msgr2=0x7fd5780069e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:01:35.116 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:35.109+0000 7fd58d43b640 1 --2- 172.21.15.78:0/778977744 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd58814b1e0 0x7fd5780069e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:35.116 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:35.109+0000 7fd58d43b640 1 -- 172.21.15.78:0/778977744 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd578005bc0 msgr2=0x7fd578005fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:01:35.116 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:35.109+0000 7fd58d43b640 1 --2- 172.21.15.78:0/778977744 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd578005bc0 0x7fd578005fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:35.116 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:35.109+0000 7fd58d43b640 1 -- 172.21.15.78:0/778977744 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd578005740 con 0x7fd578006f20 2023-11-28T20:01:35.117 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:35.109+0000 7fd58d43b640 1 --2- 172.21.15.78:0/778977744 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd578006f20 0x7fd5780073a0 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7fd5880c6a70 tx=0x7fd58001fa60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=26a83a3ec26f7c84 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:01:35.117 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:35.113+0000 7fd5877fe640 1 -- 172.21.15.78:0/778977744 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5800aa690 con 0x7fd578006f20 2023-11-28T20:01:35.117 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:35.113+0000 7fd5877fe640 1 -- 172.21.15.78:0/778977744 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd5800aa810 con 0x7fd578006f20 2023-11-28T20:01:35.117 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:35.113+0000 7fd5877fe640 1 -- 172.21.15.78:0/778977744 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5800aabc0 con 0x7fd578006f20 2023-11-28T20:01:35.117 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:35.113+0000 7fd58ee9e640 1 -- 172.21.15.78:0/778977744 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd578006f20 msgr2=0x7fd5780073a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:01:35.117 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:35.113+0000 7fd58ee9e640 1 --2- 172.21.15.78:0/778977744 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd578006f20 0x7fd5780073a0 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7fd5880c6a70 tx=0x7fd58001fa60 comp rx=0 tx=0).stop 2023-11-28T20:01:35.118 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:35.113+0000 7fd58d43b640 1 -- 172.21.15.78:0/778977744 reap_dead start 2023-11-28T20:01:35.118 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:35.113+0000 7fd58ee9e640 1 -- 172.21.15.78:0/778977744 shutdown_connections 2023-11-28T20:01:35.118 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:35.113+0000 7fd58ee9e640 1 -- 172.21.15.78:0/778977744 >> 172.21.15.78:0/778977744 conn(0x7fd5880c59f0 msgr2=0x7fd5880c5e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:01:35.118 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:35.113+0000 7fd58ee9e640 1 -- 172.21.15.78:0/778977744 shutdown_connections 2023-11-28T20:01:35.118 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:35.113+0000 7fd58ee9e640 1 -- 172.21.15.78:0/778977744 wait complete. 2023-11-28T20:01:35.120 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:35.113+0000 7fd58ee9e640 1 Processor -- start 2023-11-28T20:01:35.120 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:35.113+0000 7fd58ee9e640 1 -- start start 2023-11-28T20:01:35.120 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:35.113+0000 7fd58ee9e640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd578006f20 0x7fd588072280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:35.120 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:35.113+0000 7fd58ee9e640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd588147200 0x7fd5881461e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:35.120 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:35.113+0000 7fd58ee9e640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd588146720 0x7fd58814c110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:35.121 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:35.113+0000 7fd58ee9e640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd58814f270 con 0x7fd588147200 2023-11-28T20:01:35.121 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:35.113+0000 7fd58ee9e640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd588146cd0 con 0x7fd578006f20 2023-11-28T20:01:35.121 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:35.113+0000 7fd58ee9e640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd588070e00 con 0x7fd588146720 2023-11-28T20:01:35.121 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:35.113+0000 7fd587fff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd588147200 0x7fd5881461e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:35.121 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:35.113+0000 7fd587fff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd588147200 0x7fd5881461e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:36380/0 (socket says 172.21.15.78:36380) 2023-11-28T20:01:35.121 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:35.113+0000 7fd587fff640 1 -- 172.21.15.78:0/3086862171 learned_addr learned my addr 172.21.15.78:0/3086862171 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T20:01:35.121 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:35.117+0000 7fd58cc3a640 1 --2- 172.21.15.78:0/3086862171 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd578006f20 0x7fd588072280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:35.121 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:35.117+0000 7fd58d43b640 1 --2- 172.21.15.78:0/3086862171 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd588146720 0x7fd58814c110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:35.121 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:35.117+0000 7fd587fff640 1 -- 172.21.15.78:0/3086862171 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd588146720 msgr2=0x7fd58814c110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:01:35.122 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:35.117+0000 7fd587fff640 1 --2- 172.21.15.78:0/3086862171 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd588146720 0x7fd58814c110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:35.122 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:35.117+0000 7fd587fff640 1 -- 172.21.15.78:0/3086862171 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd578006f20 msgr2=0x7fd588072280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:01:35.122 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:35.117+0000 7fd587fff640 1 --2- 172.21.15.78:0/3086862171 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd578006f20 0x7fd588072280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:35.122 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:35.117+0000 7fd587fff640 1 -- 172.21.15.78:0/3086862171 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd588146f20 con 0x7fd588147200 2023-11-28T20:01:35.122 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:35.117+0000 7fd587fff640 1 --2- 172.21.15.78:0/3086862171 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd588147200 0x7fd5881461e0 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7fd57400f850 tx=0x7fd57400fc50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:01:35.122 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:35.117+0000 7fd5857fa640 1 -- 172.21.15.78:0/3086862171 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5740050d0 con 0x7fd588147200 2023-11-28T20:01:35.122 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:35.117+0000 7fd5857fa640 1 -- 172.21.15.78:0/3086862171 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd574005230 con 0x7fd588147200 2023-11-28T20:01:35.122 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:35.117+0000 7fd58ee9e640 1 -- 172.21.15.78:0/3086862171 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd5880704d0 con 0x7fd588147200 2023-11-28T20:01:35.123 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:35.117+0000 7fd5857fa640 1 -- 172.21.15.78:0/3086862171 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd57400d6d0 con 0x7fd588147200 2023-11-28T20:01:35.123 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:35.117+0000 7fd58ee9e640 1 -- 172.21.15.78:0/3086862171 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd588070a90 con 0x7fd588147200 2023-11-28T20:01:35.124 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:35.117+0000 7fd58ee9e640 1 -- 172.21.15.78:0/3086862171 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd588070c50 con 0x7fd588147200 2023-11-28T20:01:35.124 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:35.117+0000 7fd5857fa640 1 -- 172.21.15.78:0/3086862171 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fd57400d830 con 0x7fd588147200 2023-11-28T20:01:35.124 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:35.117+0000 7fd5857fa640 1 --2- 172.21.15.78:0/3086862171 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fd56c0664a0 0x7fd56c068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:35.124 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:35.117+0000 7fd5857fa640 1 -- 172.21.15.78:0/3086862171 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 6885+0+0 (secure 0 0 0) 0x7fd5740841f0 con 0x7fd588147200 2023-11-28T20:01:35.124 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:35.117+0000 7fd58cc3a640 1 --2- 172.21.15.78:0/3086862171 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fd56c0664a0 0x7fd56c068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:35.124 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:35.121+0000 7fd58cc3a640 1 --2- 172.21.15.78:0/3086862171 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fd56c0664a0 0x7fd56c068960 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7fd57c009be0 tx=0x7fd57c009190 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:01:35.127 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:35.121+0000 7fd5857fa640 1 -- 172.21.15.78:0/3086862171 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fd5740511c0 con 0x7fd588147200 2023-11-28T20:01:35.280 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:35.277+0000 7fd58ee9e640 1 -- 172.21.15.78:0/3086862171 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs2_data", "var": "pg_num"} v 0) v1 -- 0x7fd588146b00 con 0x7fd588147200 2023-11-28T20:01:35.280 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:35.277+0000 7fd5857fa640 1 -- 172.21.15.78:0/3086862171 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs2_data", "var": "pg_num"}]=0 v65) v1 ==== 101+0+11 (secure 0 0 0) 0x7fd5740547e0 con 0x7fd588147200 2023-11-28T20:01:35.281 INFO:teuthology.orchestra.run.smithi078.stdout:pg_num: 64 2023-11-28T20:01:35.282 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:35.277+0000 7fd58ee9e640 1 -- 172.21.15.78:0/3086862171 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fd56c0664a0 msgr2=0x7fd56c068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:01:35.282 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:35.277+0000 7fd58ee9e640 1 --2- 172.21.15.78:0/3086862171 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fd56c0664a0 0x7fd56c068960 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7fd57c009be0 tx=0x7fd57c009190 comp rx=0 tx=0).stop 2023-11-28T20:01:35.282 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:35.277+0000 7fd58ee9e640 1 -- 172.21.15.78:0/3086862171 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd588147200 msgr2=0x7fd5881461e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:01:35.283 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:35.277+0000 7fd58ee9e640 1 --2- 172.21.15.78:0/3086862171 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd588147200 0x7fd5881461e0 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7fd57400f850 tx=0x7fd57400fc50 comp rx=0 tx=0).stop 2023-11-28T20:01:35.283 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:35.277+0000 7fd58ee9e640 1 -- 172.21.15.78:0/3086862171 shutdown_connections 2023-11-28T20:01:35.283 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:35.277+0000 7fd58ee9e640 1 --2- 172.21.15.78:0/3086862171 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fd56c0664a0 0x7fd56c068960 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:35.283 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:35.277+0000 7fd58ee9e640 1 --2- 172.21.15.78:0/3086862171 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd588146720 0x7fd58814c110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:35.283 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:35.277+0000 7fd58ee9e640 1 --2- 172.21.15.78:0/3086862171 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd588147200 0x7fd5881461e0 unknown :-1 s=CLOSED pgs=720 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:35.283 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:35.277+0000 7fd58ee9e640 1 --2- 172.21.15.78:0/3086862171 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd578006f20 0x7fd588072280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:35.283 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:35.277+0000 7fd58ee9e640 1 -- 172.21.15.78:0/3086862171 >> 172.21.15.78:0/3086862171 conn(0x7fd5880c59f0 msgr2=0x7fd588148ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:01:35.283 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:35.277+0000 7fd58ee9e640 1 -- 172.21.15.78:0/3086862171 shutdown_connections 2023-11-28T20:01:35.283 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:35.277+0000 7fd58ee9e640 1 -- 172.21.15.78:0/3086862171 wait complete. 2023-11-28T20:01:35.301 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-11-28T20:01:35.440 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:35.437+0000 7f9feae32640 1 Processor -- start 2023-11-28T20:01:35.440 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:35.437+0000 7f9feae32640 1 -- start start 2023-11-28T20:01:35.441 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:35.437+0000 7f9feae32640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f9fe40c2110 0x7f9fe40c5ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:35.441 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:35.437+0000 7f9feae32640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9fe40a93d0 con 0x7f9fe40c0c80 2023-11-28T20:01:35.441 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:35.437+0000 7f9feae32640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9fe40a9640 con 0x7f9fe4154390 2023-11-28T20:01:35.441 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:35.437+0000 7f9feae32640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9fe40aa1c0 con 0x7f9fe40c2110 2023-11-28T20:01:35.442 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:35.437+0000 7f9fe93cf640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f9fe40c0c80 0x7f9fe40c61e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:39426/0 (socket says 172.21.15.78:39426) 2023-11-28T20:01:35.442 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:35.437+0000 7f9fe3fff640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f9fe40c2110 0x7f9fe40c5ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:35.442 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:35.437+0000 7f9fe93cf640 1 -- 172.21.15.78:0/60543311 learned_addr learned my addr 172.21.15.78:0/60543311 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-11-28T20:01:35.442 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:35.437+0000 7f9fe3fff640 1 -- 172.21.15.78:0/60543311 >> v1:172.21.15.179:6789/0 conn(0x7f9fe4154390 legacy=0x7f9fe40c4a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:01:35.442 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:35.437+0000 7f9fe3fff640 1 -- 172.21.15.78:0/60543311 >> v1:172.21.15.78:6789/0 conn(0x7f9fe40c0c80 legacy=0x7f9fe40c61e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:01:35.443 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:35.437+0000 7f9fe3fff640 1 -- 172.21.15.78:0/60543311 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9fe40a9920 con 0x7f9fe40c2110 2023-11-28T20:01:35.445 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:35.441+0000 7f9fe3fff640 1 --2- 172.21.15.78:0/60543311 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9fe40c2110 0x7f9fe40c5ca0 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7f9fd00097c0 tx=0x7f9fd001c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6084e7c2e90530f8 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:01:35.445 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:35.441+0000 7f9fe37fe640 1 -- 172.21.15.78:0/60543311 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fd00a8050 con 0x7f9fe40c2110 2023-11-28T20:01:35.445 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:35.441+0000 7f9fe37fe640 1 -- 172.21.15.78:0/60543311 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9fd00ac5f0 con 0x7f9fe40c2110 2023-11-28T20:01:35.445 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:35.441+0000 7f9fe37fe640 1 -- 172.21.15.78:0/60543311 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fd00ac980 con 0x7f9fe40c2110 2023-11-28T20:01:35.446 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:35.441+0000 7f9feae32640 1 -- 172.21.15.78:0/60543311 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9fe40c2110 msgr2=0x7f9fe40c5ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:01:35.446 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:35.441+0000 7f9feae32640 1 --2- 172.21.15.78:0/60543311 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9fe40c2110 0x7f9fe40c5ca0 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7f9fd00097c0 tx=0x7f9fd001c480 comp rx=0 tx=0).stop 2023-11-28T20:01:35.446 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:35.441+0000 7f9feae32640 1 -- 172.21.15.78:0/60543311 shutdown_connections 2023-11-28T20:01:35.446 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:35.441+0000 7f9feae32640 1 --2- 172.21.15.78:0/60543311 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9fe40c2110 0x7f9fe40c5ca0 unknown :-1 s=CLOSED pgs=722 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:35.446 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:35.441+0000 7f9feae32640 1 -- 172.21.15.78:0/60543311 >> 172.21.15.78:0/60543311 conn(0x7f9fe406b220 msgr2=0x7f9fe40a77e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:01:35.446 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:35.441+0000 7f9feae32640 1 -- 172.21.15.78:0/60543311 shutdown_connections 2023-11-28T20:01:35.446 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:35.441+0000 7f9feae32640 1 -- 172.21.15.78:0/60543311 wait complete. 2023-11-28T20:01:35.447 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:35.445+0000 7f9feae32640 1 Processor -- start 2023-11-28T20:01:35.447 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:35.445+0000 7f9feae32640 1 -- start start 2023-11-28T20:01:35.449 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:35.445+0000 7f9feae32640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9fe40c0c80 0x7f9fe414d640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:35.449 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:35.445+0000 7f9feae32640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9fe40c2110 0x7f9fe40707b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:35.449 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:35.445+0000 7f9feae32640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9fe4154390 0x7f9fe4070cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:35.449 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:35.445+0000 7f9feae32640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9fe40724f0 con 0x7f9fe40c2110 2023-11-28T20:01:35.449 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:35.445+0000 7f9feae32640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9fe406fc00 con 0x7f9fe40c0c80 2023-11-28T20:01:35.450 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:35.445+0000 7f9feae32640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9fe4071230 con 0x7f9fe4154390 2023-11-28T20:01:35.450 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:35.445+0000 7f9fe3fff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9fe40c2110 0x7f9fe40707b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:35.450 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:35.445+0000 7f9fe3fff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9fe40c2110 0x7f9fe40707b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:55262/0 (socket says 172.21.15.78:55262) 2023-11-28T20:01:35.450 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:35.445+0000 7f9fe3fff640 1 -- 172.21.15.78:0/556850622 learned_addr learned my addr 172.21.15.78:0/556850622 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T20:01:35.450 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:35.445+0000 7f9fe3fff640 1 -- 172.21.15.78:0/556850622 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9fe4154390 msgr2=0x7f9fe4070cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:01:35.450 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:35.445+0000 7f9fe3fff640 1 --2- 172.21.15.78:0/556850622 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9fe4154390 0x7f9fe4070cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:35.450 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:35.445+0000 7f9fe3fff640 1 -- 172.21.15.78:0/556850622 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9fe40c0c80 msgr2=0x7f9fe414d640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:01:35.450 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:35.445+0000 7f9fe3fff640 1 --2- 172.21.15.78:0/556850622 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9fe40c0c80 0x7f9fe414d640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:35.450 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:35.445+0000 7f9fe3fff640 1 -- 172.21.15.78:0/556850622 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9fd0009420 con 0x7f9fe40c2110 2023-11-28T20:01:35.450 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:35.445+0000 7f9fe3fff640 1 --2- 172.21.15.78:0/556850622 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9fe40c2110 0x7f9fe40707b0 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x7f9fd001a0b0 tx=0x7f9fd0019220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:01:35.451 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:35.445+0000 7f9fe17fa640 1 -- 172.21.15.78:0/556850622 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fd00b5620 con 0x7f9fe40c2110 2023-11-28T20:01:35.451 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:35.445+0000 7f9fe17fa640 1 -- 172.21.15.78:0/556850622 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9fd00b5780 con 0x7f9fe40c2110 2023-11-28T20:01:35.451 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:35.445+0000 7f9fe17fa640 1 -- 172.21.15.78:0/556850622 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fd00b5b30 con 0x7f9fe40c2110 2023-11-28T20:01:35.451 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:35.445+0000 7f9feae32640 1 -- 172.21.15.78:0/556850622 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9fe4148300 con 0x7f9fe40c2110 2023-11-28T20:01:35.451 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:35.445+0000 7f9feae32640 1 -- 172.21.15.78:0/556850622 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9fe414fe00 con 0x7f9fe40c2110 2023-11-28T20:01:35.452 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:35.445+0000 7f9feae32640 1 -- 172.21.15.78:0/556850622 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9fe4067630 con 0x7f9fe40c2110 2023-11-28T20:01:35.452 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:35.449+0000 7f9fe17fa640 1 -- 172.21.15.78:0/556850622 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f9fd00b3040 con 0x7f9fe40c2110 2023-11-28T20:01:35.453 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:35.449+0000 7f9fe17fa640 1 --2- 172.21.15.78:0/556850622 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f9fc8066470 0x7f9fc8068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:35.453 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:35.449+0000 7f9fe17fa640 1 -- 172.21.15.78:0/556850622 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 6885+0+0 (secure 0 0 0) 0x7f9fd011e690 con 0x7f9fe40c2110 2023-11-28T20:01:35.453 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:35.449+0000 7f9fe8bce640 1 --2- 172.21.15.78:0/556850622 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f9fc8066470 0x7f9fc8068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:35.453 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:35.449+0000 7f9fe8bce640 1 --2- 172.21.15.78:0/556850622 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f9fc8066470 0x7f9fc8068930 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f9fd8000f70 tx=0x7f9fd80079c0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:01:35.456 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:35.453+0000 7f9fe17fa640 1 -- 172.21.15.78:0/556850622 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f9fd00eb660 con 0x7f9fe40c2110 2023-11-28T20:01:35.618 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:35.613+0000 7f9feae32640 1 -- 172.21.15.78:0/556850622 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f9fe4070590 con 0x7f9fe40c2110 2023-11-28T20:01:35.618 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:35.613+0000 7f9fe17fa640 1 -- 172.21.15.78:0/556850622 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v65) v1 ==== 80+0+0 (secure 0 0 0) 0x7f9fd00eec80 con 0x7f9fe40c2110 2023-11-28T20:01:35.618 INFO:teuthology.orchestra.run.smithi078.stderr:listed 0 entries 2023-11-28T20:01:35.620 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:35.617+0000 7f9feae32640 1 -- 172.21.15.78:0/556850622 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f9fc8066470 msgr2=0x7f9fc8068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:01:35.621 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:35.617+0000 7f9feae32640 1 --2- 172.21.15.78:0/556850622 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f9fc8066470 0x7f9fc8068930 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f9fd8000f70 tx=0x7f9fd80079c0 comp rx=0 tx=0).stop 2023-11-28T20:01:35.621 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:35.617+0000 7f9feae32640 1 -- 172.21.15.78:0/556850622 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9fe40c2110 msgr2=0x7f9fe40707b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:01:35.621 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:35.617+0000 7f9feae32640 1 --2- 172.21.15.78:0/556850622 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9fe40c2110 0x7f9fe40707b0 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x7f9fd001a0b0 tx=0x7f9fd0019220 comp rx=0 tx=0).stop 2023-11-28T20:01:35.621 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:35.617+0000 7f9feae32640 1 -- 172.21.15.78:0/556850622 shutdown_connections 2023-11-28T20:01:35.621 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:35.617+0000 7f9feae32640 1 --2- 172.21.15.78:0/556850622 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f9fc8066470 0x7f9fc8068930 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:35.621 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:35.617+0000 7f9feae32640 1 --2- 172.21.15.78:0/556850622 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9fe4154390 0x7f9fe4070cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:35.621 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:35.617+0000 7f9feae32640 1 --2- 172.21.15.78:0/556850622 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9fe40c2110 0x7f9fe40707b0 unknown :-1 s=CLOSED pgs=723 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:35.621 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:35.617+0000 7f9feae32640 1 --2- 172.21.15.78:0/556850622 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9fe40c0c80 0x7f9fe414d640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:35.621 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:35.617+0000 7f9feae32640 1 -- 172.21.15.78:0/556850622 >> 172.21.15.78:0/556850622 conn(0x7f9fe406b220 msgr2=0x7f9fe4151a00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:01:35.621 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:35.617+0000 7f9feae32640 1 -- 172.21.15.78:0/556850622 shutdown_connections 2023-11-28T20:01:35.621 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:35.617+0000 7f9feae32640 1 -- 172.21.15.78:0/556850622 wait complete. 2023-11-28T20:01:35.639 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2023-11-28T20:01:35.639 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T20:01:35.640 DEBUG:teuthology.orchestra.run.smithi179:> sudo umount /home/ubuntu/cephtest/mnt.1 2023-11-28T20:01:35.673 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi179.front.sepia.ceph.com 2023-11-28T20:01:35.674 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T20:01:35.674 DEBUG:teuthology.orchestra.run.smithi179:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-11-28T20:01:35.730 DEBUG:teuthology.orchestra.run.smithi179:> set -ex 2023-11-28T20:01:35.731 DEBUG:teuthology.orchestra.run.smithi179:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-28T20:01:35.787 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354628k,nr_inodes=4088657,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275376k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=3817 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275372k,nr_inodes=818843,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275376k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 2023-11-28T20:01:35.787 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-11-28T20:01:35.925 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:35.921+0000 7fd5b4a09640 1 Processor -- start 2023-11-28T20:01:35.926 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:35.921+0000 7fd5b4a09640 1 -- start start 2023-11-28T20:01:35.927 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:35.921+0000 7fd5b4a09640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd5b014e3f0 0x7fd5b00bfce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:35.927 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:35.921+0000 7fd5b4a09640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fd5b006bef0 0x7fd5b00c41f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:35.927 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:35.921+0000 7fd5b4a09640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fd5b00c4730 0x7fd5b006c5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:35.928 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:35.921+0000 7fd5b4a09640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd5b0151690 con 0x7fd5b006bef0 2023-11-28T20:01:35.928 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:35.921+0000 7fd5b4a09640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd5b0151bc0 con 0x7fd5b00c4730 2023-11-28T20:01:35.928 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:35.921+0000 7fd5b4a09640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd5b01518e0 con 0x7fd5b014e3f0 2023-11-28T20:01:35.928 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:35.921+0000 7fd5a7fff640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fd5b006bef0 0x7fd5b00c41f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:35.928 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:35.921+0000 7fd5a7fff640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fd5b006bef0 0x7fd5b00c41f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:55278/0 (socket says 172.21.15.78:55278) 2023-11-28T20:01:35.928 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:35.921+0000 7fd5a7fff640 1 -- 172.21.15.78:0/3729023866 learned_addr learned my addr 172.21.15.78:0/3729023866 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T20:01:35.928 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:35.921+0000 7fd5aed9d640 1 --2- 172.21.15.78:0/3729023866 >> v2:172.21.15.179:3300/0 conn(0x7fd5b00c4730 0x7fd5b006c5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:35.928 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:35.921+0000 7fd5ae59c640 1 --2- 172.21.15.78:0/3729023866 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd5b014e3f0 0x7fd5b00bfce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:35.928 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:35.925+0000 7fd5a7fff640 1 -- 172.21.15.78:0/3729023866 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd5b014e3f0 msgr2=0x7fd5b00bfce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:01:35.928 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:35.925+0000 7fd5a7fff640 1 --2- 172.21.15.78:0/3729023866 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd5b014e3f0 0x7fd5b00bfce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:35.928 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:35.925+0000 7fd5a7fff640 1 -- 172.21.15.78:0/3729023866 >> v2:172.21.15.179:3300/0 conn(0x7fd5b00c4730 msgr2=0x7fd5b006c5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:01:35.929 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:35.925+0000 7fd5a7fff640 1 --2- 172.21.15.78:0/3729023866 >> v2:172.21.15.179:3300/0 conn(0x7fd5b00c4730 0x7fd5b006c5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:35.929 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:35.925+0000 7fd5a7fff640 1 -- 172.21.15.78:0/3729023866 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5b00c1de0 con 0x7fd5b006bef0 2023-11-28T20:01:35.929 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:35.925+0000 7fd5aed9d640 1 --2- 172.21.15.78:0/3729023866 >> v2:172.21.15.179:3300/0 conn(0x7fd5b00c4730 0x7fd5b006c5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T20:01:35.930 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:35.925+0000 7fd5a7fff640 1 --2- 172.21.15.78:0/3729023866 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd5b006bef0 0x7fd5b00c41f0 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7fd5b00a5750 tx=0x7fd59801e650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=83347e7649e5423c server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:01:35.930 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:35.925+0000 7fd5add9b640 1 -- 172.21.15.78:0/3729023866 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5980ab5f0 con 0x7fd5b006bef0 2023-11-28T20:01:35.930 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:35.925+0000 7fd5add9b640 1 -- 172.21.15.78:0/3729023866 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd5980ab750 con 0x7fd5b006bef0 2023-11-28T20:01:35.931 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:35.925+0000 7fd5add9b640 1 -- 172.21.15.78:0/3729023866 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5980abae0 con 0x7fd5b006bef0 2023-11-28T20:01:35.932 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:35.925+0000 7fd5b4a09640 1 -- 172.21.15.78:0/3729023866 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd5b006bef0 msgr2=0x7fd5b00c41f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:01:35.932 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:35.925+0000 7fd5b4a09640 1 --2- 172.21.15.78:0/3729023866 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd5b006bef0 0x7fd5b00c41f0 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7fd5b00a5750 tx=0x7fd59801e650 comp rx=0 tx=0).stop 2023-11-28T20:01:35.932 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:35.925+0000 7fd5b4a09640 1 -- 172.21.15.78:0/3729023866 shutdown_connections 2023-11-28T20:01:35.932 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:35.925+0000 7fd5b4a09640 1 --2- 172.21.15.78:0/3729023866 >> v2:172.21.15.179:3300/0 conn(0x7fd5b00c4730 0x7fd5b006c5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:35.932 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:35.925+0000 7fd5b4a09640 1 --2- 172.21.15.78:0/3729023866 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd5b006bef0 0x7fd5b00c41f0 unknown :-1 s=CLOSED pgs=724 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:35.932 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:35.925+0000 7fd5b4a09640 1 --2- 172.21.15.78:0/3729023866 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd5b014e3f0 0x7fd5b00bfce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:35.932 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:35.925+0000 7fd5b4a09640 1 -- 172.21.15.78:0/3729023866 >> 172.21.15.78:0/3729023866 conn(0x7fd5b00a7810 msgr2=0x7fd5b00a7c20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:01:35.933 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:35.929+0000 7fd5b4a09640 1 -- 172.21.15.78:0/3729023866 shutdown_connections 2023-11-28T20:01:35.933 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:35.929+0000 7fd5b4a09640 1 -- 172.21.15.78:0/3729023866 wait complete. 2023-11-28T20:01:35.933 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:35.929+0000 7fd5b4a09640 1 Processor -- start 2023-11-28T20:01:35.933 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:35.929+0000 7fd5b4a09640 1 -- start start 2023-11-28T20:01:35.935 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:35.929+0000 7fd5b4a09640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd5b006bef0 0x7fd5b01ed1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:35.935 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:35.929+0000 7fd5b4a09640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd5b00c4730 0x7fd5b00bf0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:35.935 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:35.929+0000 7fd5b4a09640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd5b014e3f0 0x7fd5b00a57e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:35.935 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:35.929+0000 7fd5b4a09640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5b00a53c0 con 0x7fd5b006bef0 2023-11-28T20:01:35.935 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:35.929+0000 7fd5b4a09640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5b0154880 con 0x7fd5b014e3f0 2023-11-28T20:01:35.936 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:35.929+0000 7fd5b4a09640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd5b01ed700 con 0x7fd5b00c4730 2023-11-28T20:01:35.936 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:35.929+0000 7fd5ae59c640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd5b006bef0 0x7fd5b01ed1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:35.936 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:35.929+0000 7fd5ae59c640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd5b006bef0 0x7fd5b01ed1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:55290/0 (socket says 172.21.15.78:55290) 2023-11-28T20:01:35.936 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:35.929+0000 7fd5ae59c640 1 -- 172.21.15.78:0/3071416739 learned_addr learned my addr 172.21.15.78:0/3071416739 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T20:01:35.936 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:35.929+0000 7fd5ae59c640 1 -- 172.21.15.78:0/3071416739 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd5b00c4730 msgr2=0x7fd5b00bf0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:01:35.936 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:35.929+0000 7fd5ae59c640 1 --2- 172.21.15.78:0/3071416739 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd5b00c4730 0x7fd5b00bf0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:35.936 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:35.929+0000 7fd5ae59c640 1 -- 172.21.15.78:0/3071416739 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd5b014e3f0 msgr2=0x7fd5b00a57e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:01:35.936 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:35.929+0000 7fd5ae59c640 1 --2- 172.21.15.78:0/3071416739 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd5b014e3f0 0x7fd5b00a57e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:35.936 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:35.929+0000 7fd5ae59c640 1 -- 172.21.15.78:0/3071416739 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5980094d0 con 0x7fd5b006bef0 2023-11-28T20:01:35.936 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:35.929+0000 7fd5ae59c640 1 --2- 172.21.15.78:0/3071416739 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd5b006bef0 0x7fd5b01ed1c0 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7fd5a000d5f0 tx=0x7fd5a000dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:01:35.937 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:35.929+0000 7fd5a6ffd640 1 -- 172.21.15.78:0/3071416739 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5a00125f0 con 0x7fd5b006bef0 2023-11-28T20:01:35.937 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:35.929+0000 7fd5a6ffd640 1 -- 172.21.15.78:0/3071416739 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd5a0012750 con 0x7fd5b006bef0 2023-11-28T20:01:35.937 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:35.933+0000 7fd5a6ffd640 1 -- 172.21.15.78:0/3071416739 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5a0012ae0 con 0x7fd5b006bef0 2023-11-28T20:01:35.937 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:35.933+0000 7fd5b4a09640 1 -- 172.21.15.78:0/3071416739 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd5b00a6880 con 0x7fd5b006bef0 2023-11-28T20:01:35.937 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:35.933+0000 7fd5b4a09640 1 -- 172.21.15.78:0/3071416739 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd5b00a5070 con 0x7fd5b006bef0 2023-11-28T20:01:35.937 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:35.933+0000 7fd5b4a09640 1 -- 172.21.15.78:0/3071416739 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd5b00a5630 con 0x7fd5b006bef0 2023-11-28T20:01:35.938 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:35.933+0000 7fd5a6ffd640 1 -- 172.21.15.78:0/3071416739 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fd5a0012c40 con 0x7fd5b006bef0 2023-11-28T20:01:35.938 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:35.933+0000 7fd5a6ffd640 1 --2- 172.21.15.78:0/3071416739 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fd5900664a0 0x7fd590068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:35.938 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:35.933+0000 7fd5a6ffd640 1 -- 172.21.15.78:0/3071416739 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 6885+0+0 (secure 0 0 0) 0x7fd5a0084740 con 0x7fd5b006bef0 2023-11-28T20:01:35.938 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:35.933+0000 7fd5a7fff640 1 --2- 172.21.15.78:0/3071416739 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fd5900664a0 0x7fd590068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:35.939 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:35.933+0000 7fd5a7fff640 1 --2- 172.21.15.78:0/3071416739 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fd5900664a0 0x7fd590068960 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7fd5980b0000 tx=0x7fd598008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:01:35.943 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:35.937+0000 7fd5a6ffd640 1 -- 172.21.15.78:0/3071416739 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fd5a0051710 con 0x7fd5b006bef0 2023-11-28T20:01:36.131 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:36.125+0000 7fd5b4a09640 1 -- 172.21.15.78:0/3071416739 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fd5b00c5370 con 0x7fd5b006bef0 2023-11-28T20:01:36.131 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:36.125+0000 7fd5a6ffd640 1 -- 172.21.15.78:0/3071416739 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v36) v1 ==== 53+0+149 (secure 0 0 0) 0x7fd5a0007380 con 0x7fd5b006bef0 2023-11-28T20:01:36.132 INFO:teuthology.orchestra.run.smithi078.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-11-28T20:01:36.132 INFO:teuthology.orchestra.run.smithi078.stdout:name: cephfs2, metadata pool: cephfs2_metadata, data pools: [cephfs2_data ] 2023-11-28T20:01:36.133 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:36.129+0000 7fd5b4a09640 1 -- 172.21.15.78:0/3071416739 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fd5900664a0 msgr2=0x7fd590068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:01:36.133 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:36.129+0000 7fd5b4a09640 1 --2- 172.21.15.78:0/3071416739 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fd5900664a0 0x7fd590068960 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7fd5980b0000 tx=0x7fd598008040 comp rx=0 tx=0).stop 2023-11-28T20:01:36.133 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:36.129+0000 7fd5b4a09640 1 -- 172.21.15.78:0/3071416739 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd5b006bef0 msgr2=0x7fd5b01ed1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:01:36.133 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:36.129+0000 7fd5b4a09640 1 --2- 172.21.15.78:0/3071416739 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd5b006bef0 0x7fd5b01ed1c0 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7fd5a000d5f0 tx=0x7fd5a000dab0 comp rx=0 tx=0).stop 2023-11-28T20:01:36.134 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:36.129+0000 7fd5b4a09640 1 -- 172.21.15.78:0/3071416739 shutdown_connections 2023-11-28T20:01:36.134 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:36.129+0000 7fd5b4a09640 1 --2- 172.21.15.78:0/3071416739 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fd5900664a0 0x7fd590068960 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:36.134 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:36.129+0000 7fd5b4a09640 1 --2- 172.21.15.78:0/3071416739 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd5b00c4730 0x7fd5b00bf0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:36.134 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:36.129+0000 7fd5b4a09640 1 --2- 172.21.15.78:0/3071416739 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd5b014e3f0 0x7fd5b00a57e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:36.134 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:36.129+0000 7fd5b4a09640 1 --2- 172.21.15.78:0/3071416739 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd5b006bef0 0x7fd5b01ed1c0 unknown :-1 s=CLOSED pgs=725 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:36.134 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:36.129+0000 7fd5b4a09640 1 -- 172.21.15.78:0/3071416739 >> 172.21.15.78:0/3071416739 conn(0x7fd5b00a7810 msgr2=0x7fd5b00a7bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:01:36.134 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:36.129+0000 7fd5b4a09640 1 -- 172.21.15.78:0/3071416739 shutdown_connections 2023-11-28T20:01:36.135 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:36.129+0000 7fd5b4a09640 1 -- 172.21.15.78:0/3071416739 wait complete. 2023-11-28T20:01:36.152 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs2; just confirmed its presence on cluster 2023-11-28T20:01:36.153 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-11-28T20:01:36.153 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi179.front.sepia.ceph.com 2023-11-28T20:01:36.153 INFO:tasks.cephfs.mount:self.client.name = client.1 2023-11-28T20:01:36.153 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-11-28T20:01:36.153 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs2 2023-11-28T20:01:36.153 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-11-28T20:01:36.153 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-11-28T20:01:36.153 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-11-28T20:01:36.153 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T20:01:36.154 DEBUG:teuthology.orchestra.run.smithi179:> ip addr 2023-11-28T20:01:36.164 INFO:teuthology.orchestra.run.smithi179.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-11-28T20:01:36.164 INFO:teuthology.orchestra.run.smithi179.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-11-28T20:01:36.164 INFO:teuthology.orchestra.run.smithi179.stdout: inet 127.0.0.1/8 scope host lo 2023-11-28T20:01:36.164 INFO:teuthology.orchestra.run.smithi179.stdout: valid_lft forever preferred_lft forever 2023-11-28T20:01:36.164 INFO:teuthology.orchestra.run.smithi179.stdout: inet6 ::1/128 scope host 2023-11-28T20:01:36.164 INFO:teuthology.orchestra.run.smithi179.stdout: valid_lft forever preferred_lft forever 2023-11-28T20:01:36.165 INFO:teuthology.orchestra.run.smithi179.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-11-28T20:01:36.165 INFO:teuthology.orchestra.run.smithi179.stdout: link/ether 0c:c4:7a:d9:3b:34 brd ff:ff:ff:ff:ff:ff 2023-11-28T20:01:36.165 INFO:teuthology.orchestra.run.smithi179.stdout: altname enp7s0f0 2023-11-28T20:01:36.165 INFO:teuthology.orchestra.run.smithi179.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-11-28T20:01:36.165 INFO:teuthology.orchestra.run.smithi179.stdout: link/ether 0c:c4:7a:d9:3b:35 brd ff:ff:ff:ff:ff:ff 2023-11-28T20:01:36.165 INFO:teuthology.orchestra.run.smithi179.stdout: altname enp7s0f1 2023-11-28T20:01:36.165 INFO:teuthology.orchestra.run.smithi179.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-11-28T20:01:36.166 INFO:teuthology.orchestra.run.smithi179.stdout: link/ether 0c:c4:7a:88:72:5a brd ff:ff:ff:ff:ff:ff 2023-11-28T20:01:36.166 INFO:teuthology.orchestra.run.smithi179.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-11-28T20:01:36.166 INFO:teuthology.orchestra.run.smithi179.stdout: link/ether 0c:c4:7a:88:72:5b brd ff:ff:ff:ff:ff:ff 2023-11-28T20:01:36.166 INFO:teuthology.orchestra.run.smithi179.stdout: inet 172.21.15.179/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2023-11-28T20:01:36.167 INFO:teuthology.orchestra.run.smithi179.stdout: valid_lft 42286sec preferred_lft 42286sec 2023-11-28T20:01:36.167 INFO:teuthology.orchestra.run.smithi179.stdout: inet6 fe80::ec4:7aff:fe88:725b/64 scope link 2023-11-28T20:01:36.167 INFO:teuthology.orchestra.run.smithi179.stdout: valid_lft forever preferred_lft forever 2023-11-28T20:01:36.167 INFO:teuthology.orchestra.run.smithi179.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-11-28T20:01:36.167 INFO:teuthology.orchestra.run.smithi179.stdout: link/ether 02:42:75:f0:7b:8c brd ff:ff:ff:ff:ff:ff 2023-11-28T20:01:36.167 INFO:teuthology.orchestra.run.smithi179.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-11-28T20:01:36.168 INFO:teuthology.orchestra.run.smithi179.stdout: valid_lft forever preferred_lft forever 2023-11-28T20:01:36.168 INFO:teuthology.orchestra.run.smithi179.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-11-28T20:01:36.168 INFO:teuthology.orchestra.run.smithi179.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2023-11-28T20:01:36.168 INFO:teuthology.orchestra.run.smithi179.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-11-28T20:01:36.169 INFO:teuthology.orchestra.run.smithi179.stdout: valid_lft forever preferred_lft forever 2023-11-28T20:01:36.169 INFO:teuthology.orchestra.run.smithi179.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2023-11-28T20:01:36.169 INFO:teuthology.orchestra.run.smithi179.stdout: valid_lft forever preferred_lft forever 2023-11-28T20:01:36.170 INFO:teuthology.orchestra.run.smithi179.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-11-28T20:01:36.170 INFO:teuthology.orchestra.run.smithi179.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2023-11-28T20:01:36.170 INFO:teuthology.orchestra.run.smithi179.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2023-11-28T20:01:36.170 INFO:teuthology.orchestra.run.smithi179.stdout: valid_lft forever preferred_lft forever 2023-11-28T20:01:36.171 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T20:01:36.171 DEBUG:teuthology.orchestra.run.smithi179:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-11-28T20:01:36.233 INFO:teuthology.orchestra.run.smithi179.stdout:1 2023-11-28T20:01:36.235 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T20:01:36.235 DEBUG:teuthology.orchestra.run.smithi179:> route 2023-11-28T20:01:36.288 INFO:teuthology.orchestra.run.smithi179.stdout:Kernel IP routing table 2023-11-28T20:01:36.288 INFO:teuthology.orchestra.run.smithi179.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-11-28T20:01:36.288 INFO:teuthology.orchestra.run.smithi179.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2023-11-28T20:01:36.289 INFO:teuthology.orchestra.run.smithi179.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-11-28T20:01:36.289 INFO:teuthology.orchestra.run.smithi179.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-11-28T20:01:36.289 INFO:teuthology.orchestra.run.smithi179.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-11-28T20:01:36.289 INFO:teuthology.orchestra.run.smithi179.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-11-28T20:01:36.289 INFO:teuthology.orchestra.run.smithi179.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-11-28T20:01:36.290 INFO:teuthology.orchestra.run.smithi179.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-11-28T20:01:36.290 INFO:teuthology.orchestra.run.smithi179.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-11-28T20:01:36.290 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T20:01:36.290 DEBUG:teuthology.orchestra.run.smithi179:> (cd / && exec bash -c ' 2023-11-28T20:01:36.291 DEBUG:teuthology.orchestra.run.smithi179:> set -e 2023-11-28T20:01:36.291 DEBUG:teuthology.orchestra.run.smithi179:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-11-28T20:01:36.291 DEBUG:teuthology.orchestra.run.smithi179:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-11-28T20:01:36.291 DEBUG:teuthology.orchestra.run.smithi179:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-11-28T20:01:36.291 DEBUG:teuthology.orchestra.run.smithi179:> ') 2023-11-28T20:01:36.381 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T20:01:36.381 DEBUG:teuthology.orchestra.run.smithi179:> ip netns list 2023-11-28T20:01:36.391 INFO:teuthology.orchestra.run.smithi179.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-11-28T20:01:36.391 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-11-28T20:01:36.392 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T20:01:36.392 DEBUG:teuthology.orchestra.run.smithi179:> sudo ip link set brx.0 up 2023-11-28T20:01:36.454 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-28T20:01:36.454 DEBUG:teuthology.orchestra.run.smithi179:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2023-11-28T20:01:36.505 INFO:teuthology.orchestra.run.smithi179.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2023-11-28T20:01:36.505 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-28T20:01:36.505 DEBUG:teuthology.orchestra.run.smithi179:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2023-11-28T20:01:36.556 INFO:tasks.cephfs.kernel_mount:mounting using device: 1@.cephfs2=/ 2023-11-28T20:01:36.556 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T20:01:36.556 DEBUG:teuthology.orchestra.run.smithi179:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 1@.cephfs2=/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-11-28T20:01:36.647 INFO:teuthology.orchestra.run.smithi179.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-11-28T20:01:36.647 INFO:teuthology.orchestra.run.smithi179.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-11-28T20:01:36.660 INFO:teuthology.orchestra.run.smithi179.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-11-28T20:01:36.660 INFO:teuthology.orchestra.run.smithi179.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-11-28T20:01:36.660 INFO:teuthology.orchestra.run.smithi179.stdout:mount.ceph: resolved to: "172.21.15.78:3300,172.21.15.179:3300,172.21.15.179:3301" 2023-11-28T20:01:36.660 INFO:teuthology.orchestra.run.smithi179.stdout:mount.ceph: trying mount with new device syntax: 1@dd9780e8-3bda-44fa-a9f0-fa07d19d901d.cephfs2=/ 2023-11-28T20:01:36.660 INFO:teuthology.orchestra.run.smithi179.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,ms_mode=prefer-crc,key=1,mon_addr=172.21.15.78:3300/172.21.15.179:3300/172.21.15.179:3301" will pass to kernel 2023-11-28T20:01:36.663 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-11-28T20:01:36.663 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T20:01:36.664 DEBUG:teuthology.orchestra.run.smithi179:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-11-28T20:01:36.684 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T20:01:36.684 DEBUG:teuthology.orchestra.run.smithi179:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-11-28T20:01:36.742 INFO:teuthology.orchestra.run.smithi179.stdout:client6148 2023-11-28T20:01:36.742 DEBUG:teuthology.orchestra.run.smithi179:> set -ex 2023-11-28T20:01:36.742 DEBUG:teuthology.orchestra.run.smithi179:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-28T20:01:36.793 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth add client.testuser mon 'allow rw fsname=cephfs, allow rw fsname=cephfs2' osd 'allow rw tag cephfs data=cephfs, allow rw tag cephfs data=cephfs2' mds 'allow rw fsname=cephfs' 2023-11-28T20:01:36.938 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:36.933+0000 7fdce9116640 1 Processor -- start 2023-11-28T20:01:36.938 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:36.933+0000 7fdce9116640 1 -- start start 2023-11-28T20:01:36.939 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:36.933+0000 7fdce9116640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fdce414b1e0 0x7fdce40c1700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:36.939 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:36.933+0000 7fdce9116640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdce40c5300 0x7fdce40a9c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:36.939 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:36.933+0000 7fdce9116640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fdce4151280 0x7fdce4151710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:36.939 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:36.933+0000 7fdce9116640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdce40a4e20 con 0x7fdce414b1e0 2023-11-28T20:01:36.939 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:36.933+0000 7fdce9116640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdce40a50e0 con 0x7fdce4151280 2023-11-28T20:01:36.939 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:36.933+0000 7fdce9116640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdce40c0f00 con 0x7fdce40c5300 2023-11-28T20:01:36.940 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:36.933+0000 7fdce2d9d640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fdce414b1e0 0x7fdce40c1700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:36.940 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:36.933+0000 7fdce2d9d640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fdce414b1e0 0x7fdce40c1700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:55306/0 (socket says 172.21.15.78:55306) 2023-11-28T20:01:36.940 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:36.933+0000 7fdce2d9d640 1 -- 172.21.15.78:0/2613985234 learned_addr learned my addr 172.21.15.78:0/2613985234 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T20:01:36.940 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:36.937+0000 7fdce359e640 1 --2- 172.21.15.78:0/2613985234 >> v2:172.21.15.179:3300/0 conn(0x7fdce4151280 0x7fdce4151710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:36.940 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:36.937+0000 7fdcdbfff640 1 --2- 172.21.15.78:0/2613985234 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdce40c5300 0x7fdce40a9c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:36.940 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:36.937+0000 7fdce2d9d640 1 -- 172.21.15.78:0/2613985234 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdce40c5300 msgr2=0x7fdce40a9c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:01:36.940 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:36.937+0000 7fdce2d9d640 1 --2- 172.21.15.78:0/2613985234 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdce40c5300 0x7fdce40a9c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:36.941 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:36.937+0000 7fdce2d9d640 1 -- 172.21.15.78:0/2613985234 >> v2:172.21.15.179:3300/0 conn(0x7fdce4151280 msgr2=0x7fdce4151710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:01:36.941 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:36.937+0000 7fdce2d9d640 1 --2- 172.21.15.78:0/2613985234 >> v2:172.21.15.179:3300/0 conn(0x7fdce4151280 0x7fdce4151710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:36.941 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:36.937+0000 7fdce2d9d640 1 -- 172.21.15.78:0/2613985234 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdce40c11e0 con 0x7fdce414b1e0 2023-11-28T20:01:36.943 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:36.937+0000 7fdce2d9d640 1 --2- 172.21.15.78:0/2613985234 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdce414b1e0 0x7fdce40c1700 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7fdce40c3b30 tx=0x7fdcd401c500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f842c0cfebf9fcea server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:01:36.943 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:36.937+0000 7fdce259c640 1 -- 172.21.15.78:0/2613985234 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcd4004230 con 0x7fdce414b1e0 2023-11-28T20:01:36.943 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:36.937+0000 7fdce259c640 1 -- 172.21.15.78:0/2613985234 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdcd40a7050 con 0x7fdce414b1e0 2023-11-28T20:01:36.943 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:36.937+0000 7fdce259c640 1 -- 172.21.15.78:0/2613985234 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcd4003620 con 0x7fdce414b1e0 2023-11-28T20:01:36.944 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:36.941+0000 7fdce9116640 1 -- 172.21.15.78:0/2613985234 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdce414b1e0 msgr2=0x7fdce40c1700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:01:36.944 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:36.941+0000 7fdce9116640 1 --2- 172.21.15.78:0/2613985234 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdce414b1e0 0x7fdce40c1700 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7fdce40c3b30 tx=0x7fdcd401c500 comp rx=0 tx=0).stop 2023-11-28T20:01:36.944 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:36.941+0000 7fdce9116640 1 -- 172.21.15.78:0/2613985234 shutdown_connections 2023-11-28T20:01:36.944 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:36.941+0000 7fdce9116640 1 --2- 172.21.15.78:0/2613985234 >> v2:172.21.15.179:3300/0 conn(0x7fdce4151280 0x7fdce4151710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:36.944 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:36.941+0000 7fdce9116640 1 --2- 172.21.15.78:0/2613985234 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdce40c5300 0x7fdce40a9c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:36.944 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:36.941+0000 7fdce9116640 1 --2- 172.21.15.78:0/2613985234 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdce414b1e0 0x7fdce40c1700 unknown :-1 s=CLOSED pgs=726 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:36.945 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:36.941+0000 7fdce9116640 1 -- 172.21.15.78:0/2613985234 >> 172.21.15.78:0/2613985234 conn(0x7fdce40c59f0 msgr2=0x7fdce40c5e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:01:36.945 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:36.941+0000 7fdce9116640 1 -- 172.21.15.78:0/2613985234 shutdown_connections 2023-11-28T20:01:36.945 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:36.941+0000 7fdce9116640 1 -- 172.21.15.78:0/2613985234 wait complete. 2023-11-28T20:01:36.945 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:36.941+0000 7fdce9116640 1 Processor -- start 2023-11-28T20:01:36.945 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:36.941+0000 7fdce9116640 1 -- start start 2023-11-28T20:01:36.949 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:36.941+0000 7fdce9116640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdce40c5300 0x7fdce406d220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:36.949 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:36.941+0000 7fdce9116640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdce414b1e0 0x7fdce41ed0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:36.949 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:36.941+0000 7fdce9116640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdce4151280 0x7fdce41ed5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:36.949 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:36.941+0000 7fdce9116640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdce4071a70 con 0x7fdce4151280 2023-11-28T20:01:36.949 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:36.941+0000 7fdce9116640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdce41f13e0 con 0x7fdce40c5300 2023-11-28T20:01:36.949 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:36.941+0000 7fdce9116640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdce40a7210 con 0x7fdce414b1e0 2023-11-28T20:01:36.949 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:36.941+0000 7fdce359e640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdce4151280 0x7fdce41ed5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:36.949 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:36.941+0000 7fdce359e640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdce4151280 0x7fdce41ed5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:55312/0 (socket says 172.21.15.78:55312) 2023-11-28T20:01:36.949 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:36.941+0000 7fdce359e640 1 -- 172.21.15.78:0/893347608 learned_addr learned my addr 172.21.15.78:0/893347608 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T20:01:36.949 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:36.941+0000 7fdce2d9d640 1 --2- 172.21.15.78:0/893347608 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdce40c5300 0x7fdce406d220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:36.950 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:36.941+0000 7fdcdbfff640 1 --2- 172.21.15.78:0/893347608 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdce414b1e0 0x7fdce41ed0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:36.950 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:36.941+0000 7fdce359e640 1 -- 172.21.15.78:0/893347608 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdce414b1e0 msgr2=0x7fdce41ed0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:01:36.950 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:36.941+0000 7fdce359e640 1 --2- 172.21.15.78:0/893347608 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdce414b1e0 0x7fdce41ed0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:36.950 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:36.941+0000 7fdce359e640 1 -- 172.21.15.78:0/893347608 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdce40c5300 msgr2=0x7fdce406d220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:01:36.950 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:36.941+0000 7fdce359e640 1 --2- 172.21.15.78:0/893347608 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdce40c5300 0x7fdce406d220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:36.950 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:36.941+0000 7fdce359e640 1 -- 172.21.15.78:0/893347608 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdcd40094d0 con 0x7fdce4151280 2023-11-28T20:01:36.950 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:36.945+0000 7fdce359e640 1 --2- 172.21.15.78:0/893347608 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdce4151280 0x7fdce41ed5e0 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7fdcdc009d30 tx=0x7fdcdc00c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:01:36.950 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:36.945+0000 7fdcdb7fe640 1 -- 172.21.15.78:0/893347608 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcdc009ba0 con 0x7fdce4151280 2023-11-28T20:01:36.950 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:36.945+0000 7fdcdb7fe640 1 -- 172.21.15.78:0/893347608 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdcdc00f040 con 0x7fdce4151280 2023-11-28T20:01:36.950 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:36.945+0000 7fdcdb7fe640 1 -- 172.21.15.78:0/893347608 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcdc0146c0 con 0x7fdce4151280 2023-11-28T20:01:36.950 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:36.945+0000 7fdce9116640 1 -- 172.21.15.78:0/893347608 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdce41f0e80 con 0x7fdce4151280 2023-11-28T20:01:36.950 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:36.945+0000 7fdce9116640 1 -- 172.21.15.78:0/893347608 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdce40a6ea0 con 0x7fdce4151280 2023-11-28T20:01:36.951 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:36.945+0000 7fdce9116640 1 -- 172.21.15.78:0/893347608 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdce4067630 con 0x7fdce4151280 2023-11-28T20:01:36.951 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:36.945+0000 7fdcdb7fe640 1 -- 172.21.15.78:0/893347608 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fdcdc014820 con 0x7fdce4151280 2023-11-28T20:01:36.951 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:36.945+0000 7fdcdb7fe640 1 --2- 172.21.15.78:0/893347608 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fdcc4066470 0x7fdcc4068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:36.952 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:36.945+0000 7fdcdb7fe640 1 -- 172.21.15.78:0/893347608 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 6885+0+0 (secure 0 0 0) 0x7fdcdc084cd0 con 0x7fdce4151280 2023-11-28T20:01:36.952 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:36.945+0000 7fdce2d9d640 1 --2- 172.21.15.78:0/893347608 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fdcc4066470 0x7fdcc4068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:36.952 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:36.949+0000 7fdce2d9d640 1 --2- 172.21.15.78:0/893347608 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fdcc4066470 0x7fdcc4068930 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7fdcd40ad000 tx=0x7fdcd40a6000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:01:36.954 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:36.949+0000 7fdcdb7fe640 1 -- 172.21.15.78:0/893347608 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fdcdc051d50 con 0x7fdce4151280 2023-11-28T20:01:37.155 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:37.153+0000 7fdce9116640 1 -- 172.21.15.78:0/893347608 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "auth add", "entity": "client.testuser", "caps": ["mon", "allow rw fsname=cephfs, allow rw fsname=cephfs2", "osd", "allow rw tag cephfs data=cephfs, allow rw tag cephfs data=cephfs2", "mds", "allow rw fsname=cephfs"]} v 0) v1 -- 0x7fdce40a7350 con 0x7fdce4151280 2023-11-28T20:01:37.158 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:37.153+0000 7fdcdb7fe640 1 -- 172.21.15.78:0/893347608 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "auth add", "entity": "client.testuser", "caps": ["mon", "allow rw fsname=cephfs, allow rw fsname=cephfs2", "osd", "allow rw tag cephfs data=cephfs, allow rw tag cephfs data=cephfs2", "mds", "allow rw fsname=cephfs"]}]=0 added key for client.testuser v19) v1 ==== 291+0+0 (secure 0 0 0) 0x7fdcdc018020 con 0x7fdce4151280 2023-11-28T20:01:37.158 INFO:teuthology.orchestra.run.smithi078.stderr:added key for client.testuser 2023-11-28T20:01:37.161 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:37.157+0000 7fdce9116640 1 -- 172.21.15.78:0/893347608 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fdcc4066470 msgr2=0x7fdcc4068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:01:37.161 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:37.157+0000 7fdce9116640 1 --2- 172.21.15.78:0/893347608 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fdcc4066470 0x7fdcc4068930 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7fdcd40ad000 tx=0x7fdcd40a6000 comp rx=0 tx=0).stop 2023-11-28T20:01:37.161 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:37.157+0000 7fdce9116640 1 -- 172.21.15.78:0/893347608 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdce4151280 msgr2=0x7fdce41ed5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:01:37.161 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:37.157+0000 7fdce9116640 1 --2- 172.21.15.78:0/893347608 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdce4151280 0x7fdce41ed5e0 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7fdcdc009d30 tx=0x7fdcdc00c490 comp rx=0 tx=0).stop 2023-11-28T20:01:37.161 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:37.157+0000 7fdce9116640 1 -- 172.21.15.78:0/893347608 shutdown_connections 2023-11-28T20:01:37.161 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:37.157+0000 7fdce9116640 1 --2- 172.21.15.78:0/893347608 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fdcc4066470 0x7fdcc4068930 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:37.161 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:37.157+0000 7fdce9116640 1 --2- 172.21.15.78:0/893347608 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdce414b1e0 0x7fdce41ed0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:37.162 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:37.157+0000 7fdce9116640 1 --2- 172.21.15.78:0/893347608 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdce4151280 0x7fdce41ed5e0 unknown :-1 s=CLOSED pgs=727 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:37.162 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:37.157+0000 7fdce9116640 1 --2- 172.21.15.78:0/893347608 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdce40c5300 0x7fdce406d220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:37.162 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:37.157+0000 7fdce9116640 1 -- 172.21.15.78:0/893347608 >> 172.21.15.78:0/893347608 conn(0x7fdce40c59f0 msgr2=0x7fdce414f140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:01:37.162 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:37.157+0000 7fdce9116640 1 -- 172.21.15.78:0/893347608 shutdown_connections 2023-11-28T20:01:37.162 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:37.157+0000 7fdce9116640 1 -- 172.21.15.78:0/893347608 wait complete. 2023-11-28T20:01:37.179 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth get client.testuser 2023-11-28T20:01:37.318 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:37.313+0000 7f6e4545f640 1 Processor -- start 2023-11-28T20:01:37.318 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:37.313+0000 7f6e4545f640 1 -- start start 2023-11-28T20:01:37.320 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:37.313+0000 7f6e4545f640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f6e400a4f90 0x7f6e400c59c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:37.320 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:37.313+0000 7f6e4545f640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6e401524b0 con 0x7f6e400a5370 2023-11-28T20:01:37.320 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:37.313+0000 7f6e4545f640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6e400c62f0 con 0x7f6e40072810 2023-11-28T20:01:37.320 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:37.313+0000 7f6e4545f640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6e40152770 con 0x7f6e400a4f90 2023-11-28T20:01:37.321 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:37.313+0000 7f6e3e7fc640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f6e400a5370 0x7f6e4014f870 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:39432/0 (socket says 172.21.15.78:39432) 2023-11-28T20:01:37.321 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:37.313+0000 7f6e3e7fc640 1 -- 172.21.15.78:0/4052162613 learned_addr learned my addr 172.21.15.78:0/4052162613 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-11-28T20:01:37.321 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:37.313+0000 7f6e3effd640 1 --2- 172.21.15.78:0/4052162613 >> v2:172.21.15.179:3300/0 conn(0x7f6e400a4f90 0x7f6e400c59c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:37.321 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:37.317+0000 7f6e3dffb640 1 -- 172.21.15.78:0/4052162613 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 317594479 0 0) 0x7f6e401524b0 con 0x7f6e400a5370 2023-11-28T20:01:37.321 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:37.317+0000 7f6e3dffb640 1 -- 172.21.15.78:0/4052162613 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6e28003530 con 0x7f6e400a5370 2023-11-28T20:01:37.321 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:37.317+0000 7f6e3dffb640 1 -- 172.21.15.78:0/4052162613 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2562480257 0 0) 0x7f6e400c62f0 con 0x7f6e40072810 2023-11-28T20:01:37.322 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:37.317+0000 7f6e3dffb640 1 -- 172.21.15.78:0/4052162613 --> v1:172.21.15.179:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6e401524b0 con 0x7f6e40072810 2023-11-28T20:01:37.322 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:37.317+0000 7f6e3effd640 1 -- 172.21.15.78:0/4052162613 >> v1:172.21.15.179:6789/0 conn(0x7f6e40072810 legacy=0x7f6e400c0800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:01:37.322 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:37.317+0000 7f6e3effd640 1 -- 172.21.15.78:0/4052162613 >> v1:172.21.15.78:6789/0 conn(0x7f6e400a5370 legacy=0x7f6e4014f870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:01:37.322 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:37.317+0000 7f6e3effd640 1 -- 172.21.15.78:0/4052162613 --> v2:172.21.15.179:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e40152a50 con 0x7f6e400a4f90 2023-11-28T20:01:37.323 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:37.317+0000 7f6e3effd640 1 --2- 172.21.15.78:0/4052162613 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6e400a4f90 0x7f6e400c59c0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f6e401526a0 tx=0x7f6e3001c3f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=581f4c407d126d22 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:01:37.323 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:37.317+0000 7f6e3dffb640 1 -- 172.21.15.78:0/4052162613 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e300ab600 con 0x7f6e400a4f90 2023-11-28T20:01:37.323 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:37.317+0000 7f6e3dffb640 1 -- 172.21.15.78:0/4052162613 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e300a7050 con 0x7f6e400a4f90 2023-11-28T20:01:37.323 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:37.317+0000 7f6e3dffb640 1 -- 172.21.15.78:0/4052162613 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e300ab980 con 0x7f6e400a4f90 2023-11-28T20:01:37.323 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:37.321+0000 7f6e4545f640 1 -- 172.21.15.78:0/4052162613 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6e400a4f90 msgr2=0x7f6e400c59c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:01:37.324 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:37.321+0000 7f6e4545f640 1 --2- 172.21.15.78:0/4052162613 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6e400a4f90 0x7f6e400c59c0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f6e401526a0 tx=0x7f6e3001c3f0 comp rx=0 tx=0).stop 2023-11-28T20:01:37.324 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:37.321+0000 7f6e4545f640 1 -- 172.21.15.78:0/4052162613 shutdown_connections 2023-11-28T20:01:37.324 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:37.321+0000 7f6e4545f640 1 --2- 172.21.15.78:0/4052162613 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6e400a4f90 0x7f6e400c59c0 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:37.324 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:37.321+0000 7f6e4545f640 1 -- 172.21.15.78:0/4052162613 >> 172.21.15.78:0/4052162613 conn(0x7f6e4006b220 msgr2=0x7f6e400a77e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:01:37.324 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:37.321+0000 7f6e4545f640 1 -- 172.21.15.78:0/4052162613 shutdown_connections 2023-11-28T20:01:37.324 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:37.321+0000 7f6e4545f640 1 -- 172.21.15.78:0/4052162613 wait complete. 2023-11-28T20:01:37.325 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:37.321+0000 7f6e4545f640 1 Processor -- start 2023-11-28T20:01:37.326 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:37.321+0000 7f6e4545f640 1 -- start start 2023-11-28T20:01:37.328 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:37.321+0000 7f6e4545f640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6e40072810 0x7f6e401447c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:37.330 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:37.321+0000 7f6e4545f640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6e400a4f90 0x7f6e4014b8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:37.330 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:37.321+0000 7f6e4545f640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6e400a5370 0x7f6e400a8c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:37.330 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:37.321+0000 7f6e4545f640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e40071d90 con 0x7f6e40072810 2023-11-28T20:01:37.330 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:37.321+0000 7f6e4545f640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e401f1660 con 0x7f6e400a4f90 2023-11-28T20:01:37.330 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:37.321+0000 7f6e4545f640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6e400aa4a0 con 0x7f6e400a5370 2023-11-28T20:01:37.330 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:37.321+0000 7f6e3effd640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6e40072810 0x7f6e401447c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:37.330 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:37.321+0000 7f6e3effd640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6e40072810 0x7f6e401447c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:55322/0 (socket says 172.21.15.78:55322) 2023-11-28T20:01:37.330 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:37.321+0000 7f6e3effd640 1 -- 172.21.15.78:0/3206827643 learned_addr learned my addr 172.21.15.78:0/3206827643 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T20:01:37.331 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:37.321+0000 7f6e3e7fc640 1 --2- 172.21.15.78:0/3206827643 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6e400a4f90 0x7f6e4014b8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:37.331 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:37.321+0000 7f6e3f7fe640 1 --2- 172.21.15.78:0/3206827643 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6e400a5370 0x7f6e400a8c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:37.331 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:37.325+0000 7f6e3effd640 1 -- 172.21.15.78:0/3206827643 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6e400a5370 msgr2=0x7f6e400a8c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:01:37.331 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:37.325+0000 7f6e3effd640 1 --2- 172.21.15.78:0/3206827643 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6e400a5370 0x7f6e400a8c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:37.331 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:37.325+0000 7f6e3effd640 1 -- 172.21.15.78:0/3206827643 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6e400a4f90 msgr2=0x7f6e4014b8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:01:37.331 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:37.325+0000 7f6e3effd640 1 --2- 172.21.15.78:0/3206827643 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6e400a4f90 0x7f6e4014b8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:37.331 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:37.325+0000 7f6e3effd640 1 -- 172.21.15.78:0/3206827643 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e30009420 con 0x7f6e40072810 2023-11-28T20:01:37.331 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:37.325+0000 7f6e3effd640 1 --2- 172.21.15.78:0/3206827643 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6e40072810 0x7f6e401447c0 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7f6e300ae040 tx=0x7f6e30019190 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:01:37.331 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:37.325+0000 7f6e277fe640 1 -- 172.21.15.78:0/3206827643 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e300b4410 con 0x7f6e40072810 2023-11-28T20:01:37.331 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:37.325+0000 7f6e277fe640 1 -- 172.21.15.78:0/3206827643 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e300b4570 con 0x7f6e40072810 2023-11-28T20:01:37.331 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:37.325+0000 7f6e277fe640 1 -- 172.21.15.78:0/3206827643 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e300b4920 con 0x7f6e40072810 2023-11-28T20:01:37.331 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:37.325+0000 7f6e4545f640 1 -- 172.21.15.78:0/3206827643 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6e400aa780 con 0x7f6e40072810 2023-11-28T20:01:37.331 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:37.325+0000 7f6e4545f640 1 -- 172.21.15.78:0/3206827643 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6e400aaa60 con 0x7f6e40072810 2023-11-28T20:01:37.332 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:37.325+0000 7f6e4545f640 1 -- 172.21.15.78:0/3206827643 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6e40067630 con 0x7f6e40072810 2023-11-28T20:01:37.332 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:37.325+0000 7f6e277fe640 1 -- 172.21.15.78:0/3206827643 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f6e300b2040 con 0x7f6e40072810 2023-11-28T20:01:37.333 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:37.325+0000 7f6e277fe640 1 --2- 172.21.15.78:0/3206827643 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f6e2c066470 0x7f6e2c068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:37.333 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:37.325+0000 7f6e277fe640 1 -- 172.21.15.78:0/3206827643 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 6885+0+0 (secure 0 0 0) 0x7f6e3011e270 con 0x7f6e40072810 2023-11-28T20:01:37.333 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:37.325+0000 7f6e3e7fc640 1 --2- 172.21.15.78:0/3206827643 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f6e2c066470 0x7f6e2c068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:37.333 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:37.329+0000 7f6e3e7fc640 1 --2- 172.21.15.78:0/3206827643 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f6e2c066470 0x7f6e2c068930 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f6e4014a2c0 tx=0x7f6e34007d80 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:01:37.334 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:37.329+0000 7f6e277fe640 1 -- 172.21.15.78:0/3206827643 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f6e300eb2f0 con 0x7f6e40072810 2023-11-28T20:01:37.534 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:37.529+0000 7f6e4545f640 1 -- 172.21.15.78:0/3206827643 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "auth get", "entity": "client.testuser"} v 0) v1 -- 0x7f6e400a7550 con 0x7f6e40072810 2023-11-28T20:01:37.534 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:37.529+0000 7f6e277fe640 1 -- 172.21.15.78:0/3206827643 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "auth get", "entity": "client.testuser"}]=0 v19) v1 ==== 85+0+245 (secure 0 0 0) 0x7f6e300ee910 con 0x7f6e40072810 2023-11-28T20:01:37.535 INFO:teuthology.orchestra.run.smithi078.stdout:[client.testuser] 2023-11-28T20:01:37.535 INFO:teuthology.orchestra.run.smithi078.stdout: key = AQAhR2ZlyvZKCRAAIn4WEgjDDSb+3VyIKui1gA== 2023-11-28T20:01:37.535 INFO:teuthology.orchestra.run.smithi078.stdout: caps mds = "allow rw fsname=cephfs" 2023-11-28T20:01:37.535 INFO:teuthology.orchestra.run.smithi078.stdout: caps mon = "allow rw fsname=cephfs, allow rw fsname=cephfs2" 2023-11-28T20:01:37.535 INFO:teuthology.orchestra.run.smithi078.stdout: caps osd = "allow rw tag cephfs data=cephfs, allow rw tag cephfs data=cephfs2" 2023-11-28T20:01:37.537 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:37.533+0000 7f6e4545f640 1 -- 172.21.15.78:0/3206827643 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f6e2c066470 msgr2=0x7f6e2c068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:01:37.537 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:37.533+0000 7f6e4545f640 1 --2- 172.21.15.78:0/3206827643 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f6e2c066470 0x7f6e2c068930 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f6e4014a2c0 tx=0x7f6e34007d80 comp rx=0 tx=0).stop 2023-11-28T20:01:37.537 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:37.533+0000 7f6e4545f640 1 -- 172.21.15.78:0/3206827643 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6e40072810 msgr2=0x7f6e401447c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:01:37.537 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:37.533+0000 7f6e4545f640 1 --2- 172.21.15.78:0/3206827643 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6e40072810 0x7f6e401447c0 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7f6e300ae040 tx=0x7f6e30019190 comp rx=0 tx=0).stop 2023-11-28T20:01:37.537 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:37.533+0000 7f6e4545f640 1 -- 172.21.15.78:0/3206827643 shutdown_connections 2023-11-28T20:01:37.537 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:37.533+0000 7f6e4545f640 1 --2- 172.21.15.78:0/3206827643 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f6e2c066470 0x7f6e2c068930 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:37.537 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:37.533+0000 7f6e4545f640 1 --2- 172.21.15.78:0/3206827643 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6e400a5370 0x7f6e400a8c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:37.538 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:37.533+0000 7f6e4545f640 1 --2- 172.21.15.78:0/3206827643 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6e400a4f90 0x7f6e4014b8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:37.538 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:37.533+0000 7f6e4545f640 1 --2- 172.21.15.78:0/3206827643 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6e40072810 0x7f6e401447c0 unknown :-1 s=CLOSED pgs=729 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:37.538 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:37.533+0000 7f6e4545f640 1 -- 172.21.15.78:0/3206827643 >> 172.21.15.78:0/3206827643 conn(0x7f6e4006b220 msgr2=0x7f6e400c0800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:01:37.538 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:37.533+0000 7f6e4545f640 1 -- 172.21.15.78:0/3206827643 shutdown_connections 2023-11-28T20:01:37.538 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:37.533+0000 7f6e4545f640 1 -- 172.21.15.78:0/3206827643 wait complete. 2023-11-28T20:01:37.556 DEBUG:teuthology.orchestra.run.smithi078:> mktemp 2023-11-28T20:01:37.565 INFO:teuthology.orchestra.run.smithi078.stdout:/tmp/tmp.sAxLtLz9W8 2023-11-28T20:01:37.565 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2023-11-28T20:01:37.565 DEBUG:teuthology.orchestra.run.smithi078:> dd of=/tmp/tmp.sAxLtLz9W8 2023-11-28T20:01:37.619 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2023-11-28T20:01:37.619 DEBUG:teuthology.orchestra.run.smithi078:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-28T20:01:37.672 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2023-11-28T20:01:37.672 DEBUG:teuthology.orchestra.run.smithi078:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-28T20:01:37.724 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-28T20:01:37.905 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:37.901+0000 7f7690de6640 1 Processor -- start 2023-11-28T20:01:37.905 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:37.901+0000 7f7690de6640 1 -- start start 2023-11-28T20:01:37.906 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:37.901+0000 7f7690de6640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f768c14e3f0 0x7f768c0bfce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:37.906 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:37.901+0000 7f7690de6640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f768c06bef0 0x7f768c0c41f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:37.906 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:37.901+0000 7f7690de6640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f768c151690 con 0x7f768c0c4730 2023-11-28T20:01:37.906 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:37.901+0000 7f7690de6640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f768c151bc0 con 0x7f768c14e3f0 2023-11-28T20:01:37.906 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:37.901+0000 7f7690de6640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f768c1518e0 con 0x7f768c06bef0 2023-11-28T20:01:37.906 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:37.901+0000 7f768a59c640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f768c14e3f0 0x7f768c0bfce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:37.907 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:37.901+0000 7f768a59c640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f768c14e3f0 0x7f768c0bfce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:55334/0 (socket says 172.21.15.78:55334) 2023-11-28T20:01:37.907 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:37.901+0000 7f768a59c640 1 -- 172.21.15.78:0/2779558993 learned_addr learned my addr 172.21.15.78:0/2779558993 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T20:01:37.907 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:37.901+0000 7f7681d9b640 1 --2- 172.21.15.78:0/2779558993 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f768c06bef0 0x7f768c0c41f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:37.907 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:37.901+0000 7f768a59c640 1 -- 172.21.15.78:0/2779558993 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f768c06bef0 msgr2=0x7f768c0c41f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:01:37.907 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:37.901+0000 7f768a59c640 1 --2- 172.21.15.78:0/2779558993 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f768c06bef0 0x7f768c0c41f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:37.908 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:37.901+0000 7f768a59c640 1 -- 172.21.15.78:0/2779558993 >> v1:172.21.15.78:6789/0 conn(0x7f768c0c4730 legacy=0x7f768c06c5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:01:37.908 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:37.901+0000 7f768a59c640 1 -- 172.21.15.78:0/2779558993 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f768c0c1de0 con 0x7f768c14e3f0 2023-11-28T20:01:37.908 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:37.901+0000 7f7689d9b640 1 -- 172.21.15.78:0/2779558993 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3375617601 0 0) 0x7f768c151690 con 0x7f768c0c4730 2023-11-28T20:01:37.908 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:37.901+0000 7f7681d9b640 1 --2- 172.21.15.78:0/2779558993 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f768c06bef0 0x7f768c0c41f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T20:01:37.909 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:37.905+0000 7f768a59c640 1 --2- 172.21.15.78:0/2779558993 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f768c14e3f0 0x7f768c0bfce0 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7f7674006fd0 tx=0x7f767401e910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=31d3430a0260354c server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:01:37.910 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:37.905+0000 7f7689d9b640 1 -- 172.21.15.78:0/2779558993 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7674004230 con 0x7f768c14e3f0 2023-11-28T20:01:37.910 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:37.905+0000 7f7689d9b640 1 -- 172.21.15.78:0/2779558993 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f76740ab070 con 0x7f768c14e3f0 2023-11-28T20:01:37.910 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:37.905+0000 7f7689d9b640 1 -- 172.21.15.78:0/2779558993 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76740a7670 con 0x7f768c14e3f0 2023-11-28T20:01:37.911 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:37.905+0000 7f7690de6640 1 -- 172.21.15.78:0/2779558993 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f768c14e3f0 msgr2=0x7f768c0bfce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:01:37.911 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:37.905+0000 7f7690de6640 1 --2- 172.21.15.78:0/2779558993 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f768c14e3f0 0x7f768c0bfce0 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7f7674006fd0 tx=0x7f767401e910 comp rx=0 tx=0).stop 2023-11-28T20:01:37.911 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:37.905+0000 7f7690de6640 1 -- 172.21.15.78:0/2779558993 shutdown_connections 2023-11-28T20:01:37.912 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:37.905+0000 7f7690de6640 1 --2- 172.21.15.78:0/2779558993 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f768c06bef0 0x7f768c0c41f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:37.912 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:37.905+0000 7f7690de6640 1 --2- 172.21.15.78:0/2779558993 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f768c14e3f0 0x7f768c0bfce0 unknown :-1 s=CLOSED pgs=731 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:37.912 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:37.905+0000 7f7690de6640 1 -- 172.21.15.78:0/2779558993 >> 172.21.15.78:0/2779558993 conn(0x7f768c0a7810 msgr2=0x7f768c0a7c20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:01:37.912 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:37.905+0000 7f7690de6640 1 -- 172.21.15.78:0/2779558993 shutdown_connections 2023-11-28T20:01:37.912 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:37.905+0000 7f7690de6640 1 -- 172.21.15.78:0/2779558993 wait complete. 2023-11-28T20:01:37.913 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:37.909+0000 7f7690de6640 1 Processor -- start 2023-11-28T20:01:37.913 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:37.909+0000 7f7690de6640 1 -- start start 2023-11-28T20:01:37.916 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:37.909+0000 7f7690de6640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f768c06bef0 0x7f768c0c1060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:37.916 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:37.909+0000 7f7690de6640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f768c0c4730 0x7f768c1504a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:37.916 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:37.909+0000 7f7690de6640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f768c14e3f0 0x7f768c145df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:37.917 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:37.909+0000 7f7690de6640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f768c0aba20 con 0x7f768c14e3f0 2023-11-28T20:01:37.917 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:37.909+0000 7f7690de6640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f768c0aa160 con 0x7f768c06bef0 2023-11-28T20:01:37.917 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:37.909+0000 7f7690de6640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f768c0aae70 con 0x7f768c0c4730 2023-11-28T20:01:37.917 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:37.909+0000 7f768ad9d640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f768c14e3f0 0x7f768c145df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:37.917 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:37.909+0000 7f768ad9d640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f768c14e3f0 0x7f768c145df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:55338/0 (socket says 172.21.15.78:55338) 2023-11-28T20:01:37.917 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:37.909+0000 7f768ad9d640 1 -- 172.21.15.78:0/331160371 learned_addr learned my addr 172.21.15.78:0/331160371 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T20:01:37.917 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:37.909+0000 7f7681d9b640 1 --2- 172.21.15.78:0/331160371 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f768c0c4730 0x7f768c1504a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:37.917 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:37.909+0000 7f768a59c640 1 --2- 172.21.15.78:0/331160371 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f768c06bef0 0x7f768c0c1060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:37.918 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:37.909+0000 7f768ad9d640 1 -- 172.21.15.78:0/331160371 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f768c0c4730 msgr2=0x7f768c1504a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:01:37.918 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:37.909+0000 7f768ad9d640 1 --2- 172.21.15.78:0/331160371 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f768c0c4730 0x7f768c1504a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:37.918 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:37.909+0000 7f768ad9d640 1 -- 172.21.15.78:0/331160371 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f768c06bef0 msgr2=0x7f768c0c1060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:01:37.918 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:37.909+0000 7f768ad9d640 1 --2- 172.21.15.78:0/331160371 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f768c06bef0 0x7f768c0c1060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:37.918 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:37.909+0000 7f768ad9d640 1 -- 172.21.15.78:0/331160371 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f767400b780 con 0x7f768c14e3f0 2023-11-28T20:01:37.918 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:37.909+0000 7f768a59c640 1 --2- 172.21.15.78:0/331160371 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f768c06bef0 0x7f768c0c1060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T20:01:37.918 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:37.909+0000 7f768ad9d640 1 --2- 172.21.15.78:0/331160371 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f768c14e3f0 0x7f768c145df0 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7f7684001570 tx=0x7f768400cbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:01:37.918 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:37.909+0000 7f76837fe640 1 -- 172.21.15.78:0/331160371 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7684003db0 con 0x7f768c14e3f0 2023-11-28T20:01:37.919 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:37.909+0000 7f76837fe640 1 -- 172.21.15.78:0/331160371 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f768400ce30 con 0x7f768c14e3f0 2023-11-28T20:01:37.919 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:37.909+0000 7f76837fe640 1 -- 172.21.15.78:0/331160371 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76840052b0 con 0x7f768c14e3f0 2023-11-28T20:01:37.919 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:37.909+0000 7f7690de6640 1 -- 172.21.15.78:0/331160371 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f768c0ab740 con 0x7f768c14e3f0 2023-11-28T20:01:37.919 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:37.909+0000 7f7690de6640 1 -- 172.21.15.78:0/331160371 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f768c0aa670 con 0x7f768c14e3f0 2023-11-28T20:01:37.919 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:37.913+0000 7f7690de6640 1 -- 172.21.15.78:0/331160371 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f768c067630 con 0x7f768c14e3f0 2023-11-28T20:01:37.920 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:37.913+0000 7f76837fe640 1 -- 172.21.15.78:0/331160371 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f7684005410 con 0x7f768c14e3f0 2023-11-28T20:01:37.920 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:37.913+0000 7f76837fe640 1 --2- 172.21.15.78:0/331160371 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f766c0664a0 0x7f766c068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:37.920 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:37.913+0000 7f76837fe640 1 -- 172.21.15.78:0/331160371 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 6885+0+0 (secure 0 0 0) 0x7f7684083ae0 con 0x7f768c14e3f0 2023-11-28T20:01:37.920 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:37.913+0000 7f768a59c640 1 --2- 172.21.15.78:0/331160371 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f766c0664a0 0x7f766c068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:37.920 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:37.913+0000 7f768a59c640 1 --2- 172.21.15.78:0/331160371 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f766c0664a0 0x7f766c068960 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f76740b1000 tx=0x7f76740a9070 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:01:37.921 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:37.917+0000 7f76837fe640 1 -- 172.21.15.78:0/331160371 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f7684050ad0 con 0x7f768c14e3f0 2023-11-28T20:01:38.075 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:38.073+0000 7f7690de6640 1 -- 172.21.15.78:0/331160371 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f768c0bf940 con 0x7f768c14e3f0 2023-11-28T20:01:38.077 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:38.073+0000 7f76837fe640 1 -- 172.21.15.78:0/331160371 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v65) v1 ==== 74+0+20410 (secure 0 0 0) 0x7f7684017020 con 0x7f768c14e3f0 2023-11-28T20:01:38.077 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-11-28T20:01:38.077 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":65,"fsid":"dd9780e8-3bda-44fa-a9f0-fa07d19d901d","created":"2023-11-28T19:58:40.969556+0000","modified":"2023-11-28T20:01:24.807489+0000","last_up_change":"2023-11-28T19:58:52.596716+0000","last_in_change":"2023-11-28T19:58:43.609275+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":12,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-28T19:58:54.011229+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_metadata","create_time":"2023-11-28T20:01:07.969267+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"60","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_data","create_time":"2023-11-28T20:01:08.865465+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"61","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs2_metadata","create_time":"2023-11-28T20:01:20.863763+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"64","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs2_data","create_time":"2023-11-28T20:01:22.176918+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"65","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs2"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e84245ac-b5da-429e-af18-39acaa2b33e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6800","nonce":3358701235},{"type":"v1","addr":"172.21.15.78:6801","nonce":3358701235}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6802","nonce":3358701235},{"type":"v1","addr":"172.21.15.78:6803","nonce":3358701235}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6806","nonce":3358701235},{"type":"v1","addr":"172.21.15.78:6807","nonce":3358701235}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6804","nonce":3358701235},{"type":"v1","addr":"172.21.15.78:6805","nonce":3358701235}]},"public_addr":"172.21.15.78:6801/3358701235","cluster_addr":"172.21.15.78:6803/3358701235","heartbeat_back_addr":"172.21.15.78:6807/3358701235","heartbeat_front_addr":"172.21.15.78:6805/3358701235","state":["exists","up"]},{"osd":1,"uuid":"e634831d-c4e2-48d9-870c-9556ae162981","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6808","nonce":3211476654},{"type":"v1","addr":"172.21.15.78:6809","nonce":3211476654}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6810","nonce":3211476654},{"type":"v1","addr":"172.21.15.78:6811","nonce":3211476654}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6814","nonce":3211476654},{"type":"v1","addr":"172.21.15.78:6815","nonce":3211476654}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6812","nonce":3211476654},{"type":"v1","addr":"172.21.15.78:6813","nonce":3211476654}]},"public_addr":"172.21.15.78:6809/3211476654","cluster_addr":"172.21.15.78:6811/3211476654","heartbeat_back_addr":"172.21.15.78:6815/3211476654","heartbeat_front_addr":"172.21.15.78:6813/3211476654","state":["exists","up"]},{"osd":2,"uuid":"274c8395-6534-41f0-b8fb-a00af8985aa8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6816","nonce":2532904479},{"type":"v1","addr":"172.21.15.78:6817","nonce":2532904479}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6818","nonce":2532904479},{"type":"v1","addr":"172.21.15.78:6819","nonce":2532904479}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6822","nonce":2532904479},{"type":"v1","addr":"172.21.15.78:6823","nonce":2532904479}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6820","nonce":2532904479},{"type":"v1","addr":"172.21.15.78:6821","nonce":2532904479}]},"public_addr":"172.21.15.78:6817/2532904479","cluster_addr":"172.21.15.78:6819/2532904479","heartbeat_back_addr":"172.21.15.78:6823/2532904479","heartbeat_front_addr":"172.21.15.78:6821/2532904479","state":["exists","up"]},{"osd":3,"uuid":"77acc9af-7d4d-4b18-8cf5-d62f5971b7c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6824","nonce":3442991267},{"type":"v1","addr":"172.21.15.78:6825","nonce":3442991267}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6826","nonce":3442991267},{"type":"v1","addr":"172.21.15.78:6827","nonce":3442991267}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6830","nonce":3442991267},{"type":"v1","addr":"172.21.15.78:6831","nonce":3442991267}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6828","nonce":3442991267},{"type":"v1","addr":"172.21.15.78:6829","nonce":3442991267}]},"public_addr":"172.21.15.78:6825/3442991267","cluster_addr":"172.21.15.78:6827/3442991267","heartbeat_back_addr":"172.21.15.78:6831/3442991267","heartbeat_front_addr":"172.21.15.78:6829/3442991267","state":["exists","up"]},{"osd":4,"uuid":"5c62bc66-6b34-4b7f-a66b-9a743969138c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":802983577},{"type":"v1","addr":"172.21.15.179:6809","nonce":802983577}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":802983577},{"type":"v1","addr":"172.21.15.179:6811","nonce":802983577}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":802983577},{"type":"v1","addr":"172.21.15.179:6815","nonce":802983577}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":802983577},{"type":"v1","addr":"172.21.15.179:6813","nonce":802983577}]},"public_addr":"172.21.15.179:6809/802983577","cluster_addr":"172.21.15.179:6811/802983577","heartbeat_back_addr":"172.21.15.179:6815/802983577","heartbeat_front_addr":"172.21.15.179:6813/802983577","state":["exists","up"]},{"osd":5,"uuid":"67db6d36-f684-4079-b0cd-82b4dd61461f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":518192887},{"type":"v1","addr":"172.21.15.179:6818","nonce":518192887}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":518192887},{"type":"v1","addr":"172.21.15.179:6822","nonce":518192887}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":518192887},{"type":"v1","addr":"172.21.15.179:6829","nonce":518192887}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6824","nonce":518192887},{"type":"v1","addr":"172.21.15.179:6826","nonce":518192887}]},"public_addr":"172.21.15.179:6818/518192887","cluster_addr":"172.21.15.179:6822/518192887","heartbeat_back_addr":"172.21.15.179:6829/518192887","heartbeat_front_addr":"172.21.15.179:6826/518192887","state":["exists","up"]},{"osd":6,"uuid":"12e670af-5a16-4c81-9f97-defa66cab967","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":815435378},{"type":"v1","addr":"172.21.15.179:6801","nonce":815435378}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":815435378},{"type":"v1","addr":"172.21.15.179:6803","nonce":815435378}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":815435378},{"type":"v1","addr":"172.21.15.179:6807","nonce":815435378}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":815435378},{"type":"v1","addr":"172.21.15.179:6805","nonce":815435378}]},"public_addr":"172.21.15.179:6801/815435378","cluster_addr":"172.21.15.179:6803/815435378","heartbeat_back_addr":"172.21.15.179:6807/815435378","heartbeat_front_addr":"172.21.15.179:6805/815435378","state":["exists","up"]},{"osd":7,"uuid":"fe630650-2eb3-49ad-8676-c341e6332eb1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6817","nonce":2848432339},{"type":"v1","addr":"172.21.15.179:6819","nonce":2848432339}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6821","nonce":2848432339},{"type":"v1","addr":"172.21.15.179:6823","nonce":2848432339}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":2848432339},{"type":"v1","addr":"172.21.15.179:6831","nonce":2848432339}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6825","nonce":2848432339},{"type":"v1","addr":"172.21.15.179:6827","nonce":2848432339}]},"public_addr":"172.21.15.179:6819/2848432339","cluster_addr":"172.21.15.179:6823/2848432339","heartbeat_back_addr":"172.21.15.179:6831/2848432339","heartbeat_front_addr":"172.21.15.179:6827/2848432339","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:58:49.255433+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:58:49.412880+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:58:49.559295+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:58:49.245237+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:58:49.184557+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:58:49.329851+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:58:49.366012+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:58:49.349604+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-28T20:01:38.079 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:38.073+0000 7f7690de6640 1 -- 172.21.15.78:0/331160371 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f766c0664a0 msgr2=0x7f766c068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:01:38.079 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:38.073+0000 7f7690de6640 1 --2- 172.21.15.78:0/331160371 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f766c0664a0 0x7f766c068960 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f76740b1000 tx=0x7f76740a9070 comp rx=0 tx=0).stop 2023-11-28T20:01:38.079 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:38.073+0000 7f7690de6640 1 -- 172.21.15.78:0/331160371 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f768c14e3f0 msgr2=0x7f768c145df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:01:38.079 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:38.073+0000 7f7690de6640 1 --2- 172.21.15.78:0/331160371 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f768c14e3f0 0x7f768c145df0 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7f7684001570 tx=0x7f768400cbe0 comp rx=0 tx=0).stop 2023-11-28T20:01:38.079 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:38.073+0000 7f7690de6640 1 -- 172.21.15.78:0/331160371 shutdown_connections 2023-11-28T20:01:38.080 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:38.073+0000 7f7690de6640 1 --2- 172.21.15.78:0/331160371 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f766c0664a0 0x7f766c068960 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:38.080 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:38.073+0000 7f7690de6640 1 --2- 172.21.15.78:0/331160371 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f768c0c4730 0x7f768c1504a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:38.080 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:38.073+0000 7f7690de6640 1 --2- 172.21.15.78:0/331160371 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f768c14e3f0 0x7f768c145df0 unknown :-1 s=CLOSED pgs=732 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:38.080 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:38.073+0000 7f7690de6640 1 --2- 172.21.15.78:0/331160371 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f768c06bef0 0x7f768c0c1060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:38.080 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:38.073+0000 7f7690de6640 1 -- 172.21.15.78:0/331160371 >> 172.21.15.78:0/331160371 conn(0x7f768c0a7810 msgr2=0x7f768c0a7bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:01:38.080 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:38.073+0000 7f7690de6640 1 -- 172.21.15.78:0/331160371 shutdown_connections 2023-11-28T20:01:38.080 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:38.073+0000 7f7690de6640 1 -- 172.21.15.78:0/331160371 wait complete. 2023-11-28T20:01:38.098 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-28T19:58:54.011229+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 9, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-28T20:01:07.969267+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '60', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 10, 'pool_name': 'cephfs_data', 'create_time': '2023-11-28T20:01:08.865465+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '61', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 11, 'pool_name': 'cephfs2_metadata', 'create_time': '2023-11-28T20:01:20.863763+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '64', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs2'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 12, 'pool_name': 'cephfs2_data', 'create_time': '2023-11-28T20:01:22.176918+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '65', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs2'}}, 'read_balance': {'score_acting': 1.6299999952316284, 'score_stable': 1.6299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.6299999952316284, 'raw_score_stable': 1.6299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-28T20:01:38.099 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-28T20:01:38.239 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:38.233+0000 7f62b88bb640 1 Processor -- start 2023-11-28T20:01:38.239 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:38.233+0000 7f62b88bb640 1 -- start start 2023-11-28T20:01:38.242 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:38.237+0000 7f62b88bb640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f62b414b1e0 0x7f62b40c1700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:38.242 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:38.237+0000 7f62b88bb640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f62b40c5300 0x7f62b40a9c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:38.243 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:38.237+0000 7f62b88bb640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f62b4151280 0x7f62b4151710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:38.243 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:38.237+0000 7f62b88bb640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f62b40a4e20 con 0x7f62b414b1e0 2023-11-28T20:01:38.243 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:38.237+0000 7f62b88bb640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f62b40a50e0 con 0x7f62b4151280 2023-11-28T20:01:38.244 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:38.237+0000 7f62b88bb640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f62b40c0f00 con 0x7f62b40c5300 2023-11-28T20:01:38.244 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:38.237+0000 7f62b259c640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f62b414b1e0 0x7f62b40c1700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:38.244 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:38.237+0000 7f62b259c640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f62b414b1e0 0x7f62b40c1700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:55354/0 (socket says 172.21.15.78:55354) 2023-11-28T20:01:38.244 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:38.237+0000 7f62b259c640 1 -- 172.21.15.78:0/3155749907 learned_addr learned my addr 172.21.15.78:0/3155749907 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T20:01:38.245 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:38.237+0000 7f62b259c640 1 -- 172.21.15.78:0/3155749907 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f62b40c5300 msgr2=0x7f62b40a9c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:01:38.245 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:38.237+0000 7f62b259c640 1 --2- 172.21.15.78:0/3155749907 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f62b40c5300 0x7f62b40a9c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:38.245 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:38.237+0000 7f62b259c640 1 -- 172.21.15.78:0/3155749907 >> v2:172.21.15.179:3300/0 conn(0x7f62b4151280 msgr2=0x7f62b4151710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:01:38.245 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:38.237+0000 7f62b2d9d640 1 --2- 172.21.15.78:0/3155749907 >> v2:172.21.15.179:3300/0 conn(0x7f62b4151280 0x7f62b4151710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:38.245 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:38.237+0000 7f62b259c640 1 --2- 172.21.15.78:0/3155749907 >> v2:172.21.15.179:3300/0 conn(0x7f62b4151280 0x7f62b4151710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:38.245 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:38.237+0000 7f62b259c640 1 -- 172.21.15.78:0/3155749907 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62b40c11e0 con 0x7f62b414b1e0 2023-11-28T20:01:38.246 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:38.237+0000 7f62b2d9d640 1 --2- 172.21.15.78:0/3155749907 >> v2:172.21.15.179:3300/0 conn(0x7f62b4151280 0x7f62b4151710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T20:01:38.247 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:38.241+0000 7f62b259c640 1 --2- 172.21.15.78:0/3155749907 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f62b414b1e0 0x7f62b40c1700 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7f62b40c3b30 tx=0x7f62a401c9d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=355b19e18a9499b6 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:01:38.247 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:38.241+0000 7f62b1d9b640 1 -- 172.21.15.78:0/3155749907 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62a40a56e0 con 0x7f62b414b1e0 2023-11-28T20:01:38.247 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:38.241+0000 7f62b1d9b640 1 -- 172.21.15.78:0/3155749907 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f62a40a5840 con 0x7f62b414b1e0 2023-11-28T20:01:38.248 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:38.241+0000 7f62b1d9b640 1 -- 172.21.15.78:0/3155749907 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62a40a5bd0 con 0x7f62b414b1e0 2023-11-28T20:01:38.248 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:38.241+0000 7f62b88bb640 1 -- 172.21.15.78:0/3155749907 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f62b414b1e0 msgr2=0x7f62b40c1700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:01:38.248 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:38.241+0000 7f62b88bb640 1 --2- 172.21.15.78:0/3155749907 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f62b414b1e0 0x7f62b40c1700 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7f62b40c3b30 tx=0x7f62a401c9d0 comp rx=0 tx=0).stop 2023-11-28T20:01:38.248 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:38.241+0000 7f62b88bb640 1 -- 172.21.15.78:0/3155749907 shutdown_connections 2023-11-28T20:01:38.248 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:38.241+0000 7f62b88bb640 1 --2- 172.21.15.78:0/3155749907 >> v2:172.21.15.179:3300/0 conn(0x7f62b4151280 0x7f62b4151710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:38.249 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:38.241+0000 7f62b88bb640 1 --2- 172.21.15.78:0/3155749907 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f62b40c5300 0x7f62b40a9c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:38.249 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:38.241+0000 7f62b88bb640 1 --2- 172.21.15.78:0/3155749907 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f62b414b1e0 0x7f62b40c1700 unknown :-1 s=CLOSED pgs=733 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:38.249 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:38.241+0000 7f62b88bb640 1 -- 172.21.15.78:0/3155749907 >> 172.21.15.78:0/3155749907 conn(0x7f62b40c59f0 msgr2=0x7f62b40c5e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:01:38.249 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:38.241+0000 7f62b88bb640 1 -- 172.21.15.78:0/3155749907 shutdown_connections 2023-11-28T20:01:38.249 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:38.241+0000 7f62b88bb640 1 -- 172.21.15.78:0/3155749907 wait complete. 2023-11-28T20:01:38.249 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:38.241+0000 7f62b88bb640 1 Processor -- start 2023-11-28T20:01:38.249 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:38.241+0000 7f62b88bb640 1 -- start start 2023-11-28T20:01:38.254 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:38.245+0000 7f62b88bb640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f62b40c5300 0x7f62b41477d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:38.254 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:38.245+0000 7f62b88bb640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f62b414b1e0 0x7f62b406c980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:38.254 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:38.245+0000 7f62b88bb640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f62b4151280 0x7f62b40a5530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:38.254 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:38.245+0000 7f62b88bb640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62b4070000 con 0x7f62b4151280 2023-11-28T20:01:38.254 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:38.245+0000 7f62b88bb640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62b4154670 con 0x7f62b414b1e0 2023-11-28T20:01:38.255 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:38.245+0000 7f62b88bb640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f62b4148320 con 0x7f62b40c5300 2023-11-28T20:01:38.255 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:38.245+0000 7f62b2d9d640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f62b4151280 0x7f62b40a5530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:38.255 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:38.245+0000 7f62b2d9d640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f62b4151280 0x7f62b40a5530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:55368/0 (socket says 172.21.15.78:55368) 2023-11-28T20:01:38.255 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:38.245+0000 7f62b2d9d640 1 -- 172.21.15.78:0/2626930539 learned_addr learned my addr 172.21.15.78:0/2626930539 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T20:01:38.255 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:38.245+0000 7f62b259c640 1 --2- 172.21.15.78:0/2626930539 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f62b40c5300 0x7f62b41477d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:38.256 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:38.245+0000 7f62a9d9b640 1 --2- 172.21.15.78:0/2626930539 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f62b414b1e0 0x7f62b406c980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:38.256 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:38.245+0000 7f62b2d9d640 1 -- 172.21.15.78:0/2626930539 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f62b40c5300 msgr2=0x7f62b41477d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:01:38.256 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:38.245+0000 7f62b2d9d640 1 --2- 172.21.15.78:0/2626930539 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f62b40c5300 0x7f62b41477d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:38.256 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:38.245+0000 7f62b2d9d640 1 -- 172.21.15.78:0/2626930539 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f62b414b1e0 msgr2=0x7f62b406c980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:01:38.256 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:38.245+0000 7f62b2d9d640 1 --2- 172.21.15.78:0/2626930539 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f62b414b1e0 0x7f62b406c980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:38.257 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:38.245+0000 7f62b2d9d640 1 -- 172.21.15.78:0/2626930539 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62a4009b30 con 0x7f62b4151280 2023-11-28T20:01:38.257 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:38.245+0000 7f62b2d9d640 1 --2- 172.21.15.78:0/2626930539 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f62b4151280 0x7f62b40a5530 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7f62ac00c7f0 tx=0x7f62ac00ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:01:38.257 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:38.245+0000 7f62ab7fe640 1 -- 172.21.15.78:0/2626930539 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62ac004230 con 0x7f62b4151280 2023-11-28T20:01:38.257 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:38.245+0000 7f62ab7fe640 1 -- 172.21.15.78:0/2626930539 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f62ac0043b0 con 0x7f62b4151280 2023-11-28T20:01:38.257 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:38.245+0000 7f62ab7fe640 1 -- 172.21.15.78:0/2626930539 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62ac003860 con 0x7f62b4151280 2023-11-28T20:01:38.258 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:38.245+0000 7f62b88bb640 1 -- 172.21.15.78:0/2626930539 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f62b40a6fa0 con 0x7f62b4151280 2023-11-28T20:01:38.258 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:38.245+0000 7f62b88bb640 1 -- 172.21.15.78:0/2626930539 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f62b41edc80 con 0x7f62b4151280 2023-11-28T20:01:38.258 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:38.245+0000 7f62b88bb640 1 -- 172.21.15.78:0/2626930539 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f62b4067630 con 0x7f62b4151280 2023-11-28T20:01:38.258 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:38.249+0000 7f62ab7fe640 1 -- 172.21.15.78:0/2626930539 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f62ac003bd0 con 0x7f62b4151280 2023-11-28T20:01:38.258 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:38.249+0000 7f62ab7fe640 1 --2- 172.21.15.78:0/2626930539 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f6294066470 0x7f6294068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:38.259 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:38.249+0000 7f62ab7fe640 1 -- 172.21.15.78:0/2626930539 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 6885+0+0 (secure 0 0 0) 0x7f62ac084590 con 0x7f62b4151280 2023-11-28T20:01:38.259 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:38.249+0000 7f62b259c640 1 --2- 172.21.15.78:0/2626930539 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f6294066470 0x7f6294068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:38.259 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:38.249+0000 7f62b259c640 1 --2- 172.21.15.78:0/2626930539 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f6294066470 0x7f6294068930 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f62a40ae000 tx=0x7f62a40a7070 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:01:38.259 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:38.253+0000 7f62ab7fe640 1 -- 172.21.15.78:0/2626930539 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f62ac0516b0 con 0x7f62b4151280 2023-11-28T20:01:38.408 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:38.405+0000 7f62b88bb640 1 -- 172.21.15.78:0/2626930539 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f62b40ab410 con 0x7f62b4151280 2023-11-28T20:01:38.408 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:38.405+0000 7f62ab7fe640 1 -- 172.21.15.78:0/2626930539 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v65) v1 ==== 93+0+10 (secure 0 0 0) 0x7f62ac054cd0 con 0x7f62b4151280 2023-11-28T20:01:38.409 INFO:teuthology.orchestra.run.smithi078.stdout:pg_num: 1 2023-11-28T20:01:38.411 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:38.405+0000 7f62b88bb640 1 -- 172.21.15.78:0/2626930539 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f6294066470 msgr2=0x7f6294068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:01:38.411 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:38.405+0000 7f62b88bb640 1 --2- 172.21.15.78:0/2626930539 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f6294066470 0x7f6294068930 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f62a40ae000 tx=0x7f62a40a7070 comp rx=0 tx=0).stop 2023-11-28T20:01:38.411 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:38.405+0000 7f62b88bb640 1 -- 172.21.15.78:0/2626930539 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f62b4151280 msgr2=0x7f62b40a5530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:01:38.411 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:38.405+0000 7f62b88bb640 1 --2- 172.21.15.78:0/2626930539 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f62b4151280 0x7f62b40a5530 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7f62ac00c7f0 tx=0x7f62ac00ccb0 comp rx=0 tx=0).stop 2023-11-28T20:01:38.411 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:38.405+0000 7f62b88bb640 1 -- 172.21.15.78:0/2626930539 shutdown_connections 2023-11-28T20:01:38.411 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:38.405+0000 7f62b88bb640 1 --2- 172.21.15.78:0/2626930539 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f6294066470 0x7f6294068930 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:38.412 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:38.405+0000 7f62b88bb640 1 --2- 172.21.15.78:0/2626930539 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f62b4151280 0x7f62b40a5530 unknown :-1 s=CLOSED pgs=734 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:38.412 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:38.405+0000 7f62b88bb640 1 --2- 172.21.15.78:0/2626930539 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f62b414b1e0 0x7f62b406c980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:38.412 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:38.405+0000 7f62b88bb640 1 --2- 172.21.15.78:0/2626930539 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f62b40c5300 0x7f62b41477d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:38.412 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:38.405+0000 7f62b88bb640 1 -- 172.21.15.78:0/2626930539 >> 172.21.15.78:0/2626930539 conn(0x7f62b40c59f0 msgr2=0x7f62b40c0270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:01:38.412 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:38.405+0000 7f62b88bb640 1 -- 172.21.15.78:0/2626930539 shutdown_connections 2023-11-28T20:01:38.412 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:38.405+0000 7f62b88bb640 1 -- 172.21.15.78:0/2626930539 wait complete. 2023-11-28T20:01:38.429 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-28T20:01:38.569 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:38.565+0000 7f4af0b3e640 1 Processor -- start 2023-11-28T20:01:38.569 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:38.565+0000 7f4af0b3e640 1 -- start start 2023-11-28T20:01:38.572 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:38.565+0000 7f4af0b3e640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4aec159c40 0x7f4aec15c030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:38.572 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:38.565+0000 7f4af0b3e640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4aec0a4e20 con 0x7f4aec14b1e0 2023-11-28T20:01:38.572 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:38.565+0000 7f4af0b3e640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4aec0a50e0 con 0x7f4aec0c5300 2023-11-28T20:01:38.572 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:38.565+0000 7f4af0b3e640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4aec1558d0 con 0x7f4aec159c40 2023-11-28T20:01:38.573 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:38.565+0000 7f4aea59c640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f4aec14b1e0 0x7f4aec0c1700 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:39462/0 (socket says 172.21.15.78:39462) 2023-11-28T20:01:38.573 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:38.565+0000 7f4aea59c640 1 -- 172.21.15.78:0/3250722644 learned_addr learned my addr 172.21.15.78:0/3250722644 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-11-28T20:01:38.573 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:38.565+0000 7f4aead9d640 1 --2- 172.21.15.78:0/3250722644 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4aec159c40 0x7f4aec15c030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:38.573 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:38.565+0000 7f4ae9d9b640 1 -- 172.21.15.78:0/3250722644 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4229199118 0 0) 0x7f4aec0a4e20 con 0x7f4aec14b1e0 2023-11-28T20:01:38.574 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:38.565+0000 7f4ae9d9b640 1 -- 172.21.15.78:0/3250722644 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4ad8005740 con 0x7f4aec14b1e0 2023-11-28T20:01:38.574 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:38.565+0000 7f4ae9d9b640 1 -- 172.21.15.78:0/3250722644 <== mon.0 v1:172.21.15.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3434324881 0 0) 0x7f4ad8005740 con 0x7f4aec14b1e0 2023-11-28T20:01:38.574 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:38.565+0000 7f4ae9d9b640 1 -- 172.21.15.78:0/3250722644 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4aec159c40 msgr2=0x7f4aec15c030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:01:38.574 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:38.565+0000 7f4ae9d9b640 1 --2- 172.21.15.78:0/3250722644 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4aec159c40 0x7f4aec15c030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:38.575 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:38.565+0000 7f4ae9d9b640 1 -- 172.21.15.78:0/3250722644 >> v1:172.21.15.179:6789/0 conn(0x7f4aec0c5300 legacy=0x7f4aec0a9c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:01:38.575 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:38.565+0000 7f4ae9d9b640 1 -- 172.21.15.78:0/3250722644 --> v1:172.21.15.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4aec0c0f00 con 0x7f4aec14b1e0 2023-11-28T20:01:38.575 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:38.569+0000 7f4ae9d9b640 1 -- 172.21.15.78:0/3250722644 <== mon.0 v1:172.21.15.78:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3326804700 0 0) 0x7f4adc001680 con 0x7f4aec14b1e0 2023-11-28T20:01:38.575 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:38.569+0000 7f4ae9d9b640 1 -- 172.21.15.78:0/3250722644 >> v1:172.21.15.78:6789/0 conn(0x7f4aec14b1e0 legacy=0x7f4aec0c1700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:01:38.575 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:38.569+0000 7f4ae9d9b640 1 --2- 172.21.15.78:0/3250722644 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4aec159c40 0x7f4ad8005bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:38.576 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:38.569+0000 7f4ae9d9b640 1 --2- 172.21.15.78:0/3250722644 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4ad8006100 0x7f4ad80069e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:38.576 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:38.569+0000 7f4ae9d9b640 1 --2- 172.21.15.78:0/3250722644 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4ad8006f20 0x7f4ad80073a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:38.576 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:38.569+0000 7f4ae9d9b640 1 -- 172.21.15.78:0/3250722644 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4aec1558d0 con 0x7f4ad8006f20 2023-11-28T20:01:38.576 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:38.569+0000 7f4ae9d9b640 1 -- 172.21.15.78:0/3250722644 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ad800dc00 con 0x7f4ad8006100 2023-11-28T20:01:38.577 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:38.569+0000 7f4ae9d9b640 1 -- 172.21.15.78:0/3250722644 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ad800ddc0 con 0x7f4aec159c40 2023-11-28T20:01:38.577 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:38.569+0000 7f4aead9d640 1 --2- 172.21.15.78:0/3250722644 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4ad8006f20 0x7f4ad80073a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:38.577 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:38.569+0000 7f4ae3fff640 1 --2- 172.21.15.78:0/3250722644 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4ad8006100 0x7f4ad80069e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:38.577 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:38.569+0000 7f4aea59c640 1 --2- 172.21.15.78:0/3250722644 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4aec159c40 0x7f4ad8005bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:38.578 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:38.569+0000 7f4aead9d640 1 -- 172.21.15.78:0/3250722644 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4aec159c40 msgr2=0x7f4ad8005bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:01:38.578 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:38.569+0000 7f4aead9d640 1 --2- 172.21.15.78:0/3250722644 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4aec159c40 0x7f4ad8005bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:38.578 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:38.569+0000 7f4aead9d640 1 -- 172.21.15.78:0/3250722644 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4ad8006100 msgr2=0x7f4ad80069e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:01:38.578 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:38.569+0000 7f4aead9d640 1 --2- 172.21.15.78:0/3250722644 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4ad8006100 0x7f4ad80069e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:38.579 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:38.569+0000 7f4aead9d640 1 -- 172.21.15.78:0/3250722644 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ad8005740 con 0x7f4ad8006f20 2023-11-28T20:01:38.583 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:38.569+0000 7f4aead9d640 1 --2- 172.21.15.78:0/3250722644 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4ad8006f20 0x7f4ad80073a0 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7f4ae4009f90 tx=0x7f4ae401cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f67f8ff3878d05de server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:01:38.583 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:38.569+0000 7f4ae9d9b640 1 -- 172.21.15.78:0/3250722644 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ae40a5b20 con 0x7f4ad8006f20 2023-11-28T20:01:38.583 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:38.569+0000 7f4ae9d9b640 1 -- 172.21.15.78:0/3250722644 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ae400f040 con 0x7f4ad8006f20 2023-11-28T20:01:38.583 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:38.569+0000 7f4ae9d9b640 1 -- 172.21.15.78:0/3250722644 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ae40ad440 con 0x7f4ad8006f20 2023-11-28T20:01:38.584 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:38.573+0000 7f4af0b3e640 1 -- 172.21.15.78:0/3250722644 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4ad8006f20 msgr2=0x7f4ad80073a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:01:38.584 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:38.573+0000 7f4af0b3e640 1 --2- 172.21.15.78:0/3250722644 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4ad8006f20 0x7f4ad80073a0 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7f4ae4009f90 tx=0x7f4ae401cc20 comp rx=0 tx=0).stop 2023-11-28T20:01:38.584 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:38.573+0000 7f4aead9d640 1 -- 172.21.15.78:0/3250722644 reap_dead start 2023-11-28T20:01:38.584 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:38.573+0000 7f4af0b3e640 1 -- 172.21.15.78:0/3250722644 shutdown_connections 2023-11-28T20:01:38.584 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:38.573+0000 7f4af0b3e640 1 -- 172.21.15.78:0/3250722644 >> 172.21.15.78:0/3250722644 conn(0x7f4aec0c59f0 msgr2=0x7f4aec0c5e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:01:38.585 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:38.573+0000 7f4af0b3e640 1 -- 172.21.15.78:0/3250722644 shutdown_connections 2023-11-28T20:01:38.585 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:38.573+0000 7f4af0b3e640 1 -- 172.21.15.78:0/3250722644 wait complete. 2023-11-28T20:01:38.585 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:38.573+0000 7f4af0b3e640 1 Processor -- start 2023-11-28T20:01:38.585 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:38.573+0000 7f4af0b3e640 1 -- start start 2023-11-28T20:01:38.586 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:38.573+0000 7f4af0b3e640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4aec0a5580 0x7f4aec0a6a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:38.586 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:38.573+0000 7f4af0b3e640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4aec14b8c0 0x7f4aec1ded30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:38.586 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:38.573+0000 7f4af0b3e640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4aec0a5960 0x7f4aec1429b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:38.587 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:38.573+0000 7f4af0b3e640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4aec1e6140 con 0x7f4aec0a5960 2023-11-28T20:01:38.587 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:38.573+0000 7f4af0b3e640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4aec072a80 con 0x7f4aec0a5580 2023-11-28T20:01:38.587 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:38.573+0000 7f4af0b3e640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4aec1e6670 con 0x7f4aec14b8c0 2023-11-28T20:01:38.587 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:38.573+0000 7f4aead9d640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4aec0a5960 0x7f4aec1429b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:38.587 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:38.573+0000 7f4aead9d640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4aec0a5960 0x7f4aec1429b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:55394/0 (socket says 172.21.15.78:55394) 2023-11-28T20:01:38.588 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:38.573+0000 7f4aead9d640 1 -- 172.21.15.78:0/3739773450 learned_addr learned my addr 172.21.15.78:0/3739773450 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T20:01:38.588 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:38.573+0000 7f4ae3fff640 1 --2- 172.21.15.78:0/3739773450 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4aec14b8c0 0x7f4aec1ded30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:38.588 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:38.573+0000 7f4aea59c640 1 --2- 172.21.15.78:0/3739773450 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4aec0a5580 0x7f4aec0a6a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:38.588 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:38.573+0000 7f4aead9d640 1 -- 172.21.15.78:0/3739773450 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4aec14b8c0 msgr2=0x7f4aec1ded30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:01:38.588 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:38.573+0000 7f4aead9d640 1 --2- 172.21.15.78:0/3739773450 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4aec14b8c0 0x7f4aec1ded30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:38.589 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:38.573+0000 7f4aead9d640 1 -- 172.21.15.78:0/3739773450 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4aec0a5580 msgr2=0x7f4aec0a6a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:01:38.589 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:38.573+0000 7f4aead9d640 1 --2- 172.21.15.78:0/3739773450 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4aec0a5580 0x7f4aec0a6a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:38.589 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:38.573+0000 7f4aead9d640 1 -- 172.21.15.78:0/3739773450 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4aec0a4dc0 con 0x7f4aec0a5960 2023-11-28T20:01:38.589 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:38.573+0000 7f4aea59c640 1 --2- 172.21.15.78:0/3739773450 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4aec0a5580 0x7f4aec0a6a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T20:01:38.589 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:38.577+0000 7f4aead9d640 1 --2- 172.21.15.78:0/3739773450 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4aec0a5960 0x7f4aec1429b0 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x7f4ae4009f90 tx=0x7f4ae4009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:01:38.589 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:38.577+0000 7f4ae2ffd640 1 -- 172.21.15.78:0/3739773450 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ae40039a0 con 0x7f4aec0a5960 2023-11-28T20:01:38.590 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:38.577+0000 7f4ae2ffd640 1 -- 172.21.15.78:0/3739773450 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ae4003b00 con 0x7f4aec0a5960 2023-11-28T20:01:38.590 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:38.577+0000 7f4ae2ffd640 1 -- 172.21.15.78:0/3739773450 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ae40ad650 con 0x7f4aec0a5960 2023-11-28T20:01:38.590 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:38.577+0000 7f4af0b3e640 1 -- 172.21.15.78:0/3739773450 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4aec072470 con 0x7f4aec0a5960 2023-11-28T20:01:38.591 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:38.577+0000 7f4af0b3e640 1 -- 172.21.15.78:0/3739773450 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4aec1e6390 con 0x7f4aec0a5960 2023-11-28T20:01:38.591 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:38.577+0000 7f4af0b3e640 1 -- 172.21.15.78:0/3739773450 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4aec0a67d0 con 0x7f4aec0a5960 2023-11-28T20:01:38.591 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:38.577+0000 7f4ae2ffd640 1 -- 172.21.15.78:0/3739773450 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f4ae40b4040 con 0x7f4aec0a5960 2023-11-28T20:01:38.591 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:38.577+0000 7f4ae2ffd640 1 --2- 172.21.15.78:0/3739773450 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f4acc066460 0x7f4acc068920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:38.592 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:38.577+0000 7f4ae2ffd640 1 -- 172.21.15.78:0/3739773450 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 6885+0+0 (secure 0 0 0) 0x7f4ae40a5e40 con 0x7f4aec0a5960 2023-11-28T20:01:38.592 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:38.577+0000 7f4aea59c640 1 --2- 172.21.15.78:0/3739773450 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f4acc066460 0x7f4acc068920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:38.593 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:38.581+0000 7f4aea59c640 1 --2- 172.21.15.78:0/3739773450 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f4acc066460 0x7f4acc068920 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f4adc0017b0 tx=0x7f4adc000ff0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:01:38.593 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:38.581+0000 7f4ae2ffd640 1 -- 172.21.15.78:0/3739773450 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f4ae40eb060 con 0x7f4aec0a5960 2023-11-28T20:01:38.735 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:38.729+0000 7f4af0b3e640 1 -- 172.21.15.78:0/3739773450 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f4aec0a7520 con 0x7f4aec0a5960 2023-11-28T20:01:38.736 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:38.733+0000 7f4ae2ffd640 1 -- 172.21.15.78:0/3739773450 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v65) v1 ==== 104+0+11 (secure 0 0 0) 0x7f4ae40b2020 con 0x7f4aec0a5960 2023-11-28T20:01:38.736 INFO:teuthology.orchestra.run.smithi078.stdout:pg_num: 32 2023-11-28T20:01:38.738 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:38.733+0000 7f4af0b3e640 1 -- 172.21.15.78:0/3739773450 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f4acc066460 msgr2=0x7f4acc068920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:01:38.738 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:38.733+0000 7f4af0b3e640 1 --2- 172.21.15.78:0/3739773450 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f4acc066460 0x7f4acc068920 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f4adc0017b0 tx=0x7f4adc000ff0 comp rx=0 tx=0).stop 2023-11-28T20:01:38.738 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:38.733+0000 7f4af0b3e640 1 -- 172.21.15.78:0/3739773450 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4aec0a5960 msgr2=0x7f4aec1429b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:01:38.738 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:38.733+0000 7f4af0b3e640 1 --2- 172.21.15.78:0/3739773450 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4aec0a5960 0x7f4aec1429b0 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x7f4ae4009f90 tx=0x7f4ae4009750 comp rx=0 tx=0).stop 2023-11-28T20:01:38.739 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:38.733+0000 7f4af0b3e640 1 -- 172.21.15.78:0/3739773450 shutdown_connections 2023-11-28T20:01:38.739 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:38.733+0000 7f4af0b3e640 1 --2- 172.21.15.78:0/3739773450 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f4acc066460 0x7f4acc068920 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:38.739 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:38.733+0000 7f4af0b3e640 1 --2- 172.21.15.78:0/3739773450 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4aec14b8c0 0x7f4aec1ded30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:38.740 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:38.733+0000 7f4af0b3e640 1 --2- 172.21.15.78:0/3739773450 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4aec0a5960 0x7f4aec1429b0 unknown :-1 s=CLOSED pgs=737 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:38.740 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:38.733+0000 7f4af0b3e640 1 --2- 172.21.15.78:0/3739773450 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4aec0a5580 0x7f4aec0a6a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:38.740 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:38.733+0000 7f4af0b3e640 1 -- 172.21.15.78:0/3739773450 >> 172.21.15.78:0/3739773450 conn(0x7f4aec0c59f0 msgr2=0x7f4aec0c4510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:01:38.740 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:38.733+0000 7f4af0b3e640 1 -- 172.21.15.78:0/3739773450 shutdown_connections 2023-11-28T20:01:38.741 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:38.733+0000 7f4af0b3e640 1 -- 172.21.15.78:0/3739773450 wait complete. 2023-11-28T20:01:38.757 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-28T20:01:38.900 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:38.897+0000 7fee83479640 1 Processor -- start 2023-11-28T20:01:38.901 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:38.897+0000 7fee83479640 1 -- start start 2023-11-28T20:01:38.901 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:38.897+0000 7fee83479640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fee7c0bed60 0x7fee7c0bf140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:38.902 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:38.897+0000 7fee83479640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fee7c0c4b20 0x7fee7c1585d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:38.902 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:38.897+0000 7fee83479640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fee7c157b80 con 0x7fee7c0a4f30 2023-11-28T20:01:38.902 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:38.897+0000 7fee83479640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fee7c158b10 con 0x7fee7c0bed60 2023-11-28T20:01:38.902 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:38.897+0000 7fee83479640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee7c06d6c0 con 0x7fee7c0c4b20 2023-11-28T20:01:38.905 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:38.897+0000 7fee81a16640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fee7c0c4b20 0x7fee7c1585d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:38.905 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:38.897+0000 7fee81215640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fee7c0bed60 0x7fee7c0bf140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:38.905 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:38.897+0000 7fee81a16640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fee7c0c4b20 0x7fee7c1585d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3301/0 says I am v2:172.21.15.78:37926/0 (socket says 172.21.15.78:37926) 2023-11-28T20:01:38.905 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:38.897+0000 7fee81a16640 1 -- 172.21.15.78:0/2304224874 learned_addr learned my addr 172.21.15.78:0/2304224874 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T20:01:38.905 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:38.897+0000 7fee80a14640 1 --1- 172.21.15.78:0/2304224874 >> v1:172.21.15.179:6789/0 conn(0x7fee7c0a4f30 0x7fee7c154590 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.179:6789/0 says I am v1:172.21.15.78:45682/0 (socket says 172.21.15.78:45682) 2023-11-28T20:01:38.905 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:38.897+0000 7fee73fff640 1 -- 172.21.15.78:0/2304224874 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2884811545 0 0) 0x7fee7c157b80 con 0x7fee7c0a4f30 2023-11-28T20:01:38.906 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:38.897+0000 7fee73fff640 1 -- 172.21.15.78:0/2304224874 --> v1:172.21.15.179:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fee68003530 con 0x7fee7c0a4f30 2023-11-28T20:01:38.906 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:38.897+0000 7fee81a16640 1 -- 172.21.15.78:0/2304224874 >> v2:172.21.15.179:3300/0 conn(0x7fee7c0bed60 msgr2=0x7fee7c0bf140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:01:38.906 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:38.897+0000 7fee81a16640 1 --2- 172.21.15.78:0/2304224874 >> v2:172.21.15.179:3300/0 conn(0x7fee7c0bed60 0x7fee7c0bf140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:38.906 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:38.897+0000 7fee81a16640 1 -- 172.21.15.78:0/2304224874 >> v1:172.21.15.179:6789/0 conn(0x7fee7c0a4f30 legacy=0x7fee7c154590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:01:38.906 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:38.897+0000 7fee81a16640 1 -- 172.21.15.78:0/2304224874 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee7c06d960 con 0x7fee7c0c4b20 2023-11-28T20:01:38.906 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:38.897+0000 7fee81215640 1 --2- 172.21.15.78:0/2304224874 >> v2:172.21.15.179:3300/0 conn(0x7fee7c0bed60 0x7fee7c0bf140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T20:01:38.907 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:38.901+0000 7fee81a16640 1 --2- 172.21.15.78:0/2304224874 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fee7c0c4b20 0x7fee7c1585d0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fee74009e50 tx=0x7fee7401c980 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f5bde38834566d2a server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:01:38.908 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:38.901+0000 7fee73fff640 1 -- 172.21.15.78:0/2304224874 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee740a5730 con 0x7fee7c0c4b20 2023-11-28T20:01:38.908 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:38.901+0000 7fee73fff640 1 -- 172.21.15.78:0/2304224874 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee740a5890 con 0x7fee7c0c4b20 2023-11-28T20:01:38.908 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:38.901+0000 7fee73fff640 1 -- 172.21.15.78:0/2304224874 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee740a5c20 con 0x7fee7c0c4b20 2023-11-28T20:01:38.908 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:38.901+0000 7fee83479640 1 -- 172.21.15.78:0/2304224874 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fee7c0c4b20 msgr2=0x7fee7c1585d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:01:38.908 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:38.901+0000 7fee83479640 1 --2- 172.21.15.78:0/2304224874 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fee7c0c4b20 0x7fee7c1585d0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fee74009e50 tx=0x7fee7401c980 comp rx=0 tx=0).stop 2023-11-28T20:01:38.908 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:38.901+0000 7fee83479640 1 -- 172.21.15.78:0/2304224874 shutdown_connections 2023-11-28T20:01:38.909 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:38.901+0000 7fee83479640 1 --2- 172.21.15.78:0/2304224874 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fee7c0c4b20 0x7fee7c1585d0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:38.909 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:38.901+0000 7fee83479640 1 --2- 172.21.15.78:0/2304224874 >> v2:172.21.15.179:3300/0 conn(0x7fee7c0bed60 0x7fee7c0bf140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:38.909 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:38.901+0000 7fee83479640 1 -- 172.21.15.78:0/2304224874 >> 172.21.15.78:0/2304224874 conn(0x7fee7c0c59f0 msgr2=0x7fee7c0c5e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:01:38.909 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:38.901+0000 7fee83479640 1 -- 172.21.15.78:0/2304224874 shutdown_connections 2023-11-28T20:01:38.909 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:38.901+0000 7fee83479640 1 -- 172.21.15.78:0/2304224874 wait complete. 2023-11-28T20:01:38.911 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:38.905+0000 7fee83479640 1 Processor -- start 2023-11-28T20:01:38.911 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:38.905+0000 7fee83479640 1 -- start start 2023-11-28T20:01:38.912 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:38.905+0000 7fee83479640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fee7c0a4f30 0x7fee7c155980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:38.912 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:38.905+0000 7fee83479640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fee7c0bed60 0x7fee7c14e640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:38.912 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:38.905+0000 7fee83479640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fee7c0c4b20 0x7fee7c152520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:38.912 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:38.905+0000 7fee83479640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee7c154930 con 0x7fee7c0bed60 2023-11-28T20:01:38.912 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:38.905+0000 7fee83479640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee7c14d810 con 0x7fee7c0a4f30 2023-11-28T20:01:38.912 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:38.905+0000 7fee83479640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee7c14dab0 con 0x7fee7c0c4b20 2023-11-28T20:01:38.912 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:38.905+0000 7fee80a14640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fee7c0bed60 0x7fee7c14e640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:38.913 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:38.905+0000 7fee80a14640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fee7c0bed60 0x7fee7c14e640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:55398/0 (socket says 172.21.15.78:55398) 2023-11-28T20:01:38.913 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:38.905+0000 7fee80a14640 1 -- 172.21.15.78:0/2231971210 learned_addr learned my addr 172.21.15.78:0/2231971210 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T20:01:38.913 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:38.905+0000 7fee80a14640 1 -- 172.21.15.78:0/2231971210 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fee7c0c4b20 msgr2=0x7fee7c152520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:01:38.913 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:38.905+0000 7fee80a14640 1 --2- 172.21.15.78:0/2231971210 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fee7c0c4b20 0x7fee7c152520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:38.913 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:38.905+0000 7fee80a14640 1 -- 172.21.15.78:0/2231971210 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fee7c0a4f30 msgr2=0x7fee7c155980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:01:38.913 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:38.905+0000 7fee80a14640 1 --2- 172.21.15.78:0/2231971210 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fee7c0a4f30 0x7fee7c155980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:38.913 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:38.905+0000 7fee80a14640 1 -- 172.21.15.78:0/2231971210 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee78009420 con 0x7fee7c0bed60 2023-11-28T20:01:38.914 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:38.905+0000 7fee80a14640 1 --2- 172.21.15.78:0/2231971210 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fee7c0bed60 0x7fee7c14e640 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7fee6c00c460 tx=0x7fee6c00c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:01:38.914 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:38.905+0000 7fee71ffb640 1 -- 172.21.15.78:0/2231971210 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee6c007480 con 0x7fee7c0bed60 2023-11-28T20:01:38.914 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:38.905+0000 7fee71ffb640 1 -- 172.21.15.78:0/2231971210 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee6c007600 con 0x7fee7c0bed60 2023-11-28T20:01:38.914 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:38.905+0000 7fee71ffb640 1 -- 172.21.15.78:0/2231971210 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee6c004a30 con 0x7fee7c0bed60 2023-11-28T20:01:38.914 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:38.905+0000 7fee83479640 1 -- 172.21.15.78:0/2231971210 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fee74009b30 con 0x7fee7c0bed60 2023-11-28T20:01:38.914 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:38.905+0000 7fee83479640 1 -- 172.21.15.78:0/2231971210 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fee7c148dd0 con 0x7fee7c0bed60 2023-11-28T20:01:38.915 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:38.909+0000 7fee83479640 1 -- 172.21.15.78:0/2231971210 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fee7c148c30 con 0x7fee7c0bed60 2023-11-28T20:01:38.915 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:38.909+0000 7fee71ffb640 1 -- 172.21.15.78:0/2231971210 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fee6c004b90 con 0x7fee7c0bed60 2023-11-28T20:01:38.916 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:38.909+0000 7fee71ffb640 1 --2- 172.21.15.78:0/2231971210 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fee60066470 0x7fee60068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:38.916 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:38.909+0000 7fee71ffb640 1 -- 172.21.15.78:0/2231971210 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 6885+0+0 (secure 0 0 0) 0x7fee6c083550 con 0x7fee7c0bed60 2023-11-28T20:01:38.916 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:38.909+0000 7fee81215640 1 --2- 172.21.15.78:0/2231971210 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fee60066470 0x7fee60068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:38.916 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:38.909+0000 7fee81215640 1 --2- 172.21.15.78:0/2231971210 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fee60066470 0x7fee60068930 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7fee78006e90 tx=0x7fee78006de0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:01:38.917 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:38.913+0000 7fee71ffb640 1 -- 172.21.15.78:0/2231971210 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fee7c148c30 con 0x7fee7c0bed60 2023-11-28T20:01:39.068 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:39.065+0000 7fee83479640 1 -- 172.21.15.78:0/2231971210 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fee7c148c30 con 0x7fee7c0bed60 2023-11-28T20:01:39.068 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:39.065+0000 7fee71ffb640 1 -- 172.21.15.78:0/2231971210 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v65) v1 ==== 100+0+11 (secure 0 0 0) 0x7fee7c148c30 con 0x7fee7c0bed60 2023-11-28T20:01:39.069 INFO:teuthology.orchestra.run.smithi078.stdout:pg_num: 64 2023-11-28T20:01:39.071 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:39.065+0000 7fee83479640 1 -- 172.21.15.78:0/2231971210 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fee60066470 msgr2=0x7fee60068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:01:39.071 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:39.065+0000 7fee83479640 1 --2- 172.21.15.78:0/2231971210 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fee60066470 0x7fee60068930 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7fee78006e90 tx=0x7fee78006de0 comp rx=0 tx=0).stop 2023-11-28T20:01:39.071 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:39.065+0000 7fee83479640 1 -- 172.21.15.78:0/2231971210 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fee7c0bed60 msgr2=0x7fee7c14e640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:01:39.071 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:39.065+0000 7fee83479640 1 --2- 172.21.15.78:0/2231971210 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fee7c0bed60 0x7fee7c14e640 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7fee6c00c460 tx=0x7fee6c00c920 comp rx=0 tx=0).stop 2023-11-28T20:01:39.071 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:39.065+0000 7fee83479640 1 -- 172.21.15.78:0/2231971210 shutdown_connections 2023-11-28T20:01:39.072 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:39.065+0000 7fee83479640 1 --2- 172.21.15.78:0/2231971210 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fee60066470 0x7fee60068930 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:39.072 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:39.065+0000 7fee83479640 1 --2- 172.21.15.78:0/2231971210 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fee7c0c4b20 0x7fee7c152520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:39.072 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:39.065+0000 7fee83479640 1 --2- 172.21.15.78:0/2231971210 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fee7c0bed60 0x7fee7c14e640 unknown :-1 s=CLOSED pgs=738 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:39.072 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:39.065+0000 7fee83479640 1 --2- 172.21.15.78:0/2231971210 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fee7c0a4f30 0x7fee7c155980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:39.072 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:39.065+0000 7fee83479640 1 -- 172.21.15.78:0/2231971210 >> 172.21.15.78:0/2231971210 conn(0x7fee7c0c59f0 msgr2=0x7fee7c0a5cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:01:39.072 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:39.065+0000 7fee83479640 1 -- 172.21.15.78:0/2231971210 shutdown_connections 2023-11-28T20:01:39.072 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:39.065+0000 7fee83479640 1 -- 172.21.15.78:0/2231971210 wait complete. 2023-11-28T20:01:39.089 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs2_metadata pg_num 2023-11-28T20:01:39.229 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:39.225+0000 7f9ab22bb640 1 Processor -- start 2023-11-28T20:01:39.233 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:39.225+0000 7f9ab22bb640 1 -- start start 2023-11-28T20:01:39.235 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:39.225+0000 7f9ab22bb640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f9aac0c5300 0x7f9aac0a9c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:39.236 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:39.225+0000 7f9ab22bb640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9aac1548c0 0x7f9aac154d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:39.236 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:39.225+0000 7f9ab22bb640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9aac0a4e20 con 0x7f9aac14b1e0 2023-11-28T20:01:39.236 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:39.225+0000 7f9ab22bb640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9aac0a50e0 con 0x7f9aac0c5300 2023-11-28T20:01:39.236 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:39.225+0000 7f9ab22bb640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9aac0c0f00 con 0x7f9aac1548c0 2023-11-28T20:01:39.237 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:39.225+0000 7f9aab7fe640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f9aac0c5300 0x7f9aac0a9c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:39.237 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:39.225+0000 7f9aabfff640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f9aac14b1e0 0x7f9aac0c1700 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:39478/0 (socket says 172.21.15.78:39478) 2023-11-28T20:01:39.237 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:39.225+0000 7f9aabfff640 1 -- 172.21.15.78:0/663844048 learned_addr learned my addr 172.21.15.78:0/663844048 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-11-28T20:01:39.237 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:39.225+0000 7f9ab0858640 1 --2- 172.21.15.78:0/663844048 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9aac1548c0 0x7f9aac154d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:39.238 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:39.225+0000 7f9aab7fe640 1 -- 172.21.15.78:0/663844048 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9aac1548c0 msgr2=0x7f9aac154d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:01:39.238 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:39.225+0000 7f9aab7fe640 1 --2- 172.21.15.78:0/663844048 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9aac1548c0 0x7f9aac154d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:39.238 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:39.225+0000 7f9aab7fe640 1 -- 172.21.15.78:0/663844048 >> v1:172.21.15.78:6789/0 conn(0x7f9aac14b1e0 legacy=0x7f9aac0c1700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:01:39.238 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:39.225+0000 7f9aab7fe640 1 -- 172.21.15.78:0/663844048 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9aac0c11e0 con 0x7f9aac0c5300 2023-11-28T20:01:39.238 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:39.225+0000 7f9aaaffd640 1 -- 172.21.15.78:0/663844048 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2057951624 0 0) 0x7f9aac0a4e20 con 0x7f9aac14b1e0 2023-11-28T20:01:39.239 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:39.229+0000 7f9aab7fe640 1 --2- 172.21.15.78:0/663844048 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9aac0c5300 0x7f9aac0a9c30 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7f9aa00097c0 tx=0x7f9aa001c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=934ddbc2ebf8b202 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:01:39.239 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:39.229+0000 7f9aaaffd640 1 -- 172.21.15.78:0/663844048 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9aa00ad640 con 0x7f9aac0c5300 2023-11-28T20:01:39.239 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:39.229+0000 7f9aaaffd640 1 -- 172.21.15.78:0/663844048 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9aa00ad7a0 con 0x7f9aac0c5300 2023-11-28T20:01:39.239 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:39.229+0000 7f9aaaffd640 1 -- 172.21.15.78:0/663844048 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9aa00adb30 con 0x7f9aac0c5300 2023-11-28T20:01:39.239 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:39.229+0000 7f9ab22bb640 1 -- 172.21.15.78:0/663844048 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9aac0c5300 msgr2=0x7f9aac0a9c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:01:39.239 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:39.229+0000 7f9ab22bb640 1 --2- 172.21.15.78:0/663844048 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9aac0c5300 0x7f9aac0a9c30 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7f9aa00097c0 tx=0x7f9aa001c480 comp rx=0 tx=0).stop 2023-11-28T20:01:39.240 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:39.229+0000 7f9ab22bb640 1 -- 172.21.15.78:0/663844048 shutdown_connections 2023-11-28T20:01:39.240 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:39.229+0000 7f9ab22bb640 1 --2- 172.21.15.78:0/663844048 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9aac1548c0 0x7f9aac154d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:39.240 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:39.229+0000 7f9ab22bb640 1 --2- 172.21.15.78:0/663844048 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9aac0c5300 0x7f9aac0a9c30 unknown :-1 s=CLOSED pgs=740 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:39.240 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:39.229+0000 7f9ab22bb640 1 -- 172.21.15.78:0/663844048 >> 172.21.15.78:0/663844048 conn(0x7f9aac0c59f0 msgr2=0x7f9aac0c5e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:01:39.240 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:39.229+0000 7f9ab22bb640 1 -- 172.21.15.78:0/663844048 shutdown_connections 2023-11-28T20:01:39.240 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:39.229+0000 7f9ab22bb640 1 -- 172.21.15.78:0/663844048 wait complete. 2023-11-28T20:01:39.241 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:39.233+0000 7f9ab22bb640 1 Processor -- start 2023-11-28T20:01:39.243 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:39.233+0000 7f9ab22bb640 1 -- start start 2023-11-28T20:01:39.243 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:39.233+0000 7f9ab22bb640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9aac0c5300 0x7f9aac0c4180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:39.244 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:39.233+0000 7f9ab22bb640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9aac14b1e0 0x7f9aac153410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:39.244 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:39.233+0000 7f9ab22bb640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9aac1548c0 0x7f9aac153950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:39.244 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:39.233+0000 7f9ab22bb640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9aac1edd10 con 0x7f9aac14b1e0 2023-11-28T20:01:39.244 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:39.233+0000 7f9ab22bb640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9aac1ece40 con 0x7f9aac1548c0 2023-11-28T20:01:39.244 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:39.233+0000 7f9ab22bb640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9aac1ed100 con 0x7f9aac0c5300 2023-11-28T20:01:39.245 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:39.233+0000 7f9aab7fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9aac14b1e0 0x7f9aac153410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:39.245 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:39.233+0000 7f9aab7fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9aac14b1e0 0x7f9aac153410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:55418/0 (socket says 172.21.15.78:55418) 2023-11-28T20:01:39.245 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:39.233+0000 7f9aab7fe640 1 -- 172.21.15.78:0/569264554 learned_addr learned my addr 172.21.15.78:0/569264554 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T20:01:39.245 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:39.233+0000 7f9aabfff640 1 --2- 172.21.15.78:0/569264554 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9aac0c5300 0x7f9aac0c4180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:39.245 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:39.233+0000 7f9ab0858640 1 --2- 172.21.15.78:0/569264554 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9aac1548c0 0x7f9aac153950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:39.245 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:39.233+0000 7f9aab7fe640 1 -- 172.21.15.78:0/569264554 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9aac0c5300 msgr2=0x7f9aac0c4180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:01:39.245 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:39.233+0000 7f9aab7fe640 1 --2- 172.21.15.78:0/569264554 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9aac0c5300 0x7f9aac0c4180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:39.245 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:39.233+0000 7f9aab7fe640 1 -- 172.21.15.78:0/569264554 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9aac1548c0 msgr2=0x7f9aac153950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:01:39.245 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:39.233+0000 7f9aab7fe640 1 --2- 172.21.15.78:0/569264554 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9aac1548c0 0x7f9aac153950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:39.245 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:39.233+0000 7f9aab7fe640 1 -- 172.21.15.78:0/569264554 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9aa0009420 con 0x7f9aac14b1e0 2023-11-28T20:01:39.246 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:39.233+0000 7f9ab0858640 1 --2- 172.21.15.78:0/569264554 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9aac1548c0 0x7f9aac153950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T20:01:39.246 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:39.233+0000 7f9aab7fe640 1 --2- 172.21.15.78:0/569264554 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9aac14b1e0 0x7f9aac153410 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x7f9aa001a0b0 tx=0x7f9aa0019220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:01:39.246 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:39.233+0000 7f9aa8ff9640 1 -- 172.21.15.78:0/569264554 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9aa00b6820 con 0x7f9aac14b1e0 2023-11-28T20:01:39.246 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:39.233+0000 7f9aa8ff9640 1 -- 172.21.15.78:0/569264554 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9aa00a6040 con 0x7f9aac14b1e0 2023-11-28T20:01:39.246 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:39.233+0000 7f9aa8ff9640 1 -- 172.21.15.78:0/569264554 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9aa00b6bc0 con 0x7f9aac14b1e0 2023-11-28T20:01:39.247 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:39.233+0000 7f9ab22bb640 1 -- 172.21.15.78:0/569264554 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9aac1ed3e0 con 0x7f9aac14b1e0 2023-11-28T20:01:39.247 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:39.233+0000 7f9ab22bb640 1 -- 172.21.15.78:0/569264554 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9aac1ed9a0 con 0x7f9aac14b1e0 2023-11-28T20:01:39.247 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:39.237+0000 7f9ab22bb640 1 -- 172.21.15.78:0/569264554 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9aac067630 con 0x7f9aac14b1e0 2023-11-28T20:01:39.247 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:39.237+0000 7f9aa8ff9640 1 -- 172.21.15.78:0/569264554 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f9aa00b4040 con 0x7f9aac14b1e0 2023-11-28T20:01:39.247 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:39.237+0000 7f9aa8ff9640 1 --2- 172.21.15.78:0/569264554 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f9a98066470 0x7f9a98068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:39.248 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:39.237+0000 7f9aa8ff9640 1 -- 172.21.15.78:0/569264554 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 6885+0+0 (secure 0 0 0) 0x7f9aa011e710 con 0x7f9aac14b1e0 2023-11-28T20:01:39.248 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:39.237+0000 7f9aabfff640 1 --2- 172.21.15.78:0/569264554 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f9a98066470 0x7f9a98068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:39.248 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:39.237+0000 7f9aabfff640 1 --2- 172.21.15.78:0/569264554 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f9a98066470 0x7f9a98068930 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f9a9c000f70 tx=0x7f9a9c009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:01:39.248 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:39.241+0000 7f9aa8ff9640 1 -- 172.21.15.78:0/569264554 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f9aa00eb6e0 con 0x7f9aac14b1e0 2023-11-28T20:01:39.403 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:39.397+0000 7f9ab22bb640 1 -- 172.21.15.78:0/569264554 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs2_metadata", "var": "pg_num"} v 0) v1 -- 0x7f9aac154ed0 con 0x7f9aac14b1e0 2023-11-28T20:01:39.403 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:39.397+0000 7f9aa8ff9640 1 -- 172.21.15.78:0/569264554 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs2_metadata", "var": "pg_num"}]=0 v65) v1 ==== 105+0+11 (secure 0 0 0) 0x7f9aa00ad600 con 0x7f9aac14b1e0 2023-11-28T20:01:39.404 INFO:teuthology.orchestra.run.smithi078.stdout:pg_num: 32 2023-11-28T20:01:39.405 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:39.401+0000 7f9ab22bb640 1 -- 172.21.15.78:0/569264554 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f9a98066470 msgr2=0x7f9a98068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:01:39.405 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:39.401+0000 7f9ab22bb640 1 --2- 172.21.15.78:0/569264554 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f9a98066470 0x7f9a98068930 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f9a9c000f70 tx=0x7f9a9c009040 comp rx=0 tx=0).stop 2023-11-28T20:01:39.406 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:39.401+0000 7f9ab22bb640 1 -- 172.21.15.78:0/569264554 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9aac14b1e0 msgr2=0x7f9aac153410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:01:39.406 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:39.401+0000 7f9ab22bb640 1 --2- 172.21.15.78:0/569264554 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9aac14b1e0 0x7f9aac153410 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x7f9aa001a0b0 tx=0x7f9aa0019220 comp rx=0 tx=0).stop 2023-11-28T20:01:39.406 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:39.401+0000 7f9ab22bb640 1 -- 172.21.15.78:0/569264554 shutdown_connections 2023-11-28T20:01:39.406 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:39.401+0000 7f9ab22bb640 1 --2- 172.21.15.78:0/569264554 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f9a98066470 0x7f9a98068930 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:39.406 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:39.401+0000 7f9ab22bb640 1 --2- 172.21.15.78:0/569264554 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9aac1548c0 0x7f9aac153950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:39.406 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:39.401+0000 7f9ab22bb640 1 --2- 172.21.15.78:0/569264554 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9aac14b1e0 0x7f9aac153410 unknown :-1 s=CLOSED pgs=741 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:39.406 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:39.401+0000 7f9ab22bb640 1 --2- 172.21.15.78:0/569264554 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9aac0c5300 0x7f9aac0c4180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:39.406 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:39.401+0000 7f9ab22bb640 1 -- 172.21.15.78:0/569264554 >> 172.21.15.78:0/569264554 conn(0x7f9aac0c59f0 msgr2=0x7f9aac0aae10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:01:39.407 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:39.401+0000 7f9ab22bb640 1 -- 172.21.15.78:0/569264554 shutdown_connections 2023-11-28T20:01:39.407 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:39.401+0000 7f9ab22bb640 1 -- 172.21.15.78:0/569264554 wait complete. 2023-11-28T20:01:39.424 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs2_data pg_num 2023-11-28T20:01:39.563 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:39.557+0000 7fba0ae5a640 1 Processor -- start 2023-11-28T20:01:39.564 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:39.561+0000 7fba0ae5a640 1 -- start start 2023-11-28T20:01:39.564 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:39.561+0000 7fba0ae5a640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fba0414fc30 0x7fba040c3cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:39.565 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:39.561+0000 7fba0ae5a640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fba04152910 con 0x7fba0406d840 2023-11-28T20:01:39.565 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:39.561+0000 7fba0ae5a640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fba04152bf0 con 0x7fba0414f850 2023-11-28T20:01:39.565 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:39.561+0000 7fba0ae5a640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fba040c2240 con 0x7fba0414fc30 2023-11-28T20:01:39.565 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:39.561+0000 7fba03fff640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fba0414fc30 0x7fba040c3cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:39.565 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:39.561+0000 7fba093f7640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7fba0406d840 0x7fba040c4210 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:39480/0 (socket says 172.21.15.78:39480) 2023-11-28T20:01:39.566 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:39.561+0000 7fba093f7640 1 -- 172.21.15.78:0/919076563 learned_addr learned my addr 172.21.15.78:0/919076563 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-11-28T20:01:39.566 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:39.561+0000 7fba03fff640 1 -- 172.21.15.78:0/919076563 >> v1:172.21.15.179:6789/0 conn(0x7fba0414f850 legacy=0x7fba040aacf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:01:39.567 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:39.561+0000 7fba03fff640 1 -- 172.21.15.78:0/919076563 >> v1:172.21.15.78:6789/0 conn(0x7fba0406d840 legacy=0x7fba040c4210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:01:39.567 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:39.561+0000 7fba037fe640 1 -- 172.21.15.78:0/919076563 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2187074779 0 0) 0x7fba04152910 con 0x7fba0406d840 2023-11-28T20:01:39.567 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:39.561+0000 7fba03fff640 1 -- 172.21.15.78:0/919076563 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba04152ed0 con 0x7fba0414fc30 2023-11-28T20:01:39.568 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:39.565+0000 7fba03fff640 1 --2- 172.21.15.78:0/919076563 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fba0414fc30 0x7fba040c3cd0 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7fb9f00097c0 tx=0x7fb9f001c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6805222731f78737 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:01:39.569 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:39.565+0000 7fba037fe640 1 -- 172.21.15.78:0/919076563 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9f00a6040 con 0x7fba0414fc30 2023-11-28T20:01:39.569 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:39.565+0000 7fba037fe640 1 -- 172.21.15.78:0/919076563 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb9f00aa600 con 0x7fba0414fc30 2023-11-28T20:01:39.569 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:39.565+0000 7fba037fe640 1 -- 172.21.15.78:0/919076563 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9f00aa990 con 0x7fba0414fc30 2023-11-28T20:01:39.570 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:39.565+0000 7fba0ae5a640 1 -- 172.21.15.78:0/919076563 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fba0414fc30 msgr2=0x7fba040c3cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:01:39.570 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:39.565+0000 7fba0ae5a640 1 --2- 172.21.15.78:0/919076563 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fba0414fc30 0x7fba040c3cd0 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7fb9f00097c0 tx=0x7fb9f001c480 comp rx=0 tx=0).stop 2023-11-28T20:01:39.570 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:39.565+0000 7fba0ae5a640 1 -- 172.21.15.78:0/919076563 shutdown_connections 2023-11-28T20:01:39.571 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:39.565+0000 7fba0ae5a640 1 --2- 172.21.15.78:0/919076563 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fba0414fc30 0x7fba040c3cd0 unknown :-1 s=CLOSED pgs=743 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:39.571 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:39.565+0000 7fba0ae5a640 1 -- 172.21.15.78:0/919076563 >> 172.21.15.78:0/919076563 conn(0x7fba040c59f0 msgr2=0x7fba040c5e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:01:39.571 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:39.565+0000 7fba0ae5a640 1 -- 172.21.15.78:0/919076563 shutdown_connections 2023-11-28T20:01:39.571 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:39.565+0000 7fba0ae5a640 1 -- 172.21.15.78:0/919076563 wait complete. 2023-11-28T20:01:39.573 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:39.565+0000 7fba0ae5a640 1 Processor -- start 2023-11-28T20:01:39.574 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:39.565+0000 7fba0ae5a640 1 -- start start 2023-11-28T20:01:39.574 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:39.569+0000 7fba0ae5a640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fba0406d840 0x7fba0406fac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:39.574 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:39.569+0000 7fba0ae5a640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fba0414f850 0x7fba040a70d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:39.574 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:39.569+0000 7fba0ae5a640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fba0414fc30 0x7fba040c3e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:39.574 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:39.569+0000 7fba0ae5a640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba04070200 con 0x7fba0414fc30 2023-11-28T20:01:39.575 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:39.569+0000 7fba0ae5a640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba041f00b0 con 0x7fba0406d840 2023-11-28T20:01:39.575 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:39.569+0000 7fba0ae5a640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba041f0390 con 0x7fba0414f850 2023-11-28T20:01:39.575 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:39.569+0000 7fba093f7640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fba0414fc30 0x7fba040c3e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:39.575 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:39.569+0000 7fba093f7640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fba0414fc30 0x7fba040c3e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:55442/0 (socket says 172.21.15.78:55442) 2023-11-28T20:01:39.575 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:39.569+0000 7fba093f7640 1 -- 172.21.15.78:0/3714056111 learned_addr learned my addr 172.21.15.78:0/3714056111 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T20:01:39.575 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:39.569+0000 7fba08bf6640 1 --2- 172.21.15.78:0/3714056111 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fba0406d840 0x7fba0406fac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:39.575 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:39.569+0000 7fba03fff640 1 --2- 172.21.15.78:0/3714056111 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fba0414f850 0x7fba040a70d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:39.575 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:39.569+0000 7fba093f7640 1 -- 172.21.15.78:0/3714056111 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fba0414f850 msgr2=0x7fba040a70d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:01:39.576 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:39.569+0000 7fba093f7640 1 --2- 172.21.15.78:0/3714056111 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fba0414f850 0x7fba040a70d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:39.576 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:39.569+0000 7fba093f7640 1 -- 172.21.15.78:0/3714056111 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fba0406d840 msgr2=0x7fba0406fac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:01:39.576 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:39.569+0000 7fba093f7640 1 --2- 172.21.15.78:0/3714056111 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fba0406d840 0x7fba0406fac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:39.576 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:39.569+0000 7fba093f7640 1 -- 172.21.15.78:0/3714056111 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9f0009420 con 0x7fba0414fc30 2023-11-28T20:01:39.576 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:39.569+0000 7fba093f7640 1 --2- 172.21.15.78:0/3714056111 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fba0414fc30 0x7fba040c3e30 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x7fb9fc001570 tx=0x7fb9fc00cca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:01:39.576 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:39.569+0000 7fba017fa640 1 -- 172.21.15.78:0/3714056111 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9fc00a640 con 0x7fba0414fc30 2023-11-28T20:01:39.576 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:39.569+0000 7fba017fa640 1 -- 172.21.15.78:0/3714056111 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb9fc00a7c0 con 0x7fba0414fc30 2023-11-28T20:01:39.576 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:39.569+0000 7fba0ae5a640 1 -- 172.21.15.78:0/3714056111 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fba041f0670 con 0x7fba0414fc30 2023-11-28T20:01:39.576 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:39.569+0000 7fba017fa640 1 -- 172.21.15.78:0/3714056111 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9fc00ab70 con 0x7fba0414fc30 2023-11-28T20:01:39.576 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:39.569+0000 7fba0ae5a640 1 -- 172.21.15.78:0/3714056111 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fba041f0c30 con 0x7fba0414fc30 2023-11-28T20:01:39.577 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:39.569+0000 7fba0ae5a640 1 -- 172.21.15.78:0/3714056111 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fba04067630 con 0x7fba0414fc30 2023-11-28T20:01:39.578 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:39.569+0000 7fba017fa640 1 -- 172.21.15.78:0/3714056111 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fb9fc00acd0 con 0x7fba0414fc30 2023-11-28T20:01:39.578 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:39.573+0000 7fba017fa640 1 --2- 172.21.15.78:0/3714056111 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fb9e80664a0 0x7fb9e8068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:39.578 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:39.573+0000 7fba017fa640 1 -- 172.21.15.78:0/3714056111 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 6885+0+0 (secure 0 0 0) 0x7fb9fc083bc0 con 0x7fba0414fc30 2023-11-28T20:01:39.578 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:39.573+0000 7fba08bf6640 1 --2- 172.21.15.78:0/3714056111 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fb9e80664a0 0x7fb9e8068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:39.578 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:39.573+0000 7fba08bf6640 1 --2- 172.21.15.78:0/3714056111 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fb9e80664a0 0x7fb9e8068960 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7fb9f8007fd0 tx=0x7fb9f8009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:01:39.580 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:39.577+0000 7fba017fa640 1 -- 172.21.15.78:0/3714056111 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fb9fc050bb0 con 0x7fba0414fc30 2023-11-28T20:01:39.730 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:39.725+0000 7fba0ae5a640 1 -- 172.21.15.78:0/3714056111 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs2_data", "var": "pg_num"} v 0) v1 -- 0x7fba041ecb40 con 0x7fba0414fc30 2023-11-28T20:01:39.730 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:39.725+0000 7fba017fa640 1 -- 172.21.15.78:0/3714056111 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs2_data", "var": "pg_num"}]=0 v65) v1 ==== 101+0+11 (secure 0 0 0) 0x7fb9fc0180a0 con 0x7fba0414fc30 2023-11-28T20:01:39.730 INFO:teuthology.orchestra.run.smithi078.stdout:pg_num: 64 2023-11-28T20:01:39.732 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:39.729+0000 7fba0ae5a640 1 -- 172.21.15.78:0/3714056111 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fb9e80664a0 msgr2=0x7fb9e8068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:01:39.732 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:39.729+0000 7fba0ae5a640 1 --2- 172.21.15.78:0/3714056111 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fb9e80664a0 0x7fb9e8068960 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7fb9f8007fd0 tx=0x7fb9f8009040 comp rx=0 tx=0).stop 2023-11-28T20:01:39.732 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:39.729+0000 7fba0ae5a640 1 -- 172.21.15.78:0/3714056111 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fba0414fc30 msgr2=0x7fba040c3e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:01:39.732 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:39.729+0000 7fba0ae5a640 1 --2- 172.21.15.78:0/3714056111 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fba0414fc30 0x7fba040c3e30 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x7fb9fc001570 tx=0x7fb9fc00cca0 comp rx=0 tx=0).stop 2023-11-28T20:01:39.732 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:39.729+0000 7fba0ae5a640 1 -- 172.21.15.78:0/3714056111 shutdown_connections 2023-11-28T20:01:39.733 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:39.729+0000 7fba0ae5a640 1 --2- 172.21.15.78:0/3714056111 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fb9e80664a0 0x7fb9e8068960 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:39.733 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:39.729+0000 7fba0ae5a640 1 --2- 172.21.15.78:0/3714056111 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fba0414f850 0x7fba040a70d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:39.733 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:39.729+0000 7fba0ae5a640 1 --2- 172.21.15.78:0/3714056111 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fba0414fc30 0x7fba040c3e30 unknown :-1 s=CLOSED pgs=744 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:39.733 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:39.729+0000 7fba0ae5a640 1 --2- 172.21.15.78:0/3714056111 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fba0406d840 0x7fba0406fac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:39.733 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:39.729+0000 7fba0ae5a640 1 -- 172.21.15.78:0/3714056111 >> 172.21.15.78:0/3714056111 conn(0x7fba040c59f0 msgr2=0x7fba040bed60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:01:39.733 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:39.729+0000 7fba0ae5a640 1 -- 172.21.15.78:0/3714056111 shutdown_connections 2023-11-28T20:01:39.733 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:39.729+0000 7fba0ae5a640 1 -- 172.21.15.78:0/3714056111 wait complete. 2023-11-28T20:01:39.751 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-11-28T20:01:39.895 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:39.889+0000 7f89d1557640 1 Processor -- start 2023-11-28T20:01:39.895 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:39.889+0000 7f89d1557640 1 -- start start 2023-11-28T20:01:39.896 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:39.893+0000 7f89d1557640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f89cc0c2110 0x7f89cc0c5ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:39.897 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:39.893+0000 7f89d1557640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f89cc0a93d0 con 0x7f89cc0c0c80 2023-11-28T20:01:39.897 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:39.893+0000 7f89d1557640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f89cc0a9640 con 0x7f89cc154390 2023-11-28T20:01:39.897 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:39.893+0000 7f89d1557640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f89cc0aa1c0 con 0x7f89cc0c2110 2023-11-28T20:01:39.897 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:39.893+0000 7f89ca7fc640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f89cc0c2110 0x7f89cc0c5ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:39.897 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:39.893+0000 7f89ca7fc640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f89cc0c2110 0x7f89cc0c5ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:55458/0 (socket says 172.21.15.78:55458) 2023-11-28T20:01:39.897 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:39.893+0000 7f89ca7fc640 1 -- 172.21.15.78:0/1029758123 learned_addr learned my addr 172.21.15.78:0/1029758123 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T20:01:39.897 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:39.893+0000 7f89ca7fc640 1 -- 172.21.15.78:0/1029758123 >> v1:172.21.15.179:6789/0 conn(0x7f89cc154390 legacy=0x7f89cc0c4a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:01:39.897 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:39.893+0000 7f89ca7fc640 1 -- 172.21.15.78:0/1029758123 >> v1:172.21.15.78:6789/0 conn(0x7f89cc0c0c80 legacy=0x7f89cc0c61e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:01:39.897 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:39.893+0000 7f89ca7fc640 1 -- 172.21.15.78:0/1029758123 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89cc0a9920 con 0x7f89cc0c2110 2023-11-28T20:01:39.897 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:39.893+0000 7f89c9ffb640 1 -- 172.21.15.78:0/1029758123 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 275744602 0 0) 0x7f89cc0a93d0 con 0x7f89cc0c0c80 2023-11-28T20:01:39.899 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:39.897+0000 7f89ca7fc640 1 --2- 172.21.15.78:0/1029758123 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f89cc0c2110 0x7f89cc0c5ca0 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7f89c0009870 tx=0x7f89c001c540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4d45e7c61bd0a718 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:01:39.900 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:39.897+0000 7f89c9ffb640 1 -- 172.21.15.78:0/1029758123 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89c00ab650 con 0x7f89cc0c2110 2023-11-28T20:01:39.900 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:39.897+0000 7f89c9ffb640 1 -- 172.21.15.78:0/1029758123 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f89c00ab7b0 con 0x7f89cc0c2110 2023-11-28T20:01:39.900 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:39.897+0000 7f89c9ffb640 1 -- 172.21.15.78:0/1029758123 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89c00abb40 con 0x7f89cc0c2110 2023-11-28T20:01:39.901 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:39.897+0000 7f89d1557640 1 -- 172.21.15.78:0/1029758123 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f89cc0c2110 msgr2=0x7f89cc0c5ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:01:39.901 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:39.897+0000 7f89d1557640 1 --2- 172.21.15.78:0/1029758123 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f89cc0c2110 0x7f89cc0c5ca0 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7f89c0009870 tx=0x7f89c001c540 comp rx=0 tx=0).stop 2023-11-28T20:01:39.901 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:39.897+0000 7f89d1557640 1 -- 172.21.15.78:0/1029758123 shutdown_connections 2023-11-28T20:01:39.901 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:39.897+0000 7f89d1557640 1 --2- 172.21.15.78:0/1029758123 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f89cc0c2110 0x7f89cc0c5ca0 unknown :-1 s=CLOSED pgs=746 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:39.901 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:39.897+0000 7f89d1557640 1 -- 172.21.15.78:0/1029758123 >> 172.21.15.78:0/1029758123 conn(0x7f89cc06b220 msgr2=0x7f89cc0a77e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:01:39.901 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:39.897+0000 7f89d1557640 1 -- 172.21.15.78:0/1029758123 shutdown_connections 2023-11-28T20:01:39.901 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:39.897+0000 7f89d1557640 1 -- 172.21.15.78:0/1029758123 wait complete. 2023-11-28T20:01:39.902 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:39.897+0000 7f89d1557640 1 Processor -- start 2023-11-28T20:01:39.902 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:39.897+0000 7f89d1557640 1 -- start start 2023-11-28T20:01:39.904 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:39.901+0000 7f89d1557640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f89cc0c0c80 0x7f89cc14a010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:39.904 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:39.901+0000 7f89d1557640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f89cc0c2110 0x7f89cc070610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:39.904 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:39.901+0000 7f89d1557640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f89cc154390 0x7f89cc1532d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:39.904 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:39.901+0000 7f89d1557640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89cc150b30 con 0x7f89cc154390 2023-11-28T20:01:39.904 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:39.901+0000 7f89d1557640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89cc070b50 con 0x7f89cc0c2110 2023-11-28T20:01:39.905 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:39.901+0000 7f89d1557640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f89cc072570 con 0x7f89cc0c0c80 2023-11-28T20:01:39.905 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:39.901+0000 7f89cb7fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f89cc154390 0x7f89cc1532d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:39.905 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:39.901+0000 7f89cb7fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f89cc154390 0x7f89cc1532d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:55468/0 (socket says 172.21.15.78:55468) 2023-11-28T20:01:39.905 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:39.901+0000 7f89cb7fe640 1 -- 172.21.15.78:0/1003898513 learned_addr learned my addr 172.21.15.78:0/1003898513 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T20:01:39.905 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:39.901+0000 7f89caffd640 1 --2- 172.21.15.78:0/1003898513 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f89cc0c0c80 0x7f89cc14a010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:39.905 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:39.901+0000 7f89ca7fc640 1 --2- 172.21.15.78:0/1003898513 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f89cc0c2110 0x7f89cc070610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:39.905 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:39.901+0000 7f89cb7fe640 1 -- 172.21.15.78:0/1003898513 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f89cc0c0c80 msgr2=0x7f89cc14a010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:01:39.905 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:39.901+0000 7f89cb7fe640 1 --2- 172.21.15.78:0/1003898513 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f89cc0c0c80 0x7f89cc14a010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:39.905 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:39.901+0000 7f89cb7fe640 1 -- 172.21.15.78:0/1003898513 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f89cc0c2110 msgr2=0x7f89cc070610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:01:39.905 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:39.901+0000 7f89cb7fe640 1 --2- 172.21.15.78:0/1003898513 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f89cc0c2110 0x7f89cc070610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:39.906 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:39.901+0000 7f89cb7fe640 1 -- 172.21.15.78:0/1003898513 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89c00094d0 con 0x7f89cc154390 2023-11-28T20:01:39.906 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:39.901+0000 7f89cb7fe640 1 --2- 172.21.15.78:0/1003898513 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f89cc154390 0x7f89cc1532d0 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x7f89c4001570 tx=0x7f89c400cd20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:01:39.907 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:39.901+0000 7f89b37fe640 1 -- 172.21.15.78:0/1003898513 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89c4003db0 con 0x7f89cc154390 2023-11-28T20:01:39.907 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:39.901+0000 7f89b37fe640 1 -- 172.21.15.78:0/1003898513 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f89c4005070 con 0x7f89cc154390 2023-11-28T20:01:39.907 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:39.901+0000 7f89d1557640 1 -- 172.21.15.78:0/1003898513 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f89cc072850 con 0x7f89cc154390 2023-11-28T20:01:39.907 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:39.901+0000 7f89b37fe640 1 -- 172.21.15.78:0/1003898513 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89c4005420 con 0x7f89cc154390 2023-11-28T20:01:39.907 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:39.901+0000 7f89d1557640 1 -- 172.21.15.78:0/1003898513 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f89cc153810 con 0x7f89cc154390 2023-11-28T20:01:39.907 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:39.901+0000 7f89d1557640 1 -- 172.21.15.78:0/1003898513 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f89cc150ca0 con 0x7f89cc154390 2023-11-28T20:01:39.907 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:39.901+0000 7f89b37fe640 1 -- 172.21.15.78:0/1003898513 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f89c4005580 con 0x7f89cc154390 2023-11-28T20:01:39.908 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:39.905+0000 7f89b37fe640 1 --2- 172.21.15.78:0/1003898513 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f89b80664a0 0x7f89b8068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:39.908 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:39.905+0000 7f89b37fe640 1 -- 172.21.15.78:0/1003898513 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 6885+0+0 (secure 0 0 0) 0x7f89c4083b60 con 0x7f89cc154390 2023-11-28T20:01:39.908 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:39.905+0000 7f89caffd640 1 --2- 172.21.15.78:0/1003898513 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f89b80664a0 0x7f89b8068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:39.908 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:39.905+0000 7f89caffd640 1 --2- 172.21.15.78:0/1003898513 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f89b80664a0 0x7f89b8068960 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f89bc007fd0 tx=0x7f89bc009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:01:39.911 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:39.909+0000 7f89b37fe640 1 -- 172.21.15.78:0/1003898513 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f89c4050be0 con 0x7f89cc154390 2023-11-28T20:01:40.075 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:40.069+0000 7f89d1557640 1 -- 172.21.15.78:0/1003898513 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f89cc067630 con 0x7f89cc154390 2023-11-28T20:01:40.075 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:40.069+0000 7f89b37fe640 1 -- 172.21.15.78:0/1003898513 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v65) v1 ==== 80+0+0 (secure 0 0 0) 0x7f89c4017020 con 0x7f89cc154390 2023-11-28T20:01:40.075 INFO:teuthology.orchestra.run.smithi078.stderr:listed 0 entries 2023-11-28T20:01:40.077 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:40.073+0000 7f89d1557640 1 -- 172.21.15.78:0/1003898513 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f89b80664a0 msgr2=0x7f89b8068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:01:40.077 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:40.073+0000 7f89d1557640 1 --2- 172.21.15.78:0/1003898513 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f89b80664a0 0x7f89b8068960 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f89bc007fd0 tx=0x7f89bc009040 comp rx=0 tx=0).stop 2023-11-28T20:01:40.077 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:40.073+0000 7f89d1557640 1 -- 172.21.15.78:0/1003898513 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f89cc154390 msgr2=0x7f89cc1532d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:01:40.077 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:40.073+0000 7f89d1557640 1 --2- 172.21.15.78:0/1003898513 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f89cc154390 0x7f89cc1532d0 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x7f89c4001570 tx=0x7f89c400cd20 comp rx=0 tx=0).stop 2023-11-28T20:01:40.078 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:40.073+0000 7f89d1557640 1 -- 172.21.15.78:0/1003898513 shutdown_connections 2023-11-28T20:01:40.078 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:40.073+0000 7f89d1557640 1 --2- 172.21.15.78:0/1003898513 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f89b80664a0 0x7f89b8068960 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:40.078 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:40.073+0000 7f89d1557640 1 --2- 172.21.15.78:0/1003898513 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f89cc154390 0x7f89cc1532d0 unknown :-1 s=CLOSED pgs=747 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:40.078 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:40.073+0000 7f89d1557640 1 --2- 172.21.15.78:0/1003898513 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f89cc0c2110 0x7f89cc070610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:40.078 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:40.073+0000 7f89d1557640 1 --2- 172.21.15.78:0/1003898513 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f89cc0c0c80 0x7f89cc14a010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:40.078 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:40.073+0000 7f89d1557640 1 -- 172.21.15.78:0/1003898513 >> 172.21.15.78:0/1003898513 conn(0x7f89cc06b220 msgr2=0x7f89cc0c4a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:01:40.078 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:40.073+0000 7f89d1557640 1 -- 172.21.15.78:0/1003898513 shutdown_connections 2023-11-28T20:01:40.078 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:40.073+0000 7f89d1557640 1 -- 172.21.15.78:0/1003898513 wait complete. 2023-11-28T20:01:40.096 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-11-28T20:01:40.096 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T20:01:40.097 DEBUG:teuthology.orchestra.run.smithi078:> sudo umount /home/ubuntu/cephtest/mnt.0 2023-11-28T20:01:40.124 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi078.front.sepia.ceph.com 2023-11-28T20:01:40.124 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T20:01:40.124 DEBUG:teuthology.orchestra.run.smithi078:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-11-28T20:01:40.176 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2023-11-28T20:01:40.176 DEBUG:teuthology.orchestra.run.smithi078:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-28T20:01:40.227 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354608k,nr_inodes=4088652,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275372k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=5526 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275368k,nr_inodes=818842,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275372k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 2023-11-28T20:01:40.228 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-11-28T20:01:40.406 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:40.401+0000 7f1ee7a17640 1 Processor -- start 2023-11-28T20:01:40.407 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:40.401+0000 7f1ee7a17640 1 -- start start 2023-11-28T20:01:40.408 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:40.405+0000 7f1ee7a17640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f1ee00c0f30 0x7f1ee0072580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:40.408 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:40.405+0000 7f1ee7a17640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f1ee00c3960 0x7f1ee00c0460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:40.409 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:40.405+0000 7f1ee7a17640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1ee00c1a50 con 0x7f1ee0159280 2023-11-28T20:01:40.409 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:40.405+0000 7f1ee7a17640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1ee00c3de0 con 0x7f1ee00c3960 2023-11-28T20:01:40.409 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:40.405+0000 7f1ee7a17640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1ee00c1ca0 con 0x7f1ee00c0f30 2023-11-28T20:01:40.409 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:40.405+0000 7f1ee4fb2640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f1ee00c3960 0x7f1ee00c0460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:40.409 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:40.405+0000 7f1ee5fb4640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f1ee0159280 0x7f1ee0155ed0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:39488/0 (socket says 172.21.15.78:39488) 2023-11-28T20:01:40.409 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:40.405+0000 7f1ee4fb2640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f1ee00c3960 0x7f1ee00c0460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:55484/0 (socket says 172.21.15.78:55484) 2023-11-28T20:01:40.409 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:40.405+0000 7f1ee5fb4640 1 -- 172.21.15.78:0/2461134032 learned_addr learned my addr 172.21.15.78:0/2461134032 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-11-28T20:01:40.409 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:40.405+0000 7f1ee57b3640 1 --2- 172.21.15.78:0/2461134032 >> v2:172.21.15.179:3300/0 conn(0x7f1ee00c0f30 0x7f1ee0072580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:40.409 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:40.405+0000 7f1ee4fb2640 1 -- 172.21.15.78:0/2461134032 >> v2:172.21.15.179:3300/0 conn(0x7f1ee00c0f30 msgr2=0x7f1ee0072580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:01:40.409 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:40.405+0000 7f1ee4fb2640 1 --2- 172.21.15.78:0/2461134032 >> v2:172.21.15.179:3300/0 conn(0x7f1ee00c0f30 0x7f1ee0072580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:40.409 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:40.405+0000 7f1ee4fb2640 1 -- 172.21.15.78:0/2461134032 >> v1:172.21.15.78:6789/0 conn(0x7f1ee0159280 legacy=0x7f1ee0155ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:01:40.410 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:40.405+0000 7f1ee4fb2640 1 -- 172.21.15.78:0/2461134032 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ee00c1f80 con 0x7f1ee00c3960 2023-11-28T20:01:40.410 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:40.405+0000 7f1ed7fff640 1 -- 172.21.15.78:0/2461134032 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 606527077 0 0) 0x7f1ee00c1a50 con 0x7f1ee0159280 2023-11-28T20:01:40.410 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:40.405+0000 7f1ee57b3640 1 --2- 172.21.15.78:0/2461134032 >> v2:172.21.15.179:3300/0 conn(0x7f1ee00c0f30 0x7f1ee0072580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T20:01:40.411 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:40.409+0000 7f1ee4fb2640 1 --2- 172.21.15.78:0/2461134032 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1ee00c3960 0x7f1ee00c0460 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7f1ee006b520 tx=0x7f1ed001c3d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1ffd9e82076cfbb1 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:01:40.412 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:40.409+0000 7f1ed7fff640 1 -- 172.21.15.78:0/2461134032 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ed00ab5f0 con 0x7f1ee00c3960 2023-11-28T20:01:40.412 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:40.409+0000 7f1ed7fff640 1 -- 172.21.15.78:0/2461134032 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ed00ab750 con 0x7f1ee00c3960 2023-11-28T20:01:40.412 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:40.409+0000 7f1ed7fff640 1 -- 172.21.15.78:0/2461134032 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ed00abae0 con 0x7f1ee00c3960 2023-11-28T20:01:40.413 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:40.409+0000 7f1ee7a17640 1 -- 172.21.15.78:0/2461134032 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1ee00c3960 msgr2=0x7f1ee00c0460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:01:40.413 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:40.409+0000 7f1ee7a17640 1 --2- 172.21.15.78:0/2461134032 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1ee00c3960 0x7f1ee00c0460 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7f1ee006b520 tx=0x7f1ed001c3d0 comp rx=0 tx=0).stop 2023-11-28T20:01:40.413 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:40.409+0000 7f1ee7a17640 1 -- 172.21.15.78:0/2461134032 shutdown_connections 2023-11-28T20:01:40.414 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:40.409+0000 7f1ee7a17640 1 --2- 172.21.15.78:0/2461134032 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1ee00c3960 0x7f1ee00c0460 unknown :-1 s=CLOSED pgs=749 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:40.414 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:40.409+0000 7f1ee7a17640 1 --2- 172.21.15.78:0/2461134032 >> v2:172.21.15.179:3300/0 conn(0x7f1ee00c0f30 0x7f1ee0072580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:40.414 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:40.409+0000 7f1ee7a17640 1 -- 172.21.15.78:0/2461134032 >> 172.21.15.78:0/2461134032 conn(0x7f1ee00a7810 msgr2=0x7f1ee00a7c20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:01:40.414 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:40.409+0000 7f1ee7a17640 1 -- 172.21.15.78:0/2461134032 shutdown_connections 2023-11-28T20:01:40.415 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:40.409+0000 7f1ee7a17640 1 -- 172.21.15.78:0/2461134032 wait complete. 2023-11-28T20:01:40.419 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:40.409+0000 7f1ee7a17640 1 Processor -- start 2023-11-28T20:01:40.419 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:40.409+0000 7f1ee7a17640 1 -- start start 2023-11-28T20:01:40.419 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:40.409+0000 7f1ee7a17640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1ee00c0f30 0x7f1ee0151e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:40.420 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:40.409+0000 7f1ee7a17640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1ee00c3960 0x7f1ee01f0d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:40.420 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:40.413+0000 7f1ee7a17640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1ee0159280 0x7f1ee01f1280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:40.420 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:40.413+0000 7f1ee7a17640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ee01f4aa0 con 0x7f1ee00c3960 2023-11-28T20:01:40.420 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:40.413+0000 7f1ee7a17640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ee00aafc0 con 0x7f1ee0159280 2023-11-28T20:01:40.420 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:40.413+0000 7f1ee7a17640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ee00a90d0 con 0x7f1ee00c0f30 2023-11-28T20:01:40.420 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:40.413+0000 7f1ee4fb2640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1ee00c3960 0x7f1ee01f0d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:40.420 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:40.413+0000 7f1ee4fb2640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1ee00c3960 0x7f1ee01f0d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:55496/0 (socket says 172.21.15.78:55496) 2023-11-28T20:01:40.420 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:40.413+0000 7f1ee4fb2640 1 -- 172.21.15.78:0/1365899911 learned_addr learned my addr 172.21.15.78:0/1365899911 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T20:01:40.420 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:40.413+0000 7f1ee5fb4640 1 --2- 172.21.15.78:0/1365899911 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1ee0159280 0x7f1ee01f1280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:40.420 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:40.413+0000 7f1ee4fb2640 1 -- 172.21.15.78:0/1365899911 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1ee00c0f30 msgr2=0x7f1ee0151e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:01:40.420 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:40.413+0000 7f1ee4fb2640 1 --2- 172.21.15.78:0/1365899911 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1ee00c0f30 0x7f1ee0151e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:40.421 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:40.413+0000 7f1ee4fb2640 1 -- 172.21.15.78:0/1365899911 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1ee0159280 msgr2=0x7f1ee01f1280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:01:40.421 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:40.413+0000 7f1ee4fb2640 1 --2- 172.21.15.78:0/1365899911 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1ee0159280 0x7f1ee01f1280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:40.421 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:40.413+0000 7f1ee4fb2640 1 -- 172.21.15.78:0/1365899911 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ed0009420 con 0x7f1ee00c3960 2023-11-28T20:01:40.421 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:40.413+0000 7f1ee5fb4640 1 --2- 172.21.15.78:0/1365899911 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1ee0159280 0x7f1ee01f1280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T20:01:40.421 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:40.413+0000 7f1ee4fb2640 1 --2- 172.21.15.78:0/1365899911 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1ee00c3960 0x7f1ee01f0d40 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x7f1ed0018fe0 tx=0x7f1ed001ac10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:01:40.421 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:40.413+0000 7f1ed5ffb640 1 -- 172.21.15.78:0/1365899911 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ed00bf610 con 0x7f1ee00c3960 2023-11-28T20:01:40.421 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:40.413+0000 7f1ed5ffb640 1 -- 172.21.15.78:0/1365899911 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ed00bf790 con 0x7f1ee00c3960 2023-11-28T20:01:40.421 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:40.413+0000 7f1ed5ffb640 1 -- 172.21.15.78:0/1365899911 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ed00bfb40 con 0x7f1ee00c3960 2023-11-28T20:01:40.421 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:40.413+0000 7f1ee7a17640 1 -- 172.21.15.78:0/1365899911 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1ee00a2670 con 0x7f1ee00c3960 2023-11-28T20:01:40.421 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:40.413+0000 7f1ee7a17640 1 -- 172.21.15.78:0/1365899911 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1ee00a8df0 con 0x7f1ee00c3960 2023-11-28T20:01:40.421 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:40.413+0000 7f1ee7a17640 1 -- 172.21.15.78:0/1365899911 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1ee01f4be0 con 0x7f1ee00c3960 2023-11-28T20:01:40.421 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:40.413+0000 7f1ed5ffb640 1 -- 172.21.15.78:0/1365899911 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f1ed00bfca0 con 0x7f1ee00c3960 2023-11-28T20:01:40.422 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:40.413+0000 7f1ed5ffb640 1 --2- 172.21.15.78:0/1365899911 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f1ec4066470 0x7f1ec4068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:40.422 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:40.417+0000 7f1ed5ffb640 1 -- 172.21.15.78:0/1365899911 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 6885+0+0 (secure 0 0 0) 0x7f1ed00a8050 con 0x7f1ee00c3960 2023-11-28T20:01:40.422 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:40.417+0000 7f1ee57b3640 1 --2- 172.21.15.78:0/1365899911 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f1ec4066470 0x7f1ec4068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:40.422 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:40.417+0000 7f1ee57b3640 1 --2- 172.21.15.78:0/1365899911 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f1ec4066470 0x7f1ec4068930 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f1edc006e90 tx=0x7f1edc008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:01:40.423 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:40.417+0000 7f1ed5ffb640 1 -- 172.21.15.78:0/1365899911 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f1ee01f4be0 con 0x7f1ee00c3960 2023-11-28T20:01:40.606 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:40.601+0000 7f1ee7a17640 1 -- 172.21.15.78:0/1365899911 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f1ee01f4be0 con 0x7f1ee00c3960 2023-11-28T20:01:40.606 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:40.601+0000 7f1ed5ffb640 1 -- 172.21.15.78:0/1365899911 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v36) v1 ==== 53+0+149 (secure 0 0 0) 0x7f1ee01f4be0 con 0x7f1ee00c3960 2023-11-28T20:01:40.606 INFO:teuthology.orchestra.run.smithi078.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-11-28T20:01:40.607 INFO:teuthology.orchestra.run.smithi078.stdout:name: cephfs2, metadata pool: cephfs2_metadata, data pools: [cephfs2_data ] 2023-11-28T20:01:40.608 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:40.605+0000 7f1ee7a17640 1 -- 172.21.15.78:0/1365899911 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f1ec4066470 msgr2=0x7f1ec4068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:01:40.609 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:40.605+0000 7f1ee7a17640 1 --2- 172.21.15.78:0/1365899911 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f1ec4066470 0x7f1ec4068930 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f1edc006e90 tx=0x7f1edc008040 comp rx=0 tx=0).stop 2023-11-28T20:01:40.609 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:40.605+0000 7f1ee7a17640 1 -- 172.21.15.78:0/1365899911 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1ee00c3960 msgr2=0x7f1ee01f0d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:01:40.609 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:40.605+0000 7f1ee7a17640 1 --2- 172.21.15.78:0/1365899911 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1ee00c3960 0x7f1ee01f0d40 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x7f1ed0018fe0 tx=0x7f1ed001ac10 comp rx=0 tx=0).stop 2023-11-28T20:01:40.609 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:40.605+0000 7f1ee7a17640 1 -- 172.21.15.78:0/1365899911 shutdown_connections 2023-11-28T20:01:40.609 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:40.605+0000 7f1ee7a17640 1 --2- 172.21.15.78:0/1365899911 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f1ec4066470 0x7f1ec4068930 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:40.610 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:40.605+0000 7f1ee7a17640 1 --2- 172.21.15.78:0/1365899911 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1ee0159280 0x7f1ee01f1280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:40.610 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:40.605+0000 7f1ee7a17640 1 --2- 172.21.15.78:0/1365899911 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1ee00c3960 0x7f1ee01f0d40 unknown :-1 s=CLOSED pgs=750 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:40.610 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:40.605+0000 7f1ee7a17640 1 --2- 172.21.15.78:0/1365899911 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1ee00c0f30 0x7f1ee0151e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:40.610 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:40.605+0000 7f1ee7a17640 1 -- 172.21.15.78:0/1365899911 >> 172.21.15.78:0/1365899911 conn(0x7f1ee00a7810 msgr2=0x7f1ee00c3f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:01:40.610 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:40.605+0000 7f1ee7a17640 1 -- 172.21.15.78:0/1365899911 shutdown_connections 2023-11-28T20:01:40.611 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:40.605+0000 7f1ee7a17640 1 -- 172.21.15.78:0/1365899911 wait complete. 2023-11-28T20:01:40.627 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs2; just confirmed its presence on cluster 2023-11-28T20:01:40.627 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-11-28T20:01:40.628 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi078.front.sepia.ceph.com 2023-11-28T20:01:40.628 INFO:tasks.cephfs.mount:self.client.name = client.testuser 2023-11-28T20:01:40.628 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-11-28T20:01:40.628 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs2 2023-11-28T20:01:40.628 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-11-28T20:01:40.628 INFO:tasks.cephfs.mount:self.client_keyring_path = /tmp/tmp.sAxLtLz9W8 2023-11-28T20:01:40.628 DEBUG:teuthology.orchestra.run.smithi078:> mktemp 2023-11-28T20:01:40.637 INFO:teuthology.orchestra.run.smithi078.stdout:/tmp/tmp.CsrqoM6tJn 2023-11-28T20:01:40.637 DEBUG:teuthology.orchestra.run.smithi078:> sudo cp /tmp/tmp.sAxLtLz9W8 /tmp/tmp.CsrqoM6tJn 2023-11-28T20:01:40.699 DEBUG:teuthology.orchestra.run.smithi078:> sudo chmod 0666 /tmp/tmp.CsrqoM6tJn 2023-11-28T20:01:40.816 DEBUG:teuthology.orchestra.remote:smithi078:/tmp/tmp.CsrqoM6tJn is 245B 2023-11-28T20:01:40.831 DEBUG:teuthology.orchestra.run.smithi078:> rm -fr /tmp/tmp.CsrqoM6tJn 2023-11-28T20:01:40.840 INFO:tasks.cephfs.mount:keyring content - [client.testuser] key = AQAhR2ZlyvZKCRAAIn4WEgjDDSb+3VyIKui1gA== caps mds = "allow rw fsname=cephfs" caps mon = "allow rw fsname=cephfs, allow rw fsname=cephfs2" caps osd = "allow rw tag cephfs data=cephfs, allow rw tag cephfs data=cephfs2" 2023-11-28T20:01:40.840 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-11-28T20:01:40.840 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T20:01:40.840 DEBUG:teuthology.orchestra.run.smithi078:> ip addr 2023-11-28T20:01:40.895 INFO:teuthology.orchestra.run.smithi078.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-11-28T20:01:40.895 INFO:teuthology.orchestra.run.smithi078.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-11-28T20:01:40.895 INFO:teuthology.orchestra.run.smithi078.stdout: inet 127.0.0.1/8 scope host lo 2023-11-28T20:01:40.895 INFO:teuthology.orchestra.run.smithi078.stdout: valid_lft forever preferred_lft forever 2023-11-28T20:01:40.896 INFO:teuthology.orchestra.run.smithi078.stdout: inet6 ::1/128 scope host 2023-11-28T20:01:40.896 INFO:teuthology.orchestra.run.smithi078.stdout: valid_lft forever preferred_lft forever 2023-11-28T20:01:40.896 INFO:teuthology.orchestra.run.smithi078.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-11-28T20:01:40.896 INFO:teuthology.orchestra.run.smithi078.stdout: link/ether 0c:c4:7a:d8:a1:22 brd ff:ff:ff:ff:ff:ff 2023-11-28T20:01:40.896 INFO:teuthology.orchestra.run.smithi078.stdout: altname enp7s0f0 2023-11-28T20:01:40.896 INFO:teuthology.orchestra.run.smithi078.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-11-28T20:01:40.896 INFO:teuthology.orchestra.run.smithi078.stdout: link/ether 0c:c4:7a:d8:a1:23 brd ff:ff:ff:ff:ff:ff 2023-11-28T20:01:40.896 INFO:teuthology.orchestra.run.smithi078.stdout: altname enp7s0f1 2023-11-28T20:01:40.896 INFO:teuthology.orchestra.run.smithi078.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-11-28T20:01:40.896 INFO:teuthology.orchestra.run.smithi078.stdout: link/ether 0c:c4:7a:8f:d4:dc brd ff:ff:ff:ff:ff:ff 2023-11-28T20:01:40.896 INFO:teuthology.orchestra.run.smithi078.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-11-28T20:01:40.897 INFO:teuthology.orchestra.run.smithi078.stdout: link/ether 0c:c4:7a:8f:d4:dd brd ff:ff:ff:ff:ff:ff 2023-11-28T20:01:40.897 INFO:teuthology.orchestra.run.smithi078.stdout: inet 172.21.15.78/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2023-11-28T20:01:40.897 INFO:teuthology.orchestra.run.smithi078.stdout: valid_lft 42271sec preferred_lft 42271sec 2023-11-28T20:01:40.897 INFO:teuthology.orchestra.run.smithi078.stdout: inet6 fe80::ec4:7aff:fe8f:d4dd/64 scope link 2023-11-28T20:01:40.897 INFO:teuthology.orchestra.run.smithi078.stdout: valid_lft forever preferred_lft forever 2023-11-28T20:01:40.897 INFO:teuthology.orchestra.run.smithi078.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-11-28T20:01:40.897 INFO:teuthology.orchestra.run.smithi078.stdout: link/ether 02:42:8f:cc:76:dd brd ff:ff:ff:ff:ff:ff 2023-11-28T20:01:40.897 INFO:teuthology.orchestra.run.smithi078.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-11-28T20:01:40.897 INFO:teuthology.orchestra.run.smithi078.stdout: valid_lft forever preferred_lft forever 2023-11-28T20:01:40.898 INFO:teuthology.orchestra.run.smithi078.stdout:9: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-11-28T20:01:40.898 INFO:teuthology.orchestra.run.smithi078.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2023-11-28T20:01:40.898 INFO:teuthology.orchestra.run.smithi078.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-11-28T20:01:40.898 INFO:teuthology.orchestra.run.smithi078.stdout: valid_lft forever preferred_lft forever 2023-11-28T20:01:40.898 INFO:teuthology.orchestra.run.smithi078.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2023-11-28T20:01:40.898 INFO:teuthology.orchestra.run.smithi078.stdout: valid_lft forever preferred_lft forever 2023-11-28T20:01:40.899 INFO:teuthology.orchestra.run.smithi078.stdout:10: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-11-28T20:01:40.899 INFO:teuthology.orchestra.run.smithi078.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-28T20:01:40.899 INFO:teuthology.orchestra.run.smithi078.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2023-11-28T20:01:40.899 INFO:teuthology.orchestra.run.smithi078.stdout: valid_lft forever preferred_lft forever 2023-11-28T20:01:40.900 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T20:01:40.900 DEBUG:teuthology.orchestra.run.smithi078:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-11-28T20:01:40.961 INFO:teuthology.orchestra.run.smithi078.stdout:1 2023-11-28T20:01:40.964 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T20:01:40.964 DEBUG:teuthology.orchestra.run.smithi078:> route 2023-11-28T20:01:41.018 INFO:teuthology.orchestra.run.smithi078.stdout:Kernel IP routing table 2023-11-28T20:01:41.019 INFO:teuthology.orchestra.run.smithi078.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-11-28T20:01:41.019 INFO:teuthology.orchestra.run.smithi078.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2023-11-28T20:01:41.019 INFO:teuthology.orchestra.run.smithi078.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-11-28T20:01:41.019 INFO:teuthology.orchestra.run.smithi078.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-11-28T20:01:41.019 INFO:teuthology.orchestra.run.smithi078.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-11-28T20:01:41.019 INFO:teuthology.orchestra.run.smithi078.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-11-28T20:01:41.019 INFO:teuthology.orchestra.run.smithi078.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-11-28T20:01:41.019 INFO:teuthology.orchestra.run.smithi078.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-11-28T20:01:41.020 INFO:teuthology.orchestra.run.smithi078.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-11-28T20:01:41.020 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T20:01:41.020 DEBUG:teuthology.orchestra.run.smithi078:> (cd / && exec bash -c ' 2023-11-28T20:01:41.020 DEBUG:teuthology.orchestra.run.smithi078:> set -e 2023-11-28T20:01:41.020 DEBUG:teuthology.orchestra.run.smithi078:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-11-28T20:01:41.020 DEBUG:teuthology.orchestra.run.smithi078:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-11-28T20:01:41.020 DEBUG:teuthology.orchestra.run.smithi078:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-11-28T20:01:41.020 DEBUG:teuthology.orchestra.run.smithi078:> ') 2023-11-28T20:01:41.118 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T20:01:41.118 DEBUG:teuthology.orchestra.run.smithi078:> ip netns list 2023-11-28T20:01:41.127 INFO:teuthology.orchestra.run.smithi078.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-11-28T20:01:41.128 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-11-28T20:01:41.128 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T20:01:41.128 DEBUG:teuthology.orchestra.run.smithi078:> sudo ip link set brx.0 up 2023-11-28T20:01:41.191 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-28T20:01:41.191 DEBUG:teuthology.orchestra.run.smithi078:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-11-28T20:01:41.243 INFO:teuthology.orchestra.run.smithi078.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-11-28T20:01:41.244 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-28T20:01:41.244 DEBUG:teuthology.orchestra.run.smithi078:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-11-28T20:01:41.299 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2023-11-28T20:01:41.299 DEBUG:teuthology.orchestra.run.smithi078:> dd if=/tmp/tmp.sAxLtLz9W8 of=/dev/stdout 2023-11-28T20:01:41.351 INFO:tasks.cephfs.kernel_mount:mounting using device: testuser@.cephfs2=/ 2023-11-28T20:01:41.351 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T20:01:41.352 DEBUG:teuthology.orchestra.run.smithi078:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph testuser@.cephfs2=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,secret=AQAhR2ZlyvZKCRAAIn4WEgjDDSb+3VyIKui1gA==,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-11-28T20:01:41.445 INFO:teuthology.orchestra.run.smithi078.stdout:parsing options: rw,norequire_active_mds,secret=AQAhR2ZlyvZKCRAAIn4WEgjDDSb+3VyIKui1gA==,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-11-28T20:01:41.445 INFO:teuthology.orchestra.run.smithi078.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-11-28T20:01:41.445 INFO:teuthology.orchestra.run.smithi078.stdout:keyring.get_secret failed 2023-11-28T20:01:41.456 INFO:teuthology.orchestra.run.smithi078.stderr:mount.ceph: kernel BUG! 2023-11-28T20:01:41.456 INFO:teuthology.orchestra.run.smithi078.stderr:mount error 13 = Permission denied 2023-11-28T20:01:41.457 INFO:teuthology.orchestra.run.smithi078.stdout:parsing options: rw,norequire_active_mds,secret=AQAhR2ZlyvZKCRAAIn4WEgjDDSb+3VyIKui1gA==,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-11-28T20:01:41.457 INFO:teuthology.orchestra.run.smithi078.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-11-28T20:01:41.457 INFO:teuthology.orchestra.run.smithi078.stdout:mount.ceph: resolved to: "172.21.15.78:3300,172.21.15.179:3300,172.21.15.179:3301" 2023-11-28T20:01:41.457 INFO:teuthology.orchestra.run.smithi078.stdout:mount.ceph: trying mount with new device syntax: testuser@dd9780e8-3bda-44fa-a9f0-fa07d19d901d.cephfs2=/ 2023-11-28T20:01:41.457 INFO:teuthology.orchestra.run.smithi078.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=testuser,ms_mode=prefer-crc,key=testuser,mon_addr=172.21.15.78:3300/172.21.15.179:3300/172.21.15.179:3301" will pass to kernel 2023-11-28T20:01:41.460 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-11-28T20:01:41.461 INFO:tasks.cephfs.kernel_mount:mount command failed 2023-11-28T20:01:41.461 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-11-28T20:01:41.461 DEBUG:teuthology.orchestra.run.smithi078:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-11-28T20:01:41.551 DEBUG:teuthology.orchestra.run.smithi179:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-11-28T20:01:41.656 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-11-28T20:01:41.656 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2023-11-28T20:01:41.656 DEBUG:teuthology.orchestra.run.smithi078:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-28T20:01:41.665 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354608k,nr_inodes=4088652,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275372k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=5526 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275368k,nr_inodes=818842,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275372k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 2023-11-28T20:01:41.665 DEBUG:teuthology.orchestra.run.smithi179:> set -ex 2023-11-28T20:01:41.665 DEBUG:teuthology.orchestra.run.smithi179:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-28T20:01:41.675 DEBUG:teuthology.orchestra.run.smithi179:> set -ex 2023-11-28T20:01:41.675 DEBUG:teuthology.orchestra.run.smithi179:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-28T20:01:41.725 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-28T20:01:41.863 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:41.857+0000 7fe33045f640 1 Processor -- start 2023-11-28T20:01:41.863 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:41.857+0000 7fe33045f640 1 -- start start 2023-11-28T20:01:41.864 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:41.861+0000 7fe33045f640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fe32814b2a0 0x7fe3280a4ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:41.864 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:41.861+0000 7fe33045f640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fe3280bee90 0x7fe3280bf310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:41.864 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:41.861+0000 7fe33045f640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe328157cf0 con 0x7fe328154740 2023-11-28T20:01:41.864 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:41.861+0000 7fe33045f640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe32806c3a0 con 0x7fe3280bee90 2023-11-28T20:01:41.865 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:41.861+0000 7fe33045f640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe328157fd0 con 0x7fe32814b2a0 2023-11-28T20:01:41.865 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:41.861+0000 7fe32d9fa640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fe3280bee90 0x7fe3280bf310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:41.865 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:41.861+0000 7fe32e9fc640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7fe328154740 0x7fe328154b70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:39502/0 (socket says 172.21.15.78:39502) 2023-11-28T20:01:41.865 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:41.861+0000 7fe32e9fc640 1 -- 172.21.15.78:0/2164535272 learned_addr learned my addr 172.21.15.78:0/2164535272 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-11-28T20:01:41.866 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:41.861+0000 7fe32e1fb640 1 --2- 172.21.15.78:0/2164535272 >> v2:172.21.15.179:3300/0 conn(0x7fe32814b2a0 0x7fe3280a4ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:41.866 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:41.861+0000 7fe32d9fa640 1 -- 172.21.15.78:0/2164535272 >> v2:172.21.15.179:3300/0 conn(0x7fe32814b2a0 msgr2=0x7fe3280a4ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:01:41.866 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:41.861+0000 7fe32d9fa640 1 --2- 172.21.15.78:0/2164535272 >> v2:172.21.15.179:3300/0 conn(0x7fe32814b2a0 0x7fe3280a4ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:41.866 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:41.861+0000 7fe32d9fa640 1 -- 172.21.15.78:0/2164535272 >> v1:172.21.15.78:6789/0 conn(0x7fe328154740 legacy=0x7fe328154b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:01:41.866 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:41.861+0000 7fe32d9fa640 1 -- 172.21.15.78:0/2164535272 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3281582b0 con 0x7fe3280bee90 2023-11-28T20:01:41.866 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:41.861+0000 7fe32d1f9640 1 -- 172.21.15.78:0/2164535272 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1350832508 0 0) 0x7fe328157cf0 con 0x7fe328154740 2023-11-28T20:01:41.866 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:41.861+0000 7fe32e1fb640 1 --2- 172.21.15.78:0/2164535272 >> v2:172.21.15.179:3300/0 conn(0x7fe32814b2a0 0x7fe3280a4ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T20:01:41.868 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:41.865+0000 7fe32d9fa640 1 --2- 172.21.15.78:0/2164535272 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe3280bee90 0x7fe3280bf310 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x7fe32806e3a0 tx=0x7fe31801c340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=afcbdc70a2be0b88 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:01:41.868 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:41.865+0000 7fe32d1f9640 1 -- 172.21.15.78:0/2164535272 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3180ab600 con 0x7fe3280bee90 2023-11-28T20:01:41.868 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:41.865+0000 7fe32d1f9640 1 -- 172.21.15.78:0/2164535272 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe3180a7050 con 0x7fe3280bee90 2023-11-28T20:01:41.868 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:41.865+0000 7fe32d1f9640 1 -- 172.21.15.78:0/2164535272 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3180ab980 con 0x7fe3280bee90 2023-11-28T20:01:41.869 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:41.865+0000 7fe33045f640 1 -- 172.21.15.78:0/2164535272 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe3280bee90 msgr2=0x7fe3280bf310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:01:41.869 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:41.865+0000 7fe33045f640 1 --2- 172.21.15.78:0/2164535272 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe3280bee90 0x7fe3280bf310 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x7fe32806e3a0 tx=0x7fe31801c340 comp rx=0 tx=0).stop 2023-11-28T20:01:41.869 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:41.865+0000 7fe33045f640 1 -- 172.21.15.78:0/2164535272 shutdown_connections 2023-11-28T20:01:41.869 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:41.865+0000 7fe33045f640 1 --2- 172.21.15.78:0/2164535272 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe3280bee90 0x7fe3280bf310 unknown :-1 s=CLOSED pgs=752 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:41.869 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:41.865+0000 7fe33045f640 1 --2- 172.21.15.78:0/2164535272 >> v2:172.21.15.179:3300/0 conn(0x7fe32814b2a0 0x7fe3280a4ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:41.869 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:41.865+0000 7fe33045f640 1 -- 172.21.15.78:0/2164535272 >> 172.21.15.78:0/2164535272 conn(0x7fe3280a7810 msgr2=0x7fe3280a7c20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:01:41.869 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:41.865+0000 7fe33045f640 1 -- 172.21.15.78:0/2164535272 shutdown_connections 2023-11-28T20:01:41.869 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:41.865+0000 7fe33045f640 1 -- 172.21.15.78:0/2164535272 wait complete. 2023-11-28T20:01:41.870 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:41.865+0000 7fe33045f640 1 Processor -- start 2023-11-28T20:01:41.870 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:41.865+0000 7fe33045f640 1 -- start start 2023-11-28T20:01:41.873 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:41.869+0000 7fe33045f640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe3280bee90 0x7fe3280a5650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:41.873 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:41.869+0000 7fe33045f640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe32814b2a0 0x7fe328155a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:41.873 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:41.869+0000 7fe33045f640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe328154740 0x7fe328153e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:41.873 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:41.869+0000 7fe33045f640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe328153a40 con 0x7fe3280bee90 2023-11-28T20:01:41.873 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:41.869+0000 7fe33045f640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3280a5b90 con 0x7fe328154740 2023-11-28T20:01:41.873 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:41.869+0000 7fe33045f640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe3281ed510 con 0x7fe32814b2a0 2023-11-28T20:01:41.873 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:41.869+0000 7fe32e1fb640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe3280bee90 0x7fe3280a5650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:41.873 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:41.869+0000 7fe32e1fb640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe3280bee90 0x7fe3280a5650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:55510/0 (socket says 172.21.15.78:55510) 2023-11-28T20:01:41.873 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:41.869+0000 7fe32e1fb640 1 -- 172.21.15.78:0/2035889359 learned_addr learned my addr 172.21.15.78:0/2035889359 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T20:01:41.873 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:41.869+0000 7fe32d9fa640 1 --2- 172.21.15.78:0/2035889359 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe32814b2a0 0x7fe328155a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:41.874 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:41.869+0000 7fe32e9fc640 1 --2- 172.21.15.78:0/2035889359 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe328154740 0x7fe328153e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:41.874 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:41.869+0000 7fe32e1fb640 1 -- 172.21.15.78:0/2035889359 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe32814b2a0 msgr2=0x7fe328155a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:01:41.874 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:41.869+0000 7fe32e1fb640 1 --2- 172.21.15.78:0/2035889359 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe32814b2a0 0x7fe328155a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:41.874 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:41.869+0000 7fe32e1fb640 1 -- 172.21.15.78:0/2035889359 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe328154740 msgr2=0x7fe328153e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:01:41.874 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:41.869+0000 7fe32e1fb640 1 --2- 172.21.15.78:0/2035889359 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe328154740 0x7fe328153e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:41.874 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:41.869+0000 7fe32e1fb640 1 -- 172.21.15.78:0/2035889359 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe318009420 con 0x7fe3280bee90 2023-11-28T20:01:41.874 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:41.869+0000 7fe32e1fb640 1 --2- 172.21.15.78:0/2035889359 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe3280bee90 0x7fe3280a5650 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x7fe32400c820 tx=0x7fe32400cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:01:41.875 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:41.869+0000 7fe31effd640 1 -- 172.21.15.78:0/2035889359 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe324007a30 con 0x7fe3280bee90 2023-11-28T20:01:41.875 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:41.869+0000 7fe31effd640 1 -- 172.21.15.78:0/2035889359 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe324007b90 con 0x7fe3280bee90 2023-11-28T20:01:41.875 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:41.869+0000 7fe33045f640 1 -- 172.21.15.78:0/2035889359 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe3281ed7f0 con 0x7fe3280bee90 2023-11-28T20:01:41.876 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:41.869+0000 7fe31effd640 1 -- 172.21.15.78:0/2035889359 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe32400ce10 con 0x7fe3280bee90 2023-11-28T20:01:41.876 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:41.869+0000 7fe33045f640 1 -- 172.21.15.78:0/2035889359 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe328153660 con 0x7fe3280bee90 2023-11-28T20:01:41.877 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:41.869+0000 7fe33045f640 1 -- 172.21.15.78:0/2035889359 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe328067630 con 0x7fe3280bee90 2023-11-28T20:01:41.878 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:41.869+0000 7fe31effd640 1 -- 172.21.15.78:0/2035889359 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fe3240113f0 con 0x7fe3280bee90 2023-11-28T20:01:41.878 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:41.873+0000 7fe31effd640 1 --2- 172.21.15.78:0/2035889359 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fe30c0664a0 0x7fe30c068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:41.878 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:41.873+0000 7fe31effd640 1 -- 172.21.15.78:0/2035889359 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 6885+0+0 (secure 0 0 0) 0x7fe324084370 con 0x7fe3280bee90 2023-11-28T20:01:41.878 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:41.873+0000 7fe32d9fa640 1 --2- 172.21.15.78:0/2035889359 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fe30c0664a0 0x7fe30c068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:41.878 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:41.873+0000 7fe32d9fa640 1 --2- 172.21.15.78:0/2035889359 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fe30c0664a0 0x7fe30c068960 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7fe3180ad000 tx=0x7fe318008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:01:41.879 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:41.877+0000 7fe31effd640 1 -- 172.21.15.78:0/2035889359 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fe3240513f0 con 0x7fe3280bee90 2023-11-28T20:01:42.030 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:42.025+0000 7fe33045f640 1 -- 172.21.15.78:0/2035889359 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe3280c0010 con 0x7fe3280bee90 2023-11-28T20:01:42.031 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:42.029+0000 7fe31effd640 1 -- 172.21.15.78:0/2035889359 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v65) v1 ==== 74+0+20410 (secure 0 0 0) 0x7fe324054a10 con 0x7fe3280bee90 2023-11-28T20:01:42.032 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-11-28T20:01:42.032 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":65,"fsid":"dd9780e8-3bda-44fa-a9f0-fa07d19d901d","created":"2023-11-28T19:58:40.969556+0000","modified":"2023-11-28T20:01:24.807489+0000","last_up_change":"2023-11-28T19:58:52.596716+0000","last_in_change":"2023-11-28T19:58:43.609275+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":12,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-28T19:58:54.011229+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_metadata","create_time":"2023-11-28T20:01:07.969267+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"60","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_data","create_time":"2023-11-28T20:01:08.865465+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"61","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs2_metadata","create_time":"2023-11-28T20:01:20.863763+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"64","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs2_data","create_time":"2023-11-28T20:01:22.176918+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"65","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs2"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e84245ac-b5da-429e-af18-39acaa2b33e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6800","nonce":3358701235},{"type":"v1","addr":"172.21.15.78:6801","nonce":3358701235}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6802","nonce":3358701235},{"type":"v1","addr":"172.21.15.78:6803","nonce":3358701235}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6806","nonce":3358701235},{"type":"v1","addr":"172.21.15.78:6807","nonce":3358701235}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6804","nonce":3358701235},{"type":"v1","addr":"172.21.15.78:6805","nonce":3358701235}]},"public_addr":"172.21.15.78:6801/3358701235","cluster_addr":"172.21.15.78:6803/3358701235","heartbeat_back_addr":"172.21.15.78:6807/3358701235","heartbeat_front_addr":"172.21.15.78:6805/3358701235","state":["exists","up"]},{"osd":1,"uuid":"e634831d-c4e2-48d9-870c-9556ae162981","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6808","nonce":3211476654},{"type":"v1","addr":"172.21.15.78:6809","nonce":3211476654}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6810","nonce":3211476654},{"type":"v1","addr":"172.21.15.78:6811","nonce":3211476654}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6814","nonce":3211476654},{"type":"v1","addr":"172.21.15.78:6815","nonce":3211476654}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6812","nonce":3211476654},{"type":"v1","addr":"172.21.15.78:6813","nonce":3211476654}]},"public_addr":"172.21.15.78:6809/3211476654","cluster_addr":"172.21.15.78:6811/3211476654","heartbeat_back_addr":"172.21.15.78:6815/3211476654","heartbeat_front_addr":"172.21.15.78:6813/3211476654","state":["exists","up"]},{"osd":2,"uuid":"274c8395-6534-41f0-b8fb-a00af8985aa8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6816","nonce":2532904479},{"type":"v1","addr":"172.21.15.78:6817","nonce":2532904479}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6818","nonce":2532904479},{"type":"v1","addr":"172.21.15.78:6819","nonce":2532904479}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6822","nonce":2532904479},{"type":"v1","addr":"172.21.15.78:6823","nonce":2532904479}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6820","nonce":2532904479},{"type":"v1","addr":"172.21.15.78:6821","nonce":2532904479}]},"public_addr":"172.21.15.78:6817/2532904479","cluster_addr":"172.21.15.78:6819/2532904479","heartbeat_back_addr":"172.21.15.78:6823/2532904479","heartbeat_front_addr":"172.21.15.78:6821/2532904479","state":["exists","up"]},{"osd":3,"uuid":"77acc9af-7d4d-4b18-8cf5-d62f5971b7c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6824","nonce":3442991267},{"type":"v1","addr":"172.21.15.78:6825","nonce":3442991267}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6826","nonce":3442991267},{"type":"v1","addr":"172.21.15.78:6827","nonce":3442991267}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6830","nonce":3442991267},{"type":"v1","addr":"172.21.15.78:6831","nonce":3442991267}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6828","nonce":3442991267},{"type":"v1","addr":"172.21.15.78:6829","nonce":3442991267}]},"public_addr":"172.21.15.78:6825/3442991267","cluster_addr":"172.21.15.78:6827/3442991267","heartbeat_back_addr":"172.21.15.78:6831/3442991267","heartbeat_front_addr":"172.21.15.78:6829/3442991267","state":["exists","up"]},{"osd":4,"uuid":"5c62bc66-6b34-4b7f-a66b-9a743969138c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":802983577},{"type":"v1","addr":"172.21.15.179:6809","nonce":802983577}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":802983577},{"type":"v1","addr":"172.21.15.179:6811","nonce":802983577}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":802983577},{"type":"v1","addr":"172.21.15.179:6815","nonce":802983577}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":802983577},{"type":"v1","addr":"172.21.15.179:6813","nonce":802983577}]},"public_addr":"172.21.15.179:6809/802983577","cluster_addr":"172.21.15.179:6811/802983577","heartbeat_back_addr":"172.21.15.179:6815/802983577","heartbeat_front_addr":"172.21.15.179:6813/802983577","state":["exists","up"]},{"osd":5,"uuid":"67db6d36-f684-4079-b0cd-82b4dd61461f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":518192887},{"type":"v1","addr":"172.21.15.179:6818","nonce":518192887}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":518192887},{"type":"v1","addr":"172.21.15.179:6822","nonce":518192887}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":518192887},{"type":"v1","addr":"172.21.15.179:6829","nonce":518192887}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6824","nonce":518192887},{"type":"v1","addr":"172.21.15.179:6826","nonce":518192887}]},"public_addr":"172.21.15.179:6818/518192887","cluster_addr":"172.21.15.179:6822/518192887","heartbeat_back_addr":"172.21.15.179:6829/518192887","heartbeat_front_addr":"172.21.15.179:6826/518192887","state":["exists","up"]},{"osd":6,"uuid":"12e670af-5a16-4c81-9f97-defa66cab967","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":815435378},{"type":"v1","addr":"172.21.15.179:6801","nonce":815435378}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":815435378},{"type":"v1","addr":"172.21.15.179:6803","nonce":815435378}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":815435378},{"type":"v1","addr":"172.21.15.179:6807","nonce":815435378}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":815435378},{"type":"v1","addr":"172.21.15.179:6805","nonce":815435378}]},"public_addr":"172.21.15.179:6801/815435378","cluster_addr":"172.21.15.179:6803/815435378","heartbeat_back_addr":"172.21.15.179:6807/815435378","heartbeat_front_addr":"172.21.15.179:6805/815435378","state":["exists","up"]},{"osd":7,"uuid":"fe630650-2eb3-49ad-8676-c341e6332eb1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6817","nonce":2848432339},{"type":"v1","addr":"172.21.15.179:6819","nonce":2848432339}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6821","nonce":2848432339},{"type":"v1","addr":"172.21.15.179:6823","nonce":2848432339}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":2848432339},{"type":"v1","addr":"172.21.15.179:6831","nonce":2848432339}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6825","nonce":2848432339},{"type":"v1","addr":"172.21.15.179:6827","nonce":2848432339}]},"public_addr":"172.21.15.179:6819/2848432339","cluster_addr":"172.21.15.179:6823/2848432339","heartbeat_back_addr":"172.21.15.179:6831/2848432339","heartbeat_front_addr":"172.21.15.179:6827/2848432339","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:58:49.255433+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:58:49.412880+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:58:49.559295+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:58:49.245237+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:58:49.184557+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:58:49.329851+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:58:49.366012+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:58:49.349604+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-28T20:01:42.034 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:42.029+0000 7fe33045f640 1 -- 172.21.15.78:0/2035889359 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fe30c0664a0 msgr2=0x7fe30c068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:01:42.034 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:42.029+0000 7fe33045f640 1 --2- 172.21.15.78:0/2035889359 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fe30c0664a0 0x7fe30c068960 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7fe3180ad000 tx=0x7fe318008040 comp rx=0 tx=0).stop 2023-11-28T20:01:42.034 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:42.029+0000 7fe33045f640 1 -- 172.21.15.78:0/2035889359 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe3280bee90 msgr2=0x7fe3280a5650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:01:42.034 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:42.029+0000 7fe33045f640 1 --2- 172.21.15.78:0/2035889359 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe3280bee90 0x7fe3280a5650 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x7fe32400c820 tx=0x7fe32400cce0 comp rx=0 tx=0).stop 2023-11-28T20:01:42.034 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:42.029+0000 7fe33045f640 1 -- 172.21.15.78:0/2035889359 shutdown_connections 2023-11-28T20:01:42.034 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:42.029+0000 7fe33045f640 1 --2- 172.21.15.78:0/2035889359 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fe30c0664a0 0x7fe30c068960 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:42.034 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:42.029+0000 7fe33045f640 1 --2- 172.21.15.78:0/2035889359 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe32814b2a0 0x7fe328155a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:42.034 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:42.029+0000 7fe33045f640 1 --2- 172.21.15.78:0/2035889359 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe328154740 0x7fe328153e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:42.034 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:42.029+0000 7fe33045f640 1 --2- 172.21.15.78:0/2035889359 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe3280bee90 0x7fe3280a5650 unknown :-1 s=CLOSED pgs=753 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:42.035 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:42.029+0000 7fe33045f640 1 -- 172.21.15.78:0/2035889359 >> 172.21.15.78:0/2035889359 conn(0x7fe3280a7810 msgr2=0x7fe3280c2560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:01:42.035 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:42.029+0000 7fe33045f640 1 -- 172.21.15.78:0/2035889359 shutdown_connections 2023-11-28T20:01:42.035 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:42.029+0000 7fe33045f640 1 -- 172.21.15.78:0/2035889359 wait complete. 2023-11-28T20:01:42.053 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-28T19:58:54.011229+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 9, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-28T20:01:07.969267+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '60', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 10, 'pool_name': 'cephfs_data', 'create_time': '2023-11-28T20:01:08.865465+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '61', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 11, 'pool_name': 'cephfs2_metadata', 'create_time': '2023-11-28T20:01:20.863763+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '64', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs2'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 12, 'pool_name': 'cephfs2_data', 'create_time': '2023-11-28T20:01:22.176918+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '65', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs2'}}, 'read_balance': {'score_acting': 1.6299999952316284, 'score_stable': 1.6299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.6299999952316284, 'raw_score_stable': 1.6299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-28T20:01:42.054 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-28T20:01:42.194 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:42.189+0000 7fe900965640 1 Processor -- start 2023-11-28T20:01:42.195 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:42.189+0000 7fe900965640 1 -- start start 2023-11-28T20:01:42.196 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:42.193+0000 7fe900965640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe8fc14b1e0 0x7fe8fc0c1700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:42.196 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:42.193+0000 7fe900965640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fe8fc1548c0 0x7fe8fc154d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:42.196 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:42.193+0000 7fe900965640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe8fc0a4e20 con 0x7fe8fc0c5300 2023-11-28T20:01:42.197 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:42.193+0000 7fe900965640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe8fc0a50e0 con 0x7fe8fc1548c0 2023-11-28T20:01:42.197 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:42.193+0000 7fe900965640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe8fc0c0f00 con 0x7fe8fc14b1e0 2023-11-28T20:01:42.197 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:42.193+0000 7fe8fad9d640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fe8fc1548c0 0x7fe8fc154d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:42.197 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:42.193+0000 7fe8fad9d640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fe8fc1548c0 0x7fe8fc154d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:55514/0 (socket says 172.21.15.78:55514) 2023-11-28T20:01:42.197 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:42.193+0000 7fe8fad9d640 1 -- 172.21.15.78:0/1717297990 learned_addr learned my addr 172.21.15.78:0/1717297990 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T20:01:42.197 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:42.193+0000 7fe8fa59c640 1 --2- 172.21.15.78:0/1717297990 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe8fc14b1e0 0x7fe8fc0c1700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:42.197 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:42.193+0000 7fe8fad9d640 1 -- 172.21.15.78:0/1717297990 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe8fc14b1e0 msgr2=0x7fe8fc0c1700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:01:42.197 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:42.193+0000 7fe8fad9d640 1 --2- 172.21.15.78:0/1717297990 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe8fc14b1e0 0x7fe8fc0c1700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:42.197 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:42.193+0000 7fe8fad9d640 1 -- 172.21.15.78:0/1717297990 >> v1:172.21.15.179:6789/0 conn(0x7fe8fc0c5300 legacy=0x7fe8fc0a9c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:01:42.197 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:42.193+0000 7fe8fad9d640 1 -- 172.21.15.78:0/1717297990 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8fc0c11e0 con 0x7fe8fc1548c0 2023-11-28T20:01:42.199 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:42.193+0000 7fe8fad9d640 1 --2- 172.21.15.78:0/1717297990 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe8fc1548c0 0x7fe8fc154d50 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 crypto rx=0x7fe8fc0c3b30 tx=0x7fe8f401c4e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d0ac11845ef40c server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:01:42.200 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:42.197+0000 7fe8f9d9b640 1 -- 172.21.15.78:0/1717297990 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8fc1558b0 con 0x7fe8fc1548c0 2023-11-28T20:01:42.200 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:42.197+0000 7fe8f9d9b640 1 -- 172.21.15.78:0/1717297990 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe8f40ac410 con 0x7fe8fc1548c0 2023-11-28T20:01:42.200 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:42.197+0000 7fe8f9d9b640 1 -- 172.21.15.78:0/1717297990 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8f40ac7a0 con 0x7fe8fc1548c0 2023-11-28T20:01:42.201 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:42.197+0000 7fe900965640 1 -- 172.21.15.78:0/1717297990 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe8fc1548c0 msgr2=0x7fe8fc154d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:01:42.201 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:42.197+0000 7fe900965640 1 --2- 172.21.15.78:0/1717297990 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe8fc1548c0 0x7fe8fc154d50 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 crypto rx=0x7fe8fc0c3b30 tx=0x7fe8f401c4e0 comp rx=0 tx=0).stop 2023-11-28T20:01:42.201 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:42.197+0000 7fe900965640 1 -- 172.21.15.78:0/1717297990 shutdown_connections 2023-11-28T20:01:42.201 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:42.197+0000 7fe900965640 1 --2- 172.21.15.78:0/1717297990 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe8fc1548c0 0x7fe8fc154d50 unknown :-1 s=CLOSED pgs=754 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:42.202 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:42.197+0000 7fe900965640 1 --2- 172.21.15.78:0/1717297990 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe8fc14b1e0 0x7fe8fc0c1700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:42.202 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:42.197+0000 7fe900965640 1 -- 172.21.15.78:0/1717297990 >> 172.21.15.78:0/1717297990 conn(0x7fe8fc0c59f0 msgr2=0x7fe8fc0c5e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:01:42.202 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:42.197+0000 7fe900965640 1 -- 172.21.15.78:0/1717297990 shutdown_connections 2023-11-28T20:01:42.203 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:42.197+0000 7fe900965640 1 -- 172.21.15.78:0/1717297990 wait complete. 2023-11-28T20:01:42.205 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:42.197+0000 7fe900965640 1 Processor -- start 2023-11-28T20:01:42.205 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:42.197+0000 7fe900965640 1 -- start start 2023-11-28T20:01:42.205 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:42.197+0000 7fe900965640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe8fc0c5300 0x7fe8fc0a53c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:42.205 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:42.197+0000 7fe900965640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe8fc14b1e0 0x7fe8fc142920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:42.205 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:42.197+0000 7fe900965640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe8fc1548c0 0x7fe8fc0befc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:42.205 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:42.201+0000 7fe900965640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8fc142e60 con 0x7fe8fc1548c0 2023-11-28T20:01:42.205 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:42.201+0000 7fe900965640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8fc0a7410 con 0x7fe8fc0c5300 2023-11-28T20:01:42.205 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:42.201+0000 7fe900965640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe8fc0a6e50 con 0x7fe8fc14b1e0 2023-11-28T20:01:42.205 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:42.201+0000 7fe8fad9d640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe8fc1548c0 0x7fe8fc0befc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:42.206 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:42.201+0000 7fe8fad9d640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe8fc1548c0 0x7fe8fc0befc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:55526/0 (socket says 172.21.15.78:55526) 2023-11-28T20:01:42.206 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:42.201+0000 7fe8fad9d640 1 -- 172.21.15.78:0/3756308783 learned_addr learned my addr 172.21.15.78:0/3756308783 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T20:01:42.206 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:42.201+0000 7fe8f1d9b640 1 --2- 172.21.15.78:0/3756308783 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe8fc14b1e0 0x7fe8fc142920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:42.206 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:42.201+0000 7fe8fa59c640 1 --2- 172.21.15.78:0/3756308783 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe8fc0c5300 0x7fe8fc0a53c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:42.206 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:42.201+0000 7fe8fad9d640 1 -- 172.21.15.78:0/3756308783 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe8fc14b1e0 msgr2=0x7fe8fc142920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:01:42.206 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:42.201+0000 7fe8fad9d640 1 --2- 172.21.15.78:0/3756308783 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe8fc14b1e0 0x7fe8fc142920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:42.206 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:42.201+0000 7fe8fad9d640 1 -- 172.21.15.78:0/3756308783 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe8fc0c5300 msgr2=0x7fe8fc0a53c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:01:42.206 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:42.201+0000 7fe8fad9d640 1 --2- 172.21.15.78:0/3756308783 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe8fc0c5300 0x7fe8fc0a53c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:42.206 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:42.201+0000 7fe8fad9d640 1 -- 172.21.15.78:0/3756308783 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8f40094d0 con 0x7fe8fc1548c0 2023-11-28T20:01:42.206 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:42.201+0000 7fe8fa59c640 1 --2- 172.21.15.78:0/3756308783 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe8fc0c5300 0x7fe8fc0a53c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T20:01:42.207 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:42.201+0000 7fe8fad9d640 1 --2- 172.21.15.78:0/3756308783 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe8fc1548c0 0x7fe8fc0befc0 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 crypto rx=0x7fe8f40af040 tx=0x7fe8f4019280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:01:42.207 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:42.201+0000 7fe8f37fe640 1 -- 172.21.15.78:0/3756308783 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8f40b7470 con 0x7fe8fc1548c0 2023-11-28T20:01:42.207 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:42.201+0000 7fe8f37fe640 1 -- 172.21.15.78:0/3756308783 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe8f40b75d0 con 0x7fe8fc1548c0 2023-11-28T20:01:42.207 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:42.201+0000 7fe900965640 1 -- 172.21.15.78:0/3756308783 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe8fc0a7130 con 0x7fe8fc1548c0 2023-11-28T20:01:42.207 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:42.201+0000 7fe8f37fe640 1 -- 172.21.15.78:0/3756308783 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8f40b7940 con 0x7fe8fc1548c0 2023-11-28T20:01:42.208 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:42.201+0000 7fe900965640 1 -- 172.21.15.78:0/3756308783 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe8fc1ed070 con 0x7fe8fc1548c0 2023-11-28T20:01:42.209 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:42.201+0000 7fe900965640 1 -- 172.21.15.78:0/3756308783 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe8fc1ecbf0 con 0x7fe8fc1548c0 2023-11-28T20:01:42.209 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:42.201+0000 7fe8f37fe640 1 -- 172.21.15.78:0/3756308783 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fe8f40b3070 con 0x7fe8fc1548c0 2023-11-28T20:01:42.209 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:42.205+0000 7fe8f37fe640 1 --2- 172.21.15.78:0/3756308783 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fe8dc066470 0x7fe8dc068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:42.209 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:42.205+0000 7fe8f37fe640 1 -- 172.21.15.78:0/3756308783 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 6885+0+0 (secure 0 0 0) 0x7fe8f411e870 con 0x7fe8fc1548c0 2023-11-28T20:01:42.209 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:42.205+0000 7fe8fa59c640 1 --2- 172.21.15.78:0/3756308783 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fe8dc066470 0x7fe8dc068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:42.209 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:42.205+0000 7fe8fa59c640 1 --2- 172.21.15.78:0/3756308783 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fe8dc066470 0x7fe8dc068930 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7fe8ec003fd0 tx=0x7fe8ec003a00 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:01:42.211 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:42.209+0000 7fe8f37fe640 1 -- 172.21.15.78:0/3756308783 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fe8fc1ecbf0 con 0x7fe8fc1548c0 2023-11-28T20:01:42.362 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:42.357+0000 7fe900965640 1 -- 172.21.15.78:0/3756308783 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fe8fc1ecbf0 con 0x7fe8fc1548c0 2023-11-28T20:01:42.363 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:42.357+0000 7fe8f37fe640 1 -- 172.21.15.78:0/3756308783 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v65) v1 ==== 93+0+10 (secure 0 0 0) 0x7fe8fc1ecbf0 con 0x7fe8fc1548c0 2023-11-28T20:01:42.363 INFO:teuthology.orchestra.run.smithi078.stdout:pg_num: 1 2023-11-28T20:01:42.366 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:42.361+0000 7fe900965640 1 -- 172.21.15.78:0/3756308783 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fe8dc066470 msgr2=0x7fe8dc068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:01:42.366 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:42.361+0000 7fe900965640 1 --2- 172.21.15.78:0/3756308783 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fe8dc066470 0x7fe8dc068930 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7fe8ec003fd0 tx=0x7fe8ec003a00 comp rx=0 tx=0).stop 2023-11-28T20:01:42.366 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:42.361+0000 7fe900965640 1 -- 172.21.15.78:0/3756308783 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe8fc1548c0 msgr2=0x7fe8fc0befc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:01:42.366 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:42.361+0000 7fe900965640 1 --2- 172.21.15.78:0/3756308783 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe8fc1548c0 0x7fe8fc0befc0 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 crypto rx=0x7fe8f40af040 tx=0x7fe8f4019280 comp rx=0 tx=0).stop 2023-11-28T20:01:42.366 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:42.361+0000 7fe900965640 1 -- 172.21.15.78:0/3756308783 shutdown_connections 2023-11-28T20:01:42.366 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:42.361+0000 7fe900965640 1 --2- 172.21.15.78:0/3756308783 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fe8dc066470 0x7fe8dc068930 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:42.366 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:42.361+0000 7fe900965640 1 --2- 172.21.15.78:0/3756308783 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe8fc14b1e0 0x7fe8fc142920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:42.366 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:42.361+0000 7fe900965640 1 --2- 172.21.15.78:0/3756308783 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe8fc1548c0 0x7fe8fc0befc0 unknown :-1 s=CLOSED pgs=755 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:42.366 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:42.361+0000 7fe900965640 1 --2- 172.21.15.78:0/3756308783 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe8fc0c5300 0x7fe8fc0a53c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:42.367 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:42.361+0000 7fe900965640 1 -- 172.21.15.78:0/3756308783 >> 172.21.15.78:0/3756308783 conn(0x7fe8fc0c59f0 msgr2=0x7fe8fc1469d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:01:42.367 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:42.361+0000 7fe900965640 1 -- 172.21.15.78:0/3756308783 shutdown_connections 2023-11-28T20:01:42.367 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:42.361+0000 7fe900965640 1 -- 172.21.15.78:0/3756308783 wait complete. 2023-11-28T20:01:42.384 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-28T20:01:42.525 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:42.521+0000 7f614ba5f640 1 Processor -- start 2023-11-28T20:01:42.526 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:42.521+0000 7f614ba5f640 1 -- start start 2023-11-28T20:01:42.527 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:42.521+0000 7f614ba5f640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f61440bf2d0 0x7f6144151970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:42.528 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:42.521+0000 7f614ba5f640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f61440c6030 0x7f6144151eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:42.528 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:42.521+0000 7f614ba5f640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f61440c98f0 0x7f61440c7cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:42.528 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:42.521+0000 7f614ba5f640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f61440c0300 con 0x7f61440bf2d0 2023-11-28T20:01:42.528 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:42.521+0000 7f614ba5f640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6144158780 con 0x7f61440c98f0 2023-11-28T20:01:42.528 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:42.521+0000 7f614ba5f640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6144157b70 con 0x7f61440c6030 2023-11-28T20:01:42.528 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:42.521+0000 7f61497fb640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f61440bf2d0 0x7f6144151970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:42.528 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:42.525+0000 7f6148ffa640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f61440c6030 0x7f6144151eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:42.528 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:42.525+0000 7f61497fb640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f61440bf2d0 0x7f6144151970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:55536/0 (socket says 172.21.15.78:55536) 2023-11-28T20:01:42.528 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:42.525+0000 7f61497fb640 1 -- 172.21.15.78:0/606111813 learned_addr learned my addr 172.21.15.78:0/606111813 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T20:01:42.528 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:42.525+0000 7f6149ffc640 1 --2- 172.21.15.78:0/606111813 >> v2:172.21.15.179:3300/0 conn(0x7f61440c98f0 0x7f61440c7cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:42.528 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:42.525+0000 7f61497fb640 1 -- 172.21.15.78:0/606111813 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f61440c6030 msgr2=0x7f6144151eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:01:42.529 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:42.525+0000 7f61497fb640 1 --2- 172.21.15.78:0/606111813 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f61440c6030 0x7f6144151eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:42.529 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:42.525+0000 7f61497fb640 1 -- 172.21.15.78:0/606111813 >> v2:172.21.15.179:3300/0 conn(0x7f61440c98f0 msgr2=0x7f61440c7cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:01:42.529 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:42.525+0000 7f61497fb640 1 --2- 172.21.15.78:0/606111813 >> v2:172.21.15.179:3300/0 conn(0x7f61440c98f0 0x7f61440c7cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:42.529 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:42.525+0000 7f61497fb640 1 -- 172.21.15.78:0/606111813 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6144157e50 con 0x7f61440bf2d0 2023-11-28T20:01:42.530 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:42.525+0000 7f61497fb640 1 --2- 172.21.15.78:0/606111813 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f61440bf2d0 0x7f6144151970 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x7f61440c6740 tx=0x7f614001c410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a27cb39c47f772f4 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:01:42.531 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:42.525+0000 7f613bfff640 1 -- 172.21.15.78:0/606111813 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61400ac630 con 0x7f61440bf2d0 2023-11-28T20:01:42.531 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:42.529+0000 7f613bfff640 1 -- 172.21.15.78:0/606111813 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f61400ac790 con 0x7f61440bf2d0 2023-11-28T20:01:42.531 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:42.529+0000 7f613bfff640 1 -- 172.21.15.78:0/606111813 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61400acb20 con 0x7f61440bf2d0 2023-11-28T20:01:42.532 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:42.529+0000 7f614ba5f640 1 -- 172.21.15.78:0/606111813 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f61440bf2d0 msgr2=0x7f6144151970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:01:42.532 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:42.529+0000 7f614ba5f640 1 --2- 172.21.15.78:0/606111813 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f61440bf2d0 0x7f6144151970 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x7f61440c6740 tx=0x7f614001c410 comp rx=0 tx=0).stop 2023-11-28T20:01:42.532 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:42.529+0000 7f614ba5f640 1 -- 172.21.15.78:0/606111813 shutdown_connections 2023-11-28T20:01:42.532 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:42.529+0000 7f614ba5f640 1 --2- 172.21.15.78:0/606111813 >> v2:172.21.15.179:3300/0 conn(0x7f61440c98f0 0x7f61440c7cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:42.533 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:42.529+0000 7f614ba5f640 1 --2- 172.21.15.78:0/606111813 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f61440c6030 0x7f6144151eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:42.533 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:42.529+0000 7f614ba5f640 1 --2- 172.21.15.78:0/606111813 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f61440bf2d0 0x7f6144151970 unknown :-1 s=CLOSED pgs=756 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:42.533 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:42.529+0000 7f614ba5f640 1 -- 172.21.15.78:0/606111813 >> 172.21.15.78:0/606111813 conn(0x7f61440c9dc0 msgr2=0x7f61440ca1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:01:42.533 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:42.529+0000 7f614ba5f640 1 -- 172.21.15.78:0/606111813 shutdown_connections 2023-11-28T20:01:42.533 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:42.529+0000 7f614ba5f640 1 -- 172.21.15.78:0/606111813 wait complete. 2023-11-28T20:01:42.534 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:42.529+0000 7f614ba5f640 1 Processor -- start 2023-11-28T20:01:42.534 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:42.529+0000 7f614ba5f640 1 -- start start 2023-11-28T20:01:42.536 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:42.529+0000 7f614ba5f640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f61440bf2d0 0x7f614414c990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:42.536 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:42.529+0000 7f614ba5f640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f61440c6030 0x7f61441454b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:42.536 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:42.529+0000 7f614ba5f640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f61440c98f0 0x7f6144147ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:42.536 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:42.529+0000 7f614ba5f640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f614414d1a0 con 0x7f61440c6030 2023-11-28T20:01:42.536 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:42.529+0000 7f614ba5f640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6144146830 con 0x7f61440bf2d0 2023-11-28T20:01:42.536 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:42.529+0000 7f614ba5f640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6144146550 con 0x7f61440c98f0 2023-11-28T20:01:42.536 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:42.533+0000 7f6148ffa640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f61440c6030 0x7f61441454b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:42.536 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:42.533+0000 7f6148ffa640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f61440c6030 0x7f61441454b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:55544/0 (socket says 172.21.15.78:55544) 2023-11-28T20:01:42.536 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:42.533+0000 7f6148ffa640 1 -- 172.21.15.78:0/364226582 learned_addr learned my addr 172.21.15.78:0/364226582 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T20:01:42.536 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:42.533+0000 7f61497fb640 1 --2- 172.21.15.78:0/364226582 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f61440bf2d0 0x7f614414c990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:42.537 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:42.533+0000 7f6149ffc640 1 --2- 172.21.15.78:0/364226582 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f61440c98f0 0x7f6144147ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:42.537 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:42.533+0000 7f6148ffa640 1 -- 172.21.15.78:0/364226582 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f61440c98f0 msgr2=0x7f6144147ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:01:42.537 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:42.533+0000 7f6148ffa640 1 --2- 172.21.15.78:0/364226582 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f61440c98f0 0x7f6144147ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:42.537 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:42.533+0000 7f6148ffa640 1 -- 172.21.15.78:0/364226582 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f61440bf2d0 msgr2=0x7f614414c990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:01:42.537 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:42.533+0000 7f6148ffa640 1 --2- 172.21.15.78:0/364226582 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f61440bf2d0 0x7f614414c990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:42.537 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:42.533+0000 7f6148ffa640 1 -- 172.21.15.78:0/364226582 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61400094d0 con 0x7f61440c6030 2023-11-28T20:01:42.537 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:42.533+0000 7f6148ffa640 1 --2- 172.21.15.78:0/364226582 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f61440c6030 0x7f61441454b0 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 crypto rx=0x7f613400e930 tx=0x7f613400edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:01:42.538 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:42.533+0000 7f6139ffb640 1 -- 172.21.15.78:0/364226582 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6134009690 con 0x7f61440c6030 2023-11-28T20:01:42.538 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:42.533+0000 7f6139ffb640 1 -- 172.21.15.78:0/364226582 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f613400ca00 con 0x7f61440c6030 2023-11-28T20:01:42.538 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:42.533+0000 7f6139ffb640 1 -- 172.21.15.78:0/364226582 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f613400cd70 con 0x7f61440c6030 2023-11-28T20:01:42.538 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:42.533+0000 7f614ba5f640 1 -- 172.21.15.78:0/364226582 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f61441449d0 con 0x7f61440c6030 2023-11-28T20:01:42.538 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:42.533+0000 7f614ba5f640 1 -- 172.21.15.78:0/364226582 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6144144f90 con 0x7f61440c6030 2023-11-28T20:01:42.538 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:42.533+0000 7f614ba5f640 1 -- 172.21.15.78:0/364226582 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6144145150 con 0x7f61440c6030 2023-11-28T20:01:42.539 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:42.533+0000 7f6139ffb640 1 -- 172.21.15.78:0/364226582 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f6134013470 con 0x7f61440c6030 2023-11-28T20:01:42.541 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:42.537+0000 7f6139ffb640 1 --2- 172.21.15.78:0/364226582 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f61280664a0 0x7f6128068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:42.541 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:42.537+0000 7f6139ffb640 1 -- 172.21.15.78:0/364226582 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 6885+0+0 (secure 0 0 0) 0x7f61340844a0 con 0x7f61440c6030 2023-11-28T20:01:42.541 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:42.537+0000 7f61497fb640 1 --2- 172.21.15.78:0/364226582 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f61280664a0 0x7f6128068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:42.542 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:42.537+0000 7f61497fb640 1 --2- 172.21.15.78:0/364226582 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f61280664a0 0x7f6128068960 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f61400ae000 tx=0x7f61400a7000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:01:42.543 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:42.541+0000 7f6139ffb640 1 -- 172.21.15.78:0/364226582 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f61340515f0 con 0x7f61440c6030 2023-11-28T20:01:42.693 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:42.689+0000 7f614ba5f640 1 -- 172.21.15.78:0/364226582 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f6144067630 con 0x7f61440c6030 2023-11-28T20:01:42.693 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:42.689+0000 7f6139ffb640 1 -- 172.21.15.78:0/364226582 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v65) v1 ==== 104+0+11 (secure 0 0 0) 0x7f6134054c10 con 0x7f61440c6030 2023-11-28T20:01:42.694 INFO:teuthology.orchestra.run.smithi078.stdout:pg_num: 32 2023-11-28T20:01:42.696 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:42.693+0000 7f614ba5f640 1 -- 172.21.15.78:0/364226582 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f61280664a0 msgr2=0x7f6128068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:01:42.696 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:42.693+0000 7f614ba5f640 1 --2- 172.21.15.78:0/364226582 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f61280664a0 0x7f6128068960 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f61400ae000 tx=0x7f61400a7000 comp rx=0 tx=0).stop 2023-11-28T20:01:42.696 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:42.693+0000 7f614ba5f640 1 -- 172.21.15.78:0/364226582 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f61440c6030 msgr2=0x7f61441454b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:01:42.696 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:42.693+0000 7f614ba5f640 1 --2- 172.21.15.78:0/364226582 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f61440c6030 0x7f61441454b0 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 crypto rx=0x7f613400e930 tx=0x7f613400edf0 comp rx=0 tx=0).stop 2023-11-28T20:01:42.696 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:42.693+0000 7f614ba5f640 1 -- 172.21.15.78:0/364226582 shutdown_connections 2023-11-28T20:01:42.696 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:42.693+0000 7f614ba5f640 1 --2- 172.21.15.78:0/364226582 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f61280664a0 0x7f6128068960 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:42.696 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:42.693+0000 7f614ba5f640 1 --2- 172.21.15.78:0/364226582 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f61440c98f0 0x7f6144147ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:42.696 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:42.693+0000 7f614ba5f640 1 --2- 172.21.15.78:0/364226582 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f61440c6030 0x7f61441454b0 unknown :-1 s=CLOSED pgs=757 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:42.697 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:42.693+0000 7f614ba5f640 1 --2- 172.21.15.78:0/364226582 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f61440bf2d0 0x7f614414c990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:42.697 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:42.693+0000 7f614ba5f640 1 -- 172.21.15.78:0/364226582 >> 172.21.15.78:0/364226582 conn(0x7f61440c9dc0 msgr2=0x7f6144151c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:01:42.697 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:42.693+0000 7f614ba5f640 1 -- 172.21.15.78:0/364226582 shutdown_connections 2023-11-28T20:01:42.697 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:42.693+0000 7f614ba5f640 1 -- 172.21.15.78:0/364226582 wait complete. 2023-11-28T20:01:42.715 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-28T20:01:42.855 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:42.849+0000 7feb4650f640 1 Processor -- start 2023-11-28T20:01:42.855 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:42.849+0000 7feb4650f640 1 -- start start 2023-11-28T20:01:42.856 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:42.853+0000 7feb4650f640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7feb4014fc30 0x7feb400c3cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:42.857 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:42.853+0000 7feb4650f640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7feb4006d840 0x7feb400c4210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:42.857 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:42.853+0000 7feb4650f640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feb40152910 con 0x7feb4014f850 2023-11-28T20:01:42.857 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:42.853+0000 7feb4650f640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feb400c2240 con 0x7feb4014fc30 2023-11-28T20:01:42.857 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:42.853+0000 7feb4650f640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb40152bf0 con 0x7feb4006d840 2023-11-28T20:01:42.858 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:42.853+0000 7feb3f7fe640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7feb4014fc30 0x7feb400c3cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:42.858 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:42.853+0000 7feb3ffff640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7feb4014f850 0x7feb400aacf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:39504/0 (socket says 172.21.15.78:39504) 2023-11-28T20:01:42.858 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:42.853+0000 7feb3ffff640 1 -- 172.21.15.78:0/3744715932 learned_addr learned my addr 172.21.15.78:0/3744715932 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-11-28T20:01:42.858 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:42.853+0000 7feb3f7fe640 1 -- 172.21.15.78:0/3744715932 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7feb4006d840 msgr2=0x7feb400c4210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:01:42.858 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:42.853+0000 7feb3f7fe640 1 --2- 172.21.15.78:0/3744715932 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7feb4006d840 0x7feb400c4210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:42.858 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:42.853+0000 7feb3f7fe640 1 -- 172.21.15.78:0/3744715932 >> v1:172.21.15.78:6789/0 conn(0x7feb4014f850 legacy=0x7feb400aacf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:01:42.858 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:42.853+0000 7feb3f7fe640 1 -- 172.21.15.78:0/3744715932 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb40152ed0 con 0x7feb4014fc30 2023-11-28T20:01:42.859 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:42.857+0000 7feb3f7fe640 1 --2- 172.21.15.78:0/3744715932 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7feb4014fc30 0x7feb400c3cd0 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7feb340097c0 tx=0x7feb3401c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=79c89075d5e7e946 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:01:42.860 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:42.857+0000 7feb3effd640 1 -- 172.21.15.78:0/3744715932 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb340ac410 con 0x7feb4014fc30 2023-11-28T20:01:42.860 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:42.857+0000 7feb3effd640 1 -- 172.21.15.78:0/3744715932 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb340ac570 con 0x7feb4014fc30 2023-11-28T20:01:42.860 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:42.857+0000 7feb3effd640 1 -- 172.21.15.78:0/3744715932 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb340ac900 con 0x7feb4014fc30 2023-11-28T20:01:42.861 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:42.857+0000 7feb4650f640 1 -- 172.21.15.78:0/3744715932 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7feb4014fc30 msgr2=0x7feb400c3cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:01:42.861 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:42.857+0000 7feb4650f640 1 --2- 172.21.15.78:0/3744715932 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7feb4014fc30 0x7feb400c3cd0 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7feb340097c0 tx=0x7feb3401c480 comp rx=0 tx=0).stop 2023-11-28T20:01:42.861 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:42.857+0000 7feb4650f640 1 -- 172.21.15.78:0/3744715932 shutdown_connections 2023-11-28T20:01:42.861 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:42.857+0000 7feb4650f640 1 --2- 172.21.15.78:0/3744715932 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7feb4006d840 0x7feb400c4210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:42.861 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:42.857+0000 7feb4650f640 1 --2- 172.21.15.78:0/3744715932 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7feb4014fc30 0x7feb400c3cd0 unknown :-1 s=CLOSED pgs=759 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:42.861 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:42.857+0000 7feb4650f640 1 -- 172.21.15.78:0/3744715932 >> 172.21.15.78:0/3744715932 conn(0x7feb400c59f0 msgr2=0x7feb400c5e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:01:42.861 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:42.857+0000 7feb4650f640 1 -- 172.21.15.78:0/3744715932 shutdown_connections 2023-11-28T20:01:42.861 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:42.857+0000 7feb4650f640 1 -- 172.21.15.78:0/3744715932 wait complete. 2023-11-28T20:01:42.862 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:42.857+0000 7feb4650f640 1 Processor -- start 2023-11-28T20:01:42.862 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:42.857+0000 7feb4650f640 1 -- start start 2023-11-28T20:01:42.864 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:42.857+0000 7feb4650f640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7feb4006d840 0x7feb401ee030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:42.864 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:42.857+0000 7feb4650f640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7feb4014f850 0x7feb401f0c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:42.864 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:42.857+0000 7feb4650f640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7feb4014fc30 0x7feb4015b480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:42.864 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:42.857+0000 7feb4650f640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb4014a870 con 0x7feb4006d840 2023-11-28T20:01:42.864 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:42.857+0000 7feb4650f640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb400a97f0 con 0x7feb4014f850 2023-11-28T20:01:42.864 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:42.857+0000 7feb4650f640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb401ed620 con 0x7feb4014fc30 2023-11-28T20:01:42.864 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:42.861+0000 7feb3ffff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7feb4006d840 0x7feb401ee030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:42.864 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:42.861+0000 7feb3ffff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7feb4006d840 0x7feb401ee030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:55560/0 (socket says 172.21.15.78:55560) 2023-11-28T20:01:42.864 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:42.861+0000 7feb3ffff640 1 -- 172.21.15.78:0/559355657 learned_addr learned my addr 172.21.15.78:0/559355657 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T20:01:42.865 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:42.861+0000 7feb3ffff640 1 -- 172.21.15.78:0/559355657 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7feb4014fc30 msgr2=0x7feb4015b480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:01:42.865 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:42.861+0000 7feb3ffff640 1 --2- 172.21.15.78:0/559355657 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7feb4014fc30 0x7feb4015b480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:42.865 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:42.861+0000 7feb3f7fe640 1 --2- 172.21.15.78:0/559355657 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7feb4014f850 0x7feb401f0c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:42.865 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:42.861+0000 7feb3ffff640 1 -- 172.21.15.78:0/559355657 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7feb4014f850 msgr2=0x7feb401f0c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:01:42.865 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:42.861+0000 7feb3ffff640 1 --2- 172.21.15.78:0/559355657 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7feb4014f850 0x7feb401f0c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:42.865 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:42.861+0000 7feb3ffff640 1 -- 172.21.15.78:0/559355657 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb34009420 con 0x7feb4006d840 2023-11-28T20:01:42.865 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:42.861+0000 7feb3ffff640 1 --2- 172.21.15.78:0/559355657 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7feb4006d840 0x7feb401ee030 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 crypto rx=0x7feb30005890 tx=0x7feb3000c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:01:42.866 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:42.861+0000 7feb3cff9640 1 -- 172.21.15.78:0/559355657 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb30005cf0 con 0x7feb4006d840 2023-11-28T20:01:42.866 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:42.861+0000 7feb3cff9640 1 -- 172.21.15.78:0/559355657 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb30005e50 con 0x7feb4006d840 2023-11-28T20:01:42.866 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:42.861+0000 7feb3cff9640 1 -- 172.21.15.78:0/559355657 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb300072b0 con 0x7feb4006d840 2023-11-28T20:01:42.866 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:42.861+0000 7feb4650f640 1 -- 172.21.15.78:0/559355657 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feb40147970 con 0x7feb4006d840 2023-11-28T20:01:42.866 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:42.861+0000 7feb4650f640 1 -- 172.21.15.78:0/559355657 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feb401ee570 con 0x7feb4006d840 2023-11-28T20:01:42.866 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:42.861+0000 7feb4650f640 1 -- 172.21.15.78:0/559355657 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feb40067630 con 0x7feb4006d840 2023-11-28T20:01:42.867 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:42.861+0000 7feb3cff9640 1 -- 172.21.15.78:0/559355657 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7feb30007410 con 0x7feb4006d840 2023-11-28T20:01:42.868 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:42.865+0000 7feb3cff9640 1 --2- 172.21.15.78:0/559355657 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7feb2c066470 0x7feb2c068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:42.868 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:42.865+0000 7feb3cff9640 1 -- 172.21.15.78:0/559355657 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 6885+0+0 (secure 0 0 0) 0x7feb30083850 con 0x7feb4006d840 2023-11-28T20:01:42.868 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:42.865+0000 7feb3f7fe640 1 --2- 172.21.15.78:0/559355657 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7feb2c066470 0x7feb2c068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:42.869 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:42.865+0000 7feb3f7fe640 1 --2- 172.21.15.78:0/559355657 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7feb2c066470 0x7feb2c068930 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7feb340ae000 tx=0x7feb340a6040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:01:42.872 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:42.869+0000 7feb3cff9640 1 -- 172.21.15.78:0/559355657 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7feb30050820 con 0x7feb4006d840 2023-11-28T20:01:43.023 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:43.017+0000 7feb4650f640 1 -- 172.21.15.78:0/559355657 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7feb400a4a90 con 0x7feb4006d840 2023-11-28T20:01:43.023 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:43.021+0000 7feb3cff9640 1 -- 172.21.15.78:0/559355657 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v65) v1 ==== 100+0+11 (secure 0 0 0) 0x7feb30053e40 con 0x7feb4006d840 2023-11-28T20:01:43.024 INFO:teuthology.orchestra.run.smithi078.stdout:pg_num: 64 2023-11-28T20:01:43.026 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:43.021+0000 7feb4650f640 1 -- 172.21.15.78:0/559355657 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7feb2c066470 msgr2=0x7feb2c068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:01:43.026 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:43.021+0000 7feb4650f640 1 --2- 172.21.15.78:0/559355657 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7feb2c066470 0x7feb2c068930 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7feb340ae000 tx=0x7feb340a6040 comp rx=0 tx=0).stop 2023-11-28T20:01:43.026 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:43.021+0000 7feb4650f640 1 -- 172.21.15.78:0/559355657 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7feb4006d840 msgr2=0x7feb401ee030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:01:43.026 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:43.021+0000 7feb4650f640 1 --2- 172.21.15.78:0/559355657 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7feb4006d840 0x7feb401ee030 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 crypto rx=0x7feb30005890 tx=0x7feb3000c960 comp rx=0 tx=0).stop 2023-11-28T20:01:43.027 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:43.021+0000 7feb4650f640 1 -- 172.21.15.78:0/559355657 shutdown_connections 2023-11-28T20:01:43.027 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:43.021+0000 7feb4650f640 1 --2- 172.21.15.78:0/559355657 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7feb2c066470 0x7feb2c068930 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:43.027 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:43.021+0000 7feb4650f640 1 --2- 172.21.15.78:0/559355657 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7feb4014fc30 0x7feb4015b480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:43.027 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:43.021+0000 7feb4650f640 1 --2- 172.21.15.78:0/559355657 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7feb4014f850 0x7feb401f0c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:43.027 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:43.021+0000 7feb4650f640 1 --2- 172.21.15.78:0/559355657 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7feb4006d840 0x7feb401ee030 unknown :-1 s=CLOSED pgs=760 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:43.027 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:43.021+0000 7feb4650f640 1 -- 172.21.15.78:0/559355657 >> 172.21.15.78:0/559355657 conn(0x7feb400c59f0 msgr2=0x7feb4006cd10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:01:43.027 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:43.021+0000 7feb4650f640 1 -- 172.21.15.78:0/559355657 shutdown_connections 2023-11-28T20:01:43.028 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:43.021+0000 7feb4650f640 1 -- 172.21.15.78:0/559355657 wait complete. 2023-11-28T20:01:43.045 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs2_metadata pg_num 2023-11-28T20:01:43.188 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:43.185+0000 7f8b65de6640 1 Processor -- start 2023-11-28T20:01:43.189 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:43.185+0000 7f8b65de6640 1 -- start start 2023-11-28T20:01:43.192 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:43.185+0000 7f8b65de6640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8b601516a0 0x7f8b600c4180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:43.192 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:43.185+0000 7f8b65de6640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f8b600c46c0 0x7f8b6006bc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:43.192 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:43.185+0000 7f8b65de6640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8b60151b20 con 0x7f8b6014e2a0 2023-11-28T20:01:43.192 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:43.185+0000 7f8b65de6640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8b60151210 con 0x7f8b600c46c0 2023-11-28T20:01:43.193 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:43.185+0000 7f8b65de6640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b6014e680 con 0x7f8b601516a0 2023-11-28T20:01:43.193 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:43.185+0000 7f8b5f7fe640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f8b6014e2a0 0x7f8b600a9460 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:39514/0 (socket says 172.21.15.78:39514) 2023-11-28T20:01:43.193 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:43.185+0000 7f8b5f7fe640 1 -- 172.21.15.78:0/3759356639 learned_addr learned my addr 172.21.15.78:0/3759356639 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-11-28T20:01:43.193 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:43.185+0000 7f8b5ffff640 1 --2- 172.21.15.78:0/3759356639 >> v2:172.21.15.78:3300/0 conn(0x7f8b600c46c0 0x7f8b6006bc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:43.193 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:43.185+0000 7f8b5effd640 1 --2- 172.21.15.78:0/3759356639 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8b601516a0 0x7f8b600c4180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:43.193 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:43.185+0000 7f8b5e7fc640 1 -- 172.21.15.78:0/3759356639 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 11101863 0 0) 0x7f8b50001120 con 0x7f8b6014e2a0 2023-11-28T20:01:43.193 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:43.185+0000 7f8b5e7fc640 1 -- 172.21.15.78:0/3759356639 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8b48003530 con 0x7f8b6014e2a0 2023-11-28T20:01:43.194 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:43.185+0000 7f8b5ffff640 1 -- 172.21.15.78:0/3759356639 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8b601516a0 msgr2=0x7f8b600c4180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:01:43.194 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:43.185+0000 7f8b5ffff640 1 --2- 172.21.15.78:0/3759356639 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8b601516a0 0x7f8b600c4180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:43.194 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:43.185+0000 7f8b5ffff640 1 -- 172.21.15.78:0/3759356639 >> v1:172.21.15.78:6789/0 conn(0x7f8b6014e2a0 legacy=0x7f8b600a9460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:01:43.194 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:43.185+0000 7f8b5ffff640 1 -- 172.21.15.78:0/3759356639 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b600a9b70 con 0x7f8b600c46c0 2023-11-28T20:01:43.196 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:43.189+0000 7f8b5ffff640 1 --2- 172.21.15.78:0/3759356639 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8b600c46c0 0x7f8b6006bc80 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 crypto rx=0x7f8b58009d90 tx=0x7f8b5801c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fe8301ba1bc4c69d server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:01:43.196 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:43.189+0000 7f8b5e7fc640 1 -- 172.21.15.78:0/3759356639 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b580a5790 con 0x7f8b600c46c0 2023-11-28T20:01:43.196 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:43.189+0000 7f8b5e7fc640 1 -- 172.21.15.78:0/3759356639 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b580a58f0 con 0x7f8b600c46c0 2023-11-28T20:01:43.196 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:43.189+0000 7f8b5e7fc640 1 -- 172.21.15.78:0/3759356639 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b580a5c80 con 0x7f8b600c46c0 2023-11-28T20:01:43.197 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:43.189+0000 7f8b65de6640 1 -- 172.21.15.78:0/3759356639 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8b600c46c0 msgr2=0x7f8b6006bc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:01:43.197 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:43.189+0000 7f8b65de6640 1 --2- 172.21.15.78:0/3759356639 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8b600c46c0 0x7f8b6006bc80 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 crypto rx=0x7f8b58009d90 tx=0x7f8b5801c950 comp rx=0 tx=0).stop 2023-11-28T20:01:43.197 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:43.189+0000 7f8b65de6640 1 -- 172.21.15.78:0/3759356639 shutdown_connections 2023-11-28T20:01:43.197 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:43.189+0000 7f8b65de6640 1 --2- 172.21.15.78:0/3759356639 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8b600c46c0 0x7f8b6006bc80 unknown :-1 s=CLOSED pgs=762 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:43.198 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:43.189+0000 7f8b65de6640 1 --2- 172.21.15.78:0/3759356639 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8b601516a0 0x7f8b600c4180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:43.198 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:43.189+0000 7f8b65de6640 1 -- 172.21.15.78:0/3759356639 >> 172.21.15.78:0/3759356639 conn(0x7f8b600c59f0 msgr2=0x7f8b600c5e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:01:43.198 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:43.189+0000 7f8b65de6640 1 -- 172.21.15.78:0/3759356639 shutdown_connections 2023-11-28T20:01:43.198 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:43.189+0000 7f8b65de6640 1 -- 172.21.15.78:0/3759356639 wait complete. 2023-11-28T20:01:43.198 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:43.193+0000 7f8b65de6640 1 Processor -- start 2023-11-28T20:01:43.198 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:43.193+0000 7f8b65de6640 1 -- start start 2023-11-28T20:01:43.200 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:43.193+0000 7f8b65de6640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8b600c46c0 0x7f8b60159ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:43.200 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:43.193+0000 7f8b65de6640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8b6014e2a0 0x7f8b600c19e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:43.201 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:43.193+0000 7f8b65de6640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8b601516a0 0x7f8b600c0370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:43.201 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:43.193+0000 7f8b65de6640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b600c2330 con 0x7f8b6014e2a0 2023-11-28T20:01:43.201 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:43.193+0000 7f8b65de6640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b601edcb0 con 0x7f8b601516a0 2023-11-28T20:01:43.201 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:43.193+0000 7f8b65de6640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b601ecef0 con 0x7f8b600c46c0 2023-11-28T20:01:43.201 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:43.193+0000 7f8b5effd640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8b6014e2a0 0x7f8b600c19e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:43.202 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:43.193+0000 7f8b5effd640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8b6014e2a0 0x7f8b600c19e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:55574/0 (socket says 172.21.15.78:55574) 2023-11-28T20:01:43.202 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:43.193+0000 7f8b5effd640 1 -- 172.21.15.78:0/3082092001 learned_addr learned my addr 172.21.15.78:0/3082092001 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T20:01:43.202 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:43.193+0000 7f8b5effd640 1 -- 172.21.15.78:0/3082092001 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8b600c46c0 msgr2=0x7f8b60159ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:01:43.202 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:43.193+0000 7f8b5f7fe640 1 --2- 172.21.15.78:0/3082092001 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8b600c46c0 0x7f8b60159ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:43.202 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:43.193+0000 7f8b5ffff640 1 --2- 172.21.15.78:0/3082092001 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8b601516a0 0x7f8b600c0370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:43.202 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:43.193+0000 7f8b5effd640 1 --2- 172.21.15.78:0/3082092001 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8b600c46c0 0x7f8b60159ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:43.202 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:43.193+0000 7f8b5effd640 1 -- 172.21.15.78:0/3082092001 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8b601516a0 msgr2=0x7f8b600c0370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:01:43.203 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:43.193+0000 7f8b5effd640 1 --2- 172.21.15.78:0/3082092001 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8b601516a0 0x7f8b600c0370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:43.203 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:43.193+0000 7f8b5effd640 1 -- 172.21.15.78:0/3082092001 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b58009a70 con 0x7f8b6014e2a0 2023-11-28T20:01:43.203 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:43.193+0000 7f8b5f7fe640 1 --2- 172.21.15.78:0/3082092001 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8b600c46c0 0x7f8b60159ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T20:01:43.203 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:43.193+0000 7f8b5ffff640 1 --2- 172.21.15.78:0/3082092001 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8b601516a0 0x7f8b600c0370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T20:01:43.203 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:43.193+0000 7f8b5effd640 1 --2- 172.21.15.78:0/3082092001 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8b6014e2a0 0x7f8b600c19e0 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 crypto rx=0x7f8b5400e870 tx=0x7f8b5400ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:01:43.203 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:43.193+0000 7f8b47fff640 1 -- 172.21.15.78:0/3082092001 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b54009510 con 0x7f8b6014e2a0 2023-11-28T20:01:43.203 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:43.193+0000 7f8b47fff640 1 -- 172.21.15.78:0/3082092001 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b5400eec0 con 0x7f8b6014e2a0 2023-11-28T20:01:43.203 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:43.193+0000 7f8b47fff640 1 -- 172.21.15.78:0/3082092001 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b5400cb40 con 0x7f8b6014e2a0 2023-11-28T20:01:43.204 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:43.193+0000 7f8b65de6640 1 -- 172.21.15.78:0/3082092001 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8b601ed1d0 con 0x7f8b6014e2a0 2023-11-28T20:01:43.204 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:43.193+0000 7f8b65de6640 1 -- 172.21.15.78:0/3082092001 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8b601ed790 con 0x7f8b6014e2a0 2023-11-28T20:01:43.204 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:43.193+0000 7f8b65de6640 1 -- 172.21.15.78:0/3082092001 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8b60067630 con 0x7f8b6014e2a0 2023-11-28T20:01:43.204 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:43.197+0000 7f8b47fff640 1 -- 172.21.15.78:0/3082092001 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f8b5400cca0 con 0x7f8b6014e2a0 2023-11-28T20:01:43.205 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:43.197+0000 7f8b47fff640 1 --2- 172.21.15.78:0/3082092001 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f8b4c0664a0 0x7f8b4c068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:43.205 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:43.197+0000 7f8b47fff640 1 -- 172.21.15.78:0/3082092001 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 6885+0+0 (secure 0 0 0) 0x7f8b540843e0 con 0x7f8b6014e2a0 2023-11-28T20:01:43.205 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:43.197+0000 7f8b5f7fe640 1 --2- 172.21.15.78:0/3082092001 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f8b4c0664a0 0x7f8b4c068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:43.205 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:43.197+0000 7f8b5f7fe640 1 --2- 172.21.15.78:0/3082092001 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f8b4c0664a0 0x7f8b4c068960 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f8b50007fd0 tx=0x7f8b50009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:01:43.205 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:43.201+0000 7f8b47fff640 1 -- 172.21.15.78:0/3082092001 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f8b54051450 con 0x7f8b6014e2a0 2023-11-28T20:01:43.357 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:43.353+0000 7f8b65de6640 1 -- 172.21.15.78:0/3082092001 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs2_metadata", "var": "pg_num"} v 0) v1 -- 0x7f8b600c5100 con 0x7f8b6014e2a0 2023-11-28T20:01:43.358 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:43.353+0000 7f8b47fff640 1 -- 172.21.15.78:0/3082092001 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs2_metadata", "var": "pg_num"}]=0 v65) v1 ==== 105+0+11 (secure 0 0 0) 0x7f8b54054a70 con 0x7f8b6014e2a0 2023-11-28T20:01:43.358 INFO:teuthology.orchestra.run.smithi078.stdout:pg_num: 32 2023-11-28T20:01:43.360 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:43.353+0000 7f8b65de6640 1 -- 172.21.15.78:0/3082092001 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f8b4c0664a0 msgr2=0x7f8b4c068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:01:43.360 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:43.353+0000 7f8b65de6640 1 --2- 172.21.15.78:0/3082092001 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f8b4c0664a0 0x7f8b4c068960 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f8b50007fd0 tx=0x7f8b50009040 comp rx=0 tx=0).stop 2023-11-28T20:01:43.360 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:43.353+0000 7f8b65de6640 1 -- 172.21.15.78:0/3082092001 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8b6014e2a0 msgr2=0x7f8b600c19e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:01:43.360 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:43.353+0000 7f8b65de6640 1 --2- 172.21.15.78:0/3082092001 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8b6014e2a0 0x7f8b600c19e0 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 crypto rx=0x7f8b5400e870 tx=0x7f8b5400ec70 comp rx=0 tx=0).stop 2023-11-28T20:01:43.361 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:43.353+0000 7f8b65de6640 1 -- 172.21.15.78:0/3082092001 shutdown_connections 2023-11-28T20:01:43.361 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:43.353+0000 7f8b65de6640 1 --2- 172.21.15.78:0/3082092001 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f8b4c0664a0 0x7f8b4c068960 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:43.361 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:43.353+0000 7f8b65de6640 1 --2- 172.21.15.78:0/3082092001 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8b601516a0 0x7f8b600c0370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:43.362 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:43.353+0000 7f8b65de6640 1 --2- 172.21.15.78:0/3082092001 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8b6014e2a0 0x7f8b600c19e0 unknown :-1 s=CLOSED pgs=763 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:43.362 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:43.353+0000 7f8b65de6640 1 --2- 172.21.15.78:0/3082092001 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8b600c46c0 0x7f8b60159ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:43.364 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:43.353+0000 7f8b65de6640 1 -- 172.21.15.78:0/3082092001 >> 172.21.15.78:0/3082092001 conn(0x7f8b600c59f0 msgr2=0x7f8b600c2580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:01:43.364 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:43.353+0000 7f8b65de6640 1 -- 172.21.15.78:0/3082092001 shutdown_connections 2023-11-28T20:01:43.364 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:43.357+0000 7f8b65de6640 1 -- 172.21.15.78:0/3082092001 wait complete. 2023-11-28T20:01:43.378 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs2_data pg_num 2023-11-28T20:01:43.518 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:43.513+0000 7f03887f8640 1 Processor -- start 2023-11-28T20:01:43.519 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:43.513+0000 7f03887f8640 1 -- start start 2023-11-28T20:01:43.521 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:43.517+0000 7f03887f8640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0380151a20 0x7f038006e890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:43.521 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:43.517+0000 7f03887f8640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f0380157a90 0x7f038006b5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:43.521 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:43.517+0000 7f03887f8640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f038006bb00 0x7f0380154bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:43.521 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:43.517+0000 7f03887f8640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f03800c2720 con 0x7f0380157a90 2023-11-28T20:01:43.521 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:43.517+0000 7f03887f8640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0380072c50 con 0x7f038006bb00 2023-11-28T20:01:43.521 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:43.517+0000 7f03887f8640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f03801544a0 con 0x7f0380151a20 2023-11-28T20:01:43.521 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:43.517+0000 7f0385d93640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f0380157a90 0x7f038006b5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:43.521 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:43.517+0000 7f0385d93640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f0380157a90 0x7f038006b5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:55582/0 (socket says 172.21.15.78:55582) 2023-11-28T20:01:43.521 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:43.517+0000 7f0385d93640 1 -- 172.21.15.78:0/3070580153 learned_addr learned my addr 172.21.15.78:0/3070580153 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T20:01:43.521 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:43.517+0000 7f0385d93640 1 -- 172.21.15.78:0/3070580153 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0380151a20 msgr2=0x7f038006e890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:01:43.521 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:43.517+0000 7f0385d93640 1 --2- 172.21.15.78:0/3070580153 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0380151a20 0x7f038006e890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:43.522 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:43.517+0000 7f0385d93640 1 -- 172.21.15.78:0/3070580153 >> v2:172.21.15.179:3300/0 conn(0x7f038006bb00 msgr2=0x7f0380154bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:01:43.522 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:43.517+0000 7f0386d95640 1 --2- 172.21.15.78:0/3070580153 >> v2:172.21.15.179:3300/0 conn(0x7f038006bb00 0x7f0380154bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:43.522 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:43.517+0000 7f0385d93640 1 --2- 172.21.15.78:0/3070580153 >> v2:172.21.15.179:3300/0 conn(0x7f038006bb00 0x7f0380154bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:43.522 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:43.517+0000 7f0385d93640 1 -- 172.21.15.78:0/3070580153 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03800c1810 con 0x7f0380157a90 2023-11-28T20:01:43.522 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:43.517+0000 7f0386d95640 1 --2- 172.21.15.78:0/3070580153 >> v2:172.21.15.179:3300/0 conn(0x7f038006bb00 0x7f0380154bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T20:01:43.523 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:43.521+0000 7f0385d93640 1 --2- 172.21.15.78:0/3070580153 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0380157a90 0x7f038006b5c0 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 crypto rx=0x7f0380158b80 tx=0x7f037001c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c15b16d58107310a server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:01:43.524 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:43.521+0000 7f0385592640 1 -- 172.21.15.78:0/3070580153 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03700ab600 con 0x7f0380157a90 2023-11-28T20:01:43.524 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:43.521+0000 7f0385592640 1 -- 172.21.15.78:0/3070580153 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f03700a7050 con 0x7f0380157a90 2023-11-28T20:01:43.524 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:43.521+0000 7f0385592640 1 -- 172.21.15.78:0/3070580153 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03700ab980 con 0x7f0380157a90 2023-11-28T20:01:43.525 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:43.521+0000 7f03887f8640 1 -- 172.21.15.78:0/3070580153 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0380157a90 msgr2=0x7f038006b5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:01:43.525 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:43.521+0000 7f03887f8640 1 --2- 172.21.15.78:0/3070580153 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0380157a90 0x7f038006b5c0 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 crypto rx=0x7f0380158b80 tx=0x7f037001c470 comp rx=0 tx=0).stop 2023-11-28T20:01:43.525 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:43.521+0000 7f03887f8640 1 -- 172.21.15.78:0/3070580153 shutdown_connections 2023-11-28T20:01:43.525 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:43.521+0000 7f03887f8640 1 --2- 172.21.15.78:0/3070580153 >> v2:172.21.15.179:3300/0 conn(0x7f038006bb00 0x7f0380154bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:43.525 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:43.521+0000 7f03887f8640 1 --2- 172.21.15.78:0/3070580153 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0380157a90 0x7f038006b5c0 unknown :-1 s=CLOSED pgs=764 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:43.525 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:43.521+0000 7f03887f8640 1 --2- 172.21.15.78:0/3070580153 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0380151a20 0x7f038006e890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:43.525 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:43.521+0000 7f03887f8640 1 -- 172.21.15.78:0/3070580153 >> 172.21.15.78:0/3070580153 conn(0x7f03800c2e20 msgr2=0x7f03800c3230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:01:43.525 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:43.521+0000 7f03887f8640 1 -- 172.21.15.78:0/3070580153 shutdown_connections 2023-11-28T20:01:43.526 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:43.521+0000 7f03887f8640 1 -- 172.21.15.78:0/3070580153 wait complete. 2023-11-28T20:01:43.526 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:43.521+0000 7f03887f8640 1 Processor -- start 2023-11-28T20:01:43.526 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:43.521+0000 7f03887f8640 1 -- start start 2023-11-28T20:01:43.528 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:43.521+0000 7f03887f8640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f038006bb00 0x7f03800c4fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:43.528 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:43.521+0000 7f03887f8640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0380151a20 0x7f038014d7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:43.528 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:43.525+0000 7f03887f8640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0380157a90 0x7f03801f0850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:43.528 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:43.525+0000 7f03887f8640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f038014be30 con 0x7f0380157a90 2023-11-28T20:01:43.528 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:43.525+0000 7f03887f8640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f038014afe0 con 0x7f0380151a20 2023-11-28T20:01:43.528 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:43.525+0000 7f03887f8640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f03800c4ac0 con 0x7f038006bb00 2023-11-28T20:01:43.528 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:43.525+0000 7f0386d95640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0380157a90 0x7f03801f0850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:43.528 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:43.525+0000 7f0385d93640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0380151a20 0x7f038014d7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:43.528 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:43.525+0000 7f0386d95640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0380157a90 0x7f03801f0850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:55586/0 (socket says 172.21.15.78:55586) 2023-11-28T20:01:43.529 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:43.525+0000 7f0386d95640 1 -- 172.21.15.78:0/3840552991 learned_addr learned my addr 172.21.15.78:0/3840552991 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T20:01:43.529 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:43.525+0000 7f0386594640 1 --2- 172.21.15.78:0/3840552991 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f038006bb00 0x7f03800c4fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:43.529 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:43.525+0000 7f0386d95640 1 -- 172.21.15.78:0/3840552991 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f038006bb00 msgr2=0x7f03800c4fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:01:43.529 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:43.525+0000 7f0386d95640 1 --2- 172.21.15.78:0/3840552991 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f038006bb00 0x7f03800c4fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:43.529 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:43.525+0000 7f0386d95640 1 -- 172.21.15.78:0/3840552991 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0380151a20 msgr2=0x7f038014d7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:01:43.529 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:43.525+0000 7f0386d95640 1 --2- 172.21.15.78:0/3840552991 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0380151a20 0x7f038014d7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:43.529 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:43.525+0000 7f0386d95640 1 -- 172.21.15.78:0/3840552991 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03700094d0 con 0x7f0380157a90 2023-11-28T20:01:43.529 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:43.525+0000 7f0385d93640 1 --2- 172.21.15.78:0/3840552991 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0380151a20 0x7f038014d7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T20:01:43.530 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:43.525+0000 7f0386d95640 1 --2- 172.21.15.78:0/3840552991 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0380157a90 0x7f03801f0850 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 crypto rx=0x7f037800cef0 tx=0x7f037800a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:01:43.530 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:43.525+0000 7f0376ffd640 1 -- 172.21.15.78:0/3840552991 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f037800d840 con 0x7f0380157a90 2023-11-28T20:01:43.530 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:43.525+0000 7f0376ffd640 1 -- 172.21.15.78:0/3840552991 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f037800d9c0 con 0x7f0380157a90 2023-11-28T20:01:43.530 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:43.525+0000 7f0376ffd640 1 -- 172.21.15.78:0/3840552991 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f037800dd70 con 0x7f0380157a90 2023-11-28T20:01:43.530 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:43.525+0000 7f03887f8640 1 -- 172.21.15.78:0/3840552991 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f03801f1400 con 0x7f0380157a90 2023-11-28T20:01:43.530 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:43.525+0000 7f03887f8640 1 -- 172.21.15.78:0/3840552991 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f038014bb50 con 0x7f0380157a90 2023-11-28T20:01:43.531 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:43.525+0000 7f03887f8640 1 -- 172.21.15.78:0/3840552991 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0380066660 con 0x7f0380157a90 2023-11-28T20:01:43.531 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:43.525+0000 7f0376ffd640 1 -- 172.21.15.78:0/3840552991 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f037801e3b0 con 0x7f0380157a90 2023-11-28T20:01:43.532 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:43.529+0000 7f0376ffd640 1 --2- 172.21.15.78:0/3840552991 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f03640664a0 0x7f0364068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:43.532 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:43.529+0000 7f0376ffd640 1 -- 172.21.15.78:0/3840552991 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 6885+0+0 (secure 0 0 0) 0x7f0378084c10 con 0x7f0380157a90 2023-11-28T20:01:43.532 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:43.529+0000 7f0386594640 1 --2- 172.21.15.78:0/3840552991 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f03640664a0 0x7f0364068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:43.532 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:43.529+0000 7f0386594640 1 --2- 172.21.15.78:0/3840552991 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f03640664a0 0x7f0364068960 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f037c009990 tx=0x7f037c009110 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:01:43.536 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:43.533+0000 7f0376ffd640 1 -- 172.21.15.78:0/3840552991 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f0378051df0 con 0x7f0380157a90 2023-11-28T20:01:43.687 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:43.685+0000 7f03887f8640 1 -- 172.21.15.78:0/3840552991 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs2_data", "var": "pg_num"} v 0) v1 -- 0x7f0380070790 con 0x7f0380157a90 2023-11-28T20:01:43.688 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:43.685+0000 7f0376ffd640 1 -- 172.21.15.78:0/3840552991 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs2_data", "var": "pg_num"}]=0 v65) v1 ==== 101+0+11 (secure 0 0 0) 0x7f037801a020 con 0x7f0380157a90 2023-11-28T20:01:43.688 INFO:teuthology.orchestra.run.smithi078.stdout:pg_num: 64 2023-11-28T20:01:43.690 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:43.685+0000 7f03887f8640 1 -- 172.21.15.78:0/3840552991 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f03640664a0 msgr2=0x7f0364068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:01:43.690 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:43.685+0000 7f03887f8640 1 --2- 172.21.15.78:0/3840552991 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f03640664a0 0x7f0364068960 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f037c009990 tx=0x7f037c009110 comp rx=0 tx=0).stop 2023-11-28T20:01:43.690 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:43.685+0000 7f03887f8640 1 -- 172.21.15.78:0/3840552991 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0380157a90 msgr2=0x7f03801f0850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:01:43.690 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:43.685+0000 7f03887f8640 1 --2- 172.21.15.78:0/3840552991 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0380157a90 0x7f03801f0850 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 crypto rx=0x7f037800cef0 tx=0x7f037800a710 comp rx=0 tx=0).stop 2023-11-28T20:01:43.690 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:43.685+0000 7f03887f8640 1 -- 172.21.15.78:0/3840552991 shutdown_connections 2023-11-28T20:01:43.690 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:43.685+0000 7f03887f8640 1 --2- 172.21.15.78:0/3840552991 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f03640664a0 0x7f0364068960 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:43.690 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:43.685+0000 7f03887f8640 1 --2- 172.21.15.78:0/3840552991 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0380157a90 0x7f03801f0850 unknown :-1 s=CLOSED pgs=765 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:43.691 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:43.685+0000 7f03887f8640 1 --2- 172.21.15.78:0/3840552991 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0380151a20 0x7f038014d7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:43.691 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:43.685+0000 7f03887f8640 1 --2- 172.21.15.78:0/3840552991 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f038006bb00 0x7f03800c4fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:43.691 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:43.685+0000 7f03887f8640 1 -- 172.21.15.78:0/3840552991 >> 172.21.15.78:0/3840552991 conn(0x7f03800c2e20 msgr2=0x7f0380153280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:01:43.691 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:43.685+0000 7f03887f8640 1 -- 172.21.15.78:0/3840552991 shutdown_connections 2023-11-28T20:01:43.691 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:43.685+0000 7f03887f8640 1 -- 172.21.15.78:0/3840552991 wait complete. 2023-11-28T20:01:43.709 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-11-28T20:01:43.847 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:43.841+0000 7f0045aaa640 1 Processor -- start 2023-11-28T20:01:43.848 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:43.845+0000 7f0045aaa640 1 -- start start 2023-11-28T20:01:43.850 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:43.845+0000 7f0045aaa640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f0040154390 0x7f00400c4a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:43.850 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:43.845+0000 7f0045aaa640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f00400c4f80 0x7f00400c63b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:43.850 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:43.845+0000 7f0045aaa640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f00400a93d0 con 0x7f00400c2110 2023-11-28T20:01:43.850 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:43.845+0000 7f0045aaa640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f00400aa1c0 con 0x7f00400c4f80 2023-11-28T20:01:43.850 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:43.845+0000 7f0045aaa640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0040154770 con 0x7f0040154390 2023-11-28T20:01:43.850 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:43.845+0000 7f003ffff640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f00400c4f80 0x7f00400c63b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:43.850 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:43.845+0000 7f003ffff640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f00400c4f80 0x7f00400c63b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:55596/0 (socket says 172.21.15.78:55596) 2023-11-28T20:01:43.850 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:43.845+0000 7f003ffff640 1 -- 172.21.15.78:0/3396188568 learned_addr learned my addr 172.21.15.78:0/3396188568 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T20:01:43.851 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:43.845+0000 7f003f7fe640 1 --2- 172.21.15.78:0/3396188568 >> v2:172.21.15.179:3300/0 conn(0x7f0040154390 0x7f00400c4a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:43.851 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:43.845+0000 7f003ffff640 1 -- 172.21.15.78:0/3396188568 >> v2:172.21.15.179:3300/0 conn(0x7f0040154390 msgr2=0x7f00400c4a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:01:43.851 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:43.845+0000 7f003ffff640 1 --2- 172.21.15.78:0/3396188568 >> v2:172.21.15.179:3300/0 conn(0x7f0040154390 0x7f00400c4a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:43.851 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:43.845+0000 7f003ffff640 1 -- 172.21.15.78:0/3396188568 >> v1:172.21.15.179:6789/0 conn(0x7f00400c2110 legacy=0x7f00400c5ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:01:43.851 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:43.845+0000 7f003ffff640 1 -- 172.21.15.78:0/3396188568 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00400a9640 con 0x7f00400c4f80 2023-11-28T20:01:43.852 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:43.849+0000 7f003ffff640 1 --2- 172.21.15.78:0/3396188568 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f00400c4f80 0x7f00400c63b0 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 crypto rx=0x7f00400a83b0 tx=0x7f003801c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c95f1d57e185e27c server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:01:43.852 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:43.849+0000 7f003e7fc640 1 -- 172.21.15.78:0/3396188568 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00380a5760 con 0x7f00400c4f80 2023-11-28T20:01:43.852 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:43.849+0000 7f003e7fc640 1 -- 172.21.15.78:0/3396188568 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f00380a58c0 con 0x7f00400c4f80 2023-11-28T20:01:43.852 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:43.849+0000 7f003e7fc640 1 -- 172.21.15.78:0/3396188568 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00380a5c50 con 0x7f00400c4f80 2023-11-28T20:01:43.853 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:43.849+0000 7f0045aaa640 1 -- 172.21.15.78:0/3396188568 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f00400c4f80 msgr2=0x7f00400c63b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:01:43.853 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:43.849+0000 7f0045aaa640 1 --2- 172.21.15.78:0/3396188568 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f00400c4f80 0x7f00400c63b0 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 crypto rx=0x7f00400a83b0 tx=0x7f003801c990 comp rx=0 tx=0).stop 2023-11-28T20:01:43.853 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:43.849+0000 7f0045aaa640 1 -- 172.21.15.78:0/3396188568 shutdown_connections 2023-11-28T20:01:43.853 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:43.849+0000 7f0045aaa640 1 --2- 172.21.15.78:0/3396188568 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f00400c4f80 0x7f00400c63b0 unknown :-1 s=CLOSED pgs=766 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:43.854 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:43.849+0000 7f0045aaa640 1 --2- 172.21.15.78:0/3396188568 >> v2:172.21.15.179:3300/0 conn(0x7f0040154390 0x7f00400c4a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:43.854 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:43.849+0000 7f0045aaa640 1 -- 172.21.15.78:0/3396188568 >> 172.21.15.78:0/3396188568 conn(0x7f004006b220 msgr2=0x7f00400a77e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:01:43.854 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:43.849+0000 7f0045aaa640 1 -- 172.21.15.78:0/3396188568 shutdown_connections 2023-11-28T20:01:43.854 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:43.849+0000 7f0045aaa640 1 -- 172.21.15.78:0/3396188568 wait complete. 2023-11-28T20:01:43.854 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:43.849+0000 7f0045aaa640 1 Processor -- start 2023-11-28T20:01:43.855 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:43.849+0000 7f0045aaa640 1 -- start start 2023-11-28T20:01:43.857 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:43.853+0000 7f0045aaa640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f00400c2110 0x7f00401f1300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:43.857 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:43.853+0000 7f0045aaa640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f00400c4f80 0x7f00400a6af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:43.857 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:43.853+0000 7f0045aaa640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0040154390 0x7f00401ea730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:43.857 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:43.853+0000 7f0045aaa640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f004014dc10 con 0x7f0040154390 2023-11-28T20:01:43.857 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:43.853+0000 7f0045aaa640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00401f1840 con 0x7f00400c2110 2023-11-28T20:01:43.858 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:43.853+0000 7f0045aaa640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0040150970 con 0x7f00400c4f80 2023-11-28T20:01:43.858 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:43.853+0000 7f003ffff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0040154390 0x7f00401ea730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:43.858 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:43.853+0000 7f003ffff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0040154390 0x7f00401ea730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:55602/0 (socket says 172.21.15.78:55602) 2023-11-28T20:01:43.858 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:43.853+0000 7f003ffff640 1 -- 172.21.15.78:0/148269487 learned_addr learned my addr 172.21.15.78:0/148269487 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T20:01:43.858 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:43.853+0000 7f003f7fe640 1 --2- 172.21.15.78:0/148269487 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f00400c2110 0x7f00401f1300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:43.858 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:43.853+0000 7f003effd640 1 --2- 172.21.15.78:0/148269487 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f00400c4f80 0x7f00400a6af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:43.858 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:43.853+0000 7f003ffff640 1 -- 172.21.15.78:0/148269487 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f00400c4f80 msgr2=0x7f00400a6af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:01:43.858 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:43.853+0000 7f003ffff640 1 --2- 172.21.15.78:0/148269487 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f00400c4f80 0x7f00400a6af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:43.858 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:43.853+0000 7f003ffff640 1 -- 172.21.15.78:0/148269487 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f00400c2110 msgr2=0x7f00401f1300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:01:43.858 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:43.853+0000 7f003ffff640 1 --2- 172.21.15.78:0/148269487 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f00400c2110 0x7f00401f1300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:43.858 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:43.853+0000 7f003ffff640 1 -- 172.21.15.78:0/148269487 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0038009b30 con 0x7f0040154390 2023-11-28T20:01:43.858 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:43.853+0000 7f003f7fe640 1 --2- 172.21.15.78:0/148269487 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f00400c2110 0x7f00401f1300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T20:01:43.859 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:43.853+0000 7f003ffff640 1 --2- 172.21.15.78:0/148269487 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0040154390 0x7f00401ea730 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x7f003801a5c0 tx=0x7f0038019730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:01:43.859 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:43.853+0000 7f0027fff640 1 -- 172.21.15.78:0/148269487 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00380b8670 con 0x7f0040154390 2023-11-28T20:01:43.859 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:43.853+0000 7f0027fff640 1 -- 172.21.15.78:0/148269487 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f00380b87d0 con 0x7f0040154390 2023-11-28T20:01:43.859 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:43.853+0000 7f0045aaa640 1 -- 172.21.15.78:0/148269487 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0040150c50 con 0x7f0040154390 2023-11-28T20:01:43.859 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:43.853+0000 7f0027fff640 1 -- 172.21.15.78:0/148269487 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00380b8b80 con 0x7f0040154390 2023-11-28T20:01:43.859 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:43.853+0000 7f0045aaa640 1 -- 172.21.15.78:0/148269487 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f004014f030 con 0x7f0040154390 2023-11-28T20:01:43.860 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:43.853+0000 7f0045aaa640 1 -- 172.21.15.78:0/148269487 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0040067630 con 0x7f0040154390 2023-11-28T20:01:43.860 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:43.853+0000 7f0027fff640 1 -- 172.21.15.78:0/148269487 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f00380b8ce0 con 0x7f0040154390 2023-11-28T20:01:43.860 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:43.857+0000 7f0027fff640 1 --2- 172.21.15.78:0/148269487 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f002c066470 0x7f002c068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:43.860 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:43.857+0000 7f0027fff640 1 -- 172.21.15.78:0/148269487 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 6885+0+0 (secure 0 0 0) 0x7f003811f730 con 0x7f0040154390 2023-11-28T20:01:43.860 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:43.857+0000 7f003f7fe640 1 --2- 172.21.15.78:0/148269487 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f002c066470 0x7f002c068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:43.861 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:43.857+0000 7f003f7fe640 1 --2- 172.21.15.78:0/148269487 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f002c066470 0x7f002c068930 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f00400a4cd0 tx=0x7f0030008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:01:43.863 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:43.861+0000 7f0027fff640 1 -- 172.21.15.78:0/148269487 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f00380ec860 con 0x7f0040154390 2023-11-28T20:01:44.025 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:44.021+0000 7f0045aaa640 1 -- 172.21.15.78:0/148269487 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f00400c0800 con 0x7f0040154390 2023-11-28T20:01:44.026 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:44.021+0000 7f0027fff640 1 -- 172.21.15.78:0/148269487 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v65) v1 ==== 80+0+0 (secure 0 0 0) 0x7f00380efe80 con 0x7f0040154390 2023-11-28T20:01:44.027 INFO:teuthology.orchestra.run.smithi078.stderr:listed 0 entries 2023-11-28T20:01:44.030 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:44.025+0000 7f0045aaa640 1 -- 172.21.15.78:0/148269487 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f002c066470 msgr2=0x7f002c068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:01:44.030 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:44.025+0000 7f0045aaa640 1 --2- 172.21.15.78:0/148269487 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f002c066470 0x7f002c068930 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f00400a4cd0 tx=0x7f0030008040 comp rx=0 tx=0).stop 2023-11-28T20:01:44.030 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:44.025+0000 7f0045aaa640 1 -- 172.21.15.78:0/148269487 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0040154390 msgr2=0x7f00401ea730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:01:44.031 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:44.025+0000 7f0045aaa640 1 --2- 172.21.15.78:0/148269487 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0040154390 0x7f00401ea730 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x7f003801a5c0 tx=0x7f0038019730 comp rx=0 tx=0).stop 2023-11-28T20:01:44.031 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:44.025+0000 7f0045aaa640 1 -- 172.21.15.78:0/148269487 shutdown_connections 2023-11-28T20:01:44.031 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:44.025+0000 7f0045aaa640 1 --2- 172.21.15.78:0/148269487 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f002c066470 0x7f002c068930 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:44.031 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:44.025+0000 7f0045aaa640 1 --2- 172.21.15.78:0/148269487 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f00400c4f80 0x7f00400a6af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:44.031 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:44.025+0000 7f0045aaa640 1 --2- 172.21.15.78:0/148269487 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0040154390 0x7f00401ea730 unknown :-1 s=CLOSED pgs=767 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:44.031 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:44.025+0000 7f0045aaa640 1 --2- 172.21.15.78:0/148269487 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f00400c2110 0x7f00401f1300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:44.031 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:44.025+0000 7f0045aaa640 1 -- 172.21.15.78:0/148269487 >> 172.21.15.78:0/148269487 conn(0x7f004006b220 msgr2=0x7f0040153430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:01:44.031 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:44.025+0000 7f0045aaa640 1 -- 172.21.15.78:0/148269487 shutdown_connections 2023-11-28T20:01:44.031 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:44.025+0000 7f0045aaa640 1 -- 172.21.15.78:0/148269487 wait complete. 2023-11-28T20:01:44.047 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2023-11-28T20:01:44.048 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T20:01:44.048 DEBUG:teuthology.orchestra.run.smithi179:> sudo umount /home/ubuntu/cephtest/mnt.1 2023-11-28T20:01:44.077 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi179.front.sepia.ceph.com 2023-11-28T20:01:44.078 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T20:01:44.078 DEBUG:teuthology.orchestra.run.smithi179:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-11-28T20:01:44.130 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-28T20:01:44.267 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:44.261+0000 7fc8c1f80640 1 Processor -- start 2023-11-28T20:01:44.267 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:44.265+0000 7fc8c1f80640 1 -- start start 2023-11-28T20:01:44.269 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:44.265+0000 7fc8c1f80640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fc8bc154fd0 0x7fc8bc1584e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:44.269 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:44.265+0000 7fc8c1f80640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fc8bc0ca190 0x7fc8bc0ca5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:44.269 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:44.265+0000 7fc8c1f80640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc8bc0c5140 con 0x7fc8bc14e570 2023-11-28T20:01:44.269 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:44.265+0000 7fc8c1f80640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc8bc0c4b80 con 0x7fc8bc154fd0 2023-11-28T20:01:44.269 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:44.265+0000 7fc8c1f80640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc8bc0c4e60 con 0x7fc8bc0ca190 2023-11-28T20:01:44.269 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:44.265+0000 7fc8baffd640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fc8bc154fd0 0x7fc8bc1584e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:44.270 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:44.265+0000 7fc8baffd640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fc8bc154fd0 0x7fc8bc1584e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:55616/0 (socket says 172.21.15.78:55616) 2023-11-28T20:01:44.270 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:44.265+0000 7fc8baffd640 1 -- 172.21.15.78:0/273883919 learned_addr learned my addr 172.21.15.78:0/273883919 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T20:01:44.270 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:44.265+0000 7fc8bbfff640 1 --2- 172.21.15.78:0/273883919 >> v2:172.21.15.179:3300/0 conn(0x7fc8bc0ca190 0x7fc8bc0ca5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:44.270 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:44.265+0000 7fc8baffd640 1 -- 172.21.15.78:0/273883919 >> v2:172.21.15.179:3300/0 conn(0x7fc8bc0ca190 msgr2=0x7fc8bc0ca5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:01:44.270 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:44.265+0000 7fc8baffd640 1 --2- 172.21.15.78:0/273883919 >> v2:172.21.15.179:3300/0 conn(0x7fc8bc0ca190 0x7fc8bc0ca5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:44.270 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:44.265+0000 7fc8baffd640 1 -- 172.21.15.78:0/273883919 >> v1:172.21.15.179:6789/0 conn(0x7fc8bc14e570 legacy=0x7fc8bc0c7cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:01:44.270 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:44.265+0000 7fc8baffd640 1 -- 172.21.15.78:0/273883919 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8bc157ce0 con 0x7fc8bc154fd0 2023-11-28T20:01:44.272 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:44.269+0000 7fc8baffd640 1 --2- 172.21.15.78:0/273883919 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc8bc154fd0 0x7fc8bc1584e0 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 crypto rx=0x7fc8bc0ac9b0 tx=0x7fc8b001c400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=280361444bc095ff server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:01:44.272 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:44.269+0000 7fc8ba7fc640 1 -- 172.21.15.78:0/273883919 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8b00ab620 con 0x7fc8bc154fd0 2023-11-28T20:01:44.272 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:44.269+0000 7fc8ba7fc640 1 -- 172.21.15.78:0/273883919 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc8b00ab780 con 0x7fc8bc154fd0 2023-11-28T20:01:44.272 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:44.269+0000 7fc8ba7fc640 1 -- 172.21.15.78:0/273883919 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8b00abb10 con 0x7fc8bc154fd0 2023-11-28T20:01:44.273 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:44.269+0000 7fc8c1f80640 1 -- 172.21.15.78:0/273883919 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc8bc154fd0 msgr2=0x7fc8bc1584e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:01:44.273 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:44.269+0000 7fc8c1f80640 1 --2- 172.21.15.78:0/273883919 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc8bc154fd0 0x7fc8bc1584e0 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 crypto rx=0x7fc8bc0ac9b0 tx=0x7fc8b001c400 comp rx=0 tx=0).stop 2023-11-28T20:01:44.274 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:44.269+0000 7fc8c1f80640 1 -- 172.21.15.78:0/273883919 shutdown_connections 2023-11-28T20:01:44.274 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:44.269+0000 7fc8c1f80640 1 --2- 172.21.15.78:0/273883919 >> v2:172.21.15.179:3300/0 conn(0x7fc8bc0ca190 0x7fc8bc0ca5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:44.274 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:44.269+0000 7fc8c1f80640 1 --2- 172.21.15.78:0/273883919 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc8bc154fd0 0x7fc8bc1584e0 unknown :-1 s=CLOSED pgs=768 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:44.274 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:44.269+0000 7fc8c1f80640 1 -- 172.21.15.78:0/273883919 >> 172.21.15.78:0/273883919 conn(0x7fc8bc0abb10 msgr2=0x7fc8bc0abf20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:01:44.274 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:44.269+0000 7fc8c1f80640 1 -- 172.21.15.78:0/273883919 shutdown_connections 2023-11-28T20:01:44.274 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:44.269+0000 7fc8c1f80640 1 -- 172.21.15.78:0/273883919 wait complete. 2023-11-28T20:01:44.275 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:44.269+0000 7fc8c1f80640 1 Processor -- start 2023-11-28T20:01:44.275 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:44.269+0000 7fc8c1f80640 1 -- start start 2023-11-28T20:01:44.276 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:44.273+0000 7fc8c1f80640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc8bc0ca190 0x7fc8bc0aca30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:44.276 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:44.273+0000 7fc8c1f80640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc8bc14e570 0x7fc8bc151580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:44.277 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:44.273+0000 7fc8c1f80640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc8bc154fd0 0x7fc8bc1efd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:44.277 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:44.273+0000 7fc8c1f80640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8bc0ad190 con 0x7fc8bc14e570 2023-11-28T20:01:44.277 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:44.273+0000 7fc8c1f80640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8bc14f920 con 0x7fc8bc0ca190 2023-11-28T20:01:44.277 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:44.273+0000 7fc8c1f80640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc8bc151ac0 con 0x7fc8bc154fd0 2023-11-28T20:01:44.277 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:44.273+0000 7fc8baffd640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc8bc14e570 0x7fc8bc151580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:44.277 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:44.273+0000 7fc8baffd640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc8bc14e570 0x7fc8bc151580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:55618/0 (socket says 172.21.15.78:55618) 2023-11-28T20:01:44.278 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:44.273+0000 7fc8baffd640 1 -- 172.21.15.78:0/2275442503 learned_addr learned my addr 172.21.15.78:0/2275442503 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T20:01:44.278 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:44.273+0000 7fc8bb7fe640 1 --2- 172.21.15.78:0/2275442503 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc8bc0ca190 0x7fc8bc0aca30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:44.278 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:44.273+0000 7fc8bbfff640 1 --2- 172.21.15.78:0/2275442503 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc8bc154fd0 0x7fc8bc1efd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:44.278 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:44.273+0000 7fc8baffd640 1 -- 172.21.15.78:0/2275442503 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc8bc154fd0 msgr2=0x7fc8bc1efd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:01:44.278 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:44.273+0000 7fc8baffd640 1 --2- 172.21.15.78:0/2275442503 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc8bc154fd0 0x7fc8bc1efd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:44.278 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:44.273+0000 7fc8baffd640 1 -- 172.21.15.78:0/2275442503 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc8bc0ca190 msgr2=0x7fc8bc0aca30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:01:44.278 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:44.273+0000 7fc8baffd640 1 --2- 172.21.15.78:0/2275442503 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc8bc0ca190 0x7fc8bc0aca30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:44.278 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:44.273+0000 7fc8baffd640 1 -- 172.21.15.78:0/2275442503 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8b00094d0 con 0x7fc8bc14e570 2023-11-28T20:01:44.278 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:44.273+0000 7fc8bbfff640 1 --2- 172.21.15.78:0/2275442503 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc8bc154fd0 0x7fc8bc1efd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T20:01:44.279 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:44.273+0000 7fc8baffd640 1 --2- 172.21.15.78:0/2275442503 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc8bc14e570 0x7fc8bc151580 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 crypto rx=0x7fc8b001c8e0 tx=0x7fc8b001ac40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:01:44.280 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:44.273+0000 7fc8a3fff640 1 -- 172.21.15.78:0/2275442503 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8b00be3f0 con 0x7fc8bc14e570 2023-11-28T20:01:44.280 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:44.273+0000 7fc8a3fff640 1 -- 172.21.15.78:0/2275442503 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc8b00be550 con 0x7fc8bc14e570 2023-11-28T20:01:44.280 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:44.273+0000 7fc8a3fff640 1 -- 172.21.15.78:0/2275442503 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8b00be900 con 0x7fc8bc14e570 2023-11-28T20:01:44.280 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:44.273+0000 7fc8c1f80640 1 -- 172.21.15.78:0/2275442503 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc8bc14d3d0 con 0x7fc8bc14e570 2023-11-28T20:01:44.280 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:44.273+0000 7fc8c1f80640 1 -- 172.21.15.78:0/2275442503 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc8bc1f0800 con 0x7fc8bc14e570 2023-11-28T20:01:44.280 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:44.273+0000 7fc8c1f80640 1 -- 172.21.15.78:0/2275442503 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc8bc067630 con 0x7fc8bc14e570 2023-11-28T20:01:44.280 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:44.277+0000 7fc8a3fff640 1 -- 172.21.15.78:0/2275442503 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fc8b00bea60 con 0x7fc8bc14e570 2023-11-28T20:01:44.281 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:44.277+0000 7fc8a3fff640 1 --2- 172.21.15.78:0/2275442503 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fc8a8066470 0x7fc8a8068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:44.281 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:44.277+0000 7fc8a3fff640 1 -- 172.21.15.78:0/2275442503 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 6885+0+0 (secure 0 0 0) 0x7fc8b011ea30 con 0x7fc8bc14e570 2023-11-28T20:01:44.281 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:44.277+0000 7fc8bb7fe640 1 --2- 172.21.15.78:0/2275442503 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fc8a8066470 0x7fc8a8068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:44.281 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:44.277+0000 7fc8bb7fe640 1 --2- 172.21.15.78:0/2275442503 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fc8a8066470 0x7fc8a8068930 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7fc8ac007fd0 tx=0x7fc8ac007e40 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:01:44.284 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:44.281+0000 7fc8a3fff640 1 -- 172.21.15.78:0/2275442503 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fc8b00ebab0 con 0x7fc8bc14e570 2023-11-28T20:01:44.463 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:44.461+0000 7fc8c1f80640 1 -- 172.21.15.78:0/2275442503 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc8bc06c830 con 0x7fc8bc14e570 2023-11-28T20:01:44.464 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:44.461+0000 7fc8a3fff640 1 -- 172.21.15.78:0/2275442503 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 36 v36) v1 ==== 94+0+6130 (secure 0 0 0) 0x7fc8b00ef0d0 con 0x7fc8bc14e570 2023-11-28T20:01:44.464 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-11-28T20:01:44.464 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":36,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5384,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6834/837155031","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6832","nonce":837155031},{"type":"v1","addr":"172.21.15.179:6834","nonce":837155031}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":27},{"gid":5387,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6835/752467462","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6833","nonce":752467462},{"type":"v1","addr":"172.21.15.179:6835","nonce":752467462}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":27}],"filesystems":[{"mdsmap":{"epoch":31,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-28T20:01:09.868520+0000","modified":"2023-11-28T20:01:12.907972+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5892},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5892":{"gid":5892,"name":"a","rank":0,"incarnation":28,"state":"up:active","state_seq":3,"addr":"172.21.15.78:6837/115607035","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6836","nonce":115607035},{"type":"v1","addr":"172.21.15.78:6837","nonce":115607035}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":4},{"mdsmap":{"epoch":36,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-28T20:01:23.178057+0000","modified":"2023-11-28T20:01:26.193482+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5889},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5889":{"gid":5889,"name":"c","rank":0,"incarnation":32,"state":"up:active","state_seq":6,"addr":"172.21.15.78:6835/1997036463","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6834","nonce":1997036463},{"type":"v1","addr":"172.21.15.78:6835","nonce":1997036463}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs2","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":5}]} 2023-11-28T20:01:44.465 INFO:teuthology.orchestra.run.smithi078.stderr:dumped fsmap epoch 36 2023-11-28T20:01:44.466 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:44.461+0000 7fc8c1f80640 1 -- 172.21.15.78:0/2275442503 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fc8a8066470 msgr2=0x7fc8a8068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:01:44.466 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:44.461+0000 7fc8c1f80640 1 --2- 172.21.15.78:0/2275442503 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fc8a8066470 0x7fc8a8068930 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7fc8ac007fd0 tx=0x7fc8ac007e40 comp rx=0 tx=0).stop 2023-11-28T20:01:44.466 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:44.461+0000 7fc8c1f80640 1 -- 172.21.15.78:0/2275442503 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc8bc14e570 msgr2=0x7fc8bc151580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:01:44.466 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:44.461+0000 7fc8c1f80640 1 --2- 172.21.15.78:0/2275442503 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc8bc14e570 0x7fc8bc151580 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 crypto rx=0x7fc8b001c8e0 tx=0x7fc8b001ac40 comp rx=0 tx=0).stop 2023-11-28T20:01:44.467 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:44.461+0000 7fc8c1f80640 1 -- 172.21.15.78:0/2275442503 shutdown_connections 2023-11-28T20:01:44.467 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:44.461+0000 7fc8c1f80640 1 --2- 172.21.15.78:0/2275442503 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fc8a8066470 0x7fc8a8068930 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:44.467 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:44.461+0000 7fc8c1f80640 1 --2- 172.21.15.78:0/2275442503 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc8bc154fd0 0x7fc8bc1efd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:44.467 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:44.461+0000 7fc8c1f80640 1 --2- 172.21.15.78:0/2275442503 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc8bc14e570 0x7fc8bc151580 unknown :-1 s=CLOSED pgs=769 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:44.467 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:44.461+0000 7fc8c1f80640 1 --2- 172.21.15.78:0/2275442503 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc8bc0ca190 0x7fc8bc0aca30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:44.467 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:44.461+0000 7fc8c1f80640 1 -- 172.21.15.78:0/2275442503 >> 172.21.15.78:0/2275442503 conn(0x7fc8bc0abb10 msgr2=0x7fc8bc0c67c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:01:44.467 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:44.461+0000 7fc8c1f80640 1 -- 172.21.15.78:0/2275442503 shutdown_connections 2023-11-28T20:01:44.467 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:44.461+0000 7fc8c1f80640 1 -- 172.21.15.78:0/2275442503 wait complete. 2023-11-28T20:01:44.485 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-28T20:01:44.624 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:44.621+0000 7f1e595d8640 1 Processor -- start 2023-11-28T20:01:44.624 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:44.621+0000 7f1e595d8640 1 -- start start 2023-11-28T20:01:44.626 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:44.621+0000 7f1e595d8640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f1e54072850 0x7f1e540a6370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:44.626 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:44.621+0000 7f1e595d8640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1e5406b060 con 0x7f1e54154520 2023-11-28T20:01:44.626 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:44.621+0000 7f1e595d8640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1e5406b300 con 0x7f1e54151e80 2023-11-28T20:01:44.626 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:44.621+0000 7f1e595d8640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1e54070d30 con 0x7f1e54072850 2023-11-28T20:01:44.626 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:44.621+0000 7f1e4bfff640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f1e54072850 0x7f1e540a6370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:44.626 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:44.621+0000 7f1e4bfff640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f1e54072850 0x7f1e540a6370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:55630/0 (socket says 172.21.15.78:55630) 2023-11-28T20:01:44.626 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:44.621+0000 7f1e4bfff640 1 -- 172.21.15.78:0/825498839 learned_addr learned my addr 172.21.15.78:0/825498839 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T20:01:44.627 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:44.621+0000 7f1e4bfff640 1 -- 172.21.15.78:0/825498839 >> v1:172.21.15.179:6789/0 conn(0x7f1e54151e80 legacy=0x7f1e540c0010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:01:44.627 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:44.621+0000 7f1e4bfff640 1 -- 172.21.15.78:0/825498839 >> v1:172.21.15.78:6789/0 conn(0x7f1e54154520 legacy=0x7f1e541549d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:01:44.627 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:44.621+0000 7f1e4bfff640 1 -- 172.21.15.78:0/825498839 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e54070f40 con 0x7f1e54072850 2023-11-28T20:01:44.627 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:44.621+0000 7f1e527fc640 1 -- 172.21.15.78:0/825498839 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2553878497 0 0) 0x7f1e5406b060 con 0x7f1e54154520 2023-11-28T20:01:44.629 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:44.625+0000 7f1e4bfff640 1 --2- 172.21.15.78:0/825498839 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1e54072850 0x7f1e540a6370 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 crypto rx=0x7f1e3c009870 tx=0x7f1e3c01c540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=55e5b207de80ed05 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:01:44.629 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:44.625+0000 7f1e527fc640 1 -- 172.21.15.78:0/825498839 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e3c0ab600 con 0x7f1e54072850 2023-11-28T20:01:44.629 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:44.625+0000 7f1e527fc640 1 -- 172.21.15.78:0/825498839 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e3c0a7050 con 0x7f1e54072850 2023-11-28T20:01:44.629 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:44.625+0000 7f1e527fc640 1 -- 172.21.15.78:0/825498839 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e3c0ab980 con 0x7f1e54072850 2023-11-28T20:01:44.630 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:44.625+0000 7f1e595d8640 1 -- 172.21.15.78:0/825498839 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1e54072850 msgr2=0x7f1e540a6370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:01:44.630 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:44.625+0000 7f1e595d8640 1 --2- 172.21.15.78:0/825498839 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1e54072850 0x7f1e540a6370 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 crypto rx=0x7f1e3c009870 tx=0x7f1e3c01c540 comp rx=0 tx=0).stop 2023-11-28T20:01:44.630 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:44.625+0000 7f1e595d8640 1 -- 172.21.15.78:0/825498839 shutdown_connections 2023-11-28T20:01:44.630 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:44.625+0000 7f1e595d8640 1 --2- 172.21.15.78:0/825498839 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1e54072850 0x7f1e540a6370 unknown :-1 s=CLOSED pgs=771 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:44.630 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:44.625+0000 7f1e595d8640 1 -- 172.21.15.78:0/825498839 >> 172.21.15.78:0/825498839 conn(0x7f1e540a8990 msgr2=0x7f1e540a8da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:01:44.630 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:44.625+0000 7f1e595d8640 1 -- 172.21.15.78:0/825498839 shutdown_connections 2023-11-28T20:01:44.631 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:44.625+0000 7f1e595d8640 1 -- 172.21.15.78:0/825498839 wait complete. 2023-11-28T20:01:44.631 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:44.629+0000 7f1e595d8640 1 Processor -- start 2023-11-28T20:01:44.631 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:44.629+0000 7f1e595d8640 1 -- start start 2023-11-28T20:01:44.634 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:44.629+0000 7f1e595d8640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1e54072850 0x7f1e54148200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:44.634 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:44.629+0000 7f1e595d8640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1e54151e80 0x7f1e540ab410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:44.634 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:44.629+0000 7f1e595d8640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1e54154520 0x7f1e540ab950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:44.634 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:44.629+0000 7f1e595d8640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e541f0300 con 0x7f1e54154520 2023-11-28T20:01:44.634 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:44.629+0000 7f1e595d8640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e54143bc0 con 0x7f1e54151e80 2023-11-28T20:01:44.634 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:44.629+0000 7f1e595d8640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e541f04f0 con 0x7f1e54072850 2023-11-28T20:01:44.634 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:44.629+0000 7f1e537fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1e54154520 0x7f1e540ab950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:44.634 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:44.629+0000 7f1e537fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1e54154520 0x7f1e540ab950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:55632/0 (socket says 172.21.15.78:55632) 2023-11-28T20:01:44.635 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:44.629+0000 7f1e537fe640 1 -- 172.21.15.78:0/1986387181 learned_addr learned my addr 172.21.15.78:0/1986387181 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T20:01:44.635 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:44.629+0000 7f1e52ffd640 1 --2- 172.21.15.78:0/1986387181 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1e54072850 0x7f1e54148200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:44.635 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:44.629+0000 7f1e4bfff640 1 --2- 172.21.15.78:0/1986387181 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1e54151e80 0x7f1e540ab410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:44.635 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:44.629+0000 7f1e537fe640 1 -- 172.21.15.78:0/1986387181 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1e54072850 msgr2=0x7f1e54148200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:01:44.635 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:44.629+0000 7f1e537fe640 1 --2- 172.21.15.78:0/1986387181 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1e54072850 0x7f1e54148200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:44.635 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:44.629+0000 7f1e537fe640 1 -- 172.21.15.78:0/1986387181 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1e54151e80 msgr2=0x7f1e540ab410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:01:44.635 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:44.629+0000 7f1e537fe640 1 --2- 172.21.15.78:0/1986387181 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1e54151e80 0x7f1e540ab410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:44.635 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:44.629+0000 7f1e537fe640 1 -- 172.21.15.78:0/1986387181 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e3c0094d0 con 0x7f1e54154520 2023-11-28T20:01:44.636 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:44.629+0000 7f1e52ffd640 1 --2- 172.21.15.78:0/1986387181 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1e54072850 0x7f1e54148200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T20:01:44.636 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:44.629+0000 7f1e4bfff640 1 --2- 172.21.15.78:0/1986387181 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1e54151e80 0x7f1e540ab410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T20:01:44.636 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:44.629+0000 7f1e537fe640 1 --2- 172.21.15.78:0/1986387181 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1e54154520 0x7f1e540ab950 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 crypto rx=0x7f1e4c002240 tx=0x7f1e4c00cbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:01:44.636 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:44.629+0000 7f1e4b7fe640 1 -- 172.21.15.78:0/1986387181 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e4c003db0 con 0x7f1e54154520 2023-11-28T20:01:44.636 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:44.629+0000 7f1e4b7fe640 1 -- 172.21.15.78:0/1986387181 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e4c00ce30 con 0x7f1e54154520 2023-11-28T20:01:44.636 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:44.629+0000 7f1e595d8640 1 -- 172.21.15.78:0/1986387181 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1e54143e60 con 0x7f1e54154520 2023-11-28T20:01:44.636 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:44.629+0000 7f1e4b7fe640 1 -- 172.21.15.78:0/1986387181 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e4c005270 con 0x7f1e54154520 2023-11-28T20:01:44.636 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:44.629+0000 7f1e595d8640 1 -- 172.21.15.78:0/1986387181 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1e541f07d0 con 0x7f1e54154520 2023-11-28T20:01:44.637 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:44.629+0000 7f1e595d8640 1 -- 172.21.15.78:0/1986387181 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1e540ab130 con 0x7f1e54154520 2023-11-28T20:01:44.637 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:44.633+0000 7f1e4b7fe640 1 -- 172.21.15.78:0/1986387181 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f1e4c0053d0 con 0x7f1e54154520 2023-11-28T20:01:44.638 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:44.633+0000 7f1e4b7fe640 1 --2- 172.21.15.78:0/1986387181 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f1e34066470 0x7f1e34068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:44.638 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:44.633+0000 7f1e4b7fe640 1 -- 172.21.15.78:0/1986387181 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 6885+0+0 (secure 0 0 0) 0x7f1e4c0839d0 con 0x7f1e54154520 2023-11-28T20:01:44.638 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:44.633+0000 7f1e52ffd640 1 --2- 172.21.15.78:0/1986387181 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f1e34066470 0x7f1e34068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:44.638 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:44.633+0000 7f1e52ffd640 1 --2- 172.21.15.78:0/1986387181 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f1e34066470 0x7f1e34068930 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f1e5406f610 tx=0x7f1e44009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:01:44.641 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:44.637+0000 7f1e4b7fe640 1 -- 172.21.15.78:0/1986387181 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f1e540ab130 con 0x7f1e54154520 2023-11-28T20:01:44.791 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:44.785+0000 7f1e595d8640 1 -- 172.21.15.78:0/1986387181 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1e540ab130 con 0x7f1e54154520 2023-11-28T20:01:44.792 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:44.789+0000 7f1e4b7fe640 1 -- 172.21.15.78:0/1986387181 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v65) v1 ==== 74+0+20410 (secure 0 0 0) 0x7f1e540ab130 con 0x7f1e54154520 2023-11-28T20:01:44.792 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-11-28T20:01:44.793 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":65,"fsid":"dd9780e8-3bda-44fa-a9f0-fa07d19d901d","created":"2023-11-28T19:58:40.969556+0000","modified":"2023-11-28T20:01:24.807489+0000","last_up_change":"2023-11-28T19:58:52.596716+0000","last_in_change":"2023-11-28T19:58:43.609275+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":12,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-28T19:58:54.011229+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_metadata","create_time":"2023-11-28T20:01:07.969267+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"60","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_data","create_time":"2023-11-28T20:01:08.865465+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"61","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs2_metadata","create_time":"2023-11-28T20:01:20.863763+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"64","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs2_data","create_time":"2023-11-28T20:01:22.176918+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"65","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs2"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e84245ac-b5da-429e-af18-39acaa2b33e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6800","nonce":3358701235},{"type":"v1","addr":"172.21.15.78:6801","nonce":3358701235}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6802","nonce":3358701235},{"type":"v1","addr":"172.21.15.78:6803","nonce":3358701235}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6806","nonce":3358701235},{"type":"v1","addr":"172.21.15.78:6807","nonce":3358701235}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6804","nonce":3358701235},{"type":"v1","addr":"172.21.15.78:6805","nonce":3358701235}]},"public_addr":"172.21.15.78:6801/3358701235","cluster_addr":"172.21.15.78:6803/3358701235","heartbeat_back_addr":"172.21.15.78:6807/3358701235","heartbeat_front_addr":"172.21.15.78:6805/3358701235","state":["exists","up"]},{"osd":1,"uuid":"e634831d-c4e2-48d9-870c-9556ae162981","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6808","nonce":3211476654},{"type":"v1","addr":"172.21.15.78:6809","nonce":3211476654}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6810","nonce":3211476654},{"type":"v1","addr":"172.21.15.78:6811","nonce":3211476654}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6814","nonce":3211476654},{"type":"v1","addr":"172.21.15.78:6815","nonce":3211476654}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6812","nonce":3211476654},{"type":"v1","addr":"172.21.15.78:6813","nonce":3211476654}]},"public_addr":"172.21.15.78:6809/3211476654","cluster_addr":"172.21.15.78:6811/3211476654","heartbeat_back_addr":"172.21.15.78:6815/3211476654","heartbeat_front_addr":"172.21.15.78:6813/3211476654","state":["exists","up"]},{"osd":2,"uuid":"274c8395-6534-41f0-b8fb-a00af8985aa8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6816","nonce":2532904479},{"type":"v1","addr":"172.21.15.78:6817","nonce":2532904479}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6818","nonce":2532904479},{"type":"v1","addr":"172.21.15.78:6819","nonce":2532904479}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6822","nonce":2532904479},{"type":"v1","addr":"172.21.15.78:6823","nonce":2532904479}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6820","nonce":2532904479},{"type":"v1","addr":"172.21.15.78:6821","nonce":2532904479}]},"public_addr":"172.21.15.78:6817/2532904479","cluster_addr":"172.21.15.78:6819/2532904479","heartbeat_back_addr":"172.21.15.78:6823/2532904479","heartbeat_front_addr":"172.21.15.78:6821/2532904479","state":["exists","up"]},{"osd":3,"uuid":"77acc9af-7d4d-4b18-8cf5-d62f5971b7c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6824","nonce":3442991267},{"type":"v1","addr":"172.21.15.78:6825","nonce":3442991267}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6826","nonce":3442991267},{"type":"v1","addr":"172.21.15.78:6827","nonce":3442991267}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6830","nonce":3442991267},{"type":"v1","addr":"172.21.15.78:6831","nonce":3442991267}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6828","nonce":3442991267},{"type":"v1","addr":"172.21.15.78:6829","nonce":3442991267}]},"public_addr":"172.21.15.78:6825/3442991267","cluster_addr":"172.21.15.78:6827/3442991267","heartbeat_back_addr":"172.21.15.78:6831/3442991267","heartbeat_front_addr":"172.21.15.78:6829/3442991267","state":["exists","up"]},{"osd":4,"uuid":"5c62bc66-6b34-4b7f-a66b-9a743969138c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":802983577},{"type":"v1","addr":"172.21.15.179:6809","nonce":802983577}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":802983577},{"type":"v1","addr":"172.21.15.179:6811","nonce":802983577}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":802983577},{"type":"v1","addr":"172.21.15.179:6815","nonce":802983577}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":802983577},{"type":"v1","addr":"172.21.15.179:6813","nonce":802983577}]},"public_addr":"172.21.15.179:6809/802983577","cluster_addr":"172.21.15.179:6811/802983577","heartbeat_back_addr":"172.21.15.179:6815/802983577","heartbeat_front_addr":"172.21.15.179:6813/802983577","state":["exists","up"]},{"osd":5,"uuid":"67db6d36-f684-4079-b0cd-82b4dd61461f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":518192887},{"type":"v1","addr":"172.21.15.179:6818","nonce":518192887}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":518192887},{"type":"v1","addr":"172.21.15.179:6822","nonce":518192887}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":518192887},{"type":"v1","addr":"172.21.15.179:6829","nonce":518192887}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6824","nonce":518192887},{"type":"v1","addr":"172.21.15.179:6826","nonce":518192887}]},"public_addr":"172.21.15.179:6818/518192887","cluster_addr":"172.21.15.179:6822/518192887","heartbeat_back_addr":"172.21.15.179:6829/518192887","heartbeat_front_addr":"172.21.15.179:6826/518192887","state":["exists","up"]},{"osd":6,"uuid":"12e670af-5a16-4c81-9f97-defa66cab967","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":815435378},{"type":"v1","addr":"172.21.15.179:6801","nonce":815435378}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":815435378},{"type":"v1","addr":"172.21.15.179:6803","nonce":815435378}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":815435378},{"type":"v1","addr":"172.21.15.179:6807","nonce":815435378}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":815435378},{"type":"v1","addr":"172.21.15.179:6805","nonce":815435378}]},"public_addr":"172.21.15.179:6801/815435378","cluster_addr":"172.21.15.179:6803/815435378","heartbeat_back_addr":"172.21.15.179:6807/815435378","heartbeat_front_addr":"172.21.15.179:6805/815435378","state":["exists","up"]},{"osd":7,"uuid":"fe630650-2eb3-49ad-8676-c341e6332eb1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6817","nonce":2848432339},{"type":"v1","addr":"172.21.15.179:6819","nonce":2848432339}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6821","nonce":2848432339},{"type":"v1","addr":"172.21.15.179:6823","nonce":2848432339}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":2848432339},{"type":"v1","addr":"172.21.15.179:6831","nonce":2848432339}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6825","nonce":2848432339},{"type":"v1","addr":"172.21.15.179:6827","nonce":2848432339}]},"public_addr":"172.21.15.179:6819/2848432339","cluster_addr":"172.21.15.179:6823/2848432339","heartbeat_back_addr":"172.21.15.179:6831/2848432339","heartbeat_front_addr":"172.21.15.179:6827/2848432339","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:58:49.255433+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:58:49.412880+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:58:49.559295+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:58:49.245237+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:58:49.184557+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:58:49.329851+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:58:49.366012+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:58:49.349604+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-28T20:01:44.794 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:44.789+0000 7f1e595d8640 1 -- 172.21.15.78:0/1986387181 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f1e34066470 msgr2=0x7f1e34068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:01:44.795 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:44.789+0000 7f1e595d8640 1 --2- 172.21.15.78:0/1986387181 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f1e34066470 0x7f1e34068930 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f1e5406f610 tx=0x7f1e44009040 comp rx=0 tx=0).stop 2023-11-28T20:01:44.795 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:44.789+0000 7f1e595d8640 1 -- 172.21.15.78:0/1986387181 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1e54154520 msgr2=0x7f1e540ab950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:01:44.795 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:44.789+0000 7f1e595d8640 1 --2- 172.21.15.78:0/1986387181 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1e54154520 0x7f1e540ab950 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 crypto rx=0x7f1e4c002240 tx=0x7f1e4c00cbe0 comp rx=0 tx=0).stop 2023-11-28T20:01:44.795 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:44.789+0000 7f1e595d8640 1 -- 172.21.15.78:0/1986387181 shutdown_connections 2023-11-28T20:01:44.795 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:44.789+0000 7f1e595d8640 1 --2- 172.21.15.78:0/1986387181 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f1e34066470 0x7f1e34068930 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:44.795 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:44.789+0000 7f1e595d8640 1 --2- 172.21.15.78:0/1986387181 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1e54154520 0x7f1e540ab950 unknown :-1 s=CLOSED pgs=772 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:44.796 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:44.789+0000 7f1e595d8640 1 --2- 172.21.15.78:0/1986387181 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1e54151e80 0x7f1e540ab410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:44.796 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:44.789+0000 7f1e595d8640 1 --2- 172.21.15.78:0/1986387181 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1e54072850 0x7f1e54148200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:44.796 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:44.789+0000 7f1e595d8640 1 -- 172.21.15.78:0/1986387181 >> 172.21.15.78:0/1986387181 conn(0x7f1e540a8990 msgr2=0x7f1e540a8d70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:01:44.796 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:44.789+0000 7f1e595d8640 1 -- 172.21.15.78:0/1986387181 shutdown_connections 2023-11-28T20:01:44.796 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:44.789+0000 7f1e595d8640 1 -- 172.21.15.78:0/1986387181 wait complete. 2023-11-28T20:01:44.814 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-28T19:58:54.011229+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 9, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-28T20:01:07.969267+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '60', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 10, 'pool_name': 'cephfs_data', 'create_time': '2023-11-28T20:01:08.865465+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '61', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 11, 'pool_name': 'cephfs2_metadata', 'create_time': '2023-11-28T20:01:20.863763+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '64', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs2'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 12, 'pool_name': 'cephfs2_data', 'create_time': '2023-11-28T20:01:22.176918+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '65', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs2'}}, 'read_balance': {'score_acting': 1.6299999952316284, 'score_stable': 1.6299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.6299999952316284, 'raw_score_stable': 1.6299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-28T20:01:44.815 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-28T20:01:44.954 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:44.949+0000 7f856e1d0640 1 Processor -- start 2023-11-28T20:01:44.955 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:44.949+0000 7f856e1d0640 1 -- start start 2023-11-28T20:01:44.956 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:44.953+0000 7f856e1d0640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f856814e8e0 0x7f8568154f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:44.956 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:44.953+0000 7f856e1d0640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f85680a53c0 con 0x7f85680c5160 2023-11-28T20:01:44.956 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:44.953+0000 7f856e1d0640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f856814ecc0 con 0x7f85680c0250 2023-11-28T20:01:44.956 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:44.953+0000 7f856e1d0640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f85680a9140 con 0x7f856814e8e0 2023-11-28T20:01:44.956 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:44.953+0000 7f856d9cf640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f85680c5160 0x7f856806d140 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:39522/0 (socket says 172.21.15.78:39522) 2023-11-28T20:01:44.956 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:44.953+0000 7f856d9cf640 1 -- 172.21.15.78:0/1412710983 learned_addr learned my addr 172.21.15.78:0/1412710983 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-11-28T20:01:44.956 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:44.953+0000 7f856d1ce640 1 --2- 172.21.15.78:0/1412710983 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f856814e8e0 0x7f8568154f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:44.957 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:44.953+0000 7f855ffff640 1 -- 172.21.15.78:0/1412710983 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1379877932 0 0) 0x7f85680a53c0 con 0x7f85680c5160 2023-11-28T20:01:44.957 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:44.953+0000 7f855ffff640 1 -- 172.21.15.78:0/1412710983 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8554003530 con 0x7f85680c5160 2023-11-28T20:01:44.958 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:44.953+0000 7f855ffff640 1 -- 172.21.15.78:0/1412710983 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3524511880 0 0) 0x7f856814ecc0 con 0x7f85680c0250 2023-11-28T20:01:44.958 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:44.953+0000 7f855ffff640 1 -- 172.21.15.78:0/1412710983 --> v1:172.21.15.179:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f85680a53c0 con 0x7f85680c0250 2023-11-28T20:01:44.958 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:44.953+0000 7f856d1ce640 1 -- 172.21.15.78:0/1412710983 >> v1:172.21.15.179:6789/0 conn(0x7f85680c0250 legacy=0x7f856806c670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:01:44.958 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:44.953+0000 7f856d1ce640 1 -- 172.21.15.78:0/1412710983 >> v1:172.21.15.78:6789/0 conn(0x7f85680c5160 legacy=0x7f856806d140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:01:44.958 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:44.953+0000 7f856d1ce640 1 -- 172.21.15.78:0/1412710983 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85680a4e20 con 0x7f856814e8e0 2023-11-28T20:01:44.959 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:44.957+0000 7f856d1ce640 1 --2- 172.21.15.78:0/1412710983 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f856814e8e0 0x7f8568154f80 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f85640097f0 tx=0x7f856401c370 comp rx=0 tx=0).ready entity=mon.2 client_cookie=346d5f151f45f425 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:01:44.960 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:44.957+0000 7f855ffff640 1 -- 172.21.15.78:0/1412710983 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85640ab600 con 0x7f856814e8e0 2023-11-28T20:01:44.960 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:44.957+0000 7f855ffff640 1 -- 172.21.15.78:0/1412710983 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f85640a7050 con 0x7f856814e8e0 2023-11-28T20:01:44.960 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:44.957+0000 7f855ffff640 1 -- 172.21.15.78:0/1412710983 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85640ab960 con 0x7f856814e8e0 2023-11-28T20:01:44.961 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:44.957+0000 7f856e1d0640 1 -- 172.21.15.78:0/1412710983 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f856814e8e0 msgr2=0x7f8568154f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:01:44.961 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:44.957+0000 7f856e1d0640 1 --2- 172.21.15.78:0/1412710983 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f856814e8e0 0x7f8568154f80 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f85640097f0 tx=0x7f856401c370 comp rx=0 tx=0).stop 2023-11-28T20:01:44.961 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:44.957+0000 7f856e1d0640 1 -- 172.21.15.78:0/1412710983 shutdown_connections 2023-11-28T20:01:44.961 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:44.957+0000 7f856e1d0640 1 --2- 172.21.15.78:0/1412710983 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f856814e8e0 0x7f8568154f80 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:44.961 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:44.957+0000 7f856e1d0640 1 -- 172.21.15.78:0/1412710983 >> 172.21.15.78:0/1412710983 conn(0x7f85680c2350 msgr2=0x7f85680c2760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:01:44.961 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:44.957+0000 7f856e1d0640 1 -- 172.21.15.78:0/1412710983 shutdown_connections 2023-11-28T20:01:44.961 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:44.957+0000 7f856e1d0640 1 -- 172.21.15.78:0/1412710983 wait complete. 2023-11-28T20:01:44.962 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:44.957+0000 7f856e1d0640 1 Processor -- start 2023-11-28T20:01:44.962 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:44.957+0000 7f856e1d0640 1 -- start start 2023-11-28T20:01:44.964 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:44.961+0000 7f856e1d0640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f85680c0250 0x7f8568071e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:44.964 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:44.961+0000 7f856e1d0640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f85680c5160 0x7f8568150840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:44.964 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:44.961+0000 7f856e1d0640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f856814e8e0 0x7f8568150d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:44.964 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:44.961+0000 7f856e1d0640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85681556d0 con 0x7f85680c5160 2023-11-28T20:01:44.964 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:44.961+0000 7f856e1d0640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85681512c0 con 0x7f85680c0250 2023-11-28T20:01:44.964 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:44.961+0000 7f856e1d0640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8568155920 con 0x7f856814e8e0 2023-11-28T20:01:44.964 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:44.961+0000 7f856c9cd640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f85680c5160 0x7f8568150840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:44.965 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:44.961+0000 7f856c9cd640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f85680c5160 0x7f8568150840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:55638/0 (socket says 172.21.15.78:55638) 2023-11-28T20:01:44.965 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:44.961+0000 7f856c9cd640 1 -- 172.21.15.78:0/4079580265 learned_addr learned my addr 172.21.15.78:0/4079580265 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T20:01:44.965 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:44.961+0000 7f856d1ce640 1 --2- 172.21.15.78:0/4079580265 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f85680c0250 0x7f8568071e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:44.965 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:44.961+0000 7f856d9cf640 1 --2- 172.21.15.78:0/4079580265 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f856814e8e0 0x7f8568150d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:44.965 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:44.961+0000 7f856c9cd640 1 -- 172.21.15.78:0/4079580265 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f856814e8e0 msgr2=0x7f8568150d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:01:44.965 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:44.961+0000 7f856c9cd640 1 --2- 172.21.15.78:0/4079580265 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f856814e8e0 0x7f8568150d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:44.965 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:44.961+0000 7f856c9cd640 1 -- 172.21.15.78:0/4079580265 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f85680c0250 msgr2=0x7f8568071e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:01:44.965 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:44.961+0000 7f856c9cd640 1 --2- 172.21.15.78:0/4079580265 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f85680c0250 0x7f8568071e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:44.965 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:44.961+0000 7f856c9cd640 1 -- 172.21.15.78:0/4079580265 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8564009420 con 0x7f85680c5160 2023-11-28T20:01:44.965 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:44.961+0000 7f856d9cf640 1 --2- 172.21.15.78:0/4079580265 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f856814e8e0 0x7f8568150d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T20:01:44.965 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:44.961+0000 7f856c9cd640 1 --2- 172.21.15.78:0/4079580265 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f85680c5160 0x7f8568150840 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 crypto rx=0x7f855800c3c0 tx=0x7f855800c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:01:44.966 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:44.961+0000 7f855dffb640 1 -- 172.21.15.78:0/4079580265 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85580052d0 con 0x7f85680c5160 2023-11-28T20:01:44.966 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:44.961+0000 7f855dffb640 1 -- 172.21.15.78:0/4079580265 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8558005430 con 0x7f85680c5160 2023-11-28T20:01:44.967 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:44.961+0000 7f856e1d0640 1 -- 172.21.15.78:0/4079580265 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f856814f930 con 0x7f85680c5160 2023-11-28T20:01:44.967 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:44.961+0000 7f855dffb640 1 -- 172.21.15.78:0/4079580265 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8558003840 con 0x7f85680c5160 2023-11-28T20:01:44.967 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:44.961+0000 7f856e1d0640 1 -- 172.21.15.78:0/4079580265 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8568150130 con 0x7f85680c5160 2023-11-28T20:01:44.967 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:44.961+0000 7f856e1d0640 1 -- 172.21.15.78:0/4079580265 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f85680674b0 con 0x7f85680c5160 2023-11-28T20:01:44.967 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:44.961+0000 7f855dffb640 1 -- 172.21.15.78:0/4079580265 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f85580039a0 con 0x7f85680c5160 2023-11-28T20:01:44.967 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:44.965+0000 7f855dffb640 1 --2- 172.21.15.78:0/4079580265 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f854c066470 0x7f854c068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:44.968 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:44.965+0000 7f855dffb640 1 -- 172.21.15.78:0/4079580265 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 6885+0+0 (secure 0 0 0) 0x7f85580837a0 con 0x7f85680c5160 2023-11-28T20:01:44.968 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:44.965+0000 7f856d1ce640 1 --2- 172.21.15.78:0/4079580265 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f854c066470 0x7f854c068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:44.968 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:44.965+0000 7f856d1ce640 1 --2- 172.21.15.78:0/4079580265 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f854c066470 0x7f854c068930 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f85640ad000 tx=0x7f85640a6000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:01:44.972 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:44.969+0000 7f855dffb640 1 -- 172.21.15.78:0/4079580265 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f8558050830 con 0x7f85680c5160 2023-11-28T20:01:45.128 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:45.125+0000 7f856e1d0640 1 -- 172.21.15.78:0/4079580265 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f856815c740 con 0x7f85680c5160 2023-11-28T20:01:45.129 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:45.125+0000 7f855dffb640 1 -- 172.21.15.78:0/4079580265 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v65) v1 ==== 93+0+10 (secure 0 0 0) 0x7f8558053e50 con 0x7f85680c5160 2023-11-28T20:01:45.130 INFO:teuthology.orchestra.run.smithi078.stdout:pg_num: 1 2023-11-28T20:01:45.131 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:45.125+0000 7f856e1d0640 1 -- 172.21.15.78:0/4079580265 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f854c066470 msgr2=0x7f854c068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:01:45.132 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:45.125+0000 7f856e1d0640 1 --2- 172.21.15.78:0/4079580265 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f854c066470 0x7f854c068930 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f85640ad000 tx=0x7f85640a6000 comp rx=0 tx=0).stop 2023-11-28T20:01:45.132 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:45.125+0000 7f856e1d0640 1 -- 172.21.15.78:0/4079580265 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f85680c5160 msgr2=0x7f8568150840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:01:45.132 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:45.125+0000 7f856e1d0640 1 --2- 172.21.15.78:0/4079580265 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f85680c5160 0x7f8568150840 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 crypto rx=0x7f855800c3c0 tx=0x7f855800c880 comp rx=0 tx=0).stop 2023-11-28T20:01:45.132 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:45.125+0000 7f856e1d0640 1 -- 172.21.15.78:0/4079580265 shutdown_connections 2023-11-28T20:01:45.133 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:45.125+0000 7f856e1d0640 1 --2- 172.21.15.78:0/4079580265 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f854c066470 0x7f854c068930 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:45.133 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:45.125+0000 7f856e1d0640 1 --2- 172.21.15.78:0/4079580265 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f856814e8e0 0x7f8568150d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:45.133 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:45.125+0000 7f856e1d0640 1 --2- 172.21.15.78:0/4079580265 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f85680c5160 0x7f8568150840 unknown :-1 s=CLOSED pgs=774 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:45.133 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:45.125+0000 7f856e1d0640 1 --2- 172.21.15.78:0/4079580265 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f85680c0250 0x7f8568071e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:45.133 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:45.125+0000 7f856e1d0640 1 -- 172.21.15.78:0/4079580265 >> 172.21.15.78:0/4079580265 conn(0x7f85680c2350 msgr2=0x7f856806c670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:01:45.133 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:45.125+0000 7f856e1d0640 1 -- 172.21.15.78:0/4079580265 shutdown_connections 2023-11-28T20:01:45.134 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:45.125+0000 7f856e1d0640 1 -- 172.21.15.78:0/4079580265 wait complete. 2023-11-28T20:01:45.149 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-28T20:01:45.290 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:45.285+0000 7f2e679e6640 1 Processor -- start 2023-11-28T20:01:45.290 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:45.285+0000 7f2e679e6640 1 -- start start 2023-11-28T20:01:45.293 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:45.285+0000 7f2e679e6640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f2e6014b1e0 0x7f2e600c1700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:45.293 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:45.285+0000 7f2e679e6640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2e600c5300 0x7f2e600a9c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:45.293 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:45.285+0000 7f2e679e6640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2e600a4e20 con 0x7f2e60151280 2023-11-28T20:01:45.294 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:45.285+0000 7f2e679e6640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2e601558d0 con 0x7f2e6014b1e0 2023-11-28T20:01:45.294 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:45.285+0000 7f2e679e6640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e600a50e0 con 0x7f2e600c5300 2023-11-28T20:01:45.294 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:45.289+0000 7f2e65782640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f2e6014b1e0 0x7f2e600c1700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:45.295 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:45.289+0000 7f2e65f83640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f2e60151280 0x7f2e60151710 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:52952/0 (socket says 172.21.15.78:52952) 2023-11-28T20:01:45.295 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:45.289+0000 7f2e65782640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f2e6014b1e0 0x7f2e600c1700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:60162/0 (socket says 172.21.15.78:60162) 2023-11-28T20:01:45.295 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:45.289+0000 7f2e65f83640 1 -- 172.21.15.78:0/1909665618 learned_addr learned my addr 172.21.15.78:0/1909665618 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-11-28T20:01:45.295 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:45.289+0000 7f2e65782640 1 -- 172.21.15.78:0/1909665618 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2e600c5300 msgr2=0x7f2e600a9c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:01:45.295 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:45.289+0000 7f2e64f81640 1 --2- 172.21.15.78:0/1909665618 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2e600c5300 0x7f2e600a9c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:45.295 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:45.289+0000 7f2e65782640 1 --2- 172.21.15.78:0/1909665618 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2e600c5300 0x7f2e600a9c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:45.295 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:45.289+0000 7f2e65782640 1 -- 172.21.15.78:0/1909665618 >> v1:172.21.15.78:6789/0 conn(0x7f2e60151280 legacy=0x7f2e60151710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:01:45.295 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:45.289+0000 7f2e65782640 1 -- 172.21.15.78:0/1909665618 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e600c0f00 con 0x7f2e6014b1e0 2023-11-28T20:01:45.295 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:45.289+0000 7f2e57fff640 1 -- 172.21.15.78:0/1909665618 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3487891738 0 0) 0x7f2e600a4e20 con 0x7f2e60151280 2023-11-28T20:01:45.295 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:45.289+0000 7f2e64f81640 1 --2- 172.21.15.78:0/1909665618 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2e600c5300 0x7f2e600a9c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T20:01:45.296 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:45.289+0000 7f2e65782640 1 --2- 172.21.15.78:0/1909665618 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2e6014b1e0 0x7f2e600c1700 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 crypto rx=0x7f2e5c0097c0 tx=0x7f2e5c01c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=752269cff819c685 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:01:45.297 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:45.289+0000 7f2e57fff640 1 -- 172.21.15.78:0/1909665618 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e5c0ad640 con 0x7f2e6014b1e0 2023-11-28T20:01:45.297 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:45.289+0000 7f2e57fff640 1 -- 172.21.15.78:0/1909665618 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e5c0ad7a0 con 0x7f2e6014b1e0 2023-11-28T20:01:45.297 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:45.289+0000 7f2e57fff640 1 -- 172.21.15.78:0/1909665618 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e5c0adb30 con 0x7f2e6014b1e0 2023-11-28T20:01:45.297 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:45.293+0000 7f2e679e6640 1 -- 172.21.15.78:0/1909665618 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2e6014b1e0 msgr2=0x7f2e600c1700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:01:45.297 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:45.293+0000 7f2e679e6640 1 --2- 172.21.15.78:0/1909665618 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2e6014b1e0 0x7f2e600c1700 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 crypto rx=0x7f2e5c0097c0 tx=0x7f2e5c01c480 comp rx=0 tx=0).stop 2023-11-28T20:01:45.297 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:45.293+0000 7f2e679e6640 1 -- 172.21.15.78:0/1909665618 shutdown_connections 2023-11-28T20:01:45.297 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:45.293+0000 7f2e679e6640 1 --2- 172.21.15.78:0/1909665618 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2e600c5300 0x7f2e600a9c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:45.297 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:45.293+0000 7f2e679e6640 1 --2- 172.21.15.78:0/1909665618 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2e6014b1e0 0x7f2e600c1700 unknown :-1 s=CLOSED pgs=776 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:45.297 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:45.293+0000 7f2e679e6640 1 -- 172.21.15.78:0/1909665618 >> 172.21.15.78:0/1909665618 conn(0x7f2e600c59f0 msgr2=0x7f2e600c5e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:01:45.297 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:45.293+0000 7f2e679e6640 1 -- 172.21.15.78:0/1909665618 shutdown_connections 2023-11-28T20:01:45.297 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:45.293+0000 7f2e679e6640 1 -- 172.21.15.78:0/1909665618 wait complete. 2023-11-28T20:01:45.299 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:45.293+0000 7f2e679e6640 1 Processor -- start 2023-11-28T20:01:45.299 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:45.293+0000 7f2e679e6640 1 -- start start 2023-11-28T20:01:45.299 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:45.293+0000 7f2e679e6640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2e600c5300 0x7f2e601f01c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:45.299 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:45.293+0000 7f2e679e6640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2e6014b1e0 0x7f2e6013faa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:45.299 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:45.293+0000 7f2e679e6640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2e60151280 0x7f2e6013ffe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:45.299 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:45.293+0000 7f2e679e6640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e601496b0 con 0x7f2e60151280 2023-11-28T20:01:45.299 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:45.293+0000 7f2e679e6640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e601477f0 con 0x7f2e600c5300 2023-11-28T20:01:45.299 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:45.293+0000 7f2e679e6640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e601f0a10 con 0x7f2e6014b1e0 2023-11-28T20:01:45.299 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:45.293+0000 7f2e65f83640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2e60151280 0x7f2e6013ffe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:45.299 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:45.293+0000 7f2e65f83640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2e60151280 0x7f2e6013ffe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:60176/0 (socket says 172.21.15.78:60176) 2023-11-28T20:01:45.299 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:45.293+0000 7f2e65f83640 1 -- 172.21.15.78:0/3473186253 learned_addr learned my addr 172.21.15.78:0/3473186253 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T20:01:45.299 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:45.293+0000 7f2e64f81640 1 --2- 172.21.15.78:0/3473186253 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2e6014b1e0 0x7f2e6013faa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:45.300 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:45.293+0000 7f2e65782640 1 --2- 172.21.15.78:0/3473186253 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2e600c5300 0x7f2e601f01c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:45.301 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:45.297+0000 7f2e65f83640 1 -- 172.21.15.78:0/3473186253 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2e6014b1e0 msgr2=0x7f2e6013faa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:01:45.301 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:45.297+0000 7f2e65f83640 1 --2- 172.21.15.78:0/3473186253 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2e6014b1e0 0x7f2e6013faa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:45.301 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:45.297+0000 7f2e65f83640 1 -- 172.21.15.78:0/3473186253 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2e600c5300 msgr2=0x7f2e601f01c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:01:45.301 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:45.297+0000 7f2e65f83640 1 --2- 172.21.15.78:0/3473186253 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2e600c5300 0x7f2e601f01c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:45.301 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:45.297+0000 7f2e65f83640 1 -- 172.21.15.78:0/3473186253 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e5c009420 con 0x7f2e60151280 2023-11-28T20:01:45.301 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:45.297+0000 7f2e65f83640 1 --2- 172.21.15.78:0/3473186253 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2e60151280 0x7f2e6013ffe0 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 crypto rx=0x7f2e5800caf0 tx=0x7f2e580021d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:01:45.301 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:45.297+0000 7f2e55ffb640 1 -- 172.21.15.78:0/3473186253 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e5800ac00 con 0x7f2e60151280 2023-11-28T20:01:45.301 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:45.297+0000 7f2e55ffb640 1 -- 172.21.15.78:0/3473186253 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e5800ad60 con 0x7f2e60151280 2023-11-28T20:01:45.301 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:45.297+0000 7f2e55ffb640 1 -- 172.21.15.78:0/3473186253 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e58012640 con 0x7f2e60151280 2023-11-28T20:01:45.301 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:45.297+0000 7f2e679e6640 1 -- 172.21.15.78:0/3473186253 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2e60140520 con 0x7f2e60151280 2023-11-28T20:01:45.301 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:45.297+0000 7f2e679e6640 1 -- 172.21.15.78:0/3473186253 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2e601f0700 con 0x7f2e60151280 2023-11-28T20:01:45.301 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:45.297+0000 7f2e679e6640 1 -- 172.21.15.78:0/3473186253 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2e60067630 con 0x7f2e60151280 2023-11-28T20:01:45.302 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:45.297+0000 7f2e55ffb640 1 -- 172.21.15.78:0/3473186253 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f2e580127a0 con 0x7f2e60151280 2023-11-28T20:01:45.302 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:45.297+0000 7f2e55ffb640 1 --2- 172.21.15.78:0/3473186253 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f2e44066470 0x7f2e44068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:45.303 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:45.297+0000 7f2e55ffb640 1 -- 172.21.15.78:0/3473186253 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 6885+0+0 (secure 0 0 0) 0x7f2e58084860 con 0x7f2e60151280 2023-11-28T20:01:45.303 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:45.297+0000 7f2e65782640 1 --2- 172.21.15.78:0/3473186253 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f2e44066470 0x7f2e44068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:45.303 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:45.301+0000 7f2e65782640 1 --2- 172.21.15.78:0/3473186253 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f2e44066470 0x7f2e44068930 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f2e5c0af000 tx=0x7f2e5c0a7070 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:01:45.308 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:45.301+0000 7f2e55ffb640 1 -- 172.21.15.78:0/3473186253 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f2e58051830 con 0x7f2e60151280 2023-11-28T20:01:45.457 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:45.453+0000 7f2e679e6640 1 -- 172.21.15.78:0/3473186253 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f2e60067c60 con 0x7f2e60151280 2023-11-28T20:01:45.457 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:45.453+0000 7f2e55ffb640 1 -- 172.21.15.78:0/3473186253 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v65) v1 ==== 104+0+11 (secure 0 0 0) 0x7f2e58054e50 con 0x7f2e60151280 2023-11-28T20:01:45.457 INFO:teuthology.orchestra.run.smithi078.stdout:pg_num: 32 2023-11-28T20:01:45.459 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:45.453+0000 7f2e679e6640 1 -- 172.21.15.78:0/3473186253 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f2e44066470 msgr2=0x7f2e44068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:01:45.461 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:45.453+0000 7f2e679e6640 1 --2- 172.21.15.78:0/3473186253 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f2e44066470 0x7f2e44068930 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f2e5c0af000 tx=0x7f2e5c0a7070 comp rx=0 tx=0).stop 2023-11-28T20:01:45.461 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:45.453+0000 7f2e679e6640 1 -- 172.21.15.78:0/3473186253 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2e60151280 msgr2=0x7f2e6013ffe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:01:45.461 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:45.453+0000 7f2e679e6640 1 --2- 172.21.15.78:0/3473186253 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2e60151280 0x7f2e6013ffe0 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 crypto rx=0x7f2e5800caf0 tx=0x7f2e580021d0 comp rx=0 tx=0).stop 2023-11-28T20:01:45.461 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:45.453+0000 7f2e679e6640 1 -- 172.21.15.78:0/3473186253 shutdown_connections 2023-11-28T20:01:45.461 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:45.453+0000 7f2e679e6640 1 --2- 172.21.15.78:0/3473186253 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f2e44066470 0x7f2e44068930 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:45.461 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:45.453+0000 7f2e679e6640 1 --2- 172.21.15.78:0/3473186253 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2e6014b1e0 0x7f2e6013faa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:45.461 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:45.453+0000 7f2e679e6640 1 --2- 172.21.15.78:0/3473186253 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2e60151280 0x7f2e6013ffe0 unknown :-1 s=CLOSED pgs=777 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:45.461 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:45.453+0000 7f2e679e6640 1 --2- 172.21.15.78:0/3473186253 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2e600c5300 0x7f2e601f01c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:45.462 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:45.453+0000 7f2e679e6640 1 -- 172.21.15.78:0/3473186253 >> 172.21.15.78:0/3473186253 conn(0x7f2e600c59f0 msgr2=0x7f2e600bed60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:01:45.462 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:45.453+0000 7f2e679e6640 1 -- 172.21.15.78:0/3473186253 shutdown_connections 2023-11-28T20:01:45.462 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:45.453+0000 7f2e679e6640 1 -- 172.21.15.78:0/3473186253 wait complete. 2023-11-28T20:01:45.478 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-28T20:01:45.619 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:45.613+0000 7fc4d59e6640 1 Processor -- start 2023-11-28T20:01:45.619 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:45.613+0000 7fc4d59e6640 1 -- start start 2023-11-28T20:01:45.620 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:45.617+0000 7fc4d59e6640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fc4d00af550 0x7fc4d0154f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:45.620 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:45.617+0000 7fc4d59e6640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc4d00c67a0 con 0x7fc4d00c4710 2023-11-28T20:01:45.620 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:45.617+0000 7fc4d59e6640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc4d00c69f0 con 0x7fc4d0158760 2023-11-28T20:01:45.620 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:45.617+0000 7fc4d59e6640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc4d00af930 con 0x7fc4d00af550 2023-11-28T20:01:45.620 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:45.617+0000 7fc4c7fff640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7fc4d00c4710 0x7fc4d0158050 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:52966/0 (socket says 172.21.15.78:52966) 2023-11-28T20:01:45.620 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:45.617+0000 7fc4c7fff640 1 -- 172.21.15.78:0/2061785570 learned_addr learned my addr 172.21.15.78:0/2061785570 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-11-28T20:01:45.622 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:45.617+0000 7fc4ceffd640 1 --2- 172.21.15.78:0/2061785570 >> v2:172.21.15.179:3300/0 conn(0x7fc4d00af550 0x7fc4d0154f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:45.622 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:45.617+0000 7fc4ce7fc640 1 -- 172.21.15.78:0/2061785570 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3124090492 0 0) 0x7fc4d00c67a0 con 0x7fc4d00c4710 2023-11-28T20:01:45.623 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:45.617+0000 7fc4ce7fc640 1 -- 172.21.15.78:0/2061785570 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc4bc003530 con 0x7fc4d00c4710 2023-11-28T20:01:45.623 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:45.617+0000 7fc4ce7fc640 1 -- 172.21.15.78:0/2061785570 <== mon.0 v1:172.21.15.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1184130241 0 0) 0x7fc4bc003530 con 0x7fc4d00c4710 2023-11-28T20:01:45.623 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:45.617+0000 7fc4ce7fc640 1 -- 172.21.15.78:0/2061785570 >> v2:172.21.15.179:3300/0 conn(0x7fc4d00af550 msgr2=0x7fc4d0154f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:01:45.623 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:45.617+0000 7fc4ce7fc640 1 --2- 172.21.15.78:0/2061785570 >> v2:172.21.15.179:3300/0 conn(0x7fc4d00af550 0x7fc4d0154f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:45.623 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:45.617+0000 7fc4ce7fc640 1 -- 172.21.15.78:0/2061785570 >> v1:172.21.15.179:6789/0 conn(0x7fc4d0158760 legacy=0x7fc4d015ee20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:01:45.623 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:45.617+0000 7fc4ce7fc640 1 -- 172.21.15.78:0/2061785570 --> v1:172.21.15.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4d00c6cd0 con 0x7fc4d00c4710 2023-11-28T20:01:45.623 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:45.617+0000 7fc4ce7fc640 1 -- 172.21.15.78:0/2061785570 <== mon.0 v1:172.21.15.78:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3326804700 0 0) 0x7fc4b8001680 con 0x7fc4d00c4710 2023-11-28T20:01:45.623 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:45.617+0000 7fc4ce7fc640 1 -- 172.21.15.78:0/2061785570 >> v1:172.21.15.78:6789/0 conn(0x7fc4d00c4710 legacy=0x7fc4d0158050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:01:45.623 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:45.617+0000 7fc4ce7fc640 1 --2- 172.21.15.78:0/2061785570 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc4bc003980 0x7fc4bc003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:45.623 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:45.617+0000 7fc4ce7fc640 1 --2- 172.21.15.78:0/2061785570 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc4bc0047d0 0x7fc4bc004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:45.623 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:45.617+0000 7fc4ce7fc640 1 --2- 172.21.15.78:0/2061785570 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc4bc0052b0 0x7fc4bc00b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:45.623 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:45.617+0000 7fc4ce7fc640 1 -- 172.21.15.78:0/2061785570 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4d00af930 con 0x7fc4bc003980 2023-11-28T20:01:45.624 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:45.617+0000 7fc4ce7fc640 1 -- 172.21.15.78:0/2061785570 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4bc00c180 con 0x7fc4bc0052b0 2023-11-28T20:01:45.624 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:45.617+0000 7fc4ce7fc640 1 -- 172.21.15.78:0/2061785570 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc4bc00c340 con 0x7fc4bc0047d0 2023-11-28T20:01:45.624 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:45.617+0000 7fc4ceffd640 1 --2- 172.21.15.78:0/2061785570 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc4bc003980 0x7fc4bc003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:45.624 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:45.617+0000 7fc4c7fff640 1 --2- 172.21.15.78:0/2061785570 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc4bc0047d0 0x7fc4bc004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:45.624 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:45.617+0000 7fc4cf7fe640 1 --2- 172.21.15.78:0/2061785570 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc4bc0052b0 0x7fc4bc00b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:45.624 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:45.617+0000 7fc4ceffd640 1 -- 172.21.15.78:0/2061785570 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc4bc0047d0 msgr2=0x7fc4bc004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:01:45.624 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:45.617+0000 7fc4ceffd640 1 --2- 172.21.15.78:0/2061785570 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc4bc0047d0 0x7fc4bc004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:45.624 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:45.617+0000 7fc4ceffd640 1 -- 172.21.15.78:0/2061785570 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc4bc0052b0 msgr2=0x7fc4bc00b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:01:45.624 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:45.617+0000 7fc4ceffd640 1 --2- 172.21.15.78:0/2061785570 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc4bc0052b0 0x7fc4bc00b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:45.624 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:45.617+0000 7fc4ceffd640 1 -- 172.21.15.78:0/2061785570 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4bc003530 con 0x7fc4bc003980 2023-11-28T20:01:45.624 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:45.617+0000 7fc4cf7fe640 1 --2- 172.21.15.78:0/2061785570 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc4bc0052b0 0x7fc4bc00b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T20:01:45.624 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:45.617+0000 7fc4cf7fe640 1 -- 172.21.15.78:0/2061785570 reap_dead start 2023-11-28T20:01:45.626 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:45.621+0000 7fc4ceffd640 1 --2- 172.21.15.78:0/2061785570 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc4bc003980 0x7fc4bc003da0 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 crypto rx=0x7fc4c0009ab0 tx=0x7fc4c001ca30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d219b8f8651a0955 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:01:45.626 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:45.621+0000 7fc4ce7fc640 1 -- 172.21.15.78:0/2061785570 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4c00a6410 con 0x7fc4bc003980 2023-11-28T20:01:45.626 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:45.621+0000 7fc4ce7fc640 1 -- 172.21.15.78:0/2061785570 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc4c00a6570 con 0x7fc4bc003980 2023-11-28T20:01:45.626 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:45.621+0000 7fc4ce7fc640 1 -- 172.21.15.78:0/2061785570 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4c00a6920 con 0x7fc4bc003980 2023-11-28T20:01:45.626 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:45.621+0000 7fc4d59e6640 1 -- 172.21.15.78:0/2061785570 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc4bc003980 msgr2=0x7fc4bc003da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:01:45.626 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:45.621+0000 7fc4d59e6640 1 --2- 172.21.15.78:0/2061785570 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc4bc003980 0x7fc4bc003da0 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 crypto rx=0x7fc4c0009ab0 tx=0x7fc4c001ca30 comp rx=0 tx=0).stop 2023-11-28T20:01:45.626 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:45.621+0000 7fc4d59e6640 1 -- 172.21.15.78:0/2061785570 shutdown_connections 2023-11-28T20:01:45.626 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:45.621+0000 7fc4d59e6640 1 --2- 172.21.15.78:0/2061785570 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc4bc003980 0x7fc4bc003da0 unknown :-1 s=CLOSED pgs=779 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:45.626 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:45.621+0000 7fc4d59e6640 1 -- 172.21.15.78:0/2061785570 >> 172.21.15.78:0/2061785570 conn(0x7fc4d00668d0 msgr2=0x7fc4d00ab980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:01:45.626 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:45.621+0000 7fc4d59e6640 1 -- 172.21.15.78:0/2061785570 shutdown_connections 2023-11-28T20:01:45.626 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:45.621+0000 7fc4d59e6640 1 -- 172.21.15.78:0/2061785570 wait complete. 2023-11-28T20:01:45.627 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:45.625+0000 7fc4d59e6640 1 Processor -- start 2023-11-28T20:01:45.627 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:45.625+0000 7fc4d59e6640 1 -- start start 2023-11-28T20:01:45.630 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:45.625+0000 7fc4d59e6640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc4bc003980 0x7fc4d01f1630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:45.630 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:45.625+0000 7fc4d59e6640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc4d014c730 0x7fc4d00c9140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:45.630 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:45.625+0000 7fc4d59e6640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc4d00c3940 0x7fc4d00a97f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:45.630 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:45.625+0000 7fc4d59e6640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4d01f0c20 con 0x7fc4d00c3940 2023-11-28T20:01:45.630 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:45.625+0000 7fc4d59e6640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4d01f1b70 con 0x7fc4bc003980 2023-11-28T20:01:45.630 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:45.625+0000 7fc4d59e6640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc4d01f11a0 con 0x7fc4d014c730 2023-11-28T20:01:45.630 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:45.625+0000 7fc4cf7fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc4d00c3940 0x7fc4d00a97f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:45.630 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:45.625+0000 7fc4ceffd640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc4bc003980 0x7fc4d01f1630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:45.630 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:45.625+0000 7fc4cf7fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc4d00c3940 0x7fc4d00a97f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:60188/0 (socket says 172.21.15.78:60188) 2023-11-28T20:01:45.631 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:45.625+0000 7fc4cf7fe640 1 -- 172.21.15.78:0/1299789594 learned_addr learned my addr 172.21.15.78:0/1299789594 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T20:01:45.631 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:45.625+0000 7fc4c7fff640 1 --2- 172.21.15.78:0/1299789594 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc4d014c730 0x7fc4d00c9140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:45.631 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:45.625+0000 7fc4cf7fe640 1 -- 172.21.15.78:0/1299789594 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc4d014c730 msgr2=0x7fc4d00c9140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:01:45.631 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:45.625+0000 7fc4cf7fe640 1 --2- 172.21.15.78:0/1299789594 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc4d014c730 0x7fc4d00c9140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:45.631 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:45.625+0000 7fc4cf7fe640 1 -- 172.21.15.78:0/1299789594 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc4bc003980 msgr2=0x7fc4d01f1630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:01:45.631 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:45.625+0000 7fc4cf7fe640 1 --2- 172.21.15.78:0/1299789594 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc4bc003980 0x7fc4d01f1630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:45.631 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:45.625+0000 7fc4cf7fe640 1 -- 172.21.15.78:0/1299789594 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4d00bcd90 con 0x7fc4d00c3940 2023-11-28T20:01:45.631 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:45.625+0000 7fc4cf7fe640 1 --2- 172.21.15.78:0/1299789594 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc4d00c3940 0x7fc4d00a97f0 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 crypto rx=0x7fc4d00c5f30 tx=0x7fc4c800eb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:01:45.631 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:45.625+0000 7fc4ccff9640 1 -- 172.21.15.78:0/1299789594 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4c800eed0 con 0x7fc4d00c3940 2023-11-28T20:01:45.631 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:45.625+0000 7fc4ccff9640 1 -- 172.21.15.78:0/1299789594 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc4c8003980 con 0x7fc4d00c3940 2023-11-28T20:01:45.631 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:45.625+0000 7fc4d59e6640 1 -- 172.21.15.78:0/1299789594 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc4d00bd070 con 0x7fc4d00c3940 2023-11-28T20:01:45.631 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:45.625+0000 7fc4ccff9640 1 -- 172.21.15.78:0/1299789594 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4c8003d10 con 0x7fc4d00c3940 2023-11-28T20:01:45.632 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:45.625+0000 7fc4d59e6640 1 -- 172.21.15.78:0/1299789594 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc4d01f0e30 con 0x7fc4d00c3940 2023-11-28T20:01:45.632 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:45.625+0000 7fc4d59e6640 1 -- 172.21.15.78:0/1299789594 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc4d00bd520 con 0x7fc4d00c3940 2023-11-28T20:01:45.632 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:45.629+0000 7fc4ccff9640 1 -- 172.21.15.78:0/1299789594 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fc4c80050d0 con 0x7fc4d00c3940 2023-11-28T20:01:45.633 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:45.629+0000 7fc4ccff9640 1 --2- 172.21.15.78:0/1299789594 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fc4b0066470 0x7fc4b0068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:45.633 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:45.629+0000 7fc4ccff9640 1 -- 172.21.15.78:0/1299789594 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 6885+0+0 (secure 0 0 0) 0x7fc4c8083fb0 con 0x7fc4d00c3940 2023-11-28T20:01:45.633 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:45.629+0000 7fc4ceffd640 1 --2- 172.21.15.78:0/1299789594 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fc4b0066470 0x7fc4b0068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:45.633 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:45.629+0000 7fc4ceffd640 1 --2- 172.21.15.78:0/1299789594 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fc4b0066470 0x7fc4b0068930 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7fc4c00ad000 tx=0x7fc4c00b2040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:01:45.636 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:45.633+0000 7fc4ccff9640 1 -- 172.21.15.78:0/1299789594 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fc4c8050fa0 con 0x7fc4d00c3940 2023-11-28T20:01:45.786 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:45.781+0000 7fc4d59e6640 1 -- 172.21.15.78:0/1299789594 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fc4d0067630 con 0x7fc4d00c3940 2023-11-28T20:01:45.786 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:45.781+0000 7fc4ccff9640 1 -- 172.21.15.78:0/1299789594 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v65) v1 ==== 100+0+11 (secure 0 0 0) 0x7fc4c80545c0 con 0x7fc4d00c3940 2023-11-28T20:01:45.787 INFO:teuthology.orchestra.run.smithi078.stdout:pg_num: 64 2023-11-28T20:01:45.788 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:45.785+0000 7fc4d59e6640 1 -- 172.21.15.78:0/1299789594 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fc4b0066470 msgr2=0x7fc4b0068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:01:45.789 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:45.785+0000 7fc4d59e6640 1 --2- 172.21.15.78:0/1299789594 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fc4b0066470 0x7fc4b0068930 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7fc4c00ad000 tx=0x7fc4c00b2040 comp rx=0 tx=0).stop 2023-11-28T20:01:45.789 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:45.785+0000 7fc4d59e6640 1 -- 172.21.15.78:0/1299789594 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc4d00c3940 msgr2=0x7fc4d00a97f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:01:45.789 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:45.785+0000 7fc4d59e6640 1 --2- 172.21.15.78:0/1299789594 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc4d00c3940 0x7fc4d00a97f0 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 crypto rx=0x7fc4d00c5f30 tx=0x7fc4c800eb90 comp rx=0 tx=0).stop 2023-11-28T20:01:45.789 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:45.785+0000 7fc4d59e6640 1 -- 172.21.15.78:0/1299789594 shutdown_connections 2023-11-28T20:01:45.789 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:45.785+0000 7fc4d59e6640 1 --2- 172.21.15.78:0/1299789594 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fc4b0066470 0x7fc4b0068930 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:45.789 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:45.785+0000 7fc4d59e6640 1 --2- 172.21.15.78:0/1299789594 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc4d014c730 0x7fc4d00c9140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:45.789 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:45.785+0000 7fc4d59e6640 1 --2- 172.21.15.78:0/1299789594 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc4d00c3940 0x7fc4d00a97f0 unknown :-1 s=CLOSED pgs=780 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:45.789 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:45.785+0000 7fc4d59e6640 1 --2- 172.21.15.78:0/1299789594 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc4bc003980 0x7fc4d01f1630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:45.789 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:45.785+0000 7fc4d59e6640 1 -- 172.21.15.78:0/1299789594 >> 172.21.15.78:0/1299789594 conn(0x7fc4d00668d0 msgr2=0x7fc4d014e380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:01:45.789 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:45.785+0000 7fc4d59e6640 1 -- 172.21.15.78:0/1299789594 shutdown_connections 2023-11-28T20:01:45.789 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:45.785+0000 7fc4d59e6640 1 -- 172.21.15.78:0/1299789594 wait complete. 2023-11-28T20:01:45.807 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs2_metadata pg_num 2023-11-28T20:01:45.948 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:45.945+0000 7f139089c640 1 Processor -- start 2023-11-28T20:01:45.948 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:45.945+0000 7f139089c640 1 -- start start 2023-11-28T20:01:45.949 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:45.945+0000 7f139089c640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f138c14b1e0 0x7f138c0c1700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:45.949 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:45.945+0000 7f139089c640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f138c1548c0 0x7f138c154d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:45.949 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:45.945+0000 7f139089c640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f138c0a4e20 con 0x7f138c0c5300 2023-11-28T20:01:45.949 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:45.945+0000 7f139089c640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f138c0a50e0 con 0x7f138c14b1e0 2023-11-28T20:01:45.949 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:45.945+0000 7f139089c640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f138c0c0f00 con 0x7f138c1548c0 2023-11-28T20:01:45.949 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:45.945+0000 7f1381d9b640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f138c0c5300 0x7f138c0a9c30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:52970/0 (socket says 172.21.15.78:52970) 2023-11-28T20:01:45.950 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:45.945+0000 7f1381d9b640 1 -- 172.21.15.78:0/4193276019 learned_addr learned my addr 172.21.15.78:0/4193276019 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-11-28T20:01:45.950 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:45.945+0000 7f138ad9d640 1 --2- 172.21.15.78:0/4193276019 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f138c1548c0 0x7f138c154d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:45.951 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:45.945+0000 7f138a59c640 1 --2- 172.21.15.78:0/4193276019 >> v2:172.21.15.179:3300/0 conn(0x7f138c14b1e0 0x7f138c0c1700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:45.951 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:45.945+0000 7f1389d9b640 1 -- 172.21.15.78:0/4193276019 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1225621321 0 0) 0x7f138c0a4e20 con 0x7f138c0c5300 2023-11-28T20:01:45.951 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:45.945+0000 7f1389d9b640 1 -- 172.21.15.78:0/4193276019 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1378005740 con 0x7f138c0c5300 2023-11-28T20:01:45.951 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:45.945+0000 7f1389d9b640 1 -- 172.21.15.78:0/4193276019 <== mon.0 v1:172.21.15.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3692094893 0 0) 0x7f1378005740 con 0x7f138c0c5300 2023-11-28T20:01:45.951 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:45.945+0000 7f138a59c640 1 -- 172.21.15.78:0/4193276019 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f138c1548c0 msgr2=0x7f138c154d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:01:45.951 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:45.945+0000 7f138a59c640 1 --2- 172.21.15.78:0/4193276019 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f138c1548c0 0x7f138c154d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:45.951 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:45.945+0000 7f138a59c640 1 -- 172.21.15.78:0/4193276019 >> v1:172.21.15.78:6789/0 conn(0x7f138c0c5300 legacy=0x7f138c0a9c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:01:45.951 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:45.945+0000 7f138a59c640 1 -- 172.21.15.78:0/4193276019 --> v2:172.21.15.179:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f138c0c11e0 con 0x7f138c14b1e0 2023-11-28T20:01:45.953 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:45.949+0000 7f138a59c640 1 --2- 172.21.15.78:0/4193276019 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f138c14b1e0 0x7f138c0c1700 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f137c009d90 tx=0x7f137c01c870 comp rx=0 tx=0).ready entity=mon.1 client_cookie=791a8c77178f43dd server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:01:45.953 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:45.949+0000 7f1389d9b640 1 -- 172.21.15.78:0/4193276019 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13740016a0 con 0x7f138c14b1e0 2023-11-28T20:01:45.954 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:45.949+0000 7f1389d9b640 1 -- 172.21.15.78:0/4193276019 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f137c0a6490 con 0x7f138c14b1e0 2023-11-28T20:01:45.954 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:45.949+0000 7f1389d9b640 1 -- 172.21.15.78:0/4193276019 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f137c0a6820 con 0x7f138c14b1e0 2023-11-28T20:01:45.955 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:45.949+0000 7f139089c640 1 -- 172.21.15.78:0/4193276019 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f138c14b1e0 msgr2=0x7f138c0c1700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:01:45.955 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:45.949+0000 7f139089c640 1 --2- 172.21.15.78:0/4193276019 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f138c14b1e0 0x7f138c0c1700 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f137c009d90 tx=0x7f137c01c870 comp rx=0 tx=0).stop 2023-11-28T20:01:45.956 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:45.949+0000 7f139089c640 1 -- 172.21.15.78:0/4193276019 shutdown_connections 2023-11-28T20:01:45.956 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:45.949+0000 7f139089c640 1 --2- 172.21.15.78:0/4193276019 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f138c1548c0 0x7f138c154d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:45.956 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:45.949+0000 7f139089c640 1 --2- 172.21.15.78:0/4193276019 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f138c14b1e0 0x7f138c0c1700 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:45.956 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:45.949+0000 7f139089c640 1 -- 172.21.15.78:0/4193276019 >> 172.21.15.78:0/4193276019 conn(0x7f138c0c59f0 msgr2=0x7f138c0c5e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:01:45.956 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:45.949+0000 7f139089c640 1 -- 172.21.15.78:0/4193276019 shutdown_connections 2023-11-28T20:01:45.956 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:45.949+0000 7f139089c640 1 -- 172.21.15.78:0/4193276019 wait complete. 2023-11-28T20:01:45.956 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:45.953+0000 7f139089c640 1 Processor -- start 2023-11-28T20:01:45.957 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:45.953+0000 7f139089c640 1 -- start start 2023-11-28T20:01:45.958 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:45.953+0000 7f139089c640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f138c0c5300 0x7f138c0ab210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:45.959 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:45.953+0000 7f139089c640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f138c14b1e0 0x7f138c1ed250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:45.959 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:45.953+0000 7f139089c640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f138c1548c0 0x7f138c1ed790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:45.959 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:45.953+0000 7f139089c640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f138c1ecdc0 con 0x7f138c0c5300 2023-11-28T20:01:45.959 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:45.953+0000 7f139089c640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f138c0a54c0 con 0x7f138c14b1e0 2023-11-28T20:01:45.959 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:45.953+0000 7f139089c640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f138c0a57a0 con 0x7f138c1548c0 2023-11-28T20:01:45.959 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:45.953+0000 7f138a59c640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f138c0c5300 0x7f138c0ab210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:45.959 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:45.953+0000 7f138a59c640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f138c0c5300 0x7f138c0ab210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:60192/0 (socket says 172.21.15.78:60192) 2023-11-28T20:01:45.959 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:45.953+0000 7f138a59c640 1 -- 172.21.15.78:0/118372395 learned_addr learned my addr 172.21.15.78:0/118372395 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T20:01:45.959 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:45.953+0000 7f138ad9d640 1 --2- 172.21.15.78:0/118372395 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f138c1548c0 0x7f138c1ed790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:45.959 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:45.953+0000 7f1381d9b640 1 --2- 172.21.15.78:0/118372395 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f138c14b1e0 0x7f138c1ed250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:45.959 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:45.953+0000 7f138a59c640 1 -- 172.21.15.78:0/118372395 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f138c1548c0 msgr2=0x7f138c1ed790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:01:45.960 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:45.953+0000 7f138a59c640 1 --2- 172.21.15.78:0/118372395 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f138c1548c0 0x7f138c1ed790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:45.960 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:45.953+0000 7f138a59c640 1 -- 172.21.15.78:0/118372395 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f138c14b1e0 msgr2=0x7f138c1ed250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:01:45.960 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:45.953+0000 7f138a59c640 1 --2- 172.21.15.78:0/118372395 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f138c14b1e0 0x7f138c1ed250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:45.960 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:45.953+0000 7f138a59c640 1 -- 172.21.15.78:0/118372395 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f137c009a70 con 0x7f138c0c5300 2023-11-28T20:01:45.960 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:45.953+0000 7f1381d9b640 1 --2- 172.21.15.78:0/118372395 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f138c14b1e0 0x7f138c1ed250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T20:01:45.960 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:45.953+0000 7f138a59c640 1 --2- 172.21.15.78:0/118372395 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f138c0c5300 0x7f138c0ab210 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 crypto rx=0x7f137c01d110 tx=0x7f137c019610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:01:45.960 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:45.953+0000 7f13837fe640 1 -- 172.21.15.78:0/118372395 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f137c0b7070 con 0x7f138c0c5300 2023-11-28T20:01:45.960 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:45.953+0000 7f13837fe640 1 -- 172.21.15.78:0/118372395 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f137c009450 con 0x7f138c0c5300 2023-11-28T20:01:45.960 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:45.953+0000 7f139089c640 1 -- 172.21.15.78:0/118372395 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f138c0a5a80 con 0x7f138c0c5300 2023-11-28T20:01:45.960 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:45.953+0000 7f13837fe640 1 -- 172.21.15.78:0/118372395 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f137c0a7690 con 0x7f138c0c5300 2023-11-28T20:01:45.960 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:45.953+0000 7f139089c640 1 -- 172.21.15.78:0/118372395 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f138c0a6c80 con 0x7f138c0c5300 2023-11-28T20:01:45.961 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:45.957+0000 7f139089c640 1 -- 172.21.15.78:0/118372395 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f138c067630 con 0x7f138c0c5300 2023-11-28T20:01:45.961 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:45.957+0000 7f13837fe640 1 -- 172.21.15.78:0/118372395 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f137c0a77f0 con 0x7f138c0c5300 2023-11-28T20:01:45.962 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:45.957+0000 7f13837fe640 1 --2- 172.21.15.78:0/118372395 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f136c066470 0x7f136c068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:45.962 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:45.957+0000 7f13837fe640 1 -- 172.21.15.78:0/118372395 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 6885+0+0 (secure 0 0 0) 0x7f137c11ec00 con 0x7f138c0c5300 2023-11-28T20:01:45.962 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:45.957+0000 7f1381d9b640 1 --2- 172.21.15.78:0/118372395 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f136c066470 0x7f136c068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:45.962 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:45.957+0000 7f1381d9b640 1 --2- 172.21.15.78:0/118372395 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f136c066470 0x7f136c068930 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f138c0aba20 tx=0x7f1374009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:01:45.966 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:45.961+0000 7f13837fe640 1 -- 172.21.15.78:0/118372395 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f137c125080 con 0x7f138c0c5300 2023-11-28T20:01:46.119 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:46.113+0000 7f139089c640 1 -- 172.21.15.78:0/118372395 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs2_metadata", "var": "pg_num"} v 0) v1 -- 0x7f138c0bf810 con 0x7f138c0c5300 2023-11-28T20:01:46.119 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:46.117+0000 7f13837fe640 1 -- 172.21.15.78:0/118372395 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs2_metadata", "var": "pg_num"}]=0 v65) v1 ==== 105+0+11 (secure 0 0 0) 0x7f137c0ac020 con 0x7f138c0c5300 2023-11-28T20:01:46.120 INFO:teuthology.orchestra.run.smithi078.stdout:pg_num: 32 2023-11-28T20:01:46.121 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:46.117+0000 7f139089c640 1 -- 172.21.15.78:0/118372395 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f136c066470 msgr2=0x7f136c068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:01:46.122 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:46.117+0000 7f139089c640 1 --2- 172.21.15.78:0/118372395 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f136c066470 0x7f136c068930 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f138c0aba20 tx=0x7f1374009040 comp rx=0 tx=0).stop 2023-11-28T20:01:46.122 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:46.117+0000 7f139089c640 1 -- 172.21.15.78:0/118372395 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f138c0c5300 msgr2=0x7f138c0ab210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:01:46.122 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:46.117+0000 7f139089c640 1 --2- 172.21.15.78:0/118372395 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f138c0c5300 0x7f138c0ab210 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 crypto rx=0x7f137c01d110 tx=0x7f137c019610 comp rx=0 tx=0).stop 2023-11-28T20:01:46.122 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:46.117+0000 7f139089c640 1 -- 172.21.15.78:0/118372395 shutdown_connections 2023-11-28T20:01:46.122 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:46.117+0000 7f139089c640 1 --2- 172.21.15.78:0/118372395 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f136c066470 0x7f136c068930 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:46.122 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:46.117+0000 7f139089c640 1 --2- 172.21.15.78:0/118372395 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f138c1548c0 0x7f138c1ed790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:46.122 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:46.117+0000 7f139089c640 1 --2- 172.21.15.78:0/118372395 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f138c14b1e0 0x7f138c1ed250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:46.122 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:46.117+0000 7f139089c640 1 --2- 172.21.15.78:0/118372395 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f138c0c5300 0x7f138c0ab210 unknown :-1 s=CLOSED pgs=782 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:46.122 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:46.117+0000 7f139089c640 1 -- 172.21.15.78:0/118372395 >> 172.21.15.78:0/118372395 conn(0x7f138c0c59f0 msgr2=0x7f138c14a460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:01:46.122 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:46.117+0000 7f139089c640 1 -- 172.21.15.78:0/118372395 shutdown_connections 2023-11-28T20:01:46.122 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:46.117+0000 7f139089c640 1 -- 172.21.15.78:0/118372395 wait complete. 2023-11-28T20:01:46.140 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs2_data pg_num 2023-11-28T20:01:46.281 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:46.277+0000 7fcfff05a640 1 Processor -- start 2023-11-28T20:01:46.281 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:46.277+0000 7fcfff05a640 1 -- start start 2023-11-28T20:01:46.282 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:46.277+0000 7fcfff05a640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcff806d840 0x7fcff80c43e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:46.282 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:46.277+0000 7fcfff05a640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcff8152910 con 0x7fcff814fc30 2023-11-28T20:01:46.282 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:46.277+0000 7fcfff05a640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcff8152bf0 con 0x7fcff814f850 2023-11-28T20:01:46.282 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:46.277+0000 7fcfff05a640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcff80c2240 con 0x7fcff806d840 2023-11-28T20:01:46.283 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:46.277+0000 7fcfeffff640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7fcff814fc30 0x7fcff80c3cd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:52984/0 (socket says 172.21.15.78:52984) 2023-11-28T20:01:46.283 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:46.277+0000 7fcfeffff640 1 -- 172.21.15.78:0/884583413 learned_addr learned my addr 172.21.15.78:0/884583413 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-11-28T20:01:46.284 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:46.277+0000 7fcfef7fe640 1 -- 172.21.15.78:0/884583413 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1296286809 0 0) 0x7fcff8152910 con 0x7fcff814fc30 2023-11-28T20:01:46.284 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:46.277+0000 7fcffd5f7640 1 --2- 172.21.15.78:0/884583413 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcff806d840 0x7fcff80c43e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:46.285 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:46.277+0000 7fcfef7fe640 1 -- 172.21.15.78:0/884583413 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcfe0003530 con 0x7fcff814fc30 2023-11-28T20:01:46.285 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:46.277+0000 7fcfef7fe640 1 -- 172.21.15.78:0/884583413 <== mon.0 v1:172.21.15.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2326049570 0 0) 0x7fcfe0003530 con 0x7fcff814fc30 2023-11-28T20:01:46.285 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:46.277+0000 7fcfef7fe640 1 -- 172.21.15.78:0/884583413 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcff806d840 msgr2=0x7fcff80c43e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:01:46.285 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:46.277+0000 7fcfef7fe640 1 --2- 172.21.15.78:0/884583413 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcff806d840 0x7fcff80c43e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:46.285 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:46.277+0000 7fcfef7fe640 1 -- 172.21.15.78:0/884583413 >> v1:172.21.15.179:6789/0 conn(0x7fcff814f850 legacy=0x7fcff80aacf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:01:46.285 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:46.281+0000 7fcfef7fe640 1 -- 172.21.15.78:0/884583413 --> v1:172.21.15.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcff8152ed0 con 0x7fcff814fc30 2023-11-28T20:01:46.285 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:46.281+0000 7fcfef7fe640 1 -- 172.21.15.78:0/884583413 <== mon.0 v1:172.21.15.78:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3326804700 0 0) 0x7fcfe80016a0 con 0x7fcff814fc30 2023-11-28T20:01:46.285 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:46.281+0000 7fcfef7fe640 1 -- 172.21.15.78:0/884583413 >> v1:172.21.15.78:6789/0 conn(0x7fcff814fc30 legacy=0x7fcff80c3cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:01:46.285 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:46.281+0000 7fcfef7fe640 1 --2- 172.21.15.78:0/884583413 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcff806d840 0x7fcfe00039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:46.285 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:46.281+0000 7fcfef7fe640 1 --2- 172.21.15.78:0/884583413 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcfe0003f30 0x7fcfe00047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:46.285 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:46.281+0000 7fcfef7fe640 1 --2- 172.21.15.78:0/884583413 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcfe0004d10 0x7fcfe0005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:46.286 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:46.281+0000 7fcfef7fe640 1 -- 172.21.15.78:0/884583413 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcff80c2240 con 0x7fcfe0004d10 2023-11-28T20:01:46.286 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:46.281+0000 7fcfef7fe640 1 -- 172.21.15.78:0/884583413 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcfe000ba70 con 0x7fcfe0003f30 2023-11-28T20:01:46.286 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:46.281+0000 7fcfef7fe640 1 -- 172.21.15.78:0/884583413 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcfe000bc30 con 0x7fcff806d840 2023-11-28T20:01:46.286 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:46.281+0000 7fcfeffff640 1 --2- 172.21.15.78:0/884583413 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcfe0003f30 0x7fcfe00047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:46.286 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:46.281+0000 7fcffd5f7640 1 --2- 172.21.15.78:0/884583413 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcfe0004d10 0x7fcfe0005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:46.286 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:46.281+0000 7fcffcdf6640 1 --2- 172.21.15.78:0/884583413 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcff806d840 0x7fcfe00039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:46.286 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:46.281+0000 7fcffd5f7640 1 -- 172.21.15.78:0/884583413 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcff806d840 msgr2=0x7fcfe00039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:01:46.287 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:46.281+0000 7fcffd5f7640 1 --2- 172.21.15.78:0/884583413 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcff806d840 0x7fcfe00039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:46.287 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:46.281+0000 7fcffd5f7640 1 -- 172.21.15.78:0/884583413 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcfe0003f30 msgr2=0x7fcfe00047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:01:46.287 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:46.281+0000 7fcffd5f7640 1 --2- 172.21.15.78:0/884583413 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcfe0003f30 0x7fcfe00047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:46.287 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:46.281+0000 7fcffd5f7640 1 -- 172.21.15.78:0/884583413 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcfe0003530 con 0x7fcfe0004d10 2023-11-28T20:01:46.288 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:46.281+0000 7fcffd5f7640 1 --2- 172.21.15.78:0/884583413 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcfe0004d10 0x7fcfe0005190 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 crypto rx=0x7fcff0009fc0 tx=0x7fcff001cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=95d7591082d7a2c server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:01:46.288 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:46.285+0000 7fcfef7fe640 1 -- 172.21.15.78:0/884583413 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcff00a5c70 con 0x7fcfe0004d10 2023-11-28T20:01:46.289 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:46.285+0000 7fcfef7fe640 1 -- 172.21.15.78:0/884583413 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcff000f040 con 0x7fcfe0004d10 2023-11-28T20:01:46.289 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:46.285+0000 7fcfef7fe640 1 -- 172.21.15.78:0/884583413 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcff00ad440 con 0x7fcfe0004d10 2023-11-28T20:01:46.289 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:46.285+0000 7fcfff05a640 1 -- 172.21.15.78:0/884583413 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcfe0004d10 msgr2=0x7fcfe0005190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:01:46.289 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:46.285+0000 7fcfff05a640 1 --2- 172.21.15.78:0/884583413 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcfe0004d10 0x7fcfe0005190 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 crypto rx=0x7fcff0009fc0 tx=0x7fcff001cc60 comp rx=0 tx=0).stop 2023-11-28T20:01:46.289 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:46.285+0000 7fcffd5f7640 1 -- 172.21.15.78:0/884583413 reap_dead start 2023-11-28T20:01:46.290 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:46.285+0000 7fcfff05a640 1 -- 172.21.15.78:0/884583413 shutdown_connections 2023-11-28T20:01:46.290 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:46.285+0000 7fcfff05a640 1 -- 172.21.15.78:0/884583413 >> 172.21.15.78:0/884583413 conn(0x7fcff80c59f0 msgr2=0x7fcff80c5e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:01:46.290 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:46.285+0000 7fcfff05a640 1 -- 172.21.15.78:0/884583413 shutdown_connections 2023-11-28T20:01:46.290 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:46.285+0000 7fcfff05a640 1 -- 172.21.15.78:0/884583413 wait complete. 2023-11-28T20:01:46.292 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:46.285+0000 7fcfff05a640 1 Processor -- start 2023-11-28T20:01:46.292 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:46.285+0000 7fcfff05a640 1 -- start start 2023-11-28T20:01:46.293 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:46.285+0000 7fcfff05a640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcfe0004d10 0x7fcff80a67a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:46.293 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:46.285+0000 7fcfff05a640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcff8072750 0x7fcff8149a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:46.293 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:46.285+0000 7fcfff05a640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcff80a6ce0 0x7fcff81e7a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:46.293 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:46.285+0000 7fcfff05a640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcff8070c40 con 0x7fcfe0004d10 2023-11-28T20:01:46.293 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:46.285+0000 7fcfff05a640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcff81eba60 con 0x7fcff80a6ce0 2023-11-28T20:01:46.294 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:46.285+0000 7fcfff05a640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcff81ebd40 con 0x7fcff8072750 2023-11-28T20:01:46.294 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:46.285+0000 7fcffcdf6640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcfe0004d10 0x7fcff80a67a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:46.294 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:46.285+0000 7fcffcdf6640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcfe0004d10 0x7fcff80a67a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:60212/0 (socket says 172.21.15.78:60212) 2023-11-28T20:01:46.294 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:46.285+0000 7fcffcdf6640 1 -- 172.21.15.78:0/450483301 learned_addr learned my addr 172.21.15.78:0/450483301 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T20:01:46.294 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:46.285+0000 7fcfeffff640 1 --2- 172.21.15.78:0/450483301 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcff8072750 0x7fcff8149a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:46.294 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:46.289+0000 7fcffd5f7640 1 --2- 172.21.15.78:0/450483301 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcff80a6ce0 0x7fcff81e7a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:46.295 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:46.289+0000 7fcffcdf6640 1 -- 172.21.15.78:0/450483301 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcff8072750 msgr2=0x7fcff8149a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:01:46.295 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:46.289+0000 7fcffcdf6640 1 --2- 172.21.15.78:0/450483301 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcff8072750 0x7fcff8149a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:46.295 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:46.289+0000 7fcffcdf6640 1 -- 172.21.15.78:0/450483301 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcff80a6ce0 msgr2=0x7fcff81e7a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:01:46.295 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:46.289+0000 7fcffcdf6640 1 --2- 172.21.15.78:0/450483301 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcff80a6ce0 0x7fcff81e7a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:46.295 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:46.289+0000 7fcffcdf6640 1 -- 172.21.15.78:0/450483301 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcff8071790 con 0x7fcfe0004d10 2023-11-28T20:01:46.295 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:46.289+0000 7fcffd5f7640 1 --2- 172.21.15.78:0/450483301 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcff80a6ce0 0x7fcff81e7a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T20:01:46.296 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:46.289+0000 7fcffcdf6640 1 --2- 172.21.15.78:0/450483301 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcfe0004d10 0x7fcff80a67a0 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 crypto rx=0x7fcff400f7f0 tx=0x7fcff400fcb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:01:46.296 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:46.289+0000 7fcfed7fa640 1 -- 172.21.15.78:0/450483301 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcff40050d0 con 0x7fcfe0004d10 2023-11-28T20:01:46.296 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:46.289+0000 7fcfed7fa640 1 -- 172.21.15.78:0/450483301 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcff4005230 con 0x7fcfe0004d10 2023-11-28T20:01:46.296 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:46.289+0000 7fcfed7fa640 1 -- 172.21.15.78:0/450483301 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcff400d730 con 0x7fcfe0004d10 2023-11-28T20:01:46.296 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:46.289+0000 7fcfff05a640 1 -- 172.21.15.78:0/450483301 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcff8071a70 con 0x7fcfe0004d10 2023-11-28T20:01:46.296 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:46.289+0000 7fcfff05a640 1 -- 172.21.15.78:0/450483301 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcff814a4b0 con 0x7fcfe0004d10 2023-11-28T20:01:46.297 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:46.289+0000 7fcfff05a640 1 -- 172.21.15.78:0/450483301 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcff8067630 con 0x7fcfe0004d10 2023-11-28T20:01:46.297 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:46.289+0000 7fcfed7fa640 1 -- 172.21.15.78:0/450483301 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fcff400d890 con 0x7fcfe0004d10 2023-11-28T20:01:46.297 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:46.289+0000 7fcfed7fa640 1 --2- 172.21.15.78:0/450483301 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fcfe40664a0 0x7fcfe4068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:46.297 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:46.289+0000 7fcfed7fa640 1 -- 172.21.15.78:0/450483301 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 6885+0+0 (secure 0 0 0) 0x7fcff4084190 con 0x7fcfe0004d10 2023-11-28T20:01:46.297 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:46.289+0000 7fcfeffff640 1 --2- 172.21.15.78:0/450483301 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fcfe40664a0 0x7fcfe4068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:46.297 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:46.293+0000 7fcfeffff640 1 --2- 172.21.15.78:0/450483301 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fcfe40664a0 0x7fcfe4068960 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7fcff814aa40 tx=0x7fcfe8001c50 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:01:46.298 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:46.293+0000 7fcfed7fa640 1 -- 172.21.15.78:0/450483301 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fcff4051200 con 0x7fcfe0004d10 2023-11-28T20:01:46.449 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:46.445+0000 7fcfff05a640 1 -- 172.21.15.78:0/450483301 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs2_data", "var": "pg_num"} v 0) v1 -- 0x7fcff80a4a90 con 0x7fcfe0004d10 2023-11-28T20:01:46.449 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:46.445+0000 7fcfed7fa640 1 -- 172.21.15.78:0/450483301 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs2_data", "var": "pg_num"}]=0 v65) v1 ==== 101+0+11 (secure 0 0 0) 0x7fcff4054820 con 0x7fcfe0004d10 2023-11-28T20:01:46.449 INFO:teuthology.orchestra.run.smithi078.stdout:pg_num: 64 2023-11-28T20:01:46.451 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:46.445+0000 7fcfff05a640 1 -- 172.21.15.78:0/450483301 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fcfe40664a0 msgr2=0x7fcfe4068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:01:46.452 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:46.445+0000 7fcfff05a640 1 --2- 172.21.15.78:0/450483301 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fcfe40664a0 0x7fcfe4068960 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7fcff814aa40 tx=0x7fcfe8001c50 comp rx=0 tx=0).stop 2023-11-28T20:01:46.452 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:46.445+0000 7fcfff05a640 1 -- 172.21.15.78:0/450483301 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcfe0004d10 msgr2=0x7fcff80a67a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:01:46.452 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:46.445+0000 7fcfff05a640 1 --2- 172.21.15.78:0/450483301 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcfe0004d10 0x7fcff80a67a0 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 crypto rx=0x7fcff400f7f0 tx=0x7fcff400fcb0 comp rx=0 tx=0).stop 2023-11-28T20:01:46.452 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:46.449+0000 7fcfff05a640 1 -- 172.21.15.78:0/450483301 shutdown_connections 2023-11-28T20:01:46.452 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:46.449+0000 7fcfff05a640 1 --2- 172.21.15.78:0/450483301 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fcfe40664a0 0x7fcfe4068960 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:46.453 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:46.449+0000 7fcfff05a640 1 --2- 172.21.15.78:0/450483301 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcff8072750 0x7fcff8149a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:46.453 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:46.449+0000 7fcfff05a640 1 --2- 172.21.15.78:0/450483301 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcff80a6ce0 0x7fcff81e7a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:46.453 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:46.449+0000 7fcfff05a640 1 --2- 172.21.15.78:0/450483301 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcfe0004d10 0x7fcff80a67a0 unknown :-1 s=CLOSED pgs=785 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:46.453 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:46.449+0000 7fcfff05a640 1 -- 172.21.15.78:0/450483301 >> 172.21.15.78:0/450483301 conn(0x7fcff80c59f0 msgr2=0x7fcff806cd50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:01:46.453 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:46.449+0000 7fcfff05a640 1 -- 172.21.15.78:0/450483301 shutdown_connections 2023-11-28T20:01:46.454 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:46.449+0000 7fcfff05a640 1 -- 172.21.15.78:0/450483301 wait complete. 2023-11-28T20:01:46.471 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-28T20:01:46.608 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:46.605+0000 7fdfa15df640 1 Processor -- start 2023-11-28T20:01:46.609 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:46.605+0000 7fdfa15df640 1 -- start start 2023-11-28T20:01:46.610 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:46.605+0000 7fdfa15df640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fdf9c151ec0 0x7fdf9c155100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:46.610 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:46.605+0000 7fdfa15df640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdf9c06b320 0x7fdf9c0c7f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:46.610 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:46.605+0000 7fdfa15df640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdf9c155640 con 0x7fdf9c0c47c0 2023-11-28T20:01:46.610 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:46.605+0000 7fdfa15df640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdf9c0c8aa0 con 0x7fdf9c151ec0 2023-11-28T20:01:46.611 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:46.605+0000 7fdfa15df640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdf9c0c9060 con 0x7fdf9c06b320 2023-11-28T20:01:46.611 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:46.605+0000 7fdf9affd640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fdf9c151ec0 0x7fdf9c155100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:46.611 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:46.605+0000 7fdf9affd640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fdf9c151ec0 0x7fdf9c155100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:60218/0 (socket says 172.21.15.78:60218) 2023-11-28T20:01:46.611 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:46.605+0000 7fdf9affd640 1 -- 172.21.15.78:0/1899900182 learned_addr learned my addr 172.21.15.78:0/1899900182 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T20:01:46.611 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:46.605+0000 7fdf9affd640 1 -- 172.21.15.78:0/1899900182 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdf9c06b320 msgr2=0x7fdf9c0c7f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:01:46.611 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:46.605+0000 7fdf9b7fe640 1 --2- 172.21.15.78:0/1899900182 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdf9c06b320 0x7fdf9c0c7f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:46.611 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:46.605+0000 7fdf9affd640 1 --2- 172.21.15.78:0/1899900182 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdf9c06b320 0x7fdf9c0c7f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:46.611 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:46.605+0000 7fdf9affd640 1 -- 172.21.15.78:0/1899900182 >> v1:172.21.15.179:6789/0 conn(0x7fdf9c0c47c0 legacy=0x7fdf9c0c94f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:01:46.611 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:46.605+0000 7fdf9affd640 1 -- 172.21.15.78:0/1899900182 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf9c0c4d30 con 0x7fdf9c151ec0 2023-11-28T20:01:46.611 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:46.605+0000 7fdf9b7fe640 1 --2- 172.21.15.78:0/1899900182 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdf9c06b320 0x7fdf9c0c7f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T20:01:46.613 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:46.609+0000 7fdf9affd640 1 --2- 172.21.15.78:0/1899900182 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdf9c151ec0 0x7fdf9c155100 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 crypto rx=0x7fdf8c009870 tx=0x7fdf8c01c500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cc8b941b8d2644c0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:01:46.614 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:46.609+0000 7fdf9a7fc640 1 -- 172.21.15.78:0/1899900182 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf8c0aa620 con 0x7fdf9c151ec0 2023-11-28T20:01:46.614 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:46.609+0000 7fdf9a7fc640 1 -- 172.21.15.78:0/1899900182 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf8c0aa780 con 0x7fdf9c151ec0 2023-11-28T20:01:46.614 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:46.609+0000 7fdf9a7fc640 1 -- 172.21.15.78:0/1899900182 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf8c0aab10 con 0x7fdf9c151ec0 2023-11-28T20:01:46.615 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:46.609+0000 7fdfa15df640 1 -- 172.21.15.78:0/1899900182 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdf9c151ec0 msgr2=0x7fdf9c155100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:01:46.615 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:46.609+0000 7fdfa15df640 1 --2- 172.21.15.78:0/1899900182 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdf9c151ec0 0x7fdf9c155100 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 crypto rx=0x7fdf8c009870 tx=0x7fdf8c01c500 comp rx=0 tx=0).stop 2023-11-28T20:01:46.615 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:46.609+0000 7fdfa15df640 1 -- 172.21.15.78:0/1899900182 shutdown_connections 2023-11-28T20:01:46.615 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:46.609+0000 7fdfa15df640 1 --2- 172.21.15.78:0/1899900182 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdf9c06b320 0x7fdf9c0c7f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:46.615 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:46.609+0000 7fdfa15df640 1 --2- 172.21.15.78:0/1899900182 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdf9c151ec0 0x7fdf9c155100 unknown :-1 s=CLOSED pgs=786 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:46.615 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:46.609+0000 7fdfa15df640 1 -- 172.21.15.78:0/1899900182 >> 172.21.15.78:0/1899900182 conn(0x7fdf9c0c9e40 msgr2=0x7fdf9c0ca250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:01:46.615 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:46.609+0000 7fdfa15df640 1 -- 172.21.15.78:0/1899900182 shutdown_connections 2023-11-28T20:01:46.615 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:46.609+0000 7fdfa15df640 1 -- 172.21.15.78:0/1899900182 wait complete. 2023-11-28T20:01:46.616 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:46.613+0000 7fdfa15df640 1 Processor -- start 2023-11-28T20:01:46.616 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:46.613+0000 7fdfa15df640 1 -- start start 2023-11-28T20:01:46.618 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:46.613+0000 7fdfa15df640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdf9c06b320 0x7fdf9c0c2ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:46.618 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:46.613+0000 7fdfa15df640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdf9c0c47c0 0x7fdf9c1577f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:46.618 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:46.613+0000 7fdfa15df640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdf9c151ec0 0x7fdf9c157d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:46.618 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:46.613+0000 7fdfa15df640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf9c13ee20 con 0x7fdf9c06b320 2023-11-28T20:01:46.618 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:46.613+0000 7fdfa15df640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf9c0c1600 con 0x7fdf9c151ec0 2023-11-28T20:01:46.618 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:46.613+0000 7fdfa15df640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdf9c158270 con 0x7fdf9c0c47c0 2023-11-28T20:01:46.618 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:46.613+0000 7fdf9affd640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdf9c06b320 0x7fdf9c0c2ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:46.618 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:46.613+0000 7fdf9affd640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdf9c06b320 0x7fdf9c0c2ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:60222/0 (socket says 172.21.15.78:60222) 2023-11-28T20:01:46.618 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:46.613+0000 7fdf9affd640 1 -- 172.21.15.78:0/3489403954 learned_addr learned my addr 172.21.15.78:0/3489403954 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T20:01:46.618 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:46.613+0000 7fdf927fc640 1 --2- 172.21.15.78:0/3489403954 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdf9c0c47c0 0x7fdf9c1577f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:46.619 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:46.613+0000 7fdf9b7fe640 1 --2- 172.21.15.78:0/3489403954 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdf9c151ec0 0x7fdf9c157d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:46.619 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:46.613+0000 7fdf9affd640 1 -- 172.21.15.78:0/3489403954 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdf9c0c47c0 msgr2=0x7fdf9c1577f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:01:46.619 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:46.613+0000 7fdf9affd640 1 --2- 172.21.15.78:0/3489403954 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdf9c0c47c0 0x7fdf9c1577f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:46.619 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:46.613+0000 7fdf9affd640 1 -- 172.21.15.78:0/3489403954 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdf9c151ec0 msgr2=0x7fdf9c157d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:01:46.619 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:46.613+0000 7fdf9affd640 1 --2- 172.21.15.78:0/3489403954 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdf9c151ec0 0x7fdf9c157d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:46.619 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:46.613+0000 7fdf9affd640 1 -- 172.21.15.78:0/3489403954 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf8c0094d0 con 0x7fdf9c06b320 2023-11-28T20:01:46.620 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:46.613+0000 7fdf9affd640 1 --2- 172.21.15.78:0/3489403954 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdf9c06b320 0x7fdf9c0c2ea0 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 crypto rx=0x7fdf8c01cda0 tx=0x7fdf8c01ad40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:01:46.620 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:46.613+0000 7fdf93fff640 1 -- 172.21.15.78:0/3489403954 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf8c0bd3f0 con 0x7fdf9c06b320 2023-11-28T20:01:46.620 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:46.613+0000 7fdf93fff640 1 -- 172.21.15.78:0/3489403954 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf8c0bd570 con 0x7fdf9c06b320 2023-11-28T20:01:46.620 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:46.613+0000 7fdf93fff640 1 -- 172.21.15.78:0/3489403954 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf8c0bd920 con 0x7fdf9c06b320 2023-11-28T20:01:46.620 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:46.613+0000 7fdfa15df640 1 -- 172.21.15.78:0/3489403954 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdf9c14a900 con 0x7fdf9c06b320 2023-11-28T20:01:46.621 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:46.613+0000 7fdfa15df640 1 -- 172.21.15.78:0/3489403954 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdf9c0c0fb0 con 0x7fdf9c06b320 2023-11-28T20:01:46.621 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:46.617+0000 7fdfa15df640 1 -- 172.21.15.78:0/3489403954 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdf9c067630 con 0x7fdf9c06b320 2023-11-28T20:01:46.621 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:46.617+0000 7fdf93fff640 1 -- 172.21.15.78:0/3489403954 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fdf8c0b33f0 con 0x7fdf9c06b320 2023-11-28T20:01:46.621 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:46.617+0000 7fdf93fff640 1 --2- 172.21.15.78:0/3489403954 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fdf7c066470 0x7fdf7c068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:46.621 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:46.617+0000 7fdf93fff640 1 -- 172.21.15.78:0/3489403954 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 6885+0+0 (secure 0 0 0) 0x7fdf8c11e450 con 0x7fdf9c06b320 2023-11-28T20:01:46.622 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:46.617+0000 7fdf927fc640 1 --2- 172.21.15.78:0/3489403954 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fdf7c066470 0x7fdf7c068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:46.622 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:46.617+0000 7fdf927fc640 1 --2- 172.21.15.78:0/3489403954 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fdf7c066470 0x7fdf7c068930 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7fdf9c0ab330 tx=0x7fdf84009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:01:46.625 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:46.621+0000 7fdf93fff640 1 -- 172.21.15.78:0/3489403954 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fdf8c0eb560 con 0x7fdf9c06b320 2023-11-28T20:01:46.806 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:46.801+0000 7fdfa15df640 1 -- 172.21.15.78:0/3489403954 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fdf9c155640 con 0x7fdf9c06b320 2023-11-28T20:01:46.806 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:46.801+0000 7fdf93fff640 1 -- 172.21.15.78:0/3489403954 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 36 v36) v1 ==== 94+0+6130 (secure 0 0 0) 0x7fdf9c155640 con 0x7fdf9c06b320 2023-11-28T20:01:46.807 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-11-28T20:01:46.807 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":36,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5384,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6834/837155031","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6832","nonce":837155031},{"type":"v1","addr":"172.21.15.179:6834","nonce":837155031}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":27},{"gid":5387,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6835/752467462","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6833","nonce":752467462},{"type":"v1","addr":"172.21.15.179:6835","nonce":752467462}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":27}],"filesystems":[{"mdsmap":{"epoch":31,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-28T20:01:09.868520+0000","modified":"2023-11-28T20:01:12.907972+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5892},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5892":{"gid":5892,"name":"a","rank":0,"incarnation":28,"state":"up:active","state_seq":3,"addr":"172.21.15.78:6837/115607035","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6836","nonce":115607035},{"type":"v1","addr":"172.21.15.78:6837","nonce":115607035}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":4},{"mdsmap":{"epoch":36,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-28T20:01:23.178057+0000","modified":"2023-11-28T20:01:26.193482+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5889},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5889":{"gid":5889,"name":"c","rank":0,"incarnation":32,"state":"up:active","state_seq":6,"addr":"172.21.15.78:6835/1997036463","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6834","nonce":1997036463},{"type":"v1","addr":"172.21.15.78:6835","nonce":1997036463}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs2","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":5}]} 2023-11-28T20:01:46.807 INFO:teuthology.orchestra.run.smithi078.stderr:dumped fsmap epoch 36 2023-11-28T20:01:46.809 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:46.805+0000 7fdfa15df640 1 -- 172.21.15.78:0/3489403954 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fdf7c066470 msgr2=0x7fdf7c068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:01:46.809 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:46.805+0000 7fdfa15df640 1 --2- 172.21.15.78:0/3489403954 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fdf7c066470 0x7fdf7c068930 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7fdf9c0ab330 tx=0x7fdf84009040 comp rx=0 tx=0).stop 2023-11-28T20:01:46.809 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:46.805+0000 7fdfa15df640 1 -- 172.21.15.78:0/3489403954 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdf9c06b320 msgr2=0x7fdf9c0c2ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:01:46.809 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:46.805+0000 7fdfa15df640 1 --2- 172.21.15.78:0/3489403954 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdf9c06b320 0x7fdf9c0c2ea0 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 crypto rx=0x7fdf8c01cda0 tx=0x7fdf8c01ad40 comp rx=0 tx=0).stop 2023-11-28T20:01:46.809 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:46.805+0000 7fdfa15df640 1 -- 172.21.15.78:0/3489403954 shutdown_connections 2023-11-28T20:01:46.809 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:46.805+0000 7fdfa15df640 1 --2- 172.21.15.78:0/3489403954 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fdf7c066470 0x7fdf7c068930 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:46.809 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:46.805+0000 7fdfa15df640 1 --2- 172.21.15.78:0/3489403954 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdf9c0c47c0 0x7fdf9c1577f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:46.809 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:46.805+0000 7fdfa15df640 1 --2- 172.21.15.78:0/3489403954 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdf9c151ec0 0x7fdf9c157d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:46.809 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:46.805+0000 7fdfa15df640 1 --2- 172.21.15.78:0/3489403954 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdf9c06b320 0x7fdf9c0c2ea0 unknown :-1 s=CLOSED pgs=787 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:46.809 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:46.805+0000 7fdfa15df640 1 -- 172.21.15.78:0/3489403954 >> 172.21.15.78:0/3489403954 conn(0x7fdf9c0c9e40 msgr2=0x7fdf9c14c270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:01:46.810 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:46.805+0000 7fdfa15df640 1 -- 172.21.15.78:0/3489403954 shutdown_connections 2023-11-28T20:01:46.810 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:46.805+0000 7fdfa15df640 1 -- 172.21.15.78:0/3489403954 wait complete. 2023-11-28T20:01:46.829 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-28T20:01:46.966 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:46.961+0000 7f66efbaa640 1 Processor -- start 2023-11-28T20:01:46.967 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:46.961+0000 7f66efbaa640 1 -- start start 2023-11-28T20:01:46.968 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:46.965+0000 7f66efbaa640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f66e80c3b80 0x7f66e806d690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:46.968 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:46.965+0000 7f66efbaa640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f66e80c5300 0x7f66e806c730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:46.968 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:46.965+0000 7f66efbaa640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f66e806bb80 con 0x7f66e806d2b0 2023-11-28T20:01:46.968 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:46.965+0000 7f66efbaa640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f66e806cc70 con 0x7f66e80c5300 2023-11-28T20:01:46.968 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:46.965+0000 7f66efbaa640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f66e80c5790 con 0x7f66e80c3b80 2023-11-28T20:01:46.969 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:46.965+0000 7f66ee147640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f66e80c5300 0x7f66e806c730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:46.969 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:46.965+0000 7f66ed145640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f66e80c3b80 0x7f66e806d690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:46.969 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:46.965+0000 7f66ee147640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f66e80c5300 0x7f66e806c730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.78:56702/0 (socket says 172.21.15.78:56702) 2023-11-28T20:01:46.969 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:46.965+0000 7f66ee147640 1 -- 172.21.15.78:0/3517216716 learned_addr learned my addr 172.21.15.78:0/3517216716 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T20:01:46.969 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:46.965+0000 7f66ed946640 1 --1- 172.21.15.78:0/3517216716 >> v1:172.21.15.179:6789/0 conn(0x7f66e806d2b0 0x7f66e806c020 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.179:6789/0 says I am v1:172.21.15.78:56108/0 (socket says 172.21.15.78:56108) 2023-11-28T20:01:46.969 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:46.965+0000 7f66ee147640 1 -- 172.21.15.78:0/3517216716 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f66e80c3b80 msgr2=0x7f66e806d690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:01:46.970 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:46.965+0000 7f66ee147640 1 --2- 172.21.15.78:0/3517216716 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f66e80c3b80 0x7f66e806d690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:46.970 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:46.965+0000 7f66ee147640 1 -- 172.21.15.78:0/3517216716 >> v1:172.21.15.179:6789/0 conn(0x7f66e806d2b0 legacy=0x7f66e806c020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:01:46.970 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:46.965+0000 7f66ee147640 1 -- 172.21.15.78:0/3517216716 --> v2:172.21.15.179:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66e81515c0 con 0x7f66e80c5300 2023-11-28T20:01:46.971 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:46.969+0000 7f66ee147640 1 --2- 172.21.15.78:0/3517216716 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f66e80c5300 0x7f66e806c730 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f66e0009e50 tx=0x7f66e001c9e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=63f79e6b1ba63ab7 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:01:46.972 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:46.969+0000 7f66ec944640 1 -- 172.21.15.78:0/3517216716 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66e00a57c0 con 0x7f66e80c5300 2023-11-28T20:01:46.972 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:46.969+0000 7f66ec944640 1 -- 172.21.15.78:0/3517216716 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f66e00a5920 con 0x7f66e80c5300 2023-11-28T20:01:46.972 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:46.969+0000 7f66ec944640 1 -- 172.21.15.78:0/3517216716 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66e00a5cb0 con 0x7f66e80c5300 2023-11-28T20:01:46.973 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:46.969+0000 7f66efbaa640 1 -- 172.21.15.78:0/3517216716 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f66e80c5300 msgr2=0x7f66e806c730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:01:46.973 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:46.969+0000 7f66efbaa640 1 --2- 172.21.15.78:0/3517216716 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f66e80c5300 0x7f66e806c730 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f66e0009e50 tx=0x7f66e001c9e0 comp rx=0 tx=0).stop 2023-11-28T20:01:46.973 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:46.969+0000 7f66efbaa640 1 -- 172.21.15.78:0/3517216716 shutdown_connections 2023-11-28T20:01:46.973 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:46.969+0000 7f66efbaa640 1 --2- 172.21.15.78:0/3517216716 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f66e80c5300 0x7f66e806c730 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:46.974 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:46.969+0000 7f66efbaa640 1 --2- 172.21.15.78:0/3517216716 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f66e80c3b80 0x7f66e806d690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:46.974 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:46.969+0000 7f66efbaa640 1 -- 172.21.15.78:0/3517216716 >> 172.21.15.78:0/3517216716 conn(0x7f66e80a7810 msgr2=0x7f66e80a7c20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:01:46.974 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:46.969+0000 7f66efbaa640 1 -- 172.21.15.78:0/3517216716 shutdown_connections 2023-11-28T20:01:46.974 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:46.969+0000 7f66efbaa640 1 -- 172.21.15.78:0/3517216716 wait complete. 2023-11-28T20:01:46.974 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:46.969+0000 7f66efbaa640 1 Processor -- start 2023-11-28T20:01:46.974 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:46.969+0000 7f66efbaa640 1 -- start start 2023-11-28T20:01:46.976 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:46.973+0000 7f66efbaa640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f66e806d2b0 0x7f66e80ab120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:46.976 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:46.973+0000 7f66efbaa640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f66e80c3b80 0x7f66e815a130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:46.976 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:46.973+0000 7f66efbaa640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f66e80c5300 0x7f66e80a5650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:46.976 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:46.973+0000 7f66efbaa640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66e8151310 con 0x7f66e806d2b0 2023-11-28T20:01:46.976 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:46.973+0000 7f66efbaa640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66e814a600 con 0x7f66e80c5300 2023-11-28T20:01:46.976 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:46.973+0000 7f66efbaa640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f66e8153340 con 0x7f66e80c3b80 2023-11-28T20:01:46.976 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:46.973+0000 7f66ed946640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f66e806d2b0 0x7f66e80ab120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:46.976 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:46.973+0000 7f66ed946640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f66e806d2b0 0x7f66e80ab120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:60226/0 (socket says 172.21.15.78:60226) 2023-11-28T20:01:46.976 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:46.973+0000 7f66ed946640 1 -- 172.21.15.78:0/1837543375 learned_addr learned my addr 172.21.15.78:0/1837543375 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T20:01:46.976 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:46.973+0000 7f66ed145640 1 --2- 172.21.15.78:0/1837543375 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f66e80c3b80 0x7f66e815a130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:46.977 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:46.973+0000 7f66ee147640 1 --2- 172.21.15.78:0/1837543375 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f66e80c5300 0x7f66e80a5650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:46.978 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:46.973+0000 7f66ed946640 1 -- 172.21.15.78:0/1837543375 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f66e80c3b80 msgr2=0x7f66e815a130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:01:46.978 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:46.973+0000 7f66ed946640 1 --2- 172.21.15.78:0/1837543375 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f66e80c3b80 0x7f66e815a130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:46.978 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:46.973+0000 7f66ed946640 1 -- 172.21.15.78:0/1837543375 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f66e80c5300 msgr2=0x7f66e80a5650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:01:46.978 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:46.973+0000 7f66ed946640 1 --2- 172.21.15.78:0/1837543375 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f66e80c5300 0x7f66e80a5650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:46.978 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:46.973+0000 7f66ed946640 1 -- 172.21.15.78:0/1837543375 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66e0009b30 con 0x7f66e806d2b0 2023-11-28T20:01:46.978 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:46.973+0000 7f66ed946640 1 --2- 172.21.15.78:0/1837543375 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f66e806d2b0 0x7f66e80ab120 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 crypto rx=0x7f66e400c490 tx=0x7f66e400c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:01:46.978 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:46.973+0000 7f66de7fc640 1 -- 172.21.15.78:0/1837543375 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66e4007480 con 0x7f66e806d2b0 2023-11-28T20:01:46.978 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:46.973+0000 7f66de7fc640 1 -- 172.21.15.78:0/1837543375 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f66e40075e0 con 0x7f66e806d2b0 2023-11-28T20:01:46.978 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:46.973+0000 7f66de7fc640 1 -- 172.21.15.78:0/1837543375 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66e4004a10 con 0x7f66e806d2b0 2023-11-28T20:01:46.978 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:46.973+0000 7f66efbaa640 1 -- 172.21.15.78:0/1837543375 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f66e814ef80 con 0x7f66e806d2b0 2023-11-28T20:01:46.979 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:46.973+0000 7f66efbaa640 1 -- 172.21.15.78:0/1837543375 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f66e81ed390 con 0x7f66e806d2b0 2023-11-28T20:01:46.979 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:46.973+0000 7f66efbaa640 1 -- 172.21.15.78:0/1837543375 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f66e81ed1f0 con 0x7f66e806d2b0 2023-11-28T20:01:46.979 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:46.973+0000 7f66de7fc640 1 -- 172.21.15.78:0/1837543375 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f66e4004b70 con 0x7f66e806d2b0 2023-11-28T20:01:46.980 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:46.977+0000 7f66de7fc640 1 --2- 172.21.15.78:0/1837543375 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f66cc066470 0x7f66cc068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:46.980 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:46.977+0000 7f66de7fc640 1 -- 172.21.15.78:0/1837543375 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 6885+0+0 (secure 0 0 0) 0x7f66e4083400 con 0x7f66e806d2b0 2023-11-28T20:01:46.980 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:46.977+0000 7f66ed145640 1 --2- 172.21.15.78:0/1837543375 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f66cc066470 0x7f66cc068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:46.980 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:46.977+0000 7f66ed145640 1 --2- 172.21.15.78:0/1837543375 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f66cc066470 0x7f66cc068930 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f66e8070140 tx=0x7f66d8009190 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:01:46.983 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:46.981+0000 7f66de7fc640 1 -- 172.21.15.78:0/1837543375 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f66e81ed1f0 con 0x7f66e806d2b0 2023-11-28T20:01:47.136 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:47.133+0000 7f66efbaa640 1 -- 172.21.15.78:0/1837543375 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f66e81ed1f0 con 0x7f66e806d2b0 2023-11-28T20:01:47.137 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:47.133+0000 7f66de7fc640 1 -- 172.21.15.78:0/1837543375 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v65) v1 ==== 74+0+20410 (secure 0 0 0) 0x7f66e81ed1f0 con 0x7f66e806d2b0 2023-11-28T20:01:47.137 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-11-28T20:01:47.137 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":65,"fsid":"dd9780e8-3bda-44fa-a9f0-fa07d19d901d","created":"2023-11-28T19:58:40.969556+0000","modified":"2023-11-28T20:01:24.807489+0000","last_up_change":"2023-11-28T19:58:52.596716+0000","last_in_change":"2023-11-28T19:58:43.609275+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":12,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-28T19:58:54.011229+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_metadata","create_time":"2023-11-28T20:01:07.969267+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"60","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_data","create_time":"2023-11-28T20:01:08.865465+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"61","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs2_metadata","create_time":"2023-11-28T20:01:20.863763+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"64","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs2_data","create_time":"2023-11-28T20:01:22.176918+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"65","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs2"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e84245ac-b5da-429e-af18-39acaa2b33e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6800","nonce":3358701235},{"type":"v1","addr":"172.21.15.78:6801","nonce":3358701235}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6802","nonce":3358701235},{"type":"v1","addr":"172.21.15.78:6803","nonce":3358701235}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6806","nonce":3358701235},{"type":"v1","addr":"172.21.15.78:6807","nonce":3358701235}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6804","nonce":3358701235},{"type":"v1","addr":"172.21.15.78:6805","nonce":3358701235}]},"public_addr":"172.21.15.78:6801/3358701235","cluster_addr":"172.21.15.78:6803/3358701235","heartbeat_back_addr":"172.21.15.78:6807/3358701235","heartbeat_front_addr":"172.21.15.78:6805/3358701235","state":["exists","up"]},{"osd":1,"uuid":"e634831d-c4e2-48d9-870c-9556ae162981","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6808","nonce":3211476654},{"type":"v1","addr":"172.21.15.78:6809","nonce":3211476654}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6810","nonce":3211476654},{"type":"v1","addr":"172.21.15.78:6811","nonce":3211476654}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6814","nonce":3211476654},{"type":"v1","addr":"172.21.15.78:6815","nonce":3211476654}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6812","nonce":3211476654},{"type":"v1","addr":"172.21.15.78:6813","nonce":3211476654}]},"public_addr":"172.21.15.78:6809/3211476654","cluster_addr":"172.21.15.78:6811/3211476654","heartbeat_back_addr":"172.21.15.78:6815/3211476654","heartbeat_front_addr":"172.21.15.78:6813/3211476654","state":["exists","up"]},{"osd":2,"uuid":"274c8395-6534-41f0-b8fb-a00af8985aa8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6816","nonce":2532904479},{"type":"v1","addr":"172.21.15.78:6817","nonce":2532904479}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6818","nonce":2532904479},{"type":"v1","addr":"172.21.15.78:6819","nonce":2532904479}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6822","nonce":2532904479},{"type":"v1","addr":"172.21.15.78:6823","nonce":2532904479}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6820","nonce":2532904479},{"type":"v1","addr":"172.21.15.78:6821","nonce":2532904479}]},"public_addr":"172.21.15.78:6817/2532904479","cluster_addr":"172.21.15.78:6819/2532904479","heartbeat_back_addr":"172.21.15.78:6823/2532904479","heartbeat_front_addr":"172.21.15.78:6821/2532904479","state":["exists","up"]},{"osd":3,"uuid":"77acc9af-7d4d-4b18-8cf5-d62f5971b7c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6824","nonce":3442991267},{"type":"v1","addr":"172.21.15.78:6825","nonce":3442991267}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6826","nonce":3442991267},{"type":"v1","addr":"172.21.15.78:6827","nonce":3442991267}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6830","nonce":3442991267},{"type":"v1","addr":"172.21.15.78:6831","nonce":3442991267}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6828","nonce":3442991267},{"type":"v1","addr":"172.21.15.78:6829","nonce":3442991267}]},"public_addr":"172.21.15.78:6825/3442991267","cluster_addr":"172.21.15.78:6827/3442991267","heartbeat_back_addr":"172.21.15.78:6831/3442991267","heartbeat_front_addr":"172.21.15.78:6829/3442991267","state":["exists","up"]},{"osd":4,"uuid":"5c62bc66-6b34-4b7f-a66b-9a743969138c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":802983577},{"type":"v1","addr":"172.21.15.179:6809","nonce":802983577}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":802983577},{"type":"v1","addr":"172.21.15.179:6811","nonce":802983577}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":802983577},{"type":"v1","addr":"172.21.15.179:6815","nonce":802983577}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":802983577},{"type":"v1","addr":"172.21.15.179:6813","nonce":802983577}]},"public_addr":"172.21.15.179:6809/802983577","cluster_addr":"172.21.15.179:6811/802983577","heartbeat_back_addr":"172.21.15.179:6815/802983577","heartbeat_front_addr":"172.21.15.179:6813/802983577","state":["exists","up"]},{"osd":5,"uuid":"67db6d36-f684-4079-b0cd-82b4dd61461f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":518192887},{"type":"v1","addr":"172.21.15.179:6818","nonce":518192887}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":518192887},{"type":"v1","addr":"172.21.15.179:6822","nonce":518192887}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":518192887},{"type":"v1","addr":"172.21.15.179:6829","nonce":518192887}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6824","nonce":518192887},{"type":"v1","addr":"172.21.15.179:6826","nonce":518192887}]},"public_addr":"172.21.15.179:6818/518192887","cluster_addr":"172.21.15.179:6822/518192887","heartbeat_back_addr":"172.21.15.179:6829/518192887","heartbeat_front_addr":"172.21.15.179:6826/518192887","state":["exists","up"]},{"osd":6,"uuid":"12e670af-5a16-4c81-9f97-defa66cab967","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":815435378},{"type":"v1","addr":"172.21.15.179:6801","nonce":815435378}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":815435378},{"type":"v1","addr":"172.21.15.179:6803","nonce":815435378}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":815435378},{"type":"v1","addr":"172.21.15.179:6807","nonce":815435378}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":815435378},{"type":"v1","addr":"172.21.15.179:6805","nonce":815435378}]},"public_addr":"172.21.15.179:6801/815435378","cluster_addr":"172.21.15.179:6803/815435378","heartbeat_back_addr":"172.21.15.179:6807/815435378","heartbeat_front_addr":"172.21.15.179:6805/815435378","state":["exists","up"]},{"osd":7,"uuid":"fe630650-2eb3-49ad-8676-c341e6332eb1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6817","nonce":2848432339},{"type":"v1","addr":"172.21.15.179:6819","nonce":2848432339}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6821","nonce":2848432339},{"type":"v1","addr":"172.21.15.179:6823","nonce":2848432339}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":2848432339},{"type":"v1","addr":"172.21.15.179:6831","nonce":2848432339}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6825","nonce":2848432339},{"type":"v1","addr":"172.21.15.179:6827","nonce":2848432339}]},"public_addr":"172.21.15.179:6819/2848432339","cluster_addr":"172.21.15.179:6823/2848432339","heartbeat_back_addr":"172.21.15.179:6831/2848432339","heartbeat_front_addr":"172.21.15.179:6827/2848432339","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:58:49.255433+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:58:49.412880+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:58:49.559295+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:58:49.245237+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:58:49.184557+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:58:49.329851+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:58:49.366012+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:58:49.349604+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-28T20:01:47.139 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:47.133+0000 7f66efbaa640 1 -- 172.21.15.78:0/1837543375 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f66cc066470 msgr2=0x7f66cc068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:01:47.139 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:47.133+0000 7f66efbaa640 1 --2- 172.21.15.78:0/1837543375 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f66cc066470 0x7f66cc068930 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f66e8070140 tx=0x7f66d8009190 comp rx=0 tx=0).stop 2023-11-28T20:01:47.140 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:47.133+0000 7f66efbaa640 1 -- 172.21.15.78:0/1837543375 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f66e806d2b0 msgr2=0x7f66e80ab120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:01:47.140 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:47.133+0000 7f66efbaa640 1 --2- 172.21.15.78:0/1837543375 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f66e806d2b0 0x7f66e80ab120 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 crypto rx=0x7f66e400c490 tx=0x7f66e400c950 comp rx=0 tx=0).stop 2023-11-28T20:01:47.140 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:47.133+0000 7f66efbaa640 1 -- 172.21.15.78:0/1837543375 shutdown_connections 2023-11-28T20:01:47.140 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:47.137+0000 7f66efbaa640 1 --2- 172.21.15.78:0/1837543375 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f66cc066470 0x7f66cc068930 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:47.140 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:47.137+0000 7f66efbaa640 1 --2- 172.21.15.78:0/1837543375 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f66e80c3b80 0x7f66e815a130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:47.140 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:47.137+0000 7f66efbaa640 1 --2- 172.21.15.78:0/1837543375 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f66e80c5300 0x7f66e80a5650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:47.140 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:47.137+0000 7f66efbaa640 1 --2- 172.21.15.78:0/1837543375 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f66e806d2b0 0x7f66e80ab120 unknown :-1 s=CLOSED pgs=788 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:47.140 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:47.137+0000 7f66efbaa640 1 -- 172.21.15.78:0/1837543375 >> 172.21.15.78:0/1837543375 conn(0x7f66e80a7810 msgr2=0x7f66e80a7bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:01:47.140 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:47.137+0000 7f66efbaa640 1 -- 172.21.15.78:0/1837543375 shutdown_connections 2023-11-28T20:01:47.140 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:47.137+0000 7f66efbaa640 1 -- 172.21.15.78:0/1837543375 wait complete. 2023-11-28T20:01:47.159 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-11-28T20:01:47.159 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-28T20:01:47.296 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:47.293+0000 7f24d8c32640 1 Processor -- start 2023-11-28T20:01:47.296 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:47.293+0000 7f24d8c32640 1 -- start start 2023-11-28T20:01:47.297 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:47.293+0000 7f24d8c32640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f24d406d2b0 0x7f24d406d690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:47.297 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:47.293+0000 7f24d8c32640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f24d40c5300 0x7f24d406c730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:47.297 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:47.293+0000 7f24d8c32640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f24d406bb80 con 0x7f24d40c3b80 2023-11-28T20:01:47.297 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:47.293+0000 7f24d8c32640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f24d406cc70 con 0x7f24d40c5300 2023-11-28T20:01:47.298 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:47.293+0000 7f24d8c32640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f24d40c5790 con 0x7f24d406d2b0 2023-11-28T20:01:47.299 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:47.293+0000 7f24d259c640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f24d406d2b0 0x7f24d406d690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:47.299 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:47.293+0000 7f24d2d9d640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f24d40c5300 0x7f24d406c730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:47.299 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:47.293+0000 7f24d259c640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f24d406d2b0 0x7f24d406d690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3301/0 says I am v2:172.21.15.78:59964/0 (socket says 172.21.15.78:59964) 2023-11-28T20:01:47.299 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:47.293+0000 7f24d259c640 1 -- 172.21.15.78:0/2737157887 learned_addr learned my addr 172.21.15.78:0/2737157887 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T20:01:47.299 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:47.293+0000 7f24c9d9b640 1 --1- 172.21.15.78:0/2737157887 >> v1:172.21.15.179:6789/0 conn(0x7f24d40c3b80 0x7f24d406c020 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.179:6789/0 says I am v1:172.21.15.78:56114/0 (socket says 172.21.15.78:56114) 2023-11-28T20:01:47.299 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:47.293+0000 7f24d259c640 1 -- 172.21.15.78:0/2737157887 >> v2:172.21.15.179:3300/0 conn(0x7f24d40c5300 msgr2=0x7f24d406c730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:01:47.299 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:47.293+0000 7f24d259c640 1 --2- 172.21.15.78:0/2737157887 >> v2:172.21.15.179:3300/0 conn(0x7f24d40c5300 0x7f24d406c730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:47.299 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:47.293+0000 7f24d259c640 1 -- 172.21.15.78:0/2737157887 >> v1:172.21.15.179:6789/0 conn(0x7f24d40c3b80 legacy=0x7f24d406c020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:01:47.299 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:47.293+0000 7f24d259c640 1 -- 172.21.15.78:0/2737157887 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24d41515c0 con 0x7f24d406d2b0 2023-11-28T20:01:47.301 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:47.297+0000 7f24d259c640 1 --2- 172.21.15.78:0/2737157887 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f24d406d2b0 0x7f24d406d690 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f24bc009870 tx=0x7f24bc01c510 comp rx=0 tx=0).ready entity=mon.2 client_cookie=98e688212a4ee691 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:01:47.301 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:47.297+0000 7f24d1d9b640 1 -- 172.21.15.78:0/2737157887 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24bc0ab620 con 0x7f24d406d2b0 2023-11-28T20:01:47.302 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:47.297+0000 7f24d1d9b640 1 -- 172.21.15.78:0/2737157887 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f24bc0ab780 con 0x7f24d406d2b0 2023-11-28T20:01:47.302 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:47.297+0000 7f24d1d9b640 1 -- 172.21.15.78:0/2737157887 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24bc0abb10 con 0x7f24d406d2b0 2023-11-28T20:01:47.302 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:47.297+0000 7f24d8c32640 1 -- 172.21.15.78:0/2737157887 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f24d406d2b0 msgr2=0x7f24d406d690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:01:47.302 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:47.297+0000 7f24d8c32640 1 --2- 172.21.15.78:0/2737157887 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f24d406d2b0 0x7f24d406d690 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f24bc009870 tx=0x7f24bc01c510 comp rx=0 tx=0).stop 2023-11-28T20:01:47.303 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:47.297+0000 7f24d8c32640 1 -- 172.21.15.78:0/2737157887 shutdown_connections 2023-11-28T20:01:47.303 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:47.297+0000 7f24d8c32640 1 --2- 172.21.15.78:0/2737157887 >> v2:172.21.15.179:3300/0 conn(0x7f24d40c5300 0x7f24d406c730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:47.303 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:47.297+0000 7f24d8c32640 1 --2- 172.21.15.78:0/2737157887 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f24d406d2b0 0x7f24d406d690 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:47.303 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:47.297+0000 7f24d8c32640 1 -- 172.21.15.78:0/2737157887 >> 172.21.15.78:0/2737157887 conn(0x7f24d40a7810 msgr2=0x7f24d40a7c20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:01:47.303 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:47.297+0000 7f24d8c32640 1 -- 172.21.15.78:0/2737157887 shutdown_connections 2023-11-28T20:01:47.303 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:47.297+0000 7f24d8c32640 1 -- 172.21.15.78:0/2737157887 wait complete. 2023-11-28T20:01:47.304 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:47.301+0000 7f24d8c32640 1 Processor -- start 2023-11-28T20:01:47.304 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:47.301+0000 7f24d8c32640 1 -- start start 2023-11-28T20:01:47.307 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:47.301+0000 7f24d8c32640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f24d406d2b0 0x7f24d4155170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:47.307 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:47.301+0000 7f24d8c32640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f24d40c3b80 0x7f24d4149330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:47.307 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:47.301+0000 7f24d8c32640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f24d40c5300 0x7f24d41ece70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:47.307 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:47.301+0000 7f24d8c32640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24d41501f0 con 0x7f24d40c3b80 2023-11-28T20:01:47.307 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:47.301+0000 7f24d8c32640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24d41f0fd0 con 0x7f24d40c5300 2023-11-28T20:01:47.308 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:47.301+0000 7f24d8c32640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f24d41f03e0 con 0x7f24d406d2b0 2023-11-28T20:01:47.308 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:47.301+0000 7f24c9d9b640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f24d40c3b80 0x7f24d4149330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:47.308 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:47.301+0000 7f24c9d9b640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f24d40c3b80 0x7f24d4149330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:60238/0 (socket says 172.21.15.78:60238) 2023-11-28T20:01:47.308 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:47.301+0000 7f24c9d9b640 1 -- 172.21.15.78:0/3327006510 learned_addr learned my addr 172.21.15.78:0/3327006510 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T20:01:47.309 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:47.301+0000 7f24d259c640 1 --2- 172.21.15.78:0/3327006510 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f24d406d2b0 0x7f24d4155170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:47.309 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:47.301+0000 7f24d2d9d640 1 --2- 172.21.15.78:0/3327006510 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f24d40c5300 0x7f24d41ece70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:47.309 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:47.301+0000 7f24c9d9b640 1 -- 172.21.15.78:0/3327006510 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f24d406d2b0 msgr2=0x7f24d4155170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:01:47.309 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:47.301+0000 7f24c9d9b640 1 --2- 172.21.15.78:0/3327006510 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f24d406d2b0 0x7f24d4155170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:47.310 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:47.301+0000 7f24c9d9b640 1 -- 172.21.15.78:0/3327006510 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f24d40c5300 msgr2=0x7f24d41ece70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:01:47.310 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:47.301+0000 7f24c9d9b640 1 --2- 172.21.15.78:0/3327006510 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f24d40c5300 0x7f24d41ece70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:47.310 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:47.301+0000 7f24c9d9b640 1 -- 172.21.15.78:0/3327006510 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24bc0094d0 con 0x7f24d40c3b80 2023-11-28T20:01:47.310 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:47.301+0000 7f24d259c640 1 --2- 172.21.15.78:0/3327006510 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f24d406d2b0 0x7f24d4155170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T20:01:47.310 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:47.301+0000 7f24c9d9b640 1 --2- 172.21.15.78:0/3327006510 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f24d40c3b80 0x7f24d4149330 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 crypto rx=0x7f24c400c490 tx=0x7f24c400c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:01:47.311 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:47.301+0000 7f24cb7fe640 1 -- 172.21.15.78:0/3327006510 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24c40074e0 con 0x7f24d40c3b80 2023-11-28T20:01:47.311 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:47.301+0000 7f24cb7fe640 1 -- 172.21.15.78:0/3327006510 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f24c4007640 con 0x7f24d40c3b80 2023-11-28T20:01:47.311 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:47.301+0000 7f24cb7fe640 1 -- 172.21.15.78:0/3327006510 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24c4004a10 con 0x7f24d40c3b80 2023-11-28T20:01:47.311 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:47.301+0000 7f24d8c32640 1 -- 172.21.15.78:0/3327006510 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f24d414ef80 con 0x7f24d40c3b80 2023-11-28T20:01:47.311 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:47.301+0000 7f24d8c32640 1 -- 172.21.15.78:0/3327006510 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f24d41f0910 con 0x7f24d40c3b80 2023-11-28T20:01:47.313 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:47.305+0000 7f24d8c32640 1 -- 172.21.15.78:0/3327006510 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f24d41f1110 con 0x7f24d40c3b80 2023-11-28T20:01:47.313 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:47.305+0000 7f24cb7fe640 1 -- 172.21.15.78:0/3327006510 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f24c4004b70 con 0x7f24d40c3b80 2023-11-28T20:01:47.313 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:47.305+0000 7f24cb7fe640 1 --2- 172.21.15.78:0/3327006510 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f24b4066470 0x7f24b4068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:47.313 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:47.305+0000 7f24cb7fe640 1 -- 172.21.15.78:0/3327006510 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 6885+0+0 (secure 0 0 0) 0x7f24c4083bf0 con 0x7f24d40c3b80 2023-11-28T20:01:47.313 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:47.305+0000 7f24d259c640 1 --2- 172.21.15.78:0/3327006510 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f24b4066470 0x7f24b4068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:47.313 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:47.305+0000 7f24d259c640 1 --2- 172.21.15.78:0/3327006510 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f24b4066470 0x7f24b4068930 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f24bc0af000 tx=0x7f24bc0b6040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:01:47.314 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:47.309+0000 7f24cb7fe640 1 -- 172.21.15.78:0/3327006510 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f24d41f1110 con 0x7f24d40c3b80 2023-11-28T20:01:47.494 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:47.489+0000 7f24d8c32640 1 -- 172.21.15.78:0/3327006510 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f24d41f1110 con 0x7f24d40c3b80 2023-11-28T20:01:47.495 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:47.489+0000 7f24cb7fe640 1 -- 172.21.15.78:0/3327006510 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 36 v36) v1 ==== 94+0+6130 (secure 0 0 0) 0x7f24d41f1110 con 0x7f24d40c3b80 2023-11-28T20:01:47.495 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-11-28T20:01:47.495 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":36,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5384,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6834/837155031","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6832","nonce":837155031},{"type":"v1","addr":"172.21.15.179:6834","nonce":837155031}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":27},{"gid":5387,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6835/752467462","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6833","nonce":752467462},{"type":"v1","addr":"172.21.15.179:6835","nonce":752467462}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":27}],"filesystems":[{"mdsmap":{"epoch":31,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-28T20:01:09.868520+0000","modified":"2023-11-28T20:01:12.907972+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5892},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5892":{"gid":5892,"name":"a","rank":0,"incarnation":28,"state":"up:active","state_seq":3,"addr":"172.21.15.78:6837/115607035","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6836","nonce":115607035},{"type":"v1","addr":"172.21.15.78:6837","nonce":115607035}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":4},{"mdsmap":{"epoch":36,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-28T20:01:23.178057+0000","modified":"2023-11-28T20:01:26.193482+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5889},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5889":{"gid":5889,"name":"c","rank":0,"incarnation":32,"state":"up:active","state_seq":6,"addr":"172.21.15.78:6835/1997036463","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6834","nonce":1997036463},{"type":"v1","addr":"172.21.15.78:6835","nonce":1997036463}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs2","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":5}]} 2023-11-28T20:01:47.495 INFO:teuthology.orchestra.run.smithi078.stderr:dumped fsmap epoch 36 2023-11-28T20:01:47.497 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:47.493+0000 7f24d8c32640 1 -- 172.21.15.78:0/3327006510 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f24b4066470 msgr2=0x7f24b4068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:01:47.497 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:47.493+0000 7f24d8c32640 1 --2- 172.21.15.78:0/3327006510 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f24b4066470 0x7f24b4068930 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f24bc0af000 tx=0x7f24bc0b6040 comp rx=0 tx=0).stop 2023-11-28T20:01:47.497 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:47.493+0000 7f24d8c32640 1 -- 172.21.15.78:0/3327006510 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f24d40c3b80 msgr2=0x7f24d4149330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:01:47.497 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:47.493+0000 7f24d8c32640 1 --2- 172.21.15.78:0/3327006510 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f24d40c3b80 0x7f24d4149330 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 crypto rx=0x7f24c400c490 tx=0x7f24c400c950 comp rx=0 tx=0).stop 2023-11-28T20:01:47.497 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:47.493+0000 7f24d8c32640 1 -- 172.21.15.78:0/3327006510 shutdown_connections 2023-11-28T20:01:47.497 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:47.493+0000 7f24d8c32640 1 --2- 172.21.15.78:0/3327006510 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f24b4066470 0x7f24b4068930 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:47.497 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:47.493+0000 7f24d8c32640 1 --2- 172.21.15.78:0/3327006510 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f24d40c5300 0x7f24d41ece70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:47.497 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:47.493+0000 7f24d8c32640 1 --2- 172.21.15.78:0/3327006510 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f24d40c3b80 0x7f24d4149330 unknown :-1 s=CLOSED pgs=789 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:47.497 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:47.493+0000 7f24d8c32640 1 --2- 172.21.15.78:0/3327006510 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f24d406d2b0 0x7f24d4155170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:47.497 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:47.493+0000 7f24d8c32640 1 -- 172.21.15.78:0/3327006510 >> 172.21.15.78:0/3327006510 conn(0x7f24d40a7810 msgr2=0x7f24d40c0840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:01:47.498 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:47.493+0000 7f24d8c32640 1 -- 172.21.15.78:0/3327006510 shutdown_connections 2023-11-28T20:01:47.498 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:47.493+0000 7f24d8c32640 1 -- 172.21.15.78:0/3327006510 wait complete. 2023-11-28T20:01:47.515 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-28T20:01:47.654 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:47.649+0000 7f623e3f8640 1 Processor -- start 2023-11-28T20:01:47.654 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:47.649+0000 7f623e3f8640 1 -- start start 2023-11-28T20:01:47.655 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:47.649+0000 7f623e3f8640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f6238071e30 0x7f62380722c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:47.655 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:47.649+0000 7f623e3f8640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f6238156110 0x7f6238156580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:47.655 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:47.649+0000 7f623e3f8640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f62380c5710 con 0x7f623814fd10 2023-11-28T20:01:47.655 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:47.649+0000 7f623e3f8640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f623806c5e0 con 0x7f6238156110 2023-11-28T20:01:47.655 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:47.649+0000 7f623e3f8640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6238155c80 con 0x7f6238071e30 2023-11-28T20:01:47.655 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:47.649+0000 7f623c995640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f6238156110 0x7f6238156580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:47.655 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:47.649+0000 7f623c995640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f6238156110 0x7f6238156580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:60248/0 (socket says 172.21.15.78:60248) 2023-11-28T20:01:47.655 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:47.649+0000 7f623c995640 1 -- 172.21.15.78:0/255385808 learned_addr learned my addr 172.21.15.78:0/255385808 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T20:01:47.656 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:47.653+0000 7f62377fe640 1 --2- 172.21.15.78:0/255385808 >> v2:172.21.15.179:3300/0 conn(0x7f6238071e30 0x7f62380722c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:47.656 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:47.653+0000 7f623c995640 1 -- 172.21.15.78:0/255385808 >> v2:172.21.15.179:3300/0 conn(0x7f6238071e30 msgr2=0x7f62380722c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:01:47.656 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:47.653+0000 7f623c995640 1 --2- 172.21.15.78:0/255385808 >> v2:172.21.15.179:3300/0 conn(0x7f6238071e30 0x7f62380722c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:47.656 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:47.653+0000 7f623c995640 1 -- 172.21.15.78:0/255385808 >> v1:172.21.15.179:6789/0 conn(0x7f623814fd10 legacy=0x7f62380a4dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:01:47.656 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:47.653+0000 7f623c995640 1 -- 172.21.15.78:0/255385808 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62380c4e70 con 0x7f6238156110 2023-11-28T20:01:47.657 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:47.653+0000 7f62377fe640 1 --2- 172.21.15.78:0/255385808 >> v2:172.21.15.179:3300/0 conn(0x7f6238071e30 0x7f62380722c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T20:01:47.658 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:47.653+0000 7f623c995640 1 --2- 172.21.15.78:0/255385808 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6238156110 0x7f6238156580 secure :-1 s=READY pgs=790 cs=0 l=1 rev1=1 crypto rx=0x7f6238066e30 tx=0x7f623001c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=461f768e5ec43d92 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:01:47.658 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:47.653+0000 7f6236ffd640 1 -- 172.21.15.78:0/255385808 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62300a5770 con 0x7f6238156110 2023-11-28T20:01:47.658 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:47.653+0000 7f6236ffd640 1 -- 172.21.15.78:0/255385808 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f62300a58d0 con 0x7f6238156110 2023-11-28T20:01:47.658 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:47.653+0000 7f6236ffd640 1 -- 172.21.15.78:0/255385808 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62300a5c60 con 0x7f6238156110 2023-11-28T20:01:47.659 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:47.653+0000 7f623e3f8640 1 -- 172.21.15.78:0/255385808 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6238156110 msgr2=0x7f6238156580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:01:47.659 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:47.653+0000 7f623e3f8640 1 --2- 172.21.15.78:0/255385808 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6238156110 0x7f6238156580 secure :-1 s=READY pgs=790 cs=0 l=1 rev1=1 crypto rx=0x7f6238066e30 tx=0x7f623001c8b0 comp rx=0 tx=0).stop 2023-11-28T20:01:47.659 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:47.657+0000 7f623e3f8640 1 -- 172.21.15.78:0/255385808 shutdown_connections 2023-11-28T20:01:47.660 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:47.657+0000 7f623e3f8640 1 --2- 172.21.15.78:0/255385808 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6238156110 0x7f6238156580 unknown :-1 s=CLOSED pgs=790 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:47.660 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:47.657+0000 7f623e3f8640 1 --2- 172.21.15.78:0/255385808 >> v2:172.21.15.179:3300/0 conn(0x7f6238071e30 0x7f62380722c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:47.660 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:47.657+0000 7f623e3f8640 1 -- 172.21.15.78:0/255385808 >> 172.21.15.78:0/255385808 conn(0x7f62380a7810 msgr2=0x7f62380a7c20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:01:47.660 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:47.657+0000 7f623e3f8640 1 -- 172.21.15.78:0/255385808 shutdown_connections 2023-11-28T20:01:47.660 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:47.657+0000 7f623e3f8640 1 -- 172.21.15.78:0/255385808 wait complete. 2023-11-28T20:01:47.660 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:47.657+0000 7f623e3f8640 1 Processor -- start 2023-11-28T20:01:47.661 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:47.657+0000 7f623e3f8640 1 -- start start 2023-11-28T20:01:47.663 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:47.657+0000 7f623e3f8640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6238071e30 0x7f623815a930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:47.664 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:47.657+0000 7f623e3f8640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f623814fd10 0x7f6238159540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:47.664 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:47.657+0000 7f623e3f8640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6238156110 0x7f623815b1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:47.664 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:47.657+0000 7f623e3f8640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62381526c0 con 0x7f623814fd10 2023-11-28T20:01:47.664 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:47.657+0000 7f623e3f8640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6238156e20 con 0x7f6238071e30 2023-11-28T20:01:47.664 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:47.657+0000 7f623e3f8640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f62381573a0 con 0x7f6238156110 2023-11-28T20:01:47.664 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:47.657+0000 7f62377fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f623814fd10 0x7f6238159540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:47.664 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:47.657+0000 7f62377fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f623814fd10 0x7f6238159540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:60260/0 (socket says 172.21.15.78:60260) 2023-11-28T20:01:47.664 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:47.657+0000 7f62377fe640 1 -- 172.21.15.78:0/2237073969 learned_addr learned my addr 172.21.15.78:0/2237073969 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T20:01:47.664 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:47.657+0000 7f6237fff640 1 --2- 172.21.15.78:0/2237073969 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6238071e30 0x7f623815a930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:47.664 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:47.657+0000 7f623c995640 1 --2- 172.21.15.78:0/2237073969 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6238156110 0x7f623815b1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:47.664 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:47.657+0000 7f62377fe640 1 -- 172.21.15.78:0/2237073969 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6238156110 msgr2=0x7f623815b1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:01:47.664 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:47.657+0000 7f62377fe640 1 --2- 172.21.15.78:0/2237073969 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6238156110 0x7f623815b1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:47.665 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:47.657+0000 7f62377fe640 1 -- 172.21.15.78:0/2237073969 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6238071e30 msgr2=0x7f623815a930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:01:47.665 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:47.657+0000 7f62377fe640 1 --2- 172.21.15.78:0/2237073969 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6238071e30 0x7f623815a930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:47.665 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:47.657+0000 7f62377fe640 1 -- 172.21.15.78:0/2237073969 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6230009b30 con 0x7f623814fd10 2023-11-28T20:01:47.665 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:47.657+0000 7f62377fe640 1 --2- 172.21.15.78:0/2237073969 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f623814fd10 0x7f6238159540 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 crypto rx=0x7f622c00d800 tx=0x7f622c00dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:01:47.665 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:47.657+0000 7f6234ff9640 1 -- 172.21.15.78:0/2237073969 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f622c00b6c0 con 0x7f623814fd10 2023-11-28T20:01:47.665 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:47.661+0000 7f6234ff9640 1 -- 172.21.15.78:0/2237073969 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f622c00b820 con 0x7f623814fd10 2023-11-28T20:01:47.665 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:47.661+0000 7f6234ff9640 1 -- 172.21.15.78:0/2237073969 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f622c00bbd0 con 0x7f623814fd10 2023-11-28T20:01:47.665 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:47.661+0000 7f623e3f8640 1 -- 172.21.15.78:0/2237073969 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f62381eb5a0 con 0x7f623814fd10 2023-11-28T20:01:47.665 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:47.661+0000 7f623e3f8640 1 -- 172.21.15.78:0/2237073969 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f62381eb190 con 0x7f623814fd10 2023-11-28T20:01:47.666 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:47.661+0000 7f623e3f8640 1 -- 172.21.15.78:0/2237073969 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6238152830 con 0x7f623814fd10 2023-11-28T20:01:47.666 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:47.661+0000 7f6234ff9640 1 -- 172.21.15.78:0/2237073969 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f622c00bd30 con 0x7f623814fd10 2023-11-28T20:01:47.666 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:47.661+0000 7f6234ff9640 1 --2- 172.21.15.78:0/2237073969 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f6224066470 0x7f6224068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:47.666 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:47.661+0000 7f6234ff9640 1 -- 172.21.15.78:0/2237073969 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 6885+0+0 (secure 0 0 0) 0x7f622c084820 con 0x7f623814fd10 2023-11-28T20:01:47.667 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:47.661+0000 7f6237fff640 1 --2- 172.21.15.78:0/2237073969 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f6224066470 0x7f6224068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:47.667 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:47.661+0000 7f6237fff640 1 --2- 172.21.15.78:0/2237073969 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f6224066470 0x7f6224068930 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f62380c1400 tx=0x7f6228009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:01:47.670 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:47.665+0000 7f6234ff9640 1 -- 172.21.15.78:0/2237073969 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f622c051800 con 0x7f623814fd10 2023-11-28T20:01:47.861 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:47.857+0000 7f623e3f8640 1 -- 172.21.15.78:0/2237073969 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f6238067630 con 0x7f623814fd10 2023-11-28T20:01:47.862 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:47.857+0000 7f6234ff9640 1 -- 172.21.15.78:0/2237073969 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 36 v36) v1 ==== 94+0+6130 (secure 0 0 0) 0x7f622c054e20 con 0x7f623814fd10 2023-11-28T20:01:47.862 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-11-28T20:01:47.863 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":36,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5384,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6834/837155031","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6832","nonce":837155031},{"type":"v1","addr":"172.21.15.179:6834","nonce":837155031}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":27},{"gid":5387,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6835/752467462","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6833","nonce":752467462},{"type":"v1","addr":"172.21.15.179:6835","nonce":752467462}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":27}],"filesystems":[{"mdsmap":{"epoch":31,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-28T20:01:09.868520+0000","modified":"2023-11-28T20:01:12.907972+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5892},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5892":{"gid":5892,"name":"a","rank":0,"incarnation":28,"state":"up:active","state_seq":3,"addr":"172.21.15.78:6837/115607035","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6836","nonce":115607035},{"type":"v1","addr":"172.21.15.78:6837","nonce":115607035}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":4},{"mdsmap":{"epoch":36,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-28T20:01:23.178057+0000","modified":"2023-11-28T20:01:26.193482+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5889},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5889":{"gid":5889,"name":"c","rank":0,"incarnation":32,"state":"up:active","state_seq":6,"addr":"172.21.15.78:6835/1997036463","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6834","nonce":1997036463},{"type":"v1","addr":"172.21.15.78:6835","nonce":1997036463}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs2","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":5}]} 2023-11-28T20:01:47.863 INFO:teuthology.orchestra.run.smithi078.stderr:dumped fsmap epoch 36 2023-11-28T20:01:47.864 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:47.861+0000 7f623e3f8640 1 -- 172.21.15.78:0/2237073969 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f6224066470 msgr2=0x7f6224068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:01:47.865 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:47.861+0000 7f623e3f8640 1 --2- 172.21.15.78:0/2237073969 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f6224066470 0x7f6224068930 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f62380c1400 tx=0x7f6228009040 comp rx=0 tx=0).stop 2023-11-28T20:01:47.865 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:47.861+0000 7f623e3f8640 1 -- 172.21.15.78:0/2237073969 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f623814fd10 msgr2=0x7f6238159540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:01:47.865 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:47.861+0000 7f623e3f8640 1 --2- 172.21.15.78:0/2237073969 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f623814fd10 0x7f6238159540 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 crypto rx=0x7f622c00d800 tx=0x7f622c00dcc0 comp rx=0 tx=0).stop 2023-11-28T20:01:47.865 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:47.861+0000 7f623e3f8640 1 -- 172.21.15.78:0/2237073969 shutdown_connections 2023-11-28T20:01:47.865 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:47.861+0000 7f623e3f8640 1 --2- 172.21.15.78:0/2237073969 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f6224066470 0x7f6224068930 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:47.865 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:47.861+0000 7f623e3f8640 1 --2- 172.21.15.78:0/2237073969 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6238156110 0x7f623815b1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:47.865 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:47.861+0000 7f623e3f8640 1 --2- 172.21.15.78:0/2237073969 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f623814fd10 0x7f6238159540 unknown :-1 s=CLOSED pgs=791 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:47.866 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:47.861+0000 7f623e3f8640 1 --2- 172.21.15.78:0/2237073969 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6238071e30 0x7f623815a930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:47.866 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:47.861+0000 7f623e3f8640 1 -- 172.21.15.78:0/2237073969 >> 172.21.15.78:0/2237073969 conn(0x7f62380a7810 msgr2=0x7f623815c210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:01:47.866 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:47.861+0000 7f623e3f8640 1 -- 172.21.15.78:0/2237073969 shutdown_connections 2023-11-28T20:01:47.866 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:47.861+0000 7f623e3f8640 1 -- 172.21.15.78:0/2237073969 wait complete. 2023-11-28T20:01:47.883 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-28T20:01:48.022 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:48.017+0000 7f7acbefd640 1 Processor -- start 2023-11-28T20:01:48.022 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:48.017+0000 7f7acbefd640 1 -- start start 2023-11-28T20:01:48.024 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:48.021+0000 7f7acbefd640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7ac4072580 0x7f7ac40c3960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:48.024 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:48.021+0000 7f7acbefd640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f7ac40c0460 0x7f7ac4155ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:48.024 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:48.021+0000 7f7acbefd640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7ac40c1a50 con 0x7f7ac40c0f30 2023-11-28T20:01:48.024 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:48.021+0000 7f7acbefd640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7ac40c08f0 con 0x7f7ac40c0460 2023-11-28T20:01:48.024 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:48.021+0000 7f7acbefd640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ac4159990 con 0x7f7ac4072580 2023-11-28T20:01:48.025 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:48.021+0000 7f7aca49a640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f7ac40c0460 0x7f7ac4155ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:48.025 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:48.021+0000 7f7aca49a640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f7ac40c0460 0x7f7ac4155ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:60262/0 (socket says 172.21.15.78:60262) 2023-11-28T20:01:48.025 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:48.021+0000 7f7aca49a640 1 -- 172.21.15.78:0/3111537905 learned_addr learned my addr 172.21.15.78:0/3111537905 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T20:01:48.025 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:48.021+0000 7f7ac9498640 1 --2- 172.21.15.78:0/3111537905 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7ac4072580 0x7f7ac40c3960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:48.025 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:48.021+0000 7f7aca49a640 1 -- 172.21.15.78:0/3111537905 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7ac4072580 msgr2=0x7f7ac40c3960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:01:48.025 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:48.021+0000 7f7aca49a640 1 --2- 172.21.15.78:0/3111537905 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7ac4072580 0x7f7ac40c3960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:48.025 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:48.021+0000 7f7aca49a640 1 -- 172.21.15.78:0/3111537905 >> v1:172.21.15.179:6789/0 conn(0x7f7ac40c0f30 legacy=0x7f7ac4159280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:01:48.026 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:48.021+0000 7f7aca49a640 1 -- 172.21.15.78:0/3111537905 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ac40c1ca0 con 0x7f7ac40c0460 2023-11-28T20:01:48.027 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:48.021+0000 7f7aca49a640 1 --2- 172.21.15.78:0/3111537905 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7ac40c0460 0x7f7ac4155ed0 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 crypto rx=0x7f7abc009e50 tx=0x7f7abc01c980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=88b6fe57290e61ed server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:01:48.027 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:48.025+0000 7f7ac8c97640 1 -- 172.21.15.78:0/3111537905 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7abc0a5750 con 0x7f7ac40c0460 2023-11-28T20:01:48.027 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:48.025+0000 7f7ac8c97640 1 -- 172.21.15.78:0/3111537905 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7abc0a58b0 con 0x7f7ac40c0460 2023-11-28T20:01:48.028 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:48.025+0000 7f7ac8c97640 1 -- 172.21.15.78:0/3111537905 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7abc0a5c40 con 0x7f7ac40c0460 2023-11-28T20:01:48.028 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:48.025+0000 7f7acbefd640 1 -- 172.21.15.78:0/3111537905 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7ac40c0460 msgr2=0x7f7ac4155ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:01:48.028 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:48.025+0000 7f7acbefd640 1 --2- 172.21.15.78:0/3111537905 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7ac40c0460 0x7f7ac4155ed0 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 crypto rx=0x7f7abc009e50 tx=0x7f7abc01c980 comp rx=0 tx=0).stop 2023-11-28T20:01:48.029 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:48.025+0000 7f7acbefd640 1 -- 172.21.15.78:0/3111537905 shutdown_connections 2023-11-28T20:01:48.029 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:48.025+0000 7f7acbefd640 1 --2- 172.21.15.78:0/3111537905 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7ac40c0460 0x7f7ac4155ed0 unknown :-1 s=CLOSED pgs=792 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:48.029 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:48.025+0000 7f7acbefd640 1 --2- 172.21.15.78:0/3111537905 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7ac4072580 0x7f7ac40c3960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:48.029 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:48.025+0000 7f7acbefd640 1 -- 172.21.15.78:0/3111537905 >> 172.21.15.78:0/3111537905 conn(0x7f7ac40a7810 msgr2=0x7f7ac40a7c20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:01:48.029 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:48.025+0000 7f7acbefd640 1 -- 172.21.15.78:0/3111537905 shutdown_connections 2023-11-28T20:01:48.029 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:48.025+0000 7f7acbefd640 1 -- 172.21.15.78:0/3111537905 wait complete. 2023-11-28T20:01:48.030 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:48.025+0000 7f7acbefd640 1 Processor -- start 2023-11-28T20:01:48.030 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:48.025+0000 7f7acbefd640 1 -- start start 2023-11-28T20:01:48.032 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:48.025+0000 7f7acbefd640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7ac4072580 0x7f7ac4155010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:48.032 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:48.025+0000 7f7acbefd640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7ac40c0460 0x7f7ac4153940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:48.032 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:48.025+0000 7f7acbefd640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7ac40c0f30 0x7f7ac40a8e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:48.033 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:48.025+0000 7f7acbefd640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ac4155550 con 0x7f7ac40c0f30 2023-11-28T20:01:48.033 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:48.025+0000 7f7acbefd640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ac41547a0 con 0x7f7ac40c0460 2023-11-28T20:01:48.033 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:48.025+0000 7f7acbefd640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ac4154220 con 0x7f7ac4072580 2023-11-28T20:01:48.033 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:48.025+0000 7f7aca49a640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7ac40c0f30 0x7f7ac40a8e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:48.033 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:48.025+0000 7f7aca49a640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7ac40c0f30 0x7f7ac40a8e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:60270/0 (socket says 172.21.15.78:60270) 2023-11-28T20:01:48.033 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:48.025+0000 7f7aca49a640 1 -- 172.21.15.78:0/3642028664 learned_addr learned my addr 172.21.15.78:0/3642028664 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T20:01:48.033 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:48.029+0000 7f7ac9c99640 1 --2- 172.21.15.78:0/3642028664 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7ac4072580 0x7f7ac4155010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:48.034 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:48.029+0000 7f7ac9498640 1 --2- 172.21.15.78:0/3642028664 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7ac40c0460 0x7f7ac4153940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:48.034 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:48.029+0000 7f7aca49a640 1 -- 172.21.15.78:0/3642028664 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7ac4072580 msgr2=0x7f7ac4155010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:01:48.034 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:48.029+0000 7f7aca49a640 1 --2- 172.21.15.78:0/3642028664 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7ac4072580 0x7f7ac4155010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:48.034 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:48.029+0000 7f7aca49a640 1 -- 172.21.15.78:0/3642028664 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7ac40c0460 msgr2=0x7f7ac4153940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:01:48.034 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:48.029+0000 7f7aca49a640 1 --2- 172.21.15.78:0/3642028664 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7ac40c0460 0x7f7ac4153940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:48.034 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:48.029+0000 7f7aca49a640 1 -- 172.21.15.78:0/3642028664 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7abc009b30 con 0x7f7ac40c0f30 2023-11-28T20:01:48.034 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:48.029+0000 7f7ac9c99640 1 --2- 172.21.15.78:0/3642028664 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7ac4072580 0x7f7ac4155010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T20:01:48.034 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:48.029+0000 7f7ac9498640 1 --2- 172.21.15.78:0/3642028664 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7ac40c0460 0x7f7ac4153940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T20:01:48.035 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:48.029+0000 7f7aca49a640 1 --2- 172.21.15.78:0/3642028664 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7ac40c0f30 0x7f7ac40a8e80 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 crypto rx=0x7f7abc0af040 tx=0x7f7abc019720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:01:48.035 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:48.029+0000 7f7aba7fc640 1 -- 172.21.15.78:0/3642028664 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7abc0b8670 con 0x7f7ac40c0f30 2023-11-28T20:01:48.035 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:48.029+0000 7f7aba7fc640 1 -- 172.21.15.78:0/3642028664 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7abc0b87d0 con 0x7f7ac40c0f30 2023-11-28T20:01:48.035 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:48.029+0000 7f7aba7fc640 1 -- 172.21.15.78:0/3642028664 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7abc0b8b80 con 0x7f7ac40c0f30 2023-11-28T20:01:48.035 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:48.029+0000 7f7acbefd640 1 -- 172.21.15.78:0/3642028664 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7ac4154d30 con 0x7f7ac40c0f30 2023-11-28T20:01:48.035 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:48.029+0000 7f7acbefd640 1 -- 172.21.15.78:0/3642028664 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7ac4071f80 con 0x7f7ac40c0f30 2023-11-28T20:01:48.036 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:48.029+0000 7f7acbefd640 1 -- 172.21.15.78:0/3642028664 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7ac40a8ba0 con 0x7f7ac40c0f30 2023-11-28T20:01:48.036 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:48.029+0000 7f7aba7fc640 1 -- 172.21.15.78:0/3642028664 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f7abc0b8ce0 con 0x7f7ac40c0f30 2023-11-28T20:01:48.036 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:48.029+0000 7f7aba7fc640 1 --2- 172.21.15.78:0/3642028664 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f7aa8066470 0x7f7aa8068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:48.037 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:48.029+0000 7f7aba7fc640 1 -- 172.21.15.78:0/3642028664 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(66..66 src has 1..66) v4 ==== 7030+0+0 (secure 0 0 0) 0x7f7abc11f5d0 con 0x7f7ac40c0f30 2023-11-28T20:01:48.037 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:48.029+0000 7f7ac9c99640 1 --2- 172.21.15.78:0/3642028664 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f7aa8066470 0x7f7aa8068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:48.037 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:48.033+0000 7f7ac9c99640 1 --2- 172.21.15.78:0/3642028664 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f7aa8066470 0x7f7aa8068930 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f7ac40719f0 tx=0x7f7ac0009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:01:48.038 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:48.033+0000 7f7aba7fc640 1 -- 172.21.15.78:0/3642028664 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f7abc0ec660 con 0x7f7ac40c0f30 2023-11-28T20:01:48.191 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:48.189+0000 7f7acbefd640 1 -- 172.21.15.78:0/3642028664 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7ac4067630 con 0x7f7ac40c0f30 2023-11-28T20:01:48.192 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:48.189+0000 7f7aba7fc640 1 -- 172.21.15.78:0/3642028664 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v66) v1 ==== 74+0+20650 (secure 0 0 0) 0x7f7abc009510 con 0x7f7ac40c0f30 2023-11-28T20:01:48.193 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-11-28T20:01:48.193 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":66,"fsid":"dd9780e8-3bda-44fa-a9f0-fa07d19d901d","created":"2023-11-28T19:58:40.969556+0000","modified":"2023-11-28T20:01:47.785262+0000","last_up_change":"2023-11-28T19:58:52.596716+0000","last_in_change":"2023-11-28T19:58:43.609275+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":12,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-28T19:58:54.011229+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_metadata","create_time":"2023-11-28T20:01:07.969267+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"60","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_data","create_time":"2023-11-28T20:01:08.865465+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"61","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs2_metadata","create_time":"2023-11-28T20:01:20.863763+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"64","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs2_data","create_time":"2023-11-28T20:01:22.176918+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"65","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs2"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e84245ac-b5da-429e-af18-39acaa2b33e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6800","nonce":3358701235},{"type":"v1","addr":"172.21.15.78:6801","nonce":3358701235}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6802","nonce":3358701235},{"type":"v1","addr":"172.21.15.78:6803","nonce":3358701235}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6806","nonce":3358701235},{"type":"v1","addr":"172.21.15.78:6807","nonce":3358701235}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6804","nonce":3358701235},{"type":"v1","addr":"172.21.15.78:6805","nonce":3358701235}]},"public_addr":"172.21.15.78:6801/3358701235","cluster_addr":"172.21.15.78:6803/3358701235","heartbeat_back_addr":"172.21.15.78:6807/3358701235","heartbeat_front_addr":"172.21.15.78:6805/3358701235","state":["exists","up"]},{"osd":1,"uuid":"e634831d-c4e2-48d9-870c-9556ae162981","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6808","nonce":3211476654},{"type":"v1","addr":"172.21.15.78:6809","nonce":3211476654}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6810","nonce":3211476654},{"type":"v1","addr":"172.21.15.78:6811","nonce":3211476654}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6814","nonce":3211476654},{"type":"v1","addr":"172.21.15.78:6815","nonce":3211476654}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6812","nonce":3211476654},{"type":"v1","addr":"172.21.15.78:6813","nonce":3211476654}]},"public_addr":"172.21.15.78:6809/3211476654","cluster_addr":"172.21.15.78:6811/3211476654","heartbeat_back_addr":"172.21.15.78:6815/3211476654","heartbeat_front_addr":"172.21.15.78:6813/3211476654","state":["exists","up"]},{"osd":2,"uuid":"274c8395-6534-41f0-b8fb-a00af8985aa8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6816","nonce":2532904479},{"type":"v1","addr":"172.21.15.78:6817","nonce":2532904479}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6818","nonce":2532904479},{"type":"v1","addr":"172.21.15.78:6819","nonce":2532904479}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6822","nonce":2532904479},{"type":"v1","addr":"172.21.15.78:6823","nonce":2532904479}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6820","nonce":2532904479},{"type":"v1","addr":"172.21.15.78:6821","nonce":2532904479}]},"public_addr":"172.21.15.78:6817/2532904479","cluster_addr":"172.21.15.78:6819/2532904479","heartbeat_back_addr":"172.21.15.78:6823/2532904479","heartbeat_front_addr":"172.21.15.78:6821/2532904479","state":["exists","up"]},{"osd":3,"uuid":"77acc9af-7d4d-4b18-8cf5-d62f5971b7c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6824","nonce":3442991267},{"type":"v1","addr":"172.21.15.78:6825","nonce":3442991267}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6826","nonce":3442991267},{"type":"v1","addr":"172.21.15.78:6827","nonce":3442991267}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6830","nonce":3442991267},{"type":"v1","addr":"172.21.15.78:6831","nonce":3442991267}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6828","nonce":3442991267},{"type":"v1","addr":"172.21.15.78:6829","nonce":3442991267}]},"public_addr":"172.21.15.78:6825/3442991267","cluster_addr":"172.21.15.78:6827/3442991267","heartbeat_back_addr":"172.21.15.78:6831/3442991267","heartbeat_front_addr":"172.21.15.78:6829/3442991267","state":["exists","up"]},{"osd":4,"uuid":"5c62bc66-6b34-4b7f-a66b-9a743969138c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":802983577},{"type":"v1","addr":"172.21.15.179:6809","nonce":802983577}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":802983577},{"type":"v1","addr":"172.21.15.179:6811","nonce":802983577}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":802983577},{"type":"v1","addr":"172.21.15.179:6815","nonce":802983577}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":802983577},{"type":"v1","addr":"172.21.15.179:6813","nonce":802983577}]},"public_addr":"172.21.15.179:6809/802983577","cluster_addr":"172.21.15.179:6811/802983577","heartbeat_back_addr":"172.21.15.179:6815/802983577","heartbeat_front_addr":"172.21.15.179:6813/802983577","state":["exists","up"]},{"osd":5,"uuid":"67db6d36-f684-4079-b0cd-82b4dd61461f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":518192887},{"type":"v1","addr":"172.21.15.179:6818","nonce":518192887}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":518192887},{"type":"v1","addr":"172.21.15.179:6822","nonce":518192887}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":518192887},{"type":"v1","addr":"172.21.15.179:6829","nonce":518192887}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6824","nonce":518192887},{"type":"v1","addr":"172.21.15.179:6826","nonce":518192887}]},"public_addr":"172.21.15.179:6818/518192887","cluster_addr":"172.21.15.179:6822/518192887","heartbeat_back_addr":"172.21.15.179:6829/518192887","heartbeat_front_addr":"172.21.15.179:6826/518192887","state":["exists","up"]},{"osd":6,"uuid":"12e670af-5a16-4c81-9f97-defa66cab967","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":815435378},{"type":"v1","addr":"172.21.15.179:6801","nonce":815435378}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":815435378},{"type":"v1","addr":"172.21.15.179:6803","nonce":815435378}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":815435378},{"type":"v1","addr":"172.21.15.179:6807","nonce":815435378}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":815435378},{"type":"v1","addr":"172.21.15.179:6805","nonce":815435378}]},"public_addr":"172.21.15.179:6801/815435378","cluster_addr":"172.21.15.179:6803/815435378","heartbeat_back_addr":"172.21.15.179:6807/815435378","heartbeat_front_addr":"172.21.15.179:6805/815435378","state":["exists","up"]},{"osd":7,"uuid":"fe630650-2eb3-49ad-8676-c341e6332eb1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6817","nonce":2848432339},{"type":"v1","addr":"172.21.15.179:6819","nonce":2848432339}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6821","nonce":2848432339},{"type":"v1","addr":"172.21.15.179:6823","nonce":2848432339}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":2848432339},{"type":"v1","addr":"172.21.15.179:6831","nonce":2848432339}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6825","nonce":2848432339},{"type":"v1","addr":"172.21.15.179:6827","nonce":2848432339}]},"public_addr":"172.21.15.179:6819/2848432339","cluster_addr":"172.21.15.179:6823/2848432339","heartbeat_back_addr":"172.21.15.179:6831/2848432339","heartbeat_front_addr":"172.21.15.179:6827/2848432339","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:58:49.255433+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:58:49.412880+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:58:49.559295+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:58:49.245237+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:58:49.184557+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:58:49.329851+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:58:49.366012+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:58:49.349604+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"9.11","mappings":[{"from":7,"to":2}]},{"pgid":"10.2","mappings":[{"from":1,"to":3}]},{"pgid":"10.1d","mappings":[{"from":4,"to":3}]},{"pgid":"10.34","mappings":[{"from":7,"to":3}]},{"pgid":"10.37","mappings":[{"from":4,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-28T20:01:48.195 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:48.189+0000 7f7acbefd640 1 -- 172.21.15.78:0/3642028664 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f7aa8066470 msgr2=0x7f7aa8068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:01:48.195 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:48.189+0000 7f7acbefd640 1 --2- 172.21.15.78:0/3642028664 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f7aa8066470 0x7f7aa8068930 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f7ac40719f0 tx=0x7f7ac0009040 comp rx=0 tx=0).stop 2023-11-28T20:01:48.195 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:48.189+0000 7f7acbefd640 1 -- 172.21.15.78:0/3642028664 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7ac40c0f30 msgr2=0x7f7ac40a8e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:01:48.195 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:48.189+0000 7f7acbefd640 1 --2- 172.21.15.78:0/3642028664 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7ac40c0f30 0x7f7ac40a8e80 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 crypto rx=0x7f7abc0af040 tx=0x7f7abc019720 comp rx=0 tx=0).stop 2023-11-28T20:01:48.195 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:48.189+0000 7f7acbefd640 1 -- 172.21.15.78:0/3642028664 shutdown_connections 2023-11-28T20:01:48.195 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:48.189+0000 7f7acbefd640 1 --2- 172.21.15.78:0/3642028664 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f7aa8066470 0x7f7aa8068930 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:48.195 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:48.189+0000 7f7acbefd640 1 --2- 172.21.15.78:0/3642028664 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7ac40c0f30 0x7f7ac40a8e80 unknown :-1 s=CLOSED pgs=793 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:48.195 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:48.189+0000 7f7acbefd640 1 --2- 172.21.15.78:0/3642028664 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7ac40c0460 0x7f7ac4153940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:48.196 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:48.189+0000 7f7acbefd640 1 --2- 172.21.15.78:0/3642028664 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7ac4072580 0x7f7ac4155010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:48.196 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:48.189+0000 7f7acbefd640 1 -- 172.21.15.78:0/3642028664 >> 172.21.15.78:0/3642028664 conn(0x7f7ac40a7810 msgr2=0x7f7ac406bdf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:01:48.196 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:48.189+0000 7f7acbefd640 1 -- 172.21.15.78:0/3642028664 shutdown_connections 2023-11-28T20:01:48.196 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:48.193+0000 7f7acbefd640 1 -- 172.21.15.78:0/3642028664 wait complete. 2023-11-28T20:01:48.214 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-11-28T20:01:48.353 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:48.349+0000 7fab060fe640 1 Processor -- start 2023-11-28T20:01:48.354 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:48.349+0000 7fab060fe640 1 -- start start 2023-11-28T20:01:48.354 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:48.349+0000 7fab060fe640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fab000c2110 0x7fab000c5ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:48.355 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:48.349+0000 7fab060fe640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fab000a93d0 con 0x7fab00154390 2023-11-28T20:01:48.355 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:48.349+0000 7fab060fe640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fab000a9640 con 0x7fab000c0c80 2023-11-28T20:01:48.355 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:48.349+0000 7fab060fe640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fab000aa1c0 con 0x7fab000c2110 2023-11-28T20:01:48.355 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:48.349+0000 7faaff7fe640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7fab00154390 0x7fab000c4a40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:52992/0 (socket says 172.21.15.78:52992) 2023-11-28T20:01:48.355 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:48.349+0000 7faaff7fe640 1 -- 172.21.15.78:0/3002881738 learned_addr learned my addr 172.21.15.78:0/3002881738 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-11-28T20:01:48.357 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:48.349+0000 7faaf7fff640 1 --2- 172.21.15.78:0/3002881738 >> v2:172.21.15.179:3300/0 conn(0x7fab000c2110 0x7fab000c5ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:48.358 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:48.349+0000 7faafeffd640 1 -- 172.21.15.78:0/3002881738 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 556677169 0 0) 0x7fab000a93d0 con 0x7fab00154390 2023-11-28T20:01:48.358 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:48.353+0000 7faafeffd640 1 -- 172.21.15.78:0/3002881738 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7faaec003530 con 0x7fab00154390 2023-11-28T20:01:48.358 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:48.353+0000 7faafeffd640 1 -- 172.21.15.78:0/3002881738 <== mon.0 v1:172.21.15.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 331181660 0 0) 0x7faaec003530 con 0x7fab00154390 2023-11-28T20:01:48.358 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:48.353+0000 7faafeffd640 1 -- 172.21.15.78:0/3002881738 >> v2:172.21.15.179:3300/0 conn(0x7fab000c2110 msgr2=0x7fab000c5ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:01:48.358 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:48.353+0000 7faafeffd640 1 --2- 172.21.15.78:0/3002881738 >> v2:172.21.15.179:3300/0 conn(0x7fab000c2110 0x7fab000c5ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:48.358 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:48.353+0000 7faafeffd640 1 -- 172.21.15.78:0/3002881738 >> v1:172.21.15.179:6789/0 conn(0x7fab000c0c80 legacy=0x7fab000c61e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:01:48.358 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:48.353+0000 7faafeffd640 1 -- 172.21.15.78:0/3002881738 --> v1:172.21.15.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab000a9920 con 0x7fab00154390 2023-11-28T20:01:48.359 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:48.353+0000 7faafeffd640 1 -- 172.21.15.78:0/3002881738 <== mon.0 v1:172.21.15.78:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3326804700 0 0) 0x7faaf0001680 con 0x7fab00154390 2023-11-28T20:01:48.359 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:48.353+0000 7faafeffd640 1 -- 172.21.15.78:0/3002881738 >> v1:172.21.15.78:6789/0 conn(0x7fab00154390 legacy=0x7fab000c4a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:01:48.359 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:48.353+0000 7faafeffd640 1 --2- 172.21.15.78:0/3002881738 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7faaec003980 0x7faaec003d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:48.359 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:48.353+0000 7faafeffd640 1 --2- 172.21.15.78:0/3002881738 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7faaec0047d0 0x7faaec004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:48.359 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:48.353+0000 7faafeffd640 1 --2- 172.21.15.78:0/3002881738 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7faaec005190 0x7faaec00b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:48.359 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:48.353+0000 7faafeffd640 1 -- 172.21.15.78:0/3002881738 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab000aa1c0 con 0x7faaec003980 2023-11-28T20:01:48.359 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:48.353+0000 7faafeffd640 1 -- 172.21.15.78:0/3002881738 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faaec00bfe0 con 0x7faaec0047d0 2023-11-28T20:01:48.359 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:48.353+0000 7faafeffd640 1 -- 172.21.15.78:0/3002881738 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faaec00c1a0 con 0x7faaec005190 2023-11-28T20:01:48.359 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:48.353+0000 7faaff7fe640 1 --2- 172.21.15.78:0/3002881738 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7faaec003980 0x7faaec003d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:48.359 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:48.353+0000 7faafffff640 1 --2- 172.21.15.78:0/3002881738 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7faaec005190 0x7faaec00b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:48.359 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:48.353+0000 7faaf7fff640 1 --2- 172.21.15.78:0/3002881738 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7faaec0047d0 0x7faaec004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:48.359 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:48.353+0000 7faaff7fe640 1 -- 172.21.15.78:0/3002881738 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7faaec005190 msgr2=0x7faaec00b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:01:48.360 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:48.353+0000 7faaff7fe640 1 --2- 172.21.15.78:0/3002881738 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7faaec005190 0x7faaec00b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:48.360 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:48.353+0000 7faaff7fe640 1 -- 172.21.15.78:0/3002881738 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7faaec0047d0 msgr2=0x7faaec004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:01:48.360 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:48.353+0000 7faaff7fe640 1 --2- 172.21.15.78:0/3002881738 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7faaec0047d0 0x7faaec004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:48.360 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:48.353+0000 7faaff7fe640 1 -- 172.21.15.78:0/3002881738 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faaec003530 con 0x7faaec003980 2023-11-28T20:01:48.361 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:48.353+0000 7faaf7fff640 1 --2- 172.21.15.78:0/3002881738 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7faaec0047d0 0x7faaec004c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T20:01:48.361 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:48.353+0000 7faafffff640 1 -- 172.21.15.78:0/3002881738 reap_dead start 2023-11-28T20:01:48.362 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:48.357+0000 7faaff7fe640 1 --2- 172.21.15.78:0/3002881738 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7faaec003980 0x7faaec003d60 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 crypto rx=0x7faaf000c190 tx=0x7faaf001cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=57fdf31c62d13c98 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:01:48.362 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:48.357+0000 7faafeffd640 1 -- 172.21.15.78:0/3002881738 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faaf0005ae0 con 0x7faaec003980 2023-11-28T20:01:48.362 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:48.357+0000 7faafeffd640 1 -- 172.21.15.78:0/3002881738 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faaf0005c40 con 0x7faaec003980 2023-11-28T20:01:48.362 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:48.357+0000 7faafeffd640 1 -- 172.21.15.78:0/3002881738 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faaf00a5780 con 0x7faaec003980 2023-11-28T20:01:48.362 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:48.357+0000 7fab060fe640 1 -- 172.21.15.78:0/3002881738 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7faaec003980 msgr2=0x7faaec003d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:01:48.362 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:48.357+0000 7fab060fe640 1 --2- 172.21.15.78:0/3002881738 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7faaec003980 0x7faaec003d60 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 crypto rx=0x7faaf000c190 tx=0x7faaf001cc20 comp rx=0 tx=0).stop 2023-11-28T20:01:48.363 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:48.357+0000 7fab060fe640 1 -- 172.21.15.78:0/3002881738 shutdown_connections 2023-11-28T20:01:48.363 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:48.357+0000 7fab060fe640 1 --2- 172.21.15.78:0/3002881738 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7faaec003980 0x7faaec003d60 unknown :-1 s=CLOSED pgs=795 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:48.363 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:48.357+0000 7fab060fe640 1 -- 172.21.15.78:0/3002881738 >> 172.21.15.78:0/3002881738 conn(0x7fab0006b220 msgr2=0x7fab000a77e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:01:48.363 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:48.357+0000 7fab060fe640 1 -- 172.21.15.78:0/3002881738 shutdown_connections 2023-11-28T20:01:48.363 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:48.357+0000 7fab060fe640 1 -- 172.21.15.78:0/3002881738 wait complete. 2023-11-28T20:01:48.363 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:48.357+0000 7fab060fe640 1 Processor -- start 2023-11-28T20:01:48.363 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:48.357+0000 7fab060fe640 1 -- start start 2023-11-28T20:01:48.365 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:48.357+0000 7fab060fe640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7faaec003980 0x7fab001e2860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:48.365 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:48.357+0000 7fab060fe640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fab001e1600 0x7fab001ecd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:48.365 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:48.357+0000 7fab060fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fab000a6c20 0x7fab000a70a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:48.365 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:48.357+0000 7fab060fe640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab0014a5e0 con 0x7fab000a6c20 2023-11-28T20:01:48.365 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:48.357+0000 7fab060fe640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab00071880 con 0x7fab001e1600 2023-11-28T20:01:48.365 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:48.357+0000 7fab060fe640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab001e20a0 con 0x7faaec003980 2023-11-28T20:01:48.365 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:48.357+0000 7faafffff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fab000a6c20 0x7fab000a70a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:48.365 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:48.357+0000 7faafffff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fab000a6c20 0x7fab000a70a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:60292/0 (socket says 172.21.15.78:60292) 2023-11-28T20:01:48.366 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:48.357+0000 7faafffff640 1 -- 172.21.15.78:0/2336048795 learned_addr learned my addr 172.21.15.78:0/2336048795 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T20:01:48.366 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:48.361+0000 7faaff7fe640 1 --2- 172.21.15.78:0/2336048795 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7faaec003980 0x7fab001e2860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:48.366 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:48.361+0000 7faaf7fff640 1 --2- 172.21.15.78:0/2336048795 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fab001e1600 0x7fab001ecd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:48.366 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:48.361+0000 7faafffff640 1 -- 172.21.15.78:0/2336048795 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7faaec003980 msgr2=0x7fab001e2860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:01:48.366 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:48.361+0000 7faafffff640 1 --2- 172.21.15.78:0/2336048795 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7faaec003980 0x7fab001e2860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:48.366 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:48.361+0000 7faafffff640 1 -- 172.21.15.78:0/2336048795 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fab001e1600 msgr2=0x7fab001ecd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:01:48.366 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:48.361+0000 7faafffff640 1 --2- 172.21.15.78:0/2336048795 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fab001e1600 0x7fab001ecd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:48.366 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:48.361+0000 7faafffff640 1 -- 172.21.15.78:0/2336048795 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab000a7960 con 0x7fab000a6c20 2023-11-28T20:01:48.366 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:48.361+0000 7faafffff640 1 --2- 172.21.15.78:0/2336048795 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fab000a6c20 0x7fab000a70a0 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 crypto rx=0x7fab000bfe20 tx=0x7faaf800eb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:01:48.366 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:48.361+0000 7faafcff9640 1 -- 172.21.15.78:0/2336048795 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faaf8003980 con 0x7fab000a6c20 2023-11-28T20:01:48.366 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:48.361+0000 7faafcff9640 1 -- 172.21.15.78:0/2336048795 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faaf8003ae0 con 0x7fab000a6c20 2023-11-28T20:01:48.367 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:48.361+0000 7faafcff9640 1 -- 172.21.15.78:0/2336048795 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faaf8003e90 con 0x7fab000a6c20 2023-11-28T20:01:48.367 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:48.361+0000 7fab060fe640 1 -- 172.21.15.78:0/2336048795 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fab001e2340 con 0x7fab000a6c20 2023-11-28T20:01:48.367 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:48.361+0000 7fab060fe640 1 -- 172.21.15.78:0/2336048795 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fab0014a240 con 0x7fab000a6c20 2023-11-28T20:01:48.367 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:48.361+0000 7fab060fe640 1 -- 172.21.15.78:0/2336048795 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fab001e2530 con 0x7fab000a6c20 2023-11-28T20:01:48.368 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:48.361+0000 7faafcff9640 1 -- 172.21.15.78:0/2336048795 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7faaf80050d0 con 0x7fab000a6c20 2023-11-28T20:01:48.368 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:48.361+0000 7faafcff9640 1 --2- 172.21.15.78:0/2336048795 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7faae0066470 0x7faae0068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:48.368 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:48.361+0000 7faafcff9640 1 -- 172.21.15.78:0/2336048795 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(66..66 src has 1..66) v4 ==== 7030+0+0 (secure 0 0 0) 0x7faaf8084210 con 0x7fab000a6c20 2023-11-28T20:01:48.368 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:48.361+0000 7faaff7fe640 1 --2- 172.21.15.78:0/2336048795 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7faae0066470 0x7faae0068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:48.368 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:48.365+0000 7faaff7fe640 1 --2- 172.21.15.78:0/2336048795 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7faae0066470 0x7faae0068930 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7faaf00ab000 tx=0x7faaf00b1040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:01:48.371 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:48.365+0000 7faafcff9640 1 -- 172.21.15.78:0/2336048795 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7faaf8054bf0 con 0x7fab000a6c20 2023-11-28T20:01:48.552 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:48.545+0000 7fab060fe640 1 -- 172.21.15.78:0/2336048795 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7fab00067630 con 0x7fab000a6c20 2023-11-28T20:01:48.552 INFO:tasks.ceph.mon.a.smithi078.stderr:2023-11-28T20:01:48.549+0000 7f3f494a3640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-11-28T20:01:48.554 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:48.549+0000 7faafcff9640 1 -- 172.21.15.78:0/2336048795 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v37) v1 ==== 161+0+0 (secure 0 0 0) 0x7faaf8054780 con 0x7fab000a6c20 2023-11-28T20:01:48.554 INFO:teuthology.orchestra.run.smithi078.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-11-28T20:01:48.556 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:48.553+0000 7fab060fe640 1 -- 172.21.15.78:0/2336048795 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7faae0066470 msgr2=0x7faae0068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:01:48.557 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:48.553+0000 7fab060fe640 1 --2- 172.21.15.78:0/2336048795 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7faae0066470 0x7faae0068930 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7faaf00ab000 tx=0x7faaf00b1040 comp rx=0 tx=0).stop 2023-11-28T20:01:48.557 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:48.553+0000 7fab060fe640 1 -- 172.21.15.78:0/2336048795 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fab000a6c20 msgr2=0x7fab000a70a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:01:48.557 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:48.553+0000 7fab060fe640 1 --2- 172.21.15.78:0/2336048795 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fab000a6c20 0x7fab000a70a0 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 crypto rx=0x7fab000bfe20 tx=0x7faaf800eb90 comp rx=0 tx=0).stop 2023-11-28T20:01:48.557 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:48.553+0000 7fab060fe640 1 -- 172.21.15.78:0/2336048795 shutdown_connections 2023-11-28T20:01:48.557 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:48.553+0000 7fab060fe640 1 --2- 172.21.15.78:0/2336048795 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7faae0066470 0x7faae0068930 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:48.557 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:48.553+0000 7fab060fe640 1 --2- 172.21.15.78:0/2336048795 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fab000a6c20 0x7fab000a70a0 unknown :-1 s=CLOSED pgs=796 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:48.557 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:48.553+0000 7fab060fe640 1 --2- 172.21.15.78:0/2336048795 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fab001e1600 0x7fab001ecd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:48.557 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:48.553+0000 7fab060fe640 1 --2- 172.21.15.78:0/2336048795 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7faaec003980 0x7fab001e2860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:48.557 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:48.553+0000 7fab060fe640 1 -- 172.21.15.78:0/2336048795 >> 172.21.15.78:0/2336048795 conn(0x7fab0006b220 msgr2=0x7fab000c3910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:01:48.557 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:48.553+0000 7fab060fe640 1 -- 172.21.15.78:0/2336048795 shutdown_connections 2023-11-28T20:01:48.557 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:48.553+0000 7fab060fe640 1 -- 172.21.15.78:0/2336048795 wait complete. 2023-11-28T20:01:48.567 INFO:tasks.ceph.mds.a.smithi078.stderr: -2880> 2023-11-28T20:01:15.473+0000 7fe2e56a9640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-11-28T20:01:48.583 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-11-28T20:01:48.614 INFO:tasks.ceph.mds.a.smithi078.stdout:starting mds.a at 2023-11-28T20:01:48.724 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:48.721+0000 7fef1bf80640 1 Processor -- start 2023-11-28T20:01:48.724 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:48.721+0000 7fef1bf80640 1 -- start start 2023-11-28T20:01:48.725 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:48.721+0000 7fef1bf80640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fef14156200 0x7fef140c0370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:48.725 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:48.721+0000 7fef1bf80640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fef1406bce0 con 0x7fef140c0e10 2023-11-28T20:01:48.726 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:48.721+0000 7fef1bf80640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fef140c2270 con 0x7fef1415bf70 2023-11-28T20:01:48.726 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:48.721+0000 7fef1bf80640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fef1406d8d0 con 0x7fef14156200 2023-11-28T20:01:48.726 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:48.721+0000 7fef1951b640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7fef140c0e10 0x7fef140c1b60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:53000/0 (socket says 172.21.15.78:53000) 2023-11-28T20:01:48.726 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:48.721+0000 7fef1951b640 1 -- 172.21.15.78:0/1141525212 learned_addr learned my addr 172.21.15.78:0/1141525212 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-11-28T20:01:48.726 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:48.721+0000 7fef19d1c640 1 --2- 172.21.15.78:0/1141525212 >> v2:172.21.15.179:3300/0 conn(0x7fef14156200 0x7fef140c0370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:48.727 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:48.721+0000 7fef18d1a640 1 -- 172.21.15.78:0/1141525212 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1488907915 0 0) 0x7fef1406bce0 con 0x7fef140c0e10 2023-11-28T20:01:48.727 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:48.721+0000 7fef18d1a640 1 -- 172.21.15.78:0/1141525212 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fef00003530 con 0x7fef140c0e10 2023-11-28T20:01:48.727 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:48.721+0000 7fef19d1c640 1 -- 172.21.15.78:0/1141525212 >> v1:172.21.15.179:6789/0 conn(0x7fef1415bf70 legacy=0x7fef1415c3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:01:48.727 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:48.721+0000 7fef19d1c640 1 -- 172.21.15.78:0/1141525212 >> v1:172.21.15.78:6789/0 conn(0x7fef140c0e10 legacy=0x7fef140c1b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:01:48.727 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:48.721+0000 7fef19d1c640 1 -- 172.21.15.78:0/1141525212 --> v2:172.21.15.179:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef1415cc60 con 0x7fef14156200 2023-11-28T20:01:48.729 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:48.725+0000 7fef19d1c640 1 --2- 172.21.15.78:0/1141525212 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fef14156200 0x7fef140c0370 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7fef100097c0 tx=0x7fef1001c360 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b7e348077591727b server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:01:48.729 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:48.725+0000 7fef18d1a640 1 -- 172.21.15.78:0/1141525212 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef100ab600 con 0x7fef14156200 2023-11-28T20:01:48.729 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:48.725+0000 7fef18d1a640 1 -- 172.21.15.78:0/1141525212 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef100a7050 con 0x7fef14156200 2023-11-28T20:01:48.729 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:48.725+0000 7fef18d1a640 1 -- 172.21.15.78:0/1141525212 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef100ab960 con 0x7fef14156200 2023-11-28T20:01:48.730 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:48.725+0000 7fef1bf80640 1 -- 172.21.15.78:0/1141525212 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fef14156200 msgr2=0x7fef140c0370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:01:48.730 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:48.725+0000 7fef1bf80640 1 --2- 172.21.15.78:0/1141525212 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fef14156200 0x7fef140c0370 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7fef100097c0 tx=0x7fef1001c360 comp rx=0 tx=0).stop 2023-11-28T20:01:48.730 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:48.725+0000 7fef1bf80640 1 -- 172.21.15.78:0/1141525212 shutdown_connections 2023-11-28T20:01:48.730 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:48.725+0000 7fef1bf80640 1 --2- 172.21.15.78:0/1141525212 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fef14156200 0x7fef140c0370 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:48.731 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:48.725+0000 7fef1bf80640 1 -- 172.21.15.78:0/1141525212 >> 172.21.15.78:0/1141525212 conn(0x7fef140c59f0 msgr2=0x7fef140c5e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:01:48.731 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:48.725+0000 7fef1bf80640 1 -- 172.21.15.78:0/1141525212 shutdown_connections 2023-11-28T20:01:48.731 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:48.725+0000 7fef1bf80640 1 -- 172.21.15.78:0/1141525212 wait complete. 2023-11-28T20:01:48.731 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:48.729+0000 7fef1bf80640 1 Processor -- start 2023-11-28T20:01:48.732 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:48.729+0000 7fef1bf80640 1 -- start start 2023-11-28T20:01:48.733 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:48.729+0000 7fef1bf80640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fef140c0e10 0x7fef1414e6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:48.733 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:48.729+0000 7fef1bf80640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fef14156200 0x7fef14157f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:48.733 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:48.729+0000 7fef1bf80640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fef1415bf70 0x7fef140722b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:48.733 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:48.729+0000 7fef1bf80640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef141f0c80 con 0x7fef14156200 2023-11-28T20:01:48.733 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:48.729+0000 7fef1bf80640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef1414f6c0 con 0x7fef140c0e10 2023-11-28T20:01:48.734 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:48.729+0000 7fef1bf80640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef1414eeb0 con 0x7fef1415bf70 2023-11-28T20:01:48.734 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:48.729+0000 7fef1951b640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fef14156200 0x7fef14157f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:48.734 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:48.729+0000 7fef1951b640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fef14156200 0x7fef14157f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:60324/0 (socket says 172.21.15.78:60324) 2023-11-28T20:01:48.734 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:48.729+0000 7fef1951b640 1 -- 172.21.15.78:0/2829903175 learned_addr learned my addr 172.21.15.78:0/2829903175 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T20:01:48.734 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:48.729+0000 7fef1a51d640 1 --2- 172.21.15.78:0/2829903175 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fef1415bf70 0x7fef140722b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:48.735 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:48.729+0000 7fef19d1c640 1 --2- 172.21.15.78:0/2829903175 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fef140c0e10 0x7fef1414e6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:48.738 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:48.729+0000 7fef1951b640 1 -- 172.21.15.78:0/2829903175 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fef1415bf70 msgr2=0x7fef140722b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:01:48.738 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:48.729+0000 7fef1951b640 1 --2- 172.21.15.78:0/2829903175 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fef1415bf70 0x7fef140722b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:48.738 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:48.729+0000 7fef1951b640 1 -- 172.21.15.78:0/2829903175 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fef140c0e10 msgr2=0x7fef1414e6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:01:48.739 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:48.729+0000 7fef1951b640 1 --2- 172.21.15.78:0/2829903175 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fef140c0e10 0x7fef1414e6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:48.739 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:48.729+0000 7fef1951b640 1 -- 172.21.15.78:0/2829903175 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef10009420 con 0x7fef14156200 2023-11-28T20:01:48.739 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:48.729+0000 7fef1951b640 1 --2- 172.21.15.78:0/2829903175 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fef14156200 0x7fef14157f40 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 crypto rx=0x7fef0400c420 tx=0x7fef0400c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:01:48.739 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:48.729+0000 7fef0a7fc640 1 -- 172.21.15.78:0/2829903175 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef04005cf0 con 0x7fef14156200 2023-11-28T20:01:48.739 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:48.729+0000 7fef0a7fc640 1 -- 172.21.15.78:0/2829903175 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef04005e50 con 0x7fef14156200 2023-11-28T20:01:48.739 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:48.729+0000 7fef1bf80640 1 -- 172.21.15.78:0/2829903175 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fef141f0f20 con 0x7fef14156200 2023-11-28T20:01:48.739 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:48.729+0000 7fef0a7fc640 1 -- 172.21.15.78:0/2829903175 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef040072d0 con 0x7fef14156200 2023-11-28T20:01:48.739 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:48.729+0000 7fef1bf80640 1 -- 172.21.15.78:0/2829903175 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fef1414f3e0 con 0x7fef14156200 2023-11-28T20:01:48.739 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:48.729+0000 7fef1bf80640 1 -- 172.21.15.78:0/2829903175 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fef141f10b0 con 0x7fef14156200 2023-11-28T20:01:48.739 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:48.733+0000 7fef0a7fc640 1 -- 172.21.15.78:0/2829903175 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fef04007430 con 0x7fef14156200 2023-11-28T20:01:48.739 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:48.733+0000 7fef0a7fc640 1 --2- 172.21.15.78:0/2829903175 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7feef80664a0 0x7feef8068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:48.740 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:48.733+0000 7fef0a7fc640 1 -- 172.21.15.78:0/2829903175 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 7116+0+0 (secure 0 0 0) 0x7fef04083850 con 0x7fef14156200 2023-11-28T20:01:48.740 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:48.733+0000 7fef19d1c640 1 --2- 172.21.15.78:0/2829903175 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7feef80664a0 0x7feef8068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:48.740 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:48.733+0000 7fef19d1c640 1 --2- 172.21.15.78:0/2829903175 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7feef80664a0 0x7feef8068960 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7fef100ad000 tx=0x7fef100a6000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:01:48.740 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:48.737+0000 7fef0a7fc640 1 -- 172.21.15.78:0/2829903175 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fef040507f0 con 0x7fef14156200 2023-11-28T20:01:48.924 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:48.921+0000 7fef1bf80640 1 -- 172.21.15.78:0/2829903175 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7fef14067630 con 0x7fef14156200 2023-11-28T20:01:49.556 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:49.553+0000 7fef0a7fc640 1 -- 172.21.15.78:0/2829903175 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v38) v1 ==== 104+0+0 (secure 0 0 0) 0x7fef04053e10 con 0x7fef14156200 2023-11-28T20:01:49.559 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:49.553+0000 7fef1bf80640 1 -- 172.21.15.78:0/2829903175 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7feef80664a0 msgr2=0x7feef8068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:01:49.559 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:49.553+0000 7fef1bf80640 1 --2- 172.21.15.78:0/2829903175 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7feef80664a0 0x7feef8068960 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7fef100ad000 tx=0x7fef100a6000 comp rx=0 tx=0).stop 2023-11-28T20:01:49.559 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:49.553+0000 7fef1bf80640 1 -- 172.21.15.78:0/2829903175 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fef14156200 msgr2=0x7fef14157f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:01:49.559 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:49.553+0000 7fef1bf80640 1 --2- 172.21.15.78:0/2829903175 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fef14156200 0x7fef14157f40 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 crypto rx=0x7fef0400c420 tx=0x7fef0400c8e0 comp rx=0 tx=0).stop 2023-11-28T20:01:49.559 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:49.553+0000 7fef1bf80640 1 -- 172.21.15.78:0/2829903175 shutdown_connections 2023-11-28T20:01:49.559 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:49.553+0000 7fef1bf80640 1 --2- 172.21.15.78:0/2829903175 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7feef80664a0 0x7feef8068960 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:49.560 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:49.553+0000 7fef1bf80640 1 --2- 172.21.15.78:0/2829903175 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fef1415bf70 0x7fef140722b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:49.560 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:49.553+0000 7fef1bf80640 1 --2- 172.21.15.78:0/2829903175 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fef14156200 0x7fef14157f40 unknown :-1 s=CLOSED pgs=800 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:49.560 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:49.553+0000 7fef1bf80640 1 --2- 172.21.15.78:0/2829903175 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fef140c0e10 0x7fef1414e6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:49.560 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:49.553+0000 7fef1bf80640 1 -- 172.21.15.78:0/2829903175 >> 172.21.15.78:0/2829903175 conn(0x7fef140c59f0 msgr2=0x7fef1415a0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:01:49.560 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:49.553+0000 7fef1bf80640 1 -- 172.21.15.78:0/2829903175 shutdown_connections 2023-11-28T20:01:49.560 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:49.553+0000 7fef1bf80640 1 -- 172.21.15.78:0/2829903175 wait complete. 2023-11-28T20:01:49.581 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-11-28T20:01:49.770 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:49.765+0000 7fc942032640 1 Processor -- start 2023-11-28T20:01:49.770 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:49.765+0000 7fc942032640 1 -- start start 2023-11-28T20:01:49.771 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:49.765+0000 7fc942032640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fc93c14e2a0 0x7fc93c1516a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:49.771 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:49.765+0000 7fc942032640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc93c151210 con 0x7fc93c0a9910 2023-11-28T20:01:49.771 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:49.765+0000 7fc942032640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc93c14e680 con 0x7fc93c0a9460 2023-11-28T20:01:49.771 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:49.765+0000 7fc942032640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc93c150be0 con 0x7fc93c14e2a0 2023-11-28T20:01:49.771 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:49.765+0000 7fc93bfff640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7fc93c0a9910 0x7fc93c06bc80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:53006/0 (socket says 172.21.15.78:53006) 2023-11-28T20:01:49.771 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:49.765+0000 7fc93bfff640 1 -- 172.21.15.78:0/2125599023 learned_addr learned my addr 172.21.15.78:0/2125599023 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-11-28T20:01:49.771 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:49.769+0000 7fc93b7fe640 1 --2- 172.21.15.78:0/2125599023 >> v2:172.21.15.179:3300/0 conn(0x7fc93c14e2a0 0x7fc93c1516a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:49.772 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:49.769+0000 7fc93a7fc640 1 -- 172.21.15.78:0/2125599023 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3327494079 0 0) 0x7fc93c151210 con 0x7fc93c0a9910 2023-11-28T20:01:49.772 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:49.769+0000 7fc93a7fc640 1 -- 172.21.15.78:0/2125599023 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc924003530 con 0x7fc93c0a9910 2023-11-28T20:01:49.772 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:49.769+0000 7fc93b7fe640 1 -- 172.21.15.78:0/2125599023 >> v1:172.21.15.179:6789/0 conn(0x7fc93c0a9460 legacy=0x7fc93c0c4180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:01:49.772 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:49.769+0000 7fc93b7fe640 1 -- 172.21.15.78:0/2125599023 >> v1:172.21.15.78:6789/0 conn(0x7fc93c0a9910 legacy=0x7fc93c06bc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:01:49.773 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:49.769+0000 7fc93b7fe640 1 -- 172.21.15.78:0/2125599023 --> v2:172.21.15.179:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc93c0c53c0 con 0x7fc93c14e2a0 2023-11-28T20:01:49.774 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:49.769+0000 7fc93b7fe640 1 --2- 172.21.15.78:0/2125599023 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc93c14e2a0 0x7fc93c1516a0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7fc92c0097c0 tx=0x7fc92c01c480 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3770bb6eb688ed server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:01:49.775 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:49.769+0000 7fc93a7fc640 1 -- 172.21.15.78:0/2125599023 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc92c0ac640 con 0x7fc93c14e2a0 2023-11-28T20:01:49.775 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:49.769+0000 7fc93a7fc640 1 -- 172.21.15.78:0/2125599023 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc92c0ac7a0 con 0x7fc93c14e2a0 2023-11-28T20:01:49.775 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:49.769+0000 7fc93a7fc640 1 -- 172.21.15.78:0/2125599023 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc92c0acb30 con 0x7fc93c14e2a0 2023-11-28T20:01:49.776 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:49.773+0000 7fc942032640 1 -- 172.21.15.78:0/2125599023 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc93c14e2a0 msgr2=0x7fc93c1516a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:01:49.776 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:49.773+0000 7fc942032640 1 --2- 172.21.15.78:0/2125599023 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc93c14e2a0 0x7fc93c1516a0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7fc92c0097c0 tx=0x7fc92c01c480 comp rx=0 tx=0).stop 2023-11-28T20:01:49.776 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:49.773+0000 7fc942032640 1 -- 172.21.15.78:0/2125599023 shutdown_connections 2023-11-28T20:01:49.776 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:49.773+0000 7fc942032640 1 --2- 172.21.15.78:0/2125599023 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc93c14e2a0 0x7fc93c1516a0 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:49.776 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:49.773+0000 7fc942032640 1 -- 172.21.15.78:0/2125599023 >> 172.21.15.78:0/2125599023 conn(0x7fc93c0c59f0 msgr2=0x7fc93c0c5e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:01:49.776 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:49.773+0000 7fc942032640 1 -- 172.21.15.78:0/2125599023 shutdown_connections 2023-11-28T20:01:49.776 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:49.773+0000 7fc942032640 1 -- 172.21.15.78:0/2125599023 wait complete. 2023-11-28T20:01:49.777 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:49.773+0000 7fc942032640 1 Processor -- start 2023-11-28T20:01:49.777 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:49.773+0000 7fc942032640 1 -- start start 2023-11-28T20:01:49.779 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:49.773+0000 7fc942032640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc93c0a9460 0x7fc93c070220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:49.779 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:49.773+0000 7fc942032640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc93c0a9910 0x7fc93c071380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:49.779 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:49.773+0000 7fc942032640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc93c14e2a0 0x7fc93c0718c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:49.779 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:49.773+0000 7fc942032640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc93c148370 con 0x7fc93c0a9460 2023-11-28T20:01:49.779 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:49.773+0000 7fc942032640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc93c147730 con 0x7fc93c0a9910 2023-11-28T20:01:49.780 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:49.773+0000 7fc942032640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc93c1479d0 con 0x7fc93c14e2a0 2023-11-28T20:01:49.780 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:49.773+0000 7fc93b7fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc93c0a9460 0x7fc93c070220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:49.780 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:49.773+0000 7fc93b7fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc93c0a9460 0x7fc93c070220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:60338/0 (socket says 172.21.15.78:60338) 2023-11-28T20:01:49.780 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:49.773+0000 7fc93b7fe640 1 -- 172.21.15.78:0/686559759 learned_addr learned my addr 172.21.15.78:0/686559759 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T20:01:49.780 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:49.773+0000 7fc93affd640 1 --2- 172.21.15.78:0/686559759 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc93c0a9910 0x7fc93c071380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:49.780 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:49.773+0000 7fc93bfff640 1 --2- 172.21.15.78:0/686559759 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc93c14e2a0 0x7fc93c0718c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:49.780 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:49.773+0000 7fc93b7fe640 1 -- 172.21.15.78:0/686559759 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc93c14e2a0 msgr2=0x7fc93c0718c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:01:49.780 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:49.773+0000 7fc93b7fe640 1 --2- 172.21.15.78:0/686559759 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc93c14e2a0 0x7fc93c0718c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:49.780 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:49.777+0000 7fc93b7fe640 1 -- 172.21.15.78:0/686559759 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc93c0a9910 msgr2=0x7fc93c071380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:01:49.780 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:49.777+0000 7fc93b7fe640 1 --2- 172.21.15.78:0/686559759 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc93c0a9910 0x7fc93c071380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:49.780 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:49.777+0000 7fc93b7fe640 1 -- 172.21.15.78:0/686559759 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc92c009420 con 0x7fc93c0a9460 2023-11-28T20:01:49.780 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:49.777+0000 7fc93bfff640 1 --2- 172.21.15.78:0/686559759 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc93c14e2a0 0x7fc93c0718c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T20:01:49.780 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:49.777+0000 7fc93affd640 1 --2- 172.21.15.78:0/686559759 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc93c0a9910 0x7fc93c071380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T20:01:49.781 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:49.777+0000 7fc93b7fe640 1 --2- 172.21.15.78:0/686559759 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc93c0a9460 0x7fc93c070220 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 crypto rx=0x7fc92c0af040 tx=0x7fc92c01acc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:01:49.781 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:49.777+0000 7fc923fff640 1 -- 172.21.15.78:0/686559759 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc92c0b8650 con 0x7fc93c0a9460 2023-11-28T20:01:49.781 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:49.777+0000 7fc923fff640 1 -- 172.21.15.78:0/686559759 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc92c0b87b0 con 0x7fc93c0a9460 2023-11-28T20:01:49.782 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:49.777+0000 7fc923fff640 1 -- 172.21.15.78:0/686559759 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc92c0b8b60 con 0x7fc93c0a9460 2023-11-28T20:01:49.782 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:49.777+0000 7fc942032640 1 -- 172.21.15.78:0/686559759 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc93c147cb0 con 0x7fc93c0a9460 2023-11-28T20:01:49.782 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:49.777+0000 7fc942032640 1 -- 172.21.15.78:0/686559759 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc93c070760 con 0x7fc93c0a9460 2023-11-28T20:01:49.782 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:49.777+0000 7fc942032640 1 -- 172.21.15.78:0/686559759 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc93c1484b0 con 0x7fc93c0a9460 2023-11-28T20:01:49.782 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:49.777+0000 7fc923fff640 1 -- 172.21.15.78:0/686559759 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fc92c0b8cc0 con 0x7fc93c0a9460 2023-11-28T20:01:49.783 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:49.777+0000 7fc923fff640 1 --2- 172.21.15.78:0/686559759 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fc928066470 0x7fc928068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:49.783 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:49.777+0000 7fc923fff640 1 -- 172.21.15.78:0/686559759 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 7116+0+0 (secure 0 0 0) 0x7fc92c11ecf0 con 0x7fc93c0a9460 2023-11-28T20:01:49.783 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:49.777+0000 7fc93affd640 1 --2- 172.21.15.78:0/686559759 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fc928066470 0x7fc928068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:49.783 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:49.781+0000 7fc93affd640 1 --2- 172.21.15.78:0/686559759 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fc928066470 0x7fc928068930 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7fc93c0ab380 tx=0x7fc930009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:01:49.786 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:49.781+0000 7fc923fff640 1 -- 172.21.15.78:0/686559759 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fc93c1484b0 con 0x7fc93c0a9460 2023-11-28T20:01:49.937 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:49.933+0000 7fc942032640 1 -- 172.21.15.78:0/686559759 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fc93c1484b0 con 0x7fc93c0a9460 2023-11-28T20:01:50.563 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:50.557+0000 7fc923fff640 1 -- 172.21.15.78:0/686559759 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v68) v1 ==== 181+0+0 (secure 0 0 0) 0x7fc93c1484b0 con 0x7fc93c0a9460 2023-11-28T20:01:50.563 INFO:teuthology.orchestra.run.smithi078.stderr:pool 'cephfs_metadata' removed 2023-11-28T20:01:50.565 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:50.561+0000 7fc942032640 1 -- 172.21.15.78:0/686559759 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fc928066470 msgr2=0x7fc928068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:01:50.565 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:50.561+0000 7fc942032640 1 --2- 172.21.15.78:0/686559759 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fc928066470 0x7fc928068930 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7fc93c0ab380 tx=0x7fc930009040 comp rx=0 tx=0).stop 2023-11-28T20:01:50.565 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:50.561+0000 7fc942032640 1 -- 172.21.15.78:0/686559759 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc93c0a9460 msgr2=0x7fc93c070220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:01:50.565 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:50.561+0000 7fc942032640 1 --2- 172.21.15.78:0/686559759 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc93c0a9460 0x7fc93c070220 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 crypto rx=0x7fc92c0af040 tx=0x7fc92c01acc0 comp rx=0 tx=0).stop 2023-11-28T20:01:50.565 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:50.561+0000 7fc942032640 1 -- 172.21.15.78:0/686559759 shutdown_connections 2023-11-28T20:01:50.565 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:50.561+0000 7fc942032640 1 --2- 172.21.15.78:0/686559759 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fc928066470 0x7fc928068930 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:50.565 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:50.561+0000 7fc942032640 1 --2- 172.21.15.78:0/686559759 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc93c14e2a0 0x7fc93c0718c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:50.566 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:50.561+0000 7fc942032640 1 --2- 172.21.15.78:0/686559759 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc93c0a9910 0x7fc93c071380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:50.566 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:50.561+0000 7fc942032640 1 --2- 172.21.15.78:0/686559759 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc93c0a9460 0x7fc93c070220 unknown :-1 s=CLOSED pgs=802 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:50.566 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:50.561+0000 7fc942032640 1 -- 172.21.15.78:0/686559759 >> 172.21.15.78:0/686559759 conn(0x7fc93c0c59f0 msgr2=0x7fc93c15b9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:01:50.566 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:50.561+0000 7fc942032640 1 -- 172.21.15.78:0/686559759 shutdown_connections 2023-11-28T20:01:50.566 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:50.561+0000 7fc942032640 1 -- 172.21.15.78:0/686559759 wait complete. 2023-11-28T20:01:50.588 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-11-28T20:01:50.740 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:50.737+0000 7fab47165640 1 Processor -- start 2023-11-28T20:01:50.740 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:50.737+0000 7fab47165640 1 -- start start 2023-11-28T20:01:50.741 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:50.737+0000 7fab47165640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fab4014b1e0 0x7fab400c1700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:50.742 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:50.737+0000 7fab47165640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fab401548c0 0x7fab40154d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:50.742 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:50.737+0000 7fab47165640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fab400a4e20 con 0x7fab400c5300 2023-11-28T20:01:50.742 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:50.737+0000 7fab47165640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fab400a50e0 con 0x7fab401548c0 2023-11-28T20:01:50.742 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:50.737+0000 7fab47165640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fab400c0f00 con 0x7fab4014b1e0 2023-11-28T20:01:50.742 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:50.737+0000 7fab45702640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fab401548c0 0x7fab40154d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:50.742 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:50.737+0000 7fab45702640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fab401548c0 0x7fab40154d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:60350/0 (socket says 172.21.15.78:60350) 2023-11-28T20:01:50.742 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:50.737+0000 7fab45702640 1 -- 172.21.15.78:0/2148002999 learned_addr learned my addr 172.21.15.78:0/2148002999 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T20:01:50.742 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:50.737+0000 7fab3ffff640 1 --1- 172.21.15.78:0/2148002999 >> v1:172.21.15.78:6789/0 conn(0x7fab400c5300 0x7fab400a9c30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:53020/0 (socket says 172.21.15.78:53020) 2023-11-28T20:01:50.742 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:50.737+0000 7fab44f01640 1 --2- 172.21.15.78:0/2148002999 >> v2:172.21.15.179:3300/0 conn(0x7fab4014b1e0 0x7fab400c1700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:50.742 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:50.737+0000 7fab45702640 1 -- 172.21.15.78:0/2148002999 >> v2:172.21.15.179:3300/0 conn(0x7fab4014b1e0 msgr2=0x7fab400c1700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:01:50.742 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:50.737+0000 7fab45702640 1 --2- 172.21.15.78:0/2148002999 >> v2:172.21.15.179:3300/0 conn(0x7fab4014b1e0 0x7fab400c1700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:50.743 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:50.737+0000 7fab45702640 1 -- 172.21.15.78:0/2148002999 >> v1:172.21.15.78:6789/0 conn(0x7fab400c5300 legacy=0x7fab400a9c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:01:50.743 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:50.737+0000 7fab45702640 1 -- 172.21.15.78:0/2148002999 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab400c11e0 con 0x7fab401548c0 2023-11-28T20:01:50.745 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:50.741+0000 7fab45702640 1 --2- 172.21.15.78:0/2148002999 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fab401548c0 0x7fab40154d30 secure :-1 s=READY pgs=804 cs=0 l=1 rev1=1 crypto rx=0x7fab400c4150 tx=0x7fab3801c9d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7aa9c2c653bfa6f2 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:01:50.745 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:50.741+0000 7fab3f7fe640 1 -- 172.21.15.78:0/2148002999 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab380a56a0 con 0x7fab401548c0 2023-11-28T20:01:50.745 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:50.741+0000 7fab3f7fe640 1 -- 172.21.15.78:0/2148002999 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab380a5800 con 0x7fab401548c0 2023-11-28T20:01:50.745 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:50.741+0000 7fab3f7fe640 1 -- 172.21.15.78:0/2148002999 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab380a5b90 con 0x7fab401548c0 2023-11-28T20:01:50.746 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:50.741+0000 7fab47165640 1 -- 172.21.15.78:0/2148002999 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fab401548c0 msgr2=0x7fab40154d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:01:50.746 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:50.741+0000 7fab47165640 1 --2- 172.21.15.78:0/2148002999 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fab401548c0 0x7fab40154d30 secure :-1 s=READY pgs=804 cs=0 l=1 rev1=1 crypto rx=0x7fab400c4150 tx=0x7fab3801c9d0 comp rx=0 tx=0).stop 2023-11-28T20:01:50.746 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:50.741+0000 7fab47165640 1 -- 172.21.15.78:0/2148002999 shutdown_connections 2023-11-28T20:01:50.746 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:50.741+0000 7fab47165640 1 --2- 172.21.15.78:0/2148002999 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fab401548c0 0x7fab40154d30 unknown :-1 s=CLOSED pgs=804 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:50.746 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:50.741+0000 7fab47165640 1 --2- 172.21.15.78:0/2148002999 >> v2:172.21.15.179:3300/0 conn(0x7fab4014b1e0 0x7fab400c1700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:50.746 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:50.741+0000 7fab47165640 1 -- 172.21.15.78:0/2148002999 >> 172.21.15.78:0/2148002999 conn(0x7fab400c59f0 msgr2=0x7fab400c5e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:01:50.746 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:50.741+0000 7fab47165640 1 -- 172.21.15.78:0/2148002999 shutdown_connections 2023-11-28T20:01:50.746 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:50.741+0000 7fab47165640 1 -- 172.21.15.78:0/2148002999 wait complete. 2023-11-28T20:01:50.747 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:50.741+0000 7fab47165640 1 Processor -- start 2023-11-28T20:01:50.747 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:50.745+0000 7fab47165640 1 -- start start 2023-11-28T20:01:50.749 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:50.745+0000 7fab47165640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fab400c5300 0x7fab4013f700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:50.749 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:50.745+0000 7fab47165640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fab4014b1e0 0x7fab400bed60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:50.749 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:50.745+0000 7fab47165640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fab401548c0 0x7fab401442a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:50.749 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:50.745+0000 7fab47165640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab4013fc40 con 0x7fab401548c0 2023-11-28T20:01:50.749 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:50.745+0000 7fab47165640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab401edba0 con 0x7fab4014b1e0 2023-11-28T20:01:50.749 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:50.745+0000 7fab47165640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab40145c20 con 0x7fab400c5300 2023-11-28T20:01:50.749 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:50.745+0000 7fab45702640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fab401548c0 0x7fab401442a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:50.749 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:50.745+0000 7fab3ffff640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fab4014b1e0 0x7fab400bed60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:50.749 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:50.745+0000 7fab44f01640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fab400c5300 0x7fab4013f700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:50.749 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:50.745+0000 7fab44f01640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fab400c5300 0x7fab4013f700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3301/0 says I am v2:172.21.15.78:60058/0 (socket says 172.21.15.78:60058) 2023-11-28T20:01:50.750 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:50.745+0000 7fab45702640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fab401548c0 0x7fab401442a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:60362/0 (socket says 172.21.15.78:60362) 2023-11-28T20:01:50.750 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:50.745+0000 7fab44f01640 1 -- 172.21.15.78:0/1243907181 learned_addr learned my addr 172.21.15.78:0/1243907181 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T20:01:50.750 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:50.745+0000 7fab45702640 1 -- 172.21.15.78:0/1243907181 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fab400c5300 msgr2=0x7fab4013f700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:01:50.750 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:50.745+0000 7fab45702640 1 --2- 172.21.15.78:0/1243907181 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fab400c5300 0x7fab4013f700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:50.750 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:50.745+0000 7fab45702640 1 -- 172.21.15.78:0/1243907181 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fab4014b1e0 msgr2=0x7fab400bed60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:01:50.750 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:50.745+0000 7fab45702640 1 --2- 172.21.15.78:0/1243907181 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fab4014b1e0 0x7fab400bed60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:50.750 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:50.745+0000 7fab45702640 1 -- 172.21.15.78:0/1243907181 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab38009b30 con 0x7fab401548c0 2023-11-28T20:01:50.751 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:50.745+0000 7fab45702640 1 --2- 172.21.15.78:0/1243907181 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fab401548c0 0x7fab401442a0 secure :-1 s=READY pgs=805 cs=0 l=1 rev1=1 crypto rx=0x7fab380ab000 tx=0x7fab38019770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:01:50.752 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:50.745+0000 7fab3d7fa640 1 -- 172.21.15.78:0/1243907181 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab38009510 con 0x7fab401548c0 2023-11-28T20:01:50.752 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:50.745+0000 7fab3d7fa640 1 -- 172.21.15.78:0/1243907181 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab380b8470 con 0x7fab401548c0 2023-11-28T20:01:50.752 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:50.745+0000 7fab47165640 1 -- 172.21.15.78:0/1243907181 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fab40145f00 con 0x7fab401548c0 2023-11-28T20:01:50.752 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:50.745+0000 7fab3d7fa640 1 -- 172.21.15.78:0/1243907181 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab380b8800 con 0x7fab401548c0 2023-11-28T20:01:50.752 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:50.745+0000 7fab47165640 1 -- 172.21.15.78:0/1243907181 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fab40070180 con 0x7fab401548c0 2023-11-28T20:01:50.752 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:50.745+0000 7fab47165640 1 -- 172.21.15.78:0/1243907181 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fab40146140 con 0x7fab401548c0 2023-11-28T20:01:50.752 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:50.749+0000 7fab3d7fa640 1 -- 172.21.15.78:0/1243907181 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fab380b8960 con 0x7fab401548c0 2023-11-28T20:01:50.753 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:50.749+0000 7fab3d7fa640 1 --2- 172.21.15.78:0/1243907181 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fab24066470 0x7fab24068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:50.753 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:50.749+0000 7fab3d7fa640 1 -- 172.21.15.78:0/1243907181 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 6649+0+0 (secure 0 0 0) 0x7fab3811ec50 con 0x7fab401548c0 2023-11-28T20:01:50.753 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:50.749+0000 7fab44f01640 1 --2- 172.21.15.78:0/1243907181 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fab24066470 0x7fab24068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:50.753 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:50.749+0000 7fab44f01640 1 --2- 172.21.15.78:0/1243907181 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fab24066470 0x7fab24068930 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7fab3400b240 tx=0x7fab3400b3a0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:01:50.757 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:50.753+0000 7fab3d7fa640 1 -- 172.21.15.78:0/1243907181 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fab40146140 con 0x7fab401548c0 2023-11-28T20:01:50.907 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:50.905+0000 7fab47165640 1 -- 172.21.15.78:0/1243907181 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fab4006fac0 con 0x7fab401548c0 2023-11-28T20:01:51.788 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:51.784+0000 7fab3d7fa640 1 -- 172.21.15.78:0/1243907181 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v69) v1 ==== 169+0+0 (secure 0 0 0) 0x7fab4006fac0 con 0x7fab401548c0 2023-11-28T20:01:51.788 INFO:teuthology.orchestra.run.smithi078.stderr:pool 'cephfs_data' removed 2023-11-28T20:01:51.791 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:51.784+0000 7fab47165640 1 -- 172.21.15.78:0/1243907181 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fab24066470 msgr2=0x7fab24068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:01:51.791 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:51.784+0000 7fab47165640 1 --2- 172.21.15.78:0/1243907181 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fab24066470 0x7fab24068930 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7fab3400b240 tx=0x7fab3400b3a0 comp rx=0 tx=0).stop 2023-11-28T20:01:51.791 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:51.784+0000 7fab47165640 1 -- 172.21.15.78:0/1243907181 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fab401548c0 msgr2=0x7fab401442a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:01:51.791 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:51.784+0000 7fab47165640 1 --2- 172.21.15.78:0/1243907181 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fab401548c0 0x7fab401442a0 secure :-1 s=READY pgs=805 cs=0 l=1 rev1=1 crypto rx=0x7fab380ab000 tx=0x7fab38019770 comp rx=0 tx=0).stop 2023-11-28T20:01:51.791 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:51.784+0000 7fab47165640 1 -- 172.21.15.78:0/1243907181 shutdown_connections 2023-11-28T20:01:51.791 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:51.784+0000 7fab47165640 1 --2- 172.21.15.78:0/1243907181 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fab24066470 0x7fab24068930 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:51.791 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:51.784+0000 7fab47165640 1 --2- 172.21.15.78:0/1243907181 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fab401548c0 0x7fab401442a0 unknown :-1 s=CLOSED pgs=805 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:51.792 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:51.784+0000 7fab47165640 1 --2- 172.21.15.78:0/1243907181 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fab4014b1e0 0x7fab400bed60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:51.792 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:51.784+0000 7fab47165640 1 --2- 172.21.15.78:0/1243907181 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fab400c5300 0x7fab4013f700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:51.792 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:51.784+0000 7fab47165640 1 -- 172.21.15.78:0/1243907181 >> 172.21.15.78:0/1243907181 conn(0x7fab400c59f0 msgr2=0x7fab401489d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:01:51.792 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:51.784+0000 7fab47165640 1 -- 172.21.15.78:0/1243907181 shutdown_connections 2023-11-28T20:01:51.792 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:51.784+0000 7fab47165640 1 -- 172.21.15.78:0/1243907181 wait complete. 2023-11-28T20:01:51.818 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-28T20:01:51.959 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:51.952+0000 7f0e31c6b640 1 Processor -- start 2023-11-28T20:01:51.960 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:51.956+0000 7f0e31c6b640 1 -- start start 2023-11-28T20:01:51.960 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:51.956+0000 7f0e31c6b640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f0e2c0722c0 0x7f0e2c15de60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:51.961 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:51.956+0000 7f0e31c6b640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0e2c0c5710 con 0x7f0e2c071e30 2023-11-28T20:01:51.961 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:51.956+0000 7f0e31c6b640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0e2c155c80 con 0x7f0e2c14fd10 2023-11-28T20:01:51.961 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:51.956+0000 7f0e31c6b640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0e2c06c5e0 con 0x7f0e2c0722c0 2023-11-28T20:01:51.961 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:51.956+0000 7f0e2affd640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f0e2c071e30 0x7f0e2c156110 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:53036/0 (socket says 172.21.15.78:53036) 2023-11-28T20:01:51.961 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:51.956+0000 7f0e2affd640 1 -- 172.21.15.78:0/1780374794 learned_addr learned my addr 172.21.15.78:0/1780374794 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-11-28T20:01:51.963 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:51.956+0000 7f0e2bfff640 1 --2- 172.21.15.78:0/1780374794 >> v2:172.21.15.179:3300/0 conn(0x7f0e2c0722c0 0x7f0e2c15de60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:51.963 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:51.956+0000 7f0e2a7fc640 1 -- 172.21.15.78:0/1780374794 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2628993711 0 0) 0x7f0e2c0c5710 con 0x7f0e2c071e30 2023-11-28T20:01:51.963 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:51.956+0000 7f0e2a7fc640 1 -- 172.21.15.78:0/1780374794 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0e14003530 con 0x7f0e2c071e30 2023-11-28T20:01:51.963 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:51.956+0000 7f0e2a7fc640 1 -- 172.21.15.78:0/1780374794 <== mon.0 v1:172.21.15.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1975418776 0 0) 0x7f0e14003530 con 0x7f0e2c071e30 2023-11-28T20:01:51.963 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:51.956+0000 7f0e2a7fc640 1 -- 172.21.15.78:0/1780374794 >> v2:172.21.15.179:3300/0 conn(0x7f0e2c0722c0 msgr2=0x7f0e2c15de60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:01:51.963 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:51.956+0000 7f0e2a7fc640 1 --2- 172.21.15.78:0/1780374794 >> v2:172.21.15.179:3300/0 conn(0x7f0e2c0722c0 0x7f0e2c15de60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:51.963 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:51.956+0000 7f0e2a7fc640 1 -- 172.21.15.78:0/1780374794 >> v1:172.21.15.179:6789/0 conn(0x7f0e2c14fd10 legacy=0x7f0e2c0a4dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:01:51.963 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:51.956+0000 7f0e2a7fc640 1 -- 172.21.15.78:0/1780374794 --> v1:172.21.15.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e2c0c4e70 con 0x7f0e2c071e30 2023-11-28T20:01:51.964 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:51.956+0000 7f0e2a7fc640 1 -- 172.21.15.78:0/1780374794 <== mon.0 v1:172.21.15.78:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3326804700 0 0) 0x7f0e20001680 con 0x7f0e2c071e30 2023-11-28T20:01:51.964 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:51.956+0000 7f0e2a7fc640 1 -- 172.21.15.78:0/1780374794 >> v1:172.21.15.78:6789/0 conn(0x7f0e2c071e30 legacy=0x7f0e2c156110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:01:51.964 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:51.956+0000 7f0e2a7fc640 1 --2- 172.21.15.78:0/1780374794 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0e14003980 0x7f0e14003d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:51.964 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:51.956+0000 7f0e2a7fc640 1 --2- 172.21.15.78:0/1780374794 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0e140047d0 0x7f0e14004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:51.964 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:51.956+0000 7f0e2a7fc640 1 --2- 172.21.15.78:0/1780374794 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0e14005190 0x7f0e1400b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:51.964 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:51.956+0000 7f0e2a7fc640 1 -- 172.21.15.78:0/1780374794 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e1400c0b0 con 0x7f0e14003980 2023-11-28T20:01:51.964 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:51.956+0000 7f0e2a7fc640 1 -- 172.21.15.78:0/1780374794 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e1400c220 con 0x7f0e14005190 2023-11-28T20:01:51.964 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:51.956+0000 7f0e2a7fc640 1 -- 172.21.15.78:0/1780374794 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e1400c3e0 con 0x7f0e140047d0 2023-11-28T20:01:51.964 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:51.956+0000 7f0e2b7fe640 1 --2- 172.21.15.78:0/1780374794 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0e14003980 0x7f0e14003d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:51.964 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:51.956+0000 7f0e2bfff640 1 --2- 172.21.15.78:0/1780374794 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0e14005190 0x7f0e1400b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:51.964 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:51.956+0000 7f0e2affd640 1 --2- 172.21.15.78:0/1780374794 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0e140047d0 0x7f0e14004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:51.965 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:51.956+0000 7f0e2b7fe640 1 -- 172.21.15.78:0/1780374794 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0e140047d0 msgr2=0x7f0e14004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:01:51.965 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:51.956+0000 7f0e2b7fe640 1 --2- 172.21.15.78:0/1780374794 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0e140047d0 0x7f0e14004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:51.965 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:51.956+0000 7f0e2b7fe640 1 -- 172.21.15.78:0/1780374794 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0e14005190 msgr2=0x7f0e1400b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:01:51.965 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:51.956+0000 7f0e2b7fe640 1 --2- 172.21.15.78:0/1780374794 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0e14005190 0x7f0e1400b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:51.965 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:51.956+0000 7f0e2b7fe640 1 -- 172.21.15.78:0/1780374794 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e14003530 con 0x7f0e14003980 2023-11-28T20:01:51.965 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:51.956+0000 7f0e2bfff640 1 -- 172.21.15.78:0/1780374794 reap_dead start 2023-11-28T20:01:51.966 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:51.960+0000 7f0e2b7fe640 1 --2- 172.21.15.78:0/1780374794 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0e14003980 0x7f0e14003d60 secure :-1 s=READY pgs=807 cs=0 l=1 rev1=1 crypto rx=0x7f0e1c001860 tx=0x7f0e1c01c4e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f3f9ce79dae1e9a9 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:01:51.966 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:51.960+0000 7f0e2a7fc640 1 -- 172.21.15.78:0/1780374794 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e1c0ab600 con 0x7f0e14003980 2023-11-28T20:01:51.966 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:51.960+0000 7f0e2a7fc640 1 -- 172.21.15.78:0/1780374794 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e1c0a7050 con 0x7f0e14003980 2023-11-28T20:01:51.966 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:51.960+0000 7f0e2a7fc640 1 -- 172.21.15.78:0/1780374794 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e1c0ab9e0 con 0x7f0e14003980 2023-11-28T20:01:51.966 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:51.960+0000 7f0e31c6b640 1 -- 172.21.15.78:0/1780374794 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0e14003980 msgr2=0x7f0e14003d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:01:51.967 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:51.960+0000 7f0e31c6b640 1 --2- 172.21.15.78:0/1780374794 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0e14003980 0x7f0e14003d60 secure :-1 s=READY pgs=807 cs=0 l=1 rev1=1 crypto rx=0x7f0e1c001860 tx=0x7f0e1c01c4e0 comp rx=0 tx=0).stop 2023-11-28T20:01:51.967 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:51.960+0000 7f0e31c6b640 1 -- 172.21.15.78:0/1780374794 shutdown_connections 2023-11-28T20:01:51.967 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:51.960+0000 7f0e31c6b640 1 --2- 172.21.15.78:0/1780374794 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0e14003980 0x7f0e14003d60 unknown :-1 s=CLOSED pgs=807 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:51.967 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:51.960+0000 7f0e31c6b640 1 -- 172.21.15.78:0/1780374794 >> 172.21.15.78:0/1780374794 conn(0x7f0e2c0a7810 msgr2=0x7f0e2c0a7c20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:01:51.967 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:51.960+0000 7f0e31c6b640 1 -- 172.21.15.78:0/1780374794 shutdown_connections 2023-11-28T20:01:51.967 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:51.960+0000 7f0e31c6b640 1 -- 172.21.15.78:0/1780374794 wait complete. 2023-11-28T20:01:51.968 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:51.964+0000 7f0e31c6b640 1 Processor -- start 2023-11-28T20:01:51.968 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:51.964+0000 7f0e31c6b640 1 -- start start 2023-11-28T20:01:51.970 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:51.964+0000 7f0e31c6b640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0e14003980 0x7f0e2c0a6080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:51.970 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:51.964+0000 7f0e31c6b640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0e2c149650 0x7f0e2c14ae30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:51.970 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:51.964+0000 7f0e31c6b640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0e2c1e04c0 0x7f0e2c14b370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:51.970 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:51.964+0000 7f0e31c6b640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e2c1eb760 con 0x7f0e2c1e04c0 2023-11-28T20:01:51.971 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:51.964+0000 7f0e31c6b640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e2c0aabb0 con 0x7f0e14003980 2023-11-28T20:01:51.971 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:51.964+0000 7f0e31c6b640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e2c1eae00 con 0x7f0e2c149650 2023-11-28T20:01:51.971 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:51.964+0000 7f0e2bfff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0e2c1e04c0 0x7f0e2c14b370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:51.971 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:51.964+0000 7f0e2bfff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0e2c1e04c0 0x7f0e2c14b370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:60380/0 (socket says 172.21.15.78:60380) 2023-11-28T20:01:51.971 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:51.964+0000 7f0e2bfff640 1 -- 172.21.15.78:0/1152398494 learned_addr learned my addr 172.21.15.78:0/1152398494 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T20:01:51.971 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:51.964+0000 7f0e2b7fe640 1 --2- 172.21.15.78:0/1152398494 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0e14003980 0x7f0e2c0a6080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:51.971 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:51.964+0000 7f0e2affd640 1 --2- 172.21.15.78:0/1152398494 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0e2c149650 0x7f0e2c14ae30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:51.971 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:51.964+0000 7f0e2bfff640 1 -- 172.21.15.78:0/1152398494 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0e2c149650 msgr2=0x7f0e2c14ae30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:01:51.971 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:51.964+0000 7f0e2bfff640 1 --2- 172.21.15.78:0/1152398494 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0e2c149650 0x7f0e2c14ae30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:51.971 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:51.964+0000 7f0e2bfff640 1 -- 172.21.15.78:0/1152398494 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0e14003980 msgr2=0x7f0e2c0a6080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:01:51.971 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:51.964+0000 7f0e2bfff640 1 --2- 172.21.15.78:0/1152398494 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0e14003980 0x7f0e2c0a6080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:51.972 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:51.964+0000 7f0e2bfff640 1 -- 172.21.15.78:0/1152398494 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e2c14b8b0 con 0x7f0e2c1e04c0 2023-11-28T20:01:51.972 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:51.964+0000 7f0e2bfff640 1 --2- 172.21.15.78:0/1152398494 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0e2c1e04c0 0x7f0e2c14b370 secure :-1 s=READY pgs=808 cs=0 l=1 rev1=1 crypto rx=0x7f0e2c0c2510 tx=0x7f0e2400f1b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:01:51.972 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:51.964+0000 7f0e13fff640 1 -- 172.21.15.78:0/1152398494 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e2400e040 con 0x7f0e2c1e04c0 2023-11-28T20:01:51.972 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:51.964+0000 7f0e13fff640 1 -- 172.21.15.78:0/1152398494 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e2400f040 con 0x7f0e2c1e04c0 2023-11-28T20:01:51.972 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:51.964+0000 7f0e13fff640 1 -- 172.21.15.78:0/1152398494 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e2400fec0 con 0x7f0e2c1e04c0 2023-11-28T20:01:51.972 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:51.964+0000 7f0e31c6b640 1 -- 172.21.15.78:0/1152398494 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0e2c1eb0a0 con 0x7f0e2c1e04c0 2023-11-28T20:01:51.972 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:51.964+0000 7f0e31c6b640 1 -- 172.21.15.78:0/1152398494 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0e2c1e09c0 con 0x7f0e2c1e04c0 2023-11-28T20:01:51.973 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:51.968+0000 7f0e31c6b640 1 -- 172.21.15.78:0/1152398494 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0e2c1eb8a0 con 0x7f0e2c1e04c0 2023-11-28T20:01:51.973 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:51.968+0000 7f0e13fff640 1 -- 172.21.15.78:0/1152398494 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f0e24015430 con 0x7f0e2c1e04c0 2023-11-28T20:01:51.973 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:51.968+0000 7f0e13fff640 1 --2- 172.21.15.78:0/1152398494 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f0e18066470 0x7f0e18068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:51.973 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:51.968+0000 7f0e13fff640 1 -- 172.21.15.78:0/1152398494 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 6119+0+0 (secure 0 0 0) 0x7f0e24084750 con 0x7f0e2c1e04c0 2023-11-28T20:01:51.973 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:51.968+0000 7f0e2b7fe640 1 --2- 172.21.15.78:0/1152398494 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f0e18066470 0x7f0e18068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:51.974 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:51.968+0000 7f0e2b7fe640 1 --2- 172.21.15.78:0/1152398494 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f0e18066470 0x7f0e18068930 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f0e1c0ad000 tx=0x7f0e1c0a6000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:01:51.977 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:51.972+0000 7f0e13fff640 1 -- 172.21.15.78:0/1152398494 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f0e2c1eb8a0 con 0x7f0e2c1e04c0 2023-11-28T20:01:52.132 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:52.128+0000 7f0e31c6b640 1 -- 172.21.15.78:0/1152398494 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0e2c1eb8a0 con 0x7f0e2c1e04c0 2023-11-28T20:01:52.133 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:52.128+0000 7f0e13fff640 1 -- 172.21.15.78:0/1152398494 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v69) v1 ==== 74+0+16884 (secure 0 0 0) 0x7f0e2c1eb8a0 con 0x7f0e2c1e04c0 2023-11-28T20:01:52.134 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-11-28T20:01:52.134 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":69,"fsid":"dd9780e8-3bda-44fa-a9f0-fa07d19d901d","created":"2023-11-28T19:58:40.969556+0000","modified":"2023-11-28T20:01:51.784028+0000","last_up_change":"2023-11-28T19:58:52.596716+0000","last_in_change":"2023-11-28T19:58:43.609275+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":12,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-28T19:58:54.011229+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs2_metadata","create_time":"2023-11-28T20:01:20.863763+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"64","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs2_data","create_time":"2023-11-28T20:01:22.176918+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"65","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs2"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e84245ac-b5da-429e-af18-39acaa2b33e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6800","nonce":3358701235},{"type":"v1","addr":"172.21.15.78:6801","nonce":3358701235}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6802","nonce":3358701235},{"type":"v1","addr":"172.21.15.78:6803","nonce":3358701235}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6806","nonce":3358701235},{"type":"v1","addr":"172.21.15.78:6807","nonce":3358701235}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6804","nonce":3358701235},{"type":"v1","addr":"172.21.15.78:6805","nonce":3358701235}]},"public_addr":"172.21.15.78:6801/3358701235","cluster_addr":"172.21.15.78:6803/3358701235","heartbeat_back_addr":"172.21.15.78:6807/3358701235","heartbeat_front_addr":"172.21.15.78:6805/3358701235","state":["exists","up"]},{"osd":1,"uuid":"e634831d-c4e2-48d9-870c-9556ae162981","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6808","nonce":3211476654},{"type":"v1","addr":"172.21.15.78:6809","nonce":3211476654}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6810","nonce":3211476654},{"type":"v1","addr":"172.21.15.78:6811","nonce":3211476654}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6814","nonce":3211476654},{"type":"v1","addr":"172.21.15.78:6815","nonce":3211476654}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6812","nonce":3211476654},{"type":"v1","addr":"172.21.15.78:6813","nonce":3211476654}]},"public_addr":"172.21.15.78:6809/3211476654","cluster_addr":"172.21.15.78:6811/3211476654","heartbeat_back_addr":"172.21.15.78:6815/3211476654","heartbeat_front_addr":"172.21.15.78:6813/3211476654","state":["exists","up"]},{"osd":2,"uuid":"274c8395-6534-41f0-b8fb-a00af8985aa8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6816","nonce":2532904479},{"type":"v1","addr":"172.21.15.78:6817","nonce":2532904479}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6818","nonce":2532904479},{"type":"v1","addr":"172.21.15.78:6819","nonce":2532904479}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6822","nonce":2532904479},{"type":"v1","addr":"172.21.15.78:6823","nonce":2532904479}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6820","nonce":2532904479},{"type":"v1","addr":"172.21.15.78:6821","nonce":2532904479}]},"public_addr":"172.21.15.78:6817/2532904479","cluster_addr":"172.21.15.78:6819/2532904479","heartbeat_back_addr":"172.21.15.78:6823/2532904479","heartbeat_front_addr":"172.21.15.78:6821/2532904479","state":["exists","up"]},{"osd":3,"uuid":"77acc9af-7d4d-4b18-8cf5-d62f5971b7c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6824","nonce":3442991267},{"type":"v1","addr":"172.21.15.78:6825","nonce":3442991267}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6826","nonce":3442991267},{"type":"v1","addr":"172.21.15.78:6827","nonce":3442991267}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6830","nonce":3442991267},{"type":"v1","addr":"172.21.15.78:6831","nonce":3442991267}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6828","nonce":3442991267},{"type":"v1","addr":"172.21.15.78:6829","nonce":3442991267}]},"public_addr":"172.21.15.78:6825/3442991267","cluster_addr":"172.21.15.78:6827/3442991267","heartbeat_back_addr":"172.21.15.78:6831/3442991267","heartbeat_front_addr":"172.21.15.78:6829/3442991267","state":["exists","up"]},{"osd":4,"uuid":"5c62bc66-6b34-4b7f-a66b-9a743969138c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":802983577},{"type":"v1","addr":"172.21.15.179:6809","nonce":802983577}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":802983577},{"type":"v1","addr":"172.21.15.179:6811","nonce":802983577}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":802983577},{"type":"v1","addr":"172.21.15.179:6815","nonce":802983577}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":802983577},{"type":"v1","addr":"172.21.15.179:6813","nonce":802983577}]},"public_addr":"172.21.15.179:6809/802983577","cluster_addr":"172.21.15.179:6811/802983577","heartbeat_back_addr":"172.21.15.179:6815/802983577","heartbeat_front_addr":"172.21.15.179:6813/802983577","state":["exists","up"]},{"osd":5,"uuid":"67db6d36-f684-4079-b0cd-82b4dd61461f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":518192887},{"type":"v1","addr":"172.21.15.179:6818","nonce":518192887}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":518192887},{"type":"v1","addr":"172.21.15.179:6822","nonce":518192887}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":518192887},{"type":"v1","addr":"172.21.15.179:6829","nonce":518192887}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6824","nonce":518192887},{"type":"v1","addr":"172.21.15.179:6826","nonce":518192887}]},"public_addr":"172.21.15.179:6818/518192887","cluster_addr":"172.21.15.179:6822/518192887","heartbeat_back_addr":"172.21.15.179:6829/518192887","heartbeat_front_addr":"172.21.15.179:6826/518192887","state":["exists","up"]},{"osd":6,"uuid":"12e670af-5a16-4c81-9f97-defa66cab967","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":815435378},{"type":"v1","addr":"172.21.15.179:6801","nonce":815435378}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":815435378},{"type":"v1","addr":"172.21.15.179:6803","nonce":815435378}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":815435378},{"type":"v1","addr":"172.21.15.179:6807","nonce":815435378}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":815435378},{"type":"v1","addr":"172.21.15.179:6805","nonce":815435378}]},"public_addr":"172.21.15.179:6801/815435378","cluster_addr":"172.21.15.179:6803/815435378","heartbeat_back_addr":"172.21.15.179:6807/815435378","heartbeat_front_addr":"172.21.15.179:6805/815435378","state":["exists","up"]},{"osd":7,"uuid":"fe630650-2eb3-49ad-8676-c341e6332eb1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6817","nonce":2848432339},{"type":"v1","addr":"172.21.15.179:6819","nonce":2848432339}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6821","nonce":2848432339},{"type":"v1","addr":"172.21.15.179:6823","nonce":2848432339}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":2848432339},{"type":"v1","addr":"172.21.15.179:6831","nonce":2848432339}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6825","nonce":2848432339},{"type":"v1","addr":"172.21.15.179:6827","nonce":2848432339}]},"public_addr":"172.21.15.179:6819/2848432339","cluster_addr":"172.21.15.179:6823/2848432339","heartbeat_back_addr":"172.21.15.179:6831/2848432339","heartbeat_front_addr":"172.21.15.179:6827/2848432339","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:58:49.255433+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:58:49.412880+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:58:49.559295+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:58:49.245237+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:58:49.184557+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:58:49.329851+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:58:49.366012+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:58:49.349604+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.78:6837/115607035":"2023-11-29T20:01:48.551494+0000","172.21.15.78:6836/115607035":"2023-11-29T20:01:48.551494+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-28T20:01:52.136 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:52.132+0000 7f0e31c6b640 1 -- 172.21.15.78:0/1152398494 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f0e18066470 msgr2=0x7f0e18068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:01:52.136 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:52.132+0000 7f0e31c6b640 1 --2- 172.21.15.78:0/1152398494 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f0e18066470 0x7f0e18068930 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f0e1c0ad000 tx=0x7f0e1c0a6000 comp rx=0 tx=0).stop 2023-11-28T20:01:52.137 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:52.132+0000 7f0e31c6b640 1 -- 172.21.15.78:0/1152398494 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0e2c1e04c0 msgr2=0x7f0e2c14b370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:01:52.137 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:52.132+0000 7f0e31c6b640 1 --2- 172.21.15.78:0/1152398494 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0e2c1e04c0 0x7f0e2c14b370 secure :-1 s=READY pgs=808 cs=0 l=1 rev1=1 crypto rx=0x7f0e2c0c2510 tx=0x7f0e2400f1b0 comp rx=0 tx=0).stop 2023-11-28T20:01:52.137 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:52.132+0000 7f0e31c6b640 1 -- 172.21.15.78:0/1152398494 shutdown_connections 2023-11-28T20:01:52.137 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:52.132+0000 7f0e31c6b640 1 --2- 172.21.15.78:0/1152398494 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f0e18066470 0x7f0e18068930 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:52.137 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:52.132+0000 7f0e31c6b640 1 --2- 172.21.15.78:0/1152398494 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0e2c149650 0x7f0e2c14ae30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:52.137 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:52.132+0000 7f0e31c6b640 1 --2- 172.21.15.78:0/1152398494 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0e2c1e04c0 0x7f0e2c14b370 unknown :-1 s=CLOSED pgs=808 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:52.137 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:52.132+0000 7f0e31c6b640 1 --2- 172.21.15.78:0/1152398494 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0e14003980 0x7f0e2c0a6080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:52.138 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:52.132+0000 7f0e31c6b640 1 -- 172.21.15.78:0/1152398494 >> 172.21.15.78:0/1152398494 conn(0x7f0e2c0a7810 msgr2=0x7f0e2c0c0190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:01:52.138 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:52.132+0000 7f0e31c6b640 1 -- 172.21.15.78:0/1152398494 shutdown_connections 2023-11-28T20:01:52.138 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:52.132+0000 7f0e31c6b640 1 -- 172.21.15.78:0/1152398494 wait complete. 2023-11-28T20:01:52.156 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-28T19:58:54.011229+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 11, 'pool_name': 'cephfs2_metadata', 'create_time': '2023-11-28T20:01:20.863763+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '64', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs2'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 12, 'pool_name': 'cephfs2_data', 'create_time': '2023-11-28T20:01:22.176918+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '65', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs2'}}, 'read_balance': {'score_acting': 1.6299999952316284, 'score_stable': 1.6299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.6299999952316284, 'raw_score_stable': 1.6299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-28T20:01:52.157 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-28T20:01:52.297 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:52.292+0000 7febcafb8640 1 Processor -- start 2023-11-28T20:01:52.297 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:52.292+0000 7febcafb8640 1 -- start start 2023-11-28T20:01:52.299 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:52.292+0000 7febcafb8640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7febc414b1e0 0x7febc40c1700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:52.299 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:52.292+0000 7febcafb8640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7febc41548c0 0x7febc4154d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:52.299 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:52.292+0000 7febcafb8640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7febc40a4e20 con 0x7febc40c5300 2023-11-28T20:01:52.299 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:52.292+0000 7febcafb8640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7febc40a50e0 con 0x7febc41548c0 2023-11-28T20:01:52.299 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:52.292+0000 7febcafb8640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7febc40c0f00 con 0x7febc414b1e0 2023-11-28T20:01:52.299 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:52.292+0000 7febc9555640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7febc41548c0 0x7febc4154d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:52.299 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:52.292+0000 7febc3fff640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7febc40c5300 0x7febc40a9c30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:53046/0 (socket says 172.21.15.78:53046) 2023-11-28T20:01:52.299 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:52.292+0000 7febc9555640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7febc41548c0 0x7febc4154d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:60384/0 (socket says 172.21.15.78:60384) 2023-11-28T20:01:52.299 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:52.292+0000 7febc3fff640 1 -- 172.21.15.78:0/2519514483 learned_addr learned my addr 172.21.15.78:0/2519514483 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-11-28T20:01:52.299 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:52.292+0000 7febc8d54640 1 --2- 172.21.15.78:0/2519514483 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7febc414b1e0 0x7febc40c1700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:52.300 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:52.296+0000 7febc9555640 1 -- 172.21.15.78:0/2519514483 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7febc414b1e0 msgr2=0x7febc40c1700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:01:52.300 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:52.296+0000 7febc9555640 1 --2- 172.21.15.78:0/2519514483 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7febc414b1e0 0x7febc40c1700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:52.300 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:52.296+0000 7febc9555640 1 -- 172.21.15.78:0/2519514483 >> v1:172.21.15.78:6789/0 conn(0x7febc40c5300 legacy=0x7febc40a9c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:01:52.300 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:52.296+0000 7febc9555640 1 -- 172.21.15.78:0/2519514483 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7febc40c11e0 con 0x7febc41548c0 2023-11-28T20:01:52.300 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:52.296+0000 7febc37fe640 1 -- 172.21.15.78:0/2519514483 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2137087499 0 0) 0x7febc40a4e20 con 0x7febc40c5300 2023-11-28T20:01:52.302 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:52.296+0000 7febc9555640 1 --2- 172.21.15.78:0/2519514483 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7febc41548c0 0x7febc4154d50 secure :-1 s=READY pgs=810 cs=0 l=1 rev1=1 crypto rx=0x7febbc00bfa0 tx=0x7febbc01eb50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=74c10bca08d78665 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:01:52.302 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:52.296+0000 7febc37fe640 1 -- 172.21.15.78:0/2519514483 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febc41558b0 con 0x7febc41548c0 2023-11-28T20:01:52.302 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:52.296+0000 7febc37fe640 1 -- 172.21.15.78:0/2519514483 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7febbc00b2d0 con 0x7febc41548c0 2023-11-28T20:01:52.302 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:52.296+0000 7febc37fe640 1 -- 172.21.15.78:0/2519514483 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febbc0a7a50 con 0x7febc41548c0 2023-11-28T20:01:52.303 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:52.296+0000 7febcafb8640 1 -- 172.21.15.78:0/2519514483 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7febc41548c0 msgr2=0x7febc4154d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:01:52.303 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:52.296+0000 7febcafb8640 1 --2- 172.21.15.78:0/2519514483 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7febc41548c0 0x7febc4154d50 secure :-1 s=READY pgs=810 cs=0 l=1 rev1=1 crypto rx=0x7febbc00bfa0 tx=0x7febbc01eb50 comp rx=0 tx=0).stop 2023-11-28T20:01:52.303 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:52.296+0000 7febcafb8640 1 -- 172.21.15.78:0/2519514483 shutdown_connections 2023-11-28T20:01:52.303 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:52.296+0000 7febcafb8640 1 --2- 172.21.15.78:0/2519514483 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7febc41548c0 0x7febc4154d50 unknown :-1 s=CLOSED pgs=810 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:52.304 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:52.296+0000 7febcafb8640 1 --2- 172.21.15.78:0/2519514483 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7febc414b1e0 0x7febc40c1700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:52.304 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:52.296+0000 7febcafb8640 1 -- 172.21.15.78:0/2519514483 >> 172.21.15.78:0/2519514483 conn(0x7febc40c59f0 msgr2=0x7febc40c5e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:01:52.304 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:52.300+0000 7febcafb8640 1 -- 172.21.15.78:0/2519514483 shutdown_connections 2023-11-28T20:01:52.304 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:52.300+0000 7febcafb8640 1 -- 172.21.15.78:0/2519514483 wait complete. 2023-11-28T20:01:52.304 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:52.300+0000 7febcafb8640 1 Processor -- start 2023-11-28T20:01:52.304 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:52.300+0000 7febcafb8640 1 -- start start 2023-11-28T20:01:52.306 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:52.300+0000 7febcafb8640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7febc40c5300 0x7febc40befc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:52.307 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:52.300+0000 7febcafb8640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7febc414b1e0 0x7febc406bef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:52.307 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:52.300+0000 7febcafb8640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7febc41548c0 0x7febc413ec90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:52.307 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:52.300+0000 7febcafb8640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7febc4152810 con 0x7febc40c5300 2023-11-28T20:01:52.307 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:52.300+0000 7febcafb8640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7febc413fd60 con 0x7febc41548c0 2023-11-28T20:01:52.307 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:52.300+0000 7febcafb8640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7febc4140040 con 0x7febc414b1e0 2023-11-28T20:01:52.307 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:52.300+0000 7febc8d54640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7febc40c5300 0x7febc40befc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:52.307 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:52.300+0000 7febc8d54640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7febc40c5300 0x7febc40befc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:60400/0 (socket says 172.21.15.78:60400) 2023-11-28T20:01:52.307 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:52.300+0000 7febc8d54640 1 -- 172.21.15.78:0/362142270 learned_addr learned my addr 172.21.15.78:0/362142270 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T20:01:52.307 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:52.300+0000 7febc3fff640 1 --2- 172.21.15.78:0/362142270 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7febc414b1e0 0x7febc406bef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:52.307 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:52.300+0000 7febc9555640 1 --2- 172.21.15.78:0/362142270 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7febc41548c0 0x7febc413ec90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:52.307 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:52.300+0000 7febc8d54640 1 -- 172.21.15.78:0/362142270 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7febc414b1e0 msgr2=0x7febc406bef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:01:52.308 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:52.300+0000 7febc8d54640 1 --2- 172.21.15.78:0/362142270 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7febc414b1e0 0x7febc406bef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:52.308 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:52.300+0000 7febc8d54640 1 -- 172.21.15.78:0/362142270 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7febc41548c0 msgr2=0x7febc413ec90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:01:52.308 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:52.300+0000 7febc8d54640 1 --2- 172.21.15.78:0/362142270 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7febc41548c0 0x7febc413ec90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:52.308 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:52.300+0000 7febc8d54640 1 -- 172.21.15.78:0/362142270 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7febbc00bc80 con 0x7febc40c5300 2023-11-28T20:01:52.308 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:52.300+0000 7febc3fff640 1 --2- 172.21.15.78:0/362142270 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7febc414b1e0 0x7febc406bef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T20:01:52.308 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:52.300+0000 7febc8d54640 1 --2- 172.21.15.78:0/362142270 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7febc40c5300 0x7febc40befc0 secure :-1 s=READY pgs=811 cs=0 l=1 rev1=1 crypto rx=0x7febb800d800 tx=0x7febb800dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:01:52.309 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:52.300+0000 7febc17fa640 1 -- 172.21.15.78:0/362142270 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febb800b6c0 con 0x7febc40c5300 2023-11-28T20:01:52.309 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:52.304+0000 7febc17fa640 1 -- 172.21.15.78:0/362142270 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7febb800b820 con 0x7febc40c5300 2023-11-28T20:01:52.309 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:52.304+0000 7febcafb8640 1 -- 172.21.15.78:0/362142270 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7febc406b9d0 con 0x7febc40c5300 2023-11-28T20:01:52.309 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:52.304+0000 7febc17fa640 1 -- 172.21.15.78:0/362142270 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febb800bb90 con 0x7febc40c5300 2023-11-28T20:01:52.309 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:52.304+0000 7febcafb8640 1 -- 172.21.15.78:0/362142270 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7febc4140320 con 0x7febc40c5300 2023-11-28T20:01:52.309 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:52.304+0000 7febcafb8640 1 -- 172.21.15.78:0/362142270 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7febc4067630 con 0x7febc40c5300 2023-11-28T20:01:52.309 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:52.304+0000 7febc17fa640 1 -- 172.21.15.78:0/362142270 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7febb800bcf0 con 0x7febc40c5300 2023-11-28T20:01:52.310 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:52.304+0000 7febc17fa640 1 --2- 172.21.15.78:0/362142270 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7feba80664a0 0x7feba8068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:52.310 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:52.304+0000 7febc17fa640 1 -- 172.21.15.78:0/362142270 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 6119+0+0 (secure 0 0 0) 0x7febb80844b0 con 0x7febc40c5300 2023-11-28T20:01:52.311 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:52.304+0000 7febc3fff640 1 --2- 172.21.15.78:0/362142270 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7feba80664a0 0x7feba8068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:52.311 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:52.308+0000 7febc3fff640 1 --2- 172.21.15.78:0/362142270 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7feba80664a0 0x7feba8068960 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7febc40aa600 tx=0x7febb0009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:01:52.314 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:52.308+0000 7febc17fa640 1 -- 172.21.15.78:0/362142270 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7febb8051780 con 0x7febc40c5300 2023-11-28T20:01:52.464 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:52.460+0000 7febcafb8640 1 -- 172.21.15.78:0/362142270 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7febc40c16a0 con 0x7febc40c5300 2023-11-28T20:01:52.464 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:52.460+0000 7febc17fa640 1 -- 172.21.15.78:0/362142270 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v69) v1 ==== 93+0+10 (secure 0 0 0) 0x7febb8054da0 con 0x7febc40c5300 2023-11-28T20:01:52.464 INFO:teuthology.orchestra.run.smithi078.stdout:pg_num: 1 2023-11-28T20:01:52.466 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:52.460+0000 7febcafb8640 1 -- 172.21.15.78:0/362142270 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7feba80664a0 msgr2=0x7feba8068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:01:52.467 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:52.460+0000 7febcafb8640 1 --2- 172.21.15.78:0/362142270 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7feba80664a0 0x7feba8068960 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7febc40aa600 tx=0x7febb0009040 comp rx=0 tx=0).stop 2023-11-28T20:01:52.467 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:52.460+0000 7febcafb8640 1 -- 172.21.15.78:0/362142270 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7febc40c5300 msgr2=0x7febc40befc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:01:52.467 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:52.460+0000 7febcafb8640 1 --2- 172.21.15.78:0/362142270 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7febc40c5300 0x7febc40befc0 secure :-1 s=READY pgs=811 cs=0 l=1 rev1=1 crypto rx=0x7febb800d800 tx=0x7febb800dcc0 comp rx=0 tx=0).stop 2023-11-28T20:01:52.467 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:52.460+0000 7febcafb8640 1 -- 172.21.15.78:0/362142270 shutdown_connections 2023-11-28T20:01:52.468 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:52.460+0000 7febcafb8640 1 --2- 172.21.15.78:0/362142270 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7feba80664a0 0x7feba8068960 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:52.468 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:52.460+0000 7febcafb8640 1 --2- 172.21.15.78:0/362142270 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7febc414b1e0 0x7febc406bef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:52.470 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:52.460+0000 7febcafb8640 1 --2- 172.21.15.78:0/362142270 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7febc41548c0 0x7febc413ec90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:52.470 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:52.460+0000 7febcafb8640 1 --2- 172.21.15.78:0/362142270 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7febc40c5300 0x7febc40befc0 unknown :-1 s=CLOSED pgs=811 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:52.471 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:52.460+0000 7febcafb8640 1 -- 172.21.15.78:0/362142270 >> 172.21.15.78:0/362142270 conn(0x7febc40c59f0 msgr2=0x7febc40aa870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:01:52.471 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:52.460+0000 7febcafb8640 1 -- 172.21.15.78:0/362142270 shutdown_connections 2023-11-28T20:01:52.471 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:52.460+0000 7febcafb8640 1 -- 172.21.15.78:0/362142270 wait complete. 2023-11-28T20:01:52.485 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs2_metadata pg_num 2023-11-28T20:01:52.625 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:52.620+0000 7f5d7f0b4640 1 Processor -- start 2023-11-28T20:01:52.626 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:52.620+0000 7f5d7f0b4640 1 -- start start 2023-11-28T20:01:52.626 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:52.620+0000 7f5d7f0b4640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f5d780c45a0 0x7f5d78154e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:52.627 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:52.620+0000 7f5d7f0b4640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5d78151e40 con 0x7f5d780ca330 2023-11-28T20:01:52.627 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:52.620+0000 7f5d7f0b4640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5d781553c0 con 0x7f5d780ca710 2023-11-28T20:01:52.627 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:52.620+0000 7f5d7f0b4640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5d780c54b0 con 0x7f5d780c45a0 2023-11-28T20:01:52.627 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:52.620+0000 7f5d7e0b2640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f5d780ca330 0x7f5d780c7d40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:53062/0 (socket says 172.21.15.78:53062) 2023-11-28T20:01:52.627 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:52.620+0000 7f5d7e0b2640 1 -- 172.21.15.78:0/3953571973 learned_addr learned my addr 172.21.15.78:0/3953571973 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-11-28T20:01:52.629 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:52.624+0000 7f5d7d0b0640 1 -- 172.21.15.78:0/3953571973 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 757580109 0 0) 0x7f5d78151e40 con 0x7f5d780ca330 2023-11-28T20:01:52.629 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:52.624+0000 7f5d7d0b0640 1 -- 172.21.15.78:0/3953571973 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5d64003530 con 0x7f5d780ca330 2023-11-28T20:01:52.629 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:52.624+0000 7f5d7e8b3640 1 --2- 172.21.15.78:0/3953571973 >> v2:172.21.15.179:3300/0 conn(0x7f5d780c45a0 0x7f5d78154e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:52.629 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:52.624+0000 7f5d7d0b0640 1 -- 172.21.15.78:0/3953571973 <== mon.0 v1:172.21.15.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1976661739 0 0) 0x7f5d64003530 con 0x7f5d780ca330 2023-11-28T20:01:52.630 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:52.624+0000 7f5d7d0b0640 1 -- 172.21.15.78:0/3953571973 >> v2:172.21.15.179:3300/0 conn(0x7f5d780c45a0 msgr2=0x7f5d78154e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:01:52.630 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:52.624+0000 7f5d7d0b0640 1 --2- 172.21.15.78:0/3953571973 >> v2:172.21.15.179:3300/0 conn(0x7f5d780c45a0 0x7f5d78154e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:52.630 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:52.624+0000 7f5d7d0b0640 1 -- 172.21.15.78:0/3953571973 >> v1:172.21.15.179:6789/0 conn(0x7f5d780ca710 legacy=0x7f5d7815cd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:01:52.630 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:52.624+0000 7f5d7d0b0640 1 -- 172.21.15.78:0/3953571973 --> v1:172.21.15.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d780c4a30 con 0x7f5d780ca330 2023-11-28T20:01:52.630 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:52.624+0000 7f5d7d0b0640 1 -- 172.21.15.78:0/3953571973 <== mon.0 v1:172.21.15.78:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3326804700 0 0) 0x7f5d74001680 con 0x7f5d780ca330 2023-11-28T20:01:52.631 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:52.624+0000 7f5d7e8b3640 1 --2- 172.21.15.78:0/3953571973 >> v2:172.21.15.179:3300/0 conn(0x7f5d780c45a0 0x7f5d78154e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T20:01:52.631 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:52.624+0000 7f5d7d0b0640 1 -- 172.21.15.78:0/3953571973 >> v1:172.21.15.78:6789/0 conn(0x7f5d780ca330 legacy=0x7f5d780c7d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:01:52.631 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:52.624+0000 7f5d7d0b0640 1 --2- 172.21.15.78:0/3953571973 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5d64003980 0x7f5d64003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:52.631 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:52.624+0000 7f5d7d0b0640 1 --2- 172.21.15.78:0/3953571973 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5d640047d0 0x7f5d64004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:52.631 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:52.624+0000 7f5d7d0b0640 1 --2- 172.21.15.78:0/3953571973 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5d64005190 0x7f5d6400b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:52.631 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:52.624+0000 7f5d7d0b0640 1 -- 172.21.15.78:0/3953571973 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d780c54b0 con 0x7f5d64003980 2023-11-28T20:01:52.632 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:52.624+0000 7f5d7d0b0640 1 -- 172.21.15.78:0/3953571973 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d6400c0c0 con 0x7f5d640047d0 2023-11-28T20:01:52.632 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:52.624+0000 7f5d7d0b0640 1 -- 172.21.15.78:0/3953571973 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5d6400c280 con 0x7f5d64005190 2023-11-28T20:01:52.632 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:52.624+0000 7f5d7e0b2640 1 --2- 172.21.15.78:0/3953571973 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5d64003980 0x7f5d64003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:52.632 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:52.624+0000 7f5d7d8b1640 1 --2- 172.21.15.78:0/3953571973 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5d640047d0 0x7f5d64004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:52.632 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:52.624+0000 7f5d7e8b3640 1 --2- 172.21.15.78:0/3953571973 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5d64005190 0x7f5d6400b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:52.632 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:52.624+0000 7f5d7e0b2640 1 -- 172.21.15.78:0/3953571973 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5d64005190 msgr2=0x7f5d6400b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:01:52.632 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:52.624+0000 7f5d7e0b2640 1 --2- 172.21.15.78:0/3953571973 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5d64005190 0x7f5d6400b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:52.633 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:52.624+0000 7f5d7e0b2640 1 -- 172.21.15.78:0/3953571973 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5d640047d0 msgr2=0x7f5d64004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:01:52.633 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:52.624+0000 7f5d7e0b2640 1 --2- 172.21.15.78:0/3953571973 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5d640047d0 0x7f5d64004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:52.633 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:52.624+0000 7f5d7e0b2640 1 -- 172.21.15.78:0/3953571973 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d64003530 con 0x7f5d64003980 2023-11-28T20:01:52.633 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:52.624+0000 7f5d7e8b3640 1 -- 172.21.15.78:0/3953571973 reap_dead start 2023-11-28T20:01:52.640 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:52.624+0000 7f5d7e0b2640 1 --2- 172.21.15.78:0/3953571973 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5d64003980 0x7f5d64003da0 secure :-1 s=READY pgs=813 cs=0 l=1 rev1=1 crypto rx=0x7f5d7400c240 tx=0x7f5d7401f330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e2f3618b25480e1c server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:01:52.640 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:52.628+0000 7f5d7d0b0640 1 -- 172.21.15.78:0/3953571973 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d74005ae0 con 0x7f5d64003980 2023-11-28T20:01:52.640 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:52.628+0000 7f5d7d0b0640 1 -- 172.21.15.78:0/3953571973 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d740ab070 con 0x7f5d64003980 2023-11-28T20:01:52.640 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:52.628+0000 7f5d7d0b0640 1 -- 172.21.15.78:0/3953571973 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d74007070 con 0x7f5d64003980 2023-11-28T20:01:52.641 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:52.628+0000 7f5d7f0b4640 1 -- 172.21.15.78:0/3953571973 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5d64003980 msgr2=0x7f5d64003da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:01:52.641 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:52.628+0000 7f5d7f0b4640 1 --2- 172.21.15.78:0/3953571973 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5d64003980 0x7f5d64003da0 secure :-1 s=READY pgs=813 cs=0 l=1 rev1=1 crypto rx=0x7f5d7400c240 tx=0x7f5d7401f330 comp rx=0 tx=0).stop 2023-11-28T20:01:52.641 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:52.628+0000 7f5d7f0b4640 1 -- 172.21.15.78:0/3953571973 shutdown_connections 2023-11-28T20:01:52.641 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:52.628+0000 7f5d7f0b4640 1 --2- 172.21.15.78:0/3953571973 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5d64003980 0x7f5d64003da0 unknown :-1 s=CLOSED pgs=813 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:52.641 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:52.628+0000 7f5d7f0b4640 1 -- 172.21.15.78:0/3953571973 >> 172.21.15.78:0/3953571973 conn(0x7f5d780abdb0 msgr2=0x7f5d780c9c20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:01:52.641 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:52.628+0000 7f5d7f0b4640 1 -- 172.21.15.78:0/3953571973 shutdown_connections 2023-11-28T20:01:52.641 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:52.628+0000 7f5d7f0b4640 1 -- 172.21.15.78:0/3953571973 wait complete. 2023-11-28T20:01:52.642 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:52.628+0000 7f5d7f0b4640 1 Processor -- start 2023-11-28T20:01:52.642 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:52.628+0000 7f5d7f0b4640 1 -- start start 2023-11-28T20:01:52.642 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:52.628+0000 7f5d7f0b4640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5d64003980 0x7f5d781ed6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:52.642 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:52.628+0000 7f5d7f0b4640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5d780af830 0x7f5d781edc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:52.642 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:52.628+0000 7f5d7f0b4640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5d781eb470 0x7f5d781eb900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:52.642 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:52.628+0000 7f5d7f0b4640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d780c26d0 con 0x7f5d781eb470 2023-11-28T20:01:52.642 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:52.628+0000 7f5d7f0b4640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d781ee150 con 0x7f5d780af830 2023-11-28T20:01:52.643 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:52.628+0000 7f5d7f0b4640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5d780c1ac0 con 0x7f5d64003980 2023-11-28T20:01:52.643 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:52.628+0000 7f5d7e8b3640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5d781eb470 0x7f5d781eb900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:52.643 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:52.628+0000 7f5d7e8b3640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5d781eb470 0x7f5d781eb900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:60412/0 (socket says 172.21.15.78:60412) 2023-11-28T20:01:52.643 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:52.628+0000 7f5d7e8b3640 1 -- 172.21.15.78:0/2985502747 learned_addr learned my addr 172.21.15.78:0/2985502747 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T20:01:52.643 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:52.632+0000 7f5d7e0b2640 1 --2- 172.21.15.78:0/2985502747 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5d64003980 0x7f5d781ed6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:52.643 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:52.632+0000 7f5d7d8b1640 1 --2- 172.21.15.78:0/2985502747 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5d780af830 0x7f5d781edc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:52.643 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:52.632+0000 7f5d7e8b3640 1 -- 172.21.15.78:0/2985502747 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5d64003980 msgr2=0x7f5d781ed6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:01:52.644 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:52.632+0000 7f5d7e8b3640 1 --2- 172.21.15.78:0/2985502747 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5d64003980 0x7f5d781ed6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:52.644 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:52.632+0000 7f5d7e8b3640 1 -- 172.21.15.78:0/2985502747 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5d780af830 msgr2=0x7f5d781edc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:01:52.644 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:52.632+0000 7f5d7e8b3640 1 --2- 172.21.15.78:0/2985502747 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5d780af830 0x7f5d781edc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:52.644 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:52.632+0000 7f5d7e8b3640 1 -- 172.21.15.78:0/2985502747 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d780c1da0 con 0x7f5d781eb470 2023-11-28T20:01:52.644 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:52.632+0000 7f5d7d8b1640 1 --2- 172.21.15.78:0/2985502747 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5d780af830 0x7f5d781edc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T20:01:52.644 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:52.632+0000 7f5d7e8b3640 1 --2- 172.21.15.78:0/2985502747 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5d781eb470 0x7f5d781eb900 secure :-1 s=READY pgs=814 cs=0 l=1 rev1=1 crypto rx=0x7f5d78074a40 tx=0x7f5d70007700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:01:52.645 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:52.632+0000 7f5d6effd640 1 -- 172.21.15.78:0/2985502747 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d700048a0 con 0x7f5d781eb470 2023-11-28T20:01:52.645 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:52.632+0000 7f5d6effd640 1 -- 172.21.15.78:0/2985502747 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d7000f050 con 0x7f5d781eb470 2023-11-28T20:01:52.645 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:52.632+0000 7f5d7f0b4640 1 -- 172.21.15.78:0/2985502747 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5d780c2080 con 0x7f5d781eb470 2023-11-28T20:01:52.645 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:52.632+0000 7f5d6effd640 1 -- 172.21.15.78:0/2985502747 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d70014630 con 0x7f5d781eb470 2023-11-28T20:01:52.645 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:52.632+0000 7f5d7f0b4640 1 -- 172.21.15.78:0/2985502747 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5d780c07e0 con 0x7f5d781eb470 2023-11-28T20:01:52.645 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:52.632+0000 7f5d7f0b4640 1 -- 172.21.15.78:0/2985502747 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5d780c2880 con 0x7f5d781eb470 2023-11-28T20:01:52.645 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:52.632+0000 7f5d6effd640 1 -- 172.21.15.78:0/2985502747 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f5d700149a0 con 0x7f5d781eb470 2023-11-28T20:01:52.646 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:52.632+0000 7f5d6effd640 1 --2- 172.21.15.78:0/2985502747 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f5d5c066470 0x7f5d5c068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:52.646 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:52.632+0000 7f5d6effd640 1 -- 172.21.15.78:0/2985502747 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 6119+0+0 (secure 0 0 0) 0x7f5d70084620 con 0x7f5d781eb470 2023-11-28T20:01:52.646 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:52.632+0000 7f5d7e0b2640 1 --2- 172.21.15.78:0/2985502747 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f5d5c066470 0x7f5d5c068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:52.646 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:52.636+0000 7f5d7e0b2640 1 --2- 172.21.15.78:0/2985502747 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f5d5c066470 0x7f5d5c068930 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f5d740af000 tx=0x7f5d740aa000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:01:52.647 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:52.636+0000 7f5d6effd640 1 -- 172.21.15.78:0/2985502747 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f5d780c2880 con 0x7f5d781eb470 2023-11-28T20:01:52.792 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:52.788+0000 7f5d7f0b4640 1 -- 172.21.15.78:0/2985502747 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs2_metadata", "var": "pg_num"} v 0) v1 -- 0x7f5d780c0a00 con 0x7f5d781eb470 2023-11-28T20:01:52.792 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:52.788+0000 7f5d6effd640 1 -- 172.21.15.78:0/2985502747 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs2_metadata", "var": "pg_num"}]=0 v69) v1 ==== 105+0+11 (secure 0 0 0) 0x7f5d70051990 con 0x7f5d781eb470 2023-11-28T20:01:52.793 INFO:teuthology.orchestra.run.smithi078.stdout:pg_num: 32 2023-11-28T20:01:52.795 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:52.788+0000 7f5d7f0b4640 1 -- 172.21.15.78:0/2985502747 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f5d5c066470 msgr2=0x7f5d5c068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:01:52.795 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:52.788+0000 7f5d7f0b4640 1 --2- 172.21.15.78:0/2985502747 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f5d5c066470 0x7f5d5c068930 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f5d740af000 tx=0x7f5d740aa000 comp rx=0 tx=0).stop 2023-11-28T20:01:52.795 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:52.788+0000 7f5d7f0b4640 1 -- 172.21.15.78:0/2985502747 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5d781eb470 msgr2=0x7f5d781eb900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:01:52.795 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:52.788+0000 7f5d7f0b4640 1 --2- 172.21.15.78:0/2985502747 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5d781eb470 0x7f5d781eb900 secure :-1 s=READY pgs=814 cs=0 l=1 rev1=1 crypto rx=0x7f5d78074a40 tx=0x7f5d70007700 comp rx=0 tx=0).stop 2023-11-28T20:01:52.795 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:52.788+0000 7f5d7f0b4640 1 -- 172.21.15.78:0/2985502747 shutdown_connections 2023-11-28T20:01:52.795 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:52.788+0000 7f5d7f0b4640 1 --2- 172.21.15.78:0/2985502747 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f5d5c066470 0x7f5d5c068930 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:52.796 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:52.788+0000 7f5d7f0b4640 1 --2- 172.21.15.78:0/2985502747 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5d781eb470 0x7f5d781eb900 unknown :-1 s=CLOSED pgs=814 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:52.796 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:52.788+0000 7f5d7f0b4640 1 --2- 172.21.15.78:0/2985502747 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5d780af830 0x7f5d781edc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:52.796 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:52.788+0000 7f5d7f0b4640 1 --2- 172.21.15.78:0/2985502747 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5d64003980 0x7f5d781ed6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:52.796 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:52.788+0000 7f5d7f0b4640 1 -- 172.21.15.78:0/2985502747 >> 172.21.15.78:0/2985502747 conn(0x7f5d780abdb0 msgr2=0x7f5d780c7d40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:01:52.796 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:52.788+0000 7f5d7f0b4640 1 -- 172.21.15.78:0/2985502747 shutdown_connections 2023-11-28T20:01:52.796 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:52.788+0000 7f5d7f0b4640 1 -- 172.21.15.78:0/2985502747 wait complete. 2023-11-28T20:01:52.814 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs2_data pg_num 2023-11-28T20:01:52.956 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:52.952+0000 7f380ef57640 1 Processor -- start 2023-11-28T20:01:52.957 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:52.952+0000 7f380ef57640 1 -- start start 2023-11-28T20:01:52.957 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:52.952+0000 7f380ef57640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f380814f850 0x7f38080aacf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:52.958 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:52.952+0000 7f380ef57640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f380806d840 0x7f38080c43e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:52.958 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:52.952+0000 7f380ef57640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3808152910 con 0x7f380814fc30 2023-11-28T20:01:52.958 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:52.952+0000 7f380ef57640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f38080c2240 con 0x7f380814f850 2023-11-28T20:01:52.958 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:52.952+0000 7f380ef57640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3808152bf0 con 0x7f380806d840 2023-11-28T20:01:52.958 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:52.952+0000 7f380ccf3640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f380814f850 0x7f38080aacf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:52.958 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:52.952+0000 7f37fffff640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f380814fc30 0x7f38080c3cd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:53076/0 (socket says 172.21.15.78:53076) 2023-11-28T20:01:52.958 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:52.952+0000 7f37fffff640 1 -- 172.21.15.78:0/3469765210 learned_addr learned my addr 172.21.15.78:0/3469765210 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-11-28T20:01:52.959 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:52.952+0000 7f380d4f4640 1 --2- 172.21.15.78:0/3469765210 >> v2:172.21.15.179:3300/0 conn(0x7f380806d840 0x7f38080c43e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:52.959 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:52.952+0000 7f380ccf3640 1 -- 172.21.15.78:0/3469765210 >> v2:172.21.15.179:3300/0 conn(0x7f380806d840 msgr2=0x7f38080c43e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:01:52.959 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:52.952+0000 7f380ccf3640 1 --2- 172.21.15.78:0/3469765210 >> v2:172.21.15.179:3300/0 conn(0x7f380806d840 0x7f38080c43e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:52.959 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:52.952+0000 7f380ccf3640 1 -- 172.21.15.78:0/3469765210 >> v1:172.21.15.78:6789/0 conn(0x7f380814fc30 legacy=0x7f38080c3cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:01:52.959 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:52.952+0000 7f37ff7fe640 1 -- 172.21.15.78:0/3469765210 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2063112156 0 0) 0x7f3808152910 con 0x7f380814fc30 2023-11-28T20:01:52.959 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:52.952+0000 7f380ccf3640 1 -- 172.21.15.78:0/3469765210 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3808152ed0 con 0x7f380814f850 2023-11-28T20:01:52.961 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:52.956+0000 7f380ccf3640 1 --2- 172.21.15.78:0/3469765210 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f380814f850 0x7f38080aacf0 secure :-1 s=READY pgs=816 cs=0 l=1 rev1=1 crypto rx=0x7f38080c2440 tx=0x7f380401c460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1f5b902e6b3fdac2 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:01:52.961 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:52.956+0000 7f37ff7fe640 1 -- 172.21.15.78:0/3469765210 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38040ab680 con 0x7f380814f850 2023-11-28T20:01:52.961 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:52.956+0000 7f37ff7fe640 1 -- 172.21.15.78:0/3469765210 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f38040ab7e0 con 0x7f380814f850 2023-11-28T20:01:52.961 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:52.956+0000 7f37ff7fe640 1 -- 172.21.15.78:0/3469765210 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38040abb70 con 0x7f380814f850 2023-11-28T20:01:52.962 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:52.956+0000 7f380ef57640 1 -- 172.21.15.78:0/3469765210 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f380814f850 msgr2=0x7f38080aacf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:01:52.962 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:52.956+0000 7f380ef57640 1 --2- 172.21.15.78:0/3469765210 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f380814f850 0x7f38080aacf0 secure :-1 s=READY pgs=816 cs=0 l=1 rev1=1 crypto rx=0x7f38080c2440 tx=0x7f380401c460 comp rx=0 tx=0).stop 2023-11-28T20:01:52.963 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:52.956+0000 7f380ef57640 1 -- 172.21.15.78:0/3469765210 shutdown_connections 2023-11-28T20:01:52.963 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:52.956+0000 7f380ef57640 1 --2- 172.21.15.78:0/3469765210 >> v2:172.21.15.179:3300/0 conn(0x7f380806d840 0x7f38080c43e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:52.963 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:52.956+0000 7f380ef57640 1 --2- 172.21.15.78:0/3469765210 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f380814f850 0x7f38080aacf0 unknown :-1 s=CLOSED pgs=816 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:52.963 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:52.956+0000 7f380ef57640 1 -- 172.21.15.78:0/3469765210 >> 172.21.15.78:0/3469765210 conn(0x7f38080c59f0 msgr2=0x7f38080c5e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:01:52.963 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:52.956+0000 7f380ef57640 1 -- 172.21.15.78:0/3469765210 shutdown_connections 2023-11-28T20:01:52.963 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:52.956+0000 7f380ef57640 1 -- 172.21.15.78:0/3469765210 wait complete. 2023-11-28T20:01:52.963 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:52.960+0000 7f380ef57640 1 Processor -- start 2023-11-28T20:01:52.964 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:52.960+0000 7f380ef57640 1 -- start start 2023-11-28T20:01:52.965 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:52.960+0000 7f380ef57640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f380806d840 0x7f38081f1790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:52.966 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:52.960+0000 7f380ef57640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f380814f850 0x7f38080a5f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:52.966 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:52.960+0000 7f380ef57640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f380814fc30 0x7f38081ed880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:52.966 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:52.960+0000 7f380ef57640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38081f1300 con 0x7f380814fc30 2023-11-28T20:01:52.966 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:52.960+0000 7f380ef57640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38081f1cd0 con 0x7f380806d840 2023-11-28T20:01:52.966 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:52.960+0000 7f380ef57640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f38081563e0 con 0x7f380814f850 2023-11-28T20:01:52.966 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:52.960+0000 7f380d4f4640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f380814fc30 0x7f38081ed880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:52.966 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:52.960+0000 7f380d4f4640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f380814fc30 0x7f38081ed880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:60432/0 (socket says 172.21.15.78:60432) 2023-11-28T20:01:52.966 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:52.960+0000 7f380d4f4640 1 -- 172.21.15.78:0/3051028464 learned_addr learned my addr 172.21.15.78:0/3051028464 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T20:01:52.966 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:52.960+0000 7f380ccf3640 1 --2- 172.21.15.78:0/3051028464 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f380806d840 0x7f38081f1790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:52.966 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:52.960+0000 7f37fffff640 1 --2- 172.21.15.78:0/3051028464 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f380814f850 0x7f38080a5f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:52.966 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:52.960+0000 7f380d4f4640 1 -- 172.21.15.78:0/3051028464 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f380814f850 msgr2=0x7f38080a5f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:01:52.967 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:52.960+0000 7f380d4f4640 1 --2- 172.21.15.78:0/3051028464 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f380814f850 0x7f38080a5f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:52.967 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:52.960+0000 7f380d4f4640 1 -- 172.21.15.78:0/3051028464 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f380806d840 msgr2=0x7f38081f1790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:01:52.967 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:52.960+0000 7f380d4f4640 1 --2- 172.21.15.78:0/3051028464 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f380806d840 0x7f38081f1790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:52.967 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:52.960+0000 7f380d4f4640 1 -- 172.21.15.78:0/3051028464 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3804009420 con 0x7f380814fc30 2023-11-28T20:01:52.967 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:52.960+0000 7f380ccf3640 1 --2- 172.21.15.78:0/3051028464 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f380806d840 0x7f38081f1790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T20:01:52.967 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:52.960+0000 7f380d4f4640 1 --2- 172.21.15.78:0/3051028464 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f380814fc30 0x7f38081ed880 secure :-1 s=READY pgs=817 cs=0 l=1 rev1=1 crypto rx=0x7f3800007e40 tx=0x7f380000e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:01:52.968 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:52.960+0000 7f37fd7fa640 1 -- 172.21.15.78:0/3051028464 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3800014620 con 0x7f380814fc30 2023-11-28T20:01:52.968 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:52.960+0000 7f37fd7fa640 1 -- 172.21.15.78:0/3051028464 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f380000ee90 con 0x7f380814fc30 2023-11-28T20:01:52.968 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:52.960+0000 7f37fd7fa640 1 -- 172.21.15.78:0/3051028464 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38000149e0 con 0x7f380814fc30 2023-11-28T20:01:52.968 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:52.960+0000 7f380ef57640 1 -- 172.21.15.78:0/3051028464 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f38081566c0 con 0x7f380814fc30 2023-11-28T20:01:52.968 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:52.960+0000 7f380ef57640 1 -- 172.21.15.78:0/3051028464 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f38080a6440 con 0x7f380814fc30 2023-11-28T20:01:52.968 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:52.964+0000 7f380ef57640 1 -- 172.21.15.78:0/3051028464 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f38081f0df0 con 0x7f380814fc30 2023-11-28T20:01:52.968 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:52.964+0000 7f37fd7fa640 1 -- 172.21.15.78:0/3051028464 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f3800014b40 con 0x7f380814fc30 2023-11-28T20:01:52.969 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:52.964+0000 7f37fd7fa640 1 --2- 172.21.15.78:0/3051028464 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f37f40664a0 0x7f37f4068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:52.969 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:52.964+0000 7f37fd7fa640 1 -- 172.21.15.78:0/3051028464 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 6119+0+0 (secure 0 0 0) 0x7f3800084870 con 0x7f380814fc30 2023-11-28T20:01:52.969 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:52.964+0000 7f380ccf3640 1 --2- 172.21.15.78:0/3051028464 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f37f40664a0 0x7f37f4068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:52.970 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:52.964+0000 7f380ccf3640 1 --2- 172.21.15.78:0/3051028464 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f37f40664a0 0x7f37f4068960 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f38040af000 tx=0x7f38040a7000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:01:52.973 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:52.968+0000 7f37fd7fa640 1 -- 172.21.15.78:0/3051028464 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f38081f0df0 con 0x7f380814fc30 2023-11-28T20:01:53.122 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:53.116+0000 7f380ef57640 1 -- 172.21.15.78:0/3051028464 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs2_data", "var": "pg_num"} v 0) v1 -- 0x7f38081f0df0 con 0x7f380814fc30 2023-11-28T20:01:53.123 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:53.116+0000 7f37fd7fa640 1 -- 172.21.15.78:0/3051028464 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs2_data", "var": "pg_num"}]=0 v69) v1 ==== 101+0+11 (secure 0 0 0) 0x7f38081f0df0 con 0x7f380814fc30 2023-11-28T20:01:53.123 INFO:teuthology.orchestra.run.smithi078.stdout:pg_num: 64 2023-11-28T20:01:53.125 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:53.120+0000 7f380ef57640 1 -- 172.21.15.78:0/3051028464 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f37f40664a0 msgr2=0x7f37f4068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:01:53.125 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:53.120+0000 7f380ef57640 1 --2- 172.21.15.78:0/3051028464 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f37f40664a0 0x7f37f4068960 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f38040af000 tx=0x7f38040a7000 comp rx=0 tx=0).stop 2023-11-28T20:01:53.125 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:53.120+0000 7f380ef57640 1 -- 172.21.15.78:0/3051028464 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f380814fc30 msgr2=0x7f38081ed880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:01:53.125 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:53.120+0000 7f380ef57640 1 --2- 172.21.15.78:0/3051028464 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f380814fc30 0x7f38081ed880 secure :-1 s=READY pgs=817 cs=0 l=1 rev1=1 crypto rx=0x7f3800007e40 tx=0x7f380000e4b0 comp rx=0 tx=0).stop 2023-11-28T20:01:53.125 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:53.120+0000 7f380ef57640 1 -- 172.21.15.78:0/3051028464 shutdown_connections 2023-11-28T20:01:53.125 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:53.120+0000 7f380ef57640 1 --2- 172.21.15.78:0/3051028464 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f37f40664a0 0x7f37f4068960 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:53.125 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:53.120+0000 7f380ef57640 1 --2- 172.21.15.78:0/3051028464 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f380814f850 0x7f38080a5f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:53.125 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:53.120+0000 7f380ef57640 1 --2- 172.21.15.78:0/3051028464 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f380814fc30 0x7f38081ed880 unknown :-1 s=CLOSED pgs=817 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:53.125 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:53.120+0000 7f380ef57640 1 --2- 172.21.15.78:0/3051028464 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f380806d840 0x7f38081f1790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:53.125 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:53.120+0000 7f380ef57640 1 -- 172.21.15.78:0/3051028464 >> 172.21.15.78:0/3051028464 conn(0x7f38080c59f0 msgr2=0x7f38080a5530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:01:53.125 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:53.120+0000 7f380ef57640 1 -- 172.21.15.78:0/3051028464 shutdown_connections 2023-11-28T20:01:53.126 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:53.120+0000 7f380ef57640 1 -- 172.21.15.78:0/3051028464 wait complete. 2023-11-28T20:01:53.144 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-28T20:01:53.280 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:53.276+0000 7effd591d640 1 Processor -- start 2023-11-28T20:01:53.281 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:53.276+0000 7effd591d640 1 -- start start 2023-11-28T20:01:53.282 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:53.276+0000 7effd591d640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7effd00af4c0 0x7effd0154f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:53.282 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:53.276+0000 7effd591d640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7effd006c100 0x7effd00c6c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:53.282 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:53.276+0000 7effd591d640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7effd00c4890 con 0x7effd00c67d0 2023-11-28T20:01:53.282 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:53.276+0000 7effd591d640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7effd0155460 con 0x7effd00af4c0 2023-11-28T20:01:53.282 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:53.276+0000 7effd591d640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7effd00af8a0 con 0x7effd006c100 2023-11-28T20:01:53.282 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:53.276+0000 7effceffd640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7effd00af4c0 0x7effd0154f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:53.282 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:53.276+0000 7effceffd640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7effd00af4c0 0x7effd0154f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:60444/0 (socket says 172.21.15.78:60444) 2023-11-28T20:01:53.282 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:53.276+0000 7effc67fc640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7effd00c67d0 0x7effd006b9f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:53082/0 (socket says 172.21.15.78:53082) 2023-11-28T20:01:53.282 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:53.276+0000 7effceffd640 1 -- 172.21.15.78:0/4272067360 learned_addr learned my addr 172.21.15.78:0/4272067360 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T20:01:53.283 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:53.276+0000 7effcf7fe640 1 --2- 172.21.15.78:0/4272067360 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7effd006c100 0x7effd00c6c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:53.283 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:53.276+0000 7effceffd640 1 -- 172.21.15.78:0/4272067360 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7effd006c100 msgr2=0x7effd00c6c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:01:53.283 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:53.276+0000 7effceffd640 1 --2- 172.21.15.78:0/4272067360 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7effd006c100 0x7effd00c6c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:53.283 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:53.276+0000 7effceffd640 1 -- 172.21.15.78:0/4272067360 >> v1:172.21.15.78:6789/0 conn(0x7effd00c67d0 legacy=0x7effd006b9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:01:53.283 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:53.276+0000 7effceffd640 1 -- 172.21.15.78:0/4272067360 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7effd00c4b30 con 0x7effd00af4c0 2023-11-28T20:01:53.284 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:53.276+0000 7effce7fc640 1 -- 172.21.15.78:0/4272067360 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 690783263 0 0) 0x7effd00c4890 con 0x7effd00c67d0 2023-11-28T20:01:53.285 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:53.280+0000 7effceffd640 1 --2- 172.21.15.78:0/4272067360 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7effd00af4c0 0x7effd0154f20 secure :-1 s=READY pgs=819 cs=0 l=1 rev1=1 crypto rx=0x7effc0009870 tx=0x7effc001c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=456881fc8abb1648 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:01:53.285 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:53.280+0000 7effce7fc640 1 -- 172.21.15.78:0/4272067360 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effc00ab680 con 0x7effd00af4c0 2023-11-28T20:01:53.285 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:53.280+0000 7effce7fc640 1 -- 172.21.15.78:0/4272067360 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7effc00ab7e0 con 0x7effd00af4c0 2023-11-28T20:01:53.285 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:53.280+0000 7effce7fc640 1 -- 172.21.15.78:0/4272067360 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effc00abb70 con 0x7effd00af4c0 2023-11-28T20:01:53.286 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:53.280+0000 7effd591d640 1 -- 172.21.15.78:0/4272067360 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7effd00af4c0 msgr2=0x7effd0154f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:01:53.286 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:53.280+0000 7effd591d640 1 --2- 172.21.15.78:0/4272067360 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7effd00af4c0 0x7effd0154f20 secure :-1 s=READY pgs=819 cs=0 l=1 rev1=1 crypto rx=0x7effc0009870 tx=0x7effc001c480 comp rx=0 tx=0).stop 2023-11-28T20:01:53.287 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:53.280+0000 7effd591d640 1 -- 172.21.15.78:0/4272067360 shutdown_connections 2023-11-28T20:01:53.287 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:53.280+0000 7effd591d640 1 --2- 172.21.15.78:0/4272067360 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7effd006c100 0x7effd00c6c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:53.287 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:53.280+0000 7effd591d640 1 --2- 172.21.15.78:0/4272067360 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7effd00af4c0 0x7effd0154f20 unknown :-1 s=CLOSED pgs=819 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:53.287 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:53.280+0000 7effd591d640 1 -- 172.21.15.78:0/4272067360 >> 172.21.15.78:0/4272067360 conn(0x7effd00ab9d0 msgr2=0x7effd00abde0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:01:53.287 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:53.280+0000 7effd591d640 1 -- 172.21.15.78:0/4272067360 shutdown_connections 2023-11-28T20:01:53.287 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:53.280+0000 7effd591d640 1 -- 172.21.15.78:0/4272067360 wait complete. 2023-11-28T20:01:53.288 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:53.284+0000 7effd591d640 1 Processor -- start 2023-11-28T20:01:53.288 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:53.284+0000 7effd591d640 1 -- start start 2023-11-28T20:01:53.290 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:53.284+0000 7effd591d640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7effd006c100 0x7effd01529c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:53.291 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:53.284+0000 7effd591d640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7effd00af4c0 0x7effd01ecd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:53.291 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:53.284+0000 7effd591d640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7effd00c67d0 0x7effd01ed2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:53.291 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:53.284+0000 7effd591d640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7effd0154650 con 0x7effd00c67d0 2023-11-28T20:01:53.291 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:53.284+0000 7effd591d640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7effd0153660 con 0x7effd00af4c0 2023-11-28T20:01:53.291 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:53.284+0000 7effd591d640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7effd0153890 con 0x7effd006c100 2023-11-28T20:01:53.291 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:53.284+0000 7effcf7fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7effd00c67d0 0x7effd01ed2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:53.291 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:53.284+0000 7effcf7fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7effd00c67d0 0x7effd01ed2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:60454/0 (socket says 172.21.15.78:60454) 2023-11-28T20:01:53.291 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:53.284+0000 7effcf7fe640 1 -- 172.21.15.78:0/1985179289 learned_addr learned my addr 172.21.15.78:0/1985179289 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T20:01:53.291 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:53.284+0000 7effc67fc640 1 --2- 172.21.15.78:0/1985179289 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7effd00af4c0 0x7effd01ecd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:53.291 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:53.284+0000 7effceffd640 1 --2- 172.21.15.78:0/1985179289 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7effd006c100 0x7effd01529c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:53.291 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:53.284+0000 7effcf7fe640 1 -- 172.21.15.78:0/1985179289 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7effd006c100 msgr2=0x7effd01529c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:01:53.291 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:53.284+0000 7effcf7fe640 1 --2- 172.21.15.78:0/1985179289 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7effd006c100 0x7effd01529c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:53.292 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:53.284+0000 7effcf7fe640 1 -- 172.21.15.78:0/1985179289 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7effd00af4c0 msgr2=0x7effd01ecd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:01:53.292 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:53.284+0000 7effcf7fe640 1 --2- 172.21.15.78:0/1985179289 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7effd00af4c0 0x7effd01ecd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:53.292 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:53.284+0000 7effcf7fe640 1 -- 172.21.15.78:0/1985179289 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7effc00094d0 con 0x7effd00c67d0 2023-11-28T20:01:53.292 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:53.284+0000 7effcf7fe640 1 --2- 172.21.15.78:0/1985179289 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7effd00c67d0 0x7effd01ed2a0 secure :-1 s=READY pgs=820 cs=0 l=1 rev1=1 crypto rx=0x7effc800efc0 tx=0x7effc800c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:01:53.292 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:53.284+0000 7effccff9640 1 -- 172.21.15.78:0/1985179289 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effc8009b20 con 0x7effd00c67d0 2023-11-28T20:01:53.292 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:53.284+0000 7effccff9640 1 -- 172.21.15.78:0/1985179289 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7effc800f040 con 0x7effd00c67d0 2023-11-28T20:01:53.292 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:53.284+0000 7effccff9640 1 -- 172.21.15.78:0/1985179289 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effc80146c0 con 0x7effd00c67d0 2023-11-28T20:01:53.292 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:53.284+0000 7effd591d640 1 -- 172.21.15.78:0/1985179289 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7effd0153b70 con 0x7effd00c67d0 2023-11-28T20:01:53.292 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:53.284+0000 7effd591d640 1 -- 172.21.15.78:0/1985179289 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7effd0154130 con 0x7effd00c67d0 2023-11-28T20:01:53.293 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:53.288+0000 7effd591d640 1 -- 172.21.15.78:0/1985179289 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7effd0154350 con 0x7effd00c67d0 2023-11-28T20:01:53.293 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:53.288+0000 7effccff9640 1 -- 172.21.15.78:0/1985179289 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7effc8014820 con 0x7effd00c67d0 2023-11-28T20:01:53.293 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:53.288+0000 7effccff9640 1 --2- 172.21.15.78:0/1985179289 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7effb00664a0 0x7effb0068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:53.293 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:53.288+0000 7effccff9640 1 -- 172.21.15.78:0/1985179289 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 6119+0+0 (secure 0 0 0) 0x7effc8084c60 con 0x7effd00c67d0 2023-11-28T20:01:53.294 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:53.288+0000 7effceffd640 1 --2- 172.21.15.78:0/1985179289 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7effb00664a0 0x7effb0068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:53.294 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:53.288+0000 7effceffd640 1 --2- 172.21.15.78:0/1985179289 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7effb00664a0 0x7effb0068960 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7effc00af000 tx=0x7effc00b6040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:01:53.297 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:53.292+0000 7effccff9640 1 -- 172.21.15.78:0/1985179289 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7effc8052080 con 0x7effd00c67d0 2023-11-28T20:01:53.477 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:53.472+0000 7effd591d640 1 -- 172.21.15.78:0/1985179289 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7effd0067630 con 0x7effd00c67d0 2023-11-28T20:01:53.478 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:53.472+0000 7effccff9640 1 -- 172.21.15.78:0/1985179289 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 38 v38) v1 ==== 94+0+4917 (secure 0 0 0) 0x7effc8018090 con 0x7effd00c67d0 2023-11-28T20:01:53.478 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-11-28T20:01:53.478 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":38,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5384,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6834/837155031","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6832","nonce":837155031},{"type":"v1","addr":"172.21.15.179:6834","nonce":837155031}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":27},{"gid":5387,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6835/752467462","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6833","nonce":752467462},{"type":"v1","addr":"172.21.15.179:6835","nonce":752467462}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":27},{"gid":6459,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6837/2542805925","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6836","nonce":2542805925},{"type":"v1","addr":"172.21.15.78:6837","nonce":2542805925}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":38}],"filesystems":[{"mdsmap":{"epoch":36,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-28T20:01:23.178057+0000","modified":"2023-11-28T20:01:26.193482+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5889},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5889":{"gid":5889,"name":"c","rank":0,"incarnation":32,"state":"up:active","state_seq":6,"addr":"172.21.15.78:6835/1997036463","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6834","nonce":1997036463},{"type":"v1","addr":"172.21.15.78:6835","nonce":1997036463}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs2","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":5}]} 2023-11-28T20:01:53.480 INFO:teuthology.orchestra.run.smithi078.stderr:dumped fsmap epoch 38 2023-11-28T20:01:53.480 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:53.472+0000 7effd591d640 1 -- 172.21.15.78:0/1985179289 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7effb00664a0 msgr2=0x7effb0068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:01:53.481 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:53.472+0000 7effd591d640 1 --2- 172.21.15.78:0/1985179289 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7effb00664a0 0x7effb0068960 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7effc00af000 tx=0x7effc00b6040 comp rx=0 tx=0).stop 2023-11-28T20:01:53.481 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:53.472+0000 7effd591d640 1 -- 172.21.15.78:0/1985179289 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7effd00c67d0 msgr2=0x7effd01ed2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:01:53.481 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:53.472+0000 7effd591d640 1 --2- 172.21.15.78:0/1985179289 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7effd00c67d0 0x7effd01ed2a0 secure :-1 s=READY pgs=820 cs=0 l=1 rev1=1 crypto rx=0x7effc800efc0 tx=0x7effc800c490 comp rx=0 tx=0).stop 2023-11-28T20:01:53.481 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:53.476+0000 7effd591d640 1 -- 172.21.15.78:0/1985179289 shutdown_connections 2023-11-28T20:01:53.481 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:53.476+0000 7effd591d640 1 --2- 172.21.15.78:0/1985179289 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7effb00664a0 0x7effb0068960 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:53.482 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:53.476+0000 7effd591d640 1 --2- 172.21.15.78:0/1985179289 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7effd00c67d0 0x7effd01ed2a0 unknown :-1 s=CLOSED pgs=820 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:53.482 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:53.476+0000 7effd591d640 1 --2- 172.21.15.78:0/1985179289 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7effd00af4c0 0x7effd01ecd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:53.482 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:53.476+0000 7effd591d640 1 --2- 172.21.15.78:0/1985179289 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7effd006c100 0x7effd01529c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:53.482 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:53.476+0000 7effd591d640 1 -- 172.21.15.78:0/1985179289 >> 172.21.15.78:0/1985179289 conn(0x7effd00ab9d0 msgr2=0x7effd00aa080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:01:53.482 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:53.476+0000 7effd591d640 1 -- 172.21.15.78:0/1985179289 shutdown_connections 2023-11-28T20:01:53.482 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:53.476+0000 7effd591d640 1 -- 172.21.15.78:0/1985179289 wait complete. 2023-11-28T20:01:53.498 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-28T20:01:53.639 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:53.632+0000 7f8c20301640 1 Processor -- start 2023-11-28T20:01:53.639 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:53.632+0000 7f8c20301640 1 -- start start 2023-11-28T20:01:53.640 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:53.636+0000 7f8c20301640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f8c1814fd10 0x7f8c180a4dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:53.640 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:53.636+0000 7f8c20301640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f8c18156110 0x7f8c18156580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:53.641 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:53.636+0000 7f8c20301640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8c180c5710 con 0x7f8c180a5300 2023-11-28T20:01:53.641 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:53.636+0000 7f8c20301640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8c1806c5e0 con 0x7f8c18156110 2023-11-28T20:01:53.641 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:53.636+0000 7f8c20301640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8c18155c80 con 0x7f8c1814fd10 2023-11-28T20:01:53.641 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:53.636+0000 7f8c1e89e640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f8c18156110 0x7f8c18156580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:53.641 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:53.636+0000 7f8c1e89e640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f8c18156110 0x7f8c18156580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:60456/0 (socket says 172.21.15.78:60456) 2023-11-28T20:01:53.641 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:53.636+0000 7f8c1e89e640 1 -- 172.21.15.78:0/3532945615 learned_addr learned my addr 172.21.15.78:0/3532945615 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T20:01:53.641 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:53.636+0000 7f8c1e09d640 1 --2- 172.21.15.78:0/3532945615 >> v2:172.21.15.179:3300/0 conn(0x7f8c1814fd10 0x7f8c180a4dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:53.641 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:53.636+0000 7f8c1e89e640 1 -- 172.21.15.78:0/3532945615 >> v2:172.21.15.179:3300/0 conn(0x7f8c1814fd10 msgr2=0x7f8c180a4dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:01:53.641 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:53.636+0000 7f8c1e89e640 1 --2- 172.21.15.78:0/3532945615 >> v2:172.21.15.179:3300/0 conn(0x7f8c1814fd10 0x7f8c180a4dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:53.641 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:53.636+0000 7f8c1e89e640 1 -- 172.21.15.78:0/3532945615 >> v1:172.21.15.179:6789/0 conn(0x7f8c180a5300 legacy=0x7f8c18071e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:01:53.642 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:53.636+0000 7f8c1e89e640 1 -- 172.21.15.78:0/3532945615 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c180c4e70 con 0x7f8c18156110 2023-11-28T20:01:53.643 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:53.640+0000 7f8c1e89e640 1 --2- 172.21.15.78:0/3532945615 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8c18156110 0x7f8c18156580 secure :-1 s=READY pgs=821 cs=0 l=1 rev1=1 crypto rx=0x7f8c1806b5a0 tx=0x7f8c1001c870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7d9344cfa8ca1d2e server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:01:53.644 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:53.640+0000 7f8c1d09b640 1 -- 172.21.15.78:0/3532945615 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c100a5730 con 0x7f8c18156110 2023-11-28T20:01:53.644 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:53.640+0000 7f8c1d09b640 1 -- 172.21.15.78:0/3532945615 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c100a5890 con 0x7f8c18156110 2023-11-28T20:01:53.644 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:53.640+0000 7f8c1d09b640 1 -- 172.21.15.78:0/3532945615 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c100a5c20 con 0x7f8c18156110 2023-11-28T20:01:53.645 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:53.640+0000 7f8c20301640 1 -- 172.21.15.78:0/3532945615 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8c18156110 msgr2=0x7f8c18156580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:01:53.645 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:53.640+0000 7f8c20301640 1 --2- 172.21.15.78:0/3532945615 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8c18156110 0x7f8c18156580 secure :-1 s=READY pgs=821 cs=0 l=1 rev1=1 crypto rx=0x7f8c1806b5a0 tx=0x7f8c1001c870 comp rx=0 tx=0).stop 2023-11-28T20:01:53.645 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:53.640+0000 7f8c20301640 1 -- 172.21.15.78:0/3532945615 shutdown_connections 2023-11-28T20:01:53.645 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:53.640+0000 7f8c20301640 1 --2- 172.21.15.78:0/3532945615 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8c18156110 0x7f8c18156580 unknown :-1 s=CLOSED pgs=821 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:53.646 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:53.640+0000 7f8c20301640 1 --2- 172.21.15.78:0/3532945615 >> v2:172.21.15.179:3300/0 conn(0x7f8c1814fd10 0x7f8c180a4dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:53.646 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:53.640+0000 7f8c20301640 1 -- 172.21.15.78:0/3532945615 >> 172.21.15.78:0/3532945615 conn(0x7f8c180a7810 msgr2=0x7f8c180a7c20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:01:53.646 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:53.640+0000 7f8c20301640 1 -- 172.21.15.78:0/3532945615 shutdown_connections 2023-11-28T20:01:53.646 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:53.640+0000 7f8c20301640 1 -- 172.21.15.78:0/3532945615 wait complete. 2023-11-28T20:01:53.646 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:53.640+0000 7f8c20301640 1 Processor -- start 2023-11-28T20:01:53.647 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:53.640+0000 7f8c20301640 1 -- start start 2023-11-28T20:01:53.649 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:53.644+0000 7f8c20301640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8c180a5300 0x7f8c181ed550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:53.649 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:53.644+0000 7f8c20301640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8c1814fd10 0x7f8c181f09c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:53.649 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:53.644+0000 7f8c20301640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8c18156110 0x7f8c1814ee90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:53.649 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:53.644+0000 7f8c20301640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c18153ff0 con 0x7f8c180a5300 2023-11-28T20:01:53.649 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:53.644+0000 7f8c20301640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c181f0f00 con 0x7f8c1814fd10 2023-11-28T20:01:53.649 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:53.644+0000 7f8c20301640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c180ab3a0 con 0x7f8c18156110 2023-11-28T20:01:53.649 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:53.644+0000 7f8c1e09d640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8c180a5300 0x7f8c181ed550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:53.649 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:53.644+0000 7f8c1e09d640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8c180a5300 0x7f8c181ed550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:60460/0 (socket says 172.21.15.78:60460) 2023-11-28T20:01:53.649 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:53.644+0000 7f8c1e09d640 1 -- 172.21.15.78:0/1352742179 learned_addr learned my addr 172.21.15.78:0/1352742179 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T20:01:53.649 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:53.644+0000 7f8c1d89c640 1 --2- 172.21.15.78:0/1352742179 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8c1814fd10 0x7f8c181f09c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:53.650 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:53.644+0000 7f8c1e89e640 1 --2- 172.21.15.78:0/1352742179 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8c18156110 0x7f8c1814ee90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:53.650 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:53.644+0000 7f8c1e09d640 1 -- 172.21.15.78:0/1352742179 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8c18156110 msgr2=0x7f8c1814ee90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:01:53.650 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:53.644+0000 7f8c1e09d640 1 --2- 172.21.15.78:0/1352742179 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8c18156110 0x7f8c1814ee90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:53.650 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:53.644+0000 7f8c1e09d640 1 -- 172.21.15.78:0/1352742179 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8c1814fd10 msgr2=0x7f8c181f09c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:01:53.650 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:53.644+0000 7f8c1e09d640 1 --2- 172.21.15.78:0/1352742179 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8c1814fd10 0x7f8c181f09c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:53.650 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:53.644+0000 7f8c1e09d640 1 -- 172.21.15.78:0/1352742179 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c10009b30 con 0x7f8c180a5300 2023-11-28T20:01:53.650 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:53.644+0000 7f8c1e09d640 1 --2- 172.21.15.78:0/1352742179 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8c180a5300 0x7f8c181ed550 secure :-1 s=READY pgs=822 cs=0 l=1 rev1=1 crypto rx=0x7f8c1400d800 tx=0x7f8c1400dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:01:53.650 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:53.644+0000 7f8c0effd640 1 -- 172.21.15.78:0/1352742179 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c1400b660 con 0x7f8c180a5300 2023-11-28T20:01:53.650 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:53.644+0000 7f8c0effd640 1 -- 172.21.15.78:0/1352742179 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c1400b7c0 con 0x7f8c180a5300 2023-11-28T20:01:53.650 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:53.644+0000 7f8c0effd640 1 -- 172.21.15.78:0/1352742179 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c1400bb30 con 0x7f8c180a5300 2023-11-28T20:01:53.650 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:53.644+0000 7f8c20301640 1 -- 172.21.15.78:0/1352742179 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8c180ab680 con 0x7f8c180a5300 2023-11-28T20:01:53.651 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:53.644+0000 7f8c20301640 1 -- 172.21.15.78:0/1352742179 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8c181ed030 con 0x7f8c180a5300 2023-11-28T20:01:53.651 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:53.644+0000 7f8c20301640 1 -- 172.21.15.78:0/1352742179 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8c181ed1f0 con 0x7f8c180a5300 2023-11-28T20:01:53.651 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:53.644+0000 7f8c0effd640 1 -- 172.21.15.78:0/1352742179 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f8c1400bc90 con 0x7f8c180a5300 2023-11-28T20:01:53.652 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:53.648+0000 7f8c0effd640 1 --2- 172.21.15.78:0/1352742179 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f8bfc0664a0 0x7f8bfc068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:53.652 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:53.648+0000 7f8c0effd640 1 -- 172.21.15.78:0/1352742179 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 6119+0+0 (secure 0 0 0) 0x7f8c140844b0 con 0x7f8c180a5300 2023-11-28T20:01:53.652 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:53.648+0000 7f8c1d89c640 1 --2- 172.21.15.78:0/1352742179 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f8bfc0664a0 0x7f8bfc068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:53.652 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:53.648+0000 7f8c1d89c640 1 --2- 172.21.15.78:0/1352742179 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f8bfc0664a0 0x7f8bfc068960 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f8c181514f0 tx=0x7f8c08009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:01:53.655 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:53.652+0000 7f8c0effd640 1 -- 172.21.15.78:0/1352742179 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f8c14051780 con 0x7f8c180a5300 2023-11-28T20:01:53.807 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:53.800+0000 7f8c20301640 1 -- 172.21.15.78:0/1352742179 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f8c18067630 con 0x7f8c180a5300 2023-11-28T20:01:53.808 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:53.804+0000 7f8c0effd640 1 -- 172.21.15.78:0/1352742179 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v69) v1 ==== 74+0+16884 (secure 0 0 0) 0x7f8c14054da0 con 0x7f8c180a5300 2023-11-28T20:01:53.808 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-11-28T20:01:53.808 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":69,"fsid":"dd9780e8-3bda-44fa-a9f0-fa07d19d901d","created":"2023-11-28T19:58:40.969556+0000","modified":"2023-11-28T20:01:51.784028+0000","last_up_change":"2023-11-28T19:58:52.596716+0000","last_in_change":"2023-11-28T19:58:43.609275+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":12,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-28T19:58:54.011229+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs2_metadata","create_time":"2023-11-28T20:01:20.863763+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"64","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs2_data","create_time":"2023-11-28T20:01:22.176918+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"65","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs2"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e84245ac-b5da-429e-af18-39acaa2b33e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6800","nonce":3358701235},{"type":"v1","addr":"172.21.15.78:6801","nonce":3358701235}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6802","nonce":3358701235},{"type":"v1","addr":"172.21.15.78:6803","nonce":3358701235}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6806","nonce":3358701235},{"type":"v1","addr":"172.21.15.78:6807","nonce":3358701235}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6804","nonce":3358701235},{"type":"v1","addr":"172.21.15.78:6805","nonce":3358701235}]},"public_addr":"172.21.15.78:6801/3358701235","cluster_addr":"172.21.15.78:6803/3358701235","heartbeat_back_addr":"172.21.15.78:6807/3358701235","heartbeat_front_addr":"172.21.15.78:6805/3358701235","state":["exists","up"]},{"osd":1,"uuid":"e634831d-c4e2-48d9-870c-9556ae162981","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6808","nonce":3211476654},{"type":"v1","addr":"172.21.15.78:6809","nonce":3211476654}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6810","nonce":3211476654},{"type":"v1","addr":"172.21.15.78:6811","nonce":3211476654}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6814","nonce":3211476654},{"type":"v1","addr":"172.21.15.78:6815","nonce":3211476654}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6812","nonce":3211476654},{"type":"v1","addr":"172.21.15.78:6813","nonce":3211476654}]},"public_addr":"172.21.15.78:6809/3211476654","cluster_addr":"172.21.15.78:6811/3211476654","heartbeat_back_addr":"172.21.15.78:6815/3211476654","heartbeat_front_addr":"172.21.15.78:6813/3211476654","state":["exists","up"]},{"osd":2,"uuid":"274c8395-6534-41f0-b8fb-a00af8985aa8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6816","nonce":2532904479},{"type":"v1","addr":"172.21.15.78:6817","nonce":2532904479}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6818","nonce":2532904479},{"type":"v1","addr":"172.21.15.78:6819","nonce":2532904479}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6822","nonce":2532904479},{"type":"v1","addr":"172.21.15.78:6823","nonce":2532904479}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6820","nonce":2532904479},{"type":"v1","addr":"172.21.15.78:6821","nonce":2532904479}]},"public_addr":"172.21.15.78:6817/2532904479","cluster_addr":"172.21.15.78:6819/2532904479","heartbeat_back_addr":"172.21.15.78:6823/2532904479","heartbeat_front_addr":"172.21.15.78:6821/2532904479","state":["exists","up"]},{"osd":3,"uuid":"77acc9af-7d4d-4b18-8cf5-d62f5971b7c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6824","nonce":3442991267},{"type":"v1","addr":"172.21.15.78:6825","nonce":3442991267}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6826","nonce":3442991267},{"type":"v1","addr":"172.21.15.78:6827","nonce":3442991267}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6830","nonce":3442991267},{"type":"v1","addr":"172.21.15.78:6831","nonce":3442991267}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6828","nonce":3442991267},{"type":"v1","addr":"172.21.15.78:6829","nonce":3442991267}]},"public_addr":"172.21.15.78:6825/3442991267","cluster_addr":"172.21.15.78:6827/3442991267","heartbeat_back_addr":"172.21.15.78:6831/3442991267","heartbeat_front_addr":"172.21.15.78:6829/3442991267","state":["exists","up"]},{"osd":4,"uuid":"5c62bc66-6b34-4b7f-a66b-9a743969138c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":802983577},{"type":"v1","addr":"172.21.15.179:6809","nonce":802983577}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":802983577},{"type":"v1","addr":"172.21.15.179:6811","nonce":802983577}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":802983577},{"type":"v1","addr":"172.21.15.179:6815","nonce":802983577}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":802983577},{"type":"v1","addr":"172.21.15.179:6813","nonce":802983577}]},"public_addr":"172.21.15.179:6809/802983577","cluster_addr":"172.21.15.179:6811/802983577","heartbeat_back_addr":"172.21.15.179:6815/802983577","heartbeat_front_addr":"172.21.15.179:6813/802983577","state":["exists","up"]},{"osd":5,"uuid":"67db6d36-f684-4079-b0cd-82b4dd61461f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":518192887},{"type":"v1","addr":"172.21.15.179:6818","nonce":518192887}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":518192887},{"type":"v1","addr":"172.21.15.179:6822","nonce":518192887}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":518192887},{"type":"v1","addr":"172.21.15.179:6829","nonce":518192887}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6824","nonce":518192887},{"type":"v1","addr":"172.21.15.179:6826","nonce":518192887}]},"public_addr":"172.21.15.179:6818/518192887","cluster_addr":"172.21.15.179:6822/518192887","heartbeat_back_addr":"172.21.15.179:6829/518192887","heartbeat_front_addr":"172.21.15.179:6826/518192887","state":["exists","up"]},{"osd":6,"uuid":"12e670af-5a16-4c81-9f97-defa66cab967","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":815435378},{"type":"v1","addr":"172.21.15.179:6801","nonce":815435378}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":815435378},{"type":"v1","addr":"172.21.15.179:6803","nonce":815435378}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":815435378},{"type":"v1","addr":"172.21.15.179:6807","nonce":815435378}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":815435378},{"type":"v1","addr":"172.21.15.179:6805","nonce":815435378}]},"public_addr":"172.21.15.179:6801/815435378","cluster_addr":"172.21.15.179:6803/815435378","heartbeat_back_addr":"172.21.15.179:6807/815435378","heartbeat_front_addr":"172.21.15.179:6805/815435378","state":["exists","up"]},{"osd":7,"uuid":"fe630650-2eb3-49ad-8676-c341e6332eb1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6817","nonce":2848432339},{"type":"v1","addr":"172.21.15.179:6819","nonce":2848432339}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6821","nonce":2848432339},{"type":"v1","addr":"172.21.15.179:6823","nonce":2848432339}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":2848432339},{"type":"v1","addr":"172.21.15.179:6831","nonce":2848432339}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6825","nonce":2848432339},{"type":"v1","addr":"172.21.15.179:6827","nonce":2848432339}]},"public_addr":"172.21.15.179:6819/2848432339","cluster_addr":"172.21.15.179:6823/2848432339","heartbeat_back_addr":"172.21.15.179:6831/2848432339","heartbeat_front_addr":"172.21.15.179:6827/2848432339","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:58:49.255433+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:58:49.412880+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:58:49.559295+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:58:49.245237+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:58:49.184557+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:58:49.329851+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:58:49.366012+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:58:49.349604+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.78:6837/115607035":"2023-11-29T20:01:48.551494+0000","172.21.15.78:6836/115607035":"2023-11-29T20:01:48.551494+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-28T20:01:53.810 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:53.804+0000 7f8c20301640 1 -- 172.21.15.78:0/1352742179 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f8bfc0664a0 msgr2=0x7f8bfc068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:01:53.811 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:53.804+0000 7f8c20301640 1 --2- 172.21.15.78:0/1352742179 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f8bfc0664a0 0x7f8bfc068960 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f8c181514f0 tx=0x7f8c08009040 comp rx=0 tx=0).stop 2023-11-28T20:01:53.811 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:53.804+0000 7f8c20301640 1 -- 172.21.15.78:0/1352742179 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8c180a5300 msgr2=0x7f8c181ed550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:01:53.811 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:53.804+0000 7f8c20301640 1 --2- 172.21.15.78:0/1352742179 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8c180a5300 0x7f8c181ed550 secure :-1 s=READY pgs=822 cs=0 l=1 rev1=1 crypto rx=0x7f8c1400d800 tx=0x7f8c1400dcc0 comp rx=0 tx=0).stop 2023-11-28T20:01:53.811 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:53.804+0000 7f8c20301640 1 -- 172.21.15.78:0/1352742179 shutdown_connections 2023-11-28T20:01:53.811 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:53.804+0000 7f8c20301640 1 --2- 172.21.15.78:0/1352742179 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f8bfc0664a0 0x7f8bfc068960 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:53.811 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:53.804+0000 7f8c20301640 1 --2- 172.21.15.78:0/1352742179 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8c18156110 0x7f8c1814ee90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:53.811 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:53.804+0000 7f8c20301640 1 --2- 172.21.15.78:0/1352742179 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8c1814fd10 0x7f8c181f09c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:53.811 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:53.804+0000 7f8c20301640 1 --2- 172.21.15.78:0/1352742179 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8c180a5300 0x7f8c181ed550 unknown :-1 s=CLOSED pgs=822 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:53.812 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:53.804+0000 7f8c20301640 1 -- 172.21.15.78:0/1352742179 >> 172.21.15.78:0/1352742179 conn(0x7f8c180a7810 msgr2=0x7f8c180bf300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:01:53.812 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:53.804+0000 7f8c20301640 1 -- 172.21.15.78:0/1352742179 shutdown_connections 2023-11-28T20:01:53.812 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:53.804+0000 7f8c20301640 1 -- 172.21.15.78:0/1352742179 wait complete. 2023-11-28T20:01:53.831 INFO:tasks.cephfs.filesystem:Destroying file system cephfs2 and related pools 2023-11-28T20:01:53.831 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-28T20:01:53.967 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:53.964+0000 7f91a05aa640 1 Processor -- start 2023-11-28T20:01:53.968 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:53.964+0000 7f91a05aa640 1 -- start start 2023-11-28T20:01:53.969 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:53.964+0000 7f91a05aa640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f919806bef0 0x7f91980bfce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:53.969 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:53.964+0000 7f91a05aa640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f919814e3f0 0x7f919806c5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:53.969 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:53.964+0000 7f91a05aa640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9198151690 con 0x7f919806caf0 2023-11-28T20:01:53.969 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:53.964+0000 7f91a05aa640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9198151bc0 con 0x7f919814e3f0 2023-11-28T20:01:53.969 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:53.964+0000 7f91a05aa640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91981518e0 con 0x7f919806bef0 2023-11-28T20:01:53.970 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:53.964+0000 7f919db45640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f919814e3f0 0x7f919806c5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:53.970 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:53.964+0000 7f919db45640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f919814e3f0 0x7f919806c5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:60462/0 (socket says 172.21.15.78:60462) 2023-11-28T20:01:53.970 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:53.964+0000 7f919db45640 1 -- 172.21.15.78:0/1700172345 learned_addr learned my addr 172.21.15.78:0/1700172345 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T20:01:53.970 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:53.964+0000 7f919e346640 1 --2- 172.21.15.78:0/1700172345 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f919806bef0 0x7f91980bfce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:53.970 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:53.964+0000 7f919db45640 1 -- 172.21.15.78:0/1700172345 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f919806bef0 msgr2=0x7f91980bfce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:01:53.971 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:53.964+0000 7f919db45640 1 --2- 172.21.15.78:0/1700172345 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f919806bef0 0x7f91980bfce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:53.971 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:53.964+0000 7f919db45640 1 -- 172.21.15.78:0/1700172345 >> v1:172.21.15.179:6789/0 conn(0x7f919806caf0 legacy=0x7f9198154180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:01:53.971 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:53.964+0000 7f919db45640 1 -- 172.21.15.78:0/1700172345 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91980c1de0 con 0x7f919814e3f0 2023-11-28T20:01:53.971 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:53.964+0000 7f919e346640 1 --2- 172.21.15.78:0/1700172345 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f919806bef0 0x7f91980bfce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T20:01:53.972 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:53.968+0000 7f919db45640 1 --2- 172.21.15.78:0/1700172345 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f919814e3f0 0x7f919806c5b0 secure :-1 s=READY pgs=823 cs=0 l=1 rev1=1 crypto rx=0x7f918800bb10 tx=0x7f918801eb40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6a8f0ae67feecfad server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:01:53.973 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:53.968+0000 7f919d344640 1 -- 172.21.15.78:0/1700172345 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91880a7aa0 con 0x7f919814e3f0 2023-11-28T20:01:53.973 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:53.968+0000 7f919d344640 1 -- 172.21.15.78:0/1700172345 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f91880a7c00 con 0x7f919814e3f0 2023-11-28T20:01:53.973 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:53.968+0000 7f919d344640 1 -- 172.21.15.78:0/1700172345 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91880af440 con 0x7f919814e3f0 2023-11-28T20:01:53.974 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:53.968+0000 7f91a05aa640 1 -- 172.21.15.78:0/1700172345 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f919814e3f0 msgr2=0x7f919806c5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:01:53.974 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:53.968+0000 7f91a05aa640 1 --2- 172.21.15.78:0/1700172345 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f919814e3f0 0x7f919806c5b0 secure :-1 s=READY pgs=823 cs=0 l=1 rev1=1 crypto rx=0x7f918800bb10 tx=0x7f918801eb40 comp rx=0 tx=0).stop 2023-11-28T20:01:53.974 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:53.968+0000 7f91a05aa640 1 -- 172.21.15.78:0/1700172345 shutdown_connections 2023-11-28T20:01:53.974 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:53.968+0000 7f91a05aa640 1 --2- 172.21.15.78:0/1700172345 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f919814e3f0 0x7f919806c5b0 unknown :-1 s=CLOSED pgs=823 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:53.975 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:53.968+0000 7f91a05aa640 1 --2- 172.21.15.78:0/1700172345 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f919806bef0 0x7f91980bfce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:53.975 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:53.968+0000 7f91a05aa640 1 -- 172.21.15.78:0/1700172345 >> 172.21.15.78:0/1700172345 conn(0x7f91980a7810 msgr2=0x7f91980a7c20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:01:53.975 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:53.968+0000 7f91a05aa640 1 -- 172.21.15.78:0/1700172345 shutdown_connections 2023-11-28T20:01:53.975 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:53.968+0000 7f91a05aa640 1 -- 172.21.15.78:0/1700172345 wait complete. 2023-11-28T20:01:53.975 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:53.972+0000 7f91a05aa640 1 Processor -- start 2023-11-28T20:01:53.975 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:53.972+0000 7f91a05aa640 1 -- start start 2023-11-28T20:01:53.977 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:53.972+0000 7f91a05aa640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f919806bef0 0x7f91981ed480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:53.977 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:53.972+0000 7f91a05aa640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f919806caf0 0x7f9198072200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:53.977 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:53.972+0000 7f91a05aa640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f919814e3f0 0x7f91980a9290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:53.977 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:53.972+0000 7f91a05aa640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91980a9da0 con 0x7f919806caf0 2023-11-28T20:01:53.977 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:53.972+0000 7f91a05aa640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91980abc40 con 0x7f919806bef0 2023-11-28T20:01:53.977 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:53.972+0000 7f91a05aa640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91981f0c20 con 0x7f919814e3f0 2023-11-28T20:01:53.978 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:53.972+0000 7f919db45640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f919806caf0 0x7f9198072200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:53.978 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:53.972+0000 7f919db45640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f919806caf0 0x7f9198072200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:60464/0 (socket says 172.21.15.78:60464) 2023-11-28T20:01:53.978 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:53.972+0000 7f919db45640 1 -- 172.21.15.78:0/566923283 learned_addr learned my addr 172.21.15.78:0/566923283 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T20:01:53.978 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:53.972+0000 7f919e346640 1 --2- 172.21.15.78:0/566923283 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f919806bef0 0x7f91981ed480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:53.978 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:53.972+0000 7f919eb47640 1 --2- 172.21.15.78:0/566923283 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f919814e3f0 0x7f91980a9290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:53.978 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:53.972+0000 7f919db45640 1 -- 172.21.15.78:0/566923283 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f919814e3f0 msgr2=0x7f91980a9290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:01:53.978 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:53.972+0000 7f919db45640 1 --2- 172.21.15.78:0/566923283 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f919814e3f0 0x7f91980a9290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:53.978 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:53.972+0000 7f919db45640 1 -- 172.21.15.78:0/566923283 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f919806bef0 msgr2=0x7f91981ed480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:01:53.978 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:53.972+0000 7f919db45640 1 --2- 172.21.15.78:0/566923283 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f919806bef0 0x7f91981ed480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:53.978 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:53.972+0000 7f919db45640 1 -- 172.21.15.78:0/566923283 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f918800b770 con 0x7f919806caf0 2023-11-28T20:01:53.978 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:53.972+0000 7f919eb47640 1 --2- 172.21.15.78:0/566923283 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f919814e3f0 0x7f91980a9290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T20:01:53.979 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:53.972+0000 7f919db45640 1 --2- 172.21.15.78:0/566923283 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f919806caf0 0x7f9198072200 secure :-1 s=READY pgs=824 cs=0 l=1 rev1=1 crypto rx=0x7f918801f3e0 tx=0x7f918801b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:01:53.979 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:53.972+0000 7f918effd640 1 -- 172.21.15.78:0/566923283 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91880ba660 con 0x7f919806caf0 2023-11-28T20:01:53.980 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:53.972+0000 7f918effd640 1 -- 172.21.15.78:0/566923283 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f91880ba7e0 con 0x7f919806caf0 2023-11-28T20:01:53.980 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:53.972+0000 7f91a05aa640 1 -- 172.21.15.78:0/566923283 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f91980ab3a0 con 0x7f919806caf0 2023-11-28T20:01:53.980 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:53.972+0000 7f918effd640 1 -- 172.21.15.78:0/566923283 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91880bab90 con 0x7f919806caf0 2023-11-28T20:01:53.980 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:53.972+0000 7f91a05aa640 1 -- 172.21.15.78:0/566923283 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f91980ab960 con 0x7f919806caf0 2023-11-28T20:01:53.980 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:53.972+0000 7f91a05aa640 1 -- 172.21.15.78:0/566923283 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f91981f09f0 con 0x7f919806caf0 2023-11-28T20:01:53.980 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:53.976+0000 7f918effd640 1 -- 172.21.15.78:0/566923283 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f91880c2360 con 0x7f919806caf0 2023-11-28T20:01:53.981 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:53.976+0000 7f918effd640 1 --2- 172.21.15.78:0/566923283 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f917c066470 0x7f917c068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:53.981 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:53.976+0000 7f918effd640 1 -- 172.21.15.78:0/566923283 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 6119+0+0 (secure 0 0 0) 0x7f918811ef70 con 0x7f919806caf0 2023-11-28T20:01:53.981 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:53.976+0000 7f919e346640 1 --2- 172.21.15.78:0/566923283 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f917c066470 0x7f917c068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:53.981 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:53.976+0000 7f919e346640 1 --2- 172.21.15.78:0/566923283 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f917c066470 0x7f917c068930 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f919400ab60 tx=0x7f9194008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:01:53.984 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:53.980+0000 7f918effd640 1 -- 172.21.15.78:0/566923283 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f91981f09f0 con 0x7f919806caf0 2023-11-28T20:01:54.166 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:54.160+0000 7f91a05aa640 1 -- 172.21.15.78:0/566923283 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f91981f09f0 con 0x7f919806caf0 2023-11-28T20:01:54.167 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:54.160+0000 7f918effd640 1 -- 172.21.15.78:0/566923283 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 38 v38) v1 ==== 94+0+4917 (secure 0 0 0) 0x7f91880ec260 con 0x7f919806caf0 2023-11-28T20:01:54.167 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-11-28T20:01:54.167 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":38,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5384,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6834/837155031","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6832","nonce":837155031},{"type":"v1","addr":"172.21.15.179:6834","nonce":837155031}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":27},{"gid":5387,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6835/752467462","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6833","nonce":752467462},{"type":"v1","addr":"172.21.15.179:6835","nonce":752467462}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":27},{"gid":6459,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6837/2542805925","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6836","nonce":2542805925},{"type":"v1","addr":"172.21.15.78:6837","nonce":2542805925}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":38}],"filesystems":[{"mdsmap":{"epoch":36,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-28T20:01:23.178057+0000","modified":"2023-11-28T20:01:26.193482+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5889},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5889":{"gid":5889,"name":"c","rank":0,"incarnation":32,"state":"up:active","state_seq":6,"addr":"172.21.15.78:6835/1997036463","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6834","nonce":1997036463},{"type":"v1","addr":"172.21.15.78:6835","nonce":1997036463}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs2","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":5}]} 2023-11-28T20:01:54.167 INFO:teuthology.orchestra.run.smithi078.stderr:dumped fsmap epoch 38 2023-11-28T20:01:54.169 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:54.164+0000 7f91a05aa640 1 -- 172.21.15.78:0/566923283 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f917c066470 msgr2=0x7f917c068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:01:54.169 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:54.164+0000 7f91a05aa640 1 --2- 172.21.15.78:0/566923283 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f917c066470 0x7f917c068930 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f919400ab60 tx=0x7f9194008040 comp rx=0 tx=0).stop 2023-11-28T20:01:54.170 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:54.164+0000 7f91a05aa640 1 -- 172.21.15.78:0/566923283 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f919806caf0 msgr2=0x7f9198072200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:01:54.170 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:54.164+0000 7f91a05aa640 1 --2- 172.21.15.78:0/566923283 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f919806caf0 0x7f9198072200 secure :-1 s=READY pgs=824 cs=0 l=1 rev1=1 crypto rx=0x7f918801f3e0 tx=0x7f918801b8e0 comp rx=0 tx=0).stop 2023-11-28T20:01:54.170 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:54.164+0000 7f91a05aa640 1 -- 172.21.15.78:0/566923283 shutdown_connections 2023-11-28T20:01:54.170 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:54.164+0000 7f91a05aa640 1 --2- 172.21.15.78:0/566923283 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f917c066470 0x7f917c068930 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:54.170 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:54.164+0000 7f91a05aa640 1 --2- 172.21.15.78:0/566923283 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f919814e3f0 0x7f91980a9290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:54.170 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:54.164+0000 7f91a05aa640 1 --2- 172.21.15.78:0/566923283 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f919806caf0 0x7f9198072200 unknown :-1 s=CLOSED pgs=824 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:54.170 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:54.164+0000 7f91a05aa640 1 --2- 172.21.15.78:0/566923283 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f919806bef0 0x7f91981ed480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:54.170 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:54.164+0000 7f91a05aa640 1 -- 172.21.15.78:0/566923283 >> 172.21.15.78:0/566923283 conn(0x7f91980a7810 msgr2=0x7f91980bee90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:01:54.170 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:54.164+0000 7f91a05aa640 1 -- 172.21.15.78:0/566923283 shutdown_connections 2023-11-28T20:01:54.170 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:54.164+0000 7f91a05aa640 1 -- 172.21.15.78:0/566923283 wait complete. 2023-11-28T20:01:54.188 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-28T20:01:54.324 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:54.320+0000 7fcf14817640 1 Processor -- start 2023-11-28T20:01:54.324 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:54.320+0000 7fcf14817640 1 -- start start 2023-11-28T20:01:54.326 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:54.320+0000 7fcf14817640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcf10151ec0 0x7fcf10155100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:54.326 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:54.320+0000 7fcf14817640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fcf100c47c0 0x7fcf1006b320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:54.326 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:54.320+0000 7fcf14817640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcf10155640 con 0x7fcf100c94f0 2023-11-28T20:01:54.326 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:54.320+0000 7fcf14817640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcf100c8aa0 con 0x7fcf100c47c0 2023-11-28T20:01:54.326 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:54.320+0000 7fcf14817640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf100c9060 con 0x7fcf10151ec0 2023-11-28T20:01:54.326 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:54.320+0000 7fcf05d9b640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fcf100c47c0 0x7fcf1006b320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:54.326 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:54.320+0000 7fcf05d9b640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fcf100c47c0 0x7fcf1006b320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:60480/0 (socket says 172.21.15.78:60480) 2023-11-28T20:01:54.326 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:54.320+0000 7fcf0ed9d640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7fcf100c94f0 0x7fcf100c7f60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:53098/0 (socket says 172.21.15.78:53098) 2023-11-28T20:01:54.327 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:54.320+0000 7fcf05d9b640 1 -- 172.21.15.78:0/4180622137 learned_addr learned my addr 172.21.15.78:0/4180622137 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T20:01:54.327 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:54.320+0000 7fcf0e59c640 1 --2- 172.21.15.78:0/4180622137 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcf10151ec0 0x7fcf10155100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:54.327 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:54.320+0000 7fcf05d9b640 1 -- 172.21.15.78:0/4180622137 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcf10151ec0 msgr2=0x7fcf10155100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:01:54.327 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:54.320+0000 7fcf05d9b640 1 --2- 172.21.15.78:0/4180622137 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcf10151ec0 0x7fcf10155100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:54.327 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:54.320+0000 7fcf05d9b640 1 -- 172.21.15.78:0/4180622137 >> v1:172.21.15.78:6789/0 conn(0x7fcf100c94f0 legacy=0x7fcf100c7f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:01:54.327 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:54.320+0000 7fcf05d9b640 1 -- 172.21.15.78:0/4180622137 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf1006b860 con 0x7fcf100c47c0 2023-11-28T20:01:54.327 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:54.320+0000 7fcf0dd9b640 1 -- 172.21.15.78:0/4180622137 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 49881199 0 0) 0x7fcf080014a0 con 0x7fcf100c94f0 2023-11-28T20:01:54.329 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:54.324+0000 7fcf05d9b640 1 --2- 172.21.15.78:0/4180622137 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcf100c47c0 0x7fcf1006b320 secure :-1 s=READY pgs=826 cs=0 l=1 rev1=1 crypto rx=0x7fcf000098a0 tx=0x7fcf0001c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=139cb90f5e00c2c0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:01:54.329 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:54.324+0000 7fcf0dd9b640 1 -- 172.21.15.78:0/4180622137 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf000aa680 con 0x7fcf100c47c0 2023-11-28T20:01:54.329 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:54.324+0000 7fcf0dd9b640 1 -- 172.21.15.78:0/4180622137 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf000aa7e0 con 0x7fcf100c47c0 2023-11-28T20:01:54.329 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:54.324+0000 7fcf0dd9b640 1 -- 172.21.15.78:0/4180622137 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf000aab70 con 0x7fcf100c47c0 2023-11-28T20:01:54.334 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:54.324+0000 7fcf14817640 1 -- 172.21.15.78:0/4180622137 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcf100c47c0 msgr2=0x7fcf1006b320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:01:54.335 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:54.324+0000 7fcf14817640 1 --2- 172.21.15.78:0/4180622137 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcf100c47c0 0x7fcf1006b320 secure :-1 s=READY pgs=826 cs=0 l=1 rev1=1 crypto rx=0x7fcf000098a0 tx=0x7fcf0001c520 comp rx=0 tx=0).stop 2023-11-28T20:01:54.335 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:54.324+0000 7fcf14817640 1 -- 172.21.15.78:0/4180622137 shutdown_connections 2023-11-28T20:01:54.335 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:54.324+0000 7fcf14817640 1 --2- 172.21.15.78:0/4180622137 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcf100c47c0 0x7fcf1006b320 unknown :-1 s=CLOSED pgs=826 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:54.335 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:54.324+0000 7fcf14817640 1 --2- 172.21.15.78:0/4180622137 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcf10151ec0 0x7fcf10155100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:54.335 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:54.324+0000 7fcf14817640 1 -- 172.21.15.78:0/4180622137 >> 172.21.15.78:0/4180622137 conn(0x7fcf100c9e40 msgr2=0x7fcf100ca250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:01:54.335 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:54.324+0000 7fcf14817640 1 -- 172.21.15.78:0/4180622137 shutdown_connections 2023-11-28T20:01:54.335 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:54.324+0000 7fcf14817640 1 -- 172.21.15.78:0/4180622137 wait complete. 2023-11-28T20:01:54.335 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:54.328+0000 7fcf14817640 1 Processor -- start 2023-11-28T20:01:54.336 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:54.328+0000 7fcf14817640 1 -- start start 2023-11-28T20:01:54.336 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:54.328+0000 7fcf14817640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcf100c47c0 0x7fcf10146bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:54.336 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:54.328+0000 7fcf14817640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcf100c94f0 0x7fcf101438b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:54.336 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:54.328+0000 7fcf14817640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcf10151ec0 0x7fcf101f0430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:54.336 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:54.328+0000 7fcf14817640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf100ab300 con 0x7fcf100c47c0 2023-11-28T20:01:54.336 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:54.328+0000 7fcf14817640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf10143420 con 0x7fcf100c94f0 2023-11-28T20:01:54.336 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:54.328+0000 7fcf14817640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf10142af0 con 0x7fcf10151ec0 2023-11-28T20:01:54.336 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:54.328+0000 7fcf0e59c640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcf100c47c0 0x7fcf10146bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:54.336 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:54.328+0000 7fcf0e59c640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcf100c47c0 0x7fcf10146bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:60492/0 (socket says 172.21.15.78:60492) 2023-11-28T20:01:54.336 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:54.328+0000 7fcf0e59c640 1 -- 172.21.15.78:0/3203862635 learned_addr learned my addr 172.21.15.78:0/3203862635 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T20:01:54.337 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:54.328+0000 7fcf05d9b640 1 --2- 172.21.15.78:0/3203862635 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcf100c94f0 0x7fcf101438b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:54.337 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:54.328+0000 7fcf0ed9d640 1 --2- 172.21.15.78:0/3203862635 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcf10151ec0 0x7fcf101f0430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:54.337 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:54.328+0000 7fcf0e59c640 1 -- 172.21.15.78:0/3203862635 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcf10151ec0 msgr2=0x7fcf101f0430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:01:54.337 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:54.328+0000 7fcf0e59c640 1 --2- 172.21.15.78:0/3203862635 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcf10151ec0 0x7fcf101f0430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:54.337 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:54.328+0000 7fcf0e59c640 1 -- 172.21.15.78:0/3203862635 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcf100c94f0 msgr2=0x7fcf101438b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:01:54.337 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:54.328+0000 7fcf0e59c640 1 --2- 172.21.15.78:0/3203862635 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcf100c94f0 0x7fcf101438b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:54.337 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:54.328+0000 7fcf0e59c640 1 -- 172.21.15.78:0/3203862635 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf000094d0 con 0x7fcf100c47c0 2023-11-28T20:01:54.337 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:54.328+0000 7fcf05d9b640 1 --2- 172.21.15.78:0/3203862635 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcf100c94f0 0x7fcf101438b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T20:01:54.337 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:54.328+0000 7fcf0ed9d640 1 --2- 172.21.15.78:0/3203862635 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcf10151ec0 0x7fcf101f0430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T20:01:54.338 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:54.328+0000 7fcf0e59c640 1 --2- 172.21.15.78:0/3203862635 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcf100c47c0 0x7fcf10146bf0 secure :-1 s=READY pgs=827 cs=0 l=1 rev1=1 crypto rx=0x7fcef800d620 tx=0x7fcef800dae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:01:54.338 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:54.328+0000 7fcf077fe640 1 -- 172.21.15.78:0/3203862635 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcef800b620 con 0x7fcf100c47c0 2023-11-28T20:01:54.338 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:54.328+0000 7fcf077fe640 1 -- 172.21.15.78:0/3203862635 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcef800b780 con 0x7fcf100c47c0 2023-11-28T20:01:54.338 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:54.328+0000 7fcf14817640 1 -- 172.21.15.78:0/3203862635 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcf10142dd0 con 0x7fcf100c47c0 2023-11-28T20:01:54.338 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:54.328+0000 7fcf077fe640 1 -- 172.21.15.78:0/3203862635 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcef800bb10 con 0x7fcf100c47c0 2023-11-28T20:01:54.338 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:54.328+0000 7fcf14817640 1 -- 172.21.15.78:0/3203862635 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcf10147130 con 0x7fcf100c47c0 2023-11-28T20:01:54.339 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:54.332+0000 7fcf14817640 1 -- 172.21.15.78:0/3203862635 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcf10067630 con 0x7fcf100c47c0 2023-11-28T20:01:54.339 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:54.332+0000 7fcf077fe640 1 -- 172.21.15.78:0/3203862635 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fcef800bc70 con 0x7fcf100c47c0 2023-11-28T20:01:54.339 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:54.332+0000 7fcf077fe640 1 --2- 172.21.15.78:0/3203862635 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fcef0066470 0x7fcef0068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:54.339 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:54.332+0000 7fcf077fe640 1 -- 172.21.15.78:0/3203862635 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 6119+0+0 (secure 0 0 0) 0x7fcef80845c0 con 0x7fcf100c47c0 2023-11-28T20:01:54.340 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:54.332+0000 7fcf05d9b640 1 --2- 172.21.15.78:0/3203862635 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fcef0066470 0x7fcef0068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:54.340 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:54.332+0000 7fcf05d9b640 1 --2- 172.21.15.78:0/3203862635 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fcef0066470 0x7fcef0068930 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7fcf000ae000 tx=0x7fcf00008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:01:54.341 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:54.336+0000 7fcf077fe640 1 -- 172.21.15.78:0/3203862635 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fcef8051800 con 0x7fcf100c47c0 2023-11-28T20:01:54.518 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:54.512+0000 7fcf14817640 1 -- 172.21.15.78:0/3203862635 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fcf100c7d40 con 0x7fcf100c47c0 2023-11-28T20:01:54.519 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:54.512+0000 7fcf077fe640 1 -- 172.21.15.78:0/3203862635 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 38 v38) v1 ==== 94+0+4917 (secure 0 0 0) 0x7fcef8054e20 con 0x7fcf100c47c0 2023-11-28T20:01:54.519 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-11-28T20:01:54.519 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":38,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5384,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6834/837155031","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6832","nonce":837155031},{"type":"v1","addr":"172.21.15.179:6834","nonce":837155031}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":27},{"gid":5387,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6835/752467462","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6833","nonce":752467462},{"type":"v1","addr":"172.21.15.179:6835","nonce":752467462}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":27},{"gid":6459,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6837/2542805925","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6836","nonce":2542805925},{"type":"v1","addr":"172.21.15.78:6837","nonce":2542805925}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":38}],"filesystems":[{"mdsmap":{"epoch":36,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-28T20:01:23.178057+0000","modified":"2023-11-28T20:01:26.193482+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5889},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5889":{"gid":5889,"name":"c","rank":0,"incarnation":32,"state":"up:active","state_seq":6,"addr":"172.21.15.78:6835/1997036463","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6834","nonce":1997036463},{"type":"v1","addr":"172.21.15.78:6835","nonce":1997036463}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs2","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":5}]} 2023-11-28T20:01:54.520 INFO:teuthology.orchestra.run.smithi078.stderr:dumped fsmap epoch 38 2023-11-28T20:01:54.523 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:54.516+0000 7fcf14817640 1 -- 172.21.15.78:0/3203862635 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fcef0066470 msgr2=0x7fcef0068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:01:54.523 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:54.516+0000 7fcf14817640 1 --2- 172.21.15.78:0/3203862635 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fcef0066470 0x7fcef0068930 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7fcf000ae000 tx=0x7fcf00008040 comp rx=0 tx=0).stop 2023-11-28T20:01:54.523 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:54.516+0000 7fcf14817640 1 -- 172.21.15.78:0/3203862635 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcf100c47c0 msgr2=0x7fcf10146bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:01:54.524 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:54.516+0000 7fcf14817640 1 --2- 172.21.15.78:0/3203862635 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcf100c47c0 0x7fcf10146bf0 secure :-1 s=READY pgs=827 cs=0 l=1 rev1=1 crypto rx=0x7fcef800d620 tx=0x7fcef800dae0 comp rx=0 tx=0).stop 2023-11-28T20:01:54.524 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:54.516+0000 7fcf14817640 1 -- 172.21.15.78:0/3203862635 shutdown_connections 2023-11-28T20:01:54.524 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:54.516+0000 7fcf14817640 1 --2- 172.21.15.78:0/3203862635 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fcef0066470 0x7fcef0068930 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:54.525 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:54.516+0000 7fcf14817640 1 --2- 172.21.15.78:0/3203862635 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcf10151ec0 0x7fcf101f0430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:54.526 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:54.516+0000 7fcf14817640 1 --2- 172.21.15.78:0/3203862635 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcf100c94f0 0x7fcf101438b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:54.526 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:54.516+0000 7fcf14817640 1 --2- 172.21.15.78:0/3203862635 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcf100c47c0 0x7fcf10146bf0 unknown :-1 s=CLOSED pgs=827 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:54.526 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:54.516+0000 7fcf14817640 1 -- 172.21.15.78:0/3203862635 >> 172.21.15.78:0/3203862635 conn(0x7fcf100c9e40 msgr2=0x7fcf10151190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:01:54.527 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:54.516+0000 7fcf14817640 1 -- 172.21.15.78:0/3203862635 shutdown_connections 2023-11-28T20:01:54.527 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:54.516+0000 7fcf14817640 1 -- 172.21.15.78:0/3203862635 wait complete. 2023-11-28T20:01:54.540 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-28T20:01:54.678 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:54.672+0000 7f405a172640 1 Processor -- start 2023-11-28T20:01:54.678 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:54.672+0000 7f405a172640 1 -- start start 2023-11-28T20:01:54.680 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:54.672+0000 7f405a172640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f405406d2b0 0x7f405406d690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:54.680 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:54.672+0000 7f405a172640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f40540c3b80 0x7f40540c5300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:54.680 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:54.672+0000 7f405a172640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f405406bb80 con 0x7f405406c020 2023-11-28T20:01:54.681 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:54.672+0000 7f405a172640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f40540c5840 con 0x7f405406d2b0 2023-11-28T20:01:54.681 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:54.672+0000 7f405a172640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f40541515c0 con 0x7f40540c3b80 2023-11-28T20:01:54.681 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:54.672+0000 7f40537fe640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f405406d2b0 0x7f405406d690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:54.681 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:54.672+0000 7f40537fe640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f405406d2b0 0x7f405406d690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:60506/0 (socket says 172.21.15.78:60506) 2023-11-28T20:01:54.681 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:54.672+0000 7f40537fe640 1 -- 172.21.15.78:0/2095654136 learned_addr learned my addr 172.21.15.78:0/2095654136 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T20:01:54.681 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:54.672+0000 7f4052ffd640 1 --2- 172.21.15.78:0/2095654136 >> v2:172.21.15.179:3300/0 conn(0x7f40540c3b80 0x7f40540c5300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:54.681 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:54.672+0000 7f40537fe640 1 -- 172.21.15.78:0/2095654136 >> v2:172.21.15.179:3300/0 conn(0x7f40540c3b80 msgr2=0x7f40540c5300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:01:54.681 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:54.672+0000 7f40537fe640 1 --2- 172.21.15.78:0/2095654136 >> v2:172.21.15.179:3300/0 conn(0x7f40540c3b80 0x7f40540c5300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:54.682 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:54.672+0000 7f40537fe640 1 -- 172.21.15.78:0/2095654136 >> v1:172.21.15.78:6789/0 conn(0x7f405406c020 legacy=0x7f405406c4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:01:54.682 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:54.672+0000 7f40537fe640 1 -- 172.21.15.78:0/2095654136 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40541518a0 con 0x7f405406d2b0 2023-11-28T20:01:54.683 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:54.676+0000 7f40537fe640 1 --2- 172.21.15.78:0/2095654136 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f405406d2b0 0x7f405406d690 secure :-1 s=READY pgs=829 cs=0 l=1 rev1=1 crypto rx=0x7f405406b5a0 tx=0x7f404401c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c19093756f42d5db server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:01:54.683 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:54.676+0000 7f40527fc640 1 -- 172.21.15.78:0/2095654136 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40440ac640 con 0x7f405406d2b0 2023-11-28T20:01:54.683 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:54.676+0000 7f40527fc640 1 -- 172.21.15.78:0/2095654136 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40440ac7a0 con 0x7f405406d2b0 2023-11-28T20:01:54.684 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:54.676+0000 7f40527fc640 1 -- 172.21.15.78:0/2095654136 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40440acb30 con 0x7f405406d2b0 2023-11-28T20:01:54.685 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:54.676+0000 7f405a172640 1 -- 172.21.15.78:0/2095654136 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f405406d2b0 msgr2=0x7f405406d690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:01:54.685 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:54.676+0000 7f405a172640 1 --2- 172.21.15.78:0/2095654136 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f405406d2b0 0x7f405406d690 secure :-1 s=READY pgs=829 cs=0 l=1 rev1=1 crypto rx=0x7f405406b5a0 tx=0x7f404401c4d0 comp rx=0 tx=0).stop 2023-11-28T20:01:54.685 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:54.676+0000 7f405a172640 1 -- 172.21.15.78:0/2095654136 shutdown_connections 2023-11-28T20:01:54.685 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:54.676+0000 7f405a172640 1 --2- 172.21.15.78:0/2095654136 >> v2:172.21.15.179:3300/0 conn(0x7f40540c3b80 0x7f40540c5300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:54.686 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:54.676+0000 7f405a172640 1 --2- 172.21.15.78:0/2095654136 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f405406d2b0 0x7f405406d690 unknown :-1 s=CLOSED pgs=829 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:54.686 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:54.676+0000 7f405a172640 1 -- 172.21.15.78:0/2095654136 >> 172.21.15.78:0/2095654136 conn(0x7f40540a7810 msgr2=0x7f40540a7c20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:01:54.686 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:54.676+0000 7f405a172640 1 -- 172.21.15.78:0/2095654136 shutdown_connections 2023-11-28T20:01:54.686 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:54.676+0000 7f405a172640 1 -- 172.21.15.78:0/2095654136 wait complete. 2023-11-28T20:01:54.689 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:54.680+0000 7f405a172640 1 Processor -- start 2023-11-28T20:01:54.689 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:54.680+0000 7f405a172640 1 -- start start 2023-11-28T20:01:54.689 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:54.680+0000 7f405a172640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f405406c020 0x7f40540ab4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:54.689 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:54.680+0000 7f405a172640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f405406d2b0 0x7f40540a91e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:54.689 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:54.680+0000 7f405a172640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f40540c3b80 0x7f405414fe10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:54.690 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:54.680+0000 7f405a172640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40540c0040 con 0x7f405406c020 2023-11-28T20:01:54.690 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:54.680+0000 7f405a172640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f405415a9b0 con 0x7f405406d2b0 2023-11-28T20:01:54.690 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:54.680+0000 7f405a172640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4054150b10 con 0x7f40540c3b80 2023-11-28T20:01:54.690 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:54.680+0000 7f40537fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f405406c020 0x7f40540ab4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:54.690 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:54.680+0000 7f40537fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f405406c020 0x7f40540ab4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:60520/0 (socket says 172.21.15.78:60520) 2023-11-28T20:01:54.690 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:54.680+0000 7f40537fe640 1 -- 172.21.15.78:0/2807951165 learned_addr learned my addr 172.21.15.78:0/2807951165 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T20:01:54.690 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:54.680+0000 7f4052ffd640 1 --2- 172.21.15.78:0/2807951165 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f405406d2b0 0x7f40540a91e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:54.690 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:54.680+0000 7f4053fff640 1 --2- 172.21.15.78:0/2807951165 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f40540c3b80 0x7f405414fe10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:54.690 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:54.680+0000 7f40537fe640 1 -- 172.21.15.78:0/2807951165 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f40540c3b80 msgr2=0x7f405414fe10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:01:54.691 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:54.680+0000 7f40537fe640 1 --2- 172.21.15.78:0/2807951165 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f40540c3b80 0x7f405414fe10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:54.691 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:54.680+0000 7f40537fe640 1 -- 172.21.15.78:0/2807951165 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f405406d2b0 msgr2=0x7f40540a91e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:01:54.691 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:54.680+0000 7f40537fe640 1 --2- 172.21.15.78:0/2807951165 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f405406d2b0 0x7f40540a91e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:54.691 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:54.680+0000 7f40537fe640 1 -- 172.21.15.78:0/2807951165 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40440094d0 con 0x7f405406c020 2023-11-28T20:01:54.691 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:54.680+0000 7f40537fe640 1 --2- 172.21.15.78:0/2807951165 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f405406c020 0x7f40540ab4c0 secure :-1 s=READY pgs=830 cs=0 l=1 rev1=1 crypto rx=0x7f40440af040 tx=0x7f4044019270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:01:54.691 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:54.680+0000 7f403bfff640 1 -- 172.21.15.78:0/2807951165 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40440b7670 con 0x7f405406c020 2023-11-28T20:01:54.691 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:54.680+0000 7f403bfff640 1 -- 172.21.15.78:0/2807951165 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40440b77d0 con 0x7f405406c020 2023-11-28T20:01:54.691 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:54.680+0000 7f403bfff640 1 -- 172.21.15.78:0/2807951165 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40440b7b60 con 0x7f405406c020 2023-11-28T20:01:54.691 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:54.680+0000 7f405a172640 1 -- 172.21.15.78:0/2807951165 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f405414ef80 con 0x7f405406c020 2023-11-28T20:01:54.691 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:54.684+0000 7f405a172640 1 -- 172.21.15.78:0/2807951165 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f40540aae30 con 0x7f405406c020 2023-11-28T20:01:54.692 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:54.684+0000 7f405a172640 1 -- 172.21.15.78:0/2807951165 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4054067630 con 0x7f405406c020 2023-11-28T20:01:54.692 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:54.684+0000 7f403bfff640 1 -- 172.21.15.78:0/2807951165 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f40440b3070 con 0x7f405406c020 2023-11-28T20:01:54.692 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:54.684+0000 7f403bfff640 1 --2- 172.21.15.78:0/2807951165 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f40400664a0 0x7f4040068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:54.693 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:54.684+0000 7f403bfff640 1 -- 172.21.15.78:0/2807951165 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 6119+0+0 (secure 0 0 0) 0x7f404411e990 con 0x7f405406c020 2023-11-28T20:01:54.693 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:54.684+0000 7f4052ffd640 1 --2- 172.21.15.78:0/2807951165 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f40400664a0 0x7f4040068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:54.693 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:54.684+0000 7f4052ffd640 1 --2- 172.21.15.78:0/2807951165 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f40400664a0 0x7f4040068960 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f40540aba00 tx=0x7f4048009190 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:01:54.693 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:54.688+0000 7f403bfff640 1 -- 172.21.15.78:0/2807951165 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f40440ebc60 con 0x7f405406c020 2023-11-28T20:01:54.847 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:54.844+0000 7f405a172640 1 -- 172.21.15.78:0/2807951165 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f405406bd70 con 0x7f405406c020 2023-11-28T20:01:54.849 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:54.844+0000 7f403bfff640 1 -- 172.21.15.78:0/2807951165 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v69) v1 ==== 74+0+16884 (secure 0 0 0) 0x7f40440b1020 con 0x7f405406c020 2023-11-28T20:01:54.849 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-11-28T20:01:54.850 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":69,"fsid":"dd9780e8-3bda-44fa-a9f0-fa07d19d901d","created":"2023-11-28T19:58:40.969556+0000","modified":"2023-11-28T20:01:51.784028+0000","last_up_change":"2023-11-28T19:58:52.596716+0000","last_in_change":"2023-11-28T19:58:43.609275+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":12,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-28T19:58:54.011229+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs2_metadata","create_time":"2023-11-28T20:01:20.863763+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"64","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs2_data","create_time":"2023-11-28T20:01:22.176918+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"65","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs2"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e84245ac-b5da-429e-af18-39acaa2b33e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6800","nonce":3358701235},{"type":"v1","addr":"172.21.15.78:6801","nonce":3358701235}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6802","nonce":3358701235},{"type":"v1","addr":"172.21.15.78:6803","nonce":3358701235}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6806","nonce":3358701235},{"type":"v1","addr":"172.21.15.78:6807","nonce":3358701235}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6804","nonce":3358701235},{"type":"v1","addr":"172.21.15.78:6805","nonce":3358701235}]},"public_addr":"172.21.15.78:6801/3358701235","cluster_addr":"172.21.15.78:6803/3358701235","heartbeat_back_addr":"172.21.15.78:6807/3358701235","heartbeat_front_addr":"172.21.15.78:6805/3358701235","state":["exists","up"]},{"osd":1,"uuid":"e634831d-c4e2-48d9-870c-9556ae162981","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6808","nonce":3211476654},{"type":"v1","addr":"172.21.15.78:6809","nonce":3211476654}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6810","nonce":3211476654},{"type":"v1","addr":"172.21.15.78:6811","nonce":3211476654}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6814","nonce":3211476654},{"type":"v1","addr":"172.21.15.78:6815","nonce":3211476654}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6812","nonce":3211476654},{"type":"v1","addr":"172.21.15.78:6813","nonce":3211476654}]},"public_addr":"172.21.15.78:6809/3211476654","cluster_addr":"172.21.15.78:6811/3211476654","heartbeat_back_addr":"172.21.15.78:6815/3211476654","heartbeat_front_addr":"172.21.15.78:6813/3211476654","state":["exists","up"]},{"osd":2,"uuid":"274c8395-6534-41f0-b8fb-a00af8985aa8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6816","nonce":2532904479},{"type":"v1","addr":"172.21.15.78:6817","nonce":2532904479}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6818","nonce":2532904479},{"type":"v1","addr":"172.21.15.78:6819","nonce":2532904479}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6822","nonce":2532904479},{"type":"v1","addr":"172.21.15.78:6823","nonce":2532904479}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6820","nonce":2532904479},{"type":"v1","addr":"172.21.15.78:6821","nonce":2532904479}]},"public_addr":"172.21.15.78:6817/2532904479","cluster_addr":"172.21.15.78:6819/2532904479","heartbeat_back_addr":"172.21.15.78:6823/2532904479","heartbeat_front_addr":"172.21.15.78:6821/2532904479","state":["exists","up"]},{"osd":3,"uuid":"77acc9af-7d4d-4b18-8cf5-d62f5971b7c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6824","nonce":3442991267},{"type":"v1","addr":"172.21.15.78:6825","nonce":3442991267}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6826","nonce":3442991267},{"type":"v1","addr":"172.21.15.78:6827","nonce":3442991267}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6830","nonce":3442991267},{"type":"v1","addr":"172.21.15.78:6831","nonce":3442991267}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6828","nonce":3442991267},{"type":"v1","addr":"172.21.15.78:6829","nonce":3442991267}]},"public_addr":"172.21.15.78:6825/3442991267","cluster_addr":"172.21.15.78:6827/3442991267","heartbeat_back_addr":"172.21.15.78:6831/3442991267","heartbeat_front_addr":"172.21.15.78:6829/3442991267","state":["exists","up"]},{"osd":4,"uuid":"5c62bc66-6b34-4b7f-a66b-9a743969138c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":802983577},{"type":"v1","addr":"172.21.15.179:6809","nonce":802983577}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":802983577},{"type":"v1","addr":"172.21.15.179:6811","nonce":802983577}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":802983577},{"type":"v1","addr":"172.21.15.179:6815","nonce":802983577}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":802983577},{"type":"v1","addr":"172.21.15.179:6813","nonce":802983577}]},"public_addr":"172.21.15.179:6809/802983577","cluster_addr":"172.21.15.179:6811/802983577","heartbeat_back_addr":"172.21.15.179:6815/802983577","heartbeat_front_addr":"172.21.15.179:6813/802983577","state":["exists","up"]},{"osd":5,"uuid":"67db6d36-f684-4079-b0cd-82b4dd61461f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":518192887},{"type":"v1","addr":"172.21.15.179:6818","nonce":518192887}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":518192887},{"type":"v1","addr":"172.21.15.179:6822","nonce":518192887}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":518192887},{"type":"v1","addr":"172.21.15.179:6829","nonce":518192887}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6824","nonce":518192887},{"type":"v1","addr":"172.21.15.179:6826","nonce":518192887}]},"public_addr":"172.21.15.179:6818/518192887","cluster_addr":"172.21.15.179:6822/518192887","heartbeat_back_addr":"172.21.15.179:6829/518192887","heartbeat_front_addr":"172.21.15.179:6826/518192887","state":["exists","up"]},{"osd":6,"uuid":"12e670af-5a16-4c81-9f97-defa66cab967","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":815435378},{"type":"v1","addr":"172.21.15.179:6801","nonce":815435378}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":815435378},{"type":"v1","addr":"172.21.15.179:6803","nonce":815435378}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":815435378},{"type":"v1","addr":"172.21.15.179:6807","nonce":815435378}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":815435378},{"type":"v1","addr":"172.21.15.179:6805","nonce":815435378}]},"public_addr":"172.21.15.179:6801/815435378","cluster_addr":"172.21.15.179:6803/815435378","heartbeat_back_addr":"172.21.15.179:6807/815435378","heartbeat_front_addr":"172.21.15.179:6805/815435378","state":["exists","up"]},{"osd":7,"uuid":"fe630650-2eb3-49ad-8676-c341e6332eb1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6817","nonce":2848432339},{"type":"v1","addr":"172.21.15.179:6819","nonce":2848432339}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6821","nonce":2848432339},{"type":"v1","addr":"172.21.15.179:6823","nonce":2848432339}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":2848432339},{"type":"v1","addr":"172.21.15.179:6831","nonce":2848432339}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6825","nonce":2848432339},{"type":"v1","addr":"172.21.15.179:6827","nonce":2848432339}]},"public_addr":"172.21.15.179:6819/2848432339","cluster_addr":"172.21.15.179:6823/2848432339","heartbeat_back_addr":"172.21.15.179:6831/2848432339","heartbeat_front_addr":"172.21.15.179:6827/2848432339","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:58:49.255433+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:58:49.412880+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:58:49.559295+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:58:49.245237+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:58:49.184557+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:58:49.329851+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:58:49.366012+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:58:49.349604+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.78:6837/115607035":"2023-11-29T20:01:48.551494+0000","172.21.15.78:6836/115607035":"2023-11-29T20:01:48.551494+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-28T20:01:54.851 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:54.844+0000 7f405a172640 1 -- 172.21.15.78:0/2807951165 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f40400664a0 msgr2=0x7f4040068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:01:54.851 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:54.844+0000 7f405a172640 1 --2- 172.21.15.78:0/2807951165 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f40400664a0 0x7f4040068960 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f40540aba00 tx=0x7f4048009190 comp rx=0 tx=0).stop 2023-11-28T20:01:54.851 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:54.844+0000 7f405a172640 1 -- 172.21.15.78:0/2807951165 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f405406c020 msgr2=0x7f40540ab4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:01:54.851 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:54.844+0000 7f405a172640 1 --2- 172.21.15.78:0/2807951165 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f405406c020 0x7f40540ab4c0 secure :-1 s=READY pgs=830 cs=0 l=1 rev1=1 crypto rx=0x7f40440af040 tx=0x7f4044019270 comp rx=0 tx=0).stop 2023-11-28T20:01:54.852 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:54.844+0000 7f405a172640 1 -- 172.21.15.78:0/2807951165 shutdown_connections 2023-11-28T20:01:54.852 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:54.844+0000 7f405a172640 1 --2- 172.21.15.78:0/2807951165 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f40400664a0 0x7f4040068960 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:54.852 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:54.844+0000 7f405a172640 1 --2- 172.21.15.78:0/2807951165 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f40540c3b80 0x7f405414fe10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:54.852 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:54.844+0000 7f405a172640 1 --2- 172.21.15.78:0/2807951165 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f405406d2b0 0x7f40540a91e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:54.852 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:54.844+0000 7f405a172640 1 --2- 172.21.15.78:0/2807951165 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f405406c020 0x7f40540ab4c0 unknown :-1 s=CLOSED pgs=830 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:54.852 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:54.844+0000 7f405a172640 1 -- 172.21.15.78:0/2807951165 >> 172.21.15.78:0/2807951165 conn(0x7f40540a7810 msgr2=0x7f40540723f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:01:54.853 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:54.844+0000 7f405a172640 1 -- 172.21.15.78:0/2807951165 shutdown_connections 2023-11-28T20:01:54.853 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:54.844+0000 7f405a172640 1 -- 172.21.15.78:0/2807951165 wait complete. 2023-11-28T20:01:54.870 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs2 2023-11-28T20:01:55.010 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:55.004+0000 7f0109e79640 1 Processor -- start 2023-11-28T20:01:55.010 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:55.004+0000 7f0109e79640 1 -- start start 2023-11-28T20:01:55.012 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:55.004+0000 7f0109e79640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f01040a4f90 0x7f01040c59c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:55.012 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:55.004+0000 7f0109e79640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f01041524b0 con 0x7f0104072810 2023-11-28T20:01:55.012 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:55.004+0000 7f0109e79640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f01040c62f0 con 0x7f01040a5370 2023-11-28T20:01:55.012 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:55.004+0000 7f0109e79640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0104152770 con 0x7f01040a4f90 2023-11-28T20:01:55.012 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:55.008+0000 7f0103fff640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f0104072810 0x7f01040c0800 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:53108/0 (socket says 172.21.15.78:53108) 2023-11-28T20:01:55.012 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:55.008+0000 7f0103fff640 1 -- 172.21.15.78:0/2939170979 learned_addr learned my addr 172.21.15.78:0/2939170979 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-11-28T20:01:55.012 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:55.008+0000 7f01037fe640 1 --2- 172.21.15.78:0/2939170979 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f01040a4f90 0x7f01040c59c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:55.012 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:55.008+0000 7f01027fc640 1 -- 172.21.15.78:0/2939170979 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 643879865 0 0) 0x7f01041524b0 con 0x7f0104072810 2023-11-28T20:01:55.013 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:55.008+0000 7f01027fc640 1 -- 172.21.15.78:0/2939170979 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f00ec003530 con 0x7f0104072810 2023-11-28T20:01:55.013 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:55.008+0000 7f01027fc640 1 -- 172.21.15.78:0/2939170979 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1580626940 0 0) 0x7f01040c62f0 con 0x7f01040a5370 2023-11-28T20:01:55.013 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:55.008+0000 7f01027fc640 1 -- 172.21.15.78:0/2939170979 --> v1:172.21.15.179:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f01041524b0 con 0x7f01040a5370 2023-11-28T20:01:55.013 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:55.008+0000 7f01037fe640 1 -- 172.21.15.78:0/2939170979 >> v1:172.21.15.179:6789/0 conn(0x7f01040a5370 legacy=0x7f010414f870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:01:55.013 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:55.008+0000 7f01037fe640 1 -- 172.21.15.78:0/2939170979 >> v1:172.21.15.78:6789/0 conn(0x7f0104072810 legacy=0x7f01040c0800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:01:55.013 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:55.008+0000 7f01027fc640 1 -- 172.21.15.78:0/2939170979 <== mon.0 v1:172.21.15.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4076078652 0 0) 0x7f00ec003530 con 0x7f0104072810 2023-11-28T20:01:55.013 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:55.008+0000 7f01037fe640 1 -- 172.21.15.78:0/2939170979 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0104152a50 con 0x7f01040a4f90 2023-11-28T20:01:55.016 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:55.008+0000 7f01037fe640 1 --2- 172.21.15.78:0/2939170979 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f01040a4f90 0x7f01040c59c0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f01041526a0 tx=0x7f00f401c330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6a07788f78dbfcfc server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:01:55.016 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:55.012+0000 7f01027fc640 1 -- 172.21.15.78:0/2939170979 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00fc001a00 con 0x7f01040a4f90 2023-11-28T20:01:55.017 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:55.012+0000 7f01027fc640 1 -- 172.21.15.78:0/2939170979 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f00f40a7050 con 0x7f01040a4f90 2023-11-28T20:01:55.017 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:55.012+0000 7f01027fc640 1 -- 172.21.15.78:0/2939170979 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00f40ab620 con 0x7f01040a4f90 2023-11-28T20:01:55.017 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:55.012+0000 7f0109e79640 1 -- 172.21.15.78:0/2939170979 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f01040a4f90 msgr2=0x7f01040c59c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:01:55.017 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:55.012+0000 7f0109e79640 1 --2- 172.21.15.78:0/2939170979 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f01040a4f90 0x7f01040c59c0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f01041526a0 tx=0x7f00f401c330 comp rx=0 tx=0).stop 2023-11-28T20:01:55.017 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:55.012+0000 7f0109e79640 1 -- 172.21.15.78:0/2939170979 shutdown_connections 2023-11-28T20:01:55.017 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:55.012+0000 7f0109e79640 1 --2- 172.21.15.78:0/2939170979 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f01040a4f90 0x7f01040c59c0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:55.018 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:55.012+0000 7f0109e79640 1 -- 172.21.15.78:0/2939170979 >> 172.21.15.78:0/2939170979 conn(0x7f010406b220 msgr2=0x7f01040a77e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:01:55.018 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:55.012+0000 7f0109e79640 1 -- 172.21.15.78:0/2939170979 shutdown_connections 2023-11-28T20:01:55.018 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:55.012+0000 7f0109e79640 1 -- 172.21.15.78:0/2939170979 wait complete. 2023-11-28T20:01:55.023 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:55.012+0000 7f0109e79640 1 Processor -- start 2023-11-28T20:01:55.023 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:55.012+0000 7f0109e79640 1 -- start start 2023-11-28T20:01:55.023 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:55.012+0000 7f0109e79640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0104072810 0x7f01040bf0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:55.023 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:55.012+0000 7f0109e79640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f01040a4f90 0x7f01041ecd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:55.024 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:55.012+0000 7f0109e79640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f01040a5370 0x7f01041ed270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:55.024 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:55.012+0000 7f0109e79640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01041576d0 con 0x7f01040a5370 2023-11-28T20:01:55.024 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:55.012+0000 7f0109e79640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0104156000 con 0x7f01040a4f90 2023-11-28T20:01:55.024 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:55.012+0000 7f0109e79640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f01040a8d60 con 0x7f0104072810 2023-11-28T20:01:55.024 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:55.012+0000 7f0103fff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f01040a5370 0x7f01041ed270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:55.024 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:55.012+0000 7f0103fff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f01040a5370 0x7f01041ed270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:60528/0 (socket says 172.21.15.78:60528) 2023-11-28T20:01:55.024 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:55.012+0000 7f0103fff640 1 -- 172.21.15.78:0/1087319017 learned_addr learned my addr 172.21.15.78:0/1087319017 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T20:01:55.025 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:55.012+0000 7f01037fe640 1 --2- 172.21.15.78:0/1087319017 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0104072810 0x7f01040bf0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:55.025 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:55.012+0000 7f0102ffd640 1 --2- 172.21.15.78:0/1087319017 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f01040a4f90 0x7f01041ecd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:55.025 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:55.016+0000 7f0103fff640 1 -- 172.21.15.78:0/1087319017 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0104072810 msgr2=0x7f01040bf0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:01:55.025 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:55.016+0000 7f0103fff640 1 --2- 172.21.15.78:0/1087319017 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0104072810 0x7f01040bf0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:55.025 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:55.016+0000 7f0103fff640 1 -- 172.21.15.78:0/1087319017 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f01040a4f90 msgr2=0x7f01041ecd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:01:55.025 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:55.016+0000 7f0103fff640 1 --2- 172.21.15.78:0/1087319017 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f01040a4f90 0x7f01041ecd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:55.025 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:55.016+0000 7f0103fff640 1 -- 172.21.15.78:0/1087319017 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00f4009420 con 0x7f01040a5370 2023-11-28T20:01:55.025 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:55.016+0000 7f0103fff640 1 --2- 172.21.15.78:0/1087319017 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f01040a5370 0x7f01041ed270 secure :-1 s=READY pgs=832 cs=0 l=1 rev1=1 crypto rx=0x7f00fc00cc60 tx=0x7f00fc00a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:01:55.026 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:55.016+0000 7f00ebfff640 1 -- 172.21.15.78:0/1087319017 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00fc00ce70 con 0x7f01040a5370 2023-11-28T20:01:55.026 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:55.016+0000 7f00ebfff640 1 -- 172.21.15.78:0/1087319017 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f00fc012400 con 0x7f01040a5370 2023-11-28T20:01:55.026 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:55.016+0000 7f0109e79640 1 -- 172.21.15.78:0/1087319017 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f01041f0cb0 con 0x7f01040a5370 2023-11-28T20:01:55.026 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:55.016+0000 7f00ebfff640 1 -- 172.21.15.78:0/1087319017 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00fc0127b0 con 0x7f01040a5370 2023-11-28T20:01:55.026 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:55.016+0000 7f0109e79640 1 -- 172.21.15.78:0/1087319017 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f01040a9020 con 0x7f01040a5370 2023-11-28T20:01:55.026 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:55.016+0000 7f0109e79640 1 -- 172.21.15.78:0/1087319017 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0104156170 con 0x7f01040a5370 2023-11-28T20:01:55.026 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:55.016+0000 7f00ebfff640 1 -- 172.21.15.78:0/1087319017 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f00fc012910 con 0x7f01040a5370 2023-11-28T20:01:55.027 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:55.016+0000 7f00ebfff640 1 --2- 172.21.15.78:0/1087319017 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f00f0066470 0x7f00f0068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:55.027 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:55.016+0000 7f00ebfff640 1 -- 172.21.15.78:0/1087319017 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 6119+0+0 (secure 0 0 0) 0x7f00fc084670 con 0x7f01040a5370 2023-11-28T20:01:55.027 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:55.016+0000 7f01037fe640 1 --2- 172.21.15.78:0/1087319017 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f00f0066470 0x7f00f0068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:55.028 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:55.020+0000 7f01037fe640 1 --2- 172.21.15.78:0/1087319017 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f00f0066470 0x7f00f0068930 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f00f40ad000 tx=0x7f00f40a6000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:01:55.028 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:55.020+0000 7f00ebfff640 1 -- 172.21.15.78:0/1087319017 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f0104156170 con 0x7f01040a5370 2023-11-28T20:01:55.209 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:55.204+0000 7f0109e79640 1 -- 172.21.15.78:0/1087319017 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs2"} v 0) v1 -- 0x7f0104156170 con 0x7f01040a5370 2023-11-28T20:01:55.209 INFO:tasks.ceph.mon.a.smithi078.stderr:2023-11-28T20:01:55.204+0000 7f3f494a3640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-11-28T20:01:55.213 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:55.208+0000 7f00ebfff640 1 -- 172.21.15.78:0/1087319017 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs2"}]=0 cephfs2 marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v39) v1 ==== 163+0+0 (secure 0 0 0) 0x7f0104156170 con 0x7f01040a5370 2023-11-28T20:01:55.213 INFO:teuthology.orchestra.run.smithi078.stderr:cephfs2 marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-11-28T20:01:55.216 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:55.212+0000 7f0109e79640 1 -- 172.21.15.78:0/1087319017 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f00f0066470 msgr2=0x7f00f0068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:01:55.216 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:55.212+0000 7f0109e79640 1 --2- 172.21.15.78:0/1087319017 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f00f0066470 0x7f00f0068930 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f00f40ad000 tx=0x7f00f40a6000 comp rx=0 tx=0).stop 2023-11-28T20:01:55.216 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:55.212+0000 7f0109e79640 1 -- 172.21.15.78:0/1087319017 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f01040a5370 msgr2=0x7f01041ed270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:01:55.216 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:55.212+0000 7f0109e79640 1 --2- 172.21.15.78:0/1087319017 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f01040a5370 0x7f01041ed270 secure :-1 s=READY pgs=832 cs=0 l=1 rev1=1 crypto rx=0x7f00fc00cc60 tx=0x7f00fc00a430 comp rx=0 tx=0).stop 2023-11-28T20:01:55.216 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:55.212+0000 7f0109e79640 1 -- 172.21.15.78:0/1087319017 shutdown_connections 2023-11-28T20:01:55.216 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:55.212+0000 7f0109e79640 1 --2- 172.21.15.78:0/1087319017 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f00f0066470 0x7f00f0068930 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:55.216 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:55.212+0000 7f0109e79640 1 --2- 172.21.15.78:0/1087319017 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f01040a5370 0x7f01041ed270 unknown :-1 s=CLOSED pgs=832 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:55.216 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:55.212+0000 7f0109e79640 1 --2- 172.21.15.78:0/1087319017 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f01040a4f90 0x7f01041ecd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:55.217 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:55.212+0000 7f0109e79640 1 --2- 172.21.15.78:0/1087319017 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0104072810 0x7f01040bf0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:55.217 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:55.212+0000 7f0109e79640 1 -- 172.21.15.78:0/1087319017 >> 172.21.15.78:0/1087319017 conn(0x7f010406b220 msgr2=0x7f01040a77c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:01:55.217 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:55.212+0000 7f0109e79640 1 -- 172.21.15.78:0/1087319017 shutdown_connections 2023-11-28T20:01:55.217 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:55.212+0000 7f0109e79640 1 -- 172.21.15.78:0/1087319017 wait complete. 2023-11-28T20:01:55.222 INFO:tasks.ceph.mds.c.smithi078.stderr: -2156> 2023-11-28T20:01:25.473+0000 7f23f8d0e640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-11-28T20:01:55.237 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs2 --yes-i-really-mean-it 2023-11-28T20:01:55.268 INFO:tasks.ceph.mds.c.smithi078.stdout:starting mds.c at 2023-11-28T20:01:55.378 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:55.372+0000 7f92e56fe640 1 Processor -- start 2023-11-28T20:01:55.378 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:55.372+0000 7f92e56fe640 1 -- start start 2023-11-28T20:01:55.380 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:55.376+0000 7f92e56fe640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f92e00af550 0x7f92e0154f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:55.380 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:55.376+0000 7f92e56fe640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f92e00c4710 0x7f92e00c4bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:55.380 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:55.376+0000 7f92e56fe640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f92e00c67a0 con 0x7f92e0158050 2023-11-28T20:01:55.380 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:55.376+0000 7f92e56fe640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f92e00af930 con 0x7f92e00af550 2023-11-28T20:01:55.380 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:55.376+0000 7f92e56fe640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f92e00c69f0 con 0x7f92e00c4710 2023-11-28T20:01:55.380 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:55.376+0000 7f92deffd640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f92e00af550 0x7f92e0154f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:55.380 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:55.376+0000 7f92d67fc640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f92e00c4710 0x7f92e00c4bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:55.380 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:55.376+0000 7f92deffd640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f92e00af550 0x7f92e0154f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.78:42366/0 (socket says 172.21.15.78:42366) 2023-11-28T20:01:55.380 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:55.376+0000 7f92deffd640 1 -- 172.21.15.78:0/3454700604 learned_addr learned my addr 172.21.15.78:0/3454700604 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T20:01:55.381 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:55.376+0000 7f92deffd640 1 -- 172.21.15.78:0/3454700604 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f92e00c4710 msgr2=0x7f92e00c4bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:01:55.381 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:55.376+0000 7f92deffd640 1 --2- 172.21.15.78:0/3454700604 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f92e00c4710 0x7f92e00c4bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:55.381 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:55.376+0000 7f92deffd640 1 -- 172.21.15.78:0/3454700604 >> v1:172.21.15.179:6789/0 conn(0x7f92e0158050 legacy=0x7f92e006b2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:01:55.381 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:55.376+0000 7f92deffd640 1 -- 172.21.15.78:0/3454700604 --> v2:172.21.15.179:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92e00c6cd0 con 0x7f92e00af550 2023-11-28T20:01:55.383 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:55.380+0000 7f92deffd640 1 --2- 172.21.15.78:0/3454700604 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f92e00af550 0x7f92e0154f20 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f92d0009870 tx=0x7f92d001c420 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b82cd6072e7e7ec7 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:01:55.383 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:55.380+0000 7f92de7fc640 1 -- 172.21.15.78:0/3454700604 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92d00ab600 con 0x7f92e00af550 2023-11-28T20:01:55.384 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:55.380+0000 7f92de7fc640 1 -- 172.21.15.78:0/3454700604 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f92d00a7050 con 0x7f92e00af550 2023-11-28T20:01:55.384 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:55.380+0000 7f92de7fc640 1 -- 172.21.15.78:0/3454700604 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92d00ab980 con 0x7f92e00af550 2023-11-28T20:01:55.384 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:55.380+0000 7f92e56fe640 1 -- 172.21.15.78:0/3454700604 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f92e00af550 msgr2=0x7f92e0154f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:01:55.385 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:55.380+0000 7f92e56fe640 1 --2- 172.21.15.78:0/3454700604 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f92e00af550 0x7f92e0154f20 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f92d0009870 tx=0x7f92d001c420 comp rx=0 tx=0).stop 2023-11-28T20:01:55.385 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:55.380+0000 7f92e56fe640 1 -- 172.21.15.78:0/3454700604 shutdown_connections 2023-11-28T20:01:55.385 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:55.380+0000 7f92e56fe640 1 --2- 172.21.15.78:0/3454700604 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f92e00c4710 0x7f92e00c4bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:55.385 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:55.380+0000 7f92e56fe640 1 --2- 172.21.15.78:0/3454700604 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f92e00af550 0x7f92e0154f20 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:55.385 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:55.380+0000 7f92e56fe640 1 -- 172.21.15.78:0/3454700604 >> 172.21.15.78:0/3454700604 conn(0x7f92e00668d0 msgr2=0x7f92e00ab980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:01:55.385 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:55.380+0000 7f92e56fe640 1 -- 172.21.15.78:0/3454700604 shutdown_connections 2023-11-28T20:01:55.385 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:55.380+0000 7f92e56fe640 1 -- 172.21.15.78:0/3454700604 wait complete. 2023-11-28T20:01:55.386 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:55.380+0000 7f92e56fe640 1 Processor -- start 2023-11-28T20:01:55.386 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:55.380+0000 7f92e56fe640 1 -- start start 2023-11-28T20:01:55.388 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:55.380+0000 7f92e56fe640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f92e00af550 0x7f92e0148b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:55.388 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:55.380+0000 7f92e56fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f92e00c4710 0x7f92e00c2030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:55.389 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:55.380+0000 7f92e56fe640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f92e0158050 0x7f92e00c2570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:55.389 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:55.380+0000 7f92e56fe640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92e00c1640 con 0x7f92e00c4710 2023-11-28T20:01:55.389 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:55.380+0000 7f92e56fe640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92e01ecd60 con 0x7f92e00af550 2023-11-28T20:01:55.389 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:55.380+0000 7f92e56fe640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f92e01525f0 con 0x7f92e0158050 2023-11-28T20:01:55.389 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:55.384+0000 7f92d67fc640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f92e00c4710 0x7f92e00c2030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:55.389 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:55.384+0000 7f92d67fc640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f92e00c4710 0x7f92e00c2030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:43938/0 (socket says 172.21.15.78:43938) 2023-11-28T20:01:55.389 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:55.384+0000 7f92d67fc640 1 -- 172.21.15.78:0/3615414657 learned_addr learned my addr 172.21.15.78:0/3615414657 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T20:01:55.389 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:55.384+0000 7f92deffd640 1 --2- 172.21.15.78:0/3615414657 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f92e00af550 0x7f92e0148b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:55.389 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:55.384+0000 7f92df7fe640 1 --2- 172.21.15.78:0/3615414657 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f92e0158050 0x7f92e00c2570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:55.389 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:55.384+0000 7f92d67fc640 1 -- 172.21.15.78:0/3615414657 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f92e0158050 msgr2=0x7f92e00c2570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:01:55.389 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:55.384+0000 7f92d67fc640 1 --2- 172.21.15.78:0/3615414657 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f92e0158050 0x7f92e00c2570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:55.389 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:55.384+0000 7f92d67fc640 1 -- 172.21.15.78:0/3615414657 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f92e00af550 msgr2=0x7f92e0148b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:01:55.390 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:55.384+0000 7f92d67fc640 1 --2- 172.21.15.78:0/3615414657 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f92e00af550 0x7f92e0148b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:55.390 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:55.384+0000 7f92d67fc640 1 -- 172.21.15.78:0/3615414657 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92d00094d0 con 0x7f92e00c4710 2023-11-28T20:01:55.390 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:55.384+0000 7f92deffd640 1 --2- 172.21.15.78:0/3615414657 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f92e00af550 0x7f92e0148b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T20:01:55.390 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:55.384+0000 7f92d67fc640 1 --2- 172.21.15.78:0/3615414657 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f92e00c4710 0x7f92e00c2030 secure :-1 s=READY pgs=836 cs=0 l=1 rev1=1 crypto rx=0x7f92c800efc0 tx=0x7f92c800c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:01:55.390 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:55.384+0000 7f92d7fff640 1 -- 172.21.15.78:0/3615414657 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92c8014480 con 0x7f92e00c4710 2023-11-28T20:01:55.390 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:55.384+0000 7f92d7fff640 1 -- 172.21.15.78:0/3615414657 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f92c800f040 con 0x7f92e00c4710 2023-11-28T20:01:55.390 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:55.384+0000 7f92d7fff640 1 -- 172.21.15.78:0/3615414657 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92c8014800 con 0x7f92e00c4710 2023-11-28T20:01:55.391 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:55.384+0000 7f92e56fe640 1 -- 172.21.15.78:0/3615414657 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f92e00c1ba0 con 0x7f92e00c4710 2023-11-28T20:01:55.391 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:55.384+0000 7f92e56fe640 1 -- 172.21.15.78:0/3615414657 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f92e01ecf60 con 0x7f92e00c4710 2023-11-28T20:01:55.392 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:55.384+0000 7f92e56fe640 1 -- 172.21.15.78:0/3615414657 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f92e01ed180 con 0x7f92e00c4710 2023-11-28T20:01:55.392 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:55.384+0000 7f92d7fff640 1 -- 172.21.15.78:0/3615414657 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f92c8014960 con 0x7f92e00c4710 2023-11-28T20:01:55.392 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:55.388+0000 7f92d7fff640 1 --2- 172.21.15.78:0/3615414657 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f92c0066470 0x7f92c0068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:55.392 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:55.388+0000 7f92d7fff640 1 -- 172.21.15.78:0/3615414657 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(70..70 src has 1..70) v4 ==== 6205+0+0 (secure 0 0 0) 0x7f92c8084cd0 con 0x7f92e00c4710 2023-11-28T20:01:55.392 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:55.388+0000 7f92deffd640 1 --2- 172.21.15.78:0/3615414657 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f92c0066470 0x7f92c0068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:55.392 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:55.388+0000 7f92deffd640 1 --2- 172.21.15.78:0/3615414657 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f92c0066470 0x7f92c0068930 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f92d00ad000 tx=0x7f92d00a6000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:01:55.395 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:55.392+0000 7f92d7fff640 1 -- 172.21.15.78:0/3615414657 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f92c8051f60 con 0x7f92e00c4710 2023-11-28T20:01:55.575 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:55.572+0000 7f92e56fe640 1 -- 172.21.15.78:0/3615414657 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs2", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f92e0067630 con 0x7f92e00c4710 2023-11-28T20:01:56.217 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:56.212+0000 7f92d7fff640 1 -- 172.21.15.78:0/3615414657 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs2", "yes_i_really_mean_it": true}]=0 v40) v1 ==== 105+0+0 (secure 0 0 0) 0x7f92c8055580 con 0x7f92e00c4710 2023-11-28T20:01:56.219 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:56.212+0000 7f92e56fe640 1 -- 172.21.15.78:0/3615414657 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f92c0066470 msgr2=0x7f92c0068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:01:56.219 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:56.212+0000 7f92e56fe640 1 --2- 172.21.15.78:0/3615414657 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f92c0066470 0x7f92c0068930 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f92d00ad000 tx=0x7f92d00a6000 comp rx=0 tx=0).stop 2023-11-28T20:01:56.220 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:56.212+0000 7f92e56fe640 1 -- 172.21.15.78:0/3615414657 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f92e00c4710 msgr2=0x7f92e00c2030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:01:56.220 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:56.212+0000 7f92e56fe640 1 --2- 172.21.15.78:0/3615414657 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f92e00c4710 0x7f92e00c2030 secure :-1 s=READY pgs=836 cs=0 l=1 rev1=1 crypto rx=0x7f92c800efc0 tx=0x7f92c800c490 comp rx=0 tx=0).stop 2023-11-28T20:01:56.220 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:56.216+0000 7f92e56fe640 1 -- 172.21.15.78:0/3615414657 shutdown_connections 2023-11-28T20:01:56.220 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:56.216+0000 7f92e56fe640 1 --2- 172.21.15.78:0/3615414657 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f92c0066470 0x7f92c0068930 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:56.220 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:56.216+0000 7f92e56fe640 1 --2- 172.21.15.78:0/3615414657 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f92e0158050 0x7f92e00c2570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:56.220 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:56.216+0000 7f92e56fe640 1 --2- 172.21.15.78:0/3615414657 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f92e00c4710 0x7f92e00c2030 unknown :-1 s=CLOSED pgs=836 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:56.220 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:56.216+0000 7f92e56fe640 1 --2- 172.21.15.78:0/3615414657 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f92e00af550 0x7f92e0148b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:56.220 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:56.216+0000 7f92e56fe640 1 -- 172.21.15.78:0/3615414657 >> 172.21.15.78:0/3615414657 conn(0x7f92e00668d0 msgr2=0x7f92e00ae080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:01:56.220 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:56.216+0000 7f92e56fe640 1 -- 172.21.15.78:0/3615414657 shutdown_connections 2023-11-28T20:01:56.220 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:56.216+0000 7f92e56fe640 1 -- 172.21.15.78:0/3615414657 wait complete. 2023-11-28T20:01:56.241 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs2_metadata cephfs2_metadata --yes-i-really-really-mean-it 2023-11-28T20:01:56.425 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:56.420+0000 7f8b052aa640 1 Processor -- start 2023-11-28T20:01:56.425 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:56.420+0000 7f8b052aa640 1 -- start start 2023-11-28T20:01:56.427 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:56.420+0000 7f8b052aa640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f8b000bf2d0 0x7f8b00151970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:56.427 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:56.420+0000 7f8b052aa640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f8b000c98f0 0x7f8b00151eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:56.428 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:56.420+0000 7f8b052aa640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8b00158780 con 0x7f8b000c6030 2023-11-28T20:01:56.428 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:56.420+0000 7f8b052aa640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8b000c0300 con 0x7f8b000c98f0 2023-11-28T20:01:56.428 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:56.420+0000 7f8b052aa640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8b00157b70 con 0x7f8b000bf2d0 2023-11-28T20:01:56.428 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:56.420+0000 7f8aff7fe640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f8b000c98f0 0x7f8b00151eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:56.428 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:56.420+0000 7f8aff7fe640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f8b000c98f0 0x7f8b00151eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:43942/0 (socket says 172.21.15.78:43942) 2023-11-28T20:01:56.428 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:56.420+0000 7f8aff7fe640 1 -- 172.21.15.78:0/435465953 learned_addr learned my addr 172.21.15.78:0/435465953 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T20:01:56.428 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:56.420+0000 7f8afeffd640 1 --2- 172.21.15.78:0/435465953 >> v2:172.21.15.179:3300/0 conn(0x7f8b000bf2d0 0x7f8b00151970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:56.428 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:56.420+0000 7f8aff7fe640 1 -- 172.21.15.78:0/435465953 >> v2:172.21.15.179:3300/0 conn(0x7f8b000bf2d0 msgr2=0x7f8b00151970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:01:56.428 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:56.420+0000 7f8aff7fe640 1 --2- 172.21.15.78:0/435465953 >> v2:172.21.15.179:3300/0 conn(0x7f8b000bf2d0 0x7f8b00151970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:56.428 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:56.420+0000 7f8aff7fe640 1 -- 172.21.15.78:0/435465953 >> v1:172.21.15.179:6789/0 conn(0x7f8b000c6030 legacy=0x7f8b000c7cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:01:56.428 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:56.420+0000 7f8aff7fe640 1 -- 172.21.15.78:0/435465953 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b00157e50 con 0x7f8b000c98f0 2023-11-28T20:01:56.429 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:56.424+0000 7f8aff7fe640 1 --2- 172.21.15.78:0/435465953 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8b000c98f0 0x7f8b00151eb0 secure :-1 s=READY pgs=837 cs=0 l=1 rev1=1 crypto rx=0x7f8b0008afd0 tx=0x7f8af801c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e06123b3915ce4ae server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:01:56.429 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:56.424+0000 7f8afe7fc640 1 -- 172.21.15.78:0/435465953 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8af80aa430 con 0x7f8b000c98f0 2023-11-28T20:01:56.429 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:56.424+0000 7f8afe7fc640 1 -- 172.21.15.78:0/435465953 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8af80aa590 con 0x7f8b000c98f0 2023-11-28T20:01:56.430 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:56.424+0000 7f8afe7fc640 1 -- 172.21.15.78:0/435465953 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8af80aa920 con 0x7f8b000c98f0 2023-11-28T20:01:56.430 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:56.424+0000 7f8b052aa640 1 -- 172.21.15.78:0/435465953 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8b000c98f0 msgr2=0x7f8b00151eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:01:56.430 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:56.424+0000 7f8b052aa640 1 --2- 172.21.15.78:0/435465953 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8b000c98f0 0x7f8b00151eb0 secure :-1 s=READY pgs=837 cs=0 l=1 rev1=1 crypto rx=0x7f8b0008afd0 tx=0x7f8af801c4d0 comp rx=0 tx=0).stop 2023-11-28T20:01:56.431 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:56.424+0000 7f8b052aa640 1 -- 172.21.15.78:0/435465953 shutdown_connections 2023-11-28T20:01:56.431 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:56.424+0000 7f8b052aa640 1 --2- 172.21.15.78:0/435465953 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8b000c98f0 0x7f8b00151eb0 unknown :-1 s=CLOSED pgs=837 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:56.431 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:56.424+0000 7f8b052aa640 1 --2- 172.21.15.78:0/435465953 >> v2:172.21.15.179:3300/0 conn(0x7f8b000bf2d0 0x7f8b00151970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:56.431 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:56.424+0000 7f8b052aa640 1 -- 172.21.15.78:0/435465953 >> 172.21.15.78:0/435465953 conn(0x7f8b000c9dc0 msgr2=0x7f8b000ca1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:01:56.431 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:56.424+0000 7f8b052aa640 1 -- 172.21.15.78:0/435465953 shutdown_connections 2023-11-28T20:01:56.431 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:56.424+0000 7f8b052aa640 1 -- 172.21.15.78:0/435465953 wait complete. 2023-11-28T20:01:56.431 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:56.428+0000 7f8b052aa640 1 Processor -- start 2023-11-28T20:01:56.432 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:56.428+0000 7f8b052aa640 1 -- start start 2023-11-28T20:01:56.434 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:56.428+0000 7f8b052aa640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8b000bf2d0 0x7f8b001519a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:56.434 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:56.428+0000 7f8b052aa640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8b000c6030 0x7f8b001ee0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:56.435 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:56.428+0000 7f8b052aa640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8b000c98f0 0x7f8b001ee620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:56.435 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:56.428+0000 7f8b052aa640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b0006c2c0 con 0x7f8b000c6030 2023-11-28T20:01:56.435 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:56.428+0000 7f8b052aa640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b001eeb60 con 0x7f8b000bf2d0 2023-11-28T20:01:56.435 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:56.428+0000 7f8b052aa640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b0006c750 con 0x7f8b000c98f0 2023-11-28T20:01:56.435 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:56.428+0000 7f8af67fc640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8b000c6030 0x7f8b001ee0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:56.435 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:56.428+0000 7f8af67fc640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8b000c6030 0x7f8b001ee0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:43948/0 (socket says 172.21.15.78:43948) 2023-11-28T20:01:56.435 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:56.428+0000 7f8af67fc640 1 -- 172.21.15.78:0/1929864128 learned_addr learned my addr 172.21.15.78:0/1929864128 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T20:01:56.435 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:56.428+0000 7f8afeffd640 1 --2- 172.21.15.78:0/1929864128 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8b000bf2d0 0x7f8b001519a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:56.435 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:56.428+0000 7f8aff7fe640 1 --2- 172.21.15.78:0/1929864128 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8b000c98f0 0x7f8b001ee620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:56.436 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:56.428+0000 7f8af67fc640 1 -- 172.21.15.78:0/1929864128 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8b000c98f0 msgr2=0x7f8b001ee620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:01:56.436 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:56.428+0000 7f8af67fc640 1 --2- 172.21.15.78:0/1929864128 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8b000c98f0 0x7f8b001ee620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:56.436 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:56.428+0000 7f8af67fc640 1 -- 172.21.15.78:0/1929864128 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8b000bf2d0 msgr2=0x7f8b001519a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:01:56.436 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:56.428+0000 7f8af67fc640 1 --2- 172.21.15.78:0/1929864128 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8b000bf2d0 0x7f8b001519a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:56.436 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:56.428+0000 7f8af67fc640 1 -- 172.21.15.78:0/1929864128 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8af80094d0 con 0x7f8b000c6030 2023-11-28T20:01:56.436 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:56.428+0000 7f8af67fc640 1 --2- 172.21.15.78:0/1929864128 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8b000c6030 0x7f8b001ee0e0 secure :-1 s=READY pgs=838 cs=0 l=1 rev1=1 crypto rx=0x7f8ae800c7f0 tx=0x7f8ae800ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:01:56.437 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:56.428+0000 7f8af7fff640 1 -- 172.21.15.78:0/1929864128 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ae8003b80 con 0x7f8b000c6030 2023-11-28T20:01:56.437 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:56.428+0000 7f8af7fff640 1 -- 172.21.15.78:0/1929864128 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ae8003ce0 con 0x7f8b000c6030 2023-11-28T20:01:56.437 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:56.428+0000 7f8af7fff640 1 -- 172.21.15.78:0/1929864128 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ae800aa90 con 0x7f8b000c6030 2023-11-28T20:01:56.437 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:56.428+0000 7f8b052aa640 1 -- 172.21.15.78:0/1929864128 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8b0006b990 con 0x7f8b000c6030 2023-11-28T20:01:56.437 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:56.428+0000 7f8b052aa640 1 -- 172.21.15.78:0/1929864128 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8b0006bf50 con 0x7f8b000c6030 2023-11-28T20:01:56.438 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:56.432+0000 7f8b052aa640 1 -- 172.21.15.78:0/1929864128 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8b0006c470 con 0x7f8b000c6030 2023-11-28T20:01:56.438 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:56.432+0000 7f8af7fff640 1 -- 172.21.15.78:0/1929864128 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f8ae800abf0 con 0x7f8b000c6030 2023-11-28T20:01:56.438 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:56.432+0000 7f8af7fff640 1 --2- 172.21.15.78:0/1929864128 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f8ae00664a0 0x7f8ae0068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:56.438 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:56.432+0000 7f8af7fff640 1 -- 172.21.15.78:0/1929864128 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(70..70 src has 1..70) v4 ==== 6205+0+0 (secure 0 0 0) 0x7f8ae8083ee0 con 0x7f8b000c6030 2023-11-28T20:01:56.438 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:56.432+0000 7f8afeffd640 1 --2- 172.21.15.78:0/1929864128 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f8ae00664a0 0x7f8ae0068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:56.439 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:56.432+0000 7f8afeffd640 1 --2- 172.21.15.78:0/1929864128 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f8ae00664a0 0x7f8ae0068960 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f8af0006aa0 tx=0x7f8af0008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:01:56.441 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:56.436+0000 7f8af7fff640 1 -- 172.21.15.78:0/1929864128 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f8b0006c470 con 0x7f8b000c6030 2023-11-28T20:01:56.594 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:56.588+0000 7f8b052aa640 1 -- 172.21.15.78:0/1929864128 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs2_metadata", "pool2": "cephfs2_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f8b00067630 con 0x7f8b000c6030 2023-11-28T20:01:57.221 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:57.216+0000 7f8af7fff640 1 -- 172.21.15.78:0/1929864128 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs2_metadata", "pool2": "cephfs2_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs2_metadata' removed v71) v1 ==== 184+0+0 (secure 0 0 0) 0x7f8ae8051160 con 0x7f8b000c6030 2023-11-28T20:01:57.221 INFO:teuthology.orchestra.run.smithi078.stderr:pool 'cephfs2_metadata' removed 2023-11-28T20:01:57.223 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:57.216+0000 7f8b052aa640 1 -- 172.21.15.78:0/1929864128 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f8ae00664a0 msgr2=0x7f8ae0068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:01:57.223 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:57.216+0000 7f8b052aa640 1 --2- 172.21.15.78:0/1929864128 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f8ae00664a0 0x7f8ae0068960 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f8af0006aa0 tx=0x7f8af0008040 comp rx=0 tx=0).stop 2023-11-28T20:01:57.223 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:57.216+0000 7f8b052aa640 1 -- 172.21.15.78:0/1929864128 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8b000c6030 msgr2=0x7f8b001ee0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:01:57.224 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:57.216+0000 7f8b052aa640 1 --2- 172.21.15.78:0/1929864128 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8b000c6030 0x7f8b001ee0e0 secure :-1 s=READY pgs=838 cs=0 l=1 rev1=1 crypto rx=0x7f8ae800c7f0 tx=0x7f8ae800ccb0 comp rx=0 tx=0).stop 2023-11-28T20:01:57.224 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:57.220+0000 7f8b052aa640 1 -- 172.21.15.78:0/1929864128 shutdown_connections 2023-11-28T20:01:57.224 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:57.220+0000 7f8b052aa640 1 --2- 172.21.15.78:0/1929864128 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f8ae00664a0 0x7f8ae0068960 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:57.224 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:57.220+0000 7f8b052aa640 1 --2- 172.21.15.78:0/1929864128 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8b000c98f0 0x7f8b001ee620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:57.224 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:57.220+0000 7f8b052aa640 1 --2- 172.21.15.78:0/1929864128 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8b000c6030 0x7f8b001ee0e0 unknown :-1 s=CLOSED pgs=838 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:57.224 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:57.220+0000 7f8b052aa640 1 --2- 172.21.15.78:0/1929864128 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8b000bf2d0 0x7f8b001519a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:57.224 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:57.220+0000 7f8b052aa640 1 -- 172.21.15.78:0/1929864128 >> 172.21.15.78:0/1929864128 conn(0x7f8b000c9dc0 msgr2=0x7f8b000aa0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:01:57.224 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:57.220+0000 7f8b052aa640 1 -- 172.21.15.78:0/1929864128 shutdown_connections 2023-11-28T20:01:57.224 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:57.220+0000 7f8b052aa640 1 -- 172.21.15.78:0/1929864128 wait complete. 2023-11-28T20:01:57.249 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs2_data cephfs2_data --yes-i-really-really-mean-it 2023-11-28T20:01:57.398 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:57.392+0000 7fa011009640 1 Processor -- start 2023-11-28T20:01:57.398 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:57.392+0000 7fa011009640 1 -- start start 2023-11-28T20:01:57.399 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:57.396+0000 7fa011009640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fa00c159c40 0x7fa00c15c030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:57.400 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:57.396+0000 7fa011009640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa00c0a4e20 con 0x7fa00c14b1e0 2023-11-28T20:01:57.400 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:57.396+0000 7fa011009640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa00c0a50e0 con 0x7fa00c0c5300 2023-11-28T20:01:57.400 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:57.396+0000 7fa011009640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa00c1558d0 con 0x7fa00c159c40 2023-11-28T20:01:57.400 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:57.396+0000 7fa00ad9d640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7fa00c14b1e0 0x7fa00c0c1700 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:54752/0 (socket says 172.21.15.78:54752) 2023-11-28T20:01:57.400 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:57.396+0000 7fa00ad9d640 1 -- 172.21.15.78:0/2162938218 learned_addr learned my addr 172.21.15.78:0/2162938218 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-11-28T20:01:57.402 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:57.396+0000 7fa00b59e640 1 --2- 172.21.15.78:0/2162938218 >> v2:172.21.15.179:3300/0 conn(0x7fa00c159c40 0x7fa00c15c030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:57.403 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:57.396+0000 7fa00a59c640 1 -- 172.21.15.78:0/2162938218 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2067361675 0 0) 0x7fa00c0a4e20 con 0x7fa00c14b1e0 2023-11-28T20:01:57.403 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:57.396+0000 7fa00a59c640 1 -- 172.21.15.78:0/2162938218 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9ff8003530 con 0x7fa00c14b1e0 2023-11-28T20:01:57.403 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:57.396+0000 7fa00a59c640 1 -- 172.21.15.78:0/2162938218 <== mon.0 v1:172.21.15.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 903695107 0 0) 0x7f9ff8003530 con 0x7fa00c14b1e0 2023-11-28T20:01:57.403 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:57.396+0000 7fa00a59c640 1 -- 172.21.15.78:0/2162938218 >> v2:172.21.15.179:3300/0 conn(0x7fa00c159c40 msgr2=0x7fa00c15c030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:01:57.403 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:57.396+0000 7fa00a59c640 1 --2- 172.21.15.78:0/2162938218 >> v2:172.21.15.179:3300/0 conn(0x7fa00c159c40 0x7fa00c15c030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:57.404 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:57.396+0000 7fa00a59c640 1 -- 172.21.15.78:0/2162938218 >> v1:172.21.15.179:6789/0 conn(0x7fa00c0c5300 legacy=0x7fa00c0a9c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:01:57.404 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:57.396+0000 7fa00a59c640 1 -- 172.21.15.78:0/2162938218 --> v1:172.21.15.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa00c0c0f00 con 0x7fa00c14b1e0 2023-11-28T20:01:57.404 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:57.396+0000 7fa00a59c640 1 -- 172.21.15.78:0/2162938218 <== mon.0 v1:172.21.15.78:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3326804700 0 0) 0x7f9ffc001a00 con 0x7fa00c14b1e0 2023-11-28T20:01:57.404 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:57.396+0000 7fa00a59c640 1 -- 172.21.15.78:0/2162938218 >> v1:172.21.15.78:6789/0 conn(0x7fa00c14b1e0 legacy=0x7fa00c0c1700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:01:57.405 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:57.396+0000 7fa00a59c640 1 --2- 172.21.15.78:0/2162938218 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9ff80039d0 0x7f9ff8003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:57.405 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:57.396+0000 7fa00a59c640 1 --2- 172.21.15.78:0/2162938218 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9ff80047d0 0x7f9ff8004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:57.405 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:57.396+0000 7fa00a59c640 1 --2- 172.21.15.78:0/2162938218 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9ff8005190 0x7f9ff800b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:57.405 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:57.396+0000 7fa00a59c640 1 -- 172.21.15.78:0/2162938218 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa00c1558d0 con 0x7f9ff80039d0 2023-11-28T20:01:57.405 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:57.396+0000 7fa00a59c640 1 -- 172.21.15.78:0/2162938218 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ff800c0c0 con 0x7f9ff80047d0 2023-11-28T20:01:57.406 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:57.396+0000 7fa00a59c640 1 -- 172.21.15.78:0/2162938218 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ff800c280 con 0x7f9ff8005190 2023-11-28T20:01:57.406 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:57.396+0000 7fa00ad9d640 1 --2- 172.21.15.78:0/2162938218 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9ff80039d0 0x7f9ff8003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:57.406 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:57.396+0000 7fa00b59e640 1 --2- 172.21.15.78:0/2162938218 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9ff8005190 0x7f9ff800b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:57.406 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:57.396+0000 7fa00259c640 1 --2- 172.21.15.78:0/2162938218 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9ff80047d0 0x7f9ff8004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:57.407 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:57.396+0000 7fa00ad9d640 1 -- 172.21.15.78:0/2162938218 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9ff8005190 msgr2=0x7f9ff800b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:01:57.407 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:57.396+0000 7fa00ad9d640 1 --2- 172.21.15.78:0/2162938218 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9ff8005190 0x7f9ff800b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:57.407 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:57.396+0000 7fa00ad9d640 1 -- 172.21.15.78:0/2162938218 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9ff80047d0 msgr2=0x7f9ff8004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:01:57.407 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:57.396+0000 7fa00ad9d640 1 --2- 172.21.15.78:0/2162938218 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9ff80047d0 0x7f9ff8004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:57.408 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:57.396+0000 7fa00ad9d640 1 -- 172.21.15.78:0/2162938218 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ff8003530 con 0x7f9ff80039d0 2023-11-28T20:01:57.408 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:57.396+0000 7fa00b59e640 1 -- 172.21.15.78:0/2162938218 reap_dead start 2023-11-28T20:01:57.411 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:57.400+0000 7fa00ad9d640 1 --2- 172.21.15.78:0/2162938218 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9ff80039d0 0x7f9ff8003e10 secure :-1 s=READY pgs=840 cs=0 l=1 rev1=1 crypto rx=0x7f9ffc00a760 tx=0x7f9ffc01d1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=666ac53f3dcdf282 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:01:57.411 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:57.400+0000 7fa00a59c640 1 -- 172.21.15.78:0/2162938218 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ffc0ad630 con 0x7f9ff80039d0 2023-11-28T20:01:57.411 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:57.400+0000 7fa00a59c640 1 -- 172.21.15.78:0/2162938218 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ffc0a8070 con 0x7f9ff80039d0 2023-11-28T20:01:57.411 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:57.400+0000 7fa00a59c640 1 -- 172.21.15.78:0/2162938218 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ffc0ada50 con 0x7f9ff80039d0 2023-11-28T20:01:57.411 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:57.400+0000 7fa011009640 1 -- 172.21.15.78:0/2162938218 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9ff80039d0 msgr2=0x7f9ff8003e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:01:57.411 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:57.400+0000 7fa011009640 1 --2- 172.21.15.78:0/2162938218 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9ff80039d0 0x7f9ff8003e10 secure :-1 s=READY pgs=840 cs=0 l=1 rev1=1 crypto rx=0x7f9ffc00a760 tx=0x7f9ffc01d1e0 comp rx=0 tx=0).stop 2023-11-28T20:01:57.412 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:57.400+0000 7fa011009640 1 -- 172.21.15.78:0/2162938218 shutdown_connections 2023-11-28T20:01:57.412 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:57.400+0000 7fa011009640 1 --2- 172.21.15.78:0/2162938218 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9ff80039d0 0x7f9ff8003e10 unknown :-1 s=CLOSED pgs=840 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:57.412 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:57.400+0000 7fa011009640 1 -- 172.21.15.78:0/2162938218 >> 172.21.15.78:0/2162938218 conn(0x7fa00c0c59f0 msgr2=0x7fa00c0c5e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:01:57.412 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:57.400+0000 7fa011009640 1 -- 172.21.15.78:0/2162938218 shutdown_connections 2023-11-28T20:01:57.412 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:57.400+0000 7fa011009640 1 -- 172.21.15.78:0/2162938218 wait complete. 2023-11-28T20:01:57.412 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:57.400+0000 7fa011009640 1 Processor -- start 2023-11-28T20:01:57.412 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:57.400+0000 7fa011009640 1 -- start start 2023-11-28T20:01:57.412 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:57.404+0000 7fa011009640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9ff80039d0 0x7fa00c06cc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:57.412 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:57.404+0000 7fa011009640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa00c1479c0 0x7fa00c140cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:57.412 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:57.404+0000 7fa011009640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa00c141ca0 0x7fa00c1411f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:57.412 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:57.404+0000 7fa011009640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa00c1ef1b0 con 0x7fa00c141ca0 2023-11-28T20:01:57.413 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:57.404+0000 7fa011009640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa00c1df290 con 0x7fa00c1479c0 2023-11-28T20:01:57.413 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:57.404+0000 7fa011009640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa00c141730 con 0x7f9ff80039d0 2023-11-28T20:01:57.413 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:57.404+0000 7fa00b59e640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa00c141ca0 0x7fa00c1411f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:57.413 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:57.404+0000 7fa00ad9d640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9ff80039d0 0x7fa00c06cc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:57.413 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:57.404+0000 7fa00b59e640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa00c141ca0 0x7fa00c1411f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:43966/0 (socket says 172.21.15.78:43966) 2023-11-28T20:01:57.413 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:57.404+0000 7fa00b59e640 1 -- 172.21.15.78:0/1644459622 learned_addr learned my addr 172.21.15.78:0/1644459622 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T20:01:57.413 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:57.404+0000 7fa00259c640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa00c1479c0 0x7fa00c140cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:57.413 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:57.404+0000 7fa00b59e640 1 -- 172.21.15.78:0/1644459622 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9ff80039d0 msgr2=0x7fa00c06cc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:01:57.413 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:57.404+0000 7fa00b59e640 1 --2- 172.21.15.78:0/1644459622 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9ff80039d0 0x7fa00c06cc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:57.413 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:57.404+0000 7fa00b59e640 1 -- 172.21.15.78:0/1644459622 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa00c1479c0 msgr2=0x7fa00c140cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:01:57.413 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:57.404+0000 7fa00b59e640 1 --2- 172.21.15.78:0/1644459622 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa00c1479c0 0x7fa00c140cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:57.413 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:57.404+0000 7fa00b59e640 1 -- 172.21.15.78:0/1644459622 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa00c142150 con 0x7fa00c141ca0 2023-11-28T20:01:57.414 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:57.404+0000 7fa00b59e640 1 --2- 172.21.15.78:0/1644459622 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa00c141ca0 0x7fa00c1411f0 secure :-1 s=READY pgs=841 cs=0 l=1 rev1=1 crypto rx=0x7fa00c0c6a70 tx=0x7fa004011920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:01:57.414 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:57.404+0000 7fa003fff640 1 -- 172.21.15.78:0/1644459622 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa004004500 con 0x7fa00c141ca0 2023-11-28T20:01:57.414 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:57.404+0000 7fa003fff640 1 -- 172.21.15.78:0/1644459622 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa004003620 con 0x7fa00c141ca0 2023-11-28T20:01:57.414 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:57.404+0000 7fa003fff640 1 -- 172.21.15.78:0/1644459622 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0040039d0 con 0x7fa00c141ca0 2023-11-28T20:01:57.414 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:57.404+0000 7fa011009640 1 -- 172.21.15.78:0/1644459622 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa00c1419c0 con 0x7fa00c141ca0 2023-11-28T20:01:57.414 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:57.404+0000 7fa011009640 1 -- 172.21.15.78:0/1644459622 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa00c06d160 con 0x7fa00c141ca0 2023-11-28T20:01:57.414 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:57.404+0000 7fa011009640 1 -- 172.21.15.78:0/1644459622 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa00c1ef2f0 con 0x7fa00c141ca0 2023-11-28T20:01:57.415 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:57.408+0000 7fa003fff640 1 -- 172.21.15.78:0/1644459622 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fa004003b30 con 0x7fa00c141ca0 2023-11-28T20:01:57.416 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:57.408+0000 7fa003fff640 1 --2- 172.21.15.78:0/1644459622 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f9fec0664a0 0x7f9fec068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:57.416 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:57.408+0000 7fa003fff640 1 -- 172.21.15.78:0/1644459622 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(71..71 src has 1..71) v4 ==== 5765+0+0 (secure 0 0 0) 0x7fa004084180 con 0x7fa00c141ca0 2023-11-28T20:01:57.416 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:57.408+0000 7fa00ad9d640 1 --2- 172.21.15.78:0/1644459622 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f9fec0664a0 0x7f9fec068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:57.416 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:57.408+0000 7fa00ad9d640 1 --2- 172.21.15.78:0/1644459622 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f9fec0664a0 0x7f9fec068960 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f9ffc0ad000 tx=0x7f9ffc0a7000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:01:57.416 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:57.412+0000 7fa003fff640 1 -- 172.21.15.78:0/1644459622 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fa00c1ef2f0 con 0x7fa00c141ca0 2023-11-28T20:01:57.567 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:57.564+0000 7fa011009640 1 -- 172.21.15.78:0/1644459622 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs2_data", "pool2": "cephfs2_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fa00c1ef2f0 con 0x7fa00c141ca0 2023-11-28T20:01:58.228 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:58.224+0000 7fa003fff640 1 -- 172.21.15.78:0/1644459622 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs2_data", "pool2": "cephfs2_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs2_data' removed v72) v1 ==== 172+0+0 (secure 0 0 0) 0x7fa00c1ef2f0 con 0x7fa00c141ca0 2023-11-28T20:01:58.228 INFO:teuthology.orchestra.run.smithi078.stderr:pool 'cephfs2_data' removed 2023-11-28T20:01:58.232 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:58.228+0000 7fa011009640 1 -- 172.21.15.78:0/1644459622 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f9fec0664a0 msgr2=0x7f9fec068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:01:58.233 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:58.228+0000 7fa011009640 1 --2- 172.21.15.78:0/1644459622 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f9fec0664a0 0x7f9fec068960 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f9ffc0ad000 tx=0x7f9ffc0a7000 comp rx=0 tx=0).stop 2023-11-28T20:01:58.233 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:58.228+0000 7fa011009640 1 -- 172.21.15.78:0/1644459622 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa00c141ca0 msgr2=0x7fa00c1411f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:01:58.233 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:58.228+0000 7fa011009640 1 --2- 172.21.15.78:0/1644459622 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa00c141ca0 0x7fa00c1411f0 secure :-1 s=READY pgs=841 cs=0 l=1 rev1=1 crypto rx=0x7fa00c0c6a70 tx=0x7fa004011920 comp rx=0 tx=0).stop 2023-11-28T20:01:58.233 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:58.228+0000 7fa011009640 1 -- 172.21.15.78:0/1644459622 shutdown_connections 2023-11-28T20:01:58.233 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:58.228+0000 7fa011009640 1 --2- 172.21.15.78:0/1644459622 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f9fec0664a0 0x7f9fec068960 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:58.233 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:58.228+0000 7fa011009640 1 --2- 172.21.15.78:0/1644459622 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa00c141ca0 0x7fa00c1411f0 unknown :-1 s=CLOSED pgs=841 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:58.233 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:58.228+0000 7fa011009640 1 --2- 172.21.15.78:0/1644459622 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa00c1479c0 0x7fa00c140cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:58.233 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:58.228+0000 7fa011009640 1 --2- 172.21.15.78:0/1644459622 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9ff80039d0 0x7fa00c06cc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:58.233 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:58.228+0000 7fa011009640 1 -- 172.21.15.78:0/1644459622 >> 172.21.15.78:0/1644459622 conn(0x7fa00c0c59f0 msgr2=0x7fa00c0c4180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:01:58.234 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:58.228+0000 7fa011009640 1 -- 172.21.15.78:0/1644459622 shutdown_connections 2023-11-28T20:01:58.234 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:58.228+0000 7fa011009640 1 -- 172.21.15.78:0/1644459622 wait complete. 2023-11-28T20:01:58.258 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-11-28T20:01:58.401 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:58.396+0000 7f854792a640 1 Processor -- start 2023-11-28T20:01:58.401 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:58.396+0000 7f854792a640 1 -- start start 2023-11-28T20:01:58.402 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:58.396+0000 7f854792a640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f85400c5300 0x7f85400a9c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:58.403 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:58.396+0000 7f854792a640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f85401548c0 0x7f8540154d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:58.403 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:58.396+0000 7f854792a640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f85400a4e20 con 0x7f854014b1e0 2023-11-28T20:01:58.403 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:58.396+0000 7f854792a640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f85400a50e0 con 0x7f85401548c0 2023-11-28T20:01:58.403 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:58.396+0000 7f854792a640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f85400c0f00 con 0x7f85400c5300 2023-11-28T20:01:58.403 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:58.396+0000 7f8545ec7640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f85401548c0 0x7f8540154d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:58.403 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:58.396+0000 7f8545ec7640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f85401548c0 0x7f8540154d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:43970/0 (socket says 172.21.15.78:43970) 2023-11-28T20:01:58.403 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:58.396+0000 7f8545ec7640 1 -- 172.21.15.78:0/1077920742 learned_addr learned my addr 172.21.15.78:0/1077920742 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T20:01:58.403 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:58.396+0000 7f8544ec5640 1 --2- 172.21.15.78:0/1077920742 >> v2:172.21.15.179:3300/0 conn(0x7f85400c5300 0x7f85400a9c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:58.403 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:58.396+0000 7f8545ec7640 1 -- 172.21.15.78:0/1077920742 >> v2:172.21.15.179:3300/0 conn(0x7f85400c5300 msgr2=0x7f85400a9c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:01:58.404 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:58.396+0000 7f8545ec7640 1 --2- 172.21.15.78:0/1077920742 >> v2:172.21.15.179:3300/0 conn(0x7f85400c5300 0x7f85400a9c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:58.404 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:58.396+0000 7f8545ec7640 1 -- 172.21.15.78:0/1077920742 >> v1:172.21.15.179:6789/0 conn(0x7f854014b1e0 legacy=0x7f85400c1700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:01:58.404 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:58.396+0000 7f8545ec7640 1 -- 172.21.15.78:0/1077920742 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85400c11e0 con 0x7f85401548c0 2023-11-28T20:01:58.404 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:58.396+0000 7f8544ec5640 1 --2- 172.21.15.78:0/1077920742 >> v2:172.21.15.179:3300/0 conn(0x7f85400c5300 0x7f85400a9c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T20:01:58.405 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:58.400+0000 7f8545ec7640 1 --2- 172.21.15.78:0/1077920742 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f85401548c0 0x7f8540154d30 secure :-1 s=READY pgs=842 cs=0 l=1 rev1=1 crypto rx=0x7f85400a9650 tx=0x7f853801c9d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f839cc0ad4226cef server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:01:58.405 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:58.400+0000 7f8537fff640 1 -- 172.21.15.78:0/1077920742 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85380a57a0 con 0x7f85401548c0 2023-11-28T20:01:58.406 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:58.400+0000 7f8537fff640 1 -- 172.21.15.78:0/1077920742 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f85380a5900 con 0x7f85401548c0 2023-11-28T20:01:58.406 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:58.400+0000 7f8537fff640 1 -- 172.21.15.78:0/1077920742 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85380a5c90 con 0x7f85401548c0 2023-11-28T20:01:58.406 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:58.400+0000 7f854792a640 1 -- 172.21.15.78:0/1077920742 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f85401548c0 msgr2=0x7f8540154d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:01:58.407 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:58.400+0000 7f854792a640 1 --2- 172.21.15.78:0/1077920742 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f85401548c0 0x7f8540154d30 secure :-1 s=READY pgs=842 cs=0 l=1 rev1=1 crypto rx=0x7f85400a9650 tx=0x7f853801c9d0 comp rx=0 tx=0).stop 2023-11-28T20:01:58.407 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:58.400+0000 7f854792a640 1 -- 172.21.15.78:0/1077920742 shutdown_connections 2023-11-28T20:01:58.407 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:58.400+0000 7f854792a640 1 --2- 172.21.15.78:0/1077920742 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f85401548c0 0x7f8540154d30 unknown :-1 s=CLOSED pgs=842 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:58.407 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:58.400+0000 7f854792a640 1 --2- 172.21.15.78:0/1077920742 >> v2:172.21.15.179:3300/0 conn(0x7f85400c5300 0x7f85400a9c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:58.407 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:58.400+0000 7f854792a640 1 -- 172.21.15.78:0/1077920742 >> 172.21.15.78:0/1077920742 conn(0x7f85400c59f0 msgr2=0x7f85400c5e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:01:58.407 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:58.400+0000 7f854792a640 1 -- 172.21.15.78:0/1077920742 shutdown_connections 2023-11-28T20:01:58.407 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:58.400+0000 7f854792a640 1 -- 172.21.15.78:0/1077920742 wait complete. 2023-11-28T20:01:58.411 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:58.404+0000 7f854792a640 1 Processor -- start 2023-11-28T20:01:58.411 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:58.404+0000 7f854792a640 1 -- start start 2023-11-28T20:01:58.412 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:58.404+0000 7f854792a640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f85400c5300 0x7f854006cd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:58.412 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:58.404+0000 7f854792a640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f854014b1e0 0x7f8540140970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:58.412 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:58.404+0000 7f854792a640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f85401548c0 0x7f8540140eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:58.412 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:58.404+0000 7f854792a640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85401413f0 con 0x7f854014b1e0 2023-11-28T20:01:58.412 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:58.404+0000 7f854792a640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8540150c20 con 0x7f85401548c0 2023-11-28T20:01:58.412 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:58.404+0000 7f854792a640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f854014f250 con 0x7f85400c5300 2023-11-28T20:01:58.412 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:58.404+0000 7f8544ec5640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f854014b1e0 0x7f8540140970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:58.412 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:58.404+0000 7f8544ec5640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f854014b1e0 0x7f8540140970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:43974/0 (socket says 172.21.15.78:43974) 2023-11-28T20:01:58.412 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:58.404+0000 7f8544ec5640 1 -- 172.21.15.78:0/2203291063 learned_addr learned my addr 172.21.15.78:0/2203291063 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T20:01:58.412 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:58.404+0000 7f8545ec7640 1 --2- 172.21.15.78:0/2203291063 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f85401548c0 0x7f8540140eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:58.413 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:58.404+0000 7f85456c6640 1 --2- 172.21.15.78:0/2203291063 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f85400c5300 0x7f854006cd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:58.413 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:58.404+0000 7f8544ec5640 1 -- 172.21.15.78:0/2203291063 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f85400c5300 msgr2=0x7f854006cd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:01:58.413 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:58.404+0000 7f8544ec5640 1 --2- 172.21.15.78:0/2203291063 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f85400c5300 0x7f854006cd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:58.413 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:58.404+0000 7f8544ec5640 1 -- 172.21.15.78:0/2203291063 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f85401548c0 msgr2=0x7f8540140eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:01:58.413 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:58.404+0000 7f8544ec5640 1 --2- 172.21.15.78:0/2203291063 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f85401548c0 0x7f8540140eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:58.413 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:58.404+0000 7f8544ec5640 1 -- 172.21.15.78:0/2203291063 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8538009b30 con 0x7f854014b1e0 2023-11-28T20:01:58.413 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:58.404+0000 7f8544ec5640 1 --2- 172.21.15.78:0/2203291063 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f854014b1e0 0x7f8540140970 secure :-1 s=READY pgs=843 cs=0 l=1 rev1=1 crypto rx=0x7f853000d800 tx=0x7f853000dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:01:58.413 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:58.404+0000 7f8535ffb640 1 -- 172.21.15.78:0/2203291063 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85300096a0 con 0x7f854014b1e0 2023-11-28T20:01:58.413 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:58.404+0000 7f8535ffb640 1 -- 172.21.15.78:0/2203291063 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8530009800 con 0x7f854014b1e0 2023-11-28T20:01:58.414 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:58.404+0000 7f8535ffb640 1 -- 172.21.15.78:0/2203291063 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8530009bb0 con 0x7f854014b1e0 2023-11-28T20:01:58.414 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:58.404+0000 7f854792a640 1 -- 172.21.15.78:0/2203291063 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f85401f09a0 con 0x7f854014b1e0 2023-11-28T20:01:58.414 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:58.404+0000 7f854792a640 1 -- 172.21.15.78:0/2203291063 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f854006d250 con 0x7f854014b1e0 2023-11-28T20:01:58.414 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:58.408+0000 7f854792a640 1 -- 172.21.15.78:0/2203291063 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8540150d90 con 0x7f854014b1e0 2023-11-28T20:01:58.415 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:58.408+0000 7f8535ffb640 1 -- 172.21.15.78:0/2203291063 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f8530009d10 con 0x7f854014b1e0 2023-11-28T20:01:58.415 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:58.408+0000 7f8535ffb640 1 --2- 172.21.15.78:0/2203291063 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f8524066470 0x7f8524068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:58.415 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:58.408+0000 7f8535ffb640 1 -- 172.21.15.78:0/2203291063 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 5349+0+0 (secure 0 0 0) 0x7f8530084170 con 0x7f854014b1e0 2023-11-28T20:01:58.415 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:58.408+0000 7f85456c6640 1 --2- 172.21.15.78:0/2203291063 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f8524066470 0x7f8524068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:58.415 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:58.408+0000 7f85456c6640 1 --2- 172.21.15.78:0/2203291063 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f8524066470 0x7f8524068930 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f853c007fd0 tx=0x7f853c009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:01:58.417 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:58.412+0000 7f8535ffb640 1 -- 172.21.15.78:0/2203291063 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f8540150d90 con 0x7f854014b1e0 2023-11-28T20:01:58.569 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:58.564+0000 7f854792a640 1 -- 172.21.15.78:0/2203291063 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f8540150d90 con 0x7f854014b1e0 2023-11-28T20:01:58.572 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:58.568+0000 7f8535ffb640 1 -- 172.21.15.78:0/2203291063 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v13) v1 ==== 104+0+0 (secure 0 0 0) 0x7f8540150d90 con 0x7f854014b1e0 2023-11-28T20:01:58.574 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:58.568+0000 7f854792a640 1 -- 172.21.15.78:0/2203291063 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f8524066470 msgr2=0x7f8524068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:01:58.574 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:58.568+0000 7f854792a640 1 --2- 172.21.15.78:0/2203291063 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f8524066470 0x7f8524068930 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f853c007fd0 tx=0x7f853c009040 comp rx=0 tx=0).stop 2023-11-28T20:01:58.574 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:58.568+0000 7f854792a640 1 -- 172.21.15.78:0/2203291063 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f854014b1e0 msgr2=0x7f8540140970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:01:58.574 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:58.568+0000 7f854792a640 1 --2- 172.21.15.78:0/2203291063 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f854014b1e0 0x7f8540140970 secure :-1 s=READY pgs=843 cs=0 l=1 rev1=1 crypto rx=0x7f853000d800 tx=0x7f853000dcc0 comp rx=0 tx=0).stop 2023-11-28T20:01:58.574 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:58.568+0000 7f854792a640 1 -- 172.21.15.78:0/2203291063 shutdown_connections 2023-11-28T20:01:58.575 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:58.568+0000 7f854792a640 1 --2- 172.21.15.78:0/2203291063 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f8524066470 0x7f8524068930 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:58.575 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:58.568+0000 7f854792a640 1 --2- 172.21.15.78:0/2203291063 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f85401548c0 0x7f8540140eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:58.575 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:58.568+0000 7f854792a640 1 --2- 172.21.15.78:0/2203291063 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f854014b1e0 0x7f8540140970 unknown :-1 s=CLOSED pgs=843 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:58.575 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:58.568+0000 7f854792a640 1 --2- 172.21.15.78:0/2203291063 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f85400c5300 0x7f854006cd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:58.575 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:58.568+0000 7f854792a640 1 -- 172.21.15.78:0/2203291063 >> 172.21.15.78:0/2203291063 conn(0x7f85400c59f0 msgr2=0x7f85401461a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:01:58.575 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:58.568+0000 7f854792a640 1 -- 172.21.15.78:0/2203291063 shutdown_connections 2023-11-28T20:01:58.575 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:58.568+0000 7f854792a640 1 -- 172.21.15.78:0/2203291063 wait complete. 2023-11-28T20:01:58.593 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_multifs_auth.TestClientsWithoutAuth.test_mount_mon_and_osd_caps_present_mds_caps_absent' 2023-11-28T20:01:58.730 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:58.724+0000 7f1da8d3e640 1 Processor -- start 2023-11-28T20:01:58.731 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:58.724+0000 7f1da8d3e640 1 -- start start 2023-11-28T20:01:58.732 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:58.728+0000 7f1da8d3e640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f1da406bef0 0x7f1da40bfce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:58.732 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:58.728+0000 7f1da8d3e640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1da4151690 con 0x7f1da414e3f0 2023-11-28T20:01:58.732 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:58.728+0000 7f1da8d3e640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1da4151bc0 con 0x7f1da406c5b0 2023-11-28T20:01:58.732 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:58.728+0000 7f1da8d3e640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1da41518e0 con 0x7f1da406bef0 2023-11-28T20:01:58.732 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:58.728+0000 7f1da259c640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f1da414e3f0 0x7f1da40c41f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:54766/0 (socket says 172.21.15.78:54766) 2023-11-28T20:01:58.733 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:58.728+0000 7f1da259c640 1 -- 172.21.15.78:0/3019736189 learned_addr learned my addr 172.21.15.78:0/3019736189 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-11-28T20:01:58.733 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:58.728+0000 7f1d9bfff640 1 --2- 172.21.15.78:0/3019736189 >> v2:172.21.15.179:3300/0 conn(0x7f1da406bef0 0x7f1da40bfce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:58.733 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:58.728+0000 7f1da1d9b640 1 -- 172.21.15.78:0/3019736189 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3443390732 0 0) 0x7f1da4151690 con 0x7f1da414e3f0 2023-11-28T20:01:58.733 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:58.728+0000 7f1da1d9b640 1 -- 172.21.15.78:0/3019736189 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1d90005740 con 0x7f1da414e3f0 2023-11-28T20:01:58.734 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:58.728+0000 7f1da1d9b640 1 -- 172.21.15.78:0/3019736189 <== mon.0 v1:172.21.15.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1735594005 0 0) 0x7f1d90005740 con 0x7f1da414e3f0 2023-11-28T20:01:58.734 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:58.728+0000 7f1da1d9b640 1 -- 172.21.15.78:0/3019736189 >> v2:172.21.15.179:3300/0 conn(0x7f1da406bef0 msgr2=0x7f1da40bfce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:01:58.735 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:58.728+0000 7f1da1d9b640 1 --2- 172.21.15.78:0/3019736189 >> v2:172.21.15.179:3300/0 conn(0x7f1da406bef0 0x7f1da40bfce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:58.735 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:58.728+0000 7f1da1d9b640 1 -- 172.21.15.78:0/3019736189 >> v1:172.21.15.179:6789/0 conn(0x7f1da406c5b0 legacy=0x7f1da406ca20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:01:58.735 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:58.728+0000 7f1da1d9b640 1 -- 172.21.15.78:0/3019736189 --> v1:172.21.15.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1da40c1de0 con 0x7f1da414e3f0 2023-11-28T20:01:58.735 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:58.728+0000 7f1da1d9b640 1 -- 172.21.15.78:0/3019736189 <== mon.0 v1:172.21.15.78:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3326804700 0 0) 0x7f1d94001680 con 0x7f1da414e3f0 2023-11-28T20:01:58.735 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:58.728+0000 7f1da1d9b640 1 -- 172.21.15.78:0/3019736189 >> v1:172.21.15.78:6789/0 conn(0x7f1da414e3f0 legacy=0x7f1da40c41f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:01:58.735 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:58.728+0000 7f1da1d9b640 1 --2- 172.21.15.78:0/3019736189 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1d90005be0 0x7f1d90006000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:58.735 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:58.728+0000 7f1da1d9b640 1 --2- 172.21.15.78:0/3019736189 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1d900069e0 0x7f1d90006e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:58.735 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:58.728+0000 7f1da1d9b640 1 --2- 172.21.15.78:0/3019736189 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1d900073f0 0x7f1d9000dba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:58.735 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:58.728+0000 7f1da1d9b640 1 -- 172.21.15.78:0/3019736189 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1da41518e0 con 0x7f1d900069e0 2023-11-28T20:01:58.735 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:58.728+0000 7f1da1d9b640 1 -- 172.21.15.78:0/3019736189 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d9000e340 con 0x7f1d90005be0 2023-11-28T20:01:58.735 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:58.728+0000 7f1da1d9b640 1 -- 172.21.15.78:0/3019736189 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d9000e500 con 0x7f1d900073f0 2023-11-28T20:01:58.736 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:58.728+0000 7f1d9bfff640 1 --2- 172.21.15.78:0/3019736189 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1d900069e0 0x7f1d90006e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:58.736 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:58.728+0000 7f1da259c640 1 --2- 172.21.15.78:0/3019736189 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1d90005be0 0x7f1d90006000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:58.736 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:58.728+0000 7f1da2d9d640 1 --2- 172.21.15.78:0/3019736189 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1d900073f0 0x7f1d9000dba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:58.736 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:58.728+0000 7f1d9bfff640 1 -- 172.21.15.78:0/3019736189 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1d900073f0 msgr2=0x7f1d9000dba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:01:58.736 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:58.728+0000 7f1d9bfff640 1 --2- 172.21.15.78:0/3019736189 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1d900073f0 0x7f1d9000dba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:58.736 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:58.728+0000 7f1d9bfff640 1 -- 172.21.15.78:0/3019736189 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1d90005be0 msgr2=0x7f1d90006000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:01:58.736 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:58.728+0000 7f1d9bfff640 1 --2- 172.21.15.78:0/3019736189 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1d90005be0 0x7f1d90006000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:58.736 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:58.728+0000 7f1d9bfff640 1 -- 172.21.15.78:0/3019736189 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d90005740 con 0x7f1d900069e0 2023-11-28T20:01:58.736 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:58.728+0000 7f1da2d9d640 1 -- 172.21.15.78:0/3019736189 reap_dead start 2023-11-28T20:01:58.737 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:58.732+0000 7f1d9bfff640 1 --2- 172.21.15.78:0/3019736189 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1d900069e0 0x7f1d90006e60 secure :-1 s=READY pgs=845 cs=0 l=1 rev1=1 crypto rx=0x7f1d8c009ab0 tx=0x7f1d8c01ca00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4d39848fc17715ca server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:01:58.737 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:58.732+0000 7f1da1d9b640 1 -- 172.21.15.78:0/3019736189 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d8c0a64f0 con 0x7f1d900069e0 2023-11-28T20:01:58.737 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:58.732+0000 7f1da1d9b640 1 -- 172.21.15.78:0/3019736189 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d8c0a6650 con 0x7f1d900069e0 2023-11-28T20:01:58.738 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:58.732+0000 7f1da1d9b640 1 -- 172.21.15.78:0/3019736189 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d8c0a6a00 con 0x7f1d900069e0 2023-11-28T20:01:58.738 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:58.732+0000 7f1da8d3e640 1 -- 172.21.15.78:0/3019736189 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1d900069e0 msgr2=0x7f1d90006e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:01:58.738 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:58.732+0000 7f1da8d3e640 1 --2- 172.21.15.78:0/3019736189 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1d900069e0 0x7f1d90006e60 secure :-1 s=READY pgs=845 cs=0 l=1 rev1=1 crypto rx=0x7f1d8c009ab0 tx=0x7f1d8c01ca00 comp rx=0 tx=0).stop 2023-11-28T20:01:58.738 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:58.732+0000 7f1da8d3e640 1 -- 172.21.15.78:0/3019736189 shutdown_connections 2023-11-28T20:01:58.738 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:58.732+0000 7f1da8d3e640 1 --2- 172.21.15.78:0/3019736189 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1d900069e0 0x7f1d90006e60 unknown :-1 s=CLOSED pgs=845 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:58.738 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:58.732+0000 7f1da8d3e640 1 -- 172.21.15.78:0/3019736189 >> 172.21.15.78:0/3019736189 conn(0x7f1da40a7810 msgr2=0x7f1da40a7c20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:01:58.738 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:58.732+0000 7f1da8d3e640 1 -- 172.21.15.78:0/3019736189 shutdown_connections 2023-11-28T20:01:58.738 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:58.732+0000 7f1da8d3e640 1 -- 172.21.15.78:0/3019736189 wait complete. 2023-11-28T20:01:58.742 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:58.736+0000 7f1da8d3e640 1 Processor -- start 2023-11-28T20:01:58.742 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:58.736+0000 7f1da8d3e640 1 -- start start 2023-11-28T20:01:58.742 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:58.736+0000 7f1da8d3e640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1d900069e0 0x7f1da41e8d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:58.742 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:58.736+0000 7f1da8d3e640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1da4148110 0x7f1da41ecaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:58.742 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:58.736+0000 7f1da8d3e640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1da4147800 0x7f1da414fad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:58.742 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:58.736+0000 7f1da8d3e640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1da41e9240 con 0x7f1da4148110 2023-11-28T20:01:58.742 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:58.736+0000 7f1da8d3e640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1da4153fc0 con 0x7f1d900069e0 2023-11-28T20:01:58.743 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:58.736+0000 7f1da8d3e640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1da4072550 con 0x7f1da4147800 2023-11-28T20:01:58.743 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:58.736+0000 7f1d9bfff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1da4148110 0x7f1da41ecaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:58.743 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:58.736+0000 7f1d9bfff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1da4148110 0x7f1da41ecaf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:43998/0 (socket says 172.21.15.78:43998) 2023-11-28T20:01:58.743 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:58.736+0000 7f1d9bfff640 1 -- 172.21.15.78:0/3649147931 learned_addr learned my addr 172.21.15.78:0/3649147931 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T20:01:58.743 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:58.736+0000 7f1da259c640 1 --2- 172.21.15.78:0/3649147931 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1d900069e0 0x7f1da41e8d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:58.743 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:58.736+0000 7f1da2d9d640 1 --2- 172.21.15.78:0/3649147931 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1da4147800 0x7f1da414fad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:58.743 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:58.736+0000 7f1d9bfff640 1 -- 172.21.15.78:0/3649147931 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1da4147800 msgr2=0x7f1da414fad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:01:58.743 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:58.736+0000 7f1d9bfff640 1 --2- 172.21.15.78:0/3649147931 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1da4147800 0x7f1da414fad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:58.743 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:58.736+0000 7f1d9bfff640 1 -- 172.21.15.78:0/3649147931 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1d900069e0 msgr2=0x7f1da41e8d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:01:58.743 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:58.736+0000 7f1d9bfff640 1 --2- 172.21.15.78:0/3649147931 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1d900069e0 0x7f1da41e8d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:58.743 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:58.736+0000 7f1d9bfff640 1 -- 172.21.15.78:0/3649147931 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1da40727f0 con 0x7f1da4148110 2023-11-28T20:01:58.743 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:58.736+0000 7f1d9bfff640 1 --2- 172.21.15.78:0/3649147931 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1da4148110 0x7f1da41ecaf0 secure :-1 s=READY pgs=846 cs=0 l=1 rev1=1 crypto rx=0x7f1d8c0b0040 tx=0x7f1d8c0197a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:01:58.744 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:58.736+0000 7f1d9affd640 1 -- 172.21.15.78:0/3649147931 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d8c00f0c0 con 0x7f1da4148110 2023-11-28T20:01:58.744 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:58.736+0000 7f1d9affd640 1 -- 172.21.15.78:0/3649147931 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d8c004020 con 0x7f1da4148110 2023-11-28T20:01:58.744 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:58.736+0000 7f1d9affd640 1 -- 172.21.15.78:0/3649147931 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d8c0043b0 con 0x7f1da4148110 2023-11-28T20:01:58.744 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:58.736+0000 7f1da8d3e640 1 -- 172.21.15.78:0/3649147931 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1da41ec310 con 0x7f1da4148110 2023-11-28T20:01:58.744 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:58.736+0000 7f1da8d3e640 1 -- 172.21.15.78:0/3649147931 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1da4150a70 con 0x7f1da4148110 2023-11-28T20:01:58.745 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:58.736+0000 7f1da8d3e640 1 -- 172.21.15.78:0/3649147931 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1da4067630 con 0x7f1da4148110 2023-11-28T20:01:58.745 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:58.740+0000 7f1d9affd640 1 -- 172.21.15.78:0/3649147931 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f1d8c0a67c0 con 0x7f1da4148110 2023-11-28T20:01:58.745 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:58.740+0000 7f1d9affd640 1 --2- 172.21.15.78:0/3649147931 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f1d84066470 0x7f1d84068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:58.745 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:58.740+0000 7f1d9affd640 1 -- 172.21.15.78:0/3649147931 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 5349+0+0 (secure 0 0 0) 0x7f1d8c0aa070 con 0x7f1da4148110 2023-11-28T20:01:58.745 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:58.740+0000 7f1da259c640 1 --2- 172.21.15.78:0/3649147931 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f1d84066470 0x7f1d84068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:58.745 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:58.740+0000 7f1da259c640 1 --2- 172.21.15.78:0/3649147931 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f1d84066470 0x7f1d84068930 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f1d94001060 tx=0x7f1d94000f90 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:01:58.748 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:58.744+0000 7f1d9affd640 1 -- 172.21.15.78:0/3649147931 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f1d8c0eae00 con 0x7f1da4148110 2023-11-28T20:01:58.948 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:58.944+0000 7f1da8d3e640 1 -- 172.21.15.78:0/3649147931 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_multifs_auth.TestClientsWithoutAuth.test_mount_mon_and_osd_caps_present_mds_caps_absent"]} v 0) v1 -- 0x7f1da40a5530 con 0x7f1da4148110 2023-11-28T20:01:59.230 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:59.224+0000 7f1d9affd640 1 -- 172.21.15.78:0/3649147931 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_multifs_auth.TestClientsWithoutAuth.test_mount_mon_and_osd_caps_present_mds_caps_absent"]}]=0 v187) v1 ==== 184+0+0 (secure 0 0 0) 0x7f1d8c0ee420 con 0x7f1da4148110 2023-11-28T20:01:59.233 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:59.228+0000 7f1da8d3e640 1 -- 172.21.15.78:0/3649147931 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f1d84066470 msgr2=0x7f1d84068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:01:59.233 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:59.228+0000 7f1da8d3e640 1 --2- 172.21.15.78:0/3649147931 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f1d84066470 0x7f1d84068930 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f1d94001060 tx=0x7f1d94000f90 comp rx=0 tx=0).stop 2023-11-28T20:01:59.233 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:59.228+0000 7f1da8d3e640 1 -- 172.21.15.78:0/3649147931 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1da4148110 msgr2=0x7f1da41ecaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:01:59.234 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:59.228+0000 7f1da8d3e640 1 --2- 172.21.15.78:0/3649147931 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1da4148110 0x7f1da41ecaf0 secure :-1 s=READY pgs=846 cs=0 l=1 rev1=1 crypto rx=0x7f1d8c0b0040 tx=0x7f1d8c0197a0 comp rx=0 tx=0).stop 2023-11-28T20:01:59.234 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:59.228+0000 7f1da8d3e640 1 -- 172.21.15.78:0/3649147931 shutdown_connections 2023-11-28T20:01:59.234 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:59.228+0000 7f1da8d3e640 1 --2- 172.21.15.78:0/3649147931 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f1d84066470 0x7f1d84068930 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:59.234 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:59.228+0000 7f1da8d3e640 1 --2- 172.21.15.78:0/3649147931 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1da4147800 0x7f1da414fad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:59.234 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:59.228+0000 7f1da8d3e640 1 --2- 172.21.15.78:0/3649147931 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1da4148110 0x7f1da41ecaf0 unknown :-1 s=CLOSED pgs=846 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:59.234 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:59.228+0000 7f1da8d3e640 1 --2- 172.21.15.78:0/3649147931 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1d900069e0 0x7f1da41e8d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:59.234 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:59.228+0000 7f1da8d3e640 1 -- 172.21.15.78:0/3649147931 >> 172.21.15.78:0/3649147931 conn(0x7f1da40a7810 msgr2=0x7f1da414a0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:01:59.234 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:59.228+0000 7f1da8d3e640 1 -- 172.21.15.78:0/3649147931 shutdown_connections 2023-11-28T20:01:59.234 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:59.228+0000 7f1da8d3e640 1 -- 172.21.15.78:0/3649147931 wait complete. 2023-11-28T20:01:59.252 INFO:tasks.cephfs_test_runner:test_mount_mon_and_osd_caps_present_mds_caps_absent (tasks.cephfs.test_multifs_auth.TestClientsWithoutAuth) ... ok 2023-11-28T20:01:59.253 INFO:tasks.cephfs_test_runner:Starting test: test_r_with_fsname_and_no_path_in_cap (tasks.cephfs.test_multifs_auth.TestMDSCaps) 2023-11-28T20:01:59.253 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-28T20:01:59.390 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:59.384+0000 7fcf6432a640 1 Processor -- start 2023-11-28T20:01:59.390 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:59.384+0000 7fcf6432a640 1 -- start start 2023-11-28T20:01:59.394 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:59.388+0000 7fcf6432a640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fcf5c06d2b0 0x7fcf5c06d690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:59.394 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:59.388+0000 7fcf6432a640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fcf5c0c5300 0x7fcf5c06c730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:59.394 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:59.388+0000 7fcf6432a640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcf5c06bb80 con 0x7fcf5c0c3b80 2023-11-28T20:01:59.394 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:59.388+0000 7fcf6432a640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcf5c06cc70 con 0x7fcf5c06d2b0 2023-11-28T20:01:59.395 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:59.388+0000 7fcf6432a640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcf5c0c5790 con 0x7fcf5c0c5300 2023-11-28T20:01:59.395 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:59.388+0000 7fcf620c6640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fcf5c06d2b0 0x7fcf5c06d690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:59.395 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:59.388+0000 7fcf620c6640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fcf5c06d2b0 0x7fcf5c06d690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:44014/0 (socket says 172.21.15.78:44014) 2023-11-28T20:01:59.395 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:59.388+0000 7fcf620c6640 1 -- 172.21.15.78:0/3615361513 learned_addr learned my addr 172.21.15.78:0/3615361513 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T20:01:59.395 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:59.388+0000 7fcf628c7640 1 --2- 172.21.15.78:0/3615361513 >> v2:172.21.15.179:3300/0 conn(0x7fcf5c0c5300 0x7fcf5c06c730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:59.395 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:59.388+0000 7fcf620c6640 1 -- 172.21.15.78:0/3615361513 >> v2:172.21.15.179:3300/0 conn(0x7fcf5c0c5300 msgr2=0x7fcf5c06c730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:01:59.395 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:59.388+0000 7fcf620c6640 1 --2- 172.21.15.78:0/3615361513 >> v2:172.21.15.179:3300/0 conn(0x7fcf5c0c5300 0x7fcf5c06c730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:59.395 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:59.388+0000 7fcf620c6640 1 -- 172.21.15.78:0/3615361513 >> v1:172.21.15.179:6789/0 conn(0x7fcf5c0c3b80 legacy=0x7fcf5c06c020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:01:59.395 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:59.388+0000 7fcf620c6640 1 -- 172.21.15.78:0/3615361513 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf5c1515c0 con 0x7fcf5c06d2b0 2023-11-28T20:01:59.395 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:59.388+0000 7fcf620c6640 1 --2- 172.21.15.78:0/3615361513 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcf5c06d2b0 0x7fcf5c06d690 secure :-1 s=READY pgs=847 cs=0 l=1 rev1=1 crypto rx=0x7fcf5c06e3c0 tx=0x7fcf5801eb60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c26cb239d2a2490a server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:01:59.396 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:59.388+0000 7fcf610c4640 1 -- 172.21.15.78:0/3615361513 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf580a7b30 con 0x7fcf5c06d2b0 2023-11-28T20:01:59.396 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:59.388+0000 7fcf610c4640 1 -- 172.21.15.78:0/3615361513 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf580a7c90 con 0x7fcf5c06d2b0 2023-11-28T20:01:59.397 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:59.388+0000 7fcf610c4640 1 -- 172.21.15.78:0/3615361513 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf580af440 con 0x7fcf5c06d2b0 2023-11-28T20:01:59.397 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:59.392+0000 7fcf6432a640 1 -- 172.21.15.78:0/3615361513 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcf5c06d2b0 msgr2=0x7fcf5c06d690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:01:59.397 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:59.392+0000 7fcf6432a640 1 --2- 172.21.15.78:0/3615361513 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcf5c06d2b0 0x7fcf5c06d690 secure :-1 s=READY pgs=847 cs=0 l=1 rev1=1 crypto rx=0x7fcf5c06e3c0 tx=0x7fcf5801eb60 comp rx=0 tx=0).stop 2023-11-28T20:01:59.397 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:59.392+0000 7fcf6432a640 1 -- 172.21.15.78:0/3615361513 shutdown_connections 2023-11-28T20:01:59.397 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:59.392+0000 7fcf6432a640 1 --2- 172.21.15.78:0/3615361513 >> v2:172.21.15.179:3300/0 conn(0x7fcf5c0c5300 0x7fcf5c06c730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:59.397 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:59.392+0000 7fcf6432a640 1 --2- 172.21.15.78:0/3615361513 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcf5c06d2b0 0x7fcf5c06d690 unknown :-1 s=CLOSED pgs=847 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:59.397 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:59.392+0000 7fcf6432a640 1 -- 172.21.15.78:0/3615361513 >> 172.21.15.78:0/3615361513 conn(0x7fcf5c0a7810 msgr2=0x7fcf5c0a7c20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:01:59.397 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:59.392+0000 7fcf6432a640 1 -- 172.21.15.78:0/3615361513 shutdown_connections 2023-11-28T20:01:59.397 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:59.392+0000 7fcf6432a640 1 -- 172.21.15.78:0/3615361513 wait complete. 2023-11-28T20:01:59.398 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:59.392+0000 7fcf6432a640 1 Processor -- start 2023-11-28T20:01:59.398 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:59.392+0000 7fcf6432a640 1 -- start start 2023-11-28T20:01:59.400 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:59.392+0000 7fcf6432a640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcf5c06d2b0 0x7fcf5c1599f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:59.400 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:59.392+0000 7fcf6432a640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcf5c0c3b80 0x7fcf5c14da90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:59.400 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:59.392+0000 7fcf6432a640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcf5c0c5300 0x7fcf5c1ed670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:59.400 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:59.392+0000 7fcf6432a640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf5c1f1380 con 0x7fcf5c0c5300 2023-11-28T20:01:59.400 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:59.392+0000 7fcf6432a640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf5c1ece90 con 0x7fcf5c06d2b0 2023-11-28T20:01:59.400 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:59.392+0000 7fcf6432a640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf5c155350 con 0x7fcf5c0c3b80 2023-11-28T20:01:59.401 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:59.392+0000 7fcf628c7640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcf5c0c5300 0x7fcf5c1ed670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:59.401 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:59.392+0000 7fcf620c6640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcf5c06d2b0 0x7fcf5c1599f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:59.401 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:59.392+0000 7fcf628c7640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcf5c0c5300 0x7fcf5c1ed670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:44020/0 (socket says 172.21.15.78:44020) 2023-11-28T20:01:59.401 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:59.392+0000 7fcf628c7640 1 -- 172.21.15.78:0/3896875254 learned_addr learned my addr 172.21.15.78:0/3896875254 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T20:01:59.401 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:59.392+0000 7fcf618c5640 1 --2- 172.21.15.78:0/3896875254 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcf5c0c3b80 0x7fcf5c14da90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:59.401 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:59.396+0000 7fcf628c7640 1 -- 172.21.15.78:0/3896875254 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcf5c0c3b80 msgr2=0x7fcf5c14da90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:01:59.401 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:59.396+0000 7fcf628c7640 1 --2- 172.21.15.78:0/3896875254 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcf5c0c3b80 0x7fcf5c14da90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:59.401 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:59.396+0000 7fcf628c7640 1 -- 172.21.15.78:0/3896875254 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcf5c06d2b0 msgr2=0x7fcf5c1599f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:01:59.401 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:59.396+0000 7fcf628c7640 1 --2- 172.21.15.78:0/3896875254 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcf5c06d2b0 0x7fcf5c1599f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:59.401 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:59.396+0000 7fcf628c7640 1 -- 172.21.15.78:0/3896875254 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf5800b770 con 0x7fcf5c0c5300 2023-11-28T20:01:59.401 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:59.396+0000 7fcf620c6640 1 --2- 172.21.15.78:0/3896875254 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcf5c06d2b0 0x7fcf5c1599f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T20:01:59.401 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:59.396+0000 7fcf628c7640 1 --2- 172.21.15.78:0/3896875254 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcf5c0c5300 0x7fcf5c1ed670 secure :-1 s=READY pgs=848 cs=0 l=1 rev1=1 crypto rx=0x7fcf54007cf0 tx=0x7fcf5400e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:01:59.402 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:59.396+0000 7fcf52ffd640 1 -- 172.21.15.78:0/3896875254 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf54014420 con 0x7fcf5c0c5300 2023-11-28T20:01:59.402 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:59.396+0000 7fcf52ffd640 1 -- 172.21.15.78:0/3896875254 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf540145a0 con 0x7fcf5c0c5300 2023-11-28T20:01:59.402 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:59.396+0000 7fcf6432a640 1 -- 172.21.15.78:0/3896875254 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcf5c14ef80 con 0x7fcf5c0c5300 2023-11-28T20:01:59.402 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:59.396+0000 7fcf52ffd640 1 -- 172.21.15.78:0/3896875254 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf54014950 con 0x7fcf5c0c5300 2023-11-28T20:01:59.402 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:59.396+0000 7fcf6432a640 1 -- 172.21.15.78:0/3896875254 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcf5c1ed150 con 0x7fcf5c0c5300 2023-11-28T20:01:59.403 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:59.396+0000 7fcf6432a640 1 -- 172.21.15.78:0/3896875254 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcf5c1ed370 con 0x7fcf5c0c5300 2023-11-28T20:01:59.403 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:59.396+0000 7fcf52ffd640 1 -- 172.21.15.78:0/3896875254 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fcf54014ab0 con 0x7fcf5c0c5300 2023-11-28T20:01:59.403 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:59.396+0000 7fcf52ffd640 1 --2- 172.21.15.78:0/3896875254 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fcf40066470 0x7fcf40068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:59.403 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:59.396+0000 7fcf52ffd640 1 -- 172.21.15.78:0/3896875254 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 5349+0+0 (secure 0 0 0) 0x7fcf54084410 con 0x7fcf5c0c5300 2023-11-28T20:01:59.403 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:59.396+0000 7fcf620c6640 1 --2- 172.21.15.78:0/3896875254 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fcf40066470 0x7fcf40068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:59.403 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:59.400+0000 7fcf620c6640 1 --2- 172.21.15.78:0/3896875254 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fcf40066470 0x7fcf40068930 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7fcf580b1000 tx=0x7fcf580a9070 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:01:59.406 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:59.400+0000 7fcf52ffd640 1 -- 172.21.15.78:0/3896875254 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fcf54051a90 con 0x7fcf5c0c5300 2023-11-28T20:01:59.564 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:59.560+0000 7fcf6432a640 1 -- 172.21.15.78:0/3896875254 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fcf5c067630 con 0x7fcf5c0c5300 2023-11-28T20:01:59.565 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:59.560+0000 7fcf52ffd640 1 -- 172.21.15.78:0/3896875254 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v72) v1 ==== 74+0+13296 (secure 0 0 0) 0x7fcf540550b0 con 0x7fcf5c0c5300 2023-11-28T20:01:59.565 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-11-28T20:01:59.565 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":72,"fsid":"dd9780e8-3bda-44fa-a9f0-fa07d19d901d","created":"2023-11-28T19:58:40.969556+0000","modified":"2023-11-28T20:01:58.221452+0000","last_up_change":"2023-11-28T19:58:52.596716+0000","last_in_change":"2023-11-28T19:58:43.609275+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":12,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-28T19:58:54.011229+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e84245ac-b5da-429e-af18-39acaa2b33e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6800","nonce":3358701235},{"type":"v1","addr":"172.21.15.78:6801","nonce":3358701235}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6802","nonce":3358701235},{"type":"v1","addr":"172.21.15.78:6803","nonce":3358701235}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6806","nonce":3358701235},{"type":"v1","addr":"172.21.15.78:6807","nonce":3358701235}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6804","nonce":3358701235},{"type":"v1","addr":"172.21.15.78:6805","nonce":3358701235}]},"public_addr":"172.21.15.78:6801/3358701235","cluster_addr":"172.21.15.78:6803/3358701235","heartbeat_back_addr":"172.21.15.78:6807/3358701235","heartbeat_front_addr":"172.21.15.78:6805/3358701235","state":["exists","up"]},{"osd":1,"uuid":"e634831d-c4e2-48d9-870c-9556ae162981","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6808","nonce":3211476654},{"type":"v1","addr":"172.21.15.78:6809","nonce":3211476654}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6810","nonce":3211476654},{"type":"v1","addr":"172.21.15.78:6811","nonce":3211476654}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6814","nonce":3211476654},{"type":"v1","addr":"172.21.15.78:6815","nonce":3211476654}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6812","nonce":3211476654},{"type":"v1","addr":"172.21.15.78:6813","nonce":3211476654}]},"public_addr":"172.21.15.78:6809/3211476654","cluster_addr":"172.21.15.78:6811/3211476654","heartbeat_back_addr":"172.21.15.78:6815/3211476654","heartbeat_front_addr":"172.21.15.78:6813/3211476654","state":["exists","up"]},{"osd":2,"uuid":"274c8395-6534-41f0-b8fb-a00af8985aa8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6816","nonce":2532904479},{"type":"v1","addr":"172.21.15.78:6817","nonce":2532904479}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6818","nonce":2532904479},{"type":"v1","addr":"172.21.15.78:6819","nonce":2532904479}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6822","nonce":2532904479},{"type":"v1","addr":"172.21.15.78:6823","nonce":2532904479}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6820","nonce":2532904479},{"type":"v1","addr":"172.21.15.78:6821","nonce":2532904479}]},"public_addr":"172.21.15.78:6817/2532904479","cluster_addr":"172.21.15.78:6819/2532904479","heartbeat_back_addr":"172.21.15.78:6823/2532904479","heartbeat_front_addr":"172.21.15.78:6821/2532904479","state":["exists","up"]},{"osd":3,"uuid":"77acc9af-7d4d-4b18-8cf5-d62f5971b7c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6824","nonce":3442991267},{"type":"v1","addr":"172.21.15.78:6825","nonce":3442991267}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6826","nonce":3442991267},{"type":"v1","addr":"172.21.15.78:6827","nonce":3442991267}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6830","nonce":3442991267},{"type":"v1","addr":"172.21.15.78:6831","nonce":3442991267}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6828","nonce":3442991267},{"type":"v1","addr":"172.21.15.78:6829","nonce":3442991267}]},"public_addr":"172.21.15.78:6825/3442991267","cluster_addr":"172.21.15.78:6827/3442991267","heartbeat_back_addr":"172.21.15.78:6831/3442991267","heartbeat_front_addr":"172.21.15.78:6829/3442991267","state":["exists","up"]},{"osd":4,"uuid":"5c62bc66-6b34-4b7f-a66b-9a743969138c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":802983577},{"type":"v1","addr":"172.21.15.179:6809","nonce":802983577}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":802983577},{"type":"v1","addr":"172.21.15.179:6811","nonce":802983577}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":802983577},{"type":"v1","addr":"172.21.15.179:6815","nonce":802983577}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":802983577},{"type":"v1","addr":"172.21.15.179:6813","nonce":802983577}]},"public_addr":"172.21.15.179:6809/802983577","cluster_addr":"172.21.15.179:6811/802983577","heartbeat_back_addr":"172.21.15.179:6815/802983577","heartbeat_front_addr":"172.21.15.179:6813/802983577","state":["exists","up"]},{"osd":5,"uuid":"67db6d36-f684-4079-b0cd-82b4dd61461f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":518192887},{"type":"v1","addr":"172.21.15.179:6818","nonce":518192887}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":518192887},{"type":"v1","addr":"172.21.15.179:6822","nonce":518192887}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":518192887},{"type":"v1","addr":"172.21.15.179:6829","nonce":518192887}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6824","nonce":518192887},{"type":"v1","addr":"172.21.15.179:6826","nonce":518192887}]},"public_addr":"172.21.15.179:6818/518192887","cluster_addr":"172.21.15.179:6822/518192887","heartbeat_back_addr":"172.21.15.179:6829/518192887","heartbeat_front_addr":"172.21.15.179:6826/518192887","state":["exists","up"]},{"osd":6,"uuid":"12e670af-5a16-4c81-9f97-defa66cab967","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":815435378},{"type":"v1","addr":"172.21.15.179:6801","nonce":815435378}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":815435378},{"type":"v1","addr":"172.21.15.179:6803","nonce":815435378}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":815435378},{"type":"v1","addr":"172.21.15.179:6807","nonce":815435378}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":815435378},{"type":"v1","addr":"172.21.15.179:6805","nonce":815435378}]},"public_addr":"172.21.15.179:6801/815435378","cluster_addr":"172.21.15.179:6803/815435378","heartbeat_back_addr":"172.21.15.179:6807/815435378","heartbeat_front_addr":"172.21.15.179:6805/815435378","state":["exists","up"]},{"osd":7,"uuid":"fe630650-2eb3-49ad-8676-c341e6332eb1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6817","nonce":2848432339},{"type":"v1","addr":"172.21.15.179:6819","nonce":2848432339}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6821","nonce":2848432339},{"type":"v1","addr":"172.21.15.179:6823","nonce":2848432339}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":2848432339},{"type":"v1","addr":"172.21.15.179:6831","nonce":2848432339}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6825","nonce":2848432339},{"type":"v1","addr":"172.21.15.179:6827","nonce":2848432339}]},"public_addr":"172.21.15.179:6819/2848432339","cluster_addr":"172.21.15.179:6823/2848432339","heartbeat_back_addr":"172.21.15.179:6831/2848432339","heartbeat_front_addr":"172.21.15.179:6827/2848432339","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:58:49.255433+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:58:49.412880+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:58:49.559295+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:58:49.245237+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:58:49.184557+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:58:49.329851+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:58:49.366012+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:58:49.349604+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.78:6835/1997036463":"2023-11-29T20:01:55.209512+0000","172.21.15.78:6834/1997036463":"2023-11-29T20:01:55.209512+0000","172.21.15.78:6837/115607035":"2023-11-29T20:01:48.551494+0000","172.21.15.78:6836/115607035":"2023-11-29T20:01:48.551494+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-28T20:01:59.567 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:59.560+0000 7fcf6432a640 1 -- 172.21.15.78:0/3896875254 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fcf40066470 msgr2=0x7fcf40068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:01:59.567 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:59.560+0000 7fcf6432a640 1 --2- 172.21.15.78:0/3896875254 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fcf40066470 0x7fcf40068930 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7fcf580b1000 tx=0x7fcf580a9070 comp rx=0 tx=0).stop 2023-11-28T20:01:59.567 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:59.560+0000 7fcf6432a640 1 -- 172.21.15.78:0/3896875254 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcf5c0c5300 msgr2=0x7fcf5c1ed670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:01:59.567 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:59.560+0000 7fcf6432a640 1 --2- 172.21.15.78:0/3896875254 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcf5c0c5300 0x7fcf5c1ed670 secure :-1 s=READY pgs=848 cs=0 l=1 rev1=1 crypto rx=0x7fcf54007cf0 tx=0x7fcf5400e4b0 comp rx=0 tx=0).stop 2023-11-28T20:01:59.567 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:59.560+0000 7fcf6432a640 1 -- 172.21.15.78:0/3896875254 shutdown_connections 2023-11-28T20:01:59.567 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:59.560+0000 7fcf6432a640 1 --2- 172.21.15.78:0/3896875254 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fcf40066470 0x7fcf40068930 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:59.567 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:59.560+0000 7fcf6432a640 1 --2- 172.21.15.78:0/3896875254 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcf5c0c3b80 0x7fcf5c14da90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:59.567 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:59.560+0000 7fcf6432a640 1 --2- 172.21.15.78:0/3896875254 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcf5c0c5300 0x7fcf5c1ed670 unknown :-1 s=CLOSED pgs=848 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:59.567 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:59.560+0000 7fcf6432a640 1 --2- 172.21.15.78:0/3896875254 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcf5c06d2b0 0x7fcf5c1599f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:59.567 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:59.560+0000 7fcf6432a640 1 -- 172.21.15.78:0/3896875254 >> 172.21.15.78:0/3896875254 conn(0x7fcf5c0a7810 msgr2=0x7fcf5c06c020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:01:59.568 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:59.560+0000 7fcf6432a640 1 -- 172.21.15.78:0/3896875254 shutdown_connections 2023-11-28T20:01:59.568 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:59.560+0000 7fcf6432a640 1 -- 172.21.15.78:0/3896875254 wait complete. 2023-11-28T20:01:59.586 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-28T19:58:54.011229+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-28T20:01:59.587 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-28T20:01:59.727 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:59.720+0000 7f18cb69e640 1 Processor -- start 2023-11-28T20:01:59.728 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:59.724+0000 7f18cb69e640 1 -- start start 2023-11-28T20:01:59.730 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:59.724+0000 7f18cb69e640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f18c414f850 0x7f18c40aacf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:59.730 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:59.724+0000 7f18cb69e640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f18c406d840 0x7f18c40c43e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:59.731 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:59.724+0000 7f18cb69e640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f18c4152910 con 0x7f18c414fc30 2023-11-28T20:01:59.731 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:59.724+0000 7f18cb69e640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f18c40c2240 con 0x7f18c414f850 2023-11-28T20:01:59.731 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:59.724+0000 7f18cb69e640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f18c4152bf0 con 0x7f18c406d840 2023-11-28T20:01:59.731 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:59.724+0000 7f18c943a640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f18c414f850 0x7f18c40aacf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:59.731 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:59.724+0000 7f18c943a640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f18c414f850 0x7f18c40aacf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:44022/0 (socket says 172.21.15.78:44022) 2023-11-28T20:01:59.732 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:59.724+0000 7f18c943a640 1 -- 172.21.15.78:0/3654306308 learned_addr learned my addr 172.21.15.78:0/3654306308 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T20:01:59.732 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:59.724+0000 7f18c9c3b640 1 --2- 172.21.15.78:0/3654306308 >> v2:172.21.15.179:3300/0 conn(0x7f18c406d840 0x7f18c40c43e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:59.732 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:59.724+0000 7f18c943a640 1 -- 172.21.15.78:0/3654306308 >> v2:172.21.15.179:3300/0 conn(0x7f18c406d840 msgr2=0x7f18c40c43e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:01:59.732 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:59.724+0000 7f18c943a640 1 --2- 172.21.15.78:0/3654306308 >> v2:172.21.15.179:3300/0 conn(0x7f18c406d840 0x7f18c40c43e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:59.732 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:59.724+0000 7f18c943a640 1 -- 172.21.15.78:0/3654306308 >> v1:172.21.15.179:6789/0 conn(0x7f18c414fc30 legacy=0x7f18c40c3cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:01:59.732 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:59.724+0000 7f18c943a640 1 -- 172.21.15.78:0/3654306308 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18c4152ed0 con 0x7f18c414f850 2023-11-28T20:01:59.734 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:59.728+0000 7f18c943a640 1 --2- 172.21.15.78:0/3654306308 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f18c414f850 0x7f18c40aacf0 secure :-1 s=READY pgs=849 cs=0 l=1 rev1=1 crypto rx=0x7f18c40c2440 tx=0x7f18c001c500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d4c5c1ce335a1bef server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:01:59.734 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:59.728+0000 7f18bbfff640 1 -- 172.21.15.78:0/3654306308 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18c00aa680 con 0x7f18c414f850 2023-11-28T20:01:59.734 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:59.728+0000 7f18bbfff640 1 -- 172.21.15.78:0/3654306308 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f18c00aa7e0 con 0x7f18c414f850 2023-11-28T20:01:59.734 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:59.728+0000 7f18bbfff640 1 -- 172.21.15.78:0/3654306308 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18c00aab70 con 0x7f18c414f850 2023-11-28T20:01:59.734 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:59.728+0000 7f18cb69e640 1 -- 172.21.15.78:0/3654306308 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f18c414f850 msgr2=0x7f18c40aacf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:01:59.734 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:59.728+0000 7f18cb69e640 1 --2- 172.21.15.78:0/3654306308 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f18c414f850 0x7f18c40aacf0 secure :-1 s=READY pgs=849 cs=0 l=1 rev1=1 crypto rx=0x7f18c40c2440 tx=0x7f18c001c500 comp rx=0 tx=0).stop 2023-11-28T20:01:59.734 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:59.728+0000 7f18cb69e640 1 -- 172.21.15.78:0/3654306308 shutdown_connections 2023-11-28T20:01:59.735 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:59.728+0000 7f18cb69e640 1 --2- 172.21.15.78:0/3654306308 >> v2:172.21.15.179:3300/0 conn(0x7f18c406d840 0x7f18c40c43e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:59.735 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:59.728+0000 7f18cb69e640 1 --2- 172.21.15.78:0/3654306308 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f18c414f850 0x7f18c40aacf0 unknown :-1 s=CLOSED pgs=849 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:59.735 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:59.728+0000 7f18cb69e640 1 -- 172.21.15.78:0/3654306308 >> 172.21.15.78:0/3654306308 conn(0x7f18c40c59f0 msgr2=0x7f18c40c5e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:01:59.735 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:59.728+0000 7f18cb69e640 1 -- 172.21.15.78:0/3654306308 shutdown_connections 2023-11-28T20:01:59.735 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:59.728+0000 7f18cb69e640 1 -- 172.21.15.78:0/3654306308 wait complete. 2023-11-28T20:01:59.737 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:59.728+0000 7f18cb69e640 1 Processor -- start 2023-11-28T20:01:59.738 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:59.728+0000 7f18cb69e640 1 -- start start 2023-11-28T20:01:59.738 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:59.732+0000 7f18cb69e640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f18c406d840 0x7f18c4072300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:59.738 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:59.732+0000 7f18cb69e640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f18c414f850 0x7f18c40a5af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:59.738 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:59.732+0000 7f18cb69e640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f18c414fc30 0x7f18c40a6030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:59.738 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:59.732+0000 7f18cb69e640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18c406fac0 con 0x7f18c406d840 2023-11-28T20:01:59.738 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:59.732+0000 7f18cb69e640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18c4070a90 con 0x7f18c414fc30 2023-11-28T20:01:59.738 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:59.732+0000 7f18cb69e640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18c4070460 con 0x7f18c414f850 2023-11-28T20:01:59.738 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:59.732+0000 7f18c943a640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f18c406d840 0x7f18c4072300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:59.738 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:59.732+0000 7f18c943a640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f18c406d840 0x7f18c4072300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:44028/0 (socket says 172.21.15.78:44028) 2023-11-28T20:01:59.738 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:59.732+0000 7f18c943a640 1 -- 172.21.15.78:0/3698075074 learned_addr learned my addr 172.21.15.78:0/3698075074 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T20:01:59.739 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:59.732+0000 7f18c8c39640 1 --2- 172.21.15.78:0/3698075074 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f18c414f850 0x7f18c40a5af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:59.739 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:59.732+0000 7f18c9c3b640 1 --2- 172.21.15.78:0/3698075074 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f18c414fc30 0x7f18c40a6030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:59.739 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:59.732+0000 7f18c943a640 1 -- 172.21.15.78:0/3698075074 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f18c414f850 msgr2=0x7f18c40a5af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:01:59.739 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:59.732+0000 7f18c943a640 1 --2- 172.21.15.78:0/3698075074 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f18c414f850 0x7f18c40a5af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:59.739 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:59.732+0000 7f18c943a640 1 -- 172.21.15.78:0/3698075074 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f18c414fc30 msgr2=0x7f18c40a6030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:01:59.739 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:59.732+0000 7f18c943a640 1 --2- 172.21.15.78:0/3698075074 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f18c414fc30 0x7f18c40a6030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:59.739 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:59.732+0000 7f18c943a640 1 -- 172.21.15.78:0/3698075074 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18c00094d0 con 0x7f18c406d840 2023-11-28T20:01:59.739 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:59.732+0000 7f18c8c39640 1 --2- 172.21.15.78:0/3698075074 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f18c414f850 0x7f18c40a5af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T20:01:59.739 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:59.732+0000 7f18c943a640 1 --2- 172.21.15.78:0/3698075074 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f18c406d840 0x7f18c4072300 secure :-1 s=READY pgs=850 cs=0 l=1 rev1=1 crypto rx=0x7f18c00ac040 tx=0x7f18c001ad40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:01:59.739 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:59.732+0000 7f18b9ffb640 1 -- 172.21.15.78:0/3698075074 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18c00b3800 con 0x7f18c406d840 2023-11-28T20:01:59.739 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:59.732+0000 7f18b9ffb640 1 -- 172.21.15.78:0/3698075074 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f18c00b3960 con 0x7f18c406d840 2023-11-28T20:01:59.740 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:59.732+0000 7f18b9ffb640 1 -- 172.21.15.78:0/3698075074 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18c00b3cd0 con 0x7f18c406d840 2023-11-28T20:01:59.740 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:59.732+0000 7f18cb69e640 1 -- 172.21.15.78:0/3698075074 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f18c406fd10 con 0x7f18c406d840 2023-11-28T20:01:59.740 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:59.732+0000 7f18cb69e640 1 -- 172.21.15.78:0/3698075074 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f18c4070720 con 0x7f18c406d840 2023-11-28T20:01:59.741 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:59.732+0000 7f18cb69e640 1 -- 172.21.15.78:0/3698075074 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f18c4067630 con 0x7f18c406d840 2023-11-28T20:01:59.741 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:59.736+0000 7f18b9ffb640 1 -- 172.21.15.78:0/3698075074 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f18c00b2380 con 0x7f18c406d840 2023-11-28T20:01:59.741 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:59.736+0000 7f18b9ffb640 1 --2- 172.21.15.78:0/3698075074 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f18a80664a0 0x7f18a8068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:01:59.741 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:59.736+0000 7f18b9ffb640 1 -- 172.21.15.78:0/3698075074 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 5349+0+0 (secure 0 0 0) 0x7f18c011e150 con 0x7f18c406d840 2023-11-28T20:01:59.741 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:59.736+0000 7f18c8c39640 1 --2- 172.21.15.78:0/3698075074 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f18a80664a0 0x7f18a8068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:01:59.741 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:59.736+0000 7f18c8c39640 1 --2- 172.21.15.78:0/3698075074 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f18a80664a0 0x7f18a8068960 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f18c4148da0 tx=0x7f18b4009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:01:59.744 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:59.740+0000 7f18b9ffb640 1 -- 172.21.15.78:0/3698075074 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f18c00eb900 con 0x7f18c406d840 2023-11-28T20:01:59.897 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:59.892+0000 7f18cb69e640 1 -- 172.21.15.78:0/3698075074 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f18c40a4a90 con 0x7f18c406d840 2023-11-28T20:01:59.898 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:59.892+0000 7f18b9ffb640 1 -- 172.21.15.78:0/3698075074 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v72) v1 ==== 93+0+10 (secure 0 0 0) 0x7f18c00eef20 con 0x7f18c406d840 2023-11-28T20:01:59.898 INFO:teuthology.orchestra.run.smithi078.stdout:pg_num: 1 2023-11-28T20:01:59.900 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:59.896+0000 7f18cb69e640 1 -- 172.21.15.78:0/3698075074 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f18a80664a0 msgr2=0x7f18a8068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:01:59.901 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:59.896+0000 7f18cb69e640 1 --2- 172.21.15.78:0/3698075074 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f18a80664a0 0x7f18a8068960 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f18c4148da0 tx=0x7f18b4009040 comp rx=0 tx=0).stop 2023-11-28T20:01:59.901 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:59.896+0000 7f18cb69e640 1 -- 172.21.15.78:0/3698075074 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f18c406d840 msgr2=0x7f18c4072300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:01:59.901 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:59.896+0000 7f18cb69e640 1 --2- 172.21.15.78:0/3698075074 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f18c406d840 0x7f18c4072300 secure :-1 s=READY pgs=850 cs=0 l=1 rev1=1 crypto rx=0x7f18c00ac040 tx=0x7f18c001ad40 comp rx=0 tx=0).stop 2023-11-28T20:01:59.901 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:59.896+0000 7f18cb69e640 1 -- 172.21.15.78:0/3698075074 shutdown_connections 2023-11-28T20:01:59.901 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:59.896+0000 7f18cb69e640 1 --2- 172.21.15.78:0/3698075074 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f18a80664a0 0x7f18a8068960 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:59.901 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:59.896+0000 7f18cb69e640 1 --2- 172.21.15.78:0/3698075074 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f18c414f850 0x7f18c40a5af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:59.902 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:59.896+0000 7f18cb69e640 1 --2- 172.21.15.78:0/3698075074 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f18c414fc30 0x7f18c40a6030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:59.902 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:59.896+0000 7f18cb69e640 1 --2- 172.21.15.78:0/3698075074 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f18c406d840 0x7f18c4072300 unknown :-1 s=CLOSED pgs=850 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:01:59.902 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:59.896+0000 7f18cb69e640 1 -- 172.21.15.78:0/3698075074 >> 172.21.15.78:0/3698075074 conn(0x7f18c40c59f0 msgr2=0x7f18c41518c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:01:59.902 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:59.896+0000 7f18cb69e640 1 -- 172.21.15.78:0/3698075074 shutdown_connections 2023-11-28T20:01:59.902 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:01:59.896+0000 7f18cb69e640 1 -- 172.21.15.78:0/3698075074 wait complete. 2023-11-28T20:01:59.919 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_multifs_auth.TestMDSCaps.test_r_with_fsname_and_no_path_in_cap' 2023-11-28T20:02:00.056 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:00.052+0000 7fdd3f957640 1 Processor -- start 2023-11-28T20:02:00.057 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:00.052+0000 7fdd3f957640 1 -- start start 2023-11-28T20:02:00.058 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:00.052+0000 7fdd3f957640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdd380c3b80 0x7fdd3806d690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:00.058 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:00.052+0000 7fdd3f957640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fdd380c5300 0x7fdd3806c730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:00.058 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:00.052+0000 7fdd3f957640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdd3806bb80 con 0x7fdd3806d2b0 2023-11-28T20:02:00.058 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:00.052+0000 7fdd3f957640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdd3806cc70 con 0x7fdd380c5300 2023-11-28T20:02:00.058 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:00.052+0000 7fdd3f957640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdd380c5790 con 0x7fdd380c3b80 2023-11-28T20:02:00.058 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:00.052+0000 7fdd3d6f3640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7fdd3806d2b0 0x7fdd3806c020 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:54776/0 (socket says 172.21.15.78:54776) 2023-11-28T20:02:00.058 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:00.052+0000 7fdd3d6f3640 1 -- 172.21.15.78:0/1797798361 learned_addr learned my addr 172.21.15.78:0/1797798361 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-11-28T20:02:00.060 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:00.052+0000 7fdd2ffff640 1 -- 172.21.15.78:0/1797798361 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2678516548 0 0) 0x7fdd3806bb80 con 0x7fdd3806d2b0 2023-11-28T20:02:00.060 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:00.052+0000 7fdd2ffff640 1 -- 172.21.15.78:0/1797798361 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdd24003530 con 0x7fdd3806d2b0 2023-11-28T20:02:00.060 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:00.052+0000 7fdd3cef2640 1 --2- 172.21.15.78:0/1797798361 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdd380c3b80 0x7fdd3806d690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:02:00.060 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:00.052+0000 7fdd3def4640 1 --2- 172.21.15.78:0/1797798361 >> v2:172.21.15.179:3300/0 conn(0x7fdd380c5300 0x7fdd3806c730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:02:00.060 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:00.052+0000 7fdd2ffff640 1 -- 172.21.15.78:0/1797798361 <== mon.0 v1:172.21.15.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1077530804 0 0) 0x7fdd24003530 con 0x7fdd3806d2b0 2023-11-28T20:02:00.061 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:00.052+0000 7fdd2ffff640 1 -- 172.21.15.78:0/1797798361 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdd380c3b80 msgr2=0x7fdd3806d690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:02:00.061 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:00.052+0000 7fdd2ffff640 1 --2- 172.21.15.78:0/1797798361 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdd380c3b80 0x7fdd3806d690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:00.061 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:00.052+0000 7fdd2ffff640 1 -- 172.21.15.78:0/1797798361 >> v2:172.21.15.179:3300/0 conn(0x7fdd380c5300 msgr2=0x7fdd3806c730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:02:00.061 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:00.052+0000 7fdd2ffff640 1 --2- 172.21.15.78:0/1797798361 >> v2:172.21.15.179:3300/0 conn(0x7fdd380c5300 0x7fdd3806c730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:00.061 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:00.052+0000 7fdd2ffff640 1 -- 172.21.15.78:0/1797798361 --> v1:172.21.15.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd381515c0 con 0x7fdd3806d2b0 2023-11-28T20:02:00.061 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:00.052+0000 7fdd2ffff640 1 -- 172.21.15.78:0/1797798361 <== mon.0 v1:172.21.15.78:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3326804700 0 0) 0x7fdd34001680 con 0x7fdd3806d2b0 2023-11-28T20:02:00.061 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:00.052+0000 7fdd2ffff640 1 -- 172.21.15.78:0/1797798361 >> v1:172.21.15.78:6789/0 conn(0x7fdd3806d2b0 legacy=0x7fdd3806c020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:02:00.061 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:00.052+0000 7fdd2ffff640 1 --2- 172.21.15.78:0/1797798361 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdd24003980 0x7fdd24003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:00.061 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:00.052+0000 7fdd2ffff640 1 --2- 172.21.15.78:0/1797798361 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdd240047d0 0x7fdd24004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:00.061 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:00.052+0000 7fdd2ffff640 1 --2- 172.21.15.78:0/1797798361 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdd24005190 0x7fdd2400b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:00.061 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:00.052+0000 7fdd2ffff640 1 -- 172.21.15.78:0/1797798361 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd3806cc70 con 0x7fdd240047d0 2023-11-28T20:02:00.062 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:00.052+0000 7fdd2ffff640 1 -- 172.21.15.78:0/1797798361 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd380c5790 con 0x7fdd24005190 2023-11-28T20:02:00.062 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:00.052+0000 7fdd2ffff640 1 -- 172.21.15.78:0/1797798361 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdd2400c030 con 0x7fdd24003980 2023-11-28T20:02:00.062 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:00.052+0000 7fdd3cef2640 1 --2- 172.21.15.78:0/1797798361 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdd240047d0 0x7fdd24004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:02:00.062 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:00.056+0000 7fdd3d6f3640 1 --2- 172.21.15.78:0/1797798361 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdd24003980 0x7fdd24003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:02:00.062 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:00.056+0000 7fdd3def4640 1 --2- 172.21.15.78:0/1797798361 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdd24005190 0x7fdd2400b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:02:00.062 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:00.056+0000 7fdd3cef2640 1 -- 172.21.15.78:0/1797798361 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdd24003980 msgr2=0x7fdd24003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:02:00.062 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:00.056+0000 7fdd3cef2640 1 --2- 172.21.15.78:0/1797798361 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdd24003980 0x7fdd24003da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:00.062 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:00.056+0000 7fdd3cef2640 1 -- 172.21.15.78:0/1797798361 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdd24005190 msgr2=0x7fdd2400b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:02:00.062 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:00.056+0000 7fdd3cef2640 1 --2- 172.21.15.78:0/1797798361 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdd24005190 0x7fdd2400b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:00.062 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:00.056+0000 7fdd3cef2640 1 -- 172.21.15.78:0/1797798361 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd24003530 con 0x7fdd240047d0 2023-11-28T20:02:00.064 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:00.056+0000 7fdd3cef2640 1 --2- 172.21.15.78:0/1797798361 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdd240047d0 0x7fdd24004c50 secure :-1 s=READY pgs=852 cs=0 l=1 rev1=1 crypto rx=0x7fdd3806f630 tx=0x7fdd2801c530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=27bfb99c1967272a server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:02:00.064 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:00.056+0000 7fdd2ffff640 1 -- 172.21.15.78:0/1797798361 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd280ad640 con 0x7fdd240047d0 2023-11-28T20:02:00.064 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:00.056+0000 7fdd2ffff640 1 -- 172.21.15.78:0/1797798361 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd280ad7a0 con 0x7fdd240047d0 2023-11-28T20:02:00.064 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:00.056+0000 7fdd2ffff640 1 -- 172.21.15.78:0/1797798361 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd280adb30 con 0x7fdd240047d0 2023-11-28T20:02:00.064 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:00.056+0000 7fdd3f957640 1 -- 172.21.15.78:0/1797798361 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdd240047d0 msgr2=0x7fdd24004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:02:00.064 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:00.056+0000 7fdd3f957640 1 --2- 172.21.15.78:0/1797798361 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdd240047d0 0x7fdd24004c50 secure :-1 s=READY pgs=852 cs=0 l=1 rev1=1 crypto rx=0x7fdd3806f630 tx=0x7fdd2801c530 comp rx=0 tx=0).stop 2023-11-28T20:02:00.064 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:00.056+0000 7fdd3def4640 1 -- 172.21.15.78:0/1797798361 reap_dead start 2023-11-28T20:02:00.065 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:00.060+0000 7fdd3f957640 1 -- 172.21.15.78:0/1797798361 shutdown_connections 2023-11-28T20:02:00.065 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:00.060+0000 7fdd3f957640 1 -- 172.21.15.78:0/1797798361 >> 172.21.15.78:0/1797798361 conn(0x7fdd380a7810 msgr2=0x7fdd380a7c20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:02:00.065 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:00.060+0000 7fdd3f957640 1 -- 172.21.15.78:0/1797798361 shutdown_connections 2023-11-28T20:02:00.065 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:00.060+0000 7fdd3f957640 1 -- 172.21.15.78:0/1797798361 wait complete. 2023-11-28T20:02:00.065 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:00.060+0000 7fdd3f957640 1 Processor -- start 2023-11-28T20:02:00.065 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:00.060+0000 7fdd3f957640 1 -- start start 2023-11-28T20:02:00.067 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:00.060+0000 7fdd3f957640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdd240047d0 0x7fdd380bf0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:00.067 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:00.060+0000 7fdd3f957640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdd380a87d0 0x7fdd38154cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:00.067 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:00.060+0000 7fdd3f957640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdd38155230 0x7fdd381ed670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:00.067 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:00.060+0000 7fdd3f957640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd381556e0 con 0x7fdd240047d0 2023-11-28T20:02:00.067 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:00.060+0000 7fdd3f957640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd381eb0a0 con 0x7fdd38155230 2023-11-28T20:02:00.068 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:00.060+0000 7fdd3f957640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdd380a9fb0 con 0x7fdd380a87d0 2023-11-28T20:02:00.068 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:00.060+0000 7fdd3d6f3640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdd240047d0 0x7fdd380bf0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:02:00.068 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:00.060+0000 7fdd3d6f3640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdd240047d0 0x7fdd380bf0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:44040/0 (socket says 172.21.15.78:44040) 2023-11-28T20:02:00.068 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:00.060+0000 7fdd3d6f3640 1 -- 172.21.15.78:0/2730473329 learned_addr learned my addr 172.21.15.78:0/2730473329 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T20:02:00.068 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:00.060+0000 7fdd3d6f3640 1 -- 172.21.15.78:0/2730473329 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdd380a87d0 msgr2=0x7fdd38154cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:02:00.068 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:00.060+0000 7fdd3d6f3640 1 --2- 172.21.15.78:0/2730473329 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdd380a87d0 0x7fdd38154cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:00.068 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:00.060+0000 7fdd3d6f3640 1 -- 172.21.15.78:0/2730473329 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdd38155230 msgr2=0x7fdd381ed670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:02:00.068 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:00.060+0000 7fdd3d6f3640 1 --2- 172.21.15.78:0/2730473329 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdd38155230 0x7fdd381ed670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:00.068 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:00.060+0000 7fdd3d6f3640 1 -- 172.21.15.78:0/2730473329 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd380a9b90 con 0x7fdd240047d0 2023-11-28T20:02:00.068 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:00.060+0000 7fdd3d6f3640 1 --2- 172.21.15.78:0/2730473329 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdd240047d0 0x7fdd380bf0f0 secure :-1 s=READY pgs=853 cs=0 l=1 rev1=1 crypto rx=0x7fdd34011980 tx=0x7fdd34011e40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:02:00.068 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:00.064+0000 7fdd2dffb640 1 -- 172.21.15.78:0/2730473329 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd3400fc20 con 0x7fdd240047d0 2023-11-28T20:02:00.069 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:00.064+0000 7fdd2dffb640 1 -- 172.21.15.78:0/2730473329 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd3400fd80 con 0x7fdd240047d0 2023-11-28T20:02:00.069 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:00.064+0000 7fdd2dffb640 1 -- 172.21.15.78:0/2730473329 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd34015650 con 0x7fdd240047d0 2023-11-28T20:02:00.069 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:00.064+0000 7fdd3f957640 1 -- 172.21.15.78:0/2730473329 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdd380aa1e0 con 0x7fdd240047d0 2023-11-28T20:02:00.069 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:00.064+0000 7fdd3f957640 1 -- 172.21.15.78:0/2730473329 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdd380aa480 con 0x7fdd240047d0 2023-11-28T20:02:00.069 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:00.064+0000 7fdd3f957640 1 -- 172.21.15.78:0/2730473329 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdd38067630 con 0x7fdd240047d0 2023-11-28T20:02:00.069 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:00.064+0000 7fdd2dffb640 1 -- 172.21.15.78:0/2730473329 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fdd340157b0 con 0x7fdd240047d0 2023-11-28T20:02:00.070 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:00.064+0000 7fdd2dffb640 1 --2- 172.21.15.78:0/2730473329 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fdd1c066460 0x7fdd1c068920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:00.071 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:00.064+0000 7fdd2dffb640 1 -- 172.21.15.78:0/2730473329 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 5349+0+0 (secure 0 0 0) 0x7fdd340871f0 con 0x7fdd240047d0 2023-11-28T20:02:00.071 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:00.064+0000 7fdd3cef2640 1 --2- 172.21.15.78:0/2730473329 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fdd1c066460 0x7fdd1c068920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:02:00.071 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:00.068+0000 7fdd3cef2640 1 --2- 172.21.15.78:0/2730473329 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fdd1c066460 0x7fdd1c068920 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7fdd280af000 tx=0x7fdd28004740 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:02:00.074 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:00.068+0000 7fdd2dffb640 1 -- 172.21.15.78:0/2730473329 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fdd34054730 con 0x7fdd240047d0 2023-11-28T20:02:00.279 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:00.272+0000 7fdd3f957640 1 -- 172.21.15.78:0/2730473329 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_multifs_auth.TestMDSCaps.test_r_with_fsname_and_no_path_in_cap"]} v 0) v1 -- 0x7fdd3806bd70 con 0x7fdd240047d0 2023-11-28T20:02:01.244 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:01.240+0000 7fdd2dffb640 1 -- 172.21.15.78:0/2730473329 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_multifs_auth.TestMDSCaps.test_r_with_fsname_and_no_path_in_cap"]}]=0 v189) v1 ==== 162+0+0 (secure 0 0 0) 0x7fdd34001700 con 0x7fdd240047d0 2023-11-28T20:02:01.250 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:01.240+0000 7fdd3f957640 1 -- 172.21.15.78:0/2730473329 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fdd1c066460 msgr2=0x7fdd1c068920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:02:01.250 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:01.240+0000 7fdd3f957640 1 --2- 172.21.15.78:0/2730473329 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fdd1c066460 0x7fdd1c068920 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7fdd280af000 tx=0x7fdd28004740 comp rx=0 tx=0).stop 2023-11-28T20:02:01.250 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:01.240+0000 7fdd3f957640 1 -- 172.21.15.78:0/2730473329 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdd240047d0 msgr2=0x7fdd380bf0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:02:01.250 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:01.240+0000 7fdd3f957640 1 --2- 172.21.15.78:0/2730473329 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdd240047d0 0x7fdd380bf0f0 secure :-1 s=READY pgs=853 cs=0 l=1 rev1=1 crypto rx=0x7fdd34011980 tx=0x7fdd34011e40 comp rx=0 tx=0).stop 2023-11-28T20:02:01.250 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:01.244+0000 7fdd3f957640 1 -- 172.21.15.78:0/2730473329 shutdown_connections 2023-11-28T20:02:01.250 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:01.244+0000 7fdd3f957640 1 --2- 172.21.15.78:0/2730473329 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fdd1c066460 0x7fdd1c068920 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:01.250 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:01.244+0000 7fdd3f957640 1 --2- 172.21.15.78:0/2730473329 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdd380a87d0 0x7fdd38154cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:01.251 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:01.244+0000 7fdd3f957640 1 --2- 172.21.15.78:0/2730473329 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdd38155230 0x7fdd381ed670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:01.251 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:01.244+0000 7fdd3f957640 1 --2- 172.21.15.78:0/2730473329 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdd240047d0 0x7fdd380bf0f0 unknown :-1 s=CLOSED pgs=853 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:01.251 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:01.244+0000 7fdd3f957640 1 -- 172.21.15.78:0/2730473329 >> 172.21.15.78:0/2730473329 conn(0x7fdd380a7810 msgr2=0x7fdd380a7c20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:02:01.251 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:01.244+0000 7fdd3f957640 1 -- 172.21.15.78:0/2730473329 shutdown_connections 2023-11-28T20:02:01.251 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:01.244+0000 7fdd3f957640 1 -- 172.21.15.78:0/2730473329 wait complete. 2023-11-28T20:02:01.270 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-11-28T20:02:01.414 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:01.408+0000 7f0a3cc5f640 1 Processor -- start 2023-11-28T20:02:01.414 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:01.408+0000 7f0a3cc5f640 1 -- start start 2023-11-28T20:02:01.417 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:01.408+0000 7f0a3cc5f640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f0a381516a0 0x7f0a3806bc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:01.417 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:01.408+0000 7f0a3cc5f640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f0a3806c1c0 0x7f0a380c38f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:01.417 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:01.408+0000 7f0a3cc5f640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0a38151210 con 0x7f0a3814e2a0 2023-11-28T20:02:01.418 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:01.408+0000 7f0a3cc5f640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0a38151b50 con 0x7f0a381516a0 2023-11-28T20:02:01.418 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:01.408+0000 7f0a3cc5f640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0a3814e680 con 0x7f0a3806c1c0 2023-11-28T20:02:01.418 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:01.412+0000 7f0a2dd9b640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f0a381516a0 0x7f0a3806bc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:02:01.418 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:01.412+0000 7f0a2dd9b640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f0a381516a0 0x7f0a3806bc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:44046/0 (socket says 172.21.15.78:44046) 2023-11-28T20:02:01.418 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:01.412+0000 7f0a2dd9b640 1 -- 172.21.15.78:0/3348259428 learned_addr learned my addr 172.21.15.78:0/3348259428 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T20:02:01.418 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:01.412+0000 7f0a36d9d640 1 --2- 172.21.15.78:0/3348259428 >> v2:172.21.15.179:3300/0 conn(0x7f0a3806c1c0 0x7f0a380c38f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:02:01.419 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:01.412+0000 7f0a2dd9b640 1 -- 172.21.15.78:0/3348259428 >> v2:172.21.15.179:3300/0 conn(0x7f0a3806c1c0 msgr2=0x7f0a380c38f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:02:01.419 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:01.412+0000 7f0a2dd9b640 1 --2- 172.21.15.78:0/3348259428 >> v2:172.21.15.179:3300/0 conn(0x7f0a3806c1c0 0x7f0a380c38f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:01.419 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:01.412+0000 7f0a2dd9b640 1 -- 172.21.15.78:0/3348259428 >> v1:172.21.15.179:6789/0 conn(0x7f0a3814e2a0 legacy=0x7f0a380a9460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:02:01.419 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:01.412+0000 7f0a2dd9b640 1 -- 172.21.15.78:0/3348259428 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a380a9b70 con 0x7f0a381516a0 2023-11-28T20:02:01.420 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:01.412+0000 7f0a2dd9b640 1 --2- 172.21.15.78:0/3348259428 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0a381516a0 0x7f0a3806bc80 secure :-1 s=READY pgs=854 cs=0 l=1 rev1=1 crypto rx=0x7f0a380c2420 tx=0x7f0a2801c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a0c7de46c08705fd server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:02:01.420 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:01.412+0000 7f0a35d9b640 1 -- 172.21.15.78:0/3348259428 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a280ad680 con 0x7f0a381516a0 2023-11-28T20:02:01.420 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:01.412+0000 7f0a35d9b640 1 -- 172.21.15.78:0/3348259428 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a280ad7e0 con 0x7f0a381516a0 2023-11-28T20:02:01.420 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:01.416+0000 7f0a35d9b640 1 -- 172.21.15.78:0/3348259428 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a280adb70 con 0x7f0a381516a0 2023-11-28T20:02:01.420 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:01.416+0000 7f0a3cc5f640 1 -- 172.21.15.78:0/3348259428 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0a381516a0 msgr2=0x7f0a3806bc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:02:01.421 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:01.416+0000 7f0a3cc5f640 1 --2- 172.21.15.78:0/3348259428 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0a381516a0 0x7f0a3806bc80 secure :-1 s=READY pgs=854 cs=0 l=1 rev1=1 crypto rx=0x7f0a380c2420 tx=0x7f0a2801c470 comp rx=0 tx=0).stop 2023-11-28T20:02:01.421 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:01.416+0000 7f0a3cc5f640 1 -- 172.21.15.78:0/3348259428 shutdown_connections 2023-11-28T20:02:01.421 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:01.416+0000 7f0a3cc5f640 1 --2- 172.21.15.78:0/3348259428 >> v2:172.21.15.179:3300/0 conn(0x7f0a3806c1c0 0x7f0a380c38f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:01.421 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:01.416+0000 7f0a3cc5f640 1 --2- 172.21.15.78:0/3348259428 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0a381516a0 0x7f0a3806bc80 unknown :-1 s=CLOSED pgs=854 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:01.421 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:01.416+0000 7f0a3cc5f640 1 -- 172.21.15.78:0/3348259428 >> 172.21.15.78:0/3348259428 conn(0x7f0a380c59f0 msgr2=0x7f0a380c5e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:02:01.421 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:01.416+0000 7f0a3cc5f640 1 -- 172.21.15.78:0/3348259428 shutdown_connections 2023-11-28T20:02:01.421 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:01.416+0000 7f0a3cc5f640 1 -- 172.21.15.78:0/3348259428 wait complete. 2023-11-28T20:02:01.421 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:01.416+0000 7f0a3cc5f640 1 Processor -- start 2023-11-28T20:02:01.422 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:01.416+0000 7f0a3cc5f640 1 -- start start 2023-11-28T20:02:01.426 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:01.416+0000 7f0a3cc5f640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0a3806c1c0 0x7f0a3806fe00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:01.426 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:01.416+0000 7f0a3cc5f640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0a3814e2a0 0x7f0a381ecde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:01.426 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:01.416+0000 7f0a3cc5f640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0a381516a0 0x7f0a381ed320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:01.426 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:01.416+0000 7f0a3cc5f640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a38071b20 con 0x7f0a3814e2a0 2023-11-28T20:02:01.426 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:01.416+0000 7f0a3cc5f640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a38071e00 con 0x7f0a381516a0 2023-11-28T20:02:01.426 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:01.416+0000 7f0a3cc5f640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a380720e0 con 0x7f0a3806c1c0 2023-11-28T20:02:01.426 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:01.416+0000 7f0a2dd9b640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0a3814e2a0 0x7f0a381ecde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:02:01.426 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:01.416+0000 7f0a2dd9b640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0a3814e2a0 0x7f0a381ecde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:44060/0 (socket says 172.21.15.78:44060) 2023-11-28T20:02:01.427 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:01.416+0000 7f0a2dd9b640 1 -- 172.21.15.78:0/3858625469 learned_addr learned my addr 172.21.15.78:0/3858625469 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T20:02:01.427 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:01.416+0000 7f0a3659c640 1 --2- 172.21.15.78:0/3858625469 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0a3806c1c0 0x7f0a3806fe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:02:01.427 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:01.416+0000 7f0a36d9d640 1 --2- 172.21.15.78:0/3858625469 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0a381516a0 0x7f0a381ed320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:02:01.427 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:01.420+0000 7f0a2dd9b640 1 -- 172.21.15.78:0/3858625469 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0a3806c1c0 msgr2=0x7f0a3806fe00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:02:01.427 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:01.420+0000 7f0a2dd9b640 1 --2- 172.21.15.78:0/3858625469 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0a3806c1c0 0x7f0a3806fe00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:01.427 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:01.420+0000 7f0a2dd9b640 1 -- 172.21.15.78:0/3858625469 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0a381516a0 msgr2=0x7f0a381ed320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:02:01.427 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:01.420+0000 7f0a2dd9b640 1 --2- 172.21.15.78:0/3858625469 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0a381516a0 0x7f0a381ed320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:01.427 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:01.420+0000 7f0a2dd9b640 1 -- 172.21.15.78:0/3858625469 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a280094d0 con 0x7f0a3814e2a0 2023-11-28T20:02:01.427 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:01.420+0000 7f0a2dd9b640 1 --2- 172.21.15.78:0/3858625469 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0a3814e2a0 0x7f0a381ecde0 secure :-1 s=READY pgs=855 cs=0 l=1 rev1=1 crypto rx=0x7f0a2801a0a0 tx=0x7f0a28019210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:02:01.427 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:01.420+0000 7f0a2f7fe640 1 -- 172.21.15.78:0/3858625469 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a280b8620 con 0x7f0a3814e2a0 2023-11-28T20:02:01.427 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:01.420+0000 7f0a2f7fe640 1 -- 172.21.15.78:0/3858625469 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a280b8780 con 0x7f0a3814e2a0 2023-11-28T20:02:01.428 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:01.420+0000 7f0a3cc5f640 1 -- 172.21.15.78:0/3858625469 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0a380723c0 con 0x7f0a3814e2a0 2023-11-28T20:02:01.428 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:01.420+0000 7f0a2f7fe640 1 -- 172.21.15.78:0/3858625469 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a280b8b30 con 0x7f0a3814e2a0 2023-11-28T20:02:01.428 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:01.420+0000 7f0a3cc5f640 1 -- 172.21.15.78:0/3858625469 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0a38070340 con 0x7f0a3814e2a0 2023-11-28T20:02:01.428 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:01.420+0000 7f0a3cc5f640 1 -- 172.21.15.78:0/3858625469 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0a38067630 con 0x7f0a3814e2a0 2023-11-28T20:02:01.428 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:01.420+0000 7f0a2f7fe640 1 -- 172.21.15.78:0/3858625469 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f0a280b4040 con 0x7f0a3814e2a0 2023-11-28T20:02:01.429 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:01.420+0000 7f0a2f7fe640 1 --2- 172.21.15.78:0/3858625469 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f0a180664a0 0x7f0a18068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:01.429 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:01.420+0000 7f0a2f7fe640 1 -- 172.21.15.78:0/3858625469 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 5349+0+0 (secure 0 0 0) 0x7f0a2811e260 con 0x7f0a3814e2a0 2023-11-28T20:02:01.429 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:01.424+0000 7f0a3659c640 1 --2- 172.21.15.78:0/3858625469 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f0a180664a0 0x7f0a18068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:02:01.429 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:01.424+0000 7f0a3659c640 1 --2- 172.21.15.78:0/3858625469 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f0a180664a0 0x7f0a18068960 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f0a3814dc10 tx=0x7f0a20009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:02:01.431 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:01.424+0000 7f0a2f7fe640 1 -- 172.21.15.78:0/3858625469 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f0a280eba00 con 0x7f0a3814e2a0 2023-11-28T20:02:01.580 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:01.576+0000 7f0a3cc5f640 1 -- 172.21.15.78:0/3858625469 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f0a380c5100 con 0x7f0a3814e2a0 2023-11-28T20:02:01.586 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:01.580+0000 7f0a2f7fe640 1 -- 172.21.15.78:0/3858625469 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v14)=0 v14) v1 ==== 122+0+0 (secure 0 0 0) 0x7f0a280ef020 con 0x7f0a3814e2a0 2023-11-28T20:02:01.588 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:01.584+0000 7f0a3cc5f640 1 -- 172.21.15.78:0/3858625469 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f0a180664a0 msgr2=0x7f0a18068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:02:01.589 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:01.584+0000 7f0a3cc5f640 1 --2- 172.21.15.78:0/3858625469 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f0a180664a0 0x7f0a18068960 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f0a3814dc10 tx=0x7f0a20009040 comp rx=0 tx=0).stop 2023-11-28T20:02:01.589 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:01.584+0000 7f0a3cc5f640 1 -- 172.21.15.78:0/3858625469 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0a3814e2a0 msgr2=0x7f0a381ecde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:02:01.589 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:01.584+0000 7f0a3cc5f640 1 --2- 172.21.15.78:0/3858625469 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0a3814e2a0 0x7f0a381ecde0 secure :-1 s=READY pgs=855 cs=0 l=1 rev1=1 crypto rx=0x7f0a2801a0a0 tx=0x7f0a28019210 comp rx=0 tx=0).stop 2023-11-28T20:02:01.589 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:01.584+0000 7f0a3cc5f640 1 -- 172.21.15.78:0/3858625469 shutdown_connections 2023-11-28T20:02:01.589 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:01.584+0000 7f0a3cc5f640 1 --2- 172.21.15.78:0/3858625469 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f0a180664a0 0x7f0a18068960 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:01.589 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:01.584+0000 7f0a3cc5f640 1 --2- 172.21.15.78:0/3858625469 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0a381516a0 0x7f0a381ed320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:01.589 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:01.584+0000 7f0a3cc5f640 1 --2- 172.21.15.78:0/3858625469 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0a3814e2a0 0x7f0a381ecde0 unknown :-1 s=CLOSED pgs=855 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:01.589 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:01.584+0000 7f0a3cc5f640 1 --2- 172.21.15.78:0/3858625469 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0a3806c1c0 0x7f0a3806fe00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:01.589 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:01.584+0000 7f0a3cc5f640 1 -- 172.21.15.78:0/3858625469 >> 172.21.15.78:0/3858625469 conn(0x7f0a380c59f0 msgr2=0x7f0a380bed60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:02:01.589 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:01.584+0000 7f0a3cc5f640 1 -- 172.21.15.78:0/3858625469 shutdown_connections 2023-11-28T20:02:01.589 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:01.584+0000 7f0a3cc5f640 1 -- 172.21.15.78:0/3858625469 wait complete. 2023-11-28T20:02:01.608 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-11-28T20:02:01.608 DEBUG:teuthology.orchestra.run.smithi078:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-11-28T20:02:01.686 DEBUG:teuthology.orchestra.run.smithi179:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-11-28T20:02:01.767 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-11-28T20:02:01.767 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2023-11-28T20:02:01.768 DEBUG:teuthology.orchestra.run.smithi078:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-28T20:02:01.776 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354608k,nr_inodes=4088652,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275372k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=5526 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275368k,nr_inodes=818842,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275372k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 2023-11-28T20:02:01.776 DEBUG:teuthology.orchestra.run.smithi179:> set -ex 2023-11-28T20:02:01.777 DEBUG:teuthology.orchestra.run.smithi179:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-28T20:02:01.786 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354628k,nr_inodes=4088657,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275376k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=3817 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275372k,nr_inodes=818843,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275376k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 2023-11-28T20:02:01.786 INFO:tasks.cephfs.cephfs_test_case:[, ] 2023-11-28T20:02:01.787 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-28T20:02:01.960 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:01.956+0000 7f458c4ad640 1 Processor -- start 2023-11-28T20:02:01.960 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:01.956+0000 7f458c4ad640 1 -- start start 2023-11-28T20:02:01.961 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:01.956+0000 7f458c4ad640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f458414b2a0 0x7f45840a4ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:01.961 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:01.956+0000 7f458c4ad640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f45840bee90 0x7f45840bf310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:01.961 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:01.956+0000 7f458c4ad640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4584157cf0 con 0x7f4584154740 2023-11-28T20:02:01.962 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:01.956+0000 7f458c4ad640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f458406c3a0 con 0x7f458414b2a0 2023-11-28T20:02:01.962 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:01.956+0000 7f458c4ad640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4584157fd0 con 0x7f45840bee90 2023-11-28T20:02:01.962 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:01.956+0000 7f458aa4a640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f4584154740 0x7f4584154bd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:54786/0 (socket says 172.21.15.78:54786) 2023-11-28T20:02:01.962 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:01.956+0000 7f458aa4a640 1 -- 172.21.15.78:0/4087557252 learned_addr learned my addr 172.21.15.78:0/4087557252 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-11-28T20:02:01.964 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:01.956+0000 7f458a249640 1 --2- 172.21.15.78:0/4087557252 >> v2:172.21.15.179:3300/0 conn(0x7f458414b2a0 0x7f45840a4ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:02:01.964 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:01.956+0000 7f4589a48640 1 --2- 172.21.15.78:0/4087557252 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f45840bee90 0x7f45840bf310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:02:01.964 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:01.956+0000 7f4589247640 1 -- 172.21.15.78:0/4087557252 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1818969213 0 0) 0x7f4584157cf0 con 0x7f4584154740 2023-11-28T20:02:01.964 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:01.956+0000 7f4589247640 1 -- 172.21.15.78:0/4087557252 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4570003530 con 0x7f4584154740 2023-11-28T20:02:01.964 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:01.956+0000 7f4589247640 1 -- 172.21.15.78:0/4087557252 <== mon.0 v1:172.21.15.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3474782547 0 0) 0x7f4570003530 con 0x7f4584154740 2023-11-28T20:02:01.964 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:01.956+0000 7f4589247640 1 -- 172.21.15.78:0/4087557252 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f45840bee90 msgr2=0x7f45840bf310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:02:01.965 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:01.956+0000 7f4589247640 1 --2- 172.21.15.78:0/4087557252 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f45840bee90 0x7f45840bf310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:01.965 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:01.956+0000 7f4589247640 1 -- 172.21.15.78:0/4087557252 >> v2:172.21.15.179:3300/0 conn(0x7f458414b2a0 msgr2=0x7f45840a4ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:02:01.965 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:01.956+0000 7f4589247640 1 --2- 172.21.15.78:0/4087557252 >> v2:172.21.15.179:3300/0 conn(0x7f458414b2a0 0x7f45840a4ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:01.965 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:01.956+0000 7f4589247640 1 -- 172.21.15.78:0/4087557252 --> v1:172.21.15.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45841582b0 con 0x7f4584154740 2023-11-28T20:02:01.965 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:01.956+0000 7f4589247640 1 -- 172.21.15.78:0/4087557252 <== mon.0 v1:172.21.15.78:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3326804700 0 0) 0x7f457c001a00 con 0x7f4584154740 2023-11-28T20:02:01.965 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:01.956+0000 7f4589247640 1 -- 172.21.15.78:0/4087557252 >> v1:172.21.15.78:6789/0 conn(0x7f4584154740 legacy=0x7f4584154bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:02:01.965 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:01.956+0000 7f4589247640 1 --2- 172.21.15.78:0/4087557252 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4570003980 0x7f4570003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:01.965 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:01.956+0000 7f4589247640 1 --2- 172.21.15.78:0/4087557252 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f45840bee90 0x7f45700047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:01.965 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:01.956+0000 7f4589247640 1 --2- 172.21.15.78:0/4087557252 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4570004d10 0x7f4570005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:01.965 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:01.956+0000 7f4589247640 1 -- 172.21.15.78:0/4087557252 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f458406c3a0 con 0x7f4570003980 2023-11-28T20:02:01.966 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:01.956+0000 7f4589247640 1 -- 172.21.15.78:0/4087557252 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4584157fd0 con 0x7f4570004d10 2023-11-28T20:02:01.966 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:01.956+0000 7f4589247640 1 -- 172.21.15.78:0/4087557252 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f457000ba10 con 0x7f45840bee90 2023-11-28T20:02:01.966 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:01.956+0000 7f458a249640 1 --2- 172.21.15.78:0/4087557252 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4570003980 0x7f4570003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:02:01.966 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:01.956+0000 7f4589a48640 1 --2- 172.21.15.78:0/4087557252 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f45840bee90 0x7f45700047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:02:01.966 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:01.956+0000 7f458aa4a640 1 --2- 172.21.15.78:0/4087557252 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4570004d10 0x7f4570005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:02:01.966 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:01.956+0000 7f458a249640 1 -- 172.21.15.78:0/4087557252 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f45840bee90 msgr2=0x7f45700047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:02:01.966 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:01.956+0000 7f458a249640 1 --2- 172.21.15.78:0/4087557252 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f45840bee90 0x7f45700047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:01.966 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:01.956+0000 7f458a249640 1 -- 172.21.15.78:0/4087557252 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4570004d10 msgr2=0x7f4570005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:02:01.966 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:01.956+0000 7f458a249640 1 --2- 172.21.15.78:0/4087557252 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4570004d10 0x7f4570005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:01.966 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:01.956+0000 7f458a249640 1 -- 172.21.15.78:0/4087557252 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4570003530 con 0x7f4570003980 2023-11-28T20:02:01.966 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:01.956+0000 7f4589a48640 1 --2- 172.21.15.78:0/4087557252 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f45840bee90 0x7f45700047d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T20:02:01.967 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:01.956+0000 7f458aa4a640 1 --2- 172.21.15.78:0/4087557252 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4570004d10 0x7f4570005190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T20:02:01.968 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:01.960+0000 7f458a249640 1 --2- 172.21.15.78:0/4087557252 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4570003980 0x7f4570003da0 secure :-1 s=READY pgs=857 cs=0 l=1 rev1=1 crypto rx=0x7f4580009ae0 tx=0x7f458001ca90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b64f3b7f3e5c398d server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:02:01.968 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:01.960+0000 7f4589247640 1 -- 172.21.15.78:0/4087557252 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45800a5570 con 0x7f4570003980 2023-11-28T20:02:01.968 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:01.960+0000 7f4589247640 1 -- 172.21.15.78:0/4087557252 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f45800a56d0 con 0x7f4570003980 2023-11-28T20:02:01.968 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:01.960+0000 7f4589247640 1 -- 172.21.15.78:0/4087557252 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45800a5a80 con 0x7f4570003980 2023-11-28T20:02:01.968 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:01.960+0000 7f458c4ad640 1 -- 172.21.15.78:0/4087557252 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4570003980 msgr2=0x7f4570003da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:02:01.968 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:01.960+0000 7f458c4ad640 1 --2- 172.21.15.78:0/4087557252 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4570003980 0x7f4570003da0 secure :-1 s=READY pgs=857 cs=0 l=1 rev1=1 crypto rx=0x7f4580009ae0 tx=0x7f458001ca90 comp rx=0 tx=0).stop 2023-11-28T20:02:01.968 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:01.960+0000 7f458aa4a640 1 -- 172.21.15.78:0/4087557252 reap_dead start 2023-11-28T20:02:01.968 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:01.960+0000 7f458c4ad640 1 -- 172.21.15.78:0/4087557252 shutdown_connections 2023-11-28T20:02:01.968 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:01.960+0000 7f458c4ad640 1 -- 172.21.15.78:0/4087557252 >> 172.21.15.78:0/4087557252 conn(0x7f45840a7810 msgr2=0x7f45840a7c20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:02:01.968 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:01.960+0000 7f458c4ad640 1 -- 172.21.15.78:0/4087557252 shutdown_connections 2023-11-28T20:02:01.969 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:01.960+0000 7f458c4ad640 1 -- 172.21.15.78:0/4087557252 wait complete. 2023-11-28T20:02:01.971 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:01.964+0000 7f458c4ad640 1 Processor -- start 2023-11-28T20:02:01.971 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:01.964+0000 7f458c4ad640 1 -- start start 2023-11-28T20:02:01.971 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:01.964+0000 7f458c4ad640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4570003980 0x7f45841f1650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:01.971 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:01.964+0000 7f458c4ad640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f45840c4820 0x7f45841ed600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:01.971 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:01.964+0000 7f458c4ad640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f45841edb40 0x7f458413f560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:01.971 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:01.964+0000 7f458c4ad640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45841f11c0 con 0x7f4570003980 2023-11-28T20:02:01.971 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:01.964+0000 7f458c4ad640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4584154070 con 0x7f45840c4820 2023-11-28T20:02:01.971 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:01.964+0000 7f458c4ad640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4584154350 con 0x7f45841edb40 2023-11-28T20:02:01.971 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:01.964+0000 7f458a249640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4570003980 0x7f45841f1650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:02:01.972 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:01.964+0000 7f458a249640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4570003980 0x7f45841f1650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:44074/0 (socket says 172.21.15.78:44074) 2023-11-28T20:02:01.972 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:01.964+0000 7f458a249640 1 -- 172.21.15.78:0/689000290 learned_addr learned my addr 172.21.15.78:0/689000290 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T20:02:01.972 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:01.964+0000 7f4589a48640 1 --2- 172.21.15.78:0/689000290 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f45840c4820 0x7f45841ed600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:02:01.972 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:01.964+0000 7f458aa4a640 1 --2- 172.21.15.78:0/689000290 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f45841edb40 0x7f458413f560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:02:01.972 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:01.964+0000 7f458a249640 1 -- 172.21.15.78:0/689000290 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f45841edb40 msgr2=0x7f458413f560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:02:01.972 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:01.964+0000 7f458a249640 1 --2- 172.21.15.78:0/689000290 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f45841edb40 0x7f458413f560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:01.972 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:01.964+0000 7f458a249640 1 -- 172.21.15.78:0/689000290 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f45840c4820 msgr2=0x7f45841ed600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:02:01.972 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:01.964+0000 7f458a249640 1 --2- 172.21.15.78:0/689000290 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f45840c4820 0x7f45841ed600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:01.972 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:01.964+0000 7f458a249640 1 -- 172.21.15.78:0/689000290 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4584155460 con 0x7f4570003980 2023-11-28T20:02:01.972 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:01.964+0000 7f458a249640 1 --2- 172.21.15.78:0/689000290 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4570003980 0x7f45841f1650 secure :-1 s=READY pgs=858 cs=0 l=1 rev1=1 crypto rx=0x7f4580009ae0 tx=0x7f4570005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:02:01.972 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:01.964+0000 7f457affd640 1 -- 172.21.15.78:0/689000290 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45800a5570 con 0x7f4570003980 2023-11-28T20:02:01.973 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:01.964+0000 7f457affd640 1 -- 172.21.15.78:0/689000290 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4580004220 con 0x7f4570003980 2023-11-28T20:02:01.973 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:01.964+0000 7f457affd640 1 -- 172.21.15.78:0/689000290 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4580003620 con 0x7f4570003980 2023-11-28T20:02:01.973 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:01.964+0000 7f458c4ad640 1 -- 172.21.15.78:0/689000290 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f45841f0b70 con 0x7f4570003980 2023-11-28T20:02:01.973 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:01.964+0000 7f458c4ad640 1 -- 172.21.15.78:0/689000290 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4584153c20 con 0x7f4570003980 2023-11-28T20:02:01.974 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:01.968+0000 7f458c4ad640 1 -- 172.21.15.78:0/689000290 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f45840679d0 con 0x7f4570003980 2023-11-28T20:02:01.974 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:01.968+0000 7f457affd640 1 -- 172.21.15.78:0/689000290 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f45800b4040 con 0x7f4570003980 2023-11-28T20:02:01.974 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:01.968+0000 7f457affd640 1 --2- 172.21.15.78:0/689000290 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f4568066470 0x7f4568068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:01.974 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:01.968+0000 7f457affd640 1 -- 172.21.15.78:0/689000290 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 5349+0+0 (secure 0 0 0) 0x7f458011e1e0 con 0x7f4570003980 2023-11-28T20:02:01.974 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:01.968+0000 7f4589a48640 1 --2- 172.21.15.78:0/689000290 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f4568066470 0x7f4568068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:02:01.974 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:01.968+0000 7f4589a48640 1 --2- 172.21.15.78:0/689000290 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f4568066470 0x7f4568068930 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f4584072c90 tx=0x7f4574008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:02:01.977 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:01.972+0000 7f457affd640 1 -- 172.21.15.78:0/689000290 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f45800eb980 con 0x7f4570003980 2023-11-28T20:02:02.160 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:02.156+0000 7f458c4ad640 1 -- 172.21.15.78:0/689000290 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f45841f11c0 con 0x7f4570003980 2023-11-28T20:02:02.161 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:02.156+0000 7f457affd640 1 -- 172.21.15.78:0/689000290 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 40 v40) v1 ==== 94+0+3699 (secure 0 0 0) 0x7f45800eefa0 con 0x7f4570003980 2023-11-28T20:02:02.161 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-11-28T20:02:02.161 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":40,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5384,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6834/837155031","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6832","nonce":837155031},{"type":"v1","addr":"172.21.15.179:6834","nonce":837155031}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":27},{"gid":5387,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6835/752467462","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6833","nonce":752467462},{"type":"v1","addr":"172.21.15.179:6835","nonce":752467462}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":27},{"gid":6459,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6837/2542805925","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6836","nonce":2542805925},{"type":"v1","addr":"172.21.15.78:6837","nonce":2542805925}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":38},{"gid":6561,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6835/1558307396","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6834","nonce":1558307396},{"type":"v1","addr":"172.21.15.78:6835","nonce":1558307396}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":40}],"filesystems":[]} 2023-11-28T20:02:02.162 INFO:teuthology.orchestra.run.smithi078.stderr:dumped fsmap epoch 40 2023-11-28T20:02:02.163 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:02.156+0000 7f458c4ad640 1 -- 172.21.15.78:0/689000290 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f4568066470 msgr2=0x7f4568068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:02:02.163 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:02.156+0000 7f458c4ad640 1 --2- 172.21.15.78:0/689000290 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f4568066470 0x7f4568068930 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f4584072c90 tx=0x7f4574008040 comp rx=0 tx=0).stop 2023-11-28T20:02:02.163 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:02.156+0000 7f458c4ad640 1 -- 172.21.15.78:0/689000290 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4570003980 msgr2=0x7f45841f1650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:02:02.163 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:02.156+0000 7f458c4ad640 1 --2- 172.21.15.78:0/689000290 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4570003980 0x7f45841f1650 secure :-1 s=READY pgs=858 cs=0 l=1 rev1=1 crypto rx=0x7f4580009ae0 tx=0x7f4570005800 comp rx=0 tx=0).stop 2023-11-28T20:02:02.163 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:02.156+0000 7f458c4ad640 1 -- 172.21.15.78:0/689000290 shutdown_connections 2023-11-28T20:02:02.163 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:02.156+0000 7f458c4ad640 1 --2- 172.21.15.78:0/689000290 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f4568066470 0x7f4568068930 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:02.163 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:02.156+0000 7f458c4ad640 1 --2- 172.21.15.78:0/689000290 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f45841edb40 0x7f458413f560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:02.163 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:02.156+0000 7f458c4ad640 1 --2- 172.21.15.78:0/689000290 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f45840c4820 0x7f45841ed600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:02.163 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:02.156+0000 7f458c4ad640 1 --2- 172.21.15.78:0/689000290 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4570003980 0x7f45841f1650 unknown :-1 s=CLOSED pgs=858 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:02.164 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:02.156+0000 7f458c4ad640 1 -- 172.21.15.78:0/689000290 >> 172.21.15.78:0/689000290 conn(0x7f45840a7810 msgr2=0x7f4584143ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:02:02.164 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:02.156+0000 7f458c4ad640 1 -- 172.21.15.78:0/689000290 shutdown_connections 2023-11-28T20:02:02.164 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:02.156+0000 7f458c4ad640 1 -- 172.21.15.78:0/689000290 wait complete. 2023-11-28T20:02:02.182 INFO:tasks.ceph.mds.a:Restarting daemon 2023-11-28T20:02:02.182 INFO:tasks.ceph.mds.a:Stopping old one... 2023-11-28T20:02:02.183 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-11-28T20:02:02.183 INFO:teuthology.orchestra.run:waiting for 300 2023-11-28T20:02:02.183 INFO:tasks.ceph.mds.c:Restarting daemon 2023-11-28T20:02:02.183 INFO:tasks.ceph.mds.c:Stopping old one... 2023-11-28T20:02:02.183 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-11-28T20:02:02.183 INFO:teuthology.orchestra.run:waiting for 300 2023-11-28T20:02:02.184 INFO:tasks.ceph.mds.b:Restarting daemon 2023-11-28T20:02:02.184 INFO:tasks.ceph.mds.b:Stopping old one... 2023-11-28T20:02:02.184 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-11-28T20:02:02.184 INFO:teuthology.orchestra.run:waiting for 300 2023-11-28T20:02:02.184 INFO:tasks.ceph.mds.d:Restarting daemon 2023-11-28T20:02:02.184 INFO:tasks.ceph.mds.d:Stopping old one... 2023-11-28T20:02:02.185 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-11-28T20:02:02.185 INFO:teuthology.orchestra.run:waiting for 300 2023-11-28T20:02:02.196 INFO:tasks.ceph.mds.c:Stopped 2023-11-28T20:02:02.196 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-11-28T20:02:02.197 INFO:tasks.ceph.mds.a:Stopped 2023-11-28T20:02:02.197 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-11-28T20:02:02.198 INFO:tasks.ceph.mds.b:Stopped 2023-11-28T20:02:02.198 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-11-28T20:02:02.199 INFO:tasks.ceph.mds.d:Stopped 2023-11-28T20:02:02.199 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-11-28T20:02:02.242 INFO:tasks.ceph.mds.c:Started 2023-11-28T20:02:02.243 DEBUG:teuthology.parallel:result is None 2023-11-28T20:02:02.244 INFO:tasks.ceph.mds.a:Started 2023-11-28T20:02:02.244 DEBUG:teuthology.parallel:result is None 2023-11-28T20:02:02.247 INFO:tasks.ceph.mds.b:Started 2023-11-28T20:02:02.248 DEBUG:teuthology.parallel:result is None 2023-11-28T20:02:02.252 INFO:tasks.ceph.mds.d:Started 2023-11-28T20:02:02.252 DEBUG:teuthology.parallel:result is None 2023-11-28T20:02:02.252 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-11-28T20:02:02.332 INFO:tasks.ceph.mds.c.smithi078.stdout:starting mds.c at 2023-11-28T20:02:02.332 INFO:tasks.ceph.mds.a.smithi078.stdout:starting mds.a at 2023-11-28T20:02:02.342 INFO:tasks.ceph.mds.b.smithi179.stdout:starting mds.b at 2023-11-28T20:02:02.342 INFO:tasks.ceph.mds.d.smithi179.stdout:starting mds.d at 2023-11-28T20:02:02.344 INFO:tasks.ceph.mds.b.smithi179.stderr:2023-11-28T20:02:02.338+0000 7f848d7ce640 -1 PosixStack listen unable to listen on v2:0.0.0.0:6832/0: (98) Address already in use 2023-11-28T20:02:02.397 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:02.392+0000 7f8527f72640 1 Processor -- start 2023-11-28T20:02:02.397 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:02.392+0000 7f8527f72640 1 -- start start 2023-11-28T20:02:02.399 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:02.392+0000 7f8527f72640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f85200a4f90 0x7f85200c59c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:02.399 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:02.392+0000 7f8527f72640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f8520072810 0x7f85200c0800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:02.399 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:02.392+0000 7f8527f72640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f85201524b0 con 0x7f85200a5370 2023-11-28T20:02:02.399 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:02.392+0000 7f8527f72640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f85200c62f0 con 0x7f8520072810 2023-11-28T20:02:02.400 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:02.392+0000 7f8527f72640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8520152770 con 0x7f85200a4f90 2023-11-28T20:02:02.400 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:02.392+0000 7f852650f640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f8520072810 0x7f85200c0800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:02:02.400 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:02.392+0000 7f852650f640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f8520072810 0x7f85200c0800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:44092/0 (socket says 172.21.15.78:44092) 2023-11-28T20:02:02.400 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:02.392+0000 7f852650f640 1 -- 172.21.15.78:0/1852849071 learned_addr learned my addr 172.21.15.78:0/1852849071 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T20:02:02.400 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:02.396+0000 7f8525d0e640 1 --2- 172.21.15.78:0/1852849071 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f85200a4f90 0x7f85200c59c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:02:02.400 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:02.396+0000 7f852650f640 1 -- 172.21.15.78:0/1852849071 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f85200a4f90 msgr2=0x7f85200c59c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:02:02.400 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:02.396+0000 7f852650f640 1 --2- 172.21.15.78:0/1852849071 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f85200a4f90 0x7f85200c59c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:02.400 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:02.396+0000 7f852650f640 1 -- 172.21.15.78:0/1852849071 >> v1:172.21.15.179:6789/0 conn(0x7f85200a5370 legacy=0x7f852014f870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:02:02.400 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:02.396+0000 7f852650f640 1 -- 172.21.15.78:0/1852849071 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8520152a50 con 0x7f8520072810 2023-11-28T20:02:02.400 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:02.396+0000 7f8525d0e640 1 --2- 172.21.15.78:0/1852849071 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f85200a4f90 0x7f85200c59c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T20:02:02.402 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:02.396+0000 7f852650f640 1 --2- 172.21.15.78:0/1852849071 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8520072810 0x7f85200c0800 secure :-1 s=READY pgs=863 cs=0 l=1 rev1=1 crypto rx=0x7f8518009e50 tx=0x7f851801c980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=28d4bb5da95faeb5 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:02:02.402 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:02.396+0000 7f8524d0c640 1 -- 172.21.15.78:0/1852849071 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85180a5640 con 0x7f8520072810 2023-11-28T20:02:02.402 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:02.396+0000 7f8524d0c640 1 -- 172.21.15.78:0/1852849071 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f85180a57a0 con 0x7f8520072810 2023-11-28T20:02:02.403 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:02.396+0000 7f8524d0c640 1 -- 172.21.15.78:0/1852849071 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85180a5b30 con 0x7f8520072810 2023-11-28T20:02:02.404 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:02.396+0000 7f8527f72640 1 -- 172.21.15.78:0/1852849071 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8520072810 msgr2=0x7f85200c0800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:02:02.404 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:02.396+0000 7f8527f72640 1 --2- 172.21.15.78:0/1852849071 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8520072810 0x7f85200c0800 secure :-1 s=READY pgs=863 cs=0 l=1 rev1=1 crypto rx=0x7f8518009e50 tx=0x7f851801c980 comp rx=0 tx=0).stop 2023-11-28T20:02:02.404 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:02.400+0000 7f8527f72640 1 -- 172.21.15.78:0/1852849071 shutdown_connections 2023-11-28T20:02:02.405 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:02.400+0000 7f8527f72640 1 --2- 172.21.15.78:0/1852849071 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8520072810 0x7f85200c0800 unknown :-1 s=CLOSED pgs=863 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:02.406 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:02.400+0000 7f8527f72640 1 --2- 172.21.15.78:0/1852849071 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f85200a4f90 0x7f85200c59c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:02.406 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:02.400+0000 7f8527f72640 1 -- 172.21.15.78:0/1852849071 >> 172.21.15.78:0/1852849071 conn(0x7f852006b220 msgr2=0x7f85200a77e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:02:02.406 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:02.400+0000 7f8527f72640 1 -- 172.21.15.78:0/1852849071 shutdown_connections 2023-11-28T20:02:02.406 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:02.400+0000 7f8527f72640 1 -- 172.21.15.78:0/1852849071 wait complete. 2023-11-28T20:02:02.409 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:02.400+0000 7f8527f72640 1 Processor -- start 2023-11-28T20:02:02.409 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:02.400+0000 7f8527f72640 1 -- start start 2023-11-28T20:02:02.410 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:02.400+0000 7f8527f72640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8520072810 0x7f85200a9b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:02.410 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:02.400+0000 7f8527f72640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f85200a4f90 0x7f852015b150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:02.410 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:02.400+0000 7f8527f72640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f85200a5370 0x7f852015b690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:02.410 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:02.400+0000 7f8527f72640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85201ed660 con 0x7f85200a5370 2023-11-28T20:02:02.410 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:02.400+0000 7f8527f72640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85200a9250 con 0x7f85200a4f90 2023-11-28T20:02:02.410 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:02.400+0000 7f8527f72640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f85200a96e0 con 0x7f8520072810 2023-11-28T20:02:02.410 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:02.400+0000 7f852650f640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f85200a5370 0x7f852015b690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:02:02.410 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:02.400+0000 7f852650f640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f85200a5370 0x7f852015b690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:44100/0 (socket says 172.21.15.78:44100) 2023-11-28T20:02:02.411 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:02.400+0000 7f852650f640 1 -- 172.21.15.78:0/3684372798 learned_addr learned my addr 172.21.15.78:0/3684372798 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T20:02:02.411 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:02.400+0000 7f8525d0e640 1 --2- 172.21.15.78:0/3684372798 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8520072810 0x7f85200a9b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:02:02.411 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:02.400+0000 7f852550d640 1 --2- 172.21.15.78:0/3684372798 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f85200a4f90 0x7f852015b150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:02:02.411 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:02.400+0000 7f852650f640 1 -- 172.21.15.78:0/3684372798 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8520072810 msgr2=0x7f85200a9b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:02:02.411 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:02.400+0000 7f852650f640 1 --2- 172.21.15.78:0/3684372798 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8520072810 0x7f85200a9b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:02.411 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:02.400+0000 7f852650f640 1 -- 172.21.15.78:0/3684372798 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f85200a4f90 msgr2=0x7f852015b150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:02:02.411 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:02.400+0000 7f852650f640 1 --2- 172.21.15.78:0/3684372798 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f85200a4f90 0x7f852015b150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:02.411 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:02.400+0000 7f852650f640 1 -- 172.21.15.78:0/3684372798 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8518009b30 con 0x7f85200a5370 2023-11-28T20:02:02.411 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:02.400+0000 7f852650f640 1 --2- 172.21.15.78:0/3684372798 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f85200a5370 0x7f852015b690 secure :-1 s=READY pgs=864 cs=0 l=1 rev1=1 crypto rx=0x7f85180af040 tx=0x7f8518019720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:02:02.411 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:02.404+0000 7f85167fc640 1 -- 172.21.15.78:0/3684372798 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85180b8670 con 0x7f85200a5370 2023-11-28T20:02:02.411 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:02.404+0000 7f85167fc640 1 -- 172.21.15.78:0/3684372798 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f85180b87d0 con 0x7f85200a5370 2023-11-28T20:02:02.411 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:02.404+0000 7f8527f72640 1 -- 172.21.15.78:0/3684372798 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f85201edb50 con 0x7f85200a5370 2023-11-28T20:02:02.412 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:02.404+0000 7f85167fc640 1 -- 172.21.15.78:0/3684372798 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85180b8b80 con 0x7f85200a5370 2023-11-28T20:02:02.412 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:02.404+0000 7f8527f72640 1 -- 172.21.15.78:0/3684372798 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f85200a8f20 con 0x7f85200a5370 2023-11-28T20:02:02.412 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:02.404+0000 7f8527f72640 1 -- 172.21.15.78:0/3684372798 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f85200a9400 con 0x7f85200a5370 2023-11-28T20:02:02.412 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:02.404+0000 7f85167fc640 1 -- 172.21.15.78:0/3684372798 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f85180b8ce0 con 0x7f85200a5370 2023-11-28T20:02:02.413 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:02.404+0000 7f85167fc640 1 --2- 172.21.15.78:0/3684372798 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f8504066470 0x7f8504068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:02.413 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:02.404+0000 7f85167fc640 1 -- 172.21.15.78:0/3684372798 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 5349+0+0 (secure 0 0 0) 0x7f851811eff0 con 0x7f85200a5370 2023-11-28T20:02:02.413 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:02.404+0000 7f8525d0e640 1 --2- 172.21.15.78:0/3684372798 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f8504066470 0x7f8504068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:02:02.413 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:02.404+0000 7f8525d0e640 1 --2- 172.21.15.78:0/3684372798 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f8504066470 0x7f8504068930 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f851c006e90 tx=0x7f851c008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:02:02.414 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:02.408+0000 7f85167fc640 1 -- 172.21.15.78:0/3684372798 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f8518150280 con 0x7f85200a5370 2023-11-28T20:02:02.576 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:02.572+0000 7f8527f72640 1 -- 172.21.15.78:0/3684372798 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f8520067630 con 0x7f85200a5370 2023-11-28T20:02:03.615 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:03.608+0000 7f85167fc640 1 -- 172.21.15.78:0/3684372798 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v77) v1 ==== 97+0+0 (secure 0 0 0) 0x7f85200a9400 con 0x7f85200a5370 2023-11-28T20:02:03.615 INFO:teuthology.orchestra.run.smithi078.stderr: removed all blocklist entries 2023-11-28T20:02:03.618 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:03.612+0000 7f8527f72640 1 -- 172.21.15.78:0/3684372798 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f8504066470 msgr2=0x7f8504068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:02:03.618 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:03.612+0000 7f8527f72640 1 --2- 172.21.15.78:0/3684372798 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f8504066470 0x7f8504068930 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f851c006e90 tx=0x7f851c008040 comp rx=0 tx=0).stop 2023-11-28T20:02:03.618 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:03.612+0000 7f8527f72640 1 -- 172.21.15.78:0/3684372798 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f85200a5370 msgr2=0x7f852015b690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:02:03.618 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:03.612+0000 7f8527f72640 1 --2- 172.21.15.78:0/3684372798 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f85200a5370 0x7f852015b690 secure :-1 s=READY pgs=864 cs=0 l=1 rev1=1 crypto rx=0x7f85180af040 tx=0x7f8518019720 comp rx=0 tx=0).stop 2023-11-28T20:02:03.618 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:03.612+0000 7f8527f72640 1 -- 172.21.15.78:0/3684372798 shutdown_connections 2023-11-28T20:02:03.618 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:03.612+0000 7f8527f72640 1 --2- 172.21.15.78:0/3684372798 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f8504066470 0x7f8504068930 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:03.618 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:03.612+0000 7f8527f72640 1 --2- 172.21.15.78:0/3684372798 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f85200a5370 0x7f852015b690 unknown :-1 s=CLOSED pgs=864 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:03.618 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:03.612+0000 7f8527f72640 1 --2- 172.21.15.78:0/3684372798 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f85200a4f90 0x7f852015b150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:03.618 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:03.612+0000 7f8527f72640 1 --2- 172.21.15.78:0/3684372798 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8520072810 0x7f85200a9b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:03.618 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:03.612+0000 7f8527f72640 1 -- 172.21.15.78:0/3684372798 >> 172.21.15.78:0/3684372798 conn(0x7f852006b220 msgr2=0x7f85200a77c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:02:03.619 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:03.612+0000 7f8527f72640 1 -- 172.21.15.78:0/3684372798 shutdown_connections 2023-11-28T20:02:03.619 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:03.612+0000 7f8527f72640 1 -- 172.21.15.78:0/3684372798 wait complete. 2023-11-28T20:02:03.640 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-11-28T20:02:03.781 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:03.776+0000 7f3ad7efe640 1 Processor -- start 2023-11-28T20:02:03.781 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:03.776+0000 7f3ad7efe640 1 -- start start 2023-11-28T20:02:03.785 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:03.776+0000 7f3ad7efe640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f3ad006bef0 0x7f3ad00bfce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:03.786 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:03.776+0000 7f3ad7efe640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3ad006c5b0 0x7f3ad006ca40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:03.786 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:03.776+0000 7f3ad7efe640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3ad0151690 con 0x7f3ad014e3f0 2023-11-28T20:02:03.786 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:03.776+0000 7f3ad7efe640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3ad0151bc0 con 0x7f3ad006bef0 2023-11-28T20:02:03.786 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:03.776+0000 7f3ad7efe640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ad01518e0 con 0x7f3ad006c5b0 2023-11-28T20:02:03.786 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:03.776+0000 7f3ad5c9a640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f3ad014e3f0 0x7f3ad00c41f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:54810/0 (socket says 172.21.15.78:54810) 2023-11-28T20:02:03.786 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:03.776+0000 7f3ad5c9a640 1 -- 172.21.15.78:0/950302325 learned_addr learned my addr 172.21.15.78:0/950302325 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-11-28T20:02:03.786 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:03.776+0000 7f3ad5499640 1 --2- 172.21.15.78:0/950302325 >> v2:172.21.15.179:3300/0 conn(0x7f3ad006bef0 0x7f3ad00bfce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:02:03.787 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:03.776+0000 7f3ad649b640 1 --2- 172.21.15.78:0/950302325 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3ad006c5b0 0x7f3ad006ca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:02:03.787 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:03.776+0000 7f3ad4c98640 1 -- 172.21.15.78:0/950302325 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1247479960 0 0) 0x7f3ad0151690 con 0x7f3ad014e3f0 2023-11-28T20:02:03.787 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:03.776+0000 7f3ad4c98640 1 -- 172.21.15.78:0/950302325 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3abc003530 con 0x7f3ad014e3f0 2023-11-28T20:02:03.787 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:03.780+0000 7f3ad4c98640 1 -- 172.21.15.78:0/950302325 <== mon.0 v1:172.21.15.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1880968423 0 0) 0x7f3abc003530 con 0x7f3ad014e3f0 2023-11-28T20:02:03.787 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:03.780+0000 7f3ad4c98640 1 -- 172.21.15.78:0/950302325 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3ad006c5b0 msgr2=0x7f3ad006ca40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:02:03.787 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:03.780+0000 7f3ad4c98640 1 --2- 172.21.15.78:0/950302325 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3ad006c5b0 0x7f3ad006ca40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:03.787 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:03.780+0000 7f3ad4c98640 1 -- 172.21.15.78:0/950302325 >> v2:172.21.15.179:3300/0 conn(0x7f3ad006bef0 msgr2=0x7f3ad00bfce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:02:03.788 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:03.780+0000 7f3ad4c98640 1 --2- 172.21.15.78:0/950302325 >> v2:172.21.15.179:3300/0 conn(0x7f3ad006bef0 0x7f3ad00bfce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:03.788 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:03.780+0000 7f3ad4c98640 1 -- 172.21.15.78:0/950302325 --> v1:172.21.15.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ad00c1de0 con 0x7f3ad014e3f0 2023-11-28T20:02:03.788 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:03.780+0000 7f3ad4c98640 1 -- 172.21.15.78:0/950302325 <== mon.0 v1:172.21.15.78:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3326804700 0 0) 0x7f3acc001680 con 0x7f3ad014e3f0 2023-11-28T20:02:03.788 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:03.780+0000 7f3ad4c98640 1 -- 172.21.15.78:0/950302325 >> v1:172.21.15.78:6789/0 conn(0x7f3ad014e3f0 legacy=0x7f3ad00c41f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:02:03.788 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:03.780+0000 7f3ad4c98640 1 --2- 172.21.15.78:0/950302325 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3ad006c5b0 0x7f3abc003980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:03.788 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:03.780+0000 7f3ad4c98640 1 --2- 172.21.15.78:0/950302325 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3abc003f00 0x7f3abc0047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:03.788 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:03.780+0000 7f3ad4c98640 1 --2- 172.21.15.78:0/950302325 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3abc004d10 0x7f3abc005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:03.789 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:03.780+0000 7f3ad4c98640 1 -- 172.21.15.78:0/950302325 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ad0151bc0 con 0x7f3abc003f00 2023-11-28T20:02:03.789 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:03.780+0000 7f3ad4c98640 1 -- 172.21.15.78:0/950302325 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ad01518e0 con 0x7f3abc004d10 2023-11-28T20:02:03.789 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:03.780+0000 7f3ad4c98640 1 -- 172.21.15.78:0/950302325 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3abc00b9e0 con 0x7f3ad006c5b0 2023-11-28T20:02:03.789 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:03.780+0000 7f3ad5499640 1 --2- 172.21.15.78:0/950302325 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3abc003f00 0x7f3abc0047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:02:03.789 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:03.780+0000 7f3ad649b640 1 --2- 172.21.15.78:0/950302325 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3abc004d10 0x7f3abc005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:02:03.789 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:03.780+0000 7f3ad5c9a640 1 --2- 172.21.15.78:0/950302325 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3ad006c5b0 0x7f3abc003980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:02:03.790 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:03.780+0000 7f3ad5499640 1 -- 172.21.15.78:0/950302325 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3ad006c5b0 msgr2=0x7f3abc003980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:02:03.790 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:03.780+0000 7f3ad5499640 1 --2- 172.21.15.78:0/950302325 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3ad006c5b0 0x7f3abc003980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:03.790 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:03.780+0000 7f3ad5499640 1 -- 172.21.15.78:0/950302325 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3abc004d10 msgr2=0x7f3abc005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:02:03.790 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:03.780+0000 7f3ad5499640 1 --2- 172.21.15.78:0/950302325 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3abc004d10 0x7f3abc005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:03.790 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:03.780+0000 7f3ad5499640 1 -- 172.21.15.78:0/950302325 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3abc003530 con 0x7f3abc003f00 2023-11-28T20:02:03.793 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:03.780+0000 7f3ad5499640 1 --2- 172.21.15.78:0/950302325 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3abc003f00 0x7f3abc0047d0 secure :-1 s=READY pgs=866 cs=0 l=1 rev1=1 crypto rx=0x7f3ac000ab10 tx=0x7f3ac001df90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2f8a65a19003b93f server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:02:03.793 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:03.784+0000 7f3ad4c98640 1 -- 172.21.15.78:0/950302325 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ac00a6e00 con 0x7f3abc003f00 2023-11-28T20:02:03.794 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:03.784+0000 7f3ad4c98640 1 -- 172.21.15.78:0/950302325 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ac00ae440 con 0x7f3abc003f00 2023-11-28T20:02:03.794 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:03.784+0000 7f3ad4c98640 1 -- 172.21.15.78:0/950302325 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ac00ae7f0 con 0x7f3abc003f00 2023-11-28T20:02:03.794 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:03.784+0000 7f3ad7efe640 1 -- 172.21.15.78:0/950302325 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3abc003f00 msgr2=0x7f3abc0047d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:02:03.794 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:03.784+0000 7f3ad7efe640 1 --2- 172.21.15.78:0/950302325 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3abc003f00 0x7f3abc0047d0 secure :-1 s=READY pgs=866 cs=0 l=1 rev1=1 crypto rx=0x7f3ac000ab10 tx=0x7f3ac001df90 comp rx=0 tx=0).stop 2023-11-28T20:02:03.794 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:03.784+0000 7f3ad649b640 1 -- 172.21.15.78:0/950302325 reap_dead start 2023-11-28T20:02:03.794 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:03.784+0000 7f3ad7efe640 1 -- 172.21.15.78:0/950302325 shutdown_connections 2023-11-28T20:02:03.794 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:03.784+0000 7f3ad7efe640 1 -- 172.21.15.78:0/950302325 >> 172.21.15.78:0/950302325 conn(0x7f3ad00a7810 msgr2=0x7f3ad00a7c20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:02:03.794 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:03.784+0000 7f3ad7efe640 1 -- 172.21.15.78:0/950302325 shutdown_connections 2023-11-28T20:02:03.794 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:03.784+0000 7f3ad7efe640 1 -- 172.21.15.78:0/950302325 wait complete. 2023-11-28T20:02:03.794 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:03.784+0000 7f3ad7efe640 1 Processor -- start 2023-11-28T20:02:03.794 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:03.784+0000 7f3ad7efe640 1 -- start start 2023-11-28T20:02:03.795 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:03.784+0000 7f3ad7efe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3abc003f00 0x7f3ad00c0e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:03.795 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:03.784+0000 7f3ad7efe640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3ad014a830 0x7f3ad014ac90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:03.795 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:03.784+0000 7f3ad7efe640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3ad00a8ed0 0x7f3ad00a9350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:03.795 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:03.784+0000 7f3ad7efe640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ad01548a0 con 0x7f3abc003f00 2023-11-28T20:02:03.795 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:03.784+0000 7f3ad7efe640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ad01f1260 con 0x7f3ad014a830 2023-11-28T20:02:03.795 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:03.784+0000 7f3ad7efe640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ad01f0dd0 con 0x7f3ad00a8ed0 2023-11-28T20:02:03.795 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:03.784+0000 7f3ad5c9a640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3abc003f00 0x7f3ad00c0e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:02:03.795 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:03.784+0000 7f3ad5c9a640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3abc003f00 0x7f3ad00c0e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:44110/0 (socket says 172.21.15.78:44110) 2023-11-28T20:02:03.795 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:03.784+0000 7f3ad5c9a640 1 -- 172.21.15.78:0/1950475556 learned_addr learned my addr 172.21.15.78:0/1950475556 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T20:02:03.795 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:03.784+0000 7f3ad649b640 1 --2- 172.21.15.78:0/1950475556 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3ad00a8ed0 0x7f3ad00a9350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:02:03.795 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:03.784+0000 7f3ad5499640 1 --2- 172.21.15.78:0/1950475556 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3ad014a830 0x7f3ad014ac90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:02:03.796 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:03.788+0000 7f3ad5c9a640 1 -- 172.21.15.78:0/1950475556 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3ad00a8ed0 msgr2=0x7f3ad00a9350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:02:03.796 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:03.788+0000 7f3ad5c9a640 1 --2- 172.21.15.78:0/1950475556 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3ad00a8ed0 0x7f3ad00a9350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:03.796 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:03.788+0000 7f3ad5c9a640 1 -- 172.21.15.78:0/1950475556 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3ad014a830 msgr2=0x7f3ad014ac90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:02:03.796 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:03.788+0000 7f3ad5c9a640 1 --2- 172.21.15.78:0/1950475556 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3ad014a830 0x7f3ad014ac90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:03.796 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:03.788+0000 7f3ad5c9a640 1 -- 172.21.15.78:0/1950475556 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ad00a8bc0 con 0x7f3abc003f00 2023-11-28T20:02:03.796 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:03.788+0000 7f3ad649b640 1 --2- 172.21.15.78:0/1950475556 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3ad00a8ed0 0x7f3ad00a9350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T20:02:03.796 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:03.788+0000 7f3ad5499640 1 --2- 172.21.15.78:0/1950475556 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3ad014a830 0x7f3ad014ac90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T20:02:03.796 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:03.788+0000 7f3ad5c9a640 1 --2- 172.21.15.78:0/1950475556 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3abc003f00 0x7f3ad00c0e30 secure :-1 s=READY pgs=867 cs=0 l=1 rev1=1 crypto rx=0x7f3acc00e7f0 tx=0x7f3acc00ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:02:03.796 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:03.788+0000 7f3ac67fc640 1 -- 172.21.15.78:0/1950475556 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3acc00c870 con 0x7f3abc003f00 2023-11-28T20:02:03.796 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:03.788+0000 7f3ac67fc640 1 -- 172.21.15.78:0/1950475556 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3acc00c9d0 con 0x7f3abc003f00 2023-11-28T20:02:03.796 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:03.788+0000 7f3ad7efe640 1 -- 172.21.15.78:0/1950475556 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3ad014b1d0 con 0x7f3abc003f00 2023-11-28T20:02:03.796 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:03.788+0000 7f3ac67fc640 1 -- 172.21.15.78:0/1950475556 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3acc00cd80 con 0x7f3abc003f00 2023-11-28T20:02:03.797 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:03.788+0000 7f3ad7efe640 1 -- 172.21.15.78:0/1950475556 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3ad01f0780 con 0x7f3abc003f00 2023-11-28T20:02:03.797 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:03.788+0000 7f3ad7efe640 1 -- 172.21.15.78:0/1950475556 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3ad0067630 con 0x7f3abc003f00 2023-11-28T20:02:03.797 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:03.788+0000 7f3ac67fc640 1 -- 172.21.15.78:0/1950475556 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f3acc01d460 con 0x7f3abc003f00 2023-11-28T20:02:03.797 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:03.788+0000 7f3ac67fc640 1 --2- 172.21.15.78:0/1950475556 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f3ab4066460 0x7f3ab4068920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:03.798 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:03.792+0000 7f3ac67fc640 1 -- 172.21.15.78:0/1950475556 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 5177+0+0 (secure 0 0 0) 0x7f3acc083bb0 con 0x7f3abc003f00 2023-11-28T20:02:03.798 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:03.792+0000 7f3ad5499640 1 --2- 172.21.15.78:0/1950475556 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f3ab4066460 0x7f3ab4068920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:02:03.798 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:03.792+0000 7f3ad5499640 1 --2- 172.21.15.78:0/1950475556 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f3ab4066460 0x7f3ab4068920 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f3ac00b0000 tx=0x7f3ac0008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:02:03.799 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:03.792+0000 7f3ac67fc640 1 -- 172.21.15.78:0/1950475556 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f3acc0512d0 con 0x7f3abc003f00 2023-11-28T20:02:04.004 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:04.000+0000 7f3ad7efe640 1 -- 172.21.15.78:0/1950475556 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f3ad00abdf0 con 0x7f3abc003f00 2023-11-28T20:02:04.005 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:04.000+0000 7f3ac67fc640 1 -- 172.21.15.78:0/1950475556 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v19) v1 ==== 80+0+5081 (secure 0 0 0) 0x7f3acc0548f0 con 0x7f3abc003f00 2023-11-28T20:02:04.005 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-11-28T20:02:04.005 INFO:teuthology.orchestra.run.smithi078.stdout:{ 2023-11-28T20:02:04.006 INFO:teuthology.orchestra.run.smithi078.stdout: "auth_dump": [ 2023-11-28T20:02:04.006 INFO:teuthology.orchestra.run.smithi078.stdout: { 2023-11-28T20:02:04.006 INFO:teuthology.orchestra.run.smithi078.stdout: "entity": "mds.a", 2023-11-28T20:02:04.006 INFO:teuthology.orchestra.run.smithi078.stdout: "key": "AQBORmZldezUHhAAmHx6/kut7l58IB6id26WJA==", 2023-11-28T20:02:04.006 INFO:teuthology.orchestra.run.smithi078.stdout: "caps": { 2023-11-28T20:02:04.007 INFO:teuthology.orchestra.run.smithi078.stdout: "mds": "allow", 2023-11-28T20:02:04.007 INFO:teuthology.orchestra.run.smithi078.stdout: "mgr": "allow *", 2023-11-28T20:02:04.007 INFO:teuthology.orchestra.run.smithi078.stdout: "mon": "allow *", 2023-11-28T20:02:04.007 INFO:teuthology.orchestra.run.smithi078.stdout: "osd": "allow *" 2023-11-28T20:02:04.007 INFO:teuthology.orchestra.run.smithi078.stdout: } 2023-11-28T20:02:04.007 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2023-11-28T20:02:04.007 INFO:teuthology.orchestra.run.smithi078.stdout: { 2023-11-28T20:02:04.008 INFO:teuthology.orchestra.run.smithi078.stdout: "entity": "mds.b", 2023-11-28T20:02:04.008 INFO:teuthology.orchestra.run.smithi078.stdout: "key": "AQBORmZltpo9KxAAF+26E+HxsJs4tdMBVMETKw==", 2023-11-28T20:02:04.008 INFO:teuthology.orchestra.run.smithi078.stdout: "caps": { 2023-11-28T20:02:04.008 INFO:teuthology.orchestra.run.smithi078.stdout: "mds": "allow", 2023-11-28T20:02:04.008 INFO:teuthology.orchestra.run.smithi078.stdout: "mgr": "allow *", 2023-11-28T20:02:04.008 INFO:teuthology.orchestra.run.smithi078.stdout: "mon": "allow *", 2023-11-28T20:02:04.008 INFO:teuthology.orchestra.run.smithi078.stdout: "osd": "allow *" 2023-11-28T20:02:04.008 INFO:teuthology.orchestra.run.smithi078.stdout: } 2023-11-28T20:02:04.008 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2023-11-28T20:02:04.009 INFO:teuthology.orchestra.run.smithi078.stdout: { 2023-11-28T20:02:04.009 INFO:teuthology.orchestra.run.smithi078.stdout: "entity": "mds.c", 2023-11-28T20:02:04.009 INFO:teuthology.orchestra.run.smithi078.stdout: "key": "AQBORmZlqQU8JhAAjJ7XKQDZbfNnj0FUsYHUXw==", 2023-11-28T20:02:04.009 INFO:teuthology.orchestra.run.smithi078.stdout: "caps": { 2023-11-28T20:02:04.009 INFO:teuthology.orchestra.run.smithi078.stdout: "mds": "allow", 2023-11-28T20:02:04.009 INFO:teuthology.orchestra.run.smithi078.stdout: "mgr": "allow *", 2023-11-28T20:02:04.009 INFO:teuthology.orchestra.run.smithi078.stdout: "mon": "allow *", 2023-11-28T20:02:04.009 INFO:teuthology.orchestra.run.smithi078.stdout: "osd": "allow *" 2023-11-28T20:02:04.009 INFO:teuthology.orchestra.run.smithi078.stdout: } 2023-11-28T20:02:04.009 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2023-11-28T20:02:04.009 INFO:teuthology.orchestra.run.smithi078.stdout: { 2023-11-28T20:02:04.009 INFO:teuthology.orchestra.run.smithi078.stdout: "entity": "mds.d", 2023-11-28T20:02:04.010 INFO:teuthology.orchestra.run.smithi078.stdout: "key": "AQBORmZlcOaPMhAAABmFnot+b8fMIUvIIJMrtA==", 2023-11-28T20:02:04.010 INFO:teuthology.orchestra.run.smithi078.stdout: "caps": { 2023-11-28T20:02:04.010 INFO:teuthology.orchestra.run.smithi078.stdout: "mds": "allow", 2023-11-28T20:02:04.010 INFO:teuthology.orchestra.run.smithi078.stdout: "mgr": "allow *", 2023-11-28T20:02:04.010 INFO:teuthology.orchestra.run.smithi078.stdout: "mon": "allow *", 2023-11-28T20:02:04.010 INFO:teuthology.orchestra.run.smithi078.stdout: "osd": "allow *" 2023-11-28T20:02:04.010 INFO:teuthology.orchestra.run.smithi078.stdout: } 2023-11-28T20:02:04.010 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2023-11-28T20:02:04.010 INFO:teuthology.orchestra.run.smithi078.stdout: { 2023-11-28T20:02:04.010 INFO:teuthology.orchestra.run.smithi078.stdout: "entity": "osd.0", 2023-11-28T20:02:04.010 INFO:teuthology.orchestra.run.smithi078.stdout: "key": "AQBSRmZllQa4CRAAUz2YsYjsIf+SX/HkkQjzNw==", 2023-11-28T20:02:04.010 INFO:teuthology.orchestra.run.smithi078.stdout: "caps": { 2023-11-28T20:02:04.011 INFO:teuthology.orchestra.run.smithi078.stdout: "mgr": "allow profile osd", 2023-11-28T20:02:04.011 INFO:teuthology.orchestra.run.smithi078.stdout: "mon": "allow profile osd", 2023-11-28T20:02:04.011 INFO:teuthology.orchestra.run.smithi078.stdout: "osd": "allow *" 2023-11-28T20:02:04.011 INFO:teuthology.orchestra.run.smithi078.stdout: } 2023-11-28T20:02:04.011 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2023-11-28T20:02:04.011 INFO:teuthology.orchestra.run.smithi078.stdout: { 2023-11-28T20:02:04.011 INFO:teuthology.orchestra.run.smithi078.stdout: "entity": "osd.1", 2023-11-28T20:02:04.011 INFO:teuthology.orchestra.run.smithi078.stdout: "key": "AQBVRmZlrRCFEBAA+6glXV0u+NS4bF4DEGymmg==", 2023-11-28T20:02:04.011 INFO:teuthology.orchestra.run.smithi078.stdout: "caps": { 2023-11-28T20:02:04.011 INFO:teuthology.orchestra.run.smithi078.stdout: "mgr": "allow profile osd", 2023-11-28T20:02:04.011 INFO:teuthology.orchestra.run.smithi078.stdout: "mon": "allow profile osd", 2023-11-28T20:02:04.011 INFO:teuthology.orchestra.run.smithi078.stdout: "osd": "allow *" 2023-11-28T20:02:04.012 INFO:teuthology.orchestra.run.smithi078.stdout: } 2023-11-28T20:02:04.012 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2023-11-28T20:02:04.012 INFO:teuthology.orchestra.run.smithi078.stdout: { 2023-11-28T20:02:04.012 INFO:teuthology.orchestra.run.smithi078.stdout: "entity": "osd.2", 2023-11-28T20:02:04.012 INFO:teuthology.orchestra.run.smithi078.stdout: "key": "AQBYRmZlfcFfFxAApsrWaESm1Utd6BLazDsCIw==", 2023-11-28T20:02:04.012 INFO:teuthology.orchestra.run.smithi078.stdout: "caps": { 2023-11-28T20:02:04.012 INFO:teuthology.orchestra.run.smithi078.stdout: "mgr": "allow profile osd", 2023-11-28T20:02:04.012 INFO:teuthology.orchestra.run.smithi078.stdout: "mon": "allow profile osd", 2023-11-28T20:02:04.012 INFO:teuthology.orchestra.run.smithi078.stdout: "osd": "allow *" 2023-11-28T20:02:04.012 INFO:teuthology.orchestra.run.smithi078.stdout: } 2023-11-28T20:02:04.012 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2023-11-28T20:02:04.012 INFO:teuthology.orchestra.run.smithi078.stdout: { 2023-11-28T20:02:04.012 INFO:teuthology.orchestra.run.smithi078.stdout: "entity": "osd.3", 2023-11-28T20:02:04.013 INFO:teuthology.orchestra.run.smithi078.stdout: "key": "AQBbRmZlc7KQHRAA4Y4BYxG7CSLpPpGx9mP5BA==", 2023-11-28T20:02:04.013 INFO:teuthology.orchestra.run.smithi078.stdout: "caps": { 2023-11-28T20:02:04.013 INFO:teuthology.orchestra.run.smithi078.stdout: "mgr": "allow profile osd", 2023-11-28T20:02:04.013 INFO:teuthology.orchestra.run.smithi078.stdout: "mon": "allow profile osd", 2023-11-28T20:02:04.013 INFO:teuthology.orchestra.run.smithi078.stdout: "osd": "allow *" 2023-11-28T20:02:04.013 INFO:teuthology.orchestra.run.smithi078.stdout: } 2023-11-28T20:02:04.013 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2023-11-28T20:02:04.013 INFO:teuthology.orchestra.run.smithi078.stdout: { 2023-11-28T20:02:04.013 INFO:teuthology.orchestra.run.smithi078.stdout: "entity": "osd.4", 2023-11-28T20:02:04.013 INFO:teuthology.orchestra.run.smithi078.stdout: "key": "AQBhRmZlU5jVJhAAnM5Ow5whdkZS0cY13ehg0Q==", 2023-11-28T20:02:04.013 INFO:teuthology.orchestra.run.smithi078.stdout: "caps": { 2023-11-28T20:02:04.013 INFO:teuthology.orchestra.run.smithi078.stdout: "mgr": "allow profile osd", 2023-11-28T20:02:04.014 INFO:teuthology.orchestra.run.smithi078.stdout: "mon": "allow profile osd", 2023-11-28T20:02:04.014 INFO:teuthology.orchestra.run.smithi078.stdout: "osd": "allow *" 2023-11-28T20:02:04.014 INFO:teuthology.orchestra.run.smithi078.stdout: } 2023-11-28T20:02:04.014 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2023-11-28T20:02:04.014 INFO:teuthology.orchestra.run.smithi078.stdout: { 2023-11-28T20:02:04.014 INFO:teuthology.orchestra.run.smithi078.stdout: "entity": "osd.5", 2023-11-28T20:02:04.014 INFO:teuthology.orchestra.run.smithi078.stdout: "key": "AQBkRmZlV0qxMBAAwuuKXOx2QOKWxJlY47Z8gw==", 2023-11-28T20:02:04.014 INFO:teuthology.orchestra.run.smithi078.stdout: "caps": { 2023-11-28T20:02:04.014 INFO:teuthology.orchestra.run.smithi078.stdout: "mgr": "allow profile osd", 2023-11-28T20:02:04.014 INFO:teuthology.orchestra.run.smithi078.stdout: "mon": "allow profile osd", 2023-11-28T20:02:04.014 INFO:teuthology.orchestra.run.smithi078.stdout: "osd": "allow *" 2023-11-28T20:02:04.014 INFO:teuthology.orchestra.run.smithi078.stdout: } 2023-11-28T20:02:04.015 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2023-11-28T20:02:04.015 INFO:teuthology.orchestra.run.smithi078.stdout: { 2023-11-28T20:02:04.015 INFO:teuthology.orchestra.run.smithi078.stdout: "entity": "osd.6", 2023-11-28T20:02:04.015 INFO:teuthology.orchestra.run.smithi078.stdout: "key": "AQBnRmZln6R8NhAAu+46Z8Qb0mXkyMx5W2U/oA==", 2023-11-28T20:02:04.015 INFO:teuthology.orchestra.run.smithi078.stdout: "caps": { 2023-11-28T20:02:04.015 INFO:teuthology.orchestra.run.smithi078.stdout: "mgr": "allow profile osd", 2023-11-28T20:02:04.015 INFO:teuthology.orchestra.run.smithi078.stdout: "mon": "allow profile osd", 2023-11-28T20:02:04.015 INFO:teuthology.orchestra.run.smithi078.stdout: "osd": "allow *" 2023-11-28T20:02:04.016 INFO:teuthology.orchestra.run.smithi078.stdout: } 2023-11-28T20:02:04.016 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2023-11-28T20:02:04.016 INFO:teuthology.orchestra.run.smithi078.stdout: { 2023-11-28T20:02:04.016 INFO:teuthology.orchestra.run.smithi078.stdout: "entity": "osd.7", 2023-11-28T20:02:04.016 INFO:teuthology.orchestra.run.smithi078.stdout: "key": "AQBrRmZl8+xEBBAAx7CjmIrEZseolpBrEDAJog==", 2023-11-28T20:02:04.016 INFO:teuthology.orchestra.run.smithi078.stdout: "caps": { 2023-11-28T20:02:04.016 INFO:teuthology.orchestra.run.smithi078.stdout: "mgr": "allow profile osd", 2023-11-28T20:02:04.016 INFO:teuthology.orchestra.run.smithi078.stdout: "mon": "allow profile osd", 2023-11-28T20:02:04.016 INFO:teuthology.orchestra.run.smithi078.stdout: "osd": "allow *" 2023-11-28T20:02:04.016 INFO:teuthology.orchestra.run.smithi078.stdout: } 2023-11-28T20:02:04.016 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2023-11-28T20:02:04.017 INFO:teuthology.orchestra.run.smithi078.stdout: { 2023-11-28T20:02:04.017 INFO:teuthology.orchestra.run.smithi078.stdout: "entity": "client.0", 2023-11-28T20:02:04.017 INFO:teuthology.orchestra.run.smithi078.stdout: "key": "AQBORmZlPLeINhAAMdB7hy84hvX1S/pHYfkeJg==", 2023-11-28T20:02:04.017 INFO:teuthology.orchestra.run.smithi078.stdout: "caps": { 2023-11-28T20:02:04.017 INFO:teuthology.orchestra.run.smithi078.stdout: "mds": "allow", 2023-11-28T20:02:04.017 INFO:teuthology.orchestra.run.smithi078.stdout: "mon": "allow r", 2023-11-28T20:02:04.017 INFO:teuthology.orchestra.run.smithi078.stdout: "osd": "allow rw tag cephfs data=cephfs" 2023-11-28T20:02:04.017 INFO:teuthology.orchestra.run.smithi078.stdout: } 2023-11-28T20:02:04.017 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2023-11-28T20:02:04.018 INFO:teuthology.orchestra.run.smithi078.stdout: { 2023-11-28T20:02:04.018 INFO:teuthology.orchestra.run.smithi078.stdout: "entity": "client.1", 2023-11-28T20:02:04.018 INFO:teuthology.orchestra.run.smithi078.stdout: "key": "AQBORmZlzBgfOhAAm6M8Y+12MlLdVkJnMmK9BQ==", 2023-11-28T20:02:04.018 INFO:teuthology.orchestra.run.smithi078.stdout: "caps": { 2023-11-28T20:02:04.018 INFO:teuthology.orchestra.run.smithi078.stdout: "mds": "allow", 2023-11-28T20:02:04.018 INFO:teuthology.orchestra.run.smithi078.stdout: "mon": "allow r", 2023-11-28T20:02:04.018 INFO:teuthology.orchestra.run.smithi078.stdout: "osd": "allow rw pool=cephfs2_data" 2023-11-28T20:02:04.018 INFO:teuthology.orchestra.run.smithi078.stdout: } 2023-11-28T20:02:04.018 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2023-11-28T20:02:04.019 INFO:teuthology.orchestra.run.smithi078.stdout: { 2023-11-28T20:02:04.019 INFO:teuthology.orchestra.run.smithi078.stdout: "entity": "client.admin", 2023-11-28T20:02:04.019 INFO:teuthology.orchestra.run.smithi078.stdout: "key": "AQBORmZl8EaQAhAAmfstKsxO4dpR94AlFoDQpg==", 2023-11-28T20:02:04.019 INFO:teuthology.orchestra.run.smithi078.stdout: "caps": { 2023-11-28T20:02:04.019 INFO:teuthology.orchestra.run.smithi078.stdout: "mds": "allow *", 2023-11-28T20:02:04.019 INFO:teuthology.orchestra.run.smithi078.stdout: "mgr": "allow *", 2023-11-28T20:02:04.019 INFO:teuthology.orchestra.run.smithi078.stdout: "mon": "allow *", 2023-11-28T20:02:04.019 INFO:teuthology.orchestra.run.smithi078.stdout: "osd": "allow *" 2023-11-28T20:02:04.019 INFO:teuthology.orchestra.run.smithi078.stdout: } 2023-11-28T20:02:04.019 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2023-11-28T20:02:04.019 INFO:teuthology.orchestra.run.smithi078.stdout: { 2023-11-28T20:02:04.020 INFO:teuthology.orchestra.run.smithi078.stdout: "entity": "client.testuser", 2023-11-28T20:02:04.020 INFO:teuthology.orchestra.run.smithi078.stdout: "key": "AQAhR2ZlyvZKCRAAIn4WEgjDDSb+3VyIKui1gA==", 2023-11-28T20:02:04.020 INFO:teuthology.orchestra.run.smithi078.stdout: "caps": { 2023-11-28T20:02:04.020 INFO:teuthology.orchestra.run.smithi078.stdout: "mds": "allow rw fsname=cephfs", 2023-11-28T20:02:04.020 INFO:teuthology.orchestra.run.smithi078.stdout: "mon": "allow rw fsname=cephfs, allow rw fsname=cephfs2", 2023-11-28T20:02:04.020 INFO:teuthology.orchestra.run.smithi078.stdout: "osd": "allow rw tag cephfs data=cephfs, allow rw tag cephfs data=cephfs2" 2023-11-28T20:02:04.020 INFO:teuthology.orchestra.run.smithi078.stdout: } 2023-11-28T20:02:04.020 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2023-11-28T20:02:04.020 INFO:teuthology.orchestra.run.smithi078.stdout: { 2023-11-28T20:02:04.020 INFO:teuthology.orchestra.run.smithi078.stdout: "entity": "mgr.x", 2023-11-28T20:02:04.020 INFO:teuthology.orchestra.run.smithi078.stdout: "key": "AQBORmZl1xbAGhAAVP5dcAqZPly145Skxk8QjA==", 2023-11-28T20:02:04.020 INFO:teuthology.orchestra.run.smithi078.stdout: "caps": { 2023-11-28T20:02:04.021 INFO:teuthology.orchestra.run.smithi078.stdout: "mds": "allow *", 2023-11-28T20:02:04.021 INFO:teuthology.orchestra.run.smithi078.stdout: "mon": "allow profile mgr", 2023-11-28T20:02:04.021 INFO:teuthology.orchestra.run.smithi078.stdout: "osd": "allow *" 2023-11-28T20:02:04.021 INFO:teuthology.orchestra.run.smithi078.stdout: } 2023-11-28T20:02:04.021 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2023-11-28T20:02:04.021 INFO:teuthology.orchestra.run.smithi078.stdout: { 2023-11-28T20:02:04.021 INFO:teuthology.orchestra.run.smithi078.stdout: "entity": "mgr.y", 2023-11-28T20:02:04.021 INFO:teuthology.orchestra.run.smithi078.stdout: "key": "AQBORmZlQkLqFhAA1lMuqxTImbm69hxar4QpXg==", 2023-11-28T20:02:04.021 INFO:teuthology.orchestra.run.smithi078.stdout: "caps": { 2023-11-28T20:02:04.021 INFO:teuthology.orchestra.run.smithi078.stdout: "mds": "allow *", 2023-11-28T20:02:04.021 INFO:teuthology.orchestra.run.smithi078.stdout: "mon": "allow profile mgr", 2023-11-28T20:02:04.022 INFO:teuthology.orchestra.run.smithi078.stdout: "osd": "allow *" 2023-11-28T20:02:04.022 INFO:teuthology.orchestra.run.smithi078.stdout: } 2023-11-28T20:02:04.022 INFO:teuthology.orchestra.run.smithi078.stdout: } 2023-11-28T20:02:04.022 INFO:teuthology.orchestra.run.smithi078.stdout: ] 2023-11-28T20:02:04.022 INFO:teuthology.orchestra.run.smithi078.stdout:} 2023-11-28T20:02:04.023 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:04.000+0000 7f3ad7efe640 1 -- 172.21.15.78:0/1950475556 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f3ab4066460 msgr2=0x7f3ab4068920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:02:04.023 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:04.000+0000 7f3ad7efe640 1 --2- 172.21.15.78:0/1950475556 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f3ab4066460 0x7f3ab4068920 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f3ac00b0000 tx=0x7f3ac0008040 comp rx=0 tx=0).stop 2023-11-28T20:02:04.023 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:04.000+0000 7f3ad7efe640 1 -- 172.21.15.78:0/1950475556 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3abc003f00 msgr2=0x7f3ad00c0e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:02:04.023 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:04.000+0000 7f3ad7efe640 1 --2- 172.21.15.78:0/1950475556 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3abc003f00 0x7f3ad00c0e30 secure :-1 s=READY pgs=867 cs=0 l=1 rev1=1 crypto rx=0x7f3acc00e7f0 tx=0x7f3acc00ecb0 comp rx=0 tx=0).stop 2023-11-28T20:02:04.023 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:04.000+0000 7f3ad7efe640 1 -- 172.21.15.78:0/1950475556 shutdown_connections 2023-11-28T20:02:04.023 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:04.000+0000 7f3ad7efe640 1 --2- 172.21.15.78:0/1950475556 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f3ab4066460 0x7f3ab4068920 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:04.023 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:04.000+0000 7f3ad7efe640 1 --2- 172.21.15.78:0/1950475556 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3ad00a8ed0 0x7f3ad00a9350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:04.024 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:04.000+0000 7f3ad7efe640 1 --2- 172.21.15.78:0/1950475556 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3ad014a830 0x7f3ad014ac90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:04.024 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:04.000+0000 7f3ad7efe640 1 --2- 172.21.15.78:0/1950475556 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3abc003f00 0x7f3ad00c0e30 unknown :-1 s=CLOSED pgs=867 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:04.024 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:04.000+0000 7f3ad7efe640 1 -- 172.21.15.78:0/1950475556 >> 172.21.15.78:0/1950475556 conn(0x7f3ad00a7810 msgr2=0x7f3ad014b420 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:02:04.024 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:04.000+0000 7f3ad7efe640 1 -- 172.21.15.78:0/1950475556 shutdown_connections 2023-11-28T20:02:04.024 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:04.000+0000 7f3ad7efe640 1 -- 172.21.15.78:0/1950475556 wait complete. 2023-11-28T20:02:04.026 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.testuser 2023-11-28T20:02:04.163 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:04.160+0000 7fe1b005f640 1 Processor -- start 2023-11-28T20:02:04.164 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:04.160+0000 7fe1b005f640 1 -- start start 2023-11-28T20:02:04.165 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:04.160+0000 7fe1b005f640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fe1a815cba0 0x7fe1a806d160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:04.165 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:04.160+0000 7fe1b005f640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fe1a806d6a0 0x7fe1a80a9af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:04.165 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:04.160+0000 7fe1b005f640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe1a815c710 con 0x7fe1a8152d30 2023-11-28T20:02:04.165 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:04.160+0000 7fe1b005f640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe1a806c360 con 0x7fe1a815cba0 2023-11-28T20:02:04.165 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:04.160+0000 7fe1b005f640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe1a80c4040 con 0x7fe1a806d6a0 2023-11-28T20:02:04.165 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:04.160+0000 7fe1ad5fa640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fe1a815cba0 0x7fe1a806d160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:02:04.166 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:04.160+0000 7fe1ad5fa640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fe1a815cba0 0x7fe1a806d160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:44124/0 (socket says 172.21.15.78:44124) 2023-11-28T20:02:04.166 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:04.160+0000 7fe1ad5fa640 1 -- 172.21.15.78:0/1812425443 learned_addr learned my addr 172.21.15.78:0/1812425443 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T20:02:04.166 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:04.160+0000 7fe1ae5fc640 1 --2- 172.21.15.78:0/1812425443 >> v2:172.21.15.179:3300/0 conn(0x7fe1a806d6a0 0x7fe1a80a9af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:02:04.166 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:04.160+0000 7fe1ad5fa640 1 -- 172.21.15.78:0/1812425443 >> v2:172.21.15.179:3300/0 conn(0x7fe1a806d6a0 msgr2=0x7fe1a80a9af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:02:04.166 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:04.160+0000 7fe1ad5fa640 1 --2- 172.21.15.78:0/1812425443 >> v2:172.21.15.179:3300/0 conn(0x7fe1a806d6a0 0x7fe1a80a9af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:04.167 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:04.160+0000 7fe1ad5fa640 1 -- 172.21.15.78:0/1812425443 >> v1:172.21.15.179:6789/0 conn(0x7fe1a8152d30 legacy=0x7fe1a80c3930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:02:04.167 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:04.160+0000 7fe1ad5fa640 1 -- 172.21.15.78:0/1812425443 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1a80aa820 con 0x7fe1a815cba0 2023-11-28T20:02:04.168 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:04.164+0000 7fe1ad5fa640 1 --2- 172.21.15.78:0/1812425443 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe1a815cba0 0x7fe1a806d160 secure :-1 s=READY pgs=868 cs=0 l=1 rev1=1 crypto rx=0x7fe1a80a56e0 tx=0x7fe19801c500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b2c273972d5e7333 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:02:04.169 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:04.164+0000 7fe1acdf9640 1 -- 172.21.15.78:0/1812425443 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1980ab610 con 0x7fe1a815cba0 2023-11-28T20:02:04.169 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:04.164+0000 7fe1acdf9640 1 -- 172.21.15.78:0/1812425443 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe1980ab770 con 0x7fe1a815cba0 2023-11-28T20:02:04.169 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:04.164+0000 7fe1acdf9640 1 -- 172.21.15.78:0/1812425443 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1980abb00 con 0x7fe1a815cba0 2023-11-28T20:02:04.170 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:04.164+0000 7fe1b005f640 1 -- 172.21.15.78:0/1812425443 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe1a815cba0 msgr2=0x7fe1a806d160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:02:04.170 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:04.164+0000 7fe1b005f640 1 --2- 172.21.15.78:0/1812425443 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe1a815cba0 0x7fe1a806d160 secure :-1 s=READY pgs=868 cs=0 l=1 rev1=1 crypto rx=0x7fe1a80a56e0 tx=0x7fe19801c500 comp rx=0 tx=0).stop 2023-11-28T20:02:04.170 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:04.164+0000 7fe1b005f640 1 -- 172.21.15.78:0/1812425443 shutdown_connections 2023-11-28T20:02:04.170 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:04.164+0000 7fe1b005f640 1 --2- 172.21.15.78:0/1812425443 >> v2:172.21.15.179:3300/0 conn(0x7fe1a806d6a0 0x7fe1a80a9af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:04.170 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:04.164+0000 7fe1b005f640 1 --2- 172.21.15.78:0/1812425443 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe1a815cba0 0x7fe1a806d160 unknown :-1 s=CLOSED pgs=868 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:04.170 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:04.164+0000 7fe1b005f640 1 -- 172.21.15.78:0/1812425443 >> 172.21.15.78:0/1812425443 conn(0x7fe1a806b220 msgr2=0x7fe1a80a77e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:02:04.170 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:04.164+0000 7fe1b005f640 1 -- 172.21.15.78:0/1812425443 shutdown_connections 2023-11-28T20:02:04.171 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:04.164+0000 7fe1b005f640 1 -- 172.21.15.78:0/1812425443 wait complete. 2023-11-28T20:02:04.171 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:04.168+0000 7fe1b005f640 1 Processor -- start 2023-11-28T20:02:04.171 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:04.168+0000 7fe1b005f640 1 -- start start 2023-11-28T20:02:04.174 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:04.168+0000 7fe1b005f640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe1a806d6a0 0x7fe1a81f1c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:04.174 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:04.168+0000 7fe1b005f640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe1a8152d30 0x7fe1a81501a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:04.174 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:04.168+0000 7fe1b005f640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe1a815cba0 0x7fe1a80a5e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:04.174 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:04.168+0000 7fe1b005f640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1a8154110 con 0x7fe1a815cba0 2023-11-28T20:02:04.174 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:04.168+0000 7fe1b005f640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1a81f2240 con 0x7fe1a806d6a0 2023-11-28T20:02:04.174 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:04.168+0000 7fe1b005f640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1a81f2520 con 0x7fe1a8152d30 2023-11-28T20:02:04.174 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:04.168+0000 7fe1ae5fc640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe1a815cba0 0x7fe1a80a5e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:02:04.174 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:04.168+0000 7fe1ae5fc640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe1a815cba0 0x7fe1a80a5e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:44136/0 (socket says 172.21.15.78:44136) 2023-11-28T20:02:04.174 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:04.168+0000 7fe1ae5fc640 1 -- 172.21.15.78:0/2173345652 learned_addr learned my addr 172.21.15.78:0/2173345652 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T20:02:04.174 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:04.168+0000 7fe1addfb640 1 --2- 172.21.15.78:0/2173345652 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe1a806d6a0 0x7fe1a81f1c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:02:04.175 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:04.168+0000 7fe1ad5fa640 1 --2- 172.21.15.78:0/2173345652 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe1a8152d30 0x7fe1a81501a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:02:04.175 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:04.168+0000 7fe1ae5fc640 1 -- 172.21.15.78:0/2173345652 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe1a8152d30 msgr2=0x7fe1a81501a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:02:04.175 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:04.168+0000 7fe1ae5fc640 1 --2- 172.21.15.78:0/2173345652 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe1a8152d30 0x7fe1a81501a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:04.175 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:04.168+0000 7fe1ae5fc640 1 -- 172.21.15.78:0/2173345652 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe1a806d6a0 msgr2=0x7fe1a81f1c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:02:04.175 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:04.168+0000 7fe1ae5fc640 1 --2- 172.21.15.78:0/2173345652 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe1a806d6a0 0x7fe1a81f1c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:04.175 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:04.168+0000 7fe1ae5fc640 1 -- 172.21.15.78:0/2173345652 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1980094d0 con 0x7fe1a815cba0 2023-11-28T20:02:04.175 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:04.168+0000 7fe1ae5fc640 1 --2- 172.21.15.78:0/2173345652 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe1a815cba0 0x7fe1a80a5e60 secure :-1 s=READY pgs=869 cs=0 l=1 rev1=1 crypto rx=0x7fe1a0007e40 tx=0x7fe1a000e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:02:04.175 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:04.168+0000 7fe19e7fc640 1 -- 172.21.15.78:0/2173345652 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1a0014620 con 0x7fe1a815cba0 2023-11-28T20:02:04.175 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:04.168+0000 7fe19e7fc640 1 -- 172.21.15.78:0/2173345652 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe1a000ee90 con 0x7fe1a815cba0 2023-11-28T20:02:04.175 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:04.168+0000 7fe1b005f640 1 -- 172.21.15.78:0/2173345652 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe1a81f2800 con 0x7fe1a815cba0 2023-11-28T20:02:04.175 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:04.168+0000 7fe19e7fc640 1 -- 172.21.15.78:0/2173345652 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1a00149e0 con 0x7fe1a815cba0 2023-11-28T20:02:04.175 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:04.168+0000 7fe1b005f640 1 -- 172.21.15.78:0/2173345652 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe1a80a5940 con 0x7fe1a815cba0 2023-11-28T20:02:04.176 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:04.168+0000 7fe1b005f640 1 -- 172.21.15.78:0/2173345652 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe1a8067630 con 0x7fe1a815cba0 2023-11-28T20:02:04.176 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:04.172+0000 7fe19e7fc640 1 -- 172.21.15.78:0/2173345652 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fe1a0014b40 con 0x7fe1a815cba0 2023-11-28T20:02:04.177 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:04.172+0000 7fe19e7fc640 1 --2- 172.21.15.78:0/2173345652 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fe18c0664a0 0x7fe18c068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:04.177 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:04.172+0000 7fe19e7fc640 1 -- 172.21.15.78:0/2173345652 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 5177+0+0 (secure 0 0 0) 0x7fe1a0084420 con 0x7fe1a815cba0 2023-11-28T20:02:04.177 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:04.172+0000 7fe1addfb640 1 --2- 172.21.15.78:0/2173345652 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fe18c0664a0 0x7fe18c068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:02:04.177 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:04.172+0000 7fe1addfb640 1 --2- 172.21.15.78:0/2173345652 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fe18c0664a0 0x7fe18c068960 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7fe1a814d4e0 tx=0x7fe1a4009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:02:04.181 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:04.176+0000 7fe19e7fc640 1 -- 172.21.15.78:0/2173345652 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fe1a0051bf0 con 0x7fe1a815cba0 2023-11-28T20:02:04.384 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:04.380+0000 7fe1b005f640 1 -- 172.21.15.78:0/2173345652 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.testuser"} v 0) v1 -- 0x7fe1a8073a30 con 0x7fe1a815cba0 2023-11-28T20:02:04.387 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:04.380+0000 7fe19e7fc640 1 -- 172.21.15.78:0/2173345652 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.testuser"}]=0 v20) v1 ==== 85+0+0 (secure 0 0 0) 0x7fe1a0055210 con 0x7fe1a815cba0 2023-11-28T20:02:04.389 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:04.384+0000 7fe1b005f640 1 -- 172.21.15.78:0/2173345652 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fe18c0664a0 msgr2=0x7fe18c068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:02:04.389 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:04.384+0000 7fe1b005f640 1 --2- 172.21.15.78:0/2173345652 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fe18c0664a0 0x7fe18c068960 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7fe1a814d4e0 tx=0x7fe1a4009040 comp rx=0 tx=0).stop 2023-11-28T20:02:04.390 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:04.384+0000 7fe1b005f640 1 -- 172.21.15.78:0/2173345652 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe1a815cba0 msgr2=0x7fe1a80a5e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:02:04.390 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:04.384+0000 7fe1b005f640 1 --2- 172.21.15.78:0/2173345652 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe1a815cba0 0x7fe1a80a5e60 secure :-1 s=READY pgs=869 cs=0 l=1 rev1=1 crypto rx=0x7fe1a0007e40 tx=0x7fe1a000e4b0 comp rx=0 tx=0).stop 2023-11-28T20:02:04.390 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:04.384+0000 7fe1b005f640 1 -- 172.21.15.78:0/2173345652 shutdown_connections 2023-11-28T20:02:04.390 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:04.384+0000 7fe1b005f640 1 --2- 172.21.15.78:0/2173345652 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fe18c0664a0 0x7fe18c068960 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:04.390 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:04.384+0000 7fe1b005f640 1 --2- 172.21.15.78:0/2173345652 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe1a8152d30 0x7fe1a81501a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:04.391 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:04.384+0000 7fe1b005f640 1 --2- 172.21.15.78:0/2173345652 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe1a815cba0 0x7fe1a80a5e60 unknown :-1 s=CLOSED pgs=869 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:04.391 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:04.384+0000 7fe1b005f640 1 --2- 172.21.15.78:0/2173345652 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe1a806d6a0 0x7fe1a81f1c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:04.391 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:04.384+0000 7fe1b005f640 1 -- 172.21.15.78:0/2173345652 >> 172.21.15.78:0/2173345652 conn(0x7fe1a806b220 msgr2=0x7fe1a815aef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:02:04.391 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:04.384+0000 7fe1b005f640 1 -- 172.21.15.78:0/2173345652 shutdown_connections 2023-11-28T20:02:04.391 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:04.384+0000 7fe1b005f640 1 -- 172.21.15.78:0/2173345652 wait complete. 2023-11-28T20:02:04.408 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-28T20:02:04.459 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T20:02:04.462 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T20:02:04.547 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:04.540+0000 7fb71de32640 1 Processor -- start 2023-11-28T20:02:04.547 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:04.540+0000 7fb71de32640 1 -- start start 2023-11-28T20:02:04.549 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:04.544+0000 7fb71de32640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb71814e3f0 0x7fb7180bfce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:04.549 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:04.544+0000 7fb71de32640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fb71806bef0 0x7fb7180c41f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:04.550 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:04.544+0000 7fb71de32640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fb7180c4730 0x7fb71806c5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:04.550 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:04.544+0000 7fb71de32640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb718151690 con 0x7fb7180c4730 2023-11-28T20:02:04.550 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:04.544+0000 7fb71de32640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb718151bc0 con 0x7fb71806bef0 2023-11-28T20:02:04.550 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:04.544+0000 7fb71de32640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb7181518e0 con 0x7fb71814e3f0 2023-11-28T20:02:04.550 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:04.544+0000 7fb717fff640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fb7180c4730 0x7fb71806c5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:02:04.550 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:04.544+0000 7fb717fff640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fb7180c4730 0x7fb71806c5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:44142/0 (socket says 172.21.15.78:44142) 2023-11-28T20:02:04.551 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:04.544+0000 7fb717fff640 1 -- 172.21.15.78:0/2199206174 learned_addr learned my addr 172.21.15.78:0/2199206174 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T20:02:04.551 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:04.544+0000 7fb70ffff640 1 --2- 172.21.15.78:0/2199206174 >> v2:172.21.15.179:3300/0 conn(0x7fb71806bef0 0x7fb7180c41f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:02:04.551 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:04.544+0000 7fb7177fe640 1 --2- 172.21.15.78:0/2199206174 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb71814e3f0 0x7fb7180bfce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:02:04.551 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:04.544+0000 7fb717fff640 1 -- 172.21.15.78:0/2199206174 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb71814e3f0 msgr2=0x7fb7180bfce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:02:04.551 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:04.544+0000 7fb717fff640 1 --2- 172.21.15.78:0/2199206174 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb71814e3f0 0x7fb7180bfce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:04.552 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:04.544+0000 7fb717fff640 1 -- 172.21.15.78:0/2199206174 >> v2:172.21.15.179:3300/0 conn(0x7fb71806bef0 msgr2=0x7fb7180c41f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:02:04.552 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:04.544+0000 7fb717fff640 1 --2- 172.21.15.78:0/2199206174 >> v2:172.21.15.179:3300/0 conn(0x7fb71806bef0 0x7fb7180c41f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:04.552 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:04.544+0000 7fb717fff640 1 -- 172.21.15.78:0/2199206174 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7180c1de0 con 0x7fb7180c4730 2023-11-28T20:02:04.552 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:04.544+0000 7fb7177fe640 1 --2- 172.21.15.78:0/2199206174 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb71814e3f0 0x7fb7180bfce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T20:02:04.553 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:04.548+0000 7fb717fff640 1 --2- 172.21.15.78:0/2199206174 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb7180c4730 0x7fb71806c5b0 secure :-1 s=READY pgs=870 cs=0 l=1 rev1=1 crypto rx=0x7fb718066de0 tx=0x7fb71001c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8553efdefe04c7c4 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:02:04.553 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:04.548+0000 7fb716ffd640 1 -- 172.21.15.78:0/2199206174 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7100a5620 con 0x7fb7180c4730 2023-11-28T20:02:04.554 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:04.548+0000 7fb716ffd640 1 -- 172.21.15.78:0/2199206174 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb7100a5780 con 0x7fb7180c4730 2023-11-28T20:02:04.554 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:04.548+0000 7fb716ffd640 1 -- 172.21.15.78:0/2199206174 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7100a5b10 con 0x7fb7180c4730 2023-11-28T20:02:04.554 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:04.548+0000 7fb71de32640 1 -- 172.21.15.78:0/2199206174 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb7180c4730 msgr2=0x7fb71806c5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:02:04.554 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:04.548+0000 7fb71de32640 1 --2- 172.21.15.78:0/2199206174 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb7180c4730 0x7fb71806c5b0 secure :-1 s=READY pgs=870 cs=0 l=1 rev1=1 crypto rx=0x7fb718066de0 tx=0x7fb71001c910 comp rx=0 tx=0).stop 2023-11-28T20:02:04.554 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:04.548+0000 7fb71de32640 1 -- 172.21.15.78:0/2199206174 shutdown_connections 2023-11-28T20:02:04.554 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:04.548+0000 7fb71de32640 1 --2- 172.21.15.78:0/2199206174 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb7180c4730 0x7fb71806c5b0 unknown :-1 s=CLOSED pgs=870 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:04.555 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:04.548+0000 7fb71de32640 1 --2- 172.21.15.78:0/2199206174 >> v2:172.21.15.179:3300/0 conn(0x7fb71806bef0 0x7fb7180c41f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:04.555 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:04.548+0000 7fb71de32640 1 --2- 172.21.15.78:0/2199206174 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb71814e3f0 0x7fb7180bfce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:04.555 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:04.548+0000 7fb71de32640 1 -- 172.21.15.78:0/2199206174 >> 172.21.15.78:0/2199206174 conn(0x7fb7180a7810 msgr2=0x7fb7180a7c20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:02:04.555 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:04.548+0000 7fb71de32640 1 -- 172.21.15.78:0/2199206174 shutdown_connections 2023-11-28T20:02:04.555 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:04.548+0000 7fb71de32640 1 -- 172.21.15.78:0/2199206174 wait complete. 2023-11-28T20:02:04.557 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:04.548+0000 7fb71de32640 1 Processor -- start 2023-11-28T20:02:04.557 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:04.548+0000 7fb71de32640 1 -- start start 2023-11-28T20:02:04.558 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:04.552+0000 7fb71de32640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb71806bef0 0x7fb71814ca20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:04.558 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:04.552+0000 7fb71de32640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb7180c4730 0x7fb71814a0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:04.558 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:04.552+0000 7fb71de32640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb71814e3f0 0x7fb718144c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:04.558 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:04.552+0000 7fb71de32640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb71814fb60 con 0x7fb7180c4730 2023-11-28T20:02:04.558 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:04.552+0000 7fb71de32640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb71814d0b0 con 0x7fb71814e3f0 2023-11-28T20:02:04.558 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:04.552+0000 7fb71de32640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb71814d390 con 0x7fb71806bef0 2023-11-28T20:02:04.558 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:04.552+0000 7fb70ffff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb7180c4730 0x7fb71814a0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:02:04.559 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:04.552+0000 7fb70ffff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb7180c4730 0x7fb71814a0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:44152/0 (socket says 172.21.15.78:44152) 2023-11-28T20:02:04.559 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:04.552+0000 7fb70ffff640 1 -- 172.21.15.78:0/884248603 learned_addr learned my addr 172.21.15.78:0/884248603 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T20:02:04.559 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:04.552+0000 7fb7177fe640 1 --2- 172.21.15.78:0/884248603 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb71806bef0 0x7fb71814ca20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:02:04.559 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:04.552+0000 7fb717fff640 1 --2- 172.21.15.78:0/884248603 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb71814e3f0 0x7fb718144c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:02:04.559 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:04.552+0000 7fb70ffff640 1 -- 172.21.15.78:0/884248603 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb71806bef0 msgr2=0x7fb71814ca20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:02:04.559 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:04.552+0000 7fb70ffff640 1 --2- 172.21.15.78:0/884248603 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb71806bef0 0x7fb71814ca20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:04.559 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:04.552+0000 7fb70ffff640 1 -- 172.21.15.78:0/884248603 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb71814e3f0 msgr2=0x7fb718144c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:02:04.560 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:04.552+0000 7fb70ffff640 1 --2- 172.21.15.78:0/884248603 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb71814e3f0 0x7fb718144c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:04.560 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:04.552+0000 7fb70ffff640 1 -- 172.21.15.78:0/884248603 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb710009b30 con 0x7fb7180c4730 2023-11-28T20:02:04.560 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:04.552+0000 7fb717fff640 1 --2- 172.21.15.78:0/884248603 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb71814e3f0 0x7fb718144c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T20:02:04.560 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:04.552+0000 7fb70ffff640 1 --2- 172.21.15.78:0/884248603 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb7180c4730 0x7fb71814a0b0 secure :-1 s=READY pgs=871 cs=0 l=1 rev1=1 crypto rx=0x7fb70000e930 tx=0x7fb70000edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:02:04.560 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:04.552+0000 7fb714ff9640 1 -- 172.21.15.78:0/884248603 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb700009690 con 0x7fb7180c4730 2023-11-28T20:02:04.560 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:04.552+0000 7fb714ff9640 1 -- 172.21.15.78:0/884248603 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb70000ca00 con 0x7fb7180c4730 2023-11-28T20:02:04.561 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:04.552+0000 7fb71de32640 1 -- 172.21.15.78:0/884248603 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb71814f510 con 0x7fb7180c4730 2023-11-28T20:02:04.561 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:04.552+0000 7fb714ff9640 1 -- 172.21.15.78:0/884248603 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb70000cd70 con 0x7fb7180c4730 2023-11-28T20:02:04.561 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:04.552+0000 7fb71de32640 1 -- 172.21.15.78:0/884248603 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb71814d670 con 0x7fb7180c4730 2023-11-28T20:02:04.561 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:04.552+0000 7fb71de32640 1 -- 172.21.15.78:0/884248603 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb718067630 con 0x7fb7180c4730 2023-11-28T20:02:04.562 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:04.552+0000 7fb714ff9640 1 -- 172.21.15.78:0/884248603 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fb700013470 con 0x7fb7180c4730 2023-11-28T20:02:04.562 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:04.556+0000 7fb714ff9640 1 --2- 172.21.15.78:0/884248603 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fb6f80664a0 0x7fb6f8068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:04.562 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:04.556+0000 7fb714ff9640 1 -- 172.21.15.78:0/884248603 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 5177+0+0 (secure 0 0 0) 0x7fb700084230 con 0x7fb7180c4730 2023-11-28T20:02:04.562 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:04.556+0000 7fb7177fe640 1 --2- 172.21.15.78:0/884248603 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fb6f80664a0 0x7fb6f8068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:02:04.562 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:04.556+0000 7fb7177fe640 1 --2- 172.21.15.78:0/884248603 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fb6f80664a0 0x7fb6f8068960 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7fb70800d980 tx=0x7fb708008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:02:04.563 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:04.560+0000 7fb714ff9640 1 -- 172.21.15.78:0/884248603 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fb700051970 con 0x7fb7180c4730 2023-11-28T20:02:04.715 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:04.708+0000 7fb71de32640 1 -- 172.21.15.78:0/884248603 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb7180c1710 con 0x7fb7180c4730 2023-11-28T20:02:04.716 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:04.712+0000 7fb714ff9640 1 -- 172.21.15.78:0/884248603 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v77) v1 ==== 74+0+13039 (secure 0 0 0) 0x7fb700054f90 con 0x7fb7180c4730 2023-11-28T20:02:04.716 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-11-28T20:02:04.716 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":77,"fsid":"dd9780e8-3bda-44fa-a9f0-fa07d19d901d","created":"2023-11-28T19:58:40.969556+0000","modified":"2023-11-28T20:02:03.611767+0000","last_up_change":"2023-11-28T19:58:52.596716+0000","last_in_change":"2023-11-28T19:58:43.609275+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":12,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-28T19:58:54.011229+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e84245ac-b5da-429e-af18-39acaa2b33e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6800","nonce":3358701235},{"type":"v1","addr":"172.21.15.78:6801","nonce":3358701235}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6802","nonce":3358701235},{"type":"v1","addr":"172.21.15.78:6803","nonce":3358701235}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6806","nonce":3358701235},{"type":"v1","addr":"172.21.15.78:6807","nonce":3358701235}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6804","nonce":3358701235},{"type":"v1","addr":"172.21.15.78:6805","nonce":3358701235}]},"public_addr":"172.21.15.78:6801/3358701235","cluster_addr":"172.21.15.78:6803/3358701235","heartbeat_back_addr":"172.21.15.78:6807/3358701235","heartbeat_front_addr":"172.21.15.78:6805/3358701235","state":["exists","up"]},{"osd":1,"uuid":"e634831d-c4e2-48d9-870c-9556ae162981","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6808","nonce":3211476654},{"type":"v1","addr":"172.21.15.78:6809","nonce":3211476654}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6810","nonce":3211476654},{"type":"v1","addr":"172.21.15.78:6811","nonce":3211476654}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6814","nonce":3211476654},{"type":"v1","addr":"172.21.15.78:6815","nonce":3211476654}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6812","nonce":3211476654},{"type":"v1","addr":"172.21.15.78:6813","nonce":3211476654}]},"public_addr":"172.21.15.78:6809/3211476654","cluster_addr":"172.21.15.78:6811/3211476654","heartbeat_back_addr":"172.21.15.78:6815/3211476654","heartbeat_front_addr":"172.21.15.78:6813/3211476654","state":["exists","up"]},{"osd":2,"uuid":"274c8395-6534-41f0-b8fb-a00af8985aa8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6816","nonce":2532904479},{"type":"v1","addr":"172.21.15.78:6817","nonce":2532904479}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6818","nonce":2532904479},{"type":"v1","addr":"172.21.15.78:6819","nonce":2532904479}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6822","nonce":2532904479},{"type":"v1","addr":"172.21.15.78:6823","nonce":2532904479}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6820","nonce":2532904479},{"type":"v1","addr":"172.21.15.78:6821","nonce":2532904479}]},"public_addr":"172.21.15.78:6817/2532904479","cluster_addr":"172.21.15.78:6819/2532904479","heartbeat_back_addr":"172.21.15.78:6823/2532904479","heartbeat_front_addr":"172.21.15.78:6821/2532904479","state":["exists","up"]},{"osd":3,"uuid":"77acc9af-7d4d-4b18-8cf5-d62f5971b7c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6824","nonce":3442991267},{"type":"v1","addr":"172.21.15.78:6825","nonce":3442991267}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6826","nonce":3442991267},{"type":"v1","addr":"172.21.15.78:6827","nonce":3442991267}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6830","nonce":3442991267},{"type":"v1","addr":"172.21.15.78:6831","nonce":3442991267}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6828","nonce":3442991267},{"type":"v1","addr":"172.21.15.78:6829","nonce":3442991267}]},"public_addr":"172.21.15.78:6825/3442991267","cluster_addr":"172.21.15.78:6827/3442991267","heartbeat_back_addr":"172.21.15.78:6831/3442991267","heartbeat_front_addr":"172.21.15.78:6829/3442991267","state":["exists","up"]},{"osd":4,"uuid":"5c62bc66-6b34-4b7f-a66b-9a743969138c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":802983577},{"type":"v1","addr":"172.21.15.179:6809","nonce":802983577}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":802983577},{"type":"v1","addr":"172.21.15.179:6811","nonce":802983577}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":802983577},{"type":"v1","addr":"172.21.15.179:6815","nonce":802983577}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":802983577},{"type":"v1","addr":"172.21.15.179:6813","nonce":802983577}]},"public_addr":"172.21.15.179:6809/802983577","cluster_addr":"172.21.15.179:6811/802983577","heartbeat_back_addr":"172.21.15.179:6815/802983577","heartbeat_front_addr":"172.21.15.179:6813/802983577","state":["exists","up"]},{"osd":5,"uuid":"67db6d36-f684-4079-b0cd-82b4dd61461f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":518192887},{"type":"v1","addr":"172.21.15.179:6818","nonce":518192887}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":518192887},{"type":"v1","addr":"172.21.15.179:6822","nonce":518192887}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":518192887},{"type":"v1","addr":"172.21.15.179:6829","nonce":518192887}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6824","nonce":518192887},{"type":"v1","addr":"172.21.15.179:6826","nonce":518192887}]},"public_addr":"172.21.15.179:6818/518192887","cluster_addr":"172.21.15.179:6822/518192887","heartbeat_back_addr":"172.21.15.179:6829/518192887","heartbeat_front_addr":"172.21.15.179:6826/518192887","state":["exists","up"]},{"osd":6,"uuid":"12e670af-5a16-4c81-9f97-defa66cab967","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":815435378},{"type":"v1","addr":"172.21.15.179:6801","nonce":815435378}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":815435378},{"type":"v1","addr":"172.21.15.179:6803","nonce":815435378}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":815435378},{"type":"v1","addr":"172.21.15.179:6807","nonce":815435378}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":815435378},{"type":"v1","addr":"172.21.15.179:6805","nonce":815435378}]},"public_addr":"172.21.15.179:6801/815435378","cluster_addr":"172.21.15.179:6803/815435378","heartbeat_back_addr":"172.21.15.179:6807/815435378","heartbeat_front_addr":"172.21.15.179:6805/815435378","state":["exists","up"]},{"osd":7,"uuid":"fe630650-2eb3-49ad-8676-c341e6332eb1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6817","nonce":2848432339},{"type":"v1","addr":"172.21.15.179:6819","nonce":2848432339}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6821","nonce":2848432339},{"type":"v1","addr":"172.21.15.179:6823","nonce":2848432339}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":2848432339},{"type":"v1","addr":"172.21.15.179:6831","nonce":2848432339}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6825","nonce":2848432339},{"type":"v1","addr":"172.21.15.179:6827","nonce":2848432339}]},"public_addr":"172.21.15.179:6819/2848432339","cluster_addr":"172.21.15.179:6823/2848432339","heartbeat_back_addr":"172.21.15.179:6831/2848432339","heartbeat_front_addr":"172.21.15.179:6827/2848432339","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:58:49.255433+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:58:49.412880+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:58:49.559295+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:58:49.245237+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:58:49.184557+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:58:49.329851+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:58:49.366012+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:58:49.349604+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-28T20:02:04.718 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:04.712+0000 7fb71de32640 1 -- 172.21.15.78:0/884248603 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fb6f80664a0 msgr2=0x7fb6f8068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:02:04.719 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:04.712+0000 7fb71de32640 1 --2- 172.21.15.78:0/884248603 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fb6f80664a0 0x7fb6f8068960 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7fb70800d980 tx=0x7fb708008040 comp rx=0 tx=0).stop 2023-11-28T20:02:04.719 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:04.712+0000 7fb71de32640 1 -- 172.21.15.78:0/884248603 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb7180c4730 msgr2=0x7fb71814a0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:02:04.719 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:04.712+0000 7fb71de32640 1 --2- 172.21.15.78:0/884248603 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb7180c4730 0x7fb71814a0b0 secure :-1 s=READY pgs=871 cs=0 l=1 rev1=1 crypto rx=0x7fb70000e930 tx=0x7fb70000edf0 comp rx=0 tx=0).stop 2023-11-28T20:02:04.719 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:04.712+0000 7fb71de32640 1 -- 172.21.15.78:0/884248603 shutdown_connections 2023-11-28T20:02:04.719 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:04.712+0000 7fb71de32640 1 --2- 172.21.15.78:0/884248603 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fb6f80664a0 0x7fb6f8068960 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:04.719 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:04.712+0000 7fb71de32640 1 --2- 172.21.15.78:0/884248603 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb71814e3f0 0x7fb718144c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:04.719 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:04.712+0000 7fb71de32640 1 --2- 172.21.15.78:0/884248603 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb7180c4730 0x7fb71814a0b0 unknown :-1 s=CLOSED pgs=871 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:04.719 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:04.712+0000 7fb71de32640 1 --2- 172.21.15.78:0/884248603 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb71806bef0 0x7fb71814ca20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:04.719 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:04.712+0000 7fb71de32640 1 -- 172.21.15.78:0/884248603 >> 172.21.15.78:0/884248603 conn(0x7fb7180a7810 msgr2=0x7fb7180a7bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:02:04.719 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:04.712+0000 7fb71de32640 1 -- 172.21.15.78:0/884248603 shutdown_connections 2023-11-28T20:02:04.719 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:04.712+0000 7fb71de32640 1 -- 172.21.15.78:0/884248603 wait complete. 2023-11-28T20:02:04.738 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-28T19:58:54.011229+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-28T20:02:04.739 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-28T20:02:04.919 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:04.912+0000 7fa25a8c9640 1 Processor -- start 2023-11-28T20:02:04.919 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:04.912+0000 7fa25a8c9640 1 -- start start 2023-11-28T20:02:04.921 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:04.916+0000 7fa25a8c9640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fa2540bed60 0x7fa2540bf140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:04.921 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:04.916+0000 7fa25a8c9640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fa2540a4f30 0x7fa2541585d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:04.921 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:04.916+0000 7fa25a8c9640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa254157b80 con 0x7fa2540c4b20 2023-11-28T20:02:04.921 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:04.916+0000 7fa25a8c9640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa254158b10 con 0x7fa2540a4f30 2023-11-28T20:02:04.921 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:04.916+0000 7fa25a8c9640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa25406d6c0 con 0x7fa2540bed60 2023-11-28T20:02:04.922 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:04.916+0000 7fa2537fe640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fa2540a4f30 0x7fa2541585d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:02:04.922 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:04.916+0000 7fa258e66640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7fa2540c4b20 0x7fa254154590 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:54818/0 (socket says 172.21.15.78:54818) 2023-11-28T20:02:04.922 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:04.916+0000 7fa258e66640 1 -- 172.21.15.78:0/898136014 learned_addr learned my addr 172.21.15.78:0/898136014 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-11-28T20:02:04.922 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:04.916+0000 7fa253fff640 1 --2- 172.21.15.78:0/898136014 >> v2:172.21.15.179:3300/0 conn(0x7fa2540bed60 0x7fa2540bf140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:02:04.922 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:04.916+0000 7fa2537fe640 1 -- 172.21.15.78:0/898136014 >> v2:172.21.15.179:3300/0 conn(0x7fa2540bed60 msgr2=0x7fa2540bf140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:02:04.922 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:04.916+0000 7fa2537fe640 1 --2- 172.21.15.78:0/898136014 >> v2:172.21.15.179:3300/0 conn(0x7fa2540bed60 0x7fa2540bf140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:04.923 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:04.916+0000 7fa2537fe640 1 -- 172.21.15.78:0/898136014 >> v1:172.21.15.78:6789/0 conn(0x7fa2540c4b20 legacy=0x7fa254154590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:02:04.923 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:04.916+0000 7fa2537fe640 1 -- 172.21.15.78:0/898136014 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa25406d960 con 0x7fa2540a4f30 2023-11-28T20:02:04.923 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:04.916+0000 7fa252ffd640 1 -- 172.21.15.78:0/898136014 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1032750365 0 0) 0x7fa254157b80 con 0x7fa2540c4b20 2023-11-28T20:02:04.924 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:04.920+0000 7fa2537fe640 1 --2- 172.21.15.78:0/898136014 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa2540a4f30 0x7fa2541585d0 secure :-1 s=READY pgs=873 cs=0 l=1 rev1=1 crypto rx=0x7fa254066dc0 tx=0x7fa24801c3d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ab13bb318c812d7b server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:02:04.924 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:04.920+0000 7fa252ffd640 1 -- 172.21.15.78:0/898136014 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2480ab600 con 0x7fa2540a4f30 2023-11-28T20:02:04.924 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:04.920+0000 7fa252ffd640 1 -- 172.21.15.78:0/898136014 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa2480a7050 con 0x7fa2540a4f30 2023-11-28T20:02:04.924 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:04.920+0000 7fa252ffd640 1 -- 172.21.15.78:0/898136014 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2480ab980 con 0x7fa2540a4f30 2023-11-28T20:02:04.925 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:04.920+0000 7fa25a8c9640 1 -- 172.21.15.78:0/898136014 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa2540a4f30 msgr2=0x7fa2541585d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:02:04.926 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:04.920+0000 7fa25a8c9640 1 --2- 172.21.15.78:0/898136014 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa2540a4f30 0x7fa2541585d0 secure :-1 s=READY pgs=873 cs=0 l=1 rev1=1 crypto rx=0x7fa254066dc0 tx=0x7fa24801c3d0 comp rx=0 tx=0).stop 2023-11-28T20:02:04.926 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:04.920+0000 7fa25a8c9640 1 -- 172.21.15.78:0/898136014 shutdown_connections 2023-11-28T20:02:04.926 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:04.920+0000 7fa25a8c9640 1 --2- 172.21.15.78:0/898136014 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa2540a4f30 0x7fa2541585d0 unknown :-1 s=CLOSED pgs=873 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:04.926 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:04.920+0000 7fa25a8c9640 1 --2- 172.21.15.78:0/898136014 >> v2:172.21.15.179:3300/0 conn(0x7fa2540bed60 0x7fa2540bf140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:04.926 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:04.920+0000 7fa25a8c9640 1 -- 172.21.15.78:0/898136014 >> 172.21.15.78:0/898136014 conn(0x7fa2540c59f0 msgr2=0x7fa2540c5e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:02:04.926 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:04.920+0000 7fa25a8c9640 1 -- 172.21.15.78:0/898136014 shutdown_connections 2023-11-28T20:02:04.927 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:04.920+0000 7fa25a8c9640 1 -- 172.21.15.78:0/898136014 wait complete. 2023-11-28T20:02:04.929 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:04.920+0000 7fa25a8c9640 1 Processor -- start 2023-11-28T20:02:04.929 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:04.920+0000 7fa25a8c9640 1 -- start start 2023-11-28T20:02:04.930 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:04.924+0000 7fa25a8c9640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa2540a4f30 0x7fa25414bb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:04.930 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:04.924+0000 7fa25a8c9640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa2540bed60 0x7fa25414c0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:04.930 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:04.924+0000 7fa25a8c9640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa2540c4b20 0x7fa254072190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:04.930 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:04.924+0000 7fa25a8c9640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa25406fcd0 con 0x7fa2540bed60 2023-11-28T20:02:04.930 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:04.924+0000 7fa25a8c9640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa254070120 con 0x7fa2540a4f30 2023-11-28T20:02:04.930 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:04.924+0000 7fa25a8c9640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2541ed500 con 0x7fa2540c4b20 2023-11-28T20:02:04.931 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:04.924+0000 7fa2537fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa2540bed60 0x7fa25414c0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:02:04.931 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:04.924+0000 7fa2537fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa2540bed60 0x7fa25414c0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:44184/0 (socket says 172.21.15.78:44184) 2023-11-28T20:02:04.931 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:04.924+0000 7fa2537fe640 1 -- 172.21.15.78:0/1550960428 learned_addr learned my addr 172.21.15.78:0/1550960428 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T20:02:04.931 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:04.924+0000 7fa253fff640 1 --2- 172.21.15.78:0/1550960428 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa2540a4f30 0x7fa25414bb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:02:04.931 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:04.924+0000 7fa258e66640 1 --2- 172.21.15.78:0/1550960428 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa2540c4b20 0x7fa254072190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:02:04.932 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:04.924+0000 7fa2537fe640 1 -- 172.21.15.78:0/1550960428 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa2540c4b20 msgr2=0x7fa254072190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:02:04.932 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:04.924+0000 7fa2537fe640 1 --2- 172.21.15.78:0/1550960428 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa2540c4b20 0x7fa254072190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:04.932 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:04.924+0000 7fa2537fe640 1 -- 172.21.15.78:0/1550960428 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa2540a4f30 msgr2=0x7fa25414bb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:02:04.932 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:04.924+0000 7fa2537fe640 1 --2- 172.21.15.78:0/1550960428 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa2540a4f30 0x7fa25414bb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:04.932 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:04.924+0000 7fa2537fe640 1 -- 172.21.15.78:0/1550960428 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa248009420 con 0x7fa2540bed60 2023-11-28T20:02:04.932 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:04.924+0000 7fa2537fe640 1 --2- 172.21.15.78:0/1550960428 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa2540bed60 0x7fa25414c0a0 secure :-1 s=READY pgs=874 cs=0 l=1 rev1=1 crypto rx=0x7fa24801a000 tx=0x7fa248019170 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:02:04.932 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:04.924+0000 7fa250ff9640 1 -- 172.21.15.78:0/1550960428 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa248006e20 con 0x7fa2540bed60 2023-11-28T20:02:04.933 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:04.924+0000 7fa250ff9640 1 -- 172.21.15.78:0/1550960428 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa248004030 con 0x7fa2540bed60 2023-11-28T20:02:04.933 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:04.924+0000 7fa250ff9640 1 -- 172.21.15.78:0/1550960428 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2480043c0 con 0x7fa2540bed60 2023-11-28T20:02:04.933 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:04.924+0000 7fa25a8c9640 1 -- 172.21.15.78:0/1550960428 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa254070a10 con 0x7fa2540bed60 2023-11-28T20:02:04.933 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:04.924+0000 7fa25a8c9640 1 -- 172.21.15.78:0/1550960428 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa254070730 con 0x7fa2540bed60 2023-11-28T20:02:04.934 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:04.924+0000 7fa25a8c9640 1 -- 172.21.15.78:0/1550960428 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa25406fe40 con 0x7fa2540bed60 2023-11-28T20:02:04.934 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:04.924+0000 7fa250ff9640 1 -- 172.21.15.78:0/1550960428 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fa2480b2040 con 0x7fa2540bed60 2023-11-28T20:02:04.934 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:04.928+0000 7fa250ff9640 1 --2- 172.21.15.78:0/1550960428 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fa240066470 0x7fa240068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:04.934 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:04.928+0000 7fa250ff9640 1 -- 172.21.15.78:0/1550960428 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 5177+0+0 (secure 0 0 0) 0x7fa24811d910 con 0x7fa2540bed60 2023-11-28T20:02:04.935 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:04.928+0000 7fa253fff640 1 --2- 172.21.15.78:0/1550960428 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fa240066470 0x7fa240068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:02:04.935 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:04.928+0000 7fa253fff640 1 --2- 172.21.15.78:0/1550960428 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fa240066470 0x7fa240068930 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7fa244009ac0 tx=0x7fa244009190 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:02:04.935 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:04.932+0000 7fa250ff9640 1 -- 172.21.15.78:0/1550960428 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fa25406fe40 con 0x7fa2540bed60 2023-11-28T20:02:05.087 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:05.080+0000 7fa25a8c9640 1 -- 172.21.15.78:0/1550960428 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fa25406fe10 con 0x7fa2540bed60 2023-11-28T20:02:05.087 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:05.080+0000 7fa250ff9640 1 -- 172.21.15.78:0/1550960428 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v77) v1 ==== 93+0+10 (secure 0 0 0) 0x7fa2480c2020 con 0x7fa2540bed60 2023-11-28T20:02:05.087 INFO:teuthology.orchestra.run.smithi078.stdout:pg_num: 1 2023-11-28T20:02:05.089 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:05.084+0000 7fa25a8c9640 1 -- 172.21.15.78:0/1550960428 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fa240066470 msgr2=0x7fa240068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:02:05.089 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:05.084+0000 7fa25a8c9640 1 --2- 172.21.15.78:0/1550960428 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fa240066470 0x7fa240068930 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7fa244009ac0 tx=0x7fa244009190 comp rx=0 tx=0).stop 2023-11-28T20:02:05.089 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:05.084+0000 7fa25a8c9640 1 -- 172.21.15.78:0/1550960428 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa2540bed60 msgr2=0x7fa25414c0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:02:05.089 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:05.084+0000 7fa25a8c9640 1 --2- 172.21.15.78:0/1550960428 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa2540bed60 0x7fa25414c0a0 secure :-1 s=READY pgs=874 cs=0 l=1 rev1=1 crypto rx=0x7fa24801a000 tx=0x7fa248019170 comp rx=0 tx=0).stop 2023-11-28T20:02:05.089 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:05.084+0000 7fa25a8c9640 1 -- 172.21.15.78:0/1550960428 shutdown_connections 2023-11-28T20:02:05.090 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:05.084+0000 7fa25a8c9640 1 --2- 172.21.15.78:0/1550960428 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fa240066470 0x7fa240068930 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:05.090 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:05.084+0000 7fa25a8c9640 1 --2- 172.21.15.78:0/1550960428 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa2540c4b20 0x7fa254072190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:05.090 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:05.084+0000 7fa25a8c9640 1 --2- 172.21.15.78:0/1550960428 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa2540bed60 0x7fa25414c0a0 unknown :-1 s=CLOSED pgs=874 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:05.090 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:05.084+0000 7fa25a8c9640 1 --2- 172.21.15.78:0/1550960428 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa2540a4f30 0x7fa25414bb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:05.090 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:05.084+0000 7fa25a8c9640 1 -- 172.21.15.78:0/1550960428 >> 172.21.15.78:0/1550960428 conn(0x7fa2540c59f0 msgr2=0x7fa2540a5650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:02:05.090 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:05.084+0000 7fa25a8c9640 1 -- 172.21.15.78:0/1550960428 shutdown_connections 2023-11-28T20:02:05.090 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:05.084+0000 7fa25a8c9640 1 -- 172.21.15.78:0/1550960428 wait complete. 2023-11-28T20:02:05.108 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-11-28T20:02:05.246 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:05.240+0000 7fe3b02fd640 1 Processor -- start 2023-11-28T20:02:05.247 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:05.240+0000 7fe3b02fd640 1 -- start start 2023-11-28T20:02:05.249 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:05.244+0000 7fe3b02fd640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fe3a806d2b0 0x7fe3a806d690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:05.249 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:05.244+0000 7fe3b02fd640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fe3a80c3b80 0x7fe3a80c5300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:05.249 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:05.244+0000 7fe3b02fd640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe3a806c020 0x7fe3a806c4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:05.249 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:05.244+0000 7fe3b02fd640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe3a80c5840 con 0x7fe3a80c3b80 2023-11-28T20:02:05.249 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:05.244+0000 7fe3b02fd640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe3a806bb80 con 0x7fe3a806d2b0 2023-11-28T20:02:05.249 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:05.244+0000 7fe3b02fd640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe3a81515c0 con 0x7fe3a806c020 2023-11-28T20:02:05.250 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:05.244+0000 7fe3ad898640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fe3a80c3b80 0x7fe3a80c5300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:02:05.250 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:05.244+0000 7fe3ad898640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fe3a80c3b80 0x7fe3a80c5300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:49374/0 (socket says 172.21.15.78:49374) 2023-11-28T20:02:05.250 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:05.244+0000 7fe3ad898640 1 -- 172.21.15.78:0/1407737170 learned_addr learned my addr 172.21.15.78:0/1407737170 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T20:02:05.250 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:05.244+0000 7fe3ae099640 1 --2- 172.21.15.78:0/1407737170 >> v2:172.21.15.179:3300/0 conn(0x7fe3a806d2b0 0x7fe3a806d690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:02:05.250 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:05.244+0000 7fe3ae89a640 1 --2- 172.21.15.78:0/1407737170 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe3a806c020 0x7fe3a806c4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:02:05.250 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:05.244+0000 7fe3ad898640 1 -- 172.21.15.78:0/1407737170 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe3a806c020 msgr2=0x7fe3a806c4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:02:05.251 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:05.244+0000 7fe3ad898640 1 --2- 172.21.15.78:0/1407737170 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe3a806c020 0x7fe3a806c4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:05.251 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:05.244+0000 7fe3ad898640 1 -- 172.21.15.78:0/1407737170 >> v2:172.21.15.179:3300/0 conn(0x7fe3a806d2b0 msgr2=0x7fe3a806d690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:02:05.251 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:05.244+0000 7fe3ad898640 1 --2- 172.21.15.78:0/1407737170 >> v2:172.21.15.179:3300/0 conn(0x7fe3a806d2b0 0x7fe3a806d690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:05.251 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:05.244+0000 7fe3ad898640 1 -- 172.21.15.78:0/1407737170 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3a81518a0 con 0x7fe3a80c3b80 2023-11-28T20:02:05.252 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:05.248+0000 7fe3ad898640 1 --2- 172.21.15.78:0/1407737170 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe3a80c3b80 0x7fe3a80c5300 secure :-1 s=READY pgs=875 cs=0 l=1 rev1=1 crypto rx=0x7fe3a80c2130 tx=0x7fe39801eba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9162ac6b04c2f89a server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:02:05.252 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:05.248+0000 7fe3ad097640 1 -- 172.21.15.78:0/1407737170 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3980a7c30 con 0x7fe3a80c3b80 2023-11-28T20:02:05.252 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:05.248+0000 7fe3ad097640 1 -- 172.21.15.78:0/1407737170 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe3980a7d90 con 0x7fe3a80c3b80 2023-11-28T20:02:05.253 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:05.248+0000 7fe3ad097640 1 -- 172.21.15.78:0/1407737170 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3980af660 con 0x7fe3a80c3b80 2023-11-28T20:02:05.253 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:05.248+0000 7fe3b02fd640 1 -- 172.21.15.78:0/1407737170 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe3a80c3b80 msgr2=0x7fe3a80c5300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:02:05.253 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:05.248+0000 7fe3b02fd640 1 --2- 172.21.15.78:0/1407737170 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe3a80c3b80 0x7fe3a80c5300 secure :-1 s=READY pgs=875 cs=0 l=1 rev1=1 crypto rx=0x7fe3a80c2130 tx=0x7fe39801eba0 comp rx=0 tx=0).stop 2023-11-28T20:02:05.253 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:05.248+0000 7fe3b02fd640 1 -- 172.21.15.78:0/1407737170 shutdown_connections 2023-11-28T20:02:05.253 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:05.248+0000 7fe3b02fd640 1 --2- 172.21.15.78:0/1407737170 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe3a806c020 0x7fe3a806c4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:05.253 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:05.248+0000 7fe3b02fd640 1 --2- 172.21.15.78:0/1407737170 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe3a80c3b80 0x7fe3a80c5300 unknown :-1 s=CLOSED pgs=875 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:05.253 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:05.248+0000 7fe3b02fd640 1 --2- 172.21.15.78:0/1407737170 >> v2:172.21.15.179:3300/0 conn(0x7fe3a806d2b0 0x7fe3a806d690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:05.254 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:05.248+0000 7fe3b02fd640 1 -- 172.21.15.78:0/1407737170 >> 172.21.15.78:0/1407737170 conn(0x7fe3a80a7810 msgr2=0x7fe3a80a7c20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:02:05.254 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:05.248+0000 7fe3b02fd640 1 -- 172.21.15.78:0/1407737170 shutdown_connections 2023-11-28T20:02:05.254 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:05.248+0000 7fe3b02fd640 1 -- 172.21.15.78:0/1407737170 wait complete. 2023-11-28T20:02:05.255 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:05.248+0000 7fe3b02fd640 1 Processor -- start 2023-11-28T20:02:05.256 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:05.248+0000 7fe3b02fd640 1 -- start start 2023-11-28T20:02:05.256 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:05.252+0000 7fe3b02fd640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe3a806c020 0x7fe3a8148750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:05.256 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:05.252+0000 7fe3b02fd640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe3a806d2b0 0x7fe3a8144fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:05.256 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:05.252+0000 7fe3b02fd640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe3a80c3b80 0x7fe3a8145520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:05.256 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:05.252+0000 7fe3b02fd640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3a815a970 con 0x7fe3a806c020 2023-11-28T20:02:05.256 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:05.252+0000 7fe3b02fd640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3a81510b0 con 0x7fe3a80c3b80 2023-11-28T20:02:05.256 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:05.252+0000 7fe3b02fd640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe3a8146c70 con 0x7fe3a806d2b0 2023-11-28T20:02:05.257 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:05.252+0000 7fe3ae099640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe3a806c020 0x7fe3a8148750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:02:05.257 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:05.252+0000 7fe3ae099640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe3a806c020 0x7fe3a8148750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:49388/0 (socket says 172.21.15.78:49388) 2023-11-28T20:02:05.257 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:05.252+0000 7fe3ae099640 1 -- 172.21.15.78:0/1271558838 learned_addr learned my addr 172.21.15.78:0/1271558838 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T20:02:05.257 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:05.252+0000 7fe3ad898640 1 --2- 172.21.15.78:0/1271558838 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe3a806d2b0 0x7fe3a8144fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:02:05.257 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:05.252+0000 7fe3ae89a640 1 --2- 172.21.15.78:0/1271558838 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe3a80c3b80 0x7fe3a8145520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:02:05.257 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:05.252+0000 7fe3ae099640 1 -- 172.21.15.78:0/1271558838 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe3a806d2b0 msgr2=0x7fe3a8144fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:02:05.257 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:05.252+0000 7fe3ae099640 1 --2- 172.21.15.78:0/1271558838 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe3a806d2b0 0x7fe3a8144fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:05.258 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:05.252+0000 7fe3ae099640 1 -- 172.21.15.78:0/1271558838 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe3a80c3b80 msgr2=0x7fe3a8145520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:02:05.258 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:05.252+0000 7fe3ae099640 1 --2- 172.21.15.78:0/1271558838 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe3a80c3b80 0x7fe3a8145520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:05.258 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:05.252+0000 7fe3ae099640 1 -- 172.21.15.78:0/1271558838 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe39800b770 con 0x7fe3a806c020 2023-11-28T20:02:05.258 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:05.252+0000 7fe3ae89a640 1 --2- 172.21.15.78:0/1271558838 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe3a80c3b80 0x7fe3a8145520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T20:02:05.259 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:05.252+0000 7fe3ae099640 1 --2- 172.21.15.78:0/1271558838 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe3a806c020 0x7fe3a8148750 secure :-1 s=READY pgs=876 cs=0 l=1 rev1=1 crypto rx=0x7fe3a400e930 tx=0x7fe3a400edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:02:05.259 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:05.252+0000 7fe39effd640 1 -- 172.21.15.78:0/1271558838 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3a4009690 con 0x7fe3a806c020 2023-11-28T20:02:05.259 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:05.252+0000 7fe39effd640 1 -- 172.21.15.78:0/1271558838 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe3a400ca00 con 0x7fe3a806c020 2023-11-28T20:02:05.259 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:05.252+0000 7fe3b02fd640 1 -- 172.21.15.78:0/1271558838 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe3a814ef80 con 0x7fe3a806c020 2023-11-28T20:02:05.260 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:05.252+0000 7fe39effd640 1 -- 172.21.15.78:0/1271558838 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3a400cd70 con 0x7fe3a806c020 2023-11-28T20:02:05.260 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:05.252+0000 7fe3b02fd640 1 -- 172.21.15.78:0/1271558838 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe3a815a590 con 0x7fe3a806c020 2023-11-28T20:02:05.260 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:05.252+0000 7fe3b02fd640 1 -- 172.21.15.78:0/1271558838 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe3a8067630 con 0x7fe3a806c020 2023-11-28T20:02:05.261 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:05.256+0000 7fe39effd640 1 -- 172.21.15.78:0/1271558838 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fe3a4013470 con 0x7fe3a806c020 2023-11-28T20:02:05.262 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:05.256+0000 7fe39effd640 1 --2- 172.21.15.78:0/1271558838 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fe38c066470 0x7fe38c068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:05.262 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:05.256+0000 7fe39effd640 1 -- 172.21.15.78:0/1271558838 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 5177+0+0 (secure 0 0 0) 0x7fe3a40846a0 con 0x7fe3a806c020 2023-11-28T20:02:05.263 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:05.256+0000 7fe3ad898640 1 --2- 172.21.15.78:0/1271558838 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fe38c066470 0x7fe38c068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:02:05.263 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:05.260+0000 7fe3ad898640 1 --2- 172.21.15.78:0/1271558838 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fe38c066470 0x7fe38c068930 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7fe3980b1000 tx=0x7fe398008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:02:05.265 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:05.260+0000 7fe39effd640 1 -- 172.21.15.78:0/1271558838 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fe3a4051dd0 con 0x7fe3a806c020 2023-11-28T20:02:05.415 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:05.412+0000 7fe3b02fd640 1 -- 172.21.15.78:0/1271558838 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7fe3a806bd70 con 0x7fe3a806c020 2023-11-28T20:02:05.416 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:05.412+0000 7fe39effd640 1 -- 172.21.15.78:0/1271558838 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v77) v1 ==== 84+0+65 (secure 0 0 0) 0x7fe3a4017060 con 0x7fe3a806c020 2023-11-28T20:02:05.416 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-11-28T20:02:05.416 INFO:teuthology.orchestra.run.smithi078.stdout:[ 2023-11-28T20:02:05.416 INFO:teuthology.orchestra.run.smithi078.stdout: { 2023-11-28T20:02:05.416 INFO:teuthology.orchestra.run.smithi078.stdout: "poolnum": 1, 2023-11-28T20:02:05.416 INFO:teuthology.orchestra.run.smithi078.stdout: "poolname": ".mgr" 2023-11-28T20:02:05.416 INFO:teuthology.orchestra.run.smithi078.stdout: } 2023-11-28T20:02:05.417 INFO:teuthology.orchestra.run.smithi078.stdout:] 2023-11-28T20:02:05.417 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:05.412+0000 7fe3b02fd640 1 -- 172.21.15.78:0/1271558838 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fe38c066470 msgr2=0x7fe38c068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:02:05.418 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:05.412+0000 7fe3b02fd640 1 --2- 172.21.15.78:0/1271558838 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fe38c066470 0x7fe38c068930 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7fe3980b1000 tx=0x7fe398008040 comp rx=0 tx=0).stop 2023-11-28T20:02:05.418 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:05.412+0000 7fe3b02fd640 1 -- 172.21.15.78:0/1271558838 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe3a806c020 msgr2=0x7fe3a8148750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:02:05.418 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:05.412+0000 7fe3b02fd640 1 --2- 172.21.15.78:0/1271558838 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe3a806c020 0x7fe3a8148750 secure :-1 s=READY pgs=876 cs=0 l=1 rev1=1 crypto rx=0x7fe3a400e930 tx=0x7fe3a400edf0 comp rx=0 tx=0).stop 2023-11-28T20:02:05.418 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:05.412+0000 7fe3b02fd640 1 -- 172.21.15.78:0/1271558838 shutdown_connections 2023-11-28T20:02:05.418 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:05.412+0000 7fe3b02fd640 1 --2- 172.21.15.78:0/1271558838 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fe38c066470 0x7fe38c068930 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:05.418 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:05.412+0000 7fe3b02fd640 1 --2- 172.21.15.78:0/1271558838 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe3a806d2b0 0x7fe3a8144fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:05.418 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:05.412+0000 7fe3b02fd640 1 --2- 172.21.15.78:0/1271558838 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe3a80c3b80 0x7fe3a8145520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:05.418 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:05.412+0000 7fe3b02fd640 1 --2- 172.21.15.78:0/1271558838 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe3a806c020 0x7fe3a8148750 unknown :-1 s=CLOSED pgs=876 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:05.419 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:05.412+0000 7fe3b02fd640 1 -- 172.21.15.78:0/1271558838 >> 172.21.15.78:0/1271558838 conn(0x7fe3a80a7810 msgr2=0x7fe3a80c2aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:02:05.419 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:05.412+0000 7fe3b02fd640 1 -- 172.21.15.78:0/1271558838 shutdown_connections 2023-11-28T20:02:05.419 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:05.412+0000 7fe3b02fd640 1 -- 172.21.15.78:0/1271558838 wait complete. 2023-11-28T20:02:05.436 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-11-28T20:02:05.436 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-11-28T20:02:05.577 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:05.572+0000 7effa44aa640 1 Processor -- start 2023-11-28T20:02:05.578 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:05.572+0000 7effa44aa640 1 -- start start 2023-11-28T20:02:05.579 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:05.572+0000 7effa44aa640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7eff9c14fc30 0x7eff9c0c3cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:05.579 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:05.572+0000 7effa44aa640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7eff9c152910 con 0x7eff9c14f850 2023-11-28T20:02:05.579 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:05.572+0000 7effa44aa640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7eff9c152bf0 con 0x7eff9c06d840 2023-11-28T20:02:05.579 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:05.572+0000 7effa44aa640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7eff9c0c2240 con 0x7eff9c14fc30 2023-11-28T20:02:05.579 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:05.572+0000 7effa2246640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7eff9c14f850 0x7eff9c0aacf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:40322/0 (socket says 172.21.15.78:40322) 2023-11-28T20:02:05.580 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:05.572+0000 7effa2246640 1 -- 172.21.15.78:0/995044023 learned_addr learned my addr 172.21.15.78:0/995044023 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-11-28T20:02:05.581 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:05.576+0000 7effa1a45640 1 --2- 172.21.15.78:0/995044023 >> v2:172.21.15.179:3300/0 conn(0x7eff9c14fc30 0x7eff9c0c3cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:02:05.581 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:05.576+0000 7effa1244640 1 -- 172.21.15.78:0/995044023 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1874229311 0 0) 0x7eff9c152910 con 0x7eff9c14f850 2023-11-28T20:02:05.581 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:05.576+0000 7effa1244640 1 -- 172.21.15.78:0/995044023 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7eff88003530 con 0x7eff9c14f850 2023-11-28T20:02:05.582 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:05.576+0000 7effa1244640 1 -- 172.21.15.78:0/995044023 <== mon.0 v1:172.21.15.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1562425182 0 0) 0x7eff88003530 con 0x7eff9c14f850 2023-11-28T20:02:05.582 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:05.576+0000 7effa1244640 1 -- 172.21.15.78:0/995044023 >> v2:172.21.15.179:3300/0 conn(0x7eff9c14fc30 msgr2=0x7eff9c0c3cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:02:05.582 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:05.576+0000 7effa1244640 1 --2- 172.21.15.78:0/995044023 >> v2:172.21.15.179:3300/0 conn(0x7eff9c14fc30 0x7eff9c0c3cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:05.582 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:05.576+0000 7effa1244640 1 -- 172.21.15.78:0/995044023 >> v1:172.21.15.179:6789/0 conn(0x7eff9c06d840 legacy=0x7eff9c0c4210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:02:05.582 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:05.576+0000 7effa1244640 1 -- 172.21.15.78:0/995044023 --> v1:172.21.15.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff9c152ed0 con 0x7eff9c14f850 2023-11-28T20:02:05.582 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:05.576+0000 7effa1244640 1 -- 172.21.15.78:0/995044023 <== mon.0 v1:172.21.15.78:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3326804700 0 0) 0x7eff98001680 con 0x7eff9c14f850 2023-11-28T20:02:05.582 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:05.576+0000 7effa1244640 1 -- 172.21.15.78:0/995044023 >> v1:172.21.15.78:6789/0 conn(0x7eff9c14f850 legacy=0x7eff9c0aacf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:02:05.582 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:05.576+0000 7effa1244640 1 --2- 172.21.15.78:0/995044023 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7eff880039d0 0x7eff88003df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:05.583 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:05.576+0000 7effa1244640 1 --2- 172.21.15.78:0/995044023 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7eff880047d0 0x7eff88004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:05.583 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:05.576+0000 7effa1244640 1 --2- 172.21.15.78:0/995044023 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7eff88005190 0x7eff8800b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:05.583 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:05.576+0000 7effa1244640 1 -- 172.21.15.78:0/995044023 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff9c0c2240 con 0x7eff880039d0 2023-11-28T20:02:05.583 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:05.576+0000 7effa1244640 1 -- 172.21.15.78:0/995044023 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff8800c090 con 0x7eff88005190 2023-11-28T20:02:05.583 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:05.576+0000 7effa1244640 1 -- 172.21.15.78:0/995044023 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff8800c250 con 0x7eff880047d0 2023-11-28T20:02:05.583 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:05.576+0000 7effa2246640 1 --2- 172.21.15.78:0/995044023 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7eff880039d0 0x7eff88003df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:02:05.583 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:05.576+0000 7effa1a45640 1 --2- 172.21.15.78:0/995044023 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7eff880047d0 0x7eff88004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:02:05.584 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:05.576+0000 7effa2a47640 1 --2- 172.21.15.78:0/995044023 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7eff88005190 0x7eff8800b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:02:05.584 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:05.576+0000 7effa2246640 1 -- 172.21.15.78:0/995044023 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7eff880047d0 msgr2=0x7eff88004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:02:05.584 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:05.576+0000 7effa2246640 1 --2- 172.21.15.78:0/995044023 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7eff880047d0 0x7eff88004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:05.584 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:05.576+0000 7effa2246640 1 -- 172.21.15.78:0/995044023 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7eff88005190 msgr2=0x7eff8800b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:02:05.584 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:05.576+0000 7effa2246640 1 --2- 172.21.15.78:0/995044023 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7eff88005190 0x7eff8800b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:05.584 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:05.576+0000 7effa2246640 1 -- 172.21.15.78:0/995044023 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff88003530 con 0x7eff880039d0 2023-11-28T20:02:05.584 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:05.576+0000 7effa2a47640 1 --2- 172.21.15.78:0/995044023 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7eff88005190 0x7eff8800b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T20:02:05.584 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:05.576+0000 7effa2a47640 1 -- 172.21.15.78:0/995044023 reap_dead start 2023-11-28T20:02:05.586 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:05.580+0000 7effa2246640 1 --2- 172.21.15.78:0/995044023 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7eff880039d0 0x7eff88003df0 secure :-1 s=READY pgs=878 cs=0 l=1 rev1=1 crypto rx=0x7eff9800c110 tx=0x7eff9801cb60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ddde362657f4ceb3 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:02:05.586 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:05.580+0000 7effa1244640 1 -- 172.21.15.78:0/995044023 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff980058e0 con 0x7eff880039d0 2023-11-28T20:02:05.586 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:05.580+0000 7effa1244640 1 -- 172.21.15.78:0/995044023 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff98005a40 con 0x7eff880039d0 2023-11-28T20:02:05.586 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:05.580+0000 7effa1244640 1 -- 172.21.15.78:0/995044023 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff98005df0 con 0x7eff880039d0 2023-11-28T20:02:05.586 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:05.580+0000 7effa44aa640 1 -- 172.21.15.78:0/995044023 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7eff880039d0 msgr2=0x7eff88003df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:02:05.587 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:05.580+0000 7effa44aa640 1 --2- 172.21.15.78:0/995044023 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7eff880039d0 0x7eff88003df0 secure :-1 s=READY pgs=878 cs=0 l=1 rev1=1 crypto rx=0x7eff9800c110 tx=0x7eff9801cb60 comp rx=0 tx=0).stop 2023-11-28T20:02:05.587 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:05.580+0000 7effa44aa640 1 -- 172.21.15.78:0/995044023 shutdown_connections 2023-11-28T20:02:05.587 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:05.580+0000 7effa44aa640 1 --2- 172.21.15.78:0/995044023 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7eff880039d0 0x7eff88003df0 unknown :-1 s=CLOSED pgs=878 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:05.587 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:05.580+0000 7effa44aa640 1 -- 172.21.15.78:0/995044023 >> 172.21.15.78:0/995044023 conn(0x7eff9c0c59f0 msgr2=0x7eff9c0c5e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:02:05.587 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:05.580+0000 7effa44aa640 1 -- 172.21.15.78:0/995044023 shutdown_connections 2023-11-28T20:02:05.587 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:05.580+0000 7effa44aa640 1 -- 172.21.15.78:0/995044023 wait complete. 2023-11-28T20:02:05.588 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:05.580+0000 7effa44aa640 1 Processor -- start 2023-11-28T20:02:05.590 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:05.580+0000 7effa44aa640 1 -- start start 2023-11-28T20:02:05.591 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:05.584+0000 7effa44aa640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7eff880039d0 0x7eff9c143cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:05.591 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:05.584+0000 7effa44aa640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7eff9c06fac0 0x7eff9c0a8ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:05.591 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:05.584+0000 7effa44aa640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7eff9c142060 0x7eff9c0a9020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:05.591 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:05.584+0000 7effa44aa640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff9c1eddb0 con 0x7eff9c06fac0 2023-11-28T20:02:05.592 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:05.584+0000 7effa44aa640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff9c141b30 con 0x7eff9c142060 2023-11-28T20:02:05.592 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:05.584+0000 7effa44aa640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff9c141d80 con 0x7eff880039d0 2023-11-28T20:02:05.592 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:05.584+0000 7effa1a45640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7eff9c06fac0 0x7eff9c0a8ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:02:05.592 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:05.584+0000 7effa1a45640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7eff9c06fac0 0x7eff9c0a8ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:49404/0 (socket says 172.21.15.78:49404) 2023-11-28T20:02:05.592 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:05.584+0000 7effa1a45640 1 -- 172.21.15.78:0/88269819 learned_addr learned my addr 172.21.15.78:0/88269819 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T20:02:05.593 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:05.584+0000 7effa2246640 1 --2- 172.21.15.78:0/88269819 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7eff880039d0 0x7eff9c143cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:02:05.593 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:05.584+0000 7effa2a47640 1 --2- 172.21.15.78:0/88269819 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7eff9c142060 0x7eff9c0a9020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:02:05.593 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:05.584+0000 7effa1a45640 1 -- 172.21.15.78:0/88269819 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7eff880039d0 msgr2=0x7eff9c143cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:02:05.593 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:05.584+0000 7effa1a45640 1 --2- 172.21.15.78:0/88269819 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7eff880039d0 0x7eff9c143cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:05.593 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:05.584+0000 7effa1a45640 1 -- 172.21.15.78:0/88269819 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7eff9c142060 msgr2=0x7eff9c0a9020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:02:05.594 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:05.584+0000 7effa1a45640 1 --2- 172.21.15.78:0/88269819 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7eff9c142060 0x7eff9c0a9020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:05.594 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:05.584+0000 7effa1a45640 1 -- 172.21.15.78:0/88269819 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff9c1ed6f0 con 0x7eff9c06fac0 2023-11-28T20:02:05.594 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:05.584+0000 7effa2246640 1 --2- 172.21.15.78:0/88269819 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7eff880039d0 0x7eff9c143cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T20:02:05.594 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:05.584+0000 7effa1a45640 1 --2- 172.21.15.78:0/88269819 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7eff9c06fac0 0x7eff9c0a8ae0 secure :-1 s=READY pgs=879 cs=0 l=1 rev1=1 crypto rx=0x7eff8c011aa0 tx=0x7eff8c011f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:02:05.595 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:05.584+0000 7eff92ffd640 1 -- 172.21.15.78:0/88269819 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff8c00fb80 con 0x7eff9c06fac0 2023-11-28T20:02:05.595 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:05.584+0000 7eff92ffd640 1 -- 172.21.15.78:0/88269819 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff8c00fce0 con 0x7eff9c06fac0 2023-11-28T20:02:05.595 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:05.584+0000 7eff92ffd640 1 -- 172.21.15.78:0/88269819 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff8c014680 con 0x7eff9c06fac0 2023-11-28T20:02:05.595 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:05.584+0000 7effa44aa640 1 -- 172.21.15.78:0/88269819 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7eff9c1ed9d0 con 0x7eff9c06fac0 2023-11-28T20:02:05.596 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:05.584+0000 7effa44aa640 1 -- 172.21.15.78:0/88269819 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7eff9c150520 con 0x7eff9c06fac0 2023-11-28T20:02:05.596 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:05.584+0000 7effa44aa640 1 -- 172.21.15.78:0/88269819 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7eff9c067630 con 0x7eff9c06fac0 2023-11-28T20:02:05.596 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:05.584+0000 7eff92ffd640 1 -- 172.21.15.78:0/88269819 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7eff8c0147e0 con 0x7eff9c06fac0 2023-11-28T20:02:05.597 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:05.588+0000 7eff92ffd640 1 --2- 172.21.15.78:0/88269819 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7eff800664a0 0x7eff80068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:05.598 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:05.588+0000 7eff92ffd640 1 -- 172.21.15.78:0/88269819 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 5177+0+0 (secure 0 0 0) 0x7eff8c084420 con 0x7eff9c06fac0 2023-11-28T20:02:05.598 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:05.588+0000 7effa2246640 1 --2- 172.21.15.78:0/88269819 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7eff800664a0 0x7eff80068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:02:05.598 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:05.588+0000 7effa2246640 1 --2- 172.21.15.78:0/88269819 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7eff800664a0 0x7eff80068960 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7eff980ab000 tx=0x7eff980a7070 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:02:05.598 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:05.588+0000 7eff92ffd640 1 -- 172.21.15.78:0/88269819 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7eff8c051b40 con 0x7eff9c06fac0 2023-11-28T20:02:05.744 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:05.740+0000 7effa44aa640 1 -- 172.21.15.78:0/88269819 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7eff9c1517f0 con 0x7eff9c06fac0 2023-11-28T20:02:06.264 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:06.260+0000 7eff92ffd640 1 -- 172.21.15.78:0/88269819 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v78) v1 ==== 138+0+0 (secure 0 0 0) 0x7eff8c055160 con 0x7eff9c06fac0 2023-11-28T20:02:06.264 INFO:teuthology.orchestra.run.smithi078.stderr:pool 'cephfs_metadata' created 2023-11-28T20:02:06.266 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:06.260+0000 7effa44aa640 1 -- 172.21.15.78:0/88269819 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7eff800664a0 msgr2=0x7eff80068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:02:06.267 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:06.260+0000 7effa44aa640 1 --2- 172.21.15.78:0/88269819 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7eff800664a0 0x7eff80068960 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7eff980ab000 tx=0x7eff980a7070 comp rx=0 tx=0).stop 2023-11-28T20:02:06.267 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:06.260+0000 7effa44aa640 1 -- 172.21.15.78:0/88269819 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7eff9c06fac0 msgr2=0x7eff9c0a8ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:02:06.267 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:06.260+0000 7effa44aa640 1 --2- 172.21.15.78:0/88269819 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7eff9c06fac0 0x7eff9c0a8ae0 secure :-1 s=READY pgs=879 cs=0 l=1 rev1=1 crypto rx=0x7eff8c011aa0 tx=0x7eff8c011f60 comp rx=0 tx=0).stop 2023-11-28T20:02:06.267 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:06.260+0000 7effa44aa640 1 -- 172.21.15.78:0/88269819 shutdown_connections 2023-11-28T20:02:06.267 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:06.260+0000 7effa44aa640 1 --2- 172.21.15.78:0/88269819 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7eff800664a0 0x7eff80068960 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:06.267 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:06.260+0000 7effa44aa640 1 --2- 172.21.15.78:0/88269819 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7eff9c142060 0x7eff9c0a9020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:06.267 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:06.260+0000 7effa44aa640 1 --2- 172.21.15.78:0/88269819 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7eff9c06fac0 0x7eff9c0a8ae0 unknown :-1 s=CLOSED pgs=879 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:06.267 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:06.260+0000 7effa44aa640 1 --2- 172.21.15.78:0/88269819 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7eff880039d0 0x7eff9c143cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:06.267 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:06.260+0000 7effa44aa640 1 -- 172.21.15.78:0/88269819 >> 172.21.15.78:0/88269819 conn(0x7eff9c0c59f0 msgr2=0x7eff9c150c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:02:06.267 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:06.260+0000 7effa44aa640 1 -- 172.21.15.78:0/88269819 shutdown_connections 2023-11-28T20:02:06.267 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:06.260+0000 7effa44aa640 1 -- 172.21.15.78:0/88269819 wait complete. 2023-11-28T20:02:06.292 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-11-28T20:02:06.438 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:06.432+0000 7f2ad6c17640 1 Processor -- start 2023-11-28T20:02:06.438 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:06.432+0000 7f2ad6c17640 1 -- start start 2023-11-28T20:02:06.439 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:06.432+0000 7f2ad6c17640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f2ad00c5300 0x7f2ad00a9c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:06.440 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:06.432+0000 7f2ad6c17640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2ad01548c0 0x7f2ad0154d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:06.440 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:06.432+0000 7f2ad6c17640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2ad00a4e20 con 0x7f2ad014b1e0 2023-11-28T20:02:06.440 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:06.432+0000 7f2ad6c17640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2ad00a50e0 con 0x7f2ad00c5300 2023-11-28T20:02:06.440 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:06.432+0000 7f2ad6c17640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ad00c0f00 con 0x7f2ad01548c0 2023-11-28T20:02:06.440 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:06.436+0000 7f2ac7fff640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f2ad00c5300 0x7f2ad00a9c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:02:06.440 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:06.436+0000 7f2ac7fff640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f2ad00c5300 0x7f2ad00a9c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:49420/0 (socket says 172.21.15.78:49420) 2023-11-28T20:02:06.440 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:06.436+0000 7f2ac7fff640 1 -- 172.21.15.78:0/3073342530 learned_addr learned my addr 172.21.15.78:0/3073342530 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T20:02:06.440 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:06.436+0000 7f2ad51b4640 1 --2- 172.21.15.78:0/3073342530 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2ad01548c0 0x7f2ad0154d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:02:06.440 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:06.436+0000 7f2ac7fff640 1 -- 172.21.15.78:0/3073342530 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2ad01548c0 msgr2=0x7f2ad0154d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:02:06.440 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:06.436+0000 7f2ac7fff640 1 --2- 172.21.15.78:0/3073342530 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2ad01548c0 0x7f2ad0154d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:06.440 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:06.436+0000 7f2ac7fff640 1 -- 172.21.15.78:0/3073342530 >> v1:172.21.15.179:6789/0 conn(0x7f2ad014b1e0 legacy=0x7f2ad00c1700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:02:06.441 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:06.436+0000 7f2ac7fff640 1 -- 172.21.15.78:0/3073342530 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ad00c11e0 con 0x7f2ad00c5300 2023-11-28T20:02:06.443 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:06.436+0000 7f2ac7fff640 1 --2- 172.21.15.78:0/3073342530 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2ad00c5300 0x7f2ad00a9c30 secure :-1 s=READY pgs=880 cs=0 l=1 rev1=1 crypto rx=0x7f2ac0009870 tx=0x7f2ac001c540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8860d610f98cb6f server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:02:06.443 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:06.436+0000 7f2ac77fe640 1 -- 172.21.15.78:0/3073342530 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ac00ab650 con 0x7f2ad00c5300 2023-11-28T20:02:06.443 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:06.436+0000 7f2ac77fe640 1 -- 172.21.15.78:0/3073342530 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ac00ab7b0 con 0x7f2ad00c5300 2023-11-28T20:02:06.443 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:06.436+0000 7f2ac77fe640 1 -- 172.21.15.78:0/3073342530 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ac00abb40 con 0x7f2ad00c5300 2023-11-28T20:02:06.444 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:06.440+0000 7f2ad6c17640 1 -- 172.21.15.78:0/3073342530 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2ad00c5300 msgr2=0x7f2ad00a9c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:02:06.444 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:06.440+0000 7f2ad6c17640 1 --2- 172.21.15.78:0/3073342530 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2ad00c5300 0x7f2ad00a9c30 secure :-1 s=READY pgs=880 cs=0 l=1 rev1=1 crypto rx=0x7f2ac0009870 tx=0x7f2ac001c540 comp rx=0 tx=0).stop 2023-11-28T20:02:06.444 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:06.440+0000 7f2ad6c17640 1 -- 172.21.15.78:0/3073342530 shutdown_connections 2023-11-28T20:02:06.444 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:06.440+0000 7f2ad6c17640 1 --2- 172.21.15.78:0/3073342530 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2ad01548c0 0x7f2ad0154d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:06.444 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:06.440+0000 7f2ad6c17640 1 --2- 172.21.15.78:0/3073342530 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2ad00c5300 0x7f2ad00a9c30 unknown :-1 s=CLOSED pgs=880 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:06.444 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:06.440+0000 7f2ad6c17640 1 -- 172.21.15.78:0/3073342530 >> 172.21.15.78:0/3073342530 conn(0x7f2ad00c59f0 msgr2=0x7f2ad00c5e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:02:06.444 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:06.440+0000 7f2ad6c17640 1 -- 172.21.15.78:0/3073342530 shutdown_connections 2023-11-28T20:02:06.445 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:06.440+0000 7f2ad6c17640 1 -- 172.21.15.78:0/3073342530 wait complete. 2023-11-28T20:02:06.445 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:06.440+0000 7f2ad6c17640 1 Processor -- start 2023-11-28T20:02:06.445 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:06.440+0000 7f2ad6c17640 1 -- start start 2023-11-28T20:02:06.447 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:06.440+0000 7f2ad6c17640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2ad00c5300 0x7f2ad01edcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:06.447 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:06.440+0000 7f2ad6c17640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2ad014b1e0 0x7f2ad0143060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:06.447 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:06.440+0000 7f2ad6c17640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2ad01548c0 0x7f2ad0146c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:06.447 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:06.440+0000 7f2ad6c17640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ad006fc40 con 0x7f2ad00c5300 2023-11-28T20:02:06.447 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:06.440+0000 7f2ad6c17640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ad01ee1f0 con 0x7f2ad014b1e0 2023-11-28T20:02:06.447 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:06.440+0000 7f2ad6c17640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ad006b930 con 0x7f2ad01548c0 2023-11-28T20:02:06.447 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:06.440+0000 7f2ad49b3640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2ad00c5300 0x7f2ad01edcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:02:06.447 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:06.440+0000 7f2ad49b3640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2ad00c5300 0x7f2ad01edcb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:49436/0 (socket says 172.21.15.78:49436) 2023-11-28T20:02:06.447 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:06.440+0000 7f2ad49b3640 1 -- 172.21.15.78:0/1184350110 learned_addr learned my addr 172.21.15.78:0/1184350110 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T20:02:06.447 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:06.440+0000 7f2ac7fff640 1 --2- 172.21.15.78:0/1184350110 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2ad014b1e0 0x7f2ad0143060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:02:06.448 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:06.440+0000 7f2ad51b4640 1 --2- 172.21.15.78:0/1184350110 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2ad01548c0 0x7f2ad0146c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:02:06.448 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:06.440+0000 7f2ad49b3640 1 -- 172.21.15.78:0/1184350110 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2ad01548c0 msgr2=0x7f2ad0146c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:02:06.448 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:06.440+0000 7f2ad49b3640 1 --2- 172.21.15.78:0/1184350110 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2ad01548c0 0x7f2ad0146c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:06.448 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:06.440+0000 7f2ad49b3640 1 -- 172.21.15.78:0/1184350110 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2ad014b1e0 msgr2=0x7f2ad0143060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:02:06.448 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:06.440+0000 7f2ad49b3640 1 --2- 172.21.15.78:0/1184350110 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2ad014b1e0 0x7f2ad0143060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:06.448 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:06.440+0000 7f2ad49b3640 1 -- 172.21.15.78:0/1184350110 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ac00094d0 con 0x7f2ad00c5300 2023-11-28T20:02:06.448 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:06.444+0000 7f2ad49b3640 1 --2- 172.21.15.78:0/1184350110 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2ad00c5300 0x7f2ad01edcb0 secure :-1 s=READY pgs=881 cs=0 l=1 rev1=1 crypto rx=0x7f2acc007fd0 tx=0x7f2acc00c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:02:06.449 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:06.444+0000 7f2ac57fa640 1 -- 172.21.15.78:0/1184350110 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2acc0052d0 con 0x7f2ad00c5300 2023-11-28T20:02:06.449 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:06.444+0000 7f2ac57fa640 1 -- 172.21.15.78:0/1184350110 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2acc005430 con 0x7f2ad00c5300 2023-11-28T20:02:06.449 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:06.444+0000 7f2ac57fa640 1 -- 172.21.15.78:0/1184350110 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2acc003840 con 0x7f2ad00c5300 2023-11-28T20:02:06.449 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:06.444+0000 7f2ad6c17640 1 -- 172.21.15.78:0/1184350110 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2ad006cdd0 con 0x7f2ad00c5300 2023-11-28T20:02:06.449 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:06.444+0000 7f2ad6c17640 1 -- 172.21.15.78:0/1184350110 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2ad006d390 con 0x7f2ad00c5300 2023-11-28T20:02:06.450 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:06.444+0000 7f2ad6c17640 1 -- 172.21.15.78:0/1184350110 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2ad0067630 con 0x7f2ad00c5300 2023-11-28T20:02:06.450 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:06.444+0000 7f2ac57fa640 1 -- 172.21.15.78:0/1184350110 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f2acc0039a0 con 0x7f2ad00c5300 2023-11-28T20:02:06.450 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:06.444+0000 7f2ac57fa640 1 --2- 172.21.15.78:0/1184350110 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f2abc0664a0 0x7f2abc068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:06.450 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:06.444+0000 7f2ac57fa640 1 -- 172.21.15.78:0/1184350110 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 5547+0+0 (secure 0 0 0) 0x7f2acc0832b0 con 0x7f2ad00c5300 2023-11-28T20:02:06.451 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:06.444+0000 7f2ac7fff640 1 --2- 172.21.15.78:0/1184350110 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f2abc0664a0 0x7f2abc068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:02:06.451 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:06.448+0000 7f2ac7fff640 1 --2- 172.21.15.78:0/1184350110 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f2abc0664a0 0x7f2abc068960 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f2ac00af000 tx=0x7f2ac00b6040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:02:06.455 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:06.452+0000 7f2ac57fa640 1 -- 172.21.15.78:0/1184350110 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f2acc050870 con 0x7f2ad00c5300 2023-11-28T20:02:06.609 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:06.604+0000 7f2ad6c17640 1 -- 172.21.15.78:0/1184350110 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f2ad006d920 con 0x7f2ad00c5300 2023-11-28T20:02:07.273 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:07.268+0000 7f2ac57fa640 1 -- 172.21.15.78:0/1184350110 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v79) v1 ==== 170+0+0 (secure 0 0 0) 0x7f2acc053e90 con 0x7f2ad00c5300 2023-11-28T20:02:07.273 INFO:teuthology.orchestra.run.smithi078.stderr:pool 'cephfs_data' created 2023-11-28T20:02:07.275 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:07.268+0000 7f2ad6c17640 1 -- 172.21.15.78:0/1184350110 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f2abc0664a0 msgr2=0x7f2abc068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:02:07.275 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:07.272+0000 7f2ad6c17640 1 --2- 172.21.15.78:0/1184350110 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f2abc0664a0 0x7f2abc068960 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f2ac00af000 tx=0x7f2ac00b6040 comp rx=0 tx=0).stop 2023-11-28T20:02:07.275 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:07.272+0000 7f2ad6c17640 1 -- 172.21.15.78:0/1184350110 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2ad00c5300 msgr2=0x7f2ad01edcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:02:07.275 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:07.272+0000 7f2ad6c17640 1 --2- 172.21.15.78:0/1184350110 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2ad00c5300 0x7f2ad01edcb0 secure :-1 s=READY pgs=881 cs=0 l=1 rev1=1 crypto rx=0x7f2acc007fd0 tx=0x7f2acc00c890 comp rx=0 tx=0).stop 2023-11-28T20:02:07.276 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:07.272+0000 7f2ad6c17640 1 -- 172.21.15.78:0/1184350110 shutdown_connections 2023-11-28T20:02:07.276 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:07.272+0000 7f2ad6c17640 1 --2- 172.21.15.78:0/1184350110 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f2abc0664a0 0x7f2abc068960 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:07.276 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:07.272+0000 7f2ad6c17640 1 --2- 172.21.15.78:0/1184350110 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2ad01548c0 0x7f2ad0146c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:07.276 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:07.272+0000 7f2ad6c17640 1 --2- 172.21.15.78:0/1184350110 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2ad014b1e0 0x7f2ad0143060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:07.276 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:07.272+0000 7f2ad6c17640 1 --2- 172.21.15.78:0/1184350110 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2ad00c5300 0x7f2ad01edcb0 unknown :-1 s=CLOSED pgs=881 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:07.276 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:07.272+0000 7f2ad6c17640 1 -- 172.21.15.78:0/1184350110 >> 172.21.15.78:0/1184350110 conn(0x7f2ad00c59f0 msgr2=0x7f2ad00c6060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:02:07.277 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:07.272+0000 7f2ad6c17640 1 -- 172.21.15.78:0/1184350110 shutdown_connections 2023-11-28T20:02:07.277 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:07.272+0000 7f2ad6c17640 1 -- 172.21.15.78:0/1184350110 wait complete. 2023-11-28T20:02:07.314 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-11-28T20:02:07.453 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:07.448+0000 7f43a75aa640 1 Processor -- start 2023-11-28T20:02:07.453 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:07.448+0000 7f43a75aa640 1 -- start start 2023-11-28T20:02:07.454 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:07.448+0000 7f43a75aa640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f43a014f850 0x7f43a00aacf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:07.454 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:07.448+0000 7f43a75aa640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f43a014fc30 0x7f43a00c3cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:07.454 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:07.448+0000 7f43a75aa640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f43a0152910 con 0x7f43a006d840 2023-11-28T20:02:07.455 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:07.448+0000 7f43a75aa640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f43a00c2240 con 0x7f43a014fc30 2023-11-28T20:02:07.455 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:07.448+0000 7f43a75aa640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f43a0152bf0 con 0x7f43a014f850 2023-11-28T20:02:07.455 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:07.448+0000 7f43a5346640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f43a014f850 0x7f43a00aacf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:02:07.456 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:07.448+0000 7f43a4b45640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f43a014fc30 0x7f43a00c3cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:02:07.456 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:07.448+0000 7f43a5346640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f43a014f850 0x7f43a00aacf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3301/0 says I am v2:172.21.15.78:57552/0 (socket says 172.21.15.78:57552) 2023-11-28T20:02:07.456 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:07.448+0000 7f43a4b45640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f43a014fc30 0x7f43a00c3cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.78:46792/0 (socket says 172.21.15.78:46792) 2023-11-28T20:02:07.456 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:07.448+0000 7f43a5346640 1 -- 172.21.15.78:0/3508826385 learned_addr learned my addr 172.21.15.78:0/3508826385 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T20:02:07.456 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:07.452+0000 7f43a5346640 1 -- 172.21.15.78:0/3508826385 >> v2:172.21.15.179:3300/0 conn(0x7f43a014fc30 msgr2=0x7f43a00c3cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:02:07.456 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:07.452+0000 7f43a5346640 1 --2- 172.21.15.78:0/3508826385 >> v2:172.21.15.179:3300/0 conn(0x7f43a014fc30 0x7f43a00c3cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:07.456 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:07.452+0000 7f43a5346640 1 -- 172.21.15.78:0/3508826385 >> v1:172.21.15.179:6789/0 conn(0x7f43a006d840 legacy=0x7f43a00c4210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:02:07.456 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:07.452+0000 7f43a5346640 1 -- 172.21.15.78:0/3508826385 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43a0152ed0 con 0x7f43a014f850 2023-11-28T20:02:07.456 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:07.452+0000 7f43a4b45640 1 --2- 172.21.15.78:0/3508826385 >> v2:172.21.15.179:3300/0 conn(0x7f43a014fc30 0x7f43a00c3cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T20:02:07.458 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:07.452+0000 7f43a5346640 1 --2- 172.21.15.78:0/3508826385 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f43a014f850 0x7f43a00aacf0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f439c009870 tx=0x7f439c01c540 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d4e5b1df146fff9 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:02:07.459 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:07.452+0000 7f4397fff640 1 -- 172.21.15.78:0/3508826385 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f439c0a9620 con 0x7f43a014f850 2023-11-28T20:02:07.459 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:07.452+0000 7f4397fff640 1 -- 172.21.15.78:0/3508826385 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f439c0a9780 con 0x7f43a014f850 2023-11-28T20:02:07.459 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:07.452+0000 7f4397fff640 1 -- 172.21.15.78:0/3508826385 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f439c0a9b10 con 0x7f43a014f850 2023-11-28T20:02:07.460 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:07.456+0000 7f43a75aa640 1 -- 172.21.15.78:0/3508826385 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f43a014f850 msgr2=0x7f43a00aacf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:02:07.460 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:07.456+0000 7f43a75aa640 1 --2- 172.21.15.78:0/3508826385 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f43a014f850 0x7f43a00aacf0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f439c009870 tx=0x7f439c01c540 comp rx=0 tx=0).stop 2023-11-28T20:02:07.460 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:07.456+0000 7f43a75aa640 1 -- 172.21.15.78:0/3508826385 shutdown_connections 2023-11-28T20:02:07.460 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:07.456+0000 7f43a75aa640 1 --2- 172.21.15.78:0/3508826385 >> v2:172.21.15.179:3300/0 conn(0x7f43a014fc30 0x7f43a00c3cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:07.460 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:07.456+0000 7f43a75aa640 1 --2- 172.21.15.78:0/3508826385 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f43a014f850 0x7f43a00aacf0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:07.460 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:07.456+0000 7f43a75aa640 1 -- 172.21.15.78:0/3508826385 >> 172.21.15.78:0/3508826385 conn(0x7f43a00c59f0 msgr2=0x7f43a00c5e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:02:07.460 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:07.456+0000 7f43a75aa640 1 -- 172.21.15.78:0/3508826385 shutdown_connections 2023-11-28T20:02:07.460 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:07.456+0000 7f43a75aa640 1 -- 172.21.15.78:0/3508826385 wait complete. 2023-11-28T20:02:07.461 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:07.456+0000 7f43a75aa640 1 Processor -- start 2023-11-28T20:02:07.461 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:07.456+0000 7f43a75aa640 1 -- start start 2023-11-28T20:02:07.464 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:07.456+0000 7f43a75aa640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f43a006d840 0x7f43a014b120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:07.464 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:07.456+0000 7f43a75aa640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f43a014f850 0x7f43a01f0c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:07.464 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:07.456+0000 7f43a75aa640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f43a014fc30 0x7f43a01f11b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:07.464 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:07.456+0000 7f43a75aa640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43a00a8b90 con 0x7f43a006d840 2023-11-28T20:02:07.464 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:07.456+0000 7f43a75aa640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43a00a8de0 con 0x7f43a014f850 2023-11-28T20:02:07.464 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:07.456+0000 7f43a75aa640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f43a0155800 con 0x7f43a014fc30 2023-11-28T20:02:07.464 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:07.456+0000 7f43a5346640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f43a006d840 0x7f43a014b120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:02:07.464 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:07.456+0000 7f43a5346640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f43a006d840 0x7f43a014b120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:49438/0 (socket says 172.21.15.78:49438) 2023-11-28T20:02:07.464 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:07.456+0000 7f43a5346640 1 -- 172.21.15.78:0/1783010303 learned_addr learned my addr 172.21.15.78:0/1783010303 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T20:02:07.465 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:07.456+0000 7f43a4b45640 1 --2- 172.21.15.78:0/1783010303 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f43a014f850 0x7f43a01f0c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:02:07.465 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:07.456+0000 7f43a5b47640 1 --2- 172.21.15.78:0/1783010303 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f43a014fc30 0x7f43a01f11b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:02:07.465 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:07.456+0000 7f43a5346640 1 -- 172.21.15.78:0/1783010303 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f43a014fc30 msgr2=0x7f43a01f11b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:02:07.465 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:07.456+0000 7f43a5346640 1 --2- 172.21.15.78:0/1783010303 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f43a014fc30 0x7f43a01f11b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:07.465 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:07.456+0000 7f43a5346640 1 -- 172.21.15.78:0/1783010303 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f43a014f850 msgr2=0x7f43a01f0c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:02:07.465 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:07.456+0000 7f43a5346640 1 --2- 172.21.15.78:0/1783010303 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f43a014f850 0x7f43a01f0c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:07.465 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:07.460+0000 7f43a5346640 1 -- 172.21.15.78:0/1783010303 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4390009420 con 0x7f43a006d840 2023-11-28T20:02:07.465 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:07.460+0000 7f43a5346640 1 --2- 172.21.15.78:0/1783010303 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f43a006d840 0x7f43a014b120 secure :-1 s=READY pgs=882 cs=0 l=1 rev1=1 crypto rx=0x7f439c0ab040 tx=0x7f439c01ad80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:02:07.465 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:07.460+0000 7f4395ffb640 1 -- 172.21.15.78:0/1783010303 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f439c0a9e80 con 0x7f43a006d840 2023-11-28T20:02:07.465 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:07.460+0000 7f4395ffb640 1 -- 172.21.15.78:0/1783010303 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f439c0bc450 con 0x7f43a006d840 2023-11-28T20:02:07.465 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:07.460+0000 7f4395ffb640 1 -- 172.21.15.78:0/1783010303 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f439c0bc800 con 0x7f43a006d840 2023-11-28T20:02:07.465 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:07.460+0000 7f43a75aa640 1 -- 172.21.15.78:0/1783010303 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f439c0094d0 con 0x7f43a006d840 2023-11-28T20:02:07.466 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:07.460+0000 7f43a75aa640 1 -- 172.21.15.78:0/1783010303 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f43a0155dc0 con 0x7f43a006d840 2023-11-28T20:02:07.466 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:07.460+0000 7f43a75aa640 1 -- 172.21.15.78:0/1783010303 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f43a0067630 con 0x7f43a006d840 2023-11-28T20:02:07.466 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:07.460+0000 7f4395ffb640 1 -- 172.21.15.78:0/1783010303 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f439c0bc960 con 0x7f43a006d840 2023-11-28T20:02:07.467 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:07.460+0000 7f4395ffb640 1 --2- 172.21.15.78:0/1783010303 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f4384066470 0x7f4384068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:07.467 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:07.464+0000 7f4395ffb640 1 -- 172.21.15.78:0/1783010303 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 5929+0+0 (secure 0 0 0) 0x7f439c11e770 con 0x7f43a006d840 2023-11-28T20:02:07.467 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:07.464+0000 7f43a4b45640 1 --2- 172.21.15.78:0/1783010303 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f4384066470 0x7f4384068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:02:07.467 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:07.464+0000 7f43a4b45640 1 --2- 172.21.15.78:0/1783010303 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f4384066470 0x7f4384068930 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f43a00a68b0 tx=0x7f4390009190 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:02:07.470 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:07.464+0000 7f4395ffb640 1 -- 172.21.15.78:0/1783010303 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f439c0ebca0 con 0x7f43a006d840 2023-11-28T20:02:07.650 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:07.644+0000 7f43a75aa640 1 -- 172.21.15.78:0/1783010303 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f43a00a4a90 con 0x7f43a006d840 2023-11-28T20:02:08.295 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:08.284+0000 7f4395ffb640 1 -- 172.21.15.78:0/1783010303 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 13 and data pool 14 v42) v1 ==== 174+0+0 (secure 0 0 0) 0x7f439c0ef2c0 con 0x7f43a006d840 2023-11-28T20:02:08.301 INFO:teuthology.orchestra.run.smithi078.stderr:new fs with metadata pool 13 and data pool 14 2023-11-28T20:02:08.303 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:08.296+0000 7f43a75aa640 1 -- 172.21.15.78:0/1783010303 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f4384066470 msgr2=0x7f4384068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:02:08.303 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:08.296+0000 7f43a75aa640 1 --2- 172.21.15.78:0/1783010303 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f4384066470 0x7f4384068930 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f43a00a68b0 tx=0x7f4390009190 comp rx=0 tx=0).stop 2023-11-28T20:02:08.303 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:08.296+0000 7f43a75aa640 1 -- 172.21.15.78:0/1783010303 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f43a006d840 msgr2=0x7f43a014b120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:02:08.303 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:08.296+0000 7f43a75aa640 1 --2- 172.21.15.78:0/1783010303 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f43a006d840 0x7f43a014b120 secure :-1 s=READY pgs=882 cs=0 l=1 rev1=1 crypto rx=0x7f439c0ab040 tx=0x7f439c01ad80 comp rx=0 tx=0).stop 2023-11-28T20:02:08.304 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:08.296+0000 7f43a75aa640 1 -- 172.21.15.78:0/1783010303 shutdown_connections 2023-11-28T20:02:08.304 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:08.296+0000 7f43a75aa640 1 --2- 172.21.15.78:0/1783010303 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f4384066470 0x7f4384068930 secure :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f43a00a68b0 tx=0x7f4390009190 comp rx=0 tx=0).stop 2023-11-28T20:02:08.304 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:08.296+0000 7f43a75aa640 1 --2- 172.21.15.78:0/1783010303 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f43a014fc30 0x7f43a01f11b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:08.304 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:08.296+0000 7f43a75aa640 1 --2- 172.21.15.78:0/1783010303 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f43a014f850 0x7f43a01f0c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:08.304 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:08.296+0000 7f43a75aa640 1 --2- 172.21.15.78:0/1783010303 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f43a006d840 0x7f43a014b120 unknown :-1 s=CLOSED pgs=882 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:08.304 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:08.300+0000 7f43a75aa640 1 -- 172.21.15.78:0/1783010303 >> 172.21.15.78:0/1783010303 conn(0x7f43a00c59f0 msgr2=0x7f43a0151b70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:02:08.308 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:08.300+0000 7f43a75aa640 1 -- 172.21.15.78:0/1783010303 shutdown_connections 2023-11-28T20:02:08.309 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:08.304+0000 7f43a75aa640 1 -- 172.21.15.78:0/1783010303 wait complete. 2023-11-28T20:02:08.337 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-28T20:02:08.475 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:08.468+0000 7f4c7e934640 1 Processor -- start 2023-11-28T20:02:08.475 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:08.472+0000 7f4c7e934640 1 -- start start 2023-11-28T20:02:08.476 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:08.472+0000 7f4c7e934640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4c780c8200 0x7f4c780c69d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:08.476 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:08.472+0000 7f4c7e934640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f4c780c9210 0x7f4c7815ecf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:08.476 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:08.472+0000 7f4c7e934640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4c78151f20 con 0x7f4c780c65f0 2023-11-28T20:02:08.477 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:08.472+0000 7f4c7e934640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4c78154450 con 0x7f4c780c9210 2023-11-28T20:02:08.477 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:08.472+0000 7f4c7e934640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4c78154710 con 0x7f4c780c8200 2023-11-28T20:02:08.477 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:08.472+0000 7f4c7d932640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f4c780c65f0 0x7f4c780c8b00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:40328/0 (socket says 172.21.15.78:40328) 2023-11-28T20:02:08.477 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:08.472+0000 7f4c7d932640 1 -- 172.21.15.78:0/2856231704 learned_addr learned my addr 172.21.15.78:0/2856231704 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-11-28T20:02:08.478 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:08.472+0000 7f4c7e133640 1 --2- 172.21.15.78:0/2856231704 >> v2:172.21.15.179:3300/0 conn(0x7f4c780c9210 0x7f4c7815ecf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:02:08.478 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:08.472+0000 7f4c7d131640 1 --2- 172.21.15.78:0/2856231704 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4c780c8200 0x7f4c780c69d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:02:08.478 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:08.472+0000 7f4c7c930640 1 -- 172.21.15.78:0/2856231704 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 83268838 0 0) 0x7f4c78151f20 con 0x7f4c780c65f0 2023-11-28T20:02:08.478 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:08.472+0000 7f4c7c930640 1 -- 172.21.15.78:0/2856231704 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4c64003530 con 0x7f4c780c65f0 2023-11-28T20:02:08.478 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:08.472+0000 7f4c7c930640 1 -- 172.21.15.78:0/2856231704 <== mon.0 v1:172.21.15.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3570777570 0 0) 0x7f4c64003530 con 0x7f4c780c65f0 2023-11-28T20:02:08.478 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:08.472+0000 7f4c7e133640 1 -- 172.21.15.78:0/2856231704 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4c780c8200 msgr2=0x7f4c780c69d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:02:08.478 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:08.472+0000 7f4c7e133640 1 --2- 172.21.15.78:0/2856231704 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4c780c8200 0x7f4c780c69d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:08.478 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:08.472+0000 7f4c7e133640 1 -- 172.21.15.78:0/2856231704 >> v1:172.21.15.78:6789/0 conn(0x7f4c780c65f0 legacy=0x7f4c780c8b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:02:08.479 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:08.472+0000 7f4c7e133640 1 -- 172.21.15.78:0/2856231704 --> v2:172.21.15.179:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c781549f0 con 0x7f4c780c9210 2023-11-28T20:02:08.479 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:08.472+0000 7f4c7d131640 1 --2- 172.21.15.78:0/2856231704 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4c780c8200 0x7f4c780c69d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T20:02:08.480 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:08.476+0000 7f4c7e133640 1 --2- 172.21.15.78:0/2856231704 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4c780c9210 0x7f4c7815ecf0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f4c70009d90 tx=0x7f4c7001c7b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1470c3e61cd7a91a server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:02:08.480 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:08.476+0000 7f4c7c930640 1 -- 172.21.15.78:0/2856231704 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c74001680 con 0x7f4c780c9210 2023-11-28T20:02:08.481 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:08.476+0000 7f4c7c930640 1 -- 172.21.15.78:0/2856231704 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c700a55b0 con 0x7f4c780c9210 2023-11-28T20:02:08.481 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:08.476+0000 7f4c7c930640 1 -- 172.21.15.78:0/2856231704 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c700a5920 con 0x7f4c780c9210 2023-11-28T20:02:08.481 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:08.476+0000 7f4c7e934640 1 -- 172.21.15.78:0/2856231704 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4c780c9210 msgr2=0x7f4c7815ecf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:02:08.481 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:08.476+0000 7f4c7e934640 1 --2- 172.21.15.78:0/2856231704 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4c780c9210 0x7f4c7815ecf0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f4c70009d90 tx=0x7f4c7001c7b0 comp rx=0 tx=0).stop 2023-11-28T20:02:08.482 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:08.476+0000 7f4c7e934640 1 -- 172.21.15.78:0/2856231704 shutdown_connections 2023-11-28T20:02:08.482 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:08.476+0000 7f4c7e934640 1 --2- 172.21.15.78:0/2856231704 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4c780c9210 0x7f4c7815ecf0 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:08.482 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:08.476+0000 7f4c7e934640 1 --2- 172.21.15.78:0/2856231704 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4c780c8200 0x7f4c780c69d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:08.482 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:08.476+0000 7f4c7e934640 1 -- 172.21.15.78:0/2856231704 >> 172.21.15.78:0/2856231704 conn(0x7f4c780ab730 msgr2=0x7f4c780abb40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:02:08.482 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:08.476+0000 7f4c7e934640 1 -- 172.21.15.78:0/2856231704 shutdown_connections 2023-11-28T20:02:08.482 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:08.476+0000 7f4c7e934640 1 -- 172.21.15.78:0/2856231704 wait complete. 2023-11-28T20:02:08.483 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:08.480+0000 7f4c7e934640 1 Processor -- start 2023-11-28T20:02:08.483 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:08.480+0000 7f4c7e934640 1 -- start start 2023-11-28T20:02:08.484 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:08.480+0000 7f4c7e934640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4c780c65f0 0x7f4c78146270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:08.484 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:08.480+0000 7f4c7e934640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4c780c8200 0x7f4c780a9900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:08.484 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:08.480+0000 7f4c7e934640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4c780c9210 0x7f4c781ecde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:08.484 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:08.480+0000 7f4c7e934640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c780bf350 con 0x7f4c780c9210 2023-11-28T20:02:08.485 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:08.480+0000 7f4c7e934640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c781f0ef0 con 0x7f4c780c8200 2023-11-28T20:02:08.485 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:08.480+0000 7f4c7e934640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4c781f0990 con 0x7f4c780c65f0 2023-11-28T20:02:08.485 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:08.480+0000 7f4c7e133640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4c780c9210 0x7f4c781ecde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:02:08.485 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:08.480+0000 7f4c7e133640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4c780c9210 0x7f4c781ecde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:49440/0 (socket says 172.21.15.78:49440) 2023-11-28T20:02:08.485 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:08.480+0000 7f4c7e133640 1 -- 172.21.15.78:0/3501491304 learned_addr learned my addr 172.21.15.78:0/3501491304 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T20:02:08.485 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:08.480+0000 7f4c7d131640 1 --2- 172.21.15.78:0/3501491304 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4c780c8200 0x7f4c780a9900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:02:08.485 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:08.480+0000 7f4c7d932640 1 --2- 172.21.15.78:0/3501491304 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4c780c65f0 0x7f4c78146270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:02:08.486 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:08.480+0000 7f4c7e133640 1 -- 172.21.15.78:0/3501491304 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4c780c65f0 msgr2=0x7f4c78146270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:02:08.486 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:08.480+0000 7f4c7e133640 1 --2- 172.21.15.78:0/3501491304 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4c780c65f0 0x7f4c78146270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:08.486 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:08.480+0000 7f4c7e133640 1 -- 172.21.15.78:0/3501491304 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4c780c8200 msgr2=0x7f4c780a9900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:02:08.486 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:08.480+0000 7f4c7e133640 1 --2- 172.21.15.78:0/3501491304 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4c780c8200 0x7f4c780a9900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:08.486 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:08.480+0000 7f4c7e133640 1 -- 172.21.15.78:0/3501491304 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c68009420 con 0x7f4c780c9210 2023-11-28T20:02:08.487 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:08.480+0000 7f4c7e133640 1 --2- 172.21.15.78:0/3501491304 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4c780c9210 0x7f4c781ecde0 secure :-1 s=READY pgs=884 cs=0 l=1 rev1=1 crypto rx=0x7f4c7001ae60 tx=0x7f4c70019550 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:02:08.487 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:08.480+0000 7f4c6e7fc640 1 -- 172.21.15.78:0/3501491304 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c70009450 con 0x7f4c780c9210 2023-11-28T20:02:08.487 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:08.480+0000 7f4c6e7fc640 1 -- 172.21.15.78:0/3501491304 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c700a5e00 con 0x7f4c780c9210 2023-11-28T20:02:08.487 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:08.480+0000 7f4c6e7fc640 1 -- 172.21.15.78:0/3501491304 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c700ad850 con 0x7f4c780c9210 2023-11-28T20:02:08.487 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:08.480+0000 7f4c7e934640 1 -- 172.21.15.78:0/3501491304 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4c70009a70 con 0x7f4c780c9210 2023-11-28T20:02:08.487 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:08.480+0000 7f4c7e934640 1 -- 172.21.15.78:0/3501491304 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4c780bd810 con 0x7f4c780c9210 2023-11-28T20:02:08.487 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:08.480+0000 7f4c7e934640 1 -- 172.21.15.78:0/3501491304 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4c780674b0 con 0x7f4c780c9210 2023-11-28T20:02:08.488 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:08.484+0000 7f4c6e7fc640 1 -- 172.21.15.78:0/3501491304 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f4c700ad9b0 con 0x7f4c780c9210 2023-11-28T20:02:08.488 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:08.484+0000 7f4c6e7fc640 1 --2- 172.21.15.78:0/3501491304 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f4c5c066470 0x7f4c5c068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:08.488 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:08.484+0000 7f4c6e7fc640 1 -- 172.21.15.78:0/3501491304 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f4c7011ee40 con 0x7f4c780c9210 2023-11-28T20:02:08.488 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:08.484+0000 7f4c7d932640 1 --2- 172.21.15.78:0/3501491304 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f4c5c066470 0x7f4c5c068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:02:08.489 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:08.484+0000 7f4c7d932640 1 --2- 172.21.15.78:0/3501491304 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f4c5c066470 0x7f4c5c068930 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f4c78151870 tx=0x7f4c74001d30 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:02:08.492 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:08.488+0000 7f4c6e7fc640 1 -- 172.21.15.78:0/3501491304 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f4c700ec2a0 con 0x7f4c780c9210 2023-11-28T20:02:08.643 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:08.636+0000 7f4c7e934640 1 -- 172.21.15.78:0/3501491304 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f4c78152040 con 0x7f4c780c9210 2023-11-28T20:02:08.644 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:08.640+0000 7f4c6e7fc640 1 -- 172.21.15.78:0/3501491304 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v80) v1 ==== 74+0+16706 (secure 0 0 0) 0x7f4c700bc090 con 0x7f4c780c9210 2023-11-28T20:02:08.644 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-11-28T20:02:08.644 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":80,"fsid":"dd9780e8-3bda-44fa-a9f0-fa07d19d901d","created":"2023-11-28T19:58:40.969556+0000","modified":"2023-11-28T20:02:07.651336+0000","last_up_change":"2023-11-28T19:58:52.596716+0000","last_in_change":"2023-11-28T19:58:43.609275+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":14,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-28T19:58:54.011229+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_metadata","create_time":"2023-11-28T20:02:05.787820+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs_data","create_time":"2023-11-28T20:02:06.652305+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e84245ac-b5da-429e-af18-39acaa2b33e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6800","nonce":3358701235},{"type":"v1","addr":"172.21.15.78:6801","nonce":3358701235}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6802","nonce":3358701235},{"type":"v1","addr":"172.21.15.78:6803","nonce":3358701235}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6806","nonce":3358701235},{"type":"v1","addr":"172.21.15.78:6807","nonce":3358701235}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6804","nonce":3358701235},{"type":"v1","addr":"172.21.15.78:6805","nonce":3358701235}]},"public_addr":"172.21.15.78:6801/3358701235","cluster_addr":"172.21.15.78:6803/3358701235","heartbeat_back_addr":"172.21.15.78:6807/3358701235","heartbeat_front_addr":"172.21.15.78:6805/3358701235","state":["exists","up"]},{"osd":1,"uuid":"e634831d-c4e2-48d9-870c-9556ae162981","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6808","nonce":3211476654},{"type":"v1","addr":"172.21.15.78:6809","nonce":3211476654}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6810","nonce":3211476654},{"type":"v1","addr":"172.21.15.78:6811","nonce":3211476654}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6814","nonce":3211476654},{"type":"v1","addr":"172.21.15.78:6815","nonce":3211476654}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6812","nonce":3211476654},{"type":"v1","addr":"172.21.15.78:6813","nonce":3211476654}]},"public_addr":"172.21.15.78:6809/3211476654","cluster_addr":"172.21.15.78:6811/3211476654","heartbeat_back_addr":"172.21.15.78:6815/3211476654","heartbeat_front_addr":"172.21.15.78:6813/3211476654","state":["exists","up"]},{"osd":2,"uuid":"274c8395-6534-41f0-b8fb-a00af8985aa8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6816","nonce":2532904479},{"type":"v1","addr":"172.21.15.78:6817","nonce":2532904479}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6818","nonce":2532904479},{"type":"v1","addr":"172.21.15.78:6819","nonce":2532904479}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6822","nonce":2532904479},{"type":"v1","addr":"172.21.15.78:6823","nonce":2532904479}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6820","nonce":2532904479},{"type":"v1","addr":"172.21.15.78:6821","nonce":2532904479}]},"public_addr":"172.21.15.78:6817/2532904479","cluster_addr":"172.21.15.78:6819/2532904479","heartbeat_back_addr":"172.21.15.78:6823/2532904479","heartbeat_front_addr":"172.21.15.78:6821/2532904479","state":["exists","up"]},{"osd":3,"uuid":"77acc9af-7d4d-4b18-8cf5-d62f5971b7c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6824","nonce":3442991267},{"type":"v1","addr":"172.21.15.78:6825","nonce":3442991267}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6826","nonce":3442991267},{"type":"v1","addr":"172.21.15.78:6827","nonce":3442991267}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6830","nonce":3442991267},{"type":"v1","addr":"172.21.15.78:6831","nonce":3442991267}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6828","nonce":3442991267},{"type":"v1","addr":"172.21.15.78:6829","nonce":3442991267}]},"public_addr":"172.21.15.78:6825/3442991267","cluster_addr":"172.21.15.78:6827/3442991267","heartbeat_back_addr":"172.21.15.78:6831/3442991267","heartbeat_front_addr":"172.21.15.78:6829/3442991267","state":["exists","up"]},{"osd":4,"uuid":"5c62bc66-6b34-4b7f-a66b-9a743969138c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":802983577},{"type":"v1","addr":"172.21.15.179:6809","nonce":802983577}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":802983577},{"type":"v1","addr":"172.21.15.179:6811","nonce":802983577}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":802983577},{"type":"v1","addr":"172.21.15.179:6815","nonce":802983577}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":802983577},{"type":"v1","addr":"172.21.15.179:6813","nonce":802983577}]},"public_addr":"172.21.15.179:6809/802983577","cluster_addr":"172.21.15.179:6811/802983577","heartbeat_back_addr":"172.21.15.179:6815/802983577","heartbeat_front_addr":"172.21.15.179:6813/802983577","state":["exists","up"]},{"osd":5,"uuid":"67db6d36-f684-4079-b0cd-82b4dd61461f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":518192887},{"type":"v1","addr":"172.21.15.179:6818","nonce":518192887}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":518192887},{"type":"v1","addr":"172.21.15.179:6822","nonce":518192887}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":518192887},{"type":"v1","addr":"172.21.15.179:6829","nonce":518192887}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6824","nonce":518192887},{"type":"v1","addr":"172.21.15.179:6826","nonce":518192887}]},"public_addr":"172.21.15.179:6818/518192887","cluster_addr":"172.21.15.179:6822/518192887","heartbeat_back_addr":"172.21.15.179:6829/518192887","heartbeat_front_addr":"172.21.15.179:6826/518192887","state":["exists","up"]},{"osd":6,"uuid":"12e670af-5a16-4c81-9f97-defa66cab967","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":815435378},{"type":"v1","addr":"172.21.15.179:6801","nonce":815435378}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":815435378},{"type":"v1","addr":"172.21.15.179:6803","nonce":815435378}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":815435378},{"type":"v1","addr":"172.21.15.179:6807","nonce":815435378}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":815435378},{"type":"v1","addr":"172.21.15.179:6805","nonce":815435378}]},"public_addr":"172.21.15.179:6801/815435378","cluster_addr":"172.21.15.179:6803/815435378","heartbeat_back_addr":"172.21.15.179:6807/815435378","heartbeat_front_addr":"172.21.15.179:6805/815435378","state":["exists","up"]},{"osd":7,"uuid":"fe630650-2eb3-49ad-8676-c341e6332eb1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6817","nonce":2848432339},{"type":"v1","addr":"172.21.15.179:6819","nonce":2848432339}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6821","nonce":2848432339},{"type":"v1","addr":"172.21.15.179:6823","nonce":2848432339}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":2848432339},{"type":"v1","addr":"172.21.15.179:6831","nonce":2848432339}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6825","nonce":2848432339},{"type":"v1","addr":"172.21.15.179:6827","nonce":2848432339}]},"public_addr":"172.21.15.179:6819/2848432339","cluster_addr":"172.21.15.179:6823/2848432339","heartbeat_back_addr":"172.21.15.179:6831/2848432339","heartbeat_front_addr":"172.21.15.179:6827/2848432339","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:58:49.255433+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:58:49.412880+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:58:49.559295+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:58:49.245237+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:58:49.184557+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:58:49.329851+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:58:49.366012+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:58:49.349604+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-28T20:02:08.646 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:08.640+0000 7f4c7e934640 1 -- 172.21.15.78:0/3501491304 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f4c5c066470 msgr2=0x7f4c5c068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:02:08.646 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:08.640+0000 7f4c7e934640 1 --2- 172.21.15.78:0/3501491304 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f4c5c066470 0x7f4c5c068930 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f4c78151870 tx=0x7f4c74001d30 comp rx=0 tx=0).stop 2023-11-28T20:02:08.647 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:08.640+0000 7f4c7e934640 1 -- 172.21.15.78:0/3501491304 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4c780c9210 msgr2=0x7f4c781ecde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:02:08.647 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:08.640+0000 7f4c7e934640 1 --2- 172.21.15.78:0/3501491304 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4c780c9210 0x7f4c781ecde0 secure :-1 s=READY pgs=884 cs=0 l=1 rev1=1 crypto rx=0x7f4c7001ae60 tx=0x7f4c70019550 comp rx=0 tx=0).stop 2023-11-28T20:02:08.647 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:08.640+0000 7f4c7e934640 1 -- 172.21.15.78:0/3501491304 shutdown_connections 2023-11-28T20:02:08.647 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:08.640+0000 7f4c7e934640 1 --2- 172.21.15.78:0/3501491304 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f4c5c066470 0x7f4c5c068930 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:08.647 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:08.640+0000 7f4c7e934640 1 --2- 172.21.15.78:0/3501491304 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4c780c9210 0x7f4c781ecde0 unknown :-1 s=CLOSED pgs=884 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:08.647 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:08.640+0000 7f4c7e934640 1 --2- 172.21.15.78:0/3501491304 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4c780c8200 0x7f4c780a9900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:08.647 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:08.640+0000 7f4c7e934640 1 --2- 172.21.15.78:0/3501491304 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4c780c65f0 0x7f4c78146270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:08.647 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:08.640+0000 7f4c7e934640 1 -- 172.21.15.78:0/3501491304 >> 172.21.15.78:0/3501491304 conn(0x7f4c780ab730 msgr2=0x7f4c780c8b00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:02:08.647 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:08.640+0000 7f4c7e934640 1 -- 172.21.15.78:0/3501491304 shutdown_connections 2023-11-28T20:02:08.647 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:08.640+0000 7f4c7e934640 1 -- 172.21.15.78:0/3501491304 wait complete. 2023-11-28T20:02:08.666 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-28T20:02:08.803 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:08.800+0000 7fbdcf116640 1 Processor -- start 2023-11-28T20:02:08.804 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:08.800+0000 7fbdcf116640 1 -- start start 2023-11-28T20:02:08.805 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:08.800+0000 7fbdcf116640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fbdc80722c0 0x7fbdc815de60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:08.805 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:08.800+0000 7fbdcf116640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbdc80c5710 con 0x7fbdc8071e30 2023-11-28T20:02:08.805 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:08.800+0000 7fbdcf116640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbdc8155c80 con 0x7fbdc814fd10 2023-11-28T20:02:08.805 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:08.800+0000 7fbdcf116640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbdc806c5e0 con 0x7fbdc80722c0 2023-11-28T20:02:08.805 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:08.800+0000 7fbdc7fff640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7fbdc8071e30 0x7fbdc8156110 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:40342/0 (socket says 172.21.15.78:40342) 2023-11-28T20:02:08.805 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:08.800+0000 7fbdc7fff640 1 -- 172.21.15.78:0/2269542275 learned_addr learned my addr 172.21.15.78:0/2269542275 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-11-28T20:02:08.805 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:08.800+0000 7fbdcd6b3640 1 --2- 172.21.15.78:0/2269542275 >> v2:172.21.15.78:3300/0 conn(0x7fbdc80722c0 0x7fbdc815de60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:02:08.806 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:08.800+0000 7fbdc77fe640 1 -- 172.21.15.78:0/2269542275 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2185200835 0 0) 0x7fbdc80c5710 con 0x7fbdc8071e30 2023-11-28T20:02:08.806 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:08.800+0000 7fbdc77fe640 1 -- 172.21.15.78:0/2269542275 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbdb8003530 con 0x7fbdc8071e30 2023-11-28T20:02:08.806 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:08.800+0000 7fbdcd6b3640 1 -- 172.21.15.78:0/2269542275 >> v1:172.21.15.179:6789/0 conn(0x7fbdc814fd10 legacy=0x7fbdc80a4dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:02:08.806 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:08.800+0000 7fbdcd6b3640 1 -- 172.21.15.78:0/2269542275 >> v1:172.21.15.78:6789/0 conn(0x7fbdc8071e30 legacy=0x7fbdc8156110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:02:08.807 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:08.800+0000 7fbdcd6b3640 1 -- 172.21.15.78:0/2269542275 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbdc80c4e70 con 0x7fbdc80722c0 2023-11-28T20:02:08.808 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:08.804+0000 7fbdcd6b3640 1 --2- 172.21.15.78:0/2269542275 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbdc80722c0 0x7fbdc815de60 secure :-1 s=READY pgs=886 cs=0 l=1 rev1=1 crypto rx=0x7fbdc0009d90 tx=0x7fbdc001c7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cfd85a754ad7ac27 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:02:08.808 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:08.804+0000 7fbdc77fe640 1 -- 172.21.15.78:0/2269542275 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbdc00a57a0 con 0x7fbdc80722c0 2023-11-28T20:02:08.809 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:08.804+0000 7fbdc77fe640 1 -- 172.21.15.78:0/2269542275 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbdc00a5900 con 0x7fbdc80722c0 2023-11-28T20:02:08.809 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:08.804+0000 7fbdc77fe640 1 -- 172.21.15.78:0/2269542275 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbdc00a5c90 con 0x7fbdc80722c0 2023-11-28T20:02:08.809 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:08.804+0000 7fbdcf116640 1 -- 172.21.15.78:0/2269542275 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbdc80722c0 msgr2=0x7fbdc815de60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:02:08.809 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:08.804+0000 7fbdcf116640 1 --2- 172.21.15.78:0/2269542275 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbdc80722c0 0x7fbdc815de60 secure :-1 s=READY pgs=886 cs=0 l=1 rev1=1 crypto rx=0x7fbdc0009d90 tx=0x7fbdc001c7f0 comp rx=0 tx=0).stop 2023-11-28T20:02:08.810 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:08.804+0000 7fbdcf116640 1 -- 172.21.15.78:0/2269542275 shutdown_connections 2023-11-28T20:02:08.810 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:08.804+0000 7fbdcf116640 1 --2- 172.21.15.78:0/2269542275 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbdc80722c0 0x7fbdc815de60 unknown :-1 s=CLOSED pgs=886 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:08.810 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:08.804+0000 7fbdcf116640 1 -- 172.21.15.78:0/2269542275 >> 172.21.15.78:0/2269542275 conn(0x7fbdc80a7810 msgr2=0x7fbdc80a7c20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:02:08.810 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:08.804+0000 7fbdcf116640 1 -- 172.21.15.78:0/2269542275 shutdown_connections 2023-11-28T20:02:08.810 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:08.804+0000 7fbdcf116640 1 -- 172.21.15.78:0/2269542275 wait complete. 2023-11-28T20:02:08.811 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:08.804+0000 7fbdcf116640 1 Processor -- start 2023-11-28T20:02:08.811 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:08.804+0000 7fbdcf116640 1 -- start start 2023-11-28T20:02:08.813 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:08.808+0000 7fbdcf116640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbdc8071e30 0x7fbdc80a6cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:08.813 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:08.808+0000 7fbdcf116640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbdc80722c0 0x7fbdc80aae00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:08.813 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:08.808+0000 7fbdcf116640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbdc814fd10 0x7fbdc81ebc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:08.813 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:08.808+0000 7fbdcf116640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbdc80a6830 con 0x7fbdc8071e30 2023-11-28T20:02:08.813 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:08.808+0000 7fbdcf116640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbdc80ab760 con 0x7fbdc814fd10 2023-11-28T20:02:08.813 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:08.808+0000 7fbdcf116640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbdc8139da0 con 0x7fbdc80722c0 2023-11-28T20:02:08.813 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:08.808+0000 7fbdcceb2640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbdc8071e30 0x7fbdc80a6cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:02:08.813 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:08.808+0000 7fbdcceb2640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbdc8071e30 0x7fbdc80a6cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:49464/0 (socket says 172.21.15.78:49464) 2023-11-28T20:02:08.813 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:08.808+0000 7fbdcceb2640 1 -- 172.21.15.78:0/2964752538 learned_addr learned my addr 172.21.15.78:0/2964752538 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T20:02:08.814 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:08.808+0000 7fbdc7fff640 1 --2- 172.21.15.78:0/2964752538 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbdc80722c0 0x7fbdc80aae00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:02:08.814 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:08.808+0000 7fbdcd6b3640 1 --2- 172.21.15.78:0/2964752538 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbdc814fd10 0x7fbdc81ebc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:02:08.814 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:08.808+0000 7fbdcceb2640 1 -- 172.21.15.78:0/2964752538 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbdc80722c0 msgr2=0x7fbdc80aae00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:02:08.814 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:08.808+0000 7fbdcceb2640 1 --2- 172.21.15.78:0/2964752538 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbdc80722c0 0x7fbdc80aae00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:08.814 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:08.808+0000 7fbdcceb2640 1 -- 172.21.15.78:0/2964752538 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbdc814fd10 msgr2=0x7fbdc81ebc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:02:08.814 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:08.808+0000 7fbdcceb2640 1 --2- 172.21.15.78:0/2964752538 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbdc814fd10 0x7fbdc81ebc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:08.814 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:08.808+0000 7fbdcceb2640 1 -- 172.21.15.78:0/2964752538 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbdc0009a70 con 0x7fbdc8071e30 2023-11-28T20:02:08.814 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:08.808+0000 7fbdcceb2640 1 --2- 172.21.15.78:0/2964752538 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbdc8071e30 0x7fbdc80a6cc0 secure :-1 s=READY pgs=887 cs=0 l=1 rev1=1 crypto rx=0x7fbdbc00b410 tx=0x7fbdbc00b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:02:08.816 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:08.808+0000 7fbdc57fa640 1 -- 172.21.15.78:0/2964752538 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbdbc004020 con 0x7fbdc8071e30 2023-11-28T20:02:08.816 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:08.808+0000 7fbdc57fa640 1 -- 172.21.15.78:0/2964752538 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbdbc004180 con 0x7fbdc8071e30 2023-11-28T20:02:08.816 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:08.808+0000 7fbdcf116640 1 -- 172.21.15.78:0/2964752538 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbdc80a61e0 con 0x7fbdc8071e30 2023-11-28T20:02:08.816 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:08.808+0000 7fbdc57fa640 1 -- 172.21.15.78:0/2964752538 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbdbc011630 con 0x7fbdc8071e30 2023-11-28T20:02:08.816 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:08.808+0000 7fbdcf116640 1 -- 172.21.15.78:0/2964752538 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbdc80ab340 con 0x7fbdc8071e30 2023-11-28T20:02:08.816 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:08.808+0000 7fbdcf116640 1 -- 172.21.15.78:0/2964752538 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbdc8067630 con 0x7fbdc8071e30 2023-11-28T20:02:08.817 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:08.812+0000 7fbdc57fa640 1 -- 172.21.15.78:0/2964752538 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fbdbc011790 con 0x7fbdc8071e30 2023-11-28T20:02:08.817 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:08.812+0000 7fbdc57fa640 1 --2- 172.21.15.78:0/2964752538 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fbdac066470 0x7fbdac068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:08.817 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:08.812+0000 7fbdc57fa640 1 -- 172.21.15.78:0/2964752538 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 6029+0+0 (secure 0 0 0) 0x7fbdbc083c00 con 0x7fbdc8071e30 2023-11-28T20:02:08.817 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:08.812+0000 7fbdc7fff640 1 --2- 172.21.15.78:0/2964752538 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fbdac066470 0x7fbdac068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:02:08.818 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:08.812+0000 7fbdc7fff640 1 --2- 172.21.15.78:0/2964752538 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fbdac066470 0x7fbdac068930 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7fbdc81edca0 tx=0x7fbdb4007d40 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:02:08.820 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:08.816+0000 7fbdc57fa640 1 -- 172.21.15.78:0/2964752538 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fbdbc050fe0 con 0x7fbdc8071e30 2023-11-28T20:02:08.971 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:08.964+0000 7fbdcf116640 1 -- 172.21.15.78:0/2964752538 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fbdc8154090 con 0x7fbdc8071e30 2023-11-28T20:02:08.972 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:08.968+0000 7fbdc57fa640 1 -- 172.21.15.78:0/2964752538 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v80) v1 ==== 74+0+16706 (secure 0 0 0) 0x7fbdbc015020 con 0x7fbdc8071e30 2023-11-28T20:02:08.972 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-11-28T20:02:08.972 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":80,"fsid":"dd9780e8-3bda-44fa-a9f0-fa07d19d901d","created":"2023-11-28T19:58:40.969556+0000","modified":"2023-11-28T20:02:07.651336+0000","last_up_change":"2023-11-28T19:58:52.596716+0000","last_in_change":"2023-11-28T19:58:43.609275+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":14,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-28T19:58:54.011229+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_metadata","create_time":"2023-11-28T20:02:05.787820+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs_data","create_time":"2023-11-28T20:02:06.652305+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e84245ac-b5da-429e-af18-39acaa2b33e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6800","nonce":3358701235},{"type":"v1","addr":"172.21.15.78:6801","nonce":3358701235}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6802","nonce":3358701235},{"type":"v1","addr":"172.21.15.78:6803","nonce":3358701235}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6806","nonce":3358701235},{"type":"v1","addr":"172.21.15.78:6807","nonce":3358701235}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6804","nonce":3358701235},{"type":"v1","addr":"172.21.15.78:6805","nonce":3358701235}]},"public_addr":"172.21.15.78:6801/3358701235","cluster_addr":"172.21.15.78:6803/3358701235","heartbeat_back_addr":"172.21.15.78:6807/3358701235","heartbeat_front_addr":"172.21.15.78:6805/3358701235","state":["exists","up"]},{"osd":1,"uuid":"e634831d-c4e2-48d9-870c-9556ae162981","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6808","nonce":3211476654},{"type":"v1","addr":"172.21.15.78:6809","nonce":3211476654}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6810","nonce":3211476654},{"type":"v1","addr":"172.21.15.78:6811","nonce":3211476654}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6814","nonce":3211476654},{"type":"v1","addr":"172.21.15.78:6815","nonce":3211476654}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6812","nonce":3211476654},{"type":"v1","addr":"172.21.15.78:6813","nonce":3211476654}]},"public_addr":"172.21.15.78:6809/3211476654","cluster_addr":"172.21.15.78:6811/3211476654","heartbeat_back_addr":"172.21.15.78:6815/3211476654","heartbeat_front_addr":"172.21.15.78:6813/3211476654","state":["exists","up"]},{"osd":2,"uuid":"274c8395-6534-41f0-b8fb-a00af8985aa8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6816","nonce":2532904479},{"type":"v1","addr":"172.21.15.78:6817","nonce":2532904479}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6818","nonce":2532904479},{"type":"v1","addr":"172.21.15.78:6819","nonce":2532904479}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6822","nonce":2532904479},{"type":"v1","addr":"172.21.15.78:6823","nonce":2532904479}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6820","nonce":2532904479},{"type":"v1","addr":"172.21.15.78:6821","nonce":2532904479}]},"public_addr":"172.21.15.78:6817/2532904479","cluster_addr":"172.21.15.78:6819/2532904479","heartbeat_back_addr":"172.21.15.78:6823/2532904479","heartbeat_front_addr":"172.21.15.78:6821/2532904479","state":["exists","up"]},{"osd":3,"uuid":"77acc9af-7d4d-4b18-8cf5-d62f5971b7c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6824","nonce":3442991267},{"type":"v1","addr":"172.21.15.78:6825","nonce":3442991267}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6826","nonce":3442991267},{"type":"v1","addr":"172.21.15.78:6827","nonce":3442991267}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6830","nonce":3442991267},{"type":"v1","addr":"172.21.15.78:6831","nonce":3442991267}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6828","nonce":3442991267},{"type":"v1","addr":"172.21.15.78:6829","nonce":3442991267}]},"public_addr":"172.21.15.78:6825/3442991267","cluster_addr":"172.21.15.78:6827/3442991267","heartbeat_back_addr":"172.21.15.78:6831/3442991267","heartbeat_front_addr":"172.21.15.78:6829/3442991267","state":["exists","up"]},{"osd":4,"uuid":"5c62bc66-6b34-4b7f-a66b-9a743969138c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":802983577},{"type":"v1","addr":"172.21.15.179:6809","nonce":802983577}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":802983577},{"type":"v1","addr":"172.21.15.179:6811","nonce":802983577}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":802983577},{"type":"v1","addr":"172.21.15.179:6815","nonce":802983577}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":802983577},{"type":"v1","addr":"172.21.15.179:6813","nonce":802983577}]},"public_addr":"172.21.15.179:6809/802983577","cluster_addr":"172.21.15.179:6811/802983577","heartbeat_back_addr":"172.21.15.179:6815/802983577","heartbeat_front_addr":"172.21.15.179:6813/802983577","state":["exists","up"]},{"osd":5,"uuid":"67db6d36-f684-4079-b0cd-82b4dd61461f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":518192887},{"type":"v1","addr":"172.21.15.179:6818","nonce":518192887}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":518192887},{"type":"v1","addr":"172.21.15.179:6822","nonce":518192887}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":518192887},{"type":"v1","addr":"172.21.15.179:6829","nonce":518192887}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6824","nonce":518192887},{"type":"v1","addr":"172.21.15.179:6826","nonce":518192887}]},"public_addr":"172.21.15.179:6818/518192887","cluster_addr":"172.21.15.179:6822/518192887","heartbeat_back_addr":"172.21.15.179:6829/518192887","heartbeat_front_addr":"172.21.15.179:6826/518192887","state":["exists","up"]},{"osd":6,"uuid":"12e670af-5a16-4c81-9f97-defa66cab967","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":815435378},{"type":"v1","addr":"172.21.15.179:6801","nonce":815435378}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":815435378},{"type":"v1","addr":"172.21.15.179:6803","nonce":815435378}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":815435378},{"type":"v1","addr":"172.21.15.179:6807","nonce":815435378}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":815435378},{"type":"v1","addr":"172.21.15.179:6805","nonce":815435378}]},"public_addr":"172.21.15.179:6801/815435378","cluster_addr":"172.21.15.179:6803/815435378","heartbeat_back_addr":"172.21.15.179:6807/815435378","heartbeat_front_addr":"172.21.15.179:6805/815435378","state":["exists","up"]},{"osd":7,"uuid":"fe630650-2eb3-49ad-8676-c341e6332eb1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6817","nonce":2848432339},{"type":"v1","addr":"172.21.15.179:6819","nonce":2848432339}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6821","nonce":2848432339},{"type":"v1","addr":"172.21.15.179:6823","nonce":2848432339}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":2848432339},{"type":"v1","addr":"172.21.15.179:6831","nonce":2848432339}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6825","nonce":2848432339},{"type":"v1","addr":"172.21.15.179:6827","nonce":2848432339}]},"public_addr":"172.21.15.179:6819/2848432339","cluster_addr":"172.21.15.179:6823/2848432339","heartbeat_back_addr":"172.21.15.179:6831/2848432339","heartbeat_front_addr":"172.21.15.179:6827/2848432339","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:58:49.255433+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:58:49.412880+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:58:49.559295+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:58:49.245237+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:58:49.184557+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:58:49.329851+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:58:49.366012+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:58:49.349604+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-28T20:02:08.974 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:08.968+0000 7fbdcf116640 1 -- 172.21.15.78:0/2964752538 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fbdac066470 msgr2=0x7fbdac068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:02:08.975 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:08.968+0000 7fbdcf116640 1 --2- 172.21.15.78:0/2964752538 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fbdac066470 0x7fbdac068930 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7fbdc81edca0 tx=0x7fbdb4007d40 comp rx=0 tx=0).stop 2023-11-28T20:02:08.975 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:08.968+0000 7fbdcf116640 1 -- 172.21.15.78:0/2964752538 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbdc8071e30 msgr2=0x7fbdc80a6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:02:08.975 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:08.968+0000 7fbdcf116640 1 --2- 172.21.15.78:0/2964752538 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbdc8071e30 0x7fbdc80a6cc0 secure :-1 s=READY pgs=887 cs=0 l=1 rev1=1 crypto rx=0x7fbdbc00b410 tx=0x7fbdbc00b8d0 comp rx=0 tx=0).stop 2023-11-28T20:02:08.975 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:08.968+0000 7fbdcf116640 1 -- 172.21.15.78:0/2964752538 shutdown_connections 2023-11-28T20:02:08.975 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:08.968+0000 7fbdcf116640 1 --2- 172.21.15.78:0/2964752538 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fbdac066470 0x7fbdac068930 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:08.975 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:08.968+0000 7fbdcf116640 1 --2- 172.21.15.78:0/2964752538 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbdc80722c0 0x7fbdc80aae00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:08.975 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:08.968+0000 7fbdcf116640 1 --2- 172.21.15.78:0/2964752538 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbdc814fd10 0x7fbdc81ebc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:08.975 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:08.968+0000 7fbdcf116640 1 --2- 172.21.15.78:0/2964752538 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbdc8071e30 0x7fbdc80a6cc0 unknown :-1 s=CLOSED pgs=887 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:08.975 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:08.968+0000 7fbdcf116640 1 -- 172.21.15.78:0/2964752538 >> 172.21.15.78:0/2964752538 conn(0x7fbdc80a7810 msgr2=0x7fbdc8154b70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:02:08.975 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:08.968+0000 7fbdcf116640 1 -- 172.21.15.78:0/2964752538 shutdown_connections 2023-11-28T20:02:08.976 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:08.968+0000 7fbdcf116640 1 -- 172.21.15.78:0/2964752538 wait complete. 2023-11-28T20:02:08.994 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-11-28T20:02:09.134 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:09.128+0000 7f8c55c17640 1 Processor -- start 2023-11-28T20:02:09.134 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:09.128+0000 7f8c55c17640 1 -- start start 2023-11-28T20:02:09.135 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:09.128+0000 7f8c55c17640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f8c5014b1e0 0x7f8c500c1700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:09.136 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:09.128+0000 7f8c55c17640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f8c500c5300 0x7f8c500a9c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:09.136 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:09.128+0000 7f8c55c17640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8c50151280 0x7f8c501516f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:09.136 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:09.128+0000 7f8c55c17640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8c500a4e20 con 0x7f8c5014b1e0 2023-11-28T20:02:09.136 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:09.128+0000 7f8c55c17640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8c500a50e0 con 0x7f8c500c5300 2023-11-28T20:02:09.136 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:09.128+0000 7f8c55c17640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c500c0f00 con 0x7f8c50151280 2023-11-28T20:02:09.136 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:09.132+0000 7f8c4f7fe640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f8c5014b1e0 0x7f8c500c1700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:02:09.136 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:09.132+0000 7f8c4f7fe640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f8c5014b1e0 0x7f8c500c1700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:49466/0 (socket says 172.21.15.78:49466) 2023-11-28T20:02:09.136 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:09.132+0000 7f8c4f7fe640 1 -- 172.21.15.78:0/1380148069 learned_addr learned my addr 172.21.15.78:0/1380148069 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T20:02:09.136 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:09.132+0000 7f8c4ffff640 1 --2- 172.21.15.78:0/1380148069 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8c50151280 0x7f8c501516f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:02:09.136 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:09.132+0000 7f8c4effd640 1 --2- 172.21.15.78:0/1380148069 >> v2:172.21.15.179:3300/0 conn(0x7f8c500c5300 0x7f8c500a9c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:02:09.136 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:09.132+0000 7f8c4f7fe640 1 -- 172.21.15.78:0/1380148069 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8c50151280 msgr2=0x7f8c501516f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:02:09.137 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:09.132+0000 7f8c4f7fe640 1 --2- 172.21.15.78:0/1380148069 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8c50151280 0x7f8c501516f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:09.137 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:09.132+0000 7f8c4f7fe640 1 -- 172.21.15.78:0/1380148069 >> v2:172.21.15.179:3300/0 conn(0x7f8c500c5300 msgr2=0x7f8c500a9c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:02:09.137 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:09.132+0000 7f8c4f7fe640 1 --2- 172.21.15.78:0/1380148069 >> v2:172.21.15.179:3300/0 conn(0x7f8c500c5300 0x7f8c500a9c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:09.137 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:09.132+0000 7f8c4f7fe640 1 -- 172.21.15.78:0/1380148069 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c500c11e0 con 0x7f8c5014b1e0 2023-11-28T20:02:09.138 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:09.132+0000 7f8c4f7fe640 1 --2- 172.21.15.78:0/1380148069 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8c5014b1e0 0x7f8c500c1700 secure :-1 s=READY pgs=888 cs=0 l=1 rev1=1 crypto rx=0x7f8c500a9650 tx=0x7f8c4001e710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=95d952c3062e1a9e server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:02:09.138 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:09.132+0000 7f8c4e7fc640 1 -- 172.21.15.78:0/1380148069 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c400ad670 con 0x7f8c5014b1e0 2023-11-28T20:02:09.139 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:09.132+0000 7f8c4e7fc640 1 -- 172.21.15.78:0/1380148069 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c400ad7d0 con 0x7f8c5014b1e0 2023-11-28T20:02:09.139 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:09.132+0000 7f8c4e7fc640 1 -- 172.21.15.78:0/1380148069 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c400adb60 con 0x7f8c5014b1e0 2023-11-28T20:02:09.139 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:09.136+0000 7f8c55c17640 1 -- 172.21.15.78:0/1380148069 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8c5014b1e0 msgr2=0x7f8c500c1700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:02:09.140 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:09.136+0000 7f8c55c17640 1 --2- 172.21.15.78:0/1380148069 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8c5014b1e0 0x7f8c500c1700 secure :-1 s=READY pgs=888 cs=0 l=1 rev1=1 crypto rx=0x7f8c500a9650 tx=0x7f8c4001e710 comp rx=0 tx=0).stop 2023-11-28T20:02:09.140 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:09.136+0000 7f8c55c17640 1 -- 172.21.15.78:0/1380148069 shutdown_connections 2023-11-28T20:02:09.140 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:09.136+0000 7f8c55c17640 1 --2- 172.21.15.78:0/1380148069 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8c50151280 0x7f8c501516f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:09.140 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:09.136+0000 7f8c55c17640 1 --2- 172.21.15.78:0/1380148069 >> v2:172.21.15.179:3300/0 conn(0x7f8c500c5300 0x7f8c500a9c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:09.140 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:09.136+0000 7f8c55c17640 1 --2- 172.21.15.78:0/1380148069 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8c5014b1e0 0x7f8c500c1700 unknown :-1 s=CLOSED pgs=888 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:09.140 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:09.136+0000 7f8c55c17640 1 -- 172.21.15.78:0/1380148069 >> 172.21.15.78:0/1380148069 conn(0x7f8c500c59f0 msgr2=0x7f8c500c5e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:02:09.140 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:09.136+0000 7f8c55c17640 1 -- 172.21.15.78:0/1380148069 shutdown_connections 2023-11-28T20:02:09.140 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:09.136+0000 7f8c55c17640 1 -- 172.21.15.78:0/1380148069 wait complete. 2023-11-28T20:02:09.141 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:09.136+0000 7f8c55c17640 1 Processor -- start 2023-11-28T20:02:09.141 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:09.136+0000 7f8c55c17640 1 -- start start 2023-11-28T20:02:09.143 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:09.136+0000 7f8c55c17640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8c500c5300 0x7f8c500724c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:09.143 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:09.136+0000 7f8c55c17640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8c5014b1e0 0x7f8c501f0370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:09.143 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:09.136+0000 7f8c55c17640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8c50151280 0x7f8c500c6030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:09.143 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:09.136+0000 7f8c55c17640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c5006fac0 con 0x7f8c5014b1e0 2023-11-28T20:02:09.143 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:09.136+0000 7f8c55c17640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c50072a00 con 0x7f8c500c5300 2023-11-28T20:02:09.143 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:09.136+0000 7f8c55c17640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c5006fff0 con 0x7f8c50151280 2023-11-28T20:02:09.143 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:09.136+0000 7f8c4effd640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8c5014b1e0 0x7f8c501f0370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:02:09.143 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:09.136+0000 7f8c4effd640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8c5014b1e0 0x7f8c501f0370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:49468/0 (socket says 172.21.15.78:49468) 2023-11-28T20:02:09.144 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:09.136+0000 7f8c4effd640 1 -- 172.21.15.78:0/3908347266 learned_addr learned my addr 172.21.15.78:0/3908347266 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T20:02:09.144 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:09.136+0000 7f8c4ffff640 1 --2- 172.21.15.78:0/3908347266 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8c50151280 0x7f8c500c6030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:02:09.144 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:09.136+0000 7f8c4f7fe640 1 --2- 172.21.15.78:0/3908347266 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8c500c5300 0x7f8c500724c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:02:09.144 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:09.136+0000 7f8c4effd640 1 -- 172.21.15.78:0/3908347266 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8c50151280 msgr2=0x7f8c500c6030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:02:09.144 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:09.136+0000 7f8c4effd640 1 --2- 172.21.15.78:0/3908347266 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8c50151280 0x7f8c500c6030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:09.144 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:09.136+0000 7f8c4effd640 1 -- 172.21.15.78:0/3908347266 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8c500c5300 msgr2=0x7f8c500724c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:02:09.144 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:09.136+0000 7f8c4effd640 1 --2- 172.21.15.78:0/3908347266 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8c500c5300 0x7f8c500724c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:09.144 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:09.136+0000 7f8c4effd640 1 -- 172.21.15.78:0/3908347266 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c400094d0 con 0x7f8c5014b1e0 2023-11-28T20:02:09.144 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:09.140+0000 7f8c4effd640 1 --2- 172.21.15.78:0/3908347266 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8c5014b1e0 0x7f8c501f0370 secure :-1 s=READY pgs=889 cs=0 l=1 rev1=1 crypto rx=0x7f8c4400d7d0 tx=0x7f8c4400dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:02:09.145 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:09.140+0000 7f8c37fff640 1 -- 172.21.15.78:0/3908347266 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c440096a0 con 0x7f8c5014b1e0 2023-11-28T20:02:09.145 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:09.140+0000 7f8c37fff640 1 -- 172.21.15.78:0/3908347266 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c44009800 con 0x7f8c5014b1e0 2023-11-28T20:02:09.145 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:09.140+0000 7f8c37fff640 1 -- 172.21.15.78:0/3908347266 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c44009bb0 con 0x7f8c5014b1e0 2023-11-28T20:02:09.145 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:09.140+0000 7f8c55c17640 1 -- 172.21.15.78:0/3908347266 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8c5006fd10 con 0x7f8c5014b1e0 2023-11-28T20:02:09.146 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:09.140+0000 7f8c55c17640 1 -- 172.21.15.78:0/3908347266 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8c50071fa0 con 0x7f8c5014b1e0 2023-11-28T20:02:09.146 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:09.140+0000 7f8c55c17640 1 -- 172.21.15.78:0/3908347266 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8c50072160 con 0x7f8c5014b1e0 2023-11-28T20:02:09.146 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:09.140+0000 7f8c37fff640 1 -- 172.21.15.78:0/3908347266 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f8c44009d10 con 0x7f8c5014b1e0 2023-11-28T20:02:09.146 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:09.140+0000 7f8c37fff640 1 --2- 172.21.15.78:0/3908347266 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f8c3c066470 0x7f8c3c068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:09.147 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:09.140+0000 7f8c37fff640 1 -- 172.21.15.78:0/3908347266 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f8c44084360 con 0x7f8c5014b1e0 2023-11-28T20:02:09.147 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:09.140+0000 7f8c4f7fe640 1 --2- 172.21.15.78:0/3908347266 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f8c3c066470 0x7f8c3c068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:02:09.147 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:09.144+0000 7f8c4f7fe640 1 --2- 172.21.15.78:0/3908347266 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f8c3c066470 0x7f8c3c068930 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f8c400b1000 tx=0x7f8c400a9000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:02:09.150 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:09.144+0000 7f8c37fff640 1 -- 172.21.15.78:0/3908347266 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f8c44051740 con 0x7f8c5014b1e0 2023-11-28T20:02:09.336 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:09.332+0000 7f8c55c17640 1 -- 172.21.15.78:0/3908347266 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f8c500c3fc0 con 0x7f8c5014b1e0 2023-11-28T20:02:10.297 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:10.292+0000 7f8c37fff640 1 -- 172.21.15.78:0/3908347266 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v45) v1 ==== 118+0+0 (secure 0 0 0) 0x7f8c44054d60 con 0x7f8c5014b1e0 2023-11-28T20:02:10.300 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:10.296+0000 7f8c55c17640 1 -- 172.21.15.78:0/3908347266 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f8c3c066470 msgr2=0x7f8c3c068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:02:10.300 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:10.296+0000 7f8c55c17640 1 --2- 172.21.15.78:0/3908347266 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f8c3c066470 0x7f8c3c068930 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f8c400b1000 tx=0x7f8c400a9000 comp rx=0 tx=0).stop 2023-11-28T20:02:10.301 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:10.296+0000 7f8c55c17640 1 -- 172.21.15.78:0/3908347266 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8c5014b1e0 msgr2=0x7f8c501f0370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:02:10.301 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:10.296+0000 7f8c55c17640 1 --2- 172.21.15.78:0/3908347266 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8c5014b1e0 0x7f8c501f0370 secure :-1 s=READY pgs=889 cs=0 l=1 rev1=1 crypto rx=0x7f8c4400d7d0 tx=0x7f8c4400dc90 comp rx=0 tx=0).stop 2023-11-28T20:02:10.301 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:10.296+0000 7f8c55c17640 1 -- 172.21.15.78:0/3908347266 shutdown_connections 2023-11-28T20:02:10.301 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:10.296+0000 7f8c55c17640 1 --2- 172.21.15.78:0/3908347266 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f8c3c066470 0x7f8c3c068930 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:10.301 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:10.296+0000 7f8c55c17640 1 --2- 172.21.15.78:0/3908347266 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8c50151280 0x7f8c500c6030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:10.301 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:10.296+0000 7f8c55c17640 1 --2- 172.21.15.78:0/3908347266 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8c5014b1e0 0x7f8c501f0370 unknown :-1 s=CLOSED pgs=889 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:10.301 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:10.296+0000 7f8c55c17640 1 --2- 172.21.15.78:0/3908347266 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8c500c5300 0x7f8c500724c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:10.301 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:10.296+0000 7f8c55c17640 1 -- 172.21.15.78:0/3908347266 >> 172.21.15.78:0/3908347266 conn(0x7f8c500c59f0 msgr2=0x7f8c500c0270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:02:10.301 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:10.296+0000 7f8c55c17640 1 -- 172.21.15.78:0/3908347266 shutdown_connections 2023-11-28T20:02:10.301 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:10.296+0000 7f8c55c17640 1 -- 172.21.15.78:0/3908347266 wait complete. 2023-11-28T20:02:10.323 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-11-28T20:02:10.323 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-11-28T20:02:10.469 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:10.464+0000 7f9c35291640 1 Processor -- start 2023-11-28T20:02:10.469 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:10.464+0000 7f9c35291640 1 -- start start 2023-11-28T20:02:10.471 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:10.464+0000 7f9c35291640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9c3014b1e0 0x7f9c300c1700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:10.471 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:10.464+0000 7f9c35291640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f9c301548c0 0x7f9c30154d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:10.471 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:10.464+0000 7f9c35291640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9c300a4e20 con 0x7f9c300c5300 2023-11-28T20:02:10.471 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:10.464+0000 7f9c35291640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9c300a50e0 con 0x7f9c301548c0 2023-11-28T20:02:10.471 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:10.464+0000 7f9c35291640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c300c0f00 con 0x7f9c3014b1e0 2023-11-28T20:02:10.471 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:10.468+0000 7f9c2f7fe640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f9c301548c0 0x7f9c30154d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:02:10.471 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:10.468+0000 7f9c267fc640 1 --1- >> v1:172.21.15.179:6789/0 conn(0x7f9c300c5300 0x7f9c300a9c30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.179:6789/0 says I am v1:172.21.15.78:39164/0 (socket says 172.21.15.78:39164) 2023-11-28T20:02:10.471 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:10.468+0000 7f9c267fc640 1 -- 172.21.15.78:0/1823137200 learned_addr learned my addr 172.21.15.78:0/1823137200 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-11-28T20:02:10.472 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:10.468+0000 7f9c2effd640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9c3014b1e0 0x7f9c300c1700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:02:10.472 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:10.468+0000 7f9c2e7fc640 1 -- 172.21.15.78:0/1823137200 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2311439605 0 0) 0x7f9c300a4e20 con 0x7f9c300c5300 2023-11-28T20:02:10.472 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:10.468+0000 7f9c2e7fc640 1 -- 172.21.15.78:0/1823137200 --> v1:172.21.15.179:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9c1c003530 con 0x7f9c300c5300 2023-11-28T20:02:10.472 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:10.468+0000 7f9c2effd640 1 -- 172.21.15.78:0/1823137200 >> v2:172.21.15.179:3300/0 conn(0x7f9c301548c0 msgr2=0x7f9c30154d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:02:10.473 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:10.468+0000 7f9c2effd640 1 --2- 172.21.15.78:0/1823137200 >> v2:172.21.15.179:3300/0 conn(0x7f9c301548c0 0x7f9c30154d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:10.473 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:10.468+0000 7f9c2effd640 1 -- 172.21.15.78:0/1823137200 >> v1:172.21.15.179:6789/0 conn(0x7f9c300c5300 legacy=0x7f9c300a9c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:02:10.473 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:10.468+0000 7f9c2effd640 1 -- 172.21.15.78:0/1823137200 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c300c11e0 con 0x7f9c3014b1e0 2023-11-28T20:02:10.473 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:10.468+0000 7f9c2f7fe640 1 --2- 172.21.15.78:0/1823137200 >> v2:172.21.15.179:3300/0 conn(0x7f9c301548c0 0x7f9c30154d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T20:02:10.474 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:10.468+0000 7f9c2effd640 1 --2- 172.21.15.78:0/1823137200 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9c3014b1e0 0x7f9c300c1700 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f9c200097c0 tx=0x7f9c2001c480 comp rx=0 tx=0).ready entity=mon.2 client_cookie=14a685aeae8b886c server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:02:10.475 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:10.468+0000 7f9c2e7fc640 1 -- 172.21.15.78:0/1823137200 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c301558b0 con 0x7f9c3014b1e0 2023-11-28T20:02:10.475 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:10.468+0000 7f9c2e7fc640 1 -- 172.21.15.78:0/1823137200 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c200ad640 con 0x7f9c3014b1e0 2023-11-28T20:02:10.475 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:10.468+0000 7f9c2e7fc640 1 -- 172.21.15.78:0/1823137200 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c200ad9d0 con 0x7f9c3014b1e0 2023-11-28T20:02:10.476 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:10.472+0000 7f9c35291640 1 -- 172.21.15.78:0/1823137200 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9c3014b1e0 msgr2=0x7f9c300c1700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:02:10.476 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:10.472+0000 7f9c35291640 1 --2- 172.21.15.78:0/1823137200 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9c3014b1e0 0x7f9c300c1700 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f9c200097c0 tx=0x7f9c2001c480 comp rx=0 tx=0).stop 2023-11-28T20:02:10.476 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:10.472+0000 7f9c35291640 1 -- 172.21.15.78:0/1823137200 shutdown_connections 2023-11-28T20:02:10.476 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:10.472+0000 7f9c35291640 1 --2- 172.21.15.78:0/1823137200 >> v2:172.21.15.179:3300/0 conn(0x7f9c301548c0 0x7f9c30154d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:10.476 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:10.472+0000 7f9c35291640 1 --2- 172.21.15.78:0/1823137200 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9c3014b1e0 0x7f9c300c1700 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:10.476 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:10.472+0000 7f9c35291640 1 -- 172.21.15.78:0/1823137200 >> 172.21.15.78:0/1823137200 conn(0x7f9c300c59f0 msgr2=0x7f9c300c5e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:02:10.476 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:10.472+0000 7f9c35291640 1 -- 172.21.15.78:0/1823137200 shutdown_connections 2023-11-28T20:02:10.476 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:10.472+0000 7f9c35291640 1 -- 172.21.15.78:0/1823137200 wait complete. 2023-11-28T20:02:10.477 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:10.472+0000 7f9c35291640 1 Processor -- start 2023-11-28T20:02:10.477 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:10.472+0000 7f9c35291640 1 -- start start 2023-11-28T20:02:10.479 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:10.472+0000 7f9c35291640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9c300c5300 0x7f9c30143920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:10.480 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:10.472+0000 7f9c35291640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9c3014b1e0 0x7f9c301ed450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:10.480 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:10.472+0000 7f9c35291640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9c301548c0 0x7f9c3006b930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:10.480 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:10.472+0000 7f9c35291640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c3006fbd0 con 0x7f9c3014b1e0 2023-11-28T20:02:10.480 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:10.472+0000 7f9c35291640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c301f14c0 con 0x7f9c300c5300 2023-11-28T20:02:10.480 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:10.472+0000 7f9c35291640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c301f17a0 con 0x7f9c301548c0 2023-11-28T20:02:10.480 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:10.472+0000 7f9c267fc640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9c3014b1e0 0x7f9c301ed450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:02:10.480 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:10.472+0000 7f9c267fc640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9c3014b1e0 0x7f9c301ed450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:49478/0 (socket says 172.21.15.78:49478) 2023-11-28T20:02:10.480 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:10.472+0000 7f9c267fc640 1 -- 172.21.15.78:0/1837596412 learned_addr learned my addr 172.21.15.78:0/1837596412 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T20:02:10.480 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:10.472+0000 7f9c2f7fe640 1 --2- 172.21.15.78:0/1837596412 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9c301548c0 0x7f9c3006b930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:02:10.480 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:10.472+0000 7f9c2effd640 1 --2- 172.21.15.78:0/1837596412 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9c300c5300 0x7f9c30143920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:02:10.480 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:10.476+0000 7f9c267fc640 1 -- 172.21.15.78:0/1837596412 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9c301548c0 msgr2=0x7f9c3006b930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:02:10.481 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:10.476+0000 7f9c267fc640 1 --2- 172.21.15.78:0/1837596412 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9c301548c0 0x7f9c3006b930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:10.481 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:10.476+0000 7f9c267fc640 1 -- 172.21.15.78:0/1837596412 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9c300c5300 msgr2=0x7f9c30143920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:02:10.481 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:10.476+0000 7f9c267fc640 1 --2- 172.21.15.78:0/1837596412 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9c300c5300 0x7f9c30143920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:10.481 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:10.476+0000 7f9c267fc640 1 -- 172.21.15.78:0/1837596412 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c28009420 con 0x7f9c3014b1e0 2023-11-28T20:02:10.481 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:10.476+0000 7f9c267fc640 1 --2- 172.21.15.78:0/1837596412 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9c3014b1e0 0x7f9c301ed450 secure :-1 s=READY pgs=890 cs=0 l=1 rev1=1 crypto rx=0x7f9c1800cbc0 tx=0x7f9c1800a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:02:10.481 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:10.476+0000 7f9c27fff640 1 -- 172.21.15.78:0/1837596412 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c1800aca0 con 0x7f9c3014b1e0 2023-11-28T20:02:10.481 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:10.476+0000 7f9c27fff640 1 -- 172.21.15.78:0/1837596412 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c1800ae00 con 0x7f9c3014b1e0 2023-11-28T20:02:10.481 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:10.476+0000 7f9c27fff640 1 -- 172.21.15.78:0/1837596412 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c18012620 con 0x7f9c3014b1e0 2023-11-28T20:02:10.481 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:10.476+0000 7f9c35291640 1 -- 172.21.15.78:0/1837596412 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9c20009420 con 0x7f9c3014b1e0 2023-11-28T20:02:10.481 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:10.476+0000 7f9c35291640 1 -- 172.21.15.78:0/1837596412 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9c301543a0 con 0x7f9c3014b1e0 2023-11-28T20:02:10.482 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:10.476+0000 7f9c35291640 1 -- 172.21.15.78:0/1837596412 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9c3006d200 con 0x7f9c3014b1e0 2023-11-28T20:02:10.482 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:10.476+0000 7f9c27fff640 1 -- 172.21.15.78:0/1837596412 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f9c18007070 con 0x7f9c3014b1e0 2023-11-28T20:02:10.482 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:10.476+0000 7f9c27fff640 1 --2- 172.21.15.78:0/1837596412 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f9c10066470 0x7f9c10068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:10.483 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:10.476+0000 7f9c27fff640 1 -- 172.21.15.78:0/1837596412 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f9c18083f10 con 0x7f9c3014b1e0 2023-11-28T20:02:10.483 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:10.476+0000 7f9c2effd640 1 --2- 172.21.15.78:0/1837596412 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f9c10066470 0x7f9c10068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:02:10.483 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:10.480+0000 7f9c2effd640 1 --2- 172.21.15.78:0/1837596412 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f9c10066470 0x7f9c10068930 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f9c200af000 tx=0x7f9c20008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:02:10.486 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:10.480+0000 7f9c27fff640 1 -- 172.21.15.78:0/1837596412 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f9c18051310 con 0x7f9c3014b1e0 2023-11-28T20:02:10.666 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:10.660+0000 7f9c35291640 1 -- 172.21.15.78:0/1837596412 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f9c300ab650 con 0x7f9c3014b1e0 2023-11-28T20:02:11.309 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:11.304+0000 7f9c27fff640 1 -- 172.21.15.78:0/1837596412 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v46) v1 ==== 122+0+0 (secure 0 0 0) 0x7f9c18054930 con 0x7f9c3014b1e0 2023-11-28T20:02:11.311 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:11.304+0000 7f9c35291640 1 -- 172.21.15.78:0/1837596412 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f9c10066470 msgr2=0x7f9c10068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:02:11.311 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:11.304+0000 7f9c35291640 1 --2- 172.21.15.78:0/1837596412 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f9c10066470 0x7f9c10068930 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f9c200af000 tx=0x7f9c20008040 comp rx=0 tx=0).stop 2023-11-28T20:02:11.311 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:11.304+0000 7f9c35291640 1 -- 172.21.15.78:0/1837596412 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9c3014b1e0 msgr2=0x7f9c301ed450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:02:11.311 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:11.304+0000 7f9c35291640 1 --2- 172.21.15.78:0/1837596412 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9c3014b1e0 0x7f9c301ed450 secure :-1 s=READY pgs=890 cs=0 l=1 rev1=1 crypto rx=0x7f9c1800cbc0 tx=0x7f9c1800a060 comp rx=0 tx=0).stop 2023-11-28T20:02:11.312 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:11.308+0000 7f9c35291640 1 -- 172.21.15.78:0/1837596412 shutdown_connections 2023-11-28T20:02:11.312 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:11.308+0000 7f9c35291640 1 --2- 172.21.15.78:0/1837596412 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f9c10066470 0x7f9c10068930 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:11.312 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:11.308+0000 7f9c35291640 1 --2- 172.21.15.78:0/1837596412 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9c301548c0 0x7f9c3006b930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:11.312 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:11.308+0000 7f9c35291640 1 --2- 172.21.15.78:0/1837596412 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9c3014b1e0 0x7f9c301ed450 unknown :-1 s=CLOSED pgs=890 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:11.312 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:11.308+0000 7f9c35291640 1 --2- 172.21.15.78:0/1837596412 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9c300c5300 0x7f9c30143920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:11.312 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:11.308+0000 7f9c35291640 1 -- 172.21.15.78:0/1837596412 >> 172.21.15.78:0/1837596412 conn(0x7f9c300c59f0 msgr2=0x7f9c300c4760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:02:11.312 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:11.308+0000 7f9c35291640 1 -- 172.21.15.78:0/1837596412 shutdown_connections 2023-11-28T20:02:11.312 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:11.308+0000 7f9c35291640 1 -- 172.21.15.78:0/1837596412 wait complete. 2023-11-28T20:02:11.331 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-11-28T20:02:11.332 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-28T20:02:11.469 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:11.464+0000 7f71684bb640 1 Processor -- start 2023-11-28T20:02:11.469 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:11.464+0000 7f71684bb640 1 -- start start 2023-11-28T20:02:11.470 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:11.464+0000 7f71684bb640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f716014fd10 0x7f71600a4dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:11.471 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:11.464+0000 7f71684bb640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7160156110 0x7f71601565c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:11.471 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:11.464+0000 7f71684bb640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f71600c5710 con 0x7f71600a5300 2023-11-28T20:02:11.471 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:11.464+0000 7f71684bb640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f716006c5e0 con 0x7f716014fd10 2023-11-28T20:02:11.471 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:11.464+0000 7f71684bb640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7160155c80 con 0x7f7160156110 2023-11-28T20:02:11.471 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:11.464+0000 7f7165a56640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f71600a5300 0x7f7160071e30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:40354/0 (socket says 172.21.15.78:40354) 2023-11-28T20:02:11.471 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:11.464+0000 7f7165a56640 1 -- 172.21.15.78:0/1092353804 learned_addr learned my addr 172.21.15.78:0/1092353804 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-11-28T20:02:11.473 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:11.468+0000 7f7166257640 1 --2- 172.21.15.78:0/1092353804 >> v2:172.21.15.179:3300/0 conn(0x7f716014fd10 0x7f71600a4dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:02:11.473 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:11.468+0000 7f7166a58640 1 --2- 172.21.15.78:0/1092353804 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7160156110 0x7f71601565c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:02:11.473 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:11.468+0000 7f7165255640 1 -- 172.21.15.78:0/1092353804 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3603412736 0 0) 0x7f71600c5710 con 0x7f71600a5300 2023-11-28T20:02:11.473 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:11.468+0000 7f7165255640 1 -- 172.21.15.78:0/1092353804 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f714c003530 con 0x7f71600a5300 2023-11-28T20:02:11.473 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:11.468+0000 7f7165255640 1 -- 172.21.15.78:0/1092353804 <== mon.0 v1:172.21.15.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4038710221 0 0) 0x7f714c003530 con 0x7f71600a5300 2023-11-28T20:02:11.473 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:11.468+0000 7f7165255640 1 -- 172.21.15.78:0/1092353804 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7160156110 msgr2=0x7f71601565c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:02:11.473 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:11.468+0000 7f7165255640 1 --2- 172.21.15.78:0/1092353804 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7160156110 0x7f71601565c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:11.473 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:11.468+0000 7f7165255640 1 -- 172.21.15.78:0/1092353804 >> v2:172.21.15.179:3300/0 conn(0x7f716014fd10 msgr2=0x7f71600a4dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:02:11.473 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:11.468+0000 7f7165255640 1 --2- 172.21.15.78:0/1092353804 >> v2:172.21.15.179:3300/0 conn(0x7f716014fd10 0x7f71600a4dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:11.474 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:11.468+0000 7f7165255640 1 -- 172.21.15.78:0/1092353804 --> v1:172.21.15.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71600c4e70 con 0x7f71600a5300 2023-11-28T20:02:11.474 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:11.468+0000 7f7165255640 1 -- 172.21.15.78:0/1092353804 <== mon.0 v1:172.21.15.78:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3326804700 0 0) 0x7f7150001680 con 0x7f71600a5300 2023-11-28T20:02:11.474 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:11.468+0000 7f7165255640 1 -- 172.21.15.78:0/1092353804 >> v1:172.21.15.78:6789/0 conn(0x7f71600a5300 legacy=0x7f7160071e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:02:11.474 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:11.468+0000 7f7165255640 1 --2- 172.21.15.78:0/1092353804 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f714c003980 0x7f714c003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:11.474 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:11.468+0000 7f7165255640 1 --2- 172.21.15.78:0/1092353804 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f714c0047d0 0x7f714c004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:11.474 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:11.468+0000 7f7165255640 1 --2- 172.21.15.78:0/1092353804 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7160156110 0x7f714c005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:11.474 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:11.468+0000 7f7165255640 1 -- 172.21.15.78:0/1092353804 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7160155c80 con 0x7f714c003980 2023-11-28T20:02:11.474 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:11.468+0000 7f7165255640 1 -- 172.21.15.78:0/1092353804 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f714c00b990 con 0x7f714c0047d0 2023-11-28T20:02:11.474 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:11.468+0000 7f7165255640 1 -- 172.21.15.78:0/1092353804 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f714c00bb50 con 0x7f7160156110 2023-11-28T20:02:11.474 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:11.468+0000 7f7166257640 1 --2- 172.21.15.78:0/1092353804 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f714c003980 0x7f714c003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:02:11.474 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:11.468+0000 7f7166a58640 1 --2- 172.21.15.78:0/1092353804 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7160156110 0x7f714c005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:02:11.474 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:11.468+0000 7f7165a56640 1 --2- 172.21.15.78:0/1092353804 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f714c0047d0 0x7f714c004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:02:11.475 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:11.468+0000 7f7166257640 1 -- 172.21.15.78:0/1092353804 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7160156110 msgr2=0x7f714c005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:02:11.475 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:11.468+0000 7f7166257640 1 --2- 172.21.15.78:0/1092353804 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7160156110 0x7f714c005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:11.475 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:11.468+0000 7f7166257640 1 -- 172.21.15.78:0/1092353804 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f714c0047d0 msgr2=0x7f714c004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:02:11.475 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:11.468+0000 7f7166257640 1 --2- 172.21.15.78:0/1092353804 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f714c0047d0 0x7f714c004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:11.475 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:11.468+0000 7f7166257640 1 -- 172.21.15.78:0/1092353804 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f714c003530 con 0x7f714c003980 2023-11-28T20:02:11.475 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:11.468+0000 7f7165a56640 1 --2- 172.21.15.78:0/1092353804 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f714c0047d0 0x7f714c004c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T20:02:11.475 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:11.472+0000 7f7166257640 1 --2- 172.21.15.78:0/1092353804 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f714c003980 0x7f714c003da0 secure :-1 s=READY pgs=892 cs=0 l=1 rev1=1 crypto rx=0x7f715c009ae0 tx=0x7f715c01ca60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=264f746fbb8d6153 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:02:11.476 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:11.472+0000 7f7165255640 1 -- 172.21.15.78:0/1092353804 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f715c0a5630 con 0x7f714c003980 2023-11-28T20:02:11.476 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:11.472+0000 7f7165255640 1 -- 172.21.15.78:0/1092353804 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f715c0a5790 con 0x7f714c003980 2023-11-28T20:02:11.476 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:11.472+0000 7f7165255640 1 -- 172.21.15.78:0/1092353804 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f715c0a5b40 con 0x7f714c003980 2023-11-28T20:02:11.477 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:11.472+0000 7f71684bb640 1 -- 172.21.15.78:0/1092353804 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f714c003980 msgr2=0x7f714c003da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:02:11.477 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:11.472+0000 7f71684bb640 1 --2- 172.21.15.78:0/1092353804 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f714c003980 0x7f714c003da0 secure :-1 s=READY pgs=892 cs=0 l=1 rev1=1 crypto rx=0x7f715c009ae0 tx=0x7f715c01ca60 comp rx=0 tx=0).stop 2023-11-28T20:02:11.477 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:11.472+0000 7f7166a58640 1 -- 172.21.15.78:0/1092353804 reap_dead start 2023-11-28T20:02:11.477 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:11.472+0000 7f71684bb640 1 -- 172.21.15.78:0/1092353804 shutdown_connections 2023-11-28T20:02:11.477 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:11.472+0000 7f71684bb640 1 -- 172.21.15.78:0/1092353804 >> 172.21.15.78:0/1092353804 conn(0x7f71600a7810 msgr2=0x7f71600a7c20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:02:11.477 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:11.472+0000 7f71684bb640 1 -- 172.21.15.78:0/1092353804 shutdown_connections 2023-11-28T20:02:11.477 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:11.472+0000 7f71684bb640 1 -- 172.21.15.78:0/1092353804 wait complete. 2023-11-28T20:02:11.478 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:11.472+0000 7f71684bb640 1 Processor -- start 2023-11-28T20:02:11.478 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:11.472+0000 7f71684bb640 1 -- start start 2023-11-28T20:02:11.480 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:11.476+0000 7f71684bb640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f714c003980 0x7f7160157590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:11.480 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:11.476+0000 7f71684bb640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f71601ec380 0x7f71601ec7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:11.480 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:11.476+0000 7f71684bb640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7160158290 0x7f7160158710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:11.480 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:11.476+0000 7f71684bb640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71601519e0 con 0x7f714c003980 2023-11-28T20:02:11.481 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:11.476+0000 7f71684bb640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7160157ad0 con 0x7f7160158290 2023-11-28T20:02:11.481 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:11.476+0000 7f71684bb640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7160150dd0 con 0x7f71601ec380 2023-11-28T20:02:11.481 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:11.476+0000 7f7166257640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f714c003980 0x7f7160157590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:02:11.481 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:11.476+0000 7f7166257640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f714c003980 0x7f7160157590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:49498/0 (socket says 172.21.15.78:49498) 2023-11-28T20:02:11.481 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:11.476+0000 7f7166257640 1 -- 172.21.15.78:0/1049600348 learned_addr learned my addr 172.21.15.78:0/1049600348 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T20:02:11.481 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:11.476+0000 7f7165a56640 1 --2- 172.21.15.78:0/1049600348 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f71601ec380 0x7f71601ec7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:02:11.481 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:11.476+0000 7f7166a58640 1 --2- 172.21.15.78:0/1049600348 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7160158290 0x7f7160158710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:02:11.481 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:11.476+0000 7f7166257640 1 -- 172.21.15.78:0/1049600348 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f71601ec380 msgr2=0x7f71601ec7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:02:11.481 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:11.476+0000 7f7166257640 1 --2- 172.21.15.78:0/1049600348 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f71601ec380 0x7f71601ec7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:11.481 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:11.476+0000 7f7166257640 1 -- 172.21.15.78:0/1049600348 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7160158290 msgr2=0x7f7160158710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:02:11.481 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:11.476+0000 7f7166257640 1 --2- 172.21.15.78:0/1049600348 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7160158290 0x7f7160158710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:11.481 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:11.476+0000 7f7166257640 1 -- 172.21.15.78:0/1049600348 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71601510b0 con 0x7f714c003980 2023-11-28T20:02:11.482 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:11.476+0000 7f7166a58640 1 --2- 172.21.15.78:0/1049600348 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7160158290 0x7f7160158710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T20:02:11.482 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:11.476+0000 7f7166257640 1 --2- 172.21.15.78:0/1049600348 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f714c003980 0x7f7160157590 secure :-1 s=READY pgs=893 cs=0 l=1 rev1=1 crypto rx=0x7f715c01c890 tx=0x7f714c005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:02:11.482 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:11.476+0000 7f7156ffd640 1 -- 172.21.15.78:0/1049600348 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f715c0a5ea0 con 0x7f714c003980 2023-11-28T20:02:11.482 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:11.476+0000 7f7156ffd640 1 -- 172.21.15.78:0/1049600348 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f715c004020 con 0x7f714c003980 2023-11-28T20:02:11.482 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:11.476+0000 7f71684bb640 1 -- 172.21.15.78:0/1049600348 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7160151390 con 0x7f714c003980 2023-11-28T20:02:11.482 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:11.476+0000 7f7156ffd640 1 -- 172.21.15.78:0/1049600348 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f715c0043b0 con 0x7f714c003980 2023-11-28T20:02:11.482 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:11.476+0000 7f71684bb640 1 -- 172.21.15.78:0/1049600348 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f71601ecd20 con 0x7f714c003980 2023-11-28T20:02:11.483 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:11.476+0000 7f71684bb640 1 -- 172.21.15.78:0/1049600348 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7160067630 con 0x7f714c003980 2023-11-28T20:02:11.483 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:11.476+0000 7f7156ffd640 1 -- 172.21.15.78:0/1049600348 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f715c0b4040 con 0x7f714c003980 2023-11-28T20:02:11.483 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:11.480+0000 7f7156ffd640 1 --2- 172.21.15.78:0/1049600348 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f7144066460 0x7f7144068920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:11.483 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:11.480+0000 7f7156ffd640 1 -- 172.21.15.78:0/1049600348 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f715c11e0e0 con 0x7f714c003980 2023-11-28T20:02:11.483 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:11.480+0000 7f7165a56640 1 --2- 172.21.15.78:0/1049600348 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f7144066460 0x7f7144068920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:02:11.484 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:11.480+0000 7f7165a56640 1 --2- 172.21.15.78:0/1049600348 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f7144066460 0x7f7144068920 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f7150000c10 tx=0x7f7150007040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:02:11.487 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:11.484+0000 7f7156ffd640 1 -- 172.21.15.78:0/1049600348 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f715c0eb680 con 0x7f714c003980 2023-11-28T20:02:11.669 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:11.664+0000 7f71684bb640 1 -- 172.21.15.78:0/1049600348 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f71601519e0 con 0x7f714c003980 2023-11-28T20:02:11.669 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:11.664+0000 7f7156ffd640 1 -- 172.21.15.78:0/1049600348 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 46 v46) v1 ==== 94+0+4915 (secure 0 0 0) 0x7f715c0eeca0 con 0x7f714c003980 2023-11-28T20:02:11.670 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-11-28T20:02:11.670 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":46,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5834,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6834/3259525552","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6832","nonce":3259525552},{"type":"v1","addr":"172.21.15.179:6834","nonce":3259525552}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":41},{"gid":6466,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6836/3096284673","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6834","nonce":3096284673},{"type":"v1","addr":"172.21.15.78:6836","nonce":3096284673}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":41},{"gid":6478,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6835/2749579094","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6833","nonce":2749579094},{"type":"v1","addr":"172.21.15.179:6835","nonce":2749579094}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":41}],"filesystems":[{"mdsmap":{"epoch":46,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-28T20:02:07.651677+0000","modified":"2023-11-28T20:02:10.666537+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":6633},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6633":{"gid":6633,"name":"a","rank":0,"incarnation":42,"state":"up:active","state_seq":3,"addr":"172.21.15.78:6837/20108235","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6835","nonce":20108235},{"type":"v1","addr":"172.21.15.78:6837","nonce":20108235}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-28T20:02:11.670 INFO:teuthology.orchestra.run.smithi078.stderr:dumped fsmap epoch 46 2023-11-28T20:02:11.672 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:11.668+0000 7f71684bb640 1 -- 172.21.15.78:0/1049600348 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f7144066460 msgr2=0x7f7144068920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:02:11.672 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:11.668+0000 7f71684bb640 1 --2- 172.21.15.78:0/1049600348 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f7144066460 0x7f7144068920 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f7150000c10 tx=0x7f7150007040 comp rx=0 tx=0).stop 2023-11-28T20:02:11.672 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:11.668+0000 7f71684bb640 1 -- 172.21.15.78:0/1049600348 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f714c003980 msgr2=0x7f7160157590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:02:11.672 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:11.668+0000 7f71684bb640 1 --2- 172.21.15.78:0/1049600348 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f714c003980 0x7f7160157590 secure :-1 s=READY pgs=893 cs=0 l=1 rev1=1 crypto rx=0x7f715c01c890 tx=0x7f714c005800 comp rx=0 tx=0).stop 2023-11-28T20:02:11.672 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:11.668+0000 7f71684bb640 1 -- 172.21.15.78:0/1049600348 shutdown_connections 2023-11-28T20:02:11.672 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:11.668+0000 7f71684bb640 1 --2- 172.21.15.78:0/1049600348 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f7144066460 0x7f7144068920 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:11.673 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:11.668+0000 7f71684bb640 1 --2- 172.21.15.78:0/1049600348 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f71601ec380 0x7f71601ec7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:11.673 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:11.668+0000 7f71684bb640 1 --2- 172.21.15.78:0/1049600348 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7160158290 0x7f7160158710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:11.673 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:11.668+0000 7f71684bb640 1 --2- 172.21.15.78:0/1049600348 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f714c003980 0x7f7160157590 unknown :-1 s=CLOSED pgs=893 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:11.673 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:11.668+0000 7f71684bb640 1 -- 172.21.15.78:0/1049600348 >> 172.21.15.78:0/1049600348 conn(0x7f71600a7810 msgr2=0x7f7160155150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:02:11.673 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:11.668+0000 7f71684bb640 1 -- 172.21.15.78:0/1049600348 shutdown_connections 2023-11-28T20:02:11.673 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:11.668+0000 7f71684bb640 1 -- 172.21.15.78:0/1049600348 wait complete. 2023-11-28T20:02:11.691 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-28T20:02:11.828 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:11.824+0000 7fabe6e9c640 1 Processor -- start 2023-11-28T20:02:11.828 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:11.824+0000 7fabe6e9c640 1 -- start start 2023-11-28T20:02:11.829 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:11.824+0000 7fabe6e9c640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fabe006bef0 0x7fabe00bfce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:11.829 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:11.824+0000 7fabe6e9c640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fabe0151690 con 0x7fabe014e3f0 2023-11-28T20:02:11.829 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:11.824+0000 7fabe6e9c640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fabe0151bc0 con 0x7fabe006c5b0 2023-11-28T20:02:11.829 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:11.824+0000 7fabe6e9c640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fabe01518e0 con 0x7fabe006bef0 2023-11-28T20:02:11.829 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:11.824+0000 7fabdffff640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fabe006bef0 0x7fabe00bfce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:02:11.829 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:11.824+0000 7fabe4c38640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7fabe014e3f0 0x7fabe00c41f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:40366/0 (socket says 172.21.15.78:40366) 2023-11-28T20:02:11.829 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:11.824+0000 7fabe4c38640 1 -- 172.21.15.78:0/1442454021 learned_addr learned my addr 172.21.15.78:0/1442454021 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-11-28T20:02:11.830 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:11.824+0000 7fabdf7fe640 1 -- 172.21.15.78:0/1442454021 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 485811953 0 0) 0x7fabe0151690 con 0x7fabe014e3f0 2023-11-28T20:02:11.830 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:11.824+0000 7fabdf7fe640 1 -- 172.21.15.78:0/1442454021 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fabd0003450 con 0x7fabe014e3f0 2023-11-28T20:02:11.830 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:11.824+0000 7fabdffff640 1 -- 172.21.15.78:0/1442454021 >> v1:172.21.15.179:6789/0 conn(0x7fabe006c5b0 legacy=0x7fabe006ca20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:02:11.830 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:11.824+0000 7fabdffff640 1 -- 172.21.15.78:0/1442454021 >> v1:172.21.15.78:6789/0 conn(0x7fabe014e3f0 legacy=0x7fabe00c41f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:02:11.831 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:11.824+0000 7fabdffff640 1 -- 172.21.15.78:0/1442454021 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fabe00c1de0 con 0x7fabe006bef0 2023-11-28T20:02:11.833 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:11.828+0000 7fabdffff640 1 --2- 172.21.15.78:0/1442454021 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fabe006bef0 0x7fabe00bfce0 secure :-1 s=READY pgs=895 cs=0 l=1 rev1=1 crypto rx=0x7fabcc0097c0 tx=0x7fabcc01c380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ecd5b0eccf523094 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:02:11.833 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:11.828+0000 7fabdf7fe640 1 -- 172.21.15.78:0/1442454021 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabcc0ab600 con 0x7fabe006bef0 2023-11-28T20:02:11.833 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:11.828+0000 7fabdf7fe640 1 -- 172.21.15.78:0/1442454021 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fabcc0a7050 con 0x7fabe006bef0 2023-11-28T20:02:11.833 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:11.828+0000 7fabdf7fe640 1 -- 172.21.15.78:0/1442454021 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabcc0ab980 con 0x7fabe006bef0 2023-11-28T20:02:11.834 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:11.828+0000 7fabe6e9c640 1 -- 172.21.15.78:0/1442454021 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fabe006bef0 msgr2=0x7fabe00bfce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:02:11.834 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:11.828+0000 7fabe6e9c640 1 --2- 172.21.15.78:0/1442454021 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fabe006bef0 0x7fabe00bfce0 secure :-1 s=READY pgs=895 cs=0 l=1 rev1=1 crypto rx=0x7fabcc0097c0 tx=0x7fabcc01c380 comp rx=0 tx=0).stop 2023-11-28T20:02:11.834 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:11.828+0000 7fabe6e9c640 1 -- 172.21.15.78:0/1442454021 shutdown_connections 2023-11-28T20:02:11.834 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:11.828+0000 7fabe6e9c640 1 --2- 172.21.15.78:0/1442454021 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fabe006bef0 0x7fabe00bfce0 unknown :-1 s=CLOSED pgs=895 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:11.834 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:11.828+0000 7fabe6e9c640 1 -- 172.21.15.78:0/1442454021 >> 172.21.15.78:0/1442454021 conn(0x7fabe00a7810 msgr2=0x7fabe00a7c20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:02:11.834 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:11.828+0000 7fabe6e9c640 1 -- 172.21.15.78:0/1442454021 shutdown_connections 2023-11-28T20:02:11.834 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:11.828+0000 7fabe6e9c640 1 -- 172.21.15.78:0/1442454021 wait complete. 2023-11-28T20:02:11.835 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:11.832+0000 7fabe6e9c640 1 Processor -- start 2023-11-28T20:02:11.835 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:11.832+0000 7fabe6e9c640 1 -- start start 2023-11-28T20:02:11.837 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:11.832+0000 7fabe6e9c640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fabe006bef0 0x7fabe0148b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:11.837 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:11.832+0000 7fabe6e9c640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fabe006c5b0 0x7fabe0149040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:11.837 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:11.832+0000 7fabe6e9c640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fabe014e3f0 0x7fabe01e8700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:11.838 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:11.832+0000 7fabe6e9c640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fabe01e9520 con 0x7fabe014e3f0 2023-11-28T20:02:11.838 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:11.832+0000 7fabe6e9c640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fabe0148670 con 0x7fabe006bef0 2023-11-28T20:02:11.838 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:11.832+0000 7fabe6e9c640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fabe014a690 con 0x7fabe006c5b0 2023-11-28T20:02:11.838 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:11.832+0000 7fabe5439640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fabe014e3f0 0x7fabe01e8700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:02:11.838 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:11.832+0000 7fabe5439640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fabe014e3f0 0x7fabe01e8700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:49512/0 (socket says 172.21.15.78:49512) 2023-11-28T20:02:11.838 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:11.832+0000 7fabe5439640 1 -- 172.21.15.78:0/3858406758 learned_addr learned my addr 172.21.15.78:0/3858406758 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T20:02:11.838 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:11.832+0000 7fabe4c38640 1 --2- 172.21.15.78:0/3858406758 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fabe006bef0 0x7fabe0148b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:02:11.838 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:11.832+0000 7fabdffff640 1 --2- 172.21.15.78:0/3858406758 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fabe006c5b0 0x7fabe0149040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:02:11.839 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:11.832+0000 7fabe5439640 1 -- 172.21.15.78:0/3858406758 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fabe006c5b0 msgr2=0x7fabe0149040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:02:11.839 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:11.832+0000 7fabe5439640 1 --2- 172.21.15.78:0/3858406758 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fabe006c5b0 0x7fabe0149040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:11.839 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:11.832+0000 7fabe5439640 1 -- 172.21.15.78:0/3858406758 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fabe006bef0 msgr2=0x7fabe0148b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:02:11.839 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:11.832+0000 7fabe5439640 1 --2- 172.21.15.78:0/3858406758 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fabe006bef0 0x7fabe0148b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:11.839 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:11.832+0000 7fabe5439640 1 -- 172.21.15.78:0/3858406758 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fabcc009420 con 0x7fabe014e3f0 2023-11-28T20:02:11.839 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:11.832+0000 7fabe4c38640 1 --2- 172.21.15.78:0/3858406758 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fabe006bef0 0x7fabe0148b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T20:02:11.839 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:11.832+0000 7fabdffff640 1 --2- 172.21.15.78:0/3858406758 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fabe006c5b0 0x7fabe0149040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T20:02:11.839 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:11.832+0000 7fabe5439640 1 --2- 172.21.15.78:0/3858406758 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fabe014e3f0 0x7fabe01e8700 secure :-1 s=READY pgs=896 cs=0 l=1 rev1=1 crypto rx=0x7fabd800c780 tx=0x7fabd800cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:02:11.840 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:11.832+0000 7fabdd7fa640 1 -- 172.21.15.78:0/3858406758 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabd8004b20 con 0x7fabe014e3f0 2023-11-28T20:02:11.840 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:11.832+0000 7fabdd7fa640 1 -- 172.21.15.78:0/3858406758 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fabd8004c80 con 0x7fabe014e3f0 2023-11-28T20:02:11.840 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:11.832+0000 7fabe6e9c640 1 -- 172.21.15.78:0/3858406758 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fabe01526b0 con 0x7fabe014e3f0 2023-11-28T20:02:11.840 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:11.832+0000 7fabdd7fa640 1 -- 172.21.15.78:0/3858406758 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabd800aa90 con 0x7fabe014e3f0 2023-11-28T20:02:11.840 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:11.832+0000 7fabe6e9c640 1 -- 172.21.15.78:0/3858406758 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fabe014a3b0 con 0x7fabe014e3f0 2023-11-28T20:02:11.841 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:11.832+0000 7fabe6e9c640 1 -- 172.21.15.78:0/3858406758 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fabe01487e0 con 0x7fabe014e3f0 2023-11-28T20:02:11.841 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:11.836+0000 7fabdd7fa640 1 -- 172.21.15.78:0/3858406758 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fabd800abf0 con 0x7fabe014e3f0 2023-11-28T20:02:11.841 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:11.836+0000 7fabdd7fa640 1 --2- 172.21.15.78:0/3858406758 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fabc40664a0 0x7fabc4068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:11.841 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:11.836+0000 7fabdd7fa640 1 -- 172.21.15.78:0/3858406758 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6029+0+0 (secure 0 0 0) 0x7fabd8084080 con 0x7fabe014e3f0 2023-11-28T20:02:11.841 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:11.836+0000 7fabe4c38640 1 --2- 172.21.15.78:0/3858406758 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fabc40664a0 0x7fabc4068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:02:11.841 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:11.836+0000 7fabe4c38640 1 --2- 172.21.15.78:0/3858406758 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fabc40664a0 0x7fabc4068960 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7fabd40011f0 tx=0x7fabd4009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:02:11.844 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:11.840+0000 7fabdd7fa640 1 -- 172.21.15.78:0/3858406758 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fabd80b5280 con 0x7fabe014e3f0 2023-11-28T20:02:11.997 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:11.992+0000 7fabe6e9c640 1 -- 172.21.15.78:0/3858406758 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fabe0067630 con 0x7fabe014e3f0 2023-11-28T20:02:11.997 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:11.992+0000 7fabdd7fa640 1 -- 172.21.15.78:0/3858406758 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v81) v1 ==== 74+0+16693 (secure 0 0 0) 0x7fabd80513b0 con 0x7fabe014e3f0 2023-11-28T20:02:11.998 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-11-28T20:02:11.998 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":81,"fsid":"dd9780e8-3bda-44fa-a9f0-fa07d19d901d","created":"2023-11-28T19:58:40.969556+0000","modified":"2023-11-28T20:02:09.283551+0000","last_up_change":"2023-11-28T19:58:52.596716+0000","last_in_change":"2023-11-28T19:58:43.609275+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":14,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-28T19:58:54.011229+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_metadata","create_time":"2023-11-28T20:02:05.787820+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs_data","create_time":"2023-11-28T20:02:06.652305+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e84245ac-b5da-429e-af18-39acaa2b33e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6800","nonce":3358701235},{"type":"v1","addr":"172.21.15.78:6801","nonce":3358701235}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6802","nonce":3358701235},{"type":"v1","addr":"172.21.15.78:6803","nonce":3358701235}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6806","nonce":3358701235},{"type":"v1","addr":"172.21.15.78:6807","nonce":3358701235}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6804","nonce":3358701235},{"type":"v1","addr":"172.21.15.78:6805","nonce":3358701235}]},"public_addr":"172.21.15.78:6801/3358701235","cluster_addr":"172.21.15.78:6803/3358701235","heartbeat_back_addr":"172.21.15.78:6807/3358701235","heartbeat_front_addr":"172.21.15.78:6805/3358701235","state":["exists","up"]},{"osd":1,"uuid":"e634831d-c4e2-48d9-870c-9556ae162981","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6808","nonce":3211476654},{"type":"v1","addr":"172.21.15.78:6809","nonce":3211476654}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6810","nonce":3211476654},{"type":"v1","addr":"172.21.15.78:6811","nonce":3211476654}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6814","nonce":3211476654},{"type":"v1","addr":"172.21.15.78:6815","nonce":3211476654}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6812","nonce":3211476654},{"type":"v1","addr":"172.21.15.78:6813","nonce":3211476654}]},"public_addr":"172.21.15.78:6809/3211476654","cluster_addr":"172.21.15.78:6811/3211476654","heartbeat_back_addr":"172.21.15.78:6815/3211476654","heartbeat_front_addr":"172.21.15.78:6813/3211476654","state":["exists","up"]},{"osd":2,"uuid":"274c8395-6534-41f0-b8fb-a00af8985aa8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6816","nonce":2532904479},{"type":"v1","addr":"172.21.15.78:6817","nonce":2532904479}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6818","nonce":2532904479},{"type":"v1","addr":"172.21.15.78:6819","nonce":2532904479}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6822","nonce":2532904479},{"type":"v1","addr":"172.21.15.78:6823","nonce":2532904479}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6820","nonce":2532904479},{"type":"v1","addr":"172.21.15.78:6821","nonce":2532904479}]},"public_addr":"172.21.15.78:6817/2532904479","cluster_addr":"172.21.15.78:6819/2532904479","heartbeat_back_addr":"172.21.15.78:6823/2532904479","heartbeat_front_addr":"172.21.15.78:6821/2532904479","state":["exists","up"]},{"osd":3,"uuid":"77acc9af-7d4d-4b18-8cf5-d62f5971b7c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6824","nonce":3442991267},{"type":"v1","addr":"172.21.15.78:6825","nonce":3442991267}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6826","nonce":3442991267},{"type":"v1","addr":"172.21.15.78:6827","nonce":3442991267}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6830","nonce":3442991267},{"type":"v1","addr":"172.21.15.78:6831","nonce":3442991267}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6828","nonce":3442991267},{"type":"v1","addr":"172.21.15.78:6829","nonce":3442991267}]},"public_addr":"172.21.15.78:6825/3442991267","cluster_addr":"172.21.15.78:6827/3442991267","heartbeat_back_addr":"172.21.15.78:6831/3442991267","heartbeat_front_addr":"172.21.15.78:6829/3442991267","state":["exists","up"]},{"osd":4,"uuid":"5c62bc66-6b34-4b7f-a66b-9a743969138c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":802983577},{"type":"v1","addr":"172.21.15.179:6809","nonce":802983577}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":802983577},{"type":"v1","addr":"172.21.15.179:6811","nonce":802983577}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":802983577},{"type":"v1","addr":"172.21.15.179:6815","nonce":802983577}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":802983577},{"type":"v1","addr":"172.21.15.179:6813","nonce":802983577}]},"public_addr":"172.21.15.179:6809/802983577","cluster_addr":"172.21.15.179:6811/802983577","heartbeat_back_addr":"172.21.15.179:6815/802983577","heartbeat_front_addr":"172.21.15.179:6813/802983577","state":["exists","up"]},{"osd":5,"uuid":"67db6d36-f684-4079-b0cd-82b4dd61461f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":518192887},{"type":"v1","addr":"172.21.15.179:6818","nonce":518192887}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":518192887},{"type":"v1","addr":"172.21.15.179:6822","nonce":518192887}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":518192887},{"type":"v1","addr":"172.21.15.179:6829","nonce":518192887}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6824","nonce":518192887},{"type":"v1","addr":"172.21.15.179:6826","nonce":518192887}]},"public_addr":"172.21.15.179:6818/518192887","cluster_addr":"172.21.15.179:6822/518192887","heartbeat_back_addr":"172.21.15.179:6829/518192887","heartbeat_front_addr":"172.21.15.179:6826/518192887","state":["exists","up"]},{"osd":6,"uuid":"12e670af-5a16-4c81-9f97-defa66cab967","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":815435378},{"type":"v1","addr":"172.21.15.179:6801","nonce":815435378}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":815435378},{"type":"v1","addr":"172.21.15.179:6803","nonce":815435378}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":815435378},{"type":"v1","addr":"172.21.15.179:6807","nonce":815435378}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":815435378},{"type":"v1","addr":"172.21.15.179:6805","nonce":815435378}]},"public_addr":"172.21.15.179:6801/815435378","cluster_addr":"172.21.15.179:6803/815435378","heartbeat_back_addr":"172.21.15.179:6807/815435378","heartbeat_front_addr":"172.21.15.179:6805/815435378","state":["exists","up"]},{"osd":7,"uuid":"fe630650-2eb3-49ad-8676-c341e6332eb1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6817","nonce":2848432339},{"type":"v1","addr":"172.21.15.179:6819","nonce":2848432339}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6821","nonce":2848432339},{"type":"v1","addr":"172.21.15.179:6823","nonce":2848432339}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":2848432339},{"type":"v1","addr":"172.21.15.179:6831","nonce":2848432339}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6825","nonce":2848432339},{"type":"v1","addr":"172.21.15.179:6827","nonce":2848432339}]},"public_addr":"172.21.15.179:6819/2848432339","cluster_addr":"172.21.15.179:6823/2848432339","heartbeat_back_addr":"172.21.15.179:6831/2848432339","heartbeat_front_addr":"172.21.15.179:6827/2848432339","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:58:49.255433+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:58:49.412880+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:58:49.559295+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:58:49.245237+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:58:49.184557+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:58:49.329851+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:58:49.366012+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:58:49.349604+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-28T20:02:12.000 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:11.996+0000 7fabe6e9c640 1 -- 172.21.15.78:0/3858406758 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fabc40664a0 msgr2=0x7fabc4068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:02:12.000 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:11.996+0000 7fabe6e9c640 1 --2- 172.21.15.78:0/3858406758 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fabc40664a0 0x7fabc4068960 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7fabd40011f0 tx=0x7fabd4009040 comp rx=0 tx=0).stop 2023-11-28T20:02:12.000 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:11.996+0000 7fabe6e9c640 1 -- 172.21.15.78:0/3858406758 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fabe014e3f0 msgr2=0x7fabe01e8700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:02:12.000 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:11.996+0000 7fabe6e9c640 1 --2- 172.21.15.78:0/3858406758 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fabe014e3f0 0x7fabe01e8700 secure :-1 s=READY pgs=896 cs=0 l=1 rev1=1 crypto rx=0x7fabd800c780 tx=0x7fabd800cc40 comp rx=0 tx=0).stop 2023-11-28T20:02:12.000 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:11.996+0000 7fabe6e9c640 1 -- 172.21.15.78:0/3858406758 shutdown_connections 2023-11-28T20:02:12.000 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:11.996+0000 7fabe6e9c640 1 --2- 172.21.15.78:0/3858406758 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fabc40664a0 0x7fabc4068960 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:12.000 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:11.996+0000 7fabe6e9c640 1 --2- 172.21.15.78:0/3858406758 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fabe006c5b0 0x7fabe0149040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:12.000 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:11.996+0000 7fabe6e9c640 1 --2- 172.21.15.78:0/3858406758 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fabe014e3f0 0x7fabe01e8700 unknown :-1 s=CLOSED pgs=896 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:12.001 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:11.996+0000 7fabe6e9c640 1 --2- 172.21.15.78:0/3858406758 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fabe006bef0 0x7fabe0148b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:12.001 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:11.996+0000 7fabe6e9c640 1 -- 172.21.15.78:0/3858406758 >> 172.21.15.78:0/3858406758 conn(0x7fabe00a7810 msgr2=0x7fabe00a7bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:02:12.001 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:11.996+0000 7fabe6e9c640 1 -- 172.21.15.78:0/3858406758 shutdown_connections 2023-11-28T20:02:12.001 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:11.996+0000 7fabe6e9c640 1 -- 172.21.15.78:0/3858406758 wait complete. 2023-11-28T20:02:12.019 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-11-28T20:02:12.020 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-28T20:02:12.156 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:12.152+0000 7f900310f640 1 Processor -- start 2023-11-28T20:02:12.156 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:12.152+0000 7f900310f640 1 -- start start 2023-11-28T20:02:12.157 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:12.152+0000 7f900310f640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f8ffc06d2b0 0x7f8ffc06d690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:12.157 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:12.152+0000 7f900310f640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8ffc0c3b80 0x7f8ffc0c5300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:12.157 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:12.152+0000 7f900310f640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8ffc06bb80 con 0x7f8ffc06c020 2023-11-28T20:02:12.157 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:12.152+0000 7f900310f640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8ffc0c5840 con 0x7f8ffc06d2b0 2023-11-28T20:02:12.157 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:12.152+0000 7f900310f640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ffc1515c0 con 0x7f8ffc0c3b80 2023-11-28T20:02:12.158 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:12.152+0000 7f90016ac640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f8ffc06c020 0x7f8ffc06c4b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:40368/0 (socket says 172.21.15.78:40368) 2023-11-28T20:02:12.158 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:12.152+0000 7f90016ac640 1 -- 172.21.15.78:0/3796047265 learned_addr learned my addr 172.21.15.78:0/3796047265 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-11-28T20:02:12.158 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:12.152+0000 7f9000eab640 1 --2- 172.21.15.78:0/3796047265 >> v2:172.21.15.179:3300/0 conn(0x7f8ffc06d2b0 0x7f8ffc06d690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:02:12.158 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:12.152+0000 7f8ff3fff640 1 --2- 172.21.15.78:0/3796047265 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8ffc0c3b80 0x7f8ffc0c5300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:02:12.159 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:12.152+0000 7f8ff37fe640 1 -- 172.21.15.78:0/3796047265 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3089284811 0 0) 0x7f8ffc06bb80 con 0x7f8ffc06c020 2023-11-28T20:02:12.159 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:12.152+0000 7f8ff37fe640 1 -- 172.21.15.78:0/3796047265 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8fe4003530 con 0x7f8ffc06c020 2023-11-28T20:02:12.159 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:12.152+0000 7f9000eab640 1 -- 172.21.15.78:0/3796047265 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8ffc0c3b80 msgr2=0x7f8ffc0c5300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:02:12.159 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:12.152+0000 7f9000eab640 1 --2- 172.21.15.78:0/3796047265 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8ffc0c3b80 0x7f8ffc0c5300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:12.159 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:12.152+0000 7f9000eab640 1 -- 172.21.15.78:0/3796047265 >> v1:172.21.15.78:6789/0 conn(0x7f8ffc06c020 legacy=0x7f8ffc06c4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:02:12.159 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:12.152+0000 7f9000eab640 1 -- 172.21.15.78:0/3796047265 --> v2:172.21.15.179:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ffc1518a0 con 0x7f8ffc06d2b0 2023-11-28T20:02:12.161 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:12.156+0000 7f9000eab640 1 --2- 172.21.15.78:0/3796047265 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8ffc06d2b0 0x7f8ffc06d690 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f8ff80097c0 tx=0x7f8ff801c450 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3a703b6bd2da3076 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:02:12.161 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:12.156+0000 7f8ff37fe640 1 -- 172.21.15.78:0/3796047265 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ff80ad660 con 0x7f8ffc06d2b0 2023-11-28T20:02:12.161 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:12.156+0000 7f8ff37fe640 1 -- 172.21.15.78:0/3796047265 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ff80ad7c0 con 0x7f8ffc06d2b0 2023-11-28T20:02:12.161 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:12.156+0000 7f8ff37fe640 1 -- 172.21.15.78:0/3796047265 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ff80adb50 con 0x7f8ffc06d2b0 2023-11-28T20:02:12.162 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:12.156+0000 7f900310f640 1 -- 172.21.15.78:0/3796047265 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8ffc06d2b0 msgr2=0x7f8ffc06d690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:02:12.162 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:12.156+0000 7f900310f640 1 --2- 172.21.15.78:0/3796047265 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8ffc06d2b0 0x7f8ffc06d690 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f8ff80097c0 tx=0x7f8ff801c450 comp rx=0 tx=0).stop 2023-11-28T20:02:12.162 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:12.156+0000 7f900310f640 1 -- 172.21.15.78:0/3796047265 shutdown_connections 2023-11-28T20:02:12.162 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:12.156+0000 7f900310f640 1 --2- 172.21.15.78:0/3796047265 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8ffc0c3b80 0x7f8ffc0c5300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:12.162 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:12.156+0000 7f900310f640 1 --2- 172.21.15.78:0/3796047265 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8ffc06d2b0 0x7f8ffc06d690 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:12.163 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:12.156+0000 7f900310f640 1 -- 172.21.15.78:0/3796047265 >> 172.21.15.78:0/3796047265 conn(0x7f8ffc0a7810 msgr2=0x7f8ffc0a7c20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:02:12.163 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:12.156+0000 7f900310f640 1 -- 172.21.15.78:0/3796047265 shutdown_connections 2023-11-28T20:02:12.163 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:12.156+0000 7f900310f640 1 -- 172.21.15.78:0/3796047265 wait complete. 2023-11-28T20:02:12.163 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:12.160+0000 7f900310f640 1 Processor -- start 2023-11-28T20:02:12.164 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:12.160+0000 7f900310f640 1 -- start start 2023-11-28T20:02:12.165 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:12.160+0000 7f900310f640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8ffc06c020 0x7f8ffc15b470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:12.166 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:12.160+0000 7f900310f640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8ffc06d2b0 0x7f8ffc1ec590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:12.166 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:12.160+0000 7f900310f640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8ffc0c3b80 0x7f8ffc1ecad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:12.166 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:12.160+0000 7f900310f640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ffc1500e0 con 0x7f8ffc0c3b80 2023-11-28T20:02:12.166 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:12.160+0000 7f900310f640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ffc14fd90 con 0x7f8ffc06d2b0 2023-11-28T20:02:12.166 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:12.160+0000 7f900310f640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ffc1eefc0 con 0x7f8ffc06c020 2023-11-28T20:02:12.166 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:12.160+0000 7f90016ac640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8ffc0c3b80 0x7f8ffc1ecad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:02:12.166 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:12.160+0000 7f90016ac640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8ffc0c3b80 0x7f8ffc1ecad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:49514/0 (socket says 172.21.15.78:49514) 2023-11-28T20:02:12.166 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:12.160+0000 7f90016ac640 1 -- 172.21.15.78:0/3635812452 learned_addr learned my addr 172.21.15.78:0/3635812452 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T20:02:12.166 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:12.160+0000 7f8ff3fff640 1 --2- 172.21.15.78:0/3635812452 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8ffc06d2b0 0x7f8ffc1ec590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:02:12.166 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:12.160+0000 7f9000eab640 1 --2- 172.21.15.78:0/3635812452 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8ffc06c020 0x7f8ffc15b470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:02:12.167 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:12.160+0000 7f90016ac640 1 -- 172.21.15.78:0/3635812452 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8ffc06c020 msgr2=0x7f8ffc15b470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:02:12.167 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:12.160+0000 7f90016ac640 1 --2- 172.21.15.78:0/3635812452 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8ffc06c020 0x7f8ffc15b470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:12.167 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:12.160+0000 7f90016ac640 1 -- 172.21.15.78:0/3635812452 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8ffc06d2b0 msgr2=0x7f8ffc1ec590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:02:12.167 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:12.160+0000 7f90016ac640 1 --2- 172.21.15.78:0/3635812452 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8ffc06d2b0 0x7f8ffc1ec590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:12.167 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:12.160+0000 7f90016ac640 1 -- 172.21.15.78:0/3635812452 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ff8009420 con 0x7f8ffc0c3b80 2023-11-28T20:02:12.167 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:12.160+0000 7f90016ac640 1 --2- 172.21.15.78:0/3635812452 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8ffc0c3b80 0x7f8ffc1ecad0 secure :-1 s=READY pgs=898 cs=0 l=1 rev1=1 crypto rx=0x7f8ff400caa0 tx=0x7f8ff400cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:02:12.168 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:12.160+0000 7f8ff17fa640 1 -- 172.21.15.78:0/3635812452 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ff400ac00 con 0x7f8ffc0c3b80 2023-11-28T20:02:12.168 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:12.160+0000 7f8ff17fa640 1 -- 172.21.15.78:0/3635812452 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ff400ad60 con 0x7f8ffc0c3b80 2023-11-28T20:02:12.168 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:12.160+0000 7f8ff17fa640 1 -- 172.21.15.78:0/3635812452 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ff4012620 con 0x7f8ffc0c3b80 2023-11-28T20:02:12.168 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:12.160+0000 7f900310f640 1 -- 172.21.15.78:0/3635812452 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8ffc14ef80 con 0x7f8ffc0c3b80 2023-11-28T20:02:12.168 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:12.160+0000 7f900310f640 1 -- 172.21.15.78:0/3635812452 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8ffc15b9b0 con 0x7f8ffc0c3b80 2023-11-28T20:02:12.168 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:12.164+0000 7f900310f640 1 -- 172.21.15.78:0/3635812452 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8ffc150290 con 0x7f8ffc0c3b80 2023-11-28T20:02:12.168 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:12.164+0000 7f8ff17fa640 1 -- 172.21.15.78:0/3635812452 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f8ff4007070 con 0x7f8ffc0c3b80 2023-11-28T20:02:12.169 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:12.164+0000 7f8ff17fa640 1 --2- 172.21.15.78:0/3635812452 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f8fe8066470 0x7f8fe8068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:12.169 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:12.164+0000 7f8ff17fa640 1 -- 172.21.15.78:0/3635812452 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f8ff4083f10 con 0x7f8ffc0c3b80 2023-11-28T20:02:12.169 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:12.164+0000 7f9000eab640 1 --2- 172.21.15.78:0/3635812452 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f8fe8066470 0x7f8fe8068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:02:12.170 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:12.164+0000 7f9000eab640 1 --2- 172.21.15.78:0/3635812452 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f8fe8066470 0x7f8fe8068930 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f8ff80af000 tx=0x7f8ff8008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:02:12.173 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:12.168+0000 7f8ff17fa640 1 -- 172.21.15.78:0/3635812452 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f8ffc150290 con 0x7f8ffc0c3b80 2023-11-28T20:02:12.321 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:12.316+0000 7f900310f640 1 -- 172.21.15.78:0/3635812452 --> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f8ffc14fc10 con 0x7f8fe8066470 2023-11-28T20:02:12.329 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:12.324+0000 7f8ff17fa640 1 -- 172.21.15.78:0/3635812452 <== mgr.4106 v2:172.21.15.78:6832/2935380957 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+283878 (secure 0 0 0) 0x7f8ff80be090 con 0x7f8fe8066470 2023-11-28T20:02:12.332 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-11-28T20:02:12.334 INFO:teuthology.orchestra.run.smithi078.stderr:dumped all 2023-11-28T20:02:12.335 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:12.328+0000 7f900310f640 1 -- 172.21.15.78:0/3635812452 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f8fe8066470 msgr2=0x7f8fe8068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:02:12.335 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:12.328+0000 7f900310f640 1 --2- 172.21.15.78:0/3635812452 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f8fe8066470 0x7f8fe8068930 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f8ff80af000 tx=0x7f8ff8008040 comp rx=0 tx=0).stop 2023-11-28T20:02:12.335 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:12.328+0000 7f900310f640 1 -- 172.21.15.78:0/3635812452 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8ffc0c3b80 msgr2=0x7f8ffc1ecad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:02:12.335 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:12.328+0000 7f900310f640 1 --2- 172.21.15.78:0/3635812452 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8ffc0c3b80 0x7f8ffc1ecad0 secure :-1 s=READY pgs=898 cs=0 l=1 rev1=1 crypto rx=0x7f8ff400caa0 tx=0x7f8ff400cf60 comp rx=0 tx=0).stop 2023-11-28T20:02:12.335 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:12.328+0000 7f900310f640 1 -- 172.21.15.78:0/3635812452 shutdown_connections 2023-11-28T20:02:12.335 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:12.328+0000 7f900310f640 1 --2- 172.21.15.78:0/3635812452 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f8fe8066470 0x7f8fe8068930 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:12.335 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:12.328+0000 7f900310f640 1 --2- 172.21.15.78:0/3635812452 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8ffc0c3b80 0x7f8ffc1ecad0 unknown :-1 s=CLOSED pgs=898 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:12.335 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:12.328+0000 7f900310f640 1 --2- 172.21.15.78:0/3635812452 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8ffc06d2b0 0x7f8ffc1ec590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:12.336 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:12.328+0000 7f900310f640 1 --2- 172.21.15.78:0/3635812452 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8ffc06c020 0x7f8ffc15b470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:12.336 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:12.328+0000 7f900310f640 1 -- 172.21.15.78:0/3635812452 >> 172.21.15.78:0/3635812452 conn(0x7f8ffc0a7810 msgr2=0x7f8ffc0711f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:02:12.336 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:12.328+0000 7f900310f640 1 -- 172.21.15.78:0/3635812452 shutdown_connections 2023-11-28T20:02:12.336 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:12.328+0000 7f900310f640 1 -- 172.21.15.78:0/3635812452 wait complete. 2023-11-28T20:02:12.352 INFO:teuthology.orchestra.run.smithi078.stdout:{"pg_ready":true,"pg_map":{"version":174,"stamp":"2023-11-28T20:02:11.992080+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":38,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":248892,"kb_used_data":7744,"kb_used_omap":12,"kb_used_meta":241011,"kb_avail":754725828,"statfs":{"total":773094113280,"available":772839247872,"internally_reserved":0,"allocated":7929856,"data_stored":4827424,"data_compressed":66748,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":12752,"internal_metadata":246795824},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":33,"apply_latency_ms":33,"commit_latency_ns":33000000,"apply_latency_ns":33000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.727258"},"pg_stats":[{"pgid":"14.3f","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2023-11-28T20:02:07.283775+0000","last_change":"2023-11-28T20:02:07.283775+0000","last_active":"2023-11-28T20:02:07.264604+0000","last_peered":"2023-11-28T20:02:07.264604+0000","last_clean":"2023-11-28T20:02:07.264604+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:02:07.283775+0000","last_undegraded":"2023-11-28T20:02:07.283775+0000","last_fullsized":"2023-11-28T20:02:07.283775+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_clean_scrub_stamp":"2023-11-28T20:02:07.264604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.3e","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2023-11-28T20:02:07.281033+0000","last_change":"2023-11-28T20:02:07.281033+0000","last_active":"2023-11-28T20:02:07.264604+0000","last_peered":"2023-11-28T20:02:07.264604+0000","last_clean":"2023-11-28T20:02:07.264604+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:02:07.281033+0000","last_undegraded":"2023-11-28T20:02:07.281033+0000","last_fullsized":"2023-11-28T20:02:07.281033+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_clean_scrub_stamp":"2023-11-28T20:02:07.264604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.3d","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2023-11-28T20:02:07.284263+0000","last_change":"2023-11-28T20:02:07.284263+0000","last_active":"2023-11-28T20:02:07.264604+0000","last_peered":"2023-11-28T20:02:07.264604+0000","last_clean":"2023-11-28T20:02:07.264604+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:02:07.284263+0000","last_undegraded":"2023-11-28T20:02:07.284263+0000","last_fullsized":"2023-11-28T20:02:07.284263+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_clean_scrub_stamp":"2023-11-28T20:02:07.264604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.3c","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2023-11-28T20:02:07.279673+0000","last_change":"2023-11-28T20:02:07.279673+0000","last_active":"2023-11-28T20:02:07.264604+0000","last_peered":"2023-11-28T20:02:07.264604+0000","last_clean":"2023-11-28T20:02:07.264604+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:02:07.279673+0000","last_undegraded":"2023-11-28T20:02:07.279673+0000","last_fullsized":"2023-11-28T20:02:07.279673+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_clean_scrub_stamp":"2023-11-28T20:02:07.264604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.3b","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2023-11-28T20:02:07.278853+0000","last_change":"2023-11-28T20:02:07.278853+0000","last_active":"2023-11-28T20:02:07.264604+0000","last_peered":"2023-11-28T20:02:07.264604+0000","last_clean":"2023-11-28T20:02:07.264604+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:02:07.278853+0000","last_undegraded":"2023-11-28T20:02:07.278853+0000","last_fullsized":"2023-11-28T20:02:07.278853+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_clean_scrub_stamp":"2023-11-28T20:02:07.264604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.3a","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2023-11-28T20:02:07.285754+0000","last_change":"2023-11-28T20:02:07.285754+0000","last_active":"2023-11-28T20:02:07.264604+0000","last_peered":"2023-11-28T20:02:07.264604+0000","last_clean":"2023-11-28T20:02:07.264604+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:02:07.285754+0000","last_undegraded":"2023-11-28T20:02:07.285754+0000","last_fullsized":"2023-11-28T20:02:07.285754+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_clean_scrub_stamp":"2023-11-28T20:02:07.264604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.39","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2023-11-28T20:02:07.287408+0000","last_change":"2023-11-28T20:02:07.287408+0000","last_active":"2023-11-28T20:02:07.264604+0000","last_peered":"2023-11-28T20:02:07.264604+0000","last_clean":"2023-11-28T20:02:07.264604+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:02:07.287408+0000","last_undegraded":"2023-11-28T20:02:07.287408+0000","last_fullsized":"2023-11-28T20:02:07.287408+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_clean_scrub_stamp":"2023-11-28T20:02:07.264604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.38","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2023-11-28T20:02:07.279529+0000","last_change":"2023-11-28T20:02:07.279529+0000","last_active":"2023-11-28T20:02:07.264604+0000","last_peered":"2023-11-28T20:02:07.264604+0000","last_clean":"2023-11-28T20:02:07.264604+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:02:07.279529+0000","last_undegraded":"2023-11-28T20:02:07.279529+0000","last_fullsized":"2023-11-28T20:02:07.279529+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_clean_scrub_stamp":"2023-11-28T20:02:07.264604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.37","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2023-11-28T20:02:07.280230+0000","last_change":"2023-11-28T20:02:07.280230+0000","last_active":"2023-11-28T20:02:07.264604+0000","last_peered":"2023-11-28T20:02:07.264604+0000","last_clean":"2023-11-28T20:02:07.264604+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:02:07.280230+0000","last_undegraded":"2023-11-28T20:02:07.280230+0000","last_fullsized":"2023-11-28T20:02:07.280230+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_clean_scrub_stamp":"2023-11-28T20:02:07.264604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.36","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2023-11-28T20:02:07.285036+0000","last_change":"2023-11-28T20:02:07.285036+0000","last_active":"2023-11-28T20:02:07.264604+0000","last_peered":"2023-11-28T20:02:07.264604+0000","last_clean":"2023-11-28T20:02:07.264604+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:02:07.285036+0000","last_undegraded":"2023-11-28T20:02:07.285036+0000","last_fullsized":"2023-11-28T20:02:07.285036+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_clean_scrub_stamp":"2023-11-28T20:02:07.264604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.35","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2023-11-28T20:02:07.280584+0000","last_change":"2023-11-28T20:02:07.280584+0000","last_active":"2023-11-28T20:02:07.264604+0000","last_peered":"2023-11-28T20:02:07.264604+0000","last_clean":"2023-11-28T20:02:07.264604+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:02:07.280584+0000","last_undegraded":"2023-11-28T20:02:07.280584+0000","last_fullsized":"2023-11-28T20:02:07.280584+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_clean_scrub_stamp":"2023-11-28T20:02:07.264604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.34","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2023-11-28T20:02:07.281300+0000","last_change":"2023-11-28T20:02:07.281300+0000","last_active":"2023-11-28T20:02:07.264604+0000","last_peered":"2023-11-28T20:02:07.264604+0000","last_clean":"2023-11-28T20:02:07.264604+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:02:07.281300+0000","last_undegraded":"2023-11-28T20:02:07.281300+0000","last_fullsized":"2023-11-28T20:02:07.281300+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_clean_scrub_stamp":"2023-11-28T20:02:07.264604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.33","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2023-11-28T20:02:07.279252+0000","last_change":"2023-11-28T20:02:07.279252+0000","last_active":"2023-11-28T20:02:07.264604+0000","last_peered":"2023-11-28T20:02:07.264604+0000","last_clean":"2023-11-28T20:02:07.264604+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:02:07.279252+0000","last_undegraded":"2023-11-28T20:02:07.279252+0000","last_fullsized":"2023-11-28T20:02:07.279252+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_clean_scrub_stamp":"2023-11-28T20:02:07.264604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.32","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2023-11-28T20:02:07.280291+0000","last_change":"2023-11-28T20:02:07.280291+0000","last_active":"2023-11-28T20:02:07.264604+0000","last_peered":"2023-11-28T20:02:07.264604+0000","last_clean":"2023-11-28T20:02:07.264604+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:02:07.280291+0000","last_undegraded":"2023-11-28T20:02:07.280291+0000","last_fullsized":"2023-11-28T20:02:07.280291+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_clean_scrub_stamp":"2023-11-28T20:02:07.264604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.31","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2023-11-28T20:02:07.278957+0000","last_change":"2023-11-28T20:02:07.278957+0000","last_active":"2023-11-28T20:02:07.264604+0000","last_peered":"2023-11-28T20:02:07.264604+0000","last_clean":"2023-11-28T20:02:07.264604+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:02:07.278957+0000","last_undegraded":"2023-11-28T20:02:07.278957+0000","last_fullsized":"2023-11-28T20:02:07.278957+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_clean_scrub_stamp":"2023-11-28T20:02:07.264604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.30","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2023-11-28T20:02:07.285701+0000","last_change":"2023-11-28T20:02:07.285701+0000","last_active":"2023-11-28T20:02:07.264604+0000","last_peered":"2023-11-28T20:02:07.264604+0000","last_clean":"2023-11-28T20:02:07.264604+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:02:07.285701+0000","last_undegraded":"2023-11-28T20:02:07.285701+0000","last_fullsized":"2023-11-28T20:02:07.285701+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_clean_scrub_stamp":"2023-11-28T20:02:07.264604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.2f","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2023-11-28T20:02:07.279900+0000","last_change":"2023-11-28T20:02:07.279900+0000","last_active":"2023-11-28T20:02:07.264604+0000","last_peered":"2023-11-28T20:02:07.264604+0000","last_clean":"2023-11-28T20:02:07.264604+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:02:07.279900+0000","last_undegraded":"2023-11-28T20:02:07.279900+0000","last_fullsized":"2023-11-28T20:02:07.279900+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_clean_scrub_stamp":"2023-11-28T20:02:07.264604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.2e","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2023-11-28T20:02:07.283280+0000","last_change":"2023-11-28T20:02:07.283280+0000","last_active":"2023-11-28T20:02:07.264604+0000","last_peered":"2023-11-28T20:02:07.264604+0000","last_clean":"2023-11-28T20:02:07.264604+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:02:07.283280+0000","last_undegraded":"2023-11-28T20:02:07.283280+0000","last_fullsized":"2023-11-28T20:02:07.283280+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_clean_scrub_stamp":"2023-11-28T20:02:07.264604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.2d","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2023-11-28T20:02:07.279980+0000","last_change":"2023-11-28T20:02:07.279980+0000","last_active":"2023-11-28T20:02:07.264604+0000","last_peered":"2023-11-28T20:02:07.264604+0000","last_clean":"2023-11-28T20:02:07.264604+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:02:07.279980+0000","last_undegraded":"2023-11-28T20:02:07.279980+0000","last_fullsized":"2023-11-28T20:02:07.279980+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_clean_scrub_stamp":"2023-11-28T20:02:07.264604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.2c","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2023-11-28T20:02:07.279215+0000","last_change":"2023-11-28T20:02:07.279215+0000","last_active":"2023-11-28T20:02:07.264604+0000","last_peered":"2023-11-28T20:02:07.264604+0000","last_clean":"2023-11-28T20:02:07.264604+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:02:07.279215+0000","last_undegraded":"2023-11-28T20:02:07.279215+0000","last_fullsized":"2023-11-28T20:02:07.279215+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_clean_scrub_stamp":"2023-11-28T20:02:07.264604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.2b","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2023-11-28T20:02:07.279982+0000","last_change":"2023-11-28T20:02:07.279982+0000","last_active":"2023-11-28T20:02:07.264604+0000","last_peered":"2023-11-28T20:02:07.264604+0000","last_clean":"2023-11-28T20:02:07.264604+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:02:07.279982+0000","last_undegraded":"2023-11-28T20:02:07.279982+0000","last_fullsized":"2023-11-28T20:02:07.279982+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_clean_scrub_stamp":"2023-11-28T20:02:07.264604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.2a","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2023-11-28T20:02:07.279747+0000","last_change":"2023-11-28T20:02:07.279747+0000","last_active":"2023-11-28T20:02:07.264604+0000","last_peered":"2023-11-28T20:02:07.264604+0000","last_clean":"2023-11-28T20:02:07.264604+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:02:07.279747+0000","last_undegraded":"2023-11-28T20:02:07.279747+0000","last_fullsized":"2023-11-28T20:02:07.279747+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_clean_scrub_stamp":"2023-11-28T20:02:07.264604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.29","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2023-11-28T20:02:07.288560+0000","last_change":"2023-11-28T20:02:07.288560+0000","last_active":"2023-11-28T20:02:07.264604+0000","last_peered":"2023-11-28T20:02:07.264604+0000","last_clean":"2023-11-28T20:02:07.264604+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:02:07.288560+0000","last_undegraded":"2023-11-28T20:02:07.288560+0000","last_fullsized":"2023-11-28T20:02:07.288560+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_clean_scrub_stamp":"2023-11-28T20:02:07.264604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.28","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2023-11-28T20:02:07.281146+0000","last_change":"2023-11-28T20:02:07.281146+0000","last_active":"2023-11-28T20:02:07.264604+0000","last_peered":"2023-11-28T20:02:07.264604+0000","last_clean":"2023-11-28T20:02:07.264604+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:02:07.281146+0000","last_undegraded":"2023-11-28T20:02:07.281146+0000","last_fullsized":"2023-11-28T20:02:07.281146+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_clean_scrub_stamp":"2023-11-28T20:02:07.264604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.27","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2023-11-28T20:02:07.280571+0000","last_change":"2023-11-28T20:02:07.280571+0000","last_active":"2023-11-28T20:02:07.264604+0000","last_peered":"2023-11-28T20:02:07.264604+0000","last_clean":"2023-11-28T20:02:07.264604+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:02:07.280571+0000","last_undegraded":"2023-11-28T20:02:07.280571+0000","last_fullsized":"2023-11-28T20:02:07.280571+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_clean_scrub_stamp":"2023-11-28T20:02:07.264604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.26","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2023-11-28T20:02:07.281292+0000","last_change":"2023-11-28T20:02:07.281292+0000","last_active":"2023-11-28T20:02:07.264604+0000","last_peered":"2023-11-28T20:02:07.264604+0000","last_clean":"2023-11-28T20:02:07.264604+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:02:07.281292+0000","last_undegraded":"2023-11-28T20:02:07.281292+0000","last_fullsized":"2023-11-28T20:02:07.281292+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_clean_scrub_stamp":"2023-11-28T20:02:07.264604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.25","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2023-11-28T20:02:07.283518+0000","last_change":"2023-11-28T20:02:07.283518+0000","last_active":"2023-11-28T20:02:07.264604+0000","last_peered":"2023-11-28T20:02:07.264604+0000","last_clean":"2023-11-28T20:02:07.264604+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:02:07.283518+0000","last_undegraded":"2023-11-28T20:02:07.283518+0000","last_fullsized":"2023-11-28T20:02:07.283518+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_clean_scrub_stamp":"2023-11-28T20:02:07.264604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.24","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2023-11-28T20:02:07.278454+0000","last_change":"2023-11-28T20:02:07.278454+0000","last_active":"2023-11-28T20:02:07.264604+0000","last_peered":"2023-11-28T20:02:07.264604+0000","last_clean":"2023-11-28T20:02:07.264604+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:02:07.278454+0000","last_undegraded":"2023-11-28T20:02:07.278454+0000","last_fullsized":"2023-11-28T20:02:07.278454+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_clean_scrub_stamp":"2023-11-28T20:02:07.264604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.23","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2023-11-28T20:02:07.286673+0000","last_change":"2023-11-28T20:02:07.286673+0000","last_active":"2023-11-28T20:02:07.264604+0000","last_peered":"2023-11-28T20:02:07.264604+0000","last_clean":"2023-11-28T20:02:07.264604+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:02:07.286673+0000","last_undegraded":"2023-11-28T20:02:07.286673+0000","last_fullsized":"2023-11-28T20:02:07.286673+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_clean_scrub_stamp":"2023-11-28T20:02:07.264604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.22","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2023-11-28T20:02:07.278208+0000","last_change":"2023-11-28T20:02:07.278208+0000","last_active":"2023-11-28T20:02:07.264604+0000","last_peered":"2023-11-28T20:02:07.264604+0000","last_clean":"2023-11-28T20:02:07.264604+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:02:07.278208+0000","last_undegraded":"2023-11-28T20:02:07.278208+0000","last_fullsized":"2023-11-28T20:02:07.278208+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_clean_scrub_stamp":"2023-11-28T20:02:07.264604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.21","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2023-11-28T20:02:07.281997+0000","last_change":"2023-11-28T20:02:07.281997+0000","last_active":"2023-11-28T20:02:07.264604+0000","last_peered":"2023-11-28T20:02:07.264604+0000","last_clean":"2023-11-28T20:02:07.264604+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:02:07.281997+0000","last_undegraded":"2023-11-28T20:02:07.281997+0000","last_fullsized":"2023-11-28T20:02:07.281997+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_clean_scrub_stamp":"2023-11-28T20:02:07.264604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.20","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2023-11-28T20:02:07.280102+0000","last_change":"2023-11-28T20:02:07.280102+0000","last_active":"2023-11-28T20:02:07.264604+0000","last_peered":"2023-11-28T20:02:07.264604+0000","last_clean":"2023-11-28T20:02:07.264604+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:02:07.280102+0000","last_undegraded":"2023-11-28T20:02:07.280102+0000","last_fullsized":"2023-11-28T20:02:07.280102+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_clean_scrub_stamp":"2023-11-28T20:02:07.264604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.1c","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2023-11-28T20:02:07.285556+0000","last_change":"2023-11-28T20:02:07.285556+0000","last_active":"2023-11-28T20:02:07.264604+0000","last_peered":"2023-11-28T20:02:07.264604+0000","last_clean":"2023-11-28T20:02:07.264604+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:02:07.285556+0000","last_undegraded":"2023-11-28T20:02:07.285556+0000","last_fullsized":"2023-11-28T20:02:07.285556+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_clean_scrub_stamp":"2023-11-28T20:02:07.264604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1f","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-28T20:02:07.301622+0000","last_change":"2023-11-28T20:02:07.298433+0000","last_active":"2023-11-28T20:02:07.301622+0000","last_peered":"2023-11-28T20:02:07.301622+0000","last_clean":"2023-11-28T20:02:07.301622+0000","last_became_active":"2023-11-28T20:02:07.298106+0000","last_became_peered":"2023-11-28T20:02:07.298106+0000","last_unstale":"2023-11-28T20:02:07.301622+0000","last_undegraded":"2023-11-28T20:02:07.301622+0000","last_fullsized":"2023-11-28T20:02:07.301622+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:06.257335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:06.257335+0000","last_clean_scrub_stamp":"2023-11-28T20:02:06.257335+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T06:20:36.448239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.1d","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2023-11-28T20:02:07.286754+0000","last_change":"2023-11-28T20:02:07.286754+0000","last_active":"2023-11-28T20:02:07.264604+0000","last_peered":"2023-11-28T20:02:07.264604+0000","last_clean":"2023-11-28T20:02:07.264604+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:02:07.286754+0000","last_undegraded":"2023-11-28T20:02:07.286754+0000","last_fullsized":"2023-11-28T20:02:07.286754+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_clean_scrub_stamp":"2023-11-28T20:02:07.264604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1e","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-28T20:02:07.296840+0000","last_change":"2023-11-28T20:02:07.293164+0000","last_active":"2023-11-28T20:02:07.296840+0000","last_peered":"2023-11-28T20:02:07.296840+0000","last_clean":"2023-11-28T20:02:07.296840+0000","last_became_active":"2023-11-28T20:02:07.292799+0000","last_became_peered":"2023-11-28T20:02:07.292799+0000","last_unstale":"2023-11-28T20:02:07.296840+0000","last_undegraded":"2023-11-28T20:02:07.296840+0000","last_fullsized":"2023-11-28T20:02:07.296840+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:06.257335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:06.257335+0000","last_clean_scrub_stamp":"2023-11-28T20:02:06.257335+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:09:41.129447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.1e","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2023-11-28T20:02:07.287269+0000","last_change":"2023-11-28T20:02:07.287269+0000","last_active":"2023-11-28T20:02:07.264604+0000","last_peered":"2023-11-28T20:02:07.264604+0000","last_clean":"2023-11-28T20:02:07.264604+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:02:07.287269+0000","last_undegraded":"2023-11-28T20:02:07.287269+0000","last_fullsized":"2023-11-28T20:02:07.287269+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_clean_scrub_stamp":"2023-11-28T20:02:07.264604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.1d","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-28T20:02:07.305601+0000","last_change":"2023-11-28T20:02:07.298412+0000","last_active":"2023-11-28T20:02:07.305601+0000","last_peered":"2023-11-28T20:02:07.305601+0000","last_clean":"2023-11-28T20:02:07.305601+0000","last_became_active":"2023-11-28T20:02:07.297937+0000","last_became_peered":"2023-11-28T20:02:07.297937+0000","last_unstale":"2023-11-28T20:02:07.305601+0000","last_undegraded":"2023-11-28T20:02:07.305601+0000","last_fullsized":"2023-11-28T20:02:07.305601+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:06.257335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:06.257335+0000","last_clean_scrub_stamp":"2023-11-28T20:02:06.257335+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:11:12.221383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.1f","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2023-11-28T20:02:07.279393+0000","last_change":"2023-11-28T20:02:07.279393+0000","last_active":"2023-11-28T20:02:07.264604+0000","last_peered":"2023-11-28T20:02:07.264604+0000","last_clean":"2023-11-28T20:02:07.264604+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:02:07.279393+0000","last_undegraded":"2023-11-28T20:02:07.279393+0000","last_fullsized":"2023-11-28T20:02:07.279393+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_clean_scrub_stamp":"2023-11-28T20:02:07.264604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1c","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-28T20:02:07.306628+0000","last_change":"2023-11-28T20:02:07.303442+0000","last_active":"2023-11-28T20:02:07.306628+0000","last_peered":"2023-11-28T20:02:07.306628+0000","last_clean":"2023-11-28T20:02:07.306628+0000","last_became_active":"2023-11-28T20:02:07.302881+0000","last_became_peered":"2023-11-28T20:02:07.302881+0000","last_unstale":"2023-11-28T20:02:07.306628+0000","last_undegraded":"2023-11-28T20:02:07.306628+0000","last_fullsized":"2023-11-28T20:02:07.306628+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:06.257335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:06.257335+0000","last_clean_scrub_stamp":"2023-11-28T20:02:06.257335+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:26:07.339153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.18","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2023-11-28T20:02:07.279010+0000","last_change":"2023-11-28T20:02:07.279010+0000","last_active":"2023-11-28T20:02:07.264604+0000","last_peered":"2023-11-28T20:02:07.264604+0000","last_clean":"2023-11-28T20:02:07.264604+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:02:07.279010+0000","last_undegraded":"2023-11-28T20:02:07.279010+0000","last_fullsized":"2023-11-28T20:02:07.279010+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_clean_scrub_stamp":"2023-11-28T20:02:07.264604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.1b","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-28T20:02:07.295836+0000","last_change":"2023-11-28T20:02:07.292245+0000","last_active":"2023-11-28T20:02:07.295836+0000","last_peered":"2023-11-28T20:02:07.295836+0000","last_clean":"2023-11-28T20:02:07.295836+0000","last_became_active":"2023-11-28T20:02:07.291923+0000","last_became_peered":"2023-11-28T20:02:07.291923+0000","last_unstale":"2023-11-28T20:02:07.295836+0000","last_undegraded":"2023-11-28T20:02:07.295836+0000","last_fullsized":"2023-11-28T20:02:07.295836+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:06.257335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:06.257335+0000","last_clean_scrub_stamp":"2023-11-28T20:02:06.257335+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:12:38.018161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.19","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2023-11-28T20:02:07.288017+0000","last_change":"2023-11-28T20:02:07.288017+0000","last_active":"2023-11-28T20:02:07.264604+0000","last_peered":"2023-11-28T20:02:07.264604+0000","last_clean":"2023-11-28T20:02:07.264604+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:02:07.288017+0000","last_undegraded":"2023-11-28T20:02:07.288017+0000","last_fullsized":"2023-11-28T20:02:07.288017+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_clean_scrub_stamp":"2023-11-28T20:02:07.264604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1a","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-28T20:02:07.300872+0000","last_change":"2023-11-28T20:02:07.297038+0000","last_active":"2023-11-28T20:02:07.300872+0000","last_peered":"2023-11-28T20:02:07.300872+0000","last_clean":"2023-11-28T20:02:07.300872+0000","last_became_active":"2023-11-28T20:02:07.295472+0000","last_became_peered":"2023-11-28T20:02:07.295472+0000","last_unstale":"2023-11-28T20:02:07.300872+0000","last_undegraded":"2023-11-28T20:02:07.300872+0000","last_fullsized":"2023-11-28T20:02:07.300872+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:06.257335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:06.257335+0000","last_clean_scrub_stamp":"2023-11-28T20:02:06.257335+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:04:18.830964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.1a","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2023-11-28T20:02:07.279632+0000","last_change":"2023-11-28T20:02:07.279632+0000","last_active":"2023-11-28T20:02:07.264604+0000","last_peered":"2023-11-28T20:02:07.264604+0000","last_clean":"2023-11-28T20:02:07.264604+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:02:07.279632+0000","last_undegraded":"2023-11-28T20:02:07.279632+0000","last_fullsized":"2023-11-28T20:02:07.279632+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_clean_scrub_stamp":"2023-11-28T20:02:07.264604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.19","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-28T20:02:07.298903+0000","last_change":"2023-11-28T20:02:07.292322+0000","last_active":"2023-11-28T20:02:07.298903+0000","last_peered":"2023-11-28T20:02:07.298903+0000","last_clean":"2023-11-28T20:02:07.298903+0000","last_became_active":"2023-11-28T20:02:07.292063+0000","last_became_peered":"2023-11-28T20:02:07.292063+0000","last_unstale":"2023-11-28T20:02:07.298903+0000","last_undegraded":"2023-11-28T20:02:07.298903+0000","last_fullsized":"2023-11-28T20:02:07.298903+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:06.257335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:06.257335+0000","last_clean_scrub_stamp":"2023-11-28T20:02:06.257335+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T07:49:30.905608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.1b","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2023-11-28T20:02:07.278842+0000","last_change":"2023-11-28T20:02:07.278842+0000","last_active":"2023-11-28T20:02:07.264604+0000","last_peered":"2023-11-28T20:02:07.264604+0000","last_clean":"2023-11-28T20:02:07.264604+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:02:07.278842+0000","last_undegraded":"2023-11-28T20:02:07.278842+0000","last_fullsized":"2023-11-28T20:02:07.278842+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_clean_scrub_stamp":"2023-11-28T20:02:07.264604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.18","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-28T20:02:07.305630+0000","last_change":"2023-11-28T20:02:07.298452+0000","last_active":"2023-11-28T20:02:07.305630+0000","last_peered":"2023-11-28T20:02:07.305630+0000","last_clean":"2023-11-28T20:02:07.305630+0000","last_became_active":"2023-11-28T20:02:07.297932+0000","last_became_peered":"2023-11-28T20:02:07.297932+0000","last_unstale":"2023-11-28T20:02:07.305630+0000","last_undegraded":"2023-11-28T20:02:07.305630+0000","last_fullsized":"2023-11-28T20:02:07.305630+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:06.257335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:06.257335+0000","last_clean_scrub_stamp":"2023-11-28T20:02:06.257335+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:41:59.292583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.14","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2023-11-28T20:02:07.279138+0000","last_change":"2023-11-28T20:02:07.279138+0000","last_active":"2023-11-28T20:02:07.264604+0000","last_peered":"2023-11-28T20:02:07.264604+0000","last_clean":"2023-11-28T20:02:07.264604+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:02:07.279138+0000","last_undegraded":"2023-11-28T20:02:07.279138+0000","last_fullsized":"2023-11-28T20:02:07.279138+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_clean_scrub_stamp":"2023-11-28T20:02:07.264604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.17","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-28T20:02:07.305738+0000","last_change":"2023-11-28T20:02:07.299173+0000","last_active":"2023-11-28T20:02:07.305738+0000","last_peered":"2023-11-28T20:02:07.305738+0000","last_clean":"2023-11-28T20:02:07.305738+0000","last_became_active":"2023-11-28T20:02:07.298892+0000","last_became_peered":"2023-11-28T20:02:07.298892+0000","last_unstale":"2023-11-28T20:02:07.305738+0000","last_undegraded":"2023-11-28T20:02:07.305738+0000","last_fullsized":"2023-11-28T20:02:07.305738+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:06.257335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:06.257335+0000","last_clean_scrub_stamp":"2023-11-28T20:02:06.257335+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:31:56.348870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.15","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2023-11-28T20:02:07.286690+0000","last_change":"2023-11-28T20:02:07.286690+0000","last_active":"2023-11-28T20:02:07.264604+0000","last_peered":"2023-11-28T20:02:07.264604+0000","last_clean":"2023-11-28T20:02:07.264604+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:02:07.286690+0000","last_undegraded":"2023-11-28T20:02:07.286690+0000","last_fullsized":"2023-11-28T20:02:07.286690+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_clean_scrub_stamp":"2023-11-28T20:02:07.264604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.16","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-28T20:02:07.299239+0000","last_change":"2023-11-28T20:02:07.291621+0000","last_active":"2023-11-28T20:02:07.299239+0000","last_peered":"2023-11-28T20:02:07.299239+0000","last_clean":"2023-11-28T20:02:07.299239+0000","last_became_active":"2023-11-28T20:02:07.288923+0000","last_became_peered":"2023-11-28T20:02:07.288923+0000","last_unstale":"2023-11-28T20:02:07.299239+0000","last_undegraded":"2023-11-28T20:02:07.299239+0000","last_fullsized":"2023-11-28T20:02:07.299239+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:06.257335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:06.257335+0000","last_clean_scrub_stamp":"2023-11-28T20:02:06.257335+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:52:29.664838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.16","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2023-11-28T20:02:07.282823+0000","last_change":"2023-11-28T20:02:07.282823+0000","last_active":"2023-11-28T20:02:07.264604+0000","last_peered":"2023-11-28T20:02:07.264604+0000","last_clean":"2023-11-28T20:02:07.264604+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:02:07.282823+0000","last_undegraded":"2023-11-28T20:02:07.282823+0000","last_fullsized":"2023-11-28T20:02:07.282823+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_clean_scrub_stamp":"2023-11-28T20:02:07.264604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.15","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-28T20:02:07.303262+0000","last_change":"2023-11-28T20:02:07.300162+0000","last_active":"2023-11-28T20:02:07.303262+0000","last_peered":"2023-11-28T20:02:07.303262+0000","last_clean":"2023-11-28T20:02:07.303262+0000","last_became_active":"2023-11-28T20:02:07.299792+0000","last_became_peered":"2023-11-28T20:02:07.299792+0000","last_unstale":"2023-11-28T20:02:07.303262+0000","last_undegraded":"2023-11-28T20:02:07.303262+0000","last_fullsized":"2023-11-28T20:02:07.303262+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:06.257335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:06.257335+0000","last_clean_scrub_stamp":"2023-11-28T20:02:06.257335+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:03:03.265026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.17","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2023-11-28T20:02:07.278623+0000","last_change":"2023-11-28T20:02:07.278623+0000","last_active":"2023-11-28T20:02:07.264604+0000","last_peered":"2023-11-28T20:02:07.264604+0000","last_clean":"2023-11-28T20:02:07.264604+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:02:07.278623+0000","last_undegraded":"2023-11-28T20:02:07.278623+0000","last_fullsized":"2023-11-28T20:02:07.278623+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_clean_scrub_stamp":"2023-11-28T20:02:07.264604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.14","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-28T20:02:07.297892+0000","last_change":"2023-11-28T20:02:07.296089+0000","last_active":"2023-11-28T20:02:07.297892+0000","last_peered":"2023-11-28T20:02:07.297892+0000","last_clean":"2023-11-28T20:02:07.297892+0000","last_became_active":"2023-11-28T20:02:07.295836+0000","last_became_peered":"2023-11-28T20:02:07.295836+0000","last_unstale":"2023-11-28T20:02:07.297892+0000","last_undegraded":"2023-11-28T20:02:07.297892+0000","last_fullsized":"2023-11-28T20:02:07.297892+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:06.257335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:06.257335+0000","last_clean_scrub_stamp":"2023-11-28T20:02:06.257335+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:40:58.188007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.10","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2023-11-28T20:02:07.278502+0000","last_change":"2023-11-28T20:02:07.278502+0000","last_active":"2023-11-28T20:02:07.264604+0000","last_peered":"2023-11-28T20:02:07.264604+0000","last_clean":"2023-11-28T20:02:07.264604+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:02:07.278502+0000","last_undegraded":"2023-11-28T20:02:07.278502+0000","last_fullsized":"2023-11-28T20:02:07.278502+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_clean_scrub_stamp":"2023-11-28T20:02:07.264604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.13","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-28T20:02:07.305695+0000","last_change":"2023-11-28T20:02:07.298781+0000","last_active":"2023-11-28T20:02:07.305695+0000","last_peered":"2023-11-28T20:02:07.305695+0000","last_clean":"2023-11-28T20:02:07.305695+0000","last_became_active":"2023-11-28T20:02:07.298318+0000","last_became_peered":"2023-11-28T20:02:07.298318+0000","last_unstale":"2023-11-28T20:02:07.305695+0000","last_undegraded":"2023-11-28T20:02:07.305695+0000","last_fullsized":"2023-11-28T20:02:07.305695+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:06.257335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:06.257335+0000","last_clean_scrub_stamp":"2023-11-28T20:02:06.257335+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:40:58.188007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.11","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2023-11-28T20:02:07.278215+0000","last_change":"2023-11-28T20:02:07.278215+0000","last_active":"2023-11-28T20:02:07.264604+0000","last_peered":"2023-11-28T20:02:07.264604+0000","last_clean":"2023-11-28T20:02:07.264604+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:02:07.278215+0000","last_undegraded":"2023-11-28T20:02:07.278215+0000","last_fullsized":"2023-11-28T20:02:07.278215+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_clean_scrub_stamp":"2023-11-28T20:02:07.264604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.12","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-28T20:02:07.296902+0000","last_change":"2023-11-28T20:02:07.293203+0000","last_active":"2023-11-28T20:02:07.296902+0000","last_peered":"2023-11-28T20:02:07.296902+0000","last_clean":"2023-11-28T20:02:07.296902+0000","last_became_active":"2023-11-28T20:02:07.292922+0000","last_became_peered":"2023-11-28T20:02:07.292922+0000","last_unstale":"2023-11-28T20:02:07.296902+0000","last_undegraded":"2023-11-28T20:02:07.296902+0000","last_fullsized":"2023-11-28T20:02:07.296902+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:06.257335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:06.257335+0000","last_clean_scrub_stamp":"2023-11-28T20:02:06.257335+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:11:12.221383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.12","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2023-11-28T20:02:07.283056+0000","last_change":"2023-11-28T20:02:07.283056+0000","last_active":"2023-11-28T20:02:07.264604+0000","last_peered":"2023-11-28T20:02:07.264604+0000","last_clean":"2023-11-28T20:02:07.264604+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:02:07.283056+0000","last_undegraded":"2023-11-28T20:02:07.283056+0000","last_fullsized":"2023-11-28T20:02:07.283056+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_clean_scrub_stamp":"2023-11-28T20:02:07.264604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.11","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-28T20:02:07.299965+0000","last_change":"2023-11-28T20:02:07.291824+0000","last_active":"2023-11-28T20:02:07.299965+0000","last_peered":"2023-11-28T20:02:07.299965+0000","last_clean":"2023-11-28T20:02:07.299965+0000","last_became_active":"2023-11-28T20:02:07.291575+0000","last_became_peered":"2023-11-28T20:02:07.291575+0000","last_unstale":"2023-11-28T20:02:07.299965+0000","last_undegraded":"2023-11-28T20:02:07.299965+0000","last_fullsized":"2023-11-28T20:02:07.299965+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:06.257335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:06.257335+0000","last_clean_scrub_stamp":"2023-11-28T20:02:06.257335+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:32:46.550427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.13","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2023-11-28T20:02:07.280802+0000","last_change":"2023-11-28T20:02:07.280802+0000","last_active":"2023-11-28T20:02:07.264604+0000","last_peered":"2023-11-28T20:02:07.264604+0000","last_clean":"2023-11-28T20:02:07.264604+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:02:07.280802+0000","last_undegraded":"2023-11-28T20:02:07.280802+0000","last_fullsized":"2023-11-28T20:02:07.280802+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_clean_scrub_stamp":"2023-11-28T20:02:07.264604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.10","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-28T20:02:07.301395+0000","last_change":"2023-11-28T20:02:07.295459+0000","last_active":"2023-11-28T20:02:07.301395+0000","last_peered":"2023-11-28T20:02:07.301395+0000","last_clean":"2023-11-28T20:02:07.301395+0000","last_became_active":"2023-11-28T20:02:07.295090+0000","last_became_peered":"2023-11-28T20:02:07.295090+0000","last_unstale":"2023-11-28T20:02:07.301395+0000","last_undegraded":"2023-11-28T20:02:07.301395+0000","last_fullsized":"2023-11-28T20:02:07.301395+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:06.257335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:06.257335+0000","last_clean_scrub_stamp":"2023-11-28T20:02:06.257335+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:42:57.441074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.c","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2023-11-28T20:02:07.279835+0000","last_change":"2023-11-28T20:02:07.279835+0000","last_active":"2023-11-28T20:02:07.264604+0000","last_peered":"2023-11-28T20:02:07.264604+0000","last_clean":"2023-11-28T20:02:07.264604+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:02:07.279835+0000","last_undegraded":"2023-11-28T20:02:07.279835+0000","last_fullsized":"2023-11-28T20:02:07.279835+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_clean_scrub_stamp":"2023-11-28T20:02:07.264604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.f","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-28T20:02:07.301507+0000","last_change":"2023-11-28T20:02:07.295608+0000","last_active":"2023-11-28T20:02:07.301507+0000","last_peered":"2023-11-28T20:02:07.301507+0000","last_clean":"2023-11-28T20:02:07.301507+0000","last_became_active":"2023-11-28T20:02:07.295293+0000","last_became_peered":"2023-11-28T20:02:07.295293+0000","last_unstale":"2023-11-28T20:02:07.301507+0000","last_undegraded":"2023-11-28T20:02:07.301507+0000","last_fullsized":"2023-11-28T20:02:07.301507+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:06.257335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:06.257335+0000","last_clean_scrub_stamp":"2023-11-28T20:02:06.257335+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:32:46.550427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.d","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2023-11-28T20:02:07.288189+0000","last_change":"2023-11-28T20:02:07.288189+0000","last_active":"2023-11-28T20:02:07.264604+0000","last_peered":"2023-11-28T20:02:07.264604+0000","last_clean":"2023-11-28T20:02:07.264604+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:02:07.288189+0000","last_undegraded":"2023-11-28T20:02:07.288189+0000","last_fullsized":"2023-11-28T20:02:07.288189+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_clean_scrub_stamp":"2023-11-28T20:02:07.264604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.e","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-28T20:02:07.306531+0000","last_change":"2023-11-28T20:02:07.300742+0000","last_active":"2023-11-28T20:02:07.306531+0000","last_peered":"2023-11-28T20:02:07.306531+0000","last_clean":"2023-11-28T20:02:07.306531+0000","last_became_active":"2023-11-28T20:02:07.300392+0000","last_became_peered":"2023-11-28T20:02:07.300392+0000","last_unstale":"2023-11-28T20:02:07.306531+0000","last_undegraded":"2023-11-28T20:02:07.306531+0000","last_fullsized":"2023-11-28T20:02:07.306531+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:06.257335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:06.257335+0000","last_clean_scrub_stamp":"2023-11-28T20:02:06.257335+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T06:29:20.315585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.e","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2023-11-28T20:02:07.280313+0000","last_change":"2023-11-28T20:02:07.280313+0000","last_active":"2023-11-28T20:02:07.264604+0000","last_peered":"2023-11-28T20:02:07.264604+0000","last_clean":"2023-11-28T20:02:07.264604+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:02:07.280313+0000","last_undegraded":"2023-11-28T20:02:07.280313+0000","last_fullsized":"2023-11-28T20:02:07.280313+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_clean_scrub_stamp":"2023-11-28T20:02:07.264604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.d","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-28T20:02:07.305924+0000","last_change":"2023-11-28T20:02:07.301258+0000","last_active":"2023-11-28T20:02:07.305924+0000","last_peered":"2023-11-28T20:02:07.305924+0000","last_clean":"2023-11-28T20:02:07.305924+0000","last_became_active":"2023-11-28T20:02:07.300955+0000","last_became_peered":"2023-11-28T20:02:07.300955+0000","last_unstale":"2023-11-28T20:02:07.305924+0000","last_undegraded":"2023-11-28T20:02:07.305924+0000","last_fullsized":"2023-11-28T20:02:07.305924+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:06.257335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:06.257335+0000","last_clean_scrub_stamp":"2023-11-28T20:02:06.257335+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:03:27.733474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.8","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2023-11-28T20:02:07.279591+0000","last_change":"2023-11-28T20:02:07.279591+0000","last_active":"2023-11-28T20:02:07.264604+0000","last_peered":"2023-11-28T20:02:07.264604+0000","last_clean":"2023-11-28T20:02:07.264604+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:02:07.279591+0000","last_undegraded":"2023-11-28T20:02:07.279591+0000","last_fullsized":"2023-11-28T20:02:07.279591+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_clean_scrub_stamp":"2023-11-28T20:02:07.264604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.b","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-28T20:02:07.302648+0000","last_change":"2023-11-28T20:02:07.295857+0000","last_active":"2023-11-28T20:02:07.302648+0000","last_peered":"2023-11-28T20:02:07.302648+0000","last_clean":"2023-11-28T20:02:07.302648+0000","last_became_active":"2023-11-28T20:02:07.295642+0000","last_became_peered":"2023-11-28T20:02:07.295642+0000","last_unstale":"2023-11-28T20:02:07.302648+0000","last_undegraded":"2023-11-28T20:02:07.302648+0000","last_fullsized":"2023-11-28T20:02:07.302648+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:06.257335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:06.257335+0000","last_clean_scrub_stamp":"2023-11-28T20:02:06.257335+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:58:36.949904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.9","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2023-11-28T20:02:07.278282+0000","last_change":"2023-11-28T20:02:07.278282+0000","last_active":"2023-11-28T20:02:07.264604+0000","last_peered":"2023-11-28T20:02:07.264604+0000","last_clean":"2023-11-28T20:02:07.264604+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:02:07.278282+0000","last_undegraded":"2023-11-28T20:02:07.278282+0000","last_fullsized":"2023-11-28T20:02:07.278282+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_clean_scrub_stamp":"2023-11-28T20:02:07.264604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.a","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-28T20:02:07.299829+0000","last_change":"2023-11-28T20:02:07.296302+0000","last_active":"2023-11-28T20:02:07.299829+0000","last_peered":"2023-11-28T20:02:07.299829+0000","last_clean":"2023-11-28T20:02:07.299829+0000","last_became_active":"2023-11-28T20:02:07.296048+0000","last_became_peered":"2023-11-28T20:02:07.296048+0000","last_unstale":"2023-11-28T20:02:07.299829+0000","last_undegraded":"2023-11-28T20:02:07.299829+0000","last_fullsized":"2023-11-28T20:02:07.299829+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:06.257335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:06.257335+0000","last_clean_scrub_stamp":"2023-11-28T20:02:06.257335+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:01:27.566717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.a","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2023-11-28T20:02:07.279215+0000","last_change":"2023-11-28T20:02:07.279215+0000","last_active":"2023-11-28T20:02:07.264604+0000","last_peered":"2023-11-28T20:02:07.264604+0000","last_clean":"2023-11-28T20:02:07.264604+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:02:07.279215+0000","last_undegraded":"2023-11-28T20:02:07.279215+0000","last_fullsized":"2023-11-28T20:02:07.279215+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_clean_scrub_stamp":"2023-11-28T20:02:07.264604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.9","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-28T20:02:07.305776+0000","last_change":"2023-11-28T20:02:07.296576+0000","last_active":"2023-11-28T20:02:07.305776+0000","last_peered":"2023-11-28T20:02:07.305776+0000","last_clean":"2023-11-28T20:02:07.305776+0000","last_became_active":"2023-11-28T20:02:07.295982+0000","last_became_peered":"2023-11-28T20:02:07.295982+0000","last_unstale":"2023-11-28T20:02:07.305776+0000","last_undegraded":"2023-11-28T20:02:07.305776+0000","last_fullsized":"2023-11-28T20:02:07.305776+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:06.257335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:06.257335+0000","last_clean_scrub_stamp":"2023-11-28T20:02:06.257335+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:49:04.193812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.b","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2023-11-28T20:02:07.286137+0000","last_change":"2023-11-28T20:02:07.286137+0000","last_active":"2023-11-28T20:02:07.264604+0000","last_peered":"2023-11-28T20:02:07.264604+0000","last_clean":"2023-11-28T20:02:07.264604+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:02:07.286137+0000","last_undegraded":"2023-11-28T20:02:07.286137+0000","last_fullsized":"2023-11-28T20:02:07.286137+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_clean_scrub_stamp":"2023-11-28T20:02:07.264604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.8","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-28T20:02:07.297499+0000","last_change":"2023-11-28T20:02:07.293087+0000","last_active":"2023-11-28T20:02:07.297499+0000","last_peered":"2023-11-28T20:02:07.297499+0000","last_clean":"2023-11-28T20:02:07.297499+0000","last_became_active":"2023-11-28T20:02:07.292815+0000","last_became_peered":"2023-11-28T20:02:07.292815+0000","last_unstale":"2023-11-28T20:02:07.297499+0000","last_undegraded":"2023-11-28T20:02:07.297499+0000","last_fullsized":"2023-11-28T20:02:07.297499+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:06.257335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:06.257335+0000","last_clean_scrub_stamp":"2023-11-28T20:02:06.257335+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T06:11:16.542043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.4","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2023-11-28T20:02:07.287644+0000","last_change":"2023-11-28T20:02:07.287644+0000","last_active":"2023-11-28T20:02:07.264604+0000","last_peered":"2023-11-28T20:02:07.264604+0000","last_clean":"2023-11-28T20:02:07.264604+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:02:07.287644+0000","last_undegraded":"2023-11-28T20:02:07.287644+0000","last_fullsized":"2023-11-28T20:02:07.287644+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_clean_scrub_stamp":"2023-11-28T20:02:07.264604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.7","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-28T20:02:07.301899+0000","last_change":"2023-11-28T20:02:07.296980+0000","last_active":"2023-11-28T20:02:07.301899+0000","last_peered":"2023-11-28T20:02:07.301899+0000","last_clean":"2023-11-28T20:02:07.301899+0000","last_became_active":"2023-11-28T20:02:07.296625+0000","last_became_peered":"2023-11-28T20:02:07.296625+0000","last_unstale":"2023-11-28T20:02:07.301899+0000","last_undegraded":"2023-11-28T20:02:07.301899+0000","last_fullsized":"2023-11-28T20:02:07.301899+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:06.257335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:06.257335+0000","last_clean_scrub_stamp":"2023-11-28T20:02:06.257335+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:53:41.844853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.5","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2023-11-28T20:02:07.286312+0000","last_change":"2023-11-28T20:02:07.286312+0000","last_active":"2023-11-28T20:02:07.264604+0000","last_peered":"2023-11-28T20:02:07.264604+0000","last_clean":"2023-11-28T20:02:07.264604+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:02:07.286312+0000","last_undegraded":"2023-11-28T20:02:07.286312+0000","last_fullsized":"2023-11-28T20:02:07.286312+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_clean_scrub_stamp":"2023-11-28T20:02:07.264604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.6","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-28T20:02:07.298993+0000","last_change":"2023-11-28T20:02:07.296643+0000","last_active":"2023-11-28T20:02:07.298993+0000","last_peered":"2023-11-28T20:02:07.298993+0000","last_clean":"2023-11-28T20:02:07.298993+0000","last_became_active":"2023-11-28T20:02:07.296369+0000","last_became_peered":"2023-11-28T20:02:07.296369+0000","last_unstale":"2023-11-28T20:02:07.298993+0000","last_undegraded":"2023-11-28T20:02:07.298993+0000","last_fullsized":"2023-11-28T20:02:07.298993+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:06.257335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:06.257335+0000","last_clean_scrub_stamp":"2023-11-28T20:02:06.257335+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:52:33.501263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.6","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2023-11-28T20:02:07.284421+0000","last_change":"2023-11-28T20:02:07.284421+0000","last_active":"2023-11-28T20:02:07.264604+0000","last_peered":"2023-11-28T20:02:07.264604+0000","last_clean":"2023-11-28T20:02:07.264604+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:02:07.284421+0000","last_undegraded":"2023-11-28T20:02:07.284421+0000","last_fullsized":"2023-11-28T20:02:07.284421+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_clean_scrub_stamp":"2023-11-28T20:02:07.264604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.5","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-28T20:02:07.303244+0000","last_change":"2023-11-28T20:02:07.300054+0000","last_active":"2023-11-28T20:02:07.303244+0000","last_peered":"2023-11-28T20:02:07.303244+0000","last_clean":"2023-11-28T20:02:07.303244+0000","last_became_active":"2023-11-28T20:02:07.298610+0000","last_became_peered":"2023-11-28T20:02:07.298610+0000","last_unstale":"2023-11-28T20:02:07.303244+0000","last_undegraded":"2023-11-28T20:02:07.303244+0000","last_fullsized":"2023-11-28T20:02:07.303244+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:06.257335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:06.257335+0000","last_clean_scrub_stamp":"2023-11-28T20:02:06.257335+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:59:20.247089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.7","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2023-11-28T20:02:07.280140+0000","last_change":"2023-11-28T20:02:07.280140+0000","last_active":"2023-11-28T20:02:07.264604+0000","last_peered":"2023-11-28T20:02:07.264604+0000","last_clean":"2023-11-28T20:02:07.264604+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:02:07.280140+0000","last_undegraded":"2023-11-28T20:02:07.280140+0000","last_fullsized":"2023-11-28T20:02:07.280140+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_clean_scrub_stamp":"2023-11-28T20:02:07.264604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.4","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-28T20:02:07.303568+0000","last_change":"2023-11-28T20:02:07.301572+0000","last_active":"2023-11-28T20:02:07.303568+0000","last_peered":"2023-11-28T20:02:07.303568+0000","last_clean":"2023-11-28T20:02:07.303568+0000","last_became_active":"2023-11-28T20:02:07.301226+0000","last_became_peered":"2023-11-28T20:02:07.301226+0000","last_unstale":"2023-11-28T20:02:07.303568+0000","last_undegraded":"2023-11-28T20:02:07.303568+0000","last_fullsized":"2023-11-28T20:02:07.303568+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:06.257335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:06.257335+0000","last_clean_scrub_stamp":"2023-11-28T20:02:06.257335+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:48:42.567546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.0","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2023-11-28T20:02:07.281665+0000","last_change":"2023-11-28T20:02:07.281665+0000","last_active":"2023-11-28T20:02:07.264604+0000","last_peered":"2023-11-28T20:02:07.264604+0000","last_clean":"2023-11-28T20:02:07.264604+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:02:07.281665+0000","last_undegraded":"2023-11-28T20:02:07.281665+0000","last_fullsized":"2023-11-28T20:02:07.281665+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_clean_scrub_stamp":"2023-11-28T20:02:07.264604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.3","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-28T20:02:07.297690+0000","last_change":"2023-11-28T20:02:07.294264+0000","last_active":"2023-11-28T20:02:07.297690+0000","last_peered":"2023-11-28T20:02:07.297690+0000","last_clean":"2023-11-28T20:02:07.297690+0000","last_became_active":"2023-11-28T20:02:07.293763+0000","last_became_peered":"2023-11-28T20:02:07.293763+0000","last_unstale":"2023-11-28T20:02:07.297690+0000","last_undegraded":"2023-11-28T20:02:07.297690+0000","last_fullsized":"2023-11-28T20:02:07.297690+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:06.257335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:06.257335+0000","last_clean_scrub_stamp":"2023-11-28T20:02:06.257335+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:10:34.198054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.1","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2023-11-28T20:02:07.281971+0000","last_change":"2023-11-28T20:02:07.281971+0000","last_active":"2023-11-28T20:02:07.264604+0000","last_peered":"2023-11-28T20:02:07.264604+0000","last_clean":"2023-11-28T20:02:07.264604+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:02:07.281971+0000","last_undegraded":"2023-11-28T20:02:07.281971+0000","last_fullsized":"2023-11-28T20:02:07.281971+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_clean_scrub_stamp":"2023-11-28T20:02:07.264604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.2","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-28T20:02:07.305772+0000","last_change":"2023-11-28T20:02:07.299946+0000","last_active":"2023-11-28T20:02:07.305772+0000","last_peered":"2023-11-28T20:02:07.305772+0000","last_clean":"2023-11-28T20:02:07.305772+0000","last_became_active":"2023-11-28T20:02:07.299678+0000","last_became_peered":"2023-11-28T20:02:07.299678+0000","last_unstale":"2023-11-28T20:02:07.305772+0000","last_undegraded":"2023-11-28T20:02:07.305772+0000","last_fullsized":"2023-11-28T20:02:07.305772+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:06.257335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:06.257335+0000","last_clean_scrub_stamp":"2023-11-28T20:02:06.257335+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:46:58.325801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.2","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2023-11-28T20:02:07.284520+0000","last_change":"2023-11-28T20:02:07.284520+0000","last_active":"2023-11-28T20:02:07.264604+0000","last_peered":"2023-11-28T20:02:07.264604+0000","last_clean":"2023-11-28T20:02:07.264604+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:02:07.284520+0000","last_undegraded":"2023-11-28T20:02:07.284520+0000","last_fullsized":"2023-11-28T20:02:07.284520+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_clean_scrub_stamp":"2023-11-28T20:02:07.264604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-28T20:02:07.301562+0000","last_change":"2023-11-28T20:02:07.297766+0000","last_active":"2023-11-28T20:02:07.301562+0000","last_peered":"2023-11-28T20:02:07.301562+0000","last_clean":"2023-11-28T20:02:07.301562+0000","last_became_active":"2023-11-28T20:02:07.297403+0000","last_became_peered":"2023-11-28T20:02:07.297403+0000","last_unstale":"2023-11-28T20:02:07.301562+0000","last_undegraded":"2023-11-28T20:02:07.301562+0000","last_fullsized":"2023-11-28T20:02:07.301562+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:06.257335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:06.257335+0000","last_clean_scrub_stamp":"2023-11-28T20:02:06.257335+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T07:05:17.648805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.3","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2023-11-28T20:02:07.285711+0000","last_change":"2023-11-28T20:02:07.285711+0000","last_active":"2023-11-28T20:02:07.264604+0000","last_peered":"2023-11-28T20:02:07.264604+0000","last_clean":"2023-11-28T20:02:07.264604+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:02:07.285711+0000","last_undegraded":"2023-11-28T20:02:07.285711+0000","last_fullsized":"2023-11-28T20:02:07.285711+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_clean_scrub_stamp":"2023-11-28T20:02:07.264604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.0","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-28T20:02:07.306551+0000","last_change":"2023-11-28T20:02:07.300917+0000","last_active":"2023-11-28T20:02:07.306551+0000","last_peered":"2023-11-28T20:02:07.306551+0000","last_clean":"2023-11-28T20:02:07.306551+0000","last_became_active":"2023-11-28T20:02:07.300632+0000","last_became_peered":"2023-11-28T20:02:07.300632+0000","last_unstale":"2023-11-28T20:02:07.306551+0000","last_undegraded":"2023-11-28T20:02:07.306551+0000","last_fullsized":"2023-11-28T20:02:07.306551+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:06.257335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:06.257335+0000","last_clean_scrub_stamp":"2023-11-28T20:02:06.257335+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:10:34.198054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.f","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2023-11-28T20:02:07.288389+0000","last_change":"2023-11-28T20:02:07.288389+0000","last_active":"2023-11-28T20:02:07.264604+0000","last_peered":"2023-11-28T20:02:07.264604+0000","last_clean":"2023-11-28T20:02:07.264604+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:02:07.288389+0000","last_undegraded":"2023-11-28T20:02:07.288389+0000","last_fullsized":"2023-11-28T20:02:07.288389+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_clean_scrub_stamp":"2023-11-28T20:02:07.264604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.c","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-28T20:02:07.300002+0000","last_change":"2023-11-28T20:02:07.293843+0000","last_active":"2023-11-28T20:02:07.300002+0000","last_peered":"2023-11-28T20:02:07.300002+0000","last_clean":"2023-11-28T20:02:07.300002+0000","last_became_active":"2023-11-28T20:02:07.293538+0000","last_became_peered":"2023-11-28T20:02:07.293538+0000","last_unstale":"2023-11-28T20:02:07.300002+0000","last_undegraded":"2023-11-28T20:02:07.300002+0000","last_fullsized":"2023-11-28T20:02:07.300002+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:06.257335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:06.257335+0000","last_clean_scrub_stamp":"2023-11-28T20:02:06.257335+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T07:05:17.648805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":215,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-28T20:02:06.276288+0000","last_change":"2023-11-28T19:58:56.136501+0000","last_active":"2023-11-28T20:02:06.276288+0000","last_peered":"2023-11-28T20:02:06.276288+0000","last_clean":"2023-11-28T20:02:06.276288+0000","last_became_active":"2023-11-28T19:58:56.135998+0000","last_became_peered":"2023-11-28T19:58:56.135998+0000","last_unstale":"2023-11-28T20:02:06.276288+0000","last_undegraded":"2023-11-28T20:02:06.276288+0000","last_fullsized":"2023-11-28T20:02:06.276288+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:58:54.602349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:58:54.602349+0000","last_clean_scrub_stamp":"2023-11-28T19:58:54.602349+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:33:42.723349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":13,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":14,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":66748,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574891,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32200,"kb_used_data":1016,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339640,"statfs":{"total":96636764160,"available":96603791360,"internally_reserved":0,"allocated":1040384,"data_stored":1046204,"data_compressed":33374,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 20:01:59 2023","interfaces":[{"interface":"back","average":{"1min":0.66000000000000003,"5min":0.67100000000000004,"15min":0.67600000000000005},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.94299999999999995,"5min":0.94299999999999995,"15min":0.94299999999999995},"last":0.71299999999999997},{"interface":"front","average":{"1min":0.66500000000000004,"5min":0.67000000000000004,"15min":0.68000000000000005},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":1.014,"5min":1.014,"15min":1.014},"last":0.73199999999999998}]},{"osd":1,"last update":"Tue Nov 28 20:01:59 2023","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.63900000000000001,"15min":0.64300000000000002},"min":{"1min":0.46100000000000002,"5min":0.438,"15min":0.438},"max":{"1min":0.95099999999999996,"5min":0.95099999999999996,"15min":0.95099999999999996},"last":0.621},{"interface":"front","average":{"1min":0.66400000000000003,"5min":0.68100000000000005,"15min":0.69499999999999995},"min":{"1min":0.45600000000000002,"5min":0.432,"15min":0.432},"max":{"1min":0.85099999999999998,"5min":1.0900000000000001,"15min":1.0900000000000001},"last":0.59199999999999997}]},{"osd":2,"last update":"Tue Nov 28 20:01:59 2023","interfaces":[{"interface":"back","average":{"1min":0.69899999999999995,"5min":0.70899999999999996,"15min":0.72599999999999998},"min":{"1min":0.497,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.93100000000000005,"5min":0.98799999999999999,"15min":0.98799999999999999},"last":0.84099999999999997},{"interface":"front","average":{"1min":0.66800000000000004,"5min":0.68799999999999994,"15min":0.69999999999999996},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":1.514,"5min":1.514,"15min":1.514},"last":0.53200000000000003}]},{"osd":3,"last update":"Tue Nov 28 20:01:59 2023","interfaces":[{"interface":"back","average":{"1min":0.68200000000000005,"5min":0.69699999999999995,"15min":0.69899999999999995},"min":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":0.90200000000000002,"5min":1.0449999999999999,"15min":1.0449999999999999},"last":0.69299999999999995},{"interface":"front","average":{"1min":0.70899999999999996,"5min":0.76600000000000001,"15min":0.78400000000000003},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":1.034,"5min":1.1299999999999999,"15min":1.1299999999999999},"last":0.79300000000000004}]},{"osd":4,"last update":"Tue Nov 28 20:01:59 2023","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.628,"15min":0.63700000000000001},"min":{"1min":0.38900000000000001,"5min":0.378,"15min":0.378},"max":{"1min":1.2829999999999999,"5min":1.2829999999999999,"15min":1.2829999999999999},"last":0.65800000000000003},{"interface":"front","average":{"1min":0.66800000000000004,"5min":0.70899999999999996,"15min":0.72499999999999998},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.91800000000000004,"5min":1.1120000000000001,"15min":1.1120000000000001},"last":0.82199999999999995}]},{"osd":5,"last update":"Tue Nov 28 20:01:59 2023","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.65300000000000002,"15min":0.67400000000000004},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.97999999999999998,"5min":1.1699999999999999,"15min":1.1699999999999999},"last":0.751},{"interface":"front","average":{"1min":0.70899999999999996,"5min":0.73699999999999999,"15min":0.75600000000000001},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":1.3300000000000001,"5min":1.3300000000000001,"15min":1.3300000000000001},"last":0.76700000000000002}]},{"osd":6,"last update":"Tue Nov 28 20:01:59 2023","interfaces":[{"interface":"back","average":{"1min":0.76000000000000001,"5min":0.76400000000000001,"15min":0.77600000000000002},"min":{"1min":0.53500000000000003,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":1.3919999999999999,"5min":1.3919999999999999,"15min":1.3919999999999999},"last":0.85899999999999999},{"interface":"front","average":{"1min":0.67000000000000004,"5min":0.71199999999999997,"15min":0.73499999999999999},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.96099999999999997,"5min":1.23,"15min":1.23},"last":0.88600000000000001}]}]},{"osd":6,"up_from":13,"seq":55834574889,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27976,"kb_used_data":952,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343864,"statfs":{"total":96636764160,"available":96608116736,"internally_reserved":0,"allocated":974848,"data_stored":455836,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 20:01:54 2023","interfaces":[{"interface":"back","average":{"1min":0.64000000000000001,"5min":0.621,"15min":0.61699999999999999},"min":{"1min":0.40200000000000002,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.91600000000000004,"5min":0.91600000000000004,"15min":0.91600000000000004},"last":0.627},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.66000000000000003,"15min":0.66200000000000003},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":0.80600000000000005,"5min":0.98999999999999999,"15min":0.98999999999999999},"last":0.68000000000000005}]},{"osd":1,"last update":"Tue Nov 28 20:01:54 2023","interfaces":[{"interface":"back","average":{"1min":0.71499999999999997,"5min":0.76600000000000001,"15min":0.78200000000000003},"min":{"1min":0.54700000000000004,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.012,"5min":1.105,"15min":1.105},"last":0.78300000000000003},{"interface":"front","average":{"1min":0.62,"5min":0.67600000000000005,"15min":0.68300000000000005},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":0.90200000000000002,"5min":0.95899999999999996,"15min":0.95899999999999996},"last":0.60899999999999999}]},{"osd":2,"last update":"Tue Nov 28 20:01:54 2023","interfaces":[{"interface":"back","average":{"1min":0.63800000000000001,"5min":0.68200000000000005,"15min":0.69399999999999995},"min":{"1min":0.502,"5min":0.502,"15min":0.502},"max":{"1min":0.78900000000000003,"5min":0.93400000000000005,"15min":0.93400000000000005},"last":0.66900000000000004},{"interface":"front","average":{"1min":0.65800000000000003,"5min":0.70399999999999996,"15min":0.71399999999999997},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":0.95299999999999996,"5min":1.006,"15min":1.006},"last":0.69999999999999996}]},{"osd":3,"last update":"Tue Nov 28 20:01:54 2023","interfaces":[{"interface":"back","average":{"1min":0.68300000000000005,"5min":0.72799999999999998,"15min":0.74199999999999999},"min":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":0.96699999999999997,"5min":1.056,"15min":1.056},"last":0.80600000000000005},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.66600000000000004,"15min":0.67800000000000005},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":0.78200000000000003,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.63900000000000001}]},{"osd":4,"last update":"Tue Nov 28 20:01:54 2023","interfaces":[{"interface":"back","average":{"1min":0.61299999999999999,"5min":0.624,"15min":0.628},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.93300000000000005,"5min":0.97599999999999998,"15min":0.97599999999999998},"last":0.55400000000000005},{"interface":"front","average":{"1min":0.61499999999999999,"5min":0.68700000000000006,"15min":0.72099999999999997},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.91700000000000004,"5min":1.389,"15min":1.389},"last":0.71399999999999997}]},{"osd":5,"last update":"Tue Nov 28 20:01:54 2023","interfaces":[{"interface":"back","average":{"1min":0.68799999999999994,"5min":0.77100000000000002,"15min":0.80100000000000005},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":1.0629999999999999,"5min":1.4259999999999999,"15min":1.4259999999999999},"last":0.749},{"interface":"front","average":{"1min":0.65600000000000003,"5min":0.72999999999999998,"15min":0.752},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.97099999999999997,"5min":1.276,"15min":1.276},"last":0.65600000000000003}]},{"osd":7,"last update":"Tue Nov 28 20:01:54 2023","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.67900000000000005,"15min":0.70299999999999996},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.84199999999999997,"5min":1.014,"15min":1.014},"last":0.58299999999999996},{"interface":"front","average":{"1min":0.68200000000000005,"5min":0.77900000000000003,"15min":0.81299999999999994},"min":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":1.002,"5min":1.242,"15min":1.242},"last":0.73599999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574891,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32136,"kb_used_data":952,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339704,"statfs":{"total":96636764160,"available":96603856896,"internally_reserved":0,"allocated":974848,"data_stored":455836,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 20:01:59 2023","interfaces":[{"interface":"back","average":{"1min":0.66500000000000004,"5min":0.68400000000000005,"15min":0.70099999999999996},"min":{"1min":0.44400000000000001,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":1.077,"5min":1.077,"15min":1.077},"last":0.56100000000000005},{"interface":"front","average":{"1min":0.65300000000000002,"5min":0.68500000000000005,"15min":0.70699999999999996},"min":{"1min":0.41899999999999998,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.94599999999999995,"5min":1.149,"15min":1.149},"last":0.67800000000000005}]},{"osd":1,"last update":"Tue Nov 28 20:01:59 2023","interfaces":[{"interface":"back","average":{"1min":0.626,"5min":0.68600000000000005,"15min":0.70399999999999996},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.82599999999999996,"5min":0.94499999999999995,"15min":0.94499999999999995},"last":0.63100000000000001},{"interface":"front","average":{"1min":0.67400000000000004,"5min":0.69299999999999995,"15min":0.71699999999999997},"min":{"1min":0.49099999999999999,"5min":0.38,"15min":0.38},"max":{"1min":1.008,"5min":1.0940000000000001,"15min":1.0940000000000001},"last":0.52200000000000002}]},{"osd":2,"last update":"Tue Nov 28 20:01:59 2023","interfaces":[{"interface":"back","average":{"1min":0.65400000000000003,"5min":0.83299999999999996,"15min":0.90800000000000003},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":1.044,"5min":5.0880000000000001,"15min":5.0880000000000001},"last":0.83099999999999996},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.879,"15min":0.96099999999999997},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":0.91300000000000003,"5min":5.1399999999999997,"15min":5.1399999999999997},"last":0.76200000000000001}]},{"osd":3,"last update":"Tue Nov 28 20:01:59 2023","interfaces":[{"interface":"back","average":{"1min":0.71499999999999997,"5min":0.90100000000000002,"15min":0.98499999999999999},"min":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":1.1000000000000001,"5min":5.0469999999999997,"15min":5.0469999999999997},"last":0.92900000000000005},{"interface":"front","average":{"1min":0.69999999999999996,"5min":0.878,"15min":0.95999999999999996},"min":{"1min":0.47899999999999998,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":0.95899999999999996,"5min":5.024,"15min":5.024},"last":0.80600000000000005}]},{"osd":4,"last update":"Tue Nov 28 20:01:59 2023","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.64000000000000001,"15min":0.66400000000000003},"min":{"1min":0.42899999999999999,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.877,"5min":1.4810000000000001,"15min":1.4810000000000001},"last":0.71399999999999997},{"interface":"front","average":{"1min":0.67300000000000004,"5min":0.72099999999999997,"15min":0.73799999999999999},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.97599999999999998,"5min":1.6339999999999999,"15min":1.6339999999999999},"last":0.88300000000000001}]},{"osd":6,"last update":"Tue Nov 28 20:01:59 2023","interfaces":[{"interface":"back","average":{"1min":0.70699999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"min":{"1min":0.48399999999999999,"5min":0.434,"15min":0.434},"max":{"1min":1.0489999999999999,"5min":1.0489999999999999,"15min":1.0489999999999999},"last":0.86099999999999999},{"interface":"front","average":{"1min":0.68899999999999995,"5min":0.72499999999999998,"15min":0.73999999999999999},"min":{"1min":0.47599999999999998,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":0.93200000000000005,"5min":1.099,"15min":1.099},"last":0.90400000000000003}]},{"osd":7,"last update":"Tue Nov 28 20:01:59 2023","interfaces":[{"interface":"back","average":{"1min":0.73599999999999999,"5min":0.77300000000000002,"15min":0.78200000000000003},"min":{"1min":0.48899999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":1.022,"5min":1.236,"15min":1.236},"last":0.96099999999999997},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.78300000000000003,"15min":0.79500000000000004},"min":{"1min":0.51100000000000001,"5min":0.505,"15min":0.505},"max":{"1min":1.1000000000000001,"5min":1.1000000000000001,"15min":1.1000000000000001},"last":0.94499999999999995}]}]},{"osd":4,"up_from":13,"seq":55834574890,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32136,"kb_used_data":952,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339704,"statfs":{"total":96636764160,"available":96603856896,"internally_reserved":0,"allocated":974848,"data_stored":455836,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 20:01:58 2023","interfaces":[{"interface":"back","average":{"1min":0.70799999999999996,"5min":0.69399999999999995,"15min":0.70499999999999996},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":1.107,"5min":1.107,"15min":1.107},"last":0.55600000000000005},{"interface":"front","average":{"1min":0.63200000000000001,"5min":0.68300000000000005,"15min":0.70299999999999996},"min":{"1min":0.42799999999999999,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":1.024,"5min":1.163,"15min":1.163},"last":0.53000000000000003}]},{"osd":1,"last update":"Tue Nov 28 20:01:58 2023","interfaces":[{"interface":"back","average":{"1min":0.64400000000000002,"5min":0.71199999999999997,"15min":0.746},"min":{"1min":0.432,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.93799999999999994,"5min":1.111,"15min":1.111},"last":0.41499999999999998},{"interface":"front","average":{"1min":0.77600000000000002,"5min":0.78000000000000003,"15min":0.80200000000000005},"min":{"1min":0.629,"5min":0.443,"15min":0.443},"max":{"1min":1.0640000000000001,"5min":1.238,"15min":1.238},"last":0.60299999999999998}]},{"osd":2,"last update":"Tue Nov 28 20:01:58 2023","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.751,"15min":0.77200000000000002},"min":{"1min":0.48599999999999999,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":1.026,"5min":1.0669999999999999,"15min":1.0669999999999999},"last":0.73699999999999999},{"interface":"front","average":{"1min":0.754,"5min":0.77400000000000002,"15min":0.80200000000000005},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":1.1359999999999999,"5min":1.1359999999999999,"15min":1.1359999999999999},"last":0.71699999999999997}]},{"osd":3,"last update":"Tue Nov 28 20:01:58 2023","interfaces":[{"interface":"back","average":{"1min":0.69199999999999995,"5min":0.74399999999999999,"15min":0.78200000000000003},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":0.97999999999999998,"5min":1.202,"15min":1.202},"last":0.57899999999999996},{"interface":"front","average":{"1min":0.74199999999999999,"5min":0.76100000000000001,"15min":0.78400000000000003},"min":{"1min":0.52800000000000002,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":1.0669999999999999,"5min":1.0669999999999999,"15min":1.0669999999999999},"last":0.66400000000000003}]},{"osd":5,"last update":"Tue Nov 28 20:01:58 2023","interfaces":[{"interface":"back","average":{"1min":0.68600000000000005,"5min":0.69499999999999995,"15min":0.71399999999999997},"min":{"1min":0.41199999999999998,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.89600000000000002,"5min":0.95899999999999996,"15min":0.95899999999999996},"last":0.44400000000000001},{"interface":"front","average":{"1min":0.65600000000000003,"5min":0.68400000000000005,"15min":0.70399999999999996},"min":{"1min":0.435,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.90500000000000003,"5min":1.034,"15min":1.034},"last":0.625}]},{"osd":6,"last update":"Tue Nov 28 20:01:58 2023","interfaces":[{"interface":"back","average":{"1min":0.64500000000000002,"5min":0.69099999999999995,"15min":0.71999999999999997},"min":{"1min":0.45300000000000001,"5min":0.438,"15min":0.438},"max":{"1min":0.85299999999999998,"5min":1.0309999999999999,"15min":1.0309999999999999},"last":0.78900000000000003},{"interface":"front","average":{"1min":0.76300000000000001,"5min":0.76600000000000001,"15min":0.77800000000000002},"min":{"1min":0.55400000000000005,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":0.93999999999999995,"5min":1.002,"15min":1.002},"last":0.64500000000000002}]},{"osd":7,"last update":"Tue Nov 28 20:01:58 2023","interfaces":[{"interface":"back","average":{"1min":0.72699999999999998,"5min":0.75900000000000001,"15min":0.77800000000000002},"min":{"1min":0.57399999999999995,"5min":0.495,"15min":0.495},"max":{"1min":1.089,"5min":1.089,"15min":1.089},"last":0.69399999999999995},{"interface":"front","average":{"1min":0.81599999999999995,"5min":0.83699999999999997,"15min":0.85899999999999999},"min":{"1min":0.621,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":1.042,"5min":1.1459999999999999,"15min":1.1459999999999999},"last":0.76700000000000002}]}]},{"osd":3,"up_from":13,"seq":55834574891,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32136,"kb_used_data":952,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339704,"statfs":{"total":96636764160,"available":96603856896,"internally_reserved":0,"allocated":974848,"data_stored":455836,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 20:01:56 2023","interfaces":[{"interface":"back","average":{"1min":0.44900000000000001,"5min":0.441,"15min":0.44500000000000001},"min":{"1min":0.26300000000000001,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":1.7130000000000001,"5min":1.7130000000000001,"15min":1.7130000000000001},"last":0.38},{"interface":"front","average":{"1min":0.51400000000000001,"5min":0.46600000000000003,"15min":0.47099999999999997},"min":{"1min":0.27100000000000002,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":3.0630000000000002,"5min":3.0630000000000002,"15min":3.0630000000000002},"last":0.48799999999999999}]},{"osd":1,"last update":"Tue Nov 28 20:01:56 2023","interfaces":[{"interface":"back","average":{"1min":0.44600000000000001,"5min":0.45800000000000002,"15min":0.47399999999999998},"min":{"1min":0.317,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.89200000000000002,"5min":0.89200000000000002,"15min":0.89200000000000002},"last":0.50600000000000001},{"interface":"front","average":{"1min":0.65600000000000003,"5min":0.52200000000000002,"15min":0.51000000000000001},"min":{"1min":0.34200000000000003,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":5.8920000000000003,"5min":5.8920000000000003,"15min":5.8920000000000003},"last":0.33800000000000002}]},{"osd":2,"last update":"Tue Nov 28 20:01:56 2023","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.54800000000000004,"15min":0.53800000000000003},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":4.6390000000000002,"5min":4.6390000000000002,"15min":4.6390000000000002},"last":0.36199999999999999},{"interface":"front","average":{"1min":0.95099999999999996,"5min":0.63900000000000001,"15min":0.60299999999999998},"min":{"1min":0.40899999999999997,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":11.593,"5min":11.593,"15min":11.593},"last":0.53500000000000003}]},{"osd":4,"last update":"Tue Nov 28 20:01:56 2023","interfaces":[{"interface":"back","average":{"1min":0.91100000000000003,"5min":0.79400000000000004,"15min":0.77200000000000002},"min":{"1min":0.46600000000000003,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":5.5549999999999997,"5min":5.5549999999999997,"15min":5.5549999999999997},"last":0.91200000000000003},{"interface":"front","average":{"1min":1.179,"5min":0.879,"15min":0.82799999999999996},"min":{"1min":0.60999999999999999,"5min":0.503,"15min":0.503},"max":{"1min":11.747,"5min":11.747,"15min":11.747},"last":0.93300000000000005}]},{"osd":5,"last update":"Tue Nov 28 20:01:56 2023","interfaces":[{"interface":"back","average":{"1min":1.1040000000000001,"5min":0.85699999999999998,"15min":0.81899999999999995},"min":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":11.705,"5min":11.705,"15min":11.705},"last":0.78700000000000003},{"interface":"front","average":{"1min":0.70399999999999996,"5min":0.77100000000000002,"15min":0.79200000000000004},"min":{"1min":0.51200000000000001,"5min":0.495,"15min":0.495},"max":{"1min":1.0580000000000001,"5min":1.3100000000000001,"15min":1.3100000000000001},"last":0.88500000000000001}]},{"osd":6,"last update":"Tue Nov 28 20:01:56 2023","interfaces":[{"interface":"back","average":{"1min":0.748,"5min":0.81899999999999995,"15min":0.83499999999999996},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":1.6639999999999999,"5min":1.6639999999999999,"15min":1.6639999999999999},"last":0.83199999999999996},{"interface":"front","average":{"1min":0.84499999999999997,"5min":0.80400000000000005,"15min":0.76700000000000002},"min":{"1min":0.52900000000000003,"5min":0.495,"15min":0.495},"max":{"1min":3.1459999999999999,"5min":4.0679999999999996,"15min":4.0679999999999996},"last":0.95299999999999996}]},{"osd":7,"last update":"Tue Nov 28 20:01:56 2023","interfaces":[{"interface":"back","average":{"1min":0.96199999999999997,"5min":0.89600000000000002,"15min":0.86499999999999999},"min":{"1min":0.52100000000000002,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":6.6619999999999999,"5min":6.6619999999999999,"15min":6.6619999999999999},"last":1.016},{"interface":"front","average":{"1min":1.141,"5min":0.92300000000000004,"15min":0.90100000000000002},"min":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":11.782,"5min":11.782,"15min":11.782},"last":0.89800000000000002}]}]},{"osd":2,"up_from":13,"seq":55834574889,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27976,"kb_used_data":952,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343864,"statfs":{"total":96636764160,"available":96608116736,"internally_reserved":0,"allocated":974848,"data_stored":455836,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 20:01:57 2023","interfaces":[{"interface":"back","average":{"1min":0.39600000000000002,"5min":0.438,"15min":0.45000000000000001},"min":{"1min":0.28899999999999998,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.60399999999999998,"5min":0.74099999999999999,"15min":0.74099999999999999},"last":0.255},{"interface":"front","average":{"1min":0.435,"5min":0.46100000000000002,"15min":0.47499999999999998},"min":{"1min":0.30199999999999999,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.59599999999999997,"5min":0.67700000000000005,"15min":0.67700000000000005},"last":0.29499999999999998}]},{"osd":1,"last update":"Tue Nov 28 20:01:57 2023","interfaces":[{"interface":"back","average":{"1min":0.47699999999999998,"5min":0.48999999999999999,"15min":0.50600000000000001},"min":{"1min":0.377,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.64500000000000002,"5min":1.0389999999999999,"15min":1.0389999999999999},"last":0.41499999999999998},{"interface":"front","average":{"1min":0.45100000000000001,"5min":0.47999999999999998,"15min":0.496},"min":{"1min":0.33800000000000002,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.58999999999999997,"5min":0.70999999999999996,"15min":0.70999999999999996},"last":0.45200000000000001}]},{"osd":3,"last update":"Tue Nov 28 20:01:57 2023","interfaces":[{"interface":"back","average":{"1min":0.45700000000000002,"5min":0.46300000000000002,"15min":0.46899999999999997},"min":{"1min":0.36899999999999999,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.60299999999999998,"5min":0.629,"15min":0.629},"last":0.32200000000000001},{"interface":"front","average":{"1min":0.52300000000000002,"5min":0.55900000000000005,"15min":0.58099999999999996},"min":{"1min":0.41599999999999998,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.58899999999999997,"5min":0.98499999999999999,"15min":0.98499999999999999},"last":0.47199999999999998}]},{"osd":4,"last update":"Tue Nov 28 20:01:57 2023","interfaces":[{"interface":"back","average":{"1min":0.69399999999999995,"5min":0.80300000000000005,"15min":0.84199999999999997},"min":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":0.86899999999999999,"5min":1.139,"15min":1.139},"last":0.60199999999999998},{"interface":"front","average":{"1min":0.70199999999999996,"5min":0.79600000000000004,"15min":0.83399999999999996},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":1.008,"5min":1.238,"15min":1.238},"last":0.68600000000000005}]},{"osd":5,"last update":"Tue Nov 28 20:01:57 2023","interfaces":[{"interface":"back","average":{"1min":0.70799999999999996,"5min":0.81200000000000006,"15min":0.85999999999999999},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":1.0389999999999999,"5min":1.6180000000000001,"15min":1.6180000000000001},"last":0.55300000000000005},{"interface":"front","average":{"1min":0.70699999999999996,"5min":0.78400000000000003,"15min":0.81799999999999995},"min":{"1min":0.51800000000000002,"5min":0.496,"15min":0.496},"max":{"1min":1.0149999999999999,"5min":1.339,"15min":1.339},"last":0.53300000000000003}]},{"osd":6,"last update":"Tue Nov 28 20:01:57 2023","interfaces":[{"interface":"back","average":{"1min":0.71399999999999997,"5min":0.77300000000000002,"15min":0.79500000000000004},"min":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":1.0589999999999999,"5min":1.1839999999999999,"15min":1.1839999999999999},"last":0.57099999999999995},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.80300000000000005,"15min":0.84199999999999997},"min":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":0.98699999999999999,"5min":1.099,"15min":1.099},"last":0.70899999999999996}]},{"osd":7,"last update":"Tue Nov 28 20:01:57 2023","interfaces":[{"interface":"back","average":{"1min":0.69599999999999995,"5min":0.82199999999999995,"15min":0.86699999999999999},"min":{"1min":0.53300000000000003,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":0.94699999999999995,"5min":1.4590000000000001,"15min":1.4590000000000001},"last":0.66200000000000003},{"interface":"front","average":{"1min":0.73199999999999998,"5min":0.80900000000000005,"15min":0.84699999999999998},"min":{"1min":0.55200000000000005,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":1.0760000000000001,"5min":1.387,"15min":1.387},"last":0.76200000000000001}]}]},{"osd":1,"up_from":13,"seq":55834574891,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32136,"kb_used_data":952,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339704,"statfs":{"total":96636764160,"available":96603856896,"internally_reserved":0,"allocated":974848,"data_stored":455836,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 20:02:00 2023","interfaces":[{"interface":"back","average":{"1min":0.38700000000000001,"5min":0.54600000000000004,"15min":0.62},"min":{"1min":0.249,"5min":0.249,"15min":0.249},"max":{"1min":0.60699999999999998,"5min":3.8740000000000001,"15min":3.8740000000000001},"last":0.39400000000000002},{"interface":"front","average":{"1min":0.42099999999999999,"5min":0.51000000000000001,"15min":0.55100000000000005},"min":{"1min":0.32300000000000001,"5min":0.25,"15min":0.25},"max":{"1min":0.60399999999999998,"5min":2.0760000000000001,"15min":2.0760000000000001},"last":0.495}]},{"osd":2,"last update":"Tue Nov 28 20:02:00 2023","interfaces":[{"interface":"back","average":{"1min":0.41399999999999998,"5min":0.56000000000000005,"15min":0.626},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.70799999999999996,"5min":3.7320000000000002,"15min":3.7320000000000002},"last":0.377},{"interface":"front","average":{"1min":0.46899999999999997,"5min":0.63400000000000001,"15min":0.71799999999999997},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.67000000000000004,"5min":3.9089999999999998,"15min":3.9089999999999998},"last":0.436}]},{"osd":3,"last update":"Tue Nov 28 20:02:00 2023","interfaces":[{"interface":"back","average":{"1min":0.52200000000000002,"5min":0.61799999999999999,"15min":0.66000000000000003},"min":{"1min":0.436,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.70799999999999996,"5min":1.6399999999999999,"15min":1.6399999999999999},"last":0.50800000000000001},{"interface":"front","average":{"1min":0.45500000000000002,"5min":0.61599999999999999,"15min":0.67400000000000004},"min":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.625,"5min":2.5270000000000001,"15min":2.5270000000000001},"last":0.52100000000000002}]},{"osd":4,"last update":"Tue Nov 28 20:02:00 2023","interfaces":[{"interface":"back","average":{"1min":0.69799999999999995,"5min":0.81699999999999995,"15min":0.86899999999999999},"min":{"1min":0.42199999999999999,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.91400000000000003,"5min":3.1659999999999999,"15min":3.1659999999999999},"last":0.61899999999999999},{"interface":"front","average":{"1min":0.69699999999999995,"5min":0.84399999999999997,"15min":0.91200000000000003},"min":{"1min":0.52300000000000002,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.94299999999999995,"5min":3.7959999999999998,"15min":3.7959999999999998},"last":0.69899999999999995}]},{"osd":5,"last update":"Tue Nov 28 20:02:00 2023","interfaces":[{"interface":"back","average":{"1min":0.71399999999999997,"5min":0.875,"15min":0.95099999999999996},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":1.004,"5min":4.1479999999999997,"15min":4.1479999999999997},"last":0.60999999999999999},{"interface":"front","average":{"1min":0.69799999999999995,"5min":0.82599999999999996,"15min":0.88200000000000001},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":0.87,"5min":3.5569999999999999,"15min":3.5569999999999999},"last":0.65200000000000002}]},{"osd":6,"last update":"Tue Nov 28 20:02:00 2023","interfaces":[{"interface":"back","average":{"1min":0.72399999999999998,"5min":0.88800000000000001,"15min":0.95699999999999996},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":0.94499999999999995,"5min":2.863,"15min":2.863},"last":0.63200000000000001},{"interface":"front","average":{"1min":0.76800000000000002,"5min":0.89800000000000002,"15min":0.95399999999999996},"min":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":0.97999999999999998,"5min":3.371,"15min":3.371},"last":0.71799999999999997}]},{"osd":7,"last update":"Tue Nov 28 20:02:00 2023","interfaces":[{"interface":"back","average":{"1min":0.70299999999999996,"5min":0.89100000000000001,"15min":0.97199999999999998},"min":{"1min":0.53100000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":0.93600000000000005,"5min":3.8439999999999999,"15min":3.8439999999999999},"last":0.76200000000000001},{"interface":"front","average":{"1min":0.68799999999999994,"5min":0.90500000000000003,"15min":0.99299999999999999},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.95899999999999996,"5min":3.9689999999999999,"15min":3.9689999999999999},"last":0.72499999999999998}]}]},{"osd":0,"up_from":13,"seq":55834574890,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32196,"kb_used_data":1016,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339644,"statfs":{"total":96636764160,"available":96603795456,"internally_reserved":0,"allocated":1040384,"data_stored":1046204,"data_compressed":33374,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Nov 28 20:01:57 2023","interfaces":[{"interface":"back","average":{"1min":0.38700000000000001,"5min":0.57399999999999995,"15min":0.65100000000000002},"min":{"1min":0.24099999999999999,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":0.68400000000000005,"5min":4.883,"15min":4.883},"last":0.35299999999999998},{"interface":"front","average":{"1min":0.43099999999999999,"5min":0.70099999999999996,"15min":0.81899999999999995},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.66800000000000004,"5min":8.0800000000000001,"15min":8.0800000000000001},"last":0.40500000000000003}]},{"osd":2,"last update":"Tue Nov 28 20:01:57 2023","interfaces":[{"interface":"back","average":{"1min":0.50800000000000001,"5min":0.77400000000000002,"15min":0.90700000000000003},"min":{"1min":0.312,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.85599999999999998,"5min":8.1029999999999998,"15min":8.1029999999999998},"last":0.39200000000000002},{"interface":"front","average":{"1min":0.53300000000000003,"5min":0.79400000000000004,"15min":0.92200000000000004},"min":{"1min":0.40600000000000003,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.748,"5min":8.1310000000000002,"15min":8.1310000000000002},"last":0.48999999999999999}]},{"osd":3,"last update":"Tue Nov 28 20:01:57 2023","interfaces":[{"interface":"back","average":{"1min":0.47299999999999998,"5min":0.628,"15min":0.70699999999999996},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.873,"5min":4.3949999999999996,"15min":4.3949999999999996},"last":0.42399999999999999},{"interface":"front","average":{"1min":0.497,"5min":0.65100000000000002,"15min":0.72099999999999997},"min":{"1min":0.37,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.89200000000000002,"5min":4.3470000000000004,"15min":4.3470000000000004},"last":0.45700000000000002}]},{"osd":4,"last update":"Tue Nov 28 20:01:57 2023","interfaces":[{"interface":"back","average":{"1min":0.72799999999999998,"5min":0.92000000000000004,"15min":1.0069999999999999},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":1.038,"5min":4.6360000000000001,"15min":4.6360000000000001},"last":0.76200000000000001},{"interface":"front","average":{"1min":0.76800000000000002,"5min":0.93400000000000005,"15min":1.0129999999999999},"min":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":1.0820000000000001,"5min":4.4710000000000001,"15min":4.4710000000000001},"last":0.69099999999999995}]},{"osd":5,"last update":"Tue Nov 28 20:01:57 2023","interfaces":[{"interface":"back","average":{"1min":0.72599999999999998,"5min":0.93200000000000005,"15min":1.02},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":0.97599999999999998,"5min":4.6120000000000001,"15min":4.6120000000000001},"last":0.75},{"interface":"front","average":{"1min":0.78600000000000003,"5min":0.93600000000000005,"15min":1.0129999999999999},"min":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.1319999999999999,"5min":4.5449999999999999,"15min":4.5449999999999999},"last":0.82699999999999996}]},{"osd":6,"last update":"Tue Nov 28 20:01:57 2023","interfaces":[{"interface":"back","average":{"1min":0.755,"5min":0.94499999999999995,"15min":1.034},"min":{"1min":0.53600000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":1.0580000000000001,"5min":4.657,"15min":4.657},"last":0.73999999999999999},{"interface":"front","average":{"1min":0.75700000000000001,"5min":0.95799999999999996,"15min":1.05},"min":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":1.0049999999999999,"5min":4.5259999999999998,"15min":4.5259999999999998},"last":0.77400000000000002}]},{"osd":7,"last update":"Tue Nov 28 20:01:57 2023","interfaces":[{"interface":"back","average":{"1min":0.73799999999999999,"5min":0.95199999999999996,"15min":1.0509999999999999},"min":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":1.081,"5min":4.7320000000000002,"15min":4.7320000000000002},"last":0.72499999999999998},{"interface":"front","average":{"1min":0.76300000000000001,"5min":0.93100000000000005,"15min":1.0069999999999999},"min":{"1min":0.58699999999999997,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":1.099,"5min":4.4939999999999998,"15min":4.4939999999999998},"last":0.80200000000000005}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33374,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33374,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-28T20:02:12.357 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-28T20:02:12.535 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:12.532+0000 7f121d9b5640 1 Processor -- start 2023-11-28T20:02:12.535 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:12.532+0000 7f121d9b5640 1 -- start start 2023-11-28T20:02:12.536 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:12.532+0000 7f121d9b5640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f12180c8210 0x7f121806c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:12.536 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:12.532+0000 7f121d9b5640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1218155370 con 0x7f12180c89e0 2023-11-28T20:02:12.536 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:12.532+0000 7f121d9b5640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1218154760 con 0x7f1218151b00 2023-11-28T20:02:12.537 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:12.532+0000 7f121d9b5640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f121806cae0 con 0x7f12180c8210 2023-11-28T20:02:12.537 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:12.532+0000 7f121d1b4640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f12180c89e0 0x7f12180c8e50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:40378/0 (socket says 172.21.15.78:40378) 2023-11-28T20:02:12.537 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:12.532+0000 7f121d1b4640 1 -- 172.21.15.78:0/623903383 learned_addr learned my addr 172.21.15.78:0/623903383 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-11-28T20:02:12.539 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:12.532+0000 7f1217fff640 1 --2- 172.21.15.78:0/623903383 >> v2:172.21.15.179:3300/0 conn(0x7f12180c8210 0x7f121806c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:02:12.539 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:12.532+0000 7f12177fe640 1 -- 172.21.15.78:0/623903383 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1069810800 0 0) 0x7f1218155370 con 0x7f12180c89e0 2023-11-28T20:02:12.539 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:12.532+0000 7f12177fe640 1 -- 172.21.15.78:0/623903383 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1208003530 con 0x7f12180c89e0 2023-11-28T20:02:12.539 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:12.532+0000 7f12177fe640 1 -- 172.21.15.78:0/623903383 <== mon.0 v1:172.21.15.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3226132581 0 0) 0x7f1208003530 con 0x7f12180c89e0 2023-11-28T20:02:12.539 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:12.532+0000 7f12177fe640 1 -- 172.21.15.78:0/623903383 >> v2:172.21.15.179:3300/0 conn(0x7f12180c8210 msgr2=0x7f121806c5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:02:12.539 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:12.532+0000 7f12177fe640 1 --2- 172.21.15.78:0/623903383 >> v2:172.21.15.179:3300/0 conn(0x7f12180c8210 0x7f121806c5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:12.539 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:12.532+0000 7f12177fe640 1 -- 172.21.15.78:0/623903383 >> v1:172.21.15.179:6789/0 conn(0x7f1218151b00 legacy=0x7f12180c4600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:02:12.539 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:12.532+0000 7f12177fe640 1 -- 172.21.15.78:0/623903383 --> v1:172.21.15.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1218154a40 con 0x7f12180c89e0 2023-11-28T20:02:12.539 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:12.532+0000 7f12177fe640 1 -- 172.21.15.78:0/623903383 <== mon.0 v1:172.21.15.78:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3326804700 0 0) 0x7f1210001a00 con 0x7f12180c89e0 2023-11-28T20:02:12.539 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:12.532+0000 7f12177fe640 1 -- 172.21.15.78:0/623903383 >> v1:172.21.15.78:6789/0 conn(0x7f12180c89e0 legacy=0x7f12180c8e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:02:12.539 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:12.532+0000 7f12177fe640 1 --2- 172.21.15.78:0/623903383 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1208003980 0x7f1208003d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:12.540 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:12.532+0000 7f12177fe640 1 --2- 172.21.15.78:0/623903383 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f12080047d0 0x7f1208004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:12.540 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:12.532+0000 7f12177fe640 1 --2- 172.21.15.78:0/623903383 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1208005190 0x7f120800b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:12.540 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:12.532+0000 7f12177fe640 1 -- 172.21.15.78:0/623903383 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f120800c060 con 0x7f1208005190 2023-11-28T20:02:12.540 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:12.532+0000 7f12177fe640 1 -- 172.21.15.78:0/623903383 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f120800c1d0 con 0x7f1208003980 2023-11-28T20:02:12.540 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:12.532+0000 7f12177fe640 1 -- 172.21.15.78:0/623903383 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f120800c390 con 0x7f12080047d0 2023-11-28T20:02:12.540 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:12.532+0000 7f121d1b4640 1 --2- 172.21.15.78:0/623903383 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1208005190 0x7f120800b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:02:12.540 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:12.532+0000 7f121c9b3640 1 --2- 172.21.15.78:0/623903383 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1208003980 0x7f1208003d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:02:12.540 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:12.532+0000 7f1217fff640 1 --2- 172.21.15.78:0/623903383 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f12080047d0 0x7f1208004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:02:12.540 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:12.532+0000 7f121d1b4640 1 -- 172.21.15.78:0/623903383 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f12080047d0 msgr2=0x7f1208004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:02:12.540 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:12.532+0000 7f121d1b4640 1 --2- 172.21.15.78:0/623903383 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f12080047d0 0x7f1208004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:12.540 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:12.532+0000 7f121d1b4640 1 -- 172.21.15.78:0/623903383 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1208003980 msgr2=0x7f1208003d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:02:12.541 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:12.532+0000 7f121d1b4640 1 --2- 172.21.15.78:0/623903383 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1208003980 0x7f1208003d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:12.541 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:12.532+0000 7f121d1b4640 1 -- 172.21.15.78:0/623903383 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1208003530 con 0x7f1208005190 2023-11-28T20:02:12.542 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:12.536+0000 7f121d1b4640 1 -- 172.21.15.78:0/623903383 reap_dead start 2023-11-28T20:02:12.542 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:12.536+0000 7f121d1b4640 1 --2- 172.21.15.78:0/623903383 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1208005190 0x7f120800b990 secure :-1 s=READY pgs=900 cs=0 l=1 rev1=1 crypto rx=0x7f121000a810 tx=0x7f121001d300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=89dd1eab009eb763 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:02:12.542 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:12.536+0000 7f12177fe640 1 -- 172.21.15.78:0/623903383 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12100ad630 con 0x7f1208005190 2023-11-28T20:02:12.542 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:12.536+0000 7f12177fe640 1 -- 172.21.15.78:0/623903383 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f12100a8070 con 0x7f1208005190 2023-11-28T20:02:12.542 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:12.536+0000 7f12177fe640 1 -- 172.21.15.78:0/623903383 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12100ada10 con 0x7f1208005190 2023-11-28T20:02:12.543 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:12.536+0000 7f121d9b5640 1 -- 172.21.15.78:0/623903383 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1208005190 msgr2=0x7f120800b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:02:12.543 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:12.536+0000 7f121d9b5640 1 --2- 172.21.15.78:0/623903383 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1208005190 0x7f120800b990 secure :-1 s=READY pgs=900 cs=0 l=1 rev1=1 crypto rx=0x7f121000a810 tx=0x7f121001d300 comp rx=0 tx=0).stop 2023-11-28T20:02:12.543 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:12.536+0000 7f121d9b5640 1 -- 172.21.15.78:0/623903383 shutdown_connections 2023-11-28T20:02:12.543 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:12.536+0000 7f121d9b5640 1 --2- 172.21.15.78:0/623903383 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1208005190 0x7f120800b990 unknown :-1 s=CLOSED pgs=900 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:12.543 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:12.536+0000 7f121d9b5640 1 -- 172.21.15.78:0/623903383 >> 172.21.15.78:0/623903383 conn(0x7f12180ab9c0 msgr2=0x7f12180abdd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:02:12.543 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:12.536+0000 7f121d9b5640 1 -- 172.21.15.78:0/623903383 shutdown_connections 2023-11-28T20:02:12.543 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:12.536+0000 7f121d9b5640 1 -- 172.21.15.78:0/623903383 wait complete. 2023-11-28T20:02:12.544 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:12.540+0000 7f121d9b5640 1 Processor -- start 2023-11-28T20:02:12.544 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:12.540+0000 7f121d9b5640 1 -- start start 2023-11-28T20:02:12.545 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:12.540+0000 7f121d9b5640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1208005190 0x7f121814e2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:12.545 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:12.540+0000 7f121d9b5640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f12180bfec0 0x7f12180c0340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:12.546 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:12.540+0000 7f121d9b5640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1218147e00 0x7f1218148280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:12.546 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:12.540+0000 7f121d9b5640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f121814a3a0 con 0x7f12180bfec0 2023-11-28T20:02:12.546 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:12.540+0000 7f121d9b5640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f121814bbc0 con 0x7f1208005190 2023-11-28T20:02:12.546 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:12.540+0000 7f121d9b5640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f121814edb0 con 0x7f1218147e00 2023-11-28T20:02:12.546 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:12.540+0000 7f1217fff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f12180bfec0 0x7f12180c0340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:02:12.546 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:12.540+0000 7f1217fff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f12180bfec0 0x7f12180c0340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:49526/0 (socket says 172.21.15.78:49526) 2023-11-28T20:02:12.549 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:12.540+0000 7f1217fff640 1 -- 172.21.15.78:0/4096146891 learned_addr learned my addr 172.21.15.78:0/4096146891 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T20:02:12.549 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:12.540+0000 7f121c9b3640 1 --2- 172.21.15.78:0/4096146891 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1208005190 0x7f121814e2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:02:12.549 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:12.540+0000 7f1217fff640 1 -- 172.21.15.78:0/4096146891 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1218147e00 msgr2=0x7f1218148280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:02:12.549 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:12.540+0000 7f1217fff640 1 --2- 172.21.15.78:0/4096146891 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1218147e00 0x7f1218148280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:12.550 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:12.540+0000 7f1217fff640 1 -- 172.21.15.78:0/4096146891 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1208005190 msgr2=0x7f121814e2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:02:12.550 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:12.540+0000 7f1217fff640 1 --2- 172.21.15.78:0/4096146891 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1208005190 0x7f121814e2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:12.550 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:12.540+0000 7f1217fff640 1 -- 172.21.15.78:0/4096146891 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f121814b5b0 con 0x7f12180bfec0 2023-11-28T20:02:12.550 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:12.540+0000 7f1217fff640 1 --2- 172.21.15.78:0/4096146891 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f12180bfec0 0x7f12180c0340 secure :-1 s=READY pgs=901 cs=0 l=1 rev1=1 crypto rx=0x7f12040118b0 tx=0x7f1204011d70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:02:12.551 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:12.540+0000 7f12157fa640 1 -- 172.21.15.78:0/4096146891 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f120400fa30 con 0x7f12180bfec0 2023-11-28T20:02:12.551 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:12.540+0000 7f12157fa640 1 -- 172.21.15.78:0/4096146891 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f120400fb90 con 0x7f12180bfec0 2023-11-28T20:02:12.551 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:12.540+0000 7f121d9b5640 1 -- 172.21.15.78:0/4096146891 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f12181ed0f0 con 0x7f12180bfec0 2023-11-28T20:02:12.551 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:12.540+0000 7f12157fa640 1 -- 172.21.15.78:0/4096146891 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1204014440 con 0x7f12180bfec0 2023-11-28T20:02:12.552 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:12.540+0000 7f121d9b5640 1 -- 172.21.15.78:0/4096146891 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f12181ed3d0 con 0x7f12180bfec0 2023-11-28T20:02:12.552 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:12.544+0000 7f121d9b5640 1 -- 172.21.15.78:0/4096146891 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f12180674b0 con 0x7f12180bfec0 2023-11-28T20:02:12.552 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:12.544+0000 7f12157fa640 1 -- 172.21.15.78:0/4096146891 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f12040145a0 con 0x7f12180bfec0 2023-11-28T20:02:12.552 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:12.544+0000 7f12157fa640 1 --2- 172.21.15.78:0/4096146891 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f11fc0664a0 0x7f11fc068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:12.552 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:12.544+0000 7f12157fa640 1 -- 172.21.15.78:0/4096146891 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f12040847e0 con 0x7f12180bfec0 2023-11-28T20:02:12.552 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:12.544+0000 7f121c9b3640 1 --2- 172.21.15.78:0/4096146891 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f11fc0664a0 0x7f11fc068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:02:12.552 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:12.544+0000 7f121c9b3640 1 --2- 172.21.15.78:0/4096146891 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f11fc0664a0 0x7f11fc068960 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f12180c20c0 tx=0x7f120c009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:02:12.552 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:12.548+0000 7f12157fa640 1 -- 172.21.15.78:0/4096146891 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f1204051b10 con 0x7f12180bfec0 2023-11-28T20:02:12.701 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:12.696+0000 7f121d9b5640 1 -- 172.21.15.78:0/4096146891 --> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f12181ecee0 con 0x7f11fc0664a0 2023-11-28T20:02:12.708 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:12.704+0000 7f12157fa640 1 -- 172.21.15.78:0/4096146891 <== mgr.4106 v2:172.21.15.78:6832/2935380957 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+283878 (secure 0 0 0) 0x7f12181ecee0 con 0x7f11fc0664a0 2023-11-28T20:02:12.711 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-11-28T20:02:12.712 INFO:teuthology.orchestra.run.smithi078.stderr:dumped all 2023-11-28T20:02:12.713 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:12.708+0000 7f121d9b5640 1 -- 172.21.15.78:0/4096146891 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f11fc0664a0 msgr2=0x7f11fc068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:02:12.714 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:12.708+0000 7f121d9b5640 1 --2- 172.21.15.78:0/4096146891 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f11fc0664a0 0x7f11fc068960 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f12180c20c0 tx=0x7f120c009040 comp rx=0 tx=0).stop 2023-11-28T20:02:12.714 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:12.708+0000 7f121d9b5640 1 -- 172.21.15.78:0/4096146891 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f12180bfec0 msgr2=0x7f12180c0340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:02:12.714 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:12.708+0000 7f121d9b5640 1 --2- 172.21.15.78:0/4096146891 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f12180bfec0 0x7f12180c0340 secure :-1 s=READY pgs=901 cs=0 l=1 rev1=1 crypto rx=0x7f12040118b0 tx=0x7f1204011d70 comp rx=0 tx=0).stop 2023-11-28T20:02:12.714 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:12.708+0000 7f121d9b5640 1 -- 172.21.15.78:0/4096146891 shutdown_connections 2023-11-28T20:02:12.714 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:12.708+0000 7f121d9b5640 1 --2- 172.21.15.78:0/4096146891 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f11fc0664a0 0x7f11fc068960 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:12.714 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:12.708+0000 7f121d9b5640 1 --2- 172.21.15.78:0/4096146891 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1218147e00 0x7f1218148280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:12.714 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:12.708+0000 7f121d9b5640 1 --2- 172.21.15.78:0/4096146891 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f12180bfec0 0x7f12180c0340 unknown :-1 s=CLOSED pgs=901 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:12.714 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:12.708+0000 7f121d9b5640 1 --2- 172.21.15.78:0/4096146891 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1208005190 0x7f121814e2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:12.715 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:12.708+0000 7f121d9b5640 1 -- 172.21.15.78:0/4096146891 >> 172.21.15.78:0/4096146891 conn(0x7f12180ab9c0 msgr2=0x7f12180c6690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:02:12.715 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:12.708+0000 7f121d9b5640 1 -- 172.21.15.78:0/4096146891 shutdown_connections 2023-11-28T20:02:12.715 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:12.708+0000 7f121d9b5640 1 -- 172.21.15.78:0/4096146891 wait complete. 2023-11-28T20:02:12.731 INFO:teuthology.orchestra.run.smithi078.stdout:{"pg_ready":true,"pg_map":{"version":174,"stamp":"2023-11-28T20:02:11.992080+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":38,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":248892,"kb_used_data":7744,"kb_used_omap":12,"kb_used_meta":241011,"kb_avail":754725828,"statfs":{"total":773094113280,"available":772839247872,"internally_reserved":0,"allocated":7929856,"data_stored":4827424,"data_compressed":66748,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":12752,"internal_metadata":246795824},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":33,"apply_latency_ms":33,"commit_latency_ns":33000000,"apply_latency_ns":33000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.727258"},"pg_stats":[{"pgid":"14.3f","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2023-11-28T20:02:07.283775+0000","last_change":"2023-11-28T20:02:07.283775+0000","last_active":"2023-11-28T20:02:07.264604+0000","last_peered":"2023-11-28T20:02:07.264604+0000","last_clean":"2023-11-28T20:02:07.264604+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:02:07.283775+0000","last_undegraded":"2023-11-28T20:02:07.283775+0000","last_fullsized":"2023-11-28T20:02:07.283775+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_clean_scrub_stamp":"2023-11-28T20:02:07.264604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.3e","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2023-11-28T20:02:07.281033+0000","last_change":"2023-11-28T20:02:07.281033+0000","last_active":"2023-11-28T20:02:07.264604+0000","last_peered":"2023-11-28T20:02:07.264604+0000","last_clean":"2023-11-28T20:02:07.264604+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:02:07.281033+0000","last_undegraded":"2023-11-28T20:02:07.281033+0000","last_fullsized":"2023-11-28T20:02:07.281033+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_clean_scrub_stamp":"2023-11-28T20:02:07.264604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.3d","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2023-11-28T20:02:07.284263+0000","last_change":"2023-11-28T20:02:07.284263+0000","last_active":"2023-11-28T20:02:07.264604+0000","last_peered":"2023-11-28T20:02:07.264604+0000","last_clean":"2023-11-28T20:02:07.264604+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:02:07.284263+0000","last_undegraded":"2023-11-28T20:02:07.284263+0000","last_fullsized":"2023-11-28T20:02:07.284263+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_clean_scrub_stamp":"2023-11-28T20:02:07.264604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.3c","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2023-11-28T20:02:07.279673+0000","last_change":"2023-11-28T20:02:07.279673+0000","last_active":"2023-11-28T20:02:07.264604+0000","last_peered":"2023-11-28T20:02:07.264604+0000","last_clean":"2023-11-28T20:02:07.264604+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:02:07.279673+0000","last_undegraded":"2023-11-28T20:02:07.279673+0000","last_fullsized":"2023-11-28T20:02:07.279673+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_clean_scrub_stamp":"2023-11-28T20:02:07.264604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.3b","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2023-11-28T20:02:07.278853+0000","last_change":"2023-11-28T20:02:07.278853+0000","last_active":"2023-11-28T20:02:07.264604+0000","last_peered":"2023-11-28T20:02:07.264604+0000","last_clean":"2023-11-28T20:02:07.264604+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:02:07.278853+0000","last_undegraded":"2023-11-28T20:02:07.278853+0000","last_fullsized":"2023-11-28T20:02:07.278853+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_clean_scrub_stamp":"2023-11-28T20:02:07.264604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.3a","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2023-11-28T20:02:07.285754+0000","last_change":"2023-11-28T20:02:07.285754+0000","last_active":"2023-11-28T20:02:07.264604+0000","last_peered":"2023-11-28T20:02:07.264604+0000","last_clean":"2023-11-28T20:02:07.264604+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:02:07.285754+0000","last_undegraded":"2023-11-28T20:02:07.285754+0000","last_fullsized":"2023-11-28T20:02:07.285754+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_clean_scrub_stamp":"2023-11-28T20:02:07.264604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.39","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2023-11-28T20:02:07.287408+0000","last_change":"2023-11-28T20:02:07.287408+0000","last_active":"2023-11-28T20:02:07.264604+0000","last_peered":"2023-11-28T20:02:07.264604+0000","last_clean":"2023-11-28T20:02:07.264604+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:02:07.287408+0000","last_undegraded":"2023-11-28T20:02:07.287408+0000","last_fullsized":"2023-11-28T20:02:07.287408+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_clean_scrub_stamp":"2023-11-28T20:02:07.264604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.38","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2023-11-28T20:02:07.279529+0000","last_change":"2023-11-28T20:02:07.279529+0000","last_active":"2023-11-28T20:02:07.264604+0000","last_peered":"2023-11-28T20:02:07.264604+0000","last_clean":"2023-11-28T20:02:07.264604+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:02:07.279529+0000","last_undegraded":"2023-11-28T20:02:07.279529+0000","last_fullsized":"2023-11-28T20:02:07.279529+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_clean_scrub_stamp":"2023-11-28T20:02:07.264604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.37","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2023-11-28T20:02:07.280230+0000","last_change":"2023-11-28T20:02:07.280230+0000","last_active":"2023-11-28T20:02:07.264604+0000","last_peered":"2023-11-28T20:02:07.264604+0000","last_clean":"2023-11-28T20:02:07.264604+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:02:07.280230+0000","last_undegraded":"2023-11-28T20:02:07.280230+0000","last_fullsized":"2023-11-28T20:02:07.280230+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_clean_scrub_stamp":"2023-11-28T20:02:07.264604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.36","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2023-11-28T20:02:07.285036+0000","last_change":"2023-11-28T20:02:07.285036+0000","last_active":"2023-11-28T20:02:07.264604+0000","last_peered":"2023-11-28T20:02:07.264604+0000","last_clean":"2023-11-28T20:02:07.264604+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:02:07.285036+0000","last_undegraded":"2023-11-28T20:02:07.285036+0000","last_fullsized":"2023-11-28T20:02:07.285036+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_clean_scrub_stamp":"2023-11-28T20:02:07.264604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.35","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2023-11-28T20:02:07.280584+0000","last_change":"2023-11-28T20:02:07.280584+0000","last_active":"2023-11-28T20:02:07.264604+0000","last_peered":"2023-11-28T20:02:07.264604+0000","last_clean":"2023-11-28T20:02:07.264604+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:02:07.280584+0000","last_undegraded":"2023-11-28T20:02:07.280584+0000","last_fullsized":"2023-11-28T20:02:07.280584+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_clean_scrub_stamp":"2023-11-28T20:02:07.264604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.34","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2023-11-28T20:02:07.281300+0000","last_change":"2023-11-28T20:02:07.281300+0000","last_active":"2023-11-28T20:02:07.264604+0000","last_peered":"2023-11-28T20:02:07.264604+0000","last_clean":"2023-11-28T20:02:07.264604+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:02:07.281300+0000","last_undegraded":"2023-11-28T20:02:07.281300+0000","last_fullsized":"2023-11-28T20:02:07.281300+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_clean_scrub_stamp":"2023-11-28T20:02:07.264604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.33","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2023-11-28T20:02:07.279252+0000","last_change":"2023-11-28T20:02:07.279252+0000","last_active":"2023-11-28T20:02:07.264604+0000","last_peered":"2023-11-28T20:02:07.264604+0000","last_clean":"2023-11-28T20:02:07.264604+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:02:07.279252+0000","last_undegraded":"2023-11-28T20:02:07.279252+0000","last_fullsized":"2023-11-28T20:02:07.279252+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_clean_scrub_stamp":"2023-11-28T20:02:07.264604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.32","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2023-11-28T20:02:07.280291+0000","last_change":"2023-11-28T20:02:07.280291+0000","last_active":"2023-11-28T20:02:07.264604+0000","last_peered":"2023-11-28T20:02:07.264604+0000","last_clean":"2023-11-28T20:02:07.264604+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:02:07.280291+0000","last_undegraded":"2023-11-28T20:02:07.280291+0000","last_fullsized":"2023-11-28T20:02:07.280291+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_clean_scrub_stamp":"2023-11-28T20:02:07.264604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.31","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2023-11-28T20:02:07.278957+0000","last_change":"2023-11-28T20:02:07.278957+0000","last_active":"2023-11-28T20:02:07.264604+0000","last_peered":"2023-11-28T20:02:07.264604+0000","last_clean":"2023-11-28T20:02:07.264604+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:02:07.278957+0000","last_undegraded":"2023-11-28T20:02:07.278957+0000","last_fullsized":"2023-11-28T20:02:07.278957+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_clean_scrub_stamp":"2023-11-28T20:02:07.264604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.30","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2023-11-28T20:02:07.285701+0000","last_change":"2023-11-28T20:02:07.285701+0000","last_active":"2023-11-28T20:02:07.264604+0000","last_peered":"2023-11-28T20:02:07.264604+0000","last_clean":"2023-11-28T20:02:07.264604+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:02:07.285701+0000","last_undegraded":"2023-11-28T20:02:07.285701+0000","last_fullsized":"2023-11-28T20:02:07.285701+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_clean_scrub_stamp":"2023-11-28T20:02:07.264604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.2f","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2023-11-28T20:02:07.279900+0000","last_change":"2023-11-28T20:02:07.279900+0000","last_active":"2023-11-28T20:02:07.264604+0000","last_peered":"2023-11-28T20:02:07.264604+0000","last_clean":"2023-11-28T20:02:07.264604+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:02:07.279900+0000","last_undegraded":"2023-11-28T20:02:07.279900+0000","last_fullsized":"2023-11-28T20:02:07.279900+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_clean_scrub_stamp":"2023-11-28T20:02:07.264604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.2e","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2023-11-28T20:02:07.283280+0000","last_change":"2023-11-28T20:02:07.283280+0000","last_active":"2023-11-28T20:02:07.264604+0000","last_peered":"2023-11-28T20:02:07.264604+0000","last_clean":"2023-11-28T20:02:07.264604+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:02:07.283280+0000","last_undegraded":"2023-11-28T20:02:07.283280+0000","last_fullsized":"2023-11-28T20:02:07.283280+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_clean_scrub_stamp":"2023-11-28T20:02:07.264604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.2d","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2023-11-28T20:02:07.279980+0000","last_change":"2023-11-28T20:02:07.279980+0000","last_active":"2023-11-28T20:02:07.264604+0000","last_peered":"2023-11-28T20:02:07.264604+0000","last_clean":"2023-11-28T20:02:07.264604+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:02:07.279980+0000","last_undegraded":"2023-11-28T20:02:07.279980+0000","last_fullsized":"2023-11-28T20:02:07.279980+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_clean_scrub_stamp":"2023-11-28T20:02:07.264604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.2c","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2023-11-28T20:02:07.279215+0000","last_change":"2023-11-28T20:02:07.279215+0000","last_active":"2023-11-28T20:02:07.264604+0000","last_peered":"2023-11-28T20:02:07.264604+0000","last_clean":"2023-11-28T20:02:07.264604+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:02:07.279215+0000","last_undegraded":"2023-11-28T20:02:07.279215+0000","last_fullsized":"2023-11-28T20:02:07.279215+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_clean_scrub_stamp":"2023-11-28T20:02:07.264604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.2b","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2023-11-28T20:02:07.279982+0000","last_change":"2023-11-28T20:02:07.279982+0000","last_active":"2023-11-28T20:02:07.264604+0000","last_peered":"2023-11-28T20:02:07.264604+0000","last_clean":"2023-11-28T20:02:07.264604+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:02:07.279982+0000","last_undegraded":"2023-11-28T20:02:07.279982+0000","last_fullsized":"2023-11-28T20:02:07.279982+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_clean_scrub_stamp":"2023-11-28T20:02:07.264604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.2a","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2023-11-28T20:02:07.279747+0000","last_change":"2023-11-28T20:02:07.279747+0000","last_active":"2023-11-28T20:02:07.264604+0000","last_peered":"2023-11-28T20:02:07.264604+0000","last_clean":"2023-11-28T20:02:07.264604+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:02:07.279747+0000","last_undegraded":"2023-11-28T20:02:07.279747+0000","last_fullsized":"2023-11-28T20:02:07.279747+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_clean_scrub_stamp":"2023-11-28T20:02:07.264604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.29","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2023-11-28T20:02:07.288560+0000","last_change":"2023-11-28T20:02:07.288560+0000","last_active":"2023-11-28T20:02:07.264604+0000","last_peered":"2023-11-28T20:02:07.264604+0000","last_clean":"2023-11-28T20:02:07.264604+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:02:07.288560+0000","last_undegraded":"2023-11-28T20:02:07.288560+0000","last_fullsized":"2023-11-28T20:02:07.288560+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_clean_scrub_stamp":"2023-11-28T20:02:07.264604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.28","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2023-11-28T20:02:07.281146+0000","last_change":"2023-11-28T20:02:07.281146+0000","last_active":"2023-11-28T20:02:07.264604+0000","last_peered":"2023-11-28T20:02:07.264604+0000","last_clean":"2023-11-28T20:02:07.264604+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:02:07.281146+0000","last_undegraded":"2023-11-28T20:02:07.281146+0000","last_fullsized":"2023-11-28T20:02:07.281146+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_clean_scrub_stamp":"2023-11-28T20:02:07.264604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.27","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2023-11-28T20:02:07.280571+0000","last_change":"2023-11-28T20:02:07.280571+0000","last_active":"2023-11-28T20:02:07.264604+0000","last_peered":"2023-11-28T20:02:07.264604+0000","last_clean":"2023-11-28T20:02:07.264604+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:02:07.280571+0000","last_undegraded":"2023-11-28T20:02:07.280571+0000","last_fullsized":"2023-11-28T20:02:07.280571+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_clean_scrub_stamp":"2023-11-28T20:02:07.264604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.26","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2023-11-28T20:02:07.281292+0000","last_change":"2023-11-28T20:02:07.281292+0000","last_active":"2023-11-28T20:02:07.264604+0000","last_peered":"2023-11-28T20:02:07.264604+0000","last_clean":"2023-11-28T20:02:07.264604+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:02:07.281292+0000","last_undegraded":"2023-11-28T20:02:07.281292+0000","last_fullsized":"2023-11-28T20:02:07.281292+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_clean_scrub_stamp":"2023-11-28T20:02:07.264604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.25","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2023-11-28T20:02:07.283518+0000","last_change":"2023-11-28T20:02:07.283518+0000","last_active":"2023-11-28T20:02:07.264604+0000","last_peered":"2023-11-28T20:02:07.264604+0000","last_clean":"2023-11-28T20:02:07.264604+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:02:07.283518+0000","last_undegraded":"2023-11-28T20:02:07.283518+0000","last_fullsized":"2023-11-28T20:02:07.283518+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_clean_scrub_stamp":"2023-11-28T20:02:07.264604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.24","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2023-11-28T20:02:07.278454+0000","last_change":"2023-11-28T20:02:07.278454+0000","last_active":"2023-11-28T20:02:07.264604+0000","last_peered":"2023-11-28T20:02:07.264604+0000","last_clean":"2023-11-28T20:02:07.264604+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:02:07.278454+0000","last_undegraded":"2023-11-28T20:02:07.278454+0000","last_fullsized":"2023-11-28T20:02:07.278454+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_clean_scrub_stamp":"2023-11-28T20:02:07.264604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.23","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2023-11-28T20:02:07.286673+0000","last_change":"2023-11-28T20:02:07.286673+0000","last_active":"2023-11-28T20:02:07.264604+0000","last_peered":"2023-11-28T20:02:07.264604+0000","last_clean":"2023-11-28T20:02:07.264604+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:02:07.286673+0000","last_undegraded":"2023-11-28T20:02:07.286673+0000","last_fullsized":"2023-11-28T20:02:07.286673+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_clean_scrub_stamp":"2023-11-28T20:02:07.264604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.22","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2023-11-28T20:02:07.278208+0000","last_change":"2023-11-28T20:02:07.278208+0000","last_active":"2023-11-28T20:02:07.264604+0000","last_peered":"2023-11-28T20:02:07.264604+0000","last_clean":"2023-11-28T20:02:07.264604+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:02:07.278208+0000","last_undegraded":"2023-11-28T20:02:07.278208+0000","last_fullsized":"2023-11-28T20:02:07.278208+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_clean_scrub_stamp":"2023-11-28T20:02:07.264604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.21","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2023-11-28T20:02:07.281997+0000","last_change":"2023-11-28T20:02:07.281997+0000","last_active":"2023-11-28T20:02:07.264604+0000","last_peered":"2023-11-28T20:02:07.264604+0000","last_clean":"2023-11-28T20:02:07.264604+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:02:07.281997+0000","last_undegraded":"2023-11-28T20:02:07.281997+0000","last_fullsized":"2023-11-28T20:02:07.281997+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_clean_scrub_stamp":"2023-11-28T20:02:07.264604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.20","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2023-11-28T20:02:07.280102+0000","last_change":"2023-11-28T20:02:07.280102+0000","last_active":"2023-11-28T20:02:07.264604+0000","last_peered":"2023-11-28T20:02:07.264604+0000","last_clean":"2023-11-28T20:02:07.264604+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:02:07.280102+0000","last_undegraded":"2023-11-28T20:02:07.280102+0000","last_fullsized":"2023-11-28T20:02:07.280102+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_clean_scrub_stamp":"2023-11-28T20:02:07.264604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.1c","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2023-11-28T20:02:07.285556+0000","last_change":"2023-11-28T20:02:07.285556+0000","last_active":"2023-11-28T20:02:07.264604+0000","last_peered":"2023-11-28T20:02:07.264604+0000","last_clean":"2023-11-28T20:02:07.264604+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:02:07.285556+0000","last_undegraded":"2023-11-28T20:02:07.285556+0000","last_fullsized":"2023-11-28T20:02:07.285556+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_clean_scrub_stamp":"2023-11-28T20:02:07.264604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1f","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-28T20:02:07.301622+0000","last_change":"2023-11-28T20:02:07.298433+0000","last_active":"2023-11-28T20:02:07.301622+0000","last_peered":"2023-11-28T20:02:07.301622+0000","last_clean":"2023-11-28T20:02:07.301622+0000","last_became_active":"2023-11-28T20:02:07.298106+0000","last_became_peered":"2023-11-28T20:02:07.298106+0000","last_unstale":"2023-11-28T20:02:07.301622+0000","last_undegraded":"2023-11-28T20:02:07.301622+0000","last_fullsized":"2023-11-28T20:02:07.301622+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:06.257335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:06.257335+0000","last_clean_scrub_stamp":"2023-11-28T20:02:06.257335+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T06:20:36.448239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.1d","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2023-11-28T20:02:07.286754+0000","last_change":"2023-11-28T20:02:07.286754+0000","last_active":"2023-11-28T20:02:07.264604+0000","last_peered":"2023-11-28T20:02:07.264604+0000","last_clean":"2023-11-28T20:02:07.264604+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:02:07.286754+0000","last_undegraded":"2023-11-28T20:02:07.286754+0000","last_fullsized":"2023-11-28T20:02:07.286754+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_clean_scrub_stamp":"2023-11-28T20:02:07.264604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1e","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-28T20:02:07.296840+0000","last_change":"2023-11-28T20:02:07.293164+0000","last_active":"2023-11-28T20:02:07.296840+0000","last_peered":"2023-11-28T20:02:07.296840+0000","last_clean":"2023-11-28T20:02:07.296840+0000","last_became_active":"2023-11-28T20:02:07.292799+0000","last_became_peered":"2023-11-28T20:02:07.292799+0000","last_unstale":"2023-11-28T20:02:07.296840+0000","last_undegraded":"2023-11-28T20:02:07.296840+0000","last_fullsized":"2023-11-28T20:02:07.296840+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:06.257335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:06.257335+0000","last_clean_scrub_stamp":"2023-11-28T20:02:06.257335+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:09:41.129447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.1e","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2023-11-28T20:02:07.287269+0000","last_change":"2023-11-28T20:02:07.287269+0000","last_active":"2023-11-28T20:02:07.264604+0000","last_peered":"2023-11-28T20:02:07.264604+0000","last_clean":"2023-11-28T20:02:07.264604+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:02:07.287269+0000","last_undegraded":"2023-11-28T20:02:07.287269+0000","last_fullsized":"2023-11-28T20:02:07.287269+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_clean_scrub_stamp":"2023-11-28T20:02:07.264604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.1d","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-28T20:02:07.305601+0000","last_change":"2023-11-28T20:02:07.298412+0000","last_active":"2023-11-28T20:02:07.305601+0000","last_peered":"2023-11-28T20:02:07.305601+0000","last_clean":"2023-11-28T20:02:07.305601+0000","last_became_active":"2023-11-28T20:02:07.297937+0000","last_became_peered":"2023-11-28T20:02:07.297937+0000","last_unstale":"2023-11-28T20:02:07.305601+0000","last_undegraded":"2023-11-28T20:02:07.305601+0000","last_fullsized":"2023-11-28T20:02:07.305601+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:06.257335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:06.257335+0000","last_clean_scrub_stamp":"2023-11-28T20:02:06.257335+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:11:12.221383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.1f","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2023-11-28T20:02:07.279393+0000","last_change":"2023-11-28T20:02:07.279393+0000","last_active":"2023-11-28T20:02:07.264604+0000","last_peered":"2023-11-28T20:02:07.264604+0000","last_clean":"2023-11-28T20:02:07.264604+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:02:07.279393+0000","last_undegraded":"2023-11-28T20:02:07.279393+0000","last_fullsized":"2023-11-28T20:02:07.279393+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_clean_scrub_stamp":"2023-11-28T20:02:07.264604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1c","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-28T20:02:07.306628+0000","last_change":"2023-11-28T20:02:07.303442+0000","last_active":"2023-11-28T20:02:07.306628+0000","last_peered":"2023-11-28T20:02:07.306628+0000","last_clean":"2023-11-28T20:02:07.306628+0000","last_became_active":"2023-11-28T20:02:07.302881+0000","last_became_peered":"2023-11-28T20:02:07.302881+0000","last_unstale":"2023-11-28T20:02:07.306628+0000","last_undegraded":"2023-11-28T20:02:07.306628+0000","last_fullsized":"2023-11-28T20:02:07.306628+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:06.257335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:06.257335+0000","last_clean_scrub_stamp":"2023-11-28T20:02:06.257335+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:26:07.339153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.18","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2023-11-28T20:02:07.279010+0000","last_change":"2023-11-28T20:02:07.279010+0000","last_active":"2023-11-28T20:02:07.264604+0000","last_peered":"2023-11-28T20:02:07.264604+0000","last_clean":"2023-11-28T20:02:07.264604+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:02:07.279010+0000","last_undegraded":"2023-11-28T20:02:07.279010+0000","last_fullsized":"2023-11-28T20:02:07.279010+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_clean_scrub_stamp":"2023-11-28T20:02:07.264604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.1b","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-28T20:02:07.295836+0000","last_change":"2023-11-28T20:02:07.292245+0000","last_active":"2023-11-28T20:02:07.295836+0000","last_peered":"2023-11-28T20:02:07.295836+0000","last_clean":"2023-11-28T20:02:07.295836+0000","last_became_active":"2023-11-28T20:02:07.291923+0000","last_became_peered":"2023-11-28T20:02:07.291923+0000","last_unstale":"2023-11-28T20:02:07.295836+0000","last_undegraded":"2023-11-28T20:02:07.295836+0000","last_fullsized":"2023-11-28T20:02:07.295836+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:06.257335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:06.257335+0000","last_clean_scrub_stamp":"2023-11-28T20:02:06.257335+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:12:38.018161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.19","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2023-11-28T20:02:07.288017+0000","last_change":"2023-11-28T20:02:07.288017+0000","last_active":"2023-11-28T20:02:07.264604+0000","last_peered":"2023-11-28T20:02:07.264604+0000","last_clean":"2023-11-28T20:02:07.264604+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:02:07.288017+0000","last_undegraded":"2023-11-28T20:02:07.288017+0000","last_fullsized":"2023-11-28T20:02:07.288017+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_clean_scrub_stamp":"2023-11-28T20:02:07.264604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1a","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-28T20:02:07.300872+0000","last_change":"2023-11-28T20:02:07.297038+0000","last_active":"2023-11-28T20:02:07.300872+0000","last_peered":"2023-11-28T20:02:07.300872+0000","last_clean":"2023-11-28T20:02:07.300872+0000","last_became_active":"2023-11-28T20:02:07.295472+0000","last_became_peered":"2023-11-28T20:02:07.295472+0000","last_unstale":"2023-11-28T20:02:07.300872+0000","last_undegraded":"2023-11-28T20:02:07.300872+0000","last_fullsized":"2023-11-28T20:02:07.300872+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:06.257335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:06.257335+0000","last_clean_scrub_stamp":"2023-11-28T20:02:06.257335+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:04:18.830964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.1a","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2023-11-28T20:02:07.279632+0000","last_change":"2023-11-28T20:02:07.279632+0000","last_active":"2023-11-28T20:02:07.264604+0000","last_peered":"2023-11-28T20:02:07.264604+0000","last_clean":"2023-11-28T20:02:07.264604+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:02:07.279632+0000","last_undegraded":"2023-11-28T20:02:07.279632+0000","last_fullsized":"2023-11-28T20:02:07.279632+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_clean_scrub_stamp":"2023-11-28T20:02:07.264604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.19","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-28T20:02:07.298903+0000","last_change":"2023-11-28T20:02:07.292322+0000","last_active":"2023-11-28T20:02:07.298903+0000","last_peered":"2023-11-28T20:02:07.298903+0000","last_clean":"2023-11-28T20:02:07.298903+0000","last_became_active":"2023-11-28T20:02:07.292063+0000","last_became_peered":"2023-11-28T20:02:07.292063+0000","last_unstale":"2023-11-28T20:02:07.298903+0000","last_undegraded":"2023-11-28T20:02:07.298903+0000","last_fullsized":"2023-11-28T20:02:07.298903+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:06.257335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:06.257335+0000","last_clean_scrub_stamp":"2023-11-28T20:02:06.257335+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T07:49:30.905608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.1b","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2023-11-28T20:02:07.278842+0000","last_change":"2023-11-28T20:02:07.278842+0000","last_active":"2023-11-28T20:02:07.264604+0000","last_peered":"2023-11-28T20:02:07.264604+0000","last_clean":"2023-11-28T20:02:07.264604+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:02:07.278842+0000","last_undegraded":"2023-11-28T20:02:07.278842+0000","last_fullsized":"2023-11-28T20:02:07.278842+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_clean_scrub_stamp":"2023-11-28T20:02:07.264604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.18","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-28T20:02:07.305630+0000","last_change":"2023-11-28T20:02:07.298452+0000","last_active":"2023-11-28T20:02:07.305630+0000","last_peered":"2023-11-28T20:02:07.305630+0000","last_clean":"2023-11-28T20:02:07.305630+0000","last_became_active":"2023-11-28T20:02:07.297932+0000","last_became_peered":"2023-11-28T20:02:07.297932+0000","last_unstale":"2023-11-28T20:02:07.305630+0000","last_undegraded":"2023-11-28T20:02:07.305630+0000","last_fullsized":"2023-11-28T20:02:07.305630+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:06.257335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:06.257335+0000","last_clean_scrub_stamp":"2023-11-28T20:02:06.257335+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:41:59.292583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.14","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2023-11-28T20:02:07.279138+0000","last_change":"2023-11-28T20:02:07.279138+0000","last_active":"2023-11-28T20:02:07.264604+0000","last_peered":"2023-11-28T20:02:07.264604+0000","last_clean":"2023-11-28T20:02:07.264604+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:02:07.279138+0000","last_undegraded":"2023-11-28T20:02:07.279138+0000","last_fullsized":"2023-11-28T20:02:07.279138+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_clean_scrub_stamp":"2023-11-28T20:02:07.264604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.17","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-28T20:02:07.305738+0000","last_change":"2023-11-28T20:02:07.299173+0000","last_active":"2023-11-28T20:02:07.305738+0000","last_peered":"2023-11-28T20:02:07.305738+0000","last_clean":"2023-11-28T20:02:07.305738+0000","last_became_active":"2023-11-28T20:02:07.298892+0000","last_became_peered":"2023-11-28T20:02:07.298892+0000","last_unstale":"2023-11-28T20:02:07.305738+0000","last_undegraded":"2023-11-28T20:02:07.305738+0000","last_fullsized":"2023-11-28T20:02:07.305738+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:06.257335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:06.257335+0000","last_clean_scrub_stamp":"2023-11-28T20:02:06.257335+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:31:56.348870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.15","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2023-11-28T20:02:07.286690+0000","last_change":"2023-11-28T20:02:07.286690+0000","last_active":"2023-11-28T20:02:07.264604+0000","last_peered":"2023-11-28T20:02:07.264604+0000","last_clean":"2023-11-28T20:02:07.264604+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:02:07.286690+0000","last_undegraded":"2023-11-28T20:02:07.286690+0000","last_fullsized":"2023-11-28T20:02:07.286690+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_clean_scrub_stamp":"2023-11-28T20:02:07.264604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.16","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-28T20:02:07.299239+0000","last_change":"2023-11-28T20:02:07.291621+0000","last_active":"2023-11-28T20:02:07.299239+0000","last_peered":"2023-11-28T20:02:07.299239+0000","last_clean":"2023-11-28T20:02:07.299239+0000","last_became_active":"2023-11-28T20:02:07.288923+0000","last_became_peered":"2023-11-28T20:02:07.288923+0000","last_unstale":"2023-11-28T20:02:07.299239+0000","last_undegraded":"2023-11-28T20:02:07.299239+0000","last_fullsized":"2023-11-28T20:02:07.299239+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:06.257335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:06.257335+0000","last_clean_scrub_stamp":"2023-11-28T20:02:06.257335+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:52:29.664838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.16","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2023-11-28T20:02:07.282823+0000","last_change":"2023-11-28T20:02:07.282823+0000","last_active":"2023-11-28T20:02:07.264604+0000","last_peered":"2023-11-28T20:02:07.264604+0000","last_clean":"2023-11-28T20:02:07.264604+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:02:07.282823+0000","last_undegraded":"2023-11-28T20:02:07.282823+0000","last_fullsized":"2023-11-28T20:02:07.282823+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_clean_scrub_stamp":"2023-11-28T20:02:07.264604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.15","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-28T20:02:07.303262+0000","last_change":"2023-11-28T20:02:07.300162+0000","last_active":"2023-11-28T20:02:07.303262+0000","last_peered":"2023-11-28T20:02:07.303262+0000","last_clean":"2023-11-28T20:02:07.303262+0000","last_became_active":"2023-11-28T20:02:07.299792+0000","last_became_peered":"2023-11-28T20:02:07.299792+0000","last_unstale":"2023-11-28T20:02:07.303262+0000","last_undegraded":"2023-11-28T20:02:07.303262+0000","last_fullsized":"2023-11-28T20:02:07.303262+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:06.257335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:06.257335+0000","last_clean_scrub_stamp":"2023-11-28T20:02:06.257335+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:03:03.265026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.17","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2023-11-28T20:02:07.278623+0000","last_change":"2023-11-28T20:02:07.278623+0000","last_active":"2023-11-28T20:02:07.264604+0000","last_peered":"2023-11-28T20:02:07.264604+0000","last_clean":"2023-11-28T20:02:07.264604+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:02:07.278623+0000","last_undegraded":"2023-11-28T20:02:07.278623+0000","last_fullsized":"2023-11-28T20:02:07.278623+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_clean_scrub_stamp":"2023-11-28T20:02:07.264604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.14","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-28T20:02:07.297892+0000","last_change":"2023-11-28T20:02:07.296089+0000","last_active":"2023-11-28T20:02:07.297892+0000","last_peered":"2023-11-28T20:02:07.297892+0000","last_clean":"2023-11-28T20:02:07.297892+0000","last_became_active":"2023-11-28T20:02:07.295836+0000","last_became_peered":"2023-11-28T20:02:07.295836+0000","last_unstale":"2023-11-28T20:02:07.297892+0000","last_undegraded":"2023-11-28T20:02:07.297892+0000","last_fullsized":"2023-11-28T20:02:07.297892+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:06.257335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:06.257335+0000","last_clean_scrub_stamp":"2023-11-28T20:02:06.257335+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:40:58.188007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.10","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2023-11-28T20:02:07.278502+0000","last_change":"2023-11-28T20:02:07.278502+0000","last_active":"2023-11-28T20:02:07.264604+0000","last_peered":"2023-11-28T20:02:07.264604+0000","last_clean":"2023-11-28T20:02:07.264604+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:02:07.278502+0000","last_undegraded":"2023-11-28T20:02:07.278502+0000","last_fullsized":"2023-11-28T20:02:07.278502+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_clean_scrub_stamp":"2023-11-28T20:02:07.264604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.13","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-28T20:02:07.305695+0000","last_change":"2023-11-28T20:02:07.298781+0000","last_active":"2023-11-28T20:02:07.305695+0000","last_peered":"2023-11-28T20:02:07.305695+0000","last_clean":"2023-11-28T20:02:07.305695+0000","last_became_active":"2023-11-28T20:02:07.298318+0000","last_became_peered":"2023-11-28T20:02:07.298318+0000","last_unstale":"2023-11-28T20:02:07.305695+0000","last_undegraded":"2023-11-28T20:02:07.305695+0000","last_fullsized":"2023-11-28T20:02:07.305695+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:06.257335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:06.257335+0000","last_clean_scrub_stamp":"2023-11-28T20:02:06.257335+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:40:58.188007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.11","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2023-11-28T20:02:07.278215+0000","last_change":"2023-11-28T20:02:07.278215+0000","last_active":"2023-11-28T20:02:07.264604+0000","last_peered":"2023-11-28T20:02:07.264604+0000","last_clean":"2023-11-28T20:02:07.264604+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:02:07.278215+0000","last_undegraded":"2023-11-28T20:02:07.278215+0000","last_fullsized":"2023-11-28T20:02:07.278215+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_clean_scrub_stamp":"2023-11-28T20:02:07.264604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.12","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-28T20:02:07.296902+0000","last_change":"2023-11-28T20:02:07.293203+0000","last_active":"2023-11-28T20:02:07.296902+0000","last_peered":"2023-11-28T20:02:07.296902+0000","last_clean":"2023-11-28T20:02:07.296902+0000","last_became_active":"2023-11-28T20:02:07.292922+0000","last_became_peered":"2023-11-28T20:02:07.292922+0000","last_unstale":"2023-11-28T20:02:07.296902+0000","last_undegraded":"2023-11-28T20:02:07.296902+0000","last_fullsized":"2023-11-28T20:02:07.296902+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:06.257335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:06.257335+0000","last_clean_scrub_stamp":"2023-11-28T20:02:06.257335+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:11:12.221383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.12","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2023-11-28T20:02:07.283056+0000","last_change":"2023-11-28T20:02:07.283056+0000","last_active":"2023-11-28T20:02:07.264604+0000","last_peered":"2023-11-28T20:02:07.264604+0000","last_clean":"2023-11-28T20:02:07.264604+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:02:07.283056+0000","last_undegraded":"2023-11-28T20:02:07.283056+0000","last_fullsized":"2023-11-28T20:02:07.283056+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_clean_scrub_stamp":"2023-11-28T20:02:07.264604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.11","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-28T20:02:07.299965+0000","last_change":"2023-11-28T20:02:07.291824+0000","last_active":"2023-11-28T20:02:07.299965+0000","last_peered":"2023-11-28T20:02:07.299965+0000","last_clean":"2023-11-28T20:02:07.299965+0000","last_became_active":"2023-11-28T20:02:07.291575+0000","last_became_peered":"2023-11-28T20:02:07.291575+0000","last_unstale":"2023-11-28T20:02:07.299965+0000","last_undegraded":"2023-11-28T20:02:07.299965+0000","last_fullsized":"2023-11-28T20:02:07.299965+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:06.257335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:06.257335+0000","last_clean_scrub_stamp":"2023-11-28T20:02:06.257335+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:32:46.550427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.13","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2023-11-28T20:02:07.280802+0000","last_change":"2023-11-28T20:02:07.280802+0000","last_active":"2023-11-28T20:02:07.264604+0000","last_peered":"2023-11-28T20:02:07.264604+0000","last_clean":"2023-11-28T20:02:07.264604+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:02:07.280802+0000","last_undegraded":"2023-11-28T20:02:07.280802+0000","last_fullsized":"2023-11-28T20:02:07.280802+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_clean_scrub_stamp":"2023-11-28T20:02:07.264604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.10","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-28T20:02:07.301395+0000","last_change":"2023-11-28T20:02:07.295459+0000","last_active":"2023-11-28T20:02:07.301395+0000","last_peered":"2023-11-28T20:02:07.301395+0000","last_clean":"2023-11-28T20:02:07.301395+0000","last_became_active":"2023-11-28T20:02:07.295090+0000","last_became_peered":"2023-11-28T20:02:07.295090+0000","last_unstale":"2023-11-28T20:02:07.301395+0000","last_undegraded":"2023-11-28T20:02:07.301395+0000","last_fullsized":"2023-11-28T20:02:07.301395+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:06.257335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:06.257335+0000","last_clean_scrub_stamp":"2023-11-28T20:02:06.257335+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:42:57.441074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.c","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2023-11-28T20:02:07.279835+0000","last_change":"2023-11-28T20:02:07.279835+0000","last_active":"2023-11-28T20:02:07.264604+0000","last_peered":"2023-11-28T20:02:07.264604+0000","last_clean":"2023-11-28T20:02:07.264604+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:02:07.279835+0000","last_undegraded":"2023-11-28T20:02:07.279835+0000","last_fullsized":"2023-11-28T20:02:07.279835+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_clean_scrub_stamp":"2023-11-28T20:02:07.264604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.f","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-28T20:02:07.301507+0000","last_change":"2023-11-28T20:02:07.295608+0000","last_active":"2023-11-28T20:02:07.301507+0000","last_peered":"2023-11-28T20:02:07.301507+0000","last_clean":"2023-11-28T20:02:07.301507+0000","last_became_active":"2023-11-28T20:02:07.295293+0000","last_became_peered":"2023-11-28T20:02:07.295293+0000","last_unstale":"2023-11-28T20:02:07.301507+0000","last_undegraded":"2023-11-28T20:02:07.301507+0000","last_fullsized":"2023-11-28T20:02:07.301507+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:06.257335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:06.257335+0000","last_clean_scrub_stamp":"2023-11-28T20:02:06.257335+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:32:46.550427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.d","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2023-11-28T20:02:07.288189+0000","last_change":"2023-11-28T20:02:07.288189+0000","last_active":"2023-11-28T20:02:07.264604+0000","last_peered":"2023-11-28T20:02:07.264604+0000","last_clean":"2023-11-28T20:02:07.264604+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:02:07.288189+0000","last_undegraded":"2023-11-28T20:02:07.288189+0000","last_fullsized":"2023-11-28T20:02:07.288189+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_clean_scrub_stamp":"2023-11-28T20:02:07.264604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.e","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-28T20:02:07.306531+0000","last_change":"2023-11-28T20:02:07.300742+0000","last_active":"2023-11-28T20:02:07.306531+0000","last_peered":"2023-11-28T20:02:07.306531+0000","last_clean":"2023-11-28T20:02:07.306531+0000","last_became_active":"2023-11-28T20:02:07.300392+0000","last_became_peered":"2023-11-28T20:02:07.300392+0000","last_unstale":"2023-11-28T20:02:07.306531+0000","last_undegraded":"2023-11-28T20:02:07.306531+0000","last_fullsized":"2023-11-28T20:02:07.306531+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:06.257335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:06.257335+0000","last_clean_scrub_stamp":"2023-11-28T20:02:06.257335+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T06:29:20.315585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.e","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2023-11-28T20:02:07.280313+0000","last_change":"2023-11-28T20:02:07.280313+0000","last_active":"2023-11-28T20:02:07.264604+0000","last_peered":"2023-11-28T20:02:07.264604+0000","last_clean":"2023-11-28T20:02:07.264604+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:02:07.280313+0000","last_undegraded":"2023-11-28T20:02:07.280313+0000","last_fullsized":"2023-11-28T20:02:07.280313+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_clean_scrub_stamp":"2023-11-28T20:02:07.264604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.d","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-28T20:02:07.305924+0000","last_change":"2023-11-28T20:02:07.301258+0000","last_active":"2023-11-28T20:02:07.305924+0000","last_peered":"2023-11-28T20:02:07.305924+0000","last_clean":"2023-11-28T20:02:07.305924+0000","last_became_active":"2023-11-28T20:02:07.300955+0000","last_became_peered":"2023-11-28T20:02:07.300955+0000","last_unstale":"2023-11-28T20:02:07.305924+0000","last_undegraded":"2023-11-28T20:02:07.305924+0000","last_fullsized":"2023-11-28T20:02:07.305924+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:06.257335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:06.257335+0000","last_clean_scrub_stamp":"2023-11-28T20:02:06.257335+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:03:27.733474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.8","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2023-11-28T20:02:07.279591+0000","last_change":"2023-11-28T20:02:07.279591+0000","last_active":"2023-11-28T20:02:07.264604+0000","last_peered":"2023-11-28T20:02:07.264604+0000","last_clean":"2023-11-28T20:02:07.264604+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:02:07.279591+0000","last_undegraded":"2023-11-28T20:02:07.279591+0000","last_fullsized":"2023-11-28T20:02:07.279591+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_clean_scrub_stamp":"2023-11-28T20:02:07.264604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.b","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-28T20:02:07.302648+0000","last_change":"2023-11-28T20:02:07.295857+0000","last_active":"2023-11-28T20:02:07.302648+0000","last_peered":"2023-11-28T20:02:07.302648+0000","last_clean":"2023-11-28T20:02:07.302648+0000","last_became_active":"2023-11-28T20:02:07.295642+0000","last_became_peered":"2023-11-28T20:02:07.295642+0000","last_unstale":"2023-11-28T20:02:07.302648+0000","last_undegraded":"2023-11-28T20:02:07.302648+0000","last_fullsized":"2023-11-28T20:02:07.302648+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:06.257335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:06.257335+0000","last_clean_scrub_stamp":"2023-11-28T20:02:06.257335+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:58:36.949904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.9","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2023-11-28T20:02:07.278282+0000","last_change":"2023-11-28T20:02:07.278282+0000","last_active":"2023-11-28T20:02:07.264604+0000","last_peered":"2023-11-28T20:02:07.264604+0000","last_clean":"2023-11-28T20:02:07.264604+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:02:07.278282+0000","last_undegraded":"2023-11-28T20:02:07.278282+0000","last_fullsized":"2023-11-28T20:02:07.278282+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_clean_scrub_stamp":"2023-11-28T20:02:07.264604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.a","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-28T20:02:07.299829+0000","last_change":"2023-11-28T20:02:07.296302+0000","last_active":"2023-11-28T20:02:07.299829+0000","last_peered":"2023-11-28T20:02:07.299829+0000","last_clean":"2023-11-28T20:02:07.299829+0000","last_became_active":"2023-11-28T20:02:07.296048+0000","last_became_peered":"2023-11-28T20:02:07.296048+0000","last_unstale":"2023-11-28T20:02:07.299829+0000","last_undegraded":"2023-11-28T20:02:07.299829+0000","last_fullsized":"2023-11-28T20:02:07.299829+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:06.257335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:06.257335+0000","last_clean_scrub_stamp":"2023-11-28T20:02:06.257335+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:01:27.566717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.a","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2023-11-28T20:02:07.279215+0000","last_change":"2023-11-28T20:02:07.279215+0000","last_active":"2023-11-28T20:02:07.264604+0000","last_peered":"2023-11-28T20:02:07.264604+0000","last_clean":"2023-11-28T20:02:07.264604+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:02:07.279215+0000","last_undegraded":"2023-11-28T20:02:07.279215+0000","last_fullsized":"2023-11-28T20:02:07.279215+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_clean_scrub_stamp":"2023-11-28T20:02:07.264604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.9","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-28T20:02:07.305776+0000","last_change":"2023-11-28T20:02:07.296576+0000","last_active":"2023-11-28T20:02:07.305776+0000","last_peered":"2023-11-28T20:02:07.305776+0000","last_clean":"2023-11-28T20:02:07.305776+0000","last_became_active":"2023-11-28T20:02:07.295982+0000","last_became_peered":"2023-11-28T20:02:07.295982+0000","last_unstale":"2023-11-28T20:02:07.305776+0000","last_undegraded":"2023-11-28T20:02:07.305776+0000","last_fullsized":"2023-11-28T20:02:07.305776+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:06.257335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:06.257335+0000","last_clean_scrub_stamp":"2023-11-28T20:02:06.257335+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:49:04.193812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.b","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2023-11-28T20:02:07.286137+0000","last_change":"2023-11-28T20:02:07.286137+0000","last_active":"2023-11-28T20:02:07.264604+0000","last_peered":"2023-11-28T20:02:07.264604+0000","last_clean":"2023-11-28T20:02:07.264604+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:02:07.286137+0000","last_undegraded":"2023-11-28T20:02:07.286137+0000","last_fullsized":"2023-11-28T20:02:07.286137+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_clean_scrub_stamp":"2023-11-28T20:02:07.264604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.8","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-28T20:02:07.297499+0000","last_change":"2023-11-28T20:02:07.293087+0000","last_active":"2023-11-28T20:02:07.297499+0000","last_peered":"2023-11-28T20:02:07.297499+0000","last_clean":"2023-11-28T20:02:07.297499+0000","last_became_active":"2023-11-28T20:02:07.292815+0000","last_became_peered":"2023-11-28T20:02:07.292815+0000","last_unstale":"2023-11-28T20:02:07.297499+0000","last_undegraded":"2023-11-28T20:02:07.297499+0000","last_fullsized":"2023-11-28T20:02:07.297499+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:06.257335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:06.257335+0000","last_clean_scrub_stamp":"2023-11-28T20:02:06.257335+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T06:11:16.542043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.4","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2023-11-28T20:02:07.287644+0000","last_change":"2023-11-28T20:02:07.287644+0000","last_active":"2023-11-28T20:02:07.264604+0000","last_peered":"2023-11-28T20:02:07.264604+0000","last_clean":"2023-11-28T20:02:07.264604+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:02:07.287644+0000","last_undegraded":"2023-11-28T20:02:07.287644+0000","last_fullsized":"2023-11-28T20:02:07.287644+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_clean_scrub_stamp":"2023-11-28T20:02:07.264604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.7","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-28T20:02:07.301899+0000","last_change":"2023-11-28T20:02:07.296980+0000","last_active":"2023-11-28T20:02:07.301899+0000","last_peered":"2023-11-28T20:02:07.301899+0000","last_clean":"2023-11-28T20:02:07.301899+0000","last_became_active":"2023-11-28T20:02:07.296625+0000","last_became_peered":"2023-11-28T20:02:07.296625+0000","last_unstale":"2023-11-28T20:02:07.301899+0000","last_undegraded":"2023-11-28T20:02:07.301899+0000","last_fullsized":"2023-11-28T20:02:07.301899+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:06.257335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:06.257335+0000","last_clean_scrub_stamp":"2023-11-28T20:02:06.257335+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:53:41.844853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.5","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2023-11-28T20:02:07.286312+0000","last_change":"2023-11-28T20:02:07.286312+0000","last_active":"2023-11-28T20:02:07.264604+0000","last_peered":"2023-11-28T20:02:07.264604+0000","last_clean":"2023-11-28T20:02:07.264604+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:02:07.286312+0000","last_undegraded":"2023-11-28T20:02:07.286312+0000","last_fullsized":"2023-11-28T20:02:07.286312+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_clean_scrub_stamp":"2023-11-28T20:02:07.264604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.6","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-28T20:02:07.298993+0000","last_change":"2023-11-28T20:02:07.296643+0000","last_active":"2023-11-28T20:02:07.298993+0000","last_peered":"2023-11-28T20:02:07.298993+0000","last_clean":"2023-11-28T20:02:07.298993+0000","last_became_active":"2023-11-28T20:02:07.296369+0000","last_became_peered":"2023-11-28T20:02:07.296369+0000","last_unstale":"2023-11-28T20:02:07.298993+0000","last_undegraded":"2023-11-28T20:02:07.298993+0000","last_fullsized":"2023-11-28T20:02:07.298993+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:06.257335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:06.257335+0000","last_clean_scrub_stamp":"2023-11-28T20:02:06.257335+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:52:33.501263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.6","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2023-11-28T20:02:07.284421+0000","last_change":"2023-11-28T20:02:07.284421+0000","last_active":"2023-11-28T20:02:07.264604+0000","last_peered":"2023-11-28T20:02:07.264604+0000","last_clean":"2023-11-28T20:02:07.264604+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:02:07.284421+0000","last_undegraded":"2023-11-28T20:02:07.284421+0000","last_fullsized":"2023-11-28T20:02:07.284421+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_clean_scrub_stamp":"2023-11-28T20:02:07.264604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.5","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-28T20:02:07.303244+0000","last_change":"2023-11-28T20:02:07.300054+0000","last_active":"2023-11-28T20:02:07.303244+0000","last_peered":"2023-11-28T20:02:07.303244+0000","last_clean":"2023-11-28T20:02:07.303244+0000","last_became_active":"2023-11-28T20:02:07.298610+0000","last_became_peered":"2023-11-28T20:02:07.298610+0000","last_unstale":"2023-11-28T20:02:07.303244+0000","last_undegraded":"2023-11-28T20:02:07.303244+0000","last_fullsized":"2023-11-28T20:02:07.303244+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:06.257335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:06.257335+0000","last_clean_scrub_stamp":"2023-11-28T20:02:06.257335+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:59:20.247089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.7","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2023-11-28T20:02:07.280140+0000","last_change":"2023-11-28T20:02:07.280140+0000","last_active":"2023-11-28T20:02:07.264604+0000","last_peered":"2023-11-28T20:02:07.264604+0000","last_clean":"2023-11-28T20:02:07.264604+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:02:07.280140+0000","last_undegraded":"2023-11-28T20:02:07.280140+0000","last_fullsized":"2023-11-28T20:02:07.280140+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_clean_scrub_stamp":"2023-11-28T20:02:07.264604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.4","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-28T20:02:07.303568+0000","last_change":"2023-11-28T20:02:07.301572+0000","last_active":"2023-11-28T20:02:07.303568+0000","last_peered":"2023-11-28T20:02:07.303568+0000","last_clean":"2023-11-28T20:02:07.303568+0000","last_became_active":"2023-11-28T20:02:07.301226+0000","last_became_peered":"2023-11-28T20:02:07.301226+0000","last_unstale":"2023-11-28T20:02:07.303568+0000","last_undegraded":"2023-11-28T20:02:07.303568+0000","last_fullsized":"2023-11-28T20:02:07.303568+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:06.257335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:06.257335+0000","last_clean_scrub_stamp":"2023-11-28T20:02:06.257335+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:48:42.567546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.0","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2023-11-28T20:02:07.281665+0000","last_change":"2023-11-28T20:02:07.281665+0000","last_active":"2023-11-28T20:02:07.264604+0000","last_peered":"2023-11-28T20:02:07.264604+0000","last_clean":"2023-11-28T20:02:07.264604+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:02:07.281665+0000","last_undegraded":"2023-11-28T20:02:07.281665+0000","last_fullsized":"2023-11-28T20:02:07.281665+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_clean_scrub_stamp":"2023-11-28T20:02:07.264604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.3","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-28T20:02:07.297690+0000","last_change":"2023-11-28T20:02:07.294264+0000","last_active":"2023-11-28T20:02:07.297690+0000","last_peered":"2023-11-28T20:02:07.297690+0000","last_clean":"2023-11-28T20:02:07.297690+0000","last_became_active":"2023-11-28T20:02:07.293763+0000","last_became_peered":"2023-11-28T20:02:07.293763+0000","last_unstale":"2023-11-28T20:02:07.297690+0000","last_undegraded":"2023-11-28T20:02:07.297690+0000","last_fullsized":"2023-11-28T20:02:07.297690+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:06.257335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:06.257335+0000","last_clean_scrub_stamp":"2023-11-28T20:02:06.257335+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:10:34.198054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.1","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2023-11-28T20:02:07.281971+0000","last_change":"2023-11-28T20:02:07.281971+0000","last_active":"2023-11-28T20:02:07.264604+0000","last_peered":"2023-11-28T20:02:07.264604+0000","last_clean":"2023-11-28T20:02:07.264604+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:02:07.281971+0000","last_undegraded":"2023-11-28T20:02:07.281971+0000","last_fullsized":"2023-11-28T20:02:07.281971+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_clean_scrub_stamp":"2023-11-28T20:02:07.264604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.2","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-28T20:02:07.305772+0000","last_change":"2023-11-28T20:02:07.299946+0000","last_active":"2023-11-28T20:02:07.305772+0000","last_peered":"2023-11-28T20:02:07.305772+0000","last_clean":"2023-11-28T20:02:07.305772+0000","last_became_active":"2023-11-28T20:02:07.299678+0000","last_became_peered":"2023-11-28T20:02:07.299678+0000","last_unstale":"2023-11-28T20:02:07.305772+0000","last_undegraded":"2023-11-28T20:02:07.305772+0000","last_fullsized":"2023-11-28T20:02:07.305772+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:06.257335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:06.257335+0000","last_clean_scrub_stamp":"2023-11-28T20:02:06.257335+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:46:58.325801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.2","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2023-11-28T20:02:07.284520+0000","last_change":"2023-11-28T20:02:07.284520+0000","last_active":"2023-11-28T20:02:07.264604+0000","last_peered":"2023-11-28T20:02:07.264604+0000","last_clean":"2023-11-28T20:02:07.264604+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:02:07.284520+0000","last_undegraded":"2023-11-28T20:02:07.284520+0000","last_fullsized":"2023-11-28T20:02:07.284520+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_clean_scrub_stamp":"2023-11-28T20:02:07.264604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-28T20:02:07.301562+0000","last_change":"2023-11-28T20:02:07.297766+0000","last_active":"2023-11-28T20:02:07.301562+0000","last_peered":"2023-11-28T20:02:07.301562+0000","last_clean":"2023-11-28T20:02:07.301562+0000","last_became_active":"2023-11-28T20:02:07.297403+0000","last_became_peered":"2023-11-28T20:02:07.297403+0000","last_unstale":"2023-11-28T20:02:07.301562+0000","last_undegraded":"2023-11-28T20:02:07.301562+0000","last_fullsized":"2023-11-28T20:02:07.301562+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:06.257335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:06.257335+0000","last_clean_scrub_stamp":"2023-11-28T20:02:06.257335+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T07:05:17.648805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.3","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2023-11-28T20:02:07.285711+0000","last_change":"2023-11-28T20:02:07.285711+0000","last_active":"2023-11-28T20:02:07.264604+0000","last_peered":"2023-11-28T20:02:07.264604+0000","last_clean":"2023-11-28T20:02:07.264604+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:02:07.285711+0000","last_undegraded":"2023-11-28T20:02:07.285711+0000","last_fullsized":"2023-11-28T20:02:07.285711+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_clean_scrub_stamp":"2023-11-28T20:02:07.264604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.0","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-28T20:02:07.306551+0000","last_change":"2023-11-28T20:02:07.300917+0000","last_active":"2023-11-28T20:02:07.306551+0000","last_peered":"2023-11-28T20:02:07.306551+0000","last_clean":"2023-11-28T20:02:07.306551+0000","last_became_active":"2023-11-28T20:02:07.300632+0000","last_became_peered":"2023-11-28T20:02:07.300632+0000","last_unstale":"2023-11-28T20:02:07.306551+0000","last_undegraded":"2023-11-28T20:02:07.306551+0000","last_fullsized":"2023-11-28T20:02:07.306551+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:06.257335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:06.257335+0000","last_clean_scrub_stamp":"2023-11-28T20:02:06.257335+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:10:34.198054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.f","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2023-11-28T20:02:07.288389+0000","last_change":"2023-11-28T20:02:07.288389+0000","last_active":"2023-11-28T20:02:07.264604+0000","last_peered":"2023-11-28T20:02:07.264604+0000","last_clean":"2023-11-28T20:02:07.264604+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:02:07.288389+0000","last_undegraded":"2023-11-28T20:02:07.288389+0000","last_fullsized":"2023-11-28T20:02:07.288389+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_clean_scrub_stamp":"2023-11-28T20:02:07.264604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.c","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-28T20:02:07.300002+0000","last_change":"2023-11-28T20:02:07.293843+0000","last_active":"2023-11-28T20:02:07.300002+0000","last_peered":"2023-11-28T20:02:07.300002+0000","last_clean":"2023-11-28T20:02:07.300002+0000","last_became_active":"2023-11-28T20:02:07.293538+0000","last_became_peered":"2023-11-28T20:02:07.293538+0000","last_unstale":"2023-11-28T20:02:07.300002+0000","last_undegraded":"2023-11-28T20:02:07.300002+0000","last_fullsized":"2023-11-28T20:02:07.300002+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:06.257335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:06.257335+0000","last_clean_scrub_stamp":"2023-11-28T20:02:06.257335+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T07:05:17.648805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":215,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-28T20:02:06.276288+0000","last_change":"2023-11-28T19:58:56.136501+0000","last_active":"2023-11-28T20:02:06.276288+0000","last_peered":"2023-11-28T20:02:06.276288+0000","last_clean":"2023-11-28T20:02:06.276288+0000","last_became_active":"2023-11-28T19:58:56.135998+0000","last_became_peered":"2023-11-28T19:58:56.135998+0000","last_unstale":"2023-11-28T20:02:06.276288+0000","last_undegraded":"2023-11-28T20:02:06.276288+0000","last_fullsized":"2023-11-28T20:02:06.276288+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:58:54.602349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:58:54.602349+0000","last_clean_scrub_stamp":"2023-11-28T19:58:54.602349+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:33:42.723349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":13,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":14,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":66748,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574891,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32200,"kb_used_data":1016,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339640,"statfs":{"total":96636764160,"available":96603791360,"internally_reserved":0,"allocated":1040384,"data_stored":1046204,"data_compressed":33374,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 20:01:59 2023","interfaces":[{"interface":"back","average":{"1min":0.66000000000000003,"5min":0.67100000000000004,"15min":0.67600000000000005},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.94299999999999995,"5min":0.94299999999999995,"15min":0.94299999999999995},"last":0.71299999999999997},{"interface":"front","average":{"1min":0.66500000000000004,"5min":0.67000000000000004,"15min":0.68000000000000005},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":1.014,"5min":1.014,"15min":1.014},"last":0.73199999999999998}]},{"osd":1,"last update":"Tue Nov 28 20:01:59 2023","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.63900000000000001,"15min":0.64300000000000002},"min":{"1min":0.46100000000000002,"5min":0.438,"15min":0.438},"max":{"1min":0.95099999999999996,"5min":0.95099999999999996,"15min":0.95099999999999996},"last":0.621},{"interface":"front","average":{"1min":0.66400000000000003,"5min":0.68100000000000005,"15min":0.69499999999999995},"min":{"1min":0.45600000000000002,"5min":0.432,"15min":0.432},"max":{"1min":0.85099999999999998,"5min":1.0900000000000001,"15min":1.0900000000000001},"last":0.59199999999999997}]},{"osd":2,"last update":"Tue Nov 28 20:01:59 2023","interfaces":[{"interface":"back","average":{"1min":0.69899999999999995,"5min":0.70899999999999996,"15min":0.72599999999999998},"min":{"1min":0.497,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.93100000000000005,"5min":0.98799999999999999,"15min":0.98799999999999999},"last":0.84099999999999997},{"interface":"front","average":{"1min":0.66800000000000004,"5min":0.68799999999999994,"15min":0.69999999999999996},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":1.514,"5min":1.514,"15min":1.514},"last":0.53200000000000003}]},{"osd":3,"last update":"Tue Nov 28 20:01:59 2023","interfaces":[{"interface":"back","average":{"1min":0.68200000000000005,"5min":0.69699999999999995,"15min":0.69899999999999995},"min":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":0.90200000000000002,"5min":1.0449999999999999,"15min":1.0449999999999999},"last":0.69299999999999995},{"interface":"front","average":{"1min":0.70899999999999996,"5min":0.76600000000000001,"15min":0.78400000000000003},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":1.034,"5min":1.1299999999999999,"15min":1.1299999999999999},"last":0.79300000000000004}]},{"osd":4,"last update":"Tue Nov 28 20:01:59 2023","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.628,"15min":0.63700000000000001},"min":{"1min":0.38900000000000001,"5min":0.378,"15min":0.378},"max":{"1min":1.2829999999999999,"5min":1.2829999999999999,"15min":1.2829999999999999},"last":0.65800000000000003},{"interface":"front","average":{"1min":0.66800000000000004,"5min":0.70899999999999996,"15min":0.72499999999999998},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.91800000000000004,"5min":1.1120000000000001,"15min":1.1120000000000001},"last":0.82199999999999995}]},{"osd":5,"last update":"Tue Nov 28 20:01:59 2023","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.65300000000000002,"15min":0.67400000000000004},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.97999999999999998,"5min":1.1699999999999999,"15min":1.1699999999999999},"last":0.751},{"interface":"front","average":{"1min":0.70899999999999996,"5min":0.73699999999999999,"15min":0.75600000000000001},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":1.3300000000000001,"5min":1.3300000000000001,"15min":1.3300000000000001},"last":0.76700000000000002}]},{"osd":6,"last update":"Tue Nov 28 20:01:59 2023","interfaces":[{"interface":"back","average":{"1min":0.76000000000000001,"5min":0.76400000000000001,"15min":0.77600000000000002},"min":{"1min":0.53500000000000003,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":1.3919999999999999,"5min":1.3919999999999999,"15min":1.3919999999999999},"last":0.85899999999999999},{"interface":"front","average":{"1min":0.67000000000000004,"5min":0.71199999999999997,"15min":0.73499999999999999},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.96099999999999997,"5min":1.23,"15min":1.23},"last":0.88600000000000001}]}]},{"osd":6,"up_from":13,"seq":55834574889,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27976,"kb_used_data":952,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343864,"statfs":{"total":96636764160,"available":96608116736,"internally_reserved":0,"allocated":974848,"data_stored":455836,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 20:01:54 2023","interfaces":[{"interface":"back","average":{"1min":0.64000000000000001,"5min":0.621,"15min":0.61699999999999999},"min":{"1min":0.40200000000000002,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.91600000000000004,"5min":0.91600000000000004,"15min":0.91600000000000004},"last":0.627},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.66000000000000003,"15min":0.66200000000000003},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":0.80600000000000005,"5min":0.98999999999999999,"15min":0.98999999999999999},"last":0.68000000000000005}]},{"osd":1,"last update":"Tue Nov 28 20:01:54 2023","interfaces":[{"interface":"back","average":{"1min":0.71499999999999997,"5min":0.76600000000000001,"15min":0.78200000000000003},"min":{"1min":0.54700000000000004,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.012,"5min":1.105,"15min":1.105},"last":0.78300000000000003},{"interface":"front","average":{"1min":0.62,"5min":0.67600000000000005,"15min":0.68300000000000005},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":0.90200000000000002,"5min":0.95899999999999996,"15min":0.95899999999999996},"last":0.60899999999999999}]},{"osd":2,"last update":"Tue Nov 28 20:01:54 2023","interfaces":[{"interface":"back","average":{"1min":0.63800000000000001,"5min":0.68200000000000005,"15min":0.69399999999999995},"min":{"1min":0.502,"5min":0.502,"15min":0.502},"max":{"1min":0.78900000000000003,"5min":0.93400000000000005,"15min":0.93400000000000005},"last":0.66900000000000004},{"interface":"front","average":{"1min":0.65800000000000003,"5min":0.70399999999999996,"15min":0.71399999999999997},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":0.95299999999999996,"5min":1.006,"15min":1.006},"last":0.69999999999999996}]},{"osd":3,"last update":"Tue Nov 28 20:01:54 2023","interfaces":[{"interface":"back","average":{"1min":0.68300000000000005,"5min":0.72799999999999998,"15min":0.74199999999999999},"min":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":0.96699999999999997,"5min":1.056,"15min":1.056},"last":0.80600000000000005},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.66600000000000004,"15min":0.67800000000000005},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":0.78200000000000003,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.63900000000000001}]},{"osd":4,"last update":"Tue Nov 28 20:01:54 2023","interfaces":[{"interface":"back","average":{"1min":0.61299999999999999,"5min":0.624,"15min":0.628},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.93300000000000005,"5min":0.97599999999999998,"15min":0.97599999999999998},"last":0.55400000000000005},{"interface":"front","average":{"1min":0.61499999999999999,"5min":0.68700000000000006,"15min":0.72099999999999997},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.91700000000000004,"5min":1.389,"15min":1.389},"last":0.71399999999999997}]},{"osd":5,"last update":"Tue Nov 28 20:01:54 2023","interfaces":[{"interface":"back","average":{"1min":0.68799999999999994,"5min":0.77100000000000002,"15min":0.80100000000000005},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":1.0629999999999999,"5min":1.4259999999999999,"15min":1.4259999999999999},"last":0.749},{"interface":"front","average":{"1min":0.65600000000000003,"5min":0.72999999999999998,"15min":0.752},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.97099999999999997,"5min":1.276,"15min":1.276},"last":0.65600000000000003}]},{"osd":7,"last update":"Tue Nov 28 20:01:54 2023","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.67900000000000005,"15min":0.70299999999999996},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.84199999999999997,"5min":1.014,"15min":1.014},"last":0.58299999999999996},{"interface":"front","average":{"1min":0.68200000000000005,"5min":0.77900000000000003,"15min":0.81299999999999994},"min":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":1.002,"5min":1.242,"15min":1.242},"last":0.73599999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574891,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32136,"kb_used_data":952,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339704,"statfs":{"total":96636764160,"available":96603856896,"internally_reserved":0,"allocated":974848,"data_stored":455836,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 20:01:59 2023","interfaces":[{"interface":"back","average":{"1min":0.66500000000000004,"5min":0.68400000000000005,"15min":0.70099999999999996},"min":{"1min":0.44400000000000001,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":1.077,"5min":1.077,"15min":1.077},"last":0.56100000000000005},{"interface":"front","average":{"1min":0.65300000000000002,"5min":0.68500000000000005,"15min":0.70699999999999996},"min":{"1min":0.41899999999999998,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.94599999999999995,"5min":1.149,"15min":1.149},"last":0.67800000000000005}]},{"osd":1,"last update":"Tue Nov 28 20:01:59 2023","interfaces":[{"interface":"back","average":{"1min":0.626,"5min":0.68600000000000005,"15min":0.70399999999999996},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.82599999999999996,"5min":0.94499999999999995,"15min":0.94499999999999995},"last":0.63100000000000001},{"interface":"front","average":{"1min":0.67400000000000004,"5min":0.69299999999999995,"15min":0.71699999999999997},"min":{"1min":0.49099999999999999,"5min":0.38,"15min":0.38},"max":{"1min":1.008,"5min":1.0940000000000001,"15min":1.0940000000000001},"last":0.52200000000000002}]},{"osd":2,"last update":"Tue Nov 28 20:01:59 2023","interfaces":[{"interface":"back","average":{"1min":0.65400000000000003,"5min":0.83299999999999996,"15min":0.90800000000000003},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":1.044,"5min":5.0880000000000001,"15min":5.0880000000000001},"last":0.83099999999999996},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.879,"15min":0.96099999999999997},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":0.91300000000000003,"5min":5.1399999999999997,"15min":5.1399999999999997},"last":0.76200000000000001}]},{"osd":3,"last update":"Tue Nov 28 20:01:59 2023","interfaces":[{"interface":"back","average":{"1min":0.71499999999999997,"5min":0.90100000000000002,"15min":0.98499999999999999},"min":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":1.1000000000000001,"5min":5.0469999999999997,"15min":5.0469999999999997},"last":0.92900000000000005},{"interface":"front","average":{"1min":0.69999999999999996,"5min":0.878,"15min":0.95999999999999996},"min":{"1min":0.47899999999999998,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":0.95899999999999996,"5min":5.024,"15min":5.024},"last":0.80600000000000005}]},{"osd":4,"last update":"Tue Nov 28 20:01:59 2023","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.64000000000000001,"15min":0.66400000000000003},"min":{"1min":0.42899999999999999,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.877,"5min":1.4810000000000001,"15min":1.4810000000000001},"last":0.71399999999999997},{"interface":"front","average":{"1min":0.67300000000000004,"5min":0.72099999999999997,"15min":0.73799999999999999},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.97599999999999998,"5min":1.6339999999999999,"15min":1.6339999999999999},"last":0.88300000000000001}]},{"osd":6,"last update":"Tue Nov 28 20:01:59 2023","interfaces":[{"interface":"back","average":{"1min":0.70699999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"min":{"1min":0.48399999999999999,"5min":0.434,"15min":0.434},"max":{"1min":1.0489999999999999,"5min":1.0489999999999999,"15min":1.0489999999999999},"last":0.86099999999999999},{"interface":"front","average":{"1min":0.68899999999999995,"5min":0.72499999999999998,"15min":0.73999999999999999},"min":{"1min":0.47599999999999998,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":0.93200000000000005,"5min":1.099,"15min":1.099},"last":0.90400000000000003}]},{"osd":7,"last update":"Tue Nov 28 20:01:59 2023","interfaces":[{"interface":"back","average":{"1min":0.73599999999999999,"5min":0.77300000000000002,"15min":0.78200000000000003},"min":{"1min":0.48899999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":1.022,"5min":1.236,"15min":1.236},"last":0.96099999999999997},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.78300000000000003,"15min":0.79500000000000004},"min":{"1min":0.51100000000000001,"5min":0.505,"15min":0.505},"max":{"1min":1.1000000000000001,"5min":1.1000000000000001,"15min":1.1000000000000001},"last":0.94499999999999995}]}]},{"osd":4,"up_from":13,"seq":55834574890,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32136,"kb_used_data":952,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339704,"statfs":{"total":96636764160,"available":96603856896,"internally_reserved":0,"allocated":974848,"data_stored":455836,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 20:01:58 2023","interfaces":[{"interface":"back","average":{"1min":0.70799999999999996,"5min":0.69399999999999995,"15min":0.70499999999999996},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":1.107,"5min":1.107,"15min":1.107},"last":0.55600000000000005},{"interface":"front","average":{"1min":0.63200000000000001,"5min":0.68300000000000005,"15min":0.70299999999999996},"min":{"1min":0.42799999999999999,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":1.024,"5min":1.163,"15min":1.163},"last":0.53000000000000003}]},{"osd":1,"last update":"Tue Nov 28 20:01:58 2023","interfaces":[{"interface":"back","average":{"1min":0.64400000000000002,"5min":0.71199999999999997,"15min":0.746},"min":{"1min":0.432,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.93799999999999994,"5min":1.111,"15min":1.111},"last":0.41499999999999998},{"interface":"front","average":{"1min":0.77600000000000002,"5min":0.78000000000000003,"15min":0.80200000000000005},"min":{"1min":0.629,"5min":0.443,"15min":0.443},"max":{"1min":1.0640000000000001,"5min":1.238,"15min":1.238},"last":0.60299999999999998}]},{"osd":2,"last update":"Tue Nov 28 20:01:58 2023","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.751,"15min":0.77200000000000002},"min":{"1min":0.48599999999999999,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":1.026,"5min":1.0669999999999999,"15min":1.0669999999999999},"last":0.73699999999999999},{"interface":"front","average":{"1min":0.754,"5min":0.77400000000000002,"15min":0.80200000000000005},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":1.1359999999999999,"5min":1.1359999999999999,"15min":1.1359999999999999},"last":0.71699999999999997}]},{"osd":3,"last update":"Tue Nov 28 20:01:58 2023","interfaces":[{"interface":"back","average":{"1min":0.69199999999999995,"5min":0.74399999999999999,"15min":0.78200000000000003},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":0.97999999999999998,"5min":1.202,"15min":1.202},"last":0.57899999999999996},{"interface":"front","average":{"1min":0.74199999999999999,"5min":0.76100000000000001,"15min":0.78400000000000003},"min":{"1min":0.52800000000000002,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":1.0669999999999999,"5min":1.0669999999999999,"15min":1.0669999999999999},"last":0.66400000000000003}]},{"osd":5,"last update":"Tue Nov 28 20:01:58 2023","interfaces":[{"interface":"back","average":{"1min":0.68600000000000005,"5min":0.69499999999999995,"15min":0.71399999999999997},"min":{"1min":0.41199999999999998,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.89600000000000002,"5min":0.95899999999999996,"15min":0.95899999999999996},"last":0.44400000000000001},{"interface":"front","average":{"1min":0.65600000000000003,"5min":0.68400000000000005,"15min":0.70399999999999996},"min":{"1min":0.435,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.90500000000000003,"5min":1.034,"15min":1.034},"last":0.625}]},{"osd":6,"last update":"Tue Nov 28 20:01:58 2023","interfaces":[{"interface":"back","average":{"1min":0.64500000000000002,"5min":0.69099999999999995,"15min":0.71999999999999997},"min":{"1min":0.45300000000000001,"5min":0.438,"15min":0.438},"max":{"1min":0.85299999999999998,"5min":1.0309999999999999,"15min":1.0309999999999999},"last":0.78900000000000003},{"interface":"front","average":{"1min":0.76300000000000001,"5min":0.76600000000000001,"15min":0.77800000000000002},"min":{"1min":0.55400000000000005,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":0.93999999999999995,"5min":1.002,"15min":1.002},"last":0.64500000000000002}]},{"osd":7,"last update":"Tue Nov 28 20:01:58 2023","interfaces":[{"interface":"back","average":{"1min":0.72699999999999998,"5min":0.75900000000000001,"15min":0.77800000000000002},"min":{"1min":0.57399999999999995,"5min":0.495,"15min":0.495},"max":{"1min":1.089,"5min":1.089,"15min":1.089},"last":0.69399999999999995},{"interface":"front","average":{"1min":0.81599999999999995,"5min":0.83699999999999997,"15min":0.85899999999999999},"min":{"1min":0.621,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":1.042,"5min":1.1459999999999999,"15min":1.1459999999999999},"last":0.76700000000000002}]}]},{"osd":3,"up_from":13,"seq":55834574891,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32136,"kb_used_data":952,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339704,"statfs":{"total":96636764160,"available":96603856896,"internally_reserved":0,"allocated":974848,"data_stored":455836,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 20:01:56 2023","interfaces":[{"interface":"back","average":{"1min":0.44900000000000001,"5min":0.441,"15min":0.44500000000000001},"min":{"1min":0.26300000000000001,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":1.7130000000000001,"5min":1.7130000000000001,"15min":1.7130000000000001},"last":0.38},{"interface":"front","average":{"1min":0.51400000000000001,"5min":0.46600000000000003,"15min":0.47099999999999997},"min":{"1min":0.27100000000000002,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":3.0630000000000002,"5min":3.0630000000000002,"15min":3.0630000000000002},"last":0.48799999999999999}]},{"osd":1,"last update":"Tue Nov 28 20:01:56 2023","interfaces":[{"interface":"back","average":{"1min":0.44600000000000001,"5min":0.45800000000000002,"15min":0.47399999999999998},"min":{"1min":0.317,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.89200000000000002,"5min":0.89200000000000002,"15min":0.89200000000000002},"last":0.50600000000000001},{"interface":"front","average":{"1min":0.65600000000000003,"5min":0.52200000000000002,"15min":0.51000000000000001},"min":{"1min":0.34200000000000003,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":5.8920000000000003,"5min":5.8920000000000003,"15min":5.8920000000000003},"last":0.33800000000000002}]},{"osd":2,"last update":"Tue Nov 28 20:01:56 2023","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.54800000000000004,"15min":0.53800000000000003},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":4.6390000000000002,"5min":4.6390000000000002,"15min":4.6390000000000002},"last":0.36199999999999999},{"interface":"front","average":{"1min":0.95099999999999996,"5min":0.63900000000000001,"15min":0.60299999999999998},"min":{"1min":0.40899999999999997,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":11.593,"5min":11.593,"15min":11.593},"last":0.53500000000000003}]},{"osd":4,"last update":"Tue Nov 28 20:01:56 2023","interfaces":[{"interface":"back","average":{"1min":0.91100000000000003,"5min":0.79400000000000004,"15min":0.77200000000000002},"min":{"1min":0.46600000000000003,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":5.5549999999999997,"5min":5.5549999999999997,"15min":5.5549999999999997},"last":0.91200000000000003},{"interface":"front","average":{"1min":1.179,"5min":0.879,"15min":0.82799999999999996},"min":{"1min":0.60999999999999999,"5min":0.503,"15min":0.503},"max":{"1min":11.747,"5min":11.747,"15min":11.747},"last":0.93300000000000005}]},{"osd":5,"last update":"Tue Nov 28 20:01:56 2023","interfaces":[{"interface":"back","average":{"1min":1.1040000000000001,"5min":0.85699999999999998,"15min":0.81899999999999995},"min":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":11.705,"5min":11.705,"15min":11.705},"last":0.78700000000000003},{"interface":"front","average":{"1min":0.70399999999999996,"5min":0.77100000000000002,"15min":0.79200000000000004},"min":{"1min":0.51200000000000001,"5min":0.495,"15min":0.495},"max":{"1min":1.0580000000000001,"5min":1.3100000000000001,"15min":1.3100000000000001},"last":0.88500000000000001}]},{"osd":6,"last update":"Tue Nov 28 20:01:56 2023","interfaces":[{"interface":"back","average":{"1min":0.748,"5min":0.81899999999999995,"15min":0.83499999999999996},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":1.6639999999999999,"5min":1.6639999999999999,"15min":1.6639999999999999},"last":0.83199999999999996},{"interface":"front","average":{"1min":0.84499999999999997,"5min":0.80400000000000005,"15min":0.76700000000000002},"min":{"1min":0.52900000000000003,"5min":0.495,"15min":0.495},"max":{"1min":3.1459999999999999,"5min":4.0679999999999996,"15min":4.0679999999999996},"last":0.95299999999999996}]},{"osd":7,"last update":"Tue Nov 28 20:01:56 2023","interfaces":[{"interface":"back","average":{"1min":0.96199999999999997,"5min":0.89600000000000002,"15min":0.86499999999999999},"min":{"1min":0.52100000000000002,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":6.6619999999999999,"5min":6.6619999999999999,"15min":6.6619999999999999},"last":1.016},{"interface":"front","average":{"1min":1.141,"5min":0.92300000000000004,"15min":0.90100000000000002},"min":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":11.782,"5min":11.782,"15min":11.782},"last":0.89800000000000002}]}]},{"osd":2,"up_from":13,"seq":55834574889,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27976,"kb_used_data":952,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343864,"statfs":{"total":96636764160,"available":96608116736,"internally_reserved":0,"allocated":974848,"data_stored":455836,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 20:01:57 2023","interfaces":[{"interface":"back","average":{"1min":0.39600000000000002,"5min":0.438,"15min":0.45000000000000001},"min":{"1min":0.28899999999999998,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.60399999999999998,"5min":0.74099999999999999,"15min":0.74099999999999999},"last":0.255},{"interface":"front","average":{"1min":0.435,"5min":0.46100000000000002,"15min":0.47499999999999998},"min":{"1min":0.30199999999999999,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.59599999999999997,"5min":0.67700000000000005,"15min":0.67700000000000005},"last":0.29499999999999998}]},{"osd":1,"last update":"Tue Nov 28 20:01:57 2023","interfaces":[{"interface":"back","average":{"1min":0.47699999999999998,"5min":0.48999999999999999,"15min":0.50600000000000001},"min":{"1min":0.377,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.64500000000000002,"5min":1.0389999999999999,"15min":1.0389999999999999},"last":0.41499999999999998},{"interface":"front","average":{"1min":0.45100000000000001,"5min":0.47999999999999998,"15min":0.496},"min":{"1min":0.33800000000000002,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.58999999999999997,"5min":0.70999999999999996,"15min":0.70999999999999996},"last":0.45200000000000001}]},{"osd":3,"last update":"Tue Nov 28 20:01:57 2023","interfaces":[{"interface":"back","average":{"1min":0.45700000000000002,"5min":0.46300000000000002,"15min":0.46899999999999997},"min":{"1min":0.36899999999999999,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.60299999999999998,"5min":0.629,"15min":0.629},"last":0.32200000000000001},{"interface":"front","average":{"1min":0.52300000000000002,"5min":0.55900000000000005,"15min":0.58099999999999996},"min":{"1min":0.41599999999999998,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.58899999999999997,"5min":0.98499999999999999,"15min":0.98499999999999999},"last":0.47199999999999998}]},{"osd":4,"last update":"Tue Nov 28 20:01:57 2023","interfaces":[{"interface":"back","average":{"1min":0.69399999999999995,"5min":0.80300000000000005,"15min":0.84199999999999997},"min":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":0.86899999999999999,"5min":1.139,"15min":1.139},"last":0.60199999999999998},{"interface":"front","average":{"1min":0.70199999999999996,"5min":0.79600000000000004,"15min":0.83399999999999996},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":1.008,"5min":1.238,"15min":1.238},"last":0.68600000000000005}]},{"osd":5,"last update":"Tue Nov 28 20:01:57 2023","interfaces":[{"interface":"back","average":{"1min":0.70799999999999996,"5min":0.81200000000000006,"15min":0.85999999999999999},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":1.0389999999999999,"5min":1.6180000000000001,"15min":1.6180000000000001},"last":0.55300000000000005},{"interface":"front","average":{"1min":0.70699999999999996,"5min":0.78400000000000003,"15min":0.81799999999999995},"min":{"1min":0.51800000000000002,"5min":0.496,"15min":0.496},"max":{"1min":1.0149999999999999,"5min":1.339,"15min":1.339},"last":0.53300000000000003}]},{"osd":6,"last update":"Tue Nov 28 20:01:57 2023","interfaces":[{"interface":"back","average":{"1min":0.71399999999999997,"5min":0.77300000000000002,"15min":0.79500000000000004},"min":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":1.0589999999999999,"5min":1.1839999999999999,"15min":1.1839999999999999},"last":0.57099999999999995},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.80300000000000005,"15min":0.84199999999999997},"min":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":0.98699999999999999,"5min":1.099,"15min":1.099},"last":0.70899999999999996}]},{"osd":7,"last update":"Tue Nov 28 20:01:57 2023","interfaces":[{"interface":"back","average":{"1min":0.69599999999999995,"5min":0.82199999999999995,"15min":0.86699999999999999},"min":{"1min":0.53300000000000003,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":0.94699999999999995,"5min":1.4590000000000001,"15min":1.4590000000000001},"last":0.66200000000000003},{"interface":"front","average":{"1min":0.73199999999999998,"5min":0.80900000000000005,"15min":0.84699999999999998},"min":{"1min":0.55200000000000005,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":1.0760000000000001,"5min":1.387,"15min":1.387},"last":0.76200000000000001}]}]},{"osd":1,"up_from":13,"seq":55834574891,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32136,"kb_used_data":952,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339704,"statfs":{"total":96636764160,"available":96603856896,"internally_reserved":0,"allocated":974848,"data_stored":455836,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 20:02:00 2023","interfaces":[{"interface":"back","average":{"1min":0.38700000000000001,"5min":0.54600000000000004,"15min":0.62},"min":{"1min":0.249,"5min":0.249,"15min":0.249},"max":{"1min":0.60699999999999998,"5min":3.8740000000000001,"15min":3.8740000000000001},"last":0.39400000000000002},{"interface":"front","average":{"1min":0.42099999999999999,"5min":0.51000000000000001,"15min":0.55100000000000005},"min":{"1min":0.32300000000000001,"5min":0.25,"15min":0.25},"max":{"1min":0.60399999999999998,"5min":2.0760000000000001,"15min":2.0760000000000001},"last":0.495}]},{"osd":2,"last update":"Tue Nov 28 20:02:00 2023","interfaces":[{"interface":"back","average":{"1min":0.41399999999999998,"5min":0.56000000000000005,"15min":0.626},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.70799999999999996,"5min":3.7320000000000002,"15min":3.7320000000000002},"last":0.377},{"interface":"front","average":{"1min":0.46899999999999997,"5min":0.63400000000000001,"15min":0.71799999999999997},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.67000000000000004,"5min":3.9089999999999998,"15min":3.9089999999999998},"last":0.436}]},{"osd":3,"last update":"Tue Nov 28 20:02:00 2023","interfaces":[{"interface":"back","average":{"1min":0.52200000000000002,"5min":0.61799999999999999,"15min":0.66000000000000003},"min":{"1min":0.436,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.70799999999999996,"5min":1.6399999999999999,"15min":1.6399999999999999},"last":0.50800000000000001},{"interface":"front","average":{"1min":0.45500000000000002,"5min":0.61599999999999999,"15min":0.67400000000000004},"min":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.625,"5min":2.5270000000000001,"15min":2.5270000000000001},"last":0.52100000000000002}]},{"osd":4,"last update":"Tue Nov 28 20:02:00 2023","interfaces":[{"interface":"back","average":{"1min":0.69799999999999995,"5min":0.81699999999999995,"15min":0.86899999999999999},"min":{"1min":0.42199999999999999,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.91400000000000003,"5min":3.1659999999999999,"15min":3.1659999999999999},"last":0.61899999999999999},{"interface":"front","average":{"1min":0.69699999999999995,"5min":0.84399999999999997,"15min":0.91200000000000003},"min":{"1min":0.52300000000000002,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.94299999999999995,"5min":3.7959999999999998,"15min":3.7959999999999998},"last":0.69899999999999995}]},{"osd":5,"last update":"Tue Nov 28 20:02:00 2023","interfaces":[{"interface":"back","average":{"1min":0.71399999999999997,"5min":0.875,"15min":0.95099999999999996},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":1.004,"5min":4.1479999999999997,"15min":4.1479999999999997},"last":0.60999999999999999},{"interface":"front","average":{"1min":0.69799999999999995,"5min":0.82599999999999996,"15min":0.88200000000000001},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":0.87,"5min":3.5569999999999999,"15min":3.5569999999999999},"last":0.65200000000000002}]},{"osd":6,"last update":"Tue Nov 28 20:02:00 2023","interfaces":[{"interface":"back","average":{"1min":0.72399999999999998,"5min":0.88800000000000001,"15min":0.95699999999999996},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":0.94499999999999995,"5min":2.863,"15min":2.863},"last":0.63200000000000001},{"interface":"front","average":{"1min":0.76800000000000002,"5min":0.89800000000000002,"15min":0.95399999999999996},"min":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":0.97999999999999998,"5min":3.371,"15min":3.371},"last":0.71799999999999997}]},{"osd":7,"last update":"Tue Nov 28 20:02:00 2023","interfaces":[{"interface":"back","average":{"1min":0.70299999999999996,"5min":0.89100000000000001,"15min":0.97199999999999998},"min":{"1min":0.53100000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":0.93600000000000005,"5min":3.8439999999999999,"15min":3.8439999999999999},"last":0.76200000000000001},{"interface":"front","average":{"1min":0.68799999999999994,"5min":0.90500000000000003,"15min":0.99299999999999999},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.95899999999999996,"5min":3.9689999999999999,"15min":3.9689999999999999},"last":0.72499999999999998}]}]},{"osd":0,"up_from":13,"seq":55834574890,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32196,"kb_used_data":1016,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339644,"statfs":{"total":96636764160,"available":96603795456,"internally_reserved":0,"allocated":1040384,"data_stored":1046204,"data_compressed":33374,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Nov 28 20:01:57 2023","interfaces":[{"interface":"back","average":{"1min":0.38700000000000001,"5min":0.57399999999999995,"15min":0.65100000000000002},"min":{"1min":0.24099999999999999,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":0.68400000000000005,"5min":4.883,"15min":4.883},"last":0.35299999999999998},{"interface":"front","average":{"1min":0.43099999999999999,"5min":0.70099999999999996,"15min":0.81899999999999995},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.66800000000000004,"5min":8.0800000000000001,"15min":8.0800000000000001},"last":0.40500000000000003}]},{"osd":2,"last update":"Tue Nov 28 20:01:57 2023","interfaces":[{"interface":"back","average":{"1min":0.50800000000000001,"5min":0.77400000000000002,"15min":0.90700000000000003},"min":{"1min":0.312,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.85599999999999998,"5min":8.1029999999999998,"15min":8.1029999999999998},"last":0.39200000000000002},{"interface":"front","average":{"1min":0.53300000000000003,"5min":0.79400000000000004,"15min":0.92200000000000004},"min":{"1min":0.40600000000000003,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.748,"5min":8.1310000000000002,"15min":8.1310000000000002},"last":0.48999999999999999}]},{"osd":3,"last update":"Tue Nov 28 20:01:57 2023","interfaces":[{"interface":"back","average":{"1min":0.47299999999999998,"5min":0.628,"15min":0.70699999999999996},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.873,"5min":4.3949999999999996,"15min":4.3949999999999996},"last":0.42399999999999999},{"interface":"front","average":{"1min":0.497,"5min":0.65100000000000002,"15min":0.72099999999999997},"min":{"1min":0.37,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.89200000000000002,"5min":4.3470000000000004,"15min":4.3470000000000004},"last":0.45700000000000002}]},{"osd":4,"last update":"Tue Nov 28 20:01:57 2023","interfaces":[{"interface":"back","average":{"1min":0.72799999999999998,"5min":0.92000000000000004,"15min":1.0069999999999999},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":1.038,"5min":4.6360000000000001,"15min":4.6360000000000001},"last":0.76200000000000001},{"interface":"front","average":{"1min":0.76800000000000002,"5min":0.93400000000000005,"15min":1.0129999999999999},"min":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":1.0820000000000001,"5min":4.4710000000000001,"15min":4.4710000000000001},"last":0.69099999999999995}]},{"osd":5,"last update":"Tue Nov 28 20:01:57 2023","interfaces":[{"interface":"back","average":{"1min":0.72599999999999998,"5min":0.93200000000000005,"15min":1.02},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":0.97599999999999998,"5min":4.6120000000000001,"15min":4.6120000000000001},"last":0.75},{"interface":"front","average":{"1min":0.78600000000000003,"5min":0.93600000000000005,"15min":1.0129999999999999},"min":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.1319999999999999,"5min":4.5449999999999999,"15min":4.5449999999999999},"last":0.82699999999999996}]},{"osd":6,"last update":"Tue Nov 28 20:01:57 2023","interfaces":[{"interface":"back","average":{"1min":0.755,"5min":0.94499999999999995,"15min":1.034},"min":{"1min":0.53600000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":1.0580000000000001,"5min":4.657,"15min":4.657},"last":0.73999999999999999},{"interface":"front","average":{"1min":0.75700000000000001,"5min":0.95799999999999996,"15min":1.05},"min":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":1.0049999999999999,"5min":4.5259999999999998,"15min":4.5259999999999998},"last":0.77400000000000002}]},{"osd":7,"last update":"Tue Nov 28 20:01:57 2023","interfaces":[{"interface":"back","average":{"1min":0.73799999999999999,"5min":0.95199999999999996,"15min":1.0509999999999999},"min":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":1.081,"5min":4.7320000000000002,"15min":4.7320000000000002},"last":0.72499999999999998},{"interface":"front","average":{"1min":0.76300000000000001,"5min":0.93100000000000005,"15min":1.0069999999999999},"min":{"1min":0.58699999999999997,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":1.099,"5min":4.4939999999999998,"15min":4.4939999999999998},"last":0.80200000000000005}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33374,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33374,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-28T20:02:12.736 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-28T20:02:12.911 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:12.904+0000 7f6586aad640 1 Processor -- start 2023-11-28T20:02:12.911 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:12.904+0000 7f6586aad640 1 -- start start 2023-11-28T20:02:12.912 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:12.908+0000 7f6586aad640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f65800722c0 0x7f658015de60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:12.912 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:12.908+0000 7f6586aad640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f65800c5710 con 0x7f658014fd10 2023-11-28T20:02:12.913 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:12.908+0000 7f6586aad640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6580155c80 con 0x7f6580071e30 2023-11-28T20:02:12.913 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:12.908+0000 7f6586aad640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f658006c5e0 con 0x7f65800722c0 2023-11-28T20:02:12.913 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:12.908+0000 7f6584849640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f658014fd10 0x7f65800a4dc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:40392/0 (socket says 172.21.15.78:40392) 2023-11-28T20:02:12.913 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:12.908+0000 7f658504a640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f65800722c0 0x7f658015de60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:02:12.913 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:12.908+0000 7f6584849640 1 -- 172.21.15.78:0/1367110424 learned_addr learned my addr 172.21.15.78:0/1367110424 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-11-28T20:02:12.913 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:12.908+0000 7f658504a640 1 -- 172.21.15.78:0/1367110424 >> v1:172.21.15.179:6789/0 conn(0x7f6580071e30 legacy=0x7f6580156110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:02:12.913 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:12.908+0000 7f658504a640 1 -- 172.21.15.78:0/1367110424 >> v1:172.21.15.78:6789/0 conn(0x7f658014fd10 legacy=0x7f65800a4dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:02:12.913 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:12.908+0000 7f658504a640 1 -- 172.21.15.78:0/1367110424 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65800c4e70 con 0x7f65800722c0 2023-11-28T20:02:12.915 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:12.912+0000 7f658504a640 1 --2- 172.21.15.78:0/1367110424 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f65800722c0 0x7f658015de60 secure :-1 s=READY pgs=903 cs=0 l=1 rev1=1 crypto rx=0x7f6578009d90 tx=0x7f657801c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=75ea5e7084149f37 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:02:12.916 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:12.912+0000 7f657f7fe640 1 -- 172.21.15.78:0/1367110424 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65780a57e0 con 0x7f65800722c0 2023-11-28T20:02:12.916 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:12.912+0000 7f657f7fe640 1 -- 172.21.15.78:0/1367110424 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f65780a5940 con 0x7f65800722c0 2023-11-28T20:02:12.916 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:12.912+0000 7f657f7fe640 1 -- 172.21.15.78:0/1367110424 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65780a5cd0 con 0x7f65800722c0 2023-11-28T20:02:12.916 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:12.912+0000 7f6586aad640 1 -- 172.21.15.78:0/1367110424 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f65800722c0 msgr2=0x7f658015de60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:02:12.917 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:12.912+0000 7f6586aad640 1 --2- 172.21.15.78:0/1367110424 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f65800722c0 0x7f658015de60 secure :-1 s=READY pgs=903 cs=0 l=1 rev1=1 crypto rx=0x7f6578009d90 tx=0x7f657801c830 comp rx=0 tx=0).stop 2023-11-28T20:02:12.917 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:12.912+0000 7f6586aad640 1 -- 172.21.15.78:0/1367110424 shutdown_connections 2023-11-28T20:02:12.917 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:12.912+0000 7f6586aad640 1 --2- 172.21.15.78:0/1367110424 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f65800722c0 0x7f658015de60 unknown :-1 s=CLOSED pgs=903 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:12.917 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:12.912+0000 7f6586aad640 1 -- 172.21.15.78:0/1367110424 >> 172.21.15.78:0/1367110424 conn(0x7f65800a7810 msgr2=0x7f65800a7c20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:02:12.917 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:12.912+0000 7f6586aad640 1 -- 172.21.15.78:0/1367110424 shutdown_connections 2023-11-28T20:02:12.917 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:12.912+0000 7f6586aad640 1 -- 172.21.15.78:0/1367110424 wait complete. 2023-11-28T20:02:12.918 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:12.912+0000 7f6586aad640 1 Processor -- start 2023-11-28T20:02:12.918 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:12.912+0000 7f6586aad640 1 -- start start 2023-11-28T20:02:12.920 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:12.916+0000 7f6586aad640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6580071e30 0x7f65800a9710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:12.920 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:12.916+0000 7f6586aad640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f65800722c0 0x7f65800aa760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:12.920 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:12.916+0000 7f6586aad640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f658014fd10 0x7f65800a6040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:12.920 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:12.916+0000 7f6586aad640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65800ab7b0 con 0x7f6580071e30 2023-11-28T20:02:12.920 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:12.916+0000 7f6586aad640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65801537a0 con 0x7f658014fd10 2023-11-28T20:02:12.920 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:12.916+0000 7f6586aad640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f65800a4dd0 con 0x7f65800722c0 2023-11-28T20:02:12.921 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:12.916+0000 7f6584849640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6580071e30 0x7f65800a9710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:02:12.921 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:12.916+0000 7f6584849640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6580071e30 0x7f65800a9710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:49542/0 (socket says 172.21.15.78:49542) 2023-11-28T20:02:12.921 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:12.916+0000 7f6584849640 1 -- 172.21.15.78:0/3965661989 learned_addr learned my addr 172.21.15.78:0/3965661989 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T20:02:12.921 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:12.916+0000 7f6584849640 1 -- 172.21.15.78:0/3965661989 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f65800722c0 msgr2=0x7f65800aa760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:02:12.921 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:12.916+0000 7f6584849640 1 --2- 172.21.15.78:0/3965661989 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f65800722c0 0x7f65800aa760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:12.921 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:12.916+0000 7f6584849640 1 -- 172.21.15.78:0/3965661989 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f658014fd10 msgr2=0x7f65800a6040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:02:12.921 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:12.916+0000 7f6584849640 1 --2- 172.21.15.78:0/3965661989 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f658014fd10 0x7f65800a6040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:12.921 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:12.916+0000 7f6584849640 1 -- 172.21.15.78:0/3965661989 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6578009a70 con 0x7f6580071e30 2023-11-28T20:02:12.921 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:12.916+0000 7f6584849640 1 --2- 172.21.15.78:0/3965661989 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6580071e30 0x7f65800a9710 secure :-1 s=READY pgs=904 cs=0 l=1 rev1=1 crypto rx=0x7f657400c400 tx=0x7f657400c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:02:12.922 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:12.916+0000 7f657d7fa640 1 -- 172.21.15.78:0/3965661989 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6574005cf0 con 0x7f6580071e30 2023-11-28T20:02:12.922 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:12.916+0000 7f657d7fa640 1 -- 172.21.15.78:0/3965661989 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6574005e50 con 0x7f6580071e30 2023-11-28T20:02:12.923 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:12.916+0000 7f6586aad640 1 -- 172.21.15.78:0/3965661989 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f65801539f0 con 0x7f6580071e30 2023-11-28T20:02:12.923 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:12.916+0000 7f657d7fa640 1 -- 172.21.15.78:0/3965661989 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65740072d0 con 0x7f6580071e30 2023-11-28T20:02:12.923 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:12.916+0000 7f6586aad640 1 -- 172.21.15.78:0/3965661989 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6580146970 con 0x7f6580071e30 2023-11-28T20:02:12.923 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:12.916+0000 7f6586aad640 1 -- 172.21.15.78:0/3965661989 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6580067630 con 0x7f6580071e30 2023-11-28T20:02:12.923 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:12.916+0000 7f657d7fa640 1 -- 172.21.15.78:0/3965661989 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f6574007430 con 0x7f6580071e30 2023-11-28T20:02:12.924 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:12.920+0000 7f657d7fa640 1 --2- 172.21.15.78:0/3965661989 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f6564066470 0x7f6564068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:12.924 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:12.920+0000 7f657d7fa640 1 -- 172.21.15.78:0/3965661989 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f6574083560 con 0x7f6580071e30 2023-11-28T20:02:12.924 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:12.920+0000 7f657ffff640 1 --2- 172.21.15.78:0/3965661989 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f6564066470 0x7f6564068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:02:12.924 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:12.920+0000 7f657ffff640 1 --2- 172.21.15.78:0/3965661989 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f6564066470 0x7f6564068930 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f656c000f70 tx=0x7f656c0079e0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:02:12.927 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:12.924+0000 7f657d7fa640 1 -- 172.21.15.78:0/3965661989 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f65740508b0 con 0x7f6580071e30 2023-11-28T20:02:13.078 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:13.072+0000 7f6586aad640 1 -- 172.21.15.78:0/3965661989 --> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f65800a54d0 con 0x7f6564066470 2023-11-28T20:02:13.086 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:13.080+0000 7f657d7fa640 1 -- 172.21.15.78:0/3965661989 <== mgr.4106 v2:172.21.15.78:6832/2935380957 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+283878 (secure 0 0 0) 0x7f656c005080 con 0x7f6564066470 2023-11-28T20:02:13.089 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-11-28T20:02:13.091 INFO:teuthology.orchestra.run.smithi078.stderr:dumped all 2023-11-28T20:02:13.093 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:13.084+0000 7f6586aad640 1 -- 172.21.15.78:0/3965661989 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f6564066470 msgr2=0x7f6564068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:02:13.093 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:13.084+0000 7f6586aad640 1 --2- 172.21.15.78:0/3965661989 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f6564066470 0x7f6564068930 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f656c000f70 tx=0x7f656c0079e0 comp rx=0 tx=0).stop 2023-11-28T20:02:13.093 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:13.084+0000 7f6586aad640 1 -- 172.21.15.78:0/3965661989 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6580071e30 msgr2=0x7f65800a9710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:02:13.093 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:13.084+0000 7f6586aad640 1 --2- 172.21.15.78:0/3965661989 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6580071e30 0x7f65800a9710 secure :-1 s=READY pgs=904 cs=0 l=1 rev1=1 crypto rx=0x7f657400c400 tx=0x7f657400c8c0 comp rx=0 tx=0).stop 2023-11-28T20:02:13.093 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:13.084+0000 7f6586aad640 1 -- 172.21.15.78:0/3965661989 shutdown_connections 2023-11-28T20:02:13.094 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:13.084+0000 7f6586aad640 1 --2- 172.21.15.78:0/3965661989 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f6564066470 0x7f6564068930 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:13.094 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:13.084+0000 7f6586aad640 1 --2- 172.21.15.78:0/3965661989 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f65800722c0 0x7f65800aa760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:13.094 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:13.084+0000 7f6586aad640 1 --2- 172.21.15.78:0/3965661989 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f658014fd10 0x7f65800a6040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:13.094 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:13.084+0000 7f6586aad640 1 --2- 172.21.15.78:0/3965661989 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6580071e30 0x7f65800a9710 unknown :-1 s=CLOSED pgs=904 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:13.094 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:13.084+0000 7f6586aad640 1 -- 172.21.15.78:0/3965661989 >> 172.21.15.78:0/3965661989 conn(0x7f65800a7810 msgr2=0x7f6580146b70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:02:13.094 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:13.084+0000 7f6586aad640 1 -- 172.21.15.78:0/3965661989 shutdown_connections 2023-11-28T20:02:13.094 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:13.084+0000 7f6586aad640 1 -- 172.21.15.78:0/3965661989 wait complete. 2023-11-28T20:02:13.109 INFO:teuthology.orchestra.run.smithi078.stdout:{"pg_ready":true,"pg_map":{"version":174,"stamp":"2023-11-28T20:02:11.992080+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":38,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":248892,"kb_used_data":7744,"kb_used_omap":12,"kb_used_meta":241011,"kb_avail":754725828,"statfs":{"total":773094113280,"available":772839247872,"internally_reserved":0,"allocated":7929856,"data_stored":4827424,"data_compressed":66748,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":12752,"internal_metadata":246795824},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":33,"apply_latency_ms":33,"commit_latency_ns":33000000,"apply_latency_ns":33000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.727258"},"pg_stats":[{"pgid":"14.3f","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2023-11-28T20:02:07.283775+0000","last_change":"2023-11-28T20:02:07.283775+0000","last_active":"2023-11-28T20:02:07.264604+0000","last_peered":"2023-11-28T20:02:07.264604+0000","last_clean":"2023-11-28T20:02:07.264604+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:02:07.283775+0000","last_undegraded":"2023-11-28T20:02:07.283775+0000","last_fullsized":"2023-11-28T20:02:07.283775+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_clean_scrub_stamp":"2023-11-28T20:02:07.264604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.3e","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2023-11-28T20:02:07.281033+0000","last_change":"2023-11-28T20:02:07.281033+0000","last_active":"2023-11-28T20:02:07.264604+0000","last_peered":"2023-11-28T20:02:07.264604+0000","last_clean":"2023-11-28T20:02:07.264604+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:02:07.281033+0000","last_undegraded":"2023-11-28T20:02:07.281033+0000","last_fullsized":"2023-11-28T20:02:07.281033+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_clean_scrub_stamp":"2023-11-28T20:02:07.264604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.3d","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2023-11-28T20:02:07.284263+0000","last_change":"2023-11-28T20:02:07.284263+0000","last_active":"2023-11-28T20:02:07.264604+0000","last_peered":"2023-11-28T20:02:07.264604+0000","last_clean":"2023-11-28T20:02:07.264604+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:02:07.284263+0000","last_undegraded":"2023-11-28T20:02:07.284263+0000","last_fullsized":"2023-11-28T20:02:07.284263+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_clean_scrub_stamp":"2023-11-28T20:02:07.264604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.3c","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2023-11-28T20:02:07.279673+0000","last_change":"2023-11-28T20:02:07.279673+0000","last_active":"2023-11-28T20:02:07.264604+0000","last_peered":"2023-11-28T20:02:07.264604+0000","last_clean":"2023-11-28T20:02:07.264604+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:02:07.279673+0000","last_undegraded":"2023-11-28T20:02:07.279673+0000","last_fullsized":"2023-11-28T20:02:07.279673+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_clean_scrub_stamp":"2023-11-28T20:02:07.264604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.3b","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2023-11-28T20:02:07.278853+0000","last_change":"2023-11-28T20:02:07.278853+0000","last_active":"2023-11-28T20:02:07.264604+0000","last_peered":"2023-11-28T20:02:07.264604+0000","last_clean":"2023-11-28T20:02:07.264604+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:02:07.278853+0000","last_undegraded":"2023-11-28T20:02:07.278853+0000","last_fullsized":"2023-11-28T20:02:07.278853+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_clean_scrub_stamp":"2023-11-28T20:02:07.264604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.3a","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2023-11-28T20:02:07.285754+0000","last_change":"2023-11-28T20:02:07.285754+0000","last_active":"2023-11-28T20:02:07.264604+0000","last_peered":"2023-11-28T20:02:07.264604+0000","last_clean":"2023-11-28T20:02:07.264604+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:02:07.285754+0000","last_undegraded":"2023-11-28T20:02:07.285754+0000","last_fullsized":"2023-11-28T20:02:07.285754+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_clean_scrub_stamp":"2023-11-28T20:02:07.264604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.39","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2023-11-28T20:02:07.287408+0000","last_change":"2023-11-28T20:02:07.287408+0000","last_active":"2023-11-28T20:02:07.264604+0000","last_peered":"2023-11-28T20:02:07.264604+0000","last_clean":"2023-11-28T20:02:07.264604+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:02:07.287408+0000","last_undegraded":"2023-11-28T20:02:07.287408+0000","last_fullsized":"2023-11-28T20:02:07.287408+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_clean_scrub_stamp":"2023-11-28T20:02:07.264604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.38","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2023-11-28T20:02:07.279529+0000","last_change":"2023-11-28T20:02:07.279529+0000","last_active":"2023-11-28T20:02:07.264604+0000","last_peered":"2023-11-28T20:02:07.264604+0000","last_clean":"2023-11-28T20:02:07.264604+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:02:07.279529+0000","last_undegraded":"2023-11-28T20:02:07.279529+0000","last_fullsized":"2023-11-28T20:02:07.279529+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_clean_scrub_stamp":"2023-11-28T20:02:07.264604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.37","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2023-11-28T20:02:07.280230+0000","last_change":"2023-11-28T20:02:07.280230+0000","last_active":"2023-11-28T20:02:07.264604+0000","last_peered":"2023-11-28T20:02:07.264604+0000","last_clean":"2023-11-28T20:02:07.264604+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:02:07.280230+0000","last_undegraded":"2023-11-28T20:02:07.280230+0000","last_fullsized":"2023-11-28T20:02:07.280230+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_clean_scrub_stamp":"2023-11-28T20:02:07.264604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.36","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2023-11-28T20:02:07.285036+0000","last_change":"2023-11-28T20:02:07.285036+0000","last_active":"2023-11-28T20:02:07.264604+0000","last_peered":"2023-11-28T20:02:07.264604+0000","last_clean":"2023-11-28T20:02:07.264604+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:02:07.285036+0000","last_undegraded":"2023-11-28T20:02:07.285036+0000","last_fullsized":"2023-11-28T20:02:07.285036+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_clean_scrub_stamp":"2023-11-28T20:02:07.264604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.35","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2023-11-28T20:02:07.280584+0000","last_change":"2023-11-28T20:02:07.280584+0000","last_active":"2023-11-28T20:02:07.264604+0000","last_peered":"2023-11-28T20:02:07.264604+0000","last_clean":"2023-11-28T20:02:07.264604+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:02:07.280584+0000","last_undegraded":"2023-11-28T20:02:07.280584+0000","last_fullsized":"2023-11-28T20:02:07.280584+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_clean_scrub_stamp":"2023-11-28T20:02:07.264604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.34","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2023-11-28T20:02:07.281300+0000","last_change":"2023-11-28T20:02:07.281300+0000","last_active":"2023-11-28T20:02:07.264604+0000","last_peered":"2023-11-28T20:02:07.264604+0000","last_clean":"2023-11-28T20:02:07.264604+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:02:07.281300+0000","last_undegraded":"2023-11-28T20:02:07.281300+0000","last_fullsized":"2023-11-28T20:02:07.281300+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_clean_scrub_stamp":"2023-11-28T20:02:07.264604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.33","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2023-11-28T20:02:07.279252+0000","last_change":"2023-11-28T20:02:07.279252+0000","last_active":"2023-11-28T20:02:07.264604+0000","last_peered":"2023-11-28T20:02:07.264604+0000","last_clean":"2023-11-28T20:02:07.264604+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:02:07.279252+0000","last_undegraded":"2023-11-28T20:02:07.279252+0000","last_fullsized":"2023-11-28T20:02:07.279252+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_clean_scrub_stamp":"2023-11-28T20:02:07.264604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.32","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2023-11-28T20:02:07.280291+0000","last_change":"2023-11-28T20:02:07.280291+0000","last_active":"2023-11-28T20:02:07.264604+0000","last_peered":"2023-11-28T20:02:07.264604+0000","last_clean":"2023-11-28T20:02:07.264604+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:02:07.280291+0000","last_undegraded":"2023-11-28T20:02:07.280291+0000","last_fullsized":"2023-11-28T20:02:07.280291+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_clean_scrub_stamp":"2023-11-28T20:02:07.264604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.31","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2023-11-28T20:02:07.278957+0000","last_change":"2023-11-28T20:02:07.278957+0000","last_active":"2023-11-28T20:02:07.264604+0000","last_peered":"2023-11-28T20:02:07.264604+0000","last_clean":"2023-11-28T20:02:07.264604+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:02:07.278957+0000","last_undegraded":"2023-11-28T20:02:07.278957+0000","last_fullsized":"2023-11-28T20:02:07.278957+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_clean_scrub_stamp":"2023-11-28T20:02:07.264604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.30","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2023-11-28T20:02:07.285701+0000","last_change":"2023-11-28T20:02:07.285701+0000","last_active":"2023-11-28T20:02:07.264604+0000","last_peered":"2023-11-28T20:02:07.264604+0000","last_clean":"2023-11-28T20:02:07.264604+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:02:07.285701+0000","last_undegraded":"2023-11-28T20:02:07.285701+0000","last_fullsized":"2023-11-28T20:02:07.285701+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_clean_scrub_stamp":"2023-11-28T20:02:07.264604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.2f","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2023-11-28T20:02:07.279900+0000","last_change":"2023-11-28T20:02:07.279900+0000","last_active":"2023-11-28T20:02:07.264604+0000","last_peered":"2023-11-28T20:02:07.264604+0000","last_clean":"2023-11-28T20:02:07.264604+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:02:07.279900+0000","last_undegraded":"2023-11-28T20:02:07.279900+0000","last_fullsized":"2023-11-28T20:02:07.279900+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_clean_scrub_stamp":"2023-11-28T20:02:07.264604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.2e","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2023-11-28T20:02:07.283280+0000","last_change":"2023-11-28T20:02:07.283280+0000","last_active":"2023-11-28T20:02:07.264604+0000","last_peered":"2023-11-28T20:02:07.264604+0000","last_clean":"2023-11-28T20:02:07.264604+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:02:07.283280+0000","last_undegraded":"2023-11-28T20:02:07.283280+0000","last_fullsized":"2023-11-28T20:02:07.283280+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_clean_scrub_stamp":"2023-11-28T20:02:07.264604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.2d","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2023-11-28T20:02:07.279980+0000","last_change":"2023-11-28T20:02:07.279980+0000","last_active":"2023-11-28T20:02:07.264604+0000","last_peered":"2023-11-28T20:02:07.264604+0000","last_clean":"2023-11-28T20:02:07.264604+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:02:07.279980+0000","last_undegraded":"2023-11-28T20:02:07.279980+0000","last_fullsized":"2023-11-28T20:02:07.279980+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_clean_scrub_stamp":"2023-11-28T20:02:07.264604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.2c","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2023-11-28T20:02:07.279215+0000","last_change":"2023-11-28T20:02:07.279215+0000","last_active":"2023-11-28T20:02:07.264604+0000","last_peered":"2023-11-28T20:02:07.264604+0000","last_clean":"2023-11-28T20:02:07.264604+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:02:07.279215+0000","last_undegraded":"2023-11-28T20:02:07.279215+0000","last_fullsized":"2023-11-28T20:02:07.279215+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_clean_scrub_stamp":"2023-11-28T20:02:07.264604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.2b","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2023-11-28T20:02:07.279982+0000","last_change":"2023-11-28T20:02:07.279982+0000","last_active":"2023-11-28T20:02:07.264604+0000","last_peered":"2023-11-28T20:02:07.264604+0000","last_clean":"2023-11-28T20:02:07.264604+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:02:07.279982+0000","last_undegraded":"2023-11-28T20:02:07.279982+0000","last_fullsized":"2023-11-28T20:02:07.279982+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_clean_scrub_stamp":"2023-11-28T20:02:07.264604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.2a","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2023-11-28T20:02:07.279747+0000","last_change":"2023-11-28T20:02:07.279747+0000","last_active":"2023-11-28T20:02:07.264604+0000","last_peered":"2023-11-28T20:02:07.264604+0000","last_clean":"2023-11-28T20:02:07.264604+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:02:07.279747+0000","last_undegraded":"2023-11-28T20:02:07.279747+0000","last_fullsized":"2023-11-28T20:02:07.279747+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_clean_scrub_stamp":"2023-11-28T20:02:07.264604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.29","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2023-11-28T20:02:07.288560+0000","last_change":"2023-11-28T20:02:07.288560+0000","last_active":"2023-11-28T20:02:07.264604+0000","last_peered":"2023-11-28T20:02:07.264604+0000","last_clean":"2023-11-28T20:02:07.264604+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:02:07.288560+0000","last_undegraded":"2023-11-28T20:02:07.288560+0000","last_fullsized":"2023-11-28T20:02:07.288560+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_clean_scrub_stamp":"2023-11-28T20:02:07.264604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.28","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2023-11-28T20:02:07.281146+0000","last_change":"2023-11-28T20:02:07.281146+0000","last_active":"2023-11-28T20:02:07.264604+0000","last_peered":"2023-11-28T20:02:07.264604+0000","last_clean":"2023-11-28T20:02:07.264604+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:02:07.281146+0000","last_undegraded":"2023-11-28T20:02:07.281146+0000","last_fullsized":"2023-11-28T20:02:07.281146+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_clean_scrub_stamp":"2023-11-28T20:02:07.264604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.27","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2023-11-28T20:02:07.280571+0000","last_change":"2023-11-28T20:02:07.280571+0000","last_active":"2023-11-28T20:02:07.264604+0000","last_peered":"2023-11-28T20:02:07.264604+0000","last_clean":"2023-11-28T20:02:07.264604+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:02:07.280571+0000","last_undegraded":"2023-11-28T20:02:07.280571+0000","last_fullsized":"2023-11-28T20:02:07.280571+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_clean_scrub_stamp":"2023-11-28T20:02:07.264604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.26","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2023-11-28T20:02:07.281292+0000","last_change":"2023-11-28T20:02:07.281292+0000","last_active":"2023-11-28T20:02:07.264604+0000","last_peered":"2023-11-28T20:02:07.264604+0000","last_clean":"2023-11-28T20:02:07.264604+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:02:07.281292+0000","last_undegraded":"2023-11-28T20:02:07.281292+0000","last_fullsized":"2023-11-28T20:02:07.281292+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_clean_scrub_stamp":"2023-11-28T20:02:07.264604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.25","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2023-11-28T20:02:07.283518+0000","last_change":"2023-11-28T20:02:07.283518+0000","last_active":"2023-11-28T20:02:07.264604+0000","last_peered":"2023-11-28T20:02:07.264604+0000","last_clean":"2023-11-28T20:02:07.264604+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:02:07.283518+0000","last_undegraded":"2023-11-28T20:02:07.283518+0000","last_fullsized":"2023-11-28T20:02:07.283518+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_clean_scrub_stamp":"2023-11-28T20:02:07.264604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.24","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2023-11-28T20:02:07.278454+0000","last_change":"2023-11-28T20:02:07.278454+0000","last_active":"2023-11-28T20:02:07.264604+0000","last_peered":"2023-11-28T20:02:07.264604+0000","last_clean":"2023-11-28T20:02:07.264604+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:02:07.278454+0000","last_undegraded":"2023-11-28T20:02:07.278454+0000","last_fullsized":"2023-11-28T20:02:07.278454+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_clean_scrub_stamp":"2023-11-28T20:02:07.264604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.23","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2023-11-28T20:02:07.286673+0000","last_change":"2023-11-28T20:02:07.286673+0000","last_active":"2023-11-28T20:02:07.264604+0000","last_peered":"2023-11-28T20:02:07.264604+0000","last_clean":"2023-11-28T20:02:07.264604+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:02:07.286673+0000","last_undegraded":"2023-11-28T20:02:07.286673+0000","last_fullsized":"2023-11-28T20:02:07.286673+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_clean_scrub_stamp":"2023-11-28T20:02:07.264604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.22","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2023-11-28T20:02:07.278208+0000","last_change":"2023-11-28T20:02:07.278208+0000","last_active":"2023-11-28T20:02:07.264604+0000","last_peered":"2023-11-28T20:02:07.264604+0000","last_clean":"2023-11-28T20:02:07.264604+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:02:07.278208+0000","last_undegraded":"2023-11-28T20:02:07.278208+0000","last_fullsized":"2023-11-28T20:02:07.278208+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_clean_scrub_stamp":"2023-11-28T20:02:07.264604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.21","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2023-11-28T20:02:07.281997+0000","last_change":"2023-11-28T20:02:07.281997+0000","last_active":"2023-11-28T20:02:07.264604+0000","last_peered":"2023-11-28T20:02:07.264604+0000","last_clean":"2023-11-28T20:02:07.264604+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:02:07.281997+0000","last_undegraded":"2023-11-28T20:02:07.281997+0000","last_fullsized":"2023-11-28T20:02:07.281997+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_clean_scrub_stamp":"2023-11-28T20:02:07.264604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.20","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2023-11-28T20:02:07.280102+0000","last_change":"2023-11-28T20:02:07.280102+0000","last_active":"2023-11-28T20:02:07.264604+0000","last_peered":"2023-11-28T20:02:07.264604+0000","last_clean":"2023-11-28T20:02:07.264604+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:02:07.280102+0000","last_undegraded":"2023-11-28T20:02:07.280102+0000","last_fullsized":"2023-11-28T20:02:07.280102+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_clean_scrub_stamp":"2023-11-28T20:02:07.264604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.1c","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2023-11-28T20:02:07.285556+0000","last_change":"2023-11-28T20:02:07.285556+0000","last_active":"2023-11-28T20:02:07.264604+0000","last_peered":"2023-11-28T20:02:07.264604+0000","last_clean":"2023-11-28T20:02:07.264604+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:02:07.285556+0000","last_undegraded":"2023-11-28T20:02:07.285556+0000","last_fullsized":"2023-11-28T20:02:07.285556+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_clean_scrub_stamp":"2023-11-28T20:02:07.264604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1f","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-28T20:02:07.301622+0000","last_change":"2023-11-28T20:02:07.298433+0000","last_active":"2023-11-28T20:02:07.301622+0000","last_peered":"2023-11-28T20:02:07.301622+0000","last_clean":"2023-11-28T20:02:07.301622+0000","last_became_active":"2023-11-28T20:02:07.298106+0000","last_became_peered":"2023-11-28T20:02:07.298106+0000","last_unstale":"2023-11-28T20:02:07.301622+0000","last_undegraded":"2023-11-28T20:02:07.301622+0000","last_fullsized":"2023-11-28T20:02:07.301622+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:06.257335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:06.257335+0000","last_clean_scrub_stamp":"2023-11-28T20:02:06.257335+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T06:20:36.448239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.1d","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2023-11-28T20:02:07.286754+0000","last_change":"2023-11-28T20:02:07.286754+0000","last_active":"2023-11-28T20:02:07.264604+0000","last_peered":"2023-11-28T20:02:07.264604+0000","last_clean":"2023-11-28T20:02:07.264604+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:02:07.286754+0000","last_undegraded":"2023-11-28T20:02:07.286754+0000","last_fullsized":"2023-11-28T20:02:07.286754+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_clean_scrub_stamp":"2023-11-28T20:02:07.264604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1e","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-28T20:02:07.296840+0000","last_change":"2023-11-28T20:02:07.293164+0000","last_active":"2023-11-28T20:02:07.296840+0000","last_peered":"2023-11-28T20:02:07.296840+0000","last_clean":"2023-11-28T20:02:07.296840+0000","last_became_active":"2023-11-28T20:02:07.292799+0000","last_became_peered":"2023-11-28T20:02:07.292799+0000","last_unstale":"2023-11-28T20:02:07.296840+0000","last_undegraded":"2023-11-28T20:02:07.296840+0000","last_fullsized":"2023-11-28T20:02:07.296840+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:06.257335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:06.257335+0000","last_clean_scrub_stamp":"2023-11-28T20:02:06.257335+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:09:41.129447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.1e","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2023-11-28T20:02:07.287269+0000","last_change":"2023-11-28T20:02:07.287269+0000","last_active":"2023-11-28T20:02:07.264604+0000","last_peered":"2023-11-28T20:02:07.264604+0000","last_clean":"2023-11-28T20:02:07.264604+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:02:07.287269+0000","last_undegraded":"2023-11-28T20:02:07.287269+0000","last_fullsized":"2023-11-28T20:02:07.287269+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_clean_scrub_stamp":"2023-11-28T20:02:07.264604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.1d","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-28T20:02:07.305601+0000","last_change":"2023-11-28T20:02:07.298412+0000","last_active":"2023-11-28T20:02:07.305601+0000","last_peered":"2023-11-28T20:02:07.305601+0000","last_clean":"2023-11-28T20:02:07.305601+0000","last_became_active":"2023-11-28T20:02:07.297937+0000","last_became_peered":"2023-11-28T20:02:07.297937+0000","last_unstale":"2023-11-28T20:02:07.305601+0000","last_undegraded":"2023-11-28T20:02:07.305601+0000","last_fullsized":"2023-11-28T20:02:07.305601+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:06.257335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:06.257335+0000","last_clean_scrub_stamp":"2023-11-28T20:02:06.257335+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:11:12.221383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.1f","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2023-11-28T20:02:07.279393+0000","last_change":"2023-11-28T20:02:07.279393+0000","last_active":"2023-11-28T20:02:07.264604+0000","last_peered":"2023-11-28T20:02:07.264604+0000","last_clean":"2023-11-28T20:02:07.264604+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:02:07.279393+0000","last_undegraded":"2023-11-28T20:02:07.279393+0000","last_fullsized":"2023-11-28T20:02:07.279393+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_clean_scrub_stamp":"2023-11-28T20:02:07.264604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1c","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-28T20:02:07.306628+0000","last_change":"2023-11-28T20:02:07.303442+0000","last_active":"2023-11-28T20:02:07.306628+0000","last_peered":"2023-11-28T20:02:07.306628+0000","last_clean":"2023-11-28T20:02:07.306628+0000","last_became_active":"2023-11-28T20:02:07.302881+0000","last_became_peered":"2023-11-28T20:02:07.302881+0000","last_unstale":"2023-11-28T20:02:07.306628+0000","last_undegraded":"2023-11-28T20:02:07.306628+0000","last_fullsized":"2023-11-28T20:02:07.306628+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:06.257335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:06.257335+0000","last_clean_scrub_stamp":"2023-11-28T20:02:06.257335+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:26:07.339153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.18","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2023-11-28T20:02:07.279010+0000","last_change":"2023-11-28T20:02:07.279010+0000","last_active":"2023-11-28T20:02:07.264604+0000","last_peered":"2023-11-28T20:02:07.264604+0000","last_clean":"2023-11-28T20:02:07.264604+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:02:07.279010+0000","last_undegraded":"2023-11-28T20:02:07.279010+0000","last_fullsized":"2023-11-28T20:02:07.279010+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_clean_scrub_stamp":"2023-11-28T20:02:07.264604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.1b","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-28T20:02:07.295836+0000","last_change":"2023-11-28T20:02:07.292245+0000","last_active":"2023-11-28T20:02:07.295836+0000","last_peered":"2023-11-28T20:02:07.295836+0000","last_clean":"2023-11-28T20:02:07.295836+0000","last_became_active":"2023-11-28T20:02:07.291923+0000","last_became_peered":"2023-11-28T20:02:07.291923+0000","last_unstale":"2023-11-28T20:02:07.295836+0000","last_undegraded":"2023-11-28T20:02:07.295836+0000","last_fullsized":"2023-11-28T20:02:07.295836+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:06.257335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:06.257335+0000","last_clean_scrub_stamp":"2023-11-28T20:02:06.257335+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:12:38.018161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.19","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2023-11-28T20:02:07.288017+0000","last_change":"2023-11-28T20:02:07.288017+0000","last_active":"2023-11-28T20:02:07.264604+0000","last_peered":"2023-11-28T20:02:07.264604+0000","last_clean":"2023-11-28T20:02:07.264604+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:02:07.288017+0000","last_undegraded":"2023-11-28T20:02:07.288017+0000","last_fullsized":"2023-11-28T20:02:07.288017+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_clean_scrub_stamp":"2023-11-28T20:02:07.264604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1a","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-28T20:02:07.300872+0000","last_change":"2023-11-28T20:02:07.297038+0000","last_active":"2023-11-28T20:02:07.300872+0000","last_peered":"2023-11-28T20:02:07.300872+0000","last_clean":"2023-11-28T20:02:07.300872+0000","last_became_active":"2023-11-28T20:02:07.295472+0000","last_became_peered":"2023-11-28T20:02:07.295472+0000","last_unstale":"2023-11-28T20:02:07.300872+0000","last_undegraded":"2023-11-28T20:02:07.300872+0000","last_fullsized":"2023-11-28T20:02:07.300872+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:06.257335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:06.257335+0000","last_clean_scrub_stamp":"2023-11-28T20:02:06.257335+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:04:18.830964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.1a","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2023-11-28T20:02:07.279632+0000","last_change":"2023-11-28T20:02:07.279632+0000","last_active":"2023-11-28T20:02:07.264604+0000","last_peered":"2023-11-28T20:02:07.264604+0000","last_clean":"2023-11-28T20:02:07.264604+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:02:07.279632+0000","last_undegraded":"2023-11-28T20:02:07.279632+0000","last_fullsized":"2023-11-28T20:02:07.279632+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_clean_scrub_stamp":"2023-11-28T20:02:07.264604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.19","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-28T20:02:07.298903+0000","last_change":"2023-11-28T20:02:07.292322+0000","last_active":"2023-11-28T20:02:07.298903+0000","last_peered":"2023-11-28T20:02:07.298903+0000","last_clean":"2023-11-28T20:02:07.298903+0000","last_became_active":"2023-11-28T20:02:07.292063+0000","last_became_peered":"2023-11-28T20:02:07.292063+0000","last_unstale":"2023-11-28T20:02:07.298903+0000","last_undegraded":"2023-11-28T20:02:07.298903+0000","last_fullsized":"2023-11-28T20:02:07.298903+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:06.257335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:06.257335+0000","last_clean_scrub_stamp":"2023-11-28T20:02:06.257335+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T07:49:30.905608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.1b","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2023-11-28T20:02:07.278842+0000","last_change":"2023-11-28T20:02:07.278842+0000","last_active":"2023-11-28T20:02:07.264604+0000","last_peered":"2023-11-28T20:02:07.264604+0000","last_clean":"2023-11-28T20:02:07.264604+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:02:07.278842+0000","last_undegraded":"2023-11-28T20:02:07.278842+0000","last_fullsized":"2023-11-28T20:02:07.278842+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_clean_scrub_stamp":"2023-11-28T20:02:07.264604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.18","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-28T20:02:07.305630+0000","last_change":"2023-11-28T20:02:07.298452+0000","last_active":"2023-11-28T20:02:07.305630+0000","last_peered":"2023-11-28T20:02:07.305630+0000","last_clean":"2023-11-28T20:02:07.305630+0000","last_became_active":"2023-11-28T20:02:07.297932+0000","last_became_peered":"2023-11-28T20:02:07.297932+0000","last_unstale":"2023-11-28T20:02:07.305630+0000","last_undegraded":"2023-11-28T20:02:07.305630+0000","last_fullsized":"2023-11-28T20:02:07.305630+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:06.257335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:06.257335+0000","last_clean_scrub_stamp":"2023-11-28T20:02:06.257335+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:41:59.292583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.14","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2023-11-28T20:02:07.279138+0000","last_change":"2023-11-28T20:02:07.279138+0000","last_active":"2023-11-28T20:02:07.264604+0000","last_peered":"2023-11-28T20:02:07.264604+0000","last_clean":"2023-11-28T20:02:07.264604+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:02:07.279138+0000","last_undegraded":"2023-11-28T20:02:07.279138+0000","last_fullsized":"2023-11-28T20:02:07.279138+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_clean_scrub_stamp":"2023-11-28T20:02:07.264604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.17","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-28T20:02:07.305738+0000","last_change":"2023-11-28T20:02:07.299173+0000","last_active":"2023-11-28T20:02:07.305738+0000","last_peered":"2023-11-28T20:02:07.305738+0000","last_clean":"2023-11-28T20:02:07.305738+0000","last_became_active":"2023-11-28T20:02:07.298892+0000","last_became_peered":"2023-11-28T20:02:07.298892+0000","last_unstale":"2023-11-28T20:02:07.305738+0000","last_undegraded":"2023-11-28T20:02:07.305738+0000","last_fullsized":"2023-11-28T20:02:07.305738+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:06.257335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:06.257335+0000","last_clean_scrub_stamp":"2023-11-28T20:02:06.257335+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:31:56.348870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.15","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2023-11-28T20:02:07.286690+0000","last_change":"2023-11-28T20:02:07.286690+0000","last_active":"2023-11-28T20:02:07.264604+0000","last_peered":"2023-11-28T20:02:07.264604+0000","last_clean":"2023-11-28T20:02:07.264604+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:02:07.286690+0000","last_undegraded":"2023-11-28T20:02:07.286690+0000","last_fullsized":"2023-11-28T20:02:07.286690+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_clean_scrub_stamp":"2023-11-28T20:02:07.264604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.16","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-28T20:02:07.299239+0000","last_change":"2023-11-28T20:02:07.291621+0000","last_active":"2023-11-28T20:02:07.299239+0000","last_peered":"2023-11-28T20:02:07.299239+0000","last_clean":"2023-11-28T20:02:07.299239+0000","last_became_active":"2023-11-28T20:02:07.288923+0000","last_became_peered":"2023-11-28T20:02:07.288923+0000","last_unstale":"2023-11-28T20:02:07.299239+0000","last_undegraded":"2023-11-28T20:02:07.299239+0000","last_fullsized":"2023-11-28T20:02:07.299239+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:06.257335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:06.257335+0000","last_clean_scrub_stamp":"2023-11-28T20:02:06.257335+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:52:29.664838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.16","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2023-11-28T20:02:07.282823+0000","last_change":"2023-11-28T20:02:07.282823+0000","last_active":"2023-11-28T20:02:07.264604+0000","last_peered":"2023-11-28T20:02:07.264604+0000","last_clean":"2023-11-28T20:02:07.264604+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:02:07.282823+0000","last_undegraded":"2023-11-28T20:02:07.282823+0000","last_fullsized":"2023-11-28T20:02:07.282823+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_clean_scrub_stamp":"2023-11-28T20:02:07.264604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.15","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-28T20:02:07.303262+0000","last_change":"2023-11-28T20:02:07.300162+0000","last_active":"2023-11-28T20:02:07.303262+0000","last_peered":"2023-11-28T20:02:07.303262+0000","last_clean":"2023-11-28T20:02:07.303262+0000","last_became_active":"2023-11-28T20:02:07.299792+0000","last_became_peered":"2023-11-28T20:02:07.299792+0000","last_unstale":"2023-11-28T20:02:07.303262+0000","last_undegraded":"2023-11-28T20:02:07.303262+0000","last_fullsized":"2023-11-28T20:02:07.303262+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:06.257335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:06.257335+0000","last_clean_scrub_stamp":"2023-11-28T20:02:06.257335+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:03:03.265026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.17","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2023-11-28T20:02:07.278623+0000","last_change":"2023-11-28T20:02:07.278623+0000","last_active":"2023-11-28T20:02:07.264604+0000","last_peered":"2023-11-28T20:02:07.264604+0000","last_clean":"2023-11-28T20:02:07.264604+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:02:07.278623+0000","last_undegraded":"2023-11-28T20:02:07.278623+0000","last_fullsized":"2023-11-28T20:02:07.278623+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_clean_scrub_stamp":"2023-11-28T20:02:07.264604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.14","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-28T20:02:07.297892+0000","last_change":"2023-11-28T20:02:07.296089+0000","last_active":"2023-11-28T20:02:07.297892+0000","last_peered":"2023-11-28T20:02:07.297892+0000","last_clean":"2023-11-28T20:02:07.297892+0000","last_became_active":"2023-11-28T20:02:07.295836+0000","last_became_peered":"2023-11-28T20:02:07.295836+0000","last_unstale":"2023-11-28T20:02:07.297892+0000","last_undegraded":"2023-11-28T20:02:07.297892+0000","last_fullsized":"2023-11-28T20:02:07.297892+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:06.257335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:06.257335+0000","last_clean_scrub_stamp":"2023-11-28T20:02:06.257335+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:40:58.188007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.10","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2023-11-28T20:02:07.278502+0000","last_change":"2023-11-28T20:02:07.278502+0000","last_active":"2023-11-28T20:02:07.264604+0000","last_peered":"2023-11-28T20:02:07.264604+0000","last_clean":"2023-11-28T20:02:07.264604+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:02:07.278502+0000","last_undegraded":"2023-11-28T20:02:07.278502+0000","last_fullsized":"2023-11-28T20:02:07.278502+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_clean_scrub_stamp":"2023-11-28T20:02:07.264604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.13","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-28T20:02:07.305695+0000","last_change":"2023-11-28T20:02:07.298781+0000","last_active":"2023-11-28T20:02:07.305695+0000","last_peered":"2023-11-28T20:02:07.305695+0000","last_clean":"2023-11-28T20:02:07.305695+0000","last_became_active":"2023-11-28T20:02:07.298318+0000","last_became_peered":"2023-11-28T20:02:07.298318+0000","last_unstale":"2023-11-28T20:02:07.305695+0000","last_undegraded":"2023-11-28T20:02:07.305695+0000","last_fullsized":"2023-11-28T20:02:07.305695+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:06.257335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:06.257335+0000","last_clean_scrub_stamp":"2023-11-28T20:02:06.257335+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:40:58.188007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.11","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2023-11-28T20:02:07.278215+0000","last_change":"2023-11-28T20:02:07.278215+0000","last_active":"2023-11-28T20:02:07.264604+0000","last_peered":"2023-11-28T20:02:07.264604+0000","last_clean":"2023-11-28T20:02:07.264604+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:02:07.278215+0000","last_undegraded":"2023-11-28T20:02:07.278215+0000","last_fullsized":"2023-11-28T20:02:07.278215+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_clean_scrub_stamp":"2023-11-28T20:02:07.264604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.12","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-28T20:02:07.296902+0000","last_change":"2023-11-28T20:02:07.293203+0000","last_active":"2023-11-28T20:02:07.296902+0000","last_peered":"2023-11-28T20:02:07.296902+0000","last_clean":"2023-11-28T20:02:07.296902+0000","last_became_active":"2023-11-28T20:02:07.292922+0000","last_became_peered":"2023-11-28T20:02:07.292922+0000","last_unstale":"2023-11-28T20:02:07.296902+0000","last_undegraded":"2023-11-28T20:02:07.296902+0000","last_fullsized":"2023-11-28T20:02:07.296902+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:06.257335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:06.257335+0000","last_clean_scrub_stamp":"2023-11-28T20:02:06.257335+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:11:12.221383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.12","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2023-11-28T20:02:07.283056+0000","last_change":"2023-11-28T20:02:07.283056+0000","last_active":"2023-11-28T20:02:07.264604+0000","last_peered":"2023-11-28T20:02:07.264604+0000","last_clean":"2023-11-28T20:02:07.264604+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:02:07.283056+0000","last_undegraded":"2023-11-28T20:02:07.283056+0000","last_fullsized":"2023-11-28T20:02:07.283056+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_clean_scrub_stamp":"2023-11-28T20:02:07.264604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.11","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-28T20:02:07.299965+0000","last_change":"2023-11-28T20:02:07.291824+0000","last_active":"2023-11-28T20:02:07.299965+0000","last_peered":"2023-11-28T20:02:07.299965+0000","last_clean":"2023-11-28T20:02:07.299965+0000","last_became_active":"2023-11-28T20:02:07.291575+0000","last_became_peered":"2023-11-28T20:02:07.291575+0000","last_unstale":"2023-11-28T20:02:07.299965+0000","last_undegraded":"2023-11-28T20:02:07.299965+0000","last_fullsized":"2023-11-28T20:02:07.299965+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:06.257335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:06.257335+0000","last_clean_scrub_stamp":"2023-11-28T20:02:06.257335+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:32:46.550427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.13","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2023-11-28T20:02:07.280802+0000","last_change":"2023-11-28T20:02:07.280802+0000","last_active":"2023-11-28T20:02:07.264604+0000","last_peered":"2023-11-28T20:02:07.264604+0000","last_clean":"2023-11-28T20:02:07.264604+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:02:07.280802+0000","last_undegraded":"2023-11-28T20:02:07.280802+0000","last_fullsized":"2023-11-28T20:02:07.280802+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_clean_scrub_stamp":"2023-11-28T20:02:07.264604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.10","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-28T20:02:07.301395+0000","last_change":"2023-11-28T20:02:07.295459+0000","last_active":"2023-11-28T20:02:07.301395+0000","last_peered":"2023-11-28T20:02:07.301395+0000","last_clean":"2023-11-28T20:02:07.301395+0000","last_became_active":"2023-11-28T20:02:07.295090+0000","last_became_peered":"2023-11-28T20:02:07.295090+0000","last_unstale":"2023-11-28T20:02:07.301395+0000","last_undegraded":"2023-11-28T20:02:07.301395+0000","last_fullsized":"2023-11-28T20:02:07.301395+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:06.257335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:06.257335+0000","last_clean_scrub_stamp":"2023-11-28T20:02:06.257335+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:42:57.441074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.c","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2023-11-28T20:02:07.279835+0000","last_change":"2023-11-28T20:02:07.279835+0000","last_active":"2023-11-28T20:02:07.264604+0000","last_peered":"2023-11-28T20:02:07.264604+0000","last_clean":"2023-11-28T20:02:07.264604+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:02:07.279835+0000","last_undegraded":"2023-11-28T20:02:07.279835+0000","last_fullsized":"2023-11-28T20:02:07.279835+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_clean_scrub_stamp":"2023-11-28T20:02:07.264604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.f","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-28T20:02:07.301507+0000","last_change":"2023-11-28T20:02:07.295608+0000","last_active":"2023-11-28T20:02:07.301507+0000","last_peered":"2023-11-28T20:02:07.301507+0000","last_clean":"2023-11-28T20:02:07.301507+0000","last_became_active":"2023-11-28T20:02:07.295293+0000","last_became_peered":"2023-11-28T20:02:07.295293+0000","last_unstale":"2023-11-28T20:02:07.301507+0000","last_undegraded":"2023-11-28T20:02:07.301507+0000","last_fullsized":"2023-11-28T20:02:07.301507+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:06.257335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:06.257335+0000","last_clean_scrub_stamp":"2023-11-28T20:02:06.257335+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:32:46.550427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.d","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2023-11-28T20:02:07.288189+0000","last_change":"2023-11-28T20:02:07.288189+0000","last_active":"2023-11-28T20:02:07.264604+0000","last_peered":"2023-11-28T20:02:07.264604+0000","last_clean":"2023-11-28T20:02:07.264604+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:02:07.288189+0000","last_undegraded":"2023-11-28T20:02:07.288189+0000","last_fullsized":"2023-11-28T20:02:07.288189+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_clean_scrub_stamp":"2023-11-28T20:02:07.264604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.e","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-28T20:02:07.306531+0000","last_change":"2023-11-28T20:02:07.300742+0000","last_active":"2023-11-28T20:02:07.306531+0000","last_peered":"2023-11-28T20:02:07.306531+0000","last_clean":"2023-11-28T20:02:07.306531+0000","last_became_active":"2023-11-28T20:02:07.300392+0000","last_became_peered":"2023-11-28T20:02:07.300392+0000","last_unstale":"2023-11-28T20:02:07.306531+0000","last_undegraded":"2023-11-28T20:02:07.306531+0000","last_fullsized":"2023-11-28T20:02:07.306531+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:06.257335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:06.257335+0000","last_clean_scrub_stamp":"2023-11-28T20:02:06.257335+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T06:29:20.315585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.e","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2023-11-28T20:02:07.280313+0000","last_change":"2023-11-28T20:02:07.280313+0000","last_active":"2023-11-28T20:02:07.264604+0000","last_peered":"2023-11-28T20:02:07.264604+0000","last_clean":"2023-11-28T20:02:07.264604+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:02:07.280313+0000","last_undegraded":"2023-11-28T20:02:07.280313+0000","last_fullsized":"2023-11-28T20:02:07.280313+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_clean_scrub_stamp":"2023-11-28T20:02:07.264604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.d","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-28T20:02:07.305924+0000","last_change":"2023-11-28T20:02:07.301258+0000","last_active":"2023-11-28T20:02:07.305924+0000","last_peered":"2023-11-28T20:02:07.305924+0000","last_clean":"2023-11-28T20:02:07.305924+0000","last_became_active":"2023-11-28T20:02:07.300955+0000","last_became_peered":"2023-11-28T20:02:07.300955+0000","last_unstale":"2023-11-28T20:02:07.305924+0000","last_undegraded":"2023-11-28T20:02:07.305924+0000","last_fullsized":"2023-11-28T20:02:07.305924+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:06.257335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:06.257335+0000","last_clean_scrub_stamp":"2023-11-28T20:02:06.257335+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:03:27.733474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.8","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2023-11-28T20:02:07.279591+0000","last_change":"2023-11-28T20:02:07.279591+0000","last_active":"2023-11-28T20:02:07.264604+0000","last_peered":"2023-11-28T20:02:07.264604+0000","last_clean":"2023-11-28T20:02:07.264604+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:02:07.279591+0000","last_undegraded":"2023-11-28T20:02:07.279591+0000","last_fullsized":"2023-11-28T20:02:07.279591+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_clean_scrub_stamp":"2023-11-28T20:02:07.264604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.b","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-28T20:02:07.302648+0000","last_change":"2023-11-28T20:02:07.295857+0000","last_active":"2023-11-28T20:02:07.302648+0000","last_peered":"2023-11-28T20:02:07.302648+0000","last_clean":"2023-11-28T20:02:07.302648+0000","last_became_active":"2023-11-28T20:02:07.295642+0000","last_became_peered":"2023-11-28T20:02:07.295642+0000","last_unstale":"2023-11-28T20:02:07.302648+0000","last_undegraded":"2023-11-28T20:02:07.302648+0000","last_fullsized":"2023-11-28T20:02:07.302648+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:06.257335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:06.257335+0000","last_clean_scrub_stamp":"2023-11-28T20:02:06.257335+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:58:36.949904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.9","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2023-11-28T20:02:07.278282+0000","last_change":"2023-11-28T20:02:07.278282+0000","last_active":"2023-11-28T20:02:07.264604+0000","last_peered":"2023-11-28T20:02:07.264604+0000","last_clean":"2023-11-28T20:02:07.264604+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:02:07.278282+0000","last_undegraded":"2023-11-28T20:02:07.278282+0000","last_fullsized":"2023-11-28T20:02:07.278282+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_clean_scrub_stamp":"2023-11-28T20:02:07.264604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.a","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-28T20:02:07.299829+0000","last_change":"2023-11-28T20:02:07.296302+0000","last_active":"2023-11-28T20:02:07.299829+0000","last_peered":"2023-11-28T20:02:07.299829+0000","last_clean":"2023-11-28T20:02:07.299829+0000","last_became_active":"2023-11-28T20:02:07.296048+0000","last_became_peered":"2023-11-28T20:02:07.296048+0000","last_unstale":"2023-11-28T20:02:07.299829+0000","last_undegraded":"2023-11-28T20:02:07.299829+0000","last_fullsized":"2023-11-28T20:02:07.299829+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:06.257335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:06.257335+0000","last_clean_scrub_stamp":"2023-11-28T20:02:06.257335+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:01:27.566717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.a","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2023-11-28T20:02:07.279215+0000","last_change":"2023-11-28T20:02:07.279215+0000","last_active":"2023-11-28T20:02:07.264604+0000","last_peered":"2023-11-28T20:02:07.264604+0000","last_clean":"2023-11-28T20:02:07.264604+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:02:07.279215+0000","last_undegraded":"2023-11-28T20:02:07.279215+0000","last_fullsized":"2023-11-28T20:02:07.279215+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_clean_scrub_stamp":"2023-11-28T20:02:07.264604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.9","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-28T20:02:07.305776+0000","last_change":"2023-11-28T20:02:07.296576+0000","last_active":"2023-11-28T20:02:07.305776+0000","last_peered":"2023-11-28T20:02:07.305776+0000","last_clean":"2023-11-28T20:02:07.305776+0000","last_became_active":"2023-11-28T20:02:07.295982+0000","last_became_peered":"2023-11-28T20:02:07.295982+0000","last_unstale":"2023-11-28T20:02:07.305776+0000","last_undegraded":"2023-11-28T20:02:07.305776+0000","last_fullsized":"2023-11-28T20:02:07.305776+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:06.257335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:06.257335+0000","last_clean_scrub_stamp":"2023-11-28T20:02:06.257335+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:49:04.193812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.b","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2023-11-28T20:02:07.286137+0000","last_change":"2023-11-28T20:02:07.286137+0000","last_active":"2023-11-28T20:02:07.264604+0000","last_peered":"2023-11-28T20:02:07.264604+0000","last_clean":"2023-11-28T20:02:07.264604+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:02:07.286137+0000","last_undegraded":"2023-11-28T20:02:07.286137+0000","last_fullsized":"2023-11-28T20:02:07.286137+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_clean_scrub_stamp":"2023-11-28T20:02:07.264604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.8","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-28T20:02:07.297499+0000","last_change":"2023-11-28T20:02:07.293087+0000","last_active":"2023-11-28T20:02:07.297499+0000","last_peered":"2023-11-28T20:02:07.297499+0000","last_clean":"2023-11-28T20:02:07.297499+0000","last_became_active":"2023-11-28T20:02:07.292815+0000","last_became_peered":"2023-11-28T20:02:07.292815+0000","last_unstale":"2023-11-28T20:02:07.297499+0000","last_undegraded":"2023-11-28T20:02:07.297499+0000","last_fullsized":"2023-11-28T20:02:07.297499+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:06.257335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:06.257335+0000","last_clean_scrub_stamp":"2023-11-28T20:02:06.257335+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T06:11:16.542043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.4","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2023-11-28T20:02:07.287644+0000","last_change":"2023-11-28T20:02:07.287644+0000","last_active":"2023-11-28T20:02:07.264604+0000","last_peered":"2023-11-28T20:02:07.264604+0000","last_clean":"2023-11-28T20:02:07.264604+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:02:07.287644+0000","last_undegraded":"2023-11-28T20:02:07.287644+0000","last_fullsized":"2023-11-28T20:02:07.287644+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_clean_scrub_stamp":"2023-11-28T20:02:07.264604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.7","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-28T20:02:07.301899+0000","last_change":"2023-11-28T20:02:07.296980+0000","last_active":"2023-11-28T20:02:07.301899+0000","last_peered":"2023-11-28T20:02:07.301899+0000","last_clean":"2023-11-28T20:02:07.301899+0000","last_became_active":"2023-11-28T20:02:07.296625+0000","last_became_peered":"2023-11-28T20:02:07.296625+0000","last_unstale":"2023-11-28T20:02:07.301899+0000","last_undegraded":"2023-11-28T20:02:07.301899+0000","last_fullsized":"2023-11-28T20:02:07.301899+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:06.257335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:06.257335+0000","last_clean_scrub_stamp":"2023-11-28T20:02:06.257335+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:53:41.844853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.5","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2023-11-28T20:02:07.286312+0000","last_change":"2023-11-28T20:02:07.286312+0000","last_active":"2023-11-28T20:02:07.264604+0000","last_peered":"2023-11-28T20:02:07.264604+0000","last_clean":"2023-11-28T20:02:07.264604+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:02:07.286312+0000","last_undegraded":"2023-11-28T20:02:07.286312+0000","last_fullsized":"2023-11-28T20:02:07.286312+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_clean_scrub_stamp":"2023-11-28T20:02:07.264604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.6","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-28T20:02:07.298993+0000","last_change":"2023-11-28T20:02:07.296643+0000","last_active":"2023-11-28T20:02:07.298993+0000","last_peered":"2023-11-28T20:02:07.298993+0000","last_clean":"2023-11-28T20:02:07.298993+0000","last_became_active":"2023-11-28T20:02:07.296369+0000","last_became_peered":"2023-11-28T20:02:07.296369+0000","last_unstale":"2023-11-28T20:02:07.298993+0000","last_undegraded":"2023-11-28T20:02:07.298993+0000","last_fullsized":"2023-11-28T20:02:07.298993+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:06.257335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:06.257335+0000","last_clean_scrub_stamp":"2023-11-28T20:02:06.257335+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:52:33.501263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.6","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2023-11-28T20:02:07.284421+0000","last_change":"2023-11-28T20:02:07.284421+0000","last_active":"2023-11-28T20:02:07.264604+0000","last_peered":"2023-11-28T20:02:07.264604+0000","last_clean":"2023-11-28T20:02:07.264604+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:02:07.284421+0000","last_undegraded":"2023-11-28T20:02:07.284421+0000","last_fullsized":"2023-11-28T20:02:07.284421+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_clean_scrub_stamp":"2023-11-28T20:02:07.264604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.5","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-28T20:02:07.303244+0000","last_change":"2023-11-28T20:02:07.300054+0000","last_active":"2023-11-28T20:02:07.303244+0000","last_peered":"2023-11-28T20:02:07.303244+0000","last_clean":"2023-11-28T20:02:07.303244+0000","last_became_active":"2023-11-28T20:02:07.298610+0000","last_became_peered":"2023-11-28T20:02:07.298610+0000","last_unstale":"2023-11-28T20:02:07.303244+0000","last_undegraded":"2023-11-28T20:02:07.303244+0000","last_fullsized":"2023-11-28T20:02:07.303244+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:06.257335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:06.257335+0000","last_clean_scrub_stamp":"2023-11-28T20:02:06.257335+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:59:20.247089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.7","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2023-11-28T20:02:07.280140+0000","last_change":"2023-11-28T20:02:07.280140+0000","last_active":"2023-11-28T20:02:07.264604+0000","last_peered":"2023-11-28T20:02:07.264604+0000","last_clean":"2023-11-28T20:02:07.264604+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:02:07.280140+0000","last_undegraded":"2023-11-28T20:02:07.280140+0000","last_fullsized":"2023-11-28T20:02:07.280140+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_clean_scrub_stamp":"2023-11-28T20:02:07.264604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.4","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-28T20:02:07.303568+0000","last_change":"2023-11-28T20:02:07.301572+0000","last_active":"2023-11-28T20:02:07.303568+0000","last_peered":"2023-11-28T20:02:07.303568+0000","last_clean":"2023-11-28T20:02:07.303568+0000","last_became_active":"2023-11-28T20:02:07.301226+0000","last_became_peered":"2023-11-28T20:02:07.301226+0000","last_unstale":"2023-11-28T20:02:07.303568+0000","last_undegraded":"2023-11-28T20:02:07.303568+0000","last_fullsized":"2023-11-28T20:02:07.303568+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:06.257335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:06.257335+0000","last_clean_scrub_stamp":"2023-11-28T20:02:06.257335+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:48:42.567546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.0","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2023-11-28T20:02:07.281665+0000","last_change":"2023-11-28T20:02:07.281665+0000","last_active":"2023-11-28T20:02:07.264604+0000","last_peered":"2023-11-28T20:02:07.264604+0000","last_clean":"2023-11-28T20:02:07.264604+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:02:07.281665+0000","last_undegraded":"2023-11-28T20:02:07.281665+0000","last_fullsized":"2023-11-28T20:02:07.281665+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_clean_scrub_stamp":"2023-11-28T20:02:07.264604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.3","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-28T20:02:07.297690+0000","last_change":"2023-11-28T20:02:07.294264+0000","last_active":"2023-11-28T20:02:07.297690+0000","last_peered":"2023-11-28T20:02:07.297690+0000","last_clean":"2023-11-28T20:02:07.297690+0000","last_became_active":"2023-11-28T20:02:07.293763+0000","last_became_peered":"2023-11-28T20:02:07.293763+0000","last_unstale":"2023-11-28T20:02:07.297690+0000","last_undegraded":"2023-11-28T20:02:07.297690+0000","last_fullsized":"2023-11-28T20:02:07.297690+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:06.257335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:06.257335+0000","last_clean_scrub_stamp":"2023-11-28T20:02:06.257335+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:10:34.198054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.1","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2023-11-28T20:02:07.281971+0000","last_change":"2023-11-28T20:02:07.281971+0000","last_active":"2023-11-28T20:02:07.264604+0000","last_peered":"2023-11-28T20:02:07.264604+0000","last_clean":"2023-11-28T20:02:07.264604+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:02:07.281971+0000","last_undegraded":"2023-11-28T20:02:07.281971+0000","last_fullsized":"2023-11-28T20:02:07.281971+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_clean_scrub_stamp":"2023-11-28T20:02:07.264604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.2","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-28T20:02:07.305772+0000","last_change":"2023-11-28T20:02:07.299946+0000","last_active":"2023-11-28T20:02:07.305772+0000","last_peered":"2023-11-28T20:02:07.305772+0000","last_clean":"2023-11-28T20:02:07.305772+0000","last_became_active":"2023-11-28T20:02:07.299678+0000","last_became_peered":"2023-11-28T20:02:07.299678+0000","last_unstale":"2023-11-28T20:02:07.305772+0000","last_undegraded":"2023-11-28T20:02:07.305772+0000","last_fullsized":"2023-11-28T20:02:07.305772+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:06.257335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:06.257335+0000","last_clean_scrub_stamp":"2023-11-28T20:02:06.257335+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:46:58.325801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.2","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2023-11-28T20:02:07.284520+0000","last_change":"2023-11-28T20:02:07.284520+0000","last_active":"2023-11-28T20:02:07.264604+0000","last_peered":"2023-11-28T20:02:07.264604+0000","last_clean":"2023-11-28T20:02:07.264604+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:02:07.284520+0000","last_undegraded":"2023-11-28T20:02:07.284520+0000","last_fullsized":"2023-11-28T20:02:07.284520+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_clean_scrub_stamp":"2023-11-28T20:02:07.264604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-28T20:02:07.301562+0000","last_change":"2023-11-28T20:02:07.297766+0000","last_active":"2023-11-28T20:02:07.301562+0000","last_peered":"2023-11-28T20:02:07.301562+0000","last_clean":"2023-11-28T20:02:07.301562+0000","last_became_active":"2023-11-28T20:02:07.297403+0000","last_became_peered":"2023-11-28T20:02:07.297403+0000","last_unstale":"2023-11-28T20:02:07.301562+0000","last_undegraded":"2023-11-28T20:02:07.301562+0000","last_fullsized":"2023-11-28T20:02:07.301562+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:06.257335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:06.257335+0000","last_clean_scrub_stamp":"2023-11-28T20:02:06.257335+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T07:05:17.648805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.3","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2023-11-28T20:02:07.285711+0000","last_change":"2023-11-28T20:02:07.285711+0000","last_active":"2023-11-28T20:02:07.264604+0000","last_peered":"2023-11-28T20:02:07.264604+0000","last_clean":"2023-11-28T20:02:07.264604+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:02:07.285711+0000","last_undegraded":"2023-11-28T20:02:07.285711+0000","last_fullsized":"2023-11-28T20:02:07.285711+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_clean_scrub_stamp":"2023-11-28T20:02:07.264604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.0","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-28T20:02:07.306551+0000","last_change":"2023-11-28T20:02:07.300917+0000","last_active":"2023-11-28T20:02:07.306551+0000","last_peered":"2023-11-28T20:02:07.306551+0000","last_clean":"2023-11-28T20:02:07.306551+0000","last_became_active":"2023-11-28T20:02:07.300632+0000","last_became_peered":"2023-11-28T20:02:07.300632+0000","last_unstale":"2023-11-28T20:02:07.306551+0000","last_undegraded":"2023-11-28T20:02:07.306551+0000","last_fullsized":"2023-11-28T20:02:07.306551+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:06.257335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:06.257335+0000","last_clean_scrub_stamp":"2023-11-28T20:02:06.257335+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:10:34.198054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.f","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2023-11-28T20:02:07.288389+0000","last_change":"2023-11-28T20:02:07.288389+0000","last_active":"2023-11-28T20:02:07.264604+0000","last_peered":"2023-11-28T20:02:07.264604+0000","last_clean":"2023-11-28T20:02:07.264604+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:02:07.288389+0000","last_undegraded":"2023-11-28T20:02:07.288389+0000","last_fullsized":"2023-11-28T20:02:07.288389+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_clean_scrub_stamp":"2023-11-28T20:02:07.264604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.c","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-28T20:02:07.300002+0000","last_change":"2023-11-28T20:02:07.293843+0000","last_active":"2023-11-28T20:02:07.300002+0000","last_peered":"2023-11-28T20:02:07.300002+0000","last_clean":"2023-11-28T20:02:07.300002+0000","last_became_active":"2023-11-28T20:02:07.293538+0000","last_became_peered":"2023-11-28T20:02:07.293538+0000","last_unstale":"2023-11-28T20:02:07.300002+0000","last_undegraded":"2023-11-28T20:02:07.300002+0000","last_fullsized":"2023-11-28T20:02:07.300002+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:06.257335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:06.257335+0000","last_clean_scrub_stamp":"2023-11-28T20:02:06.257335+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T07:05:17.648805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":215,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-28T20:02:06.276288+0000","last_change":"2023-11-28T19:58:56.136501+0000","last_active":"2023-11-28T20:02:06.276288+0000","last_peered":"2023-11-28T20:02:06.276288+0000","last_clean":"2023-11-28T20:02:06.276288+0000","last_became_active":"2023-11-28T19:58:56.135998+0000","last_became_peered":"2023-11-28T19:58:56.135998+0000","last_unstale":"2023-11-28T20:02:06.276288+0000","last_undegraded":"2023-11-28T20:02:06.276288+0000","last_fullsized":"2023-11-28T20:02:06.276288+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:58:54.602349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:58:54.602349+0000","last_clean_scrub_stamp":"2023-11-28T19:58:54.602349+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:33:42.723349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":13,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":14,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":66748,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574891,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32200,"kb_used_data":1016,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339640,"statfs":{"total":96636764160,"available":96603791360,"internally_reserved":0,"allocated":1040384,"data_stored":1046204,"data_compressed":33374,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 20:01:59 2023","interfaces":[{"interface":"back","average":{"1min":0.66000000000000003,"5min":0.67100000000000004,"15min":0.67600000000000005},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.94299999999999995,"5min":0.94299999999999995,"15min":0.94299999999999995},"last":0.71299999999999997},{"interface":"front","average":{"1min":0.66500000000000004,"5min":0.67000000000000004,"15min":0.68000000000000005},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":1.014,"5min":1.014,"15min":1.014},"last":0.73199999999999998}]},{"osd":1,"last update":"Tue Nov 28 20:01:59 2023","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.63900000000000001,"15min":0.64300000000000002},"min":{"1min":0.46100000000000002,"5min":0.438,"15min":0.438},"max":{"1min":0.95099999999999996,"5min":0.95099999999999996,"15min":0.95099999999999996},"last":0.621},{"interface":"front","average":{"1min":0.66400000000000003,"5min":0.68100000000000005,"15min":0.69499999999999995},"min":{"1min":0.45600000000000002,"5min":0.432,"15min":0.432},"max":{"1min":0.85099999999999998,"5min":1.0900000000000001,"15min":1.0900000000000001},"last":0.59199999999999997}]},{"osd":2,"last update":"Tue Nov 28 20:01:59 2023","interfaces":[{"interface":"back","average":{"1min":0.69899999999999995,"5min":0.70899999999999996,"15min":0.72599999999999998},"min":{"1min":0.497,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.93100000000000005,"5min":0.98799999999999999,"15min":0.98799999999999999},"last":0.84099999999999997},{"interface":"front","average":{"1min":0.66800000000000004,"5min":0.68799999999999994,"15min":0.69999999999999996},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":1.514,"5min":1.514,"15min":1.514},"last":0.53200000000000003}]},{"osd":3,"last update":"Tue Nov 28 20:01:59 2023","interfaces":[{"interface":"back","average":{"1min":0.68200000000000005,"5min":0.69699999999999995,"15min":0.69899999999999995},"min":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":0.90200000000000002,"5min":1.0449999999999999,"15min":1.0449999999999999},"last":0.69299999999999995},{"interface":"front","average":{"1min":0.70899999999999996,"5min":0.76600000000000001,"15min":0.78400000000000003},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":1.034,"5min":1.1299999999999999,"15min":1.1299999999999999},"last":0.79300000000000004}]},{"osd":4,"last update":"Tue Nov 28 20:01:59 2023","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.628,"15min":0.63700000000000001},"min":{"1min":0.38900000000000001,"5min":0.378,"15min":0.378},"max":{"1min":1.2829999999999999,"5min":1.2829999999999999,"15min":1.2829999999999999},"last":0.65800000000000003},{"interface":"front","average":{"1min":0.66800000000000004,"5min":0.70899999999999996,"15min":0.72499999999999998},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.91800000000000004,"5min":1.1120000000000001,"15min":1.1120000000000001},"last":0.82199999999999995}]},{"osd":5,"last update":"Tue Nov 28 20:01:59 2023","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.65300000000000002,"15min":0.67400000000000004},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.97999999999999998,"5min":1.1699999999999999,"15min":1.1699999999999999},"last":0.751},{"interface":"front","average":{"1min":0.70899999999999996,"5min":0.73699999999999999,"15min":0.75600000000000001},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":1.3300000000000001,"5min":1.3300000000000001,"15min":1.3300000000000001},"last":0.76700000000000002}]},{"osd":6,"last update":"Tue Nov 28 20:01:59 2023","interfaces":[{"interface":"back","average":{"1min":0.76000000000000001,"5min":0.76400000000000001,"15min":0.77600000000000002},"min":{"1min":0.53500000000000003,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":1.3919999999999999,"5min":1.3919999999999999,"15min":1.3919999999999999},"last":0.85899999999999999},{"interface":"front","average":{"1min":0.67000000000000004,"5min":0.71199999999999997,"15min":0.73499999999999999},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.96099999999999997,"5min":1.23,"15min":1.23},"last":0.88600000000000001}]}]},{"osd":6,"up_from":13,"seq":55834574889,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27976,"kb_used_data":952,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343864,"statfs":{"total":96636764160,"available":96608116736,"internally_reserved":0,"allocated":974848,"data_stored":455836,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 20:01:54 2023","interfaces":[{"interface":"back","average":{"1min":0.64000000000000001,"5min":0.621,"15min":0.61699999999999999},"min":{"1min":0.40200000000000002,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.91600000000000004,"5min":0.91600000000000004,"15min":0.91600000000000004},"last":0.627},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.66000000000000003,"15min":0.66200000000000003},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":0.80600000000000005,"5min":0.98999999999999999,"15min":0.98999999999999999},"last":0.68000000000000005}]},{"osd":1,"last update":"Tue Nov 28 20:01:54 2023","interfaces":[{"interface":"back","average":{"1min":0.71499999999999997,"5min":0.76600000000000001,"15min":0.78200000000000003},"min":{"1min":0.54700000000000004,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.012,"5min":1.105,"15min":1.105},"last":0.78300000000000003},{"interface":"front","average":{"1min":0.62,"5min":0.67600000000000005,"15min":0.68300000000000005},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":0.90200000000000002,"5min":0.95899999999999996,"15min":0.95899999999999996},"last":0.60899999999999999}]},{"osd":2,"last update":"Tue Nov 28 20:01:54 2023","interfaces":[{"interface":"back","average":{"1min":0.63800000000000001,"5min":0.68200000000000005,"15min":0.69399999999999995},"min":{"1min":0.502,"5min":0.502,"15min":0.502},"max":{"1min":0.78900000000000003,"5min":0.93400000000000005,"15min":0.93400000000000005},"last":0.66900000000000004},{"interface":"front","average":{"1min":0.65800000000000003,"5min":0.70399999999999996,"15min":0.71399999999999997},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":0.95299999999999996,"5min":1.006,"15min":1.006},"last":0.69999999999999996}]},{"osd":3,"last update":"Tue Nov 28 20:01:54 2023","interfaces":[{"interface":"back","average":{"1min":0.68300000000000005,"5min":0.72799999999999998,"15min":0.74199999999999999},"min":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":0.96699999999999997,"5min":1.056,"15min":1.056},"last":0.80600000000000005},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.66600000000000004,"15min":0.67800000000000005},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":0.78200000000000003,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.63900000000000001}]},{"osd":4,"last update":"Tue Nov 28 20:01:54 2023","interfaces":[{"interface":"back","average":{"1min":0.61299999999999999,"5min":0.624,"15min":0.628},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.93300000000000005,"5min":0.97599999999999998,"15min":0.97599999999999998},"last":0.55400000000000005},{"interface":"front","average":{"1min":0.61499999999999999,"5min":0.68700000000000006,"15min":0.72099999999999997},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.91700000000000004,"5min":1.389,"15min":1.389},"last":0.71399999999999997}]},{"osd":5,"last update":"Tue Nov 28 20:01:54 2023","interfaces":[{"interface":"back","average":{"1min":0.68799999999999994,"5min":0.77100000000000002,"15min":0.80100000000000005},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":1.0629999999999999,"5min":1.4259999999999999,"15min":1.4259999999999999},"last":0.749},{"interface":"front","average":{"1min":0.65600000000000003,"5min":0.72999999999999998,"15min":0.752},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.97099999999999997,"5min":1.276,"15min":1.276},"last":0.65600000000000003}]},{"osd":7,"last update":"Tue Nov 28 20:01:54 2023","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.67900000000000005,"15min":0.70299999999999996},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.84199999999999997,"5min":1.014,"15min":1.014},"last":0.58299999999999996},{"interface":"front","average":{"1min":0.68200000000000005,"5min":0.77900000000000003,"15min":0.81299999999999994},"min":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":1.002,"5min":1.242,"15min":1.242},"last":0.73599999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574891,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32136,"kb_used_data":952,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339704,"statfs":{"total":96636764160,"available":96603856896,"internally_reserved":0,"allocated":974848,"data_stored":455836,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 20:01:59 2023","interfaces":[{"interface":"back","average":{"1min":0.66500000000000004,"5min":0.68400000000000005,"15min":0.70099999999999996},"min":{"1min":0.44400000000000001,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":1.077,"5min":1.077,"15min":1.077},"last":0.56100000000000005},{"interface":"front","average":{"1min":0.65300000000000002,"5min":0.68500000000000005,"15min":0.70699999999999996},"min":{"1min":0.41899999999999998,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.94599999999999995,"5min":1.149,"15min":1.149},"last":0.67800000000000005}]},{"osd":1,"last update":"Tue Nov 28 20:01:59 2023","interfaces":[{"interface":"back","average":{"1min":0.626,"5min":0.68600000000000005,"15min":0.70399999999999996},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.82599999999999996,"5min":0.94499999999999995,"15min":0.94499999999999995},"last":0.63100000000000001},{"interface":"front","average":{"1min":0.67400000000000004,"5min":0.69299999999999995,"15min":0.71699999999999997},"min":{"1min":0.49099999999999999,"5min":0.38,"15min":0.38},"max":{"1min":1.008,"5min":1.0940000000000001,"15min":1.0940000000000001},"last":0.52200000000000002}]},{"osd":2,"last update":"Tue Nov 28 20:01:59 2023","interfaces":[{"interface":"back","average":{"1min":0.65400000000000003,"5min":0.83299999999999996,"15min":0.90800000000000003},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":1.044,"5min":5.0880000000000001,"15min":5.0880000000000001},"last":0.83099999999999996},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.879,"15min":0.96099999999999997},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":0.91300000000000003,"5min":5.1399999999999997,"15min":5.1399999999999997},"last":0.76200000000000001}]},{"osd":3,"last update":"Tue Nov 28 20:01:59 2023","interfaces":[{"interface":"back","average":{"1min":0.71499999999999997,"5min":0.90100000000000002,"15min":0.98499999999999999},"min":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":1.1000000000000001,"5min":5.0469999999999997,"15min":5.0469999999999997},"last":0.92900000000000005},{"interface":"front","average":{"1min":0.69999999999999996,"5min":0.878,"15min":0.95999999999999996},"min":{"1min":0.47899999999999998,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":0.95899999999999996,"5min":5.024,"15min":5.024},"last":0.80600000000000005}]},{"osd":4,"last update":"Tue Nov 28 20:01:59 2023","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.64000000000000001,"15min":0.66400000000000003},"min":{"1min":0.42899999999999999,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.877,"5min":1.4810000000000001,"15min":1.4810000000000001},"last":0.71399999999999997},{"interface":"front","average":{"1min":0.67300000000000004,"5min":0.72099999999999997,"15min":0.73799999999999999},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.97599999999999998,"5min":1.6339999999999999,"15min":1.6339999999999999},"last":0.88300000000000001}]},{"osd":6,"last update":"Tue Nov 28 20:01:59 2023","interfaces":[{"interface":"back","average":{"1min":0.70699999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"min":{"1min":0.48399999999999999,"5min":0.434,"15min":0.434},"max":{"1min":1.0489999999999999,"5min":1.0489999999999999,"15min":1.0489999999999999},"last":0.86099999999999999},{"interface":"front","average":{"1min":0.68899999999999995,"5min":0.72499999999999998,"15min":0.73999999999999999},"min":{"1min":0.47599999999999998,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":0.93200000000000005,"5min":1.099,"15min":1.099},"last":0.90400000000000003}]},{"osd":7,"last update":"Tue Nov 28 20:01:59 2023","interfaces":[{"interface":"back","average":{"1min":0.73599999999999999,"5min":0.77300000000000002,"15min":0.78200000000000003},"min":{"1min":0.48899999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":1.022,"5min":1.236,"15min":1.236},"last":0.96099999999999997},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.78300000000000003,"15min":0.79500000000000004},"min":{"1min":0.51100000000000001,"5min":0.505,"15min":0.505},"max":{"1min":1.1000000000000001,"5min":1.1000000000000001,"15min":1.1000000000000001},"last":0.94499999999999995}]}]},{"osd":4,"up_from":13,"seq":55834574890,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32136,"kb_used_data":952,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339704,"statfs":{"total":96636764160,"available":96603856896,"internally_reserved":0,"allocated":974848,"data_stored":455836,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 20:01:58 2023","interfaces":[{"interface":"back","average":{"1min":0.70799999999999996,"5min":0.69399999999999995,"15min":0.70499999999999996},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":1.107,"5min":1.107,"15min":1.107},"last":0.55600000000000005},{"interface":"front","average":{"1min":0.63200000000000001,"5min":0.68300000000000005,"15min":0.70299999999999996},"min":{"1min":0.42799999999999999,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":1.024,"5min":1.163,"15min":1.163},"last":0.53000000000000003}]},{"osd":1,"last update":"Tue Nov 28 20:01:58 2023","interfaces":[{"interface":"back","average":{"1min":0.64400000000000002,"5min":0.71199999999999997,"15min":0.746},"min":{"1min":0.432,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.93799999999999994,"5min":1.111,"15min":1.111},"last":0.41499999999999998},{"interface":"front","average":{"1min":0.77600000000000002,"5min":0.78000000000000003,"15min":0.80200000000000005},"min":{"1min":0.629,"5min":0.443,"15min":0.443},"max":{"1min":1.0640000000000001,"5min":1.238,"15min":1.238},"last":0.60299999999999998}]},{"osd":2,"last update":"Tue Nov 28 20:01:58 2023","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.751,"15min":0.77200000000000002},"min":{"1min":0.48599999999999999,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":1.026,"5min":1.0669999999999999,"15min":1.0669999999999999},"last":0.73699999999999999},{"interface":"front","average":{"1min":0.754,"5min":0.77400000000000002,"15min":0.80200000000000005},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":1.1359999999999999,"5min":1.1359999999999999,"15min":1.1359999999999999},"last":0.71699999999999997}]},{"osd":3,"last update":"Tue Nov 28 20:01:58 2023","interfaces":[{"interface":"back","average":{"1min":0.69199999999999995,"5min":0.74399999999999999,"15min":0.78200000000000003},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":0.97999999999999998,"5min":1.202,"15min":1.202},"last":0.57899999999999996},{"interface":"front","average":{"1min":0.74199999999999999,"5min":0.76100000000000001,"15min":0.78400000000000003},"min":{"1min":0.52800000000000002,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":1.0669999999999999,"5min":1.0669999999999999,"15min":1.0669999999999999},"last":0.66400000000000003}]},{"osd":5,"last update":"Tue Nov 28 20:01:58 2023","interfaces":[{"interface":"back","average":{"1min":0.68600000000000005,"5min":0.69499999999999995,"15min":0.71399999999999997},"min":{"1min":0.41199999999999998,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.89600000000000002,"5min":0.95899999999999996,"15min":0.95899999999999996},"last":0.44400000000000001},{"interface":"front","average":{"1min":0.65600000000000003,"5min":0.68400000000000005,"15min":0.70399999999999996},"min":{"1min":0.435,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.90500000000000003,"5min":1.034,"15min":1.034},"last":0.625}]},{"osd":6,"last update":"Tue Nov 28 20:01:58 2023","interfaces":[{"interface":"back","average":{"1min":0.64500000000000002,"5min":0.69099999999999995,"15min":0.71999999999999997},"min":{"1min":0.45300000000000001,"5min":0.438,"15min":0.438},"max":{"1min":0.85299999999999998,"5min":1.0309999999999999,"15min":1.0309999999999999},"last":0.78900000000000003},{"interface":"front","average":{"1min":0.76300000000000001,"5min":0.76600000000000001,"15min":0.77800000000000002},"min":{"1min":0.55400000000000005,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":0.93999999999999995,"5min":1.002,"15min":1.002},"last":0.64500000000000002}]},{"osd":7,"last update":"Tue Nov 28 20:01:58 2023","interfaces":[{"interface":"back","average":{"1min":0.72699999999999998,"5min":0.75900000000000001,"15min":0.77800000000000002},"min":{"1min":0.57399999999999995,"5min":0.495,"15min":0.495},"max":{"1min":1.089,"5min":1.089,"15min":1.089},"last":0.69399999999999995},{"interface":"front","average":{"1min":0.81599999999999995,"5min":0.83699999999999997,"15min":0.85899999999999999},"min":{"1min":0.621,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":1.042,"5min":1.1459999999999999,"15min":1.1459999999999999},"last":0.76700000000000002}]}]},{"osd":3,"up_from":13,"seq":55834574891,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32136,"kb_used_data":952,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339704,"statfs":{"total":96636764160,"available":96603856896,"internally_reserved":0,"allocated":974848,"data_stored":455836,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 20:01:56 2023","interfaces":[{"interface":"back","average":{"1min":0.44900000000000001,"5min":0.441,"15min":0.44500000000000001},"min":{"1min":0.26300000000000001,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":1.7130000000000001,"5min":1.7130000000000001,"15min":1.7130000000000001},"last":0.38},{"interface":"front","average":{"1min":0.51400000000000001,"5min":0.46600000000000003,"15min":0.47099999999999997},"min":{"1min":0.27100000000000002,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":3.0630000000000002,"5min":3.0630000000000002,"15min":3.0630000000000002},"last":0.48799999999999999}]},{"osd":1,"last update":"Tue Nov 28 20:01:56 2023","interfaces":[{"interface":"back","average":{"1min":0.44600000000000001,"5min":0.45800000000000002,"15min":0.47399999999999998},"min":{"1min":0.317,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.89200000000000002,"5min":0.89200000000000002,"15min":0.89200000000000002},"last":0.50600000000000001},{"interface":"front","average":{"1min":0.65600000000000003,"5min":0.52200000000000002,"15min":0.51000000000000001},"min":{"1min":0.34200000000000003,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":5.8920000000000003,"5min":5.8920000000000003,"15min":5.8920000000000003},"last":0.33800000000000002}]},{"osd":2,"last update":"Tue Nov 28 20:01:56 2023","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.54800000000000004,"15min":0.53800000000000003},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":4.6390000000000002,"5min":4.6390000000000002,"15min":4.6390000000000002},"last":0.36199999999999999},{"interface":"front","average":{"1min":0.95099999999999996,"5min":0.63900000000000001,"15min":0.60299999999999998},"min":{"1min":0.40899999999999997,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":11.593,"5min":11.593,"15min":11.593},"last":0.53500000000000003}]},{"osd":4,"last update":"Tue Nov 28 20:01:56 2023","interfaces":[{"interface":"back","average":{"1min":0.91100000000000003,"5min":0.79400000000000004,"15min":0.77200000000000002},"min":{"1min":0.46600000000000003,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":5.5549999999999997,"5min":5.5549999999999997,"15min":5.5549999999999997},"last":0.91200000000000003},{"interface":"front","average":{"1min":1.179,"5min":0.879,"15min":0.82799999999999996},"min":{"1min":0.60999999999999999,"5min":0.503,"15min":0.503},"max":{"1min":11.747,"5min":11.747,"15min":11.747},"last":0.93300000000000005}]},{"osd":5,"last update":"Tue Nov 28 20:01:56 2023","interfaces":[{"interface":"back","average":{"1min":1.1040000000000001,"5min":0.85699999999999998,"15min":0.81899999999999995},"min":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":11.705,"5min":11.705,"15min":11.705},"last":0.78700000000000003},{"interface":"front","average":{"1min":0.70399999999999996,"5min":0.77100000000000002,"15min":0.79200000000000004},"min":{"1min":0.51200000000000001,"5min":0.495,"15min":0.495},"max":{"1min":1.0580000000000001,"5min":1.3100000000000001,"15min":1.3100000000000001},"last":0.88500000000000001}]},{"osd":6,"last update":"Tue Nov 28 20:01:56 2023","interfaces":[{"interface":"back","average":{"1min":0.748,"5min":0.81899999999999995,"15min":0.83499999999999996},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":1.6639999999999999,"5min":1.6639999999999999,"15min":1.6639999999999999},"last":0.83199999999999996},{"interface":"front","average":{"1min":0.84499999999999997,"5min":0.80400000000000005,"15min":0.76700000000000002},"min":{"1min":0.52900000000000003,"5min":0.495,"15min":0.495},"max":{"1min":3.1459999999999999,"5min":4.0679999999999996,"15min":4.0679999999999996},"last":0.95299999999999996}]},{"osd":7,"last update":"Tue Nov 28 20:01:56 2023","interfaces":[{"interface":"back","average":{"1min":0.96199999999999997,"5min":0.89600000000000002,"15min":0.86499999999999999},"min":{"1min":0.52100000000000002,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":6.6619999999999999,"5min":6.6619999999999999,"15min":6.6619999999999999},"last":1.016},{"interface":"front","average":{"1min":1.141,"5min":0.92300000000000004,"15min":0.90100000000000002},"min":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":11.782,"5min":11.782,"15min":11.782},"last":0.89800000000000002}]}]},{"osd":2,"up_from":13,"seq":55834574889,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27976,"kb_used_data":952,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343864,"statfs":{"total":96636764160,"available":96608116736,"internally_reserved":0,"allocated":974848,"data_stored":455836,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 20:01:57 2023","interfaces":[{"interface":"back","average":{"1min":0.39600000000000002,"5min":0.438,"15min":0.45000000000000001},"min":{"1min":0.28899999999999998,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.60399999999999998,"5min":0.74099999999999999,"15min":0.74099999999999999},"last":0.255},{"interface":"front","average":{"1min":0.435,"5min":0.46100000000000002,"15min":0.47499999999999998},"min":{"1min":0.30199999999999999,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.59599999999999997,"5min":0.67700000000000005,"15min":0.67700000000000005},"last":0.29499999999999998}]},{"osd":1,"last update":"Tue Nov 28 20:01:57 2023","interfaces":[{"interface":"back","average":{"1min":0.47699999999999998,"5min":0.48999999999999999,"15min":0.50600000000000001},"min":{"1min":0.377,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.64500000000000002,"5min":1.0389999999999999,"15min":1.0389999999999999},"last":0.41499999999999998},{"interface":"front","average":{"1min":0.45100000000000001,"5min":0.47999999999999998,"15min":0.496},"min":{"1min":0.33800000000000002,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.58999999999999997,"5min":0.70999999999999996,"15min":0.70999999999999996},"last":0.45200000000000001}]},{"osd":3,"last update":"Tue Nov 28 20:01:57 2023","interfaces":[{"interface":"back","average":{"1min":0.45700000000000002,"5min":0.46300000000000002,"15min":0.46899999999999997},"min":{"1min":0.36899999999999999,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.60299999999999998,"5min":0.629,"15min":0.629},"last":0.32200000000000001},{"interface":"front","average":{"1min":0.52300000000000002,"5min":0.55900000000000005,"15min":0.58099999999999996},"min":{"1min":0.41599999999999998,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.58899999999999997,"5min":0.98499999999999999,"15min":0.98499999999999999},"last":0.47199999999999998}]},{"osd":4,"last update":"Tue Nov 28 20:01:57 2023","interfaces":[{"interface":"back","average":{"1min":0.69399999999999995,"5min":0.80300000000000005,"15min":0.84199999999999997},"min":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":0.86899999999999999,"5min":1.139,"15min":1.139},"last":0.60199999999999998},{"interface":"front","average":{"1min":0.70199999999999996,"5min":0.79600000000000004,"15min":0.83399999999999996},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":1.008,"5min":1.238,"15min":1.238},"last":0.68600000000000005}]},{"osd":5,"last update":"Tue Nov 28 20:01:57 2023","interfaces":[{"interface":"back","average":{"1min":0.70799999999999996,"5min":0.81200000000000006,"15min":0.85999999999999999},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":1.0389999999999999,"5min":1.6180000000000001,"15min":1.6180000000000001},"last":0.55300000000000005},{"interface":"front","average":{"1min":0.70699999999999996,"5min":0.78400000000000003,"15min":0.81799999999999995},"min":{"1min":0.51800000000000002,"5min":0.496,"15min":0.496},"max":{"1min":1.0149999999999999,"5min":1.339,"15min":1.339},"last":0.53300000000000003}]},{"osd":6,"last update":"Tue Nov 28 20:01:57 2023","interfaces":[{"interface":"back","average":{"1min":0.71399999999999997,"5min":0.77300000000000002,"15min":0.79500000000000004},"min":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":1.0589999999999999,"5min":1.1839999999999999,"15min":1.1839999999999999},"last":0.57099999999999995},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.80300000000000005,"15min":0.84199999999999997},"min":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":0.98699999999999999,"5min":1.099,"15min":1.099},"last":0.70899999999999996}]},{"osd":7,"last update":"Tue Nov 28 20:01:57 2023","interfaces":[{"interface":"back","average":{"1min":0.69599999999999995,"5min":0.82199999999999995,"15min":0.86699999999999999},"min":{"1min":0.53300000000000003,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":0.94699999999999995,"5min":1.4590000000000001,"15min":1.4590000000000001},"last":0.66200000000000003},{"interface":"front","average":{"1min":0.73199999999999998,"5min":0.80900000000000005,"15min":0.84699999999999998},"min":{"1min":0.55200000000000005,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":1.0760000000000001,"5min":1.387,"15min":1.387},"last":0.76200000000000001}]}]},{"osd":1,"up_from":13,"seq":55834574891,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32136,"kb_used_data":952,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339704,"statfs":{"total":96636764160,"available":96603856896,"internally_reserved":0,"allocated":974848,"data_stored":455836,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 20:02:00 2023","interfaces":[{"interface":"back","average":{"1min":0.38700000000000001,"5min":0.54600000000000004,"15min":0.62},"min":{"1min":0.249,"5min":0.249,"15min":0.249},"max":{"1min":0.60699999999999998,"5min":3.8740000000000001,"15min":3.8740000000000001},"last":0.39400000000000002},{"interface":"front","average":{"1min":0.42099999999999999,"5min":0.51000000000000001,"15min":0.55100000000000005},"min":{"1min":0.32300000000000001,"5min":0.25,"15min":0.25},"max":{"1min":0.60399999999999998,"5min":2.0760000000000001,"15min":2.0760000000000001},"last":0.495}]},{"osd":2,"last update":"Tue Nov 28 20:02:00 2023","interfaces":[{"interface":"back","average":{"1min":0.41399999999999998,"5min":0.56000000000000005,"15min":0.626},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.70799999999999996,"5min":3.7320000000000002,"15min":3.7320000000000002},"last":0.377},{"interface":"front","average":{"1min":0.46899999999999997,"5min":0.63400000000000001,"15min":0.71799999999999997},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.67000000000000004,"5min":3.9089999999999998,"15min":3.9089999999999998},"last":0.436}]},{"osd":3,"last update":"Tue Nov 28 20:02:00 2023","interfaces":[{"interface":"back","average":{"1min":0.52200000000000002,"5min":0.61799999999999999,"15min":0.66000000000000003},"min":{"1min":0.436,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.70799999999999996,"5min":1.6399999999999999,"15min":1.6399999999999999},"last":0.50800000000000001},{"interface":"front","average":{"1min":0.45500000000000002,"5min":0.61599999999999999,"15min":0.67400000000000004},"min":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.625,"5min":2.5270000000000001,"15min":2.5270000000000001},"last":0.52100000000000002}]},{"osd":4,"last update":"Tue Nov 28 20:02:00 2023","interfaces":[{"interface":"back","average":{"1min":0.69799999999999995,"5min":0.81699999999999995,"15min":0.86899999999999999},"min":{"1min":0.42199999999999999,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.91400000000000003,"5min":3.1659999999999999,"15min":3.1659999999999999},"last":0.61899999999999999},{"interface":"front","average":{"1min":0.69699999999999995,"5min":0.84399999999999997,"15min":0.91200000000000003},"min":{"1min":0.52300000000000002,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.94299999999999995,"5min":3.7959999999999998,"15min":3.7959999999999998},"last":0.69899999999999995}]},{"osd":5,"last update":"Tue Nov 28 20:02:00 2023","interfaces":[{"interface":"back","average":{"1min":0.71399999999999997,"5min":0.875,"15min":0.95099999999999996},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":1.004,"5min":4.1479999999999997,"15min":4.1479999999999997},"last":0.60999999999999999},{"interface":"front","average":{"1min":0.69799999999999995,"5min":0.82599999999999996,"15min":0.88200000000000001},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":0.87,"5min":3.5569999999999999,"15min":3.5569999999999999},"last":0.65200000000000002}]},{"osd":6,"last update":"Tue Nov 28 20:02:00 2023","interfaces":[{"interface":"back","average":{"1min":0.72399999999999998,"5min":0.88800000000000001,"15min":0.95699999999999996},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":0.94499999999999995,"5min":2.863,"15min":2.863},"last":0.63200000000000001},{"interface":"front","average":{"1min":0.76800000000000002,"5min":0.89800000000000002,"15min":0.95399999999999996},"min":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":0.97999999999999998,"5min":3.371,"15min":3.371},"last":0.71799999999999997}]},{"osd":7,"last update":"Tue Nov 28 20:02:00 2023","interfaces":[{"interface":"back","average":{"1min":0.70299999999999996,"5min":0.89100000000000001,"15min":0.97199999999999998},"min":{"1min":0.53100000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":0.93600000000000005,"5min":3.8439999999999999,"15min":3.8439999999999999},"last":0.76200000000000001},{"interface":"front","average":{"1min":0.68799999999999994,"5min":0.90500000000000003,"15min":0.99299999999999999},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.95899999999999996,"5min":3.9689999999999999,"15min":3.9689999999999999},"last":0.72499999999999998}]}]},{"osd":0,"up_from":13,"seq":55834574890,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32196,"kb_used_data":1016,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339644,"statfs":{"total":96636764160,"available":96603795456,"internally_reserved":0,"allocated":1040384,"data_stored":1046204,"data_compressed":33374,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Nov 28 20:01:57 2023","interfaces":[{"interface":"back","average":{"1min":0.38700000000000001,"5min":0.57399999999999995,"15min":0.65100000000000002},"min":{"1min":0.24099999999999999,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":0.68400000000000005,"5min":4.883,"15min":4.883},"last":0.35299999999999998},{"interface":"front","average":{"1min":0.43099999999999999,"5min":0.70099999999999996,"15min":0.81899999999999995},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.66800000000000004,"5min":8.0800000000000001,"15min":8.0800000000000001},"last":0.40500000000000003}]},{"osd":2,"last update":"Tue Nov 28 20:01:57 2023","interfaces":[{"interface":"back","average":{"1min":0.50800000000000001,"5min":0.77400000000000002,"15min":0.90700000000000003},"min":{"1min":0.312,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.85599999999999998,"5min":8.1029999999999998,"15min":8.1029999999999998},"last":0.39200000000000002},{"interface":"front","average":{"1min":0.53300000000000003,"5min":0.79400000000000004,"15min":0.92200000000000004},"min":{"1min":0.40600000000000003,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.748,"5min":8.1310000000000002,"15min":8.1310000000000002},"last":0.48999999999999999}]},{"osd":3,"last update":"Tue Nov 28 20:01:57 2023","interfaces":[{"interface":"back","average":{"1min":0.47299999999999998,"5min":0.628,"15min":0.70699999999999996},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.873,"5min":4.3949999999999996,"15min":4.3949999999999996},"last":0.42399999999999999},{"interface":"front","average":{"1min":0.497,"5min":0.65100000000000002,"15min":0.72099999999999997},"min":{"1min":0.37,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.89200000000000002,"5min":4.3470000000000004,"15min":4.3470000000000004},"last":0.45700000000000002}]},{"osd":4,"last update":"Tue Nov 28 20:01:57 2023","interfaces":[{"interface":"back","average":{"1min":0.72799999999999998,"5min":0.92000000000000004,"15min":1.0069999999999999},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":1.038,"5min":4.6360000000000001,"15min":4.6360000000000001},"last":0.76200000000000001},{"interface":"front","average":{"1min":0.76800000000000002,"5min":0.93400000000000005,"15min":1.0129999999999999},"min":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":1.0820000000000001,"5min":4.4710000000000001,"15min":4.4710000000000001},"last":0.69099999999999995}]},{"osd":5,"last update":"Tue Nov 28 20:01:57 2023","interfaces":[{"interface":"back","average":{"1min":0.72599999999999998,"5min":0.93200000000000005,"15min":1.02},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":0.97599999999999998,"5min":4.6120000000000001,"15min":4.6120000000000001},"last":0.75},{"interface":"front","average":{"1min":0.78600000000000003,"5min":0.93600000000000005,"15min":1.0129999999999999},"min":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.1319999999999999,"5min":4.5449999999999999,"15min":4.5449999999999999},"last":0.82699999999999996}]},{"osd":6,"last update":"Tue Nov 28 20:01:57 2023","interfaces":[{"interface":"back","average":{"1min":0.755,"5min":0.94499999999999995,"15min":1.034},"min":{"1min":0.53600000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":1.0580000000000001,"5min":4.657,"15min":4.657},"last":0.73999999999999999},{"interface":"front","average":{"1min":0.75700000000000001,"5min":0.95799999999999996,"15min":1.05},"min":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":1.0049999999999999,"5min":4.5259999999999998,"15min":4.5259999999999998},"last":0.77400000000000002}]},{"osd":7,"last update":"Tue Nov 28 20:01:57 2023","interfaces":[{"interface":"back","average":{"1min":0.73799999999999999,"5min":0.95199999999999996,"15min":1.0509999999999999},"min":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":1.081,"5min":4.7320000000000002,"15min":4.7320000000000002},"last":0.72499999999999998},{"interface":"front","average":{"1min":0.76300000000000001,"5min":0.93100000000000005,"15min":1.0069999999999999},"min":{"1min":0.58699999999999997,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":1.099,"5min":4.4939999999999998,"15min":4.4939999999999998},"last":0.80200000000000005}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33374,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33374,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-28T20:02:13.115 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.3f is not active+clean 2023-11-28T20:02:13.115 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.3f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 79, 'state': 'creating+peering', 'last_fresh': '2023-11-28T20:02:07.283775+0000', 'last_change': '2023-11-28T20:02:07.283775+0000', 'last_active': '2023-11-28T20:02:07.264604+0000', 'last_peered': '2023-11-28T20:02:07.264604+0000', 'last_clean': '2023-11-28T20:02:07.264604+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T20:02:07.283775+0000', 'last_undegraded': '2023-11-28T20:02:07.283775+0000', 'last_fullsized': '2023-11-28T20:02:07.283775+0000', 'mapping_epoch': 79, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 79, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T20:02:07.264604+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T20:02:07.264604+0000', 'last_clean_scrub_stamp': '2023-11-28T20:02:07.264604+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 0], 'acting': [3, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-11-28T20:02:13.116 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.3e is not active+clean 2023-11-28T20:02:13.116 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.3e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 79, 'state': 'creating+peering', 'last_fresh': '2023-11-28T20:02:07.281033+0000', 'last_change': '2023-11-28T20:02:07.281033+0000', 'last_active': '2023-11-28T20:02:07.264604+0000', 'last_peered': '2023-11-28T20:02:07.264604+0000', 'last_clean': '2023-11-28T20:02:07.264604+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T20:02:07.281033+0000', 'last_undegraded': '2023-11-28T20:02:07.281033+0000', 'last_fullsized': '2023-11-28T20:02:07.281033+0000', 'mapping_epoch': 79, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 79, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T20:02:07.264604+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T20:02:07.264604+0000', 'last_clean_scrub_stamp': '2023-11-28T20:02:07.264604+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 3], 'acting': [5, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-11-28T20:02:13.116 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.3d is not active+clean 2023-11-28T20:02:13.116 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.3d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 79, 'state': 'creating+peering', 'last_fresh': '2023-11-28T20:02:07.284263+0000', 'last_change': '2023-11-28T20:02:07.284263+0000', 'last_active': '2023-11-28T20:02:07.264604+0000', 'last_peered': '2023-11-28T20:02:07.264604+0000', 'last_clean': '2023-11-28T20:02:07.264604+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T20:02:07.284263+0000', 'last_undegraded': '2023-11-28T20:02:07.284263+0000', 'last_fullsized': '2023-11-28T20:02:07.284263+0000', 'mapping_epoch': 79, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 79, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T20:02:07.264604+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T20:02:07.264604+0000', 'last_clean_scrub_stamp': '2023-11-28T20:02:07.264604+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 4], 'acting': [3, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-11-28T20:02:13.116 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.3c is not active+clean 2023-11-28T20:02:13.117 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.3c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 79, 'state': 'creating+peering', 'last_fresh': '2023-11-28T20:02:07.279673+0000', 'last_change': '2023-11-28T20:02:07.279673+0000', 'last_active': '2023-11-28T20:02:07.264604+0000', 'last_peered': '2023-11-28T20:02:07.264604+0000', 'last_clean': '2023-11-28T20:02:07.264604+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T20:02:07.279673+0000', 'last_undegraded': '2023-11-28T20:02:07.279673+0000', 'last_fullsized': '2023-11-28T20:02:07.279673+0000', 'mapping_epoch': 79, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 79, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T20:02:07.264604+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T20:02:07.264604+0000', 'last_clean_scrub_stamp': '2023-11-28T20:02:07.264604+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 6], 'acting': [1, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-11-28T20:02:13.117 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.3b is not active+clean 2023-11-28T20:02:13.117 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.3b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 79, 'state': 'creating+peering', 'last_fresh': '2023-11-28T20:02:07.278853+0000', 'last_change': '2023-11-28T20:02:07.278853+0000', 'last_active': '2023-11-28T20:02:07.264604+0000', 'last_peered': '2023-11-28T20:02:07.264604+0000', 'last_clean': '2023-11-28T20:02:07.264604+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T20:02:07.278853+0000', 'last_undegraded': '2023-11-28T20:02:07.278853+0000', 'last_fullsized': '2023-11-28T20:02:07.278853+0000', 'mapping_epoch': 79, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 79, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T20:02:07.264604+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T20:02:07.264604+0000', 'last_clean_scrub_stamp': '2023-11-28T20:02:07.264604+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 6], 'acting': [4, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-11-28T20:02:13.117 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.3a is not active+clean 2023-11-28T20:02:13.117 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.3a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 79, 'state': 'creating+peering', 'last_fresh': '2023-11-28T20:02:07.285754+0000', 'last_change': '2023-11-28T20:02:07.285754+0000', 'last_active': '2023-11-28T20:02:07.264604+0000', 'last_peered': '2023-11-28T20:02:07.264604+0000', 'last_clean': '2023-11-28T20:02:07.264604+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T20:02:07.285754+0000', 'last_undegraded': '2023-11-28T20:02:07.285754+0000', 'last_fullsized': '2023-11-28T20:02:07.285754+0000', 'mapping_epoch': 79, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 79, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T20:02:07.264604+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T20:02:07.264604+0000', 'last_clean_scrub_stamp': '2023-11-28T20:02:07.264604+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-11-28T20:02:13.118 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.39 is not active+clean 2023-11-28T20:02:13.118 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.39', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 79, 'state': 'creating+peering', 'last_fresh': '2023-11-28T20:02:07.287408+0000', 'last_change': '2023-11-28T20:02:07.287408+0000', 'last_active': '2023-11-28T20:02:07.264604+0000', 'last_peered': '2023-11-28T20:02:07.264604+0000', 'last_clean': '2023-11-28T20:02:07.264604+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T20:02:07.287408+0000', 'last_undegraded': '2023-11-28T20:02:07.287408+0000', 'last_fullsized': '2023-11-28T20:02:07.287408+0000', 'mapping_epoch': 79, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 79, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T20:02:07.264604+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T20:02:07.264604+0000', 'last_clean_scrub_stamp': '2023-11-28T20:02:07.264604+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 3], 'acting': [7, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-11-28T20:02:13.118 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.38 is not active+clean 2023-11-28T20:02:13.118 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.38', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 79, 'state': 'creating+peering', 'last_fresh': '2023-11-28T20:02:07.279529+0000', 'last_change': '2023-11-28T20:02:07.279529+0000', 'last_active': '2023-11-28T20:02:07.264604+0000', 'last_peered': '2023-11-28T20:02:07.264604+0000', 'last_clean': '2023-11-28T20:02:07.264604+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T20:02:07.279529+0000', 'last_undegraded': '2023-11-28T20:02:07.279529+0000', 'last_fullsized': '2023-11-28T20:02:07.279529+0000', 'mapping_epoch': 79, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 79, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T20:02:07.264604+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T20:02:07.264604+0000', 'last_clean_scrub_stamp': '2023-11-28T20:02:07.264604+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 7], 'acting': [1, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-11-28T20:02:13.118 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.37 is not active+clean 2023-11-28T20:02:13.118 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.37', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 79, 'state': 'creating+peering', 'last_fresh': '2023-11-28T20:02:07.280230+0000', 'last_change': '2023-11-28T20:02:07.280230+0000', 'last_active': '2023-11-28T20:02:07.264604+0000', 'last_peered': '2023-11-28T20:02:07.264604+0000', 'last_clean': '2023-11-28T20:02:07.264604+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T20:02:07.280230+0000', 'last_undegraded': '2023-11-28T20:02:07.280230+0000', 'last_fullsized': '2023-11-28T20:02:07.280230+0000', 'mapping_epoch': 79, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 79, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T20:02:07.264604+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T20:02:07.264604+0000', 'last_clean_scrub_stamp': '2023-11-28T20:02:07.264604+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 5], 'acting': [4, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-11-28T20:02:13.119 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.36 is not active+clean 2023-11-28T20:02:13.119 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.36', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 79, 'state': 'creating+peering', 'last_fresh': '2023-11-28T20:02:07.285036+0000', 'last_change': '2023-11-28T20:02:07.285036+0000', 'last_active': '2023-11-28T20:02:07.264604+0000', 'last_peered': '2023-11-28T20:02:07.264604+0000', 'last_clean': '2023-11-28T20:02:07.264604+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T20:02:07.285036+0000', 'last_undegraded': '2023-11-28T20:02:07.285036+0000', 'last_fullsized': '2023-11-28T20:02:07.285036+0000', 'mapping_epoch': 79, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 79, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T20:02:07.264604+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T20:02:07.264604+0000', 'last_clean_scrub_stamp': '2023-11-28T20:02:07.264604+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 1], 'acting': [2, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-11-28T20:02:13.119 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.35 is not active+clean 2023-11-28T20:02:13.119 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.35', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 79, 'state': 'creating+peering', 'last_fresh': '2023-11-28T20:02:07.280584+0000', 'last_change': '2023-11-28T20:02:07.280584+0000', 'last_active': '2023-11-28T20:02:07.264604+0000', 'last_peered': '2023-11-28T20:02:07.264604+0000', 'last_clean': '2023-11-28T20:02:07.264604+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T20:02:07.280584+0000', 'last_undegraded': '2023-11-28T20:02:07.280584+0000', 'last_fullsized': '2023-11-28T20:02:07.280584+0000', 'mapping_epoch': 79, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 79, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T20:02:07.264604+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T20:02:07.264604+0000', 'last_clean_scrub_stamp': '2023-11-28T20:02:07.264604+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 0], 'acting': [4, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-11-28T20:02:13.119 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.34 is not active+clean 2023-11-28T20:02:13.120 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.34', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 79, 'state': 'creating+peering', 'last_fresh': '2023-11-28T20:02:07.281300+0000', 'last_change': '2023-11-28T20:02:07.281300+0000', 'last_active': '2023-11-28T20:02:07.264604+0000', 'last_peered': '2023-11-28T20:02:07.264604+0000', 'last_clean': '2023-11-28T20:02:07.264604+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T20:02:07.281300+0000', 'last_undegraded': '2023-11-28T20:02:07.281300+0000', 'last_fullsized': '2023-11-28T20:02:07.281300+0000', 'mapping_epoch': 79, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 79, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T20:02:07.264604+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T20:02:07.264604+0000', 'last_clean_scrub_stamp': '2023-11-28T20:02:07.264604+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 3], 'acting': [2, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-11-28T20:02:13.120 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.33 is not active+clean 2023-11-28T20:02:13.120 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.33', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 79, 'state': 'creating+peering', 'last_fresh': '2023-11-28T20:02:07.279252+0000', 'last_change': '2023-11-28T20:02:07.279252+0000', 'last_active': '2023-11-28T20:02:07.264604+0000', 'last_peered': '2023-11-28T20:02:07.264604+0000', 'last_clean': '2023-11-28T20:02:07.264604+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T20:02:07.279252+0000', 'last_undegraded': '2023-11-28T20:02:07.279252+0000', 'last_fullsized': '2023-11-28T20:02:07.279252+0000', 'mapping_epoch': 79, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 79, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T20:02:07.264604+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T20:02:07.264604+0000', 'last_clean_scrub_stamp': '2023-11-28T20:02:07.264604+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 7], 'acting': [1, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-11-28T20:02:13.120 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.32 is not active+clean 2023-11-28T20:02:13.121 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.32', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 79, 'state': 'creating+peering', 'last_fresh': '2023-11-28T20:02:07.280291+0000', 'last_change': '2023-11-28T20:02:07.280291+0000', 'last_active': '2023-11-28T20:02:07.264604+0000', 'last_peered': '2023-11-28T20:02:07.264604+0000', 'last_clean': '2023-11-28T20:02:07.264604+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T20:02:07.280291+0000', 'last_undegraded': '2023-11-28T20:02:07.280291+0000', 'last_fullsized': '2023-11-28T20:02:07.280291+0000', 'mapping_epoch': 79, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 79, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T20:02:07.264604+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T20:02:07.264604+0000', 'last_clean_scrub_stamp': '2023-11-28T20:02:07.264604+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 1], 'acting': [4, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-11-28T20:02:13.121 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.31 is not active+clean 2023-11-28T20:02:13.121 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.31', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 79, 'state': 'creating+peering', 'last_fresh': '2023-11-28T20:02:07.278957+0000', 'last_change': '2023-11-28T20:02:07.278957+0000', 'last_active': '2023-11-28T20:02:07.264604+0000', 'last_peered': '2023-11-28T20:02:07.264604+0000', 'last_clean': '2023-11-28T20:02:07.264604+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T20:02:07.278957+0000', 'last_undegraded': '2023-11-28T20:02:07.278957+0000', 'last_fullsized': '2023-11-28T20:02:07.278957+0000', 'mapping_epoch': 79, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 79, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T20:02:07.264604+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T20:02:07.264604+0000', 'last_clean_scrub_stamp': '2023-11-28T20:02:07.264604+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 3], 'acting': [1, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-11-28T20:02:13.121 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.30 is not active+clean 2023-11-28T20:02:13.121 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.30', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 79, 'state': 'creating+peering', 'last_fresh': '2023-11-28T20:02:07.285701+0000', 'last_change': '2023-11-28T20:02:07.285701+0000', 'last_active': '2023-11-28T20:02:07.264604+0000', 'last_peered': '2023-11-28T20:02:07.264604+0000', 'last_clean': '2023-11-28T20:02:07.264604+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T20:02:07.285701+0000', 'last_undegraded': '2023-11-28T20:02:07.285701+0000', 'last_fullsized': '2023-11-28T20:02:07.285701+0000', 'mapping_epoch': 79, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 79, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T20:02:07.264604+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T20:02:07.264604+0000', 'last_clean_scrub_stamp': '2023-11-28T20:02:07.264604+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 3], 'acting': [0, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-11-28T20:02:13.122 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.2f is not active+clean 2023-11-28T20:02:13.122 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.2f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 79, 'state': 'creating+peering', 'last_fresh': '2023-11-28T20:02:07.279900+0000', 'last_change': '2023-11-28T20:02:07.279900+0000', 'last_active': '2023-11-28T20:02:07.264604+0000', 'last_peered': '2023-11-28T20:02:07.264604+0000', 'last_clean': '2023-11-28T20:02:07.264604+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T20:02:07.279900+0000', 'last_undegraded': '2023-11-28T20:02:07.279900+0000', 'last_fullsized': '2023-11-28T20:02:07.279900+0000', 'mapping_epoch': 79, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 79, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T20:02:07.264604+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T20:02:07.264604+0000', 'last_clean_scrub_stamp': '2023-11-28T20:02:07.264604+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 3], 'acting': [0, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-11-28T20:02:13.122 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.2e is not active+clean 2023-11-28T20:02:13.122 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.2e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 79, 'state': 'creating+peering', 'last_fresh': '2023-11-28T20:02:07.283280+0000', 'last_change': '2023-11-28T20:02:07.283280+0000', 'last_active': '2023-11-28T20:02:07.264604+0000', 'last_peered': '2023-11-28T20:02:07.264604+0000', 'last_clean': '2023-11-28T20:02:07.264604+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T20:02:07.283280+0000', 'last_undegraded': '2023-11-28T20:02:07.283280+0000', 'last_fullsized': '2023-11-28T20:02:07.283280+0000', 'mapping_epoch': 79, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 79, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T20:02:07.264604+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T20:02:07.264604+0000', 'last_clean_scrub_stamp': '2023-11-28T20:02:07.264604+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 5], 'acting': [3, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-11-28T20:02:13.122 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.2d is not active+clean 2023-11-28T20:02:13.122 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.2d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 79, 'state': 'creating+peering', 'last_fresh': '2023-11-28T20:02:07.279980+0000', 'last_change': '2023-11-28T20:02:07.279980+0000', 'last_active': '2023-11-28T20:02:07.264604+0000', 'last_peered': '2023-11-28T20:02:07.264604+0000', 'last_clean': '2023-11-28T20:02:07.264604+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T20:02:07.279980+0000', 'last_undegraded': '2023-11-28T20:02:07.279980+0000', 'last_fullsized': '2023-11-28T20:02:07.279980+0000', 'mapping_epoch': 79, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 79, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T20:02:07.264604+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T20:02:07.264604+0000', 'last_clean_scrub_stamp': '2023-11-28T20:02:07.264604+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 1], 'acting': [4, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-11-28T20:02:13.123 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.2c is not active+clean 2023-11-28T20:02:13.123 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.2c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 79, 'state': 'creating+peering', 'last_fresh': '2023-11-28T20:02:07.279215+0000', 'last_change': '2023-11-28T20:02:07.279215+0000', 'last_active': '2023-11-28T20:02:07.264604+0000', 'last_peered': '2023-11-28T20:02:07.264604+0000', 'last_clean': '2023-11-28T20:02:07.264604+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T20:02:07.279215+0000', 'last_undegraded': '2023-11-28T20:02:07.279215+0000', 'last_fullsized': '2023-11-28T20:02:07.279215+0000', 'mapping_epoch': 79, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 79, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T20:02:07.264604+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T20:02:07.264604+0000', 'last_clean_scrub_stamp': '2023-11-28T20:02:07.264604+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 3], 'acting': [1, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-11-28T20:02:13.123 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.2b is not active+clean 2023-11-28T20:02:13.123 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.2b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 79, 'state': 'creating+peering', 'last_fresh': '2023-11-28T20:02:07.279982+0000', 'last_change': '2023-11-28T20:02:07.279982+0000', 'last_active': '2023-11-28T20:02:07.264604+0000', 'last_peered': '2023-11-28T20:02:07.264604+0000', 'last_clean': '2023-11-28T20:02:07.264604+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T20:02:07.279982+0000', 'last_undegraded': '2023-11-28T20:02:07.279982+0000', 'last_fullsized': '2023-11-28T20:02:07.279982+0000', 'mapping_epoch': 79, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 79, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T20:02:07.264604+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T20:02:07.264604+0000', 'last_clean_scrub_stamp': '2023-11-28T20:02:07.264604+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 7], 'acting': [4, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-11-28T20:02:13.123 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.2a is not active+clean 2023-11-28T20:02:13.123 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.2a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 79, 'state': 'creating+peering', 'last_fresh': '2023-11-28T20:02:07.279747+0000', 'last_change': '2023-11-28T20:02:07.279747+0000', 'last_active': '2023-11-28T20:02:07.264604+0000', 'last_peered': '2023-11-28T20:02:07.264604+0000', 'last_clean': '2023-11-28T20:02:07.264604+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T20:02:07.279747+0000', 'last_undegraded': '2023-11-28T20:02:07.279747+0000', 'last_fullsized': '2023-11-28T20:02:07.279747+0000', 'mapping_epoch': 79, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 79, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T20:02:07.264604+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T20:02:07.264604+0000', 'last_clean_scrub_stamp': '2023-11-28T20:02:07.264604+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 1], 'acting': [4, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-11-28T20:02:13.124 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.29 is not active+clean 2023-11-28T20:02:13.124 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.29', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 79, 'state': 'creating+peering', 'last_fresh': '2023-11-28T20:02:07.288560+0000', 'last_change': '2023-11-28T20:02:07.288560+0000', 'last_active': '2023-11-28T20:02:07.264604+0000', 'last_peered': '2023-11-28T20:02:07.264604+0000', 'last_clean': '2023-11-28T20:02:07.264604+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T20:02:07.288560+0000', 'last_undegraded': '2023-11-28T20:02:07.288560+0000', 'last_fullsized': '2023-11-28T20:02:07.288560+0000', 'mapping_epoch': 79, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 79, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T20:02:07.264604+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T20:02:07.264604+0000', 'last_clean_scrub_stamp': '2023-11-28T20:02:07.264604+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 1], 'acting': [6, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-11-28T20:02:13.124 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.28 is not active+clean 2023-11-28T20:02:13.124 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.28', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 79, 'state': 'creating+peering', 'last_fresh': '2023-11-28T20:02:07.281146+0000', 'last_change': '2023-11-28T20:02:07.281146+0000', 'last_active': '2023-11-28T20:02:07.264604+0000', 'last_peered': '2023-11-28T20:02:07.264604+0000', 'last_clean': '2023-11-28T20:02:07.264604+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T20:02:07.281146+0000', 'last_undegraded': '2023-11-28T20:02:07.281146+0000', 'last_fullsized': '2023-11-28T20:02:07.281146+0000', 'mapping_epoch': 79, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 79, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T20:02:07.264604+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T20:02:07.264604+0000', 'last_clean_scrub_stamp': '2023-11-28T20:02:07.264604+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 4], 'acting': [3, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-11-28T20:02:13.124 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.27 is not active+clean 2023-11-28T20:02:13.125 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.27', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 79, 'state': 'creating+peering', 'last_fresh': '2023-11-28T20:02:07.280571+0000', 'last_change': '2023-11-28T20:02:07.280571+0000', 'last_active': '2023-11-28T20:02:07.264604+0000', 'last_peered': '2023-11-28T20:02:07.264604+0000', 'last_clean': '2023-11-28T20:02:07.264604+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T20:02:07.280571+0000', 'last_undegraded': '2023-11-28T20:02:07.280571+0000', 'last_fullsized': '2023-11-28T20:02:07.280571+0000', 'mapping_epoch': 79, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 79, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T20:02:07.264604+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T20:02:07.264604+0000', 'last_clean_scrub_stamp': '2023-11-28T20:02:07.264604+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 6], 'acting': [5, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-11-28T20:02:13.125 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.26 is not active+clean 2023-11-28T20:02:13.125 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.26', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 79, 'state': 'creating+peering', 'last_fresh': '2023-11-28T20:02:07.281292+0000', 'last_change': '2023-11-28T20:02:07.281292+0000', 'last_active': '2023-11-28T20:02:07.264604+0000', 'last_peered': '2023-11-28T20:02:07.264604+0000', 'last_clean': '2023-11-28T20:02:07.264604+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T20:02:07.281292+0000', 'last_undegraded': '2023-11-28T20:02:07.281292+0000', 'last_fullsized': '2023-11-28T20:02:07.281292+0000', 'mapping_epoch': 79, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 79, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T20:02:07.264604+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T20:02:07.264604+0000', 'last_clean_scrub_stamp': '2023-11-28T20:02:07.264604+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 1], 'acting': [4, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-11-28T20:02:13.125 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.25 is not active+clean 2023-11-28T20:02:13.125 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.25', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 79, 'state': 'creating+peering', 'last_fresh': '2023-11-28T20:02:07.283518+0000', 'last_change': '2023-11-28T20:02:07.283518+0000', 'last_active': '2023-11-28T20:02:07.264604+0000', 'last_peered': '2023-11-28T20:02:07.264604+0000', 'last_clean': '2023-11-28T20:02:07.264604+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T20:02:07.283518+0000', 'last_undegraded': '2023-11-28T20:02:07.283518+0000', 'last_fullsized': '2023-11-28T20:02:07.283518+0000', 'mapping_epoch': 79, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 79, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T20:02:07.264604+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T20:02:07.264604+0000', 'last_clean_scrub_stamp': '2023-11-28T20:02:07.264604+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 6], 'acting': [2, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-11-28T20:02:13.125 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.24 is not active+clean 2023-11-28T20:02:13.126 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.24', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 79, 'state': 'creating+peering', 'last_fresh': '2023-11-28T20:02:07.278454+0000', 'last_change': '2023-11-28T20:02:07.278454+0000', 'last_active': '2023-11-28T20:02:07.264604+0000', 'last_peered': '2023-11-28T20:02:07.264604+0000', 'last_clean': '2023-11-28T20:02:07.264604+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T20:02:07.278454+0000', 'last_undegraded': '2023-11-28T20:02:07.278454+0000', 'last_fullsized': '2023-11-28T20:02:07.278454+0000', 'mapping_epoch': 79, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 79, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T20:02:07.264604+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T20:02:07.264604+0000', 'last_clean_scrub_stamp': '2023-11-28T20:02:07.264604+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 4], 'acting': [1, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-11-28T20:02:13.126 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.23 is not active+clean 2023-11-28T20:02:13.126 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.23', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 79, 'state': 'creating+peering', 'last_fresh': '2023-11-28T20:02:07.286673+0000', 'last_change': '2023-11-28T20:02:07.286673+0000', 'last_active': '2023-11-28T20:02:07.264604+0000', 'last_peered': '2023-11-28T20:02:07.264604+0000', 'last_clean': '2023-11-28T20:02:07.264604+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T20:02:07.286673+0000', 'last_undegraded': '2023-11-28T20:02:07.286673+0000', 'last_fullsized': '2023-11-28T20:02:07.286673+0000', 'mapping_epoch': 79, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 79, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T20:02:07.264604+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T20:02:07.264604+0000', 'last_clean_scrub_stamp': '2023-11-28T20:02:07.264604+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 2], 'acting': [7, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-11-28T20:02:13.126 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.22 is not active+clean 2023-11-28T20:02:13.126 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.22', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 79, 'state': 'creating+peering', 'last_fresh': '2023-11-28T20:02:07.278208+0000', 'last_change': '2023-11-28T20:02:07.278208+0000', 'last_active': '2023-11-28T20:02:07.264604+0000', 'last_peered': '2023-11-28T20:02:07.264604+0000', 'last_clean': '2023-11-28T20:02:07.264604+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T20:02:07.278208+0000', 'last_undegraded': '2023-11-28T20:02:07.278208+0000', 'last_fullsized': '2023-11-28T20:02:07.278208+0000', 'mapping_epoch': 79, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 79, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T20:02:07.264604+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T20:02:07.264604+0000', 'last_clean_scrub_stamp': '2023-11-28T20:02:07.264604+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 5], 'acting': [4, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-11-28T20:02:13.127 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.21 is not active+clean 2023-11-28T20:02:13.127 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.21', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 79, 'state': 'creating+peering', 'last_fresh': '2023-11-28T20:02:07.281997+0000', 'last_change': '2023-11-28T20:02:07.281997+0000', 'last_active': '2023-11-28T20:02:07.264604+0000', 'last_peered': '2023-11-28T20:02:07.264604+0000', 'last_clean': '2023-11-28T20:02:07.264604+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T20:02:07.281997+0000', 'last_undegraded': '2023-11-28T20:02:07.281997+0000', 'last_fullsized': '2023-11-28T20:02:07.281997+0000', 'mapping_epoch': 79, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 79, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T20:02:07.264604+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T20:02:07.264604+0000', 'last_clean_scrub_stamp': '2023-11-28T20:02:07.264604+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 1], 'acting': [5, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-11-28T20:02:13.127 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.20 is not active+clean 2023-11-28T20:02:13.127 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.20', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 79, 'state': 'creating+peering', 'last_fresh': '2023-11-28T20:02:07.280102+0000', 'last_change': '2023-11-28T20:02:07.280102+0000', 'last_active': '2023-11-28T20:02:07.264604+0000', 'last_peered': '2023-11-28T20:02:07.264604+0000', 'last_clean': '2023-11-28T20:02:07.264604+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T20:02:07.280102+0000', 'last_undegraded': '2023-11-28T20:02:07.280102+0000', 'last_fullsized': '2023-11-28T20:02:07.280102+0000', 'mapping_epoch': 79, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 79, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T20:02:07.264604+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T20:02:07.264604+0000', 'last_clean_scrub_stamp': '2023-11-28T20:02:07.264604+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 3], 'acting': [0, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-11-28T20:02:13.127 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.1c is not active+clean 2023-11-28T20:02:13.127 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.1c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 79, 'state': 'creating+peering', 'last_fresh': '2023-11-28T20:02:07.285556+0000', 'last_change': '2023-11-28T20:02:07.285556+0000', 'last_active': '2023-11-28T20:02:07.264604+0000', 'last_peered': '2023-11-28T20:02:07.264604+0000', 'last_clean': '2023-11-28T20:02:07.264604+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T20:02:07.285556+0000', 'last_undegraded': '2023-11-28T20:02:07.285556+0000', 'last_fullsized': '2023-11-28T20:02:07.285556+0000', 'mapping_epoch': 79, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 79, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T20:02:07.264604+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T20:02:07.264604+0000', 'last_clean_scrub_stamp': '2023-11-28T20:02:07.264604+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 4], 'acting': [0, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-11-28T20:02:13.128 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.1d is not active+clean 2023-11-28T20:02:13.128 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.1d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 79, 'state': 'creating+peering', 'last_fresh': '2023-11-28T20:02:07.286754+0000', 'last_change': '2023-11-28T20:02:07.286754+0000', 'last_active': '2023-11-28T20:02:07.264604+0000', 'last_peered': '2023-11-28T20:02:07.264604+0000', 'last_clean': '2023-11-28T20:02:07.264604+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T20:02:07.286754+0000', 'last_undegraded': '2023-11-28T20:02:07.286754+0000', 'last_fullsized': '2023-11-28T20:02:07.286754+0000', 'mapping_epoch': 79, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 79, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T20:02:07.264604+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T20:02:07.264604+0000', 'last_clean_scrub_stamp': '2023-11-28T20:02:07.264604+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-11-28T20:02:13.128 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.1e is not active+clean 2023-11-28T20:02:13.128 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.1e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 79, 'state': 'creating+peering', 'last_fresh': '2023-11-28T20:02:07.287269+0000', 'last_change': '2023-11-28T20:02:07.287269+0000', 'last_active': '2023-11-28T20:02:07.264604+0000', 'last_peered': '2023-11-28T20:02:07.264604+0000', 'last_clean': '2023-11-28T20:02:07.264604+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T20:02:07.287269+0000', 'last_undegraded': '2023-11-28T20:02:07.287269+0000', 'last_fullsized': '2023-11-28T20:02:07.287269+0000', 'mapping_epoch': 79, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 79, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T20:02:07.264604+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T20:02:07.264604+0000', 'last_clean_scrub_stamp': '2023-11-28T20:02:07.264604+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 1], 'acting': [7, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-11-28T20:02:13.128 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.1f is not active+clean 2023-11-28T20:02:13.129 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.1f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 79, 'state': 'creating+peering', 'last_fresh': '2023-11-28T20:02:07.279393+0000', 'last_change': '2023-11-28T20:02:07.279393+0000', 'last_active': '2023-11-28T20:02:07.264604+0000', 'last_peered': '2023-11-28T20:02:07.264604+0000', 'last_clean': '2023-11-28T20:02:07.264604+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T20:02:07.279393+0000', 'last_undegraded': '2023-11-28T20:02:07.279393+0000', 'last_fullsized': '2023-11-28T20:02:07.279393+0000', 'mapping_epoch': 79, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 79, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T20:02:07.264604+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T20:02:07.264604+0000', 'last_clean_scrub_stamp': '2023-11-28T20:02:07.264604+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 6], 'acting': [0, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-11-28T20:02:13.129 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.18 is not active+clean 2023-11-28T20:02:13.129 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.18', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 79, 'state': 'creating+peering', 'last_fresh': '2023-11-28T20:02:07.279010+0000', 'last_change': '2023-11-28T20:02:07.279010+0000', 'last_active': '2023-11-28T20:02:07.264604+0000', 'last_peered': '2023-11-28T20:02:07.264604+0000', 'last_clean': '2023-11-28T20:02:07.264604+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T20:02:07.279010+0000', 'last_undegraded': '2023-11-28T20:02:07.279010+0000', 'last_fullsized': '2023-11-28T20:02:07.279010+0000', 'mapping_epoch': 79, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 79, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T20:02:07.264604+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T20:02:07.264604+0000', 'last_clean_scrub_stamp': '2023-11-28T20:02:07.264604+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 3], 'acting': [1, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-11-28T20:02:13.129 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.19 is not active+clean 2023-11-28T20:02:13.129 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.19', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 79, 'state': 'creating+peering', 'last_fresh': '2023-11-28T20:02:07.288017+0000', 'last_change': '2023-11-28T20:02:07.288017+0000', 'last_active': '2023-11-28T20:02:07.264604+0000', 'last_peered': '2023-11-28T20:02:07.264604+0000', 'last_clean': '2023-11-28T20:02:07.264604+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T20:02:07.288017+0000', 'last_undegraded': '2023-11-28T20:02:07.288017+0000', 'last_fullsized': '2023-11-28T20:02:07.288017+0000', 'mapping_epoch': 79, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 79, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T20:02:07.264604+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T20:02:07.264604+0000', 'last_clean_scrub_stamp': '2023-11-28T20:02:07.264604+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 0], 'acting': [6, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-11-28T20:02:13.130 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.1a is not active+clean 2023-11-28T20:02:13.130 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.1a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 79, 'state': 'creating+peering', 'last_fresh': '2023-11-28T20:02:07.279632+0000', 'last_change': '2023-11-28T20:02:07.279632+0000', 'last_active': '2023-11-28T20:02:07.264604+0000', 'last_peered': '2023-11-28T20:02:07.264604+0000', 'last_clean': '2023-11-28T20:02:07.264604+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T20:02:07.279632+0000', 'last_undegraded': '2023-11-28T20:02:07.279632+0000', 'last_fullsized': '2023-11-28T20:02:07.279632+0000', 'mapping_epoch': 79, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 79, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T20:02:07.264604+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T20:02:07.264604+0000', 'last_clean_scrub_stamp': '2023-11-28T20:02:07.264604+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-11-28T20:02:13.130 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.1b is not active+clean 2023-11-28T20:02:13.130 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.1b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 79, 'state': 'creating+peering', 'last_fresh': '2023-11-28T20:02:07.278842+0000', 'last_change': '2023-11-28T20:02:07.278842+0000', 'last_active': '2023-11-28T20:02:07.264604+0000', 'last_peered': '2023-11-28T20:02:07.264604+0000', 'last_clean': '2023-11-28T20:02:07.264604+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T20:02:07.278842+0000', 'last_undegraded': '2023-11-28T20:02:07.278842+0000', 'last_fullsized': '2023-11-28T20:02:07.278842+0000', 'mapping_epoch': 79, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 79, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T20:02:07.264604+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T20:02:07.264604+0000', 'last_clean_scrub_stamp': '2023-11-28T20:02:07.264604+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 6], 'acting': [1, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-11-28T20:02:13.130 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.14 is not active+clean 2023-11-28T20:02:13.130 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.14', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 79, 'state': 'creating+peering', 'last_fresh': '2023-11-28T20:02:07.279138+0000', 'last_change': '2023-11-28T20:02:07.279138+0000', 'last_active': '2023-11-28T20:02:07.264604+0000', 'last_peered': '2023-11-28T20:02:07.264604+0000', 'last_clean': '2023-11-28T20:02:07.264604+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T20:02:07.279138+0000', 'last_undegraded': '2023-11-28T20:02:07.279138+0000', 'last_fullsized': '2023-11-28T20:02:07.279138+0000', 'mapping_epoch': 79, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 79, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T20:02:07.264604+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T20:02:07.264604+0000', 'last_clean_scrub_stamp': '2023-11-28T20:02:07.264604+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 3], 'acting': [4, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-11-28T20:02:13.131 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.15 is not active+clean 2023-11-28T20:02:13.131 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.15', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 79, 'state': 'creating+peering', 'last_fresh': '2023-11-28T20:02:07.286690+0000', 'last_change': '2023-11-28T20:02:07.286690+0000', 'last_active': '2023-11-28T20:02:07.264604+0000', 'last_peered': '2023-11-28T20:02:07.264604+0000', 'last_clean': '2023-11-28T20:02:07.264604+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T20:02:07.286690+0000', 'last_undegraded': '2023-11-28T20:02:07.286690+0000', 'last_fullsized': '2023-11-28T20:02:07.286690+0000', 'mapping_epoch': 79, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 79, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T20:02:07.264604+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T20:02:07.264604+0000', 'last_clean_scrub_stamp': '2023-11-28T20:02:07.264604+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 4], 'acting': [7, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-11-28T20:02:13.131 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.16 is not active+clean 2023-11-28T20:02:13.131 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.16', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 79, 'state': 'creating+peering', 'last_fresh': '2023-11-28T20:02:07.282823+0000', 'last_change': '2023-11-28T20:02:07.282823+0000', 'last_active': '2023-11-28T20:02:07.264604+0000', 'last_peered': '2023-11-28T20:02:07.264604+0000', 'last_clean': '2023-11-28T20:02:07.264604+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T20:02:07.282823+0000', 'last_undegraded': '2023-11-28T20:02:07.282823+0000', 'last_fullsized': '2023-11-28T20:02:07.282823+0000', 'mapping_epoch': 79, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 79, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T20:02:07.264604+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T20:02:07.264604+0000', 'last_clean_scrub_stamp': '2023-11-28T20:02:07.264604+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 0], 'acting': [3, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-11-28T20:02:13.131 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.17 is not active+clean 2023-11-28T20:02:13.131 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.17', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 79, 'state': 'creating+peering', 'last_fresh': '2023-11-28T20:02:07.278623+0000', 'last_change': '2023-11-28T20:02:07.278623+0000', 'last_active': '2023-11-28T20:02:07.264604+0000', 'last_peered': '2023-11-28T20:02:07.264604+0000', 'last_clean': '2023-11-28T20:02:07.264604+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T20:02:07.278623+0000', 'last_undegraded': '2023-11-28T20:02:07.278623+0000', 'last_fullsized': '2023-11-28T20:02:07.278623+0000', 'mapping_epoch': 79, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 79, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T20:02:07.264604+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T20:02:07.264604+0000', 'last_clean_scrub_stamp': '2023-11-28T20:02:07.264604+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 5], 'acting': [1, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-11-28T20:02:13.132 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.10 is not active+clean 2023-11-28T20:02:13.132 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.10', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 79, 'state': 'creating+peering', 'last_fresh': '2023-11-28T20:02:07.278502+0000', 'last_change': '2023-11-28T20:02:07.278502+0000', 'last_active': '2023-11-28T20:02:07.264604+0000', 'last_peered': '2023-11-28T20:02:07.264604+0000', 'last_clean': '2023-11-28T20:02:07.264604+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T20:02:07.278502+0000', 'last_undegraded': '2023-11-28T20:02:07.278502+0000', 'last_fullsized': '2023-11-28T20:02:07.278502+0000', 'mapping_epoch': 79, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 79, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T20:02:07.264604+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T20:02:07.264604+0000', 'last_clean_scrub_stamp': '2023-11-28T20:02:07.264604+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 7], 'acting': [1, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-11-28T20:02:13.132 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.11 is not active+clean 2023-11-28T20:02:13.132 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.11', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 79, 'state': 'creating+peering', 'last_fresh': '2023-11-28T20:02:07.278215+0000', 'last_change': '2023-11-28T20:02:07.278215+0000', 'last_active': '2023-11-28T20:02:07.264604+0000', 'last_peered': '2023-11-28T20:02:07.264604+0000', 'last_clean': '2023-11-28T20:02:07.264604+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T20:02:07.278215+0000', 'last_undegraded': '2023-11-28T20:02:07.278215+0000', 'last_fullsized': '2023-11-28T20:02:07.278215+0000', 'mapping_epoch': 79, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 79, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T20:02:07.264604+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T20:02:07.264604+0000', 'last_clean_scrub_stamp': '2023-11-28T20:02:07.264604+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 6], 'acting': [4, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-11-28T20:02:13.132 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.12 is not active+clean 2023-11-28T20:02:13.133 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.12', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 79, 'state': 'creating+peering', 'last_fresh': '2023-11-28T20:02:07.283056+0000', 'last_change': '2023-11-28T20:02:07.283056+0000', 'last_active': '2023-11-28T20:02:07.264604+0000', 'last_peered': '2023-11-28T20:02:07.264604+0000', 'last_clean': '2023-11-28T20:02:07.264604+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T20:02:07.283056+0000', 'last_undegraded': '2023-11-28T20:02:07.283056+0000', 'last_fullsized': '2023-11-28T20:02:07.283056+0000', 'mapping_epoch': 79, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 79, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T20:02:07.264604+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T20:02:07.264604+0000', 'last_clean_scrub_stamp': '2023-11-28T20:02:07.264604+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 1], 'acting': [2, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-11-28T20:02:13.133 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.13 is not active+clean 2023-11-28T20:02:13.133 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.13', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 79, 'state': 'creating+peering', 'last_fresh': '2023-11-28T20:02:07.280802+0000', 'last_change': '2023-11-28T20:02:07.280802+0000', 'last_active': '2023-11-28T20:02:07.264604+0000', 'last_peered': '2023-11-28T20:02:07.264604+0000', 'last_clean': '2023-11-28T20:02:07.264604+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T20:02:07.280802+0000', 'last_undegraded': '2023-11-28T20:02:07.280802+0000', 'last_fullsized': '2023-11-28T20:02:07.280802+0000', 'mapping_epoch': 79, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 79, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T20:02:07.264604+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T20:02:07.264604+0000', 'last_clean_scrub_stamp': '2023-11-28T20:02:07.264604+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 4], 'acting': [2, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-11-28T20:02:13.133 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.c is not active+clean 2023-11-28T20:02:13.133 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 79, 'state': 'creating+peering', 'last_fresh': '2023-11-28T20:02:07.279835+0000', 'last_change': '2023-11-28T20:02:07.279835+0000', 'last_active': '2023-11-28T20:02:07.264604+0000', 'last_peered': '2023-11-28T20:02:07.264604+0000', 'last_clean': '2023-11-28T20:02:07.264604+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T20:02:07.279835+0000', 'last_undegraded': '2023-11-28T20:02:07.279835+0000', 'last_fullsized': '2023-11-28T20:02:07.279835+0000', 'mapping_epoch': 79, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 79, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T20:02:07.264604+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T20:02:07.264604+0000', 'last_clean_scrub_stamp': '2023-11-28T20:02:07.264604+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 4], 'acting': [0, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-11-28T20:02:13.134 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.d is not active+clean 2023-11-28T20:02:13.134 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 79, 'state': 'creating+peering', 'last_fresh': '2023-11-28T20:02:07.288189+0000', 'last_change': '2023-11-28T20:02:07.288189+0000', 'last_active': '2023-11-28T20:02:07.264604+0000', 'last_peered': '2023-11-28T20:02:07.264604+0000', 'last_clean': '2023-11-28T20:02:07.264604+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T20:02:07.288189+0000', 'last_undegraded': '2023-11-28T20:02:07.288189+0000', 'last_fullsized': '2023-11-28T20:02:07.288189+0000', 'mapping_epoch': 79, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 79, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T20:02:07.264604+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T20:02:07.264604+0000', 'last_clean_scrub_stamp': '2023-11-28T20:02:07.264604+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 5], 'acting': [6, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-11-28T20:02:13.134 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.e is not active+clean 2023-11-28T20:02:13.134 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 79, 'state': 'creating+peering', 'last_fresh': '2023-11-28T20:02:07.280313+0000', 'last_change': '2023-11-28T20:02:07.280313+0000', 'last_active': '2023-11-28T20:02:07.264604+0000', 'last_peered': '2023-11-28T20:02:07.264604+0000', 'last_clean': '2023-11-28T20:02:07.264604+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T20:02:07.280313+0000', 'last_undegraded': '2023-11-28T20:02:07.280313+0000', 'last_fullsized': '2023-11-28T20:02:07.280313+0000', 'mapping_epoch': 79, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 79, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T20:02:07.264604+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T20:02:07.264604+0000', 'last_clean_scrub_stamp': '2023-11-28T20:02:07.264604+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 2], 'acting': [4, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-11-28T20:02:13.134 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.8 is not active+clean 2023-11-28T20:02:13.134 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.8', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 79, 'state': 'creating+peering', 'last_fresh': '2023-11-28T20:02:07.279591+0000', 'last_change': '2023-11-28T20:02:07.279591+0000', 'last_active': '2023-11-28T20:02:07.264604+0000', 'last_peered': '2023-11-28T20:02:07.264604+0000', 'last_clean': '2023-11-28T20:02:07.264604+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T20:02:07.279591+0000', 'last_undegraded': '2023-11-28T20:02:07.279591+0000', 'last_fullsized': '2023-11-28T20:02:07.279591+0000', 'mapping_epoch': 79, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 79, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T20:02:07.264604+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T20:02:07.264604+0000', 'last_clean_scrub_stamp': '2023-11-28T20:02:07.264604+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-11-28T20:02:13.135 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.9 is not active+clean 2023-11-28T20:02:13.135 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.9', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 79, 'state': 'creating+peering', 'last_fresh': '2023-11-28T20:02:07.278282+0000', 'last_change': '2023-11-28T20:02:07.278282+0000', 'last_active': '2023-11-28T20:02:07.264604+0000', 'last_peered': '2023-11-28T20:02:07.264604+0000', 'last_clean': '2023-11-28T20:02:07.264604+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T20:02:07.278282+0000', 'last_undegraded': '2023-11-28T20:02:07.278282+0000', 'last_fullsized': '2023-11-28T20:02:07.278282+0000', 'mapping_epoch': 79, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 79, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T20:02:07.264604+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T20:02:07.264604+0000', 'last_clean_scrub_stamp': '2023-11-28T20:02:07.264604+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 3], 'acting': [5, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-11-28T20:02:13.135 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.a is not active+clean 2023-11-28T20:02:13.135 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 79, 'state': 'creating+peering', 'last_fresh': '2023-11-28T20:02:07.279215+0000', 'last_change': '2023-11-28T20:02:07.279215+0000', 'last_active': '2023-11-28T20:02:07.264604+0000', 'last_peered': '2023-11-28T20:02:07.264604+0000', 'last_clean': '2023-11-28T20:02:07.264604+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T20:02:07.279215+0000', 'last_undegraded': '2023-11-28T20:02:07.279215+0000', 'last_fullsized': '2023-11-28T20:02:07.279215+0000', 'mapping_epoch': 79, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 79, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T20:02:07.264604+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T20:02:07.264604+0000', 'last_clean_scrub_stamp': '2023-11-28T20:02:07.264604+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 1], 'acting': [5, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-11-28T20:02:13.135 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.b is not active+clean 2023-11-28T20:02:13.135 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 79, 'state': 'creating+peering', 'last_fresh': '2023-11-28T20:02:07.286137+0000', 'last_change': '2023-11-28T20:02:07.286137+0000', 'last_active': '2023-11-28T20:02:07.264604+0000', 'last_peered': '2023-11-28T20:02:07.264604+0000', 'last_clean': '2023-11-28T20:02:07.264604+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T20:02:07.286137+0000', 'last_undegraded': '2023-11-28T20:02:07.286137+0000', 'last_fullsized': '2023-11-28T20:02:07.286137+0000', 'mapping_epoch': 79, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 79, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T20:02:07.264604+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T20:02:07.264604+0000', 'last_clean_scrub_stamp': '2023-11-28T20:02:07.264604+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-11-28T20:02:13.135 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.4 is not active+clean 2023-11-28T20:02:13.135 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.4', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 79, 'state': 'creating+peering', 'last_fresh': '2023-11-28T20:02:07.287644+0000', 'last_change': '2023-11-28T20:02:07.287644+0000', 'last_active': '2023-11-28T20:02:07.264604+0000', 'last_peered': '2023-11-28T20:02:07.264604+0000', 'last_clean': '2023-11-28T20:02:07.264604+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T20:02:07.287644+0000', 'last_undegraded': '2023-11-28T20:02:07.287644+0000', 'last_fullsized': '2023-11-28T20:02:07.287644+0000', 'mapping_epoch': 79, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 79, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T20:02:07.264604+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T20:02:07.264604+0000', 'last_clean_scrub_stamp': '2023-11-28T20:02:07.264604+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 7], 'acting': [6, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-11-28T20:02:13.135 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.5 is not active+clean 2023-11-28T20:02:13.136 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.5', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 79, 'state': 'creating+peering', 'last_fresh': '2023-11-28T20:02:07.286312+0000', 'last_change': '2023-11-28T20:02:07.286312+0000', 'last_active': '2023-11-28T20:02:07.264604+0000', 'last_peered': '2023-11-28T20:02:07.264604+0000', 'last_clean': '2023-11-28T20:02:07.264604+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T20:02:07.286312+0000', 'last_undegraded': '2023-11-28T20:02:07.286312+0000', 'last_fullsized': '2023-11-28T20:02:07.286312+0000', 'mapping_epoch': 79, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 79, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T20:02:07.264604+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T20:02:07.264604+0000', 'last_clean_scrub_stamp': '2023-11-28T20:02:07.264604+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 4], 'acting': [0, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-11-28T20:02:13.136 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.6 is not active+clean 2023-11-28T20:02:13.136 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.6', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 79, 'state': 'creating+peering', 'last_fresh': '2023-11-28T20:02:07.284421+0000', 'last_change': '2023-11-28T20:02:07.284421+0000', 'last_active': '2023-11-28T20:02:07.264604+0000', 'last_peered': '2023-11-28T20:02:07.264604+0000', 'last_clean': '2023-11-28T20:02:07.264604+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T20:02:07.284421+0000', 'last_undegraded': '2023-11-28T20:02:07.284421+0000', 'last_fullsized': '2023-11-28T20:02:07.284421+0000', 'mapping_epoch': 79, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 79, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T20:02:07.264604+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T20:02:07.264604+0000', 'last_clean_scrub_stamp': '2023-11-28T20:02:07.264604+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-11-28T20:02:13.136 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.7 is not active+clean 2023-11-28T20:02:13.136 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.7', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 79, 'state': 'creating+peering', 'last_fresh': '2023-11-28T20:02:07.280140+0000', 'last_change': '2023-11-28T20:02:07.280140+0000', 'last_active': '2023-11-28T20:02:07.264604+0000', 'last_peered': '2023-11-28T20:02:07.264604+0000', 'last_clean': '2023-11-28T20:02:07.264604+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T20:02:07.280140+0000', 'last_undegraded': '2023-11-28T20:02:07.280140+0000', 'last_fullsized': '2023-11-28T20:02:07.280140+0000', 'mapping_epoch': 79, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 79, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T20:02:07.264604+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T20:02:07.264604+0000', 'last_clean_scrub_stamp': '2023-11-28T20:02:07.264604+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 4], 'acting': [5, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-11-28T20:02:13.137 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.0 is not active+clean 2023-11-28T20:02:13.137 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.0', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 79, 'state': 'creating+peering', 'last_fresh': '2023-11-28T20:02:07.281665+0000', 'last_change': '2023-11-28T20:02:07.281665+0000', 'last_active': '2023-11-28T20:02:07.264604+0000', 'last_peered': '2023-11-28T20:02:07.264604+0000', 'last_clean': '2023-11-28T20:02:07.264604+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T20:02:07.281665+0000', 'last_undegraded': '2023-11-28T20:02:07.281665+0000', 'last_fullsized': '2023-11-28T20:02:07.281665+0000', 'mapping_epoch': 79, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 79, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T20:02:07.264604+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T20:02:07.264604+0000', 'last_clean_scrub_stamp': '2023-11-28T20:02:07.264604+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 0], 'acting': [2, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-11-28T20:02:13.137 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.1 is not active+clean 2023-11-28T20:02:13.137 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.1', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 79, 'state': 'creating+peering', 'last_fresh': '2023-11-28T20:02:07.281971+0000', 'last_change': '2023-11-28T20:02:07.281971+0000', 'last_active': '2023-11-28T20:02:07.264604+0000', 'last_peered': '2023-11-28T20:02:07.264604+0000', 'last_clean': '2023-11-28T20:02:07.264604+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T20:02:07.281971+0000', 'last_undegraded': '2023-11-28T20:02:07.281971+0000', 'last_fullsized': '2023-11-28T20:02:07.281971+0000', 'mapping_epoch': 79, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 79, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T20:02:07.264604+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T20:02:07.264604+0000', 'last_clean_scrub_stamp': '2023-11-28T20:02:07.264604+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 1], 'acting': [3, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-11-28T20:02:13.137 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.2 is not active+clean 2023-11-28T20:02:13.137 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.2', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 79, 'state': 'creating+peering', 'last_fresh': '2023-11-28T20:02:07.284520+0000', 'last_change': '2023-11-28T20:02:07.284520+0000', 'last_active': '2023-11-28T20:02:07.264604+0000', 'last_peered': '2023-11-28T20:02:07.264604+0000', 'last_clean': '2023-11-28T20:02:07.264604+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T20:02:07.284520+0000', 'last_undegraded': '2023-11-28T20:02:07.284520+0000', 'last_fullsized': '2023-11-28T20:02:07.284520+0000', 'mapping_epoch': 79, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 79, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T20:02:07.264604+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T20:02:07.264604+0000', 'last_clean_scrub_stamp': '2023-11-28T20:02:07.264604+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 1], 'acting': [6, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-11-28T20:02:13.138 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.3 is not active+clean 2023-11-28T20:02:13.138 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.3', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 79, 'state': 'creating+peering', 'last_fresh': '2023-11-28T20:02:07.285711+0000', 'last_change': '2023-11-28T20:02:07.285711+0000', 'last_active': '2023-11-28T20:02:07.264604+0000', 'last_peered': '2023-11-28T20:02:07.264604+0000', 'last_clean': '2023-11-28T20:02:07.264604+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T20:02:07.285711+0000', 'last_undegraded': '2023-11-28T20:02:07.285711+0000', 'last_fullsized': '2023-11-28T20:02:07.285711+0000', 'mapping_epoch': 79, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 79, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T20:02:07.264604+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T20:02:07.264604+0000', 'last_clean_scrub_stamp': '2023-11-28T20:02:07.264604+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 3], 'acting': [0, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-11-28T20:02:13.138 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.f is not active+clean 2023-11-28T20:02:13.138 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 79, 'state': 'creating+peering', 'last_fresh': '2023-11-28T20:02:07.288389+0000', 'last_change': '2023-11-28T20:02:07.288389+0000', 'last_active': '2023-11-28T20:02:07.264604+0000', 'last_peered': '2023-11-28T20:02:07.264604+0000', 'last_clean': '2023-11-28T20:02:07.264604+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T20:02:07.288389+0000', 'last_undegraded': '2023-11-28T20:02:07.288389+0000', 'last_fullsized': '2023-11-28T20:02:07.288389+0000', 'mapping_epoch': 79, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 79, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T20:02:07.264604+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T20:02:07.264604+0000', 'last_clean_scrub_stamp': '2023-11-28T20:02:07.264604+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 3], 'acting': [7, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-11-28T20:02:13.139 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2023-11-28T20:02:13.261 INFO:tasks.ceph.mds.a.smithi078.stderr:2023-11-28T20:02:13.256+0000 7f2c7b196640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-11-28T20:02:13.287 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:13.284+0000 7f0aa8a79640 1 Processor -- start 2023-11-28T20:02:13.288 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:13.284+0000 7f0aa8a79640 1 -- start start 2023-11-28T20:02:13.289 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:13.284+0000 7f0aa8a79640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f0aa40bfce0 0x7f0aa406ccc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:13.289 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:13.284+0000 7f0aa8a79640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0aa4151690 con 0x7f0aa406bef0 2023-11-28T20:02:13.289 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:13.284+0000 7f0aa8a79640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0aa4151bc0 con 0x7f0aa414e3f0 2023-11-28T20:02:13.289 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:13.284+0000 7f0aa8a79640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0aa41518e0 con 0x7f0aa40bfce0 2023-11-28T20:02:13.289 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:13.284+0000 7f0a9bfff640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f0aa406bef0 0x7f0aa406c5b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:40408/0 (socket says 172.21.15.78:40408) 2023-11-28T20:02:13.289 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:13.284+0000 7f0a9bfff640 1 -- 172.21.15.78:0/1121555421 learned_addr learned my addr 172.21.15.78:0/1121555421 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-11-28T20:02:13.289 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:13.284+0000 7f0aa2d9d640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f0aa40bfce0 0x7f0aa406ccc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:02:13.290 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:13.284+0000 7f0aa2d9d640 1 -- 172.21.15.78:0/1121555421 >> v1:172.21.15.179:6789/0 conn(0x7f0aa414e3f0 legacy=0x7f0aa40c41f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:02:13.290 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:13.284+0000 7f0aa2d9d640 1 -- 172.21.15.78:0/1121555421 >> v1:172.21.15.78:6789/0 conn(0x7f0aa406bef0 legacy=0x7f0aa406c5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:02:13.290 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:13.284+0000 7f0aa1d9b640 1 -- 172.21.15.78:0/1121555421 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 485827379 0 0) 0x7f0aa4151690 con 0x7f0aa406bef0 2023-11-28T20:02:13.290 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:13.284+0000 7f0aa2d9d640 1 -- 172.21.15.78:0/1121555421 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0aa40c1de0 con 0x7f0aa40bfce0 2023-11-28T20:02:13.292 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:13.288+0000 7f0aa2d9d640 1 --2- 172.21.15.78:0/1121555421 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0aa40bfce0 0x7f0aa406ccc0 secure :-1 s=READY pgs=906 cs=0 l=1 rev1=1 crypto rx=0x7f0a9c00ad90 tx=0x7f0a9c01d890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=27b5c127fc61f998 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:02:13.292 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:13.288+0000 7f0aa1d9b640 1 -- 172.21.15.78:0/1121555421 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a9c0a67f0 con 0x7f0aa40bfce0 2023-11-28T20:02:13.292 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:13.288+0000 7f0aa1d9b640 1 -- 172.21.15.78:0/1121555421 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a9c0a6950 con 0x7f0aa40bfce0 2023-11-28T20:02:13.293 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:13.288+0000 7f0aa1d9b640 1 -- 172.21.15.78:0/1121555421 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a9c0a6ce0 con 0x7f0aa40bfce0 2023-11-28T20:02:13.293 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:13.288+0000 7f0aa8a79640 1 -- 172.21.15.78:0/1121555421 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0aa40bfce0 msgr2=0x7f0aa406ccc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:02:13.293 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:13.288+0000 7f0aa8a79640 1 --2- 172.21.15.78:0/1121555421 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0aa40bfce0 0x7f0aa406ccc0 secure :-1 s=READY pgs=906 cs=0 l=1 rev1=1 crypto rx=0x7f0a9c00ad90 tx=0x7f0a9c01d890 comp rx=0 tx=0).stop 2023-11-28T20:02:13.294 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:13.288+0000 7f0aa8a79640 1 -- 172.21.15.78:0/1121555421 shutdown_connections 2023-11-28T20:02:13.294 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:13.288+0000 7f0aa8a79640 1 --2- 172.21.15.78:0/1121555421 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0aa40bfce0 0x7f0aa406ccc0 unknown :-1 s=CLOSED pgs=906 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:13.294 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:13.288+0000 7f0aa8a79640 1 -- 172.21.15.78:0/1121555421 >> 172.21.15.78:0/1121555421 conn(0x7f0aa40a7810 msgr2=0x7f0aa40a7c20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:02:13.294 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:13.288+0000 7f0aa8a79640 1 -- 172.21.15.78:0/1121555421 shutdown_connections 2023-11-28T20:02:13.294 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:13.288+0000 7f0aa8a79640 1 -- 172.21.15.78:0/1121555421 wait complete. 2023-11-28T20:02:13.295 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:13.288+0000 7f0aa8a79640 1 Processor -- start 2023-11-28T20:02:13.295 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:13.292+0000 7f0aa8a79640 1 -- start start 2023-11-28T20:02:13.296 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:13.292+0000 7f0aa8a79640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0aa406bef0 0x7f0aa40bf0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:13.297 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:13.292+0000 7f0aa8a79640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0aa40bfce0 0x7f0aa4147e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:13.297 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:13.292+0000 7f0aa8a79640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0aa414e3f0 0x7f0aa41ee8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:13.297 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:13.292+0000 7f0aa8a79640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0aa41edec0 con 0x7f0aa414e3f0 2023-11-28T20:02:13.297 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:13.292+0000 7f0aa8a79640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0aa4152320 con 0x7f0aa40bfce0 2023-11-28T20:02:13.297 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:13.292+0000 7f0aa8a79640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0aa4070a00 con 0x7f0aa406bef0 2023-11-28T20:02:13.297 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:13.292+0000 7f0aa2d9d640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0aa414e3f0 0x7f0aa41ee8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:02:13.297 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:13.292+0000 7f0aa2d9d640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0aa414e3f0 0x7f0aa41ee8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:49556/0 (socket says 172.21.15.78:49556) 2023-11-28T20:02:13.297 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:13.292+0000 7f0aa2d9d640 1 -- 172.21.15.78:0/1477979678 learned_addr learned my addr 172.21.15.78:0/1477979678 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T20:02:13.297 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:13.292+0000 7f0aa259c640 1 --2- 172.21.15.78:0/1477979678 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0aa406bef0 0x7f0aa40bf0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:02:13.297 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:13.292+0000 7f0a9bfff640 1 --2- 172.21.15.78:0/1477979678 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0aa40bfce0 0x7f0aa4147e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:02:13.297 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:13.292+0000 7f0aa2d9d640 1 -- 172.21.15.78:0/1477979678 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0aa406bef0 msgr2=0x7f0aa40bf0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:02:13.298 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:13.292+0000 7f0aa2d9d640 1 --2- 172.21.15.78:0/1477979678 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0aa406bef0 0x7f0aa40bf0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:13.298 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:13.292+0000 7f0aa2d9d640 1 -- 172.21.15.78:0/1477979678 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0aa40bfce0 msgr2=0x7f0aa4147e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:02:13.298 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:13.292+0000 7f0aa2d9d640 1 --2- 172.21.15.78:0/1477979678 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0aa40bfce0 0x7f0aa4147e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:13.298 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:13.292+0000 7f0aa2d9d640 1 -- 172.21.15.78:0/1477979678 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a9c00aa70 con 0x7f0aa414e3f0 2023-11-28T20:02:13.298 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:13.292+0000 7f0aa2d9d640 1 --2- 172.21.15.78:0/1477979678 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0aa414e3f0 0x7f0aa41ee8d0 secure :-1 s=READY pgs=907 cs=0 l=1 rev1=1 crypto rx=0x7f0a9c01a4a0 tx=0x7f0a9c01a630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:02:13.299 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:13.292+0000 7f0a9affd640 1 -- 172.21.15.78:0/1477979678 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a9c003ba0 con 0x7f0aa414e3f0 2023-11-28T20:02:13.299 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:13.292+0000 7f0a9affd640 1 -- 172.21.15.78:0/1477979678 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a9c003d00 con 0x7f0aa414e3f0 2023-11-28T20:02:13.299 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:13.292+0000 7f0aa8a79640 1 -- 172.21.15.78:0/1477979678 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0aa41ee0d0 con 0x7f0aa414e3f0 2023-11-28T20:02:13.299 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:13.292+0000 7f0a9affd640 1 -- 172.21.15.78:0/1477979678 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a9c0b8850 con 0x7f0aa414e3f0 2023-11-28T20:02:13.299 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:13.292+0000 7f0aa8a79640 1 -- 172.21.15.78:0/1477979678 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0aa40bf630 con 0x7f0aa414e3f0 2023-11-28T20:02:13.299 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:13.292+0000 7f0aa8a79640 1 -- 172.21.15.78:0/1477979678 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0aa4067630 con 0x7f0aa414e3f0 2023-11-28T20:02:13.299 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:13.296+0000 7f0a9affd640 1 -- 172.21.15.78:0/1477979678 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f0a9c0b89b0 con 0x7f0aa414e3f0 2023-11-28T20:02:13.300 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:13.296+0000 7f0a9affd640 1 --2- 172.21.15.78:0/1477979678 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f0a84066470 0x7f0a84068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:13.301 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:13.296+0000 7f0a9affd640 1 -- 172.21.15.78:0/1477979678 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f0a9c11ef00 con 0x7f0aa414e3f0 2023-11-28T20:02:13.301 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:13.296+0000 7f0aa259c640 1 --2- 172.21.15.78:0/1477979678 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f0a84066470 0x7f0a84068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:02:13.301 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:13.296+0000 7f0aa259c640 1 --2- 172.21.15.78:0/1477979678 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f0a84066470 0x7f0a84068930 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f0a94007fd0 tx=0x7f0a94009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:02:13.304 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:13.300+0000 7f0a9affd640 1 -- 172.21.15.78:0/1477979678 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f0a9c0ec4a0 con 0x7f0aa414e3f0 2023-11-28T20:02:13.508 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:13.504+0000 7f0aa8a79640 1 -- 172.21.15.78:0/1477979678 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7f0aa41ee580 con 0x7f0aa414e3f0 2023-11-28T20:02:13.508 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:13.504+0000 7f0a9affd640 1 -- 172.21.15.78:0/1477979678 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1452 (secure 0 0 0) 0x7f0a9c0efac0 con 0x7f0aa414e3f0 2023-11-28T20:02:13.509 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-11-28T20:02:13.509 INFO:teuthology.orchestra.run.smithi078.stdout:{"fsid":"dd9780e8-3bda-44fa-a9f0-fa07d19d901d","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":212,"monmap":{"epoch":1,"min_mon_release_name":"reef","num_mons":3},"osdmap":{"epoch":81,"num_osds":8,"num_up_osds":8,"osd_up_since":1701201532,"num_in_osds":8,"osd_in_since":1701201523,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"creating+peering","count":64},{"state_name":"active+clean","count":33}],"num_pgs":97,"num_pools":3,"num_objects":2,"data_bytes":590368,"bytes_used":254865408,"bytes_avail":772839247872,"bytes_total":773094113280,"inactive_pgs_ratio":0.65979379415512085},"fsmap":{"epoch":46,"id":6,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":6,"rank":0,"name":"a","status":"up:active","gid":6633}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":8,"modified":"2023-11-28T20:01:55.989503+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2023-11-28T20:02:13.510 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:13.504+0000 7f0aa8a79640 1 -- 172.21.15.78:0/1477979678 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f0a84066470 msgr2=0x7f0a84068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:02:13.510 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:13.504+0000 7f0aa8a79640 1 --2- 172.21.15.78:0/1477979678 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f0a84066470 0x7f0a84068930 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f0a94007fd0 tx=0x7f0a94009040 comp rx=0 tx=0).stop 2023-11-28T20:02:13.510 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:13.504+0000 7f0aa8a79640 1 -- 172.21.15.78:0/1477979678 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0aa414e3f0 msgr2=0x7f0aa41ee8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:02:13.511 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:13.504+0000 7f0aa8a79640 1 --2- 172.21.15.78:0/1477979678 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0aa414e3f0 0x7f0aa41ee8d0 secure :-1 s=READY pgs=907 cs=0 l=1 rev1=1 crypto rx=0x7f0a9c01a4a0 tx=0x7f0a9c01a630 comp rx=0 tx=0).stop 2023-11-28T20:02:13.511 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:13.504+0000 7f0aa8a79640 1 -- 172.21.15.78:0/1477979678 shutdown_connections 2023-11-28T20:02:13.511 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:13.504+0000 7f0aa8a79640 1 --2- 172.21.15.78:0/1477979678 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f0a84066470 0x7f0a84068930 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:13.511 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:13.504+0000 7f0aa8a79640 1 --2- 172.21.15.78:0/1477979678 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0aa414e3f0 0x7f0aa41ee8d0 unknown :-1 s=CLOSED pgs=907 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:13.511 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:13.504+0000 7f0aa8a79640 1 --2- 172.21.15.78:0/1477979678 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0aa40bfce0 0x7f0aa4147e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:13.511 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:13.504+0000 7f0aa8a79640 1 --2- 172.21.15.78:0/1477979678 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0aa406bef0 0x7f0aa40bf0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:13.511 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:13.504+0000 7f0aa8a79640 1 -- 172.21.15.78:0/1477979678 >> 172.21.15.78:0/1477979678 conn(0x7f0aa40a7810 msgr2=0x7f0aa40c41f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:02:13.511 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:13.504+0000 7f0aa8a79640 1 -- 172.21.15.78:0/1477979678 shutdown_connections 2023-11-28T20:02:13.511 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:13.504+0000 7f0aa8a79640 1 -- 172.21.15.78:0/1477979678 wait complete. 2023-11-28T20:02:13.530 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2023-11-28T20:02:13.530 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-28T20:02:13.668 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:13.664+0000 7f7aee7d8640 1 Processor -- start 2023-11-28T20:02:13.668 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:13.664+0000 7f7aee7d8640 1 -- start start 2023-11-28T20:02:13.669 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:13.664+0000 7f7aee7d8640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f7ae80c3b80 0x7f7ae806d690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:13.669 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:13.664+0000 7f7aee7d8640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7ae806bb80 con 0x7f7ae806d2b0 2023-11-28T20:02:13.669 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:13.664+0000 7f7aee7d8640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7ae80c5790 con 0x7f7ae80c5300 2023-11-28T20:02:13.669 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:13.664+0000 7f7aee7d8640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7ae81515c0 con 0x7f7ae80c3b80 2023-11-28T20:02:13.669 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:13.664+0000 7f7ae7fff640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f7ae806d2b0 0x7f7ae806c020 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:40416/0 (socket says 172.21.15.78:40416) 2023-11-28T20:02:13.669 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:13.664+0000 7f7ae7fff640 1 -- 172.21.15.78:0/3147399198 learned_addr learned my addr 172.21.15.78:0/3147399198 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-11-28T20:02:13.672 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:13.664+0000 7f7adffff640 1 --2- 172.21.15.78:0/3147399198 >> v2:172.21.15.179:3300/0 conn(0x7f7ae80c3b80 0x7f7ae806d690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:02:13.672 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:13.664+0000 7f7ae77fe640 1 -- 172.21.15.78:0/3147399198 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2559899862 0 0) 0x7f7ae806bb80 con 0x7f7ae806d2b0 2023-11-28T20:02:13.672 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:13.664+0000 7f7ae77fe640 1 -- 172.21.15.78:0/3147399198 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7ad4003530 con 0x7f7ae806d2b0 2023-11-28T20:02:13.672 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:13.664+0000 7f7ae77fe640 1 -- 172.21.15.78:0/3147399198 <== mon.0 v1:172.21.15.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3653537185 0 0) 0x7f7ad4003530 con 0x7f7ae806d2b0 2023-11-28T20:02:13.672 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:13.664+0000 7f7ae77fe640 1 -- 172.21.15.78:0/3147399198 >> v2:172.21.15.179:3300/0 conn(0x7f7ae80c3b80 msgr2=0x7f7ae806d690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:02:13.672 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:13.664+0000 7f7ae77fe640 1 --2- 172.21.15.78:0/3147399198 >> v2:172.21.15.179:3300/0 conn(0x7f7ae80c3b80 0x7f7ae806d690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:13.672 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:13.664+0000 7f7ae77fe640 1 -- 172.21.15.78:0/3147399198 >> v1:172.21.15.179:6789/0 conn(0x7f7ae80c5300 legacy=0x7f7ae806c730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:02:13.672 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:13.664+0000 7f7ae77fe640 1 -- 172.21.15.78:0/3147399198 --> v1:172.21.15.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ae81518a0 con 0x7f7ae806d2b0 2023-11-28T20:02:13.672 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:13.664+0000 7f7ae77fe640 1 -- 172.21.15.78:0/3147399198 <== mon.0 v1:172.21.15.78:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3326804700 0 0) 0x7f7ad8001680 con 0x7f7ae806d2b0 2023-11-28T20:02:13.673 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:13.664+0000 7f7ae77fe640 1 -- 172.21.15.78:0/3147399198 >> v1:172.21.15.78:6789/0 conn(0x7f7ae806d2b0 legacy=0x7f7ae806c020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:02:13.673 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:13.664+0000 7f7ae77fe640 1 --2- 172.21.15.78:0/3147399198 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7ad4003980 0x7f7ad4003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:13.673 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:13.664+0000 7f7ae77fe640 1 --2- 172.21.15.78:0/3147399198 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7ad40047d0 0x7f7ad4004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:13.673 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:13.664+0000 7f7ae77fe640 1 --2- 172.21.15.78:0/3147399198 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7ad4005190 0x7f7ad400b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:13.673 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:13.664+0000 7f7ae77fe640 1 -- 172.21.15.78:0/3147399198 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ae81515c0 con 0x7f7ad4003980 2023-11-28T20:02:13.673 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:13.664+0000 7f7ae77fe640 1 -- 172.21.15.78:0/3147399198 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ad400c030 con 0x7f7ad40047d0 2023-11-28T20:02:13.673 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:13.664+0000 7f7ae77fe640 1 -- 172.21.15.78:0/3147399198 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ad400c1f0 con 0x7f7ad4005190 2023-11-28T20:02:13.673 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:13.664+0000 7f7ae7fff640 1 --2- 172.21.15.78:0/3147399198 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7ad4003980 0x7f7ad4003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:02:13.674 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:13.664+0000 7f7adffff640 1 --2- 172.21.15.78:0/3147399198 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7ad40047d0 0x7f7ad4004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:02:13.674 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:13.664+0000 7f7aecd75640 1 --2- 172.21.15.78:0/3147399198 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7ad4005190 0x7f7ad400b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:02:13.674 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:13.664+0000 7f7ae7fff640 1 -- 172.21.15.78:0/3147399198 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7ad4005190 msgr2=0x7f7ad400b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:02:13.674 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:13.664+0000 7f7ae7fff640 1 --2- 172.21.15.78:0/3147399198 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7ad4005190 0x7f7ad400b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:13.674 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:13.664+0000 7f7ae7fff640 1 -- 172.21.15.78:0/3147399198 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7ad40047d0 msgr2=0x7f7ad4004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:02:13.674 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:13.664+0000 7f7ae7fff640 1 --2- 172.21.15.78:0/3147399198 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7ad40047d0 0x7f7ad4004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:13.674 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:13.664+0000 7f7ae7fff640 1 -- 172.21.15.78:0/3147399198 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ad4003530 con 0x7f7ad4003980 2023-11-28T20:02:13.674 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:13.664+0000 7f7adffff640 1 --2- 172.21.15.78:0/3147399198 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7ad40047d0 0x7f7ad4004c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T20:02:13.675 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:13.664+0000 7f7aecd75640 1 -- 172.21.15.78:0/3147399198 reap_dead start 2023-11-28T20:02:13.676 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:13.668+0000 7f7ae7fff640 1 --2- 172.21.15.78:0/3147399198 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7ad4003980 0x7f7ad4003da0 secure :-1 s=READY pgs=909 cs=0 l=1 rev1=1 crypto rx=0x7f7ad800c240 tx=0x7f7ad801cc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dfb11c88cacfd08b server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:02:13.676 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:13.668+0000 7f7ae77fe640 1 -- 172.21.15.78:0/3147399198 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ad8005ae0 con 0x7f7ad4003980 2023-11-28T20:02:13.676 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:13.668+0000 7f7ae77fe640 1 -- 172.21.15.78:0/3147399198 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ad8005c60 con 0x7f7ad4003980 2023-11-28T20:02:13.676 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:13.668+0000 7f7ae77fe640 1 -- 172.21.15.78:0/3147399198 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ad80a5800 con 0x7f7ad4003980 2023-11-28T20:02:13.676 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:13.668+0000 7f7aee7d8640 1 -- 172.21.15.78:0/3147399198 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7ad4003980 msgr2=0x7f7ad4003da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:02:13.677 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:13.668+0000 7f7aee7d8640 1 --2- 172.21.15.78:0/3147399198 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7ad4003980 0x7f7ad4003da0 secure :-1 s=READY pgs=909 cs=0 l=1 rev1=1 crypto rx=0x7f7ad800c240 tx=0x7f7ad801cc10 comp rx=0 tx=0).stop 2023-11-28T20:02:13.677 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:13.668+0000 7f7aee7d8640 1 -- 172.21.15.78:0/3147399198 shutdown_connections 2023-11-28T20:02:13.677 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:13.668+0000 7f7aee7d8640 1 --2- 172.21.15.78:0/3147399198 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7ad4003980 0x7f7ad4003da0 unknown :-1 s=CLOSED pgs=909 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:13.677 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:13.668+0000 7f7aee7d8640 1 -- 172.21.15.78:0/3147399198 >> 172.21.15.78:0/3147399198 conn(0x7f7ae80a7810 msgr2=0x7f7ae80a7c20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:02:13.677 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:13.668+0000 7f7aee7d8640 1 -- 172.21.15.78:0/3147399198 shutdown_connections 2023-11-28T20:02:13.677 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:13.668+0000 7f7aee7d8640 1 -- 172.21.15.78:0/3147399198 wait complete. 2023-11-28T20:02:13.678 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:13.672+0000 7f7aee7d8640 1 Processor -- start 2023-11-28T20:02:13.678 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:13.672+0000 7f7aee7d8640 1 -- start start 2023-11-28T20:02:13.680 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:13.672+0000 7f7aee7d8640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7ad4003980 0x7f7ae81e2210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:13.680 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:13.672+0000 7f7aee7d8640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7ae81eaf50 0x7f7ae814cd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:13.680 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:13.672+0000 7f7aee7d8640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7ae80bc250 0x7f7ae814d270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:13.680 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:13.672+0000 7f7aee7d8640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ae814d7b0 con 0x7f7ad4003980 2023-11-28T20:02:13.680 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:13.672+0000 7f7aee7d8640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ae81eb400 con 0x7f7ae80bc250 2023-11-28T20:02:13.680 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:13.672+0000 7f7aee7d8640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ae81eb6e0 con 0x7f7ae81eaf50 2023-11-28T20:02:13.680 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:13.672+0000 7f7ae7fff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7ad4003980 0x7f7ae81e2210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:02:13.680 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:13.672+0000 7f7ae7fff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7ad4003980 0x7f7ae81e2210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:49564/0 (socket says 172.21.15.78:49564) 2023-11-28T20:02:13.680 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:13.672+0000 7f7ae7fff640 1 -- 172.21.15.78:0/1079550055 learned_addr learned my addr 172.21.15.78:0/1079550055 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T20:02:13.680 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:13.672+0000 7f7aecd75640 1 --2- 172.21.15.78:0/1079550055 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7ae80bc250 0x7f7ae814d270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:02:13.681 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:13.672+0000 7f7ae7fff640 1 -- 172.21.15.78:0/1079550055 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7ae81eaf50 msgr2=0x7f7ae814cd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:02:13.681 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:13.672+0000 7f7ae7fff640 1 --2- 172.21.15.78:0/1079550055 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7ae81eaf50 0x7f7ae814cd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:13.681 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:13.672+0000 7f7ae7fff640 1 -- 172.21.15.78:0/1079550055 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7ae80bc250 msgr2=0x7f7ae814d270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:02:13.681 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:13.672+0000 7f7ae7fff640 1 --2- 172.21.15.78:0/1079550055 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7ae80bc250 0x7f7ae814d270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:13.681 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:13.672+0000 7f7ae7fff640 1 -- 172.21.15.78:0/1079550055 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ae814ef80 con 0x7f7ad4003980 2023-11-28T20:02:13.681 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:13.672+0000 7f7ae7fff640 1 --2- 172.21.15.78:0/1079550055 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7ad4003980 0x7f7ae81e2210 secure :-1 s=READY pgs=910 cs=0 l=1 rev1=1 crypto rx=0x7f7ad800c240 tx=0x7f7ad4005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:02:13.681 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:13.672+0000 7f7ae57fa640 1 -- 172.21.15.78:0/1079550055 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ad80b4070 con 0x7f7ad4003980 2023-11-28T20:02:13.681 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:13.672+0000 7f7ae57fa640 1 -- 172.21.15.78:0/1079550055 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ad80a5800 con 0x7f7ad4003980 2023-11-28T20:02:13.681 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:13.672+0000 7f7ae57fa640 1 -- 172.21.15.78:0/1079550055 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ad80a5b90 con 0x7f7ad4003980 2023-11-28T20:02:13.681 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:13.672+0000 7f7aee7d8640 1 -- 172.21.15.78:0/1079550055 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7ae81eb9c0 con 0x7f7ad4003980 2023-11-28T20:02:13.681 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:13.672+0000 7f7aee7d8640 1 -- 172.21.15.78:0/1079550055 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7ae81e2750 con 0x7f7ad4003980 2023-11-28T20:02:13.682 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:13.676+0000 7f7aee7d8640 1 -- 172.21.15.78:0/1079550055 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7ae8067630 con 0x7f7ad4003980 2023-11-28T20:02:13.682 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:13.676+0000 7f7ae57fa640 1 -- 172.21.15.78:0/1079550055 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f7ad80a5cf0 con 0x7f7ad4003980 2023-11-28T20:02:13.683 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:13.676+0000 7f7ae57fa640 1 --2- 172.21.15.78:0/1079550055 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f7ac80664a0 0x7f7ac8068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:13.683 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:13.676+0000 7f7ae57fa640 1 -- 172.21.15.78:0/1079550055 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f7ad811ddf0 con 0x7f7ad4003980 2023-11-28T20:02:13.683 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:13.676+0000 7f7adffff640 1 --2- 172.21.15.78:0/1079550055 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f7ac80664a0 0x7f7ac8068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:02:13.683 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:13.676+0000 7f7adffff640 1 --2- 172.21.15.78:0/1079550055 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f7ac80664a0 0x7f7ac8068960 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f7ae81eb330 tx=0x7f7ad0008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:02:13.685 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:13.680+0000 7f7ae57fa640 1 -- 172.21.15.78:0/1079550055 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f7ad80eb1c0 con 0x7f7ad4003980 2023-11-28T20:02:13.832 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:13.828+0000 7f7aee7d8640 1 -- 172.21.15.78:0/1079550055 --> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f7ae814ee00 con 0x7f7ac80664a0 2023-11-28T20:02:13.840 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:13.836+0000 7f7ae57fa640 1 -- 172.21.15.78:0/1079550055 <== mgr.4106 v2:172.21.15.78:6832/2935380957 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+283878 (secure 0 0 0) 0x7f7ad0009e40 con 0x7f7ac80664a0 2023-11-28T20:02:13.843 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-11-28T20:02:13.844 INFO:teuthology.orchestra.run.smithi078.stderr:dumped all 2023-11-28T20:02:13.845 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:13.840+0000 7f7aee7d8640 1 -- 172.21.15.78:0/1079550055 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f7ac80664a0 msgr2=0x7f7ac8068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:02:13.846 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:13.840+0000 7f7aee7d8640 1 --2- 172.21.15.78:0/1079550055 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f7ac80664a0 0x7f7ac8068960 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f7ae81eb330 tx=0x7f7ad0008040 comp rx=0 tx=0).stop 2023-11-28T20:02:13.846 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:13.840+0000 7f7aee7d8640 1 -- 172.21.15.78:0/1079550055 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7ad4003980 msgr2=0x7f7ae81e2210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:02:13.846 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:13.840+0000 7f7aee7d8640 1 --2- 172.21.15.78:0/1079550055 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7ad4003980 0x7f7ae81e2210 secure :-1 s=READY pgs=910 cs=0 l=1 rev1=1 crypto rx=0x7f7ad800c240 tx=0x7f7ad4005800 comp rx=0 tx=0).stop 2023-11-28T20:02:13.846 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:13.840+0000 7f7aee7d8640 1 -- 172.21.15.78:0/1079550055 shutdown_connections 2023-11-28T20:02:13.846 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:13.840+0000 7f7aee7d8640 1 --2- 172.21.15.78:0/1079550055 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f7ac80664a0 0x7f7ac8068960 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:13.847 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:13.840+0000 7f7aee7d8640 1 --2- 172.21.15.78:0/1079550055 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7ae81eaf50 0x7f7ae814cd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:13.847 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:13.840+0000 7f7aee7d8640 1 --2- 172.21.15.78:0/1079550055 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7ae80bc250 0x7f7ae814d270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:13.847 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:13.840+0000 7f7aee7d8640 1 --2- 172.21.15.78:0/1079550055 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7ad4003980 0x7f7ae81e2210 unknown :-1 s=CLOSED pgs=910 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:13.847 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:13.840+0000 7f7aee7d8640 1 -- 172.21.15.78:0/1079550055 >> 172.21.15.78:0/1079550055 conn(0x7f7ae80a7810 msgr2=0x7f7ae80a7bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:02:13.847 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:13.840+0000 7f7aee7d8640 1 -- 172.21.15.78:0/1079550055 shutdown_connections 2023-11-28T20:02:13.848 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:13.840+0000 7f7aee7d8640 1 -- 172.21.15.78:0/1079550055 wait complete. 2023-11-28T20:02:13.863 INFO:teuthology.orchestra.run.smithi078.stdout:{"pg_ready":true,"pg_map":{"version":174,"stamp":"2023-11-28T20:02:11.992080+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":38,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":248892,"kb_used_data":7744,"kb_used_omap":12,"kb_used_meta":241011,"kb_avail":754725828,"statfs":{"total":773094113280,"available":772839247872,"internally_reserved":0,"allocated":7929856,"data_stored":4827424,"data_compressed":66748,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":12752,"internal_metadata":246795824},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":33,"apply_latency_ms":33,"commit_latency_ns":33000000,"apply_latency_ns":33000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.727258"},"pg_stats":[{"pgid":"14.3f","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2023-11-28T20:02:07.283775+0000","last_change":"2023-11-28T20:02:07.283775+0000","last_active":"2023-11-28T20:02:07.264604+0000","last_peered":"2023-11-28T20:02:07.264604+0000","last_clean":"2023-11-28T20:02:07.264604+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:02:07.283775+0000","last_undegraded":"2023-11-28T20:02:07.283775+0000","last_fullsized":"2023-11-28T20:02:07.283775+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_clean_scrub_stamp":"2023-11-28T20:02:07.264604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.3e","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2023-11-28T20:02:07.281033+0000","last_change":"2023-11-28T20:02:07.281033+0000","last_active":"2023-11-28T20:02:07.264604+0000","last_peered":"2023-11-28T20:02:07.264604+0000","last_clean":"2023-11-28T20:02:07.264604+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:02:07.281033+0000","last_undegraded":"2023-11-28T20:02:07.281033+0000","last_fullsized":"2023-11-28T20:02:07.281033+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_clean_scrub_stamp":"2023-11-28T20:02:07.264604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.3d","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2023-11-28T20:02:07.284263+0000","last_change":"2023-11-28T20:02:07.284263+0000","last_active":"2023-11-28T20:02:07.264604+0000","last_peered":"2023-11-28T20:02:07.264604+0000","last_clean":"2023-11-28T20:02:07.264604+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:02:07.284263+0000","last_undegraded":"2023-11-28T20:02:07.284263+0000","last_fullsized":"2023-11-28T20:02:07.284263+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_clean_scrub_stamp":"2023-11-28T20:02:07.264604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.3c","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2023-11-28T20:02:07.279673+0000","last_change":"2023-11-28T20:02:07.279673+0000","last_active":"2023-11-28T20:02:07.264604+0000","last_peered":"2023-11-28T20:02:07.264604+0000","last_clean":"2023-11-28T20:02:07.264604+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:02:07.279673+0000","last_undegraded":"2023-11-28T20:02:07.279673+0000","last_fullsized":"2023-11-28T20:02:07.279673+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_clean_scrub_stamp":"2023-11-28T20:02:07.264604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.3b","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2023-11-28T20:02:07.278853+0000","last_change":"2023-11-28T20:02:07.278853+0000","last_active":"2023-11-28T20:02:07.264604+0000","last_peered":"2023-11-28T20:02:07.264604+0000","last_clean":"2023-11-28T20:02:07.264604+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:02:07.278853+0000","last_undegraded":"2023-11-28T20:02:07.278853+0000","last_fullsized":"2023-11-28T20:02:07.278853+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_clean_scrub_stamp":"2023-11-28T20:02:07.264604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.3a","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2023-11-28T20:02:07.285754+0000","last_change":"2023-11-28T20:02:07.285754+0000","last_active":"2023-11-28T20:02:07.264604+0000","last_peered":"2023-11-28T20:02:07.264604+0000","last_clean":"2023-11-28T20:02:07.264604+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:02:07.285754+0000","last_undegraded":"2023-11-28T20:02:07.285754+0000","last_fullsized":"2023-11-28T20:02:07.285754+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_clean_scrub_stamp":"2023-11-28T20:02:07.264604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.39","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2023-11-28T20:02:07.287408+0000","last_change":"2023-11-28T20:02:07.287408+0000","last_active":"2023-11-28T20:02:07.264604+0000","last_peered":"2023-11-28T20:02:07.264604+0000","last_clean":"2023-11-28T20:02:07.264604+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:02:07.287408+0000","last_undegraded":"2023-11-28T20:02:07.287408+0000","last_fullsized":"2023-11-28T20:02:07.287408+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_clean_scrub_stamp":"2023-11-28T20:02:07.264604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.38","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2023-11-28T20:02:07.279529+0000","last_change":"2023-11-28T20:02:07.279529+0000","last_active":"2023-11-28T20:02:07.264604+0000","last_peered":"2023-11-28T20:02:07.264604+0000","last_clean":"2023-11-28T20:02:07.264604+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:02:07.279529+0000","last_undegraded":"2023-11-28T20:02:07.279529+0000","last_fullsized":"2023-11-28T20:02:07.279529+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_clean_scrub_stamp":"2023-11-28T20:02:07.264604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.37","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2023-11-28T20:02:07.280230+0000","last_change":"2023-11-28T20:02:07.280230+0000","last_active":"2023-11-28T20:02:07.264604+0000","last_peered":"2023-11-28T20:02:07.264604+0000","last_clean":"2023-11-28T20:02:07.264604+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:02:07.280230+0000","last_undegraded":"2023-11-28T20:02:07.280230+0000","last_fullsized":"2023-11-28T20:02:07.280230+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_clean_scrub_stamp":"2023-11-28T20:02:07.264604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.36","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2023-11-28T20:02:07.285036+0000","last_change":"2023-11-28T20:02:07.285036+0000","last_active":"2023-11-28T20:02:07.264604+0000","last_peered":"2023-11-28T20:02:07.264604+0000","last_clean":"2023-11-28T20:02:07.264604+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:02:07.285036+0000","last_undegraded":"2023-11-28T20:02:07.285036+0000","last_fullsized":"2023-11-28T20:02:07.285036+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_clean_scrub_stamp":"2023-11-28T20:02:07.264604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.35","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2023-11-28T20:02:07.280584+0000","last_change":"2023-11-28T20:02:07.280584+0000","last_active":"2023-11-28T20:02:07.264604+0000","last_peered":"2023-11-28T20:02:07.264604+0000","last_clean":"2023-11-28T20:02:07.264604+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:02:07.280584+0000","last_undegraded":"2023-11-28T20:02:07.280584+0000","last_fullsized":"2023-11-28T20:02:07.280584+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_clean_scrub_stamp":"2023-11-28T20:02:07.264604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.34","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2023-11-28T20:02:07.281300+0000","last_change":"2023-11-28T20:02:07.281300+0000","last_active":"2023-11-28T20:02:07.264604+0000","last_peered":"2023-11-28T20:02:07.264604+0000","last_clean":"2023-11-28T20:02:07.264604+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:02:07.281300+0000","last_undegraded":"2023-11-28T20:02:07.281300+0000","last_fullsized":"2023-11-28T20:02:07.281300+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_clean_scrub_stamp":"2023-11-28T20:02:07.264604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.33","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2023-11-28T20:02:07.279252+0000","last_change":"2023-11-28T20:02:07.279252+0000","last_active":"2023-11-28T20:02:07.264604+0000","last_peered":"2023-11-28T20:02:07.264604+0000","last_clean":"2023-11-28T20:02:07.264604+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:02:07.279252+0000","last_undegraded":"2023-11-28T20:02:07.279252+0000","last_fullsized":"2023-11-28T20:02:07.279252+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_clean_scrub_stamp":"2023-11-28T20:02:07.264604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.32","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2023-11-28T20:02:07.280291+0000","last_change":"2023-11-28T20:02:07.280291+0000","last_active":"2023-11-28T20:02:07.264604+0000","last_peered":"2023-11-28T20:02:07.264604+0000","last_clean":"2023-11-28T20:02:07.264604+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:02:07.280291+0000","last_undegraded":"2023-11-28T20:02:07.280291+0000","last_fullsized":"2023-11-28T20:02:07.280291+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_clean_scrub_stamp":"2023-11-28T20:02:07.264604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.31","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2023-11-28T20:02:07.278957+0000","last_change":"2023-11-28T20:02:07.278957+0000","last_active":"2023-11-28T20:02:07.264604+0000","last_peered":"2023-11-28T20:02:07.264604+0000","last_clean":"2023-11-28T20:02:07.264604+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:02:07.278957+0000","last_undegraded":"2023-11-28T20:02:07.278957+0000","last_fullsized":"2023-11-28T20:02:07.278957+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_clean_scrub_stamp":"2023-11-28T20:02:07.264604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.30","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2023-11-28T20:02:07.285701+0000","last_change":"2023-11-28T20:02:07.285701+0000","last_active":"2023-11-28T20:02:07.264604+0000","last_peered":"2023-11-28T20:02:07.264604+0000","last_clean":"2023-11-28T20:02:07.264604+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:02:07.285701+0000","last_undegraded":"2023-11-28T20:02:07.285701+0000","last_fullsized":"2023-11-28T20:02:07.285701+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_clean_scrub_stamp":"2023-11-28T20:02:07.264604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.2f","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2023-11-28T20:02:07.279900+0000","last_change":"2023-11-28T20:02:07.279900+0000","last_active":"2023-11-28T20:02:07.264604+0000","last_peered":"2023-11-28T20:02:07.264604+0000","last_clean":"2023-11-28T20:02:07.264604+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:02:07.279900+0000","last_undegraded":"2023-11-28T20:02:07.279900+0000","last_fullsized":"2023-11-28T20:02:07.279900+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_clean_scrub_stamp":"2023-11-28T20:02:07.264604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.2e","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2023-11-28T20:02:07.283280+0000","last_change":"2023-11-28T20:02:07.283280+0000","last_active":"2023-11-28T20:02:07.264604+0000","last_peered":"2023-11-28T20:02:07.264604+0000","last_clean":"2023-11-28T20:02:07.264604+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:02:07.283280+0000","last_undegraded":"2023-11-28T20:02:07.283280+0000","last_fullsized":"2023-11-28T20:02:07.283280+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_clean_scrub_stamp":"2023-11-28T20:02:07.264604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.2d","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2023-11-28T20:02:07.279980+0000","last_change":"2023-11-28T20:02:07.279980+0000","last_active":"2023-11-28T20:02:07.264604+0000","last_peered":"2023-11-28T20:02:07.264604+0000","last_clean":"2023-11-28T20:02:07.264604+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:02:07.279980+0000","last_undegraded":"2023-11-28T20:02:07.279980+0000","last_fullsized":"2023-11-28T20:02:07.279980+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_clean_scrub_stamp":"2023-11-28T20:02:07.264604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.2c","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2023-11-28T20:02:07.279215+0000","last_change":"2023-11-28T20:02:07.279215+0000","last_active":"2023-11-28T20:02:07.264604+0000","last_peered":"2023-11-28T20:02:07.264604+0000","last_clean":"2023-11-28T20:02:07.264604+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:02:07.279215+0000","last_undegraded":"2023-11-28T20:02:07.279215+0000","last_fullsized":"2023-11-28T20:02:07.279215+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_clean_scrub_stamp":"2023-11-28T20:02:07.264604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.2b","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2023-11-28T20:02:07.279982+0000","last_change":"2023-11-28T20:02:07.279982+0000","last_active":"2023-11-28T20:02:07.264604+0000","last_peered":"2023-11-28T20:02:07.264604+0000","last_clean":"2023-11-28T20:02:07.264604+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:02:07.279982+0000","last_undegraded":"2023-11-28T20:02:07.279982+0000","last_fullsized":"2023-11-28T20:02:07.279982+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_clean_scrub_stamp":"2023-11-28T20:02:07.264604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.2a","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2023-11-28T20:02:07.279747+0000","last_change":"2023-11-28T20:02:07.279747+0000","last_active":"2023-11-28T20:02:07.264604+0000","last_peered":"2023-11-28T20:02:07.264604+0000","last_clean":"2023-11-28T20:02:07.264604+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:02:07.279747+0000","last_undegraded":"2023-11-28T20:02:07.279747+0000","last_fullsized":"2023-11-28T20:02:07.279747+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_clean_scrub_stamp":"2023-11-28T20:02:07.264604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.29","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2023-11-28T20:02:07.288560+0000","last_change":"2023-11-28T20:02:07.288560+0000","last_active":"2023-11-28T20:02:07.264604+0000","last_peered":"2023-11-28T20:02:07.264604+0000","last_clean":"2023-11-28T20:02:07.264604+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:02:07.288560+0000","last_undegraded":"2023-11-28T20:02:07.288560+0000","last_fullsized":"2023-11-28T20:02:07.288560+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_clean_scrub_stamp":"2023-11-28T20:02:07.264604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.28","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2023-11-28T20:02:07.281146+0000","last_change":"2023-11-28T20:02:07.281146+0000","last_active":"2023-11-28T20:02:07.264604+0000","last_peered":"2023-11-28T20:02:07.264604+0000","last_clean":"2023-11-28T20:02:07.264604+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:02:07.281146+0000","last_undegraded":"2023-11-28T20:02:07.281146+0000","last_fullsized":"2023-11-28T20:02:07.281146+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_clean_scrub_stamp":"2023-11-28T20:02:07.264604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.27","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2023-11-28T20:02:07.280571+0000","last_change":"2023-11-28T20:02:07.280571+0000","last_active":"2023-11-28T20:02:07.264604+0000","last_peered":"2023-11-28T20:02:07.264604+0000","last_clean":"2023-11-28T20:02:07.264604+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:02:07.280571+0000","last_undegraded":"2023-11-28T20:02:07.280571+0000","last_fullsized":"2023-11-28T20:02:07.280571+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_clean_scrub_stamp":"2023-11-28T20:02:07.264604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.26","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2023-11-28T20:02:07.281292+0000","last_change":"2023-11-28T20:02:07.281292+0000","last_active":"2023-11-28T20:02:07.264604+0000","last_peered":"2023-11-28T20:02:07.264604+0000","last_clean":"2023-11-28T20:02:07.264604+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:02:07.281292+0000","last_undegraded":"2023-11-28T20:02:07.281292+0000","last_fullsized":"2023-11-28T20:02:07.281292+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_clean_scrub_stamp":"2023-11-28T20:02:07.264604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.25","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2023-11-28T20:02:07.283518+0000","last_change":"2023-11-28T20:02:07.283518+0000","last_active":"2023-11-28T20:02:07.264604+0000","last_peered":"2023-11-28T20:02:07.264604+0000","last_clean":"2023-11-28T20:02:07.264604+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:02:07.283518+0000","last_undegraded":"2023-11-28T20:02:07.283518+0000","last_fullsized":"2023-11-28T20:02:07.283518+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_clean_scrub_stamp":"2023-11-28T20:02:07.264604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.24","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2023-11-28T20:02:07.278454+0000","last_change":"2023-11-28T20:02:07.278454+0000","last_active":"2023-11-28T20:02:07.264604+0000","last_peered":"2023-11-28T20:02:07.264604+0000","last_clean":"2023-11-28T20:02:07.264604+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:02:07.278454+0000","last_undegraded":"2023-11-28T20:02:07.278454+0000","last_fullsized":"2023-11-28T20:02:07.278454+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_clean_scrub_stamp":"2023-11-28T20:02:07.264604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.23","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2023-11-28T20:02:07.286673+0000","last_change":"2023-11-28T20:02:07.286673+0000","last_active":"2023-11-28T20:02:07.264604+0000","last_peered":"2023-11-28T20:02:07.264604+0000","last_clean":"2023-11-28T20:02:07.264604+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:02:07.286673+0000","last_undegraded":"2023-11-28T20:02:07.286673+0000","last_fullsized":"2023-11-28T20:02:07.286673+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_clean_scrub_stamp":"2023-11-28T20:02:07.264604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.22","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2023-11-28T20:02:07.278208+0000","last_change":"2023-11-28T20:02:07.278208+0000","last_active":"2023-11-28T20:02:07.264604+0000","last_peered":"2023-11-28T20:02:07.264604+0000","last_clean":"2023-11-28T20:02:07.264604+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:02:07.278208+0000","last_undegraded":"2023-11-28T20:02:07.278208+0000","last_fullsized":"2023-11-28T20:02:07.278208+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_clean_scrub_stamp":"2023-11-28T20:02:07.264604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.21","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2023-11-28T20:02:07.281997+0000","last_change":"2023-11-28T20:02:07.281997+0000","last_active":"2023-11-28T20:02:07.264604+0000","last_peered":"2023-11-28T20:02:07.264604+0000","last_clean":"2023-11-28T20:02:07.264604+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:02:07.281997+0000","last_undegraded":"2023-11-28T20:02:07.281997+0000","last_fullsized":"2023-11-28T20:02:07.281997+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_clean_scrub_stamp":"2023-11-28T20:02:07.264604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.20","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2023-11-28T20:02:07.280102+0000","last_change":"2023-11-28T20:02:07.280102+0000","last_active":"2023-11-28T20:02:07.264604+0000","last_peered":"2023-11-28T20:02:07.264604+0000","last_clean":"2023-11-28T20:02:07.264604+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:02:07.280102+0000","last_undegraded":"2023-11-28T20:02:07.280102+0000","last_fullsized":"2023-11-28T20:02:07.280102+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_clean_scrub_stamp":"2023-11-28T20:02:07.264604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.1c","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2023-11-28T20:02:07.285556+0000","last_change":"2023-11-28T20:02:07.285556+0000","last_active":"2023-11-28T20:02:07.264604+0000","last_peered":"2023-11-28T20:02:07.264604+0000","last_clean":"2023-11-28T20:02:07.264604+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:02:07.285556+0000","last_undegraded":"2023-11-28T20:02:07.285556+0000","last_fullsized":"2023-11-28T20:02:07.285556+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_clean_scrub_stamp":"2023-11-28T20:02:07.264604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1f","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-28T20:02:07.301622+0000","last_change":"2023-11-28T20:02:07.298433+0000","last_active":"2023-11-28T20:02:07.301622+0000","last_peered":"2023-11-28T20:02:07.301622+0000","last_clean":"2023-11-28T20:02:07.301622+0000","last_became_active":"2023-11-28T20:02:07.298106+0000","last_became_peered":"2023-11-28T20:02:07.298106+0000","last_unstale":"2023-11-28T20:02:07.301622+0000","last_undegraded":"2023-11-28T20:02:07.301622+0000","last_fullsized":"2023-11-28T20:02:07.301622+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:06.257335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:06.257335+0000","last_clean_scrub_stamp":"2023-11-28T20:02:06.257335+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T06:20:36.448239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.1d","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2023-11-28T20:02:07.286754+0000","last_change":"2023-11-28T20:02:07.286754+0000","last_active":"2023-11-28T20:02:07.264604+0000","last_peered":"2023-11-28T20:02:07.264604+0000","last_clean":"2023-11-28T20:02:07.264604+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:02:07.286754+0000","last_undegraded":"2023-11-28T20:02:07.286754+0000","last_fullsized":"2023-11-28T20:02:07.286754+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_clean_scrub_stamp":"2023-11-28T20:02:07.264604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1e","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-28T20:02:07.296840+0000","last_change":"2023-11-28T20:02:07.293164+0000","last_active":"2023-11-28T20:02:07.296840+0000","last_peered":"2023-11-28T20:02:07.296840+0000","last_clean":"2023-11-28T20:02:07.296840+0000","last_became_active":"2023-11-28T20:02:07.292799+0000","last_became_peered":"2023-11-28T20:02:07.292799+0000","last_unstale":"2023-11-28T20:02:07.296840+0000","last_undegraded":"2023-11-28T20:02:07.296840+0000","last_fullsized":"2023-11-28T20:02:07.296840+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:06.257335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:06.257335+0000","last_clean_scrub_stamp":"2023-11-28T20:02:06.257335+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:09:41.129447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.1e","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2023-11-28T20:02:07.287269+0000","last_change":"2023-11-28T20:02:07.287269+0000","last_active":"2023-11-28T20:02:07.264604+0000","last_peered":"2023-11-28T20:02:07.264604+0000","last_clean":"2023-11-28T20:02:07.264604+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:02:07.287269+0000","last_undegraded":"2023-11-28T20:02:07.287269+0000","last_fullsized":"2023-11-28T20:02:07.287269+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_clean_scrub_stamp":"2023-11-28T20:02:07.264604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.1d","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-28T20:02:07.305601+0000","last_change":"2023-11-28T20:02:07.298412+0000","last_active":"2023-11-28T20:02:07.305601+0000","last_peered":"2023-11-28T20:02:07.305601+0000","last_clean":"2023-11-28T20:02:07.305601+0000","last_became_active":"2023-11-28T20:02:07.297937+0000","last_became_peered":"2023-11-28T20:02:07.297937+0000","last_unstale":"2023-11-28T20:02:07.305601+0000","last_undegraded":"2023-11-28T20:02:07.305601+0000","last_fullsized":"2023-11-28T20:02:07.305601+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:06.257335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:06.257335+0000","last_clean_scrub_stamp":"2023-11-28T20:02:06.257335+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:11:12.221383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.1f","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2023-11-28T20:02:07.279393+0000","last_change":"2023-11-28T20:02:07.279393+0000","last_active":"2023-11-28T20:02:07.264604+0000","last_peered":"2023-11-28T20:02:07.264604+0000","last_clean":"2023-11-28T20:02:07.264604+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:02:07.279393+0000","last_undegraded":"2023-11-28T20:02:07.279393+0000","last_fullsized":"2023-11-28T20:02:07.279393+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_clean_scrub_stamp":"2023-11-28T20:02:07.264604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1c","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-28T20:02:07.306628+0000","last_change":"2023-11-28T20:02:07.303442+0000","last_active":"2023-11-28T20:02:07.306628+0000","last_peered":"2023-11-28T20:02:07.306628+0000","last_clean":"2023-11-28T20:02:07.306628+0000","last_became_active":"2023-11-28T20:02:07.302881+0000","last_became_peered":"2023-11-28T20:02:07.302881+0000","last_unstale":"2023-11-28T20:02:07.306628+0000","last_undegraded":"2023-11-28T20:02:07.306628+0000","last_fullsized":"2023-11-28T20:02:07.306628+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:06.257335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:06.257335+0000","last_clean_scrub_stamp":"2023-11-28T20:02:06.257335+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:26:07.339153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.18","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2023-11-28T20:02:07.279010+0000","last_change":"2023-11-28T20:02:07.279010+0000","last_active":"2023-11-28T20:02:07.264604+0000","last_peered":"2023-11-28T20:02:07.264604+0000","last_clean":"2023-11-28T20:02:07.264604+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:02:07.279010+0000","last_undegraded":"2023-11-28T20:02:07.279010+0000","last_fullsized":"2023-11-28T20:02:07.279010+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_clean_scrub_stamp":"2023-11-28T20:02:07.264604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.1b","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-28T20:02:07.295836+0000","last_change":"2023-11-28T20:02:07.292245+0000","last_active":"2023-11-28T20:02:07.295836+0000","last_peered":"2023-11-28T20:02:07.295836+0000","last_clean":"2023-11-28T20:02:07.295836+0000","last_became_active":"2023-11-28T20:02:07.291923+0000","last_became_peered":"2023-11-28T20:02:07.291923+0000","last_unstale":"2023-11-28T20:02:07.295836+0000","last_undegraded":"2023-11-28T20:02:07.295836+0000","last_fullsized":"2023-11-28T20:02:07.295836+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:06.257335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:06.257335+0000","last_clean_scrub_stamp":"2023-11-28T20:02:06.257335+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:12:38.018161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.19","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2023-11-28T20:02:07.288017+0000","last_change":"2023-11-28T20:02:07.288017+0000","last_active":"2023-11-28T20:02:07.264604+0000","last_peered":"2023-11-28T20:02:07.264604+0000","last_clean":"2023-11-28T20:02:07.264604+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:02:07.288017+0000","last_undegraded":"2023-11-28T20:02:07.288017+0000","last_fullsized":"2023-11-28T20:02:07.288017+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_clean_scrub_stamp":"2023-11-28T20:02:07.264604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1a","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-28T20:02:07.300872+0000","last_change":"2023-11-28T20:02:07.297038+0000","last_active":"2023-11-28T20:02:07.300872+0000","last_peered":"2023-11-28T20:02:07.300872+0000","last_clean":"2023-11-28T20:02:07.300872+0000","last_became_active":"2023-11-28T20:02:07.295472+0000","last_became_peered":"2023-11-28T20:02:07.295472+0000","last_unstale":"2023-11-28T20:02:07.300872+0000","last_undegraded":"2023-11-28T20:02:07.300872+0000","last_fullsized":"2023-11-28T20:02:07.300872+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:06.257335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:06.257335+0000","last_clean_scrub_stamp":"2023-11-28T20:02:06.257335+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:04:18.830964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.1a","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2023-11-28T20:02:07.279632+0000","last_change":"2023-11-28T20:02:07.279632+0000","last_active":"2023-11-28T20:02:07.264604+0000","last_peered":"2023-11-28T20:02:07.264604+0000","last_clean":"2023-11-28T20:02:07.264604+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:02:07.279632+0000","last_undegraded":"2023-11-28T20:02:07.279632+0000","last_fullsized":"2023-11-28T20:02:07.279632+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_clean_scrub_stamp":"2023-11-28T20:02:07.264604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.19","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-28T20:02:07.298903+0000","last_change":"2023-11-28T20:02:07.292322+0000","last_active":"2023-11-28T20:02:07.298903+0000","last_peered":"2023-11-28T20:02:07.298903+0000","last_clean":"2023-11-28T20:02:07.298903+0000","last_became_active":"2023-11-28T20:02:07.292063+0000","last_became_peered":"2023-11-28T20:02:07.292063+0000","last_unstale":"2023-11-28T20:02:07.298903+0000","last_undegraded":"2023-11-28T20:02:07.298903+0000","last_fullsized":"2023-11-28T20:02:07.298903+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:06.257335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:06.257335+0000","last_clean_scrub_stamp":"2023-11-28T20:02:06.257335+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T07:49:30.905608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.1b","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2023-11-28T20:02:07.278842+0000","last_change":"2023-11-28T20:02:07.278842+0000","last_active":"2023-11-28T20:02:07.264604+0000","last_peered":"2023-11-28T20:02:07.264604+0000","last_clean":"2023-11-28T20:02:07.264604+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:02:07.278842+0000","last_undegraded":"2023-11-28T20:02:07.278842+0000","last_fullsized":"2023-11-28T20:02:07.278842+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_clean_scrub_stamp":"2023-11-28T20:02:07.264604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.18","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-28T20:02:07.305630+0000","last_change":"2023-11-28T20:02:07.298452+0000","last_active":"2023-11-28T20:02:07.305630+0000","last_peered":"2023-11-28T20:02:07.305630+0000","last_clean":"2023-11-28T20:02:07.305630+0000","last_became_active":"2023-11-28T20:02:07.297932+0000","last_became_peered":"2023-11-28T20:02:07.297932+0000","last_unstale":"2023-11-28T20:02:07.305630+0000","last_undegraded":"2023-11-28T20:02:07.305630+0000","last_fullsized":"2023-11-28T20:02:07.305630+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:06.257335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:06.257335+0000","last_clean_scrub_stamp":"2023-11-28T20:02:06.257335+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:41:59.292583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.14","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2023-11-28T20:02:07.279138+0000","last_change":"2023-11-28T20:02:07.279138+0000","last_active":"2023-11-28T20:02:07.264604+0000","last_peered":"2023-11-28T20:02:07.264604+0000","last_clean":"2023-11-28T20:02:07.264604+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:02:07.279138+0000","last_undegraded":"2023-11-28T20:02:07.279138+0000","last_fullsized":"2023-11-28T20:02:07.279138+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_clean_scrub_stamp":"2023-11-28T20:02:07.264604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.17","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-28T20:02:07.305738+0000","last_change":"2023-11-28T20:02:07.299173+0000","last_active":"2023-11-28T20:02:07.305738+0000","last_peered":"2023-11-28T20:02:07.305738+0000","last_clean":"2023-11-28T20:02:07.305738+0000","last_became_active":"2023-11-28T20:02:07.298892+0000","last_became_peered":"2023-11-28T20:02:07.298892+0000","last_unstale":"2023-11-28T20:02:07.305738+0000","last_undegraded":"2023-11-28T20:02:07.305738+0000","last_fullsized":"2023-11-28T20:02:07.305738+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:06.257335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:06.257335+0000","last_clean_scrub_stamp":"2023-11-28T20:02:06.257335+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:31:56.348870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.15","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2023-11-28T20:02:07.286690+0000","last_change":"2023-11-28T20:02:07.286690+0000","last_active":"2023-11-28T20:02:07.264604+0000","last_peered":"2023-11-28T20:02:07.264604+0000","last_clean":"2023-11-28T20:02:07.264604+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:02:07.286690+0000","last_undegraded":"2023-11-28T20:02:07.286690+0000","last_fullsized":"2023-11-28T20:02:07.286690+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_clean_scrub_stamp":"2023-11-28T20:02:07.264604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.16","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-28T20:02:07.299239+0000","last_change":"2023-11-28T20:02:07.291621+0000","last_active":"2023-11-28T20:02:07.299239+0000","last_peered":"2023-11-28T20:02:07.299239+0000","last_clean":"2023-11-28T20:02:07.299239+0000","last_became_active":"2023-11-28T20:02:07.288923+0000","last_became_peered":"2023-11-28T20:02:07.288923+0000","last_unstale":"2023-11-28T20:02:07.299239+0000","last_undegraded":"2023-11-28T20:02:07.299239+0000","last_fullsized":"2023-11-28T20:02:07.299239+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:06.257335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:06.257335+0000","last_clean_scrub_stamp":"2023-11-28T20:02:06.257335+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:52:29.664838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.16","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2023-11-28T20:02:07.282823+0000","last_change":"2023-11-28T20:02:07.282823+0000","last_active":"2023-11-28T20:02:07.264604+0000","last_peered":"2023-11-28T20:02:07.264604+0000","last_clean":"2023-11-28T20:02:07.264604+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:02:07.282823+0000","last_undegraded":"2023-11-28T20:02:07.282823+0000","last_fullsized":"2023-11-28T20:02:07.282823+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_clean_scrub_stamp":"2023-11-28T20:02:07.264604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.15","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-28T20:02:07.303262+0000","last_change":"2023-11-28T20:02:07.300162+0000","last_active":"2023-11-28T20:02:07.303262+0000","last_peered":"2023-11-28T20:02:07.303262+0000","last_clean":"2023-11-28T20:02:07.303262+0000","last_became_active":"2023-11-28T20:02:07.299792+0000","last_became_peered":"2023-11-28T20:02:07.299792+0000","last_unstale":"2023-11-28T20:02:07.303262+0000","last_undegraded":"2023-11-28T20:02:07.303262+0000","last_fullsized":"2023-11-28T20:02:07.303262+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:06.257335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:06.257335+0000","last_clean_scrub_stamp":"2023-11-28T20:02:06.257335+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:03:03.265026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.17","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2023-11-28T20:02:07.278623+0000","last_change":"2023-11-28T20:02:07.278623+0000","last_active":"2023-11-28T20:02:07.264604+0000","last_peered":"2023-11-28T20:02:07.264604+0000","last_clean":"2023-11-28T20:02:07.264604+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:02:07.278623+0000","last_undegraded":"2023-11-28T20:02:07.278623+0000","last_fullsized":"2023-11-28T20:02:07.278623+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_clean_scrub_stamp":"2023-11-28T20:02:07.264604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.14","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-28T20:02:07.297892+0000","last_change":"2023-11-28T20:02:07.296089+0000","last_active":"2023-11-28T20:02:07.297892+0000","last_peered":"2023-11-28T20:02:07.297892+0000","last_clean":"2023-11-28T20:02:07.297892+0000","last_became_active":"2023-11-28T20:02:07.295836+0000","last_became_peered":"2023-11-28T20:02:07.295836+0000","last_unstale":"2023-11-28T20:02:07.297892+0000","last_undegraded":"2023-11-28T20:02:07.297892+0000","last_fullsized":"2023-11-28T20:02:07.297892+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:06.257335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:06.257335+0000","last_clean_scrub_stamp":"2023-11-28T20:02:06.257335+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:40:58.188007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.10","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2023-11-28T20:02:07.278502+0000","last_change":"2023-11-28T20:02:07.278502+0000","last_active":"2023-11-28T20:02:07.264604+0000","last_peered":"2023-11-28T20:02:07.264604+0000","last_clean":"2023-11-28T20:02:07.264604+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:02:07.278502+0000","last_undegraded":"2023-11-28T20:02:07.278502+0000","last_fullsized":"2023-11-28T20:02:07.278502+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_clean_scrub_stamp":"2023-11-28T20:02:07.264604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.13","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-28T20:02:07.305695+0000","last_change":"2023-11-28T20:02:07.298781+0000","last_active":"2023-11-28T20:02:07.305695+0000","last_peered":"2023-11-28T20:02:07.305695+0000","last_clean":"2023-11-28T20:02:07.305695+0000","last_became_active":"2023-11-28T20:02:07.298318+0000","last_became_peered":"2023-11-28T20:02:07.298318+0000","last_unstale":"2023-11-28T20:02:07.305695+0000","last_undegraded":"2023-11-28T20:02:07.305695+0000","last_fullsized":"2023-11-28T20:02:07.305695+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:06.257335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:06.257335+0000","last_clean_scrub_stamp":"2023-11-28T20:02:06.257335+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:40:58.188007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.11","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2023-11-28T20:02:07.278215+0000","last_change":"2023-11-28T20:02:07.278215+0000","last_active":"2023-11-28T20:02:07.264604+0000","last_peered":"2023-11-28T20:02:07.264604+0000","last_clean":"2023-11-28T20:02:07.264604+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:02:07.278215+0000","last_undegraded":"2023-11-28T20:02:07.278215+0000","last_fullsized":"2023-11-28T20:02:07.278215+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_clean_scrub_stamp":"2023-11-28T20:02:07.264604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.12","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-28T20:02:07.296902+0000","last_change":"2023-11-28T20:02:07.293203+0000","last_active":"2023-11-28T20:02:07.296902+0000","last_peered":"2023-11-28T20:02:07.296902+0000","last_clean":"2023-11-28T20:02:07.296902+0000","last_became_active":"2023-11-28T20:02:07.292922+0000","last_became_peered":"2023-11-28T20:02:07.292922+0000","last_unstale":"2023-11-28T20:02:07.296902+0000","last_undegraded":"2023-11-28T20:02:07.296902+0000","last_fullsized":"2023-11-28T20:02:07.296902+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:06.257335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:06.257335+0000","last_clean_scrub_stamp":"2023-11-28T20:02:06.257335+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:11:12.221383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.12","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2023-11-28T20:02:07.283056+0000","last_change":"2023-11-28T20:02:07.283056+0000","last_active":"2023-11-28T20:02:07.264604+0000","last_peered":"2023-11-28T20:02:07.264604+0000","last_clean":"2023-11-28T20:02:07.264604+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:02:07.283056+0000","last_undegraded":"2023-11-28T20:02:07.283056+0000","last_fullsized":"2023-11-28T20:02:07.283056+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_clean_scrub_stamp":"2023-11-28T20:02:07.264604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.11","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-28T20:02:07.299965+0000","last_change":"2023-11-28T20:02:07.291824+0000","last_active":"2023-11-28T20:02:07.299965+0000","last_peered":"2023-11-28T20:02:07.299965+0000","last_clean":"2023-11-28T20:02:07.299965+0000","last_became_active":"2023-11-28T20:02:07.291575+0000","last_became_peered":"2023-11-28T20:02:07.291575+0000","last_unstale":"2023-11-28T20:02:07.299965+0000","last_undegraded":"2023-11-28T20:02:07.299965+0000","last_fullsized":"2023-11-28T20:02:07.299965+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:06.257335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:06.257335+0000","last_clean_scrub_stamp":"2023-11-28T20:02:06.257335+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:32:46.550427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.13","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2023-11-28T20:02:07.280802+0000","last_change":"2023-11-28T20:02:07.280802+0000","last_active":"2023-11-28T20:02:07.264604+0000","last_peered":"2023-11-28T20:02:07.264604+0000","last_clean":"2023-11-28T20:02:07.264604+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:02:07.280802+0000","last_undegraded":"2023-11-28T20:02:07.280802+0000","last_fullsized":"2023-11-28T20:02:07.280802+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_clean_scrub_stamp":"2023-11-28T20:02:07.264604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.10","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-28T20:02:07.301395+0000","last_change":"2023-11-28T20:02:07.295459+0000","last_active":"2023-11-28T20:02:07.301395+0000","last_peered":"2023-11-28T20:02:07.301395+0000","last_clean":"2023-11-28T20:02:07.301395+0000","last_became_active":"2023-11-28T20:02:07.295090+0000","last_became_peered":"2023-11-28T20:02:07.295090+0000","last_unstale":"2023-11-28T20:02:07.301395+0000","last_undegraded":"2023-11-28T20:02:07.301395+0000","last_fullsized":"2023-11-28T20:02:07.301395+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:06.257335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:06.257335+0000","last_clean_scrub_stamp":"2023-11-28T20:02:06.257335+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:42:57.441074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.c","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2023-11-28T20:02:07.279835+0000","last_change":"2023-11-28T20:02:07.279835+0000","last_active":"2023-11-28T20:02:07.264604+0000","last_peered":"2023-11-28T20:02:07.264604+0000","last_clean":"2023-11-28T20:02:07.264604+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:02:07.279835+0000","last_undegraded":"2023-11-28T20:02:07.279835+0000","last_fullsized":"2023-11-28T20:02:07.279835+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_clean_scrub_stamp":"2023-11-28T20:02:07.264604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.f","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-28T20:02:07.301507+0000","last_change":"2023-11-28T20:02:07.295608+0000","last_active":"2023-11-28T20:02:07.301507+0000","last_peered":"2023-11-28T20:02:07.301507+0000","last_clean":"2023-11-28T20:02:07.301507+0000","last_became_active":"2023-11-28T20:02:07.295293+0000","last_became_peered":"2023-11-28T20:02:07.295293+0000","last_unstale":"2023-11-28T20:02:07.301507+0000","last_undegraded":"2023-11-28T20:02:07.301507+0000","last_fullsized":"2023-11-28T20:02:07.301507+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:06.257335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:06.257335+0000","last_clean_scrub_stamp":"2023-11-28T20:02:06.257335+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:32:46.550427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.d","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2023-11-28T20:02:07.288189+0000","last_change":"2023-11-28T20:02:07.288189+0000","last_active":"2023-11-28T20:02:07.264604+0000","last_peered":"2023-11-28T20:02:07.264604+0000","last_clean":"2023-11-28T20:02:07.264604+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:02:07.288189+0000","last_undegraded":"2023-11-28T20:02:07.288189+0000","last_fullsized":"2023-11-28T20:02:07.288189+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_clean_scrub_stamp":"2023-11-28T20:02:07.264604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.e","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-28T20:02:07.306531+0000","last_change":"2023-11-28T20:02:07.300742+0000","last_active":"2023-11-28T20:02:07.306531+0000","last_peered":"2023-11-28T20:02:07.306531+0000","last_clean":"2023-11-28T20:02:07.306531+0000","last_became_active":"2023-11-28T20:02:07.300392+0000","last_became_peered":"2023-11-28T20:02:07.300392+0000","last_unstale":"2023-11-28T20:02:07.306531+0000","last_undegraded":"2023-11-28T20:02:07.306531+0000","last_fullsized":"2023-11-28T20:02:07.306531+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:06.257335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:06.257335+0000","last_clean_scrub_stamp":"2023-11-28T20:02:06.257335+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T06:29:20.315585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.e","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2023-11-28T20:02:07.280313+0000","last_change":"2023-11-28T20:02:07.280313+0000","last_active":"2023-11-28T20:02:07.264604+0000","last_peered":"2023-11-28T20:02:07.264604+0000","last_clean":"2023-11-28T20:02:07.264604+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:02:07.280313+0000","last_undegraded":"2023-11-28T20:02:07.280313+0000","last_fullsized":"2023-11-28T20:02:07.280313+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_clean_scrub_stamp":"2023-11-28T20:02:07.264604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.d","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-28T20:02:07.305924+0000","last_change":"2023-11-28T20:02:07.301258+0000","last_active":"2023-11-28T20:02:07.305924+0000","last_peered":"2023-11-28T20:02:07.305924+0000","last_clean":"2023-11-28T20:02:07.305924+0000","last_became_active":"2023-11-28T20:02:07.300955+0000","last_became_peered":"2023-11-28T20:02:07.300955+0000","last_unstale":"2023-11-28T20:02:07.305924+0000","last_undegraded":"2023-11-28T20:02:07.305924+0000","last_fullsized":"2023-11-28T20:02:07.305924+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:06.257335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:06.257335+0000","last_clean_scrub_stamp":"2023-11-28T20:02:06.257335+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:03:27.733474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.8","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2023-11-28T20:02:07.279591+0000","last_change":"2023-11-28T20:02:07.279591+0000","last_active":"2023-11-28T20:02:07.264604+0000","last_peered":"2023-11-28T20:02:07.264604+0000","last_clean":"2023-11-28T20:02:07.264604+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:02:07.279591+0000","last_undegraded":"2023-11-28T20:02:07.279591+0000","last_fullsized":"2023-11-28T20:02:07.279591+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_clean_scrub_stamp":"2023-11-28T20:02:07.264604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.b","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-28T20:02:07.302648+0000","last_change":"2023-11-28T20:02:07.295857+0000","last_active":"2023-11-28T20:02:07.302648+0000","last_peered":"2023-11-28T20:02:07.302648+0000","last_clean":"2023-11-28T20:02:07.302648+0000","last_became_active":"2023-11-28T20:02:07.295642+0000","last_became_peered":"2023-11-28T20:02:07.295642+0000","last_unstale":"2023-11-28T20:02:07.302648+0000","last_undegraded":"2023-11-28T20:02:07.302648+0000","last_fullsized":"2023-11-28T20:02:07.302648+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:06.257335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:06.257335+0000","last_clean_scrub_stamp":"2023-11-28T20:02:06.257335+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:58:36.949904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.9","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2023-11-28T20:02:07.278282+0000","last_change":"2023-11-28T20:02:07.278282+0000","last_active":"2023-11-28T20:02:07.264604+0000","last_peered":"2023-11-28T20:02:07.264604+0000","last_clean":"2023-11-28T20:02:07.264604+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:02:07.278282+0000","last_undegraded":"2023-11-28T20:02:07.278282+0000","last_fullsized":"2023-11-28T20:02:07.278282+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_clean_scrub_stamp":"2023-11-28T20:02:07.264604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.a","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-28T20:02:07.299829+0000","last_change":"2023-11-28T20:02:07.296302+0000","last_active":"2023-11-28T20:02:07.299829+0000","last_peered":"2023-11-28T20:02:07.299829+0000","last_clean":"2023-11-28T20:02:07.299829+0000","last_became_active":"2023-11-28T20:02:07.296048+0000","last_became_peered":"2023-11-28T20:02:07.296048+0000","last_unstale":"2023-11-28T20:02:07.299829+0000","last_undegraded":"2023-11-28T20:02:07.299829+0000","last_fullsized":"2023-11-28T20:02:07.299829+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:06.257335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:06.257335+0000","last_clean_scrub_stamp":"2023-11-28T20:02:06.257335+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:01:27.566717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.a","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2023-11-28T20:02:07.279215+0000","last_change":"2023-11-28T20:02:07.279215+0000","last_active":"2023-11-28T20:02:07.264604+0000","last_peered":"2023-11-28T20:02:07.264604+0000","last_clean":"2023-11-28T20:02:07.264604+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:02:07.279215+0000","last_undegraded":"2023-11-28T20:02:07.279215+0000","last_fullsized":"2023-11-28T20:02:07.279215+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_clean_scrub_stamp":"2023-11-28T20:02:07.264604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.9","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-28T20:02:07.305776+0000","last_change":"2023-11-28T20:02:07.296576+0000","last_active":"2023-11-28T20:02:07.305776+0000","last_peered":"2023-11-28T20:02:07.305776+0000","last_clean":"2023-11-28T20:02:07.305776+0000","last_became_active":"2023-11-28T20:02:07.295982+0000","last_became_peered":"2023-11-28T20:02:07.295982+0000","last_unstale":"2023-11-28T20:02:07.305776+0000","last_undegraded":"2023-11-28T20:02:07.305776+0000","last_fullsized":"2023-11-28T20:02:07.305776+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:06.257335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:06.257335+0000","last_clean_scrub_stamp":"2023-11-28T20:02:06.257335+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:49:04.193812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.b","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2023-11-28T20:02:07.286137+0000","last_change":"2023-11-28T20:02:07.286137+0000","last_active":"2023-11-28T20:02:07.264604+0000","last_peered":"2023-11-28T20:02:07.264604+0000","last_clean":"2023-11-28T20:02:07.264604+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:02:07.286137+0000","last_undegraded":"2023-11-28T20:02:07.286137+0000","last_fullsized":"2023-11-28T20:02:07.286137+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_clean_scrub_stamp":"2023-11-28T20:02:07.264604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.8","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-28T20:02:07.297499+0000","last_change":"2023-11-28T20:02:07.293087+0000","last_active":"2023-11-28T20:02:07.297499+0000","last_peered":"2023-11-28T20:02:07.297499+0000","last_clean":"2023-11-28T20:02:07.297499+0000","last_became_active":"2023-11-28T20:02:07.292815+0000","last_became_peered":"2023-11-28T20:02:07.292815+0000","last_unstale":"2023-11-28T20:02:07.297499+0000","last_undegraded":"2023-11-28T20:02:07.297499+0000","last_fullsized":"2023-11-28T20:02:07.297499+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:06.257335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:06.257335+0000","last_clean_scrub_stamp":"2023-11-28T20:02:06.257335+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T06:11:16.542043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.4","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2023-11-28T20:02:07.287644+0000","last_change":"2023-11-28T20:02:07.287644+0000","last_active":"2023-11-28T20:02:07.264604+0000","last_peered":"2023-11-28T20:02:07.264604+0000","last_clean":"2023-11-28T20:02:07.264604+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:02:07.287644+0000","last_undegraded":"2023-11-28T20:02:07.287644+0000","last_fullsized":"2023-11-28T20:02:07.287644+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_clean_scrub_stamp":"2023-11-28T20:02:07.264604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.7","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-28T20:02:07.301899+0000","last_change":"2023-11-28T20:02:07.296980+0000","last_active":"2023-11-28T20:02:07.301899+0000","last_peered":"2023-11-28T20:02:07.301899+0000","last_clean":"2023-11-28T20:02:07.301899+0000","last_became_active":"2023-11-28T20:02:07.296625+0000","last_became_peered":"2023-11-28T20:02:07.296625+0000","last_unstale":"2023-11-28T20:02:07.301899+0000","last_undegraded":"2023-11-28T20:02:07.301899+0000","last_fullsized":"2023-11-28T20:02:07.301899+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:06.257335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:06.257335+0000","last_clean_scrub_stamp":"2023-11-28T20:02:06.257335+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:53:41.844853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.5","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2023-11-28T20:02:07.286312+0000","last_change":"2023-11-28T20:02:07.286312+0000","last_active":"2023-11-28T20:02:07.264604+0000","last_peered":"2023-11-28T20:02:07.264604+0000","last_clean":"2023-11-28T20:02:07.264604+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:02:07.286312+0000","last_undegraded":"2023-11-28T20:02:07.286312+0000","last_fullsized":"2023-11-28T20:02:07.286312+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_clean_scrub_stamp":"2023-11-28T20:02:07.264604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.6","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-28T20:02:07.298993+0000","last_change":"2023-11-28T20:02:07.296643+0000","last_active":"2023-11-28T20:02:07.298993+0000","last_peered":"2023-11-28T20:02:07.298993+0000","last_clean":"2023-11-28T20:02:07.298993+0000","last_became_active":"2023-11-28T20:02:07.296369+0000","last_became_peered":"2023-11-28T20:02:07.296369+0000","last_unstale":"2023-11-28T20:02:07.298993+0000","last_undegraded":"2023-11-28T20:02:07.298993+0000","last_fullsized":"2023-11-28T20:02:07.298993+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:06.257335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:06.257335+0000","last_clean_scrub_stamp":"2023-11-28T20:02:06.257335+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:52:33.501263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.6","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2023-11-28T20:02:07.284421+0000","last_change":"2023-11-28T20:02:07.284421+0000","last_active":"2023-11-28T20:02:07.264604+0000","last_peered":"2023-11-28T20:02:07.264604+0000","last_clean":"2023-11-28T20:02:07.264604+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:02:07.284421+0000","last_undegraded":"2023-11-28T20:02:07.284421+0000","last_fullsized":"2023-11-28T20:02:07.284421+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_clean_scrub_stamp":"2023-11-28T20:02:07.264604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.5","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-28T20:02:07.303244+0000","last_change":"2023-11-28T20:02:07.300054+0000","last_active":"2023-11-28T20:02:07.303244+0000","last_peered":"2023-11-28T20:02:07.303244+0000","last_clean":"2023-11-28T20:02:07.303244+0000","last_became_active":"2023-11-28T20:02:07.298610+0000","last_became_peered":"2023-11-28T20:02:07.298610+0000","last_unstale":"2023-11-28T20:02:07.303244+0000","last_undegraded":"2023-11-28T20:02:07.303244+0000","last_fullsized":"2023-11-28T20:02:07.303244+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:06.257335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:06.257335+0000","last_clean_scrub_stamp":"2023-11-28T20:02:06.257335+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:59:20.247089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.7","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2023-11-28T20:02:07.280140+0000","last_change":"2023-11-28T20:02:07.280140+0000","last_active":"2023-11-28T20:02:07.264604+0000","last_peered":"2023-11-28T20:02:07.264604+0000","last_clean":"2023-11-28T20:02:07.264604+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:02:07.280140+0000","last_undegraded":"2023-11-28T20:02:07.280140+0000","last_fullsized":"2023-11-28T20:02:07.280140+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_clean_scrub_stamp":"2023-11-28T20:02:07.264604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.4","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-28T20:02:07.303568+0000","last_change":"2023-11-28T20:02:07.301572+0000","last_active":"2023-11-28T20:02:07.303568+0000","last_peered":"2023-11-28T20:02:07.303568+0000","last_clean":"2023-11-28T20:02:07.303568+0000","last_became_active":"2023-11-28T20:02:07.301226+0000","last_became_peered":"2023-11-28T20:02:07.301226+0000","last_unstale":"2023-11-28T20:02:07.303568+0000","last_undegraded":"2023-11-28T20:02:07.303568+0000","last_fullsized":"2023-11-28T20:02:07.303568+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:06.257335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:06.257335+0000","last_clean_scrub_stamp":"2023-11-28T20:02:06.257335+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:48:42.567546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.0","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2023-11-28T20:02:07.281665+0000","last_change":"2023-11-28T20:02:07.281665+0000","last_active":"2023-11-28T20:02:07.264604+0000","last_peered":"2023-11-28T20:02:07.264604+0000","last_clean":"2023-11-28T20:02:07.264604+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:02:07.281665+0000","last_undegraded":"2023-11-28T20:02:07.281665+0000","last_fullsized":"2023-11-28T20:02:07.281665+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_clean_scrub_stamp":"2023-11-28T20:02:07.264604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.3","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-28T20:02:07.297690+0000","last_change":"2023-11-28T20:02:07.294264+0000","last_active":"2023-11-28T20:02:07.297690+0000","last_peered":"2023-11-28T20:02:07.297690+0000","last_clean":"2023-11-28T20:02:07.297690+0000","last_became_active":"2023-11-28T20:02:07.293763+0000","last_became_peered":"2023-11-28T20:02:07.293763+0000","last_unstale":"2023-11-28T20:02:07.297690+0000","last_undegraded":"2023-11-28T20:02:07.297690+0000","last_fullsized":"2023-11-28T20:02:07.297690+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:06.257335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:06.257335+0000","last_clean_scrub_stamp":"2023-11-28T20:02:06.257335+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:10:34.198054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.1","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2023-11-28T20:02:07.281971+0000","last_change":"2023-11-28T20:02:07.281971+0000","last_active":"2023-11-28T20:02:07.264604+0000","last_peered":"2023-11-28T20:02:07.264604+0000","last_clean":"2023-11-28T20:02:07.264604+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:02:07.281971+0000","last_undegraded":"2023-11-28T20:02:07.281971+0000","last_fullsized":"2023-11-28T20:02:07.281971+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_clean_scrub_stamp":"2023-11-28T20:02:07.264604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.2","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-28T20:02:07.305772+0000","last_change":"2023-11-28T20:02:07.299946+0000","last_active":"2023-11-28T20:02:07.305772+0000","last_peered":"2023-11-28T20:02:07.305772+0000","last_clean":"2023-11-28T20:02:07.305772+0000","last_became_active":"2023-11-28T20:02:07.299678+0000","last_became_peered":"2023-11-28T20:02:07.299678+0000","last_unstale":"2023-11-28T20:02:07.305772+0000","last_undegraded":"2023-11-28T20:02:07.305772+0000","last_fullsized":"2023-11-28T20:02:07.305772+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:06.257335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:06.257335+0000","last_clean_scrub_stamp":"2023-11-28T20:02:06.257335+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:46:58.325801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.2","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2023-11-28T20:02:07.284520+0000","last_change":"2023-11-28T20:02:07.284520+0000","last_active":"2023-11-28T20:02:07.264604+0000","last_peered":"2023-11-28T20:02:07.264604+0000","last_clean":"2023-11-28T20:02:07.264604+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:02:07.284520+0000","last_undegraded":"2023-11-28T20:02:07.284520+0000","last_fullsized":"2023-11-28T20:02:07.284520+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_clean_scrub_stamp":"2023-11-28T20:02:07.264604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-28T20:02:07.301562+0000","last_change":"2023-11-28T20:02:07.297766+0000","last_active":"2023-11-28T20:02:07.301562+0000","last_peered":"2023-11-28T20:02:07.301562+0000","last_clean":"2023-11-28T20:02:07.301562+0000","last_became_active":"2023-11-28T20:02:07.297403+0000","last_became_peered":"2023-11-28T20:02:07.297403+0000","last_unstale":"2023-11-28T20:02:07.301562+0000","last_undegraded":"2023-11-28T20:02:07.301562+0000","last_fullsized":"2023-11-28T20:02:07.301562+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:06.257335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:06.257335+0000","last_clean_scrub_stamp":"2023-11-28T20:02:06.257335+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T07:05:17.648805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.3","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2023-11-28T20:02:07.285711+0000","last_change":"2023-11-28T20:02:07.285711+0000","last_active":"2023-11-28T20:02:07.264604+0000","last_peered":"2023-11-28T20:02:07.264604+0000","last_clean":"2023-11-28T20:02:07.264604+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:02:07.285711+0000","last_undegraded":"2023-11-28T20:02:07.285711+0000","last_fullsized":"2023-11-28T20:02:07.285711+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_clean_scrub_stamp":"2023-11-28T20:02:07.264604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.0","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-28T20:02:07.306551+0000","last_change":"2023-11-28T20:02:07.300917+0000","last_active":"2023-11-28T20:02:07.306551+0000","last_peered":"2023-11-28T20:02:07.306551+0000","last_clean":"2023-11-28T20:02:07.306551+0000","last_became_active":"2023-11-28T20:02:07.300632+0000","last_became_peered":"2023-11-28T20:02:07.300632+0000","last_unstale":"2023-11-28T20:02:07.306551+0000","last_undegraded":"2023-11-28T20:02:07.306551+0000","last_fullsized":"2023-11-28T20:02:07.306551+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:06.257335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:06.257335+0000","last_clean_scrub_stamp":"2023-11-28T20:02:06.257335+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:10:34.198054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.f","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2023-11-28T20:02:07.288389+0000","last_change":"2023-11-28T20:02:07.288389+0000","last_active":"2023-11-28T20:02:07.264604+0000","last_peered":"2023-11-28T20:02:07.264604+0000","last_clean":"2023-11-28T20:02:07.264604+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:02:07.288389+0000","last_undegraded":"2023-11-28T20:02:07.288389+0000","last_fullsized":"2023-11-28T20:02:07.288389+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_clean_scrub_stamp":"2023-11-28T20:02:07.264604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.c","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-28T20:02:07.300002+0000","last_change":"2023-11-28T20:02:07.293843+0000","last_active":"2023-11-28T20:02:07.300002+0000","last_peered":"2023-11-28T20:02:07.300002+0000","last_clean":"2023-11-28T20:02:07.300002+0000","last_became_active":"2023-11-28T20:02:07.293538+0000","last_became_peered":"2023-11-28T20:02:07.293538+0000","last_unstale":"2023-11-28T20:02:07.300002+0000","last_undegraded":"2023-11-28T20:02:07.300002+0000","last_fullsized":"2023-11-28T20:02:07.300002+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:06.257335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:06.257335+0000","last_clean_scrub_stamp":"2023-11-28T20:02:06.257335+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T07:05:17.648805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":215,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-28T20:02:06.276288+0000","last_change":"2023-11-28T19:58:56.136501+0000","last_active":"2023-11-28T20:02:06.276288+0000","last_peered":"2023-11-28T20:02:06.276288+0000","last_clean":"2023-11-28T20:02:06.276288+0000","last_became_active":"2023-11-28T19:58:56.135998+0000","last_became_peered":"2023-11-28T19:58:56.135998+0000","last_unstale":"2023-11-28T20:02:06.276288+0000","last_undegraded":"2023-11-28T20:02:06.276288+0000","last_fullsized":"2023-11-28T20:02:06.276288+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:58:54.602349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:58:54.602349+0000","last_clean_scrub_stamp":"2023-11-28T19:58:54.602349+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:33:42.723349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":13,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":14,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":66748,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574891,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32200,"kb_used_data":1016,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339640,"statfs":{"total":96636764160,"available":96603791360,"internally_reserved":0,"allocated":1040384,"data_stored":1046204,"data_compressed":33374,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 20:01:59 2023","interfaces":[{"interface":"back","average":{"1min":0.66000000000000003,"5min":0.67100000000000004,"15min":0.67600000000000005},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.94299999999999995,"5min":0.94299999999999995,"15min":0.94299999999999995},"last":0.71299999999999997},{"interface":"front","average":{"1min":0.66500000000000004,"5min":0.67000000000000004,"15min":0.68000000000000005},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":1.014,"5min":1.014,"15min":1.014},"last":0.73199999999999998}]},{"osd":1,"last update":"Tue Nov 28 20:01:59 2023","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.63900000000000001,"15min":0.64300000000000002},"min":{"1min":0.46100000000000002,"5min":0.438,"15min":0.438},"max":{"1min":0.95099999999999996,"5min":0.95099999999999996,"15min":0.95099999999999996},"last":0.621},{"interface":"front","average":{"1min":0.66400000000000003,"5min":0.68100000000000005,"15min":0.69499999999999995},"min":{"1min":0.45600000000000002,"5min":0.432,"15min":0.432},"max":{"1min":0.85099999999999998,"5min":1.0900000000000001,"15min":1.0900000000000001},"last":0.59199999999999997}]},{"osd":2,"last update":"Tue Nov 28 20:01:59 2023","interfaces":[{"interface":"back","average":{"1min":0.69899999999999995,"5min":0.70899999999999996,"15min":0.72599999999999998},"min":{"1min":0.497,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.93100000000000005,"5min":0.98799999999999999,"15min":0.98799999999999999},"last":0.84099999999999997},{"interface":"front","average":{"1min":0.66800000000000004,"5min":0.68799999999999994,"15min":0.69999999999999996},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":1.514,"5min":1.514,"15min":1.514},"last":0.53200000000000003}]},{"osd":3,"last update":"Tue Nov 28 20:01:59 2023","interfaces":[{"interface":"back","average":{"1min":0.68200000000000005,"5min":0.69699999999999995,"15min":0.69899999999999995},"min":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":0.90200000000000002,"5min":1.0449999999999999,"15min":1.0449999999999999},"last":0.69299999999999995},{"interface":"front","average":{"1min":0.70899999999999996,"5min":0.76600000000000001,"15min":0.78400000000000003},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":1.034,"5min":1.1299999999999999,"15min":1.1299999999999999},"last":0.79300000000000004}]},{"osd":4,"last update":"Tue Nov 28 20:01:59 2023","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.628,"15min":0.63700000000000001},"min":{"1min":0.38900000000000001,"5min":0.378,"15min":0.378},"max":{"1min":1.2829999999999999,"5min":1.2829999999999999,"15min":1.2829999999999999},"last":0.65800000000000003},{"interface":"front","average":{"1min":0.66800000000000004,"5min":0.70899999999999996,"15min":0.72499999999999998},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.91800000000000004,"5min":1.1120000000000001,"15min":1.1120000000000001},"last":0.82199999999999995}]},{"osd":5,"last update":"Tue Nov 28 20:01:59 2023","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.65300000000000002,"15min":0.67400000000000004},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.97999999999999998,"5min":1.1699999999999999,"15min":1.1699999999999999},"last":0.751},{"interface":"front","average":{"1min":0.70899999999999996,"5min":0.73699999999999999,"15min":0.75600000000000001},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":1.3300000000000001,"5min":1.3300000000000001,"15min":1.3300000000000001},"last":0.76700000000000002}]},{"osd":6,"last update":"Tue Nov 28 20:01:59 2023","interfaces":[{"interface":"back","average":{"1min":0.76000000000000001,"5min":0.76400000000000001,"15min":0.77600000000000002},"min":{"1min":0.53500000000000003,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":1.3919999999999999,"5min":1.3919999999999999,"15min":1.3919999999999999},"last":0.85899999999999999},{"interface":"front","average":{"1min":0.67000000000000004,"5min":0.71199999999999997,"15min":0.73499999999999999},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.96099999999999997,"5min":1.23,"15min":1.23},"last":0.88600000000000001}]}]},{"osd":6,"up_from":13,"seq":55834574889,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27976,"kb_used_data":952,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343864,"statfs":{"total":96636764160,"available":96608116736,"internally_reserved":0,"allocated":974848,"data_stored":455836,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 20:01:54 2023","interfaces":[{"interface":"back","average":{"1min":0.64000000000000001,"5min":0.621,"15min":0.61699999999999999},"min":{"1min":0.40200000000000002,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.91600000000000004,"5min":0.91600000000000004,"15min":0.91600000000000004},"last":0.627},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.66000000000000003,"15min":0.66200000000000003},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":0.80600000000000005,"5min":0.98999999999999999,"15min":0.98999999999999999},"last":0.68000000000000005}]},{"osd":1,"last update":"Tue Nov 28 20:01:54 2023","interfaces":[{"interface":"back","average":{"1min":0.71499999999999997,"5min":0.76600000000000001,"15min":0.78200000000000003},"min":{"1min":0.54700000000000004,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.012,"5min":1.105,"15min":1.105},"last":0.78300000000000003},{"interface":"front","average":{"1min":0.62,"5min":0.67600000000000005,"15min":0.68300000000000005},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":0.90200000000000002,"5min":0.95899999999999996,"15min":0.95899999999999996},"last":0.60899999999999999}]},{"osd":2,"last update":"Tue Nov 28 20:01:54 2023","interfaces":[{"interface":"back","average":{"1min":0.63800000000000001,"5min":0.68200000000000005,"15min":0.69399999999999995},"min":{"1min":0.502,"5min":0.502,"15min":0.502},"max":{"1min":0.78900000000000003,"5min":0.93400000000000005,"15min":0.93400000000000005},"last":0.66900000000000004},{"interface":"front","average":{"1min":0.65800000000000003,"5min":0.70399999999999996,"15min":0.71399999999999997},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":0.95299999999999996,"5min":1.006,"15min":1.006},"last":0.69999999999999996}]},{"osd":3,"last update":"Tue Nov 28 20:01:54 2023","interfaces":[{"interface":"back","average":{"1min":0.68300000000000005,"5min":0.72799999999999998,"15min":0.74199999999999999},"min":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":0.96699999999999997,"5min":1.056,"15min":1.056},"last":0.80600000000000005},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.66600000000000004,"15min":0.67800000000000005},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":0.78200000000000003,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.63900000000000001}]},{"osd":4,"last update":"Tue Nov 28 20:01:54 2023","interfaces":[{"interface":"back","average":{"1min":0.61299999999999999,"5min":0.624,"15min":0.628},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.93300000000000005,"5min":0.97599999999999998,"15min":0.97599999999999998},"last":0.55400000000000005},{"interface":"front","average":{"1min":0.61499999999999999,"5min":0.68700000000000006,"15min":0.72099999999999997},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.91700000000000004,"5min":1.389,"15min":1.389},"last":0.71399999999999997}]},{"osd":5,"last update":"Tue Nov 28 20:01:54 2023","interfaces":[{"interface":"back","average":{"1min":0.68799999999999994,"5min":0.77100000000000002,"15min":0.80100000000000005},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":1.0629999999999999,"5min":1.4259999999999999,"15min":1.4259999999999999},"last":0.749},{"interface":"front","average":{"1min":0.65600000000000003,"5min":0.72999999999999998,"15min":0.752},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.97099999999999997,"5min":1.276,"15min":1.276},"last":0.65600000000000003}]},{"osd":7,"last update":"Tue Nov 28 20:01:54 2023","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.67900000000000005,"15min":0.70299999999999996},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.84199999999999997,"5min":1.014,"15min":1.014},"last":0.58299999999999996},{"interface":"front","average":{"1min":0.68200000000000005,"5min":0.77900000000000003,"15min":0.81299999999999994},"min":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":1.002,"5min":1.242,"15min":1.242},"last":0.73599999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574891,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32136,"kb_used_data":952,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339704,"statfs":{"total":96636764160,"available":96603856896,"internally_reserved":0,"allocated":974848,"data_stored":455836,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 20:01:59 2023","interfaces":[{"interface":"back","average":{"1min":0.66500000000000004,"5min":0.68400000000000005,"15min":0.70099999999999996},"min":{"1min":0.44400000000000001,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":1.077,"5min":1.077,"15min":1.077},"last":0.56100000000000005},{"interface":"front","average":{"1min":0.65300000000000002,"5min":0.68500000000000005,"15min":0.70699999999999996},"min":{"1min":0.41899999999999998,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.94599999999999995,"5min":1.149,"15min":1.149},"last":0.67800000000000005}]},{"osd":1,"last update":"Tue Nov 28 20:01:59 2023","interfaces":[{"interface":"back","average":{"1min":0.626,"5min":0.68600000000000005,"15min":0.70399999999999996},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.82599999999999996,"5min":0.94499999999999995,"15min":0.94499999999999995},"last":0.63100000000000001},{"interface":"front","average":{"1min":0.67400000000000004,"5min":0.69299999999999995,"15min":0.71699999999999997},"min":{"1min":0.49099999999999999,"5min":0.38,"15min":0.38},"max":{"1min":1.008,"5min":1.0940000000000001,"15min":1.0940000000000001},"last":0.52200000000000002}]},{"osd":2,"last update":"Tue Nov 28 20:01:59 2023","interfaces":[{"interface":"back","average":{"1min":0.65400000000000003,"5min":0.83299999999999996,"15min":0.90800000000000003},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":1.044,"5min":5.0880000000000001,"15min":5.0880000000000001},"last":0.83099999999999996},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.879,"15min":0.96099999999999997},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":0.91300000000000003,"5min":5.1399999999999997,"15min":5.1399999999999997},"last":0.76200000000000001}]},{"osd":3,"last update":"Tue Nov 28 20:01:59 2023","interfaces":[{"interface":"back","average":{"1min":0.71499999999999997,"5min":0.90100000000000002,"15min":0.98499999999999999},"min":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":1.1000000000000001,"5min":5.0469999999999997,"15min":5.0469999999999997},"last":0.92900000000000005},{"interface":"front","average":{"1min":0.69999999999999996,"5min":0.878,"15min":0.95999999999999996},"min":{"1min":0.47899999999999998,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":0.95899999999999996,"5min":5.024,"15min":5.024},"last":0.80600000000000005}]},{"osd":4,"last update":"Tue Nov 28 20:01:59 2023","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.64000000000000001,"15min":0.66400000000000003},"min":{"1min":0.42899999999999999,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.877,"5min":1.4810000000000001,"15min":1.4810000000000001},"last":0.71399999999999997},{"interface":"front","average":{"1min":0.67300000000000004,"5min":0.72099999999999997,"15min":0.73799999999999999},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.97599999999999998,"5min":1.6339999999999999,"15min":1.6339999999999999},"last":0.88300000000000001}]},{"osd":6,"last update":"Tue Nov 28 20:01:59 2023","interfaces":[{"interface":"back","average":{"1min":0.70699999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"min":{"1min":0.48399999999999999,"5min":0.434,"15min":0.434},"max":{"1min":1.0489999999999999,"5min":1.0489999999999999,"15min":1.0489999999999999},"last":0.86099999999999999},{"interface":"front","average":{"1min":0.68899999999999995,"5min":0.72499999999999998,"15min":0.73999999999999999},"min":{"1min":0.47599999999999998,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":0.93200000000000005,"5min":1.099,"15min":1.099},"last":0.90400000000000003}]},{"osd":7,"last update":"Tue Nov 28 20:01:59 2023","interfaces":[{"interface":"back","average":{"1min":0.73599999999999999,"5min":0.77300000000000002,"15min":0.78200000000000003},"min":{"1min":0.48899999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":1.022,"5min":1.236,"15min":1.236},"last":0.96099999999999997},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.78300000000000003,"15min":0.79500000000000004},"min":{"1min":0.51100000000000001,"5min":0.505,"15min":0.505},"max":{"1min":1.1000000000000001,"5min":1.1000000000000001,"15min":1.1000000000000001},"last":0.94499999999999995}]}]},{"osd":4,"up_from":13,"seq":55834574890,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32136,"kb_used_data":952,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339704,"statfs":{"total":96636764160,"available":96603856896,"internally_reserved":0,"allocated":974848,"data_stored":455836,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 20:01:58 2023","interfaces":[{"interface":"back","average":{"1min":0.70799999999999996,"5min":0.69399999999999995,"15min":0.70499999999999996},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":1.107,"5min":1.107,"15min":1.107},"last":0.55600000000000005},{"interface":"front","average":{"1min":0.63200000000000001,"5min":0.68300000000000005,"15min":0.70299999999999996},"min":{"1min":0.42799999999999999,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":1.024,"5min":1.163,"15min":1.163},"last":0.53000000000000003}]},{"osd":1,"last update":"Tue Nov 28 20:01:58 2023","interfaces":[{"interface":"back","average":{"1min":0.64400000000000002,"5min":0.71199999999999997,"15min":0.746},"min":{"1min":0.432,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.93799999999999994,"5min":1.111,"15min":1.111},"last":0.41499999999999998},{"interface":"front","average":{"1min":0.77600000000000002,"5min":0.78000000000000003,"15min":0.80200000000000005},"min":{"1min":0.629,"5min":0.443,"15min":0.443},"max":{"1min":1.0640000000000001,"5min":1.238,"15min":1.238},"last":0.60299999999999998}]},{"osd":2,"last update":"Tue Nov 28 20:01:58 2023","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.751,"15min":0.77200000000000002},"min":{"1min":0.48599999999999999,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":1.026,"5min":1.0669999999999999,"15min":1.0669999999999999},"last":0.73699999999999999},{"interface":"front","average":{"1min":0.754,"5min":0.77400000000000002,"15min":0.80200000000000005},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":1.1359999999999999,"5min":1.1359999999999999,"15min":1.1359999999999999},"last":0.71699999999999997}]},{"osd":3,"last update":"Tue Nov 28 20:01:58 2023","interfaces":[{"interface":"back","average":{"1min":0.69199999999999995,"5min":0.74399999999999999,"15min":0.78200000000000003},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":0.97999999999999998,"5min":1.202,"15min":1.202},"last":0.57899999999999996},{"interface":"front","average":{"1min":0.74199999999999999,"5min":0.76100000000000001,"15min":0.78400000000000003},"min":{"1min":0.52800000000000002,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":1.0669999999999999,"5min":1.0669999999999999,"15min":1.0669999999999999},"last":0.66400000000000003}]},{"osd":5,"last update":"Tue Nov 28 20:01:58 2023","interfaces":[{"interface":"back","average":{"1min":0.68600000000000005,"5min":0.69499999999999995,"15min":0.71399999999999997},"min":{"1min":0.41199999999999998,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.89600000000000002,"5min":0.95899999999999996,"15min":0.95899999999999996},"last":0.44400000000000001},{"interface":"front","average":{"1min":0.65600000000000003,"5min":0.68400000000000005,"15min":0.70399999999999996},"min":{"1min":0.435,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.90500000000000003,"5min":1.034,"15min":1.034},"last":0.625}]},{"osd":6,"last update":"Tue Nov 28 20:01:58 2023","interfaces":[{"interface":"back","average":{"1min":0.64500000000000002,"5min":0.69099999999999995,"15min":0.71999999999999997},"min":{"1min":0.45300000000000001,"5min":0.438,"15min":0.438},"max":{"1min":0.85299999999999998,"5min":1.0309999999999999,"15min":1.0309999999999999},"last":0.78900000000000003},{"interface":"front","average":{"1min":0.76300000000000001,"5min":0.76600000000000001,"15min":0.77800000000000002},"min":{"1min":0.55400000000000005,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":0.93999999999999995,"5min":1.002,"15min":1.002},"last":0.64500000000000002}]},{"osd":7,"last update":"Tue Nov 28 20:01:58 2023","interfaces":[{"interface":"back","average":{"1min":0.72699999999999998,"5min":0.75900000000000001,"15min":0.77800000000000002},"min":{"1min":0.57399999999999995,"5min":0.495,"15min":0.495},"max":{"1min":1.089,"5min":1.089,"15min":1.089},"last":0.69399999999999995},{"interface":"front","average":{"1min":0.81599999999999995,"5min":0.83699999999999997,"15min":0.85899999999999999},"min":{"1min":0.621,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":1.042,"5min":1.1459999999999999,"15min":1.1459999999999999},"last":0.76700000000000002}]}]},{"osd":3,"up_from":13,"seq":55834574891,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32136,"kb_used_data":952,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339704,"statfs":{"total":96636764160,"available":96603856896,"internally_reserved":0,"allocated":974848,"data_stored":455836,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 20:01:56 2023","interfaces":[{"interface":"back","average":{"1min":0.44900000000000001,"5min":0.441,"15min":0.44500000000000001},"min":{"1min":0.26300000000000001,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":1.7130000000000001,"5min":1.7130000000000001,"15min":1.7130000000000001},"last":0.38},{"interface":"front","average":{"1min":0.51400000000000001,"5min":0.46600000000000003,"15min":0.47099999999999997},"min":{"1min":0.27100000000000002,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":3.0630000000000002,"5min":3.0630000000000002,"15min":3.0630000000000002},"last":0.48799999999999999}]},{"osd":1,"last update":"Tue Nov 28 20:01:56 2023","interfaces":[{"interface":"back","average":{"1min":0.44600000000000001,"5min":0.45800000000000002,"15min":0.47399999999999998},"min":{"1min":0.317,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.89200000000000002,"5min":0.89200000000000002,"15min":0.89200000000000002},"last":0.50600000000000001},{"interface":"front","average":{"1min":0.65600000000000003,"5min":0.52200000000000002,"15min":0.51000000000000001},"min":{"1min":0.34200000000000003,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":5.8920000000000003,"5min":5.8920000000000003,"15min":5.8920000000000003},"last":0.33800000000000002}]},{"osd":2,"last update":"Tue Nov 28 20:01:56 2023","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.54800000000000004,"15min":0.53800000000000003},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":4.6390000000000002,"5min":4.6390000000000002,"15min":4.6390000000000002},"last":0.36199999999999999},{"interface":"front","average":{"1min":0.95099999999999996,"5min":0.63900000000000001,"15min":0.60299999999999998},"min":{"1min":0.40899999999999997,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":11.593,"5min":11.593,"15min":11.593},"last":0.53500000000000003}]},{"osd":4,"last update":"Tue Nov 28 20:01:56 2023","interfaces":[{"interface":"back","average":{"1min":0.91100000000000003,"5min":0.79400000000000004,"15min":0.77200000000000002},"min":{"1min":0.46600000000000003,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":5.5549999999999997,"5min":5.5549999999999997,"15min":5.5549999999999997},"last":0.91200000000000003},{"interface":"front","average":{"1min":1.179,"5min":0.879,"15min":0.82799999999999996},"min":{"1min":0.60999999999999999,"5min":0.503,"15min":0.503},"max":{"1min":11.747,"5min":11.747,"15min":11.747},"last":0.93300000000000005}]},{"osd":5,"last update":"Tue Nov 28 20:01:56 2023","interfaces":[{"interface":"back","average":{"1min":1.1040000000000001,"5min":0.85699999999999998,"15min":0.81899999999999995},"min":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":11.705,"5min":11.705,"15min":11.705},"last":0.78700000000000003},{"interface":"front","average":{"1min":0.70399999999999996,"5min":0.77100000000000002,"15min":0.79200000000000004},"min":{"1min":0.51200000000000001,"5min":0.495,"15min":0.495},"max":{"1min":1.0580000000000001,"5min":1.3100000000000001,"15min":1.3100000000000001},"last":0.88500000000000001}]},{"osd":6,"last update":"Tue Nov 28 20:01:56 2023","interfaces":[{"interface":"back","average":{"1min":0.748,"5min":0.81899999999999995,"15min":0.83499999999999996},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":1.6639999999999999,"5min":1.6639999999999999,"15min":1.6639999999999999},"last":0.83199999999999996},{"interface":"front","average":{"1min":0.84499999999999997,"5min":0.80400000000000005,"15min":0.76700000000000002},"min":{"1min":0.52900000000000003,"5min":0.495,"15min":0.495},"max":{"1min":3.1459999999999999,"5min":4.0679999999999996,"15min":4.0679999999999996},"last":0.95299999999999996}]},{"osd":7,"last update":"Tue Nov 28 20:01:56 2023","interfaces":[{"interface":"back","average":{"1min":0.96199999999999997,"5min":0.89600000000000002,"15min":0.86499999999999999},"min":{"1min":0.52100000000000002,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":6.6619999999999999,"5min":6.6619999999999999,"15min":6.6619999999999999},"last":1.016},{"interface":"front","average":{"1min":1.141,"5min":0.92300000000000004,"15min":0.90100000000000002},"min":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":11.782,"5min":11.782,"15min":11.782},"last":0.89800000000000002}]}]},{"osd":2,"up_from":13,"seq":55834574889,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27976,"kb_used_data":952,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343864,"statfs":{"total":96636764160,"available":96608116736,"internally_reserved":0,"allocated":974848,"data_stored":455836,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 20:01:57 2023","interfaces":[{"interface":"back","average":{"1min":0.39600000000000002,"5min":0.438,"15min":0.45000000000000001},"min":{"1min":0.28899999999999998,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.60399999999999998,"5min":0.74099999999999999,"15min":0.74099999999999999},"last":0.255},{"interface":"front","average":{"1min":0.435,"5min":0.46100000000000002,"15min":0.47499999999999998},"min":{"1min":0.30199999999999999,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.59599999999999997,"5min":0.67700000000000005,"15min":0.67700000000000005},"last":0.29499999999999998}]},{"osd":1,"last update":"Tue Nov 28 20:01:57 2023","interfaces":[{"interface":"back","average":{"1min":0.47699999999999998,"5min":0.48999999999999999,"15min":0.50600000000000001},"min":{"1min":0.377,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.64500000000000002,"5min":1.0389999999999999,"15min":1.0389999999999999},"last":0.41499999999999998},{"interface":"front","average":{"1min":0.45100000000000001,"5min":0.47999999999999998,"15min":0.496},"min":{"1min":0.33800000000000002,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.58999999999999997,"5min":0.70999999999999996,"15min":0.70999999999999996},"last":0.45200000000000001}]},{"osd":3,"last update":"Tue Nov 28 20:01:57 2023","interfaces":[{"interface":"back","average":{"1min":0.45700000000000002,"5min":0.46300000000000002,"15min":0.46899999999999997},"min":{"1min":0.36899999999999999,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.60299999999999998,"5min":0.629,"15min":0.629},"last":0.32200000000000001},{"interface":"front","average":{"1min":0.52300000000000002,"5min":0.55900000000000005,"15min":0.58099999999999996},"min":{"1min":0.41599999999999998,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.58899999999999997,"5min":0.98499999999999999,"15min":0.98499999999999999},"last":0.47199999999999998}]},{"osd":4,"last update":"Tue Nov 28 20:01:57 2023","interfaces":[{"interface":"back","average":{"1min":0.69399999999999995,"5min":0.80300000000000005,"15min":0.84199999999999997},"min":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":0.86899999999999999,"5min":1.139,"15min":1.139},"last":0.60199999999999998},{"interface":"front","average":{"1min":0.70199999999999996,"5min":0.79600000000000004,"15min":0.83399999999999996},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":1.008,"5min":1.238,"15min":1.238},"last":0.68600000000000005}]},{"osd":5,"last update":"Tue Nov 28 20:01:57 2023","interfaces":[{"interface":"back","average":{"1min":0.70799999999999996,"5min":0.81200000000000006,"15min":0.85999999999999999},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":1.0389999999999999,"5min":1.6180000000000001,"15min":1.6180000000000001},"last":0.55300000000000005},{"interface":"front","average":{"1min":0.70699999999999996,"5min":0.78400000000000003,"15min":0.81799999999999995},"min":{"1min":0.51800000000000002,"5min":0.496,"15min":0.496},"max":{"1min":1.0149999999999999,"5min":1.339,"15min":1.339},"last":0.53300000000000003}]},{"osd":6,"last update":"Tue Nov 28 20:01:57 2023","interfaces":[{"interface":"back","average":{"1min":0.71399999999999997,"5min":0.77300000000000002,"15min":0.79500000000000004},"min":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":1.0589999999999999,"5min":1.1839999999999999,"15min":1.1839999999999999},"last":0.57099999999999995},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.80300000000000005,"15min":0.84199999999999997},"min":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":0.98699999999999999,"5min":1.099,"15min":1.099},"last":0.70899999999999996}]},{"osd":7,"last update":"Tue Nov 28 20:01:57 2023","interfaces":[{"interface":"back","average":{"1min":0.69599999999999995,"5min":0.82199999999999995,"15min":0.86699999999999999},"min":{"1min":0.53300000000000003,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":0.94699999999999995,"5min":1.4590000000000001,"15min":1.4590000000000001},"last":0.66200000000000003},{"interface":"front","average":{"1min":0.73199999999999998,"5min":0.80900000000000005,"15min":0.84699999999999998},"min":{"1min":0.55200000000000005,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":1.0760000000000001,"5min":1.387,"15min":1.387},"last":0.76200000000000001}]}]},{"osd":1,"up_from":13,"seq":55834574891,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32136,"kb_used_data":952,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339704,"statfs":{"total":96636764160,"available":96603856896,"internally_reserved":0,"allocated":974848,"data_stored":455836,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 20:02:00 2023","interfaces":[{"interface":"back","average":{"1min":0.38700000000000001,"5min":0.54600000000000004,"15min":0.62},"min":{"1min":0.249,"5min":0.249,"15min":0.249},"max":{"1min":0.60699999999999998,"5min":3.8740000000000001,"15min":3.8740000000000001},"last":0.39400000000000002},{"interface":"front","average":{"1min":0.42099999999999999,"5min":0.51000000000000001,"15min":0.55100000000000005},"min":{"1min":0.32300000000000001,"5min":0.25,"15min":0.25},"max":{"1min":0.60399999999999998,"5min":2.0760000000000001,"15min":2.0760000000000001},"last":0.495}]},{"osd":2,"last update":"Tue Nov 28 20:02:00 2023","interfaces":[{"interface":"back","average":{"1min":0.41399999999999998,"5min":0.56000000000000005,"15min":0.626},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.70799999999999996,"5min":3.7320000000000002,"15min":3.7320000000000002},"last":0.377},{"interface":"front","average":{"1min":0.46899999999999997,"5min":0.63400000000000001,"15min":0.71799999999999997},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.67000000000000004,"5min":3.9089999999999998,"15min":3.9089999999999998},"last":0.436}]},{"osd":3,"last update":"Tue Nov 28 20:02:00 2023","interfaces":[{"interface":"back","average":{"1min":0.52200000000000002,"5min":0.61799999999999999,"15min":0.66000000000000003},"min":{"1min":0.436,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.70799999999999996,"5min":1.6399999999999999,"15min":1.6399999999999999},"last":0.50800000000000001},{"interface":"front","average":{"1min":0.45500000000000002,"5min":0.61599999999999999,"15min":0.67400000000000004},"min":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.625,"5min":2.5270000000000001,"15min":2.5270000000000001},"last":0.52100000000000002}]},{"osd":4,"last update":"Tue Nov 28 20:02:00 2023","interfaces":[{"interface":"back","average":{"1min":0.69799999999999995,"5min":0.81699999999999995,"15min":0.86899999999999999},"min":{"1min":0.42199999999999999,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.91400000000000003,"5min":3.1659999999999999,"15min":3.1659999999999999},"last":0.61899999999999999},{"interface":"front","average":{"1min":0.69699999999999995,"5min":0.84399999999999997,"15min":0.91200000000000003},"min":{"1min":0.52300000000000002,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.94299999999999995,"5min":3.7959999999999998,"15min":3.7959999999999998},"last":0.69899999999999995}]},{"osd":5,"last update":"Tue Nov 28 20:02:00 2023","interfaces":[{"interface":"back","average":{"1min":0.71399999999999997,"5min":0.875,"15min":0.95099999999999996},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":1.004,"5min":4.1479999999999997,"15min":4.1479999999999997},"last":0.60999999999999999},{"interface":"front","average":{"1min":0.69799999999999995,"5min":0.82599999999999996,"15min":0.88200000000000001},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":0.87,"5min":3.5569999999999999,"15min":3.5569999999999999},"last":0.65200000000000002}]},{"osd":6,"last update":"Tue Nov 28 20:02:00 2023","interfaces":[{"interface":"back","average":{"1min":0.72399999999999998,"5min":0.88800000000000001,"15min":0.95699999999999996},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":0.94499999999999995,"5min":2.863,"15min":2.863},"last":0.63200000000000001},{"interface":"front","average":{"1min":0.76800000000000002,"5min":0.89800000000000002,"15min":0.95399999999999996},"min":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":0.97999999999999998,"5min":3.371,"15min":3.371},"last":0.71799999999999997}]},{"osd":7,"last update":"Tue Nov 28 20:02:00 2023","interfaces":[{"interface":"back","average":{"1min":0.70299999999999996,"5min":0.89100000000000001,"15min":0.97199999999999998},"min":{"1min":0.53100000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":0.93600000000000005,"5min":3.8439999999999999,"15min":3.8439999999999999},"last":0.76200000000000001},{"interface":"front","average":{"1min":0.68799999999999994,"5min":0.90500000000000003,"15min":0.99299999999999999},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.95899999999999996,"5min":3.9689999999999999,"15min":3.9689999999999999},"last":0.72499999999999998}]}]},{"osd":0,"up_from":13,"seq":55834574890,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32196,"kb_used_data":1016,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339644,"statfs":{"total":96636764160,"available":96603795456,"internally_reserved":0,"allocated":1040384,"data_stored":1046204,"data_compressed":33374,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Nov 28 20:01:57 2023","interfaces":[{"interface":"back","average":{"1min":0.38700000000000001,"5min":0.57399999999999995,"15min":0.65100000000000002},"min":{"1min":0.24099999999999999,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":0.68400000000000005,"5min":4.883,"15min":4.883},"last":0.35299999999999998},{"interface":"front","average":{"1min":0.43099999999999999,"5min":0.70099999999999996,"15min":0.81899999999999995},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.66800000000000004,"5min":8.0800000000000001,"15min":8.0800000000000001},"last":0.40500000000000003}]},{"osd":2,"last update":"Tue Nov 28 20:01:57 2023","interfaces":[{"interface":"back","average":{"1min":0.50800000000000001,"5min":0.77400000000000002,"15min":0.90700000000000003},"min":{"1min":0.312,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.85599999999999998,"5min":8.1029999999999998,"15min":8.1029999999999998},"last":0.39200000000000002},{"interface":"front","average":{"1min":0.53300000000000003,"5min":0.79400000000000004,"15min":0.92200000000000004},"min":{"1min":0.40600000000000003,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.748,"5min":8.1310000000000002,"15min":8.1310000000000002},"last":0.48999999999999999}]},{"osd":3,"last update":"Tue Nov 28 20:01:57 2023","interfaces":[{"interface":"back","average":{"1min":0.47299999999999998,"5min":0.628,"15min":0.70699999999999996},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.873,"5min":4.3949999999999996,"15min":4.3949999999999996},"last":0.42399999999999999},{"interface":"front","average":{"1min":0.497,"5min":0.65100000000000002,"15min":0.72099999999999997},"min":{"1min":0.37,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.89200000000000002,"5min":4.3470000000000004,"15min":4.3470000000000004},"last":0.45700000000000002}]},{"osd":4,"last update":"Tue Nov 28 20:01:57 2023","interfaces":[{"interface":"back","average":{"1min":0.72799999999999998,"5min":0.92000000000000004,"15min":1.0069999999999999},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":1.038,"5min":4.6360000000000001,"15min":4.6360000000000001},"last":0.76200000000000001},{"interface":"front","average":{"1min":0.76800000000000002,"5min":0.93400000000000005,"15min":1.0129999999999999},"min":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":1.0820000000000001,"5min":4.4710000000000001,"15min":4.4710000000000001},"last":0.69099999999999995}]},{"osd":5,"last update":"Tue Nov 28 20:01:57 2023","interfaces":[{"interface":"back","average":{"1min":0.72599999999999998,"5min":0.93200000000000005,"15min":1.02},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":0.97599999999999998,"5min":4.6120000000000001,"15min":4.6120000000000001},"last":0.75},{"interface":"front","average":{"1min":0.78600000000000003,"5min":0.93600000000000005,"15min":1.0129999999999999},"min":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.1319999999999999,"5min":4.5449999999999999,"15min":4.5449999999999999},"last":0.82699999999999996}]},{"osd":6,"last update":"Tue Nov 28 20:01:57 2023","interfaces":[{"interface":"back","average":{"1min":0.755,"5min":0.94499999999999995,"15min":1.034},"min":{"1min":0.53600000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":1.0580000000000001,"5min":4.657,"15min":4.657},"last":0.73999999999999999},{"interface":"front","average":{"1min":0.75700000000000001,"5min":0.95799999999999996,"15min":1.05},"min":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":1.0049999999999999,"5min":4.5259999999999998,"15min":4.5259999999999998},"last":0.77400000000000002}]},{"osd":7,"last update":"Tue Nov 28 20:01:57 2023","interfaces":[{"interface":"back","average":{"1min":0.73799999999999999,"5min":0.95199999999999996,"15min":1.0509999999999999},"min":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":1.081,"5min":4.7320000000000002,"15min":4.7320000000000002},"last":0.72499999999999998},{"interface":"front","average":{"1min":0.76300000000000001,"5min":0.93100000000000005,"15min":1.0069999999999999},"min":{"1min":0.58699999999999997,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":1.099,"5min":4.4939999999999998,"15min":4.4939999999999998},"last":0.80200000000000005}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33374,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33374,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-28T20:02:16.870 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-28T20:02:17.016 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:17.012+0000 7f7fd1bb8640 1 Processor -- start 2023-11-28T20:02:17.016 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:17.012+0000 7f7fd1bb8640 1 -- start start 2023-11-28T20:02:17.018 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:17.012+0000 7f7fd1bb8640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f7fcc06d2b0 0x7f7fcc06d690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:17.018 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:17.012+0000 7f7fd1bb8640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f7fcc0c3b80 0x7f7fcc0c5300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:17.018 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:17.012+0000 7f7fd1bb8640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7fcc06bb80 con 0x7f7fcc06c020 2023-11-28T20:02:17.018 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:17.012+0000 7f7fd1bb8640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7fcc0c5840 con 0x7f7fcc0c3b80 2023-11-28T20:02:17.018 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:17.012+0000 7f7fd1bb8640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7fcc1515c0 con 0x7f7fcc06d2b0 2023-11-28T20:02:17.018 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:17.012+0000 7f7fcaffd640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f7fcc0c3b80 0x7f7fcc0c5300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:02:17.018 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:17.012+0000 7f7fcaffd640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f7fcc0c3b80 0x7f7fcc0c5300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:54240/0 (socket says 172.21.15.78:54240) 2023-11-28T20:02:17.018 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:17.012+0000 7f7fcaffd640 1 -- 172.21.15.78:0/3709272484 learned_addr learned my addr 172.21.15.78:0/3709272484 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T20:02:17.018 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:17.012+0000 7f7fcb7fe640 1 --2- 172.21.15.78:0/3709272484 >> v2:172.21.15.179:3300/0 conn(0x7f7fcc06d2b0 0x7f7fcc06d690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:02:17.018 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:17.012+0000 7f7fcaffd640 1 -- 172.21.15.78:0/3709272484 >> v2:172.21.15.179:3300/0 conn(0x7f7fcc06d2b0 msgr2=0x7f7fcc06d690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:02:17.019 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:17.012+0000 7f7fcaffd640 1 --2- 172.21.15.78:0/3709272484 >> v2:172.21.15.179:3300/0 conn(0x7f7fcc06d2b0 0x7f7fcc06d690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:17.019 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:17.012+0000 7f7fcaffd640 1 -- 172.21.15.78:0/3709272484 >> v1:172.21.15.179:6789/0 conn(0x7f7fcc06c020 legacy=0x7f7fcc06c4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:02:17.019 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:17.012+0000 7f7fcaffd640 1 -- 172.21.15.78:0/3709272484 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7fcc1518a0 con 0x7f7fcc0c3b80 2023-11-28T20:02:17.020 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:17.016+0000 7f7fcaffd640 1 --2- 172.21.15.78:0/3709272484 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7fcc0c3b80 0x7f7fcc0c5300 secure :-1 s=READY pgs=911 cs=0 l=1 rev1=1 crypto rx=0x7f7fcc0c2130 tx=0x7f7fc001c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b8f430c0eb8ba5b2 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:02:17.021 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:17.016+0000 7f7fca7fc640 1 -- 172.21.15.78:0/3709272484 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fc00aa5f0 con 0x7f7fcc0c3b80 2023-11-28T20:02:17.021 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:17.016+0000 7f7fca7fc640 1 -- 172.21.15.78:0/3709272484 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7fc00aa750 con 0x7f7fcc0c3b80 2023-11-28T20:02:17.021 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:17.016+0000 7f7fca7fc640 1 -- 172.21.15.78:0/3709272484 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fc00aaae0 con 0x7f7fcc0c3b80 2023-11-28T20:02:17.022 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:17.016+0000 7f7fd1bb8640 1 -- 172.21.15.78:0/3709272484 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7fcc0c3b80 msgr2=0x7f7fcc0c5300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:02:17.022 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:17.016+0000 7f7fd1bb8640 1 --2- 172.21.15.78:0/3709272484 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7fcc0c3b80 0x7f7fcc0c5300 secure :-1 s=READY pgs=911 cs=0 l=1 rev1=1 crypto rx=0x7f7fcc0c2130 tx=0x7f7fc001c490 comp rx=0 tx=0).stop 2023-11-28T20:02:17.022 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:17.016+0000 7f7fd1bb8640 1 -- 172.21.15.78:0/3709272484 shutdown_connections 2023-11-28T20:02:17.022 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:17.016+0000 7f7fd1bb8640 1 --2- 172.21.15.78:0/3709272484 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7fcc0c3b80 0x7f7fcc0c5300 unknown :-1 s=CLOSED pgs=911 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:17.023 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:17.016+0000 7f7fd1bb8640 1 --2- 172.21.15.78:0/3709272484 >> v2:172.21.15.179:3300/0 conn(0x7f7fcc06d2b0 0x7f7fcc06d690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:17.023 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:17.016+0000 7f7fd1bb8640 1 -- 172.21.15.78:0/3709272484 >> 172.21.15.78:0/3709272484 conn(0x7f7fcc0a7810 msgr2=0x7f7fcc0a7c20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:02:17.023 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:17.016+0000 7f7fd1bb8640 1 -- 172.21.15.78:0/3709272484 shutdown_connections 2023-11-28T20:02:17.023 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:17.016+0000 7f7fd1bb8640 1 -- 172.21.15.78:0/3709272484 wait complete. 2023-11-28T20:02:17.023 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:17.020+0000 7f7fd1bb8640 1 Processor -- start 2023-11-28T20:02:17.024 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:17.020+0000 7f7fd1bb8640 1 -- start start 2023-11-28T20:02:17.026 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:17.020+0000 7f7fd1bb8640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7fcc06c020 0x7f7fcc159950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:17.026 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:17.020+0000 7f7fd1bb8640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7fcc06d2b0 0x7f7fcc159e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:17.026 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:17.020+0000 7f7fd1bb8640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7fcc0c3b80 0x7f7fcc1f02c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:17.026 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:17.020+0000 7f7fd1bb8640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7fcc1509a0 con 0x7f7fcc06c020 2023-11-28T20:02:17.026 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:17.020+0000 7f7fd1bb8640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7fcc156dc0 con 0x7f7fcc0c3b80 2023-11-28T20:02:17.026 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:17.020+0000 7f7fd1bb8640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7fcc14fdd0 con 0x7f7fcc06d2b0 2023-11-28T20:02:17.027 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:17.020+0000 7f7fcb7fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7fcc06c020 0x7f7fcc159950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:02:17.027 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:17.020+0000 7f7fcb7fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7fcc06c020 0x7f7fcc159950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:54242/0 (socket says 172.21.15.78:54242) 2023-11-28T20:02:17.027 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:17.020+0000 7f7fcb7fe640 1 -- 172.21.15.78:0/247336999 learned_addr learned my addr 172.21.15.78:0/247336999 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T20:02:17.027 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:17.020+0000 7f7fcaffd640 1 --2- 172.21.15.78:0/247336999 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7fcc06d2b0 0x7f7fcc159e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:02:17.027 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:17.020+0000 7f7fcbfff640 1 --2- 172.21.15.78:0/247336999 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7fcc0c3b80 0x7f7fcc1f02c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:02:17.027 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:17.020+0000 7f7fcb7fe640 1 -- 172.21.15.78:0/247336999 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7fcc06d2b0 msgr2=0x7f7fcc159e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:02:17.027 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:17.020+0000 7f7fcb7fe640 1 --2- 172.21.15.78:0/247336999 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7fcc06d2b0 0x7f7fcc159e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:17.027 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:17.020+0000 7f7fcb7fe640 1 -- 172.21.15.78:0/247336999 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7fcc0c3b80 msgr2=0x7f7fcc1f02c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:02:17.027 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:17.020+0000 7f7fcb7fe640 1 --2- 172.21.15.78:0/247336999 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7fcc0c3b80 0x7f7fcc1f02c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:17.028 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:17.020+0000 7f7fcb7fe640 1 -- 172.21.15.78:0/247336999 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7fc00094d0 con 0x7f7fcc06c020 2023-11-28T20:02:17.028 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:17.020+0000 7f7fcaffd640 1 --2- 172.21.15.78:0/247336999 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7fcc06d2b0 0x7f7fcc159e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T20:02:17.028 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:17.020+0000 7f7fcbfff640 1 --2- 172.21.15.78:0/247336999 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7fcc0c3b80 0x7f7fcc1f02c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T20:02:17.028 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:17.020+0000 7f7fcb7fe640 1 --2- 172.21.15.78:0/247336999 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7fcc06c020 0x7f7fcc159950 secure :-1 s=READY pgs=912 cs=0 l=1 rev1=1 crypto rx=0x7f7fbc00d800 tx=0x7f7fbc00dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:02:17.028 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:17.020+0000 7f7fb3fff640 1 -- 172.21.15.78:0/247336999 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fbc00b6c0 con 0x7f7fcc06c020 2023-11-28T20:02:17.028 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:17.020+0000 7f7fb3fff640 1 -- 172.21.15.78:0/247336999 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7fbc00b820 con 0x7f7fcc06c020 2023-11-28T20:02:17.028 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:17.020+0000 7f7fb3fff640 1 -- 172.21.15.78:0/247336999 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fbc00bb90 con 0x7f7fcc06c020 2023-11-28T20:02:17.029 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:17.020+0000 7f7fd1bb8640 1 -- 172.21.15.78:0/247336999 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7fcc14ef80 con 0x7f7fcc06c020 2023-11-28T20:02:17.029 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:17.020+0000 7f7fd1bb8640 1 -- 172.21.15.78:0/247336999 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7fcc150350 con 0x7f7fcc06c020 2023-11-28T20:02:17.030 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:17.020+0000 7f7fd1bb8640 1 -- 172.21.15.78:0/247336999 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7fcc067630 con 0x7f7fcc06c020 2023-11-28T20:02:17.030 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:17.024+0000 7f7fb3fff640 1 -- 172.21.15.78:0/247336999 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f7fbc00bcf0 con 0x7f7fcc06c020 2023-11-28T20:02:17.030 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:17.024+0000 7f7fb3fff640 1 --2- 172.21.15.78:0/247336999 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f7fb80664a0 0x7f7fb8068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:17.030 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:17.024+0000 7f7fb3fff640 1 -- 172.21.15.78:0/247336999 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f7fbc0844f0 con 0x7f7fcc06c020 2023-11-28T20:02:17.030 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:17.024+0000 7f7fcaffd640 1 --2- 172.21.15.78:0/247336999 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f7fb80664a0 0x7f7fb8068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:02:17.030 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:17.024+0000 7f7fcaffd640 1 --2- 172.21.15.78:0/247336999 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f7fb80664a0 0x7f7fb8068960 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f7fc00ae000 tx=0x7f7fc00a7000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:02:17.033 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:17.028+0000 7f7fb3fff640 1 -- 172.21.15.78:0/247336999 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f7fbc051820 con 0x7f7fcc06c020 2023-11-28T20:02:17.180 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:17.176+0000 7f7fd1bb8640 1 -- 172.21.15.78:0/247336999 --> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f7fcc14ee00 con 0x7f7fb80664a0 2023-11-28T20:02:17.187 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:17.184+0000 7f7fb3fff640 1 -- 172.21.15.78:0/247336999 <== mgr.4106 v2:172.21.15.78:6832/2935380957 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+289179 (secure 0 0 0) 0x7f7fc00b8070 con 0x7f7fb80664a0 2023-11-28T20:02:17.191 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-11-28T20:02:17.193 INFO:teuthology.orchestra.run.smithi078.stderr:dumped all 2023-11-28T20:02:17.194 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:17.188+0000 7f7fd1bb8640 1 -- 172.21.15.78:0/247336999 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f7fb80664a0 msgr2=0x7f7fb8068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:02:17.194 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:17.188+0000 7f7fd1bb8640 1 --2- 172.21.15.78:0/247336999 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f7fb80664a0 0x7f7fb8068960 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f7fc00ae000 tx=0x7f7fc00a7000 comp rx=0 tx=0).stop 2023-11-28T20:02:17.194 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:17.188+0000 7f7fd1bb8640 1 -- 172.21.15.78:0/247336999 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7fcc06c020 msgr2=0x7f7fcc159950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:02:17.194 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:17.188+0000 7f7fd1bb8640 1 --2- 172.21.15.78:0/247336999 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7fcc06c020 0x7f7fcc159950 secure :-1 s=READY pgs=912 cs=0 l=1 rev1=1 crypto rx=0x7f7fbc00d800 tx=0x7f7fbc00dcc0 comp rx=0 tx=0).stop 2023-11-28T20:02:17.194 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:17.188+0000 7f7fd1bb8640 1 -- 172.21.15.78:0/247336999 shutdown_connections 2023-11-28T20:02:17.195 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:17.188+0000 7f7fd1bb8640 1 --2- 172.21.15.78:0/247336999 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f7fb80664a0 0x7f7fb8068960 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:17.195 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:17.188+0000 7f7fd1bb8640 1 --2- 172.21.15.78:0/247336999 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7fcc06d2b0 0x7f7fcc159e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:17.195 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:17.188+0000 7f7fd1bb8640 1 --2- 172.21.15.78:0/247336999 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7fcc0c3b80 0x7f7fcc1f02c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:17.195 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:17.188+0000 7f7fd1bb8640 1 --2- 172.21.15.78:0/247336999 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7fcc06c020 0x7f7fcc159950 unknown :-1 s=CLOSED pgs=912 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:17.195 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:17.188+0000 7f7fd1bb8640 1 -- 172.21.15.78:0/247336999 >> 172.21.15.78:0/247336999 conn(0x7f7fcc0a7810 msgr2=0x7f7fcc06d690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:02:17.195 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:17.188+0000 7f7fd1bb8640 1 -- 172.21.15.78:0/247336999 shutdown_connections 2023-11-28T20:02:17.195 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:17.188+0000 7f7fd1bb8640 1 -- 172.21.15.78:0/247336999 wait complete. 2023-11-28T20:02:17.211 INFO:teuthology.orchestra.run.smithi078.stdout:{"pg_ready":true,"pg_map":{"version":176,"stamp":"2023-11-28T20:02:15.992895+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":187,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":257452,"kb_used_data":8000,"kb_used_omap":12,"kb_used_meta":249331,"kb_avail":754717268,"statfs":{"total":773094113280,"available":772830482432,"internally_reserved":0,"allocated":8192000,"data_stored":4941964,"data_compressed":66748,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":12752,"internal_metadata":255315504},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":52,"apply_latency_ms":52,"commit_latency_ns":52000000,"apply_latency_ns":52000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.001513"},"pg_stats":[{"pgid":"14.3f","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-28T20:02:09.920561+0000","last_change":"2023-11-28T20:02:08.304755+0000","last_active":"2023-11-28T20:02:09.920561+0000","last_peered":"2023-11-28T20:02:09.920561+0000","last_clean":"2023-11-28T20:02:09.920561+0000","last_became_active":"2023-11-28T20:02:08.304434+0000","last_became_peered":"2023-11-28T20:02:08.304434+0000","last_unstale":"2023-11-28T20:02:09.920561+0000","last_undegraded":"2023-11-28T20:02:09.920561+0000","last_fullsized":"2023-11-28T20:02:09.920561+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_clean_scrub_stamp":"2023-11-28T20:02:07.264604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:58:51.867372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.3e","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-28T20:02:09.296283+0000","last_change":"2023-11-28T20:02:08.296680+0000","last_active":"2023-11-28T20:02:09.296283+0000","last_peered":"2023-11-28T20:02:09.296283+0000","last_clean":"2023-11-28T20:02:09.296283+0000","last_became_active":"2023-11-28T20:02:08.296004+0000","last_became_peered":"2023-11-28T20:02:08.296004+0000","last_unstale":"2023-11-28T20:02:09.296283+0000","last_undegraded":"2023-11-28T20:02:09.296283+0000","last_fullsized":"2023-11-28T20:02:09.296283+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_clean_scrub_stamp":"2023-11-28T20:02:07.264604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:10:35.205323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.3d","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-28T20:02:09.920278+0000","last_change":"2023-11-28T20:02:08.308225+0000","last_active":"2023-11-28T20:02:09.920278+0000","last_peered":"2023-11-28T20:02:09.920278+0000","last_clean":"2023-11-28T20:02:09.920278+0000","last_became_active":"2023-11-28T20:02:08.307962+0000","last_became_peered":"2023-11-28T20:02:08.307962+0000","last_unstale":"2023-11-28T20:02:09.920278+0000","last_undegraded":"2023-11-28T20:02:09.920278+0000","last_fullsized":"2023-11-28T20:02:09.920278+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_clean_scrub_stamp":"2023-11-28T20:02:07.264604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:41:07.273185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.3c","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-28T20:02:09.297390+0000","last_change":"2023-11-28T20:02:08.315019+0000","last_active":"2023-11-28T20:02:09.297390+0000","last_peered":"2023-11-28T20:02:09.297390+0000","last_clean":"2023-11-28T20:02:09.297390+0000","last_became_active":"2023-11-28T20:02:08.314731+0000","last_became_peered":"2023-11-28T20:02:08.314731+0000","last_unstale":"2023-11-28T20:02:09.297390+0000","last_undegraded":"2023-11-28T20:02:09.297390+0000","last_fullsized":"2023-11-28T20:02:09.297390+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_clean_scrub_stamp":"2023-11-28T20:02:07.264604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:42:00.299852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.3b","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-28T20:02:09.296060+0000","last_change":"2023-11-28T20:02:08.301524+0000","last_active":"2023-11-28T20:02:09.296060+0000","last_peered":"2023-11-28T20:02:09.296060+0000","last_clean":"2023-11-28T20:02:09.296060+0000","last_became_active":"2023-11-28T20:02:08.301223+0000","last_became_peered":"2023-11-28T20:02:08.301223+0000","last_unstale":"2023-11-28T20:02:09.296060+0000","last_undegraded":"2023-11-28T20:02:09.296060+0000","last_fullsized":"2023-11-28T20:02:09.296060+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_clean_scrub_stamp":"2023-11-28T20:02:07.264604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:58:52.570056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.3a","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-28T20:02:09.341091+0000","last_change":"2023-11-28T20:02:08.309601+0000","last_active":"2023-11-28T20:02:09.341091+0000","last_peered":"2023-11-28T20:02:09.341091+0000","last_clean":"2023-11-28T20:02:09.341091+0000","last_became_active":"2023-11-28T20:02:08.309350+0000","last_became_peered":"2023-11-28T20:02:08.309350+0000","last_unstale":"2023-11-28T20:02:09.341091+0000","last_undegraded":"2023-11-28T20:02:09.341091+0000","last_fullsized":"2023-11-28T20:02:09.341091+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_clean_scrub_stamp":"2023-11-28T20:02:07.264604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:06:22.207175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.39","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-28T20:02:10.120121+0000","last_change":"2023-11-28T20:02:08.298696+0000","last_active":"2023-11-28T20:02:10.120121+0000","last_peered":"2023-11-28T20:02:10.120121+0000","last_clean":"2023-11-28T20:02:10.120121+0000","last_became_active":"2023-11-28T20:02:08.297650+0000","last_became_peered":"2023-11-28T20:02:08.297650+0000","last_unstale":"2023-11-28T20:02:10.120121+0000","last_undegraded":"2023-11-28T20:02:10.120121+0000","last_fullsized":"2023-11-28T20:02:10.120121+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_clean_scrub_stamp":"2023-11-28T20:02:07.264604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:27:09.260314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.38","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-28T20:02:09.296990+0000","last_change":"2023-11-28T20:02:08.297052+0000","last_active":"2023-11-28T20:02:09.296990+0000","last_peered":"2023-11-28T20:02:09.296990+0000","last_clean":"2023-11-28T20:02:09.296990+0000","last_became_active":"2023-11-28T20:02:08.295852+0000","last_became_peered":"2023-11-28T20:02:08.295852+0000","last_unstale":"2023-11-28T20:02:09.296990+0000","last_undegraded":"2023-11-28T20:02:09.296990+0000","last_fullsized":"2023-11-28T20:02:09.296990+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_clean_scrub_stamp":"2023-11-28T20:02:07.264604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:33:12.680902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.37","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-28T20:02:09.295457+0000","last_change":"2023-11-28T20:02:08.297178+0000","last_active":"2023-11-28T20:02:09.295457+0000","last_peered":"2023-11-28T20:02:09.295457+0000","last_clean":"2023-11-28T20:02:09.295457+0000","last_became_active":"2023-11-28T20:02:08.296480+0000","last_became_peered":"2023-11-28T20:02:08.296480+0000","last_unstale":"2023-11-28T20:02:09.295457+0000","last_undegraded":"2023-11-28T20:02:09.295457+0000","last_fullsized":"2023-11-28T20:02:09.295457+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_clean_scrub_stamp":"2023-11-28T20:02:07.264604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:49:05.201081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.36","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-28T20:02:10.119031+0000","last_change":"2023-11-28T20:02:08.316569+0000","last_active":"2023-11-28T20:02:10.119031+0000","last_peered":"2023-11-28T20:02:10.119031+0000","last_clean":"2023-11-28T20:02:10.119031+0000","last_became_active":"2023-11-28T20:02:08.316305+0000","last_became_peered":"2023-11-28T20:02:08.316305+0000","last_unstale":"2023-11-28T20:02:10.119031+0000","last_undegraded":"2023-11-28T20:02:10.119031+0000","last_fullsized":"2023-11-28T20:02:10.119031+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_clean_scrub_stamp":"2023-11-28T20:02:07.264604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T06:30:11.363319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.35","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-28T20:02:09.295173+0000","last_change":"2023-11-28T20:02:08.301530+0000","last_active":"2023-11-28T20:02:09.295173+0000","last_peered":"2023-11-28T20:02:09.295173+0000","last_clean":"2023-11-28T20:02:09.295173+0000","last_became_active":"2023-11-28T20:02:08.301047+0000","last_became_peered":"2023-11-28T20:02:08.301047+0000","last_unstale":"2023-11-28T20:02:09.295173+0000","last_undegraded":"2023-11-28T20:02:09.295173+0000","last_fullsized":"2023-11-28T20:02:09.295173+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_clean_scrub_stamp":"2023-11-28T20:02:07.264604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:58:37.957173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.34","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-28T20:02:10.118805+0000","last_change":"2023-11-28T20:02:08.309936+0000","last_active":"2023-11-28T20:02:10.118805+0000","last_peered":"2023-11-28T20:02:10.118805+0000","last_clean":"2023-11-28T20:02:10.118805+0000","last_became_active":"2023-11-28T20:02:08.309719+0000","last_became_peered":"2023-11-28T20:02:08.309719+0000","last_unstale":"2023-11-28T20:02:10.118805+0000","last_undegraded":"2023-11-28T20:02:10.118805+0000","last_fullsized":"2023-11-28T20:02:10.118805+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_clean_scrub_stamp":"2023-11-28T20:02:07.264604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:31:20.575901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.33","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-28T20:02:09.297113+0000","last_change":"2023-11-28T20:02:08.294336+0000","last_active":"2023-11-28T20:02:09.297113+0000","last_peered":"2023-11-28T20:02:09.297113+0000","last_clean":"2023-11-28T20:02:09.297113+0000","last_became_active":"2023-11-28T20:02:08.294087+0000","last_became_peered":"2023-11-28T20:02:08.294087+0000","last_unstale":"2023-11-28T20:02:09.297113+0000","last_undegraded":"2023-11-28T20:02:09.297113+0000","last_fullsized":"2023-11-28T20:02:09.297113+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_clean_scrub_stamp":"2023-11-28T20:02:07.264604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:51:11.144383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.32","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-28T20:02:09.295042+0000","last_change":"2023-11-28T20:02:08.307905+0000","last_active":"2023-11-28T20:02:09.295042+0000","last_peered":"2023-11-28T20:02:09.295042+0000","last_clean":"2023-11-28T20:02:09.295042+0000","last_became_active":"2023-11-28T20:02:08.307623+0000","last_became_peered":"2023-11-28T20:02:08.307623+0000","last_unstale":"2023-11-28T20:02:09.295042+0000","last_undegraded":"2023-11-28T20:02:09.295042+0000","last_fullsized":"2023-11-28T20:02:09.295042+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_clean_scrub_stamp":"2023-11-28T20:02:07.264604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:55:37.170814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.31","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-28T20:02:09.297071+0000","last_change":"2023-11-28T20:02:08.296139+0000","last_active":"2023-11-28T20:02:09.297071+0000","last_peered":"2023-11-28T20:02:09.297071+0000","last_clean":"2023-11-28T20:02:09.297071+0000","last_became_active":"2023-11-28T20:02:08.295866+0000","last_became_peered":"2023-11-28T20:02:08.295866+0000","last_unstale":"2023-11-28T20:02:09.297071+0000","last_undegraded":"2023-11-28T20:02:09.297071+0000","last_fullsized":"2023-11-28T20:02:09.297071+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_clean_scrub_stamp":"2023-11-28T20:02:07.264604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:18:14.885236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.30","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-28T20:02:09.341070+0000","last_change":"2023-11-28T20:02:08.302149+0000","last_active":"2023-11-28T20:02:09.341070+0000","last_peered":"2023-11-28T20:02:09.341070+0000","last_clean":"2023-11-28T20:02:09.341070+0000","last_became_active":"2023-11-28T20:02:08.301657+0000","last_became_peered":"2023-11-28T20:02:08.301657+0000","last_unstale":"2023-11-28T20:02:09.341070+0000","last_undegraded":"2023-11-28T20:02:09.341070+0000","last_fullsized":"2023-11-28T20:02:09.341070+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_clean_scrub_stamp":"2023-11-28T20:02:07.264604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:37:52.578636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.2f","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-28T20:02:09.341484+0000","last_change":"2023-11-28T20:02:08.301087+0000","last_active":"2023-11-28T20:02:09.341484+0000","last_peered":"2023-11-28T20:02:09.341484+0000","last_clean":"2023-11-28T20:02:09.341484+0000","last_became_active":"2023-11-28T20:02:08.300738+0000","last_became_peered":"2023-11-28T20:02:08.300738+0000","last_unstale":"2023-11-28T20:02:09.341484+0000","last_undegraded":"2023-11-28T20:02:09.341484+0000","last_fullsized":"2023-11-28T20:02:09.341484+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_clean_scrub_stamp":"2023-11-28T20:02:07.264604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T07:54:21.325208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.2e","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-28T20:02:09.920420+0000","last_change":"2023-11-28T20:02:08.294533+0000","last_active":"2023-11-28T20:02:09.920420+0000","last_peered":"2023-11-28T20:02:09.920420+0000","last_clean":"2023-11-28T20:02:09.920420+0000","last_became_active":"2023-11-28T20:02:08.294329+0000","last_became_peered":"2023-11-28T20:02:08.294329+0000","last_unstale":"2023-11-28T20:02:09.920420+0000","last_undegraded":"2023-11-28T20:02:09.920420+0000","last_fullsized":"2023-11-28T20:02:09.920420+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_clean_scrub_stamp":"2023-11-28T20:02:07.264604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:12:41.265139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.2d","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-28T20:02:09.295289+0000","last_change":"2023-11-28T20:02:08.311901+0000","last_active":"2023-11-28T20:02:09.295289+0000","last_peered":"2023-11-28T20:02:09.295289+0000","last_clean":"2023-11-28T20:02:09.295289+0000","last_became_active":"2023-11-28T20:02:08.311540+0000","last_became_peered":"2023-11-28T20:02:08.311540+0000","last_unstale":"2023-11-28T20:02:09.295289+0000","last_undegraded":"2023-11-28T20:02:09.295289+0000","last_fullsized":"2023-11-28T20:02:09.295289+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_clean_scrub_stamp":"2023-11-28T20:02:07.264604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:46:59.333070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.2c","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-28T20:02:09.297510+0000","last_change":"2023-11-28T20:02:08.292376+0000","last_active":"2023-11-28T20:02:09.297510+0000","last_peered":"2023-11-28T20:02:09.297510+0000","last_clean":"2023-11-28T20:02:09.297510+0000","last_became_active":"2023-11-28T20:02:08.292042+0000","last_became_peered":"2023-11-28T20:02:08.292042+0000","last_unstale":"2023-11-28T20:02:09.297510+0000","last_undegraded":"2023-11-28T20:02:09.297510+0000","last_fullsized":"2023-11-28T20:02:09.297510+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_clean_scrub_stamp":"2023-11-28T20:02:07.264604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:53:42.852122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.2b","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-28T20:02:09.295091+0000","last_change":"2023-11-28T20:02:08.297539+0000","last_active":"2023-11-28T20:02:09.295091+0000","last_peered":"2023-11-28T20:02:09.295091+0000","last_clean":"2023-11-28T20:02:09.295091+0000","last_became_active":"2023-11-28T20:02:08.294583+0000","last_became_peered":"2023-11-28T20:02:08.294583+0000","last_unstale":"2023-11-28T20:02:09.295091+0000","last_undegraded":"2023-11-28T20:02:09.295091+0000","last_fullsized":"2023-11-28T20:02:09.295091+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_clean_scrub_stamp":"2023-11-28T20:02:07.264604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:34:43.366405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.2a","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-28T20:02:09.294938+0000","last_change":"2023-11-28T20:02:08.297073+0000","last_active":"2023-11-28T20:02:09.294938+0000","last_peered":"2023-11-28T20:02:09.294938+0000","last_clean":"2023-11-28T20:02:09.294938+0000","last_became_active":"2023-11-28T20:02:08.296814+0000","last_became_peered":"2023-11-28T20:02:08.296814+0000","last_unstale":"2023-11-28T20:02:09.294938+0000","last_undegraded":"2023-11-28T20:02:09.294938+0000","last_fullsized":"2023-11-28T20:02:09.294938+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_clean_scrub_stamp":"2023-11-28T20:02:07.264604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:00:38.869040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.29","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-28T20:02:10.120704+0000","last_change":"2023-11-28T20:02:08.308480+0000","last_active":"2023-11-28T20:02:10.120704+0000","last_peered":"2023-11-28T20:02:10.120704+0000","last_clean":"2023-11-28T20:02:10.120704+0000","last_became_active":"2023-11-28T20:02:08.308190+0000","last_became_peered":"2023-11-28T20:02:08.308190+0000","last_unstale":"2023-11-28T20:02:10.120704+0000","last_undegraded":"2023-11-28T20:02:10.120704+0000","last_fullsized":"2023-11-28T20:02:10.120704+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_clean_scrub_stamp":"2023-11-28T20:02:07.264604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:51:11.144383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.28","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-28T20:02:09.920300+0000","last_change":"2023-11-28T20:02:08.307205+0000","last_active":"2023-11-28T20:02:09.920300+0000","last_peered":"2023-11-28T20:02:09.920300+0000","last_clean":"2023-11-28T20:02:09.920300+0000","last_became_active":"2023-11-28T20:02:08.306954+0000","last_became_peered":"2023-11-28T20:02:08.306954+0000","last_unstale":"2023-11-28T20:02:09.920300+0000","last_undegraded":"2023-11-28T20:02:09.920300+0000","last_fullsized":"2023-11-28T20:02:09.920300+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_clean_scrub_stamp":"2023-11-28T20:02:07.264604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:27:46.451074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.27","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-28T20:02:09.296373+0000","last_change":"2023-11-28T20:02:08.294531+0000","last_active":"2023-11-28T20:02:09.296373+0000","last_peered":"2023-11-28T20:02:09.296373+0000","last_clean":"2023-11-28T20:02:09.296373+0000","last_became_active":"2023-11-28T20:02:08.294163+0000","last_became_peered":"2023-11-28T20:02:08.294163+0000","last_unstale":"2023-11-28T20:02:09.296373+0000","last_undegraded":"2023-11-28T20:02:09.296373+0000","last_fullsized":"2023-11-28T20:02:09.296373+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_clean_scrub_stamp":"2023-11-28T20:02:07.264604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:21:50.379035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.26","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-28T20:02:09.295439+0000","last_change":"2023-11-28T20:02:08.307678+0000","last_active":"2023-11-28T20:02:09.295439+0000","last_peered":"2023-11-28T20:02:09.295439+0000","last_clean":"2023-11-28T20:02:09.295439+0000","last_became_active":"2023-11-28T20:02:08.307402+0000","last_became_peered":"2023-11-28T20:02:08.307402+0000","last_unstale":"2023-11-28T20:02:09.295439+0000","last_undegraded":"2023-11-28T20:02:09.295439+0000","last_fullsized":"2023-11-28T20:02:09.295439+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_clean_scrub_stamp":"2023-11-28T20:02:07.264604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:31:57.356139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.25","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-28T20:02:10.118984+0000","last_change":"2023-11-28T20:02:08.313075+0000","last_active":"2023-11-28T20:02:10.118984+0000","last_peered":"2023-11-28T20:02:10.118984+0000","last_clean":"2023-11-28T20:02:10.118984+0000","last_became_active":"2023-11-28T20:02:08.312852+0000","last_became_peered":"2023-11-28T20:02:08.312852+0000","last_unstale":"2023-11-28T20:02:10.118984+0000","last_undegraded":"2023-11-28T20:02:10.118984+0000","last_fullsized":"2023-11-28T20:02:10.118984+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_clean_scrub_stamp":"2023-11-28T20:02:07.264604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:47:27.485031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.24","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-28T20:02:09.297627+0000","last_change":"2023-11-28T20:02:08.296547+0000","last_active":"2023-11-28T20:02:09.297627+0000","last_peered":"2023-11-28T20:02:09.297627+0000","last_clean":"2023-11-28T20:02:09.297627+0000","last_became_active":"2023-11-28T20:02:08.296274+0000","last_became_peered":"2023-11-28T20:02:08.296274+0000","last_unstale":"2023-11-28T20:02:09.297627+0000","last_undegraded":"2023-11-28T20:02:09.297627+0000","last_fullsized":"2023-11-28T20:02:09.297627+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_clean_scrub_stamp":"2023-11-28T20:02:07.264604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:40:59.195276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.23","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-28T20:02:10.120404+0000","last_change":"2023-11-28T20:02:08.313149+0000","last_active":"2023-11-28T20:02:10.120404+0000","last_peered":"2023-11-28T20:02:10.120404+0000","last_clean":"2023-11-28T20:02:10.120404+0000","last_became_active":"2023-11-28T20:02:08.312835+0000","last_became_peered":"2023-11-28T20:02:08.312835+0000","last_unstale":"2023-11-28T20:02:10.120404+0000","last_undegraded":"2023-11-28T20:02:10.120404+0000","last_fullsized":"2023-11-28T20:02:10.120404+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_clean_scrub_stamp":"2023-11-28T20:02:07.264604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:56:59.351869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.22","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-28T20:02:09.295801+0000","last_change":"2023-11-28T20:02:08.296480+0000","last_active":"2023-11-28T20:02:09.295801+0000","last_peered":"2023-11-28T20:02:09.295801+0000","last_clean":"2023-11-28T20:02:09.295801+0000","last_became_active":"2023-11-28T20:02:08.293946+0000","last_became_peered":"2023-11-28T20:02:08.293946+0000","last_unstale":"2023-11-28T20:02:09.295801+0000","last_undegraded":"2023-11-28T20:02:09.295801+0000","last_fullsized":"2023-11-28T20:02:09.295801+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_clean_scrub_stamp":"2023-11-28T20:02:07.264604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:56:40.073193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.21","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-28T20:02:09.294998+0000","last_change":"2023-11-28T20:02:08.287344+0000","last_active":"2023-11-28T20:02:09.294998+0000","last_peered":"2023-11-28T20:02:09.294998+0000","last_clean":"2023-11-28T20:02:09.294998+0000","last_became_active":"2023-11-28T20:02:08.287066+0000","last_became_peered":"2023-11-28T20:02:08.287066+0000","last_unstale":"2023-11-28T20:02:09.294998+0000","last_undegraded":"2023-11-28T20:02:09.294998+0000","last_fullsized":"2023-11-28T20:02:09.294998+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_clean_scrub_stamp":"2023-11-28T20:02:07.264604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:53:42.852122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.20","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-28T20:02:09.341433+0000","last_change":"2023-11-28T20:02:08.301980+0000","last_active":"2023-11-28T20:02:09.341433+0000","last_peered":"2023-11-28T20:02:09.341433+0000","last_clean":"2023-11-28T20:02:09.341433+0000","last_became_active":"2023-11-28T20:02:08.301384+0000","last_became_peered":"2023-11-28T20:02:08.301384+0000","last_unstale":"2023-11-28T20:02:09.341433+0000","last_undegraded":"2023-11-28T20:02:09.341433+0000","last_fullsized":"2023-11-28T20:02:09.341433+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_clean_scrub_stamp":"2023-11-28T20:02:07.264604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:54:01.736053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.1c","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-28T20:02:09.341401+0000","last_change":"2023-11-28T20:02:08.306450+0000","last_active":"2023-11-28T20:02:09.341401+0000","last_peered":"2023-11-28T20:02:09.341401+0000","last_clean":"2023-11-28T20:02:09.341401+0000","last_became_active":"2023-11-28T20:02:08.305331+0000","last_became_peered":"2023-11-28T20:02:08.305331+0000","last_unstale":"2023-11-28T20:02:09.341401+0000","last_undegraded":"2023-11-28T20:02:09.341401+0000","last_fullsized":"2023-11-28T20:02:09.341401+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_clean_scrub_stamp":"2023-11-28T20:02:07.264604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:45:53.384489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1f","version":"80'4","reported_seq":16,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-28T20:02:08.320033+0000","last_change":"2023-11-28T20:02:07.298433+0000","last_active":"2023-11-28T20:02:08.320033+0000","last_peered":"2023-11-28T20:02:08.320033+0000","last_clean":"2023-11-28T20:02:08.320033+0000","last_became_active":"2023-11-28T20:02:07.298106+0000","last_became_peered":"2023-11-28T20:02:07.298106+0000","last_unstale":"2023-11-28T20:02:08.320033+0000","last_undegraded":"2023-11-28T20:02:08.320033+0000","last_fullsized":"2023-11-28T20:02:08.320033+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:06.257335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:06.257335+0000","last_clean_scrub_stamp":"2023-11-28T20:02:06.257335+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:31:56.348870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.1d","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-28T20:02:09.341415+0000","last_change":"2023-11-28T20:02:08.317121+0000","last_active":"2023-11-28T20:02:09.341415+0000","last_peered":"2023-11-28T20:02:09.341415+0000","last_clean":"2023-11-28T20:02:09.341415+0000","last_became_active":"2023-11-28T20:02:08.316880+0000","last_became_peered":"2023-11-28T20:02:08.316880+0000","last_unstale":"2023-11-28T20:02:09.341415+0000","last_undegraded":"2023-11-28T20:02:09.341415+0000","last_fullsized":"2023-11-28T20:02:09.341415+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_clean_scrub_stamp":"2023-11-28T20:02:07.264604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T06:42:59.198543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1e","version":"80'1","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-28T20:02:08.311405+0000","last_change":"2023-11-28T20:02:07.293164+0000","last_active":"2023-11-28T20:02:08.311405+0000","last_peered":"2023-11-28T20:02:08.311405+0000","last_clean":"2023-11-28T20:02:08.311405+0000","last_became_active":"2023-11-28T20:02:07.292799+0000","last_became_peered":"2023-11-28T20:02:07.292799+0000","last_unstale":"2023-11-28T20:02:08.311405+0000","last_undegraded":"2023-11-28T20:02:08.311405+0000","last_fullsized":"2023-11-28T20:02:08.311405+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:06.257335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:06.257335+0000","last_clean_scrub_stamp":"2023-11-28T20:02:06.257335+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:32:46.550427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.1e","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-28T20:02:10.120225+0000","last_change":"2023-11-28T20:02:08.307558+0000","last_active":"2023-11-28T20:02:10.120225+0000","last_peered":"2023-11-28T20:02:10.120225+0000","last_clean":"2023-11-28T20:02:10.120225+0000","last_became_active":"2023-11-28T20:02:08.307293+0000","last_became_peered":"2023-11-28T20:02:08.307293+0000","last_unstale":"2023-11-28T20:02:10.120225+0000","last_undegraded":"2023-11-28T20:02:10.120225+0000","last_fullsized":"2023-11-28T20:02:10.120225+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_clean_scrub_stamp":"2023-11-28T20:02:07.264604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:31:10.520073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.1d","version":"80'2","reported_seq":14,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-28T20:02:08.315050+0000","last_change":"2023-11-28T20:02:07.298412+0000","last_active":"2023-11-28T20:02:08.315050+0000","last_peered":"2023-11-28T20:02:08.315050+0000","last_clean":"2023-11-28T20:02:08.315050+0000","last_became_active":"2023-11-28T20:02:07.297937+0000","last_became_peered":"2023-11-28T20:02:07.297937+0000","last_unstale":"2023-11-28T20:02:08.315050+0000","last_undegraded":"2023-11-28T20:02:08.315050+0000","last_fullsized":"2023-11-28T20:02:08.315050+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:06.257335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:06.257335+0000","last_clean_scrub_stamp":"2023-11-28T20:02:06.257335+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:10:00.652865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.1f","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-28T20:02:09.341542+0000","last_change":"2023-11-28T20:02:08.300921+0000","last_active":"2023-11-28T20:02:09.341542+0000","last_peered":"2023-11-28T20:02:09.341542+0000","last_clean":"2023-11-28T20:02:09.341542+0000","last_became_active":"2023-11-28T20:02:08.300407+0000","last_became_peered":"2023-11-28T20:02:08.300407+0000","last_unstale":"2023-11-28T20:02:09.341542+0000","last_undegraded":"2023-11-28T20:02:09.341542+0000","last_fullsized":"2023-11-28T20:02:09.341542+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_clean_scrub_stamp":"2023-11-28T20:02:07.264604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T07:27:12.455346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1c","version":"80'2","reported_seq":14,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-28T20:02:08.316401+0000","last_change":"2023-11-28T20:02:07.303442+0000","last_active":"2023-11-28T20:02:08.316401+0000","last_peered":"2023-11-28T20:02:08.316401+0000","last_clean":"2023-11-28T20:02:08.316401+0000","last_became_active":"2023-11-28T20:02:07.302881+0000","last_became_peered":"2023-11-28T20:02:07.302881+0000","last_unstale":"2023-11-28T20:02:08.316401+0000","last_undegraded":"2023-11-28T20:02:08.316401+0000","last_fullsized":"2023-11-28T20:02:08.316401+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:06.257335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:06.257335+0000","last_clean_scrub_stamp":"2023-11-28T20:02:06.257335+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:32:53.356561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.18","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-28T20:02:09.296991+0000","last_change":"2023-11-28T20:02:08.301741+0000","last_active":"2023-11-28T20:02:09.296991+0000","last_peered":"2023-11-28T20:02:09.296991+0000","last_clean":"2023-11-28T20:02:09.296991+0000","last_became_active":"2023-11-28T20:02:08.296574+0000","last_became_peered":"2023-11-28T20:02:08.296574+0000","last_unstale":"2023-11-28T20:02:09.296991+0000","last_undegraded":"2023-11-28T20:02:09.296991+0000","last_fullsized":"2023-11-28T20:02:09.296991+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_clean_scrub_stamp":"2023-11-28T20:02:07.264604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:55:48.206640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.1b","version":"80'1","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-28T20:02:08.314885+0000","last_change":"2023-11-28T20:02:07.292245+0000","last_active":"2023-11-28T20:02:08.314885+0000","last_peered":"2023-11-28T20:02:08.314885+0000","last_clean":"2023-11-28T20:02:08.314885+0000","last_became_active":"2023-11-28T20:02:07.291923+0000","last_became_peered":"2023-11-28T20:02:07.291923+0000","last_unstale":"2023-11-28T20:02:08.314885+0000","last_undegraded":"2023-11-28T20:02:08.314885+0000","last_fullsized":"2023-11-28T20:02:08.314885+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:06.257335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:06.257335+0000","last_clean_scrub_stamp":"2023-11-28T20:02:06.257335+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T07:18:58.610557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.19","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-28T20:02:10.120041+0000","last_change":"2023-11-28T20:02:08.306953+0000","last_active":"2023-11-28T20:02:10.120041+0000","last_peered":"2023-11-28T20:02:10.120041+0000","last_clean":"2023-11-28T20:02:10.120041+0000","last_became_active":"2023-11-28T20:02:08.302688+0000","last_became_peered":"2023-11-28T20:02:08.302688+0000","last_unstale":"2023-11-28T20:02:10.120041+0000","last_undegraded":"2023-11-28T20:02:10.120041+0000","last_fullsized":"2023-11-28T20:02:10.120041+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_clean_scrub_stamp":"2023-11-28T20:02:07.264604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:33:12.680902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1a","version":"80'1","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-28T20:02:08.320938+0000","last_change":"2023-11-28T20:02:07.297038+0000","last_active":"2023-11-28T20:02:08.320938+0000","last_peered":"2023-11-28T20:02:08.320938+0000","last_clean":"2023-11-28T20:02:08.320938+0000","last_became_active":"2023-11-28T20:02:07.295472+0000","last_became_peered":"2023-11-28T20:02:07.295472+0000","last_unstale":"2023-11-28T20:02:08.320938+0000","last_undegraded":"2023-11-28T20:02:08.320938+0000","last_fullsized":"2023-11-28T20:02:08.320938+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:06.257335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:06.257335+0000","last_clean_scrub_stamp":"2023-11-28T20:02:06.257335+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:26:07.339153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.1a","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-28T20:02:09.341086+0000","last_change":"2023-11-28T20:02:08.306474+0000","last_active":"2023-11-28T20:02:09.341086+0000","last_peered":"2023-11-28T20:02:09.341086+0000","last_clean":"2023-11-28T20:02:09.341086+0000","last_became_active":"2023-11-28T20:02:08.306183+0000","last_became_peered":"2023-11-28T20:02:08.306183+0000","last_unstale":"2023-11-28T20:02:09.341086+0000","last_undegraded":"2023-11-28T20:02:09.341086+0000","last_fullsized":"2023-11-28T20:02:09.341086+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_clean_scrub_stamp":"2023-11-28T20:02:07.264604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:58:51.867372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.19","version":"0'0","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-28T20:02:08.283967+0000","last_change":"2023-11-28T20:02:07.292322+0000","last_active":"2023-11-28T20:02:08.283967+0000","last_peered":"2023-11-28T20:02:08.283967+0000","last_clean":"2023-11-28T20:02:08.283967+0000","last_became_active":"2023-11-28T20:02:07.292063+0000","last_became_peered":"2023-11-28T20:02:07.292063+0000","last_unstale":"2023-11-28T20:02:08.283967+0000","last_undegraded":"2023-11-28T20:02:08.283967+0000","last_fullsized":"2023-11-28T20:02:08.283967+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:06.257335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:06.257335+0000","last_clean_scrub_stamp":"2023-11-28T20:02:06.257335+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:31:09.512804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.1b","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-28T20:02:09.297396+0000","last_change":"2023-11-28T20:02:08.308147+0000","last_active":"2023-11-28T20:02:09.297396+0000","last_peered":"2023-11-28T20:02:09.297396+0000","last_clean":"2023-11-28T20:02:09.297396+0000","last_became_active":"2023-11-28T20:02:08.307818+0000","last_became_peered":"2023-11-28T20:02:08.307818+0000","last_unstale":"2023-11-28T20:02:09.297396+0000","last_undegraded":"2023-11-28T20:02:09.297396+0000","last_fullsized":"2023-11-28T20:02:09.297396+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_clean_scrub_stamp":"2023-11-28T20:02:07.264604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T06:29:21.322854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.18","version":"0'0","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-28T20:02:08.287940+0000","last_change":"2023-11-28T20:02:07.298452+0000","last_active":"2023-11-28T20:02:08.287940+0000","last_peered":"2023-11-28T20:02:08.287940+0000","last_clean":"2023-11-28T20:02:08.287940+0000","last_became_active":"2023-11-28T20:02:07.297932+0000","last_became_peered":"2023-11-28T20:02:07.297932+0000","last_unstale":"2023-11-28T20:02:08.287940+0000","last_undegraded":"2023-11-28T20:02:08.287940+0000","last_fullsized":"2023-11-28T20:02:08.287940+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:06.257335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:06.257335+0000","last_clean_scrub_stamp":"2023-11-28T20:02:06.257335+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:31:16.962567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.14","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-28T20:02:09.295715+0000","last_change":"2023-11-28T20:02:08.298743+0000","last_active":"2023-11-28T20:02:09.295715+0000","last_peered":"2023-11-28T20:02:09.295715+0000","last_clean":"2023-11-28T20:02:09.295715+0000","last_became_active":"2023-11-28T20:02:08.298491+0000","last_became_peered":"2023-11-28T20:02:08.298491+0000","last_unstale":"2023-11-28T20:02:09.295715+0000","last_undegraded":"2023-11-28T20:02:09.295715+0000","last_fullsized":"2023-11-28T20:02:09.295715+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_clean_scrub_stamp":"2023-11-28T20:02:07.264604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:32:54.363830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.17","version":"0'0","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-28T20:02:08.281037+0000","last_change":"2023-11-28T20:02:07.299173+0000","last_active":"2023-11-28T20:02:08.281037+0000","last_peered":"2023-11-28T20:02:08.281037+0000","last_clean":"2023-11-28T20:02:08.281037+0000","last_became_active":"2023-11-28T20:02:07.298892+0000","last_became_peered":"2023-11-28T20:02:07.298892+0000","last_unstale":"2023-11-28T20:02:08.281037+0000","last_undegraded":"2023-11-28T20:02:08.281037+0000","last_fullsized":"2023-11-28T20:02:08.281037+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:06.257335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:06.257335+0000","last_clean_scrub_stamp":"2023-11-28T20:02:06.257335+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:50:01.847152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.15","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-28T20:02:10.120342+0000","last_change":"2023-11-28T20:02:08.303341+0000","last_active":"2023-11-28T20:02:10.120342+0000","last_peered":"2023-11-28T20:02:10.120342+0000","last_clean":"2023-11-28T20:02:10.120342+0000","last_became_active":"2023-11-28T20:02:08.303067+0000","last_became_peered":"2023-11-28T20:02:08.303067+0000","last_unstale":"2023-11-28T20:02:10.120342+0000","last_undegraded":"2023-11-28T20:02:10.120342+0000","last_fullsized":"2023-11-28T20:02:10.120342+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_clean_scrub_stamp":"2023-11-28T20:02:07.264604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:54:53.728600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.16","version":"0'0","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-28T20:02:08.284454+0000","last_change":"2023-11-28T20:02:07.291621+0000","last_active":"2023-11-28T20:02:08.284454+0000","last_peered":"2023-11-28T20:02:08.284454+0000","last_clean":"2023-11-28T20:02:08.284454+0000","last_became_active":"2023-11-28T20:02:07.288923+0000","last_became_peered":"2023-11-28T20:02:07.288923+0000","last_unstale":"2023-11-28T20:02:08.284454+0000","last_undegraded":"2023-11-28T20:02:08.284454+0000","last_fullsized":"2023-11-28T20:02:08.284454+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:06.257335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:06.257335+0000","last_clean_scrub_stamp":"2023-11-28T20:02:06.257335+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:54:52.721331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.16","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-28T20:02:09.920446+0000","last_change":"2023-11-28T20:02:08.295869+0000","last_active":"2023-11-28T20:02:09.920446+0000","last_peered":"2023-11-28T20:02:09.920446+0000","last_clean":"2023-11-28T20:02:09.920446+0000","last_became_active":"2023-11-28T20:02:08.295474+0000","last_became_peered":"2023-11-28T20:02:08.295474+0000","last_unstale":"2023-11-28T20:02:09.920446+0000","last_undegraded":"2023-11-28T20:02:09.920446+0000","last_fullsized":"2023-11-28T20:02:09.920446+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_clean_scrub_stamp":"2023-11-28T20:02:07.264604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:37:52.578636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.15","version":"80'3","reported_seq":15,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-28T20:02:08.321793+0000","last_change":"2023-11-28T20:02:07.300162+0000","last_active":"2023-11-28T20:02:08.321793+0000","last_peered":"2023-11-28T20:02:08.321793+0000","last_clean":"2023-11-28T20:02:08.321793+0000","last_became_active":"2023-11-28T20:02:07.299792+0000","last_became_peered":"2023-11-28T20:02:07.299792+0000","last_unstale":"2023-11-28T20:02:08.321793+0000","last_undegraded":"2023-11-28T20:02:08.321793+0000","last_fullsized":"2023-11-28T20:02:08.321793+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:06.257335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:06.257335+0000","last_clean_scrub_stamp":"2023-11-28T20:02:06.257335+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:42:57.441074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.17","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-28T20:02:09.297548+0000","last_change":"2023-11-28T20:02:08.286867+0000","last_active":"2023-11-28T20:02:09.297548+0000","last_peered":"2023-11-28T20:02:09.297548+0000","last_clean":"2023-11-28T20:02:09.297548+0000","last_became_active":"2023-11-28T20:02:08.286448+0000","last_became_peered":"2023-11-28T20:02:08.286448+0000","last_unstale":"2023-11-28T20:02:09.297548+0000","last_undegraded":"2023-11-28T20:02:09.297548+0000","last_fullsized":"2023-11-28T20:02:09.297548+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_clean_scrub_stamp":"2023-11-28T20:02:07.264604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:11:13.228652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.14","version":"80'6","reported_seq":18,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-28T20:02:08.321383+0000","last_change":"2023-11-28T20:02:07.296089+0000","last_active":"2023-11-28T20:02:08.321383+0000","last_peered":"2023-11-28T20:02:08.321383+0000","last_clean":"2023-11-28T20:02:08.321383+0000","last_became_active":"2023-11-28T20:02:07.295836+0000","last_became_peered":"2023-11-28T20:02:07.295836+0000","last_unstale":"2023-11-28T20:02:08.321383+0000","last_undegraded":"2023-11-28T20:02:08.321383+0000","last_fullsized":"2023-11-28T20:02:08.321383+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:06.257335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:06.257335+0000","last_clean_scrub_stamp":"2023-11-28T20:02:06.257335+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:27:45.443806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.10","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-28T20:02:09.297141+0000","last_change":"2023-11-28T20:02:08.296835+0000","last_active":"2023-11-28T20:02:09.297141+0000","last_peered":"2023-11-28T20:02:09.297141+0000","last_clean":"2023-11-28T20:02:09.297141+0000","last_became_active":"2023-11-28T20:02:08.296239+0000","last_became_peered":"2023-11-28T20:02:08.296239+0000","last_unstale":"2023-11-28T20:02:09.297141+0000","last_undegraded":"2023-11-28T20:02:09.297141+0000","last_fullsized":"2023-11-28T20:02:09.297141+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_clean_scrub_stamp":"2023-11-28T20:02:07.264604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:50:02.854421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.13","version":"80'2","reported_seq":14,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-28T20:02:08.320137+0000","last_change":"2023-11-28T20:02:07.298781+0000","last_active":"2023-11-28T20:02:08.320137+0000","last_peered":"2023-11-28T20:02:08.320137+0000","last_clean":"2023-11-28T20:02:08.320137+0000","last_became_active":"2023-11-28T20:02:07.298318+0000","last_became_peered":"2023-11-28T20:02:07.298318+0000","last_unstale":"2023-11-28T20:02:08.320137+0000","last_undegraded":"2023-11-28T20:02:08.320137+0000","last_fullsized":"2023-11-28T20:02:08.320137+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:06.257335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:06.257335+0000","last_clean_scrub_stamp":"2023-11-28T20:02:06.257335+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T06:34:38.820255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.11","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-28T20:02:09.294831+0000","last_change":"2023-11-28T20:02:08.294608+0000","last_active":"2023-11-28T20:02:09.294831+0000","last_peered":"2023-11-28T20:02:09.294831+0000","last_clean":"2023-11-28T20:02:09.294831+0000","last_became_active":"2023-11-28T20:02:08.294294+0000","last_became_peered":"2023-11-28T20:02:08.294294+0000","last_unstale":"2023-11-28T20:02:09.294831+0000","last_undegraded":"2023-11-28T20:02:09.294831+0000","last_fullsized":"2023-11-28T20:02:09.294831+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_clean_scrub_stamp":"2023-11-28T20:02:07.264604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:25:22.453300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.12","version":"0'0","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-28T20:02:08.285573+0000","last_change":"2023-11-28T20:02:07.293203+0000","last_active":"2023-11-28T20:02:08.285573+0000","last_peered":"2023-11-28T20:02:08.285573+0000","last_clean":"2023-11-28T20:02:08.285573+0000","last_became_active":"2023-11-28T20:02:07.292922+0000","last_became_peered":"2023-11-28T20:02:07.292922+0000","last_unstale":"2023-11-28T20:02:08.285573+0000","last_undegraded":"2023-11-28T20:02:08.285573+0000","last_fullsized":"2023-11-28T20:02:08.285573+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:06.257335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:06.257335+0000","last_clean_scrub_stamp":"2023-11-28T20:02:06.257335+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:18:07.449281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.12","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-28T20:02:10.118650+0000","last_change":"2023-11-28T20:02:08.305983+0000","last_active":"2023-11-28T20:02:10.118650+0000","last_peered":"2023-11-28T20:02:10.118650+0000","last_clean":"2023-11-28T20:02:10.118650+0000","last_became_active":"2023-11-28T20:02:08.305718+0000","last_became_peered":"2023-11-28T20:02:08.305718+0000","last_unstale":"2023-11-28T20:02:10.118650+0000","last_undegraded":"2023-11-28T20:02:10.118650+0000","last_fullsized":"2023-11-28T20:02:10.118650+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_clean_scrub_stamp":"2023-11-28T20:02:07.264604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T07:15:19.620125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.11","version":"0'0","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-28T20:02:08.277642+0000","last_change":"2023-11-28T20:02:07.291824+0000","last_active":"2023-11-28T20:02:08.277642+0000","last_peered":"2023-11-28T20:02:08.277642+0000","last_clean":"2023-11-28T20:02:08.277642+0000","last_became_active":"2023-11-28T20:02:07.291575+0000","last_became_peered":"2023-11-28T20:02:07.291575+0000","last_unstale":"2023-11-28T20:02:08.277642+0000","last_undegraded":"2023-11-28T20:02:08.277642+0000","last_fullsized":"2023-11-28T20:02:08.277642+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:06.257335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:06.257335+0000","last_clean_scrub_stamp":"2023-11-28T20:02:06.257335+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:48:42.567546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.13","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-28T20:02:10.118806+0000","last_change":"2023-11-28T20:02:08.312636+0000","last_active":"2023-11-28T20:02:10.118806+0000","last_peered":"2023-11-28T20:02:10.118806+0000","last_clean":"2023-11-28T20:02:10.118806+0000","last_became_active":"2023-11-28T20:02:08.312388+0000","last_became_peered":"2023-11-28T20:02:08.312388+0000","last_unstale":"2023-11-28T20:02:10.118806+0000","last_undegraded":"2023-11-28T20:02:10.118806+0000","last_fullsized":"2023-11-28T20:02:10.118806+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_clean_scrub_stamp":"2023-11-28T20:02:07.264604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:08:01.628559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.10","version":"80'8","reported_seq":20,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-28T20:02:08.319984+0000","last_change":"2023-11-28T20:02:07.295459+0000","last_active":"2023-11-28T20:02:08.319984+0000","last_peered":"2023-11-28T20:02:08.319984+0000","last_clean":"2023-11-28T20:02:08.319984+0000","last_became_active":"2023-11-28T20:02:07.295090+0000","last_became_peered":"2023-11-28T20:02:07.295090+0000","last_unstale":"2023-11-28T20:02:08.319984+0000","last_undegraded":"2023-11-28T20:02:08.319984+0000","last_fullsized":"2023-11-28T20:02:08.319984+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:06.257335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:06.257335+0000","last_clean_scrub_stamp":"2023-11-28T20:02:06.257335+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:32:53.356561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.c","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-28T20:02:09.341186+0000","last_change":"2023-11-28T20:02:08.310148+0000","last_active":"2023-11-28T20:02:09.341186+0000","last_peered":"2023-11-28T20:02:09.341186+0000","last_clean":"2023-11-28T20:02:09.341186+0000","last_became_active":"2023-11-28T20:02:08.308703+0000","last_became_peered":"2023-11-28T20:02:08.308703+0000","last_unstale":"2023-11-28T20:02:09.341186+0000","last_undegraded":"2023-11-28T20:02:09.341186+0000","last_fullsized":"2023-11-28T20:02:09.341186+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_clean_scrub_stamp":"2023-11-28T20:02:07.264604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:54:00.199248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.f","version":"80'1","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-28T20:02:08.310549+0000","last_change":"2023-11-28T20:02:07.295608+0000","last_active":"2023-11-28T20:02:08.310549+0000","last_peered":"2023-11-28T20:02:08.310549+0000","last_clean":"2023-11-28T20:02:08.310549+0000","last_became_active":"2023-11-28T20:02:07.295293+0000","last_became_peered":"2023-11-28T20:02:07.295293+0000","last_unstale":"2023-11-28T20:02:08.310549+0000","last_undegraded":"2023-11-28T20:02:08.310549+0000","last_fullsized":"2023-11-28T20:02:08.310549+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:06.257335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:06.257335+0000","last_clean_scrub_stamp":"2023-11-28T20:02:06.257335+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:49:04.193812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.d","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-28T20:02:10.120419+0000","last_change":"2023-11-28T20:02:08.300331+0000","last_active":"2023-11-28T20:02:10.120419+0000","last_peered":"2023-11-28T20:02:10.120419+0000","last_clean":"2023-11-28T20:02:10.120419+0000","last_became_active":"2023-11-28T20:02:08.300031+0000","last_became_peered":"2023-11-28T20:02:08.300031+0000","last_unstale":"2023-11-28T20:02:10.120419+0000","last_undegraded":"2023-11-28T20:02:10.120419+0000","last_fullsized":"2023-11-28T20:02:10.120419+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_clean_scrub_stamp":"2023-11-28T20:02:07.264604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:55:48.206640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.e","version":"80'2","reported_seq":14,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-28T20:02:08.314439+0000","last_change":"2023-11-28T20:02:07.300742+0000","last_active":"2023-11-28T20:02:08.314439+0000","last_peered":"2023-11-28T20:02:08.314439+0000","last_clean":"2023-11-28T20:02:08.314439+0000","last_became_active":"2023-11-28T20:02:07.300392+0000","last_became_peered":"2023-11-28T20:02:07.300392+0000","last_unstale":"2023-11-28T20:02:08.314439+0000","last_undegraded":"2023-11-28T20:02:08.314439+0000","last_fullsized":"2023-11-28T20:02:08.314439+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:06.257335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:06.257335+0000","last_clean_scrub_stamp":"2023-11-28T20:02:06.257335+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:12:46.771683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.e","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-28T20:02:09.295583+0000","last_change":"2023-11-28T20:02:08.313109+0000","last_active":"2023-11-28T20:02:09.295583+0000","last_peered":"2023-11-28T20:02:09.295583+0000","last_clean":"2023-11-28T20:02:09.295583+0000","last_became_active":"2023-11-28T20:02:08.312841+0000","last_became_peered":"2023-11-28T20:02:08.312841+0000","last_unstale":"2023-11-28T20:02:09.295583+0000","last_undegraded":"2023-11-28T20:02:09.295583+0000","last_fullsized":"2023-11-28T20:02:09.295583+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_clean_scrub_stamp":"2023-11-28T20:02:07.264604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:48:20.809209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.d","version":"80'1","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-28T20:02:08.320625+0000","last_change":"2023-11-28T20:02:07.301258+0000","last_active":"2023-11-28T20:02:08.320625+0000","last_peered":"2023-11-28T20:02:08.320625+0000","last_clean":"2023-11-28T20:02:08.320625+0000","last_became_active":"2023-11-28T20:02:07.300955+0000","last_became_peered":"2023-11-28T20:02:07.300955+0000","last_unstale":"2023-11-28T20:02:08.320625+0000","last_undegraded":"2023-11-28T20:02:08.320625+0000","last_fullsized":"2023-11-28T20:02:08.320625+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:06.257335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:06.257335+0000","last_clean_scrub_stamp":"2023-11-28T20:02:06.257335+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T07:05:17.648805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.8","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-28T20:02:09.341209+0000","last_change":"2023-11-28T20:02:08.303056+0000","last_active":"2023-11-28T20:02:09.341209+0000","last_peered":"2023-11-28T20:02:09.341209+0000","last_clean":"2023-11-28T20:02:09.341209+0000","last_became_active":"2023-11-28T20:02:08.302812+0000","last_became_peered":"2023-11-28T20:02:08.302812+0000","last_unstale":"2023-11-28T20:02:09.341209+0000","last_undegraded":"2023-11-28T20:02:09.341209+0000","last_fullsized":"2023-11-28T20:02:09.341209+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_clean_scrub_stamp":"2023-11-28T20:02:07.264604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:47:55.747151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.b","version":"80'2","reported_seq":14,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-28T20:02:08.320749+0000","last_change":"2023-11-28T20:02:07.295857+0000","last_active":"2023-11-28T20:02:08.320749+0000","last_peered":"2023-11-28T20:02:08.320749+0000","last_clean":"2023-11-28T20:02:08.320749+0000","last_became_active":"2023-11-28T20:02:07.295642+0000","last_became_peered":"2023-11-28T20:02:07.295642+0000","last_unstale":"2023-11-28T20:02:08.320749+0000","last_undegraded":"2023-11-28T20:02:08.320749+0000","last_fullsized":"2023-11-28T20:02:08.320749+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:06.257335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:06.257335+0000","last_clean_scrub_stamp":"2023-11-28T20:02:06.257335+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:32:53.356561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.9","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-28T20:02:09.295133+0000","last_change":"2023-11-28T20:02:08.297174+0000","last_active":"2023-11-28T20:02:09.295133+0000","last_peered":"2023-11-28T20:02:09.295133+0000","last_clean":"2023-11-28T20:02:09.295133+0000","last_became_active":"2023-11-28T20:02:08.296877+0000","last_became_peered":"2023-11-28T20:02:08.296877+0000","last_unstale":"2023-11-28T20:02:09.295133+0000","last_undegraded":"2023-11-28T20:02:09.295133+0000","last_fullsized":"2023-11-28T20:02:09.295133+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_clean_scrub_stamp":"2023-11-28T20:02:07.264604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:11:13.228652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.a","version":"0'0","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-28T20:02:08.298128+0000","last_change":"2023-11-28T20:02:07.296302+0000","last_active":"2023-11-28T20:02:08.298128+0000","last_peered":"2023-11-28T20:02:08.298128+0000","last_clean":"2023-11-28T20:02:08.298128+0000","last_became_active":"2023-11-28T20:02:07.296048+0000","last_became_peered":"2023-11-28T20:02:07.296048+0000","last_unstale":"2023-11-28T20:02:08.298128+0000","last_undegraded":"2023-11-28T20:02:08.298128+0000","last_fullsized":"2023-11-28T20:02:08.298128+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:06.257335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:06.257335+0000","last_clean_scrub_stamp":"2023-11-28T20:02:06.257335+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:22:17.972305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.a","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-28T20:02:09.295755+0000","last_change":"2023-11-28T20:02:08.289316+0000","last_active":"2023-11-28T20:02:09.295755+0000","last_peered":"2023-11-28T20:02:09.295755+0000","last_clean":"2023-11-28T20:02:09.295755+0000","last_became_active":"2023-11-28T20:02:08.288979+0000","last_became_peered":"2023-11-28T20:02:08.288979+0000","last_unstale":"2023-11-28T20:02:09.295755+0000","last_undegraded":"2023-11-28T20:02:09.295755+0000","last_fullsized":"2023-11-28T20:02:09.295755+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_clean_scrub_stamp":"2023-11-28T20:02:07.264604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:40:59.195276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.9","version":"0'0","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-28T20:02:08.280962+0000","last_change":"2023-11-28T20:02:07.296576+0000","last_active":"2023-11-28T20:02:08.280962+0000","last_peered":"2023-11-28T20:02:08.280962+0000","last_clean":"2023-11-28T20:02:08.280962+0000","last_became_active":"2023-11-28T20:02:07.295982+0000","last_became_peered":"2023-11-28T20:02:07.295982+0000","last_unstale":"2023-11-28T20:02:08.280962+0000","last_undegraded":"2023-11-28T20:02:08.280962+0000","last_fullsized":"2023-11-28T20:02:08.280962+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:06.257335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:06.257335+0000","last_clean_scrub_stamp":"2023-11-28T20:02:06.257335+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:51:10.137114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.b","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-28T20:02:09.341242+0000","last_change":"2023-11-28T20:02:08.317237+0000","last_active":"2023-11-28T20:02:09.341242+0000","last_peered":"2023-11-28T20:02:09.341242+0000","last_clean":"2023-11-28T20:02:09.341242+0000","last_became_active":"2023-11-28T20:02:08.316980+0000","last_became_peered":"2023-11-28T20:02:08.316980+0000","last_unstale":"2023-11-28T20:02:09.341242+0000","last_undegraded":"2023-11-28T20:02:09.341242+0000","last_fullsized":"2023-11-28T20:02:09.341242+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_clean_scrub_stamp":"2023-11-28T20:02:07.264604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T06:33:53.234496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.8","version":"0'0","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-28T20:02:08.295293+0000","last_change":"2023-11-28T20:02:07.293087+0000","last_active":"2023-11-28T20:02:08.295293+0000","last_peered":"2023-11-28T20:02:08.295293+0000","last_clean":"2023-11-28T20:02:08.295293+0000","last_became_active":"2023-11-28T20:02:07.292815+0000","last_became_peered":"2023-11-28T20:02:07.292815+0000","last_unstale":"2023-11-28T20:02:08.295293+0000","last_undegraded":"2023-11-28T20:02:08.295293+0000","last_fullsized":"2023-11-28T20:02:08.295293+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:06.257335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:06.257335+0000","last_clean_scrub_stamp":"2023-11-28T20:02:06.257335+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:57:12.771669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.4","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-28T20:02:10.120616+0000","last_change":"2023-11-28T20:02:08.307858+0000","last_active":"2023-11-28T20:02:10.120616+0000","last_peered":"2023-11-28T20:02:10.120616+0000","last_clean":"2023-11-28T20:02:10.120616+0000","last_became_active":"2023-11-28T20:02:08.307550+0000","last_became_peered":"2023-11-28T20:02:08.307550+0000","last_unstale":"2023-11-28T20:02:10.120616+0000","last_undegraded":"2023-11-28T20:02:10.120616+0000","last_fullsized":"2023-11-28T20:02:10.120616+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_clean_scrub_stamp":"2023-11-28T20:02:07.264604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:18:14.885236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.7","version":"80'2","reported_seq":14,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-28T20:02:08.314853+0000","last_change":"2023-11-28T20:02:07.296980+0000","last_active":"2023-11-28T20:02:08.314853+0000","last_peered":"2023-11-28T20:02:08.314853+0000","last_clean":"2023-11-28T20:02:08.314853+0000","last_became_active":"2023-11-28T20:02:07.296625+0000","last_became_peered":"2023-11-28T20:02:07.296625+0000","last_unstale":"2023-11-28T20:02:08.314853+0000","last_undegraded":"2023-11-28T20:02:08.314853+0000","last_fullsized":"2023-11-28T20:02:08.314853+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:06.257335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:06.257335+0000","last_clean_scrub_stamp":"2023-11-28T20:02:06.257335+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:52:29.664838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.5","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-28T20:02:09.341554+0000","last_change":"2023-11-28T20:02:08.304794+0000","last_active":"2023-11-28T20:02:09.341554+0000","last_peered":"2023-11-28T20:02:09.341554+0000","last_clean":"2023-11-28T20:02:09.341554+0000","last_became_active":"2023-11-28T20:02:08.304425+0000","last_became_peered":"2023-11-28T20:02:08.304425+0000","last_unstale":"2023-11-28T20:02:09.341554+0000","last_undegraded":"2023-11-28T20:02:09.341554+0000","last_fullsized":"2023-11-28T20:02:09.341554+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_clean_scrub_stamp":"2023-11-28T20:02:07.264604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T06:13:44.850484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.6","version":"81'1","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-28T20:02:09.295800+0000","last_change":"2023-11-28T20:02:07.296643+0000","last_active":"2023-11-28T20:02:09.295800+0000","last_peered":"2023-11-28T20:02:09.295800+0000","last_clean":"2023-11-28T20:02:09.295800+0000","last_became_active":"2023-11-28T20:02:07.296369+0000","last_became_peered":"2023-11-28T20:02:07.296369+0000","last_unstale":"2023-11-28T20:02:09.295800+0000","last_undegraded":"2023-11-28T20:02:09.295800+0000","last_fullsized":"2023-11-28T20:02:09.295800+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:06.257335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:06.257335+0000","last_clean_scrub_stamp":"2023-11-28T20:02:06.257335+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:48:42.567546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.6","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-28T20:02:09.341337+0000","last_change":"2023-11-28T20:02:08.317251+0000","last_active":"2023-11-28T20:02:09.341337+0000","last_peered":"2023-11-28T20:02:09.341337+0000","last_clean":"2023-11-28T20:02:09.341337+0000","last_became_active":"2023-11-28T20:02:08.316870+0000","last_became_peered":"2023-11-28T20:02:08.316870+0000","last_unstale":"2023-11-28T20:02:09.341337+0000","last_undegraded":"2023-11-28T20:02:09.341337+0000","last_fullsized":"2023-11-28T20:02:09.341337+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_clean_scrub_stamp":"2023-11-28T20:02:07.264604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:15:09.805381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.5","version":"0'0","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-28T20:02:08.286388+0000","last_change":"2023-11-28T20:02:07.300054+0000","last_active":"2023-11-28T20:02:08.286388+0000","last_peered":"2023-11-28T20:02:08.286388+0000","last_clean":"2023-11-28T20:02:08.286388+0000","last_became_active":"2023-11-28T20:02:07.298610+0000","last_became_peered":"2023-11-28T20:02:07.298610+0000","last_unstale":"2023-11-28T20:02:08.286388+0000","last_undegraded":"2023-11-28T20:02:08.286388+0000","last_fullsized":"2023-11-28T20:02:08.286388+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:06.257335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:06.257335+0000","last_clean_scrub_stamp":"2023-11-28T20:02:06.257335+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:04:18.830964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.7","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-28T20:02:09.296362+0000","last_change":"2023-11-28T20:02:08.303184+0000","last_active":"2023-11-28T20:02:09.296362+0000","last_peered":"2023-11-28T20:02:09.296362+0000","last_clean":"2023-11-28T20:02:09.296362+0000","last_became_active":"2023-11-28T20:02:08.302908+0000","last_became_peered":"2023-11-28T20:02:08.302908+0000","last_unstale":"2023-11-28T20:02:09.296362+0000","last_undegraded":"2023-11-28T20:02:09.296362+0000","last_fullsized":"2023-11-28T20:02:09.296362+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_clean_scrub_stamp":"2023-11-28T20:02:07.264604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:46:20.521407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.4","version":"0'0","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-28T20:02:08.292904+0000","last_change":"2023-11-28T20:02:07.301572+0000","last_active":"2023-11-28T20:02:08.292904+0000","last_peered":"2023-11-28T20:02:08.292904+0000","last_clean":"2023-11-28T20:02:08.292904+0000","last_became_active":"2023-11-28T20:02:07.301226+0000","last_became_peered":"2023-11-28T20:02:07.301226+0000","last_unstale":"2023-11-28T20:02:08.292904+0000","last_undegraded":"2023-11-28T20:02:08.292904+0000","last_fullsized":"2023-11-28T20:02:08.292904+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:06.257335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:06.257335+0000","last_clean_scrub_stamp":"2023-11-28T20:02:06.257335+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:56:39.065924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.0","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-28T20:02:10.118597+0000","last_change":"2023-11-28T20:02:08.307668+0000","last_active":"2023-11-28T20:02:10.118597+0000","last_peered":"2023-11-28T20:02:10.118597+0000","last_clean":"2023-11-28T20:02:10.118597+0000","last_became_active":"2023-11-28T20:02:08.307428+0000","last_became_peered":"2023-11-28T20:02:08.307428+0000","last_unstale":"2023-11-28T20:02:10.118597+0000","last_undegraded":"2023-11-28T20:02:10.118597+0000","last_fullsized":"2023-11-28T20:02:10.118597+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_clean_scrub_stamp":"2023-11-28T20:02:07.264604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T07:35:34.958615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.3","version":"0'0","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-28T20:02:08.285902+0000","last_change":"2023-11-28T20:02:07.294264+0000","last_active":"2023-11-28T20:02:08.285902+0000","last_peered":"2023-11-28T20:02:08.285902+0000","last_clean":"2023-11-28T20:02:08.285902+0000","last_became_active":"2023-11-28T20:02:07.293763+0000","last_became_peered":"2023-11-28T20:02:07.293763+0000","last_unstale":"2023-11-28T20:02:08.285902+0000","last_undegraded":"2023-11-28T20:02:08.285902+0000","last_fullsized":"2023-11-28T20:02:08.285902+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:06.257335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:06.257335+0000","last_clean_scrub_stamp":"2023-11-28T20:02:06.257335+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:41:06.265916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.1","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-28T20:02:09.920184+0000","last_change":"2023-11-28T20:02:08.294339+0000","last_active":"2023-11-28T20:02:09.920184+0000","last_peered":"2023-11-28T20:02:09.920184+0000","last_clean":"2023-11-28T20:02:09.920184+0000","last_became_active":"2023-11-28T20:02:08.294058+0000","last_became_peered":"2023-11-28T20:02:08.294058+0000","last_unstale":"2023-11-28T20:02:09.920184+0000","last_undegraded":"2023-11-28T20:02:09.920184+0000","last_fullsized":"2023-11-28T20:02:09.920184+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_clean_scrub_stamp":"2023-11-28T20:02:07.264604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:18:08.456550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.2","version":"0'0","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-28T20:02:08.280333+0000","last_change":"2023-11-28T20:02:07.299946+0000","last_active":"2023-11-28T20:02:08.280333+0000","last_peered":"2023-11-28T20:02:08.280333+0000","last_clean":"2023-11-28T20:02:08.280333+0000","last_became_active":"2023-11-28T20:02:07.299678+0000","last_became_peered":"2023-11-28T20:02:07.299678+0000","last_unstale":"2023-11-28T20:02:08.280333+0000","last_undegraded":"2023-11-28T20:02:08.280333+0000","last_fullsized":"2023-11-28T20:02:08.280333+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:06.257335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:06.257335+0000","last_clean_scrub_stamp":"2023-11-28T20:02:06.257335+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:33:11.673633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.2","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-28T20:02:10.119972+0000","last_change":"2023-11-28T20:02:08.309044+0000","last_active":"2023-11-28T20:02:10.119972+0000","last_peered":"2023-11-28T20:02:10.119972+0000","last_clean":"2023-11-28T20:02:10.119972+0000","last_became_active":"2023-11-28T20:02:08.308771+0000","last_became_peered":"2023-11-28T20:02:08.308771+0000","last_unstale":"2023-11-28T20:02:10.119972+0000","last_undegraded":"2023-11-28T20:02:10.119972+0000","last_fullsized":"2023-11-28T20:02:10.119972+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_clean_scrub_stamp":"2023-11-28T20:02:07.264604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:58:52.570056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1","version":"0'0","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-28T20:02:08.292465+0000","last_change":"2023-11-28T20:02:07.297766+0000","last_active":"2023-11-28T20:02:08.292465+0000","last_peered":"2023-11-28T20:02:08.292465+0000","last_clean":"2023-11-28T20:02:08.292465+0000","last_became_active":"2023-11-28T20:02:07.297403+0000","last_became_peered":"2023-11-28T20:02:07.297403+0000","last_unstale":"2023-11-28T20:02:08.292465+0000","last_undegraded":"2023-11-28T20:02:08.292465+0000","last_fullsized":"2023-11-28T20:02:08.292465+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:06.257335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:06.257335+0000","last_clean_scrub_stamp":"2023-11-28T20:02:06.257335+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:48:19.801940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.3","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-28T20:02:09.341231+0000","last_change":"2023-11-28T20:02:08.303952+0000","last_active":"2023-11-28T20:02:09.341231+0000","last_peered":"2023-11-28T20:02:09.341231+0000","last_clean":"2023-11-28T20:02:09.341231+0000","last_became_active":"2023-11-28T20:02:08.303673+0000","last_became_peered":"2023-11-28T20:02:08.303673+0000","last_unstale":"2023-11-28T20:02:09.341231+0000","last_undegraded":"2023-11-28T20:02:09.341231+0000","last_fullsized":"2023-11-28T20:02:09.341231+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_clean_scrub_stamp":"2023-11-28T20:02:07.264604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:54:17.796972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.0","version":"0'0","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-28T20:02:08.288081+0000","last_change":"2023-11-28T20:02:07.300917+0000","last_active":"2023-11-28T20:02:08.288081+0000","last_peered":"2023-11-28T20:02:08.288081+0000","last_clean":"2023-11-28T20:02:08.288081+0000","last_became_active":"2023-11-28T20:02:07.300632+0000","last_became_peered":"2023-11-28T20:02:07.300632+0000","last_unstale":"2023-11-28T20:02:08.288081+0000","last_undegraded":"2023-11-28T20:02:08.288081+0000","last_fullsized":"2023-11-28T20:02:08.288081+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:06.257335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:06.257335+0000","last_clean_scrub_stamp":"2023-11-28T20:02:06.257335+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:54:32.151264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.f","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-28T20:02:10.120505+0000","last_change":"2023-11-28T20:02:08.297920+0000","last_active":"2023-11-28T20:02:10.120505+0000","last_peered":"2023-11-28T20:02:10.120505+0000","last_clean":"2023-11-28T20:02:10.120505+0000","last_became_active":"2023-11-28T20:02:08.297638+0000","last_became_peered":"2023-11-28T20:02:08.297638+0000","last_unstale":"2023-11-28T20:02:10.120505+0000","last_undegraded":"2023-11-28T20:02:10.120505+0000","last_fullsized":"2023-11-28T20:02:10.120505+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_clean_scrub_stamp":"2023-11-28T20:02:07.264604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:18:08.456550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.c","version":"0'0","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-28T20:02:08.278744+0000","last_change":"2023-11-28T20:02:07.293843+0000","last_active":"2023-11-28T20:02:08.278744+0000","last_peered":"2023-11-28T20:02:08.278744+0000","last_clean":"2023-11-28T20:02:08.278744+0000","last_became_active":"2023-11-28T20:02:07.293538+0000","last_became_peered":"2023-11-28T20:02:07.293538+0000","last_unstale":"2023-11-28T20:02:08.278744+0000","last_undegraded":"2023-11-28T20:02:08.278744+0000","last_fullsized":"2023-11-28T20:02:08.278744+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:06.257335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:06.257335+0000","last_clean_scrub_stamp":"2023-11-28T20:02:06.257335+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:58:51.562787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":217,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-28T20:02:08.288184+0000","last_change":"2023-11-28T19:58:56.136501+0000","last_active":"2023-11-28T20:02:08.288184+0000","last_peered":"2023-11-28T20:02:08.288184+0000","last_clean":"2023-11-28T20:02:08.288184+0000","last_became_active":"2023-11-28T19:58:56.135998+0000","last_became_peered":"2023-11-28T19:58:56.135998+0000","last_unstale":"2023-11-28T20:02:08.288184+0000","last_undegraded":"2023-11-28T20:02:08.288184+0000","last_fullsized":"2023-11-28T20:02:08.288184+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:58:54.602349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:58:54.602349+0000","last_clean_scrub_stamp":"2023-11-28T19:58:54.602349+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:33:42.723349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":13,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":14,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":66748,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574892,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32232,"kb_used_data":1048,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339608,"statfs":{"total":96636764160,"available":96603758592,"internally_reserved":0,"allocated":1073152,"data_stored":1059975,"data_compressed":33374,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 20:01:59 2023","interfaces":[{"interface":"back","average":{"1min":0.66000000000000003,"5min":0.67100000000000004,"15min":0.67600000000000005},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.94299999999999995,"5min":0.94299999999999995,"15min":0.94299999999999995},"last":0.68300000000000005},{"interface":"front","average":{"1min":0.66500000000000004,"5min":0.67000000000000004,"15min":0.68000000000000005},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":1.014,"5min":1.014,"15min":1.014},"last":0.75900000000000001}]},{"osd":1,"last update":"Tue Nov 28 20:01:59 2023","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.63900000000000001,"15min":0.64300000000000002},"min":{"1min":0.46100000000000002,"5min":0.438,"15min":0.438},"max":{"1min":0.95099999999999996,"5min":0.95099999999999996,"15min":0.95099999999999996},"last":0.73599999999999999},{"interface":"front","average":{"1min":0.66400000000000003,"5min":0.68100000000000005,"15min":0.69499999999999995},"min":{"1min":0.45600000000000002,"5min":0.432,"15min":0.432},"max":{"1min":0.85099999999999998,"5min":1.0900000000000001,"15min":1.0900000000000001},"last":0.60499999999999998}]},{"osd":2,"last update":"Tue Nov 28 20:01:59 2023","interfaces":[{"interface":"back","average":{"1min":0.69899999999999995,"5min":0.70899999999999996,"15min":0.72599999999999998},"min":{"1min":0.497,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.93100000000000005,"5min":0.98799999999999999,"15min":0.98799999999999999},"last":0.54400000000000004},{"interface":"front","average":{"1min":0.66800000000000004,"5min":0.68799999999999994,"15min":0.69999999999999996},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":1.514,"5min":1.514,"15min":1.514},"last":0.80300000000000005}]},{"osd":3,"last update":"Tue Nov 28 20:01:59 2023","interfaces":[{"interface":"back","average":{"1min":0.68200000000000005,"5min":0.69699999999999995,"15min":0.69899999999999995},"min":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":0.90200000000000002,"5min":1.0449999999999999,"15min":1.0449999999999999},"last":0.82499999999999996},{"interface":"front","average":{"1min":0.70899999999999996,"5min":0.76600000000000001,"15min":0.78400000000000003},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":1.034,"5min":1.1299999999999999,"15min":1.1299999999999999},"last":0.63800000000000001}]},{"osd":4,"last update":"Tue Nov 28 20:01:59 2023","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.628,"15min":0.63700000000000001},"min":{"1min":0.38900000000000001,"5min":0.378,"15min":0.378},"max":{"1min":1.2829999999999999,"5min":1.2829999999999999,"15min":1.2829999999999999},"last":0.501},{"interface":"front","average":{"1min":0.66800000000000004,"5min":0.70899999999999996,"15min":0.72499999999999998},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.91800000000000004,"5min":1.1120000000000001,"15min":1.1120000000000001},"last":0.86199999999999999}]},{"osd":5,"last update":"Tue Nov 28 20:01:59 2023","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.65300000000000002,"15min":0.67400000000000004},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.97999999999999998,"5min":1.1699999999999999,"15min":1.1699999999999999},"last":0.77900000000000003},{"interface":"front","average":{"1min":0.70899999999999996,"5min":0.73699999999999999,"15min":0.75600000000000001},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":1.3300000000000001,"5min":1.3300000000000001,"15min":1.3300000000000001},"last":0.69799999999999995}]},{"osd":6,"last update":"Tue Nov 28 20:01:59 2023","interfaces":[{"interface":"back","average":{"1min":0.76000000000000001,"5min":0.76400000000000001,"15min":0.77600000000000002},"min":{"1min":0.53500000000000003,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":1.3919999999999999,"5min":1.3919999999999999,"15min":1.3919999999999999},"last":0.84999999999999998},{"interface":"front","average":{"1min":0.67000000000000004,"5min":0.71199999999999997,"15min":0.73499999999999999},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.96099999999999997,"5min":1.23,"15min":1.23},"last":0.65400000000000003}]}]},{"osd":6,"up_from":13,"seq":55834574890,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32176,"kb_used_data":996,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339664,"statfs":{"total":96636764160,"available":96603815936,"internally_reserved":0,"allocated":1019904,"data_stored":471767,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 20:01:54 2023","interfaces":[{"interface":"back","average":{"1min":0.64000000000000001,"5min":0.621,"15min":0.61699999999999999},"min":{"1min":0.40200000000000002,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.91600000000000004,"5min":0.91600000000000004,"15min":0.91600000000000004},"last":0.67900000000000005},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.66000000000000003,"15min":0.66200000000000003},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":0.80600000000000005,"5min":0.98999999999999999,"15min":0.98999999999999999},"last":0.91900000000000004}]},{"osd":1,"last update":"Tue Nov 28 20:01:54 2023","interfaces":[{"interface":"back","average":{"1min":0.71499999999999997,"5min":0.76600000000000001,"15min":0.78200000000000003},"min":{"1min":0.54700000000000004,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.012,"5min":1.105,"15min":1.105},"last":0.83499999999999996},{"interface":"front","average":{"1min":0.62,"5min":0.67600000000000005,"15min":0.68300000000000005},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":0.90200000000000002,"5min":0.95899999999999996,"15min":0.95899999999999996},"last":0.86099999999999999}]},{"osd":2,"last update":"Tue Nov 28 20:01:54 2023","interfaces":[{"interface":"back","average":{"1min":0.63800000000000001,"5min":0.68200000000000005,"15min":0.69399999999999995},"min":{"1min":0.502,"5min":0.502,"15min":0.502},"max":{"1min":0.78900000000000003,"5min":0.93400000000000005,"15min":0.93400000000000005},"last":0.74099999999999999},{"interface":"front","average":{"1min":0.65800000000000003,"5min":0.70399999999999996,"15min":0.71399999999999997},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":0.95299999999999996,"5min":1.006,"15min":1.006},"last":0.78000000000000003}]},{"osd":3,"last update":"Tue Nov 28 20:01:54 2023","interfaces":[{"interface":"back","average":{"1min":0.68300000000000005,"5min":0.72799999999999998,"15min":0.74199999999999999},"min":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":0.96699999999999997,"5min":1.056,"15min":1.056},"last":0.75900000000000001},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.66600000000000004,"15min":0.67800000000000005},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":0.78200000000000003,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.80800000000000005}]},{"osd":4,"last update":"Tue Nov 28 20:01:54 2023","interfaces":[{"interface":"back","average":{"1min":0.61299999999999999,"5min":0.624,"15min":0.628},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.93300000000000005,"5min":0.97599999999999998,"15min":0.97599999999999998},"last":0.57599999999999996},{"interface":"front","average":{"1min":0.61499999999999999,"5min":0.68700000000000006,"15min":0.72099999999999997},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.91700000000000004,"5min":1.389,"15min":1.389},"last":0.64000000000000001}]},{"osd":5,"last update":"Tue Nov 28 20:01:54 2023","interfaces":[{"interface":"back","average":{"1min":0.68799999999999994,"5min":0.77100000000000002,"15min":0.80100000000000005},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":1.0629999999999999,"5min":1.4259999999999999,"15min":1.4259999999999999},"last":0.60499999999999998},{"interface":"front","average":{"1min":0.65600000000000003,"5min":0.72999999999999998,"15min":0.752},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.97099999999999997,"5min":1.276,"15min":1.276},"last":0.624}]},{"osd":7,"last update":"Tue Nov 28 20:01:54 2023","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.67900000000000005,"15min":0.70299999999999996},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.84199999999999997,"5min":1.014,"15min":1.014},"last":0.88},{"interface":"front","average":{"1min":0.68200000000000005,"5min":0.77900000000000003,"15min":0.81299999999999994},"min":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":1.002,"5min":1.242,"15min":1.242},"last":0.90000000000000002}]}]},{"osd":5,"up_from":13,"seq":55834574892,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32156,"kb_used_data":976,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339684,"statfs":{"total":96636764160,"available":96603836416,"internally_reserved":0,"allocated":999424,"data_stored":469551,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 20:01:59 2023","interfaces":[{"interface":"back","average":{"1min":0.66500000000000004,"5min":0.68400000000000005,"15min":0.70099999999999996},"min":{"1min":0.44400000000000001,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":1.077,"5min":1.077,"15min":1.077},"last":0.625},{"interface":"front","average":{"1min":0.65300000000000002,"5min":0.68500000000000005,"15min":0.70699999999999996},"min":{"1min":0.41899999999999998,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.94599999999999995,"5min":1.149,"15min":1.149},"last":0.56599999999999995}]},{"osd":1,"last update":"Tue Nov 28 20:01:59 2023","interfaces":[{"interface":"back","average":{"1min":0.626,"5min":0.68600000000000005,"15min":0.70399999999999996},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.82599999999999996,"5min":0.94499999999999995,"15min":0.94499999999999995},"last":0.42599999999999999},{"interface":"front","average":{"1min":0.67400000000000004,"5min":0.69299999999999995,"15min":0.71699999999999997},"min":{"1min":0.49099999999999999,"5min":0.38,"15min":0.38},"max":{"1min":1.008,"5min":1.0940000000000001,"15min":1.0940000000000001},"last":0.78300000000000003}]},{"osd":2,"last update":"Tue Nov 28 20:01:59 2023","interfaces":[{"interface":"back","average":{"1min":0.65400000000000003,"5min":0.83299999999999996,"15min":0.90800000000000003},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":1.044,"5min":5.0880000000000001,"15min":5.0880000000000001},"last":0.72499999999999998},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.879,"15min":0.96099999999999997},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":0.91300000000000003,"5min":5.1399999999999997,"15min":5.1399999999999997},"last":0.48499999999999999}]},{"osd":3,"last update":"Tue Nov 28 20:01:59 2023","interfaces":[{"interface":"back","average":{"1min":0.71499999999999997,"5min":0.90100000000000002,"15min":0.98499999999999999},"min":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":1.1000000000000001,"5min":5.0469999999999997,"15min":5.0469999999999997},"last":0.84899999999999998},{"interface":"front","average":{"1min":0.69999999999999996,"5min":0.878,"15min":0.95999999999999996},"min":{"1min":0.47899999999999998,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":0.95899999999999996,"5min":5.024,"15min":5.024},"last":0.747}]},{"osd":4,"last update":"Tue Nov 28 20:01:59 2023","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.64000000000000001,"15min":0.66400000000000003},"min":{"1min":0.42899999999999999,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.877,"5min":1.4810000000000001,"15min":1.4810000000000001},"last":0.872},{"interface":"front","average":{"1min":0.67300000000000004,"5min":0.72099999999999997,"15min":0.73799999999999999},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.97599999999999998,"5min":1.6339999999999999,"15min":1.6339999999999999},"last":0.76600000000000001}]},{"osd":6,"last update":"Tue Nov 28 20:01:59 2023","interfaces":[{"interface":"back","average":{"1min":0.70699999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"min":{"1min":0.48399999999999999,"5min":0.434,"15min":0.434},"max":{"1min":1.0489999999999999,"5min":1.0489999999999999,"15min":1.0489999999999999},"last":0.80800000000000005},{"interface":"front","average":{"1min":0.68899999999999995,"5min":0.72499999999999998,"15min":0.73999999999999999},"min":{"1min":0.47599999999999998,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":0.93200000000000005,"5min":1.099,"15min":1.099},"last":0.96299999999999997}]},{"osd":7,"last update":"Tue Nov 28 20:01:59 2023","interfaces":[{"interface":"back","average":{"1min":0.73599999999999999,"5min":0.77300000000000002,"15min":0.78200000000000003},"min":{"1min":0.48899999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":1.022,"5min":1.236,"15min":1.236},"last":0.89500000000000002},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.78300000000000003,"15min":0.79500000000000004},"min":{"1min":0.51100000000000001,"5min":0.505,"15min":0.505},"max":{"1min":1.1000000000000001,"5min":1.1000000000000001,"15min":1.1000000000000001},"last":0.66200000000000003}]}]},{"osd":4,"up_from":13,"seq":55834574891,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32164,"kb_used_data":984,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339676,"statfs":{"total":96636764160,"available":96603828224,"internally_reserved":0,"allocated":1007616,"data_stored":469711,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 20:01:58 2023","interfaces":[{"interface":"back","average":{"1min":0.70799999999999996,"5min":0.69399999999999995,"15min":0.70499999999999996},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":1.107,"5min":1.107,"15min":1.107},"last":0.66900000000000004},{"interface":"front","average":{"1min":0.63200000000000001,"5min":0.68300000000000005,"15min":0.70299999999999996},"min":{"1min":0.42799999999999999,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":1.024,"5min":1.163,"15min":1.163},"last":0.45600000000000002}]},{"osd":1,"last update":"Tue Nov 28 20:01:58 2023","interfaces":[{"interface":"back","average":{"1min":0.64400000000000002,"5min":0.71199999999999997,"15min":0.746},"min":{"1min":0.432,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.93799999999999994,"5min":1.111,"15min":1.111},"last":0.57699999999999996},{"interface":"front","average":{"1min":0.77600000000000002,"5min":0.78000000000000003,"15min":0.80200000000000005},"min":{"1min":0.629,"5min":0.443,"15min":0.443},"max":{"1min":1.0640000000000001,"5min":1.238,"15min":1.238},"last":0.51700000000000002}]},{"osd":2,"last update":"Tue Nov 28 20:01:58 2023","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.751,"15min":0.77200000000000002},"min":{"1min":0.48599999999999999,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":1.026,"5min":1.0669999999999999,"15min":1.0669999999999999},"last":0.622},{"interface":"front","average":{"1min":0.754,"5min":0.77400000000000002,"15min":0.80200000000000005},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":1.1359999999999999,"5min":1.1359999999999999,"15min":1.1359999999999999},"last":0.63600000000000001}]},{"osd":3,"last update":"Tue Nov 28 20:01:58 2023","interfaces":[{"interface":"back","average":{"1min":0.69199999999999995,"5min":0.74399999999999999,"15min":0.78200000000000003},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":0.97999999999999998,"5min":1.202,"15min":1.202},"last":0.59899999999999998},{"interface":"front","average":{"1min":0.74199999999999999,"5min":0.76100000000000001,"15min":0.78400000000000003},"min":{"1min":0.52800000000000002,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":1.0669999999999999,"5min":1.0669999999999999,"15min":1.0669999999999999},"last":0.64900000000000002}]},{"osd":5,"last update":"Tue Nov 28 20:01:58 2023","interfaces":[{"interface":"back","average":{"1min":0.68600000000000005,"5min":0.69499999999999995,"15min":0.71399999999999997},"min":{"1min":0.41199999999999998,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.89600000000000002,"5min":0.95899999999999996,"15min":0.95899999999999996},"last":0.38400000000000001},{"interface":"front","average":{"1min":0.65600000000000003,"5min":0.68400000000000005,"15min":0.70399999999999996},"min":{"1min":0.435,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.90500000000000003,"5min":1.034,"15min":1.034},"last":0.40600000000000003}]},{"osd":6,"last update":"Tue Nov 28 20:01:58 2023","interfaces":[{"interface":"back","average":{"1min":0.64500000000000002,"5min":0.69099999999999995,"15min":0.71999999999999997},"min":{"1min":0.45300000000000001,"5min":0.438,"15min":0.438},"max":{"1min":0.85299999999999998,"5min":1.0309999999999999,"15min":1.0309999999999999},"last":0.48699999999999999},{"interface":"front","average":{"1min":0.76300000000000001,"5min":0.76600000000000001,"15min":0.77800000000000002},"min":{"1min":0.55400000000000005,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":0.93999999999999995,"5min":1.002,"15min":1.002},"last":0.55900000000000005}]},{"osd":7,"last update":"Tue Nov 28 20:01:58 2023","interfaces":[{"interface":"back","average":{"1min":0.72699999999999998,"5min":0.75900000000000001,"15min":0.77800000000000002},"min":{"1min":0.57399999999999995,"5min":0.495,"15min":0.495},"max":{"1min":1.089,"5min":1.089,"15min":1.089},"last":0.53900000000000003},{"interface":"front","average":{"1min":0.81599999999999995,"5min":0.83699999999999997,"15min":0.85899999999999999},"min":{"1min":0.621,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":1.042,"5min":1.1459999999999999,"15min":1.1459999999999999},"last":0.68200000000000005}]}]},{"osd":3,"up_from":13,"seq":55834574892,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32156,"kb_used_data":976,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339684,"statfs":{"total":96636764160,"available":96603836416,"internally_reserved":0,"allocated":999424,"data_stored":469551,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 20:01:56 2023","interfaces":[{"interface":"back","average":{"1min":0.44900000000000001,"5min":0.441,"15min":0.44500000000000001},"min":{"1min":0.26300000000000001,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":1.7130000000000001,"5min":1.7130000000000001,"15min":1.7130000000000001},"last":0.45800000000000002},{"interface":"front","average":{"1min":0.51400000000000001,"5min":0.46600000000000003,"15min":0.47099999999999997},"min":{"1min":0.27100000000000002,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":3.0630000000000002,"5min":3.0630000000000002,"15min":3.0630000000000002},"last":0.435}]},{"osd":1,"last update":"Tue Nov 28 20:01:56 2023","interfaces":[{"interface":"back","average":{"1min":0.44600000000000001,"5min":0.45800000000000002,"15min":0.47399999999999998},"min":{"1min":0.317,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.89200000000000002,"5min":0.89200000000000002,"15min":0.89200000000000002},"last":0.34399999999999997},{"interface":"front","average":{"1min":0.65600000000000003,"5min":0.52200000000000002,"15min":0.51000000000000001},"min":{"1min":0.34200000000000003,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":5.8920000000000003,"5min":5.8920000000000003,"15min":5.8920000000000003},"last":0.36099999999999999}]},{"osd":2,"last update":"Tue Nov 28 20:01:56 2023","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.54800000000000004,"15min":0.53800000000000003},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":4.6390000000000002,"5min":4.6390000000000002,"15min":4.6390000000000002},"last":0.39200000000000002},{"interface":"front","average":{"1min":0.95099999999999996,"5min":0.63900000000000001,"15min":0.60299999999999998},"min":{"1min":0.40899999999999997,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":11.593,"5min":11.593,"15min":11.593},"last":0.47499999999999998}]},{"osd":4,"last update":"Tue Nov 28 20:01:56 2023","interfaces":[{"interface":"back","average":{"1min":0.91100000000000003,"5min":0.79400000000000004,"15min":0.77200000000000002},"min":{"1min":0.46600000000000003,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":5.5549999999999997,"5min":5.5549999999999997,"15min":5.5549999999999997},"last":0.90900000000000003},{"interface":"front","average":{"1min":1.179,"5min":0.879,"15min":0.82799999999999996},"min":{"1min":0.60999999999999999,"5min":0.503,"15min":0.503},"max":{"1min":11.747,"5min":11.747,"15min":11.747},"last":0.89700000000000002}]},{"osd":5,"last update":"Tue Nov 28 20:01:56 2023","interfaces":[{"interface":"back","average":{"1min":1.1040000000000001,"5min":0.85699999999999998,"15min":0.81899999999999995},"min":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":11.705,"5min":11.705,"15min":11.705},"last":0.81999999999999995},{"interface":"front","average":{"1min":0.70399999999999996,"5min":0.77100000000000002,"15min":0.79200000000000004},"min":{"1min":0.51200000000000001,"5min":0.495,"15min":0.495},"max":{"1min":1.0580000000000001,"5min":1.3100000000000001,"15min":1.3100000000000001},"last":0.92400000000000004}]},{"osd":6,"last update":"Tue Nov 28 20:01:56 2023","interfaces":[{"interface":"back","average":{"1min":0.748,"5min":0.81899999999999995,"15min":0.83499999999999996},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":1.6639999999999999,"5min":1.6639999999999999,"15min":1.6639999999999999},"last":0.77600000000000002},{"interface":"front","average":{"1min":0.84499999999999997,"5min":0.80400000000000005,"15min":0.76700000000000002},"min":{"1min":0.52900000000000003,"5min":0.495,"15min":0.495},"max":{"1min":3.1459999999999999,"5min":4.0679999999999996,"15min":4.0679999999999996},"last":0.84499999999999997}]},{"osd":7,"last update":"Tue Nov 28 20:01:56 2023","interfaces":[{"interface":"back","average":{"1min":0.96199999999999997,"5min":0.89600000000000002,"15min":0.86499999999999999},"min":{"1min":0.52100000000000002,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":6.6619999999999999,"5min":6.6619999999999999,"15min":6.6619999999999999},"last":0.88400000000000001},{"interface":"front","average":{"1min":1.141,"5min":0.92300000000000004,"15min":0.90100000000000002},"min":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":11.782,"5min":11.782,"15min":11.782},"last":0.86699999999999999}]}]},{"osd":2,"up_from":13,"seq":55834574890,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32156,"kb_used_data":976,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339684,"statfs":{"total":96636764160,"available":96603836416,"internally_reserved":0,"allocated":999424,"data_stored":469551,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 20:01:57 2023","interfaces":[{"interface":"back","average":{"1min":0.39600000000000002,"5min":0.438,"15min":0.45000000000000001},"min":{"1min":0.28899999999999998,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.60399999999999998,"5min":0.74099999999999999,"15min":0.74099999999999999},"last":0.41399999999999998},{"interface":"front","average":{"1min":0.435,"5min":0.46100000000000002,"15min":0.47499999999999998},"min":{"1min":0.30199999999999999,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.59599999999999997,"5min":0.67700000000000005,"15min":0.67700000000000005},"last":0.46000000000000002}]},{"osd":1,"last update":"Tue Nov 28 20:01:57 2023","interfaces":[{"interface":"back","average":{"1min":0.47699999999999998,"5min":0.48999999999999999,"15min":0.50600000000000001},"min":{"1min":0.377,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.64500000000000002,"5min":1.0389999999999999,"15min":1.0389999999999999},"last":0.48599999999999999},{"interface":"front","average":{"1min":0.45100000000000001,"5min":0.47999999999999998,"15min":0.496},"min":{"1min":0.33800000000000002,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.58999999999999997,"5min":0.70999999999999996,"15min":0.70999999999999996},"last":0.375}]},{"osd":3,"last update":"Tue Nov 28 20:01:57 2023","interfaces":[{"interface":"back","average":{"1min":0.45700000000000002,"5min":0.46300000000000002,"15min":0.46899999999999997},"min":{"1min":0.36899999999999999,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.60299999999999998,"5min":0.629,"15min":0.629},"last":0.39400000000000002},{"interface":"front","average":{"1min":0.52300000000000002,"5min":0.55900000000000005,"15min":0.58099999999999996},"min":{"1min":0.41599999999999998,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.58899999999999997,"5min":0.98499999999999999,"15min":0.98499999999999999},"last":0.504}]},{"osd":4,"last update":"Tue Nov 28 20:01:57 2023","interfaces":[{"interface":"back","average":{"1min":0.69399999999999995,"5min":0.80300000000000005,"15min":0.84199999999999997},"min":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":0.86899999999999999,"5min":1.139,"15min":1.139},"last":0.747},{"interface":"front","average":{"1min":0.70199999999999996,"5min":0.79600000000000004,"15min":0.83399999999999996},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":1.008,"5min":1.238,"15min":1.238},"last":0.64500000000000002}]},{"osd":5,"last update":"Tue Nov 28 20:01:57 2023","interfaces":[{"interface":"back","average":{"1min":0.70799999999999996,"5min":0.81200000000000006,"15min":0.85999999999999999},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":1.0389999999999999,"5min":1.6180000000000001,"15min":1.6180000000000001},"last":0.80800000000000005},{"interface":"front","average":{"1min":0.70699999999999996,"5min":0.78400000000000003,"15min":0.81799999999999995},"min":{"1min":0.51800000000000002,"5min":0.496,"15min":0.496},"max":{"1min":1.0149999999999999,"5min":1.339,"15min":1.339},"last":0.78300000000000003}]},{"osd":6,"last update":"Tue Nov 28 20:01:57 2023","interfaces":[{"interface":"back","average":{"1min":0.71399999999999997,"5min":0.77300000000000002,"15min":0.79500000000000004},"min":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":1.0589999999999999,"5min":1.1839999999999999,"15min":1.1839999999999999},"last":0.87},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.80300000000000005,"15min":0.84199999999999997},"min":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":0.98699999999999999,"5min":1.099,"15min":1.099},"last":0.81799999999999995}]},{"osd":7,"last update":"Tue Nov 28 20:01:57 2023","interfaces":[{"interface":"back","average":{"1min":0.69599999999999995,"5min":0.82199999999999995,"15min":0.86699999999999999},"min":{"1min":0.53300000000000003,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":0.94699999999999995,"5min":1.4590000000000001,"15min":1.4590000000000001},"last":0.76400000000000001},{"interface":"front","average":{"1min":0.73199999999999998,"5min":0.80900000000000005,"15min":0.84699999999999998},"min":{"1min":0.55200000000000005,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":1.0760000000000001,"5min":1.387,"15min":1.387},"last":0.71699999999999997}]}]},{"osd":1,"up_from":13,"seq":55834574892,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32160,"kb_used_data":980,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339680,"statfs":{"total":96636764160,"available":96603832320,"internally_reserved":0,"allocated":1003520,"data_stored":469621,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":10,"apply_latency_ms":10,"commit_latency_ns":10000000,"apply_latency_ns":10000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 20:02:00 2023","interfaces":[{"interface":"back","average":{"1min":0.38700000000000001,"5min":0.54600000000000004,"15min":0.62},"min":{"1min":0.249,"5min":0.249,"15min":0.249},"max":{"1min":0.60699999999999998,"5min":3.8740000000000001,"15min":3.8740000000000001},"last":0.30299999999999999},{"interface":"front","average":{"1min":0.42099999999999999,"5min":0.51000000000000001,"15min":0.55100000000000005},"min":{"1min":0.32300000000000001,"5min":0.25,"15min":0.25},"max":{"1min":0.60399999999999998,"5min":2.0760000000000001,"15min":2.0760000000000001},"last":0.40200000000000002}]},{"osd":2,"last update":"Tue Nov 28 20:02:00 2023","interfaces":[{"interface":"back","average":{"1min":0.41399999999999998,"5min":0.56000000000000005,"15min":0.626},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.70799999999999996,"5min":3.7320000000000002,"15min":3.7320000000000002},"last":0.33400000000000002},{"interface":"front","average":{"1min":0.46899999999999997,"5min":0.63400000000000001,"15min":0.71799999999999997},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.67000000000000004,"5min":3.9089999999999998,"15min":3.9089999999999998},"last":0.42899999999999999}]},{"osd":3,"last update":"Tue Nov 28 20:02:00 2023","interfaces":[{"interface":"back","average":{"1min":0.52200000000000002,"5min":0.61799999999999999,"15min":0.66000000000000003},"min":{"1min":0.436,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.70799999999999996,"5min":1.6399999999999999,"15min":1.6399999999999999},"last":0.49399999999999999},{"interface":"front","average":{"1min":0.45500000000000002,"5min":0.61599999999999999,"15min":0.67400000000000004},"min":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.625,"5min":2.5270000000000001,"15min":2.5270000000000001},"last":0.45200000000000001}]},{"osd":4,"last update":"Tue Nov 28 20:02:00 2023","interfaces":[{"interface":"back","average":{"1min":0.69799999999999995,"5min":0.81699999999999995,"15min":0.86899999999999999},"min":{"1min":0.42199999999999999,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.91400000000000003,"5min":3.1659999999999999,"15min":3.1659999999999999},"last":0.75800000000000001},{"interface":"front","average":{"1min":0.69699999999999995,"5min":0.84399999999999997,"15min":0.91200000000000003},"min":{"1min":0.52300000000000002,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.94299999999999995,"5min":3.7959999999999998,"15min":3.7959999999999998},"last":0.74099999999999999}]},{"osd":5,"last update":"Tue Nov 28 20:02:00 2023","interfaces":[{"interface":"back","average":{"1min":0.71399999999999997,"5min":0.875,"15min":0.95099999999999996},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":1.004,"5min":4.1479999999999997,"15min":4.1479999999999997},"last":0.82699999999999996},{"interface":"front","average":{"1min":0.69799999999999995,"5min":0.82599999999999996,"15min":0.88200000000000001},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":0.87,"5min":3.5569999999999999,"15min":3.5569999999999999},"last":0.67300000000000004}]},{"osd":6,"last update":"Tue Nov 28 20:02:00 2023","interfaces":[{"interface":"back","average":{"1min":0.72399999999999998,"5min":0.88800000000000001,"15min":0.95699999999999996},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":0.94499999999999995,"5min":2.863,"15min":2.863},"last":0.78900000000000003},{"interface":"front","average":{"1min":0.76800000000000002,"5min":0.89800000000000002,"15min":0.95399999999999996},"min":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":0.97999999999999998,"5min":3.371,"15min":3.371},"last":0.81000000000000005}]},{"osd":7,"last update":"Tue Nov 28 20:02:00 2023","interfaces":[{"interface":"back","average":{"1min":0.70299999999999996,"5min":0.89100000000000001,"15min":0.97199999999999998},"min":{"1min":0.53100000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":0.93600000000000005,"5min":3.8439999999999999,"15min":3.8439999999999999},"last":0.77500000000000002},{"interface":"front","average":{"1min":0.68799999999999994,"5min":0.90500000000000003,"15min":0.99299999999999999},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.95899999999999996,"5min":3.9689999999999999,"15min":3.9689999999999999},"last":0.85299999999999998}]}]},{"osd":0,"up_from":13,"seq":55834574891,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32252,"kb_used_data":1064,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339588,"statfs":{"total":96636764160,"available":96603738112,"internally_reserved":0,"allocated":1089536,"data_stored":1062237,"data_compressed":33374,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Nov 28 20:01:57 2023","interfaces":[{"interface":"back","average":{"1min":0.38700000000000001,"5min":0.57399999999999995,"15min":0.65100000000000002},"min":{"1min":0.24099999999999999,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":0.68400000000000005,"5min":4.883,"15min":4.883},"last":0.29599999999999999},{"interface":"front","average":{"1min":0.43099999999999999,"5min":0.70099999999999996,"15min":0.81899999999999995},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.66800000000000004,"5min":8.0800000000000001,"15min":8.0800000000000001},"last":0.35699999999999998}]},{"osd":2,"last update":"Tue Nov 28 20:01:57 2023","interfaces":[{"interface":"back","average":{"1min":0.50800000000000001,"5min":0.77400000000000002,"15min":0.90700000000000003},"min":{"1min":0.312,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.85599999999999998,"5min":8.1029999999999998,"15min":8.1029999999999998},"last":0.54800000000000004},{"interface":"front","average":{"1min":0.53300000000000003,"5min":0.79400000000000004,"15min":0.92200000000000004},"min":{"1min":0.40600000000000003,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.748,"5min":8.1310000000000002,"15min":8.1310000000000002},"last":0.53600000000000003}]},{"osd":3,"last update":"Tue Nov 28 20:01:57 2023","interfaces":[{"interface":"back","average":{"1min":0.47299999999999998,"5min":0.628,"15min":0.70699999999999996},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.873,"5min":4.3949999999999996,"15min":4.3949999999999996},"last":0.33100000000000002},{"interface":"front","average":{"1min":0.497,"5min":0.65100000000000002,"15min":0.72099999999999997},"min":{"1min":0.37,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.89200000000000002,"5min":4.3470000000000004,"15min":4.3470000000000004},"last":0.48999999999999999}]},{"osd":4,"last update":"Tue Nov 28 20:01:57 2023","interfaces":[{"interface":"back","average":{"1min":0.72799999999999998,"5min":0.92000000000000004,"15min":1.0069999999999999},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":1.038,"5min":4.6360000000000001,"15min":4.6360000000000001},"last":0.80100000000000005},{"interface":"front","average":{"1min":0.76800000000000002,"5min":0.93400000000000005,"15min":1.0129999999999999},"min":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":1.0820000000000001,"5min":4.4710000000000001,"15min":4.4710000000000001},"last":0.872}]},{"osd":5,"last update":"Tue Nov 28 20:01:57 2023","interfaces":[{"interface":"back","average":{"1min":0.72599999999999998,"5min":0.93200000000000005,"15min":1.02},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":0.97599999999999998,"5min":4.6120000000000001,"15min":4.6120000000000001},"last":0.85599999999999998},{"interface":"front","average":{"1min":0.78600000000000003,"5min":0.93600000000000005,"15min":1.0129999999999999},"min":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.1319999999999999,"5min":4.5449999999999999,"15min":4.5449999999999999},"last":0.88200000000000001}]},{"osd":6,"last update":"Tue Nov 28 20:01:57 2023","interfaces":[{"interface":"back","average":{"1min":0.755,"5min":0.94499999999999995,"15min":1.034},"min":{"1min":0.53600000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":1.0580000000000001,"5min":4.657,"15min":4.657},"last":0.82799999999999996},{"interface":"front","average":{"1min":0.75700000000000001,"5min":0.95799999999999996,"15min":1.05},"min":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":1.0049999999999999,"5min":4.5259999999999998,"15min":4.5259999999999998},"last":0.79100000000000004}]},{"osd":7,"last update":"Tue Nov 28 20:01:57 2023","interfaces":[{"interface":"back","average":{"1min":0.73799999999999999,"5min":0.95199999999999996,"15min":1.0509999999999999},"min":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":1.081,"5min":4.7320000000000002,"15min":4.7320000000000002},"last":0.89500000000000002},{"interface":"front","average":{"1min":0.76300000000000001,"5min":0.93100000000000005,"15min":1.0069999999999999},"min":{"1min":0.58699999999999997,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":1.099,"5min":4.4939999999999998,"15min":4.4939999999999998},"last":0.84199999999999997}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33374,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33374,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":2318,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2216,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-28T20:02:17.216 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-11-28T20:02:17.216 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-11-28T20:02:17.398 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:17.392+0000 7fe53359e640 1 Processor -- start 2023-11-28T20:02:17.398 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:17.392+0000 7fe53359e640 1 -- start start 2023-11-28T20:02:17.399 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:17.396+0000 7fe53359e640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe5340a6cc0 0x7fe5340a70a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:17.400 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:17.396+0000 7fe53359e640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fe5340c1950 0x7fe534154ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:17.400 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:17.396+0000 7fe53359e640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe5340c4ea0 con 0x7fe5340c6ae0 2023-11-28T20:02:17.400 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:17.396+0000 7fe53359e640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe534155420 con 0x7fe5340c1950 2023-11-28T20:02:17.400 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:17.396+0000 7fe53359e640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe534070730 con 0x7fe5340a6cc0 2023-11-28T20:02:17.400 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:17.396+0000 7fe532d9d640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7fe5340c6ae0 0x7fe534070020 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:41702/0 (socket says 172.21.15.78:41702) 2023-11-28T20:02:17.400 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:17.396+0000 7fe532d9d640 1 -- 172.21.15.78:0/2120971695 learned_addr learned my addr 172.21.15.78:0/2120971695 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-11-28T20:02:17.400 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:17.396+0000 7fe531d9b640 1 --2- 172.21.15.78:0/2120971695 >> v2:172.21.15.179:3300/0 conn(0x7fe5340c1950 0x7fe534154ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:02:17.400 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:17.396+0000 7fe53259c640 1 --2- 172.21.15.78:0/2120971695 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe5340a6cc0 0x7fe5340a70a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:02:17.400 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:17.396+0000 7fe53159a640 1 -- 172.21.15.78:0/2120971695 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1421998694 0 0) 0x7fe52c001120 con 0x7fe5340c6ae0 2023-11-28T20:02:17.401 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:17.396+0000 7fe53159a640 1 -- 172.21.15.78:0/2120971695 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe51c003530 con 0x7fe5340c6ae0 2023-11-28T20:02:17.401 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:17.396+0000 7fe53259c640 1 -- 172.21.15.78:0/2120971695 >> v2:172.21.15.179:3300/0 conn(0x7fe5340c1950 msgr2=0x7fe534154ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:02:17.401 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:17.396+0000 7fe53259c640 1 --2- 172.21.15.78:0/2120971695 >> v2:172.21.15.179:3300/0 conn(0x7fe5340c1950 0x7fe534154ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:17.401 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:17.396+0000 7fe53259c640 1 -- 172.21.15.78:0/2120971695 >> v1:172.21.15.78:6789/0 conn(0x7fe5340c6ae0 legacy=0x7fe534070020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:02:17.401 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:17.396+0000 7fe53259c640 1 -- 172.21.15.78:0/2120971695 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe53406ef80 con 0x7fe5340a6cc0 2023-11-28T20:02:17.403 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:17.400+0000 7fe53259c640 1 --2- 172.21.15.78:0/2120971695 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe5340a6cc0 0x7fe5340a70a0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fe524009d90 tx=0x7fe52401f130 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7547c51a209d080f server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:02:17.403 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:17.400+0000 7fe53159a640 1 -- 172.21.15.78:0/2120971695 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5240af600 con 0x7fe5340a6cc0 2023-11-28T20:02:17.403 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:17.400+0000 7fe53159a640 1 -- 172.21.15.78:0/2120971695 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe5240ab050 con 0x7fe5340a6cc0 2023-11-28T20:02:17.404 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:17.400+0000 7fe53159a640 1 -- 172.21.15.78:0/2120971695 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5240af960 con 0x7fe5340a6cc0 2023-11-28T20:02:17.405 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:17.400+0000 7fe53359e640 1 -- 172.21.15.78:0/2120971695 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe5340a6cc0 msgr2=0x7fe5340a70a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:02:17.405 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:17.400+0000 7fe53359e640 1 --2- 172.21.15.78:0/2120971695 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe5340a6cc0 0x7fe5340a70a0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fe524009d90 tx=0x7fe52401f130 comp rx=0 tx=0).stop 2023-11-28T20:02:17.405 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:17.400+0000 7fe53359e640 1 -- 172.21.15.78:0/2120971695 shutdown_connections 2023-11-28T20:02:17.405 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:17.400+0000 7fe53359e640 1 --2- 172.21.15.78:0/2120971695 >> v2:172.21.15.179:3300/0 conn(0x7fe5340c1950 0x7fe534154ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:17.405 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:17.400+0000 7fe53359e640 1 --2- 172.21.15.78:0/2120971695 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe5340a6cc0 0x7fe5340a70a0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:17.405 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:17.400+0000 7fe53359e640 1 -- 172.21.15.78:0/2120971695 >> 172.21.15.78:0/2120971695 conn(0x7fe5340662a0 msgr2=0x7fe5340666b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:02:17.405 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:17.400+0000 7fe53359e640 1 -- 172.21.15.78:0/2120971695 shutdown_connections 2023-11-28T20:02:17.405 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:17.400+0000 7fe53359e640 1 -- 172.21.15.78:0/2120971695 wait complete. 2023-11-28T20:02:17.406 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:17.400+0000 7fe53359e640 1 Processor -- start 2023-11-28T20:02:17.406 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:17.400+0000 7fe53359e640 1 -- start start 2023-11-28T20:02:17.407 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:17.404+0000 7fe53359e640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe5340a6cc0 0x7fe53414ce60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:17.407 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:17.404+0000 7fe53359e640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe5340c1950 0x7fe5341539d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:17.408 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:17.404+0000 7fe53359e640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe5340c6ae0 0x7fe5340a8600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:17.408 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:17.404+0000 7fe53359e640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe534156130 con 0x7fe5340c1950 2023-11-28T20:02:17.408 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:17.404+0000 7fe53359e640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5341edfd0 con 0x7fe5340a6cc0 2023-11-28T20:02:17.408 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:17.404+0000 7fe53359e640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe5341ed3c0 con 0x7fe5340c6ae0 2023-11-28T20:02:17.408 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:17.404+0000 7fe531d9b640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe5340c1950 0x7fe5341539d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:02:17.408 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:17.404+0000 7fe531d9b640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe5340c1950 0x7fe5341539d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:54254/0 (socket says 172.21.15.78:54254) 2023-11-28T20:02:17.408 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:17.404+0000 7fe531d9b640 1 -- 172.21.15.78:0/1503678317 learned_addr learned my addr 172.21.15.78:0/1503678317 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T20:02:17.410 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:17.404+0000 7fe53259c640 1 --2- 172.21.15.78:0/1503678317 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe5340a6cc0 0x7fe53414ce60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:02:17.410 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:17.404+0000 7fe532d9d640 1 --2- 172.21.15.78:0/1503678317 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe5340c6ae0 0x7fe5340a8600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:02:17.410 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:17.404+0000 7fe531d9b640 1 -- 172.21.15.78:0/1503678317 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe5340c6ae0 msgr2=0x7fe5340a8600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:02:17.410 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:17.404+0000 7fe531d9b640 1 --2- 172.21.15.78:0/1503678317 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe5340c6ae0 0x7fe5340a8600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:17.410 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:17.404+0000 7fe531d9b640 1 -- 172.21.15.78:0/1503678317 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe5340a6cc0 msgr2=0x7fe53414ce60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:02:17.410 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:17.404+0000 7fe531d9b640 1 --2- 172.21.15.78:0/1503678317 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe5340a6cc0 0x7fe53414ce60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:17.410 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:17.404+0000 7fe531d9b640 1 -- 172.21.15.78:0/1503678317 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe524009a70 con 0x7fe5340c1950 2023-11-28T20:02:17.410 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:17.404+0000 7fe53259c640 1 --2- 172.21.15.78:0/1503678317 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe5340a6cc0 0x7fe53414ce60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T20:02:17.410 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:17.404+0000 7fe532d9d640 1 --2- 172.21.15.78:0/1503678317 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe5340c6ae0 0x7fe5340a8600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T20:02:17.411 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:17.404+0000 7fe531d9b640 1 --2- 172.21.15.78:0/1503678317 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe5340c1950 0x7fe5341539d0 secure :-1 s=READY pgs=914 cs=0 l=1 rev1=1 crypto rx=0x7fe52800e930 tx=0x7fe52800edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:02:17.411 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:17.404+0000 7fe522ffd640 1 -- 172.21.15.78:0/1503678317 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe528009690 con 0x7fe5340c1950 2023-11-28T20:02:17.411 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:17.404+0000 7fe522ffd640 1 -- 172.21.15.78:0/1503678317 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe52800ca00 con 0x7fe5340c1950 2023-11-28T20:02:17.411 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:17.404+0000 7fe522ffd640 1 -- 172.21.15.78:0/1503678317 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe52800cd70 con 0x7fe5340c1950 2023-11-28T20:02:17.411 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:17.404+0000 7fe53359e640 1 -- 172.21.15.78:0/1503678317 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe5341ed6a0 con 0x7fe5340c1950 2023-11-28T20:02:17.411 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:17.404+0000 7fe53359e640 1 -- 172.21.15.78:0/1503678317 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe5341edc60 con 0x7fe5340c1950 2023-11-28T20:02:17.411 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:17.404+0000 7fe53359e640 1 -- 172.21.15.78:0/1503678317 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe5341ee140 con 0x7fe5340c1950 2023-11-28T20:02:17.412 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:17.404+0000 7fe522ffd640 1 -- 172.21.15.78:0/1503678317 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fe528013470 con 0x7fe5340c1950 2023-11-28T20:02:17.412 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:17.408+0000 7fe522ffd640 1 --2- 172.21.15.78:0/1503678317 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fe514066470 0x7fe514068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:17.412 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:17.408+0000 7fe522ffd640 1 -- 172.21.15.78:0/1503678317 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6029+0+0 (secure 0 0 0) 0x7fe528084180 con 0x7fe5340c1950 2023-11-28T20:02:17.412 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:17.408+0000 7fe53259c640 1 --2- 172.21.15.78:0/1503678317 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fe514066470 0x7fe514068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:02:17.412 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:17.408+0000 7fe53259c640 1 --2- 172.21.15.78:0/1503678317 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fe514066470 0x7fe514068930 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7fe5240b1000 tx=0x7fe5240aa000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:02:17.416 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:17.412+0000 7fe522ffd640 1 -- 172.21.15.78:0/1503678317 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fe528051610 con 0x7fe5340c1950 2023-11-28T20:02:17.619 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:17.616+0000 7fe53359e640 1 -- 172.21.15.78:0/1503678317 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7fe5340674b0 con 0x7fe5340c1950 2023-11-28T20:02:17.621 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:17.616+0000 7fe522ffd640 1 -- 172.21.15.78:0/1503678317 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v21) v1 ==== 190+0+147 (secure 0 0 0) 0x7fe528054c30 con 0x7fe5340c1950 2023-11-28T20:02:17.622 INFO:teuthology.orchestra.run.smithi078.stdout:[client.0] 2023-11-28T20:02:17.622 INFO:teuthology.orchestra.run.smithi078.stdout: key = AQBORmZlPLeINhAAMdB7hy84hvX1S/pHYfkeJg== 2023-11-28T20:02:17.622 INFO:teuthology.orchestra.run.smithi078.stdout: caps mds = "allow" 2023-11-28T20:02:17.622 INFO:teuthology.orchestra.run.smithi078.stdout: caps mon = "allow r" 2023-11-28T20:02:17.622 INFO:teuthology.orchestra.run.smithi078.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2023-11-28T20:02:17.622 INFO:teuthology.orchestra.run.smithi078.stderr:updated caps for client.0 2023-11-28T20:02:17.625 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:17.620+0000 7fe53359e640 1 -- 172.21.15.78:0/1503678317 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fe514066470 msgr2=0x7fe514068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:02:17.625 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:17.620+0000 7fe53359e640 1 --2- 172.21.15.78:0/1503678317 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fe514066470 0x7fe514068930 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7fe5240b1000 tx=0x7fe5240aa000 comp rx=0 tx=0).stop 2023-11-28T20:02:17.625 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:17.620+0000 7fe53359e640 1 -- 172.21.15.78:0/1503678317 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe5340c1950 msgr2=0x7fe5341539d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:02:17.625 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:17.620+0000 7fe53359e640 1 --2- 172.21.15.78:0/1503678317 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe5340c1950 0x7fe5341539d0 secure :-1 s=READY pgs=914 cs=0 l=1 rev1=1 crypto rx=0x7fe52800e930 tx=0x7fe52800edf0 comp rx=0 tx=0).stop 2023-11-28T20:02:17.625 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:17.620+0000 7fe53359e640 1 -- 172.21.15.78:0/1503678317 shutdown_connections 2023-11-28T20:02:17.625 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:17.620+0000 7fe53359e640 1 --2- 172.21.15.78:0/1503678317 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fe514066470 0x7fe514068930 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:17.625 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:17.620+0000 7fe53359e640 1 --2- 172.21.15.78:0/1503678317 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe5340c6ae0 0x7fe5340a8600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:17.625 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:17.620+0000 7fe53359e640 1 --2- 172.21.15.78:0/1503678317 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe5340c1950 0x7fe5341539d0 unknown :-1 s=CLOSED pgs=914 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:17.626 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:17.620+0000 7fe53359e640 1 --2- 172.21.15.78:0/1503678317 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe5340a6cc0 0x7fe53414ce60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:17.626 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:17.620+0000 7fe53359e640 1 -- 172.21.15.78:0/1503678317 >> 172.21.15.78:0/1503678317 conn(0x7fe5340662a0 msgr2=0x7fe53414ff50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:02:17.626 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:17.620+0000 7fe53359e640 1 -- 172.21.15.78:0/1503678317 shutdown_connections 2023-11-28T20:02:17.626 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:17.620+0000 7fe53359e640 1 -- 172.21.15.78:0/1503678317 wait complete. 2023-11-28T20:02:17.644 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-28T20:02:17.780 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:17.776+0000 7f52cebc4640 1 Processor -- start 2023-11-28T20:02:17.780 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:17.776+0000 7f52cebc4640 1 -- start start 2023-11-28T20:02:17.782 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:17.776+0000 7f52cebc4640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f52c814fd10 0x7f52c80a4dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:17.782 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:17.776+0000 7f52cebc4640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f52c80a5300 0x7f52c8071e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:17.782 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:17.776+0000 7f52cebc4640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f52c80c5710 con 0x7f52c8072370 2023-11-28T20:02:17.782 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:17.776+0000 7f52cebc4640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f52c806c5e0 con 0x7f52c814fd10 2023-11-28T20:02:17.782 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:17.776+0000 7f52cebc4640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f52c8155c80 con 0x7f52c80a5300 2023-11-28T20:02:17.783 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:17.776+0000 7f52cd161640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f52c8072370 0x7f52c8156110 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:41714/0 (socket says 172.21.15.78:41714) 2023-11-28T20:02:17.783 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:17.776+0000 7f52cd161640 1 -- 172.21.15.78:0/1870877461 learned_addr learned my addr 172.21.15.78:0/1870877461 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-11-28T20:02:17.783 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:17.776+0000 7f52cc960640 1 --2- 172.21.15.78:0/1870877461 >> v2:172.21.15.78:3300/0 conn(0x7f52c814fd10 0x7f52c80a4dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:02:17.783 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:17.776+0000 7f52c7fff640 1 --2- 172.21.15.78:0/1870877461 >> v2:172.21.15.179:3300/0 conn(0x7f52c80a5300 0x7f52c8071e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:02:17.783 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:17.776+0000 7f52c77fe640 1 -- 172.21.15.78:0/1870877461 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2525894955 0 0) 0x7f52c80c5710 con 0x7f52c8072370 2023-11-28T20:02:17.783 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:17.776+0000 7f52c77fe640 1 -- 172.21.15.78:0/1870877461 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f52b8003530 con 0x7f52c8072370 2023-11-28T20:02:17.783 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:17.776+0000 7f52cc960640 1 -- 172.21.15.78:0/1870877461 >> v2:172.21.15.179:3300/0 conn(0x7f52c80a5300 msgr2=0x7f52c8071e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:02:17.783 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:17.776+0000 7f52cc960640 1 --2- 172.21.15.78:0/1870877461 >> v2:172.21.15.179:3300/0 conn(0x7f52c80a5300 0x7f52c8071e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:17.783 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:17.776+0000 7f52cc960640 1 -- 172.21.15.78:0/1870877461 >> v1:172.21.15.78:6789/0 conn(0x7f52c8072370 legacy=0x7f52c8156110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:02:17.783 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:17.776+0000 7f52cc960640 1 -- 172.21.15.78:0/1870877461 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52c80c4e70 con 0x7f52c814fd10 2023-11-28T20:02:17.783 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:17.776+0000 7f52c7fff640 1 --2- 172.21.15.78:0/1870877461 >> v2:172.21.15.179:3300/0 conn(0x7f52c80a5300 0x7f52c8071e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T20:02:17.785 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:17.780+0000 7f52cc960640 1 --2- 172.21.15.78:0/1870877461 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f52c814fd10 0x7f52c80a4dc0 secure :-1 s=READY pgs=916 cs=0 l=1 rev1=1 crypto rx=0x7f52c8066e30 tx=0x7f52bc01c310 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f45ff75bbf556166 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:02:17.785 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:17.780+0000 7f52c77fe640 1 -- 172.21.15.78:0/1870877461 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52bc0ac640 con 0x7f52c814fd10 2023-11-28T20:02:17.785 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:17.780+0000 7f52c77fe640 1 -- 172.21.15.78:0/1870877461 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f52bc0ac7a0 con 0x7f52c814fd10 2023-11-28T20:02:17.785 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:17.780+0000 7f52c77fe640 1 -- 172.21.15.78:0/1870877461 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52bc0acb30 con 0x7f52c814fd10 2023-11-28T20:02:17.786 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:17.780+0000 7f52cebc4640 1 -- 172.21.15.78:0/1870877461 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f52c814fd10 msgr2=0x7f52c80a4dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:02:17.786 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:17.780+0000 7f52cebc4640 1 --2- 172.21.15.78:0/1870877461 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f52c814fd10 0x7f52c80a4dc0 secure :-1 s=READY pgs=916 cs=0 l=1 rev1=1 crypto rx=0x7f52c8066e30 tx=0x7f52bc01c310 comp rx=0 tx=0).stop 2023-11-28T20:02:17.786 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:17.780+0000 7f52cebc4640 1 -- 172.21.15.78:0/1870877461 shutdown_connections 2023-11-28T20:02:17.786 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:17.780+0000 7f52cebc4640 1 --2- 172.21.15.78:0/1870877461 >> v2:172.21.15.179:3300/0 conn(0x7f52c80a5300 0x7f52c8071e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:17.786 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:17.780+0000 7f52cebc4640 1 --2- 172.21.15.78:0/1870877461 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f52c814fd10 0x7f52c80a4dc0 unknown :-1 s=CLOSED pgs=916 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:17.787 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:17.780+0000 7f52cebc4640 1 -- 172.21.15.78:0/1870877461 >> 172.21.15.78:0/1870877461 conn(0x7f52c80a7810 msgr2=0x7f52c80a7c20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:02:17.787 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:17.780+0000 7f52cebc4640 1 -- 172.21.15.78:0/1870877461 shutdown_connections 2023-11-28T20:02:17.787 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:17.780+0000 7f52cebc4640 1 -- 172.21.15.78:0/1870877461 wait complete. 2023-11-28T20:02:17.787 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:17.784+0000 7f52cebc4640 1 Processor -- start 2023-11-28T20:02:17.787 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:17.784+0000 7f52cebc4640 1 -- start start 2023-11-28T20:02:17.790 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:17.784+0000 7f52cebc4640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f52c8072370 0x7f52c8070ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:17.790 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:17.784+0000 7f52cebc4640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f52c80a5300 0x7f52c80bee90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:17.790 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:17.784+0000 7f52cebc4640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f52c814fd10 0x7f52c81efdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:17.790 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:17.784+0000 7f52cebc4640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52c81552c0 con 0x7f52c80a5300 2023-11-28T20:02:17.790 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:17.784+0000 7f52cebc4640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52c80ab880 con 0x7f52c814fd10 2023-11-28T20:02:17.791 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:17.784+0000 7f52cebc4640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52c814c260 con 0x7f52c8072370 2023-11-28T20:02:17.791 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:17.784+0000 7f52c7fff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f52c80a5300 0x7f52c80bee90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:02:17.791 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:17.784+0000 7f52c7fff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f52c80a5300 0x7f52c80bee90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:54272/0 (socket says 172.21.15.78:54272) 2023-11-28T20:02:17.791 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:17.784+0000 7f52c7fff640 1 -- 172.21.15.78:0/1653191278 learned_addr learned my addr 172.21.15.78:0/1653191278 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T20:02:17.791 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:17.784+0000 7f52cc960640 1 --2- 172.21.15.78:0/1653191278 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f52c8072370 0x7f52c8070ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:02:17.791 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:17.784+0000 7f52cd161640 1 --2- 172.21.15.78:0/1653191278 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f52c814fd10 0x7f52c81efdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:02:17.791 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:17.784+0000 7f52c7fff640 1 -- 172.21.15.78:0/1653191278 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f52c8072370 msgr2=0x7f52c8070ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:02:17.791 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:17.784+0000 7f52c7fff640 1 --2- 172.21.15.78:0/1653191278 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f52c8072370 0x7f52c8070ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:17.791 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:17.784+0000 7f52c7fff640 1 -- 172.21.15.78:0/1653191278 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f52c814fd10 msgr2=0x7f52c81efdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:02:17.791 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:17.784+0000 7f52c7fff640 1 --2- 172.21.15.78:0/1653191278 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f52c814fd10 0x7f52c81efdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:17.792 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:17.784+0000 7f52c7fff640 1 -- 172.21.15.78:0/1653191278 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52bc009420 con 0x7f52c80a5300 2023-11-28T20:02:17.792 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:17.784+0000 7f52c7fff640 1 --2- 172.21.15.78:0/1653191278 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f52c80a5300 0x7f52c80bee90 secure :-1 s=READY pgs=917 cs=0 l=1 rev1=1 crypto rx=0x7f52b400e840 tx=0x7f52b400ed00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:02:17.792 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:17.784+0000 7f52c57fa640 1 -- 172.21.15.78:0/1653191278 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52b400c8d0 con 0x7f52c80a5300 2023-11-28T20:02:17.792 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:17.784+0000 7f52c57fa640 1 -- 172.21.15.78:0/1653191278 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f52b400ca30 con 0x7f52c80a5300 2023-11-28T20:02:17.792 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:17.784+0000 7f52c57fa640 1 -- 172.21.15.78:0/1653191278 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52b400cdc0 con 0x7f52c80a5300 2023-11-28T20:02:17.792 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:17.784+0000 7f52cebc4640 1 -- 172.21.15.78:0/1653191278 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f52c8071a00 con 0x7f52c80a5300 2023-11-28T20:02:17.792 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:17.784+0000 7f52cebc4640 1 -- 172.21.15.78:0/1653191278 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f52c8154ee0 con 0x7f52c80a5300 2023-11-28T20:02:17.793 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:17.784+0000 7f52cebc4640 1 -- 172.21.15.78:0/1653191278 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f52c8155530 con 0x7f52c80a5300 2023-11-28T20:02:17.793 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:17.788+0000 7f52c57fa640 1 -- 172.21.15.78:0/1653191278 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f52b4013410 con 0x7f52c80a5300 2023-11-28T20:02:17.794 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:17.788+0000 7f52c57fa640 1 --2- 172.21.15.78:0/1653191278 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f52ac066470 0x7f52ac068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:17.794 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:17.788+0000 7f52c57fa640 1 -- 172.21.15.78:0/1653191278 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f52b4083da0 con 0x7f52c80a5300 2023-11-28T20:02:17.794 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:17.788+0000 7f52cc960640 1 --2- 172.21.15.78:0/1653191278 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f52ac066470 0x7f52ac068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:02:17.794 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:17.788+0000 7f52cc960640 1 --2- 172.21.15.78:0/1653191278 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f52ac066470 0x7f52ac068930 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f52bc0ae000 tx=0x7f52bc008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:02:17.796 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:17.792+0000 7f52c57fa640 1 -- 172.21.15.78:0/1653191278 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f52b4051180 con 0x7f52c80a5300 2023-11-28T20:02:17.977 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:17.972+0000 7f52cebc4640 1 -- 172.21.15.78:0/1653191278 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f52c8067630 con 0x7f52c80a5300 2023-11-28T20:02:17.978 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:17.972+0000 7f52c57fa640 1 -- 172.21.15.78:0/1653191278 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 46 v46) v1 ==== 94+0+4915 (secure 0 0 0) 0x7f52b40547a0 con 0x7f52c80a5300 2023-11-28T20:02:17.978 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-11-28T20:02:17.978 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":46,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5834,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6834/3259525552","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6832","nonce":3259525552},{"type":"v1","addr":"172.21.15.179:6834","nonce":3259525552}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":41},{"gid":6466,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6836/3096284673","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6834","nonce":3096284673},{"type":"v1","addr":"172.21.15.78:6836","nonce":3096284673}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":41},{"gid":6478,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6835/2749579094","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6833","nonce":2749579094},{"type":"v1","addr":"172.21.15.179:6835","nonce":2749579094}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":41}],"filesystems":[{"mdsmap":{"epoch":46,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-28T20:02:07.651677+0000","modified":"2023-11-28T20:02:10.666537+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":6633},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6633":{"gid":6633,"name":"a","rank":0,"incarnation":42,"state":"up:active","state_seq":3,"addr":"172.21.15.78:6837/20108235","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6835","nonce":20108235},{"type":"v1","addr":"172.21.15.78:6837","nonce":20108235}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-28T20:02:17.978 INFO:teuthology.orchestra.run.smithi078.stderr:dumped fsmap epoch 46 2023-11-28T20:02:17.980 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:17.976+0000 7f52cebc4640 1 -- 172.21.15.78:0/1653191278 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f52ac066470 msgr2=0x7f52ac068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:02:17.980 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:17.976+0000 7f52cebc4640 1 --2- 172.21.15.78:0/1653191278 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f52ac066470 0x7f52ac068930 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f52bc0ae000 tx=0x7f52bc008040 comp rx=0 tx=0).stop 2023-11-28T20:02:17.980 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:17.976+0000 7f52cebc4640 1 -- 172.21.15.78:0/1653191278 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f52c80a5300 msgr2=0x7f52c80bee90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:02:17.981 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:17.976+0000 7f52cebc4640 1 --2- 172.21.15.78:0/1653191278 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f52c80a5300 0x7f52c80bee90 secure :-1 s=READY pgs=917 cs=0 l=1 rev1=1 crypto rx=0x7f52b400e840 tx=0x7f52b400ed00 comp rx=0 tx=0).stop 2023-11-28T20:02:17.981 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:17.976+0000 7f52cebc4640 1 -- 172.21.15.78:0/1653191278 shutdown_connections 2023-11-28T20:02:17.981 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:17.976+0000 7f52cebc4640 1 --2- 172.21.15.78:0/1653191278 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f52ac066470 0x7f52ac068930 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:17.981 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:17.976+0000 7f52cebc4640 1 --2- 172.21.15.78:0/1653191278 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f52c814fd10 0x7f52c81efdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:17.981 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:17.976+0000 7f52cebc4640 1 --2- 172.21.15.78:0/1653191278 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f52c80a5300 0x7f52c80bee90 unknown :-1 s=CLOSED pgs=917 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:17.982 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:17.976+0000 7f52cebc4640 1 --2- 172.21.15.78:0/1653191278 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f52c8072370 0x7f52c8070ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:17.982 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:17.976+0000 7f52cebc4640 1 -- 172.21.15.78:0/1653191278 >> 172.21.15.78:0/1653191278 conn(0x7f52c80a7810 msgr2=0x7f52c814c9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:02:17.982 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:17.976+0000 7f52cebc4640 1 -- 172.21.15.78:0/1653191278 shutdown_connections 2023-11-28T20:02:17.982 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:17.976+0000 7f52cebc4640 1 -- 172.21.15.78:0/1653191278 wait complete. 2023-11-28T20:02:18.403 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 46, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-11-28T20:02:07.651677+0000', 'modified': '2023-11-28T20:02:10.666537+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 6633}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6633': {'gid': 6633, 'name': 'a', 'rank': 0, 'incarnation': 42, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.78:6837/20108235', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.78:6835', 'nonce': 20108235}, {'type': 'v1', 'addr': '172.21.15.78:6837', 'nonce': 20108235}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [14], 'metadata_pool': 13, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-11-28T20:02:18.403 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-11-28T20:02:18.403 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2023-11-28T20:02:18.543 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:18.540+0000 7fb877017640 1 Processor -- start 2023-11-28T20:02:18.544 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:18.540+0000 7fb877017640 1 -- start start 2023-11-28T20:02:18.545 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:18.540+0000 7fb877017640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fb8700c2110 0x7fb8700c5ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:18.545 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:18.540+0000 7fb877017640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb8700a93d0 con 0x7fb870154390 2023-11-28T20:02:18.545 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:18.540+0000 7fb877017640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb8700a9640 con 0x7fb8700c0c80 2023-11-28T20:02:18.545 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:18.540+0000 7fb877017640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb8700aa1c0 con 0x7fb8700c2110 2023-11-28T20:02:18.545 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:18.540+0000 7fb874db3640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7fb870154390 0x7fb8700c4a40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:41718/0 (socket says 172.21.15.78:41718) 2023-11-28T20:02:18.545 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:18.540+0000 7fb874db3640 1 -- 172.21.15.78:0/653472816 learned_addr learned my addr 172.21.15.78:0/653472816 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-11-28T20:02:18.547 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:18.540+0000 7fb86ffff640 1 --2- 172.21.15.78:0/653472816 >> v2:172.21.15.179:3300/0 conn(0x7fb8700c2110 0x7fb8700c5ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:02:18.547 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:18.540+0000 7fb86f7fe640 1 -- 172.21.15.78:0/653472816 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3831045562 0 0) 0x7fb8700a93d0 con 0x7fb870154390 2023-11-28T20:02:18.548 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:18.540+0000 7fb86f7fe640 1 -- 172.21.15.78:0/653472816 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb860003530 con 0x7fb870154390 2023-11-28T20:02:18.548 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:18.540+0000 7fb86f7fe640 1 -- 172.21.15.78:0/653472816 <== mon.0 v1:172.21.15.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 206449191 0 0) 0x7fb860003530 con 0x7fb870154390 2023-11-28T20:02:18.548 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:18.540+0000 7fb86f7fe640 1 -- 172.21.15.78:0/653472816 >> v2:172.21.15.179:3300/0 conn(0x7fb8700c2110 msgr2=0x7fb8700c5ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:02:18.548 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:18.540+0000 7fb86f7fe640 1 --2- 172.21.15.78:0/653472816 >> v2:172.21.15.179:3300/0 conn(0x7fb8700c2110 0x7fb8700c5ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:18.548 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:18.540+0000 7fb86f7fe640 1 -- 172.21.15.78:0/653472816 >> v1:172.21.15.179:6789/0 conn(0x7fb8700c0c80 legacy=0x7fb8700c61e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:02:18.548 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:18.540+0000 7fb86f7fe640 1 -- 172.21.15.78:0/653472816 --> v1:172.21.15.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8700a9920 con 0x7fb870154390 2023-11-28T20:02:18.548 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:18.540+0000 7fb86f7fe640 1 -- 172.21.15.78:0/653472816 <== mon.0 v1:172.21.15.78:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3326804700 0 0) 0x7fb864001680 con 0x7fb870154390 2023-11-28T20:02:18.548 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:18.540+0000 7fb86f7fe640 1 -- 172.21.15.78:0/653472816 >> v1:172.21.15.78:6789/0 conn(0x7fb870154390 legacy=0x7fb8700c4a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:02:18.548 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:18.540+0000 7fb86f7fe640 1 --2- 172.21.15.78:0/653472816 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb860003980 0x7fb860003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:18.549 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:18.540+0000 7fb86f7fe640 1 --2- 172.21.15.78:0/653472816 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb8600047d0 0x7fb860004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:18.549 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:18.540+0000 7fb86f7fe640 1 --2- 172.21.15.78:0/653472816 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb860005190 0x7fb86000dba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:18.549 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:18.540+0000 7fb86f7fe640 1 -- 172.21.15.78:0/653472816 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8700aa1c0 con 0x7fb8600047d0 2023-11-28T20:02:18.549 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:18.540+0000 7fb86f7fe640 1 -- 172.21.15.78:0/653472816 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb86000e240 con 0x7fb860005190 2023-11-28T20:02:18.549 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:18.540+0000 7fb86f7fe640 1 -- 172.21.15.78:0/653472816 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb86000e400 con 0x7fb860003980 2023-11-28T20:02:18.549 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:18.540+0000 7fb86ffff640 1 --2- 172.21.15.78:0/653472816 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb8600047d0 0x7fb860004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:02:18.549 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:18.540+0000 7fb874db3640 1 --2- 172.21.15.78:0/653472816 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb860003980 0x7fb860003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:02:18.549 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:18.540+0000 7fb8755b4640 1 --2- 172.21.15.78:0/653472816 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb860005190 0x7fb86000dba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:02:18.549 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:18.540+0000 7fb86ffff640 1 -- 172.21.15.78:0/653472816 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb860003980 msgr2=0x7fb860003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:02:18.550 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:18.540+0000 7fb86ffff640 1 --2- 172.21.15.78:0/653472816 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb860003980 0x7fb860003da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:18.550 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:18.540+0000 7fb86ffff640 1 -- 172.21.15.78:0/653472816 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb860005190 msgr2=0x7fb86000dba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:02:18.550 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:18.540+0000 7fb86ffff640 1 --2- 172.21.15.78:0/653472816 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb860005190 0x7fb86000dba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:18.550 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:18.540+0000 7fb86ffff640 1 -- 172.21.15.78:0/653472816 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb860003530 con 0x7fb8600047d0 2023-11-28T20:02:18.550 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:18.540+0000 7fb8755b4640 1 --2- 172.21.15.78:0/653472816 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb860005190 0x7fb86000dba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T20:02:18.550 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:18.540+0000 7fb8755b4640 1 -- 172.21.15.78:0/653472816 reap_dead start 2023-11-28T20:02:18.551 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:18.544+0000 7fb86ffff640 1 --2- 172.21.15.78:0/653472816 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb8600047d0 0x7fb860004c50 secure :-1 s=READY pgs=919 cs=0 l=1 rev1=1 crypto rx=0x7fb85c009ae0 tx=0x7fb85c01ca50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8e44e09c5edb6037 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:02:18.552 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:18.544+0000 7fb86f7fe640 1 -- 172.21.15.78:0/653472816 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb85c0a6440 con 0x7fb8600047d0 2023-11-28T20:02:18.552 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:18.544+0000 7fb86f7fe640 1 -- 172.21.15.78:0/653472816 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb85c0a65a0 con 0x7fb8600047d0 2023-11-28T20:02:18.552 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:18.544+0000 7fb86f7fe640 1 -- 172.21.15.78:0/653472816 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb85c0a6950 con 0x7fb8600047d0 2023-11-28T20:02:18.552 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:18.544+0000 7fb877017640 1 -- 172.21.15.78:0/653472816 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb8600047d0 msgr2=0x7fb860004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:02:18.552 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:18.544+0000 7fb877017640 1 --2- 172.21.15.78:0/653472816 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb8600047d0 0x7fb860004c50 secure :-1 s=READY pgs=919 cs=0 l=1 rev1=1 crypto rx=0x7fb85c009ae0 tx=0x7fb85c01ca50 comp rx=0 tx=0).stop 2023-11-28T20:02:18.552 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:18.544+0000 7fb877017640 1 -- 172.21.15.78:0/653472816 shutdown_connections 2023-11-28T20:02:18.552 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:18.544+0000 7fb877017640 1 --2- 172.21.15.78:0/653472816 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb8600047d0 0x7fb860004c50 unknown :-1 s=CLOSED pgs=919 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:18.552 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:18.544+0000 7fb877017640 1 -- 172.21.15.78:0/653472816 >> 172.21.15.78:0/653472816 conn(0x7fb87006b220 msgr2=0x7fb8700a77e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:02:18.552 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:18.544+0000 7fb877017640 1 -- 172.21.15.78:0/653472816 shutdown_connections 2023-11-28T20:02:18.552 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:18.544+0000 7fb877017640 1 -- 172.21.15.78:0/653472816 wait complete. 2023-11-28T20:02:18.555 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:18.548+0000 7fb877017640 1 Processor -- start 2023-11-28T20:02:18.555 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:18.548+0000 7fb877017640 1 -- start start 2023-11-28T20:02:18.555 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:18.548+0000 7fb877017640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb8600047d0 0x7fb8701ed890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:18.555 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:18.548+0000 7fb877017640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb870146390 0x7fb8700a60d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:18.555 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:18.548+0000 7fb877017640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb8700a6610 0x7fb870144da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:18.555 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:18.548+0000 7fb877017640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb87006fd30 con 0x7fb8600047d0 2023-11-28T20:02:18.555 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:18.548+0000 7fb877017640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8700a6ac0 con 0x7fb870146390 2023-11-28T20:02:18.556 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:18.548+0000 7fb877017640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8700711e0 con 0x7fb8700a6610 2023-11-28T20:02:18.556 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:18.548+0000 7fb874db3640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb8600047d0 0x7fb8701ed890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:02:18.556 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:18.548+0000 7fb874db3640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb8600047d0 0x7fb8701ed890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:54290/0 (socket says 172.21.15.78:54290) 2023-11-28T20:02:18.556 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:18.548+0000 7fb874db3640 1 -- 172.21.15.78:0/2412316581 learned_addr learned my addr 172.21.15.78:0/2412316581 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T20:02:18.556 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:18.548+0000 7fb8755b4640 1 --2- 172.21.15.78:0/2412316581 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb8700a6610 0x7fb870144da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:02:18.556 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:18.548+0000 7fb874db3640 1 -- 172.21.15.78:0/2412316581 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb8700a6610 msgr2=0x7fb870144da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:02:18.556 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:18.548+0000 7fb874db3640 1 --2- 172.21.15.78:0/2412316581 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb8700a6610 0x7fb870144da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:18.556 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:18.548+0000 7fb874db3640 1 -- 172.21.15.78:0/2412316581 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb870146390 msgr2=0x7fb8700a60d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:02:18.556 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:18.548+0000 7fb86ffff640 1 --2- 172.21.15.78:0/2412316581 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb870146390 0x7fb8700a60d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:02:18.556 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:18.548+0000 7fb874db3640 1 --2- 172.21.15.78:0/2412316581 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb870146390 0x7fb8700a60d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:18.557 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:18.548+0000 7fb874db3640 1 -- 172.21.15.78:0/2412316581 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb870145f50 con 0x7fb8600047d0 2023-11-28T20:02:18.557 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:18.548+0000 7fb8755b4640 1 --2- 172.21.15.78:0/2412316581 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb8700a6610 0x7fb870144da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T20:02:18.557 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:18.548+0000 7fb86ffff640 1 --2- 172.21.15.78:0/2412316581 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb870146390 0x7fb8700a60d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T20:02:18.557 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:18.548+0000 7fb874db3640 1 --2- 172.21.15.78:0/2412316581 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb8600047d0 0x7fb8701ed890 secure :-1 s=READY pgs=920 cs=0 l=1 rev1=1 crypto rx=0x7fb8640124c0 tx=0x7fb864012980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:02:18.557 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:18.548+0000 7fb86d7fa640 1 -- 172.21.15.78:0/2412316581 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb864014810 con 0x7fb8600047d0 2023-11-28T20:02:18.557 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:18.548+0000 7fb86d7fa640 1 -- 172.21.15.78:0/2412316581 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb864014970 con 0x7fb8600047d0 2023-11-28T20:02:18.557 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:18.548+0000 7fb86d7fa640 1 -- 172.21.15.78:0/2412316581 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb864014d20 con 0x7fb8600047d0 2023-11-28T20:02:18.557 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:18.548+0000 7fb877017640 1 -- 172.21.15.78:0/2412316581 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb8701ee1c0 con 0x7fb8600047d0 2023-11-28T20:02:18.557 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:18.548+0000 7fb877017640 1 -- 172.21.15.78:0/2412316581 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb870070180 con 0x7fb8600047d0 2023-11-28T20:02:18.558 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:18.552+0000 7fb86d7fa640 1 -- 172.21.15.78:0/2412316581 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fb864016440 con 0x7fb8600047d0 2023-11-28T20:02:18.559 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:18.552+0000 7fb86d7fa640 1 --2- 172.21.15.78:0/2412316581 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fb854066470 0x7fb854068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:18.559 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:18.552+0000 7fb86d7fa640 1 -- 172.21.15.78:0/2412316581 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6029+0+0 (secure 0 0 0) 0x7fb864086970 con 0x7fb8600047d0 2023-11-28T20:02:18.559 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:18.552+0000 7fb86ffff640 1 --2- 172.21.15.78:0/2412316581 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fb854066470 0x7fb854068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:02:18.559 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:18.552+0000 7fb87a398000 1 Processor -- start 2023-11-28T20:02:18.559 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:18.552+0000 7fb87a398000 1 -- start start 2023-11-28T20:02:18.559 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:18.552+0000 7fb86ffff640 1 --2- 172.21.15.78:0/2412316581 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fb854066470 0x7fb854068930 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7fb85c0ad000 tx=0x7fb85c0a9040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:02:18.561 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:18.556+0000 7fb87a398000 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5587527f92e0 0x5587527f96c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:18.562 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:18.556+0000 7fb87a398000 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5587527f9c00 0x5587527f9fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:18.562 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:18.556+0000 7fb87a398000 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5587527fa520 0x558752843a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:18.562 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:18.556+0000 7fb87a398000 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x558752666130 con 0x5587527f9c00 2023-11-28T20:02:18.562 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:18.556+0000 7fb87a398000 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x5587526539a0 con 0x5587527f92e0 2023-11-28T20:02:18.562 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:18.556+0000 7fb87a398000 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x558752650ed0 con 0x5587527fa520 2023-11-28T20:02:18.562 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:18.556+0000 7fb86ffff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5587527f9c00 0x5587527f9fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:02:18.562 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:18.556+0000 7fb86ffff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5587527f9c00 0x5587527f9fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:54292/0 (socket says 172.21.15.78:54292) 2023-11-28T20:02:18.562 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:18.556+0000 7fb86ffff640 1 -- 172.21.15.78:0/3420579288 learned_addr learned my addr 172.21.15.78:0/3420579288 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T20:02:18.562 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:18.556+0000 7fb8755b4640 1 --2- 172.21.15.78:0/3420579288 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5587527fa520 0x558752843a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:02:18.563 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:18.556+0000 7fb874db3640 1 --2- 172.21.15.78:0/3420579288 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5587527f92e0 0x5587527f96c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:02:18.563 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:18.556+0000 7fb86ffff640 1 -- 172.21.15.78:0/3420579288 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5587527fa520 msgr2=0x558752843a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:02:18.563 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:18.556+0000 7fb86ffff640 1 --2- 172.21.15.78:0/3420579288 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5587527fa520 0x558752843a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:18.563 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:18.556+0000 7fb86ffff640 1 -- 172.21.15.78:0/3420579288 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5587527f92e0 msgr2=0x5587527f96c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:02:18.563 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:18.556+0000 7fb86ffff640 1 --2- 172.21.15.78:0/3420579288 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5587527f92e0 0x5587527f96c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:18.563 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:18.556+0000 7fb86ffff640 1 -- 172.21.15.78:0/3420579288 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558752344890 con 0x5587527f9c00 2023-11-28T20:02:18.563 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:18.556+0000 7fb86ffff640 1 --2- 172.21.15.78:0/3420579288 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5587527f9c00 0x5587527f9fe0 secure :-1 s=READY pgs=921 cs=0 l=1 rev1=1 crypto rx=0x7fb85c01cfc0 tx=0x7fb85c0046d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2ffe6c881115abd7 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:02:18.563 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:18.556+0000 7fb85a7fc640 1 -- 172.21.15.78:0/3420579288 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb85c0a7b70 con 0x5587527f9c00 2023-11-28T20:02:18.563 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:18.556+0000 7fb85a7fc640 1 -- 172.21.15.78:0/3420579288 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb85c0a7cd0 con 0x5587527f9c00 2023-11-28T20:02:18.563 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:18.556+0000 7fb85a7fc640 1 -- 172.21.15.78:0/3420579288 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb85c0bd670 con 0x5587527f9c00 2023-11-28T20:02:18.564 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:18.556+0000 7fb87a398000 1 -- 172.21.15.78:0/3420579288 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5587527f9c00 msgr2=0x5587527f9fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:02:18.564 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:18.556+0000 7fb87a398000 1 --2- 172.21.15.78:0/3420579288 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5587527f9c00 0x5587527f9fe0 secure :-1 s=READY pgs=921 cs=0 l=1 rev1=1 crypto rx=0x7fb85c01cfc0 tx=0x7fb85c0046d0 comp rx=0 tx=0).stop 2023-11-28T20:02:18.564 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:18.556+0000 7fb87a398000 1 -- 172.21.15.78:0/3420579288 shutdown_connections 2023-11-28T20:02:18.564 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:18.556+0000 7fb87a398000 1 --2- 172.21.15.78:0/3420579288 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5587527fa520 0x558752843a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:18.564 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:18.556+0000 7fb87a398000 1 --2- 172.21.15.78:0/3420579288 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5587527f9c00 0x5587527f9fe0 unknown :-1 s=CLOSED pgs=921 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:18.564 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:18.556+0000 7fb87a398000 1 --2- 172.21.15.78:0/3420579288 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5587527f92e0 0x5587527f96c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:18.564 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:18.556+0000 7fb87a398000 1 -- 172.21.15.78:0/3420579288 >> 172.21.15.78:0/3420579288 conn(0x558752802190 msgr2=0x5587528397a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:02:18.564 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:18.556+0000 7fb87a398000 1 -- 172.21.15.78:0/3420579288 shutdown_connections 2023-11-28T20:02:18.565 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:18.556+0000 7fb87a398000 1 -- 172.21.15.78:0/3420579288 wait complete. 2023-11-28T20:02:18.565 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:18.556+0000 7fb87a398000 1 -- start start 2023-11-28T20:02:18.569 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:18.556+0000 7fb87a398000 1 Processor -- start 2023-11-28T20:02:18.569 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:18.560+0000 7fb87a398000 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5587527f92e0 0x558752835f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:18.569 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:18.560+0000 7fb87a398000 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5587527f9c00 0x558752842070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:18.569 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:18.560+0000 7fb87a398000 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5587527fa520 0x5587528425b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:18.570 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:18.560+0000 7fb87a398000 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55875264c7c0 con 0x5587527f92e0 2023-11-28T20:02:18.570 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:18.560+0000 7fb87a398000 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x558752604bf0 con 0x5587527f9c00 2023-11-28T20:02:18.570 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:18.560+0000 7fb87a398000 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x55875260aa90 con 0x5587527fa520 2023-11-28T20:02:18.570 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:18.560+0000 7fb87a398000 10 client.0 _ll_register_callbacks cb 0x5587527e73c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-28T20:02:18.570 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:18.560+0000 7fb874db3640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5587527f92e0 0x558752835f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:02:18.570 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:18.560+0000 7fb874db3640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5587527f92e0 0x558752835f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:54298/0 (socket says 172.21.15.78:54298) 2023-11-28T20:02:18.570 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:18.560+0000 7fb874db3640 1 -- 172.21.15.78:0/4156741271 learned_addr learned my addr 172.21.15.78:0/4156741271 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T20:02:18.570 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:18.560+0000 7fb86ffff640 1 --2- 172.21.15.78:0/4156741271 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5587527f9c00 0x558752842070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:02:18.570 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:18.560+0000 7fb874db3640 1 -- 172.21.15.78:0/4156741271 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5587527fa520 msgr2=0x5587528425b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:02:18.570 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:18.560+0000 7fb8755b4640 1 --2- 172.21.15.78:0/4156741271 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5587527fa520 0x5587528425b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:02:18.571 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:18.560+0000 7fb874db3640 1 --2- 172.21.15.78:0/4156741271 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5587527fa520 0x5587528425b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:18.571 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:18.560+0000 7fb874db3640 1 -- 172.21.15.78:0/4156741271 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5587527f9c00 msgr2=0x558752842070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:02:18.571 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:18.560+0000 7fb874db3640 1 --2- 172.21.15.78:0/4156741271 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5587527f9c00 0x558752842070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:18.571 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:18.560+0000 7fb874db3640 1 -- 172.21.15.78:0/4156741271 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb860003530 con 0x5587527f92e0 2023-11-28T20:02:18.571 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:18.560+0000 7fb86ffff640 1 --2- 172.21.15.78:0/4156741271 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5587527f9c00 0x558752842070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T20:02:18.571 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:18.560+0000 7fb8755b4640 1 --2- 172.21.15.78:0/4156741271 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5587527fa520 0x5587528425b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T20:02:18.571 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:18.560+0000 7fb874db3640 1 --2- 172.21.15.78:0/4156741271 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5587527f92e0 0x558752835f40 secure :-1 s=READY pgs=922 cs=0 l=1 rev1=1 crypto rx=0x7fb864057910 tx=0x7fb86405fc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7f3497d3aee72a02 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:02:18.571 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:18.560+0000 7fb84f7fe640 10 client.0 ms_handle_connect on v2:172.21.15.78:3300/0 2023-11-28T20:02:18.571 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:18.560+0000 7fb84f7fe640 1 -- 172.21.15.78:0/4156741271 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb864055de0 con 0x5587527f92e0 2023-11-28T20:02:18.572 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:18.560+0000 7fb84f7fe640 1 -- 172.21.15.78:0/4156741271 <== mon.0 v2:172.21.15.78:3300/0 2 ==== osd_map(81..81 src has 1..81) v4 ==== 6029+0+0 (secure 0 0 0) 0x7fb86405f950 con 0x5587527f92e0 2023-11-28T20:02:18.572 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:18.560+0000 7fb87a398000 1 -- 172.21.15.78:0/4156741271 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55875260e470 con 0x5587527f92e0 2023-11-28T20:02:18.572 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:18.560+0000 7fb84f7fe640 1 -- 172.21.15.78:0/4156741271 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_get_version_reply(handle=1 version=46) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb86407ebe0 con 0x5587527f92e0 2023-11-28T20:02:18.572 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:18.560+0000 7fb87a398000 10 client.6807 fetch_fsmap learned FSMap version 46 2023-11-28T20:02:18.572 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:18.560+0000 7fb87a398000 1 -- 172.21.15.78:0/4156741271 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,fsmap=46,monmap=2+}) v3 -- 0x55875260d190 con 0x5587527f92e0 2023-11-28T20:02:18.572 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:18.560+0000 7fb84f7fe640 1 -- 172.21.15.78:0/4156741271 <== mon.0 v2:172.21.15.78:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55875260e470 con 0x5587527f92e0 2023-11-28T20:02:18.572 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:18.560+0000 7fb84f7fe640 1 -- 172.21.15.78:0/4156741271 <== mon.0 v2:172.21.15.78:3300/0 5 ==== fsmap(e 46) v1 ==== 3294+0+0 (secure 0 0 0) 0x7fb864053770 con 0x5587527f92e0 2023-11-28T20:02:18.572 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:18.560+0000 7fb87a398000 10 client.6807 fetch_fsmap finished waiting for FSMap version 46 2023-11-28T20:02:18.572 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:18.560+0000 7fb87a398000 10 client.6807 resolve_mds: resolved name 'a' to daemon mds.a 2023-11-28T20:02:18.572 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:18.560+0000 7fb87a398000 20 client.6807 populate_metadata read hostname 'smithi078' 2023-11-28T20:02:18.573 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:18.560+0000 7fb87a398000 1 --2- 172.21.15.78:0/4156741271 >> [v2:172.21.15.78:6835/20108235,v1:172.21.15.78:6837/20108235] conn(0x558752842fc0 0x5587528433a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:18.573 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:18.560+0000 7fb87a398000 4 client.6807 mds_command: new command op to 6633 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-11-28T20:02:18.573 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:18.560+0000 7fb87a398000 1 -- 172.21.15.78:0/4156741271 --> [v2:172.21.15.78:6835/20108235,v1:172.21.15.78:6837/20108235] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x558752611b50 con 0x558752842fc0 2023-11-28T20:02:18.573 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:18.560+0000 7fb86ffff640 1 --2- 172.21.15.78:0/4156741271 >> [v2:172.21.15.78:6835/20108235,v1:172.21.15.78:6837/20108235] conn(0x558752842fc0 0x5587528433a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:02:18.573 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:18.560+0000 7fb84f7fe640 10 client.6807 ms_handle_connect on v2:172.21.15.78:6835/20108235 2023-11-28T20:02:18.573 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:18.560+0000 7fb86ffff640 1 --2- 172.21.15.78:0/4156741271 >> [v2:172.21.15.78:6835/20108235,v1:172.21.15.78:6837/20108235] conn(0x558752842fc0 0x5587528433a0 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b9c8bc10ec45dbac server_cookie=35d1d1336cb48de4 in_seq=0 out_seq=0 2023-11-28T20:02:18.573 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:18.560+0000 7fb84f7fe640 1 -- 172.21.15.78:0/4156741271 <== mds.0 v2:172.21.15.78:6835/20108235 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x558752611b50 con 0x558752842fc0 2023-11-28T20:02:18.573 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:18.560+0000 7fb84f7fe640 10 client.6807 handle_command_reply: tid=0 2023-11-28T20:02:18.573 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:18.560+0000 7fb87a398000 1 client.6807 shutdown 2023-11-28T20:02:18.574 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:18.560+0000 7fb87a398000 1 -- 172.21.15.78:0/4156741271 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5587527f92e0 msgr2=0x558752835f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:02:18.574 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:18.560+0000 7fb87a398000 1 --2- 172.21.15.78:0/4156741271 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5587527f92e0 0x558752835f40 secure :-1 s=READY pgs=922 cs=0 l=1 rev1=1 crypto rx=0x7fb864057910 tx=0x7fb86405fc90 comp rx=0 tx=0).stop 2023-11-28T20:02:18.574 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:18.560+0000 7fb87a398000 1 -- 172.21.15.78:0/4156741271 shutdown_connections 2023-11-28T20:02:18.574 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:18.560+0000 7fb87a398000 1 --2- 172.21.15.78:0/4156741271 >> [v2:172.21.15.78:6835/20108235,v1:172.21.15.78:6837/20108235] conn(0x558752842fc0 0x5587528433a0 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:18.574 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:18.560+0000 7fb87a398000 1 --2- 172.21.15.78:0/4156741271 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5587527fa520 0x5587528425b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:18.574 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:18.560+0000 7fb87a398000 1 --2- 172.21.15.78:0/4156741271 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5587527f9c00 0x558752842070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:18.574 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:18.560+0000 7fb84f7fe640 0 client.6807 ms_handle_reset on v2:172.21.15.78:6835/20108235 2023-11-28T20:02:18.574 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:18.560+0000 7fb87a398000 1 --2- 172.21.15.78:0/4156741271 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5587527f92e0 0x558752835f40 unknown :-1 s=CLOSED pgs=922 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:18.574 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:18.560+0000 7fb87a398000 1 -- 172.21.15.78:0/4156741271 >> 172.21.15.78:0/4156741271 conn(0x558752802190 msgr2=0x558752836b30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:02:18.575 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:18.564+0000 7fb87a398000 1 -- 172.21.15.78:0/4156741271 shutdown_connections 2023-11-28T20:02:18.575 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:18.564+0000 7fb87a398000 1 -- 172.21.15.78:0/4156741271 wait complete. 2023-11-28T20:02:18.575 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:18.564+0000 7fb87a398000 20 client.6807 trim_cache size 0 max 16384 2023-11-28T20:02:18.582 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:18.576+0000 7fb87a398000 1 Processor -- start 2023-11-28T20:02:18.583 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:18.576+0000 7fb87a398000 1 -- start start 2023-11-28T20:02:18.584 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:18.580+0000 7fb87a398000 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5587527f92e0 0x5587527f8950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:18.584 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:18.580+0000 7fb87a398000 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5587527f9c00 0x5587527fa900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:18.584 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:18.580+0000 7fb87a398000 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5587527fa520 0x5587528493d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:18.584 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:18.580+0000 7fb87a398000 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x558752305940 con 0x5587527fa520 2023-11-28T20:02:18.584 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:18.580+0000 7fb87a398000 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x55875264f320 con 0x5587527f9c00 2023-11-28T20:02:18.585 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:18.580+0000 7fb87a398000 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x558752803890 con 0x5587527f92e0 2023-11-28T20:02:18.585 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:18.580+0000 7fb8755b4640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5587527fa520 0x5587528493d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:02:18.585 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:18.580+0000 7fb8755b4640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5587527fa520 0x5587528493d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:54312/0 (socket says 172.21.15.78:54312) 2023-11-28T20:02:18.585 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:18.580+0000 7fb8755b4640 1 -- 172.21.15.78:0/3709519074 learned_addr learned my addr 172.21.15.78:0/3709519074 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T20:02:18.585 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:18.580+0000 7fb874db3640 1 --2- 172.21.15.78:0/3709519074 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5587527f92e0 0x5587527f8950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:02:18.585 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:18.580+0000 7fb86ffff640 1 --2- 172.21.15.78:0/3709519074 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5587527f9c00 0x5587527fa900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:02:18.585 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:18.580+0000 7fb8755b4640 1 -- 172.21.15.78:0/3709519074 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5587527f92e0 msgr2=0x5587527f8950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:02:18.585 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:18.580+0000 7fb8755b4640 1 --2- 172.21.15.78:0/3709519074 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5587527f92e0 0x5587527f8950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:18.585 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:18.580+0000 7fb8755b4640 1 -- 172.21.15.78:0/3709519074 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5587527f9c00 msgr2=0x5587527fa900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:02:18.585 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:18.580+0000 7fb8755b4640 1 --2- 172.21.15.78:0/3709519074 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5587527f9c00 0x5587527fa900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:18.585 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:18.580+0000 7fb8755b4640 1 -- 172.21.15.78:0/3709519074 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5587525f3490 con 0x5587527fa520 2023-11-28T20:02:18.585 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:18.580+0000 7fb8755b4640 1 --2- 172.21.15.78:0/3709519074 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5587527fa520 0x5587528493d0 secure :-1 s=READY pgs=923 cs=0 l=1 rev1=1 crypto rx=0x7fb8700bfe20 tx=0x7fb868005420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=714560c1be92fa83 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:02:18.586 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:18.580+0000 7fb85affd640 1 -- 172.21.15.78:0/3709519074 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb868001900 con 0x5587527fa520 2023-11-28T20:02:18.586 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:18.580+0000 7fb85affd640 1 -- 172.21.15.78:0/3709519074 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb86800d070 con 0x5587527fa520 2023-11-28T20:02:18.586 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:18.580+0000 7fb85affd640 1 -- 172.21.15.78:0/3709519074 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb868001c60 con 0x5587527fa520 2023-11-28T20:02:18.589 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:18.580+0000 7fb87a398000 1 -- 172.21.15.78:0/3709519074 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5587527fa520 msgr2=0x5587528493d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:02:18.590 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:18.580+0000 7fb87a398000 1 --2- 172.21.15.78:0/3709519074 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5587527fa520 0x5587528493d0 secure :-1 s=READY pgs=923 cs=0 l=1 rev1=1 crypto rx=0x7fb8700bfe20 tx=0x7fb868005420 comp rx=0 tx=0).stop 2023-11-28T20:02:18.590 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:18.580+0000 7fb87a398000 1 -- 172.21.15.78:0/3709519074 shutdown_connections 2023-11-28T20:02:18.590 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:18.580+0000 7fb87a398000 1 --2- 172.21.15.78:0/3709519074 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5587527fa520 0x5587528493d0 unknown :-1 s=CLOSED pgs=923 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:18.590 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:18.580+0000 7fb87a398000 1 --2- 172.21.15.78:0/3709519074 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5587527f9c00 0x5587527fa900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:18.590 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:18.580+0000 7fb87a398000 1 --2- 172.21.15.78:0/3709519074 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5587527f92e0 0x5587527f8950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:18.590 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:18.580+0000 7fb87a398000 1 -- 172.21.15.78:0/3709519074 >> 172.21.15.78:0/3709519074 conn(0x558752802190 msgr2=0x558752853850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:02:18.590 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:18.580+0000 7fb87a398000 1 -- 172.21.15.78:0/3709519074 shutdown_connections 2023-11-28T20:02:18.590 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:18.580+0000 7fb87a398000 1 -- 172.21.15.78:0/3709519074 wait complete. 2023-11-28T20:02:18.590 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:18.580+0000 7fb87a398000 1 -- start start 2023-11-28T20:02:18.590 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:18.580+0000 7fb87a398000 1 Processor -- start 2023-11-28T20:02:18.590 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:18.584+0000 7fb87a398000 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5587527f92e0 0x558752850a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:18.591 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:18.584+0000 7fb87a398000 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5587527f9c00 0x558752850f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:18.591 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:18.584+0000 7fb87a398000 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5587527fa520 0x5587528514b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:18.591 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:18.584+0000 7fb87a398000 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x5587526d3fa0 con 0x5587527f9c00 2023-11-28T20:02:18.591 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:18.584+0000 7fb87a398000 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x5587526086f0 con 0x5587527fa520 2023-11-28T20:02:18.591 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:18.584+0000 7fb87a398000 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x5587526507c0 con 0x5587527f92e0 2023-11-28T20:02:18.591 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:18.584+0000 7fb87a398000 10 client.0 _ll_register_callbacks cb 0x5587527c7bd0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-28T20:02:18.591 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:18.584+0000 7fb86ffff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5587527f9c00 0x558752850f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:02:18.591 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:18.584+0000 7fb86ffff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5587527f9c00 0x558752850f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:54328/0 (socket says 172.21.15.78:54328) 2023-11-28T20:02:18.591 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:18.584+0000 7fb86ffff640 1 -- 172.21.15.78:0/1212811528 learned_addr learned my addr 172.21.15.78:0/1212811528 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T20:02:18.591 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:18.584+0000 7fb874db3640 1 --2- 172.21.15.78:0/1212811528 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5587527f92e0 0x558752850a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:02:18.591 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:18.584+0000 7fb8755b4640 1 --2- 172.21.15.78:0/1212811528 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5587527fa520 0x5587528514b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:02:18.591 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:18.584+0000 7fb86ffff640 1 -- 172.21.15.78:0/1212811528 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5587527f92e0 msgr2=0x558752850a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:02:18.592 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:18.584+0000 7fb86ffff640 1 --2- 172.21.15.78:0/1212811528 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5587527f92e0 0x558752850a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:18.592 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:18.584+0000 7fb86ffff640 1 -- 172.21.15.78:0/1212811528 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5587527fa520 msgr2=0x5587528514b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:02:18.592 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:18.584+0000 7fb86ffff640 1 --2- 172.21.15.78:0/1212811528 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5587527fa520 0x5587528514b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:18.592 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:18.584+0000 7fb86ffff640 1 -- 172.21.15.78:0/1212811528 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb8700a9640 con 0x5587527f9c00 2023-11-28T20:02:18.592 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:18.584+0000 7fb86ffff640 1 --2- 172.21.15.78:0/1212811528 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5587527f9c00 0x558752850f70 secure :-1 s=READY pgs=924 cs=0 l=1 rev1=1 crypto rx=0x7fb85c009ab0 tx=0x7fb85c01b290 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ce33ea85ac077f17 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:02:18.592 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:18.584+0000 7fb84f7fe640 10 client.0 ms_handle_connect on v2:172.21.15.78:3300/0 2023-11-28T20:02:18.592 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:18.584+0000 7fb84f7fe640 1 -- 172.21.15.78:0/1212811528 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb85c0a7c70 con 0x5587527f9c00 2023-11-28T20:02:18.592 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:18.584+0000 7fb84f7fe640 1 -- 172.21.15.78:0/1212811528 <== mon.0 v2:172.21.15.78:3300/0 2 ==== osd_map(81..81 src has 1..81) v4 ==== 6029+0+0 (secure 0 0 0) 0x7fb85c0a6d60 con 0x5587527f9c00 2023-11-28T20:02:18.592 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:18.584+0000 7fb87a398000 1 -- 172.21.15.78:0/1212811528 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55875264b110 con 0x5587527f9c00 2023-11-28T20:02:18.592 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:18.584+0000 7fb84f7fe640 1 -- 172.21.15.78:0/1212811528 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_get_version_reply(handle=1 version=46) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb85c0a7dd0 con 0x5587527f9c00 2023-11-28T20:02:18.592 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:18.584+0000 7fb87a398000 10 client.6813 fetch_fsmap learned FSMap version 46 2023-11-28T20:02:18.592 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:18.584+0000 7fb87a398000 1 -- 172.21.15.78:0/1212811528 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,fsmap=46,monmap=2+}) v3 -- 0x558752344cc0 con 0x5587527f9c00 2023-11-28T20:02:18.593 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:18.584+0000 7fb84f7fe640 1 -- 172.21.15.78:0/1212811528 <== mon.0 v2:172.21.15.78:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55875264b110 con 0x5587527f9c00 2023-11-28T20:02:18.593 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:18.584+0000 7fb84f7fe640 1 -- 172.21.15.78:0/1212811528 <== mon.0 v2:172.21.15.78:3300/0 5 ==== fsmap(e 46) v1 ==== 3294+0+0 (secure 0 0 0) 0x7fb85c0cb1c0 con 0x5587527f9c00 2023-11-28T20:02:18.593 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:18.584+0000 7fb87a398000 10 client.6813 fetch_fsmap finished waiting for FSMap version 46 2023-11-28T20:02:18.593 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:18.584+0000 7fb87a398000 10 client.6813 resolve_mds: resolved name 'a' to daemon mds.a 2023-11-28T20:02:18.593 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:18.584+0000 7fb87a398000 20 client.6813 populate_metadata read hostname 'smithi078' 2023-11-28T20:02:18.593 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:18.584+0000 7fb87a398000 1 --2- 172.21.15.78:0/1212811528 >> [v2:172.21.15.78:6835/20108235,v1:172.21.15.78:6837/20108235] conn(0x5587528a3f50 0x5587528a6340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:18.593 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:18.584+0000 7fb87a398000 4 client.6813 mds_command: new command op to 6633 tid=0 multi_id=0 [{"prefix": "status"}] 2023-11-28T20:02:18.593 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:18.584+0000 7fb87a398000 1 -- 172.21.15.78:0/1212811528 --> [v2:172.21.15.78:6835/20108235,v1:172.21.15.78:6837/20108235] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55875267a9a0 con 0x5587528a3f50 2023-11-28T20:02:18.593 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:18.584+0000 7fb874db3640 1 --2- 172.21.15.78:0/1212811528 >> [v2:172.21.15.78:6835/20108235,v1:172.21.15.78:6837/20108235] conn(0x5587528a3f50 0x5587528a6340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:02:18.593 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:18.584+0000 7fb84f7fe640 10 client.6813 ms_handle_connect on v2:172.21.15.78:6835/20108235 2023-11-28T20:02:18.593 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:18.584+0000 7fb874db3640 1 --2- 172.21.15.78:0/1212811528 >> [v2:172.21.15.78:6835/20108235,v1:172.21.15.78:6837/20108235] conn(0x5587528a3f50 0x5587528a6340 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d191a2ba1a62229 server_cookie=bc9bb308b1a22a42 in_seq=0 out_seq=0 2023-11-28T20:02:18.593 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:18.584+0000 7fb84f7fe640 1 -- 172.21.15.78:0/1212811528 <== mds.0 v2:172.21.15.78:6835/20108235 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+325 (crc 0 0 0) 0x55875267a9a0 con 0x5587528a3f50 2023-11-28T20:02:18.594 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:18.584+0000 7fb84f7fe640 10 client.6813 handle_command_reply: tid=0 2023-11-28T20:02:18.594 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:18.584+0000 7fb87a398000 1 client.6813 shutdown 2023-11-28T20:02:18.595 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:18.584+0000 7fb87a398000 1 -- 172.21.15.78:0/1212811528 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5587527f9c00 msgr2=0x558752850f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:02:18.595 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:18.584+0000 7fb87a398000 1 --2- 172.21.15.78:0/1212811528 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5587527f9c00 0x558752850f70 secure :-1 s=READY pgs=924 cs=0 l=1 rev1=1 crypto rx=0x7fb85c009ab0 tx=0x7fb85c01b290 comp rx=0 tx=0).stop 2023-11-28T20:02:18.595 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:18.584+0000 7fb87a398000 1 -- 172.21.15.78:0/1212811528 shutdown_connections 2023-11-28T20:02:18.595 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:18.584+0000 7fb87a398000 1 --2- 172.21.15.78:0/1212811528 >> [v2:172.21.15.78:6835/20108235,v1:172.21.15.78:6837/20108235] conn(0x5587528a3f50 0x5587528a6340 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:18.595 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:18.584+0000 7fb87a398000 1 --2- 172.21.15.78:0/1212811528 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5587527fa520 0x5587528514b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:18.595 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:18.584+0000 7fb87a398000 1 --2- 172.21.15.78:0/1212811528 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5587527f9c00 0x558752850f70 unknown :-1 s=CLOSED pgs=924 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:18.595 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:18.584+0000 7fb84f7fe640 0 client.6813 ms_handle_reset on v2:172.21.15.78:6835/20108235 2023-11-28T20:02:18.595 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:18.584+0000 7fb87a398000 1 --2- 172.21.15.78:0/1212811528 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5587527f92e0 0x558752850a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:18.595 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:18.584+0000 7fb87a398000 1 -- 172.21.15.78:0/1212811528 >> 172.21.15.78:0/1212811528 conn(0x558752802190 msgr2=0x5587527fb520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:02:18.595 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:18.584+0000 7fb87a398000 1 -- 172.21.15.78:0/1212811528 shutdown_connections 2023-11-28T20:02:18.596 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:18.584+0000 7fb87a398000 1 -- 172.21.15.78:0/1212811528 wait complete. 2023-11-28T20:02:18.596 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:18.584+0000 7fb87a398000 20 client.6813 trim_cache size 0 max 16384 2023-11-28T20:02:18.597 INFO:teuthology.orchestra.run.smithi078.stdout:{ 2023-11-28T20:02:18.597 INFO:teuthology.orchestra.run.smithi078.stdout: "cluster_fsid": "dd9780e8-3bda-44fa-a9f0-fa07d19d901d", 2023-11-28T20:02:18.597 INFO:teuthology.orchestra.run.smithi078.stdout: "whoami": 0, 2023-11-28T20:02:18.597 INFO:teuthology.orchestra.run.smithi078.stdout: "id": 6633, 2023-11-28T20:02:18.597 INFO:teuthology.orchestra.run.smithi078.stdout: "want_state": "up:active", 2023-11-28T20:02:18.597 INFO:teuthology.orchestra.run.smithi078.stdout: "state": "up:active", 2023-11-28T20:02:18.597 INFO:teuthology.orchestra.run.smithi078.stdout: "fs_name": "cephfs", 2023-11-28T20:02:18.598 INFO:teuthology.orchestra.run.smithi078.stdout: "rank_uptime": 10.303591879000001, 2023-11-28T20:02:18.598 INFO:teuthology.orchestra.run.smithi078.stdout: "mdsmap_epoch": 46, 2023-11-28T20:02:18.598 INFO:teuthology.orchestra.run.smithi078.stdout: "osdmap_epoch": 81, 2023-11-28T20:02:18.598 INFO:teuthology.orchestra.run.smithi078.stdout: "osdmap_epoch_barrier": 81, 2023-11-28T20:02:18.598 INFO:teuthology.orchestra.run.smithi078.stdout: "uptime": 16.254672955 2023-11-28T20:02:18.598 INFO:teuthology.orchestra.run.smithi078.stdout:} 2023-11-28T20:02:18.599 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:18.588+0000 7fb877017640 1 -- 172.21.15.78:0/2412316581 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fb854066470 msgr2=0x7fb854068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:02:18.599 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:18.588+0000 7fb877017640 1 --2- 172.21.15.78:0/2412316581 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fb854066470 0x7fb854068930 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7fb85c0ad000 tx=0x7fb85c0a9040 comp rx=0 tx=0).stop 2023-11-28T20:02:18.599 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:18.588+0000 7fb877017640 1 -- 172.21.15.78:0/2412316581 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb8600047d0 msgr2=0x7fb8701ed890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:02:18.599 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:18.588+0000 7fb877017640 1 --2- 172.21.15.78:0/2412316581 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb8600047d0 0x7fb8701ed890 secure :-1 s=READY pgs=920 cs=0 l=1 rev1=1 crypto rx=0x7fb8640124c0 tx=0x7fb864012980 comp rx=0 tx=0).stop 2023-11-28T20:02:18.599 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:18.588+0000 7fb877017640 1 -- 172.21.15.78:0/2412316581 shutdown_connections 2023-11-28T20:02:18.599 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:18.588+0000 7fb877017640 1 --2- 172.21.15.78:0/2412316581 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fb854066470 0x7fb854068930 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:18.600 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:18.588+0000 7fb877017640 1 --2- 172.21.15.78:0/2412316581 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb8700a6610 0x7fb870144da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:18.600 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:18.588+0000 7fb877017640 1 --2- 172.21.15.78:0/2412316581 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb870146390 0x7fb8700a60d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:18.600 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:18.588+0000 7fb877017640 1 --2- 172.21.15.78:0/2412316581 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb8600047d0 0x7fb8701ed890 unknown :-1 s=CLOSED pgs=920 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:18.600 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:18.588+0000 7fb877017640 1 -- 172.21.15.78:0/2412316581 >> 172.21.15.78:0/2412316581 conn(0x7fb87006b220 msgr2=0x7fb870152630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:02:18.600 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:18.588+0000 7fb877017640 1 -- 172.21.15.78:0/2412316581 shutdown_connections 2023-11-28T20:02:18.600 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:18.588+0000 7fb877017640 1 -- 172.21.15.78:0/2412316581 wait complete. 2023-11-28T20:02:18.610 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-11-28T20:02:18.748 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:18.744+0000 7f7dbeb84640 1 Processor -- start 2023-11-28T20:02:18.748 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:18.744+0000 7f7dbeb84640 1 -- start start 2023-11-28T20:02:18.749 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:18.744+0000 7f7dbeb84640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f7db8151b00 0x7f7db806c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:18.750 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:18.744+0000 7f7dbeb84640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7db80c8210 0x7f7db80c4600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:18.750 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:18.744+0000 7f7dbeb84640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f7db80c4b40 0x7f7db80c89e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:18.750 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:18.744+0000 7f7dbeb84640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7db806cae0 con 0x7f7db8151b00 2023-11-28T20:02:18.750 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:18.744+0000 7f7dbeb84640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7db8154550 con 0x7f7db80c4b40 2023-11-28T20:02:18.750 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:18.744+0000 7f7dbeb84640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7db8155370 con 0x7f7db80c8210 2023-11-28T20:02:18.750 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:18.744+0000 7f7dbdb82640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f7db8151b00 0x7f7db806c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:02:18.750 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:18.744+0000 7f7dbdb82640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f7db8151b00 0x7f7db806c5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:54338/0 (socket says 172.21.15.78:54338) 2023-11-28T20:02:18.750 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:18.744+0000 7f7dbdb82640 1 -- 172.21.15.78:0/4136343709 learned_addr learned my addr 172.21.15.78:0/4136343709 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T20:02:18.750 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:18.744+0000 7f7dbd381640 1 --2- 172.21.15.78:0/4136343709 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7db80c8210 0x7f7db80c4600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:02:18.750 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:18.744+0000 7f7dbe383640 1 --2- 172.21.15.78:0/4136343709 >> v2:172.21.15.179:3300/0 conn(0x7f7db80c4b40 0x7f7db80c89e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:02:18.750 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:18.744+0000 7f7dbdb82640 1 -- 172.21.15.78:0/4136343709 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7db80c8210 msgr2=0x7f7db80c4600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:02:18.751 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:18.744+0000 7f7dbdb82640 1 --2- 172.21.15.78:0/4136343709 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7db80c8210 0x7f7db80c4600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:18.751 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:18.744+0000 7f7dbdb82640 1 -- 172.21.15.78:0/4136343709 >> v2:172.21.15.179:3300/0 conn(0x7f7db80c4b40 msgr2=0x7f7db80c89e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:02:18.751 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:18.744+0000 7f7dbdb82640 1 --2- 172.21.15.78:0/4136343709 >> v2:172.21.15.179:3300/0 conn(0x7f7db80c4b40 0x7f7db80c89e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:18.751 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:18.744+0000 7f7dbdb82640 1 -- 172.21.15.78:0/4136343709 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7db8154760 con 0x7f7db8151b00 2023-11-28T20:02:18.752 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:18.748+0000 7f7dbdb82640 1 --2- 172.21.15.78:0/4136343709 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7db8151b00 0x7f7db806c5a0 secure :-1 s=READY pgs=925 cs=0 l=1 rev1=1 crypto rx=0x7f7db80c74c0 tx=0x7f7db401c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7967d09037be000c server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:02:18.753 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:18.748+0000 7f7dbcb80640 1 -- 172.21.15.78:0/4136343709 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7db80c9730 con 0x7f7db8151b00 2023-11-28T20:02:18.753 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:18.748+0000 7f7dbcb80640 1 -- 172.21.15.78:0/4136343709 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7db40a7050 con 0x7f7db8151b00 2023-11-28T20:02:18.753 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:18.748+0000 7f7dbcb80640 1 -- 172.21.15.78:0/4136343709 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7db40ab820 con 0x7f7db8151b00 2023-11-28T20:02:18.753 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:18.748+0000 7f7dbeb84640 1 -- 172.21.15.78:0/4136343709 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7db8151b00 msgr2=0x7f7db806c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:02:18.753 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:18.748+0000 7f7dbeb84640 1 --2- 172.21.15.78:0/4136343709 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7db8151b00 0x7f7db806c5a0 secure :-1 s=READY pgs=925 cs=0 l=1 rev1=1 crypto rx=0x7f7db80c74c0 tx=0x7f7db401c470 comp rx=0 tx=0).stop 2023-11-28T20:02:18.754 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:18.748+0000 7f7dbeb84640 1 -- 172.21.15.78:0/4136343709 shutdown_connections 2023-11-28T20:02:18.754 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:18.748+0000 7f7dbeb84640 1 --2- 172.21.15.78:0/4136343709 >> v2:172.21.15.179:3300/0 conn(0x7f7db80c4b40 0x7f7db80c89e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:18.754 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:18.748+0000 7f7dbeb84640 1 --2- 172.21.15.78:0/4136343709 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7db80c8210 0x7f7db80c4600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:18.754 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:18.748+0000 7f7dbeb84640 1 --2- 172.21.15.78:0/4136343709 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7db8151b00 0x7f7db806c5a0 unknown :-1 s=CLOSED pgs=925 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:18.754 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:18.748+0000 7f7dbeb84640 1 -- 172.21.15.78:0/4136343709 >> 172.21.15.78:0/4136343709 conn(0x7f7db80ab9c0 msgr2=0x7f7db80abdd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:02:18.754 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:18.748+0000 7f7dbeb84640 1 -- 172.21.15.78:0/4136343709 shutdown_connections 2023-11-28T20:02:18.754 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:18.748+0000 7f7dbeb84640 1 -- 172.21.15.78:0/4136343709 wait complete. 2023-11-28T20:02:18.755 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:18.752+0000 7f7dbeb84640 1 Processor -- start 2023-11-28T20:02:18.755 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:18.752+0000 7f7dbeb84640 1 -- start start 2023-11-28T20:02:18.758 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:18.752+0000 7f7dbeb84640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7db80c4b40 0x7f7db814d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:18.758 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:18.752+0000 7f7dbeb84640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7db80c8210 0x7f7db814eac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:18.758 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:18.752+0000 7f7dbeb84640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7db8151b00 0x7f7db8156a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:18.758 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:18.752+0000 7f7dbeb84640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7db814dcb0 con 0x7f7db8151b00 2023-11-28T20:02:18.758 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:18.752+0000 7f7dbeb84640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7db814f000 con 0x7f7db80c8210 2023-11-28T20:02:18.758 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:18.752+0000 7f7dbeb84640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7db814c3e0 con 0x7f7db80c4b40 2023-11-28T20:02:18.759 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:18.752+0000 7f7dbe383640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7db8151b00 0x7f7db8156a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:02:18.759 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:18.752+0000 7f7dbe383640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7db8151b00 0x7f7db8156a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:54348/0 (socket says 172.21.15.78:54348) 2023-11-28T20:02:18.759 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:18.752+0000 7f7dbe383640 1 -- 172.21.15.78:0/3466605397 learned_addr learned my addr 172.21.15.78:0/3466605397 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T20:02:18.759 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:18.752+0000 7f7dbdb82640 1 --2- 172.21.15.78:0/3466605397 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7db80c4b40 0x7f7db814d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:02:18.759 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:18.752+0000 7f7dbd381640 1 --2- 172.21.15.78:0/3466605397 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7db80c8210 0x7f7db814eac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:02:18.759 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:18.752+0000 7f7dbe383640 1 -- 172.21.15.78:0/3466605397 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7db80c4b40 msgr2=0x7f7db814d0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:02:18.759 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:18.752+0000 7f7dbe383640 1 --2- 172.21.15.78:0/3466605397 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7db80c4b40 0x7f7db814d0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:18.759 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:18.752+0000 7f7dbe383640 1 -- 172.21.15.78:0/3466605397 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7db80c8210 msgr2=0x7f7db814eac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:02:18.759 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:18.752+0000 7f7dbe383640 1 --2- 172.21.15.78:0/3466605397 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7db80c8210 0x7f7db814eac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:18.759 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:18.752+0000 7f7dbe383640 1 -- 172.21.15.78:0/3466605397 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7db40094d0 con 0x7f7db8151b00 2023-11-28T20:02:18.759 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:18.752+0000 7f7dbd381640 1 --2- 172.21.15.78:0/3466605397 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7db80c8210 0x7f7db814eac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T20:02:18.760 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:18.752+0000 7f7dbe383640 1 --2- 172.21.15.78:0/3466605397 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7db8151b00 0x7f7db8156a30 secure :-1 s=READY pgs=926 cs=0 l=1 rev1=1 crypto rx=0x7f7db0007e60 tx=0x7f7db000e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:02:18.760 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:18.752+0000 7f7dae7fc640 1 -- 172.21.15.78:0/3466605397 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7db0014620 con 0x7f7db8151b00 2023-11-28T20:02:18.760 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:18.752+0000 7f7dae7fc640 1 -- 172.21.15.78:0/3466605397 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7db000ee90 con 0x7f7db8151b00 2023-11-28T20:02:18.760 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:18.752+0000 7f7dbeb84640 1 -- 172.21.15.78:0/3466605397 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7db814cc30 con 0x7f7db8151b00 2023-11-28T20:02:18.760 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:18.752+0000 7f7dae7fc640 1 -- 172.21.15.78:0/3466605397 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7db00149e0 con 0x7f7db8151b00 2023-11-28T20:02:18.760 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:18.752+0000 7f7dbeb84640 1 -- 172.21.15.78:0/3466605397 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7db814c100 con 0x7f7db8151b00 2023-11-28T20:02:18.760 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:18.752+0000 7f7dbeb84640 1 -- 172.21.15.78:0/3466605397 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7db814cdc0 con 0x7f7db8151b00 2023-11-28T20:02:18.761 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:18.756+0000 7f7dae7fc640 1 -- 172.21.15.78:0/3466605397 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f7db0014b40 con 0x7f7db8151b00 2023-11-28T20:02:18.761 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:18.756+0000 7f7dae7fc640 1 --2- 172.21.15.78:0/3466605397 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f7d9c066470 0x7f7d9c068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:18.761 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:18.756+0000 7f7dae7fc640 1 -- 172.21.15.78:0/3466605397 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f7db00848b0 con 0x7f7db8151b00 2023-11-28T20:02:18.762 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:18.756+0000 7f7dbdb82640 1 --2- 172.21.15.78:0/3466605397 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f7d9c066470 0x7f7d9c068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:02:18.762 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:18.756+0000 7f7dbdb82640 1 --2- 172.21.15.78:0/3466605397 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f7d9c066470 0x7f7d9c068930 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f7db40ad000 tx=0x7f7db4008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:02:18.764 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:18.760+0000 7f7dae7fc640 1 -- 172.21.15.78:0/3466605397 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f7db0051b50 con 0x7f7db8151b00 2023-11-28T20:02:18.947 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:18.944+0000 7f7dbeb84640 1 -- 172.21.15.78:0/3466605397 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f7db80674b0 con 0x7f7db8151b00 2023-11-28T20:02:18.947 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:18.944+0000 7f7dae7fc640 1 -- 172.21.15.78:0/3466605397 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v46) v1 ==== 53+0+73 (secure 0 0 0) 0x7f7db0055170 con 0x7f7db8151b00 2023-11-28T20:02:18.948 INFO:teuthology.orchestra.run.smithi078.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-11-28T20:02:18.949 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:18.944+0000 7f7dbeb84640 1 -- 172.21.15.78:0/3466605397 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f7d9c066470 msgr2=0x7f7d9c068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:02:18.949 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:18.944+0000 7f7dbeb84640 1 --2- 172.21.15.78:0/3466605397 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f7d9c066470 0x7f7d9c068930 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f7db40ad000 tx=0x7f7db4008040 comp rx=0 tx=0).stop 2023-11-28T20:02:18.950 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:18.944+0000 7f7dbeb84640 1 -- 172.21.15.78:0/3466605397 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7db8151b00 msgr2=0x7f7db8156a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:02:18.950 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:18.944+0000 7f7dbeb84640 1 --2- 172.21.15.78:0/3466605397 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7db8151b00 0x7f7db8156a30 secure :-1 s=READY pgs=926 cs=0 l=1 rev1=1 crypto rx=0x7f7db0007e60 tx=0x7f7db000e4b0 comp rx=0 tx=0).stop 2023-11-28T20:02:18.950 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:18.944+0000 7f7dbeb84640 1 -- 172.21.15.78:0/3466605397 shutdown_connections 2023-11-28T20:02:18.950 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:18.944+0000 7f7dbeb84640 1 --2- 172.21.15.78:0/3466605397 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f7d9c066470 0x7f7d9c068930 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:18.950 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:18.944+0000 7f7dbeb84640 1 --2- 172.21.15.78:0/3466605397 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7db8151b00 0x7f7db8156a30 unknown :-1 s=CLOSED pgs=926 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:18.950 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:18.944+0000 7f7dbeb84640 1 --2- 172.21.15.78:0/3466605397 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7db80c8210 0x7f7db814eac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:18.950 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:18.944+0000 7f7dbeb84640 1 --2- 172.21.15.78:0/3466605397 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7db80c4b40 0x7f7db814d0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:18.950 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:18.944+0000 7f7dbeb84640 1 -- 172.21.15.78:0/3466605397 >> 172.21.15.78:0/3466605397 conn(0x7f7db80ab9c0 msgr2=0x7f7db80c6690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:02:18.950 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:18.944+0000 7f7dbeb84640 1 -- 172.21.15.78:0/3466605397 shutdown_connections 2023-11-28T20:02:18.951 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:18.944+0000 7f7dbeb84640 1 -- 172.21.15.78:0/3466605397 wait complete. 2023-11-28T20:02:18.968 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-11-28T20:02:18.968 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-11-28T20:02:18.968 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi078.front.sepia.ceph.com 2023-11-28T20:02:18.968 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-11-28T20:02:18.968 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-11-28T20:02:18.968 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-11-28T20:02:18.969 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-11-28T20:02:18.969 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-11-28T20:02:18.969 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-11-28T20:02:18.969 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T20:02:18.969 DEBUG:teuthology.orchestra.run.smithi078:> ip addr 2023-11-28T20:02:18.978 INFO:teuthology.orchestra.run.smithi078.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-11-28T20:02:18.979 INFO:teuthology.orchestra.run.smithi078.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-11-28T20:02:18.979 INFO:teuthology.orchestra.run.smithi078.stdout: inet 127.0.0.1/8 scope host lo 2023-11-28T20:02:18.979 INFO:teuthology.orchestra.run.smithi078.stdout: valid_lft forever preferred_lft forever 2023-11-28T20:02:18.979 INFO:teuthology.orchestra.run.smithi078.stdout: inet6 ::1/128 scope host 2023-11-28T20:02:18.979 INFO:teuthology.orchestra.run.smithi078.stdout: valid_lft forever preferred_lft forever 2023-11-28T20:02:18.980 INFO:teuthology.orchestra.run.smithi078.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-11-28T20:02:18.980 INFO:teuthology.orchestra.run.smithi078.stdout: link/ether 0c:c4:7a:d8:a1:22 brd ff:ff:ff:ff:ff:ff 2023-11-28T20:02:18.980 INFO:teuthology.orchestra.run.smithi078.stdout: altname enp7s0f0 2023-11-28T20:02:18.980 INFO:teuthology.orchestra.run.smithi078.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-11-28T20:02:18.980 INFO:teuthology.orchestra.run.smithi078.stdout: link/ether 0c:c4:7a:d8:a1:23 brd ff:ff:ff:ff:ff:ff 2023-11-28T20:02:18.980 INFO:teuthology.orchestra.run.smithi078.stdout: altname enp7s0f1 2023-11-28T20:02:18.980 INFO:teuthology.orchestra.run.smithi078.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-11-28T20:02:18.980 INFO:teuthology.orchestra.run.smithi078.stdout: link/ether 0c:c4:7a:8f:d4:dc brd ff:ff:ff:ff:ff:ff 2023-11-28T20:02:18.980 INFO:teuthology.orchestra.run.smithi078.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-11-28T20:02:18.980 INFO:teuthology.orchestra.run.smithi078.stdout: link/ether 0c:c4:7a:8f:d4:dd brd ff:ff:ff:ff:ff:ff 2023-11-28T20:02:18.980 INFO:teuthology.orchestra.run.smithi078.stdout: inet 172.21.15.78/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2023-11-28T20:02:18.980 INFO:teuthology.orchestra.run.smithi078.stdout: valid_lft 42233sec preferred_lft 42233sec 2023-11-28T20:02:18.981 INFO:teuthology.orchestra.run.smithi078.stdout: inet6 fe80::ec4:7aff:fe8f:d4dd/64 scope link 2023-11-28T20:02:18.981 INFO:teuthology.orchestra.run.smithi078.stdout: valid_lft forever preferred_lft forever 2023-11-28T20:02:18.981 INFO:teuthology.orchestra.run.smithi078.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-11-28T20:02:18.981 INFO:teuthology.orchestra.run.smithi078.stdout: link/ether 02:42:8f:cc:76:dd brd ff:ff:ff:ff:ff:ff 2023-11-28T20:02:18.981 INFO:teuthology.orchestra.run.smithi078.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-11-28T20:02:18.981 INFO:teuthology.orchestra.run.smithi078.stdout: valid_lft forever preferred_lft forever 2023-11-28T20:02:18.981 INFO:teuthology.orchestra.run.smithi078.stdout:9: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-11-28T20:02:18.981 INFO:teuthology.orchestra.run.smithi078.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2023-11-28T20:02:18.981 INFO:teuthology.orchestra.run.smithi078.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-11-28T20:02:18.981 INFO:teuthology.orchestra.run.smithi078.stdout: valid_lft forever preferred_lft forever 2023-11-28T20:02:18.981 INFO:teuthology.orchestra.run.smithi078.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2023-11-28T20:02:18.982 INFO:teuthology.orchestra.run.smithi078.stdout: valid_lft forever preferred_lft forever 2023-11-28T20:02:18.982 INFO:teuthology.orchestra.run.smithi078.stdout:10: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-11-28T20:02:18.982 INFO:teuthology.orchestra.run.smithi078.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-28T20:02:18.982 INFO:teuthology.orchestra.run.smithi078.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2023-11-28T20:02:18.982 INFO:teuthology.orchestra.run.smithi078.stdout: valid_lft forever preferred_lft forever 2023-11-28T20:02:18.983 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T20:02:18.983 DEBUG:teuthology.orchestra.run.smithi078:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-11-28T20:02:19.045 INFO:teuthology.orchestra.run.smithi078.stdout:1 2023-11-28T20:02:19.047 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T20:02:19.048 DEBUG:teuthology.orchestra.run.smithi078:> route 2023-11-28T20:02:19.101 INFO:teuthology.orchestra.run.smithi078.stdout:Kernel IP routing table 2023-11-28T20:02:19.101 INFO:teuthology.orchestra.run.smithi078.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-11-28T20:02:19.101 INFO:teuthology.orchestra.run.smithi078.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2023-11-28T20:02:19.101 INFO:teuthology.orchestra.run.smithi078.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-11-28T20:02:19.101 INFO:teuthology.orchestra.run.smithi078.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-11-28T20:02:19.101 INFO:teuthology.orchestra.run.smithi078.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-11-28T20:02:19.102 INFO:teuthology.orchestra.run.smithi078.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-11-28T20:02:19.102 INFO:teuthology.orchestra.run.smithi078.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-11-28T20:02:19.102 INFO:teuthology.orchestra.run.smithi078.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-11-28T20:02:19.102 INFO:teuthology.orchestra.run.smithi078.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-11-28T20:02:19.102 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T20:02:19.103 DEBUG:teuthology.orchestra.run.smithi078:> (cd / && exec bash -c ' 2023-11-28T20:02:19.103 DEBUG:teuthology.orchestra.run.smithi078:> set -e 2023-11-28T20:02:19.103 DEBUG:teuthology.orchestra.run.smithi078:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-11-28T20:02:19.103 DEBUG:teuthology.orchestra.run.smithi078:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-11-28T20:02:19.103 DEBUG:teuthology.orchestra.run.smithi078:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-11-28T20:02:19.103 DEBUG:teuthology.orchestra.run.smithi078:> ') 2023-11-28T20:02:19.193 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T20:02:19.193 DEBUG:teuthology.orchestra.run.smithi078:> ip netns list 2023-11-28T20:02:19.203 INFO:teuthology.orchestra.run.smithi078.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-11-28T20:02:19.203 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-11-28T20:02:19.203 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T20:02:19.204 DEBUG:teuthology.orchestra.run.smithi078:> sudo ip link set brx.0 up 2023-11-28T20:02:19.267 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-28T20:02:19.267 DEBUG:teuthology.orchestra.run.smithi078:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-11-28T20:02:19.323 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-28T20:02:19.323 DEBUG:teuthology.orchestra.run.smithi078:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-11-28T20:02:19.375 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2023-11-28T20:02:19.375 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T20:02:19.375 DEBUG:teuthology.orchestra.run.smithi078:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-11-28T20:02:19.468 INFO:teuthology.orchestra.run.smithi078.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-11-28T20:02:19.468 INFO:teuthology.orchestra.run.smithi078.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-11-28T20:02:19.481 INFO:teuthology.orchestra.run.smithi078.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-11-28T20:02:19.482 INFO:teuthology.orchestra.run.smithi078.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-11-28T20:02:19.482 INFO:teuthology.orchestra.run.smithi078.stdout:mount.ceph: resolved to: "172.21.15.78:3300,172.21.15.179:3300,172.21.15.179:3301" 2023-11-28T20:02:19.482 INFO:teuthology.orchestra.run.smithi078.stdout:mount.ceph: trying mount with new device syntax: 0@dd9780e8-3bda-44fa-a9f0-fa07d19d901d.cephfs=/ 2023-11-28T20:02:19.482 INFO:teuthology.orchestra.run.smithi078.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.78:3300/172.21.15.179:3300/172.21.15.179:3301" will pass to kernel 2023-11-28T20:02:19.485 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-11-28T20:02:19.485 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T20:02:19.486 DEBUG:teuthology.orchestra.run.smithi078:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-11-28T20:02:19.507 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T20:02:19.508 DEBUG:teuthology.orchestra.run.smithi078:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-11-28T20:02:19.569 INFO:teuthology.orchestra.run.smithi078.stdout:client6822 2023-11-28T20:02:19.570 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2023-11-28T20:02:19.570 DEBUG:teuthology.orchestra.run.smithi078:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-28T20:02:19.619 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-11-28T20:02:19.800 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:19.796+0000 7fae75980640 1 Processor -- start 2023-11-28T20:02:19.800 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:19.796+0000 7fae75980640 1 -- start start 2023-11-28T20:02:19.802 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:19.796+0000 7fae75980640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fae7006c100 0x7fae7015fe30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:19.802 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:19.796+0000 7fae75980640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fae700c4890 con 0x7fae70154f20 2023-11-28T20:02:19.802 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:19.796+0000 7fae75980640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fae701553d0 con 0x7fae700af4c0 2023-11-28T20:02:19.802 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:19.796+0000 7fae75980640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae700af8a0 con 0x7fae7006c100 2023-11-28T20:02:19.802 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:19.796+0000 7fae667fc640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7fae70154f20 0x7fae7006b9f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:41732/0 (socket says 172.21.15.78:41732) 2023-11-28T20:02:19.802 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:19.796+0000 7fae667fc640 1 -- 172.21.15.78:0/3041549456 learned_addr learned my addr 172.21.15.78:0/3041549456 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-11-28T20:02:19.802 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:19.796+0000 7fae6f7fe640 1 --2- 172.21.15.78:0/3041549456 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fae7006c100 0x7fae7015fe30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:02:19.802 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:19.796+0000 7fae6e7fc640 1 -- 172.21.15.78:0/3041549456 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3491376913 0 0) 0x7fae700c4890 con 0x7fae70154f20 2023-11-28T20:02:19.802 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:19.796+0000 7fae6e7fc640 1 -- 172.21.15.78:0/3041549456 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fae5c003530 con 0x7fae70154f20 2023-11-28T20:02:19.804 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:19.796+0000 7fae6e7fc640 1 -- 172.21.15.78:0/3041549456 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 853094796 0 0) 0x7fae701553d0 con 0x7fae700af4c0 2023-11-28T20:02:19.804 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:19.796+0000 7fae6e7fc640 1 -- 172.21.15.78:0/3041549456 --> v1:172.21.15.179:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fae700c4890 con 0x7fae700af4c0 2023-11-28T20:02:19.805 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:19.796+0000 7fae6e7fc640 1 -- 172.21.15.78:0/3041549456 <== mon.0 v1:172.21.15.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4176983872 0 0) 0x7fae5c003530 con 0x7fae70154f20 2023-11-28T20:02:19.805 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:19.796+0000 7fae6e7fc640 1 -- 172.21.15.78:0/3041549456 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fae7006c100 msgr2=0x7fae7015fe30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:02:19.805 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:19.796+0000 7fae6e7fc640 1 --2- 172.21.15.78:0/3041549456 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fae7006c100 0x7fae7015fe30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:19.805 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:19.796+0000 7fae6e7fc640 1 -- 172.21.15.78:0/3041549456 >> v1:172.21.15.179:6789/0 conn(0x7fae700af4c0 legacy=0x7fae700c67d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:02:19.805 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:19.796+0000 7fae6e7fc640 1 -- 172.21.15.78:0/3041549456 --> v1:172.21.15.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae700c4b30 con 0x7fae70154f20 2023-11-28T20:02:19.805 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:19.796+0000 7fae6e7fc640 1 -- 172.21.15.78:0/3041549456 <== mon.0 v1:172.21.15.78:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3326804700 0 0) 0x7fae58001680 con 0x7fae70154f20 2023-11-28T20:02:19.806 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:19.796+0000 7fae6e7fc640 1 -- 172.21.15.78:0/3041549456 >> v1:172.21.15.78:6789/0 conn(0x7fae70154f20 legacy=0x7fae7006b9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:02:19.806 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:19.796+0000 7fae6e7fc640 1 --2- 172.21.15.78:0/3041549456 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fae5c003b40 0x7fae5c003f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:19.806 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:19.796+0000 7fae6e7fc640 1 --2- 172.21.15.78:0/3041549456 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fae7006c100 0x7fae5c0047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:19.806 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:19.796+0000 7fae6e7fc640 1 --2- 172.21.15.78:0/3041549456 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fae5c004d10 0x7fae5c005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:19.806 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:19.796+0000 7fae6e7fc640 1 -- 172.21.15.78:0/3041549456 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae700af8a0 con 0x7fae5c003b40 2023-11-28T20:02:19.807 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:19.796+0000 7fae6e7fc640 1 -- 172.21.15.78:0/3041549456 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae5c00ba90 con 0x7fae5c004d10 2023-11-28T20:02:19.807 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:19.796+0000 7fae6e7fc640 1 -- 172.21.15.78:0/3041549456 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae5c00bc50 con 0x7fae7006c100 2023-11-28T20:02:19.807 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:19.796+0000 7fae6effd640 1 --2- 172.21.15.78:0/3041549456 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fae5c003b40 0x7fae5c003f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:02:19.807 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:19.796+0000 7fae667fc640 1 --2- 172.21.15.78:0/3041549456 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fae7006c100 0x7fae5c0047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:02:19.807 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:19.800+0000 7fae6f7fe640 1 --2- 172.21.15.78:0/3041549456 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fae5c004d10 0x7fae5c005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:02:19.807 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:19.800+0000 7fae6effd640 1 -- 172.21.15.78:0/3041549456 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fae7006c100 msgr2=0x7fae5c0047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:02:19.807 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:19.800+0000 7fae6effd640 1 --2- 172.21.15.78:0/3041549456 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fae7006c100 0x7fae5c0047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:19.807 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:19.800+0000 7fae6effd640 1 -- 172.21.15.78:0/3041549456 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fae5c004d10 msgr2=0x7fae5c005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:02:19.808 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:19.800+0000 7fae6effd640 1 --2- 172.21.15.78:0/3041549456 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fae5c004d10 0x7fae5c005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:19.808 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:19.800+0000 7fae6effd640 1 -- 172.21.15.78:0/3041549456 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae5c003530 con 0x7fae5c003b40 2023-11-28T20:02:19.808 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:19.800+0000 7fae667fc640 1 --2- 172.21.15.78:0/3041549456 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fae7006c100 0x7fae5c0047d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T20:02:19.811 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:19.800+0000 7fae6effd640 1 --2- 172.21.15.78:0/3041549456 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fae5c003b40 0x7fae5c003f40 secure :-1 s=READY pgs=929 cs=0 l=1 rev1=1 crypto rx=0x7fae60001fd0 tx=0x7fae6001c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3d355eb580e5030c server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:02:19.811 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:19.800+0000 7fae6e7fc640 1 -- 172.21.15.78:0/3041549456 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae60003b80 con 0x7fae5c003b40 2023-11-28T20:02:19.811 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:19.800+0000 7fae6e7fc640 1 -- 172.21.15.78:0/3041549456 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae60003d00 con 0x7fae5c003b40 2023-11-28T20:02:19.811 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:19.800+0000 7fae6e7fc640 1 -- 172.21.15.78:0/3041549456 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae60005310 con 0x7fae5c003b40 2023-11-28T20:02:19.811 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:19.800+0000 7fae75980640 1 -- 172.21.15.78:0/3041549456 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fae5c003b40 msgr2=0x7fae5c003f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:02:19.811 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:19.800+0000 7fae75980640 1 --2- 172.21.15.78:0/3041549456 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fae5c003b40 0x7fae5c003f40 secure :-1 s=READY pgs=929 cs=0 l=1 rev1=1 crypto rx=0x7fae60001fd0 tx=0x7fae6001c8b0 comp rx=0 tx=0).stop 2023-11-28T20:02:19.812 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:19.800+0000 7fae6f7fe640 1 -- 172.21.15.78:0/3041549456 reap_dead start 2023-11-28T20:02:19.812 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:19.800+0000 7fae75980640 1 -- 172.21.15.78:0/3041549456 shutdown_connections 2023-11-28T20:02:19.812 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:19.800+0000 7fae75980640 1 -- 172.21.15.78:0/3041549456 >> 172.21.15.78:0/3041549456 conn(0x7fae700ab9d0 msgr2=0x7fae700abde0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:02:19.812 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:19.800+0000 7fae75980640 1 -- 172.21.15.78:0/3041549456 shutdown_connections 2023-11-28T20:02:19.812 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:19.800+0000 7fae75980640 1 -- 172.21.15.78:0/3041549456 wait complete. 2023-11-28T20:02:19.812 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:19.804+0000 7fae75980640 1 Processor -- start 2023-11-28T20:02:19.812 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:19.804+0000 7fae75980640 1 -- start start 2023-11-28T20:02:19.813 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:19.804+0000 7fae75980640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fae5c003b40 0x7fae7014a910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:19.813 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:19.804+0000 7fae75980640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fae7014f6b0 0x7fae701ec4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:19.813 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:19.804+0000 7fae75980640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fae7014ba40 0x7fae701eca00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:19.813 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:19.804+0000 7fae75980640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae7014b5b0 con 0x7fae7014f6b0 2023-11-28T20:02:19.813 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:19.804+0000 7fae75980640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae7014eaa0 con 0x7fae5c003b40 2023-11-28T20:02:19.813 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:19.804+0000 7fae75980640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae7014e4e0 con 0x7fae7014ba40 2023-11-28T20:02:19.813 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:19.804+0000 7fae667fc640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fae7014f6b0 0x7fae701ec4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:02:19.814 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:19.804+0000 7fae667fc640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fae7014f6b0 0x7fae701ec4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:54370/0 (socket says 172.21.15.78:54370) 2023-11-28T20:02:19.814 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:19.804+0000 7fae667fc640 1 -- 172.21.15.78:0/2446791560 learned_addr learned my addr 172.21.15.78:0/2446791560 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T20:02:19.814 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:19.804+0000 7fae6effd640 1 --2- 172.21.15.78:0/2446791560 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fae5c003b40 0x7fae7014a910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:02:19.814 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:19.804+0000 7fae6f7fe640 1 --2- 172.21.15.78:0/2446791560 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fae7014ba40 0x7fae701eca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:02:19.814 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:19.804+0000 7fae667fc640 1 -- 172.21.15.78:0/2446791560 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fae7014ba40 msgr2=0x7fae701eca00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:02:19.814 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:19.804+0000 7fae667fc640 1 --2- 172.21.15.78:0/2446791560 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fae7014ba40 0x7fae701eca00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:19.814 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:19.804+0000 7fae667fc640 1 -- 172.21.15.78:0/2446791560 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fae5c003b40 msgr2=0x7fae7014a910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:02:19.815 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:19.804+0000 7fae667fc640 1 --2- 172.21.15.78:0/2446791560 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fae5c003b40 0x7fae7014a910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:19.815 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:19.804+0000 7fae667fc640 1 -- 172.21.15.78:0/2446791560 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae7014e7c0 con 0x7fae7014f6b0 2023-11-28T20:02:19.815 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:19.804+0000 7fae667fc640 1 --2- 172.21.15.78:0/2446791560 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fae7014f6b0 0x7fae701ec4c0 secure :-1 s=READY pgs=930 cs=0 l=1 rev1=1 crypto rx=0x7fae58000fc0 tx=0x7fae5800ec10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:02:19.815 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:19.804+0000 7fae6cff9640 1 -- 172.21.15.78:0/2446791560 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae5800ee60 con 0x7fae7014f6b0 2023-11-28T20:02:19.815 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:19.804+0000 7fae6cff9640 1 -- 172.21.15.78:0/2446791560 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae5800c8d0 con 0x7fae7014f6b0 2023-11-28T20:02:19.815 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:19.804+0000 7fae75980640 1 -- 172.21.15.78:0/2446791560 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fae70150900 con 0x7fae7014f6b0 2023-11-28T20:02:19.815 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:19.804+0000 7fae6cff9640 1 -- 172.21.15.78:0/2446791560 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae5800cc40 con 0x7fae7014f6b0 2023-11-28T20:02:19.816 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:19.808+0000 7fae75980640 1 -- 172.21.15.78:0/2446791560 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fae7014b130 con 0x7fae7014f6b0 2023-11-28T20:02:19.817 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:19.808+0000 7fae75980640 1 -- 172.21.15.78:0/2446791560 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fae7014b720 con 0x7fae7014f6b0 2023-11-28T20:02:19.817 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:19.808+0000 7fae6cff9640 1 -- 172.21.15.78:0/2446791560 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fae5801d460 con 0x7fae7014f6b0 2023-11-28T20:02:19.817 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:19.808+0000 7fae6cff9640 1 --2- 172.21.15.78:0/2446791560 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fae500664a0 0x7fae50068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:19.818 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:19.808+0000 7fae6cff9640 1 -- 172.21.15.78:0/2446791560 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6029+0+0 (secure 0 0 0) 0x7fae58083df0 con 0x7fae7014f6b0 2023-11-28T20:02:19.818 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:19.808+0000 7fae6effd640 1 --2- 172.21.15.78:0/2446791560 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fae500664a0 0x7fae50068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:02:19.818 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:19.812+0000 7fae6effd640 1 --2- 172.21.15.78:0/2446791560 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fae500664a0 0x7fae50068960 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7fae600ad000 tx=0x7fae600a7070 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:02:19.819 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:19.812+0000 7fae6cff9640 1 -- 172.21.15.78:0/2446791560 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fae58051140 con 0x7fae7014f6b0 2023-11-28T20:02:20.003 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:20.000+0000 7fae75980640 1 -- 172.21.15.78:0/2446791560 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fae7014b320 con 0x7fae7014f6b0 2023-11-28T20:02:20.003 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:20.000+0000 7fae6cff9640 1 -- 172.21.15.78:0/2446791560 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v46) v1 ==== 53+0+73 (secure 0 0 0) 0x7fae58054760 con 0x7fae7014f6b0 2023-11-28T20:02:20.003 INFO:teuthology.orchestra.run.smithi078.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-11-28T20:02:20.005 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:20.000+0000 7fae75980640 1 -- 172.21.15.78:0/2446791560 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fae500664a0 msgr2=0x7fae50068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:02:20.005 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:20.000+0000 7fae75980640 1 --2- 172.21.15.78:0/2446791560 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fae500664a0 0x7fae50068960 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7fae600ad000 tx=0x7fae600a7070 comp rx=0 tx=0).stop 2023-11-28T20:02:20.006 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:20.000+0000 7fae75980640 1 -- 172.21.15.78:0/2446791560 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fae7014f6b0 msgr2=0x7fae701ec4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:02:20.006 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:20.000+0000 7fae75980640 1 --2- 172.21.15.78:0/2446791560 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fae7014f6b0 0x7fae701ec4c0 secure :-1 s=READY pgs=930 cs=0 l=1 rev1=1 crypto rx=0x7fae58000fc0 tx=0x7fae5800ec10 comp rx=0 tx=0).stop 2023-11-28T20:02:20.006 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:20.000+0000 7fae75980640 1 -- 172.21.15.78:0/2446791560 shutdown_connections 2023-11-28T20:02:20.006 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:20.000+0000 7fae75980640 1 --2- 172.21.15.78:0/2446791560 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fae500664a0 0x7fae50068960 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:20.006 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:20.000+0000 7fae75980640 1 --2- 172.21.15.78:0/2446791560 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fae7014ba40 0x7fae701eca00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:20.006 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:20.000+0000 7fae75980640 1 --2- 172.21.15.78:0/2446791560 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fae7014f6b0 0x7fae701ec4c0 unknown :-1 s=CLOSED pgs=930 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:20.006 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:20.000+0000 7fae75980640 1 --2- 172.21.15.78:0/2446791560 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fae5c003b40 0x7fae7014a910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:20.006 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:20.000+0000 7fae75980640 1 -- 172.21.15.78:0/2446791560 >> 172.21.15.78:0/2446791560 conn(0x7fae700ab9d0 msgr2=0x7fae700aa910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:02:20.006 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:20.000+0000 7fae75980640 1 -- 172.21.15.78:0/2446791560 shutdown_connections 2023-11-28T20:02:20.007 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:20.000+0000 7fae75980640 1 -- 172.21.15.78:0/2446791560 wait complete. 2023-11-28T20:02:20.024 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-11-28T20:02:20.024 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-11-28T20:02:20.024 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi179.front.sepia.ceph.com 2023-11-28T20:02:20.024 INFO:tasks.cephfs.mount:self.client.name = client.1 2023-11-28T20:02:20.024 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-11-28T20:02:20.025 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-11-28T20:02:20.025 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-11-28T20:02:20.025 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-11-28T20:02:20.025 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-11-28T20:02:20.025 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T20:02:20.025 DEBUG:teuthology.orchestra.run.smithi179:> ip addr 2023-11-28T20:02:20.036 INFO:teuthology.orchestra.run.smithi179.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-11-28T20:02:20.036 INFO:teuthology.orchestra.run.smithi179.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-11-28T20:02:20.036 INFO:teuthology.orchestra.run.smithi179.stdout: inet 127.0.0.1/8 scope host lo 2023-11-28T20:02:20.036 INFO:teuthology.orchestra.run.smithi179.stdout: valid_lft forever preferred_lft forever 2023-11-28T20:02:20.036 INFO:teuthology.orchestra.run.smithi179.stdout: inet6 ::1/128 scope host 2023-11-28T20:02:20.036 INFO:teuthology.orchestra.run.smithi179.stdout: valid_lft forever preferred_lft forever 2023-11-28T20:02:20.036 INFO:teuthology.orchestra.run.smithi179.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-11-28T20:02:20.037 INFO:teuthology.orchestra.run.smithi179.stdout: link/ether 0c:c4:7a:d9:3b:34 brd ff:ff:ff:ff:ff:ff 2023-11-28T20:02:20.037 INFO:teuthology.orchestra.run.smithi179.stdout: altname enp7s0f0 2023-11-28T20:02:20.037 INFO:teuthology.orchestra.run.smithi179.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-11-28T20:02:20.037 INFO:teuthology.orchestra.run.smithi179.stdout: link/ether 0c:c4:7a:d9:3b:35 brd ff:ff:ff:ff:ff:ff 2023-11-28T20:02:20.037 INFO:teuthology.orchestra.run.smithi179.stdout: altname enp7s0f1 2023-11-28T20:02:20.037 INFO:teuthology.orchestra.run.smithi179.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-11-28T20:02:20.037 INFO:teuthology.orchestra.run.smithi179.stdout: link/ether 0c:c4:7a:88:72:5a brd ff:ff:ff:ff:ff:ff 2023-11-28T20:02:20.037 INFO:teuthology.orchestra.run.smithi179.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-11-28T20:02:20.037 INFO:teuthology.orchestra.run.smithi179.stdout: link/ether 0c:c4:7a:88:72:5b brd ff:ff:ff:ff:ff:ff 2023-11-28T20:02:20.037 INFO:teuthology.orchestra.run.smithi179.stdout: inet 172.21.15.179/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2023-11-28T20:02:20.037 INFO:teuthology.orchestra.run.smithi179.stdout: valid_lft 42242sec preferred_lft 42242sec 2023-11-28T20:02:20.037 INFO:teuthology.orchestra.run.smithi179.stdout: inet6 fe80::ec4:7aff:fe88:725b/64 scope link 2023-11-28T20:02:20.038 INFO:teuthology.orchestra.run.smithi179.stdout: valid_lft forever preferred_lft forever 2023-11-28T20:02:20.038 INFO:teuthology.orchestra.run.smithi179.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-11-28T20:02:20.038 INFO:teuthology.orchestra.run.smithi179.stdout: link/ether 02:42:75:f0:7b:8c brd ff:ff:ff:ff:ff:ff 2023-11-28T20:02:20.038 INFO:teuthology.orchestra.run.smithi179.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-11-28T20:02:20.038 INFO:teuthology.orchestra.run.smithi179.stdout: valid_lft forever preferred_lft forever 2023-11-28T20:02:20.038 INFO:teuthology.orchestra.run.smithi179.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-11-28T20:02:20.038 INFO:teuthology.orchestra.run.smithi179.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2023-11-28T20:02:20.038 INFO:teuthology.orchestra.run.smithi179.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-11-28T20:02:20.038 INFO:teuthology.orchestra.run.smithi179.stdout: valid_lft forever preferred_lft forever 2023-11-28T20:02:20.039 INFO:teuthology.orchestra.run.smithi179.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2023-11-28T20:02:20.039 INFO:teuthology.orchestra.run.smithi179.stdout: valid_lft forever preferred_lft forever 2023-11-28T20:02:20.039 INFO:teuthology.orchestra.run.smithi179.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-11-28T20:02:20.039 INFO:teuthology.orchestra.run.smithi179.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2023-11-28T20:02:20.039 INFO:teuthology.orchestra.run.smithi179.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2023-11-28T20:02:20.039 INFO:teuthology.orchestra.run.smithi179.stdout: valid_lft forever preferred_lft forever 2023-11-28T20:02:20.040 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T20:02:20.040 DEBUG:teuthology.orchestra.run.smithi179:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-11-28T20:02:20.101 INFO:teuthology.orchestra.run.smithi179.stdout:1 2023-11-28T20:02:20.104 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T20:02:20.104 DEBUG:teuthology.orchestra.run.smithi179:> route 2023-11-28T20:02:20.158 INFO:teuthology.orchestra.run.smithi179.stdout:Kernel IP routing table 2023-11-28T20:02:20.158 INFO:teuthology.orchestra.run.smithi179.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-11-28T20:02:20.158 INFO:teuthology.orchestra.run.smithi179.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2023-11-28T20:02:20.159 INFO:teuthology.orchestra.run.smithi179.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-11-28T20:02:20.159 INFO:teuthology.orchestra.run.smithi179.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-11-28T20:02:20.159 INFO:teuthology.orchestra.run.smithi179.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-11-28T20:02:20.159 INFO:teuthology.orchestra.run.smithi179.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-11-28T20:02:20.159 INFO:teuthology.orchestra.run.smithi179.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-11-28T20:02:20.160 INFO:teuthology.orchestra.run.smithi179.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-11-28T20:02:20.160 INFO:teuthology.orchestra.run.smithi179.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-11-28T20:02:20.160 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T20:02:20.160 DEBUG:teuthology.orchestra.run.smithi179:> (cd / && exec bash -c ' 2023-11-28T20:02:20.160 DEBUG:teuthology.orchestra.run.smithi179:> set -e 2023-11-28T20:02:20.161 DEBUG:teuthology.orchestra.run.smithi179:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-11-28T20:02:20.161 DEBUG:teuthology.orchestra.run.smithi179:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-11-28T20:02:20.161 DEBUG:teuthology.orchestra.run.smithi179:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-11-28T20:02:20.161 DEBUG:teuthology.orchestra.run.smithi179:> ') 2023-11-28T20:02:20.260 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T20:02:20.260 DEBUG:teuthology.orchestra.run.smithi179:> ip netns list 2023-11-28T20:02:20.269 INFO:teuthology.orchestra.run.smithi179.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-11-28T20:02:20.270 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-11-28T20:02:20.270 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T20:02:20.270 DEBUG:teuthology.orchestra.run.smithi179:> sudo ip link set brx.0 up 2023-11-28T20:02:20.337 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-28T20:02:20.337 DEBUG:teuthology.orchestra.run.smithi179:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2023-11-28T20:02:20.392 INFO:teuthology.orchestra.run.smithi179.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2023-11-28T20:02:20.393 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-28T20:02:20.393 DEBUG:teuthology.orchestra.run.smithi179:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2023-11-28T20:02:20.448 INFO:tasks.cephfs.kernel_mount:mounting using device: 1@.cephfs=/ 2023-11-28T20:02:20.448 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T20:02:20.448 DEBUG:teuthology.orchestra.run.smithi179:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 1@.cephfs=/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-11-28T20:02:20.538 INFO:teuthology.orchestra.run.smithi179.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-11-28T20:02:20.539 INFO:teuthology.orchestra.run.smithi179.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-11-28T20:02:20.552 INFO:teuthology.orchestra.run.smithi179.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-11-28T20:02:20.552 INFO:teuthology.orchestra.run.smithi179.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-11-28T20:02:20.553 INFO:teuthology.orchestra.run.smithi179.stdout:mount.ceph: resolved to: "172.21.15.78:3300,172.21.15.179:3300,172.21.15.179:3301" 2023-11-28T20:02:20.553 INFO:teuthology.orchestra.run.smithi179.stdout:mount.ceph: trying mount with new device syntax: 1@dd9780e8-3bda-44fa-a9f0-fa07d19d901d.cephfs=/ 2023-11-28T20:02:20.553 INFO:teuthology.orchestra.run.smithi179.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,ms_mode=prefer-crc,key=1,mon_addr=172.21.15.78:3300/172.21.15.179:3300/172.21.15.179:3301" will pass to kernel 2023-11-28T20:02:20.556 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-11-28T20:02:20.556 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T20:02:20.556 DEBUG:teuthology.orchestra.run.smithi179:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-11-28T20:02:20.576 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T20:02:20.576 DEBUG:teuthology.orchestra.run.smithi179:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-11-28T20:02:20.631 INFO:teuthology.orchestra.run.smithi179.stdout:client6831 2023-11-28T20:02:20.632 DEBUG:teuthology.orchestra.run.smithi179:> set -ex 2023-11-28T20:02:20.632 DEBUG:teuthology.orchestra.run.smithi179:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-28T20:02:20.685 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth rm client.testuser 2023-11-28T20:02:20.830 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:20.824+0000 7f803bbd1640 1 Processor -- start 2023-11-28T20:02:20.831 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:20.824+0000 7f803bbd1640 1 -- start start 2023-11-28T20:02:20.832 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:20.828+0000 7f803bbd1640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f80340a5370 0x7f803414f870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:20.832 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:20.828+0000 7f803bbd1640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f8034072810 0x7f803414fdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:20.833 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:20.828+0000 7f803bbd1640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f80341524b0 con 0x7f80340a4f90 2023-11-28T20:02:20.833 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:20.828+0000 7f803bbd1640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f80340c60d0 con 0x7f8034072810 2023-11-28T20:02:20.833 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:20.828+0000 7f803bbd1640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f80340c62f0 con 0x7f80340a5370 2023-11-28T20:02:20.833 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:20.828+0000 7f803a16e640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f8034072810 0x7f803414fdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:02:20.833 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:20.828+0000 7f803a16e640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f8034072810 0x7f803414fdb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:54374/0 (socket says 172.21.15.78:54374) 2023-11-28T20:02:20.833 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:20.828+0000 7f803a16e640 1 -- 172.21.15.78:0/1735047885 learned_addr learned my addr 172.21.15.78:0/1735047885 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T20:02:20.833 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:20.828+0000 7f803916c640 1 --2- 172.21.15.78:0/1735047885 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f80340a5370 0x7f803414f870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:02:20.833 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:20.828+0000 7f803a16e640 1 -- 172.21.15.78:0/1735047885 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f80340a5370 msgr2=0x7f803414f870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:02:20.833 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:20.828+0000 7f803a16e640 1 --2- 172.21.15.78:0/1735047885 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f80340a5370 0x7f803414f870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:20.833 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:20.828+0000 7f803a16e640 1 -- 172.21.15.78:0/1735047885 >> v1:172.21.15.179:6789/0 conn(0x7f80340a4f90 legacy=0x7f80340c59c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:02:20.833 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:20.828+0000 7f803a16e640 1 -- 172.21.15.78:0/1735047885 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8034152770 con 0x7f8034072810 2023-11-28T20:02:20.833 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:20.828+0000 7f803896b640 1 -- 172.21.15.78:0/1735047885 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3749275047 0 0) 0x7f80341524b0 con 0x7f80340a4f90 2023-11-28T20:02:20.835 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:20.832+0000 7f803a16e640 1 --2- 172.21.15.78:0/1735047885 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8034072810 0x7f803414fdb0 secure :-1 s=READY pgs=932 cs=0 l=1 rev1=1 crypto rx=0x7f802c009e50 tx=0x7f802c01c980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f9866238651f1feb server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:02:20.835 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:20.832+0000 7f803896b640 1 -- 172.21.15.78:0/1735047885 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f802c0a5640 con 0x7f8034072810 2023-11-28T20:02:20.836 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:20.832+0000 7f803896b640 1 -- 172.21.15.78:0/1735047885 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f802c0a57a0 con 0x7f8034072810 2023-11-28T20:02:20.836 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:20.832+0000 7f803896b640 1 -- 172.21.15.78:0/1735047885 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f802c0a5b30 con 0x7f8034072810 2023-11-28T20:02:20.836 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:20.832+0000 7f803bbd1640 1 -- 172.21.15.78:0/1735047885 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8034072810 msgr2=0x7f803414fdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:02:20.836 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:20.832+0000 7f803bbd1640 1 --2- 172.21.15.78:0/1735047885 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8034072810 0x7f803414fdb0 secure :-1 s=READY pgs=932 cs=0 l=1 rev1=1 crypto rx=0x7f802c009e50 tx=0x7f802c01c980 comp rx=0 tx=0).stop 2023-11-28T20:02:20.837 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:20.832+0000 7f803bbd1640 1 -- 172.21.15.78:0/1735047885 shutdown_connections 2023-11-28T20:02:20.837 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:20.832+0000 7f803bbd1640 1 --2- 172.21.15.78:0/1735047885 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8034072810 0x7f803414fdb0 unknown :-1 s=CLOSED pgs=932 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:20.837 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:20.832+0000 7f803bbd1640 1 --2- 172.21.15.78:0/1735047885 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f80340a5370 0x7f803414f870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:20.837 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:20.832+0000 7f803bbd1640 1 -- 172.21.15.78:0/1735047885 >> 172.21.15.78:0/1735047885 conn(0x7f803406b220 msgr2=0x7f80340a77e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:02:20.837 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:20.832+0000 7f803bbd1640 1 -- 172.21.15.78:0/1735047885 shutdown_connections 2023-11-28T20:02:20.837 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:20.832+0000 7f803bbd1640 1 -- 172.21.15.78:0/1735047885 wait complete. 2023-11-28T20:02:20.838 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:20.832+0000 7f803bbd1640 1 Processor -- start 2023-11-28T20:02:20.838 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:20.832+0000 7f803bbd1640 1 -- start start 2023-11-28T20:02:20.840 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:20.836+0000 7f803bbd1640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8034072810 0x7f803414b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:20.840 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:20.836+0000 7f803bbd1640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f80340a4f90 0x7f8034149130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:20.840 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:20.836+0000 7f803bbd1640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f80340a5370 0x7f8034149670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:20.840 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:20.836+0000 7f803bbd1640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80341503a0 con 0x7f8034072810 2023-11-28T20:02:20.840 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:20.836+0000 7f803bbd1640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f803414ff90 con 0x7f80340a4f90 2023-11-28T20:02:20.840 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:20.836+0000 7f803bbd1640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f80340aa840 con 0x7f80340a5370 2023-11-28T20:02:20.840 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:20.836+0000 7f803996d640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8034072810 0x7f803414b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:02:20.840 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:20.836+0000 7f803996d640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8034072810 0x7f803414b0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:54382/0 (socket says 172.21.15.78:54382) 2023-11-28T20:02:20.840 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:20.836+0000 7f803996d640 1 -- 172.21.15.78:0/3736420590 learned_addr learned my addr 172.21.15.78:0/3736420590 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T20:02:20.840 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:20.836+0000 7f803916c640 1 --2- 172.21.15.78:0/3736420590 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f80340a4f90 0x7f8034149130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:02:20.841 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:20.836+0000 7f803a16e640 1 --2- 172.21.15.78:0/3736420590 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f80340a5370 0x7f8034149670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:02:20.841 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:20.836+0000 7f803996d640 1 -- 172.21.15.78:0/3736420590 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f80340a5370 msgr2=0x7f8034149670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:02:20.841 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:20.836+0000 7f803996d640 1 --2- 172.21.15.78:0/3736420590 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f80340a5370 0x7f8034149670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:20.841 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:20.836+0000 7f803996d640 1 -- 172.21.15.78:0/3736420590 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f80340a4f90 msgr2=0x7f8034149130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:02:20.841 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:20.836+0000 7f803996d640 1 --2- 172.21.15.78:0/3736420590 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f80340a4f90 0x7f8034149130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:20.841 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:20.836+0000 7f803996d640 1 -- 172.21.15.78:0/3736420590 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f802c009b30 con 0x7f8034072810 2023-11-28T20:02:20.841 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:20.836+0000 7f803916c640 1 --2- 172.21.15.78:0/3736420590 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f80340a4f90 0x7f8034149130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T20:02:20.841 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:20.836+0000 7f803996d640 1 --2- 172.21.15.78:0/3736420590 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8034072810 0x7f803414b0d0 secure :-1 s=READY pgs=933 cs=0 l=1 rev1=1 crypto rx=0x7f803000c4d0 tx=0x7f803000c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:02:20.842 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:20.836+0000 7f802a7fc640 1 -- 172.21.15.78:0/3736420590 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8030005480 con 0x7f8034072810 2023-11-28T20:02:20.842 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:20.836+0000 7f802a7fc640 1 -- 172.21.15.78:0/3736420590 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8030003600 con 0x7f8034072810 2023-11-28T20:02:20.842 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:20.836+0000 7f803bbd1640 1 -- 172.21.15.78:0/3736420590 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f80340aab20 con 0x7f8034072810 2023-11-28T20:02:20.842 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:20.836+0000 7f802a7fc640 1 -- 172.21.15.78:0/3736420590 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80300039b0 con 0x7f8034072810 2023-11-28T20:02:20.843 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:20.836+0000 7f803bbd1640 1 -- 172.21.15.78:0/3736420590 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f80341520b0 con 0x7f8034072810 2023-11-28T20:02:20.843 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:20.836+0000 7f803bbd1640 1 -- 172.21.15.78:0/3736420590 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f80340c0050 con 0x7f8034072810 2023-11-28T20:02:20.843 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:20.836+0000 7f802a7fc640 1 -- 172.21.15.78:0/3736420590 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f8030003b10 con 0x7f8034072810 2023-11-28T20:02:20.843 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:20.840+0000 7f802a7fc640 1 --2- 172.21.15.78:0/3736420590 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f8018066470 0x7f8018068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:20.843 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:20.840+0000 7f802a7fc640 1 -- 172.21.15.78:0/3736420590 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f80300835b0 con 0x7f8034072810 2023-11-28T20:02:20.843 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:20.840+0000 7f803916c640 1 --2- 172.21.15.78:0/3736420590 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f8018066470 0x7f8018068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:02:20.844 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:20.840+0000 7f803916c640 1 --2- 172.21.15.78:0/3736420590 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f8018066470 0x7f8018068930 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f80340a6590 tx=0x7f8024009190 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:02:20.847 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:20.844+0000 7f802a7fc640 1 -- 172.21.15.78:0/3736420590 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f80300509c0 con 0x7f8034072810 2023-11-28T20:02:21.051 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:21.048+0000 7f803bbd1640 1 -- 172.21.15.78:0/3736420590 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "auth rm", "entity": "client.testuser"} v 0) v1 -- 0x7f8034067630 con 0x7f8034072810 2023-11-28T20:02:21.052 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:21.048+0000 7f802a7fc640 1 -- 172.21.15.78:0/3736420590 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "auth rm", "entity": "client.testuser"}]=0 v21) v1 ==== 84+0+0 (secure 0 0 0) 0x7f8030017090 con 0x7f8034072810 2023-11-28T20:02:21.054 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:21.048+0000 7f803bbd1640 1 -- 172.21.15.78:0/3736420590 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f8018066470 msgr2=0x7f8018068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:02:21.054 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:21.048+0000 7f803bbd1640 1 --2- 172.21.15.78:0/3736420590 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f8018066470 0x7f8018068930 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f80340a6590 tx=0x7f8024009190 comp rx=0 tx=0).stop 2023-11-28T20:02:21.054 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:21.048+0000 7f803bbd1640 1 -- 172.21.15.78:0/3736420590 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8034072810 msgr2=0x7f803414b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:02:21.054 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:21.048+0000 7f803bbd1640 1 --2- 172.21.15.78:0/3736420590 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8034072810 0x7f803414b0d0 secure :-1 s=READY pgs=933 cs=0 l=1 rev1=1 crypto rx=0x7f803000c4d0 tx=0x7f803000c990 comp rx=0 tx=0).stop 2023-11-28T20:02:21.054 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:21.048+0000 7f803bbd1640 1 -- 172.21.15.78:0/3736420590 shutdown_connections 2023-11-28T20:02:21.054 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:21.048+0000 7f803bbd1640 1 --2- 172.21.15.78:0/3736420590 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f8018066470 0x7f8018068930 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:21.054 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:21.048+0000 7f803bbd1640 1 --2- 172.21.15.78:0/3736420590 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f80340a5370 0x7f8034149670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:21.054 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:21.048+0000 7f803bbd1640 1 --2- 172.21.15.78:0/3736420590 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f80340a4f90 0x7f8034149130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:21.054 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:21.048+0000 7f803bbd1640 1 --2- 172.21.15.78:0/3736420590 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8034072810 0x7f803414b0d0 unknown :-1 s=CLOSED pgs=933 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:21.054 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:21.048+0000 7f803bbd1640 1 -- 172.21.15.78:0/3736420590 >> 172.21.15.78:0/3736420590 conn(0x7f803406b220 msgr2=0x7f80340a65c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:02:21.055 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:21.048+0000 7f803bbd1640 1 -- 172.21.15.78:0/3736420590 shutdown_connections 2023-11-28T20:02:21.055 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:21.048+0000 7f803bbd1640 1 -- 172.21.15.78:0/3736420590 wait complete. 2023-11-28T20:02:21.073 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-28T20:02:21.211 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:21.204+0000 7f41f3d65640 1 Processor -- start 2023-11-28T20:02:21.211 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:21.208+0000 7f41f3d65640 1 -- start start 2023-11-28T20:02:21.212 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:21.208+0000 7f41f3d65640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f41ec0c3b80 0x7f41ec06d690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:21.213 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:21.208+0000 7f41f3d65640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f41ec0c5300 0x7f41ec06c730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:21.213 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:21.208+0000 7f41f3d65640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f41ec06bb80 con 0x7f41ec06d2b0 2023-11-28T20:02:21.213 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:21.208+0000 7f41f3d65640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f41ec06cc70 con 0x7f41ec0c5300 2023-11-28T20:02:21.213 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:21.208+0000 7f41f3d65640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f41ec0c5790 con 0x7f41ec0c3b80 2023-11-28T20:02:21.213 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:21.208+0000 7f41f2302640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f41ec0c5300 0x7f41ec06c730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:02:21.213 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:21.208+0000 7f41f2302640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f41ec0c5300 0x7f41ec06c730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:54398/0 (socket says 172.21.15.78:54398) 2023-11-28T20:02:21.213 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:21.208+0000 7f41f2302640 1 -- 172.21.15.78:0/942681475 learned_addr learned my addr 172.21.15.78:0/942681475 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T20:02:21.213 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:21.208+0000 7f41f1b01640 1 --1- 172.21.15.78:0/942681475 >> v1:172.21.15.78:6789/0 conn(0x7f41ec06d2b0 0x7f41ec06c020 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:41742/0 (socket says 172.21.15.78:41742) 2023-11-28T20:02:21.213 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:21.208+0000 7f41f1300640 1 --2- 172.21.15.78:0/942681475 >> v2:172.21.15.179:3300/0 conn(0x7f41ec0c3b80 0x7f41ec06d690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:02:21.213 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:21.208+0000 7f41f2302640 1 -- 172.21.15.78:0/942681475 >> v2:172.21.15.179:3300/0 conn(0x7f41ec0c3b80 msgr2=0x7f41ec06d690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:02:21.213 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:21.208+0000 7f41f2302640 1 --2- 172.21.15.78:0/942681475 >> v2:172.21.15.179:3300/0 conn(0x7f41ec0c3b80 0x7f41ec06d690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:21.213 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:21.208+0000 7f41f2302640 1 -- 172.21.15.78:0/942681475 >> v1:172.21.15.78:6789/0 conn(0x7f41ec06d2b0 legacy=0x7f41ec06c020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:02:21.214 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:21.208+0000 7f41f2302640 1 -- 172.21.15.78:0/942681475 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41ec1515c0 con 0x7f41ec0c5300 2023-11-28T20:02:21.214 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:21.208+0000 7f41f0aff640 1 -- 172.21.15.78:0/942681475 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1891829464 0 0) 0x7f41ec06bb80 con 0x7f41ec06d2b0 2023-11-28T20:02:21.215 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:21.212+0000 7f41f2302640 1 --2- 172.21.15.78:0/942681475 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f41ec0c5300 0x7f41ec06c730 secure :-1 s=READY pgs=935 cs=0 l=1 rev1=1 crypto rx=0x7f41ec06b5a0 tx=0x7f41e401c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=58d42bfb3fd7caea server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:02:21.216 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:21.212+0000 7f41f0aff640 1 -- 172.21.15.78:0/942681475 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41e40a5770 con 0x7f41ec0c5300 2023-11-28T20:02:21.216 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:21.212+0000 7f41f0aff640 1 -- 172.21.15.78:0/942681475 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f41e40a58d0 con 0x7f41ec0c5300 2023-11-28T20:02:21.216 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:21.212+0000 7f41f0aff640 1 -- 172.21.15.78:0/942681475 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41e40a5c60 con 0x7f41ec0c5300 2023-11-28T20:02:21.217 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:21.212+0000 7f41f3d65640 1 -- 172.21.15.78:0/942681475 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f41ec0c5300 msgr2=0x7f41ec06c730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:02:21.217 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:21.212+0000 7f41f3d65640 1 --2- 172.21.15.78:0/942681475 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f41ec0c5300 0x7f41ec06c730 secure :-1 s=READY pgs=935 cs=0 l=1 rev1=1 crypto rx=0x7f41ec06b5a0 tx=0x7f41e401c9a0 comp rx=0 tx=0).stop 2023-11-28T20:02:21.217 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:21.212+0000 7f41f3d65640 1 -- 172.21.15.78:0/942681475 shutdown_connections 2023-11-28T20:02:21.217 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:21.212+0000 7f41f3d65640 1 --2- 172.21.15.78:0/942681475 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f41ec0c5300 0x7f41ec06c730 unknown :-1 s=CLOSED pgs=935 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:21.217 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:21.212+0000 7f41f3d65640 1 --2- 172.21.15.78:0/942681475 >> v2:172.21.15.179:3300/0 conn(0x7f41ec0c3b80 0x7f41ec06d690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:21.217 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:21.212+0000 7f41f3d65640 1 -- 172.21.15.78:0/942681475 >> 172.21.15.78:0/942681475 conn(0x7f41ec0a7810 msgr2=0x7f41ec0a7c20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:02:21.217 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:21.212+0000 7f41f3d65640 1 -- 172.21.15.78:0/942681475 shutdown_connections 2023-11-28T20:02:21.217 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:21.212+0000 7f41f3d65640 1 -- 172.21.15.78:0/942681475 wait complete. 2023-11-28T20:02:21.222 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:21.212+0000 7f41f3d65640 1 Processor -- start 2023-11-28T20:02:21.222 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:21.212+0000 7f41f3d65640 1 -- start start 2023-11-28T20:02:21.222 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:21.216+0000 7f41f3d65640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f41ec06d2b0 0x7f41ec154a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:21.222 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:21.216+0000 7f41f3d65640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f41ec0c3b80 0x7f41ec15a360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:21.222 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:21.216+0000 7f41f3d65640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f41ec0c5300 0x7f41ec0a9950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:21.222 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:21.216+0000 7f41f3d65640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41ec1eca60 con 0x7f41ec0c5300 2023-11-28T20:02:21.222 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:21.216+0000 7f41f3d65640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41ec1578d0 con 0x7f41ec06d2b0 2023-11-28T20:02:21.223 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:21.216+0000 7f41f3d65640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f41ec1575f0 con 0x7f41ec0c3b80 2023-11-28T20:02:21.223 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:21.216+0000 7f41f2302640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f41ec0c5300 0x7f41ec0a9950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:02:21.223 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:21.216+0000 7f41f2302640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f41ec0c5300 0x7f41ec0a9950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:54412/0 (socket says 172.21.15.78:54412) 2023-11-28T20:02:21.223 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:21.216+0000 7f41f2302640 1 -- 172.21.15.78:0/2910757120 learned_addr learned my addr 172.21.15.78:0/2910757120 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T20:02:21.223 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:21.216+0000 7f41f1b01640 1 --2- 172.21.15.78:0/2910757120 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f41ec06d2b0 0x7f41ec154a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:02:21.223 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:21.216+0000 7f41f1300640 1 --2- 172.21.15.78:0/2910757120 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f41ec0c3b80 0x7f41ec15a360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:02:21.223 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:21.216+0000 7f41f2302640 1 -- 172.21.15.78:0/2910757120 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f41ec0c3b80 msgr2=0x7f41ec15a360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:02:21.223 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:21.216+0000 7f41f2302640 1 --2- 172.21.15.78:0/2910757120 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f41ec0c3b80 0x7f41ec15a360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:21.224 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:21.216+0000 7f41f2302640 1 -- 172.21.15.78:0/2910757120 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f41ec06d2b0 msgr2=0x7f41ec154a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:02:21.224 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:21.216+0000 7f41f2302640 1 --2- 172.21.15.78:0/2910757120 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f41ec06d2b0 0x7f41ec154a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:21.224 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:21.216+0000 7f41f2302640 1 -- 172.21.15.78:0/2910757120 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41e4009b30 con 0x7f41ec0c5300 2023-11-28T20:02:21.224 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:21.216+0000 7f41f2302640 1 --2- 172.21.15.78:0/2910757120 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f41ec0c5300 0x7f41ec0a9950 secure :-1 s=READY pgs=936 cs=0 l=1 rev1=1 crypto rx=0x7f41e40af040 tx=0x7f41e4019740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:02:21.224 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:21.216+0000 7f41e27fc640 1 -- 172.21.15.78:0/2910757120 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41e40b8670 con 0x7f41ec0c5300 2023-11-28T20:02:21.224 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:21.216+0000 7f41e27fc640 1 -- 172.21.15.78:0/2910757120 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f41e40b87d0 con 0x7f41ec0c5300 2023-11-28T20:02:21.224 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:21.216+0000 7f41f3d65640 1 -- 172.21.15.78:0/2910757120 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f41ec14ef80 con 0x7f41ec0c5300 2023-11-28T20:02:21.224 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:21.216+0000 7f41e27fc640 1 -- 172.21.15.78:0/2910757120 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41e40b8b80 con 0x7f41ec0c5300 2023-11-28T20:02:21.224 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:21.216+0000 7f41f3d65640 1 -- 172.21.15.78:0/2910757120 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f41ec1ecf50 con 0x7f41ec0c5300 2023-11-28T20:02:21.224 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:21.216+0000 7f41f3d65640 1 -- 172.21.15.78:0/2910757120 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f41ec067630 con 0x7f41ec0c5300 2023-11-28T20:02:21.225 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:21.216+0000 7f41e27fc640 1 -- 172.21.15.78:0/2910757120 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f41e40b8ce0 con 0x7f41ec0c5300 2023-11-28T20:02:21.225 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:21.220+0000 7f41e27fc640 1 --2- 172.21.15.78:0/2910757120 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f41d0066470 0x7f41d0068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:21.225 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:21.220+0000 7f41e27fc640 1 -- 172.21.15.78:0/2910757120 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f41e411f370 con 0x7f41ec0c5300 2023-11-28T20:02:21.225 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:21.220+0000 7f41f1b01640 1 --2- 172.21.15.78:0/2910757120 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f41d0066470 0x7f41d0068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:02:21.225 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:21.220+0000 7f41f1b01640 1 --2- 172.21.15.78:0/2910757120 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f41d0066470 0x7f41d0068930 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f41e8000f70 tx=0x7f41e8007b60 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:02:21.227 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:21.224+0000 7f41e27fc640 1 -- 172.21.15.78:0/2910757120 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f41e40ec7d0 con 0x7f41ec0c5300 2023-11-28T20:02:21.377 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:21.372+0000 7f41f3d65640 1 -- 172.21.15.78:0/2910757120 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f41ec070540 con 0x7f41ec0c5300 2023-11-28T20:02:21.378 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:21.372+0000 7f41e27fc640 1 -- 172.21.15.78:0/2910757120 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v81) v1 ==== 74+0+16693 (secure 0 0 0) 0x7f41e4009510 con 0x7f41ec0c5300 2023-11-28T20:02:21.378 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-11-28T20:02:21.378 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":81,"fsid":"dd9780e8-3bda-44fa-a9f0-fa07d19d901d","created":"2023-11-28T19:58:40.969556+0000","modified":"2023-11-28T20:02:09.283551+0000","last_up_change":"2023-11-28T19:58:52.596716+0000","last_in_change":"2023-11-28T19:58:43.609275+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":14,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-28T19:58:54.011229+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_metadata","create_time":"2023-11-28T20:02:05.787820+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs_data","create_time":"2023-11-28T20:02:06.652305+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e84245ac-b5da-429e-af18-39acaa2b33e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6800","nonce":3358701235},{"type":"v1","addr":"172.21.15.78:6801","nonce":3358701235}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6802","nonce":3358701235},{"type":"v1","addr":"172.21.15.78:6803","nonce":3358701235}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6806","nonce":3358701235},{"type":"v1","addr":"172.21.15.78:6807","nonce":3358701235}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6804","nonce":3358701235},{"type":"v1","addr":"172.21.15.78:6805","nonce":3358701235}]},"public_addr":"172.21.15.78:6801/3358701235","cluster_addr":"172.21.15.78:6803/3358701235","heartbeat_back_addr":"172.21.15.78:6807/3358701235","heartbeat_front_addr":"172.21.15.78:6805/3358701235","state":["exists","up"]},{"osd":1,"uuid":"e634831d-c4e2-48d9-870c-9556ae162981","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6808","nonce":3211476654},{"type":"v1","addr":"172.21.15.78:6809","nonce":3211476654}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6810","nonce":3211476654},{"type":"v1","addr":"172.21.15.78:6811","nonce":3211476654}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6814","nonce":3211476654},{"type":"v1","addr":"172.21.15.78:6815","nonce":3211476654}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6812","nonce":3211476654},{"type":"v1","addr":"172.21.15.78:6813","nonce":3211476654}]},"public_addr":"172.21.15.78:6809/3211476654","cluster_addr":"172.21.15.78:6811/3211476654","heartbeat_back_addr":"172.21.15.78:6815/3211476654","heartbeat_front_addr":"172.21.15.78:6813/3211476654","state":["exists","up"]},{"osd":2,"uuid":"274c8395-6534-41f0-b8fb-a00af8985aa8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6816","nonce":2532904479},{"type":"v1","addr":"172.21.15.78:6817","nonce":2532904479}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6818","nonce":2532904479},{"type":"v1","addr":"172.21.15.78:6819","nonce":2532904479}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6822","nonce":2532904479},{"type":"v1","addr":"172.21.15.78:6823","nonce":2532904479}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6820","nonce":2532904479},{"type":"v1","addr":"172.21.15.78:6821","nonce":2532904479}]},"public_addr":"172.21.15.78:6817/2532904479","cluster_addr":"172.21.15.78:6819/2532904479","heartbeat_back_addr":"172.21.15.78:6823/2532904479","heartbeat_front_addr":"172.21.15.78:6821/2532904479","state":["exists","up"]},{"osd":3,"uuid":"77acc9af-7d4d-4b18-8cf5-d62f5971b7c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6824","nonce":3442991267},{"type":"v1","addr":"172.21.15.78:6825","nonce":3442991267}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6826","nonce":3442991267},{"type":"v1","addr":"172.21.15.78:6827","nonce":3442991267}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6830","nonce":3442991267},{"type":"v1","addr":"172.21.15.78:6831","nonce":3442991267}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6828","nonce":3442991267},{"type":"v1","addr":"172.21.15.78:6829","nonce":3442991267}]},"public_addr":"172.21.15.78:6825/3442991267","cluster_addr":"172.21.15.78:6827/3442991267","heartbeat_back_addr":"172.21.15.78:6831/3442991267","heartbeat_front_addr":"172.21.15.78:6829/3442991267","state":["exists","up"]},{"osd":4,"uuid":"5c62bc66-6b34-4b7f-a66b-9a743969138c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":802983577},{"type":"v1","addr":"172.21.15.179:6809","nonce":802983577}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":802983577},{"type":"v1","addr":"172.21.15.179:6811","nonce":802983577}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":802983577},{"type":"v1","addr":"172.21.15.179:6815","nonce":802983577}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":802983577},{"type":"v1","addr":"172.21.15.179:6813","nonce":802983577}]},"public_addr":"172.21.15.179:6809/802983577","cluster_addr":"172.21.15.179:6811/802983577","heartbeat_back_addr":"172.21.15.179:6815/802983577","heartbeat_front_addr":"172.21.15.179:6813/802983577","state":["exists","up"]},{"osd":5,"uuid":"67db6d36-f684-4079-b0cd-82b4dd61461f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":518192887},{"type":"v1","addr":"172.21.15.179:6818","nonce":518192887}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":518192887},{"type":"v1","addr":"172.21.15.179:6822","nonce":518192887}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":518192887},{"type":"v1","addr":"172.21.15.179:6829","nonce":518192887}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6824","nonce":518192887},{"type":"v1","addr":"172.21.15.179:6826","nonce":518192887}]},"public_addr":"172.21.15.179:6818/518192887","cluster_addr":"172.21.15.179:6822/518192887","heartbeat_back_addr":"172.21.15.179:6829/518192887","heartbeat_front_addr":"172.21.15.179:6826/518192887","state":["exists","up"]},{"osd":6,"uuid":"12e670af-5a16-4c81-9f97-defa66cab967","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":815435378},{"type":"v1","addr":"172.21.15.179:6801","nonce":815435378}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":815435378},{"type":"v1","addr":"172.21.15.179:6803","nonce":815435378}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":815435378},{"type":"v1","addr":"172.21.15.179:6807","nonce":815435378}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":815435378},{"type":"v1","addr":"172.21.15.179:6805","nonce":815435378}]},"public_addr":"172.21.15.179:6801/815435378","cluster_addr":"172.21.15.179:6803/815435378","heartbeat_back_addr":"172.21.15.179:6807/815435378","heartbeat_front_addr":"172.21.15.179:6805/815435378","state":["exists","up"]},{"osd":7,"uuid":"fe630650-2eb3-49ad-8676-c341e6332eb1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6817","nonce":2848432339},{"type":"v1","addr":"172.21.15.179:6819","nonce":2848432339}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6821","nonce":2848432339},{"type":"v1","addr":"172.21.15.179:6823","nonce":2848432339}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":2848432339},{"type":"v1","addr":"172.21.15.179:6831","nonce":2848432339}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6825","nonce":2848432339},{"type":"v1","addr":"172.21.15.179:6827","nonce":2848432339}]},"public_addr":"172.21.15.179:6819/2848432339","cluster_addr":"172.21.15.179:6823/2848432339","heartbeat_back_addr":"172.21.15.179:6831/2848432339","heartbeat_front_addr":"172.21.15.179:6827/2848432339","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:58:49.255433+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:58:49.412880+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:58:49.559295+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:58:49.245237+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:58:49.184557+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:58:49.329851+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:58:49.366012+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:58:49.349604+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-28T20:02:21.380 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:21.376+0000 7f41f3d65640 1 -- 172.21.15.78:0/2910757120 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f41d0066470 msgr2=0x7f41d0068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:02:21.380 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:21.376+0000 7f41f3d65640 1 --2- 172.21.15.78:0/2910757120 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f41d0066470 0x7f41d0068930 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f41e8000f70 tx=0x7f41e8007b60 comp rx=0 tx=0).stop 2023-11-28T20:02:21.380 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:21.376+0000 7f41f3d65640 1 -- 172.21.15.78:0/2910757120 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f41ec0c5300 msgr2=0x7f41ec0a9950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:02:21.381 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:21.376+0000 7f41f3d65640 1 --2- 172.21.15.78:0/2910757120 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f41ec0c5300 0x7f41ec0a9950 secure :-1 s=READY pgs=936 cs=0 l=1 rev1=1 crypto rx=0x7f41e40af040 tx=0x7f41e4019740 comp rx=0 tx=0).stop 2023-11-28T20:02:21.381 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:21.376+0000 7f41f3d65640 1 -- 172.21.15.78:0/2910757120 shutdown_connections 2023-11-28T20:02:21.381 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:21.376+0000 7f41f3d65640 1 --2- 172.21.15.78:0/2910757120 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f41d0066470 0x7f41d0068930 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:21.381 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:21.376+0000 7f41f3d65640 1 --2- 172.21.15.78:0/2910757120 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f41ec0c3b80 0x7f41ec15a360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:21.381 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:21.376+0000 7f41f3d65640 1 --2- 172.21.15.78:0/2910757120 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f41ec0c5300 0x7f41ec0a9950 unknown :-1 s=CLOSED pgs=936 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:21.381 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:21.376+0000 7f41f3d65640 1 --2- 172.21.15.78:0/2910757120 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f41ec06d2b0 0x7f41ec154a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:21.381 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:21.376+0000 7f41f3d65640 1 -- 172.21.15.78:0/2910757120 >> 172.21.15.78:0/2910757120 conn(0x7f41ec0a7810 msgr2=0x7f41ec071c30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:02:21.381 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:21.376+0000 7f41f3d65640 1 -- 172.21.15.78:0/2910757120 shutdown_connections 2023-11-28T20:02:21.381 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:21.376+0000 7f41f3d65640 1 -- 172.21.15.78:0/2910757120 wait complete. 2023-11-28T20:02:21.399 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-28T19:58:54.011229+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 13, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-28T20:02:05.787820+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '80', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 14, 'pool_name': 'cephfs_data', 'create_time': '2023-11-28T20:02:06.652305+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '81', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-28T20:02:21.400 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-28T20:02:21.539 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:21.532+0000 7f540f6fe640 1 Processor -- start 2023-11-28T20:02:21.539 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:21.532+0000 7f540f6fe640 1 -- start start 2023-11-28T20:02:21.540 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:21.536+0000 7f540f6fe640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f540814b1e0 0x7f54080c1700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:21.540 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:21.536+0000 7f540f6fe640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f54080a4e20 con 0x7f54081548c0 2023-11-28T20:02:21.540 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:21.536+0000 7f540f6fe640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f54080a50e0 con 0x7f54080c5300 2023-11-28T20:02:21.540 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:21.536+0000 7f540f6fe640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f54080c0f00 con 0x7f540814b1e0 2023-11-28T20:02:21.541 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:21.536+0000 7f540d49a640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f540814b1e0 0x7f54080c1700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:02:21.541 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:21.536+0000 7f540dc9b640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f54081548c0 0x7f5408154d30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:41750/0 (socket says 172.21.15.78:41750) 2023-11-28T20:02:21.541 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:21.536+0000 7f540dc9b640 1 -- 172.21.15.78:0/3862946563 learned_addr learned my addr 172.21.15.78:0/3862946563 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-11-28T20:02:21.541 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:21.536+0000 7f540d49a640 1 -- 172.21.15.78:0/3862946563 >> v1:172.21.15.179:6789/0 conn(0x7f54080c5300 legacy=0x7f54080a9c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:02:21.541 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:21.536+0000 7f540d49a640 1 -- 172.21.15.78:0/3862946563 >> v1:172.21.15.78:6789/0 conn(0x7f54081548c0 legacy=0x7f5408154d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:02:21.541 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:21.536+0000 7f53fffff640 1 -- 172.21.15.78:0/3862946563 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2313634809 0 0) 0x7f54080a4e20 con 0x7f54081548c0 2023-11-28T20:02:21.541 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:21.536+0000 7f540d49a640 1 -- 172.21.15.78:0/3862946563 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54080c11e0 con 0x7f540814b1e0 2023-11-28T20:02:21.544 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:21.540+0000 7f540d49a640 1 --2- 172.21.15.78:0/3862946563 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f540814b1e0 0x7f54080c1700 secure :-1 s=READY pgs=938 cs=0 l=1 rev1=1 crypto rx=0x7f54040097c0 tx=0x7f540401c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=222b91b62c296a5 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:02:21.544 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:21.540+0000 7f53fffff640 1 -- 172.21.15.78:0/3862946563 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54040ab600 con 0x7f540814b1e0 2023-11-28T20:02:21.544 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:21.540+0000 7f53fffff640 1 -- 172.21.15.78:0/3862946563 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f54040a7050 con 0x7f540814b1e0 2023-11-28T20:02:21.544 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:21.540+0000 7f53fffff640 1 -- 172.21.15.78:0/3862946563 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54040ab980 con 0x7f540814b1e0 2023-11-28T20:02:21.545 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:21.540+0000 7f540f6fe640 1 -- 172.21.15.78:0/3862946563 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f540814b1e0 msgr2=0x7f54080c1700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:02:21.545 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:21.540+0000 7f540f6fe640 1 --2- 172.21.15.78:0/3862946563 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f540814b1e0 0x7f54080c1700 secure :-1 s=READY pgs=938 cs=0 l=1 rev1=1 crypto rx=0x7f54040097c0 tx=0x7f540401c480 comp rx=0 tx=0).stop 2023-11-28T20:02:21.545 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:21.540+0000 7f540f6fe640 1 -- 172.21.15.78:0/3862946563 shutdown_connections 2023-11-28T20:02:21.545 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:21.540+0000 7f540f6fe640 1 --2- 172.21.15.78:0/3862946563 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f540814b1e0 0x7f54080c1700 unknown :-1 s=CLOSED pgs=938 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:21.545 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:21.540+0000 7f540f6fe640 1 -- 172.21.15.78:0/3862946563 >> 172.21.15.78:0/3862946563 conn(0x7f54080c59f0 msgr2=0x7f54080c5e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:02:21.545 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:21.540+0000 7f540f6fe640 1 -- 172.21.15.78:0/3862946563 shutdown_connections 2023-11-28T20:02:21.545 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:21.540+0000 7f540f6fe640 1 -- 172.21.15.78:0/3862946563 wait complete. 2023-11-28T20:02:21.546 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:21.540+0000 7f540f6fe640 1 Processor -- start 2023-11-28T20:02:21.546 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:21.540+0000 7f540f6fe640 1 -- start start 2023-11-28T20:02:21.548 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:21.544+0000 7f540f6fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f54080c5300 0x7f54081f0d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:21.548 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:21.544+0000 7f540f6fe640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f540814b1e0 0x7f540806cc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:21.549 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:21.544+0000 7f540f6fe640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f54081548c0 0x7f54081ed3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:21.549 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:21.544+0000 7f540f6fe640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54081ecf60 con 0x7f54080c5300 2023-11-28T20:02:21.549 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:21.544+0000 7f540f6fe640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54081f1280 con 0x7f54081548c0 2023-11-28T20:02:21.549 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:21.544+0000 7f540f6fe640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5408146ed0 con 0x7f540814b1e0 2023-11-28T20:02:21.549 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:21.544+0000 7f540d49a640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f54080c5300 0x7f54081f0d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:02:21.549 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:21.544+0000 7f540d49a640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f54080c5300 0x7f54081f0d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:54432/0 (socket says 172.21.15.78:54432) 2023-11-28T20:02:21.549 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:21.544+0000 7f540d49a640 1 -- 172.21.15.78:0/2342894475 learned_addr learned my addr 172.21.15.78:0/2342894475 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T20:02:21.549 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:21.544+0000 7f540dc9b640 1 --2- 172.21.15.78:0/2342894475 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f54081548c0 0x7f54081ed3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:02:21.549 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:21.544+0000 7f540cc99640 1 --2- 172.21.15.78:0/2342894475 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f540814b1e0 0x7f540806cc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:02:21.550 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:21.544+0000 7f540d49a640 1 -- 172.21.15.78:0/2342894475 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f540814b1e0 msgr2=0x7f540806cc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:02:21.550 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:21.544+0000 7f540d49a640 1 --2- 172.21.15.78:0/2342894475 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f540814b1e0 0x7f540806cc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:21.550 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:21.544+0000 7f540d49a640 1 -- 172.21.15.78:0/2342894475 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f54081548c0 msgr2=0x7f54081ed3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:02:21.550 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:21.544+0000 7f540d49a640 1 --2- 172.21.15.78:0/2342894475 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f54081548c0 0x7f54081ed3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:21.550 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:21.544+0000 7f540d49a640 1 -- 172.21.15.78:0/2342894475 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5404009420 con 0x7f54080c5300 2023-11-28T20:02:21.551 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:21.544+0000 7f540cc99640 1 --2- 172.21.15.78:0/2342894475 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f540814b1e0 0x7f540806cc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T20:02:21.551 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:21.544+0000 7f540d49a640 1 --2- 172.21.15.78:0/2342894475 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f54080c5300 0x7f54081f0d40 secure :-1 s=READY pgs=939 cs=0 l=1 rev1=1 crypto rx=0x7f5404019090 tx=0x7f540401acc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:02:21.551 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:21.544+0000 7f53fdffb640 1 -- 172.21.15.78:0/2342894475 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54040b7650 con 0x7f54080c5300 2023-11-28T20:02:21.551 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:21.544+0000 7f53fdffb640 1 -- 172.21.15.78:0/2342894475 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f54040b77b0 con 0x7f54080c5300 2023-11-28T20:02:21.551 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:21.544+0000 7f53fdffb640 1 -- 172.21.15.78:0/2342894475 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54040b7b60 con 0x7f54080c5300 2023-11-28T20:02:21.551 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:21.544+0000 7f540f6fe640 1 -- 172.21.15.78:0/2342894475 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f54081471b0 con 0x7f54080c5300 2023-11-28T20:02:21.551 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:21.544+0000 7f540f6fe640 1 -- 172.21.15.78:0/2342894475 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f540806d160 con 0x7f54080c5300 2023-11-28T20:02:21.553 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:21.544+0000 7f540f6fe640 1 -- 172.21.15.78:0/2342894475 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5408067630 con 0x7f54080c5300 2023-11-28T20:02:21.553 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:21.544+0000 7f53fdffb640 1 -- 172.21.15.78:0/2342894475 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f54040b7cc0 con 0x7f54080c5300 2023-11-28T20:02:21.553 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:21.548+0000 7f53fdffb640 1 --2- 172.21.15.78:0/2342894475 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f53ec066470 0x7f53ec068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:21.554 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:21.548+0000 7f53fdffb640 1 -- 172.21.15.78:0/2342894475 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f540411e960 con 0x7f54080c5300 2023-11-28T20:02:21.554 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:21.548+0000 7f540cc99640 1 --2- 172.21.15.78:0/2342894475 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f53ec066470 0x7f53ec068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:02:21.554 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:21.548+0000 7f540cc99640 1 --2- 172.21.15.78:0/2342894475 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f53ec066470 0x7f53ec068930 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f5408067ed0 tx=0x7f53f8009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:02:21.555 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:21.552+0000 7f53fdffb640 1 -- 172.21.15.78:0/2342894475 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f54040ebc00 con 0x7f54080c5300 2023-11-28T20:02:21.705 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:21.700+0000 7f540f6fe640 1 -- 172.21.15.78:0/2342894475 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f540814a720 con 0x7f54080c5300 2023-11-28T20:02:21.706 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:21.700+0000 7f53fdffb640 1 -- 172.21.15.78:0/2342894475 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v81) v1 ==== 93+0+10 (secure 0 0 0) 0x7f54040b00a0 con 0x7f54080c5300 2023-11-28T20:02:21.706 INFO:teuthology.orchestra.run.smithi078.stdout:pg_num: 1 2023-11-28T20:02:21.708 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:21.704+0000 7f540f6fe640 1 -- 172.21.15.78:0/2342894475 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f53ec066470 msgr2=0x7f53ec068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:02:21.708 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:21.704+0000 7f540f6fe640 1 --2- 172.21.15.78:0/2342894475 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f53ec066470 0x7f53ec068930 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f5408067ed0 tx=0x7f53f8009040 comp rx=0 tx=0).stop 2023-11-28T20:02:21.708 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:21.704+0000 7f540f6fe640 1 -- 172.21.15.78:0/2342894475 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f54080c5300 msgr2=0x7f54081f0d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:02:21.708 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:21.704+0000 7f540f6fe640 1 --2- 172.21.15.78:0/2342894475 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f54080c5300 0x7f54081f0d40 secure :-1 s=READY pgs=939 cs=0 l=1 rev1=1 crypto rx=0x7f5404019090 tx=0x7f540401acc0 comp rx=0 tx=0).stop 2023-11-28T20:02:21.709 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:21.704+0000 7f540f6fe640 1 -- 172.21.15.78:0/2342894475 shutdown_connections 2023-11-28T20:02:21.709 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:21.704+0000 7f540f6fe640 1 --2- 172.21.15.78:0/2342894475 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f53ec066470 0x7f53ec068930 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:21.709 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:21.704+0000 7f540f6fe640 1 --2- 172.21.15.78:0/2342894475 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f540814b1e0 0x7f540806cc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:21.709 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:21.704+0000 7f540f6fe640 1 --2- 172.21.15.78:0/2342894475 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f54081548c0 0x7f54081ed3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:21.709 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:21.704+0000 7f540f6fe640 1 --2- 172.21.15.78:0/2342894475 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f54080c5300 0x7f54081f0d40 unknown :-1 s=CLOSED pgs=939 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:21.709 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:21.704+0000 7f540f6fe640 1 -- 172.21.15.78:0/2342894475 >> 172.21.15.78:0/2342894475 conn(0x7f54080c59f0 msgr2=0x7f5408154d30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:02:21.709 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:21.704+0000 7f540f6fe640 1 -- 172.21.15.78:0/2342894475 shutdown_connections 2023-11-28T20:02:21.709 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:21.704+0000 7f540f6fe640 1 -- 172.21.15.78:0/2342894475 wait complete. 2023-11-28T20:02:21.727 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-28T20:02:21.868 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:21.864+0000 7f921312a640 1 Processor -- start 2023-11-28T20:02:21.868 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:21.864+0000 7f921312a640 1 -- start start 2023-11-28T20:02:21.869 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:21.864+0000 7f921312a640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f920c0a4f30 0x7f920c0bf140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:21.869 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:21.864+0000 7f921312a640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f920c0c4b20 0x7f920c1585d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:21.870 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:21.864+0000 7f921312a640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f920c157b80 con 0x7f920c0bed60 2023-11-28T20:02:21.870 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:21.864+0000 7f921312a640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f920c158b10 con 0x7f920c0a4f30 2023-11-28T20:02:21.870 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:21.864+0000 7f921312a640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f920c06d6c0 con 0x7f920c0c4b20 2023-11-28T20:02:21.872 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:21.864+0000 7f92116c7640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f920c0c4b20 0x7f920c1585d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:02:21.872 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:21.864+0000 7f9203fff640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f920c0a4f30 0x7f920c0bf140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:02:21.872 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:21.864+0000 7f9203fff640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f920c0a4f30 0x7f920c0bf140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.78:52800/0 (socket says 172.21.15.78:52800) 2023-11-28T20:02:21.872 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:21.864+0000 7f92116c7640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f920c0c4b20 0x7f920c1585d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3301/0 says I am v2:172.21.15.78:44606/0 (socket says 172.21.15.78:44606) 2023-11-28T20:02:21.872 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:21.864+0000 7f9203fff640 1 -- 172.21.15.78:0/575126085 learned_addr learned my addr 172.21.15.78:0/575126085 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T20:02:21.873 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:21.864+0000 7f9210ec6640 1 --1- >> v1:172.21.15.179:6789/0 conn(0x7f920c0bed60 0x7f920c154590 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.179:6789/0 says I am v1:172.21.15.78:34470/0 (socket says 172.21.15.78:34470) 2023-11-28T20:02:21.873 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:21.864+0000 7f9203fff640 1 -- 172.21.15.78:0/575126085 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f920c0c4b20 msgr2=0x7f920c1585d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:02:21.873 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:21.864+0000 7f9203fff640 1 --2- 172.21.15.78:0/575126085 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f920c0c4b20 0x7f920c1585d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:21.873 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:21.864+0000 7f9203fff640 1 -- 172.21.15.78:0/575126085 >> v1:172.21.15.179:6789/0 conn(0x7f920c0bed60 legacy=0x7f920c154590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:02:21.873 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:21.864+0000 7f9203fff640 1 -- 172.21.15.78:0/575126085 --> v2:172.21.15.179:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f920c06d960 con 0x7f920c0a4f30 2023-11-28T20:02:21.873 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:21.864+0000 7f92037fe640 1 -- 172.21.15.78:0/575126085 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2157445599 0 0) 0x7f920c157b80 con 0x7f920c0bed60 2023-11-28T20:02:21.874 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:21.868+0000 7f9203fff640 1 --2- 172.21.15.78:0/575126085 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f920c0a4f30 0x7f920c0bf140 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f91fc009870 tx=0x7f91fc01c4b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=eed5a4a9dd085e43 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:02:21.875 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:21.868+0000 7f92037fe640 1 -- 172.21.15.78:0/575126085 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91fc0ac600 con 0x7f920c0a4f30 2023-11-28T20:02:21.875 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:21.868+0000 7f92037fe640 1 -- 172.21.15.78:0/575126085 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f91fc0a8050 con 0x7f920c0a4f30 2023-11-28T20:02:21.875 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:21.868+0000 7f92037fe640 1 -- 172.21.15.78:0/575126085 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91fc0ac980 con 0x7f920c0a4f30 2023-11-28T20:02:21.875 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:21.868+0000 7f921312a640 1 -- 172.21.15.78:0/575126085 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f920c0a4f30 msgr2=0x7f920c0bf140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:02:21.875 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:21.868+0000 7f921312a640 1 --2- 172.21.15.78:0/575126085 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f920c0a4f30 0x7f920c0bf140 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f91fc009870 tx=0x7f91fc01c4b0 comp rx=0 tx=0).stop 2023-11-28T20:02:21.875 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:21.868+0000 7f921312a640 1 -- 172.21.15.78:0/575126085 shutdown_connections 2023-11-28T20:02:21.875 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:21.868+0000 7f921312a640 1 --2- 172.21.15.78:0/575126085 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f920c0c4b20 0x7f920c1585d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:21.875 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:21.868+0000 7f921312a640 1 --2- 172.21.15.78:0/575126085 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f920c0a4f30 0x7f920c0bf140 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:21.875 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:21.868+0000 7f921312a640 1 -- 172.21.15.78:0/575126085 >> 172.21.15.78:0/575126085 conn(0x7f920c0c59f0 msgr2=0x7f920c0c5e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:02:21.875 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:21.868+0000 7f921312a640 1 -- 172.21.15.78:0/575126085 shutdown_connections 2023-11-28T20:02:21.875 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:21.868+0000 7f921312a640 1 -- 172.21.15.78:0/575126085 wait complete. 2023-11-28T20:02:21.876 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:21.872+0000 7f921312a640 1 Processor -- start 2023-11-28T20:02:21.876 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:21.872+0000 7f921312a640 1 -- start start 2023-11-28T20:02:21.880 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:21.872+0000 7f921312a640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f920c0a4f30 0x7f920c1507e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:21.880 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:21.872+0000 7f921312a640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f920c0bed60 0x7f920c155980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:21.880 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:21.872+0000 7f921312a640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f920c0c4b20 0x7f920c1f07d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:21.880 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:21.872+0000 7f921312a640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f920c0717c0 con 0x7f920c0a4f30 2023-11-28T20:02:21.880 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:21.872+0000 7f921312a640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f920c072350 con 0x7f920c0bed60 2023-11-28T20:02:21.881 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:21.872+0000 7f921312a640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f920c072630 con 0x7f920c0c4b20 2023-11-28T20:02:21.882 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:21.872+0000 7f9210ec6640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f920c0a4f30 0x7f920c1507e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:02:21.882 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:21.872+0000 7f9210ec6640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f920c0a4f30 0x7f920c1507e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:54448/0 (socket says 172.21.15.78:54448) 2023-11-28T20:02:21.882 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:21.872+0000 7f9210ec6640 1 -- 172.21.15.78:0/2010740222 learned_addr learned my addr 172.21.15.78:0/2010740222 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T20:02:21.882 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:21.872+0000 7f92116c7640 1 --2- 172.21.15.78:0/2010740222 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f920c0c4b20 0x7f920c1f07d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:02:21.882 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:21.872+0000 7f9203fff640 1 --2- 172.21.15.78:0/2010740222 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f920c0bed60 0x7f920c155980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:02:21.883 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:21.872+0000 7f9210ec6640 1 -- 172.21.15.78:0/2010740222 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f920c0c4b20 msgr2=0x7f920c1f07d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:02:21.883 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:21.872+0000 7f9210ec6640 1 --2- 172.21.15.78:0/2010740222 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f920c0c4b20 0x7f920c1f07d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:21.883 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:21.872+0000 7f9210ec6640 1 -- 172.21.15.78:0/2010740222 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f920c0bed60 msgr2=0x7f920c155980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:02:21.883 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:21.872+0000 7f9210ec6640 1 --2- 172.21.15.78:0/2010740222 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f920c0bed60 0x7f920c155980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:21.884 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:21.872+0000 7f9210ec6640 1 -- 172.21.15.78:0/2010740222 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91fc0094d0 con 0x7f920c0a4f30 2023-11-28T20:02:21.885 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:21.872+0000 7f9210ec6640 1 --2- 172.21.15.78:0/2010740222 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f920c0a4f30 0x7f920c1507e0 secure :-1 s=READY pgs=940 cs=0 l=1 rev1=1 crypto rx=0x7f920800c480 tx=0x7f920800c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:02:21.885 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:21.872+0000 7f92017fa640 1 -- 172.21.15.78:0/2010740222 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92080074e0 con 0x7f920c0a4f30 2023-11-28T20:02:21.885 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:21.872+0000 7f92017fa640 1 -- 172.21.15.78:0/2010740222 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9208007660 con 0x7f920c0a4f30 2023-11-28T20:02:21.885 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:21.872+0000 7f921312a640 1 -- 172.21.15.78:0/2010740222 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f920c072910 con 0x7f920c0a4f30 2023-11-28T20:02:21.885 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:21.872+0000 7f92017fa640 1 -- 172.21.15.78:0/2010740222 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9208004a30 con 0x7f920c0a4f30 2023-11-28T20:02:21.885 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:21.876+0000 7f921312a640 1 -- 172.21.15.78:0/2010740222 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f920c150d20 con 0x7f920c0a4f30 2023-11-28T20:02:21.885 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:21.876+0000 7f921312a640 1 -- 172.21.15.78:0/2010740222 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f920c067630 con 0x7f920c0a4f30 2023-11-28T20:02:21.886 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:21.876+0000 7f92017fa640 1 -- 172.21.15.78:0/2010740222 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f9208004b90 con 0x7f920c0a4f30 2023-11-28T20:02:21.886 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:21.876+0000 7f92017fa640 1 --2- 172.21.15.78:0/2010740222 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f91f8066470 0x7f91f8068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:21.886 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:21.876+0000 7f92017fa640 1 -- 172.21.15.78:0/2010740222 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f92080834a0 con 0x7f920c0a4f30 2023-11-28T20:02:21.886 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:21.876+0000 7f9203fff640 1 --2- 172.21.15.78:0/2010740222 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f91f8066470 0x7f91f8068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:02:21.886 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:21.880+0000 7f9203fff640 1 --2- 172.21.15.78:0/2010740222 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f91f8066470 0x7f91f8068930 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f91fc0ae000 tx=0x7f91fc008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:02:21.886 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:21.880+0000 7f92017fa640 1 -- 172.21.15.78:0/2010740222 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f9208050880 con 0x7f920c0a4f30 2023-11-28T20:02:22.037 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:22.032+0000 7f921312a640 1 -- 172.21.15.78:0/2010740222 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f920c0c5710 con 0x7f920c0a4f30 2023-11-28T20:02:22.038 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:22.032+0000 7f92017fa640 1 -- 172.21.15.78:0/2010740222 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v81) v1 ==== 104+0+11 (secure 0 0 0) 0x7f9208053ea0 con 0x7f920c0a4f30 2023-11-28T20:02:22.038 INFO:teuthology.orchestra.run.smithi078.stdout:pg_num: 32 2023-11-28T20:02:22.040 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:22.036+0000 7f921312a640 1 -- 172.21.15.78:0/2010740222 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f91f8066470 msgr2=0x7f91f8068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:02:22.040 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:22.036+0000 7f921312a640 1 --2- 172.21.15.78:0/2010740222 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f91f8066470 0x7f91f8068930 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f91fc0ae000 tx=0x7f91fc008040 comp rx=0 tx=0).stop 2023-11-28T20:02:22.040 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:22.036+0000 7f921312a640 1 -- 172.21.15.78:0/2010740222 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f920c0a4f30 msgr2=0x7f920c1507e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:02:22.040 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:22.036+0000 7f921312a640 1 --2- 172.21.15.78:0/2010740222 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f920c0a4f30 0x7f920c1507e0 secure :-1 s=READY pgs=940 cs=0 l=1 rev1=1 crypto rx=0x7f920800c480 tx=0x7f920800c940 comp rx=0 tx=0).stop 2023-11-28T20:02:22.040 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:22.036+0000 7f921312a640 1 -- 172.21.15.78:0/2010740222 shutdown_connections 2023-11-28T20:02:22.041 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:22.036+0000 7f921312a640 1 --2- 172.21.15.78:0/2010740222 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f91f8066470 0x7f91f8068930 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:22.041 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:22.036+0000 7f921312a640 1 --2- 172.21.15.78:0/2010740222 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f920c0c4b20 0x7f920c1f07d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:22.041 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:22.036+0000 7f921312a640 1 --2- 172.21.15.78:0/2010740222 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f920c0bed60 0x7f920c155980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:22.041 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:22.036+0000 7f921312a640 1 --2- 172.21.15.78:0/2010740222 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f920c0a4f30 0x7f920c1507e0 unknown :-1 s=CLOSED pgs=940 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:22.041 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:22.036+0000 7f921312a640 1 -- 172.21.15.78:0/2010740222 >> 172.21.15.78:0/2010740222 conn(0x7f920c0c59f0 msgr2=0x7f920c15e590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:02:22.041 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:22.036+0000 7f921312a640 1 -- 172.21.15.78:0/2010740222 shutdown_connections 2023-11-28T20:02:22.041 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:22.036+0000 7f921312a640 1 -- 172.21.15.78:0/2010740222 wait complete. 2023-11-28T20:02:22.059 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-28T20:02:22.199 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:22.192+0000 7fc526679640 1 Processor -- start 2023-11-28T20:02:22.199 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:22.192+0000 7fc526679640 1 -- start start 2023-11-28T20:02:22.200 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:22.196+0000 7fc526679640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fc5200c4bc0 0x7fc52015fed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:22.200 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:22.196+0000 7fc526679640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc520155400 con 0x7fc5200c47e0 2023-11-28T20:02:22.200 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:22.196+0000 7fc526679640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc520154830 con 0x7fc5200c83d0 2023-11-28T20:02:22.200 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:22.196+0000 7fc526679640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc5200c5830 con 0x7fc5200c4bc0 2023-11-28T20:02:22.200 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:22.196+0000 7fc51ffff640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7fc5200c47e0 0x7fc5200c8bd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:41758/0 (socket says 172.21.15.78:41758) 2023-11-28T20:02:22.200 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:22.196+0000 7fc51ffff640 1 -- 172.21.15.78:0/2198452430 learned_addr learned my addr 172.21.15.78:0/2198452430 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-11-28T20:02:22.200 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:22.196+0000 7fc524c16640 1 --2- 172.21.15.78:0/2198452430 >> v2:172.21.15.78:3300/0 conn(0x7fc5200c4bc0 0x7fc52015fed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:02:22.201 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:22.196+0000 7fc524c16640 1 -- 172.21.15.78:0/2198452430 >> v1:172.21.15.179:6789/0 conn(0x7fc5200c83d0 legacy=0x7fc5200c92e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:02:22.201 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:22.196+0000 7fc524c16640 1 -- 172.21.15.78:0/2198452430 >> v1:172.21.15.78:6789/0 conn(0x7fc5200c47e0 legacy=0x7fc5200c8bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:02:22.201 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:22.196+0000 7fc524c16640 1 -- 172.21.15.78:0/2198452430 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5200c4ff0 con 0x7fc5200c4bc0 2023-11-28T20:02:22.201 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:22.196+0000 7fc51f7fe640 1 -- 172.21.15.78:0/2198452430 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1615677652 0 0) 0x7fc520155400 con 0x7fc5200c47e0 2023-11-28T20:02:22.203 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:22.200+0000 7fc524c16640 1 --2- 172.21.15.78:0/2198452430 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc5200c4bc0 0x7fc52015fed0 secure :-1 s=READY pgs=942 cs=0 l=1 rev1=1 crypto rx=0x7fc518009d90 tx=0x7fc51801c7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b2ecc334e057510b server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:02:22.204 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:22.200+0000 7fc51f7fe640 1 -- 172.21.15.78:0/2198452430 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5180a57a0 con 0x7fc5200c4bc0 2023-11-28T20:02:22.204 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:22.200+0000 7fc51f7fe640 1 -- 172.21.15.78:0/2198452430 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc5180a5900 con 0x7fc5200c4bc0 2023-11-28T20:02:22.204 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:22.200+0000 7fc51f7fe640 1 -- 172.21.15.78:0/2198452430 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5180a5c90 con 0x7fc5200c4bc0 2023-11-28T20:02:22.204 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:22.200+0000 7fc526679640 1 -- 172.21.15.78:0/2198452430 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc5200c4bc0 msgr2=0x7fc52015fed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:02:22.205 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:22.200+0000 7fc526679640 1 --2- 172.21.15.78:0/2198452430 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc5200c4bc0 0x7fc52015fed0 secure :-1 s=READY pgs=942 cs=0 l=1 rev1=1 crypto rx=0x7fc518009d90 tx=0x7fc51801c7f0 comp rx=0 tx=0).stop 2023-11-28T20:02:22.205 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:22.200+0000 7fc526679640 1 -- 172.21.15.78:0/2198452430 shutdown_connections 2023-11-28T20:02:22.206 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:22.200+0000 7fc526679640 1 --2- 172.21.15.78:0/2198452430 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc5200c4bc0 0x7fc52015fed0 unknown :-1 s=CLOSED pgs=942 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:22.206 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:22.200+0000 7fc526679640 1 -- 172.21.15.78:0/2198452430 >> 172.21.15.78:0/2198452430 conn(0x7fc5200ab920 msgr2=0x7fc5200abd30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:02:22.206 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:22.200+0000 7fc526679640 1 -- 172.21.15.78:0/2198452430 shutdown_connections 2023-11-28T20:02:22.206 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:22.200+0000 7fc526679640 1 -- 172.21.15.78:0/2198452430 wait complete. 2023-11-28T20:02:22.211 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:22.200+0000 7fc526679640 1 Processor -- start 2023-11-28T20:02:22.211 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:22.200+0000 7fc526679640 1 -- start start 2023-11-28T20:02:22.212 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:22.204+0000 7fc526679640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc5200c47e0 0x7fc5201ee080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:22.212 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:22.204+0000 7fc526679640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc5200c4bc0 0x7fc52013f5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:22.212 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:22.204+0000 7fc526679640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc5200c83d0 0x7fc520150080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:22.212 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:22.204+0000 7fc526679640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5200c07a0 con 0x7fc5200c4bc0 2023-11-28T20:02:22.212 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:22.204+0000 7fc526679640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc52014f8c0 con 0x7fc5200c47e0 2023-11-28T20:02:22.212 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:22.204+0000 7fc526679640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc5201ed830 con 0x7fc5200c83d0 2023-11-28T20:02:22.212 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:22.204+0000 7fc517fff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc5200c4bc0 0x7fc52013f5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:02:22.212 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:22.204+0000 7fc517fff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc5200c4bc0 0x7fc52013f5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:54460/0 (socket says 172.21.15.78:54460) 2023-11-28T20:02:22.212 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:22.204+0000 7fc517fff640 1 -- 172.21.15.78:0/2693865801 learned_addr learned my addr 172.21.15.78:0/2693865801 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T20:02:22.213 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:22.204+0000 7fc517fff640 1 -- 172.21.15.78:0/2693865801 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc5200c83d0 msgr2=0x7fc520150080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:02:22.213 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:22.204+0000 7fc517fff640 1 --2- 172.21.15.78:0/2693865801 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc5200c83d0 0x7fc520150080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:22.213 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:22.204+0000 7fc517fff640 1 -- 172.21.15.78:0/2693865801 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc5200c47e0 msgr2=0x7fc5201ee080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:02:22.213 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:22.204+0000 7fc517fff640 1 --2- 172.21.15.78:0/2693865801 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc5200c47e0 0x7fc5201ee080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:22.213 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:22.204+0000 7fc517fff640 1 -- 172.21.15.78:0/2693865801 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc518009a70 con 0x7fc5200c4bc0 2023-11-28T20:02:22.213 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:22.204+0000 7fc517fff640 1 --2- 172.21.15.78:0/2693865801 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc5200c4bc0 0x7fc52013f5e0 secure :-1 s=READY pgs=943 cs=0 l=1 rev1=1 crypto rx=0x7fc50800b410 tx=0x7fc50800b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:02:22.213 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:22.204+0000 7fc51d7fa640 1 -- 172.21.15.78:0/2693865801 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc508004020 con 0x7fc5200c4bc0 2023-11-28T20:02:22.213 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:22.204+0000 7fc51d7fa640 1 -- 172.21.15.78:0/2693865801 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc508004180 con 0x7fc5200c4bc0 2023-11-28T20:02:22.213 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:22.204+0000 7fc51d7fa640 1 -- 172.21.15.78:0/2693865801 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc508011630 con 0x7fc5200c4bc0 2023-11-28T20:02:22.214 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:22.204+0000 7fc526679640 1 -- 172.21.15.78:0/2693865801 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc52014fb60 con 0x7fc5200c4bc0 2023-11-28T20:02:22.214 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:22.204+0000 7fc526679640 1 -- 172.21.15.78:0/2693865801 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc52013fb20 con 0x7fc5200c4bc0 2023-11-28T20:02:22.214 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:22.204+0000 7fc526679640 1 -- 172.21.15.78:0/2693865801 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc52014fd50 con 0x7fc5200c4bc0 2023-11-28T20:02:22.214 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:22.204+0000 7fc51d7fa640 1 -- 172.21.15.78:0/2693865801 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fc508011790 con 0x7fc5200c4bc0 2023-11-28T20:02:22.215 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:22.208+0000 7fc51d7fa640 1 --2- 172.21.15.78:0/2693865801 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fc500066470 0x7fc500068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:22.215 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:22.208+0000 7fc51d7fa640 1 -- 172.21.15.78:0/2693865801 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6029+0+0 (secure 0 0 0) 0x7fc508083c90 con 0x7fc5200c4bc0 2023-11-28T20:02:22.215 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:22.208+0000 7fc51ffff640 1 --2- 172.21.15.78:0/2693865801 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fc500066470 0x7fc500068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:02:22.215 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:22.208+0000 7fc51ffff640 1 --2- 172.21.15.78:0/2693865801 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fc500066470 0x7fc500068930 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7fc5100011f0 tx=0x7fc510007930 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:02:22.216 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:22.212+0000 7fc51d7fa640 1 -- 172.21.15.78:0/2693865801 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fc508051060 con 0x7fc5200c4bc0 2023-11-28T20:02:22.366 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:22.360+0000 7fc526679640 1 -- 172.21.15.78:0/2693865801 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fc520067630 con 0x7fc5200c4bc0 2023-11-28T20:02:22.367 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:22.360+0000 7fc51d7fa640 1 -- 172.21.15.78:0/2693865801 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v81) v1 ==== 100+0+11 (secure 0 0 0) 0x7fc508054680 con 0x7fc5200c4bc0 2023-11-28T20:02:22.367 INFO:teuthology.orchestra.run.smithi078.stdout:pg_num: 64 2023-11-28T20:02:22.369 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:22.364+0000 7fc526679640 1 -- 172.21.15.78:0/2693865801 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fc500066470 msgr2=0x7fc500068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:02:22.369 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:22.364+0000 7fc526679640 1 --2- 172.21.15.78:0/2693865801 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fc500066470 0x7fc500068930 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7fc5100011f0 tx=0x7fc510007930 comp rx=0 tx=0).stop 2023-11-28T20:02:22.369 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:22.364+0000 7fc526679640 1 -- 172.21.15.78:0/2693865801 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc5200c4bc0 msgr2=0x7fc52013f5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:02:22.369 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:22.364+0000 7fc526679640 1 --2- 172.21.15.78:0/2693865801 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc5200c4bc0 0x7fc52013f5e0 secure :-1 s=READY pgs=943 cs=0 l=1 rev1=1 crypto rx=0x7fc50800b410 tx=0x7fc50800b8d0 comp rx=0 tx=0).stop 2023-11-28T20:02:22.369 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:22.364+0000 7fc526679640 1 -- 172.21.15.78:0/2693865801 shutdown_connections 2023-11-28T20:02:22.369 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:22.364+0000 7fc526679640 1 --2- 172.21.15.78:0/2693865801 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fc500066470 0x7fc500068930 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:22.369 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:22.364+0000 7fc526679640 1 --2- 172.21.15.78:0/2693865801 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc5200c83d0 0x7fc520150080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:22.370 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:22.364+0000 7fc526679640 1 --2- 172.21.15.78:0/2693865801 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc5200c4bc0 0x7fc52013f5e0 unknown :-1 s=CLOSED pgs=943 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:22.370 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:22.364+0000 7fc526679640 1 --2- 172.21.15.78:0/2693865801 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc5200c47e0 0x7fc5201ee080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:22.370 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:22.364+0000 7fc526679640 1 -- 172.21.15.78:0/2693865801 >> 172.21.15.78:0/2693865801 conn(0x7fc5200ab920 msgr2=0x7fc5200abd00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:02:22.370 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:22.364+0000 7fc526679640 1 -- 172.21.15.78:0/2693865801 shutdown_connections 2023-11-28T20:02:22.370 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:22.364+0000 7fc526679640 1 -- 172.21.15.78:0/2693865801 wait complete. 2023-11-28T20:02:22.388 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-11-28T20:02:22.524 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:22.520+0000 7fb89e12a640 1 Processor -- start 2023-11-28T20:02:22.524 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:22.520+0000 7fb89e12a640 1 -- start start 2023-11-28T20:02:22.525 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:22.520+0000 7fb89e12a640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fb8980c47c0 0x7fb898155100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:22.525 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:22.520+0000 7fb89e12a640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fb89806b320 0x7fb8980c7f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:22.526 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:22.520+0000 7fb89e12a640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb898155640 con 0x7fb898151ec0 2023-11-28T20:02:22.526 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:22.520+0000 7fb89e12a640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb8980c8aa0 con 0x7fb89806b320 2023-11-28T20:02:22.526 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:22.520+0000 7fb89e12a640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb8980c9060 con 0x7fb8980c47c0 2023-11-28T20:02:22.526 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:22.520+0000 7fb8977fe640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7fb898151ec0 0x7fb8980c94f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:41768/0 (socket says 172.21.15.78:41768) 2023-11-28T20:02:22.526 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:22.520+0000 7fb8977fe640 1 -- 172.21.15.78:0/2724135344 learned_addr learned my addr 172.21.15.78:0/2724135344 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-11-28T20:02:22.526 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:22.520+0000 7fb897fff640 1 --2- 172.21.15.78:0/2724135344 >> v2:172.21.15.78:3300/0 conn(0x7fb89806b320 0x7fb8980c7f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:02:22.527 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:22.520+0000 7fb896ffd640 1 --2- 172.21.15.78:0/2724135344 >> v2:172.21.15.179:3300/0 conn(0x7fb8980c47c0 0x7fb898155100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:02:22.527 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:22.520+0000 7fb8967fc640 1 -- 172.21.15.78:0/2724135344 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 146843801 0 0) 0x7fb888001120 con 0x7fb898151ec0 2023-11-28T20:02:22.527 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:22.520+0000 7fb8967fc640 1 -- 172.21.15.78:0/2724135344 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb880003530 con 0x7fb898151ec0 2023-11-28T20:02:22.527 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:22.520+0000 7fb897fff640 1 -- 172.21.15.78:0/2724135344 >> v2:172.21.15.179:3300/0 conn(0x7fb8980c47c0 msgr2=0x7fb898155100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:02:22.527 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:22.520+0000 7fb897fff640 1 --2- 172.21.15.78:0/2724135344 >> v2:172.21.15.179:3300/0 conn(0x7fb8980c47c0 0x7fb898155100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:22.527 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:22.520+0000 7fb897fff640 1 -- 172.21.15.78:0/2724135344 >> v1:172.21.15.78:6789/0 conn(0x7fb898151ec0 legacy=0x7fb8980c94f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:02:22.528 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:22.520+0000 7fb897fff640 1 -- 172.21.15.78:0/2724135344 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8980c4d30 con 0x7fb89806b320 2023-11-28T20:02:22.529 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:22.524+0000 7fb897fff640 1 --2- 172.21.15.78:0/2724135344 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb89806b320 0x7fb8980c7f60 secure :-1 s=READY pgs=945 cs=0 l=1 rev1=1 crypto rx=0x7fb89806d520 tx=0x7fb89001c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5497ed4bb259d957 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:02:22.529 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:22.524+0000 7fb8967fc640 1 -- 172.21.15.78:0/2724135344 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8900a59d0 con 0x7fb89806b320 2023-11-28T20:02:22.529 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:22.524+0000 7fb8967fc640 1 -- 172.21.15.78:0/2724135344 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb8900a5b30 con 0x7fb89806b320 2023-11-28T20:02:22.529 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:22.524+0000 7fb8967fc640 1 -- 172.21.15.78:0/2724135344 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8900ad440 con 0x7fb89806b320 2023-11-28T20:02:22.530 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:22.524+0000 7fb89e12a640 1 -- 172.21.15.78:0/2724135344 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb89806b320 msgr2=0x7fb8980c7f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:02:22.530 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:22.524+0000 7fb89e12a640 1 --2- 172.21.15.78:0/2724135344 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb89806b320 0x7fb8980c7f60 secure :-1 s=READY pgs=945 cs=0 l=1 rev1=1 crypto rx=0x7fb89806d520 tx=0x7fb89001c910 comp rx=0 tx=0).stop 2023-11-28T20:02:22.530 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:22.524+0000 7fb89e12a640 1 -- 172.21.15.78:0/2724135344 shutdown_connections 2023-11-28T20:02:22.530 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:22.524+0000 7fb89e12a640 1 --2- 172.21.15.78:0/2724135344 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb89806b320 0x7fb8980c7f60 unknown :-1 s=CLOSED pgs=945 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:22.530 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:22.524+0000 7fb89e12a640 1 --2- 172.21.15.78:0/2724135344 >> v2:172.21.15.179:3300/0 conn(0x7fb8980c47c0 0x7fb898155100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:22.530 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:22.524+0000 7fb89e12a640 1 -- 172.21.15.78:0/2724135344 >> 172.21.15.78:0/2724135344 conn(0x7fb8980c9e40 msgr2=0x7fb8980ca250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:02:22.530 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:22.524+0000 7fb89e12a640 1 -- 172.21.15.78:0/2724135344 shutdown_connections 2023-11-28T20:02:22.531 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:22.524+0000 7fb89e12a640 1 -- 172.21.15.78:0/2724135344 wait complete. 2023-11-28T20:02:22.531 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:22.528+0000 7fb89e12a640 1 Processor -- start 2023-11-28T20:02:22.531 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:22.528+0000 7fb89e12a640 1 -- start start 2023-11-28T20:02:22.534 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:22.528+0000 7fb89e12a640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb89806b320 0x7fb8981efc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:22.534 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:22.528+0000 7fb89e12a640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb8980c47c0 0x7fb8981f0190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:22.534 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:22.528+0000 7fb89e12a640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb898151ec0 0x7fb8981f09c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:22.534 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:22.528+0000 7fb89e12a640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8981ee660 con 0x7fb8980c47c0 2023-11-28T20:02:22.534 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:22.528+0000 7fb89e12a640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb898155080 con 0x7fb89806b320 2023-11-28T20:02:22.534 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:22.528+0000 7fb89e12a640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8980c7ff0 con 0x7fb898151ec0 2023-11-28T20:02:22.534 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:22.528+0000 7fb896ffd640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb8980c47c0 0x7fb8981f0190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:02:22.534 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:22.528+0000 7fb896ffd640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb8980c47c0 0x7fb8981f0190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:54482/0 (socket says 172.21.15.78:54482) 2023-11-28T20:02:22.534 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:22.528+0000 7fb896ffd640 1 -- 172.21.15.78:0/2087177684 learned_addr learned my addr 172.21.15.78:0/2087177684 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T20:02:22.535 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:22.528+0000 7fb8977fe640 1 --2- 172.21.15.78:0/2087177684 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb89806b320 0x7fb8981efc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:02:22.535 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:22.528+0000 7fb897fff640 1 --2- 172.21.15.78:0/2087177684 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb898151ec0 0x7fb8981f09c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:02:22.535 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:22.528+0000 7fb896ffd640 1 -- 172.21.15.78:0/2087177684 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb898151ec0 msgr2=0x7fb8981f09c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:02:22.535 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:22.528+0000 7fb896ffd640 1 --2- 172.21.15.78:0/2087177684 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb898151ec0 0x7fb8981f09c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:22.535 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:22.528+0000 7fb896ffd640 1 -- 172.21.15.78:0/2087177684 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb89806b320 msgr2=0x7fb8981efc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:02:22.535 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:22.528+0000 7fb896ffd640 1 --2- 172.21.15.78:0/2087177684 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb89806b320 0x7fb8981efc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:22.535 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:22.528+0000 7fb896ffd640 1 -- 172.21.15.78:0/2087177684 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb890009a70 con 0x7fb8980c47c0 2023-11-28T20:02:22.535 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:22.528+0000 7fb896ffd640 1 --2- 172.21.15.78:0/2087177684 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb8980c47c0 0x7fb8981f0190 secure :-1 s=READY pgs=946 cs=0 l=1 rev1=1 crypto rx=0x7fb88c00d800 tx=0x7fb88c00dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:02:22.535 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:22.528+0000 7fb87ffff640 1 -- 172.21.15.78:0/2087177684 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb88c00b6c0 con 0x7fb8980c47c0 2023-11-28T20:02:22.535 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:22.528+0000 7fb87ffff640 1 -- 172.21.15.78:0/2087177684 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb88c00b820 con 0x7fb8980c47c0 2023-11-28T20:02:22.535 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:22.528+0000 7fb87ffff640 1 -- 172.21.15.78:0/2087177684 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb88c00bb90 con 0x7fb8980c47c0 2023-11-28T20:02:22.535 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:22.528+0000 7fb89e12a640 1 -- 172.21.15.78:0/2087177684 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb8980c3740 con 0x7fb8980c47c0 2023-11-28T20:02:22.536 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:22.528+0000 7fb89e12a640 1 -- 172.21.15.78:0/2087177684 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb898152910 con 0x7fb8980c47c0 2023-11-28T20:02:22.536 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:22.532+0000 7fb89e12a640 1 -- 172.21.15.78:0/2087177684 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb898067630 con 0x7fb8980c47c0 2023-11-28T20:02:22.536 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:22.532+0000 7fb87ffff640 1 -- 172.21.15.78:0/2087177684 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fb88c00bcf0 con 0x7fb8980c47c0 2023-11-28T20:02:22.536 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:22.532+0000 7fb87ffff640 1 --2- 172.21.15.78:0/2087177684 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fb884066470 0x7fb884068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:22.536 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:22.532+0000 7fb87ffff640 1 -- 172.21.15.78:0/2087177684 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6029+0+0 (secure 0 0 0) 0x7fb88c084450 con 0x7fb8980c47c0 2023-11-28T20:02:22.537 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:22.532+0000 7fb8977fe640 1 --2- 172.21.15.78:0/2087177684 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fb884066470 0x7fb884068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:02:22.537 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:22.532+0000 7fb8977fe640 1 --2- 172.21.15.78:0/2087177684 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fb884066470 0x7fb884068930 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7fb888001280 tx=0x7fb888009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:02:22.540 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:22.536+0000 7fb87ffff640 1 -- 172.21.15.78:0/2087177684 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fb88c051820 con 0x7fb8980c47c0 2023-11-28T20:02:22.691 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:22.684+0000 7fb89e12a640 1 -- 172.21.15.78:0/2087177684 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7fb8980caa30 con 0x7fb8980c47c0 2023-11-28T20:02:22.691 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:22.688+0000 7fb87ffff640 1 -- 172.21.15.78:0/2087177684 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v81) v1 ==== 84+0+209 (secure 0 0 0) 0x7fb88c054e40 con 0x7fb8980c47c0 2023-11-28T20:02:22.692 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-11-28T20:02:22.692 INFO:teuthology.orchestra.run.smithi078.stdout:[ 2023-11-28T20:02:22.692 INFO:teuthology.orchestra.run.smithi078.stdout: { 2023-11-28T20:02:22.692 INFO:teuthology.orchestra.run.smithi078.stdout: "poolnum": 1, 2023-11-28T20:02:22.692 INFO:teuthology.orchestra.run.smithi078.stdout: "poolname": ".mgr" 2023-11-28T20:02:22.692 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2023-11-28T20:02:22.692 INFO:teuthology.orchestra.run.smithi078.stdout: { 2023-11-28T20:02:22.693 INFO:teuthology.orchestra.run.smithi078.stdout: "poolnum": 13, 2023-11-28T20:02:22.693 INFO:teuthology.orchestra.run.smithi078.stdout: "poolname": "cephfs_metadata" 2023-11-28T20:02:22.693 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2023-11-28T20:02:22.693 INFO:teuthology.orchestra.run.smithi078.stdout: { 2023-11-28T20:02:22.693 INFO:teuthology.orchestra.run.smithi078.stdout: "poolnum": 14, 2023-11-28T20:02:22.693 INFO:teuthology.orchestra.run.smithi078.stdout: "poolname": "cephfs_data" 2023-11-28T20:02:22.693 INFO:teuthology.orchestra.run.smithi078.stdout: } 2023-11-28T20:02:22.693 INFO:teuthology.orchestra.run.smithi078.stdout:] 2023-11-28T20:02:22.694 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:22.688+0000 7fb89e12a640 1 -- 172.21.15.78:0/2087177684 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fb884066470 msgr2=0x7fb884068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:02:22.695 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:22.688+0000 7fb89e12a640 1 --2- 172.21.15.78:0/2087177684 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fb884066470 0x7fb884068930 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7fb888001280 tx=0x7fb888009040 comp rx=0 tx=0).stop 2023-11-28T20:02:22.695 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:22.688+0000 7fb89e12a640 1 -- 172.21.15.78:0/2087177684 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb8980c47c0 msgr2=0x7fb8981f0190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:02:22.695 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:22.688+0000 7fb89e12a640 1 --2- 172.21.15.78:0/2087177684 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb8980c47c0 0x7fb8981f0190 secure :-1 s=READY pgs=946 cs=0 l=1 rev1=1 crypto rx=0x7fb88c00d800 tx=0x7fb88c00dcc0 comp rx=0 tx=0).stop 2023-11-28T20:02:22.695 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:22.688+0000 7fb89e12a640 1 -- 172.21.15.78:0/2087177684 shutdown_connections 2023-11-28T20:02:22.695 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:22.688+0000 7fb89e12a640 1 --2- 172.21.15.78:0/2087177684 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fb884066470 0x7fb884068930 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:22.695 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:22.688+0000 7fb89e12a640 1 --2- 172.21.15.78:0/2087177684 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb898151ec0 0x7fb8981f09c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:22.695 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:22.688+0000 7fb89e12a640 1 --2- 172.21.15.78:0/2087177684 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb8980c47c0 0x7fb8981f0190 unknown :-1 s=CLOSED pgs=946 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:22.695 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:22.688+0000 7fb89e12a640 1 --2- 172.21.15.78:0/2087177684 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb89806b320 0x7fb8981efc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:22.695 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:22.688+0000 7fb89e12a640 1 -- 172.21.15.78:0/2087177684 >> 172.21.15.78:0/2087177684 conn(0x7fb8980c9e40 msgr2=0x7fb89806c6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:02:22.696 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:22.688+0000 7fb89e12a640 1 -- 172.21.15.78:0/2087177684 shutdown_connections 2023-11-28T20:02:22.696 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:22.688+0000 7fb89e12a640 1 -- 172.21.15.78:0/2087177684 wait complete. 2023-11-28T20:02:22.712 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs2' 2023-11-28T20:02:22.712 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs2_metadata --pg_num_min 64 2023-11-28T20:02:22.854 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:22.848+0000 7f81d4809640 1 Processor -- start 2023-11-28T20:02:22.855 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:22.848+0000 7f81d4809640 1 -- start start 2023-11-28T20:02:22.856 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:22.852+0000 7f81d4809640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f81d014f850 0x7f81d00aacf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:22.856 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:22.852+0000 7f81d4809640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f81d006d840 0x7f81d00c43e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:22.856 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:22.852+0000 7f81d4809640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f81d0152910 con 0x7f81d014fc30 2023-11-28T20:02:22.856 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:22.852+0000 7f81d4809640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f81d00c2240 con 0x7f81d014f850 2023-11-28T20:02:22.856 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:22.852+0000 7f81d4809640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81d0152bf0 con 0x7f81d006d840 2023-11-28T20:02:22.857 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:22.852+0000 7f81ce59c640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f81d014f850 0x7f81d00aacf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:02:22.857 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:22.852+0000 7f81ce59c640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f81d014f850 0x7f81d00aacf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.78:52850/0 (socket says 172.21.15.78:52850) 2023-11-28T20:02:22.857 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:22.852+0000 7f81ce59c640 1 -- 172.21.15.78:0/1367558523 learned_addr learned my addr 172.21.15.78:0/1367558523 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T20:02:22.857 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:22.852+0000 7f81ced9d640 1 --2- 172.21.15.78:0/1367558523 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f81d006d840 0x7f81d00c43e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:02:22.857 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:22.852+0000 7f81ce59c640 1 -- 172.21.15.78:0/1367558523 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f81d006d840 msgr2=0x7f81d00c43e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:02:22.857 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:22.852+0000 7f81ce59c640 1 --2- 172.21.15.78:0/1367558523 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f81d006d840 0x7f81d00c43e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:22.857 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:22.852+0000 7f81ce59c640 1 -- 172.21.15.78:0/1367558523 >> v1:172.21.15.179:6789/0 conn(0x7f81d014fc30 legacy=0x7f81d00c3cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:02:22.857 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:22.852+0000 7f81ce59c640 1 -- 172.21.15.78:0/1367558523 --> v2:172.21.15.179:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81d0152ed0 con 0x7f81d014f850 2023-11-28T20:02:22.859 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:22.856+0000 7f81ce59c640 1 --2- 172.21.15.78:0/1367558523 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f81d014f850 0x7f81d00aacf0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f81c0009870 tx=0x7f81c001c540 comp rx=0 tx=0).ready entity=mon.1 client_cookie=66cdf7a59d44f809 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:02:22.860 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:22.856+0000 7f81cdd9b640 1 -- 172.21.15.78:0/1367558523 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81c00a9620 con 0x7f81d014f850 2023-11-28T20:02:22.860 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:22.856+0000 7f81cdd9b640 1 -- 172.21.15.78:0/1367558523 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f81c00a9780 con 0x7f81d014f850 2023-11-28T20:02:22.860 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:22.856+0000 7f81cdd9b640 1 -- 172.21.15.78:0/1367558523 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81c00a9b10 con 0x7f81d014f850 2023-11-28T20:02:22.861 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:22.856+0000 7f81d4809640 1 -- 172.21.15.78:0/1367558523 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f81d014f850 msgr2=0x7f81d00aacf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:02:22.861 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:22.856+0000 7f81d4809640 1 --2- 172.21.15.78:0/1367558523 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f81d014f850 0x7f81d00aacf0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f81c0009870 tx=0x7f81c001c540 comp rx=0 tx=0).stop 2023-11-28T20:02:22.861 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:22.856+0000 7f81d4809640 1 -- 172.21.15.78:0/1367558523 shutdown_connections 2023-11-28T20:02:22.861 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:22.856+0000 7f81d4809640 1 --2- 172.21.15.78:0/1367558523 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f81d006d840 0x7f81d00c43e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:22.861 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:22.856+0000 7f81d4809640 1 --2- 172.21.15.78:0/1367558523 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f81d014f850 0x7f81d00aacf0 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:22.861 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:22.856+0000 7f81d4809640 1 -- 172.21.15.78:0/1367558523 >> 172.21.15.78:0/1367558523 conn(0x7f81d00c59f0 msgr2=0x7f81d00c5e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:02:22.861 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:22.856+0000 7f81d4809640 1 -- 172.21.15.78:0/1367558523 shutdown_connections 2023-11-28T20:02:22.861 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:22.856+0000 7f81d4809640 1 -- 172.21.15.78:0/1367558523 wait complete. 2023-11-28T20:02:22.862 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:22.856+0000 7f81d4809640 1 Processor -- start 2023-11-28T20:02:22.862 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:22.856+0000 7f81d4809640 1 -- start start 2023-11-28T20:02:22.863 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:22.860+0000 7f81d4809640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f81d006d840 0x7f81d0070180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:22.863 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:22.860+0000 7f81d4809640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f81d014f850 0x7f81d01488f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:22.863 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:22.860+0000 7f81d4809640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f81d014fc30 0x7f81d0148e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:22.863 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:22.860+0000 7f81d4809640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81d01ee990 con 0x7f81d014f850 2023-11-28T20:02:22.864 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:22.860+0000 7f81d4809640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81d01eec70 con 0x7f81d014fc30 2023-11-28T20:02:22.864 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:22.860+0000 7f81d4809640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81d01eef50 con 0x7f81d006d840 2023-11-28T20:02:22.864 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:22.860+0000 7f81c5d9b640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f81d014f850 0x7f81d01488f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:02:22.864 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:22.860+0000 7f81c5d9b640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f81d014f850 0x7f81d01488f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:54498/0 (socket says 172.21.15.78:54498) 2023-11-28T20:02:22.864 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:22.860+0000 7f81c5d9b640 1 -- 172.21.15.78:0/268785053 learned_addr learned my addr 172.21.15.78:0/268785053 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T20:02:22.865 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:22.860+0000 7f81ce59c640 1 --2- 172.21.15.78:0/268785053 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f81d006d840 0x7f81d0070180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:02:22.865 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:22.860+0000 7f81ced9d640 1 --2- 172.21.15.78:0/268785053 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f81d014fc30 0x7f81d0148e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:02:22.865 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:22.860+0000 7f81c5d9b640 1 -- 172.21.15.78:0/268785053 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f81d006d840 msgr2=0x7f81d0070180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:02:22.866 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:22.860+0000 7f81c5d9b640 1 --2- 172.21.15.78:0/268785053 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f81d006d840 0x7f81d0070180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:22.866 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:22.860+0000 7f81c5d9b640 1 -- 172.21.15.78:0/268785053 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f81d014fc30 msgr2=0x7f81d0148e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:02:22.866 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:22.860+0000 7f81c5d9b640 1 --2- 172.21.15.78:0/268785053 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f81d014fc30 0x7f81d0148e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:22.866 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:22.860+0000 7f81c5d9b640 1 -- 172.21.15.78:0/268785053 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81c00094d0 con 0x7f81d014f850 2023-11-28T20:02:22.866 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:22.860+0000 7f81ced9d640 1 --2- 172.21.15.78:0/268785053 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f81d014fc30 0x7f81d0148e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T20:02:22.866 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:22.860+0000 7f81c5d9b640 1 --2- 172.21.15.78:0/268785053 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f81d014f850 0x7f81d01488f0 secure :-1 s=READY pgs=947 cs=0 l=1 rev1=1 crypto rx=0x7f81b800c3a0 tx=0x7f81b800c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:02:22.866 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:22.860+0000 7f81c77fe640 1 -- 172.21.15.78:0/268785053 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81b80052d0 con 0x7f81d014f850 2023-11-28T20:02:22.866 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:22.860+0000 7f81c77fe640 1 -- 172.21.15.78:0/268785053 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f81b8005450 con 0x7f81d014f850 2023-11-28T20:02:22.866 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:22.860+0000 7f81d4809640 1 -- 172.21.15.78:0/268785053 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f81d01ef230 con 0x7f81d014f850 2023-11-28T20:02:22.866 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:22.860+0000 7f81c77fe640 1 -- 172.21.15.78:0/268785053 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81b8003860 con 0x7f81d014f850 2023-11-28T20:02:22.866 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:22.860+0000 7f81d4809640 1 -- 172.21.15.78:0/268785053 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f81d0150eb0 con 0x7f81d014f850 2023-11-28T20:02:22.867 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:22.860+0000 7f81d4809640 1 -- 172.21.15.78:0/268785053 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f81d01ef6e0 con 0x7f81d014f850 2023-11-28T20:02:22.867 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:22.860+0000 7f81c77fe640 1 -- 172.21.15.78:0/268785053 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f81b80039c0 con 0x7f81d014f850 2023-11-28T20:02:22.867 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:22.864+0000 7f81c77fe640 1 --2- 172.21.15.78:0/268785053 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f81b0066470 0x7f81b0068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:22.867 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:22.864+0000 7f81c77fe640 1 -- 172.21.15.78:0/268785053 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f81b8083460 con 0x7f81d014f850 2023-11-28T20:02:22.868 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:22.864+0000 7f81ce59c640 1 --2- 172.21.15.78:0/268785053 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f81b0066470 0x7f81b0068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:02:22.868 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:22.864+0000 7f81ce59c640 1 --2- 172.21.15.78:0/268785053 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f81b0066470 0x7f81b0068930 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f81c00ae000 tx=0x7f81c00b3040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:02:22.871 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:22.868+0000 7f81c77fe640 1 -- 172.21.15.78:0/268785053 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f81d01ef6e0 con 0x7f81d014f850 2023-11-28T20:02:23.023 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:23.016+0000 7f81d4809640 1 -- 172.21.15.78:0/268785053 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs2_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f81d01ef6e0 con 0x7f81d014f850 2023-11-28T20:02:23.841 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:23.836+0000 7f81c77fe640 1 -- 172.21.15.78:0/268785053 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs2_metadata", "pg_num_min": 64}]=0 pool 'cephfs2_metadata' created v82) v1 ==== 140+0+0 (secure 0 0 0) 0x7f81d01ef6e0 con 0x7f81d014f850 2023-11-28T20:02:23.841 INFO:teuthology.orchestra.run.smithi078.stderr:pool 'cephfs2_metadata' created 2023-11-28T20:02:23.844 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:23.840+0000 7f81d4809640 1 -- 172.21.15.78:0/268785053 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f81b0066470 msgr2=0x7f81b0068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:02:23.844 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:23.840+0000 7f81d4809640 1 --2- 172.21.15.78:0/268785053 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f81b0066470 0x7f81b0068930 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f81c00ae000 tx=0x7f81c00b3040 comp rx=0 tx=0).stop 2023-11-28T20:02:23.845 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:23.840+0000 7f81d4809640 1 -- 172.21.15.78:0/268785053 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f81d014f850 msgr2=0x7f81d01488f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:02:23.845 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:23.840+0000 7f81d4809640 1 --2- 172.21.15.78:0/268785053 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f81d014f850 0x7f81d01488f0 secure :-1 s=READY pgs=947 cs=0 l=1 rev1=1 crypto rx=0x7f81b800c3a0 tx=0x7f81b800c860 comp rx=0 tx=0).stop 2023-11-28T20:02:23.845 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:23.840+0000 7f81d4809640 1 -- 172.21.15.78:0/268785053 shutdown_connections 2023-11-28T20:02:23.845 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:23.840+0000 7f81d4809640 1 --2- 172.21.15.78:0/268785053 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f81b0066470 0x7f81b0068930 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:23.845 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:23.840+0000 7f81d4809640 1 --2- 172.21.15.78:0/268785053 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f81d014fc30 0x7f81d0148e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:23.845 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:23.840+0000 7f81d4809640 1 --2- 172.21.15.78:0/268785053 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f81d014f850 0x7f81d01488f0 unknown :-1 s=CLOSED pgs=947 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:23.845 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:23.840+0000 7f81d4809640 1 --2- 172.21.15.78:0/268785053 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f81d006d840 0x7f81d0070180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:23.845 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:23.840+0000 7f81d4809640 1 -- 172.21.15.78:0/268785053 >> 172.21.15.78:0/268785053 conn(0x7f81d00c59f0 msgr2=0x7f81d00c3cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:02:23.846 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:23.840+0000 7f81d4809640 1 -- 172.21.15.78:0/268785053 shutdown_connections 2023-11-28T20:02:23.846 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:23.840+0000 7f81d4809640 1 -- 172.21.15.78:0/268785053 wait complete. 2023-11-28T20:02:23.872 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs2_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-11-28T20:02:24.018 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:24.012+0000 7f65ed71e640 1 Processor -- start 2023-11-28T20:02:24.018 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:24.012+0000 7f65ed71e640 1 -- start start 2023-11-28T20:02:24.020 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:24.016+0000 7f65ed71e640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f65e80c1950 0x7f65e80a70a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:24.020 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:24.016+0000 7f65ed71e640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f65e8154ee0 0x7f65e80c6ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:24.020 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:24.016+0000 7f65ed71e640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f65e80c7020 con 0x7f65e80a6cc0 2023-11-28T20:02:24.020 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:24.016+0000 7f65ed71e640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f65e80c4ea0 con 0x7f65e80c1950 2023-11-28T20:02:24.020 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:24.016+0000 7f65ed71e640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f65e8070730 con 0x7f65e8154ee0 2023-11-28T20:02:24.020 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:24.016+0000 7f65e77fe640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f65e80c1950 0x7f65e80a70a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:02:24.020 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:24.016+0000 7f65e77fe640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f65e80c1950 0x7f65e80a70a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:54506/0 (socket says 172.21.15.78:54506) 2023-11-28T20:02:24.020 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:24.016+0000 7f65e7fff640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f65e80a6cc0 0x7f65e8070020 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:41780/0 (socket says 172.21.15.78:41780) 2023-11-28T20:02:24.020 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:24.016+0000 7f65e77fe640 1 -- 172.21.15.78:0/2882433127 learned_addr learned my addr 172.21.15.78:0/2882433127 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T20:02:24.020 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:24.016+0000 7f65ecf1d640 1 --2- 172.21.15.78:0/2882433127 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f65e8154ee0 0x7f65e80c6ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:02:24.020 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:24.016+0000 7f65e77fe640 1 -- 172.21.15.78:0/2882433127 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f65e8154ee0 msgr2=0x7f65e80c6ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:02:24.021 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:24.016+0000 7f65e77fe640 1 --2- 172.21.15.78:0/2882433127 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f65e8154ee0 0x7f65e80c6ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:24.021 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:24.016+0000 7f65e77fe640 1 -- 172.21.15.78:0/2882433127 >> v1:172.21.15.78:6789/0 conn(0x7f65e80a6cc0 legacy=0x7f65e8070020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:02:24.021 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:24.016+0000 7f65e77fe640 1 -- 172.21.15.78:0/2882433127 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65e806ef80 con 0x7f65e80c1950 2023-11-28T20:02:24.022 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:24.016+0000 7f65e77fe640 1 --2- 172.21.15.78:0/2882433127 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f65e80c1950 0x7f65e80a70a0 secure :-1 s=READY pgs=949 cs=0 l=1 rev1=1 crypto rx=0x7f65dc009870 tx=0x7f65dc01ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8c635e06edd91e92 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:02:24.024 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:24.020+0000 7f65e6ffd640 1 -- 172.21.15.78:0/2882433127 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65dc0a8a30 con 0x7f65e80c1950 2023-11-28T20:02:24.024 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:24.020+0000 7f65e6ffd640 1 -- 172.21.15.78:0/2882433127 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f65dc0a8b90 con 0x7f65e80c1950 2023-11-28T20:02:24.024 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:24.020+0000 7f65e6ffd640 1 -- 172.21.15.78:0/2882433127 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65dc0b0440 con 0x7f65e80c1950 2023-11-28T20:02:24.024 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:24.020+0000 7f65ed71e640 1 -- 172.21.15.78:0/2882433127 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f65e80c1950 msgr2=0x7f65e80a70a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:02:24.024 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:24.020+0000 7f65ed71e640 1 --2- 172.21.15.78:0/2882433127 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f65e80c1950 0x7f65e80a70a0 secure :-1 s=READY pgs=949 cs=0 l=1 rev1=1 crypto rx=0x7f65dc009870 tx=0x7f65dc01ed30 comp rx=0 tx=0).stop 2023-11-28T20:02:24.024 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:24.020+0000 7f65ed71e640 1 -- 172.21.15.78:0/2882433127 shutdown_connections 2023-11-28T20:02:24.024 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:24.020+0000 7f65ed71e640 1 --2- 172.21.15.78:0/2882433127 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f65e8154ee0 0x7f65e80c6ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:24.024 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:24.020+0000 7f65ed71e640 1 --2- 172.21.15.78:0/2882433127 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f65e80c1950 0x7f65e80a70a0 unknown :-1 s=CLOSED pgs=949 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:24.024 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:24.020+0000 7f65ed71e640 1 -- 172.21.15.78:0/2882433127 >> 172.21.15.78:0/2882433127 conn(0x7f65e80662a0 msgr2=0x7f65e80666b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:02:24.024 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:24.020+0000 7f65ed71e640 1 -- 172.21.15.78:0/2882433127 shutdown_connections 2023-11-28T20:02:24.025 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:24.020+0000 7f65ed71e640 1 -- 172.21.15.78:0/2882433127 wait complete. 2023-11-28T20:02:24.025 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:24.020+0000 7f65ed71e640 1 Processor -- start 2023-11-28T20:02:24.025 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:24.020+0000 7f65ed71e640 1 -- start start 2023-11-28T20:02:24.027 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:24.020+0000 7f65ed71e640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f65e80a6cc0 0x7f65e8153b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:24.027 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:24.020+0000 7f65ed71e640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f65e80c1950 0x7f65e81ed160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:24.028 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:24.020+0000 7f65ed71e640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f65e8154ee0 0x7f65e81ed6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:24.028 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:24.020+0000 7f65ed71e640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65e8156080 con 0x7f65e8154ee0 2023-11-28T20:02:24.028 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:24.020+0000 7f65ed71e640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65e8158440 con 0x7f65e80c1950 2023-11-28T20:02:24.028 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:24.020+0000 7f65ed71e640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f65e8157330 con 0x7f65e80a6cc0 2023-11-28T20:02:24.028 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:24.020+0000 7f65ecf1d640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f65e8154ee0 0x7f65e81ed6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:02:24.028 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:24.020+0000 7f65ecf1d640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f65e8154ee0 0x7f65e81ed6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:54514/0 (socket says 172.21.15.78:54514) 2023-11-28T20:02:24.028 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:24.020+0000 7f65ecf1d640 1 -- 172.21.15.78:0/260407057 learned_addr learned my addr 172.21.15.78:0/260407057 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T20:02:24.028 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:24.020+0000 7f65e7fff640 1 --2- 172.21.15.78:0/260407057 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f65e80a6cc0 0x7f65e8153b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:02:24.028 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:24.020+0000 7f65e77fe640 1 --2- 172.21.15.78:0/260407057 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f65e80c1950 0x7f65e81ed160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:02:24.028 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:24.024+0000 7f65ecf1d640 1 -- 172.21.15.78:0/260407057 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f65e80a6cc0 msgr2=0x7f65e8153b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:02:24.028 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:24.024+0000 7f65ecf1d640 1 --2- 172.21.15.78:0/260407057 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f65e80a6cc0 0x7f65e8153b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:24.029 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:24.024+0000 7f65ecf1d640 1 -- 172.21.15.78:0/260407057 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f65e80c1950 msgr2=0x7f65e81ed160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:02:24.029 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:24.024+0000 7f65ecf1d640 1 --2- 172.21.15.78:0/260407057 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f65e80c1950 0x7f65e81ed160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:24.029 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:24.024+0000 7f65ecf1d640 1 -- 172.21.15.78:0/260407057 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65dc0094d0 con 0x7f65e8154ee0 2023-11-28T20:02:24.029 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:24.024+0000 7f65e7fff640 1 --2- 172.21.15.78:0/260407057 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f65e80a6cc0 0x7f65e8153b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T20:02:24.029 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:24.024+0000 7f65e77fe640 1 --2- 172.21.15.78:0/260407057 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f65e80c1950 0x7f65e81ed160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T20:02:24.029 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:24.024+0000 7f65ecf1d640 1 --2- 172.21.15.78:0/260407057 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f65e8154ee0 0x7f65e81ed6a0 secure :-1 s=READY pgs=950 cs=0 l=1 rev1=1 crypto rx=0x7f65e0007d20 tx=0x7f65e000e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:02:24.029 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:24.024+0000 7f65e4ff9640 1 -- 172.21.15.78:0/260407057 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65e0014420 con 0x7f65e8154ee0 2023-11-28T20:02:24.029 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:24.024+0000 7f65e4ff9640 1 -- 172.21.15.78:0/260407057 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f65e00145a0 con 0x7f65e8154ee0 2023-11-28T20:02:24.029 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:24.024+0000 7f65ed71e640 1 -- 172.21.15.78:0/260407057 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f65e8155da0 con 0x7f65e8154ee0 2023-11-28T20:02:24.029 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:24.024+0000 7f65e4ff9640 1 -- 172.21.15.78:0/260407057 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65e0014950 con 0x7f65e8154ee0 2023-11-28T20:02:24.029 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:24.024+0000 7f65ed71e640 1 -- 172.21.15.78:0/260407057 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f65e8158690 con 0x7f65e8154ee0 2023-11-28T20:02:24.030 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:24.024+0000 7f65ed71e640 1 -- 172.21.15.78:0/260407057 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f65e80a8c60 con 0x7f65e8154ee0 2023-11-28T20:02:24.030 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:24.024+0000 7f65e4ff9640 1 -- 172.21.15.78:0/260407057 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f65e0014ab0 con 0x7f65e8154ee0 2023-11-28T20:02:24.031 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:24.024+0000 7f65e4ff9640 1 --2- 172.21.15.78:0/260407057 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f65d4066470 0x7f65d4068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:24.031 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:24.028+0000 7f65e4ff9640 1 -- 172.21.15.78:0/260407057 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 6400+0+0 (secure 0 0 0) 0x7f65e00857f0 con 0x7f65e8154ee0 2023-11-28T20:02:24.031 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:24.028+0000 7f65e7fff640 1 --2- 172.21.15.78:0/260407057 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f65d4066470 0x7f65d4068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:02:24.031 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:24.028+0000 7f65e7fff640 1 --2- 172.21.15.78:0/260407057 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f65d4066470 0x7f65d4068930 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f65d8000f70 tx=0x7f65d8007d70 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:02:24.034 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:24.028+0000 7f65e4ff9640 1 -- 172.21.15.78:0/260407057 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f65e0052b10 con 0x7f65e8154ee0 2023-11-28T20:02:24.187 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:24.180+0000 7f65ed71e640 1 -- 172.21.15.78:0/260407057 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs2_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f65e806f520 con 0x7f65e8154ee0 2023-11-28T20:02:24.852 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:24.848+0000 7f65e4ff9640 1 -- 172.21.15.78:0/260407057 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs2_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs2_data' created v83) v1 ==== 172+0+0 (secure 0 0 0) 0x7f65e806f520 con 0x7f65e8154ee0 2023-11-28T20:02:24.852 INFO:teuthology.orchestra.run.smithi078.stderr:pool 'cephfs2_data' created 2023-11-28T20:02:24.853 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:24.848+0000 7f65ed71e640 1 -- 172.21.15.78:0/260407057 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f65d4066470 msgr2=0x7f65d4068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:02:24.854 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:24.848+0000 7f65ed71e640 1 --2- 172.21.15.78:0/260407057 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f65d4066470 0x7f65d4068930 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f65d8000f70 tx=0x7f65d8007d70 comp rx=0 tx=0).stop 2023-11-28T20:02:24.855 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:24.848+0000 7f65ed71e640 1 -- 172.21.15.78:0/260407057 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f65e8154ee0 msgr2=0x7f65e81ed6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:02:24.855 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:24.848+0000 7f65ed71e640 1 --2- 172.21.15.78:0/260407057 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f65e8154ee0 0x7f65e81ed6a0 secure :-1 s=READY pgs=950 cs=0 l=1 rev1=1 crypto rx=0x7f65e0007d20 tx=0x7f65e000e4b0 comp rx=0 tx=0).stop 2023-11-28T20:02:24.855 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:24.848+0000 7f65ed71e640 1 -- 172.21.15.78:0/260407057 shutdown_connections 2023-11-28T20:02:24.855 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:24.848+0000 7f65ed71e640 1 --2- 172.21.15.78:0/260407057 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f65d4066470 0x7f65d4068930 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:24.855 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:24.848+0000 7f65ed71e640 1 --2- 172.21.15.78:0/260407057 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f65e8154ee0 0x7f65e81ed6a0 unknown :-1 s=CLOSED pgs=950 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:24.855 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:24.848+0000 7f65ed71e640 1 --2- 172.21.15.78:0/260407057 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f65e80c1950 0x7f65e81ed160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:24.855 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:24.848+0000 7f65ed71e640 1 --2- 172.21.15.78:0/260407057 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f65e80a6cc0 0x7f65e8153b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:24.855 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:24.848+0000 7f65ed71e640 1 -- 172.21.15.78:0/260407057 >> 172.21.15.78:0/260407057 conn(0x7f65e80662a0 msgr2=0x7f65e80c71b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:02:24.855 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:24.848+0000 7f65ed71e640 1 -- 172.21.15.78:0/260407057 shutdown_connections 2023-11-28T20:02:24.855 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:24.848+0000 7f65ed71e640 1 -- 172.21.15.78:0/260407057 wait complete. 2023-11-28T20:02:24.890 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs2 cephfs2_metadata cephfs2_data 2023-11-28T20:02:25.031 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:25.028+0000 7f91230c9640 1 Processor -- start 2023-11-28T20:02:25.031 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:25.028+0000 7f91230c9640 1 -- start start 2023-11-28T20:02:25.032 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:25.028+0000 7f91230c9640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f911c14fc30 0x7f911c0c3cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:25.032 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:25.028+0000 7f91230c9640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f911c152910 con 0x7f911c14f850 2023-11-28T20:02:25.032 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:25.028+0000 7f91230c9640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f911c152bf0 con 0x7f911c06d840 2023-11-28T20:02:25.032 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:25.028+0000 7f91230c9640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f911c0c2240 con 0x7f911c14fc30 2023-11-28T20:02:25.032 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:25.028+0000 7f9120e65640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f911c14f850 0x7f911c0aacf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:41794/0 (socket says 172.21.15.78:41794) 2023-11-28T20:02:25.033 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:25.028+0000 7f9120e65640 1 -- 172.21.15.78:0/1240981927 learned_addr learned my addr 172.21.15.78:0/1240981927 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-11-28T20:02:25.033 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:25.028+0000 7f9113fff640 1 --2- 172.21.15.78:0/1240981927 >> v2:172.21.15.179:3300/0 conn(0x7f911c14fc30 0x7f911c0c3cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:02:25.033 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:25.028+0000 7f91137fe640 1 -- 172.21.15.78:0/1240981927 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 50834953 0 0) 0x7f911c152910 con 0x7f911c14f850 2023-11-28T20:02:25.034 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:25.028+0000 7f91137fe640 1 -- 172.21.15.78:0/1240981927 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9104003530 con 0x7f911c14f850 2023-11-28T20:02:25.034 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:25.028+0000 7f9113fff640 1 -- 172.21.15.78:0/1240981927 >> v1:172.21.15.179:6789/0 conn(0x7f911c06d840 legacy=0x7f911c0c4210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:02:25.034 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:25.028+0000 7f9113fff640 1 -- 172.21.15.78:0/1240981927 >> v1:172.21.15.78:6789/0 conn(0x7f911c14f850 legacy=0x7f911c0aacf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:02:25.034 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:25.028+0000 7f9113fff640 1 -- 172.21.15.78:0/1240981927 --> v2:172.21.15.179:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f911c152ed0 con 0x7f911c14fc30 2023-11-28T20:02:25.036 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:25.032+0000 7f9113fff640 1 --2- 172.21.15.78:0/1240981927 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f911c14fc30 0x7f911c0c3cd0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f910c0097c0 tx=0x7f910c01c480 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b411986a0e171289 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:02:25.037 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:25.032+0000 7f91137fe640 1 -- 172.21.15.78:0/1240981927 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f910c0a6040 con 0x7f911c14fc30 2023-11-28T20:02:25.037 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:25.032+0000 7f91137fe640 1 -- 172.21.15.78:0/1240981927 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f910c0aa600 con 0x7f911c14fc30 2023-11-28T20:02:25.037 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:25.032+0000 7f91137fe640 1 -- 172.21.15.78:0/1240981927 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f910c0aa970 con 0x7f911c14fc30 2023-11-28T20:02:25.038 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:25.032+0000 7f91230c9640 1 -- 172.21.15.78:0/1240981927 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f911c14fc30 msgr2=0x7f911c0c3cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:02:25.038 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:25.032+0000 7f91230c9640 1 --2- 172.21.15.78:0/1240981927 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f911c14fc30 0x7f911c0c3cd0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f910c0097c0 tx=0x7f910c01c480 comp rx=0 tx=0).stop 2023-11-28T20:02:25.038 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:25.032+0000 7f91230c9640 1 -- 172.21.15.78:0/1240981927 shutdown_connections 2023-11-28T20:02:25.038 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:25.032+0000 7f91230c9640 1 --2- 172.21.15.78:0/1240981927 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f911c14fc30 0x7f911c0c3cd0 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:25.038 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:25.032+0000 7f91230c9640 1 -- 172.21.15.78:0/1240981927 >> 172.21.15.78:0/1240981927 conn(0x7f911c0c59f0 msgr2=0x7f911c0c5e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:02:25.038 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:25.032+0000 7f91230c9640 1 -- 172.21.15.78:0/1240981927 shutdown_connections 2023-11-28T20:02:25.039 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:25.032+0000 7f91230c9640 1 -- 172.21.15.78:0/1240981927 wait complete. 2023-11-28T20:02:25.039 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:25.036+0000 7f91230c9640 1 Processor -- start 2023-11-28T20:02:25.039 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:25.036+0000 7f91230c9640 1 -- start start 2023-11-28T20:02:25.041 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:25.036+0000 7f91230c9640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f911c06d840 0x7f911c14e080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:25.041 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:25.036+0000 7f91230c9640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f911c14f850 0x7f911c1ed780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:25.041 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:25.036+0000 7f91230c9640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f911c14fc30 0x7f911c1edcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:25.041 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:25.036+0000 7f91230c9640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f911c0a6f90 con 0x7f911c06d840 2023-11-28T20:02:25.041 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:25.036+0000 7f91230c9640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f911c1f1780 con 0x7f911c14f850 2023-11-28T20:02:25.041 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:25.036+0000 7f91230c9640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f911c1f1cb0 con 0x7f911c14fc30 2023-11-28T20:02:25.041 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:25.036+0000 7f9120e65640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f911c06d840 0x7f911c14e080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:02:25.041 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:25.036+0000 7f9120e65640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f911c06d840 0x7f911c14e080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:54528/0 (socket says 172.21.15.78:54528) 2023-11-28T20:02:25.041 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:25.036+0000 7f9120e65640 1 -- 172.21.15.78:0/1285371783 learned_addr learned my addr 172.21.15.78:0/1285371783 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T20:02:25.041 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:25.036+0000 7f9120e65640 1 -- 172.21.15.78:0/1285371783 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f911c14fc30 msgr2=0x7f911c1edcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:02:25.042 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:25.036+0000 7f9120e65640 1 --2- 172.21.15.78:0/1285371783 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f911c14fc30 0x7f911c1edcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:25.042 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:25.036+0000 7f9120e65640 1 -- 172.21.15.78:0/1285371783 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f911c14f850 msgr2=0x7f911c1ed780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:02:25.042 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:25.036+0000 7f9120e65640 1 --2- 172.21.15.78:0/1285371783 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f911c14f850 0x7f911c1ed780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:25.042 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:25.036+0000 7f9120e65640 1 -- 172.21.15.78:0/1285371783 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f910c009420 con 0x7f911c06d840 2023-11-28T20:02:25.043 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:25.036+0000 7f9120e65640 1 --2- 172.21.15.78:0/1285371783 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f911c06d840 0x7f911c14e080 secure :-1 s=READY pgs=952 cs=0 l=1 rev1=1 crypto rx=0x7f911800c500 tx=0x7f911800c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:02:25.043 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:25.036+0000 7f91117fa640 1 -- 172.21.15.78:0/1285371783 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9118005cf0 con 0x7f911c06d840 2023-11-28T20:02:25.043 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:25.036+0000 7f91117fa640 1 -- 172.21.15.78:0/1285371783 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9118005e50 con 0x7f911c06d840 2023-11-28T20:02:25.043 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:25.036+0000 7f91117fa640 1 -- 172.21.15.78:0/1285371783 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91180072f0 con 0x7f911c06d840 2023-11-28T20:02:25.043 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:25.036+0000 7f91230c9640 1 -- 172.21.15.78:0/1285371783 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f911c0a9440 con 0x7f911c06d840 2023-11-28T20:02:25.043 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:25.036+0000 7f91230c9640 1 -- 172.21.15.78:0/1285371783 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f911c1f19d0 con 0x7f911c06d840 2023-11-28T20:02:25.043 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:25.036+0000 7f91230c9640 1 -- 172.21.15.78:0/1285371783 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f911c067630 con 0x7f911c06d840 2023-11-28T20:02:25.043 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:25.040+0000 7f91117fa640 1 -- 172.21.15.78:0/1285371783 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f9118007450 con 0x7f911c06d840 2023-11-28T20:02:25.044 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:25.040+0000 7f91117fa640 1 --2- 172.21.15.78:0/1285371783 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f91080664a0 0x7f9108068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:25.044 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:25.040+0000 7f91117fa640 1 -- 172.21.15.78:0/1285371783 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6783+0+0 (secure 0 0 0) 0x7f91180837c0 con 0x7f911c06d840 2023-11-28T20:02:25.045 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:25.040+0000 7f9113fff640 1 --2- 172.21.15.78:0/1285371783 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f91080664a0 0x7f9108068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:02:25.045 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:25.040+0000 7f9113fff640 1 --2- 172.21.15.78:0/1285371783 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f91080664a0 0x7f9108068960 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f910c0ae000 tx=0x7f910c008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:02:25.049 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:25.044+0000 7f91117fa640 1 -- 172.21.15.78:0/1285371783 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f91180508b0 con 0x7f911c06d840 2023-11-28T20:02:25.230 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:25.224+0000 7f91230c9640 1 -- 172.21.15.78:0/1285371783 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs2", "metadata": "cephfs2_metadata", "data": "cephfs2_data"} v 0) v1 -- 0x7f911c0aafb0 con 0x7f911c06d840 2023-11-28T20:02:25.854 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:25.848+0000 7f91117fa640 1 -- 172.21.15.78:0/1285371783 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs2", "metadata": "cephfs2_metadata", "data": "cephfs2_data"}]=0 new fs with metadata pool 15 and data pool 16 v47) v1 ==== 177+0+0 (secure 0 0 0) 0x7f9118053ed0 con 0x7f911c06d840 2023-11-28T20:02:25.855 INFO:teuthology.orchestra.run.smithi078.stderr:new fs with metadata pool 15 and data pool 16 2023-11-28T20:02:25.856 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:25.852+0000 7f91230c9640 1 -- 172.21.15.78:0/1285371783 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f91080664a0 msgr2=0x7f9108068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:02:25.856 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:25.852+0000 7f91230c9640 1 --2- 172.21.15.78:0/1285371783 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f91080664a0 0x7f9108068960 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f910c0ae000 tx=0x7f910c008040 comp rx=0 tx=0).stop 2023-11-28T20:02:25.856 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:25.852+0000 7f91230c9640 1 -- 172.21.15.78:0/1285371783 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f911c06d840 msgr2=0x7f911c14e080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:02:25.856 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:25.852+0000 7f91230c9640 1 --2- 172.21.15.78:0/1285371783 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f911c06d840 0x7f911c14e080 secure :-1 s=READY pgs=952 cs=0 l=1 rev1=1 crypto rx=0x7f911800c500 tx=0x7f911800c9c0 comp rx=0 tx=0).stop 2023-11-28T20:02:25.856 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:25.852+0000 7f91230c9640 1 -- 172.21.15.78:0/1285371783 shutdown_connections 2023-11-28T20:02:25.856 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:25.852+0000 7f91230c9640 1 --2- 172.21.15.78:0/1285371783 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f91080664a0 0x7f9108068960 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:25.856 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:25.852+0000 7f91230c9640 1 --2- 172.21.15.78:0/1285371783 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f911c14fc30 0x7f911c1edcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:25.856 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:25.852+0000 7f91230c9640 1 --2- 172.21.15.78:0/1285371783 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f911c14f850 0x7f911c1ed780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:25.857 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:25.852+0000 7f91230c9640 1 --2- 172.21.15.78:0/1285371783 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f911c06d840 0x7f911c14e080 unknown :-1 s=CLOSED pgs=952 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:25.857 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:25.852+0000 7f91230c9640 1 -- 172.21.15.78:0/1285371783 >> 172.21.15.78:0/1285371783 conn(0x7f911c0c59f0 msgr2=0x7f911c0c5dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:02:25.857 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:25.852+0000 7f91230c9640 1 -- 172.21.15.78:0/1285371783 shutdown_connections 2023-11-28T20:02:25.857 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:25.852+0000 7f91230c9640 1 -- 172.21.15.78:0/1285371783 wait complete. 2023-11-28T20:02:25.881 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-28T20:02:26.019 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:26.016+0000 7f48dc432640 1 Processor -- start 2023-11-28T20:02:26.019 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:26.016+0000 7f48dc432640 1 -- start start 2023-11-28T20:02:26.021 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:26.016+0000 7f48dc432640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f48d4151e80 0x7f48d4072850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:26.021 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:26.016+0000 7f48dc432640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f48d406b060 con 0x7f48d40a6370 2023-11-28T20:02:26.021 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:26.016+0000 7f48dc432640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f48d406b300 con 0x7f48d4154520 2023-11-28T20:02:26.021 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:26.016+0000 7f48dc432640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f48d40a67b0 con 0x7f48d4151e80 2023-11-28T20:02:26.021 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:26.016+0000 7f48d99cd640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f48d40a6370 0x7f48d40c0010 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:55660/0 (socket says 172.21.15.78:55660) 2023-11-28T20:02:26.021 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:26.016+0000 7f48d99cd640 1 -- 172.21.15.78:0/731218379 learned_addr learned my addr 172.21.15.78:0/731218379 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-11-28T20:02:26.021 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:26.016+0000 7f48da1ce640 1 --2- 172.21.15.78:0/731218379 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f48d4151e80 0x7f48d4072850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:02:26.022 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:26.016+0000 7f48d91cc640 1 -- 172.21.15.78:0/731218379 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2856609447 0 0) 0x7f48d406b060 con 0x7f48d40a6370 2023-11-28T20:02:26.022 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:26.016+0000 7f48d91cc640 1 -- 172.21.15.78:0/731218379 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f48c0003530 con 0x7f48d40a6370 2023-11-28T20:02:26.022 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:26.016+0000 7f48da1ce640 1 -- 172.21.15.78:0/731218379 >> v1:172.21.15.179:6789/0 conn(0x7f48d4154520 legacy=0x7f48d41549a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:02:26.022 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:26.016+0000 7f48da1ce640 1 -- 172.21.15.78:0/731218379 >> v1:172.21.15.78:6789/0 conn(0x7f48d40a6370 legacy=0x7f48d40c0010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:02:26.022 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:26.016+0000 7f48da1ce640 1 -- 172.21.15.78:0/731218379 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48d4070f40 con 0x7f48d4151e80 2023-11-28T20:02:26.024 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:26.020+0000 7f48da1ce640 1 --2- 172.21.15.78:0/731218379 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f48d4151e80 0x7f48d4072850 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f48d00097f0 tx=0x7f48d001c4c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=53f2a0a16c566fe4 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:02:26.025 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:26.020+0000 7f48d91cc640 1 -- 172.21.15.78:0/731218379 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48d00ab600 con 0x7f48d4151e80 2023-11-28T20:02:26.025 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:26.020+0000 7f48d91cc640 1 -- 172.21.15.78:0/731218379 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f48d00a7050 con 0x7f48d4151e80 2023-11-28T20:02:26.025 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:26.020+0000 7f48d91cc640 1 -- 172.21.15.78:0/731218379 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48d00ab980 con 0x7f48d4151e80 2023-11-28T20:02:26.025 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:26.020+0000 7f48dc432640 1 -- 172.21.15.78:0/731218379 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f48d4151e80 msgr2=0x7f48d4072850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:02:26.026 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:26.020+0000 7f48dc432640 1 --2- 172.21.15.78:0/731218379 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f48d4151e80 0x7f48d4072850 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f48d00097f0 tx=0x7f48d001c4c0 comp rx=0 tx=0).stop 2023-11-28T20:02:26.026 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:26.020+0000 7f48dc432640 1 -- 172.21.15.78:0/731218379 shutdown_connections 2023-11-28T20:02:26.026 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:26.020+0000 7f48dc432640 1 --2- 172.21.15.78:0/731218379 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f48d4151e80 0x7f48d4072850 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:26.026 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:26.020+0000 7f48dc432640 1 -- 172.21.15.78:0/731218379 >> 172.21.15.78:0/731218379 conn(0x7f48d40a8990 msgr2=0x7f48d40a8da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:02:26.026 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:26.020+0000 7f48dc432640 1 -- 172.21.15.78:0/731218379 shutdown_connections 2023-11-28T20:02:26.026 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:26.020+0000 7f48dc432640 1 -- 172.21.15.78:0/731218379 wait complete. 2023-11-28T20:02:26.027 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:26.024+0000 7f48dc432640 1 Processor -- start 2023-11-28T20:02:26.027 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:26.024+0000 7f48dc432640 1 -- start start 2023-11-28T20:02:26.028 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:26.024+0000 7f48dc432640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f48d40a6370 0x7f48d4153cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:26.029 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:26.024+0000 7f48dc432640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f48d4151e80 0x7f48d413d650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:26.029 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:26.024+0000 7f48dc432640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f48d4154520 0x7f48d41409c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:26.029 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:26.024+0000 7f48dc432640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48d4152e50 con 0x7f48d4154520 2023-11-28T20:02:26.029 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:26.024+0000 7f48dc432640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48d413f3f0 con 0x7f48d40a6370 2023-11-28T20:02:26.029 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:26.024+0000 7f48dc432640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f48d413ed50 con 0x7f48d4151e80 2023-11-28T20:02:26.029 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:26.024+0000 7f48da9cf640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f48d4154520 0x7f48d41409c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:02:26.029 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:26.024+0000 7f48da9cf640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f48d4154520 0x7f48d41409c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:58546/0 (socket says 172.21.15.78:58546) 2023-11-28T20:02:26.029 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:26.024+0000 7f48da9cf640 1 -- 172.21.15.78:0/2846689269 learned_addr learned my addr 172.21.15.78:0/2846689269 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T20:02:26.029 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:26.024+0000 7f48da1ce640 1 --2- 172.21.15.78:0/2846689269 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f48d40a6370 0x7f48d4153cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:02:26.029 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:26.024+0000 7f48d99cd640 1 --2- 172.21.15.78:0/2846689269 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f48d4151e80 0x7f48d413d650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:02:26.029 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:26.024+0000 7f48da9cf640 1 -- 172.21.15.78:0/2846689269 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f48d4151e80 msgr2=0x7f48d413d650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:02:26.029 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:26.024+0000 7f48da9cf640 1 --2- 172.21.15.78:0/2846689269 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f48d4151e80 0x7f48d413d650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:26.030 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:26.024+0000 7f48da9cf640 1 -- 172.21.15.78:0/2846689269 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f48d40a6370 msgr2=0x7f48d4153cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:02:26.030 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:26.024+0000 7f48da9cf640 1 --2- 172.21.15.78:0/2846689269 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f48d40a6370 0x7f48d4153cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:26.030 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:26.024+0000 7f48da9cf640 1 -- 172.21.15.78:0/2846689269 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48d0009420 con 0x7f48d4154520 2023-11-28T20:02:26.030 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:26.024+0000 7f48da1ce640 1 --2- 172.21.15.78:0/2846689269 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f48d40a6370 0x7f48d4153cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T20:02:26.030 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:26.024+0000 7f48da9cf640 1 --2- 172.21.15.78:0/2846689269 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f48d4154520 0x7f48d41409c0 secure :-1 s=READY pgs=954 cs=0 l=1 rev1=1 crypto rx=0x7f48cc00c7a0 tx=0x7f48cc00cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:02:26.031 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:26.024+0000 7f48caffd640 1 -- 172.21.15.78:0/2846689269 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48cc003b80 con 0x7f48d4154520 2023-11-28T20:02:26.031 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:26.024+0000 7f48caffd640 1 -- 172.21.15.78:0/2846689269 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f48cc003ce0 con 0x7f48d4154520 2023-11-28T20:02:26.031 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:26.024+0000 7f48dc432640 1 -- 172.21.15.78:0/2846689269 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f48d413ea10 con 0x7f48d4154520 2023-11-28T20:02:26.031 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:26.024+0000 7f48caffd640 1 -- 172.21.15.78:0/2846689269 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48cc00aa30 con 0x7f48d4154520 2023-11-28T20:02:26.031 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:26.024+0000 7f48dc432640 1 -- 172.21.15.78:0/2846689269 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f48d413f110 con 0x7f48d4154520 2023-11-28T20:02:26.031 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:26.024+0000 7f48dc432640 1 -- 172.21.15.78:0/2846689269 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f48d413eba0 con 0x7f48d4154520 2023-11-28T20:02:26.031 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:26.028+0000 7f48caffd640 1 -- 172.21.15.78:0/2846689269 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f48cc00ab90 con 0x7f48d4154520 2023-11-28T20:02:26.032 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:26.028+0000 7f48caffd640 1 --2- 172.21.15.78:0/2846689269 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f48b8066470 0x7f48b8068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:26.032 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:26.028+0000 7f48caffd640 1 -- 172.21.15.78:0/2846689269 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6885+0+0 (secure 0 0 0) 0x7f48cc0840c0 con 0x7f48d4154520 2023-11-28T20:02:26.032 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:26.028+0000 7f48da1ce640 1 --2- 172.21.15.78:0/2846689269 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f48b8066470 0x7f48b8068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:02:26.032 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:26.028+0000 7f48da1ce640 1 --2- 172.21.15.78:0/2846689269 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f48b8066470 0x7f48b8068930 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f48d00ad000 tx=0x7f48d00a6000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:02:26.036 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:26.032+0000 7f48caffd640 1 -- 172.21.15.78:0/2846689269 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f48cc051130 con 0x7f48d4154520 2023-11-28T20:02:26.187 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:26.180+0000 7f48dc432640 1 -- 172.21.15.78:0/2846689269 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f48d4067630 con 0x7f48d4154520 2023-11-28T20:02:26.188 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:26.184+0000 7f48caffd640 1 -- 172.21.15.78:0/2846689269 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v84) v1 ==== 74+0+20352 (secure 0 0 0) 0x7f48cc054750 con 0x7f48d4154520 2023-11-28T20:02:26.188 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-11-28T20:02:26.188 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":84,"fsid":"dd9780e8-3bda-44fa-a9f0-fa07d19d901d","created":"2023-11-28T19:58:40.969556+0000","modified":"2023-11-28T20:02:25.230830+0000","last_up_change":"2023-11-28T19:58:52.596716+0000","last_in_change":"2023-11-28T19:58:43.609275+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":16,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-28T19:58:54.011229+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_metadata","create_time":"2023-11-28T20:02:05.787820+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs_data","create_time":"2023-11-28T20:02:06.652305+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs2_metadata","create_time":"2023-11-28T20:02:23.066724+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":16,"pool_name":"cephfs2_data","create_time":"2023-11-28T20:02:24.230614+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs2"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e84245ac-b5da-429e-af18-39acaa2b33e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6800","nonce":3358701235},{"type":"v1","addr":"172.21.15.78:6801","nonce":3358701235}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6802","nonce":3358701235},{"type":"v1","addr":"172.21.15.78:6803","nonce":3358701235}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6806","nonce":3358701235},{"type":"v1","addr":"172.21.15.78:6807","nonce":3358701235}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6804","nonce":3358701235},{"type":"v1","addr":"172.21.15.78:6805","nonce":3358701235}]},"public_addr":"172.21.15.78:6801/3358701235","cluster_addr":"172.21.15.78:6803/3358701235","heartbeat_back_addr":"172.21.15.78:6807/3358701235","heartbeat_front_addr":"172.21.15.78:6805/3358701235","state":["exists","up"]},{"osd":1,"uuid":"e634831d-c4e2-48d9-870c-9556ae162981","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6808","nonce":3211476654},{"type":"v1","addr":"172.21.15.78:6809","nonce":3211476654}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6810","nonce":3211476654},{"type":"v1","addr":"172.21.15.78:6811","nonce":3211476654}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6814","nonce":3211476654},{"type":"v1","addr":"172.21.15.78:6815","nonce":3211476654}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6812","nonce":3211476654},{"type":"v1","addr":"172.21.15.78:6813","nonce":3211476654}]},"public_addr":"172.21.15.78:6809/3211476654","cluster_addr":"172.21.15.78:6811/3211476654","heartbeat_back_addr":"172.21.15.78:6815/3211476654","heartbeat_front_addr":"172.21.15.78:6813/3211476654","state":["exists","up"]},{"osd":2,"uuid":"274c8395-6534-41f0-b8fb-a00af8985aa8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6816","nonce":2532904479},{"type":"v1","addr":"172.21.15.78:6817","nonce":2532904479}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6818","nonce":2532904479},{"type":"v1","addr":"172.21.15.78:6819","nonce":2532904479}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6822","nonce":2532904479},{"type":"v1","addr":"172.21.15.78:6823","nonce":2532904479}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6820","nonce":2532904479},{"type":"v1","addr":"172.21.15.78:6821","nonce":2532904479}]},"public_addr":"172.21.15.78:6817/2532904479","cluster_addr":"172.21.15.78:6819/2532904479","heartbeat_back_addr":"172.21.15.78:6823/2532904479","heartbeat_front_addr":"172.21.15.78:6821/2532904479","state":["exists","up"]},{"osd":3,"uuid":"77acc9af-7d4d-4b18-8cf5-d62f5971b7c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6824","nonce":3442991267},{"type":"v1","addr":"172.21.15.78:6825","nonce":3442991267}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6826","nonce":3442991267},{"type":"v1","addr":"172.21.15.78:6827","nonce":3442991267}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6830","nonce":3442991267},{"type":"v1","addr":"172.21.15.78:6831","nonce":3442991267}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6828","nonce":3442991267},{"type":"v1","addr":"172.21.15.78:6829","nonce":3442991267}]},"public_addr":"172.21.15.78:6825/3442991267","cluster_addr":"172.21.15.78:6827/3442991267","heartbeat_back_addr":"172.21.15.78:6831/3442991267","heartbeat_front_addr":"172.21.15.78:6829/3442991267","state":["exists","up"]},{"osd":4,"uuid":"5c62bc66-6b34-4b7f-a66b-9a743969138c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":802983577},{"type":"v1","addr":"172.21.15.179:6809","nonce":802983577}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":802983577},{"type":"v1","addr":"172.21.15.179:6811","nonce":802983577}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":802983577},{"type":"v1","addr":"172.21.15.179:6815","nonce":802983577}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":802983577},{"type":"v1","addr":"172.21.15.179:6813","nonce":802983577}]},"public_addr":"172.21.15.179:6809/802983577","cluster_addr":"172.21.15.179:6811/802983577","heartbeat_back_addr":"172.21.15.179:6815/802983577","heartbeat_front_addr":"172.21.15.179:6813/802983577","state":["exists","up"]},{"osd":5,"uuid":"67db6d36-f684-4079-b0cd-82b4dd61461f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":518192887},{"type":"v1","addr":"172.21.15.179:6818","nonce":518192887}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":518192887},{"type":"v1","addr":"172.21.15.179:6822","nonce":518192887}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":518192887},{"type":"v1","addr":"172.21.15.179:6829","nonce":518192887}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6824","nonce":518192887},{"type":"v1","addr":"172.21.15.179:6826","nonce":518192887}]},"public_addr":"172.21.15.179:6818/518192887","cluster_addr":"172.21.15.179:6822/518192887","heartbeat_back_addr":"172.21.15.179:6829/518192887","heartbeat_front_addr":"172.21.15.179:6826/518192887","state":["exists","up"]},{"osd":6,"uuid":"12e670af-5a16-4c81-9f97-defa66cab967","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":815435378},{"type":"v1","addr":"172.21.15.179:6801","nonce":815435378}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":815435378},{"type":"v1","addr":"172.21.15.179:6803","nonce":815435378}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":815435378},{"type":"v1","addr":"172.21.15.179:6807","nonce":815435378}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":815435378},{"type":"v1","addr":"172.21.15.179:6805","nonce":815435378}]},"public_addr":"172.21.15.179:6801/815435378","cluster_addr":"172.21.15.179:6803/815435378","heartbeat_back_addr":"172.21.15.179:6807/815435378","heartbeat_front_addr":"172.21.15.179:6805/815435378","state":["exists","up"]},{"osd":7,"uuid":"fe630650-2eb3-49ad-8676-c341e6332eb1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6817","nonce":2848432339},{"type":"v1","addr":"172.21.15.179:6819","nonce":2848432339}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6821","nonce":2848432339},{"type":"v1","addr":"172.21.15.179:6823","nonce":2848432339}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":2848432339},{"type":"v1","addr":"172.21.15.179:6831","nonce":2848432339}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6825","nonce":2848432339},{"type":"v1","addr":"172.21.15.179:6827","nonce":2848432339}]},"public_addr":"172.21.15.179:6819/2848432339","cluster_addr":"172.21.15.179:6823/2848432339","heartbeat_back_addr":"172.21.15.179:6831/2848432339","heartbeat_front_addr":"172.21.15.179:6827/2848432339","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:58:49.255433+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:58:49.412880+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:58:49.559295+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:58:49.245237+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:58:49.184557+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:58:49.329851+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:58:49.366012+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:58:49.349604+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-28T20:02:26.191 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:26.184+0000 7f48dc432640 1 -- 172.21.15.78:0/2846689269 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f48b8066470 msgr2=0x7f48b8068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:02:26.191 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:26.184+0000 7f48dc432640 1 --2- 172.21.15.78:0/2846689269 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f48b8066470 0x7f48b8068930 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f48d00ad000 tx=0x7f48d00a6000 comp rx=0 tx=0).stop 2023-11-28T20:02:26.191 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:26.184+0000 7f48dc432640 1 -- 172.21.15.78:0/2846689269 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f48d4154520 msgr2=0x7f48d41409c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:02:26.191 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:26.184+0000 7f48dc432640 1 --2- 172.21.15.78:0/2846689269 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f48d4154520 0x7f48d41409c0 secure :-1 s=READY pgs=954 cs=0 l=1 rev1=1 crypto rx=0x7f48cc00c7a0 tx=0x7f48cc00cc60 comp rx=0 tx=0).stop 2023-11-28T20:02:26.191 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:26.184+0000 7f48dc432640 1 -- 172.21.15.78:0/2846689269 shutdown_connections 2023-11-28T20:02:26.191 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:26.184+0000 7f48dc432640 1 --2- 172.21.15.78:0/2846689269 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f48b8066470 0x7f48b8068930 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:26.192 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:26.184+0000 7f48dc432640 1 --2- 172.21.15.78:0/2846689269 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f48d4151e80 0x7f48d413d650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:26.192 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:26.184+0000 7f48dc432640 1 --2- 172.21.15.78:0/2846689269 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f48d4154520 0x7f48d41409c0 unknown :-1 s=CLOSED pgs=954 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:26.192 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:26.184+0000 7f48dc432640 1 --2- 172.21.15.78:0/2846689269 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f48d40a6370 0x7f48d4153cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:26.192 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:26.184+0000 7f48dc432640 1 -- 172.21.15.78:0/2846689269 >> 172.21.15.78:0/2846689269 conn(0x7f48d40a8990 msgr2=0x7f48d4148f90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:02:26.192 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:26.184+0000 7f48dc432640 1 -- 172.21.15.78:0/2846689269 shutdown_connections 2023-11-28T20:02:26.192 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:26.184+0000 7f48dc432640 1 -- 172.21.15.78:0/2846689269 wait complete. 2023-11-28T20:02:26.210 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-28T20:02:26.347 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:26.344+0000 7f4827faa640 1 Processor -- start 2023-11-28T20:02:26.348 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:26.344+0000 7f4827faa640 1 -- start start 2023-11-28T20:02:26.349 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:26.344+0000 7f4827faa640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f48200af4c0 0x7f4820154f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:26.349 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:26.344+0000 7f4827faa640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f482006c100 0x7f48200c6c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:26.349 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:26.344+0000 7f4827faa640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f48200c4890 con 0x7f48200c67d0 2023-11-28T20:02:26.350 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:26.344+0000 7f4827faa640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4820155460 con 0x7f482006c100 2023-11-28T20:02:26.350 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:26.344+0000 7f4827faa640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f48200af8a0 con 0x7f48200af4c0 2023-11-28T20:02:26.350 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:26.344+0000 7f4826547640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f482006c100 0x7f48200c6c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:02:26.350 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:26.344+0000 7f4825545640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f48200c67d0 0x7f482006b9f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:55670/0 (socket says 172.21.15.78:55670) 2023-11-28T20:02:26.350 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:26.344+0000 7f4825545640 1 -- 172.21.15.78:0/529519603 learned_addr learned my addr 172.21.15.78:0/529519603 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-11-28T20:02:26.350 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:26.344+0000 7f4825d46640 1 --2- 172.21.15.78:0/529519603 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f48200af4c0 0x7f4820154f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:02:26.350 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:26.344+0000 7f4826547640 1 -- 172.21.15.78:0/529519603 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f48200af4c0 msgr2=0x7f4820154f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:02:26.350 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:26.344+0000 7f4826547640 1 --2- 172.21.15.78:0/529519603 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f48200af4c0 0x7f4820154f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:26.350 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:26.344+0000 7f4826547640 1 -- 172.21.15.78:0/529519603 >> v1:172.21.15.78:6789/0 conn(0x7f48200c67d0 legacy=0x7f482006b9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:02:26.350 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:26.344+0000 7f4826547640 1 -- 172.21.15.78:0/529519603 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48200c4b30 con 0x7f482006c100 2023-11-28T20:02:26.350 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:26.344+0000 7f4824d44640 1 -- 172.21.15.78:0/529519603 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2308733942 0 0) 0x7f48200c4890 con 0x7f48200c67d0 2023-11-28T20:02:26.351 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:26.344+0000 7f4825d46640 1 --2- 172.21.15.78:0/529519603 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f48200af4c0 0x7f4820154f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T20:02:26.352 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:26.348+0000 7f4826547640 1 --2- 172.21.15.78:0/529519603 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f482006c100 0x7f48200c6c50 secure :-1 s=READY pgs=956 cs=0 l=1 rev1=1 crypto rx=0x7f4818009d90 tx=0x7f481801c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=120a552780902813 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:02:26.353 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:26.348+0000 7f4824d44640 1 -- 172.21.15.78:0/529519603 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48180a5950 con 0x7f482006c100 2023-11-28T20:02:26.353 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:26.348+0000 7f4824d44640 1 -- 172.21.15.78:0/529519603 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f48180a5ab0 con 0x7f482006c100 2023-11-28T20:02:26.353 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:26.348+0000 7f4824d44640 1 -- 172.21.15.78:0/529519603 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48180a5e40 con 0x7f482006c100 2023-11-28T20:02:26.354 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:26.348+0000 7f4827faa640 1 -- 172.21.15.78:0/529519603 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f482006c100 msgr2=0x7f48200c6c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:02:26.354 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:26.348+0000 7f4827faa640 1 --2- 172.21.15.78:0/529519603 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f482006c100 0x7f48200c6c50 secure :-1 s=READY pgs=956 cs=0 l=1 rev1=1 crypto rx=0x7f4818009d90 tx=0x7f481801c890 comp rx=0 tx=0).stop 2023-11-28T20:02:26.354 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:26.348+0000 7f4827faa640 1 -- 172.21.15.78:0/529519603 shutdown_connections 2023-11-28T20:02:26.354 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:26.348+0000 7f4827faa640 1 --2- 172.21.15.78:0/529519603 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f482006c100 0x7f48200c6c50 unknown :-1 s=CLOSED pgs=956 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:26.354 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:26.348+0000 7f4827faa640 1 --2- 172.21.15.78:0/529519603 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f48200af4c0 0x7f4820154f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:26.354 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:26.348+0000 7f4827faa640 1 -- 172.21.15.78:0/529519603 >> 172.21.15.78:0/529519603 conn(0x7f48200ab9d0 msgr2=0x7f48200abde0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:02:26.354 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:26.348+0000 7f4827faa640 1 -- 172.21.15.78:0/529519603 shutdown_connections 2023-11-28T20:02:26.355 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:26.348+0000 7f4827faa640 1 -- 172.21.15.78:0/529519603 wait complete. 2023-11-28T20:02:26.355 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:26.352+0000 7f4827faa640 1 Processor -- start 2023-11-28T20:02:26.355 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:26.352+0000 7f4827faa640 1 -- start start 2023-11-28T20:02:26.358 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:26.352+0000 7f4827faa640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f482006c100 0x7f482015e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:26.358 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:26.352+0000 7f4827faa640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f48200af4c0 0x7f48201efdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:26.358 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:26.352+0000 7f4827faa640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f48200c67d0 0x7f48201f0330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:26.358 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:26.352+0000 7f4827faa640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f482015d5f0 con 0x7f48200c67d0 2023-11-28T20:02:26.358 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:26.352+0000 7f4827faa640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48200cab80 con 0x7f48200af4c0 2023-11-28T20:02:26.358 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:26.352+0000 7f4827faa640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f48200bdf00 con 0x7f482006c100 2023-11-28T20:02:26.358 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:26.352+0000 7f4826547640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f48200c67d0 0x7f48201f0330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:02:26.359 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:26.352+0000 7f4826547640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f48200c67d0 0x7f48201f0330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:58558/0 (socket says 172.21.15.78:58558) 2023-11-28T20:02:26.359 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:26.352+0000 7f4826547640 1 -- 172.21.15.78:0/3698375806 learned_addr learned my addr 172.21.15.78:0/3698375806 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T20:02:26.359 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:26.352+0000 7f4825d46640 1 --2- 172.21.15.78:0/3698375806 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f482006c100 0x7f482015e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:02:26.359 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:26.352+0000 7f4825545640 1 --2- 172.21.15.78:0/3698375806 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f48200af4c0 0x7f48201efdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:02:26.359 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:26.352+0000 7f4826547640 1 -- 172.21.15.78:0/3698375806 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f482006c100 msgr2=0x7f482015e340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:02:26.359 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:26.352+0000 7f4826547640 1 --2- 172.21.15.78:0/3698375806 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f482006c100 0x7f482015e340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:26.359 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:26.352+0000 7f4826547640 1 -- 172.21.15.78:0/3698375806 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f48200af4c0 msgr2=0x7f48201efdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:02:26.359 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:26.352+0000 7f4826547640 1 --2- 172.21.15.78:0/3698375806 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f48200af4c0 0x7f48201efdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:26.359 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:26.352+0000 7f4826547640 1 -- 172.21.15.78:0/3698375806 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4818009a70 con 0x7f48200c67d0 2023-11-28T20:02:26.360 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:26.352+0000 7f4825d46640 1 --2- 172.21.15.78:0/3698375806 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f482006c100 0x7f482015e340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T20:02:26.360 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:26.352+0000 7f4826547640 1 --2- 172.21.15.78:0/3698375806 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f48200c67d0 0x7f48201f0330 secure :-1 s=READY pgs=957 cs=0 l=1 rev1=1 crypto rx=0x7f481801af40 tx=0x7f4818019630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:02:26.360 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:26.352+0000 7f48167fc640 1 -- 172.21.15.78:0/3698375806 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48180ade40 con 0x7f48200c67d0 2023-11-28T20:02:26.360 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:26.352+0000 7f48167fc640 1 -- 172.21.15.78:0/3698375806 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4818009450 con 0x7f48200c67d0 2023-11-28T20:02:26.360 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:26.352+0000 7f48167fc640 1 -- 172.21.15.78:0/3698375806 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48180b9670 con 0x7f48200c67d0 2023-11-28T20:02:26.360 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:26.352+0000 7f4827faa640 1 -- 172.21.15.78:0/3698375806 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f48200ca910 con 0x7f48200c67d0 2023-11-28T20:02:26.360 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:26.352+0000 7f4827faa640 1 -- 172.21.15.78:0/3698375806 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f482015e880 con 0x7f48200c67d0 2023-11-28T20:02:26.361 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:26.352+0000 7f4827faa640 1 -- 172.21.15.78:0/3698375806 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f48200be070 con 0x7f48200c67d0 2023-11-28T20:02:26.361 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:26.356+0000 7f48167fc640 1 -- 172.21.15.78:0/3698375806 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f48180b97d0 con 0x7f48200c67d0 2023-11-28T20:02:26.361 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:26.356+0000 7f48167fc640 1 --2- 172.21.15.78:0/3698375806 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f4804066470 0x7f4804068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:26.361 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:26.356+0000 7f48167fc640 1 -- 172.21.15.78:0/3698375806 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6885+0+0 (secure 0 0 0) 0x7f481811fbe0 con 0x7f48200c67d0 2023-11-28T20:02:26.362 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:26.356+0000 7f4825d46640 1 --2- 172.21.15.78:0/3698375806 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f4804066470 0x7f4804068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:02:26.362 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:26.356+0000 7f4825d46640 1 --2- 172.21.15.78:0/3698375806 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f4804066470 0x7f4804068930 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f481c009970 tx=0x7f481c008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:02:26.364 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:26.360+0000 7f48167fc640 1 -- 172.21.15.78:0/3698375806 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f48180ecbb0 con 0x7f48200c67d0 2023-11-28T20:02:26.518 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:26.512+0000 7f4827faa640 1 -- 172.21.15.78:0/3698375806 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f4820067630 con 0x7f48200c67d0 2023-11-28T20:02:26.518 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:26.512+0000 7f48167fc640 1 -- 172.21.15.78:0/3698375806 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v84) v1 ==== 74+0+20352 (secure 0 0 0) 0x7f48180f01d0 con 0x7f48200c67d0 2023-11-28T20:02:26.519 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-11-28T20:02:26.519 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":84,"fsid":"dd9780e8-3bda-44fa-a9f0-fa07d19d901d","created":"2023-11-28T19:58:40.969556+0000","modified":"2023-11-28T20:02:25.230830+0000","last_up_change":"2023-11-28T19:58:52.596716+0000","last_in_change":"2023-11-28T19:58:43.609275+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":16,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-28T19:58:54.011229+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_metadata","create_time":"2023-11-28T20:02:05.787820+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs_data","create_time":"2023-11-28T20:02:06.652305+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs2_metadata","create_time":"2023-11-28T20:02:23.066724+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":16,"pool_name":"cephfs2_data","create_time":"2023-11-28T20:02:24.230614+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs2"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e84245ac-b5da-429e-af18-39acaa2b33e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6800","nonce":3358701235},{"type":"v1","addr":"172.21.15.78:6801","nonce":3358701235}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6802","nonce":3358701235},{"type":"v1","addr":"172.21.15.78:6803","nonce":3358701235}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6806","nonce":3358701235},{"type":"v1","addr":"172.21.15.78:6807","nonce":3358701235}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6804","nonce":3358701235},{"type":"v1","addr":"172.21.15.78:6805","nonce":3358701235}]},"public_addr":"172.21.15.78:6801/3358701235","cluster_addr":"172.21.15.78:6803/3358701235","heartbeat_back_addr":"172.21.15.78:6807/3358701235","heartbeat_front_addr":"172.21.15.78:6805/3358701235","state":["exists","up"]},{"osd":1,"uuid":"e634831d-c4e2-48d9-870c-9556ae162981","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6808","nonce":3211476654},{"type":"v1","addr":"172.21.15.78:6809","nonce":3211476654}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6810","nonce":3211476654},{"type":"v1","addr":"172.21.15.78:6811","nonce":3211476654}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6814","nonce":3211476654},{"type":"v1","addr":"172.21.15.78:6815","nonce":3211476654}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6812","nonce":3211476654},{"type":"v1","addr":"172.21.15.78:6813","nonce":3211476654}]},"public_addr":"172.21.15.78:6809/3211476654","cluster_addr":"172.21.15.78:6811/3211476654","heartbeat_back_addr":"172.21.15.78:6815/3211476654","heartbeat_front_addr":"172.21.15.78:6813/3211476654","state":["exists","up"]},{"osd":2,"uuid":"274c8395-6534-41f0-b8fb-a00af8985aa8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6816","nonce":2532904479},{"type":"v1","addr":"172.21.15.78:6817","nonce":2532904479}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6818","nonce":2532904479},{"type":"v1","addr":"172.21.15.78:6819","nonce":2532904479}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6822","nonce":2532904479},{"type":"v1","addr":"172.21.15.78:6823","nonce":2532904479}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6820","nonce":2532904479},{"type":"v1","addr":"172.21.15.78:6821","nonce":2532904479}]},"public_addr":"172.21.15.78:6817/2532904479","cluster_addr":"172.21.15.78:6819/2532904479","heartbeat_back_addr":"172.21.15.78:6823/2532904479","heartbeat_front_addr":"172.21.15.78:6821/2532904479","state":["exists","up"]},{"osd":3,"uuid":"77acc9af-7d4d-4b18-8cf5-d62f5971b7c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6824","nonce":3442991267},{"type":"v1","addr":"172.21.15.78:6825","nonce":3442991267}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6826","nonce":3442991267},{"type":"v1","addr":"172.21.15.78:6827","nonce":3442991267}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6830","nonce":3442991267},{"type":"v1","addr":"172.21.15.78:6831","nonce":3442991267}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6828","nonce":3442991267},{"type":"v1","addr":"172.21.15.78:6829","nonce":3442991267}]},"public_addr":"172.21.15.78:6825/3442991267","cluster_addr":"172.21.15.78:6827/3442991267","heartbeat_back_addr":"172.21.15.78:6831/3442991267","heartbeat_front_addr":"172.21.15.78:6829/3442991267","state":["exists","up"]},{"osd":4,"uuid":"5c62bc66-6b34-4b7f-a66b-9a743969138c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":802983577},{"type":"v1","addr":"172.21.15.179:6809","nonce":802983577}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":802983577},{"type":"v1","addr":"172.21.15.179:6811","nonce":802983577}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":802983577},{"type":"v1","addr":"172.21.15.179:6815","nonce":802983577}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":802983577},{"type":"v1","addr":"172.21.15.179:6813","nonce":802983577}]},"public_addr":"172.21.15.179:6809/802983577","cluster_addr":"172.21.15.179:6811/802983577","heartbeat_back_addr":"172.21.15.179:6815/802983577","heartbeat_front_addr":"172.21.15.179:6813/802983577","state":["exists","up"]},{"osd":5,"uuid":"67db6d36-f684-4079-b0cd-82b4dd61461f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":518192887},{"type":"v1","addr":"172.21.15.179:6818","nonce":518192887}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":518192887},{"type":"v1","addr":"172.21.15.179:6822","nonce":518192887}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":518192887},{"type":"v1","addr":"172.21.15.179:6829","nonce":518192887}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6824","nonce":518192887},{"type":"v1","addr":"172.21.15.179:6826","nonce":518192887}]},"public_addr":"172.21.15.179:6818/518192887","cluster_addr":"172.21.15.179:6822/518192887","heartbeat_back_addr":"172.21.15.179:6829/518192887","heartbeat_front_addr":"172.21.15.179:6826/518192887","state":["exists","up"]},{"osd":6,"uuid":"12e670af-5a16-4c81-9f97-defa66cab967","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":815435378},{"type":"v1","addr":"172.21.15.179:6801","nonce":815435378}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":815435378},{"type":"v1","addr":"172.21.15.179:6803","nonce":815435378}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":815435378},{"type":"v1","addr":"172.21.15.179:6807","nonce":815435378}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":815435378},{"type":"v1","addr":"172.21.15.179:6805","nonce":815435378}]},"public_addr":"172.21.15.179:6801/815435378","cluster_addr":"172.21.15.179:6803/815435378","heartbeat_back_addr":"172.21.15.179:6807/815435378","heartbeat_front_addr":"172.21.15.179:6805/815435378","state":["exists","up"]},{"osd":7,"uuid":"fe630650-2eb3-49ad-8676-c341e6332eb1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6817","nonce":2848432339},{"type":"v1","addr":"172.21.15.179:6819","nonce":2848432339}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6821","nonce":2848432339},{"type":"v1","addr":"172.21.15.179:6823","nonce":2848432339}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":2848432339},{"type":"v1","addr":"172.21.15.179:6831","nonce":2848432339}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6825","nonce":2848432339},{"type":"v1","addr":"172.21.15.179:6827","nonce":2848432339}]},"public_addr":"172.21.15.179:6819/2848432339","cluster_addr":"172.21.15.179:6823/2848432339","heartbeat_back_addr":"172.21.15.179:6831/2848432339","heartbeat_front_addr":"172.21.15.179:6827/2848432339","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:58:49.255433+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:58:49.412880+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:58:49.559295+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:58:49.245237+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:58:49.184557+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:58:49.329851+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:58:49.366012+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:58:49.349604+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-28T20:02:26.520 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:26.512+0000 7f4827faa640 1 -- 172.21.15.78:0/3698375806 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f4804066470 msgr2=0x7f4804068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:02:26.520 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:26.512+0000 7f4827faa640 1 --2- 172.21.15.78:0/3698375806 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f4804066470 0x7f4804068930 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f481c009970 tx=0x7f481c008040 comp rx=0 tx=0).stop 2023-11-28T20:02:26.520 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:26.512+0000 7f4827faa640 1 -- 172.21.15.78:0/3698375806 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f48200c67d0 msgr2=0x7f48201f0330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:02:26.520 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:26.512+0000 7f4827faa640 1 --2- 172.21.15.78:0/3698375806 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f48200c67d0 0x7f48201f0330 secure :-1 s=READY pgs=957 cs=0 l=1 rev1=1 crypto rx=0x7f481801af40 tx=0x7f4818019630 comp rx=0 tx=0).stop 2023-11-28T20:02:26.520 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:26.512+0000 7f4827faa640 1 -- 172.21.15.78:0/3698375806 shutdown_connections 2023-11-28T20:02:26.520 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:26.512+0000 7f4827faa640 1 --2- 172.21.15.78:0/3698375806 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f4804066470 0x7f4804068930 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:26.520 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:26.512+0000 7f4827faa640 1 --2- 172.21.15.78:0/3698375806 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f48200c67d0 0x7f48201f0330 unknown :-1 s=CLOSED pgs=957 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:26.520 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:26.512+0000 7f4827faa640 1 --2- 172.21.15.78:0/3698375806 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f48200af4c0 0x7f48201efdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:26.520 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:26.512+0000 7f4827faa640 1 --2- 172.21.15.78:0/3698375806 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f482006c100 0x7f482015e340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:26.520 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:26.512+0000 7f4827faa640 1 -- 172.21.15.78:0/3698375806 >> 172.21.15.78:0/3698375806 conn(0x7f48200ab9d0 msgr2=0x7f48200ae490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:02:26.521 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:26.512+0000 7f4827faa640 1 -- 172.21.15.78:0/3698375806 shutdown_connections 2023-11-28T20:02:26.521 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:26.512+0000 7f4827faa640 1 -- 172.21.15.78:0/3698375806 wait complete. 2023-11-28T20:02:26.539 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs2 standby_count_wanted 0 2023-11-28T20:02:26.679 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:26.672+0000 7f561ddd1640 1 Processor -- start 2023-11-28T20:02:26.679 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:26.672+0000 7f561ddd1640 1 -- start start 2023-11-28T20:02:26.680 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:26.676+0000 7f561ddd1640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f561814e2a0 0x7f56181516a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:26.680 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:26.676+0000 7f561ddd1640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f56180a9910 0x7f561806bc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:26.680 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:26.676+0000 7f561ddd1640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5618151210 con 0x7f56180a9460 2023-11-28T20:02:26.680 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:26.676+0000 7f561ddd1640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f561814e680 con 0x7f561814e2a0 2023-11-28T20:02:26.680 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:26.676+0000 7f561ddd1640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5618150be0 con 0x7f56180a9910 2023-11-28T20:02:26.681 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:26.676+0000 7f5617fff640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f56180a9910 0x7f561806bc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:02:26.681 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:26.676+0000 7f5617fff640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f56180a9910 0x7f561806bc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3301/0 says I am v2:172.21.15.78:35370/0 (socket says 172.21.15.78:35370) 2023-11-28T20:02:26.681 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:26.676+0000 7f56177fe640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f561814e2a0 0x7f56181516a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:02:26.681 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:26.676+0000 7f5617fff640 1 -- 172.21.15.78:0/3417107831 learned_addr learned my addr 172.21.15.78:0/3417107831 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T20:02:26.681 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:26.676+0000 7f5617fff640 1 -- 172.21.15.78:0/3417107831 >> v2:172.21.15.179:3300/0 conn(0x7f561814e2a0 msgr2=0x7f56181516a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:02:26.681 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:26.676+0000 7f5617fff640 1 --2- 172.21.15.78:0/3417107831 >> v2:172.21.15.179:3300/0 conn(0x7f561814e2a0 0x7f56181516a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:26.682 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:26.676+0000 7f5617fff640 1 -- 172.21.15.78:0/3417107831 >> v1:172.21.15.179:6789/0 conn(0x7f56180a9460 legacy=0x7f56180c4180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:02:26.682 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:26.676+0000 7f5617fff640 1 -- 172.21.15.78:0/3417107831 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56180c53c0 con 0x7f56180a9910 2023-11-28T20:02:26.684 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:26.680+0000 7f5617fff640 1 --2- 172.21.15.78:0/3417107831 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f56180a9910 0x7f561806bc80 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f561000af60 tx=0x7f561001db10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9657f2d7f6b32032 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:02:26.684 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:26.680+0000 7f56167fc640 1 -- 172.21.15.78:0/3417107831 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f561000a2d0 con 0x7f56180a9910 2023-11-28T20:02:26.684 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:26.680+0000 7f56167fc640 1 -- 172.21.15.78:0/3417107831 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f56100a6770 con 0x7f56180a9910 2023-11-28T20:02:26.684 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:26.680+0000 7f56167fc640 1 -- 172.21.15.78:0/3417107831 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56100a6b00 con 0x7f56180a9910 2023-11-28T20:02:26.685 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:26.680+0000 7f561ddd1640 1 -- 172.21.15.78:0/3417107831 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f56180a9910 msgr2=0x7f561806bc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:02:26.685 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:26.680+0000 7f561ddd1640 1 --2- 172.21.15.78:0/3417107831 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f56180a9910 0x7f561806bc80 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f561000af60 tx=0x7f561001db10 comp rx=0 tx=0).stop 2023-11-28T20:02:26.685 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:26.680+0000 7f561ddd1640 1 -- 172.21.15.78:0/3417107831 shutdown_connections 2023-11-28T20:02:26.685 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:26.680+0000 7f561ddd1640 1 --2- 172.21.15.78:0/3417107831 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f56180a9910 0x7f561806bc80 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:26.685 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:26.680+0000 7f561ddd1640 1 --2- 172.21.15.78:0/3417107831 >> v2:172.21.15.179:3300/0 conn(0x7f561814e2a0 0x7f56181516a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:26.685 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:26.680+0000 7f561ddd1640 1 -- 172.21.15.78:0/3417107831 >> 172.21.15.78:0/3417107831 conn(0x7f56180c59f0 msgr2=0x7f56180c5e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:02:26.685 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:26.680+0000 7f561ddd1640 1 -- 172.21.15.78:0/3417107831 shutdown_connections 2023-11-28T20:02:26.685 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:26.680+0000 7f561ddd1640 1 -- 172.21.15.78:0/3417107831 wait complete. 2023-11-28T20:02:26.686 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:26.680+0000 7f561ddd1640 1 Processor -- start 2023-11-28T20:02:26.686 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:26.680+0000 7f561ddd1640 1 -- start start 2023-11-28T20:02:26.689 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:26.684+0000 7f561ddd1640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f56180a9460 0x7f561815e870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:26.689 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:26.684+0000 7f561ddd1640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f56180a9910 0x7f56181f06b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:26.689 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:26.684+0000 7f561ddd1640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f561814e2a0 0x7f56181f0bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:26.689 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:26.684+0000 7f561ddd1640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56180c2190 con 0x7f561814e2a0 2023-11-28T20:02:26.689 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:26.684+0000 7f561ddd1640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56181f0290 con 0x7f56180a9460 2023-11-28T20:02:26.689 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:26.684+0000 7f561ddd1640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f561814d270 con 0x7f56180a9910 2023-11-28T20:02:26.689 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:26.684+0000 7f5617fff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f561814e2a0 0x7f56181f0bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:02:26.689 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:26.684+0000 7f5617fff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f561814e2a0 0x7f56181f0bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:58572/0 (socket says 172.21.15.78:58572) 2023-11-28T20:02:26.689 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:26.684+0000 7f5617fff640 1 -- 172.21.15.78:0/2860424510 learned_addr learned my addr 172.21.15.78:0/2860424510 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T20:02:26.689 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:26.684+0000 7f56177fe640 1 --2- 172.21.15.78:0/2860424510 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f56180a9460 0x7f561815e870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:02:26.690 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:26.684+0000 7f5616ffd640 1 --2- 172.21.15.78:0/2860424510 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f56180a9910 0x7f56181f06b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:02:26.690 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:26.684+0000 7f5617fff640 1 -- 172.21.15.78:0/2860424510 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f56180a9910 msgr2=0x7f56181f06b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:02:26.690 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:26.684+0000 7f5617fff640 1 --2- 172.21.15.78:0/2860424510 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f56180a9910 0x7f56181f06b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:26.690 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:26.684+0000 7f5617fff640 1 -- 172.21.15.78:0/2860424510 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f56180a9460 msgr2=0x7f561815e870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:02:26.690 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:26.684+0000 7f5617fff640 1 --2- 172.21.15.78:0/2860424510 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f56180a9460 0x7f561815e870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:26.690 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:26.684+0000 7f5617fff640 1 -- 172.21.15.78:0/2860424510 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f561000ac40 con 0x7f561814e2a0 2023-11-28T20:02:26.690 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:26.684+0000 7f5617fff640 1 --2- 172.21.15.78:0/2860424510 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f561814e2a0 0x7f56181f0bf0 secure :-1 s=READY pgs=958 cs=0 l=1 rev1=1 crypto rx=0x7f561001b740 tx=0x7f561001a8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:02:26.690 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:26.684+0000 7f55fffff640 1 -- 172.21.15.78:0/2860424510 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56100a6e70 con 0x7f561814e2a0 2023-11-28T20:02:26.690 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:26.684+0000 7f55fffff640 1 -- 172.21.15.78:0/2860424510 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5610008500 con 0x7f561814e2a0 2023-11-28T20:02:26.690 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:26.684+0000 7f55fffff640 1 -- 172.21.15.78:0/2860424510 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56100088b0 con 0x7f561814e2a0 2023-11-28T20:02:26.690 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:26.684+0000 7f561ddd1640 1 -- 172.21.15.78:0/2860424510 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f561814d4a0 con 0x7f561814e2a0 2023-11-28T20:02:26.691 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:26.684+0000 7f561ddd1640 1 -- 172.21.15.78:0/2860424510 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f561815edb0 con 0x7f561814e2a0 2023-11-28T20:02:26.691 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:26.684+0000 7f561ddd1640 1 -- 172.21.15.78:0/2860424510 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f56181f03d0 con 0x7f561814e2a0 2023-11-28T20:02:26.692 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:26.684+0000 7f55fffff640 1 -- 172.21.15.78:0/2860424510 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f5610008a10 con 0x7f561814e2a0 2023-11-28T20:02:26.692 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:26.688+0000 7f55fffff640 1 --2- 172.21.15.78:0/2860424510 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f5604066470 0x7f5604068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:26.692 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:26.688+0000 7f55fffff640 1 -- 172.21.15.78:0/2860424510 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6885+0+0 (secure 0 0 0) 0x7f561011f500 con 0x7f561814e2a0 2023-11-28T20:02:26.692 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:26.688+0000 7f56177fe640 1 --2- 172.21.15.78:0/2860424510 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f5604066470 0x7f5604068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:02:26.692 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:26.688+0000 7f56177fe640 1 --2- 172.21.15.78:0/2860424510 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f5604066470 0x7f5604068930 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f56181ea9c0 tx=0x7f5608009190 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:02:26.695 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:26.692+0000 7f55fffff640 1 -- 172.21.15.78:0/2860424510 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f56181f03d0 con 0x7f561814e2a0 2023-11-28T20:02:26.887 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:26.884+0000 7f561ddd1640 1 -- 172.21.15.78:0/2860424510 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs2", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f56181f03d0 con 0x7f561814e2a0 2023-11-28T20:02:27.879 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:27.876+0000 7f55fffff640 1 -- 172.21.15.78:0/2860424510 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs2", "var": "standby_count_wanted", "val": "0"}]=0 v50) v1 ==== 119+0+0 (secure 0 0 0) 0x7f56181f03d0 con 0x7f561814e2a0 2023-11-28T20:02:27.882 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:27.876+0000 7f561ddd1640 1 -- 172.21.15.78:0/2860424510 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f5604066470 msgr2=0x7f5604068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:02:27.882 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:27.876+0000 7f561ddd1640 1 --2- 172.21.15.78:0/2860424510 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f5604066470 0x7f5604068930 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f56181ea9c0 tx=0x7f5608009190 comp rx=0 tx=0).stop 2023-11-28T20:02:27.882 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:27.876+0000 7f561ddd1640 1 -- 172.21.15.78:0/2860424510 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f561814e2a0 msgr2=0x7f56181f0bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:02:27.882 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:27.876+0000 7f561ddd1640 1 --2- 172.21.15.78:0/2860424510 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f561814e2a0 0x7f56181f0bf0 secure :-1 s=READY pgs=958 cs=0 l=1 rev1=1 crypto rx=0x7f561001b740 tx=0x7f561001a8b0 comp rx=0 tx=0).stop 2023-11-28T20:02:27.882 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:27.876+0000 7f561ddd1640 1 -- 172.21.15.78:0/2860424510 shutdown_connections 2023-11-28T20:02:27.882 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:27.876+0000 7f561ddd1640 1 --2- 172.21.15.78:0/2860424510 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f5604066470 0x7f5604068930 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:27.883 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:27.876+0000 7f561ddd1640 1 --2- 172.21.15.78:0/2860424510 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f56180a9910 0x7f56181f06b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:27.883 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:27.876+0000 7f561ddd1640 1 --2- 172.21.15.78:0/2860424510 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f561814e2a0 0x7f56181f0bf0 unknown :-1 s=CLOSED pgs=958 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:27.883 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:27.876+0000 7f561ddd1640 1 --2- 172.21.15.78:0/2860424510 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f56180a9460 0x7f561815e870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:27.883 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:27.876+0000 7f561ddd1640 1 -- 172.21.15.78:0/2860424510 >> 172.21.15.78:0/2860424510 conn(0x7f56180c59f0 msgr2=0x7f561814fd50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:02:27.883 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:27.876+0000 7f561ddd1640 1 -- 172.21.15.78:0/2860424510 shutdown_connections 2023-11-28T20:02:27.883 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:27.876+0000 7f561ddd1640 1 -- 172.21.15.78:0/2860424510 wait complete. 2023-11-28T20:02:27.905 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-11-28T20:02:27.905 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs2 allow_standby_replay false 2023-11-28T20:02:28.052 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:28.048+0000 7f6c79f0f640 1 Processor -- start 2023-11-28T20:02:28.053 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:28.048+0000 7f6c79f0f640 1 -- start start 2023-11-28T20:02:28.055 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:28.048+0000 7f6c79f0f640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f6c74159c40 0x7f6c7415c030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:28.055 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:28.048+0000 7f6c79f0f640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6c740a4e20 con 0x7f6c7414b1e0 2023-11-28T20:02:28.055 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:28.048+0000 7f6c79f0f640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6c740a50e0 con 0x7f6c740c5300 2023-11-28T20:02:28.055 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:28.048+0000 7f6c79f0f640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6c741558d0 con 0x7f6c74159c40 2023-11-28T20:02:28.055 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:28.048+0000 7f6c737fe640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f6c7414b1e0 0x7f6c740c1700 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:55682/0 (socket says 172.21.15.78:55682) 2023-11-28T20:02:28.056 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:28.048+0000 7f6c737fe640 1 -- 172.21.15.78:0/2899292234 learned_addr learned my addr 172.21.15.78:0/2899292234 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-11-28T20:02:28.056 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:28.048+0000 7f6c73fff640 1 --2- 172.21.15.78:0/2899292234 >> v2:172.21.15.179:3300/0 conn(0x7f6c74159c40 0x7f6c7415c030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:02:28.056 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:28.048+0000 7f6c727fc640 1 -- 172.21.15.78:0/2899292234 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 140726209 0 0) 0x7f6c740a4e20 con 0x7f6c7414b1e0 2023-11-28T20:02:28.056 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:28.048+0000 7f6c727fc640 1 -- 172.21.15.78:0/2899292234 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6c5c003530 con 0x7f6c7414b1e0 2023-11-28T20:02:28.056 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:28.048+0000 7f6c727fc640 1 -- 172.21.15.78:0/2899292234 <== mon.0 v1:172.21.15.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2329807418 0 0) 0x7f6c5c003530 con 0x7f6c7414b1e0 2023-11-28T20:02:28.056 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:28.048+0000 7f6c73fff640 1 -- 172.21.15.78:0/2899292234 >> v1:172.21.15.179:6789/0 conn(0x7f6c740c5300 legacy=0x7f6c740a9c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:02:28.057 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:28.048+0000 7f6c73fff640 1 -- 172.21.15.78:0/2899292234 >> v1:172.21.15.78:6789/0 conn(0x7f6c7414b1e0 legacy=0x7f6c740c1700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:02:28.057 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:28.048+0000 7f6c73fff640 1 -- 172.21.15.78:0/2899292234 --> v2:172.21.15.179:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c740c0f00 con 0x7f6c74159c40 2023-11-28T20:02:28.058 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:28.052+0000 7f6c73fff640 1 --2- 172.21.15.78:0/2899292234 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6c74159c40 0x7f6c7415c030 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f6c740a5010 tx=0x7f6c6c01c850 comp rx=0 tx=0).ready entity=mon.1 client_cookie=95d16775767b6daf server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:02:28.058 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:28.052+0000 7f6c727fc640 1 -- 172.21.15.78:0/2899292234 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c64001680 con 0x7f6c74159c40 2023-11-28T20:02:28.059 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:28.052+0000 7f6c727fc640 1 -- 172.21.15.78:0/2899292234 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c6c0a55a0 con 0x7f6c74159c40 2023-11-28T20:02:28.059 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:28.052+0000 7f6c727fc640 1 -- 172.21.15.78:0/2899292234 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c6c0a5910 con 0x7f6c74159c40 2023-11-28T20:02:28.059 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:28.052+0000 7f6c79f0f640 1 -- 172.21.15.78:0/2899292234 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6c74159c40 msgr2=0x7f6c7415c030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:02:28.059 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:28.052+0000 7f6c79f0f640 1 --2- 172.21.15.78:0/2899292234 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6c74159c40 0x7f6c7415c030 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f6c740a5010 tx=0x7f6c6c01c850 comp rx=0 tx=0).stop 2023-11-28T20:02:28.059 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:28.052+0000 7f6c79f0f640 1 -- 172.21.15.78:0/2899292234 shutdown_connections 2023-11-28T20:02:28.061 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:28.052+0000 7f6c79f0f640 1 --2- 172.21.15.78:0/2899292234 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6c74159c40 0x7f6c7415c030 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:28.061 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:28.052+0000 7f6c79f0f640 1 -- 172.21.15.78:0/2899292234 >> 172.21.15.78:0/2899292234 conn(0x7f6c740c59f0 msgr2=0x7f6c740c5e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:02:28.061 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:28.052+0000 7f6c79f0f640 1 -- 172.21.15.78:0/2899292234 shutdown_connections 2023-11-28T20:02:28.061 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:28.052+0000 7f6c79f0f640 1 -- 172.21.15.78:0/2899292234 wait complete. 2023-11-28T20:02:28.063 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:28.056+0000 7f6c79f0f640 1 Processor -- start 2023-11-28T20:02:28.063 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:28.056+0000 7f6c79f0f640 1 -- start start 2023-11-28T20:02:28.064 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:28.056+0000 7f6c79f0f640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6c740c5300 0x7f6c74151bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:28.064 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:28.056+0000 7f6c79f0f640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6c7414b1e0 0x7f6c740befc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:28.064 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:28.056+0000 7f6c79f0f640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6c74159c40 0x7f6c741ecd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:28.064 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:28.056+0000 7f6c79f0f640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c741ec680 con 0x7f6c74159c40 2023-11-28T20:02:28.064 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:28.056+0000 7f6c79f0f640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c74150ae0 con 0x7f6c7414b1e0 2023-11-28T20:02:28.064 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:28.056+0000 7f6c79f0f640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c741ec900 con 0x7f6c740c5300 2023-11-28T20:02:28.064 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:28.056+0000 7f6c73fff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6c74159c40 0x7f6c741ecd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:02:28.064 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:28.056+0000 7f6c73fff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6c74159c40 0x7f6c741ecd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:58574/0 (socket says 172.21.15.78:58574) 2023-11-28T20:02:28.064 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:28.056+0000 7f6c73fff640 1 -- 172.21.15.78:0/2357758862 learned_addr learned my addr 172.21.15.78:0/2357758862 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T20:02:28.064 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:28.056+0000 7f6c737fe640 1 --2- 172.21.15.78:0/2357758862 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6c740c5300 0x7f6c74151bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:02:28.064 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:28.056+0000 7f6c72ffd640 1 --2- 172.21.15.78:0/2357758862 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6c7414b1e0 0x7f6c740befc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:02:28.064 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:28.056+0000 7f6c73fff640 1 -- 172.21.15.78:0/2357758862 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6c740c5300 msgr2=0x7f6c74151bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:02:28.065 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:28.056+0000 7f6c73fff640 1 --2- 172.21.15.78:0/2357758862 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6c740c5300 0x7f6c74151bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:28.065 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:28.056+0000 7f6c73fff640 1 -- 172.21.15.78:0/2357758862 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6c7414b1e0 msgr2=0x7f6c740befc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:02:28.065 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:28.056+0000 7f6c73fff640 1 --2- 172.21.15.78:0/2357758862 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6c7414b1e0 0x7f6c740befc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:28.065 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:28.056+0000 7f6c73fff640 1 -- 172.21.15.78:0/2357758862 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c6c009a70 con 0x7f6c74159c40 2023-11-28T20:02:28.065 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:28.056+0000 7f6c73fff640 1 --2- 172.21.15.78:0/2357758862 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6c74159c40 0x7f6c741ecd90 secure :-1 s=READY pgs=960 cs=0 l=1 rev1=1 crypto rx=0x7f6c6c009d60 tx=0x7f6c6c0195f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:02:28.065 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:28.056+0000 7f6c5bfff640 1 -- 172.21.15.78:0/2357758862 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c6c0bd070 con 0x7f6c74159c40 2023-11-28T20:02:28.065 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:28.056+0000 7f6c5bfff640 1 -- 172.21.15.78:0/2357758862 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c6c0a5920 con 0x7f6c74159c40 2023-11-28T20:02:28.065 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:28.056+0000 7f6c79f0f640 1 -- 172.21.15.78:0/2357758862 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6c741f06a0 con 0x7f6c74159c40 2023-11-28T20:02:28.065 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:28.056+0000 7f6c5bfff640 1 -- 172.21.15.78:0/2357758862 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c6c0a5cf0 con 0x7f6c74159c40 2023-11-28T20:02:28.065 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:28.056+0000 7f6c79f0f640 1 -- 172.21.15.78:0/2357758862 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6c74149fe0 con 0x7f6c74159c40 2023-11-28T20:02:28.065 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:28.060+0000 7f6c79f0f640 1 -- 172.21.15.78:0/2357758862 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6c741eca90 con 0x7f6c74159c40 2023-11-28T20:02:28.066 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:28.060+0000 7f6c5bfff640 1 -- 172.21.15.78:0/2357758862 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f6c6c004040 con 0x7f6c74159c40 2023-11-28T20:02:28.066 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:28.060+0000 7f6c5bfff640 1 --2- 172.21.15.78:0/2357758862 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f6c60066470 0x7f6c60068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:28.067 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:28.060+0000 7f6c5bfff640 1 -- 172.21.15.78:0/2357758862 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6885+0+0 (secure 0 0 0) 0x7f6c7414b7d0 con 0x7f6c74159c40 2023-11-28T20:02:28.067 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:28.060+0000 7f6c737fe640 1 --2- 172.21.15.78:0/2357758862 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f6c60066470 0x7f6c60068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:02:28.067 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:28.060+0000 7f6c737fe640 1 --2- 172.21.15.78:0/2357758862 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f6c60066470 0x7f6c60068930 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f6c64005890 tx=0x7f6c64001db0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:02:28.068 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:28.064+0000 7f6c5bfff640 1 -- 172.21.15.78:0/2357758862 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f6c6c0ebbd0 con 0x7f6c74159c40 2023-11-28T20:02:28.249 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:28.244+0000 7f6c79f0f640 1 -- 172.21.15.78:0/2357758862 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs2", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f6c74067630 con 0x7f6c74159c40 2023-11-28T20:02:28.262 INFO:tasks.ceph.mds.b.smithi179.stderr:2023-11-28T20:02:28.257+0000 7f84877c2640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-11-28T20:02:28.886 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:28.880+0000 7f6c5bfff640 1 -- 172.21.15.78:0/2357758862 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs2", "var": "allow_standby_replay", "val": "false"}]=0 v51) v1 ==== 123+0+0 (secure 0 0 0) 0x7f6c6c0b20c0 con 0x7f6c74159c40 2023-11-28T20:02:28.888 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:28.884+0000 7f6c79f0f640 1 -- 172.21.15.78:0/2357758862 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f6c60066470 msgr2=0x7f6c60068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:02:28.888 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:28.884+0000 7f6c79f0f640 1 --2- 172.21.15.78:0/2357758862 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f6c60066470 0x7f6c60068930 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f6c64005890 tx=0x7f6c64001db0 comp rx=0 tx=0).stop 2023-11-28T20:02:28.888 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:28.884+0000 7f6c79f0f640 1 -- 172.21.15.78:0/2357758862 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6c74159c40 msgr2=0x7f6c741ecd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:02:28.888 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:28.884+0000 7f6c79f0f640 1 --2- 172.21.15.78:0/2357758862 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6c74159c40 0x7f6c741ecd90 secure :-1 s=READY pgs=960 cs=0 l=1 rev1=1 crypto rx=0x7f6c6c009d60 tx=0x7f6c6c0195f0 comp rx=0 tx=0).stop 2023-11-28T20:02:28.888 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:28.884+0000 7f6c79f0f640 1 -- 172.21.15.78:0/2357758862 shutdown_connections 2023-11-28T20:02:28.888 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:28.884+0000 7f6c79f0f640 1 --2- 172.21.15.78:0/2357758862 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f6c60066470 0x7f6c60068930 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:28.889 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:28.884+0000 7f6c79f0f640 1 --2- 172.21.15.78:0/2357758862 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6c74159c40 0x7f6c741ecd90 unknown :-1 s=CLOSED pgs=960 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:28.889 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:28.884+0000 7f6c79f0f640 1 --2- 172.21.15.78:0/2357758862 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6c7414b1e0 0x7f6c740befc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:28.889 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:28.884+0000 7f6c79f0f640 1 --2- 172.21.15.78:0/2357758862 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6c740c5300 0x7f6c74151bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:28.889 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:28.884+0000 7f6c79f0f640 1 -- 172.21.15.78:0/2357758862 >> 172.21.15.78:0/2357758862 conn(0x7f6c740c59f0 msgr2=0x7f6c740aac10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:02:28.889 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:28.884+0000 7f6c79f0f640 1 -- 172.21.15.78:0/2357758862 shutdown_connections 2023-11-28T20:02:28.889 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:28.884+0000 7f6c79f0f640 1 -- 172.21.15.78:0/2357758862 wait complete. 2023-11-28T20:02:28.908 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs2' 2023-11-28T20:02:28.909 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-28T20:02:29.047 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:29.044+0000 7f50952c8640 1 Processor -- start 2023-11-28T20:02:29.047 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:29.044+0000 7f50952c8640 1 -- start start 2023-11-28T20:02:29.048 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:29.044+0000 7f50952c8640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f50900c65f0 0x7f50900c69d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:29.048 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:29.044+0000 7f50952c8640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f50900c8200 0x7f50900c8b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:29.049 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:29.044+0000 7f50952c8640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5090151f20 con 0x7f50900c9040 2023-11-28T20:02:29.049 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:29.044+0000 7f50952c8640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5090154450 con 0x7f50900c65f0 2023-11-28T20:02:29.049 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:29.044+0000 7f50952c8640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5090154710 con 0x7f50900c8200 2023-11-28T20:02:29.049 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:29.044+0000 7f508ffff640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f50900c65f0 0x7f50900c69d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:02:29.049 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:29.044+0000 7f508ffff640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f50900c65f0 0x7f50900c69d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:58580/0 (socket says 172.21.15.78:58580) 2023-11-28T20:02:29.049 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:29.044+0000 7f508ffff640 1 -- 172.21.15.78:0/124120704 learned_addr learned my addr 172.21.15.78:0/124120704 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T20:02:29.050 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:29.044+0000 7f508f7fe640 1 --2- 172.21.15.78:0/124120704 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f50900c8200 0x7f50900c8b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:02:29.050 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:29.044+0000 7f508ffff640 1 -- 172.21.15.78:0/124120704 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f50900c8200 msgr2=0x7f50900c8b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:02:29.050 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:29.044+0000 7f508ffff640 1 --2- 172.21.15.78:0/124120704 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f50900c8200 0x7f50900c8b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:29.050 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:29.044+0000 7f508ffff640 1 -- 172.21.15.78:0/124120704 >> v1:172.21.15.179:6789/0 conn(0x7f50900c9040 legacy=0x7f50901579c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:02:29.050 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:29.044+0000 7f508ffff640 1 -- 172.21.15.78:0/124120704 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50901549f0 con 0x7f50900c65f0 2023-11-28T20:02:29.050 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:29.044+0000 7f508f7fe640 1 --2- 172.21.15.78:0/124120704 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f50900c8200 0x7f50900c8b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T20:02:29.052 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:29.048+0000 7f508ffff640 1 --2- 172.21.15.78:0/124120704 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f50900c65f0 0x7f50900c69d0 secure :-1 s=READY pgs=961 cs=0 l=1 rev1=1 crypto rx=0x7f5080009870 tx=0x7f508001c440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b7c0a3b631787fee server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:02:29.052 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:29.048+0000 7f508effd640 1 -- 172.21.15.78:0/124120704 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50800ab600 con 0x7f50900c65f0 2023-11-28T20:02:29.052 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:29.048+0000 7f508effd640 1 -- 172.21.15.78:0/124120704 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f50800ab760 con 0x7f50900c65f0 2023-11-28T20:02:29.052 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:29.048+0000 7f508effd640 1 -- 172.21.15.78:0/124120704 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50800abaf0 con 0x7f50900c65f0 2023-11-28T20:02:29.053 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:29.048+0000 7f50952c8640 1 -- 172.21.15.78:0/124120704 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f50900c65f0 msgr2=0x7f50900c69d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:02:29.053 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:29.048+0000 7f50952c8640 1 --2- 172.21.15.78:0/124120704 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f50900c65f0 0x7f50900c69d0 secure :-1 s=READY pgs=961 cs=0 l=1 rev1=1 crypto rx=0x7f5080009870 tx=0x7f508001c440 comp rx=0 tx=0).stop 2023-11-28T20:02:29.053 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:29.048+0000 7f50952c8640 1 -- 172.21.15.78:0/124120704 shutdown_connections 2023-11-28T20:02:29.054 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:29.048+0000 7f50952c8640 1 --2- 172.21.15.78:0/124120704 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f50900c8200 0x7f50900c8b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:29.054 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:29.048+0000 7f50952c8640 1 --2- 172.21.15.78:0/124120704 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f50900c65f0 0x7f50900c69d0 unknown :-1 s=CLOSED pgs=961 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:29.054 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:29.048+0000 7f50952c8640 1 -- 172.21.15.78:0/124120704 >> 172.21.15.78:0/124120704 conn(0x7f50900ab730 msgr2=0x7f50900abb40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:02:29.054 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:29.048+0000 7f50952c8640 1 -- 172.21.15.78:0/124120704 shutdown_connections 2023-11-28T20:02:29.054 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:29.048+0000 7f50952c8640 1 -- 172.21.15.78:0/124120704 wait complete. 2023-11-28T20:02:29.054 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:29.048+0000 7f50952c8640 1 Processor -- start 2023-11-28T20:02:29.054 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:29.052+0000 7f50952c8640 1 -- start start 2023-11-28T20:02:29.057 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:29.052+0000 7f50952c8640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f50900c65f0 0x7f50901ed810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:29.057 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:29.052+0000 7f50952c8640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f50900c8200 0x7f509014b060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:29.057 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:29.052+0000 7f50952c8640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f50900c9040 0x7f5090149c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:29.057 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:29.052+0000 7f50952c8640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50901edd50 con 0x7f50900c65f0 2023-11-28T20:02:29.057 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:29.052+0000 7f50952c8640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5090148bc0 con 0x7f50900c9040 2023-11-28T20:02:29.057 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:29.052+0000 7f50952c8640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5090148ea0 con 0x7f50900c8200 2023-11-28T20:02:29.057 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:29.052+0000 7f508ffff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f50900c65f0 0x7f50901ed810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:02:29.057 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:29.052+0000 7f508ffff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f50900c65f0 0x7f50901ed810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:58588/0 (socket says 172.21.15.78:58588) 2023-11-28T20:02:29.057 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:29.052+0000 7f508ffff640 1 -- 172.21.15.78:0/2398722622 learned_addr learned my addr 172.21.15.78:0/2398722622 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T20:02:29.058 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:29.052+0000 7f508f7fe640 1 --2- 172.21.15.78:0/2398722622 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f50900c8200 0x7f509014b060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:02:29.058 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:29.052+0000 7f5094ac7640 1 --2- 172.21.15.78:0/2398722622 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f50900c9040 0x7f5090149c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:02:29.058 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:29.052+0000 7f508ffff640 1 -- 172.21.15.78:0/2398722622 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f50900c8200 msgr2=0x7f509014b060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:02:29.058 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:29.052+0000 7f508ffff640 1 --2- 172.21.15.78:0/2398722622 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f50900c8200 0x7f509014b060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:29.058 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:29.052+0000 7f508ffff640 1 -- 172.21.15.78:0/2398722622 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f50900c9040 msgr2=0x7f5090149c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:02:29.058 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:29.052+0000 7f508ffff640 1 --2- 172.21.15.78:0/2398722622 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f50900c9040 0x7f5090149c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:29.058 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:29.052+0000 7f508ffff640 1 -- 172.21.15.78:0/2398722622 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50800094d0 con 0x7f50900c65f0 2023-11-28T20:02:29.058 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:29.052+0000 7f5094ac7640 1 --2- 172.21.15.78:0/2398722622 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f50900c9040 0x7f5090149c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T20:02:29.058 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:29.052+0000 7f508ffff640 1 --2- 172.21.15.78:0/2398722622 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f50900c65f0 0x7f50901ed810 secure :-1 s=READY pgs=962 cs=0 l=1 rev1=1 crypto rx=0x7f50800ad040 tx=0x7f508001ac80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:02:29.058 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:29.052+0000 7f508cff9640 1 -- 172.21.15.78:0/2398722622 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50800b4800 con 0x7f50900c65f0 2023-11-28T20:02:29.058 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:29.052+0000 7f508cff9640 1 -- 172.21.15.78:0/2398722622 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f50800b4980 con 0x7f50900c65f0 2023-11-28T20:02:29.059 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:29.052+0000 7f508cff9640 1 -- 172.21.15.78:0/2398722622 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50800b4d30 con 0x7f50900c65f0 2023-11-28T20:02:29.059 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:29.052+0000 7f50952c8640 1 -- 172.21.15.78:0/2398722622 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5090149180 con 0x7f50900c65f0 2023-11-28T20:02:29.059 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:29.052+0000 7f50952c8640 1 -- 172.21.15.78:0/2398722622 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5090149740 con 0x7f50900c65f0 2023-11-28T20:02:29.060 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:29.052+0000 7f50952c8640 1 -- 172.21.15.78:0/2398722622 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f50900674b0 con 0x7f50900c65f0 2023-11-28T20:02:29.060 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:29.056+0000 7f508cff9640 1 -- 172.21.15.78:0/2398722622 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f50800c7440 con 0x7f50900c65f0 2023-11-28T20:02:29.060 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:29.056+0000 7f508cff9640 1 --2- 172.21.15.78:0/2398722622 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f507c066470 0x7f507c068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:29.060 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:29.056+0000 7f508cff9640 1 -- 172.21.15.78:0/2398722622 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6885+0+0 (secure 0 0 0) 0x7f508011edf0 con 0x7f50900c65f0 2023-11-28T20:02:29.060 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:29.056+0000 7f508f7fe640 1 --2- 172.21.15.78:0/2398722622 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f507c066470 0x7f507c068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:02:29.060 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:29.056+0000 7f508f7fe640 1 --2- 172.21.15.78:0/2398722622 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f507c066470 0x7f507c068930 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f509014f6e0 tx=0x7f5084008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:02:29.064 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:29.060+0000 7f508cff9640 1 -- 172.21.15.78:0/2398722622 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f50800ebe70 con 0x7f50900c65f0 2023-11-28T20:02:29.247 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:29.244+0000 7f50952c8640 1 -- 172.21.15.78:0/2398722622 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f509006c650 con 0x7f50900c65f0 2023-11-28T20:02:29.247 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:29.244+0000 7f508cff9640 1 -- 172.21.15.78:0/2398722622 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 51 v51) v1 ==== 94+0+6134 (secure 0 0 0) 0x7f50800ef490 con 0x7f50900c65f0 2023-11-28T20:02:29.248 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-11-28T20:02:29.248 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":51,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5834,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6834/3259525552","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6832","nonce":3259525552},{"type":"v1","addr":"172.21.15.179:6834","nonce":3259525552}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":41},{"gid":6466,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6836/3096284673","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6834","nonce":3096284673},{"type":"v1","addr":"172.21.15.78:6836","nonce":3096284673}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":41}],"filesystems":[{"mdsmap":{"epoch":46,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-28T20:02:07.651677+0000","modified":"2023-11-28T20:02:10.666537+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":6633},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6633":{"gid":6633,"name":"a","rank":0,"incarnation":42,"state":"up:active","state_seq":3,"addr":"172.21.15.78:6837/20108235","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6835","nonce":20108235},{"type":"v1","addr":"172.21.15.78:6837","nonce":20108235}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6},{"mdsmap":{"epoch":51,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-28T20:02:25.231135+0000","modified":"2023-11-28T20:02:28.250515+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":6478},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6478":{"gid":6478,"name":"b","rank":0,"incarnation":47,"state":"up:active","state_seq":7,"addr":"172.21.15.179:6835/2749579094","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6833","nonce":2749579094},{"type":"v1","addr":"172.21.15.179:6835","nonce":2749579094}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs2","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":7}]} 2023-11-28T20:02:29.248 INFO:teuthology.orchestra.run.smithi078.stderr:dumped fsmap epoch 51 2023-11-28T20:02:29.250 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:29.244+0000 7f50952c8640 1 -- 172.21.15.78:0/2398722622 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f507c066470 msgr2=0x7f507c068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:02:29.250 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:29.244+0000 7f50952c8640 1 --2- 172.21.15.78:0/2398722622 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f507c066470 0x7f507c068930 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f509014f6e0 tx=0x7f5084008040 comp rx=0 tx=0).stop 2023-11-28T20:02:29.250 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:29.244+0000 7f50952c8640 1 -- 172.21.15.78:0/2398722622 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f50900c65f0 msgr2=0x7f50901ed810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:02:29.251 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:29.244+0000 7f50952c8640 1 --2- 172.21.15.78:0/2398722622 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f50900c65f0 0x7f50901ed810 secure :-1 s=READY pgs=962 cs=0 l=1 rev1=1 crypto rx=0x7f50800ad040 tx=0x7f508001ac80 comp rx=0 tx=0).stop 2023-11-28T20:02:29.251 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:29.244+0000 7f50952c8640 1 -- 172.21.15.78:0/2398722622 shutdown_connections 2023-11-28T20:02:29.251 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:29.244+0000 7f50952c8640 1 --2- 172.21.15.78:0/2398722622 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f507c066470 0x7f507c068930 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:29.252 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:29.244+0000 7f50952c8640 1 --2- 172.21.15.78:0/2398722622 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f50900c8200 0x7f509014b060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:29.252 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:29.244+0000 7f50952c8640 1 --2- 172.21.15.78:0/2398722622 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f50900c9040 0x7f5090149c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:29.252 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:29.244+0000 7f50952c8640 1 --2- 172.21.15.78:0/2398722622 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f50900c65f0 0x7f50901ed810 unknown :-1 s=CLOSED pgs=962 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:29.252 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:29.244+0000 7f50952c8640 1 -- 172.21.15.78:0/2398722622 >> 172.21.15.78:0/2398722622 conn(0x7f50900ab730 msgr2=0x7f509015f380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:02:29.252 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:29.244+0000 7f50952c8640 1 -- 172.21.15.78:0/2398722622 shutdown_connections 2023-11-28T20:02:29.252 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:29.244+0000 7f50952c8640 1 -- 172.21.15.78:0/2398722622 wait complete. 2023-11-28T20:02:29.269 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-28T20:02:29.407 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:29.404+0000 7fce10a7b640 1 Processor -- start 2023-11-28T20:02:29.407 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:29.404+0000 7fce10a7b640 1 -- start start 2023-11-28T20:02:29.409 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:29.404+0000 7fce10a7b640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fce0c0c69d0 0x7fce0c15fd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:29.409 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:29.404+0000 7fce10a7b640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fce0c151f20 con 0x7fce0c0c65f0 2023-11-28T20:02:29.409 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:29.404+0000 7fce10a7b640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fce0c154450 con 0x7fce0c0c8200 2023-11-28T20:02:29.409 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:29.404+0000 7fce10a7b640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fce0c0c6e80 con 0x7fce0c0c69d0 2023-11-28T20:02:29.409 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:29.404+0000 7fce0b7fe640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7fce0c0c65f0 0x7fce0c0c8b00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:55686/0 (socket says 172.21.15.78:55686) 2023-11-28T20:02:29.409 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:29.404+0000 7fce0b7fe640 1 -- 172.21.15.78:0/3782591556 learned_addr learned my addr 172.21.15.78:0/3782591556 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-11-28T20:02:29.409 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:29.404+0000 7fce0bfff640 1 --2- 172.21.15.78:0/3782591556 >> v2:172.21.15.179:3300/0 conn(0x7fce0c0c69d0 0x7fce0c15fd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:02:29.409 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:29.404+0000 7fce0a7fc640 1 -- 172.21.15.78:0/3782591556 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 209330243 0 0) 0x7fce0c151f20 con 0x7fce0c0c65f0 2023-11-28T20:02:29.409 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:29.404+0000 7fce0a7fc640 1 -- 172.21.15.78:0/3782591556 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcdf4003530 con 0x7fce0c0c65f0 2023-11-28T20:02:29.411 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:29.404+0000 7fce0a7fc640 1 -- 172.21.15.78:0/3782591556 <== mon.0 v1:172.21.15.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3447452304 0 0) 0x7fcdf4003530 con 0x7fce0c0c65f0 2023-11-28T20:02:29.411 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:29.404+0000 7fce0a7fc640 1 -- 172.21.15.78:0/3782591556 >> v2:172.21.15.179:3300/0 conn(0x7fce0c0c69d0 msgr2=0x7fce0c15fd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:02:29.411 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:29.404+0000 7fce0a7fc640 1 --2- 172.21.15.78:0/3782591556 >> v2:172.21.15.179:3300/0 conn(0x7fce0c0c69d0 0x7fce0c15fd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:29.411 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:29.404+0000 7fce0a7fc640 1 -- 172.21.15.78:0/3782591556 >> v1:172.21.15.179:6789/0 conn(0x7fce0c0c8200 legacy=0x7fce0c0c9210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:02:29.411 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:29.404+0000 7fce0a7fc640 1 -- 172.21.15.78:0/3782591556 --> v1:172.21.15.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce0c154710 con 0x7fce0c0c65f0 2023-11-28T20:02:29.411 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:29.404+0000 7fce0a7fc640 1 -- 172.21.15.78:0/3782591556 <== mon.0 v1:172.21.15.78:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3326804700 0 0) 0x7fcdfc001680 con 0x7fce0c0c65f0 2023-11-28T20:02:29.411 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:29.404+0000 7fce0a7fc640 1 -- 172.21.15.78:0/3782591556 >> v1:172.21.15.78:6789/0 conn(0x7fce0c0c65f0 legacy=0x7fce0c0c8b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:02:29.411 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:29.404+0000 7fce0a7fc640 1 --2- 172.21.15.78:0/3782591556 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcdf40039d0 0x7fcdf4003df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:29.412 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:29.404+0000 7fce0a7fc640 1 --2- 172.21.15.78:0/3782591556 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcdf40047d0 0x7fcdf4004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:29.412 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:29.404+0000 7fce0a7fc640 1 --2- 172.21.15.78:0/3782591556 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcdf40052b0 0x7fcdf400b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:29.412 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:29.404+0000 7fce0a7fc640 1 -- 172.21.15.78:0/3782591556 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce0c0c6e80 con 0x7fcdf40047d0 2023-11-28T20:02:29.412 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:29.404+0000 7fce0a7fc640 1 -- 172.21.15.78:0/3782591556 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcdf400c1b0 con 0x7fcdf40039d0 2023-11-28T20:02:29.412 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:29.404+0000 7fce0a7fc640 1 -- 172.21.15.78:0/3782591556 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcdf400c370 con 0x7fcdf40052b0 2023-11-28T20:02:29.412 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:29.404+0000 7fce0affd640 1 --2- 172.21.15.78:0/3782591556 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcdf40047d0 0x7fcdf4004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:02:29.412 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:29.404+0000 7fce0b7fe640 1 --2- 172.21.15.78:0/3782591556 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcdf40039d0 0x7fcdf4003df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:02:29.412 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:29.404+0000 7fce0bfff640 1 --2- 172.21.15.78:0/3782591556 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcdf40052b0 0x7fcdf400b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:02:29.412 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:29.404+0000 7fce0affd640 1 -- 172.21.15.78:0/3782591556 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcdf40052b0 msgr2=0x7fcdf400b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:02:29.412 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:29.404+0000 7fce0affd640 1 --2- 172.21.15.78:0/3782591556 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcdf40052b0 0x7fcdf400b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:29.412 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:29.404+0000 7fce0affd640 1 -- 172.21.15.78:0/3782591556 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcdf40039d0 msgr2=0x7fcdf4003df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:02:29.412 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:29.404+0000 7fce0affd640 1 --2- 172.21.15.78:0/3782591556 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcdf40039d0 0x7fcdf4003df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:29.413 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:29.404+0000 7fce0affd640 1 -- 172.21.15.78:0/3782591556 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcdf4003530 con 0x7fcdf40047d0 2023-11-28T20:02:29.413 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:29.404+0000 7fce0bfff640 1 -- 172.21.15.78:0/3782591556 reap_dead start 2023-11-28T20:02:29.414 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:29.408+0000 7fce0affd640 1 --2- 172.21.15.78:0/3782591556 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcdf40047d0 0x7fcdf4004c50 secure :-1 s=READY pgs=964 cs=0 l=1 rev1=1 crypto rx=0x7fce00001750 tx=0x7fce0001c370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a38112c1cfeb2556 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:02:29.414 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:29.408+0000 7fce0a7fc640 1 -- 172.21.15.78:0/3782591556 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce000052d0 con 0x7fcdf40047d0 2023-11-28T20:02:29.414 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:29.408+0000 7fce0a7fc640 1 -- 172.21.15.78:0/3782591556 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce000a7050 con 0x7fcdf40047d0 2023-11-28T20:02:29.414 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:29.408+0000 7fce0a7fc640 1 -- 172.21.15.78:0/3782591556 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce00003600 con 0x7fcdf40047d0 2023-11-28T20:02:29.414 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:29.408+0000 7fce10a7b640 1 -- 172.21.15.78:0/3782591556 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcdf40047d0 msgr2=0x7fcdf4004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:02:29.414 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:29.408+0000 7fce10a7b640 1 --2- 172.21.15.78:0/3782591556 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcdf40047d0 0x7fcdf4004c50 secure :-1 s=READY pgs=964 cs=0 l=1 rev1=1 crypto rx=0x7fce00001750 tx=0x7fce0001c370 comp rx=0 tx=0).stop 2023-11-28T20:02:29.414 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:29.408+0000 7fce10a7b640 1 -- 172.21.15.78:0/3782591556 shutdown_connections 2023-11-28T20:02:29.414 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:29.408+0000 7fce10a7b640 1 --2- 172.21.15.78:0/3782591556 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcdf40047d0 0x7fcdf4004c50 unknown :-1 s=CLOSED pgs=964 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:29.414 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:29.408+0000 7fce10a7b640 1 -- 172.21.15.78:0/3782591556 >> 172.21.15.78:0/3782591556 conn(0x7fce0c0ab730 msgr2=0x7fce0c0abb40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:02:29.414 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:29.408+0000 7fce10a7b640 1 -- 172.21.15.78:0/3782591556 shutdown_connections 2023-11-28T20:02:29.414 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:29.408+0000 7fce10a7b640 1 -- 172.21.15.78:0/3782591556 wait complete. 2023-11-28T20:02:29.415 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:29.412+0000 7fce10a7b640 1 Processor -- start 2023-11-28T20:02:29.415 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:29.412+0000 7fce10a7b640 1 -- start start 2023-11-28T20:02:29.417 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:29.412+0000 7fce10a7b640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcdf40047d0 0x7fce0c0c31d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:29.417 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:29.412+0000 7fce10a7b640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fce0c156d20 0x7fce0c1f0810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:29.417 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:29.412+0000 7fce10a7b640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fce0c14f040 0x7fce0c1f0d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:29.417 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:29.412+0000 7fce10a7b640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce0c1f0380 con 0x7fcdf40047d0 2023-11-28T20:02:29.417 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:29.412+0000 7fce10a7b640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce0c0c22d0 con 0x7fce0c156d20 2023-11-28T20:02:29.418 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:29.412+0000 7fce10a7b640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fce0c0c1d10 con 0x7fce0c14f040 2023-11-28T20:02:29.418 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:29.412+0000 7fce0b7fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcdf40047d0 0x7fce0c0c31d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:02:29.418 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:29.412+0000 7fce0b7fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcdf40047d0 0x7fce0c0c31d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:58602/0 (socket says 172.21.15.78:58602) 2023-11-28T20:02:29.418 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:29.412+0000 7fce0b7fe640 1 -- 172.21.15.78:0/2917892319 learned_addr learned my addr 172.21.15.78:0/2917892319 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T20:02:29.418 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:29.412+0000 7fce0bfff640 1 --2- 172.21.15.78:0/2917892319 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fce0c14f040 0x7fce0c1f0d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:02:29.418 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:29.412+0000 7fce0affd640 1 --2- 172.21.15.78:0/2917892319 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fce0c156d20 0x7fce0c1f0810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:02:29.418 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:29.412+0000 7fce0b7fe640 1 -- 172.21.15.78:0/2917892319 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fce0c14f040 msgr2=0x7fce0c1f0d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:02:29.418 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:29.412+0000 7fce0b7fe640 1 --2- 172.21.15.78:0/2917892319 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fce0c14f040 0x7fce0c1f0d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:29.418 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:29.412+0000 7fce0b7fe640 1 -- 172.21.15.78:0/2917892319 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fce0c156d20 msgr2=0x7fce0c1f0810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:02:29.418 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:29.412+0000 7fce0b7fe640 1 --2- 172.21.15.78:0/2917892319 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fce0c156d20 0x7fce0c1f0810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:29.418 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:29.412+0000 7fce0b7fe640 1 -- 172.21.15.78:0/2917892319 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce0c0c1ff0 con 0x7fcdf40047d0 2023-11-28T20:02:29.418 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:29.412+0000 7fce0b7fe640 1 --2- 172.21.15.78:0/2917892319 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcdf40047d0 0x7fce0c0c31d0 secure :-1 s=READY pgs=965 cs=0 l=1 rev1=1 crypto rx=0x7fcdfc004e30 tx=0x7fcdfc007430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:02:29.419 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:29.412+0000 7fcdf3fff640 1 -- 172.21.15.78:0/2917892319 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcdfc001000 con 0x7fcdf40047d0 2023-11-28T20:02:29.419 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:29.412+0000 7fcdf3fff640 1 -- 172.21.15.78:0/2917892319 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcdfc00f7b0 con 0x7fcdf40047d0 2023-11-28T20:02:29.419 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:29.412+0000 7fcdf3fff640 1 -- 172.21.15.78:0/2917892319 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcdfc00fb40 con 0x7fcdf40047d0 2023-11-28T20:02:29.420 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:29.412+0000 7fce10a7b640 1 -- 172.21.15.78:0/2917892319 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fce0c0c3710 con 0x7fcdf40047d0 2023-11-28T20:02:29.420 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:29.412+0000 7fce10a7b640 1 -- 172.21.15.78:0/2917892319 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fce0c0c39c0 con 0x7fcdf40047d0 2023-11-28T20:02:29.420 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:29.412+0000 7fce10a7b640 1 -- 172.21.15.78:0/2917892319 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fce0c0674b0 con 0x7fcdf40047d0 2023-11-28T20:02:29.420 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:29.416+0000 7fcdf3fff640 1 -- 172.21.15.78:0/2917892319 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fcdfc00fca0 con 0x7fcdf40047d0 2023-11-28T20:02:29.420 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:29.416+0000 7fcdf3fff640 1 --2- 172.21.15.78:0/2917892319 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fcdf80664a0 0x7fcdf8068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:29.421 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:29.416+0000 7fcdf3fff640 1 -- 172.21.15.78:0/2917892319 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6885+0+0 (secure 0 0 0) 0x7fcdfc084110 con 0x7fcdf40047d0 2023-11-28T20:02:29.421 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:29.416+0000 7fce0affd640 1 --2- 172.21.15.78:0/2917892319 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fcdf80664a0 0x7fcdf8068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:02:29.421 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:29.416+0000 7fce0affd640 1 --2- 172.21.15.78:0/2917892319 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fcdf80664a0 0x7fcdf8068960 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7fce0c0c8680 tx=0x7fce000011a0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:02:29.424 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:29.420+0000 7fcdf3fff640 1 -- 172.21.15.78:0/2917892319 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fcdfc051230 con 0x7fcdf40047d0 2023-11-28T20:02:29.576 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:29.572+0000 7fce10a7b640 1 -- 172.21.15.78:0/2917892319 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fce0c1523c0 con 0x7fcdf40047d0 2023-11-28T20:02:29.577 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:29.572+0000 7fcdf3fff640 1 -- 172.21.15.78:0/2917892319 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v85) v1 ==== 74+0+20339 (secure 0 0 0) 0x7fcdfc054850 con 0x7fcdf40047d0 2023-11-28T20:02:29.578 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-11-28T20:02:29.578 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":85,"fsid":"dd9780e8-3bda-44fa-a9f0-fa07d19d901d","created":"2023-11-28T19:58:40.969556+0000","modified":"2023-11-28T20:02:26.796715+0000","last_up_change":"2023-11-28T19:58:52.596716+0000","last_in_change":"2023-11-28T19:58:43.609275+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":16,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-28T19:58:54.011229+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_metadata","create_time":"2023-11-28T20:02:05.787820+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs_data","create_time":"2023-11-28T20:02:06.652305+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs2_metadata","create_time":"2023-11-28T20:02:23.066724+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":16,"pool_name":"cephfs2_data","create_time":"2023-11-28T20:02:24.230614+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs2"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e84245ac-b5da-429e-af18-39acaa2b33e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6800","nonce":3358701235},{"type":"v1","addr":"172.21.15.78:6801","nonce":3358701235}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6802","nonce":3358701235},{"type":"v1","addr":"172.21.15.78:6803","nonce":3358701235}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6806","nonce":3358701235},{"type":"v1","addr":"172.21.15.78:6807","nonce":3358701235}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6804","nonce":3358701235},{"type":"v1","addr":"172.21.15.78:6805","nonce":3358701235}]},"public_addr":"172.21.15.78:6801/3358701235","cluster_addr":"172.21.15.78:6803/3358701235","heartbeat_back_addr":"172.21.15.78:6807/3358701235","heartbeat_front_addr":"172.21.15.78:6805/3358701235","state":["exists","up"]},{"osd":1,"uuid":"e634831d-c4e2-48d9-870c-9556ae162981","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6808","nonce":3211476654},{"type":"v1","addr":"172.21.15.78:6809","nonce":3211476654}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6810","nonce":3211476654},{"type":"v1","addr":"172.21.15.78:6811","nonce":3211476654}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6814","nonce":3211476654},{"type":"v1","addr":"172.21.15.78:6815","nonce":3211476654}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6812","nonce":3211476654},{"type":"v1","addr":"172.21.15.78:6813","nonce":3211476654}]},"public_addr":"172.21.15.78:6809/3211476654","cluster_addr":"172.21.15.78:6811/3211476654","heartbeat_back_addr":"172.21.15.78:6815/3211476654","heartbeat_front_addr":"172.21.15.78:6813/3211476654","state":["exists","up"]},{"osd":2,"uuid":"274c8395-6534-41f0-b8fb-a00af8985aa8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6816","nonce":2532904479},{"type":"v1","addr":"172.21.15.78:6817","nonce":2532904479}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6818","nonce":2532904479},{"type":"v1","addr":"172.21.15.78:6819","nonce":2532904479}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6822","nonce":2532904479},{"type":"v1","addr":"172.21.15.78:6823","nonce":2532904479}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6820","nonce":2532904479},{"type":"v1","addr":"172.21.15.78:6821","nonce":2532904479}]},"public_addr":"172.21.15.78:6817/2532904479","cluster_addr":"172.21.15.78:6819/2532904479","heartbeat_back_addr":"172.21.15.78:6823/2532904479","heartbeat_front_addr":"172.21.15.78:6821/2532904479","state":["exists","up"]},{"osd":3,"uuid":"77acc9af-7d4d-4b18-8cf5-d62f5971b7c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6824","nonce":3442991267},{"type":"v1","addr":"172.21.15.78:6825","nonce":3442991267}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6826","nonce":3442991267},{"type":"v1","addr":"172.21.15.78:6827","nonce":3442991267}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6830","nonce":3442991267},{"type":"v1","addr":"172.21.15.78:6831","nonce":3442991267}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6828","nonce":3442991267},{"type":"v1","addr":"172.21.15.78:6829","nonce":3442991267}]},"public_addr":"172.21.15.78:6825/3442991267","cluster_addr":"172.21.15.78:6827/3442991267","heartbeat_back_addr":"172.21.15.78:6831/3442991267","heartbeat_front_addr":"172.21.15.78:6829/3442991267","state":["exists","up"]},{"osd":4,"uuid":"5c62bc66-6b34-4b7f-a66b-9a743969138c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":802983577},{"type":"v1","addr":"172.21.15.179:6809","nonce":802983577}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":802983577},{"type":"v1","addr":"172.21.15.179:6811","nonce":802983577}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":802983577},{"type":"v1","addr":"172.21.15.179:6815","nonce":802983577}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":802983577},{"type":"v1","addr":"172.21.15.179:6813","nonce":802983577}]},"public_addr":"172.21.15.179:6809/802983577","cluster_addr":"172.21.15.179:6811/802983577","heartbeat_back_addr":"172.21.15.179:6815/802983577","heartbeat_front_addr":"172.21.15.179:6813/802983577","state":["exists","up"]},{"osd":5,"uuid":"67db6d36-f684-4079-b0cd-82b4dd61461f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":518192887},{"type":"v1","addr":"172.21.15.179:6818","nonce":518192887}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":518192887},{"type":"v1","addr":"172.21.15.179:6822","nonce":518192887}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":518192887},{"type":"v1","addr":"172.21.15.179:6829","nonce":518192887}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6824","nonce":518192887},{"type":"v1","addr":"172.21.15.179:6826","nonce":518192887}]},"public_addr":"172.21.15.179:6818/518192887","cluster_addr":"172.21.15.179:6822/518192887","heartbeat_back_addr":"172.21.15.179:6829/518192887","heartbeat_front_addr":"172.21.15.179:6826/518192887","state":["exists","up"]},{"osd":6,"uuid":"12e670af-5a16-4c81-9f97-defa66cab967","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":815435378},{"type":"v1","addr":"172.21.15.179:6801","nonce":815435378}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":815435378},{"type":"v1","addr":"172.21.15.179:6803","nonce":815435378}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":815435378},{"type":"v1","addr":"172.21.15.179:6807","nonce":815435378}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":815435378},{"type":"v1","addr":"172.21.15.179:6805","nonce":815435378}]},"public_addr":"172.21.15.179:6801/815435378","cluster_addr":"172.21.15.179:6803/815435378","heartbeat_back_addr":"172.21.15.179:6807/815435378","heartbeat_front_addr":"172.21.15.179:6805/815435378","state":["exists","up"]},{"osd":7,"uuid":"fe630650-2eb3-49ad-8676-c341e6332eb1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6817","nonce":2848432339},{"type":"v1","addr":"172.21.15.179:6819","nonce":2848432339}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6821","nonce":2848432339},{"type":"v1","addr":"172.21.15.179:6823","nonce":2848432339}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":2848432339},{"type":"v1","addr":"172.21.15.179:6831","nonce":2848432339}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6825","nonce":2848432339},{"type":"v1","addr":"172.21.15.179:6827","nonce":2848432339}]},"public_addr":"172.21.15.179:6819/2848432339","cluster_addr":"172.21.15.179:6823/2848432339","heartbeat_back_addr":"172.21.15.179:6831/2848432339","heartbeat_front_addr":"172.21.15.179:6827/2848432339","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:58:49.255433+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:58:49.412880+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:58:49.559295+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:58:49.245237+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:58:49.184557+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:58:49.329851+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:58:49.366012+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:58:49.349604+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-28T20:02:29.581 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:29.576+0000 7fce10a7b640 1 -- 172.21.15.78:0/2917892319 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fcdf80664a0 msgr2=0x7fcdf8068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:02:29.582 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:29.576+0000 7fce10a7b640 1 --2- 172.21.15.78:0/2917892319 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fcdf80664a0 0x7fcdf8068960 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7fce0c0c8680 tx=0x7fce000011a0 comp rx=0 tx=0).stop 2023-11-28T20:02:29.582 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:29.576+0000 7fce10a7b640 1 -- 172.21.15.78:0/2917892319 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcdf40047d0 msgr2=0x7fce0c0c31d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:02:29.582 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:29.576+0000 7fce10a7b640 1 --2- 172.21.15.78:0/2917892319 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcdf40047d0 0x7fce0c0c31d0 secure :-1 s=READY pgs=965 cs=0 l=1 rev1=1 crypto rx=0x7fcdfc004e30 tx=0x7fcdfc007430 comp rx=0 tx=0).stop 2023-11-28T20:02:29.582 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:29.576+0000 7fce10a7b640 1 -- 172.21.15.78:0/2917892319 shutdown_connections 2023-11-28T20:02:29.582 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:29.576+0000 7fce10a7b640 1 --2- 172.21.15.78:0/2917892319 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fcdf80664a0 0x7fcdf8068960 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:29.582 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:29.576+0000 7fce10a7b640 1 --2- 172.21.15.78:0/2917892319 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fce0c14f040 0x7fce0c1f0d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:29.582 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:29.576+0000 7fce10a7b640 1 --2- 172.21.15.78:0/2917892319 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fce0c156d20 0x7fce0c1f0810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:29.582 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:29.576+0000 7fce10a7b640 1 --2- 172.21.15.78:0/2917892319 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcdf40047d0 0x7fce0c0c31d0 unknown :-1 s=CLOSED pgs=965 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:29.582 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:29.576+0000 7fce10a7b640 1 -- 172.21.15.78:0/2917892319 >> 172.21.15.78:0/2917892319 conn(0x7fce0c0ab730 msgr2=0x7fce0c0c4cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:02:29.582 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:29.576+0000 7fce10a7b640 1 -- 172.21.15.78:0/2917892319 shutdown_connections 2023-11-28T20:02:29.583 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:29.576+0000 7fce10a7b640 1 -- 172.21.15.78:0/2917892319 wait complete. 2023-11-28T20:02:29.599 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-11-28T20:02:29.600 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-28T20:02:29.736 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:29.732+0000 7f44d1aaa640 1 Processor -- start 2023-11-28T20:02:29.736 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:29.732+0000 7f44d1aaa640 1 -- start start 2023-11-28T20:02:29.738 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:29.732+0000 7f44d1aaa640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f44cc0c3b80 0x7f44cc06d690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:29.738 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:29.732+0000 7f44d1aaa640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f44cc0c5300 0x7f44cc06c730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:29.738 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:29.732+0000 7f44d1aaa640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f44cc06bb80 con 0x7f44cc06d2b0 2023-11-28T20:02:29.738 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:29.732+0000 7f44d1aaa640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f44cc06cc70 con 0x7f44cc0c3b80 2023-11-28T20:02:29.738 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:29.732+0000 7f44d1aaa640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f44cc0c5790 con 0x7f44cc0c5300 2023-11-28T20:02:29.738 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:29.732+0000 7f44caffd640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f44cc0c3b80 0x7f44cc06d690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:02:29.739 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:29.732+0000 7f44caffd640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f44cc0c3b80 0x7f44cc06d690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:58612/0 (socket says 172.21.15.78:58612) 2023-11-28T20:02:29.739 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:29.732+0000 7f44caffd640 1 -- 172.21.15.78:0/2168264869 learned_addr learned my addr 172.21.15.78:0/2168264869 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T20:02:29.739 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:29.732+0000 7f44cb7fe640 1 --1- 172.21.15.78:0/2168264869 >> v1:172.21.15.78:6789/0 conn(0x7f44cc06d2b0 0x7f44cc06c020 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:55702/0 (socket says 172.21.15.78:55702) 2023-11-28T20:02:29.739 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:29.732+0000 7f44cbfff640 1 --2- 172.21.15.78:0/2168264869 >> v2:172.21.15.179:3300/0 conn(0x7f44cc0c5300 0x7f44cc06c730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:02:29.739 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:29.732+0000 7f44caffd640 1 -- 172.21.15.78:0/2168264869 >> v2:172.21.15.179:3300/0 conn(0x7f44cc0c5300 msgr2=0x7f44cc06c730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:02:29.739 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:29.732+0000 7f44caffd640 1 --2- 172.21.15.78:0/2168264869 >> v2:172.21.15.179:3300/0 conn(0x7f44cc0c5300 0x7f44cc06c730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:29.739 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:29.732+0000 7f44caffd640 1 -- 172.21.15.78:0/2168264869 >> v1:172.21.15.78:6789/0 conn(0x7f44cc06d2b0 legacy=0x7f44cc06c020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:02:29.740 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:29.732+0000 7f44caffd640 1 -- 172.21.15.78:0/2168264869 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44cc1515c0 con 0x7f44cc0c3b80 2023-11-28T20:02:29.740 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:29.732+0000 7f44ca7fc640 1 -- 172.21.15.78:0/2168264869 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2473360180 0 0) 0x7f44cc06bb80 con 0x7f44cc06d2b0 2023-11-28T20:02:29.741 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:29.736+0000 7f44caffd640 1 --2- 172.21.15.78:0/2168264869 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f44cc0c3b80 0x7f44cc06d690 secure :-1 s=READY pgs=967 cs=0 l=1 rev1=1 crypto rx=0x7f44cc06e3c0 tx=0x7f44c001c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4b0719ced24374bf server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:02:29.741 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:29.736+0000 7f44ca7fc640 1 -- 172.21.15.78:0/2168264869 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44c00aa430 con 0x7f44cc0c3b80 2023-11-28T20:02:29.741 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:29.736+0000 7f44ca7fc640 1 -- 172.21.15.78:0/2168264869 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f44c00aa590 con 0x7f44cc0c3b80 2023-11-28T20:02:29.741 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:29.736+0000 7f44ca7fc640 1 -- 172.21.15.78:0/2168264869 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44c00aa920 con 0x7f44cc0c3b80 2023-11-28T20:02:29.742 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:29.736+0000 7f44d1aaa640 1 -- 172.21.15.78:0/2168264869 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f44cc0c3b80 msgr2=0x7f44cc06d690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:02:29.742 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:29.736+0000 7f44d1aaa640 1 --2- 172.21.15.78:0/2168264869 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f44cc0c3b80 0x7f44cc06d690 secure :-1 s=READY pgs=967 cs=0 l=1 rev1=1 crypto rx=0x7f44cc06e3c0 tx=0x7f44c001c4d0 comp rx=0 tx=0).stop 2023-11-28T20:02:29.742 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:29.736+0000 7f44d1aaa640 1 -- 172.21.15.78:0/2168264869 shutdown_connections 2023-11-28T20:02:29.743 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:29.736+0000 7f44d1aaa640 1 --2- 172.21.15.78:0/2168264869 >> v2:172.21.15.179:3300/0 conn(0x7f44cc0c5300 0x7f44cc06c730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:29.743 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:29.736+0000 7f44d1aaa640 1 --2- 172.21.15.78:0/2168264869 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f44cc0c3b80 0x7f44cc06d690 unknown :-1 s=CLOSED pgs=967 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:29.743 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:29.736+0000 7f44d1aaa640 1 -- 172.21.15.78:0/2168264869 >> 172.21.15.78:0/2168264869 conn(0x7f44cc0a7810 msgr2=0x7f44cc0a7c20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:02:29.743 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:29.736+0000 7f44d1aaa640 1 -- 172.21.15.78:0/2168264869 shutdown_connections 2023-11-28T20:02:29.743 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:29.736+0000 7f44d1aaa640 1 -- 172.21.15.78:0/2168264869 wait complete. 2023-11-28T20:02:29.744 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:29.740+0000 7f44d1aaa640 1 Processor -- start 2023-11-28T20:02:29.744 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:29.740+0000 7f44d1aaa640 1 -- start start 2023-11-28T20:02:29.746 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:29.740+0000 7f44d1aaa640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f44cc06d2b0 0x7f44cc15b1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:29.746 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:29.740+0000 7f44d1aaa640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f44cc0c3b80 0x7f44cc0a8980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:29.746 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:29.740+0000 7f44d1aaa640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f44cc0c5300 0x7f44cc0a8ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:29.746 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:29.740+0000 7f44d1aaa640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44cc1eb9d0 con 0x7f44cc0c3b80 2023-11-28T20:02:29.746 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:29.740+0000 7f44d1aaa640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44cc1eb660 con 0x7f44cc0c5300 2023-11-28T20:02:29.747 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:29.740+0000 7f44d1aaa640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f44cc0ab390 con 0x7f44cc06d2b0 2023-11-28T20:02:29.747 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:29.740+0000 7f44caffd640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f44cc0c3b80 0x7f44cc0a8980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:02:29.747 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:29.740+0000 7f44caffd640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f44cc0c3b80 0x7f44cc0a8980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:58624/0 (socket says 172.21.15.78:58624) 2023-11-28T20:02:29.747 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:29.740+0000 7f44caffd640 1 -- 172.21.15.78:0/883226923 learned_addr learned my addr 172.21.15.78:0/883226923 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T20:02:29.747 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:29.740+0000 7f44cbfff640 1 --2- 172.21.15.78:0/883226923 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f44cc0c5300 0x7f44cc0a8ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:02:29.747 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:29.740+0000 7f44cb7fe640 1 --2- 172.21.15.78:0/883226923 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f44cc06d2b0 0x7f44cc15b1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:02:29.747 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:29.740+0000 7f44caffd640 1 -- 172.21.15.78:0/883226923 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f44cc06d2b0 msgr2=0x7f44cc15b1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:02:29.747 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:29.740+0000 7f44caffd640 1 --2- 172.21.15.78:0/883226923 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f44cc06d2b0 0x7f44cc15b1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:29.748 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:29.740+0000 7f44caffd640 1 -- 172.21.15.78:0/883226923 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f44cc0c5300 msgr2=0x7f44cc0a8ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:02:29.748 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:29.740+0000 7f44caffd640 1 --2- 172.21.15.78:0/883226923 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f44cc0c5300 0x7f44cc0a8ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:29.748 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:29.740+0000 7f44caffd640 1 -- 172.21.15.78:0/883226923 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44c00094d0 con 0x7f44cc0c3b80 2023-11-28T20:02:29.748 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:29.740+0000 7f44caffd640 1 --2- 172.21.15.78:0/883226923 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f44cc0c3b80 0x7f44cc0a8980 secure :-1 s=READY pgs=968 cs=0 l=1 rev1=1 crypto rx=0x7f44c00ac040 tx=0x7f44c001ad10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:02:29.748 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:29.740+0000 7f44b3fff640 1 -- 172.21.15.78:0/883226923 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44c00aad80 con 0x7f44cc0c3b80 2023-11-28T20:02:29.748 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:29.740+0000 7f44b3fff640 1 -- 172.21.15.78:0/883226923 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f44c00b7070 con 0x7f44cc0c3b80 2023-11-28T20:02:29.748 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:29.740+0000 7f44d1aaa640 1 -- 172.21.15.78:0/883226923 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f44cc14ef80 con 0x7f44cc0c3b80 2023-11-28T20:02:29.749 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:29.740+0000 7f44b3fff640 1 -- 172.21.15.78:0/883226923 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44c0004230 con 0x7f44cc0c3b80 2023-11-28T20:02:29.749 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:29.740+0000 7f44d1aaa640 1 -- 172.21.15.78:0/883226923 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f44cc15b720 con 0x7f44cc0c3b80 2023-11-28T20:02:29.750 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:29.744+0000 7f44d1aaa640 1 -- 172.21.15.78:0/883226923 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f44cc0a82b0 con 0x7f44cc0c3b80 2023-11-28T20:02:29.750 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:29.744+0000 7f44b3fff640 1 -- 172.21.15.78:0/883226923 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f44c0004390 con 0x7f44cc0c3b80 2023-11-28T20:02:29.750 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:29.744+0000 7f44b3fff640 1 --2- 172.21.15.78:0/883226923 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f44b8066470 0x7f44b8068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:29.750 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:29.744+0000 7f44b3fff640 1 -- 172.21.15.78:0/883226923 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6885+0+0 (secure 0 0 0) 0x7f44c011e580 con 0x7f44cc0c3b80 2023-11-28T20:02:29.750 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:29.744+0000 7f44cb7fe640 1 --2- 172.21.15.78:0/883226923 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f44b8066470 0x7f44b8068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:02:29.750 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:29.744+0000 7f44cb7fe640 1 --2- 172.21.15.78:0/883226923 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f44b8066470 0x7f44b8068930 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f44bc007fd0 tx=0x7f44bc007d60 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:02:29.752 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:29.748+0000 7f44b3fff640 1 -- 172.21.15.78:0/883226923 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f44c00eb600 con 0x7f44cc0c3b80 2023-11-28T20:02:29.900 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:29.896+0000 7f44d1aaa640 1 -- 172.21.15.78:0/883226923 --> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f44cc14ee00 con 0x7f44b8066470 2023-11-28T20:02:29.913 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:29.908+0000 7f44b3fff640 1 -- 172.21.15.78:0/883226923 <== mgr.4106 v2:172.21.15.78:6832/2935380957 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+512938 (secure 0 0 0) 0x7f44bc004c80 con 0x7f44b8066470 2023-11-28T20:02:29.918 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-11-28T20:02:29.922 INFO:teuthology.orchestra.run.smithi078.stderr:dumped all 2023-11-28T20:02:29.924 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:29.912+0000 7f44d1aaa640 1 -- 172.21.15.78:0/883226923 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f44b8066470 msgr2=0x7f44b8068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:02:29.924 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:29.912+0000 7f44d1aaa640 1 --2- 172.21.15.78:0/883226923 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f44b8066470 0x7f44b8068930 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f44bc007fd0 tx=0x7f44bc007d60 comp rx=0 tx=0).stop 2023-11-28T20:02:29.924 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:29.912+0000 7f44d1aaa640 1 -- 172.21.15.78:0/883226923 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f44cc0c3b80 msgr2=0x7f44cc0a8980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:02:29.924 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:29.912+0000 7f44d1aaa640 1 --2- 172.21.15.78:0/883226923 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f44cc0c3b80 0x7f44cc0a8980 secure :-1 s=READY pgs=968 cs=0 l=1 rev1=1 crypto rx=0x7f44c00ac040 tx=0x7f44c001ad10 comp rx=0 tx=0).stop 2023-11-28T20:02:29.925 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:29.912+0000 7f44d1aaa640 1 -- 172.21.15.78:0/883226923 shutdown_connections 2023-11-28T20:02:29.925 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:29.912+0000 7f44d1aaa640 1 --2- 172.21.15.78:0/883226923 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f44b8066470 0x7f44b8068930 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:29.925 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:29.912+0000 7f44d1aaa640 1 --2- 172.21.15.78:0/883226923 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f44cc0c5300 0x7f44cc0a8ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:29.925 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:29.912+0000 7f44d1aaa640 1 --2- 172.21.15.78:0/883226923 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f44cc0c3b80 0x7f44cc0a8980 unknown :-1 s=CLOSED pgs=968 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:29.925 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:29.912+0000 7f44d1aaa640 1 --2- 172.21.15.78:0/883226923 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f44cc06d2b0 0x7f44cc15b1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:29.925 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:29.912+0000 7f44d1aaa640 1 -- 172.21.15.78:0/883226923 >> 172.21.15.78:0/883226923 conn(0x7f44cc0a7810 msgr2=0x7f44cc14de50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:02:29.925 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:29.912+0000 7f44d1aaa640 1 -- 172.21.15.78:0/883226923 shutdown_connections 2023-11-28T20:02:29.925 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:29.912+0000 7f44d1aaa640 1 -- 172.21.15.78:0/883226923 wait complete. 2023-11-28T20:02:29.938 INFO:teuthology.orchestra.run.smithi078.stdout:{"pg_ready":true,"pg_map":{"version":186,"stamp":"2023-11-28T20:02:27.995139+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":594273,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":206,"num_write_kb":2433,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":158,"ondisk_log_size":158,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":257436,"kb_used_data":8000,"kb_used_omap":12,"kb_used_meta":249331,"kb_avail":754717284,"statfs":{"total":773094113280,"available":772830498816,"internally_reserved":0,"allocated":8192000,"data_stored":4944954,"data_compressed":66748,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":12752,"internal_metadata":255315504},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.152944"},"pg_stats":[{"pgid":"16.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T20:02:24.842435+0000","last_change":"2023-11-28T20:02:24.842435+0000","last_active":"2023-11-28T20:02:24.842435+0000","last_peered":"2023-11-28T20:02:24.842435+0000","last_clean":"2023-11-28T20:02:24.842435+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:02:24.842435+0000","last_undegraded":"2023-11-28T20:02:24.842435+0000","last_fullsized":"2023-11-28T20:02:24.842435+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:24.842435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:24.842435+0000","last_clean_scrub_stamp":"2023-11-28T20:02:24.842435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.3f","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-28T20:02:09.920561+0000","last_change":"2023-11-28T20:02:08.304755+0000","last_active":"2023-11-28T20:02:09.920561+0000","last_peered":"2023-11-28T20:02:09.920561+0000","last_clean":"2023-11-28T20:02:09.920561+0000","last_became_active":"2023-11-28T20:02:08.304434+0000","last_became_peered":"2023-11-28T20:02:08.304434+0000","last_unstale":"2023-11-28T20:02:09.920561+0000","last_undegraded":"2023-11-28T20:02:09.920561+0000","last_fullsized":"2023-11-28T20:02:09.920561+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_clean_scrub_stamp":"2023-11-28T20:02:07.264604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:58:51.867372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T20:02:24.842435+0000","last_change":"2023-11-28T20:02:24.842435+0000","last_active":"2023-11-28T20:02:24.842435+0000","last_peered":"2023-11-28T20:02:24.842435+0000","last_clean":"2023-11-28T20:02:24.842435+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:02:24.842435+0000","last_undegraded":"2023-11-28T20:02:24.842435+0000","last_fullsized":"2023-11-28T20:02:24.842435+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:24.842435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:24.842435+0000","last_clean_scrub_stamp":"2023-11-28T20:02:24.842435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.3e","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-28T20:02:09.296283+0000","last_change":"2023-11-28T20:02:08.296680+0000","last_active":"2023-11-28T20:02:09.296283+0000","last_peered":"2023-11-28T20:02:09.296283+0000","last_clean":"2023-11-28T20:02:09.296283+0000","last_became_active":"2023-11-28T20:02:08.296004+0000","last_became_peered":"2023-11-28T20:02:08.296004+0000","last_unstale":"2023-11-28T20:02:09.296283+0000","last_undegraded":"2023-11-28T20:02:09.296283+0000","last_fullsized":"2023-11-28T20:02:09.296283+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_clean_scrub_stamp":"2023-11-28T20:02:07.264604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:10:35.205323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T20:02:24.842435+0000","last_change":"2023-11-28T20:02:24.842435+0000","last_active":"2023-11-28T20:02:24.842435+0000","last_peered":"2023-11-28T20:02:24.842435+0000","last_clean":"2023-11-28T20:02:24.842435+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:02:24.842435+0000","last_undegraded":"2023-11-28T20:02:24.842435+0000","last_fullsized":"2023-11-28T20:02:24.842435+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:24.842435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:24.842435+0000","last_clean_scrub_stamp":"2023-11-28T20:02:24.842435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.3d","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-28T20:02:09.920278+0000","last_change":"2023-11-28T20:02:08.308225+0000","last_active":"2023-11-28T20:02:09.920278+0000","last_peered":"2023-11-28T20:02:09.920278+0000","last_clean":"2023-11-28T20:02:09.920278+0000","last_became_active":"2023-11-28T20:02:08.307962+0000","last_became_peered":"2023-11-28T20:02:08.307962+0000","last_unstale":"2023-11-28T20:02:09.920278+0000","last_undegraded":"2023-11-28T20:02:09.920278+0000","last_fullsized":"2023-11-28T20:02:09.920278+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_clean_scrub_stamp":"2023-11-28T20:02:07.264604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:41:07.273185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T20:02:24.842435+0000","last_change":"2023-11-28T20:02:24.842435+0000","last_active":"2023-11-28T20:02:24.842435+0000","last_peered":"2023-11-28T20:02:24.842435+0000","last_clean":"2023-11-28T20:02:24.842435+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:02:24.842435+0000","last_undegraded":"2023-11-28T20:02:24.842435+0000","last_fullsized":"2023-11-28T20:02:24.842435+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:24.842435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:24.842435+0000","last_clean_scrub_stamp":"2023-11-28T20:02:24.842435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.3c","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-28T20:02:09.297390+0000","last_change":"2023-11-28T20:02:08.315019+0000","last_active":"2023-11-28T20:02:09.297390+0000","last_peered":"2023-11-28T20:02:09.297390+0000","last_clean":"2023-11-28T20:02:09.297390+0000","last_became_active":"2023-11-28T20:02:08.314731+0000","last_became_peered":"2023-11-28T20:02:08.314731+0000","last_unstale":"2023-11-28T20:02:09.297390+0000","last_undegraded":"2023-11-28T20:02:09.297390+0000","last_fullsized":"2023-11-28T20:02:09.297390+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_clean_scrub_stamp":"2023-11-28T20:02:07.264604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:42:00.299852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T20:02:24.842435+0000","last_change":"2023-11-28T20:02:24.842435+0000","last_active":"2023-11-28T20:02:24.842435+0000","last_peered":"2023-11-28T20:02:24.842435+0000","last_clean":"2023-11-28T20:02:24.842435+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:02:24.842435+0000","last_undegraded":"2023-11-28T20:02:24.842435+0000","last_fullsized":"2023-11-28T20:02:24.842435+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:24.842435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:24.842435+0000","last_clean_scrub_stamp":"2023-11-28T20:02:24.842435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.3b","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-28T20:02:09.296060+0000","last_change":"2023-11-28T20:02:08.301524+0000","last_active":"2023-11-28T20:02:09.296060+0000","last_peered":"2023-11-28T20:02:09.296060+0000","last_clean":"2023-11-28T20:02:09.296060+0000","last_became_active":"2023-11-28T20:02:08.301223+0000","last_became_peered":"2023-11-28T20:02:08.301223+0000","last_unstale":"2023-11-28T20:02:09.296060+0000","last_undegraded":"2023-11-28T20:02:09.296060+0000","last_fullsized":"2023-11-28T20:02:09.296060+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_clean_scrub_stamp":"2023-11-28T20:02:07.264604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:58:52.570056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T20:02:24.842435+0000","last_change":"2023-11-28T20:02:24.842435+0000","last_active":"2023-11-28T20:02:24.842435+0000","last_peered":"2023-11-28T20:02:24.842435+0000","last_clean":"2023-11-28T20:02:24.842435+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:02:24.842435+0000","last_undegraded":"2023-11-28T20:02:24.842435+0000","last_fullsized":"2023-11-28T20:02:24.842435+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:24.842435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:24.842435+0000","last_clean_scrub_stamp":"2023-11-28T20:02:24.842435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.3a","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-28T20:02:09.341091+0000","last_change":"2023-11-28T20:02:08.309601+0000","last_active":"2023-11-28T20:02:09.341091+0000","last_peered":"2023-11-28T20:02:09.341091+0000","last_clean":"2023-11-28T20:02:09.341091+0000","last_became_active":"2023-11-28T20:02:08.309350+0000","last_became_peered":"2023-11-28T20:02:08.309350+0000","last_unstale":"2023-11-28T20:02:09.341091+0000","last_undegraded":"2023-11-28T20:02:09.341091+0000","last_fullsized":"2023-11-28T20:02:09.341091+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_clean_scrub_stamp":"2023-11-28T20:02:07.264604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:06:22.207175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T20:02:24.842435+0000","last_change":"2023-11-28T20:02:24.842435+0000","last_active":"2023-11-28T20:02:24.842435+0000","last_peered":"2023-11-28T20:02:24.842435+0000","last_clean":"2023-11-28T20:02:24.842435+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:02:24.842435+0000","last_undegraded":"2023-11-28T20:02:24.842435+0000","last_fullsized":"2023-11-28T20:02:24.842435+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:24.842435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:24.842435+0000","last_clean_scrub_stamp":"2023-11-28T20:02:24.842435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.39","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-28T20:02:10.120121+0000","last_change":"2023-11-28T20:02:08.298696+0000","last_active":"2023-11-28T20:02:10.120121+0000","last_peered":"2023-11-28T20:02:10.120121+0000","last_clean":"2023-11-28T20:02:10.120121+0000","last_became_active":"2023-11-28T20:02:08.297650+0000","last_became_peered":"2023-11-28T20:02:08.297650+0000","last_unstale":"2023-11-28T20:02:10.120121+0000","last_undegraded":"2023-11-28T20:02:10.120121+0000","last_fullsized":"2023-11-28T20:02:10.120121+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_clean_scrub_stamp":"2023-11-28T20:02:07.264604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:27:09.260314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T20:02:24.842435+0000","last_change":"2023-11-28T20:02:24.842435+0000","last_active":"2023-11-28T20:02:24.842435+0000","last_peered":"2023-11-28T20:02:24.842435+0000","last_clean":"2023-11-28T20:02:24.842435+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:02:24.842435+0000","last_undegraded":"2023-11-28T20:02:24.842435+0000","last_fullsized":"2023-11-28T20:02:24.842435+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:24.842435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:24.842435+0000","last_clean_scrub_stamp":"2023-11-28T20:02:24.842435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.38","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-28T20:02:09.296990+0000","last_change":"2023-11-28T20:02:08.297052+0000","last_active":"2023-11-28T20:02:09.296990+0000","last_peered":"2023-11-28T20:02:09.296990+0000","last_clean":"2023-11-28T20:02:09.296990+0000","last_became_active":"2023-11-28T20:02:08.295852+0000","last_became_peered":"2023-11-28T20:02:08.295852+0000","last_unstale":"2023-11-28T20:02:09.296990+0000","last_undegraded":"2023-11-28T20:02:09.296990+0000","last_fullsized":"2023-11-28T20:02:09.296990+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_clean_scrub_stamp":"2023-11-28T20:02:07.264604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:33:12.680902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T20:02:24.842435+0000","last_change":"2023-11-28T20:02:24.842435+0000","last_active":"2023-11-28T20:02:24.842435+0000","last_peered":"2023-11-28T20:02:24.842435+0000","last_clean":"2023-11-28T20:02:24.842435+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:02:24.842435+0000","last_undegraded":"2023-11-28T20:02:24.842435+0000","last_fullsized":"2023-11-28T20:02:24.842435+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:24.842435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:24.842435+0000","last_clean_scrub_stamp":"2023-11-28T20:02:24.842435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.37","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-28T20:02:09.295457+0000","last_change":"2023-11-28T20:02:08.297178+0000","last_active":"2023-11-28T20:02:09.295457+0000","last_peered":"2023-11-28T20:02:09.295457+0000","last_clean":"2023-11-28T20:02:09.295457+0000","last_became_active":"2023-11-28T20:02:08.296480+0000","last_became_peered":"2023-11-28T20:02:08.296480+0000","last_unstale":"2023-11-28T20:02:09.295457+0000","last_undegraded":"2023-11-28T20:02:09.295457+0000","last_fullsized":"2023-11-28T20:02:09.295457+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_clean_scrub_stamp":"2023-11-28T20:02:07.264604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:49:05.201081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T20:02:24.842435+0000","last_change":"2023-11-28T20:02:24.842435+0000","last_active":"2023-11-28T20:02:24.842435+0000","last_peered":"2023-11-28T20:02:24.842435+0000","last_clean":"2023-11-28T20:02:24.842435+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:02:24.842435+0000","last_undegraded":"2023-11-28T20:02:24.842435+0000","last_fullsized":"2023-11-28T20:02:24.842435+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:24.842435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:24.842435+0000","last_clean_scrub_stamp":"2023-11-28T20:02:24.842435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.36","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-28T20:02:10.119031+0000","last_change":"2023-11-28T20:02:08.316569+0000","last_active":"2023-11-28T20:02:10.119031+0000","last_peered":"2023-11-28T20:02:10.119031+0000","last_clean":"2023-11-28T20:02:10.119031+0000","last_became_active":"2023-11-28T20:02:08.316305+0000","last_became_peered":"2023-11-28T20:02:08.316305+0000","last_unstale":"2023-11-28T20:02:10.119031+0000","last_undegraded":"2023-11-28T20:02:10.119031+0000","last_fullsized":"2023-11-28T20:02:10.119031+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_clean_scrub_stamp":"2023-11-28T20:02:07.264604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T06:30:11.363319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T20:02:24.842435+0000","last_change":"2023-11-28T20:02:24.842435+0000","last_active":"2023-11-28T20:02:24.842435+0000","last_peered":"2023-11-28T20:02:24.842435+0000","last_clean":"2023-11-28T20:02:24.842435+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:02:24.842435+0000","last_undegraded":"2023-11-28T20:02:24.842435+0000","last_fullsized":"2023-11-28T20:02:24.842435+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:24.842435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:24.842435+0000","last_clean_scrub_stamp":"2023-11-28T20:02:24.842435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.35","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-28T20:02:09.295173+0000","last_change":"2023-11-28T20:02:08.301530+0000","last_active":"2023-11-28T20:02:09.295173+0000","last_peered":"2023-11-28T20:02:09.295173+0000","last_clean":"2023-11-28T20:02:09.295173+0000","last_became_active":"2023-11-28T20:02:08.301047+0000","last_became_peered":"2023-11-28T20:02:08.301047+0000","last_unstale":"2023-11-28T20:02:09.295173+0000","last_undegraded":"2023-11-28T20:02:09.295173+0000","last_fullsized":"2023-11-28T20:02:09.295173+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_clean_scrub_stamp":"2023-11-28T20:02:07.264604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:58:37.957173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T20:02:24.842435+0000","last_change":"2023-11-28T20:02:24.842435+0000","last_active":"2023-11-28T20:02:24.842435+0000","last_peered":"2023-11-28T20:02:24.842435+0000","last_clean":"2023-11-28T20:02:24.842435+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:02:24.842435+0000","last_undegraded":"2023-11-28T20:02:24.842435+0000","last_fullsized":"2023-11-28T20:02:24.842435+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:24.842435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:24.842435+0000","last_clean_scrub_stamp":"2023-11-28T20:02:24.842435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.34","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-28T20:02:10.118805+0000","last_change":"2023-11-28T20:02:08.309936+0000","last_active":"2023-11-28T20:02:10.118805+0000","last_peered":"2023-11-28T20:02:10.118805+0000","last_clean":"2023-11-28T20:02:10.118805+0000","last_became_active":"2023-11-28T20:02:08.309719+0000","last_became_peered":"2023-11-28T20:02:08.309719+0000","last_unstale":"2023-11-28T20:02:10.118805+0000","last_undegraded":"2023-11-28T20:02:10.118805+0000","last_fullsized":"2023-11-28T20:02:10.118805+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_clean_scrub_stamp":"2023-11-28T20:02:07.264604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:31:20.575901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T20:02:24.842435+0000","last_change":"2023-11-28T20:02:24.842435+0000","last_active":"2023-11-28T20:02:24.842435+0000","last_peered":"2023-11-28T20:02:24.842435+0000","last_clean":"2023-11-28T20:02:24.842435+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:02:24.842435+0000","last_undegraded":"2023-11-28T20:02:24.842435+0000","last_fullsized":"2023-11-28T20:02:24.842435+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:24.842435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:24.842435+0000","last_clean_scrub_stamp":"2023-11-28T20:02:24.842435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.33","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-28T20:02:09.297113+0000","last_change":"2023-11-28T20:02:08.294336+0000","last_active":"2023-11-28T20:02:09.297113+0000","last_peered":"2023-11-28T20:02:09.297113+0000","last_clean":"2023-11-28T20:02:09.297113+0000","last_became_active":"2023-11-28T20:02:08.294087+0000","last_became_peered":"2023-11-28T20:02:08.294087+0000","last_unstale":"2023-11-28T20:02:09.297113+0000","last_undegraded":"2023-11-28T20:02:09.297113+0000","last_fullsized":"2023-11-28T20:02:09.297113+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_clean_scrub_stamp":"2023-11-28T20:02:07.264604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:51:11.144383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T20:02:24.842435+0000","last_change":"2023-11-28T20:02:24.842435+0000","last_active":"2023-11-28T20:02:24.842435+0000","last_peered":"2023-11-28T20:02:24.842435+0000","last_clean":"2023-11-28T20:02:24.842435+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:02:24.842435+0000","last_undegraded":"2023-11-28T20:02:24.842435+0000","last_fullsized":"2023-11-28T20:02:24.842435+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:24.842435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:24.842435+0000","last_clean_scrub_stamp":"2023-11-28T20:02:24.842435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.32","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-28T20:02:09.295042+0000","last_change":"2023-11-28T20:02:08.307905+0000","last_active":"2023-11-28T20:02:09.295042+0000","last_peered":"2023-11-28T20:02:09.295042+0000","last_clean":"2023-11-28T20:02:09.295042+0000","last_became_active":"2023-11-28T20:02:08.307623+0000","last_became_peered":"2023-11-28T20:02:08.307623+0000","last_unstale":"2023-11-28T20:02:09.295042+0000","last_undegraded":"2023-11-28T20:02:09.295042+0000","last_fullsized":"2023-11-28T20:02:09.295042+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_clean_scrub_stamp":"2023-11-28T20:02:07.264604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:55:37.170814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T20:02:24.842435+0000","last_change":"2023-11-28T20:02:24.842435+0000","last_active":"2023-11-28T20:02:24.842435+0000","last_peered":"2023-11-28T20:02:24.842435+0000","last_clean":"2023-11-28T20:02:24.842435+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:02:24.842435+0000","last_undegraded":"2023-11-28T20:02:24.842435+0000","last_fullsized":"2023-11-28T20:02:24.842435+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:24.842435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:24.842435+0000","last_clean_scrub_stamp":"2023-11-28T20:02:24.842435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.31","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-28T20:02:09.297071+0000","last_change":"2023-11-28T20:02:08.296139+0000","last_active":"2023-11-28T20:02:09.297071+0000","last_peered":"2023-11-28T20:02:09.297071+0000","last_clean":"2023-11-28T20:02:09.297071+0000","last_became_active":"2023-11-28T20:02:08.295866+0000","last_became_peered":"2023-11-28T20:02:08.295866+0000","last_unstale":"2023-11-28T20:02:09.297071+0000","last_undegraded":"2023-11-28T20:02:09.297071+0000","last_fullsized":"2023-11-28T20:02:09.297071+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_clean_scrub_stamp":"2023-11-28T20:02:07.264604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:18:14.885236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T20:02:24.842435+0000","last_change":"2023-11-28T20:02:24.842435+0000","last_active":"2023-11-28T20:02:24.842435+0000","last_peered":"2023-11-28T20:02:24.842435+0000","last_clean":"2023-11-28T20:02:24.842435+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:02:24.842435+0000","last_undegraded":"2023-11-28T20:02:24.842435+0000","last_fullsized":"2023-11-28T20:02:24.842435+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:24.842435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:24.842435+0000","last_clean_scrub_stamp":"2023-11-28T20:02:24.842435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.30","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-28T20:02:09.341070+0000","last_change":"2023-11-28T20:02:08.302149+0000","last_active":"2023-11-28T20:02:09.341070+0000","last_peered":"2023-11-28T20:02:09.341070+0000","last_clean":"2023-11-28T20:02:09.341070+0000","last_became_active":"2023-11-28T20:02:08.301657+0000","last_became_peered":"2023-11-28T20:02:08.301657+0000","last_unstale":"2023-11-28T20:02:09.341070+0000","last_undegraded":"2023-11-28T20:02:09.341070+0000","last_fullsized":"2023-11-28T20:02:09.341070+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_clean_scrub_stamp":"2023-11-28T20:02:07.264604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:37:52.578636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T20:02:24.842435+0000","last_change":"2023-11-28T20:02:24.842435+0000","last_active":"2023-11-28T20:02:24.842435+0000","last_peered":"2023-11-28T20:02:24.842435+0000","last_clean":"2023-11-28T20:02:24.842435+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:02:24.842435+0000","last_undegraded":"2023-11-28T20:02:24.842435+0000","last_fullsized":"2023-11-28T20:02:24.842435+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:24.842435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:24.842435+0000","last_clean_scrub_stamp":"2023-11-28T20:02:24.842435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.2f","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-28T20:02:09.341484+0000","last_change":"2023-11-28T20:02:08.301087+0000","last_active":"2023-11-28T20:02:09.341484+0000","last_peered":"2023-11-28T20:02:09.341484+0000","last_clean":"2023-11-28T20:02:09.341484+0000","last_became_active":"2023-11-28T20:02:08.300738+0000","last_became_peered":"2023-11-28T20:02:08.300738+0000","last_unstale":"2023-11-28T20:02:09.341484+0000","last_undegraded":"2023-11-28T20:02:09.341484+0000","last_fullsized":"2023-11-28T20:02:09.341484+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_clean_scrub_stamp":"2023-11-28T20:02:07.264604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T07:54:21.325208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T20:02:24.842435+0000","last_change":"2023-11-28T20:02:24.842435+0000","last_active":"2023-11-28T20:02:24.842435+0000","last_peered":"2023-11-28T20:02:24.842435+0000","last_clean":"2023-11-28T20:02:24.842435+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:02:24.842435+0000","last_undegraded":"2023-11-28T20:02:24.842435+0000","last_fullsized":"2023-11-28T20:02:24.842435+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:24.842435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:24.842435+0000","last_clean_scrub_stamp":"2023-11-28T20:02:24.842435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.2e","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-28T20:02:09.920420+0000","last_change":"2023-11-28T20:02:08.294533+0000","last_active":"2023-11-28T20:02:09.920420+0000","last_peered":"2023-11-28T20:02:09.920420+0000","last_clean":"2023-11-28T20:02:09.920420+0000","last_became_active":"2023-11-28T20:02:08.294329+0000","last_became_peered":"2023-11-28T20:02:08.294329+0000","last_unstale":"2023-11-28T20:02:09.920420+0000","last_undegraded":"2023-11-28T20:02:09.920420+0000","last_fullsized":"2023-11-28T20:02:09.920420+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_clean_scrub_stamp":"2023-11-28T20:02:07.264604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:12:41.265139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T20:02:24.842435+0000","last_change":"2023-11-28T20:02:24.842435+0000","last_active":"2023-11-28T20:02:24.842435+0000","last_peered":"2023-11-28T20:02:24.842435+0000","last_clean":"2023-11-28T20:02:24.842435+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:02:24.842435+0000","last_undegraded":"2023-11-28T20:02:24.842435+0000","last_fullsized":"2023-11-28T20:02:24.842435+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:24.842435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:24.842435+0000","last_clean_scrub_stamp":"2023-11-28T20:02:24.842435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.2d","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-28T20:02:09.295289+0000","last_change":"2023-11-28T20:02:08.311901+0000","last_active":"2023-11-28T20:02:09.295289+0000","last_peered":"2023-11-28T20:02:09.295289+0000","last_clean":"2023-11-28T20:02:09.295289+0000","last_became_active":"2023-11-28T20:02:08.311540+0000","last_became_peered":"2023-11-28T20:02:08.311540+0000","last_unstale":"2023-11-28T20:02:09.295289+0000","last_undegraded":"2023-11-28T20:02:09.295289+0000","last_fullsized":"2023-11-28T20:02:09.295289+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_clean_scrub_stamp":"2023-11-28T20:02:07.264604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:46:59.333070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T20:02:24.842435+0000","last_change":"2023-11-28T20:02:24.842435+0000","last_active":"2023-11-28T20:02:24.842435+0000","last_peered":"2023-11-28T20:02:24.842435+0000","last_clean":"2023-11-28T20:02:24.842435+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:02:24.842435+0000","last_undegraded":"2023-11-28T20:02:24.842435+0000","last_fullsized":"2023-11-28T20:02:24.842435+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:24.842435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:24.842435+0000","last_clean_scrub_stamp":"2023-11-28T20:02:24.842435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.2c","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-28T20:02:09.297510+0000","last_change":"2023-11-28T20:02:08.292376+0000","last_active":"2023-11-28T20:02:09.297510+0000","last_peered":"2023-11-28T20:02:09.297510+0000","last_clean":"2023-11-28T20:02:09.297510+0000","last_became_active":"2023-11-28T20:02:08.292042+0000","last_became_peered":"2023-11-28T20:02:08.292042+0000","last_unstale":"2023-11-28T20:02:09.297510+0000","last_undegraded":"2023-11-28T20:02:09.297510+0000","last_fullsized":"2023-11-28T20:02:09.297510+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_clean_scrub_stamp":"2023-11-28T20:02:07.264604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:53:42.852122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T20:02:24.842435+0000","last_change":"2023-11-28T20:02:24.842435+0000","last_active":"2023-11-28T20:02:24.842435+0000","last_peered":"2023-11-28T20:02:24.842435+0000","last_clean":"2023-11-28T20:02:24.842435+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:02:24.842435+0000","last_undegraded":"2023-11-28T20:02:24.842435+0000","last_fullsized":"2023-11-28T20:02:24.842435+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:24.842435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:24.842435+0000","last_clean_scrub_stamp":"2023-11-28T20:02:24.842435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.2b","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-28T20:02:09.295091+0000","last_change":"2023-11-28T20:02:08.297539+0000","last_active":"2023-11-28T20:02:09.295091+0000","last_peered":"2023-11-28T20:02:09.295091+0000","last_clean":"2023-11-28T20:02:09.295091+0000","last_became_active":"2023-11-28T20:02:08.294583+0000","last_became_peered":"2023-11-28T20:02:08.294583+0000","last_unstale":"2023-11-28T20:02:09.295091+0000","last_undegraded":"2023-11-28T20:02:09.295091+0000","last_fullsized":"2023-11-28T20:02:09.295091+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_clean_scrub_stamp":"2023-11-28T20:02:07.264604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:34:43.366405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T20:02:24.842435+0000","last_change":"2023-11-28T20:02:24.842435+0000","last_active":"2023-11-28T20:02:24.842435+0000","last_peered":"2023-11-28T20:02:24.842435+0000","last_clean":"2023-11-28T20:02:24.842435+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:02:24.842435+0000","last_undegraded":"2023-11-28T20:02:24.842435+0000","last_fullsized":"2023-11-28T20:02:24.842435+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:24.842435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:24.842435+0000","last_clean_scrub_stamp":"2023-11-28T20:02:24.842435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.2a","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-28T20:02:09.294938+0000","last_change":"2023-11-28T20:02:08.297073+0000","last_active":"2023-11-28T20:02:09.294938+0000","last_peered":"2023-11-28T20:02:09.294938+0000","last_clean":"2023-11-28T20:02:09.294938+0000","last_became_active":"2023-11-28T20:02:08.296814+0000","last_became_peered":"2023-11-28T20:02:08.296814+0000","last_unstale":"2023-11-28T20:02:09.294938+0000","last_undegraded":"2023-11-28T20:02:09.294938+0000","last_fullsized":"2023-11-28T20:02:09.294938+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_clean_scrub_stamp":"2023-11-28T20:02:07.264604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:00:38.869040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T20:02:24.842435+0000","last_change":"2023-11-28T20:02:24.842435+0000","last_active":"2023-11-28T20:02:24.842435+0000","last_peered":"2023-11-28T20:02:24.842435+0000","last_clean":"2023-11-28T20:02:24.842435+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:02:24.842435+0000","last_undegraded":"2023-11-28T20:02:24.842435+0000","last_fullsized":"2023-11-28T20:02:24.842435+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:24.842435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:24.842435+0000","last_clean_scrub_stamp":"2023-11-28T20:02:24.842435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.29","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-28T20:02:10.120704+0000","last_change":"2023-11-28T20:02:08.308480+0000","last_active":"2023-11-28T20:02:10.120704+0000","last_peered":"2023-11-28T20:02:10.120704+0000","last_clean":"2023-11-28T20:02:10.120704+0000","last_became_active":"2023-11-28T20:02:08.308190+0000","last_became_peered":"2023-11-28T20:02:08.308190+0000","last_unstale":"2023-11-28T20:02:10.120704+0000","last_undegraded":"2023-11-28T20:02:10.120704+0000","last_fullsized":"2023-11-28T20:02:10.120704+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_clean_scrub_stamp":"2023-11-28T20:02:07.264604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:51:11.144383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T20:02:24.842435+0000","last_change":"2023-11-28T20:02:24.842435+0000","last_active":"2023-11-28T20:02:24.842435+0000","last_peered":"2023-11-28T20:02:24.842435+0000","last_clean":"2023-11-28T20:02:24.842435+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:02:24.842435+0000","last_undegraded":"2023-11-28T20:02:24.842435+0000","last_fullsized":"2023-11-28T20:02:24.842435+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:24.842435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:24.842435+0000","last_clean_scrub_stamp":"2023-11-28T20:02:24.842435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.28","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-28T20:02:09.920300+0000","last_change":"2023-11-28T20:02:08.307205+0000","last_active":"2023-11-28T20:02:09.920300+0000","last_peered":"2023-11-28T20:02:09.920300+0000","last_clean":"2023-11-28T20:02:09.920300+0000","last_became_active":"2023-11-28T20:02:08.306954+0000","last_became_peered":"2023-11-28T20:02:08.306954+0000","last_unstale":"2023-11-28T20:02:09.920300+0000","last_undegraded":"2023-11-28T20:02:09.920300+0000","last_fullsized":"2023-11-28T20:02:09.920300+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_clean_scrub_stamp":"2023-11-28T20:02:07.264604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:27:46.451074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T20:02:24.842435+0000","last_change":"2023-11-28T20:02:24.842435+0000","last_active":"2023-11-28T20:02:24.842435+0000","last_peered":"2023-11-28T20:02:24.842435+0000","last_clean":"2023-11-28T20:02:24.842435+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:02:24.842435+0000","last_undegraded":"2023-11-28T20:02:24.842435+0000","last_fullsized":"2023-11-28T20:02:24.842435+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:24.842435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:24.842435+0000","last_clean_scrub_stamp":"2023-11-28T20:02:24.842435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.27","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-28T20:02:09.296373+0000","last_change":"2023-11-28T20:02:08.294531+0000","last_active":"2023-11-28T20:02:09.296373+0000","last_peered":"2023-11-28T20:02:09.296373+0000","last_clean":"2023-11-28T20:02:09.296373+0000","last_became_active":"2023-11-28T20:02:08.294163+0000","last_became_peered":"2023-11-28T20:02:08.294163+0000","last_unstale":"2023-11-28T20:02:09.296373+0000","last_undegraded":"2023-11-28T20:02:09.296373+0000","last_fullsized":"2023-11-28T20:02:09.296373+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_clean_scrub_stamp":"2023-11-28T20:02:07.264604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:21:50.379035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T20:02:24.842435+0000","last_change":"2023-11-28T20:02:24.842435+0000","last_active":"2023-11-28T20:02:24.842435+0000","last_peered":"2023-11-28T20:02:24.842435+0000","last_clean":"2023-11-28T20:02:24.842435+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:02:24.842435+0000","last_undegraded":"2023-11-28T20:02:24.842435+0000","last_fullsized":"2023-11-28T20:02:24.842435+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:24.842435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:24.842435+0000","last_clean_scrub_stamp":"2023-11-28T20:02:24.842435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.26","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-28T20:02:09.295439+0000","last_change":"2023-11-28T20:02:08.307678+0000","last_active":"2023-11-28T20:02:09.295439+0000","last_peered":"2023-11-28T20:02:09.295439+0000","last_clean":"2023-11-28T20:02:09.295439+0000","last_became_active":"2023-11-28T20:02:08.307402+0000","last_became_peered":"2023-11-28T20:02:08.307402+0000","last_unstale":"2023-11-28T20:02:09.295439+0000","last_undegraded":"2023-11-28T20:02:09.295439+0000","last_fullsized":"2023-11-28T20:02:09.295439+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_clean_scrub_stamp":"2023-11-28T20:02:07.264604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:31:57.356139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T20:02:24.842435+0000","last_change":"2023-11-28T20:02:24.842435+0000","last_active":"2023-11-28T20:02:24.842435+0000","last_peered":"2023-11-28T20:02:24.842435+0000","last_clean":"2023-11-28T20:02:24.842435+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:02:24.842435+0000","last_undegraded":"2023-11-28T20:02:24.842435+0000","last_fullsized":"2023-11-28T20:02:24.842435+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:24.842435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:24.842435+0000","last_clean_scrub_stamp":"2023-11-28T20:02:24.842435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.25","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-28T20:02:10.118984+0000","last_change":"2023-11-28T20:02:08.313075+0000","last_active":"2023-11-28T20:02:10.118984+0000","last_peered":"2023-11-28T20:02:10.118984+0000","last_clean":"2023-11-28T20:02:10.118984+0000","last_became_active":"2023-11-28T20:02:08.312852+0000","last_became_peered":"2023-11-28T20:02:08.312852+0000","last_unstale":"2023-11-28T20:02:10.118984+0000","last_undegraded":"2023-11-28T20:02:10.118984+0000","last_fullsized":"2023-11-28T20:02:10.118984+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_clean_scrub_stamp":"2023-11-28T20:02:07.264604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:47:27.485031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T20:02:24.842435+0000","last_change":"2023-11-28T20:02:24.842435+0000","last_active":"2023-11-28T20:02:24.842435+0000","last_peered":"2023-11-28T20:02:24.842435+0000","last_clean":"2023-11-28T20:02:24.842435+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:02:24.842435+0000","last_undegraded":"2023-11-28T20:02:24.842435+0000","last_fullsized":"2023-11-28T20:02:24.842435+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:24.842435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:24.842435+0000","last_clean_scrub_stamp":"2023-11-28T20:02:24.842435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.24","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-28T20:02:09.297627+0000","last_change":"2023-11-28T20:02:08.296547+0000","last_active":"2023-11-28T20:02:09.297627+0000","last_peered":"2023-11-28T20:02:09.297627+0000","last_clean":"2023-11-28T20:02:09.297627+0000","last_became_active":"2023-11-28T20:02:08.296274+0000","last_became_peered":"2023-11-28T20:02:08.296274+0000","last_unstale":"2023-11-28T20:02:09.297627+0000","last_undegraded":"2023-11-28T20:02:09.297627+0000","last_fullsized":"2023-11-28T20:02:09.297627+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_clean_scrub_stamp":"2023-11-28T20:02:07.264604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:40:59.195276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T20:02:24.842435+0000","last_change":"2023-11-28T20:02:24.842435+0000","last_active":"2023-11-28T20:02:24.842435+0000","last_peered":"2023-11-28T20:02:24.842435+0000","last_clean":"2023-11-28T20:02:24.842435+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:02:24.842435+0000","last_undegraded":"2023-11-28T20:02:24.842435+0000","last_fullsized":"2023-11-28T20:02:24.842435+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:24.842435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:24.842435+0000","last_clean_scrub_stamp":"2023-11-28T20:02:24.842435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.23","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-28T20:02:10.120404+0000","last_change":"2023-11-28T20:02:08.313149+0000","last_active":"2023-11-28T20:02:10.120404+0000","last_peered":"2023-11-28T20:02:10.120404+0000","last_clean":"2023-11-28T20:02:10.120404+0000","last_became_active":"2023-11-28T20:02:08.312835+0000","last_became_peered":"2023-11-28T20:02:08.312835+0000","last_unstale":"2023-11-28T20:02:10.120404+0000","last_undegraded":"2023-11-28T20:02:10.120404+0000","last_fullsized":"2023-11-28T20:02:10.120404+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_clean_scrub_stamp":"2023-11-28T20:02:07.264604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:56:59.351869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T20:02:24.842435+0000","last_change":"2023-11-28T20:02:24.842435+0000","last_active":"2023-11-28T20:02:24.842435+0000","last_peered":"2023-11-28T20:02:24.842435+0000","last_clean":"2023-11-28T20:02:24.842435+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:02:24.842435+0000","last_undegraded":"2023-11-28T20:02:24.842435+0000","last_fullsized":"2023-11-28T20:02:24.842435+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:24.842435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:24.842435+0000","last_clean_scrub_stamp":"2023-11-28T20:02:24.842435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.22","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-28T20:02:09.295801+0000","last_change":"2023-11-28T20:02:08.296480+0000","last_active":"2023-11-28T20:02:09.295801+0000","last_peered":"2023-11-28T20:02:09.295801+0000","last_clean":"2023-11-28T20:02:09.295801+0000","last_became_active":"2023-11-28T20:02:08.293946+0000","last_became_peered":"2023-11-28T20:02:08.293946+0000","last_unstale":"2023-11-28T20:02:09.295801+0000","last_undegraded":"2023-11-28T20:02:09.295801+0000","last_fullsized":"2023-11-28T20:02:09.295801+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_clean_scrub_stamp":"2023-11-28T20:02:07.264604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:56:40.073193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T20:02:24.842435+0000","last_change":"2023-11-28T20:02:24.842435+0000","last_active":"2023-11-28T20:02:24.842435+0000","last_peered":"2023-11-28T20:02:24.842435+0000","last_clean":"2023-11-28T20:02:24.842435+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:02:24.842435+0000","last_undegraded":"2023-11-28T20:02:24.842435+0000","last_fullsized":"2023-11-28T20:02:24.842435+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:24.842435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:24.842435+0000","last_clean_scrub_stamp":"2023-11-28T20:02:24.842435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.21","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-28T20:02:09.294998+0000","last_change":"2023-11-28T20:02:08.287344+0000","last_active":"2023-11-28T20:02:09.294998+0000","last_peered":"2023-11-28T20:02:09.294998+0000","last_clean":"2023-11-28T20:02:09.294998+0000","last_became_active":"2023-11-28T20:02:08.287066+0000","last_became_peered":"2023-11-28T20:02:08.287066+0000","last_unstale":"2023-11-28T20:02:09.294998+0000","last_undegraded":"2023-11-28T20:02:09.294998+0000","last_fullsized":"2023-11-28T20:02:09.294998+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_clean_scrub_stamp":"2023-11-28T20:02:07.264604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:53:42.852122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T20:02:24.842435+0000","last_change":"2023-11-28T20:02:24.842435+0000","last_active":"2023-11-28T20:02:24.842435+0000","last_peered":"2023-11-28T20:02:24.842435+0000","last_clean":"2023-11-28T20:02:24.842435+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:02:24.842435+0000","last_undegraded":"2023-11-28T20:02:24.842435+0000","last_fullsized":"2023-11-28T20:02:24.842435+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:24.842435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:24.842435+0000","last_clean_scrub_stamp":"2023-11-28T20:02:24.842435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.20","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-28T20:02:09.341433+0000","last_change":"2023-11-28T20:02:08.301980+0000","last_active":"2023-11-28T20:02:09.341433+0000","last_peered":"2023-11-28T20:02:09.341433+0000","last_clean":"2023-11-28T20:02:09.341433+0000","last_became_active":"2023-11-28T20:02:08.301384+0000","last_became_peered":"2023-11-28T20:02:08.301384+0000","last_unstale":"2023-11-28T20:02:09.341433+0000","last_undegraded":"2023-11-28T20:02:09.341433+0000","last_fullsized":"2023-11-28T20:02:09.341433+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_clean_scrub_stamp":"2023-11-28T20:02:07.264604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:54:01.736053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T20:02:24.842435+0000","last_change":"2023-11-28T20:02:24.842435+0000","last_active":"2023-11-28T20:02:24.842435+0000","last_peered":"2023-11-28T20:02:24.842435+0000","last_clean":"2023-11-28T20:02:24.842435+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:02:24.842435+0000","last_undegraded":"2023-11-28T20:02:24.842435+0000","last_fullsized":"2023-11-28T20:02:24.842435+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:24.842435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:24.842435+0000","last_clean_scrub_stamp":"2023-11-28T20:02:24.842435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T20:02:23.834083+0000","last_change":"2023-11-28T20:02:23.834083+0000","last_active":"2023-11-28T20:02:23.834083+0000","last_peered":"2023-11-28T20:02:23.834083+0000","last_clean":"2023-11-28T20:02:23.834083+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:02:23.834083+0000","last_undegraded":"2023-11-28T20:02:23.834083+0000","last_fullsized":"2023-11-28T20:02:23.834083+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:23.834083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:23.834083+0000","last_clean_scrub_stamp":"2023-11-28T20:02:23.834083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.1c","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-28T20:02:09.341401+0000","last_change":"2023-11-28T20:02:08.306450+0000","last_active":"2023-11-28T20:02:09.341401+0000","last_peered":"2023-11-28T20:02:09.341401+0000","last_clean":"2023-11-28T20:02:09.341401+0000","last_became_active":"2023-11-28T20:02:08.305331+0000","last_became_peered":"2023-11-28T20:02:08.305331+0000","last_unstale":"2023-11-28T20:02:09.341401+0000","last_undegraded":"2023-11-28T20:02:09.341401+0000","last_fullsized":"2023-11-28T20:02:09.341401+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_clean_scrub_stamp":"2023-11-28T20:02:07.264604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:45:53.384489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1f","version":"80'4","reported_seq":16,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-28T20:02:08.320033+0000","last_change":"2023-11-28T20:02:07.298433+0000","last_active":"2023-11-28T20:02:08.320033+0000","last_peered":"2023-11-28T20:02:08.320033+0000","last_clean":"2023-11-28T20:02:08.320033+0000","last_became_active":"2023-11-28T20:02:07.298106+0000","last_became_peered":"2023-11-28T20:02:07.298106+0000","last_unstale":"2023-11-28T20:02:08.320033+0000","last_undegraded":"2023-11-28T20:02:08.320033+0000","last_fullsized":"2023-11-28T20:02:08.320033+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:06.257335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:06.257335+0000","last_clean_scrub_stamp":"2023-11-28T20:02:06.257335+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:31:56.348870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T20:02:24.842435+0000","last_change":"2023-11-28T20:02:24.842435+0000","last_active":"2023-11-28T20:02:24.842435+0000","last_peered":"2023-11-28T20:02:24.842435+0000","last_clean":"2023-11-28T20:02:24.842435+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:02:24.842435+0000","last_undegraded":"2023-11-28T20:02:24.842435+0000","last_fullsized":"2023-11-28T20:02:24.842435+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:24.842435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:24.842435+0000","last_clean_scrub_stamp":"2023-11-28T20:02:24.842435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T20:02:23.834083+0000","last_change":"2023-11-28T20:02:23.834083+0000","last_active":"2023-11-28T20:02:23.834083+0000","last_peered":"2023-11-28T20:02:23.834083+0000","last_clean":"2023-11-28T20:02:23.834083+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:02:23.834083+0000","last_undegraded":"2023-11-28T20:02:23.834083+0000","last_fullsized":"2023-11-28T20:02:23.834083+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:23.834083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:23.834083+0000","last_clean_scrub_stamp":"2023-11-28T20:02:23.834083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.1d","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-28T20:02:09.341415+0000","last_change":"2023-11-28T20:02:08.317121+0000","last_active":"2023-11-28T20:02:09.341415+0000","last_peered":"2023-11-28T20:02:09.341415+0000","last_clean":"2023-11-28T20:02:09.341415+0000","last_became_active":"2023-11-28T20:02:08.316880+0000","last_became_peered":"2023-11-28T20:02:08.316880+0000","last_unstale":"2023-11-28T20:02:09.341415+0000","last_undegraded":"2023-11-28T20:02:09.341415+0000","last_fullsized":"2023-11-28T20:02:09.341415+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_clean_scrub_stamp":"2023-11-28T20:02:07.264604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T06:42:59.198543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1e","version":"80'1","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-28T20:02:08.311405+0000","last_change":"2023-11-28T20:02:07.293164+0000","last_active":"2023-11-28T20:02:08.311405+0000","last_peered":"2023-11-28T20:02:08.311405+0000","last_clean":"2023-11-28T20:02:08.311405+0000","last_became_active":"2023-11-28T20:02:07.292799+0000","last_became_peered":"2023-11-28T20:02:07.292799+0000","last_unstale":"2023-11-28T20:02:08.311405+0000","last_undegraded":"2023-11-28T20:02:08.311405+0000","last_fullsized":"2023-11-28T20:02:08.311405+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:06.257335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:06.257335+0000","last_clean_scrub_stamp":"2023-11-28T20:02:06.257335+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:32:46.550427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T20:02:24.842435+0000","last_change":"2023-11-28T20:02:24.842435+0000","last_active":"2023-11-28T20:02:24.842435+0000","last_peered":"2023-11-28T20:02:24.842435+0000","last_clean":"2023-11-28T20:02:24.842435+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:02:24.842435+0000","last_undegraded":"2023-11-28T20:02:24.842435+0000","last_fullsized":"2023-11-28T20:02:24.842435+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:24.842435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:24.842435+0000","last_clean_scrub_stamp":"2023-11-28T20:02:24.842435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T20:02:23.834083+0000","last_change":"2023-11-28T20:02:23.834083+0000","last_active":"2023-11-28T20:02:23.834083+0000","last_peered":"2023-11-28T20:02:23.834083+0000","last_clean":"2023-11-28T20:02:23.834083+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:02:23.834083+0000","last_undegraded":"2023-11-28T20:02:23.834083+0000","last_fullsized":"2023-11-28T20:02:23.834083+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:23.834083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:23.834083+0000","last_clean_scrub_stamp":"2023-11-28T20:02:23.834083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.1e","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-28T20:02:10.120225+0000","last_change":"2023-11-28T20:02:08.307558+0000","last_active":"2023-11-28T20:02:10.120225+0000","last_peered":"2023-11-28T20:02:10.120225+0000","last_clean":"2023-11-28T20:02:10.120225+0000","last_became_active":"2023-11-28T20:02:08.307293+0000","last_became_peered":"2023-11-28T20:02:08.307293+0000","last_unstale":"2023-11-28T20:02:10.120225+0000","last_undegraded":"2023-11-28T20:02:10.120225+0000","last_fullsized":"2023-11-28T20:02:10.120225+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_clean_scrub_stamp":"2023-11-28T20:02:07.264604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:31:10.520073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.1d","version":"80'2","reported_seq":14,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-28T20:02:08.315050+0000","last_change":"2023-11-28T20:02:07.298412+0000","last_active":"2023-11-28T20:02:08.315050+0000","last_peered":"2023-11-28T20:02:08.315050+0000","last_clean":"2023-11-28T20:02:08.315050+0000","last_became_active":"2023-11-28T20:02:07.297937+0000","last_became_peered":"2023-11-28T20:02:07.297937+0000","last_unstale":"2023-11-28T20:02:08.315050+0000","last_undegraded":"2023-11-28T20:02:08.315050+0000","last_fullsized":"2023-11-28T20:02:08.315050+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:06.257335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:06.257335+0000","last_clean_scrub_stamp":"2023-11-28T20:02:06.257335+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:10:00.652865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T20:02:24.842435+0000","last_change":"2023-11-28T20:02:24.842435+0000","last_active":"2023-11-28T20:02:24.842435+0000","last_peered":"2023-11-28T20:02:24.842435+0000","last_clean":"2023-11-28T20:02:24.842435+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:02:24.842435+0000","last_undegraded":"2023-11-28T20:02:24.842435+0000","last_fullsized":"2023-11-28T20:02:24.842435+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:24.842435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:24.842435+0000","last_clean_scrub_stamp":"2023-11-28T20:02:24.842435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T20:02:23.834083+0000","last_change":"2023-11-28T20:02:23.834083+0000","last_active":"2023-11-28T20:02:23.834083+0000","last_peered":"2023-11-28T20:02:23.834083+0000","last_clean":"2023-11-28T20:02:23.834083+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:02:23.834083+0000","last_undegraded":"2023-11-28T20:02:23.834083+0000","last_fullsized":"2023-11-28T20:02:23.834083+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:23.834083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:23.834083+0000","last_clean_scrub_stamp":"2023-11-28T20:02:23.834083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.1f","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-28T20:02:09.341542+0000","last_change":"2023-11-28T20:02:08.300921+0000","last_active":"2023-11-28T20:02:09.341542+0000","last_peered":"2023-11-28T20:02:09.341542+0000","last_clean":"2023-11-28T20:02:09.341542+0000","last_became_active":"2023-11-28T20:02:08.300407+0000","last_became_peered":"2023-11-28T20:02:08.300407+0000","last_unstale":"2023-11-28T20:02:09.341542+0000","last_undegraded":"2023-11-28T20:02:09.341542+0000","last_fullsized":"2023-11-28T20:02:09.341542+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_clean_scrub_stamp":"2023-11-28T20:02:07.264604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T07:27:12.455346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1c","version":"80'2","reported_seq":14,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-28T20:02:08.316401+0000","last_change":"2023-11-28T20:02:07.303442+0000","last_active":"2023-11-28T20:02:08.316401+0000","last_peered":"2023-11-28T20:02:08.316401+0000","last_clean":"2023-11-28T20:02:08.316401+0000","last_became_active":"2023-11-28T20:02:07.302881+0000","last_became_peered":"2023-11-28T20:02:07.302881+0000","last_unstale":"2023-11-28T20:02:08.316401+0000","last_undegraded":"2023-11-28T20:02:08.316401+0000","last_fullsized":"2023-11-28T20:02:08.316401+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:06.257335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:06.257335+0000","last_clean_scrub_stamp":"2023-11-28T20:02:06.257335+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:32:53.356561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T20:02:24.842435+0000","last_change":"2023-11-28T20:02:24.842435+0000","last_active":"2023-11-28T20:02:24.842435+0000","last_peered":"2023-11-28T20:02:24.842435+0000","last_clean":"2023-11-28T20:02:24.842435+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:02:24.842435+0000","last_undegraded":"2023-11-28T20:02:24.842435+0000","last_fullsized":"2023-11-28T20:02:24.842435+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:24.842435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:24.842435+0000","last_clean_scrub_stamp":"2023-11-28T20:02:24.842435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T20:02:23.834083+0000","last_change":"2023-11-28T20:02:23.834083+0000","last_active":"2023-11-28T20:02:23.834083+0000","last_peered":"2023-11-28T20:02:23.834083+0000","last_clean":"2023-11-28T20:02:23.834083+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:02:23.834083+0000","last_undegraded":"2023-11-28T20:02:23.834083+0000","last_fullsized":"2023-11-28T20:02:23.834083+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:23.834083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:23.834083+0000","last_clean_scrub_stamp":"2023-11-28T20:02:23.834083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.18","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-28T20:02:09.296991+0000","last_change":"2023-11-28T20:02:08.301741+0000","last_active":"2023-11-28T20:02:09.296991+0000","last_peered":"2023-11-28T20:02:09.296991+0000","last_clean":"2023-11-28T20:02:09.296991+0000","last_became_active":"2023-11-28T20:02:08.296574+0000","last_became_peered":"2023-11-28T20:02:08.296574+0000","last_unstale":"2023-11-28T20:02:09.296991+0000","last_undegraded":"2023-11-28T20:02:09.296991+0000","last_fullsized":"2023-11-28T20:02:09.296991+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_clean_scrub_stamp":"2023-11-28T20:02:07.264604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:55:48.206640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.1b","version":"80'1","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-28T20:02:08.314885+0000","last_change":"2023-11-28T20:02:07.292245+0000","last_active":"2023-11-28T20:02:08.314885+0000","last_peered":"2023-11-28T20:02:08.314885+0000","last_clean":"2023-11-28T20:02:08.314885+0000","last_became_active":"2023-11-28T20:02:07.291923+0000","last_became_peered":"2023-11-28T20:02:07.291923+0000","last_unstale":"2023-11-28T20:02:08.314885+0000","last_undegraded":"2023-11-28T20:02:08.314885+0000","last_fullsized":"2023-11-28T20:02:08.314885+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:06.257335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:06.257335+0000","last_clean_scrub_stamp":"2023-11-28T20:02:06.257335+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T07:18:58.610557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T20:02:24.842435+0000","last_change":"2023-11-28T20:02:24.842435+0000","last_active":"2023-11-28T20:02:24.842435+0000","last_peered":"2023-11-28T20:02:24.842435+0000","last_clean":"2023-11-28T20:02:24.842435+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:02:24.842435+0000","last_undegraded":"2023-11-28T20:02:24.842435+0000","last_fullsized":"2023-11-28T20:02:24.842435+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:24.842435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:24.842435+0000","last_clean_scrub_stamp":"2023-11-28T20:02:24.842435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T20:02:23.834083+0000","last_change":"2023-11-28T20:02:23.834083+0000","last_active":"2023-11-28T20:02:23.834083+0000","last_peered":"2023-11-28T20:02:23.834083+0000","last_clean":"2023-11-28T20:02:23.834083+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:02:23.834083+0000","last_undegraded":"2023-11-28T20:02:23.834083+0000","last_fullsized":"2023-11-28T20:02:23.834083+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:23.834083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:23.834083+0000","last_clean_scrub_stamp":"2023-11-28T20:02:23.834083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.19","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-28T20:02:10.120041+0000","last_change":"2023-11-28T20:02:08.306953+0000","last_active":"2023-11-28T20:02:10.120041+0000","last_peered":"2023-11-28T20:02:10.120041+0000","last_clean":"2023-11-28T20:02:10.120041+0000","last_became_active":"2023-11-28T20:02:08.302688+0000","last_became_peered":"2023-11-28T20:02:08.302688+0000","last_unstale":"2023-11-28T20:02:10.120041+0000","last_undegraded":"2023-11-28T20:02:10.120041+0000","last_fullsized":"2023-11-28T20:02:10.120041+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_clean_scrub_stamp":"2023-11-28T20:02:07.264604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:33:12.680902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1a","version":"80'1","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-28T20:02:08.320938+0000","last_change":"2023-11-28T20:02:07.297038+0000","last_active":"2023-11-28T20:02:08.320938+0000","last_peered":"2023-11-28T20:02:08.320938+0000","last_clean":"2023-11-28T20:02:08.320938+0000","last_became_active":"2023-11-28T20:02:07.295472+0000","last_became_peered":"2023-11-28T20:02:07.295472+0000","last_unstale":"2023-11-28T20:02:08.320938+0000","last_undegraded":"2023-11-28T20:02:08.320938+0000","last_fullsized":"2023-11-28T20:02:08.320938+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:06.257335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:06.257335+0000","last_clean_scrub_stamp":"2023-11-28T20:02:06.257335+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:26:07.339153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T20:02:24.842435+0000","last_change":"2023-11-28T20:02:24.842435+0000","last_active":"2023-11-28T20:02:24.842435+0000","last_peered":"2023-11-28T20:02:24.842435+0000","last_clean":"2023-11-28T20:02:24.842435+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:02:24.842435+0000","last_undegraded":"2023-11-28T20:02:24.842435+0000","last_fullsized":"2023-11-28T20:02:24.842435+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:24.842435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:24.842435+0000","last_clean_scrub_stamp":"2023-11-28T20:02:24.842435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T20:02:23.834083+0000","last_change":"2023-11-28T20:02:23.834083+0000","last_active":"2023-11-28T20:02:23.834083+0000","last_peered":"2023-11-28T20:02:23.834083+0000","last_clean":"2023-11-28T20:02:23.834083+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:02:23.834083+0000","last_undegraded":"2023-11-28T20:02:23.834083+0000","last_fullsized":"2023-11-28T20:02:23.834083+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:23.834083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:23.834083+0000","last_clean_scrub_stamp":"2023-11-28T20:02:23.834083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.1a","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-28T20:02:09.341086+0000","last_change":"2023-11-28T20:02:08.306474+0000","last_active":"2023-11-28T20:02:09.341086+0000","last_peered":"2023-11-28T20:02:09.341086+0000","last_clean":"2023-11-28T20:02:09.341086+0000","last_became_active":"2023-11-28T20:02:08.306183+0000","last_became_peered":"2023-11-28T20:02:08.306183+0000","last_unstale":"2023-11-28T20:02:09.341086+0000","last_undegraded":"2023-11-28T20:02:09.341086+0000","last_fullsized":"2023-11-28T20:02:09.341086+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_clean_scrub_stamp":"2023-11-28T20:02:07.264604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:58:51.867372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.19","version":"0'0","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-28T20:02:08.283967+0000","last_change":"2023-11-28T20:02:07.292322+0000","last_active":"2023-11-28T20:02:08.283967+0000","last_peered":"2023-11-28T20:02:08.283967+0000","last_clean":"2023-11-28T20:02:08.283967+0000","last_became_active":"2023-11-28T20:02:07.292063+0000","last_became_peered":"2023-11-28T20:02:07.292063+0000","last_unstale":"2023-11-28T20:02:08.283967+0000","last_undegraded":"2023-11-28T20:02:08.283967+0000","last_fullsized":"2023-11-28T20:02:08.283967+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:06.257335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:06.257335+0000","last_clean_scrub_stamp":"2023-11-28T20:02:06.257335+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:31:09.512804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T20:02:24.842435+0000","last_change":"2023-11-28T20:02:24.842435+0000","last_active":"2023-11-28T20:02:24.842435+0000","last_peered":"2023-11-28T20:02:24.842435+0000","last_clean":"2023-11-28T20:02:24.842435+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:02:24.842435+0000","last_undegraded":"2023-11-28T20:02:24.842435+0000","last_fullsized":"2023-11-28T20:02:24.842435+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:24.842435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:24.842435+0000","last_clean_scrub_stamp":"2023-11-28T20:02:24.842435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T20:02:23.834083+0000","last_change":"2023-11-28T20:02:23.834083+0000","last_active":"2023-11-28T20:02:23.834083+0000","last_peered":"2023-11-28T20:02:23.834083+0000","last_clean":"2023-11-28T20:02:23.834083+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:02:23.834083+0000","last_undegraded":"2023-11-28T20:02:23.834083+0000","last_fullsized":"2023-11-28T20:02:23.834083+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:23.834083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:23.834083+0000","last_clean_scrub_stamp":"2023-11-28T20:02:23.834083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.1b","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-28T20:02:09.297396+0000","last_change":"2023-11-28T20:02:08.308147+0000","last_active":"2023-11-28T20:02:09.297396+0000","last_peered":"2023-11-28T20:02:09.297396+0000","last_clean":"2023-11-28T20:02:09.297396+0000","last_became_active":"2023-11-28T20:02:08.307818+0000","last_became_peered":"2023-11-28T20:02:08.307818+0000","last_unstale":"2023-11-28T20:02:09.297396+0000","last_undegraded":"2023-11-28T20:02:09.297396+0000","last_fullsized":"2023-11-28T20:02:09.297396+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_clean_scrub_stamp":"2023-11-28T20:02:07.264604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T06:29:21.322854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.18","version":"0'0","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-28T20:02:08.287940+0000","last_change":"2023-11-28T20:02:07.298452+0000","last_active":"2023-11-28T20:02:08.287940+0000","last_peered":"2023-11-28T20:02:08.287940+0000","last_clean":"2023-11-28T20:02:08.287940+0000","last_became_active":"2023-11-28T20:02:07.297932+0000","last_became_peered":"2023-11-28T20:02:07.297932+0000","last_unstale":"2023-11-28T20:02:08.287940+0000","last_undegraded":"2023-11-28T20:02:08.287940+0000","last_fullsized":"2023-11-28T20:02:08.287940+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:06.257335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:06.257335+0000","last_clean_scrub_stamp":"2023-11-28T20:02:06.257335+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:31:16.962567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T20:02:24.842435+0000","last_change":"2023-11-28T20:02:24.842435+0000","last_active":"2023-11-28T20:02:24.842435+0000","last_peered":"2023-11-28T20:02:24.842435+0000","last_clean":"2023-11-28T20:02:24.842435+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:02:24.842435+0000","last_undegraded":"2023-11-28T20:02:24.842435+0000","last_fullsized":"2023-11-28T20:02:24.842435+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:24.842435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:24.842435+0000","last_clean_scrub_stamp":"2023-11-28T20:02:24.842435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T20:02:23.834083+0000","last_change":"2023-11-28T20:02:23.834083+0000","last_active":"2023-11-28T20:02:23.834083+0000","last_peered":"2023-11-28T20:02:23.834083+0000","last_clean":"2023-11-28T20:02:23.834083+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:02:23.834083+0000","last_undegraded":"2023-11-28T20:02:23.834083+0000","last_fullsized":"2023-11-28T20:02:23.834083+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:23.834083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:23.834083+0000","last_clean_scrub_stamp":"2023-11-28T20:02:23.834083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.14","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-28T20:02:09.295715+0000","last_change":"2023-11-28T20:02:08.298743+0000","last_active":"2023-11-28T20:02:09.295715+0000","last_peered":"2023-11-28T20:02:09.295715+0000","last_clean":"2023-11-28T20:02:09.295715+0000","last_became_active":"2023-11-28T20:02:08.298491+0000","last_became_peered":"2023-11-28T20:02:08.298491+0000","last_unstale":"2023-11-28T20:02:09.295715+0000","last_undegraded":"2023-11-28T20:02:09.295715+0000","last_fullsized":"2023-11-28T20:02:09.295715+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_clean_scrub_stamp":"2023-11-28T20:02:07.264604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:32:54.363830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.17","version":"0'0","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-28T20:02:08.281037+0000","last_change":"2023-11-28T20:02:07.299173+0000","last_active":"2023-11-28T20:02:08.281037+0000","last_peered":"2023-11-28T20:02:08.281037+0000","last_clean":"2023-11-28T20:02:08.281037+0000","last_became_active":"2023-11-28T20:02:07.298892+0000","last_became_peered":"2023-11-28T20:02:07.298892+0000","last_unstale":"2023-11-28T20:02:08.281037+0000","last_undegraded":"2023-11-28T20:02:08.281037+0000","last_fullsized":"2023-11-28T20:02:08.281037+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:06.257335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:06.257335+0000","last_clean_scrub_stamp":"2023-11-28T20:02:06.257335+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:50:01.847152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T20:02:24.842435+0000","last_change":"2023-11-28T20:02:24.842435+0000","last_active":"2023-11-28T20:02:24.842435+0000","last_peered":"2023-11-28T20:02:24.842435+0000","last_clean":"2023-11-28T20:02:24.842435+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:02:24.842435+0000","last_undegraded":"2023-11-28T20:02:24.842435+0000","last_fullsized":"2023-11-28T20:02:24.842435+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:24.842435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:24.842435+0000","last_clean_scrub_stamp":"2023-11-28T20:02:24.842435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T20:02:23.834083+0000","last_change":"2023-11-28T20:02:23.834083+0000","last_active":"2023-11-28T20:02:23.834083+0000","last_peered":"2023-11-28T20:02:23.834083+0000","last_clean":"2023-11-28T20:02:23.834083+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:02:23.834083+0000","last_undegraded":"2023-11-28T20:02:23.834083+0000","last_fullsized":"2023-11-28T20:02:23.834083+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:23.834083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:23.834083+0000","last_clean_scrub_stamp":"2023-11-28T20:02:23.834083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.15","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-28T20:02:10.120342+0000","last_change":"2023-11-28T20:02:08.303341+0000","last_active":"2023-11-28T20:02:10.120342+0000","last_peered":"2023-11-28T20:02:10.120342+0000","last_clean":"2023-11-28T20:02:10.120342+0000","last_became_active":"2023-11-28T20:02:08.303067+0000","last_became_peered":"2023-11-28T20:02:08.303067+0000","last_unstale":"2023-11-28T20:02:10.120342+0000","last_undegraded":"2023-11-28T20:02:10.120342+0000","last_fullsized":"2023-11-28T20:02:10.120342+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_clean_scrub_stamp":"2023-11-28T20:02:07.264604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:54:53.728600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.16","version":"0'0","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-28T20:02:08.284454+0000","last_change":"2023-11-28T20:02:07.291621+0000","last_active":"2023-11-28T20:02:08.284454+0000","last_peered":"2023-11-28T20:02:08.284454+0000","last_clean":"2023-11-28T20:02:08.284454+0000","last_became_active":"2023-11-28T20:02:07.288923+0000","last_became_peered":"2023-11-28T20:02:07.288923+0000","last_unstale":"2023-11-28T20:02:08.284454+0000","last_undegraded":"2023-11-28T20:02:08.284454+0000","last_fullsized":"2023-11-28T20:02:08.284454+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:06.257335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:06.257335+0000","last_clean_scrub_stamp":"2023-11-28T20:02:06.257335+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:54:52.721331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T20:02:24.842435+0000","last_change":"2023-11-28T20:02:24.842435+0000","last_active":"2023-11-28T20:02:24.842435+0000","last_peered":"2023-11-28T20:02:24.842435+0000","last_clean":"2023-11-28T20:02:24.842435+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:02:24.842435+0000","last_undegraded":"2023-11-28T20:02:24.842435+0000","last_fullsized":"2023-11-28T20:02:24.842435+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:24.842435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:24.842435+0000","last_clean_scrub_stamp":"2023-11-28T20:02:24.842435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T20:02:23.834083+0000","last_change":"2023-11-28T20:02:23.834083+0000","last_active":"2023-11-28T20:02:23.834083+0000","last_peered":"2023-11-28T20:02:23.834083+0000","last_clean":"2023-11-28T20:02:23.834083+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:02:23.834083+0000","last_undegraded":"2023-11-28T20:02:23.834083+0000","last_fullsized":"2023-11-28T20:02:23.834083+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:23.834083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:23.834083+0000","last_clean_scrub_stamp":"2023-11-28T20:02:23.834083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.16","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-28T20:02:09.920446+0000","last_change":"2023-11-28T20:02:08.295869+0000","last_active":"2023-11-28T20:02:09.920446+0000","last_peered":"2023-11-28T20:02:09.920446+0000","last_clean":"2023-11-28T20:02:09.920446+0000","last_became_active":"2023-11-28T20:02:08.295474+0000","last_became_peered":"2023-11-28T20:02:08.295474+0000","last_unstale":"2023-11-28T20:02:09.920446+0000","last_undegraded":"2023-11-28T20:02:09.920446+0000","last_fullsized":"2023-11-28T20:02:09.920446+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_clean_scrub_stamp":"2023-11-28T20:02:07.264604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:37:52.578636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.15","version":"80'3","reported_seq":15,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-28T20:02:08.321793+0000","last_change":"2023-11-28T20:02:07.300162+0000","last_active":"2023-11-28T20:02:08.321793+0000","last_peered":"2023-11-28T20:02:08.321793+0000","last_clean":"2023-11-28T20:02:08.321793+0000","last_became_active":"2023-11-28T20:02:07.299792+0000","last_became_peered":"2023-11-28T20:02:07.299792+0000","last_unstale":"2023-11-28T20:02:08.321793+0000","last_undegraded":"2023-11-28T20:02:08.321793+0000","last_fullsized":"2023-11-28T20:02:08.321793+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:06.257335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:06.257335+0000","last_clean_scrub_stamp":"2023-11-28T20:02:06.257335+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:42:57.441074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T20:02:24.842435+0000","last_change":"2023-11-28T20:02:24.842435+0000","last_active":"2023-11-28T20:02:24.842435+0000","last_peered":"2023-11-28T20:02:24.842435+0000","last_clean":"2023-11-28T20:02:24.842435+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:02:24.842435+0000","last_undegraded":"2023-11-28T20:02:24.842435+0000","last_fullsized":"2023-11-28T20:02:24.842435+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:24.842435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:24.842435+0000","last_clean_scrub_stamp":"2023-11-28T20:02:24.842435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T20:02:23.834083+0000","last_change":"2023-11-28T20:02:23.834083+0000","last_active":"2023-11-28T20:02:23.834083+0000","last_peered":"2023-11-28T20:02:23.834083+0000","last_clean":"2023-11-28T20:02:23.834083+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:02:23.834083+0000","last_undegraded":"2023-11-28T20:02:23.834083+0000","last_fullsized":"2023-11-28T20:02:23.834083+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:23.834083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:23.834083+0000","last_clean_scrub_stamp":"2023-11-28T20:02:23.834083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.17","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-28T20:02:09.297548+0000","last_change":"2023-11-28T20:02:08.286867+0000","last_active":"2023-11-28T20:02:09.297548+0000","last_peered":"2023-11-28T20:02:09.297548+0000","last_clean":"2023-11-28T20:02:09.297548+0000","last_became_active":"2023-11-28T20:02:08.286448+0000","last_became_peered":"2023-11-28T20:02:08.286448+0000","last_unstale":"2023-11-28T20:02:09.297548+0000","last_undegraded":"2023-11-28T20:02:09.297548+0000","last_fullsized":"2023-11-28T20:02:09.297548+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_clean_scrub_stamp":"2023-11-28T20:02:07.264604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:11:13.228652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.14","version":"81'8","reported_seq":20,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-28T20:02:19.479574+0000","last_change":"2023-11-28T20:02:07.296089+0000","last_active":"2023-11-28T20:02:19.479574+0000","last_peered":"2023-11-28T20:02:19.479574+0000","last_clean":"2023-11-28T20:02:19.479574+0000","last_became_active":"2023-11-28T20:02:07.295836+0000","last_became_peered":"2023-11-28T20:02:07.295836+0000","last_unstale":"2023-11-28T20:02:19.479574+0000","last_undegraded":"2023-11-28T20:02:19.479574+0000","last_fullsized":"2023-11-28T20:02:19.479574+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:06.257335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:06.257335+0000","last_clean_scrub_stamp":"2023-11-28T20:02:06.257335+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:27:45.443806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3107,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T20:02:24.842435+0000","last_change":"2023-11-28T20:02:24.842435+0000","last_active":"2023-11-28T20:02:24.842435+0000","last_peered":"2023-11-28T20:02:24.842435+0000","last_clean":"2023-11-28T20:02:24.842435+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:02:24.842435+0000","last_undegraded":"2023-11-28T20:02:24.842435+0000","last_fullsized":"2023-11-28T20:02:24.842435+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:24.842435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:24.842435+0000","last_clean_scrub_stamp":"2023-11-28T20:02:24.842435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T20:02:23.834083+0000","last_change":"2023-11-28T20:02:23.834083+0000","last_active":"2023-11-28T20:02:23.834083+0000","last_peered":"2023-11-28T20:02:23.834083+0000","last_clean":"2023-11-28T20:02:23.834083+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:02:23.834083+0000","last_undegraded":"2023-11-28T20:02:23.834083+0000","last_fullsized":"2023-11-28T20:02:23.834083+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:23.834083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:23.834083+0000","last_clean_scrub_stamp":"2023-11-28T20:02:23.834083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.10","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-28T20:02:09.297141+0000","last_change":"2023-11-28T20:02:08.296835+0000","last_active":"2023-11-28T20:02:09.297141+0000","last_peered":"2023-11-28T20:02:09.297141+0000","last_clean":"2023-11-28T20:02:09.297141+0000","last_became_active":"2023-11-28T20:02:08.296239+0000","last_became_peered":"2023-11-28T20:02:08.296239+0000","last_unstale":"2023-11-28T20:02:09.297141+0000","last_undegraded":"2023-11-28T20:02:09.297141+0000","last_fullsized":"2023-11-28T20:02:09.297141+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_clean_scrub_stamp":"2023-11-28T20:02:07.264604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:50:02.854421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.13","version":"80'2","reported_seq":14,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-28T20:02:08.320137+0000","last_change":"2023-11-28T20:02:07.298781+0000","last_active":"2023-11-28T20:02:08.320137+0000","last_peered":"2023-11-28T20:02:08.320137+0000","last_clean":"2023-11-28T20:02:08.320137+0000","last_became_active":"2023-11-28T20:02:07.298318+0000","last_became_peered":"2023-11-28T20:02:07.298318+0000","last_unstale":"2023-11-28T20:02:08.320137+0000","last_undegraded":"2023-11-28T20:02:08.320137+0000","last_fullsized":"2023-11-28T20:02:08.320137+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:06.257335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:06.257335+0000","last_clean_scrub_stamp":"2023-11-28T20:02:06.257335+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T06:34:38.820255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T20:02:24.842435+0000","last_change":"2023-11-28T20:02:24.842435+0000","last_active":"2023-11-28T20:02:24.842435+0000","last_peered":"2023-11-28T20:02:24.842435+0000","last_clean":"2023-11-28T20:02:24.842435+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:02:24.842435+0000","last_undegraded":"2023-11-28T20:02:24.842435+0000","last_fullsized":"2023-11-28T20:02:24.842435+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:24.842435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:24.842435+0000","last_clean_scrub_stamp":"2023-11-28T20:02:24.842435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T20:02:23.834083+0000","last_change":"2023-11-28T20:02:23.834083+0000","last_active":"2023-11-28T20:02:23.834083+0000","last_peered":"2023-11-28T20:02:23.834083+0000","last_clean":"2023-11-28T20:02:23.834083+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:02:23.834083+0000","last_undegraded":"2023-11-28T20:02:23.834083+0000","last_fullsized":"2023-11-28T20:02:23.834083+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:23.834083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:23.834083+0000","last_clean_scrub_stamp":"2023-11-28T20:02:23.834083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.11","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-28T20:02:09.294831+0000","last_change":"2023-11-28T20:02:08.294608+0000","last_active":"2023-11-28T20:02:09.294831+0000","last_peered":"2023-11-28T20:02:09.294831+0000","last_clean":"2023-11-28T20:02:09.294831+0000","last_became_active":"2023-11-28T20:02:08.294294+0000","last_became_peered":"2023-11-28T20:02:08.294294+0000","last_unstale":"2023-11-28T20:02:09.294831+0000","last_undegraded":"2023-11-28T20:02:09.294831+0000","last_fullsized":"2023-11-28T20:02:09.294831+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_clean_scrub_stamp":"2023-11-28T20:02:07.264604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:25:22.453300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.12","version":"0'0","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-28T20:02:08.285573+0000","last_change":"2023-11-28T20:02:07.293203+0000","last_active":"2023-11-28T20:02:08.285573+0000","last_peered":"2023-11-28T20:02:08.285573+0000","last_clean":"2023-11-28T20:02:08.285573+0000","last_became_active":"2023-11-28T20:02:07.292922+0000","last_became_peered":"2023-11-28T20:02:07.292922+0000","last_unstale":"2023-11-28T20:02:08.285573+0000","last_undegraded":"2023-11-28T20:02:08.285573+0000","last_fullsized":"2023-11-28T20:02:08.285573+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:06.257335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:06.257335+0000","last_clean_scrub_stamp":"2023-11-28T20:02:06.257335+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:18:07.449281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T20:02:24.842435+0000","last_change":"2023-11-28T20:02:24.842435+0000","last_active":"2023-11-28T20:02:24.842435+0000","last_peered":"2023-11-28T20:02:24.842435+0000","last_clean":"2023-11-28T20:02:24.842435+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:02:24.842435+0000","last_undegraded":"2023-11-28T20:02:24.842435+0000","last_fullsized":"2023-11-28T20:02:24.842435+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:24.842435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:24.842435+0000","last_clean_scrub_stamp":"2023-11-28T20:02:24.842435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T20:02:23.834083+0000","last_change":"2023-11-28T20:02:23.834083+0000","last_active":"2023-11-28T20:02:23.834083+0000","last_peered":"2023-11-28T20:02:23.834083+0000","last_clean":"2023-11-28T20:02:23.834083+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:02:23.834083+0000","last_undegraded":"2023-11-28T20:02:23.834083+0000","last_fullsized":"2023-11-28T20:02:23.834083+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:23.834083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:23.834083+0000","last_clean_scrub_stamp":"2023-11-28T20:02:23.834083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.12","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-28T20:02:10.118650+0000","last_change":"2023-11-28T20:02:08.305983+0000","last_active":"2023-11-28T20:02:10.118650+0000","last_peered":"2023-11-28T20:02:10.118650+0000","last_clean":"2023-11-28T20:02:10.118650+0000","last_became_active":"2023-11-28T20:02:08.305718+0000","last_became_peered":"2023-11-28T20:02:08.305718+0000","last_unstale":"2023-11-28T20:02:10.118650+0000","last_undegraded":"2023-11-28T20:02:10.118650+0000","last_fullsized":"2023-11-28T20:02:10.118650+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_clean_scrub_stamp":"2023-11-28T20:02:07.264604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T07:15:19.620125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.11","version":"0'0","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-28T20:02:08.277642+0000","last_change":"2023-11-28T20:02:07.291824+0000","last_active":"2023-11-28T20:02:08.277642+0000","last_peered":"2023-11-28T20:02:08.277642+0000","last_clean":"2023-11-28T20:02:08.277642+0000","last_became_active":"2023-11-28T20:02:07.291575+0000","last_became_peered":"2023-11-28T20:02:07.291575+0000","last_unstale":"2023-11-28T20:02:08.277642+0000","last_undegraded":"2023-11-28T20:02:08.277642+0000","last_fullsized":"2023-11-28T20:02:08.277642+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:06.257335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:06.257335+0000","last_clean_scrub_stamp":"2023-11-28T20:02:06.257335+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:48:42.567546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T20:02:24.842435+0000","last_change":"2023-11-28T20:02:24.842435+0000","last_active":"2023-11-28T20:02:24.842435+0000","last_peered":"2023-11-28T20:02:24.842435+0000","last_clean":"2023-11-28T20:02:24.842435+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:02:24.842435+0000","last_undegraded":"2023-11-28T20:02:24.842435+0000","last_fullsized":"2023-11-28T20:02:24.842435+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:24.842435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:24.842435+0000","last_clean_scrub_stamp":"2023-11-28T20:02:24.842435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T20:02:23.834083+0000","last_change":"2023-11-28T20:02:23.834083+0000","last_active":"2023-11-28T20:02:23.834083+0000","last_peered":"2023-11-28T20:02:23.834083+0000","last_clean":"2023-11-28T20:02:23.834083+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:02:23.834083+0000","last_undegraded":"2023-11-28T20:02:23.834083+0000","last_fullsized":"2023-11-28T20:02:23.834083+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:23.834083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:23.834083+0000","last_clean_scrub_stamp":"2023-11-28T20:02:23.834083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.13","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-28T20:02:10.118806+0000","last_change":"2023-11-28T20:02:08.312636+0000","last_active":"2023-11-28T20:02:10.118806+0000","last_peered":"2023-11-28T20:02:10.118806+0000","last_clean":"2023-11-28T20:02:10.118806+0000","last_became_active":"2023-11-28T20:02:08.312388+0000","last_became_peered":"2023-11-28T20:02:08.312388+0000","last_unstale":"2023-11-28T20:02:10.118806+0000","last_undegraded":"2023-11-28T20:02:10.118806+0000","last_fullsized":"2023-11-28T20:02:10.118806+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_clean_scrub_stamp":"2023-11-28T20:02:07.264604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:08:01.628559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.10","version":"80'8","reported_seq":20,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-28T20:02:08.319984+0000","last_change":"2023-11-28T20:02:07.295459+0000","last_active":"2023-11-28T20:02:08.319984+0000","last_peered":"2023-11-28T20:02:08.319984+0000","last_clean":"2023-11-28T20:02:08.319984+0000","last_became_active":"2023-11-28T20:02:07.295090+0000","last_became_peered":"2023-11-28T20:02:07.295090+0000","last_unstale":"2023-11-28T20:02:08.319984+0000","last_undegraded":"2023-11-28T20:02:08.319984+0000","last_fullsized":"2023-11-28T20:02:08.319984+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:06.257335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:06.257335+0000","last_clean_scrub_stamp":"2023-11-28T20:02:06.257335+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:32:53.356561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T20:02:24.842435+0000","last_change":"2023-11-28T20:02:24.842435+0000","last_active":"2023-11-28T20:02:24.842435+0000","last_peered":"2023-11-28T20:02:24.842435+0000","last_clean":"2023-11-28T20:02:24.842435+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:02:24.842435+0000","last_undegraded":"2023-11-28T20:02:24.842435+0000","last_fullsized":"2023-11-28T20:02:24.842435+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:24.842435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:24.842435+0000","last_clean_scrub_stamp":"2023-11-28T20:02:24.842435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T20:02:23.834083+0000","last_change":"2023-11-28T20:02:23.834083+0000","last_active":"2023-11-28T20:02:23.834083+0000","last_peered":"2023-11-28T20:02:23.834083+0000","last_clean":"2023-11-28T20:02:23.834083+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:02:23.834083+0000","last_undegraded":"2023-11-28T20:02:23.834083+0000","last_fullsized":"2023-11-28T20:02:23.834083+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:23.834083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:23.834083+0000","last_clean_scrub_stamp":"2023-11-28T20:02:23.834083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.c","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-28T20:02:09.341186+0000","last_change":"2023-11-28T20:02:08.310148+0000","last_active":"2023-11-28T20:02:09.341186+0000","last_peered":"2023-11-28T20:02:09.341186+0000","last_clean":"2023-11-28T20:02:09.341186+0000","last_became_active":"2023-11-28T20:02:08.308703+0000","last_became_peered":"2023-11-28T20:02:08.308703+0000","last_unstale":"2023-11-28T20:02:09.341186+0000","last_undegraded":"2023-11-28T20:02:09.341186+0000","last_fullsized":"2023-11-28T20:02:09.341186+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_clean_scrub_stamp":"2023-11-28T20:02:07.264604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:54:00.199248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.f","version":"80'1","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-28T20:02:08.310549+0000","last_change":"2023-11-28T20:02:07.295608+0000","last_active":"2023-11-28T20:02:08.310549+0000","last_peered":"2023-11-28T20:02:08.310549+0000","last_clean":"2023-11-28T20:02:08.310549+0000","last_became_active":"2023-11-28T20:02:07.295293+0000","last_became_peered":"2023-11-28T20:02:07.295293+0000","last_unstale":"2023-11-28T20:02:08.310549+0000","last_undegraded":"2023-11-28T20:02:08.310549+0000","last_fullsized":"2023-11-28T20:02:08.310549+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:06.257335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:06.257335+0000","last_clean_scrub_stamp":"2023-11-28T20:02:06.257335+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:49:04.193812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T20:02:24.842435+0000","last_change":"2023-11-28T20:02:24.842435+0000","last_active":"2023-11-28T20:02:24.842435+0000","last_peered":"2023-11-28T20:02:24.842435+0000","last_clean":"2023-11-28T20:02:24.842435+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:02:24.842435+0000","last_undegraded":"2023-11-28T20:02:24.842435+0000","last_fullsized":"2023-11-28T20:02:24.842435+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:24.842435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:24.842435+0000","last_clean_scrub_stamp":"2023-11-28T20:02:24.842435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T20:02:23.834083+0000","last_change":"2023-11-28T20:02:23.834083+0000","last_active":"2023-11-28T20:02:23.834083+0000","last_peered":"2023-11-28T20:02:23.834083+0000","last_clean":"2023-11-28T20:02:23.834083+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:02:23.834083+0000","last_undegraded":"2023-11-28T20:02:23.834083+0000","last_fullsized":"2023-11-28T20:02:23.834083+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:23.834083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:23.834083+0000","last_clean_scrub_stamp":"2023-11-28T20:02:23.834083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.d","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-28T20:02:10.120419+0000","last_change":"2023-11-28T20:02:08.300331+0000","last_active":"2023-11-28T20:02:10.120419+0000","last_peered":"2023-11-28T20:02:10.120419+0000","last_clean":"2023-11-28T20:02:10.120419+0000","last_became_active":"2023-11-28T20:02:08.300031+0000","last_became_peered":"2023-11-28T20:02:08.300031+0000","last_unstale":"2023-11-28T20:02:10.120419+0000","last_undegraded":"2023-11-28T20:02:10.120419+0000","last_fullsized":"2023-11-28T20:02:10.120419+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_clean_scrub_stamp":"2023-11-28T20:02:07.264604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:55:48.206640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.e","version":"80'2","reported_seq":14,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-28T20:02:08.314439+0000","last_change":"2023-11-28T20:02:07.300742+0000","last_active":"2023-11-28T20:02:08.314439+0000","last_peered":"2023-11-28T20:02:08.314439+0000","last_clean":"2023-11-28T20:02:08.314439+0000","last_became_active":"2023-11-28T20:02:07.300392+0000","last_became_peered":"2023-11-28T20:02:07.300392+0000","last_unstale":"2023-11-28T20:02:08.314439+0000","last_undegraded":"2023-11-28T20:02:08.314439+0000","last_fullsized":"2023-11-28T20:02:08.314439+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:06.257335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:06.257335+0000","last_clean_scrub_stamp":"2023-11-28T20:02:06.257335+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:12:46.771683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T20:02:24.842435+0000","last_change":"2023-11-28T20:02:24.842435+0000","last_active":"2023-11-28T20:02:24.842435+0000","last_peered":"2023-11-28T20:02:24.842435+0000","last_clean":"2023-11-28T20:02:24.842435+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:02:24.842435+0000","last_undegraded":"2023-11-28T20:02:24.842435+0000","last_fullsized":"2023-11-28T20:02:24.842435+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:24.842435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:24.842435+0000","last_clean_scrub_stamp":"2023-11-28T20:02:24.842435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T20:02:23.834083+0000","last_change":"2023-11-28T20:02:23.834083+0000","last_active":"2023-11-28T20:02:23.834083+0000","last_peered":"2023-11-28T20:02:23.834083+0000","last_clean":"2023-11-28T20:02:23.834083+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:02:23.834083+0000","last_undegraded":"2023-11-28T20:02:23.834083+0000","last_fullsized":"2023-11-28T20:02:23.834083+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:23.834083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:23.834083+0000","last_clean_scrub_stamp":"2023-11-28T20:02:23.834083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.e","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-28T20:02:09.295583+0000","last_change":"2023-11-28T20:02:08.313109+0000","last_active":"2023-11-28T20:02:09.295583+0000","last_peered":"2023-11-28T20:02:09.295583+0000","last_clean":"2023-11-28T20:02:09.295583+0000","last_became_active":"2023-11-28T20:02:08.312841+0000","last_became_peered":"2023-11-28T20:02:08.312841+0000","last_unstale":"2023-11-28T20:02:09.295583+0000","last_undegraded":"2023-11-28T20:02:09.295583+0000","last_fullsized":"2023-11-28T20:02:09.295583+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_clean_scrub_stamp":"2023-11-28T20:02:07.264604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:48:20.809209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.d","version":"80'1","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-28T20:02:08.320625+0000","last_change":"2023-11-28T20:02:07.301258+0000","last_active":"2023-11-28T20:02:08.320625+0000","last_peered":"2023-11-28T20:02:08.320625+0000","last_clean":"2023-11-28T20:02:08.320625+0000","last_became_active":"2023-11-28T20:02:07.300955+0000","last_became_peered":"2023-11-28T20:02:07.300955+0000","last_unstale":"2023-11-28T20:02:08.320625+0000","last_undegraded":"2023-11-28T20:02:08.320625+0000","last_fullsized":"2023-11-28T20:02:08.320625+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:06.257335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:06.257335+0000","last_clean_scrub_stamp":"2023-11-28T20:02:06.257335+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T07:05:17.648805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T20:02:24.842435+0000","last_change":"2023-11-28T20:02:24.842435+0000","last_active":"2023-11-28T20:02:24.842435+0000","last_peered":"2023-11-28T20:02:24.842435+0000","last_clean":"2023-11-28T20:02:24.842435+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:02:24.842435+0000","last_undegraded":"2023-11-28T20:02:24.842435+0000","last_fullsized":"2023-11-28T20:02:24.842435+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:24.842435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:24.842435+0000","last_clean_scrub_stamp":"2023-11-28T20:02:24.842435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T20:02:23.834083+0000","last_change":"2023-11-28T20:02:23.834083+0000","last_active":"2023-11-28T20:02:23.834083+0000","last_peered":"2023-11-28T20:02:23.834083+0000","last_clean":"2023-11-28T20:02:23.834083+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:02:23.834083+0000","last_undegraded":"2023-11-28T20:02:23.834083+0000","last_fullsized":"2023-11-28T20:02:23.834083+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:23.834083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:23.834083+0000","last_clean_scrub_stamp":"2023-11-28T20:02:23.834083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.8","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-28T20:02:09.341209+0000","last_change":"2023-11-28T20:02:08.303056+0000","last_active":"2023-11-28T20:02:09.341209+0000","last_peered":"2023-11-28T20:02:09.341209+0000","last_clean":"2023-11-28T20:02:09.341209+0000","last_became_active":"2023-11-28T20:02:08.302812+0000","last_became_peered":"2023-11-28T20:02:08.302812+0000","last_unstale":"2023-11-28T20:02:09.341209+0000","last_undegraded":"2023-11-28T20:02:09.341209+0000","last_fullsized":"2023-11-28T20:02:09.341209+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_clean_scrub_stamp":"2023-11-28T20:02:07.264604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:47:55.747151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.b","version":"80'2","reported_seq":14,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-28T20:02:08.320749+0000","last_change":"2023-11-28T20:02:07.295857+0000","last_active":"2023-11-28T20:02:08.320749+0000","last_peered":"2023-11-28T20:02:08.320749+0000","last_clean":"2023-11-28T20:02:08.320749+0000","last_became_active":"2023-11-28T20:02:07.295642+0000","last_became_peered":"2023-11-28T20:02:07.295642+0000","last_unstale":"2023-11-28T20:02:08.320749+0000","last_undegraded":"2023-11-28T20:02:08.320749+0000","last_fullsized":"2023-11-28T20:02:08.320749+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:06.257335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:06.257335+0000","last_clean_scrub_stamp":"2023-11-28T20:02:06.257335+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:32:53.356561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T20:02:24.842435+0000","last_change":"2023-11-28T20:02:24.842435+0000","last_active":"2023-11-28T20:02:24.842435+0000","last_peered":"2023-11-28T20:02:24.842435+0000","last_clean":"2023-11-28T20:02:24.842435+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:02:24.842435+0000","last_undegraded":"2023-11-28T20:02:24.842435+0000","last_fullsized":"2023-11-28T20:02:24.842435+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:24.842435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:24.842435+0000","last_clean_scrub_stamp":"2023-11-28T20:02:24.842435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T20:02:23.834083+0000","last_change":"2023-11-28T20:02:23.834083+0000","last_active":"2023-11-28T20:02:23.834083+0000","last_peered":"2023-11-28T20:02:23.834083+0000","last_clean":"2023-11-28T20:02:23.834083+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:02:23.834083+0000","last_undegraded":"2023-11-28T20:02:23.834083+0000","last_fullsized":"2023-11-28T20:02:23.834083+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:23.834083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:23.834083+0000","last_clean_scrub_stamp":"2023-11-28T20:02:23.834083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.9","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-28T20:02:09.295133+0000","last_change":"2023-11-28T20:02:08.297174+0000","last_active":"2023-11-28T20:02:09.295133+0000","last_peered":"2023-11-28T20:02:09.295133+0000","last_clean":"2023-11-28T20:02:09.295133+0000","last_became_active":"2023-11-28T20:02:08.296877+0000","last_became_peered":"2023-11-28T20:02:08.296877+0000","last_unstale":"2023-11-28T20:02:09.295133+0000","last_undegraded":"2023-11-28T20:02:09.295133+0000","last_fullsized":"2023-11-28T20:02:09.295133+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_clean_scrub_stamp":"2023-11-28T20:02:07.264604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:11:13.228652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.a","version":"0'0","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-28T20:02:08.298128+0000","last_change":"2023-11-28T20:02:07.296302+0000","last_active":"2023-11-28T20:02:08.298128+0000","last_peered":"2023-11-28T20:02:08.298128+0000","last_clean":"2023-11-28T20:02:08.298128+0000","last_became_active":"2023-11-28T20:02:07.296048+0000","last_became_peered":"2023-11-28T20:02:07.296048+0000","last_unstale":"2023-11-28T20:02:08.298128+0000","last_undegraded":"2023-11-28T20:02:08.298128+0000","last_fullsized":"2023-11-28T20:02:08.298128+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:06.257335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:06.257335+0000","last_clean_scrub_stamp":"2023-11-28T20:02:06.257335+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:22:17.972305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T20:02:24.842435+0000","last_change":"2023-11-28T20:02:24.842435+0000","last_active":"2023-11-28T20:02:24.842435+0000","last_peered":"2023-11-28T20:02:24.842435+0000","last_clean":"2023-11-28T20:02:24.842435+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:02:24.842435+0000","last_undegraded":"2023-11-28T20:02:24.842435+0000","last_fullsized":"2023-11-28T20:02:24.842435+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:24.842435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:24.842435+0000","last_clean_scrub_stamp":"2023-11-28T20:02:24.842435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T20:02:23.834083+0000","last_change":"2023-11-28T20:02:23.834083+0000","last_active":"2023-11-28T20:02:23.834083+0000","last_peered":"2023-11-28T20:02:23.834083+0000","last_clean":"2023-11-28T20:02:23.834083+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:02:23.834083+0000","last_undegraded":"2023-11-28T20:02:23.834083+0000","last_fullsized":"2023-11-28T20:02:23.834083+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:23.834083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:23.834083+0000","last_clean_scrub_stamp":"2023-11-28T20:02:23.834083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.a","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-28T20:02:09.295755+0000","last_change":"2023-11-28T20:02:08.289316+0000","last_active":"2023-11-28T20:02:09.295755+0000","last_peered":"2023-11-28T20:02:09.295755+0000","last_clean":"2023-11-28T20:02:09.295755+0000","last_became_active":"2023-11-28T20:02:08.288979+0000","last_became_peered":"2023-11-28T20:02:08.288979+0000","last_unstale":"2023-11-28T20:02:09.295755+0000","last_undegraded":"2023-11-28T20:02:09.295755+0000","last_fullsized":"2023-11-28T20:02:09.295755+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_clean_scrub_stamp":"2023-11-28T20:02:07.264604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:40:59.195276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.9","version":"0'0","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-28T20:02:08.280962+0000","last_change":"2023-11-28T20:02:07.296576+0000","last_active":"2023-11-28T20:02:08.280962+0000","last_peered":"2023-11-28T20:02:08.280962+0000","last_clean":"2023-11-28T20:02:08.280962+0000","last_became_active":"2023-11-28T20:02:07.295982+0000","last_became_peered":"2023-11-28T20:02:07.295982+0000","last_unstale":"2023-11-28T20:02:08.280962+0000","last_undegraded":"2023-11-28T20:02:08.280962+0000","last_fullsized":"2023-11-28T20:02:08.280962+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:06.257335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:06.257335+0000","last_clean_scrub_stamp":"2023-11-28T20:02:06.257335+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:51:10.137114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T20:02:24.842435+0000","last_change":"2023-11-28T20:02:24.842435+0000","last_active":"2023-11-28T20:02:24.842435+0000","last_peered":"2023-11-28T20:02:24.842435+0000","last_clean":"2023-11-28T20:02:24.842435+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:02:24.842435+0000","last_undegraded":"2023-11-28T20:02:24.842435+0000","last_fullsized":"2023-11-28T20:02:24.842435+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:24.842435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:24.842435+0000","last_clean_scrub_stamp":"2023-11-28T20:02:24.842435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T20:02:23.834083+0000","last_change":"2023-11-28T20:02:23.834083+0000","last_active":"2023-11-28T20:02:23.834083+0000","last_peered":"2023-11-28T20:02:23.834083+0000","last_clean":"2023-11-28T20:02:23.834083+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:02:23.834083+0000","last_undegraded":"2023-11-28T20:02:23.834083+0000","last_fullsized":"2023-11-28T20:02:23.834083+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:23.834083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:23.834083+0000","last_clean_scrub_stamp":"2023-11-28T20:02:23.834083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.b","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-28T20:02:09.341242+0000","last_change":"2023-11-28T20:02:08.317237+0000","last_active":"2023-11-28T20:02:09.341242+0000","last_peered":"2023-11-28T20:02:09.341242+0000","last_clean":"2023-11-28T20:02:09.341242+0000","last_became_active":"2023-11-28T20:02:08.316980+0000","last_became_peered":"2023-11-28T20:02:08.316980+0000","last_unstale":"2023-11-28T20:02:09.341242+0000","last_undegraded":"2023-11-28T20:02:09.341242+0000","last_fullsized":"2023-11-28T20:02:09.341242+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_clean_scrub_stamp":"2023-11-28T20:02:07.264604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T06:33:53.234496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.8","version":"0'0","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-28T20:02:08.295293+0000","last_change":"2023-11-28T20:02:07.293087+0000","last_active":"2023-11-28T20:02:08.295293+0000","last_peered":"2023-11-28T20:02:08.295293+0000","last_clean":"2023-11-28T20:02:08.295293+0000","last_became_active":"2023-11-28T20:02:07.292815+0000","last_became_peered":"2023-11-28T20:02:07.292815+0000","last_unstale":"2023-11-28T20:02:08.295293+0000","last_undegraded":"2023-11-28T20:02:08.295293+0000","last_fullsized":"2023-11-28T20:02:08.295293+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:06.257335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:06.257335+0000","last_clean_scrub_stamp":"2023-11-28T20:02:06.257335+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:57:12.771669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T20:02:24.842435+0000","last_change":"2023-11-28T20:02:24.842435+0000","last_active":"2023-11-28T20:02:24.842435+0000","last_peered":"2023-11-28T20:02:24.842435+0000","last_clean":"2023-11-28T20:02:24.842435+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:02:24.842435+0000","last_undegraded":"2023-11-28T20:02:24.842435+0000","last_fullsized":"2023-11-28T20:02:24.842435+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:24.842435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:24.842435+0000","last_clean_scrub_stamp":"2023-11-28T20:02:24.842435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T20:02:23.834083+0000","last_change":"2023-11-28T20:02:23.834083+0000","last_active":"2023-11-28T20:02:23.834083+0000","last_peered":"2023-11-28T20:02:23.834083+0000","last_clean":"2023-11-28T20:02:23.834083+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:02:23.834083+0000","last_undegraded":"2023-11-28T20:02:23.834083+0000","last_fullsized":"2023-11-28T20:02:23.834083+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:23.834083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:23.834083+0000","last_clean_scrub_stamp":"2023-11-28T20:02:23.834083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.4","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-28T20:02:10.120616+0000","last_change":"2023-11-28T20:02:08.307858+0000","last_active":"2023-11-28T20:02:10.120616+0000","last_peered":"2023-11-28T20:02:10.120616+0000","last_clean":"2023-11-28T20:02:10.120616+0000","last_became_active":"2023-11-28T20:02:08.307550+0000","last_became_peered":"2023-11-28T20:02:08.307550+0000","last_unstale":"2023-11-28T20:02:10.120616+0000","last_undegraded":"2023-11-28T20:02:10.120616+0000","last_fullsized":"2023-11-28T20:02:10.120616+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_clean_scrub_stamp":"2023-11-28T20:02:07.264604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:18:14.885236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.7","version":"80'2","reported_seq":14,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-28T20:02:08.314853+0000","last_change":"2023-11-28T20:02:07.296980+0000","last_active":"2023-11-28T20:02:08.314853+0000","last_peered":"2023-11-28T20:02:08.314853+0000","last_clean":"2023-11-28T20:02:08.314853+0000","last_became_active":"2023-11-28T20:02:07.296625+0000","last_became_peered":"2023-11-28T20:02:07.296625+0000","last_unstale":"2023-11-28T20:02:08.314853+0000","last_undegraded":"2023-11-28T20:02:08.314853+0000","last_fullsized":"2023-11-28T20:02:08.314853+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:06.257335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:06.257335+0000","last_clean_scrub_stamp":"2023-11-28T20:02:06.257335+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:52:29.664838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T20:02:24.842435+0000","last_change":"2023-11-28T20:02:24.842435+0000","last_active":"2023-11-28T20:02:24.842435+0000","last_peered":"2023-11-28T20:02:24.842435+0000","last_clean":"2023-11-28T20:02:24.842435+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:02:24.842435+0000","last_undegraded":"2023-11-28T20:02:24.842435+0000","last_fullsized":"2023-11-28T20:02:24.842435+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:24.842435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:24.842435+0000","last_clean_scrub_stamp":"2023-11-28T20:02:24.842435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T20:02:23.834083+0000","last_change":"2023-11-28T20:02:23.834083+0000","last_active":"2023-11-28T20:02:23.834083+0000","last_peered":"2023-11-28T20:02:23.834083+0000","last_clean":"2023-11-28T20:02:23.834083+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:02:23.834083+0000","last_undegraded":"2023-11-28T20:02:23.834083+0000","last_fullsized":"2023-11-28T20:02:23.834083+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:23.834083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:23.834083+0000","last_clean_scrub_stamp":"2023-11-28T20:02:23.834083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.5","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-28T20:02:09.341554+0000","last_change":"2023-11-28T20:02:08.304794+0000","last_active":"2023-11-28T20:02:09.341554+0000","last_peered":"2023-11-28T20:02:09.341554+0000","last_clean":"2023-11-28T20:02:09.341554+0000","last_became_active":"2023-11-28T20:02:08.304425+0000","last_became_peered":"2023-11-28T20:02:08.304425+0000","last_unstale":"2023-11-28T20:02:09.341554+0000","last_undegraded":"2023-11-28T20:02:09.341554+0000","last_fullsized":"2023-11-28T20:02:09.341554+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_clean_scrub_stamp":"2023-11-28T20:02:07.264604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T06:13:44.850484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.6","version":"81'1","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-28T20:02:09.295800+0000","last_change":"2023-11-28T20:02:07.296643+0000","last_active":"2023-11-28T20:02:09.295800+0000","last_peered":"2023-11-28T20:02:09.295800+0000","last_clean":"2023-11-28T20:02:09.295800+0000","last_became_active":"2023-11-28T20:02:07.296369+0000","last_became_peered":"2023-11-28T20:02:07.296369+0000","last_unstale":"2023-11-28T20:02:09.295800+0000","last_undegraded":"2023-11-28T20:02:09.295800+0000","last_fullsized":"2023-11-28T20:02:09.295800+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:06.257335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:06.257335+0000","last_clean_scrub_stamp":"2023-11-28T20:02:06.257335+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:48:42.567546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T20:02:24.842435+0000","last_change":"2023-11-28T20:02:24.842435+0000","last_active":"2023-11-28T20:02:24.842435+0000","last_peered":"2023-11-28T20:02:24.842435+0000","last_clean":"2023-11-28T20:02:24.842435+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:02:24.842435+0000","last_undegraded":"2023-11-28T20:02:24.842435+0000","last_fullsized":"2023-11-28T20:02:24.842435+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:24.842435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:24.842435+0000","last_clean_scrub_stamp":"2023-11-28T20:02:24.842435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T20:02:23.834083+0000","last_change":"2023-11-28T20:02:23.834083+0000","last_active":"2023-11-28T20:02:23.834083+0000","last_peered":"2023-11-28T20:02:23.834083+0000","last_clean":"2023-11-28T20:02:23.834083+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:02:23.834083+0000","last_undegraded":"2023-11-28T20:02:23.834083+0000","last_fullsized":"2023-11-28T20:02:23.834083+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:23.834083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:23.834083+0000","last_clean_scrub_stamp":"2023-11-28T20:02:23.834083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.6","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-28T20:02:09.341337+0000","last_change":"2023-11-28T20:02:08.317251+0000","last_active":"2023-11-28T20:02:09.341337+0000","last_peered":"2023-11-28T20:02:09.341337+0000","last_clean":"2023-11-28T20:02:09.341337+0000","last_became_active":"2023-11-28T20:02:08.316870+0000","last_became_peered":"2023-11-28T20:02:08.316870+0000","last_unstale":"2023-11-28T20:02:09.341337+0000","last_undegraded":"2023-11-28T20:02:09.341337+0000","last_fullsized":"2023-11-28T20:02:09.341337+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_clean_scrub_stamp":"2023-11-28T20:02:07.264604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:15:09.805381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.5","version":"0'0","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-28T20:02:08.286388+0000","last_change":"2023-11-28T20:02:07.300054+0000","last_active":"2023-11-28T20:02:08.286388+0000","last_peered":"2023-11-28T20:02:08.286388+0000","last_clean":"2023-11-28T20:02:08.286388+0000","last_became_active":"2023-11-28T20:02:07.298610+0000","last_became_peered":"2023-11-28T20:02:07.298610+0000","last_unstale":"2023-11-28T20:02:08.286388+0000","last_undegraded":"2023-11-28T20:02:08.286388+0000","last_fullsized":"2023-11-28T20:02:08.286388+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:06.257335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:06.257335+0000","last_clean_scrub_stamp":"2023-11-28T20:02:06.257335+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:04:18.830964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T20:02:24.842435+0000","last_change":"2023-11-28T20:02:24.842435+0000","last_active":"2023-11-28T20:02:24.842435+0000","last_peered":"2023-11-28T20:02:24.842435+0000","last_clean":"2023-11-28T20:02:24.842435+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:02:24.842435+0000","last_undegraded":"2023-11-28T20:02:24.842435+0000","last_fullsized":"2023-11-28T20:02:24.842435+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:24.842435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:24.842435+0000","last_clean_scrub_stamp":"2023-11-28T20:02:24.842435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T20:02:23.834083+0000","last_change":"2023-11-28T20:02:23.834083+0000","last_active":"2023-11-28T20:02:23.834083+0000","last_peered":"2023-11-28T20:02:23.834083+0000","last_clean":"2023-11-28T20:02:23.834083+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:02:23.834083+0000","last_undegraded":"2023-11-28T20:02:23.834083+0000","last_fullsized":"2023-11-28T20:02:23.834083+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:23.834083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:23.834083+0000","last_clean_scrub_stamp":"2023-11-28T20:02:23.834083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.7","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-28T20:02:09.296362+0000","last_change":"2023-11-28T20:02:08.303184+0000","last_active":"2023-11-28T20:02:09.296362+0000","last_peered":"2023-11-28T20:02:09.296362+0000","last_clean":"2023-11-28T20:02:09.296362+0000","last_became_active":"2023-11-28T20:02:08.302908+0000","last_became_peered":"2023-11-28T20:02:08.302908+0000","last_unstale":"2023-11-28T20:02:09.296362+0000","last_undegraded":"2023-11-28T20:02:09.296362+0000","last_fullsized":"2023-11-28T20:02:09.296362+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_clean_scrub_stamp":"2023-11-28T20:02:07.264604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:46:20.521407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.4","version":"0'0","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-28T20:02:08.292904+0000","last_change":"2023-11-28T20:02:07.301572+0000","last_active":"2023-11-28T20:02:08.292904+0000","last_peered":"2023-11-28T20:02:08.292904+0000","last_clean":"2023-11-28T20:02:08.292904+0000","last_became_active":"2023-11-28T20:02:07.301226+0000","last_became_peered":"2023-11-28T20:02:07.301226+0000","last_unstale":"2023-11-28T20:02:08.292904+0000","last_undegraded":"2023-11-28T20:02:08.292904+0000","last_fullsized":"2023-11-28T20:02:08.292904+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:06.257335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:06.257335+0000","last_clean_scrub_stamp":"2023-11-28T20:02:06.257335+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:56:39.065924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T20:02:24.842435+0000","last_change":"2023-11-28T20:02:24.842435+0000","last_active":"2023-11-28T20:02:24.842435+0000","last_peered":"2023-11-28T20:02:24.842435+0000","last_clean":"2023-11-28T20:02:24.842435+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:02:24.842435+0000","last_undegraded":"2023-11-28T20:02:24.842435+0000","last_fullsized":"2023-11-28T20:02:24.842435+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:24.842435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:24.842435+0000","last_clean_scrub_stamp":"2023-11-28T20:02:24.842435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T20:02:23.834083+0000","last_change":"2023-11-28T20:02:23.834083+0000","last_active":"2023-11-28T20:02:23.834083+0000","last_peered":"2023-11-28T20:02:23.834083+0000","last_clean":"2023-11-28T20:02:23.834083+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:02:23.834083+0000","last_undegraded":"2023-11-28T20:02:23.834083+0000","last_fullsized":"2023-11-28T20:02:23.834083+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:23.834083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:23.834083+0000","last_clean_scrub_stamp":"2023-11-28T20:02:23.834083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.0","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-28T20:02:10.118597+0000","last_change":"2023-11-28T20:02:08.307668+0000","last_active":"2023-11-28T20:02:10.118597+0000","last_peered":"2023-11-28T20:02:10.118597+0000","last_clean":"2023-11-28T20:02:10.118597+0000","last_became_active":"2023-11-28T20:02:08.307428+0000","last_became_peered":"2023-11-28T20:02:08.307428+0000","last_unstale":"2023-11-28T20:02:10.118597+0000","last_undegraded":"2023-11-28T20:02:10.118597+0000","last_fullsized":"2023-11-28T20:02:10.118597+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_clean_scrub_stamp":"2023-11-28T20:02:07.264604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T07:35:34.958615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.3","version":"0'0","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-28T20:02:08.285902+0000","last_change":"2023-11-28T20:02:07.294264+0000","last_active":"2023-11-28T20:02:08.285902+0000","last_peered":"2023-11-28T20:02:08.285902+0000","last_clean":"2023-11-28T20:02:08.285902+0000","last_became_active":"2023-11-28T20:02:07.293763+0000","last_became_peered":"2023-11-28T20:02:07.293763+0000","last_unstale":"2023-11-28T20:02:08.285902+0000","last_undegraded":"2023-11-28T20:02:08.285902+0000","last_fullsized":"2023-11-28T20:02:08.285902+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:06.257335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:06.257335+0000","last_clean_scrub_stamp":"2023-11-28T20:02:06.257335+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:41:06.265916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T20:02:24.842435+0000","last_change":"2023-11-28T20:02:24.842435+0000","last_active":"2023-11-28T20:02:24.842435+0000","last_peered":"2023-11-28T20:02:24.842435+0000","last_clean":"2023-11-28T20:02:24.842435+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:02:24.842435+0000","last_undegraded":"2023-11-28T20:02:24.842435+0000","last_fullsized":"2023-11-28T20:02:24.842435+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:24.842435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:24.842435+0000","last_clean_scrub_stamp":"2023-11-28T20:02:24.842435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T20:02:23.834083+0000","last_change":"2023-11-28T20:02:23.834083+0000","last_active":"2023-11-28T20:02:23.834083+0000","last_peered":"2023-11-28T20:02:23.834083+0000","last_clean":"2023-11-28T20:02:23.834083+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:02:23.834083+0000","last_undegraded":"2023-11-28T20:02:23.834083+0000","last_fullsized":"2023-11-28T20:02:23.834083+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:23.834083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:23.834083+0000","last_clean_scrub_stamp":"2023-11-28T20:02:23.834083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.1","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-28T20:02:09.920184+0000","last_change":"2023-11-28T20:02:08.294339+0000","last_active":"2023-11-28T20:02:09.920184+0000","last_peered":"2023-11-28T20:02:09.920184+0000","last_clean":"2023-11-28T20:02:09.920184+0000","last_became_active":"2023-11-28T20:02:08.294058+0000","last_became_peered":"2023-11-28T20:02:08.294058+0000","last_unstale":"2023-11-28T20:02:09.920184+0000","last_undegraded":"2023-11-28T20:02:09.920184+0000","last_fullsized":"2023-11-28T20:02:09.920184+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_clean_scrub_stamp":"2023-11-28T20:02:07.264604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:18:08.456550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.2","version":"0'0","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-28T20:02:08.280333+0000","last_change":"2023-11-28T20:02:07.299946+0000","last_active":"2023-11-28T20:02:08.280333+0000","last_peered":"2023-11-28T20:02:08.280333+0000","last_clean":"2023-11-28T20:02:08.280333+0000","last_became_active":"2023-11-28T20:02:07.299678+0000","last_became_peered":"2023-11-28T20:02:07.299678+0000","last_unstale":"2023-11-28T20:02:08.280333+0000","last_undegraded":"2023-11-28T20:02:08.280333+0000","last_fullsized":"2023-11-28T20:02:08.280333+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:06.257335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:06.257335+0000","last_clean_scrub_stamp":"2023-11-28T20:02:06.257335+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:33:11.673633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T20:02:24.842435+0000","last_change":"2023-11-28T20:02:24.842435+0000","last_active":"2023-11-28T20:02:24.842435+0000","last_peered":"2023-11-28T20:02:24.842435+0000","last_clean":"2023-11-28T20:02:24.842435+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:02:24.842435+0000","last_undegraded":"2023-11-28T20:02:24.842435+0000","last_fullsized":"2023-11-28T20:02:24.842435+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:24.842435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:24.842435+0000","last_clean_scrub_stamp":"2023-11-28T20:02:24.842435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T20:02:23.834083+0000","last_change":"2023-11-28T20:02:23.834083+0000","last_active":"2023-11-28T20:02:23.834083+0000","last_peered":"2023-11-28T20:02:23.834083+0000","last_clean":"2023-11-28T20:02:23.834083+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:02:23.834083+0000","last_undegraded":"2023-11-28T20:02:23.834083+0000","last_fullsized":"2023-11-28T20:02:23.834083+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:23.834083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:23.834083+0000","last_clean_scrub_stamp":"2023-11-28T20:02:23.834083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.2","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-28T20:02:10.119972+0000","last_change":"2023-11-28T20:02:08.309044+0000","last_active":"2023-11-28T20:02:10.119972+0000","last_peered":"2023-11-28T20:02:10.119972+0000","last_clean":"2023-11-28T20:02:10.119972+0000","last_became_active":"2023-11-28T20:02:08.308771+0000","last_became_peered":"2023-11-28T20:02:08.308771+0000","last_unstale":"2023-11-28T20:02:10.119972+0000","last_undegraded":"2023-11-28T20:02:10.119972+0000","last_fullsized":"2023-11-28T20:02:10.119972+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_clean_scrub_stamp":"2023-11-28T20:02:07.264604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:58:52.570056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1","version":"0'0","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-28T20:02:08.292465+0000","last_change":"2023-11-28T20:02:07.297766+0000","last_active":"2023-11-28T20:02:08.292465+0000","last_peered":"2023-11-28T20:02:08.292465+0000","last_clean":"2023-11-28T20:02:08.292465+0000","last_became_active":"2023-11-28T20:02:07.297403+0000","last_became_peered":"2023-11-28T20:02:07.297403+0000","last_unstale":"2023-11-28T20:02:08.292465+0000","last_undegraded":"2023-11-28T20:02:08.292465+0000","last_fullsized":"2023-11-28T20:02:08.292465+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:06.257335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:06.257335+0000","last_clean_scrub_stamp":"2023-11-28T20:02:06.257335+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:48:19.801940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T20:02:24.842435+0000","last_change":"2023-11-28T20:02:24.842435+0000","last_active":"2023-11-28T20:02:24.842435+0000","last_peered":"2023-11-28T20:02:24.842435+0000","last_clean":"2023-11-28T20:02:24.842435+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:02:24.842435+0000","last_undegraded":"2023-11-28T20:02:24.842435+0000","last_fullsized":"2023-11-28T20:02:24.842435+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:24.842435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:24.842435+0000","last_clean_scrub_stamp":"2023-11-28T20:02:24.842435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T20:02:23.834083+0000","last_change":"2023-11-28T20:02:23.834083+0000","last_active":"2023-11-28T20:02:23.834083+0000","last_peered":"2023-11-28T20:02:23.834083+0000","last_clean":"2023-11-28T20:02:23.834083+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:02:23.834083+0000","last_undegraded":"2023-11-28T20:02:23.834083+0000","last_fullsized":"2023-11-28T20:02:23.834083+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:23.834083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:23.834083+0000","last_clean_scrub_stamp":"2023-11-28T20:02:23.834083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.3","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-28T20:02:09.341231+0000","last_change":"2023-11-28T20:02:08.303952+0000","last_active":"2023-11-28T20:02:09.341231+0000","last_peered":"2023-11-28T20:02:09.341231+0000","last_clean":"2023-11-28T20:02:09.341231+0000","last_became_active":"2023-11-28T20:02:08.303673+0000","last_became_peered":"2023-11-28T20:02:08.303673+0000","last_unstale":"2023-11-28T20:02:09.341231+0000","last_undegraded":"2023-11-28T20:02:09.341231+0000","last_fullsized":"2023-11-28T20:02:09.341231+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_clean_scrub_stamp":"2023-11-28T20:02:07.264604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:54:17.796972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.0","version":"0'0","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-28T20:02:08.288081+0000","last_change":"2023-11-28T20:02:07.300917+0000","last_active":"2023-11-28T20:02:08.288081+0000","last_peered":"2023-11-28T20:02:08.288081+0000","last_clean":"2023-11-28T20:02:08.288081+0000","last_became_active":"2023-11-28T20:02:07.300632+0000","last_became_peered":"2023-11-28T20:02:07.300632+0000","last_unstale":"2023-11-28T20:02:08.288081+0000","last_undegraded":"2023-11-28T20:02:08.288081+0000","last_fullsized":"2023-11-28T20:02:08.288081+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:06.257335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:06.257335+0000","last_clean_scrub_stamp":"2023-11-28T20:02:06.257335+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:54:32.151264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T20:02:24.842435+0000","last_change":"2023-11-28T20:02:24.842435+0000","last_active":"2023-11-28T20:02:24.842435+0000","last_peered":"2023-11-28T20:02:24.842435+0000","last_clean":"2023-11-28T20:02:24.842435+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:02:24.842435+0000","last_undegraded":"2023-11-28T20:02:24.842435+0000","last_fullsized":"2023-11-28T20:02:24.842435+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:24.842435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:24.842435+0000","last_clean_scrub_stamp":"2023-11-28T20:02:24.842435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T20:02:23.834083+0000","last_change":"2023-11-28T20:02:23.834083+0000","last_active":"2023-11-28T20:02:23.834083+0000","last_peered":"2023-11-28T20:02:23.834083+0000","last_clean":"2023-11-28T20:02:23.834083+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:02:23.834083+0000","last_undegraded":"2023-11-28T20:02:23.834083+0000","last_fullsized":"2023-11-28T20:02:23.834083+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:23.834083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:23.834083+0000","last_clean_scrub_stamp":"2023-11-28T20:02:23.834083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.f","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-28T20:02:10.120505+0000","last_change":"2023-11-28T20:02:08.297920+0000","last_active":"2023-11-28T20:02:10.120505+0000","last_peered":"2023-11-28T20:02:10.120505+0000","last_clean":"2023-11-28T20:02:10.120505+0000","last_became_active":"2023-11-28T20:02:08.297638+0000","last_became_peered":"2023-11-28T20:02:08.297638+0000","last_unstale":"2023-11-28T20:02:10.120505+0000","last_undegraded":"2023-11-28T20:02:10.120505+0000","last_fullsized":"2023-11-28T20:02:10.120505+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_clean_scrub_stamp":"2023-11-28T20:02:07.264604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:18:08.456550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.c","version":"0'0","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-28T20:02:08.278744+0000","last_change":"2023-11-28T20:02:07.293843+0000","last_active":"2023-11-28T20:02:08.278744+0000","last_peered":"2023-11-28T20:02:08.278744+0000","last_clean":"2023-11-28T20:02:08.278744+0000","last_became_active":"2023-11-28T20:02:07.293538+0000","last_became_peered":"2023-11-28T20:02:07.293538+0000","last_unstale":"2023-11-28T20:02:08.278744+0000","last_undegraded":"2023-11-28T20:02:08.278744+0000","last_fullsized":"2023-11-28T20:02:08.278744+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:06.257335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:06.257335+0000","last_clean_scrub_stamp":"2023-11-28T20:02:06.257335+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:58:51.562787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":217,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-28T20:02:08.288184+0000","last_change":"2023-11-28T19:58:56.136501+0000","last_active":"2023-11-28T20:02:08.288184+0000","last_peered":"2023-11-28T20:02:08.288184+0000","last_clean":"2023-11-28T20:02:08.288184+0000","last_became_active":"2023-11-28T19:58:56.135998+0000","last_became_peered":"2023-11-28T19:58:56.135998+0000","last_unstale":"2023-11-28T20:02:08.288184+0000","last_undegraded":"2023-11-28T20:02:08.288184+0000","last_fullsized":"2023-11-28T20:02:08.288184+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:58:54.602349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:58:54.602349+0000","last_clean_scrub_stamp":"2023-11-28T19:58:54.602349+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:33:42.723349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":16,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":15,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":13,"num_pg":32,"stat_sum":{"num_bytes":3905,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":47,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":7810,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":41,"ondisk_log_size":41,"up":64,"acting":64,"num_store_stats":8},{"poolid":14,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":66748,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574894,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32232,"kb_used_data":1048,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339608,"statfs":{"total":96636764160,"available":96603758592,"internally_reserved":0,"allocated":1073152,"data_stored":1059975,"data_compressed":33374,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 20:01:59 2023","interfaces":[{"interface":"back","average":{"1min":0.66000000000000003,"5min":0.67100000000000004,"15min":0.67600000000000005},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.94299999999999995,"5min":0.94299999999999995,"15min":0.94299999999999995},"last":0.69799999999999995},{"interface":"front","average":{"1min":0.66500000000000004,"5min":0.67000000000000004,"15min":0.68000000000000005},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":1.014,"5min":1.014,"15min":1.014},"last":0.68200000000000005}]},{"osd":1,"last update":"Tue Nov 28 20:01:59 2023","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.63900000000000001,"15min":0.64300000000000002},"min":{"1min":0.46100000000000002,"5min":0.438,"15min":0.438},"max":{"1min":0.95099999999999996,"5min":0.95099999999999996,"15min":0.95099999999999996},"last":0.76800000000000002},{"interface":"front","average":{"1min":0.66400000000000003,"5min":0.68100000000000005,"15min":0.69499999999999995},"min":{"1min":0.45600000000000002,"5min":0.432,"15min":0.432},"max":{"1min":0.85099999999999998,"5min":1.0900000000000001,"15min":1.0900000000000001},"last":0.66600000000000004}]},{"osd":2,"last update":"Tue Nov 28 20:01:59 2023","interfaces":[{"interface":"back","average":{"1min":0.69899999999999995,"5min":0.70899999999999996,"15min":0.72599999999999998},"min":{"1min":0.497,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.93100000000000005,"5min":0.98799999999999999,"15min":0.98799999999999999},"last":0.62},{"interface":"front","average":{"1min":0.66800000000000004,"5min":0.68799999999999994,"15min":0.69999999999999996},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":1.514,"5min":1.514,"15min":1.514},"last":0.71499999999999997}]},{"osd":3,"last update":"Tue Nov 28 20:01:59 2023","interfaces":[{"interface":"back","average":{"1min":0.68200000000000005,"5min":0.69699999999999995,"15min":0.69899999999999995},"min":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":0.90200000000000002,"5min":1.0449999999999999,"15min":1.0449999999999999},"last":0.82199999999999995},{"interface":"front","average":{"1min":0.70899999999999996,"5min":0.76600000000000001,"15min":0.78400000000000003},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":1.034,"5min":1.1299999999999999,"15min":1.1299999999999999},"last":0.73099999999999998}]},{"osd":4,"last update":"Tue Nov 28 20:01:59 2023","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.628,"15min":0.63700000000000001},"min":{"1min":0.38900000000000001,"5min":0.378,"15min":0.378},"max":{"1min":1.2829999999999999,"5min":1.2829999999999999,"15min":1.2829999999999999},"last":0.746},{"interface":"front","average":{"1min":0.66800000000000004,"5min":0.70899999999999996,"15min":0.72499999999999998},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.91800000000000004,"5min":1.1120000000000001,"15min":1.1120000000000001},"last":0.86699999999999999}]},{"osd":5,"last update":"Tue Nov 28 20:01:59 2023","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.65300000000000002,"15min":0.67400000000000004},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.97999999999999998,"5min":1.1699999999999999,"15min":1.1699999999999999},"last":0.755},{"interface":"front","average":{"1min":0.70899999999999996,"5min":0.73699999999999999,"15min":0.75600000000000001},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":1.3300000000000001,"5min":1.3300000000000001,"15min":1.3300000000000001},"last":0.54200000000000004}]},{"osd":6,"last update":"Tue Nov 28 20:01:59 2023","interfaces":[{"interface":"back","average":{"1min":0.76000000000000001,"5min":0.76400000000000001,"15min":0.77600000000000002},"min":{"1min":0.53500000000000003,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":1.3919999999999999,"5min":1.3919999999999999,"15min":1.3919999999999999},"last":0.79500000000000004},{"interface":"front","average":{"1min":0.67000000000000004,"5min":0.71199999999999997,"15min":0.73499999999999999},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.96099999999999997,"5min":1.23,"15min":1.23},"last":0.64200000000000002}]}]},{"osd":6,"up_from":13,"seq":55834574892,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32172,"kb_used_data":996,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339668,"statfs":{"total":96636764160,"available":96603820032,"internally_reserved":0,"allocated":1019904,"data_stored":473262,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 20:01:54 2023","interfaces":[{"interface":"back","average":{"1min":0.64000000000000001,"5min":0.621,"15min":0.61699999999999999},"min":{"1min":0.40200000000000002,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.91600000000000004,"5min":0.91600000000000004,"15min":0.91600000000000004},"last":0.88700000000000001},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.66000000000000003,"15min":0.66200000000000003},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":0.80600000000000005,"5min":0.98999999999999999,"15min":0.98999999999999999},"last":0.626}]},{"osd":1,"last update":"Tue Nov 28 20:01:54 2023","interfaces":[{"interface":"back","average":{"1min":0.71499999999999997,"5min":0.76600000000000001,"15min":0.78200000000000003},"min":{"1min":0.54700000000000004,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.012,"5min":1.105,"15min":1.105},"last":0.78500000000000003},{"interface":"front","average":{"1min":0.62,"5min":0.67600000000000005,"15min":0.68300000000000005},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":0.90200000000000002,"5min":0.95899999999999996,"15min":0.95899999999999996},"last":0.65100000000000002}]},{"osd":2,"last update":"Tue Nov 28 20:01:54 2023","interfaces":[{"interface":"back","average":{"1min":0.63800000000000001,"5min":0.68200000000000005,"15min":0.69399999999999995},"min":{"1min":0.502,"5min":0.502,"15min":0.502},"max":{"1min":0.78900000000000003,"5min":0.93400000000000005,"15min":0.93400000000000005},"last":0.66800000000000004},{"interface":"front","average":{"1min":0.65800000000000003,"5min":0.70399999999999996,"15min":0.71399999999999997},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":0.95299999999999996,"5min":1.006,"15min":1.006},"last":0.69199999999999995}]},{"osd":3,"last update":"Tue Nov 28 20:01:54 2023","interfaces":[{"interface":"back","average":{"1min":0.68300000000000005,"5min":0.72799999999999998,"15min":0.74199999999999999},"min":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":0.96699999999999997,"5min":1.056,"15min":1.056},"last":0.86299999999999999},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.66600000000000004,"15min":0.67800000000000005},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":0.78200000000000003,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.75700000000000001}]},{"osd":4,"last update":"Tue Nov 28 20:01:54 2023","interfaces":[{"interface":"back","average":{"1min":0.61299999999999999,"5min":0.624,"15min":0.628},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.93300000000000005,"5min":0.97599999999999998,"15min":0.97599999999999998},"last":0.55600000000000005},{"interface":"front","average":{"1min":0.61499999999999999,"5min":0.68700000000000006,"15min":0.72099999999999997},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.91700000000000004,"5min":1.389,"15min":1.389},"last":0.82799999999999996}]},{"osd":5,"last update":"Tue Nov 28 20:01:54 2023","interfaces":[{"interface":"back","average":{"1min":0.68799999999999994,"5min":0.77100000000000002,"15min":0.80100000000000005},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":1.0629999999999999,"5min":1.4259999999999999,"15min":1.4259999999999999},"last":0.71599999999999997},{"interface":"front","average":{"1min":0.65600000000000003,"5min":0.72999999999999998,"15min":0.752},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.97099999999999997,"5min":1.276,"15min":1.276},"last":0.73599999999999999}]},{"osd":7,"last update":"Tue Nov 28 20:01:54 2023","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.67900000000000005,"15min":0.70299999999999996},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.84199999999999997,"5min":1.014,"15min":1.014},"last":0.80500000000000005},{"interface":"front","average":{"1min":0.68200000000000005,"5min":0.77900000000000003,"15min":0.81299999999999994},"min":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":1.002,"5min":1.242,"15min":1.242},"last":0.77500000000000002}]}]},{"osd":5,"up_from":13,"seq":55834574894,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32156,"kb_used_data":976,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339684,"statfs":{"total":96636764160,"available":96603836416,"internally_reserved":0,"allocated":999424,"data_stored":469551,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 20:01:59 2023","interfaces":[{"interface":"back","average":{"1min":0.66500000000000004,"5min":0.68400000000000005,"15min":0.70099999999999996},"min":{"1min":0.44400000000000001,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":1.077,"5min":1.077,"15min":1.077},"last":0.72799999999999998},{"interface":"front","average":{"1min":0.65300000000000002,"5min":0.68500000000000005,"15min":0.70699999999999996},"min":{"1min":0.41899999999999998,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.94599999999999995,"5min":1.149,"15min":1.149},"last":0.80600000000000005}]},{"osd":1,"last update":"Tue Nov 28 20:01:59 2023","interfaces":[{"interface":"back","average":{"1min":0.626,"5min":0.68600000000000005,"15min":0.70399999999999996},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.82599999999999996,"5min":0.94499999999999995,"15min":0.94499999999999995},"last":0.83399999999999996},{"interface":"front","average":{"1min":0.67400000000000004,"5min":0.69299999999999995,"15min":0.71699999999999997},"min":{"1min":0.49099999999999999,"5min":0.38,"15min":0.38},"max":{"1min":1.008,"5min":1.0940000000000001,"15min":1.0940000000000001},"last":0.77900000000000003}]},{"osd":2,"last update":"Tue Nov 28 20:01:59 2023","interfaces":[{"interface":"back","average":{"1min":0.65400000000000003,"5min":0.83299999999999996,"15min":0.90800000000000003},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":1.044,"5min":5.0880000000000001,"15min":5.0880000000000001},"last":0.75700000000000001},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.879,"15min":0.96099999999999997},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":0.91300000000000003,"5min":5.1399999999999997,"15min":5.1399999999999997},"last":0.66500000000000004}]},{"osd":3,"last update":"Tue Nov 28 20:01:59 2023","interfaces":[{"interface":"back","average":{"1min":0.71499999999999997,"5min":0.90100000000000002,"15min":0.98499999999999999},"min":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":1.1000000000000001,"5min":5.0469999999999997,"15min":5.0469999999999997},"last":0.85399999999999998},{"interface":"front","average":{"1min":0.69999999999999996,"5min":0.878,"15min":0.95999999999999996},"min":{"1min":0.47899999999999998,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":0.95899999999999996,"5min":5.024,"15min":5.024},"last":0.70999999999999996}]},{"osd":4,"last update":"Tue Nov 28 20:01:59 2023","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.64000000000000001,"15min":0.66400000000000003},"min":{"1min":0.42899999999999999,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.877,"5min":1.4810000000000001,"15min":1.4810000000000001},"last":0.433},{"interface":"front","average":{"1min":0.67300000000000004,"5min":0.72099999999999997,"15min":0.73799999999999999},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.97599999999999998,"5min":1.6339999999999999,"15min":1.6339999999999999},"last":0.51200000000000001}]},{"osd":6,"last update":"Tue Nov 28 20:01:59 2023","interfaces":[{"interface":"back","average":{"1min":0.70699999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"min":{"1min":0.48399999999999999,"5min":0.434,"15min":0.434},"max":{"1min":1.0489999999999999,"5min":1.0489999999999999,"15min":1.0489999999999999},"last":0.58299999999999996},{"interface":"front","average":{"1min":0.68899999999999995,"5min":0.72499999999999998,"15min":0.73999999999999999},"min":{"1min":0.47599999999999998,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":0.93200000000000005,"5min":1.099,"15min":1.099},"last":0.48899999999999999}]},{"osd":7,"last update":"Tue Nov 28 20:01:59 2023","interfaces":[{"interface":"back","average":{"1min":0.73599999999999999,"5min":0.77300000000000002,"15min":0.78200000000000003},"min":{"1min":0.48899999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":1.022,"5min":1.236,"15min":1.236},"last":0.56799999999999995},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.78300000000000003,"15min":0.79500000000000004},"min":{"1min":0.51100000000000001,"5min":0.505,"15min":0.505},"max":{"1min":1.1000000000000001,"5min":1.1000000000000001,"15min":1.1000000000000001},"last":0.54000000000000004}]}]},{"osd":4,"up_from":13,"seq":55834574893,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32164,"kb_used_data":984,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339676,"statfs":{"total":96636764160,"available":96603828224,"internally_reserved":0,"allocated":1007616,"data_stored":469711,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 20:01:58 2023","interfaces":[{"interface":"back","average":{"1min":0.70799999999999996,"5min":0.69399999999999995,"15min":0.70499999999999996},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":1.107,"5min":1.107,"15min":1.107},"last":0.66500000000000004},{"interface":"front","average":{"1min":0.63200000000000001,"5min":0.68300000000000005,"15min":0.70299999999999996},"min":{"1min":0.42799999999999999,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":1.024,"5min":1.163,"15min":1.163},"last":0.63400000000000001}]},{"osd":1,"last update":"Tue Nov 28 20:01:58 2023","interfaces":[{"interface":"back","average":{"1min":0.64400000000000002,"5min":0.71199999999999997,"15min":0.746},"min":{"1min":0.432,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.93799999999999994,"5min":1.111,"15min":1.111},"last":0.69899999999999995},{"interface":"front","average":{"1min":0.77600000000000002,"5min":0.78000000000000003,"15min":0.80200000000000005},"min":{"1min":0.629,"5min":0.443,"15min":0.443},"max":{"1min":1.0640000000000001,"5min":1.238,"15min":1.238},"last":0.74299999999999999}]},{"osd":2,"last update":"Tue Nov 28 20:01:58 2023","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.751,"15min":0.77200000000000002},"min":{"1min":0.48599999999999999,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":1.026,"5min":1.0669999999999999,"15min":1.0669999999999999},"last":0.61899999999999999},{"interface":"front","average":{"1min":0.754,"5min":0.77400000000000002,"15min":0.80200000000000005},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":1.1359999999999999,"5min":1.1359999999999999,"15min":1.1359999999999999},"last":0.71499999999999997}]},{"osd":3,"last update":"Tue Nov 28 20:01:58 2023","interfaces":[{"interface":"back","average":{"1min":0.69199999999999995,"5min":0.74399999999999999,"15min":0.78200000000000003},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":0.97999999999999998,"5min":1.202,"15min":1.202},"last":0.55800000000000005},{"interface":"front","average":{"1min":0.74199999999999999,"5min":0.76100000000000001,"15min":0.78400000000000003},"min":{"1min":0.52800000000000002,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":1.0669999999999999,"5min":1.0669999999999999,"15min":1.0669999999999999},"last":0.64900000000000002}]},{"osd":5,"last update":"Tue Nov 28 20:01:58 2023","interfaces":[{"interface":"back","average":{"1min":0.68600000000000005,"5min":0.69499999999999995,"15min":0.71399999999999997},"min":{"1min":0.41199999999999998,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.89600000000000002,"5min":0.95899999999999996,"15min":0.95899999999999996},"last":0.53200000000000003},{"interface":"front","average":{"1min":0.65600000000000003,"5min":0.68400000000000005,"15min":0.70399999999999996},"min":{"1min":0.435,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.90500000000000003,"5min":1.034,"15min":1.034},"last":0.505}]},{"osd":6,"last update":"Tue Nov 28 20:01:58 2023","interfaces":[{"interface":"back","average":{"1min":0.64500000000000002,"5min":0.69099999999999995,"15min":0.71999999999999997},"min":{"1min":0.45300000000000001,"5min":0.438,"15min":0.438},"max":{"1min":0.85299999999999998,"5min":1.0309999999999999,"15min":1.0309999999999999},"last":0.57499999999999996},{"interface":"front","average":{"1min":0.76300000000000001,"5min":0.76600000000000001,"15min":0.77800000000000002},"min":{"1min":0.55400000000000005,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":0.93999999999999995,"5min":1.002,"15min":1.002},"last":0.59399999999999997}]},{"osd":7,"last update":"Tue Nov 28 20:01:58 2023","interfaces":[{"interface":"back","average":{"1min":0.72699999999999998,"5min":0.75900000000000001,"15min":0.77800000000000002},"min":{"1min":0.57399999999999995,"5min":0.495,"15min":0.495},"max":{"1min":1.089,"5min":1.089,"15min":1.089},"last":0.68000000000000005},{"interface":"front","average":{"1min":0.81599999999999995,"5min":0.83699999999999997,"15min":0.85899999999999999},"min":{"1min":0.621,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":1.042,"5min":1.1459999999999999,"15min":1.1459999999999999},"last":0.72899999999999998}]}]},{"osd":3,"up_from":13,"seq":55834574894,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32156,"kb_used_data":976,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339684,"statfs":{"total":96636764160,"available":96603836416,"internally_reserved":0,"allocated":999424,"data_stored":469551,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 20:01:56 2023","interfaces":[{"interface":"back","average":{"1min":0.44900000000000001,"5min":0.441,"15min":0.44500000000000001},"min":{"1min":0.26300000000000001,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":1.7130000000000001,"5min":1.7130000000000001,"15min":1.7130000000000001},"last":0.38500000000000001},{"interface":"front","average":{"1min":0.51400000000000001,"5min":0.46600000000000003,"15min":0.47099999999999997},"min":{"1min":0.27100000000000002,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":3.0630000000000002,"5min":3.0630000000000002,"15min":3.0630000000000002},"last":0.503}]},{"osd":1,"last update":"Tue Nov 28 20:01:56 2023","interfaces":[{"interface":"back","average":{"1min":0.44600000000000001,"5min":0.45800000000000002,"15min":0.47399999999999998},"min":{"1min":0.317,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.89200000000000002,"5min":0.89200000000000002,"15min":0.89200000000000002},"last":0.32900000000000001},{"interface":"front","average":{"1min":0.65600000000000003,"5min":0.52200000000000002,"15min":0.51000000000000001},"min":{"1min":0.34200000000000003,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":5.8920000000000003,"5min":5.8920000000000003,"15min":5.8920000000000003},"last":0.66700000000000004}]},{"osd":2,"last update":"Tue Nov 28 20:01:56 2023","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.54800000000000004,"15min":0.53800000000000003},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":4.6390000000000002,"5min":4.6390000000000002,"15min":4.6390000000000002},"last":0.54400000000000004},{"interface":"front","average":{"1min":0.95099999999999996,"5min":0.63900000000000001,"15min":0.60299999999999998},"min":{"1min":0.40899999999999997,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":11.593,"5min":11.593,"15min":11.593},"last":0.46800000000000003}]},{"osd":4,"last update":"Tue Nov 28 20:01:56 2023","interfaces":[{"interface":"back","average":{"1min":0.91100000000000003,"5min":0.79400000000000004,"15min":0.77200000000000002},"min":{"1min":0.46600000000000003,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":5.5549999999999997,"5min":5.5549999999999997,"15min":5.5549999999999997},"last":0.63300000000000001},{"interface":"front","average":{"1min":1.179,"5min":0.879,"15min":0.82799999999999996},"min":{"1min":0.60999999999999999,"5min":0.503,"15min":0.503},"max":{"1min":11.747,"5min":11.747,"15min":11.747},"last":0.60999999999999999}]},{"osd":5,"last update":"Tue Nov 28 20:01:56 2023","interfaces":[{"interface":"back","average":{"1min":1.1040000000000001,"5min":0.85699999999999998,"15min":0.81899999999999995},"min":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":11.705,"5min":11.705,"15min":11.705},"last":0.52600000000000002},{"interface":"front","average":{"1min":0.70399999999999996,"5min":0.77100000000000002,"15min":0.79200000000000004},"min":{"1min":0.51200000000000001,"5min":0.495,"15min":0.495},"max":{"1min":1.0580000000000001,"5min":1.3100000000000001,"15min":1.3100000000000001},"last":0.69599999999999995}]},{"osd":6,"last update":"Tue Nov 28 20:01:56 2023","interfaces":[{"interface":"back","average":{"1min":0.748,"5min":0.81899999999999995,"15min":0.83499999999999996},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":1.6639999999999999,"5min":1.6639999999999999,"15min":1.6639999999999999},"last":0.72399999999999998},{"interface":"front","average":{"1min":0.84499999999999997,"5min":0.80400000000000005,"15min":0.76700000000000002},"min":{"1min":0.52900000000000003,"5min":0.495,"15min":0.495},"max":{"1min":3.1459999999999999,"5min":4.0679999999999996,"15min":4.0679999999999996},"last":0.82099999999999995}]},{"osd":7,"last update":"Tue Nov 28 20:01:56 2023","interfaces":[{"interface":"back","average":{"1min":0.96199999999999997,"5min":0.89600000000000002,"15min":0.86499999999999999},"min":{"1min":0.52100000000000002,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":6.6619999999999999,"5min":6.6619999999999999,"15min":6.6619999999999999},"last":0.78000000000000003},{"interface":"front","average":{"1min":1.141,"5min":0.92300000000000004,"15min":0.90100000000000002},"min":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":11.782,"5min":11.782,"15min":11.782},"last":0.57399999999999995}]}]},{"osd":2,"up_from":13,"seq":55834574892,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32156,"kb_used_data":976,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339684,"statfs":{"total":96636764160,"available":96603836416,"internally_reserved":0,"allocated":999424,"data_stored":469551,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 20:01:57 2023","interfaces":[{"interface":"back","average":{"1min":0.39600000000000002,"5min":0.438,"15min":0.45000000000000001},"min":{"1min":0.28899999999999998,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.60399999999999998,"5min":0.74099999999999999,"15min":0.74099999999999999},"last":0.58399999999999996},{"interface":"front","average":{"1min":0.435,"5min":0.46100000000000002,"15min":0.47499999999999998},"min":{"1min":0.30199999999999999,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.59599999999999997,"5min":0.67700000000000005,"15min":0.67700000000000005},"last":0.37}]},{"osd":1,"last update":"Tue Nov 28 20:01:57 2023","interfaces":[{"interface":"back","average":{"1min":0.47699999999999998,"5min":0.48999999999999999,"15min":0.50600000000000001},"min":{"1min":0.377,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.64500000000000002,"5min":1.0389999999999999,"15min":1.0389999999999999},"last":0.50600000000000001},{"interface":"front","average":{"1min":0.45100000000000001,"5min":0.47999999999999998,"15min":0.496},"min":{"1min":0.33800000000000002,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.58999999999999997,"5min":0.70999999999999996,"15min":0.70999999999999996},"last":0.54400000000000004}]},{"osd":3,"last update":"Tue Nov 28 20:01:57 2023","interfaces":[{"interface":"back","average":{"1min":0.45700000000000002,"5min":0.46300000000000002,"15min":0.46899999999999997},"min":{"1min":0.36899999999999999,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.60299999999999998,"5min":0.629,"15min":0.629},"last":0.63300000000000001},{"interface":"front","average":{"1min":0.52300000000000002,"5min":0.55900000000000005,"15min":0.58099999999999996},"min":{"1min":0.41599999999999998,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.58899999999999997,"5min":0.98499999999999999,"15min":0.98499999999999999},"last":0.56399999999999995}]},{"osd":4,"last update":"Tue Nov 28 20:01:57 2023","interfaces":[{"interface":"back","average":{"1min":0.69399999999999995,"5min":0.80300000000000005,"15min":0.84199999999999997},"min":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":0.86899999999999999,"5min":1.139,"15min":1.139},"last":0.60399999999999998},{"interface":"front","average":{"1min":0.70199999999999996,"5min":0.79600000000000004,"15min":0.83399999999999996},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":1.008,"5min":1.238,"15min":1.238},"last":0.73399999999999999}]},{"osd":5,"last update":"Tue Nov 28 20:01:57 2023","interfaces":[{"interface":"back","average":{"1min":0.70799999999999996,"5min":0.81200000000000006,"15min":0.85999999999999999},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":1.0389999999999999,"5min":1.6180000000000001,"15min":1.6180000000000001},"last":0.62},{"interface":"front","average":{"1min":0.70699999999999996,"5min":0.78400000000000003,"15min":0.81799999999999995},"min":{"1min":0.51800000000000002,"5min":0.496,"15min":0.496},"max":{"1min":1.0149999999999999,"5min":1.339,"15min":1.339},"last":0.82199999999999995}]},{"osd":6,"last update":"Tue Nov 28 20:01:57 2023","interfaces":[{"interface":"back","average":{"1min":0.71399999999999997,"5min":0.77300000000000002,"15min":0.79500000000000004},"min":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":1.0589999999999999,"5min":1.1839999999999999,"15min":1.1839999999999999},"last":0.78100000000000003},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.80300000000000005,"15min":0.84199999999999997},"min":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":0.98699999999999999,"5min":1.099,"15min":1.099},"last":0.67900000000000005}]},{"osd":7,"last update":"Tue Nov 28 20:01:57 2023","interfaces":[{"interface":"back","average":{"1min":0.69599999999999995,"5min":0.82199999999999995,"15min":0.86699999999999999},"min":{"1min":0.53300000000000003,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":0.94699999999999995,"5min":1.4590000000000001,"15min":1.4590000000000001},"last":0.69799999999999995},{"interface":"front","average":{"1min":0.73199999999999998,"5min":0.80900000000000005,"15min":0.84699999999999998},"min":{"1min":0.55200000000000005,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":1.0760000000000001,"5min":1.387,"15min":1.387},"last":0.71499999999999997}]}]},{"osd":1,"up_from":13,"seq":55834574894,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32160,"kb_used_data":980,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339680,"statfs":{"total":96636764160,"available":96603832320,"internally_reserved":0,"allocated":1003520,"data_stored":469621,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 20:02:00 2023","interfaces":[{"interface":"back","average":{"1min":0.38700000000000001,"5min":0.54600000000000004,"15min":0.62},"min":{"1min":0.249,"5min":0.249,"15min":0.249},"max":{"1min":0.60699999999999998,"5min":3.8740000000000001,"15min":3.8740000000000001},"last":0.23300000000000001},{"interface":"front","average":{"1min":0.42099999999999999,"5min":0.51000000000000001,"15min":0.55100000000000005},"min":{"1min":0.32300000000000001,"5min":0.25,"15min":0.25},"max":{"1min":0.60399999999999998,"5min":2.0760000000000001,"15min":2.0760000000000001},"last":0.26900000000000002}]},{"osd":2,"last update":"Tue Nov 28 20:02:00 2023","interfaces":[{"interface":"back","average":{"1min":0.41399999999999998,"5min":0.56000000000000005,"15min":0.626},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.70799999999999996,"5min":3.7320000000000002,"15min":3.7320000000000002},"last":0.34799999999999998},{"interface":"front","average":{"1min":0.46899999999999997,"5min":0.63400000000000001,"15min":0.71799999999999997},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.67000000000000004,"5min":3.9089999999999998,"15min":3.9089999999999998},"last":0.28999999999999998}]},{"osd":3,"last update":"Tue Nov 28 20:02:00 2023","interfaces":[{"interface":"back","average":{"1min":0.52200000000000002,"5min":0.61799999999999999,"15min":0.66000000000000003},"min":{"1min":0.436,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.70799999999999996,"5min":1.6399999999999999,"15min":1.6399999999999999},"last":0.64200000000000002},{"interface":"front","average":{"1min":0.45500000000000002,"5min":0.61599999999999999,"15min":0.67400000000000004},"min":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.625,"5min":2.5270000000000001,"15min":2.5270000000000001},"last":0.56699999999999995}]},{"osd":4,"last update":"Tue Nov 28 20:02:00 2023","interfaces":[{"interface":"back","average":{"1min":0.69799999999999995,"5min":0.81699999999999995,"15min":0.86899999999999999},"min":{"1min":0.42199999999999999,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.91400000000000003,"5min":3.1659999999999999,"15min":3.1659999999999999},"last":0.441},{"interface":"front","average":{"1min":0.69699999999999995,"5min":0.84399999999999997,"15min":0.91200000000000003},"min":{"1min":0.52300000000000002,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.94299999999999995,"5min":3.7959999999999998,"15min":3.7959999999999998},"last":0.58299999999999996}]},{"osd":5,"last update":"Tue Nov 28 20:02:00 2023","interfaces":[{"interface":"back","average":{"1min":0.71399999999999997,"5min":0.875,"15min":0.95099999999999996},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":1.004,"5min":4.1479999999999997,"15min":4.1479999999999997},"last":0.60299999999999998},{"interface":"front","average":{"1min":0.69799999999999995,"5min":0.82599999999999996,"15min":0.88200000000000001},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":0.87,"5min":3.5569999999999999,"15min":3.5569999999999999},"last":0.55000000000000004}]},{"osd":6,"last update":"Tue Nov 28 20:02:00 2023","interfaces":[{"interface":"back","average":{"1min":0.72399999999999998,"5min":0.88800000000000001,"15min":0.95699999999999996},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":0.94499999999999995,"5min":2.863,"15min":2.863},"last":0.48499999999999999},{"interface":"front","average":{"1min":0.76800000000000002,"5min":0.89800000000000002,"15min":0.95399999999999996},"min":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":0.97999999999999998,"5min":3.371,"15min":3.371},"last":0.62}]},{"osd":7,"last update":"Tue Nov 28 20:02:00 2023","interfaces":[{"interface":"back","average":{"1min":0.70299999999999996,"5min":0.89100000000000001,"15min":0.97199999999999998},"min":{"1min":0.53100000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":0.93600000000000005,"5min":3.8439999999999999,"15min":3.8439999999999999},"last":0.67900000000000005},{"interface":"front","average":{"1min":0.68799999999999994,"5min":0.90500000000000003,"15min":0.99299999999999999},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.95899999999999996,"5min":3.9689999999999999,"15min":3.9689999999999999},"last":0.53200000000000003}]}]},{"osd":0,"up_from":13,"seq":55834574893,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32240,"kb_used_data":1064,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339600,"statfs":{"total":96636764160,"available":96603750400,"internally_reserved":0,"allocated":1089536,"data_stored":1063732,"data_compressed":33374,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Nov 28 20:01:57 2023","interfaces":[{"interface":"back","average":{"1min":0.38700000000000001,"5min":0.57399999999999995,"15min":0.65100000000000002},"min":{"1min":0.24099999999999999,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":0.68400000000000005,"5min":4.883,"15min":4.883},"last":0.34100000000000003},{"interface":"front","average":{"1min":0.43099999999999999,"5min":0.70099999999999996,"15min":0.81899999999999995},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.66800000000000004,"5min":8.0800000000000001,"15min":8.0800000000000001},"last":0.47099999999999997}]},{"osd":2,"last update":"Tue Nov 28 20:01:57 2023","interfaces":[{"interface":"back","average":{"1min":0.50800000000000001,"5min":0.77400000000000002,"15min":0.90700000000000003},"min":{"1min":0.312,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.85599999999999998,"5min":8.1029999999999998,"15min":8.1029999999999998},"last":0.49399999999999999},{"interface":"front","average":{"1min":0.53300000000000003,"5min":0.79400000000000004,"15min":0.92200000000000004},"min":{"1min":0.40600000000000003,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.748,"5min":8.1310000000000002,"15min":8.1310000000000002},"last":0.52700000000000002}]},{"osd":3,"last update":"Tue Nov 28 20:01:57 2023","interfaces":[{"interface":"back","average":{"1min":0.47299999999999998,"5min":0.628,"15min":0.70699999999999996},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.873,"5min":4.3949999999999996,"15min":4.3949999999999996},"last":0.44700000000000001},{"interface":"front","average":{"1min":0.497,"5min":0.65100000000000002,"15min":0.72099999999999997},"min":{"1min":0.37,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.89200000000000002,"5min":4.3470000000000004,"15min":4.3470000000000004},"last":0.54800000000000004}]},{"osd":4,"last update":"Tue Nov 28 20:01:57 2023","interfaces":[{"interface":"back","average":{"1min":0.72799999999999998,"5min":0.92000000000000004,"15min":1.0069999999999999},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":1.038,"5min":4.6360000000000001,"15min":4.6360000000000001},"last":0.71199999999999997},{"interface":"front","average":{"1min":0.76800000000000002,"5min":0.93400000000000005,"15min":1.0129999999999999},"min":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":1.0820000000000001,"5min":4.4710000000000001,"15min":4.4710000000000001},"last":0.68700000000000006}]},{"osd":5,"last update":"Tue Nov 28 20:01:57 2023","interfaces":[{"interface":"back","average":{"1min":0.72599999999999998,"5min":0.93200000000000005,"15min":1.02},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":0.97599999999999998,"5min":4.6120000000000001,"15min":4.6120000000000001},"last":0.73499999999999999},{"interface":"front","average":{"1min":0.78600000000000003,"5min":0.93600000000000005,"15min":1.0129999999999999},"min":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.1319999999999999,"5min":4.5449999999999999,"15min":4.5449999999999999},"last":0.77000000000000002}]},{"osd":6,"last update":"Tue Nov 28 20:01:57 2023","interfaces":[{"interface":"back","average":{"1min":0.755,"5min":0.94499999999999995,"15min":1.034},"min":{"1min":0.53600000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":1.0580000000000001,"5min":4.657,"15min":4.657},"last":0.752},{"interface":"front","average":{"1min":0.75700000000000001,"5min":0.95799999999999996,"15min":1.05},"min":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":1.0049999999999999,"5min":4.5259999999999998,"15min":4.5259999999999998},"last":0.85199999999999998}]},{"osd":7,"last update":"Tue Nov 28 20:01:57 2023","interfaces":[{"interface":"back","average":{"1min":0.73799999999999999,"5min":0.95199999999999996,"15min":1.0509999999999999},"min":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":1.081,"5min":4.7320000000000002,"15min":4.7320000000000002},"last":0.78100000000000003},{"interface":"front","average":{"1min":0.76300000000000001,"5min":0.93100000000000005,"15min":1.0069999999999999},"min":{"1min":0.58699999999999997,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":1.099,"5min":4.4939999999999998,"15min":4.4939999999999998},"last":0.82799999999999996}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33374,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33374,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":3813,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":3711,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-28T20:02:29.950 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-28T20:02:30.120 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:30.116+0000 7f9ff429c640 1 Processor -- start 2023-11-28T20:02:30.120 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:30.116+0000 7f9ff429c640 1 -- start start 2023-11-28T20:02:30.122 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:30.116+0000 7f9ff429c640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f9fec06d690 0x7f9fec0c5300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:30.122 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:30.116+0000 7f9ff429c640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9fec06db20 con 0x7f9fec0c3b80 2023-11-28T20:02:30.122 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:30.116+0000 7f9ff429c640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9fec06bb80 con 0x7f9fec06d2b0 2023-11-28T20:02:30.122 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:30.116+0000 7f9ff429c640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9fec0c5840 con 0x7f9fec06d690 2023-11-28T20:02:30.122 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:30.116+0000 7f9ff2839640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f9fec06d690 0x7f9fec0c5300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:02:30.122 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:30.116+0000 7f9ff2839640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f9fec06d690 0x7f9fec0c5300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:58640/0 (socket says 172.21.15.78:58640) 2023-11-28T20:02:30.122 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:30.116+0000 7f9ff1837640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f9fec0c3b80 0x7f9fec06c730 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:55706/0 (socket says 172.21.15.78:55706) 2023-11-28T20:02:30.123 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:30.116+0000 7f9ff2839640 1 -- 172.21.15.78:0/3995450322 learned_addr learned my addr 172.21.15.78:0/3995450322 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T20:02:30.123 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:30.116+0000 7f9ff2839640 1 -- 172.21.15.78:0/3995450322 >> v1:172.21.15.179:6789/0 conn(0x7f9fec06d2b0 legacy=0x7f9fec06c020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:02:30.123 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:30.116+0000 7f9ff2839640 1 -- 172.21.15.78:0/3995450322 >> v1:172.21.15.78:6789/0 conn(0x7f9fec0c3b80 legacy=0x7f9fec06c730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:02:30.123 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:30.116+0000 7f9ff2839640 1 -- 172.21.15.78:0/3995450322 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9fec1515c0 con 0x7f9fec06d690 2023-11-28T20:02:30.123 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:30.116+0000 7f9ff1036640 1 -- 172.21.15.78:0/3995450322 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4232737194 0 0) 0x7f9fdc001120 con 0x7f9fec0c3b80 2023-11-28T20:02:30.124 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:30.120+0000 7f9ff2839640 1 --2- 172.21.15.78:0/3995450322 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9fec06d690 0x7f9fec0c5300 secure :-1 s=READY pgs=970 cs=0 l=1 rev1=1 crypto rx=0x7f9fe4009e50 tx=0x7f9fe401c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=766054d5834387e2 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:02:30.125 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:30.120+0000 7f9ff1036640 1 -- 172.21.15.78:0/3995450322 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fe40a5770 con 0x7f9fec06d690 2023-11-28T20:02:30.125 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:30.120+0000 7f9ff1036640 1 -- 172.21.15.78:0/3995450322 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9fe40a58d0 con 0x7f9fec06d690 2023-11-28T20:02:30.125 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:30.120+0000 7f9ff1036640 1 -- 172.21.15.78:0/3995450322 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fe40a5c60 con 0x7f9fec06d690 2023-11-28T20:02:30.126 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:30.120+0000 7f9ff429c640 1 -- 172.21.15.78:0/3995450322 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9fec06d690 msgr2=0x7f9fec0c5300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:02:30.126 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:30.120+0000 7f9ff429c640 1 --2- 172.21.15.78:0/3995450322 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9fec06d690 0x7f9fec0c5300 secure :-1 s=READY pgs=970 cs=0 l=1 rev1=1 crypto rx=0x7f9fe4009e50 tx=0x7f9fe401c9a0 comp rx=0 tx=0).stop 2023-11-28T20:02:30.126 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:30.120+0000 7f9ff429c640 1 -- 172.21.15.78:0/3995450322 shutdown_connections 2023-11-28T20:02:30.126 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:30.120+0000 7f9ff429c640 1 --2- 172.21.15.78:0/3995450322 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9fec06d690 0x7f9fec0c5300 unknown :-1 s=CLOSED pgs=970 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:30.126 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:30.120+0000 7f9ff429c640 1 -- 172.21.15.78:0/3995450322 >> 172.21.15.78:0/3995450322 conn(0x7f9fec0a7810 msgr2=0x7f9fec0a7c20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:02:30.127 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:30.120+0000 7f9ff429c640 1 -- 172.21.15.78:0/3995450322 shutdown_connections 2023-11-28T20:02:30.127 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:30.120+0000 7f9ff429c640 1 -- 172.21.15.78:0/3995450322 wait complete. 2023-11-28T20:02:30.127 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:30.124+0000 7f9ff429c640 1 Processor -- start 2023-11-28T20:02:30.127 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:30.124+0000 7f9ff429c640 1 -- start start 2023-11-28T20:02:30.129 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:30.124+0000 7f9ff429c640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9fec06d2b0 0x7f9fec154a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:30.129 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:30.124+0000 7f9ff429c640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9fec06d690 0x7f9fec15b520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:30.130 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:30.124+0000 7f9ff429c640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9fec0c3b80 0x7f9fec14dc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:30.130 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:30.124+0000 7f9ff429c640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9fec158c70 con 0x7f9fec0c3b80 2023-11-28T20:02:30.130 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:30.124+0000 7f9ff429c640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9fec0aa3d0 con 0x7f9fec06d2b0 2023-11-28T20:02:30.130 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:30.124+0000 7f9ff429c640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9fec0aa6b0 con 0x7f9fec06d690 2023-11-28T20:02:30.130 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:30.124+0000 7f9ff2839640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9fec0c3b80 0x7f9fec14dc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:02:30.130 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:30.124+0000 7f9ff2839640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9fec0c3b80 0x7f9fec14dc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:58652/0 (socket says 172.21.15.78:58652) 2023-11-28T20:02:30.130 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:30.124+0000 7f9ff2839640 1 -- 172.21.15.78:0/3869326138 learned_addr learned my addr 172.21.15.78:0/3869326138 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T20:02:30.130 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:30.124+0000 7f9ff2038640 1 --2- 172.21.15.78:0/3869326138 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9fec06d2b0 0x7f9fec154a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:02:30.130 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:30.124+0000 7f9ff1837640 1 --2- 172.21.15.78:0/3869326138 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9fec06d690 0x7f9fec15b520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:02:30.130 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:30.124+0000 7f9ff2839640 1 -- 172.21.15.78:0/3869326138 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9fec06d690 msgr2=0x7f9fec15b520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:02:30.131 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:30.124+0000 7f9ff2839640 1 --2- 172.21.15.78:0/3869326138 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9fec06d690 0x7f9fec15b520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:30.131 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:30.124+0000 7f9ff2839640 1 -- 172.21.15.78:0/3869326138 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9fec06d2b0 msgr2=0x7f9fec154a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:02:30.131 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:30.124+0000 7f9ff2839640 1 --2- 172.21.15.78:0/3869326138 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9fec06d2b0 0x7f9fec154a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:30.131 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:30.124+0000 7f9ff2839640 1 -- 172.21.15.78:0/3869326138 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9fe4009b30 con 0x7f9fec0c3b80 2023-11-28T20:02:30.131 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:30.124+0000 7f9ff1837640 1 --2- 172.21.15.78:0/3869326138 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9fec06d690 0x7f9fec15b520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T20:02:30.131 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:30.124+0000 7f9ff2839640 1 --2- 172.21.15.78:0/3869326138 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9fec0c3b80 0x7f9fec14dc20 secure :-1 s=READY pgs=971 cs=0 l=1 rev1=1 crypto rx=0x7f9fe40af040 tx=0x7f9fe4019740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:02:30.131 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:30.124+0000 7f9fe2ffd640 1 -- 172.21.15.78:0/3869326138 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fe40b8670 con 0x7f9fec0c3b80 2023-11-28T20:02:30.131 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:30.124+0000 7f9fe2ffd640 1 -- 172.21.15.78:0/3869326138 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9fe40b87d0 con 0x7f9fec0c3b80 2023-11-28T20:02:30.131 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:30.124+0000 7f9fe2ffd640 1 -- 172.21.15.78:0/3869326138 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fe40b8b40 con 0x7f9fec0c3b80 2023-11-28T20:02:30.132 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:30.124+0000 7f9ff429c640 1 -- 172.21.15.78:0/3869326138 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9fec14ef80 con 0x7f9fec0c3b80 2023-11-28T20:02:30.132 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:30.124+0000 7f9ff429c640 1 -- 172.21.15.78:0/3869326138 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9fec0aac70 con 0x7f9fec0c3b80 2023-11-28T20:02:30.133 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:30.124+0000 7f9ff429c640 1 -- 172.21.15.78:0/3869326138 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9fec0679d0 con 0x7f9fec0c3b80 2023-11-28T20:02:30.133 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:30.128+0000 7f9fe2ffd640 1 -- 172.21.15.78:0/3869326138 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f9fe40b8ca0 con 0x7f9fec0c3b80 2023-11-28T20:02:30.133 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:30.128+0000 7f9fe2ffd640 1 --2- 172.21.15.78:0/3869326138 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f9fd00664a0 0x7f9fd0068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:30.133 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:30.128+0000 7f9fe2ffd640 1 -- 172.21.15.78:0/3869326138 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6885+0+0 (secure 0 0 0) 0x7f9fe411f720 con 0x7f9fec0c3b80 2023-11-28T20:02:30.133 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:30.128+0000 7f9ff2038640 1 --2- 172.21.15.78:0/3869326138 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f9fd00664a0 0x7f9fd0068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:02:30.133 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:30.128+0000 7f9ff2038640 1 --2- 172.21.15.78:0/3869326138 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f9fd00664a0 0x7f9fd0068960 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f9fe8007fd0 tx=0x7f9fe8007e40 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:02:30.136 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:30.132+0000 7f9fe2ffd640 1 -- 172.21.15.78:0/3869326138 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f9fe40ec810 con 0x7f9fec0c3b80 2023-11-28T20:02:30.283 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:30.280+0000 7f9ff429c640 1 -- 172.21.15.78:0/3869326138 --> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f9fec14ee00 con 0x7f9fd00664a0 2023-11-28T20:02:30.296 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:30.292+0000 7f9fe2ffd640 1 -- 172.21.15.78:0/3869326138 <== mgr.4106 v2:172.21.15.78:6832/2935380957 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+527812 (secure 0 0 0) 0x7f9fe8004c00 con 0x7f9fd00664a0 2023-11-28T20:02:30.301 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-11-28T20:02:30.305 INFO:teuthology.orchestra.run.smithi078.stderr:dumped all 2023-11-28T20:02:30.307 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:30.296+0000 7f9ff429c640 1 -- 172.21.15.78:0/3869326138 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f9fd00664a0 msgr2=0x7f9fd0068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:02:30.307 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:30.296+0000 7f9ff429c640 1 --2- 172.21.15.78:0/3869326138 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f9fd00664a0 0x7f9fd0068960 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f9fe8007fd0 tx=0x7f9fe8007e40 comp rx=0 tx=0).stop 2023-11-28T20:02:30.307 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:30.296+0000 7f9ff429c640 1 -- 172.21.15.78:0/3869326138 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9fec0c3b80 msgr2=0x7f9fec14dc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:02:30.307 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:30.296+0000 7f9ff429c640 1 --2- 172.21.15.78:0/3869326138 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9fec0c3b80 0x7f9fec14dc20 secure :-1 s=READY pgs=971 cs=0 l=1 rev1=1 crypto rx=0x7f9fe40af040 tx=0x7f9fe4019740 comp rx=0 tx=0).stop 2023-11-28T20:02:30.307 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:30.296+0000 7f9ff429c640 1 -- 172.21.15.78:0/3869326138 shutdown_connections 2023-11-28T20:02:30.307 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:30.296+0000 7f9ff429c640 1 --2- 172.21.15.78:0/3869326138 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f9fd00664a0 0x7f9fd0068960 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:30.307 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:30.296+0000 7f9ff429c640 1 --2- 172.21.15.78:0/3869326138 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9fec06d690 0x7f9fec15b520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:30.307 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:30.296+0000 7f9ff429c640 1 --2- 172.21.15.78:0/3869326138 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9fec0c3b80 0x7f9fec14dc20 unknown :-1 s=CLOSED pgs=971 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:30.307 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:30.296+0000 7f9ff429c640 1 --2- 172.21.15.78:0/3869326138 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9fec06d2b0 0x7f9fec154a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:30.307 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:30.296+0000 7f9ff429c640 1 -- 172.21.15.78:0/3869326138 >> 172.21.15.78:0/3869326138 conn(0x7f9fec0a7810 msgr2=0x7f9fec0a7bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:02:30.307 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:30.296+0000 7f9ff429c640 1 -- 172.21.15.78:0/3869326138 shutdown_connections 2023-11-28T20:02:30.308 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:30.296+0000 7f9ff429c640 1 -- 172.21.15.78:0/3869326138 wait complete. 2023-11-28T20:02:30.320 INFO:teuthology.orchestra.run.smithi078.stdout:{"pg_ready":true,"pg_map":{"version":187,"stamp":"2023-11-28T20:02:29.995492+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":596683,"num_objects":46,"num_object_clones":0,"num_object_copies":92,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":251,"num_write_kb":2447,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":28,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":197,"ondisk_log_size":197,"up":386,"acting":386,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":307,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":257904,"kb_used_data":8412,"kb_used_omap":12,"kb_used_meta":249331,"kb_avail":754716816,"statfs":{"total":773094113280,"available":772830019584,"internally_reserved":0,"allocated":8613888,"data_stored":5166311,"data_compressed":66748,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":12752,"internal_metadata":255315504},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":41,"apply_latency_ms":41,"commit_latency_ns":41000000,"apply_latency_ns":41000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001090"},"pg_stats":[{"pgid":"16.21","version":"0'0","reported_seq":11,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-11-28T20:02:27.158233+0000","last_change":"2023-11-28T20:02:25.813454+0000","last_active":"2023-11-28T20:02:27.158233+0000","last_peered":"2023-11-28T20:02:27.158233+0000","last_clean":"2023-11-28T20:02:27.158233+0000","last_became_active":"2023-11-28T20:02:25.813095+0000","last_became_peered":"2023-11-28T20:02:25.813095+0000","last_unstale":"2023-11-28T20:02:27.158233+0000","last_undegraded":"2023-11-28T20:02:27.158233+0000","last_fullsized":"2023-11-28T20:02:27.158233+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:24.842435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:24.842435+0000","last_clean_scrub_stamp":"2023-11-28T20:02:24.842435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:54:17.777079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.3f","version":"0'0","reported_seq":14,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-11-28T20:02:24.856046+0000","last_change":"2023-11-28T20:02:08.304755+0000","last_active":"2023-11-28T20:02:24.856046+0000","last_peered":"2023-11-28T20:02:24.856046+0000","last_clean":"2023-11-28T20:02:24.856046+0000","last_became_active":"2023-11-28T20:02:08.304434+0000","last_became_peered":"2023-11-28T20:02:08.304434+0000","last_unstale":"2023-11-28T20:02:24.856046+0000","last_undegraded":"2023-11-28T20:02:24.856046+0000","last_fullsized":"2023-11-28T20:02:24.856046+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_clean_scrub_stamp":"2023-11-28T20:02:07.264604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:58:51.867372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.20","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-11-28T20:02:25.812910+0000","last_change":"2023-11-28T20:02:25.810553+0000","last_active":"2023-11-28T20:02:25.812910+0000","last_peered":"2023-11-28T20:02:25.812910+0000","last_clean":"2023-11-28T20:02:25.812910+0000","last_became_active":"2023-11-28T20:02:25.810251+0000","last_became_peered":"2023-11-28T20:02:25.810251+0000","last_unstale":"2023-11-28T20:02:25.812910+0000","last_undegraded":"2023-11-28T20:02:25.812910+0000","last_fullsized":"2023-11-28T20:02:25.812910+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:24.842435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:24.842435+0000","last_clean_scrub_stamp":"2023-11-28T20:02:24.842435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:09:59.714547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.3e","version":"0'0","reported_seq":15,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-11-28T20:02:25.817191+0000","last_change":"2023-11-28T20:02:08.296680+0000","last_active":"2023-11-28T20:02:25.817191+0000","last_peered":"2023-11-28T20:02:25.817191+0000","last_clean":"2023-11-28T20:02:25.817191+0000","last_became_active":"2023-11-28T20:02:08.296004+0000","last_became_peered":"2023-11-28T20:02:08.296004+0000","last_unstale":"2023-11-28T20:02:25.817191+0000","last_undegraded":"2023-11-28T20:02:25.817191+0000","last_fullsized":"2023-11-28T20:02:25.817191+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_clean_scrub_stamp":"2023-11-28T20:02:07.264604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:10:35.205323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.23","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-11-28T20:02:25.828343+0000","last_change":"2023-11-28T20:02:25.822866+0000","last_active":"2023-11-28T20:02:25.828343+0000","last_peered":"2023-11-28T20:02:25.828343+0000","last_clean":"2023-11-28T20:02:25.828343+0000","last_became_active":"2023-11-28T20:02:25.822314+0000","last_became_peered":"2023-11-28T20:02:25.822314+0000","last_unstale":"2023-11-28T20:02:25.828343+0000","last_undegraded":"2023-11-28T20:02:25.828343+0000","last_fullsized":"2023-11-28T20:02:25.828343+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:24.842435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:24.842435+0000","last_clean_scrub_stamp":"2023-11-28T20:02:24.842435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:14:02.714877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.3d","version":"0'0","reported_seq":14,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-11-28T20:02:24.855953+0000","last_change":"2023-11-28T20:02:08.308225+0000","last_active":"2023-11-28T20:02:24.855953+0000","last_peered":"2023-11-28T20:02:24.855953+0000","last_clean":"2023-11-28T20:02:24.855953+0000","last_became_active":"2023-11-28T20:02:08.307962+0000","last_became_peered":"2023-11-28T20:02:08.307962+0000","last_unstale":"2023-11-28T20:02:24.855953+0000","last_undegraded":"2023-11-28T20:02:24.855953+0000","last_fullsized":"2023-11-28T20:02:24.855953+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_clean_scrub_stamp":"2023-11-28T20:02:07.264604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:41:07.273185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.22","version":"0'0","reported_seq":11,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-11-28T20:02:26.805958+0000","last_change":"2023-11-28T20:02:25.833957+0000","last_active":"2023-11-28T20:02:26.805958+0000","last_peered":"2023-11-28T20:02:26.805958+0000","last_clean":"2023-11-28T20:02:26.805958+0000","last_became_active":"2023-11-28T20:02:25.833591+0000","last_became_peered":"2023-11-28T20:02:25.833591+0000","last_unstale":"2023-11-28T20:02:26.805958+0000","last_undegraded":"2023-11-28T20:02:26.805958+0000","last_fullsized":"2023-11-28T20:02:26.805958+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:24.842435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:24.842435+0000","last_clean_scrub_stamp":"2023-11-28T20:02:24.842435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:31:28.097904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.3c","version":"0'0","reported_seq":15,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-11-28T20:02:25.815751+0000","last_change":"2023-11-28T20:02:08.315019+0000","last_active":"2023-11-28T20:02:25.815751+0000","last_peered":"2023-11-28T20:02:25.815751+0000","last_clean":"2023-11-28T20:02:25.815751+0000","last_became_active":"2023-11-28T20:02:08.314731+0000","last_became_peered":"2023-11-28T20:02:08.314731+0000","last_unstale":"2023-11-28T20:02:25.815751+0000","last_undegraded":"2023-11-28T20:02:25.815751+0000","last_fullsized":"2023-11-28T20:02:25.815751+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_clean_scrub_stamp":"2023-11-28T20:02:07.264604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:42:00.299852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.25","version":"0'0","reported_seq":11,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-11-28T20:02:26.806408+0000","last_change":"2023-11-28T20:02:25.830955+0000","last_active":"2023-11-28T20:02:26.806408+0000","last_peered":"2023-11-28T20:02:26.806408+0000","last_clean":"2023-11-28T20:02:26.806408+0000","last_became_active":"2023-11-28T20:02:25.829539+0000","last_became_peered":"2023-11-28T20:02:25.829539+0000","last_unstale":"2023-11-28T20:02:26.806408+0000","last_undegraded":"2023-11-28T20:02:26.806408+0000","last_fullsized":"2023-11-28T20:02:26.806408+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:24.842435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:24.842435+0000","last_clean_scrub_stamp":"2023-11-28T20:02:24.842435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:48:13.324982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.3b","version":"0'0","reported_seq":15,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-11-28T20:02:25.805623+0000","last_change":"2023-11-28T20:02:08.301524+0000","last_active":"2023-11-28T20:02:25.805623+0000","last_peered":"2023-11-28T20:02:25.805623+0000","last_clean":"2023-11-28T20:02:25.805623+0000","last_became_active":"2023-11-28T20:02:08.301223+0000","last_became_peered":"2023-11-28T20:02:08.301223+0000","last_unstale":"2023-11-28T20:02:25.805623+0000","last_undegraded":"2023-11-28T20:02:25.805623+0000","last_fullsized":"2023-11-28T20:02:25.805623+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_clean_scrub_stamp":"2023-11-28T20:02:07.264604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:58:52.570056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.24","version":"0'0","reported_seq":11,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-11-28T20:02:27.158314+0000","last_change":"2023-11-28T20:02:25.833122+0000","last_active":"2023-11-28T20:02:27.158314+0000","last_peered":"2023-11-28T20:02:27.158314+0000","last_clean":"2023-11-28T20:02:27.158314+0000","last_became_active":"2023-11-28T20:02:25.832749+0000","last_became_peered":"2023-11-28T20:02:25.832749+0000","last_unstale":"2023-11-28T20:02:27.158314+0000","last_undegraded":"2023-11-28T20:02:27.158314+0000","last_fullsized":"2023-11-28T20:02:27.158314+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:24.842435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:24.842435+0000","last_clean_scrub_stamp":"2023-11-28T20:02:24.842435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:48:13.324982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.3a","version":"0'0","reported_seq":15,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-11-28T20:02:25.807015+0000","last_change":"2023-11-28T20:02:08.309601+0000","last_active":"2023-11-28T20:02:25.807015+0000","last_peered":"2023-11-28T20:02:25.807015+0000","last_clean":"2023-11-28T20:02:25.807015+0000","last_became_active":"2023-11-28T20:02:08.309350+0000","last_became_peered":"2023-11-28T20:02:08.309350+0000","last_unstale":"2023-11-28T20:02:25.807015+0000","last_undegraded":"2023-11-28T20:02:25.807015+0000","last_fullsized":"2023-11-28T20:02:25.807015+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_clean_scrub_stamp":"2023-11-28T20:02:07.264604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:06:22.207175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.27","version":"0'0","reported_seq":11,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-11-28T20:02:26.807444+0000","last_change":"2023-11-28T20:02:25.834678+0000","last_active":"2023-11-28T20:02:26.807444+0000","last_peered":"2023-11-28T20:02:26.807444+0000","last_clean":"2023-11-28T20:02:26.807444+0000","last_became_active":"2023-11-28T20:02:25.834356+0000","last_became_peered":"2023-11-28T20:02:25.834356+0000","last_unstale":"2023-11-28T20:02:26.807444+0000","last_undegraded":"2023-11-28T20:02:26.807444+0000","last_fullsized":"2023-11-28T20:02:26.807444+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:24.842435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:24.842435+0000","last_clean_scrub_stamp":"2023-11-28T20:02:24.842435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:41:24.851016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.39","version":"0'0","reported_seq":14,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-11-28T20:02:24.864662+0000","last_change":"2023-11-28T20:02:08.298696+0000","last_active":"2023-11-28T20:02:24.864662+0000","last_peered":"2023-11-28T20:02:24.864662+0000","last_clean":"2023-11-28T20:02:24.864662+0000","last_became_active":"2023-11-28T20:02:08.297650+0000","last_became_peered":"2023-11-28T20:02:08.297650+0000","last_unstale":"2023-11-28T20:02:24.864662+0000","last_undegraded":"2023-11-28T20:02:24.864662+0000","last_fullsized":"2023-11-28T20:02:24.864662+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_clean_scrub_stamp":"2023-11-28T20:02:07.264604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:27:09.260314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.26","version":"0'0","reported_seq":11,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-11-28T20:02:26.807477+0000","last_change":"2023-11-28T20:02:25.820569+0000","last_active":"2023-11-28T20:02:26.807477+0000","last_peered":"2023-11-28T20:02:26.807477+0000","last_clean":"2023-11-28T20:02:26.807477+0000","last_became_active":"2023-11-28T20:02:25.816180+0000","last_became_peered":"2023-11-28T20:02:25.816180+0000","last_unstale":"2023-11-28T20:02:26.807477+0000","last_undegraded":"2023-11-28T20:02:26.807477+0000","last_fullsized":"2023-11-28T20:02:26.807477+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:24.842435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:24.842435+0000","last_clean_scrub_stamp":"2023-11-28T20:02:24.842435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:28:04.028906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.38","version":"0'0","reported_seq":15,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-11-28T20:02:25.808957+0000","last_change":"2023-11-28T20:02:08.297052+0000","last_active":"2023-11-28T20:02:25.808957+0000","last_peered":"2023-11-28T20:02:25.808957+0000","last_clean":"2023-11-28T20:02:25.808957+0000","last_became_active":"2023-11-28T20:02:08.295852+0000","last_became_peered":"2023-11-28T20:02:08.295852+0000","last_unstale":"2023-11-28T20:02:25.808957+0000","last_undegraded":"2023-11-28T20:02:25.808957+0000","last_fullsized":"2023-11-28T20:02:25.808957+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_clean_scrub_stamp":"2023-11-28T20:02:07.264604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:33:12.680902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.29","version":"0'0","reported_seq":11,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-11-28T20:02:27.354962+0000","last_change":"2023-11-28T20:02:25.826295+0000","last_active":"2023-11-28T20:02:27.354962+0000","last_peered":"2023-11-28T20:02:27.354962+0000","last_clean":"2023-11-28T20:02:27.354962+0000","last_became_active":"2023-11-28T20:02:25.825957+0000","last_became_peered":"2023-11-28T20:02:25.825957+0000","last_unstale":"2023-11-28T20:02:27.354962+0000","last_undegraded":"2023-11-28T20:02:27.354962+0000","last_fullsized":"2023-11-28T20:02:27.354962+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:24.842435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:24.842435+0000","last_clean_scrub_stamp":"2023-11-28T20:02:24.842435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:13:32.125680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.37","version":"0'0","reported_seq":15,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-11-28T20:02:25.807404+0000","last_change":"2023-11-28T20:02:08.297178+0000","last_active":"2023-11-28T20:02:25.807404+0000","last_peered":"2023-11-28T20:02:25.807404+0000","last_clean":"2023-11-28T20:02:25.807404+0000","last_became_active":"2023-11-28T20:02:08.296480+0000","last_became_peered":"2023-11-28T20:02:08.296480+0000","last_unstale":"2023-11-28T20:02:25.807404+0000","last_undegraded":"2023-11-28T20:02:25.807404+0000","last_fullsized":"2023-11-28T20:02:25.807404+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_clean_scrub_stamp":"2023-11-28T20:02:07.264604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:49:05.201081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.28","version":"0'0","reported_seq":11,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-11-28T20:02:26.801976+0000","last_change":"2023-11-28T20:02:25.821945+0000","last_active":"2023-11-28T20:02:26.801976+0000","last_peered":"2023-11-28T20:02:26.801976+0000","last_clean":"2023-11-28T20:02:26.801976+0000","last_became_active":"2023-11-28T20:02:25.819177+0000","last_became_peered":"2023-11-28T20:02:25.819177+0000","last_unstale":"2023-11-28T20:02:26.801976+0000","last_undegraded":"2023-11-28T20:02:26.801976+0000","last_fullsized":"2023-11-28T20:02:26.801976+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:24.842435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:24.842435+0000","last_clean_scrub_stamp":"2023-11-28T20:02:24.842435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:54:17.777079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.36","version":"0'0","reported_seq":14,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-11-28T20:02:24.873529+0000","last_change":"2023-11-28T20:02:08.316569+0000","last_active":"2023-11-28T20:02:24.873529+0000","last_peered":"2023-11-28T20:02:24.873529+0000","last_clean":"2023-11-28T20:02:24.873529+0000","last_became_active":"2023-11-28T20:02:08.316305+0000","last_became_peered":"2023-11-28T20:02:08.316305+0000","last_unstale":"2023-11-28T20:02:24.873529+0000","last_undegraded":"2023-11-28T20:02:24.873529+0000","last_fullsized":"2023-11-28T20:02:24.873529+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_clean_scrub_stamp":"2023-11-28T20:02:07.264604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T06:30:11.363319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.2b","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-11-28T20:02:25.836624+0000","last_change":"2023-11-28T20:02:25.831850+0000","last_active":"2023-11-28T20:02:25.836624+0000","last_peered":"2023-11-28T20:02:25.836624+0000","last_clean":"2023-11-28T20:02:25.836624+0000","last_became_active":"2023-11-28T20:02:25.831635+0000","last_became_peered":"2023-11-28T20:02:25.831635+0000","last_unstale":"2023-11-28T20:02:25.836624+0000","last_undegraded":"2023-11-28T20:02:25.836624+0000","last_fullsized":"2023-11-28T20:02:25.836624+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:24.842435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:24.842435+0000","last_clean_scrub_stamp":"2023-11-28T20:02:24.842435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:21:47.157616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.35","version":"0'0","reported_seq":15,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-11-28T20:02:25.805716+0000","last_change":"2023-11-28T20:02:08.301530+0000","last_active":"2023-11-28T20:02:25.805716+0000","last_peered":"2023-11-28T20:02:25.805716+0000","last_clean":"2023-11-28T20:02:25.805716+0000","last_became_active":"2023-11-28T20:02:08.301047+0000","last_became_peered":"2023-11-28T20:02:08.301047+0000","last_unstale":"2023-11-28T20:02:25.805716+0000","last_undegraded":"2023-11-28T20:02:25.805716+0000","last_fullsized":"2023-11-28T20:02:25.805716+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_clean_scrub_stamp":"2023-11-28T20:02:07.264604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:58:37.957173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.2a","version":"0'0","reported_seq":11,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-11-28T20:02:26.802151+0000","last_change":"2023-11-28T20:02:25.834829+0000","last_active":"2023-11-28T20:02:26.802151+0000","last_peered":"2023-11-28T20:02:26.802151+0000","last_clean":"2023-11-28T20:02:26.802151+0000","last_became_active":"2023-11-28T20:02:25.834533+0000","last_became_peered":"2023-11-28T20:02:25.834533+0000","last_unstale":"2023-11-28T20:02:26.802151+0000","last_undegraded":"2023-11-28T20:02:26.802151+0000","last_fullsized":"2023-11-28T20:02:26.802151+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:24.842435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:24.842435+0000","last_clean_scrub_stamp":"2023-11-28T20:02:24.842435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:48:13.324982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.34","version":"0'0","reported_seq":14,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-11-28T20:02:24.872585+0000","last_change":"2023-11-28T20:02:08.309936+0000","last_active":"2023-11-28T20:02:24.872585+0000","last_peered":"2023-11-28T20:02:24.872585+0000","last_clean":"2023-11-28T20:02:24.872585+0000","last_became_active":"2023-11-28T20:02:08.309719+0000","last_became_peered":"2023-11-28T20:02:08.309719+0000","last_unstale":"2023-11-28T20:02:24.872585+0000","last_undegraded":"2023-11-28T20:02:24.872585+0000","last_fullsized":"2023-11-28T20:02:24.872585+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_clean_scrub_stamp":"2023-11-28T20:02:07.264604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:31:20.575901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.2d","version":"0'0","reported_seq":11,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-11-28T20:02:27.355426+0000","last_change":"2023-11-28T20:02:25.819077+0000","last_active":"2023-11-28T20:02:27.355426+0000","last_peered":"2023-11-28T20:02:27.355426+0000","last_clean":"2023-11-28T20:02:27.355426+0000","last_became_active":"2023-11-28T20:02:25.818823+0000","last_became_peered":"2023-11-28T20:02:25.818823+0000","last_unstale":"2023-11-28T20:02:27.355426+0000","last_undegraded":"2023-11-28T20:02:27.355426+0000","last_fullsized":"2023-11-28T20:02:27.355426+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:24.842435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:24.842435+0000","last_clean_scrub_stamp":"2023-11-28T20:02:24.842435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T06:38:47.345729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.33","version":"0'0","reported_seq":15,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-11-28T20:02:25.815663+0000","last_change":"2023-11-28T20:02:08.294336+0000","last_active":"2023-11-28T20:02:25.815663+0000","last_peered":"2023-11-28T20:02:25.815663+0000","last_clean":"2023-11-28T20:02:25.815663+0000","last_became_active":"2023-11-28T20:02:08.294087+0000","last_became_peered":"2023-11-28T20:02:08.294087+0000","last_unstale":"2023-11-28T20:02:25.815663+0000","last_undegraded":"2023-11-28T20:02:25.815663+0000","last_fullsized":"2023-11-28T20:02:25.815663+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_clean_scrub_stamp":"2023-11-28T20:02:07.264604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:51:11.144383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.2c","version":"0'0","reported_seq":11,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-11-28T20:02:26.806985+0000","last_change":"2023-11-28T20:02:25.822509+0000","last_active":"2023-11-28T20:02:26.806985+0000","last_peered":"2023-11-28T20:02:26.806985+0000","last_clean":"2023-11-28T20:02:26.806985+0000","last_became_active":"2023-11-28T20:02:25.821979+0000","last_became_peered":"2023-11-28T20:02:25.821979+0000","last_unstale":"2023-11-28T20:02:26.806985+0000","last_undegraded":"2023-11-28T20:02:26.806985+0000","last_fullsized":"2023-11-28T20:02:26.806985+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:24.842435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:24.842435+0000","last_clean_scrub_stamp":"2023-11-28T20:02:24.842435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:57:16.929700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.32","version":"0'0","reported_seq":15,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-11-28T20:02:25.806440+0000","last_change":"2023-11-28T20:02:08.307905+0000","last_active":"2023-11-28T20:02:25.806440+0000","last_peered":"2023-11-28T20:02:25.806440+0000","last_clean":"2023-11-28T20:02:25.806440+0000","last_became_active":"2023-11-28T20:02:08.307623+0000","last_became_peered":"2023-11-28T20:02:08.307623+0000","last_unstale":"2023-11-28T20:02:25.806440+0000","last_undegraded":"2023-11-28T20:02:25.806440+0000","last_fullsized":"2023-11-28T20:02:25.806440+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_clean_scrub_stamp":"2023-11-28T20:02:07.264604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:55:37.170814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.2f","version":"0'0","reported_seq":11,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-11-28T20:02:27.355730+0000","last_change":"2023-11-28T20:02:25.834974+0000","last_active":"2023-11-28T20:02:27.355730+0000","last_peered":"2023-11-28T20:02:27.355730+0000","last_clean":"2023-11-28T20:02:27.355730+0000","last_became_active":"2023-11-28T20:02:25.834685+0000","last_became_peered":"2023-11-28T20:02:25.834685+0000","last_unstale":"2023-11-28T20:02:27.355730+0000","last_undegraded":"2023-11-28T20:02:27.355730+0000","last_fullsized":"2023-11-28T20:02:27.355730+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:24.842435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:24.842435+0000","last_clean_scrub_stamp":"2023-11-28T20:02:24.842435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:52:26.881080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.31","version":"0'0","reported_seq":15,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-11-28T20:02:25.812762+0000","last_change":"2023-11-28T20:02:08.296139+0000","last_active":"2023-11-28T20:02:25.812762+0000","last_peered":"2023-11-28T20:02:25.812762+0000","last_clean":"2023-11-28T20:02:25.812762+0000","last_became_active":"2023-11-28T20:02:08.295866+0000","last_became_peered":"2023-11-28T20:02:08.295866+0000","last_unstale":"2023-11-28T20:02:25.812762+0000","last_undegraded":"2023-11-28T20:02:25.812762+0000","last_fullsized":"2023-11-28T20:02:25.812762+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_clean_scrub_stamp":"2023-11-28T20:02:07.264604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:18:14.885236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.2e","version":"0'0","reported_seq":11,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-11-28T20:02:27.158757+0000","last_change":"2023-11-28T20:02:25.822254+0000","last_active":"2023-11-28T20:02:27.158757+0000","last_peered":"2023-11-28T20:02:27.158757+0000","last_clean":"2023-11-28T20:02:27.158757+0000","last_became_active":"2023-11-28T20:02:25.821205+0000","last_became_peered":"2023-11-28T20:02:25.821205+0000","last_unstale":"2023-11-28T20:02:27.158757+0000","last_undegraded":"2023-11-28T20:02:27.158757+0000","last_fullsized":"2023-11-28T20:02:27.158757+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:24.842435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:24.842435+0000","last_clean_scrub_stamp":"2023-11-28T20:02:24.842435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:46:10.962320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.30","version":"0'0","reported_seq":15,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-11-28T20:02:25.805055+0000","last_change":"2023-11-28T20:02:08.302149+0000","last_active":"2023-11-28T20:02:25.805055+0000","last_peered":"2023-11-28T20:02:25.805055+0000","last_clean":"2023-11-28T20:02:25.805055+0000","last_became_active":"2023-11-28T20:02:08.301657+0000","last_became_peered":"2023-11-28T20:02:08.301657+0000","last_unstale":"2023-11-28T20:02:25.805055+0000","last_undegraded":"2023-11-28T20:02:25.805055+0000","last_fullsized":"2023-11-28T20:02:25.805055+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_clean_scrub_stamp":"2023-11-28T20:02:07.264604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:37:52.578636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.31","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-11-28T20:02:25.835411+0000","last_change":"2023-11-28T20:02:25.831698+0000","last_active":"2023-11-28T20:02:25.835411+0000","last_peered":"2023-11-28T20:02:25.835411+0000","last_clean":"2023-11-28T20:02:25.835411+0000","last_became_active":"2023-11-28T20:02:25.831415+0000","last_became_peered":"2023-11-28T20:02:25.831415+0000","last_unstale":"2023-11-28T20:02:25.835411+0000","last_undegraded":"2023-11-28T20:02:25.835411+0000","last_fullsized":"2023-11-28T20:02:25.835411+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:24.842435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:24.842435+0000","last_clean_scrub_stamp":"2023-11-28T20:02:24.842435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T06:34:10.812327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.2f","version":"0'0","reported_seq":15,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-11-28T20:02:25.809530+0000","last_change":"2023-11-28T20:02:08.301087+0000","last_active":"2023-11-28T20:02:25.809530+0000","last_peered":"2023-11-28T20:02:25.809530+0000","last_clean":"2023-11-28T20:02:25.809530+0000","last_became_active":"2023-11-28T20:02:08.300738+0000","last_became_peered":"2023-11-28T20:02:08.300738+0000","last_unstale":"2023-11-28T20:02:25.809530+0000","last_undegraded":"2023-11-28T20:02:25.809530+0000","last_fullsized":"2023-11-28T20:02:25.809530+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_clean_scrub_stamp":"2023-11-28T20:02:07.264604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T07:54:21.325208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.30","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-11-28T20:02:25.830428+0000","last_change":"2023-11-28T20:02:25.825426+0000","last_active":"2023-11-28T20:02:25.830428+0000","last_peered":"2023-11-28T20:02:25.830428+0000","last_clean":"2023-11-28T20:02:25.830428+0000","last_became_active":"2023-11-28T20:02:25.825075+0000","last_became_peered":"2023-11-28T20:02:25.825075+0000","last_unstale":"2023-11-28T20:02:25.830428+0000","last_undegraded":"2023-11-28T20:02:25.830428+0000","last_fullsized":"2023-11-28T20:02:25.830428+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:24.842435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:24.842435+0000","last_clean_scrub_stamp":"2023-11-28T20:02:24.842435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:54:19.313884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.2e","version":"0'0","reported_seq":14,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-11-28T20:02:24.855778+0000","last_change":"2023-11-28T20:02:08.294533+0000","last_active":"2023-11-28T20:02:24.855778+0000","last_peered":"2023-11-28T20:02:24.855778+0000","last_clean":"2023-11-28T20:02:24.855778+0000","last_became_active":"2023-11-28T20:02:08.294329+0000","last_became_peered":"2023-11-28T20:02:08.294329+0000","last_unstale":"2023-11-28T20:02:24.855778+0000","last_undegraded":"2023-11-28T20:02:24.855778+0000","last_fullsized":"2023-11-28T20:02:24.855778+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_clean_scrub_stamp":"2023-11-28T20:02:07.264604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:12:41.265139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.33","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-11-28T20:02:25.833734+0000","last_change":"2023-11-28T20:02:25.826913+0000","last_active":"2023-11-28T20:02:25.833734+0000","last_peered":"2023-11-28T20:02:25.833734+0000","last_clean":"2023-11-28T20:02:25.833734+0000","last_became_active":"2023-11-28T20:02:25.826606+0000","last_became_peered":"2023-11-28T20:02:25.826606+0000","last_unstale":"2023-11-28T20:02:25.833734+0000","last_undegraded":"2023-11-28T20:02:25.833734+0000","last_fullsized":"2023-11-28T20:02:25.833734+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:24.842435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:24.842435+0000","last_clean_scrub_stamp":"2023-11-28T20:02:24.842435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T06:43:16.776374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.2d","version":"0'0","reported_seq":15,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-11-28T20:02:25.805825+0000","last_change":"2023-11-28T20:02:08.311901+0000","last_active":"2023-11-28T20:02:25.805825+0000","last_peered":"2023-11-28T20:02:25.805825+0000","last_clean":"2023-11-28T20:02:25.805825+0000","last_became_active":"2023-11-28T20:02:08.311540+0000","last_became_peered":"2023-11-28T20:02:08.311540+0000","last_unstale":"2023-11-28T20:02:25.805825+0000","last_undegraded":"2023-11-28T20:02:25.805825+0000","last_fullsized":"2023-11-28T20:02:25.805825+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_clean_scrub_stamp":"2023-11-28T20:02:07.264604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:46:59.333070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.32","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-11-28T20:02:25.832635+0000","last_change":"2023-11-28T20:02:25.827877+0000","last_active":"2023-11-28T20:02:25.832635+0000","last_peered":"2023-11-28T20:02:25.832635+0000","last_clean":"2023-11-28T20:02:25.832635+0000","last_became_active":"2023-11-28T20:02:25.827579+0000","last_became_peered":"2023-11-28T20:02:25.827579+0000","last_unstale":"2023-11-28T20:02:25.832635+0000","last_undegraded":"2023-11-28T20:02:25.832635+0000","last_fullsized":"2023-11-28T20:02:25.832635+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:24.842435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:24.842435+0000","last_clean_scrub_stamp":"2023-11-28T20:02:24.842435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:54:35.374803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.2c","version":"0'0","reported_seq":15,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-11-28T20:02:25.815838+0000","last_change":"2023-11-28T20:02:08.292376+0000","last_active":"2023-11-28T20:02:25.815838+0000","last_peered":"2023-11-28T20:02:25.815838+0000","last_clean":"2023-11-28T20:02:25.815838+0000","last_became_active":"2023-11-28T20:02:08.292042+0000","last_became_peered":"2023-11-28T20:02:08.292042+0000","last_unstale":"2023-11-28T20:02:25.815838+0000","last_undegraded":"2023-11-28T20:02:25.815838+0000","last_fullsized":"2023-11-28T20:02:25.815838+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_clean_scrub_stamp":"2023-11-28T20:02:07.264604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:53:42.852122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.35","version":"0'0","reported_seq":11,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-11-28T20:02:26.806259+0000","last_change":"2023-11-28T20:02:25.830258+0000","last_active":"2023-11-28T20:02:26.806259+0000","last_peered":"2023-11-28T20:02:26.806259+0000","last_clean":"2023-11-28T20:02:26.806259+0000","last_became_active":"2023-11-28T20:02:25.829950+0000","last_became_peered":"2023-11-28T20:02:25.829950+0000","last_unstale":"2023-11-28T20:02:26.806259+0000","last_undegraded":"2023-11-28T20:02:26.806259+0000","last_fullsized":"2023-11-28T20:02:26.806259+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:24.842435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:24.842435+0000","last_clean_scrub_stamp":"2023-11-28T20:02:24.842435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:54:17.777079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.2b","version":"0'0","reported_seq":15,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-11-28T20:02:25.804762+0000","last_change":"2023-11-28T20:02:08.297539+0000","last_active":"2023-11-28T20:02:25.804762+0000","last_peered":"2023-11-28T20:02:25.804762+0000","last_clean":"2023-11-28T20:02:25.804762+0000","last_became_active":"2023-11-28T20:02:08.294583+0000","last_became_peered":"2023-11-28T20:02:08.294583+0000","last_unstale":"2023-11-28T20:02:25.804762+0000","last_undegraded":"2023-11-28T20:02:25.804762+0000","last_fullsized":"2023-11-28T20:02:25.804762+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_clean_scrub_stamp":"2023-11-28T20:02:07.264604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:34:43.366405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.34","version":"0'0","reported_seq":11,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-11-28T20:02:26.807073+0000","last_change":"2023-11-28T20:02:25.818407+0000","last_active":"2023-11-28T20:02:26.807073+0000","last_peered":"2023-11-28T20:02:26.807073+0000","last_clean":"2023-11-28T20:02:26.807073+0000","last_became_active":"2023-11-28T20:02:25.817933+0000","last_became_peered":"2023-11-28T20:02:25.817933+0000","last_unstale":"2023-11-28T20:02:26.807073+0000","last_undegraded":"2023-11-28T20:02:26.807073+0000","last_fullsized":"2023-11-28T20:02:26.807073+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:24.842435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:24.842435+0000","last_clean_scrub_stamp":"2023-11-28T20:02:24.842435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:18:26.034381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.2a","version":"0'0","reported_seq":15,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-11-28T20:02:25.806522+0000","last_change":"2023-11-28T20:02:08.297073+0000","last_active":"2023-11-28T20:02:25.806522+0000","last_peered":"2023-11-28T20:02:25.806522+0000","last_clean":"2023-11-28T20:02:25.806522+0000","last_became_active":"2023-11-28T20:02:08.296814+0000","last_became_peered":"2023-11-28T20:02:08.296814+0000","last_unstale":"2023-11-28T20:02:25.806522+0000","last_undegraded":"2023-11-28T20:02:25.806522+0000","last_fullsized":"2023-11-28T20:02:25.806522+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_clean_scrub_stamp":"2023-11-28T20:02:07.264604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:00:38.869040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.37","version":"0'0","reported_seq":11,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-11-28T20:02:27.158909+0000","last_change":"2023-11-28T20:02:25.820642+0000","last_active":"2023-11-28T20:02:27.158909+0000","last_peered":"2023-11-28T20:02:27.158909+0000","last_clean":"2023-11-28T20:02:27.158909+0000","last_became_active":"2023-11-28T20:02:25.820345+0000","last_became_peered":"2023-11-28T20:02:25.820345+0000","last_unstale":"2023-11-28T20:02:27.158909+0000","last_undegraded":"2023-11-28T20:02:27.158909+0000","last_fullsized":"2023-11-28T20:02:27.158909+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:24.842435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:24.842435+0000","last_clean_scrub_stamp":"2023-11-28T20:02:24.842435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:54:19.313884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.29","version":"0'0","reported_seq":15,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-11-28T20:02:25.803968+0000","last_change":"2023-11-28T20:02:08.308480+0000","last_active":"2023-11-28T20:02:25.803968+0000","last_peered":"2023-11-28T20:02:25.803968+0000","last_clean":"2023-11-28T20:02:25.803968+0000","last_became_active":"2023-11-28T20:02:08.308190+0000","last_became_peered":"2023-11-28T20:02:08.308190+0000","last_unstale":"2023-11-28T20:02:25.803968+0000","last_undegraded":"2023-11-28T20:02:25.803968+0000","last_fullsized":"2023-11-28T20:02:25.803968+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_clean_scrub_stamp":"2023-11-28T20:02:07.264604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:51:11.144383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.36","version":"0'0","reported_seq":11,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-11-28T20:02:26.802799+0000","last_change":"2023-11-28T20:02:25.819340+0000","last_active":"2023-11-28T20:02:26.802799+0000","last_peered":"2023-11-28T20:02:26.802799+0000","last_clean":"2023-11-28T20:02:26.802799+0000","last_became_active":"2023-11-28T20:02:25.819047+0000","last_became_peered":"2023-11-28T20:02:25.819047+0000","last_unstale":"2023-11-28T20:02:26.802799+0000","last_undegraded":"2023-11-28T20:02:26.802799+0000","last_fullsized":"2023-11-28T20:02:26.802799+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:24.842435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:24.842435+0000","last_clean_scrub_stamp":"2023-11-28T20:02:24.842435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:46:10.962320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.28","version":"0'0","reported_seq":14,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-11-28T20:02:24.855620+0000","last_change":"2023-11-28T20:02:08.307205+0000","last_active":"2023-11-28T20:02:24.855620+0000","last_peered":"2023-11-28T20:02:24.855620+0000","last_clean":"2023-11-28T20:02:24.855620+0000","last_became_active":"2023-11-28T20:02:08.306954+0000","last_became_peered":"2023-11-28T20:02:08.306954+0000","last_unstale":"2023-11-28T20:02:24.855620+0000","last_undegraded":"2023-11-28T20:02:24.855620+0000","last_fullsized":"2023-11-28T20:02:24.855620+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_clean_scrub_stamp":"2023-11-28T20:02:07.264604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:27:46.451074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.39","version":"0'0","reported_seq":11,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-11-28T20:02:27.158422+0000","last_change":"2023-11-28T20:02:25.827484+0000","last_active":"2023-11-28T20:02:27.158422+0000","last_peered":"2023-11-28T20:02:27.158422+0000","last_clean":"2023-11-28T20:02:27.158422+0000","last_became_active":"2023-11-28T20:02:25.827141+0000","last_became_peered":"2023-11-28T20:02:25.827141+0000","last_unstale":"2023-11-28T20:02:27.158422+0000","last_undegraded":"2023-11-28T20:02:27.158422+0000","last_fullsized":"2023-11-28T20:02:27.158422+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:24.842435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:24.842435+0000","last_clean_scrub_stamp":"2023-11-28T20:02:24.842435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:54:35.374803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.27","version":"0'0","reported_seq":15,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-11-28T20:02:25.827267+0000","last_change":"2023-11-28T20:02:08.294531+0000","last_active":"2023-11-28T20:02:25.827267+0000","last_peered":"2023-11-28T20:02:25.827267+0000","last_clean":"2023-11-28T20:02:25.827267+0000","last_became_active":"2023-11-28T20:02:08.294163+0000","last_became_peered":"2023-11-28T20:02:08.294163+0000","last_unstale":"2023-11-28T20:02:25.827267+0000","last_undegraded":"2023-11-28T20:02:25.827267+0000","last_fullsized":"2023-11-28T20:02:25.827267+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_clean_scrub_stamp":"2023-11-28T20:02:07.264604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:21:50.379035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.38","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-11-28T20:02:25.828373+0000","last_change":"2023-11-28T20:02:25.820122+0000","last_active":"2023-11-28T20:02:25.828373+0000","last_peered":"2023-11-28T20:02:25.828373+0000","last_clean":"2023-11-28T20:02:25.828373+0000","last_became_active":"2023-11-28T20:02:25.819829+0000","last_became_peered":"2023-11-28T20:02:25.819829+0000","last_unstale":"2023-11-28T20:02:25.828373+0000","last_undegraded":"2023-11-28T20:02:25.828373+0000","last_fullsized":"2023-11-28T20:02:25.828373+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:24.842435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:24.842435+0000","last_clean_scrub_stamp":"2023-11-28T20:02:24.842435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:31:37.771255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.26","version":"0'0","reported_seq":15,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-11-28T20:02:25.807059+0000","last_change":"2023-11-28T20:02:08.307678+0000","last_active":"2023-11-28T20:02:25.807059+0000","last_peered":"2023-11-28T20:02:25.807059+0000","last_clean":"2023-11-28T20:02:25.807059+0000","last_became_active":"2023-11-28T20:02:08.307402+0000","last_became_peered":"2023-11-28T20:02:08.307402+0000","last_unstale":"2023-11-28T20:02:25.807059+0000","last_undegraded":"2023-11-28T20:02:25.807059+0000","last_fullsized":"2023-11-28T20:02:25.807059+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_clean_scrub_stamp":"2023-11-28T20:02:07.264604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:31:57.356139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.3b","version":"0'0","reported_seq":11,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-11-28T20:02:26.802243+0000","last_change":"2023-11-28T20:02:25.824102+0000","last_active":"2023-11-28T20:02:26.802243+0000","last_peered":"2023-11-28T20:02:26.802243+0000","last_clean":"2023-11-28T20:02:26.802243+0000","last_became_active":"2023-11-28T20:02:25.823694+0000","last_became_peered":"2023-11-28T20:02:25.823694+0000","last_unstale":"2023-11-28T20:02:26.802243+0000","last_undegraded":"2023-11-28T20:02:26.802243+0000","last_fullsized":"2023-11-28T20:02:26.802243+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:24.842435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:24.842435+0000","last_clean_scrub_stamp":"2023-11-28T20:02:24.842435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T06:34:10.812327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.25","version":"0'0","reported_seq":14,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-11-28T20:02:24.873190+0000","last_change":"2023-11-28T20:02:08.313075+0000","last_active":"2023-11-28T20:02:24.873190+0000","last_peered":"2023-11-28T20:02:24.873190+0000","last_clean":"2023-11-28T20:02:24.873190+0000","last_became_active":"2023-11-28T20:02:08.312852+0000","last_became_peered":"2023-11-28T20:02:08.312852+0000","last_unstale":"2023-11-28T20:02:24.873190+0000","last_undegraded":"2023-11-28T20:02:24.873190+0000","last_fullsized":"2023-11-28T20:02:24.873190+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_clean_scrub_stamp":"2023-11-28T20:02:07.264604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:47:27.485031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.3a","version":"0'0","reported_seq":11,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-11-28T20:02:27.157988+0000","last_change":"2023-11-28T20:02:25.823084+0000","last_active":"2023-11-28T20:02:27.157988+0000","last_peered":"2023-11-28T20:02:27.157988+0000","last_clean":"2023-11-28T20:02:27.157988+0000","last_became_active":"2023-11-28T20:02:25.822770+0000","last_became_peered":"2023-11-28T20:02:25.822770+0000","last_unstale":"2023-11-28T20:02:27.157988+0000","last_undegraded":"2023-11-28T20:02:27.157988+0000","last_fullsized":"2023-11-28T20:02:27.157988+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:24.842435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:24.842435+0000","last_clean_scrub_stamp":"2023-11-28T20:02:24.842435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:59:09.445203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.24","version":"0'0","reported_seq":15,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-11-28T20:02:25.815917+0000","last_change":"2023-11-28T20:02:08.296547+0000","last_active":"2023-11-28T20:02:25.815917+0000","last_peered":"2023-11-28T20:02:25.815917+0000","last_clean":"2023-11-28T20:02:25.815917+0000","last_became_active":"2023-11-28T20:02:08.296274+0000","last_became_peered":"2023-11-28T20:02:08.296274+0000","last_unstale":"2023-11-28T20:02:25.815917+0000","last_undegraded":"2023-11-28T20:02:25.815917+0000","last_fullsized":"2023-11-28T20:02:25.815917+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_clean_scrub_stamp":"2023-11-28T20:02:07.264604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:40:59.195276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.3d","version":"0'0","reported_seq":11,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-11-28T20:02:27.355701+0000","last_change":"2023-11-28T20:02:25.834875+0000","last_active":"2023-11-28T20:02:27.355701+0000","last_peered":"2023-11-28T20:02:27.355701+0000","last_clean":"2023-11-28T20:02:27.355701+0000","last_became_active":"2023-11-28T20:02:25.834600+0000","last_became_peered":"2023-11-28T20:02:25.834600+0000","last_unstale":"2023-11-28T20:02:27.355701+0000","last_undegraded":"2023-11-28T20:02:27.355701+0000","last_fullsized":"2023-11-28T20:02:27.355701+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:24.842435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:24.842435+0000","last_clean_scrub_stamp":"2023-11-28T20:02:24.842435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:11:36.969373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.23","version":"0'0","reported_seq":14,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-11-28T20:02:24.865122+0000","last_change":"2023-11-28T20:02:08.313149+0000","last_active":"2023-11-28T20:02:24.865122+0000","last_peered":"2023-11-28T20:02:24.865122+0000","last_clean":"2023-11-28T20:02:24.865122+0000","last_became_active":"2023-11-28T20:02:08.312835+0000","last_became_peered":"2023-11-28T20:02:08.312835+0000","last_unstale":"2023-11-28T20:02:24.865122+0000","last_undegraded":"2023-11-28T20:02:24.865122+0000","last_fullsized":"2023-11-28T20:02:24.865122+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_clean_scrub_stamp":"2023-11-28T20:02:07.264604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:56:59.351869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.3c","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-11-28T20:02:25.817739+0000","last_change":"2023-11-28T20:02:25.814841+0000","last_active":"2023-11-28T20:02:25.817739+0000","last_peered":"2023-11-28T20:02:25.817739+0000","last_clean":"2023-11-28T20:02:25.817739+0000","last_became_active":"2023-11-28T20:02:25.814591+0000","last_became_peered":"2023-11-28T20:02:25.814591+0000","last_unstale":"2023-11-28T20:02:25.817739+0000","last_undegraded":"2023-11-28T20:02:25.817739+0000","last_fullsized":"2023-11-28T20:02:25.817739+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:24.842435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:24.842435+0000","last_clean_scrub_stamp":"2023-11-28T20:02:24.842435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T07:54:38.903039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.22","version":"0'0","reported_seq":15,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-11-28T20:02:25.806660+0000","last_change":"2023-11-28T20:02:08.296480+0000","last_active":"2023-11-28T20:02:25.806660+0000","last_peered":"2023-11-28T20:02:25.806660+0000","last_clean":"2023-11-28T20:02:25.806660+0000","last_became_active":"2023-11-28T20:02:08.293946+0000","last_became_peered":"2023-11-28T20:02:08.293946+0000","last_unstale":"2023-11-28T20:02:25.806660+0000","last_undegraded":"2023-11-28T20:02:25.806660+0000","last_fullsized":"2023-11-28T20:02:25.806660+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_clean_scrub_stamp":"2023-11-28T20:02:07.264604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:56:40.073193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.3f","version":"0'0","reported_seq":11,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-11-28T20:02:27.355573+0000","last_change":"2023-11-28T20:02:25.822596+0000","last_active":"2023-11-28T20:02:27.355573+0000","last_peered":"2023-11-28T20:02:27.355573+0000","last_clean":"2023-11-28T20:02:27.355573+0000","last_became_active":"2023-11-28T20:02:25.821806+0000","last_became_peered":"2023-11-28T20:02:25.821806+0000","last_unstale":"2023-11-28T20:02:27.355573+0000","last_undegraded":"2023-11-28T20:02:27.355573+0000","last_fullsized":"2023-11-28T20:02:27.355573+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:24.842435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:24.842435+0000","last_clean_scrub_stamp":"2023-11-28T20:02:24.842435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:49:32.306169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.21","version":"0'0","reported_seq":15,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-11-28T20:02:25.817315+0000","last_change":"2023-11-28T20:02:08.287344+0000","last_active":"2023-11-28T20:02:25.817315+0000","last_peered":"2023-11-28T20:02:25.817315+0000","last_clean":"2023-11-28T20:02:25.817315+0000","last_became_active":"2023-11-28T20:02:08.287066+0000","last_became_peered":"2023-11-28T20:02:08.287066+0000","last_unstale":"2023-11-28T20:02:25.817315+0000","last_undegraded":"2023-11-28T20:02:25.817315+0000","last_fullsized":"2023-11-28T20:02:25.817315+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_clean_scrub_stamp":"2023-11-28T20:02:07.264604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:53:42.852122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.3e","version":"0'0","reported_seq":11,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-11-28T20:02:27.158737+0000","last_change":"2023-11-28T20:02:25.822477+0000","last_active":"2023-11-28T20:02:27.158737+0000","last_peered":"2023-11-28T20:02:27.158737+0000","last_clean":"2023-11-28T20:02:27.158737+0000","last_became_active":"2023-11-28T20:02:25.821943+0000","last_became_peered":"2023-11-28T20:02:25.821943+0000","last_unstale":"2023-11-28T20:02:27.158737+0000","last_undegraded":"2023-11-28T20:02:27.158737+0000","last_fullsized":"2023-11-28T20:02:27.158737+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:24.842435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:24.842435+0000","last_clean_scrub_stamp":"2023-11-28T20:02:24.842435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:15:27.383212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.20","version":"0'0","reported_seq":15,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-11-28T20:02:25.805129+0000","last_change":"2023-11-28T20:02:08.301980+0000","last_active":"2023-11-28T20:02:25.805129+0000","last_peered":"2023-11-28T20:02:25.805129+0000","last_clean":"2023-11-28T20:02:25.805129+0000","last_became_active":"2023-11-28T20:02:08.301384+0000","last_became_peered":"2023-11-28T20:02:08.301384+0000","last_unstale":"2023-11-28T20:02:25.805129+0000","last_undegraded":"2023-11-28T20:02:25.805129+0000","last_fullsized":"2023-11-28T20:02:25.805129+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_clean_scrub_stamp":"2023-11-28T20:02:07.264604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:54:01.736053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.2","version":"0'0","reported_seq":11,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-11-28T20:02:26.806174+0000","last_change":"2023-11-28T20:02:25.829022+0000","last_active":"2023-11-28T20:02:26.806174+0000","last_peered":"2023-11-28T20:02:26.806174+0000","last_clean":"2023-11-28T20:02:26.806174+0000","last_became_active":"2023-11-28T20:02:25.828134+0000","last_became_peered":"2023-11-28T20:02:25.828134+0000","last_unstale":"2023-11-28T20:02:26.806174+0000","last_undegraded":"2023-11-28T20:02:26.806174+0000","last_fullsized":"2023-11-28T20:02:26.806174+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:24.842435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:24.842435+0000","last_clean_scrub_stamp":"2023-11-28T20:02:24.842435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:55:11.306431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.1d","version":"84'2","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-11-28T20:02:26.807125+0000","last_change":"2023-11-28T20:02:24.878155+0000","last_active":"2023-11-28T20:02:26.807125+0000","last_peered":"2023-11-28T20:02:26.807125+0000","last_clean":"2023-11-28T20:02:26.807125+0000","last_became_active":"2023-11-28T20:02:24.877847+0000","last_became_peered":"2023-11-28T20:02:24.877847+0000","last_unstale":"2023-11-28T20:02:26.807125+0000","last_undegraded":"2023-11-28T20:02:26.807125+0000","last_fullsized":"2023-11-28T20:02:26.807125+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:23.834083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:23.834083+0000","last_clean_scrub_stamp":"2023-11-28T20:02:23.834083+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:46:37.090886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.1c","version":"0'0","reported_seq":15,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-11-28T20:02:25.807611+0000","last_change":"2023-11-28T20:02:08.306450+0000","last_active":"2023-11-28T20:02:25.807611+0000","last_peered":"2023-11-28T20:02:25.807611+0000","last_clean":"2023-11-28T20:02:25.807611+0000","last_became_active":"2023-11-28T20:02:08.305331+0000","last_became_peered":"2023-11-28T20:02:08.305331+0000","last_unstale":"2023-11-28T20:02:25.807611+0000","last_undegraded":"2023-11-28T20:02:25.807611+0000","last_fullsized":"2023-11-28T20:02:25.807611+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_clean_scrub_stamp":"2023-11-28T20:02:07.264604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:45:53.384489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1f","version":"80'4","reported_seq":20,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-11-28T20:02:25.808605+0000","last_change":"2023-11-28T20:02:07.298433+0000","last_active":"2023-11-28T20:02:25.808605+0000","last_peered":"2023-11-28T20:02:25.808605+0000","last_clean":"2023-11-28T20:02:25.808605+0000","last_became_active":"2023-11-28T20:02:07.298106+0000","last_became_peered":"2023-11-28T20:02:07.298106+0000","last_unstale":"2023-11-28T20:02:25.808605+0000","last_undegraded":"2023-11-28T20:02:25.808605+0000","last_fullsized":"2023-11-28T20:02:25.808605+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:06.257335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:06.257335+0000","last_clean_scrub_stamp":"2023-11-28T20:02:06.257335+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:31:56.348870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.3","version":"0'0","reported_seq":11,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-11-28T20:02:26.805944+0000","last_change":"2023-11-28T20:02:25.829190+0000","last_active":"2023-11-28T20:02:26.805944+0000","last_peered":"2023-11-28T20:02:26.805944+0000","last_clean":"2023-11-28T20:02:26.805944+0000","last_became_active":"2023-11-28T20:02:25.827516+0000","last_became_peered":"2023-11-28T20:02:25.827516+0000","last_unstale":"2023-11-28T20:02:26.805944+0000","last_undegraded":"2023-11-28T20:02:26.805944+0000","last_fullsized":"2023-11-28T20:02:26.805944+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:24.842435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:24.842435+0000","last_clean_scrub_stamp":"2023-11-28T20:02:24.842435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:06:39.785006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.1c","version":"84'2","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-11-28T20:02:26.802460+0000","last_change":"2023-11-28T20:02:24.880305+0000","last_active":"2023-11-28T20:02:26.802460+0000","last_peered":"2023-11-28T20:02:26.802460+0000","last_clean":"2023-11-28T20:02:26.802460+0000","last_became_active":"2023-11-28T20:02:24.880030+0000","last_became_peered":"2023-11-28T20:02:24.880030+0000","last_unstale":"2023-11-28T20:02:26.802460+0000","last_undegraded":"2023-11-28T20:02:26.802460+0000","last_fullsized":"2023-11-28T20:02:26.802460+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:23.834083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:23.834083+0000","last_clean_scrub_stamp":"2023-11-28T20:02:23.834083+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:41:23.842664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.1d","version":"0'0","reported_seq":15,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-11-28T20:02:25.808256+0000","last_change":"2023-11-28T20:02:08.317121+0000","last_active":"2023-11-28T20:02:25.808256+0000","last_peered":"2023-11-28T20:02:25.808256+0000","last_clean":"2023-11-28T20:02:25.808256+0000","last_became_active":"2023-11-28T20:02:08.316880+0000","last_became_peered":"2023-11-28T20:02:08.316880+0000","last_unstale":"2023-11-28T20:02:25.808256+0000","last_undegraded":"2023-11-28T20:02:25.808256+0000","last_fullsized":"2023-11-28T20:02:25.808256+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_clean_scrub_stamp":"2023-11-28T20:02:07.264604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T06:42:59.198543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1e","version":"80'1","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-11-28T20:02:25.807221+0000","last_change":"2023-11-28T20:02:07.293164+0000","last_active":"2023-11-28T20:02:25.807221+0000","last_peered":"2023-11-28T20:02:25.807221+0000","last_clean":"2023-11-28T20:02:25.807221+0000","last_became_active":"2023-11-28T20:02:07.292799+0000","last_became_peered":"2023-11-28T20:02:07.292799+0000","last_unstale":"2023-11-28T20:02:25.807221+0000","last_undegraded":"2023-11-28T20:02:25.807221+0000","last_fullsized":"2023-11-28T20:02:25.807221+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:06.257335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:06.257335+0000","last_clean_scrub_stamp":"2023-11-28T20:02:06.257335+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:32:46.550427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.0","version":"0'0","reported_seq":11,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-11-28T20:02:27.354969+0000","last_change":"2023-11-28T20:02:25.812777+0000","last_active":"2023-11-28T20:02:27.354969+0000","last_peered":"2023-11-28T20:02:27.354969+0000","last_clean":"2023-11-28T20:02:27.354969+0000","last_became_active":"2023-11-28T20:02:25.812293+0000","last_became_peered":"2023-11-28T20:02:25.812293+0000","last_unstale":"2023-11-28T20:02:27.354969+0000","last_undegraded":"2023-11-28T20:02:27.354969+0000","last_fullsized":"2023-11-28T20:02:27.354969+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:24.842435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:24.842435+0000","last_clean_scrub_stamp":"2023-11-28T20:02:24.842435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T07:57:55.411790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1f","version":"84'4","reported_seq":15,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-11-28T20:02:25.869538+0000","last_change":"2023-11-28T20:02:24.883040+0000","last_active":"2023-11-28T20:02:25.869538+0000","last_peered":"2023-11-28T20:02:25.869538+0000","last_clean":"2023-11-28T20:02:25.869538+0000","last_became_active":"2023-11-28T20:02:24.882752+0000","last_became_peered":"2023-11-28T20:02:24.882752+0000","last_unstale":"2023-11-28T20:02:25.869538+0000","last_undegraded":"2023-11-28T20:02:25.869538+0000","last_fullsized":"2023-11-28T20:02:25.869538+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:23.834083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:23.834083+0000","last_clean_scrub_stamp":"2023-11-28T20:02:23.834083+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:04:24.827466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.1e","version":"0'0","reported_seq":14,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-11-28T20:02:24.865449+0000","last_change":"2023-11-28T20:02:08.307558+0000","last_active":"2023-11-28T20:02:24.865449+0000","last_peered":"2023-11-28T20:02:24.865449+0000","last_clean":"2023-11-28T20:02:24.865449+0000","last_became_active":"2023-11-28T20:02:08.307293+0000","last_became_peered":"2023-11-28T20:02:08.307293+0000","last_unstale":"2023-11-28T20:02:24.865449+0000","last_undegraded":"2023-11-28T20:02:24.865449+0000","last_fullsized":"2023-11-28T20:02:24.865449+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_clean_scrub_stamp":"2023-11-28T20:02:07.264604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:31:10.520073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.1d","version":"80'2","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-11-28T20:02:24.866184+0000","last_change":"2023-11-28T20:02:07.298412+0000","last_active":"2023-11-28T20:02:24.866184+0000","last_peered":"2023-11-28T20:02:24.866184+0000","last_clean":"2023-11-28T20:02:24.866184+0000","last_became_active":"2023-11-28T20:02:07.297937+0000","last_became_peered":"2023-11-28T20:02:07.297937+0000","last_unstale":"2023-11-28T20:02:24.866184+0000","last_undegraded":"2023-11-28T20:02:24.866184+0000","last_fullsized":"2023-11-28T20:02:24.866184+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:06.257335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:06.257335+0000","last_clean_scrub_stamp":"2023-11-28T20:02:06.257335+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:10:00.652865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.1","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-11-28T20:02:25.824987+0000","last_change":"2023-11-28T20:02:25.820115+0000","last_active":"2023-11-28T20:02:25.824987+0000","last_peered":"2023-11-28T20:02:25.824987+0000","last_clean":"2023-11-28T20:02:25.824987+0000","last_became_active":"2023-11-28T20:02:25.819689+0000","last_became_peered":"2023-11-28T20:02:25.819689+0000","last_unstale":"2023-11-28T20:02:25.824987+0000","last_undegraded":"2023-11-28T20:02:25.824987+0000","last_fullsized":"2023-11-28T20:02:25.824987+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:24.842435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:24.842435+0000","last_clean_scrub_stamp":"2023-11-28T20:02:24.842435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:01:32.975882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.1e","version":"84'1","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-11-28T20:02:25.867587+0000","last_change":"2023-11-28T20:02:24.876751+0000","last_active":"2023-11-28T20:02:25.867587+0000","last_peered":"2023-11-28T20:02:25.867587+0000","last_clean":"2023-11-28T20:02:25.867587+0000","last_became_active":"2023-11-28T20:02:24.876451+0000","last_became_peered":"2023-11-28T20:02:24.876451+0000","last_unstale":"2023-11-28T20:02:25.867587+0000","last_undegraded":"2023-11-28T20:02:25.867587+0000","last_fullsized":"2023-11-28T20:02:25.867587+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:23.834083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:23.834083+0000","last_clean_scrub_stamp":"2023-11-28T20:02:23.834083+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T07:05:35.225553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.1f","version":"0'0","reported_seq":15,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-11-28T20:02:25.809502+0000","last_change":"2023-11-28T20:02:08.300921+0000","last_active":"2023-11-28T20:02:25.809502+0000","last_peered":"2023-11-28T20:02:25.809502+0000","last_clean":"2023-11-28T20:02:25.809502+0000","last_became_active":"2023-11-28T20:02:08.300407+0000","last_became_peered":"2023-11-28T20:02:08.300407+0000","last_unstale":"2023-11-28T20:02:25.809502+0000","last_undegraded":"2023-11-28T20:02:25.809502+0000","last_fullsized":"2023-11-28T20:02:25.809502+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_clean_scrub_stamp":"2023-11-28T20:02:07.264604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T07:27:12.455346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1c","version":"80'2","reported_seq":18,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-11-28T20:02:25.806750+0000","last_change":"2023-11-28T20:02:07.303442+0000","last_active":"2023-11-28T20:02:25.806750+0000","last_peered":"2023-11-28T20:02:25.806750+0000","last_clean":"2023-11-28T20:02:25.806750+0000","last_became_active":"2023-11-28T20:02:07.302881+0000","last_became_peered":"2023-11-28T20:02:07.302881+0000","last_unstale":"2023-11-28T20:02:25.806750+0000","last_undegraded":"2023-11-28T20:02:25.806750+0000","last_fullsized":"2023-11-28T20:02:25.806750+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:06.257335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:06.257335+0000","last_clean_scrub_stamp":"2023-11-28T20:02:06.257335+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:32:53.356561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.6","version":"0'0","reported_seq":11,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-11-28T20:02:27.158876+0000","last_change":"2023-11-28T20:02:25.829814+0000","last_active":"2023-11-28T20:02:27.158876+0000","last_peered":"2023-11-28T20:02:27.158876+0000","last_clean":"2023-11-28T20:02:27.158876+0000","last_became_active":"2023-11-28T20:02:25.829494+0000","last_became_peered":"2023-11-28T20:02:25.829494+0000","last_unstale":"2023-11-28T20:02:27.158876+0000","last_undegraded":"2023-11-28T20:02:27.158876+0000","last_fullsized":"2023-11-28T20:02:27.158876+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:24.842435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:24.842435+0000","last_clean_scrub_stamp":"2023-11-28T20:02:24.842435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T06:43:16.776374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.19","version":"0'0","reported_seq":12,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-11-28T20:02:26.805603+0000","last_change":"2023-11-28T20:02:24.876657+0000","last_active":"2023-11-28T20:02:26.805603+0000","last_peered":"2023-11-28T20:02:26.805603+0000","last_clean":"2023-11-28T20:02:26.805603+0000","last_became_active":"2023-11-28T20:02:24.876382+0000","last_became_peered":"2023-11-28T20:02:24.876382+0000","last_unstale":"2023-11-28T20:02:26.805603+0000","last_undegraded":"2023-11-28T20:02:26.805603+0000","last_fullsized":"2023-11-28T20:02:26.805603+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:23.834083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:23.834083+0000","last_clean_scrub_stamp":"2023-11-28T20:02:23.834083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:36:24.792567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.18","version":"0'0","reported_seq":15,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-11-28T20:02:25.808974+0000","last_change":"2023-11-28T20:02:08.301741+0000","last_active":"2023-11-28T20:02:25.808974+0000","last_peered":"2023-11-28T20:02:25.808974+0000","last_clean":"2023-11-28T20:02:25.808974+0000","last_became_active":"2023-11-28T20:02:08.296574+0000","last_became_peered":"2023-11-28T20:02:08.296574+0000","last_unstale":"2023-11-28T20:02:25.808974+0000","last_undegraded":"2023-11-28T20:02:25.808974+0000","last_fullsized":"2023-11-28T20:02:25.808974+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_clean_scrub_stamp":"2023-11-28T20:02:07.264604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:55:48.206640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.1b","version":"80'1","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-11-28T20:02:25.805553+0000","last_change":"2023-11-28T20:02:07.292245+0000","last_active":"2023-11-28T20:02:25.805553+0000","last_peered":"2023-11-28T20:02:25.805553+0000","last_clean":"2023-11-28T20:02:25.805553+0000","last_became_active":"2023-11-28T20:02:07.291923+0000","last_became_peered":"2023-11-28T20:02:07.291923+0000","last_unstale":"2023-11-28T20:02:25.805553+0000","last_undegraded":"2023-11-28T20:02:25.805553+0000","last_fullsized":"2023-11-28T20:02:25.805553+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:06.257335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:06.257335+0000","last_clean_scrub_stamp":"2023-11-28T20:02:06.257335+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T07:18:58.610557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.7","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-11-28T20:02:25.819606+0000","last_change":"2023-11-28T20:02:25.816440+0000","last_active":"2023-11-28T20:02:25.819606+0000","last_peered":"2023-11-28T20:02:25.819606+0000","last_clean":"2023-11-28T20:02:25.819606+0000","last_became_active":"2023-11-28T20:02:25.816157+0000","last_became_peered":"2023-11-28T20:02:25.816157+0000","last_unstale":"2023-11-28T20:02:25.819606+0000","last_undegraded":"2023-11-28T20:02:25.819606+0000","last_fullsized":"2023-11-28T20:02:25.819606+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:24.842435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:24.842435+0000","last_clean_scrub_stamp":"2023-11-28T20:02:24.842435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T06:14:02.428315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.18","version":"0'0","reported_seq":11,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-11-28T20:02:25.804350+0000","last_change":"2023-11-28T20:02:24.869255+0000","last_active":"2023-11-28T20:02:25.804350+0000","last_peered":"2023-11-28T20:02:25.804350+0000","last_clean":"2023-11-28T20:02:25.804350+0000","last_became_active":"2023-11-28T20:02:24.869001+0000","last_became_peered":"2023-11-28T20:02:24.869001+0000","last_unstale":"2023-11-28T20:02:25.804350+0000","last_undegraded":"2023-11-28T20:02:25.804350+0000","last_fullsized":"2023-11-28T20:02:25.804350+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:23.834083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:23.834083+0000","last_clean_scrub_stamp":"2023-11-28T20:02:23.834083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:05:18.409015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.19","version":"0'0","reported_seq":15,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-11-28T20:02:25.804025+0000","last_change":"2023-11-28T20:02:08.306953+0000","last_active":"2023-11-28T20:02:25.804025+0000","last_peered":"2023-11-28T20:02:25.804025+0000","last_clean":"2023-11-28T20:02:25.804025+0000","last_became_active":"2023-11-28T20:02:08.302688+0000","last_became_peered":"2023-11-28T20:02:08.302688+0000","last_unstale":"2023-11-28T20:02:25.804025+0000","last_undegraded":"2023-11-28T20:02:25.804025+0000","last_fullsized":"2023-11-28T20:02:25.804025+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_clean_scrub_stamp":"2023-11-28T20:02:07.264604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:33:12.680902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1a","version":"80'1","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-11-28T20:02:25.814718+0000","last_change":"2023-11-28T20:02:07.297038+0000","last_active":"2023-11-28T20:02:25.814718+0000","last_peered":"2023-11-28T20:02:25.814718+0000","last_clean":"2023-11-28T20:02:25.814718+0000","last_became_active":"2023-11-28T20:02:07.295472+0000","last_became_peered":"2023-11-28T20:02:07.295472+0000","last_unstale":"2023-11-28T20:02:25.814718+0000","last_undegraded":"2023-11-28T20:02:25.814718+0000","last_fullsized":"2023-11-28T20:02:25.814718+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:06.257335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:06.257335+0000","last_clean_scrub_stamp":"2023-11-28T20:02:06.257335+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:26:07.339153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.4","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-11-28T20:02:25.825527+0000","last_change":"2023-11-28T20:02:25.823012+0000","last_active":"2023-11-28T20:02:25.825527+0000","last_peered":"2023-11-28T20:02:25.825527+0000","last_clean":"2023-11-28T20:02:25.825527+0000","last_became_active":"2023-11-28T20:02:25.822762+0000","last_became_peered":"2023-11-28T20:02:25.822762+0000","last_unstale":"2023-11-28T20:02:25.825527+0000","last_undegraded":"2023-11-28T20:02:25.825527+0000","last_fullsized":"2023-11-28T20:02:25.825527+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:24.842435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:24.842435+0000","last_clean_scrub_stamp":"2023-11-28T20:02:24.842435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:54:19.313884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.1b","version":"84'1","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-11-28T20:02:25.866646+0000","last_change":"2023-11-28T20:02:24.879567+0000","last_active":"2023-11-28T20:02:25.866646+0000","last_peered":"2023-11-28T20:02:25.866646+0000","last_clean":"2023-11-28T20:02:25.866646+0000","last_became_active":"2023-11-28T20:02:24.879039+0000","last_became_peered":"2023-11-28T20:02:24.879039+0000","last_unstale":"2023-11-28T20:02:25.866646+0000","last_undegraded":"2023-11-28T20:02:25.866646+0000","last_fullsized":"2023-11-28T20:02:25.866646+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:23.834083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:23.834083+0000","last_clean_scrub_stamp":"2023-11-28T20:02:23.834083+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T07:54:37.894687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.1a","version":"0'0","reported_seq":15,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-11-28T20:02:25.807101+0000","last_change":"2023-11-28T20:02:08.306474+0000","last_active":"2023-11-28T20:02:25.807101+0000","last_peered":"2023-11-28T20:02:25.807101+0000","last_clean":"2023-11-28T20:02:25.807101+0000","last_became_active":"2023-11-28T20:02:08.306183+0000","last_became_peered":"2023-11-28T20:02:08.306183+0000","last_unstale":"2023-11-28T20:02:25.807101+0000","last_undegraded":"2023-11-28T20:02:25.807101+0000","last_fullsized":"2023-11-28T20:02:25.807101+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_clean_scrub_stamp":"2023-11-28T20:02:07.264604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:58:51.867372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.19","version":"0'0","reported_seq":15,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-11-28T20:02:24.855557+0000","last_change":"2023-11-28T20:02:07.292322+0000","last_active":"2023-11-28T20:02:24.855557+0000","last_peered":"2023-11-28T20:02:24.855557+0000","last_clean":"2023-11-28T20:02:24.855557+0000","last_became_active":"2023-11-28T20:02:07.292063+0000","last_became_peered":"2023-11-28T20:02:07.292063+0000","last_unstale":"2023-11-28T20:02:24.855557+0000","last_undegraded":"2023-11-28T20:02:24.855557+0000","last_fullsized":"2023-11-28T20:02:24.855557+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:06.257335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:06.257335+0000","last_clean_scrub_stamp":"2023-11-28T20:02:06.257335+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:31:09.512804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.5","version":"0'0","reported_seq":11,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-11-28T20:02:27.355675+0000","last_change":"2023-11-28T20:02:25.820806+0000","last_active":"2023-11-28T20:02:27.355675+0000","last_peered":"2023-11-28T20:02:27.355675+0000","last_clean":"2023-11-28T20:02:27.355675+0000","last_became_active":"2023-11-28T20:02:25.820557+0000","last_became_peered":"2023-11-28T20:02:25.820557+0000","last_unstale":"2023-11-28T20:02:27.355675+0000","last_undegraded":"2023-11-28T20:02:27.355675+0000","last_fullsized":"2023-11-28T20:02:27.355675+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:24.842435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:24.842435+0000","last_clean_scrub_stamp":"2023-11-28T20:02:24.842435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T06:03:52.536451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1a","version":"84'1","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-11-28T20:02:26.805738+0000","last_change":"2023-11-28T20:02:24.882849+0000","last_active":"2023-11-28T20:02:26.805738+0000","last_peered":"2023-11-28T20:02:26.805738+0000","last_clean":"2023-11-28T20:02:26.805738+0000","last_became_active":"2023-11-28T20:02:24.882543+0000","last_became_peered":"2023-11-28T20:02:24.882543+0000","last_unstale":"2023-11-28T20:02:26.805738+0000","last_undegraded":"2023-11-28T20:02:26.805738+0000","last_fullsized":"2023-11-28T20:02:26.805738+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:23.834083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:23.834083+0000","last_clean_scrub_stamp":"2023-11-28T20:02:23.834083+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:12:57.834618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.1b","version":"0'0","reported_seq":15,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-11-28T20:02:25.815740+0000","last_change":"2023-11-28T20:02:08.308147+0000","last_active":"2023-11-28T20:02:25.815740+0000","last_peered":"2023-11-28T20:02:25.815740+0000","last_clean":"2023-11-28T20:02:25.815740+0000","last_became_active":"2023-11-28T20:02:08.307818+0000","last_became_peered":"2023-11-28T20:02:08.307818+0000","last_unstale":"2023-11-28T20:02:25.815740+0000","last_undegraded":"2023-11-28T20:02:25.815740+0000","last_fullsized":"2023-11-28T20:02:25.815740+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_clean_scrub_stamp":"2023-11-28T20:02:07.264604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T06:29:21.322854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.18","version":"0'0","reported_seq":15,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-11-28T20:02:24.864242+0000","last_change":"2023-11-28T20:02:07.298452+0000","last_active":"2023-11-28T20:02:24.864242+0000","last_peered":"2023-11-28T20:02:24.864242+0000","last_clean":"2023-11-28T20:02:24.864242+0000","last_became_active":"2023-11-28T20:02:07.297932+0000","last_became_peered":"2023-11-28T20:02:07.297932+0000","last_unstale":"2023-11-28T20:02:24.864242+0000","last_undegraded":"2023-11-28T20:02:24.864242+0000","last_fullsized":"2023-11-28T20:02:24.864242+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:06.257335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:06.257335+0000","last_clean_scrub_stamp":"2023-11-28T20:02:06.257335+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:31:16.962567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.a","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-11-28T20:02:25.828261+0000","last_change":"2023-11-28T20:02:25.820759+0000","last_active":"2023-11-28T20:02:25.828261+0000","last_peered":"2023-11-28T20:02:25.828261+0000","last_clean":"2023-11-28T20:02:25.828261+0000","last_became_active":"2023-11-28T20:02:25.820280+0000","last_became_peered":"2023-11-28T20:02:25.820280+0000","last_unstale":"2023-11-28T20:02:25.828261+0000","last_undegraded":"2023-11-28T20:02:25.828261+0000","last_fullsized":"2023-11-28T20:02:25.828261+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:24.842435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:24.842435+0000","last_clean_scrub_stamp":"2023-11-28T20:02:24.842435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:43:16.026174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.15","version":"84'3","reported_seq":14,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-11-28T20:02:25.867930+0000","last_change":"2023-11-28T20:02:24.879351+0000","last_active":"2023-11-28T20:02:25.867930+0000","last_peered":"2023-11-28T20:02:25.867930+0000","last_clean":"2023-11-28T20:02:25.867930+0000","last_became_active":"2023-11-28T20:02:24.878728+0000","last_became_peered":"2023-11-28T20:02:24.878728+0000","last_unstale":"2023-11-28T20:02:25.867930+0000","last_undegraded":"2023-11-28T20:02:25.867930+0000","last_fullsized":"2023-11-28T20:02:25.867930+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:23.834083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:23.834083+0000","last_clean_scrub_stamp":"2023-11-28T20:02:23.834083+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:15:26.374860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.14","version":"0'0","reported_seq":15,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-11-28T20:02:25.804621+0000","last_change":"2023-11-28T20:02:08.298743+0000","last_active":"2023-11-28T20:02:25.804621+0000","last_peered":"2023-11-28T20:02:25.804621+0000","last_clean":"2023-11-28T20:02:25.804621+0000","last_became_active":"2023-11-28T20:02:08.298491+0000","last_became_peered":"2023-11-28T20:02:08.298491+0000","last_unstale":"2023-11-28T20:02:25.804621+0000","last_undegraded":"2023-11-28T20:02:25.804621+0000","last_fullsized":"2023-11-28T20:02:25.804621+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_clean_scrub_stamp":"2023-11-28T20:02:07.264604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:32:54.363830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.17","version":"0'0","reported_seq":16,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-11-28T20:02:25.827425+0000","last_change":"2023-11-28T20:02:07.299173+0000","last_active":"2023-11-28T20:02:25.827425+0000","last_peered":"2023-11-28T20:02:25.827425+0000","last_clean":"2023-11-28T20:02:25.827425+0000","last_became_active":"2023-11-28T20:02:07.298892+0000","last_became_peered":"2023-11-28T20:02:07.298892+0000","last_unstale":"2023-11-28T20:02:25.827425+0000","last_undegraded":"2023-11-28T20:02:25.827425+0000","last_fullsized":"2023-11-28T20:02:25.827425+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:06.257335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:06.257335+0000","last_clean_scrub_stamp":"2023-11-28T20:02:06.257335+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:50:01.847152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.b","version":"0'0","reported_seq":11,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-11-28T20:02:26.802337+0000","last_change":"2023-11-28T20:02:25.819018+0000","last_active":"2023-11-28T20:02:26.802337+0000","last_peered":"2023-11-28T20:02:26.802337+0000","last_clean":"2023-11-28T20:02:26.802337+0000","last_became_active":"2023-11-28T20:02:25.818750+0000","last_became_peered":"2023-11-28T20:02:25.818750+0000","last_unstale":"2023-11-28T20:02:26.802337+0000","last_undegraded":"2023-11-28T20:02:26.802337+0000","last_fullsized":"2023-11-28T20:02:26.802337+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:24.842435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:24.842435+0000","last_clean_scrub_stamp":"2023-11-28T20:02:24.842435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:15:27.383212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.14","version":"84'6","reported_seq":18,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-11-28T20:02:27.158279+0000","last_change":"2023-11-28T20:02:24.881076+0000","last_active":"2023-11-28T20:02:27.158279+0000","last_peered":"2023-11-28T20:02:27.158279+0000","last_clean":"2023-11-28T20:02:27.158279+0000","last_became_active":"2023-11-28T20:02:24.880709+0000","last_became_peered":"2023-11-28T20:02:24.880709+0000","last_unstale":"2023-11-28T20:02:27.158279+0000","last_undegraded":"2023-11-28T20:02:27.158279+0000","last_fullsized":"2023-11-28T20:02:27.158279+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:23.834083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:23.834083+0000","last_clean_scrub_stamp":"2023-11-28T20:02:23.834083+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:41:23.842664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.15","version":"0'0","reported_seq":14,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-11-28T20:02:24.866092+0000","last_change":"2023-11-28T20:02:08.303341+0000","last_active":"2023-11-28T20:02:24.866092+0000","last_peered":"2023-11-28T20:02:24.866092+0000","last_clean":"2023-11-28T20:02:24.866092+0000","last_became_active":"2023-11-28T20:02:08.303067+0000","last_became_peered":"2023-11-28T20:02:08.303067+0000","last_unstale":"2023-11-28T20:02:24.866092+0000","last_undegraded":"2023-11-28T20:02:24.866092+0000","last_fullsized":"2023-11-28T20:02:24.866092+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_clean_scrub_stamp":"2023-11-28T20:02:07.264604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:54:53.728600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.16","version":"0'0","reported_seq":15,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-11-28T20:02:24.855858+0000","last_change":"2023-11-28T20:02:07.291621+0000","last_active":"2023-11-28T20:02:24.855858+0000","last_peered":"2023-11-28T20:02:24.855858+0000","last_clean":"2023-11-28T20:02:24.855858+0000","last_became_active":"2023-11-28T20:02:07.288923+0000","last_became_peered":"2023-11-28T20:02:07.288923+0000","last_unstale":"2023-11-28T20:02:24.855858+0000","last_undegraded":"2023-11-28T20:02:24.855858+0000","last_fullsized":"2023-11-28T20:02:24.855858+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:06.257335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:06.257335+0000","last_clean_scrub_stamp":"2023-11-28T20:02:06.257335+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:54:52.721331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.8","version":"0'0","reported_seq":11,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-11-28T20:02:27.354899+0000","last_change":"2023-11-28T20:02:25.814563+0000","last_active":"2023-11-28T20:02:27.354899+0000","last_peered":"2023-11-28T20:02:27.354899+0000","last_clean":"2023-11-28T20:02:27.354899+0000","last_became_active":"2023-11-28T20:02:25.814280+0000","last_became_peered":"2023-11-28T20:02:25.814280+0000","last_unstale":"2023-11-28T20:02:27.354899+0000","last_undegraded":"2023-11-28T20:02:27.354899+0000","last_fullsized":"2023-11-28T20:02:27.354899+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:24.842435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:24.842435+0000","last_clean_scrub_stamp":"2023-11-28T20:02:24.842435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:55:02.371267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.17","version":"0'0","reported_seq":12,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-11-28T20:02:26.807585+0000","last_change":"2023-11-28T20:02:24.884044+0000","last_active":"2023-11-28T20:02:26.807585+0000","last_peered":"2023-11-28T20:02:26.807585+0000","last_clean":"2023-11-28T20:02:26.807585+0000","last_became_active":"2023-11-28T20:02:24.883433+0000","last_became_peered":"2023-11-28T20:02:24.883433+0000","last_unstale":"2023-11-28T20:02:26.807585+0000","last_undegraded":"2023-11-28T20:02:26.807585+0000","last_fullsized":"2023-11-28T20:02:26.807585+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:23.834083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:23.834083+0000","last_clean_scrub_stamp":"2023-11-28T20:02:23.834083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:10:18.229612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.16","version":"0'0","reported_seq":14,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-11-28T20:02:24.856070+0000","last_change":"2023-11-28T20:02:08.295869+0000","last_active":"2023-11-28T20:02:24.856070+0000","last_peered":"2023-11-28T20:02:24.856070+0000","last_clean":"2023-11-28T20:02:24.856070+0000","last_became_active":"2023-11-28T20:02:08.295474+0000","last_became_peered":"2023-11-28T20:02:08.295474+0000","last_unstale":"2023-11-28T20:02:24.856070+0000","last_undegraded":"2023-11-28T20:02:24.856070+0000","last_fullsized":"2023-11-28T20:02:24.856070+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_clean_scrub_stamp":"2023-11-28T20:02:07.264604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:37:52.578636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.15","version":"80'3","reported_seq":19,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-11-28T20:02:25.805953+0000","last_change":"2023-11-28T20:02:07.300162+0000","last_active":"2023-11-28T20:02:25.805953+0000","last_peered":"2023-11-28T20:02:25.805953+0000","last_clean":"2023-11-28T20:02:25.805953+0000","last_became_active":"2023-11-28T20:02:07.299792+0000","last_became_peered":"2023-11-28T20:02:07.299792+0000","last_unstale":"2023-11-28T20:02:25.805953+0000","last_undegraded":"2023-11-28T20:02:25.805953+0000","last_fullsized":"2023-11-28T20:02:25.805953+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:06.257335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:06.257335+0000","last_clean_scrub_stamp":"2023-11-28T20:02:06.257335+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:42:57.441074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.9","version":"0'0","reported_seq":11,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-11-28T20:02:26.801971+0000","last_change":"2023-11-28T20:02:25.818503+0000","last_active":"2023-11-28T20:02:26.801971+0000","last_peered":"2023-11-28T20:02:26.801971+0000","last_clean":"2023-11-28T20:02:26.801971+0000","last_became_active":"2023-11-28T20:02:25.818233+0000","last_became_peered":"2023-11-28T20:02:25.818233+0000","last_unstale":"2023-11-28T20:02:26.801971+0000","last_undegraded":"2023-11-28T20:02:26.801971+0000","last_fullsized":"2023-11-28T20:02:26.801971+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:24.842435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:24.842435+0000","last_clean_scrub_stamp":"2023-11-28T20:02:24.842435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:06:39.785006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.16","version":"0'0","reported_seq":12,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-11-28T20:02:27.355510+0000","last_change":"2023-11-28T20:02:24.878398+0000","last_active":"2023-11-28T20:02:27.355510+0000","last_peered":"2023-11-28T20:02:27.355510+0000","last_clean":"2023-11-28T20:02:27.355510+0000","last_became_active":"2023-11-28T20:02:24.878101+0000","last_became_peered":"2023-11-28T20:02:24.878101+0000","last_unstale":"2023-11-28T20:02:27.355510+0000","last_undegraded":"2023-11-28T20:02:27.355510+0000","last_fullsized":"2023-11-28T20:02:27.355510+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:23.834083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:23.834083+0000","last_clean_scrub_stamp":"2023-11-28T20:02:23.834083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T07:21:20.584960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.17","version":"0'0","reported_seq":15,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-11-28T20:02:25.816719+0000","last_change":"2023-11-28T20:02:08.286867+0000","last_active":"2023-11-28T20:02:25.816719+0000","last_peered":"2023-11-28T20:02:25.816719+0000","last_clean":"2023-11-28T20:02:25.816719+0000","last_became_active":"2023-11-28T20:02:08.286448+0000","last_became_peered":"2023-11-28T20:02:08.286448+0000","last_unstale":"2023-11-28T20:02:25.816719+0000","last_undegraded":"2023-11-28T20:02:25.816719+0000","last_fullsized":"2023-11-28T20:02:25.816719+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_clean_scrub_stamp":"2023-11-28T20:02:07.264604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:11:13.228652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.14","version":"81'8","reported_seq":24,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-11-28T20:02:25.807762+0000","last_change":"2023-11-28T20:02:07.296089+0000","last_active":"2023-11-28T20:02:25.807762+0000","last_peered":"2023-11-28T20:02:25.807762+0000","last_clean":"2023-11-28T20:02:25.807762+0000","last_became_active":"2023-11-28T20:02:07.295836+0000","last_became_peered":"2023-11-28T20:02:07.295836+0000","last_unstale":"2023-11-28T20:02:25.807762+0000","last_undegraded":"2023-11-28T20:02:25.807762+0000","last_fullsized":"2023-11-28T20:02:25.807762+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:06.257335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:06.257335+0000","last_clean_scrub_stamp":"2023-11-28T20:02:06.257335+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:27:45.443806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3107,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.e","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-11-28T20:02:25.816419+0000","last_change":"2023-11-28T20:02:25.810671+0000","last_active":"2023-11-28T20:02:25.816419+0000","last_peered":"2023-11-28T20:02:25.816419+0000","last_clean":"2023-11-28T20:02:25.816419+0000","last_became_active":"2023-11-28T20:02:25.810387+0000","last_became_peered":"2023-11-28T20:02:25.810387+0000","last_unstale":"2023-11-28T20:02:25.816419+0000","last_undegraded":"2023-11-28T20:02:25.816419+0000","last_fullsized":"2023-11-28T20:02:25.816419+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:24.842435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:24.842435+0000","last_clean_scrub_stamp":"2023-11-28T20:02:24.842435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:33:05.135527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.11","version":"0'0","reported_seq":11,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-11-28T20:02:25.799464+0000","last_change":"2023-11-28T20:02:24.880576+0000","last_active":"2023-11-28T20:02:25.799464+0000","last_peered":"2023-11-28T20:02:25.799464+0000","last_clean":"2023-11-28T20:02:25.799464+0000","last_became_active":"2023-11-28T20:02:24.880303+0000","last_became_peered":"2023-11-28T20:02:24.880303+0000","last_unstale":"2023-11-28T20:02:25.799464+0000","last_undegraded":"2023-11-28T20:02:25.799464+0000","last_fullsized":"2023-11-28T20:02:25.799464+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:23.834083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:23.834083+0000","last_clean_scrub_stamp":"2023-11-28T20:02:23.834083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:03:20.841774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.10","version":"0'0","reported_seq":15,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-11-28T20:02:25.809755+0000","last_change":"2023-11-28T20:02:08.296835+0000","last_active":"2023-11-28T20:02:25.809755+0000","last_peered":"2023-11-28T20:02:25.809755+0000","last_clean":"2023-11-28T20:02:25.809755+0000","last_became_active":"2023-11-28T20:02:08.296239+0000","last_became_peered":"2023-11-28T20:02:08.296239+0000","last_unstale":"2023-11-28T20:02:25.809755+0000","last_undegraded":"2023-11-28T20:02:25.809755+0000","last_fullsized":"2023-11-28T20:02:25.809755+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_clean_scrub_stamp":"2023-11-28T20:02:07.264604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:50:02.854421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.13","version":"80'2","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-11-28T20:02:24.865500+0000","last_change":"2023-11-28T20:02:07.298781+0000","last_active":"2023-11-28T20:02:24.865500+0000","last_peered":"2023-11-28T20:02:24.865500+0000","last_clean":"2023-11-28T20:02:24.865500+0000","last_became_active":"2023-11-28T20:02:07.298318+0000","last_became_peered":"2023-11-28T20:02:07.298318+0000","last_unstale":"2023-11-28T20:02:24.865500+0000","last_undegraded":"2023-11-28T20:02:24.865500+0000","last_fullsized":"2023-11-28T20:02:24.865500+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:06.257335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:06.257335+0000","last_clean_scrub_stamp":"2023-11-28T20:02:06.257335+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T06:34:38.820255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.f","version":"0'0","reported_seq":11,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-11-28T20:02:27.355884+0000","last_change":"2023-11-28T20:02:25.834801+0000","last_active":"2023-11-28T20:02:27.355884+0000","last_peered":"2023-11-28T20:02:27.355884+0000","last_clean":"2023-11-28T20:02:27.355884+0000","last_became_active":"2023-11-28T20:02:25.834513+0000","last_became_peered":"2023-11-28T20:02:25.834513+0000","last_unstale":"2023-11-28T20:02:27.355884+0000","last_undegraded":"2023-11-28T20:02:27.355884+0000","last_fullsized":"2023-11-28T20:02:27.355884+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:24.842435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:24.842435+0000","last_clean_scrub_stamp":"2023-11-28T20:02:24.842435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:16:22.375446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.10","version":"84'8","reported_seq":20,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-11-28T20:02:26.805401+0000","last_change":"2023-11-28T20:02:24.877748+0000","last_active":"2023-11-28T20:02:26.805401+0000","last_peered":"2023-11-28T20:02:26.805401+0000","last_clean":"2023-11-28T20:02:26.805401+0000","last_became_active":"2023-11-28T20:02:24.877459+0000","last_became_peered":"2023-11-28T20:02:24.877459+0000","last_unstale":"2023-11-28T20:02:26.805401+0000","last_undegraded":"2023-11-28T20:02:26.805401+0000","last_fullsized":"2023-11-28T20:02:26.805401+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:23.834083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:23.834083+0000","last_clean_scrub_stamp":"2023-11-28T20:02:23.834083+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T07:49:48.482356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.11","version":"0'0","reported_seq":15,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-11-28T20:02:25.805337+0000","last_change":"2023-11-28T20:02:08.294608+0000","last_active":"2023-11-28T20:02:25.805337+0000","last_peered":"2023-11-28T20:02:25.805337+0000","last_clean":"2023-11-28T20:02:25.805337+0000","last_became_active":"2023-11-28T20:02:08.294294+0000","last_became_peered":"2023-11-28T20:02:08.294294+0000","last_unstale":"2023-11-28T20:02:25.805337+0000","last_undegraded":"2023-11-28T20:02:25.805337+0000","last_fullsized":"2023-11-28T20:02:25.805337+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_clean_scrub_stamp":"2023-11-28T20:02:07.264604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:25:22.453300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.12","version":"0'0","reported_seq":16,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-11-28T20:02:25.807202+0000","last_change":"2023-11-28T20:02:07.293203+0000","last_active":"2023-11-28T20:02:25.807202+0000","last_peered":"2023-11-28T20:02:25.807202+0000","last_clean":"2023-11-28T20:02:25.807202+0000","last_became_active":"2023-11-28T20:02:07.292922+0000","last_became_peered":"2023-11-28T20:02:07.292922+0000","last_unstale":"2023-11-28T20:02:25.807202+0000","last_undegraded":"2023-11-28T20:02:25.807202+0000","last_fullsized":"2023-11-28T20:02:25.807202+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:06.257335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:06.257335+0000","last_clean_scrub_stamp":"2023-11-28T20:02:06.257335+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:18:07.449281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.c","version":"0'0","reported_seq":11,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-11-28T20:02:26.805910+0000","last_change":"2023-11-28T20:02:25.829615+0000","last_active":"2023-11-28T20:02:26.805910+0000","last_peered":"2023-11-28T20:02:26.805910+0000","last_clean":"2023-11-28T20:02:26.805910+0000","last_became_active":"2023-11-28T20:02:25.829293+0000","last_became_peered":"2023-11-28T20:02:25.829293+0000","last_unstale":"2023-11-28T20:02:26.805910+0000","last_undegraded":"2023-11-28T20:02:26.805910+0000","last_fullsized":"2023-11-28T20:02:26.805910+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:24.842435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:24.842435+0000","last_clean_scrub_stamp":"2023-11-28T20:02:24.842435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:59:09.445203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.13","version":"84'2","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-11-28T20:02:26.802344+0000","last_change":"2023-11-28T20:02:24.879838+0000","last_active":"2023-11-28T20:02:26.802344+0000","last_peered":"2023-11-28T20:02:26.802344+0000","last_clean":"2023-11-28T20:02:26.802344+0000","last_became_active":"2023-11-28T20:02:24.879587+0000","last_became_peered":"2023-11-28T20:02:24.879587+0000","last_unstale":"2023-11-28T20:02:26.802344+0000","last_undegraded":"2023-11-28T20:02:26.802344+0000","last_fullsized":"2023-11-28T20:02:26.802344+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:23.834083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:23.834083+0000","last_clean_scrub_stamp":"2023-11-28T20:02:23.834083+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:12:57.834618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.12","version":"0'0","reported_seq":14,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-11-28T20:02:24.873726+0000","last_change":"2023-11-28T20:02:08.305983+0000","last_active":"2023-11-28T20:02:24.873726+0000","last_peered":"2023-11-28T20:02:24.873726+0000","last_clean":"2023-11-28T20:02:24.873726+0000","last_became_active":"2023-11-28T20:02:08.305718+0000","last_became_peered":"2023-11-28T20:02:08.305718+0000","last_unstale":"2023-11-28T20:02:24.873726+0000","last_undegraded":"2023-11-28T20:02:24.873726+0000","last_fullsized":"2023-11-28T20:02:24.873726+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_clean_scrub_stamp":"2023-11-28T20:02:07.264604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T07:15:19.620125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.11","version":"0'0","reported_seq":16,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-11-28T20:02:25.812891+0000","last_change":"2023-11-28T20:02:07.291824+0000","last_active":"2023-11-28T20:02:25.812891+0000","last_peered":"2023-11-28T20:02:25.812891+0000","last_clean":"2023-11-28T20:02:25.812891+0000","last_became_active":"2023-11-28T20:02:07.291575+0000","last_became_peered":"2023-11-28T20:02:07.291575+0000","last_unstale":"2023-11-28T20:02:25.812891+0000","last_undegraded":"2023-11-28T20:02:25.812891+0000","last_fullsized":"2023-11-28T20:02:25.812891+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:06.257335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:06.257335+0000","last_clean_scrub_stamp":"2023-11-28T20:02:06.257335+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:48:42.567546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.d","version":"0'0","reported_seq":11,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-11-28T20:02:27.158675+0000","last_change":"2023-11-28T20:02:25.822764+0000","last_active":"2023-11-28T20:02:27.158675+0000","last_peered":"2023-11-28T20:02:27.158675+0000","last_clean":"2023-11-28T20:02:27.158675+0000","last_became_active":"2023-11-28T20:02:25.820344+0000","last_became_peered":"2023-11-28T20:02:25.820344+0000","last_unstale":"2023-11-28T20:02:27.158675+0000","last_undegraded":"2023-11-28T20:02:27.158675+0000","last_fullsized":"2023-11-28T20:02:27.158675+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:24.842435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:24.842435+0000","last_clean_scrub_stamp":"2023-11-28T20:02:24.842435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T06:34:10.812327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.12","version":"0'0","reported_seq":11,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-11-28T20:02:25.804919+0000","last_change":"2023-11-28T20:02:24.867146+0000","last_active":"2023-11-28T20:02:25.804919+0000","last_peered":"2023-11-28T20:02:25.804919+0000","last_clean":"2023-11-28T20:02:25.804919+0000","last_became_active":"2023-11-28T20:02:24.866856+0000","last_became_peered":"2023-11-28T20:02:24.866856+0000","last_unstale":"2023-11-28T20:02:25.804919+0000","last_undegraded":"2023-11-28T20:02:25.804919+0000","last_fullsized":"2023-11-28T20:02:25.804919+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:23.834083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:23.834083+0000","last_clean_scrub_stamp":"2023-11-28T20:02:23.834083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T07:14:53.673098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.13","version":"0'0","reported_seq":14,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-11-28T20:02:24.871977+0000","last_change":"2023-11-28T20:02:08.312636+0000","last_active":"2023-11-28T20:02:24.871977+0000","last_peered":"2023-11-28T20:02:24.871977+0000","last_clean":"2023-11-28T20:02:24.871977+0000","last_became_active":"2023-11-28T20:02:08.312388+0000","last_became_peered":"2023-11-28T20:02:08.312388+0000","last_unstale":"2023-11-28T20:02:24.871977+0000","last_undegraded":"2023-11-28T20:02:24.871977+0000","last_fullsized":"2023-11-28T20:02:24.871977+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_clean_scrub_stamp":"2023-11-28T20:02:07.264604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:08:01.628559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.10","version":"80'8","reported_seq":24,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-11-28T20:02:25.809085+0000","last_change":"2023-11-28T20:02:07.295459+0000","last_active":"2023-11-28T20:02:25.809085+0000","last_peered":"2023-11-28T20:02:25.809085+0000","last_clean":"2023-11-28T20:02:25.809085+0000","last_became_active":"2023-11-28T20:02:07.295090+0000","last_became_peered":"2023-11-28T20:02:07.295090+0000","last_unstale":"2023-11-28T20:02:25.809085+0000","last_undegraded":"2023-11-28T20:02:25.809085+0000","last_fullsized":"2023-11-28T20:02:25.809085+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:06.257335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:06.257335+0000","last_clean_scrub_stamp":"2023-11-28T20:02:06.257335+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:32:53.356561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.12","version":"0'0","reported_seq":11,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-11-28T20:02:27.158027+0000","last_change":"2023-11-28T20:02:25.815877+0000","last_active":"2023-11-28T20:02:27.158027+0000","last_peered":"2023-11-28T20:02:27.158027+0000","last_clean":"2023-11-28T20:02:27.158027+0000","last_became_active":"2023-11-28T20:02:25.815570+0000","last_became_peered":"2023-11-28T20:02:25.815570+0000","last_unstale":"2023-11-28T20:02:27.158027+0000","last_undegraded":"2023-11-28T20:02:27.158027+0000","last_fullsized":"2023-11-28T20:02:27.158027+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:24.842435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:24.842435+0000","last_clean_scrub_stamp":"2023-11-28T20:02:24.842435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:06:39.785006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.d","version":"84'1","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-11-28T20:02:25.870770+0000","last_change":"2023-11-28T20:02:24.879566+0000","last_active":"2023-11-28T20:02:25.870770+0000","last_peered":"2023-11-28T20:02:25.870770+0000","last_clean":"2023-11-28T20:02:25.870770+0000","last_became_active":"2023-11-28T20:02:24.879084+0000","last_became_peered":"2023-11-28T20:02:24.879084+0000","last_unstale":"2023-11-28T20:02:25.870770+0000","last_undegraded":"2023-11-28T20:02:25.870770+0000","last_fullsized":"2023-11-28T20:02:25.870770+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:23.834083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:23.834083+0000","last_clean_scrub_stamp":"2023-11-28T20:02:23.834083+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T06:43:15.768022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.c","version":"0'0","reported_seq":15,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-11-28T20:02:25.807680+0000","last_change":"2023-11-28T20:02:08.310148+0000","last_active":"2023-11-28T20:02:25.807680+0000","last_peered":"2023-11-28T20:02:25.807680+0000","last_clean":"2023-11-28T20:02:25.807680+0000","last_became_active":"2023-11-28T20:02:08.308703+0000","last_became_peered":"2023-11-28T20:02:08.308703+0000","last_unstale":"2023-11-28T20:02:25.807680+0000","last_undegraded":"2023-11-28T20:02:25.807680+0000","last_fullsized":"2023-11-28T20:02:25.807680+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_clean_scrub_stamp":"2023-11-28T20:02:07.264604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:54:00.199248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.f","version":"80'1","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-11-28T20:02:25.808101+0000","last_change":"2023-11-28T20:02:07.295608+0000","last_active":"2023-11-28T20:02:25.808101+0000","last_peered":"2023-11-28T20:02:25.808101+0000","last_clean":"2023-11-28T20:02:25.808101+0000","last_became_active":"2023-11-28T20:02:07.295293+0000","last_became_peered":"2023-11-28T20:02:07.295293+0000","last_unstale":"2023-11-28T20:02:25.808101+0000","last_undegraded":"2023-11-28T20:02:25.808101+0000","last_fullsized":"2023-11-28T20:02:25.808101+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:06.257335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:06.257335+0000","last_clean_scrub_stamp":"2023-11-28T20:02:06.257335+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:49:04.193812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.13","version":"0'0","reported_seq":11,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-11-28T20:02:26.802209+0000","last_change":"2023-11-28T20:02:25.823940+0000","last_active":"2023-11-28T20:02:26.802209+0000","last_peered":"2023-11-28T20:02:26.802209+0000","last_clean":"2023-11-28T20:02:26.802209+0000","last_became_active":"2023-11-28T20:02:25.823335+0000","last_became_peered":"2023-11-28T20:02:25.823335+0000","last_unstale":"2023-11-28T20:02:26.802209+0000","last_undegraded":"2023-11-28T20:02:26.802209+0000","last_fullsized":"2023-11-28T20:02:26.802209+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:24.842435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:24.842435+0000","last_clean_scrub_stamp":"2023-11-28T20:02:24.842435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:54:35.374803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.c","version":"0'0","reported_seq":12,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-11-28T20:02:26.806132+0000","last_change":"2023-11-28T20:02:24.885799+0000","last_active":"2023-11-28T20:02:26.806132+0000","last_peered":"2023-11-28T20:02:26.806132+0000","last_clean":"2023-11-28T20:02:26.806132+0000","last_became_active":"2023-11-28T20:02:24.885408+0000","last_became_peered":"2023-11-28T20:02:24.885408+0000","last_unstale":"2023-11-28T20:02:26.806132+0000","last_undegraded":"2023-11-28T20:02:26.806132+0000","last_fullsized":"2023-11-28T20:02:26.806132+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:23.834083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:23.834083+0000","last_clean_scrub_stamp":"2023-11-28T20:02:23.834083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:18:25.026028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.d","version":"0'0","reported_seq":15,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-11-28T20:02:25.807747+0000","last_change":"2023-11-28T20:02:08.300331+0000","last_active":"2023-11-28T20:02:25.807747+0000","last_peered":"2023-11-28T20:02:25.807747+0000","last_clean":"2023-11-28T20:02:25.807747+0000","last_became_active":"2023-11-28T20:02:08.300031+0000","last_became_peered":"2023-11-28T20:02:08.300031+0000","last_unstale":"2023-11-28T20:02:25.807747+0000","last_undegraded":"2023-11-28T20:02:25.807747+0000","last_fullsized":"2023-11-28T20:02:25.807747+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_clean_scrub_stamp":"2023-11-28T20:02:07.264604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:55:48.206640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.e","version":"80'2","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-11-28T20:02:24.865365+0000","last_change":"2023-11-28T20:02:07.300742+0000","last_active":"2023-11-28T20:02:24.865365+0000","last_peered":"2023-11-28T20:02:24.865365+0000","last_clean":"2023-11-28T20:02:24.865365+0000","last_became_active":"2023-11-28T20:02:07.300392+0000","last_became_peered":"2023-11-28T20:02:07.300392+0000","last_unstale":"2023-11-28T20:02:24.865365+0000","last_undegraded":"2023-11-28T20:02:24.865365+0000","last_fullsized":"2023-11-28T20:02:24.865365+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:06.257335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:06.257335+0000","last_clean_scrub_stamp":"2023-11-28T20:02:06.257335+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:12:46.771683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.10","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-11-28T20:02:25.819644+0000","last_change":"2023-11-28T20:02:25.814866+0000","last_active":"2023-11-28T20:02:25.819644+0000","last_peered":"2023-11-28T20:02:25.819644+0000","last_clean":"2023-11-28T20:02:25.819644+0000","last_became_active":"2023-11-28T20:02:25.814215+0000","last_became_peered":"2023-11-28T20:02:25.814215+0000","last_unstale":"2023-11-28T20:02:25.819644+0000","last_undegraded":"2023-11-28T20:02:25.819644+0000","last_fullsized":"2023-11-28T20:02:25.819644+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:24.842435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:24.842435+0000","last_clean_scrub_stamp":"2023-11-28T20:02:24.842435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T07:02:43.159507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.f","version":"84'1","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-11-28T20:02:27.158949+0000","last_change":"2023-11-28T20:02:24.882590+0000","last_active":"2023-11-28T20:02:27.158949+0000","last_peered":"2023-11-28T20:02:27.158949+0000","last_clean":"2023-11-28T20:02:27.158949+0000","last_became_active":"2023-11-28T20:02:24.880596+0000","last_became_peered":"2023-11-28T20:02:24.880596+0000","last_unstale":"2023-11-28T20:02:27.158949+0000","last_undegraded":"2023-11-28T20:02:27.158949+0000","last_fullsized":"2023-11-28T20:02:27.158949+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:23.834083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:23.834083+0000","last_clean_scrub_stamp":"2023-11-28T20:02:23.834083+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:12:57.834618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.e","version":"0'0","reported_seq":15,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-11-28T20:02:25.807141+0000","last_change":"2023-11-28T20:02:08.313109+0000","last_active":"2023-11-28T20:02:25.807141+0000","last_peered":"2023-11-28T20:02:25.807141+0000","last_clean":"2023-11-28T20:02:25.807141+0000","last_became_active":"2023-11-28T20:02:08.312841+0000","last_became_peered":"2023-11-28T20:02:08.312841+0000","last_unstale":"2023-11-28T20:02:25.807141+0000","last_undegraded":"2023-11-28T20:02:25.807141+0000","last_fullsized":"2023-11-28T20:02:25.807141+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_clean_scrub_stamp":"2023-11-28T20:02:07.264604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:48:20.809209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.d","version":"80'1","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-11-28T20:02:25.805954+0000","last_change":"2023-11-28T20:02:07.301258+0000","last_active":"2023-11-28T20:02:25.805954+0000","last_peered":"2023-11-28T20:02:25.805954+0000","last_clean":"2023-11-28T20:02:25.805954+0000","last_became_active":"2023-11-28T20:02:07.300955+0000","last_became_peered":"2023-11-28T20:02:07.300955+0000","last_unstale":"2023-11-28T20:02:25.805954+0000","last_undegraded":"2023-11-28T20:02:25.805954+0000","last_fullsized":"2023-11-28T20:02:25.805954+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:06.257335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:06.257335+0000","last_clean_scrub_stamp":"2023-11-28T20:02:06.257335+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T07:05:17.648805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.16","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-11-28T20:02:25.817917+0000","last_change":"2023-11-28T20:02:25.812371+0000","last_active":"2023-11-28T20:02:25.817917+0000","last_peered":"2023-11-28T20:02:25.817917+0000","last_clean":"2023-11-28T20:02:25.817917+0000","last_became_active":"2023-11-28T20:02:25.812085+0000","last_became_peered":"2023-11-28T20:02:25.812085+0000","last_unstale":"2023-11-28T20:02:25.817917+0000","last_undegraded":"2023-11-28T20:02:25.817917+0000","last_fullsized":"2023-11-28T20:02:25.817917+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:24.842435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:24.842435+0000","last_clean_scrub_stamp":"2023-11-28T20:02:24.842435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T07:27:30.033177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.9","version":"0'0","reported_seq":12,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-11-28T20:02:27.157920+0000","last_change":"2023-11-28T20:02:24.886442+0000","last_active":"2023-11-28T20:02:27.157920+0000","last_peered":"2023-11-28T20:02:27.157920+0000","last_clean":"2023-11-28T20:02:27.157920+0000","last_became_active":"2023-11-28T20:02:24.886086+0000","last_became_peered":"2023-11-28T20:02:24.886086+0000","last_unstale":"2023-11-28T20:02:27.157920+0000","last_undegraded":"2023-11-28T20:02:27.157920+0000","last_fullsized":"2023-11-28T20:02:27.157920+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:23.834083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:23.834083+0000","last_clean_scrub_stamp":"2023-11-28T20:02:23.834083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:54:49.728011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.8","version":"0'0","reported_seq":15,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-11-28T20:02:25.805199+0000","last_change":"2023-11-28T20:02:08.303056+0000","last_active":"2023-11-28T20:02:25.805199+0000","last_peered":"2023-11-28T20:02:25.805199+0000","last_clean":"2023-11-28T20:02:25.805199+0000","last_became_active":"2023-11-28T20:02:08.302812+0000","last_became_peered":"2023-11-28T20:02:08.302812+0000","last_unstale":"2023-11-28T20:02:25.805199+0000","last_undegraded":"2023-11-28T20:02:25.805199+0000","last_fullsized":"2023-11-28T20:02:25.805199+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_clean_scrub_stamp":"2023-11-28T20:02:07.264604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:47:55.747151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.b","version":"80'2","reported_seq":18,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-11-28T20:02:25.819865+0000","last_change":"2023-11-28T20:02:07.295857+0000","last_active":"2023-11-28T20:02:25.819865+0000","last_peered":"2023-11-28T20:02:25.819865+0000","last_clean":"2023-11-28T20:02:25.819865+0000","last_became_active":"2023-11-28T20:02:07.295642+0000","last_became_peered":"2023-11-28T20:02:07.295642+0000","last_unstale":"2023-11-28T20:02:25.819865+0000","last_undegraded":"2023-11-28T20:02:25.819865+0000","last_fullsized":"2023-11-28T20:02:25.819865+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:06.257335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:06.257335+0000","last_clean_scrub_stamp":"2023-11-28T20:02:06.257335+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:32:53.356561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.17","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-11-28T20:02:25.825311+0000","last_change":"2023-11-28T20:02:25.820408+0000","last_active":"2023-11-28T20:02:25.825311+0000","last_peered":"2023-11-28T20:02:25.825311+0000","last_clean":"2023-11-28T20:02:25.825311+0000","last_became_active":"2023-11-28T20:02:25.820110+0000","last_became_peered":"2023-11-28T20:02:25.820110+0000","last_unstale":"2023-11-28T20:02:25.825311+0000","last_undegraded":"2023-11-28T20:02:25.825311+0000","last_fullsized":"2023-11-28T20:02:25.825311+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:24.842435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:24.842435+0000","last_clean_scrub_stamp":"2023-11-28T20:02:24.842435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:37:32.135190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.8","version":"0'0","reported_seq":11,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-11-28T20:02:25.800005+0000","last_change":"2023-11-28T20:02:24.876451+0000","last_active":"2023-11-28T20:02:25.800005+0000","last_peered":"2023-11-28T20:02:25.800005+0000","last_clean":"2023-11-28T20:02:25.800005+0000","last_became_active":"2023-11-28T20:02:24.876183+0000","last_became_peered":"2023-11-28T20:02:24.876183+0000","last_unstale":"2023-11-28T20:02:25.800005+0000","last_undegraded":"2023-11-28T20:02:25.800005+0000","last_fullsized":"2023-11-28T20:02:25.800005+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:23.834083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:23.834083+0000","last_clean_scrub_stamp":"2023-11-28T20:02:23.834083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:26:09.248698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.9","version":"0'0","reported_seq":15,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-11-28T20:02:25.817398+0000","last_change":"2023-11-28T20:02:08.297174+0000","last_active":"2023-11-28T20:02:25.817398+0000","last_peered":"2023-11-28T20:02:25.817398+0000","last_clean":"2023-11-28T20:02:25.817398+0000","last_became_active":"2023-11-28T20:02:08.296877+0000","last_became_peered":"2023-11-28T20:02:08.296877+0000","last_unstale":"2023-11-28T20:02:25.817398+0000","last_undegraded":"2023-11-28T20:02:25.817398+0000","last_fullsized":"2023-11-28T20:02:25.817398+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_clean_scrub_stamp":"2023-11-28T20:02:07.264604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:11:13.228652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.a","version":"0'0","reported_seq":15,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-11-28T20:02:24.873863+0000","last_change":"2023-11-28T20:02:07.296302+0000","last_active":"2023-11-28T20:02:24.873863+0000","last_peered":"2023-11-28T20:02:24.873863+0000","last_clean":"2023-11-28T20:02:24.873863+0000","last_became_active":"2023-11-28T20:02:07.296048+0000","last_became_peered":"2023-11-28T20:02:07.296048+0000","last_unstale":"2023-11-28T20:02:24.873863+0000","last_undegraded":"2023-11-28T20:02:24.873863+0000","last_fullsized":"2023-11-28T20:02:24.873863+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:06.257335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:06.257335+0000","last_clean_scrub_stamp":"2023-11-28T20:02:06.257335+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:22:17.972305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.14","version":"0'0","reported_seq":11,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-11-28T20:02:27.355363+0000","last_change":"2023-11-28T20:02:25.817465+0000","last_active":"2023-11-28T20:02:27.355363+0000","last_peered":"2023-11-28T20:02:27.355363+0000","last_clean":"2023-11-28T20:02:27.355363+0000","last_became_active":"2023-11-28T20:02:25.817179+0000","last_became_peered":"2023-11-28T20:02:25.817179+0000","last_unstale":"2023-11-28T20:02:27.355363+0000","last_undegraded":"2023-11-28T20:02:27.355363+0000","last_fullsized":"2023-11-28T20:02:27.355363+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:24.842435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:24.842435+0000","last_clean_scrub_stamp":"2023-11-28T20:02:24.842435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:57:18.245565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.b","version":"84'2","reported_seq":13,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-11-28T20:02:25.867618+0000","last_change":"2023-11-28T20:02:24.882314+0000","last_active":"2023-11-28T20:02:25.867618+0000","last_peered":"2023-11-28T20:02:25.867618+0000","last_clean":"2023-11-28T20:02:25.867618+0000","last_became_active":"2023-11-28T20:02:24.882046+0000","last_became_peered":"2023-11-28T20:02:24.882046+0000","last_unstale":"2023-11-28T20:02:25.867618+0000","last_undegraded":"2023-11-28T20:02:25.867618+0000","last_fullsized":"2023-11-28T20:02:25.867618+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:23.834083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:23.834083+0000","last_clean_scrub_stamp":"2023-11-28T20:02:23.834083+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:06:03.831763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.a","version":"0'0","reported_seq":15,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-11-28T20:02:25.823522+0000","last_change":"2023-11-28T20:02:08.289316+0000","last_active":"2023-11-28T20:02:25.823522+0000","last_peered":"2023-11-28T20:02:25.823522+0000","last_clean":"2023-11-28T20:02:25.823522+0000","last_became_active":"2023-11-28T20:02:08.288979+0000","last_became_peered":"2023-11-28T20:02:08.288979+0000","last_unstale":"2023-11-28T20:02:25.823522+0000","last_undegraded":"2023-11-28T20:02:25.823522+0000","last_fullsized":"2023-11-28T20:02:25.823522+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_clean_scrub_stamp":"2023-11-28T20:02:07.264604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:40:59.195276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.9","version":"0'0","reported_seq":16,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-11-28T20:02:25.817482+0000","last_change":"2023-11-28T20:02:07.296576+0000","last_active":"2023-11-28T20:02:25.817482+0000","last_peered":"2023-11-28T20:02:25.817482+0000","last_clean":"2023-11-28T20:02:25.817482+0000","last_became_active":"2023-11-28T20:02:07.295982+0000","last_became_peered":"2023-11-28T20:02:07.295982+0000","last_unstale":"2023-11-28T20:02:25.817482+0000","last_undegraded":"2023-11-28T20:02:25.817482+0000","last_fullsized":"2023-11-28T20:02:25.817482+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:06.257335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:06.257335+0000","last_clean_scrub_stamp":"2023-11-28T20:02:06.257335+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:51:10.137114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.15","version":"0'0","reported_seq":11,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-11-28T20:02:27.355493+0000","last_change":"2023-11-28T20:02:25.827919+0000","last_active":"2023-11-28T20:02:27.355493+0000","last_peered":"2023-11-28T20:02:27.355493+0000","last_clean":"2023-11-28T20:02:27.355493+0000","last_became_active":"2023-11-28T20:02:25.827569+0000","last_became_peered":"2023-11-28T20:02:25.827569+0000","last_unstale":"2023-11-28T20:02:27.355493+0000","last_undegraded":"2023-11-28T20:02:27.355493+0000","last_fullsized":"2023-11-28T20:02:27.355493+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:24.842435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:24.842435+0000","last_clean_scrub_stamp":"2023-11-28T20:02:24.842435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:59:59.383513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.a","version":"0'0","reported_seq":11,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-11-28T20:02:25.799514+0000","last_change":"2023-11-28T20:02:24.876910+0000","last_active":"2023-11-28T20:02:25.799514+0000","last_peered":"2023-11-28T20:02:25.799514+0000","last_clean":"2023-11-28T20:02:25.799514+0000","last_became_active":"2023-11-28T20:02:24.876600+0000","last_became_peered":"2023-11-28T20:02:24.876600+0000","last_unstale":"2023-11-28T20:02:25.799514+0000","last_undegraded":"2023-11-28T20:02:25.799514+0000","last_fullsized":"2023-11-28T20:02:25.799514+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:23.834083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:23.834083+0000","last_clean_scrub_stamp":"2023-11-28T20:02:23.834083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:12:55.594909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.b","version":"0'0","reported_seq":15,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-11-28T20:02:25.807300+0000","last_change":"2023-11-28T20:02:08.317237+0000","last_active":"2023-11-28T20:02:25.807300+0000","last_peered":"2023-11-28T20:02:25.807300+0000","last_clean":"2023-11-28T20:02:25.807300+0000","last_became_active":"2023-11-28T20:02:08.316980+0000","last_became_peered":"2023-11-28T20:02:08.316980+0000","last_unstale":"2023-11-28T20:02:25.807300+0000","last_undegraded":"2023-11-28T20:02:25.807300+0000","last_fullsized":"2023-11-28T20:02:25.807300+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_clean_scrub_stamp":"2023-11-28T20:02:07.264604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T06:33:53.234496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.8","version":"0'0","reported_seq":15,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-11-28T20:02:24.870254+0000","last_change":"2023-11-28T20:02:07.293087+0000","last_active":"2023-11-28T20:02:24.870254+0000","last_peered":"2023-11-28T20:02:24.870254+0000","last_clean":"2023-11-28T20:02:24.870254+0000","last_became_active":"2023-11-28T20:02:07.292815+0000","last_became_peered":"2023-11-28T20:02:07.292815+0000","last_unstale":"2023-11-28T20:02:24.870254+0000","last_undegraded":"2023-11-28T20:02:24.870254+0000","last_fullsized":"2023-11-28T20:02:24.870254+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:06.257335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:06.257335+0000","last_clean_scrub_stamp":"2023-11-28T20:02:06.257335+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:57:12.771669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.1a","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-11-28T20:02:25.818454+0000","last_change":"2023-11-28T20:02:25.812223+0000","last_active":"2023-11-28T20:02:25.818454+0000","last_peered":"2023-11-28T20:02:25.818454+0000","last_clean":"2023-11-28T20:02:25.818454+0000","last_became_active":"2023-11-28T20:02:25.811925+0000","last_became_peered":"2023-11-28T20:02:25.811925+0000","last_unstale":"2023-11-28T20:02:25.818454+0000","last_undegraded":"2023-11-28T20:02:25.818454+0000","last_fullsized":"2023-11-28T20:02:25.818454+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:24.842435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:24.842435+0000","last_clean_scrub_stamp":"2023-11-28T20:02:24.842435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:46:10.962320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.5","version":"0'0","reported_seq":12,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-11-28T20:02:27.158448+0000","last_change":"2023-11-28T20:02:24.882248+0000","last_active":"2023-11-28T20:02:27.158448+0000","last_peered":"2023-11-28T20:02:27.158448+0000","last_clean":"2023-11-28T20:02:27.158448+0000","last_became_active":"2023-11-28T20:02:24.881980+0000","last_became_peered":"2023-11-28T20:02:24.881980+0000","last_unstale":"2023-11-28T20:02:27.158448+0000","last_undegraded":"2023-11-28T20:02:27.158448+0000","last_fullsized":"2023-11-28T20:02:27.158448+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:23.834083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:23.834083+0000","last_clean_scrub_stamp":"2023-11-28T20:02:23.834083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:28:03.020553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.4","version":"0'0","reported_seq":15,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-11-28T20:02:25.806579+0000","last_change":"2023-11-28T20:02:08.307858+0000","last_active":"2023-11-28T20:02:25.806579+0000","last_peered":"2023-11-28T20:02:25.806579+0000","last_clean":"2023-11-28T20:02:25.806579+0000","last_became_active":"2023-11-28T20:02:08.307550+0000","last_became_peered":"2023-11-28T20:02:08.307550+0000","last_unstale":"2023-11-28T20:02:25.806579+0000","last_undegraded":"2023-11-28T20:02:25.806579+0000","last_fullsized":"2023-11-28T20:02:25.806579+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_clean_scrub_stamp":"2023-11-28T20:02:07.264604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:18:14.885236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.7","version":"80'2","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-11-28T20:02:24.865157+0000","last_change":"2023-11-28T20:02:07.296980+0000","last_active":"2023-11-28T20:02:24.865157+0000","last_peered":"2023-11-28T20:02:24.865157+0000","last_clean":"2023-11-28T20:02:24.865157+0000","last_became_active":"2023-11-28T20:02:07.296625+0000","last_became_peered":"2023-11-28T20:02:07.296625+0000","last_unstale":"2023-11-28T20:02:24.865157+0000","last_undegraded":"2023-11-28T20:02:24.865157+0000","last_fullsized":"2023-11-28T20:02:24.865157+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:06.257335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:06.257335+0000","last_clean_scrub_stamp":"2023-11-28T20:02:06.257335+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:52:29.664838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.1b","version":"0'0","reported_seq":11,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-11-28T20:02:26.806449+0000","last_change":"2023-11-28T20:02:25.831395+0000","last_active":"2023-11-28T20:02:26.806449+0000","last_peered":"2023-11-28T20:02:26.806449+0000","last_clean":"2023-11-28T20:02:26.806449+0000","last_became_active":"2023-11-28T20:02:25.830984+0000","last_became_peered":"2023-11-28T20:02:25.830984+0000","last_unstale":"2023-11-28T20:02:26.806449+0000","last_undegraded":"2023-11-28T20:02:26.806449+0000","last_fullsized":"2023-11-28T20:02:26.806449+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:24.842435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:24.842435+0000","last_clean_scrub_stamp":"2023-11-28T20:02:24.842435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:54:35.374803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.4","version":"0'0","reported_seq":12,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-11-28T20:02:26.802414+0000","last_change":"2023-11-28T20:02:24.879435+0000","last_active":"2023-11-28T20:02:26.802414+0000","last_peered":"2023-11-28T20:02:26.802414+0000","last_clean":"2023-11-28T20:02:26.802414+0000","last_became_active":"2023-11-28T20:02:24.879129+0000","last_became_peered":"2023-11-28T20:02:24.879129+0000","last_unstale":"2023-11-28T20:02:26.802414+0000","last_undegraded":"2023-11-28T20:02:26.802414+0000","last_fullsized":"2023-11-28T20:02:26.802414+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:23.834083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:23.834083+0000","last_clean_scrub_stamp":"2023-11-28T20:02:23.834083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:28:03.020553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.5","version":"0'0","reported_seq":15,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-11-28T20:02:25.808428+0000","last_change":"2023-11-28T20:02:08.304794+0000","last_active":"2023-11-28T20:02:25.808428+0000","last_peered":"2023-11-28T20:02:25.808428+0000","last_clean":"2023-11-28T20:02:25.808428+0000","last_became_active":"2023-11-28T20:02:08.304425+0000","last_became_peered":"2023-11-28T20:02:08.304425+0000","last_unstale":"2023-11-28T20:02:25.808428+0000","last_undegraded":"2023-11-28T20:02:25.808428+0000","last_fullsized":"2023-11-28T20:02:25.808428+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_clean_scrub_stamp":"2023-11-28T20:02:07.264604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T06:13:44.850484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.6","version":"81'1","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-11-28T20:02:25.807309+0000","last_change":"2023-11-28T20:02:07.296643+0000","last_active":"2023-11-28T20:02:25.807309+0000","last_peered":"2023-11-28T20:02:25.807309+0000","last_clean":"2023-11-28T20:02:25.807309+0000","last_became_active":"2023-11-28T20:02:07.296369+0000","last_became_peered":"2023-11-28T20:02:07.296369+0000","last_unstale":"2023-11-28T20:02:25.807309+0000","last_undegraded":"2023-11-28T20:02:25.807309+0000","last_fullsized":"2023-11-28T20:02:25.807309+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:06.257335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:06.257335+0000","last_clean_scrub_stamp":"2023-11-28T20:02:06.257335+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:48:42.567546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.18","version":"0'0","reported_seq":11,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-11-28T20:02:27.355043+0000","last_change":"2023-11-28T20:02:25.812604+0000","last_active":"2023-11-28T20:02:27.355043+0000","last_peered":"2023-11-28T20:02:27.355043+0000","last_clean":"2023-11-28T20:02:27.355043+0000","last_became_active":"2023-11-28T20:02:25.812005+0000","last_became_peered":"2023-11-28T20:02:25.812005+0000","last_unstale":"2023-11-28T20:02:27.355043+0000","last_undegraded":"2023-11-28T20:02:27.355043+0000","last_fullsized":"2023-11-28T20:02:27.355043+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:24.842435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:24.842435+0000","last_clean_scrub_stamp":"2023-11-28T20:02:24.842435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:08:04.912044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.7","version":"84'2","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-11-28T20:02:26.802611+0000","last_change":"2023-11-28T20:02:24.885031+0000","last_active":"2023-11-28T20:02:26.802611+0000","last_peered":"2023-11-28T20:02:26.802611+0000","last_clean":"2023-11-28T20:02:26.802611+0000","last_became_active":"2023-11-28T20:02:24.884718+0000","last_became_peered":"2023-11-28T20:02:24.884718+0000","last_unstale":"2023-11-28T20:02:26.802611+0000","last_undegraded":"2023-11-28T20:02:26.802611+0000","last_fullsized":"2023-11-28T20:02:26.802611+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:23.834083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:23.834083+0000","last_clean_scrub_stamp":"2023-11-28T20:02:23.834083+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:38:09.148115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.6","version":"0'0","reported_seq":15,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-11-28T20:02:25.808126+0000","last_change":"2023-11-28T20:02:08.317251+0000","last_active":"2023-11-28T20:02:25.808126+0000","last_peered":"2023-11-28T20:02:25.808126+0000","last_clean":"2023-11-28T20:02:25.808126+0000","last_became_active":"2023-11-28T20:02:08.316870+0000","last_became_peered":"2023-11-28T20:02:08.316870+0000","last_unstale":"2023-11-28T20:02:25.808126+0000","last_undegraded":"2023-11-28T20:02:25.808126+0000","last_fullsized":"2023-11-28T20:02:25.808126+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_clean_scrub_stamp":"2023-11-28T20:02:07.264604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:15:09.805381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.5","version":"0'0","reported_seq":16,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-11-28T20:02:25.806047+0000","last_change":"2023-11-28T20:02:07.300054+0000","last_active":"2023-11-28T20:02:25.806047+0000","last_peered":"2023-11-28T20:02:25.806047+0000","last_clean":"2023-11-28T20:02:25.806047+0000","last_became_active":"2023-11-28T20:02:07.298610+0000","last_became_peered":"2023-11-28T20:02:07.298610+0000","last_unstale":"2023-11-28T20:02:25.806047+0000","last_undegraded":"2023-11-28T20:02:25.806047+0000","last_fullsized":"2023-11-28T20:02:25.806047+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:06.257335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:06.257335+0000","last_clean_scrub_stamp":"2023-11-28T20:02:06.257335+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:04:18.830964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.19","version":"0'0","reported_seq":11,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-11-28T20:02:26.805371+0000","last_change":"2023-11-28T20:02:25.818218+0000","last_active":"2023-11-28T20:02:26.805371+0000","last_peered":"2023-11-28T20:02:26.805371+0000","last_clean":"2023-11-28T20:02:26.805371+0000","last_became_active":"2023-11-28T20:02:25.817709+0000","last_became_peered":"2023-11-28T20:02:25.817709+0000","last_unstale":"2023-11-28T20:02:26.805371+0000","last_undegraded":"2023-11-28T20:02:26.805371+0000","last_fullsized":"2023-11-28T20:02:26.805371+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:24.842435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:24.842435+0000","last_clean_scrub_stamp":"2023-11-28T20:02:24.842435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:27:26.838145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.6","version":"85'1","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-11-28T20:02:27.359181+0000","last_change":"2023-11-28T20:02:24.883531+0000","last_active":"2023-11-28T20:02:27.359181+0000","last_peered":"2023-11-28T20:02:27.359181+0000","last_clean":"2023-11-28T20:02:27.359181+0000","last_became_active":"2023-11-28T20:02:24.882707+0000","last_became_peered":"2023-11-28T20:02:24.882707+0000","last_unstale":"2023-11-28T20:02:27.359181+0000","last_undegraded":"2023-11-28T20:02:27.359181+0000","last_fullsized":"2023-11-28T20:02:27.359181+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:23.834083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:23.834083+0000","last_clean_scrub_stamp":"2023-11-28T20:02:23.834083+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:26:08.433547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.7","version":"0'0","reported_seq":15,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-11-28T20:02:25.827347+0000","last_change":"2023-11-28T20:02:08.303184+0000","last_active":"2023-11-28T20:02:25.827347+0000","last_peered":"2023-11-28T20:02:25.827347+0000","last_clean":"2023-11-28T20:02:25.827347+0000","last_became_active":"2023-11-28T20:02:08.302908+0000","last_became_peered":"2023-11-28T20:02:08.302908+0000","last_unstale":"2023-11-28T20:02:25.827347+0000","last_undegraded":"2023-11-28T20:02:25.827347+0000","last_fullsized":"2023-11-28T20:02:25.827347+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_clean_scrub_stamp":"2023-11-28T20:02:07.264604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:46:20.521407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.4","version":"0'0","reported_seq":16,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-11-28T20:02:25.806843+0000","last_change":"2023-11-28T20:02:07.301572+0000","last_active":"2023-11-28T20:02:25.806843+0000","last_peered":"2023-11-28T20:02:25.806843+0000","last_clean":"2023-11-28T20:02:25.806843+0000","last_became_active":"2023-11-28T20:02:07.301226+0000","last_became_peered":"2023-11-28T20:02:07.301226+0000","last_unstale":"2023-11-28T20:02:25.806843+0000","last_undegraded":"2023-11-28T20:02:25.806843+0000","last_fullsized":"2023-11-28T20:02:25.806843+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:06.257335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:06.257335+0000","last_clean_scrub_stamp":"2023-11-28T20:02:06.257335+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:56:39.065924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.1e","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-11-28T20:02:25.835593+0000","last_change":"2023-11-28T20:02:25.831671+0000","last_active":"2023-11-28T20:02:25.835593+0000","last_peered":"2023-11-28T20:02:25.835593+0000","last_clean":"2023-11-28T20:02:25.835593+0000","last_became_active":"2023-11-28T20:02:25.831373+0000","last_became_peered":"2023-11-28T20:02:25.831373+0000","last_unstale":"2023-11-28T20:02:25.835593+0000","last_undegraded":"2023-11-28T20:02:25.835593+0000","last_fullsized":"2023-11-28T20:02:25.835593+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:24.842435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:24.842435+0000","last_clean_scrub_stamp":"2023-11-28T20:02:24.842435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:46:10.962320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.1","version":"0'0","reported_seq":12,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-11-28T20:02:27.157911+0000","last_change":"2023-11-28T20:02:24.880292+0000","last_active":"2023-11-28T20:02:27.157911+0000","last_peered":"2023-11-28T20:02:27.157911+0000","last_clean":"2023-11-28T20:02:27.157911+0000","last_became_active":"2023-11-28T20:02:24.880018+0000","last_became_peered":"2023-11-28T20:02:24.880018+0000","last_unstale":"2023-11-28T20:02:27.157911+0000","last_undegraded":"2023-11-28T20:02:27.157911+0000","last_fullsized":"2023-11-28T20:02:27.157911+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:23.834083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:23.834083+0000","last_clean_scrub_stamp":"2023-11-28T20:02:23.834083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T06:34:56.397003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.0","version":"0'0","reported_seq":14,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-11-28T20:02:24.870113+0000","last_change":"2023-11-28T20:02:08.307668+0000","last_active":"2023-11-28T20:02:24.870113+0000","last_peered":"2023-11-28T20:02:24.870113+0000","last_clean":"2023-11-28T20:02:24.870113+0000","last_became_active":"2023-11-28T20:02:08.307428+0000","last_became_peered":"2023-11-28T20:02:08.307428+0000","last_unstale":"2023-11-28T20:02:24.870113+0000","last_undegraded":"2023-11-28T20:02:24.870113+0000","last_fullsized":"2023-11-28T20:02:24.870113+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_clean_scrub_stamp":"2023-11-28T20:02:07.264604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T07:35:34.958615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.3","version":"0'0","reported_seq":16,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-11-28T20:02:25.807446+0000","last_change":"2023-11-28T20:02:07.294264+0000","last_active":"2023-11-28T20:02:25.807446+0000","last_peered":"2023-11-28T20:02:25.807446+0000","last_clean":"2023-11-28T20:02:25.807446+0000","last_became_active":"2023-11-28T20:02:07.293763+0000","last_became_peered":"2023-11-28T20:02:07.293763+0000","last_unstale":"2023-11-28T20:02:25.807446+0000","last_undegraded":"2023-11-28T20:02:25.807446+0000","last_fullsized":"2023-11-28T20:02:25.807446+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:06.257335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:06.257335+0000","last_clean_scrub_stamp":"2023-11-28T20:02:06.257335+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:41:06.265916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.1f","version":"0'0","reported_seq":11,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-11-28T20:02:26.807719+0000","last_change":"2023-11-28T20:02:25.830630+0000","last_active":"2023-11-28T20:02:26.807719+0000","last_peered":"2023-11-28T20:02:26.807719+0000","last_clean":"2023-11-28T20:02:26.807719+0000","last_became_active":"2023-11-28T20:02:25.830205+0000","last_became_peered":"2023-11-28T20:02:25.830205+0000","last_unstale":"2023-11-28T20:02:26.807719+0000","last_undegraded":"2023-11-28T20:02:26.807719+0000","last_fullsized":"2023-11-28T20:02:26.807719+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:24.842435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:24.842435+0000","last_clean_scrub_stamp":"2023-11-28T20:02:24.842435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T06:34:10.812327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.0","version":"0'0","reported_seq":11,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-11-28T20:02:25.799936+0000","last_change":"2023-11-28T20:02:24.880369+0000","last_active":"2023-11-28T20:02:25.799936+0000","last_peered":"2023-11-28T20:02:25.799936+0000","last_clean":"2023-11-28T20:02:25.799936+0000","last_became_active":"2023-11-28T20:02:24.880044+0000","last_became_peered":"2023-11-28T20:02:24.880044+0000","last_unstale":"2023-11-28T20:02:25.799936+0000","last_undegraded":"2023-11-28T20:02:25.799936+0000","last_fullsized":"2023-11-28T20:02:25.799936+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:23.834083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:23.834083+0000","last_clean_scrub_stamp":"2023-11-28T20:02:23.834083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:20:22.297564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.1","version":"0'0","reported_seq":14,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-11-28T20:02:24.855473+0000","last_change":"2023-11-28T20:02:08.294339+0000","last_active":"2023-11-28T20:02:24.855473+0000","last_peered":"2023-11-28T20:02:24.855473+0000","last_clean":"2023-11-28T20:02:24.855473+0000","last_became_active":"2023-11-28T20:02:08.294058+0000","last_became_peered":"2023-11-28T20:02:08.294058+0000","last_unstale":"2023-11-28T20:02:24.855473+0000","last_undegraded":"2023-11-28T20:02:24.855473+0000","last_fullsized":"2023-11-28T20:02:24.855473+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_clean_scrub_stamp":"2023-11-28T20:02:07.264604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:18:08.456550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.2","version":"0'0","reported_seq":16,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-11-28T20:02:25.823792+0000","last_change":"2023-11-28T20:02:07.299946+0000","last_active":"2023-11-28T20:02:25.823792+0000","last_peered":"2023-11-28T20:02:25.823792+0000","last_clean":"2023-11-28T20:02:25.823792+0000","last_became_active":"2023-11-28T20:02:07.299678+0000","last_became_peered":"2023-11-28T20:02:07.299678+0000","last_unstale":"2023-11-28T20:02:25.823792+0000","last_undegraded":"2023-11-28T20:02:25.823792+0000","last_fullsized":"2023-11-28T20:02:25.823792+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:06.257335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:06.257335+0000","last_clean_scrub_stamp":"2023-11-28T20:02:06.257335+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:33:11.673633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.1c","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-11-28T20:02:25.828269+0000","last_change":"2023-11-28T20:02:25.821176+0000","last_active":"2023-11-28T20:02:25.828269+0000","last_peered":"2023-11-28T20:02:25.828269+0000","last_clean":"2023-11-28T20:02:25.828269+0000","last_became_active":"2023-11-28T20:02:25.820761+0000","last_became_peered":"2023-11-28T20:02:25.820761+0000","last_unstale":"2023-11-28T20:02:25.828269+0000","last_undegraded":"2023-11-28T20:02:25.828269+0000","last_fullsized":"2023-11-28T20:02:25.828269+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:24.842435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:24.842435+0000","last_clean_scrub_stamp":"2023-11-28T20:02:24.842435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:40:35.020886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.3","version":"0'0","reported_seq":12,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-11-28T20:02:26.806423+0000","last_change":"2023-11-28T20:02:24.879586+0000","last_active":"2023-11-28T20:02:26.806423+0000","last_peered":"2023-11-28T20:02:26.806423+0000","last_clean":"2023-11-28T20:02:26.806423+0000","last_became_active":"2023-11-28T20:02:24.879214+0000","last_became_peered":"2023-11-28T20:02:24.879214+0000","last_unstale":"2023-11-28T20:02:26.806423+0000","last_undegraded":"2023-11-28T20:02:26.806423+0000","last_fullsized":"2023-11-28T20:02:26.806423+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:23.834083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:23.834083+0000","last_clean_scrub_stamp":"2023-11-28T20:02:23.834083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:52:47.241586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.2","version":"0'0","reported_seq":15,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-11-28T20:02:25.805325+0000","last_change":"2023-11-28T20:02:08.309044+0000","last_active":"2023-11-28T20:02:25.805325+0000","last_peered":"2023-11-28T20:02:25.805325+0000","last_clean":"2023-11-28T20:02:25.805325+0000","last_became_active":"2023-11-28T20:02:08.308771+0000","last_became_peered":"2023-11-28T20:02:08.308771+0000","last_unstale":"2023-11-28T20:02:25.805325+0000","last_undegraded":"2023-11-28T20:02:25.805325+0000","last_fullsized":"2023-11-28T20:02:25.805325+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_clean_scrub_stamp":"2023-11-28T20:02:07.264604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:58:52.570056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1","version":"0'0","reported_seq":16,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-11-28T20:02:25.804122+0000","last_change":"2023-11-28T20:02:07.297766+0000","last_active":"2023-11-28T20:02:25.804122+0000","last_peered":"2023-11-28T20:02:25.804122+0000","last_clean":"2023-11-28T20:02:25.804122+0000","last_became_active":"2023-11-28T20:02:07.297403+0000","last_became_peered":"2023-11-28T20:02:07.297403+0000","last_unstale":"2023-11-28T20:02:25.804122+0000","last_undegraded":"2023-11-28T20:02:25.804122+0000","last_fullsized":"2023-11-28T20:02:25.804122+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:06.257335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:06.257335+0000","last_clean_scrub_stamp":"2023-11-28T20:02:06.257335+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:48:19.801940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.1d","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-11-28T20:02:25.828353+0000","last_change":"2023-11-28T20:02:25.820721+0000","last_active":"2023-11-28T20:02:25.828353+0000","last_peered":"2023-11-28T20:02:25.828353+0000","last_clean":"2023-11-28T20:02:25.828353+0000","last_became_active":"2023-11-28T20:02:25.820120+0000","last_became_peered":"2023-11-28T20:02:25.820120+0000","last_unstale":"2023-11-28T20:02:25.828353+0000","last_undegraded":"2023-11-28T20:02:25.828353+0000","last_fullsized":"2023-11-28T20:02:25.828353+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:24.842435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:24.842435+0000","last_clean_scrub_stamp":"2023-11-28T20:02:24.842435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T07:19:17.195657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.2","version":"0'0","reported_seq":11,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-11-28T20:02:25.799985+0000","last_change":"2023-11-28T20:02:24.880316+0000","last_active":"2023-11-28T20:02:25.799985+0000","last_peered":"2023-11-28T20:02:25.799985+0000","last_clean":"2023-11-28T20:02:25.799985+0000","last_became_active":"2023-11-28T20:02:24.880042+0000","last_became_peered":"2023-11-28T20:02:24.880042+0000","last_unstale":"2023-11-28T20:02:25.799985+0000","last_undegraded":"2023-11-28T20:02:25.799985+0000","last_fullsized":"2023-11-28T20:02:25.799985+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:23.834083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:23.834083+0000","last_clean_scrub_stamp":"2023-11-28T20:02:23.834083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:56:38.481864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.3","version":"0'0","reported_seq":15,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-11-28T20:02:25.807356+0000","last_change":"2023-11-28T20:02:08.303952+0000","last_active":"2023-11-28T20:02:25.807356+0000","last_peered":"2023-11-28T20:02:25.807356+0000","last_clean":"2023-11-28T20:02:25.807356+0000","last_became_active":"2023-11-28T20:02:08.303673+0000","last_became_peered":"2023-11-28T20:02:08.303673+0000","last_unstale":"2023-11-28T20:02:25.807356+0000","last_undegraded":"2023-11-28T20:02:25.807356+0000","last_fullsized":"2023-11-28T20:02:25.807356+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_clean_scrub_stamp":"2023-11-28T20:02:07.264604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:54:17.796972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.0","version":"0'0","reported_seq":15,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-11-28T20:02:24.864324+0000","last_change":"2023-11-28T20:02:07.300917+0000","last_active":"2023-11-28T20:02:24.864324+0000","last_peered":"2023-11-28T20:02:24.864324+0000","last_clean":"2023-11-28T20:02:24.864324+0000","last_became_active":"2023-11-28T20:02:07.300632+0000","last_became_peered":"2023-11-28T20:02:07.300632+0000","last_unstale":"2023-11-28T20:02:24.864324+0000","last_undegraded":"2023-11-28T20:02:24.864324+0000","last_fullsized":"2023-11-28T20:02:24.864324+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:06.257335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:06.257335+0000","last_clean_scrub_stamp":"2023-11-28T20:02:06.257335+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:54:32.151264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.11","version":"0'0","reported_seq":11,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-11-28T20:02:26.805381+0000","last_change":"2023-11-28T20:02:25.824685+0000","last_active":"2023-11-28T20:02:26.805381+0000","last_peered":"2023-11-28T20:02:26.805381+0000","last_clean":"2023-11-28T20:02:26.805381+0000","last_became_active":"2023-11-28T20:02:25.824372+0000","last_became_peered":"2023-11-28T20:02:25.824372+0000","last_unstale":"2023-11-28T20:02:26.805381+0000","last_undegraded":"2023-11-28T20:02:26.805381+0000","last_fullsized":"2023-11-28T20:02:26.805381+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:24.842435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:24.842435+0000","last_clean_scrub_stamp":"2023-11-28T20:02:24.842435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:38:10.156467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.e","version":"84'2","reported_seq":13,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-11-28T20:02:25.867667+0000","last_change":"2023-11-28T20:02:24.878855+0000","last_active":"2023-11-28T20:02:25.867667+0000","last_peered":"2023-11-28T20:02:25.867667+0000","last_clean":"2023-11-28T20:02:25.867667+0000","last_became_active":"2023-11-28T20:02:24.878601+0000","last_became_peered":"2023-11-28T20:02:24.878601+0000","last_unstale":"2023-11-28T20:02:25.867667+0000","last_undegraded":"2023-11-28T20:02:25.867667+0000","last_fullsized":"2023-11-28T20:02:25.867667+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:23.834083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:23.834083+0000","last_clean_scrub_stamp":"2023-11-28T20:02:23.834083+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:04:36.407712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.f","version":"0'0","reported_seq":14,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-11-28T20:02:24.864975+0000","last_change":"2023-11-28T20:02:08.297920+0000","last_active":"2023-11-28T20:02:24.864975+0000","last_peered":"2023-11-28T20:02:24.864975+0000","last_clean":"2023-11-28T20:02:24.864975+0000","last_became_active":"2023-11-28T20:02:08.297638+0000","last_became_peered":"2023-11-28T20:02:08.297638+0000","last_unstale":"2023-11-28T20:02:24.864975+0000","last_undegraded":"2023-11-28T20:02:24.864975+0000","last_fullsized":"2023-11-28T20:02:24.864975+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:07.264604+0000","last_clean_scrub_stamp":"2023-11-28T20:02:07.264604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:18:08.456550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.c","version":"0'0","reported_seq":16,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-11-28T20:02:25.816572+0000","last_change":"2023-11-28T20:02:07.293843+0000","last_active":"2023-11-28T20:02:25.816572+0000","last_peered":"2023-11-28T20:02:25.816572+0000","last_clean":"2023-11-28T20:02:25.816572+0000","last_became_active":"2023-11-28T20:02:07.293538+0000","last_became_peered":"2023-11-28T20:02:07.293538+0000","last_unstale":"2023-11-28T20:02:25.816572+0000","last_undegraded":"2023-11-28T20:02:25.816572+0000","last_fullsized":"2023-11-28T20:02:25.816572+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:02:06.257335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:02:06.257335+0000","last_clean_scrub_stamp":"2023-11-28T20:02:06.257335+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:58:51.562787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":220,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-11-28T20:02:24.864410+0000","last_change":"2023-11-28T19:58:56.136501+0000","last_active":"2023-11-28T20:02:24.864410+0000","last_peered":"2023-11-28T20:02:24.864410+0000","last_clean":"2023-11-28T20:02:24.864410+0000","last_became_active":"2023-11-28T19:58:56.135998+0000","last_became_peered":"2023-11-28T19:58:56.135998+0000","last_unstale":"2023-11-28T20:02:24.864410+0000","last_undegraded":"2023-11-28T20:02:24.864410+0000","last_fullsized":"2023-11-28T20:02:24.864410+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:58:54.602349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:58:54.602349+0000","last_clean_scrub_stamp":"2023-11-28T19:58:54.602349+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:33:42.723349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":16,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":15,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":13,"num_pg":32,"stat_sum":{"num_bytes":3905,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":47,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":7810,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":41,"ondisk_log_size":41,"up":64,"acting":64,"num_store_stats":8},{"poolid":14,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":66748,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574895,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32280,"kb_used_data":1092,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339560,"statfs":{"total":96636764160,"available":96603709440,"internally_reserved":0,"allocated":1118208,"data_stored":1082529,"data_compressed":33374,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 20:01:59 2023","interfaces":[{"interface":"back","average":{"1min":0.66000000000000003,"5min":0.67100000000000004,"15min":0.67600000000000005},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.94299999999999995,"5min":0.94299999999999995,"15min":0.94299999999999995},"last":0.45500000000000002},{"interface":"front","average":{"1min":0.66500000000000004,"5min":0.67000000000000004,"15min":0.68000000000000005},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":1.014,"5min":1.014,"15min":1.014},"last":0.66600000000000004}]},{"osd":1,"last update":"Tue Nov 28 20:01:59 2023","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.63900000000000001,"15min":0.64300000000000002},"min":{"1min":0.46100000000000002,"5min":0.438,"15min":0.438},"max":{"1min":0.95099999999999996,"5min":0.95099999999999996,"15min":0.95099999999999996},"last":0.60399999999999998},{"interface":"front","average":{"1min":0.66400000000000003,"5min":0.68100000000000005,"15min":0.69499999999999995},"min":{"1min":0.45600000000000002,"5min":0.432,"15min":0.432},"max":{"1min":0.85099999999999998,"5min":1.0900000000000001,"15min":1.0900000000000001},"last":0.63800000000000001}]},{"osd":2,"last update":"Tue Nov 28 20:01:59 2023","interfaces":[{"interface":"back","average":{"1min":0.69899999999999995,"5min":0.70899999999999996,"15min":0.72599999999999998},"min":{"1min":0.497,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.93100000000000005,"5min":0.98799999999999999,"15min":0.98799999999999999},"last":0.72599999999999998},{"interface":"front","average":{"1min":0.66800000000000004,"5min":0.68799999999999994,"15min":0.69999999999999996},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":1.514,"5min":1.514,"15min":1.514},"last":0.51000000000000001}]},{"osd":3,"last update":"Tue Nov 28 20:01:59 2023","interfaces":[{"interface":"back","average":{"1min":0.68200000000000005,"5min":0.69699999999999995,"15min":0.69899999999999995},"min":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":0.90200000000000002,"5min":1.0449999999999999,"15min":1.0449999999999999},"last":0.53800000000000003},{"interface":"front","average":{"1min":0.70899999999999996,"5min":0.76600000000000001,"15min":0.78400000000000003},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":1.034,"5min":1.1299999999999999,"15min":1.1299999999999999},"last":0.79400000000000004}]},{"osd":4,"last update":"Tue Nov 28 20:01:59 2023","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.628,"15min":0.63700000000000001},"min":{"1min":0.38900000000000001,"5min":0.378,"15min":0.378},"max":{"1min":1.2829999999999999,"5min":1.2829999999999999,"15min":1.2829999999999999},"last":0.61699999999999999},{"interface":"front","average":{"1min":0.66800000000000004,"5min":0.70899999999999996,"15min":0.72499999999999998},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.91800000000000004,"5min":1.1120000000000001,"15min":1.1120000000000001},"last":0.68700000000000006}]},{"osd":5,"last update":"Tue Nov 28 20:01:59 2023","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.65300000000000002,"15min":0.67400000000000004},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.97999999999999998,"5min":1.1699999999999999,"15min":1.1699999999999999},"last":0.82999999999999996},{"interface":"front","average":{"1min":0.70899999999999996,"5min":0.73699999999999999,"15min":0.75600000000000001},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":1.3300000000000001,"5min":1.3300000000000001,"15min":1.3300000000000001},"last":0.70799999999999996}]},{"osd":6,"last update":"Tue Nov 28 20:01:59 2023","interfaces":[{"interface":"back","average":{"1min":0.76000000000000001,"5min":0.76400000000000001,"15min":0.77600000000000002},"min":{"1min":0.53500000000000003,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":1.3919999999999999,"5min":1.3919999999999999,"15min":1.3919999999999999},"last":0.77400000000000002},{"interface":"front","average":{"1min":0.67000000000000004,"5min":0.71199999999999997,"15min":0.73499999999999999},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.96099999999999997,"5min":1.23,"15min":1.23},"last":0.745}]}]},{"osd":6,"up_from":13,"seq":55834574893,"num_pgs":50,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32244,"kb_used_data":1064,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339596,"statfs":{"total":96636764160,"available":96603746304,"internally_reserved":0,"allocated":1089536,"data_stored":505349,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 20:01:54 2023","interfaces":[{"interface":"back","average":{"1min":0.64000000000000001,"5min":0.621,"15min":0.61699999999999999},"min":{"1min":0.40200000000000002,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.91600000000000004,"5min":0.91600000000000004,"15min":0.91600000000000004},"last":0.623},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.66000000000000003,"15min":0.66200000000000003},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":0.80600000000000005,"5min":0.98999999999999999,"15min":0.98999999999999999},"last":0.56799999999999995}]},{"osd":1,"last update":"Tue Nov 28 20:01:54 2023","interfaces":[{"interface":"back","average":{"1min":0.71499999999999997,"5min":0.76600000000000001,"15min":0.78200000000000003},"min":{"1min":0.54700000000000004,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.012,"5min":1.105,"15min":1.105},"last":0.67700000000000005},{"interface":"front","average":{"1min":0.62,"5min":0.67600000000000005,"15min":0.68300000000000005},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":0.90200000000000002,"5min":0.95899999999999996,"15min":0.95899999999999996},"last":0.73899999999999999}]},{"osd":2,"last update":"Tue Nov 28 20:01:54 2023","interfaces":[{"interface":"back","average":{"1min":0.63800000000000001,"5min":0.68200000000000005,"15min":0.69399999999999995},"min":{"1min":0.502,"5min":0.502,"15min":0.502},"max":{"1min":0.78900000000000003,"5min":0.93400000000000005,"15min":0.93400000000000005},"last":0.81000000000000005},{"interface":"front","average":{"1min":0.65800000000000003,"5min":0.70399999999999996,"15min":0.71399999999999997},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":0.95299999999999996,"5min":1.006,"15min":1.006},"last":0.83299999999999996}]},{"osd":3,"last update":"Tue Nov 28 20:01:54 2023","interfaces":[{"interface":"back","average":{"1min":0.68300000000000005,"5min":0.72799999999999998,"15min":0.74199999999999999},"min":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":0.96699999999999997,"5min":1.056,"15min":1.056},"last":0.71299999999999997},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.66600000000000004,"15min":0.67800000000000005},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":0.78200000000000003,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.87}]},{"osd":4,"last update":"Tue Nov 28 20:01:54 2023","interfaces":[{"interface":"back","average":{"1min":0.61299999999999999,"5min":0.624,"15min":0.628},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.93300000000000005,"5min":0.97599999999999998,"15min":0.97599999999999998},"last":0.69699999999999995},{"interface":"front","average":{"1min":0.61499999999999999,"5min":0.68700000000000006,"15min":0.72099999999999997},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.91700000000000004,"5min":1.389,"15min":1.389},"last":0.77200000000000002}]},{"osd":5,"last update":"Tue Nov 28 20:01:54 2023","interfaces":[{"interface":"back","average":{"1min":0.68799999999999994,"5min":0.77100000000000002,"15min":0.80100000000000005},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":1.0629999999999999,"5min":1.4259999999999999,"15min":1.4259999999999999},"last":0.95499999999999996},{"interface":"front","average":{"1min":0.65600000000000003,"5min":0.72999999999999998,"15min":0.752},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.97099999999999997,"5min":1.276,"15min":1.276},"last":0.65700000000000003}]},{"osd":7,"last update":"Tue Nov 28 20:01:54 2023","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.67900000000000005,"15min":0.70299999999999996},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.84199999999999997,"5min":1.014,"15min":1.014},"last":0.90300000000000002},{"interface":"front","average":{"1min":0.68200000000000005,"5min":0.77900000000000003,"15min":0.81299999999999994},"min":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":1.002,"5min":1.242,"15min":1.242},"last":0.60099999999999998}]}]},{"osd":5,"up_from":13,"seq":55834574895,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32212,"kb_used_data":1024,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339628,"statfs":{"total":96636764160,"available":96603779072,"internally_reserved":0,"allocated":1048576,"data_stored":499422,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 20:01:59 2023","interfaces":[{"interface":"back","average":{"1min":0.66500000000000004,"5min":0.68400000000000005,"15min":0.70099999999999996},"min":{"1min":0.44400000000000001,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":1.077,"5min":1.077,"15min":1.077},"last":0.72599999999999998},{"interface":"front","average":{"1min":0.65300000000000002,"5min":0.68500000000000005,"15min":0.70699999999999996},"min":{"1min":0.41899999999999998,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.94599999999999995,"5min":1.149,"15min":1.149},"last":0.66200000000000003}]},{"osd":1,"last update":"Tue Nov 28 20:01:59 2023","interfaces":[{"interface":"back","average":{"1min":0.626,"5min":0.68600000000000005,"15min":0.70399999999999996},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.82599999999999996,"5min":0.94499999999999995,"15min":0.94499999999999995},"last":0.82299999999999995},{"interface":"front","average":{"1min":0.67400000000000004,"5min":0.69299999999999995,"15min":0.71699999999999997},"min":{"1min":0.49099999999999999,"5min":0.38,"15min":0.38},"max":{"1min":1.008,"5min":1.0940000000000001,"15min":1.0940000000000001},"last":0.63100000000000001}]},{"osd":2,"last update":"Tue Nov 28 20:01:59 2023","interfaces":[{"interface":"back","average":{"1min":0.65400000000000003,"5min":0.83299999999999996,"15min":0.90800000000000003},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":1.044,"5min":5.0880000000000001,"15min":5.0880000000000001},"last":0.70499999999999996},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.879,"15min":0.96099999999999997},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":0.91300000000000003,"5min":5.1399999999999997,"15min":5.1399999999999997},"last":0.74299999999999999}]},{"osd":3,"last update":"Tue Nov 28 20:01:59 2023","interfaces":[{"interface":"back","average":{"1min":0.71499999999999997,"5min":0.90100000000000002,"15min":0.98499999999999999},"min":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":1.1000000000000001,"5min":5.0469999999999997,"15min":5.0469999999999997},"last":0.80400000000000005},{"interface":"front","average":{"1min":0.69999999999999996,"5min":0.878,"15min":0.95999999999999996},"min":{"1min":0.47899999999999998,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":0.95899999999999996,"5min":5.024,"15min":5.024},"last":0.57099999999999995}]},{"osd":4,"last update":"Tue Nov 28 20:01:59 2023","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.64000000000000001,"15min":0.66400000000000003},"min":{"1min":0.42899999999999999,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.877,"5min":1.4810000000000001,"15min":1.4810000000000001},"last":0.68600000000000005},{"interface":"front","average":{"1min":0.67300000000000004,"5min":0.72099999999999997,"15min":0.73799999999999999},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.97599999999999998,"5min":1.6339999999999999,"15min":1.6339999999999999},"last":0.501}]},{"osd":6,"last update":"Tue Nov 28 20:01:59 2023","interfaces":[{"interface":"back","average":{"1min":0.70699999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"min":{"1min":0.48399999999999999,"5min":0.434,"15min":0.434},"max":{"1min":1.0489999999999999,"5min":1.0489999999999999,"15min":1.0489999999999999},"last":0.64500000000000002},{"interface":"front","average":{"1min":0.68899999999999995,"5min":0.72499999999999998,"15min":0.73999999999999999},"min":{"1min":0.47599999999999998,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":0.93200000000000005,"5min":1.099,"15min":1.099},"last":0.77000000000000002}]},{"osd":7,"last update":"Tue Nov 28 20:01:59 2023","interfaces":[{"interface":"back","average":{"1min":0.73599999999999999,"5min":0.77300000000000002,"15min":0.78200000000000003},"min":{"1min":0.48899999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":1.022,"5min":1.236,"15min":1.236},"last":0.59299999999999997},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.78300000000000003,"15min":0.79500000000000004},"min":{"1min":0.51100000000000001,"5min":0.505,"15min":0.505},"max":{"1min":1.1000000000000001,"5min":1.1000000000000001,"15min":1.1000000000000001},"last":0.78500000000000003}]}]},{"osd":4,"up_from":13,"seq":55834574894,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32232,"kb_used_data":1040,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339608,"statfs":{"total":96636764160,"available":96603758592,"internally_reserved":0,"allocated":1064960,"data_stored":499674,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 20:01:58 2023","interfaces":[{"interface":"back","average":{"1min":0.70799999999999996,"5min":0.69399999999999995,"15min":0.70499999999999996},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":1.107,"5min":1.107,"15min":1.107},"last":0.66400000000000003},{"interface":"front","average":{"1min":0.63200000000000001,"5min":0.68300000000000005,"15min":0.70299999999999996},"min":{"1min":0.42799999999999999,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":1.024,"5min":1.163,"15min":1.163},"last":0.54000000000000004}]},{"osd":1,"last update":"Tue Nov 28 20:01:58 2023","interfaces":[{"interface":"back","average":{"1min":0.64400000000000002,"5min":0.71199999999999997,"15min":0.746},"min":{"1min":0.432,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.93799999999999994,"5min":1.111,"15min":1.111},"last":0.76100000000000001},{"interface":"front","average":{"1min":0.77600000000000002,"5min":0.78000000000000003,"15min":0.80200000000000005},"min":{"1min":0.629,"5min":0.443,"15min":0.443},"max":{"1min":1.0640000000000001,"5min":1.238,"15min":1.238},"last":0.78600000000000003}]},{"osd":2,"last update":"Tue Nov 28 20:01:58 2023","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.751,"15min":0.77200000000000002},"min":{"1min":0.48599999999999999,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":1.026,"5min":1.0669999999999999,"15min":1.0669999999999999},"last":0.69399999999999995},{"interface":"front","average":{"1min":0.754,"5min":0.77400000000000002,"15min":0.80200000000000005},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":1.1359999999999999,"5min":1.1359999999999999,"15min":1.1359999999999999},"last":0.84199999999999997}]},{"osd":3,"last update":"Tue Nov 28 20:01:58 2023","interfaces":[{"interface":"back","average":{"1min":0.69199999999999995,"5min":0.74399999999999999,"15min":0.78200000000000003},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":0.97999999999999998,"5min":1.202,"15min":1.202},"last":0.64500000000000002},{"interface":"front","average":{"1min":0.74199999999999999,"5min":0.76100000000000001,"15min":0.78400000000000003},"min":{"1min":0.52800000000000002,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":1.0669999999999999,"5min":1.0669999999999999,"15min":1.0669999999999999},"last":0.61799999999999999}]},{"osd":5,"last update":"Tue Nov 28 20:01:58 2023","interfaces":[{"interface":"back","average":{"1min":0.68600000000000005,"5min":0.69499999999999995,"15min":0.71399999999999997},"min":{"1min":0.41199999999999998,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.89600000000000002,"5min":0.95899999999999996,"15min":0.95899999999999996},"last":0.74299999999999999},{"interface":"front","average":{"1min":0.65600000000000003,"5min":0.68400000000000005,"15min":0.70399999999999996},"min":{"1min":0.435,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.90500000000000003,"5min":1.034,"15min":1.034},"last":0.71599999999999997}]},{"osd":6,"last update":"Tue Nov 28 20:01:58 2023","interfaces":[{"interface":"back","average":{"1min":0.64500000000000002,"5min":0.69099999999999995,"15min":0.71999999999999997},"min":{"1min":0.45300000000000001,"5min":0.438,"15min":0.438},"max":{"1min":0.85299999999999998,"5min":1.0309999999999999,"15min":1.0309999999999999},"last":0.72999999999999998},{"interface":"front","average":{"1min":0.76300000000000001,"5min":0.76600000000000001,"15min":0.77800000000000002},"min":{"1min":0.55400000000000005,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":0.93999999999999995,"5min":1.002,"15min":1.002},"last":0.81499999999999995}]},{"osd":7,"last update":"Tue Nov 28 20:01:58 2023","interfaces":[{"interface":"back","average":{"1min":0.72699999999999998,"5min":0.75900000000000001,"15min":0.77800000000000002},"min":{"1min":0.57399999999999995,"5min":0.495,"15min":0.495},"max":{"1min":1.089,"5min":1.089,"15min":1.089},"last":0.77500000000000002},{"interface":"front","average":{"1min":0.81599999999999995,"5min":0.83699999999999997,"15min":0.85899999999999999},"min":{"1min":0.621,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":1.042,"5min":1.1459999999999999,"15min":1.1459999999999999},"last":0.80200000000000005}]}]},{"osd":3,"up_from":13,"seq":55834574895,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32200,"kb_used_data":1016,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339640,"statfs":{"total":96636764160,"available":96603791360,"internally_reserved":0,"allocated":1040384,"data_stored":492527,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 20:01:56 2023","interfaces":[{"interface":"back","average":{"1min":0.44900000000000001,"5min":0.441,"15min":0.44500000000000001},"min":{"1min":0.26300000000000001,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":1.7130000000000001,"5min":1.7130000000000001,"15min":1.7130000000000001},"last":0.38500000000000001},{"interface":"front","average":{"1min":0.51400000000000001,"5min":0.46600000000000003,"15min":0.47099999999999997},"min":{"1min":0.27100000000000002,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":3.0630000000000002,"5min":3.0630000000000002,"15min":3.0630000000000002},"last":0.503}]},{"osd":1,"last update":"Tue Nov 28 20:01:56 2023","interfaces":[{"interface":"back","average":{"1min":0.44600000000000001,"5min":0.45800000000000002,"15min":0.47399999999999998},"min":{"1min":0.317,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.89200000000000002,"5min":0.89200000000000002,"15min":0.89200000000000002},"last":0.32900000000000001},{"interface":"front","average":{"1min":0.65600000000000003,"5min":0.52200000000000002,"15min":0.51000000000000001},"min":{"1min":0.34200000000000003,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":5.8920000000000003,"5min":5.8920000000000003,"15min":5.8920000000000003},"last":0.66700000000000004}]},{"osd":2,"last update":"Tue Nov 28 20:01:56 2023","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.54800000000000004,"15min":0.53800000000000003},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":4.6390000000000002,"5min":4.6390000000000002,"15min":4.6390000000000002},"last":0.54400000000000004},{"interface":"front","average":{"1min":0.95099999999999996,"5min":0.63900000000000001,"15min":0.60299999999999998},"min":{"1min":0.40899999999999997,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":11.593,"5min":11.593,"15min":11.593},"last":0.46800000000000003}]},{"osd":4,"last update":"Tue Nov 28 20:01:56 2023","interfaces":[{"interface":"back","average":{"1min":0.91100000000000003,"5min":0.79400000000000004,"15min":0.77200000000000002},"min":{"1min":0.46600000000000003,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":5.5549999999999997,"5min":5.5549999999999997,"15min":5.5549999999999997},"last":0.63300000000000001},{"interface":"front","average":{"1min":1.179,"5min":0.879,"15min":0.82799999999999996},"min":{"1min":0.60999999999999999,"5min":0.503,"15min":0.503},"max":{"1min":11.747,"5min":11.747,"15min":11.747},"last":0.60999999999999999}]},{"osd":5,"last update":"Tue Nov 28 20:01:56 2023","interfaces":[{"interface":"back","average":{"1min":1.1040000000000001,"5min":0.85699999999999998,"15min":0.81899999999999995},"min":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":11.705,"5min":11.705,"15min":11.705},"last":0.52600000000000002},{"interface":"front","average":{"1min":0.70399999999999996,"5min":0.77100000000000002,"15min":0.79200000000000004},"min":{"1min":0.51200000000000001,"5min":0.495,"15min":0.495},"max":{"1min":1.0580000000000001,"5min":1.3100000000000001,"15min":1.3100000000000001},"last":0.69599999999999995}]},{"osd":6,"last update":"Tue Nov 28 20:01:56 2023","interfaces":[{"interface":"back","average":{"1min":0.748,"5min":0.81899999999999995,"15min":0.83499999999999996},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":1.6639999999999999,"5min":1.6639999999999999,"15min":1.6639999999999999},"last":0.72399999999999998},{"interface":"front","average":{"1min":0.84499999999999997,"5min":0.80400000000000005,"15min":0.76700000000000002},"min":{"1min":0.52900000000000003,"5min":0.495,"15min":0.495},"max":{"1min":3.1459999999999999,"5min":4.0679999999999996,"15min":4.0679999999999996},"last":0.82099999999999995}]},{"osd":7,"last update":"Tue Nov 28 20:01:56 2023","interfaces":[{"interface":"back","average":{"1min":0.96199999999999997,"5min":0.89600000000000002,"15min":0.86499999999999999},"min":{"1min":0.52100000000000002,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":6.6619999999999999,"5min":6.6619999999999999,"15min":6.6619999999999999},"last":0.78000000000000003},{"interface":"front","average":{"1min":1.141,"5min":0.92300000000000004,"15min":0.90100000000000002},"min":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":11.782,"5min":11.782,"15min":11.782},"last":0.57399999999999995}]}]},{"osd":2,"up_from":13,"seq":55834574893,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32200,"kb_used_data":1016,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339640,"statfs":{"total":96636764160,"available":96603791360,"internally_reserved":0,"allocated":1040384,"data_stored":491979,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 20:01:57 2023","interfaces":[{"interface":"back","average":{"1min":0.39600000000000002,"5min":0.438,"15min":0.45000000000000001},"min":{"1min":0.28899999999999998,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.60399999999999998,"5min":0.74099999999999999,"15min":0.74099999999999999},"last":0.32500000000000001},{"interface":"front","average":{"1min":0.435,"5min":0.46100000000000002,"15min":0.47499999999999998},"min":{"1min":0.30199999999999999,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.59599999999999997,"5min":0.67700000000000005,"15min":0.67700000000000005},"last":0.27300000000000002}]},{"osd":1,"last update":"Tue Nov 28 20:01:57 2023","interfaces":[{"interface":"back","average":{"1min":0.47699999999999998,"5min":0.48999999999999999,"15min":0.50600000000000001},"min":{"1min":0.377,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.64500000000000002,"5min":1.0389999999999999,"15min":1.0389999999999999},"last":0.35899999999999999},{"interface":"front","average":{"1min":0.45100000000000001,"5min":0.47999999999999998,"15min":0.496},"min":{"1min":0.33800000000000002,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.58999999999999997,"5min":0.70999999999999996,"15min":0.70999999999999996},"last":0.28899999999999998}]},{"osd":3,"last update":"Tue Nov 28 20:01:57 2023","interfaces":[{"interface":"back","average":{"1min":0.45700000000000002,"5min":0.46300000000000002,"15min":0.46899999999999997},"min":{"1min":0.36899999999999999,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.60299999999999998,"5min":0.629,"15min":0.629},"last":0.45500000000000002},{"interface":"front","average":{"1min":0.52300000000000002,"5min":0.55900000000000005,"15min":0.58099999999999996},"min":{"1min":0.41599999999999998,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.58899999999999997,"5min":0.98499999999999999,"15min":0.98499999999999999},"last":0.39800000000000002}]},{"osd":4,"last update":"Tue Nov 28 20:01:57 2023","interfaces":[{"interface":"back","average":{"1min":0.69399999999999995,"5min":0.80300000000000005,"15min":0.84199999999999997},"min":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":0.86899999999999999,"5min":1.139,"15min":1.139},"last":0.66900000000000004},{"interface":"front","average":{"1min":0.70199999999999996,"5min":0.79600000000000004,"15min":0.83399999999999996},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":1.008,"5min":1.238,"15min":1.238},"last":0.59299999999999997}]},{"osd":5,"last update":"Tue Nov 28 20:01:57 2023","interfaces":[{"interface":"back","average":{"1min":0.70799999999999996,"5min":0.81200000000000006,"15min":0.85999999999999999},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":1.0389999999999999,"5min":1.6180000000000001,"15min":1.6180000000000001},"last":0.76900000000000002},{"interface":"front","average":{"1min":0.70699999999999996,"5min":0.78400000000000003,"15min":0.81799999999999995},"min":{"1min":0.51800000000000002,"5min":0.496,"15min":0.496},"max":{"1min":1.0149999999999999,"5min":1.339,"15min":1.339},"last":0.51700000000000002}]},{"osd":6,"last update":"Tue Nov 28 20:01:57 2023","interfaces":[{"interface":"back","average":{"1min":0.71399999999999997,"5min":0.77300000000000002,"15min":0.79500000000000004},"min":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":1.0589999999999999,"5min":1.1839999999999999,"15min":1.1839999999999999},"last":0.69299999999999995},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.80300000000000005,"15min":0.84199999999999997},"min":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":0.98699999999999999,"5min":1.099,"15min":1.099},"last":0.61299999999999999}]},{"osd":7,"last update":"Tue Nov 28 20:01:57 2023","interfaces":[{"interface":"back","average":{"1min":0.69599999999999995,"5min":0.82199999999999995,"15min":0.86699999999999999},"min":{"1min":0.53300000000000003,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":0.94699999999999995,"5min":1.4590000000000001,"15min":1.4590000000000001},"last":0.68000000000000005},{"interface":"front","average":{"1min":0.73199999999999998,"5min":0.80900000000000005,"15min":0.84699999999999998},"min":{"1min":0.55200000000000005,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":1.0760000000000001,"5min":1.387,"15min":1.387},"last":0.57199999999999995}]}]},{"osd":1,"up_from":13,"seq":55834574895,"num_pgs":60,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32220,"kb_used_data":1032,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339620,"statfs":{"total":96636764160,"available":96603770880,"internally_reserved":0,"allocated":1056768,"data_stored":499526,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 20:02:00 2023","interfaces":[{"interface":"back","average":{"1min":0.38700000000000001,"5min":0.54600000000000004,"15min":0.62},"min":{"1min":0.249,"5min":0.249,"15min":0.249},"max":{"1min":0.60699999999999998,"5min":3.8740000000000001,"15min":3.8740000000000001},"last":0.46999999999999997},{"interface":"front","average":{"1min":0.42099999999999999,"5min":0.51000000000000001,"15min":0.55100000000000005},"min":{"1min":0.32300000000000001,"5min":0.25,"15min":0.25},"max":{"1min":0.60399999999999998,"5min":2.0760000000000001,"15min":2.0760000000000001},"last":0.35099999999999998}]},{"osd":2,"last update":"Tue Nov 28 20:02:00 2023","interfaces":[{"interface":"back","average":{"1min":0.41399999999999998,"5min":0.56000000000000005,"15min":0.626},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.70799999999999996,"5min":3.7320000000000002,"15min":3.7320000000000002},"last":0.374},{"interface":"front","average":{"1min":0.46899999999999997,"5min":0.63400000000000001,"15min":0.71799999999999997},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.67000000000000004,"5min":3.9089999999999998,"15min":3.9089999999999998},"last":0.39000000000000001}]},{"osd":3,"last update":"Tue Nov 28 20:02:00 2023","interfaces":[{"interface":"back","average":{"1min":0.52200000000000002,"5min":0.61799999999999999,"15min":0.66000000000000003},"min":{"1min":0.436,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.70799999999999996,"5min":1.6399999999999999,"15min":1.6399999999999999},"last":0.48899999999999999},{"interface":"front","average":{"1min":0.45500000000000002,"5min":0.61599999999999999,"15min":0.67400000000000004},"min":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.625,"5min":2.5270000000000001,"15min":2.5270000000000001},"last":0.45700000000000002}]},{"osd":4,"last update":"Tue Nov 28 20:02:00 2023","interfaces":[{"interface":"back","average":{"1min":0.69799999999999995,"5min":0.81699999999999995,"15min":0.86899999999999999},"min":{"1min":0.42199999999999999,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.91400000000000003,"5min":3.1659999999999999,"15min":3.1659999999999999},"last":0.44400000000000001},{"interface":"front","average":{"1min":0.69699999999999995,"5min":0.84399999999999997,"15min":0.91200000000000003},"min":{"1min":0.52300000000000002,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.94299999999999995,"5min":3.7959999999999998,"15min":3.7959999999999998},"last":0.51600000000000001}]},{"osd":5,"last update":"Tue Nov 28 20:02:00 2023","interfaces":[{"interface":"back","average":{"1min":0.71399999999999997,"5min":0.875,"15min":0.95099999999999996},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":1.004,"5min":4.1479999999999997,"15min":4.1479999999999997},"last":0.50900000000000001},{"interface":"front","average":{"1min":0.69799999999999995,"5min":0.82599999999999996,"15min":0.88200000000000001},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":0.87,"5min":3.5569999999999999,"15min":3.5569999999999999},"last":0.60399999999999998}]},{"osd":6,"last update":"Tue Nov 28 20:02:00 2023","interfaces":[{"interface":"back","average":{"1min":0.72399999999999998,"5min":0.88800000000000001,"15min":0.95699999999999996},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":0.94499999999999995,"5min":2.863,"15min":2.863},"last":0.54700000000000004},{"interface":"front","average":{"1min":0.76800000000000002,"5min":0.89800000000000002,"15min":0.95399999999999996},"min":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":0.97999999999999998,"5min":3.371,"15min":3.371},"last":0.56000000000000005}]},{"osd":7,"last update":"Tue Nov 28 20:02:00 2023","interfaces":[{"interface":"back","average":{"1min":0.70299999999999996,"5min":0.89100000000000001,"15min":0.97199999999999998},"min":{"1min":0.53100000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":0.93600000000000005,"5min":3.8439999999999999,"15min":3.8439999999999999},"last":0.58399999999999996},{"interface":"front","average":{"1min":0.68799999999999994,"5min":0.90500000000000003,"15min":0.99299999999999999},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.95899999999999996,"5min":3.9689999999999999,"15min":3.9689999999999999},"last":0.57199999999999995}]}]},{"osd":0,"up_from":13,"seq":55834574894,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32316,"kb_used_data":1128,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339524,"statfs":{"total":96636764160,"available":96603672576,"internally_reserved":0,"allocated":1155072,"data_stored":1095305,"data_compressed":33374,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Nov 28 20:01:57 2023","interfaces":[{"interface":"back","average":{"1min":0.38700000000000001,"5min":0.57399999999999995,"15min":0.65100000000000002},"min":{"1min":0.24099999999999999,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":0.68400000000000005,"5min":4.883,"15min":4.883},"last":0.34599999999999997},{"interface":"front","average":{"1min":0.43099999999999999,"5min":0.70099999999999996,"15min":0.81899999999999995},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.66800000000000004,"5min":8.0800000000000001,"15min":8.0800000000000001},"last":0.28299999999999997}]},{"osd":2,"last update":"Tue Nov 28 20:01:57 2023","interfaces":[{"interface":"back","average":{"1min":0.50800000000000001,"5min":0.77400000000000002,"15min":0.90700000000000003},"min":{"1min":0.312,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.85599999999999998,"5min":8.1029999999999998,"15min":8.1029999999999998},"last":0.40600000000000003},{"interface":"front","average":{"1min":0.53300000000000003,"5min":0.79400000000000004,"15min":0.92200000000000004},"min":{"1min":0.40600000000000003,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.748,"5min":8.1310000000000002,"15min":8.1310000000000002},"last":0.38900000000000001}]},{"osd":3,"last update":"Tue Nov 28 20:01:57 2023","interfaces":[{"interface":"back","average":{"1min":0.47299999999999998,"5min":0.628,"15min":0.70699999999999996},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.873,"5min":4.3949999999999996,"15min":4.3949999999999996},"last":0.372},{"interface":"front","average":{"1min":0.497,"5min":0.65100000000000002,"15min":0.72099999999999997},"min":{"1min":0.37,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.89200000000000002,"5min":4.3470000000000004,"15min":4.3470000000000004},"last":0.44800000000000001}]},{"osd":4,"last update":"Tue Nov 28 20:01:57 2023","interfaces":[{"interface":"back","average":{"1min":0.72799999999999998,"5min":0.92000000000000004,"15min":1.0069999999999999},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":1.038,"5min":4.6360000000000001,"15min":4.6360000000000001},"last":0.626},{"interface":"front","average":{"1min":0.76800000000000002,"5min":0.93400000000000005,"15min":1.0129999999999999},"min":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":1.0820000000000001,"5min":4.4710000000000001,"15min":4.4710000000000001},"last":0.55700000000000005}]},{"osd":5,"last update":"Tue Nov 28 20:01:57 2023","interfaces":[{"interface":"back","average":{"1min":0.72599999999999998,"5min":0.93200000000000005,"15min":1.02},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":0.97599999999999998,"5min":4.6120000000000001,"15min":4.6120000000000001},"last":0.64600000000000002},{"interface":"front","average":{"1min":0.78600000000000003,"5min":0.93600000000000005,"15min":1.0129999999999999},"min":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.1319999999999999,"5min":4.5449999999999999,"15min":4.5449999999999999},"last":0.65900000000000003}]},{"osd":6,"last update":"Tue Nov 28 20:01:57 2023","interfaces":[{"interface":"back","average":{"1min":0.755,"5min":0.94499999999999995,"15min":1.034},"min":{"1min":0.53600000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":1.0580000000000001,"5min":4.657,"15min":4.657},"last":0.59399999999999997},{"interface":"front","average":{"1min":0.75700000000000001,"5min":0.95799999999999996,"15min":1.05},"min":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":1.0049999999999999,"5min":4.5259999999999998,"15min":4.5259999999999998},"last":0.60999999999999999}]},{"osd":7,"last update":"Tue Nov 28 20:01:57 2023","interfaces":[{"interface":"back","average":{"1min":0.73799999999999999,"5min":0.95199999999999996,"15min":1.0509999999999999},"min":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":1.081,"5min":4.7320000000000002,"15min":4.7320000000000002},"last":0.57099999999999995},{"interface":"front","average":{"1min":0.76300000000000001,"5min":0.93100000000000005,"15min":1.0069999999999999},"min":{"1min":0.58699999999999997,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":1.099,"5min":4.4939999999999998,"15min":4.4939999999999998},"last":0.68200000000000005}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33374,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33374,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":3813,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":3711,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2216,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-28T20:02:30.388 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-11-28T20:02:30.388 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.1 mon 'allow r' osd 'allow rw pool=cephfs2_data' mds allow 2023-11-28T20:02:30.534 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:30.528+0000 7f8ae04c9640 1 Processor -- start 2023-11-28T20:02:30.534 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:30.528+0000 7f8ae04c9640 1 -- start start 2023-11-28T20:02:30.536 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:30.532+0000 7f8ae04c9640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8ad814b1e0 0x7f8ad80c1700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:30.536 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:30.532+0000 7f8ae04c9640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f8ad81548c0 0x7f8ad8154d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:30.536 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:30.532+0000 7f8ae04c9640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8ad80a4e20 con 0x7f8ad80c5300 2023-11-28T20:02:30.536 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:30.532+0000 7f8ae04c9640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8ad80a50e0 con 0x7f8ad81548c0 2023-11-28T20:02:30.536 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:30.532+0000 7f8ae04c9640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ad80c0f00 con 0x7f8ad814b1e0 2023-11-28T20:02:30.536 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:30.532+0000 7f8adea66640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f8ad81548c0 0x7f8ad8154d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:02:30.536 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:30.532+0000 7f8adea66640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f8ad81548c0 0x7f8ad8154d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:58664/0 (socket says 172.21.15.78:58664) 2023-11-28T20:02:30.536 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:30.532+0000 7f8adea66640 1 -- 172.21.15.78:0/3520218384 learned_addr learned my addr 172.21.15.78:0/3520218384 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T20:02:30.537 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:30.532+0000 7f8ade265640 1 --2- 172.21.15.78:0/3520218384 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8ad814b1e0 0x7f8ad80c1700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:02:30.537 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:30.532+0000 7f8adea66640 1 -- 172.21.15.78:0/3520218384 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8ad814b1e0 msgr2=0x7f8ad80c1700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:02:30.537 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:30.532+0000 7f8adea66640 1 --2- 172.21.15.78:0/3520218384 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8ad814b1e0 0x7f8ad80c1700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:30.537 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:30.532+0000 7f8adea66640 1 -- 172.21.15.78:0/3520218384 >> v1:172.21.15.179:6789/0 conn(0x7f8ad80c5300 legacy=0x7f8ad80a9c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:02:30.537 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:30.532+0000 7f8adea66640 1 -- 172.21.15.78:0/3520218384 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ad80c11e0 con 0x7f8ad81548c0 2023-11-28T20:02:30.537 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:30.532+0000 7f8ade265640 1 --2- 172.21.15.78:0/3520218384 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8ad814b1e0 0x7f8ad80c1700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T20:02:30.538 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:30.532+0000 7f8adea66640 1 --2- 172.21.15.78:0/3520218384 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8ad81548c0 0x7f8ad8154d50 secure :-1 s=READY pgs=972 cs=0 l=1 rev1=1 crypto rx=0x7f8ad0009e50 tx=0x7f8ad001ca10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8c6946a07594e777 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:02:30.539 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:30.536+0000 7f8add263640 1 -- 172.21.15.78:0/3520218384 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ad81558b0 con 0x7f8ad81548c0 2023-11-28T20:02:30.539 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:30.536+0000 7f8add263640 1 -- 172.21.15.78:0/3520218384 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ad00a57f0 con 0x7f8ad81548c0 2023-11-28T20:02:30.539 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:30.536+0000 7f8add263640 1 -- 172.21.15.78:0/3520218384 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ad00a5b80 con 0x7f8ad81548c0 2023-11-28T20:02:30.540 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:30.536+0000 7f8ae04c9640 1 -- 172.21.15.78:0/3520218384 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8ad81548c0 msgr2=0x7f8ad8154d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:02:30.540 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:30.536+0000 7f8ae04c9640 1 --2- 172.21.15.78:0/3520218384 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8ad81548c0 0x7f8ad8154d50 secure :-1 s=READY pgs=972 cs=0 l=1 rev1=1 crypto rx=0x7f8ad0009e50 tx=0x7f8ad001ca10 comp rx=0 tx=0).stop 2023-11-28T20:02:30.540 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:30.536+0000 7f8ae04c9640 1 -- 172.21.15.78:0/3520218384 shutdown_connections 2023-11-28T20:02:30.540 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:30.536+0000 7f8ae04c9640 1 --2- 172.21.15.78:0/3520218384 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8ad81548c0 0x7f8ad8154d50 unknown :-1 s=CLOSED pgs=972 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:30.540 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:30.536+0000 7f8ae04c9640 1 --2- 172.21.15.78:0/3520218384 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8ad814b1e0 0x7f8ad80c1700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:30.540 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:30.536+0000 7f8ae04c9640 1 -- 172.21.15.78:0/3520218384 >> 172.21.15.78:0/3520218384 conn(0x7f8ad80c59f0 msgr2=0x7f8ad80c5e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:02:30.540 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:30.536+0000 7f8ae04c9640 1 -- 172.21.15.78:0/3520218384 shutdown_connections 2023-11-28T20:02:30.541 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:30.536+0000 7f8ae04c9640 1 -- 172.21.15.78:0/3520218384 wait complete. 2023-11-28T20:02:30.541 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:30.536+0000 7f8ae04c9640 1 Processor -- start 2023-11-28T20:02:30.541 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:30.536+0000 7f8ae04c9640 1 -- start start 2023-11-28T20:02:30.545 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:30.536+0000 7f8ae04c9640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8ad80c5300 0x7f8ad80befc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:30.545 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:30.536+0000 7f8ae04c9640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8ad814b1e0 0x7f8ad81ecd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:30.545 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:30.536+0000 7f8ae04c9640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8ad81548c0 0x7f8ad81ed2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:30.545 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:30.536+0000 7f8ae04c9640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ad81f02d0 con 0x7f8ad80c5300 2023-11-28T20:02:30.545 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:30.536+0000 7f8ae04c9640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ad81f0b70 con 0x7f8ad814b1e0 2023-11-28T20:02:30.545 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:30.536+0000 7f8ae04c9640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ad81543d0 con 0x7f8ad81548c0 2023-11-28T20:02:30.545 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:30.536+0000 7f8ade265640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8ad80c5300 0x7f8ad80befc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:02:30.545 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:30.536+0000 7f8ade265640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8ad80c5300 0x7f8ad80befc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:58680/0 (socket says 172.21.15.78:58680) 2023-11-28T20:02:30.545 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:30.536+0000 7f8ade265640 1 -- 172.21.15.78:0/4139362053 learned_addr learned my addr 172.21.15.78:0/4139362053 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T20:02:30.546 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:30.536+0000 7f8adda64640 1 --2- 172.21.15.78:0/4139362053 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8ad814b1e0 0x7f8ad81ecd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:02:30.546 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:30.540+0000 7f8adea66640 1 --2- 172.21.15.78:0/4139362053 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8ad81548c0 0x7f8ad81ed2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:02:30.546 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:30.540+0000 7f8ade265640 1 -- 172.21.15.78:0/4139362053 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8ad81548c0 msgr2=0x7f8ad81ed2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:02:30.546 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:30.540+0000 7f8ade265640 1 --2- 172.21.15.78:0/4139362053 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8ad81548c0 0x7f8ad81ed2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:30.546 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:30.540+0000 7f8ade265640 1 -- 172.21.15.78:0/4139362053 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8ad814b1e0 msgr2=0x7f8ad81ecd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:02:30.546 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:30.540+0000 7f8ade265640 1 --2- 172.21.15.78:0/4139362053 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8ad814b1e0 0x7f8ad81ecd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:30.546 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:30.540+0000 7f8ade265640 1 -- 172.21.15.78:0/4139362053 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ad0009b30 con 0x7f8ad80c5300 2023-11-28T20:02:30.546 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:30.540+0000 7f8adda64640 1 --2- 172.21.15.78:0/4139362053 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8ad814b1e0 0x7f8ad81ecd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T20:02:30.546 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:30.540+0000 7f8ade265640 1 --2- 172.21.15.78:0/4139362053 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8ad80c5300 0x7f8ad80befc0 secure :-1 s=READY pgs=973 cs=0 l=1 rev1=1 crypto rx=0x7f8ad400e840 tx=0x7f8ad400ed00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:02:30.547 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:30.540+0000 7f8aceffd640 1 -- 172.21.15.78:0/4139362053 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ad400c8d0 con 0x7f8ad80c5300 2023-11-28T20:02:30.547 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:30.540+0000 7f8aceffd640 1 -- 172.21.15.78:0/4139362053 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ad400ca30 con 0x7f8ad80c5300 2023-11-28T20:02:30.547 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:30.540+0000 7f8aceffd640 1 -- 172.21.15.78:0/4139362053 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ad400cdc0 con 0x7f8ad80c5300 2023-11-28T20:02:30.547 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:30.540+0000 7f8ae04c9640 1 -- 172.21.15.78:0/4139362053 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8ad81f0520 con 0x7f8ad80c5300 2023-11-28T20:02:30.547 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:30.540+0000 7f8ae04c9640 1 -- 172.21.15.78:0/4139362053 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8ad80a7280 con 0x7f8ad80c5300 2023-11-28T20:02:30.547 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:30.540+0000 7f8ae04c9640 1 -- 172.21.15.78:0/4139362053 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8ad8067630 con 0x7f8ad80c5300 2023-11-28T20:02:30.548 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:30.540+0000 7f8aceffd640 1 -- 172.21.15.78:0/4139362053 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f8ad4013410 con 0x7f8ad80c5300 2023-11-28T20:02:30.548 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:30.540+0000 7f8aceffd640 1 --2- 172.21.15.78:0/4139362053 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f8abc066470 0x7f8abc068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:30.548 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:30.544+0000 7f8aceffd640 1 -- 172.21.15.78:0/4139362053 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6885+0+0 (secure 0 0 0) 0x7f8ad4084080 con 0x7f8ad80c5300 2023-11-28T20:02:30.548 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:30.544+0000 7f8adda64640 1 --2- 172.21.15.78:0/4139362053 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f8abc066470 0x7f8abc068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:02:30.548 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:30.544+0000 7f8adda64640 1 --2- 172.21.15.78:0/4139362053 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f8abc066470 0x7f8abc068930 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f8ad81ede90 tx=0x7f8ac8009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:02:30.550 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:30.544+0000 7f8aceffd640 1 -- 172.21.15.78:0/4139362053 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f8ad4051100 con 0x7f8ad80c5300 2023-11-28T20:02:30.753 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:30.748+0000 7f8ae04c9640 1 -- 172.21.15.78:0/4139362053 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.1", "caps": ["mon", "allow r", "osd", "allow rw pool=cephfs2_data", "mds", "allow"]} v 0) v1 -- 0x7f8ad80ab090 con 0x7f8ad80c5300 2023-11-28T20:02:30.757 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:30.752+0000 7f8aceffd640 1 -- 172.21.15.78:0/4139362053 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.1", "caps": ["mon", "allow r", "osd", "allow rw pool=cephfs2_data", "mds", "allow"]}]=0 updated caps for client.1 v22) v1 ==== 185+0+142 (secure 0 0 0) 0x7f8ad4054720 con 0x7f8ad80c5300 2023-11-28T20:02:30.757 INFO:teuthology.orchestra.run.smithi078.stdout:[client.1] 2023-11-28T20:02:30.757 INFO:teuthology.orchestra.run.smithi078.stdout: key = AQBORmZlzBgfOhAAm6M8Y+12MlLdVkJnMmK9BQ== 2023-11-28T20:02:30.757 INFO:teuthology.orchestra.run.smithi078.stdout: caps mds = "allow" 2023-11-28T20:02:30.758 INFO:teuthology.orchestra.run.smithi078.stdout: caps mon = "allow r" 2023-11-28T20:02:30.758 INFO:teuthology.orchestra.run.smithi078.stdout: caps osd = "allow rw pool=cephfs2_data" 2023-11-28T20:02:30.758 INFO:teuthology.orchestra.run.smithi078.stderr:updated caps for client.1 2023-11-28T20:02:30.759 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:30.756+0000 7f8ae04c9640 1 -- 172.21.15.78:0/4139362053 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f8abc066470 msgr2=0x7f8abc068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:02:30.760 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:30.756+0000 7f8ae04c9640 1 --2- 172.21.15.78:0/4139362053 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f8abc066470 0x7f8abc068930 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f8ad81ede90 tx=0x7f8ac8009040 comp rx=0 tx=0).stop 2023-11-28T20:02:30.761 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:30.756+0000 7f8ae04c9640 1 -- 172.21.15.78:0/4139362053 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8ad80c5300 msgr2=0x7f8ad80befc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:02:30.764 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:30.756+0000 7f8ae04c9640 1 --2- 172.21.15.78:0/4139362053 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8ad80c5300 0x7f8ad80befc0 secure :-1 s=READY pgs=973 cs=0 l=1 rev1=1 crypto rx=0x7f8ad400e840 tx=0x7f8ad400ed00 comp rx=0 tx=0).stop 2023-11-28T20:02:30.764 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:30.756+0000 7f8ae04c9640 1 -- 172.21.15.78:0/4139362053 shutdown_connections 2023-11-28T20:02:30.764 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:30.756+0000 7f8ae04c9640 1 --2- 172.21.15.78:0/4139362053 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f8abc066470 0x7f8abc068930 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:30.764 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:30.756+0000 7f8ae04c9640 1 --2- 172.21.15.78:0/4139362053 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8ad81548c0 0x7f8ad81ed2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:30.764 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:30.756+0000 7f8ae04c9640 1 --2- 172.21.15.78:0/4139362053 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8ad814b1e0 0x7f8ad81ecd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:30.764 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:30.756+0000 7f8ae04c9640 1 --2- 172.21.15.78:0/4139362053 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8ad80c5300 0x7f8ad80befc0 unknown :-1 s=CLOSED pgs=973 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:30.764 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:30.756+0000 7f8ae04c9640 1 -- 172.21.15.78:0/4139362053 >> 172.21.15.78:0/4139362053 conn(0x7f8ad80c59f0 msgr2=0x7f8ad8145e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:02:30.764 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:30.756+0000 7f8ae04c9640 1 -- 172.21.15.78:0/4139362053 shutdown_connections 2023-11-28T20:02:30.764 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:30.756+0000 7f8ae04c9640 1 -- 172.21.15.78:0/4139362053 wait complete. 2023-11-28T20:02:30.778 DEBUG:teuthology.orchestra.run.smithi179:> set -ex 2023-11-28T20:02:30.779 DEBUG:teuthology.orchestra.run.smithi179:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-28T20:02:30.789 DEBUG:teuthology.orchestra.run.smithi179:> set -ex 2023-11-28T20:02:30.789 DEBUG:teuthology.orchestra.run.smithi179:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-28T20:02:30.846 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-28T20:02:30.984 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:30.980+0000 7f3b8d90f640 1 Processor -- start 2023-11-28T20:02:30.984 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:30.980+0000 7f3b8d90f640 1 -- start start 2023-11-28T20:02:30.985 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:30.980+0000 7f3b8d90f640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f3b880c5f60 0x7f3b880c4330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:30.985 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:30.980+0000 7f3b8d90f640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3b880c4870 0x7f3b880c6ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:30.986 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:30.980+0000 7f3b8d90f640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3b880c6a10 con 0x7f3b88155310 2023-11-28T20:02:30.986 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:30.980+0000 7f3b8d90f640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3b880c2740 con 0x7f3b880c5f60 2023-11-28T20:02:30.986 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:30.980+0000 7f3b8d90f640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b8806bc80 con 0x7f3b880c4870 2023-11-28T20:02:30.986 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:30.980+0000 7f3b86ffd640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f3b88155310 0x7f3b88158590 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:55716/0 (socket says 172.21.15.78:55716) 2023-11-28T20:02:30.986 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:30.980+0000 7f3b86ffd640 1 -- 172.21.15.78:0/542638805 learned_addr learned my addr 172.21.15.78:0/542638805 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-11-28T20:02:30.987 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:30.980+0000 7f3b7e7fc640 1 --2- 172.21.15.78:0/542638805 >> v2:172.21.15.78:3300/0 conn(0x7f3b880c5f60 0x7f3b880c4330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:02:30.987 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:30.980+0000 7f3b877fe640 1 --2- 172.21.15.78:0/542638805 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3b880c4870 0x7f3b880c6ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:02:30.987 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:30.980+0000 7f3b867fc640 1 -- 172.21.15.78:0/542638805 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 628559755 0 0) 0x7f3b880c6a10 con 0x7f3b88155310 2023-11-28T20:02:30.988 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:30.980+0000 7f3b867fc640 1 -- 172.21.15.78:0/542638805 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3b74003530 con 0x7f3b88155310 2023-11-28T20:02:30.988 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:30.980+0000 7f3b7e7fc640 1 -- 172.21.15.78:0/542638805 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3b880c4870 msgr2=0x7f3b880c6ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:02:30.988 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:30.980+0000 7f3b7e7fc640 1 --2- 172.21.15.78:0/542638805 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3b880c4870 0x7f3b880c6ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:30.988 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:30.980+0000 7f3b7e7fc640 1 -- 172.21.15.78:0/542638805 >> v1:172.21.15.78:6789/0 conn(0x7f3b88155310 legacy=0x7f3b88158590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:02:30.988 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:30.980+0000 7f3b7e7fc640 1 -- 172.21.15.78:0/542638805 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b880c2f80 con 0x7f3b880c5f60 2023-11-28T20:02:30.989 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:30.984+0000 7f3b7e7fc640 1 --2- 172.21.15.78:0/542638805 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3b880c5f60 0x7f3b880c4330 secure :-1 s=READY pgs=975 cs=0 l=1 rev1=1 crypto rx=0x7f3b70009d90 tx=0x7f3b7001c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f00f319faaccbefb server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:02:30.990 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:30.984+0000 7f3b867fc640 1 -- 172.21.15.78:0/542638805 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b700a58f0 con 0x7f3b880c5f60 2023-11-28T20:02:30.990 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:30.984+0000 7f3b867fc640 1 -- 172.21.15.78:0/542638805 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b700a5a50 con 0x7f3b880c5f60 2023-11-28T20:02:30.990 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:30.984+0000 7f3b867fc640 1 -- 172.21.15.78:0/542638805 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b700a5de0 con 0x7f3b880c5f60 2023-11-28T20:02:30.990 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:30.984+0000 7f3b8d90f640 1 -- 172.21.15.78:0/542638805 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3b880c5f60 msgr2=0x7f3b880c4330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:02:30.990 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:30.984+0000 7f3b8d90f640 1 --2- 172.21.15.78:0/542638805 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3b880c5f60 0x7f3b880c4330 secure :-1 s=READY pgs=975 cs=0 l=1 rev1=1 crypto rx=0x7f3b70009d90 tx=0x7f3b7001c920 comp rx=0 tx=0).stop 2023-11-28T20:02:30.991 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:30.984+0000 7f3b8d90f640 1 -- 172.21.15.78:0/542638805 shutdown_connections 2023-11-28T20:02:30.991 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:30.984+0000 7f3b8d90f640 1 --2- 172.21.15.78:0/542638805 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3b880c4870 0x7f3b880c6ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:30.991 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:30.984+0000 7f3b8d90f640 1 --2- 172.21.15.78:0/542638805 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3b880c5f60 0x7f3b880c4330 unknown :-1 s=CLOSED pgs=975 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:30.991 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:30.984+0000 7f3b8d90f640 1 -- 172.21.15.78:0/542638805 >> 172.21.15.78:0/542638805 conn(0x7f3b880a9830 msgr2=0x7f3b880a9c40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:02:30.991 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:30.984+0000 7f3b8d90f640 1 -- 172.21.15.78:0/542638805 shutdown_connections 2023-11-28T20:02:30.991 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:30.984+0000 7f3b8d90f640 1 -- 172.21.15.78:0/542638805 wait complete. 2023-11-28T20:02:30.992 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:30.988+0000 7f3b8d90f640 1 Processor -- start 2023-11-28T20:02:30.992 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:30.988+0000 7f3b8d90f640 1 -- start start 2023-11-28T20:02:30.995 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:30.988+0000 7f3b8d90f640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3b880c4870 0x7f3b880a8bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:30.995 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:30.988+0000 7f3b8d90f640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3b880c5f60 0x7f3b880a90f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:30.995 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:30.988+0000 7f3b8d90f640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3b88155310 0x7f3b881ece30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:30.995 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:30.988+0000 7f3b8d90f640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b88146b80 con 0x7f3b88155310 2023-11-28T20:02:30.995 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:30.988+0000 7f3b8d90f640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b8814fa30 con 0x7f3b880c5f60 2023-11-28T20:02:30.995 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:30.988+0000 7f3b8d90f640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b8814dc80 con 0x7f3b880c4870 2023-11-28T20:02:30.995 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:30.988+0000 7f3b877fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3b88155310 0x7f3b881ece30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:02:30.995 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:30.988+0000 7f3b877fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3b88155310 0x7f3b881ece30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:58704/0 (socket says 172.21.15.78:58704) 2023-11-28T20:02:30.995 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:30.988+0000 7f3b877fe640 1 -- 172.21.15.78:0/1237685384 learned_addr learned my addr 172.21.15.78:0/1237685384 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T20:02:30.995 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:30.988+0000 7f3b877fe640 1 -- 172.21.15.78:0/1237685384 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3b880c4870 msgr2=0x7f3b880a8bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:02:30.995 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:30.988+0000 7f3b7e7fc640 1 --2- 172.21.15.78:0/1237685384 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3b880c5f60 0x7f3b880a90f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:02:30.996 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:30.988+0000 7f3b86ffd640 1 --2- 172.21.15.78:0/1237685384 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3b880c4870 0x7f3b880a8bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:02:30.996 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:30.988+0000 7f3b877fe640 1 --2- 172.21.15.78:0/1237685384 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3b880c4870 0x7f3b880a8bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:30.996 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:30.988+0000 7f3b877fe640 1 -- 172.21.15.78:0/1237685384 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3b880c5f60 msgr2=0x7f3b880a90f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:02:30.996 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:30.988+0000 7f3b877fe640 1 --2- 172.21.15.78:0/1237685384 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3b880c5f60 0x7f3b880a90f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:30.996 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:30.988+0000 7f3b877fe640 1 -- 172.21.15.78:0/1237685384 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b70009a70 con 0x7f3b88155310 2023-11-28T20:02:30.996 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:30.988+0000 7f3b7e7fc640 1 --2- 172.21.15.78:0/1237685384 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3b880c5f60 0x7f3b880a90f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T20:02:30.996 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:30.988+0000 7f3b86ffd640 1 --2- 172.21.15.78:0/1237685384 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3b880c4870 0x7f3b880a8bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T20:02:30.996 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:30.988+0000 7f3b877fe640 1 --2- 172.21.15.78:0/1237685384 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3b88155310 0x7f3b881ece30 secure :-1 s=READY pgs=976 cs=0 l=1 rev1=1 crypto rx=0x7f3b8000d560 tx=0x7f3b8000da20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:02:30.996 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:30.988+0000 7f3b84ff9640 1 -- 172.21.15.78:0/1237685384 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b800125f0 con 0x7f3b88155310 2023-11-28T20:02:30.997 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:30.988+0000 7f3b84ff9640 1 -- 172.21.15.78:0/1237685384 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b80012770 con 0x7f3b88155310 2023-11-28T20:02:30.997 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:30.988+0000 7f3b8d90f640 1 -- 172.21.15.78:0/1237685384 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3b881563d0 con 0x7f3b88155310 2023-11-28T20:02:30.997 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:30.988+0000 7f3b84ff9640 1 -- 172.21.15.78:0/1237685384 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b80012b20 con 0x7f3b88155310 2023-11-28T20:02:30.997 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:30.988+0000 7f3b8d90f640 1 -- 172.21.15.78:0/1237685384 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3b88156990 con 0x7f3b88155310 2023-11-28T20:02:30.998 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:30.992+0000 7f3b8d90f640 1 -- 172.21.15.78:0/1237685384 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3b8814ddf0 con 0x7f3b88155310 2023-11-28T20:02:30.998 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:30.992+0000 7f3b84ff9640 1 -- 172.21.15.78:0/1237685384 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f3b80012c80 con 0x7f3b88155310 2023-11-28T20:02:30.998 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:30.992+0000 7f3b84ff9640 1 --2- 172.21.15.78:0/1237685384 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f3b68066470 0x7f3b68068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:30.998 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:30.992+0000 7f3b84ff9640 1 -- 172.21.15.78:0/1237685384 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6885+0+0 (secure 0 0 0) 0x7f3b800847b0 con 0x7f3b88155310 2023-11-28T20:02:30.998 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:30.992+0000 7f3b86ffd640 1 --2- 172.21.15.78:0/1237685384 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f3b68066470 0x7f3b68068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:02:30.999 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:30.992+0000 7f3b86ffd640 1 --2- 172.21.15.78:0/1237685384 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f3b68066470 0x7f3b68068930 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f3b780011f0 tx=0x7f3b78009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:02:31.001 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:30.996+0000 7f3b84ff9640 1 -- 172.21.15.78:0/1237685384 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f3b80051820 con 0x7f3b88155310 2023-11-28T20:02:31.152 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:31.148+0000 7f3b8d90f640 1 -- 172.21.15.78:0/1237685384 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3b88067630 con 0x7f3b88155310 2023-11-28T20:02:31.153 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:31.148+0000 7f3b84ff9640 1 -- 172.21.15.78:0/1237685384 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v85) v1 ==== 74+0+20339 (secure 0 0 0) 0x7f3b80054e40 con 0x7f3b88155310 2023-11-28T20:02:31.153 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-11-28T20:02:31.154 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":85,"fsid":"dd9780e8-3bda-44fa-a9f0-fa07d19d901d","created":"2023-11-28T19:58:40.969556+0000","modified":"2023-11-28T20:02:26.796715+0000","last_up_change":"2023-11-28T19:58:52.596716+0000","last_in_change":"2023-11-28T19:58:43.609275+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":16,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-28T19:58:54.011229+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_metadata","create_time":"2023-11-28T20:02:05.787820+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs_data","create_time":"2023-11-28T20:02:06.652305+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs2_metadata","create_time":"2023-11-28T20:02:23.066724+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":16,"pool_name":"cephfs2_data","create_time":"2023-11-28T20:02:24.230614+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs2"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e84245ac-b5da-429e-af18-39acaa2b33e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6800","nonce":3358701235},{"type":"v1","addr":"172.21.15.78:6801","nonce":3358701235}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6802","nonce":3358701235},{"type":"v1","addr":"172.21.15.78:6803","nonce":3358701235}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6806","nonce":3358701235},{"type":"v1","addr":"172.21.15.78:6807","nonce":3358701235}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6804","nonce":3358701235},{"type":"v1","addr":"172.21.15.78:6805","nonce":3358701235}]},"public_addr":"172.21.15.78:6801/3358701235","cluster_addr":"172.21.15.78:6803/3358701235","heartbeat_back_addr":"172.21.15.78:6807/3358701235","heartbeat_front_addr":"172.21.15.78:6805/3358701235","state":["exists","up"]},{"osd":1,"uuid":"e634831d-c4e2-48d9-870c-9556ae162981","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6808","nonce":3211476654},{"type":"v1","addr":"172.21.15.78:6809","nonce":3211476654}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6810","nonce":3211476654},{"type":"v1","addr":"172.21.15.78:6811","nonce":3211476654}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6814","nonce":3211476654},{"type":"v1","addr":"172.21.15.78:6815","nonce":3211476654}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6812","nonce":3211476654},{"type":"v1","addr":"172.21.15.78:6813","nonce":3211476654}]},"public_addr":"172.21.15.78:6809/3211476654","cluster_addr":"172.21.15.78:6811/3211476654","heartbeat_back_addr":"172.21.15.78:6815/3211476654","heartbeat_front_addr":"172.21.15.78:6813/3211476654","state":["exists","up"]},{"osd":2,"uuid":"274c8395-6534-41f0-b8fb-a00af8985aa8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6816","nonce":2532904479},{"type":"v1","addr":"172.21.15.78:6817","nonce":2532904479}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6818","nonce":2532904479},{"type":"v1","addr":"172.21.15.78:6819","nonce":2532904479}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6822","nonce":2532904479},{"type":"v1","addr":"172.21.15.78:6823","nonce":2532904479}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6820","nonce":2532904479},{"type":"v1","addr":"172.21.15.78:6821","nonce":2532904479}]},"public_addr":"172.21.15.78:6817/2532904479","cluster_addr":"172.21.15.78:6819/2532904479","heartbeat_back_addr":"172.21.15.78:6823/2532904479","heartbeat_front_addr":"172.21.15.78:6821/2532904479","state":["exists","up"]},{"osd":3,"uuid":"77acc9af-7d4d-4b18-8cf5-d62f5971b7c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6824","nonce":3442991267},{"type":"v1","addr":"172.21.15.78:6825","nonce":3442991267}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6826","nonce":3442991267},{"type":"v1","addr":"172.21.15.78:6827","nonce":3442991267}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6830","nonce":3442991267},{"type":"v1","addr":"172.21.15.78:6831","nonce":3442991267}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6828","nonce":3442991267},{"type":"v1","addr":"172.21.15.78:6829","nonce":3442991267}]},"public_addr":"172.21.15.78:6825/3442991267","cluster_addr":"172.21.15.78:6827/3442991267","heartbeat_back_addr":"172.21.15.78:6831/3442991267","heartbeat_front_addr":"172.21.15.78:6829/3442991267","state":["exists","up"]},{"osd":4,"uuid":"5c62bc66-6b34-4b7f-a66b-9a743969138c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":802983577},{"type":"v1","addr":"172.21.15.179:6809","nonce":802983577}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":802983577},{"type":"v1","addr":"172.21.15.179:6811","nonce":802983577}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":802983577},{"type":"v1","addr":"172.21.15.179:6815","nonce":802983577}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":802983577},{"type":"v1","addr":"172.21.15.179:6813","nonce":802983577}]},"public_addr":"172.21.15.179:6809/802983577","cluster_addr":"172.21.15.179:6811/802983577","heartbeat_back_addr":"172.21.15.179:6815/802983577","heartbeat_front_addr":"172.21.15.179:6813/802983577","state":["exists","up"]},{"osd":5,"uuid":"67db6d36-f684-4079-b0cd-82b4dd61461f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":518192887},{"type":"v1","addr":"172.21.15.179:6818","nonce":518192887}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":518192887},{"type":"v1","addr":"172.21.15.179:6822","nonce":518192887}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":518192887},{"type":"v1","addr":"172.21.15.179:6829","nonce":518192887}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6824","nonce":518192887},{"type":"v1","addr":"172.21.15.179:6826","nonce":518192887}]},"public_addr":"172.21.15.179:6818/518192887","cluster_addr":"172.21.15.179:6822/518192887","heartbeat_back_addr":"172.21.15.179:6829/518192887","heartbeat_front_addr":"172.21.15.179:6826/518192887","state":["exists","up"]},{"osd":6,"uuid":"12e670af-5a16-4c81-9f97-defa66cab967","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":815435378},{"type":"v1","addr":"172.21.15.179:6801","nonce":815435378}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":815435378},{"type":"v1","addr":"172.21.15.179:6803","nonce":815435378}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":815435378},{"type":"v1","addr":"172.21.15.179:6807","nonce":815435378}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":815435378},{"type":"v1","addr":"172.21.15.179:6805","nonce":815435378}]},"public_addr":"172.21.15.179:6801/815435378","cluster_addr":"172.21.15.179:6803/815435378","heartbeat_back_addr":"172.21.15.179:6807/815435378","heartbeat_front_addr":"172.21.15.179:6805/815435378","state":["exists","up"]},{"osd":7,"uuid":"fe630650-2eb3-49ad-8676-c341e6332eb1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6817","nonce":2848432339},{"type":"v1","addr":"172.21.15.179:6819","nonce":2848432339}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6821","nonce":2848432339},{"type":"v1","addr":"172.21.15.179:6823","nonce":2848432339}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":2848432339},{"type":"v1","addr":"172.21.15.179:6831","nonce":2848432339}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6825","nonce":2848432339},{"type":"v1","addr":"172.21.15.179:6827","nonce":2848432339}]},"public_addr":"172.21.15.179:6819/2848432339","cluster_addr":"172.21.15.179:6823/2848432339","heartbeat_back_addr":"172.21.15.179:6831/2848432339","heartbeat_front_addr":"172.21.15.179:6827/2848432339","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:58:49.255433+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:58:49.412880+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:58:49.559295+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:58:49.245237+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:58:49.184557+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:58:49.329851+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:58:49.366012+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:58:49.349604+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-28T20:02:31.155 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:31.152+0000 7f3b8d90f640 1 -- 172.21.15.78:0/1237685384 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f3b68066470 msgr2=0x7f3b68068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:02:31.156 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:31.152+0000 7f3b8d90f640 1 --2- 172.21.15.78:0/1237685384 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f3b68066470 0x7f3b68068930 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f3b780011f0 tx=0x7f3b78009040 comp rx=0 tx=0).stop 2023-11-28T20:02:31.156 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:31.152+0000 7f3b8d90f640 1 -- 172.21.15.78:0/1237685384 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3b88155310 msgr2=0x7f3b881ece30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:02:31.156 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:31.152+0000 7f3b8d90f640 1 --2- 172.21.15.78:0/1237685384 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3b88155310 0x7f3b881ece30 secure :-1 s=READY pgs=976 cs=0 l=1 rev1=1 crypto rx=0x7f3b8000d560 tx=0x7f3b8000da20 comp rx=0 tx=0).stop 2023-11-28T20:02:31.156 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:31.152+0000 7f3b8d90f640 1 -- 172.21.15.78:0/1237685384 shutdown_connections 2023-11-28T20:02:31.156 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:31.152+0000 7f3b8d90f640 1 --2- 172.21.15.78:0/1237685384 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f3b68066470 0x7f3b68068930 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:31.156 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:31.152+0000 7f3b8d90f640 1 --2- 172.21.15.78:0/1237685384 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3b88155310 0x7f3b881ece30 unknown :-1 s=CLOSED pgs=976 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:31.156 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:31.152+0000 7f3b8d90f640 1 --2- 172.21.15.78:0/1237685384 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3b880c5f60 0x7f3b880a90f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:31.156 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:31.152+0000 7f3b8d90f640 1 --2- 172.21.15.78:0/1237685384 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3b880c4870 0x7f3b880a8bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:31.156 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:31.152+0000 7f3b8d90f640 1 -- 172.21.15.78:0/1237685384 >> 172.21.15.78:0/1237685384 conn(0x7f3b880a9830 msgr2=0x7f3b880a9c10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:02:31.156 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:31.152+0000 7f3b8d90f640 1 -- 172.21.15.78:0/1237685384 shutdown_connections 2023-11-28T20:02:31.156 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:31.152+0000 7f3b8d90f640 1 -- 172.21.15.78:0/1237685384 wait complete. 2023-11-28T20:02:31.175 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-28T19:58:54.011229+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 13, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-28T20:02:05.787820+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '80', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 14, 'pool_name': 'cephfs_data', 'create_time': '2023-11-28T20:02:06.652305+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '81', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 15, 'pool_name': 'cephfs2_metadata', 'create_time': '2023-11-28T20:02:23.066724+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '84', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs2'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 16, 'pool_name': 'cephfs2_data', 'create_time': '2023-11-28T20:02:24.230614+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '85', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs2'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-28T20:02:31.175 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-28T20:02:31.318 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:31.312+0000 7f1f4291d640 1 Processor -- start 2023-11-28T20:02:31.318 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:31.312+0000 7f1f4291d640 1 -- start start 2023-11-28T20:02:31.319 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:31.312+0000 7f1f4291d640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f1f3c14f850 0x7f1f3c0aacf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:31.319 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:31.316+0000 7f1f4291d640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1f3c06d840 0x7f1f3c0c43e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:31.319 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:31.316+0000 7f1f4291d640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1f3c152910 con 0x7f1f3c14fc30 2023-11-28T20:02:31.319 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:31.316+0000 7f1f4291d640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1f3c0c2240 con 0x7f1f3c14f850 2023-11-28T20:02:31.319 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:31.316+0000 7f1f4291d640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1f3c152bf0 con 0x7f1f3c06d840 2023-11-28T20:02:31.320 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:31.316+0000 7f1f40eba640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1f3c06d840 0x7f1f3c0c43e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:02:31.320 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:31.316+0000 7f1f3bfff640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f1f3c14f850 0x7f1f3c0aacf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:02:31.320 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:31.316+0000 7f1f3b7fe640 1 --1- >> v1:172.21.15.179:6789/0 conn(0x7f1f3c14fc30 0x7f1f3c0c3cd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.179:6789/0 says I am v1:172.21.15.78:39814/0 (socket says 172.21.15.78:39814) 2023-11-28T20:02:31.320 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:31.316+0000 7f1f40eba640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1f3c06d840 0x7f1f3c0c43e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3301/0 says I am v2:172.21.15.78:35502/0 (socket says 172.21.15.78:35502) 2023-11-28T20:02:31.320 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:31.316+0000 7f1f3bfff640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f1f3c14f850 0x7f1f3c0aacf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.78:53898/0 (socket says 172.21.15.78:53898) 2023-11-28T20:02:31.320 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:31.316+0000 7f1f3b7fe640 1 -- 172.21.15.78:0/1124806542 learned_addr learned my addr 172.21.15.78:0/1124806542 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-11-28T20:02:31.320 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:31.316+0000 7f1f3bfff640 1 -- 172.21.15.78:0/1124806542 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1f3c06d840 msgr2=0x7f1f3c0c43e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:02:31.321 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:31.316+0000 7f1f3bfff640 1 --2- 172.21.15.78:0/1124806542 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1f3c06d840 0x7f1f3c0c43e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:31.321 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:31.316+0000 7f1f3bfff640 1 -- 172.21.15.78:0/1124806542 >> v1:172.21.15.179:6789/0 conn(0x7f1f3c14fc30 legacy=0x7f1f3c0c3cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:02:31.321 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:31.316+0000 7f1f3bfff640 1 -- 172.21.15.78:0/1124806542 --> v2:172.21.15.179:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f3c152ed0 con 0x7f1f3c14f850 2023-11-28T20:02:31.321 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:31.316+0000 7f1f3affd640 1 -- 172.21.15.78:0/1124806542 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1334141503 0 0) 0x7f1f3c152910 con 0x7f1f3c14fc30 2023-11-28T20:02:31.321 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:31.316+0000 7f1f40eba640 1 --2- 172.21.15.78:0/1124806542 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1f3c06d840 0x7f1f3c0c43e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T20:02:31.323 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:31.320+0000 7f1f3bfff640 1 --2- 172.21.15.78:0/1124806542 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1f3c14f850 0x7f1f3c0aacf0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f1f2c0097c0 tx=0x7f1f2c01c480 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f5da234db1253bc server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:02:31.324 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:31.320+0000 7f1f3affd640 1 -- 172.21.15.78:0/1124806542 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f2c0a6040 con 0x7f1f3c14f850 2023-11-28T20:02:31.324 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:31.320+0000 7f1f3affd640 1 -- 172.21.15.78:0/1124806542 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f2c0aa600 con 0x7f1f3c14f850 2023-11-28T20:02:31.324 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:31.320+0000 7f1f3affd640 1 -- 172.21.15.78:0/1124806542 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f2c0aa990 con 0x7f1f3c14f850 2023-11-28T20:02:31.324 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:31.320+0000 7f1f4291d640 1 -- 172.21.15.78:0/1124806542 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1f3c14f850 msgr2=0x7f1f3c0aacf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:02:31.325 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:31.320+0000 7f1f4291d640 1 --2- 172.21.15.78:0/1124806542 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1f3c14f850 0x7f1f3c0aacf0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f1f2c0097c0 tx=0x7f1f2c01c480 comp rx=0 tx=0).stop 2023-11-28T20:02:31.325 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:31.320+0000 7f1f4291d640 1 -- 172.21.15.78:0/1124806542 shutdown_connections 2023-11-28T20:02:31.325 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:31.320+0000 7f1f4291d640 1 --2- 172.21.15.78:0/1124806542 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1f3c06d840 0x7f1f3c0c43e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:31.325 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:31.320+0000 7f1f4291d640 1 --2- 172.21.15.78:0/1124806542 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1f3c14f850 0x7f1f3c0aacf0 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:31.325 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:31.320+0000 7f1f4291d640 1 -- 172.21.15.78:0/1124806542 >> 172.21.15.78:0/1124806542 conn(0x7f1f3c0c59f0 msgr2=0x7f1f3c0c5e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:02:31.325 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:31.320+0000 7f1f4291d640 1 -- 172.21.15.78:0/1124806542 shutdown_connections 2023-11-28T20:02:31.325 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:31.320+0000 7f1f4291d640 1 -- 172.21.15.78:0/1124806542 wait complete. 2023-11-28T20:02:31.326 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:31.320+0000 7f1f4291d640 1 Processor -- start 2023-11-28T20:02:31.326 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:31.320+0000 7f1f4291d640 1 -- start start 2023-11-28T20:02:31.328 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:31.324+0000 7f1f4291d640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1f3c06d840 0x7f1f3c1ee360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:31.328 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:31.324+0000 7f1f4291d640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1f3c14f850 0x7f1f3c0a6d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:31.329 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:31.324+0000 7f1f4291d640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1f3c14fc30 0x7f1f3c0a8ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:31.329 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:31.324+0000 7f1f4291d640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f3c072500 con 0x7f1f3c14f850 2023-11-28T20:02:31.329 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:31.324+0000 7f1f4291d640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f3c15c210 con 0x7f1f3c06d840 2023-11-28T20:02:31.329 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:31.324+0000 7f1f4291d640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1f3c15c4f0 con 0x7f1f3c14fc30 2023-11-28T20:02:31.329 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:31.324+0000 7f1f3b7fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1f3c14f850 0x7f1f3c0a6d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:02:31.329 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:31.324+0000 7f1f3b7fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1f3c14f850 0x7f1f3c0a6d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:58712/0 (socket says 172.21.15.78:58712) 2023-11-28T20:02:31.329 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:31.324+0000 7f1f3b7fe640 1 -- 172.21.15.78:0/613651872 learned_addr learned my addr 172.21.15.78:0/613651872 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T20:02:31.329 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:31.324+0000 7f1f40eba640 1 --2- 172.21.15.78:0/613651872 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1f3c14fc30 0x7f1f3c0a8ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:02:31.329 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:31.324+0000 7f1f3bfff640 1 --2- 172.21.15.78:0/613651872 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1f3c06d840 0x7f1f3c1ee360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:02:31.329 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:31.324+0000 7f1f3b7fe640 1 -- 172.21.15.78:0/613651872 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1f3c14fc30 msgr2=0x7f1f3c0a8ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:02:31.329 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:31.324+0000 7f1f3b7fe640 1 --2- 172.21.15.78:0/613651872 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1f3c14fc30 0x7f1f3c0a8ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:31.330 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:31.324+0000 7f1f3b7fe640 1 -- 172.21.15.78:0/613651872 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1f3c06d840 msgr2=0x7f1f3c1ee360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:02:31.330 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:31.324+0000 7f1f3b7fe640 1 --2- 172.21.15.78:0/613651872 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1f3c06d840 0x7f1f3c1ee360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:31.330 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:31.324+0000 7f1f3b7fe640 1 -- 172.21.15.78:0/613651872 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f34009a70 con 0x7f1f3c14f850 2023-11-28T20:02:31.330 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:31.324+0000 7f1f3bfff640 1 --2- 172.21.15.78:0/613651872 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1f3c06d840 0x7f1f3c1ee360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T20:02:31.330 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:31.324+0000 7f1f3b7fe640 1 --2- 172.21.15.78:0/613651872 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1f3c14f850 0x7f1f3c0a6d80 secure :-1 s=READY pgs=977 cs=0 l=1 rev1=1 crypto rx=0x7f1f30007fd0 tx=0x7f1f3000c820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:02:31.330 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:31.324+0000 7f1f38ff9640 1 -- 172.21.15.78:0/613651872 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f30005cf0 con 0x7f1f3c14f850 2023-11-28T20:02:31.330 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:31.324+0000 7f1f38ff9640 1 -- 172.21.15.78:0/613651872 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f30005e70 con 0x7f1f3c14f850 2023-11-28T20:02:31.330 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:31.324+0000 7f1f4291d640 1 -- 172.21.15.78:0/613651872 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1f2c009420 con 0x7f1f3c14f850 2023-11-28T20:02:31.330 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:31.324+0000 7f1f38ff9640 1 -- 172.21.15.78:0/613651872 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f300072f0 con 0x7f1f3c14f850 2023-11-28T20:02:31.330 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:31.324+0000 7f1f4291d640 1 -- 172.21.15.78:0/613651872 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1f3c1edb60 con 0x7f1f3c14f850 2023-11-28T20:02:31.332 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:31.324+0000 7f1f4291d640 1 -- 172.21.15.78:0/613651872 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1f3c067630 con 0x7f1f3c14f850 2023-11-28T20:02:31.332 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:31.324+0000 7f1f38ff9640 1 -- 172.21.15.78:0/613651872 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f1f30007450 con 0x7f1f3c14f850 2023-11-28T20:02:31.332 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:31.328+0000 7f1f38ff9640 1 --2- 172.21.15.78:0/613651872 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f1f280664a0 0x7f1f28068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:31.332 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:31.328+0000 7f1f38ff9640 1 -- 172.21.15.78:0/613651872 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6885+0+0 (secure 0 0 0) 0x7f1f30083890 con 0x7f1f3c14f850 2023-11-28T20:02:31.332 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:31.328+0000 7f1f3bfff640 1 --2- 172.21.15.78:0/613651872 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f1f280664a0 0x7f1f28068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:02:31.332 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:31.328+0000 7f1f3bfff640 1 --2- 172.21.15.78:0/613651872 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f1f280664a0 0x7f1f28068960 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f1f2c0ae000 tx=0x7f1f2c0a7000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:02:31.335 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:31.332+0000 7f1f38ff9640 1 -- 172.21.15.78:0/613651872 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f1f30050860 con 0x7f1f3c14f850 2023-11-28T20:02:31.485 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:31.480+0000 7f1f4291d640 1 -- 172.21.15.78:0/613651872 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f1f3c1505b0 con 0x7f1f3c14f850 2023-11-28T20:02:31.485 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:31.480+0000 7f1f38ff9640 1 -- 172.21.15.78:0/613651872 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v85) v1 ==== 93+0+10 (secure 0 0 0) 0x7f1f30053e80 con 0x7f1f3c14f850 2023-11-28T20:02:31.486 INFO:teuthology.orchestra.run.smithi078.stdout:pg_num: 1 2023-11-28T20:02:31.487 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:31.484+0000 7f1f4291d640 1 -- 172.21.15.78:0/613651872 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f1f280664a0 msgr2=0x7f1f28068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:02:31.487 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:31.484+0000 7f1f4291d640 1 --2- 172.21.15.78:0/613651872 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f1f280664a0 0x7f1f28068960 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f1f2c0ae000 tx=0x7f1f2c0a7000 comp rx=0 tx=0).stop 2023-11-28T20:02:31.487 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:31.484+0000 7f1f4291d640 1 -- 172.21.15.78:0/613651872 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1f3c14f850 msgr2=0x7f1f3c0a6d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:02:31.488 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:31.484+0000 7f1f4291d640 1 --2- 172.21.15.78:0/613651872 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1f3c14f850 0x7f1f3c0a6d80 secure :-1 s=READY pgs=977 cs=0 l=1 rev1=1 crypto rx=0x7f1f30007fd0 tx=0x7f1f3000c820 comp rx=0 tx=0).stop 2023-11-28T20:02:31.488 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:31.484+0000 7f1f4291d640 1 -- 172.21.15.78:0/613651872 shutdown_connections 2023-11-28T20:02:31.488 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:31.484+0000 7f1f4291d640 1 --2- 172.21.15.78:0/613651872 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f1f280664a0 0x7f1f28068960 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:31.488 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:31.484+0000 7f1f4291d640 1 --2- 172.21.15.78:0/613651872 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1f3c14fc30 0x7f1f3c0a8ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:31.488 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:31.484+0000 7f1f4291d640 1 --2- 172.21.15.78:0/613651872 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1f3c14f850 0x7f1f3c0a6d80 unknown :-1 s=CLOSED pgs=977 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:31.488 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:31.484+0000 7f1f4291d640 1 --2- 172.21.15.78:0/613651872 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1f3c06d840 0x7f1f3c1ee360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:31.488 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:31.484+0000 7f1f4291d640 1 -- 172.21.15.78:0/613651872 >> 172.21.15.78:0/613651872 conn(0x7f1f3c0c59f0 msgr2=0x7f1f3c06cd10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:02:31.488 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:31.484+0000 7f1f4291d640 1 -- 172.21.15.78:0/613651872 shutdown_connections 2023-11-28T20:02:31.488 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:31.484+0000 7f1f4291d640 1 -- 172.21.15.78:0/613651872 wait complete. 2023-11-28T20:02:31.506 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-28T20:02:31.647 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:31.640+0000 7f412dc54640 1 Processor -- start 2023-11-28T20:02:31.647 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:31.640+0000 7f412dc54640 1 -- start start 2023-11-28T20:02:31.648 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:31.644+0000 7f412dc54640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f412814fc30 0x7f41280c3cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:31.648 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:31.644+0000 7f412dc54640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4128152910 con 0x7f412814f850 2023-11-28T20:02:31.648 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:31.644+0000 7f412dc54640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4128152bf0 con 0x7f412806d840 2023-11-28T20:02:31.648 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:31.644+0000 7f412dc54640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f41280c2240 con 0x7f412814fc30 2023-11-28T20:02:31.648 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:31.644+0000 7f41277fe640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f412814f850 0x7f41280aacf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:55722/0 (socket says 172.21.15.78:55722) 2023-11-28T20:02:31.648 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:31.644+0000 7f41277fe640 1 -- 172.21.15.78:0/1509335803 learned_addr learned my addr 172.21.15.78:0/1509335803 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-11-28T20:02:31.650 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:31.644+0000 7f4126ffd640 1 -- 172.21.15.78:0/1509335803 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3318930758 0 0) 0x7f4128152910 con 0x7f412814f850 2023-11-28T20:02:31.651 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:31.644+0000 7f4126ffd640 1 -- 172.21.15.78:0/1509335803 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4114003530 con 0x7f412814f850 2023-11-28T20:02:31.651 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:31.644+0000 7f411ffff640 1 --2- 172.21.15.78:0/1509335803 >> v2:172.21.15.179:3300/0 conn(0x7f412814fc30 0x7f41280c3cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:02:31.651 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:31.644+0000 7f4126ffd640 1 -- 172.21.15.78:0/1509335803 <== mon.0 v1:172.21.15.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2337380786 0 0) 0x7f4114003530 con 0x7f412814f850 2023-11-28T20:02:31.651 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:31.644+0000 7f4126ffd640 1 -- 172.21.15.78:0/1509335803 >> v2:172.21.15.179:3300/0 conn(0x7f412814fc30 msgr2=0x7f41280c3cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:02:31.651 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:31.644+0000 7f4126ffd640 1 --2- 172.21.15.78:0/1509335803 >> v2:172.21.15.179:3300/0 conn(0x7f412814fc30 0x7f41280c3cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:31.651 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:31.644+0000 7f4126ffd640 1 -- 172.21.15.78:0/1509335803 >> v1:172.21.15.179:6789/0 conn(0x7f412806d840 legacy=0x7f41280c4210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:02:31.651 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:31.644+0000 7f4126ffd640 1 -- 172.21.15.78:0/1509335803 --> v1:172.21.15.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4128152ed0 con 0x7f412814f850 2023-11-28T20:02:31.651 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:31.644+0000 7f4126ffd640 1 -- 172.21.15.78:0/1509335803 <== mon.0 v1:172.21.15.78:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3326804700 0 0) 0x7f4118001680 con 0x7f412814f850 2023-11-28T20:02:31.651 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:31.644+0000 7f4126ffd640 1 -- 172.21.15.78:0/1509335803 >> v1:172.21.15.78:6789/0 conn(0x7f412814f850 legacy=0x7f41280aacf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:02:31.652 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:31.644+0000 7f4126ffd640 1 --2- 172.21.15.78:0/1509335803 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4114003980 0x7f4114003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:31.652 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:31.644+0000 7f4126ffd640 1 --2- 172.21.15.78:0/1509335803 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f41140047d0 0x7f4114004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:31.652 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:31.644+0000 7f4126ffd640 1 --2- 172.21.15.78:0/1509335803 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4114005190 0x7f411400b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:31.652 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:31.644+0000 7f4126ffd640 1 -- 172.21.15.78:0/1509335803 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41280c2240 con 0x7f4114005190 2023-11-28T20:02:31.652 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:31.644+0000 7f4126ffd640 1 -- 172.21.15.78:0/1509335803 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f411400c030 con 0x7f41140047d0 2023-11-28T20:02:31.652 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:31.644+0000 7f4126ffd640 1 -- 172.21.15.78:0/1509335803 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f411400c1f0 con 0x7f4114003980 2023-11-28T20:02:31.652 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:31.644+0000 7f4127fff640 1 --2- 172.21.15.78:0/1509335803 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4114005190 0x7f411400b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:02:31.652 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:31.644+0000 7f41277fe640 1 --2- 172.21.15.78:0/1509335803 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4114003980 0x7f4114003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:02:31.652 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:31.644+0000 7f411ffff640 1 --2- 172.21.15.78:0/1509335803 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f41140047d0 0x7f4114004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:02:31.652 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:31.644+0000 7f4127fff640 1 -- 172.21.15.78:0/1509335803 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4114003980 msgr2=0x7f4114003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:02:31.652 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:31.644+0000 7f4127fff640 1 --2- 172.21.15.78:0/1509335803 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4114003980 0x7f4114003da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:31.652 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:31.644+0000 7f4127fff640 1 -- 172.21.15.78:0/1509335803 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f41140047d0 msgr2=0x7f4114004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:02:31.653 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:31.644+0000 7f4127fff640 1 --2- 172.21.15.78:0/1509335803 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f41140047d0 0x7f4114004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:31.653 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:31.644+0000 7f4127fff640 1 -- 172.21.15.78:0/1509335803 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4114003530 con 0x7f4114005190 2023-11-28T20:02:31.654 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:31.648+0000 7f4127fff640 1 -- 172.21.15.78:0/1509335803 reap_dead start 2023-11-28T20:02:31.654 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:31.648+0000 7f4127fff640 1 --2- 172.21.15.78:0/1509335803 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4114005190 0x7f411400b990 secure :-1 s=READY pgs=979 cs=0 l=1 rev1=1 crypto rx=0x7f4120001e70 tx=0x7f412001c760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=86e6e46aa5a2dc34 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:02:31.654 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:31.648+0000 7f4126ffd640 1 -- 172.21.15.78:0/1509335803 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4120003b80 con 0x7f4114005190 2023-11-28T20:02:31.654 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:31.648+0000 7f4126ffd640 1 -- 172.21.15.78:0/1509335803 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4120003d20 con 0x7f4114005190 2023-11-28T20:02:31.654 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:31.648+0000 7f4126ffd640 1 -- 172.21.15.78:0/1509335803 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4120005260 con 0x7f4114005190 2023-11-28T20:02:31.654 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:31.648+0000 7f412dc54640 1 -- 172.21.15.78:0/1509335803 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4114005190 msgr2=0x7f411400b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:02:31.654 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:31.648+0000 7f412dc54640 1 --2- 172.21.15.78:0/1509335803 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4114005190 0x7f411400b990 secure :-1 s=READY pgs=979 cs=0 l=1 rev1=1 crypto rx=0x7f4120001e70 tx=0x7f412001c760 comp rx=0 tx=0).stop 2023-11-28T20:02:31.655 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:31.648+0000 7f412dc54640 1 -- 172.21.15.78:0/1509335803 shutdown_connections 2023-11-28T20:02:31.655 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:31.648+0000 7f412dc54640 1 --2- 172.21.15.78:0/1509335803 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4114005190 0x7f411400b990 unknown :-1 s=CLOSED pgs=979 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:31.655 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:31.648+0000 7f412dc54640 1 -- 172.21.15.78:0/1509335803 >> 172.21.15.78:0/1509335803 conn(0x7f41280c59f0 msgr2=0x7f41280c5e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:02:31.655 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:31.648+0000 7f412dc54640 1 -- 172.21.15.78:0/1509335803 shutdown_connections 2023-11-28T20:02:31.655 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:31.648+0000 7f412dc54640 1 -- 172.21.15.78:0/1509335803 wait complete. 2023-11-28T20:02:31.655 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:31.652+0000 7f412dc54640 1 Processor -- start 2023-11-28T20:02:31.656 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:31.652+0000 7f412dc54640 1 -- start start 2023-11-28T20:02:31.658 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:31.652+0000 7f412dc54640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4114005190 0x7f41280beff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:31.658 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:31.652+0000 7f412dc54640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f412806fac0 0x7f41280704f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:31.658 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:31.652+0000 7f412dc54640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f41280a92e0 0x7f412814aef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:31.658 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:31.652+0000 7f412dc54640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41280aab20 con 0x7f41280a92e0 2023-11-28T20:02:31.658 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:31.652+0000 7f412dc54640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41280729e0 con 0x7f412806fac0 2023-11-28T20:02:31.658 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:31.652+0000 7f412dc54640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f41281ea580 con 0x7f4114005190 2023-11-28T20:02:31.658 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:31.652+0000 7f4127fff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f41280a92e0 0x7f412814aef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:02:31.658 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:31.652+0000 7f4127fff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f41280a92e0 0x7f412814aef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:58734/0 (socket says 172.21.15.78:58734) 2023-11-28T20:02:31.658 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:31.652+0000 7f4127fff640 1 -- 172.21.15.78:0/1921964911 learned_addr learned my addr 172.21.15.78:0/1921964911 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T20:02:31.658 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:31.652+0000 7f411ffff640 1 --2- 172.21.15.78:0/1921964911 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f412806fac0 0x7f41280704f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:02:31.659 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:31.652+0000 7f41277fe640 1 --2- 172.21.15.78:0/1921964911 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4114005190 0x7f41280beff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:02:31.659 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:31.652+0000 7f4127fff640 1 -- 172.21.15.78:0/1921964911 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4114005190 msgr2=0x7f41280beff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:02:31.659 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:31.652+0000 7f4127fff640 1 --2- 172.21.15.78:0/1921964911 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4114005190 0x7f41280beff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:31.659 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:31.652+0000 7f4127fff640 1 -- 172.21.15.78:0/1921964911 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f412806fac0 msgr2=0x7f41280704f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:02:31.659 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:31.652+0000 7f4127fff640 1 --2- 172.21.15.78:0/1921964911 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f412806fac0 0x7f41280704f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:31.659 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:31.652+0000 7f4127fff640 1 -- 172.21.15.78:0/1921964911 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41281ea860 con 0x7f41280a92e0 2023-11-28T20:02:31.659 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:31.652+0000 7f4127fff640 1 --2- 172.21.15.78:0/1921964911 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f41280a92e0 0x7f412814aef0 secure :-1 s=READY pgs=980 cs=0 l=1 rev1=1 crypto rx=0x7f412001cc40 tx=0x7f4114005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:02:31.659 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:31.652+0000 7f4124ff9640 1 -- 172.21.15.78:0/1921964911 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41200ac070 con 0x7f41280a92e0 2023-11-28T20:02:31.659 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:31.652+0000 7f4124ff9640 1 -- 172.21.15.78:0/1921964911 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4120007dc0 con 0x7f41280a92e0 2023-11-28T20:02:31.659 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:31.652+0000 7f4124ff9640 1 -- 172.21.15.78:0/1921964911 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4120003b80 con 0x7f41280a92e0 2023-11-28T20:02:31.659 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:31.652+0000 7f412dc54640 1 -- 172.21.15.78:0/1921964911 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f41280a8ae0 con 0x7f41280a92e0 2023-11-28T20:02:31.660 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:31.652+0000 7f412dc54640 1 -- 172.21.15.78:0/1921964911 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f41280bf530 con 0x7f41280a92e0 2023-11-28T20:02:31.660 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:31.652+0000 7f412dc54640 1 -- 172.21.15.78:0/1921964911 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4128067630 con 0x7f41280a92e0 2023-11-28T20:02:31.660 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:31.656+0000 7f4124ff9640 1 -- 172.21.15.78:0/1921964911 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f4120006b60 con 0x7f41280a92e0 2023-11-28T20:02:31.661 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:31.656+0000 7f4124ff9640 1 --2- 172.21.15.78:0/1921964911 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f41080664a0 0x7f4108068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:31.661 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:31.656+0000 7f4124ff9640 1 -- 172.21.15.78:0/1921964911 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6885+0+0 (secure 0 0 0) 0x7f412011cf70 con 0x7f41280a92e0 2023-11-28T20:02:31.661 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:31.656+0000 7f41277fe640 1 --2- 172.21.15.78:0/1921964911 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f41080664a0 0x7f4108068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:02:31.661 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:31.656+0000 7f41277fe640 1 --2- 172.21.15.78:0/1921964911 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f41080664a0 0x7f4108068960 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f4118007d30 tx=0x7f4118009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:02:31.664 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:31.660+0000 7f4124ff9640 1 -- 172.21.15.78:0/1921964911 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f41200edb00 con 0x7f41280a92e0 2023-11-28T20:02:31.814 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:31.808+0000 7f412dc54640 1 -- 172.21.15.78:0/1921964911 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f41280a4a90 con 0x7f41280a92e0 2023-11-28T20:02:31.815 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:31.812+0000 7f4124ff9640 1 -- 172.21.15.78:0/1921964911 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v85) v1 ==== 104+0+11 (secure 0 0 0) 0x7f41200b50a0 con 0x7f41280a92e0 2023-11-28T20:02:31.815 INFO:teuthology.orchestra.run.smithi078.stdout:pg_num: 32 2023-11-28T20:02:31.817 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:31.812+0000 7f412dc54640 1 -- 172.21.15.78:0/1921964911 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f41080664a0 msgr2=0x7f4108068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:02:31.817 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:31.812+0000 7f412dc54640 1 --2- 172.21.15.78:0/1921964911 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f41080664a0 0x7f4108068960 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f4118007d30 tx=0x7f4118009040 comp rx=0 tx=0).stop 2023-11-28T20:02:31.817 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:31.812+0000 7f412dc54640 1 -- 172.21.15.78:0/1921964911 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f41280a92e0 msgr2=0x7f412814aef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:02:31.817 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:31.812+0000 7f412dc54640 1 --2- 172.21.15.78:0/1921964911 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f41280a92e0 0x7f412814aef0 secure :-1 s=READY pgs=980 cs=0 l=1 rev1=1 crypto rx=0x7f412001cc40 tx=0x7f4114005800 comp rx=0 tx=0).stop 2023-11-28T20:02:31.817 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:31.812+0000 7f412dc54640 1 -- 172.21.15.78:0/1921964911 shutdown_connections 2023-11-28T20:02:31.817 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:31.812+0000 7f412dc54640 1 --2- 172.21.15.78:0/1921964911 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f41080664a0 0x7f4108068960 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:31.817 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:31.812+0000 7f412dc54640 1 --2- 172.21.15.78:0/1921964911 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f41280a92e0 0x7f412814aef0 unknown :-1 s=CLOSED pgs=980 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:31.817 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:31.812+0000 7f412dc54640 1 --2- 172.21.15.78:0/1921964911 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f412806fac0 0x7f41280704f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:31.817 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:31.812+0000 7f412dc54640 1 --2- 172.21.15.78:0/1921964911 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4114005190 0x7f41280beff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:31.817 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:31.812+0000 7f412dc54640 1 -- 172.21.15.78:0/1921964911 >> 172.21.15.78:0/1921964911 conn(0x7f41280c59f0 msgr2=0x7f41280c4a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:02:31.818 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:31.812+0000 7f412dc54640 1 -- 172.21.15.78:0/1921964911 shutdown_connections 2023-11-28T20:02:31.818 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:31.812+0000 7f412dc54640 1 -- 172.21.15.78:0/1921964911 wait complete. 2023-11-28T20:02:31.836 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-28T20:02:31.976 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:31.972+0000 7f094259d640 1 Processor -- start 2023-11-28T20:02:31.976 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:31.972+0000 7f094259d640 1 -- start start 2023-11-28T20:02:31.977 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:31.972+0000 7f094259d640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f093c14fc30 0x7f093c0c3cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:31.977 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:31.972+0000 7f094259d640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f093c06d840 0x7f093c0c4210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:31.977 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:31.972+0000 7f094259d640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f093c152910 con 0x7f093c14f850 2023-11-28T20:02:31.977 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:31.972+0000 7f094259d640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f093c0c2240 con 0x7f093c14fc30 2023-11-28T20:02:31.978 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:31.972+0000 7f094259d640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f093c152bf0 con 0x7f093c06d840 2023-11-28T20:02:31.978 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:31.972+0000 7f093bfff640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f093c14f850 0x7f093c0aacf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:55728/0 (socket says 172.21.15.78:55728) 2023-11-28T20:02:31.978 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:31.972+0000 7f093bfff640 1 -- 172.21.15.78:0/2596861704 learned_addr learned my addr 172.21.15.78:0/2596861704 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-11-28T20:02:31.978 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:31.972+0000 7f093b7fe640 1 --2- 172.21.15.78:0/2596861704 >> v2:172.21.15.78:3300/0 conn(0x7f093c14fc30 0x7f093c0c3cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:02:31.979 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:31.972+0000 7f0940b3a640 1 --2- 172.21.15.78:0/2596861704 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f093c06d840 0x7f093c0c4210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:02:31.979 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:31.972+0000 7f093affd640 1 -- 172.21.15.78:0/2596861704 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2265109970 0 0) 0x7f093c152910 con 0x7f093c14f850 2023-11-28T20:02:31.979 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:31.972+0000 7f093b7fe640 1 -- 172.21.15.78:0/2596861704 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f093c06d840 msgr2=0x7f093c0c4210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:02:31.979 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:31.972+0000 7f093b7fe640 1 --2- 172.21.15.78:0/2596861704 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f093c06d840 0x7f093c0c4210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:31.979 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:31.972+0000 7f093b7fe640 1 -- 172.21.15.78:0/2596861704 >> v1:172.21.15.78:6789/0 conn(0x7f093c14f850 legacy=0x7f093c0aacf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:02:31.979 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:31.972+0000 7f093b7fe640 1 -- 172.21.15.78:0/2596861704 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f093c152ed0 con 0x7f093c14fc30 2023-11-28T20:02:31.981 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:31.976+0000 7f093b7fe640 1 --2- 172.21.15.78:0/2596861704 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f093c14fc30 0x7f093c0c3cd0 secure :-1 s=READY pgs=982 cs=0 l=1 rev1=1 crypto rx=0x7f09300097c0 tx=0x7f093001c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=48c593a923ad7b18 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:02:31.981 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:31.976+0000 7f093affd640 1 -- 172.21.15.78:0/2596861704 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09300ac410 con 0x7f093c14fc30 2023-11-28T20:02:31.981 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:31.976+0000 7f093affd640 1 -- 172.21.15.78:0/2596861704 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f09300ac570 con 0x7f093c14fc30 2023-11-28T20:02:31.981 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:31.976+0000 7f093affd640 1 -- 172.21.15.78:0/2596861704 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09300ac900 con 0x7f093c14fc30 2023-11-28T20:02:31.982 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:31.976+0000 7f094259d640 1 -- 172.21.15.78:0/2596861704 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f093c14fc30 msgr2=0x7f093c0c3cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:02:31.982 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:31.976+0000 7f094259d640 1 --2- 172.21.15.78:0/2596861704 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f093c14fc30 0x7f093c0c3cd0 secure :-1 s=READY pgs=982 cs=0 l=1 rev1=1 crypto rx=0x7f09300097c0 tx=0x7f093001c480 comp rx=0 tx=0).stop 2023-11-28T20:02:31.982 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:31.976+0000 7f094259d640 1 -- 172.21.15.78:0/2596861704 shutdown_connections 2023-11-28T20:02:31.982 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:31.976+0000 7f094259d640 1 --2- 172.21.15.78:0/2596861704 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f093c06d840 0x7f093c0c4210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:31.982 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:31.976+0000 7f094259d640 1 --2- 172.21.15.78:0/2596861704 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f093c14fc30 0x7f093c0c3cd0 unknown :-1 s=CLOSED pgs=982 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:31.983 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:31.976+0000 7f094259d640 1 -- 172.21.15.78:0/2596861704 >> 172.21.15.78:0/2596861704 conn(0x7f093c0c59f0 msgr2=0x7f093c0c5e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:02:31.983 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:31.976+0000 7f094259d640 1 -- 172.21.15.78:0/2596861704 shutdown_connections 2023-11-28T20:02:31.983 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:31.976+0000 7f094259d640 1 -- 172.21.15.78:0/2596861704 wait complete. 2023-11-28T20:02:31.984 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:31.980+0000 7f094259d640 1 Processor -- start 2023-11-28T20:02:31.984 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:31.980+0000 7f094259d640 1 -- start start 2023-11-28T20:02:31.986 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:31.980+0000 7f094259d640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f093c06d840 0x7f093c14b600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:31.987 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:31.980+0000 7f094259d640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f093c14f850 0x7f093c0a6910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:31.987 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:31.980+0000 7f094259d640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f093c14fc30 0x7f093c1ede10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:31.987 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:31.980+0000 7f094259d640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f093c0a74b0 con 0x7f093c06d840 2023-11-28T20:02:31.987 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:31.980+0000 7f094259d640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f093c1f1800 con 0x7f093c14f850 2023-11-28T20:02:31.987 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:31.980+0000 7f094259d640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f093c1f1d30 con 0x7f093c14fc30 2023-11-28T20:02:31.987 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:31.980+0000 7f093bfff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f093c06d840 0x7f093c14b600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:02:31.987 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:31.980+0000 7f093bfff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f093c06d840 0x7f093c14b600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:58756/0 (socket says 172.21.15.78:58756) 2023-11-28T20:02:31.987 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:31.980+0000 7f093bfff640 1 -- 172.21.15.78:0/2652581386 learned_addr learned my addr 172.21.15.78:0/2652581386 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T20:02:31.987 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:31.980+0000 7f0940b3a640 1 --2- 172.21.15.78:0/2652581386 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f093c14fc30 0x7f093c1ede10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:02:31.987 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:31.980+0000 7f093b7fe640 1 --2- 172.21.15.78:0/2652581386 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f093c14f850 0x7f093c0a6910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:02:31.988 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:31.980+0000 7f093bfff640 1 -- 172.21.15.78:0/2652581386 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f093c14fc30 msgr2=0x7f093c1ede10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:02:31.988 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:31.980+0000 7f093bfff640 1 --2- 172.21.15.78:0/2652581386 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f093c14fc30 0x7f093c1ede10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:31.988 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:31.980+0000 7f093bfff640 1 -- 172.21.15.78:0/2652581386 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f093c14f850 msgr2=0x7f093c0a6910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:02:31.988 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:31.980+0000 7f093bfff640 1 --2- 172.21.15.78:0/2652581386 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f093c14f850 0x7f093c0a6910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:31.988 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:31.980+0000 7f093bfff640 1 -- 172.21.15.78:0/2652581386 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0930009420 con 0x7f093c06d840 2023-11-28T20:02:31.988 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:31.980+0000 7f0940b3a640 1 --2- 172.21.15.78:0/2652581386 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f093c14fc30 0x7f093c1ede10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T20:02:31.988 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:31.980+0000 7f093bfff640 1 --2- 172.21.15.78:0/2652581386 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f093c06d840 0x7f093c14b600 secure :-1 s=READY pgs=983 cs=0 l=1 rev1=1 crypto rx=0x7f092c00c550 tx=0x7f092c00ca10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:02:31.988 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:31.980+0000 7f0938ff9640 1 -- 172.21.15.78:0/2652581386 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f092c005cf0 con 0x7f093c06d840 2023-11-28T20:02:31.988 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:31.980+0000 7f0938ff9640 1 -- 172.21.15.78:0/2652581386 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f092c005e70 con 0x7f093c06d840 2023-11-28T20:02:31.988 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:31.980+0000 7f0938ff9640 1 -- 172.21.15.78:0/2652581386 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f092c007310 con 0x7f093c06d840 2023-11-28T20:02:31.988 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:31.980+0000 7f094259d640 1 -- 172.21.15.78:0/2652581386 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f093c1f1a50 con 0x7f093c06d840 2023-11-28T20:02:31.989 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:31.980+0000 7f094259d640 1 -- 172.21.15.78:0/2652581386 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f093c06fed0 con 0x7f093c06d840 2023-11-28T20:02:31.989 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:31.984+0000 7f094259d640 1 -- 172.21.15.78:0/2652581386 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f093c067630 con 0x7f093c06d840 2023-11-28T20:02:31.990 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:31.984+0000 7f0938ff9640 1 -- 172.21.15.78:0/2652581386 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f092c007470 con 0x7f093c06d840 2023-11-28T20:02:31.990 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:31.984+0000 7f0938ff9640 1 --2- 172.21.15.78:0/2652581386 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f0928066470 0x7f0928068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:31.990 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:31.984+0000 7f0938ff9640 1 -- 172.21.15.78:0/2652581386 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6885+0+0 (secure 0 0 0) 0x7f092c083910 con 0x7f093c06d840 2023-11-28T20:02:31.990 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:31.984+0000 7f093b7fe640 1 --2- 172.21.15.78:0/2652581386 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f0928066470 0x7f0928068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:02:31.990 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:31.984+0000 7f093b7fe640 1 --2- 172.21.15.78:0/2652581386 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f0928066470 0x7f0928068930 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f09300ae000 tx=0x7f0930008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:02:31.992 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:31.988+0000 7f0938ff9640 1 -- 172.21.15.78:0/2652581386 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f092c050980 con 0x7f093c06d840 2023-11-28T20:02:32.144 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:32.140+0000 7f094259d640 1 -- 172.21.15.78:0/2652581386 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f093c0ab1b0 con 0x7f093c06d840 2023-11-28T20:02:32.144 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:32.140+0000 7f0938ff9640 1 -- 172.21.15.78:0/2652581386 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v85) v1 ==== 100+0+11 (secure 0 0 0) 0x7f092c0170a0 con 0x7f093c06d840 2023-11-28T20:02:32.144 INFO:teuthology.orchestra.run.smithi078.stdout:pg_num: 64 2023-11-28T20:02:32.146 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:32.140+0000 7f094259d640 1 -- 172.21.15.78:0/2652581386 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f0928066470 msgr2=0x7f0928068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:02:32.146 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:32.140+0000 7f094259d640 1 --2- 172.21.15.78:0/2652581386 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f0928066470 0x7f0928068930 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f09300ae000 tx=0x7f0930008040 comp rx=0 tx=0).stop 2023-11-28T20:02:32.146 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:32.140+0000 7f094259d640 1 -- 172.21.15.78:0/2652581386 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f093c06d840 msgr2=0x7f093c14b600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:02:32.147 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:32.140+0000 7f094259d640 1 --2- 172.21.15.78:0/2652581386 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f093c06d840 0x7f093c14b600 secure :-1 s=READY pgs=983 cs=0 l=1 rev1=1 crypto rx=0x7f092c00c550 tx=0x7f092c00ca10 comp rx=0 tx=0).stop 2023-11-28T20:02:32.147 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:32.140+0000 7f094259d640 1 -- 172.21.15.78:0/2652581386 shutdown_connections 2023-11-28T20:02:32.147 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:32.140+0000 7f094259d640 1 --2- 172.21.15.78:0/2652581386 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f0928066470 0x7f0928068930 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:32.147 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:32.140+0000 7f094259d640 1 --2- 172.21.15.78:0/2652581386 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f093c14fc30 0x7f093c1ede10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:32.147 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:32.140+0000 7f094259d640 1 --2- 172.21.15.78:0/2652581386 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f093c14f850 0x7f093c0a6910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:32.147 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:32.140+0000 7f094259d640 1 --2- 172.21.15.78:0/2652581386 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f093c06d840 0x7f093c14b600 unknown :-1 s=CLOSED pgs=983 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:32.147 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:32.140+0000 7f094259d640 1 -- 172.21.15.78:0/2652581386 >> 172.21.15.78:0/2652581386 conn(0x7f093c0c59f0 msgr2=0x7f093c14ed70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:02:32.147 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:32.140+0000 7f094259d640 1 -- 172.21.15.78:0/2652581386 shutdown_connections 2023-11-28T20:02:32.147 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:32.140+0000 7f094259d640 1 -- 172.21.15.78:0/2652581386 wait complete. 2023-11-28T20:02:32.165 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs2_metadata pg_num 2023-11-28T20:02:32.306 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:32.300+0000 7fdd748c8640 1 Processor -- start 2023-11-28T20:02:32.307 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:32.300+0000 7fdd748c8640 1 -- start start 2023-11-28T20:02:32.309 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:32.304+0000 7fdd748c8640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdd700ca330 0x7fdd700ca710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:32.309 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:32.304+0000 7fdd748c8640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fdd700c45a0 0x7fdd70154e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:32.309 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:32.304+0000 7fdd748c8640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdd70151e40 con 0x7fdd7006c480 2023-11-28T20:02:32.309 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:32.304+0000 7fdd748c8640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdd700c54b0 con 0x7fdd700c45a0 2023-11-28T20:02:32.309 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:32.304+0000 7fdd748c8640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdd701553c0 con 0x7fdd700ca330 2023-11-28T20:02:32.309 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:32.304+0000 7fdd67fff640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fdd700c45a0 0x7fdd70154e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:02:32.309 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:32.304+0000 7fdd67fff640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fdd700c45a0 0x7fdd70154e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:58758/0 (socket says 172.21.15.78:58758) 2023-11-28T20:02:32.309 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:32.304+0000 7fdd67fff640 1 -- 172.21.15.78:0/3550859759 learned_addr learned my addr 172.21.15.78:0/3550859759 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T20:02:32.309 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:32.304+0000 7fdd6f59e640 1 --1- 172.21.15.78:0/3550859759 >> v1:172.21.15.78:6789/0 conn(0x7fdd7006c480 0x7fdd700c7d40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:55732/0 (socket says 172.21.15.78:55732) 2023-11-28T20:02:32.309 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:32.304+0000 7fdd6ed9d640 1 --2- 172.21.15.78:0/3550859759 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdd700ca330 0x7fdd700ca710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:02:32.310 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:32.304+0000 7fdd67fff640 1 -- 172.21.15.78:0/3550859759 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdd700ca330 msgr2=0x7fdd700ca710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:02:32.310 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:32.304+0000 7fdd67fff640 1 --2- 172.21.15.78:0/3550859759 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdd700ca330 0x7fdd700ca710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:32.310 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:32.304+0000 7fdd67fff640 1 -- 172.21.15.78:0/3550859759 >> v1:172.21.15.78:6789/0 conn(0x7fdd7006c480 legacy=0x7fdd700c7d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:02:32.310 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:32.304+0000 7fdd67fff640 1 -- 172.21.15.78:0/3550859759 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd7006b9e0 con 0x7fdd700c45a0 2023-11-28T20:02:32.312 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:32.308+0000 7fdd67fff640 1 --2- 172.21.15.78:0/3550859759 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdd700c45a0 0x7fdd70154e80 secure :-1 s=READY pgs=985 cs=0 l=1 rev1=1 crypto rx=0x7fdd58009870 tx=0x7fdd5801ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ad41ee7dd21c2955 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:02:32.312 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:32.308+0000 7fdd6e59c640 1 -- 172.21.15.78:0/3550859759 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd580a8a30 con 0x7fdd700c45a0 2023-11-28T20:02:32.312 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:32.308+0000 7fdd6e59c640 1 -- 172.21.15.78:0/3550859759 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd580a8b90 con 0x7fdd700c45a0 2023-11-28T20:02:32.312 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:32.308+0000 7fdd6e59c640 1 -- 172.21.15.78:0/3550859759 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd580b0440 con 0x7fdd700c45a0 2023-11-28T20:02:32.313 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:32.308+0000 7fdd748c8640 1 -- 172.21.15.78:0/3550859759 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdd700c45a0 msgr2=0x7fdd70154e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:02:32.313 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:32.308+0000 7fdd748c8640 1 --2- 172.21.15.78:0/3550859759 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdd700c45a0 0x7fdd70154e80 secure :-1 s=READY pgs=985 cs=0 l=1 rev1=1 crypto rx=0x7fdd58009870 tx=0x7fdd5801ed30 comp rx=0 tx=0).stop 2023-11-28T20:02:32.313 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:32.308+0000 7fdd748c8640 1 -- 172.21.15.78:0/3550859759 shutdown_connections 2023-11-28T20:02:32.313 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:32.308+0000 7fdd748c8640 1 --2- 172.21.15.78:0/3550859759 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdd700c45a0 0x7fdd70154e80 unknown :-1 s=CLOSED pgs=985 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:32.313 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:32.308+0000 7fdd748c8640 1 --2- 172.21.15.78:0/3550859759 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdd700ca330 0x7fdd700ca710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:32.313 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:32.308+0000 7fdd748c8640 1 -- 172.21.15.78:0/3550859759 >> 172.21.15.78:0/3550859759 conn(0x7fdd700abdb0 msgr2=0x7fdd700c9c20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:02:32.313 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:32.308+0000 7fdd748c8640 1 -- 172.21.15.78:0/3550859759 shutdown_connections 2023-11-28T20:02:32.313 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:32.308+0000 7fdd748c8640 1 -- 172.21.15.78:0/3550859759 wait complete. 2023-11-28T20:02:32.314 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:32.308+0000 7fdd748c8640 1 Processor -- start 2023-11-28T20:02:32.315 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:32.308+0000 7fdd748c8640 1 -- start start 2023-11-28T20:02:32.317 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:32.312+0000 7fdd748c8640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdd7006c480 0x7fdd701ed530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:32.317 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:32.312+0000 7fdd748c8640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdd700c45a0 0x7fdd70157660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:32.317 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:32.312+0000 7fdd748c8640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdd700ca330 0x7fdd70157ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:32.317 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:32.312+0000 7fdd748c8640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd7014ab80 con 0x7fdd700ca330 2023-11-28T20:02:32.318 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:32.312+0000 7fdd748c8640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd701ee180 con 0x7fdd700c45a0 2023-11-28T20:02:32.318 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:32.312+0000 7fdd748c8640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdd700ace60 con 0x7fdd7006c480 2023-11-28T20:02:32.318 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:32.312+0000 7fdd6f59e640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdd700ca330 0x7fdd70157ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:02:32.318 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:32.312+0000 7fdd67fff640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdd700c45a0 0x7fdd70157660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:02:32.318 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:32.312+0000 7fdd6f59e640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdd700ca330 0x7fdd70157ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:58772/0 (socket says 172.21.15.78:58772) 2023-11-28T20:02:32.318 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:32.312+0000 7fdd6ed9d640 1 --2- 172.21.15.78:0/432308156 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdd7006c480 0x7fdd701ed530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:02:32.318 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:32.312+0000 7fdd6f59e640 1 -- 172.21.15.78:0/432308156 learned_addr learned my addr 172.21.15.78:0/432308156 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T20:02:32.318 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:32.312+0000 7fdd6ed9d640 1 -- 172.21.15.78:0/432308156 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdd700c45a0 msgr2=0x7fdd70157660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:02:32.318 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:32.312+0000 7fdd6ed9d640 1 --2- 172.21.15.78:0/432308156 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdd700c45a0 0x7fdd70157660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:32.318 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:32.312+0000 7fdd6ed9d640 1 -- 172.21.15.78:0/432308156 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdd700ca330 msgr2=0x7fdd70157ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:02:32.318 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:32.312+0000 7fdd6ed9d640 1 --2- 172.21.15.78:0/432308156 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdd700ca330 0x7fdd70157ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:32.319 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:32.312+0000 7fdd6ed9d640 1 -- 172.21.15.78:0/432308156 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd580094d0 con 0x7fdd7006c480 2023-11-28T20:02:32.319 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:32.312+0000 7fdd6f59e640 1 --2- 172.21.15.78:0/432308156 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdd700ca330 0x7fdd70157ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T20:02:32.319 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:32.312+0000 7fdd6ed9d640 1 --2- 172.21.15.78:0/432308156 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdd7006c480 0x7fdd701ed530 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fdd6000e8a0 tx=0x7fdd6000ed60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:02:32.319 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:32.312+0000 7fdd677fe640 1 -- 172.21.15.78:0/432308156 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd6000c940 con 0x7fdd7006c480 2023-11-28T20:02:32.319 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:32.312+0000 7fdd677fe640 1 -- 172.21.15.78:0/432308156 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd6000caa0 con 0x7fdd7006c480 2023-11-28T20:02:32.319 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:32.312+0000 7fdd748c8640 1 -- 172.21.15.78:0/432308156 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdd7014b540 con 0x7fdd7006c480 2023-11-28T20:02:32.319 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:32.312+0000 7fdd677fe640 1 -- 172.21.15.78:0/432308156 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd6000ce10 con 0x7fdd7006c480 2023-11-28T20:02:32.319 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:32.312+0000 7fdd748c8640 1 -- 172.21.15.78:0/432308156 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdd701ede10 con 0x7fdd7006c480 2023-11-28T20:02:32.320 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:32.312+0000 7fdd748c8640 1 -- 172.21.15.78:0/432308156 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdd700674b0 con 0x7fdd7006c480 2023-11-28T20:02:32.320 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:32.316+0000 7fdd677fe640 1 -- 172.21.15.78:0/432308156 <== mon.2 v2:172.21.15.179:3301/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fdd60013470 con 0x7fdd7006c480 2023-11-28T20:02:32.320 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:32.316+0000 7fdd677fe640 1 --2- 172.21.15.78:0/432308156 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fdd50066470 0x7fdd50068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:32.320 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:32.316+0000 7fdd677fe640 1 -- 172.21.15.78:0/432308156 <== mon.2 v2:172.21.15.179:3301/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6885+0+0 (secure 0 0 0) 0x7fdd600843f0 con 0x7fdd7006c480 2023-11-28T20:02:32.321 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:32.316+0000 7fdd67fff640 1 --2- 172.21.15.78:0/432308156 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fdd50066470 0x7fdd50068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:02:32.321 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:32.316+0000 7fdd67fff640 1 --2- 172.21.15.78:0/432308156 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fdd50066470 0x7fdd50068930 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7fdd580b2000 tx=0x7fdd58009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:02:32.325 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:32.320+0000 7fdd677fe640 1 -- 172.21.15.78:0/432308156 <== mon.2 v2:172.21.15.179:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fdd60051470 con 0x7fdd7006c480 2023-11-28T20:02:32.475 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:32.472+0000 7fdd748c8640 1 -- 172.21.15.78:0/432308156 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs2_metadata", "var": "pg_num"} v 0) v1 -- 0x7fdd700caa30 con 0x7fdd7006c480 2023-11-28T20:02:32.475 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:32.472+0000 7fdd677fe640 1 -- 172.21.15.78:0/432308156 <== mon.2 v2:172.21.15.179:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs2_metadata", "var": "pg_num"}]=0 v85) v1 ==== 105+0+11 (secure 0 0 0) 0x7fdd60054a90 con 0x7fdd7006c480 2023-11-28T20:02:32.476 INFO:teuthology.orchestra.run.smithi078.stdout:pg_num: 32 2023-11-28T20:02:32.478 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:32.472+0000 7fdd748c8640 1 -- 172.21.15.78:0/432308156 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fdd50066470 msgr2=0x7fdd50068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:02:32.478 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:32.472+0000 7fdd748c8640 1 --2- 172.21.15.78:0/432308156 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fdd50066470 0x7fdd50068930 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7fdd580b2000 tx=0x7fdd58009040 comp rx=0 tx=0).stop 2023-11-28T20:02:32.478 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:32.472+0000 7fdd748c8640 1 -- 172.21.15.78:0/432308156 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdd7006c480 msgr2=0x7fdd701ed530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:02:32.478 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:32.472+0000 7fdd748c8640 1 --2- 172.21.15.78:0/432308156 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdd7006c480 0x7fdd701ed530 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fdd6000e8a0 tx=0x7fdd6000ed60 comp rx=0 tx=0).stop 2023-11-28T20:02:32.478 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:32.472+0000 7fdd748c8640 1 -- 172.21.15.78:0/432308156 shutdown_connections 2023-11-28T20:02:32.478 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:32.472+0000 7fdd748c8640 1 --2- 172.21.15.78:0/432308156 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fdd50066470 0x7fdd50068930 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:32.478 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:32.472+0000 7fdd748c8640 1 --2- 172.21.15.78:0/432308156 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdd700ca330 0x7fdd70157ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:32.479 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:32.472+0000 7fdd748c8640 1 --2- 172.21.15.78:0/432308156 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdd700c45a0 0x7fdd70157660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:32.479 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:32.472+0000 7fdd748c8640 1 --2- 172.21.15.78:0/432308156 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdd7006c480 0x7fdd701ed530 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:32.479 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:32.472+0000 7fdd748c8640 1 -- 172.21.15.78:0/432308156 >> 172.21.15.78:0/432308156 conn(0x7fdd700abdb0 msgr2=0x7fdd701548a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:02:32.479 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:32.472+0000 7fdd748c8640 1 -- 172.21.15.78:0/432308156 shutdown_connections 2023-11-28T20:02:32.479 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:32.472+0000 7fdd748c8640 1 -- 172.21.15.78:0/432308156 wait complete. 2023-11-28T20:02:32.497 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs2_data pg_num 2023-11-28T20:02:32.636 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:32.632+0000 7fa3eedaa640 1 Processor -- start 2023-11-28T20:02:32.636 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:32.632+0000 7fa3eedaa640 1 -- start start 2023-11-28T20:02:32.638 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:32.632+0000 7fa3eedaa640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fa3e814fc30 0x7fa3e80c3cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:32.638 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:32.632+0000 7fa3eedaa640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa3e8152910 con 0x7fa3e814f850 2023-11-28T20:02:32.638 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:32.632+0000 7fa3eedaa640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa3e8152bf0 con 0x7fa3e806d840 2023-11-28T20:02:32.638 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:32.632+0000 7fa3eedaa640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa3e80c2240 con 0x7fa3e814fc30 2023-11-28T20:02:32.638 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:32.632+0000 7fa3ecb46640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7fa3e814f850 0x7fa3e80aacf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:55748/0 (socket says 172.21.15.78:55748) 2023-11-28T20:02:32.638 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:32.632+0000 7fa3ecb46640 1 -- 172.21.15.78:0/1782139802 learned_addr learned my addr 172.21.15.78:0/1782139802 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-11-28T20:02:32.639 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:32.632+0000 7fa3dffff640 1 --2- 172.21.15.78:0/1782139802 >> v2:172.21.15.179:3300/0 conn(0x7fa3e814fc30 0x7fa3e80c3cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:02:32.639 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:32.632+0000 7fa3df7fe640 1 -- 172.21.15.78:0/1782139802 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3875386348 0 0) 0x7fa3e8152910 con 0x7fa3e814f850 2023-11-28T20:02:32.639 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:32.632+0000 7fa3df7fe640 1 -- 172.21.15.78:0/1782139802 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa3d0003530 con 0x7fa3e814f850 2023-11-28T20:02:32.640 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:32.632+0000 7fa3df7fe640 1 -- 172.21.15.78:0/1782139802 <== mon.0 v1:172.21.15.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 847943599 0 0) 0x7fa3d0003530 con 0x7fa3e814f850 2023-11-28T20:02:32.640 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:32.632+0000 7fa3df7fe640 1 -- 172.21.15.78:0/1782139802 >> v2:172.21.15.179:3300/0 conn(0x7fa3e814fc30 msgr2=0x7fa3e80c3cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:02:32.641 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:32.632+0000 7fa3df7fe640 1 --2- 172.21.15.78:0/1782139802 >> v2:172.21.15.179:3300/0 conn(0x7fa3e814fc30 0x7fa3e80c3cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:32.641 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:32.632+0000 7fa3df7fe640 1 -- 172.21.15.78:0/1782139802 >> v1:172.21.15.179:6789/0 conn(0x7fa3e806d840 legacy=0x7fa3e80c4210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:02:32.641 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:32.632+0000 7fa3df7fe640 1 -- 172.21.15.78:0/1782139802 --> v1:172.21.15.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3e8152ed0 con 0x7fa3e814f850 2023-11-28T20:02:32.641 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:32.632+0000 7fa3df7fe640 1 -- 172.21.15.78:0/1782139802 <== mon.0 v1:172.21.15.78:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3326804700 0 0) 0x7fa3e4001680 con 0x7fa3e814f850 2023-11-28T20:02:32.641 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:32.632+0000 7fa3df7fe640 1 -- 172.21.15.78:0/1782139802 >> v1:172.21.15.78:6789/0 conn(0x7fa3e814f850 legacy=0x7fa3e80aacf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:02:32.641 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:32.632+0000 7fa3df7fe640 1 --2- 172.21.15.78:0/1782139802 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa3d00039d0 0x7fa3d0003df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:32.641 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:32.632+0000 7fa3df7fe640 1 --2- 172.21.15.78:0/1782139802 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa3d00047d0 0x7fa3d0004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:32.641 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:32.632+0000 7fa3df7fe640 1 --2- 172.21.15.78:0/1782139802 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa3d0005190 0x7fa3d000b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:32.641 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:32.632+0000 7fa3df7fe640 1 -- 172.21.15.78:0/1782139802 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3e80c2240 con 0x7fa3d00047d0 2023-11-28T20:02:32.641 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:32.632+0000 7fa3df7fe640 1 -- 172.21.15.78:0/1782139802 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3d000c090 con 0x7fa3d00039d0 2023-11-28T20:02:32.641 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:32.632+0000 7fa3df7fe640 1 -- 172.21.15.78:0/1782139802 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa3d000c250 con 0x7fa3d0005190 2023-11-28T20:02:32.642 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:32.632+0000 7fa3dffff640 1 --2- 172.21.15.78:0/1782139802 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa3d00047d0 0x7fa3d0004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:02:32.642 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:32.632+0000 7fa3ecb46640 1 --2- 172.21.15.78:0/1782139802 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa3d00039d0 0x7fa3d0003df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:02:32.642 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:32.636+0000 7fa3ed347640 1 --2- 172.21.15.78:0/1782139802 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa3d0005190 0x7fa3d000b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:02:32.642 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:32.636+0000 7fa3dffff640 1 -- 172.21.15.78:0/1782139802 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa3d0005190 msgr2=0x7fa3d000b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:02:32.642 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:32.636+0000 7fa3dffff640 1 --2- 172.21.15.78:0/1782139802 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa3d0005190 0x7fa3d000b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:32.642 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:32.636+0000 7fa3dffff640 1 -- 172.21.15.78:0/1782139802 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa3d00039d0 msgr2=0x7fa3d0003df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:02:32.642 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:32.636+0000 7fa3dffff640 1 --2- 172.21.15.78:0/1782139802 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa3d00039d0 0x7fa3d0003df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:32.642 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:32.636+0000 7fa3dffff640 1 -- 172.21.15.78:0/1782139802 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3d0003530 con 0x7fa3d00047d0 2023-11-28T20:02:32.642 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:32.636+0000 7fa3ecb46640 1 --2- 172.21.15.78:0/1782139802 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa3d00039d0 0x7fa3d0003df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T20:02:32.642 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:32.636+0000 7fa3ed347640 1 -- 172.21.15.78:0/1782139802 reap_dead start 2023-11-28T20:02:32.643 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:32.636+0000 7fa3dffff640 1 --2- 172.21.15.78:0/1782139802 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa3d00047d0 0x7fa3d0004c50 secure :-1 s=READY pgs=987 cs=0 l=1 rev1=1 crypto rx=0x7fa3d8009ae0 tx=0x7fa3d801ca50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6eda4af1bf77058 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:02:32.644 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:32.636+0000 7fa3df7fe640 1 -- 172.21.15.78:0/1782139802 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3d80a5530 con 0x7fa3d00047d0 2023-11-28T20:02:32.644 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:32.636+0000 7fa3df7fe640 1 -- 172.21.15.78:0/1782139802 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa3d80a5690 con 0x7fa3d00047d0 2023-11-28T20:02:32.644 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:32.636+0000 7fa3df7fe640 1 -- 172.21.15.78:0/1782139802 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3d80a5a40 con 0x7fa3d00047d0 2023-11-28T20:02:32.644 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:32.636+0000 7fa3eedaa640 1 -- 172.21.15.78:0/1782139802 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa3d00047d0 msgr2=0x7fa3d0004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:02:32.644 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:32.636+0000 7fa3eedaa640 1 --2- 172.21.15.78:0/1782139802 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa3d00047d0 0x7fa3d0004c50 secure :-1 s=READY pgs=987 cs=0 l=1 rev1=1 crypto rx=0x7fa3d8009ae0 tx=0x7fa3d801ca50 comp rx=0 tx=0).stop 2023-11-28T20:02:32.644 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:32.636+0000 7fa3eedaa640 1 -- 172.21.15.78:0/1782139802 shutdown_connections 2023-11-28T20:02:32.644 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:32.636+0000 7fa3eedaa640 1 --2- 172.21.15.78:0/1782139802 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa3d00047d0 0x7fa3d0004c50 unknown :-1 s=CLOSED pgs=987 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:32.644 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:32.636+0000 7fa3eedaa640 1 -- 172.21.15.78:0/1782139802 >> 172.21.15.78:0/1782139802 conn(0x7fa3e80c59f0 msgr2=0x7fa3e80c5e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:02:32.644 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:32.640+0000 7fa3eedaa640 1 -- 172.21.15.78:0/1782139802 shutdown_connections 2023-11-28T20:02:32.644 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:32.640+0000 7fa3eedaa640 1 -- 172.21.15.78:0/1782139802 wait complete. 2023-11-28T20:02:32.649 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:32.640+0000 7fa3eedaa640 1 Processor -- start 2023-11-28T20:02:32.649 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:32.640+0000 7fa3eedaa640 1 -- start start 2023-11-28T20:02:32.650 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:32.640+0000 7fa3eedaa640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa3d00047d0 0x7fa3e80befc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:32.650 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:32.640+0000 7fa3eedaa640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa3e81ed7e0 0x7fa3e8140de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:32.650 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:32.640+0000 7fa3eedaa640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa3e8141320 0x7fa3e80a6270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:32.650 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:32.640+0000 7fa3eedaa640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3e81ea6a0 con 0x7fa3d00047d0 2023-11-28T20:02:32.650 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:32.640+0000 7fa3eedaa640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3e81ea980 con 0x7fa3e8141320 2023-11-28T20:02:32.650 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:32.640+0000 7fa3eedaa640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa3e81eac60 con 0x7fa3e81ed7e0 2023-11-28T20:02:32.650 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:32.640+0000 7fa3ecb46640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa3d00047d0 0x7fa3e80befc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:02:32.651 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:32.640+0000 7fa3ecb46640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa3d00047d0 0x7fa3e80befc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:58798/0 (socket says 172.21.15.78:58798) 2023-11-28T20:02:32.651 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:32.640+0000 7fa3ecb46640 1 -- 172.21.15.78:0/3578003847 learned_addr learned my addr 172.21.15.78:0/3578003847 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T20:02:32.651 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:32.640+0000 7fa3ed347640 1 --2- 172.21.15.78:0/3578003847 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa3e8141320 0x7fa3e80a6270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:02:32.651 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:32.640+0000 7fa3dffff640 1 --2- 172.21.15.78:0/3578003847 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa3e81ed7e0 0x7fa3e8140de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:02:32.651 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:32.640+0000 7fa3ecb46640 1 -- 172.21.15.78:0/3578003847 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa3e81ed7e0 msgr2=0x7fa3e8140de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:02:32.651 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:32.640+0000 7fa3ecb46640 1 --2- 172.21.15.78:0/3578003847 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa3e81ed7e0 0x7fa3e8140de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:32.651 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:32.640+0000 7fa3ecb46640 1 -- 172.21.15.78:0/3578003847 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa3e8141320 msgr2=0x7fa3e80a6270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:02:32.651 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:32.640+0000 7fa3ecb46640 1 --2- 172.21.15.78:0/3578003847 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa3e8141320 0x7fa3e80a6270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:32.651 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:32.640+0000 7fa3ecb46640 1 -- 172.21.15.78:0/3578003847 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3e81eaf40 con 0x7fa3d00047d0 2023-11-28T20:02:32.651 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:32.640+0000 7fa3ecb46640 1 --2- 172.21.15.78:0/3578003847 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa3d00047d0 0x7fa3e80befc0 secure :-1 s=READY pgs=988 cs=0 l=1 rev1=1 crypto rx=0x7fa3e4011980 tx=0x7fa3e4011e40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:02:32.652 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:32.640+0000 7fa3dd7fa640 1 -- 172.21.15.78:0/3578003847 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3e400fb60 con 0x7fa3d00047d0 2023-11-28T20:02:32.652 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:32.640+0000 7fa3dd7fa640 1 -- 172.21.15.78:0/3578003847 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa3e400fcc0 con 0x7fa3d00047d0 2023-11-28T20:02:32.652 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:32.640+0000 7fa3dd7fa640 1 -- 172.21.15.78:0/3578003847 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3e4015610 con 0x7fa3d00047d0 2023-11-28T20:02:32.652 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:32.640+0000 7fa3eedaa640 1 -- 172.21.15.78:0/3578003847 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa3e81417a0 con 0x7fa3d00047d0 2023-11-28T20:02:32.652 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:32.644+0000 7fa3eedaa640 1 -- 172.21.15.78:0/3578003847 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa3e80bf500 con 0x7fa3d00047d0 2023-11-28T20:02:32.654 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:32.644+0000 7fa3eedaa640 1 -- 172.21.15.78:0/3578003847 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa3e81eb0d0 con 0x7fa3d00047d0 2023-11-28T20:02:32.654 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:32.644+0000 7fa3dd7fa640 1 -- 172.21.15.78:0/3578003847 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fa3e4015770 con 0x7fa3d00047d0 2023-11-28T20:02:32.654 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:32.644+0000 7fa3dd7fa640 1 --2- 172.21.15.78:0/3578003847 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fa3d40664a0 0x7fa3d4068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:32.654 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:32.644+0000 7fa3dd7fa640 1 -- 172.21.15.78:0/3578003847 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6885+0+0 (secure 0 0 0) 0x7fa3e4087610 con 0x7fa3d00047d0 2023-11-28T20:02:32.655 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:32.644+0000 7fa3dffff640 1 --2- 172.21.15.78:0/3578003847 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fa3d40664a0 0x7fa3d4068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:02:32.655 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:32.644+0000 7fa3dffff640 1 --2- 172.21.15.78:0/3578003847 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fa3d40664a0 0x7fa3d4068960 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7fa3d80af000 tx=0x7fa3d8008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:02:32.655 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:32.648+0000 7fa3dd7fa640 1 -- 172.21.15.78:0/3578003847 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fa3e40545e0 con 0x7fa3d00047d0 2023-11-28T20:02:32.804 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:32.800+0000 7fa3eedaa640 1 -- 172.21.15.78:0/3578003847 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs2_data", "var": "pg_num"} v 0) v1 -- 0x7fa3e8067630 con 0x7fa3d00047d0 2023-11-28T20:02:32.805 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:32.800+0000 7fa3dd7fa640 1 -- 172.21.15.78:0/3578003847 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs2_data", "var": "pg_num"}]=0 v85) v1 ==== 101+0+11 (secure 0 0 0) 0x7fa3e4057c00 con 0x7fa3d00047d0 2023-11-28T20:02:32.805 INFO:teuthology.orchestra.run.smithi078.stdout:pg_num: 64 2023-11-28T20:02:32.806 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:32.800+0000 7fa3eedaa640 1 -- 172.21.15.78:0/3578003847 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fa3d40664a0 msgr2=0x7fa3d4068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:02:32.807 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:32.800+0000 7fa3eedaa640 1 --2- 172.21.15.78:0/3578003847 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fa3d40664a0 0x7fa3d4068960 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7fa3d80af000 tx=0x7fa3d8008040 comp rx=0 tx=0).stop 2023-11-28T20:02:32.807 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:32.800+0000 7fa3eedaa640 1 -- 172.21.15.78:0/3578003847 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa3d00047d0 msgr2=0x7fa3e80befc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:02:32.807 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:32.800+0000 7fa3eedaa640 1 --2- 172.21.15.78:0/3578003847 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa3d00047d0 0x7fa3e80befc0 secure :-1 s=READY pgs=988 cs=0 l=1 rev1=1 crypto rx=0x7fa3e4011980 tx=0x7fa3e4011e40 comp rx=0 tx=0).stop 2023-11-28T20:02:32.807 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:32.800+0000 7fa3eedaa640 1 -- 172.21.15.78:0/3578003847 shutdown_connections 2023-11-28T20:02:32.807 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:32.800+0000 7fa3eedaa640 1 --2- 172.21.15.78:0/3578003847 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fa3d40664a0 0x7fa3d4068960 unknown :-1 s=CLOSED pgs=471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:32.807 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:32.800+0000 7fa3eedaa640 1 --2- 172.21.15.78:0/3578003847 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa3e81ed7e0 0x7fa3e8140de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:32.807 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:32.800+0000 7fa3eedaa640 1 --2- 172.21.15.78:0/3578003847 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa3e8141320 0x7fa3e80a6270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:32.807 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:32.800+0000 7fa3eedaa640 1 --2- 172.21.15.78:0/3578003847 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa3d00047d0 0x7fa3e80befc0 unknown :-1 s=CLOSED pgs=988 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:32.807 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:32.800+0000 7fa3eedaa640 1 -- 172.21.15.78:0/3578003847 >> 172.21.15.78:0/3578003847 conn(0x7fa3e80c59f0 msgr2=0x7fa3e80c0b10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:02:32.807 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:32.800+0000 7fa3eedaa640 1 -- 172.21.15.78:0/3578003847 shutdown_connections 2023-11-28T20:02:32.807 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:32.800+0000 7fa3eedaa640 1 -- 172.21.15.78:0/3578003847 wait complete. 2023-11-28T20:02:32.826 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-11-28T20:02:32.967 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:32.964+0000 7f8d103f8640 1 Processor -- start 2023-11-28T20:02:32.967 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:32.964+0000 7f8d103f8640 1 -- start start 2023-11-28T20:02:32.968 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:32.964+0000 7f8d103f8640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f8d080c2110 0x7f8d080c5ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:32.968 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:32.964+0000 7f8d103f8640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8d080a93d0 con 0x7f8d080c0c80 2023-11-28T20:02:32.968 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:32.964+0000 7f8d103f8640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8d080a9640 con 0x7f8d08154390 2023-11-28T20:02:32.969 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:32.964+0000 7f8d103f8640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8d080aa1c0 con 0x7f8d080c2110 2023-11-28T20:02:32.970 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:32.964+0000 7f8d0e995640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f8d080c0c80 0x7f8d080c61e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:55756/0 (socket says 172.21.15.78:55756) 2023-11-28T20:02:32.971 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:32.964+0000 7f8d0e995640 1 -- 172.21.15.78:0/3312036536 learned_addr learned my addr 172.21.15.78:0/3312036536 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-11-28T20:02:32.971 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:32.964+0000 7f8d0d993640 1 --2- 172.21.15.78:0/3312036536 >> v2:172.21.15.179:3300/0 conn(0x7f8d080c2110 0x7f8d080c5ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:02:32.971 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:32.964+0000 7f8d0d192640 1 -- 172.21.15.78:0/3312036536 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 47306308 0 0) 0x7f8d080a93d0 con 0x7f8d080c0c80 2023-11-28T20:02:32.971 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:32.964+0000 7f8d0d192640 1 -- 172.21.15.78:0/3312036536 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8cf4003530 con 0x7f8d080c0c80 2023-11-28T20:02:32.971 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:32.964+0000 7f8d0d192640 1 -- 172.21.15.78:0/3312036536 <== mon.0 v1:172.21.15.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2815735078 0 0) 0x7f8cf4003530 con 0x7f8d080c0c80 2023-11-28T20:02:32.971 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:32.964+0000 7f8d0d192640 1 -- 172.21.15.78:0/3312036536 >> v2:172.21.15.179:3300/0 conn(0x7f8d080c2110 msgr2=0x7f8d080c5ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:02:32.971 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:32.964+0000 7f8d0d192640 1 --2- 172.21.15.78:0/3312036536 >> v2:172.21.15.179:3300/0 conn(0x7f8d080c2110 0x7f8d080c5ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:32.971 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:32.964+0000 7f8d0d192640 1 -- 172.21.15.78:0/3312036536 >> v1:172.21.15.179:6789/0 conn(0x7f8d08154390 legacy=0x7f8d080c4a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:02:32.971 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:32.964+0000 7f8d0d192640 1 -- 172.21.15.78:0/3312036536 --> v1:172.21.15.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d080a9920 con 0x7f8d080c0c80 2023-11-28T20:02:32.971 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:32.964+0000 7f8d0d192640 1 -- 172.21.15.78:0/3312036536 <== mon.0 v1:172.21.15.78:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3326804700 0 0) 0x7f8d00001a00 con 0x7f8d080c0c80 2023-11-28T20:02:32.971 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:32.964+0000 7f8d0d192640 1 -- 172.21.15.78:0/3312036536 >> v1:172.21.15.78:6789/0 conn(0x7f8d080c0c80 legacy=0x7f8d080c61e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:02:32.972 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:32.964+0000 7f8d0d192640 1 --2- 172.21.15.78:0/3312036536 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8cf4003980 0x7f8cf4003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:32.972 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:32.964+0000 7f8d0d192640 1 --2- 172.21.15.78:0/3312036536 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8cf40047d0 0x7f8cf4004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:32.972 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:32.964+0000 7f8d0d192640 1 --2- 172.21.15.78:0/3312036536 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8cf4005190 0x7f8cf400dba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:32.972 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:32.964+0000 7f8d0d192640 1 -- 172.21.15.78:0/3312036536 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d080aa1c0 con 0x7f8cf40047d0 2023-11-28T20:02:32.972 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:32.964+0000 7f8d0d192640 1 -- 172.21.15.78:0/3312036536 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8cf400e240 con 0x7f8cf4005190 2023-11-28T20:02:32.972 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:32.964+0000 7f8d0d192640 1 -- 172.21.15.78:0/3312036536 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8cf400e400 con 0x7f8cf4003980 2023-11-28T20:02:32.972 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:32.964+0000 7f8d0d993640 1 --2- 172.21.15.78:0/3312036536 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8cf40047d0 0x7f8cf4004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:02:32.972 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:32.964+0000 7f8d0e194640 1 --2- 172.21.15.78:0/3312036536 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8cf4003980 0x7f8cf4003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:02:32.972 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:32.964+0000 7f8d0e995640 1 --2- 172.21.15.78:0/3312036536 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8cf4005190 0x7f8cf400dba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:02:32.973 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:32.964+0000 7f8d0d993640 1 -- 172.21.15.78:0/3312036536 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8cf4003980 msgr2=0x7f8cf4003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:02:32.973 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:32.964+0000 7f8d0d993640 1 --2- 172.21.15.78:0/3312036536 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8cf4003980 0x7f8cf4003da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:32.973 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:32.964+0000 7f8d0d993640 1 -- 172.21.15.78:0/3312036536 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8cf4005190 msgr2=0x7f8cf400dba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:02:32.973 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:32.964+0000 7f8d0d993640 1 --2- 172.21.15.78:0/3312036536 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8cf4005190 0x7f8cf400dba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:32.973 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:32.964+0000 7f8d0d993640 1 -- 172.21.15.78:0/3312036536 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8cf4003530 con 0x7f8cf40047d0 2023-11-28T20:02:32.973 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:32.964+0000 7f8d0e995640 1 --2- 172.21.15.78:0/3312036536 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8cf4005190 0x7f8cf400dba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T20:02:32.973 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:32.964+0000 7f8d0e995640 1 -- 172.21.15.78:0/3312036536 reap_dead start 2023-11-28T20:02:32.975 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:32.968+0000 7f8d0d993640 1 --2- 172.21.15.78:0/3312036536 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8cf40047d0 0x7f8cf4004c50 secure :-1 s=READY pgs=990 cs=0 l=1 rev1=1 crypto rx=0x7f8cf8009ae0 tx=0x7f8cf801ca50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4f4804d2454a7445 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:02:32.975 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:32.968+0000 7f8d0d192640 1 -- 172.21.15.78:0/3312036536 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cf80a5640 con 0x7f8cf40047d0 2023-11-28T20:02:32.975 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:32.968+0000 7f8d0d192640 1 -- 172.21.15.78:0/3312036536 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8cf80a57a0 con 0x7f8cf40047d0 2023-11-28T20:02:32.975 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:32.968+0000 7f8d0d192640 1 -- 172.21.15.78:0/3312036536 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cf80a5b50 con 0x7f8cf40047d0 2023-11-28T20:02:32.975 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:32.968+0000 7f8d103f8640 1 -- 172.21.15.78:0/3312036536 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8cf40047d0 msgr2=0x7f8cf4004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:02:32.975 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:32.968+0000 7f8d103f8640 1 --2- 172.21.15.78:0/3312036536 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8cf40047d0 0x7f8cf4004c50 secure :-1 s=READY pgs=990 cs=0 l=1 rev1=1 crypto rx=0x7f8cf8009ae0 tx=0x7f8cf801ca50 comp rx=0 tx=0).stop 2023-11-28T20:02:32.975 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:32.968+0000 7f8d103f8640 1 -- 172.21.15.78:0/3312036536 shutdown_connections 2023-11-28T20:02:32.975 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:32.968+0000 7f8d103f8640 1 --2- 172.21.15.78:0/3312036536 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8cf40047d0 0x7f8cf4004c50 unknown :-1 s=CLOSED pgs=990 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:32.975 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:32.968+0000 7f8d103f8640 1 -- 172.21.15.78:0/3312036536 >> 172.21.15.78:0/3312036536 conn(0x7f8d0806b220 msgr2=0x7f8d080a77e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:02:32.976 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:32.968+0000 7f8d103f8640 1 -- 172.21.15.78:0/3312036536 shutdown_connections 2023-11-28T20:02:32.976 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:32.968+0000 7f8d103f8640 1 -- 172.21.15.78:0/3312036536 wait complete. 2023-11-28T20:02:32.976 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:32.972+0000 7f8d103f8640 1 Processor -- start 2023-11-28T20:02:32.976 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:32.972+0000 7f8d103f8640 1 -- start start 2023-11-28T20:02:32.978 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:32.972+0000 7f8d103f8640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8cf40047d0 0x7f8d08146c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:32.978 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:32.972+0000 7f8d103f8640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8d08147190 0x7f8d081449f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:32.978 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:32.972+0000 7f8d103f8640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8d081ed880 0x7f8d08144f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:32.979 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:32.972+0000 7f8d103f8640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d081d9c30 con 0x7f8d081ed880 2023-11-28T20:02:32.979 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:32.972+0000 7f8d103f8640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d081eb1e0 con 0x7f8d08147190 2023-11-28T20:02:32.979 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:32.972+0000 7f8d103f8640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8d081ea310 con 0x7f8cf40047d0 2023-11-28T20:02:32.979 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:32.972+0000 7f8d0e995640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8d081ed880 0x7f8d08144f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:02:32.979 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:32.972+0000 7f8d0e995640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8d081ed880 0x7f8d08144f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:58814/0 (socket says 172.21.15.78:58814) 2023-11-28T20:02:32.979 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:32.972+0000 7f8d0e995640 1 -- 172.21.15.78:0/799658137 learned_addr learned my addr 172.21.15.78:0/799658137 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T20:02:32.979 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:32.972+0000 7f8d0d993640 1 --2- 172.21.15.78:0/799658137 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8d08147190 0x7f8d081449f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:02:32.979 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:32.972+0000 7f8d0e194640 1 --2- 172.21.15.78:0/799658137 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8cf40047d0 0x7f8d08146c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:02:32.979 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:32.972+0000 7f8d0e995640 1 -- 172.21.15.78:0/799658137 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8cf40047d0 msgr2=0x7f8d08146c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:02:32.979 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:32.972+0000 7f8d0e995640 1 --2- 172.21.15.78:0/799658137 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8cf40047d0 0x7f8d08146c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:32.979 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:32.972+0000 7f8d0e995640 1 -- 172.21.15.78:0/799658137 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8d08147190 msgr2=0x7f8d081449f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:02:32.980 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:32.972+0000 7f8d0e995640 1 --2- 172.21.15.78:0/799658137 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8d08147190 0x7f8d081449f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:32.980 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:32.972+0000 7f8d0e995640 1 -- 172.21.15.78:0/799658137 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d081ea5d0 con 0x7f8d081ed880 2023-11-28T20:02:32.980 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:32.972+0000 7f8d0e995640 1 --2- 172.21.15.78:0/799658137 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8d081ed880 0x7f8d08144f30 secure :-1 s=READY pgs=991 cs=0 l=1 rev1=1 crypto rx=0x7f8d00004c00 tx=0x7f8d00011c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:02:32.980 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:32.972+0000 7f8cfeffd640 1 -- 172.21.15.78:0/799658137 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d0001a030 con 0x7f8d081ed880 2023-11-28T20:02:32.980 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:32.972+0000 7f8cfeffd640 1 -- 172.21.15.78:0/799658137 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d0000f8a0 con 0x7f8d081ed880 2023-11-28T20:02:32.980 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:32.972+0000 7f8cfeffd640 1 -- 172.21.15.78:0/799658137 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d0000fc30 con 0x7f8d081ed880 2023-11-28T20:02:32.980 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:32.972+0000 7f8d103f8640 1 -- 172.21.15.78:0/799658137 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8d081ea8b0 con 0x7f8d081ed880 2023-11-28T20:02:32.980 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:32.972+0000 7f8d103f8640 1 -- 172.21.15.78:0/799658137 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8d081eae70 con 0x7f8d081ed880 2023-11-28T20:02:32.981 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:32.976+0000 7f8d103f8640 1 -- 172.21.15.78:0/799658137 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8d08067630 con 0x7f8d081ed880 2023-11-28T20:02:32.982 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:32.976+0000 7f8cfeffd640 1 -- 172.21.15.78:0/799658137 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f8d0001d070 con 0x7f8d081ed880 2023-11-28T20:02:32.982 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:32.976+0000 7f8cfeffd640 1 --2- 172.21.15.78:0/799658137 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f8cec066470 0x7f8cec068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:32.982 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:32.976+0000 7f8cfeffd640 1 -- 172.21.15.78:0/799658137 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6885+0+0 (secure 0 0 0) 0x7f8d0001b070 con 0x7f8d081ed880 2023-11-28T20:02:32.982 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:32.976+0000 7f8d0e194640 1 --2- 172.21.15.78:0/799658137 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f8cec066470 0x7f8cec068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:02:32.982 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:32.976+0000 7f8d0e194640 1 --2- 172.21.15.78:0/799658137 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f8cec066470 0x7f8cec068930 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f8d04000c10 tx=0x7f8d04009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:02:32.985 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:32.980+0000 7f8cfeffd640 1 -- 172.21.15.78:0/799658137 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f8d0008d080 con 0x7f8d081ed880 2023-11-28T20:02:33.147 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:33.144+0000 7f8d103f8640 1 -- 172.21.15.78:0/799658137 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f8d080c0110 con 0x7f8d081ed880 2023-11-28T20:02:33.148 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:33.144+0000 7f8cfeffd640 1 -- 172.21.15.78:0/799658137 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v85) v1 ==== 80+0+0 (secure 0 0 0) 0x7f8d00053f00 con 0x7f8d081ed880 2023-11-28T20:02:33.148 INFO:teuthology.orchestra.run.smithi078.stderr:listed 0 entries 2023-11-28T20:02:33.150 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:33.144+0000 7f8d103f8640 1 -- 172.21.15.78:0/799658137 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f8cec066470 msgr2=0x7f8cec068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:02:33.150 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:33.144+0000 7f8d103f8640 1 --2- 172.21.15.78:0/799658137 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f8cec066470 0x7f8cec068930 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f8d04000c10 tx=0x7f8d04009040 comp rx=0 tx=0).stop 2023-11-28T20:02:33.150 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:33.144+0000 7f8d103f8640 1 -- 172.21.15.78:0/799658137 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8d081ed880 msgr2=0x7f8d08144f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:02:33.150 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:33.144+0000 7f8d103f8640 1 --2- 172.21.15.78:0/799658137 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8d081ed880 0x7f8d08144f30 secure :-1 s=READY pgs=991 cs=0 l=1 rev1=1 crypto rx=0x7f8d00004c00 tx=0x7f8d00011c20 comp rx=0 tx=0).stop 2023-11-28T20:02:33.151 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:33.144+0000 7f8d103f8640 1 -- 172.21.15.78:0/799658137 shutdown_connections 2023-11-28T20:02:33.151 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:33.144+0000 7f8d103f8640 1 --2- 172.21.15.78:0/799658137 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f8cec066470 0x7f8cec068930 unknown :-1 s=CLOSED pgs=472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:33.151 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:33.144+0000 7f8d103f8640 1 --2- 172.21.15.78:0/799658137 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8d081ed880 0x7f8d08144f30 unknown :-1 s=CLOSED pgs=991 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:33.151 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:33.144+0000 7f8d103f8640 1 --2- 172.21.15.78:0/799658137 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8d08147190 0x7f8d081449f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:33.152 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:33.144+0000 7f8d103f8640 1 --2- 172.21.15.78:0/799658137 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8cf40047d0 0x7f8d08146c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:33.152 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:33.144+0000 7f8d103f8640 1 -- 172.21.15.78:0/799658137 >> 172.21.15.78:0/799658137 conn(0x7f8d0806b220 msgr2=0x7f8d08152ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:02:33.152 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:33.144+0000 7f8d103f8640 1 -- 172.21.15.78:0/799658137 shutdown_connections 2023-11-28T20:02:33.152 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:33.144+0000 7f8d103f8640 1 -- 172.21.15.78:0/799658137 wait complete. 2023-11-28T20:02:33.168 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2023-11-28T20:02:33.168 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T20:02:33.168 DEBUG:teuthology.orchestra.run.smithi179:> sudo umount /home/ubuntu/cephtest/mnt.1 2023-11-28T20:02:33.198 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi179.front.sepia.ceph.com 2023-11-28T20:02:33.198 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T20:02:33.199 DEBUG:teuthology.orchestra.run.smithi179:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-11-28T20:02:33.254 DEBUG:teuthology.orchestra.run.smithi179:> set -ex 2023-11-28T20:02:33.254 DEBUG:teuthology.orchestra.run.smithi179:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-28T20:02:33.306 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354628k,nr_inodes=4088657,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275376k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=3817 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275372k,nr_inodes=818843,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275376k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 2023-11-28T20:02:33.306 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-11-28T20:02:33.444 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:33.440+0000 7f0688580640 1 Processor -- start 2023-11-28T20:02:33.444 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:33.440+0000 7f0688580640 1 -- start start 2023-11-28T20:02:33.445 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:33.440+0000 7f0688580640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f06800af4c0 0x7f0680154f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:33.445 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:33.440+0000 7f0688580640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f06800c67d0 0x7f06800c6c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:33.445 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:33.440+0000 7f0688580640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f06800c4890 con 0x7f068006b9f0 2023-11-28T20:02:33.446 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:33.440+0000 7f0688580640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0680155460 con 0x7f06800c67d0 2023-11-28T20:02:33.446 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:33.440+0000 7f0688580640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f06800af8a0 con 0x7f06800af4c0 2023-11-28T20:02:33.446 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:33.440+0000 7f0685b1b640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f06800c67d0 0x7f06800c6c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:02:33.447 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:33.440+0000 7f068631c640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f06800af4c0 0x7f0680154f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:02:33.447 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:33.440+0000 7f0685b1b640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f06800c67d0 0x7f06800c6c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.78:53998/0 (socket says 172.21.15.78:53998) 2023-11-28T20:02:33.447 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:33.440+0000 7f0685b1b640 1 -- 172.21.15.78:0/3755662498 learned_addr learned my addr 172.21.15.78:0/3755662498 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T20:02:33.447 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:33.440+0000 7f068631c640 1 -- 172.21.15.78:0/3755662498 >> v2:172.21.15.179:3300/0 conn(0x7f06800c67d0 msgr2=0x7f06800c6c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:02:33.447 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:33.440+0000 7f068631c640 1 --2- 172.21.15.78:0/3755662498 >> v2:172.21.15.179:3300/0 conn(0x7f06800c67d0 0x7f06800c6c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:33.447 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:33.440+0000 7f068631c640 1 -- 172.21.15.78:0/3755662498 >> v1:172.21.15.179:6789/0 conn(0x7f068006b9f0 legacy=0x7f0680157a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:02:33.447 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:33.440+0000 7f068631c640 1 -- 172.21.15.78:0/3755662498 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06800c4b30 con 0x7f06800af4c0 2023-11-28T20:02:33.447 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:33.440+0000 7f0685b1b640 1 --2- 172.21.15.78:0/3755662498 >> v2:172.21.15.179:3300/0 conn(0x7f06800c67d0 0x7f06800c6c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T20:02:33.449 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:33.444+0000 7f068631c640 1 --2- 172.21.15.78:0/3755662498 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f06800af4c0 0x7f0680154f20 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f067c0097c0 tx=0x7f067c01c3c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2ca45f620453696b server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:02:33.449 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:33.444+0000 7f068531a640 1 -- 172.21.15.78:0/3755662498 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f067c0ac620 con 0x7f06800af4c0 2023-11-28T20:02:33.449 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:33.444+0000 7f068531a640 1 -- 172.21.15.78:0/3755662498 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f067c0ac780 con 0x7f06800af4c0 2023-11-28T20:02:33.450 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:33.444+0000 7f068531a640 1 -- 172.21.15.78:0/3755662498 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f067c0acb10 con 0x7f06800af4c0 2023-11-28T20:02:33.451 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:33.444+0000 7f0688580640 1 -- 172.21.15.78:0/3755662498 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f06800af4c0 msgr2=0x7f0680154f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:02:33.451 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:33.444+0000 7f0688580640 1 --2- 172.21.15.78:0/3755662498 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f06800af4c0 0x7f0680154f20 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f067c0097c0 tx=0x7f067c01c3c0 comp rx=0 tx=0).stop 2023-11-28T20:02:33.451 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:33.444+0000 7f0688580640 1 -- 172.21.15.78:0/3755662498 shutdown_connections 2023-11-28T20:02:33.451 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:33.444+0000 7f0688580640 1 --2- 172.21.15.78:0/3755662498 >> v2:172.21.15.179:3300/0 conn(0x7f06800c67d0 0x7f06800c6c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:33.451 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:33.444+0000 7f0688580640 1 --2- 172.21.15.78:0/3755662498 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f06800af4c0 0x7f0680154f20 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:33.451 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:33.444+0000 7f0688580640 1 -- 172.21.15.78:0/3755662498 >> 172.21.15.78:0/3755662498 conn(0x7f06800ab9d0 msgr2=0x7f06800abde0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:02:33.451 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:33.444+0000 7f0688580640 1 -- 172.21.15.78:0/3755662498 shutdown_connections 2023-11-28T20:02:33.451 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:33.444+0000 7f0688580640 1 -- 172.21.15.78:0/3755662498 wait complete. 2023-11-28T20:02:33.452 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:33.448+0000 7f0688580640 1 Processor -- start 2023-11-28T20:02:33.452 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:33.448+0000 7f0688580640 1 -- start start 2023-11-28T20:02:33.454 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:33.448+0000 7f0688580640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f068006b9f0 0x7f0680155aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:33.454 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:33.448+0000 7f0688580640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f06800af4c0 0x7f0680147eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:33.454 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:33.448+0000 7f0688580640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f06800c67d0 0x7f06801483f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:33.454 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:33.448+0000 7f0688580640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0680150d70 con 0x7f06800c67d0 2023-11-28T20:02:33.454 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:33.448+0000 7f0688580640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f068014be80 con 0x7f068006b9f0 2023-11-28T20:02:33.454 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:33.448+0000 7f0688580640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f068014c160 con 0x7f06800af4c0 2023-11-28T20:02:33.454 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:33.448+0000 7f0686b1d640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f06800c67d0 0x7f06801483f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:02:33.454 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:33.448+0000 7f0686b1d640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f06800c67d0 0x7f06801483f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:58818/0 (socket says 172.21.15.78:58818) 2023-11-28T20:02:33.454 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:33.448+0000 7f0686b1d640 1 -- 172.21.15.78:0/3394908725 learned_addr learned my addr 172.21.15.78:0/3394908725 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T20:02:33.455 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:33.448+0000 7f0685b1b640 1 --2- 172.21.15.78:0/3394908725 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f06800af4c0 0x7f0680147eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:02:33.455 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:33.448+0000 7f068631c640 1 --2- 172.21.15.78:0/3394908725 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f068006b9f0 0x7f0680155aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:02:33.455 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:33.448+0000 7f0686b1d640 1 -- 172.21.15.78:0/3394908725 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f06800af4c0 msgr2=0x7f0680147eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:02:33.455 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:33.448+0000 7f0686b1d640 1 --2- 172.21.15.78:0/3394908725 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f06800af4c0 0x7f0680147eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:33.455 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:33.448+0000 7f0686b1d640 1 -- 172.21.15.78:0/3394908725 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f068006b9f0 msgr2=0x7f0680155aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:02:33.455 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:33.448+0000 7f0686b1d640 1 --2- 172.21.15.78:0/3394908725 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f068006b9f0 0x7f0680155aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:33.455 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:33.448+0000 7f0686b1d640 1 -- 172.21.15.78:0/3394908725 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06700094d0 con 0x7f06800c67d0 2023-11-28T20:02:33.456 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:33.448+0000 7f0686b1d640 1 --2- 172.21.15.78:0/3394908725 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f06800c67d0 0x7f06801483f0 secure :-1 s=READY pgs=992 cs=0 l=1 rev1=1 crypto rx=0x7f067800c730 tx=0x7f067800cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:02:33.456 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:33.448+0000 7f0676ffd640 1 -- 172.21.15.78:0/3394908725 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0678003b80 con 0x7f06800c67d0 2023-11-28T20:02:33.456 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:33.448+0000 7f0676ffd640 1 -- 172.21.15.78:0/3394908725 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0678003ce0 con 0x7f06800c67d0 2023-11-28T20:02:33.456 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:33.448+0000 7f0676ffd640 1 -- 172.21.15.78:0/3394908725 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f067800aa30 con 0x7f06800c67d0 2023-11-28T20:02:33.456 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:33.448+0000 7f0688580640 1 -- 172.21.15.78:0/3394908725 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f067c009420 con 0x7f06800c67d0 2023-11-28T20:02:33.456 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:33.448+0000 7f0688580640 1 -- 172.21.15.78:0/3394908725 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f06801495f0 con 0x7f06800c67d0 2023-11-28T20:02:33.456 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:33.452+0000 7f0688580640 1 -- 172.21.15.78:0/3394908725 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0680149810 con 0x7f06800c67d0 2023-11-28T20:02:33.457 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:33.452+0000 7f0676ffd640 1 -- 172.21.15.78:0/3394908725 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f067800ab90 con 0x7f06800c67d0 2023-11-28T20:02:33.458 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:33.452+0000 7f0676ffd640 1 --2- 172.21.15.78:0/3394908725 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f0664066470 0x7f0664068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:33.458 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:33.452+0000 7f0676ffd640 1 -- 172.21.15.78:0/3394908725 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6885+0+0 (secure 0 0 0) 0x7f0678083f10 con 0x7f06800c67d0 2023-11-28T20:02:33.458 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:33.452+0000 7f068631c640 1 --2- 172.21.15.78:0/3394908725 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f0664066470 0x7f0664068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:02:33.458 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:33.456+0000 7f068631c640 1 --2- 172.21.15.78:0/3394908725 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f0664066470 0x7f0664068930 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f067c0ae000 tx=0x7f067c0a7000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:02:33.462 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:33.456+0000 7f0676ffd640 1 -- 172.21.15.78:0/3394908725 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f0678051030 con 0x7f06800c67d0 2023-11-28T20:02:33.643 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:33.640+0000 7f0688580640 1 -- 172.21.15.78:0/3394908725 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f068014c2d0 con 0x7f06800c67d0 2023-11-28T20:02:33.643 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:33.640+0000 7f0676ffd640 1 -- 172.21.15.78:0/3394908725 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v51) v1 ==== 53+0+149 (secure 0 0 0) 0x7f0678054650 con 0x7f06800c67d0 2023-11-28T20:02:33.643 INFO:teuthology.orchestra.run.smithi078.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-11-28T20:02:33.644 INFO:teuthology.orchestra.run.smithi078.stdout:name: cephfs2, metadata pool: cephfs2_metadata, data pools: [cephfs2_data ] 2023-11-28T20:02:33.645 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:33.640+0000 7f0688580640 1 -- 172.21.15.78:0/3394908725 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f0664066470 msgr2=0x7f0664068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:02:33.645 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:33.640+0000 7f0688580640 1 --2- 172.21.15.78:0/3394908725 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f0664066470 0x7f0664068930 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f067c0ae000 tx=0x7f067c0a7000 comp rx=0 tx=0).stop 2023-11-28T20:02:33.646 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:33.640+0000 7f0688580640 1 -- 172.21.15.78:0/3394908725 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f06800c67d0 msgr2=0x7f06801483f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:02:33.646 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:33.640+0000 7f0688580640 1 --2- 172.21.15.78:0/3394908725 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f06800c67d0 0x7f06801483f0 secure :-1 s=READY pgs=992 cs=0 l=1 rev1=1 crypto rx=0x7f067800c730 tx=0x7f067800cbf0 comp rx=0 tx=0).stop 2023-11-28T20:02:33.646 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:33.640+0000 7f0688580640 1 -- 172.21.15.78:0/3394908725 shutdown_connections 2023-11-28T20:02:33.646 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:33.640+0000 7f0688580640 1 --2- 172.21.15.78:0/3394908725 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f0664066470 0x7f0664068930 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:33.646 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:33.640+0000 7f0688580640 1 --2- 172.21.15.78:0/3394908725 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f06800af4c0 0x7f0680147eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:33.646 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:33.640+0000 7f0688580640 1 --2- 172.21.15.78:0/3394908725 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f06800c67d0 0x7f06801483f0 unknown :-1 s=CLOSED pgs=992 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:33.646 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:33.640+0000 7f0688580640 1 --2- 172.21.15.78:0/3394908725 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f068006b9f0 0x7f0680155aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:33.646 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:33.640+0000 7f0688580640 1 -- 172.21.15.78:0/3394908725 >> 172.21.15.78:0/3394908725 conn(0x7f06800ab9d0 msgr2=0x7f06800abdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:02:33.647 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:33.640+0000 7f0688580640 1 -- 172.21.15.78:0/3394908725 shutdown_connections 2023-11-28T20:02:33.647 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:33.640+0000 7f0688580640 1 -- 172.21.15.78:0/3394908725 wait complete. 2023-11-28T20:02:33.664 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs2; just confirmed its presence on cluster 2023-11-28T20:02:33.664 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-11-28T20:02:33.665 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi179.front.sepia.ceph.com 2023-11-28T20:02:33.665 INFO:tasks.cephfs.mount:self.client.name = client.1 2023-11-28T20:02:33.665 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-11-28T20:02:33.665 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs2 2023-11-28T20:02:33.665 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-11-28T20:02:33.666 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-11-28T20:02:33.666 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-11-28T20:02:33.666 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T20:02:33.666 DEBUG:teuthology.orchestra.run.smithi179:> ip addr 2023-11-28T20:02:33.677 INFO:teuthology.orchestra.run.smithi179.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-11-28T20:02:33.678 INFO:teuthology.orchestra.run.smithi179.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-11-28T20:02:33.678 INFO:teuthology.orchestra.run.smithi179.stdout: inet 127.0.0.1/8 scope host lo 2023-11-28T20:02:33.678 INFO:teuthology.orchestra.run.smithi179.stdout: valid_lft forever preferred_lft forever 2023-11-28T20:02:33.678 INFO:teuthology.orchestra.run.smithi179.stdout: inet6 ::1/128 scope host 2023-11-28T20:02:33.678 INFO:teuthology.orchestra.run.smithi179.stdout: valid_lft forever preferred_lft forever 2023-11-28T20:02:33.678 INFO:teuthology.orchestra.run.smithi179.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-11-28T20:02:33.678 INFO:teuthology.orchestra.run.smithi179.stdout: link/ether 0c:c4:7a:d9:3b:34 brd ff:ff:ff:ff:ff:ff 2023-11-28T20:02:33.678 INFO:teuthology.orchestra.run.smithi179.stdout: altname enp7s0f0 2023-11-28T20:02:33.679 INFO:teuthology.orchestra.run.smithi179.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-11-28T20:02:33.679 INFO:teuthology.orchestra.run.smithi179.stdout: link/ether 0c:c4:7a:d9:3b:35 brd ff:ff:ff:ff:ff:ff 2023-11-28T20:02:33.679 INFO:teuthology.orchestra.run.smithi179.stdout: altname enp7s0f1 2023-11-28T20:02:33.679 INFO:teuthology.orchestra.run.smithi179.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-11-28T20:02:33.679 INFO:teuthology.orchestra.run.smithi179.stdout: link/ether 0c:c4:7a:88:72:5a brd ff:ff:ff:ff:ff:ff 2023-11-28T20:02:33.679 INFO:teuthology.orchestra.run.smithi179.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-11-28T20:02:33.679 INFO:teuthology.orchestra.run.smithi179.stdout: link/ether 0c:c4:7a:88:72:5b brd ff:ff:ff:ff:ff:ff 2023-11-28T20:02:33.680 INFO:teuthology.orchestra.run.smithi179.stdout: inet 172.21.15.179/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2023-11-28T20:02:33.680 INFO:teuthology.orchestra.run.smithi179.stdout: valid_lft 42229sec preferred_lft 42229sec 2023-11-28T20:02:33.680 INFO:teuthology.orchestra.run.smithi179.stdout: inet6 fe80::ec4:7aff:fe88:725b/64 scope link 2023-11-28T20:02:33.680 INFO:teuthology.orchestra.run.smithi179.stdout: valid_lft forever preferred_lft forever 2023-11-28T20:02:33.680 INFO:teuthology.orchestra.run.smithi179.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-11-28T20:02:33.681 INFO:teuthology.orchestra.run.smithi179.stdout: link/ether 02:42:75:f0:7b:8c brd ff:ff:ff:ff:ff:ff 2023-11-28T20:02:33.681 INFO:teuthology.orchestra.run.smithi179.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-11-28T20:02:33.681 INFO:teuthology.orchestra.run.smithi179.stdout: valid_lft forever preferred_lft forever 2023-11-28T20:02:33.681 INFO:teuthology.orchestra.run.smithi179.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-11-28T20:02:33.681 INFO:teuthology.orchestra.run.smithi179.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2023-11-28T20:02:33.681 INFO:teuthology.orchestra.run.smithi179.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-11-28T20:02:33.681 INFO:teuthology.orchestra.run.smithi179.stdout: valid_lft forever preferred_lft forever 2023-11-28T20:02:33.682 INFO:teuthology.orchestra.run.smithi179.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2023-11-28T20:02:33.682 INFO:teuthology.orchestra.run.smithi179.stdout: valid_lft forever preferred_lft forever 2023-11-28T20:02:33.682 INFO:teuthology.orchestra.run.smithi179.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-11-28T20:02:33.682 INFO:teuthology.orchestra.run.smithi179.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2023-11-28T20:02:33.682 INFO:teuthology.orchestra.run.smithi179.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2023-11-28T20:02:33.682 INFO:teuthology.orchestra.run.smithi179.stdout: valid_lft forever preferred_lft forever 2023-11-28T20:02:33.682 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T20:02:33.683 DEBUG:teuthology.orchestra.run.smithi179:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-11-28T20:02:33.741 INFO:teuthology.orchestra.run.smithi179.stdout:1 2023-11-28T20:02:33.743 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T20:02:33.743 DEBUG:teuthology.orchestra.run.smithi179:> route 2023-11-28T20:02:33.801 INFO:teuthology.orchestra.run.smithi179.stdout:Kernel IP routing table 2023-11-28T20:02:33.801 INFO:teuthology.orchestra.run.smithi179.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-11-28T20:02:33.801 INFO:teuthology.orchestra.run.smithi179.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2023-11-28T20:02:33.802 INFO:teuthology.orchestra.run.smithi179.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-11-28T20:02:33.802 INFO:teuthology.orchestra.run.smithi179.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-11-28T20:02:33.802 INFO:teuthology.orchestra.run.smithi179.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-11-28T20:02:33.802 INFO:teuthology.orchestra.run.smithi179.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-11-28T20:02:33.802 INFO:teuthology.orchestra.run.smithi179.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-11-28T20:02:33.803 INFO:teuthology.orchestra.run.smithi179.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-11-28T20:02:33.803 INFO:teuthology.orchestra.run.smithi179.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-11-28T20:02:33.803 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T20:02:33.803 DEBUG:teuthology.orchestra.run.smithi179:> (cd / && exec bash -c ' 2023-11-28T20:02:33.803 DEBUG:teuthology.orchestra.run.smithi179:> set -e 2023-11-28T20:02:33.804 DEBUG:teuthology.orchestra.run.smithi179:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-11-28T20:02:33.804 DEBUG:teuthology.orchestra.run.smithi179:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-11-28T20:02:33.804 DEBUG:teuthology.orchestra.run.smithi179:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-11-28T20:02:33.804 DEBUG:teuthology.orchestra.run.smithi179:> ') 2023-11-28T20:02:33.899 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T20:02:33.900 DEBUG:teuthology.orchestra.run.smithi179:> ip netns list 2023-11-28T20:02:33.909 INFO:teuthology.orchestra.run.smithi179.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-11-28T20:02:33.910 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-11-28T20:02:33.910 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T20:02:33.910 DEBUG:teuthology.orchestra.run.smithi179:> sudo ip link set brx.0 up 2023-11-28T20:02:33.974 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-28T20:02:33.974 DEBUG:teuthology.orchestra.run.smithi179:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2023-11-28T20:02:34.025 INFO:teuthology.orchestra.run.smithi179.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2023-11-28T20:02:34.026 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-28T20:02:34.026 DEBUG:teuthology.orchestra.run.smithi179:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2023-11-28T20:02:34.077 INFO:tasks.cephfs.kernel_mount:mounting using device: 1@.cephfs2=/ 2023-11-28T20:02:34.077 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T20:02:34.077 DEBUG:teuthology.orchestra.run.smithi179:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 1@.cephfs2=/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-11-28T20:02:34.175 INFO:teuthology.orchestra.run.smithi179.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-11-28T20:02:34.175 INFO:teuthology.orchestra.run.smithi179.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-11-28T20:02:34.187 INFO:teuthology.orchestra.run.smithi179.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-11-28T20:02:34.187 INFO:teuthology.orchestra.run.smithi179.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-11-28T20:02:34.187 INFO:teuthology.orchestra.run.smithi179.stdout:mount.ceph: resolved to: "172.21.15.78:3300,172.21.15.179:3300,172.21.15.179:3301" 2023-11-28T20:02:34.188 INFO:teuthology.orchestra.run.smithi179.stdout:mount.ceph: trying mount with new device syntax: 1@dd9780e8-3bda-44fa-a9f0-fa07d19d901d.cephfs2=/ 2023-11-28T20:02:34.188 INFO:teuthology.orchestra.run.smithi179.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,ms_mode=prefer-crc,key=1,mon_addr=172.21.15.78:3300/172.21.15.179:3300/172.21.15.179:3301" will pass to kernel 2023-11-28T20:02:34.191 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-11-28T20:02:34.191 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T20:02:34.191 DEBUG:teuthology.orchestra.run.smithi179:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-11-28T20:02:34.212 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T20:02:34.212 DEBUG:teuthology.orchestra.run.smithi179:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-11-28T20:02:34.270 INFO:teuthology.orchestra.run.smithi179.stdout:client7008 2023-11-28T20:02:34.270 DEBUG:teuthology.orchestra.run.smithi179:> set -ex 2023-11-28T20:02:34.271 DEBUG:teuthology.orchestra.run.smithi179:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-28T20:02:34.321 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T20:02:34.321 DEBUG:teuthology.orchestra.run.smithi078:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir /home/ubuntu/cephtest/mnt.0/testdir) 2023-11-28T20:02:34.336 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2023-11-28T20:02:34.336 DEBUG:teuthology.orchestra.run.smithi078:> dd of=/home/ubuntu/cephtest/mnt.0/testdir/testfile 2023-11-28T20:02:34.392 INFO:tasks.cephfs.caps_helper:Test file has been created on FS "cephfs" at path "/home/ubuntu/cephtest/mnt.0/testdir/testfile" with the following data - self.path = /home/ubuntu/cephtest/mnt.0/testdir/testfile cephfs_name = cephfs cephfs_mntpt = / hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-11-28T20:02:34.392 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T20:02:34.392 DEBUG:teuthology.orchestra.run.smithi179:> (cd /home/ubuntu/cephtest/mnt.1 && exec mkdir /home/ubuntu/cephtest/mnt.1/testdir) 2023-11-28T20:02:34.409 DEBUG:teuthology.orchestra.run.smithi179:> set -ex 2023-11-28T20:02:34.409 DEBUG:teuthology.orchestra.run.smithi179:> dd of=/home/ubuntu/cephtest/mnt.1/testdir/testfile 2023-11-28T20:02:34.470 INFO:tasks.cephfs.caps_helper:Test file has been created on FS "cephfs2" at path "/home/ubuntu/cephtest/mnt.1/testdir/testfile" with the following data - self.path = /home/ubuntu/cephtest/mnt.1/testdir/testfile cephfs_name = cephfs2 cephfs_mntpt = / hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-11-28T20:02:34.470 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth add client.testuser mon 'allow r' osd 'allow r tag cephfs data=cephfs, allow r tag cephfs data=cephfs2' mds 'allow r fsname=cephfs, allow r fsname=cephfs2' 2023-11-28T20:02:34.516 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T20:02:34.520 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T20:02:34.616 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:34.612+0000 7f8dc5380640 1 Processor -- start 2023-11-28T20:02:34.616 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:34.612+0000 7f8dc5380640 1 -- start start 2023-11-28T20:02:34.617 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:34.612+0000 7f8dc5380640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f8dc014f850 0x7f8dc00aacf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:34.618 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:34.612+0000 7f8dc5380640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f8dc014fc30 0x7f8dc00c3cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:34.618 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:34.612+0000 7f8dc5380640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8dc006d840 0x7f8dc00c4210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:34.618 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:34.612+0000 7f8dc5380640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8dc00c2240 con 0x7f8dc014fc30 2023-11-28T20:02:34.618 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:34.612+0000 7f8dc5380640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8dc0152910 con 0x7f8dc014f850 2023-11-28T20:02:34.618 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:34.612+0000 7f8dc5380640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8dc0152bf0 con 0x7f8dc006d840 2023-11-28T20:02:34.618 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:34.612+0000 7f8dbe7fc640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f8dc014fc30 0x7f8dc00c3cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:02:34.619 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:34.612+0000 7f8dbe7fc640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f8dc014fc30 0x7f8dc00c3cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:58826/0 (socket says 172.21.15.78:58826) 2023-11-28T20:02:34.619 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:34.612+0000 7f8dbe7fc640 1 -- 172.21.15.78:0/1405102127 learned_addr learned my addr 172.21.15.78:0/1405102127 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T20:02:34.619 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:34.612+0000 7f8dbeffd640 1 --2- 172.21.15.78:0/1405102127 >> v2:172.21.15.179:3300/0 conn(0x7f8dc014f850 0x7f8dc00aacf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:02:34.619 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:34.612+0000 7f8dbf7fe640 1 --2- 172.21.15.78:0/1405102127 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8dc006d840 0x7f8dc00c4210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:02:34.619 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:34.612+0000 7f8dbe7fc640 1 -- 172.21.15.78:0/1405102127 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8dc006d840 msgr2=0x7f8dc00c4210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:02:34.619 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:34.612+0000 7f8dbe7fc640 1 --2- 172.21.15.78:0/1405102127 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8dc006d840 0x7f8dc00c4210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:34.619 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:34.612+0000 7f8dbe7fc640 1 -- 172.21.15.78:0/1405102127 >> v2:172.21.15.179:3300/0 conn(0x7f8dc014f850 msgr2=0x7f8dc00aacf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:02:34.620 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:34.612+0000 7f8dbe7fc640 1 --2- 172.21.15.78:0/1405102127 >> v2:172.21.15.179:3300/0 conn(0x7f8dc014f850 0x7f8dc00aacf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:34.620 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:34.612+0000 7f8dbe7fc640 1 -- 172.21.15.78:0/1405102127 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8dc0152ed0 con 0x7f8dc014fc30 2023-11-28T20:02:34.620 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:34.612+0000 7f8dbeffd640 1 --2- 172.21.15.78:0/1405102127 >> v2:172.21.15.179:3300/0 conn(0x7f8dc014f850 0x7f8dc00aacf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T20:02:34.621 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:34.616+0000 7f8dbe7fc640 1 --2- 172.21.15.78:0/1405102127 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8dc014fc30 0x7f8dc00c3cd0 secure :-1 s=READY pgs=994 cs=0 l=1 rev1=1 crypto rx=0x7f8dc0066f50 tx=0x7f8db401c500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=48d960cf4b613a28 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:02:34.621 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:34.616+0000 7f8dbdffb640 1 -- 172.21.15.78:0/1405102127 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8db40aa640 con 0x7f8dc014fc30 2023-11-28T20:02:34.621 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:34.616+0000 7f8dbdffb640 1 -- 172.21.15.78:0/1405102127 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8db40aa7a0 con 0x7f8dc014fc30 2023-11-28T20:02:34.621 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:34.616+0000 7f8dbdffb640 1 -- 172.21.15.78:0/1405102127 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8db40aab30 con 0x7f8dc014fc30 2023-11-28T20:02:34.622 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:34.616+0000 7f8dc5380640 1 -- 172.21.15.78:0/1405102127 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8dc014fc30 msgr2=0x7f8dc00c3cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:02:34.622 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:34.616+0000 7f8dc5380640 1 --2- 172.21.15.78:0/1405102127 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8dc014fc30 0x7f8dc00c3cd0 secure :-1 s=READY pgs=994 cs=0 l=1 rev1=1 crypto rx=0x7f8dc0066f50 tx=0x7f8db401c500 comp rx=0 tx=0).stop 2023-11-28T20:02:34.622 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:34.616+0000 7f8dc5380640 1 -- 172.21.15.78:0/1405102127 shutdown_connections 2023-11-28T20:02:34.623 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:34.616+0000 7f8dc5380640 1 --2- 172.21.15.78:0/1405102127 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8dc006d840 0x7f8dc00c4210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:34.623 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:34.616+0000 7f8dc5380640 1 --2- 172.21.15.78:0/1405102127 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8dc014fc30 0x7f8dc00c3cd0 unknown :-1 s=CLOSED pgs=994 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:34.623 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:34.616+0000 7f8dc5380640 1 --2- 172.21.15.78:0/1405102127 >> v2:172.21.15.179:3300/0 conn(0x7f8dc014f850 0x7f8dc00aacf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:34.623 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:34.616+0000 7f8dc5380640 1 -- 172.21.15.78:0/1405102127 >> 172.21.15.78:0/1405102127 conn(0x7f8dc00c59f0 msgr2=0x7f8dc00c5e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:02:34.624 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:34.616+0000 7f8dc5380640 1 -- 172.21.15.78:0/1405102127 shutdown_connections 2023-11-28T20:02:34.624 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:34.616+0000 7f8dc5380640 1 -- 172.21.15.78:0/1405102127 wait complete. 2023-11-28T20:02:34.627 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:34.616+0000 7f8dc5380640 1 Processor -- start 2023-11-28T20:02:34.627 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:34.620+0000 7f8dc5380640 1 -- start start 2023-11-28T20:02:34.627 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:34.620+0000 7f8dc5380640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8dc006d840 0x7f8dc01ed440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:34.627 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:34.620+0000 7f8dc5380640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8dc014f850 0x7f8dc006fac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:34.628 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:34.620+0000 7f8dc5380640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8dc014fc30 0x7f8dc015b480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:34.628 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:34.620+0000 7f8dc5380640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8dc00705b0 con 0x7f8dc006d840 2023-11-28T20:02:34.628 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:34.620+0000 7f8dc5380640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8dc01f0c50 con 0x7f8dc014f850 2023-11-28T20:02:34.628 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:34.620+0000 7f8dc5380640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8dc00721e0 con 0x7f8dc014fc30 2023-11-28T20:02:34.628 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:34.620+0000 7f8dbeffd640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8dc006d840 0x7f8dc01ed440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:02:34.629 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:34.620+0000 7f8dbeffd640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8dc006d840 0x7f8dc01ed440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:58834/0 (socket says 172.21.15.78:58834) 2023-11-28T20:02:34.629 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:34.620+0000 7f8dbe7fc640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8dc014f850 0x7f8dc006fac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:02:34.629 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:34.620+0000 7f8dbeffd640 1 -- 172.21.15.78:0/1788227408 learned_addr learned my addr 172.21.15.78:0/1788227408 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T20:02:34.629 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:34.620+0000 7f8dbf7fe640 1 --2- 172.21.15.78:0/1788227408 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8dc014fc30 0x7f8dc015b480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:02:34.629 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:34.620+0000 7f8dbeffd640 1 -- 172.21.15.78:0/1788227408 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8dc014fc30 msgr2=0x7f8dc015b480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:02:34.630 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:34.620+0000 7f8dbeffd640 1 --2- 172.21.15.78:0/1788227408 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8dc014fc30 0x7f8dc015b480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:34.630 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:34.620+0000 7f8dbeffd640 1 -- 172.21.15.78:0/1788227408 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8dc014f850 msgr2=0x7f8dc006fac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:02:34.630 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:34.620+0000 7f8dbeffd640 1 --2- 172.21.15.78:0/1788227408 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8dc014f850 0x7f8dc006fac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:34.630 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:34.620+0000 7f8dbeffd640 1 -- 172.21.15.78:0/1788227408 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8db40094d0 con 0x7f8dc006d840 2023-11-28T20:02:34.630 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:34.620+0000 7f8dbe7fc640 1 --2- 172.21.15.78:0/1788227408 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8dc014f850 0x7f8dc006fac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T20:02:34.631 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:34.620+0000 7f8dbeffd640 1 --2- 172.21.15.78:0/1788227408 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8dc006d840 0x7f8dc01ed440 secure :-1 s=READY pgs=995 cs=0 l=1 rev1=1 crypto rx=0x7f8db000e810 tx=0x7f8db000ecd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:02:34.631 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:34.620+0000 7f8da77fe640 1 -- 172.21.15.78:0/1788227408 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8db000c8d0 con 0x7f8dc006d840 2023-11-28T20:02:34.631 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:34.620+0000 7f8da77fe640 1 -- 172.21.15.78:0/1788227408 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8db000ca30 con 0x7f8dc006d840 2023-11-28T20:02:34.631 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:34.620+0000 7f8da77fe640 1 -- 172.21.15.78:0/1788227408 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8db000cdc0 con 0x7f8dc006d840 2023-11-28T20:02:34.631 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:34.620+0000 7f8dc5380640 1 -- 172.21.15.78:0/1788227408 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8dc0071940 con 0x7f8dc006d840 2023-11-28T20:02:34.631 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:34.620+0000 7f8dc5380640 1 -- 172.21.15.78:0/1788227408 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8dc0071f00 con 0x7f8dc006d840 2023-11-28T20:02:34.631 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:34.620+0000 7f8dc5380640 1 -- 172.21.15.78:0/1788227408 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8dc01f09b0 con 0x7f8dc006d840 2023-11-28T20:02:34.631 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:34.624+0000 7f8da77fe640 1 -- 172.21.15.78:0/1788227408 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f8db0013410 con 0x7f8dc006d840 2023-11-28T20:02:34.632 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:34.624+0000 7f8da77fe640 1 --2- 172.21.15.78:0/1788227408 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f8dac066470 0x7f8dac068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:34.632 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:34.624+0000 7f8da77fe640 1 -- 172.21.15.78:0/1788227408 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6885+0+0 (secure 0 0 0) 0x7f8db0083ff0 con 0x7f8dc006d840 2023-11-28T20:02:34.632 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:34.624+0000 7f8dbe7fc640 1 --2- 172.21.15.78:0/1788227408 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f8dac066470 0x7f8dac068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:02:34.633 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:34.624+0000 7f8dbe7fc640 1 --2- 172.21.15.78:0/1788227408 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f8dac066470 0x7f8dac068930 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f8db40ae000 tx=0x7f8db40b5040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:02:34.633 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:34.628+0000 7f8da77fe640 1 -- 172.21.15.78:0/1788227408 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f8dc01f09b0 con 0x7f8dc006d840 2023-11-28T20:02:34.832 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:34.828+0000 7f8dc5380640 1 -- 172.21.15.78:0/1788227408 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "auth add", "entity": "client.testuser", "caps": ["mon", "allow r", "osd", "allow r tag cephfs data=cephfs, allow r tag cephfs data=cephfs2", "mds", "allow r fsname=cephfs, allow r fsname=cephfs2"]} v 0) v1 -- 0x7f8dc01f09b0 con 0x7f8dc006d840 2023-11-28T20:02:34.835 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:34.832+0000 7f8da77fe640 1 -- 172.21.15.78:0/1788227408 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "auth add", "entity": "client.testuser", "caps": ["mon", "allow r", "osd", "allow r tag cephfs data=cephfs, allow r tag cephfs data=cephfs2", "mds", "allow r fsname=cephfs, allow r fsname=cephfs2"]}]=0 added key for client.testuser v23) v1 ==== 272+0+0 (secure 0 0 0) 0x7f8dc01f09b0 con 0x7f8dc006d840 2023-11-28T20:02:34.835 INFO:teuthology.orchestra.run.smithi078.stderr:added key for client.testuser 2023-11-28T20:02:34.837 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:34.832+0000 7f8dc5380640 1 -- 172.21.15.78:0/1788227408 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f8dac066470 msgr2=0x7f8dac068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:02:34.838 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:34.832+0000 7f8dc5380640 1 --2- 172.21.15.78:0/1788227408 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f8dac066470 0x7f8dac068930 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f8db40ae000 tx=0x7f8db40b5040 comp rx=0 tx=0).stop 2023-11-28T20:02:34.838 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:34.832+0000 7f8dc5380640 1 -- 172.21.15.78:0/1788227408 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8dc006d840 msgr2=0x7f8dc01ed440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:02:34.838 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:34.832+0000 7f8dc5380640 1 --2- 172.21.15.78:0/1788227408 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8dc006d840 0x7f8dc01ed440 secure :-1 s=READY pgs=995 cs=0 l=1 rev1=1 crypto rx=0x7f8db000e810 tx=0x7f8db000ecd0 comp rx=0 tx=0).stop 2023-11-28T20:02:34.838 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:34.832+0000 7f8dc5380640 1 -- 172.21.15.78:0/1788227408 shutdown_connections 2023-11-28T20:02:34.839 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:34.832+0000 7f8dc5380640 1 --2- 172.21.15.78:0/1788227408 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f8dac066470 0x7f8dac068930 unknown :-1 s=CLOSED pgs=474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:34.839 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:34.832+0000 7f8dc5380640 1 --2- 172.21.15.78:0/1788227408 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8dc014fc30 0x7f8dc015b480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:34.839 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:34.832+0000 7f8dc5380640 1 --2- 172.21.15.78:0/1788227408 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8dc014f850 0x7f8dc006fac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:34.839 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:34.832+0000 7f8dc5380640 1 --2- 172.21.15.78:0/1788227408 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8dc006d840 0x7f8dc01ed440 unknown :-1 s=CLOSED pgs=995 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:34.839 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:34.832+0000 7f8dc5380640 1 -- 172.21.15.78:0/1788227408 >> 172.21.15.78:0/1788227408 conn(0x7f8dc00c59f0 msgr2=0x7f8dc014f030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:02:34.840 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:34.832+0000 7f8dc5380640 1 -- 172.21.15.78:0/1788227408 shutdown_connections 2023-11-28T20:02:34.840 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:34.832+0000 7f8dc5380640 1 -- 172.21.15.78:0/1788227408 wait complete. 2023-11-28T20:02:34.857 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth get client.testuser 2023-11-28T20:02:35.039 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:35.036+0000 7f21dd8ea640 1 Processor -- start 2023-11-28T20:02:35.039 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:35.036+0000 7f21dd8ea640 1 -- start start 2023-11-28T20:02:35.040 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:35.036+0000 7f21dd8ea640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f21d80c0c80 0x7f21d80c63b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:35.040 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:35.036+0000 7f21dd8ea640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f21d80a93d0 con 0x7f21d8154390 2023-11-28T20:02:35.041 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:35.036+0000 7f21dd8ea640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f21d80a9640 con 0x7f21d80c2110 2023-11-28T20:02:35.041 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:35.036+0000 7f21dd8ea640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f21d80aa1c0 con 0x7f21d80c0c80 2023-11-28T20:02:35.041 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:35.036+0000 7f21d77fe640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f21d80c0c80 0x7f21d80c63b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:02:35.042 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:35.036+0000 7f21d77fe640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f21d80c0c80 0x7f21d80c63b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:58844/0 (socket says 172.21.15.78:58844) 2023-11-28T20:02:35.042 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:35.036+0000 7f21d6ffd640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f21d8154390 0x7f21d80c4a40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:55760/0 (socket says 172.21.15.78:55760) 2023-11-28T20:02:35.042 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:35.036+0000 7f21d77fe640 1 -- 172.21.15.78:0/87841114 learned_addr learned my addr 172.21.15.78:0/87841114 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T20:02:35.043 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:35.036+0000 7f21d77fe640 1 -- 172.21.15.78:0/87841114 >> v1:172.21.15.179:6789/0 conn(0x7f21d80c2110 legacy=0x7f21d80c5ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:02:35.043 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:35.036+0000 7f21d77fe640 1 -- 172.21.15.78:0/87841114 >> v1:172.21.15.78:6789/0 conn(0x7f21d8154390 legacy=0x7f21d80c4a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:02:35.044 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:35.036+0000 7f21d77fe640 1 -- 172.21.15.78:0/87841114 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21d80a9920 con 0x7f21d80c0c80 2023-11-28T20:02:35.044 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:35.036+0000 7f21d67fc640 1 -- 172.21.15.78:0/87841114 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2307323171 0 0) 0x7f21d80a93d0 con 0x7f21d8154390 2023-11-28T20:02:35.047 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:35.040+0000 7f21d77fe640 1 --2- 172.21.15.78:0/87841114 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f21d80c0c80 0x7f21d80c63b0 secure :-1 s=READY pgs=997 cs=0 l=1 rev1=1 crypto rx=0x7f21d0009e50 tx=0x7f21d001c9d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5742f4d17ca3592a server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:02:35.047 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:35.040+0000 7f21d67fc640 1 -- 172.21.15.78:0/87841114 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21d00a57a0 con 0x7f21d80c0c80 2023-11-28T20:02:35.047 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:35.040+0000 7f21d67fc640 1 -- 172.21.15.78:0/87841114 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f21d00a5900 con 0x7f21d80c0c80 2023-11-28T20:02:35.048 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:35.040+0000 7f21d67fc640 1 -- 172.21.15.78:0/87841114 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21d00a5c90 con 0x7f21d80c0c80 2023-11-28T20:02:35.048 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:35.040+0000 7f21dd8ea640 1 -- 172.21.15.78:0/87841114 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f21d80c0c80 msgr2=0x7f21d80c63b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:02:35.048 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:35.040+0000 7f21dd8ea640 1 --2- 172.21.15.78:0/87841114 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f21d80c0c80 0x7f21d80c63b0 secure :-1 s=READY pgs=997 cs=0 l=1 rev1=1 crypto rx=0x7f21d0009e50 tx=0x7f21d001c9d0 comp rx=0 tx=0).stop 2023-11-28T20:02:35.048 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:35.040+0000 7f21dd8ea640 1 -- 172.21.15.78:0/87841114 shutdown_connections 2023-11-28T20:02:35.049 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:35.040+0000 7f21dd8ea640 1 --2- 172.21.15.78:0/87841114 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f21d80c0c80 0x7f21d80c63b0 unknown :-1 s=CLOSED pgs=997 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:35.049 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:35.040+0000 7f21dd8ea640 1 -- 172.21.15.78:0/87841114 >> 172.21.15.78:0/87841114 conn(0x7f21d806b220 msgr2=0x7f21d80a77e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:02:35.049 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:35.040+0000 7f21dd8ea640 1 -- 172.21.15.78:0/87841114 shutdown_connections 2023-11-28T20:02:35.049 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:35.040+0000 7f21dd8ea640 1 -- 172.21.15.78:0/87841114 wait complete. 2023-11-28T20:02:35.050 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:35.040+0000 7f21dd8ea640 1 Processor -- start 2023-11-28T20:02:35.050 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:35.040+0000 7f21dd8ea640 1 -- start start 2023-11-28T20:02:35.054 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:35.044+0000 7f21dd8ea640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f21d80c0c80 0x7f21d80a6860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:35.054 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:35.044+0000 7f21dd8ea640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f21d80c2110 0x7f21d8070610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:35.054 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:35.044+0000 7f21dd8ea640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f21d8154390 0x7f21d8146530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:35.054 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:35.044+0000 7f21dd8ea640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21d80710a0 con 0x7f21d8154390 2023-11-28T20:02:35.054 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:35.044+0000 7f21dd8ea640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21d80a6da0 con 0x7f21d80c0c80 2023-11-28T20:02:35.054 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:35.044+0000 7f21dd8ea640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f21d8147430 con 0x7f21d80c2110 2023-11-28T20:02:35.054 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:35.044+0000 7f21d77fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f21d8154390 0x7f21d8146530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:02:35.054 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:35.044+0000 7f21d6ffd640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f21d80c0c80 0x7f21d80a6860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:02:35.055 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:35.044+0000 7f21cffff640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f21d80c2110 0x7f21d8070610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:02:35.055 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:35.044+0000 7f21d6ffd640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f21d80c0c80 0x7f21d80a6860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.78:54032/0 (socket says 172.21.15.78:54032) 2023-11-28T20:02:35.055 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:35.044+0000 7f21d77fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f21d8154390 0x7f21d8146530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:58848/0 (socket says 172.21.15.78:58848) 2023-11-28T20:02:35.055 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:35.044+0000 7f21d6ffd640 1 -- 172.21.15.78:0/908539046 learned_addr learned my addr 172.21.15.78:0/908539046 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T20:02:35.055 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:35.044+0000 7f21cffff640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f21d80c2110 0x7f21d8070610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3301/0 says I am v2:172.21.15.78:35658/0 (socket says 172.21.15.78:35658) 2023-11-28T20:02:35.055 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:35.044+0000 7f21d77fe640 1 -- 172.21.15.78:0/908539046 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f21d80c2110 msgr2=0x7f21d8070610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:02:35.055 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:35.044+0000 7f21d77fe640 1 --2- 172.21.15.78:0/908539046 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f21d80c2110 0x7f21d8070610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:35.056 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:35.044+0000 7f21d77fe640 1 -- 172.21.15.78:0/908539046 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f21d80c0c80 msgr2=0x7f21d80a6860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:02:35.056 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:35.044+0000 7f21d77fe640 1 --2- 172.21.15.78:0/908539046 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f21d80c0c80 0x7f21d80a6860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:35.056 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:35.044+0000 7f21d77fe640 1 -- 172.21.15.78:0/908539046 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21d0009b30 con 0x7f21d8154390 2023-11-28T20:02:35.056 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:35.044+0000 7f21cffff640 1 --2- 172.21.15.78:0/908539046 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f21d80c2110 0x7f21d8070610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T20:02:35.056 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:35.044+0000 7f21d77fe640 1 --2- 172.21.15.78:0/908539046 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f21d8154390 0x7f21d8146530 secure :-1 s=READY pgs=998 cs=0 l=1 rev1=1 crypto rx=0x7f21d00ab000 tx=0x7f21d0019770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:02:35.057 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:35.044+0000 7f21d4ff9640 1 -- 172.21.15.78:0/908539046 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21d00b8470 con 0x7f21d8154390 2023-11-28T20:02:35.057 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:35.044+0000 7f21d4ff9640 1 -- 172.21.15.78:0/908539046 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f21d00b85d0 con 0x7f21d8154390 2023-11-28T20:02:35.057 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:35.044+0000 7f21d4ff9640 1 -- 172.21.15.78:0/908539046 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21d00b8940 con 0x7f21d8154390 2023-11-28T20:02:35.057 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:35.044+0000 7f21dd8ea640 1 -- 172.21.15.78:0/908539046 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f21d80712c0 con 0x7f21d8154390 2023-11-28T20:02:35.057 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:35.044+0000 7f21dd8ea640 1 -- 172.21.15.78:0/908539046 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f21d8070b50 con 0x7f21d8154390 2023-11-28T20:02:35.057 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:35.044+0000 7f21dd8ea640 1 -- 172.21.15.78:0/908539046 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f21d8067630 con 0x7f21d8154390 2023-11-28T20:02:35.058 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:35.048+0000 7f21d4ff9640 1 -- 172.21.15.78:0/908539046 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f21d00b8aa0 con 0x7f21d8154390 2023-11-28T20:02:35.058 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:35.048+0000 7f21d4ff9640 1 --2- 172.21.15.78:0/908539046 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f21b80664a0 0x7f21b8068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:35.058 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:35.048+0000 7f21d4ff9640 1 -- 172.21.15.78:0/908539046 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6885+0+0 (secure 0 0 0) 0x7f21d011f110 con 0x7f21d8154390 2023-11-28T20:02:35.059 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:35.048+0000 7f21d6ffd640 1 --2- 172.21.15.78:0/908539046 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f21b80664a0 0x7f21b8068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:02:35.059 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:35.048+0000 7f21d6ffd640 1 --2- 172.21.15.78:0/908539046 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f21b80664a0 0x7f21b8068960 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f21c8000f70 tx=0x7f21c8007eb0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:02:35.060 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:35.052+0000 7f21d4ff9640 1 -- 172.21.15.78:0/908539046 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f21d00ec190 con 0x7f21d8154390 2023-11-28T20:02:35.256 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:35.252+0000 7f21dd8ea640 1 -- 172.21.15.78:0/908539046 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "auth get", "entity": "client.testuser"} v 0) v1 -- 0x7f21d8067630 con 0x7f21d8154390 2023-11-28T20:02:35.256 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:35.252+0000 7f21d4ff9640 1 -- 172.21.15.78:0/908539046 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "auth get", "entity": "client.testuser"}]=0 v23) v1 ==== 85+0+226 (secure 0 0 0) 0x7f21d00ef7b0 con 0x7f21d8154390 2023-11-28T20:02:35.256 INFO:teuthology.orchestra.run.smithi078.stdout:[client.testuser] 2023-11-28T20:02:35.256 INFO:teuthology.orchestra.run.smithi078.stdout: key = AQBaR2ZlZ0uqMRAAUA+5naTf77F/Mb/2VolMgw== 2023-11-28T20:02:35.256 INFO:teuthology.orchestra.run.smithi078.stdout: caps mds = "allow r fsname=cephfs, allow r fsname=cephfs2" 2023-11-28T20:02:35.256 INFO:teuthology.orchestra.run.smithi078.stdout: caps mon = "allow r" 2023-11-28T20:02:35.257 INFO:teuthology.orchestra.run.smithi078.stdout: caps osd = "allow r tag cephfs data=cephfs, allow r tag cephfs data=cephfs2" 2023-11-28T20:02:35.258 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:35.252+0000 7f21dd8ea640 1 -- 172.21.15.78:0/908539046 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f21b80664a0 msgr2=0x7f21b8068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:02:35.258 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:35.252+0000 7f21dd8ea640 1 --2- 172.21.15.78:0/908539046 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f21b80664a0 0x7f21b8068960 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f21c8000f70 tx=0x7f21c8007eb0 comp rx=0 tx=0).stop 2023-11-28T20:02:35.258 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:35.252+0000 7f21dd8ea640 1 -- 172.21.15.78:0/908539046 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f21d8154390 msgr2=0x7f21d8146530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:02:35.258 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:35.252+0000 7f21dd8ea640 1 --2- 172.21.15.78:0/908539046 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f21d8154390 0x7f21d8146530 secure :-1 s=READY pgs=998 cs=0 l=1 rev1=1 crypto rx=0x7f21d00ab000 tx=0x7f21d0019770 comp rx=0 tx=0).stop 2023-11-28T20:02:35.259 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:35.252+0000 7f21dd8ea640 1 -- 172.21.15.78:0/908539046 shutdown_connections 2023-11-28T20:02:35.259 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:35.252+0000 7f21dd8ea640 1 --2- 172.21.15.78:0/908539046 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f21b80664a0 0x7f21b8068960 unknown :-1 s=CLOSED pgs=475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:35.259 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:35.252+0000 7f21dd8ea640 1 --2- 172.21.15.78:0/908539046 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f21d80c2110 0x7f21d8070610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:35.259 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:35.252+0000 7f21dd8ea640 1 --2- 172.21.15.78:0/908539046 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f21d8154390 0x7f21d8146530 unknown :-1 s=CLOSED pgs=998 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:35.259 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:35.252+0000 7f21dd8ea640 1 --2- 172.21.15.78:0/908539046 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f21d80c0c80 0x7f21d80a6860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:35.259 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:35.252+0000 7f21dd8ea640 1 -- 172.21.15.78:0/908539046 >> 172.21.15.78:0/908539046 conn(0x7f21d806b220 msgr2=0x7f21d80bf550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:02:35.259 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:35.252+0000 7f21dd8ea640 1 -- 172.21.15.78:0/908539046 shutdown_connections 2023-11-28T20:02:35.259 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:35.252+0000 7f21dd8ea640 1 -- 172.21.15.78:0/908539046 wait complete. 2023-11-28T20:02:35.277 INFO:tasks.cephfs.test_multifs_auth:keyring generated for testing is - [client.testuser] key = AQBaR2ZlZ0uqMRAAUA+5naTf77F/Mb/2VolMgw== caps mds = "allow r fsname=cephfs, allow r fsname=cephfs2" caps mon = "allow r" caps osd = "allow r tag cephfs data=cephfs, allow r tag cephfs data=cephfs2" 2023-11-28T20:02:35.278 DEBUG:teuthology.orchestra.run.smithi078:> mktemp 2023-11-28T20:02:35.286 INFO:teuthology.orchestra.run.smithi078.stdout:/tmp/tmp.QZTYiaI6Et 2023-11-28T20:02:35.286 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2023-11-28T20:02:35.286 DEBUG:teuthology.orchestra.run.smithi078:> dd of=/tmp/tmp.QZTYiaI6Et 2023-11-28T20:02:35.339 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2023-11-28T20:02:35.339 DEBUG:teuthology.orchestra.run.smithi078:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-28T20:02:35.391 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2023-11-28T20:02:35.391 DEBUG:teuthology.orchestra.run.smithi078:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-28T20:02:35.443 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-28T20:02:35.623 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:35.620+0000 7fcd82580640 1 Processor -- start 2023-11-28T20:02:35.624 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:35.620+0000 7fcd82580640 1 -- start start 2023-11-28T20:02:35.625 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:35.620+0000 7fcd82580640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fcd7c071e30 0x7fcd7c0722c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:35.625 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:35.620+0000 7fcd82580640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fcd7c156110 0x7fcd7c156580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:35.625 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:35.620+0000 7fcd82580640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcd7c0c5710 con 0x7fcd7c14fd10 2023-11-28T20:02:35.625 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:35.620+0000 7fcd82580640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcd7c06c5e0 con 0x7fcd7c071e30 2023-11-28T20:02:35.625 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:35.620+0000 7fcd82580640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcd7c155c80 con 0x7fcd7c156110 2023-11-28T20:02:35.626 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:35.620+0000 7fcd7b7fe640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fcd7c071e30 0x7fcd7c0722c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:02:35.626 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:35.620+0000 7fcd7b7fe640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fcd7c071e30 0x7fcd7c0722c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:50706/0 (socket says 172.21.15.78:50706) 2023-11-28T20:02:35.626 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:35.620+0000 7fcd7b7fe640 1 -- 172.21.15.78:0/3342683155 learned_addr learned my addr 172.21.15.78:0/3342683155 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T20:02:35.626 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:35.620+0000 7fcd80b1d640 1 --2- 172.21.15.78:0/3342683155 >> v2:172.21.15.179:3300/0 conn(0x7fcd7c156110 0x7fcd7c156580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:02:35.626 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:35.620+0000 7fcd7b7fe640 1 -- 172.21.15.78:0/3342683155 >> v2:172.21.15.179:3300/0 conn(0x7fcd7c156110 msgr2=0x7fcd7c156580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:02:35.626 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:35.620+0000 7fcd7b7fe640 1 --2- 172.21.15.78:0/3342683155 >> v2:172.21.15.179:3300/0 conn(0x7fcd7c156110 0x7fcd7c156580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:35.626 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:35.620+0000 7fcd7b7fe640 1 -- 172.21.15.78:0/3342683155 >> v1:172.21.15.179:6789/0 conn(0x7fcd7c14fd10 legacy=0x7fcd7c0a4dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:02:35.626 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:35.620+0000 7fcd7b7fe640 1 -- 172.21.15.78:0/3342683155 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd7c0c4e70 con 0x7fcd7c071e30 2023-11-28T20:02:35.628 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:35.624+0000 7fcd7b7fe640 1 --2- 172.21.15.78:0/3342683155 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcd7c071e30 0x7fcd7c0722c0 secure :-1 s=READY pgs=999 cs=0 l=1 rev1=1 crypto rx=0x7fcd7c0a86e0 tx=0x7fcd7001c3e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=efa9b2d31d9371f6 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:02:35.629 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:35.624+0000 7fcd7affd640 1 -- 172.21.15.78:0/3342683155 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd700ac640 con 0x7fcd7c071e30 2023-11-28T20:02:35.630 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:35.624+0000 7fcd7affd640 1 -- 172.21.15.78:0/3342683155 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd700ac7a0 con 0x7fcd7c071e30 2023-11-28T20:02:35.630 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:35.624+0000 7fcd7affd640 1 -- 172.21.15.78:0/3342683155 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd700acb30 con 0x7fcd7c071e30 2023-11-28T20:02:35.630 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:35.624+0000 7fcd82580640 1 -- 172.21.15.78:0/3342683155 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcd7c071e30 msgr2=0x7fcd7c0722c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:02:35.630 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:35.624+0000 7fcd82580640 1 --2- 172.21.15.78:0/3342683155 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcd7c071e30 0x7fcd7c0722c0 secure :-1 s=READY pgs=999 cs=0 l=1 rev1=1 crypto rx=0x7fcd7c0a86e0 tx=0x7fcd7001c3e0 comp rx=0 tx=0).stop 2023-11-28T20:02:35.630 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:35.624+0000 7fcd82580640 1 -- 172.21.15.78:0/3342683155 shutdown_connections 2023-11-28T20:02:35.630 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:35.624+0000 7fcd82580640 1 --2- 172.21.15.78:0/3342683155 >> v2:172.21.15.179:3300/0 conn(0x7fcd7c156110 0x7fcd7c156580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:35.630 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:35.624+0000 7fcd82580640 1 --2- 172.21.15.78:0/3342683155 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcd7c071e30 0x7fcd7c0722c0 unknown :-1 s=CLOSED pgs=999 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:35.630 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:35.624+0000 7fcd82580640 1 -- 172.21.15.78:0/3342683155 >> 172.21.15.78:0/3342683155 conn(0x7fcd7c0a7810 msgr2=0x7fcd7c0a7c20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:02:35.631 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:35.624+0000 7fcd82580640 1 -- 172.21.15.78:0/3342683155 shutdown_connections 2023-11-28T20:02:35.631 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:35.624+0000 7fcd82580640 1 -- 172.21.15.78:0/3342683155 wait complete. 2023-11-28T20:02:35.631 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:35.628+0000 7fcd82580640 1 Processor -- start 2023-11-28T20:02:35.631 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:35.628+0000 7fcd82580640 1 -- start start 2023-11-28T20:02:35.634 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:35.628+0000 7fcd82580640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcd7c071e30 0x7fcd7c15c370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:35.634 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:35.628+0000 7fcd82580640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcd7c14fd10 0x7fcd7c1ee2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:35.634 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:35.628+0000 7fcd82580640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcd7c156110 0x7fcd7c149e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:35.634 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:35.628+0000 7fcd82580640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd7c1ede90 con 0x7fcd7c071e30 2023-11-28T20:02:35.634 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:35.628+0000 7fcd82580640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd7c1534e0 con 0x7fcd7c14fd10 2023-11-28T20:02:35.635 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:35.628+0000 7fcd82580640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd7c152cf0 con 0x7fcd7c156110 2023-11-28T20:02:35.635 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:35.628+0000 7fcd7bfff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcd7c071e30 0x7fcd7c15c370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:02:35.635 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:35.628+0000 7fcd7bfff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcd7c071e30 0x7fcd7c15c370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:50720/0 (socket says 172.21.15.78:50720) 2023-11-28T20:02:35.635 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:35.628+0000 7fcd7bfff640 1 -- 172.21.15.78:0/3082159022 learned_addr learned my addr 172.21.15.78:0/3082159022 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T20:02:35.635 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:35.628+0000 7fcd7b7fe640 1 --2- 172.21.15.78:0/3082159022 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcd7c14fd10 0x7fcd7c1ee2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:02:35.636 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:35.628+0000 7fcd80b1d640 1 --2- 172.21.15.78:0/3082159022 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcd7c156110 0x7fcd7c149e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:02:35.636 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:35.628+0000 7fcd7bfff640 1 -- 172.21.15.78:0/3082159022 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcd7c156110 msgr2=0x7fcd7c149e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:02:35.636 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:35.628+0000 7fcd7bfff640 1 --2- 172.21.15.78:0/3082159022 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcd7c156110 0x7fcd7c149e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:35.636 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:35.628+0000 7fcd7bfff640 1 -- 172.21.15.78:0/3082159022 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcd7c14fd10 msgr2=0x7fcd7c1ee2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:02:35.636 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:35.628+0000 7fcd7bfff640 1 --2- 172.21.15.78:0/3082159022 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcd7c14fd10 0x7fcd7c1ee2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:35.637 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:35.628+0000 7fcd7bfff640 1 -- 172.21.15.78:0/3082159022 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd700094d0 con 0x7fcd7c071e30 2023-11-28T20:02:35.637 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:35.628+0000 7fcd7bfff640 1 --2- 172.21.15.78:0/3082159022 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcd7c071e30 0x7fcd7c15c370 secure :-1 s=READY pgs=1000 cs=0 l=1 rev1=1 crypto rx=0x7fcd6c00c560 tx=0x7fcd6c00ca20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:02:35.637 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:35.628+0000 7fcd78ff9640 1 -- 172.21.15.78:0/3082159022 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd6c005220 con 0x7fcd7c071e30 2023-11-28T20:02:35.637 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:35.628+0000 7fcd78ff9640 1 -- 172.21.15.78:0/3082159022 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd6c005380 con 0x7fcd7c071e30 2023-11-28T20:02:35.637 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:35.628+0000 7fcd78ff9640 1 -- 172.21.15.78:0/3082159022 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd6c007270 con 0x7fcd7c071e30 2023-11-28T20:02:35.638 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:35.628+0000 7fcd82580640 1 -- 172.21.15.78:0/3082159022 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcd7c150cd0 con 0x7fcd7c071e30 2023-11-28T20:02:35.638 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:35.628+0000 7fcd82580640 1 -- 172.21.15.78:0/3082159022 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcd7c153200 con 0x7fcd7c071e30 2023-11-28T20:02:35.639 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:35.628+0000 7fcd82580640 1 -- 172.21.15.78:0/3082159022 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcd7c067630 con 0x7fcd7c071e30 2023-11-28T20:02:35.639 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:35.632+0000 7fcd78ff9640 1 -- 172.21.15.78:0/3082159022 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fcd6c0073d0 con 0x7fcd7c071e30 2023-11-28T20:02:35.639 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:35.632+0000 7fcd78ff9640 1 --2- 172.21.15.78:0/3082159022 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fcd68066470 0x7fcd68068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:35.639 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:35.632+0000 7fcd78ff9640 1 -- 172.21.15.78:0/3082159022 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6885+0+0 (secure 0 0 0) 0x7fcd6c083af0 con 0x7fcd7c071e30 2023-11-28T20:02:35.640 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:35.632+0000 7fcd7b7fe640 1 --2- 172.21.15.78:0/3082159022 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fcd68066470 0x7fcd68068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:02:35.640 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:35.632+0000 7fcd7b7fe640 1 --2- 172.21.15.78:0/3082159022 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fcd68066470 0x7fcd68068930 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7fcd700ae000 tx=0x7fcd70008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:02:35.641 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:35.636+0000 7fcd78ff9640 1 -- 172.21.15.78:0/3082159022 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fcd6c050b60 con 0x7fcd7c071e30 2023-11-28T20:02:35.791 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:35.788+0000 7fcd82580640 1 -- 172.21.15.78:0/3082159022 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fcd7c1edc60 con 0x7fcd7c071e30 2023-11-28T20:02:35.792 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:35.788+0000 7fcd78ff9640 1 -- 172.21.15.78:0/3082159022 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v85) v1 ==== 74+0+20339 (secure 0 0 0) 0x7fcd6c054180 con 0x7fcd7c071e30 2023-11-28T20:02:35.793 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-11-28T20:02:35.793 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":85,"fsid":"dd9780e8-3bda-44fa-a9f0-fa07d19d901d","created":"2023-11-28T19:58:40.969556+0000","modified":"2023-11-28T20:02:26.796715+0000","last_up_change":"2023-11-28T19:58:52.596716+0000","last_in_change":"2023-11-28T19:58:43.609275+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":16,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-28T19:58:54.011229+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_metadata","create_time":"2023-11-28T20:02:05.787820+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs_data","create_time":"2023-11-28T20:02:06.652305+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs2_metadata","create_time":"2023-11-28T20:02:23.066724+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":16,"pool_name":"cephfs2_data","create_time":"2023-11-28T20:02:24.230614+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs2"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e84245ac-b5da-429e-af18-39acaa2b33e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6800","nonce":3358701235},{"type":"v1","addr":"172.21.15.78:6801","nonce":3358701235}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6802","nonce":3358701235},{"type":"v1","addr":"172.21.15.78:6803","nonce":3358701235}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6806","nonce":3358701235},{"type":"v1","addr":"172.21.15.78:6807","nonce":3358701235}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6804","nonce":3358701235},{"type":"v1","addr":"172.21.15.78:6805","nonce":3358701235}]},"public_addr":"172.21.15.78:6801/3358701235","cluster_addr":"172.21.15.78:6803/3358701235","heartbeat_back_addr":"172.21.15.78:6807/3358701235","heartbeat_front_addr":"172.21.15.78:6805/3358701235","state":["exists","up"]},{"osd":1,"uuid":"e634831d-c4e2-48d9-870c-9556ae162981","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6808","nonce":3211476654},{"type":"v1","addr":"172.21.15.78:6809","nonce":3211476654}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6810","nonce":3211476654},{"type":"v1","addr":"172.21.15.78:6811","nonce":3211476654}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6814","nonce":3211476654},{"type":"v1","addr":"172.21.15.78:6815","nonce":3211476654}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6812","nonce":3211476654},{"type":"v1","addr":"172.21.15.78:6813","nonce":3211476654}]},"public_addr":"172.21.15.78:6809/3211476654","cluster_addr":"172.21.15.78:6811/3211476654","heartbeat_back_addr":"172.21.15.78:6815/3211476654","heartbeat_front_addr":"172.21.15.78:6813/3211476654","state":["exists","up"]},{"osd":2,"uuid":"274c8395-6534-41f0-b8fb-a00af8985aa8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6816","nonce":2532904479},{"type":"v1","addr":"172.21.15.78:6817","nonce":2532904479}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6818","nonce":2532904479},{"type":"v1","addr":"172.21.15.78:6819","nonce":2532904479}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6822","nonce":2532904479},{"type":"v1","addr":"172.21.15.78:6823","nonce":2532904479}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6820","nonce":2532904479},{"type":"v1","addr":"172.21.15.78:6821","nonce":2532904479}]},"public_addr":"172.21.15.78:6817/2532904479","cluster_addr":"172.21.15.78:6819/2532904479","heartbeat_back_addr":"172.21.15.78:6823/2532904479","heartbeat_front_addr":"172.21.15.78:6821/2532904479","state":["exists","up"]},{"osd":3,"uuid":"77acc9af-7d4d-4b18-8cf5-d62f5971b7c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6824","nonce":3442991267},{"type":"v1","addr":"172.21.15.78:6825","nonce":3442991267}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6826","nonce":3442991267},{"type":"v1","addr":"172.21.15.78:6827","nonce":3442991267}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6830","nonce":3442991267},{"type":"v1","addr":"172.21.15.78:6831","nonce":3442991267}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6828","nonce":3442991267},{"type":"v1","addr":"172.21.15.78:6829","nonce":3442991267}]},"public_addr":"172.21.15.78:6825/3442991267","cluster_addr":"172.21.15.78:6827/3442991267","heartbeat_back_addr":"172.21.15.78:6831/3442991267","heartbeat_front_addr":"172.21.15.78:6829/3442991267","state":["exists","up"]},{"osd":4,"uuid":"5c62bc66-6b34-4b7f-a66b-9a743969138c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":802983577},{"type":"v1","addr":"172.21.15.179:6809","nonce":802983577}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":802983577},{"type":"v1","addr":"172.21.15.179:6811","nonce":802983577}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":802983577},{"type":"v1","addr":"172.21.15.179:6815","nonce":802983577}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":802983577},{"type":"v1","addr":"172.21.15.179:6813","nonce":802983577}]},"public_addr":"172.21.15.179:6809/802983577","cluster_addr":"172.21.15.179:6811/802983577","heartbeat_back_addr":"172.21.15.179:6815/802983577","heartbeat_front_addr":"172.21.15.179:6813/802983577","state":["exists","up"]},{"osd":5,"uuid":"67db6d36-f684-4079-b0cd-82b4dd61461f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":518192887},{"type":"v1","addr":"172.21.15.179:6818","nonce":518192887}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":518192887},{"type":"v1","addr":"172.21.15.179:6822","nonce":518192887}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":518192887},{"type":"v1","addr":"172.21.15.179:6829","nonce":518192887}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6824","nonce":518192887},{"type":"v1","addr":"172.21.15.179:6826","nonce":518192887}]},"public_addr":"172.21.15.179:6818/518192887","cluster_addr":"172.21.15.179:6822/518192887","heartbeat_back_addr":"172.21.15.179:6829/518192887","heartbeat_front_addr":"172.21.15.179:6826/518192887","state":["exists","up"]},{"osd":6,"uuid":"12e670af-5a16-4c81-9f97-defa66cab967","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":815435378},{"type":"v1","addr":"172.21.15.179:6801","nonce":815435378}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":815435378},{"type":"v1","addr":"172.21.15.179:6803","nonce":815435378}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":815435378},{"type":"v1","addr":"172.21.15.179:6807","nonce":815435378}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":815435378},{"type":"v1","addr":"172.21.15.179:6805","nonce":815435378}]},"public_addr":"172.21.15.179:6801/815435378","cluster_addr":"172.21.15.179:6803/815435378","heartbeat_back_addr":"172.21.15.179:6807/815435378","heartbeat_front_addr":"172.21.15.179:6805/815435378","state":["exists","up"]},{"osd":7,"uuid":"fe630650-2eb3-49ad-8676-c341e6332eb1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6817","nonce":2848432339},{"type":"v1","addr":"172.21.15.179:6819","nonce":2848432339}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6821","nonce":2848432339},{"type":"v1","addr":"172.21.15.179:6823","nonce":2848432339}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":2848432339},{"type":"v1","addr":"172.21.15.179:6831","nonce":2848432339}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6825","nonce":2848432339},{"type":"v1","addr":"172.21.15.179:6827","nonce":2848432339}]},"public_addr":"172.21.15.179:6819/2848432339","cluster_addr":"172.21.15.179:6823/2848432339","heartbeat_back_addr":"172.21.15.179:6831/2848432339","heartbeat_front_addr":"172.21.15.179:6827/2848432339","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:58:49.255433+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:58:49.412880+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:58:49.559295+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:58:49.245237+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:58:49.184557+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:58:49.329851+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:58:49.366012+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:58:49.349604+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-28T20:02:35.795 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:35.788+0000 7fcd82580640 1 -- 172.21.15.78:0/3082159022 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fcd68066470 msgr2=0x7fcd68068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:02:35.795 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:35.788+0000 7fcd82580640 1 --2- 172.21.15.78:0/3082159022 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fcd68066470 0x7fcd68068930 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7fcd700ae000 tx=0x7fcd70008040 comp rx=0 tx=0).stop 2023-11-28T20:02:35.795 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:35.788+0000 7fcd82580640 1 -- 172.21.15.78:0/3082159022 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcd7c071e30 msgr2=0x7fcd7c15c370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:02:35.795 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:35.788+0000 7fcd82580640 1 --2- 172.21.15.78:0/3082159022 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcd7c071e30 0x7fcd7c15c370 secure :-1 s=READY pgs=1000 cs=0 l=1 rev1=1 crypto rx=0x7fcd6c00c560 tx=0x7fcd6c00ca20 comp rx=0 tx=0).stop 2023-11-28T20:02:35.795 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:35.788+0000 7fcd82580640 1 -- 172.21.15.78:0/3082159022 shutdown_connections 2023-11-28T20:02:35.795 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:35.788+0000 7fcd82580640 1 --2- 172.21.15.78:0/3082159022 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fcd68066470 0x7fcd68068930 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:35.795 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:35.788+0000 7fcd82580640 1 --2- 172.21.15.78:0/3082159022 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcd7c156110 0x7fcd7c149e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:35.796 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:35.788+0000 7fcd82580640 1 --2- 172.21.15.78:0/3082159022 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcd7c14fd10 0x7fcd7c1ee2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:35.796 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:35.788+0000 7fcd82580640 1 --2- 172.21.15.78:0/3082159022 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcd7c071e30 0x7fcd7c15c370 unknown :-1 s=CLOSED pgs=1000 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:35.796 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:35.788+0000 7fcd82580640 1 -- 172.21.15.78:0/3082159022 >> 172.21.15.78:0/3082159022 conn(0x7fcd7c0a7810 msgr2=0x7fcd7c154270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:02:35.796 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:35.788+0000 7fcd82580640 1 -- 172.21.15.78:0/3082159022 shutdown_connections 2023-11-28T20:02:35.796 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:35.788+0000 7fcd82580640 1 -- 172.21.15.78:0/3082159022 wait complete. 2023-11-28T20:02:35.816 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-28T19:58:54.011229+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 13, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-28T20:02:05.787820+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '80', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 14, 'pool_name': 'cephfs_data', 'create_time': '2023-11-28T20:02:06.652305+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '81', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 15, 'pool_name': 'cephfs2_metadata', 'create_time': '2023-11-28T20:02:23.066724+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '84', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs2'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 16, 'pool_name': 'cephfs2_data', 'create_time': '2023-11-28T20:02:24.230614+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '85', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs2'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-28T20:02:35.816 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-28T20:02:35.958 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:35.952+0000 7f008ce5f640 1 Processor -- start 2023-11-28T20:02:35.958 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:35.952+0000 7f008ce5f640 1 -- start start 2023-11-28T20:02:35.959 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:35.956+0000 7f008ce5f640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f008814b1e0 0x7f00880c1700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:35.959 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:35.956+0000 7f008ce5f640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f00880a4e20 con 0x7f00881548c0 2023-11-28T20:02:35.959 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:35.956+0000 7f008ce5f640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f00880a50e0 con 0x7f00880c5300 2023-11-28T20:02:35.959 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:35.956+0000 7f008ce5f640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f00880c0f00 con 0x7f008814b1e0 2023-11-28T20:02:35.960 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:35.956+0000 7f0086d9d640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f00881548c0 0x7f0088154d30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:49950/0 (socket says 172.21.15.78:49950) 2023-11-28T20:02:35.961 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:35.956+0000 7f0086d9d640 1 -- 172.21.15.78:0/2291715572 learned_addr learned my addr 172.21.15.78:0/2291715572 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-11-28T20:02:35.961 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:35.956+0000 7f008659c640 1 --2- 172.21.15.78:0/2291715572 >> v2:172.21.15.179:3300/0 conn(0x7f008814b1e0 0x7f00880c1700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:02:35.961 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:35.956+0000 7f0085d9b640 1 -- 172.21.15.78:0/2291715572 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2309928764 0 0) 0x7f00880a4e20 con 0x7f00881548c0 2023-11-28T20:02:35.961 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:35.956+0000 7f0085d9b640 1 -- 172.21.15.78:0/2291715572 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0074003530 con 0x7f00881548c0 2023-11-28T20:02:35.961 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:35.956+0000 7f008659c640 1 -- 172.21.15.78:0/2291715572 >> v1:172.21.15.179:6789/0 conn(0x7f00880c5300 legacy=0x7f00880a9c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:02:35.961 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:35.956+0000 7f008659c640 1 -- 172.21.15.78:0/2291715572 >> v1:172.21.15.78:6789/0 conn(0x7f00881548c0 legacy=0x7f0088154d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:02:35.961 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:35.956+0000 7f008659c640 1 -- 172.21.15.78:0/2291715572 --> v2:172.21.15.179:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00880c11e0 con 0x7f008814b1e0 2023-11-28T20:02:35.963 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:35.960+0000 7f008659c640 1 --2- 172.21.15.78:0/2291715572 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f008814b1e0 0x7f00880c1700 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f00780097c0 tx=0x7f007801c480 comp rx=0 tx=0).ready entity=mon.1 client_cookie=45bfc8a14d1bafae server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:02:35.964 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:35.960+0000 7f0085d9b640 1 -- 172.21.15.78:0/2291715572 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00780ab600 con 0x7f008814b1e0 2023-11-28T20:02:35.964 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:35.960+0000 7f0085d9b640 1 -- 172.21.15.78:0/2291715572 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f00780a7050 con 0x7f008814b1e0 2023-11-28T20:02:35.964 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:35.960+0000 7f0085d9b640 1 -- 172.21.15.78:0/2291715572 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00780ab980 con 0x7f008814b1e0 2023-11-28T20:02:35.965 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:35.960+0000 7f008ce5f640 1 -- 172.21.15.78:0/2291715572 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f008814b1e0 msgr2=0x7f00880c1700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:02:35.965 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:35.960+0000 7f008ce5f640 1 --2- 172.21.15.78:0/2291715572 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f008814b1e0 0x7f00880c1700 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f00780097c0 tx=0x7f007801c480 comp rx=0 tx=0).stop 2023-11-28T20:02:35.965 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:35.960+0000 7f008ce5f640 1 -- 172.21.15.78:0/2291715572 shutdown_connections 2023-11-28T20:02:35.965 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:35.960+0000 7f008ce5f640 1 --2- 172.21.15.78:0/2291715572 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f008814b1e0 0x7f00880c1700 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:35.965 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:35.960+0000 7f008ce5f640 1 -- 172.21.15.78:0/2291715572 >> 172.21.15.78:0/2291715572 conn(0x7f00880c59f0 msgr2=0x7f00880c5e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:02:35.965 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:35.960+0000 7f008ce5f640 1 -- 172.21.15.78:0/2291715572 shutdown_connections 2023-11-28T20:02:35.966 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:35.960+0000 7f008ce5f640 1 -- 172.21.15.78:0/2291715572 wait complete. 2023-11-28T20:02:35.966 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:35.960+0000 7f008ce5f640 1 Processor -- start 2023-11-28T20:02:35.966 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:35.960+0000 7f008ce5f640 1 -- start start 2023-11-28T20:02:35.968 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:35.964+0000 7f008ce5f640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f00880c5300 0x7f0088140c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:35.968 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:35.964+0000 7f008ce5f640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f008814b1e0 0x7f0088143df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:35.968 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:35.964+0000 7f008ce5f640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f00881548c0 0x7f008806b970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:35.968 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:35.964+0000 7f008ce5f640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0088141500 con 0x7f00881548c0 2023-11-28T20:02:35.968 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:35.964+0000 7f008ce5f640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0088142c30 con 0x7f008814b1e0 2023-11-28T20:02:35.968 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:35.964+0000 7f008ce5f640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0088144330 con 0x7f00880c5300 2023-11-28T20:02:35.968 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:35.964+0000 7f0086d9d640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f00881548c0 0x7f008806b970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:02:35.968 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:35.964+0000 7f0086d9d640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f00881548c0 0x7f008806b970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:50728/0 (socket says 172.21.15.78:50728) 2023-11-28T20:02:35.968 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:35.964+0000 7f0086d9d640 1 -- 172.21.15.78:0/1072707866 learned_addr learned my addr 172.21.15.78:0/1072707866 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T20:02:35.969 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:35.964+0000 7f007dd9b640 1 --2- 172.21.15.78:0/1072707866 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f008814b1e0 0x7f0088143df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:02:35.969 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:35.964+0000 7f008659c640 1 --2- 172.21.15.78:0/1072707866 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f00880c5300 0x7f0088140c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:02:35.970 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:35.964+0000 7f0086d9d640 1 -- 172.21.15.78:0/1072707866 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f00880c5300 msgr2=0x7f0088140c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:02:35.970 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:35.964+0000 7f0086d9d640 1 --2- 172.21.15.78:0/1072707866 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f00880c5300 0x7f0088140c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:35.970 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:35.964+0000 7f0086d9d640 1 -- 172.21.15.78:0/1072707866 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f008814b1e0 msgr2=0x7f0088143df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:02:35.970 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:35.964+0000 7f0086d9d640 1 --2- 172.21.15.78:0/1072707866 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f008814b1e0 0x7f0088143df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:35.970 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:35.964+0000 7f0086d9d640 1 -- 172.21.15.78:0/1072707866 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0078009420 con 0x7f00881548c0 2023-11-28T20:02:35.970 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:35.964+0000 7f007dd9b640 1 --2- 172.21.15.78:0/1072707866 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f008814b1e0 0x7f0088143df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T20:02:35.970 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:35.964+0000 7f0086d9d640 1 --2- 172.21.15.78:0/1072707866 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f00881548c0 0x7f008806b970 secure :-1 s=READY pgs=1002 cs=0 l=1 rev1=1 crypto rx=0x7f008000c3c0 tx=0x7f008000c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:02:35.971 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:35.964+0000 7f007f7fe640 1 -- 172.21.15.78:0/1072707866 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0080005cf0 con 0x7f00881548c0 2023-11-28T20:02:35.971 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:35.964+0000 7f007f7fe640 1 -- 172.21.15.78:0/1072707866 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0080005e50 con 0x7f00881548c0 2023-11-28T20:02:35.971 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:35.964+0000 7f008ce5f640 1 -- 172.21.15.78:0/1072707866 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0088142080 con 0x7f00881548c0 2023-11-28T20:02:35.971 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:35.964+0000 7f007f7fe640 1 -- 172.21.15.78:0/1072707866 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0080007310 con 0x7f00881548c0 2023-11-28T20:02:35.971 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:35.964+0000 7f008ce5f640 1 -- 172.21.15.78:0/1072707866 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0088141a30 con 0x7f00881548c0 2023-11-28T20:02:35.971 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:35.964+0000 7f008ce5f640 1 -- 172.21.15.78:0/1072707866 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0088141890 con 0x7f00881548c0 2023-11-28T20:02:35.972 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:35.968+0000 7f007f7fe640 1 -- 172.21.15.78:0/1072707866 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f0080007470 con 0x7f00881548c0 2023-11-28T20:02:35.972 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:35.968+0000 7f007f7fe640 1 --2- 172.21.15.78:0/1072707866 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f0068066470 0x7f0068068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:35.972 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:35.968+0000 7f007f7fe640 1 -- 172.21.15.78:0/1072707866 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6885+0+0 (secure 0 0 0) 0x7f0080083750 con 0x7f00881548c0 2023-11-28T20:02:35.972 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:35.968+0000 7f008659c640 1 --2- 172.21.15.78:0/1072707866 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f0068066470 0x7f0068068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:02:35.972 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:35.968+0000 7f008659c640 1 --2- 172.21.15.78:0/1072707866 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f0068066470 0x7f0068068930 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f00780ad000 tx=0x7f00780a6000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:02:35.976 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:35.972+0000 7f007f7fe640 1 -- 172.21.15.78:0/1072707866 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f0088141890 con 0x7f00881548c0 2023-11-28T20:02:36.126 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:36.120+0000 7f008ce5f640 1 -- 172.21.15.78:0/1072707866 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f0088143b10 con 0x7f00881548c0 2023-11-28T20:02:36.126 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:36.120+0000 7f007f7fe640 1 -- 172.21.15.78:0/1072707866 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v85) v1 ==== 93+0+10 (secure 0 0 0) 0x7f0088143b10 con 0x7f00881548c0 2023-11-28T20:02:36.127 INFO:teuthology.orchestra.run.smithi078.stdout:pg_num: 1 2023-11-28T20:02:36.129 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:36.124+0000 7f008ce5f640 1 -- 172.21.15.78:0/1072707866 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f0068066470 msgr2=0x7f0068068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:02:36.129 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:36.124+0000 7f008ce5f640 1 --2- 172.21.15.78:0/1072707866 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f0068066470 0x7f0068068930 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f00780ad000 tx=0x7f00780a6000 comp rx=0 tx=0).stop 2023-11-28T20:02:36.129 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:36.124+0000 7f008ce5f640 1 -- 172.21.15.78:0/1072707866 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f00881548c0 msgr2=0x7f008806b970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:02:36.129 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:36.124+0000 7f008ce5f640 1 --2- 172.21.15.78:0/1072707866 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f00881548c0 0x7f008806b970 secure :-1 s=READY pgs=1002 cs=0 l=1 rev1=1 crypto rx=0x7f008000c3c0 tx=0x7f008000c880 comp rx=0 tx=0).stop 2023-11-28T20:02:36.130 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:36.124+0000 7f008ce5f640 1 -- 172.21.15.78:0/1072707866 shutdown_connections 2023-11-28T20:02:36.130 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:36.124+0000 7f008ce5f640 1 --2- 172.21.15.78:0/1072707866 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f0068066470 0x7f0068068930 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:36.130 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:36.124+0000 7f008ce5f640 1 --2- 172.21.15.78:0/1072707866 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f00881548c0 0x7f008806b970 unknown :-1 s=CLOSED pgs=1002 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:36.130 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:36.124+0000 7f008ce5f640 1 --2- 172.21.15.78:0/1072707866 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f008814b1e0 0x7f0088143df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:36.131 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:36.124+0000 7f008ce5f640 1 --2- 172.21.15.78:0/1072707866 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f00880c5300 0x7f0088140c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:36.131 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:36.124+0000 7f008ce5f640 1 -- 172.21.15.78:0/1072707866 >> 172.21.15.78:0/1072707866 conn(0x7f00880c59f0 msgr2=0x7f0088146d90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:02:36.131 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:36.124+0000 7f008ce5f640 1 -- 172.21.15.78:0/1072707866 shutdown_connections 2023-11-28T20:02:36.131 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:36.124+0000 7f008ce5f640 1 -- 172.21.15.78:0/1072707866 wait complete. 2023-11-28T20:02:36.148 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-28T20:02:36.288 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:36.284+0000 7f538ff57640 1 Processor -- start 2023-11-28T20:02:36.289 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:36.284+0000 7f538ff57640 1 -- start start 2023-11-28T20:02:36.290 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:36.284+0000 7f538ff57640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f53880c5300 0x7f53880a9c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:36.290 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:36.284+0000 7f538ff57640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f53880a4e20 con 0x7f538814b1e0 2023-11-28T20:02:36.290 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:36.284+0000 7f538ff57640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f53880a50e0 con 0x7f53881548c0 2023-11-28T20:02:36.290 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:36.284+0000 7f538ff57640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f53880c0f00 con 0x7f53880c5300 2023-11-28T20:02:36.291 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:36.284+0000 7f538dcf3640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f538814b1e0 0x7f53880c1700 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:49962/0 (socket says 172.21.15.78:49962) 2023-11-28T20:02:36.291 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:36.284+0000 7f538dcf3640 1 -- 172.21.15.78:0/3520891268 learned_addr learned my addr 172.21.15.78:0/3520891268 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-11-28T20:02:36.291 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:36.284+0000 7f538d4f2640 1 --2- 172.21.15.78:0/3520891268 >> v2:172.21.15.78:3300/0 conn(0x7f53880c5300 0x7f53880a9c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:02:36.291 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:36.284+0000 7f538ccf1640 1 -- 172.21.15.78:0/3520891268 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1593694334 0 0) 0x7f53880a4e20 con 0x7f538814b1e0 2023-11-28T20:02:36.291 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:36.284+0000 7f538d4f2640 1 -- 172.21.15.78:0/3520891268 >> v1:172.21.15.179:6789/0 conn(0x7f53881548c0 legacy=0x7f5388154d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:02:36.291 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:36.284+0000 7f538d4f2640 1 -- 172.21.15.78:0/3520891268 >> v1:172.21.15.78:6789/0 conn(0x7f538814b1e0 legacy=0x7f53880c1700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:02:36.291 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:36.284+0000 7f538d4f2640 1 -- 172.21.15.78:0/3520891268 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53880c11e0 con 0x7f53880c5300 2023-11-28T20:02:36.292 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:36.288+0000 7f538d4f2640 1 --2- 172.21.15.78:0/3520891268 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f53880c5300 0x7f53880a9c30 secure :-1 s=READY pgs=1004 cs=0 l=1 rev1=1 crypto rx=0x7f53780097c0 tx=0x7f537801c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e498fad6dc98021f server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:02:36.293 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:36.288+0000 7f538ccf1640 1 -- 172.21.15.78:0/3520891268 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53780ab600 con 0x7f53880c5300 2023-11-28T20:02:36.293 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:36.288+0000 7f538ccf1640 1 -- 172.21.15.78:0/3520891268 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f53780a7050 con 0x7f53880c5300 2023-11-28T20:02:36.294 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:36.288+0000 7f538ccf1640 1 -- 172.21.15.78:0/3520891268 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53780ab980 con 0x7f53880c5300 2023-11-28T20:02:36.295 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:36.288+0000 7f538ff57640 1 -- 172.21.15.78:0/3520891268 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f53880c5300 msgr2=0x7f53880a9c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:02:36.295 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:36.288+0000 7f538ff57640 1 --2- 172.21.15.78:0/3520891268 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f53880c5300 0x7f53880a9c30 secure :-1 s=READY pgs=1004 cs=0 l=1 rev1=1 crypto rx=0x7f53780097c0 tx=0x7f537801c480 comp rx=0 tx=0).stop 2023-11-28T20:02:36.295 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:36.288+0000 7f538ff57640 1 -- 172.21.15.78:0/3520891268 shutdown_connections 2023-11-28T20:02:36.296 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:36.288+0000 7f538ff57640 1 --2- 172.21.15.78:0/3520891268 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f53880c5300 0x7f53880a9c30 unknown :-1 s=CLOSED pgs=1004 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:36.296 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:36.288+0000 7f538ff57640 1 -- 172.21.15.78:0/3520891268 >> 172.21.15.78:0/3520891268 conn(0x7f53880c59f0 msgr2=0x7f53880c5e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:02:36.296 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:36.288+0000 7f538ff57640 1 -- 172.21.15.78:0/3520891268 shutdown_connections 2023-11-28T20:02:36.296 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:36.288+0000 7f538ff57640 1 -- 172.21.15.78:0/3520891268 wait complete. 2023-11-28T20:02:36.300 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:36.292+0000 7f538ff57640 1 Processor -- start 2023-11-28T20:02:36.300 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:36.292+0000 7f538ff57640 1 -- start start 2023-11-28T20:02:36.300 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:36.292+0000 7f538ff57640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f53880c5300 0x7f5388141360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:36.300 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:36.292+0000 7f538ff57640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f538814b1e0 0x7f53880bed60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:36.300 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:36.292+0000 7f538ff57640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f53881548c0 0x7f538806b970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:36.300 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:36.292+0000 7f538ff57640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53881418a0 con 0x7f538814b1e0 2023-11-28T20:02:36.300 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:36.292+0000 7f538ff57640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53881f1280 con 0x7f53881548c0 2023-11-28T20:02:36.300 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:36.292+0000 7f538ff57640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f538806d6b0 con 0x7f53880c5300 2023-11-28T20:02:36.300 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:36.292+0000 7f538d4f2640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f538814b1e0 0x7f53880bed60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:02:36.300 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:36.292+0000 7f538d4f2640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f538814b1e0 0x7f53880bed60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:50748/0 (socket says 172.21.15.78:50748) 2023-11-28T20:02:36.301 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:36.292+0000 7f538d4f2640 1 -- 172.21.15.78:0/3659318841 learned_addr learned my addr 172.21.15.78:0/3659318841 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T20:02:36.301 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:36.292+0000 7f538e4f4640 1 --2- 172.21.15.78:0/3659318841 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f53881548c0 0x7f538806b970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:02:36.301 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:36.292+0000 7f538dcf3640 1 --2- 172.21.15.78:0/3659318841 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f53880c5300 0x7f5388141360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:02:36.301 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:36.292+0000 7f538d4f2640 1 -- 172.21.15.78:0/3659318841 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f53880c5300 msgr2=0x7f5388141360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:02:36.301 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:36.292+0000 7f538d4f2640 1 --2- 172.21.15.78:0/3659318841 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f53880c5300 0x7f5388141360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:36.301 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:36.292+0000 7f538d4f2640 1 -- 172.21.15.78:0/3659318841 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f53881548c0 msgr2=0x7f538806b970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:02:36.301 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:36.292+0000 7f538d4f2640 1 --2- 172.21.15.78:0/3659318841 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f53881548c0 0x7f538806b970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:36.301 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:36.292+0000 7f538d4f2640 1 -- 172.21.15.78:0/3659318841 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5378009420 con 0x7f538814b1e0 2023-11-28T20:02:36.301 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:36.292+0000 7f538d4f2640 1 --2- 172.21.15.78:0/3659318841 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f538814b1e0 0x7f53880bed60 secure :-1 s=READY pgs=1005 cs=0 l=1 rev1=1 crypto rx=0x7f5378019090 tx=0x7f5378019220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:02:36.301 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:36.292+0000 7f537e7fc640 1 -- 172.21.15.78:0/3659318841 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53780b4610 con 0x7f538814b1e0 2023-11-28T20:02:36.301 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:36.292+0000 7f537e7fc640 1 -- 172.21.15.78:0/3659318841 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f53780abe90 con 0x7f538814b1e0 2023-11-28T20:02:36.301 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:36.292+0000 7f537e7fc640 1 -- 172.21.15.78:0/3659318841 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53780b49d0 con 0x7f538814b1e0 2023-11-28T20:02:36.303 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:36.292+0000 7f538ff57640 1 -- 172.21.15.78:0/3659318841 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f53881ecf80 con 0x7f538814b1e0 2023-11-28T20:02:36.303 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:36.292+0000 7f538ff57640 1 -- 172.21.15.78:0/3659318841 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f53881ed540 con 0x7f538814b1e0 2023-11-28T20:02:36.303 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:36.296+0000 7f538ff57640 1 -- 172.21.15.78:0/3659318841 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5388067630 con 0x7f538814b1e0 2023-11-28T20:02:36.303 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:36.296+0000 7f537e7fc640 1 -- 172.21.15.78:0/3659318841 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f53780b2040 con 0x7f538814b1e0 2023-11-28T20:02:36.304 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:36.296+0000 7f537e7fc640 1 --2- 172.21.15.78:0/3659318841 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f536c066470 0x7f536c068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:36.304 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:36.296+0000 7f537e7fc640 1 -- 172.21.15.78:0/3659318841 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6885+0+0 (secure 0 0 0) 0x7f537811e440 con 0x7f538814b1e0 2023-11-28T20:02:36.304 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:36.296+0000 7f538dcf3640 1 --2- 172.21.15.78:0/3659318841 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f536c066470 0x7f536c068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:02:36.304 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:36.296+0000 7f538dcf3640 1 --2- 172.21.15.78:0/3659318841 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f536c066470 0x7f536c068930 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f5384007fd0 tx=0x7f5384007ba0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:02:36.304 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:36.300+0000 7f537e7fc640 1 -- 172.21.15.78:0/3659318841 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f53780eb380 con 0x7f538814b1e0 2023-11-28T20:02:36.454 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:36.448+0000 7f538ff57640 1 -- 172.21.15.78:0/3659318841 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f53880bf9c0 con 0x7f538814b1e0 2023-11-28T20:02:36.455 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:36.452+0000 7f537e7fc640 1 -- 172.21.15.78:0/3659318841 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v85) v1 ==== 104+0+11 (secure 0 0 0) 0x7f53780ee9a0 con 0x7f538814b1e0 2023-11-28T20:02:36.455 INFO:teuthology.orchestra.run.smithi078.stdout:pg_num: 32 2023-11-28T20:02:36.457 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:36.452+0000 7f538ff57640 1 -- 172.21.15.78:0/3659318841 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f536c066470 msgr2=0x7f536c068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:02:36.457 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:36.452+0000 7f538ff57640 1 --2- 172.21.15.78:0/3659318841 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f536c066470 0x7f536c068930 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f5384007fd0 tx=0x7f5384007ba0 comp rx=0 tx=0).stop 2023-11-28T20:02:36.457 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:36.452+0000 7f538ff57640 1 -- 172.21.15.78:0/3659318841 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f538814b1e0 msgr2=0x7f53880bed60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:02:36.458 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:36.452+0000 7f538ff57640 1 --2- 172.21.15.78:0/3659318841 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f538814b1e0 0x7f53880bed60 secure :-1 s=READY pgs=1005 cs=0 l=1 rev1=1 crypto rx=0x7f5378019090 tx=0x7f5378019220 comp rx=0 tx=0).stop 2023-11-28T20:02:36.458 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:36.452+0000 7f538ff57640 1 -- 172.21.15.78:0/3659318841 shutdown_connections 2023-11-28T20:02:36.458 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:36.452+0000 7f538ff57640 1 --2- 172.21.15.78:0/3659318841 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f536c066470 0x7f536c068930 unknown :-1 s=CLOSED pgs=478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:36.458 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:36.452+0000 7f538ff57640 1 --2- 172.21.15.78:0/3659318841 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f53881548c0 0x7f538806b970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:36.458 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:36.452+0000 7f538ff57640 1 --2- 172.21.15.78:0/3659318841 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f538814b1e0 0x7f53880bed60 unknown :-1 s=CLOSED pgs=1005 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:36.458 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:36.452+0000 7f538ff57640 1 --2- 172.21.15.78:0/3659318841 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f53880c5300 0x7f5388141360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:36.458 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:36.452+0000 7f538ff57640 1 -- 172.21.15.78:0/3659318841 >> 172.21.15.78:0/3659318841 conn(0x7f53880c59f0 msgr2=0x7f5388154d30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:02:36.458 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:36.452+0000 7f538ff57640 1 -- 172.21.15.78:0/3659318841 shutdown_connections 2023-11-28T20:02:36.458 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:36.452+0000 7f538ff57640 1 -- 172.21.15.78:0/3659318841 wait complete. 2023-11-28T20:02:36.476 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-28T20:02:36.615 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:36.612+0000 7ff3c9232640 1 Processor -- start 2023-11-28T20:02:36.616 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:36.612+0000 7ff3c9232640 1 -- start start 2023-11-28T20:02:36.618 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:36.612+0000 7ff3c9232640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7ff3c414b1e0 0x7ff3c40c1700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:36.618 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:36.612+0000 7ff3c9232640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7ff3c40c5300 0x7ff3c40a9c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:36.618 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:36.612+0000 7ff3c9232640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff3c40a4e20 con 0x7ff3c4151280 2023-11-28T20:02:36.618 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:36.612+0000 7ff3c9232640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff3c41558d0 con 0x7ff3c40c5300 2023-11-28T20:02:36.618 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:36.612+0000 7ff3c9232640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff3c40a50e0 con 0x7ff3c414b1e0 2023-11-28T20:02:36.619 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:36.612+0000 7ff3c259c640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7ff3c40c5300 0x7ff3c40a9c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:02:36.619 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:36.612+0000 7ff3c259c640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7ff3c40c5300 0x7ff3c40a9c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:50750/0 (socket says 172.21.15.78:50750) 2023-11-28T20:02:36.619 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:36.612+0000 7ff3c259c640 1 -- 172.21.15.78:0/57957288 learned_addr learned my addr 172.21.15.78:0/57957288 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T20:02:36.619 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:36.612+0000 7ff3c2d9d640 1 --2- 172.21.15.78:0/57957288 >> v2:172.21.15.179:3300/0 conn(0x7ff3c414b1e0 0x7ff3c40c1700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:02:36.619 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:36.612+0000 7ff3c259c640 1 -- 172.21.15.78:0/57957288 >> v2:172.21.15.179:3300/0 conn(0x7ff3c414b1e0 msgr2=0x7ff3c40c1700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:02:36.619 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:36.612+0000 7ff3c259c640 1 --2- 172.21.15.78:0/57957288 >> v2:172.21.15.179:3300/0 conn(0x7ff3c414b1e0 0x7ff3c40c1700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:36.619 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:36.612+0000 7ff3c259c640 1 -- 172.21.15.78:0/57957288 >> v1:172.21.15.179:6789/0 conn(0x7ff3c4151280 legacy=0x7ff3c41516f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:02:36.619 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:36.612+0000 7ff3c259c640 1 -- 172.21.15.78:0/57957288 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3c40c0f00 con 0x7ff3c40c5300 2023-11-28T20:02:36.621 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:36.616+0000 7ff3c259c640 1 --2- 172.21.15.78:0/57957288 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff3c40c5300 0x7ff3c40a9c30 secure :-1 s=READY pgs=1006 cs=0 l=1 rev1=1 crypto rx=0x7ff3c40c4150 tx=0x7ff3b801c4c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=12acbd864aeaf130 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:02:36.621 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:36.616+0000 7ff3c1d9b640 1 -- 172.21.15.78:0/57957288 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3b80ab600 con 0x7ff3c40c5300 2023-11-28T20:02:36.621 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:36.616+0000 7ff3c1d9b640 1 -- 172.21.15.78:0/57957288 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff3b80a7050 con 0x7ff3c40c5300 2023-11-28T20:02:36.621 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:36.616+0000 7ff3c1d9b640 1 -- 172.21.15.78:0/57957288 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3b80ab980 con 0x7ff3c40c5300 2023-11-28T20:02:36.621 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:36.616+0000 7ff3c9232640 1 -- 172.21.15.78:0/57957288 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff3c40c5300 msgr2=0x7ff3c40a9c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:02:36.621 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:36.616+0000 7ff3c9232640 1 --2- 172.21.15.78:0/57957288 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff3c40c5300 0x7ff3c40a9c30 secure :-1 s=READY pgs=1006 cs=0 l=1 rev1=1 crypto rx=0x7ff3c40c4150 tx=0x7ff3b801c4c0 comp rx=0 tx=0).stop 2023-11-28T20:02:36.621 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:36.616+0000 7ff3c9232640 1 -- 172.21.15.78:0/57957288 shutdown_connections 2023-11-28T20:02:36.621 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:36.616+0000 7ff3c9232640 1 --2- 172.21.15.78:0/57957288 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff3c40c5300 0x7ff3c40a9c30 unknown :-1 s=CLOSED pgs=1006 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:36.621 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:36.616+0000 7ff3c9232640 1 --2- 172.21.15.78:0/57957288 >> v2:172.21.15.179:3300/0 conn(0x7ff3c414b1e0 0x7ff3c40c1700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:36.621 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:36.616+0000 7ff3c9232640 1 -- 172.21.15.78:0/57957288 >> 172.21.15.78:0/57957288 conn(0x7ff3c40c59f0 msgr2=0x7ff3c40c5e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:02:36.622 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:36.616+0000 7ff3c9232640 1 -- 172.21.15.78:0/57957288 shutdown_connections 2023-11-28T20:02:36.622 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:36.616+0000 7ff3c9232640 1 -- 172.21.15.78:0/57957288 wait complete. 2023-11-28T20:02:36.622 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:36.620+0000 7ff3c9232640 1 Processor -- start 2023-11-28T20:02:36.623 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:36.620+0000 7ff3c9232640 1 -- start start 2023-11-28T20:02:36.625 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:36.620+0000 7ff3c9232640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff3c40c5300 0x7ff3c40a5360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:36.625 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:36.620+0000 7ff3c9232640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff3c414b1e0 0x7ff3c40a6ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:36.625 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:36.620+0000 7ff3c9232640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff3c4151280 0x7ff3c41f03a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:36.625 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:36.620+0000 7ff3c9232640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3c41488e0 con 0x7ff3c414b1e0 2023-11-28T20:02:36.625 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:36.620+0000 7ff3c9232640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3c4148ea0 con 0x7ff3c4151280 2023-11-28T20:02:36.625 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:36.620+0000 7ff3c9232640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff3c40a5940 con 0x7ff3c40c5300 2023-11-28T20:02:36.625 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:36.620+0000 7ff3c259c640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff3c414b1e0 0x7ff3c40a6ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:02:36.625 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:36.620+0000 7ff3c259c640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff3c414b1e0 0x7ff3c40a6ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:50764/0 (socket says 172.21.15.78:50764) 2023-11-28T20:02:36.626 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:36.620+0000 7ff3c259c640 1 -- 172.21.15.78:0/3209980661 learned_addr learned my addr 172.21.15.78:0/3209980661 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T20:02:36.626 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:36.620+0000 7ff3c2d9d640 1 --2- 172.21.15.78:0/3209980661 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff3c40c5300 0x7ff3c40a5360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:02:36.626 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:36.620+0000 7ff3c359e640 1 --2- 172.21.15.78:0/3209980661 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff3c4151280 0x7ff3c41f03a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:02:36.626 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:36.620+0000 7ff3c259c640 1 -- 172.21.15.78:0/3209980661 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff3c40c5300 msgr2=0x7ff3c40a5360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:02:36.626 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:36.620+0000 7ff3c259c640 1 --2- 172.21.15.78:0/3209980661 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff3c40c5300 0x7ff3c40a5360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:36.626 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:36.620+0000 7ff3c259c640 1 -- 172.21.15.78:0/3209980661 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff3c4151280 msgr2=0x7ff3c41f03a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:02:36.626 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:36.620+0000 7ff3c259c640 1 --2- 172.21.15.78:0/3209980661 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff3c4151280 0x7ff3c41f03a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:36.626 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:36.620+0000 7ff3c259c640 1 -- 172.21.15.78:0/3209980661 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3b80094d0 con 0x7ff3c414b1e0 2023-11-28T20:02:36.626 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:36.620+0000 7ff3c2d9d640 1 --2- 172.21.15.78:0/3209980661 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff3c40c5300 0x7ff3c40a5360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T20:02:36.627 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:36.620+0000 7ff3c259c640 1 --2- 172.21.15.78:0/3209980661 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff3c414b1e0 0x7ff3c40a6ea0 secure :-1 s=READY pgs=1007 cs=0 l=1 rev1=1 crypto rx=0x7ff3b801ab70 tx=0x7ff3b8019260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:02:36.627 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:36.620+0000 7ff3ab7fe640 1 -- 172.21.15.78:0/3209980661 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3b80b4420 con 0x7ff3c414b1e0 2023-11-28T20:02:36.627 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:36.620+0000 7ff3ab7fe640 1 -- 172.21.15.78:0/3209980661 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff3b80b4580 con 0x7ff3c414b1e0 2023-11-28T20:02:36.627 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:36.620+0000 7ff3c9232640 1 -- 172.21.15.78:0/3209980661 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff3c40a5c20 con 0x7ff3c414b1e0 2023-11-28T20:02:36.627 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:36.620+0000 7ff3ab7fe640 1 -- 172.21.15.78:0/3209980661 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3b80b4910 con 0x7ff3c414b1e0 2023-11-28T20:02:36.627 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:36.620+0000 7ff3c9232640 1 -- 172.21.15.78:0/3209980661 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff3c406ced0 con 0x7ff3c414b1e0 2023-11-28T20:02:36.628 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:36.620+0000 7ff3c9232640 1 -- 172.21.15.78:0/3209980661 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff3c4067630 con 0x7ff3c414b1e0 2023-11-28T20:02:36.628 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:36.624+0000 7ff3ab7fe640 1 -- 172.21.15.78:0/3209980661 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7ff3b80b2070 con 0x7ff3c414b1e0 2023-11-28T20:02:36.628 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:36.624+0000 7ff3ab7fe640 1 --2- 172.21.15.78:0/3209980661 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7ff3b00664a0 0x7ff3b0068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:36.628 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:36.624+0000 7ff3ab7fe640 1 -- 172.21.15.78:0/3209980661 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6885+0+0 (secure 0 0 0) 0x7ff3b811dfa0 con 0x7ff3c414b1e0 2023-11-28T20:02:36.628 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:36.624+0000 7ff3c2d9d640 1 --2- 172.21.15.78:0/3209980661 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7ff3b00664a0 0x7ff3b0068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:02:36.629 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:36.624+0000 7ff3c2d9d640 1 --2- 172.21.15.78:0/3209980661 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7ff3b00664a0 0x7ff3b0068960 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7ff3c40c1670 tx=0x7ff3b4008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:02:36.632 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:36.628+0000 7ff3ab7fe640 1 -- 172.21.15.78:0/3209980661 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7ff3b80eaf70 con 0x7ff3c414b1e0 2023-11-28T20:02:36.781 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:36.776+0000 7ff3c9232640 1 -- 172.21.15.78:0/3209980661 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7ff3c4148fe0 con 0x7ff3c414b1e0 2023-11-28T20:02:36.781 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:36.776+0000 7ff3ab7fe640 1 -- 172.21.15.78:0/3209980661 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v85) v1 ==== 100+0+11 (secure 0 0 0) 0x7ff3b80b0020 con 0x7ff3c414b1e0 2023-11-28T20:02:36.782 INFO:teuthology.orchestra.run.smithi078.stdout:pg_num: 64 2023-11-28T20:02:36.783 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:36.780+0000 7ff3c9232640 1 -- 172.21.15.78:0/3209980661 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7ff3b00664a0 msgr2=0x7ff3b0068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:02:36.783 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:36.780+0000 7ff3c9232640 1 --2- 172.21.15.78:0/3209980661 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7ff3b00664a0 0x7ff3b0068960 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7ff3c40c1670 tx=0x7ff3b4008040 comp rx=0 tx=0).stop 2023-11-28T20:02:36.783 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:36.780+0000 7ff3c9232640 1 -- 172.21.15.78:0/3209980661 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff3c414b1e0 msgr2=0x7ff3c40a6ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:02:36.784 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:36.780+0000 7ff3c9232640 1 --2- 172.21.15.78:0/3209980661 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff3c414b1e0 0x7ff3c40a6ea0 secure :-1 s=READY pgs=1007 cs=0 l=1 rev1=1 crypto rx=0x7ff3b801ab70 tx=0x7ff3b8019260 comp rx=0 tx=0).stop 2023-11-28T20:02:36.784 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:36.780+0000 7ff3c9232640 1 -- 172.21.15.78:0/3209980661 shutdown_connections 2023-11-28T20:02:36.784 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:36.780+0000 7ff3c9232640 1 --2- 172.21.15.78:0/3209980661 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7ff3b00664a0 0x7ff3b0068960 unknown :-1 s=CLOSED pgs=479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:36.784 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:36.780+0000 7ff3c9232640 1 --2- 172.21.15.78:0/3209980661 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff3c4151280 0x7ff3c41f03a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:36.784 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:36.780+0000 7ff3c9232640 1 --2- 172.21.15.78:0/3209980661 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff3c414b1e0 0x7ff3c40a6ea0 unknown :-1 s=CLOSED pgs=1007 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:36.784 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:36.780+0000 7ff3c9232640 1 --2- 172.21.15.78:0/3209980661 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff3c40c5300 0x7ff3c40a5360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:36.784 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:36.780+0000 7ff3c9232640 1 -- 172.21.15.78:0/3209980661 >> 172.21.15.78:0/3209980661 conn(0x7ff3c40c59f0 msgr2=0x7ff3c4145090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:02:36.784 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:36.780+0000 7ff3c9232640 1 -- 172.21.15.78:0/3209980661 shutdown_connections 2023-11-28T20:02:36.784 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:36.780+0000 7ff3c9232640 1 -- 172.21.15.78:0/3209980661 wait complete. 2023-11-28T20:02:36.802 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs2_metadata pg_num 2023-11-28T20:02:36.942 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:36.936+0000 7f33aeb55640 1 Processor -- start 2023-11-28T20:02:36.943 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:36.936+0000 7f33aeb55640 1 -- start start 2023-11-28T20:02:36.944 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:36.940+0000 7f33aeb55640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f33a814f850 0x7f33a80aacf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:36.944 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:36.940+0000 7f33aeb55640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f33a806d840 0x7f33a80c43e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:36.944 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:36.940+0000 7f33aeb55640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f33a8152910 con 0x7f33a814fc30 2023-11-28T20:02:36.944 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:36.940+0000 7f33aeb55640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f33a80c2240 con 0x7f33a806d840 2023-11-28T20:02:36.945 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:36.940+0000 7f33aeb55640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33a8152bf0 con 0x7f33a814f850 2023-11-28T20:02:36.945 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:36.940+0000 7f339ffff640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f33a814fc30 0x7f33a80c3cd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:49968/0 (socket says 172.21.15.78:49968) 2023-11-28T20:02:36.945 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:36.940+0000 7f339ffff640 1 -- 172.21.15.78:0/2704516779 learned_addr learned my addr 172.21.15.78:0/2704516779 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-11-28T20:02:36.945 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:36.940+0000 7f33ad0f2640 1 --2- 172.21.15.78:0/2704516779 >> v2:172.21.15.179:3300/0 conn(0x7f33a806d840 0x7f33a80c43e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:02:36.945 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:36.940+0000 7f33ac8f1640 1 --2- 172.21.15.78:0/2704516779 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f33a814f850 0x7f33a80aacf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:02:36.946 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:36.940+0000 7f339f7fe640 1 -- 172.21.15.78:0/2704516779 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3691781884 0 0) 0x7f33a8152910 con 0x7f33a814fc30 2023-11-28T20:02:36.947 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:36.940+0000 7f339f7fe640 1 -- 172.21.15.78:0/2704516779 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3390003530 con 0x7f33a814fc30 2023-11-28T20:02:36.947 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:36.940+0000 7f33ac8f1640 1 -- 172.21.15.78:0/2704516779 >> v2:172.21.15.179:3300/0 conn(0x7f33a806d840 msgr2=0x7f33a80c43e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:02:36.947 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:36.940+0000 7f33ac8f1640 1 --2- 172.21.15.78:0/2704516779 >> v2:172.21.15.179:3300/0 conn(0x7f33a806d840 0x7f33a80c43e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:36.948 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:36.940+0000 7f33ac8f1640 1 -- 172.21.15.78:0/2704516779 >> v1:172.21.15.78:6789/0 conn(0x7f33a814fc30 legacy=0x7f33a80c3cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:02:36.948 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:36.940+0000 7f33ac8f1640 1 -- 172.21.15.78:0/2704516779 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33a8152ed0 con 0x7f33a814f850 2023-11-28T20:02:36.948 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:36.940+0000 7f33ad0f2640 1 --2- 172.21.15.78:0/2704516779 >> v2:172.21.15.179:3300/0 conn(0x7f33a806d840 0x7f33a80c43e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T20:02:36.949 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:36.944+0000 7f33ac8f1640 1 --2- 172.21.15.78:0/2704516779 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f33a814f850 0x7f33a80aacf0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f33a40097c0 tx=0x7f33a401c480 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c2e4db24f24e5e73 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:02:36.949 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:36.944+0000 7f339f7fe640 1 -- 172.21.15.78:0/2704516779 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33a40a6040 con 0x7f33a814f850 2023-11-28T20:02:36.950 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:36.944+0000 7f339f7fe640 1 -- 172.21.15.78:0/2704516779 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f33a40aa600 con 0x7f33a814f850 2023-11-28T20:02:36.950 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:36.944+0000 7f339f7fe640 1 -- 172.21.15.78:0/2704516779 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33a40aa990 con 0x7f33a814f850 2023-11-28T20:02:36.950 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:36.944+0000 7f33aeb55640 1 -- 172.21.15.78:0/2704516779 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f33a814f850 msgr2=0x7f33a80aacf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:02:36.950 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:36.944+0000 7f33aeb55640 1 --2- 172.21.15.78:0/2704516779 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f33a814f850 0x7f33a80aacf0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f33a40097c0 tx=0x7f33a401c480 comp rx=0 tx=0).stop 2023-11-28T20:02:36.950 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:36.944+0000 7f33aeb55640 1 -- 172.21.15.78:0/2704516779 shutdown_connections 2023-11-28T20:02:36.951 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:36.944+0000 7f33aeb55640 1 --2- 172.21.15.78:0/2704516779 >> v2:172.21.15.179:3300/0 conn(0x7f33a806d840 0x7f33a80c43e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:36.951 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:36.944+0000 7f33aeb55640 1 --2- 172.21.15.78:0/2704516779 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f33a814f850 0x7f33a80aacf0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:36.951 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:36.944+0000 7f33aeb55640 1 -- 172.21.15.78:0/2704516779 >> 172.21.15.78:0/2704516779 conn(0x7f33a80c59f0 msgr2=0x7f33a80c5e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:02:36.951 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:36.944+0000 7f33aeb55640 1 -- 172.21.15.78:0/2704516779 shutdown_connections 2023-11-28T20:02:36.951 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:36.944+0000 7f33aeb55640 1 -- 172.21.15.78:0/2704516779 wait complete. 2023-11-28T20:02:36.954 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:36.944+0000 7f33aeb55640 1 Processor -- start 2023-11-28T20:02:36.954 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:36.944+0000 7f33aeb55640 1 -- start start 2023-11-28T20:02:36.954 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:36.948+0000 7f33aeb55640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f33a806d840 0x7f33a81f1220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:36.954 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:36.948+0000 7f33aeb55640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f33a814f850 0x7f33a80a68a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:36.954 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:36.948+0000 7f33aeb55640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f33a814fc30 0x7f33a806fef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:36.955 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:36.948+0000 7f33aeb55640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33a81568f0 con 0x7f33a806d840 2023-11-28T20:02:36.955 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:36.948+0000 7f33aeb55640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33a80a70c0 con 0x7f33a814fc30 2023-11-28T20:02:36.955 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:36.948+0000 7f33aeb55640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33a80a93b0 con 0x7f33a814f850 2023-11-28T20:02:36.955 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:36.948+0000 7f33ac8f1640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f33a806d840 0x7f33a81f1220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:02:36.955 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:36.948+0000 7f33ac8f1640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f33a806d840 0x7f33a81f1220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:50780/0 (socket says 172.21.15.78:50780) 2023-11-28T20:02:36.955 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:36.948+0000 7f33ac8f1640 1 -- 172.21.15.78:0/4104598256 learned_addr learned my addr 172.21.15.78:0/4104598256 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T20:02:36.955 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:36.948+0000 7f33ad0f2640 1 --2- 172.21.15.78:0/4104598256 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f33a814fc30 0x7f33a806fef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:02:36.955 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:36.948+0000 7f339ffff640 1 --2- 172.21.15.78:0/4104598256 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f33a814f850 0x7f33a80a68a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:02:36.955 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:36.948+0000 7f33ac8f1640 1 -- 172.21.15.78:0/4104598256 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f33a814f850 msgr2=0x7f33a80a68a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:02:36.955 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:36.948+0000 7f33ac8f1640 1 --2- 172.21.15.78:0/4104598256 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f33a814f850 0x7f33a80a68a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:36.955 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:36.948+0000 7f33ac8f1640 1 -- 172.21.15.78:0/4104598256 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f33a814fc30 msgr2=0x7f33a806fef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:02:36.956 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:36.948+0000 7f33ac8f1640 1 --2- 172.21.15.78:0/4104598256 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f33a814fc30 0x7f33a806fef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:36.956 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:36.948+0000 7f33ac8f1640 1 -- 172.21.15.78:0/4104598256 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33a0009a70 con 0x7f33a806d840 2023-11-28T20:02:36.956 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:36.948+0000 7f33ad0f2640 1 --2- 172.21.15.78:0/4104598256 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f33a814fc30 0x7f33a806fef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T20:02:36.956 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:36.948+0000 7f33ac8f1640 1 --2- 172.21.15.78:0/4104598256 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f33a806d840 0x7f33a81f1220 secure :-1 s=READY pgs=1009 cs=0 l=1 rev1=1 crypto rx=0x7f33a401ab30 tx=0x7f33a401acc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:02:36.956 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:36.948+0000 7f339d7fa640 1 -- 172.21.15.78:0/4104598256 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33a4006e20 con 0x7f33a806d840 2023-11-28T20:02:36.956 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:36.948+0000 7f339d7fa640 1 -- 172.21.15.78:0/4104598256 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f33a40b3600 con 0x7f33a806d840 2023-11-28T20:02:36.956 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:36.948+0000 7f33aeb55640 1 -- 172.21.15.78:0/4104598256 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f33a4009420 con 0x7f33a806d840 2023-11-28T20:02:36.956 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:36.948+0000 7f339d7fa640 1 -- 172.21.15.78:0/4104598256 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33a40b39d0 con 0x7f33a806d840 2023-11-28T20:02:36.956 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:36.948+0000 7f33aeb55640 1 -- 172.21.15.78:0/4104598256 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f33a8156580 con 0x7f33a806d840 2023-11-28T20:02:36.956 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:36.948+0000 7f33aeb55640 1 -- 172.21.15.78:0/4104598256 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f33a80a98d0 con 0x7f33a806d840 2023-11-28T20:02:36.957 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:36.948+0000 7f339d7fa640 1 -- 172.21.15.78:0/4104598256 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f33a40b3b30 con 0x7f33a806d840 2023-11-28T20:02:36.957 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:36.952+0000 7f339d7fa640 1 --2- 172.21.15.78:0/4104598256 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f3394066470 0x7f3394068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:36.957 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:36.952+0000 7f339d7fa640 1 -- 172.21.15.78:0/4104598256 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6885+0+0 (secure 0 0 0) 0x7f33a411edd0 con 0x7f33a806d840 2023-11-28T20:02:36.957 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:36.952+0000 7f339ffff640 1 --2- 172.21.15.78:0/4104598256 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f3394066470 0x7f3394068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:02:36.958 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:36.952+0000 7f339ffff640 1 --2- 172.21.15.78:0/4104598256 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f3394066470 0x7f3394068930 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f33a80c6870 tx=0x7f3398009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:02:36.961 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:36.956+0000 7f339d7fa640 1 -- 172.21.15.78:0/4104598256 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f33a4123070 con 0x7f33a806d840 2023-11-28T20:02:37.108 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:37.104+0000 7f33aeb55640 1 -- 172.21.15.78:0/4104598256 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs2_metadata", "var": "pg_num"} v 0) v1 -- 0x7f33a8067630 con 0x7f33a806d840 2023-11-28T20:02:37.108 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:37.104+0000 7f339d7fa640 1 -- 172.21.15.78:0/4104598256 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs2_metadata", "var": "pg_num"}]=0 v85) v1 ==== 105+0+11 (secure 0 0 0) 0x7f33a40ebda0 con 0x7f33a806d840 2023-11-28T20:02:37.108 INFO:teuthology.orchestra.run.smithi078.stdout:pg_num: 32 2023-11-28T20:02:37.110 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:37.104+0000 7f33aeb55640 1 -- 172.21.15.78:0/4104598256 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f3394066470 msgr2=0x7f3394068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:02:37.110 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:37.104+0000 7f33aeb55640 1 --2- 172.21.15.78:0/4104598256 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f3394066470 0x7f3394068930 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f33a80c6870 tx=0x7f3398009040 comp rx=0 tx=0).stop 2023-11-28T20:02:37.110 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:37.104+0000 7f33aeb55640 1 -- 172.21.15.78:0/4104598256 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f33a806d840 msgr2=0x7f33a81f1220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:02:37.110 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:37.104+0000 7f33aeb55640 1 --2- 172.21.15.78:0/4104598256 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f33a806d840 0x7f33a81f1220 secure :-1 s=READY pgs=1009 cs=0 l=1 rev1=1 crypto rx=0x7f33a401ab30 tx=0x7f33a401acc0 comp rx=0 tx=0).stop 2023-11-28T20:02:37.111 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:37.104+0000 7f33aeb55640 1 -- 172.21.15.78:0/4104598256 shutdown_connections 2023-11-28T20:02:37.111 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:37.104+0000 7f33aeb55640 1 --2- 172.21.15.78:0/4104598256 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f3394066470 0x7f3394068930 unknown :-1 s=CLOSED pgs=480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:37.111 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:37.104+0000 7f33aeb55640 1 --2- 172.21.15.78:0/4104598256 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f33a814f850 0x7f33a80a68a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:37.111 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:37.104+0000 7f33aeb55640 1 --2- 172.21.15.78:0/4104598256 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f33a814fc30 0x7f33a806fef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:37.111 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:37.104+0000 7f33aeb55640 1 --2- 172.21.15.78:0/4104598256 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f33a806d840 0x7f33a81f1220 unknown :-1 s=CLOSED pgs=1009 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:37.111 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:37.104+0000 7f33aeb55640 1 -- 172.21.15.78:0/4104598256 >> 172.21.15.78:0/4104598256 conn(0x7f33a80c59f0 msgr2=0x7f33a814f110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:02:37.111 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:37.104+0000 7f33aeb55640 1 -- 172.21.15.78:0/4104598256 shutdown_connections 2023-11-28T20:02:37.111 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:37.104+0000 7f33aeb55640 1 -- 172.21.15.78:0/4104598256 wait complete. 2023-11-28T20:02:37.129 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs2_data pg_num 2023-11-28T20:02:37.269 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:37.264+0000 7f9edb10f640 1 Processor -- start 2023-11-28T20:02:37.270 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:37.264+0000 7f9edb10f640 1 -- start start 2023-11-28T20:02:37.271 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:37.264+0000 7f9edb10f640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f9ed414f850 0x7f9ed40aacf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:37.271 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:37.264+0000 7f9edb10f640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9ed414fc30 0x7f9ed40c3cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:37.271 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:37.264+0000 7f9edb10f640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9ed4152910 con 0x7f9ed406d840 2023-11-28T20:02:37.271 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:37.264+0000 7f9edb10f640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9ed40c2240 con 0x7f9ed414f850 2023-11-28T20:02:37.271 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:37.264+0000 7f9edb10f640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ed4152bf0 con 0x7f9ed414fc30 2023-11-28T20:02:37.271 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:37.264+0000 7f9ed96ac640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f9ed406d840 0x7f9ed40c4210 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:49976/0 (socket says 172.21.15.78:49976) 2023-11-28T20:02:37.271 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:37.264+0000 7f9ed96ac640 1 -- 172.21.15.78:0/2850997713 learned_addr learned my addr 172.21.15.78:0/2850997713 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-11-28T20:02:37.272 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:37.264+0000 7f9ecbfff640 1 --2- 172.21.15.78:0/2850997713 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9ed414fc30 0x7f9ed40c3cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:02:37.272 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:37.264+0000 7f9ed8eab640 1 --2- 172.21.15.78:0/2850997713 >> v2:172.21.15.179:3300/0 conn(0x7f9ed414f850 0x7f9ed40aacf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:02:37.272 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:37.268+0000 7f9ecb7fe640 1 -- 172.21.15.78:0/2850997713 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4125871543 0 0) 0x7f9ed4152910 con 0x7f9ed406d840 2023-11-28T20:02:37.272 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:37.268+0000 7f9ecb7fe640 1 -- 172.21.15.78:0/2850997713 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9ebc003530 con 0x7f9ed406d840 2023-11-28T20:02:37.272 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:37.268+0000 7f9ecbfff640 1 -- 172.21.15.78:0/2850997713 >> v2:172.21.15.179:3300/0 conn(0x7f9ed414f850 msgr2=0x7f9ed40aacf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:02:37.272 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:37.268+0000 7f9ecbfff640 1 --2- 172.21.15.78:0/2850997713 >> v2:172.21.15.179:3300/0 conn(0x7f9ed414f850 0x7f9ed40aacf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:37.272 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:37.268+0000 7f9ecbfff640 1 -- 172.21.15.78:0/2850997713 >> v1:172.21.15.78:6789/0 conn(0x7f9ed406d840 legacy=0x7f9ed40c4210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:02:37.272 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:37.268+0000 7f9ecbfff640 1 -- 172.21.15.78:0/2850997713 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ed4152ed0 con 0x7f9ed414fc30 2023-11-28T20:02:37.274 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:37.268+0000 7f9ecbfff640 1 --2- 172.21.15.78:0/2850997713 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9ed414fc30 0x7f9ed40c3cd0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f9ec40097c0 tx=0x7f9ec401c480 comp rx=0 tx=0).ready entity=mon.2 client_cookie=20fb9188c4319016 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:02:37.274 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:37.268+0000 7f9ecb7fe640 1 -- 172.21.15.78:0/2850997713 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ec40a6040 con 0x7f9ed414fc30 2023-11-28T20:02:37.274 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:37.268+0000 7f9ecb7fe640 1 -- 172.21.15.78:0/2850997713 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ec40aa600 con 0x7f9ed414fc30 2023-11-28T20:02:37.274 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:37.268+0000 7f9ecb7fe640 1 -- 172.21.15.78:0/2850997713 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ec40aa990 con 0x7f9ed414fc30 2023-11-28T20:02:37.275 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:37.272+0000 7f9edb10f640 1 -- 172.21.15.78:0/2850997713 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9ed414fc30 msgr2=0x7f9ed40c3cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:02:37.275 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:37.272+0000 7f9edb10f640 1 --2- 172.21.15.78:0/2850997713 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9ed414fc30 0x7f9ed40c3cd0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f9ec40097c0 tx=0x7f9ec401c480 comp rx=0 tx=0).stop 2023-11-28T20:02:37.275 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:37.272+0000 7f9edb10f640 1 -- 172.21.15.78:0/2850997713 shutdown_connections 2023-11-28T20:02:37.276 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:37.272+0000 7f9edb10f640 1 --2- 172.21.15.78:0/2850997713 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9ed414fc30 0x7f9ed40c3cd0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:37.276 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:37.272+0000 7f9edb10f640 1 --2- 172.21.15.78:0/2850997713 >> v2:172.21.15.179:3300/0 conn(0x7f9ed414f850 0x7f9ed40aacf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:37.276 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:37.272+0000 7f9edb10f640 1 -- 172.21.15.78:0/2850997713 >> 172.21.15.78:0/2850997713 conn(0x7f9ed40c59f0 msgr2=0x7f9ed40c5e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:02:37.276 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:37.272+0000 7f9edb10f640 1 -- 172.21.15.78:0/2850997713 shutdown_connections 2023-11-28T20:02:37.276 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:37.272+0000 7f9edb10f640 1 -- 172.21.15.78:0/2850997713 wait complete. 2023-11-28T20:02:37.276 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:37.272+0000 7f9edb10f640 1 Processor -- start 2023-11-28T20:02:37.276 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:37.272+0000 7f9edb10f640 1 -- start start 2023-11-28T20:02:37.279 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:37.272+0000 7f9edb10f640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9ed406d840 0x7f9ed41ed770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:37.279 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:37.272+0000 7f9edb10f640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9ed414f850 0x7f9ed41f14c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:37.279 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:37.272+0000 7f9edb10f640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9ed414fc30 0x7f9ed4071120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:37.279 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:37.272+0000 7f9edb10f640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ed4149330 con 0x7f9ed414f850 2023-11-28T20:02:37.279 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:37.272+0000 7f9edb10f640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ed414eed0 con 0x7f9ed414fc30 2023-11-28T20:02:37.280 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:37.272+0000 7f9edb10f640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ed41f0ce0 con 0x7f9ed406d840 2023-11-28T20:02:37.280 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:37.272+0000 7f9ecbfff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9ed414f850 0x7f9ed41f14c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:02:37.280 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:37.272+0000 7f9ecbfff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9ed414f850 0x7f9ed41f14c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:50788/0 (socket says 172.21.15.78:50788) 2023-11-28T20:02:37.280 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:37.272+0000 7f9ecbfff640 1 -- 172.21.15.78:0/423074320 learned_addr learned my addr 172.21.15.78:0/423074320 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T20:02:37.280 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:37.272+0000 7f9ed8eab640 1 --2- 172.21.15.78:0/423074320 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9ed406d840 0x7f9ed41ed770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:02:37.280 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:37.272+0000 7f9ed96ac640 1 --2- 172.21.15.78:0/423074320 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9ed414fc30 0x7f9ed4071120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:02:37.280 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:37.272+0000 7f9ecbfff640 1 -- 172.21.15.78:0/423074320 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9ed406d840 msgr2=0x7f9ed41ed770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:02:37.280 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:37.272+0000 7f9ecbfff640 1 --2- 172.21.15.78:0/423074320 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9ed406d840 0x7f9ed41ed770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:37.280 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:37.272+0000 7f9ecbfff640 1 -- 172.21.15.78:0/423074320 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9ed414fc30 msgr2=0x7f9ed4071120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:02:37.280 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:37.272+0000 7f9ecbfff640 1 --2- 172.21.15.78:0/423074320 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9ed414fc30 0x7f9ed4071120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:37.281 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:37.272+0000 7f9ecbfff640 1 -- 172.21.15.78:0/423074320 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ec4009420 con 0x7f9ed414f850 2023-11-28T20:02:37.281 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:37.272+0000 7f9ed8eab640 1 --2- 172.21.15.78:0/423074320 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9ed406d840 0x7f9ed41ed770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T20:02:37.281 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:37.276+0000 7f9ecbfff640 1 --2- 172.21.15.78:0/423074320 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9ed414f850 0x7f9ed41f14c0 secure :-1 s=READY pgs=1011 cs=0 l=1 rev1=1 crypto rx=0x7f9ec401a0b0 tx=0x7f9ec401acc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:02:37.281 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:37.276+0000 7f9ec97fa640 1 -- 172.21.15.78:0/423074320 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ec4006e20 con 0x7f9ed414f850 2023-11-28T20:02:37.281 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:37.276+0000 7f9ec97fa640 1 -- 172.21.15.78:0/423074320 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ec40b3600 con 0x7f9ed414f850 2023-11-28T20:02:37.281 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:37.276+0000 7f9ec97fa640 1 -- 172.21.15.78:0/423074320 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ec40b3990 con 0x7f9ed414f850 2023-11-28T20:02:37.281 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:37.276+0000 7f9edb10f640 1 -- 172.21.15.78:0/423074320 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9ed40725f0 con 0x7f9ed414f850 2023-11-28T20:02:37.282 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:37.276+0000 7f9edb10f640 1 -- 172.21.15.78:0/423074320 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9ed41f0fa0 con 0x7f9ed414f850 2023-11-28T20:02:37.282 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:37.276+0000 7f9edb10f640 1 -- 172.21.15.78:0/423074320 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9ed40c4560 con 0x7f9ed414f850 2023-11-28T20:02:37.282 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:37.276+0000 7f9ec97fa640 1 -- 172.21.15.78:0/423074320 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f9ec40b3af0 con 0x7f9ed414f850 2023-11-28T20:02:37.283 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:37.276+0000 7f9ec97fa640 1 --2- 172.21.15.78:0/423074320 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f9ec00664a0 0x7f9ec0068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:37.283 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:37.276+0000 7f9ec97fa640 1 -- 172.21.15.78:0/423074320 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6885+0+0 (secure 0 0 0) 0x7f9ec411e320 con 0x7f9ed414f850 2023-11-28T20:02:37.283 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:37.276+0000 7f9ed8eab640 1 --2- 172.21.15.78:0/423074320 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f9ec00664a0 0x7f9ec0068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:02:37.283 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:37.280+0000 7f9ed8eab640 1 --2- 172.21.15.78:0/423074320 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f9ec00664a0 0x7f9ec0068960 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f9ed0009bb0 tx=0x7f9ed0008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:02:37.286 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:37.280+0000 7f9ec97fa640 1 -- 172.21.15.78:0/423074320 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f9ec40eb2f0 con 0x7f9ed414f850 2023-11-28T20:02:37.437 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:37.432+0000 7f9edb10f640 1 -- 172.21.15.78:0/423074320 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs2_data", "var": "pg_num"} v 0) v1 -- 0x7f9ed40c6990 con 0x7f9ed414f850 2023-11-28T20:02:37.437 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:37.432+0000 7f9ec97fa640 1 -- 172.21.15.78:0/423074320 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs2_data", "var": "pg_num"}]=0 v85) v1 ==== 101+0+11 (secure 0 0 0) 0x7f9ec40ee910 con 0x7f9ed414f850 2023-11-28T20:02:37.437 INFO:teuthology.orchestra.run.smithi078.stdout:pg_num: 64 2023-11-28T20:02:37.439 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:37.436+0000 7f9edb10f640 1 -- 172.21.15.78:0/423074320 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f9ec00664a0 msgr2=0x7f9ec0068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:02:37.439 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:37.436+0000 7f9edb10f640 1 --2- 172.21.15.78:0/423074320 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f9ec00664a0 0x7f9ec0068960 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f9ed0009bb0 tx=0x7f9ed0008040 comp rx=0 tx=0).stop 2023-11-28T20:02:37.439 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:37.436+0000 7f9edb10f640 1 -- 172.21.15.78:0/423074320 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9ed414f850 msgr2=0x7f9ed41f14c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:02:37.439 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:37.436+0000 7f9edb10f640 1 --2- 172.21.15.78:0/423074320 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9ed414f850 0x7f9ed41f14c0 secure :-1 s=READY pgs=1011 cs=0 l=1 rev1=1 crypto rx=0x7f9ec401a0b0 tx=0x7f9ec401acc0 comp rx=0 tx=0).stop 2023-11-28T20:02:37.440 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:37.436+0000 7f9edb10f640 1 -- 172.21.15.78:0/423074320 shutdown_connections 2023-11-28T20:02:37.440 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:37.436+0000 7f9edb10f640 1 --2- 172.21.15.78:0/423074320 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f9ec00664a0 0x7f9ec0068960 unknown :-1 s=CLOSED pgs=481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:37.440 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:37.436+0000 7f9edb10f640 1 --2- 172.21.15.78:0/423074320 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9ed414fc30 0x7f9ed4071120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:37.440 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:37.436+0000 7f9edb10f640 1 --2- 172.21.15.78:0/423074320 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9ed414f850 0x7f9ed41f14c0 unknown :-1 s=CLOSED pgs=1011 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:37.440 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:37.436+0000 7f9edb10f640 1 --2- 172.21.15.78:0/423074320 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9ed406d840 0x7f9ed41ed770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:37.440 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:37.436+0000 7f9edb10f640 1 -- 172.21.15.78:0/423074320 >> 172.21.15.78:0/423074320 conn(0x7f9ed40c59f0 msgr2=0x7f9ed40c0c70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:02:37.440 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:37.436+0000 7f9edb10f640 1 -- 172.21.15.78:0/423074320 shutdown_connections 2023-11-28T20:02:37.440 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:37.436+0000 7f9edb10f640 1 -- 172.21.15.78:0/423074320 wait complete. 2023-11-28T20:02:37.459 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-11-28T20:02:37.599 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:37.596+0000 7fbfc1bf5640 1 Processor -- start 2023-11-28T20:02:37.599 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:37.596+0000 7fbfc1bf5640 1 -- start start 2023-11-28T20:02:37.601 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:37.596+0000 7fbfc1bf5640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fbfbc154390 0x7fbfbc0c4a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:37.601 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:37.596+0000 7fbfc1bf5640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fbfbc0c2110 0x7fbfbc0c5ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:37.601 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:37.596+0000 7fbfc1bf5640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbfbc0a93d0 con 0x7fbfbc0c4f80 2023-11-28T20:02:37.601 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:37.596+0000 7fbfc1bf5640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbfbc0aa1c0 con 0x7fbfbc0c2110 2023-11-28T20:02:37.601 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:37.596+0000 7fbfc1bf5640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbfbc154770 con 0x7fbfbc154390 2023-11-28T20:02:37.602 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:37.596+0000 7fbfbaffd640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fbfbc0c2110 0x7fbfbc0c5ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:02:37.602 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:37.596+0000 7fbfbaffd640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fbfbc0c2110 0x7fbfbc0c5ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:50792/0 (socket says 172.21.15.78:50792) 2023-11-28T20:02:37.602 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:37.596+0000 7fbfbaffd640 1 -- 172.21.15.78:0/1063170786 learned_addr learned my addr 172.21.15.78:0/1063170786 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T20:02:37.602 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:37.596+0000 7fbfbb7fe640 1 --2- 172.21.15.78:0/1063170786 >> v2:172.21.15.179:3300/0 conn(0x7fbfbc154390 0x7fbfbc0c4a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:02:37.602 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:37.596+0000 7fbfbaffd640 1 -- 172.21.15.78:0/1063170786 >> v2:172.21.15.179:3300/0 conn(0x7fbfbc154390 msgr2=0x7fbfbc0c4a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:02:37.602 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:37.596+0000 7fbfbaffd640 1 --2- 172.21.15.78:0/1063170786 >> v2:172.21.15.179:3300/0 conn(0x7fbfbc154390 0x7fbfbc0c4a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:37.603 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:37.596+0000 7fbfbaffd640 1 -- 172.21.15.78:0/1063170786 >> v1:172.21.15.78:6789/0 conn(0x7fbfbc0c4f80 legacy=0x7fbfbc0c61e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:02:37.603 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:37.596+0000 7fbfbaffd640 1 -- 172.21.15.78:0/1063170786 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbfbc0a9640 con 0x7fbfbc0c2110 2023-11-28T20:02:37.604 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:37.600+0000 7fbfbaffd640 1 --2- 172.21.15.78:0/1063170786 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbfbc0c2110 0x7fbfbc0c5ca0 secure :-1 s=READY pgs=1013 cs=0 l=1 rev1=1 crypto rx=0x7fbfbc0a83b0 tx=0x7fbfb001c500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bc057130a2819938 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:02:37.604 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:37.600+0000 7fbfba7fc640 1 -- 172.21.15.78:0/1063170786 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfb00ab610 con 0x7fbfbc0c2110 2023-11-28T20:02:37.604 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:37.600+0000 7fbfba7fc640 1 -- 172.21.15.78:0/1063170786 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbfb00ab770 con 0x7fbfbc0c2110 2023-11-28T20:02:37.604 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:37.600+0000 7fbfba7fc640 1 -- 172.21.15.78:0/1063170786 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfb00abb00 con 0x7fbfbc0c2110 2023-11-28T20:02:37.605 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:37.600+0000 7fbfc1bf5640 1 -- 172.21.15.78:0/1063170786 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbfbc0c2110 msgr2=0x7fbfbc0c5ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:02:37.605 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:37.600+0000 7fbfc1bf5640 1 --2- 172.21.15.78:0/1063170786 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbfbc0c2110 0x7fbfbc0c5ca0 secure :-1 s=READY pgs=1013 cs=0 l=1 rev1=1 crypto rx=0x7fbfbc0a83b0 tx=0x7fbfb001c500 comp rx=0 tx=0).stop 2023-11-28T20:02:37.605 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:37.600+0000 7fbfc1bf5640 1 -- 172.21.15.78:0/1063170786 shutdown_connections 2023-11-28T20:02:37.606 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:37.600+0000 7fbfc1bf5640 1 --2- 172.21.15.78:0/1063170786 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbfbc0c2110 0x7fbfbc0c5ca0 unknown :-1 s=CLOSED pgs=1013 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:37.606 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:37.600+0000 7fbfc1bf5640 1 --2- 172.21.15.78:0/1063170786 >> v2:172.21.15.179:3300/0 conn(0x7fbfbc154390 0x7fbfbc0c4a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:37.606 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:37.600+0000 7fbfc1bf5640 1 -- 172.21.15.78:0/1063170786 >> 172.21.15.78:0/1063170786 conn(0x7fbfbc06b220 msgr2=0x7fbfbc0a77e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:02:37.606 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:37.600+0000 7fbfc1bf5640 1 -- 172.21.15.78:0/1063170786 shutdown_connections 2023-11-28T20:02:37.606 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:37.600+0000 7fbfc1bf5640 1 -- 172.21.15.78:0/1063170786 wait complete. 2023-11-28T20:02:37.607 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:37.600+0000 7fbfc1bf5640 1 Processor -- start 2023-11-28T20:02:37.607 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:37.604+0000 7fbfc1bf5640 1 -- start start 2023-11-28T20:02:37.609 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:37.604+0000 7fbfc1bf5640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbfbc0c2110 0x7fbfbc072260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:37.609 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:37.604+0000 7fbfc1bf5640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbfbc0c4f80 0x7fbfbc144fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:37.610 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:37.604+0000 7fbfc1bf5640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbfbc154390 0x7fbfbc145510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:37.610 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:37.604+0000 7fbfc1bf5640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbfbc070a50 con 0x7fbfbc154390 2023-11-28T20:02:37.610 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:37.604+0000 7fbfc1bf5640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbfbc0a6270 con 0x7fbfbc0c4f80 2023-11-28T20:02:37.611 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:37.604+0000 7fbfc1bf5640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbfbc070e80 con 0x7fbfbc0c2110 2023-11-28T20:02:37.611 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:37.604+0000 7fbfbbfff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbfbc154390 0x7fbfbc145510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:02:37.611 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:37.604+0000 7fbfbbfff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbfbc154390 0x7fbfbc145510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:50806/0 (socket says 172.21.15.78:50806) 2023-11-28T20:02:37.611 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:37.604+0000 7fbfbbfff640 1 -- 172.21.15.78:0/1702237444 learned_addr learned my addr 172.21.15.78:0/1702237444 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T20:02:37.612 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:37.604+0000 7fbfbaffd640 1 --2- 172.21.15.78:0/1702237444 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbfbc0c4f80 0x7fbfbc144fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:02:37.612 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:37.604+0000 7fbfbb7fe640 1 --2- 172.21.15.78:0/1702237444 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbfbc0c2110 0x7fbfbc072260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:02:37.612 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:37.604+0000 7fbfbbfff640 1 -- 172.21.15.78:0/1702237444 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbfbc0c2110 msgr2=0x7fbfbc072260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:02:37.612 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:37.604+0000 7fbfbbfff640 1 --2- 172.21.15.78:0/1702237444 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbfbc0c2110 0x7fbfbc072260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:37.612 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:37.604+0000 7fbfbbfff640 1 -- 172.21.15.78:0/1702237444 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbfbc0c4f80 msgr2=0x7fbfbc144fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:02:37.613 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:37.604+0000 7fbfbbfff640 1 --2- 172.21.15.78:0/1702237444 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbfbc0c4f80 0x7fbfbc144fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:37.613 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:37.604+0000 7fbfbbfff640 1 -- 172.21.15.78:0/1702237444 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbfb00094d0 con 0x7fbfbc154390 2023-11-28T20:02:37.613 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:37.604+0000 7fbfbaffd640 1 --2- 172.21.15.78:0/1702237444 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbfbc0c4f80 0x7fbfbc144fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T20:02:37.613 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:37.604+0000 7fbfbbfff640 1 --2- 172.21.15.78:0/1702237444 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbfbc154390 0x7fbfbc145510 secure :-1 s=READY pgs=1014 cs=0 l=1 rev1=1 crypto rx=0x7fbfb400c770 tx=0x7fbfb400cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:02:37.614 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:37.604+0000 7fbfa3fff640 1 -- 172.21.15.78:0/1702237444 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfb4003b80 con 0x7fbfbc154390 2023-11-28T20:02:37.614 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:37.604+0000 7fbfa3fff640 1 -- 172.21.15.78:0/1702237444 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbfb4003ce0 con 0x7fbfbc154390 2023-11-28T20:02:37.614 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:37.604+0000 7fbfa3fff640 1 -- 172.21.15.78:0/1702237444 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfb400aa90 con 0x7fbfbc154390 2023-11-28T20:02:37.614 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:37.604+0000 7fbfc1bf5640 1 -- 172.21.15.78:0/1702237444 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbfbc071b70 con 0x7fbfbc154390 2023-11-28T20:02:37.614 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:37.604+0000 7fbfc1bf5640 1 -- 172.21.15.78:0/1702237444 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbfbc070770 con 0x7fbfbc154390 2023-11-28T20:02:37.616 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:37.604+0000 7fbfc1bf5640 1 -- 172.21.15.78:0/1702237444 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbfbc0a63b0 con 0x7fbfbc154390 2023-11-28T20:02:37.616 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:37.608+0000 7fbfa3fff640 1 -- 172.21.15.78:0/1702237444 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fbfb400abf0 con 0x7fbfbc154390 2023-11-28T20:02:37.616 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:37.608+0000 7fbfa3fff640 1 --2- 172.21.15.78:0/1702237444 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fbfa80664a0 0x7fbfa8068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:37.616 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:37.608+0000 7fbfa3fff640 1 -- 172.21.15.78:0/1702237444 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6885+0+0 (secure 0 0 0) 0x7fbfb4084090 con 0x7fbfbc154390 2023-11-28T20:02:37.616 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:37.608+0000 7fbfbb7fe640 1 --2- 172.21.15.78:0/1702237444 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fbfa80664a0 0x7fbfa8068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:02:37.617 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:37.608+0000 7fbfbb7fe640 1 --2- 172.21.15.78:0/1702237444 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fbfa80664a0 0x7fbfa8068960 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7fbfac0079c0 tx=0x7fbfac008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:02:37.617 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:37.612+0000 7fbfa3fff640 1 -- 172.21.15.78:0/1702237444 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fbfbc0a63b0 con 0x7fbfbc154390 2023-11-28T20:02:37.777 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:37.772+0000 7fbfc1bf5640 1 -- 172.21.15.78:0/1702237444 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fbfbc0a63b0 con 0x7fbfbc154390 2023-11-28T20:02:37.778 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:37.772+0000 7fbfa3fff640 1 -- 172.21.15.78:0/1702237444 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v85) v1 ==== 80+0+0 (secure 0 0 0) 0x7fbfbc0a63b0 con 0x7fbfbc154390 2023-11-28T20:02:37.778 INFO:teuthology.orchestra.run.smithi078.stderr:listed 0 entries 2023-11-28T20:02:37.779 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:37.776+0000 7fbfc1bf5640 1 -- 172.21.15.78:0/1702237444 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fbfa80664a0 msgr2=0x7fbfa8068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:02:37.780 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:37.776+0000 7fbfc1bf5640 1 --2- 172.21.15.78:0/1702237444 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fbfa80664a0 0x7fbfa8068960 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7fbfac0079c0 tx=0x7fbfac008040 comp rx=0 tx=0).stop 2023-11-28T20:02:37.780 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:37.776+0000 7fbfc1bf5640 1 -- 172.21.15.78:0/1702237444 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbfbc154390 msgr2=0x7fbfbc145510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:02:37.780 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:37.776+0000 7fbfc1bf5640 1 --2- 172.21.15.78:0/1702237444 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbfbc154390 0x7fbfbc145510 secure :-1 s=READY pgs=1014 cs=0 l=1 rev1=1 crypto rx=0x7fbfb400c770 tx=0x7fbfb400cc30 comp rx=0 tx=0).stop 2023-11-28T20:02:37.780 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:37.776+0000 7fbfc1bf5640 1 -- 172.21.15.78:0/1702237444 shutdown_connections 2023-11-28T20:02:37.780 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:37.776+0000 7fbfc1bf5640 1 --2- 172.21.15.78:0/1702237444 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fbfa80664a0 0x7fbfa8068960 unknown :-1 s=CLOSED pgs=482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:37.780 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:37.776+0000 7fbfc1bf5640 1 --2- 172.21.15.78:0/1702237444 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbfbc154390 0x7fbfbc145510 unknown :-1 s=CLOSED pgs=1014 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:37.780 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:37.776+0000 7fbfc1bf5640 1 --2- 172.21.15.78:0/1702237444 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbfbc0c4f80 0x7fbfbc144fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:37.780 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:37.776+0000 7fbfc1bf5640 1 --2- 172.21.15.78:0/1702237444 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbfbc0c2110 0x7fbfbc072260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:37.780 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:37.776+0000 7fbfc1bf5640 1 -- 172.21.15.78:0/1702237444 >> 172.21.15.78:0/1702237444 conn(0x7fbfbc06b220 msgr2=0x7fbfbc151d30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:02:37.780 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:37.776+0000 7fbfc1bf5640 1 -- 172.21.15.78:0/1702237444 shutdown_connections 2023-11-28T20:02:37.781 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:37.776+0000 7fbfc1bf5640 1 -- 172.21.15.78:0/1702237444 wait complete. 2023-11-28T20:02:37.799 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-11-28T20:02:37.799 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T20:02:37.799 DEBUG:teuthology.orchestra.run.smithi078:> sudo umount /home/ubuntu/cephtest/mnt.0 2023-11-28T20:02:37.856 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi078.front.sepia.ceph.com 2023-11-28T20:02:37.856 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T20:02:37.856 DEBUG:teuthology.orchestra.run.smithi078:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-11-28T20:02:37.882 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2023-11-28T20:02:37.882 DEBUG:teuthology.orchestra.run.smithi078:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-28T20:02:37.933 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354608k,nr_inodes=4088652,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275372k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=5526 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275368k,nr_inodes=818842,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275372k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 2023-11-28T20:02:37.933 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-11-28T20:02:38.113 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:38.108+0000 7fc591b96640 1 Processor -- start 2023-11-28T20:02:38.113 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:38.108+0000 7fc591b96640 1 -- start start 2023-11-28T20:02:38.114 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:38.108+0000 7fc591b96640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fc58c0c5f60 0x7fc58c0c4330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:38.114 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:38.108+0000 7fc591b96640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc58c0c4870 0x7fc58c0c6ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:38.114 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:38.108+0000 7fc591b96640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc58c0c6a10 con 0x7fc58c155310 2023-11-28T20:02:38.114 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:38.108+0000 7fc591b96640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc58c0c2740 con 0x7fc58c0c5f60 2023-11-28T20:02:38.114 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:38.108+0000 7fc591b96640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc58c06bc80 con 0x7fc58c0c4870 2023-11-28T20:02:38.115 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:38.108+0000 7fc583fff640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fc58c0c5f60 0x7fc58c0c4330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:02:38.115 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:38.108+0000 7fc58bfff640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc58c0c4870 0x7fc58c0c6ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:02:38.115 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:38.108+0000 7fc58bfff640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc58c0c4870 0x7fc58c0c6ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3301/0 says I am v2:172.21.15.78:41256/0 (socket says 172.21.15.78:41256) 2023-11-28T20:02:38.115 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:38.108+0000 7fc58bfff640 1 -- 172.21.15.78:0/2823204567 learned_addr learned my addr 172.21.15.78:0/2823204567 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T20:02:38.115 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:38.108+0000 7fc58b7fe640 1 --1- 172.21.15.78:0/2823204567 >> v1:172.21.15.179:6789/0 conn(0x7fc58c155310 0x7fc58c158590 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.179:6789/0 says I am v1:172.21.15.78:36840/0 (socket says 172.21.15.78:36840) 2023-11-28T20:02:38.115 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:38.112+0000 7fc58affd640 1 -- 172.21.15.78:0/2823204567 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 773893171 0 0) 0x7fc58c0c6a10 con 0x7fc58c155310 2023-11-28T20:02:38.116 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:38.112+0000 7fc58bfff640 1 -- 172.21.15.78:0/2823204567 >> v2:172.21.15.179:3300/0 conn(0x7fc58c0c5f60 msgr2=0x7fc58c0c4330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:02:38.116 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:38.112+0000 7fc58bfff640 1 --2- 172.21.15.78:0/2823204567 >> v2:172.21.15.179:3300/0 conn(0x7fc58c0c5f60 0x7fc58c0c4330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:38.116 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:38.112+0000 7fc58bfff640 1 -- 172.21.15.78:0/2823204567 >> v1:172.21.15.179:6789/0 conn(0x7fc58c155310 legacy=0x7fc58c158590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:02:38.116 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:38.112+0000 7fc58bfff640 1 -- 172.21.15.78:0/2823204567 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc58c0c2f80 con 0x7fc58c0c4870 2023-11-28T20:02:38.116 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:38.112+0000 7fc583fff640 1 --2- 172.21.15.78:0/2823204567 >> v2:172.21.15.179:3300/0 conn(0x7fc58c0c5f60 0x7fc58c0c4330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T20:02:38.117 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:38.112+0000 7fc58bfff640 1 --2- 172.21.15.78:0/2823204567 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc58c0c4870 0x7fc58c0c6ea0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fc584009e50 tx=0x7fc58401c9e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c4e9674a5b5613dc server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:02:38.118 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:38.112+0000 7fc58affd640 1 -- 172.21.15.78:0/2823204567 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5840a58a0 con 0x7fc58c0c4870 2023-11-28T20:02:38.118 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:38.112+0000 7fc58affd640 1 -- 172.21.15.78:0/2823204567 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc5840a5a00 con 0x7fc58c0c4870 2023-11-28T20:02:38.118 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:38.112+0000 7fc58affd640 1 -- 172.21.15.78:0/2823204567 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5840a5d90 con 0x7fc58c0c4870 2023-11-28T20:02:38.119 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:38.112+0000 7fc591b96640 1 -- 172.21.15.78:0/2823204567 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc58c0c4870 msgr2=0x7fc58c0c6ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:02:38.119 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:38.112+0000 7fc591b96640 1 --2- 172.21.15.78:0/2823204567 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc58c0c4870 0x7fc58c0c6ea0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fc584009e50 tx=0x7fc58401c9e0 comp rx=0 tx=0).stop 2023-11-28T20:02:38.119 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:38.116+0000 7fc591b96640 1 -- 172.21.15.78:0/2823204567 shutdown_connections 2023-11-28T20:02:38.120 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:38.116+0000 7fc591b96640 1 --2- 172.21.15.78:0/2823204567 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc58c0c4870 0x7fc58c0c6ea0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:38.120 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:38.116+0000 7fc591b96640 1 --2- 172.21.15.78:0/2823204567 >> v2:172.21.15.179:3300/0 conn(0x7fc58c0c5f60 0x7fc58c0c4330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:38.120 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:38.116+0000 7fc591b96640 1 -- 172.21.15.78:0/2823204567 >> 172.21.15.78:0/2823204567 conn(0x7fc58c0a9830 msgr2=0x7fc58c0a9c40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:02:38.121 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:38.116+0000 7fc591b96640 1 -- 172.21.15.78:0/2823204567 shutdown_connections 2023-11-28T20:02:38.121 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:38.116+0000 7fc591b96640 1 -- 172.21.15.78:0/2823204567 wait complete. 2023-11-28T20:02:38.123 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:38.116+0000 7fc591b96640 1 Processor -- start 2023-11-28T20:02:38.123 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:38.116+0000 7fc591b96640 1 -- start start 2023-11-28T20:02:38.123 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:38.116+0000 7fc591b96640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc58c0c4870 0x7fc58c1f0910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:38.123 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:38.116+0000 7fc591b96640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc58c0c5f60 0x7fc58c1564e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:38.123 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:38.116+0000 7fc591b96640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc58c155310 0x7fc58c156a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:38.124 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:38.116+0000 7fc591b96640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc58c158860 con 0x7fc58c0c5f60 2023-11-28T20:02:38.124 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:38.116+0000 7fc591b96640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc58c06d6a0 con 0x7fc58c155310 2023-11-28T20:02:38.124 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:38.116+0000 7fc591b96640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc58c1f15f0 con 0x7fc58c0c4870 2023-11-28T20:02:38.124 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:38.116+0000 7fc583fff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc58c0c5f60 0x7fc58c1564e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:02:38.124 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:38.116+0000 7fc583fff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc58c0c5f60 0x7fc58c1564e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:50822/0 (socket says 172.21.15.78:50822) 2023-11-28T20:02:38.124 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:38.116+0000 7fc583fff640 1 -- 172.21.15.78:0/173170385 learned_addr learned my addr 172.21.15.78:0/173170385 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T20:02:38.124 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:38.116+0000 7fc58b7fe640 1 --2- 172.21.15.78:0/173170385 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc58c0c4870 0x7fc58c1f0910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:02:38.124 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:38.116+0000 7fc58bfff640 1 --2- 172.21.15.78:0/173170385 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc58c155310 0x7fc58c156a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:02:38.124 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:38.116+0000 7fc583fff640 1 -- 172.21.15.78:0/173170385 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc58c0c4870 msgr2=0x7fc58c1f0910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:02:38.124 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:38.116+0000 7fc583fff640 1 --2- 172.21.15.78:0/173170385 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc58c0c4870 0x7fc58c1f0910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:38.124 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:38.116+0000 7fc583fff640 1 -- 172.21.15.78:0/173170385 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc58c155310 msgr2=0x7fc58c156a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:02:38.125 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:38.116+0000 7fc583fff640 1 --2- 172.21.15.78:0/173170385 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc58c155310 0x7fc58c156a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:38.125 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:38.116+0000 7fc583fff640 1 -- 172.21.15.78:0/173170385 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc574009420 con 0x7fc58c0c5f60 2023-11-28T20:02:38.125 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:38.116+0000 7fc583fff640 1 --2- 172.21.15.78:0/173170385 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc58c0c5f60 0x7fc58c1564e0 secure :-1 s=READY pgs=1015 cs=0 l=1 rev1=1 crypto rx=0x7fc57400ea00 tx=0x7fc57400eec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:02:38.125 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:38.120+0000 7fc588ff9640 1 -- 172.21.15.78:0/173170385 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc57400ca60 con 0x7fc58c0c5f60 2023-11-28T20:02:38.125 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:38.120+0000 7fc588ff9640 1 -- 172.21.15.78:0/173170385 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc57400cbc0 con 0x7fc58c0c5f60 2023-11-28T20:02:38.125 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:38.120+0000 7fc588ff9640 1 -- 172.21.15.78:0/173170385 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc574013470 con 0x7fc58c0c5f60 2023-11-28T20:02:38.125 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:38.120+0000 7fc591b96640 1 -- 172.21.15.78:0/173170385 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc584009b30 con 0x7fc58c0c5f60 2023-11-28T20:02:38.125 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:38.120+0000 7fc591b96640 1 -- 172.21.15.78:0/173170385 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc58c158480 con 0x7fc58c0c5f60 2023-11-28T20:02:38.126 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:38.120+0000 7fc591b96640 1 -- 172.21.15.78:0/173170385 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc58c067630 con 0x7fc58c0c5f60 2023-11-28T20:02:38.126 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:38.120+0000 7fc588ff9640 1 -- 172.21.15.78:0/173170385 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fc5740135d0 con 0x7fc58c0c5f60 2023-11-28T20:02:38.126 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:38.120+0000 7fc588ff9640 1 --2- 172.21.15.78:0/173170385 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fc56c0664a0 0x7fc56c068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:38.126 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:38.120+0000 7fc588ff9640 1 -- 172.21.15.78:0/173170385 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6885+0+0 (secure 0 0 0) 0x7fc574084230 con 0x7fc58c0c5f60 2023-11-28T20:02:38.126 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:38.120+0000 7fc58b7fe640 1 --2- 172.21.15.78:0/173170385 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fc56c0664a0 0x7fc56c068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:02:38.127 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:38.124+0000 7fc58b7fe640 1 --2- 172.21.15.78:0/173170385 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fc56c0664a0 0x7fc56c068960 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7fc57c007fd0 tx=0x7fc57c007d60 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:02:38.130 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:38.124+0000 7fc588ff9640 1 -- 172.21.15.78:0/173170385 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fc5740512b0 con 0x7fc58c0c5f60 2023-11-28T20:02:38.314 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:38.308+0000 7fc591b96640 1 -- 172.21.15.78:0/173170385 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fc58c0c5d40 con 0x7fc58c0c5f60 2023-11-28T20:02:38.314 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:38.308+0000 7fc588ff9640 1 -- 172.21.15.78:0/173170385 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v51) v1 ==== 53+0+149 (secure 0 0 0) 0x7fc5740548d0 con 0x7fc58c0c5f60 2023-11-28T20:02:38.314 INFO:teuthology.orchestra.run.smithi078.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-11-28T20:02:38.314 INFO:teuthology.orchestra.run.smithi078.stdout:name: cephfs2, metadata pool: cephfs2_metadata, data pools: [cephfs2_data ] 2023-11-28T20:02:38.316 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:38.312+0000 7fc591b96640 1 -- 172.21.15.78:0/173170385 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fc56c0664a0 msgr2=0x7fc56c068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:02:38.316 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:38.312+0000 7fc591b96640 1 --2- 172.21.15.78:0/173170385 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fc56c0664a0 0x7fc56c068960 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7fc57c007fd0 tx=0x7fc57c007d60 comp rx=0 tx=0).stop 2023-11-28T20:02:38.316 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:38.312+0000 7fc591b96640 1 -- 172.21.15.78:0/173170385 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc58c0c5f60 msgr2=0x7fc58c1564e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:02:38.316 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:38.312+0000 7fc591b96640 1 --2- 172.21.15.78:0/173170385 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc58c0c5f60 0x7fc58c1564e0 secure :-1 s=READY pgs=1015 cs=0 l=1 rev1=1 crypto rx=0x7fc57400ea00 tx=0x7fc57400eec0 comp rx=0 tx=0).stop 2023-11-28T20:02:38.317 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:38.312+0000 7fc591b96640 1 -- 172.21.15.78:0/173170385 shutdown_connections 2023-11-28T20:02:38.317 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:38.312+0000 7fc591b96640 1 --2- 172.21.15.78:0/173170385 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fc56c0664a0 0x7fc56c068960 unknown :-1 s=CLOSED pgs=483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:38.317 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:38.312+0000 7fc591b96640 1 --2- 172.21.15.78:0/173170385 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc58c155310 0x7fc58c156a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:38.317 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:38.312+0000 7fc591b96640 1 --2- 172.21.15.78:0/173170385 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc58c0c5f60 0x7fc58c1564e0 unknown :-1 s=CLOSED pgs=1015 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:38.317 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:38.312+0000 7fc591b96640 1 --2- 172.21.15.78:0/173170385 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc58c0c4870 0x7fc58c1f0910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:38.317 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:38.312+0000 7fc591b96640 1 -- 172.21.15.78:0/173170385 >> 172.21.15.78:0/173170385 conn(0x7fc58c0a9830 msgr2=0x7fc58c151380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:02:38.317 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:38.312+0000 7fc591b96640 1 -- 172.21.15.78:0/173170385 shutdown_connections 2023-11-28T20:02:38.317 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:38.312+0000 7fc591b96640 1 -- 172.21.15.78:0/173170385 wait complete. 2023-11-28T20:02:38.335 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-11-28T20:02:38.335 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-11-28T20:02:38.335 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi078.front.sepia.ceph.com 2023-11-28T20:02:38.335 INFO:tasks.cephfs.mount:self.client.name = client.testuser 2023-11-28T20:02:38.335 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-11-28T20:02:38.335 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-11-28T20:02:38.335 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-11-28T20:02:38.335 INFO:tasks.cephfs.mount:self.client_keyring_path = /tmp/tmp.QZTYiaI6Et 2023-11-28T20:02:38.336 DEBUG:teuthology.orchestra.run.smithi078:> mktemp 2023-11-28T20:02:38.344 INFO:teuthology.orchestra.run.smithi078.stdout:/tmp/tmp.nWOv9Bbz1v 2023-11-28T20:02:38.345 DEBUG:teuthology.orchestra.run.smithi078:> sudo cp /tmp/tmp.QZTYiaI6Et /tmp/tmp.nWOv9Bbz1v 2023-11-28T20:02:38.406 DEBUG:teuthology.orchestra.run.smithi078:> sudo chmod 0666 /tmp/tmp.nWOv9Bbz1v 2023-11-28T20:02:38.523 DEBUG:teuthology.orchestra.remote:smithi078:/tmp/tmp.nWOv9Bbz1v is 226B 2023-11-28T20:02:38.538 DEBUG:teuthology.orchestra.run.smithi078:> rm -fr /tmp/tmp.nWOv9Bbz1v 2023-11-28T20:02:38.546 INFO:tasks.cephfs.mount:keyring content - [client.testuser] key = AQBaR2ZlZ0uqMRAAUA+5naTf77F/Mb/2VolMgw== caps mds = "allow r fsname=cephfs, allow r fsname=cephfs2" caps mon = "allow r" caps osd = "allow r tag cephfs data=cephfs, allow r tag cephfs data=cephfs2" 2023-11-28T20:02:38.546 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-11-28T20:02:38.546 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T20:02:38.546 DEBUG:teuthology.orchestra.run.smithi078:> ip addr 2023-11-28T20:02:38.596 INFO:teuthology.orchestra.run.smithi078.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-11-28T20:02:38.596 INFO:teuthology.orchestra.run.smithi078.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-11-28T20:02:38.597 INFO:teuthology.orchestra.run.smithi078.stdout: inet 127.0.0.1/8 scope host lo 2023-11-28T20:02:38.597 INFO:teuthology.orchestra.run.smithi078.stdout: valid_lft forever preferred_lft forever 2023-11-28T20:02:38.597 INFO:teuthology.orchestra.run.smithi078.stdout: inet6 ::1/128 scope host 2023-11-28T20:02:38.597 INFO:teuthology.orchestra.run.smithi078.stdout: valid_lft forever preferred_lft forever 2023-11-28T20:02:38.597 INFO:teuthology.orchestra.run.smithi078.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-11-28T20:02:38.597 INFO:teuthology.orchestra.run.smithi078.stdout: link/ether 0c:c4:7a:d8:a1:22 brd ff:ff:ff:ff:ff:ff 2023-11-28T20:02:38.597 INFO:teuthology.orchestra.run.smithi078.stdout: altname enp7s0f0 2023-11-28T20:02:38.597 INFO:teuthology.orchestra.run.smithi078.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-11-28T20:02:38.598 INFO:teuthology.orchestra.run.smithi078.stdout: link/ether 0c:c4:7a:d8:a1:23 brd ff:ff:ff:ff:ff:ff 2023-11-28T20:02:38.598 INFO:teuthology.orchestra.run.smithi078.stdout: altname enp7s0f1 2023-11-28T20:02:38.598 INFO:teuthology.orchestra.run.smithi078.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-11-28T20:02:38.598 INFO:teuthology.orchestra.run.smithi078.stdout: link/ether 0c:c4:7a:8f:d4:dc brd ff:ff:ff:ff:ff:ff 2023-11-28T20:02:38.598 INFO:teuthology.orchestra.run.smithi078.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-11-28T20:02:38.598 INFO:teuthology.orchestra.run.smithi078.stdout: link/ether 0c:c4:7a:8f:d4:dd brd ff:ff:ff:ff:ff:ff 2023-11-28T20:02:38.598 INFO:teuthology.orchestra.run.smithi078.stdout: inet 172.21.15.78/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2023-11-28T20:02:38.598 INFO:teuthology.orchestra.run.smithi078.stdout: valid_lft 42213sec preferred_lft 42213sec 2023-11-28T20:02:38.598 INFO:teuthology.orchestra.run.smithi078.stdout: inet6 fe80::ec4:7aff:fe8f:d4dd/64 scope link 2023-11-28T20:02:38.598 INFO:teuthology.orchestra.run.smithi078.stdout: valid_lft forever preferred_lft forever 2023-11-28T20:02:38.598 INFO:teuthology.orchestra.run.smithi078.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-11-28T20:02:38.598 INFO:teuthology.orchestra.run.smithi078.stdout: link/ether 02:42:8f:cc:76:dd brd ff:ff:ff:ff:ff:ff 2023-11-28T20:02:38.599 INFO:teuthology.orchestra.run.smithi078.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-11-28T20:02:38.599 INFO:teuthology.orchestra.run.smithi078.stdout: valid_lft forever preferred_lft forever 2023-11-28T20:02:38.599 INFO:teuthology.orchestra.run.smithi078.stdout:9: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-11-28T20:02:38.599 INFO:teuthology.orchestra.run.smithi078.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2023-11-28T20:02:38.599 INFO:teuthology.orchestra.run.smithi078.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-11-28T20:02:38.599 INFO:teuthology.orchestra.run.smithi078.stdout: valid_lft forever preferred_lft forever 2023-11-28T20:02:38.599 INFO:teuthology.orchestra.run.smithi078.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2023-11-28T20:02:38.599 INFO:teuthology.orchestra.run.smithi078.stdout: valid_lft forever preferred_lft forever 2023-11-28T20:02:38.599 INFO:teuthology.orchestra.run.smithi078.stdout:10: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-11-28T20:02:38.599 INFO:teuthology.orchestra.run.smithi078.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-28T20:02:38.599 INFO:teuthology.orchestra.run.smithi078.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2023-11-28T20:02:38.599 INFO:teuthology.orchestra.run.smithi078.stdout: valid_lft forever preferred_lft forever 2023-11-28T20:02:38.600 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T20:02:38.600 DEBUG:teuthology.orchestra.run.smithi078:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-11-28T20:02:38.657 INFO:teuthology.orchestra.run.smithi078.stdout:1 2023-11-28T20:02:38.660 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T20:02:38.660 DEBUG:teuthology.orchestra.run.smithi078:> route 2023-11-28T20:02:38.717 INFO:teuthology.orchestra.run.smithi078.stdout:Kernel IP routing table 2023-11-28T20:02:38.718 INFO:teuthology.orchestra.run.smithi078.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-11-28T20:02:38.718 INFO:teuthology.orchestra.run.smithi078.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2023-11-28T20:02:38.718 INFO:teuthology.orchestra.run.smithi078.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-11-28T20:02:38.718 INFO:teuthology.orchestra.run.smithi078.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-11-28T20:02:38.718 INFO:teuthology.orchestra.run.smithi078.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-11-28T20:02:38.718 INFO:teuthology.orchestra.run.smithi078.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-11-28T20:02:38.718 INFO:teuthology.orchestra.run.smithi078.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-11-28T20:02:38.718 INFO:teuthology.orchestra.run.smithi078.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-11-28T20:02:38.718 INFO:teuthology.orchestra.run.smithi078.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-11-28T20:02:38.718 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T20:02:38.719 DEBUG:teuthology.orchestra.run.smithi078:> (cd / && exec bash -c ' 2023-11-28T20:02:38.719 DEBUG:teuthology.orchestra.run.smithi078:> set -e 2023-11-28T20:02:38.719 DEBUG:teuthology.orchestra.run.smithi078:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-11-28T20:02:38.719 DEBUG:teuthology.orchestra.run.smithi078:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-11-28T20:02:38.719 DEBUG:teuthology.orchestra.run.smithi078:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-11-28T20:02:38.719 DEBUG:teuthology.orchestra.run.smithi078:> ') 2023-11-28T20:02:38.810 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T20:02:38.811 DEBUG:teuthology.orchestra.run.smithi078:> ip netns list 2023-11-28T20:02:38.820 INFO:teuthology.orchestra.run.smithi078.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-11-28T20:02:38.999 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-11-28T20:02:39.095 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T20:02:39.095 DEBUG:teuthology.orchestra.run.smithi078:> sudo ip link set brx.0 up 2023-11-28T20:02:39.118 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-28T20:02:39.118 DEBUG:teuthology.orchestra.run.smithi078:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-11-28T20:02:39.171 INFO:teuthology.orchestra.run.smithi078.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-11-28T20:02:39.171 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-28T20:02:39.171 DEBUG:teuthology.orchestra.run.smithi078:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-11-28T20:02:39.222 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2023-11-28T20:02:39.222 DEBUG:teuthology.orchestra.run.smithi078:> dd if=/tmp/tmp.QZTYiaI6Et of=/dev/stdout 2023-11-28T20:02:39.270 INFO:tasks.cephfs.kernel_mount:mounting using device: testuser@.cephfs=/ 2023-11-28T20:02:39.271 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T20:02:39.271 DEBUG:teuthology.orchestra.run.smithi078:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph testuser@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,secret=AQBaR2ZlZ0uqMRAAUA+5naTf77F/Mb/2VolMgw==,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-11-28T20:02:39.365 INFO:teuthology.orchestra.run.smithi078.stdout:parsing options: rw,norequire_active_mds,secret=AQBaR2ZlZ0uqMRAAUA+5naTf77F/Mb/2VolMgw==,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-11-28T20:02:39.365 INFO:teuthology.orchestra.run.smithi078.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-11-28T20:02:39.366 INFO:teuthology.orchestra.run.smithi078.stdout:keyring.get_secret failed 2023-11-28T20:02:39.378 INFO:teuthology.orchestra.run.smithi078.stdout:parsing options: rw,norequire_active_mds,secret=AQBaR2ZlZ0uqMRAAUA+5naTf77F/Mb/2VolMgw==,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-11-28T20:02:39.471 INFO:teuthology.orchestra.run.smithi078.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-11-28T20:02:39.541 INFO:teuthology.orchestra.run.smithi078.stdout:mount.ceph: resolved to: "172.21.15.78:3300,172.21.15.179:3300,172.21.15.179:3301" 2023-11-28T20:02:39.541 INFO:teuthology.orchestra.run.smithi078.stdout:mount.ceph: trying mount with new device syntax: testuser@dd9780e8-3bda-44fa-a9f0-fa07d19d901d.cephfs=/ 2023-11-28T20:02:39.541 INFO:teuthology.orchestra.run.smithi078.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=testuser,ms_mode=prefer-crc,key=testuser,mon_addr=172.21.15.78:3300/172.21.15.179:3300/172.21.15.179:3301" will pass to kernel 2023-11-28T20:02:39.543 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-11-28T20:02:39.649 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T20:02:39.649 DEBUG:teuthology.orchestra.run.smithi078:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-11-28T20:02:39.668 INFO:teuthology.orchestra.run.smithi078.stderr:chmod: changing permissions of '/home/ubuntu/cephtest/mnt.0': Permission denied 2023-11-28T20:02:39.669 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-28T20:02:39.670 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T20:02:39.670 DEBUG:teuthology.orchestra.run.smithi078:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-11-28T20:02:39.726 INFO:teuthology.orchestra.run.smithi078.stdout:client7077 2023-11-28T20:02:39.726 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2023-11-28T20:02:39.727 DEBUG:teuthology.orchestra.run.smithi078:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-28T20:02:39.782 DEBUG:teuthology.orchestra.run.smithi179:> mktemp 2023-11-28T20:02:39.792 INFO:teuthology.orchestra.run.smithi179.stdout:/tmp/tmp.eOw7VL0zaf 2023-11-28T20:02:39.792 DEBUG:teuthology.orchestra.run.smithi179:> set -ex 2023-11-28T20:02:39.792 DEBUG:teuthology.orchestra.run.smithi179:> dd of=/tmp/tmp.eOw7VL0zaf 2023-11-28T20:02:39.841 DEBUG:teuthology.orchestra.run.smithi179:> set -ex 2023-11-28T20:02:39.841 DEBUG:teuthology.orchestra.run.smithi179:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-28T20:02:39.893 DEBUG:teuthology.orchestra.run.smithi179:> set -ex 2023-11-28T20:02:39.894 DEBUG:teuthology.orchestra.run.smithi179:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-28T20:02:39.946 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-28T20:02:40.086 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:40.080+0000 7f06f2dc3640 1 Processor -- start 2023-11-28T20:02:40.086 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:40.080+0000 7f06f2dc3640 1 -- start start 2023-11-28T20:02:40.087 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:40.084+0000 7f06f2dc3640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f06ec0bf310 0x7f06ec154e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:40.087 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:40.084+0000 7f06f2dc3640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f06ec157cf0 con 0x7f06ec0bee90 2023-11-28T20:02:40.087 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:40.084+0000 7f06f2dc3640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f06ec157fd0 con 0x7f06ec14b2a0 2023-11-28T20:02:40.087 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:40.084+0000 7f06f2dc3640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f06ec06c3a0 con 0x7f06ec0bf310 2023-11-28T20:02:40.087 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:40.084+0000 7f06ebfff640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f06ec0bee90 0x7f06ec154740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:50002/0 (socket says 172.21.15.78:50002) 2023-11-28T20:02:40.087 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:40.084+0000 7f06ebfff640 1 -- 172.21.15.78:0/3515937824 learned_addr learned my addr 172.21.15.78:0/3515937824 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-11-28T20:02:40.087 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:40.084+0000 7f06f1360640 1 --2- 172.21.15.78:0/3515937824 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f06ec0bf310 0x7f06ec154e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:02:40.088 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:40.084+0000 7f06eb7fe640 1 -- 172.21.15.78:0/3515937824 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1941311924 0 0) 0x7f06ec157cf0 con 0x7f06ec0bee90 2023-11-28T20:02:40.089 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:40.084+0000 7f06eb7fe640 1 -- 172.21.15.78:0/3515937824 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f06dc003530 con 0x7f06ec0bee90 2023-11-28T20:02:40.089 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:40.084+0000 7f06eb7fe640 1 -- 172.21.15.78:0/3515937824 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 327351052 0 0) 0x7f06ec157fd0 con 0x7f06ec14b2a0 2023-11-28T20:02:40.089 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:40.084+0000 7f06eb7fe640 1 -- 172.21.15.78:0/3515937824 --> v1:172.21.15.179:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f06ec157cf0 con 0x7f06ec14b2a0 2023-11-28T20:02:40.089 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:40.084+0000 7f06f1360640 1 -- 172.21.15.78:0/3515937824 >> v1:172.21.15.179:6789/0 conn(0x7f06ec14b2a0 legacy=0x7f06ec0a4ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:02:40.089 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:40.084+0000 7f06f1360640 1 -- 172.21.15.78:0/3515937824 >> v1:172.21.15.78:6789/0 conn(0x7f06ec0bee90 legacy=0x7f06ec154740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:02:40.089 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:40.084+0000 7f06f1360640 1 -- 172.21.15.78:0/3515937824 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06ec1582b0 con 0x7f06ec0bf310 2023-11-28T20:02:40.090 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:40.088+0000 7f06f1360640 1 --2- 172.21.15.78:0/3515937824 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f06ec0bf310 0x7f06ec154e50 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f06e4009dc0 tx=0x7f06e401c850 comp rx=0 tx=0).ready entity=mon.2 client_cookie=582dad845d0056d9 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:02:40.092 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:40.088+0000 7f06eb7fe640 1 -- 172.21.15.78:0/3515937824 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06e40a5820 con 0x7f06ec0bf310 2023-11-28T20:02:40.092 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:40.088+0000 7f06eb7fe640 1 -- 172.21.15.78:0/3515937824 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f06e40a5980 con 0x7f06ec0bf310 2023-11-28T20:02:40.092 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:40.088+0000 7f06eb7fe640 1 -- 172.21.15.78:0/3515937824 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06e40a5d10 con 0x7f06ec0bf310 2023-11-28T20:02:40.092 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:40.088+0000 7f06f2dc3640 1 -- 172.21.15.78:0/3515937824 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f06ec0bf310 msgr2=0x7f06ec154e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:02:40.092 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:40.088+0000 7f06f2dc3640 1 --2- 172.21.15.78:0/3515937824 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f06ec0bf310 0x7f06ec154e50 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f06e4009dc0 tx=0x7f06e401c850 comp rx=0 tx=0).stop 2023-11-28T20:02:40.092 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:40.088+0000 7f06f2dc3640 1 -- 172.21.15.78:0/3515937824 shutdown_connections 2023-11-28T20:02:40.092 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:40.088+0000 7f06f2dc3640 1 --2- 172.21.15.78:0/3515937824 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f06ec0bf310 0x7f06ec154e50 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:40.092 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:40.088+0000 7f06f2dc3640 1 -- 172.21.15.78:0/3515937824 >> 172.21.15.78:0/3515937824 conn(0x7f06ec0a7810 msgr2=0x7f06ec0a7c20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:02:40.093 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:40.088+0000 7f06f2dc3640 1 -- 172.21.15.78:0/3515937824 shutdown_connections 2023-11-28T20:02:40.093 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:40.088+0000 7f06f2dc3640 1 -- 172.21.15.78:0/3515937824 wait complete. 2023-11-28T20:02:40.093 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:40.088+0000 7f06f2dc3640 1 Processor -- start 2023-11-28T20:02:40.093 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:40.088+0000 7f06f2dc3640 1 -- start start 2023-11-28T20:02:40.096 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:40.088+0000 7f06f2dc3640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f06ec0bee90 0x7f06ec143660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:40.096 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:40.088+0000 7f06f2dc3640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f06ec0bf310 0x7f06ec143ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:40.096 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:40.088+0000 7f06f2dc3640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f06ec14b2a0 0x7f06ec153410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:40.096 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:40.088+0000 7f06f2dc3640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06ec152ff0 con 0x7f06ec0bf310 2023-11-28T20:02:40.096 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:40.088+0000 7f06f2dc3640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06ec148020 con 0x7f06ec14b2a0 2023-11-28T20:02:40.096 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:40.088+0000 7f06f2dc3640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f06ec13d9b0 con 0x7f06ec0bee90 2023-11-28T20:02:40.096 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:40.092+0000 7f06ebfff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f06ec0bf310 0x7f06ec143ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:02:40.096 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:40.092+0000 7f06ebfff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f06ec0bf310 0x7f06ec143ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:50836/0 (socket says 172.21.15.78:50836) 2023-11-28T20:02:40.096 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:40.092+0000 7f06ebfff640 1 -- 172.21.15.78:0/504150043 learned_addr learned my addr 172.21.15.78:0/504150043 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T20:02:40.096 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:40.092+0000 7f06f1360640 1 --2- 172.21.15.78:0/504150043 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f06ec14b2a0 0x7f06ec153410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:02:40.096 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:40.092+0000 7f06f0b5f640 1 --2- 172.21.15.78:0/504150043 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f06ec0bee90 0x7f06ec143660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:02:40.097 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:40.092+0000 7f06ebfff640 1 -- 172.21.15.78:0/504150043 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f06ec0bee90 msgr2=0x7f06ec143660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:02:40.097 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:40.092+0000 7f06ebfff640 1 --2- 172.21.15.78:0/504150043 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f06ec0bee90 0x7f06ec143660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:40.097 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:40.092+0000 7f06ebfff640 1 -- 172.21.15.78:0/504150043 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f06ec14b2a0 msgr2=0x7f06ec153410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:02:40.097 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:40.092+0000 7f06ebfff640 1 --2- 172.21.15.78:0/504150043 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f06ec14b2a0 0x7f06ec153410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:40.097 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:40.092+0000 7f06ebfff640 1 -- 172.21.15.78:0/504150043 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06e4009a70 con 0x7f06ec0bf310 2023-11-28T20:02:40.097 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:40.092+0000 7f06ebfff640 1 --2- 172.21.15.78:0/504150043 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f06ec0bf310 0x7f06ec143ba0 secure :-1 s=READY pgs=1018 cs=0 l=1 rev1=1 crypto rx=0x7f06d800c420 tx=0x7f06d800c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:02:40.097 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:40.092+0000 7f06e97fa640 1 -- 172.21.15.78:0/504150043 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06d8005cf0 con 0x7f06ec0bf310 2023-11-28T20:02:40.097 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:40.092+0000 7f06e97fa640 1 -- 172.21.15.78:0/504150043 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f06d8005e50 con 0x7f06ec0bf310 2023-11-28T20:02:40.097 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:40.092+0000 7f06e97fa640 1 -- 172.21.15.78:0/504150043 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06d8007310 con 0x7f06ec0bf310 2023-11-28T20:02:40.097 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:40.092+0000 7f06f2dc3640 1 -- 172.21.15.78:0/504150043 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f06ec0a7010 con 0x7f06ec0bf310 2023-11-28T20:02:40.097 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:40.092+0000 7f06f2dc3640 1 -- 172.21.15.78:0/504150043 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f06ec1ee600 con 0x7f06ec0bf310 2023-11-28T20:02:40.098 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:40.092+0000 7f06f2dc3640 1 -- 172.21.15.78:0/504150043 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f06ec153130 con 0x7f06ec0bf310 2023-11-28T20:02:40.098 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:40.092+0000 7f06e97fa640 1 -- 172.21.15.78:0/504150043 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f06d8007470 con 0x7f06ec0bf310 2023-11-28T20:02:40.098 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:40.092+0000 7f06e97fa640 1 --2- 172.21.15.78:0/504150043 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f06d0066470 0x7f06d0068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:40.099 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:40.092+0000 7f06e97fa640 1 -- 172.21.15.78:0/504150043 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6885+0+0 (secure 0 0 0) 0x7f06d8083960 con 0x7f06ec0bf310 2023-11-28T20:02:40.099 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:40.096+0000 7f06f0b5f640 1 --2- 172.21.15.78:0/504150043 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f06d0066470 0x7f06d0068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:02:40.099 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:40.096+0000 7f06f0b5f640 1 --2- 172.21.15.78:0/504150043 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f06d0066470 0x7f06d0068930 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f06e00011f0 tx=0x7f06e0009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:02:40.102 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:40.096+0000 7f06e97fa640 1 -- 172.21.15.78:0/504150043 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f06ec153130 con 0x7f06ec0bf310 2023-11-28T20:02:40.250 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:40.244+0000 7f06f2dc3640 1 -- 172.21.15.78:0/504150043 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f06ec153130 con 0x7f06ec0bf310 2023-11-28T20:02:40.252 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:40.248+0000 7f06e97fa640 1 -- 172.21.15.78:0/504150043 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v85) v1 ==== 74+0+20339 (secure 0 0 0) 0x7f06ec153130 con 0x7f06ec0bf310 2023-11-28T20:02:40.252 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-11-28T20:02:40.253 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":85,"fsid":"dd9780e8-3bda-44fa-a9f0-fa07d19d901d","created":"2023-11-28T19:58:40.969556+0000","modified":"2023-11-28T20:02:26.796715+0000","last_up_change":"2023-11-28T19:58:52.596716+0000","last_in_change":"2023-11-28T19:58:43.609275+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":16,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-28T19:58:54.011229+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_metadata","create_time":"2023-11-28T20:02:05.787820+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs_data","create_time":"2023-11-28T20:02:06.652305+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs2_metadata","create_time":"2023-11-28T20:02:23.066724+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":16,"pool_name":"cephfs2_data","create_time":"2023-11-28T20:02:24.230614+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs2"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e84245ac-b5da-429e-af18-39acaa2b33e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6800","nonce":3358701235},{"type":"v1","addr":"172.21.15.78:6801","nonce":3358701235}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6802","nonce":3358701235},{"type":"v1","addr":"172.21.15.78:6803","nonce":3358701235}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6806","nonce":3358701235},{"type":"v1","addr":"172.21.15.78:6807","nonce":3358701235}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6804","nonce":3358701235},{"type":"v1","addr":"172.21.15.78:6805","nonce":3358701235}]},"public_addr":"172.21.15.78:6801/3358701235","cluster_addr":"172.21.15.78:6803/3358701235","heartbeat_back_addr":"172.21.15.78:6807/3358701235","heartbeat_front_addr":"172.21.15.78:6805/3358701235","state":["exists","up"]},{"osd":1,"uuid":"e634831d-c4e2-48d9-870c-9556ae162981","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6808","nonce":3211476654},{"type":"v1","addr":"172.21.15.78:6809","nonce":3211476654}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6810","nonce":3211476654},{"type":"v1","addr":"172.21.15.78:6811","nonce":3211476654}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6814","nonce":3211476654},{"type":"v1","addr":"172.21.15.78:6815","nonce":3211476654}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6812","nonce":3211476654},{"type":"v1","addr":"172.21.15.78:6813","nonce":3211476654}]},"public_addr":"172.21.15.78:6809/3211476654","cluster_addr":"172.21.15.78:6811/3211476654","heartbeat_back_addr":"172.21.15.78:6815/3211476654","heartbeat_front_addr":"172.21.15.78:6813/3211476654","state":["exists","up"]},{"osd":2,"uuid":"274c8395-6534-41f0-b8fb-a00af8985aa8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6816","nonce":2532904479},{"type":"v1","addr":"172.21.15.78:6817","nonce":2532904479}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6818","nonce":2532904479},{"type":"v1","addr":"172.21.15.78:6819","nonce":2532904479}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6822","nonce":2532904479},{"type":"v1","addr":"172.21.15.78:6823","nonce":2532904479}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6820","nonce":2532904479},{"type":"v1","addr":"172.21.15.78:6821","nonce":2532904479}]},"public_addr":"172.21.15.78:6817/2532904479","cluster_addr":"172.21.15.78:6819/2532904479","heartbeat_back_addr":"172.21.15.78:6823/2532904479","heartbeat_front_addr":"172.21.15.78:6821/2532904479","state":["exists","up"]},{"osd":3,"uuid":"77acc9af-7d4d-4b18-8cf5-d62f5971b7c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6824","nonce":3442991267},{"type":"v1","addr":"172.21.15.78:6825","nonce":3442991267}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6826","nonce":3442991267},{"type":"v1","addr":"172.21.15.78:6827","nonce":3442991267}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6830","nonce":3442991267},{"type":"v1","addr":"172.21.15.78:6831","nonce":3442991267}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6828","nonce":3442991267},{"type":"v1","addr":"172.21.15.78:6829","nonce":3442991267}]},"public_addr":"172.21.15.78:6825/3442991267","cluster_addr":"172.21.15.78:6827/3442991267","heartbeat_back_addr":"172.21.15.78:6831/3442991267","heartbeat_front_addr":"172.21.15.78:6829/3442991267","state":["exists","up"]},{"osd":4,"uuid":"5c62bc66-6b34-4b7f-a66b-9a743969138c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":802983577},{"type":"v1","addr":"172.21.15.179:6809","nonce":802983577}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":802983577},{"type":"v1","addr":"172.21.15.179:6811","nonce":802983577}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":802983577},{"type":"v1","addr":"172.21.15.179:6815","nonce":802983577}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":802983577},{"type":"v1","addr":"172.21.15.179:6813","nonce":802983577}]},"public_addr":"172.21.15.179:6809/802983577","cluster_addr":"172.21.15.179:6811/802983577","heartbeat_back_addr":"172.21.15.179:6815/802983577","heartbeat_front_addr":"172.21.15.179:6813/802983577","state":["exists","up"]},{"osd":5,"uuid":"67db6d36-f684-4079-b0cd-82b4dd61461f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":518192887},{"type":"v1","addr":"172.21.15.179:6818","nonce":518192887}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":518192887},{"type":"v1","addr":"172.21.15.179:6822","nonce":518192887}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":518192887},{"type":"v1","addr":"172.21.15.179:6829","nonce":518192887}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6824","nonce":518192887},{"type":"v1","addr":"172.21.15.179:6826","nonce":518192887}]},"public_addr":"172.21.15.179:6818/518192887","cluster_addr":"172.21.15.179:6822/518192887","heartbeat_back_addr":"172.21.15.179:6829/518192887","heartbeat_front_addr":"172.21.15.179:6826/518192887","state":["exists","up"]},{"osd":6,"uuid":"12e670af-5a16-4c81-9f97-defa66cab967","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":815435378},{"type":"v1","addr":"172.21.15.179:6801","nonce":815435378}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":815435378},{"type":"v1","addr":"172.21.15.179:6803","nonce":815435378}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":815435378},{"type":"v1","addr":"172.21.15.179:6807","nonce":815435378}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":815435378},{"type":"v1","addr":"172.21.15.179:6805","nonce":815435378}]},"public_addr":"172.21.15.179:6801/815435378","cluster_addr":"172.21.15.179:6803/815435378","heartbeat_back_addr":"172.21.15.179:6807/815435378","heartbeat_front_addr":"172.21.15.179:6805/815435378","state":["exists","up"]},{"osd":7,"uuid":"fe630650-2eb3-49ad-8676-c341e6332eb1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6817","nonce":2848432339},{"type":"v1","addr":"172.21.15.179:6819","nonce":2848432339}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6821","nonce":2848432339},{"type":"v1","addr":"172.21.15.179:6823","nonce":2848432339}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":2848432339},{"type":"v1","addr":"172.21.15.179:6831","nonce":2848432339}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6825","nonce":2848432339},{"type":"v1","addr":"172.21.15.179:6827","nonce":2848432339}]},"public_addr":"172.21.15.179:6819/2848432339","cluster_addr":"172.21.15.179:6823/2848432339","heartbeat_back_addr":"172.21.15.179:6831/2848432339","heartbeat_front_addr":"172.21.15.179:6827/2848432339","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:58:49.255433+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:58:49.412880+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:58:49.559295+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:58:49.245237+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:58:49.184557+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:58:49.329851+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:58:49.366012+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:58:49.349604+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-28T20:02:40.255 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:40.248+0000 7f06f2dc3640 1 -- 172.21.15.78:0/504150043 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f06d0066470 msgr2=0x7f06d0068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:02:40.255 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:40.248+0000 7f06f2dc3640 1 --2- 172.21.15.78:0/504150043 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f06d0066470 0x7f06d0068930 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f06e00011f0 tx=0x7f06e0009040 comp rx=0 tx=0).stop 2023-11-28T20:02:40.255 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:40.248+0000 7f06f2dc3640 1 -- 172.21.15.78:0/504150043 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f06ec0bf310 msgr2=0x7f06ec143ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:02:40.255 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:40.248+0000 7f06f2dc3640 1 --2- 172.21.15.78:0/504150043 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f06ec0bf310 0x7f06ec143ba0 secure :-1 s=READY pgs=1018 cs=0 l=1 rev1=1 crypto rx=0x7f06d800c420 tx=0x7f06d800c8e0 comp rx=0 tx=0).stop 2023-11-28T20:02:40.255 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:40.248+0000 7f06f2dc3640 1 -- 172.21.15.78:0/504150043 shutdown_connections 2023-11-28T20:02:40.255 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:40.248+0000 7f06f2dc3640 1 --2- 172.21.15.78:0/504150043 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f06d0066470 0x7f06d0068930 unknown :-1 s=CLOSED pgs=484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:40.255 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:40.248+0000 7f06f2dc3640 1 --2- 172.21.15.78:0/504150043 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f06ec14b2a0 0x7f06ec153410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:40.255 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:40.248+0000 7f06f2dc3640 1 --2- 172.21.15.78:0/504150043 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f06ec0bf310 0x7f06ec143ba0 unknown :-1 s=CLOSED pgs=1018 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:40.255 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:40.248+0000 7f06f2dc3640 1 --2- 172.21.15.78:0/504150043 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f06ec0bee90 0x7f06ec143660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:40.255 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:40.248+0000 7f06f2dc3640 1 -- 172.21.15.78:0/504150043 >> 172.21.15.78:0/504150043 conn(0x7f06ec0a7810 msgr2=0x7f06ec0a7bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:02:40.256 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:40.248+0000 7f06f2dc3640 1 -- 172.21.15.78:0/504150043 shutdown_connections 2023-11-28T20:02:40.256 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:40.248+0000 7f06f2dc3640 1 -- 172.21.15.78:0/504150043 wait complete. 2023-11-28T20:02:40.273 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-28T19:58:54.011229+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 13, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-28T20:02:05.787820+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '80', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 14, 'pool_name': 'cephfs_data', 'create_time': '2023-11-28T20:02:06.652305+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '81', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 15, 'pool_name': 'cephfs2_metadata', 'create_time': '2023-11-28T20:02:23.066724+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '84', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs2'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 16, 'pool_name': 'cephfs2_data', 'create_time': '2023-11-28T20:02:24.230614+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '85', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs2'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-28T20:02:40.274 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-28T20:02:40.419 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:40.416+0000 7f1813980640 1 Processor -- start 2023-11-28T20:02:40.419 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:40.416+0000 7f1813980640 1 -- start start 2023-11-28T20:02:40.421 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:40.416+0000 7f1813980640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f180c156200 0x7f180c0c0370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:40.421 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:40.416+0000 7f1813980640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f180c0c0e10 0x7f180c0c1b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:40.421 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:40.416+0000 7f1813980640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f180c15bf70 0x7f180c15c400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:40.421 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:40.416+0000 7f1813980640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f180c06d8d0 con 0x7f180c15bf70 2023-11-28T20:02:40.422 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:40.416+0000 7f1813980640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f180c06bce0 con 0x7f180c156200 2023-11-28T20:02:40.422 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:40.416+0000 7f1813980640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f180c15cc60 con 0x7f180c0c0e10 2023-11-28T20:02:40.422 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:40.416+0000 7f1811f1d640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f180c15bf70 0x7f180c15c400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:02:40.422 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:40.416+0000 7f1811f1d640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f180c15bf70 0x7f180c15c400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:50846/0 (socket says 172.21.15.78:50846) 2023-11-28T20:02:40.422 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:40.416+0000 7f1811f1d640 1 -- 172.21.15.78:0/2027951659 learned_addr learned my addr 172.21.15.78:0/2027951659 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T20:02:40.422 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:40.416+0000 7f181171c640 1 --2- 172.21.15.78:0/2027951659 >> v2:172.21.15.179:3300/0 conn(0x7f180c156200 0x7f180c0c0370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:02:40.422 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:40.416+0000 7f1810f1b640 1 --2- 172.21.15.78:0/2027951659 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f180c0c0e10 0x7f180c0c1b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:02:40.422 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:40.416+0000 7f1811f1d640 1 -- 172.21.15.78:0/2027951659 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f180c0c0e10 msgr2=0x7f180c0c1b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:02:40.422 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:40.416+0000 7f1811f1d640 1 --2- 172.21.15.78:0/2027951659 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f180c0c0e10 0x7f180c0c1b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:40.422 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:40.416+0000 7f1811f1d640 1 -- 172.21.15.78:0/2027951659 >> v2:172.21.15.179:3300/0 conn(0x7f180c156200 msgr2=0x7f180c0c0370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:02:40.422 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:40.416+0000 7f1811f1d640 1 --2- 172.21.15.78:0/2027951659 >> v2:172.21.15.179:3300/0 conn(0x7f180c156200 0x7f180c0c0370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:40.423 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:40.416+0000 7f1811f1d640 1 -- 172.21.15.78:0/2027951659 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f180c06bf30 con 0x7f180c15bf70 2023-11-28T20:02:40.423 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:40.416+0000 7f181171c640 1 --2- 172.21.15.78:0/2027951659 >> v2:172.21.15.179:3300/0 conn(0x7f180c156200 0x7f180c0c0370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T20:02:40.424 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:40.420+0000 7f1811f1d640 1 --2- 172.21.15.78:0/2027951659 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f180c15bf70 0x7f180c15c400 secure :-1 s=READY pgs=1019 cs=0 l=1 rev1=1 crypto rx=0x7f180c0c66a0 tx=0x7f180401c870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=27c8721b9255ba8e server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:02:40.425 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:40.420+0000 7f1803fff640 1 -- 172.21.15.78:0/2027951659 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18040a5640 con 0x7f180c15bf70 2023-11-28T20:02:40.425 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:40.420+0000 7f1803fff640 1 -- 172.21.15.78:0/2027951659 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f18040a57a0 con 0x7f180c15bf70 2023-11-28T20:02:40.425 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:40.420+0000 7f1803fff640 1 -- 172.21.15.78:0/2027951659 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18040a5b30 con 0x7f180c15bf70 2023-11-28T20:02:40.425 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:40.420+0000 7f1813980640 1 -- 172.21.15.78:0/2027951659 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f180c15bf70 msgr2=0x7f180c15c400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:02:40.426 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:40.420+0000 7f1813980640 1 --2- 172.21.15.78:0/2027951659 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f180c15bf70 0x7f180c15c400 secure :-1 s=READY pgs=1019 cs=0 l=1 rev1=1 crypto rx=0x7f180c0c66a0 tx=0x7f180401c870 comp rx=0 tx=0).stop 2023-11-28T20:02:40.426 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:40.420+0000 7f1813980640 1 -- 172.21.15.78:0/2027951659 shutdown_connections 2023-11-28T20:02:40.426 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:40.420+0000 7f1813980640 1 --2- 172.21.15.78:0/2027951659 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f180c15bf70 0x7f180c15c400 unknown :-1 s=CLOSED pgs=1019 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:40.426 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:40.420+0000 7f1813980640 1 --2- 172.21.15.78:0/2027951659 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f180c0c0e10 0x7f180c0c1b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:40.426 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:40.420+0000 7f1813980640 1 --2- 172.21.15.78:0/2027951659 >> v2:172.21.15.179:3300/0 conn(0x7f180c156200 0x7f180c0c0370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:40.426 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:40.420+0000 7f1813980640 1 -- 172.21.15.78:0/2027951659 >> 172.21.15.78:0/2027951659 conn(0x7f180c0c59f0 msgr2=0x7f180c0c5e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:02:40.426 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:40.420+0000 7f1813980640 1 -- 172.21.15.78:0/2027951659 shutdown_connections 2023-11-28T20:02:40.426 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:40.420+0000 7f1813980640 1 -- 172.21.15.78:0/2027951659 wait complete. 2023-11-28T20:02:40.427 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:40.424+0000 7f1813980640 1 Processor -- start 2023-11-28T20:02:40.427 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:40.424+0000 7f1813980640 1 -- start start 2023-11-28T20:02:40.429 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:40.424+0000 7f1813980640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f180c0c0e10 0x7f180c0c3950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:40.429 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:40.424+0000 7f1813980640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f180c156200 0x7f180c071330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:40.429 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:40.424+0000 7f1813980640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f180c15bf70 0x7f180c071870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:40.429 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:40.424+0000 7f1813980640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f180c14dfd0 con 0x7f180c0c0e10 2023-11-28T20:02:40.429 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:40.424+0000 7f1813980640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f180c1f4e50 con 0x7f180c156200 2023-11-28T20:02:40.430 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:40.424+0000 7f1813980640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f180c1f5130 con 0x7f180c15bf70 2023-11-28T20:02:40.430 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:40.424+0000 7f181171c640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f180c0c0e10 0x7f180c0c3950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:02:40.430 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:40.424+0000 7f181171c640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f180c0c0e10 0x7f180c0c3950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:50858/0 (socket says 172.21.15.78:50858) 2023-11-28T20:02:40.430 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:40.424+0000 7f181171c640 1 -- 172.21.15.78:0/2445111854 learned_addr learned my addr 172.21.15.78:0/2445111854 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T20:02:40.430 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:40.424+0000 7f1811f1d640 1 --2- 172.21.15.78:0/2445111854 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f180c15bf70 0x7f180c071870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:02:40.430 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:40.424+0000 7f1810f1b640 1 --2- 172.21.15.78:0/2445111854 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f180c156200 0x7f180c071330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:02:40.430 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:40.424+0000 7f181171c640 1 -- 172.21.15.78:0/2445111854 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f180c15bf70 msgr2=0x7f180c071870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:02:40.430 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:40.424+0000 7f181171c640 1 --2- 172.21.15.78:0/2445111854 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f180c15bf70 0x7f180c071870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:40.430 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:40.424+0000 7f181171c640 1 -- 172.21.15.78:0/2445111854 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f180c156200 msgr2=0x7f180c071330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:02:40.430 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:40.424+0000 7f181171c640 1 --2- 172.21.15.78:0/2445111854 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f180c156200 0x7f180c071330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:40.431 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:40.424+0000 7f181171c640 1 -- 172.21.15.78:0/2445111854 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1804009b30 con 0x7f180c0c0e10 2023-11-28T20:02:40.431 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:40.424+0000 7f1811f1d640 1 --2- 172.21.15.78:0/2445111854 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f180c15bf70 0x7f180c071870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T20:02:40.431 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:40.424+0000 7f181171c640 1 --2- 172.21.15.78:0/2445111854 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f180c0c0e10 0x7f180c0c3950 secure :-1 s=READY pgs=1020 cs=0 l=1 rev1=1 crypto rx=0x7f180800e810 tx=0x7f180800ecd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:02:40.431 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:40.424+0000 7f1801ffb640 1 -- 172.21.15.78:0/2445111854 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f180800c8d0 con 0x7f180c0c0e10 2023-11-28T20:02:40.431 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:40.424+0000 7f1801ffb640 1 -- 172.21.15.78:0/2445111854 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f180800ca30 con 0x7f180c0c0e10 2023-11-28T20:02:40.431 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:40.424+0000 7f1801ffb640 1 -- 172.21.15.78:0/2445111854 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f180800cde0 con 0x7f180c0c0e10 2023-11-28T20:02:40.431 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:40.424+0000 7f1813980640 1 -- 172.21.15.78:0/2445111854 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f180c14e290 con 0x7f180c0c0e10 2023-11-28T20:02:40.431 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:40.424+0000 7f1813980640 1 -- 172.21.15.78:0/2445111854 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f180c0ab040 con 0x7f180c0c0e10 2023-11-28T20:02:40.433 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:40.424+0000 7f1813980640 1 -- 172.21.15.78:0/2445111854 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f180c067630 con 0x7f180c0c0e10 2023-11-28T20:02:40.433 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:40.428+0000 7f1801ffb640 1 -- 172.21.15.78:0/2445111854 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f1808013410 con 0x7f180c0c0e10 2023-11-28T20:02:40.433 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:40.428+0000 7f1801ffb640 1 --2- 172.21.15.78:0/2445111854 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f17f00664a0 0x7f17f0068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:40.433 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:40.428+0000 7f1801ffb640 1 -- 172.21.15.78:0/2445111854 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6885+0+0 (secure 0 0 0) 0x7f18080841a0 con 0x7f180c0c0e10 2023-11-28T20:02:40.434 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:40.428+0000 7f1810f1b640 1 --2- 172.21.15.78:0/2445111854 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f17f00664a0 0x7f17f0068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:02:40.434 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:40.428+0000 7f1810f1b640 1 --2- 172.21.15.78:0/2445111854 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f17f00664a0 0x7f17f0068960 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f180c1632d0 tx=0x7f17fc008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:02:40.436 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:40.432+0000 7f1801ffb640 1 -- 172.21.15.78:0/2445111854 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f18080510e0 con 0x7f180c0c0e10 2023-11-28T20:02:40.586 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:40.580+0000 7f1813980640 1 -- 172.21.15.78:0/2445111854 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f180c0c6550 con 0x7f180c0c0e10 2023-11-28T20:02:40.587 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:40.584+0000 7f1801ffb640 1 -- 172.21.15.78:0/2445111854 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v85) v1 ==== 93+0+10 (secure 0 0 0) 0x7f1808054700 con 0x7f180c0c0e10 2023-11-28T20:02:40.587 INFO:teuthology.orchestra.run.smithi078.stdout:pg_num: 1 2023-11-28T20:02:40.589 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:40.584+0000 7f1813980640 1 -- 172.21.15.78:0/2445111854 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f17f00664a0 msgr2=0x7f17f0068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:02:40.589 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:40.584+0000 7f1813980640 1 --2- 172.21.15.78:0/2445111854 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f17f00664a0 0x7f17f0068960 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f180c1632d0 tx=0x7f17fc008040 comp rx=0 tx=0).stop 2023-11-28T20:02:40.589 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:40.584+0000 7f1813980640 1 -- 172.21.15.78:0/2445111854 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f180c0c0e10 msgr2=0x7f180c0c3950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:02:40.589 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:40.584+0000 7f1813980640 1 --2- 172.21.15.78:0/2445111854 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f180c0c0e10 0x7f180c0c3950 secure :-1 s=READY pgs=1020 cs=0 l=1 rev1=1 crypto rx=0x7f180800e810 tx=0x7f180800ecd0 comp rx=0 tx=0).stop 2023-11-28T20:02:40.590 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:40.584+0000 7f1813980640 1 -- 172.21.15.78:0/2445111854 shutdown_connections 2023-11-28T20:02:40.590 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:40.584+0000 7f1813980640 1 --2- 172.21.15.78:0/2445111854 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f17f00664a0 0x7f17f0068960 unknown :-1 s=CLOSED pgs=485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:40.590 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:40.584+0000 7f1813980640 1 --2- 172.21.15.78:0/2445111854 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f180c15bf70 0x7f180c071870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:40.590 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:40.584+0000 7f1813980640 1 --2- 172.21.15.78:0/2445111854 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f180c156200 0x7f180c071330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:40.590 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:40.584+0000 7f1813980640 1 --2- 172.21.15.78:0/2445111854 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f180c0c0e10 0x7f180c0c3950 unknown :-1 s=CLOSED pgs=1020 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:40.590 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:40.584+0000 7f1813980640 1 -- 172.21.15.78:0/2445111854 >> 172.21.15.78:0/2445111854 conn(0x7f180c0c59f0 msgr2=0x7f180c0c5e40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:02:40.590 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:40.584+0000 7f1813980640 1 -- 172.21.15.78:0/2445111854 shutdown_connections 2023-11-28T20:02:40.590 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:40.584+0000 7f1813980640 1 -- 172.21.15.78:0/2445111854 wait complete. 2023-11-28T20:02:40.608 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-28T20:02:40.747 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:40.740+0000 7fc24c780640 1 Processor -- start 2023-11-28T20:02:40.747 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:40.744+0000 7fc24c780640 1 -- start start 2023-11-28T20:02:40.748 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:40.744+0000 7fc24c780640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fc24414b1e0 0x7fc2440c1700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:40.748 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:40.744+0000 7fc24c780640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fc2440c5300 0x7fc2440a9c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:40.749 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:40.744+0000 7fc24c780640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc2440a4e20 con 0x7fc244151280 2023-11-28T20:02:40.749 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:40.744+0000 7fc24c780640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc2441558d0 con 0x7fc2440c5300 2023-11-28T20:02:40.749 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:40.744+0000 7fc24c780640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc2440a50e0 con 0x7fc24414b1e0 2023-11-28T20:02:40.749 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:40.744+0000 7fc249d1b640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fc2440c5300 0x7fc2440a9c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:02:40.749 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:40.744+0000 7fc24ad1d640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7fc244151280 0x7fc2441516f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:50008/0 (socket says 172.21.15.78:50008) 2023-11-28T20:02:40.749 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:40.744+0000 7fc24ad1d640 1 -- 172.21.15.78:0/3862621905 learned_addr learned my addr 172.21.15.78:0/3862621905 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-11-28T20:02:40.749 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:40.744+0000 7fc24a51c640 1 --2- 172.21.15.78:0/3862621905 >> v2:172.21.15.179:3300/0 conn(0x7fc24414b1e0 0x7fc2440c1700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:02:40.749 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:40.744+0000 7fc249d1b640 1 -- 172.21.15.78:0/3862621905 >> v2:172.21.15.179:3300/0 conn(0x7fc24414b1e0 msgr2=0x7fc2440c1700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:02:40.749 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:40.744+0000 7fc249d1b640 1 --2- 172.21.15.78:0/3862621905 >> v2:172.21.15.179:3300/0 conn(0x7fc24414b1e0 0x7fc2440c1700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:40.749 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:40.744+0000 7fc249d1b640 1 -- 172.21.15.78:0/3862621905 >> v1:172.21.15.78:6789/0 conn(0x7fc244151280 legacy=0x7fc2441516f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:02:40.749 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:40.744+0000 7fc249d1b640 1 -- 172.21.15.78:0/3862621905 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2440c0f00 con 0x7fc2440c5300 2023-11-28T20:02:40.751 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:40.748+0000 7fc249d1b640 1 --2- 172.21.15.78:0/3862621905 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc2440c5300 0x7fc2440a9c30 secure :-1 s=READY pgs=1022 cs=0 l=1 rev1=1 crypto rx=0x7fc2440c4150 tx=0x7fc23401e670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d7d10a0a5a93b466 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:02:40.752 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:40.748+0000 7fc24951a640 1 -- 172.21.15.78:0/3862621905 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2340af680 con 0x7fc2440c5300 2023-11-28T20:02:40.752 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:40.748+0000 7fc24951a640 1 -- 172.21.15.78:0/3862621905 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc2340af7e0 con 0x7fc2440c5300 2023-11-28T20:02:40.752 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:40.748+0000 7fc24951a640 1 -- 172.21.15.78:0/3862621905 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2340afb70 con 0x7fc2440c5300 2023-11-28T20:02:40.752 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:40.748+0000 7fc24c780640 1 -- 172.21.15.78:0/3862621905 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc2440c5300 msgr2=0x7fc2440a9c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:02:40.752 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:40.748+0000 7fc24c780640 1 --2- 172.21.15.78:0/3862621905 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc2440c5300 0x7fc2440a9c30 secure :-1 s=READY pgs=1022 cs=0 l=1 rev1=1 crypto rx=0x7fc2440c4150 tx=0x7fc23401e670 comp rx=0 tx=0).stop 2023-11-28T20:02:40.753 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:40.748+0000 7fc24c780640 1 -- 172.21.15.78:0/3862621905 shutdown_connections 2023-11-28T20:02:40.753 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:40.748+0000 7fc24c780640 1 --2- 172.21.15.78:0/3862621905 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc2440c5300 0x7fc2440a9c30 unknown :-1 s=CLOSED pgs=1022 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:40.753 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:40.748+0000 7fc24c780640 1 --2- 172.21.15.78:0/3862621905 >> v2:172.21.15.179:3300/0 conn(0x7fc24414b1e0 0x7fc2440c1700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:40.753 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:40.748+0000 7fc24c780640 1 -- 172.21.15.78:0/3862621905 >> 172.21.15.78:0/3862621905 conn(0x7fc2440c59f0 msgr2=0x7fc2440c5e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:02:40.753 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:40.748+0000 7fc24c780640 1 -- 172.21.15.78:0/3862621905 shutdown_connections 2023-11-28T20:02:40.753 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:40.748+0000 7fc24c780640 1 -- 172.21.15.78:0/3862621905 wait complete. 2023-11-28T20:02:40.754 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:40.748+0000 7fc24c780640 1 Processor -- start 2023-11-28T20:02:40.754 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:40.748+0000 7fc24c780640 1 -- start start 2023-11-28T20:02:40.756 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:40.752+0000 7fc24c780640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc2440c5300 0x7fc244072220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:40.756 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:40.752+0000 7fc24c780640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc24414b1e0 0x7fc244072760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:40.756 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:40.752+0000 7fc24c780640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc244151280 0x7fc244146610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:40.756 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:40.752+0000 7fc24c780640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2440a6830 con 0x7fc2440c5300 2023-11-28T20:02:40.757 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:40.752+0000 7fc24c780640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc244070ab0 con 0x7fc244151280 2023-11-28T20:02:40.757 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:40.752+0000 7fc24c780640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc2440a5f20 con 0x7fc24414b1e0 2023-11-28T20:02:40.757 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:40.752+0000 7fc24a51c640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc2440c5300 0x7fc244072220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:02:40.757 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:40.752+0000 7fc24a51c640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc2440c5300 0x7fc244072220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:50874/0 (socket says 172.21.15.78:50874) 2023-11-28T20:02:40.757 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:40.752+0000 7fc24a51c640 1 -- 172.21.15.78:0/1155038885 learned_addr learned my addr 172.21.15.78:0/1155038885 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T20:02:40.757 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:40.752+0000 7fc249d1b640 1 --2- 172.21.15.78:0/1155038885 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc24414b1e0 0x7fc244072760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:02:40.757 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:40.752+0000 7fc24ad1d640 1 --2- 172.21.15.78:0/1155038885 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc244151280 0x7fc244146610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:02:40.757 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:40.752+0000 7fc24a51c640 1 -- 172.21.15.78:0/1155038885 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc24414b1e0 msgr2=0x7fc244072760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:02:40.757 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:40.752+0000 7fc24a51c640 1 --2- 172.21.15.78:0/1155038885 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc24414b1e0 0x7fc244072760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:40.757 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:40.752+0000 7fc24a51c640 1 -- 172.21.15.78:0/1155038885 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc244151280 msgr2=0x7fc244146610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:02:40.757 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:40.752+0000 7fc24a51c640 1 --2- 172.21.15.78:0/1155038885 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc244151280 0x7fc244146610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:40.758 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:40.752+0000 7fc24a51c640 1 -- 172.21.15.78:0/1155038885 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc234009420 con 0x7fc2440c5300 2023-11-28T20:02:40.758 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:40.752+0000 7fc249d1b640 1 --2- 172.21.15.78:0/1155038885 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc24414b1e0 0x7fc244072760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T20:02:40.758 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:40.752+0000 7fc24a51c640 1 --2- 172.21.15.78:0/1155038885 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc2440c5300 0x7fc244072220 secure :-1 s=READY pgs=1023 cs=0 l=1 rev1=1 crypto rx=0x7fc24000d800 tx=0x7fc24000dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:02:40.758 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:40.752+0000 7fc23affd640 1 -- 172.21.15.78:0/1155038885 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc24000b6c0 con 0x7fc2440c5300 2023-11-28T20:02:40.758 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:40.752+0000 7fc23affd640 1 -- 172.21.15.78:0/1155038885 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc24000b820 con 0x7fc2440c5300 2023-11-28T20:02:40.758 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:40.752+0000 7fc24c780640 1 -- 172.21.15.78:0/1155038885 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc2440707d0 con 0x7fc2440c5300 2023-11-28T20:02:40.758 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:40.752+0000 7fc23affd640 1 -- 172.21.15.78:0/1155038885 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc24000bb90 con 0x7fc2440c5300 2023-11-28T20:02:40.758 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:40.752+0000 7fc24c780640 1 -- 172.21.15.78:0/1155038885 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc2440a6450 con 0x7fc2440c5300 2023-11-28T20:02:40.759 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:40.752+0000 7fc24c780640 1 -- 172.21.15.78:0/1155038885 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc244067630 con 0x7fc2440c5300 2023-11-28T20:02:40.759 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:40.752+0000 7fc23affd640 1 -- 172.21.15.78:0/1155038885 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fc24000bcf0 con 0x7fc2440c5300 2023-11-28T20:02:40.760 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:40.756+0000 7fc23affd640 1 --2- 172.21.15.78:0/1155038885 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fc228066470 0x7fc228068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:40.760 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:40.756+0000 7fc23affd640 1 -- 172.21.15.78:0/1155038885 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6885+0+0 (secure 0 0 0) 0x7fc2400847c0 con 0x7fc2440c5300 2023-11-28T20:02:40.760 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:40.756+0000 7fc249d1b640 1 --2- 172.21.15.78:0/1155038885 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fc228066470 0x7fc228068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:02:40.760 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:40.756+0000 7fc249d1b640 1 --2- 172.21.15.78:0/1155038885 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fc228066470 0x7fc228068930 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7fc2340b1000 tx=0x7fc234008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:02:40.763 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:40.760+0000 7fc23affd640 1 -- 172.21.15.78:0/1155038885 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fc240051830 con 0x7fc2440c5300 2023-11-28T20:02:40.917 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:40.912+0000 7fc24c780640 1 -- 172.21.15.78:0/1155038885 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fc24414a460 con 0x7fc2440c5300 2023-11-28T20:02:40.917 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:40.912+0000 7fc23affd640 1 -- 172.21.15.78:0/1155038885 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v85) v1 ==== 104+0+11 (secure 0 0 0) 0x7fc240054e50 con 0x7fc2440c5300 2023-11-28T20:02:40.917 INFO:teuthology.orchestra.run.smithi078.stdout:pg_num: 32 2023-11-28T20:02:40.919 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:40.916+0000 7fc24c780640 1 -- 172.21.15.78:0/1155038885 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fc228066470 msgr2=0x7fc228068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:02:40.919 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:40.916+0000 7fc24c780640 1 --2- 172.21.15.78:0/1155038885 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fc228066470 0x7fc228068930 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7fc2340b1000 tx=0x7fc234008040 comp rx=0 tx=0).stop 2023-11-28T20:02:40.919 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:40.916+0000 7fc24c780640 1 -- 172.21.15.78:0/1155038885 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc2440c5300 msgr2=0x7fc244072220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:02:40.919 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:40.916+0000 7fc24c780640 1 --2- 172.21.15.78:0/1155038885 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc2440c5300 0x7fc244072220 secure :-1 s=READY pgs=1023 cs=0 l=1 rev1=1 crypto rx=0x7fc24000d800 tx=0x7fc24000dcc0 comp rx=0 tx=0).stop 2023-11-28T20:02:40.920 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:40.916+0000 7fc24c780640 1 -- 172.21.15.78:0/1155038885 shutdown_connections 2023-11-28T20:02:40.920 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:40.916+0000 7fc24c780640 1 --2- 172.21.15.78:0/1155038885 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fc228066470 0x7fc228068930 unknown :-1 s=CLOSED pgs=486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:40.920 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:40.916+0000 7fc24c780640 1 --2- 172.21.15.78:0/1155038885 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc24414b1e0 0x7fc244072760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:40.920 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:40.916+0000 7fc24c780640 1 --2- 172.21.15.78:0/1155038885 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc244151280 0x7fc244146610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:40.920 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:40.916+0000 7fc24c780640 1 --2- 172.21.15.78:0/1155038885 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc2440c5300 0x7fc244072220 unknown :-1 s=CLOSED pgs=1023 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:40.920 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:40.916+0000 7fc24c780640 1 -- 172.21.15.78:0/1155038885 >> 172.21.15.78:0/1155038885 conn(0x7fc2440c59f0 msgr2=0x7fc2441516f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:02:40.920 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:40.916+0000 7fc24c780640 1 -- 172.21.15.78:0/1155038885 shutdown_connections 2023-11-28T20:02:40.920 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:40.916+0000 7fc24c780640 1 -- 172.21.15.78:0/1155038885 wait complete. 2023-11-28T20:02:40.938 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-28T20:02:41.078 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:41.072+0000 7face94f3640 1 Processor -- start 2023-11-28T20:02:41.078 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:41.072+0000 7face94f3640 1 -- start start 2023-11-28T20:02:41.079 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:41.076+0000 7face94f3640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7face41518b0 0x7face40bf600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:41.079 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:41.076+0000 7face94f3640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7face40c19f0 con 0x7face40664c0 2023-11-28T20:02:41.079 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:41.076+0000 7face94f3640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7face41552c0 con 0x7face40c0c40 2023-11-28T20:02:41.079 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:41.076+0000 7face94f3640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7face4154fe0 con 0x7face41518b0 2023-11-28T20:02:41.079 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:41.076+0000 7face3fff640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7face41518b0 0x7face40bf600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:02:41.079 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:41.076+0000 7face8cf2640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7face40664c0 0x7face415ed40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:50018/0 (socket says 172.21.15.78:50018) 2023-11-28T20:02:41.080 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:41.076+0000 7face8cf2640 1 -- 172.21.15.78:0/2790865352 learned_addr learned my addr 172.21.15.78:0/2790865352 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-11-28T20:02:41.080 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:41.076+0000 7face3fff640 1 -- 172.21.15.78:0/2790865352 >> v1:172.21.15.179:6789/0 conn(0x7face40c0c40 legacy=0x7face406a5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:02:41.080 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:41.076+0000 7face3fff640 1 -- 172.21.15.78:0/2790865352 >> v1:172.21.15.78:6789/0 conn(0x7face40664c0 legacy=0x7face415ed40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:02:41.080 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:41.076+0000 7face2ffd640 1 -- 172.21.15.78:0/2790865352 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3304652959 0 0) 0x7face40c19f0 con 0x7face40664c0 2023-11-28T20:02:41.080 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:41.076+0000 7face3fff640 1 -- 172.21.15.78:0/2790865352 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7face40c1680 con 0x7face41518b0 2023-11-28T20:02:41.083 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:41.076+0000 7face3fff640 1 --2- 172.21.15.78:0/2790865352 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7face41518b0 0x7face40bf600 secure :-1 s=READY pgs=1025 cs=0 l=1 rev1=1 crypto rx=0x7facd40097c0 tx=0x7facd401c320 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2df9fb7435f147f server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:02:41.083 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:41.080+0000 7face2ffd640 1 -- 172.21.15.78:0/2790865352 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facd40ab600 con 0x7face41518b0 2023-11-28T20:02:41.083 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:41.080+0000 7face2ffd640 1 -- 172.21.15.78:0/2790865352 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7facd40a7050 con 0x7face41518b0 2023-11-28T20:02:41.083 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:41.080+0000 7face2ffd640 1 -- 172.21.15.78:0/2790865352 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facd40ab980 con 0x7face41518b0 2023-11-28T20:02:41.084 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:41.080+0000 7face94f3640 1 -- 172.21.15.78:0/2790865352 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7face41518b0 msgr2=0x7face40bf600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:02:41.084 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:41.080+0000 7face94f3640 1 --2- 172.21.15.78:0/2790865352 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7face41518b0 0x7face40bf600 secure :-1 s=READY pgs=1025 cs=0 l=1 rev1=1 crypto rx=0x7facd40097c0 tx=0x7facd401c320 comp rx=0 tx=0).stop 2023-11-28T20:02:41.084 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:41.080+0000 7face94f3640 1 -- 172.21.15.78:0/2790865352 shutdown_connections 2023-11-28T20:02:41.084 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:41.080+0000 7face94f3640 1 --2- 172.21.15.78:0/2790865352 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7face41518b0 0x7face40bf600 unknown :-1 s=CLOSED pgs=1025 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:41.084 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:41.080+0000 7face94f3640 1 -- 172.21.15.78:0/2790865352 >> 172.21.15.78:0/2790865352 conn(0x7face40c2d40 msgr2=0x7face40c3150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:02:41.084 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:41.080+0000 7face94f3640 1 -- 172.21.15.78:0/2790865352 shutdown_connections 2023-11-28T20:02:41.084 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:41.080+0000 7face94f3640 1 -- 172.21.15.78:0/2790865352 wait complete. 2023-11-28T20:02:41.085 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:41.080+0000 7face94f3640 1 Processor -- start 2023-11-28T20:02:41.085 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:41.080+0000 7face94f3640 1 -- start start 2023-11-28T20:02:41.088 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:41.080+0000 7face94f3640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7face40664c0 0x7face41f05e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:41.088 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:41.080+0000 7face94f3640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7face40c0c40 0x7face4146ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:41.088 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:41.080+0000 7face94f3640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7face41518b0 0x7face40722a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:41.088 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:41.080+0000 7face94f3640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7face41565a0 con 0x7face40c0c40 2023-11-28T20:02:41.088 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:41.080+0000 7face94f3640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7face40aa9d0 con 0x7face41518b0 2023-11-28T20:02:41.088 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:41.080+0000 7face94f3640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7face40a9e50 con 0x7face40664c0 2023-11-28T20:02:41.089 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:41.080+0000 7face37fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7face40c0c40 0x7face4146ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:02:41.089 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:41.080+0000 7face37fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7face40c0c40 0x7face4146ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:50886/0 (socket says 172.21.15.78:50886) 2023-11-28T20:02:41.089 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:41.080+0000 7face37fe640 1 -- 172.21.15.78:0/2505759062 learned_addr learned my addr 172.21.15.78:0/2505759062 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T20:02:41.089 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:41.080+0000 7face3fff640 1 --2- 172.21.15.78:0/2505759062 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7face40664c0 0x7face41f05e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:02:41.089 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:41.080+0000 7face8cf2640 1 --2- 172.21.15.78:0/2505759062 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7face41518b0 0x7face40722a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:02:41.089 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:41.084+0000 7face37fe640 1 -- 172.21.15.78:0/2505759062 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7face40664c0 msgr2=0x7face41f05e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:02:41.089 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:41.084+0000 7face37fe640 1 --2- 172.21.15.78:0/2505759062 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7face40664c0 0x7face41f05e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:41.089 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:41.084+0000 7face37fe640 1 -- 172.21.15.78:0/2505759062 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7face41518b0 msgr2=0x7face40722a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:02:41.089 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:41.084+0000 7face37fe640 1 --2- 172.21.15.78:0/2505759062 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7face41518b0 0x7face40722a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:41.089 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:41.084+0000 7face37fe640 1 -- 172.21.15.78:0/2505759062 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7facd4009420 con 0x7face40c0c40 2023-11-28T20:02:41.089 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:41.084+0000 7face8cf2640 1 --2- 172.21.15.78:0/2505759062 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7face41518b0 0x7face40722a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T20:02:41.090 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:41.084+0000 7face37fe640 1 --2- 172.21.15.78:0/2505759062 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7face40c0c40 0x7face4146ae0 secure :-1 s=READY pgs=1026 cs=0 l=1 rev1=1 crypto rx=0x7facd800b410 tx=0x7facd800b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:02:41.090 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:41.084+0000 7face0ff9640 1 -- 172.21.15.78:0/2505759062 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facd8004020 con 0x7face40c0c40 2023-11-28T20:02:41.090 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:41.084+0000 7face0ff9640 1 -- 172.21.15.78:0/2505759062 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7facd8004180 con 0x7face40c0c40 2023-11-28T20:02:41.090 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:41.084+0000 7face0ff9640 1 -- 172.21.15.78:0/2505759062 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facd8011630 con 0x7face40c0c40 2023-11-28T20:02:41.090 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:41.084+0000 7face94f3640 1 -- 172.21.15.78:0/2505759062 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7face40aa130 con 0x7face40c0c40 2023-11-28T20:02:41.090 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:41.084+0000 7face94f3640 1 -- 172.21.15.78:0/2505759062 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7face40aa6f0 con 0x7face40c0c40 2023-11-28T20:02:41.091 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:41.084+0000 7face94f3640 1 -- 172.21.15.78:0/2505759062 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7face40674b0 con 0x7face40c0c40 2023-11-28T20:02:41.091 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:41.084+0000 7face0ff9640 1 -- 172.21.15.78:0/2505759062 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7facd8011790 con 0x7face40c0c40 2023-11-28T20:02:41.091 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:41.084+0000 7face0ff9640 1 --2- 172.21.15.78:0/2505759062 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7facd0066470 0x7facd0068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:41.091 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:41.088+0000 7face0ff9640 1 -- 172.21.15.78:0/2505759062 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6885+0+0 (secure 0 0 0) 0x7facd8083ff0 con 0x7face40c0c40 2023-11-28T20:02:41.091 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:41.088+0000 7face3fff640 1 --2- 172.21.15.78:0/2505759062 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7facd0066470 0x7facd0068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:02:41.091 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:41.088+0000 7face3fff640 1 --2- 172.21.15.78:0/2505759062 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7facd0066470 0x7facd0068930 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7face4072cf0 tx=0x7facd40a6000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:02:41.095 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:41.092+0000 7face0ff9640 1 -- 172.21.15.78:0/2505759062 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7facd80b5280 con 0x7face40c0c40 2023-11-28T20:02:41.247 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:41.240+0000 7face94f3640 1 -- 172.21.15.78:0/2505759062 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7face40662a0 con 0x7face40c0c40 2023-11-28T20:02:41.247 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:41.244+0000 7face0ff9640 1 -- 172.21.15.78:0/2505759062 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v85) v1 ==== 100+0+11 (secure 0 0 0) 0x7facd80150a0 con 0x7face40c0c40 2023-11-28T20:02:41.247 INFO:teuthology.orchestra.run.smithi078.stdout:pg_num: 64 2023-11-28T20:02:41.249 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:41.244+0000 7face94f3640 1 -- 172.21.15.78:0/2505759062 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7facd0066470 msgr2=0x7facd0068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:02:41.249 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:41.244+0000 7face94f3640 1 --2- 172.21.15.78:0/2505759062 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7facd0066470 0x7facd0068930 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7face4072cf0 tx=0x7facd40a6000 comp rx=0 tx=0).stop 2023-11-28T20:02:41.249 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:41.244+0000 7face94f3640 1 -- 172.21.15.78:0/2505759062 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7face40c0c40 msgr2=0x7face4146ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:02:41.249 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:41.244+0000 7face94f3640 1 --2- 172.21.15.78:0/2505759062 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7face40c0c40 0x7face4146ae0 secure :-1 s=READY pgs=1026 cs=0 l=1 rev1=1 crypto rx=0x7facd800b410 tx=0x7facd800b8d0 comp rx=0 tx=0).stop 2023-11-28T20:02:41.249 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:41.244+0000 7face94f3640 1 -- 172.21.15.78:0/2505759062 shutdown_connections 2023-11-28T20:02:41.249 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:41.244+0000 7face94f3640 1 --2- 172.21.15.78:0/2505759062 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7facd0066470 0x7facd0068930 unknown :-1 s=CLOSED pgs=487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:41.250 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:41.244+0000 7face94f3640 1 --2- 172.21.15.78:0/2505759062 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7face41518b0 0x7face40722a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:41.250 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:41.244+0000 7face94f3640 1 --2- 172.21.15.78:0/2505759062 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7face40c0c40 0x7face4146ae0 unknown :-1 s=CLOSED pgs=1026 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:41.250 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:41.244+0000 7face94f3640 1 --2- 172.21.15.78:0/2505759062 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7face40664c0 0x7face41f05e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:41.250 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:41.244+0000 7face94f3640 1 -- 172.21.15.78:0/2505759062 >> 172.21.15.78:0/2505759062 conn(0x7face40c2d40 msgr2=0x7face40c3120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:02:41.250 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:41.244+0000 7face94f3640 1 -- 172.21.15.78:0/2505759062 shutdown_connections 2023-11-28T20:02:41.250 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:41.244+0000 7face94f3640 1 -- 172.21.15.78:0/2505759062 wait complete. 2023-11-28T20:02:41.268 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs2_metadata pg_num 2023-11-28T20:02:41.408 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:41.404+0000 7fb325d2a640 1 Processor -- start 2023-11-28T20:02:41.408 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:41.404+0000 7fb325d2a640 1 -- start start 2023-11-28T20:02:41.409 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:41.404+0000 7fb325d2a640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fb32014f850 0x7fb3200aacf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:41.409 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:41.404+0000 7fb325d2a640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb320152910 con 0x7fb32006d840 2023-11-28T20:02:41.409 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:41.404+0000 7fb325d2a640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb320152bf0 con 0x7fb32014fc30 2023-11-28T20:02:41.409 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:41.404+0000 7fb325d2a640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb3200c2240 con 0x7fb32014f850 2023-11-28T20:02:41.409 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:41.404+0000 7fb31f7fe640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fb32014f850 0x7fb3200aacf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:02:41.409 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:41.404+0000 7fb31ffff640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7fb32006d840 0x7fb3200c43e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:50022/0 (socket says 172.21.15.78:50022) 2023-11-28T20:02:41.410 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:41.404+0000 7fb31ffff640 1 -- 172.21.15.78:0/1404619461 learned_addr learned my addr 172.21.15.78:0/1404619461 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-11-28T20:02:41.410 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:41.404+0000 7fb31f7fe640 1 -- 172.21.15.78:0/1404619461 >> v1:172.21.15.179:6789/0 conn(0x7fb32014fc30 legacy=0x7fb3200c3cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:02:41.410 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:41.404+0000 7fb31f7fe640 1 -- 172.21.15.78:0/1404619461 >> v1:172.21.15.78:6789/0 conn(0x7fb32006d840 legacy=0x7fb3200c43e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:02:41.410 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:41.404+0000 7fb31f7fe640 1 -- 172.21.15.78:0/1404619461 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb320152ed0 con 0x7fb32014f850 2023-11-28T20:02:41.412 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:41.408+0000 7fb31f7fe640 1 --2- 172.21.15.78:0/1404619461 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb32014f850 0x7fb3200aacf0 secure :-1 s=READY pgs=1028 cs=0 l=1 rev1=1 crypto rx=0x7fb3100097c0 tx=0x7fb31001c3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1726eedb9d7bb759 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:02:41.413 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:41.408+0000 7fb31e7fc640 1 -- 172.21.15.78:0/1404619461 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3100ac630 con 0x7fb32014f850 2023-11-28T20:02:41.413 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:41.408+0000 7fb31e7fc640 1 -- 172.21.15.78:0/1404619461 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb3100ac790 con 0x7fb32014f850 2023-11-28T20:02:41.413 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:41.408+0000 7fb31e7fc640 1 -- 172.21.15.78:0/1404619461 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3100acb20 con 0x7fb32014f850 2023-11-28T20:02:41.415 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:41.408+0000 7fb325d2a640 1 -- 172.21.15.78:0/1404619461 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb32014f850 msgr2=0x7fb3200aacf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:02:41.415 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:41.408+0000 7fb325d2a640 1 --2- 172.21.15.78:0/1404619461 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb32014f850 0x7fb3200aacf0 secure :-1 s=READY pgs=1028 cs=0 l=1 rev1=1 crypto rx=0x7fb3100097c0 tx=0x7fb31001c3b0 comp rx=0 tx=0).stop 2023-11-28T20:02:41.415 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:41.408+0000 7fb325d2a640 1 -- 172.21.15.78:0/1404619461 shutdown_connections 2023-11-28T20:02:41.415 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:41.408+0000 7fb325d2a640 1 --2- 172.21.15.78:0/1404619461 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb32014f850 0x7fb3200aacf0 unknown :-1 s=CLOSED pgs=1028 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:41.415 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:41.408+0000 7fb325d2a640 1 -- 172.21.15.78:0/1404619461 >> 172.21.15.78:0/1404619461 conn(0x7fb3200c59f0 msgr2=0x7fb3200c5e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:02:41.415 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:41.408+0000 7fb325d2a640 1 -- 172.21.15.78:0/1404619461 shutdown_connections 2023-11-28T20:02:41.416 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:41.408+0000 7fb325d2a640 1 -- 172.21.15.78:0/1404619461 wait complete. 2023-11-28T20:02:41.416 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:41.412+0000 7fb325d2a640 1 Processor -- start 2023-11-28T20:02:41.418 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:41.412+0000 7fb325d2a640 1 -- start start 2023-11-28T20:02:41.418 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:41.412+0000 7fb325d2a640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb32006d840 0x7fb32014c850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:41.418 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:41.412+0000 7fb325d2a640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb32014f850 0x7fb3201eeb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:41.418 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:41.412+0000 7fb325d2a640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb32014fc30 0x7fb3201ef0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:41.418 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:41.412+0000 7fb325d2a640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb320071620 con 0x7fb32006d840 2023-11-28T20:02:41.418 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:41.412+0000 7fb325d2a640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb320071e60 con 0x7fb32014f850 2023-11-28T20:02:41.418 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:41.412+0000 7fb325d2a640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb3201ef600 con 0x7fb32014fc30 2023-11-28T20:02:41.418 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:41.412+0000 7fb31f7fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb32006d840 0x7fb32014c850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:02:41.418 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:41.412+0000 7fb31f7fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb32006d840 0x7fb32014c850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:50902/0 (socket says 172.21.15.78:50902) 2023-11-28T20:02:41.418 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:41.412+0000 7fb31f7fe640 1 -- 172.21.15.78:0/217071203 learned_addr learned my addr 172.21.15.78:0/217071203 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T20:02:41.419 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:41.412+0000 7fb31ffff640 1 --2- 172.21.15.78:0/217071203 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb32014fc30 0x7fb3201ef0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:02:41.419 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:41.412+0000 7fb31effd640 1 --2- 172.21.15.78:0/217071203 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb32014f850 0x7fb3201eeb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:02:41.419 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:41.412+0000 7fb31f7fe640 1 -- 172.21.15.78:0/217071203 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb32014fc30 msgr2=0x7fb3201ef0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:02:41.419 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:41.412+0000 7fb31f7fe640 1 --2- 172.21.15.78:0/217071203 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb32014fc30 0x7fb3201ef0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:41.419 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:41.412+0000 7fb31f7fe640 1 -- 172.21.15.78:0/217071203 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb32014f850 msgr2=0x7fb3201eeb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:02:41.419 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:41.412+0000 7fb31f7fe640 1 --2- 172.21.15.78:0/217071203 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb32014f850 0x7fb3201eeb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:41.419 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:41.412+0000 7fb31f7fe640 1 -- 172.21.15.78:0/217071203 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb310009420 con 0x7fb32006d840 2023-11-28T20:02:41.419 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:41.412+0000 7fb31ffff640 1 --2- 172.21.15.78:0/217071203 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb32014fc30 0x7fb3201ef0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T20:02:41.419 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:41.412+0000 7fb31f7fe640 1 --2- 172.21.15.78:0/217071203 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb32006d840 0x7fb32014c850 secure :-1 s=READY pgs=1029 cs=0 l=1 rev1=1 crypto rx=0x7fb310018fc0 tx=0x7fb310019150 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:02:41.419 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:41.412+0000 7fb307fff640 1 -- 172.21.15.78:0/217071203 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3100b5610 con 0x7fb32006d840 2023-11-28T20:02:41.419 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:41.412+0000 7fb307fff640 1 -- 172.21.15.78:0/217071203 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb3100b5790 con 0x7fb32006d840 2023-11-28T20:02:41.419 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:41.412+0000 7fb307fff640 1 -- 172.21.15.78:0/217071203 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3100b5b40 con 0x7fb32006d840 2023-11-28T20:02:41.420 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:41.412+0000 7fb325d2a640 1 -- 172.21.15.78:0/217071203 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb320071850 con 0x7fb32006d840 2023-11-28T20:02:41.420 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:41.412+0000 7fb325d2a640 1 -- 172.21.15.78:0/217071203 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb32014f5f0 con 0x7fb32006d840 2023-11-28T20:02:41.420 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:41.416+0000 7fb325d2a640 1 -- 172.21.15.78:0/217071203 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb320067630 con 0x7fb32006d840 2023-11-28T20:02:41.421 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:41.416+0000 7fb307fff640 1 -- 172.21.15.78:0/217071203 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fb3100b3040 con 0x7fb32006d840 2023-11-28T20:02:41.421 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:41.416+0000 7fb307fff640 1 --2- 172.21.15.78:0/217071203 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fb30c066470 0x7fb30c068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:41.421 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:41.416+0000 7fb307fff640 1 -- 172.21.15.78:0/217071203 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6885+0+0 (secure 0 0 0) 0x7fb31011e620 con 0x7fb32006d840 2023-11-28T20:02:41.421 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:41.416+0000 7fb31effd640 1 --2- 172.21.15.78:0/217071203 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fb30c066470 0x7fb30c068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:02:41.421 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:41.416+0000 7fb31effd640 1 --2- 172.21.15.78:0/217071203 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fb30c066470 0x7fb30c068930 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7fb320072680 tx=0x7fb314008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:02:41.424 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:41.420+0000 7fb307fff640 1 -- 172.21.15.78:0/217071203 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fb3100eb570 con 0x7fb32006d840 2023-11-28T20:02:41.573 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:41.568+0000 7fb325d2a640 1 -- 172.21.15.78:0/217071203 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs2_metadata", "var": "pg_num"} v 0) v1 -- 0x7fb3201526d0 con 0x7fb32006d840 2023-11-28T20:02:41.574 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:41.568+0000 7fb307fff640 1 -- 172.21.15.78:0/217071203 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs2_metadata", "var": "pg_num"}]=0 v85) v1 ==== 105+0+11 (secure 0 0 0) 0x7fb3201526d0 con 0x7fb32006d840 2023-11-28T20:02:41.574 INFO:teuthology.orchestra.run.smithi078.stdout:pg_num: 32 2023-11-28T20:02:41.576 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:41.572+0000 7fb325d2a640 1 -- 172.21.15.78:0/217071203 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fb30c066470 msgr2=0x7fb30c068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:02:41.576 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:41.572+0000 7fb325d2a640 1 --2- 172.21.15.78:0/217071203 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fb30c066470 0x7fb30c068930 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7fb320072680 tx=0x7fb314008040 comp rx=0 tx=0).stop 2023-11-28T20:02:41.576 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:41.572+0000 7fb325d2a640 1 -- 172.21.15.78:0/217071203 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb32006d840 msgr2=0x7fb32014c850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:02:41.576 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:41.572+0000 7fb325d2a640 1 --2- 172.21.15.78:0/217071203 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb32006d840 0x7fb32014c850 secure :-1 s=READY pgs=1029 cs=0 l=1 rev1=1 crypto rx=0x7fb310018fc0 tx=0x7fb310019150 comp rx=0 tx=0).stop 2023-11-28T20:02:41.576 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:41.572+0000 7fb325d2a640 1 -- 172.21.15.78:0/217071203 shutdown_connections 2023-11-28T20:02:41.576 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:41.572+0000 7fb325d2a640 1 --2- 172.21.15.78:0/217071203 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fb30c066470 0x7fb30c068930 unknown :-1 s=CLOSED pgs=488 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:41.577 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:41.572+0000 7fb325d2a640 1 --2- 172.21.15.78:0/217071203 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb32014fc30 0x7fb3201ef0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:41.577 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:41.572+0000 7fb325d2a640 1 --2- 172.21.15.78:0/217071203 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb32014f850 0x7fb3201eeb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:41.577 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:41.572+0000 7fb325d2a640 1 --2- 172.21.15.78:0/217071203 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb32006d840 0x7fb32014c850 unknown :-1 s=CLOSED pgs=1029 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:41.577 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:41.572+0000 7fb325d2a640 1 -- 172.21.15.78:0/217071203 >> 172.21.15.78:0/217071203 conn(0x7fb3200c59f0 msgr2=0x7fb32015d110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:02:41.577 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:41.572+0000 7fb325d2a640 1 -- 172.21.15.78:0/217071203 shutdown_connections 2023-11-28T20:02:41.577 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:41.572+0000 7fb325d2a640 1 -- 172.21.15.78:0/217071203 wait complete. 2023-11-28T20:02:41.596 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs2_data pg_num 2023-11-28T20:02:41.736 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:41.732+0000 7fd596ce3640 1 Processor -- start 2023-11-28T20:02:41.736 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:41.732+0000 7fd596ce3640 1 -- start start 2023-11-28T20:02:41.737 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:41.732+0000 7fd596ce3640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fd59014b1e0 0x7fd5900c1700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:41.738 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:41.732+0000 7fd596ce3640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd5900a4e20 con 0x7fd5900c5300 2023-11-28T20:02:41.738 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:41.732+0000 7fd596ce3640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd5900a50e0 con 0x7fd5901548c0 2023-11-28T20:02:41.738 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:41.732+0000 7fd596ce3640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd5900c0f00 con 0x7fd59014b1e0 2023-11-28T20:02:41.738 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:41.732+0000 7fd594a7f640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fd59014b1e0 0x7fd5900c1700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:02:41.738 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:41.732+0000 7fd587fff640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7fd5900c5300 0x7fd5900a9c30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:50030/0 (socket says 172.21.15.78:50030) 2023-11-28T20:02:41.738 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:41.732+0000 7fd587fff640 1 -- 172.21.15.78:0/472649341 learned_addr learned my addr 172.21.15.78:0/472649341 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-11-28T20:02:41.738 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:41.732+0000 7fd594a7f640 1 -- 172.21.15.78:0/472649341 >> v1:172.21.15.179:6789/0 conn(0x7fd5901548c0 legacy=0x7fd590154d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:02:41.738 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:41.732+0000 7fd594a7f640 1 -- 172.21.15.78:0/472649341 >> v1:172.21.15.78:6789/0 conn(0x7fd5900c5300 legacy=0x7fd5900a9c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:02:41.738 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:41.732+0000 7fd594a7f640 1 -- 172.21.15.78:0/472649341 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5900c11e0 con 0x7fd59014b1e0 2023-11-28T20:02:41.738 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:41.732+0000 7fd5877fe640 1 -- 172.21.15.78:0/472649341 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2496492721 0 0) 0x7fd5900a4e20 con 0x7fd5900c5300 2023-11-28T20:02:41.740 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:41.736+0000 7fd594a7f640 1 --2- 172.21.15.78:0/472649341 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd59014b1e0 0x7fd5900c1700 secure :-1 s=READY pgs=1031 cs=0 l=1 rev1=1 crypto rx=0x7fd58c0097c0 tx=0x7fd58c01c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=86052a6d62365f85 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:02:41.741 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:41.736+0000 7fd5877fe640 1 -- 172.21.15.78:0/472649341 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd58c0ab600 con 0x7fd59014b1e0 2023-11-28T20:02:41.741 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:41.736+0000 7fd5877fe640 1 -- 172.21.15.78:0/472649341 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd58c0a7050 con 0x7fd59014b1e0 2023-11-28T20:02:41.741 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:41.736+0000 7fd5877fe640 1 -- 172.21.15.78:0/472649341 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd58c0ab980 con 0x7fd59014b1e0 2023-11-28T20:02:41.742 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:41.736+0000 7fd596ce3640 1 -- 172.21.15.78:0/472649341 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd59014b1e0 msgr2=0x7fd5900c1700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:02:41.742 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:41.736+0000 7fd596ce3640 1 --2- 172.21.15.78:0/472649341 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd59014b1e0 0x7fd5900c1700 secure :-1 s=READY pgs=1031 cs=0 l=1 rev1=1 crypto rx=0x7fd58c0097c0 tx=0x7fd58c01c480 comp rx=0 tx=0).stop 2023-11-28T20:02:41.742 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:41.736+0000 7fd596ce3640 1 -- 172.21.15.78:0/472649341 shutdown_connections 2023-11-28T20:02:41.742 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:41.736+0000 7fd596ce3640 1 --2- 172.21.15.78:0/472649341 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd59014b1e0 0x7fd5900c1700 unknown :-1 s=CLOSED pgs=1031 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:41.742 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:41.736+0000 7fd596ce3640 1 -- 172.21.15.78:0/472649341 >> 172.21.15.78:0/472649341 conn(0x7fd5900c59f0 msgr2=0x7fd5900c5e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:02:41.742 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:41.736+0000 7fd596ce3640 1 -- 172.21.15.78:0/472649341 shutdown_connections 2023-11-28T20:02:41.742 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:41.736+0000 7fd596ce3640 1 -- 172.21.15.78:0/472649341 wait complete. 2023-11-28T20:02:41.743 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:41.740+0000 7fd596ce3640 1 Processor -- start 2023-11-28T20:02:41.743 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:41.740+0000 7fd596ce3640 1 -- start start 2023-11-28T20:02:41.749 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:41.740+0000 7fd596ce3640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd5900c5300 0x7fd590142710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:41.749 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:41.740+0000 7fd596ce3640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd59014b1e0 0x7fd59006b970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:41.749 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:41.740+0000 7fd596ce3640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd5901548c0 0x7fd59006beb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:41.749 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:41.740+0000 7fd596ce3640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5900a6060 con 0x7fd5900c5300 2023-11-28T20:02:41.750 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:41.740+0000 7fd596ce3640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd590153870 con 0x7fd59014b1e0 2023-11-28T20:02:41.750 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:41.740+0000 7fd596ce3640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd5900a56c0 con 0x7fd5901548c0 2023-11-28T20:02:41.750 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:41.740+0000 7fd594a7f640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd5900c5300 0x7fd590142710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:02:41.750 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:41.740+0000 7fd594a7f640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd5900c5300 0x7fd590142710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:50924/0 (socket says 172.21.15.78:50924) 2023-11-28T20:02:41.750 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:41.740+0000 7fd594a7f640 1 -- 172.21.15.78:0/28133375 learned_addr learned my addr 172.21.15.78:0/28133375 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T20:02:41.750 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:41.740+0000 7fd587fff640 1 --2- 172.21.15.78:0/28133375 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd59014b1e0 0x7fd59006b970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:02:41.751 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:41.740+0000 7fd595280640 1 --2- 172.21.15.78:0/28133375 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd5901548c0 0x7fd59006beb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:02:41.751 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:41.740+0000 7fd594a7f640 1 -- 172.21.15.78:0/28133375 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd5901548c0 msgr2=0x7fd59006beb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:02:41.751 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:41.740+0000 7fd594a7f640 1 --2- 172.21.15.78:0/28133375 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd5901548c0 0x7fd59006beb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:41.751 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:41.740+0000 7fd594a7f640 1 -- 172.21.15.78:0/28133375 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd59014b1e0 msgr2=0x7fd59006b970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:02:41.751 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:41.740+0000 7fd594a7f640 1 --2- 172.21.15.78:0/28133375 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd59014b1e0 0x7fd59006b970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:41.751 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:41.740+0000 7fd594a7f640 1 -- 172.21.15.78:0/28133375 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd58c009420 con 0x7fd5900c5300 2023-11-28T20:02:41.752 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:41.740+0000 7fd594a7f640 1 --2- 172.21.15.78:0/28133375 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd5900c5300 0x7fd590142710 secure :-1 s=READY pgs=1032 cs=0 l=1 rev1=1 crypto rx=0x7fd58c0ae040 tx=0x7fd58c01acc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:02:41.752 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:41.740+0000 7fd5857fa640 1 -- 172.21.15.78:0/28133375 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd58c0b7650 con 0x7fd5900c5300 2023-11-28T20:02:41.752 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:41.740+0000 7fd5857fa640 1 -- 172.21.15.78:0/28133375 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd58c0b77b0 con 0x7fd5900c5300 2023-11-28T20:02:41.752 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:41.740+0000 7fd5857fa640 1 -- 172.21.15.78:0/28133375 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd58c0b7b60 con 0x7fd5900c5300 2023-11-28T20:02:41.752 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:41.740+0000 7fd596ce3640 1 -- 172.21.15.78:0/28133375 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd5900a59a0 con 0x7fd5900c5300 2023-11-28T20:02:41.752 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:41.740+0000 7fd596ce3640 1 -- 172.21.15.78:0/28133375 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd5900a7100 con 0x7fd5900c5300 2023-11-28T20:02:41.752 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:41.740+0000 7fd596ce3640 1 -- 172.21.15.78:0/28133375 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd5900a6380 con 0x7fd5900c5300 2023-11-28T20:02:41.753 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:41.744+0000 7fd5857fa640 1 -- 172.21.15.78:0/28133375 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fd58c0b7cc0 con 0x7fd5900c5300 2023-11-28T20:02:41.753 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:41.744+0000 7fd5857fa640 1 --2- 172.21.15.78:0/28133375 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fd57c0664a0 0x7fd57c068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:41.753 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:41.744+0000 7fd5857fa640 1 -- 172.21.15.78:0/28133375 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6885+0+0 (secure 0 0 0) 0x7fd58c11ec10 con 0x7fd5900c5300 2023-11-28T20:02:41.753 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:41.744+0000 7fd587fff640 1 --2- 172.21.15.78:0/28133375 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fd57c0664a0 0x7fd57c068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:02:41.754 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:41.744+0000 7fd587fff640 1 --2- 172.21.15.78:0/28133375 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fd57c0664a0 0x7fd57c068960 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7fd580007fd0 tx=0x7fd580007ba0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:02:41.754 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:41.748+0000 7fd5857fa640 1 -- 172.21.15.78:0/28133375 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fd58c0ebda0 con 0x7fd5900c5300 2023-11-28T20:02:41.906 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:41.900+0000 7fd596ce3640 1 -- 172.21.15.78:0/28133375 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs2_data", "var": "pg_num"} v 0) v1 -- 0x7fd5900a61a0 con 0x7fd5900c5300 2023-11-28T20:02:41.906 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:41.900+0000 7fd5857fa640 1 -- 172.21.15.78:0/28133375 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs2_data", "var": "pg_num"}]=0 v85) v1 ==== 101+0+11 (secure 0 0 0) 0x7fd5900a61a0 con 0x7fd5900c5300 2023-11-28T20:02:41.906 INFO:teuthology.orchestra.run.smithi078.stdout:pg_num: 64 2023-11-28T20:02:41.908 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:41.904+0000 7fd596ce3640 1 -- 172.21.15.78:0/28133375 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fd57c0664a0 msgr2=0x7fd57c068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:02:41.908 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:41.904+0000 7fd596ce3640 1 --2- 172.21.15.78:0/28133375 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fd57c0664a0 0x7fd57c068960 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7fd580007fd0 tx=0x7fd580007ba0 comp rx=0 tx=0).stop 2023-11-28T20:02:41.908 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:41.904+0000 7fd596ce3640 1 -- 172.21.15.78:0/28133375 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd5900c5300 msgr2=0x7fd590142710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:02:41.908 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:41.904+0000 7fd596ce3640 1 --2- 172.21.15.78:0/28133375 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd5900c5300 0x7fd590142710 secure :-1 s=READY pgs=1032 cs=0 l=1 rev1=1 crypto rx=0x7fd58c0ae040 tx=0x7fd58c01acc0 comp rx=0 tx=0).stop 2023-11-28T20:02:41.908 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:41.904+0000 7fd596ce3640 1 -- 172.21.15.78:0/28133375 shutdown_connections 2023-11-28T20:02:41.909 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:41.904+0000 7fd596ce3640 1 --2- 172.21.15.78:0/28133375 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fd57c0664a0 0x7fd57c068960 unknown :-1 s=CLOSED pgs=489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:41.909 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:41.904+0000 7fd596ce3640 1 --2- 172.21.15.78:0/28133375 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd5901548c0 0x7fd59006beb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:41.909 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:41.904+0000 7fd596ce3640 1 --2- 172.21.15.78:0/28133375 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd59014b1e0 0x7fd59006b970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:41.909 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:41.904+0000 7fd596ce3640 1 --2- 172.21.15.78:0/28133375 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd5900c5300 0x7fd590142710 unknown :-1 s=CLOSED pgs=1032 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:41.909 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:41.904+0000 7fd596ce3640 1 -- 172.21.15.78:0/28133375 >> 172.21.15.78:0/28133375 conn(0x7fd5900c59f0 msgr2=0x7fd590147a70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:02:41.909 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:41.904+0000 7fd596ce3640 1 -- 172.21.15.78:0/28133375 shutdown_connections 2023-11-28T20:02:41.909 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:41.904+0000 7fd596ce3640 1 -- 172.21.15.78:0/28133375 wait complete. 2023-11-28T20:02:41.927 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-11-28T20:02:42.067 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:42.060+0000 7ffad87aa640 1 Processor -- start 2023-11-28T20:02:42.067 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:42.064+0000 7ffad87aa640 1 -- start start 2023-11-28T20:02:42.068 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:42.064+0000 7ffad87aa640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7ffad00a4f90 0x7ffad00c59c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:42.068 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:42.064+0000 7ffad87aa640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffad01524b0 con 0x7ffad00a5370 2023-11-28T20:02:42.068 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:42.064+0000 7ffad87aa640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffad00c62f0 con 0x7ffad0072810 2023-11-28T20:02:42.068 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:42.064+0000 7ffad87aa640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffad0152770 con 0x7ffad00a4f90 2023-11-28T20:02:42.068 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:42.064+0000 7ffad6546640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7ffad00a4f90 0x7ffad00c59c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:02:42.069 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:42.064+0000 7ffad6546640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7ffad00a4f90 0x7ffad00c59c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:50930/0 (socket says 172.21.15.78:50930) 2023-11-28T20:02:42.069 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:42.064+0000 7ffad6546640 1 -- 172.21.15.78:0/2826811020 learned_addr learned my addr 172.21.15.78:0/2826811020 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T20:02:42.069 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:42.064+0000 7ffad6546640 1 -- 172.21.15.78:0/2826811020 >> v1:172.21.15.179:6789/0 conn(0x7ffad0072810 legacy=0x7ffad00c0800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:02:42.069 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:42.064+0000 7ffad6546640 1 -- 172.21.15.78:0/2826811020 >> v1:172.21.15.78:6789/0 conn(0x7ffad00a5370 legacy=0x7ffad014f870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:02:42.069 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:42.064+0000 7ffad6546640 1 -- 172.21.15.78:0/2826811020 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffad0152a50 con 0x7ffad00a4f90 2023-11-28T20:02:42.071 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:42.068+0000 7ffad6546640 1 --2- 172.21.15.78:0/2826811020 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ffad00a4f90 0x7ffad00c59c0 secure :-1 s=READY pgs=1034 cs=0 l=1 rev1=1 crypto rx=0x7ffad01526a0 tx=0x7ffacc01c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=676bb8c004af59d4 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:02:42.072 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:42.068+0000 7ffad5544640 1 -- 172.21.15.78:0/2826811020 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffacc0ab600 con 0x7ffad00a4f90 2023-11-28T20:02:42.072 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:42.068+0000 7ffad5544640 1 -- 172.21.15.78:0/2826811020 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffacc0a7050 con 0x7ffad00a4f90 2023-11-28T20:02:42.072 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:42.068+0000 7ffad5544640 1 -- 172.21.15.78:0/2826811020 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffacc0ab980 con 0x7ffad00a4f90 2023-11-28T20:02:42.073 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:42.068+0000 7ffad87aa640 1 -- 172.21.15.78:0/2826811020 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ffad00a4f90 msgr2=0x7ffad00c59c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:02:42.073 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:42.068+0000 7ffad87aa640 1 --2- 172.21.15.78:0/2826811020 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ffad00a4f90 0x7ffad00c59c0 secure :-1 s=READY pgs=1034 cs=0 l=1 rev1=1 crypto rx=0x7ffad01526a0 tx=0x7ffacc01c490 comp rx=0 tx=0).stop 2023-11-28T20:02:42.073 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:42.068+0000 7ffad87aa640 1 -- 172.21.15.78:0/2826811020 shutdown_connections 2023-11-28T20:02:42.073 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:42.068+0000 7ffad87aa640 1 --2- 172.21.15.78:0/2826811020 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ffad00a4f90 0x7ffad00c59c0 unknown :-1 s=CLOSED pgs=1034 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:42.073 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:42.068+0000 7ffad87aa640 1 -- 172.21.15.78:0/2826811020 >> 172.21.15.78:0/2826811020 conn(0x7ffad006b220 msgr2=0x7ffad00a77e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:02:42.073 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:42.068+0000 7ffad87aa640 1 -- 172.21.15.78:0/2826811020 shutdown_connections 2023-11-28T20:02:42.073 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:42.068+0000 7ffad87aa640 1 -- 172.21.15.78:0/2826811020 wait complete. 2023-11-28T20:02:42.074 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:42.068+0000 7ffad87aa640 1 Processor -- start 2023-11-28T20:02:42.074 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:42.068+0000 7ffad87aa640 1 -- start start 2023-11-28T20:02:42.077 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:42.072+0000 7ffad87aa640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ffad0072810 0x7ffad014cb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:42.077 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:42.072+0000 7ffad87aa640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ffad00a4f90 0x7ffad00a77c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:42.077 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:42.072+0000 7ffad87aa640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ffad00a5370 0x7ffad014f600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:42.078 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:42.072+0000 7ffad87aa640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffad00c0000 con 0x7ffad0072810 2023-11-28T20:02:42.078 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:42.072+0000 7ffad87aa640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffad014d040 con 0x7ffad00a5370 2023-11-28T20:02:42.078 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:42.072+0000 7ffad87aa640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffad00a8ff0 con 0x7ffad00a4f90 2023-11-28T20:02:42.078 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:42.072+0000 7ffad6546640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ffad0072810 0x7ffad014cb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:02:42.078 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:42.072+0000 7ffad6546640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ffad0072810 0x7ffad014cb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:50934/0 (socket says 172.21.15.78:50934) 2023-11-28T20:02:42.078 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:42.072+0000 7ffad6546640 1 -- 172.21.15.78:0/3187524260 learned_addr learned my addr 172.21.15.78:0/3187524260 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T20:02:42.078 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:42.072+0000 7ffad6d47640 1 --2- 172.21.15.78:0/3187524260 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ffad00a5370 0x7ffad014f600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:02:42.078 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:42.072+0000 7ffad5d45640 1 --2- 172.21.15.78:0/3187524260 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ffad00a4f90 0x7ffad00a77c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:02:42.078 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:42.072+0000 7ffad6546640 1 -- 172.21.15.78:0/3187524260 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ffad00a4f90 msgr2=0x7ffad00a77c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:02:42.078 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:42.072+0000 7ffad6546640 1 --2- 172.21.15.78:0/3187524260 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ffad00a4f90 0x7ffad00a77c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:42.078 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:42.072+0000 7ffad6546640 1 -- 172.21.15.78:0/3187524260 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ffad00a5370 msgr2=0x7ffad014f600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:02:42.078 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:42.072+0000 7ffad6546640 1 --2- 172.21.15.78:0/3187524260 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ffad00a5370 0x7ffad014f600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:42.079 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:42.072+0000 7ffad6546640 1 -- 172.21.15.78:0/3187524260 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffacc0094d0 con 0x7ffad0072810 2023-11-28T20:02:42.079 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:42.072+0000 7ffad6546640 1 --2- 172.21.15.78:0/3187524260 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ffad0072810 0x7ffad014cb00 secure :-1 s=READY pgs=1035 cs=0 l=1 rev1=1 crypto rx=0x7ffacc01a0c0 tx=0x7ffacc019230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:02:42.079 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:42.072+0000 7ffac6ffd640 1 -- 172.21.15.78:0/3187524260 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffacc0b4420 con 0x7ffad0072810 2023-11-28T20:02:42.079 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:42.072+0000 7ffac6ffd640 1 -- 172.21.15.78:0/3187524260 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffacc0b4580 con 0x7ffad0072810 2023-11-28T20:02:42.079 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:42.072+0000 7ffad87aa640 1 -- 172.21.15.78:0/3187524260 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffad00a7d00 con 0x7ffad0072810 2023-11-28T20:02:42.079 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:42.072+0000 7ffac6ffd640 1 -- 172.21.15.78:0/3187524260 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffacc0b4910 con 0x7ffad0072810 2023-11-28T20:02:42.079 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:42.072+0000 7ffad87aa640 1 -- 172.21.15.78:0/3187524260 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffad00a67e0 con 0x7ffad0072810 2023-11-28T20:02:42.079 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:42.072+0000 7ffad87aa640 1 -- 172.21.15.78:0/3187524260 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffad00c0e90 con 0x7ffad0072810 2023-11-28T20:02:42.080 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:42.072+0000 7ffac6ffd640 1 -- 172.21.15.78:0/3187524260 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7ffacc0b2070 con 0x7ffad0072810 2023-11-28T20:02:42.080 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:42.076+0000 7ffac6ffd640 1 --2- 172.21.15.78:0/3187524260 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7ffab4066470 0x7ffab4068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:42.081 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:42.076+0000 7ffac6ffd640 1 -- 172.21.15.78:0/3187524260 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6885+0+0 (secure 0 0 0) 0x7ffacc11ddd0 con 0x7ffad0072810 2023-11-28T20:02:42.081 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:42.076+0000 7ffad5d45640 1 --2- 172.21.15.78:0/3187524260 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7ffab4066470 0x7ffab4068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:02:42.081 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:42.076+0000 7ffad5d45640 1 --2- 172.21.15.78:0/3187524260 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7ffab4066470 0x7ffab4068930 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7ffad006bb50 tx=0x7ffac0009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:02:42.083 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:42.080+0000 7ffac6ffd640 1 -- 172.21.15.78:0/3187524260 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7ffacc0eaef0 con 0x7ffad0072810 2023-11-28T20:02:42.246 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:42.240+0000 7ffad87aa640 1 -- 172.21.15.78:0/3187524260 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7ffad0067630 con 0x7ffad0072810 2023-11-28T20:02:42.246 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:42.240+0000 7ffac6ffd640 1 -- 172.21.15.78:0/3187524260 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v85) v1 ==== 80+0+0 (secure 0 0 0) 0x7ffacc0ee510 con 0x7ffad0072810 2023-11-28T20:02:42.246 INFO:teuthology.orchestra.run.smithi078.stderr:listed 0 entries 2023-11-28T20:02:42.248 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:42.244+0000 7ffad87aa640 1 -- 172.21.15.78:0/3187524260 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7ffab4066470 msgr2=0x7ffab4068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:02:42.249 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:42.244+0000 7ffad87aa640 1 --2- 172.21.15.78:0/3187524260 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7ffab4066470 0x7ffab4068930 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7ffad006bb50 tx=0x7ffac0009040 comp rx=0 tx=0).stop 2023-11-28T20:02:42.249 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:42.244+0000 7ffad87aa640 1 -- 172.21.15.78:0/3187524260 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ffad0072810 msgr2=0x7ffad014cb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:02:42.249 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:42.244+0000 7ffad87aa640 1 --2- 172.21.15.78:0/3187524260 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ffad0072810 0x7ffad014cb00 secure :-1 s=READY pgs=1035 cs=0 l=1 rev1=1 crypto rx=0x7ffacc01a0c0 tx=0x7ffacc019230 comp rx=0 tx=0).stop 2023-11-28T20:02:42.250 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:42.244+0000 7ffad87aa640 1 -- 172.21.15.78:0/3187524260 shutdown_connections 2023-11-28T20:02:42.250 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:42.244+0000 7ffad87aa640 1 --2- 172.21.15.78:0/3187524260 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7ffab4066470 0x7ffab4068930 unknown :-1 s=CLOSED pgs=490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:42.250 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:42.244+0000 7ffad87aa640 1 --2- 172.21.15.78:0/3187524260 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ffad00a4f90 0x7ffad00a77c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:42.250 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:42.244+0000 7ffad87aa640 1 --2- 172.21.15.78:0/3187524260 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ffad00a5370 0x7ffad014f600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:42.250 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:42.244+0000 7ffad87aa640 1 --2- 172.21.15.78:0/3187524260 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ffad0072810 0x7ffad014cb00 unknown :-1 s=CLOSED pgs=1035 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:42.250 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:42.244+0000 7ffad87aa640 1 -- 172.21.15.78:0/3187524260 >> 172.21.15.78:0/3187524260 conn(0x7ffad006b220 msgr2=0x7ffad00c3620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:02:42.251 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:42.244+0000 7ffad87aa640 1 -- 172.21.15.78:0/3187524260 shutdown_connections 2023-11-28T20:02:42.251 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:42.244+0000 7ffad87aa640 1 -- 172.21.15.78:0/3187524260 wait complete. 2023-11-28T20:02:42.267 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2023-11-28T20:02:42.267 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T20:02:42.268 DEBUG:teuthology.orchestra.run.smithi179:> sudo umount /home/ubuntu/cephtest/mnt.1 2023-11-28T20:02:42.320 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi179.front.sepia.ceph.com 2023-11-28T20:02:42.320 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T20:02:42.320 DEBUG:teuthology.orchestra.run.smithi179:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-11-28T20:02:42.345 DEBUG:teuthology.orchestra.run.smithi179:> set -ex 2023-11-28T20:02:42.345 DEBUG:teuthology.orchestra.run.smithi179:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-28T20:02:42.397 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354628k,nr_inodes=4088657,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275376k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=3817 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275372k,nr_inodes=818843,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275376k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 2023-11-28T20:02:42.398 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-11-28T20:02:42.534 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:42.528+0000 7f1ee472a640 1 Processor -- start 2023-11-28T20:02:42.534 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:42.528+0000 7f1ee472a640 1 -- start start 2023-11-28T20:02:42.536 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:42.532+0000 7f1ee472a640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1edc06d2b0 0x7f1edc06d690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:42.536 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:42.532+0000 7f1ee472a640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f1edc0c3b80 0x7f1edc0c5300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:42.536 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:42.532+0000 7f1ee472a640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1edc06bb80 con 0x7f1edc06c020 2023-11-28T20:02:42.536 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:42.532+0000 7f1ee472a640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1edc0c5840 con 0x7f1edc0c3b80 2023-11-28T20:02:42.536 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:42.532+0000 7f1ee472a640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1edc1515c0 con 0x7f1edc06d2b0 2023-11-28T20:02:42.536 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:42.532+0000 7f1ee1cc5640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f1edc0c3b80 0x7f1edc0c5300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:02:42.537 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:42.532+0000 7f1ee1cc5640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f1edc0c3b80 0x7f1edc0c5300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:50938/0 (socket says 172.21.15.78:50938) 2023-11-28T20:02:42.537 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:42.532+0000 7f1ee1cc5640 1 -- 172.21.15.78:0/4025241592 learned_addr learned my addr 172.21.15.78:0/4025241592 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T20:02:42.537 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:42.532+0000 7f1ee24c6640 1 --2- 172.21.15.78:0/4025241592 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1edc06d2b0 0x7f1edc06d690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:02:42.537 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:42.532+0000 7f1ee1cc5640 1 -- 172.21.15.78:0/4025241592 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1edc06d2b0 msgr2=0x7f1edc06d690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:02:42.537 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:42.532+0000 7f1ee1cc5640 1 --2- 172.21.15.78:0/4025241592 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1edc06d2b0 0x7f1edc06d690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:42.537 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:42.532+0000 7f1ee1cc5640 1 -- 172.21.15.78:0/4025241592 >> v1:172.21.15.179:6789/0 conn(0x7f1edc06c020 legacy=0x7f1edc06c4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:02:42.537 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:42.532+0000 7f1ee1cc5640 1 -- 172.21.15.78:0/4025241592 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1edc1518a0 con 0x7f1edc0c3b80 2023-11-28T20:02:42.539 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:42.536+0000 7f1ee1cc5640 1 --2- 172.21.15.78:0/4025241592 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1edc0c3b80 0x7f1edc0c5300 secure :-1 s=READY pgs=1036 cs=0 l=1 rev1=1 crypto rx=0x7f1ecc009870 tx=0x7f1ecc01c510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2b0e160b275aafa4 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:02:42.540 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:42.536+0000 7f1ee14c4640 1 -- 172.21.15.78:0/4025241592 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ecc0aa670 con 0x7f1edc0c3b80 2023-11-28T20:02:42.540 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:42.536+0000 7f1ee14c4640 1 -- 172.21.15.78:0/4025241592 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ecc0aa7d0 con 0x7f1edc0c3b80 2023-11-28T20:02:42.540 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:42.536+0000 7f1ee14c4640 1 -- 172.21.15.78:0/4025241592 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ecc0aab60 con 0x7f1edc0c3b80 2023-11-28T20:02:42.540 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:42.536+0000 7f1ee472a640 1 -- 172.21.15.78:0/4025241592 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1edc0c3b80 msgr2=0x7f1edc0c5300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:02:42.541 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:42.536+0000 7f1ee472a640 1 --2- 172.21.15.78:0/4025241592 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1edc0c3b80 0x7f1edc0c5300 secure :-1 s=READY pgs=1036 cs=0 l=1 rev1=1 crypto rx=0x7f1ecc009870 tx=0x7f1ecc01c510 comp rx=0 tx=0).stop 2023-11-28T20:02:42.541 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:42.536+0000 7f1ee472a640 1 -- 172.21.15.78:0/4025241592 shutdown_connections 2023-11-28T20:02:42.541 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:42.536+0000 7f1ee472a640 1 --2- 172.21.15.78:0/4025241592 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1edc0c3b80 0x7f1edc0c5300 unknown :-1 s=CLOSED pgs=1036 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:42.541 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:42.536+0000 7f1ee472a640 1 --2- 172.21.15.78:0/4025241592 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1edc06d2b0 0x7f1edc06d690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:42.541 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:42.536+0000 7f1ee472a640 1 -- 172.21.15.78:0/4025241592 >> 172.21.15.78:0/4025241592 conn(0x7f1edc0a7810 msgr2=0x7f1edc0a7c20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:02:42.541 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:42.536+0000 7f1ee472a640 1 -- 172.21.15.78:0/4025241592 shutdown_connections 2023-11-28T20:02:42.541 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:42.536+0000 7f1ee472a640 1 -- 172.21.15.78:0/4025241592 wait complete. 2023-11-28T20:02:42.542 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:42.536+0000 7f1ee472a640 1 Processor -- start 2023-11-28T20:02:42.542 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:42.536+0000 7f1ee472a640 1 -- start start 2023-11-28T20:02:42.543 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:42.540+0000 7f1ee472a640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1edc06c020 0x7f1edc1534c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:42.543 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:42.540+0000 7f1ee472a640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1edc06d2b0 0x7f1edc1f0d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:42.543 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:42.540+0000 7f1ee472a640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1edc0c3b80 0x7f1edc15b370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:42.543 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:42.540+0000 7f1ee472a640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1edc0a8fe0 con 0x7f1edc06c020 2023-11-28T20:02:42.543 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:42.540+0000 7f1ee472a640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1edc153e90 con 0x7f1edc06d2b0 2023-11-28T20:02:42.543 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:42.540+0000 7f1ee472a640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1edc1f1290 con 0x7f1edc0c3b80 2023-11-28T20:02:42.543 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:42.540+0000 7f1ee24c6640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1edc06c020 0x7f1edc1534c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:02:42.543 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:42.540+0000 7f1ee24c6640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1edc06c020 0x7f1edc1534c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:50952/0 (socket says 172.21.15.78:50952) 2023-11-28T20:02:42.543 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:42.540+0000 7f1ee24c6640 1 -- 172.21.15.78:0/4227846875 learned_addr learned my addr 172.21.15.78:0/4227846875 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T20:02:42.545 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:42.540+0000 7f1ee1cc5640 1 --2- 172.21.15.78:0/4227846875 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1edc06d2b0 0x7f1edc1f0d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:02:42.545 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:42.540+0000 7f1ee2cc7640 1 --2- 172.21.15.78:0/4227846875 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1edc0c3b80 0x7f1edc15b370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:02:42.545 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:42.540+0000 7f1ee24c6640 1 -- 172.21.15.78:0/4227846875 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1edc0c3b80 msgr2=0x7f1edc15b370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:02:42.545 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:42.540+0000 7f1ee24c6640 1 --2- 172.21.15.78:0/4227846875 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1edc0c3b80 0x7f1edc15b370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:42.545 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:42.540+0000 7f1ee24c6640 1 -- 172.21.15.78:0/4227846875 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1edc06d2b0 msgr2=0x7f1edc1f0d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:02:42.545 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:42.540+0000 7f1ee24c6640 1 --2- 172.21.15.78:0/4227846875 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1edc06d2b0 0x7f1edc1f0d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:42.545 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:42.540+0000 7f1ee24c6640 1 -- 172.21.15.78:0/4227846875 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ecc0094d0 con 0x7f1edc06c020 2023-11-28T20:02:42.545 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:42.540+0000 7f1ee1cc5640 1 --2- 172.21.15.78:0/4227846875 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1edc06d2b0 0x7f1edc1f0d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T20:02:42.546 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:42.540+0000 7f1ee2cc7640 1 --2- 172.21.15.78:0/4227846875 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1edc0c3b80 0x7f1edc15b370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T20:02:42.546 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:42.540+0000 7f1ee24c6640 1 --2- 172.21.15.78:0/4227846875 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1edc06c020 0x7f1edc1534c0 secure :-1 s=READY pgs=1037 cs=0 l=1 rev1=1 crypto rx=0x7f1ed800d830 tx=0x7f1ed800dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:02:42.546 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:42.540+0000 7f1ed2ffd640 1 -- 172.21.15.78:0/4227846875 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ed800b6c0 con 0x7f1edc06c020 2023-11-28T20:02:42.546 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:42.540+0000 7f1ed2ffd640 1 -- 172.21.15.78:0/4227846875 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ed800b860 con 0x7f1edc06c020 2023-11-28T20:02:42.546 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:42.540+0000 7f1ee472a640 1 -- 172.21.15.78:0/4227846875 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1edc14ef80 con 0x7f1edc06c020 2023-11-28T20:02:42.546 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:42.540+0000 7f1ed2ffd640 1 -- 172.21.15.78:0/4227846875 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ed800bc10 con 0x7f1edc06c020 2023-11-28T20:02:42.546 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:42.540+0000 7f1ee472a640 1 -- 172.21.15.78:0/4227846875 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1edc0a87d0 con 0x7f1edc06c020 2023-11-28T20:02:42.546 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:42.540+0000 7f1ee472a640 1 -- 172.21.15.78:0/4227846875 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1edc067630 con 0x7f1edc06c020 2023-11-28T20:02:42.547 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:42.540+0000 7f1ed2ffd640 1 -- 172.21.15.78:0/4227846875 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f1ed801e460 con 0x7f1edc06c020 2023-11-28T20:02:42.547 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:42.544+0000 7f1ed2ffd640 1 --2- 172.21.15.78:0/4227846875 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f1ec00664a0 0x7f1ec0068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:42.548 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:42.544+0000 7f1ed2ffd640 1 -- 172.21.15.78:0/4227846875 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6885+0+0 (secure 0 0 0) 0x7f1ed8084b60 con 0x7f1edc06c020 2023-11-28T20:02:42.548 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:42.544+0000 7f1ee1cc5640 1 --2- 172.21.15.78:0/4227846875 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f1ec00664a0 0x7f1ec0068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:02:42.548 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:42.544+0000 7f1ee1cc5640 1 --2- 172.21.15.78:0/4227846875 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f1ec00664a0 0x7f1ec0068960 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f1ecc0ae000 tx=0x7f1ecc008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:02:42.551 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:42.548+0000 7f1ed2ffd640 1 -- 172.21.15.78:0/4227846875 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f1ed8051aa0 con 0x7f1edc06c020 2023-11-28T20:02:42.733 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:42.728+0000 7f1ee472a640 1 -- 172.21.15.78:0/4227846875 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f1edc06bd70 con 0x7f1edc06c020 2023-11-28T20:02:42.733 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:42.728+0000 7f1ed2ffd640 1 -- 172.21.15.78:0/4227846875 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v51) v1 ==== 53+0+149 (secure 0 0 0) 0x7f1ed80550c0 con 0x7f1edc06c020 2023-11-28T20:02:42.733 INFO:teuthology.orchestra.run.smithi078.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-11-28T20:02:42.733 INFO:teuthology.orchestra.run.smithi078.stdout:name: cephfs2, metadata pool: cephfs2_metadata, data pools: [cephfs2_data ] 2023-11-28T20:02:42.735 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:42.732+0000 7f1ee472a640 1 -- 172.21.15.78:0/4227846875 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f1ec00664a0 msgr2=0x7f1ec0068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:02:42.735 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:42.732+0000 7f1ee472a640 1 --2- 172.21.15.78:0/4227846875 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f1ec00664a0 0x7f1ec0068960 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f1ecc0ae000 tx=0x7f1ecc008040 comp rx=0 tx=0).stop 2023-11-28T20:02:42.736 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:42.732+0000 7f1ee472a640 1 -- 172.21.15.78:0/4227846875 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1edc06c020 msgr2=0x7f1edc1534c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:02:42.736 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:42.732+0000 7f1ee472a640 1 --2- 172.21.15.78:0/4227846875 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1edc06c020 0x7f1edc1534c0 secure :-1 s=READY pgs=1037 cs=0 l=1 rev1=1 crypto rx=0x7f1ed800d830 tx=0x7f1ed800dcf0 comp rx=0 tx=0).stop 2023-11-28T20:02:42.736 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:42.732+0000 7f1ee472a640 1 -- 172.21.15.78:0/4227846875 shutdown_connections 2023-11-28T20:02:42.736 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:42.732+0000 7f1ee472a640 1 --2- 172.21.15.78:0/4227846875 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f1ec00664a0 0x7f1ec0068960 unknown :-1 s=CLOSED pgs=491 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:42.736 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:42.732+0000 7f1ee472a640 1 --2- 172.21.15.78:0/4227846875 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1edc0c3b80 0x7f1edc15b370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:42.736 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:42.732+0000 7f1ee472a640 1 --2- 172.21.15.78:0/4227846875 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1edc06d2b0 0x7f1edc1f0d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:42.736 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:42.732+0000 7f1ee472a640 1 --2- 172.21.15.78:0/4227846875 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1edc06c020 0x7f1edc1534c0 unknown :-1 s=CLOSED pgs=1037 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:42.736 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:42.732+0000 7f1ee472a640 1 -- 172.21.15.78:0/4227846875 >> 172.21.15.78:0/4227846875 conn(0x7f1edc0a7810 msgr2=0x7f1edc0a7bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:02:42.736 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:42.732+0000 7f1ee472a640 1 -- 172.21.15.78:0/4227846875 shutdown_connections 2023-11-28T20:02:42.736 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:42.732+0000 7f1ee472a640 1 -- 172.21.15.78:0/4227846875 wait complete. 2023-11-28T20:02:42.754 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs2; just confirmed its presence on cluster 2023-11-28T20:02:42.754 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-11-28T20:02:42.754 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi179.front.sepia.ceph.com 2023-11-28T20:02:42.754 INFO:tasks.cephfs.mount:self.client.name = client.testuser 2023-11-28T20:02:42.754 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-11-28T20:02:42.754 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs2 2023-11-28T20:02:42.754 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-11-28T20:02:42.754 INFO:tasks.cephfs.mount:self.client_keyring_path = /tmp/tmp.eOw7VL0zaf 2023-11-28T20:02:42.755 DEBUG:teuthology.orchestra.run.smithi179:> mktemp 2023-11-28T20:02:42.764 INFO:teuthology.orchestra.run.smithi179.stdout:/tmp/tmp.vi723WrCU5 2023-11-28T20:02:42.764 DEBUG:teuthology.orchestra.run.smithi179:> sudo cp /tmp/tmp.eOw7VL0zaf /tmp/tmp.vi723WrCU5 2023-11-28T20:02:42.831 DEBUG:teuthology.orchestra.run.smithi179:> sudo chmod 0666 /tmp/tmp.vi723WrCU5 2023-11-28T20:02:42.951 DEBUG:teuthology.orchestra.remote:smithi179:/tmp/tmp.vi723WrCU5 is 226B 2023-11-28T20:02:42.969 DEBUG:teuthology.orchestra.run.smithi179:> rm -fr /tmp/tmp.vi723WrCU5 2023-11-28T20:02:42.978 INFO:tasks.cephfs.mount:keyring content - [client.testuser] key = AQBaR2ZlZ0uqMRAAUA+5naTf77F/Mb/2VolMgw== caps mds = "allow r fsname=cephfs, allow r fsname=cephfs2" caps mon = "allow r" caps osd = "allow r tag cephfs data=cephfs, allow r tag cephfs data=cephfs2" 2023-11-28T20:02:42.978 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-11-28T20:02:42.978 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T20:02:42.978 DEBUG:teuthology.orchestra.run.smithi179:> ip addr 2023-11-28T20:02:43.033 INFO:teuthology.orchestra.run.smithi179.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-11-28T20:02:43.034 INFO:teuthology.orchestra.run.smithi179.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-11-28T20:02:43.034 INFO:teuthology.orchestra.run.smithi179.stdout: inet 127.0.0.1/8 scope host lo 2023-11-28T20:02:43.034 INFO:teuthology.orchestra.run.smithi179.stdout: valid_lft forever preferred_lft forever 2023-11-28T20:02:43.034 INFO:teuthology.orchestra.run.smithi179.stdout: inet6 ::1/128 scope host 2023-11-28T20:02:43.034 INFO:teuthology.orchestra.run.smithi179.stdout: valid_lft forever preferred_lft forever 2023-11-28T20:02:43.034 INFO:teuthology.orchestra.run.smithi179.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-11-28T20:02:43.034 INFO:teuthology.orchestra.run.smithi179.stdout: link/ether 0c:c4:7a:d9:3b:34 brd ff:ff:ff:ff:ff:ff 2023-11-28T20:02:43.034 INFO:teuthology.orchestra.run.smithi179.stdout: altname enp7s0f0 2023-11-28T20:02:43.034 INFO:teuthology.orchestra.run.smithi179.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-11-28T20:02:43.034 INFO:teuthology.orchestra.run.smithi179.stdout: link/ether 0c:c4:7a:d9:3b:35 brd ff:ff:ff:ff:ff:ff 2023-11-28T20:02:43.034 INFO:teuthology.orchestra.run.smithi179.stdout: altname enp7s0f1 2023-11-28T20:02:43.035 INFO:teuthology.orchestra.run.smithi179.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-11-28T20:02:43.035 INFO:teuthology.orchestra.run.smithi179.stdout: link/ether 0c:c4:7a:88:72:5a brd ff:ff:ff:ff:ff:ff 2023-11-28T20:02:43.035 INFO:teuthology.orchestra.run.smithi179.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-11-28T20:02:43.035 INFO:teuthology.orchestra.run.smithi179.stdout: link/ether 0c:c4:7a:88:72:5b brd ff:ff:ff:ff:ff:ff 2023-11-28T20:02:43.035 INFO:teuthology.orchestra.run.smithi179.stdout: inet 172.21.15.179/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2023-11-28T20:02:43.035 INFO:teuthology.orchestra.run.smithi179.stdout: valid_lft 42219sec preferred_lft 42219sec 2023-11-28T20:02:43.035 INFO:teuthology.orchestra.run.smithi179.stdout: inet6 fe80::ec4:7aff:fe88:725b/64 scope link 2023-11-28T20:02:43.035 INFO:teuthology.orchestra.run.smithi179.stdout: valid_lft forever preferred_lft forever 2023-11-28T20:02:43.035 INFO:teuthology.orchestra.run.smithi179.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-11-28T20:02:43.035 INFO:teuthology.orchestra.run.smithi179.stdout: link/ether 02:42:75:f0:7b:8c brd ff:ff:ff:ff:ff:ff 2023-11-28T20:02:43.035 INFO:teuthology.orchestra.run.smithi179.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-11-28T20:02:43.035 INFO:teuthology.orchestra.run.smithi179.stdout: valid_lft forever preferred_lft forever 2023-11-28T20:02:43.035 INFO:teuthology.orchestra.run.smithi179.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-11-28T20:02:43.036 INFO:teuthology.orchestra.run.smithi179.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2023-11-28T20:02:43.036 INFO:teuthology.orchestra.run.smithi179.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-11-28T20:02:43.036 INFO:teuthology.orchestra.run.smithi179.stdout: valid_lft forever preferred_lft forever 2023-11-28T20:02:43.036 INFO:teuthology.orchestra.run.smithi179.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2023-11-28T20:02:43.036 INFO:teuthology.orchestra.run.smithi179.stdout: valid_lft forever preferred_lft forever 2023-11-28T20:02:43.036 INFO:teuthology.orchestra.run.smithi179.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-11-28T20:02:43.036 INFO:teuthology.orchestra.run.smithi179.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2023-11-28T20:02:43.036 INFO:teuthology.orchestra.run.smithi179.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2023-11-28T20:02:43.036 INFO:teuthology.orchestra.run.smithi179.stdout: valid_lft forever preferred_lft forever 2023-11-28T20:02:43.037 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T20:02:43.037 DEBUG:teuthology.orchestra.run.smithi179:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-11-28T20:02:43.100 INFO:teuthology.orchestra.run.smithi179.stdout:1 2023-11-28T20:02:43.102 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T20:02:43.103 DEBUG:teuthology.orchestra.run.smithi179:> route 2023-11-28T20:02:43.159 INFO:teuthology.orchestra.run.smithi179.stdout:Kernel IP routing table 2023-11-28T20:02:43.160 INFO:teuthology.orchestra.run.smithi179.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-11-28T20:02:43.160 INFO:teuthology.orchestra.run.smithi179.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2023-11-28T20:02:43.160 INFO:teuthology.orchestra.run.smithi179.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-11-28T20:02:43.160 INFO:teuthology.orchestra.run.smithi179.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-11-28T20:02:43.160 INFO:teuthology.orchestra.run.smithi179.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-11-28T20:02:43.160 INFO:teuthology.orchestra.run.smithi179.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-11-28T20:02:43.160 INFO:teuthology.orchestra.run.smithi179.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-11-28T20:02:43.160 INFO:teuthology.orchestra.run.smithi179.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-11-28T20:02:43.160 INFO:teuthology.orchestra.run.smithi179.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-11-28T20:02:43.160 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T20:02:43.161 DEBUG:teuthology.orchestra.run.smithi179:> (cd / && exec bash -c ' 2023-11-28T20:02:43.161 DEBUG:teuthology.orchestra.run.smithi179:> set -e 2023-11-28T20:02:43.161 DEBUG:teuthology.orchestra.run.smithi179:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-11-28T20:02:43.161 DEBUG:teuthology.orchestra.run.smithi179:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-11-28T20:02:43.161 DEBUG:teuthology.orchestra.run.smithi179:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-11-28T20:02:43.161 DEBUG:teuthology.orchestra.run.smithi179:> ') 2023-11-28T20:02:43.254 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T20:02:43.254 DEBUG:teuthology.orchestra.run.smithi179:> ip netns list 2023-11-28T20:02:43.264 INFO:teuthology.orchestra.run.smithi179.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-11-28T20:02:43.264 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-11-28T20:02:43.264 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T20:02:43.264 DEBUG:teuthology.orchestra.run.smithi179:> sudo ip link set brx.0 up 2023-11-28T20:02:43.325 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-28T20:02:43.325 DEBUG:teuthology.orchestra.run.smithi179:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2023-11-28T20:02:43.377 INFO:teuthology.orchestra.run.smithi179.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2023-11-28T20:02:43.377 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-28T20:02:43.377 DEBUG:teuthology.orchestra.run.smithi179:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2023-11-28T20:02:43.428 DEBUG:teuthology.orchestra.run.smithi179:> set -ex 2023-11-28T20:02:43.428 DEBUG:teuthology.orchestra.run.smithi179:> dd if=/tmp/tmp.eOw7VL0zaf of=/dev/stdout 2023-11-28T20:02:43.476 INFO:tasks.cephfs.kernel_mount:mounting using device: testuser@.cephfs2=/ 2023-11-28T20:02:43.476 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T20:02:43.477 DEBUG:teuthology.orchestra.run.smithi179:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph testuser@.cephfs2=/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,secret=AQBaR2ZlZ0uqMRAAUA+5naTf77F/Mb/2VolMgw==,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-11-28T20:02:43.572 INFO:teuthology.orchestra.run.smithi179.stdout:parsing options: rw,norequire_active_mds,secret=AQBaR2ZlZ0uqMRAAUA+5naTf77F/Mb/2VolMgw==,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-11-28T20:02:43.572 INFO:teuthology.orchestra.run.smithi179.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-11-28T20:02:43.573 INFO:teuthology.orchestra.run.smithi179.stdout:keyring.get_secret failed 2023-11-28T20:02:43.585 INFO:teuthology.orchestra.run.smithi179.stdout:parsing options: rw,norequire_active_mds,secret=AQBaR2ZlZ0uqMRAAUA+5naTf77F/Mb/2VolMgw==,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-11-28T20:02:43.585 INFO:teuthology.orchestra.run.smithi179.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-11-28T20:02:43.585 INFO:teuthology.orchestra.run.smithi179.stdout:mount.ceph: resolved to: "172.21.15.78:3300,172.21.15.179:3300,172.21.15.179:3301" 2023-11-28T20:02:43.585 INFO:teuthology.orchestra.run.smithi179.stdout:mount.ceph: trying mount with new device syntax: testuser@dd9780e8-3bda-44fa-a9f0-fa07d19d901d.cephfs2=/ 2023-11-28T20:02:43.585 INFO:teuthology.orchestra.run.smithi179.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=testuser,ms_mode=prefer-crc,key=testuser,mon_addr=172.21.15.78:3300/172.21.15.179:3300/172.21.15.179:3301" will pass to kernel 2023-11-28T20:02:43.588 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-11-28T20:02:43.588 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T20:02:43.589 DEBUG:teuthology.orchestra.run.smithi179:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-11-28T20:02:43.650 INFO:teuthology.orchestra.run.smithi179.stderr:chmod: changing permissions of '/home/ubuntu/cephtest/mnt.1': Permission denied 2023-11-28T20:02:43.652 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-28T20:02:43.652 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T20:02:43.652 DEBUG:teuthology.orchestra.run.smithi179:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-11-28T20:02:43.707 INFO:teuthology.orchestra.run.smithi179.stdout:client7143 2023-11-28T20:02:43.708 DEBUG:teuthology.orchestra.run.smithi179:> set -ex 2023-11-28T20:02:43.708 DEBUG:teuthology.orchestra.run.smithi179:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-28T20:02:43.756 INFO:tasks.cephfs.caps_helper:test read perm: read file /home/ubuntu/cephtest/mnt.0/testdir/testfile and expect data "self.path = /home/ubuntu/cephtest/mnt.0/testdir/testfile cephfs_name = cephfs cephfs_mntpt = / hostfs_mntpt = /home/ubuntu/cephtest/mnt.0" 2023-11-28T20:02:43.757 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T20:02:43.757 DEBUG:teuthology.orchestra.run.smithi078:> (cd /home/ubuntu/cephtest/mnt.0 && exec cat /home/ubuntu/cephtest/mnt.0/testdir/testfile) 2023-11-28T20:02:43.768 INFO:teuthology.orchestra.run.smithi078.stderr:cat: /home/ubuntu/cephtest/mnt.0/testdir/testfile: Permission denied 2023-11-28T20:02:43.769 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-28T20:02:43.769 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2023-11-28T20:02:43.769 DEBUG:teuthology.orchestra.run.smithi078:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-28T20:02:43.820 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2023-11-28T20:02:43.820 DEBUG:teuthology.orchestra.run.smithi078:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-28T20:02:43.872 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-28T20:02:44.060 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:44.056+0000 7f7cfdb1d640 1 Processor -- start 2023-11-28T20:02:44.061 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:44.056+0000 7f7cfdb1d640 1 -- start start 2023-11-28T20:02:44.062 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:44.056+0000 7f7cfdb1d640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7cf814e570 0x7f7cf80c7cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:44.062 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:44.056+0000 7f7cfdb1d640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f7cf80ca190 0x7f7cf80ca600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:44.062 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:44.056+0000 7f7cfdb1d640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7cf80c81f0 con 0x7f7cf8154fd0 2023-11-28T20:02:44.062 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:44.056+0000 7f7cfdb1d640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7cf80c5140 con 0x7f7cf80ca190 2023-11-28T20:02:44.062 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:44.056+0000 7f7cfdb1d640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7cf80c4b80 con 0x7f7cf814e570 2023-11-28T20:02:44.062 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:44.056+0000 7f7cf6ffd640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f7cf8154fd0 0x7f7cf81584e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:50058/0 (socket says 172.21.15.78:50058) 2023-11-28T20:02:44.062 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:44.056+0000 7f7cf6ffd640 1 -- 172.21.15.78:0/726122748 learned_addr learned my addr 172.21.15.78:0/726122748 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-11-28T20:02:44.062 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:44.056+0000 7f7cf77fe640 1 --2- 172.21.15.78:0/726122748 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7cf814e570 0x7f7cf80c7cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:02:44.062 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:44.056+0000 7f7cf7fff640 1 --2- 172.21.15.78:0/726122748 >> v2:172.21.15.179:3300/0 conn(0x7f7cf80ca190 0x7f7cf80ca600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:02:44.063 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:44.056+0000 7f7cf67fc640 1 -- 172.21.15.78:0/726122748 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2077934844 0 0) 0x7f7cf80c81f0 con 0x7f7cf8154fd0 2023-11-28T20:02:44.063 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:44.056+0000 7f7cf67fc640 1 -- 172.21.15.78:0/726122748 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7ce0003530 con 0x7f7cf8154fd0 2023-11-28T20:02:44.063 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:44.056+0000 7f7cf77fe640 1 -- 172.21.15.78:0/726122748 >> v2:172.21.15.179:3300/0 conn(0x7f7cf80ca190 msgr2=0x7f7cf80ca600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:02:44.063 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:44.056+0000 7f7cf77fe640 1 --2- 172.21.15.78:0/726122748 >> v2:172.21.15.179:3300/0 conn(0x7f7cf80ca190 0x7f7cf80ca600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:44.063 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:44.060+0000 7f7cf77fe640 1 -- 172.21.15.78:0/726122748 >> v1:172.21.15.78:6789/0 conn(0x7f7cf8154fd0 legacy=0x7f7cf81584e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:02:44.064 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:44.060+0000 7f7cf77fe640 1 -- 172.21.15.78:0/726122748 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7cf80c4e60 con 0x7f7cf814e570 2023-11-28T20:02:44.065 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:44.060+0000 7f7cf77fe640 1 --2- 172.21.15.78:0/726122748 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7cf814e570 0x7f7cf80c7cb0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f7ce80097c0 tx=0x7f7ce801c3c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f57054e2edec8083 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:02:44.066 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:44.060+0000 7f7cf67fc640 1 -- 172.21.15.78:0/726122748 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ce80ac620 con 0x7f7cf814e570 2023-11-28T20:02:44.066 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:44.060+0000 7f7cf67fc640 1 -- 172.21.15.78:0/726122748 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ce80ac780 con 0x7f7cf814e570 2023-11-28T20:02:44.066 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:44.060+0000 7f7cf67fc640 1 -- 172.21.15.78:0/726122748 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ce80acaf0 con 0x7f7cf814e570 2023-11-28T20:02:44.071 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:44.060+0000 7f7cfdb1d640 1 -- 172.21.15.78:0/726122748 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7cf814e570 msgr2=0x7f7cf80c7cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:02:44.071 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:44.060+0000 7f7cfdb1d640 1 --2- 172.21.15.78:0/726122748 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7cf814e570 0x7f7cf80c7cb0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f7ce80097c0 tx=0x7f7ce801c3c0 comp rx=0 tx=0).stop 2023-11-28T20:02:44.071 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:44.060+0000 7f7cfdb1d640 1 -- 172.21.15.78:0/726122748 shutdown_connections 2023-11-28T20:02:44.071 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:44.060+0000 7f7cfdb1d640 1 --2- 172.21.15.78:0/726122748 >> v2:172.21.15.179:3300/0 conn(0x7f7cf80ca190 0x7f7cf80ca600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:44.071 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:44.060+0000 7f7cfdb1d640 1 --2- 172.21.15.78:0/726122748 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7cf814e570 0x7f7cf80c7cb0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:44.071 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:44.060+0000 7f7cfdb1d640 1 -- 172.21.15.78:0/726122748 >> 172.21.15.78:0/726122748 conn(0x7f7cf80abb10 msgr2=0x7f7cf80abf20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:02:44.071 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:44.060+0000 7f7cfdb1d640 1 -- 172.21.15.78:0/726122748 shutdown_connections 2023-11-28T20:02:44.071 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:44.060+0000 7f7cfdb1d640 1 -- 172.21.15.78:0/726122748 wait complete. 2023-11-28T20:02:44.071 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:44.064+0000 7f7cfdb1d640 1 Processor -- start 2023-11-28T20:02:44.072 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:44.064+0000 7f7cfdb1d640 1 -- start start 2023-11-28T20:02:44.072 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:44.064+0000 7f7cfdb1d640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7cf80ca190 0x7f7cf81ed2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:44.072 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:44.064+0000 7f7cfdb1d640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7cf814e570 0x7f7cf80aec30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:44.072 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:44.064+0000 7f7cfdb1d640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7cf8154fd0 0x7f7cf80adad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:44.072 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:44.064+0000 7f7cfdb1d640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7cf80aca30 con 0x7f7cf8154fd0 2023-11-28T20:02:44.072 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:44.064+0000 7f7cfdb1d640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7cf80acd10 con 0x7f7cf814e570 2023-11-28T20:02:44.072 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:44.064+0000 7f7cfdb1d640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7cf80acff0 con 0x7f7cf80ca190 2023-11-28T20:02:44.072 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:44.064+0000 7f7cf7fff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7cf8154fd0 0x7f7cf80adad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:02:44.072 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:44.064+0000 7f7cf7fff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7cf8154fd0 0x7f7cf80adad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:50954/0 (socket says 172.21.15.78:50954) 2023-11-28T20:02:44.072 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:44.064+0000 7f7cf7fff640 1 -- 172.21.15.78:0/2480848327 learned_addr learned my addr 172.21.15.78:0/2480848327 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T20:02:44.072 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:44.064+0000 7f7cf77fe640 1 --2- 172.21.15.78:0/2480848327 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7cf80ca190 0x7f7cf81ed2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:02:44.072 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:44.064+0000 7f7cf6ffd640 1 --2- 172.21.15.78:0/2480848327 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7cf814e570 0x7f7cf80aec30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:02:44.072 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:44.064+0000 7f7cf7fff640 1 -- 172.21.15.78:0/2480848327 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7cf80ca190 msgr2=0x7f7cf81ed2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:02:44.073 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:44.064+0000 7f7cf7fff640 1 --2- 172.21.15.78:0/2480848327 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7cf80ca190 0x7f7cf81ed2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:44.073 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:44.064+0000 7f7cf7fff640 1 -- 172.21.15.78:0/2480848327 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7cf814e570 msgr2=0x7f7cf80aec30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:02:44.073 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:44.064+0000 7f7cf7fff640 1 --2- 172.21.15.78:0/2480848327 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7cf814e570 0x7f7cf80aec30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:44.073 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:44.064+0000 7f7cf7fff640 1 -- 172.21.15.78:0/2480848327 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ce8009420 con 0x7f7cf8154fd0 2023-11-28T20:02:44.073 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:44.064+0000 7f7cf7fff640 1 --2- 172.21.15.78:0/2480848327 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7cf8154fd0 0x7f7cf80adad0 secure :-1 s=READY pgs=1040 cs=0 l=1 rev1=1 crypto rx=0x7f7cf000efc0 tx=0x7f7cf000c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:02:44.073 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:44.064+0000 7f7cdffff640 1 -- 172.21.15.78:0/2480848327 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cf0009ba0 con 0x7f7cf8154fd0 2023-11-28T20:02:44.073 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:44.064+0000 7f7cdffff640 1 -- 172.21.15.78:0/2480848327 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7cf000f040 con 0x7f7cf8154fd0 2023-11-28T20:02:44.073 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:44.064+0000 7f7cdffff640 1 -- 172.21.15.78:0/2480848327 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cf00146c0 con 0x7f7cf8154fd0 2023-11-28T20:02:44.073 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:44.064+0000 7f7cfdb1d640 1 -- 172.21.15.78:0/2480848327 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7cf80ad2d0 con 0x7f7cf8154fd0 2023-11-28T20:02:44.073 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:44.068+0000 7f7cfdb1d640 1 -- 172.21.15.78:0/2480848327 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7cf80c89d0 con 0x7f7cf8154fd0 2023-11-28T20:02:44.074 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:44.068+0000 7f7cfdb1d640 1 -- 172.21.15.78:0/2480848327 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7cf80ad7f0 con 0x7f7cf8154fd0 2023-11-28T20:02:44.074 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:44.068+0000 7f7cdffff640 1 -- 172.21.15.78:0/2480848327 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f7cf0014820 con 0x7f7cf8154fd0 2023-11-28T20:02:44.074 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:44.068+0000 7f7cdffff640 1 --2- 172.21.15.78:0/2480848327 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f7ce40664a0 0x7f7ce4068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:44.074 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:44.068+0000 7f7cdffff640 1 -- 172.21.15.78:0/2480848327 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6885+0+0 (secure 0 0 0) 0x7f7cf0084e90 con 0x7f7cf8154fd0 2023-11-28T20:02:44.074 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:44.068+0000 7f7cf77fe640 1 --2- 172.21.15.78:0/2480848327 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f7ce40664a0 0x7f7ce4068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:02:44.074 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:44.068+0000 7f7cf77fe640 1 --2- 172.21.15.78:0/2480848327 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f7ce40664a0 0x7f7ce4068960 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f7ce80ae000 tx=0x7f7ce80a7000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:02:44.077 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:44.072+0000 7f7cdffff640 1 -- 172.21.15.78:0/2480848327 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f7cf80ad7f0 con 0x7f7cf8154fd0 2023-11-28T20:02:44.227 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:44.224+0000 7f7cfdb1d640 1 -- 172.21.15.78:0/2480848327 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7cf80ad7f0 con 0x7f7cf8154fd0 2023-11-28T20:02:44.229 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:44.224+0000 7f7cdffff640 1 -- 172.21.15.78:0/2480848327 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v85) v1 ==== 74+0+20339 (secure 0 0 0) 0x7f7cf80ad7f0 con 0x7f7cf8154fd0 2023-11-28T20:02:44.229 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-11-28T20:02:44.229 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":85,"fsid":"dd9780e8-3bda-44fa-a9f0-fa07d19d901d","created":"2023-11-28T19:58:40.969556+0000","modified":"2023-11-28T20:02:26.796715+0000","last_up_change":"2023-11-28T19:58:52.596716+0000","last_in_change":"2023-11-28T19:58:43.609275+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":16,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-28T19:58:54.011229+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_metadata","create_time":"2023-11-28T20:02:05.787820+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs_data","create_time":"2023-11-28T20:02:06.652305+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs2_metadata","create_time":"2023-11-28T20:02:23.066724+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":16,"pool_name":"cephfs2_data","create_time":"2023-11-28T20:02:24.230614+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs2"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e84245ac-b5da-429e-af18-39acaa2b33e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6800","nonce":3358701235},{"type":"v1","addr":"172.21.15.78:6801","nonce":3358701235}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6802","nonce":3358701235},{"type":"v1","addr":"172.21.15.78:6803","nonce":3358701235}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6806","nonce":3358701235},{"type":"v1","addr":"172.21.15.78:6807","nonce":3358701235}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6804","nonce":3358701235},{"type":"v1","addr":"172.21.15.78:6805","nonce":3358701235}]},"public_addr":"172.21.15.78:6801/3358701235","cluster_addr":"172.21.15.78:6803/3358701235","heartbeat_back_addr":"172.21.15.78:6807/3358701235","heartbeat_front_addr":"172.21.15.78:6805/3358701235","state":["exists","up"]},{"osd":1,"uuid":"e634831d-c4e2-48d9-870c-9556ae162981","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6808","nonce":3211476654},{"type":"v1","addr":"172.21.15.78:6809","nonce":3211476654}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6810","nonce":3211476654},{"type":"v1","addr":"172.21.15.78:6811","nonce":3211476654}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6814","nonce":3211476654},{"type":"v1","addr":"172.21.15.78:6815","nonce":3211476654}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6812","nonce":3211476654},{"type":"v1","addr":"172.21.15.78:6813","nonce":3211476654}]},"public_addr":"172.21.15.78:6809/3211476654","cluster_addr":"172.21.15.78:6811/3211476654","heartbeat_back_addr":"172.21.15.78:6815/3211476654","heartbeat_front_addr":"172.21.15.78:6813/3211476654","state":["exists","up"]},{"osd":2,"uuid":"274c8395-6534-41f0-b8fb-a00af8985aa8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6816","nonce":2532904479},{"type":"v1","addr":"172.21.15.78:6817","nonce":2532904479}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6818","nonce":2532904479},{"type":"v1","addr":"172.21.15.78:6819","nonce":2532904479}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6822","nonce":2532904479},{"type":"v1","addr":"172.21.15.78:6823","nonce":2532904479}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6820","nonce":2532904479},{"type":"v1","addr":"172.21.15.78:6821","nonce":2532904479}]},"public_addr":"172.21.15.78:6817/2532904479","cluster_addr":"172.21.15.78:6819/2532904479","heartbeat_back_addr":"172.21.15.78:6823/2532904479","heartbeat_front_addr":"172.21.15.78:6821/2532904479","state":["exists","up"]},{"osd":3,"uuid":"77acc9af-7d4d-4b18-8cf5-d62f5971b7c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6824","nonce":3442991267},{"type":"v1","addr":"172.21.15.78:6825","nonce":3442991267}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6826","nonce":3442991267},{"type":"v1","addr":"172.21.15.78:6827","nonce":3442991267}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6830","nonce":3442991267},{"type":"v1","addr":"172.21.15.78:6831","nonce":3442991267}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6828","nonce":3442991267},{"type":"v1","addr":"172.21.15.78:6829","nonce":3442991267}]},"public_addr":"172.21.15.78:6825/3442991267","cluster_addr":"172.21.15.78:6827/3442991267","heartbeat_back_addr":"172.21.15.78:6831/3442991267","heartbeat_front_addr":"172.21.15.78:6829/3442991267","state":["exists","up"]},{"osd":4,"uuid":"5c62bc66-6b34-4b7f-a66b-9a743969138c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":802983577},{"type":"v1","addr":"172.21.15.179:6809","nonce":802983577}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":802983577},{"type":"v1","addr":"172.21.15.179:6811","nonce":802983577}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":802983577},{"type":"v1","addr":"172.21.15.179:6815","nonce":802983577}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":802983577},{"type":"v1","addr":"172.21.15.179:6813","nonce":802983577}]},"public_addr":"172.21.15.179:6809/802983577","cluster_addr":"172.21.15.179:6811/802983577","heartbeat_back_addr":"172.21.15.179:6815/802983577","heartbeat_front_addr":"172.21.15.179:6813/802983577","state":["exists","up"]},{"osd":5,"uuid":"67db6d36-f684-4079-b0cd-82b4dd61461f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":518192887},{"type":"v1","addr":"172.21.15.179:6818","nonce":518192887}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":518192887},{"type":"v1","addr":"172.21.15.179:6822","nonce":518192887}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":518192887},{"type":"v1","addr":"172.21.15.179:6829","nonce":518192887}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6824","nonce":518192887},{"type":"v1","addr":"172.21.15.179:6826","nonce":518192887}]},"public_addr":"172.21.15.179:6818/518192887","cluster_addr":"172.21.15.179:6822/518192887","heartbeat_back_addr":"172.21.15.179:6829/518192887","heartbeat_front_addr":"172.21.15.179:6826/518192887","state":["exists","up"]},{"osd":6,"uuid":"12e670af-5a16-4c81-9f97-defa66cab967","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":815435378},{"type":"v1","addr":"172.21.15.179:6801","nonce":815435378}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":815435378},{"type":"v1","addr":"172.21.15.179:6803","nonce":815435378}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":815435378},{"type":"v1","addr":"172.21.15.179:6807","nonce":815435378}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":815435378},{"type":"v1","addr":"172.21.15.179:6805","nonce":815435378}]},"public_addr":"172.21.15.179:6801/815435378","cluster_addr":"172.21.15.179:6803/815435378","heartbeat_back_addr":"172.21.15.179:6807/815435378","heartbeat_front_addr":"172.21.15.179:6805/815435378","state":["exists","up"]},{"osd":7,"uuid":"fe630650-2eb3-49ad-8676-c341e6332eb1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6817","nonce":2848432339},{"type":"v1","addr":"172.21.15.179:6819","nonce":2848432339}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6821","nonce":2848432339},{"type":"v1","addr":"172.21.15.179:6823","nonce":2848432339}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":2848432339},{"type":"v1","addr":"172.21.15.179:6831","nonce":2848432339}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6825","nonce":2848432339},{"type":"v1","addr":"172.21.15.179:6827","nonce":2848432339}]},"public_addr":"172.21.15.179:6819/2848432339","cluster_addr":"172.21.15.179:6823/2848432339","heartbeat_back_addr":"172.21.15.179:6831/2848432339","heartbeat_front_addr":"172.21.15.179:6827/2848432339","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:58:49.255433+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:58:49.412880+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:58:49.559295+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:58:49.245237+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:58:49.184557+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:58:49.329851+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:58:49.366012+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:58:49.349604+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-28T20:02:44.231 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:44.224+0000 7f7cfdb1d640 1 -- 172.21.15.78:0/2480848327 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f7ce40664a0 msgr2=0x7f7ce4068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:02:44.231 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:44.224+0000 7f7cfdb1d640 1 --2- 172.21.15.78:0/2480848327 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f7ce40664a0 0x7f7ce4068960 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f7ce80ae000 tx=0x7f7ce80a7000 comp rx=0 tx=0).stop 2023-11-28T20:02:44.231 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:44.224+0000 7f7cfdb1d640 1 -- 172.21.15.78:0/2480848327 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7cf8154fd0 msgr2=0x7f7cf80adad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:02:44.231 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:44.224+0000 7f7cfdb1d640 1 --2- 172.21.15.78:0/2480848327 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7cf8154fd0 0x7f7cf80adad0 secure :-1 s=READY pgs=1040 cs=0 l=1 rev1=1 crypto rx=0x7f7cf000efc0 tx=0x7f7cf000c490 comp rx=0 tx=0).stop 2023-11-28T20:02:44.231 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:44.224+0000 7f7cfdb1d640 1 -- 172.21.15.78:0/2480848327 shutdown_connections 2023-11-28T20:02:44.231 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:44.224+0000 7f7cfdb1d640 1 --2- 172.21.15.78:0/2480848327 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f7ce40664a0 0x7f7ce4068960 unknown :-1 s=CLOSED pgs=492 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:44.231 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:44.224+0000 7f7cfdb1d640 1 --2- 172.21.15.78:0/2480848327 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7cf8154fd0 0x7f7cf80adad0 unknown :-1 s=CLOSED pgs=1040 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:44.231 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:44.224+0000 7f7cfdb1d640 1 --2- 172.21.15.78:0/2480848327 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7cf814e570 0x7f7cf80aec30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:44.231 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:44.224+0000 7f7cfdb1d640 1 --2- 172.21.15.78:0/2480848327 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7cf80ca190 0x7f7cf81ed2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:44.231 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:44.224+0000 7f7cfdb1d640 1 -- 172.21.15.78:0/2480848327 >> 172.21.15.78:0/2480848327 conn(0x7f7cf80abb10 msgr2=0x7f7cf814c720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:02:44.231 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:44.228+0000 7f7cfdb1d640 1 -- 172.21.15.78:0/2480848327 shutdown_connections 2023-11-28T20:02:44.232 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:44.228+0000 7f7cfdb1d640 1 -- 172.21.15.78:0/2480848327 wait complete. 2023-11-28T20:02:44.251 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-28T19:58:54.011229+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 13, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-28T20:02:05.787820+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '80', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 14, 'pool_name': 'cephfs_data', 'create_time': '2023-11-28T20:02:06.652305+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '81', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 15, 'pool_name': 'cephfs2_metadata', 'create_time': '2023-11-28T20:02:23.066724+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '84', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs2'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 16, 'pool_name': 'cephfs2_data', 'create_time': '2023-11-28T20:02:24.230614+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '85', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs2'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-28T20:02:44.251 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-28T20:02:44.392 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:44.388+0000 7faa664aa640 1 Processor -- start 2023-11-28T20:02:44.392 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:44.388+0000 7faa664aa640 1 -- start start 2023-11-28T20:02:44.395 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:44.388+0000 7faa664aa640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7faa6014b1e0 0x7faa600c1700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:44.491 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:44.388+0000 7faa664aa640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7faa600c5300 0x7faa600a9c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:44.577 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:44.388+0000 7faa664aa640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faa600a4e20 con 0x7faa60151280 2023-11-28T20:02:44.670 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:44.388+0000 7faa664aa640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faa601558d0 con 0x7faa600c5300 2023-11-28T20:02:44.768 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:44.388+0000 7faa664aa640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa600a50e0 con 0x7faa6014b1e0 2023-11-28T20:02:44.889 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:44.388+0000 7faa64a47640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7faa60151280 0x7faa60151710 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:50072/0 (socket says 172.21.15.78:50072) 2023-11-28T20:02:45.058 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:44.388+0000 7faa64a47640 1 -- 172.21.15.78:0/3380538747 learned_addr learned my addr 172.21.15.78:0/3380538747 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-11-28T20:02:45.154 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:44.388+0000 7faa5f7fe640 1 --2- 172.21.15.78:0/3380538747 >> v2:172.21.15.179:3300/0 conn(0x7faa600c5300 0x7faa600a9c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:02:45.262 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:44.388+0000 7faa5ffff640 1 --2- 172.21.15.78:0/3380538747 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7faa6014b1e0 0x7faa600c1700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:02:45.262 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:44.388+0000 7faa5effd640 1 -- 172.21.15.78:0/3380538747 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1645657108 0 0) 0x7faa600a4e20 con 0x7faa60151280 2023-11-28T20:02:45.262 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:44.388+0000 7faa5effd640 1 -- 172.21.15.78:0/3380538747 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7faa48003530 con 0x7faa60151280 2023-11-28T20:02:45.262 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:44.388+0000 7faa5f7fe640 1 -- 172.21.15.78:0/3380538747 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7faa6014b1e0 msgr2=0x7faa600c1700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:02:45.262 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:44.388+0000 7faa5f7fe640 1 --2- 172.21.15.78:0/3380538747 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7faa6014b1e0 0x7faa600c1700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:45.262 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:44.388+0000 7faa5f7fe640 1 -- 172.21.15.78:0/3380538747 >> v1:172.21.15.78:6789/0 conn(0x7faa60151280 legacy=0x7faa60151710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:02:45.262 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:44.388+0000 7faa5f7fe640 1 -- 172.21.15.78:0/3380538747 --> v2:172.21.15.179:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa600c0f00 con 0x7faa600c5300 2023-11-28T20:02:45.266 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:44.392+0000 7faa5f7fe640 1 --2- 172.21.15.78:0/3380538747 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7faa600c5300 0x7faa600a9c30 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7faa540097c0 tx=0x7faa5401c480 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4a2517f5e9fd21c3 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:02:45.267 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:44.392+0000 7faa5effd640 1 -- 172.21.15.78:0/3380538747 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa540ad640 con 0x7faa600c5300 2023-11-28T20:02:45.267 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:44.392+0000 7faa5effd640 1 -- 172.21.15.78:0/3380538747 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa540ad7a0 con 0x7faa600c5300 2023-11-28T20:02:45.267 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:44.392+0000 7faa5effd640 1 -- 172.21.15.78:0/3380538747 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa540adb30 con 0x7faa600c5300 2023-11-28T20:02:45.267 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:44.392+0000 7faa664aa640 1 -- 172.21.15.78:0/3380538747 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7faa600c5300 msgr2=0x7faa600a9c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:02:45.267 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:44.392+0000 7faa664aa640 1 --2- 172.21.15.78:0/3380538747 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7faa600c5300 0x7faa600a9c30 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7faa540097c0 tx=0x7faa5401c480 comp rx=0 tx=0).stop 2023-11-28T20:02:45.267 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:44.392+0000 7faa664aa640 1 -- 172.21.15.78:0/3380538747 shutdown_connections 2023-11-28T20:02:45.267 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:44.392+0000 7faa664aa640 1 --2- 172.21.15.78:0/3380538747 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7faa600c5300 0x7faa600a9c30 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:45.267 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:44.392+0000 7faa664aa640 1 --2- 172.21.15.78:0/3380538747 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7faa6014b1e0 0x7faa600c1700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:45.267 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:44.392+0000 7faa664aa640 1 -- 172.21.15.78:0/3380538747 >> 172.21.15.78:0/3380538747 conn(0x7faa600c59f0 msgr2=0x7faa600c5e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:02:45.267 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:44.392+0000 7faa664aa640 1 -- 172.21.15.78:0/3380538747 shutdown_connections 2023-11-28T20:02:45.268 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:44.392+0000 7faa664aa640 1 -- 172.21.15.78:0/3380538747 wait complete. 2023-11-28T20:02:45.268 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:44.396+0000 7faa664aa640 1 Processor -- start 2023-11-28T20:02:45.268 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:44.396+0000 7faa664aa640 1 -- start start 2023-11-28T20:02:45.268 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:44.396+0000 7faa664aa640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7faa600c5300 0x7faa601ed850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:45.268 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:44.396+0000 7faa664aa640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7faa6014b1e0 0x7faa60146ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:45.268 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:44.396+0000 7faa664aa640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7faa60151280 0x7faa60072180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:45.268 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:44.396+0000 7faa664aa640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa601edd90 con 0x7faa60151280 2023-11-28T20:02:45.268 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:44.396+0000 7faa664aa640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa60144650 con 0x7faa600c5300 2023-11-28T20:02:45.268 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:44.396+0000 7faa664aa640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa60147f60 con 0x7faa6014b1e0 2023-11-28T20:02:45.268 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:44.396+0000 7faa64a47640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7faa60151280 0x7faa60072180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:02:45.268 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:44.396+0000 7faa64a47640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7faa60151280 0x7faa60072180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:50960/0 (socket says 172.21.15.78:50960) 2023-11-28T20:02:45.268 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:44.396+0000 7faa64a47640 1 -- 172.21.15.78:0/1210484348 learned_addr learned my addr 172.21.15.78:0/1210484348 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T20:02:45.269 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:44.396+0000 7faa5f7fe640 1 --2- 172.21.15.78:0/1210484348 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7faa6014b1e0 0x7faa60146ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:02:45.269 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:44.396+0000 7faa5ffff640 1 --2- 172.21.15.78:0/1210484348 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7faa600c5300 0x7faa601ed850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:02:45.269 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:44.396+0000 7faa64a47640 1 -- 172.21.15.78:0/1210484348 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7faa6014b1e0 msgr2=0x7faa60146ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:02:45.269 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:44.396+0000 7faa64a47640 1 --2- 172.21.15.78:0/1210484348 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7faa6014b1e0 0x7faa60146ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:45.269 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:44.396+0000 7faa64a47640 1 -- 172.21.15.78:0/1210484348 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7faa600c5300 msgr2=0x7faa601ed850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:02:45.269 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:44.396+0000 7faa64a47640 1 --2- 172.21.15.78:0/1210484348 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7faa600c5300 0x7faa601ed850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:45.269 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:44.396+0000 7faa64a47640 1 -- 172.21.15.78:0/1210484348 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa54009420 con 0x7faa60151280 2023-11-28T20:02:45.269 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:44.396+0000 7faa5ffff640 1 --2- 172.21.15.78:0/1210484348 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7faa600c5300 0x7faa601ed850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T20:02:45.269 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:44.396+0000 7faa64a47640 1 --2- 172.21.15.78:0/1210484348 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7faa60151280 0x7faa60072180 secure :-1 s=READY pgs=1042 cs=0 l=1 rev1=1 crypto rx=0x7faa5800cb30 tx=0x7faa5800a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:02:45.269 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:44.396+0000 7faa5cff9640 1 -- 172.21.15.78:0/1210484348 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa5800aca0 con 0x7faa60151280 2023-11-28T20:02:45.269 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:44.396+0000 7faa5cff9640 1 -- 172.21.15.78:0/1210484348 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa5800ae00 con 0x7faa60151280 2023-11-28T20:02:45.270 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:44.396+0000 7faa5cff9640 1 -- 172.21.15.78:0/1210484348 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa58012600 con 0x7faa60151280 2023-11-28T20:02:45.270 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:44.396+0000 7faa664aa640 1 -- 172.21.15.78:0/1210484348 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faa60148240 con 0x7faa60151280 2023-11-28T20:02:45.270 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:44.396+0000 7faa664aa640 1 -- 172.21.15.78:0/1210484348 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faa60148800 con 0x7faa60151280 2023-11-28T20:02:45.270 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:44.400+0000 7faa664aa640 1 -- 172.21.15.78:0/1210484348 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faa60067630 con 0x7faa60151280 2023-11-28T20:02:45.270 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:44.400+0000 7faa5cff9640 1 -- 172.21.15.78:0/1210484348 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7faa58012820 con 0x7faa60151280 2023-11-28T20:02:45.270 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:44.400+0000 7faa5cff9640 1 --2- 172.21.15.78:0/1210484348 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7faa4c066470 0x7faa4c068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:45.270 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:44.400+0000 7faa5cff9640 1 -- 172.21.15.78:0/1210484348 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6885+0+0 (secure 0 0 0) 0x7faa58084280 con 0x7faa60151280 2023-11-28T20:02:45.270 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:44.400+0000 7faa5ffff640 1 --2- 172.21.15.78:0/1210484348 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7faa4c066470 0x7faa4c068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:02:45.270 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:44.400+0000 7faa5ffff640 1 --2- 172.21.15.78:0/1210484348 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7faa4c066470 0x7faa4c068930 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7faa600bfde0 tx=0x7faa50008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:02:45.270 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:44.404+0000 7faa5cff9640 1 -- 172.21.15.78:0/1210484348 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7faa58051300 con 0x7faa60151280 2023-11-28T20:02:45.270 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:44.556+0000 7faa664aa640 1 -- 172.21.15.78:0/1210484348 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7faa601448b0 con 0x7faa60151280 2023-11-28T20:02:45.270 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:44.556+0000 7faa5cff9640 1 -- 172.21.15.78:0/1210484348 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v85) v1 ==== 93+0+10 (secure 0 0 0) 0x7faa58054920 con 0x7faa60151280 2023-11-28T20:02:45.271 INFO:teuthology.orchestra.run.smithi078.stdout:pg_num: 1 2023-11-28T20:02:45.272 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:44.556+0000 7faa664aa640 1 -- 172.21.15.78:0/1210484348 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7faa4c066470 msgr2=0x7faa4c068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:02:45.272 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:44.556+0000 7faa664aa640 1 --2- 172.21.15.78:0/1210484348 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7faa4c066470 0x7faa4c068930 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7faa600bfde0 tx=0x7faa50008040 comp rx=0 tx=0).stop 2023-11-28T20:02:45.272 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:44.556+0000 7faa664aa640 1 -- 172.21.15.78:0/1210484348 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7faa60151280 msgr2=0x7faa60072180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:02:45.272 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:44.556+0000 7faa664aa640 1 --2- 172.21.15.78:0/1210484348 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7faa60151280 0x7faa60072180 secure :-1 s=READY pgs=1042 cs=0 l=1 rev1=1 crypto rx=0x7faa5800cb30 tx=0x7faa5800a060 comp rx=0 tx=0).stop 2023-11-28T20:02:45.272 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:44.556+0000 7faa664aa640 1 -- 172.21.15.78:0/1210484348 shutdown_connections 2023-11-28T20:02:45.272 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:44.556+0000 7faa664aa640 1 --2- 172.21.15.78:0/1210484348 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7faa4c066470 0x7faa4c068930 unknown :-1 s=CLOSED pgs=493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:45.273 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:44.556+0000 7faa664aa640 1 --2- 172.21.15.78:0/1210484348 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7faa6014b1e0 0x7faa60146ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:45.273 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:44.556+0000 7faa664aa640 1 --2- 172.21.15.78:0/1210484348 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7faa60151280 0x7faa60072180 unknown :-1 s=CLOSED pgs=1042 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:45.273 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:44.556+0000 7faa664aa640 1 --2- 172.21.15.78:0/1210484348 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7faa600c5300 0x7faa601ed850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:45.273 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:44.556+0000 7faa664aa640 1 -- 172.21.15.78:0/1210484348 >> 172.21.15.78:0/1210484348 conn(0x7faa600c59f0 msgr2=0x7faa60145020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:02:45.273 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:44.556+0000 7faa664aa640 1 -- 172.21.15.78:0/1210484348 shutdown_connections 2023-11-28T20:02:45.273 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:44.556+0000 7faa664aa640 1 -- 172.21.15.78:0/1210484348 wait complete. 2023-11-28T20:02:45.273 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-28T20:02:45.417 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:45.412+0000 7f3cc2467640 1 Processor -- start 2023-11-28T20:02:45.418 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:45.412+0000 7f3cc2467640 1 -- start start 2023-11-28T20:02:45.419 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:45.416+0000 7f3cc2467640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3cbc0726f0 0x7f3cbc06a5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:45.419 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:45.416+0000 7f3cc2467640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f3cbc0c2750 0x7f3cbc070580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:45.419 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:45.416+0000 7f3cc2467640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3cbc1508a0 con 0x7f3cbc14dcc0 2023-11-28T20:02:45.419 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:45.416+0000 7f3cc2467640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3cbc0712a0 con 0x7f3cbc0c2750 2023-11-28T20:02:45.419 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:45.416+0000 7f3cc2467640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3cbc0c1fa0 con 0x7f3cbc0726f0 2023-11-28T20:02:45.420 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:45.416+0000 7f3cc1465640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f3cbc14dcc0 0x7f3cbc151080 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:41814/0 (socket says 172.21.15.78:41814) 2023-11-28T20:02:45.420 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:45.416+0000 7f3cc1465640 1 -- 172.21.15.78:0/2045664531 learned_addr learned my addr 172.21.15.78:0/2045664531 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-11-28T20:02:45.421 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:45.416+0000 7f3cc0c64640 1 --2- 172.21.15.78:0/2045664531 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3cbc0726f0 0x7f3cbc06a5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:02:45.421 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:45.416+0000 7f3cc1c66640 1 --2- 172.21.15.78:0/2045664531 >> v2:172.21.15.179:3300/0 conn(0x7f3cbc0c2750 0x7f3cbc070580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:02:45.422 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:45.416+0000 7f3cb3fff640 1 -- 172.21.15.78:0/2045664531 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3684759809 0 0) 0x7f3cbc1508a0 con 0x7f3cbc14dcc0 2023-11-28T20:02:45.422 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:45.416+0000 7f3cb3fff640 1 -- 172.21.15.78:0/2045664531 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3ca8003530 con 0x7f3cbc14dcc0 2023-11-28T20:02:45.422 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:45.416+0000 7f3cb3fff640 1 -- 172.21.15.78:0/2045664531 <== mon.0 v1:172.21.15.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 217049810 0 0) 0x7f3ca8003530 con 0x7f3cbc14dcc0 2023-11-28T20:02:45.422 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:45.416+0000 7f3cb3fff640 1 -- 172.21.15.78:0/2045664531 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3cbc0726f0 msgr2=0x7f3cbc06a5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:02:45.422 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:45.416+0000 7f3cb3fff640 1 --2- 172.21.15.78:0/2045664531 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3cbc0726f0 0x7f3cbc06a5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:45.422 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:45.416+0000 7f3cb3fff640 1 -- 172.21.15.78:0/2045664531 >> v2:172.21.15.179:3300/0 conn(0x7f3cbc0c2750 msgr2=0x7f3cbc070580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:02:45.422 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:45.416+0000 7f3cb3fff640 1 --2- 172.21.15.78:0/2045664531 >> v2:172.21.15.179:3300/0 conn(0x7f3cbc0c2750 0x7f3cbc070580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:45.422 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:45.416+0000 7f3cb3fff640 1 -- 172.21.15.78:0/2045664531 --> v1:172.21.15.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3cbc0c2280 con 0x7f3cbc14dcc0 2023-11-28T20:02:45.422 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:45.416+0000 7f3cb3fff640 1 -- 172.21.15.78:0/2045664531 <== mon.0 v1:172.21.15.78:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3326804700 0 0) 0x7f3cb8001680 con 0x7f3cbc14dcc0 2023-11-28T20:02:45.422 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:45.416+0000 7f3cb3fff640 1 -- 172.21.15.78:0/2045664531 >> v1:172.21.15.78:6789/0 conn(0x7f3cbc14dcc0 legacy=0x7f3cbc151080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:02:45.422 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:45.416+0000 7f3cb3fff640 1 --2- 172.21.15.78:0/2045664531 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3ca8003980 0x7f3ca8003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:45.423 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:45.416+0000 7f3cb3fff640 1 --2- 172.21.15.78:0/2045664531 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3cbc0726f0 0x7f3ca80047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:45.423 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:45.416+0000 7f3cb3fff640 1 --2- 172.21.15.78:0/2045664531 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3ca8004d10 0x7f3ca8005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:45.423 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:45.416+0000 7f3cb3fff640 1 -- 172.21.15.78:0/2045664531 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3cbc0712a0 con 0x7f3ca8003980 2023-11-28T20:02:45.423 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:45.416+0000 7f3cb3fff640 1 -- 172.21.15.78:0/2045664531 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3cbc0c1fa0 con 0x7f3ca8004d10 2023-11-28T20:02:45.423 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:45.416+0000 7f3cb3fff640 1 -- 172.21.15.78:0/2045664531 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ca8005960 con 0x7f3cbc0726f0 2023-11-28T20:02:45.423 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:45.416+0000 7f3cc1465640 1 --2- 172.21.15.78:0/2045664531 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3ca8003980 0x7f3ca8003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:02:45.423 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:45.416+0000 7f3cc0c64640 1 --2- 172.21.15.78:0/2045664531 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3cbc0726f0 0x7f3ca80047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:02:45.423 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:45.416+0000 7f3cc1c66640 1 --2- 172.21.15.78:0/2045664531 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3ca8004d10 0x7f3ca8005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:02:45.423 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:45.416+0000 7f3cc1465640 1 -- 172.21.15.78:0/2045664531 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3cbc0726f0 msgr2=0x7f3ca80047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:02:45.423 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:45.416+0000 7f3cc1465640 1 --2- 172.21.15.78:0/2045664531 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3cbc0726f0 0x7f3ca80047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:45.423 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:45.416+0000 7f3cc1465640 1 -- 172.21.15.78:0/2045664531 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3ca8004d10 msgr2=0x7f3ca8005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:02:45.424 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:45.416+0000 7f3cc1465640 1 --2- 172.21.15.78:0/2045664531 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3ca8004d10 0x7f3ca8005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:45.424 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:45.416+0000 7f3cc1465640 1 -- 172.21.15.78:0/2045664531 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ca8003530 con 0x7f3ca8003980 2023-11-28T20:02:45.425 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:45.420+0000 7f3cc1465640 1 --2- 172.21.15.78:0/2045664531 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3ca8003980 0x7f3ca8003da0 secure :-1 s=READY pgs=1044 cs=0 l=1 rev1=1 crypto rx=0x7f3cb800c0e0 tx=0x7f3cb801cb30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f80af7714fce6be0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:02:45.425 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:45.420+0000 7f3cb3fff640 1 -- 172.21.15.78:0/2045664531 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cb80058e0 con 0x7f3ca8003980 2023-11-28T20:02:45.425 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:45.420+0000 7f3cb3fff640 1 -- 172.21.15.78:0/2045664531 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3cb8005a40 con 0x7f3ca8003980 2023-11-28T20:02:45.425 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:45.420+0000 7f3cb3fff640 1 -- 172.21.15.78:0/2045664531 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cb8005df0 con 0x7f3ca8003980 2023-11-28T20:02:45.425 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:45.420+0000 7f3cc2467640 1 -- 172.21.15.78:0/2045664531 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3ca8003980 msgr2=0x7f3ca8003da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:02:45.425 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:45.420+0000 7f3cc2467640 1 --2- 172.21.15.78:0/2045664531 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3ca8003980 0x7f3ca8003da0 secure :-1 s=READY pgs=1044 cs=0 l=1 rev1=1 crypto rx=0x7f3cb800c0e0 tx=0x7f3cb801cb30 comp rx=0 tx=0).stop 2023-11-28T20:02:45.425 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:45.420+0000 7f3cc1c66640 1 -- 172.21.15.78:0/2045664531 reap_dead start 2023-11-28T20:02:45.425 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:45.420+0000 7f3cc2467640 1 -- 172.21.15.78:0/2045664531 shutdown_connections 2023-11-28T20:02:45.425 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:45.420+0000 7f3cc2467640 1 -- 172.21.15.78:0/2045664531 >> 172.21.15.78:0/2045664531 conn(0x7f3cbc0c2d40 msgr2=0x7f3cbc0c3150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:02:45.426 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:45.420+0000 7f3cc2467640 1 -- 172.21.15.78:0/2045664531 shutdown_connections 2023-11-28T20:02:45.426 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:45.420+0000 7f3cc2467640 1 -- 172.21.15.78:0/2045664531 wait complete. 2023-11-28T20:02:45.426 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:45.420+0000 7f3cc2467640 1 Processor -- start 2023-11-28T20:02:45.426 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:45.420+0000 7f3cc2467640 1 -- start start 2023-11-28T20:02:45.428 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:45.424+0000 7f3cc2467640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3ca8003980 0x7f3cbc14ff20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:45.428 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:45.424+0000 7f3cc2467640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3cbc149320 0x7f3cbc13aa30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:45.428 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:45.424+0000 7f3cc2467640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3cbc13af70 0x7f3cbc1ebd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:45.428 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:45.424+0000 7f3cc2467640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3cbc0c5b40 con 0x7f3cbc149320 2023-11-28T20:02:45.428 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:45.424+0000 7f3cc2467640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3cbc150460 con 0x7f3ca8003980 2023-11-28T20:02:45.428 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:45.424+0000 7f3cc2467640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3cbc13b3f0 con 0x7f3cbc13af70 2023-11-28T20:02:45.428 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:45.424+0000 7f3cc0c64640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3cbc149320 0x7f3cbc13aa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:02:45.428 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:45.424+0000 7f3cc0c64640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3cbc149320 0x7f3cbc13aa30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:50014/0 (socket says 172.21.15.78:50014) 2023-11-28T20:02:45.428 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:45.424+0000 7f3cc0c64640 1 -- 172.21.15.78:0/1680170966 learned_addr learned my addr 172.21.15.78:0/1680170966 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T20:02:45.428 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:45.424+0000 7f3cc1465640 1 --2- 172.21.15.78:0/1680170966 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3ca8003980 0x7f3cbc14ff20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:02:45.429 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:45.424+0000 7f3cc1c66640 1 --2- 172.21.15.78:0/1680170966 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3cbc13af70 0x7f3cbc1ebd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:02:45.429 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:45.424+0000 7f3cc0c64640 1 -- 172.21.15.78:0/1680170966 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3cbc13af70 msgr2=0x7f3cbc1ebd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:02:45.429 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:45.424+0000 7f3cc0c64640 1 --2- 172.21.15.78:0/1680170966 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3cbc13af70 0x7f3cbc1ebd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:45.429 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:45.424+0000 7f3cc0c64640 1 -- 172.21.15.78:0/1680170966 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3ca8003980 msgr2=0x7f3cbc14ff20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:02:45.429 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:45.424+0000 7f3cc0c64640 1 --2- 172.21.15.78:0/1680170966 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3ca8003980 0x7f3cbc14ff20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:45.429 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:45.424+0000 7f3cc0c64640 1 -- 172.21.15.78:0/1680170966 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3cbc0c51c0 con 0x7f3cbc149320 2023-11-28T20:02:45.429 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:45.424+0000 7f3cc0c64640 1 --2- 172.21.15.78:0/1680170966 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3cbc149320 0x7f3cbc13aa30 secure :-1 s=READY pgs=1045 cs=0 l=1 rev1=1 crypto rx=0x7f3cac011990 tx=0x7f3cac011e50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:02:45.430 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:45.424+0000 7f3cb1ffb640 1 -- 172.21.15.78:0/1680170966 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cac00fad0 con 0x7f3cbc149320 2023-11-28T20:02:45.430 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:45.424+0000 7f3cb1ffb640 1 -- 172.21.15.78:0/1680170966 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3cac00fc30 con 0x7f3cbc149320 2023-11-28T20:02:45.430 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:45.424+0000 7f3cb1ffb640 1 -- 172.21.15.78:0/1680170966 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cac014440 con 0x7f3cbc149320 2023-11-28T20:02:45.430 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:45.424+0000 7f3cc2467640 1 -- 172.21.15.78:0/1680170966 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3cbc150670 con 0x7f3cbc149320 2023-11-28T20:02:45.430 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:45.424+0000 7f3cc2467640 1 -- 172.21.15.78:0/1680170966 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3cbc0c5760 con 0x7f3cbc149320 2023-11-28T20:02:45.430 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:45.424+0000 7f3cc2467640 1 -- 172.21.15.78:0/1680170966 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3cbc0674b0 con 0x7f3cbc149320 2023-11-28T20:02:45.431 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:45.424+0000 7f3cb1ffb640 1 -- 172.21.15.78:0/1680170966 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f3cac0145a0 con 0x7f3cbc149320 2023-11-28T20:02:45.431 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:45.428+0000 7f3cb1ffb640 1 --2- 172.21.15.78:0/1680170966 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f3ca00664a0 0x7f3ca0068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:45.431 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:45.428+0000 7f3cb1ffb640 1 -- 172.21.15.78:0/1680170966 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6885+0+0 (secure 0 0 0) 0x7f3cac0849d0 con 0x7f3cbc149320 2023-11-28T20:02:45.432 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:45.428+0000 7f3cc1465640 1 --2- 172.21.15.78:0/1680170966 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f3ca00664a0 0x7f3ca0068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:02:45.432 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:45.428+0000 7f3cc1465640 1 --2- 172.21.15.78:0/1680170966 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f3ca00664a0 0x7f3ca0068960 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f3cb80aa000 tx=0x7f3cb8000ff0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:02:45.435 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:45.432+0000 7f3cb1ffb640 1 -- 172.21.15.78:0/1680170966 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f3cac051a50 con 0x7f3cbc149320 2023-11-28T20:02:45.585 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:45.580+0000 7f3cc2467640 1 -- 172.21.15.78:0/1680170966 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f3cbc0c0c40 con 0x7f3cbc149320 2023-11-28T20:02:45.585 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:45.580+0000 7f3cb1ffb640 1 -- 172.21.15.78:0/1680170966 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v85) v1 ==== 104+0+11 (secure 0 0 0) 0x7f3cac0220a0 con 0x7f3cbc149320 2023-11-28T20:02:45.586 INFO:teuthology.orchestra.run.smithi078.stdout:pg_num: 32 2023-11-28T20:02:45.587 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:45.584+0000 7f3cc2467640 1 -- 172.21.15.78:0/1680170966 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f3ca00664a0 msgr2=0x7f3ca0068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:02:45.587 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:45.584+0000 7f3cc2467640 1 --2- 172.21.15.78:0/1680170966 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f3ca00664a0 0x7f3ca0068960 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f3cb80aa000 tx=0x7f3cb8000ff0 comp rx=0 tx=0).stop 2023-11-28T20:02:45.588 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:45.584+0000 7f3cc2467640 1 -- 172.21.15.78:0/1680170966 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3cbc149320 msgr2=0x7f3cbc13aa30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:02:45.588 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:45.584+0000 7f3cc2467640 1 --2- 172.21.15.78:0/1680170966 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3cbc149320 0x7f3cbc13aa30 secure :-1 s=READY pgs=1045 cs=0 l=1 rev1=1 crypto rx=0x7f3cac011990 tx=0x7f3cac011e50 comp rx=0 tx=0).stop 2023-11-28T20:02:45.588 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:45.584+0000 7f3cc2467640 1 -- 172.21.15.78:0/1680170966 shutdown_connections 2023-11-28T20:02:45.588 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:45.584+0000 7f3cc2467640 1 --2- 172.21.15.78:0/1680170966 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f3ca00664a0 0x7f3ca0068960 unknown :-1 s=CLOSED pgs=494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:45.588 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:45.584+0000 7f3cc2467640 1 --2- 172.21.15.78:0/1680170966 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3cbc13af70 0x7f3cbc1ebd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:45.588 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:45.584+0000 7f3cc2467640 1 --2- 172.21.15.78:0/1680170966 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3cbc149320 0x7f3cbc13aa30 unknown :-1 s=CLOSED pgs=1045 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:45.588 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:45.584+0000 7f3cc2467640 1 --2- 172.21.15.78:0/1680170966 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3ca8003980 0x7f3cbc14ff20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:45.588 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:45.584+0000 7f3cc2467640 1 -- 172.21.15.78:0/1680170966 >> 172.21.15.78:0/1680170966 conn(0x7f3cbc0c2d40 msgr2=0x7f3cbc155560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:02:45.588 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:45.584+0000 7f3cc2467640 1 -- 172.21.15.78:0/1680170966 shutdown_connections 2023-11-28T20:02:45.588 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:45.584+0000 7f3cc2467640 1 -- 172.21.15.78:0/1680170966 wait complete. 2023-11-28T20:02:45.606 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-28T20:02:45.746 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:45.740+0000 7f83d0879640 1 Processor -- start 2023-11-28T20:02:45.746 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:45.740+0000 7f83d0879640 1 -- start start 2023-11-28T20:02:45.747 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:45.744+0000 7f83d0879640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f83cc14fc30 0x7f83cc0c3cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:45.747 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:45.744+0000 7f83d0879640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f83cc06d840 0x7f83cc0c4210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:45.747 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:45.744+0000 7f83d0879640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f83cc152910 con 0x7f83cc14f850 2023-11-28T20:02:45.747 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:45.744+0000 7f83d0879640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f83cc0c2240 con 0x7f83cc06d840 2023-11-28T20:02:45.748 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:45.744+0000 7f83d0879640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83cc152bf0 con 0x7f83cc14fc30 2023-11-28T20:02:45.748 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:45.744+0000 7f83cad9d640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f83cc06d840 0x7f83cc0c4210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:02:45.748 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:45.744+0000 7f83ca59c640 1 --1- >> v1:172.21.15.179:6789/0 conn(0x7f83cc14f850 0x7f83cc0aacf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.179:6789/0 says I am v1:172.21.15.78:43826/0 (socket says 172.21.15.78:43826) 2023-11-28T20:02:45.749 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:45.744+0000 7f83c3fff640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f83cc14fc30 0x7f83cc0c3cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:02:45.749 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:45.744+0000 7f83ca59c640 1 -- 172.21.15.78:0/3656448609 learned_addr learned my addr 172.21.15.78:0/3656448609 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-11-28T20:02:45.749 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:45.744+0000 7f83c3fff640 1 -- 172.21.15.78:0/3656448609 >> v2:172.21.15.179:3300/0 conn(0x7f83cc06d840 msgr2=0x7f83cc0c4210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:02:45.749 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:45.744+0000 7f83c3fff640 1 --2- 172.21.15.78:0/3656448609 >> v2:172.21.15.179:3300/0 conn(0x7f83cc06d840 0x7f83cc0c4210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:45.749 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:45.744+0000 7f83c3fff640 1 -- 172.21.15.78:0/3656448609 >> v1:172.21.15.179:6789/0 conn(0x7f83cc14f850 legacy=0x7f83cc0aacf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:02:45.749 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:45.744+0000 7f83c9d9b640 1 -- 172.21.15.78:0/3656448609 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3664770451 0 0) 0x7f83cc152910 con 0x7f83cc14f850 2023-11-28T20:02:45.749 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:45.744+0000 7f83c3fff640 1 -- 172.21.15.78:0/3656448609 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83cc152ed0 con 0x7f83cc14fc30 2023-11-28T20:02:45.751 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:45.748+0000 7f83c3fff640 1 --2- 172.21.15.78:0/3656448609 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f83cc14fc30 0x7f83cc0c3cd0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f83b40097c0 tx=0x7f83b401c480 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b06e4858eee936e4 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:02:45.752 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:45.748+0000 7f83c9d9b640 1 -- 172.21.15.78:0/3656448609 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83b40ac410 con 0x7f83cc14fc30 2023-11-28T20:02:45.752 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:45.748+0000 7f83c9d9b640 1 -- 172.21.15.78:0/3656448609 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f83b40ac570 con 0x7f83cc14fc30 2023-11-28T20:02:45.752 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:45.748+0000 7f83c9d9b640 1 -- 172.21.15.78:0/3656448609 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83b40ac900 con 0x7f83cc14fc30 2023-11-28T20:02:45.753 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:45.748+0000 7f83d0879640 1 -- 172.21.15.78:0/3656448609 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f83cc14fc30 msgr2=0x7f83cc0c3cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:02:45.753 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:45.748+0000 7f83d0879640 1 --2- 172.21.15.78:0/3656448609 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f83cc14fc30 0x7f83cc0c3cd0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f83b40097c0 tx=0x7f83b401c480 comp rx=0 tx=0).stop 2023-11-28T20:02:45.753 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:45.748+0000 7f83d0879640 1 -- 172.21.15.78:0/3656448609 shutdown_connections 2023-11-28T20:02:45.753 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:45.748+0000 7f83d0879640 1 --2- 172.21.15.78:0/3656448609 >> v2:172.21.15.179:3300/0 conn(0x7f83cc06d840 0x7f83cc0c4210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:45.753 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:45.748+0000 7f83d0879640 1 --2- 172.21.15.78:0/3656448609 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f83cc14fc30 0x7f83cc0c3cd0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:45.753 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:45.748+0000 7f83d0879640 1 -- 172.21.15.78:0/3656448609 >> 172.21.15.78:0/3656448609 conn(0x7f83cc0c59f0 msgr2=0x7f83cc0c5e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:02:45.753 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:45.748+0000 7f83d0879640 1 -- 172.21.15.78:0/3656448609 shutdown_connections 2023-11-28T20:02:45.753 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:45.748+0000 7f83d0879640 1 -- 172.21.15.78:0/3656448609 wait complete. 2023-11-28T20:02:45.754 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:45.748+0000 7f83d0879640 1 Processor -- start 2023-11-28T20:02:45.754 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:45.748+0000 7f83d0879640 1 -- start start 2023-11-28T20:02:45.757 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:45.752+0000 7f83d0879640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f83cc06d840 0x7f83cc0aa510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:45.757 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:45.752+0000 7f83d0879640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f83cc14f850 0x7f83cc0720d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:45.757 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:45.752+0000 7f83d0879640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f83cc14fc30 0x7f83cc072610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:45.757 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:45.752+0000 7f83d0879640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83cc0a6540 con 0x7f83cc14fc30 2023-11-28T20:02:45.757 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:45.752+0000 7f83d0879640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83cc072b50 con 0x7f83cc06d840 2023-11-28T20:02:45.757 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:45.752+0000 7f83d0879640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83cc0a5530 con 0x7f83cc14f850 2023-11-28T20:02:45.757 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:45.752+0000 7f83cad9d640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f83cc14fc30 0x7f83cc072610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:02:45.757 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:45.752+0000 7f83cad9d640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f83cc14fc30 0x7f83cc072610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:50030/0 (socket says 172.21.15.78:50030) 2023-11-28T20:02:45.758 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:45.752+0000 7f83cad9d640 1 -- 172.21.15.78:0/1678935849 learned_addr learned my addr 172.21.15.78:0/1678935849 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T20:02:45.758 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:45.752+0000 7f83ca59c640 1 --2- 172.21.15.78:0/1678935849 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f83cc06d840 0x7f83cc0aa510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:02:45.758 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:45.752+0000 7f83c3fff640 1 --2- 172.21.15.78:0/1678935849 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f83cc14f850 0x7f83cc0720d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:02:45.758 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:45.752+0000 7f83cad9d640 1 -- 172.21.15.78:0/1678935849 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f83cc14f850 msgr2=0x7f83cc0720d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:02:45.758 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:45.752+0000 7f83cad9d640 1 --2- 172.21.15.78:0/1678935849 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f83cc14f850 0x7f83cc0720d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:45.758 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:45.752+0000 7f83cad9d640 1 -- 172.21.15.78:0/1678935849 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f83cc06d840 msgr2=0x7f83cc0aa510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:02:45.758 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:45.752+0000 7f83cad9d640 1 --2- 172.21.15.78:0/1678935849 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f83cc06d840 0x7f83cc0aa510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:45.758 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:45.752+0000 7f83cad9d640 1 -- 172.21.15.78:0/1678935849 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83b4009420 con 0x7f83cc14fc30 2023-11-28T20:02:45.758 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:45.752+0000 7f83cad9d640 1 --2- 172.21.15.78:0/1678935849 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f83cc14fc30 0x7f83cc072610 secure :-1 s=READY pgs=1046 cs=0 l=1 rev1=1 crypto rx=0x7f83c400efc0 tx=0x7f83c400c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:02:45.758 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:45.752+0000 7f83c2ffd640 1 -- 172.21.15.78:0/1678935849 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83c4009ca0 con 0x7f83cc14fc30 2023-11-28T20:02:45.759 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:45.752+0000 7f83c2ffd640 1 -- 172.21.15.78:0/1678935849 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f83c400f040 con 0x7f83cc14fc30 2023-11-28T20:02:45.759 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:45.752+0000 7f83c2ffd640 1 -- 172.21.15.78:0/1678935849 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83c40146c0 con 0x7f83cc14fc30 2023-11-28T20:02:45.759 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:45.752+0000 7f83d0879640 1 -- 172.21.15.78:0/1678935849 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f83cc1472a0 con 0x7f83cc14fc30 2023-11-28T20:02:45.759 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:45.752+0000 7f83d0879640 1 -- 172.21.15.78:0/1678935849 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f83cc0a5a60 con 0x7f83cc14fc30 2023-11-28T20:02:45.760 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:45.752+0000 7f83d0879640 1 -- 172.21.15.78:0/1678935849 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f83cc067630 con 0x7f83cc14fc30 2023-11-28T20:02:45.760 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:45.752+0000 7f83c2ffd640 1 -- 172.21.15.78:0/1678935849 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f83c4014820 con 0x7f83cc14fc30 2023-11-28T20:02:45.760 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:45.756+0000 7f83c2ffd640 1 --2- 172.21.15.78:0/1678935849 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f83ac066470 0x7f83ac068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:45.760 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:45.756+0000 7f83c2ffd640 1 -- 172.21.15.78:0/1678935849 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6885+0+0 (secure 0 0 0) 0x7f83c4085190 con 0x7f83cc14fc30 2023-11-28T20:02:45.760 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:45.756+0000 7f83ca59c640 1 --2- 172.21.15.78:0/1678935849 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f83ac066470 0x7f83ac068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:02:45.760 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:45.756+0000 7f83ca59c640 1 --2- 172.21.15.78:0/1678935849 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f83ac066470 0x7f83ac068930 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f83bc007fd0 tx=0x7f83bc007d60 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:02:45.763 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:45.760+0000 7f83c2ffd640 1 -- 172.21.15.78:0/1678935849 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f83c4052220 con 0x7f83cc14fc30 2023-11-28T20:02:45.914 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:45.908+0000 7f83d0879640 1 -- 172.21.15.78:0/1678935849 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f83cc0a4a90 con 0x7f83cc14fc30 2023-11-28T20:02:45.914 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:45.908+0000 7f83c2ffd640 1 -- 172.21.15.78:0/1678935849 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v85) v1 ==== 100+0+11 (secure 0 0 0) 0x7f83c4055840 con 0x7f83cc14fc30 2023-11-28T20:02:45.915 INFO:teuthology.orchestra.run.smithi078.stdout:pg_num: 64 2023-11-28T20:02:45.916 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:45.912+0000 7f83d0879640 1 -- 172.21.15.78:0/1678935849 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f83ac066470 msgr2=0x7f83ac068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:02:45.916 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:45.912+0000 7f83d0879640 1 --2- 172.21.15.78:0/1678935849 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f83ac066470 0x7f83ac068930 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f83bc007fd0 tx=0x7f83bc007d60 comp rx=0 tx=0).stop 2023-11-28T20:02:45.916 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:45.912+0000 7f83d0879640 1 -- 172.21.15.78:0/1678935849 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f83cc14fc30 msgr2=0x7f83cc072610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:02:45.916 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:45.912+0000 7f83d0879640 1 --2- 172.21.15.78:0/1678935849 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f83cc14fc30 0x7f83cc072610 secure :-1 s=READY pgs=1046 cs=0 l=1 rev1=1 crypto rx=0x7f83c400efc0 tx=0x7f83c400c490 comp rx=0 tx=0).stop 2023-11-28T20:02:45.917 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:45.912+0000 7f83d0879640 1 -- 172.21.15.78:0/1678935849 shutdown_connections 2023-11-28T20:02:45.917 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:45.912+0000 7f83d0879640 1 --2- 172.21.15.78:0/1678935849 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f83ac066470 0x7f83ac068930 unknown :-1 s=CLOSED pgs=495 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:45.917 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:45.912+0000 7f83d0879640 1 --2- 172.21.15.78:0/1678935849 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f83cc14f850 0x7f83cc0720d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:45.917 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:45.912+0000 7f83d0879640 1 --2- 172.21.15.78:0/1678935849 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f83cc14fc30 0x7f83cc072610 unknown :-1 s=CLOSED pgs=1046 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:45.917 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:45.912+0000 7f83d0879640 1 --2- 172.21.15.78:0/1678935849 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f83cc06d840 0x7f83cc0aa510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:45.917 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:45.912+0000 7f83d0879640 1 -- 172.21.15.78:0/1678935849 >> 172.21.15.78:0/1678935849 conn(0x7f83cc0c59f0 msgr2=0x7f83cc1509c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:02:45.917 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:45.912+0000 7f83d0879640 1 -- 172.21.15.78:0/1678935849 shutdown_connections 2023-11-28T20:02:45.917 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:45.912+0000 7f83d0879640 1 -- 172.21.15.78:0/1678935849 wait complete. 2023-11-28T20:02:45.935 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs2_metadata pg_num 2023-11-28T20:02:46.076 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:46.072+0000 7f93b4c17640 1 Processor -- start 2023-11-28T20:02:46.076 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:46.072+0000 7f93b4c17640 1 -- start start 2023-11-28T20:02:46.078 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:46.072+0000 7f93b4c17640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f93b00c5300 0x7f93b00a9c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:46.078 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:46.072+0000 7f93b4c17640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f93b01548c0 0x7f93b0154d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:46.078 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:46.072+0000 7f93b4c17640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f93b00a4e20 con 0x7f93b014b1e0 2023-11-28T20:02:46.078 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:46.072+0000 7f93b4c17640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f93b00a50e0 con 0x7f93b01548c0 2023-11-28T20:02:46.078 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:46.072+0000 7f93b4c17640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f93b00c0f00 con 0x7f93b00c5300 2023-11-28T20:02:46.078 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:46.072+0000 7f93aed9d640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f93b01548c0 0x7f93b0154d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:02:46.078 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:46.072+0000 7f93aed9d640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f93b01548c0 0x7f93b0154d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:50036/0 (socket says 172.21.15.78:50036) 2023-11-28T20:02:46.079 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:46.072+0000 7f93aed9d640 1 -- 172.21.15.78:0/1829330584 learned_addr learned my addr 172.21.15.78:0/1829330584 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T20:02:46.079 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:46.072+0000 7f93a5d9b640 1 --2- 172.21.15.78:0/1829330584 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f93b00c5300 0x7f93b00a9c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:02:46.079 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:46.072+0000 7f93aed9d640 1 -- 172.21.15.78:0/1829330584 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f93b00c5300 msgr2=0x7f93b00a9c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:02:46.079 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:46.072+0000 7f93aed9d640 1 --2- 172.21.15.78:0/1829330584 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f93b00c5300 0x7f93b00a9c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:46.079 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:46.072+0000 7f93aed9d640 1 -- 172.21.15.78:0/1829330584 >> v1:172.21.15.179:6789/0 conn(0x7f93b014b1e0 legacy=0x7f93b00c1700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:02:46.079 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:46.072+0000 7f93aed9d640 1 -- 172.21.15.78:0/1829330584 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93b00c11e0 con 0x7f93b01548c0 2023-11-28T20:02:46.081 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:46.076+0000 7f93aed9d640 1 --2- 172.21.15.78:0/1829330584 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f93b01548c0 0x7f93b0154d50 secure :-1 s=READY pgs=1047 cs=0 l=1 rev1=1 crypto rx=0x7f93a8009870 tx=0x7f93a801c540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7748a739289485b9 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:02:46.081 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:46.076+0000 7f93add9b640 1 -- 172.21.15.78:0/1829330584 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93b01558b0 con 0x7f93b01548c0 2023-11-28T20:02:46.081 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:46.076+0000 7f93add9b640 1 -- 172.21.15.78:0/1829330584 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f93a80ab650 con 0x7f93b01548c0 2023-11-28T20:02:46.081 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:46.076+0000 7f93add9b640 1 -- 172.21.15.78:0/1829330584 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93a80ab9e0 con 0x7f93b01548c0 2023-11-28T20:02:46.082 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:46.076+0000 7f93b4c17640 1 -- 172.21.15.78:0/1829330584 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f93b01548c0 msgr2=0x7f93b0154d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:02:46.082 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:46.076+0000 7f93b4c17640 1 --2- 172.21.15.78:0/1829330584 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f93b01548c0 0x7f93b0154d50 secure :-1 s=READY pgs=1047 cs=0 l=1 rev1=1 crypto rx=0x7f93a8009870 tx=0x7f93a801c540 comp rx=0 tx=0).stop 2023-11-28T20:02:46.082 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:46.076+0000 7f93b4c17640 1 -- 172.21.15.78:0/1829330584 shutdown_connections 2023-11-28T20:02:46.083 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:46.076+0000 7f93b4c17640 1 --2- 172.21.15.78:0/1829330584 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f93b01548c0 0x7f93b0154d50 unknown :-1 s=CLOSED pgs=1047 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:46.083 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:46.076+0000 7f93b4c17640 1 --2- 172.21.15.78:0/1829330584 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f93b00c5300 0x7f93b00a9c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:46.083 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:46.076+0000 7f93b4c17640 1 -- 172.21.15.78:0/1829330584 >> 172.21.15.78:0/1829330584 conn(0x7f93b00c59f0 msgr2=0x7f93b00c5e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:02:46.083 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:46.076+0000 7f93b4c17640 1 -- 172.21.15.78:0/1829330584 shutdown_connections 2023-11-28T20:02:46.083 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:46.076+0000 7f93b4c17640 1 -- 172.21.15.78:0/1829330584 wait complete. 2023-11-28T20:02:46.086 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:46.080+0000 7f93b4c17640 1 Processor -- start 2023-11-28T20:02:46.086 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:46.080+0000 7f93b4c17640 1 -- start start 2023-11-28T20:02:46.086 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:46.080+0000 7f93b4c17640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f93b00c5300 0x7f93b00aab70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:46.086 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:46.080+0000 7f93b4c17640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f93b014b1e0 0x7f93b0141b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:46.086 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:46.080+0000 7f93b4c17640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f93b01548c0 0x7f93b0142070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:46.086 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:46.080+0000 7f93b4c17640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93b01eb990 con 0x7f93b00c5300 2023-11-28T20:02:46.087 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:46.080+0000 7f93b4c17640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93b01425b0 con 0x7f93b01548c0 2023-11-28T20:02:46.087 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:46.080+0000 7f93b4c17640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f93b01eae10 con 0x7f93b014b1e0 2023-11-28T20:02:46.087 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:46.080+0000 7f93ae59c640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f93b00c5300 0x7f93b00aab70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:02:46.087 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:46.080+0000 7f93ae59c640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f93b00c5300 0x7f93b00aab70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:50048/0 (socket says 172.21.15.78:50048) 2023-11-28T20:02:46.087 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:46.080+0000 7f93ae59c640 1 -- 172.21.15.78:0/3894112963 learned_addr learned my addr 172.21.15.78:0/3894112963 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T20:02:46.087 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:46.080+0000 7f93a5d9b640 1 --2- 172.21.15.78:0/3894112963 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f93b014b1e0 0x7f93b0141b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:02:46.087 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:46.080+0000 7f93aed9d640 1 --2- 172.21.15.78:0/3894112963 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f93b01548c0 0x7f93b0142070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:02:46.087 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:46.080+0000 7f93ae59c640 1 -- 172.21.15.78:0/3894112963 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f93b014b1e0 msgr2=0x7f93b0141b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:02:46.087 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:46.080+0000 7f93ae59c640 1 --2- 172.21.15.78:0/3894112963 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f93b014b1e0 0x7f93b0141b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:46.087 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:46.080+0000 7f93ae59c640 1 -- 172.21.15.78:0/3894112963 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f93b01548c0 msgr2=0x7f93b0142070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:02:46.087 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:46.080+0000 7f93ae59c640 1 --2- 172.21.15.78:0/3894112963 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f93b01548c0 0x7f93b0142070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:46.087 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:46.080+0000 7f93ae59c640 1 -- 172.21.15.78:0/3894112963 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93a80094d0 con 0x7f93b00c5300 2023-11-28T20:02:46.088 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:46.080+0000 7f93ae59c640 1 --2- 172.21.15.78:0/3894112963 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f93b00c5300 0x7f93b00aab70 secure :-1 s=READY pgs=1048 cs=0 l=1 rev1=1 crypto rx=0x7f93a000c7f0 tx=0x7f93a000ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:02:46.088 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:46.080+0000 7f93a77fe640 1 -- 172.21.15.78:0/3894112963 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93a0003ba0 con 0x7f93b00c5300 2023-11-28T20:02:46.088 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:46.080+0000 7f93a77fe640 1 -- 172.21.15.78:0/3894112963 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f93a0003d00 con 0x7f93b00c5300 2023-11-28T20:02:46.088 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:46.080+0000 7f93b4c17640 1 -- 172.21.15.78:0/3894112963 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f93b01eb0f0 con 0x7f93b00c5300 2023-11-28T20:02:46.088 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:46.080+0000 7f93a77fe640 1 -- 172.21.15.78:0/3894112963 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93a000aa90 con 0x7f93b00c5300 2023-11-28T20:02:46.088 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:46.080+0000 7f93b4c17640 1 -- 172.21.15.78:0/3894112963 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f93b01eb6b0 con 0x7f93b00c5300 2023-11-28T20:02:46.089 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:46.084+0000 7f93b4c17640 1 -- 172.21.15.78:0/3894112963 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f93b0153300 con 0x7f93b00c5300 2023-11-28T20:02:46.089 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:46.084+0000 7f93a77fe640 1 -- 172.21.15.78:0/3894112963 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f93a000abf0 con 0x7f93b00c5300 2023-11-28T20:02:46.089 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:46.084+0000 7f93a77fe640 1 --2- 172.21.15.78:0/3894112963 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f9390066470 0x7f9390068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:46.089 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:46.084+0000 7f93a77fe640 1 -- 172.21.15.78:0/3894112963 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6885+0+0 (secure 0 0 0) 0x7f93a0083fd0 con 0x7f93b00c5300 2023-11-28T20:02:46.089 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:46.084+0000 7f93a5d9b640 1 --2- 172.21.15.78:0/3894112963 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f9390066470 0x7f9390068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:02:46.089 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:46.084+0000 7f93a5d9b640 1 --2- 172.21.15.78:0/3894112963 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f9390066470 0x7f9390068930 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f93b0151f00 tx=0x7f9398008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:02:46.094 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:46.088+0000 7f93a77fe640 1 -- 172.21.15.78:0/3894112963 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f93a00b5280 con 0x7f93b00c5300 2023-11-28T20:02:46.243 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:46.240+0000 7f93b4c17640 1 -- 172.21.15.78:0/3894112963 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs2_metadata", "var": "pg_num"} v 0) v1 -- 0x7f93b0067630 con 0x7f93b00c5300 2023-11-28T20:02:46.244 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:46.240+0000 7f93a77fe640 1 -- 172.21.15.78:0/3894112963 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs2_metadata", "var": "pg_num"}]=0 v85) v1 ==== 105+0+11 (secure 0 0 0) 0x7f93b0153300 con 0x7f93b00c5300 2023-11-28T20:02:46.244 INFO:teuthology.orchestra.run.smithi078.stdout:pg_num: 32 2023-11-28T20:02:46.246 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:46.240+0000 7f93b4c17640 1 -- 172.21.15.78:0/3894112963 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f9390066470 msgr2=0x7f9390068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:02:46.246 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:46.240+0000 7f93b4c17640 1 --2- 172.21.15.78:0/3894112963 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f9390066470 0x7f9390068930 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f93b0151f00 tx=0x7f9398008040 comp rx=0 tx=0).stop 2023-11-28T20:02:46.246 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:46.240+0000 7f93b4c17640 1 -- 172.21.15.78:0/3894112963 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f93b00c5300 msgr2=0x7f93b00aab70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:02:46.246 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:46.240+0000 7f93b4c17640 1 --2- 172.21.15.78:0/3894112963 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f93b00c5300 0x7f93b00aab70 secure :-1 s=READY pgs=1048 cs=0 l=1 rev1=1 crypto rx=0x7f93a000c7f0 tx=0x7f93a000ccb0 comp rx=0 tx=0).stop 2023-11-28T20:02:46.247 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:46.240+0000 7f93b4c17640 1 -- 172.21.15.78:0/3894112963 shutdown_connections 2023-11-28T20:02:46.247 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:46.240+0000 7f93b4c17640 1 --2- 172.21.15.78:0/3894112963 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f9390066470 0x7f9390068930 unknown :-1 s=CLOSED pgs=496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:46.247 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:46.240+0000 7f93b4c17640 1 --2- 172.21.15.78:0/3894112963 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f93b014b1e0 0x7f93b0141b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:46.247 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:46.240+0000 7f93b4c17640 1 --2- 172.21.15.78:0/3894112963 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f93b01548c0 0x7f93b0142070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:46.247 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:46.240+0000 7f93b4c17640 1 --2- 172.21.15.78:0/3894112963 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f93b00c5300 0x7f93b00aab70 unknown :-1 s=CLOSED pgs=1048 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:46.247 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:46.240+0000 7f93b4c17640 1 -- 172.21.15.78:0/3894112963 >> 172.21.15.78:0/3894112963 conn(0x7f93b00c59f0 msgr2=0x7f93b0149b70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:02:46.247 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:46.240+0000 7f93b4c17640 1 -- 172.21.15.78:0/3894112963 shutdown_connections 2023-11-28T20:02:46.247 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:46.240+0000 7f93b4c17640 1 -- 172.21.15.78:0/3894112963 wait complete. 2023-11-28T20:02:46.265 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs2_data pg_num 2023-11-28T20:02:46.406 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:46.400+0000 7f190a5e6640 1 Processor -- start 2023-11-28T20:02:46.407 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:46.400+0000 7f190a5e6640 1 -- start start 2023-11-28T20:02:46.409 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:46.400+0000 7f190a5e6640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f190414e2a0 0x7f19041516a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:46.409 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:46.400+0000 7f190a5e6640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f19040a9460 0x7f19040c4180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:46.409 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:46.400+0000 7f190a5e6640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1904151210 con 0x7f19040a9910 2023-11-28T20:02:46.409 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:46.400+0000 7f190a5e6640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f190414e680 con 0x7f19040a9460 2023-11-28T20:02:46.410 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:46.400+0000 7f190a5e6640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1904150be0 con 0x7f190414e2a0 2023-11-28T20:02:46.410 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:46.404+0000 7f19037fe640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f19040a9460 0x7f19040c4180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:02:46.410 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:46.404+0000 7f19037fe640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f19040a9460 0x7f19040c4180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:50056/0 (socket says 172.21.15.78:50056) 2023-11-28T20:02:46.410 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:46.404+0000 7f19037fe640 1 -- 172.21.15.78:0/3345936138 learned_addr learned my addr 172.21.15.78:0/3345936138 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T20:02:46.410 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:46.404+0000 7f19037fe640 1 -- 172.21.15.78:0/3345936138 >> v2:172.21.15.179:3300/0 conn(0x7f190414e2a0 msgr2=0x7f19041516a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:02:46.411 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:46.404+0000 7f1903fff640 1 --2- 172.21.15.78:0/3345936138 >> v2:172.21.15.179:3300/0 conn(0x7f190414e2a0 0x7f19041516a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:02:46.411 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:46.404+0000 7f19037fe640 1 --2- 172.21.15.78:0/3345936138 >> v2:172.21.15.179:3300/0 conn(0x7f190414e2a0 0x7f19041516a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:46.411 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:46.404+0000 7f19037fe640 1 -- 172.21.15.78:0/3345936138 >> v1:172.21.15.179:6789/0 conn(0x7f19040a9910 legacy=0x7f190406bc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:02:46.411 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:46.404+0000 7f19037fe640 1 -- 172.21.15.78:0/3345936138 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19040c53c0 con 0x7f19040a9460 2023-11-28T20:02:46.412 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:46.404+0000 7f1903fff640 1 --2- 172.21.15.78:0/3345936138 >> v2:172.21.15.179:3300/0 conn(0x7f190414e2a0 0x7f19041516a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T20:02:46.413 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:46.404+0000 7f19037fe640 1 --2- 172.21.15.78:0/3345936138 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f19040a9460 0x7f19040c4180 secure :-1 s=READY pgs=1049 cs=0 l=1 rev1=1 crypto rx=0x7f19040c6910 tx=0x7f18f801c4c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eb918740904addea server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:02:46.413 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:46.404+0000 7f1902ffd640 1 -- 172.21.15.78:0/3345936138 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18f8004230 con 0x7f19040a9460 2023-11-28T20:02:46.413 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:46.404+0000 7f1902ffd640 1 -- 172.21.15.78:0/3345936138 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f18f80a7050 con 0x7f19040a9460 2023-11-28T20:02:46.413 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:46.404+0000 7f1902ffd640 1 -- 172.21.15.78:0/3345936138 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18f8003620 con 0x7f19040a9460 2023-11-28T20:02:46.414 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:46.408+0000 7f190a5e6640 1 -- 172.21.15.78:0/3345936138 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f19040a9460 msgr2=0x7f19040c4180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:02:46.414 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:46.408+0000 7f190a5e6640 1 --2- 172.21.15.78:0/3345936138 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f19040a9460 0x7f19040c4180 secure :-1 s=READY pgs=1049 cs=0 l=1 rev1=1 crypto rx=0x7f19040c6910 tx=0x7f18f801c4c0 comp rx=0 tx=0).stop 2023-11-28T20:02:46.414 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:46.408+0000 7f190a5e6640 1 -- 172.21.15.78:0/3345936138 shutdown_connections 2023-11-28T20:02:46.414 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:46.408+0000 7f190a5e6640 1 --2- 172.21.15.78:0/3345936138 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f19040a9460 0x7f19040c4180 unknown :-1 s=CLOSED pgs=1049 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:46.414 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:46.408+0000 7f190a5e6640 1 --2- 172.21.15.78:0/3345936138 >> v2:172.21.15.179:3300/0 conn(0x7f190414e2a0 0x7f19041516a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:46.414 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:46.408+0000 7f190a5e6640 1 -- 172.21.15.78:0/3345936138 >> 172.21.15.78:0/3345936138 conn(0x7f19040c59f0 msgr2=0x7f19040c5e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:02:46.414 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:46.408+0000 7f190a5e6640 1 -- 172.21.15.78:0/3345936138 shutdown_connections 2023-11-28T20:02:46.415 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:46.408+0000 7f190a5e6640 1 -- 172.21.15.78:0/3345936138 wait complete. 2023-11-28T20:02:46.415 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:46.408+0000 7f190a5e6640 1 Processor -- start 2023-11-28T20:02:46.415 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:46.408+0000 7f190a5e6640 1 -- start start 2023-11-28T20:02:46.418 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:46.408+0000 7f190a5e6640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f19040a9460 0x7f19041eb6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:46.418 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:46.408+0000 7f190a5e6640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f19040a9910 0x7f1904145f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:46.418 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:46.408+0000 7f190a5e6640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f190414e2a0 0x7f19041ee8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:46.418 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:46.408+0000 7f190a5e6640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1904145a60 con 0x7f19040a9460 2023-11-28T20:02:46.418 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:46.408+0000 7f190a5e6640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19041ee420 con 0x7f190414e2a0 2023-11-28T20:02:46.419 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:46.408+0000 7f190a5e6640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19041ebc30 con 0x7f19040a9910 2023-11-28T20:02:46.419 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:46.408+0000 7f1903fff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f19040a9460 0x7f19041eb6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:02:46.419 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:46.408+0000 7f1903fff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f19040a9460 0x7f19041eb6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:50066/0 (socket says 172.21.15.78:50066) 2023-11-28T20:02:46.419 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:46.408+0000 7f1903fff640 1 -- 172.21.15.78:0/4164750310 learned_addr learned my addr 172.21.15.78:0/4164750310 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T20:02:46.419 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:46.408+0000 7f19037fe640 1 --2- 172.21.15.78:0/4164750310 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f19040a9910 0x7f1904145f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:02:46.419 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:46.408+0000 7f1908b83640 1 --2- 172.21.15.78:0/4164750310 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f190414e2a0 0x7f19041ee8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:02:46.419 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:46.408+0000 7f1903fff640 1 -- 172.21.15.78:0/4164750310 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f19040a9910 msgr2=0x7f1904145f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:02:46.420 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:46.408+0000 7f1903fff640 1 --2- 172.21.15.78:0/4164750310 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f19040a9910 0x7f1904145f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:46.420 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:46.408+0000 7f1903fff640 1 -- 172.21.15.78:0/4164750310 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f190414e2a0 msgr2=0x7f19041ee8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:02:46.420 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:46.408+0000 7f1903fff640 1 --2- 172.21.15.78:0/4164750310 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f190414e2a0 0x7f19041ee8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:46.420 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:46.408+0000 7f1903fff640 1 -- 172.21.15.78:0/4164750310 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18f80094d0 con 0x7f19040a9460 2023-11-28T20:02:46.420 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:46.408+0000 7f19037fe640 1 --2- 172.21.15.78:0/4164750310 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f19040a9910 0x7f1904145f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T20:02:46.420 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:46.412+0000 7f1903fff640 1 --2- 172.21.15.78:0/4164750310 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f19040a9460 0x7f19041eb6f0 secure :-1 s=READY pgs=1050 cs=0 l=1 rev1=1 crypto rx=0x7f18f400c820 tx=0x7f18f400cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:02:46.421 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:46.412+0000 7f1900ff9640 1 -- 172.21.15.78:0/4164750310 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18f4007a30 con 0x7f19040a9460 2023-11-28T20:02:46.421 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:46.412+0000 7f1900ff9640 1 -- 172.21.15.78:0/4164750310 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f18f4007b90 con 0x7f19040a9460 2023-11-28T20:02:46.421 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:46.412+0000 7f1900ff9640 1 -- 172.21.15.78:0/4164750310 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18f400ce10 con 0x7f19040a9460 2023-11-28T20:02:46.421 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:46.412+0000 7f190a5e6640 1 -- 172.21.15.78:0/4164750310 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1904144f20 con 0x7f19040a9460 2023-11-28T20:02:46.421 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:46.412+0000 7f190a5e6640 1 -- 172.21.15.78:0/4164750310 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f19041454a0 con 0x7f19040a9460 2023-11-28T20:02:46.422 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:46.412+0000 7f190a5e6640 1 -- 172.21.15.78:0/4164750310 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1904067630 con 0x7f19040a9460 2023-11-28T20:02:46.422 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:46.412+0000 7f1900ff9640 1 -- 172.21.15.78:0/4164750310 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f18f40113f0 con 0x7f19040a9460 2023-11-28T20:02:46.422 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:46.412+0000 7f1900ff9640 1 --2- 172.21.15.78:0/4164750310 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f18f00664a0 0x7f18f0068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:46.422 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:46.412+0000 7f1900ff9640 1 -- 172.21.15.78:0/4164750310 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6885+0+0 (secure 0 0 0) 0x7f18f4084340 con 0x7f19040a9460 2023-11-28T20:02:46.422 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:46.412+0000 7f19037fe640 1 --2- 172.21.15.78:0/4164750310 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f18f00664a0 0x7f18f0068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:02:46.423 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:46.412+0000 7f19037fe640 1 --2- 172.21.15.78:0/4164750310 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f18f00664a0 0x7f18f0068960 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f18f80ad000 tx=0x7f18f8008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:02:46.423 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:46.416+0000 7f1900ff9640 1 -- 172.21.15.78:0/4164750310 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f18f40513b0 con 0x7f19040a9460 2023-11-28T20:02:46.571 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:46.568+0000 7f190a5e6640 1 -- 172.21.15.78:0/4164750310 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs2_data", "var": "pg_num"} v 0) v1 -- 0x7f19040aad90 con 0x7f19040a9460 2023-11-28T20:02:46.572 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:46.568+0000 7f1900ff9640 1 -- 172.21.15.78:0/4164750310 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs2_data", "var": "pg_num"}]=0 v85) v1 ==== 101+0+11 (secure 0 0 0) 0x7f18f40549d0 con 0x7f19040a9460 2023-11-28T20:02:46.572 INFO:teuthology.orchestra.run.smithi078.stdout:pg_num: 64 2023-11-28T20:02:46.573 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:46.568+0000 7f190a5e6640 1 -- 172.21.15.78:0/4164750310 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f18f00664a0 msgr2=0x7f18f0068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:02:46.574 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:46.568+0000 7f190a5e6640 1 --2- 172.21.15.78:0/4164750310 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f18f00664a0 0x7f18f0068960 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f18f80ad000 tx=0x7f18f8008040 comp rx=0 tx=0).stop 2023-11-28T20:02:46.574 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:46.568+0000 7f190a5e6640 1 -- 172.21.15.78:0/4164750310 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f19040a9460 msgr2=0x7f19041eb6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:02:46.574 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:46.568+0000 7f190a5e6640 1 --2- 172.21.15.78:0/4164750310 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f19040a9460 0x7f19041eb6f0 secure :-1 s=READY pgs=1050 cs=0 l=1 rev1=1 crypto rx=0x7f18f400c820 tx=0x7f18f400cce0 comp rx=0 tx=0).stop 2023-11-28T20:02:46.574 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:46.568+0000 7f190a5e6640 1 -- 172.21.15.78:0/4164750310 shutdown_connections 2023-11-28T20:02:46.574 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:46.568+0000 7f190a5e6640 1 --2- 172.21.15.78:0/4164750310 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f18f00664a0 0x7f18f0068960 unknown :-1 s=CLOSED pgs=497 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:46.574 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:46.568+0000 7f190a5e6640 1 --2- 172.21.15.78:0/4164750310 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f19040a9910 0x7f1904145f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:46.574 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:46.568+0000 7f190a5e6640 1 --2- 172.21.15.78:0/4164750310 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f190414e2a0 0x7f19041ee8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:46.574 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:46.568+0000 7f190a5e6640 1 --2- 172.21.15.78:0/4164750310 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f19040a9460 0x7f19041eb6f0 unknown :-1 s=CLOSED pgs=1050 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:46.574 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:46.568+0000 7f190a5e6640 1 -- 172.21.15.78:0/4164750310 >> 172.21.15.78:0/4164750310 conn(0x7f19040c59f0 msgr2=0x7f190415c5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:02:46.574 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:46.568+0000 7f190a5e6640 1 -- 172.21.15.78:0/4164750310 shutdown_connections 2023-11-28T20:02:46.575 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:46.568+0000 7f190a5e6640 1 -- 172.21.15.78:0/4164750310 wait complete. 2023-11-28T20:02:46.593 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-11-28T20:02:46.731 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:46.724+0000 7f53b9809640 1 Processor -- start 2023-11-28T20:02:46.731 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:46.728+0000 7f53b9809640 1 -- start start 2023-11-28T20:02:46.732 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:46.728+0000 7f53b9809640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f53b414e520 0x7f53b40c5d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:46.732 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:46.728+0000 7f53b9809640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f53b40a6f70 0x7f53b40a7400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:46.732 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:46.728+0000 7f53b9809640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f53b40c51b0 con 0x7f53b4155170 2023-11-28T20:02:46.732 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:46.728+0000 7f53b9809640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f53b414e900 con 0x7f53b414e520 2023-11-28T20:02:46.732 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:46.728+0000 7f53b9809640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f53b40c4ed0 con 0x7f53b40a6f70 2023-11-28T20:02:46.732 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:46.728+0000 7f53b2ffd640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f53b414e520 0x7f53b40c5d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:02:46.732 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:46.728+0000 7f53b2ffd640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f53b414e520 0x7f53b40c5d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:50078/0 (socket says 172.21.15.78:50078) 2023-11-28T20:02:46.732 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:46.728+0000 7f53b2ffd640 1 -- 172.21.15.78:0/1638919698 learned_addr learned my addr 172.21.15.78:0/1638919698 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T20:02:46.732 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:46.728+0000 7f53b37fe640 1 --2- 172.21.15.78:0/1638919698 >> v2:172.21.15.179:3300/0 conn(0x7f53b40a6f70 0x7f53b40a7400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:02:46.733 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:46.728+0000 7f53b2ffd640 1 -- 172.21.15.78:0/1638919698 >> v2:172.21.15.179:3300/0 conn(0x7f53b40a6f70 msgr2=0x7f53b40a7400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:02:46.733 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:46.728+0000 7f53b2ffd640 1 --2- 172.21.15.78:0/1638919698 >> v2:172.21.15.179:3300/0 conn(0x7f53b40a6f70 0x7f53b40a7400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:46.733 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:46.728+0000 7f53b2ffd640 1 -- 172.21.15.78:0/1638919698 >> v1:172.21.15.179:6789/0 conn(0x7f53b4155170 legacy=0x7f53b40c46f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:02:46.733 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:46.728+0000 7f53b2ffd640 1 -- 172.21.15.78:0/1638919698 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53b4154690 con 0x7f53b414e520 2023-11-28T20:02:46.735 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:46.732+0000 7f53b2ffd640 1 --2- 172.21.15.78:0/1638919698 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f53b414e520 0x7f53b40c5d80 secure :-1 s=READY pgs=1051 cs=0 l=1 rev1=1 crypto rx=0x7f53b406db50 tx=0x7f53a401c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b4ce9f927f64de80 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:02:46.736 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:46.732+0000 7f53b27fc640 1 -- 172.21.15.78:0/1638919698 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53a40a5820 con 0x7f53b414e520 2023-11-28T20:02:46.736 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:46.732+0000 7f53b27fc640 1 -- 172.21.15.78:0/1638919698 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f53a40a5980 con 0x7f53b414e520 2023-11-28T20:02:46.736 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:46.732+0000 7f53b27fc640 1 -- 172.21.15.78:0/1638919698 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53a40a5d10 con 0x7f53b414e520 2023-11-28T20:02:46.737 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:46.732+0000 7f53b9809640 1 -- 172.21.15.78:0/1638919698 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f53b414e520 msgr2=0x7f53b40c5d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:02:46.737 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:46.732+0000 7f53b9809640 1 --2- 172.21.15.78:0/1638919698 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f53b414e520 0x7f53b40c5d80 secure :-1 s=READY pgs=1051 cs=0 l=1 rev1=1 crypto rx=0x7f53b406db50 tx=0x7f53a401c960 comp rx=0 tx=0).stop 2023-11-28T20:02:46.737 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:46.732+0000 7f53b9809640 1 -- 172.21.15.78:0/1638919698 shutdown_connections 2023-11-28T20:02:46.737 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:46.732+0000 7f53b9809640 1 --2- 172.21.15.78:0/1638919698 >> v2:172.21.15.179:3300/0 conn(0x7f53b40a6f70 0x7f53b40a7400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:46.737 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:46.732+0000 7f53b9809640 1 --2- 172.21.15.78:0/1638919698 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f53b414e520 0x7f53b40c5d80 unknown :-1 s=CLOSED pgs=1051 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:46.737 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:46.732+0000 7f53b9809640 1 -- 172.21.15.78:0/1638919698 >> 172.21.15.78:0/1638919698 conn(0x7f53b40c7c60 msgr2=0x7f53b40c8070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:02:46.737 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:46.732+0000 7f53b9809640 1 -- 172.21.15.78:0/1638919698 shutdown_connections 2023-11-28T20:02:46.737 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:46.732+0000 7f53b9809640 1 -- 172.21.15.78:0/1638919698 wait complete. 2023-11-28T20:02:46.738 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:46.732+0000 7f53b9809640 1 Processor -- start 2023-11-28T20:02:46.738 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:46.732+0000 7f53b9809640 1 -- start start 2023-11-28T20:02:46.741 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:46.736+0000 7f53b9809640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f53b40a6f70 0x7f53b41ec8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:46.741 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:46.736+0000 7f53b9809640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f53b414e520 0x7f53b41f06d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:46.741 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:46.736+0000 7f53b9809640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f53b4155170 0x7f53b4142990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:46.741 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:46.736+0000 7f53b9809640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53b414fa90 con 0x7f53b4155170 2023-11-28T20:02:46.742 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:46.736+0000 7f53b9809640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53b41ece00 con 0x7f53b40a6f70 2023-11-28T20:02:46.742 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:46.736+0000 7f53b9809640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53b41f0240 con 0x7f53b414e520 2023-11-28T20:02:46.742 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:46.736+0000 7f53b37fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f53b4155170 0x7f53b4142990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:02:46.742 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:46.736+0000 7f53b37fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f53b4155170 0x7f53b4142990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:50094/0 (socket says 172.21.15.78:50094) 2023-11-28T20:02:46.742 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:46.736+0000 7f53b37fe640 1 -- 172.21.15.78:0/1389944309 learned_addr learned my addr 172.21.15.78:0/1389944309 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T20:02:46.742 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:46.736+0000 7f53b2ffd640 1 --2- 172.21.15.78:0/1389944309 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f53b40a6f70 0x7f53b41ec8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:02:46.742 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:46.736+0000 7f53aa7fc640 1 --2- 172.21.15.78:0/1389944309 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f53b414e520 0x7f53b41f06d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:02:46.742 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:46.736+0000 7f53b37fe640 1 -- 172.21.15.78:0/1389944309 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f53b414e520 msgr2=0x7f53b41f06d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:02:46.742 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:46.736+0000 7f53b37fe640 1 --2- 172.21.15.78:0/1389944309 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f53b414e520 0x7f53b41f06d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:46.742 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:46.736+0000 7f53b37fe640 1 -- 172.21.15.78:0/1389944309 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f53b40a6f70 msgr2=0x7f53b41ec8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:02:46.742 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:46.736+0000 7f53b37fe640 1 --2- 172.21.15.78:0/1389944309 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f53b40a6f70 0x7f53b41ec8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:46.743 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:46.736+0000 7f53b37fe640 1 -- 172.21.15.78:0/1389944309 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53a4009b30 con 0x7f53b4155170 2023-11-28T20:02:46.743 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:46.736+0000 7f53b37fe640 1 --2- 172.21.15.78:0/1389944309 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f53b4155170 0x7f53b4142990 secure :-1 s=READY pgs=1052 cs=0 l=1 rev1=1 crypto rx=0x7f53ac00d590 tx=0x7f53ac00da50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:02:46.743 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:46.736+0000 7f53b0ff9640 1 -- 172.21.15.78:0/1389944309 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53ac0125f0 con 0x7f53b4155170 2023-11-28T20:02:46.743 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:46.736+0000 7f53b0ff9640 1 -- 172.21.15.78:0/1389944309 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f53ac012770 con 0x7f53b4155170 2023-11-28T20:02:46.743 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:46.736+0000 7f53b9809640 1 -- 172.21.15.78:0/1389944309 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f53b414ea40 con 0x7f53b4155170 2023-11-28T20:02:46.743 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:46.736+0000 7f53b0ff9640 1 -- 172.21.15.78:0/1389944309 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53ac012b20 con 0x7f53b4155170 2023-11-28T20:02:46.743 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:46.736+0000 7f53b9809640 1 -- 172.21.15.78:0/1389944309 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f53b414f000 con 0x7f53b4155170 2023-11-28T20:02:46.743 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:46.736+0000 7f53b9809640 1 -- 172.21.15.78:0/1389944309 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f53b41f03d0 con 0x7f53b4155170 2023-11-28T20:02:46.744 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:46.736+0000 7f53b0ff9640 1 -- 172.21.15.78:0/1389944309 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f53ac012c80 con 0x7f53b4155170 2023-11-28T20:02:46.745 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:46.740+0000 7f53b0ff9640 1 --2- 172.21.15.78:0/1389944309 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f5394066470 0x7f5394068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:46.745 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:46.740+0000 7f53b0ff9640 1 -- 172.21.15.78:0/1389944309 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6885+0+0 (secure 0 0 0) 0x7f53ac084690 con 0x7f53b4155170 2023-11-28T20:02:46.745 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:46.740+0000 7f53b2ffd640 1 --2- 172.21.15.78:0/1389944309 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f5394066470 0x7f5394068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:02:46.745 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:46.740+0000 7f53b2ffd640 1 --2- 172.21.15.78:0/1389944309 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f5394066470 0x7f5394068930 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f53a40ae000 tx=0x7f53a40a7070 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:02:46.747 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:46.744+0000 7f53b0ff9640 1 -- 172.21.15.78:0/1389944309 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f53ac051710 con 0x7f53b4155170 2023-11-28T20:02:46.911 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:46.908+0000 7f53b9809640 1 -- 172.21.15.78:0/1389944309 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f53b4067630 con 0x7f53b4155170 2023-11-28T20:02:46.911 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:46.908+0000 7f53b0ff9640 1 -- 172.21.15.78:0/1389944309 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v85) v1 ==== 80+0+0 (secure 0 0 0) 0x7f53ac054d30 con 0x7f53b4155170 2023-11-28T20:02:46.912 INFO:teuthology.orchestra.run.smithi078.stderr:listed 0 entries 2023-11-28T20:02:46.914 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:46.908+0000 7f53b9809640 1 -- 172.21.15.78:0/1389944309 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f5394066470 msgr2=0x7f5394068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:02:46.914 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:46.908+0000 7f53b9809640 1 --2- 172.21.15.78:0/1389944309 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f5394066470 0x7f5394068930 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f53a40ae000 tx=0x7f53a40a7070 comp rx=0 tx=0).stop 2023-11-28T20:02:46.914 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:46.908+0000 7f53b9809640 1 -- 172.21.15.78:0/1389944309 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f53b4155170 msgr2=0x7f53b4142990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:02:46.914 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:46.908+0000 7f53b9809640 1 --2- 172.21.15.78:0/1389944309 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f53b4155170 0x7f53b4142990 secure :-1 s=READY pgs=1052 cs=0 l=1 rev1=1 crypto rx=0x7f53ac00d590 tx=0x7f53ac00da50 comp rx=0 tx=0).stop 2023-11-28T20:02:46.914 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:46.908+0000 7f53b9809640 1 -- 172.21.15.78:0/1389944309 shutdown_connections 2023-11-28T20:02:46.914 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:46.908+0000 7f53b9809640 1 --2- 172.21.15.78:0/1389944309 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f5394066470 0x7f5394068930 unknown :-1 s=CLOSED pgs=498 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:46.914 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:46.908+0000 7f53b9809640 1 --2- 172.21.15.78:0/1389944309 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f53b414e520 0x7f53b41f06d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:46.915 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:46.908+0000 7f53b9809640 1 --2- 172.21.15.78:0/1389944309 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f53b4155170 0x7f53b4142990 unknown :-1 s=CLOSED pgs=1052 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:46.915 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:46.908+0000 7f53b9809640 1 --2- 172.21.15.78:0/1389944309 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f53b40a6f70 0x7f53b41ec8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:46.915 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:46.908+0000 7f53b9809640 1 -- 172.21.15.78:0/1389944309 >> 172.21.15.78:0/1389944309 conn(0x7f53b40c7c60 msgr2=0x7f53b414b5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:02:46.915 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:46.908+0000 7f53b9809640 1 -- 172.21.15.78:0/1389944309 shutdown_connections 2023-11-28T20:02:46.915 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:46.908+0000 7f53b9809640 1 -- 172.21.15.78:0/1389944309 wait complete. 2023-11-28T20:02:46.932 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.testuser... 2023-11-28T20:02:46.932 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T20:02:46.932 DEBUG:teuthology.orchestra.run.smithi078:> sudo umount /home/ubuntu/cephtest/mnt.0 2023-11-28T20:02:46.959 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi078.front.sepia.ceph.com 2023-11-28T20:02:46.960 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T20:02:46.960 DEBUG:teuthology.orchestra.run.smithi078:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-11-28T20:02:47.015 DEBUG:teuthology.orchestra.run.smithi179:> set -ex 2023-11-28T20:02:47.015 DEBUG:teuthology.orchestra.run.smithi179:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-28T20:02:47.025 DEBUG:teuthology.orchestra.run.smithi179:> set -ex 2023-11-28T20:02:47.025 DEBUG:teuthology.orchestra.run.smithi179:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-28T20:02:47.082 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-28T20:02:47.219 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:47.212+0000 7f86b4e9e640 1 Processor -- start 2023-11-28T20:02:47.219 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:47.212+0000 7f86b4e9e640 1 -- start start 2023-11-28T20:02:47.220 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:47.216+0000 7f86b4e9e640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f86b006bef0 0x7f86b00bfce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:47.220 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:47.216+0000 7f86b4e9e640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f86b0151690 con 0x7f86b006c5b0 2023-11-28T20:02:47.220 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:47.216+0000 7f86b4e9e640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f86b0151bc0 con 0x7f86b014e3f0 2023-11-28T20:02:47.220 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:47.216+0000 7f86b4e9e640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f86b01518e0 con 0x7f86b006bef0 2023-11-28T20:02:47.220 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:47.216+0000 7f86aed9d640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f86b006c5b0 0x7f86b006ca20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:41822/0 (socket says 172.21.15.78:41822) 2023-11-28T20:02:47.220 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:47.216+0000 7f86aed9d640 1 -- 172.21.15.78:0/2287380534 learned_addr learned my addr 172.21.15.78:0/2287380534 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-11-28T20:02:47.220 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:47.216+0000 7f86a7fff640 1 --2- 172.21.15.78:0/2287380534 >> v2:172.21.15.78:3300/0 conn(0x7f86b006bef0 0x7f86b00bfce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:02:47.221 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:47.216+0000 7f86add9b640 1 -- 172.21.15.78:0/2287380534 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2765035827 0 0) 0x7f86b0151690 con 0x7f86b006c5b0 2023-11-28T20:02:47.221 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:47.216+0000 7f86add9b640 1 -- 172.21.15.78:0/2287380534 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f869c003450 con 0x7f86b006c5b0 2023-11-28T20:02:47.221 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:47.216+0000 7f86a7fff640 1 -- 172.21.15.78:0/2287380534 >> v1:172.21.15.179:6789/0 conn(0x7f86b014e3f0 legacy=0x7f86b00c41f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:02:47.222 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:47.216+0000 7f86a7fff640 1 -- 172.21.15.78:0/2287380534 >> v1:172.21.15.78:6789/0 conn(0x7f86b006c5b0 legacy=0x7f86b006ca20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:02:47.222 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:47.216+0000 7f86a7fff640 1 -- 172.21.15.78:0/2287380534 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86b00c1de0 con 0x7f86b006bef0 2023-11-28T20:02:47.223 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:47.220+0000 7f86a7fff640 1 --2- 172.21.15.78:0/2287380534 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f86b006bef0 0x7f86b00bfce0 secure :-1 s=READY pgs=1054 cs=0 l=1 rev1=1 crypto rx=0x7f86980097c0 tx=0x7f869801c3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c002d416735be5cd server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:02:47.224 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:47.220+0000 7f86add9b640 1 -- 172.21.15.78:0/2287380534 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86980ab600 con 0x7f86b006bef0 2023-11-28T20:02:47.224 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:47.220+0000 7f86add9b640 1 -- 172.21.15.78:0/2287380534 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f86980a7050 con 0x7f86b006bef0 2023-11-28T20:02:47.224 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:47.220+0000 7f86add9b640 1 -- 172.21.15.78:0/2287380534 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86980ab980 con 0x7f86b006bef0 2023-11-28T20:02:47.224 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:47.220+0000 7f86b4e9e640 1 -- 172.21.15.78:0/2287380534 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f86b006bef0 msgr2=0x7f86b00bfce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:02:47.225 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:47.220+0000 7f86b4e9e640 1 --2- 172.21.15.78:0/2287380534 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f86b006bef0 0x7f86b00bfce0 secure :-1 s=READY pgs=1054 cs=0 l=1 rev1=1 crypto rx=0x7f86980097c0 tx=0x7f869801c3c0 comp rx=0 tx=0).stop 2023-11-28T20:02:47.225 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:47.220+0000 7f86b4e9e640 1 -- 172.21.15.78:0/2287380534 shutdown_connections 2023-11-28T20:02:47.225 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:47.220+0000 7f86b4e9e640 1 --2- 172.21.15.78:0/2287380534 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f86b006bef0 0x7f86b00bfce0 unknown :-1 s=CLOSED pgs=1054 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:47.225 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:47.220+0000 7f86b4e9e640 1 -- 172.21.15.78:0/2287380534 >> 172.21.15.78:0/2287380534 conn(0x7f86b00a7810 msgr2=0x7f86b00a7c20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:02:47.225 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:47.220+0000 7f86b4e9e640 1 -- 172.21.15.78:0/2287380534 shutdown_connections 2023-11-28T20:02:47.225 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:47.220+0000 7f86b4e9e640 1 -- 172.21.15.78:0/2287380534 wait complete. 2023-11-28T20:02:47.226 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:47.220+0000 7f86b4e9e640 1 Processor -- start 2023-11-28T20:02:47.226 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:47.220+0000 7f86b4e9e640 1 -- start start 2023-11-28T20:02:47.229 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:47.224+0000 7f86b4e9e640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f86b006bef0 0x7f86b014f040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:47.229 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:47.224+0000 7f86b4e9e640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f86b006c5b0 0x7f86b0141af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:47.230 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:47.224+0000 7f86b4e9e640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f86b014e3f0 0x7f86b0142030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:47.230 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:47.224+0000 7f86b4e9e640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86b014ffc0 con 0x7f86b006c5b0 2023-11-28T20:02:47.230 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:47.224+0000 7f86b4e9e640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86b01ed790 con 0x7f86b006bef0 2023-11-28T20:02:47.230 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:47.224+0000 7f86b4e9e640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86b014fa00 con 0x7f86b014e3f0 2023-11-28T20:02:47.230 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:47.224+0000 7f86a7fff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f86b006c5b0 0x7f86b0141af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:02:47.230 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:47.224+0000 7f86a7fff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f86b006c5b0 0x7f86b0141af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:50112/0 (socket says 172.21.15.78:50112) 2023-11-28T20:02:47.230 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:47.224+0000 7f86a7fff640 1 -- 172.21.15.78:0/883154150 learned_addr learned my addr 172.21.15.78:0/883154150 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T20:02:47.230 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:47.224+0000 7f86ae59c640 1 --2- 172.21.15.78:0/883154150 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f86b006bef0 0x7f86b014f040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:02:47.230 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:47.224+0000 7f86aed9d640 1 --2- 172.21.15.78:0/883154150 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f86b014e3f0 0x7f86b0142030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:02:47.230 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:47.224+0000 7f86a7fff640 1 -- 172.21.15.78:0/883154150 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f86b014e3f0 msgr2=0x7f86b0142030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:02:47.230 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:47.224+0000 7f86a7fff640 1 --2- 172.21.15.78:0/883154150 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f86b014e3f0 0x7f86b0142030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:47.231 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:47.224+0000 7f86a7fff640 1 -- 172.21.15.78:0/883154150 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f86b006bef0 msgr2=0x7f86b014f040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:02:47.231 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:47.224+0000 7f86a7fff640 1 --2- 172.21.15.78:0/883154150 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f86b006bef0 0x7f86b014f040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:47.231 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:47.224+0000 7f86a7fff640 1 -- 172.21.15.78:0/883154150 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8698009420 con 0x7f86b006c5b0 2023-11-28T20:02:47.231 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:47.224+0000 7f86ae59c640 1 --2- 172.21.15.78:0/883154150 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f86b006bef0 0x7f86b014f040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T20:02:47.231 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:47.224+0000 7f86a7fff640 1 --2- 172.21.15.78:0/883154150 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f86b006c5b0 0x7f86b0141af0 secure :-1 s=READY pgs=1055 cs=0 l=1 rev1=1 crypto rx=0x7f86980ae040 tx=0x7f8698019160 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:02:47.231 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:47.224+0000 7f86a6ffd640 1 -- 172.21.15.78:0/883154150 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8698006e20 con 0x7f86b006c5b0 2023-11-28T20:02:47.231 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:47.224+0000 7f86a6ffd640 1 -- 172.21.15.78:0/883154150 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f86980b4410 con 0x7f86b006c5b0 2023-11-28T20:02:47.231 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:47.224+0000 7f86a6ffd640 1 -- 172.21.15.78:0/883154150 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86980b47a0 con 0x7f86b006c5b0 2023-11-28T20:02:47.231 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:47.224+0000 7f86b4e9e640 1 -- 172.21.15.78:0/883154150 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f86b014fce0 con 0x7f86b006c5b0 2023-11-28T20:02:47.232 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:47.224+0000 7f86b4e9e640 1 -- 172.21.15.78:0/883154150 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f86b00a4dc0 con 0x7f86b006c5b0 2023-11-28T20:02:47.232 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:47.224+0000 7f86b4e9e640 1 -- 172.21.15.78:0/883154150 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f86b0070910 con 0x7f86b006c5b0 2023-11-28T20:02:47.232 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:47.228+0000 7f86a6ffd640 1 -- 172.21.15.78:0/883154150 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f86980b2040 con 0x7f86b006c5b0 2023-11-28T20:02:47.233 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:47.228+0000 7f86a6ffd640 1 --2- 172.21.15.78:0/883154150 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f86900664a0 0x7f8690068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:47.233 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:47.228+0000 7f86a6ffd640 1 -- 172.21.15.78:0/883154150 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6885+0+0 (secure 0 0 0) 0x7f869811e210 con 0x7f86b006c5b0 2023-11-28T20:02:47.233 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:47.228+0000 7f86ae59c640 1 --2- 172.21.15.78:0/883154150 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f86900664a0 0x7f8690068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:02:47.233 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:47.228+0000 7f86ae59c640 1 --2- 172.21.15.78:0/883154150 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f86900664a0 0x7f8690068960 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f86b01511f0 tx=0x7f86a0009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:02:47.236 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:47.232+0000 7f86a6ffd640 1 -- 172.21.15.78:0/883154150 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f86b0070910 con 0x7f86b006c5b0 2023-11-28T20:02:47.389 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:47.384+0000 7f86b4e9e640 1 -- 172.21.15.78:0/883154150 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f86b0070910 con 0x7f86b006c5b0 2023-11-28T20:02:47.390 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:47.384+0000 7f86a6ffd640 1 -- 172.21.15.78:0/883154150 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v85) v1 ==== 74+0+20339 (secure 0 0 0) 0x7f86b0070910 con 0x7f86b006c5b0 2023-11-28T20:02:47.391 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-11-28T20:02:47.391 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":85,"fsid":"dd9780e8-3bda-44fa-a9f0-fa07d19d901d","created":"2023-11-28T19:58:40.969556+0000","modified":"2023-11-28T20:02:26.796715+0000","last_up_change":"2023-11-28T19:58:52.596716+0000","last_in_change":"2023-11-28T19:58:43.609275+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":16,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-28T19:58:54.011229+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_metadata","create_time":"2023-11-28T20:02:05.787820+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs_data","create_time":"2023-11-28T20:02:06.652305+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs2_metadata","create_time":"2023-11-28T20:02:23.066724+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":16,"pool_name":"cephfs2_data","create_time":"2023-11-28T20:02:24.230614+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs2"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e84245ac-b5da-429e-af18-39acaa2b33e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6800","nonce":3358701235},{"type":"v1","addr":"172.21.15.78:6801","nonce":3358701235}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6802","nonce":3358701235},{"type":"v1","addr":"172.21.15.78:6803","nonce":3358701235}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6806","nonce":3358701235},{"type":"v1","addr":"172.21.15.78:6807","nonce":3358701235}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6804","nonce":3358701235},{"type":"v1","addr":"172.21.15.78:6805","nonce":3358701235}]},"public_addr":"172.21.15.78:6801/3358701235","cluster_addr":"172.21.15.78:6803/3358701235","heartbeat_back_addr":"172.21.15.78:6807/3358701235","heartbeat_front_addr":"172.21.15.78:6805/3358701235","state":["exists","up"]},{"osd":1,"uuid":"e634831d-c4e2-48d9-870c-9556ae162981","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6808","nonce":3211476654},{"type":"v1","addr":"172.21.15.78:6809","nonce":3211476654}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6810","nonce":3211476654},{"type":"v1","addr":"172.21.15.78:6811","nonce":3211476654}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6814","nonce":3211476654},{"type":"v1","addr":"172.21.15.78:6815","nonce":3211476654}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6812","nonce":3211476654},{"type":"v1","addr":"172.21.15.78:6813","nonce":3211476654}]},"public_addr":"172.21.15.78:6809/3211476654","cluster_addr":"172.21.15.78:6811/3211476654","heartbeat_back_addr":"172.21.15.78:6815/3211476654","heartbeat_front_addr":"172.21.15.78:6813/3211476654","state":["exists","up"]},{"osd":2,"uuid":"274c8395-6534-41f0-b8fb-a00af8985aa8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6816","nonce":2532904479},{"type":"v1","addr":"172.21.15.78:6817","nonce":2532904479}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6818","nonce":2532904479},{"type":"v1","addr":"172.21.15.78:6819","nonce":2532904479}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6822","nonce":2532904479},{"type":"v1","addr":"172.21.15.78:6823","nonce":2532904479}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6820","nonce":2532904479},{"type":"v1","addr":"172.21.15.78:6821","nonce":2532904479}]},"public_addr":"172.21.15.78:6817/2532904479","cluster_addr":"172.21.15.78:6819/2532904479","heartbeat_back_addr":"172.21.15.78:6823/2532904479","heartbeat_front_addr":"172.21.15.78:6821/2532904479","state":["exists","up"]},{"osd":3,"uuid":"77acc9af-7d4d-4b18-8cf5-d62f5971b7c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6824","nonce":3442991267},{"type":"v1","addr":"172.21.15.78:6825","nonce":3442991267}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6826","nonce":3442991267},{"type":"v1","addr":"172.21.15.78:6827","nonce":3442991267}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6830","nonce":3442991267},{"type":"v1","addr":"172.21.15.78:6831","nonce":3442991267}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6828","nonce":3442991267},{"type":"v1","addr":"172.21.15.78:6829","nonce":3442991267}]},"public_addr":"172.21.15.78:6825/3442991267","cluster_addr":"172.21.15.78:6827/3442991267","heartbeat_back_addr":"172.21.15.78:6831/3442991267","heartbeat_front_addr":"172.21.15.78:6829/3442991267","state":["exists","up"]},{"osd":4,"uuid":"5c62bc66-6b34-4b7f-a66b-9a743969138c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":802983577},{"type":"v1","addr":"172.21.15.179:6809","nonce":802983577}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":802983577},{"type":"v1","addr":"172.21.15.179:6811","nonce":802983577}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":802983577},{"type":"v1","addr":"172.21.15.179:6815","nonce":802983577}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":802983577},{"type":"v1","addr":"172.21.15.179:6813","nonce":802983577}]},"public_addr":"172.21.15.179:6809/802983577","cluster_addr":"172.21.15.179:6811/802983577","heartbeat_back_addr":"172.21.15.179:6815/802983577","heartbeat_front_addr":"172.21.15.179:6813/802983577","state":["exists","up"]},{"osd":5,"uuid":"67db6d36-f684-4079-b0cd-82b4dd61461f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":518192887},{"type":"v1","addr":"172.21.15.179:6818","nonce":518192887}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":518192887},{"type":"v1","addr":"172.21.15.179:6822","nonce":518192887}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":518192887},{"type":"v1","addr":"172.21.15.179:6829","nonce":518192887}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6824","nonce":518192887},{"type":"v1","addr":"172.21.15.179:6826","nonce":518192887}]},"public_addr":"172.21.15.179:6818/518192887","cluster_addr":"172.21.15.179:6822/518192887","heartbeat_back_addr":"172.21.15.179:6829/518192887","heartbeat_front_addr":"172.21.15.179:6826/518192887","state":["exists","up"]},{"osd":6,"uuid":"12e670af-5a16-4c81-9f97-defa66cab967","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":815435378},{"type":"v1","addr":"172.21.15.179:6801","nonce":815435378}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":815435378},{"type":"v1","addr":"172.21.15.179:6803","nonce":815435378}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":815435378},{"type":"v1","addr":"172.21.15.179:6807","nonce":815435378}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":815435378},{"type":"v1","addr":"172.21.15.179:6805","nonce":815435378}]},"public_addr":"172.21.15.179:6801/815435378","cluster_addr":"172.21.15.179:6803/815435378","heartbeat_back_addr":"172.21.15.179:6807/815435378","heartbeat_front_addr":"172.21.15.179:6805/815435378","state":["exists","up"]},{"osd":7,"uuid":"fe630650-2eb3-49ad-8676-c341e6332eb1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6817","nonce":2848432339},{"type":"v1","addr":"172.21.15.179:6819","nonce":2848432339}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6821","nonce":2848432339},{"type":"v1","addr":"172.21.15.179:6823","nonce":2848432339}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":2848432339},{"type":"v1","addr":"172.21.15.179:6831","nonce":2848432339}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6825","nonce":2848432339},{"type":"v1","addr":"172.21.15.179:6827","nonce":2848432339}]},"public_addr":"172.21.15.179:6819/2848432339","cluster_addr":"172.21.15.179:6823/2848432339","heartbeat_back_addr":"172.21.15.179:6831/2848432339","heartbeat_front_addr":"172.21.15.179:6827/2848432339","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:58:49.255433+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:58:49.412880+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:58:49.559295+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:58:49.245237+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:58:49.184557+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:58:49.329851+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:58:49.366012+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:58:49.349604+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-28T20:02:47.393 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:47.388+0000 7f86b4e9e640 1 -- 172.21.15.78:0/883154150 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f86900664a0 msgr2=0x7f8690068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:02:47.393 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:47.388+0000 7f86b4e9e640 1 --2- 172.21.15.78:0/883154150 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f86900664a0 0x7f8690068960 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f86b01511f0 tx=0x7f86a0009040 comp rx=0 tx=0).stop 2023-11-28T20:02:47.393 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:47.388+0000 7f86b4e9e640 1 -- 172.21.15.78:0/883154150 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f86b006c5b0 msgr2=0x7f86b0141af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:02:47.393 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:47.388+0000 7f86b4e9e640 1 --2- 172.21.15.78:0/883154150 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f86b006c5b0 0x7f86b0141af0 secure :-1 s=READY pgs=1055 cs=0 l=1 rev1=1 crypto rx=0x7f86980ae040 tx=0x7f8698019160 comp rx=0 tx=0).stop 2023-11-28T20:02:47.393 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:47.388+0000 7f86b4e9e640 1 -- 172.21.15.78:0/883154150 shutdown_connections 2023-11-28T20:02:47.393 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:47.388+0000 7f86b4e9e640 1 --2- 172.21.15.78:0/883154150 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f86900664a0 0x7f8690068960 unknown :-1 s=CLOSED pgs=499 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:47.393 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:47.388+0000 7f86b4e9e640 1 --2- 172.21.15.78:0/883154150 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f86b014e3f0 0x7f86b0142030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:47.393 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:47.388+0000 7f86b4e9e640 1 --2- 172.21.15.78:0/883154150 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f86b006c5b0 0x7f86b0141af0 unknown :-1 s=CLOSED pgs=1055 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:47.393 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:47.388+0000 7f86b4e9e640 1 --2- 172.21.15.78:0/883154150 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f86b006bef0 0x7f86b014f040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:47.394 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:47.388+0000 7f86b4e9e640 1 -- 172.21.15.78:0/883154150 >> 172.21.15.78:0/883154150 conn(0x7f86b00a7810 msgr2=0x7f86b00bee90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:02:47.394 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:47.388+0000 7f86b4e9e640 1 -- 172.21.15.78:0/883154150 shutdown_connections 2023-11-28T20:02:47.394 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:47.388+0000 7f86b4e9e640 1 -- 172.21.15.78:0/883154150 wait complete. 2023-11-28T20:02:47.412 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-28T19:58:54.011229+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 13, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-28T20:02:05.787820+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '80', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 14, 'pool_name': 'cephfs_data', 'create_time': '2023-11-28T20:02:06.652305+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '81', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 15, 'pool_name': 'cephfs2_metadata', 'create_time': '2023-11-28T20:02:23.066724+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '84', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs2'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 16, 'pool_name': 'cephfs2_data', 'create_time': '2023-11-28T20:02:24.230614+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '85', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs2'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-28T20:02:47.413 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-28T20:02:47.554 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:47.548+0000 7fccb8abb640 1 Processor -- start 2023-11-28T20:02:47.554 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:47.548+0000 7fccb8abb640 1 -- start start 2023-11-28T20:02:47.556 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:47.552+0000 7fccb8abb640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fccb414e8e0 0x7fccb4154f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:47.556 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:47.552+0000 7fccb8abb640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fccb40c0250 0x7fccb406c670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:47.556 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:47.552+0000 7fccb8abb640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fccb40a53c0 con 0x7fccb406cbb0 2023-11-28T20:02:47.556 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:47.552+0000 7fccb8abb640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fccb40a9140 con 0x7fccb414e8e0 2023-11-28T20:02:47.556 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:47.552+0000 7fccb8abb640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fccb414ecc0 con 0x7fccb40c0250 2023-11-28T20:02:47.556 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:47.552+0000 7fccb37fe640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fccb414e8e0 0x7fccb4154f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:02:47.556 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:47.552+0000 7fccb37fe640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fccb414e8e0 0x7fccb4154f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:50116/0 (socket says 172.21.15.78:50116) 2023-11-28T20:02:47.556 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:47.552+0000 7fccb37fe640 1 -- 172.21.15.78:0/3652774945 learned_addr learned my addr 172.21.15.78:0/3652774945 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T20:02:47.556 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:47.552+0000 7fccabfff640 1 --2- 172.21.15.78:0/3652774945 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fccb40c0250 0x7fccb406c670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:02:47.556 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:47.552+0000 7fccb37fe640 1 -- 172.21.15.78:0/3652774945 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fccb40c0250 msgr2=0x7fccb406c670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:02:47.557 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:47.552+0000 7fccb37fe640 1 --2- 172.21.15.78:0/3652774945 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fccb40c0250 0x7fccb406c670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:47.557 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:47.552+0000 7fccb37fe640 1 -- 172.21.15.78:0/3652774945 >> v1:172.21.15.179:6789/0 conn(0x7fccb406cbb0 legacy=0x7fccb406d140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:02:47.557 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:47.552+0000 7fccb37fe640 1 -- 172.21.15.78:0/3652774945 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fccb40a4e20 con 0x7fccb414e8e0 2023-11-28T20:02:47.559 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:47.556+0000 7fccb37fe640 1 --2- 172.21.15.78:0/3652774945 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fccb414e8e0 0x7fccb4154f80 secure :-1 s=READY pgs=1056 cs=0 l=1 rev1=1 crypto rx=0x7fcca400bb10 tx=0x7fcca401ea80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e46a133dce85c4b5 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:02:47.559 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:47.556+0000 7fccb2ffd640 1 -- 172.21.15.78:0/3652774945 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcca40a7a10 con 0x7fccb414e8e0 2023-11-28T20:02:47.559 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:47.556+0000 7fccb2ffd640 1 -- 172.21.15.78:0/3652774945 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcca40a7b70 con 0x7fccb414e8e0 2023-11-28T20:02:47.559 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:47.556+0000 7fccb2ffd640 1 -- 172.21.15.78:0/3652774945 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcca40af440 con 0x7fccb414e8e0 2023-11-28T20:02:47.560 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:47.556+0000 7fccb8abb640 1 -- 172.21.15.78:0/3652774945 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fccb414e8e0 msgr2=0x7fccb4154f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:02:47.560 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:47.556+0000 7fccb8abb640 1 --2- 172.21.15.78:0/3652774945 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fccb414e8e0 0x7fccb4154f80 secure :-1 s=READY pgs=1056 cs=0 l=1 rev1=1 crypto rx=0x7fcca400bb10 tx=0x7fcca401ea80 comp rx=0 tx=0).stop 2023-11-28T20:02:47.560 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:47.556+0000 7fccb8abb640 1 -- 172.21.15.78:0/3652774945 shutdown_connections 2023-11-28T20:02:47.560 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:47.556+0000 7fccb8abb640 1 --2- 172.21.15.78:0/3652774945 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fccb40c0250 0x7fccb406c670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:47.560 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:47.556+0000 7fccb8abb640 1 --2- 172.21.15.78:0/3652774945 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fccb414e8e0 0x7fccb4154f80 unknown :-1 s=CLOSED pgs=1056 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:47.561 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:47.556+0000 7fccb8abb640 1 -- 172.21.15.78:0/3652774945 >> 172.21.15.78:0/3652774945 conn(0x7fccb40c2350 msgr2=0x7fccb40c2760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:02:47.561 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:47.556+0000 7fccb8abb640 1 -- 172.21.15.78:0/3652774945 shutdown_connections 2023-11-28T20:02:47.561 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:47.556+0000 7fccb8abb640 1 -- 172.21.15.78:0/3652774945 wait complete. 2023-11-28T20:02:47.561 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:47.556+0000 7fccb8abb640 1 Processor -- start 2023-11-28T20:02:47.561 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:47.556+0000 7fccb8abb640 1 -- start start 2023-11-28T20:02:47.563 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:47.556+0000 7fccb8abb640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fccb406cbb0 0x7fccb41ec860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:47.563 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:47.556+0000 7fccb8abb640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fccb40c0250 0x7fccb4149890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:47.563 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:47.556+0000 7fccb8abb640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fccb414e8e0 0x7fccb41e9280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:47.563 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:47.556+0000 7fccb8abb640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fccb406ffd0 con 0x7fccb414e8e0 2023-11-28T20:02:47.563 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:47.556+0000 7fccb8abb640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fccb41e8df0 con 0x7fccb406cbb0 2023-11-28T20:02:47.563 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:47.556+0000 7fccb8abb640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fccb4149dd0 con 0x7fccb40c0250 2023-11-28T20:02:47.563 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:47.560+0000 7fccb3fff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fccb414e8e0 0x7fccb41e9280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:02:47.563 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:47.560+0000 7fccabfff640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fccb40c0250 0x7fccb4149890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:02:47.563 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:47.560+0000 7fccb37fe640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fccb406cbb0 0x7fccb41ec860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:02:47.563 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:47.560+0000 7fccb3fff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fccb414e8e0 0x7fccb41e9280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:50118/0 (socket says 172.21.15.78:50118) 2023-11-28T20:02:47.563 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:47.560+0000 7fccb3fff640 1 -- 172.21.15.78:0/2433065948 learned_addr learned my addr 172.21.15.78:0/2433065948 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T20:02:47.565 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:47.560+0000 7fccb3fff640 1 -- 172.21.15.78:0/2433065948 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fccb40c0250 msgr2=0x7fccb4149890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:02:47.565 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:47.560+0000 7fccb3fff640 1 --2- 172.21.15.78:0/2433065948 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fccb40c0250 0x7fccb4149890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:47.565 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:47.560+0000 7fccb3fff640 1 -- 172.21.15.78:0/2433065948 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fccb406cbb0 msgr2=0x7fccb41ec860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:02:47.565 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:47.560+0000 7fccb3fff640 1 --2- 172.21.15.78:0/2433065948 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fccb406cbb0 0x7fccb41ec860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:47.565 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:47.560+0000 7fccb3fff640 1 -- 172.21.15.78:0/2433065948 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcca400b770 con 0x7fccb414e8e0 2023-11-28T20:02:47.565 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:47.560+0000 7fccb3fff640 1 --2- 172.21.15.78:0/2433065948 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fccb414e8e0 0x7fccb41e9280 secure :-1 s=READY pgs=1057 cs=0 l=1 rev1=1 crypto rx=0x7fccac00b970 tx=0x7fccac00be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:02:47.565 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:47.560+0000 7fccb0ff9640 1 -- 172.21.15.78:0/2433065948 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fccac00cae0 con 0x7fccb414e8e0 2023-11-28T20:02:47.565 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:47.560+0000 7fccb0ff9640 1 -- 172.21.15.78:0/2433065948 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fccac00cc40 con 0x7fccb414e8e0 2023-11-28T20:02:47.565 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:47.560+0000 7fccb8abb640 1 -- 172.21.15.78:0/2433065948 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fccb4071150 con 0x7fccb414e8e0 2023-11-28T20:02:47.565 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:47.560+0000 7fccb0ff9640 1 -- 172.21.15.78:0/2433065948 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fccac014680 con 0x7fccb414e8e0 2023-11-28T20:02:47.565 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:47.560+0000 7fccb8abb640 1 -- 172.21.15.78:0/2433065948 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fccb406fcf0 con 0x7fccb414e8e0 2023-11-28T20:02:47.566 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:47.560+0000 7fccb8abb640 1 -- 172.21.15.78:0/2433065948 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fccb40674b0 con 0x7fccb414e8e0 2023-11-28T20:02:47.566 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:47.560+0000 7fccb0ff9640 1 -- 172.21.15.78:0/2433065948 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fccac01d3b0 con 0x7fccb414e8e0 2023-11-28T20:02:47.566 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:47.564+0000 7fccb0ff9640 1 --2- 172.21.15.78:0/2433065948 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fcc94066470 0x7fcc94068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:47.567 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:47.564+0000 7fccb0ff9640 1 -- 172.21.15.78:0/2433065948 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6885+0+0 (secure 0 0 0) 0x7fccac0840a0 con 0x7fccb414e8e0 2023-11-28T20:02:47.567 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:47.564+0000 7fccb37fe640 1 --2- 172.21.15.78:0/2433065948 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fcc94066470 0x7fcc94068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:02:47.567 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:47.564+0000 7fccb37fe640 1 --2- 172.21.15.78:0/2433065948 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fcc94066470 0x7fcc94068930 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7fcca40b1000 tx=0x7fcca40a9070 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:02:47.571 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:47.568+0000 7fccb0ff9640 1 -- 172.21.15.78:0/2433065948 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fccac051120 con 0x7fccb414e8e0 2023-11-28T20:02:47.720 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:47.716+0000 7fccb8abb640 1 -- 172.21.15.78:0/2433065948 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fccb41e8f30 con 0x7fccb414e8e0 2023-11-28T20:02:47.721 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:47.716+0000 7fccb0ff9640 1 -- 172.21.15.78:0/2433065948 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v85) v1 ==== 93+0+10 (secure 0 0 0) 0x7fccac054740 con 0x7fccb414e8e0 2023-11-28T20:02:47.721 INFO:teuthology.orchestra.run.smithi078.stdout:pg_num: 1 2023-11-28T20:02:47.723 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:47.716+0000 7fccb8abb640 1 -- 172.21.15.78:0/2433065948 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fcc94066470 msgr2=0x7fcc94068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:02:47.723 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:47.716+0000 7fccb8abb640 1 --2- 172.21.15.78:0/2433065948 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fcc94066470 0x7fcc94068930 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7fcca40b1000 tx=0x7fcca40a9070 comp rx=0 tx=0).stop 2023-11-28T20:02:47.723 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:47.716+0000 7fccb8abb640 1 -- 172.21.15.78:0/2433065948 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fccb414e8e0 msgr2=0x7fccb41e9280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:02:47.723 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:47.716+0000 7fccb8abb640 1 --2- 172.21.15.78:0/2433065948 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fccb414e8e0 0x7fccb41e9280 secure :-1 s=READY pgs=1057 cs=0 l=1 rev1=1 crypto rx=0x7fccac00b970 tx=0x7fccac00be30 comp rx=0 tx=0).stop 2023-11-28T20:02:47.723 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:47.720+0000 7fccb8abb640 1 -- 172.21.15.78:0/2433065948 shutdown_connections 2023-11-28T20:02:47.723 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:47.720+0000 7fccb8abb640 1 --2- 172.21.15.78:0/2433065948 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fcc94066470 0x7fcc94068930 unknown :-1 s=CLOSED pgs=500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:47.723 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:47.720+0000 7fccb8abb640 1 --2- 172.21.15.78:0/2433065948 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fccb40c0250 0x7fccb4149890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:47.723 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:47.720+0000 7fccb8abb640 1 --2- 172.21.15.78:0/2433065948 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fccb414e8e0 0x7fccb41e9280 unknown :-1 s=CLOSED pgs=1057 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:47.724 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:47.720+0000 7fccb8abb640 1 --2- 172.21.15.78:0/2433065948 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fccb406cbb0 0x7fccb41ec860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:47.724 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:47.720+0000 7fccb8abb640 1 -- 172.21.15.78:0/2433065948 >> 172.21.15.78:0/2433065948 conn(0x7fccb40c2350 msgr2=0x7fccb40c0fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:02:47.724 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:47.720+0000 7fccb8abb640 1 -- 172.21.15.78:0/2433065948 shutdown_connections 2023-11-28T20:02:47.724 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:47.720+0000 7fccb8abb640 1 -- 172.21.15.78:0/2433065948 wait complete. 2023-11-28T20:02:47.742 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-28T20:02:47.884 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:47.880+0000 7fed968d6640 1 Processor -- start 2023-11-28T20:02:47.884 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:47.880+0000 7fed968d6640 1 -- start start 2023-11-28T20:02:47.885 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:47.880+0000 7fed968d6640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fed900c47e0 0x7fed900c4bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:47.886 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:47.880+0000 7fed968d6640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fed900c92e0 0x7fed9015eec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:47.886 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:47.880+0000 7fed968d6640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fed90155400 con 0x7fed900c83d0 2023-11-28T20:02:47.886 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:47.880+0000 7fed968d6640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fed900c5830 con 0x7fed900c47e0 2023-11-28T20:02:47.886 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:47.880+0000 7fed968d6640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fed90154620 con 0x7fed900c92e0 2023-11-28T20:02:47.886 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:47.880+0000 7fed8ffff640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fed900c47e0 0x7fed900c4bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:02:47.886 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:47.880+0000 7fed8ffff640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fed900c47e0 0x7fed900c4bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:50134/0 (socket says 172.21.15.78:50134) 2023-11-28T20:02:47.886 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:47.880+0000 7fed8ffff640 1 -- 172.21.15.78:0/350966695 learned_addr learned my addr 172.21.15.78:0/350966695 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T20:02:47.886 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:47.880+0000 7fed94e73640 1 --2- 172.21.15.78:0/350966695 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fed900c92e0 0x7fed9015eec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:02:47.887 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:47.880+0000 7fed8ffff640 1 -- 172.21.15.78:0/350966695 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fed900c92e0 msgr2=0x7fed9015eec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:02:47.887 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:47.880+0000 7fed8ffff640 1 --2- 172.21.15.78:0/350966695 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fed900c92e0 0x7fed9015eec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:47.887 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:47.880+0000 7fed8ffff640 1 -- 172.21.15.78:0/350966695 >> v1:172.21.15.179:6789/0 conn(0x7fed900c83d0 legacy=0x7fed900c8bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:02:47.887 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:47.880+0000 7fed8ffff640 1 -- 172.21.15.78:0/350966695 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed90154830 con 0x7fed900c47e0 2023-11-28T20:02:47.888 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:47.880+0000 7fed94e73640 1 --2- 172.21.15.78:0/350966695 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fed900c92e0 0x7fed9015eec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T20:02:47.889 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:47.884+0000 7fed8ffff640 1 --2- 172.21.15.78:0/350966695 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fed900c47e0 0x7fed900c4bc0 secure :-1 s=READY pgs=1058 cs=0 l=1 rev1=1 crypto rx=0x7fed80009870 tx=0x7fed8001c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9a691b146b3fbb5b server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:02:47.889 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:47.884+0000 7fed8effd640 1 -- 172.21.15.78:0/350966695 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed800ad640 con 0x7fed900c47e0 2023-11-28T20:02:47.889 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:47.884+0000 7fed8effd640 1 -- 172.21.15.78:0/350966695 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed800ad7a0 con 0x7fed900c47e0 2023-11-28T20:02:47.889 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:47.884+0000 7fed8effd640 1 -- 172.21.15.78:0/350966695 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed800adb30 con 0x7fed900c47e0 2023-11-28T20:02:47.890 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:47.884+0000 7fed968d6640 1 -- 172.21.15.78:0/350966695 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fed900c47e0 msgr2=0x7fed900c4bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:02:47.890 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:47.884+0000 7fed968d6640 1 --2- 172.21.15.78:0/350966695 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fed900c47e0 0x7fed900c4bc0 secure :-1 s=READY pgs=1058 cs=0 l=1 rev1=1 crypto rx=0x7fed80009870 tx=0x7fed8001c480 comp rx=0 tx=0).stop 2023-11-28T20:02:47.891 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:47.884+0000 7fed968d6640 1 -- 172.21.15.78:0/350966695 shutdown_connections 2023-11-28T20:02:47.891 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:47.884+0000 7fed968d6640 1 --2- 172.21.15.78:0/350966695 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fed900c92e0 0x7fed9015eec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:47.891 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:47.884+0000 7fed968d6640 1 --2- 172.21.15.78:0/350966695 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fed900c47e0 0x7fed900c4bc0 unknown :-1 s=CLOSED pgs=1058 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:47.891 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:47.884+0000 7fed968d6640 1 -- 172.21.15.78:0/350966695 >> 172.21.15.78:0/350966695 conn(0x7fed900ab920 msgr2=0x7fed900abd30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:02:47.891 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:47.884+0000 7fed968d6640 1 -- 172.21.15.78:0/350966695 shutdown_connections 2023-11-28T20:02:47.891 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:47.884+0000 7fed968d6640 1 -- 172.21.15.78:0/350966695 wait complete. 2023-11-28T20:02:47.892 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:47.888+0000 7fed968d6640 1 Processor -- start 2023-11-28T20:02:47.892 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:47.888+0000 7fed968d6640 1 -- start start 2023-11-28T20:02:47.894 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:47.888+0000 7fed968d6640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fed900c47e0 0x7fed900aacc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:47.894 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:47.888+0000 7fed968d6640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fed900c83d0 0x7fed901ecee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:47.894 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:47.888+0000 7fed968d6640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fed900c92e0 0x7fed901ed420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:47.895 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:47.888+0000 7fed968d6640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed900c2b20 con 0x7fed900c47e0 2023-11-28T20:02:47.895 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:47.888+0000 7fed968d6640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed90155990 con 0x7fed900c83d0 2023-11-28T20:02:47.895 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:47.888+0000 7fed968d6640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fed900afd00 con 0x7fed900c92e0 2023-11-28T20:02:47.895 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:47.888+0000 7fed8ffff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fed900c47e0 0x7fed900aacc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:02:47.895 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:47.888+0000 7fed8ffff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fed900c47e0 0x7fed900aacc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:50140/0 (socket says 172.21.15.78:50140) 2023-11-28T20:02:47.895 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:47.888+0000 7fed8ffff640 1 -- 172.21.15.78:0/164768799 learned_addr learned my addr 172.21.15.78:0/164768799 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T20:02:47.895 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:47.888+0000 7fed8f7fe640 1 --2- 172.21.15.78:0/164768799 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fed900c83d0 0x7fed901ecee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:02:47.895 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:47.888+0000 7fed94e73640 1 --2- 172.21.15.78:0/164768799 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fed900c92e0 0x7fed901ed420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:02:47.895 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:47.888+0000 7fed8ffff640 1 -- 172.21.15.78:0/164768799 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fed900c92e0 msgr2=0x7fed901ed420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:02:47.895 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:47.888+0000 7fed8ffff640 1 --2- 172.21.15.78:0/164768799 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fed900c92e0 0x7fed901ed420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:47.895 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:47.888+0000 7fed8ffff640 1 -- 172.21.15.78:0/164768799 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fed900c83d0 msgr2=0x7fed901ecee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:02:47.896 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:47.888+0000 7fed8ffff640 1 --2- 172.21.15.78:0/164768799 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fed900c83d0 0x7fed901ecee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:47.896 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:47.888+0000 7fed8ffff640 1 -- 172.21.15.78:0/164768799 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed800094d0 con 0x7fed900c47e0 2023-11-28T20:02:47.896 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:47.888+0000 7fed8ffff640 1 --2- 172.21.15.78:0/164768799 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fed900c47e0 0x7fed900aacc0 secure :-1 s=READY pgs=1059 cs=0 l=1 rev1=1 crypto rx=0x7fed800b0040 tx=0x7fed80019220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:02:47.896 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:47.888+0000 7fed8cff9640 1 -- 172.21.15.78:0/164768799 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed800b6830 con 0x7fed900c47e0 2023-11-28T20:02:47.896 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:47.888+0000 7fed8cff9640 1 -- 172.21.15.78:0/164768799 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed800a6040 con 0x7fed900c47e0 2023-11-28T20:02:47.896 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:47.888+0000 7fed8cff9640 1 -- 172.21.15.78:0/164768799 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed800b6bd0 con 0x7fed900c47e0 2023-11-28T20:02:47.896 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:47.888+0000 7fed968d6640 1 -- 172.21.15.78:0/164768799 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fed901f0df0 con 0x7fed900c47e0 2023-11-28T20:02:47.896 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:47.888+0000 7fed968d6640 1 -- 172.21.15.78:0/164768799 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fed90155ec0 con 0x7fed900c47e0 2023-11-28T20:02:47.897 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:47.892+0000 7fed968d6640 1 -- 172.21.15.78:0/164768799 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fed90067630 con 0x7fed900c47e0 2023-11-28T20:02:47.897 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:47.892+0000 7fed8cff9640 1 -- 172.21.15.78:0/164768799 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fed800b4070 con 0x7fed900c47e0 2023-11-28T20:02:47.897 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:47.892+0000 7fed8cff9640 1 --2- 172.21.15.78:0/164768799 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fed7c066470 0x7fed7c068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:47.898 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:47.892+0000 7fed8cff9640 1 -- 172.21.15.78:0/164768799 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6885+0+0 (secure 0 0 0) 0x7fed8011ec90 con 0x7fed900c47e0 2023-11-28T20:02:47.898 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:47.892+0000 7fed8f7fe640 1 --2- 172.21.15.78:0/164768799 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fed7c066470 0x7fed7c068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:02:47.898 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:47.892+0000 7fed8f7fe640 1 --2- 172.21.15.78:0/164768799 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fed7c066470 0x7fed7c068930 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7fed9014c150 tx=0x7fed84009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:02:47.901 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:47.896+0000 7fed8cff9640 1 -- 172.21.15.78:0/164768799 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fed800ebc60 con 0x7fed900c47e0 2023-11-28T20:02:48.053 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:48.048+0000 7fed968d6640 1 -- 172.21.15.78:0/164768799 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fed9006c940 con 0x7fed900c47e0 2023-11-28T20:02:48.054 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:48.048+0000 7fed8cff9640 1 -- 172.21.15.78:0/164768799 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v85) v1 ==== 104+0+11 (secure 0 0 0) 0x7fed800b2020 con 0x7fed900c47e0 2023-11-28T20:02:48.054 INFO:teuthology.orchestra.run.smithi078.stdout:pg_num: 32 2023-11-28T20:02:48.056 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:48.052+0000 7fed968d6640 1 -- 172.21.15.78:0/164768799 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fed7c066470 msgr2=0x7fed7c068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:02:48.056 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:48.052+0000 7fed968d6640 1 --2- 172.21.15.78:0/164768799 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fed7c066470 0x7fed7c068930 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7fed9014c150 tx=0x7fed84009040 comp rx=0 tx=0).stop 2023-11-28T20:02:48.056 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:48.052+0000 7fed968d6640 1 -- 172.21.15.78:0/164768799 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fed900c47e0 msgr2=0x7fed900aacc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:02:48.056 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:48.052+0000 7fed968d6640 1 --2- 172.21.15.78:0/164768799 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fed900c47e0 0x7fed900aacc0 secure :-1 s=READY pgs=1059 cs=0 l=1 rev1=1 crypto rx=0x7fed800b0040 tx=0x7fed80019220 comp rx=0 tx=0).stop 2023-11-28T20:02:48.056 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:48.052+0000 7fed968d6640 1 -- 172.21.15.78:0/164768799 shutdown_connections 2023-11-28T20:02:48.056 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:48.052+0000 7fed968d6640 1 --2- 172.21.15.78:0/164768799 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fed7c066470 0x7fed7c068930 unknown :-1 s=CLOSED pgs=501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:48.056 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:48.052+0000 7fed968d6640 1 --2- 172.21.15.78:0/164768799 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fed900c92e0 0x7fed901ed420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:48.056 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:48.052+0000 7fed968d6640 1 --2- 172.21.15.78:0/164768799 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fed900c83d0 0x7fed901ecee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:48.057 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:48.052+0000 7fed968d6640 1 --2- 172.21.15.78:0/164768799 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fed900c47e0 0x7fed900aacc0 unknown :-1 s=CLOSED pgs=1059 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:48.057 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:48.052+0000 7fed968d6640 1 -- 172.21.15.78:0/164768799 >> 172.21.15.78:0/164768799 conn(0x7fed900ab920 msgr2=0x7fed90153590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:02:48.057 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:48.052+0000 7fed968d6640 1 -- 172.21.15.78:0/164768799 shutdown_connections 2023-11-28T20:02:48.057 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:48.052+0000 7fed968d6640 1 -- 172.21.15.78:0/164768799 wait complete. 2023-11-28T20:02:48.074 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-28T20:02:48.221 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:48.216+0000 7f0545817640 1 Processor -- start 2023-11-28T20:02:48.221 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:48.216+0000 7f0545817640 1 -- start start 2023-11-28T20:02:48.223 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:48.216+0000 7f0545817640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f05400c5f60 0x7f05400c4330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:48.223 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:48.216+0000 7f0545817640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f05400c4870 0x7f05400c6ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:48.223 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:48.216+0000 7f0545817640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f05400c6a10 con 0x7f0540155310 2023-11-28T20:02:48.223 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:48.216+0000 7f0545817640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f05400c2740 con 0x7f05400c4870 2023-11-28T20:02:48.224 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:48.216+0000 7f0545817640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f054006bc80 con 0x7f05400c5f60 2023-11-28T20:02:48.224 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:48.220+0000 7f053f7fe640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f05400c4870 0x7f05400c6ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:02:48.224 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:48.220+0000 7f05367fc640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f05400c5f60 0x7f05400c4330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:02:48.224 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:48.220+0000 7f053f7fe640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f05400c4870 0x7f05400c6ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.78:43654/0 (socket says 172.21.15.78:43654) 2023-11-28T20:02:48.224 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:48.220+0000 7f053f7fe640 1 -- 172.21.15.78:0/75921385 learned_addr learned my addr 172.21.15.78:0/75921385 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T20:02:48.224 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:48.220+0000 7f053f7fe640 1 -- 172.21.15.78:0/75921385 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f05400c5f60 msgr2=0x7f05400c4330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:02:48.224 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:48.220+0000 7f053f7fe640 1 --2- 172.21.15.78:0/75921385 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f05400c5f60 0x7f05400c4330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:48.224 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:48.220+0000 7f053f7fe640 1 -- 172.21.15.78:0/75921385 >> v1:172.21.15.179:6789/0 conn(0x7f0540155310 legacy=0x7f0540158590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:02:48.224 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:48.220+0000 7f053f7fe640 1 -- 172.21.15.78:0/75921385 --> v2:172.21.15.179:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05400c2f80 con 0x7f05400c4870 2023-11-28T20:02:48.224 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:48.220+0000 7f05367fc640 1 --2- 172.21.15.78:0/75921385 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f05400c5f60 0x7f05400c4330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T20:02:48.224 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:48.220+0000 7f053e7fc640 1 -- 172.21.15.78:0/75921385 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3140471266 0 0) 0x7f05400c6a10 con 0x7f0540155310 2023-11-28T20:02:48.226 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:48.220+0000 7f053f7fe640 1 --2- 172.21.15.78:0/75921385 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f05400c4870 0x7f05400c6ea0 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f0538009e50 tx=0x7f053801c9e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b0057a46af2a2d9f server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:02:48.227 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:48.220+0000 7f053e7fc640 1 -- 172.21.15.78:0/75921385 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05380a58a0 con 0x7f05400c4870 2023-11-28T20:02:48.227 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:48.220+0000 7f053e7fc640 1 -- 172.21.15.78:0/75921385 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f05380a5a00 con 0x7f05400c4870 2023-11-28T20:02:48.227 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:48.220+0000 7f053e7fc640 1 -- 172.21.15.78:0/75921385 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05380a5d90 con 0x7f05400c4870 2023-11-28T20:02:48.227 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:48.224+0000 7f0545817640 1 -- 172.21.15.78:0/75921385 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f05400c4870 msgr2=0x7f05400c6ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:02:48.227 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:48.224+0000 7f0545817640 1 --2- 172.21.15.78:0/75921385 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f05400c4870 0x7f05400c6ea0 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f0538009e50 tx=0x7f053801c9e0 comp rx=0 tx=0).stop 2023-11-28T20:02:48.228 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:48.224+0000 7f0545817640 1 -- 172.21.15.78:0/75921385 shutdown_connections 2023-11-28T20:02:48.228 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:48.224+0000 7f0545817640 1 --2- 172.21.15.78:0/75921385 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f05400c4870 0x7f05400c6ea0 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:48.228 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:48.224+0000 7f0545817640 1 --2- 172.21.15.78:0/75921385 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f05400c5f60 0x7f05400c4330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:48.228 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:48.224+0000 7f0545817640 1 -- 172.21.15.78:0/75921385 >> 172.21.15.78:0/75921385 conn(0x7f05400a9830 msgr2=0x7f05400a9c40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:02:48.228 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:48.224+0000 7f0545817640 1 -- 172.21.15.78:0/75921385 shutdown_connections 2023-11-28T20:02:48.228 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:48.224+0000 7f0545817640 1 -- 172.21.15.78:0/75921385 wait complete. 2023-11-28T20:02:48.229 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:48.224+0000 7f0545817640 1 Processor -- start 2023-11-28T20:02:48.229 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:48.224+0000 7f0545817640 1 -- start start 2023-11-28T20:02:48.230 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:48.224+0000 7f0545817640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f05400c4870 0x7f054014ffa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:48.231 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:48.224+0000 7f0545817640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f05400c5f60 0x7f0540153400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:48.231 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:48.224+0000 7f0545817640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0540155310 0x7f05401ee4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:48.231 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:48.224+0000 7f0545817640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05400a6b60 con 0x7f05400c4870 2023-11-28T20:02:48.231 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:48.224+0000 7f0545817640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05401519b0 con 0x7f05400c5f60 2023-11-28T20:02:48.231 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:48.224+0000 7f0545817640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05400a6d40 con 0x7f0540155310 2023-11-28T20:02:48.231 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:48.224+0000 7f053effd640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f05400c4870 0x7f054014ffa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:02:48.231 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:48.224+0000 7f053effd640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f05400c4870 0x7f054014ffa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:50152/0 (socket says 172.21.15.78:50152) 2023-11-28T20:02:48.231 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:48.224+0000 7f053effd640 1 -- 172.21.15.78:0/30469503 learned_addr learned my addr 172.21.15.78:0/30469503 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T20:02:48.231 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:48.224+0000 7f05367fc640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f05400c5f60 0x7f0540153400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:02:48.231 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:48.224+0000 7f053f7fe640 1 --2- 172.21.15.78:0/30469503 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0540155310 0x7f05401ee4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:02:48.232 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:48.224+0000 7f053f7fe640 1 -- 172.21.15.78:0/30469503 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f05400c5f60 msgr2=0x7f0540153400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:02:48.232 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:48.224+0000 7f053f7fe640 1 --2- 172.21.15.78:0/30469503 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f05400c5f60 0x7f0540153400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:48.232 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:48.224+0000 7f053f7fe640 1 -- 172.21.15.78:0/30469503 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f05400c4870 msgr2=0x7f054014ffa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:02:48.232 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:48.224+0000 7f053f7fe640 1 --2- 172.21.15.78:0/30469503 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f05400c4870 0x7f054014ffa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:48.232 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:48.224+0000 7f053f7fe640 1 -- 172.21.15.78:0/30469503 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0530009420 con 0x7f0540155310 2023-11-28T20:02:48.232 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:48.224+0000 7f05367fc640 1 --2- 172.21.15.78:0/30469503 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f05400c5f60 0x7f0540153400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T20:02:48.232 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:48.228+0000 7f053f7fe640 1 --2- 172.21.15.78:0/30469503 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0540155310 0x7f05401ee4b0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f05380ab000 tx=0x7f0538019780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:02:48.233 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:48.228+0000 7f053cff9640 1 -- 172.21.15.78:0/30469503 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05380b8670 con 0x7f0540155310 2023-11-28T20:02:48.233 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:48.228+0000 7f053cff9640 1 -- 172.21.15.78:0/30469503 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f05380b87d0 con 0x7f0540155310 2023-11-28T20:02:48.233 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:48.228+0000 7f0545817640 1 -- 172.21.15.78:0/30469503 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0538009b30 con 0x7f0540155310 2023-11-28T20:02:48.233 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:48.228+0000 7f053cff9640 1 -- 172.21.15.78:0/30469503 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05380b8b80 con 0x7f0540155310 2023-11-28T20:02:48.233 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:48.228+0000 7f0545817640 1 -- 172.21.15.78:0/30469503 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0540154780 con 0x7f0540155310 2023-11-28T20:02:48.233 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:48.228+0000 7f0545817640 1 -- 172.21.15.78:0/30469503 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f05401f5190 con 0x7f0540155310 2023-11-28T20:02:48.234 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:48.228+0000 7f053cff9640 1 -- 172.21.15.78:0/30469503 <== mon.2 v2:172.21.15.179:3301/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f05380b8ce0 con 0x7f0540155310 2023-11-28T20:02:48.234 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:48.228+0000 7f053cff9640 1 --2- 172.21.15.78:0/30469503 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f0520066470 0x7f0520068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:48.234 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:48.228+0000 7f053cff9640 1 -- 172.21.15.78:0/30469503 <== mon.2 v2:172.21.15.179:3301/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 7088+0+0 (secure 0 0 0) 0x7f053811fdb0 con 0x7f0540155310 2023-11-28T20:02:48.234 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:48.228+0000 7f053effd640 1 --2- 172.21.15.78:0/30469503 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f0520066470 0x7f0520068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:02:48.235 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:48.232+0000 7f053effd640 1 --2- 172.21.15.78:0/30469503 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f0520066470 0x7f0520068930 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f0528000f70 tx=0x7f0528009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:02:48.238 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:48.232+0000 7f053cff9640 1 -- 172.21.15.78:0/30469503 <== mon.2 v2:172.21.15.179:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f05380ece10 con 0x7f0540155310 2023-11-28T20:02:48.393 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:48.388+0000 7f0545817640 1 -- 172.21.15.78:0/30469503 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f05401f5190 con 0x7f0540155310 2023-11-28T20:02:48.394 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:48.388+0000 7f053cff9640 1 -- 172.21.15.78:0/30469503 <== mon.2 v2:172.21.15.179:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v86) v1 ==== 100+0+11 (secure 0 0 0) 0x7f05401f5190 con 0x7f0540155310 2023-11-28T20:02:48.394 INFO:teuthology.orchestra.run.smithi078.stdout:pg_num: 64 2023-11-28T20:02:48.396 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:48.392+0000 7f0545817640 1 -- 172.21.15.78:0/30469503 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f0520066470 msgr2=0x7f0520068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:02:48.396 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:48.392+0000 7f0545817640 1 --2- 172.21.15.78:0/30469503 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f0520066470 0x7f0520068930 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f0528000f70 tx=0x7f0528009040 comp rx=0 tx=0).stop 2023-11-28T20:02:48.396 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:48.392+0000 7f0545817640 1 -- 172.21.15.78:0/30469503 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0540155310 msgr2=0x7f05401ee4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:02:48.396 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:48.392+0000 7f0545817640 1 --2- 172.21.15.78:0/30469503 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0540155310 0x7f05401ee4b0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f05380ab000 tx=0x7f0538019780 comp rx=0 tx=0).stop 2023-11-28T20:02:48.396 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:48.392+0000 7f0545817640 1 -- 172.21.15.78:0/30469503 shutdown_connections 2023-11-28T20:02:48.396 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:48.392+0000 7f0545817640 1 --2- 172.21.15.78:0/30469503 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f0520066470 0x7f0520068930 unknown :-1 s=CLOSED pgs=502 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:48.396 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:48.392+0000 7f0545817640 1 --2- 172.21.15.78:0/30469503 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0540155310 0x7f05401ee4b0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:48.397 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:48.392+0000 7f0545817640 1 --2- 172.21.15.78:0/30469503 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f05400c5f60 0x7f0540153400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:48.397 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:48.392+0000 7f0545817640 1 --2- 172.21.15.78:0/30469503 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f05400c4870 0x7f054014ffa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:48.397 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:48.392+0000 7f0545817640 1 -- 172.21.15.78:0/30469503 >> 172.21.15.78:0/30469503 conn(0x7f05400a9830 msgr2=0x7f054015e230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:02:48.397 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:48.392+0000 7f0545817640 1 -- 172.21.15.78:0/30469503 shutdown_connections 2023-11-28T20:02:48.397 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:48.392+0000 7f0545817640 1 -- 172.21.15.78:0/30469503 wait complete. 2023-11-28T20:02:48.415 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs2_metadata pg_num 2023-11-28T20:02:48.555 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:48.552+0000 7f8f11d96640 1 Processor -- start 2023-11-28T20:02:48.555 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:48.552+0000 7f8f11d96640 1 -- start start 2023-11-28T20:02:48.556 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:48.552+0000 7f8f11d96640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f8f0c14b1e0 0x7f8f0c0c1700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:48.557 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:48.552+0000 7f8f11d96640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f8f0c0c5300 0x7f8f0c0a9c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:48.557 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:48.552+0000 7f8f11d96640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8f0c0a4e20 con 0x7f8f0c151280 2023-11-28T20:02:48.557 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:48.552+0000 7f8f11d96640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8f0c1558d0 con 0x7f8f0c0c5300 2023-11-28T20:02:48.557 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:48.552+0000 7f8f11d96640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8f0c0a50e0 con 0x7f8f0c14b1e0 2023-11-28T20:02:48.557 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:48.552+0000 7f8f0affd640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f8f0c0c5300 0x7f8f0c0a9c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:02:48.557 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:48.552+0000 7f8f0affd640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f8f0c0c5300 0x7f8f0c0a9c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:50158/0 (socket says 172.21.15.78:50158) 2023-11-28T20:02:48.557 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:48.552+0000 7f8f0affd640 1 -- 172.21.15.78:0/1665381193 learned_addr learned my addr 172.21.15.78:0/1665381193 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T20:02:48.558 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:48.552+0000 7f8f0b7fe640 1 --2- 172.21.15.78:0/1665381193 >> v2:172.21.15.179:3300/0 conn(0x7f8f0c14b1e0 0x7f8f0c0c1700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:02:48.558 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:48.552+0000 7f8f0affd640 1 -- 172.21.15.78:0/1665381193 >> v2:172.21.15.179:3300/0 conn(0x7f8f0c14b1e0 msgr2=0x7f8f0c0c1700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:02:48.558 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:48.552+0000 7f8f0affd640 1 --2- 172.21.15.78:0/1665381193 >> v2:172.21.15.179:3300/0 conn(0x7f8f0c14b1e0 0x7f8f0c0c1700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:48.558 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:48.552+0000 7f8f0affd640 1 -- 172.21.15.78:0/1665381193 >> v1:172.21.15.179:6789/0 conn(0x7f8f0c151280 legacy=0x7f8f0c1516f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:02:48.558 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:48.552+0000 7f8f0affd640 1 -- 172.21.15.78:0/1665381193 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f0c0c0f00 con 0x7f8f0c0c5300 2023-11-28T20:02:48.558 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:48.552+0000 7f8f0b7fe640 1 --2- 172.21.15.78:0/1665381193 >> v2:172.21.15.179:3300/0 conn(0x7f8f0c14b1e0 0x7f8f0c0c1700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T20:02:48.560 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:48.556+0000 7f8f0affd640 1 --2- 172.21.15.78:0/1665381193 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8f0c0c5300 0x7f8f0c0a9c30 secure :-1 s=READY pgs=1060 cs=0 l=1 rev1=1 crypto rx=0x7f8f0c0c4150 tx=0x7f8f0001c4c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e72a692f061933d7 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:02:48.560 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:48.556+0000 7f8f0a7fc640 1 -- 172.21.15.78:0/1665381193 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f000ab600 con 0x7f8f0c0c5300 2023-11-28T20:02:48.560 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:48.556+0000 7f8f0a7fc640 1 -- 172.21.15.78:0/1665381193 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f000a7050 con 0x7f8f0c0c5300 2023-11-28T20:02:48.560 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:48.556+0000 7f8f0a7fc640 1 -- 172.21.15.78:0/1665381193 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f000ab980 con 0x7f8f0c0c5300 2023-11-28T20:02:48.561 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:48.556+0000 7f8f11d96640 1 -- 172.21.15.78:0/1665381193 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8f0c0c5300 msgr2=0x7f8f0c0a9c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:02:48.561 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:48.556+0000 7f8f11d96640 1 --2- 172.21.15.78:0/1665381193 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8f0c0c5300 0x7f8f0c0a9c30 secure :-1 s=READY pgs=1060 cs=0 l=1 rev1=1 crypto rx=0x7f8f0c0c4150 tx=0x7f8f0001c4c0 comp rx=0 tx=0).stop 2023-11-28T20:02:48.561 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:48.556+0000 7f8f11d96640 1 -- 172.21.15.78:0/1665381193 shutdown_connections 2023-11-28T20:02:48.561 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:48.556+0000 7f8f11d96640 1 --2- 172.21.15.78:0/1665381193 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8f0c0c5300 0x7f8f0c0a9c30 unknown :-1 s=CLOSED pgs=1060 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:48.561 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:48.556+0000 7f8f11d96640 1 --2- 172.21.15.78:0/1665381193 >> v2:172.21.15.179:3300/0 conn(0x7f8f0c14b1e0 0x7f8f0c0c1700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:48.561 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:48.556+0000 7f8f11d96640 1 -- 172.21.15.78:0/1665381193 >> 172.21.15.78:0/1665381193 conn(0x7f8f0c0c59f0 msgr2=0x7f8f0c0c5e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:02:48.561 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:48.556+0000 7f8f11d96640 1 -- 172.21.15.78:0/1665381193 shutdown_connections 2023-11-28T20:02:48.561 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:48.556+0000 7f8f11d96640 1 -- 172.21.15.78:0/1665381193 wait complete. 2023-11-28T20:02:48.562 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:48.556+0000 7f8f11d96640 1 Processor -- start 2023-11-28T20:02:48.562 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:48.556+0000 7f8f11d96640 1 -- start start 2023-11-28T20:02:48.564 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:48.560+0000 7f8f11d96640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8f0c0c5300 0x7f8f0c0c4770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:48.564 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:48.560+0000 7f8f11d96640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8f0c14b1e0 0x7f8f0c1e8810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:48.564 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:48.560+0000 7f8f11d96640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8f0c151280 0x7f8f0c1e8d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:48.564 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:48.560+0000 7f8f11d96640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f0c1ec5c0 con 0x7f8f0c14b1e0 2023-11-28T20:02:48.564 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:48.560+0000 7f8f11d96640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f0c0c1770 con 0x7f8f0c151280 2023-11-28T20:02:48.564 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:48.560+0000 7f8f11d96640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8f0c1552c0 con 0x7f8f0c0c5300 2023-11-28T20:02:48.564 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:48.560+0000 7f8f0affd640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8f0c14b1e0 0x7f8f0c1e8810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:02:48.565 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:48.560+0000 7f8f0affd640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8f0c14b1e0 0x7f8f0c1e8810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:50164/0 (socket says 172.21.15.78:50164) 2023-11-28T20:02:48.565 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:48.560+0000 7f8f0affd640 1 -- 172.21.15.78:0/3489825339 learned_addr learned my addr 172.21.15.78:0/3489825339 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T20:02:48.565 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:48.560+0000 7f8f0bfff640 1 --2- 172.21.15.78:0/3489825339 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8f0c151280 0x7f8f0c1e8d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:02:48.565 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:48.560+0000 7f8f0b7fe640 1 --2- 172.21.15.78:0/3489825339 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8f0c0c5300 0x7f8f0c0c4770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:02:48.565 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:48.560+0000 7f8f0affd640 1 -- 172.21.15.78:0/3489825339 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8f0c0c5300 msgr2=0x7f8f0c0c4770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:02:48.565 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:48.560+0000 7f8f0affd640 1 --2- 172.21.15.78:0/3489825339 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8f0c0c5300 0x7f8f0c0c4770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:48.565 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:48.560+0000 7f8f0affd640 1 -- 172.21.15.78:0/3489825339 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8f0c151280 msgr2=0x7f8f0c1e8d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:02:48.565 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:48.560+0000 7f8f0affd640 1 --2- 172.21.15.78:0/3489825339 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8f0c151280 0x7f8f0c1e8d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:48.565 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:48.560+0000 7f8f0affd640 1 -- 172.21.15.78:0/3489825339 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f000094d0 con 0x7f8f0c14b1e0 2023-11-28T20:02:48.565 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:48.560+0000 7f8f0affd640 1 --2- 172.21.15.78:0/3489825339 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8f0c14b1e0 0x7f8f0c1e8810 secure :-1 s=READY pgs=1061 cs=0 l=1 rev1=1 crypto rx=0x7f8f000ae040 tx=0x7f8f00019260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:02:48.566 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:48.560+0000 7f8ef3fff640 1 -- 172.21.15.78:0/3489825339 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f000b4640 con 0x7f8f0c14b1e0 2023-11-28T20:02:48.566 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:48.560+0000 7f8ef3fff640 1 -- 172.21.15.78:0/3489825339 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f000b47c0 con 0x7f8f0c14b1e0 2023-11-28T20:02:48.567 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:48.560+0000 7f8f11d96640 1 -- 172.21.15.78:0/3489825339 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8f0c1ebf00 con 0x7f8f0c14b1e0 2023-11-28T20:02:48.567 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:48.560+0000 7f8ef3fff640 1 -- 172.21.15.78:0/3489825339 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f000b4b70 con 0x7f8f0c14b1e0 2023-11-28T20:02:48.567 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:48.560+0000 7f8f11d96640 1 -- 172.21.15.78:0/3489825339 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8f0c0c4cb0 con 0x7f8f0c14b1e0 2023-11-28T20:02:48.567 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:48.560+0000 7f8f11d96640 1 -- 172.21.15.78:0/3489825339 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8f0c1ec700 con 0x7f8f0c14b1e0 2023-11-28T20:02:48.567 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:48.564+0000 7f8ef3fff640 1 -- 172.21.15.78:0/3489825339 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f8f000b2070 con 0x7f8f0c14b1e0 2023-11-28T20:02:48.568 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:48.564+0000 7f8ef3fff640 1 --2- 172.21.15.78:0/3489825339 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f8ef8066470 0x7f8ef8068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:48.568 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:48.564+0000 7f8ef3fff640 1 -- 172.21.15.78:0/3489825339 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 7088+0+0 (secure 0 0 0) 0x7f8f0011e290 con 0x7f8f0c14b1e0 2023-11-28T20:02:48.568 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:48.564+0000 7f8f0b7fe640 1 --2- 172.21.15.78:0/3489825339 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f8ef8066470 0x7f8ef8068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:02:48.568 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:48.564+0000 7f8f0b7fe640 1 --2- 172.21.15.78:0/3489825339 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f8ef8066470 0x7f8ef8068930 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f8efc00ab60 tx=0x7f8efc008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:02:48.572 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:48.568+0000 7f8ef3fff640 1 -- 172.21.15.78:0/3489825339 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f8f0c1ec700 con 0x7f8f0c14b1e0 2023-11-28T20:02:48.722 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:48.716+0000 7f8f11d96640 1 -- 172.21.15.78:0/3489825339 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs2_metadata", "var": "pg_num"} v 0) v1 -- 0x7f8f0c1ec700 con 0x7f8f0c14b1e0 2023-11-28T20:02:48.722 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:48.716+0000 7f8ef3fff640 1 -- 172.21.15.78:0/3489825339 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs2_metadata", "var": "pg_num"}]=0 v86) v1 ==== 105+0+11 (secure 0 0 0) 0x7f8f0c1ec700 con 0x7f8f0c14b1e0 2023-11-28T20:02:48.722 INFO:teuthology.orchestra.run.smithi078.stdout:pg_num: 32 2023-11-28T20:02:48.724 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:48.720+0000 7f8f11d96640 1 -- 172.21.15.78:0/3489825339 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f8ef8066470 msgr2=0x7f8ef8068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:02:48.724 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:48.720+0000 7f8f11d96640 1 --2- 172.21.15.78:0/3489825339 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f8ef8066470 0x7f8ef8068930 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f8efc00ab60 tx=0x7f8efc008040 comp rx=0 tx=0).stop 2023-11-28T20:02:48.724 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:48.720+0000 7f8f11d96640 1 -- 172.21.15.78:0/3489825339 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8f0c14b1e0 msgr2=0x7f8f0c1e8810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:02:48.724 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:48.720+0000 7f8f11d96640 1 --2- 172.21.15.78:0/3489825339 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8f0c14b1e0 0x7f8f0c1e8810 secure :-1 s=READY pgs=1061 cs=0 l=1 rev1=1 crypto rx=0x7f8f000ae040 tx=0x7f8f00019260 comp rx=0 tx=0).stop 2023-11-28T20:02:48.724 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:48.720+0000 7f8f11d96640 1 -- 172.21.15.78:0/3489825339 shutdown_connections 2023-11-28T20:02:48.724 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:48.720+0000 7f8f11d96640 1 --2- 172.21.15.78:0/3489825339 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f8ef8066470 0x7f8ef8068930 unknown :-1 s=CLOSED pgs=503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:48.724 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:48.720+0000 7f8f11d96640 1 --2- 172.21.15.78:0/3489825339 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8f0c151280 0x7f8f0c1e8d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:48.724 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:48.720+0000 7f8f11d96640 1 --2- 172.21.15.78:0/3489825339 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8f0c14b1e0 0x7f8f0c1e8810 unknown :-1 s=CLOSED pgs=1061 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:48.724 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:48.720+0000 7f8f11d96640 1 --2- 172.21.15.78:0/3489825339 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8f0c0c5300 0x7f8f0c0c4770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:48.724 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:48.720+0000 7f8f11d96640 1 -- 172.21.15.78:0/3489825339 >> 172.21.15.78:0/3489825339 conn(0x7f8f0c0c59f0 msgr2=0x7f8f0c1502d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:02:48.724 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:48.720+0000 7f8f11d96640 1 -- 172.21.15.78:0/3489825339 shutdown_connections 2023-11-28T20:02:48.725 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:48.720+0000 7f8f11d96640 1 -- 172.21.15.78:0/3489825339 wait complete. 2023-11-28T20:02:48.742 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs2_data pg_num 2023-11-28T20:02:48.884 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:48.880+0000 7f82bde09640 1 Processor -- start 2023-11-28T20:02:48.885 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:48.880+0000 7f82bde09640 1 -- start start 2023-11-28T20:02:48.886 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:48.880+0000 7f82bde09640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f82b814b1e0 0x7f82b80c1700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:48.886 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:48.880+0000 7f82bde09640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f82b80c5300 0x7f82b80a9c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:48.886 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:48.880+0000 7f82bde09640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f82b80a4e20 con 0x7f82b8151280 2023-11-28T20:02:48.886 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:48.880+0000 7f82bde09640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f82b81558d0 con 0x7f82b814b1e0 2023-11-28T20:02:48.886 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:48.880+0000 7f82bde09640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f82b80a50e0 con 0x7f82b80c5300 2023-11-28T20:02:48.886 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:48.880+0000 7f82b6ffd640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f82b80c5300 0x7f82b80a9c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:02:48.886 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:48.880+0000 7f82b77fe640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f82b814b1e0 0x7f82b80c1700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:02:48.886 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:48.880+0000 7f82b6ffd640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f82b80c5300 0x7f82b80a9c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3301/0 says I am v2:172.21.15.78:55590/0 (socket says 172.21.15.78:55590) 2023-11-28T20:02:48.887 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:48.880+0000 7f82b7fff640 1 --1- >> v1:172.21.15.179:6789/0 conn(0x7f82b8151280 0x7f82b8151710 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.179:6789/0 says I am v1:172.21.15.78:43906/0 (socket says 172.21.15.78:43906) 2023-11-28T20:02:48.887 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:48.880+0000 7f82b6ffd640 1 -- 172.21.15.78:0/1705916715 learned_addr learned my addr 172.21.15.78:0/1705916715 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T20:02:48.887 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:48.880+0000 7f82b77fe640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f82b814b1e0 0x7f82b80c1700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.78:43680/0 (socket says 172.21.15.78:43680) 2023-11-28T20:02:48.887 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:48.880+0000 7f82b6ffd640 1 -- 172.21.15.78:0/1705916715 >> v2:172.21.15.179:3300/0 conn(0x7f82b814b1e0 msgr2=0x7f82b80c1700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:02:48.887 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:48.880+0000 7f82b6ffd640 1 --2- 172.21.15.78:0/1705916715 >> v2:172.21.15.179:3300/0 conn(0x7f82b814b1e0 0x7f82b80c1700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:48.888 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:48.880+0000 7f82b6ffd640 1 -- 172.21.15.78:0/1705916715 >> v1:172.21.15.179:6789/0 conn(0x7f82b8151280 legacy=0x7f82b8151710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:02:48.888 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:48.880+0000 7f82b6ffd640 1 -- 172.21.15.78:0/1705916715 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82b80c0f00 con 0x7f82b80c5300 2023-11-28T20:02:48.888 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:48.884+0000 7f82b77fe640 1 --2- 172.21.15.78:0/1705916715 >> v2:172.21.15.179:3300/0 conn(0x7f82b814b1e0 0x7f82b80c1700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T20:02:48.890 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:48.884+0000 7f82b6ffd640 1 --2- 172.21.15.78:0/1705916715 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f82b80c5300 0x7f82b80a9c30 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f82ac009870 tx=0x7f82ac01c540 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8d2b2074e0159d2b server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:02:48.890 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:48.884+0000 7f82b67fc640 1 -- 172.21.15.78:0/1705916715 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82ac004230 con 0x7f82b80c5300 2023-11-28T20:02:48.891 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:48.884+0000 7f82b67fc640 1 -- 172.21.15.78:0/1705916715 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f82ac0a7050 con 0x7f82b80c5300 2023-11-28T20:02:48.891 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:48.884+0000 7f82b67fc640 1 -- 172.21.15.78:0/1705916715 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82ac003620 con 0x7f82b80c5300 2023-11-28T20:02:48.893 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:48.884+0000 7f82bde09640 1 -- 172.21.15.78:0/1705916715 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f82b80c5300 msgr2=0x7f82b80a9c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:02:48.893 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:48.884+0000 7f82bde09640 1 --2- 172.21.15.78:0/1705916715 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f82b80c5300 0x7f82b80a9c30 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f82ac009870 tx=0x7f82ac01c540 comp rx=0 tx=0).stop 2023-11-28T20:02:48.893 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:48.884+0000 7f82bde09640 1 -- 172.21.15.78:0/1705916715 shutdown_connections 2023-11-28T20:02:48.893 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:48.884+0000 7f82bde09640 1 --2- 172.21.15.78:0/1705916715 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f82b80c5300 0x7f82b80a9c30 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:48.893 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:48.884+0000 7f82bde09640 1 --2- 172.21.15.78:0/1705916715 >> v2:172.21.15.179:3300/0 conn(0x7f82b814b1e0 0x7f82b80c1700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:48.894 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:48.884+0000 7f82bde09640 1 -- 172.21.15.78:0/1705916715 >> 172.21.15.78:0/1705916715 conn(0x7f82b80c59f0 msgr2=0x7f82b80c5e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:02:48.894 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:48.884+0000 7f82bde09640 1 -- 172.21.15.78:0/1705916715 shutdown_connections 2023-11-28T20:02:48.894 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:48.888+0000 7f82bde09640 1 -- 172.21.15.78:0/1705916715 wait complete. 2023-11-28T20:02:48.894 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:48.888+0000 7f82bde09640 1 Processor -- start 2023-11-28T20:02:48.894 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:48.888+0000 7f82bde09640 1 -- start start 2023-11-28T20:02:48.898 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:48.888+0000 7f82bde09640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f82b80c5300 0x7f82b814fee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:48.898 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:48.888+0000 7f82bde09640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f82b814b1e0 0x7f82b8071570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:48.898 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:48.888+0000 7f82bde09640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f82b8151280 0x7f82b8071ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:48.899 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:48.888+0000 7f82bde09640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82b8147d40 con 0x7f82b80c5300 2023-11-28T20:02:48.899 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:48.888+0000 7f82bde09640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82b8148300 con 0x7f82b814b1e0 2023-11-28T20:02:48.899 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:48.888+0000 7f82bde09640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f82b8071ff0 con 0x7f82b8151280 2023-11-28T20:02:48.899 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:48.888+0000 7f82b77fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f82b80c5300 0x7f82b814fee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:02:48.899 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:48.888+0000 7f82b77fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f82b80c5300 0x7f82b814fee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:50172/0 (socket says 172.21.15.78:50172) 2023-11-28T20:02:48.899 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:48.888+0000 7f82b77fe640 1 -- 172.21.15.78:0/3787751267 learned_addr learned my addr 172.21.15.78:0/3787751267 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T20:02:48.899 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:48.888+0000 7f82b6ffd640 1 --2- 172.21.15.78:0/3787751267 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f82b814b1e0 0x7f82b8071570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:02:48.899 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:48.888+0000 7f82b7fff640 1 --2- 172.21.15.78:0/3787751267 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f82b8151280 0x7f82b8071ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:02:48.899 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:48.888+0000 7f82b77fe640 1 -- 172.21.15.78:0/3787751267 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f82b8151280 msgr2=0x7f82b8071ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:02:48.899 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:48.888+0000 7f82b77fe640 1 --2- 172.21.15.78:0/3787751267 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f82b8151280 0x7f82b8071ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:48.899 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:48.888+0000 7f82b77fe640 1 -- 172.21.15.78:0/3787751267 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f82b814b1e0 msgr2=0x7f82b8071570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:02:48.900 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:48.888+0000 7f82b77fe640 1 --2- 172.21.15.78:0/3787751267 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f82b814b1e0 0x7f82b8071570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:48.900 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:48.888+0000 7f82b77fe640 1 -- 172.21.15.78:0/3787751267 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82a800b6c0 con 0x7f82b80c5300 2023-11-28T20:02:48.900 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:48.888+0000 7f82b77fe640 1 --2- 172.21.15.78:0/3787751267 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f82b80c5300 0x7f82b814fee0 secure :-1 s=READY pgs=1062 cs=0 l=1 rev1=1 crypto rx=0x7f82a800eda0 tx=0x7f82a800d720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:02:48.900 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:48.888+0000 7f829ffff640 1 -- 172.21.15.78:0/3787751267 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82a8010850 con 0x7f82b80c5300 2023-11-28T20:02:48.900 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:48.888+0000 7f829ffff640 1 -- 172.21.15.78:0/3787751267 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f82a80109b0 con 0x7f82b80c5300 2023-11-28T20:02:48.900 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:48.888+0000 7f82bde09640 1 -- 172.21.15.78:0/3787751267 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f82ac0094d0 con 0x7f82b80c5300 2023-11-28T20:02:48.900 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:48.888+0000 7f829ffff640 1 -- 172.21.15.78:0/3787751267 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82a8010d20 con 0x7f82b80c5300 2023-11-28T20:02:48.900 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:48.892+0000 7f82bde09640 1 -- 172.21.15.78:0/3787751267 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f82b806fda0 con 0x7f82b80c5300 2023-11-28T20:02:48.900 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:48.892+0000 7f82bde09640 1 -- 172.21.15.78:0/3787751267 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f82b8067630 con 0x7f82b80c5300 2023-11-28T20:02:48.900 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:48.892+0000 7f829ffff640 1 -- 172.21.15.78:0/3787751267 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f82a800f3d0 con 0x7f82b80c5300 2023-11-28T20:02:48.900 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:48.892+0000 7f829ffff640 1 --2- 172.21.15.78:0/3787751267 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f82a4066470 0x7f82a4068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:48.901 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:48.892+0000 7f829ffff640 1 -- 172.21.15.78:0/3787751267 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 7088+0+0 (secure 0 0 0) 0x7f82a8084c10 con 0x7f82b80c5300 2023-11-28T20:02:48.901 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:48.892+0000 7f82b6ffd640 1 --2- 172.21.15.78:0/3787751267 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f82a4066470 0x7f82a4068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:02:48.901 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:48.892+0000 7f82b6ffd640 1 --2- 172.21.15.78:0/3787751267 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f82a4066470 0x7f82a4068930 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f82ac0ad000 tx=0x7f82ac009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:02:48.902 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:48.896+0000 7f829ffff640 1 -- 172.21.15.78:0/3787751267 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f82a8051a30 con 0x7f82b80c5300 2023-11-28T20:02:49.049 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:49.044+0000 7f82bde09640 1 -- 172.21.15.78:0/3787751267 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs2_data", "var": "pg_num"} v 0) v1 -- 0x7f82b8067f40 con 0x7f82b80c5300 2023-11-28T20:02:49.050 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:49.044+0000 7f829ffff640 1 -- 172.21.15.78:0/3787751267 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs2_data", "var": "pg_num"}]=0 v86) v1 ==== 101+0+11 (secure 0 0 0) 0x7f82a8055050 con 0x7f82b80c5300 2023-11-28T20:02:49.050 INFO:teuthology.orchestra.run.smithi078.stdout:pg_num: 64 2023-11-28T20:02:49.052 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:49.048+0000 7f82bde09640 1 -- 172.21.15.78:0/3787751267 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f82a4066470 msgr2=0x7f82a4068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:02:49.052 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:49.048+0000 7f82bde09640 1 --2- 172.21.15.78:0/3787751267 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f82a4066470 0x7f82a4068930 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f82ac0ad000 tx=0x7f82ac009040 comp rx=0 tx=0).stop 2023-11-28T20:02:49.052 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:49.048+0000 7f82bde09640 1 -- 172.21.15.78:0/3787751267 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f82b80c5300 msgr2=0x7f82b814fee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:02:49.053 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:49.048+0000 7f82bde09640 1 --2- 172.21.15.78:0/3787751267 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f82b80c5300 0x7f82b814fee0 secure :-1 s=READY pgs=1062 cs=0 l=1 rev1=1 crypto rx=0x7f82a800eda0 tx=0x7f82a800d720 comp rx=0 tx=0).stop 2023-11-28T20:02:49.053 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:49.048+0000 7f82bde09640 1 -- 172.21.15.78:0/3787751267 shutdown_connections 2023-11-28T20:02:49.053 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:49.048+0000 7f82bde09640 1 --2- 172.21.15.78:0/3787751267 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f82a4066470 0x7f82a4068930 unknown :-1 s=CLOSED pgs=504 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:49.053 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:49.048+0000 7f82bde09640 1 --2- 172.21.15.78:0/3787751267 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f82b8151280 0x7f82b8071ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:49.053 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:49.048+0000 7f82bde09640 1 --2- 172.21.15.78:0/3787751267 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f82b814b1e0 0x7f82b8071570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:49.053 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:49.048+0000 7f82bde09640 1 --2- 172.21.15.78:0/3787751267 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f82b80c5300 0x7f82b814fee0 unknown :-1 s=CLOSED pgs=1062 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:49.053 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:49.048+0000 7f82bde09640 1 -- 172.21.15.78:0/3787751267 >> 172.21.15.78:0/3787751267 conn(0x7f82b80c59f0 msgr2=0x7f82b8151710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:02:49.054 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:49.048+0000 7f82bde09640 1 -- 172.21.15.78:0/3787751267 shutdown_connections 2023-11-28T20:02:49.054 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:49.048+0000 7f82bde09640 1 -- 172.21.15.78:0/3787751267 wait complete. 2023-11-28T20:02:49.075 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-11-28T20:02:49.217 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:49.212+0000 7f82f7b9d640 1 Processor -- start 2023-11-28T20:02:49.217 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:49.212+0000 7f82f7b9d640 1 -- start start 2023-11-28T20:02:49.218 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:49.212+0000 7f82f7b9d640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f82f0154390 0x7f82f00c4a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:49.218 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:49.212+0000 7f82f7b9d640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f82f00c2110 0x7f82f00c5ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:49.218 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:49.212+0000 7f82f7b9d640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f82f00a93d0 con 0x7f82f00c4f80 2023-11-28T20:02:49.218 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:49.212+0000 7f82f7b9d640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f82f00aa1c0 con 0x7f82f0154390 2023-11-28T20:02:49.218 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:49.212+0000 7f82f7b9d640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f82f0154770 con 0x7f82f00c2110 2023-11-28T20:02:49.218 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:49.212+0000 7f82f5939640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f82f0154390 0x7f82f00c4a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:02:49.218 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:49.212+0000 7f82f613a640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f82f00c4f80 0x7f82f00c61e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:41834/0 (socket says 172.21.15.78:41834) 2023-11-28T20:02:49.218 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:49.212+0000 7f82f613a640 1 -- 172.21.15.78:0/2827371605 learned_addr learned my addr 172.21.15.78:0/2827371605 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-11-28T20:02:49.219 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:49.212+0000 7f82f5138640 1 --2- 172.21.15.78:0/2827371605 >> v2:172.21.15.179:3300/0 conn(0x7f82f00c2110 0x7f82f00c5ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:02:49.219 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:49.212+0000 7f82f5939640 1 -- 172.21.15.78:0/2827371605 >> v2:172.21.15.179:3300/0 conn(0x7f82f00c2110 msgr2=0x7f82f00c5ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:02:49.219 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:49.212+0000 7f82f5939640 1 --2- 172.21.15.78:0/2827371605 >> v2:172.21.15.179:3300/0 conn(0x7f82f00c2110 0x7f82f00c5ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:49.219 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:49.216+0000 7f82f5939640 1 -- 172.21.15.78:0/2827371605 >> v1:172.21.15.78:6789/0 conn(0x7f82f00c4f80 legacy=0x7f82f00c61e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:02:49.220 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:49.216+0000 7f82f5939640 1 -- 172.21.15.78:0/2827371605 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82f00a9640 con 0x7f82f0154390 2023-11-28T20:02:49.220 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:49.216+0000 7f82f4937640 1 -- 172.21.15.78:0/2827371605 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2367031727 0 0) 0x7f82f00a93d0 con 0x7f82f00c4f80 2023-11-28T20:02:49.221 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:49.216+0000 7f82f5939640 1 --2- 172.21.15.78:0/2827371605 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f82f0154390 0x7f82f00c4a40 secure :-1 s=READY pgs=1064 cs=0 l=1 rev1=1 crypto rx=0x7f82f00bfe50 tx=0x7f82ec01c440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8f43531a5cfef3a8 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:02:49.222 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:49.216+0000 7f82f4937640 1 -- 172.21.15.78:0/2827371605 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82ec004230 con 0x7f82f0154390 2023-11-28T20:02:49.222 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:49.216+0000 7f82f4937640 1 -- 172.21.15.78:0/2827371605 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f82ec0a7050 con 0x7f82f0154390 2023-11-28T20:02:49.222 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:49.216+0000 7f82f4937640 1 -- 172.21.15.78:0/2827371605 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82ec003620 con 0x7f82f0154390 2023-11-28T20:02:49.223 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:49.216+0000 7f82f7b9d640 1 -- 172.21.15.78:0/2827371605 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f82f0154390 msgr2=0x7f82f00c4a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:02:49.223 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:49.216+0000 7f82f7b9d640 1 --2- 172.21.15.78:0/2827371605 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f82f0154390 0x7f82f00c4a40 secure :-1 s=READY pgs=1064 cs=0 l=1 rev1=1 crypto rx=0x7f82f00bfe50 tx=0x7f82ec01c440 comp rx=0 tx=0).stop 2023-11-28T20:02:49.223 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:49.216+0000 7f82f7b9d640 1 -- 172.21.15.78:0/2827371605 shutdown_connections 2023-11-28T20:02:49.223 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:49.216+0000 7f82f7b9d640 1 --2- 172.21.15.78:0/2827371605 >> v2:172.21.15.179:3300/0 conn(0x7f82f00c2110 0x7f82f00c5ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:49.223 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:49.216+0000 7f82f7b9d640 1 --2- 172.21.15.78:0/2827371605 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f82f0154390 0x7f82f00c4a40 unknown :-1 s=CLOSED pgs=1064 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:49.223 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:49.216+0000 7f82f7b9d640 1 -- 172.21.15.78:0/2827371605 >> 172.21.15.78:0/2827371605 conn(0x7f82f006b220 msgr2=0x7f82f00a77e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:02:49.224 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:49.216+0000 7f82f7b9d640 1 -- 172.21.15.78:0/2827371605 shutdown_connections 2023-11-28T20:02:49.224 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:49.216+0000 7f82f7b9d640 1 -- 172.21.15.78:0/2827371605 wait complete. 2023-11-28T20:02:49.224 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:49.220+0000 7f82f7b9d640 1 Processor -- start 2023-11-28T20:02:49.224 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:49.220+0000 7f82f7b9d640 1 -- start start 2023-11-28T20:02:49.227 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:49.220+0000 7f82f7b9d640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f82f00c2110 0x7f82f00bf0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:49.227 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:49.220+0000 7f82f7b9d640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f82f00c4f80 0x7f82f01ea500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:49.227 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:49.220+0000 7f82f7b9d640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f82f0154390 0x7f82f01eaa40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:49.227 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:49.220+0000 7f82f7b9d640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82f01edd50 con 0x7f82f0154390 2023-11-28T20:02:49.227 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:49.220+0000 7f82f7b9d640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82f014c3e0 con 0x7f82f00c2110 2023-11-28T20:02:49.227 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:49.220+0000 7f82f7b9d640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f82f0150db0 con 0x7f82f00c4f80 2023-11-28T20:02:49.227 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:49.220+0000 7f82f613a640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f82f0154390 0x7f82f01eaa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:02:49.227 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:49.220+0000 7f82f5939640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f82f00c2110 0x7f82f00bf0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:02:49.227 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:49.220+0000 7f82f613a640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f82f0154390 0x7f82f01eaa40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:50188/0 (socket says 172.21.15.78:50188) 2023-11-28T20:02:49.227 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:49.220+0000 7f82f613a640 1 -- 172.21.15.78:0/535699847 learned_addr learned my addr 172.21.15.78:0/535699847 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T20:02:49.227 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:49.220+0000 7f82f5138640 1 --2- 172.21.15.78:0/535699847 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f82f00c4f80 0x7f82f01ea500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:02:49.228 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:49.220+0000 7f82f613a640 1 -- 172.21.15.78:0/535699847 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f82f00c4f80 msgr2=0x7f82f01ea500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:02:49.228 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:49.220+0000 7f82f613a640 1 --2- 172.21.15.78:0/535699847 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f82f00c4f80 0x7f82f01ea500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:49.228 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:49.220+0000 7f82f613a640 1 -- 172.21.15.78:0/535699847 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f82f00c2110 msgr2=0x7f82f00bf0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:02:49.228 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:49.220+0000 7f82f613a640 1 --2- 172.21.15.78:0/535699847 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f82f00c2110 0x7f82f00bf0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:49.228 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:49.220+0000 7f82f613a640 1 -- 172.21.15.78:0/535699847 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82ec009420 con 0x7f82f0154390 2023-11-28T20:02:49.228 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:49.220+0000 7f82f613a640 1 --2- 172.21.15.78:0/535699847 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f82f0154390 0x7f82f01eaa40 secure :-1 s=READY pgs=1065 cs=0 l=1 rev1=1 crypto rx=0x7f82e8001570 tx=0x7f82e800cca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:02:49.228 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:49.220+0000 7f82e67fc640 1 -- 172.21.15.78:0/535699847 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82e800a640 con 0x7f82f0154390 2023-11-28T20:02:49.228 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:49.220+0000 7f82e67fc640 1 -- 172.21.15.78:0/535699847 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f82e800a7c0 con 0x7f82f0154390 2023-11-28T20:02:49.228 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:49.220+0000 7f82e67fc640 1 -- 172.21.15.78:0/535699847 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82e800ab70 con 0x7f82f0154390 2023-11-28T20:02:49.228 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:49.220+0000 7f82f7b9d640 1 -- 172.21.15.78:0/535699847 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f82f01eaf80 con 0x7f82f0154390 2023-11-28T20:02:49.229 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:49.224+0000 7f82f7b9d640 1 -- 172.21.15.78:0/535699847 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f82f01ee240 con 0x7f82f0154390 2023-11-28T20:02:49.229 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:49.224+0000 7f82f7b9d640 1 -- 172.21.15.78:0/535699847 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f82f0067630 con 0x7f82f0154390 2023-11-28T20:02:49.229 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:49.224+0000 7f82e67fc640 1 -- 172.21.15.78:0/535699847 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f82e800acd0 con 0x7f82f0154390 2023-11-28T20:02:49.230 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:49.224+0000 7f82e67fc640 1 --2- 172.21.15.78:0/535699847 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f82d40664a0 0x7f82d4068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:49.230 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:49.224+0000 7f82e67fc640 1 -- 172.21.15.78:0/535699847 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 7088+0+0 (secure 0 0 0) 0x7f82e8083810 con 0x7f82f0154390 2023-11-28T20:02:49.230 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:49.224+0000 7f82f5939640 1 --2- 172.21.15.78:0/535699847 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f82d40664a0 0x7f82d4068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:02:49.230 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:49.224+0000 7f82f5939640 1 --2- 172.21.15.78:0/535699847 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f82d40664a0 0x7f82d4068960 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f82ec0ad000 tx=0x7f82ec008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:02:49.233 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:49.228+0000 7f82e67fc640 1 -- 172.21.15.78:0/535699847 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f82e80507f0 con 0x7f82f0154390 2023-11-28T20:02:49.392 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:49.388+0000 7f82f7b9d640 1 -- 172.21.15.78:0/535699847 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f82f006d250 con 0x7f82f0154390 2023-11-28T20:02:49.393 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:49.388+0000 7f82e67fc640 1 -- 172.21.15.78:0/535699847 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v87) v1 ==== 80+0+0 (secure 0 0 0) 0x7f82e8053e10 con 0x7f82f0154390 2023-11-28T20:02:49.393 INFO:teuthology.orchestra.run.smithi078.stderr:listed 0 entries 2023-11-28T20:02:49.395 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:49.392+0000 7f82f7b9d640 1 -- 172.21.15.78:0/535699847 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f82d40664a0 msgr2=0x7f82d4068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:02:49.395 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:49.392+0000 7f82f7b9d640 1 --2- 172.21.15.78:0/535699847 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f82d40664a0 0x7f82d4068960 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f82ec0ad000 tx=0x7f82ec008040 comp rx=0 tx=0).stop 2023-11-28T20:02:49.395 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:49.392+0000 7f82f7b9d640 1 -- 172.21.15.78:0/535699847 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f82f0154390 msgr2=0x7f82f01eaa40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:02:49.395 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:49.392+0000 7f82f7b9d640 1 --2- 172.21.15.78:0/535699847 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f82f0154390 0x7f82f01eaa40 secure :-1 s=READY pgs=1065 cs=0 l=1 rev1=1 crypto rx=0x7f82e8001570 tx=0x7f82e800cca0 comp rx=0 tx=0).stop 2023-11-28T20:02:49.395 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:49.392+0000 7f82f7b9d640 1 -- 172.21.15.78:0/535699847 shutdown_connections 2023-11-28T20:02:49.395 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:49.392+0000 7f82f7b9d640 1 --2- 172.21.15.78:0/535699847 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f82d40664a0 0x7f82d4068960 unknown :-1 s=CLOSED pgs=505 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:49.395 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:49.392+0000 7f82f7b9d640 1 --2- 172.21.15.78:0/535699847 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f82f00c4f80 0x7f82f01ea500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:49.396 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:49.392+0000 7f82f7b9d640 1 --2- 172.21.15.78:0/535699847 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f82f0154390 0x7f82f01eaa40 unknown :-1 s=CLOSED pgs=1065 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:49.396 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:49.392+0000 7f82f7b9d640 1 --2- 172.21.15.78:0/535699847 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f82f00c2110 0x7f82f00bf0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:49.396 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:49.392+0000 7f82f7b9d640 1 -- 172.21.15.78:0/535699847 >> 172.21.15.78:0/535699847 conn(0x7f82f006b220 msgr2=0x7f82f0152080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:02:49.396 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:49.392+0000 7f82f7b9d640 1 -- 172.21.15.78:0/535699847 shutdown_connections 2023-11-28T20:02:49.396 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:49.392+0000 7f82f7b9d640 1 -- 172.21.15.78:0/535699847 wait complete. 2023-11-28T20:02:49.413 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.testuser... 2023-11-28T20:02:49.414 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T20:02:49.414 DEBUG:teuthology.orchestra.run.smithi179:> sudo umount /home/ubuntu/cephtest/mnt.1 2023-11-28T20:02:49.443 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi179.front.sepia.ceph.com 2023-11-28T20:02:49.443 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T20:02:49.443 DEBUG:teuthology.orchestra.run.smithi179:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-11-28T20:02:49.494 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-11-28T20:02:49.495 DEBUG:teuthology.orchestra.run.smithi078:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-11-28T20:02:49.573 DEBUG:teuthology.orchestra.run.smithi179:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-11-28T20:02:49.651 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-11-28T20:02:49.651 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2023-11-28T20:02:49.651 DEBUG:teuthology.orchestra.run.smithi078:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-28T20:02:49.662 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354608k,nr_inodes=4088652,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275372k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=5526 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275368k,nr_inodes=818842,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275372k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 2023-11-28T20:02:49.663 DEBUG:teuthology.orchestra.run.smithi179:> set -ex 2023-11-28T20:02:49.663 DEBUG:teuthology.orchestra.run.smithi179:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-28T20:02:49.672 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354628k,nr_inodes=4088657,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275376k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=3817 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275372k,nr_inodes=818843,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275376k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 2023-11-28T20:02:49.673 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-28T20:02:49.846 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:49.840+0000 7f61207f8640 1 Processor -- start 2023-11-28T20:02:49.847 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:49.840+0000 7f61207f8640 1 -- start start 2023-11-28T20:02:49.848 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:49.844+0000 7f61207f8640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f611814e3f0 0x7f61180bfce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:49.848 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:49.844+0000 7f61207f8640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f611806c5b0 0x7f611806ca40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:49.849 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:49.844+0000 7f61207f8640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6118151690 con 0x7f611806bef0 2023-11-28T20:02:49.849 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:49.844+0000 7f61207f8640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6118151bc0 con 0x7f611814e3f0 2023-11-28T20:02:49.849 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:49.844+0000 7f61207f8640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f61181518e0 con 0x7f611806c5b0 2023-11-28T20:02:49.849 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:49.844+0000 7f611ed95640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f611806c5b0 0x7f611806ca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:02:49.849 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:49.844+0000 7f611ed95640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f611806c5b0 0x7f611806ca40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3301/0 says I am v2:172.21.15.78:55618/0 (socket says 172.21.15.78:55618) 2023-11-28T20:02:49.849 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:49.844+0000 7f611ed95640 1 -- 172.21.15.78:0/1637884566 learned_addr learned my addr 172.21.15.78:0/1637884566 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T20:02:49.850 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:49.844+0000 7f611e594640 1 --2- 172.21.15.78:0/1637884566 >> v2:172.21.15.179:3300/0 conn(0x7f611814e3f0 0x7f61180bfce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:02:49.850 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:49.844+0000 7f611ed95640 1 -- 172.21.15.78:0/1637884566 >> v2:172.21.15.179:3300/0 conn(0x7f611814e3f0 msgr2=0x7f61180bfce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:02:49.850 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:49.844+0000 7f611ed95640 1 --2- 172.21.15.78:0/1637884566 >> v2:172.21.15.179:3300/0 conn(0x7f611814e3f0 0x7f61180bfce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:49.851 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:49.844+0000 7f611ed95640 1 -- 172.21.15.78:0/1637884566 >> v1:172.21.15.179:6789/0 conn(0x7f611806bef0 legacy=0x7f61180c41f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:02:49.851 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:49.844+0000 7f611ed95640 1 -- 172.21.15.78:0/1637884566 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61180c1de0 con 0x7f611806c5b0 2023-11-28T20:02:49.853 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:49.848+0000 7f611ed95640 1 --2- 172.21.15.78:0/1637884566 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f611806c5b0 0x7f611806ca40 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f611000d150 tx=0x7f611001eb50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=477a1b3c253ce342 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:02:49.853 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:49.848+0000 7f611d592640 1 -- 172.21.15.78:0/1637884566 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61100a7ab0 con 0x7f611806c5b0 2023-11-28T20:02:49.853 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:49.848+0000 7f611d592640 1 -- 172.21.15.78:0/1637884566 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f61100ab070 con 0x7f611806c5b0 2023-11-28T20:02:49.853 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:49.848+0000 7f611d592640 1 -- 172.21.15.78:0/1637884566 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61100a7e30 con 0x7f611806c5b0 2023-11-28T20:02:49.853 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:49.848+0000 7f61207f8640 1 -- 172.21.15.78:0/1637884566 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f611806c5b0 msgr2=0x7f611806ca40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:02:49.854 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:49.848+0000 7f61207f8640 1 --2- 172.21.15.78:0/1637884566 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f611806c5b0 0x7f611806ca40 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f611000d150 tx=0x7f611001eb50 comp rx=0 tx=0).stop 2023-11-28T20:02:49.854 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:49.848+0000 7f61207f8640 1 -- 172.21.15.78:0/1637884566 shutdown_connections 2023-11-28T20:02:49.855 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:49.848+0000 7f61207f8640 1 --2- 172.21.15.78:0/1637884566 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f611806c5b0 0x7f611806ca40 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:49.855 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:49.848+0000 7f61207f8640 1 --2- 172.21.15.78:0/1637884566 >> v2:172.21.15.179:3300/0 conn(0x7f611814e3f0 0x7f61180bfce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:49.855 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:49.848+0000 7f61207f8640 1 -- 172.21.15.78:0/1637884566 >> 172.21.15.78:0/1637884566 conn(0x7f61180a7810 msgr2=0x7f61180a7c20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:02:49.855 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:49.848+0000 7f61207f8640 1 -- 172.21.15.78:0/1637884566 shutdown_connections 2023-11-28T20:02:49.855 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:49.848+0000 7f61207f8640 1 -- 172.21.15.78:0/1637884566 wait complete. 2023-11-28T20:02:49.858 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:49.848+0000 7f61207f8640 1 Processor -- start 2023-11-28T20:02:49.858 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:49.848+0000 7f61207f8640 1 -- start start 2023-11-28T20:02:49.858 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:49.852+0000 7f61207f8640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f611806bef0 0x7f6118152670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:49.859 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:49.852+0000 7f61207f8640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f611806c5b0 0x7f61181e92f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:49.859 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:49.852+0000 7f61207f8640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f611814e3f0 0x7f6118144b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:49.859 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:49.852+0000 7f61207f8640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61181e8c00 con 0x7f611806bef0 2023-11-28T20:02:49.859 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:49.852+0000 7f61207f8640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61181550a0 con 0x7f611814e3f0 2023-11-28T20:02:49.859 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:49.852+0000 7f61207f8640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f61180725e0 con 0x7f611806c5b0 2023-11-28T20:02:49.859 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:49.852+0000 7f611e594640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f611806bef0 0x7f6118152670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:02:49.859 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:49.852+0000 7f611e594640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f611806bef0 0x7f6118152670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:50190/0 (socket says 172.21.15.78:50190) 2023-11-28T20:02:49.859 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:49.852+0000 7f611e594640 1 -- 172.21.15.78:0/3601480912 learned_addr learned my addr 172.21.15.78:0/3601480912 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T20:02:49.859 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:49.852+0000 7f611dd93640 1 --2- 172.21.15.78:0/3601480912 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f611806c5b0 0x7f61181e92f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:02:49.859 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:49.852+0000 7f611ed95640 1 --2- 172.21.15.78:0/3601480912 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f611814e3f0 0x7f6118144b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:02:49.859 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:49.852+0000 7f611e594640 1 -- 172.21.15.78:0/3601480912 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f611806c5b0 msgr2=0x7f61181e92f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:02:49.859 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:49.852+0000 7f611e594640 1 --2- 172.21.15.78:0/3601480912 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f611806c5b0 0x7f61181e92f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:49.860 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:49.852+0000 7f611e594640 1 -- 172.21.15.78:0/3601480912 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f611814e3f0 msgr2=0x7f6118144b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:02:49.860 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:49.852+0000 7f611e594640 1 --2- 172.21.15.78:0/3601480912 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f611814e3f0 0x7f6118144b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:49.860 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:49.852+0000 7f611e594640 1 -- 172.21.15.78:0/3601480912 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f611000bd40 con 0x7f611806bef0 2023-11-28T20:02:49.860 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:49.852+0000 7f611e594640 1 --2- 172.21.15.78:0/3601480912 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f611806bef0 0x7f6118152670 secure :-1 s=READY pgs=1066 cs=0 l=1 rev1=1 crypto rx=0x7f611400e8d0 tx=0x7f611400ecd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:02:49.860 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:49.852+0000 7f610effd640 1 -- 172.21.15.78:0/3601480912 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6114009510 con 0x7f611806bef0 2023-11-28T20:02:49.860 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:49.852+0000 7f610effd640 1 -- 172.21.15.78:0/3601480912 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f611400c940 con 0x7f611806bef0 2023-11-28T20:02:49.860 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:49.852+0000 7f61207f8640 1 -- 172.21.15.78:0/3601480912 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6118154e00 con 0x7f611806bef0 2023-11-28T20:02:49.860 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:49.852+0000 7f610effd640 1 -- 172.21.15.78:0/3601480912 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f611400ccb0 con 0x7f611806bef0 2023-11-28T20:02:49.860 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:49.852+0000 7f61207f8640 1 -- 172.21.15.78:0/3601480912 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f61181e8e10 con 0x7f611806bef0 2023-11-28T20:02:49.860 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:49.852+0000 7f61207f8640 1 -- 172.21.15.78:0/3601480912 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f61180721a0 con 0x7f611806bef0 2023-11-28T20:02:49.988 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:49.852+0000 7f610effd640 1 -- 172.21.15.78:0/3601480912 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f6114013470 con 0x7f611806bef0 2023-11-28T20:02:50.139 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:49.856+0000 7f610effd640 1 --2- 172.21.15.78:0/3601480912 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f60fc0664a0 0x7f60fc068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:50.727 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:49.856+0000 7f610effd640 1 -- 172.21.15.78:0/3601480912 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 7088+0+0 (secure 0 0 0) 0x7f61140843d0 con 0x7f611806bef0 2023-11-28T20:02:50.843 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:49.856+0000 7f611dd93640 1 --2- 172.21.15.78:0/3601480912 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f60fc0664a0 0x7f60fc068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:02:50.953 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:49.856+0000 7f611dd93640 1 --2- 172.21.15.78:0/3601480912 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f60fc0664a0 0x7f60fc068960 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f611814a170 tx=0x7f6108009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:02:50.953 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:49.860+0000 7f610effd640 1 -- 172.21.15.78:0/3601480912 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f61180721a0 con 0x7f611806bef0 2023-11-28T20:02:50.953 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:50.040+0000 7f61207f8640 1 -- 172.21.15.78:0/3601480912 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f61180721a0 con 0x7f611806bef0 2023-11-28T20:02:50.953 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:50.040+0000 7f610effd640 1 -- 172.21.15.78:0/3601480912 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 51 v51) v1 ==== 94+0+6134 (secure 0 0 0) 0x7f61180721a0 con 0x7f611806bef0 2023-11-28T20:02:50.954 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-11-28T20:02:51.286 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":51,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5834,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6834/3259525552","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6832","nonce":3259525552},{"type":"v1","addr":"172.21.15.179:6834","nonce":3259525552}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":41},{"gid":6466,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6836/3096284673","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6834","nonce":3096284673},{"type":"v1","addr":"172.21.15.78:6836","nonce":3096284673}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":41}],"filesystems":[{"mdsmap":{"epoch":46,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-28T20:02:07.651677+0000","modified":"2023-11-28T20:02:10.666537+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":6633},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6633":{"gid":6633,"name":"a","rank":0,"incarnation":42,"state":"up:active","state_seq":3,"addr":"172.21.15.78:6837/20108235","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6835","nonce":20108235},{"type":"v1","addr":"172.21.15.78:6837","nonce":20108235}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6},{"mdsmap":{"epoch":51,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-28T20:02:25.231135+0000","modified":"2023-11-28T20:02:28.250515+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":6478},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6478":{"gid":6478,"name":"b","rank":0,"incarnation":47,"state":"up:active","state_seq":7,"addr":"172.21.15.179:6835/2749579094","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6833","nonce":2749579094},{"type":"v1","addr":"172.21.15.179:6835","nonce":2749579094}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs2","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":7}]} 2023-11-28T20:02:51.288 INFO:teuthology.orchestra.run.smithi078.stderr:dumped fsmap epoch 51 2023-11-28T20:02:51.400 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:50.044+0000 7f61207f8640 1 -- 172.21.15.78:0/3601480912 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f60fc0664a0 msgr2=0x7f60fc068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:02:51.401 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:50.044+0000 7f61207f8640 1 --2- 172.21.15.78:0/3601480912 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f60fc0664a0 0x7f60fc068960 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f611814a170 tx=0x7f6108009040 comp rx=0 tx=0).stop 2023-11-28T20:02:51.401 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:50.044+0000 7f61207f8640 1 -- 172.21.15.78:0/3601480912 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f611806bef0 msgr2=0x7f6118152670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:02:51.401 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:50.044+0000 7f61207f8640 1 --2- 172.21.15.78:0/3601480912 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f611806bef0 0x7f6118152670 secure :-1 s=READY pgs=1066 cs=0 l=1 rev1=1 crypto rx=0x7f611400e8d0 tx=0x7f611400ecd0 comp rx=0 tx=0).stop 2023-11-28T20:02:51.401 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:50.044+0000 7f61207f8640 1 -- 172.21.15.78:0/3601480912 shutdown_connections 2023-11-28T20:02:51.507 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:50.044+0000 7f61207f8640 1 --2- 172.21.15.78:0/3601480912 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f60fc0664a0 0x7f60fc068960 unknown :-1 s=CLOSED pgs=506 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:51.508 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:50.044+0000 7f61207f8640 1 --2- 172.21.15.78:0/3601480912 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f611806c5b0 0x7f61181e92f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:51.508 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:50.044+0000 7f61207f8640 1 --2- 172.21.15.78:0/3601480912 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f611814e3f0 0x7f6118144b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:51.508 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:50.044+0000 7f61207f8640 1 --2- 172.21.15.78:0/3601480912 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f611806bef0 0x7f6118152670 unknown :-1 s=CLOSED pgs=1066 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:51.508 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:50.044+0000 7f61207f8640 1 -- 172.21.15.78:0/3601480912 >> 172.21.15.78:0/3601480912 conn(0x7f61180a7810 msgr2=0x7f61180c41f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:02:51.508 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:50.044+0000 7f61207f8640 1 -- 172.21.15.78:0/3601480912 shutdown_connections 2023-11-28T20:02:51.508 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:50.044+0000 7f61207f8640 1 -- 172.21.15.78:0/3601480912 wait complete. 2023-11-28T20:02:51.509 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-28T20:02:51.655 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:51.652+0000 7f6a52184640 1 Processor -- start 2023-11-28T20:02:51.655 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:51.652+0000 7f6a52184640 1 -- start start 2023-11-28T20:02:51.656 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:51.652+0000 7f6a52184640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f6a4c1552e0 0x7f6a4c0c23e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:51.656 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:51.652+0000 7f6a52184640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6a4c0c2920 0x7f6a4c0c4810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:51.656 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:51.652+0000 7f6a52184640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6a4c0c5fb0 con 0x7f6a4c0c67d0 2023-11-28T20:02:51.656 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:51.652+0000 7f6a52184640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6a4c1556c0 con 0x7f6a4c1552e0 2023-11-28T20:02:51.656 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:51.652+0000 7f6a52184640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a4c0c2db0 con 0x7f6a4c0c2920 2023-11-28T20:02:51.657 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:51.652+0000 7f6a51182640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f6a4c1552e0 0x7f6a4c0c23e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:02:51.657 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:51.652+0000 7f6a51182640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f6a4c1552e0 0x7f6a4c0c23e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:50192/0 (socket says 172.21.15.78:50192) 2023-11-28T20:02:51.657 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:51.652+0000 7f6a51182640 1 -- 172.21.15.78:0/3520425966 learned_addr learned my addr 172.21.15.78:0/3520425966 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T20:02:51.657 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:51.652+0000 7f6a51182640 1 -- 172.21.15.78:0/3520425966 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6a4c0c2920 msgr2=0x7f6a4c0c4810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:02:51.657 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:51.652+0000 7f6a51983640 1 --2- 172.21.15.78:0/3520425966 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6a4c0c2920 0x7f6a4c0c4810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:02:51.657 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:51.652+0000 7f6a51182640 1 --2- 172.21.15.78:0/3520425966 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6a4c0c2920 0x7f6a4c0c4810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:51.658 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:51.652+0000 7f6a51182640 1 -- 172.21.15.78:0/3520425966 >> v1:172.21.15.179:6789/0 conn(0x7f6a4c0c67d0 legacy=0x7f6a4c0c4100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:02:51.658 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:51.652+0000 7f6a51182640 1 -- 172.21.15.78:0/3520425966 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a4c0700b0 con 0x7f6a4c1552e0 2023-11-28T20:02:51.658 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:51.652+0000 7f6a51983640 1 --2- 172.21.15.78:0/3520425966 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6a4c0c2920 0x7f6a4c0c4810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T20:02:51.661 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:51.656+0000 7f6a51182640 1 --2- 172.21.15.78:0/3520425966 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6a4c1552e0 0x7f6a4c0c23e0 secure :-1 s=READY pgs=1067 cs=0 l=1 rev1=1 crypto rx=0x7f6a48009870 tx=0x7f6a4801c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ec52f64dc4089f72 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:02:51.661 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:51.656+0000 7f6a43fff640 1 -- 172.21.15.78:0/3520425966 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a480aa5f0 con 0x7f6a4c1552e0 2023-11-28T20:02:51.661 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:51.656+0000 7f6a43fff640 1 -- 172.21.15.78:0/3520425966 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a480aa750 con 0x7f6a4c1552e0 2023-11-28T20:02:51.661 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:51.656+0000 7f6a43fff640 1 -- 172.21.15.78:0/3520425966 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a480aaae0 con 0x7f6a4c1552e0 2023-11-28T20:02:51.661 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:51.656+0000 7f6a52184640 1 -- 172.21.15.78:0/3520425966 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6a4c1552e0 msgr2=0x7f6a4c0c23e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:02:51.661 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:51.656+0000 7f6a52184640 1 --2- 172.21.15.78:0/3520425966 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6a4c1552e0 0x7f6a4c0c23e0 secure :-1 s=READY pgs=1067 cs=0 l=1 rev1=1 crypto rx=0x7f6a48009870 tx=0x7f6a4801c4d0 comp rx=0 tx=0).stop 2023-11-28T20:02:51.661 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:51.656+0000 7f6a52184640 1 -- 172.21.15.78:0/3520425966 shutdown_connections 2023-11-28T20:02:51.661 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:51.656+0000 7f6a52184640 1 --2- 172.21.15.78:0/3520425966 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6a4c0c2920 0x7f6a4c0c4810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:51.661 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:51.656+0000 7f6a52184640 1 --2- 172.21.15.78:0/3520425966 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6a4c1552e0 0x7f6a4c0c23e0 unknown :-1 s=CLOSED pgs=1067 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:51.662 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:51.656+0000 7f6a52184640 1 -- 172.21.15.78:0/3520425966 >> 172.21.15.78:0/3520425966 conn(0x7f6a4c0c79e0 msgr2=0x7f6a4c0c7df0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:02:51.662 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:51.656+0000 7f6a52184640 1 -- 172.21.15.78:0/3520425966 shutdown_connections 2023-11-28T20:02:51.662 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:51.656+0000 7f6a52184640 1 -- 172.21.15.78:0/3520425966 wait complete. 2023-11-28T20:02:51.662 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:51.656+0000 7f6a52184640 1 Processor -- start 2023-11-28T20:02:51.662 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:51.660+0000 7f6a52184640 1 -- start start 2023-11-28T20:02:51.665 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:51.660+0000 7f6a52184640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6a4c0c2920 0x7f6a4c0a8150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:51.665 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:51.660+0000 7f6a52184640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6a4c0c67d0 0x7f6a4c1462e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:51.665 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:51.660+0000 7f6a52184640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6a4c1552e0 0x7f6a4c146820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:51.665 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:51.660+0000 7f6a52184640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a4c157fa0 con 0x7f6a4c1552e0 2023-11-28T20:02:51.665 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:51.660+0000 7f6a52184640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a4c157250 con 0x7f6a4c0c2920 2023-11-28T20:02:51.665 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:51.660+0000 7f6a52184640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a4c1473c0 con 0x7f6a4c0c67d0 2023-11-28T20:02:51.665 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:51.660+0000 7f6a51983640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6a4c1552e0 0x7f6a4c146820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:02:51.665 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:51.660+0000 7f6a51983640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6a4c1552e0 0x7f6a4c146820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:50196/0 (socket says 172.21.15.78:50196) 2023-11-28T20:02:51.665 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:51.660+0000 7f6a51983640 1 -- 172.21.15.78:0/3800099361 learned_addr learned my addr 172.21.15.78:0/3800099361 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T20:02:51.665 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:51.660+0000 7f6a51182640 1 --2- 172.21.15.78:0/3800099361 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6a4c0c2920 0x7f6a4c0a8150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:02:51.666 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:51.660+0000 7f6a50981640 1 --2- 172.21.15.78:0/3800099361 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6a4c0c67d0 0x7f6a4c1462e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:02:51.666 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:51.660+0000 7f6a51983640 1 -- 172.21.15.78:0/3800099361 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6a4c0c67d0 msgr2=0x7f6a4c1462e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:02:51.666 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:51.660+0000 7f6a51983640 1 --2- 172.21.15.78:0/3800099361 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6a4c0c67d0 0x7f6a4c1462e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:51.666 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:51.660+0000 7f6a51983640 1 -- 172.21.15.78:0/3800099361 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6a4c0c2920 msgr2=0x7f6a4c0a8150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:02:51.666 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:51.660+0000 7f6a51983640 1 --2- 172.21.15.78:0/3800099361 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6a4c0c2920 0x7f6a4c0a8150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:51.666 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:51.660+0000 7f6a51983640 1 -- 172.21.15.78:0/3800099361 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a480094d0 con 0x7f6a4c1552e0 2023-11-28T20:02:51.666 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:51.660+0000 7f6a50981640 1 --2- 172.21.15.78:0/3800099361 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6a4c0c67d0 0x7f6a4c1462e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T20:02:51.666 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:51.660+0000 7f6a51983640 1 --2- 172.21.15.78:0/3800099361 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6a4c1552e0 0x7f6a4c146820 secure :-1 s=READY pgs=1068 cs=0 l=1 rev1=1 crypto rx=0x7f6a4400cd50 tx=0x7f6a4400a650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:02:51.666 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:51.660+0000 7f6a41ffb640 1 -- 172.21.15.78:0/3800099361 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a4400f680 con 0x7f6a4c1552e0 2023-11-28T20:02:51.666 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:51.660+0000 7f6a41ffb640 1 -- 172.21.15.78:0/3800099361 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a4400f800 con 0x7f6a4c1552e0 2023-11-28T20:02:51.666 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:51.660+0000 7f6a41ffb640 1 -- 172.21.15.78:0/3800099361 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a4400fbb0 con 0x7f6a4c1552e0 2023-11-28T20:02:51.667 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:51.660+0000 7f6a52184640 1 -- 172.21.15.78:0/3800099361 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6a4c1574c0 con 0x7f6a4c1552e0 2023-11-28T20:02:51.667 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:51.660+0000 7f6a52184640 1 -- 172.21.15.78:0/3800099361 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6a4c157a80 con 0x7f6a4c1552e0 2023-11-28T20:02:51.667 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:51.660+0000 7f6a52184640 1 -- 172.21.15.78:0/3800099361 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6a4c157ca0 con 0x7f6a4c1552e0 2023-11-28T20:02:51.668 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:51.664+0000 7f6a41ffb640 1 -- 172.21.15.78:0/3800099361 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f6a4400b040 con 0x7f6a4c1552e0 2023-11-28T20:02:51.668 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:51.664+0000 7f6a41ffb640 1 --2- 172.21.15.78:0/3800099361 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f6a300664a0 0x7f6a30068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:51.668 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:51.664+0000 7f6a41ffb640 1 -- 172.21.15.78:0/3800099361 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 7088+0+0 (secure 0 0 0) 0x7f6a44084d20 con 0x7f6a4c1552e0 2023-11-28T20:02:51.668 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:51.664+0000 7f6a51182640 1 --2- 172.21.15.78:0/3800099361 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f6a300664a0 0x7f6a30068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:02:51.668 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:51.664+0000 7f6a51182640 1 --2- 172.21.15.78:0/3800099361 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f6a300664a0 0x7f6a30068960 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f6a480ae000 tx=0x7f6a480a7000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:02:51.672 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:51.668+0000 7f6a41ffb640 1 -- 172.21.15.78:0/3800099361 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f6a44051c50 con 0x7f6a4c1552e0 2023-11-28T20:02:51.821 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:51.816+0000 7f6a52184640 1 -- 172.21.15.78:0/3800099361 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f6a4c06b1f0 con 0x7f6a4c1552e0 2023-11-28T20:02:51.822 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:51.820+0000 7f6a41ffb640 1 -- 172.21.15.78:0/3800099361 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v87) v1 ==== 74+0+20676 (secure 0 0 0) 0x7f6a4401d020 con 0x7f6a4c1552e0 2023-11-28T20:02:51.823 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-11-28T20:02:51.823 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":87,"fsid":"dd9780e8-3bda-44fa-a9f0-fa07d19d901d","created":"2023-11-28T19:58:40.969556+0000","modified":"2023-11-28T20:02:49.136462+0000","last_up_change":"2023-11-28T19:58:52.596716+0000","last_in_change":"2023-11-28T19:58:43.609275+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":16,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-28T19:58:54.011229+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_metadata","create_time":"2023-11-28T20:02:05.787820+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs_data","create_time":"2023-11-28T20:02:06.652305+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs2_metadata","create_time":"2023-11-28T20:02:23.066724+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":16,"pool_name":"cephfs2_data","create_time":"2023-11-28T20:02:24.230614+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs2"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e84245ac-b5da-429e-af18-39acaa2b33e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6800","nonce":3358701235},{"type":"v1","addr":"172.21.15.78:6801","nonce":3358701235}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6802","nonce":3358701235},{"type":"v1","addr":"172.21.15.78:6803","nonce":3358701235}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6806","nonce":3358701235},{"type":"v1","addr":"172.21.15.78:6807","nonce":3358701235}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6804","nonce":3358701235},{"type":"v1","addr":"172.21.15.78:6805","nonce":3358701235}]},"public_addr":"172.21.15.78:6801/3358701235","cluster_addr":"172.21.15.78:6803/3358701235","heartbeat_back_addr":"172.21.15.78:6807/3358701235","heartbeat_front_addr":"172.21.15.78:6805/3358701235","state":["exists","up"]},{"osd":1,"uuid":"e634831d-c4e2-48d9-870c-9556ae162981","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6808","nonce":3211476654},{"type":"v1","addr":"172.21.15.78:6809","nonce":3211476654}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6810","nonce":3211476654},{"type":"v1","addr":"172.21.15.78:6811","nonce":3211476654}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6814","nonce":3211476654},{"type":"v1","addr":"172.21.15.78:6815","nonce":3211476654}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6812","nonce":3211476654},{"type":"v1","addr":"172.21.15.78:6813","nonce":3211476654}]},"public_addr":"172.21.15.78:6809/3211476654","cluster_addr":"172.21.15.78:6811/3211476654","heartbeat_back_addr":"172.21.15.78:6815/3211476654","heartbeat_front_addr":"172.21.15.78:6813/3211476654","state":["exists","up"]},{"osd":2,"uuid":"274c8395-6534-41f0-b8fb-a00af8985aa8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6816","nonce":2532904479},{"type":"v1","addr":"172.21.15.78:6817","nonce":2532904479}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6818","nonce":2532904479},{"type":"v1","addr":"172.21.15.78:6819","nonce":2532904479}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6822","nonce":2532904479},{"type":"v1","addr":"172.21.15.78:6823","nonce":2532904479}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6820","nonce":2532904479},{"type":"v1","addr":"172.21.15.78:6821","nonce":2532904479}]},"public_addr":"172.21.15.78:6817/2532904479","cluster_addr":"172.21.15.78:6819/2532904479","heartbeat_back_addr":"172.21.15.78:6823/2532904479","heartbeat_front_addr":"172.21.15.78:6821/2532904479","state":["exists","up"]},{"osd":3,"uuid":"77acc9af-7d4d-4b18-8cf5-d62f5971b7c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6824","nonce":3442991267},{"type":"v1","addr":"172.21.15.78:6825","nonce":3442991267}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6826","nonce":3442991267},{"type":"v1","addr":"172.21.15.78:6827","nonce":3442991267}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6830","nonce":3442991267},{"type":"v1","addr":"172.21.15.78:6831","nonce":3442991267}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6828","nonce":3442991267},{"type":"v1","addr":"172.21.15.78:6829","nonce":3442991267}]},"public_addr":"172.21.15.78:6825/3442991267","cluster_addr":"172.21.15.78:6827/3442991267","heartbeat_back_addr":"172.21.15.78:6831/3442991267","heartbeat_front_addr":"172.21.15.78:6829/3442991267","state":["exists","up"]},{"osd":4,"uuid":"5c62bc66-6b34-4b7f-a66b-9a743969138c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":802983577},{"type":"v1","addr":"172.21.15.179:6809","nonce":802983577}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":802983577},{"type":"v1","addr":"172.21.15.179:6811","nonce":802983577}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":802983577},{"type":"v1","addr":"172.21.15.179:6815","nonce":802983577}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":802983577},{"type":"v1","addr":"172.21.15.179:6813","nonce":802983577}]},"public_addr":"172.21.15.179:6809/802983577","cluster_addr":"172.21.15.179:6811/802983577","heartbeat_back_addr":"172.21.15.179:6815/802983577","heartbeat_front_addr":"172.21.15.179:6813/802983577","state":["exists","up"]},{"osd":5,"uuid":"67db6d36-f684-4079-b0cd-82b4dd61461f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":518192887},{"type":"v1","addr":"172.21.15.179:6818","nonce":518192887}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":518192887},{"type":"v1","addr":"172.21.15.179:6822","nonce":518192887}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":518192887},{"type":"v1","addr":"172.21.15.179:6829","nonce":518192887}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6824","nonce":518192887},{"type":"v1","addr":"172.21.15.179:6826","nonce":518192887}]},"public_addr":"172.21.15.179:6818/518192887","cluster_addr":"172.21.15.179:6822/518192887","heartbeat_back_addr":"172.21.15.179:6829/518192887","heartbeat_front_addr":"172.21.15.179:6826/518192887","state":["exists","up"]},{"osd":6,"uuid":"12e670af-5a16-4c81-9f97-defa66cab967","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":815435378},{"type":"v1","addr":"172.21.15.179:6801","nonce":815435378}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":815435378},{"type":"v1","addr":"172.21.15.179:6803","nonce":815435378}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":815435378},{"type":"v1","addr":"172.21.15.179:6807","nonce":815435378}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":815435378},{"type":"v1","addr":"172.21.15.179:6805","nonce":815435378}]},"public_addr":"172.21.15.179:6801/815435378","cluster_addr":"172.21.15.179:6803/815435378","heartbeat_back_addr":"172.21.15.179:6807/815435378","heartbeat_front_addr":"172.21.15.179:6805/815435378","state":["exists","up"]},{"osd":7,"uuid":"fe630650-2eb3-49ad-8676-c341e6332eb1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6817","nonce":2848432339},{"type":"v1","addr":"172.21.15.179:6819","nonce":2848432339}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6821","nonce":2848432339},{"type":"v1","addr":"172.21.15.179:6823","nonce":2848432339}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":2848432339},{"type":"v1","addr":"172.21.15.179:6831","nonce":2848432339}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6825","nonce":2848432339},{"type":"v1","addr":"172.21.15.179:6827","nonce":2848432339}]},"public_addr":"172.21.15.179:6819/2848432339","cluster_addr":"172.21.15.179:6823/2848432339","heartbeat_back_addr":"172.21.15.179:6831/2848432339","heartbeat_front_addr":"172.21.15.179:6827/2848432339","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:58:49.255433+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:58:49.412880+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:58:49.559295+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:58:49.245237+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:58:49.184557+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:58:49.329851+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:58:49.366012+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:58:49.349604+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"14.8","mappings":[{"from":1,"to":5}]},{"pgid":"14.2c","mappings":[{"from":1,"to":7}]},{"pgid":"14.33","mappings":[{"from":1,"to":2}]},{"pgid":"14.3c","mappings":[{"from":1,"to":7}]},{"pgid":"16.1f","mappings":[{"from":5,"to":4}]},{"pgid":"16.26","mappings":[{"from":6,"to":7}]},{"pgid":"16.3a","mappings":[{"from":1,"to":4}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-28T20:02:51.825 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:51.820+0000 7f6a52184640 1 -- 172.21.15.78:0/3800099361 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f6a300664a0 msgr2=0x7f6a30068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:02:51.825 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:51.820+0000 7f6a52184640 1 --2- 172.21.15.78:0/3800099361 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f6a300664a0 0x7f6a30068960 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f6a480ae000 tx=0x7f6a480a7000 comp rx=0 tx=0).stop 2023-11-28T20:02:51.825 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:51.820+0000 7f6a52184640 1 -- 172.21.15.78:0/3800099361 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6a4c1552e0 msgr2=0x7f6a4c146820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:02:51.825 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:51.820+0000 7f6a52184640 1 --2- 172.21.15.78:0/3800099361 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6a4c1552e0 0x7f6a4c146820 secure :-1 s=READY pgs=1068 cs=0 l=1 rev1=1 crypto rx=0x7f6a4400cd50 tx=0x7f6a4400a650 comp rx=0 tx=0).stop 2023-11-28T20:02:51.825 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:51.820+0000 7f6a52184640 1 -- 172.21.15.78:0/3800099361 shutdown_connections 2023-11-28T20:02:51.825 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:51.820+0000 7f6a52184640 1 --2- 172.21.15.78:0/3800099361 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f6a300664a0 0x7f6a30068960 unknown :-1 s=CLOSED pgs=507 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:51.825 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:51.820+0000 7f6a52184640 1 --2- 172.21.15.78:0/3800099361 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6a4c0c67d0 0x7f6a4c1462e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:51.826 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:51.820+0000 7f6a52184640 1 --2- 172.21.15.78:0/3800099361 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6a4c1552e0 0x7f6a4c146820 unknown :-1 s=CLOSED pgs=1068 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:51.826 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:51.820+0000 7f6a52184640 1 --2- 172.21.15.78:0/3800099361 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6a4c0c2920 0x7f6a4c0a8150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:51.826 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:51.820+0000 7f6a52184640 1 -- 172.21.15.78:0/3800099361 >> 172.21.15.78:0/3800099361 conn(0x7f6a4c0c79e0 msgr2=0x7f6a4c0c3ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:02:51.826 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:51.820+0000 7f6a52184640 1 -- 172.21.15.78:0/3800099361 shutdown_connections 2023-11-28T20:02:51.826 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:51.820+0000 7f6a52184640 1 -- 172.21.15.78:0/3800099361 wait complete. 2023-11-28T20:02:51.844 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-28T19:58:54.011229+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 13, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-28T20:02:05.787820+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '80', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 14, 'pool_name': 'cephfs_data', 'create_time': '2023-11-28T20:02:06.652305+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '81', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 15, 'pool_name': 'cephfs2_metadata', 'create_time': '2023-11-28T20:02:23.066724+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '84', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs2'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 16, 'pool_name': 'cephfs2_data', 'create_time': '2023-11-28T20:02:24.230614+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '85', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs2'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-28T20:02:51.845 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-28T20:02:51.985 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:51.980+0000 7f43e2e6b640 1 Processor -- start 2023-11-28T20:02:51.985 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:51.980+0000 7f43e2e6b640 1 -- start start 2023-11-28T20:02:51.987 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:51.980+0000 7f43e2e6b640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f43dc0bed60 0x7f43dc0bf140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:51.987 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:51.980+0000 7f43e2e6b640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f43dc0c4b20 0x7f43dc1585d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:51.987 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:51.980+0000 7f43e2e6b640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f43dc157b80 con 0x7f43dc0a4f30 2023-11-28T20:02:51.987 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:51.980+0000 7f43e2e6b640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f43dc158b10 con 0x7f43dc0c4b20 2023-11-28T20:02:51.988 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:51.980+0000 7f43e2e6b640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f43dc06d6c0 con 0x7f43dc0bed60 2023-11-28T20:02:51.988 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:51.980+0000 7f43e1408640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f43dc0c4b20 0x7f43dc1585d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:02:51.988 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:51.980+0000 7f43d3fff640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f43dc0a4f30 0x7f43dc154590 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:41846/0 (socket says 172.21.15.78:41846) 2023-11-28T20:02:51.988 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:51.980+0000 7f43d3fff640 1 -- 172.21.15.78:0/1351618915 learned_addr learned my addr 172.21.15.78:0/1351618915 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-11-28T20:02:51.988 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:51.984+0000 7f43e0c07640 1 --2- 172.21.15.78:0/1351618915 >> v2:172.21.15.179:3300/0 conn(0x7f43dc0bed60 0x7f43dc0bf140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:02:51.988 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:51.984+0000 7f43e1408640 1 -- 172.21.15.78:0/1351618915 >> v2:172.21.15.179:3300/0 conn(0x7f43dc0bed60 msgr2=0x7f43dc0bf140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:02:51.988 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:51.984+0000 7f43e1408640 1 --2- 172.21.15.78:0/1351618915 >> v2:172.21.15.179:3300/0 conn(0x7f43dc0bed60 0x7f43dc0bf140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:51.988 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:51.984+0000 7f43e1408640 1 -- 172.21.15.78:0/1351618915 >> v1:172.21.15.78:6789/0 conn(0x7f43dc0a4f30 legacy=0x7f43dc154590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:02:51.988 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:51.984+0000 7f43e1408640 1 -- 172.21.15.78:0/1351618915 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43dc06d960 con 0x7f43dc0c4b20 2023-11-28T20:02:51.989 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:51.984+0000 7f43e1408640 1 --2- 172.21.15.78:0/1351618915 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f43dc0c4b20 0x7f43dc1585d0 secure :-1 s=READY pgs=1070 cs=0 l=1 rev1=1 crypto rx=0x7f43dc066dc0 tx=0x7f43d401c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3f7c3c516cc7e87a server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:02:51.990 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:51.984+0000 7f43d37fe640 1 -- 172.21.15.78:0/1351618915 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43d40a5830 con 0x7f43dc0c4b20 2023-11-28T20:02:51.990 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:51.984+0000 7f43d37fe640 1 -- 172.21.15.78:0/1351618915 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f43d40a5990 con 0x7f43dc0c4b20 2023-11-28T20:02:51.990 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:51.984+0000 7f43d37fe640 1 -- 172.21.15.78:0/1351618915 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43d40a5d20 con 0x7f43dc0c4b20 2023-11-28T20:02:51.991 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:51.984+0000 7f43e2e6b640 1 -- 172.21.15.78:0/1351618915 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f43dc0c4b20 msgr2=0x7f43dc1585d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:02:51.991 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:51.984+0000 7f43e2e6b640 1 --2- 172.21.15.78:0/1351618915 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f43dc0c4b20 0x7f43dc1585d0 secure :-1 s=READY pgs=1070 cs=0 l=1 rev1=1 crypto rx=0x7f43dc066dc0 tx=0x7f43d401c880 comp rx=0 tx=0).stop 2023-11-28T20:02:51.991 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:51.988+0000 7f43e2e6b640 1 -- 172.21.15.78:0/1351618915 shutdown_connections 2023-11-28T20:02:51.991 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:51.988+0000 7f43e2e6b640 1 --2- 172.21.15.78:0/1351618915 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f43dc0c4b20 0x7f43dc1585d0 unknown :-1 s=CLOSED pgs=1070 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:51.991 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:51.988+0000 7f43e2e6b640 1 --2- 172.21.15.78:0/1351618915 >> v2:172.21.15.179:3300/0 conn(0x7f43dc0bed60 0x7f43dc0bf140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:51.991 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:51.988+0000 7f43e2e6b640 1 -- 172.21.15.78:0/1351618915 >> 172.21.15.78:0/1351618915 conn(0x7f43dc0c59f0 msgr2=0x7f43dc0c5e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:02:51.992 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:51.988+0000 7f43e2e6b640 1 -- 172.21.15.78:0/1351618915 shutdown_connections 2023-11-28T20:02:51.992 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:51.988+0000 7f43e2e6b640 1 -- 172.21.15.78:0/1351618915 wait complete. 2023-11-28T20:02:51.992 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:51.988+0000 7f43e2e6b640 1 Processor -- start 2023-11-28T20:02:51.992 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:51.988+0000 7f43e2e6b640 1 -- start start 2023-11-28T20:02:51.994 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:51.988+0000 7f43e2e6b640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f43dc0a4f30 0x7f43dc148570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:51.995 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:51.988+0000 7f43e2e6b640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f43dc0bed60 0x7f43dc150490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:51.995 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:51.988+0000 7f43e2e6b640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f43dc0c4b20 0x7f43dc14d030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:51.995 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:51.988+0000 7f43e2e6b640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43dc148fa0 con 0x7f43dc0c4b20 2023-11-28T20:02:51.995 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:51.988+0000 7f43e2e6b640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43dc1544d0 con 0x7f43dc0bed60 2023-11-28T20:02:51.995 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:51.988+0000 7f43e2e6b640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f43dc154700 con 0x7f43dc0a4f30 2023-11-28T20:02:51.995 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:51.988+0000 7f43e1408640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f43dc0c4b20 0x7f43dc14d030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:02:51.995 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:51.988+0000 7f43e1408640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f43dc0c4b20 0x7f43dc14d030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:50228/0 (socket says 172.21.15.78:50228) 2023-11-28T20:02:51.995 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:51.988+0000 7f43e1408640 1 -- 172.21.15.78:0/1045094964 learned_addr learned my addr 172.21.15.78:0/1045094964 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T20:02:51.995 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:51.988+0000 7f43d3fff640 1 --2- 172.21.15.78:0/1045094964 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f43dc0bed60 0x7f43dc150490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:02:51.995 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:51.988+0000 7f43e0c07640 1 --2- 172.21.15.78:0/1045094964 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f43dc0a4f30 0x7f43dc148570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:02:51.996 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:51.988+0000 7f43e1408640 1 -- 172.21.15.78:0/1045094964 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f43dc0a4f30 msgr2=0x7f43dc148570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:02:51.996 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:51.988+0000 7f43e1408640 1 --2- 172.21.15.78:0/1045094964 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f43dc0a4f30 0x7f43dc148570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:51.996 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:51.988+0000 7f43e1408640 1 -- 172.21.15.78:0/1045094964 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f43dc0bed60 msgr2=0x7f43dc150490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:02:51.996 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:51.988+0000 7f43e1408640 1 --2- 172.21.15.78:0/1045094964 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f43dc0bed60 0x7f43dc150490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:51.996 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:51.988+0000 7f43e1408640 1 -- 172.21.15.78:0/1045094964 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43d4009a70 con 0x7f43dc0c4b20 2023-11-28T20:02:51.996 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:51.988+0000 7f43e0c07640 1 --2- 172.21.15.78:0/1045094964 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f43dc0a4f30 0x7f43dc148570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T20:02:51.996 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:51.988+0000 7f43e1408640 1 --2- 172.21.15.78:0/1045094964 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f43dc0c4b20 0x7f43dc14d030 secure :-1 s=READY pgs=1071 cs=0 l=1 rev1=1 crypto rx=0x7f43d4019490 tx=0x7f43d4019620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:02:51.996 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:51.992+0000 7f43d17fa640 1 -- 172.21.15.78:0/1045094964 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43d40b9860 con 0x7f43dc0c4b20 2023-11-28T20:02:51.996 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:51.992+0000 7f43d17fa640 1 -- 172.21.15.78:0/1045094964 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f43d40a5820 con 0x7f43dc0c4b20 2023-11-28T20:02:51.996 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:51.992+0000 7f43d17fa640 1 -- 172.21.15.78:0/1045094964 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43d40b9c00 con 0x7f43dc0c4b20 2023-11-28T20:02:51.996 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:51.992+0000 7f43e2e6b640 1 -- 172.21.15.78:0/1045094964 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f43dc1549e0 con 0x7f43dc0c4b20 2023-11-28T20:02:51.997 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:51.992+0000 7f43e2e6b640 1 -- 172.21.15.78:0/1045094964 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f43dc152780 con 0x7f43dc0c4b20 2023-11-28T20:02:51.997 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:51.992+0000 7f43e2e6b640 1 -- 172.21.15.78:0/1045094964 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f43dc067630 con 0x7f43dc0c4b20 2023-11-28T20:02:51.997 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:51.992+0000 7f43d17fa640 1 -- 172.21.15.78:0/1045094964 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f43d40ad440 con 0x7f43dc0c4b20 2023-11-28T20:02:51.997 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:51.992+0000 7f43d17fa640 1 --2- 172.21.15.78:0/1045094964 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f43c80664a0 0x7f43c8068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:51.998 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:51.992+0000 7f43d17fa640 1 -- 172.21.15.78:0/1045094964 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 7088+0+0 (secure 0 0 0) 0x7f43d411f8c0 con 0x7f43dc0c4b20 2023-11-28T20:02:51.998 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:51.992+0000 7f43e0c07640 1 --2- 172.21.15.78:0/1045094964 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f43c80664a0 0x7f43c8068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:02:51.998 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:51.992+0000 7f43e0c07640 1 --2- 172.21.15.78:0/1045094964 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f43c80664a0 0x7f43c8068960 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f43dc149660 tx=0x7f43d8008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:02:52.002 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:51.996+0000 7f43d17fa640 1 -- 172.21.15.78:0/1045094964 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f43d40ec910 con 0x7f43dc0c4b20 2023-11-28T20:02:52.155 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:52.148+0000 7f43e2e6b640 1 -- 172.21.15.78:0/1045094964 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f43dc0729b0 con 0x7f43dc0c4b20 2023-11-28T20:02:52.155 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:52.152+0000 7f43d17fa640 1 -- 172.21.15.78:0/1045094964 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v87) v1 ==== 93+0+10 (secure 0 0 0) 0x7f43d40eff30 con 0x7f43dc0c4b20 2023-11-28T20:02:52.155 INFO:teuthology.orchestra.run.smithi078.stdout:pg_num: 1 2023-11-28T20:02:52.157 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:52.152+0000 7f43e2e6b640 1 -- 172.21.15.78:0/1045094964 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f43c80664a0 msgr2=0x7f43c8068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:02:52.157 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:52.152+0000 7f43e2e6b640 1 --2- 172.21.15.78:0/1045094964 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f43c80664a0 0x7f43c8068960 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f43dc149660 tx=0x7f43d8008040 comp rx=0 tx=0).stop 2023-11-28T20:02:52.157 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:52.152+0000 7f43e2e6b640 1 -- 172.21.15.78:0/1045094964 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f43dc0c4b20 msgr2=0x7f43dc14d030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:02:52.157 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:52.152+0000 7f43e2e6b640 1 --2- 172.21.15.78:0/1045094964 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f43dc0c4b20 0x7f43dc14d030 secure :-1 s=READY pgs=1071 cs=0 l=1 rev1=1 crypto rx=0x7f43d4019490 tx=0x7f43d4019620 comp rx=0 tx=0).stop 2023-11-28T20:02:52.157 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:52.152+0000 7f43e2e6b640 1 -- 172.21.15.78:0/1045094964 shutdown_connections 2023-11-28T20:02:52.157 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:52.152+0000 7f43e2e6b640 1 --2- 172.21.15.78:0/1045094964 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f43c80664a0 0x7f43c8068960 unknown :-1 s=CLOSED pgs=508 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:52.157 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:52.152+0000 7f43e2e6b640 1 --2- 172.21.15.78:0/1045094964 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f43dc0c4b20 0x7f43dc14d030 unknown :-1 s=CLOSED pgs=1071 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:52.158 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:52.152+0000 7f43e2e6b640 1 --2- 172.21.15.78:0/1045094964 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f43dc0bed60 0x7f43dc150490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:52.158 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:52.152+0000 7f43e2e6b640 1 --2- 172.21.15.78:0/1045094964 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f43dc0a4f30 0x7f43dc148570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:52.158 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:52.152+0000 7f43e2e6b640 1 -- 172.21.15.78:0/1045094964 >> 172.21.15.78:0/1045094964 conn(0x7f43dc0c59f0 msgr2=0x7f43dc0a60c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:02:52.158 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:52.152+0000 7f43e2e6b640 1 -- 172.21.15.78:0/1045094964 shutdown_connections 2023-11-28T20:02:52.158 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:52.152+0000 7f43e2e6b640 1 -- 172.21.15.78:0/1045094964 wait complete. 2023-11-28T20:02:52.176 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-28T20:02:52.316 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:52.312+0000 7f6e61ae3640 1 Processor -- start 2023-11-28T20:02:52.317 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:52.312+0000 7f6e61ae3640 1 -- start start 2023-11-28T20:02:52.318 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:52.312+0000 7f6e61ae3640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f6e5c0bed60 0x7f6e5c0bf140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:52.318 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:52.312+0000 7f6e61ae3640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6e5c0a4f30 0x7f6e5c1585d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:52.318 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:52.312+0000 7f6e61ae3640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f6e5c0c4b20 0x7f6e5c154590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:52.319 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:52.312+0000 7f6e61ae3640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6e5c157b80 con 0x7f6e5c0c4b20 2023-11-28T20:02:52.319 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:52.312+0000 7f6e61ae3640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6e5c158b10 con 0x7f6e5c0bed60 2023-11-28T20:02:52.319 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:52.312+0000 7f6e61ae3640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6e5c06d6c0 con 0x7f6e5c0a4f30 2023-11-28T20:02:52.319 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:52.312+0000 7f6e5bfff640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f6e5c0c4b20 0x7f6e5c154590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:02:52.319 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:52.312+0000 7f6e5bfff640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f6e5c0c4b20 0x7f6e5c154590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:50230/0 (socket says 172.21.15.78:50230) 2023-11-28T20:02:52.319 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:52.312+0000 7f6e5bfff640 1 -- 172.21.15.78:0/2107221459 learned_addr learned my addr 172.21.15.78:0/2107221459 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T20:02:52.319 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:52.312+0000 7f6e53fff640 1 --2- 172.21.15.78:0/2107221459 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6e5c0a4f30 0x7f6e5c1585d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:02:52.319 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:52.312+0000 7f6e5b7fe640 1 --2- 172.21.15.78:0/2107221459 >> v2:172.21.15.179:3300/0 conn(0x7f6e5c0bed60 0x7f6e5c0bf140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:02:52.319 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:52.312+0000 7f6e5bfff640 1 -- 172.21.15.78:0/2107221459 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6e5c0a4f30 msgr2=0x7f6e5c1585d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:02:52.319 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:52.312+0000 7f6e5bfff640 1 --2- 172.21.15.78:0/2107221459 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6e5c0a4f30 0x7f6e5c1585d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:52.319 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:52.312+0000 7f6e5bfff640 1 -- 172.21.15.78:0/2107221459 >> v2:172.21.15.179:3300/0 conn(0x7f6e5c0bed60 msgr2=0x7f6e5c0bf140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:02:52.320 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:52.312+0000 7f6e5bfff640 1 --2- 172.21.15.78:0/2107221459 >> v2:172.21.15.179:3300/0 conn(0x7f6e5c0bed60 0x7f6e5c0bf140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:52.320 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:52.312+0000 7f6e5bfff640 1 -- 172.21.15.78:0/2107221459 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e5c06d960 con 0x7f6e5c0c4b20 2023-11-28T20:02:52.320 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:52.312+0000 7f6e5b7fe640 1 --2- 172.21.15.78:0/2107221459 >> v2:172.21.15.179:3300/0 conn(0x7f6e5c0bed60 0x7f6e5c0bf140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T20:02:52.321 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:52.316+0000 7f6e5bfff640 1 --2- 172.21.15.78:0/2107221459 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6e5c0c4b20 0x7f6e5c154590 secure :-1 s=READY pgs=1072 cs=0 l=1 rev1=1 crypto rx=0x7f6e5c066dc0 tx=0x7f6e5401c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=76902486085ce298 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:02:52.322 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:52.316+0000 7f6e5affd640 1 -- 172.21.15.78:0/2107221459 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e540a5790 con 0x7f6e5c0c4b20 2023-11-28T20:02:52.322 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:52.316+0000 7f6e5affd640 1 -- 172.21.15.78:0/2107221459 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e540a58f0 con 0x7f6e5c0c4b20 2023-11-28T20:02:52.322 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:52.316+0000 7f6e5affd640 1 -- 172.21.15.78:0/2107221459 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e540a5c80 con 0x7f6e5c0c4b20 2023-11-28T20:02:52.323 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:52.316+0000 7f6e61ae3640 1 -- 172.21.15.78:0/2107221459 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6e5c0c4b20 msgr2=0x7f6e5c154590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:02:52.323 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:52.316+0000 7f6e61ae3640 1 --2- 172.21.15.78:0/2107221459 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6e5c0c4b20 0x7f6e5c154590 secure :-1 s=READY pgs=1072 cs=0 l=1 rev1=1 crypto rx=0x7f6e5c066dc0 tx=0x7f6e5401c910 comp rx=0 tx=0).stop 2023-11-28T20:02:52.323 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:52.316+0000 7f6e61ae3640 1 -- 172.21.15.78:0/2107221459 shutdown_connections 2023-11-28T20:02:52.323 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:52.316+0000 7f6e61ae3640 1 --2- 172.21.15.78:0/2107221459 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6e5c0c4b20 0x7f6e5c154590 unknown :-1 s=CLOSED pgs=1072 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:52.323 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:52.316+0000 7f6e61ae3640 1 --2- 172.21.15.78:0/2107221459 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6e5c0a4f30 0x7f6e5c1585d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:52.323 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:52.316+0000 7f6e61ae3640 1 --2- 172.21.15.78:0/2107221459 >> v2:172.21.15.179:3300/0 conn(0x7f6e5c0bed60 0x7f6e5c0bf140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:52.323 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:52.316+0000 7f6e61ae3640 1 -- 172.21.15.78:0/2107221459 >> 172.21.15.78:0/2107221459 conn(0x7f6e5c0c59f0 msgr2=0x7f6e5c0c5e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:02:52.324 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:52.316+0000 7f6e61ae3640 1 -- 172.21.15.78:0/2107221459 shutdown_connections 2023-11-28T20:02:52.324 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:52.316+0000 7f6e61ae3640 1 -- 172.21.15.78:0/2107221459 wait complete. 2023-11-28T20:02:52.326 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:52.320+0000 7f6e61ae3640 1 Processor -- start 2023-11-28T20:02:52.326 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:52.320+0000 7f6e61ae3640 1 -- start start 2023-11-28T20:02:52.326 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:52.320+0000 7f6e61ae3640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6e5c0a4f30 0x7f6e5c1563b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:52.326 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:52.320+0000 7f6e61ae3640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6e5c0bed60 0x7f6e5c150f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:52.326 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:52.320+0000 7f6e61ae3640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6e5c0c4b20 0x7f6e5c1ecca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:52.326 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:52.320+0000 7f6e61ae3640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e5c1f0be0 con 0x7f6e5c0c4b20 2023-11-28T20:02:52.327 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:52.320+0000 7f6e61ae3640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e5c153d00 con 0x7f6e5c0a4f30 2023-11-28T20:02:52.327 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:52.320+0000 7f6e61ae3640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6e5c1f02b0 con 0x7f6e5c0bed60 2023-11-28T20:02:52.327 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:52.320+0000 7f6e5bfff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6e5c0c4b20 0x7f6e5c1ecca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:02:52.327 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:52.320+0000 7f6e5bfff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6e5c0c4b20 0x7f6e5c1ecca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:50246/0 (socket says 172.21.15.78:50246) 2023-11-28T20:02:52.327 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:52.320+0000 7f6e5bfff640 1 -- 172.21.15.78:0/2426448579 learned_addr learned my addr 172.21.15.78:0/2426448579 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T20:02:52.327 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:52.320+0000 7f6e53fff640 1 --2- 172.21.15.78:0/2426448579 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6e5c0bed60 0x7f6e5c150f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:02:52.327 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:52.320+0000 7f6e5b7fe640 1 --2- 172.21.15.78:0/2426448579 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6e5c0a4f30 0x7f6e5c1563b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:02:52.327 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:52.320+0000 7f6e5bfff640 1 -- 172.21.15.78:0/2426448579 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6e5c0bed60 msgr2=0x7f6e5c150f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:02:52.328 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:52.320+0000 7f6e5bfff640 1 --2- 172.21.15.78:0/2426448579 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6e5c0bed60 0x7f6e5c150f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:52.328 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:52.320+0000 7f6e5bfff640 1 -- 172.21.15.78:0/2426448579 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6e5c0a4f30 msgr2=0x7f6e5c1563b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:02:52.328 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:52.320+0000 7f6e5bfff640 1 --2- 172.21.15.78:0/2426448579 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6e5c0a4f30 0x7f6e5c1563b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:52.328 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:52.320+0000 7f6e5bfff640 1 -- 172.21.15.78:0/2426448579 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e54009b30 con 0x7f6e5c0c4b20 2023-11-28T20:02:52.328 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:52.320+0000 7f6e5bfff640 1 --2- 172.21.15.78:0/2426448579 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6e5c0c4b20 0x7f6e5c1ecca0 secure :-1 s=READY pgs=1073 cs=0 l=1 rev1=1 crypto rx=0x7f6e5401afc0 tx=0x7f6e540196b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:02:52.328 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:52.320+0000 7f6e58ff9640 1 -- 172.21.15.78:0/2426448579 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e540b8670 con 0x7f6e5c0c4b20 2023-11-28T20:02:52.328 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:52.320+0000 7f6e58ff9640 1 -- 172.21.15.78:0/2426448579 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e540b87d0 con 0x7f6e5c0c4b20 2023-11-28T20:02:52.328 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:52.320+0000 7f6e58ff9640 1 -- 172.21.15.78:0/2426448579 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e540b8b60 con 0x7f6e5c0c4b20 2023-11-28T20:02:52.328 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:52.320+0000 7f6e61ae3640 1 -- 172.21.15.78:0/2426448579 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6e5c1f0520 con 0x7f6e5c0c4b20 2023-11-28T20:02:52.328 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:52.320+0000 7f6e61ae3640 1 -- 172.21.15.78:0/2426448579 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6e5c1514d0 con 0x7f6e5c0c4b20 2023-11-28T20:02:52.329 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:52.324+0000 7f6e61ae3640 1 -- 172.21.15.78:0/2426448579 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6e5c1f0d20 con 0x7f6e5c0c4b20 2023-11-28T20:02:52.329 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:52.324+0000 7f6e58ff9640 1 -- 172.21.15.78:0/2426448579 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f6e540b8cc0 con 0x7f6e5c0c4b20 2023-11-28T20:02:52.330 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:52.324+0000 7f6e58ff9640 1 --2- 172.21.15.78:0/2426448579 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f6e3c066470 0x7f6e3c068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:52.330 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:52.324+0000 7f6e58ff9640 1 -- 172.21.15.78:0/2426448579 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 7088+0+0 (secure 0 0 0) 0x7f6e5411f920 con 0x7f6e5c0c4b20 2023-11-28T20:02:52.330 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:52.324+0000 7f6e5b7fe640 1 --2- 172.21.15.78:0/2426448579 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f6e3c066470 0x7f6e3c068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:02:52.330 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:52.324+0000 7f6e5b7fe640 1 --2- 172.21.15.78:0/2426448579 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f6e3c066470 0x7f6e3c068930 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f6e5c154aa0 tx=0x7f6e4c008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:02:52.333 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:52.328+0000 7f6e58ff9640 1 -- 172.21.15.78:0/2426448579 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f6e5c1f0d20 con 0x7f6e5c0c4b20 2023-11-28T20:02:52.481 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:52.476+0000 7f6e61ae3640 1 -- 172.21.15.78:0/2426448579 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f6e5c1f0d20 con 0x7f6e5c0c4b20 2023-11-28T20:02:52.482 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:52.476+0000 7f6e58ff9640 1 -- 172.21.15.78:0/2426448579 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v87) v1 ==== 104+0+11 (secure 0 0 0) 0x7f6e540bc020 con 0x7f6e5c0c4b20 2023-11-28T20:02:52.482 INFO:teuthology.orchestra.run.smithi078.stdout:pg_num: 32 2023-11-28T20:02:52.484 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:52.480+0000 7f6e61ae3640 1 -- 172.21.15.78:0/2426448579 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f6e3c066470 msgr2=0x7f6e3c068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:02:52.484 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:52.480+0000 7f6e61ae3640 1 --2- 172.21.15.78:0/2426448579 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f6e3c066470 0x7f6e3c068930 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f6e5c154aa0 tx=0x7f6e4c008040 comp rx=0 tx=0).stop 2023-11-28T20:02:52.484 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:52.480+0000 7f6e61ae3640 1 -- 172.21.15.78:0/2426448579 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6e5c0c4b20 msgr2=0x7f6e5c1ecca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:02:52.484 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:52.480+0000 7f6e61ae3640 1 --2- 172.21.15.78:0/2426448579 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6e5c0c4b20 0x7f6e5c1ecca0 secure :-1 s=READY pgs=1073 cs=0 l=1 rev1=1 crypto rx=0x7f6e5401afc0 tx=0x7f6e540196b0 comp rx=0 tx=0).stop 2023-11-28T20:02:52.484 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:52.480+0000 7f6e61ae3640 1 -- 172.21.15.78:0/2426448579 shutdown_connections 2023-11-28T20:02:52.484 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:52.480+0000 7f6e61ae3640 1 --2- 172.21.15.78:0/2426448579 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f6e3c066470 0x7f6e3c068930 unknown :-1 s=CLOSED pgs=509 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:52.484 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:52.480+0000 7f6e61ae3640 1 --2- 172.21.15.78:0/2426448579 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6e5c0bed60 0x7f6e5c150f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:52.484 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:52.480+0000 7f6e61ae3640 1 --2- 172.21.15.78:0/2426448579 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6e5c0c4b20 0x7f6e5c1ecca0 unknown :-1 s=CLOSED pgs=1073 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:52.484 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:52.480+0000 7f6e61ae3640 1 --2- 172.21.15.78:0/2426448579 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6e5c0a4f30 0x7f6e5c1563b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:52.485 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:52.480+0000 7f6e61ae3640 1 -- 172.21.15.78:0/2426448579 >> 172.21.15.78:0/2426448579 conn(0x7f6e5c0c59f0 msgr2=0x7f6e5c06cc10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:02:52.485 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:52.480+0000 7f6e61ae3640 1 -- 172.21.15.78:0/2426448579 shutdown_connections 2023-11-28T20:02:52.485 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:52.480+0000 7f6e61ae3640 1 -- 172.21.15.78:0/2426448579 wait complete. 2023-11-28T20:02:52.502 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-28T20:02:52.643 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:52.640+0000 7f8f8fa09640 1 Processor -- start 2023-11-28T20:02:52.643 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:52.640+0000 7f8f8fa09640 1 -- start start 2023-11-28T20:02:52.644 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:52.640+0000 7f8f8fa09640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f8f8814f850 0x7f8f880aacf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:52.645 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:52.640+0000 7f8f8fa09640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8f8806d840 0x7f8f880c43e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:52.645 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:52.640+0000 7f8f8fa09640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8f88152910 con 0x7f8f8814fc30 2023-11-28T20:02:52.645 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:52.640+0000 7f8f8fa09640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8f880c2240 con 0x7f8f8814f850 2023-11-28T20:02:52.645 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:52.640+0000 7f8f8fa09640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8f88152bf0 con 0x7f8f8806d840 2023-11-28T20:02:52.645 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:52.640+0000 7f8f8d7a5640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f8f8814f850 0x7f8f880aacf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:02:52.645 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:52.640+0000 7f8f8cfa4640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f8f8814fc30 0x7f8f880c3cd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:41854/0 (socket says 172.21.15.78:41854) 2023-11-28T20:02:52.645 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:52.640+0000 7f8f8cfa4640 1 -- 172.21.15.78:0/3449346617 learned_addr learned my addr 172.21.15.78:0/3449346617 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-11-28T20:02:52.645 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:52.640+0000 7f8f8dfa6640 1 --2- 172.21.15.78:0/3449346617 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8f8806d840 0x7f8f880c43e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:02:52.646 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:52.640+0000 7f8f8d7a5640 1 -- 172.21.15.78:0/3449346617 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8f8806d840 msgr2=0x7f8f880c43e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:02:52.646 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:52.640+0000 7f8f8d7a5640 1 --2- 172.21.15.78:0/3449346617 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8f8806d840 0x7f8f880c43e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:52.646 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:52.640+0000 7f8f8d7a5640 1 -- 172.21.15.78:0/3449346617 >> v1:172.21.15.78:6789/0 conn(0x7f8f8814fc30 legacy=0x7f8f880c3cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:02:52.646 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:52.640+0000 7f8f8d7a5640 1 -- 172.21.15.78:0/3449346617 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f88152ed0 con 0x7f8f8814f850 2023-11-28T20:02:52.646 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:52.640+0000 7f8f7ffff640 1 -- 172.21.15.78:0/3449346617 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 485922874 0 0) 0x7f8f88152910 con 0x7f8f8814fc30 2023-11-28T20:02:52.650 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:52.644+0000 7f8f8d7a5640 1 --2- 172.21.15.78:0/3449346617 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8f8814f850 0x7f8f880aacf0 secure :-1 s=READY pgs=1075 cs=0 l=1 rev1=1 crypto rx=0x7f8f840097c0 tx=0x7f8f8401c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9770a94aed34b790 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:02:52.650 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:52.644+0000 7f8f7ffff640 1 -- 172.21.15.78:0/3449346617 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f840a6040 con 0x7f8f8814f850 2023-11-28T20:02:52.650 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:52.644+0000 7f8f7ffff640 1 -- 172.21.15.78:0/3449346617 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f840aa600 con 0x7f8f8814f850 2023-11-28T20:02:52.650 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:52.644+0000 7f8f7ffff640 1 -- 172.21.15.78:0/3449346617 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f840aa990 con 0x7f8f8814f850 2023-11-28T20:02:52.650 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:52.644+0000 7f8f8fa09640 1 -- 172.21.15.78:0/3449346617 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8f8814f850 msgr2=0x7f8f880aacf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:02:52.651 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:52.644+0000 7f8f8fa09640 1 --2- 172.21.15.78:0/3449346617 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8f8814f850 0x7f8f880aacf0 secure :-1 s=READY pgs=1075 cs=0 l=1 rev1=1 crypto rx=0x7f8f840097c0 tx=0x7f8f8401c480 comp rx=0 tx=0).stop 2023-11-28T20:02:52.651 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:52.644+0000 7f8f8fa09640 1 -- 172.21.15.78:0/3449346617 shutdown_connections 2023-11-28T20:02:52.651 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:52.644+0000 7f8f8fa09640 1 --2- 172.21.15.78:0/3449346617 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8f8806d840 0x7f8f880c43e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:52.651 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:52.644+0000 7f8f8fa09640 1 --2- 172.21.15.78:0/3449346617 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8f8814f850 0x7f8f880aacf0 unknown :-1 s=CLOSED pgs=1075 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:52.651 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:52.644+0000 7f8f8fa09640 1 -- 172.21.15.78:0/3449346617 >> 172.21.15.78:0/3449346617 conn(0x7f8f880c59f0 msgr2=0x7f8f880c5e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:02:52.651 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:52.644+0000 7f8f8fa09640 1 -- 172.21.15.78:0/3449346617 shutdown_connections 2023-11-28T20:02:52.651 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:52.644+0000 7f8f8fa09640 1 -- 172.21.15.78:0/3449346617 wait complete. 2023-11-28T20:02:52.653 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:52.648+0000 7f8f8fa09640 1 Processor -- start 2023-11-28T20:02:52.653 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:52.648+0000 7f8f8fa09640 1 -- start start 2023-11-28T20:02:52.654 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:52.648+0000 7f8f8fa09640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8f8806d840 0x7f8f880aa390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:52.654 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:52.648+0000 7f8f8fa09640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8f8814f850 0x7f8f881564d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:52.654 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:52.648+0000 7f8f8fa09640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8f8814fc30 0x7f8f88144c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:52.654 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:52.648+0000 7f8f8fa09640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f88156000 con 0x7f8f8814f850 2023-11-28T20:02:52.654 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:52.648+0000 7f8f8fa09640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f8814a8a0 con 0x7f8f8806d840 2023-11-28T20:02:52.654 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:52.648+0000 7f8f8fa09640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8f880a9eb0 con 0x7f8f8814fc30 2023-11-28T20:02:52.654 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:52.648+0000 7f8f8cfa4640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8f8814f850 0x7f8f881564d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:02:52.654 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:52.648+0000 7f8f8cfa4640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8f8814f850 0x7f8f881564d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:50264/0 (socket says 172.21.15.78:50264) 2023-11-28T20:02:52.654 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:52.648+0000 7f8f8cfa4640 1 -- 172.21.15.78:0/1759859224 learned_addr learned my addr 172.21.15.78:0/1759859224 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T20:02:52.655 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:52.648+0000 7f8f8d7a5640 1 --2- 172.21.15.78:0/1759859224 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8f8806d840 0x7f8f880aa390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:02:52.655 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:52.648+0000 7f8f8dfa6640 1 --2- 172.21.15.78:0/1759859224 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8f8814fc30 0x7f8f88144c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:02:52.655 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:52.648+0000 7f8f8cfa4640 1 -- 172.21.15.78:0/1759859224 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8f8814fc30 msgr2=0x7f8f88144c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:02:52.655 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:52.648+0000 7f8f8cfa4640 1 --2- 172.21.15.78:0/1759859224 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8f8814fc30 0x7f8f88144c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:52.655 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:52.648+0000 7f8f8cfa4640 1 -- 172.21.15.78:0/1759859224 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8f8806d840 msgr2=0x7f8f880aa390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:02:52.655 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:52.648+0000 7f8f8cfa4640 1 --2- 172.21.15.78:0/1759859224 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8f8806d840 0x7f8f880aa390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:52.655 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:52.648+0000 7f8f8cfa4640 1 -- 172.21.15.78:0/1759859224 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f84009420 con 0x7f8f8814f850 2023-11-28T20:02:52.655 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:52.648+0000 7f8f8d7a5640 1 --2- 172.21.15.78:0/1759859224 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8f8806d840 0x7f8f880aa390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T20:02:52.656 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:52.648+0000 7f8f8cfa4640 1 --2- 172.21.15.78:0/1759859224 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8f8814f850 0x7f8f881564d0 secure :-1 s=READY pgs=1076 cs=0 l=1 rev1=1 crypto rx=0x7f8f78007fd0 tx=0x7f8f7800c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:02:52.656 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:52.648+0000 7f8f7dffb640 1 -- 172.21.15.78:0/1759859224 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f78005cf0 con 0x7f8f8814f850 2023-11-28T20:02:52.656 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:52.648+0000 7f8f7dffb640 1 -- 172.21.15.78:0/1759859224 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f78005e70 con 0x7f8f8814f850 2023-11-28T20:02:52.656 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:52.648+0000 7f8f8fa09640 1 -- 172.21.15.78:0/1759859224 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8f88145170 con 0x7f8f8814f850 2023-11-28T20:02:52.656 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:52.648+0000 7f8f7dffb640 1 -- 172.21.15.78:0/1759859224 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f780072f0 con 0x7f8f8814f850 2023-11-28T20:02:52.656 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:52.648+0000 7f8f8fa09640 1 -- 172.21.15.78:0/1759859224 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8f8814adf0 con 0x7f8f8814f850 2023-11-28T20:02:52.657 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:52.648+0000 7f8f8fa09640 1 -- 172.21.15.78:0/1759859224 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8f880aa0b0 con 0x7f8f8814f850 2023-11-28T20:02:52.657 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:52.652+0000 7f8f7dffb640 1 -- 172.21.15.78:0/1759859224 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f8f78007450 con 0x7f8f8814f850 2023-11-28T20:02:52.657 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:52.652+0000 7f8f7dffb640 1 --2- 172.21.15.78:0/1759859224 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f8f6c0664a0 0x7f8f6c068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:52.657 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:52.652+0000 7f8f7dffb640 1 -- 172.21.15.78:0/1759859224 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 7088+0+0 (secure 0 0 0) 0x7f8f78083a20 con 0x7f8f8814f850 2023-11-28T20:02:52.657 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:52.652+0000 7f8f8d7a5640 1 --2- 172.21.15.78:0/1759859224 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f8f6c0664a0 0x7f8f6c068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:02:52.657 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:52.652+0000 7f8f8d7a5640 1 --2- 172.21.15.78:0/1759859224 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f8f6c0664a0 0x7f8f6c068960 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f8f840ae000 tx=0x7f8f840a7000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:02:52.659 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:52.656+0000 7f8f7dffb640 1 -- 172.21.15.78:0/1759859224 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f8f880aa0b0 con 0x7f8f8814f850 2023-11-28T20:02:52.809 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:52.804+0000 7f8f8fa09640 1 -- 172.21.15.78:0/1759859224 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f8f880aa0b0 con 0x7f8f8814f850 2023-11-28T20:02:52.809 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:52.804+0000 7f8f7dffb640 1 -- 172.21.15.78:0/1759859224 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v87) v1 ==== 100+0+11 (secure 0 0 0) 0x7f8f880aa0b0 con 0x7f8f8814f850 2023-11-28T20:02:52.809 INFO:teuthology.orchestra.run.smithi078.stdout:pg_num: 64 2023-11-28T20:02:52.811 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:52.808+0000 7f8f8fa09640 1 -- 172.21.15.78:0/1759859224 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f8f6c0664a0 msgr2=0x7f8f6c068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:02:52.811 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:52.808+0000 7f8f8fa09640 1 --2- 172.21.15.78:0/1759859224 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f8f6c0664a0 0x7f8f6c068960 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f8f840ae000 tx=0x7f8f840a7000 comp rx=0 tx=0).stop 2023-11-28T20:02:52.812 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:52.808+0000 7f8f8fa09640 1 -- 172.21.15.78:0/1759859224 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8f8814f850 msgr2=0x7f8f881564d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:02:52.812 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:52.808+0000 7f8f8fa09640 1 --2- 172.21.15.78:0/1759859224 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8f8814f850 0x7f8f881564d0 secure :-1 s=READY pgs=1076 cs=0 l=1 rev1=1 crypto rx=0x7f8f78007fd0 tx=0x7f8f7800c8e0 comp rx=0 tx=0).stop 2023-11-28T20:02:52.812 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:52.808+0000 7f8f8fa09640 1 -- 172.21.15.78:0/1759859224 shutdown_connections 2023-11-28T20:02:52.812 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:52.808+0000 7f8f8fa09640 1 --2- 172.21.15.78:0/1759859224 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f8f6c0664a0 0x7f8f6c068960 unknown :-1 s=CLOSED pgs=510 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:52.812 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:52.808+0000 7f8f8fa09640 1 --2- 172.21.15.78:0/1759859224 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8f8814fc30 0x7f8f88144c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:52.812 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:52.808+0000 7f8f8fa09640 1 --2- 172.21.15.78:0/1759859224 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8f8814f850 0x7f8f881564d0 unknown :-1 s=CLOSED pgs=1076 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:52.812 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:52.808+0000 7f8f8fa09640 1 --2- 172.21.15.78:0/1759859224 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8f8806d840 0x7f8f880aa390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:52.812 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:52.808+0000 7f8f8fa09640 1 -- 172.21.15.78:0/1759859224 >> 172.21.15.78:0/1759859224 conn(0x7f8f880c59f0 msgr2=0x7f8f88150530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:02:52.812 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:52.808+0000 7f8f8fa09640 1 -- 172.21.15.78:0/1759859224 shutdown_connections 2023-11-28T20:02:52.812 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:52.808+0000 7f8f8fa09640 1 -- 172.21.15.78:0/1759859224 wait complete. 2023-11-28T20:02:52.830 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs2_metadata pg_num 2023-11-28T20:02:52.971 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:52.968+0000 7fa07dbe6640 1 Processor -- start 2023-11-28T20:02:52.971 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:52.968+0000 7fa07dbe6640 1 -- start start 2023-11-28T20:02:52.972 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:52.968+0000 7fa07dbe6640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fa0780c5300 0x7fa0780a9c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:52.972 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:52.968+0000 7fa07dbe6640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa0781548c0 0x7fa078154d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:52.972 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:52.968+0000 7fa07dbe6640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa0780a4e20 con 0x7fa07814b1e0 2023-11-28T20:02:52.972 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:52.968+0000 7fa07dbe6640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa0780a50e0 con 0x7fa0780c5300 2023-11-28T20:02:52.972 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:52.968+0000 7fa07dbe6640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa0780c0f00 con 0x7fa0781548c0 2023-11-28T20:02:52.972 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:52.968+0000 7fa0777fe640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7fa07814b1e0 0x7fa0780c1700 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:41860/0 (socket says 172.21.15.78:41860) 2023-11-28T20:02:52.973 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:52.968+0000 7fa0777fe640 1 -- 172.21.15.78:0/1258627754 learned_addr learned my addr 172.21.15.78:0/1258627754 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-11-28T20:02:52.973 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:52.968+0000 7fa076ffd640 1 --2- 172.21.15.78:0/1258627754 >> v2:172.21.15.78:3300/0 conn(0x7fa0780c5300 0x7fa0780a9c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:02:52.973 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:52.968+0000 7fa076ffd640 1 -- 172.21.15.78:0/1258627754 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa0781548c0 msgr2=0x7fa078154d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:02:52.973 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:52.968+0000 7fa077fff640 1 --2- 172.21.15.78:0/1258627754 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa0781548c0 0x7fa078154d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:02:52.973 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:52.968+0000 7fa076ffd640 1 --2- 172.21.15.78:0/1258627754 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa0781548c0 0x7fa078154d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:52.974 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:52.968+0000 7fa076ffd640 1 -- 172.21.15.78:0/1258627754 >> v1:172.21.15.78:6789/0 conn(0x7fa07814b1e0 legacy=0x7fa0780c1700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:02:52.974 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:52.968+0000 7fa076ffd640 1 -- 172.21.15.78:0/1258627754 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0780c11e0 con 0x7fa0780c5300 2023-11-28T20:02:52.974 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:52.968+0000 7fa077fff640 1 --2- 172.21.15.78:0/1258627754 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa0781548c0 0x7fa078154d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T20:02:52.977 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:52.972+0000 7fa076ffd640 1 --2- 172.21.15.78:0/1258627754 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa0780c5300 0x7fa0780a9c30 secure :-1 s=READY pgs=1078 cs=0 l=1 rev1=1 crypto rx=0x7fa06c0097c0 tx=0x7fa06c01c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3394461648ba7e36 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:02:52.977 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:52.972+0000 7fa0767fc640 1 -- 172.21.15.78:0/1258627754 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa06c0ad640 con 0x7fa0780c5300 2023-11-28T20:02:52.977 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:52.972+0000 7fa0767fc640 1 -- 172.21.15.78:0/1258627754 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa06c0ad7a0 con 0x7fa0780c5300 2023-11-28T20:02:52.977 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:52.972+0000 7fa0767fc640 1 -- 172.21.15.78:0/1258627754 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa06c0adb30 con 0x7fa0780c5300 2023-11-28T20:02:52.978 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:52.972+0000 7fa07dbe6640 1 -- 172.21.15.78:0/1258627754 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa0780c5300 msgr2=0x7fa0780a9c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:02:52.978 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:52.972+0000 7fa07dbe6640 1 --2- 172.21.15.78:0/1258627754 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa0780c5300 0x7fa0780a9c30 secure :-1 s=READY pgs=1078 cs=0 l=1 rev1=1 crypto rx=0x7fa06c0097c0 tx=0x7fa06c01c480 comp rx=0 tx=0).stop 2023-11-28T20:02:52.978 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:52.972+0000 7fa07dbe6640 1 -- 172.21.15.78:0/1258627754 shutdown_connections 2023-11-28T20:02:52.978 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:52.972+0000 7fa07dbe6640 1 --2- 172.21.15.78:0/1258627754 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa0781548c0 0x7fa078154d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:52.978 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:52.972+0000 7fa07dbe6640 1 --2- 172.21.15.78:0/1258627754 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa0780c5300 0x7fa0780a9c30 unknown :-1 s=CLOSED pgs=1078 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:52.978 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:52.972+0000 7fa07dbe6640 1 -- 172.21.15.78:0/1258627754 >> 172.21.15.78:0/1258627754 conn(0x7fa0780c59f0 msgr2=0x7fa0780c5e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:02:52.979 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:52.972+0000 7fa07dbe6640 1 -- 172.21.15.78:0/1258627754 shutdown_connections 2023-11-28T20:02:52.979 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:52.972+0000 7fa07dbe6640 1 -- 172.21.15.78:0/1258627754 wait complete. 2023-11-28T20:02:52.983 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:52.972+0000 7fa07dbe6640 1 Processor -- start 2023-11-28T20:02:52.983 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:52.972+0000 7fa07dbe6640 1 -- start start 2023-11-28T20:02:52.983 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:52.976+0000 7fa07dbe6640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa0780c5300 0x7fa07814fae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:52.983 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:52.976+0000 7fa07dbe6640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa07814b1e0 0x7fa078147ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:52.983 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:52.976+0000 7fa07dbe6640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa0781548c0 0x7fa0781ee2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:52.984 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:52.976+0000 7fa07dbe6640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa078150360 con 0x7fa0780c5300 2023-11-28T20:02:52.984 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:52.976+0000 7fa07dbe6640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa07806d8d0 con 0x7fa0781548c0 2023-11-28T20:02:52.984 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:52.976+0000 7fa07dbe6640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa07806d310 con 0x7fa07814b1e0 2023-11-28T20:02:52.984 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:52.976+0000 7fa0777fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa0780c5300 0x7fa07814fae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:02:52.984 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:52.976+0000 7fa0777fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa0780c5300 0x7fa07814fae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:50286/0 (socket says 172.21.15.78:50286) 2023-11-28T20:02:52.984 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:52.976+0000 7fa0777fe640 1 -- 172.21.15.78:0/2782159060 learned_addr learned my addr 172.21.15.78:0/2782159060 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T20:02:52.984 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:52.976+0000 7fa076ffd640 1 --2- 172.21.15.78:0/2782159060 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa07814b1e0 0x7fa078147ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:02:52.985 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:52.976+0000 7fa077fff640 1 --2- 172.21.15.78:0/2782159060 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa0781548c0 0x7fa0781ee2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:02:52.985 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:52.976+0000 7fa0777fe640 1 -- 172.21.15.78:0/2782159060 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa07814b1e0 msgr2=0x7fa078147ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:02:52.985 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:52.976+0000 7fa0777fe640 1 --2- 172.21.15.78:0/2782159060 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa07814b1e0 0x7fa078147ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:52.986 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:52.976+0000 7fa0777fe640 1 -- 172.21.15.78:0/2782159060 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa0781548c0 msgr2=0x7fa0781ee2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:02:52.986 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:52.976+0000 7fa0777fe640 1 --2- 172.21.15.78:0/2782159060 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa0781548c0 0x7fa0781ee2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:52.986 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:52.976+0000 7fa0777fe640 1 -- 172.21.15.78:0/2782159060 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa06c009420 con 0x7fa0780c5300 2023-11-28T20:02:52.986 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:52.976+0000 7fa077fff640 1 --2- 172.21.15.78:0/2782159060 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa0781548c0 0x7fa0781ee2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T20:02:52.986 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:52.976+0000 7fa0777fe640 1 --2- 172.21.15.78:0/2782159060 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa0780c5300 0x7fa07814fae0 secure :-1 s=READY pgs=1079 cs=0 l=1 rev1=1 crypto rx=0x7fa068005890 tx=0x7fa06800c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:02:52.986 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:52.976+0000 7fa05ffff640 1 -- 172.21.15.78:0/2782159060 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa068005cf0 con 0x7fa0780c5300 2023-11-28T20:02:52.987 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:52.976+0000 7fa05ffff640 1 -- 172.21.15.78:0/2782159060 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa068005e50 con 0x7fa0780c5300 2023-11-28T20:02:52.987 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:52.976+0000 7fa05ffff640 1 -- 172.21.15.78:0/2782159060 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0680072b0 con 0x7fa0780c5300 2023-11-28T20:02:52.987 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:52.976+0000 7fa07dbe6640 1 -- 172.21.15.78:0/2782159060 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa07806d5f0 con 0x7fa0780c5300 2023-11-28T20:02:52.987 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:52.976+0000 7fa07dbe6640 1 -- 172.21.15.78:0/2782159060 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa07814f5c0 con 0x7fa0780c5300 2023-11-28T20:02:52.987 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:52.976+0000 7fa07dbe6640 1 -- 172.21.15.78:0/2782159060 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa07814f140 con 0x7fa0780c5300 2023-11-28T20:02:52.987 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:52.980+0000 7fa05ffff640 1 -- 172.21.15.78:0/2782159060 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fa068007410 con 0x7fa0780c5300 2023-11-28T20:02:52.989 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:52.980+0000 7fa05ffff640 1 --2- 172.21.15.78:0/2782159060 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fa064066470 0x7fa064068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:52.989 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:52.980+0000 7fa05ffff640 1 -- 172.21.15.78:0/2782159060 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 7088+0+0 (secure 0 0 0) 0x7fa068083890 con 0x7fa0780c5300 2023-11-28T20:02:52.990 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:52.980+0000 7fa076ffd640 1 --2- 172.21.15.78:0/2782159060 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fa064066470 0x7fa064068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:02:52.990 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:52.980+0000 7fa076ffd640 1 --2- 172.21.15.78:0/2782159060 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fa064066470 0x7fa064068930 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7fa06c0af000 tx=0x7fa06c008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:02:52.990 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:52.984+0000 7fa05ffff640 1 -- 172.21.15.78:0/2782159060 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fa07814f140 con 0x7fa0780c5300 2023-11-28T20:02:53.137 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:53.132+0000 7fa07dbe6640 1 -- 172.21.15.78:0/2782159060 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs2_metadata", "var": "pg_num"} v 0) v1 -- 0x7fa07814f140 con 0x7fa0780c5300 2023-11-28T20:02:53.137 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:53.132+0000 7fa05ffff640 1 -- 172.21.15.78:0/2782159060 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs2_metadata", "var": "pg_num"}]=0 v87) v1 ==== 105+0+11 (secure 0 0 0) 0x7fa07814f140 con 0x7fa0780c5300 2023-11-28T20:02:53.137 INFO:teuthology.orchestra.run.smithi078.stdout:pg_num: 32 2023-11-28T20:02:53.139 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:53.136+0000 7fa07dbe6640 1 -- 172.21.15.78:0/2782159060 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fa064066470 msgr2=0x7fa064068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:02:53.140 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:53.136+0000 7fa07dbe6640 1 --2- 172.21.15.78:0/2782159060 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fa064066470 0x7fa064068930 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7fa06c0af000 tx=0x7fa06c008040 comp rx=0 tx=0).stop 2023-11-28T20:02:53.140 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:53.136+0000 7fa07dbe6640 1 -- 172.21.15.78:0/2782159060 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa0780c5300 msgr2=0x7fa07814fae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:02:53.140 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:53.136+0000 7fa07dbe6640 1 --2- 172.21.15.78:0/2782159060 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa0780c5300 0x7fa07814fae0 secure :-1 s=READY pgs=1079 cs=0 l=1 rev1=1 crypto rx=0x7fa068005890 tx=0x7fa06800c960 comp rx=0 tx=0).stop 2023-11-28T20:02:53.140 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:53.136+0000 7fa07dbe6640 1 -- 172.21.15.78:0/2782159060 shutdown_connections 2023-11-28T20:02:53.140 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:53.136+0000 7fa07dbe6640 1 --2- 172.21.15.78:0/2782159060 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fa064066470 0x7fa064068930 unknown :-1 s=CLOSED pgs=511 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:53.140 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:53.136+0000 7fa07dbe6640 1 --2- 172.21.15.78:0/2782159060 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa07814b1e0 0x7fa078147ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:53.140 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:53.136+0000 7fa07dbe6640 1 --2- 172.21.15.78:0/2782159060 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa0781548c0 0x7fa0781ee2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:53.140 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:53.136+0000 7fa07dbe6640 1 --2- 172.21.15.78:0/2782159060 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa0780c5300 0x7fa07814fae0 unknown :-1 s=CLOSED pgs=1079 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:53.141 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:53.136+0000 7fa07dbe6640 1 -- 172.21.15.78:0/2782159060 >> 172.21.15.78:0/2782159060 conn(0x7fa0780c59f0 msgr2=0x7fa0780aa400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:02:53.141 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:53.136+0000 7fa07dbe6640 1 -- 172.21.15.78:0/2782159060 shutdown_connections 2023-11-28T20:02:53.141 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:53.136+0000 7fa07dbe6640 1 -- 172.21.15.78:0/2782159060 wait complete. 2023-11-28T20:02:53.158 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs2_data pg_num 2023-11-28T20:02:53.301 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:53.296+0000 7f3e33c5a640 1 Processor -- start 2023-11-28T20:02:53.301 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:53.296+0000 7f3e33c5a640 1 -- start start 2023-11-28T20:02:53.302 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:53.296+0000 7f3e33c5a640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f3e2c14f850 0x7f3e2c0aacf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:53.302 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:53.296+0000 7f3e33c5a640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f3e2c06d840 0x7f3e2c0c43e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:53.302 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:53.296+0000 7f3e33c5a640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3e2c152910 con 0x7f3e2c14fc30 2023-11-28T20:02:53.302 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:53.296+0000 7f3e33c5a640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3e2c0c2240 con 0x7f3e2c14f850 2023-11-28T20:02:53.302 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:53.296+0000 7f3e33c5a640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3e2c152bf0 con 0x7f3e2c06d840 2023-11-28T20:02:53.303 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:53.296+0000 7f3e319f6640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f3e2c14f850 0x7f3e2c0aacf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:02:53.304 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:53.296+0000 7f3e311f5640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f3e2c14fc30 0x7f3e2c0c3cd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:41864/0 (socket says 172.21.15.78:41864) 2023-11-28T20:02:53.304 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:53.296+0000 7f3e311f5640 1 -- 172.21.15.78:0/723010455 learned_addr learned my addr 172.21.15.78:0/723010455 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-11-28T20:02:53.304 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:53.296+0000 7f3e321f7640 1 --2- 172.21.15.78:0/723010455 >> v2:172.21.15.179:3300/0 conn(0x7f3e2c06d840 0x7f3e2c0c43e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:02:53.304 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:53.300+0000 7f3e319f6640 1 -- 172.21.15.78:0/723010455 >> v2:172.21.15.179:3300/0 conn(0x7f3e2c06d840 msgr2=0x7f3e2c0c43e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:02:53.305 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:53.300+0000 7f3e319f6640 1 --2- 172.21.15.78:0/723010455 >> v2:172.21.15.179:3300/0 conn(0x7f3e2c06d840 0x7f3e2c0c43e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:53.305 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:53.300+0000 7f3e319f6640 1 -- 172.21.15.78:0/723010455 >> v1:172.21.15.78:6789/0 conn(0x7f3e2c14fc30 legacy=0x7f3e2c0c3cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:02:53.305 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:53.300+0000 7f3e309f4640 1 -- 172.21.15.78:0/723010455 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1356207916 0 0) 0x7f3e2c152910 con 0x7f3e2c14fc30 2023-11-28T20:02:53.305 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:53.300+0000 7f3e319f6640 1 -- 172.21.15.78:0/723010455 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e2c152ed0 con 0x7f3e2c14f850 2023-11-28T20:02:53.306 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:53.300+0000 7f3e321f7640 1 --2- 172.21.15.78:0/723010455 >> v2:172.21.15.179:3300/0 conn(0x7f3e2c06d840 0x7f3e2c0c43e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T20:02:53.307 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:53.300+0000 7f3e319f6640 1 --2- 172.21.15.78:0/723010455 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3e2c14f850 0x7f3e2c0aacf0 secure :-1 s=READY pgs=1081 cs=0 l=1 rev1=1 crypto rx=0x7f3e2c0c2440 tx=0x7f3e2801c460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9f01889b3f5b7e18 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:02:53.307 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:53.300+0000 7f3e309f4640 1 -- 172.21.15.78:0/723010455 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e280ab680 con 0x7f3e2c14f850 2023-11-28T20:02:53.307 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:53.300+0000 7f3e309f4640 1 -- 172.21.15.78:0/723010455 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e280ab7e0 con 0x7f3e2c14f850 2023-11-28T20:02:53.307 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:53.300+0000 7f3e309f4640 1 -- 172.21.15.78:0/723010455 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e280abb70 con 0x7f3e2c14f850 2023-11-28T20:02:53.307 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:53.300+0000 7f3e33c5a640 1 -- 172.21.15.78:0/723010455 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3e2c14f850 msgr2=0x7f3e2c0aacf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:02:53.308 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:53.300+0000 7f3e33c5a640 1 --2- 172.21.15.78:0/723010455 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3e2c14f850 0x7f3e2c0aacf0 secure :-1 s=READY pgs=1081 cs=0 l=1 rev1=1 crypto rx=0x7f3e2c0c2440 tx=0x7f3e2801c460 comp rx=0 tx=0).stop 2023-11-28T20:02:53.308 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:53.304+0000 7f3e33c5a640 1 -- 172.21.15.78:0/723010455 shutdown_connections 2023-11-28T20:02:53.308 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:53.304+0000 7f3e33c5a640 1 --2- 172.21.15.78:0/723010455 >> v2:172.21.15.179:3300/0 conn(0x7f3e2c06d840 0x7f3e2c0c43e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:53.308 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:53.304+0000 7f3e33c5a640 1 --2- 172.21.15.78:0/723010455 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3e2c14f850 0x7f3e2c0aacf0 unknown :-1 s=CLOSED pgs=1081 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:53.308 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:53.304+0000 7f3e33c5a640 1 -- 172.21.15.78:0/723010455 >> 172.21.15.78:0/723010455 conn(0x7f3e2c0c59f0 msgr2=0x7f3e2c0c5e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:02:53.309 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:53.304+0000 7f3e33c5a640 1 -- 172.21.15.78:0/723010455 shutdown_connections 2023-11-28T20:02:53.309 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:53.304+0000 7f3e33c5a640 1 -- 172.21.15.78:0/723010455 wait complete. 2023-11-28T20:02:53.311 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:53.304+0000 7f3e33c5a640 1 Processor -- start 2023-11-28T20:02:53.311 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:53.304+0000 7f3e33c5a640 1 -- start start 2023-11-28T20:02:53.311 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:53.304+0000 7f3e33c5a640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3e2c06d840 0x7f3e2c0a8ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:53.311 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:53.304+0000 7f3e33c5a640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3e2c14f850 0x7f3e2c1478d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:53.311 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:53.304+0000 7f3e33c5a640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3e2c14fc30 0x7f3e2c147e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:53.312 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:53.304+0000 7f3e33c5a640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e2c0a9d80 con 0x7f3e2c06d840 2023-11-28T20:02:53.312 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:53.304+0000 7f3e33c5a640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e2c0c0f30 con 0x7f3e2c14f850 2023-11-28T20:02:53.312 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:53.304+0000 7f3e33c5a640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3e2c0a6f90 con 0x7f3e2c14fc30 2023-11-28T20:02:53.312 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:53.304+0000 7f3e319f6640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3e2c06d840 0x7f3e2c0a8ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:02:53.312 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:53.304+0000 7f3e319f6640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3e2c06d840 0x7f3e2c0a8ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:50310/0 (socket says 172.21.15.78:50310) 2023-11-28T20:02:53.312 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:53.304+0000 7f3e319f6640 1 -- 172.21.15.78:0/1050106694 learned_addr learned my addr 172.21.15.78:0/1050106694 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T20:02:53.313 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:53.304+0000 7f3e319f6640 1 -- 172.21.15.78:0/1050106694 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3e2c14fc30 msgr2=0x7f3e2c147e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:02:53.313 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:53.304+0000 7f3e319f6640 1 --2- 172.21.15.78:0/1050106694 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3e2c14fc30 0x7f3e2c147e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:53.313 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:53.304+0000 7f3e319f6640 1 -- 172.21.15.78:0/1050106694 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3e2c14f850 msgr2=0x7f3e2c1478d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:02:53.313 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:53.304+0000 7f3e319f6640 1 --2- 172.21.15.78:0/1050106694 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3e2c14f850 0x7f3e2c1478d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:53.313 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:53.304+0000 7f3e319f6640 1 -- 172.21.15.78:0/1050106694 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e28009420 con 0x7f3e2c06d840 2023-11-28T20:02:53.313 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:53.304+0000 7f3e319f6640 1 --2- 172.21.15.78:0/1050106694 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3e2c06d840 0x7f3e2c0a8ae0 secure :-1 s=READY pgs=1082 cs=0 l=1 rev1=1 crypto rx=0x7f3e280ad040 tx=0x7f3e2801aca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:02:53.313 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:53.304+0000 7f3e227fc640 1 -- 172.21.15.78:0/1050106694 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e280b5810 con 0x7f3e2c06d840 2023-11-28T20:02:53.313 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:53.308+0000 7f3e227fc640 1 -- 172.21.15.78:0/1050106694 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e280b5990 con 0x7f3e2c06d840 2023-11-28T20:02:53.314 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:53.308+0000 7f3e33c5a640 1 -- 172.21.15.78:0/1050106694 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3e2c0a7270 con 0x7f3e2c06d840 2023-11-28T20:02:53.314 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:53.308+0000 7f3e227fc640 1 -- 172.21.15.78:0/1050106694 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e280b5d40 con 0x7f3e2c06d840 2023-11-28T20:02:53.314 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:53.308+0000 7f3e33c5a640 1 -- 172.21.15.78:0/1050106694 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3e2c0a6ca0 con 0x7f3e2c06d840 2023-11-28T20:02:53.315 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:53.308+0000 7f3e33c5a640 1 -- 172.21.15.78:0/1050106694 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3e2c067630 con 0x7f3e2c06d840 2023-11-28T20:02:53.315 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:53.308+0000 7f3e227fc640 1 -- 172.21.15.78:0/1050106694 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f3e280c83f0 con 0x7f3e2c06d840 2023-11-28T20:02:53.315 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:53.308+0000 7f3e227fc640 1 --2- 172.21.15.78:0/1050106694 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f3e10066470 0x7f3e10068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:53.316 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:53.308+0000 7f3e227fc640 1 -- 172.21.15.78:0/1050106694 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 7088+0+0 (secure 0 0 0) 0x7f3e2811f430 con 0x7f3e2c06d840 2023-11-28T20:02:53.316 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:53.308+0000 7f3e311f5640 1 --2- 172.21.15.78:0/1050106694 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f3e10066470 0x7f3e10068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:02:53.316 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:53.308+0000 7f3e311f5640 1 --2- 172.21.15.78:0/1050106694 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f3e10066470 0x7f3e10068930 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f3e2c0c45b0 tx=0x7f3e1c007970 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:02:53.317 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:53.312+0000 7f3e227fc640 1 -- 172.21.15.78:0/1050106694 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f3e280ec410 con 0x7f3e2c06d840 2023-11-28T20:02:53.468 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:53.464+0000 7f3e33c5a640 1 -- 172.21.15.78:0/1050106694 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs2_data", "var": "pg_num"} v 0) v1 -- 0x7f3e2c0aaba0 con 0x7f3e2c06d840 2023-11-28T20:02:53.469 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:53.464+0000 7f3e227fc640 1 -- 172.21.15.78:0/1050106694 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs2_data", "var": "pg_num"}]=0 v87) v1 ==== 101+0+11 (secure 0 0 0) 0x7f3e280efa30 con 0x7f3e2c06d840 2023-11-28T20:02:53.469 INFO:teuthology.orchestra.run.smithi078.stdout:pg_num: 64 2023-11-28T20:02:53.471 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:53.464+0000 7f3e33c5a640 1 -- 172.21.15.78:0/1050106694 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f3e10066470 msgr2=0x7f3e10068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:02:53.472 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:53.464+0000 7f3e33c5a640 1 --2- 172.21.15.78:0/1050106694 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f3e10066470 0x7f3e10068930 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f3e2c0c45b0 tx=0x7f3e1c007970 comp rx=0 tx=0).stop 2023-11-28T20:02:53.472 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:53.464+0000 7f3e33c5a640 1 -- 172.21.15.78:0/1050106694 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3e2c06d840 msgr2=0x7f3e2c0a8ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:02:53.472 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:53.464+0000 7f3e33c5a640 1 --2- 172.21.15.78:0/1050106694 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3e2c06d840 0x7f3e2c0a8ae0 secure :-1 s=READY pgs=1082 cs=0 l=1 rev1=1 crypto rx=0x7f3e280ad040 tx=0x7f3e2801aca0 comp rx=0 tx=0).stop 2023-11-28T20:02:53.472 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:53.464+0000 7f3e33c5a640 1 -- 172.21.15.78:0/1050106694 shutdown_connections 2023-11-28T20:02:53.472 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:53.464+0000 7f3e33c5a640 1 --2- 172.21.15.78:0/1050106694 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f3e10066470 0x7f3e10068930 unknown :-1 s=CLOSED pgs=512 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:53.473 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:53.464+0000 7f3e33c5a640 1 --2- 172.21.15.78:0/1050106694 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3e2c14fc30 0x7f3e2c147e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:53.473 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:53.464+0000 7f3e33c5a640 1 --2- 172.21.15.78:0/1050106694 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3e2c14f850 0x7f3e2c1478d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:53.473 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:53.464+0000 7f3e33c5a640 1 --2- 172.21.15.78:0/1050106694 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3e2c06d840 0x7f3e2c0a8ae0 unknown :-1 s=CLOSED pgs=1082 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:53.473 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:53.464+0000 7f3e33c5a640 1 -- 172.21.15.78:0/1050106694 >> 172.21.15.78:0/1050106694 conn(0x7f3e2c0c59f0 msgr2=0x7f3e2c0c3cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:02:53.474 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:53.468+0000 7f3e33c5a640 1 -- 172.21.15.78:0/1050106694 shutdown_connections 2023-11-28T20:02:53.474 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:53.468+0000 7f3e33c5a640 1 -- 172.21.15.78:0/1050106694 wait complete. 2023-11-28T20:02:53.490 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-28T20:02:53.627 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:53.620+0000 7fa046a9f640 1 Processor -- start 2023-11-28T20:02:53.627 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:53.624+0000 7fa046a9f640 1 -- start start 2023-11-28T20:02:53.629 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:53.624+0000 7fa046a9f640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fa040151b40 0x7fa0400c7fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:53.629 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:53.624+0000 7fa046a9f640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa0400c9f80 0x7fa0400ca3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:53.629 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:53.624+0000 7fa046a9f640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa0401584b0 con 0x7fa040157910 2023-11-28T20:02:53.629 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:53.624+0000 7fa046a9f640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa040154320 con 0x7fa040151b40 2023-11-28T20:02:53.629 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:53.624+0000 7fa046a9f640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa0401552f0 con 0x7fa0400c9f80 2023-11-28T20:02:53.630 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:53.624+0000 7fa045a9d640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fa040151b40 0x7fa0400c7fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:02:53.630 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:53.624+0000 7fa045a9d640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fa040151b40 0x7fa0400c7fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:50322/0 (socket says 172.21.15.78:50322) 2023-11-28T20:02:53.630 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:53.624+0000 7fa045a9d640 1 -- 172.21.15.78:0/569440083 learned_addr learned my addr 172.21.15.78:0/569440083 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T20:02:53.630 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:53.624+0000 7fa04529c640 1 --2- 172.21.15.78:0/569440083 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa0400c9f80 0x7fa0400ca3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:02:53.630 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:53.624+0000 7fa045a9d640 1 -- 172.21.15.78:0/569440083 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa0400c9f80 msgr2=0x7fa0400ca3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:02:53.631 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:53.624+0000 7fa045a9d640 1 --2- 172.21.15.78:0/569440083 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa0400c9f80 0x7fa0400ca3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:53.631 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:53.624+0000 7fa045a9d640 1 -- 172.21.15.78:0/569440083 >> v1:172.21.15.179:6789/0 conn(0x7fa040157910 legacy=0x7fa040157da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:02:53.631 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:53.624+0000 7fa045a9d640 1 -- 172.21.15.78:0/569440083 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa040154530 con 0x7fa040151b40 2023-11-28T20:02:53.631 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:53.628+0000 7fa045a9d640 1 --2- 172.21.15.78:0/569440083 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa040151b40 0x7fa0400c7fd0 secure :-1 s=READY pgs=1083 cs=0 l=1 rev1=1 crypto rx=0x7fa03c009870 tx=0x7fa03c01c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fbfd8295911e55fa server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:02:53.632 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:53.628+0000 7fa044a9b640 1 -- 172.21.15.78:0/569440083 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa03c0ab600 con 0x7fa040151b40 2023-11-28T20:02:53.632 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:53.628+0000 7fa044a9b640 1 -- 172.21.15.78:0/569440083 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa03c0a7050 con 0x7fa040151b40 2023-11-28T20:02:53.632 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:53.628+0000 7fa044a9b640 1 -- 172.21.15.78:0/569440083 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa03c0ab980 con 0x7fa040151b40 2023-11-28T20:02:53.633 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:53.628+0000 7fa046a9f640 1 -- 172.21.15.78:0/569440083 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa040151b40 msgr2=0x7fa0400c7fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:02:53.633 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:53.628+0000 7fa046a9f640 1 --2- 172.21.15.78:0/569440083 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa040151b40 0x7fa0400c7fd0 secure :-1 s=READY pgs=1083 cs=0 l=1 rev1=1 crypto rx=0x7fa03c009870 tx=0x7fa03c01c470 comp rx=0 tx=0).stop 2023-11-28T20:02:53.633 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:53.628+0000 7fa046a9f640 1 -- 172.21.15.78:0/569440083 shutdown_connections 2023-11-28T20:02:53.633 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:53.628+0000 7fa046a9f640 1 --2- 172.21.15.78:0/569440083 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa0400c9f80 0x7fa0400ca3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:53.633 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:53.628+0000 7fa046a9f640 1 --2- 172.21.15.78:0/569440083 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa040151b40 0x7fa0400c7fd0 unknown :-1 s=CLOSED pgs=1083 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:53.633 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:53.628+0000 7fa046a9f640 1 -- 172.21.15.78:0/569440083 >> 172.21.15.78:0/569440083 conn(0x7fa040066470 msgr2=0x7fa040066880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:02:53.633 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:53.628+0000 7fa046a9f640 1 -- 172.21.15.78:0/569440083 shutdown_connections 2023-11-28T20:02:53.634 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:53.628+0000 7fa046a9f640 1 -- 172.21.15.78:0/569440083 wait complete. 2023-11-28T20:02:53.634 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:53.628+0000 7fa046a9f640 1 Processor -- start 2023-11-28T20:02:53.634 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:53.628+0000 7fa046a9f640 1 -- start start 2023-11-28T20:02:53.636 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:53.632+0000 7fa046a9f640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa0400c9f80 0x7fa04014d320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:53.636 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:53.632+0000 7fa046a9f640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa040151b40 0x7fa0401ed300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:53.637 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:53.632+0000 7fa046a9f640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa040157910 0x7fa0401503a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:53.637 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:53.632+0000 7fa046a9f640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0401ed840 con 0x7fa040157910 2023-11-28T20:02:53.637 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:53.632+0000 7fa046a9f640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa04014d970 con 0x7fa040151b40 2023-11-28T20:02:53.637 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:53.632+0000 7fa046a9f640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa04014bc60 con 0x7fa0400c9f80 2023-11-28T20:02:53.637 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:53.632+0000 7fa04629e640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa040157910 0x7fa0401503a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:02:53.637 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:53.632+0000 7fa04529c640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa040151b40 0x7fa0401ed300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:02:53.637 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:53.632+0000 7fa045a9d640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa0400c9f80 0x7fa04014d320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:02:53.637 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:53.632+0000 7fa04529c640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa040151b40 0x7fa0401ed300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.78:43824/0 (socket says 172.21.15.78:43824) 2023-11-28T20:02:53.637 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:53.632+0000 7fa045a9d640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa0400c9f80 0x7fa04014d320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3301/0 says I am v2:172.21.15.78:55726/0 (socket says 172.21.15.78:55726) 2023-11-28T20:02:53.637 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:53.632+0000 7fa04529c640 1 -- 172.21.15.78:0/1305573105 learned_addr learned my addr 172.21.15.78:0/1305573105 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T20:02:53.637 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:53.632+0000 7fa04629e640 1 -- 172.21.15.78:0/1305573105 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa0400c9f80 msgr2=0x7fa04014d320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:02:53.638 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:53.632+0000 7fa04629e640 1 --2- 172.21.15.78:0/1305573105 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa0400c9f80 0x7fa04014d320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:53.638 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:53.632+0000 7fa04629e640 1 -- 172.21.15.78:0/1305573105 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa040151b40 msgr2=0x7fa0401ed300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:02:53.638 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:53.632+0000 7fa04629e640 1 --2- 172.21.15.78:0/1305573105 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa040151b40 0x7fa0401ed300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:53.638 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:53.632+0000 7fa04629e640 1 -- 172.21.15.78:0/1305573105 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa03c0094d0 con 0x7fa040157910 2023-11-28T20:02:53.638 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:53.632+0000 7fa04629e640 1 --2- 172.21.15.78:0/1305573105 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa040157910 0x7fa0401503a0 secure :-1 s=READY pgs=1084 cs=0 l=1 rev1=1 crypto rx=0x7fa03800be00 tx=0x7fa03800bef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:02:53.638 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:53.632+0000 7fa0367fc640 1 -- 172.21.15.78:0/1305573105 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa03800ce70 con 0x7fa040157910 2023-11-28T20:02:53.638 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:53.632+0000 7fa0367fc640 1 -- 172.21.15.78:0/1305573105 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa038003980 con 0x7fa040157910 2023-11-28T20:02:53.638 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:53.632+0000 7fa046a9f640 1 -- 172.21.15.78:0/1305573105 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa04014bf40 con 0x7fa040157910 2023-11-28T20:02:53.638 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:53.632+0000 7fa0367fc640 1 -- 172.21.15.78:0/1305573105 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa038003d70 con 0x7fa040157910 2023-11-28T20:02:53.638 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:53.632+0000 7fa046a9f640 1 -- 172.21.15.78:0/1305573105 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa0401508e0 con 0x7fa040157910 2023-11-28T20:02:53.639 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:53.632+0000 7fa046a9f640 1 -- 172.21.15.78:0/1305573105 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa04014c460 con 0x7fa040157910 2023-11-28T20:02:53.639 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:53.636+0000 7fa0367fc640 1 -- 172.21.15.78:0/1305573105 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fa038003ed0 con 0x7fa040157910 2023-11-28T20:02:53.640 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:53.636+0000 7fa0367fc640 1 --2- 172.21.15.78:0/1305573105 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fa024066470 0x7fa024068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:53.640 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:53.636+0000 7fa0367fc640 1 -- 172.21.15.78:0/1305573105 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 7088+0+0 (secure 0 0 0) 0x7fa0380842b0 con 0x7fa040157910 2023-11-28T20:02:53.640 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:53.636+0000 7fa045a9d640 1 --2- 172.21.15.78:0/1305573105 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fa024066470 0x7fa024068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:02:53.640 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:53.636+0000 7fa045a9d640 1 --2- 172.21.15.78:0/1305573105 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fa024066470 0x7fa024068930 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7fa0400c0c20 tx=0x7fa03c0a6000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:02:53.644 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:53.640+0000 7fa0367fc640 1 -- 172.21.15.78:0/1305573105 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fa04014c460 con 0x7fa040157910 2023-11-28T20:02:53.822 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:53.816+0000 7fa046a9f640 1 -- 172.21.15.78:0/1305573105 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa04014c460 con 0x7fa040157910 2023-11-28T20:02:53.823 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:53.820+0000 7fa0367fc640 1 -- 172.21.15.78:0/1305573105 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 51 v51) v1 ==== 94+0+6134 (secure 0 0 0) 0x7fa04014c460 con 0x7fa040157910 2023-11-28T20:02:53.823 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-11-28T20:02:53.823 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":51,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5834,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6834/3259525552","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6832","nonce":3259525552},{"type":"v1","addr":"172.21.15.179:6834","nonce":3259525552}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":41},{"gid":6466,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6836/3096284673","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6834","nonce":3096284673},{"type":"v1","addr":"172.21.15.78:6836","nonce":3096284673}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":41}],"filesystems":[{"mdsmap":{"epoch":46,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-28T20:02:07.651677+0000","modified":"2023-11-28T20:02:10.666537+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":6633},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6633":{"gid":6633,"name":"a","rank":0,"incarnation":42,"state":"up:active","state_seq":3,"addr":"172.21.15.78:6837/20108235","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6835","nonce":20108235},{"type":"v1","addr":"172.21.15.78:6837","nonce":20108235}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6},{"mdsmap":{"epoch":51,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-28T20:02:25.231135+0000","modified":"2023-11-28T20:02:28.250515+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":6478},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6478":{"gid":6478,"name":"b","rank":0,"incarnation":47,"state":"up:active","state_seq":7,"addr":"172.21.15.179:6835/2749579094","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6833","nonce":2749579094},{"type":"v1","addr":"172.21.15.179:6835","nonce":2749579094}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs2","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":7}]} 2023-11-28T20:02:53.824 INFO:teuthology.orchestra.run.smithi078.stderr:dumped fsmap epoch 51 2023-11-28T20:02:53.825 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:53.820+0000 7fa046a9f640 1 -- 172.21.15.78:0/1305573105 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fa024066470 msgr2=0x7fa024068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:02:53.825 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:53.820+0000 7fa046a9f640 1 --2- 172.21.15.78:0/1305573105 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fa024066470 0x7fa024068930 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7fa0400c0c20 tx=0x7fa03c0a6000 comp rx=0 tx=0).stop 2023-11-28T20:02:53.825 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:53.820+0000 7fa046a9f640 1 -- 172.21.15.78:0/1305573105 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa040157910 msgr2=0x7fa0401503a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:02:53.826 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:53.820+0000 7fa046a9f640 1 --2- 172.21.15.78:0/1305573105 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa040157910 0x7fa0401503a0 secure :-1 s=READY pgs=1084 cs=0 l=1 rev1=1 crypto rx=0x7fa03800be00 tx=0x7fa03800bef0 comp rx=0 tx=0).stop 2023-11-28T20:02:53.826 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:53.820+0000 7fa046a9f640 1 -- 172.21.15.78:0/1305573105 shutdown_connections 2023-11-28T20:02:53.826 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:53.820+0000 7fa046a9f640 1 --2- 172.21.15.78:0/1305573105 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fa024066470 0x7fa024068930 unknown :-1 s=CLOSED pgs=513 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:53.826 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:53.820+0000 7fa046a9f640 1 --2- 172.21.15.78:0/1305573105 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa040157910 0x7fa0401503a0 unknown :-1 s=CLOSED pgs=1084 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:53.826 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:53.820+0000 7fa046a9f640 1 --2- 172.21.15.78:0/1305573105 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa040151b40 0x7fa0401ed300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:53.826 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:53.820+0000 7fa046a9f640 1 --2- 172.21.15.78:0/1305573105 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa0400c9f80 0x7fa04014d320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:53.826 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:53.820+0000 7fa046a9f640 1 -- 172.21.15.78:0/1305573105 >> 172.21.15.78:0/1305573105 conn(0x7fa040066470 msgr2=0x7fa040153c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:02:53.826 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:53.820+0000 7fa046a9f640 1 -- 172.21.15.78:0/1305573105 shutdown_connections 2023-11-28T20:02:53.827 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:53.820+0000 7fa046a9f640 1 -- 172.21.15.78:0/1305573105 wait complete. 2023-11-28T20:02:53.844 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-28T20:02:53.995 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:53.992+0000 7fdb56009640 1 Processor -- start 2023-11-28T20:02:53.996 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:53.992+0000 7fdb56009640 1 -- start start 2023-11-28T20:02:53.998 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:53.992+0000 7fdb56009640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fdb500c65f0 0x7fdb500c69d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:53.998 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:53.992+0000 7fdb56009640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdb500c8200 0x7fdb500c8b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:53.998 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:53.992+0000 7fdb56009640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdb50151f20 con 0x7fdb500c9040 2023-11-28T20:02:53.999 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:53.992+0000 7fdb56009640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdb50154450 con 0x7fdb500c65f0 2023-11-28T20:02:53.999 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:53.992+0000 7fdb56009640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdb50154710 con 0x7fdb500c8200 2023-11-28T20:02:53.999 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:53.992+0000 7fdb54806640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdb500c8200 0x7fdb500c8b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:02:53.999 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:53.992+0000 7fdb55007640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fdb500c65f0 0x7fdb500c69d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:02:54.000 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:53.992+0000 7fdb54806640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdb500c8200 0x7fdb500c8b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3301/0 says I am v2:172.21.15.78:55738/0 (socket says 172.21.15.78:55738) 2023-11-28T20:02:54.000 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:53.992+0000 7fdb54806640 1 -- 172.21.15.78:0/2037409364 learned_addr learned my addr 172.21.15.78:0/2037409364 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T20:02:54.000 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:53.992+0000 7fdb54806640 1 -- 172.21.15.78:0/2037409364 >> v2:172.21.15.179:3300/0 conn(0x7fdb500c65f0 msgr2=0x7fdb500c69d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:02:54.001 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:53.992+0000 7fdb54806640 1 --2- 172.21.15.78:0/2037409364 >> v2:172.21.15.179:3300/0 conn(0x7fdb500c65f0 0x7fdb500c69d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:54.001 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:53.992+0000 7fdb54806640 1 -- 172.21.15.78:0/2037409364 >> v1:172.21.15.179:6789/0 conn(0x7fdb500c9040 legacy=0x7fdb501579c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:02:54.001 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:53.992+0000 7fdb54806640 1 -- 172.21.15.78:0/2037409364 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb501549f0 con 0x7fdb500c8200 2023-11-28T20:02:54.001 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:53.992+0000 7fdb55007640 1 --2- 172.21.15.78:0/2037409364 >> v2:172.21.15.179:3300/0 conn(0x7fdb500c65f0 0x7fdb500c69d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T20:02:54.008 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:53.996+0000 7fdb54806640 1 --2- 172.21.15.78:0/2037409364 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdb500c8200 0x7fdb500c8b00 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fdb40009870 tx=0x7fdb4001c480 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fa9a6a0df4eba53d server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:02:54.008 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:53.996+0000 7fdb47fff640 1 -- 172.21.15.78:0/2037409364 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb400ad640 con 0x7fdb500c8200 2023-11-28T20:02:54.008 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:53.996+0000 7fdb47fff640 1 -- 172.21.15.78:0/2037409364 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb400ad7a0 con 0x7fdb500c8200 2023-11-28T20:02:54.008 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:53.996+0000 7fdb47fff640 1 -- 172.21.15.78:0/2037409364 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb400adb30 con 0x7fdb500c8200 2023-11-28T20:02:54.008 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:53.996+0000 7fdb56009640 1 -- 172.21.15.78:0/2037409364 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdb500c8200 msgr2=0x7fdb500c8b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:02:54.008 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:53.996+0000 7fdb56009640 1 --2- 172.21.15.78:0/2037409364 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdb500c8200 0x7fdb500c8b00 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fdb40009870 tx=0x7fdb4001c480 comp rx=0 tx=0).stop 2023-11-28T20:02:54.008 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:53.996+0000 7fdb56009640 1 -- 172.21.15.78:0/2037409364 shutdown_connections 2023-11-28T20:02:54.008 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:53.996+0000 7fdb56009640 1 --2- 172.21.15.78:0/2037409364 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdb500c8200 0x7fdb500c8b00 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:54.008 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:53.996+0000 7fdb56009640 1 --2- 172.21.15.78:0/2037409364 >> v2:172.21.15.179:3300/0 conn(0x7fdb500c65f0 0x7fdb500c69d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:54.008 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:53.996+0000 7fdb56009640 1 -- 172.21.15.78:0/2037409364 >> 172.21.15.78:0/2037409364 conn(0x7fdb500ab730 msgr2=0x7fdb500abb40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:02:54.009 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:53.996+0000 7fdb56009640 1 -- 172.21.15.78:0/2037409364 shutdown_connections 2023-11-28T20:02:54.009 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:53.996+0000 7fdb56009640 1 -- 172.21.15.78:0/2037409364 wait complete. 2023-11-28T20:02:54.009 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:54.000+0000 7fdb56009640 1 Processor -- start 2023-11-28T20:02:54.009 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:54.000+0000 7fdb56009640 1 -- start start 2023-11-28T20:02:54.009 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:54.000+0000 7fdb56009640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdb500c65f0 0x7fdb500c23c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:54.009 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:54.000+0000 7fdb56009640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdb500c8200 0x7fdb501568f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:54.009 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:54.000+0000 7fdb56009640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdb500c9040 0x7fdb50148a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:54.009 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:54.000+0000 7fdb56009640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb50157540 con 0x7fdb500c9040 2023-11-28T20:02:54.009 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:54.000+0000 7fdb56009640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb5014b180 con 0x7fdb500c8200 2023-11-28T20:02:54.010 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:54.000+0000 7fdb56009640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdb500c2900 con 0x7fdb500c65f0 2023-11-28T20:02:54.010 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:54.000+0000 7fdb55007640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdb500c65f0 0x7fdb500c23c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:02:54.010 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:54.000+0000 7fdb55808640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdb500c9040 0x7fdb50148a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:02:54.010 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:54.000+0000 7fdb55007640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdb500c65f0 0x7fdb500c23c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3301/0 says I am v2:172.21.15.78:55754/0 (socket says 172.21.15.78:55754) 2023-11-28T20:02:54.010 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:54.000+0000 7fdb55007640 1 -- 172.21.15.78:0/1923095286 learned_addr learned my addr 172.21.15.78:0/1923095286 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T20:02:54.010 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:54.000+0000 7fdb54806640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdb500c8200 0x7fdb501568f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:02:54.010 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:54.000+0000 7fdb55808640 1 -- 172.21.15.78:0/1923095286 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdb500c65f0 msgr2=0x7fdb500c23c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:02:54.010 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:54.000+0000 7fdb55808640 1 --2- 172.21.15.78:0/1923095286 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdb500c65f0 0x7fdb500c23c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:54.010 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:54.000+0000 7fdb55808640 1 -- 172.21.15.78:0/1923095286 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdb500c8200 msgr2=0x7fdb501568f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:02:54.011 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:54.000+0000 7fdb55808640 1 --2- 172.21.15.78:0/1923095286 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdb500c8200 0x7fdb501568f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:54.011 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:54.000+0000 7fdb55808640 1 -- 172.21.15.78:0/1923095286 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb4c009420 con 0x7fdb500c9040 2023-11-28T20:02:54.011 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:54.000+0000 7fdb55808640 1 --2- 172.21.15.78:0/1923095286 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdb500c9040 0x7fdb50148a20 secure :-1 s=READY pgs=1085 cs=0 l=1 rev1=1 crypto rx=0x7fdb4800c700 tx=0x7fdb4800cbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:02:54.011 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:54.000+0000 7fdb45ffb640 1 -- 172.21.15.78:0/1923095286 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb48003b80 con 0x7fdb500c9040 2023-11-28T20:02:54.012 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:54.000+0000 7fdb45ffb640 1 -- 172.21.15.78:0/1923095286 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb48003ce0 con 0x7fdb500c9040 2023-11-28T20:02:54.012 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:54.000+0000 7fdb56009640 1 -- 172.21.15.78:0/1923095286 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdb400094d0 con 0x7fdb500c9040 2023-11-28T20:02:54.012 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:54.000+0000 7fdb45ffb640 1 -- 172.21.15.78:0/1923095286 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb48005310 con 0x7fdb500c9040 2023-11-28T20:02:54.012 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:54.000+0000 7fdb56009640 1 -- 172.21.15.78:0/1923095286 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdb5014ab30 con 0x7fdb500c9040 2023-11-28T20:02:54.012 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:54.000+0000 7fdb56009640 1 -- 172.21.15.78:0/1923095286 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdb5014b2f0 con 0x7fdb500c9040 2023-11-28T20:02:54.012 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:54.004+0000 7fdb45ffb640 1 -- 172.21.15.78:0/1923095286 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fdb48005470 con 0x7fdb500c9040 2023-11-28T20:02:54.013 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:54.004+0000 7fdb45ffb640 1 --2- 172.21.15.78:0/1923095286 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fdb340664a0 0x7fdb34068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:54.013 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:54.004+0000 7fdb45ffb640 1 -- 172.21.15.78:0/1923095286 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 7088+0+0 (secure 0 0 0) 0x7fdb48083fc0 con 0x7fdb500c9040 2023-11-28T20:02:54.014 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:54.004+0000 7fdb55007640 1 --2- 172.21.15.78:0/1923095286 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fdb340664a0 0x7fdb34068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:02:54.014 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:54.004+0000 7fdb55007640 1 --2- 172.21.15.78:0/1923095286 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fdb340664a0 0x7fdb34068960 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7fdb5015f270 tx=0x7fdb4c009190 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:02:54.014 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:54.008+0000 7fdb45ffb640 1 -- 172.21.15.78:0/1923095286 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fdb48050fa0 con 0x7fdb500c9040 2023-11-28T20:02:54.170 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:54.164+0000 7fdb56009640 1 -- 172.21.15.78:0/1923095286 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fdb500674b0 con 0x7fdb500c9040 2023-11-28T20:02:54.172 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:54.168+0000 7fdb45ffb640 1 -- 172.21.15.78:0/1923095286 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v87) v1 ==== 74+0+20676 (secure 0 0 0) 0x7fdb480545c0 con 0x7fdb500c9040 2023-11-28T20:02:54.172 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-11-28T20:02:54.172 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":87,"fsid":"dd9780e8-3bda-44fa-a9f0-fa07d19d901d","created":"2023-11-28T19:58:40.969556+0000","modified":"2023-11-28T20:02:49.136462+0000","last_up_change":"2023-11-28T19:58:52.596716+0000","last_in_change":"2023-11-28T19:58:43.609275+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":16,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-28T19:58:54.011229+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_metadata","create_time":"2023-11-28T20:02:05.787820+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs_data","create_time":"2023-11-28T20:02:06.652305+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs2_metadata","create_time":"2023-11-28T20:02:23.066724+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":16,"pool_name":"cephfs2_data","create_time":"2023-11-28T20:02:24.230614+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs2"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e84245ac-b5da-429e-af18-39acaa2b33e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6800","nonce":3358701235},{"type":"v1","addr":"172.21.15.78:6801","nonce":3358701235}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6802","nonce":3358701235},{"type":"v1","addr":"172.21.15.78:6803","nonce":3358701235}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6806","nonce":3358701235},{"type":"v1","addr":"172.21.15.78:6807","nonce":3358701235}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6804","nonce":3358701235},{"type":"v1","addr":"172.21.15.78:6805","nonce":3358701235}]},"public_addr":"172.21.15.78:6801/3358701235","cluster_addr":"172.21.15.78:6803/3358701235","heartbeat_back_addr":"172.21.15.78:6807/3358701235","heartbeat_front_addr":"172.21.15.78:6805/3358701235","state":["exists","up"]},{"osd":1,"uuid":"e634831d-c4e2-48d9-870c-9556ae162981","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6808","nonce":3211476654},{"type":"v1","addr":"172.21.15.78:6809","nonce":3211476654}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6810","nonce":3211476654},{"type":"v1","addr":"172.21.15.78:6811","nonce":3211476654}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6814","nonce":3211476654},{"type":"v1","addr":"172.21.15.78:6815","nonce":3211476654}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6812","nonce":3211476654},{"type":"v1","addr":"172.21.15.78:6813","nonce":3211476654}]},"public_addr":"172.21.15.78:6809/3211476654","cluster_addr":"172.21.15.78:6811/3211476654","heartbeat_back_addr":"172.21.15.78:6815/3211476654","heartbeat_front_addr":"172.21.15.78:6813/3211476654","state":["exists","up"]},{"osd":2,"uuid":"274c8395-6534-41f0-b8fb-a00af8985aa8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6816","nonce":2532904479},{"type":"v1","addr":"172.21.15.78:6817","nonce":2532904479}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6818","nonce":2532904479},{"type":"v1","addr":"172.21.15.78:6819","nonce":2532904479}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6822","nonce":2532904479},{"type":"v1","addr":"172.21.15.78:6823","nonce":2532904479}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6820","nonce":2532904479},{"type":"v1","addr":"172.21.15.78:6821","nonce":2532904479}]},"public_addr":"172.21.15.78:6817/2532904479","cluster_addr":"172.21.15.78:6819/2532904479","heartbeat_back_addr":"172.21.15.78:6823/2532904479","heartbeat_front_addr":"172.21.15.78:6821/2532904479","state":["exists","up"]},{"osd":3,"uuid":"77acc9af-7d4d-4b18-8cf5-d62f5971b7c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6824","nonce":3442991267},{"type":"v1","addr":"172.21.15.78:6825","nonce":3442991267}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6826","nonce":3442991267},{"type":"v1","addr":"172.21.15.78:6827","nonce":3442991267}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6830","nonce":3442991267},{"type":"v1","addr":"172.21.15.78:6831","nonce":3442991267}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6828","nonce":3442991267},{"type":"v1","addr":"172.21.15.78:6829","nonce":3442991267}]},"public_addr":"172.21.15.78:6825/3442991267","cluster_addr":"172.21.15.78:6827/3442991267","heartbeat_back_addr":"172.21.15.78:6831/3442991267","heartbeat_front_addr":"172.21.15.78:6829/3442991267","state":["exists","up"]},{"osd":4,"uuid":"5c62bc66-6b34-4b7f-a66b-9a743969138c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":802983577},{"type":"v1","addr":"172.21.15.179:6809","nonce":802983577}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":802983577},{"type":"v1","addr":"172.21.15.179:6811","nonce":802983577}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":802983577},{"type":"v1","addr":"172.21.15.179:6815","nonce":802983577}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":802983577},{"type":"v1","addr":"172.21.15.179:6813","nonce":802983577}]},"public_addr":"172.21.15.179:6809/802983577","cluster_addr":"172.21.15.179:6811/802983577","heartbeat_back_addr":"172.21.15.179:6815/802983577","heartbeat_front_addr":"172.21.15.179:6813/802983577","state":["exists","up"]},{"osd":5,"uuid":"67db6d36-f684-4079-b0cd-82b4dd61461f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":518192887},{"type":"v1","addr":"172.21.15.179:6818","nonce":518192887}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":518192887},{"type":"v1","addr":"172.21.15.179:6822","nonce":518192887}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":518192887},{"type":"v1","addr":"172.21.15.179:6829","nonce":518192887}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6824","nonce":518192887},{"type":"v1","addr":"172.21.15.179:6826","nonce":518192887}]},"public_addr":"172.21.15.179:6818/518192887","cluster_addr":"172.21.15.179:6822/518192887","heartbeat_back_addr":"172.21.15.179:6829/518192887","heartbeat_front_addr":"172.21.15.179:6826/518192887","state":["exists","up"]},{"osd":6,"uuid":"12e670af-5a16-4c81-9f97-defa66cab967","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":815435378},{"type":"v1","addr":"172.21.15.179:6801","nonce":815435378}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":815435378},{"type":"v1","addr":"172.21.15.179:6803","nonce":815435378}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":815435378},{"type":"v1","addr":"172.21.15.179:6807","nonce":815435378}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":815435378},{"type":"v1","addr":"172.21.15.179:6805","nonce":815435378}]},"public_addr":"172.21.15.179:6801/815435378","cluster_addr":"172.21.15.179:6803/815435378","heartbeat_back_addr":"172.21.15.179:6807/815435378","heartbeat_front_addr":"172.21.15.179:6805/815435378","state":["exists","up"]},{"osd":7,"uuid":"fe630650-2eb3-49ad-8676-c341e6332eb1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6817","nonce":2848432339},{"type":"v1","addr":"172.21.15.179:6819","nonce":2848432339}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6821","nonce":2848432339},{"type":"v1","addr":"172.21.15.179:6823","nonce":2848432339}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":2848432339},{"type":"v1","addr":"172.21.15.179:6831","nonce":2848432339}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6825","nonce":2848432339},{"type":"v1","addr":"172.21.15.179:6827","nonce":2848432339}]},"public_addr":"172.21.15.179:6819/2848432339","cluster_addr":"172.21.15.179:6823/2848432339","heartbeat_back_addr":"172.21.15.179:6831/2848432339","heartbeat_front_addr":"172.21.15.179:6827/2848432339","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:58:49.255433+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:58:49.412880+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:58:49.559295+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:58:49.245237+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:58:49.184557+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:58:49.329851+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:58:49.366012+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:58:49.349604+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"14.8","mappings":[{"from":1,"to":5}]},{"pgid":"14.2c","mappings":[{"from":1,"to":7}]},{"pgid":"14.33","mappings":[{"from":1,"to":2}]},{"pgid":"14.3c","mappings":[{"from":1,"to":7}]},{"pgid":"16.1f","mappings":[{"from":5,"to":4}]},{"pgid":"16.26","mappings":[{"from":6,"to":7}]},{"pgid":"16.3a","mappings":[{"from":1,"to":4}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-28T20:02:54.174 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:54.168+0000 7fdb56009640 1 -- 172.21.15.78:0/1923095286 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fdb340664a0 msgr2=0x7fdb34068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:02:54.174 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:54.168+0000 7fdb56009640 1 --2- 172.21.15.78:0/1923095286 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fdb340664a0 0x7fdb34068960 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7fdb5015f270 tx=0x7fdb4c009190 comp rx=0 tx=0).stop 2023-11-28T20:02:54.174 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:54.168+0000 7fdb56009640 1 -- 172.21.15.78:0/1923095286 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdb500c9040 msgr2=0x7fdb50148a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:02:54.174 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:54.168+0000 7fdb56009640 1 --2- 172.21.15.78:0/1923095286 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdb500c9040 0x7fdb50148a20 secure :-1 s=READY pgs=1085 cs=0 l=1 rev1=1 crypto rx=0x7fdb4800c700 tx=0x7fdb4800cbc0 comp rx=0 tx=0).stop 2023-11-28T20:02:54.175 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:54.168+0000 7fdb56009640 1 -- 172.21.15.78:0/1923095286 shutdown_connections 2023-11-28T20:02:54.175 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:54.168+0000 7fdb56009640 1 --2- 172.21.15.78:0/1923095286 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fdb340664a0 0x7fdb34068960 unknown :-1 s=CLOSED pgs=514 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:54.175 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:54.168+0000 7fdb56009640 1 --2- 172.21.15.78:0/1923095286 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdb500c9040 0x7fdb50148a20 unknown :-1 s=CLOSED pgs=1085 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:54.175 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:54.168+0000 7fdb56009640 1 --2- 172.21.15.78:0/1923095286 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdb500c8200 0x7fdb501568f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:54.175 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:54.168+0000 7fdb56009640 1 --2- 172.21.15.78:0/1923095286 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdb500c65f0 0x7fdb500c23c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:54.175 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:54.168+0000 7fdb56009640 1 -- 172.21.15.78:0/1923095286 >> 172.21.15.78:0/1923095286 conn(0x7fdb500ab730 msgr2=0x7fdb500abb10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:02:54.176 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:54.168+0000 7fdb56009640 1 -- 172.21.15.78:0/1923095286 shutdown_connections 2023-11-28T20:02:54.176 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:54.168+0000 7fdb56009640 1 -- 172.21.15.78:0/1923095286 wait complete. 2023-11-28T20:02:54.193 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-11-28T20:02:54.193 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-28T20:02:54.331 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:54.328+0000 7fcaea3f8640 1 Processor -- start 2023-11-28T20:02:54.331 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:54.328+0000 7fcaea3f8640 1 -- start start 2023-11-28T20:02:54.333 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:54.328+0000 7fcaea3f8640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fcae40bf690 0x7fcae40c4da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:54.333 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:54.328+0000 7fcaea3f8640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fcae40c59a0 0x7fcae40c8990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:54.333 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:54.328+0000 7fcaea3f8640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcae40c62b0 con 0x7fcae40c49c0 2023-11-28T20:02:54.333 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:54.328+0000 7fcaea3f8640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcae40c6590 con 0x7fcae40bf690 2023-11-28T20:02:54.333 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:54.328+0000 7fcaea3f8640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcae41588d0 con 0x7fcae40c59a0 2023-11-28T20:02:54.333 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:54.328+0000 7fcae37fe640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fcae40bf690 0x7fcae40c4da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:02:54.333 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:54.328+0000 7fcae3fff640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7fcae40c49c0 0x7fcae40c8280 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:41878/0 (socket says 172.21.15.78:41878) 2023-11-28T20:02:54.333 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:54.328+0000 7fcae3fff640 1 -- 172.21.15.78:0/2257465859 learned_addr learned my addr 172.21.15.78:0/2257465859 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-11-28T20:02:54.334 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:54.328+0000 7fcae8995640 1 --2- 172.21.15.78:0/2257465859 >> v2:172.21.15.179:3300/0 conn(0x7fcae40c59a0 0x7fcae40c8990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:02:54.334 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:54.328+0000 7fcae37fe640 1 -- 172.21.15.78:0/2257465859 >> v2:172.21.15.179:3300/0 conn(0x7fcae40c59a0 msgr2=0x7fcae40c8990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:02:54.334 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:54.328+0000 7fcae37fe640 1 --2- 172.21.15.78:0/2257465859 >> v2:172.21.15.179:3300/0 conn(0x7fcae40c59a0 0x7fcae40c8990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:54.334 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:54.328+0000 7fcae37fe640 1 -- 172.21.15.78:0/2257465859 >> v1:172.21.15.78:6789/0 conn(0x7fcae40c49c0 legacy=0x7fcae40c8280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:02:54.334 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:54.328+0000 7fcae37fe640 1 -- 172.21.15.78:0/2257465859 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcae40c7d60 con 0x7fcae40bf690 2023-11-28T20:02:54.336 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:54.332+0000 7fcae37fe640 1 --2- 172.21.15.78:0/2257465859 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcae40bf690 0x7fcae40c4da0 secure :-1 s=READY pgs=1087 cs=0 l=1 rev1=1 crypto rx=0x7fcae40c7880 tx=0x7fcad801c460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c8fcf20008f752a7 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:02:54.336 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:54.332+0000 7fcae2ffd640 1 -- 172.21.15.78:0/2257465859 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcad80ab5f0 con 0x7fcae40bf690 2023-11-28T20:02:54.336 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:54.332+0000 7fcae2ffd640 1 -- 172.21.15.78:0/2257465859 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcad80ab750 con 0x7fcae40bf690 2023-11-28T20:02:54.336 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:54.332+0000 7fcae2ffd640 1 -- 172.21.15.78:0/2257465859 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcad80abae0 con 0x7fcae40bf690 2023-11-28T20:02:54.337 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:54.332+0000 7fcaea3f8640 1 -- 172.21.15.78:0/2257465859 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcae40bf690 msgr2=0x7fcae40c4da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:02:54.337 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:54.332+0000 7fcaea3f8640 1 --2- 172.21.15.78:0/2257465859 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcae40bf690 0x7fcae40c4da0 secure :-1 s=READY pgs=1087 cs=0 l=1 rev1=1 crypto rx=0x7fcae40c7880 tx=0x7fcad801c460 comp rx=0 tx=0).stop 2023-11-28T20:02:54.337 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:54.332+0000 7fcaea3f8640 1 -- 172.21.15.78:0/2257465859 shutdown_connections 2023-11-28T20:02:54.337 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:54.332+0000 7fcaea3f8640 1 --2- 172.21.15.78:0/2257465859 >> v2:172.21.15.179:3300/0 conn(0x7fcae40c59a0 0x7fcae40c8990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:54.338 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:54.332+0000 7fcaea3f8640 1 --2- 172.21.15.78:0/2257465859 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcae40bf690 0x7fcae40c4da0 unknown :-1 s=CLOSED pgs=1087 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:54.338 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:54.332+0000 7fcaea3f8640 1 -- 172.21.15.78:0/2257465859 >> 172.21.15.78:0/2257465859 conn(0x7fcae40c6840 msgr2=0x7fcae40c6c50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:02:54.338 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:54.332+0000 7fcaea3f8640 1 -- 172.21.15.78:0/2257465859 shutdown_connections 2023-11-28T20:02:54.338 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:54.332+0000 7fcaea3f8640 1 -- 172.21.15.78:0/2257465859 wait complete. 2023-11-28T20:02:54.338 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:54.332+0000 7fcaea3f8640 1 Processor -- start 2023-11-28T20:02:54.339 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:54.336+0000 7fcaea3f8640 1 -- start start 2023-11-28T20:02:54.340 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:54.336+0000 7fcaea3f8640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcae40bf690 0x7fcae414a030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:54.340 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:54.336+0000 7fcaea3f8640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcae40c49c0 0x7fcae4156ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:54.340 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:54.336+0000 7fcaea3f8640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcae40c59a0 0x7fcae4157220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:54.340 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:54.336+0000 7fcaea3f8640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcae41eddb0 con 0x7fcae40c59a0 2023-11-28T20:02:54.340 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:54.336+0000 7fcaea3f8640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcae4157760 con 0x7fcae40c49c0 2023-11-28T20:02:54.340 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:54.336+0000 7fcaea3f8640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcae414b900 con 0x7fcae40bf690 2023-11-28T20:02:54.340 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:54.336+0000 7fcae8995640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcae40c59a0 0x7fcae4157220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:02:54.340 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:54.336+0000 7fcae8995640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcae40c59a0 0x7fcae4157220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:50368/0 (socket says 172.21.15.78:50368) 2023-11-28T20:02:54.340 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:54.336+0000 7fcae8995640 1 -- 172.21.15.78:0/430249460 learned_addr learned my addr 172.21.15.78:0/430249460 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T20:02:54.342 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:54.336+0000 7fcae37fe640 1 --2- 172.21.15.78:0/430249460 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcae40c49c0 0x7fcae4156ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:02:54.342 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:54.336+0000 7fcae8995640 1 -- 172.21.15.78:0/430249460 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcae40bf690 msgr2=0x7fcae414a030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:02:54.342 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:54.336+0000 7fcae8995640 1 --2- 172.21.15.78:0/430249460 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcae40bf690 0x7fcae414a030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:54.342 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:54.336+0000 7fcae8995640 1 -- 172.21.15.78:0/430249460 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcae40c49c0 msgr2=0x7fcae4156ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:02:54.342 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:54.336+0000 7fcae8995640 1 --2- 172.21.15.78:0/430249460 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcae40c49c0 0x7fcae4156ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:54.342 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:54.336+0000 7fcae8995640 1 -- 172.21.15.78:0/430249460 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcad8009420 con 0x7fcae40c59a0 2023-11-28T20:02:54.342 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:54.336+0000 7fcae8995640 1 --2- 172.21.15.78:0/430249460 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcae40c59a0 0x7fcae4157220 secure :-1 s=READY pgs=1088 cs=0 l=1 rev1=1 crypto rx=0x7fcadc007e40 tx=0x7fcadc00e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:02:54.342 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:54.336+0000 7fcae0ff9640 1 -- 172.21.15.78:0/430249460 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcadc014620 con 0x7fcae40c59a0 2023-11-28T20:02:54.343 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:54.336+0000 7fcae0ff9640 1 -- 172.21.15.78:0/430249460 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcadc00ee90 con 0x7fcae40c59a0 2023-11-28T20:02:54.343 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:54.336+0000 7fcaea3f8640 1 -- 172.21.15.78:0/430249460 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcae4157af0 con 0x7fcae40c59a0 2023-11-28T20:02:54.343 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:54.336+0000 7fcae0ff9640 1 -- 172.21.15.78:0/430249460 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcadc0149e0 con 0x7fcae40c59a0 2023-11-28T20:02:54.343 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:54.336+0000 7fcaea3f8640 1 -- 172.21.15.78:0/430249460 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcae40afc60 con 0x7fcae40c59a0 2023-11-28T20:02:54.343 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:54.336+0000 7fcaea3f8640 1 -- 172.21.15.78:0/430249460 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcae41578c0 con 0x7fcae40c59a0 2023-11-28T20:02:54.344 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:54.340+0000 7fcae0ff9640 1 -- 172.21.15.78:0/430249460 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fcadc014b40 con 0x7fcae40c59a0 2023-11-28T20:02:54.344 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:54.340+0000 7fcae0ff9640 1 --2- 172.21.15.78:0/430249460 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fcad0066470 0x7fcad0068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:54.344 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:54.340+0000 7fcae0ff9640 1 -- 172.21.15.78:0/430249460 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 7088+0+0 (secure 0 0 0) 0x7fcadc084cf0 con 0x7fcae40c59a0 2023-11-28T20:02:54.344 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:54.340+0000 7fcae3fff640 1 --2- 172.21.15.78:0/430249460 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fcad0066470 0x7fcad0068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:02:54.345 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:54.340+0000 7fcae3fff640 1 --2- 172.21.15.78:0/430249460 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fcad0066470 0x7fcad0068930 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7fcad4001600 tx=0x7fcad4007a50 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:02:54.347 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:54.344+0000 7fcae0ff9640 1 -- 172.21.15.78:0/430249460 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fcae41578c0 con 0x7fcae40c59a0 2023-11-28T20:02:54.526 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:54.520+0000 7fcaea3f8640 1 -- 172.21.15.78:0/430249460 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fcae4157c80 con 0x7fcae40c59a0 2023-11-28T20:02:54.527 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:54.524+0000 7fcae0ff9640 1 -- 172.21.15.78:0/430249460 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 51 v51) v1 ==== 94+0+6134 (secure 0 0 0) 0x7fcadc089070 con 0x7fcae40c59a0 2023-11-28T20:02:54.527 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-11-28T20:02:54.527 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":51,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5834,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6834/3259525552","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6832","nonce":3259525552},{"type":"v1","addr":"172.21.15.179:6834","nonce":3259525552}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":41},{"gid":6466,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6836/3096284673","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6834","nonce":3096284673},{"type":"v1","addr":"172.21.15.78:6836","nonce":3096284673}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":41}],"filesystems":[{"mdsmap":{"epoch":46,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-28T20:02:07.651677+0000","modified":"2023-11-28T20:02:10.666537+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":6633},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6633":{"gid":6633,"name":"a","rank":0,"incarnation":42,"state":"up:active","state_seq":3,"addr":"172.21.15.78:6837/20108235","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6835","nonce":20108235},{"type":"v1","addr":"172.21.15.78:6837","nonce":20108235}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6},{"mdsmap":{"epoch":51,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-28T20:02:25.231135+0000","modified":"2023-11-28T20:02:28.250515+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":6478},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6478":{"gid":6478,"name":"b","rank":0,"incarnation":47,"state":"up:active","state_seq":7,"addr":"172.21.15.179:6835/2749579094","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6833","nonce":2749579094},{"type":"v1","addr":"172.21.15.179:6835","nonce":2749579094}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs2","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":7}]} 2023-11-28T20:02:54.528 INFO:teuthology.orchestra.run.smithi078.stderr:dumped fsmap epoch 51 2023-11-28T20:02:54.529 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:54.524+0000 7fcaea3f8640 1 -- 172.21.15.78:0/430249460 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fcad0066470 msgr2=0x7fcad0068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:02:54.529 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:54.524+0000 7fcaea3f8640 1 --2- 172.21.15.78:0/430249460 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fcad0066470 0x7fcad0068930 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7fcad4001600 tx=0x7fcad4007a50 comp rx=0 tx=0).stop 2023-11-28T20:02:54.529 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:54.524+0000 7fcaea3f8640 1 -- 172.21.15.78:0/430249460 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcae40c59a0 msgr2=0x7fcae4157220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:02:54.530 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:54.524+0000 7fcaea3f8640 1 --2- 172.21.15.78:0/430249460 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcae40c59a0 0x7fcae4157220 secure :-1 s=READY pgs=1088 cs=0 l=1 rev1=1 crypto rx=0x7fcadc007e40 tx=0x7fcadc00e4b0 comp rx=0 tx=0).stop 2023-11-28T20:02:54.530 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:54.524+0000 7fcaea3f8640 1 -- 172.21.15.78:0/430249460 shutdown_connections 2023-11-28T20:02:54.530 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:54.524+0000 7fcaea3f8640 1 --2- 172.21.15.78:0/430249460 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fcad0066470 0x7fcad0068930 unknown :-1 s=CLOSED pgs=515 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:54.530 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:54.524+0000 7fcaea3f8640 1 --2- 172.21.15.78:0/430249460 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcae40c59a0 0x7fcae4157220 unknown :-1 s=CLOSED pgs=1088 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:54.530 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:54.524+0000 7fcaea3f8640 1 --2- 172.21.15.78:0/430249460 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcae40c49c0 0x7fcae4156ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:54.530 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:54.524+0000 7fcaea3f8640 1 --2- 172.21.15.78:0/430249460 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcae40bf690 0x7fcae414a030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:54.530 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:54.524+0000 7fcaea3f8640 1 -- 172.21.15.78:0/430249460 >> 172.21.15.78:0/430249460 conn(0x7fcae40c6840 msgr2=0x7fcae40c80d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:02:54.530 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:54.524+0000 7fcaea3f8640 1 -- 172.21.15.78:0/430249460 shutdown_connections 2023-11-28T20:02:54.530 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:54.524+0000 7fcaea3f8640 1 -- 172.21.15.78:0/430249460 wait complete. 2023-11-28T20:02:54.548 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-28T20:02:54.685 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:54.680+0000 7f1319417640 1 Processor -- start 2023-11-28T20:02:54.685 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:54.680+0000 7f1319417640 1 -- start start 2023-11-28T20:02:54.686 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:54.680+0000 7f1319417640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f131406bef0 0x7f13140bfce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:54.686 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:54.680+0000 7f1319417640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1314151690 con 0x7f131414e3f0 2023-11-28T20:02:54.687 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:54.680+0000 7f1319417640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1314151bc0 con 0x7f131406c5b0 2023-11-28T20:02:54.687 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:54.680+0000 7f1319417640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f13141518e0 con 0x7f131406bef0 2023-11-28T20:02:54.687 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:54.684+0000 7f1312ffd640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f131414e3f0 0x7f13140c41f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:41890/0 (socket says 172.21.15.78:41890) 2023-11-28T20:02:54.687 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:54.684+0000 7f1312ffd640 1 -- 172.21.15.78:0/1212188446 learned_addr learned my addr 172.21.15.78:0/1212188446 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-11-28T20:02:54.689 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:54.684+0000 7f130a7fc640 1 --2- 172.21.15.78:0/1212188446 >> v2:172.21.15.179:3300/0 conn(0x7f131406bef0 0x7f13140bfce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:02:54.689 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:54.684+0000 7f13127fc640 1 -- 172.21.15.78:0/1212188446 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2976934115 0 0) 0x7f1314151690 con 0x7f131414e3f0 2023-11-28T20:02:54.689 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:54.684+0000 7f13127fc640 1 -- 172.21.15.78:0/1212188446 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f12f4003450 con 0x7f131414e3f0 2023-11-28T20:02:54.689 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:54.684+0000 7f13127fc640 1 -- 172.21.15.78:0/1212188446 <== mon.0 v1:172.21.15.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 887331180 0 0) 0x7f12f4003450 con 0x7f131414e3f0 2023-11-28T20:02:54.689 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:54.684+0000 7f13127fc640 1 -- 172.21.15.78:0/1212188446 >> v2:172.21.15.179:3300/0 conn(0x7f131406bef0 msgr2=0x7f13140bfce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:02:54.689 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:54.684+0000 7f13127fc640 1 --2- 172.21.15.78:0/1212188446 >> v2:172.21.15.179:3300/0 conn(0x7f131406bef0 0x7f13140bfce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:54.690 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:54.684+0000 7f13127fc640 1 -- 172.21.15.78:0/1212188446 >> v1:172.21.15.179:6789/0 conn(0x7f131406c5b0 legacy=0x7f131406ca20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:02:54.690 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:54.684+0000 7f13127fc640 1 -- 172.21.15.78:0/1212188446 --> v1:172.21.15.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13140c1de0 con 0x7f131414e3f0 2023-11-28T20:02:54.690 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:54.684+0000 7f13127fc640 1 -- 172.21.15.78:0/1212188446 <== mon.0 v1:172.21.15.78:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3326804700 0 0) 0x7f12fc001680 con 0x7f131414e3f0 2023-11-28T20:02:54.690 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:54.684+0000 7f13127fc640 1 -- 172.21.15.78:0/1212188446 >> v1:172.21.15.78:6789/0 conn(0x7f131414e3f0 legacy=0x7f13140c41f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:02:54.690 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:54.684+0000 7f13127fc640 1 --2- 172.21.15.78:0/1212188446 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f12f4003ac0 0x7f12f4003ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:54.690 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:54.684+0000 7f13127fc640 1 --2- 172.21.15.78:0/1212188446 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f12f4008860 0x7f12f400acf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:54.690 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:54.684+0000 7f13127fc640 1 --2- 172.21.15.78:0/1212188446 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f12f400b5e0 0x7f12f400daa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:54.690 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:54.684+0000 7f13127fc640 1 -- 172.21.15.78:0/1212188446 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13141518e0 con 0x7f12f400b5e0 2023-11-28T20:02:54.690 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:54.684+0000 7f13127fc640 1 -- 172.21.15.78:0/1212188446 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12f400e380 con 0x7f12f4003ac0 2023-11-28T20:02:54.691 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:54.684+0000 7f13127fc640 1 -- 172.21.15.78:0/1212188446 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f12f400e540 con 0x7f12f4008860 2023-11-28T20:02:54.691 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:54.684+0000 7f13137fe640 1 --2- 172.21.15.78:0/1212188446 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f12f400b5e0 0x7f12f400daa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:02:54.691 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:54.684+0000 7f1312ffd640 1 --2- 172.21.15.78:0/1212188446 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f12f4003ac0 0x7f12f4003ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:02:54.691 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:54.684+0000 7f130a7fc640 1 --2- 172.21.15.78:0/1212188446 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f12f4008860 0x7f12f400acf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:02:54.691 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:54.684+0000 7f13137fe640 1 -- 172.21.15.78:0/1212188446 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f12f4008860 msgr2=0x7f12f400acf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:02:54.692 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:54.684+0000 7f13137fe640 1 --2- 172.21.15.78:0/1212188446 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f12f4008860 0x7f12f400acf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:54.692 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:54.684+0000 7f13137fe640 1 -- 172.21.15.78:0/1212188446 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f12f4003ac0 msgr2=0x7f12f4003ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:02:54.692 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:54.684+0000 7f13137fe640 1 --2- 172.21.15.78:0/1212188446 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f12f4003ac0 0x7f12f4003ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:54.692 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:54.684+0000 7f13137fe640 1 -- 172.21.15.78:0/1212188446 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12f4003450 con 0x7f12f400b5e0 2023-11-28T20:02:54.693 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:54.688+0000 7f13137fe640 1 -- 172.21.15.78:0/1212188446 reap_dead start 2023-11-28T20:02:54.693 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:54.688+0000 7f13137fe640 1 --2- 172.21.15.78:0/1212188446 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f12f400b5e0 0x7f12f400daa0 secure :-1 s=READY pgs=1090 cs=0 l=1 rev1=1 crypto rx=0x7f130c001e70 tx=0x7f130c01c760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=740c6eb96842ad67 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:02:54.693 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:54.688+0000 7f13127fc640 1 -- 172.21.15.78:0/1212188446 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f130c003b80 con 0x7f12f400b5e0 2023-11-28T20:02:54.693 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:54.688+0000 7f13127fc640 1 -- 172.21.15.78:0/1212188446 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f130c003d20 con 0x7f12f400b5e0 2023-11-28T20:02:54.694 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:54.688+0000 7f13127fc640 1 -- 172.21.15.78:0/1212188446 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f130c005260 con 0x7f12f400b5e0 2023-11-28T20:02:54.694 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:54.688+0000 7f1319417640 1 -- 172.21.15.78:0/1212188446 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f12f400b5e0 msgr2=0x7f12f400daa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:02:54.694 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:54.688+0000 7f1319417640 1 --2- 172.21.15.78:0/1212188446 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f12f400b5e0 0x7f12f400daa0 secure :-1 s=READY pgs=1090 cs=0 l=1 rev1=1 crypto rx=0x7f130c001e70 tx=0x7f130c01c760 comp rx=0 tx=0).stop 2023-11-28T20:02:54.694 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:54.688+0000 7f1319417640 1 -- 172.21.15.78:0/1212188446 shutdown_connections 2023-11-28T20:02:54.694 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:54.688+0000 7f1319417640 1 --2- 172.21.15.78:0/1212188446 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f12f400b5e0 0x7f12f400daa0 unknown :-1 s=CLOSED pgs=1090 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:54.694 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:54.688+0000 7f1319417640 1 -- 172.21.15.78:0/1212188446 >> 172.21.15.78:0/1212188446 conn(0x7f13140a7810 msgr2=0x7f13140a7c20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:02:54.694 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:54.688+0000 7f1319417640 1 -- 172.21.15.78:0/1212188446 shutdown_connections 2023-11-28T20:02:54.694 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:54.688+0000 7f1319417640 1 -- 172.21.15.78:0/1212188446 wait complete. 2023-11-28T20:02:54.695 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:54.688+0000 7f1319417640 1 Processor -- start 2023-11-28T20:02:54.697 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:54.688+0000 7f1319417640 1 -- start start 2023-11-28T20:02:54.697 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:54.688+0000 7f1319417640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f12f400b5e0 0x7f13141ed9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:54.698 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:54.688+0000 7f1319417640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f13141edee0 0x7f13141541b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:54.698 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:54.692+0000 7f1319417640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f13141546f0 0x7f13141da330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:54.698 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:54.692+0000 7f1319417640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13141df1c0 con 0x7f13141546f0 2023-11-28T20:02:54.698 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:54.692+0000 7f1319417640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13141de9b0 con 0x7f12f400b5e0 2023-11-28T20:02:54.698 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:54.692+0000 7f1319417640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f13141dff40 con 0x7f13141edee0 2023-11-28T20:02:54.699 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:54.692+0000 7f13137fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f13141546f0 0x7f13141da330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:02:54.699 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:54.692+0000 7f13137fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f13141546f0 0x7f13141da330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:50396/0 (socket says 172.21.15.78:50396) 2023-11-28T20:02:54.699 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:54.692+0000 7f13137fe640 1 -- 172.21.15.78:0/2006897103 learned_addr learned my addr 172.21.15.78:0/2006897103 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T20:02:54.700 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:54.692+0000 7f1312ffd640 1 --2- 172.21.15.78:0/2006897103 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f12f400b5e0 0x7f13141ed9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:02:54.700 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:54.692+0000 7f13137fe640 1 -- 172.21.15.78:0/2006897103 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f13141edee0 msgr2=0x7f13141541b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:02:54.700 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:54.692+0000 7f130a7fc640 1 --2- 172.21.15.78:0/2006897103 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f13141edee0 0x7f13141541b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:02:54.701 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:54.692+0000 7f13137fe640 1 --2- 172.21.15.78:0/2006897103 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f13141edee0 0x7f13141541b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:54.701 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:54.692+0000 7f13137fe640 1 -- 172.21.15.78:0/2006897103 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f12f400b5e0 msgr2=0x7f13141ed9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:02:54.701 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:54.692+0000 7f13137fe640 1 --2- 172.21.15.78:0/2006897103 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f12f400b5e0 0x7f13141ed9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:54.701 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:54.692+0000 7f13137fe640 1 -- 172.21.15.78:0/2006897103 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13141dfad0 con 0x7f13141546f0 2023-11-28T20:02:54.702 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:54.692+0000 7f1312ffd640 1 --2- 172.21.15.78:0/2006897103 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f12f400b5e0 0x7f13141ed9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T20:02:54.702 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:54.692+0000 7f130a7fc640 1 --2- 172.21.15.78:0/2006897103 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f13141edee0 0x7f13141541b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T20:02:54.702 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:54.692+0000 7f13137fe640 1 --2- 172.21.15.78:0/2006897103 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f13141546f0 0x7f13141da330 secure :-1 s=READY pgs=1091 cs=0 l=1 rev1=1 crypto rx=0x7f130c01c590 tx=0x7f12f4003700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:02:54.702 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:54.692+0000 7f130bfff640 1 -- 172.21.15.78:0/2006897103 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f130c0ac070 con 0x7f13141546f0 2023-11-28T20:02:54.703 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:54.692+0000 7f130bfff640 1 -- 172.21.15.78:0/2006897103 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f130c003e90 con 0x7f13141546f0 2023-11-28T20:02:54.703 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:54.692+0000 7f130bfff640 1 -- 172.21.15.78:0/2006897103 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f130c006b60 con 0x7f13141546f0 2023-11-28T20:02:54.703 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:54.692+0000 7f1319417640 1 -- 172.21.15.78:0/2006897103 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f13141dec00 con 0x7f13141546f0 2023-11-28T20:02:54.704 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:54.692+0000 7f1319417640 1 -- 172.21.15.78:0/2006897103 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1314154b80 con 0x7f13141546f0 2023-11-28T20:02:54.705 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:54.692+0000 7f1319417640 1 -- 172.21.15.78:0/2006897103 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1314067630 con 0x7f13141546f0 2023-11-28T20:02:54.706 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:54.692+0000 7f130bfff640 1 -- 172.21.15.78:0/2006897103 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f130c006cc0 con 0x7f13141546f0 2023-11-28T20:02:54.706 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:54.696+0000 7f130bfff640 1 --2- 172.21.15.78:0/2006897103 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f12f8066470 0x7f12f8068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:54.706 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:54.696+0000 7f130bfff640 1 -- 172.21.15.78:0/2006897103 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 7088+0+0 (secure 0 0 0) 0x7f130c11d0c0 con 0x7f13141546f0 2023-11-28T20:02:54.706 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:54.696+0000 7f1312ffd640 1 --2- 172.21.15.78:0/2006897103 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f12f8066470 0x7f12f8068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:02:54.707 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:54.696+0000 7f1312ffd640 1 --2- 172.21.15.78:0/2006897103 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f12f8066470 0x7f12f8068930 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f12fc001060 tx=0x7f12fc004810 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:02:54.708 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:54.696+0000 7f130bfff640 1 -- 172.21.15.78:0/2006897103 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f130c0ea120 con 0x7f13141546f0 2023-11-28T20:02:54.883 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:54.880+0000 7f1319417640 1 -- 172.21.15.78:0/2006897103 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f13140c3ab0 con 0x7f13141546f0 2023-11-28T20:02:54.884 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:54.880+0000 7f130bfff640 1 -- 172.21.15.78:0/2006897103 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 51 v51) v1 ==== 94+0+6134 (secure 0 0 0) 0x7f130c0b8090 con 0x7f13141546f0 2023-11-28T20:02:54.884 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-11-28T20:02:54.884 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":51,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5834,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6834/3259525552","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6832","nonce":3259525552},{"type":"v1","addr":"172.21.15.179:6834","nonce":3259525552}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":41},{"gid":6466,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6836/3096284673","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6834","nonce":3096284673},{"type":"v1","addr":"172.21.15.78:6836","nonce":3096284673}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":41}],"filesystems":[{"mdsmap":{"epoch":46,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-28T20:02:07.651677+0000","modified":"2023-11-28T20:02:10.666537+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":6633},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6633":{"gid":6633,"name":"a","rank":0,"incarnation":42,"state":"up:active","state_seq":3,"addr":"172.21.15.78:6837/20108235","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6835","nonce":20108235},{"type":"v1","addr":"172.21.15.78:6837","nonce":20108235}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6},{"mdsmap":{"epoch":51,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-28T20:02:25.231135+0000","modified":"2023-11-28T20:02:28.250515+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":6478},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6478":{"gid":6478,"name":"b","rank":0,"incarnation":47,"state":"up:active","state_seq":7,"addr":"172.21.15.179:6835/2749579094","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6833","nonce":2749579094},{"type":"v1","addr":"172.21.15.179:6835","nonce":2749579094}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs2","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":7}]} 2023-11-28T20:02:54.885 INFO:teuthology.orchestra.run.smithi078.stderr:dumped fsmap epoch 51 2023-11-28T20:02:54.887 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:54.880+0000 7f1319417640 1 -- 172.21.15.78:0/2006897103 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f12f8066470 msgr2=0x7f12f8068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:02:54.887 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:54.880+0000 7f1319417640 1 --2- 172.21.15.78:0/2006897103 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f12f8066470 0x7f12f8068930 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f12fc001060 tx=0x7f12fc004810 comp rx=0 tx=0).stop 2023-11-28T20:02:54.887 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:54.880+0000 7f1319417640 1 -- 172.21.15.78:0/2006897103 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f13141546f0 msgr2=0x7f13141da330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:02:54.887 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:54.880+0000 7f1319417640 1 --2- 172.21.15.78:0/2006897103 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f13141546f0 0x7f13141da330 secure :-1 s=READY pgs=1091 cs=0 l=1 rev1=1 crypto rx=0x7f130c01c590 tx=0x7f12f4003700 comp rx=0 tx=0).stop 2023-11-28T20:02:54.888 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:54.884+0000 7f1319417640 1 -- 172.21.15.78:0/2006897103 shutdown_connections 2023-11-28T20:02:54.888 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:54.884+0000 7f1319417640 1 --2- 172.21.15.78:0/2006897103 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f12f8066470 0x7f12f8068930 unknown :-1 s=CLOSED pgs=516 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:54.888 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:54.884+0000 7f1319417640 1 --2- 172.21.15.78:0/2006897103 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f13141edee0 0x7f13141541b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:54.888 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:54.884+0000 7f1319417640 1 --2- 172.21.15.78:0/2006897103 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f13141546f0 0x7f13141da330 unknown :-1 s=CLOSED pgs=1091 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:54.889 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:54.884+0000 7f1319417640 1 --2- 172.21.15.78:0/2006897103 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f12f400b5e0 0x7f13141ed9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:54.889 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:54.884+0000 7f1319417640 1 -- 172.21.15.78:0/2006897103 >> 172.21.15.78:0/2006897103 conn(0x7f13140a7810 msgr2=0x7f131414af20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:02:54.889 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:54.884+0000 7f1319417640 1 -- 172.21.15.78:0/2006897103 shutdown_connections 2023-11-28T20:02:54.889 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:54.884+0000 7f1319417640 1 -- 172.21.15.78:0/2006897103 wait complete. 2023-11-28T20:02:54.908 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-28T20:02:55.045 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:55.040+0000 7f2ae4980640 1 Processor -- start 2023-11-28T20:02:55.045 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:55.040+0000 7f2ae4980640 1 -- start start 2023-11-28T20:02:55.047 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:55.040+0000 7f2ae4980640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f2ae014fd10 0x7f2ae00a4dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:55.047 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:55.040+0000 7f2ae4980640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f2ae00a5300 0x7f2ae0071e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:55.047 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:55.040+0000 7f2ae4980640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2ae0072370 0x7f2ae0156110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:55.047 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:55.040+0000 7f2ae4980640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2ae006c5e0 con 0x7f2ae014fd10 2023-11-28T20:02:55.047 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:55.040+0000 7f2ae4980640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2ae00c5710 con 0x7f2ae00a5300 2023-11-28T20:02:55.048 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:55.040+0000 7f2ae4980640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ae0155c80 con 0x7f2ae0072370 2023-11-28T20:02:55.048 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:55.044+0000 7f2ade59c640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f2ae014fd10 0x7f2ae00a4dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:02:55.048 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:55.044+0000 7f2ade59c640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f2ae014fd10 0x7f2ae00a4dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:50400/0 (socket says 172.21.15.78:50400) 2023-11-28T20:02:55.048 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:55.044+0000 7f2ade59c640 1 -- 172.21.15.78:0/3256835486 learned_addr learned my addr 172.21.15.78:0/3256835486 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T20:02:55.048 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:55.044+0000 7f2ade59c640 1 -- 172.21.15.78:0/3256835486 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2ae0072370 msgr2=0x7f2ae0156110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:02:55.048 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:55.044+0000 7f2ade59c640 1 --2- 172.21.15.78:0/3256835486 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2ae0072370 0x7f2ae0156110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:55.048 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:55.044+0000 7f2ade59c640 1 -- 172.21.15.78:0/3256835486 >> v2:172.21.15.179:3300/0 conn(0x7f2ae00a5300 msgr2=0x7f2ae0071e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:02:55.048 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:55.044+0000 7f2ade59c640 1 --2- 172.21.15.78:0/3256835486 >> v2:172.21.15.179:3300/0 conn(0x7f2ae00a5300 0x7f2ae0071e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:55.048 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:55.044+0000 7f2ade59c640 1 -- 172.21.15.78:0/3256835486 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ae00c4e70 con 0x7f2ae014fd10 2023-11-28T20:02:55.050 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:55.044+0000 7f2ade59c640 1 --2- 172.21.15.78:0/3256835486 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2ae014fd10 0x7f2ae00a4dc0 secure :-1 s=READY pgs=1092 cs=0 l=1 rev1=1 crypto rx=0x7f2ae0066e30 tx=0x7f2ad001c3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1ca7868e82482fbc server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:02:55.050 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:55.044+0000 7f2add59a640 1 -- 172.21.15.78:0/3256835486 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ad00ab600 con 0x7f2ae014fd10 2023-11-28T20:02:55.050 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:55.044+0000 7f2add59a640 1 -- 172.21.15.78:0/3256835486 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ad00a7050 con 0x7f2ae014fd10 2023-11-28T20:02:55.050 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:55.044+0000 7f2add59a640 1 -- 172.21.15.78:0/3256835486 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ad00ab980 con 0x7f2ae014fd10 2023-11-28T20:02:55.051 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:55.048+0000 7f2ae4980640 1 -- 172.21.15.78:0/3256835486 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2ae014fd10 msgr2=0x7f2ae00a4dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:02:55.052 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:55.048+0000 7f2ae4980640 1 --2- 172.21.15.78:0/3256835486 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2ae014fd10 0x7f2ae00a4dc0 secure :-1 s=READY pgs=1092 cs=0 l=1 rev1=1 crypto rx=0x7f2ae0066e30 tx=0x7f2ad001c3b0 comp rx=0 tx=0).stop 2023-11-28T20:02:55.052 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:55.048+0000 7f2ae4980640 1 -- 172.21.15.78:0/3256835486 shutdown_connections 2023-11-28T20:02:55.052 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:55.048+0000 7f2ae4980640 1 --2- 172.21.15.78:0/3256835486 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2ae0072370 0x7f2ae0156110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:55.052 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:55.048+0000 7f2ae4980640 1 --2- 172.21.15.78:0/3256835486 >> v2:172.21.15.179:3300/0 conn(0x7f2ae00a5300 0x7f2ae0071e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:55.052 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:55.048+0000 7f2ae4980640 1 --2- 172.21.15.78:0/3256835486 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2ae014fd10 0x7f2ae00a4dc0 unknown :-1 s=CLOSED pgs=1092 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:55.052 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:55.048+0000 7f2ae4980640 1 -- 172.21.15.78:0/3256835486 >> 172.21.15.78:0/3256835486 conn(0x7f2ae00a7810 msgr2=0x7f2ae00a7c20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:02:55.053 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:55.048+0000 7f2ae4980640 1 -- 172.21.15.78:0/3256835486 shutdown_connections 2023-11-28T20:02:55.053 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:55.048+0000 7f2ae4980640 1 -- 172.21.15.78:0/3256835486 wait complete. 2023-11-28T20:02:55.055 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:55.048+0000 7f2ae4980640 1 Processor -- start 2023-11-28T20:02:55.055 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:55.048+0000 7f2ae4980640 1 -- start start 2023-11-28T20:02:55.055 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:55.048+0000 7f2ae4980640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2ae0072370 0x7f2ae01ed4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:55.056 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:55.048+0000 7f2ae4980640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2ae00a5300 0x7f2ae00bf120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:55.056 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:55.048+0000 7f2ae4980640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2ae014fd10 0x7f2ae00aad70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:55.056 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:55.048+0000 7f2ae4980640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ae0157230 con 0x7f2ae00a5300 2023-11-28T20:02:55.056 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:55.048+0000 7f2ae4980640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ae0071e30 con 0x7f2ae014fd10 2023-11-28T20:02:55.056 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:55.048+0000 7f2ae4980640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ae01f0dc0 con 0x7f2ae0072370 2023-11-28T20:02:55.057 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:55.048+0000 7f2addd9b640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2ae00a5300 0x7f2ae00bf120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:02:55.057 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:55.048+0000 7f2addd9b640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2ae00a5300 0x7f2ae00bf120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:50412/0 (socket says 172.21.15.78:50412) 2023-11-28T20:02:55.057 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:55.048+0000 7f2addd9b640 1 -- 172.21.15.78:0/861501285 learned_addr learned my addr 172.21.15.78:0/861501285 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T20:02:55.057 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:55.048+0000 7f2ade59c640 1 --2- 172.21.15.78:0/861501285 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2ae0072370 0x7f2ae01ed4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:02:55.057 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:55.048+0000 7f2aded9d640 1 --2- 172.21.15.78:0/861501285 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2ae014fd10 0x7f2ae00aad70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:02:55.057 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:55.048+0000 7f2addd9b640 1 -- 172.21.15.78:0/861501285 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2ae0072370 msgr2=0x7f2ae01ed4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:02:55.058 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:55.048+0000 7f2addd9b640 1 --2- 172.21.15.78:0/861501285 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2ae0072370 0x7f2ae01ed4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:55.058 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:55.048+0000 7f2addd9b640 1 -- 172.21.15.78:0/861501285 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2ae014fd10 msgr2=0x7f2ae00aad70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:02:55.058 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:55.048+0000 7f2addd9b640 1 --2- 172.21.15.78:0/861501285 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2ae014fd10 0x7f2ae00aad70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:55.058 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:55.048+0000 7f2addd9b640 1 -- 172.21.15.78:0/861501285 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ad00094d0 con 0x7f2ae00a5300 2023-11-28T20:02:55.058 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:55.048+0000 7f2ade59c640 1 --2- 172.21.15.78:0/861501285 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2ae0072370 0x7f2ae01ed4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T20:02:55.058 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:55.048+0000 7f2aded9d640 1 --2- 172.21.15.78:0/861501285 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2ae014fd10 0x7f2ae00aad70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T20:02:55.058 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:55.052+0000 7f2addd9b640 1 --2- 172.21.15.78:0/861501285 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2ae00a5300 0x7f2ae00bf120 secure :-1 s=READY pgs=1093 cs=0 l=1 rev1=1 crypto rx=0x7f2ad400b480 tx=0x7f2ad400b940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:02:55.059 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:55.052+0000 7f2aceffd640 1 -- 172.21.15.78:0/861501285 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ad4010870 con 0x7f2ae00a5300 2023-11-28T20:02:55.059 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:55.052+0000 7f2aceffd640 1 -- 172.21.15.78:0/861501285 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ad40109d0 con 0x7f2ae00a5300 2023-11-28T20:02:55.059 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:55.052+0000 7f2aceffd640 1 -- 172.21.15.78:0/861501285 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ad4010d80 con 0x7f2ae00a5300 2023-11-28T20:02:55.059 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:55.052+0000 7f2ae4980640 1 -- 172.21.15.78:0/861501285 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2ae01f10a0 con 0x7f2ae00a5300 2023-11-28T20:02:55.059 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:55.052+0000 7f2ae4980640 1 -- 172.21.15.78:0/861501285 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2ae01f1660 con 0x7f2ae00a5300 2023-11-28T20:02:55.060 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:55.052+0000 7f2ae4980640 1 -- 172.21.15.78:0/861501285 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2ae0067630 con 0x7f2ae00a5300 2023-11-28T20:02:55.060 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:55.052+0000 7f2aceffd640 1 -- 172.21.15.78:0/861501285 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f2ad400f3c0 con 0x7f2ae00a5300 2023-11-28T20:02:55.061 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:55.052+0000 7f2aceffd640 1 --2- 172.21.15.78:0/861501285 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f2ac0066470 0x7f2ac0068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:55.061 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:55.052+0000 7f2aceffd640 1 -- 172.21.15.78:0/861501285 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 7088+0+0 (secure 0 0 0) 0x7f2ad4084440 con 0x7f2ae00a5300 2023-11-28T20:02:55.061 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:55.052+0000 7f2ade59c640 1 --2- 172.21.15.78:0/861501285 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f2ac0066470 0x7f2ac0068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:02:55.061 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:55.056+0000 7f2ade59c640 1 --2- 172.21.15.78:0/861501285 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f2ac0066470 0x7f2ac0068930 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f2ad00ad000 tx=0x7f2ad0008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:02:55.062 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:55.056+0000 7f2aceffd640 1 -- 172.21.15.78:0/861501285 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f2ad4051370 con 0x7f2ae00a5300 2023-11-28T20:02:55.214 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:55.208+0000 7f2ae4980640 1 -- 172.21.15.78:0/861501285 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2ae01ee970 con 0x7f2ae00a5300 2023-11-28T20:02:55.216 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:55.212+0000 7f2aceffd640 1 -- 172.21.15.78:0/861501285 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v87) v1 ==== 74+0+20676 (secure 0 0 0) 0x7f2ad4054990 con 0x7f2ae00a5300 2023-11-28T20:02:55.216 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-11-28T20:02:55.217 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":87,"fsid":"dd9780e8-3bda-44fa-a9f0-fa07d19d901d","created":"2023-11-28T19:58:40.969556+0000","modified":"2023-11-28T20:02:49.136462+0000","last_up_change":"2023-11-28T19:58:52.596716+0000","last_in_change":"2023-11-28T19:58:43.609275+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":16,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-28T19:58:54.011229+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_metadata","create_time":"2023-11-28T20:02:05.787820+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs_data","create_time":"2023-11-28T20:02:06.652305+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs2_metadata","create_time":"2023-11-28T20:02:23.066724+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":16,"pool_name":"cephfs2_data","create_time":"2023-11-28T20:02:24.230614+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs2"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e84245ac-b5da-429e-af18-39acaa2b33e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6800","nonce":3358701235},{"type":"v1","addr":"172.21.15.78:6801","nonce":3358701235}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6802","nonce":3358701235},{"type":"v1","addr":"172.21.15.78:6803","nonce":3358701235}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6806","nonce":3358701235},{"type":"v1","addr":"172.21.15.78:6807","nonce":3358701235}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6804","nonce":3358701235},{"type":"v1","addr":"172.21.15.78:6805","nonce":3358701235}]},"public_addr":"172.21.15.78:6801/3358701235","cluster_addr":"172.21.15.78:6803/3358701235","heartbeat_back_addr":"172.21.15.78:6807/3358701235","heartbeat_front_addr":"172.21.15.78:6805/3358701235","state":["exists","up"]},{"osd":1,"uuid":"e634831d-c4e2-48d9-870c-9556ae162981","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6808","nonce":3211476654},{"type":"v1","addr":"172.21.15.78:6809","nonce":3211476654}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6810","nonce":3211476654},{"type":"v1","addr":"172.21.15.78:6811","nonce":3211476654}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6814","nonce":3211476654},{"type":"v1","addr":"172.21.15.78:6815","nonce":3211476654}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6812","nonce":3211476654},{"type":"v1","addr":"172.21.15.78:6813","nonce":3211476654}]},"public_addr":"172.21.15.78:6809/3211476654","cluster_addr":"172.21.15.78:6811/3211476654","heartbeat_back_addr":"172.21.15.78:6815/3211476654","heartbeat_front_addr":"172.21.15.78:6813/3211476654","state":["exists","up"]},{"osd":2,"uuid":"274c8395-6534-41f0-b8fb-a00af8985aa8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6816","nonce":2532904479},{"type":"v1","addr":"172.21.15.78:6817","nonce":2532904479}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6818","nonce":2532904479},{"type":"v1","addr":"172.21.15.78:6819","nonce":2532904479}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6822","nonce":2532904479},{"type":"v1","addr":"172.21.15.78:6823","nonce":2532904479}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6820","nonce":2532904479},{"type":"v1","addr":"172.21.15.78:6821","nonce":2532904479}]},"public_addr":"172.21.15.78:6817/2532904479","cluster_addr":"172.21.15.78:6819/2532904479","heartbeat_back_addr":"172.21.15.78:6823/2532904479","heartbeat_front_addr":"172.21.15.78:6821/2532904479","state":["exists","up"]},{"osd":3,"uuid":"77acc9af-7d4d-4b18-8cf5-d62f5971b7c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6824","nonce":3442991267},{"type":"v1","addr":"172.21.15.78:6825","nonce":3442991267}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6826","nonce":3442991267},{"type":"v1","addr":"172.21.15.78:6827","nonce":3442991267}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6830","nonce":3442991267},{"type":"v1","addr":"172.21.15.78:6831","nonce":3442991267}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6828","nonce":3442991267},{"type":"v1","addr":"172.21.15.78:6829","nonce":3442991267}]},"public_addr":"172.21.15.78:6825/3442991267","cluster_addr":"172.21.15.78:6827/3442991267","heartbeat_back_addr":"172.21.15.78:6831/3442991267","heartbeat_front_addr":"172.21.15.78:6829/3442991267","state":["exists","up"]},{"osd":4,"uuid":"5c62bc66-6b34-4b7f-a66b-9a743969138c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":802983577},{"type":"v1","addr":"172.21.15.179:6809","nonce":802983577}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":802983577},{"type":"v1","addr":"172.21.15.179:6811","nonce":802983577}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":802983577},{"type":"v1","addr":"172.21.15.179:6815","nonce":802983577}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":802983577},{"type":"v1","addr":"172.21.15.179:6813","nonce":802983577}]},"public_addr":"172.21.15.179:6809/802983577","cluster_addr":"172.21.15.179:6811/802983577","heartbeat_back_addr":"172.21.15.179:6815/802983577","heartbeat_front_addr":"172.21.15.179:6813/802983577","state":["exists","up"]},{"osd":5,"uuid":"67db6d36-f684-4079-b0cd-82b4dd61461f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":518192887},{"type":"v1","addr":"172.21.15.179:6818","nonce":518192887}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":518192887},{"type":"v1","addr":"172.21.15.179:6822","nonce":518192887}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":518192887},{"type":"v1","addr":"172.21.15.179:6829","nonce":518192887}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6824","nonce":518192887},{"type":"v1","addr":"172.21.15.179:6826","nonce":518192887}]},"public_addr":"172.21.15.179:6818/518192887","cluster_addr":"172.21.15.179:6822/518192887","heartbeat_back_addr":"172.21.15.179:6829/518192887","heartbeat_front_addr":"172.21.15.179:6826/518192887","state":["exists","up"]},{"osd":6,"uuid":"12e670af-5a16-4c81-9f97-defa66cab967","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":815435378},{"type":"v1","addr":"172.21.15.179:6801","nonce":815435378}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":815435378},{"type":"v1","addr":"172.21.15.179:6803","nonce":815435378}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":815435378},{"type":"v1","addr":"172.21.15.179:6807","nonce":815435378}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":815435378},{"type":"v1","addr":"172.21.15.179:6805","nonce":815435378}]},"public_addr":"172.21.15.179:6801/815435378","cluster_addr":"172.21.15.179:6803/815435378","heartbeat_back_addr":"172.21.15.179:6807/815435378","heartbeat_front_addr":"172.21.15.179:6805/815435378","state":["exists","up"]},{"osd":7,"uuid":"fe630650-2eb3-49ad-8676-c341e6332eb1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6817","nonce":2848432339},{"type":"v1","addr":"172.21.15.179:6819","nonce":2848432339}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6821","nonce":2848432339},{"type":"v1","addr":"172.21.15.179:6823","nonce":2848432339}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":2848432339},{"type":"v1","addr":"172.21.15.179:6831","nonce":2848432339}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6825","nonce":2848432339},{"type":"v1","addr":"172.21.15.179:6827","nonce":2848432339}]},"public_addr":"172.21.15.179:6819/2848432339","cluster_addr":"172.21.15.179:6823/2848432339","heartbeat_back_addr":"172.21.15.179:6831/2848432339","heartbeat_front_addr":"172.21.15.179:6827/2848432339","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:58:49.255433+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:58:49.412880+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:58:49.559295+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:58:49.245237+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:58:49.184557+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:58:49.329851+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:58:49.366012+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:58:49.349604+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"14.8","mappings":[{"from":1,"to":5}]},{"pgid":"14.2c","mappings":[{"from":1,"to":7}]},{"pgid":"14.33","mappings":[{"from":1,"to":2}]},{"pgid":"14.3c","mappings":[{"from":1,"to":7}]},{"pgid":"16.1f","mappings":[{"from":5,"to":4}]},{"pgid":"16.26","mappings":[{"from":6,"to":7}]},{"pgid":"16.3a","mappings":[{"from":1,"to":4}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-28T20:02:55.218 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:55.212+0000 7f2ae4980640 1 -- 172.21.15.78:0/861501285 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f2ac0066470 msgr2=0x7f2ac0068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:02:55.218 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:55.212+0000 7f2ae4980640 1 --2- 172.21.15.78:0/861501285 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f2ac0066470 0x7f2ac0068930 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f2ad00ad000 tx=0x7f2ad0008040 comp rx=0 tx=0).stop 2023-11-28T20:02:55.219 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:55.212+0000 7f2ae4980640 1 -- 172.21.15.78:0/861501285 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2ae00a5300 msgr2=0x7f2ae00bf120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:02:55.219 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:55.212+0000 7f2ae4980640 1 --2- 172.21.15.78:0/861501285 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2ae00a5300 0x7f2ae00bf120 secure :-1 s=READY pgs=1093 cs=0 l=1 rev1=1 crypto rx=0x7f2ad400b480 tx=0x7f2ad400b940 comp rx=0 tx=0).stop 2023-11-28T20:02:55.219 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:55.212+0000 7f2ae4980640 1 -- 172.21.15.78:0/861501285 shutdown_connections 2023-11-28T20:02:55.220 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:55.212+0000 7f2ae4980640 1 --2- 172.21.15.78:0/861501285 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f2ac0066470 0x7f2ac0068930 unknown :-1 s=CLOSED pgs=517 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:55.220 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:55.212+0000 7f2ae4980640 1 --2- 172.21.15.78:0/861501285 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2ae014fd10 0x7f2ae00aad70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:55.220 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:55.212+0000 7f2ae4980640 1 --2- 172.21.15.78:0/861501285 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2ae00a5300 0x7f2ae00bf120 unknown :-1 s=CLOSED pgs=1093 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:55.221 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:55.212+0000 7f2ae4980640 1 --2- 172.21.15.78:0/861501285 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2ae0072370 0x7f2ae01ed4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:55.221 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:55.212+0000 7f2ae4980640 1 -- 172.21.15.78:0/861501285 >> 172.21.15.78:0/861501285 conn(0x7f2ae00a7810 msgr2=0x7f2ae006d1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:02:55.221 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:55.212+0000 7f2ae4980640 1 -- 172.21.15.78:0/861501285 shutdown_connections 2023-11-28T20:02:55.221 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:55.212+0000 7f2ae4980640 1 -- 172.21.15.78:0/861501285 wait complete. 2023-11-28T20:02:55.238 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-11-28T20:02:55.378 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:55.372+0000 7fc571d1d640 1 Processor -- start 2023-11-28T20:02:55.378 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:55.372+0000 7fc571d1d640 1 -- start start 2023-11-28T20:02:55.380 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:55.376+0000 7fc571d1d640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fc56c06bc70 0x7fc56c0a4fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:55.380 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:55.376+0000 7fc571d1d640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fc56c14e550 0x7fc56c150f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:55.380 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:55.376+0000 7fc571d1d640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc56c0a4cc0 con 0x7fc56c0c66b0 2023-11-28T20:02:55.380 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:55.376+0000 7fc571d1d640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc56c0c23d0 con 0x7fc56c06bc70 2023-11-28T20:02:55.381 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:55.376+0000 7fc571d1d640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc56c0c1b70 con 0x7fc56c14e550 2023-11-28T20:02:55.381 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:55.376+0000 7fc56affd640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7fc56c0c66b0 0x7fc56c14de40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:51034/0 (socket says 172.21.15.78:51034) 2023-11-28T20:02:55.381 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:55.376+0000 7fc56affd640 1 -- 172.21.15.78:0/4029419164 learned_addr learned my addr 172.21.15.78:0/4029419164 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-11-28T20:02:55.381 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:55.376+0000 7fc56b7fe640 1 --2- 172.21.15.78:0/4029419164 >> v2:172.21.15.78:3300/0 conn(0x7fc56c06bc70 0x7fc56c0a4fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:02:55.381 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:55.376+0000 7fc56bfff640 1 --2- 172.21.15.78:0/4029419164 >> v2:172.21.15.179:3300/0 conn(0x7fc56c14e550 0x7fc56c150f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:02:55.381 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:55.376+0000 7fc56a7fc640 1 -- 172.21.15.78:0/4029419164 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1778621755 0 0) 0x7fc56c0a4cc0 con 0x7fc56c0c66b0 2023-11-28T20:02:55.381 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:55.376+0000 7fc56a7fc640 1 -- 172.21.15.78:0/4029419164 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc554005740 con 0x7fc56c0c66b0 2023-11-28T20:02:55.381 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:55.376+0000 7fc56b7fe640 1 -- 172.21.15.78:0/4029419164 >> v2:172.21.15.179:3300/0 conn(0x7fc56c14e550 msgr2=0x7fc56c150f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:02:55.381 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:55.376+0000 7fc56b7fe640 1 --2- 172.21.15.78:0/4029419164 >> v2:172.21.15.179:3300/0 conn(0x7fc56c14e550 0x7fc56c150f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:55.381 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:55.376+0000 7fc56b7fe640 1 -- 172.21.15.78:0/4029419164 >> v1:172.21.15.78:6789/0 conn(0x7fc56c0c66b0 legacy=0x7fc56c14de40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:02:55.381 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:55.376+0000 7fc56b7fe640 1 -- 172.21.15.78:0/4029419164 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc56c0c1d80 con 0x7fc56c06bc70 2023-11-28T20:02:55.383 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:55.380+0000 7fc56b7fe640 1 --2- 172.21.15.78:0/4029419164 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc56c06bc70 0x7fc56c0a4fa0 secure :-1 s=READY pgs=1095 cs=0 l=1 rev1=1 crypto rx=0x7fc56c0c6450 tx=0x7fc55c01c300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=96242ec3ea663635 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:02:55.383 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:55.380+0000 7fc56a7fc640 1 -- 172.21.15.78:0/4029419164 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc55c0ab600 con 0x7fc56c06bc70 2023-11-28T20:02:55.383 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:55.380+0000 7fc56a7fc640 1 -- 172.21.15.78:0/4029419164 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc55c0a7050 con 0x7fc56c06bc70 2023-11-28T20:02:55.383 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:55.380+0000 7fc56a7fc640 1 -- 172.21.15.78:0/4029419164 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc55c0ab980 con 0x7fc56c06bc70 2023-11-28T20:02:55.384 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:55.380+0000 7fc571d1d640 1 -- 172.21.15.78:0/4029419164 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc56c06bc70 msgr2=0x7fc56c0a4fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:02:55.384 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:55.380+0000 7fc571d1d640 1 --2- 172.21.15.78:0/4029419164 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc56c06bc70 0x7fc56c0a4fa0 secure :-1 s=READY pgs=1095 cs=0 l=1 rev1=1 crypto rx=0x7fc56c0c6450 tx=0x7fc55c01c300 comp rx=0 tx=0).stop 2023-11-28T20:02:55.384 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:55.380+0000 7fc571d1d640 1 -- 172.21.15.78:0/4029419164 shutdown_connections 2023-11-28T20:02:55.384 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:55.380+0000 7fc571d1d640 1 --2- 172.21.15.78:0/4029419164 >> v2:172.21.15.179:3300/0 conn(0x7fc56c14e550 0x7fc56c150f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:55.384 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:55.380+0000 7fc571d1d640 1 --2- 172.21.15.78:0/4029419164 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc56c06bc70 0x7fc56c0a4fa0 unknown :-1 s=CLOSED pgs=1095 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:55.385 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:55.380+0000 7fc571d1d640 1 -- 172.21.15.78:0/4029419164 >> 172.21.15.78:0/4029419164 conn(0x7fc56c06b220 msgr2=0x7fc56c0a77e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:02:55.385 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:55.380+0000 7fc571d1d640 1 -- 172.21.15.78:0/4029419164 shutdown_connections 2023-11-28T20:02:55.385 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:55.380+0000 7fc571d1d640 1 -- 172.21.15.78:0/4029419164 wait complete. 2023-11-28T20:02:55.386 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:55.380+0000 7fc571d1d640 1 Processor -- start 2023-11-28T20:02:55.386 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:55.380+0000 7fc571d1d640 1 -- start start 2023-11-28T20:02:55.388 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:55.384+0000 7fc571d1d640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc56c06bc70 0x7fc56c1ebf20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:55.388 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:55.384+0000 7fc571d1d640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc56c0c66b0 0x7fc56c13dd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:55.391 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:55.384+0000 7fc571d1d640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc56c14e550 0x7fc56c13e280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:55.391 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:55.384+0000 7fc571d1d640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc56c0bff90 con 0x7fc56c14e550 2023-11-28T20:02:55.391 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:55.384+0000 7fc571d1d640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc56c1ecb30 con 0x7fc56c0c66b0 2023-11-28T20:02:55.391 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:55.384+0000 7fc571d1d640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc56c0bfcb0 con 0x7fc56c06bc70 2023-11-28T20:02:55.392 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:55.384+0000 7fc56bfff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc56c14e550 0x7fc56c13e280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:02:55.392 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:55.384+0000 7fc56bfff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc56c14e550 0x7fc56c13e280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:41696/0 (socket says 172.21.15.78:41696) 2023-11-28T20:02:55.392 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:55.384+0000 7fc56bfff640 1 -- 172.21.15.78:0/3019889146 learned_addr learned my addr 172.21.15.78:0/3019889146 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T20:02:55.392 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:55.384+0000 7fc56affd640 1 --2- 172.21.15.78:0/3019889146 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc56c0c66b0 0x7fc56c13dd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:02:55.392 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:55.384+0000 7fc56b7fe640 1 --2- 172.21.15.78:0/3019889146 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc56c06bc70 0x7fc56c1ebf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:02:55.393 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:55.384+0000 7fc56bfff640 1 -- 172.21.15.78:0/3019889146 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc56c06bc70 msgr2=0x7fc56c1ebf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:02:55.393 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:55.384+0000 7fc56bfff640 1 --2- 172.21.15.78:0/3019889146 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc56c06bc70 0x7fc56c1ebf20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:55.393 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:55.384+0000 7fc56bfff640 1 -- 172.21.15.78:0/3019889146 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc56c0c66b0 msgr2=0x7fc56c13dd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:02:55.393 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:55.384+0000 7fc56bfff640 1 --2- 172.21.15.78:0/3019889146 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc56c0c66b0 0x7fc56c13dd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:55.393 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:55.384+0000 7fc56bfff640 1 -- 172.21.15.78:0/3019889146 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc55c009420 con 0x7fc56c14e550 2023-11-28T20:02:55.393 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:55.384+0000 7fc56affd640 1 --2- 172.21.15.78:0/3019889146 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc56c0c66b0 0x7fc56c13dd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T20:02:55.393 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:55.384+0000 7fc56bfff640 1 --2- 172.21.15.78:0/3019889146 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc56c14e550 0x7fc56c13e280 secure :-1 s=READY pgs=1096 cs=0 l=1 rev1=1 crypto rx=0x7fc564007e60 tx=0x7fc56400e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:02:55.393 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:55.384+0000 7fc553fff640 1 -- 172.21.15.78:0/3019889146 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc564014420 con 0x7fc56c14e550 2023-11-28T20:02:55.393 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:55.384+0000 7fc553fff640 1 -- 172.21.15.78:0/3019889146 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc5640145a0 con 0x7fc56c14e550 2023-11-28T20:02:55.394 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:55.384+0000 7fc553fff640 1 -- 172.21.15.78:0/3019889146 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc564014950 con 0x7fc56c14e550 2023-11-28T20:02:55.394 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:55.384+0000 7fc571d1d640 1 -- 172.21.15.78:0/3019889146 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc56c14cf50 con 0x7fc56c14e550 2023-11-28T20:02:55.394 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:55.384+0000 7fc571d1d640 1 -- 172.21.15.78:0/3019889146 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc56c141ac0 con 0x7fc56c14e550 2023-11-28T20:02:55.395 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:55.384+0000 7fc571d1d640 1 -- 172.21.15.78:0/3019889146 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc56c0a94f0 con 0x7fc56c14e550 2023-11-28T20:02:55.396 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:55.384+0000 7fc553fff640 1 -- 172.21.15.78:0/3019889146 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fc564014ab0 con 0x7fc56c14e550 2023-11-28T20:02:55.396 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:55.388+0000 7fc553fff640 1 --2- 172.21.15.78:0/3019889146 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fc5580664a0 0x7fc558068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:55.396 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:55.388+0000 7fc553fff640 1 -- 172.21.15.78:0/3019889146 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 7088+0+0 (secure 0 0 0) 0x7fc564084ca0 con 0x7fc56c14e550 2023-11-28T20:02:55.396 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:55.388+0000 7fc56b7fe640 1 --2- 172.21.15.78:0/3019889146 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fc5580664a0 0x7fc558068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:02:55.396 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:55.388+0000 7fc56b7fe640 1 --2- 172.21.15.78:0/3019889146 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fc5580664a0 0x7fc558068960 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7fc55c0ad000 tx=0x7fc55c0a6000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:02:55.396 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:55.392+0000 7fc553fff640 1 -- 172.21.15.78:0/3019889146 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fc56c0a94f0 con 0x7fc56c14e550 2023-11-28T20:02:55.575 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:55.572+0000 7fc571d1d640 1 -- 172.21.15.78:0/3019889146 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7fc56c0a94f0 con 0x7fc56c14e550 2023-11-28T20:02:55.575 INFO:tasks.ceph.mon.a.smithi078.stderr:2023-11-28T20:02:55.572+0000 7f3f494a3640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-11-28T20:02:55.578 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:55.572+0000 7fc553fff640 1 -- 172.21.15.78:0/3019889146 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v52) v1 ==== 161+0+0 (secure 0 0 0) 0x7fc56c0a94f0 con 0x7fc56c14e550 2023-11-28T20:02:55.578 INFO:teuthology.orchestra.run.smithi078.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-11-28T20:02:55.580 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:55.576+0000 7fc571d1d640 1 -- 172.21.15.78:0/3019889146 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fc5580664a0 msgr2=0x7fc558068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:02:55.581 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:55.576+0000 7fc571d1d640 1 --2- 172.21.15.78:0/3019889146 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fc5580664a0 0x7fc558068960 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7fc55c0ad000 tx=0x7fc55c0a6000 comp rx=0 tx=0).stop 2023-11-28T20:02:55.581 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:55.576+0000 7fc571d1d640 1 -- 172.21.15.78:0/3019889146 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc56c14e550 msgr2=0x7fc56c13e280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:02:55.581 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:55.576+0000 7fc571d1d640 1 --2- 172.21.15.78:0/3019889146 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc56c14e550 0x7fc56c13e280 secure :-1 s=READY pgs=1096 cs=0 l=1 rev1=1 crypto rx=0x7fc564007e60 tx=0x7fc56400e4b0 comp rx=0 tx=0).stop 2023-11-28T20:02:55.581 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:55.576+0000 7fc571d1d640 1 -- 172.21.15.78:0/3019889146 shutdown_connections 2023-11-28T20:02:55.581 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:55.576+0000 7fc571d1d640 1 --2- 172.21.15.78:0/3019889146 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fc5580664a0 0x7fc558068960 unknown :-1 s=CLOSED pgs=518 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:55.582 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:55.576+0000 7fc571d1d640 1 --2- 172.21.15.78:0/3019889146 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc56c14e550 0x7fc56c13e280 unknown :-1 s=CLOSED pgs=1096 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:55.582 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:55.576+0000 7fc571d1d640 1 --2- 172.21.15.78:0/3019889146 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc56c0c66b0 0x7fc56c13dd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:55.582 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:55.576+0000 7fc571d1d640 1 --2- 172.21.15.78:0/3019889146 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc56c06bc70 0x7fc56c1ebf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:55.582 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:55.576+0000 7fc571d1d640 1 -- 172.21.15.78:0/3019889146 >> 172.21.15.78:0/3019889146 conn(0x7fc56c06b220 msgr2=0x7fc56c0a6140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:02:55.583 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:55.576+0000 7fc571d1d640 1 -- 172.21.15.78:0/3019889146 shutdown_connections 2023-11-28T20:02:55.584 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:55.576+0000 7fc571d1d640 1 -- 172.21.15.78:0/3019889146 wait complete. 2023-11-28T20:02:55.591 INFO:tasks.ceph.mds.a.smithi078.stderr: -5244> 2023-11-28T20:02:13.256+0000 7f2c7b196640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-11-28T20:02:55.602 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-11-28T20:02:55.639 INFO:tasks.ceph.mds.a.smithi078.stdout:starting mds.a at 2023-11-28T20:02:55.743 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:55.740+0000 7f63f2209640 1 Processor -- start 2023-11-28T20:02:55.743 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:55.740+0000 7f63f2209640 1 -- start start 2023-11-28T20:02:55.744 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:55.740+0000 7f63f2209640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f63ec155d30 0x7f63ec0c05a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:55.744 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:55.740+0000 7f63f2209640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f63ec06c630 0x7f63ec0c3750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:55.745 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:55.740+0000 7f63f2209640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f63ec06bfd0 con 0x7f63ec0c0ae0 2023-11-28T20:02:55.745 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:55.740+0000 7f63f2209640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f63ec0c43a0 con 0x7f63ec155d30 2023-11-28T20:02:55.745 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:55.740+0000 7f63f2209640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f63ec159740 con 0x7f63ec06c630 2023-11-28T20:02:55.745 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:55.740+0000 7f63f1207640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f63ec155d30 0x7f63ec0c05a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:02:55.745 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:55.740+0000 7f63f1207640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f63ec155d30 0x7f63ec0c05a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:41718/0 (socket says 172.21.15.78:41718) 2023-11-28T20:02:55.745 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:55.740+0000 7f63f1207640 1 -- 172.21.15.78:0/405488193 learned_addr learned my addr 172.21.15.78:0/405488193 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T20:02:55.746 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:55.740+0000 7f63f0a06640 1 --2- 172.21.15.78:0/405488193 >> v2:172.21.15.179:3300/0 conn(0x7f63ec06c630 0x7f63ec0c3750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:02:55.746 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:55.740+0000 7f63f1207640 1 -- 172.21.15.78:0/405488193 >> v2:172.21.15.179:3300/0 conn(0x7f63ec06c630 msgr2=0x7f63ec0c3750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:02:55.746 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:55.740+0000 7f63f1207640 1 --2- 172.21.15.78:0/405488193 >> v2:172.21.15.179:3300/0 conn(0x7f63ec06c630 0x7f63ec0c3750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:55.746 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:55.740+0000 7f63f1207640 1 -- 172.21.15.78:0/405488193 >> v1:172.21.15.179:6789/0 conn(0x7f63ec0c0ae0 legacy=0x7f63ec0c3c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:02:55.746 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:55.740+0000 7f63f1207640 1 -- 172.21.15.78:0/405488193 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63ec156110 con 0x7f63ec155d30 2023-11-28T20:02:55.747 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:55.740+0000 7f63f0a06640 1 --2- 172.21.15.78:0/405488193 >> v2:172.21.15.179:3300/0 conn(0x7f63ec06c630 0x7f63ec0c3750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T20:02:55.748 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:55.744+0000 7f63f1207640 1 --2- 172.21.15.78:0/405488193 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f63ec155d30 0x7f63ec0c05a0 secure :-1 s=READY pgs=1099 cs=0 l=1 rev1=1 crypto rx=0x7f63ec06f520 tx=0x7f63e801c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fd74df4a120f8128 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:02:55.749 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:55.744+0000 7f63e3fff640 1 -- 172.21.15.78:0/405488193 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63e80ab600 con 0x7f63ec155d30 2023-11-28T20:02:55.749 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:55.744+0000 7f63e3fff640 1 -- 172.21.15.78:0/405488193 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f63e80a7050 con 0x7f63ec155d30 2023-11-28T20:02:55.749 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:55.744+0000 7f63e3fff640 1 -- 172.21.15.78:0/405488193 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63e80ab980 con 0x7f63ec155d30 2023-11-28T20:02:55.750 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:55.744+0000 7f63f2209640 1 -- 172.21.15.78:0/405488193 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f63ec155d30 msgr2=0x7f63ec0c05a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:02:55.750 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:55.744+0000 7f63f2209640 1 --2- 172.21.15.78:0/405488193 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f63ec155d30 0x7f63ec0c05a0 secure :-1 s=READY pgs=1099 cs=0 l=1 rev1=1 crypto rx=0x7f63ec06f520 tx=0x7f63e801c430 comp rx=0 tx=0).stop 2023-11-28T20:02:55.750 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:55.744+0000 7f63f2209640 1 -- 172.21.15.78:0/405488193 shutdown_connections 2023-11-28T20:02:55.750 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:55.744+0000 7f63f2209640 1 --2- 172.21.15.78:0/405488193 >> v2:172.21.15.179:3300/0 conn(0x7f63ec06c630 0x7f63ec0c3750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:55.750 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:55.744+0000 7f63f2209640 1 --2- 172.21.15.78:0/405488193 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f63ec155d30 0x7f63ec0c05a0 unknown :-1 s=CLOSED pgs=1099 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:55.750 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:55.744+0000 7f63f2209640 1 -- 172.21.15.78:0/405488193 >> 172.21.15.78:0/405488193 conn(0x7f63ec0c2350 msgr2=0x7f63ec0c2760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:02:55.750 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:55.744+0000 7f63f2209640 1 -- 172.21.15.78:0/405488193 shutdown_connections 2023-11-28T20:02:55.751 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:55.744+0000 7f63f2209640 1 -- 172.21.15.78:0/405488193 wait complete. 2023-11-28T20:02:55.752 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:55.748+0000 7f63f2209640 1 Processor -- start 2023-11-28T20:02:55.752 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:55.748+0000 7f63f2209640 1 -- start start 2023-11-28T20:02:55.753 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:55.748+0000 7f63f2209640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f63ec06c630 0x7f63ec0a9eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:55.753 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:55.748+0000 7f63f2209640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f63ec0c0ae0 0x7f63ec1eec20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:55.753 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:55.748+0000 7f63f2209640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f63ec155d30 0x7f63ec1f41b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:55.753 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:55.748+0000 7f63f2209640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63ec0a4b80 con 0x7f63ec155d30 2023-11-28T20:02:55.753 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:55.748+0000 7f63f2209640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63ec0aa3f0 con 0x7f63ec06c630 2023-11-28T20:02:55.753 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:55.748+0000 7f63f2209640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f63ec1f50f0 con 0x7f63ec0c0ae0 2023-11-28T20:02:55.753 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:55.748+0000 7f63f1a08640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f63ec155d30 0x7f63ec1f41b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:02:55.754 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:55.748+0000 7f63f1207640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f63ec06c630 0x7f63ec0a9eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:02:55.754 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:55.748+0000 7f63f1a08640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f63ec155d30 0x7f63ec1f41b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:41734/0 (socket says 172.21.15.78:41734) 2023-11-28T20:02:55.754 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:55.748+0000 7f63f1a08640 1 -- 172.21.15.78:0/2495362249 learned_addr learned my addr 172.21.15.78:0/2495362249 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T20:02:55.754 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:55.748+0000 7f63f0a06640 1 --2- 172.21.15.78:0/2495362249 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f63ec0c0ae0 0x7f63ec1eec20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:02:55.754 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:55.748+0000 7f63f1a08640 1 -- 172.21.15.78:0/2495362249 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f63ec0c0ae0 msgr2=0x7f63ec1eec20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:02:55.755 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:55.748+0000 7f63f1a08640 1 --2- 172.21.15.78:0/2495362249 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f63ec0c0ae0 0x7f63ec1eec20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:55.755 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:55.748+0000 7f63f1a08640 1 -- 172.21.15.78:0/2495362249 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f63ec06c630 msgr2=0x7f63ec0a9eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:02:55.755 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:55.748+0000 7f63f1a08640 1 --2- 172.21.15.78:0/2495362249 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f63ec06c630 0x7f63ec0a9eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:55.755 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:55.748+0000 7f63f1a08640 1 -- 172.21.15.78:0/2495362249 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63e80094d0 con 0x7f63ec155d30 2023-11-28T20:02:55.755 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:55.748+0000 7f63f1a08640 1 --2- 172.21.15.78:0/2495362249 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f63ec155d30 0x7f63ec1f41b0 secure :-1 s=READY pgs=1100 cs=0 l=1 rev1=1 crypto rx=0x7f63e400b970 tx=0x7f63e400be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:02:55.758 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:55.748+0000 7f63e1ffb640 1 -- 172.21.15.78:0/2495362249 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63e400cae0 con 0x7f63ec155d30 2023-11-28T20:02:55.759 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:55.748+0000 7f63e1ffb640 1 -- 172.21.15.78:0/2495362249 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f63e400cc40 con 0x7f63ec155d30 2023-11-28T20:02:55.759 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:55.748+0000 7f63f2209640 1 -- 172.21.15.78:0/2495362249 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f63ec1f4e10 con 0x7f63ec155d30 2023-11-28T20:02:55.759 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:55.748+0000 7f63e1ffb640 1 -- 172.21.15.78:0/2495362249 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63e4014680 con 0x7f63ec155d30 2023-11-28T20:02:55.760 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:55.748+0000 7f63f2209640 1 -- 172.21.15.78:0/2495362249 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f63ec0a9990 con 0x7f63ec155d30 2023-11-28T20:02:55.760 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:55.748+0000 7f63f2209640 1 -- 172.21.15.78:0/2495362249 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f63ec0a9bb0 con 0x7f63ec155d30 2023-11-28T20:02:55.760 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:55.752+0000 7f63e1ffb640 1 -- 172.21.15.78:0/2495362249 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f63e401d3b0 con 0x7f63ec155d30 2023-11-28T20:02:55.760 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:55.752+0000 7f63e1ffb640 1 --2- 172.21.15.78:0/2495362249 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f63d00664a0 0x7f63d0068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:55.760 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:55.752+0000 7f63e1ffb640 1 -- 172.21.15.78:0/2495362249 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 7174+0+0 (secure 0 0 0) 0x7f63e4084130 con 0x7f63ec155d30 2023-11-28T20:02:55.761 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:55.752+0000 7f63f1207640 1 --2- 172.21.15.78:0/2495362249 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f63d00664a0 0x7f63d0068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:02:55.761 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:55.752+0000 7f63f1207640 1 --2- 172.21.15.78:0/2495362249 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f63d00664a0 0x7f63d0068960 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f63e80ad000 tx=0x7f63e80a6000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:02:55.761 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:55.756+0000 7f63e1ffb640 1 -- 172.21.15.78:0/2495362249 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f63e4051090 con 0x7f63ec155d30 2023-11-28T20:02:55.942 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:55.936+0000 7f63f2209640 1 -- 172.21.15.78:0/2495362249 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f63ec0674b0 con 0x7f63ec155d30 2023-11-28T20:02:56.580 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:56.576+0000 7f63e1ffb640 1 -- 172.21.15.78:0/2495362249 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v53) v1 ==== 104+0+0 (secure 0 0 0) 0x7f63e40546b0 con 0x7f63ec155d30 2023-11-28T20:02:56.583 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:56.580+0000 7f63f2209640 1 -- 172.21.15.78:0/2495362249 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f63d00664a0 msgr2=0x7f63d0068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:02:56.583 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:56.580+0000 7f63f2209640 1 --2- 172.21.15.78:0/2495362249 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f63d00664a0 0x7f63d0068960 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f63e80ad000 tx=0x7f63e80a6000 comp rx=0 tx=0).stop 2023-11-28T20:02:56.583 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:56.580+0000 7f63f2209640 1 -- 172.21.15.78:0/2495362249 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f63ec155d30 msgr2=0x7f63ec1f41b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:02:56.583 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:56.580+0000 7f63f2209640 1 --2- 172.21.15.78:0/2495362249 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f63ec155d30 0x7f63ec1f41b0 secure :-1 s=READY pgs=1100 cs=0 l=1 rev1=1 crypto rx=0x7f63e400b970 tx=0x7f63e400be30 comp rx=0 tx=0).stop 2023-11-28T20:02:56.583 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:56.580+0000 7f63f2209640 1 -- 172.21.15.78:0/2495362249 shutdown_connections 2023-11-28T20:02:56.584 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:56.580+0000 7f63f2209640 1 --2- 172.21.15.78:0/2495362249 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f63d00664a0 0x7f63d0068960 unknown :-1 s=CLOSED pgs=519 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:56.584 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:56.580+0000 7f63f2209640 1 --2- 172.21.15.78:0/2495362249 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f63ec0c0ae0 0x7f63ec1eec20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:56.584 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:56.580+0000 7f63f2209640 1 --2- 172.21.15.78:0/2495362249 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f63ec155d30 0x7f63ec1f41b0 unknown :-1 s=CLOSED pgs=1100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:56.584 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:56.580+0000 7f63f2209640 1 --2- 172.21.15.78:0/2495362249 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f63ec06c630 0x7f63ec0a9eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:56.584 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:56.580+0000 7f63f2209640 1 -- 172.21.15.78:0/2495362249 >> 172.21.15.78:0/2495362249 conn(0x7f63ec0c2350 msgr2=0x7f63ec1548e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:02:56.584 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:56.580+0000 7f63f2209640 1 -- 172.21.15.78:0/2495362249 shutdown_connections 2023-11-28T20:02:56.584 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:56.580+0000 7f63f2209640 1 -- 172.21.15.78:0/2495362249 wait complete. 2023-11-28T20:02:56.604 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-11-28T20:02:56.789 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:56.784+0000 7f80310c9640 1 Processor -- start 2023-11-28T20:02:56.789 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:56.784+0000 7f80310c9640 1 -- start start 2023-11-28T20:02:56.791 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:56.784+0000 7f80310c9640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f802c14e2a0 0x7f802c1516a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:56.791 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:56.784+0000 7f80310c9640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f802c0a9460 0x7f802c0c4180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:56.791 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:56.784+0000 7f80310c9640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f802c0a98e0 0x7f802c06bc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:56.791 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:56.784+0000 7f80310c9640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f802c151210 con 0x7f802c0a9460 2023-11-28T20:02:56.791 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:56.784+0000 7f80310c9640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f802c14e680 con 0x7f802c0a98e0 2023-11-28T20:02:56.791 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:56.784+0000 7f80310c9640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f802c150be0 con 0x7f802c14e2a0 2023-11-28T20:02:56.792 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:56.784+0000 7f8023fff640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f802c0a9460 0x7f802c0c4180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:02:56.792 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:56.784+0000 7f8023fff640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f802c0a9460 0x7f802c0c4180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:41740/0 (socket says 172.21.15.78:41740) 2023-11-28T20:02:56.792 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:56.784+0000 7f8023fff640 1 -- 172.21.15.78:0/2857999015 learned_addr learned my addr 172.21.15.78:0/2857999015 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T20:02:56.792 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:56.784+0000 7f802b59e640 1 --2- 172.21.15.78:0/2857999015 >> v2:172.21.15.179:3300/0 conn(0x7f802c0a98e0 0x7f802c06bc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:02:56.792 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:56.784+0000 7f802ad9d640 1 --2- 172.21.15.78:0/2857999015 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f802c14e2a0 0x7f802c1516a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:02:56.792 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:56.788+0000 7f8023fff640 1 -- 172.21.15.78:0/2857999015 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f802c14e2a0 msgr2=0x7f802c1516a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:02:56.792 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:56.788+0000 7f8023fff640 1 --2- 172.21.15.78:0/2857999015 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f802c14e2a0 0x7f802c1516a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:56.792 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:56.788+0000 7f8023fff640 1 -- 172.21.15.78:0/2857999015 >> v2:172.21.15.179:3300/0 conn(0x7f802c0a98e0 msgr2=0x7f802c06bc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:02:56.792 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:56.788+0000 7f8023fff640 1 --2- 172.21.15.78:0/2857999015 >> v2:172.21.15.179:3300/0 conn(0x7f802c0a98e0 0x7f802c06bc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:56.792 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:56.788+0000 7f8023fff640 1 -- 172.21.15.78:0/2857999015 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f802c0c53c0 con 0x7f802c0a9460 2023-11-28T20:02:56.793 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:56.788+0000 7f802b59e640 1 --2- 172.21.15.78:0/2857999015 >> v2:172.21.15.179:3300/0 conn(0x7f802c0a98e0 0x7f802c06bc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T20:02:56.793 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:56.788+0000 7f802ad9d640 1 --2- 172.21.15.78:0/2857999015 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f802c14e2a0 0x7f802c1516a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T20:02:56.793 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:56.788+0000 7f8023fff640 1 --2- 172.21.15.78:0/2857999015 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f802c0a9460 0x7f802c0c4180 secure :-1 s=READY pgs=1101 cs=0 l=1 rev1=1 crypto rx=0x7f802c06fb50 tx=0x7f801401d610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=582c53ec2bc3a8e8 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:02:56.794 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:56.788+0000 7f802a59c640 1 -- 172.21.15.78:0/2857999015 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80140ab650 con 0x7f802c0a9460 2023-11-28T20:02:56.794 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:56.788+0000 7f802a59c640 1 -- 172.21.15.78:0/2857999015 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f80140ab7b0 con 0x7f802c0a9460 2023-11-28T20:02:56.794 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:56.788+0000 7f802a59c640 1 -- 172.21.15.78:0/2857999015 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80140abb40 con 0x7f802c0a9460 2023-11-28T20:02:56.795 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:56.788+0000 7f80310c9640 1 -- 172.21.15.78:0/2857999015 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f802c0a9460 msgr2=0x7f802c0c4180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:02:56.795 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:56.788+0000 7f80310c9640 1 --2- 172.21.15.78:0/2857999015 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f802c0a9460 0x7f802c0c4180 secure :-1 s=READY pgs=1101 cs=0 l=1 rev1=1 crypto rx=0x7f802c06fb50 tx=0x7f801401d610 comp rx=0 tx=0).stop 2023-11-28T20:02:56.795 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:56.788+0000 7f80310c9640 1 -- 172.21.15.78:0/2857999015 shutdown_connections 2023-11-28T20:02:56.795 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:56.788+0000 7f80310c9640 1 --2- 172.21.15.78:0/2857999015 >> v2:172.21.15.179:3300/0 conn(0x7f802c0a98e0 0x7f802c06bc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:56.795 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:56.788+0000 7f80310c9640 1 --2- 172.21.15.78:0/2857999015 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f802c0a9460 0x7f802c0c4180 unknown :-1 s=CLOSED pgs=1101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:56.795 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:56.788+0000 7f80310c9640 1 --2- 172.21.15.78:0/2857999015 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f802c14e2a0 0x7f802c1516a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:56.795 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:56.788+0000 7f80310c9640 1 -- 172.21.15.78:0/2857999015 >> 172.21.15.78:0/2857999015 conn(0x7f802c0c59f0 msgr2=0x7f802c0c5e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:02:56.795 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:56.788+0000 7f80310c9640 1 -- 172.21.15.78:0/2857999015 shutdown_connections 2023-11-28T20:02:56.796 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:56.788+0000 7f80310c9640 1 -- 172.21.15.78:0/2857999015 wait complete. 2023-11-28T20:02:56.796 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:56.792+0000 7f80310c9640 1 Processor -- start 2023-11-28T20:02:56.796 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:56.792+0000 7f80310c9640 1 -- start start 2023-11-28T20:02:56.799 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:56.792+0000 7f80310c9640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f802c0a9460 0x7f802c0c19e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:56.799 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:56.792+0000 7f80310c9640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f802c0a98e0 0x7f802c1f08c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:56.799 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:56.792+0000 7f80310c9640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f802c14e2a0 0x7f802c14ecb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:56.799 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:56.792+0000 7f80310c9640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f802c1f0e00 con 0x7f802c0a9460 2023-11-28T20:02:56.800 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:56.792+0000 7f80310c9640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f802c1ed350 con 0x7f802c14e2a0 2023-11-28T20:02:56.800 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:56.792+0000 7f80310c9640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f802c1f10a0 con 0x7f802c0a98e0 2023-11-28T20:02:56.800 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:56.792+0000 7f802ad9d640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f802c0a9460 0x7f802c0c19e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:02:56.800 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:56.792+0000 7f802ad9d640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f802c0a9460 0x7f802c0c19e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:41752/0 (socket says 172.21.15.78:41752) 2023-11-28T20:02:56.800 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:56.792+0000 7f802ad9d640 1 -- 172.21.15.78:0/1625091545 learned_addr learned my addr 172.21.15.78:0/1625091545 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T20:02:56.800 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:56.792+0000 7f802b59e640 1 --2- 172.21.15.78:0/1625091545 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f802c14e2a0 0x7f802c14ecb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:02:56.800 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:56.792+0000 7f8023fff640 1 --2- 172.21.15.78:0/1625091545 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f802c0a98e0 0x7f802c1f08c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:02:56.800 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:56.792+0000 7f802ad9d640 1 -- 172.21.15.78:0/1625091545 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f802c0a98e0 msgr2=0x7f802c1f08c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:02:56.800 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:56.792+0000 7f802ad9d640 1 --2- 172.21.15.78:0/1625091545 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f802c0a98e0 0x7f802c1f08c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:56.801 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:56.792+0000 7f802ad9d640 1 -- 172.21.15.78:0/1625091545 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f802c14e2a0 msgr2=0x7f802c14ecb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:02:56.801 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:56.792+0000 7f802ad9d640 1 --2- 172.21.15.78:0/1625091545 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f802c14e2a0 0x7f802c14ecb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:56.801 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:56.792+0000 7f802ad9d640 1 -- 172.21.15.78:0/1625091545 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80140094d0 con 0x7f802c0a9460 2023-11-28T20:02:56.801 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:56.792+0000 7f802ad9d640 1 --2- 172.21.15.78:0/1625091545 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f802c0a9460 0x7f802c0c19e0 secure :-1 s=READY pgs=1102 cs=0 l=1 rev1=1 crypto rx=0x7f801c00c7f0 tx=0x7f801c00ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:02:56.802 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:56.792+0000 7f80237fe640 1 -- 172.21.15.78:0/1625091545 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f801c007820 con 0x7f802c0a9460 2023-11-28T20:02:56.802 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:56.792+0000 7f80237fe640 1 -- 172.21.15.78:0/1625091545 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f801c007980 con 0x7f802c0a9460 2023-11-28T20:02:56.802 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:56.792+0000 7f80237fe640 1 -- 172.21.15.78:0/1625091545 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f801c007d30 con 0x7f802c0a9460 2023-11-28T20:02:56.802 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:56.792+0000 7f80310c9640 1 -- 172.21.15.78:0/1625091545 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f802c1f1380 con 0x7f802c0a9460 2023-11-28T20:02:56.803 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:56.796+0000 7f80310c9640 1 -- 172.21.15.78:0/1625091545 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f802c1ed610 con 0x7f802c0a9460 2023-11-28T20:02:56.804 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:56.796+0000 7f80310c9640 1 -- 172.21.15.78:0/1625091545 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f802c067630 con 0x7f802c0a9460 2023-11-28T20:02:56.807 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:56.796+0000 7f80237fe640 1 -- 172.21.15.78:0/1625091545 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f801c0113f0 con 0x7f802c0a9460 2023-11-28T20:02:56.807 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:56.796+0000 7f80237fe640 1 --2- 172.21.15.78:0/1625091545 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f800c066470 0x7f800c068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:56.807 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:56.796+0000 7f80237fe640 1 -- 172.21.15.78:0/1625091545 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 7174+0+0 (secure 0 0 0) 0x7f801c084790 con 0x7f802c0a9460 2023-11-28T20:02:56.807 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:56.796+0000 7f8023fff640 1 --2- 172.21.15.78:0/1625091545 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f800c066470 0x7f800c068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:02:56.807 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:56.796+0000 7f8023fff640 1 --2- 172.21.15.78:0/1625091545 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f800c066470 0x7f800c068930 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f80140af000 tx=0x7f8014008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:02:56.808 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:56.800+0000 7f80237fe640 1 -- 172.21.15.78:0/1625091545 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f801c051660 con 0x7f802c0a9460 2023-11-28T20:02:56.961 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:56.956+0000 7f80310c9640 1 -- 172.21.15.78:0/1625091545 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f802c0a7450 con 0x7f802c0a9460 2023-11-28T20:02:57.913 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:57.908+0000 7f80237fe640 1 -- 172.21.15.78:0/1625091545 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v89) v1 ==== 181+0+0 (secure 0 0 0) 0x7f801c054c80 con 0x7f802c0a9460 2023-11-28T20:02:57.913 INFO:teuthology.orchestra.run.smithi078.stderr:pool 'cephfs_metadata' removed 2023-11-28T20:02:57.916 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:57.912+0000 7f80310c9640 1 -- 172.21.15.78:0/1625091545 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f800c066470 msgr2=0x7f800c068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:02:57.916 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:57.912+0000 7f80310c9640 1 --2- 172.21.15.78:0/1625091545 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f800c066470 0x7f800c068930 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f80140af000 tx=0x7f8014008040 comp rx=0 tx=0).stop 2023-11-28T20:02:57.916 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:57.912+0000 7f80310c9640 1 -- 172.21.15.78:0/1625091545 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f802c0a9460 msgr2=0x7f802c0c19e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:02:57.916 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:57.912+0000 7f80310c9640 1 --2- 172.21.15.78:0/1625091545 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f802c0a9460 0x7f802c0c19e0 secure :-1 s=READY pgs=1102 cs=0 l=1 rev1=1 crypto rx=0x7f801c00c7f0 tx=0x7f801c00ccb0 comp rx=0 tx=0).stop 2023-11-28T20:02:57.917 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:57.912+0000 7f80310c9640 1 -- 172.21.15.78:0/1625091545 shutdown_connections 2023-11-28T20:02:57.917 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:57.912+0000 7f80310c9640 1 --2- 172.21.15.78:0/1625091545 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f800c066470 0x7f800c068930 unknown :-1 s=CLOSED pgs=521 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:57.917 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:57.912+0000 7f80310c9640 1 --2- 172.21.15.78:0/1625091545 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f802c0a98e0 0x7f802c1f08c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:57.917 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:57.912+0000 7f80310c9640 1 --2- 172.21.15.78:0/1625091545 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f802c14e2a0 0x7f802c14ecb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:57.917 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:57.912+0000 7f80310c9640 1 --2- 172.21.15.78:0/1625091545 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f802c0a9460 0x7f802c0c19e0 unknown :-1 s=CLOSED pgs=1102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:57.918 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:57.912+0000 7f80310c9640 1 -- 172.21.15.78:0/1625091545 >> 172.21.15.78:0/1625091545 conn(0x7f802c0c59f0 msgr2=0x7f802c14f900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:02:57.918 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:57.912+0000 7f80310c9640 1 -- 172.21.15.78:0/1625091545 shutdown_connections 2023-11-28T20:02:57.918 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:57.912+0000 7f80310c9640 1 -- 172.21.15.78:0/1625091545 wait complete. 2023-11-28T20:02:57.943 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-11-28T20:02:58.088 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:58.084+0000 7fb146b65640 1 Processor -- start 2023-11-28T20:02:58.088 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:58.084+0000 7fb146b65640 1 -- start start 2023-11-28T20:02:58.089 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:58.084+0000 7fb146b65640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fb14014f850 0x7fb1400aacf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:58.090 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:58.084+0000 7fb146b65640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fb14014fc30 0x7fb1400c3cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:58.090 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:58.084+0000 7fb146b65640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb14006d840 0x7fb1400c4210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:58.090 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:58.084+0000 7fb146b65640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb1400c2240 con 0x7fb14014fc30 2023-11-28T20:02:58.090 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:58.084+0000 7fb146b65640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb140152910 con 0x7fb14014f850 2023-11-28T20:02:58.090 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:58.084+0000 7fb146b65640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb140152bf0 con 0x7fb14006d840 2023-11-28T20:02:58.090 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:58.084+0000 7fb137fff640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fb14014fc30 0x7fb1400c3cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:02:58.090 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:58.084+0000 7fb137fff640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fb14014fc30 0x7fb1400c3cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:41768/0 (socket says 172.21.15.78:41768) 2023-11-28T20:02:58.090 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:58.084+0000 7fb137fff640 1 -- 172.21.15.78:0/3398111521 learned_addr learned my addr 172.21.15.78:0/3398111521 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T20:02:58.090 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:58.084+0000 7fb145102640 1 --2- 172.21.15.78:0/3398111521 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb14006d840 0x7fb1400c4210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:02:58.090 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:58.084+0000 7fb144901640 1 --2- 172.21.15.78:0/3398111521 >> v2:172.21.15.179:3300/0 conn(0x7fb14014f850 0x7fb1400aacf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:02:58.091 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:58.084+0000 7fb137fff640 1 -- 172.21.15.78:0/3398111521 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb14006d840 msgr2=0x7fb1400c4210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:02:58.091 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:58.084+0000 7fb137fff640 1 --2- 172.21.15.78:0/3398111521 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb14006d840 0x7fb1400c4210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:58.091 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:58.084+0000 7fb137fff640 1 -- 172.21.15.78:0/3398111521 >> v2:172.21.15.179:3300/0 conn(0x7fb14014f850 msgr2=0x7fb1400aacf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:02:58.091 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:58.084+0000 7fb137fff640 1 --2- 172.21.15.78:0/3398111521 >> v2:172.21.15.179:3300/0 conn(0x7fb14014f850 0x7fb1400aacf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:58.091 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:58.084+0000 7fb137fff640 1 -- 172.21.15.78:0/3398111521 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb140152ed0 con 0x7fb14014fc30 2023-11-28T20:02:58.093 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:58.088+0000 7fb137fff640 1 --2- 172.21.15.78:0/3398111521 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb14014fc30 0x7fb1400c3cd0 secure :-1 s=READY pgs=1103 cs=0 l=1 rev1=1 crypto rx=0x7fb140066f50 tx=0x7fb13001c500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9176f9726e0c135a server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:02:58.094 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:58.088+0000 7fb1377fe640 1 -- 172.21.15.78:0/3398111521 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1300aa640 con 0x7fb14014fc30 2023-11-28T20:02:58.094 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:58.088+0000 7fb1377fe640 1 -- 172.21.15.78:0/3398111521 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb1300aa7a0 con 0x7fb14014fc30 2023-11-28T20:02:58.094 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:58.088+0000 7fb1377fe640 1 -- 172.21.15.78:0/3398111521 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1300aab30 con 0x7fb14014fc30 2023-11-28T20:02:58.094 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:58.088+0000 7fb146b65640 1 -- 172.21.15.78:0/3398111521 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb14014fc30 msgr2=0x7fb1400c3cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:02:58.094 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:58.088+0000 7fb146b65640 1 --2- 172.21.15.78:0/3398111521 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb14014fc30 0x7fb1400c3cd0 secure :-1 s=READY pgs=1103 cs=0 l=1 rev1=1 crypto rx=0x7fb140066f50 tx=0x7fb13001c500 comp rx=0 tx=0).stop 2023-11-28T20:02:58.094 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:58.088+0000 7fb146b65640 1 -- 172.21.15.78:0/3398111521 shutdown_connections 2023-11-28T20:02:58.094 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:58.088+0000 7fb146b65640 1 --2- 172.21.15.78:0/3398111521 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb14006d840 0x7fb1400c4210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:58.095 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:58.088+0000 7fb146b65640 1 --2- 172.21.15.78:0/3398111521 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb14014fc30 0x7fb1400c3cd0 unknown :-1 s=CLOSED pgs=1103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:58.095 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:58.088+0000 7fb146b65640 1 --2- 172.21.15.78:0/3398111521 >> v2:172.21.15.179:3300/0 conn(0x7fb14014f850 0x7fb1400aacf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:58.095 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:58.088+0000 7fb146b65640 1 -- 172.21.15.78:0/3398111521 >> 172.21.15.78:0/3398111521 conn(0x7fb1400c59f0 msgr2=0x7fb1400c5e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:02:58.095 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:58.088+0000 7fb146b65640 1 -- 172.21.15.78:0/3398111521 shutdown_connections 2023-11-28T20:02:58.095 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:58.088+0000 7fb146b65640 1 -- 172.21.15.78:0/3398111521 wait complete. 2023-11-28T20:02:58.096 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:58.092+0000 7fb146b65640 1 Processor -- start 2023-11-28T20:02:58.096 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:58.092+0000 7fb146b65640 1 -- start start 2023-11-28T20:02:58.099 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:58.092+0000 7fb146b65640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb14006d840 0x7fb1400a6910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:58.099 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:58.092+0000 7fb146b65640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb14014f850 0x7fb1401f0a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:58.099 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:58.092+0000 7fb146b65640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb14014fc30 0x7fb1401f0fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:58.099 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:58.092+0000 7fb146b65640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb14014d3d0 con 0x7fb14006d840 2023-11-28T20:02:58.099 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:58.092+0000 7fb146b65640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb14014cdc0 con 0x7fb14014f850 2023-11-28T20:02:58.099 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:58.092+0000 7fb146b65640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb140153930 con 0x7fb14014fc30 2023-11-28T20:02:58.099 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:58.092+0000 7fb144901640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb14006d840 0x7fb1400a6910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:02:58.099 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:58.092+0000 7fb144901640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb14006d840 0x7fb1400a6910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:41774/0 (socket says 172.21.15.78:41774) 2023-11-28T20:02:58.099 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:58.092+0000 7fb144901640 1 -- 172.21.15.78:0/2509654143 learned_addr learned my addr 172.21.15.78:0/2509654143 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T20:02:58.099 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:58.092+0000 7fb145102640 1 --2- 172.21.15.78:0/2509654143 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb14014fc30 0x7fb1401f0fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:02:58.100 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:58.092+0000 7fb137fff640 1 --2- 172.21.15.78:0/2509654143 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb14014f850 0x7fb1401f0a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:02:58.100 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:58.092+0000 7fb144901640 1 -- 172.21.15.78:0/2509654143 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb14014fc30 msgr2=0x7fb1401f0fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:02:58.100 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:58.092+0000 7fb144901640 1 --2- 172.21.15.78:0/2509654143 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb14014fc30 0x7fb1401f0fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:58.100 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:58.092+0000 7fb144901640 1 -- 172.21.15.78:0/2509654143 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb14014f850 msgr2=0x7fb1401f0a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:02:58.100 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:58.092+0000 7fb144901640 1 --2- 172.21.15.78:0/2509654143 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb14014f850 0x7fb1401f0a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:58.100 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:58.092+0000 7fb144901640 1 -- 172.21.15.78:0/2509654143 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1300094d0 con 0x7fb14006d840 2023-11-28T20:02:58.100 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:58.092+0000 7fb144901640 1 --2- 172.21.15.78:0/2509654143 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb14006d840 0x7fb1400a6910 secure :-1 s=READY pgs=1104 cs=0 l=1 rev1=1 crypto rx=0x7fb13c00e930 tx=0x7fb13c00edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:02:58.100 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:58.092+0000 7fb1357fa640 1 -- 172.21.15.78:0/2509654143 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb13c009690 con 0x7fb14006d840 2023-11-28T20:02:58.100 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:58.092+0000 7fb1357fa640 1 -- 172.21.15.78:0/2509654143 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb13c00ca00 con 0x7fb14006d840 2023-11-28T20:02:58.100 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:58.092+0000 7fb146b65640 1 -- 172.21.15.78:0/2509654143 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb14014d060 con 0x7fb14006d840 2023-11-28T20:02:58.100 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:58.092+0000 7fb1357fa640 1 -- 172.21.15.78:0/2509654143 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb13c00cd70 con 0x7fb14006d840 2023-11-28T20:02:58.100 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:58.092+0000 7fb146b65640 1 -- 172.21.15.78:0/2509654143 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb1400a7220 con 0x7fb14006d840 2023-11-28T20:02:58.101 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:58.096+0000 7fb146b65640 1 -- 172.21.15.78:0/2509654143 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb140067630 con 0x7fb14006d840 2023-11-28T20:02:58.101 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:58.096+0000 7fb1357fa640 1 -- 172.21.15.78:0/2509654143 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fb13c013470 con 0x7fb14006d840 2023-11-28T20:02:58.101 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:58.096+0000 7fb1357fa640 1 --2- 172.21.15.78:0/2509654143 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fb12c066470 0x7fb12c068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:58.102 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:58.096+0000 7fb1357fa640 1 -- 172.21.15.78:0/2509654143 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 6736+0+0 (secure 0 0 0) 0x7fb13c084440 con 0x7fb14006d840 2023-11-28T20:02:58.102 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:58.096+0000 7fb137fff640 1 --2- 172.21.15.78:0/2509654143 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fb12c066470 0x7fb12c068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:02:58.102 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:58.096+0000 7fb137fff640 1 --2- 172.21.15.78:0/2509654143 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fb12c066470 0x7fb12c068930 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7fb1300ae000 tx=0x7fb1300a7000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:02:58.105 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:58.100+0000 7fb1357fa640 1 -- 172.21.15.78:0/2509654143 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fb13c051610 con 0x7fb14006d840 2023-11-28T20:02:58.255 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:58.252+0000 7fb146b65640 1 -- 172.21.15.78:0/2509654143 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fb1400a4a90 con 0x7fb14006d840 2023-11-28T20:02:58.920 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:58.916+0000 7fb1357fa640 1 -- 172.21.15.78:0/2509654143 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v90) v1 ==== 169+0+0 (secure 0 0 0) 0x7fb13c054c30 con 0x7fb14006d840 2023-11-28T20:02:58.920 INFO:teuthology.orchestra.run.smithi078.stderr:pool 'cephfs_data' removed 2023-11-28T20:02:58.924 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:58.920+0000 7fb146b65640 1 -- 172.21.15.78:0/2509654143 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fb12c066470 msgr2=0x7fb12c068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:02:58.924 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:58.920+0000 7fb146b65640 1 --2- 172.21.15.78:0/2509654143 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fb12c066470 0x7fb12c068930 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7fb1300ae000 tx=0x7fb1300a7000 comp rx=0 tx=0).stop 2023-11-28T20:02:58.924 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:58.920+0000 7fb146b65640 1 -- 172.21.15.78:0/2509654143 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb14006d840 msgr2=0x7fb1400a6910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:02:58.924 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:58.920+0000 7fb146b65640 1 --2- 172.21.15.78:0/2509654143 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb14006d840 0x7fb1400a6910 secure :-1 s=READY pgs=1104 cs=0 l=1 rev1=1 crypto rx=0x7fb13c00e930 tx=0x7fb13c00edf0 comp rx=0 tx=0).stop 2023-11-28T20:02:58.924 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:58.920+0000 7fb146b65640 1 -- 172.21.15.78:0/2509654143 shutdown_connections 2023-11-28T20:02:58.924 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:58.920+0000 7fb146b65640 1 --2- 172.21.15.78:0/2509654143 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fb12c066470 0x7fb12c068930 unknown :-1 s=CLOSED pgs=522 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:58.925 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:58.920+0000 7fb146b65640 1 --2- 172.21.15.78:0/2509654143 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb14014fc30 0x7fb1401f0fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:58.925 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:58.920+0000 7fb146b65640 1 --2- 172.21.15.78:0/2509654143 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb14014f850 0x7fb1401f0a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:58.925 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:58.920+0000 7fb146b65640 1 --2- 172.21.15.78:0/2509654143 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb14006d840 0x7fb1400a6910 unknown :-1 s=CLOSED pgs=1104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:58.925 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:58.920+0000 7fb146b65640 1 -- 172.21.15.78:0/2509654143 >> 172.21.15.78:0/2509654143 conn(0x7fb1400c59f0 msgr2=0x7fb1401515e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:02:58.925 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:58.920+0000 7fb146b65640 1 -- 172.21.15.78:0/2509654143 shutdown_connections 2023-11-28T20:02:58.925 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:58.920+0000 7fb146b65640 1 -- 172.21.15.78:0/2509654143 wait complete. 2023-11-28T20:02:58.965 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-28T20:02:59.111 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:59.108+0000 7f76f6a32640 1 Processor -- start 2023-11-28T20:02:59.112 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:59.108+0000 7f76f6a32640 1 -- start start 2023-11-28T20:02:59.113 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:59.108+0000 7f76f6a32640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f76f0151ec0 0x7f76f0155100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:59.113 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:59.108+0000 7f76f6a32640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f76f006b320 0x7f76f00c7f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:59.113 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:59.108+0000 7f76f6a32640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f76f0155640 con 0x7f76f00c47c0 2023-11-28T20:02:59.113 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:59.108+0000 7f76f6a32640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f76f00c8aa0 con 0x7f76f006b320 2023-11-28T20:02:59.113 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:59.108+0000 7f76f6a32640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f76f00c9060 con 0x7f76f0151ec0 2023-11-28T20:02:59.113 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:59.108+0000 7f76f4fcf640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f76f006b320 0x7f76f00c7f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:02:59.114 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:59.108+0000 7f76f4fcf640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f76f006b320 0x7f76f00c7f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:41780/0 (socket says 172.21.15.78:41780) 2023-11-28T20:02:59.114 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:59.108+0000 7f76f4fcf640 1 -- 172.21.15.78:0/190909885 learned_addr learned my addr 172.21.15.78:0/190909885 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T20:02:59.114 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:59.108+0000 7f76effff640 1 --2- 172.21.15.78:0/190909885 >> v2:172.21.15.179:3300/0 conn(0x7f76f0151ec0 0x7f76f0155100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:02:59.114 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:59.108+0000 7f76f4fcf640 1 -- 172.21.15.78:0/190909885 >> v2:172.21.15.179:3300/0 conn(0x7f76f0151ec0 msgr2=0x7f76f0155100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:02:59.114 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:59.108+0000 7f76f4fcf640 1 --2- 172.21.15.78:0/190909885 >> v2:172.21.15.179:3300/0 conn(0x7f76f0151ec0 0x7f76f0155100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:59.114 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:59.108+0000 7f76f4fcf640 1 -- 172.21.15.78:0/190909885 >> v1:172.21.15.179:6789/0 conn(0x7f76f00c47c0 legacy=0x7f76f00c94f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:02:59.114 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:59.108+0000 7f76f4fcf640 1 -- 172.21.15.78:0/190909885 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76f00c4d30 con 0x7f76f006b320 2023-11-28T20:02:59.114 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:59.108+0000 7f76effff640 1 --2- 172.21.15.78:0/190909885 >> v2:172.21.15.179:3300/0 conn(0x7f76f0151ec0 0x7f76f0155100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T20:02:59.116 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:59.112+0000 7f76f4fcf640 1 --2- 172.21.15.78:0/190909885 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f76f006b320 0x7f76f00c7f60 secure :-1 s=READY pgs=1105 cs=0 l=1 rev1=1 crypto rx=0x7f76f006a8a0 tx=0x7f76e801c9d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ea3cee39e3884d2c server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:02:59.116 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:59.112+0000 7f76eeffd640 1 -- 172.21.15.78:0/190909885 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76e80a5890 con 0x7f76f006b320 2023-11-28T20:02:59.116 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:59.112+0000 7f76eeffd640 1 -- 172.21.15.78:0/190909885 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f76e80a59f0 con 0x7f76f006b320 2023-11-28T20:02:59.116 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:59.112+0000 7f76eeffd640 1 -- 172.21.15.78:0/190909885 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76e80a5d80 con 0x7f76f006b320 2023-11-28T20:02:59.118 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:59.112+0000 7f76f6a32640 1 -- 172.21.15.78:0/190909885 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f76f006b320 msgr2=0x7f76f00c7f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:02:59.118 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:59.112+0000 7f76f6a32640 1 --2- 172.21.15.78:0/190909885 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f76f006b320 0x7f76f00c7f60 secure :-1 s=READY pgs=1105 cs=0 l=1 rev1=1 crypto rx=0x7f76f006a8a0 tx=0x7f76e801c9d0 comp rx=0 tx=0).stop 2023-11-28T20:02:59.118 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:59.112+0000 7f76f6a32640 1 -- 172.21.15.78:0/190909885 shutdown_connections 2023-11-28T20:02:59.118 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:59.112+0000 7f76f6a32640 1 --2- 172.21.15.78:0/190909885 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f76f006b320 0x7f76f00c7f60 unknown :-1 s=CLOSED pgs=1105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:59.118 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:59.112+0000 7f76f6a32640 1 --2- 172.21.15.78:0/190909885 >> v2:172.21.15.179:3300/0 conn(0x7f76f0151ec0 0x7f76f0155100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:59.118 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:59.112+0000 7f76f6a32640 1 -- 172.21.15.78:0/190909885 >> 172.21.15.78:0/190909885 conn(0x7f76f00c9e40 msgr2=0x7f76f00ca250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:02:59.118 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:59.112+0000 7f76f6a32640 1 -- 172.21.15.78:0/190909885 shutdown_connections 2023-11-28T20:02:59.118 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:59.112+0000 7f76f6a32640 1 -- 172.21.15.78:0/190909885 wait complete. 2023-11-28T20:02:59.119 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:59.112+0000 7f76f6a32640 1 Processor -- start 2023-11-28T20:02:59.119 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:59.116+0000 7f76f6a32640 1 -- start start 2023-11-28T20:02:59.121 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:59.116+0000 7f76f6a32640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f76f006b320 0x7f76f0156e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:59.121 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:59.116+0000 7f76f6a32640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f76f00c47c0 0x7f76f01f0ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:59.121 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:59.116+0000 7f76f6a32640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f76f0151ec0 0x7f76f01f1000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:59.121 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:59.116+0000 7f76f6a32640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76f014fe20 con 0x7f76f006b320 2023-11-28T20:02:59.122 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:59.116+0000 7f76f6a32640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76f0150630 con 0x7f76f0151ec0 2023-11-28T20:02:59.122 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:59.116+0000 7f76f6a32640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f76f0151330 con 0x7f76f00c47c0 2023-11-28T20:02:59.122 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:59.116+0000 7f76effff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f76f006b320 0x7f76f0156e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:02:59.122 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:59.116+0000 7f76effff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f76f006b320 0x7f76f0156e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:41796/0 (socket says 172.21.15.78:41796) 2023-11-28T20:02:59.122 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:59.116+0000 7f76effff640 1 -- 172.21.15.78:0/736098453 learned_addr learned my addr 172.21.15.78:0/736098453 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T20:02:59.122 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:59.116+0000 7f76f4fcf640 1 --2- 172.21.15.78:0/736098453 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f76f0151ec0 0x7f76f01f1000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:02:59.123 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:59.116+0000 7f76ef7fe640 1 --2- 172.21.15.78:0/736098453 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f76f00c47c0 0x7f76f01f0ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:02:59.123 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:59.116+0000 7f76effff640 1 -- 172.21.15.78:0/736098453 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f76f00c47c0 msgr2=0x7f76f01f0ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:02:59.123 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:59.116+0000 7f76effff640 1 --2- 172.21.15.78:0/736098453 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f76f00c47c0 0x7f76f01f0ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:59.123 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:59.116+0000 7f76effff640 1 -- 172.21.15.78:0/736098453 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f76f0151ec0 msgr2=0x7f76f01f1000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:02:59.124 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:59.116+0000 7f76effff640 1 --2- 172.21.15.78:0/736098453 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f76f0151ec0 0x7f76f01f1000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:59.124 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:59.116+0000 7f76effff640 1 -- 172.21.15.78:0/736098453 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76e8009b30 con 0x7f76f006b320 2023-11-28T20:02:59.124 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:59.116+0000 7f76ef7fe640 1 --2- 172.21.15.78:0/736098453 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f76f00c47c0 0x7f76f01f0ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T20:02:59.124 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:59.116+0000 7f76effff640 1 --2- 172.21.15.78:0/736098453 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f76f006b320 0x7f76f0156e90 secure :-1 s=READY pgs=1106 cs=0 l=1 rev1=1 crypto rx=0x7f76e000d800 tx=0x7f76e000dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:02:59.124 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:59.116+0000 7f76ecff9640 1 -- 172.21.15.78:0/736098453 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76e00096c0 con 0x7f76f006b320 2023-11-28T20:02:59.124 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:59.116+0000 7f76ecff9640 1 -- 172.21.15.78:0/736098453 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f76e0009820 con 0x7f76f006b320 2023-11-28T20:02:59.124 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:59.116+0000 7f76f6a32640 1 -- 172.21.15.78:0/736098453 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f76f0150070 con 0x7f76f006b320 2023-11-28T20:02:59.125 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:59.116+0000 7f76ecff9640 1 -- 172.21.15.78:0/736098453 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76e0009bd0 con 0x7f76f006b320 2023-11-28T20:02:59.125 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:59.116+0000 7f76f6a32640 1 -- 172.21.15.78:0/736098453 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f76f0150b30 con 0x7f76f006b320 2023-11-28T20:02:59.126 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:59.116+0000 7f76f6a32640 1 -- 172.21.15.78:0/736098453 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f76f0067630 con 0x7f76f006b320 2023-11-28T20:02:59.126 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:59.120+0000 7f76ecff9640 1 -- 172.21.15.78:0/736098453 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f76e0009d30 con 0x7f76f006b320 2023-11-28T20:02:59.126 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:59.120+0000 7f76ecff9640 1 --2- 172.21.15.78:0/736098453 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f76dc0664a0 0x7f76dc068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:59.126 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:59.120+0000 7f76ecff9640 1 -- 172.21.15.78:0/736098453 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 6206+0+0 (secure 0 0 0) 0x7f76e0084700 con 0x7f76f006b320 2023-11-28T20:02:59.126 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:59.120+0000 7f76ef7fe640 1 --2- 172.21.15.78:0/736098453 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f76dc0664a0 0x7f76dc068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:02:59.126 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:59.120+0000 7f76ef7fe640 1 --2- 172.21.15.78:0/736098453 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f76dc0664a0 0x7f76dc068960 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f76f014f020 tx=0x7f76e4009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:02:59.127 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:59.124+0000 7f76ecff9640 1 -- 172.21.15.78:0/736098453 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f76e0051980 con 0x7f76f006b320 2023-11-28T20:02:59.276 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:59.272+0000 7f76f6a32640 1 -- 172.21.15.78:0/736098453 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f76f006ca00 con 0x7f76f006b320 2023-11-28T20:02:59.277 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:59.272+0000 7f76ecff9640 1 -- 172.21.15.78:0/736098453 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v90) v1 ==== 74+0+16956 (secure 0 0 0) 0x7f76e0054fa0 con 0x7f76f006b320 2023-11-28T20:02:59.278 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-11-28T20:02:59.278 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":90,"fsid":"dd9780e8-3bda-44fa-a9f0-fa07d19d901d","created":"2023-11-28T19:58:40.969556+0000","modified":"2023-11-28T20:02:58.914049+0000","last_up_change":"2023-11-28T19:58:52.596716+0000","last_in_change":"2023-11-28T19:58:43.609275+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":16,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-28T19:58:54.011229+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs2_metadata","create_time":"2023-11-28T20:02:23.066724+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":16,"pool_name":"cephfs2_data","create_time":"2023-11-28T20:02:24.230614+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs2"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e84245ac-b5da-429e-af18-39acaa2b33e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6800","nonce":3358701235},{"type":"v1","addr":"172.21.15.78:6801","nonce":3358701235}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6802","nonce":3358701235},{"type":"v1","addr":"172.21.15.78:6803","nonce":3358701235}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6806","nonce":3358701235},{"type":"v1","addr":"172.21.15.78:6807","nonce":3358701235}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6804","nonce":3358701235},{"type":"v1","addr":"172.21.15.78:6805","nonce":3358701235}]},"public_addr":"172.21.15.78:6801/3358701235","cluster_addr":"172.21.15.78:6803/3358701235","heartbeat_back_addr":"172.21.15.78:6807/3358701235","heartbeat_front_addr":"172.21.15.78:6805/3358701235","state":["exists","up"]},{"osd":1,"uuid":"e634831d-c4e2-48d9-870c-9556ae162981","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6808","nonce":3211476654},{"type":"v1","addr":"172.21.15.78:6809","nonce":3211476654}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6810","nonce":3211476654},{"type":"v1","addr":"172.21.15.78:6811","nonce":3211476654}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6814","nonce":3211476654},{"type":"v1","addr":"172.21.15.78:6815","nonce":3211476654}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6812","nonce":3211476654},{"type":"v1","addr":"172.21.15.78:6813","nonce":3211476654}]},"public_addr":"172.21.15.78:6809/3211476654","cluster_addr":"172.21.15.78:6811/3211476654","heartbeat_back_addr":"172.21.15.78:6815/3211476654","heartbeat_front_addr":"172.21.15.78:6813/3211476654","state":["exists","up"]},{"osd":2,"uuid":"274c8395-6534-41f0-b8fb-a00af8985aa8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6816","nonce":2532904479},{"type":"v1","addr":"172.21.15.78:6817","nonce":2532904479}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6818","nonce":2532904479},{"type":"v1","addr":"172.21.15.78:6819","nonce":2532904479}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6822","nonce":2532904479},{"type":"v1","addr":"172.21.15.78:6823","nonce":2532904479}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6820","nonce":2532904479},{"type":"v1","addr":"172.21.15.78:6821","nonce":2532904479}]},"public_addr":"172.21.15.78:6817/2532904479","cluster_addr":"172.21.15.78:6819/2532904479","heartbeat_back_addr":"172.21.15.78:6823/2532904479","heartbeat_front_addr":"172.21.15.78:6821/2532904479","state":["exists","up"]},{"osd":3,"uuid":"77acc9af-7d4d-4b18-8cf5-d62f5971b7c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6824","nonce":3442991267},{"type":"v1","addr":"172.21.15.78:6825","nonce":3442991267}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6826","nonce":3442991267},{"type":"v1","addr":"172.21.15.78:6827","nonce":3442991267}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6830","nonce":3442991267},{"type":"v1","addr":"172.21.15.78:6831","nonce":3442991267}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6828","nonce":3442991267},{"type":"v1","addr":"172.21.15.78:6829","nonce":3442991267}]},"public_addr":"172.21.15.78:6825/3442991267","cluster_addr":"172.21.15.78:6827/3442991267","heartbeat_back_addr":"172.21.15.78:6831/3442991267","heartbeat_front_addr":"172.21.15.78:6829/3442991267","state":["exists","up"]},{"osd":4,"uuid":"5c62bc66-6b34-4b7f-a66b-9a743969138c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":802983577},{"type":"v1","addr":"172.21.15.179:6809","nonce":802983577}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":802983577},{"type":"v1","addr":"172.21.15.179:6811","nonce":802983577}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":802983577},{"type":"v1","addr":"172.21.15.179:6815","nonce":802983577}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":802983577},{"type":"v1","addr":"172.21.15.179:6813","nonce":802983577}]},"public_addr":"172.21.15.179:6809/802983577","cluster_addr":"172.21.15.179:6811/802983577","heartbeat_back_addr":"172.21.15.179:6815/802983577","heartbeat_front_addr":"172.21.15.179:6813/802983577","state":["exists","up"]},{"osd":5,"uuid":"67db6d36-f684-4079-b0cd-82b4dd61461f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":518192887},{"type":"v1","addr":"172.21.15.179:6818","nonce":518192887}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":518192887},{"type":"v1","addr":"172.21.15.179:6822","nonce":518192887}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":518192887},{"type":"v1","addr":"172.21.15.179:6829","nonce":518192887}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6824","nonce":518192887},{"type":"v1","addr":"172.21.15.179:6826","nonce":518192887}]},"public_addr":"172.21.15.179:6818/518192887","cluster_addr":"172.21.15.179:6822/518192887","heartbeat_back_addr":"172.21.15.179:6829/518192887","heartbeat_front_addr":"172.21.15.179:6826/518192887","state":["exists","up"]},{"osd":6,"uuid":"12e670af-5a16-4c81-9f97-defa66cab967","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":815435378},{"type":"v1","addr":"172.21.15.179:6801","nonce":815435378}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":815435378},{"type":"v1","addr":"172.21.15.179:6803","nonce":815435378}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":815435378},{"type":"v1","addr":"172.21.15.179:6807","nonce":815435378}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":815435378},{"type":"v1","addr":"172.21.15.179:6805","nonce":815435378}]},"public_addr":"172.21.15.179:6801/815435378","cluster_addr":"172.21.15.179:6803/815435378","heartbeat_back_addr":"172.21.15.179:6807/815435378","heartbeat_front_addr":"172.21.15.179:6805/815435378","state":["exists","up"]},{"osd":7,"uuid":"fe630650-2eb3-49ad-8676-c341e6332eb1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6817","nonce":2848432339},{"type":"v1","addr":"172.21.15.179:6819","nonce":2848432339}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6821","nonce":2848432339},{"type":"v1","addr":"172.21.15.179:6823","nonce":2848432339}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":2848432339},{"type":"v1","addr":"172.21.15.179:6831","nonce":2848432339}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6825","nonce":2848432339},{"type":"v1","addr":"172.21.15.179:6827","nonce":2848432339}]},"public_addr":"172.21.15.179:6819/2848432339","cluster_addr":"172.21.15.179:6823/2848432339","heartbeat_back_addr":"172.21.15.179:6831/2848432339","heartbeat_front_addr":"172.21.15.179:6827/2848432339","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:58:49.255433+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:58:49.412880+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:58:49.559295+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:58:49.245237+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:58:49.184557+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:58:49.329851+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:58:49.366012+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:58:49.349604+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"16.1f","mappings":[{"from":5,"to":4}]},{"pgid":"16.26","mappings":[{"from":6,"to":7}]},{"pgid":"16.3a","mappings":[{"from":1,"to":4}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.78:6837/20108235":"2023-11-29T20:02:55.575854+0000","172.21.15.78:6835/20108235":"2023-11-29T20:02:55.575854+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-28T20:02:59.279 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:59.276+0000 7f76f6a32640 1 -- 172.21.15.78:0/736098453 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f76dc0664a0 msgr2=0x7f76dc068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:02:59.280 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:59.276+0000 7f76f6a32640 1 --2- 172.21.15.78:0/736098453 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f76dc0664a0 0x7f76dc068960 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f76f014f020 tx=0x7f76e4009040 comp rx=0 tx=0).stop 2023-11-28T20:02:59.280 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:59.276+0000 7f76f6a32640 1 -- 172.21.15.78:0/736098453 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f76f006b320 msgr2=0x7f76f0156e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:02:59.280 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:59.276+0000 7f76f6a32640 1 --2- 172.21.15.78:0/736098453 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f76f006b320 0x7f76f0156e90 secure :-1 s=READY pgs=1106 cs=0 l=1 rev1=1 crypto rx=0x7f76e000d800 tx=0x7f76e000dcc0 comp rx=0 tx=0).stop 2023-11-28T20:02:59.280 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:59.276+0000 7f76f6a32640 1 -- 172.21.15.78:0/736098453 shutdown_connections 2023-11-28T20:02:59.280 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:59.276+0000 7f76f6a32640 1 --2- 172.21.15.78:0/736098453 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f76dc0664a0 0x7f76dc068960 unknown :-1 s=CLOSED pgs=523 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:59.280 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:59.276+0000 7f76f6a32640 1 --2- 172.21.15.78:0/736098453 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f76f00c47c0 0x7f76f01f0ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:59.280 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:59.276+0000 7f76f6a32640 1 --2- 172.21.15.78:0/736098453 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f76f0151ec0 0x7f76f01f1000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:59.280 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:59.276+0000 7f76f6a32640 1 --2- 172.21.15.78:0/736098453 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f76f006b320 0x7f76f0156e90 unknown :-1 s=CLOSED pgs=1106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:59.280 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:59.276+0000 7f76f6a32640 1 -- 172.21.15.78:0/736098453 >> 172.21.15.78:0/736098453 conn(0x7f76f00c9e40 msgr2=0x7f76f014c480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:02:59.280 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:59.276+0000 7f76f6a32640 1 -- 172.21.15.78:0/736098453 shutdown_connections 2023-11-28T20:02:59.280 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:59.276+0000 7f76f6a32640 1 -- 172.21.15.78:0/736098453 wait complete. 2023-11-28T20:02:59.299 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-28T19:58:54.011229+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 15, 'pool_name': 'cephfs2_metadata', 'create_time': '2023-11-28T20:02:23.066724+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '84', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs2'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 16, 'pool_name': 'cephfs2_data', 'create_time': '2023-11-28T20:02:24.230614+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '85', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs2'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-28T20:02:59.299 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-28T20:02:59.440 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:59.436+0000 7fbf92df5640 1 Processor -- start 2023-11-28T20:02:59.440 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:59.436+0000 7fbf92df5640 1 -- start start 2023-11-28T20:02:59.442 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:59.436+0000 7fbf92df5640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fbf8c14b1e0 0x7fbf8c0c1700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:59.442 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:59.436+0000 7fbf92df5640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbf8c0c5300 0x7fbf8c0a9c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:59.442 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:59.436+0000 7fbf92df5640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbf8c0a4e20 con 0x7fbf8c151280 2023-11-28T20:02:59.442 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:59.436+0000 7fbf92df5640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbf8c1558d0 con 0x7fbf8c14b1e0 2023-11-28T20:02:59.442 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:59.436+0000 7fbf92df5640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbf8c0a50e0 con 0x7fbf8c0c5300 2023-11-28T20:02:59.442 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:59.436+0000 7fbf90b91640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fbf8c14b1e0 0x7fbf8c0c1700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:02:59.442 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:59.436+0000 7fbf8bfff640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbf8c0c5300 0x7fbf8c0a9c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:02:59.442 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:59.436+0000 7fbf90b91640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fbf8c14b1e0 0x7fbf8c0c1700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.78:35376/0 (socket says 172.21.15.78:35376) 2023-11-28T20:02:59.442 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:59.436+0000 7fbf90b91640 1 -- 172.21.15.78:0/3997032754 learned_addr learned my addr 172.21.15.78:0/3997032754 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T20:02:59.442 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:59.436+0000 7fbf91392640 1 --1- 172.21.15.78:0/3997032754 >> v1:172.21.15.179:6789/0 conn(0x7fbf8c151280 0x7fbf8c151710 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.179:6789/0 says I am v1:172.21.15.78:38096/0 (socket says 172.21.15.78:38096) 2023-11-28T20:02:59.443 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:59.436+0000 7fbf90b91640 1 -- 172.21.15.78:0/3997032754 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbf8c0c5300 msgr2=0x7fbf8c0a9c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:02:59.443 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:59.436+0000 7fbf90b91640 1 --2- 172.21.15.78:0/3997032754 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbf8c0c5300 0x7fbf8c0a9c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:59.443 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:59.436+0000 7fbf90b91640 1 -- 172.21.15.78:0/3997032754 >> v1:172.21.15.179:6789/0 conn(0x7fbf8c151280 legacy=0x7fbf8c151710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:02:59.443 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:59.436+0000 7fbf90b91640 1 -- 172.21.15.78:0/3997032754 --> v2:172.21.15.179:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf8c0c0f00 con 0x7fbf8c14b1e0 2023-11-28T20:02:59.443 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:59.436+0000 7fbf8b7fe640 1 -- 172.21.15.78:0/3997032754 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1943445766 0 0) 0x7fbf8c0a4e20 con 0x7fbf8c151280 2023-11-28T20:02:59.445 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:59.440+0000 7fbf90b91640 1 --2- 172.21.15.78:0/3997032754 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbf8c14b1e0 0x7fbf8c0c1700 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7fbf8000bb10 tx=0x7fbf8001ec10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=66aba3a78260ca5 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:02:59.446 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:59.440+0000 7fbf8b7fe640 1 -- 172.21.15.78:0/3997032754 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf800a7af0 con 0x7fbf8c14b1e0 2023-11-28T20:02:59.446 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:59.440+0000 7fbf8b7fe640 1 -- 172.21.15.78:0/3997032754 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf800a7c50 con 0x7fbf8c14b1e0 2023-11-28T20:02:59.446 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:59.440+0000 7fbf8b7fe640 1 -- 172.21.15.78:0/3997032754 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf800af440 con 0x7fbf8c14b1e0 2023-11-28T20:02:59.446 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:59.440+0000 7fbf92df5640 1 -- 172.21.15.78:0/3997032754 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbf8c14b1e0 msgr2=0x7fbf8c0c1700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:02:59.447 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:59.440+0000 7fbf92df5640 1 --2- 172.21.15.78:0/3997032754 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbf8c14b1e0 0x7fbf8c0c1700 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7fbf8000bb10 tx=0x7fbf8001ec10 comp rx=0 tx=0).stop 2023-11-28T20:02:59.447 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:59.440+0000 7fbf92df5640 1 -- 172.21.15.78:0/3997032754 shutdown_connections 2023-11-28T20:02:59.447 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:59.440+0000 7fbf92df5640 1 --2- 172.21.15.78:0/3997032754 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbf8c0c5300 0x7fbf8c0a9c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:59.447 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:59.440+0000 7fbf92df5640 1 --2- 172.21.15.78:0/3997032754 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbf8c14b1e0 0x7fbf8c0c1700 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:59.447 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:59.440+0000 7fbf92df5640 1 -- 172.21.15.78:0/3997032754 >> 172.21.15.78:0/3997032754 conn(0x7fbf8c0c59f0 msgr2=0x7fbf8c0c5e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:02:59.447 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:59.440+0000 7fbf92df5640 1 -- 172.21.15.78:0/3997032754 shutdown_connections 2023-11-28T20:02:59.447 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:59.444+0000 7fbf92df5640 1 -- 172.21.15.78:0/3997032754 wait complete. 2023-11-28T20:02:59.448 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:59.444+0000 7fbf92df5640 1 Processor -- start 2023-11-28T20:02:59.448 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:59.444+0000 7fbf92df5640 1 -- start start 2023-11-28T20:02:59.450 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:59.444+0000 7fbf92df5640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbf8c0c5300 0x7fbf8c0a65d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:59.450 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:59.444+0000 7fbf92df5640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbf8c14b1e0 0x7fbf8c14e290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:59.451 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:59.444+0000 7fbf92df5640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbf8c151280 0x7fbf8c1e8cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:59.451 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:59.444+0000 7fbf92df5640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf8c071610 con 0x7fbf8c151280 2023-11-28T20:02:59.451 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:59.444+0000 7fbf92df5640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf8c072950 con 0x7fbf8c0c5300 2023-11-28T20:02:59.451 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:59.444+0000 7fbf92df5640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbf8c155040 con 0x7fbf8c14b1e0 2023-11-28T20:02:59.451 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:59.444+0000 7fbf91392640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbf8c151280 0x7fbf8c1e8cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:02:59.451 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:59.444+0000 7fbf91392640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbf8c151280 0x7fbf8c1e8cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:41804/0 (socket says 172.21.15.78:41804) 2023-11-28T20:02:59.451 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:59.444+0000 7fbf91392640 1 -- 172.21.15.78:0/1858493358 learned_addr learned my addr 172.21.15.78:0/1858493358 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T20:02:59.451 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:59.444+0000 7fbf90b91640 1 --2- 172.21.15.78:0/1858493358 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbf8c0c5300 0x7fbf8c0a65d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:02:59.451 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:59.444+0000 7fbf8bfff640 1 --2- 172.21.15.78:0/1858493358 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbf8c14b1e0 0x7fbf8c14e290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:02:59.451 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:59.444+0000 7fbf91392640 1 -- 172.21.15.78:0/1858493358 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbf8c14b1e0 msgr2=0x7fbf8c14e290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:02:59.452 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:59.444+0000 7fbf91392640 1 --2- 172.21.15.78:0/1858493358 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbf8c14b1e0 0x7fbf8c14e290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:59.452 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:59.444+0000 7fbf91392640 1 -- 172.21.15.78:0/1858493358 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbf8c0c5300 msgr2=0x7fbf8c0a65d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:02:59.452 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:59.444+0000 7fbf91392640 1 --2- 172.21.15.78:0/1858493358 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbf8c0c5300 0x7fbf8c0a65d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:59.452 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:59.444+0000 7fbf91392640 1 -- 172.21.15.78:0/1858493358 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf8000b770 con 0x7fbf8c151280 2023-11-28T20:02:59.452 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:59.444+0000 7fbf91392640 1 --2- 172.21.15.78:0/1858493358 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbf8c151280 0x7fbf8c1e8cb0 secure :-1 s=READY pgs=1107 cs=0 l=1 rev1=1 crypto rx=0x7fbf8400c780 tx=0x7fbf8400cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:02:59.452 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:59.444+0000 7fbf897fa640 1 -- 172.21.15.78:0/1858493358 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf8400ce30 con 0x7fbf8c151280 2023-11-28T20:02:59.452 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:59.444+0000 7fbf897fa640 1 -- 172.21.15.78:0/1858493358 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf8400a5e0 con 0x7fbf8c151280 2023-11-28T20:02:59.452 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:59.444+0000 7fbf897fa640 1 -- 172.21.15.78:0/1858493358 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf8400a9d0 con 0x7fbf8c151280 2023-11-28T20:02:59.452 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:59.448+0000 7fbf92df5640 1 -- 172.21.15.78:0/1858493358 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbf8c154a80 con 0x7fbf8c151280 2023-11-28T20:02:59.452 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:59.448+0000 7fbf92df5640 1 -- 172.21.15.78:0/1858493358 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbf8c0725e0 con 0x7fbf8c151280 2023-11-28T20:02:59.453 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:59.448+0000 7fbf92df5640 1 -- 172.21.15.78:0/1858493358 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbf8c0c3b60 con 0x7fbf8c151280 2023-11-28T20:02:59.453 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:59.448+0000 7fbf897fa640 1 -- 172.21.15.78:0/1858493358 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fbf8400ab30 con 0x7fbf8c151280 2023-11-28T20:02:59.453 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:59.448+0000 7fbf897fa640 1 --2- 172.21.15.78:0/1858493358 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fbf70066470 0x7fbf70068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:59.453 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:59.448+0000 7fbf897fa640 1 -- 172.21.15.78:0/1858493358 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 6206+0+0 (secure 0 0 0) 0x7fbf84083cc0 con 0x7fbf8c151280 2023-11-28T20:02:59.454 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:59.448+0000 7fbf90b91640 1 --2- 172.21.15.78:0/1858493358 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fbf70066470 0x7fbf70068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:02:59.454 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:59.448+0000 7fbf90b91640 1 --2- 172.21.15.78:0/1858493358 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fbf70066470 0x7fbf70068930 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7fbf800b1000 tx=0x7fbf800a9070 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:02:59.457 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:59.452+0000 7fbf897fa640 1 -- 172.21.15.78:0/1858493358 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fbf84050f60 con 0x7fbf8c151280 2023-11-28T20:02:59.608 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:59.604+0000 7fbf92df5640 1 -- 172.21.15.78:0/1858493358 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fbf8c072b00 con 0x7fbf8c151280 2023-11-28T20:02:59.608 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:59.604+0000 7fbf897fa640 1 -- 172.21.15.78:0/1858493358 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v90) v1 ==== 93+0+10 (secure 0 0 0) 0x7fbf8c072b00 con 0x7fbf8c151280 2023-11-28T20:02:59.608 INFO:teuthology.orchestra.run.smithi078.stdout:pg_num: 1 2023-11-28T20:02:59.610 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:59.604+0000 7fbf92df5640 1 -- 172.21.15.78:0/1858493358 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fbf70066470 msgr2=0x7fbf70068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:02:59.610 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:59.604+0000 7fbf92df5640 1 --2- 172.21.15.78:0/1858493358 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fbf70066470 0x7fbf70068930 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7fbf800b1000 tx=0x7fbf800a9070 comp rx=0 tx=0).stop 2023-11-28T20:02:59.610 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:59.604+0000 7fbf92df5640 1 -- 172.21.15.78:0/1858493358 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbf8c151280 msgr2=0x7fbf8c1e8cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:02:59.610 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:59.604+0000 7fbf92df5640 1 --2- 172.21.15.78:0/1858493358 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbf8c151280 0x7fbf8c1e8cb0 secure :-1 s=READY pgs=1107 cs=0 l=1 rev1=1 crypto rx=0x7fbf8400c780 tx=0x7fbf8400cc40 comp rx=0 tx=0).stop 2023-11-28T20:02:59.611 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:59.604+0000 7fbf92df5640 1 -- 172.21.15.78:0/1858493358 shutdown_connections 2023-11-28T20:02:59.611 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:59.604+0000 7fbf92df5640 1 --2- 172.21.15.78:0/1858493358 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fbf70066470 0x7fbf70068930 unknown :-1 s=CLOSED pgs=524 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:59.611 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:59.604+0000 7fbf92df5640 1 --2- 172.21.15.78:0/1858493358 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbf8c14b1e0 0x7fbf8c14e290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:59.611 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:59.604+0000 7fbf92df5640 1 --2- 172.21.15.78:0/1858493358 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbf8c151280 0x7fbf8c1e8cb0 unknown :-1 s=CLOSED pgs=1107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:59.611 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:59.604+0000 7fbf92df5640 1 --2- 172.21.15.78:0/1858493358 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbf8c0c5300 0x7fbf8c0a65d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:59.611 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:59.604+0000 7fbf92df5640 1 -- 172.21.15.78:0/1858493358 >> 172.21.15.78:0/1858493358 conn(0x7fbf8c0c59f0 msgr2=0x7fbf8c151710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:02:59.611 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:59.604+0000 7fbf92df5640 1 -- 172.21.15.78:0/1858493358 shutdown_connections 2023-11-28T20:02:59.611 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:59.604+0000 7fbf92df5640 1 -- 172.21.15.78:0/1858493358 wait complete. 2023-11-28T20:02:59.629 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs2_metadata pg_num 2023-11-28T20:02:59.770 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:59.764+0000 7fbd17edd640 1 Processor -- start 2023-11-28T20:02:59.771 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:59.768+0000 7fbd17edd640 1 -- start start 2023-11-28T20:02:59.772 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:59.768+0000 7fbd17edd640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbd1014fc30 0x7fbd100c3cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:59.772 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:59.768+0000 7fbd17edd640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fbd1006d840 0x7fbd100c4210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:59.772 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:59.768+0000 7fbd17edd640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbd10152910 con 0x7fbd1014f850 2023-11-28T20:02:59.773 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:59.768+0000 7fbd17edd640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbd100c2240 con 0x7fbd1006d840 2023-11-28T20:02:59.773 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:59.768+0000 7fbd17edd640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd10152bf0 con 0x7fbd1014fc30 2023-11-28T20:02:59.773 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:59.768+0000 7fbd15c79640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7fbd1014f850 0x7fbd100aacf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:51056/0 (socket says 172.21.15.78:51056) 2023-11-28T20:02:59.773 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:59.768+0000 7fbd15c79640 1 -- 172.21.15.78:0/2549863251 learned_addr learned my addr 172.21.15.78:0/2549863251 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-11-28T20:02:59.773 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:59.768+0000 7fbd1647a640 1 --2- 172.21.15.78:0/2549863251 >> v2:172.21.15.179:3300/0 conn(0x7fbd1006d840 0x7fbd100c4210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:02:59.773 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:59.768+0000 7fbd15478640 1 --2- 172.21.15.78:0/2549863251 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbd1014fc30 0x7fbd100c3cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:02:59.773 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:59.768+0000 7fbd14c77640 1 -- 172.21.15.78:0/2549863251 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1572729746 0 0) 0x7fbd10152910 con 0x7fbd1014f850 2023-11-28T20:02:59.773 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:59.768+0000 7fbd14c77640 1 -- 172.21.15.78:0/2549863251 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbcfc003530 con 0x7fbd1014f850 2023-11-28T20:02:59.774 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:59.768+0000 7fbd14c77640 1 -- 172.21.15.78:0/2549863251 <== mon.0 v1:172.21.15.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3238125702 0 0) 0x7fbcfc003530 con 0x7fbd1014f850 2023-11-28T20:02:59.774 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:59.768+0000 7fbd1647a640 1 -- 172.21.15.78:0/2549863251 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbd1014fc30 msgr2=0x7fbd100c3cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:02:59.774 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:59.768+0000 7fbd1647a640 1 --2- 172.21.15.78:0/2549863251 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbd1014fc30 0x7fbd100c3cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:59.774 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:59.768+0000 7fbd1647a640 1 -- 172.21.15.78:0/2549863251 >> v1:172.21.15.78:6789/0 conn(0x7fbd1014f850 legacy=0x7fbd100aacf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:02:59.774 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:59.768+0000 7fbd1647a640 1 -- 172.21.15.78:0/2549863251 --> v2:172.21.15.179:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd10152ed0 con 0x7fbd1006d840 2023-11-28T20:02:59.775 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:59.772+0000 7fbd1647a640 1 --2- 172.21.15.78:0/2549863251 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbd1006d840 0x7fbd100c4210 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7fbd08009d90 tx=0x7fbd0801c870 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ce2a1e2b25a01d7 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:02:59.776 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:59.772+0000 7fbd14c77640 1 -- 172.21.15.78:0/2549863251 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd0c001680 con 0x7fbd1006d840 2023-11-28T20:02:59.776 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:59.772+0000 7fbd14c77640 1 -- 172.21.15.78:0/2549863251 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd080a55a0 con 0x7fbd1006d840 2023-11-28T20:02:59.776 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:59.772+0000 7fbd14c77640 1 -- 172.21.15.78:0/2549863251 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd080a5930 con 0x7fbd1006d840 2023-11-28T20:02:59.777 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:59.772+0000 7fbd17edd640 1 -- 172.21.15.78:0/2549863251 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbd1006d840 msgr2=0x7fbd100c4210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:02:59.777 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:59.772+0000 7fbd17edd640 1 --2- 172.21.15.78:0/2549863251 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbd1006d840 0x7fbd100c4210 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7fbd08009d90 tx=0x7fbd0801c870 comp rx=0 tx=0).stop 2023-11-28T20:02:59.777 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:59.772+0000 7fbd17edd640 1 -- 172.21.15.78:0/2549863251 shutdown_connections 2023-11-28T20:02:59.777 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:59.772+0000 7fbd17edd640 1 --2- 172.21.15.78:0/2549863251 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbd1006d840 0x7fbd100c4210 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:59.777 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:59.772+0000 7fbd17edd640 1 --2- 172.21.15.78:0/2549863251 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbd1014fc30 0x7fbd100c3cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:59.777 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:59.772+0000 7fbd17edd640 1 -- 172.21.15.78:0/2549863251 >> 172.21.15.78:0/2549863251 conn(0x7fbd100c59f0 msgr2=0x7fbd100c5e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:02:59.778 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:59.772+0000 7fbd17edd640 1 -- 172.21.15.78:0/2549863251 shutdown_connections 2023-11-28T20:02:59.778 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:59.772+0000 7fbd17edd640 1 -- 172.21.15.78:0/2549863251 wait complete. 2023-11-28T20:02:59.778 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:59.772+0000 7fbd17edd640 1 Processor -- start 2023-11-28T20:02:59.778 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:59.776+0000 7fbd17edd640 1 -- start start 2023-11-28T20:02:59.780 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:59.776+0000 7fbd17edd640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbd1006d840 0x7fbd1015b480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:59.780 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:59.776+0000 7fbd17edd640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbd1014f850 0x7fbd10146c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:59.781 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:59.776+0000 7fbd17edd640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbd1014fc30 0x7fbd101471a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:59.781 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:59.776+0000 7fbd17edd640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd100a9f70 con 0x7fbd1006d840 2023-11-28T20:02:59.781 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:59.776+0000 7fbd17edd640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd101f0b20 con 0x7fbd1014fc30 2023-11-28T20:02:59.781 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:59.776+0000 7fbd17edd640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd101f0d70 con 0x7fbd1014f850 2023-11-28T20:02:59.781 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:59.776+0000 7fbd15c79640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbd1006d840 0x7fbd1015b480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:02:59.781 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:59.776+0000 7fbd15c79640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbd1006d840 0x7fbd1015b480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:41810/0 (socket says 172.21.15.78:41810) 2023-11-28T20:02:59.781 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:59.776+0000 7fbd15c79640 1 -- 172.21.15.78:0/2701246706 learned_addr learned my addr 172.21.15.78:0/2701246706 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T20:02:59.781 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:59.776+0000 7fbd1647a640 1 --2- 172.21.15.78:0/2701246706 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbd1014fc30 0x7fbd101471a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:02:59.781 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:59.776+0000 7fbd15478640 1 --2- 172.21.15.78:0/2701246706 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbd1014f850 0x7fbd10146c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:02:59.781 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:59.776+0000 7fbd15c79640 1 -- 172.21.15.78:0/2701246706 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbd1014f850 msgr2=0x7fbd10146c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:02:59.781 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:59.776+0000 7fbd15c79640 1 --2- 172.21.15.78:0/2701246706 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbd1014f850 0x7fbd10146c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:59.781 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:59.776+0000 7fbd15c79640 1 -- 172.21.15.78:0/2701246706 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbd1014fc30 msgr2=0x7fbd101471a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:02:59.782 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:59.776+0000 7fbd15c79640 1 --2- 172.21.15.78:0/2701246706 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbd1014fc30 0x7fbd101471a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:59.782 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:59.776+0000 7fbd15c79640 1 -- 172.21.15.78:0/2701246706 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd08009a70 con 0x7fbd1006d840 2023-11-28T20:02:59.782 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:59.776+0000 7fbd15478640 1 --2- 172.21.15.78:0/2701246706 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbd1014f850 0x7fbd10146c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T20:02:59.782 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:59.776+0000 7fbd15c79640 1 --2- 172.21.15.78:0/2701246706 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbd1006d840 0x7fbd1015b480 secure :-1 s=READY pgs=1109 cs=0 l=1 rev1=1 crypto rx=0x7fbd0c00c780 tx=0x7fbd0c00cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:02:59.782 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:59.776+0000 7fbd067fc640 1 -- 172.21.15.78:0/2701246706 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd0c005cf0 con 0x7fbd1006d840 2023-11-28T20:02:59.782 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:59.776+0000 7fbd067fc640 1 -- 172.21.15.78:0/2701246706 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd0c005e50 con 0x7fbd1006d840 2023-11-28T20:02:59.782 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:59.776+0000 7fbd067fc640 1 -- 172.21.15.78:0/2701246706 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd0c0072b0 con 0x7fbd1006d840 2023-11-28T20:02:59.782 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:59.776+0000 7fbd17edd640 1 -- 172.21.15.78:0/2701246706 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbd101f1050 con 0x7fbd1006d840 2023-11-28T20:02:59.782 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:59.776+0000 7fbd17edd640 1 -- 172.21.15.78:0/2701246706 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbd101f1610 con 0x7fbd1006d840 2023-11-28T20:02:59.783 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:59.776+0000 7fbd17edd640 1 -- 172.21.15.78:0/2701246706 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbd10067630 con 0x7fbd1006d840 2023-11-28T20:02:59.783 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:59.780+0000 7fbd067fc640 1 -- 172.21.15.78:0/2701246706 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fbd0c007410 con 0x7fbd1006d840 2023-11-28T20:02:59.783 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:59.780+0000 7fbd067fc640 1 --2- 172.21.15.78:0/2701246706 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fbcf4066470 0x7fbcf4068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:02:59.783 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:59.780+0000 7fbd067fc640 1 -- 172.21.15.78:0/2701246706 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 6206+0+0 (secure 0 0 0) 0x7fbd0c083e20 con 0x7fbd1006d840 2023-11-28T20:02:59.784 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:59.780+0000 7fbd15478640 1 --2- 172.21.15.78:0/2701246706 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fbcf4066470 0x7fbcf4068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:02:59.784 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:59.780+0000 7fbd15478640 1 --2- 172.21.15.78:0/2701246706 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fbcf4066470 0x7fbcf4068930 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7fbd1006d490 tx=0x7fbd00008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:02:59.787 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:59.784+0000 7fbd067fc640 1 -- 172.21.15.78:0/2701246706 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fbd0c051140 con 0x7fbd1006d840 2023-11-28T20:02:59.938 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:59.932+0000 7fbd17edd640 1 -- 172.21.15.78:0/2701246706 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs2_metadata", "var": "pg_num"} v 0) v1 -- 0x7fbd100c1220 con 0x7fbd1006d840 2023-11-28T20:02:59.939 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:59.936+0000 7fbd067fc640 1 -- 172.21.15.78:0/2701246706 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs2_metadata", "var": "pg_num"}]=0 v90) v1 ==== 105+0+11 (secure 0 0 0) 0x7fbd0c054760 con 0x7fbd1006d840 2023-11-28T20:02:59.939 INFO:teuthology.orchestra.run.smithi078.stdout:pg_num: 32 2023-11-28T20:02:59.941 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:59.936+0000 7fbd17edd640 1 -- 172.21.15.78:0/2701246706 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fbcf4066470 msgr2=0x7fbcf4068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:02:59.941 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:59.936+0000 7fbd17edd640 1 --2- 172.21.15.78:0/2701246706 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fbcf4066470 0x7fbcf4068930 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7fbd1006d490 tx=0x7fbd00008040 comp rx=0 tx=0).stop 2023-11-28T20:02:59.941 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:59.936+0000 7fbd17edd640 1 -- 172.21.15.78:0/2701246706 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbd1006d840 msgr2=0x7fbd1015b480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:02:59.941 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:59.936+0000 7fbd17edd640 1 --2- 172.21.15.78:0/2701246706 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbd1006d840 0x7fbd1015b480 secure :-1 s=READY pgs=1109 cs=0 l=1 rev1=1 crypto rx=0x7fbd0c00c780 tx=0x7fbd0c00cc40 comp rx=0 tx=0).stop 2023-11-28T20:02:59.941 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:59.936+0000 7fbd17edd640 1 -- 172.21.15.78:0/2701246706 shutdown_connections 2023-11-28T20:02:59.941 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:59.936+0000 7fbd17edd640 1 --2- 172.21.15.78:0/2701246706 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fbcf4066470 0x7fbcf4068930 unknown :-1 s=CLOSED pgs=525 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:59.942 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:59.936+0000 7fbd17edd640 1 --2- 172.21.15.78:0/2701246706 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbd1014f850 0x7fbd10146c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:59.942 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:59.936+0000 7fbd17edd640 1 --2- 172.21.15.78:0/2701246706 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbd1014fc30 0x7fbd101471a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:59.942 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:59.936+0000 7fbd17edd640 1 --2- 172.21.15.78:0/2701246706 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbd1006d840 0x7fbd1015b480 unknown :-1 s=CLOSED pgs=1109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:02:59.942 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:59.936+0000 7fbd17edd640 1 -- 172.21.15.78:0/2701246706 >> 172.21.15.78:0/2701246706 conn(0x7fbd100c59f0 msgr2=0x7fbd10150330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:02:59.942 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:59.936+0000 7fbd17edd640 1 -- 172.21.15.78:0/2701246706 shutdown_connections 2023-11-28T20:02:59.942 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:02:59.936+0000 7fbd17edd640 1 -- 172.21.15.78:0/2701246706 wait complete. 2023-11-28T20:02:59.960 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs2_data pg_num 2023-11-28T20:03:00.102 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:00.096+0000 7f55cb701640 1 Processor -- start 2023-11-28T20:03:00.102 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:00.096+0000 7f55cb701640 1 -- start start 2023-11-28T20:03:00.103 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:00.100+0000 7f55cb701640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f55c414f850 0x7f55c40aacf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:03:00.103 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:00.100+0000 7f55cb701640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f55c4152910 con 0x7f55c414fc30 2023-11-28T20:03:00.103 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:00.100+0000 7f55cb701640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f55c4152bf0 con 0x7f55c406d840 2023-11-28T20:03:00.103 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:00.100+0000 7f55cb701640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f55c40c2240 con 0x7f55c414f850 2023-11-28T20:03:00.103 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:00.100+0000 7f55c8c9c640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f55c414fc30 0x7f55c40c3cd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:51060/0 (socket says 172.21.15.78:51060) 2023-11-28T20:03:00.103 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:00.100+0000 7f55c8c9c640 1 -- 172.21.15.78:0/3419026557 learned_addr learned my addr 172.21.15.78:0/3419026557 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-11-28T20:03:00.105 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:00.100+0000 7f55c949d640 1 --2- 172.21.15.78:0/3419026557 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f55c414f850 0x7f55c40aacf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:03:00.105 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:00.100+0000 7f55bbfff640 1 -- 172.21.15.78:0/3419026557 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 143912198 0 0) 0x7f55c4152910 con 0x7f55c414fc30 2023-11-28T20:03:00.105 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:00.100+0000 7f55bbfff640 1 -- 172.21.15.78:0/3419026557 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f55b0003530 con 0x7f55c414fc30 2023-11-28T20:03:00.106 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:00.100+0000 7f55bbfff640 1 -- 172.21.15.78:0/3419026557 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2890384295 0 0) 0x7f55c4152bf0 con 0x7f55c406d840 2023-11-28T20:03:00.106 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:00.100+0000 7f55bbfff640 1 -- 172.21.15.78:0/3419026557 --> v1:172.21.15.179:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f55c4152910 con 0x7f55c406d840 2023-11-28T20:03:00.106 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:00.100+0000 7f55bbfff640 1 -- 172.21.15.78:0/3419026557 <== mon.0 v1:172.21.15.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 400702503 0 0) 0x7f55b0003530 con 0x7f55c414fc30 2023-11-28T20:03:00.106 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:00.100+0000 7f55bbfff640 1 -- 172.21.15.78:0/3419026557 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f55c414f850 msgr2=0x7f55c40aacf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:03:00.106 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:00.100+0000 7f55bbfff640 1 --2- 172.21.15.78:0/3419026557 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f55c414f850 0x7f55c40aacf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:03:00.106 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:00.100+0000 7f55bbfff640 1 -- 172.21.15.78:0/3419026557 >> v1:172.21.15.179:6789/0 conn(0x7f55c406d840 legacy=0x7f55c40c43e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:03:00.106 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:00.100+0000 7f55bbfff640 1 -- 172.21.15.78:0/3419026557 --> v1:172.21.15.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55c4152ed0 con 0x7f55c414fc30 2023-11-28T20:03:00.106 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:00.100+0000 7f55bbfff640 1 -- 172.21.15.78:0/3419026557 <== mon.0 v1:172.21.15.78:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3326804700 0 0) 0x7f55b4001680 con 0x7f55c414fc30 2023-11-28T20:03:00.106 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:00.100+0000 7f55bbfff640 1 -- 172.21.15.78:0/3419026557 >> v1:172.21.15.78:6789/0 conn(0x7f55c414fc30 legacy=0x7f55c40c3cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:03:00.106 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:00.100+0000 7f55bbfff640 1 --2- 172.21.15.78:0/3419026557 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f55b0003b40 0x7f55b0003f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:03:00.106 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:00.100+0000 7f55bbfff640 1 --2- 172.21.15.78:0/3419026557 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f55c414f850 0x7f55b00047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:03:00.107 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:00.100+0000 7f55bbfff640 1 --2- 172.21.15.78:0/3419026557 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f55b0004d10 0x7f55b0005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:03:00.107 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:00.100+0000 7f55bbfff640 1 -- 172.21.15.78:0/3419026557 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55c40c2240 con 0x7f55b0004d10 2023-11-28T20:03:00.107 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:00.100+0000 7f55bbfff640 1 -- 172.21.15.78:0/3419026557 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55b000ba90 con 0x7f55b0003b40 2023-11-28T20:03:00.107 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:00.100+0000 7f55bbfff640 1 -- 172.21.15.78:0/3419026557 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f55b000bc50 con 0x7f55c414f850 2023-11-28T20:03:00.107 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:00.100+0000 7f55c9c9e640 1 --2- 172.21.15.78:0/3419026557 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f55b0004d10 0x7f55b0005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:03:00.107 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:00.100+0000 7f55c949d640 1 --2- 172.21.15.78:0/3419026557 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f55b0003b40 0x7f55b0003f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:03:00.107 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:00.100+0000 7f55c8c9c640 1 --2- 172.21.15.78:0/3419026557 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f55c414f850 0x7f55b00047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:03:00.107 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:00.100+0000 7f55c9c9e640 1 -- 172.21.15.78:0/3419026557 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f55c414f850 msgr2=0x7f55b00047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:03:00.107 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:00.100+0000 7f55c9c9e640 1 --2- 172.21.15.78:0/3419026557 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f55c414f850 0x7f55b00047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:03:00.107 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:00.100+0000 7f55c9c9e640 1 -- 172.21.15.78:0/3419026557 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f55b0003b40 msgr2=0x7f55b0003f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:03:00.107 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:00.100+0000 7f55c9c9e640 1 --2- 172.21.15.78:0/3419026557 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f55b0003b40 0x7f55b0003f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:03:00.107 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:00.100+0000 7f55c9c9e640 1 -- 172.21.15.78:0/3419026557 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55b0003530 con 0x7f55b0004d10 2023-11-28T20:03:00.108 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:00.104+0000 7f55c9c9e640 1 --2- 172.21.15.78:0/3419026557 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f55b0004d10 0x7f55b0005190 secure :-1 s=READY pgs=1111 cs=0 l=1 rev1=1 crypto rx=0x7f55c406dc90 tx=0x7f55bc01f030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dc94ef1bf96be4d8 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:03:00.108 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:00.104+0000 7f55bbfff640 1 -- 172.21.15.78:0/3419026557 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55bc0a8c50 con 0x7f55b0004d10 2023-11-28T20:03:00.108 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:00.104+0000 7f55bbfff640 1 -- 172.21.15.78:0/3419026557 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f55bc0a8dd0 con 0x7f55b0004d10 2023-11-28T20:03:00.109 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:00.104+0000 7f55bbfff640 1 -- 172.21.15.78:0/3419026557 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55bc003bc0 con 0x7f55b0004d10 2023-11-28T20:03:00.109 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:00.104+0000 7f55cb701640 1 -- 172.21.15.78:0/3419026557 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f55b0004d10 msgr2=0x7f55b0005190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:03:00.109 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:00.104+0000 7f55cb701640 1 --2- 172.21.15.78:0/3419026557 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f55b0004d10 0x7f55b0005190 secure :-1 s=READY pgs=1111 cs=0 l=1 rev1=1 crypto rx=0x7f55c406dc90 tx=0x7f55bc01f030 comp rx=0 tx=0).stop 2023-11-28T20:03:00.109 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:00.104+0000 7f55c9c9e640 1 -- 172.21.15.78:0/3419026557 reap_dead start 2023-11-28T20:03:00.109 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:00.104+0000 7f55cb701640 1 -- 172.21.15.78:0/3419026557 shutdown_connections 2023-11-28T20:03:00.109 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:00.104+0000 7f55cb701640 1 -- 172.21.15.78:0/3419026557 >> 172.21.15.78:0/3419026557 conn(0x7f55c40c59f0 msgr2=0x7f55c40c5e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:03:00.109 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:00.104+0000 7f55cb701640 1 -- 172.21.15.78:0/3419026557 shutdown_connections 2023-11-28T20:03:00.110 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:00.104+0000 7f55cb701640 1 -- 172.21.15.78:0/3419026557 wait complete. 2023-11-28T20:03:00.110 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:00.104+0000 7f55cb701640 1 Processor -- start 2023-11-28T20:03:00.110 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:00.108+0000 7f55cb701640 1 -- start start 2023-11-28T20:03:00.113 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:00.108+0000 7f55cb701640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f55b0004d10 0x7f55c40a7000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:03:00.114 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:00.108+0000 7f55cb701640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f55c4149ba0 0x7f55c41dbdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:03:00.114 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:00.108+0000 7f55cb701640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f55c4148ef0 0x7f55c4149370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:03:00.114 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:00.108+0000 7f55cb701640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55c40a5f20 con 0x7f55b0004d10 2023-11-28T20:03:00.114 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:00.108+0000 7f55cb701640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55c4156890 con 0x7f55c4148ef0 2023-11-28T20:03:00.114 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:00.108+0000 7f55cb701640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f55c41edb20 con 0x7f55c4149ba0 2023-11-28T20:03:00.114 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:00.108+0000 7f55c949d640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f55b0004d10 0x7f55c40a7000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:03:00.114 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:00.108+0000 7f55c949d640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f55b0004d10 0x7f55c40a7000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:41830/0 (socket says 172.21.15.78:41830) 2023-11-28T20:03:00.114 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:00.108+0000 7f55c949d640 1 -- 172.21.15.78:0/2470717659 learned_addr learned my addr 172.21.15.78:0/2470717659 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T20:03:00.114 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:00.108+0000 7f55c9c9e640 1 --2- 172.21.15.78:0/2470717659 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f55c4148ef0 0x7f55c4149370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:03:00.114 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:00.108+0000 7f55c8c9c640 1 --2- 172.21.15.78:0/2470717659 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f55c4149ba0 0x7f55c41dbdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:03:00.114 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:00.108+0000 7f55c949d640 1 -- 172.21.15.78:0/2470717659 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f55c4149ba0 msgr2=0x7f55c41dbdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:03:00.115 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:00.108+0000 7f55c949d640 1 --2- 172.21.15.78:0/2470717659 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f55c4149ba0 0x7f55c41dbdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:03:00.115 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:00.108+0000 7f55c949d640 1 -- 172.21.15.78:0/2470717659 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f55c4148ef0 msgr2=0x7f55c4149370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:03:00.115 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:00.108+0000 7f55c949d640 1 --2- 172.21.15.78:0/2470717659 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f55c4148ef0 0x7f55c4149370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:03:00.115 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:00.108+0000 7f55c949d640 1 -- 172.21.15.78:0/2470717659 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55c41ede00 con 0x7f55b0004d10 2023-11-28T20:03:00.115 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:00.108+0000 7f55c9c9e640 1 --2- 172.21.15.78:0/2470717659 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f55c4148ef0 0x7f55c4149370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T20:03:00.115 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:00.108+0000 7f55c8c9c640 1 --2- 172.21.15.78:0/2470717659 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f55c4149ba0 0x7f55c41dbdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T20:03:00.115 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:00.108+0000 7f55c949d640 1 --2- 172.21.15.78:0/2470717659 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f55b0004d10 0x7f55c40a7000 secure :-1 s=READY pgs=1112 cs=0 l=1 rev1=1 crypto rx=0x7f55c00119d0 tx=0x7f55c0011e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:03:00.115 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:00.108+0000 7f55b9ffb640 1 -- 172.21.15.78:0/2470717659 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55c000fb50 con 0x7f55b0004d10 2023-11-28T20:03:00.115 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:00.108+0000 7f55b9ffb640 1 -- 172.21.15.78:0/2470717659 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f55c000fcb0 con 0x7f55b0004d10 2023-11-28T20:03:00.115 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:00.108+0000 7f55b9ffb640 1 -- 172.21.15.78:0/2470717659 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55c0014440 con 0x7f55b0004d10 2023-11-28T20:03:00.115 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:00.108+0000 7f55cb701640 1 -- 172.21.15.78:0/2470717659 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f55c40a6170 con 0x7f55b0004d10 2023-11-28T20:03:00.116 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:00.108+0000 7f55cb701640 1 -- 172.21.15.78:0/2470717659 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f55c41dc330 con 0x7f55b0004d10 2023-11-28T20:03:00.116 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:00.108+0000 7f55cb701640 1 -- 172.21.15.78:0/2470717659 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f55c4067630 con 0x7f55b0004d10 2023-11-28T20:03:00.116 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:00.112+0000 7f55b9ffb640 1 -- 172.21.15.78:0/2470717659 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f55c00145a0 con 0x7f55b0004d10 2023-11-28T20:03:00.117 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:00.112+0000 7f55b9ffb640 1 --2- 172.21.15.78:0/2470717659 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f55a8066470 0x7f55a8068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:03:00.117 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:00.112+0000 7f55b9ffb640 1 -- 172.21.15.78:0/2470717659 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 6206+0+0 (secure 0 0 0) 0x7f55c00848a0 con 0x7f55b0004d10 2023-11-28T20:03:00.117 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:00.112+0000 7f55c8c9c640 1 --2- 172.21.15.78:0/2470717659 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f55a8066470 0x7f55a8068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:03:00.117 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:00.112+0000 7f55c8c9c640 1 --2- 172.21.15.78:0/2470717659 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f55a8066470 0x7f55a8068930 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f55c414a320 tx=0x7f55b4009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:03:00.121 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:00.116+0000 7f55b9ffb640 1 -- 172.21.15.78:0/2470717659 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f55c0051c80 con 0x7f55b0004d10 2023-11-28T20:03:00.271 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:00.268+0000 7f55cb701640 1 -- 172.21.15.78:0/2470717659 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs2_data", "var": "pg_num"} v 0) v1 -- 0x7f55c41edf90 con 0x7f55b0004d10 2023-11-28T20:03:00.271 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:00.268+0000 7f55b9ffb640 1 -- 172.21.15.78:0/2470717659 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs2_data", "var": "pg_num"}]=0 v90) v1 ==== 101+0+11 (secure 0 0 0) 0x7f55c00552a0 con 0x7f55b0004d10 2023-11-28T20:03:00.271 INFO:teuthology.orchestra.run.smithi078.stdout:pg_num: 64 2023-11-28T20:03:00.273 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:00.268+0000 7f55cb701640 1 -- 172.21.15.78:0/2470717659 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f55a8066470 msgr2=0x7f55a8068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:03:00.273 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:00.268+0000 7f55cb701640 1 --2- 172.21.15.78:0/2470717659 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f55a8066470 0x7f55a8068930 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f55c414a320 tx=0x7f55b4009040 comp rx=0 tx=0).stop 2023-11-28T20:03:00.274 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:00.268+0000 7f55cb701640 1 -- 172.21.15.78:0/2470717659 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f55b0004d10 msgr2=0x7f55c40a7000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:03:00.274 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:00.268+0000 7f55cb701640 1 --2- 172.21.15.78:0/2470717659 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f55b0004d10 0x7f55c40a7000 secure :-1 s=READY pgs=1112 cs=0 l=1 rev1=1 crypto rx=0x7f55c00119d0 tx=0x7f55c0011e90 comp rx=0 tx=0).stop 2023-11-28T20:03:00.274 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:00.268+0000 7f55cb701640 1 -- 172.21.15.78:0/2470717659 shutdown_connections 2023-11-28T20:03:00.274 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:00.268+0000 7f55cb701640 1 --2- 172.21.15.78:0/2470717659 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f55a8066470 0x7f55a8068930 unknown :-1 s=CLOSED pgs=526 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:03:00.274 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:00.268+0000 7f55cb701640 1 --2- 172.21.15.78:0/2470717659 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f55c4149ba0 0x7f55c41dbdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:03:00.274 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:00.268+0000 7f55cb701640 1 --2- 172.21.15.78:0/2470717659 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f55c4148ef0 0x7f55c4149370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:03:00.274 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:00.268+0000 7f55cb701640 1 --2- 172.21.15.78:0/2470717659 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f55b0004d10 0x7f55c40a7000 unknown :-1 s=CLOSED pgs=1112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:03:00.274 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:00.268+0000 7f55cb701640 1 -- 172.21.15.78:0/2470717659 >> 172.21.15.78:0/2470717659 conn(0x7f55c40c59f0 msgr2=0x7f55c406cd50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:03:00.274 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:00.268+0000 7f55cb701640 1 -- 172.21.15.78:0/2470717659 shutdown_connections 2023-11-28T20:03:00.274 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:00.268+0000 7f55cb701640 1 -- 172.21.15.78:0/2470717659 wait complete. 2023-11-28T20:03:00.292 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-28T20:03:00.429 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:00.424+0000 7f685bc5a640 1 Processor -- start 2023-11-28T20:03:00.429 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:00.424+0000 7f685bc5a640 1 -- start start 2023-11-28T20:03:00.430 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:00.424+0000 7f685bc5a640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f685414e3f0 0x7f68540bfce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:03:00.430 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:00.424+0000 7f685bc5a640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6854151690 con 0x7f685406bef0 2023-11-28T20:03:00.430 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:00.424+0000 7f685bc5a640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6854151bc0 con 0x7f685406c5b0 2023-11-28T20:03:00.430 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:00.424+0000 7f685bc5a640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f68541518e0 con 0x7f685414e3f0 2023-11-28T20:03:00.430 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:00.424+0000 7f68591f5640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f685406bef0 0x7f68540c41f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:51064/0 (socket says 172.21.15.78:51064) 2023-11-28T20:03:00.431 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:00.424+0000 7f68591f5640 1 -- 172.21.15.78:0/2823406331 learned_addr learned my addr 172.21.15.78:0/2823406331 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-11-28T20:03:00.433 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:00.428+0000 7f68589f4640 1 -- 172.21.15.78:0/2823406331 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3854018116 0 0) 0x7f6854151690 con 0x7f685406bef0 2023-11-28T20:03:00.433 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:00.428+0000 7f68589f4640 1 -- 172.21.15.78:0/2823406331 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6840003530 con 0x7f685406bef0 2023-11-28T20:03:00.433 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:00.428+0000 7f68599f6640 1 --2- 172.21.15.78:0/2823406331 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f685414e3f0 0x7f68540bfce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:03:00.433 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:00.428+0000 7f68589f4640 1 -- 172.21.15.78:0/2823406331 <== mon.0 v1:172.21.15.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3227267428 0 0) 0x7f6840003530 con 0x7f685406bef0 2023-11-28T20:03:00.433 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:00.428+0000 7f68589f4640 1 -- 172.21.15.78:0/2823406331 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f685414e3f0 msgr2=0x7f68540bfce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:03:00.433 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:00.428+0000 7f68589f4640 1 --2- 172.21.15.78:0/2823406331 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f685414e3f0 0x7f68540bfce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:03:00.433 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:00.428+0000 7f68589f4640 1 -- 172.21.15.78:0/2823406331 >> v1:172.21.15.179:6789/0 conn(0x7f685406c5b0 legacy=0x7f685406ca40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:03:00.433 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:00.428+0000 7f68589f4640 1 -- 172.21.15.78:0/2823406331 --> v1:172.21.15.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68540c1de0 con 0x7f685406bef0 2023-11-28T20:03:00.433 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:00.428+0000 7f68589f4640 1 -- 172.21.15.78:0/2823406331 <== mon.0 v1:172.21.15.78:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3326804700 0 0) 0x7f6844001680 con 0x7f685406bef0 2023-11-28T20:03:00.433 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:00.428+0000 7f68589f4640 1 -- 172.21.15.78:0/2823406331 >> v1:172.21.15.78:6789/0 conn(0x7f685406bef0 legacy=0x7f68540c41f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:03:00.434 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:00.428+0000 7f68589f4640 1 --2- 172.21.15.78:0/2823406331 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f685414e3f0 0x7f68400039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:03:00.434 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:00.428+0000 7f68589f4640 1 --2- 172.21.15.78:0/2823406331 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6840003f30 0x7f68400047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:03:00.434 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:00.428+0000 7f68589f4640 1 --2- 172.21.15.78:0/2823406331 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6840004d10 0x7f6840005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:03:00.434 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:00.428+0000 7f68589f4640 1 -- 172.21.15.78:0/2823406331 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68541518e0 con 0x7f6840003f30 2023-11-28T20:03:00.434 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:00.428+0000 7f68589f4640 1 -- 172.21.15.78:0/2823406331 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f684000bb20 con 0x7f6840004d10 2023-11-28T20:03:00.434 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:00.428+0000 7f68589f4640 1 -- 172.21.15.78:0/2823406331 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f684000def0 con 0x7f685414e3f0 2023-11-28T20:03:00.434 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:00.428+0000 7f68591f5640 1 --2- 172.21.15.78:0/2823406331 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6840003f30 0x7f68400047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:03:00.434 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:00.428+0000 7f68599f6640 1 --2- 172.21.15.78:0/2823406331 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f685414e3f0 0x7f68400039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:03:00.434 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:00.428+0000 7f685a1f7640 1 --2- 172.21.15.78:0/2823406331 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6840004d10 0x7f6840005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:03:00.434 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:00.428+0000 7f68591f5640 1 -- 172.21.15.78:0/2823406331 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f685414e3f0 msgr2=0x7f68400039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:03:00.434 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:00.428+0000 7f68591f5640 1 --2- 172.21.15.78:0/2823406331 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f685414e3f0 0x7f68400039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:03:00.435 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:00.428+0000 7f68591f5640 1 -- 172.21.15.78:0/2823406331 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6840004d10 msgr2=0x7f6840005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:03:00.435 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:00.428+0000 7f68591f5640 1 --2- 172.21.15.78:0/2823406331 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6840004d10 0x7f6840005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:03:00.435 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:00.428+0000 7f68591f5640 1 -- 172.21.15.78:0/2823406331 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6840003530 con 0x7f6840003f30 2023-11-28T20:03:00.436 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:00.432+0000 7f68591f5640 1 --2- 172.21.15.78:0/2823406331 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6840003f30 0x7f68400047d0 secure :-1 s=READY pgs=1114 cs=0 l=1 rev1=1 crypto rx=0x7f684400c240 tx=0x7f684401cc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c419f914f9fb18b6 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:03:00.436 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:00.432+0000 7f68589f4640 1 -- 172.21.15.78:0/2823406331 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6844005ae0 con 0x7f6840003f30 2023-11-28T20:03:00.436 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:00.432+0000 7f68589f4640 1 -- 172.21.15.78:0/2823406331 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6844005c40 con 0x7f6840003f30 2023-11-28T20:03:00.436 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:00.432+0000 7f68589f4640 1 -- 172.21.15.78:0/2823406331 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68440a5780 con 0x7f6840003f30 2023-11-28T20:03:00.436 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:00.432+0000 7f685bc5a640 1 -- 172.21.15.78:0/2823406331 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6840003f30 msgr2=0x7f68400047d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:03:00.436 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:00.432+0000 7f685bc5a640 1 --2- 172.21.15.78:0/2823406331 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6840003f30 0x7f68400047d0 secure :-1 s=READY pgs=1114 cs=0 l=1 rev1=1 crypto rx=0x7f684400c240 tx=0x7f684401cc10 comp rx=0 tx=0).stop 2023-11-28T20:03:00.437 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:00.432+0000 7f685a1f7640 1 -- 172.21.15.78:0/2823406331 reap_dead start 2023-11-28T20:03:00.437 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:00.432+0000 7f685bc5a640 1 -- 172.21.15.78:0/2823406331 shutdown_connections 2023-11-28T20:03:00.437 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:00.432+0000 7f685bc5a640 1 -- 172.21.15.78:0/2823406331 >> 172.21.15.78:0/2823406331 conn(0x7f68540a7810 msgr2=0x7f68540a7c20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:03:00.437 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:00.432+0000 7f685bc5a640 1 -- 172.21.15.78:0/2823406331 shutdown_connections 2023-11-28T20:03:00.437 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:00.432+0000 7f685bc5a640 1 -- 172.21.15.78:0/2823406331 wait complete. 2023-11-28T20:03:00.437 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:00.432+0000 7f685bc5a640 1 Processor -- start 2023-11-28T20:03:00.438 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:00.432+0000 7f685bc5a640 1 -- start start 2023-11-28T20:03:00.439 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:00.432+0000 7f685bc5a640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6840003f30 0x7f68541ec7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:03:00.439 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:00.432+0000 7f685bc5a640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f68540a8b10 0x7f6854149600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:03:00.439 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:00.432+0000 7f685bc5a640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f68541ecd30 0x7f6854149b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:03:00.439 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:00.432+0000 7f685bc5a640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f685414a080 con 0x7f6840003f30 2023-11-28T20:03:00.439 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:00.432+0000 7f685bc5a640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68540a9e80 con 0x7f68540a8b10 2023-11-28T20:03:00.439 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:00.432+0000 7f685bc5a640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f68541524a0 con 0x7f68541ecd30 2023-11-28T20:03:00.440 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:00.436+0000 7f68599f6640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6840003f30 0x7f68541ec7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:03:00.440 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:00.436+0000 7f68599f6640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6840003f30 0x7f68541ec7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:41846/0 (socket says 172.21.15.78:41846) 2023-11-28T20:03:00.440 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:00.436+0000 7f68599f6640 1 -- 172.21.15.78:0/2910887817 learned_addr learned my addr 172.21.15.78:0/2910887817 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T20:03:00.440 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:00.436+0000 7f685a1f7640 1 --2- 172.21.15.78:0/2910887817 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f68541ecd30 0x7f6854149b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:03:00.440 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:00.436+0000 7f68591f5640 1 --2- 172.21.15.78:0/2910887817 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f68540a8b10 0x7f6854149600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:03:00.440 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:00.436+0000 7f68599f6640 1 -- 172.21.15.78:0/2910887817 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f68541ecd30 msgr2=0x7f6854149b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:03:00.440 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:00.436+0000 7f68599f6640 1 --2- 172.21.15.78:0/2910887817 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f68541ecd30 0x7f6854149b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:03:00.440 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:00.436+0000 7f68599f6640 1 -- 172.21.15.78:0/2910887817 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f68540a8b10 msgr2=0x7f6854149600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:03:00.440 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:00.436+0000 7f68599f6640 1 --2- 172.21.15.78:0/2910887817 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f68540a8b10 0x7f6854149600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:03:00.440 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:00.436+0000 7f68599f6640 1 -- 172.21.15.78:0/2910887817 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6854152740 con 0x7f6840003f30 2023-11-28T20:03:00.440 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:00.436+0000 7f68591f5640 1 --2- 172.21.15.78:0/2910887817 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f68540a8b10 0x7f6854149600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T20:03:00.441 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:00.436+0000 7f68599f6640 1 --2- 172.21.15.78:0/2910887817 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6840003f30 0x7f68541ec7f0 secure :-1 s=READY pgs=1115 cs=0 l=1 rev1=1 crypto rx=0x7f68500119d0 tx=0x7f6850011e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:03:00.441 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:00.436+0000 7f684a7fc640 1 -- 172.21.15.78:0/2910887817 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f685000fb50 con 0x7f6840003f30 2023-11-28T20:03:00.442 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:00.436+0000 7f684a7fc640 1 -- 172.21.15.78:0/2910887817 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f685000fcb0 con 0x7f6840003f30 2023-11-28T20:03:00.442 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:00.436+0000 7f685bc5a640 1 -- 172.21.15.78:0/2910887817 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f68541ed280 con 0x7f6840003f30 2023-11-28T20:03:00.442 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:00.436+0000 7f684a7fc640 1 -- 172.21.15.78:0/2910887817 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6850014440 con 0x7f6840003f30 2023-11-28T20:03:00.442 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:00.436+0000 7f685bc5a640 1 -- 172.21.15.78:0/2910887817 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6854152a90 con 0x7f6840003f30 2023-11-28T20:03:00.442 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:00.436+0000 7f685bc5a640 1 -- 172.21.15.78:0/2910887817 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f68541541d0 con 0x7f6840003f30 2023-11-28T20:03:00.442 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:00.436+0000 7f684a7fc640 1 -- 172.21.15.78:0/2910887817 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f68500145a0 con 0x7f6840003f30 2023-11-28T20:03:00.443 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:00.436+0000 7f684a7fc640 1 --2- 172.21.15.78:0/2910887817 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f68380664a0 0x7f6838068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:03:00.443 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:00.440+0000 7f684a7fc640 1 -- 172.21.15.78:0/2910887817 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 6206+0+0 (secure 0 0 0) 0x7f6850084840 con 0x7f6840003f30 2023-11-28T20:03:00.443 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:00.440+0000 7f68591f5640 1 --2- 172.21.15.78:0/2910887817 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f68380664a0 0x7f6838068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:03:00.443 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:00.440+0000 7f68591f5640 1 --2- 172.21.15.78:0/2910887817 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f68380664a0 0x7f6838068960 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7f684400c240 tx=0x7f68440a7070 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:03:00.446 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:00.440+0000 7f684a7fc640 1 -- 172.21.15.78:0/2910887817 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f6850051b80 con 0x7f6840003f30 2023-11-28T20:03:00.627 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:00.624+0000 7f685bc5a640 1 -- 172.21.15.78:0/2910887817 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f6854067630 con 0x7f6840003f30 2023-11-28T20:03:00.628 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:00.624+0000 7f684a7fc640 1 -- 172.21.15.78:0/2910887817 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 53 v53) v1 ==== 94+0+4923 (secure 0 0 0) 0x7f68500551a0 con 0x7f6840003f30 2023-11-28T20:03:00.628 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-11-28T20:03:00.628 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":53,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5834,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6834/3259525552","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6832","nonce":3259525552},{"type":"v1","addr":"172.21.15.179:6834","nonce":3259525552}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":41},{"gid":6466,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6836/3096284673","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6834","nonce":3096284673},{"type":"v1","addr":"172.21.15.78:6836","nonce":3096284673}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":41},{"gid":7320,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6837/1031394527","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6835","nonce":1031394527},{"type":"v1","addr":"172.21.15.78:6837","nonce":1031394527}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":53}],"filesystems":[{"mdsmap":{"epoch":51,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-28T20:02:25.231135+0000","modified":"2023-11-28T20:02:28.250515+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":6478},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6478":{"gid":6478,"name":"b","rank":0,"incarnation":47,"state":"up:active","state_seq":7,"addr":"172.21.15.179:6835/2749579094","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6833","nonce":2749579094},{"type":"v1","addr":"172.21.15.179:6835","nonce":2749579094}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs2","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":7}]} 2023-11-28T20:03:00.629 INFO:teuthology.orchestra.run.smithi078.stderr:dumped fsmap epoch 53 2023-11-28T20:03:00.629 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:00.624+0000 7f685bc5a640 1 -- 172.21.15.78:0/2910887817 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f68380664a0 msgr2=0x7f6838068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:03:00.630 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:00.624+0000 7f685bc5a640 1 --2- 172.21.15.78:0/2910887817 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f68380664a0 0x7f6838068960 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7f684400c240 tx=0x7f68440a7070 comp rx=0 tx=0).stop 2023-11-28T20:03:00.630 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:00.624+0000 7f685bc5a640 1 -- 172.21.15.78:0/2910887817 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6840003f30 msgr2=0x7f68541ec7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:03:00.630 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:00.624+0000 7f685bc5a640 1 --2- 172.21.15.78:0/2910887817 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6840003f30 0x7f68541ec7f0 secure :-1 s=READY pgs=1115 cs=0 l=1 rev1=1 crypto rx=0x7f68500119d0 tx=0x7f6850011e90 comp rx=0 tx=0).stop 2023-11-28T20:03:00.630 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:00.624+0000 7f685bc5a640 1 -- 172.21.15.78:0/2910887817 shutdown_connections 2023-11-28T20:03:00.630 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:00.624+0000 7f685bc5a640 1 --2- 172.21.15.78:0/2910887817 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f68380664a0 0x7f6838068960 unknown :-1 s=CLOSED pgs=527 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:03:00.630 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:00.624+0000 7f685bc5a640 1 --2- 172.21.15.78:0/2910887817 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f68541ecd30 0x7f6854149b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:03:00.630 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:00.624+0000 7f685bc5a640 1 --2- 172.21.15.78:0/2910887817 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f68540a8b10 0x7f6854149600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:03:00.630 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:00.624+0000 7f685bc5a640 1 --2- 172.21.15.78:0/2910887817 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6840003f30 0x7f68541ec7f0 unknown :-1 s=CLOSED pgs=1115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:03:00.630 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:00.624+0000 7f685bc5a640 1 -- 172.21.15.78:0/2910887817 >> 172.21.15.78:0/2910887817 conn(0x7f68540a7810 msgr2=0x7f68540c2c40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:03:00.630 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:00.624+0000 7f685bc5a640 1 -- 172.21.15.78:0/2910887817 shutdown_connections 2023-11-28T20:03:00.631 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:00.624+0000 7f685bc5a640 1 -- 172.21.15.78:0/2910887817 wait complete. 2023-11-28T20:03:00.649 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-28T20:03:00.785 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:00.780+0000 7fd675654640 1 Processor -- start 2023-11-28T20:03:00.786 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:00.780+0000 7fd675654640 1 -- start start 2023-11-28T20:03:00.786 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:00.784+0000 7fd675654640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd6700c3b80 0x7fd67006d690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:03:00.787 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:00.784+0000 7fd675654640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd67006bb80 con 0x7fd67006d2b0 2023-11-28T20:03:00.787 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:00.784+0000 7fd675654640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd6700c5790 con 0x7fd6700c5300 2023-11-28T20:03:00.787 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:00.784+0000 7fd675654640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd6701515c0 con 0x7fd6700c3b80 2023-11-28T20:03:00.787 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:00.784+0000 7fd66effd640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7fd67006d2b0 0x7fd67006c020 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:51070/0 (socket says 172.21.15.78:51070) 2023-11-28T20:03:00.787 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:00.784+0000 7fd66effd640 1 -- 172.21.15.78:0/1278911857 learned_addr learned my addr 172.21.15.78:0/1278911857 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-11-28T20:03:00.788 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:00.784+0000 7fd6667fc640 1 --2- 172.21.15.78:0/1278911857 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd6700c3b80 0x7fd67006d690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:03:00.788 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:00.784+0000 7fd66e7fc640 1 -- 172.21.15.78:0/1278911857 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4086956514 0 0) 0x7fd67006bb80 con 0x7fd67006d2b0 2023-11-28T20:03:00.788 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:00.784+0000 7fd66e7fc640 1 -- 172.21.15.78:0/1278911857 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd65c003530 con 0x7fd67006d2b0 2023-11-28T20:03:00.789 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:00.784+0000 7fd66e7fc640 1 -- 172.21.15.78:0/1278911857 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 326144310 0 0) 0x7fd6700c5790 con 0x7fd6700c5300 2023-11-28T20:03:00.789 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:00.784+0000 7fd6667fc640 1 -- 172.21.15.78:0/1278911857 >> v1:172.21.15.179:6789/0 conn(0x7fd6700c5300 legacy=0x7fd67006c730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:03:00.789 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:00.784+0000 7fd6667fc640 1 -- 172.21.15.78:0/1278911857 >> v1:172.21.15.78:6789/0 conn(0x7fd67006d2b0 legacy=0x7fd67006c020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:03:00.789 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:00.784+0000 7fd6667fc640 1 -- 172.21.15.78:0/1278911857 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6701518a0 con 0x7fd6700c3b80 2023-11-28T20:03:00.790 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:00.788+0000 7fd6667fc640 1 --2- 172.21.15.78:0/1278911857 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd6700c3b80 0x7fd67006d690 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fd6580097f0 tx=0x7fd65801c3b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f5e13f55d6891f35 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:03:00.791 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:00.788+0000 7fd66e7fc640 1 -- 172.21.15.78:0/1278911857 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6580ab600 con 0x7fd6700c3b80 2023-11-28T20:03:00.791 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:00.788+0000 7fd66e7fc640 1 -- 172.21.15.78:0/1278911857 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd6580a7050 con 0x7fd6700c3b80 2023-11-28T20:03:00.791 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:00.788+0000 7fd66e7fc640 1 -- 172.21.15.78:0/1278911857 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6580ab980 con 0x7fd6700c3b80 2023-11-28T20:03:00.793 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:00.788+0000 7fd675654640 1 -- 172.21.15.78:0/1278911857 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd6700c3b80 msgr2=0x7fd67006d690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:03:00.793 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:00.788+0000 7fd675654640 1 --2- 172.21.15.78:0/1278911857 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd6700c3b80 0x7fd67006d690 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fd6580097f0 tx=0x7fd65801c3b0 comp rx=0 tx=0).stop 2023-11-28T20:03:00.793 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:00.788+0000 7fd675654640 1 -- 172.21.15.78:0/1278911857 shutdown_connections 2023-11-28T20:03:00.793 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:00.788+0000 7fd675654640 1 --2- 172.21.15.78:0/1278911857 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd6700c3b80 0x7fd67006d690 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:03:00.793 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:00.788+0000 7fd675654640 1 -- 172.21.15.78:0/1278911857 >> 172.21.15.78:0/1278911857 conn(0x7fd6700a7810 msgr2=0x7fd6700a7c20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:03:00.794 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:00.788+0000 7fd675654640 1 -- 172.21.15.78:0/1278911857 shutdown_connections 2023-11-28T20:03:00.794 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:00.788+0000 7fd675654640 1 -- 172.21.15.78:0/1278911857 wait complete. 2023-11-28T20:03:00.797 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:00.788+0000 7fd675654640 1 Processor -- start 2023-11-28T20:03:00.797 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:00.788+0000 7fd675654640 1 -- start start 2023-11-28T20:03:00.797 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:00.792+0000 7fd675654640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd67006d2b0 0x7fd6700bbde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:03:00.798 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:00.792+0000 7fd675654640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd6700c3b80 0x7fd6700be060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:03:00.798 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:00.792+0000 7fd675654640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd6700c5300 0x7fd670155ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:03:00.798 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:00.792+0000 7fd675654640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6700baa80 con 0x7fd67006d2b0 2023-11-28T20:03:00.798 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:00.792+0000 7fd675654640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6700bad60 con 0x7fd6700c3b80 2023-11-28T20:03:00.799 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:00.792+0000 7fd675654640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd6700bb040 con 0x7fd6700c5300 2023-11-28T20:03:00.799 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:00.792+0000 7fd66effd640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd67006d2b0 0x7fd6700bbde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:03:00.799 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:00.792+0000 7fd66effd640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd67006d2b0 0x7fd6700bbde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:41852/0 (socket says 172.21.15.78:41852) 2023-11-28T20:03:00.799 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:00.792+0000 7fd66effd640 1 -- 172.21.15.78:0/2697932290 learned_addr learned my addr 172.21.15.78:0/2697932290 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T20:03:00.799 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:00.792+0000 7fd66f7fe640 1 --2- 172.21.15.78:0/2697932290 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd6700c5300 0x7fd670155ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:03:00.800 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:00.792+0000 7fd6667fc640 1 --2- 172.21.15.78:0/2697932290 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd6700c3b80 0x7fd6700be060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:03:00.800 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:00.792+0000 7fd66effd640 1 -- 172.21.15.78:0/2697932290 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd6700c5300 msgr2=0x7fd670155ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:03:00.800 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:00.792+0000 7fd66effd640 1 --2- 172.21.15.78:0/2697932290 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd6700c5300 0x7fd670155ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:03:00.801 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:00.792+0000 7fd66effd640 1 -- 172.21.15.78:0/2697932290 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd6700c3b80 msgr2=0x7fd6700be060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:03:00.801 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:00.792+0000 7fd66effd640 1 --2- 172.21.15.78:0/2697932290 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd6700c3b80 0x7fd6700be060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:03:00.801 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:00.792+0000 7fd66effd640 1 -- 172.21.15.78:0/2697932290 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd658009420 con 0x7fd67006d2b0 2023-11-28T20:03:00.801 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:00.792+0000 7fd66effd640 1 --2- 172.21.15.78:0/2697932290 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd67006d2b0 0x7fd6700bbde0 secure :-1 s=READY pgs=1117 cs=0 l=1 rev1=1 crypto rx=0x7fd660002020 tx=0x7fd66000a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:03:00.801 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:00.792+0000 7fd667fff640 1 -- 172.21.15.78:0/2697932290 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd660012400 con 0x7fd67006d2b0 2023-11-28T20:03:00.802 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:00.792+0000 7fd667fff640 1 -- 172.21.15.78:0/2697932290 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd660012560 con 0x7fd67006d2b0 2023-11-28T20:03:00.802 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:00.792+0000 7fd675654640 1 -- 172.21.15.78:0/2697932290 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd67014ef80 con 0x7fd67006d2b0 2023-11-28T20:03:00.802 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:00.792+0000 7fd667fff640 1 -- 172.21.15.78:0/2697932290 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd660012910 con 0x7fd67006d2b0 2023-11-28T20:03:00.802 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:00.792+0000 7fd675654640 1 -- 172.21.15.78:0/2697932290 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd6700bb600 con 0x7fd67006d2b0 2023-11-28T20:03:00.803 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:00.792+0000 7fd675654640 1 -- 172.21.15.78:0/2697932290 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd6700679d0 con 0x7fd67006d2b0 2023-11-28T20:03:00.804 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:00.792+0000 7fd667fff640 1 -- 172.21.15.78:0/2697932290 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fd660007070 con 0x7fd67006d2b0 2023-11-28T20:03:00.805 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:00.792+0000 7fd667fff640 1 --2- 172.21.15.78:0/2697932290 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fd6500664a0 0x7fd650068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:03:00.805 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:00.796+0000 7fd667fff640 1 -- 172.21.15.78:0/2697932290 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 6206+0+0 (secure 0 0 0) 0x7fd6600842b0 con 0x7fd67006d2b0 2023-11-28T20:03:00.805 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:00.796+0000 7fd6667fc640 1 --2- 172.21.15.78:0/2697932290 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fd6500664a0 0x7fd650068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:03:00.805 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:00.796+0000 7fd6667fc640 1 --2- 172.21.15.78:0/2697932290 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fd6500664a0 0x7fd650068960 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7fd6580ad000 tx=0x7fd6580a6000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:03:00.805 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:00.796+0000 7fd667fff640 1 -- 172.21.15.78:0/2697932290 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fd660051530 con 0x7fd67006d2b0 2023-11-28T20:03:00.952 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:00.948+0000 7fd675654640 1 -- 172.21.15.78:0/2697932290 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd6700c0c50 con 0x7fd67006d2b0 2023-11-28T20:03:00.954 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:00.948+0000 7fd667fff640 1 -- 172.21.15.78:0/2697932290 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v90) v1 ==== 74+0+16956 (secure 0 0 0) 0x7fd660054b50 con 0x7fd67006d2b0 2023-11-28T20:03:00.954 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-11-28T20:03:00.954 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":90,"fsid":"dd9780e8-3bda-44fa-a9f0-fa07d19d901d","created":"2023-11-28T19:58:40.969556+0000","modified":"2023-11-28T20:02:58.914049+0000","last_up_change":"2023-11-28T19:58:52.596716+0000","last_in_change":"2023-11-28T19:58:43.609275+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":16,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-28T19:58:54.011229+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs2_metadata","create_time":"2023-11-28T20:02:23.066724+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":16,"pool_name":"cephfs2_data","create_time":"2023-11-28T20:02:24.230614+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs2"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e84245ac-b5da-429e-af18-39acaa2b33e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6800","nonce":3358701235},{"type":"v1","addr":"172.21.15.78:6801","nonce":3358701235}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6802","nonce":3358701235},{"type":"v1","addr":"172.21.15.78:6803","nonce":3358701235}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6806","nonce":3358701235},{"type":"v1","addr":"172.21.15.78:6807","nonce":3358701235}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6804","nonce":3358701235},{"type":"v1","addr":"172.21.15.78:6805","nonce":3358701235}]},"public_addr":"172.21.15.78:6801/3358701235","cluster_addr":"172.21.15.78:6803/3358701235","heartbeat_back_addr":"172.21.15.78:6807/3358701235","heartbeat_front_addr":"172.21.15.78:6805/3358701235","state":["exists","up"]},{"osd":1,"uuid":"e634831d-c4e2-48d9-870c-9556ae162981","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6808","nonce":3211476654},{"type":"v1","addr":"172.21.15.78:6809","nonce":3211476654}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6810","nonce":3211476654},{"type":"v1","addr":"172.21.15.78:6811","nonce":3211476654}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6814","nonce":3211476654},{"type":"v1","addr":"172.21.15.78:6815","nonce":3211476654}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6812","nonce":3211476654},{"type":"v1","addr":"172.21.15.78:6813","nonce":3211476654}]},"public_addr":"172.21.15.78:6809/3211476654","cluster_addr":"172.21.15.78:6811/3211476654","heartbeat_back_addr":"172.21.15.78:6815/3211476654","heartbeat_front_addr":"172.21.15.78:6813/3211476654","state":["exists","up"]},{"osd":2,"uuid":"274c8395-6534-41f0-b8fb-a00af8985aa8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6816","nonce":2532904479},{"type":"v1","addr":"172.21.15.78:6817","nonce":2532904479}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6818","nonce":2532904479},{"type":"v1","addr":"172.21.15.78:6819","nonce":2532904479}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6822","nonce":2532904479},{"type":"v1","addr":"172.21.15.78:6823","nonce":2532904479}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6820","nonce":2532904479},{"type":"v1","addr":"172.21.15.78:6821","nonce":2532904479}]},"public_addr":"172.21.15.78:6817/2532904479","cluster_addr":"172.21.15.78:6819/2532904479","heartbeat_back_addr":"172.21.15.78:6823/2532904479","heartbeat_front_addr":"172.21.15.78:6821/2532904479","state":["exists","up"]},{"osd":3,"uuid":"77acc9af-7d4d-4b18-8cf5-d62f5971b7c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6824","nonce":3442991267},{"type":"v1","addr":"172.21.15.78:6825","nonce":3442991267}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6826","nonce":3442991267},{"type":"v1","addr":"172.21.15.78:6827","nonce":3442991267}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6830","nonce":3442991267},{"type":"v1","addr":"172.21.15.78:6831","nonce":3442991267}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6828","nonce":3442991267},{"type":"v1","addr":"172.21.15.78:6829","nonce":3442991267}]},"public_addr":"172.21.15.78:6825/3442991267","cluster_addr":"172.21.15.78:6827/3442991267","heartbeat_back_addr":"172.21.15.78:6831/3442991267","heartbeat_front_addr":"172.21.15.78:6829/3442991267","state":["exists","up"]},{"osd":4,"uuid":"5c62bc66-6b34-4b7f-a66b-9a743969138c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":802983577},{"type":"v1","addr":"172.21.15.179:6809","nonce":802983577}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":802983577},{"type":"v1","addr":"172.21.15.179:6811","nonce":802983577}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":802983577},{"type":"v1","addr":"172.21.15.179:6815","nonce":802983577}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":802983577},{"type":"v1","addr":"172.21.15.179:6813","nonce":802983577}]},"public_addr":"172.21.15.179:6809/802983577","cluster_addr":"172.21.15.179:6811/802983577","heartbeat_back_addr":"172.21.15.179:6815/802983577","heartbeat_front_addr":"172.21.15.179:6813/802983577","state":["exists","up"]},{"osd":5,"uuid":"67db6d36-f684-4079-b0cd-82b4dd61461f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":518192887},{"type":"v1","addr":"172.21.15.179:6818","nonce":518192887}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":518192887},{"type":"v1","addr":"172.21.15.179:6822","nonce":518192887}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":518192887},{"type":"v1","addr":"172.21.15.179:6829","nonce":518192887}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6824","nonce":518192887},{"type":"v1","addr":"172.21.15.179:6826","nonce":518192887}]},"public_addr":"172.21.15.179:6818/518192887","cluster_addr":"172.21.15.179:6822/518192887","heartbeat_back_addr":"172.21.15.179:6829/518192887","heartbeat_front_addr":"172.21.15.179:6826/518192887","state":["exists","up"]},{"osd":6,"uuid":"12e670af-5a16-4c81-9f97-defa66cab967","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":815435378},{"type":"v1","addr":"172.21.15.179:6801","nonce":815435378}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":815435378},{"type":"v1","addr":"172.21.15.179:6803","nonce":815435378}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":815435378},{"type":"v1","addr":"172.21.15.179:6807","nonce":815435378}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":815435378},{"type":"v1","addr":"172.21.15.179:6805","nonce":815435378}]},"public_addr":"172.21.15.179:6801/815435378","cluster_addr":"172.21.15.179:6803/815435378","heartbeat_back_addr":"172.21.15.179:6807/815435378","heartbeat_front_addr":"172.21.15.179:6805/815435378","state":["exists","up"]},{"osd":7,"uuid":"fe630650-2eb3-49ad-8676-c341e6332eb1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6817","nonce":2848432339},{"type":"v1","addr":"172.21.15.179:6819","nonce":2848432339}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6821","nonce":2848432339},{"type":"v1","addr":"172.21.15.179:6823","nonce":2848432339}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":2848432339},{"type":"v1","addr":"172.21.15.179:6831","nonce":2848432339}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6825","nonce":2848432339},{"type":"v1","addr":"172.21.15.179:6827","nonce":2848432339}]},"public_addr":"172.21.15.179:6819/2848432339","cluster_addr":"172.21.15.179:6823/2848432339","heartbeat_back_addr":"172.21.15.179:6831/2848432339","heartbeat_front_addr":"172.21.15.179:6827/2848432339","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:58:49.255433+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:58:49.412880+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:58:49.559295+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:58:49.245237+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:58:49.184557+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:58:49.329851+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:58:49.366012+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:58:49.349604+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"16.1f","mappings":[{"from":5,"to":4}]},{"pgid":"16.26","mappings":[{"from":6,"to":7}]},{"pgid":"16.3a","mappings":[{"from":1,"to":4}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.78:6837/20108235":"2023-11-29T20:02:55.575854+0000","172.21.15.78:6835/20108235":"2023-11-29T20:02:55.575854+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-28T20:03:00.956 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:00.952+0000 7fd675654640 1 -- 172.21.15.78:0/2697932290 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fd6500664a0 msgr2=0x7fd650068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:03:00.956 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:00.952+0000 7fd675654640 1 --2- 172.21.15.78:0/2697932290 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fd6500664a0 0x7fd650068960 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7fd6580ad000 tx=0x7fd6580a6000 comp rx=0 tx=0).stop 2023-11-28T20:03:00.957 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:00.952+0000 7fd675654640 1 -- 172.21.15.78:0/2697932290 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd67006d2b0 msgr2=0x7fd6700bbde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:03:00.957 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:00.952+0000 7fd675654640 1 --2- 172.21.15.78:0/2697932290 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd67006d2b0 0x7fd6700bbde0 secure :-1 s=READY pgs=1117 cs=0 l=1 rev1=1 crypto rx=0x7fd660002020 tx=0x7fd66000a430 comp rx=0 tx=0).stop 2023-11-28T20:03:00.957 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:00.952+0000 7fd675654640 1 -- 172.21.15.78:0/2697932290 shutdown_connections 2023-11-28T20:03:00.957 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:00.952+0000 7fd675654640 1 --2- 172.21.15.78:0/2697932290 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fd6500664a0 0x7fd650068960 unknown :-1 s=CLOSED pgs=528 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:03:00.957 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:00.952+0000 7fd675654640 1 --2- 172.21.15.78:0/2697932290 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd6700c5300 0x7fd670155ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:03:00.957 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:00.952+0000 7fd675654640 1 --2- 172.21.15.78:0/2697932290 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd6700c3b80 0x7fd6700be060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:03:00.957 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:00.952+0000 7fd675654640 1 --2- 172.21.15.78:0/2697932290 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd67006d2b0 0x7fd6700bbde0 unknown :-1 s=CLOSED pgs=1117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:03:00.957 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:00.952+0000 7fd675654640 1 -- 172.21.15.78:0/2697932290 >> 172.21.15.78:0/2697932290 conn(0x7fd6700a7810 msgr2=0x7fd67015c570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:03:00.957 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:00.952+0000 7fd675654640 1 -- 172.21.15.78:0/2697932290 shutdown_connections 2023-11-28T20:03:00.958 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:00.952+0000 7fd675654640 1 -- 172.21.15.78:0/2697932290 wait complete. 2023-11-28T20:03:00.975 INFO:tasks.cephfs.filesystem:Destroying file system cephfs2 and related pools 2023-11-28T20:03:00.975 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-28T20:03:01.113 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:01.108+0000 7f51abc17640 1 Processor -- start 2023-11-28T20:03:01.160 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:01.108+0000 7f51abc17640 1 -- start start 2023-11-28T20:03:01.165 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:01.108+0000 7f51abc17640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f51a40c0f30 0x7f51a4072580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:03:01.165 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:01.108+0000 7f51abc17640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f51a40c3960 0x7f51a40c0460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:03:01.165 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:01.108+0000 7f51abc17640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f51a4159280 0x7f51a4155ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:03:01.165 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:01.108+0000 7f51abc17640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f51a40c3de0 con 0x7f51a4159280 2023-11-28T20:03:01.165 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:01.108+0000 7f51abc17640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f51a40c1a50 con 0x7f51a40c3960 2023-11-28T20:03:01.165 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:01.108+0000 7f51abc17640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51a40c1ca0 con 0x7f51a40c0f30 2023-11-28T20:03:01.165 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:01.112+0000 7f51aa1b4640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f51a4159280 0x7f51a4155ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:03:01.166 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:01.112+0000 7f51aa1b4640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f51a4159280 0x7f51a4155ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:41854/0 (socket says 172.21.15.78:41854) 2023-11-28T20:03:01.166 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:01.112+0000 7f51aa1b4640 1 -- 172.21.15.78:0/458980021 learned_addr learned my addr 172.21.15.78:0/458980021 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T20:03:01.166 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:01.112+0000 7f51a99b3640 1 --2- 172.21.15.78:0/458980021 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f51a40c0f30 0x7f51a4072580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:03:01.166 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:01.112+0000 7f51a91b2640 1 --2- 172.21.15.78:0/458980021 >> v2:172.21.15.179:3300/0 conn(0x7f51a40c3960 0x7f51a40c0460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:03:01.166 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:01.112+0000 7f51aa1b4640 1 -- 172.21.15.78:0/458980021 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f51a40c0f30 msgr2=0x7f51a4072580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:03:01.167 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:01.112+0000 7f51aa1b4640 1 --2- 172.21.15.78:0/458980021 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f51a40c0f30 0x7f51a4072580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:03:01.167 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:01.112+0000 7f51aa1b4640 1 -- 172.21.15.78:0/458980021 >> v2:172.21.15.179:3300/0 conn(0x7f51a40c3960 msgr2=0x7f51a40c0460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:03:01.167 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:01.112+0000 7f51aa1b4640 1 --2- 172.21.15.78:0/458980021 >> v2:172.21.15.179:3300/0 conn(0x7f51a40c3960 0x7f51a40c0460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:03:01.168 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:01.112+0000 7f51aa1b4640 1 -- 172.21.15.78:0/458980021 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51a40c1f80 con 0x7f51a4159280 2023-11-28T20:03:01.168 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:01.112+0000 7f51a91b2640 1 --2- 172.21.15.78:0/458980021 >> v2:172.21.15.179:3300/0 conn(0x7f51a40c3960 0x7f51a40c0460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T20:03:01.168 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:01.112+0000 7f51aa1b4640 1 --2- 172.21.15.78:0/458980021 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f51a4159280 0x7f51a4155ed0 secure :-1 s=READY pgs=1118 cs=0 l=1 rev1=1 crypto rx=0x7f51a406b5a0 tx=0x7f519c01c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=41fd3c52a912f1a2 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:03:01.168 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:01.112+0000 7f51a89b1640 1 -- 172.21.15.78:0/458980021 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f519c0a57e0 con 0x7f51a4159280 2023-11-28T20:03:01.168 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:01.112+0000 7f51a89b1640 1 -- 172.21.15.78:0/458980021 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f519c0a5940 con 0x7f51a4159280 2023-11-28T20:03:01.168 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:01.112+0000 7f51a89b1640 1 -- 172.21.15.78:0/458980021 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f519c0a5cd0 con 0x7f51a4159280 2023-11-28T20:03:01.169 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:01.116+0000 7f51abc17640 1 -- 172.21.15.78:0/458980021 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f51a4159280 msgr2=0x7f51a4155ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:03:01.169 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:01.116+0000 7f51abc17640 1 --2- 172.21.15.78:0/458980021 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f51a4159280 0x7f51a4155ed0 secure :-1 s=READY pgs=1118 cs=0 l=1 rev1=1 crypto rx=0x7f51a406b5a0 tx=0x7f519c01c940 comp rx=0 tx=0).stop 2023-11-28T20:03:01.169 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:01.116+0000 7f51abc17640 1 -- 172.21.15.78:0/458980021 shutdown_connections 2023-11-28T20:03:01.169 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:01.116+0000 7f51abc17640 1 --2- 172.21.15.78:0/458980021 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f51a4159280 0x7f51a4155ed0 unknown :-1 s=CLOSED pgs=1118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:03:01.169 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:01.116+0000 7f51abc17640 1 --2- 172.21.15.78:0/458980021 >> v2:172.21.15.179:3300/0 conn(0x7f51a40c3960 0x7f51a40c0460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:03:01.169 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:01.116+0000 7f51abc17640 1 --2- 172.21.15.78:0/458980021 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f51a40c0f30 0x7f51a4072580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:03:01.169 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:01.116+0000 7f51abc17640 1 -- 172.21.15.78:0/458980021 >> 172.21.15.78:0/458980021 conn(0x7f51a40a7810 msgr2=0x7f51a40a7c20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:03:01.169 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:01.116+0000 7f51abc17640 1 -- 172.21.15.78:0/458980021 shutdown_connections 2023-11-28T20:03:01.169 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:01.116+0000 7f51abc17640 1 -- 172.21.15.78:0/458980021 wait complete. 2023-11-28T20:03:01.170 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:01.116+0000 7f51abc17640 1 Processor -- start 2023-11-28T20:03:01.170 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:01.116+0000 7f51abc17640 1 -- start start 2023-11-28T20:03:01.170 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:01.116+0000 7f51abc17640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f51a40c0f30 0x7f51a40a6610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:03:01.170 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:01.116+0000 7f51abc17640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f51a40c3960 0x7f51a4154130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:03:01.170 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:01.116+0000 7f51abc17640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f51a4159280 0x7f51a4154670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:03:01.170 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:01.116+0000 7f51abc17640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51a4154fa0 con 0x7f51a4159280 2023-11-28T20:03:01.170 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:01.116+0000 7f51abc17640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51a4153ca0 con 0x7f51a40c0f30 2023-11-28T20:03:01.170 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:01.116+0000 7f51abc17640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51a41551f0 con 0x7f51a40c3960 2023-11-28T20:03:01.170 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:01.116+0000 7f51aa1b4640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f51a4159280 0x7f51a4154670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:03:01.170 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:01.116+0000 7f51aa1b4640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f51a4159280 0x7f51a4154670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:41866/0 (socket says 172.21.15.78:41866) 2023-11-28T20:03:01.170 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:01.116+0000 7f51aa1b4640 1 -- 172.21.15.78:0/1329176407 learned_addr learned my addr 172.21.15.78:0/1329176407 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T20:03:01.171 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:01.116+0000 7f51a91b2640 1 --2- 172.21.15.78:0/1329176407 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f51a40c3960 0x7f51a4154130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:03:01.171 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:01.116+0000 7f51a99b3640 1 --2- 172.21.15.78:0/1329176407 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f51a40c0f30 0x7f51a40a6610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:03:01.171 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:01.120+0000 7f51aa1b4640 1 -- 172.21.15.78:0/1329176407 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f51a40c3960 msgr2=0x7f51a4154130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:03:01.171 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:01.120+0000 7f51aa1b4640 1 --2- 172.21.15.78:0/1329176407 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f51a40c3960 0x7f51a4154130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:03:01.171 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:01.120+0000 7f51aa1b4640 1 -- 172.21.15.78:0/1329176407 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f51a40c0f30 msgr2=0x7f51a40a6610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:03:01.171 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:01.120+0000 7f51aa1b4640 1 --2- 172.21.15.78:0/1329176407 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f51a40c0f30 0x7f51a40a6610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:03:01.171 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:01.120+0000 7f51aa1b4640 1 -- 172.21.15.78:0/1329176407 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f519c009b30 con 0x7f51a4159280 2023-11-28T20:03:01.171 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:01.120+0000 7f51aa1b4640 1 --2- 172.21.15.78:0/1329176407 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f51a4159280 0x7f51a4154670 secure :-1 s=READY pgs=1119 cs=0 l=1 rev1=1 crypto rx=0x7f519c01d1e0 tx=0x7f519c0196e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:03:01.171 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:01.120+0000 7f519a7fc640 1 -- 172.21.15.78:0/1329176407 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f519c0b8670 con 0x7f51a4159280 2023-11-28T20:03:01.171 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:01.120+0000 7f519a7fc640 1 -- 172.21.15.78:0/1329176407 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f519c0b87f0 con 0x7f51a4159280 2023-11-28T20:03:01.171 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:01.120+0000 7f519a7fc640 1 -- 172.21.15.78:0/1329176407 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f519c0b8ba0 con 0x7f51a4159280 2023-11-28T20:03:01.171 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:01.120+0000 7f51abc17640 1 -- 172.21.15.78:0/1329176407 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f51a41554d0 con 0x7f51a4159280 2023-11-28T20:03:01.172 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:01.120+0000 7f51abc17640 1 -- 172.21.15.78:0/1329176407 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f51a40a6b50 con 0x7f51a4159280 2023-11-28T20:03:01.172 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:01.120+0000 7f51abc17640 1 -- 172.21.15.78:0/1329176407 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f51a40a86d0 con 0x7f51a4159280 2023-11-28T20:03:01.172 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:01.120+0000 7f519a7fc640 1 -- 172.21.15.78:0/1329176407 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f519c0b8d00 con 0x7f51a4159280 2023-11-28T20:03:01.172 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:01.120+0000 7f519a7fc640 1 --2- 172.21.15.78:0/1329176407 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f5188066470 0x7f5188068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:03:01.172 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:01.120+0000 7f519a7fc640 1 -- 172.21.15.78:0/1329176407 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 6206+0+0 (secure 0 0 0) 0x7f519c11f230 con 0x7f51a4159280 2023-11-28T20:03:01.172 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:01.120+0000 7f51a99b3640 1 --2- 172.21.15.78:0/1329176407 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f5188066470 0x7f5188068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:03:01.172 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:01.124+0000 7f51a99b3640 1 --2- 172.21.15.78:0/1329176407 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f5188066470 0x7f5188068930 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7f51a40a5490 tx=0x7f51a0008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:03:01.172 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:01.128+0000 7f519a7fc640 1 -- 172.21.15.78:0/1329176407 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f519c0ec680 con 0x7f51a4159280 2023-11-28T20:03:01.311 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:01.304+0000 7f51abc17640 1 -- 172.21.15.78:0/1329176407 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f51a4067630 con 0x7f51a4159280 2023-11-28T20:03:01.311 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:01.304+0000 7f519a7fc640 1 -- 172.21.15.78:0/1329176407 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 53 v53) v1 ==== 94+0+4923 (secure 0 0 0) 0x7f519c0efca0 con 0x7f51a4159280 2023-11-28T20:03:01.312 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-11-28T20:03:01.312 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":53,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5834,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6834/3259525552","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6832","nonce":3259525552},{"type":"v1","addr":"172.21.15.179:6834","nonce":3259525552}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":41},{"gid":6466,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6836/3096284673","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6834","nonce":3096284673},{"type":"v1","addr":"172.21.15.78:6836","nonce":3096284673}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":41},{"gid":7320,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6837/1031394527","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6835","nonce":1031394527},{"type":"v1","addr":"172.21.15.78:6837","nonce":1031394527}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":53}],"filesystems":[{"mdsmap":{"epoch":51,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-28T20:02:25.231135+0000","modified":"2023-11-28T20:02:28.250515+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":6478},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6478":{"gid":6478,"name":"b","rank":0,"incarnation":47,"state":"up:active","state_seq":7,"addr":"172.21.15.179:6835/2749579094","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6833","nonce":2749579094},{"type":"v1","addr":"172.21.15.179:6835","nonce":2749579094}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs2","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":7}]} 2023-11-28T20:03:01.315 INFO:teuthology.orchestra.run.smithi078.stderr:dumped fsmap epoch 53 2023-11-28T20:03:01.315 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:01.308+0000 7f51abc17640 1 -- 172.21.15.78:0/1329176407 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f5188066470 msgr2=0x7f5188068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:03:01.315 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:01.308+0000 7f51abc17640 1 --2- 172.21.15.78:0/1329176407 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f5188066470 0x7f5188068930 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7f51a40a5490 tx=0x7f51a0008040 comp rx=0 tx=0).stop 2023-11-28T20:03:01.316 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:01.308+0000 7f51abc17640 1 -- 172.21.15.78:0/1329176407 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f51a4159280 msgr2=0x7f51a4154670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:03:01.316 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:01.308+0000 7f51abc17640 1 --2- 172.21.15.78:0/1329176407 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f51a4159280 0x7f51a4154670 secure :-1 s=READY pgs=1119 cs=0 l=1 rev1=1 crypto rx=0x7f519c01d1e0 tx=0x7f519c0196e0 comp rx=0 tx=0).stop 2023-11-28T20:03:01.316 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:01.308+0000 7f51abc17640 1 -- 172.21.15.78:0/1329176407 shutdown_connections 2023-11-28T20:03:01.316 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:01.308+0000 7f51abc17640 1 --2- 172.21.15.78:0/1329176407 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f5188066470 0x7f5188068930 unknown :-1 s=CLOSED pgs=529 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:03:01.317 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:01.308+0000 7f51abc17640 1 --2- 172.21.15.78:0/1329176407 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f51a40c3960 0x7f51a4154130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:03:01.317 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:01.308+0000 7f51abc17640 1 --2- 172.21.15.78:0/1329176407 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f51a4159280 0x7f51a4154670 unknown :-1 s=CLOSED pgs=1119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:03:01.317 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:01.308+0000 7f51abc17640 1 --2- 172.21.15.78:0/1329176407 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f51a40c0f30 0x7f51a40a6610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:03:01.317 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:01.308+0000 7f51abc17640 1 -- 172.21.15.78:0/1329176407 >> 172.21.15.78:0/1329176407 conn(0x7f51a40a7810 msgr2=0x7f51a406bdf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:03:01.318 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:01.308+0000 7f51abc17640 1 -- 172.21.15.78:0/1329176407 shutdown_connections 2023-11-28T20:03:01.318 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:01.308+0000 7f51abc17640 1 -- 172.21.15.78:0/1329176407 wait complete. 2023-11-28T20:03:01.332 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-28T20:03:01.468 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:01.464+0000 7fb7e3a17640 1 Processor -- start 2023-11-28T20:03:01.469 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:01.464+0000 7fb7e3a17640 1 -- start start 2023-11-28T20:03:01.470 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:01.464+0000 7fb7e3a17640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fb7dc0722c0 0x7fb7dc15de60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:03:01.470 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:01.464+0000 7fb7e3a17640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb7dc0c5710 con 0x7fb7dc14fd10 2023-11-28T20:03:01.470 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:01.464+0000 7fb7e3a17640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb7dc155c80 con 0x7fb7dc071e30 2023-11-28T20:03:01.470 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:01.464+0000 7fb7e3a17640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb7dc06c5e0 con 0x7fb7dc0722c0 2023-11-28T20:03:01.470 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:01.464+0000 7fb7e17b3640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7fb7dc14fd10 0x7fb7dc0a4dc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:51078/0 (socket says 172.21.15.78:51078) 2023-11-28T20:03:01.470 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:01.464+0000 7fb7e17b3640 1 -- 172.21.15.78:0/3875991340 learned_addr learned my addr 172.21.15.78:0/3875991340 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-11-28T20:03:01.470 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:01.464+0000 7fb7e1fb4640 1 --2- 172.21.15.78:0/3875991340 >> v2:172.21.15.179:3300/0 conn(0x7fb7dc0722c0 0x7fb7dc15de60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:03:01.471 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:01.468+0000 7fb7d3fff640 1 -- 172.21.15.78:0/3875991340 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3090354537 0 0) 0x7fb7dc0c5710 con 0x7fb7dc14fd10 2023-11-28T20:03:01.471 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:01.468+0000 7fb7d3fff640 1 -- 172.21.15.78:0/3875991340 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb7c8003530 con 0x7fb7dc14fd10 2023-11-28T20:03:01.471 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:01.468+0000 7fb7d3fff640 1 -- 172.21.15.78:0/3875991340 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2877393489 0 0) 0x7fb7dc155c80 con 0x7fb7dc071e30 2023-11-28T20:03:01.472 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:01.468+0000 7fb7d3fff640 1 -- 172.21.15.78:0/3875991340 --> v1:172.21.15.179:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb7dc0c5710 con 0x7fb7dc071e30 2023-11-28T20:03:01.472 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:01.468+0000 7fb7e1fb4640 1 -- 172.21.15.78:0/3875991340 >> v1:172.21.15.179:6789/0 conn(0x7fb7dc071e30 legacy=0x7fb7dc156110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:03:01.472 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:01.468+0000 7fb7e1fb4640 1 -- 172.21.15.78:0/3875991340 >> v1:172.21.15.78:6789/0 conn(0x7fb7dc14fd10 legacy=0x7fb7dc0a4dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:03:01.472 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:01.468+0000 7fb7e1fb4640 1 -- 172.21.15.78:0/3875991340 --> v2:172.21.15.179:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7dc0c4e70 con 0x7fb7dc0722c0 2023-11-28T20:03:01.474 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:01.468+0000 7fb7e1fb4640 1 --2- 172.21.15.78:0/3875991340 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb7dc0722c0 0x7fb7dc15de60 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7fb7d4009d90 tx=0x7fb7d401c830 comp rx=0 tx=0).ready entity=mon.1 client_cookie=99247acb6f6409f4 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:03:01.474 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:01.468+0000 7fb7d3fff640 1 -- 172.21.15.78:0/3875991340 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7d40a57e0 con 0x7fb7dc0722c0 2023-11-28T20:03:01.474 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:01.468+0000 7fb7d3fff640 1 -- 172.21.15.78:0/3875991340 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb7d40a5940 con 0x7fb7dc0722c0 2023-11-28T20:03:01.474 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:01.468+0000 7fb7d3fff640 1 -- 172.21.15.78:0/3875991340 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7d40a5cd0 con 0x7fb7dc0722c0 2023-11-28T20:03:01.475 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:01.468+0000 7fb7e3a17640 1 -- 172.21.15.78:0/3875991340 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb7dc0722c0 msgr2=0x7fb7dc15de60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:03:01.475 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:01.468+0000 7fb7e3a17640 1 --2- 172.21.15.78:0/3875991340 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb7dc0722c0 0x7fb7dc15de60 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7fb7d4009d90 tx=0x7fb7d401c830 comp rx=0 tx=0).stop 2023-11-28T20:03:01.475 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:01.472+0000 7fb7e3a17640 1 -- 172.21.15.78:0/3875991340 shutdown_connections 2023-11-28T20:03:01.475 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:01.472+0000 7fb7e3a17640 1 --2- 172.21.15.78:0/3875991340 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb7dc0722c0 0x7fb7dc15de60 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:03:01.475 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:01.472+0000 7fb7e3a17640 1 -- 172.21.15.78:0/3875991340 >> 172.21.15.78:0/3875991340 conn(0x7fb7dc0a7810 msgr2=0x7fb7dc0a7c20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:03:01.475 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:01.472+0000 7fb7e3a17640 1 -- 172.21.15.78:0/3875991340 shutdown_connections 2023-11-28T20:03:01.475 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:01.472+0000 7fb7e3a17640 1 -- 172.21.15.78:0/3875991340 wait complete. 2023-11-28T20:03:01.476 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:01.472+0000 7fb7e3a17640 1 Processor -- start 2023-11-28T20:03:01.476 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:01.472+0000 7fb7e3a17640 1 -- start start 2023-11-28T20:03:01.479 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:01.472+0000 7fb7e3a17640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb7dc071e30 0x7fb7dc0ab1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:03:01.479 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:01.472+0000 7fb7e3a17640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb7dc0722c0 0x7fb7dc0a8ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:03:01.479 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:01.472+0000 7fb7e3a17640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb7dc14fd10 0x7fb7dc144a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:03:01.479 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:01.472+0000 7fb7e3a17640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7dc1f05f0 con 0x7fb7dc071e30 2023-11-28T20:03:01.479 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:01.472+0000 7fb7e3a17640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7dc0a6970 con 0x7fb7dc14fd10 2023-11-28T20:03:01.479 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:01.472+0000 7fb7e3a17640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb7dc0a6c50 con 0x7fb7dc0722c0 2023-11-28T20:03:01.479 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:01.472+0000 7fb7e17b3640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb7dc071e30 0x7fb7dc0ab1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:03:01.479 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:01.472+0000 7fb7e17b3640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb7dc071e30 0x7fb7dc0ab1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:41880/0 (socket says 172.21.15.78:41880) 2023-11-28T20:03:01.479 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:01.472+0000 7fb7e17b3640 1 -- 172.21.15.78:0/2140228005 learned_addr learned my addr 172.21.15.78:0/2140228005 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T20:03:01.480 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:01.472+0000 7fb7e1fb4640 1 --2- 172.21.15.78:0/2140228005 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb7dc14fd10 0x7fb7dc144a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:03:01.480 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:01.472+0000 7fb7e0fb2640 1 --2- 172.21.15.78:0/2140228005 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb7dc0722c0 0x7fb7dc0a8ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:03:01.480 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:01.472+0000 7fb7e17b3640 1 -- 172.21.15.78:0/2140228005 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb7dc0722c0 msgr2=0x7fb7dc0a8ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:03:01.480 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:01.472+0000 7fb7e17b3640 1 --2- 172.21.15.78:0/2140228005 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb7dc0722c0 0x7fb7dc0a8ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:03:01.480 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:01.472+0000 7fb7e17b3640 1 -- 172.21.15.78:0/2140228005 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb7dc14fd10 msgr2=0x7fb7dc144a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:03:01.480 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:01.472+0000 7fb7e17b3640 1 --2- 172.21.15.78:0/2140228005 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb7dc14fd10 0x7fb7dc144a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:03:01.480 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:01.472+0000 7fb7e17b3640 1 -- 172.21.15.78:0/2140228005 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7d4009a70 con 0x7fb7dc071e30 2023-11-28T20:03:01.480 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:01.472+0000 7fb7e1fb4640 1 --2- 172.21.15.78:0/2140228005 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb7dc14fd10 0x7fb7dc144a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T20:03:01.480 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:01.472+0000 7fb7e17b3640 1 --2- 172.21.15.78:0/2140228005 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb7dc071e30 0x7fb7dc0ab1c0 secure :-1 s=READY pgs=1121 cs=0 l=1 rev1=1 crypto rx=0x7fb7d800c4d0 tx=0x7fb7d800c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:03:01.480 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:01.476+0000 7fb7d1ffb640 1 -- 172.21.15.78:0/2140228005 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7d8005cf0 con 0x7fb7dc071e30 2023-11-28T20:03:01.480 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:01.476+0000 7fb7d1ffb640 1 -- 172.21.15.78:0/2140228005 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb7d8005e50 con 0x7fb7dc071e30 2023-11-28T20:03:01.480 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:01.476+0000 7fb7d1ffb640 1 -- 172.21.15.78:0/2140228005 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7d8007290 con 0x7fb7dc071e30 2023-11-28T20:03:01.481 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:01.476+0000 7fb7e3a17640 1 -- 172.21.15.78:0/2140228005 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb7dc0a6f30 con 0x7fb7dc071e30 2023-11-28T20:03:01.481 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:01.476+0000 7fb7e3a17640 1 -- 172.21.15.78:0/2140228005 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb7dc0aa090 con 0x7fb7dc071e30 2023-11-28T20:03:01.481 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:01.476+0000 7fb7e3a17640 1 -- 172.21.15.78:0/2140228005 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb7dc1f0730 con 0x7fb7dc071e30 2023-11-28T20:03:01.482 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:01.476+0000 7fb7d1ffb640 1 -- 172.21.15.78:0/2140228005 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fb7d80073f0 con 0x7fb7dc071e30 2023-11-28T20:03:01.482 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:01.476+0000 7fb7d1ffb640 1 --2- 172.21.15.78:0/2140228005 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fb7c0066470 0x7fb7c0068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:03:01.482 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:01.476+0000 7fb7d1ffb640 1 -- 172.21.15.78:0/2140228005 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 6206+0+0 (secure 0 0 0) 0x7fb7d8083570 con 0x7fb7dc071e30 2023-11-28T20:03:01.482 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:01.476+0000 7fb7e0fb2640 1 --2- 172.21.15.78:0/2140228005 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fb7c0066470 0x7fb7c0068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:03:01.483 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:01.476+0000 7fb7e0fb2640 1 --2- 172.21.15.78:0/2140228005 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fb7c0066470 0x7fb7c0068930 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7fb7dc153fa0 tx=0x7fb7cc009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:03:01.486 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:01.480+0000 7fb7d1ffb640 1 -- 172.21.15.78:0/2140228005 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fb7dc1f0730 con 0x7fb7dc071e30 2023-11-28T20:03:01.665 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:01.660+0000 7fb7e3a17640 1 -- 172.21.15.78:0/2140228005 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb7dc1f0730 con 0x7fb7dc071e30 2023-11-28T20:03:01.666 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:01.660+0000 7fb7d1ffb640 1 -- 172.21.15.78:0/2140228005 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 53 v53) v1 ==== 94+0+4923 (secure 0 0 0) 0x7fb7dc1f0730 con 0x7fb7dc071e30 2023-11-28T20:03:01.666 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-11-28T20:03:01.666 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":53,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5834,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6834/3259525552","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6832","nonce":3259525552},{"type":"v1","addr":"172.21.15.179:6834","nonce":3259525552}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":41},{"gid":6466,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6836/3096284673","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6834","nonce":3096284673},{"type":"v1","addr":"172.21.15.78:6836","nonce":3096284673}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":41},{"gid":7320,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6837/1031394527","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6835","nonce":1031394527},{"type":"v1","addr":"172.21.15.78:6837","nonce":1031394527}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":53}],"filesystems":[{"mdsmap":{"epoch":51,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-28T20:02:25.231135+0000","modified":"2023-11-28T20:02:28.250515+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":6478},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6478":{"gid":6478,"name":"b","rank":0,"incarnation":47,"state":"up:active","state_seq":7,"addr":"172.21.15.179:6835/2749579094","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6833","nonce":2749579094},{"type":"v1","addr":"172.21.15.179:6835","nonce":2749579094}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs2","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":7}]} 2023-11-28T20:03:01.666 INFO:teuthology.orchestra.run.smithi078.stderr:dumped fsmap epoch 53 2023-11-28T20:03:01.668 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:01.664+0000 7fb7e3a17640 1 -- 172.21.15.78:0/2140228005 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fb7c0066470 msgr2=0x7fb7c0068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:03:01.668 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:01.664+0000 7fb7e3a17640 1 --2- 172.21.15.78:0/2140228005 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fb7c0066470 0x7fb7c0068930 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7fb7dc153fa0 tx=0x7fb7cc009040 comp rx=0 tx=0).stop 2023-11-28T20:03:01.668 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:01.664+0000 7fb7e3a17640 1 -- 172.21.15.78:0/2140228005 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb7dc071e30 msgr2=0x7fb7dc0ab1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:03:01.668 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:01.664+0000 7fb7e3a17640 1 --2- 172.21.15.78:0/2140228005 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb7dc071e30 0x7fb7dc0ab1c0 secure :-1 s=READY pgs=1121 cs=0 l=1 rev1=1 crypto rx=0x7fb7d800c4d0 tx=0x7fb7d800c990 comp rx=0 tx=0).stop 2023-11-28T20:03:01.668 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:01.664+0000 7fb7e3a17640 1 -- 172.21.15.78:0/2140228005 shutdown_connections 2023-11-28T20:03:01.668 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:01.664+0000 7fb7e3a17640 1 --2- 172.21.15.78:0/2140228005 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fb7c0066470 0x7fb7c0068930 unknown :-1 s=CLOSED pgs=530 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:03:01.668 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:01.664+0000 7fb7e3a17640 1 --2- 172.21.15.78:0/2140228005 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb7dc0722c0 0x7fb7dc0a8ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:03:01.669 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:01.664+0000 7fb7e3a17640 1 --2- 172.21.15.78:0/2140228005 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb7dc14fd10 0x7fb7dc144a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:03:01.669 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:01.664+0000 7fb7e3a17640 1 --2- 172.21.15.78:0/2140228005 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb7dc071e30 0x7fb7dc0ab1c0 unknown :-1 s=CLOSED pgs=1121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:03:01.669 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:01.664+0000 7fb7e3a17640 1 -- 172.21.15.78:0/2140228005 >> 172.21.15.78:0/2140228005 conn(0x7fb7dc0a7810 msgr2=0x7fb7dc148cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:03:01.669 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:01.664+0000 7fb7e3a17640 1 -- 172.21.15.78:0/2140228005 shutdown_connections 2023-11-28T20:03:01.669 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:01.664+0000 7fb7e3a17640 1 -- 172.21.15.78:0/2140228005 wait complete. 2023-11-28T20:03:01.687 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-28T20:03:01.824 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:01.820+0000 7fd3fbafd640 1 Processor -- start 2023-11-28T20:03:01.824 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:01.820+0000 7fd3fbafd640 1 -- start start 2023-11-28T20:03:01.825 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:01.820+0000 7fd3fbafd640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd3f414e570 0x7fd3f40c7cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:03:01.825 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:01.820+0000 7fd3fbafd640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fd3f40ca190 0x7fd3f40ca600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:03:01.825 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:01.820+0000 7fd3fbafd640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd3f40c81f0 con 0x7fd3f4154fd0 2023-11-28T20:03:01.825 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:01.820+0000 7fd3fbafd640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd3f40c5140 con 0x7fd3f40ca190 2023-11-28T20:03:01.826 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:01.820+0000 7fd3fbafd640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd3f40c4b80 con 0x7fd3f414e570 2023-11-28T20:03:01.826 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:01.820+0000 7fd3f9098640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7fd3f4154fd0 0x7fd3f41584e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:51084/0 (socket says 172.21.15.78:51084) 2023-11-28T20:03:01.826 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:01.820+0000 7fd3f9098640 1 -- 172.21.15.78:0/1737098897 learned_addr learned my addr 172.21.15.78:0/1737098897 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-11-28T20:03:01.828 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:01.820+0000 7fd3f9899640 1 --2- 172.21.15.78:0/1737098897 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd3f414e570 0x7fd3f40c7cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:03:01.828 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:01.820+0000 7fd3fa09a640 1 --2- 172.21.15.78:0/1737098897 >> v2:172.21.15.179:3300/0 conn(0x7fd3f40ca190 0x7fd3f40ca600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:03:01.828 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:01.820+0000 7fd3f8897640 1 -- 172.21.15.78:0/1737098897 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3739652430 0 0) 0x7fd3f40c81f0 con 0x7fd3f4154fd0 2023-11-28T20:03:01.828 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:01.820+0000 7fd3f8897640 1 -- 172.21.15.78:0/1737098897 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd3e0003530 con 0x7fd3f4154fd0 2023-11-28T20:03:01.828 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:01.820+0000 7fd3f8897640 1 -- 172.21.15.78:0/1737098897 <== mon.0 v1:172.21.15.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1503565426 0 0) 0x7fd3e0003530 con 0x7fd3f4154fd0 2023-11-28T20:03:01.828 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:01.820+0000 7fd3f8897640 1 -- 172.21.15.78:0/1737098897 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd3f414e570 msgr2=0x7fd3f40c7cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:03:01.828 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:01.820+0000 7fd3f8897640 1 --2- 172.21.15.78:0/1737098897 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd3f414e570 0x7fd3f40c7cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:03:01.828 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:01.820+0000 7fd3f8897640 1 -- 172.21.15.78:0/1737098897 >> v2:172.21.15.179:3300/0 conn(0x7fd3f40ca190 msgr2=0x7fd3f40ca600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:03:01.828 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:01.820+0000 7fd3f8897640 1 --2- 172.21.15.78:0/1737098897 >> v2:172.21.15.179:3300/0 conn(0x7fd3f40ca190 0x7fd3f40ca600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:03:01.828 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:01.820+0000 7fd3f8897640 1 -- 172.21.15.78:0/1737098897 --> v1:172.21.15.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3f40c4e60 con 0x7fd3f4154fd0 2023-11-28T20:03:01.829 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:01.820+0000 7fd3f8897640 1 -- 172.21.15.78:0/1737098897 <== mon.0 v1:172.21.15.78:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3326804700 0 0) 0x7fd3e40016a0 con 0x7fd3f4154fd0 2023-11-28T20:03:01.829 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:01.820+0000 7fd3f8897640 1 -- 172.21.15.78:0/1737098897 >> v1:172.21.15.78:6789/0 conn(0x7fd3f4154fd0 legacy=0x7fd3f41584e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:03:01.829 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:01.820+0000 7fd3f8897640 1 --2- 172.21.15.78:0/1737098897 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd3e0003980 0x7fd3e0003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:03:01.829 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:01.820+0000 7fd3f8897640 1 --2- 172.21.15.78:0/1737098897 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd3f414e570 0x7fd3e00047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:03:01.829 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:01.820+0000 7fd3f8897640 1 --2- 172.21.15.78:0/1737098897 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd3e0004d10 0x7fd3e0005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:03:01.829 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:01.820+0000 7fd3f8897640 1 -- 172.21.15.78:0/1737098897 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3f40c5140 con 0x7fd3e0004d10 2023-11-28T20:03:01.829 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:01.820+0000 7fd3f8897640 1 -- 172.21.15.78:0/1737098897 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3f40c4b80 con 0x7fd3e0003980 2023-11-28T20:03:01.829 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:01.820+0000 7fd3f8897640 1 -- 172.21.15.78:0/1737098897 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd3e000b990 con 0x7fd3f414e570 2023-11-28T20:03:01.829 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:01.824+0000 7fd3f9899640 1 --2- 172.21.15.78:0/1737098897 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd3e0003980 0x7fd3e0003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:03:01.829 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:01.824+0000 7fd3fa09a640 1 --2- 172.21.15.78:0/1737098897 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd3e0004d10 0x7fd3e0005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:03:01.829 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:01.824+0000 7fd3f9098640 1 --2- 172.21.15.78:0/1737098897 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd3f414e570 0x7fd3e00047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:03:01.829 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:01.824+0000 7fd3fa09a640 1 -- 172.21.15.78:0/1737098897 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd3f414e570 msgr2=0x7fd3e00047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:03:01.830 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:01.824+0000 7fd3fa09a640 1 --2- 172.21.15.78:0/1737098897 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd3f414e570 0x7fd3e00047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:03:01.830 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:01.824+0000 7fd3fa09a640 1 -- 172.21.15.78:0/1737098897 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd3e0003980 msgr2=0x7fd3e0003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:03:01.830 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:01.824+0000 7fd3fa09a640 1 --2- 172.21.15.78:0/1737098897 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd3e0003980 0x7fd3e0003da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:03:01.830 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:01.824+0000 7fd3fa09a640 1 -- 172.21.15.78:0/1737098897 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3e0003530 con 0x7fd3e0004d10 2023-11-28T20:03:01.831 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:01.824+0000 7fd3fa09a640 1 --2- 172.21.15.78:0/1737098897 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd3e0004d10 0x7fd3e0005190 secure :-1 s=READY pgs=1123 cs=0 l=1 rev1=1 crypto rx=0x7fd3ec009fc0 tx=0x7fd3ec01cca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=df3e8dfb8ac07454 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:03:01.831 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:01.824+0000 7fd3f8897640 1 -- 172.21.15.78:0/1737098897 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3ec0a5cb0 con 0x7fd3e0004d10 2023-11-28T20:03:01.831 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:01.824+0000 7fd3f8897640 1 -- 172.21.15.78:0/1737098897 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd3ec00f040 con 0x7fd3e0004d10 2023-11-28T20:03:01.831 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:01.824+0000 7fd3f8897640 1 -- 172.21.15.78:0/1737098897 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3ec0ad680 con 0x7fd3e0004d10 2023-11-28T20:03:01.831 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:01.828+0000 7fd3fbafd640 1 -- 172.21.15.78:0/1737098897 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd3e0004d10 msgr2=0x7fd3e0005190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:03:01.831 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:01.828+0000 7fd3fbafd640 1 --2- 172.21.15.78:0/1737098897 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd3e0004d10 0x7fd3e0005190 secure :-1 s=READY pgs=1123 cs=0 l=1 rev1=1 crypto rx=0x7fd3ec009fc0 tx=0x7fd3ec01cca0 comp rx=0 tx=0).stop 2023-11-28T20:03:01.832 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:01.828+0000 7fd3fa09a640 1 -- 172.21.15.78:0/1737098897 reap_dead start 2023-11-28T20:03:01.832 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:01.828+0000 7fd3fbafd640 1 -- 172.21.15.78:0/1737098897 shutdown_connections 2023-11-28T20:03:01.832 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:01.828+0000 7fd3fbafd640 1 -- 172.21.15.78:0/1737098897 >> 172.21.15.78:0/1737098897 conn(0x7fd3f40abb10 msgr2=0x7fd3f40abf20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:03:01.832 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:01.828+0000 7fd3fbafd640 1 -- 172.21.15.78:0/1737098897 shutdown_connections 2023-11-28T20:03:01.832 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:01.828+0000 7fd3fbafd640 1 -- 172.21.15.78:0/1737098897 wait complete. 2023-11-28T20:03:01.832 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:01.828+0000 7fd3fbafd640 1 Processor -- start 2023-11-28T20:03:01.832 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:01.828+0000 7fd3fbafd640 1 -- start start 2023-11-28T20:03:01.835 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:01.828+0000 7fd3fbafd640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd3e0004d10 0x7fd3f41eb5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:03:01.835 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:01.828+0000 7fd3fbafd640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd3f40af3b0 0x7fd3f40adca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:03:01.835 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:01.828+0000 7fd3fbafd640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd3f41ed910 0x7fd3f414adb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:03:01.835 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:01.828+0000 7fd3fbafd640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3f4151550 con 0x7fd3f41ed910 2023-11-28T20:03:01.835 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:01.828+0000 7fd3fbafd640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3f41ebaf0 con 0x7fd3f40af3b0 2023-11-28T20:03:01.835 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:01.828+0000 7fd3fbafd640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd3f40ad4e0 con 0x7fd3e0004d10 2023-11-28T20:03:01.835 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:01.828+0000 7fd3fa09a640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd3f41ed910 0x7fd3f414adb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:03:01.835 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:01.828+0000 7fd3fa09a640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd3f41ed910 0x7fd3f414adb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:41896/0 (socket says 172.21.15.78:41896) 2023-11-28T20:03:01.835 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:01.828+0000 7fd3fa09a640 1 -- 172.21.15.78:0/1042615928 learned_addr learned my addr 172.21.15.78:0/1042615928 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T20:03:01.835 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:01.828+0000 7fd3f9098640 1 --2- 172.21.15.78:0/1042615928 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd3f40af3b0 0x7fd3f40adca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:03:01.835 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:01.828+0000 7fd3fa09a640 1 -- 172.21.15.78:0/1042615928 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd3e0004d10 msgr2=0x7fd3f41eb5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:03:01.836 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:01.828+0000 7fd3fa09a640 1 --2- 172.21.15.78:0/1042615928 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd3e0004d10 0x7fd3f41eb5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:03:01.836 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:01.828+0000 7fd3fa09a640 1 -- 172.21.15.78:0/1042615928 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd3f40af3b0 msgr2=0x7fd3f40adca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:03:01.836 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:01.828+0000 7fd3fa09a640 1 --2- 172.21.15.78:0/1042615928 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd3f40af3b0 0x7fd3f40adca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:03:01.836 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:01.828+0000 7fd3fa09a640 1 -- 172.21.15.78:0/1042615928 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3f41ee260 con 0x7fd3f41ed910 2023-11-28T20:03:01.836 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:01.828+0000 7fd3f9098640 1 --2- 172.21.15.78:0/1042615928 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd3f40af3b0 0x7fd3f40adca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T20:03:01.836 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:01.828+0000 7fd3fa09a640 1 --2- 172.21.15.78:0/1042615928 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd3f41ed910 0x7fd3f414adb0 secure :-1 s=READY pgs=1124 cs=0 l=1 rev1=1 crypto rx=0x7fd3ec002240 tx=0x7fd3ec009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:03:01.836 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:01.832+0000 7fd3ea7fc640 1 -- 172.21.15.78:0/1042615928 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3ec0039a0 con 0x7fd3f41ed910 2023-11-28T20:03:01.836 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:01.832+0000 7fd3ea7fc640 1 -- 172.21.15.78:0/1042615928 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd3ec003b00 con 0x7fd3f41ed910 2023-11-28T20:03:01.836 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:01.832+0000 7fd3ea7fc640 1 -- 172.21.15.78:0/1042615928 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3ec003e70 con 0x7fd3f41ed910 2023-11-28T20:03:01.836 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:01.832+0000 7fd3fbafd640 1 -- 172.21.15.78:0/1042615928 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd3f40ad780 con 0x7fd3f41ed910 2023-11-28T20:03:01.836 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:01.832+0000 7fd3fbafd640 1 -- 172.21.15.78:0/1042615928 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd3f41ee540 con 0x7fd3f41ed910 2023-11-28T20:03:01.837 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:01.832+0000 7fd3fbafd640 1 -- 172.21.15.78:0/1042615928 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd3f40ad970 con 0x7fd3f41ed910 2023-11-28T20:03:01.837 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:01.832+0000 7fd3ea7fc640 1 -- 172.21.15.78:0/1042615928 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fd3ec0b4040 con 0x7fd3f41ed910 2023-11-28T20:03:01.837 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:01.832+0000 7fd3ea7fc640 1 --2- 172.21.15.78:0/1042615928 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fd3d80664a0 0x7fd3d8068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:03:01.838 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:01.832+0000 7fd3ea7fc640 1 -- 172.21.15.78:0/1042615928 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 6206+0+0 (secure 0 0 0) 0x7fd3ec11d8d0 con 0x7fd3f41ed910 2023-11-28T20:03:01.838 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:01.832+0000 7fd3f9899640 1 --2- 172.21.15.78:0/1042615928 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fd3d80664a0 0x7fd3d8068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:03:01.838 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:01.832+0000 7fd3f9899640 1 --2- 172.21.15.78:0/1042615928 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fd3d80664a0 0x7fd3d8068960 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7fd3f40ab240 tx=0x7fd3f0009340 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:03:01.841 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:01.836+0000 7fd3ea7fc640 1 -- 172.21.15.78:0/1042615928 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fd3ec0eab70 con 0x7fd3f41ed910 2023-11-28T20:03:01.993 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:01.988+0000 7fd3fbafd640 1 -- 172.21.15.78:0/1042615928 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd3f4067630 con 0x7fd3f41ed910 2023-11-28T20:03:01.995 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:01.992+0000 7fd3ea7fc640 1 -- 172.21.15.78:0/1042615928 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v90) v1 ==== 74+0+16956 (secure 0 0 0) 0x7fd3ec0bc090 con 0x7fd3f41ed910 2023-11-28T20:03:01.995 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-11-28T20:03:01.995 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":90,"fsid":"dd9780e8-3bda-44fa-a9f0-fa07d19d901d","created":"2023-11-28T19:58:40.969556+0000","modified":"2023-11-28T20:02:58.914049+0000","last_up_change":"2023-11-28T19:58:52.596716+0000","last_in_change":"2023-11-28T19:58:43.609275+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":16,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-28T19:58:54.011229+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs2_metadata","create_time":"2023-11-28T20:02:23.066724+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":16,"pool_name":"cephfs2_data","create_time":"2023-11-28T20:02:24.230614+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs2"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e84245ac-b5da-429e-af18-39acaa2b33e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6800","nonce":3358701235},{"type":"v1","addr":"172.21.15.78:6801","nonce":3358701235}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6802","nonce":3358701235},{"type":"v1","addr":"172.21.15.78:6803","nonce":3358701235}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6806","nonce":3358701235},{"type":"v1","addr":"172.21.15.78:6807","nonce":3358701235}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6804","nonce":3358701235},{"type":"v1","addr":"172.21.15.78:6805","nonce":3358701235}]},"public_addr":"172.21.15.78:6801/3358701235","cluster_addr":"172.21.15.78:6803/3358701235","heartbeat_back_addr":"172.21.15.78:6807/3358701235","heartbeat_front_addr":"172.21.15.78:6805/3358701235","state":["exists","up"]},{"osd":1,"uuid":"e634831d-c4e2-48d9-870c-9556ae162981","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6808","nonce":3211476654},{"type":"v1","addr":"172.21.15.78:6809","nonce":3211476654}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6810","nonce":3211476654},{"type":"v1","addr":"172.21.15.78:6811","nonce":3211476654}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6814","nonce":3211476654},{"type":"v1","addr":"172.21.15.78:6815","nonce":3211476654}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6812","nonce":3211476654},{"type":"v1","addr":"172.21.15.78:6813","nonce":3211476654}]},"public_addr":"172.21.15.78:6809/3211476654","cluster_addr":"172.21.15.78:6811/3211476654","heartbeat_back_addr":"172.21.15.78:6815/3211476654","heartbeat_front_addr":"172.21.15.78:6813/3211476654","state":["exists","up"]},{"osd":2,"uuid":"274c8395-6534-41f0-b8fb-a00af8985aa8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6816","nonce":2532904479},{"type":"v1","addr":"172.21.15.78:6817","nonce":2532904479}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6818","nonce":2532904479},{"type":"v1","addr":"172.21.15.78:6819","nonce":2532904479}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6822","nonce":2532904479},{"type":"v1","addr":"172.21.15.78:6823","nonce":2532904479}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6820","nonce":2532904479},{"type":"v1","addr":"172.21.15.78:6821","nonce":2532904479}]},"public_addr":"172.21.15.78:6817/2532904479","cluster_addr":"172.21.15.78:6819/2532904479","heartbeat_back_addr":"172.21.15.78:6823/2532904479","heartbeat_front_addr":"172.21.15.78:6821/2532904479","state":["exists","up"]},{"osd":3,"uuid":"77acc9af-7d4d-4b18-8cf5-d62f5971b7c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6824","nonce":3442991267},{"type":"v1","addr":"172.21.15.78:6825","nonce":3442991267}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6826","nonce":3442991267},{"type":"v1","addr":"172.21.15.78:6827","nonce":3442991267}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6830","nonce":3442991267},{"type":"v1","addr":"172.21.15.78:6831","nonce":3442991267}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6828","nonce":3442991267},{"type":"v1","addr":"172.21.15.78:6829","nonce":3442991267}]},"public_addr":"172.21.15.78:6825/3442991267","cluster_addr":"172.21.15.78:6827/3442991267","heartbeat_back_addr":"172.21.15.78:6831/3442991267","heartbeat_front_addr":"172.21.15.78:6829/3442991267","state":["exists","up"]},{"osd":4,"uuid":"5c62bc66-6b34-4b7f-a66b-9a743969138c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":802983577},{"type":"v1","addr":"172.21.15.179:6809","nonce":802983577}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":802983577},{"type":"v1","addr":"172.21.15.179:6811","nonce":802983577}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":802983577},{"type":"v1","addr":"172.21.15.179:6815","nonce":802983577}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":802983577},{"type":"v1","addr":"172.21.15.179:6813","nonce":802983577}]},"public_addr":"172.21.15.179:6809/802983577","cluster_addr":"172.21.15.179:6811/802983577","heartbeat_back_addr":"172.21.15.179:6815/802983577","heartbeat_front_addr":"172.21.15.179:6813/802983577","state":["exists","up"]},{"osd":5,"uuid":"67db6d36-f684-4079-b0cd-82b4dd61461f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":518192887},{"type":"v1","addr":"172.21.15.179:6818","nonce":518192887}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":518192887},{"type":"v1","addr":"172.21.15.179:6822","nonce":518192887}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":518192887},{"type":"v1","addr":"172.21.15.179:6829","nonce":518192887}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6824","nonce":518192887},{"type":"v1","addr":"172.21.15.179:6826","nonce":518192887}]},"public_addr":"172.21.15.179:6818/518192887","cluster_addr":"172.21.15.179:6822/518192887","heartbeat_back_addr":"172.21.15.179:6829/518192887","heartbeat_front_addr":"172.21.15.179:6826/518192887","state":["exists","up"]},{"osd":6,"uuid":"12e670af-5a16-4c81-9f97-defa66cab967","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":815435378},{"type":"v1","addr":"172.21.15.179:6801","nonce":815435378}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":815435378},{"type":"v1","addr":"172.21.15.179:6803","nonce":815435378}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":815435378},{"type":"v1","addr":"172.21.15.179:6807","nonce":815435378}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":815435378},{"type":"v1","addr":"172.21.15.179:6805","nonce":815435378}]},"public_addr":"172.21.15.179:6801/815435378","cluster_addr":"172.21.15.179:6803/815435378","heartbeat_back_addr":"172.21.15.179:6807/815435378","heartbeat_front_addr":"172.21.15.179:6805/815435378","state":["exists","up"]},{"osd":7,"uuid":"fe630650-2eb3-49ad-8676-c341e6332eb1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6817","nonce":2848432339},{"type":"v1","addr":"172.21.15.179:6819","nonce":2848432339}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6821","nonce":2848432339},{"type":"v1","addr":"172.21.15.179:6823","nonce":2848432339}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":2848432339},{"type":"v1","addr":"172.21.15.179:6831","nonce":2848432339}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6825","nonce":2848432339},{"type":"v1","addr":"172.21.15.179:6827","nonce":2848432339}]},"public_addr":"172.21.15.179:6819/2848432339","cluster_addr":"172.21.15.179:6823/2848432339","heartbeat_back_addr":"172.21.15.179:6831/2848432339","heartbeat_front_addr":"172.21.15.179:6827/2848432339","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:58:49.255433+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:58:49.412880+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:58:49.559295+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:58:49.245237+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:58:49.184557+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:58:49.329851+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:58:49.366012+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:58:49.349604+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"16.1f","mappings":[{"from":5,"to":4}]},{"pgid":"16.26","mappings":[{"from":6,"to":7}]},{"pgid":"16.3a","mappings":[{"from":1,"to":4}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.78:6837/20108235":"2023-11-29T20:02:55.575854+0000","172.21.15.78:6835/20108235":"2023-11-29T20:02:55.575854+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-28T20:03:01.997 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:01.992+0000 7fd3fbafd640 1 -- 172.21.15.78:0/1042615928 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fd3d80664a0 msgr2=0x7fd3d8068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:03:01.997 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:01.992+0000 7fd3fbafd640 1 --2- 172.21.15.78:0/1042615928 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fd3d80664a0 0x7fd3d8068960 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7fd3f40ab240 tx=0x7fd3f0009340 comp rx=0 tx=0).stop 2023-11-28T20:03:01.997 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:01.992+0000 7fd3fbafd640 1 -- 172.21.15.78:0/1042615928 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd3f41ed910 msgr2=0x7fd3f414adb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:03:01.997 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:01.992+0000 7fd3fbafd640 1 --2- 172.21.15.78:0/1042615928 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd3f41ed910 0x7fd3f414adb0 secure :-1 s=READY pgs=1124 cs=0 l=1 rev1=1 crypto rx=0x7fd3ec002240 tx=0x7fd3ec009750 comp rx=0 tx=0).stop 2023-11-28T20:03:01.997 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:01.992+0000 7fd3fbafd640 1 -- 172.21.15.78:0/1042615928 shutdown_connections 2023-11-28T20:03:01.997 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:01.992+0000 7fd3fbafd640 1 --2- 172.21.15.78:0/1042615928 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fd3d80664a0 0x7fd3d8068960 unknown :-1 s=CLOSED pgs=531 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:03:01.998 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:01.992+0000 7fd3fbafd640 1 --2- 172.21.15.78:0/1042615928 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd3f41ed910 0x7fd3f414adb0 unknown :-1 s=CLOSED pgs=1124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:03:01.998 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:01.992+0000 7fd3fbafd640 1 --2- 172.21.15.78:0/1042615928 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd3f40af3b0 0x7fd3f40adca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:03:01.998 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:01.992+0000 7fd3fbafd640 1 --2- 172.21.15.78:0/1042615928 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd3e0004d10 0x7fd3f41eb5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:03:01.998 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:01.992+0000 7fd3fbafd640 1 -- 172.21.15.78:0/1042615928 >> 172.21.15.78:0/1042615928 conn(0x7fd3f40abb10 msgr2=0x7fd3f40c67c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:03:01.998 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:01.992+0000 7fd3fbafd640 1 -- 172.21.15.78:0/1042615928 shutdown_connections 2023-11-28T20:03:01.998 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:01.992+0000 7fd3fbafd640 1 -- 172.21.15.78:0/1042615928 wait complete. 2023-11-28T20:03:02.017 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs2 2023-11-28T20:03:02.155 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:02.152+0000 7f2635a79640 1 Processor -- start 2023-11-28T20:03:02.155 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:02.152+0000 7f2635a79640 1 -- start start 2023-11-28T20:03:02.157 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:02.152+0000 7f2635a79640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f2630154390 0x7f26300c4a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:03:02.157 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:02.152+0000 7f2635a79640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f26300c2110 0x7f26300c5ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:03:02.157 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:02.152+0000 7f2635a79640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f26300c4f80 0x7f26300c61e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:03:02.157 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:02.152+0000 7f2635a79640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f26300aa1c0 con 0x7f26300c4f80 2023-11-28T20:03:02.157 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:02.152+0000 7f2635a79640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2630154770 con 0x7f2630154390 2023-11-28T20:03:02.157 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:02.152+0000 7f2635a79640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f26300a93d0 con 0x7f26300c2110 2023-11-28T20:03:02.157 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:02.152+0000 7f262ffff640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f26300c4f80 0x7f26300c61e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:03:02.157 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:02.152+0000 7f262ffff640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f26300c4f80 0x7f26300c61e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:41898/0 (socket says 172.21.15.78:41898) 2023-11-28T20:03:02.157 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:02.152+0000 7f262ffff640 1 -- 172.21.15.78:0/1385213827 learned_addr learned my addr 172.21.15.78:0/1385213827 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T20:03:02.157 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:02.152+0000 7f262f7fe640 1 --2- 172.21.15.78:0/1385213827 >> v2:172.21.15.179:3300/0 conn(0x7f2630154390 0x7f26300c4a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:03:02.158 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:02.152+0000 7f262effd640 1 --2- 172.21.15.78:0/1385213827 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f26300c2110 0x7f26300c5ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:03:02.158 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:02.152+0000 7f262ffff640 1 -- 172.21.15.78:0/1385213827 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f26300c2110 msgr2=0x7f26300c5ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:03:02.158 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:02.152+0000 7f262ffff640 1 --2- 172.21.15.78:0/1385213827 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f26300c2110 0x7f26300c5ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:03:02.158 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:02.152+0000 7f262ffff640 1 -- 172.21.15.78:0/1385213827 >> v2:172.21.15.179:3300/0 conn(0x7f2630154390 msgr2=0x7f26300c4a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:03:02.158 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:02.152+0000 7f262ffff640 1 --2- 172.21.15.78:0/1385213827 >> v2:172.21.15.179:3300/0 conn(0x7f2630154390 0x7f26300c4a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:03:02.158 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:02.152+0000 7f262ffff640 1 -- 172.21.15.78:0/1385213827 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26300a9640 con 0x7f26300c4f80 2023-11-28T20:03:02.159 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:02.156+0000 7f262ffff640 1 --2- 172.21.15.78:0/1385213827 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f26300c4f80 0x7f26300c61e0 secure :-1 s=READY pgs=1125 cs=0 l=1 rev1=1 crypto rx=0x7f26300a83b0 tx=0x7f262801ebd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b99743a80d5b521f server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:03:02.161 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:02.156+0000 7f262e7fc640 1 -- 172.21.15.78:0/1385213827 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f262800b2d0 con 0x7f26300c4f80 2023-11-28T20:03:02.162 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:02.156+0000 7f262e7fc640 1 -- 172.21.15.78:0/1385213827 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f262800b430 con 0x7f26300c4f80 2023-11-28T20:03:02.162 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:02.156+0000 7f262e7fc640 1 -- 172.21.15.78:0/1385213827 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26280a7c80 con 0x7f26300c4f80 2023-11-28T20:03:02.162 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:02.156+0000 7f2635a79640 1 -- 172.21.15.78:0/1385213827 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f26300c4f80 msgr2=0x7f26300c61e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:03:02.162 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:02.156+0000 7f2635a79640 1 --2- 172.21.15.78:0/1385213827 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f26300c4f80 0x7f26300c61e0 secure :-1 s=READY pgs=1125 cs=0 l=1 rev1=1 crypto rx=0x7f26300a83b0 tx=0x7f262801ebd0 comp rx=0 tx=0).stop 2023-11-28T20:03:02.162 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:02.156+0000 7f2635a79640 1 -- 172.21.15.78:0/1385213827 shutdown_connections 2023-11-28T20:03:02.162 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:02.156+0000 7f2635a79640 1 --2- 172.21.15.78:0/1385213827 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f26300c4f80 0x7f26300c61e0 unknown :-1 s=CLOSED pgs=1125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:03:02.162 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:02.156+0000 7f2635a79640 1 --2- 172.21.15.78:0/1385213827 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f26300c2110 0x7f26300c5ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:03:02.162 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:02.156+0000 7f2635a79640 1 --2- 172.21.15.78:0/1385213827 >> v2:172.21.15.179:3300/0 conn(0x7f2630154390 0x7f26300c4a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:03:02.162 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:02.156+0000 7f2635a79640 1 -- 172.21.15.78:0/1385213827 >> 172.21.15.78:0/1385213827 conn(0x7f263006b220 msgr2=0x7f26300a77e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:03:02.162 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:02.156+0000 7f2635a79640 1 -- 172.21.15.78:0/1385213827 shutdown_connections 2023-11-28T20:03:02.163 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:02.156+0000 7f2635a79640 1 -- 172.21.15.78:0/1385213827 wait complete. 2023-11-28T20:03:02.164 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:02.156+0000 7f2635a79640 1 Processor -- start 2023-11-28T20:03:02.165 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:02.160+0000 7f2635a79640 1 -- start start 2023-11-28T20:03:02.165 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:02.160+0000 7f2635a79640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f26300c2110 0x7f26301460f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:03:02.165 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:02.160+0000 7f2635a79640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f26300c4f80 0x7f263014d7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:03:02.165 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:02.160+0000 7f2635a79640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2630154390 0x7f2630149320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:03:02.165 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:02.160+0000 7f2635a79640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f263014d350 con 0x7f26300c2110 2023-11-28T20:03:02.165 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:02.160+0000 7f2635a79640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26301f0bc0 con 0x7f26300c4f80 2023-11-28T20:03:02.165 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:02.160+0000 7f2635a79640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f263014ca20 con 0x7f2630154390 2023-11-28T20:03:02.165 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:02.160+0000 7f262f7fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f26300c2110 0x7f26301460f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:03:02.165 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:02.160+0000 7f262f7fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f26300c2110 0x7f26301460f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:41902/0 (socket says 172.21.15.78:41902) 2023-11-28T20:03:02.165 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:02.160+0000 7f262f7fe640 1 -- 172.21.15.78:0/1177120349 learned_addr learned my addr 172.21.15.78:0/1177120349 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T20:03:02.166 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:02.160+0000 7f262ffff640 1 --2- 172.21.15.78:0/1177120349 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2630154390 0x7f2630149320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:03:02.166 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:02.160+0000 7f262effd640 1 --2- 172.21.15.78:0/1177120349 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f26300c4f80 0x7f263014d7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:03:02.166 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:02.160+0000 7f262f7fe640 1 -- 172.21.15.78:0/1177120349 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2630154390 msgr2=0x7f2630149320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:03:02.166 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:02.160+0000 7f262f7fe640 1 --2- 172.21.15.78:0/1177120349 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2630154390 0x7f2630149320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:03:02.166 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:02.160+0000 7f262f7fe640 1 -- 172.21.15.78:0/1177120349 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f26300c4f80 msgr2=0x7f263014d7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:03:02.166 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:02.160+0000 7f262f7fe640 1 --2- 172.21.15.78:0/1177120349 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f26300c4f80 0x7f263014d7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:03:02.166 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:02.160+0000 7f262f7fe640 1 -- 172.21.15.78:0/1177120349 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f262800bd40 con 0x7f26300c2110 2023-11-28T20:03:02.166 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:02.160+0000 7f262ffff640 1 --2- 172.21.15.78:0/1177120349 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2630154390 0x7f2630149320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T20:03:02.166 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:02.160+0000 7f262f7fe640 1 --2- 172.21.15.78:0/1177120349 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f26300c2110 0x7f26301460f0 secure :-1 s=READY pgs=1126 cs=0 l=1 rev1=1 crypto rx=0x7f262000e870 tx=0x7f262000ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:03:02.166 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:02.160+0000 7f2617fff640 1 -- 172.21.15.78:0/1177120349 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2620009510 con 0x7f26300c2110 2023-11-28T20:03:02.167 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:02.160+0000 7f2617fff640 1 -- 172.21.15.78:0/1177120349 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f262000eec0 con 0x7f26300c2110 2023-11-28T20:03:02.167 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:02.160+0000 7f2617fff640 1 -- 172.21.15.78:0/1177120349 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f262000cb40 con 0x7f26300c2110 2023-11-28T20:03:02.167 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:02.160+0000 7f2635a79640 1 -- 172.21.15.78:0/1177120349 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f263014cd00 con 0x7f26300c2110 2023-11-28T20:03:02.167 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:02.160+0000 7f2635a79640 1 -- 172.21.15.78:0/1177120349 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f26301f0870 con 0x7f26300c2110 2023-11-28T20:03:02.168 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:02.160+0000 7f2635a79640 1 -- 172.21.15.78:0/1177120349 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2630067630 con 0x7f26300c2110 2023-11-28T20:03:02.168 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:02.164+0000 7f2617fff640 1 -- 172.21.15.78:0/1177120349 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f262000cca0 con 0x7f26300c2110 2023-11-28T20:03:02.168 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:02.164+0000 7f2617fff640 1 --2- 172.21.15.78:0/1177120349 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f261c0664a0 0x7f261c068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:03:02.168 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:02.164+0000 7f2617fff640 1 -- 172.21.15.78:0/1177120349 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 6206+0+0 (secure 0 0 0) 0x7f26200841a0 con 0x7f26300c2110 2023-11-28T20:03:02.168 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:02.164+0000 7f262effd640 1 --2- 172.21.15.78:0/1177120349 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f261c0664a0 0x7f261c068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:03:02.169 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:02.164+0000 7f262effd640 1 --2- 172.21.15.78:0/1177120349 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f261c0664a0 0x7f261c068960 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7f2630144b10 tx=0x7f2624008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:03:02.171 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:02.168+0000 7f2617fff640 1 -- 172.21.15.78:0/1177120349 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f2620051420 con 0x7f26300c2110 2023-11-28T20:03:02.351 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:02.348+0000 7f2635a79640 1 -- 172.21.15.78:0/1177120349 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs2"} v 0) v1 -- 0x7f26300c0110 con 0x7f26300c2110 2023-11-28T20:03:02.352 INFO:tasks.ceph.mon.a.smithi078.stderr:2023-11-28T20:03:02.348+0000 7f3f494a3640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-11-28T20:03:02.354 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:02.348+0000 7f2617fff640 1 -- 172.21.15.78:0/1177120349 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs2"}]=0 cephfs2 marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v54) v1 ==== 163+0+0 (secure 0 0 0) 0x7f2620054a40 con 0x7f26300c2110 2023-11-28T20:03:02.354 INFO:teuthology.orchestra.run.smithi078.stderr:cephfs2 marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-11-28T20:03:02.356 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:02.352+0000 7f2635a79640 1 -- 172.21.15.78:0/1177120349 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f261c0664a0 msgr2=0x7f261c068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:03:02.357 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:02.352+0000 7f2635a79640 1 --2- 172.21.15.78:0/1177120349 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f261c0664a0 0x7f261c068960 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7f2630144b10 tx=0x7f2624008040 comp rx=0 tx=0).stop 2023-11-28T20:03:02.357 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:02.352+0000 7f2635a79640 1 -- 172.21.15.78:0/1177120349 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f26300c2110 msgr2=0x7f26301460f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:03:02.357 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:02.352+0000 7f2635a79640 1 --2- 172.21.15.78:0/1177120349 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f26300c2110 0x7f26301460f0 secure :-1 s=READY pgs=1126 cs=0 l=1 rev1=1 crypto rx=0x7f262000e870 tx=0x7f262000ec70 comp rx=0 tx=0).stop 2023-11-28T20:03:02.357 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:02.352+0000 7f2635a79640 1 -- 172.21.15.78:0/1177120349 shutdown_connections 2023-11-28T20:03:02.357 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:02.352+0000 7f2635a79640 1 --2- 172.21.15.78:0/1177120349 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f261c0664a0 0x7f261c068960 unknown :-1 s=CLOSED pgs=532 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:03:02.357 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:02.352+0000 7f2635a79640 1 --2- 172.21.15.78:0/1177120349 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2630154390 0x7f2630149320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:03:02.357 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:02.352+0000 7f2635a79640 1 --2- 172.21.15.78:0/1177120349 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f26300c4f80 0x7f263014d7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:03:02.357 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:02.352+0000 7f2635a79640 1 --2- 172.21.15.78:0/1177120349 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f26300c2110 0x7f26301460f0 unknown :-1 s=CLOSED pgs=1126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:03:02.357 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:02.352+0000 7f2635a79640 1 -- 172.21.15.78:0/1177120349 >> 172.21.15.78:0/1177120349 conn(0x7f263006b220 msgr2=0x7f2630151bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:03:02.358 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:02.352+0000 7f2635a79640 1 -- 172.21.15.78:0/1177120349 shutdown_connections 2023-11-28T20:03:02.358 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:02.352+0000 7f2635a79640 1 -- 172.21.15.78:0/1177120349 wait complete. 2023-11-28T20:03:02.365 INFO:tasks.ceph.mds.b.smithi179.stderr: -5818> 2023-11-28T20:02:02.338+0000 7f848d7ce640 -1 PosixStack listen unable to listen on v2:0.0.0.0:6832/0: (98) Address already in use 2023-11-28T20:03:02.368 INFO:tasks.ceph.mds.b.smithi179.stderr: -4591> 2023-11-28T20:02:28.257+0000 7f84877c2640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-11-28T20:03:02.377 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs2 --yes-i-really-mean-it 2023-11-28T20:03:02.418 INFO:tasks.ceph.mds.b.smithi179.stdout:starting mds.b at 2023-11-28T20:03:02.521 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:02.512+0000 7f247110f640 1 Processor -- start 2023-11-28T20:03:02.521 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:02.516+0000 7f247110f640 1 -- start start 2023-11-28T20:03:02.521 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:02.516+0000 7f247110f640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f246c14f850 0x7f246c0aacf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:03:02.521 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:02.516+0000 7f247110f640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f246c14fc30 0x7f246c0c3cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:03:02.522 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:02.516+0000 7f247110f640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f246c152910 con 0x7f246c06d840 2023-11-28T20:03:02.522 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:02.516+0000 7f247110f640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f246c0c2240 con 0x7f246c14fc30 2023-11-28T20:03:02.522 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:02.516+0000 7f247110f640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f246c152bf0 con 0x7f246c14f850 2023-11-28T20:03:02.522 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:02.516+0000 7f246b59e640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f246c06d840 0x7f246c0c4210 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:51086/0 (socket says 172.21.15.78:51086) 2023-11-28T20:03:02.523 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:02.516+0000 7f246b59e640 1 -- 172.21.15.78:0/3746067833 learned_addr learned my addr 172.21.15.78:0/3746067833 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-11-28T20:03:02.523 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:02.516+0000 7f246a59c640 1 --2- 172.21.15.78:0/3746067833 >> v2:172.21.15.179:3300/0 conn(0x7f246c14fc30 0x7f246c0c3cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:03:02.523 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:02.516+0000 7f246ad9d640 1 --2- 172.21.15.78:0/3746067833 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f246c14f850 0x7f246c0aacf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:03:02.523 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:02.516+0000 7f2469d9b640 1 -- 172.21.15.78:0/3746067833 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 448305983 0 0) 0x7f246c152910 con 0x7f246c06d840 2023-11-28T20:03:02.523 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:02.516+0000 7f2469d9b640 1 -- 172.21.15.78:0/3746067833 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2454003530 con 0x7f246c06d840 2023-11-28T20:03:02.523 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:02.516+0000 7f246a59c640 1 -- 172.21.15.78:0/3746067833 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f246c14f850 msgr2=0x7f246c0aacf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:03:02.523 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:02.516+0000 7f246a59c640 1 --2- 172.21.15.78:0/3746067833 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f246c14f850 0x7f246c0aacf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:03:02.524 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:02.516+0000 7f246a59c640 1 -- 172.21.15.78:0/3746067833 >> v1:172.21.15.78:6789/0 conn(0x7f246c06d840 legacy=0x7f246c0c4210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:03:02.524 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:02.516+0000 7f246a59c640 1 -- 172.21.15.78:0/3746067833 --> v2:172.21.15.179:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f246c152ed0 con 0x7f246c14fc30 2023-11-28T20:03:02.525 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:02.520+0000 7f246a59c640 1 --2- 172.21.15.78:0/3746067833 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f246c14fc30 0x7f246c0c3cd0 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f24600097c0 tx=0x7f246001c480 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cde50df33a5cc4ed server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:03:02.525 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:02.520+0000 7f2469d9b640 1 -- 172.21.15.78:0/3746067833 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24600a6040 con 0x7f246c14fc30 2023-11-28T20:03:02.525 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:02.520+0000 7f2469d9b640 1 -- 172.21.15.78:0/3746067833 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f24600aa600 con 0x7f246c14fc30 2023-11-28T20:03:02.525 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:02.520+0000 7f2469d9b640 1 -- 172.21.15.78:0/3746067833 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24600aa990 con 0x7f246c14fc30 2023-11-28T20:03:02.526 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:02.520+0000 7f247110f640 1 -- 172.21.15.78:0/3746067833 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f246c14fc30 msgr2=0x7f246c0c3cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:03:02.526 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:02.520+0000 7f247110f640 1 --2- 172.21.15.78:0/3746067833 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f246c14fc30 0x7f246c0c3cd0 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f24600097c0 tx=0x7f246001c480 comp rx=0 tx=0).stop 2023-11-28T20:03:02.526 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:02.520+0000 7f247110f640 1 -- 172.21.15.78:0/3746067833 shutdown_connections 2023-11-28T20:03:02.527 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:02.520+0000 7f247110f640 1 --2- 172.21.15.78:0/3746067833 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f246c14fc30 0x7f246c0c3cd0 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:03:02.527 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:02.520+0000 7f247110f640 1 --2- 172.21.15.78:0/3746067833 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f246c14f850 0x7f246c0aacf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:03:02.527 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:02.520+0000 7f247110f640 1 -- 172.21.15.78:0/3746067833 >> 172.21.15.78:0/3746067833 conn(0x7f246c0c59f0 msgr2=0x7f246c0c5e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:03:02.527 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:02.520+0000 7f247110f640 1 -- 172.21.15.78:0/3746067833 shutdown_connections 2023-11-28T20:03:02.527 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:02.520+0000 7f247110f640 1 -- 172.21.15.78:0/3746067833 wait complete. 2023-11-28T20:03:02.530 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:02.524+0000 7f247110f640 1 Processor -- start 2023-11-28T20:03:02.530 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:02.524+0000 7f247110f640 1 -- start start 2023-11-28T20:03:02.530 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:02.524+0000 7f247110f640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f246c06d840 0x7f246c156390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:03:02.530 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:02.524+0000 7f247110f640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f246c14f850 0x7f246c14bca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:03:02.530 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:02.524+0000 7f247110f640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f246c14fc30 0x7f246c1ee6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:03:02.530 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:02.524+0000 7f247110f640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f246c1ee250 con 0x7f246c14fc30 2023-11-28T20:03:02.531 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:02.524+0000 7f247110f640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f246c146de0 con 0x7f246c06d840 2023-11-28T20:03:02.531 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:02.524+0000 7f247110f640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f246c071250 con 0x7f246c14f850 2023-11-28T20:03:02.531 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:02.524+0000 7f246b59e640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f246c14fc30 0x7f246c1ee6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:03:02.531 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:02.524+0000 7f246b59e640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f246c14fc30 0x7f246c1ee6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:41908/0 (socket says 172.21.15.78:41908) 2023-11-28T20:03:02.531 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:02.524+0000 7f246b59e640 1 -- 172.21.15.78:0/1827832984 learned_addr learned my addr 172.21.15.78:0/1827832984 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T20:03:02.531 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:02.524+0000 7f246a59c640 1 --2- 172.21.15.78:0/1827832984 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f246c14f850 0x7f246c14bca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:03:02.531 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:02.524+0000 7f246ad9d640 1 --2- 172.21.15.78:0/1827832984 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f246c06d840 0x7f246c156390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:03:02.532 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:02.524+0000 7f246b59e640 1 -- 172.21.15.78:0/1827832984 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f246c14f850 msgr2=0x7f246c14bca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:03:02.532 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:02.524+0000 7f246b59e640 1 --2- 172.21.15.78:0/1827832984 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f246c14f850 0x7f246c14bca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:03:02.532 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:02.524+0000 7f246b59e640 1 -- 172.21.15.78:0/1827832984 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f246c06d840 msgr2=0x7f246c156390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:03:02.532 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:02.524+0000 7f246b59e640 1 --2- 172.21.15.78:0/1827832984 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f246c06d840 0x7f246c156390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:03:02.532 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:02.524+0000 7f246b59e640 1 -- 172.21.15.78:0/1827832984 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2460009420 con 0x7f246c14fc30 2023-11-28T20:03:02.532 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:02.524+0000 7f246b59e640 1 --2- 172.21.15.78:0/1827832984 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f246c14fc30 0x7f246c1ee6e0 secure :-1 s=READY pgs=1128 cs=0 l=1 rev1=1 crypto rx=0x7f246400cbb0 tx=0x7f246400a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:03:02.532 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:02.524+0000 7f24537fe640 1 -- 172.21.15.78:0/1827832984 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f246400ace0 con 0x7f246c14fc30 2023-11-28T20:03:02.532 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:02.524+0000 7f24537fe640 1 -- 172.21.15.78:0/1827832984 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f246400ae40 con 0x7f246c14fc30 2023-11-28T20:03:02.533 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:02.524+0000 7f24537fe640 1 -- 172.21.15.78:0/1827832984 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2464012600 con 0x7f246c14fc30 2023-11-28T20:03:02.533 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:02.524+0000 7f247110f640 1 -- 172.21.15.78:0/1827832984 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f246c1eb210 con 0x7f246c14fc30 2023-11-28T20:03:02.533 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:02.524+0000 7f247110f640 1 -- 172.21.15.78:0/1827832984 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f246c1eb7d0 con 0x7f246c14fc30 2023-11-28T20:03:02.533 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:02.524+0000 7f247110f640 1 -- 172.21.15.78:0/1827832984 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f246c1ee400 con 0x7f246c14fc30 2023-11-28T20:03:02.534 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:02.528+0000 7f24537fe640 1 -- 172.21.15.78:0/1827832984 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f2464012820 con 0x7f246c14fc30 2023-11-28T20:03:02.534 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:02.528+0000 7f24537fe640 1 --2- 172.21.15.78:0/1827832984 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f2458066470 0x7f2458068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:03:02.534 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:02.528+0000 7f24537fe640 1 -- 172.21.15.78:0/1827832984 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 6292+0+0 (secure 0 0 0) 0x7f2464083f80 con 0x7f246c14fc30 2023-11-28T20:03:02.534 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:02.528+0000 7f246ad9d640 1 --2- 172.21.15.78:0/1827832984 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f2458066470 0x7f2458068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:03:02.534 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:02.528+0000 7f246ad9d640 1 --2- 172.21.15.78:0/1827832984 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f2458066470 0x7f2458068930 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7f246c151380 tx=0x7f245c009190 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:03:02.535 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:02.532+0000 7f24537fe640 1 -- 172.21.15.78:0/1827832984 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f246c1ee400 con 0x7f246c14fc30 2023-11-28T20:03:02.718 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:02.712+0000 7f247110f640 1 -- 172.21.15.78:0/1827832984 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs2", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f246c1ee400 con 0x7f246c14fc30 2023-11-28T20:03:03.356 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:03.352+0000 7f24537fe640 1 -- 172.21.15.78:0/1827832984 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs2", "yes_i_really_mean_it": true}]=0 v55) v1 ==== 105+0+0 (secure 0 0 0) 0x7f246c1ee400 con 0x7f246c14fc30 2023-11-28T20:03:03.359 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:03.352+0000 7f247110f640 1 -- 172.21.15.78:0/1827832984 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f2458066470 msgr2=0x7f2458068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:03:03.359 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:03.352+0000 7f247110f640 1 --2- 172.21.15.78:0/1827832984 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f2458066470 0x7f2458068930 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7f246c151380 tx=0x7f245c009190 comp rx=0 tx=0).stop 2023-11-28T20:03:03.359 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:03.352+0000 7f247110f640 1 -- 172.21.15.78:0/1827832984 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f246c14fc30 msgr2=0x7f246c1ee6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:03:03.359 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:03.352+0000 7f247110f640 1 --2- 172.21.15.78:0/1827832984 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f246c14fc30 0x7f246c1ee6e0 secure :-1 s=READY pgs=1128 cs=0 l=1 rev1=1 crypto rx=0x7f246400cbb0 tx=0x7f246400a430 comp rx=0 tx=0).stop 2023-11-28T20:03:03.359 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:03.356+0000 7f247110f640 1 -- 172.21.15.78:0/1827832984 shutdown_connections 2023-11-28T20:03:03.360 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:03.356+0000 7f247110f640 1 --2- 172.21.15.78:0/1827832984 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f2458066470 0x7f2458068930 unknown :-1 s=CLOSED pgs=533 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:03:03.360 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:03.356+0000 7f247110f640 1 --2- 172.21.15.78:0/1827832984 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f246c14f850 0x7f246c14bca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:03:03.360 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:03.356+0000 7f247110f640 1 --2- 172.21.15.78:0/1827832984 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f246c14fc30 0x7f246c1ee6e0 unknown :-1 s=CLOSED pgs=1128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:03:03.360 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:03.356+0000 7f247110f640 1 --2- 172.21.15.78:0/1827832984 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f246c06d840 0x7f246c156390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:03:03.360 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:03.356+0000 7f247110f640 1 -- 172.21.15.78:0/1827832984 >> 172.21.15.78:0/1827832984 conn(0x7f246c0c59f0 msgr2=0x7f246c151970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:03:03.360 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:03.356+0000 7f247110f640 1 -- 172.21.15.78:0/1827832984 shutdown_connections 2023-11-28T20:03:03.360 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:03.356+0000 7f247110f640 1 -- 172.21.15.78:0/1827832984 wait complete. 2023-11-28T20:03:03.383 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs2_metadata cephfs2_metadata --yes-i-really-really-mean-it 2023-11-28T20:03:03.525 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:03.520+0000 7fd1f1980640 1 Processor -- start 2023-11-28T20:03:03.525 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:03.520+0000 7fd1f1980640 1 -- start start 2023-11-28T20:03:03.526 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:03.520+0000 7fd1f1980640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fd1ec0c5300 0x7fd1ec0a9c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:03:03.527 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:03.520+0000 7fd1f1980640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd1ec0a4e20 con 0x7fd1ec1548c0 2023-11-28T20:03:03.527 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:03.520+0000 7fd1f1980640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd1ec0a50e0 con 0x7fd1ec14b1e0 2023-11-28T20:03:03.527 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:03.520+0000 7fd1f1980640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd1ec0c0f00 con 0x7fd1ec0c5300 2023-11-28T20:03:03.527 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:03.524+0000 7fd1e3fff640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fd1ec0c5300 0x7fd1ec0a9c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:03:03.527 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:03.524+0000 7fd1eb7fe640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7fd1ec1548c0 0x7fd1ec154d30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:51100/0 (socket says 172.21.15.78:51100) 2023-11-28T20:03:03.527 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:03.524+0000 7fd1eb7fe640 1 -- 172.21.15.78:0/4097898251 learned_addr learned my addr 172.21.15.78:0/4097898251 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-11-28T20:03:03.528 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:03.524+0000 7fd1e3fff640 1 -- 172.21.15.78:0/4097898251 >> v1:172.21.15.179:6789/0 conn(0x7fd1ec14b1e0 legacy=0x7fd1ec0c1700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:03:03.528 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:03.524+0000 7fd1e3fff640 1 -- 172.21.15.78:0/4097898251 >> v1:172.21.15.78:6789/0 conn(0x7fd1ec1548c0 legacy=0x7fd1ec154d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:03:03.528 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:03.524+0000 7fd1e3fff640 1 -- 172.21.15.78:0/4097898251 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1ec0c11e0 con 0x7fd1ec0c5300 2023-11-28T20:03:03.528 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:03.524+0000 7fd1ea7fc640 1 -- 172.21.15.78:0/4097898251 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2099021712 0 0) 0x7fd1ec0a4e20 con 0x7fd1ec1548c0 2023-11-28T20:03:03.531 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:03.524+0000 7fd1e3fff640 1 --2- 172.21.15.78:0/4097898251 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd1ec0c5300 0x7fd1ec0a9c30 secure :-1 s=READY pgs=1130 cs=0 l=1 rev1=1 crypto rx=0x7fd1d40097c0 tx=0x7fd1d401c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=26e33ff1876c8db server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:03:03.531 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:03.524+0000 7fd1ea7fc640 1 -- 172.21.15.78:0/4097898251 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1d40ab600 con 0x7fd1ec0c5300 2023-11-28T20:03:03.531 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:03.524+0000 7fd1ea7fc640 1 -- 172.21.15.78:0/4097898251 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd1d40a7050 con 0x7fd1ec0c5300 2023-11-28T20:03:03.531 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:03.524+0000 7fd1ea7fc640 1 -- 172.21.15.78:0/4097898251 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1d40ab980 con 0x7fd1ec0c5300 2023-11-28T20:03:03.531 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:03.528+0000 7fd1f1980640 1 -- 172.21.15.78:0/4097898251 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd1ec0c5300 msgr2=0x7fd1ec0a9c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:03:03.531 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:03.528+0000 7fd1f1980640 1 --2- 172.21.15.78:0/4097898251 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd1ec0c5300 0x7fd1ec0a9c30 secure :-1 s=READY pgs=1130 cs=0 l=1 rev1=1 crypto rx=0x7fd1d40097c0 tx=0x7fd1d401c480 comp rx=0 tx=0).stop 2023-11-28T20:03:03.531 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:03.528+0000 7fd1f1980640 1 -- 172.21.15.78:0/4097898251 shutdown_connections 2023-11-28T20:03:03.532 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:03.528+0000 7fd1f1980640 1 --2- 172.21.15.78:0/4097898251 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd1ec0c5300 0x7fd1ec0a9c30 unknown :-1 s=CLOSED pgs=1130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:03:03.532 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:03.528+0000 7fd1f1980640 1 -- 172.21.15.78:0/4097898251 >> 172.21.15.78:0/4097898251 conn(0x7fd1ec0c59f0 msgr2=0x7fd1ec0c5e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:03:03.532 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:03.528+0000 7fd1f1980640 1 -- 172.21.15.78:0/4097898251 shutdown_connections 2023-11-28T20:03:03.532 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:03.528+0000 7fd1f1980640 1 -- 172.21.15.78:0/4097898251 wait complete. 2023-11-28T20:03:03.532 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:03.528+0000 7fd1f1980640 1 Processor -- start 2023-11-28T20:03:03.533 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:03.528+0000 7fd1f1980640 1 -- start start 2023-11-28T20:03:03.535 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:03.528+0000 7fd1f1980640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd1ec0c5300 0x7fd1ec151cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:03:03.535 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:03.528+0000 7fd1f1980640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd1ec14b1e0 0x7fd1ec0befc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:03:03.535 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:03.528+0000 7fd1f1980640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd1ec1548c0 0x7fd1ec1ed130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:03:03.535 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:03.528+0000 7fd1f1980640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1ec151890 con 0x7fd1ec0c5300 2023-11-28T20:03:03.535 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:03.528+0000 7fd1f1980640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1ec14f500 con 0x7fd1ec14b1e0 2023-11-28T20:03:03.535 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:03.528+0000 7fd1f1980640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1ec14f7e0 con 0x7fd1ec1548c0 2023-11-28T20:03:03.535 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:03.528+0000 7fd1eaffd640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd1ec0c5300 0x7fd1ec151cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:03:03.535 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:03.528+0000 7fd1eaffd640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd1ec0c5300 0x7fd1ec151cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:41916/0 (socket says 172.21.15.78:41916) 2023-11-28T20:03:03.536 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:03.528+0000 7fd1eaffd640 1 -- 172.21.15.78:0/4204041978 learned_addr learned my addr 172.21.15.78:0/4204041978 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T20:03:03.536 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:03.528+0000 7fd1e3fff640 1 --2- 172.21.15.78:0/4204041978 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd1ec14b1e0 0x7fd1ec0befc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:03:03.536 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:03.528+0000 7fd1eb7fe640 1 --2- 172.21.15.78:0/4204041978 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd1ec1548c0 0x7fd1ec1ed130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:03:03.536 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:03.528+0000 7fd1eaffd640 1 -- 172.21.15.78:0/4204041978 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd1ec1548c0 msgr2=0x7fd1ec1ed130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:03:03.536 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:03.528+0000 7fd1eaffd640 1 --2- 172.21.15.78:0/4204041978 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd1ec1548c0 0x7fd1ec1ed130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:03:03.536 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:03.528+0000 7fd1eaffd640 1 -- 172.21.15.78:0/4204041978 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd1ec14b1e0 msgr2=0x7fd1ec0befc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:03:03.536 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:03.528+0000 7fd1eaffd640 1 --2- 172.21.15.78:0/4204041978 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd1ec14b1e0 0x7fd1ec0befc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:03:03.536 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:03.528+0000 7fd1eaffd640 1 -- 172.21.15.78:0/4204041978 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1d4009420 con 0x7fd1ec0c5300 2023-11-28T20:03:03.536 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:03.528+0000 7fd1eaffd640 1 --2- 172.21.15.78:0/4204041978 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd1ec0c5300 0x7fd1ec151cb0 secure :-1 s=READY pgs=1131 cs=0 l=1 rev1=1 crypto rx=0x7fd1dc00c500 tx=0x7fd1dc00c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:03:03.537 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:03.532+0000 7fd1e8ff9640 1 -- 172.21.15.78:0/4204041978 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1dc005220 con 0x7fd1ec0c5300 2023-11-28T20:03:03.537 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:03.532+0000 7fd1e8ff9640 1 -- 172.21.15.78:0/4204041978 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd1dc005380 con 0x7fd1ec0c5300 2023-11-28T20:03:03.537 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:03.532+0000 7fd1f1980640 1 -- 172.21.15.78:0/4204041978 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd1ec1514b0 con 0x7fd1ec0c5300 2023-11-28T20:03:03.537 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:03.532+0000 7fd1e8ff9640 1 -- 172.21.15.78:0/4204041978 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1dc007270 con 0x7fd1ec0c5300 2023-11-28T20:03:03.537 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:03.532+0000 7fd1f1980640 1 -- 172.21.15.78:0/4204041978 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd1ec0bf500 con 0x7fd1ec0c5300 2023-11-28T20:03:03.538 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:03.532+0000 7fd1f1980640 1 -- 172.21.15.78:0/4204041978 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd1ec1519d0 con 0x7fd1ec0c5300 2023-11-28T20:03:03.538 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:03.532+0000 7fd1e8ff9640 1 -- 172.21.15.78:0/4204041978 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fd1dc0073d0 con 0x7fd1ec0c5300 2023-11-28T20:03:03.538 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:03.532+0000 7fd1e8ff9640 1 --2- 172.21.15.78:0/4204041978 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fd1cc066470 0x7fd1cc068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:03:03.538 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:03.532+0000 7fd1e8ff9640 1 -- 172.21.15.78:0/4204041978 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 6292+0+0 (secure 0 0 0) 0x7fd1dc083a50 con 0x7fd1ec0c5300 2023-11-28T20:03:03.538 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:03.532+0000 7fd1e3fff640 1 --2- 172.21.15.78:0/4204041978 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fd1cc066470 0x7fd1cc068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:03:03.539 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:03.532+0000 7fd1e3fff640 1 --2- 172.21.15.78:0/4204041978 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fd1cc066470 0x7fd1cc068930 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7fd1d40ad000 tx=0x7fd1d40a6000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:03:03.541 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:03.536+0000 7fd1e8ff9640 1 -- 172.21.15.78:0/4204041978 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fd1ec1519d0 con 0x7fd1ec0c5300 2023-11-28T20:03:03.691 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:03.688+0000 7fd1f1980640 1 -- 172.21.15.78:0/4204041978 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs2_metadata", "pool2": "cephfs2_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fd1ec1519d0 con 0x7fd1ec0c5300 2023-11-28T20:03:04.358 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:04.352+0000 7fd1e8ff9640 1 -- 172.21.15.78:0/4204041978 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs2_metadata", "pool2": "cephfs2_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs2_metadata' removed v92) v1 ==== 184+0+0 (secure 0 0 0) 0x7fd1ec1519d0 con 0x7fd1ec0c5300 2023-11-28T20:03:04.359 INFO:teuthology.orchestra.run.smithi078.stderr:pool 'cephfs2_metadata' removed 2023-11-28T20:03:04.361 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:04.356+0000 7fd1f1980640 1 -- 172.21.15.78:0/4204041978 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fd1cc066470 msgr2=0x7fd1cc068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:03:04.362 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:04.356+0000 7fd1f1980640 1 --2- 172.21.15.78:0/4204041978 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fd1cc066470 0x7fd1cc068930 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7fd1d40ad000 tx=0x7fd1d40a6000 comp rx=0 tx=0).stop 2023-11-28T20:03:04.362 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:04.356+0000 7fd1f1980640 1 -- 172.21.15.78:0/4204041978 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd1ec0c5300 msgr2=0x7fd1ec151cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:03:04.362 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:04.356+0000 7fd1f1980640 1 --2- 172.21.15.78:0/4204041978 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd1ec0c5300 0x7fd1ec151cb0 secure :-1 s=READY pgs=1131 cs=0 l=1 rev1=1 crypto rx=0x7fd1dc00c500 tx=0x7fd1dc00c9c0 comp rx=0 tx=0).stop 2023-11-28T20:03:04.362 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:04.356+0000 7fd1f1980640 1 -- 172.21.15.78:0/4204041978 shutdown_connections 2023-11-28T20:03:04.363 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:04.356+0000 7fd1f1980640 1 --2- 172.21.15.78:0/4204041978 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fd1cc066470 0x7fd1cc068930 unknown :-1 s=CLOSED pgs=535 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:03:04.363 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:04.356+0000 7fd1f1980640 1 --2- 172.21.15.78:0/4204041978 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd1ec1548c0 0x7fd1ec1ed130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:03:04.363 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:04.356+0000 7fd1f1980640 1 --2- 172.21.15.78:0/4204041978 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd1ec14b1e0 0x7fd1ec0befc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:03:04.363 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:04.356+0000 7fd1f1980640 1 --2- 172.21.15.78:0/4204041978 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd1ec0c5300 0x7fd1ec151cb0 unknown :-1 s=CLOSED pgs=1131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:03:04.363 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:04.356+0000 7fd1f1980640 1 -- 172.21.15.78:0/4204041978 >> 172.21.15.78:0/4204041978 conn(0x7fd1ec0c59f0 msgr2=0x7fd1ec0c1700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:03:04.363 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:04.360+0000 7fd1f1980640 1 -- 172.21.15.78:0/4204041978 shutdown_connections 2023-11-28T20:03:04.363 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:04.360+0000 7fd1f1980640 1 -- 172.21.15.78:0/4204041978 wait complete. 2023-11-28T20:03:04.384 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs2_data cephfs2_data --yes-i-really-really-mean-it 2023-11-28T20:03:04.554 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:04.528+0000 7fe35fd72640 1 Processor -- start 2023-11-28T20:03:04.555 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:04.528+0000 7fe35fd72640 1 -- start start 2023-11-28T20:03:04.555 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:04.528+0000 7fe35fd72640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe35814b1e0 0x7fe3580c1700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:03:04.556 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:04.528+0000 7fe35fd72640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fe3580c5300 0x7fe3580a9c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:03:04.557 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:04.528+0000 7fe35fd72640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fe358151280 0x7fe358151710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:03:04.557 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:04.528+0000 7fe35fd72640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe3580a4e20 con 0x7fe3580c5300 2023-11-28T20:03:04.558 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:04.528+0000 7fe35fd72640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe3580a50e0 con 0x7fe358151280 2023-11-28T20:03:04.559 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:04.528+0000 7fe35fd72640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe3580c0f00 con 0x7fe35814b1e0 2023-11-28T20:03:04.560 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:04.528+0000 7fe35d30d640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fe3580c5300 0x7fe3580a9c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:03:04.560 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:04.528+0000 7fe35d30d640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fe3580c5300 0x7fe3580a9c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:41920/0 (socket says 172.21.15.78:41920) 2023-11-28T20:03:04.561 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:04.528+0000 7fe35d30d640 1 -- 172.21.15.78:0/1640390748 learned_addr learned my addr 172.21.15.78:0/1640390748 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T20:03:04.562 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:04.532+0000 7fe35db0e640 1 --2- 172.21.15.78:0/1640390748 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe35814b1e0 0x7fe3580c1700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:03:04.562 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:04.532+0000 7fe35e30f640 1 --2- 172.21.15.78:0/1640390748 >> v2:172.21.15.179:3300/0 conn(0x7fe358151280 0x7fe358151710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:03:04.563 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:04.532+0000 7fe35d30d640 1 -- 172.21.15.78:0/1640390748 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe35814b1e0 msgr2=0x7fe3580c1700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:03:04.563 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:04.532+0000 7fe35d30d640 1 --2- 172.21.15.78:0/1640390748 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe35814b1e0 0x7fe3580c1700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:03:04.564 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:04.532+0000 7fe35d30d640 1 -- 172.21.15.78:0/1640390748 >> v2:172.21.15.179:3300/0 conn(0x7fe358151280 msgr2=0x7fe358151710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:03:04.564 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:04.532+0000 7fe35d30d640 1 --2- 172.21.15.78:0/1640390748 >> v2:172.21.15.179:3300/0 conn(0x7fe358151280 0x7fe358151710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:03:04.565 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:04.532+0000 7fe35d30d640 1 -- 172.21.15.78:0/1640390748 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3580c11e0 con 0x7fe3580c5300 2023-11-28T20:03:04.565 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:04.532+0000 7fe35d30d640 1 --2- 172.21.15.78:0/1640390748 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe3580c5300 0x7fe3580a9c30 secure :-1 s=READY pgs=1132 cs=0 l=1 rev1=1 crypto rx=0x7fe3580c3b30 tx=0x7fe34801c500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3a95df36208c28a6 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:03:04.566 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:04.532+0000 7fe35cb0c640 1 -- 172.21.15.78:0/1640390748 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe348004230 con 0x7fe3580c5300 2023-11-28T20:03:04.566 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:04.532+0000 7fe35cb0c640 1 -- 172.21.15.78:0/1640390748 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe3480a7050 con 0x7fe3580c5300 2023-11-28T20:03:04.567 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:04.532+0000 7fe35cb0c640 1 -- 172.21.15.78:0/1640390748 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe348003620 con 0x7fe3580c5300 2023-11-28T20:03:04.567 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:04.532+0000 7fe35fd72640 1 -- 172.21.15.78:0/1640390748 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe3580c5300 msgr2=0x7fe3580a9c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:03:04.568 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:04.532+0000 7fe35fd72640 1 --2- 172.21.15.78:0/1640390748 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe3580c5300 0x7fe3580a9c30 secure :-1 s=READY pgs=1132 cs=0 l=1 rev1=1 crypto rx=0x7fe3580c3b30 tx=0x7fe34801c500 comp rx=0 tx=0).stop 2023-11-28T20:03:04.569 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:04.532+0000 7fe35fd72640 1 -- 172.21.15.78:0/1640390748 shutdown_connections 2023-11-28T20:03:04.569 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:04.532+0000 7fe35fd72640 1 --2- 172.21.15.78:0/1640390748 >> v2:172.21.15.179:3300/0 conn(0x7fe358151280 0x7fe358151710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:03:04.570 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:04.532+0000 7fe35fd72640 1 --2- 172.21.15.78:0/1640390748 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe3580c5300 0x7fe3580a9c30 unknown :-1 s=CLOSED pgs=1132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:03:04.570 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:04.532+0000 7fe35fd72640 1 --2- 172.21.15.78:0/1640390748 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe35814b1e0 0x7fe3580c1700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:03:04.571 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:04.532+0000 7fe35fd72640 1 -- 172.21.15.78:0/1640390748 >> 172.21.15.78:0/1640390748 conn(0x7fe3580c59f0 msgr2=0x7fe3580c5e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:03:04.572 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:04.532+0000 7fe35fd72640 1 -- 172.21.15.78:0/1640390748 shutdown_connections 2023-11-28T20:03:04.572 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:04.532+0000 7fe35fd72640 1 -- 172.21.15.78:0/1640390748 wait complete. 2023-11-28T20:03:04.573 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:04.536+0000 7fe35fd72640 1 Processor -- start 2023-11-28T20:03:04.573 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:04.536+0000 7fe35fd72640 1 -- start start 2023-11-28T20:03:04.574 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:04.536+0000 7fe35fd72640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe3580c5300 0x7fe3581462e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:03:04.575 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:04.536+0000 7fe35fd72640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe35814b1e0 0x7fe358149a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:03:04.576 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:04.536+0000 7fe35fd72640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe358151280 0x7fe358149f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:03:04.576 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:04.536+0000 7fe35fd72640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe35806d5d0 con 0x7fe3580c5300 2023-11-28T20:03:04.577 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:04.536+0000 7fe35fd72640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe35813fb10 con 0x7fe358151280 2023-11-28T20:03:04.577 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:04.536+0000 7fe35fd72640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe35814a4b0 con 0x7fe35814b1e0 2023-11-28T20:03:04.577 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:04.536+0000 7fe35db0e640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe3580c5300 0x7fe3581462e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:03:04.578 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:04.536+0000 7fe35db0e640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe3580c5300 0x7fe3581462e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:41934/0 (socket says 172.21.15.78:41934) 2023-11-28T20:03:04.579 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:04.536+0000 7fe35db0e640 1 -- 172.21.15.78:0/337328707 learned_addr learned my addr 172.21.15.78:0/337328707 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T20:03:04.579 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:04.536+0000 7fe35d30d640 1 --2- 172.21.15.78:0/337328707 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe35814b1e0 0x7fe358149a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:03:04.580 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:04.536+0000 7fe35e30f640 1 --2- 172.21.15.78:0/337328707 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe358151280 0x7fe358149f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:03:04.580 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:04.536+0000 7fe35db0e640 1 -- 172.21.15.78:0/337328707 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe35814b1e0 msgr2=0x7fe358149a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:03:04.580 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:04.536+0000 7fe35db0e640 1 --2- 172.21.15.78:0/337328707 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe35814b1e0 0x7fe358149a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:03:04.580 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:04.536+0000 7fe35db0e640 1 -- 172.21.15.78:0/337328707 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe358151280 msgr2=0x7fe358149f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:03:04.581 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:04.536+0000 7fe35db0e640 1 --2- 172.21.15.78:0/337328707 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe358151280 0x7fe358149f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:03:04.581 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:04.536+0000 7fe35db0e640 1 -- 172.21.15.78:0/337328707 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3480094d0 con 0x7fe3580c5300 2023-11-28T20:03:04.581 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:04.536+0000 7fe35db0e640 1 --2- 172.21.15.78:0/337328707 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe3580c5300 0x7fe3581462e0 secure :-1 s=READY pgs=1133 cs=0 l=1 rev1=1 crypto rx=0x7fe35400d800 tx=0x7fe35400dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:03:04.581 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:04.536+0000 7fe34e7fc640 1 -- 172.21.15.78:0/337328707 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3540096a0 con 0x7fe3580c5300 2023-11-28T20:03:04.581 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:04.536+0000 7fe34e7fc640 1 -- 172.21.15.78:0/337328707 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe354009800 con 0x7fe3580c5300 2023-11-28T20:03:04.581 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:04.536+0000 7fe34e7fc640 1 -- 172.21.15.78:0/337328707 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe354009b70 con 0x7fe3580c5300 2023-11-28T20:03:04.581 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:04.536+0000 7fe35fd72640 1 -- 172.21.15.78:0/337328707 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe3581f1420 con 0x7fe3580c5300 2023-11-28T20:03:04.581 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:04.536+0000 7fe35fd72640 1 -- 172.21.15.78:0/337328707 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe3581f0f90 con 0x7fe3580c5300 2023-11-28T20:03:04.581 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:04.540+0000 7fe35fd72640 1 -- 172.21.15.78:0/337328707 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe358067630 con 0x7fe3580c5300 2023-11-28T20:03:04.581 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:04.540+0000 7fe34e7fc640 1 -- 172.21.15.78:0/337328707 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fe354009cd0 con 0x7fe3580c5300 2023-11-28T20:03:04.581 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:04.540+0000 7fe34e7fc640 1 --2- 172.21.15.78:0/337328707 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fe33c066470 0x7fe33c068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:03:04.581 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:04.540+0000 7fe34e7fc640 1 -- 172.21.15.78:0/337328707 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 5852+0+0 (secure 0 0 0) 0x7fe354084670 con 0x7fe3580c5300 2023-11-28T20:03:04.582 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:04.540+0000 7fe35d30d640 1 --2- 172.21.15.78:0/337328707 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fe33c066470 0x7fe33c068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:03:04.582 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:04.540+0000 7fe35d30d640 1 --2- 172.21.15.78:0/337328707 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fe33c066470 0x7fe33c068930 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7fe3480ad000 tx=0x7fe348009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:03:04.582 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:04.544+0000 7fe34e7fc640 1 -- 172.21.15.78:0/337328707 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fe354051a50 con 0x7fe3580c5300 2023-11-28T20:03:04.599 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T20:03:04.603 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T20:03:04.704 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:04.700+0000 7fe35fd72640 1 -- 172.21.15.78:0/337328707 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs2_data", "pool2": "cephfs2_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fe358140740 con 0x7fe3580c5300 2023-11-28T20:03:05.362 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:05.356+0000 7fe34e7fc640 1 -- 172.21.15.78:0/337328707 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs2_data", "pool2": "cephfs2_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs2_data' removed v93) v1 ==== 172+0+0 (secure 0 0 0) 0x7fe354055070 con 0x7fe3580c5300 2023-11-28T20:03:05.363 INFO:teuthology.orchestra.run.smithi078.stderr:pool 'cephfs2_data' removed 2023-11-28T20:03:05.364 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:05.360+0000 7fe35fd72640 1 -- 172.21.15.78:0/337328707 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fe33c066470 msgr2=0x7fe33c068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:03:05.365 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:05.360+0000 7fe35fd72640 1 --2- 172.21.15.78:0/337328707 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fe33c066470 0x7fe33c068930 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7fe3480ad000 tx=0x7fe348009040 comp rx=0 tx=0).stop 2023-11-28T20:03:05.365 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:05.360+0000 7fe35fd72640 1 -- 172.21.15.78:0/337328707 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe3580c5300 msgr2=0x7fe3581462e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:03:05.365 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:05.360+0000 7fe35fd72640 1 --2- 172.21.15.78:0/337328707 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe3580c5300 0x7fe3581462e0 secure :-1 s=READY pgs=1133 cs=0 l=1 rev1=1 crypto rx=0x7fe35400d800 tx=0x7fe35400dcc0 comp rx=0 tx=0).stop 2023-11-28T20:03:05.365 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:05.360+0000 7fe35fd72640 1 -- 172.21.15.78:0/337328707 shutdown_connections 2023-11-28T20:03:05.365 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:05.360+0000 7fe35fd72640 1 --2- 172.21.15.78:0/337328707 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fe33c066470 0x7fe33c068930 unknown :-1 s=CLOSED pgs=536 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:03:05.366 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:05.360+0000 7fe35fd72640 1 --2- 172.21.15.78:0/337328707 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe35814b1e0 0x7fe358149a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:03:05.366 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:05.360+0000 7fe35fd72640 1 --2- 172.21.15.78:0/337328707 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe358151280 0x7fe358149f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:03:05.366 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:05.360+0000 7fe35fd72640 1 --2- 172.21.15.78:0/337328707 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe3580c5300 0x7fe3581462e0 unknown :-1 s=CLOSED pgs=1133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:03:05.366 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:05.360+0000 7fe35fd72640 1 -- 172.21.15.78:0/337328707 >> 172.21.15.78:0/337328707 conn(0x7fe3580c59f0 msgr2=0x7fe3580c5dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:03:05.366 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:05.360+0000 7fe35fd72640 1 -- 172.21.15.78:0/337328707 shutdown_connections 2023-11-28T20:03:05.367 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:05.360+0000 7fe35fd72640 1 -- 172.21.15.78:0/337328707 wait complete. 2023-11-28T20:03:05.390 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-11-28T20:03:05.534 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:05.524+0000 7fbd63b0f640 1 Processor -- start 2023-11-28T20:03:05.534 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:05.524+0000 7fbd63b0f640 1 -- start start 2023-11-28T20:03:05.534 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:05.528+0000 7fbd63b0f640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbd5c156200 0x7fbd5c0c0370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:03:05.534 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:05.528+0000 7fbd63b0f640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fbd5c0c0e10 0x7fbd5c0c1b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:03:05.534 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:05.528+0000 7fbd63b0f640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbd5c06bce0 con 0x7fbd5c15bf70 2023-11-28T20:03:05.535 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:05.528+0000 7fbd63b0f640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbd5c06d8d0 con 0x7fbd5c0c0e10 2023-11-28T20:03:05.535 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:05.528+0000 7fbd63b0f640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd5c15cc60 con 0x7fbd5c156200 2023-11-28T20:03:05.535 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:05.528+0000 7fbd610aa640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fbd5c0c0e10 0x7fbd5c0c1b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:03:05.535 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:05.528+0000 7fbd610aa640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fbd5c0c0e10 0x7fbd5c0c1b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:47618/0 (socket says 172.21.15.78:47618) 2023-11-28T20:03:05.535 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:05.528+0000 7fbd610aa640 1 -- 172.21.15.78:0/1493794258 learned_addr learned my addr 172.21.15.78:0/1493794258 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T20:03:05.535 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:05.528+0000 7fbd610aa640 1 -- 172.21.15.78:0/1493794258 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbd5c156200 msgr2=0x7fbd5c0c0370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:03:05.535 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:05.528+0000 7fbd618ab640 1 --2- 172.21.15.78:0/1493794258 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbd5c156200 0x7fbd5c0c0370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:03:05.535 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:05.528+0000 7fbd610aa640 1 --2- 172.21.15.78:0/1493794258 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbd5c156200 0x7fbd5c0c0370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:03:05.535 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:05.528+0000 7fbd610aa640 1 -- 172.21.15.78:0/1493794258 >> v1:172.21.15.179:6789/0 conn(0x7fbd5c15bf70 legacy=0x7fbd5c15c400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:03:05.535 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:05.528+0000 7fbd610aa640 1 -- 172.21.15.78:0/1493794258 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd5c06bf30 con 0x7fbd5c0c0e10 2023-11-28T20:03:05.535 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:05.528+0000 7fbd618ab640 1 --2- 172.21.15.78:0/1493794258 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbd5c156200 0x7fbd5c0c0370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T20:03:05.535 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:05.528+0000 7fbd610aa640 1 --2- 172.21.15.78:0/1493794258 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbd5c0c0e10 0x7fbd5c0c1b60 secure :-1 s=READY pgs=1134 cs=0 l=1 rev1=1 crypto rx=0x7fbd4c009870 tx=0x7fbd4c01c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=70fe34e33e8d7069 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:03:05.537 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:05.532+0000 7fbd608a9640 1 -- 172.21.15.78:0/1493794258 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd4c0ac620 con 0x7fbd5c0c0e10 2023-11-28T20:03:05.537 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:05.532+0000 7fbd608a9640 1 -- 172.21.15.78:0/1493794258 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd4c0ac780 con 0x7fbd5c0c0e10 2023-11-28T20:03:05.537 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:05.532+0000 7fbd608a9640 1 -- 172.21.15.78:0/1493794258 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd4c0acb10 con 0x7fbd5c0c0e10 2023-11-28T20:03:05.537 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:05.532+0000 7fbd63b0f640 1 -- 172.21.15.78:0/1493794258 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbd5c0c0e10 msgr2=0x7fbd5c0c1b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:03:05.537 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:05.532+0000 7fbd63b0f640 1 --2- 172.21.15.78:0/1493794258 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbd5c0c0e10 0x7fbd5c0c1b60 secure :-1 s=READY pgs=1134 cs=0 l=1 rev1=1 crypto rx=0x7fbd4c009870 tx=0x7fbd4c01c3a0 comp rx=0 tx=0).stop 2023-11-28T20:03:05.537 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:05.532+0000 7fbd63b0f640 1 -- 172.21.15.78:0/1493794258 shutdown_connections 2023-11-28T20:03:05.537 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:05.532+0000 7fbd63b0f640 1 --2- 172.21.15.78:0/1493794258 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbd5c0c0e10 0x7fbd5c0c1b60 unknown :-1 s=CLOSED pgs=1134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:03:05.537 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:05.532+0000 7fbd63b0f640 1 --2- 172.21.15.78:0/1493794258 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbd5c156200 0x7fbd5c0c0370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:03:05.537 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:05.532+0000 7fbd63b0f640 1 -- 172.21.15.78:0/1493794258 >> 172.21.15.78:0/1493794258 conn(0x7fbd5c0c59f0 msgr2=0x7fbd5c0c5e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:03:05.537 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:05.532+0000 7fbd63b0f640 1 -- 172.21.15.78:0/1493794258 shutdown_connections 2023-11-28T20:03:05.538 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:05.532+0000 7fbd63b0f640 1 -- 172.21.15.78:0/1493794258 wait complete. 2023-11-28T20:03:05.538 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:05.532+0000 7fbd63b0f640 1 Processor -- start 2023-11-28T20:03:05.538 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:05.532+0000 7fbd63b0f640 1 -- start start 2023-11-28T20:03:05.539 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:05.532+0000 7fbd63b0f640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbd5c0c0e10 0x7fbd5c140fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:03:05.539 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:05.532+0000 7fbd63b0f640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbd5c156200 0x7fbd5c141fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:03:05.539 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:05.532+0000 7fbd63b0f640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbd5c15bf70 0x7fbd5c142520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:03:05.540 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:05.532+0000 7fbd63b0f640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd5c141bc0 con 0x7fbd5c0c0e10 2023-11-28T20:03:05.540 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:05.532+0000 7fbd63b0f640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd5c141870 con 0x7fbd5c15bf70 2023-11-28T20:03:05.540 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:05.532+0000 7fbd63b0f640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd5c0a8e10 con 0x7fbd5c156200 2023-11-28T20:03:05.540 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:05.532+0000 7fbd618ab640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbd5c0c0e10 0x7fbd5c140fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:03:05.540 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:05.532+0000 7fbd618ab640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbd5c0c0e10 0x7fbd5c140fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:47624/0 (socket says 172.21.15.78:47624) 2023-11-28T20:03:05.540 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:05.532+0000 7fbd618ab640 1 -- 172.21.15.78:0/2738258028 learned_addr learned my addr 172.21.15.78:0/2738258028 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T20:03:05.540 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:05.536+0000 7fbd618ab640 1 -- 172.21.15.78:0/2738258028 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbd5c156200 msgr2=0x7fbd5c141fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:03:05.540 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:05.536+0000 7fbd618ab640 1 --2- 172.21.15.78:0/2738258028 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbd5c156200 0x7fbd5c141fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:03:05.540 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:05.536+0000 7fbd618ab640 1 -- 172.21.15.78:0/2738258028 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbd5c15bf70 msgr2=0x7fbd5c142520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:03:05.540 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:05.536+0000 7fbd618ab640 1 --2- 172.21.15.78:0/2738258028 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbd5c15bf70 0x7fbd5c142520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:03:05.540 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:05.536+0000 7fbd618ab640 1 -- 172.21.15.78:0/2738258028 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd4c0094d0 con 0x7fbd5c0c0e10 2023-11-28T20:03:05.540 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:05.536+0000 7fbd618ab640 1 --2- 172.21.15.78:0/2738258028 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbd5c0c0e10 0x7fbd5c140fd0 secure :-1 s=READY pgs=1135 cs=0 l=1 rev1=1 crypto rx=0x7fbd5800c7f0 tx=0x7fbd5800ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:03:05.541 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:05.536+0000 7fbd527fc640 1 -- 172.21.15.78:0/2738258028 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd5800cea0 con 0x7fbd5c0c0e10 2023-11-28T20:03:05.541 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:05.536+0000 7fbd527fc640 1 -- 172.21.15.78:0/2738258028 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd58007a30 con 0x7fbd5c0c0e10 2023-11-28T20:03:05.541 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:05.536+0000 7fbd527fc640 1 -- 172.21.15.78:0/2738258028 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd58007de0 con 0x7fbd5c0c0e10 2023-11-28T20:03:05.541 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:05.536+0000 7fbd63b0f640 1 -- 172.21.15.78:0/2738258028 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbd5c0a90f0 con 0x7fbd5c0c0e10 2023-11-28T20:03:05.541 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:05.536+0000 7fbd63b0f640 1 -- 172.21.15.78:0/2738258028 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbd5c14ca60 con 0x7fbd5c0c0e10 2023-11-28T20:03:05.542 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:05.536+0000 7fbd63b0f640 1 -- 172.21.15.78:0/2738258028 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbd5c141d00 con 0x7fbd5c0c0e10 2023-11-28T20:03:05.542 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:05.536+0000 7fbd527fc640 1 -- 172.21.15.78:0/2738258028 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fbd580113f0 con 0x7fbd5c0c0e10 2023-11-28T20:03:05.542 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:05.536+0000 7fbd527fc640 1 --2- 172.21.15.78:0/2738258028 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fbd40066470 0x7fbd40068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:03:05.542 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:05.536+0000 7fbd527fc640 1 -- 172.21.15.78:0/2738258028 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 5349+0+0 (secure 0 0 0) 0x7fbd58083e70 con 0x7fbd5c0c0e10 2023-11-28T20:03:05.543 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:05.536+0000 7fbd610aa640 1 --2- 172.21.15.78:0/2738258028 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fbd40066470 0x7fbd40068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:03:05.543 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:05.540+0000 7fbd610aa640 1 --2- 172.21.15.78:0/2738258028 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fbd40066470 0x7fbd40068930 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7fbd4c0ae000 tx=0x7fbd4c004740 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:03:05.546 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:05.540+0000 7fbd527fc640 1 -- 172.21.15.78:0/2738258028 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fbd5c141d00 con 0x7fbd5c0c0e10 2023-11-28T20:03:05.696 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:05.692+0000 7fbd63b0f640 1 -- 172.21.15.78:0/2738258028 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7fbd5c141d00 con 0x7fbd5c0c0e10 2023-11-28T20:03:05.700 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:05.696+0000 7fbd527fc640 1 -- 172.21.15.78:0/2738258028 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v15) v1 ==== 104+0+0 (secure 0 0 0) 0x7fbd5c141d00 con 0x7fbd5c0c0e10 2023-11-28T20:03:05.702 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:05.696+0000 7fbd63b0f640 1 -- 172.21.15.78:0/2738258028 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fbd40066470 msgr2=0x7fbd40068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:03:05.702 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:05.696+0000 7fbd63b0f640 1 --2- 172.21.15.78:0/2738258028 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fbd40066470 0x7fbd40068930 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7fbd4c0ae000 tx=0x7fbd4c004740 comp rx=0 tx=0).stop 2023-11-28T20:03:05.702 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:05.696+0000 7fbd63b0f640 1 -- 172.21.15.78:0/2738258028 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbd5c0c0e10 msgr2=0x7fbd5c140fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:03:05.702 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:05.696+0000 7fbd63b0f640 1 --2- 172.21.15.78:0/2738258028 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbd5c0c0e10 0x7fbd5c140fd0 secure :-1 s=READY pgs=1135 cs=0 l=1 rev1=1 crypto rx=0x7fbd5800c7f0 tx=0x7fbd5800ccb0 comp rx=0 tx=0).stop 2023-11-28T20:03:05.703 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:05.696+0000 7fbd63b0f640 1 -- 172.21.15.78:0/2738258028 shutdown_connections 2023-11-28T20:03:05.703 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:05.696+0000 7fbd63b0f640 1 --2- 172.21.15.78:0/2738258028 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fbd40066470 0x7fbd40068930 unknown :-1 s=CLOSED pgs=537 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:03:05.703 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:05.696+0000 7fbd63b0f640 1 --2- 172.21.15.78:0/2738258028 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbd5c156200 0x7fbd5c141fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:03:05.703 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:05.696+0000 7fbd63b0f640 1 --2- 172.21.15.78:0/2738258028 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbd5c15bf70 0x7fbd5c142520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:03:05.703 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:05.696+0000 7fbd63b0f640 1 --2- 172.21.15.78:0/2738258028 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbd5c0c0e10 0x7fbd5c140fd0 unknown :-1 s=CLOSED pgs=1135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:03:05.703 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:05.696+0000 7fbd63b0f640 1 -- 172.21.15.78:0/2738258028 >> 172.21.15.78:0/2738258028 conn(0x7fbd5c0c59f0 msgr2=0x7fbd5c0c1680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:03:05.703 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:05.696+0000 7fbd63b0f640 1 -- 172.21.15.78:0/2738258028 shutdown_connections 2023-11-28T20:03:05.703 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:05.696+0000 7fbd63b0f640 1 -- 172.21.15.78:0/2738258028 wait complete. 2023-11-28T20:03:05.722 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_multifs_auth.TestMDSCaps.test_r_with_fsname_and_no_path_in_cap' 2023-11-28T20:03:05.867 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:05.860+0000 7f3f1293b640 1 Processor -- start 2023-11-28T20:03:05.869 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:05.860+0000 7f3f1293b640 1 -- start start 2023-11-28T20:03:05.869 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:05.860+0000 7f3f1293b640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f3f0c0c8200 0x7f3f0c0c69d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:03:05.869 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:05.860+0000 7f3f1293b640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3f0c0c9210 0x7f3f0c15ecf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:03:05.869 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:05.860+0000 7f3f1293b640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3f0c151f20 con 0x7f3f0c0c65f0 2023-11-28T20:03:05.869 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:05.860+0000 7f3f1293b640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3f0c154450 con 0x7f3f0c0c8200 2023-11-28T20:03:05.870 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:05.860+0000 7f3f1293b640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f0c154710 con 0x7f3f0c0c9210 2023-11-28T20:03:05.870 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:05.860+0000 7f3f11939640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f3f0c0c65f0 0x7f3f0c0c8b00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:42940/0 (socket says 172.21.15.78:42940) 2023-11-28T20:03:05.870 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:05.860+0000 7f3f11939640 1 -- 172.21.15.78:0/3890142523 learned_addr learned my addr 172.21.15.78:0/3890142523 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-11-28T20:03:05.870 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:05.860+0000 7f3f11138640 1 --2- 172.21.15.78:0/3890142523 >> v2:172.21.15.179:3300/0 conn(0x7f3f0c0c8200 0x7f3f0c0c69d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:03:05.870 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:05.860+0000 7f3f1213a640 1 --2- 172.21.15.78:0/3890142523 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3f0c0c9210 0x7f3f0c15ecf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:03:05.870 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:05.860+0000 7f3f10937640 1 -- 172.21.15.78:0/3890142523 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3542464460 0 0) 0x7f3f0c151f20 con 0x7f3f0c0c65f0 2023-11-28T20:03:05.870 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:05.860+0000 7f3f10937640 1 -- 172.21.15.78:0/3890142523 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3ef8003530 con 0x7f3f0c0c65f0 2023-11-28T20:03:05.870 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:05.860+0000 7f3f11138640 1 -- 172.21.15.78:0/3890142523 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3f0c0c9210 msgr2=0x7f3f0c15ecf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:03:05.870 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:05.860+0000 7f3f11138640 1 --2- 172.21.15.78:0/3890142523 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3f0c0c9210 0x7f3f0c15ecf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:03:05.870 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:05.860+0000 7f3f10937640 1 -- 172.21.15.78:0/3890142523 <== mon.0 v1:172.21.15.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3013548762 0 0) 0x7f3ef8003530 con 0x7f3f0c0c65f0 2023-11-28T20:03:05.870 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:05.860+0000 7f3f11138640 1 -- 172.21.15.78:0/3890142523 >> v1:172.21.15.78:6789/0 conn(0x7f3f0c0c65f0 legacy=0x7f3f0c0c8b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:03:05.871 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:05.860+0000 7f3f11138640 1 -- 172.21.15.78:0/3890142523 --> v2:172.21.15.179:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f0c1549f0 con 0x7f3f0c0c8200 2023-11-28T20:03:05.876 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:05.864+0000 7f3f11138640 1 --2- 172.21.15.78:0/3890142523 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3f0c0c8200 0x7f3f0c0c69d0 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f3efc0097c0 tx=0x7f3efc01c2e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=dd38781f57ce4b03 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:03:05.877 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:05.864+0000 7f3f10937640 1 -- 172.21.15.78:0/3890142523 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f08001680 con 0x7f3f0c0c8200 2023-11-28T20:03:05.877 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:05.864+0000 7f3f10937640 1 -- 172.21.15.78:0/3890142523 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3efc0a7050 con 0x7f3f0c0c8200 2023-11-28T20:03:05.877 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:05.864+0000 7f3f10937640 1 -- 172.21.15.78:0/3890142523 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3efc0ab600 con 0x7f3f0c0c8200 2023-11-28T20:03:05.877 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:05.864+0000 7f3f1293b640 1 -- 172.21.15.78:0/3890142523 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3f0c0c8200 msgr2=0x7f3f0c0c69d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:03:05.877 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:05.864+0000 7f3f1293b640 1 --2- 172.21.15.78:0/3890142523 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3f0c0c8200 0x7f3f0c0c69d0 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f3efc0097c0 tx=0x7f3efc01c2e0 comp rx=0 tx=0).stop 2023-11-28T20:03:05.878 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:05.864+0000 7f3f1293b640 1 -- 172.21.15.78:0/3890142523 shutdown_connections 2023-11-28T20:03:05.878 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:05.864+0000 7f3f1293b640 1 --2- 172.21.15.78:0/3890142523 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3f0c0c9210 0x7f3f0c15ecf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:03:05.878 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:05.864+0000 7f3f1293b640 1 --2- 172.21.15.78:0/3890142523 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3f0c0c8200 0x7f3f0c0c69d0 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:03:05.878 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:05.864+0000 7f3f1293b640 1 -- 172.21.15.78:0/3890142523 >> 172.21.15.78:0/3890142523 conn(0x7f3f0c0ab730 msgr2=0x7f3f0c0abb40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:03:05.878 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:05.864+0000 7f3f1293b640 1 -- 172.21.15.78:0/3890142523 shutdown_connections 2023-11-28T20:03:05.878 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:05.864+0000 7f3f1293b640 1 -- 172.21.15.78:0/3890142523 wait complete. 2023-11-28T20:03:05.879 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:05.868+0000 7f3f1293b640 1 Processor -- start 2023-11-28T20:03:05.879 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:05.868+0000 7f3f1293b640 1 -- start start 2023-11-28T20:03:05.879 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:05.868+0000 7f3f1293b640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3f0c0c65f0 0x7f3f0c147f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:03:05.879 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:05.868+0000 7f3f1293b640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3f0c0c8200 0x7f3f0c0bd6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:03:05.879 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:05.868+0000 7f3f1293b640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3f0c0c9210 0x7f3f0c145eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:03:05.879 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:05.868+0000 7f3f1293b640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f0c1586c0 con 0x7f3f0c0c65f0 2023-11-28T20:03:05.879 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:05.868+0000 7f3f1293b640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f0c1581d0 con 0x7f3f0c0c8200 2023-11-28T20:03:05.879 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:05.868+0000 7f3f1293b640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f0c1f0040 con 0x7f3f0c0c9210 2023-11-28T20:03:05.879 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:05.868+0000 7f3f11939640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3f0c0c65f0 0x7f3f0c147f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:03:05.879 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:05.868+0000 7f3f11939640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3f0c0c65f0 0x7f3f0c147f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:47628/0 (socket says 172.21.15.78:47628) 2023-11-28T20:03:05.880 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:05.868+0000 7f3f11939640 1 -- 172.21.15.78:0/1975601718 learned_addr learned my addr 172.21.15.78:0/1975601718 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T20:03:05.880 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:05.868+0000 7f3f11138640 1 --2- 172.21.15.78:0/1975601718 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3f0c0c8200 0x7f3f0c0bd6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:03:05.880 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:05.868+0000 7f3f1213a640 1 --2- 172.21.15.78:0/1975601718 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3f0c0c9210 0x7f3f0c145eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:03:05.880 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:05.868+0000 7f3f11939640 1 -- 172.21.15.78:0/1975601718 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3f0c0c9210 msgr2=0x7f3f0c145eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:03:05.880 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:05.868+0000 7f3f11939640 1 --2- 172.21.15.78:0/1975601718 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3f0c0c9210 0x7f3f0c145eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:03:05.880 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:05.868+0000 7f3f11939640 1 -- 172.21.15.78:0/1975601718 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3f0c0c8200 msgr2=0x7f3f0c0bd6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:03:05.881 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:05.868+0000 7f3f11939640 1 --2- 172.21.15.78:0/1975601718 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3f0c0c8200 0x7f3f0c0bd6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:03:05.881 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:05.868+0000 7f3f11939640 1 -- 172.21.15.78:0/1975601718 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3efc009420 con 0x7f3f0c0c65f0 2023-11-28T20:03:05.881 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:05.868+0000 7f3f11939640 1 --2- 172.21.15.78:0/1975601718 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3f0c0c65f0 0x7f3f0c147f60 secure :-1 s=READY pgs=1137 cs=0 l=1 rev1=1 crypto rx=0x7f3f0800c750 tx=0x7f3f0800cc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:03:05.881 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:05.868+0000 7f3f027fc640 1 -- 172.21.15.78:0/1975601718 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f08005ae0 con 0x7f3f0c0c65f0 2023-11-28T20:03:05.881 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:05.868+0000 7f3f027fc640 1 -- 172.21.15.78:0/1975601718 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f08005c40 con 0x7f3f0c0c65f0 2023-11-28T20:03:05.881 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:05.868+0000 7f3f027fc640 1 -- 172.21.15.78:0/1975601718 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f08007070 con 0x7f3f0c0c65f0 2023-11-28T20:03:05.881 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:05.868+0000 7f3f1293b640 1 -- 172.21.15.78:0/1975601718 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3f0c155830 con 0x7f3f0c0c65f0 2023-11-28T20:03:05.881 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:05.868+0000 7f3f1293b640 1 -- 172.21.15.78:0/1975601718 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3f0c1583e0 con 0x7f3f0c0c65f0 2023-11-28T20:03:05.882 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:05.868+0000 7f3f1293b640 1 -- 172.21.15.78:0/1975601718 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3f0c0674b0 con 0x7f3f0c0c65f0 2023-11-28T20:03:05.882 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:05.872+0000 7f3f027fc640 1 -- 172.21.15.78:0/1975601718 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f3f080071d0 con 0x7f3f0c0c65f0 2023-11-28T20:03:05.882 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:05.872+0000 7f3f027fc640 1 --2- 172.21.15.78:0/1975601718 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f3ef0066470 0x7f3ef0068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:03:05.882 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:05.872+0000 7f3f027fc640 1 -- 172.21.15.78:0/1975601718 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 5349+0+0 (secure 0 0 0) 0x7f3f08083920 con 0x7f3f0c0c65f0 2023-11-28T20:03:05.882 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:05.872+0000 7f3f11138640 1 --2- 172.21.15.78:0/1975601718 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f3ef0066470 0x7f3ef0068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:03:05.883 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:05.872+0000 7f3f11138640 1 --2- 172.21.15.78:0/1975601718 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f3ef0066470 0x7f3ef0068930 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7f3efc0ad000 tx=0x7f3efc008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:03:05.883 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:05.876+0000 7f3f027fc640 1 -- 172.21.15.78:0/1975601718 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f3f08050fa0 con 0x7f3f0c0c65f0 2023-11-28T20:03:06.084 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:06.080+0000 7f3f1293b640 1 -- 172.21.15.78:0/1975601718 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_multifs_auth.TestMDSCaps.test_r_with_fsname_and_no_path_in_cap"]} v 0) v1 -- 0x7f3f0c0c5160 con 0x7f3f0c0c65f0 2023-11-28T20:03:06.364 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:06.360+0000 7f3f027fc640 1 -- 172.21.15.78:0/1975601718 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_multifs_auth.TestMDSCaps.test_r_with_fsname_and_no_path_in_cap"]}]=0 v251) v1 ==== 159+0+0 (secure 0 0 0) 0x7f3f080545c0 con 0x7f3f0c0c65f0 2023-11-28T20:03:06.366 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:06.360+0000 7f3f1293b640 1 -- 172.21.15.78:0/1975601718 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f3ef0066470 msgr2=0x7f3ef0068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:03:06.367 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:06.360+0000 7f3f1293b640 1 --2- 172.21.15.78:0/1975601718 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f3ef0066470 0x7f3ef0068930 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7f3efc0ad000 tx=0x7f3efc008040 comp rx=0 tx=0).stop 2023-11-28T20:03:06.367 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:06.360+0000 7f3f1293b640 1 -- 172.21.15.78:0/1975601718 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3f0c0c65f0 msgr2=0x7f3f0c147f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:03:06.367 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:06.360+0000 7f3f1293b640 1 --2- 172.21.15.78:0/1975601718 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3f0c0c65f0 0x7f3f0c147f60 secure :-1 s=READY pgs=1137 cs=0 l=1 rev1=1 crypto rx=0x7f3f0800c750 tx=0x7f3f0800cc10 comp rx=0 tx=0).stop 2023-11-28T20:03:06.367 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:06.360+0000 7f3f1293b640 1 -- 172.21.15.78:0/1975601718 shutdown_connections 2023-11-28T20:03:06.367 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:06.360+0000 7f3f1293b640 1 --2- 172.21.15.78:0/1975601718 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f3ef0066470 0x7f3ef0068930 unknown :-1 s=CLOSED pgs=538 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:03:06.367 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:06.360+0000 7f3f1293b640 1 --2- 172.21.15.78:0/1975601718 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3f0c0c9210 0x7f3f0c145eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:03:06.367 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:06.360+0000 7f3f1293b640 1 --2- 172.21.15.78:0/1975601718 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3f0c0c8200 0x7f3f0c0bd6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:03:06.367 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:06.360+0000 7f3f1293b640 1 --2- 172.21.15.78:0/1975601718 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3f0c0c65f0 0x7f3f0c147f60 unknown :-1 s=CLOSED pgs=1137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:03:06.367 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:06.360+0000 7f3f1293b640 1 -- 172.21.15.78:0/1975601718 >> 172.21.15.78:0/1975601718 conn(0x7f3f0c0ab730 msgr2=0x7f3f0c0aaf30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:03:06.367 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:06.360+0000 7f3f1293b640 1 -- 172.21.15.78:0/1975601718 shutdown_connections 2023-11-28T20:03:06.367 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:06.360+0000 7f3f1293b640 1 -- 172.21.15.78:0/1975601718 wait complete. 2023-11-28T20:03:06.387 INFO:tasks.cephfs_test_runner:test_r_with_fsname_and_no_path_in_cap (tasks.cephfs.test_multifs_auth.TestMDSCaps) ... ERROR 2023-11-28T20:03:06.388 INFO:tasks.cephfs_test_runner: 2023-11-28T20:03:06.388 INFO:tasks.cephfs_test_runner:====================================================================== 2023-11-28T20:03:06.388 INFO:tasks.cephfs_test_runner:ERROR: test_r_with_fsname_and_no_path_in_cap (tasks.cephfs.test_multifs_auth.TestMDSCaps) 2023-11-28T20:03:06.388 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2023-11-28T20:03:06.388 INFO:tasks.cephfs_test_runner:Traceback (most recent call last): 2023-11-28T20:03:06.388 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_43dd94c190073cf16cff1e711dd7f5a7b1cbc883/qa/tasks/cephfs/test_multifs_auth.py", line 95, in test_r_with_fsname_and_no_path_in_cap 2023-11-28T20:03:06.388 INFO:tasks.cephfs_test_runner: self.captesters[0].run_mds_cap_tests(PERM) 2023-11-28T20:03:06.388 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_43dd94c190073cf16cff1e711dd7f5a7b1cbc883/qa/tasks/cephfs/caps_helper.py", line 262, in run_mds_cap_tests 2023-11-28T20:03:06.388 INFO:tasks.cephfs_test_runner: self.conduct_pos_test_for_read_caps() 2023-11-28T20:03:06.388 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_43dd94c190073cf16cff1e711dd7f5a7b1cbc883/qa/tasks/cephfs/caps_helper.py", line 274, in conduct_pos_test_for_read_caps 2023-11-28T20:03:06.389 INFO:tasks.cephfs_test_runner: contents = self.mount.read_file(self.path, sudo_read) 2023-11-28T20:03:06.389 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_43dd94c190073cf16cff1e711dd7f5a7b1cbc883/qa/tasks/cephfs/mount.py", line 749, in read_file 2023-11-28T20:03:06.389 INFO:tasks.cephfs_test_runner: return self.run_shell(args=args, omit_sudo=False).stdout.getvalue().strip() 2023-11-28T20:03:06.389 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_43dd94c190073cf16cff1e711dd7f5a7b1cbc883/qa/tasks/cephfs/mount.py", line 784, in run_shell 2023-11-28T20:03:06.389 INFO:tasks.cephfs_test_runner: return self.client_remote.run(args=args, cwd=cwd, timeout=timeout, 2023-11-28T20:03:06.389 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_5ae09a5cc7064ca2bf994df19f3006b79794789a/teuthology/orchestra/remote.py", line 523, in run 2023-11-28T20:03:06.389 INFO:tasks.cephfs_test_runner: r = self._runner(client=self.ssh, name=self.shortname, **kwargs) 2023-11-28T20:03:06.389 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_5ae09a5cc7064ca2bf994df19f3006b79794789a/teuthology/orchestra/run.py", line 455, in run 2023-11-28T20:03:06.389 INFO:tasks.cephfs_test_runner: r.wait() 2023-11-28T20:03:06.389 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_5ae09a5cc7064ca2bf994df19f3006b79794789a/teuthology/orchestra/run.py", line 161, in wait 2023-11-28T20:03:06.389 INFO:tasks.cephfs_test_runner: self._raise_for_status() 2023-11-28T20:03:06.389 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_5ae09a5cc7064ca2bf994df19f3006b79794789a/teuthology/orchestra/run.py", line 181, in _raise_for_status 2023-11-28T20:03:06.389 INFO:tasks.cephfs_test_runner: raise CommandFailedError( 2023-11-28T20:03:06.389 INFO:tasks.cephfs_test_runner:teuthology.exceptions.CommandFailedError: Command failed on smithi078 with status 1: '(cd /home/ubuntu/cephtest/mnt.0 && exec cat /home/ubuntu/cephtest/mnt.0/testdir/testfile)' 2023-11-28T20:03:06.390 INFO:tasks.cephfs_test_runner: 2023-11-28T20:03:06.390 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2023-11-28T20:03:06.390 INFO:tasks.cephfs_test_runner:Ran 3 tests in 200.461s 2023-11-28T20:03:06.390 INFO:tasks.cephfs_test_runner: 2023-11-28T20:03:06.390 INFO:tasks.cephfs_test_runner:FAILED (errors=1) 2023-11-28T20:03:06.390 INFO:tasks.cephfs_test_runner: 2023-11-28T20:03:06.390 INFO:tasks.cephfs_test_runner:====================================================================== 2023-11-28T20:03:06.390 INFO:tasks.cephfs_test_runner:ERROR: test_r_with_fsname_and_no_path_in_cap (tasks.cephfs.test_multifs_auth.TestMDSCaps) 2023-11-28T20:03:06.390 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2023-11-28T20:03:06.390 INFO:tasks.cephfs_test_runner:Traceback (most recent call last): 2023-11-28T20:03:06.390 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_43dd94c190073cf16cff1e711dd7f5a7b1cbc883/qa/tasks/cephfs/test_multifs_auth.py", line 95, in test_r_with_fsname_and_no_path_in_cap 2023-11-28T20:03:06.391 INFO:tasks.cephfs_test_runner: self.captesters[0].run_mds_cap_tests(PERM) 2023-11-28T20:03:06.391 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_43dd94c190073cf16cff1e711dd7f5a7b1cbc883/qa/tasks/cephfs/caps_helper.py", line 262, in run_mds_cap_tests 2023-11-28T20:03:06.391 INFO:tasks.cephfs_test_runner: self.conduct_pos_test_for_read_caps() 2023-11-28T20:03:06.391 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_43dd94c190073cf16cff1e711dd7f5a7b1cbc883/qa/tasks/cephfs/caps_helper.py", line 274, in conduct_pos_test_for_read_caps 2023-11-28T20:03:06.391 INFO:tasks.cephfs_test_runner: contents = self.mount.read_file(self.path, sudo_read) 2023-11-28T20:03:06.391 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_43dd94c190073cf16cff1e711dd7f5a7b1cbc883/qa/tasks/cephfs/mount.py", line 749, in read_file 2023-11-28T20:03:06.391 INFO:tasks.cephfs_test_runner: return self.run_shell(args=args, omit_sudo=False).stdout.getvalue().strip() 2023-11-28T20:03:06.391 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_43dd94c190073cf16cff1e711dd7f5a7b1cbc883/qa/tasks/cephfs/mount.py", line 784, in run_shell 2023-11-28T20:03:06.391 INFO:tasks.cephfs_test_runner: return self.client_remote.run(args=args, cwd=cwd, timeout=timeout, 2023-11-28T20:03:06.391 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_5ae09a5cc7064ca2bf994df19f3006b79794789a/teuthology/orchestra/remote.py", line 523, in run 2023-11-28T20:03:06.391 INFO:tasks.cephfs_test_runner: r = self._runner(client=self.ssh, name=self.shortname, **kwargs) 2023-11-28T20:03:06.391 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_5ae09a5cc7064ca2bf994df19f3006b79794789a/teuthology/orchestra/run.py", line 455, in run 2023-11-28T20:03:06.391 INFO:tasks.cephfs_test_runner: r.wait() 2023-11-28T20:03:06.391 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_5ae09a5cc7064ca2bf994df19f3006b79794789a/teuthology/orchestra/run.py", line 161, in wait 2023-11-28T20:03:06.392 INFO:tasks.cephfs_test_runner: self._raise_for_status() 2023-11-28T20:03:06.392 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_5ae09a5cc7064ca2bf994df19f3006b79794789a/teuthology/orchestra/run.py", line 181, in _raise_for_status 2023-11-28T20:03:06.392 INFO:tasks.cephfs_test_runner: raise CommandFailedError( 2023-11-28T20:03:06.392 INFO:tasks.cephfs_test_runner:teuthology.exceptions.CommandFailedError: Command failed on smithi078 with status 1: '(cd /home/ubuntu/cephtest/mnt.0 && exec cat /home/ubuntu/cephtest/mnt.0/testdir/testfile)' 2023-11-28T20:03:06.392 INFO:tasks.cephfs_test_runner: 2023-11-28T20:03:06.392 ERROR:teuthology.run_tasks:Saw exception from tasks. Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_5ae09a5cc7064ca2bf994df19f3006b79794789a/teuthology/run_tasks.py", line 109, in run_tasks manager.__enter__() File "/usr/lib/python3.8/contextlib.py", line 113, in __enter__ return next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph-c_43dd94c190073cf16cff1e711dd7f5a7b1cbc883/qa/tasks/cephfs_test_runner.py", line 211, in task raise RuntimeError("Test failure: {0}".format(", ".join(bad_tests))) RuntimeError: Test failure: test_r_with_fsname_and_no_path_in_cap (tasks.cephfs.test_multifs_auth.TestMDSCaps) 2023-11-28T20:03:06.465 ERROR:teuthology.util.sentry: Sentry event: https://sentry.ceph.com/organizations/ceph/?query=196a95889df544b39210ab79fe94e97e Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_5ae09a5cc7064ca2bf994df19f3006b79794789a/teuthology/run_tasks.py", line 109, in run_tasks manager.__enter__() File "/usr/lib/python3.8/contextlib.py", line 113, in __enter__ return next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph-c_43dd94c190073cf16cff1e711dd7f5a7b1cbc883/qa/tasks/cephfs_test_runner.py", line 211, in task raise RuntimeError("Test failure: {0}".format(", ".join(bad_tests))) RuntimeError: Test failure: test_r_with_fsname_and_no_path_in_cap (tasks.cephfs.test_multifs_auth.TestMDSCaps) 2023-11-28T20:03:06.467 DEBUG:teuthology.run_tasks:Unwinding manager cephfs_test_runner 2023-11-28T20:03:06.477 DEBUG:teuthology.run_tasks:Unwinding manager kclient 2023-11-28T20:03:06.492 INFO:tasks.kclient:Unmounting kernel clients... 2023-11-28T20:03:06.493 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2023-11-28T20:03:06.493 DEBUG:teuthology.orchestra.run.smithi078:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-28T20:03:06.515 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354608k,nr_inodes=4088652,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275372k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=5526 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275368k,nr_inodes=818842,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275372k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 2023-11-28T20:03:06.516 DEBUG:teuthology.orchestra.run.smithi179:> set -ex 2023-11-28T20:03:06.516 DEBUG:teuthology.orchestra.run.smithi179:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-28T20:03:06.526 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354628k,nr_inodes=4088657,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275376k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=3817 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275372k,nr_inodes=818843,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275376k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 2023-11-28T20:03:06.527 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T20:03:06.527 DEBUG:teuthology.orchestra.run.smithi078:> ip netns list 2023-11-28T20:03:06.566 INFO:teuthology.orchestra.run.smithi078.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-11-28T20:03:06.567 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T20:03:06.568 DEBUG:teuthology.orchestra.run.smithi078:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-28T20:03:06.631 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T20:03:06.631 DEBUG:teuthology.orchestra.run.smithi078:> sudo ip link delete ceph-brx 2023-11-28T20:03:06.889 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T20:03:06.891 DEBUG:teuthology.orchestra.run.smithi179:> ip netns list 2023-11-28T20:03:06.901 INFO:teuthology.orchestra.run.smithi179.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-11-28T20:03:06.902 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T20:03:06.902 DEBUG:teuthology.orchestra.run.smithi179:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.1 2023-11-28T20:03:06.968 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T20:03:06.968 DEBUG:teuthology.orchestra.run.smithi179:> sudo ip link delete ceph-brx 2023-11-28T20:03:07.187 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2023-11-28T20:03:07.197 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2023-11-28T20:03:07.197 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-28T20:03:07.343 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:07.340+0000 7f3a16417640 1 Processor -- start 2023-11-28T20:03:07.344 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:07.340+0000 7f3a16417640 1 -- start start 2023-11-28T20:03:07.345 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:07.340+0000 7f3a16417640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3a100af4c0 0x7f3a10154f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:03:07.345 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:07.340+0000 7f3a16417640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f3a100c67d0 0x7f3a100c6c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:03:07.346 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:07.340+0000 7f3a16417640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3a100c4890 con 0x7f3a1006b9f0 2023-11-28T20:03:07.346 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:07.340+0000 7f3a16417640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3a10155460 con 0x7f3a100c67d0 2023-11-28T20:03:07.346 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:07.340+0000 7f3a16417640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3a100af8a0 con 0x7f3a100af4c0 2023-11-28T20:03:07.346 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:07.340+0000 7f3a0f7fe640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f3a100c67d0 0x7f3a100c6c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:03:07.346 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:07.340+0000 7f3a0f7fe640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f3a100c67d0 0x7f3a100c6c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:47634/0 (socket says 172.21.15.78:47634) 2023-11-28T20:03:07.346 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:07.340+0000 7f3a0f7fe640 1 -- 172.21.15.78:0/2833697805 learned_addr learned my addr 172.21.15.78:0/2833697805 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T20:03:07.346 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:07.340+0000 7f3a0ffff640 1 --2- 172.21.15.78:0/2833697805 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3a100af4c0 0x7f3a10154f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:03:07.347 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:07.340+0000 7f3a0f7fe640 1 -- 172.21.15.78:0/2833697805 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3a100af4c0 msgr2=0x7f3a10154f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:03:07.347 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:07.340+0000 7f3a0f7fe640 1 --2- 172.21.15.78:0/2833697805 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3a100af4c0 0x7f3a10154f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:03:07.347 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:07.340+0000 7f3a0f7fe640 1 -- 172.21.15.78:0/2833697805 >> v1:172.21.15.179:6789/0 conn(0x7f3a1006b9f0 legacy=0x7f3a10157a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:03:07.347 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:07.340+0000 7f3a0f7fe640 1 -- 172.21.15.78:0/2833697805 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a100c4b30 con 0x7f3a100c67d0 2023-11-28T20:03:07.348 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:07.344+0000 7f3a0f7fe640 1 --2- 172.21.15.78:0/2833697805 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3a100c67d0 0x7f3a100c6c50 secure :-1 s=READY pgs=1138 cs=0 l=1 rev1=1 crypto rx=0x7f3a04009870 tx=0x7f3a0401c440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cb25a012f9cd5f5c server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:03:07.348 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:07.344+0000 7f3a0effd640 1 -- 172.21.15.78:0/2833697805 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a040ab600 con 0x7f3a100c67d0 2023-11-28T20:03:07.349 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:07.344+0000 7f3a0effd640 1 -- 172.21.15.78:0/2833697805 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a040ab760 con 0x7f3a100c67d0 2023-11-28T20:03:07.349 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:07.344+0000 7f3a0effd640 1 -- 172.21.15.78:0/2833697805 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a040abaf0 con 0x7f3a100c67d0 2023-11-28T20:03:07.350 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:07.344+0000 7f3a16417640 1 -- 172.21.15.78:0/2833697805 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3a100c67d0 msgr2=0x7f3a100c6c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:03:07.350 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:07.344+0000 7f3a16417640 1 --2- 172.21.15.78:0/2833697805 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3a100c67d0 0x7f3a100c6c50 secure :-1 s=READY pgs=1138 cs=0 l=1 rev1=1 crypto rx=0x7f3a04009870 tx=0x7f3a0401c440 comp rx=0 tx=0).stop 2023-11-28T20:03:07.350 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:07.344+0000 7f3a16417640 1 -- 172.21.15.78:0/2833697805 shutdown_connections 2023-11-28T20:03:07.350 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:07.344+0000 7f3a16417640 1 --2- 172.21.15.78:0/2833697805 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3a100c67d0 0x7f3a100c6c50 unknown :-1 s=CLOSED pgs=1138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:03:07.350 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:07.344+0000 7f3a16417640 1 --2- 172.21.15.78:0/2833697805 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3a100af4c0 0x7f3a10154f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:03:07.350 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:07.344+0000 7f3a16417640 1 -- 172.21.15.78:0/2833697805 >> 172.21.15.78:0/2833697805 conn(0x7f3a100ab9d0 msgr2=0x7f3a100abde0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:03:07.351 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:07.344+0000 7f3a16417640 1 -- 172.21.15.78:0/2833697805 shutdown_connections 2023-11-28T20:03:07.351 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:07.344+0000 7f3a16417640 1 -- 172.21.15.78:0/2833697805 wait complete. 2023-11-28T20:03:07.351 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:07.348+0000 7f3a16417640 1 Processor -- start 2023-11-28T20:03:07.352 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:07.348+0000 7f3a16417640 1 -- start start 2023-11-28T20:03:07.353 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:07.348+0000 7f3a16417640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3a1006b9f0 0x7f3a100be330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:03:07.354 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:07.348+0000 7f3a16417640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3a100af4c0 0x7f3a101f18b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:03:07.354 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:07.348+0000 7f3a16417640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3a100c67d0 0x7f3a100aa8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:03:07.354 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:07.348+0000 7f3a16417640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a100bc840 con 0x7f3a100c67d0 2023-11-28T20:03:07.354 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:07.348+0000 7f3a16417640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a100be870 con 0x7f3a100af4c0 2023-11-28T20:03:07.354 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:07.348+0000 7f3a16417640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3a101f10f0 con 0x7f3a1006b9f0 2023-11-28T20:03:07.354 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:07.348+0000 7f3a149b4640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3a100c67d0 0x7f3a100aa8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:03:07.354 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:07.348+0000 7f3a149b4640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3a100c67d0 0x7f3a100aa8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:47648/0 (socket says 172.21.15.78:47648) 2023-11-28T20:03:07.355 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:07.348+0000 7f3a149b4640 1 -- 172.21.15.78:0/798668344 learned_addr learned my addr 172.21.15.78:0/798668344 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T20:03:07.355 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:07.348+0000 7f3a0ffff640 1 --2- 172.21.15.78:0/798668344 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3a1006b9f0 0x7f3a100be330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:03:07.355 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:07.348+0000 7f3a0f7fe640 1 --2- 172.21.15.78:0/798668344 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3a100af4c0 0x7f3a101f18b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:03:07.355 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:07.348+0000 7f3a149b4640 1 -- 172.21.15.78:0/798668344 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3a1006b9f0 msgr2=0x7f3a100be330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:03:07.355 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:07.348+0000 7f3a149b4640 1 --2- 172.21.15.78:0/798668344 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3a1006b9f0 0x7f3a100be330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:03:07.355 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:07.348+0000 7f3a149b4640 1 -- 172.21.15.78:0/798668344 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3a100af4c0 msgr2=0x7f3a101f18b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:03:07.356 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:07.348+0000 7f3a149b4640 1 --2- 172.21.15.78:0/798668344 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3a100af4c0 0x7f3a101f18b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:03:07.356 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:07.348+0000 7f3a149b4640 1 -- 172.21.15.78:0/798668344 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a040094d0 con 0x7f3a100c67d0 2023-11-28T20:03:07.356 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:07.348+0000 7f3a149b4640 1 --2- 172.21.15.78:0/798668344 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3a100c67d0 0x7f3a100aa8b0 secure :-1 s=READY pgs=1139 cs=0 l=1 rev1=1 crypto rx=0x7f3a0800c780 tx=0x7f3a0800cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:03:07.356 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:07.348+0000 7f3a0cff9640 1 -- 172.21.15.78:0/798668344 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a08004b70 con 0x7f3a100c67d0 2023-11-28T20:03:07.356 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:07.348+0000 7f3a0cff9640 1 -- 172.21.15.78:0/798668344 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a0800ce90 con 0x7f3a100c67d0 2023-11-28T20:03:07.356 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:07.348+0000 7f3a0cff9640 1 -- 172.21.15.78:0/798668344 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a0800a850 con 0x7f3a100c67d0 2023-11-28T20:03:07.357 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:07.348+0000 7f3a16417640 1 -- 172.21.15.78:0/798668344 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3a100c43e0 con 0x7f3a100c67d0 2023-11-28T20:03:07.357 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:07.348+0000 7f3a16417640 1 -- 172.21.15.78:0/798668344 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3a101f1390 con 0x7f3a100c67d0 2023-11-28T20:03:07.358 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:07.352+0000 7f3a16417640 1 -- 172.21.15.78:0/798668344 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3a101f1580 con 0x7f3a100c67d0 2023-11-28T20:03:07.358 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:07.352+0000 7f3a0cff9640 1 -- 172.21.15.78:0/798668344 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f3a0800a9b0 con 0x7f3a100c67d0 2023-11-28T20:03:07.358 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:07.352+0000 7f3a0cff9640 1 --2- 172.21.15.78:0/798668344 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f39fc066470 0x7f39fc068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:03:07.358 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:07.352+0000 7f3a0cff9640 1 -- 172.21.15.78:0/798668344 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 5349+0+0 (secure 0 0 0) 0x7f3a08083d40 con 0x7f3a100c67d0 2023-11-28T20:03:07.358 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:07.352+0000 7f3a0ffff640 1 --2- 172.21.15.78:0/798668344 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f39fc066470 0x7f39fc068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:03:07.358 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:07.352+0000 7f3a0ffff640 1 --2- 172.21.15.78:0/798668344 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f39fc066470 0x7f39fc068930 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7f3a10071cb0 tx=0x7f3a00008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:03:07.360 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:07.356+0000 7f3a0cff9640 1 -- 172.21.15.78:0/798668344 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f3a080513d0 con 0x7f3a100c67d0 2023-11-28T20:03:07.508 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:07.504+0000 7f3a16417640 1 -- 172.21.15.78:0/798668344 --> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f3a1006c250 con 0x7f39fc066470 2023-11-28T20:03:07.510 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:07.504+0000 7f3a0cff9640 1 -- 172.21.15.78:0/798668344 <== mgr.4106 v2:172.21.15.78:6832/2935380957 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+50731 (secure 0 0 0) 0x7f3a00010990 con 0x7f39fc066470 2023-11-28T20:03:07.511 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-11-28T20:03:07.512 INFO:teuthology.orchestra.run.smithi078.stderr:dumped all 2023-11-28T20:03:07.512 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:07.508+0000 7f3a16417640 1 -- 172.21.15.78:0/798668344 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f39fc066470 msgr2=0x7f39fc068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:03:07.513 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:07.508+0000 7f3a16417640 1 --2- 172.21.15.78:0/798668344 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f39fc066470 0x7f39fc068930 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7f3a10071cb0 tx=0x7f3a00008040 comp rx=0 tx=0).stop 2023-11-28T20:03:07.513 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:07.508+0000 7f3a16417640 1 -- 172.21.15.78:0/798668344 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3a100c67d0 msgr2=0x7f3a100aa8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:03:07.513 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:07.508+0000 7f3a16417640 1 --2- 172.21.15.78:0/798668344 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3a100c67d0 0x7f3a100aa8b0 secure :-1 s=READY pgs=1139 cs=0 l=1 rev1=1 crypto rx=0x7f3a0800c780 tx=0x7f3a0800cc40 comp rx=0 tx=0).stop 2023-11-28T20:03:07.513 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:07.508+0000 7f3a16417640 1 -- 172.21.15.78:0/798668344 shutdown_connections 2023-11-28T20:03:07.514 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:07.508+0000 7f3a16417640 1 --2- 172.21.15.78:0/798668344 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f39fc066470 0x7f39fc068930 unknown :-1 s=CLOSED pgs=539 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:03:07.514 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:07.508+0000 7f3a16417640 1 --2- 172.21.15.78:0/798668344 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3a100c67d0 0x7f3a100aa8b0 unknown :-1 s=CLOSED pgs=1139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:03:07.514 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:07.508+0000 7f3a16417640 1 --2- 172.21.15.78:0/798668344 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3a100af4c0 0x7f3a101f18b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:03:07.514 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:07.508+0000 7f3a16417640 1 --2- 172.21.15.78:0/798668344 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3a1006b9f0 0x7f3a100be330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:03:07.515 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:07.508+0000 7f3a16417640 1 -- 172.21.15.78:0/798668344 >> 172.21.15.78:0/798668344 conn(0x7f3a100ab9d0 msgr2=0x7f3a10157a90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:03:07.515 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:07.508+0000 7f3a16417640 1 -- 172.21.15.78:0/798668344 shutdown_connections 2023-11-28T20:03:07.515 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:07.508+0000 7f3a16417640 1 -- 172.21.15.78:0/798668344 wait complete. 2023-11-28T20:03:07.531 INFO:teuthology.orchestra.run.smithi078.stdout:{"pg_ready":true,"pg_map":{"version":213,"stamp":"2023-11-28T20:03:06.003782+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":217,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":258448,"kb_used_data":9000,"kb_used_omap":12,"kb_used_meta":249331,"kb_avail":754716272,"statfs":{"total":773094113280,"available":772829462528,"internally_reserved":0,"allocated":9216000,"data_stored":5519038,"data_compressed":66748,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":12752,"internal_metadata":255315504},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":57,"apply_latency_ms":57,"commit_latency_ns":57000000,"apply_latency_ns":57000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-12079,"num_objects":-23,"num_object_clones":0,"num_object_copies":-46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-23,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-60,"num_write_kb":-32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001389"},"pg_stats":[{"pgid":"1.0","version":"17'117","reported_seq":226,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-11-28T20:02:58.009429+0000","last_change":"2023-11-28T19:58:56.136501+0000","last_active":"2023-11-28T20:02:58.009429+0000","last_peered":"2023-11-28T20:02:58.009429+0000","last_clean":"2023-11-28T20:02:58.009429+0000","last_became_active":"2023-11-28T19:58:56.135998+0000","last_became_peered":"2023-11-28T19:58:56.135998+0000","last_unstale":"2023-11-28T20:02:58.009429+0000","last_undegraded":"2023-11-28T20:02:58.009429+0000","last_fullsized":"2023-11-28T20:02:58.009429+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:58:54.602349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:58:54.602349+0000","last_clean_scrub_stamp":"2023-11-28T19:58:54.602349+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:33:42.723349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":66748,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574902,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32348,"kb_used_data":1164,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339492,"statfs":{"total":96636764160,"available":96603639808,"internally_reserved":0,"allocated":1191936,"data_stored":1126507,"data_compressed":33374,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 20:03:01 2023","interfaces":[{"interface":"back","average":{"1min":0.65600000000000003,"5min":0.66700000000000004,"15min":0.67500000000000004},"min":{"1min":0.45100000000000001,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.84299999999999997,"5min":0.94299999999999995,"15min":0.94299999999999995},"last":0.75800000000000001},{"interface":"front","average":{"1min":0.67200000000000004,"5min":0.66800000000000004,"15min":0.67900000000000005},"min":{"1min":0.47799999999999998,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":0.81100000000000005,"5min":1.014,"15min":1.014},"last":0.67400000000000004}]},{"osd":1,"last update":"Tue Nov 28 20:03:01 2023","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.63800000000000001,"15min":0.64300000000000002},"min":{"1min":0.47699999999999998,"5min":0.438,"15min":0.438},"max":{"1min":0.84199999999999997,"5min":0.95099999999999996,"15min":0.95099999999999996},"last":0.53100000000000003},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.66900000000000004,"15min":0.69099999999999995},"min":{"1min":0.47799999999999998,"5min":0.432,"15min":0.432},"max":{"1min":0.77600000000000002,"5min":1.0900000000000001,"15min":1.0900000000000001},"last":0.56999999999999995}]},{"osd":2,"last update":"Tue Nov 28 20:03:01 2023","interfaces":[{"interface":"back","average":{"1min":0.70399999999999996,"5min":0.70299999999999996,"15min":0.72399999999999998},"min":{"1min":0.52800000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.86099999999999999,"5min":0.98799999999999999,"15min":0.98799999999999999},"last":0.65600000000000003},{"interface":"front","average":{"1min":0.67600000000000005,"5min":0.68100000000000005,"15min":0.69799999999999995},"min":{"1min":0.504,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":0.84999999999999998,"5min":1.514,"15min":1.514},"last":0.74399999999999999}]},{"osd":3,"last update":"Tue Nov 28 20:03:01 2023","interfaces":[{"interface":"back","average":{"1min":0.69699999999999995,"5min":0.69699999999999995,"15min":0.69899999999999995},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":0.93200000000000005,"5min":1.0449999999999999,"15min":1.0449999999999999},"last":0.59999999999999998},{"interface":"front","average":{"1min":0.70999999999999996,"5min":0.749,"15min":0.77800000000000002},"min":{"1min":0.53100000000000003,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":0.86599999999999999,"5min":1.1299999999999999,"15min":1.1299999999999999},"last":0.72099999999999997}]},{"osd":4,"last update":"Tue Nov 28 20:03:01 2023","interfaces":[{"interface":"back","average":{"1min":0.64600000000000002,"5min":0.629,"15min":0.63700000000000001},"min":{"1min":0.443,"5min":0.378,"15min":0.378},"max":{"1min":0.86799999999999999,"5min":1.2829999999999999,"15min":1.2829999999999999},"last":0.621},{"interface":"front","average":{"1min":0.70899999999999996,"5min":0.70399999999999996,"15min":0.72399999999999998},"min":{"1min":0.439,"5min":0.379,"15min":0.379},"max":{"1min":0.98199999999999998,"5min":1.1120000000000001,"15min":1.1120000000000001},"last":0.439}]},{"osd":5,"last update":"Tue Nov 28 20:03:01 2023","interfaces":[{"interface":"back","average":{"1min":0.68300000000000005,"5min":0.65200000000000002,"15min":0.67400000000000004},"min":{"1min":0.42599999999999999,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.86299999999999999,"5min":1.1699999999999999,"15min":1.1699999999999999},"last":0.78400000000000003},{"interface":"front","average":{"1min":0.70099999999999996,"5min":0.72399999999999998,"15min":0.752},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":0.92000000000000004,"5min":1.3300000000000001,"15min":1.3300000000000001},"last":0.77300000000000002}]},{"osd":6,"last update":"Tue Nov 28 20:03:01 2023","interfaces":[{"interface":"back","average":{"1min":0.76100000000000001,"5min":0.75900000000000001,"15min":0.77400000000000002},"min":{"1min":0.59999999999999998,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.95599999999999996,"5min":1.3919999999999999,"15min":1.3919999999999999},"last":0.70399999999999996},{"interface":"front","average":{"1min":0.70399999999999996,"5min":0.70299999999999996,"15min":0.73199999999999998},"min":{"1min":0.443,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":1.018,"5min":1.23,"15min":1.23},"last":0.68799999999999994}]}]},{"osd":6,"up_from":13,"seq":55834574900,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32312,"kb_used_data":1132,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339528,"statfs":{"total":96636764160,"available":96603676672,"internally_reserved":0,"allocated":1159168,"data_stored":554304,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 20:02:55 2023","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.61799999999999999,"15min":0.61599999999999999},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.88700000000000001,"5min":0.91600000000000004,"15min":0.91600000000000004},"last":0.51500000000000001},{"interface":"front","average":{"1min":0.63500000000000001,"5min":0.65400000000000003,"15min":0.66000000000000003},"min":{"1min":0.49399999999999999,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":0.91900000000000004,"5min":0.98999999999999999,"15min":0.98999999999999999},"last":0.625}]},{"osd":1,"last update":"Tue Nov 28 20:02:55 2023","interfaces":[{"interface":"back","average":{"1min":0.73499999999999999,"5min":0.755,"15min":0.77900000000000003},"min":{"1min":0.55800000000000005,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":0.89000000000000001,"5min":1.105,"15min":1.105},"last":0.66800000000000004},{"interface":"front","average":{"1min":0.66300000000000003,"5min":0.67100000000000004,"15min":0.68100000000000005},"min":{"1min":0.50600000000000001,"5min":0.443,"15min":0.443},"max":{"1min":0.879,"5min":0.95899999999999996,"15min":0.95899999999999996},"last":0.68400000000000005}]},{"osd":2,"last update":"Tue Nov 28 20:02:55 2023","interfaces":[{"interface":"back","average":{"1min":0.64000000000000001,"5min":0.67000000000000004,"15min":0.68999999999999995},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.81599999999999995,"5min":0.93400000000000005,"15min":0.93400000000000005},"last":0.48499999999999999},{"interface":"front","average":{"1min":0.70599999999999996,"5min":0.70099999999999996,"15min":0.71299999999999997},"min":{"1min":0.46999999999999997,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":0.84299999999999997,"5min":1.006,"15min":1.006},"last":0.71999999999999997}]},{"osd":3,"last update":"Tue Nov 28 20:02:55 2023","interfaces":[{"interface":"back","average":{"1min":0.69499999999999995,"5min":0.71699999999999997,"15min":0.73799999999999999},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.86399999999999999,"5min":1.056,"15min":1.056},"last":0.57599999999999996},{"interface":"front","average":{"1min":0.66500000000000004,"5min":0.66200000000000003,"15min":0.67700000000000005},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.87,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.53400000000000003}]},{"osd":4,"last update":"Tue Nov 28 20:02:55 2023","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.61799999999999999,"15min":0.626},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.81000000000000005,"5min":0.97599999999999998,"15min":0.97599999999999998},"last":0.55500000000000005},{"interface":"front","average":{"1min":0.67300000000000004,"5min":0.67400000000000004,"15min":0.71699999999999997},"min":{"1min":0.46999999999999997,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.82799999999999996,"5min":1.389,"15min":1.389},"last":0.70299999999999996}]},{"osd":5,"last update":"Tue Nov 28 20:02:55 2023","interfaces":[{"interface":"back","average":{"1min":0.70399999999999996,"5min":0.749,"15min":0.79400000000000004},"min":{"1min":0.49399999999999999,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.95499999999999996,"5min":1.4259999999999999,"15min":1.4259999999999999},"last":0.73399999999999999},{"interface":"front","average":{"1min":0.69199999999999995,"5min":0.71599999999999997,"15min":0.747},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.90000000000000002,"5min":1.276,"15min":1.276},"last":0.46600000000000003}]},{"osd":7,"last update":"Tue Nov 28 20:02:55 2023","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.67100000000000004,"15min":0.69999999999999996},"min":{"1min":0.379,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.90300000000000002,"5min":1.014,"15min":1.014},"last":0.60499999999999998},{"interface":"front","average":{"1min":0.73799999999999999,"5min":0.76100000000000001,"15min":0.80700000000000005},"min":{"1min":0.52700000000000002,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":0.92200000000000004,"5min":1.242,"15min":1.242},"last":0.64000000000000001}]}]},{"osd":5,"up_from":13,"seq":55834574902,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32284,"kb_used_data":1104,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339556,"statfs":{"total":96636764160,"available":96603705344,"internally_reserved":0,"allocated":1130496,"data_stored":542557,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 20:03:02 2023","interfaces":[{"interface":"back","average":{"1min":0.85899999999999999,"5min":0.71399999999999997,"15min":0.71099999999999997},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":5.9080000000000004,"5min":5.9080000000000004,"15min":5.9080000000000004},"last":0.45900000000000002},{"interface":"front","average":{"1min":0.84099999999999997,"5min":0.70999999999999996,"15min":0.71599999999999997},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":4.8789999999999996,"5min":4.8789999999999996,"15min":4.8789999999999996},"last":0.73699999999999999}]},{"osd":1,"last update":"Tue Nov 28 20:03:02 2023","interfaces":[{"interface":"back","average":{"1min":0.875,"5min":0.71899999999999997,"15min":0.71499999999999997},"min":{"1min":0.42599999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":5.1529999999999996,"5min":5.1529999999999996,"15min":5.1529999999999996},"last":0.67200000000000004},{"interface":"front","average":{"1min":0.91700000000000004,"5min":0.73099999999999998,"15min":0.72899999999999998},"min":{"1min":0.41199999999999998,"5min":0.38,"15min":0.38},"max":{"1min":6.3630000000000004,"5min":6.3630000000000004,"15min":6.3630000000000004},"last":0.41199999999999998}]},{"osd":2,"last update":"Tue Nov 28 20:03:02 2023","interfaces":[{"interface":"back","average":{"1min":0.83299999999999996,"5min":0.81100000000000005,"15min":0.90100000000000002},"min":{"1min":0.47799999999999998,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":4.3639999999999999,"5min":5.0880000000000001,"15min":5.0880000000000001},"last":0.878},{"interface":"front","average":{"1min":0.93700000000000006,"5min":0.86599999999999999,"15min":0.95599999999999996},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":6.335,"5min":6.335,"15min":6.335},"last":0.56999999999999995}]},{"osd":3,"last update":"Tue Nov 28 20:03:02 2023","interfaces":[{"interface":"back","average":{"1min":0.92200000000000004,"5min":0.88,"15min":0.97799999999999998},"min":{"1min":0.56399999999999995,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":4.9710000000000001,"5min":5.0469999999999997,"15min":5.0469999999999997},"last":0.81499999999999995},{"interface":"front","average":{"1min":0.878,"5min":0.85399999999999998,"15min":0.95199999999999996},"min":{"1min":0.51600000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":5.0439999999999996,"5min":5.0439999999999996,"15min":5.0439999999999996},"last":0.61099999999999999}]},{"osd":4,"last update":"Tue Nov 28 20:03:02 2023","interfaces":[{"interface":"back","average":{"1min":0.88200000000000001,"5min":0.68100000000000005,"15min":0.67800000000000005},"min":{"1min":0.38700000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":6.5380000000000003,"5min":6.5380000000000003,"15min":6.5380000000000003},"last":0.78900000000000003},{"interface":"front","average":{"1min":0.85899999999999999,"5min":0.74299999999999999,"15min":0.745},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":5.0179999999999998,"5min":5.0179999999999998,"15min":5.0179999999999998},"last":0.93999999999999995}]},{"osd":6,"last update":"Tue Nov 28 20:03:02 2023","interfaces":[{"interface":"back","average":{"1min":0.871,"5min":0.73899999999999999,"15min":0.71699999999999997},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":5.21,"5min":5.21,"15min":5.21},"last":0.85099999999999998},{"interface":"front","average":{"1min":0.94699999999999995,"5min":0.76400000000000001,"15min":0.753},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":6.4790000000000001,"5min":6.4790000000000001,"15min":6.4790000000000001},"last":0.83399999999999996}]},{"osd":7,"last update":"Tue Nov 28 20:03:02 2023","interfaces":[{"interface":"back","average":{"1min":0.93999999999999995,"5min":0.80400000000000005,"15min":0.79200000000000004},"min":{"1min":0.53100000000000003,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":5.6360000000000001,"5min":5.6360000000000001,"15min":5.6360000000000001},"last":0.91200000000000003},{"interface":"front","average":{"1min":0.92800000000000005,"5min":0.80800000000000005,"15min":0.80300000000000005},"min":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":5.5819999999999999,"5min":5.5819999999999999,"15min":5.5819999999999999},"last":0.76200000000000001}]}]},{"osd":4,"up_from":13,"seq":55834574901,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32292,"kb_used_data":1112,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339548,"statfs":{"total":96636764160,"available":96603697152,"internally_reserved":0,"allocated":1138688,"data_stored":542649,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 20:03:01 2023","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.68100000000000005,"15min":0.70099999999999996},"min":{"1min":0.51800000000000002,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.85199999999999998,"5min":1.107,"15min":1.107},"last":0.66400000000000003},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.66300000000000003,"15min":0.69699999999999995},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.81499999999999995,"5min":1.163,"15min":1.163},"last":0.63800000000000001}]},{"osd":1,"last update":"Tue Nov 28 20:03:01 2023","interfaces":[{"interface":"back","average":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.74199999999999999},"min":{"1min":0.41499999999999998,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.95499999999999996,"5min":1.111,"15min":1.111},"last":0.76900000000000002},{"interface":"front","average":{"1min":0.70499999999999996,"5min":0.75800000000000001,"15min":0.79500000000000004},"min":{"1min":0.502,"5min":0.443,"15min":0.443},"max":{"1min":0.91000000000000003,"5min":1.238,"15min":1.238},"last":0.75900000000000001}]},{"osd":2,"last update":"Tue Nov 28 20:03:01 2023","interfaces":[{"interface":"back","average":{"1min":0.68300000000000005,"5min":0.73099999999999998,"15min":0.76500000000000001},"min":{"1min":0.44500000000000001,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.92700000000000005,"5min":1.0669999999999999,"15min":1.0669999999999999},"last":0.71599999999999997},{"interface":"front","average":{"1min":0.74399999999999999,"5min":0.75900000000000001,"15min":0.79700000000000004},"min":{"1min":0.63600000000000001,"5min":0.438,"15min":0.438},"max":{"1min":0.86399999999999999,"5min":1.1359999999999999,"15min":1.1359999999999999},"last":0.70299999999999996}]},{"osd":3,"last update":"Tue Nov 28 20:03:01 2023","interfaces":[{"interface":"back","average":{"1min":0.626,"5min":0.70899999999999996,"15min":0.77100000000000002},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":0.76300000000000001,"5min":1.202,"15min":1.202},"last":0.74199999999999999},{"interface":"front","average":{"1min":0.71699999999999997,"5min":0.745,"15min":0.77900000000000003},"min":{"1min":0.50600000000000001,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":0.90100000000000002,"5min":1.0669999999999999,"15min":1.0669999999999999},"last":0.81200000000000006}]},{"osd":5,"last update":"Tue Nov 28 20:03:01 2023","interfaces":[{"interface":"back","average":{"1min":0.59699999999999998,"5min":0.67000000000000004,"15min":0.70599999999999996},"min":{"1min":0.38400000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.78900000000000003,"5min":0.95899999999999996,"15min":0.95899999999999996},"last":0.61899999999999999},{"interface":"front","average":{"1min":0.60499999999999998,"5min":0.66200000000000003,"15min":0.69599999999999995},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.92200000000000004,"5min":1.034,"15min":1.034},"last":0.68600000000000005}]},{"osd":6,"last update":"Tue Nov 28 20:03:01 2023","interfaces":[{"interface":"back","average":{"1min":0.69699999999999995,"5min":0.68400000000000005,"15min":0.71799999999999997},"min":{"1min":0.48699999999999999,"5min":0.438,"15min":0.438},"max":{"1min":0.94499999999999995,"5min":1.0309999999999999,"15min":1.0309999999999999},"last":0.58999999999999997},{"interface":"front","average":{"1min":0.68200000000000005,"5min":0.746,"15min":0.77100000000000002},"min":{"1min":0.48799999999999999,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":0.88800000000000001,"5min":1.002,"15min":1.002},"last":0.56200000000000006}]},{"osd":7,"last update":"Tue Nov 28 20:03:01 2023","interfaces":[{"interface":"back","average":{"1min":0.69899999999999995,"5min":0.74099999999999999,"15min":0.77200000000000002},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":0.89800000000000002,"5min":1.089,"15min":1.089},"last":0.78800000000000003},{"interface":"front","average":{"1min":0.80700000000000005,"5min":0.82399999999999995,"15min":0.85399999999999998},"min":{"1min":0.68200000000000005,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":0.97199999999999998,"5min":1.1459999999999999,"15min":1.1459999999999999},"last":0.85599999999999998}]}]},{"osd":3,"up_from":13,"seq":55834574902,"num_pgs":45,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32280,"kb_used_data":1100,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339560,"statfs":{"total":96636764160,"available":96603709440,"internally_reserved":0,"allocated":1126400,"data_stored":536699,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":10,"apply_latency_ms":10,"commit_latency_ns":10000000,"apply_latency_ns":10000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 20:02:58 2023","interfaces":[{"interface":"back","average":{"1min":0.40200000000000002,"5min":0.432,"15min":0.442},"min":{"1min":0.31,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":0.52100000000000002,"5min":1.7130000000000001,"15min":1.7130000000000001},"last":0.503},{"interface":"front","average":{"1min":0.46000000000000002,"5min":0.46300000000000002,"15min":0.46999999999999997},"min":{"1min":0.377,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.57899999999999996,"5min":3.0630000000000002,"15min":3.0630000000000002},"last":0.54500000000000004}]},{"osd":1,"last update":"Tue Nov 28 20:02:58 2023","interfaces":[{"interface":"back","average":{"1min":0.434,"5min":0.44800000000000001,"15min":0.46999999999999997},"min":{"1min":0.32900000000000001,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.85399999999999998,"5min":0.89200000000000002,"15min":0.89200000000000002},"last":0.85399999999999998},{"interface":"front","average":{"1min":0.438,"5min":0.50800000000000001,"15min":0.50600000000000001},"min":{"1min":0.30599999999999999,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.66700000000000004,"5min":5.8920000000000003,"15min":5.8920000000000003},"last":0.41799999999999998}]},{"osd":2,"last update":"Tue Nov 28 20:02:58 2023","interfaces":[{"interface":"back","average":{"1min":0.499,"5min":0.54100000000000004,"15min":0.53600000000000003},"min":{"1min":0.36199999999999999,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.621,"5min":4.6390000000000002,"15min":4.6390000000000002},"last":0.60299999999999998},{"interface":"front","average":{"1min":0.52100000000000002,"5min":0.626,"15min":0.59899999999999998},"min":{"1min":0.42099999999999999,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.80200000000000005,"5min":11.593,"15min":11.593},"last":0.80200000000000005}]},{"osd":4,"last update":"Tue Nov 28 20:02:58 2023","interfaces":[{"interface":"back","average":{"1min":0.98699999999999999,"5min":0.83899999999999997,"15min":0.78700000000000003},"min":{"1min":0.61599999999999999,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":5.2629999999999999,"5min":5.5549999999999997,"15min":5.5549999999999997},"last":5.2629999999999999},{"interface":"front","average":{"1min":1.0229999999999999,"5min":0.92300000000000004,"15min":0.84299999999999997},"min":{"1min":0.60999999999999999,"5min":0.503,"15min":0.503},"max":{"1min":5.4939999999999998,"5min":11.747,"15min":11.747},"last":5.4939999999999998}]},{"osd":5,"last update":"Tue Nov 28 20:02:58 2023","interfaces":[{"interface":"back","average":{"1min":0.92900000000000005,"5min":0.88300000000000001,"15min":0.82699999999999996},"min":{"1min":0.52600000000000002,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":5.4450000000000003,"5min":11.705,"15min":11.705},"last":5.4450000000000003},{"interface":"front","average":{"1min":0.94499999999999995,"5min":0.79900000000000004,"15min":0.80100000000000005},"min":{"1min":0.56599999999999995,"5min":0.495,"15min":0.495},"max":{"1min":4.681,"5min":4.681,"15min":4.681},"last":4.681}]},{"osd":6,"last update":"Tue Nov 28 20:02:58 2023","interfaces":[{"interface":"back","average":{"1min":0.78500000000000003,"5min":0.80700000000000005,"15min":0.83099999999999996},"min":{"1min":0.54600000000000004,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":1,"5min":1.6639999999999999,"15min":1.6639999999999999},"last":1},{"interface":"front","average":{"1min":0.81499999999999995,"5min":0.81699999999999995,"15min":0.77100000000000002},"min":{"1min":0.55200000000000005,"5min":0.495,"15min":0.495},"max":{"1min":1.0329999999999999,"5min":4.0679999999999996,"15min":4.0679999999999996},"last":0.90600000000000003}]},{"osd":7,"last update":"Tue Nov 28 20:02:58 2023","interfaces":[{"interface":"back","average":{"1min":0.90100000000000002,"5min":0.90600000000000003,"15min":0.86799999999999999},"min":{"1min":0.64700000000000002,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":2.6589999999999998,"5min":6.6619999999999999,"15min":6.6619999999999999},"last":2.6589999999999998},{"interface":"front","average":{"1min":0.94099999999999995,"5min":0.93300000000000005,"15min":0.90500000000000003},"min":{"1min":0.57399999999999995,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":4.6539999999999999,"5min":11.782,"15min":11.782},"last":4.6539999999999999}]}]},{"osd":2,"up_from":13,"seq":55834574900,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32288,"kb_used_data":1108,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339552,"statfs":{"total":96636764160,"available":96603701248,"internally_reserved":0,"allocated":1134592,"data_stored":542591,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 20:02:57 2023","interfaces":[{"interface":"back","average":{"1min":0.39300000000000002,"5min":0.42499999999999999,"15min":0.44500000000000001},"min":{"1min":0.254,"5min":0.254,"15min":0.254},"max":{"1min":0.58399999999999996,"5min":0.74099999999999999,"15min":0.74099999999999999},"last":0.46800000000000003},{"interface":"front","average":{"1min":0.35799999999999998,"5min":0.436,"15min":0.46700000000000003},"min":{"1min":0.27300000000000002,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.46999999999999997,"5min":0.67700000000000005,"15min":0.67700000000000005},"last":0.51000000000000001}]},{"osd":1,"last update":"Tue Nov 28 20:02:57 2023","interfaces":[{"interface":"back","average":{"1min":0.437,"5min":0.47399999999999998,"15min":0.501},"min":{"1min":0.33600000000000002,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.50600000000000001,"5min":1.0389999999999999,"15min":1.0389999999999999},"last":0.34999999999999998},{"interface":"front","average":{"1min":0.433,"5min":0.46500000000000002,"15min":0.49099999999999999},"min":{"1min":0.28899999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.56699999999999995,"5min":0.70999999999999996,"15min":0.70999999999999996},"last":0.501}]},{"osd":3,"last update":"Tue Nov 28 20:02:57 2023","interfaces":[{"interface":"back","average":{"1min":0.41299999999999998,"5min":0.45100000000000001,"15min":0.46500000000000002},"min":{"1min":0.32100000000000001,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"last":0.42599999999999999},{"interface":"front","average":{"1min":0.46700000000000003,"5min":0.53400000000000003,"15min":0.57199999999999995},"min":{"1min":0.39700000000000002,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.56399999999999995,"5min":0.98499999999999999,"15min":0.98499999999999999},"last":0.45100000000000001}]},{"osd":4,"last update":"Tue Nov 28 20:02:57 2023","interfaces":[{"interface":"back","average":{"1min":0.69199999999999995,"5min":0.76900000000000002,"15min":0.83099999999999996},"min":{"1min":0.5,"5min":0.5,"15min":0.5},"max":{"1min":0.97199999999999998,"5min":1.139,"15min":1.139},"last":0.68700000000000006},{"interface":"front","average":{"1min":0.65900000000000003,"5min":0.75700000000000001,"15min":0.82099999999999995},"min":{"1min":0.51600000000000001,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":0.82699999999999996,"5min":1.238,"15min":1.238},"last":0.73599999999999999}]},{"osd":5,"last update":"Tue Nov 28 20:02:57 2023","interfaces":[{"interface":"back","average":{"1min":0.69799999999999995,"5min":0.77400000000000002,"15min":0.84799999999999998},"min":{"1min":0.55300000000000005,"5min":0.437,"15min":0.437},"max":{"1min":0.94499999999999995,"5min":1.6180000000000001,"15min":1.6180000000000001},"last":0.63500000000000001},{"interface":"front","average":{"1min":0.65600000000000003,"5min":0.748,"15min":0.80600000000000005},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":0.84099999999999997,"5min":1.339,"15min":1.339},"last":0.72099999999999997}]},{"osd":6,"last update":"Tue Nov 28 20:02:57 2023","interfaces":[{"interface":"back","average":{"1min":0.69699999999999995,"5min":0.751,"15min":0.78700000000000003},"min":{"1min":0.54300000000000004,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":0.88300000000000001,"5min":1.1839999999999999,"15min":1.1839999999999999},"last":0.755},{"interface":"front","average":{"1min":0.67500000000000004,"5min":0.76500000000000001,"15min":0.82899999999999996},"min":{"1min":0.52400000000000002,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":0.93000000000000005,"5min":1.099,"15min":1.099},"last":0.65400000000000003}]},{"osd":7,"last update":"Tue Nov 28 20:02:57 2023","interfaces":[{"interface":"back","average":{"1min":0.67200000000000004,"5min":0.77800000000000002,"15min":0.85199999999999998},"min":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":0.86899999999999999,"5min":1.4590000000000001,"15min":1.4590000000000001},"last":0.70899999999999996},{"interface":"front","average":{"1min":0.71299999999999997,"5min":0.77800000000000002,"15min":0.83699999999999997},"min":{"1min":0.57199999999999995,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":0.85499999999999998,"5min":1.387,"15min":1.387},"last":0.62}]}]},{"osd":1,"up_from":13,"seq":55834574902,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32276,"kb_used_data":1096,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339564,"statfs":{"total":96636764160,"available":96603713536,"internally_reserved":0,"allocated":1122304,"data_stored":536013,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":10,"apply_latency_ms":10,"commit_latency_ns":10000000,"apply_latency_ns":10000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 20:02:00 2023","interfaces":[{"interface":"back","average":{"1min":0.38700000000000001,"5min":0.54600000000000004,"15min":0.62},"min":{"1min":0.249,"5min":0.249,"15min":0.249},"max":{"1min":0.60699999999999998,"5min":3.8740000000000001,"15min":3.8740000000000001},"last":0.48899999999999999},{"interface":"front","average":{"1min":0.42099999999999999,"5min":0.51000000000000001,"15min":0.55100000000000005},"min":{"1min":0.32300000000000001,"5min":0.25,"15min":0.25},"max":{"1min":0.60399999999999998,"5min":2.0760000000000001,"15min":2.0760000000000001},"last":0.36799999999999999}]},{"osd":2,"last update":"Tue Nov 28 20:02:00 2023","interfaces":[{"interface":"back","average":{"1min":0.41399999999999998,"5min":0.56000000000000005,"15min":0.626},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.70799999999999996,"5min":3.7320000000000002,"15min":3.7320000000000002},"last":0.41099999999999998},{"interface":"front","average":{"1min":0.46899999999999997,"5min":0.63400000000000001,"15min":0.71799999999999997},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.67000000000000004,"5min":3.9089999999999998,"15min":3.9089999999999998},"last":0.443}]},{"osd":3,"last update":"Tue Nov 28 20:02:00 2023","interfaces":[{"interface":"back","average":{"1min":0.52200000000000002,"5min":0.61799999999999999,"15min":0.66000000000000003},"min":{"1min":0.436,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.70799999999999996,"5min":1.6399999999999999,"15min":1.6399999999999999},"last":0.53200000000000003},{"interface":"front","average":{"1min":0.45500000000000002,"5min":0.61599999999999999,"15min":0.67400000000000004},"min":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.625,"5min":2.5270000000000001,"15min":2.5270000000000001},"last":0.42999999999999999}]},{"osd":4,"last update":"Tue Nov 28 20:02:00 2023","interfaces":[{"interface":"back","average":{"1min":0.69799999999999995,"5min":0.81699999999999995,"15min":0.86899999999999999},"min":{"1min":0.42199999999999999,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.91400000000000003,"5min":3.1659999999999999,"15min":3.1659999999999999},"last":0.67400000000000004},{"interface":"front","average":{"1min":0.69699999999999995,"5min":0.84399999999999997,"15min":0.91200000000000003},"min":{"1min":0.52300000000000002,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.94299999999999995,"5min":3.7959999999999998,"15min":3.7959999999999998},"last":0.77000000000000002}]},{"osd":5,"last update":"Tue Nov 28 20:02:00 2023","interfaces":[{"interface":"back","average":{"1min":0.71399999999999997,"5min":0.875,"15min":0.95099999999999996},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":1.004,"5min":4.1479999999999997,"15min":4.1479999999999997},"last":0.75900000000000001},{"interface":"front","average":{"1min":0.69799999999999995,"5min":0.82599999999999996,"15min":0.88200000000000001},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":0.87,"5min":3.5569999999999999,"15min":3.5569999999999999},"last":0.63900000000000001}]},{"osd":6,"last update":"Tue Nov 28 20:02:00 2023","interfaces":[{"interface":"back","average":{"1min":0.72399999999999998,"5min":0.88800000000000001,"15min":0.95699999999999996},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":0.94499999999999995,"5min":2.863,"15min":2.863},"last":0.78900000000000003},{"interface":"front","average":{"1min":0.76800000000000002,"5min":0.89800000000000002,"15min":0.95399999999999996},"min":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":0.97999999999999998,"5min":3.371,"15min":3.371},"last":0.74399999999999999}]},{"osd":7,"last update":"Tue Nov 28 20:02:00 2023","interfaces":[{"interface":"back","average":{"1min":0.70299999999999996,"5min":0.89100000000000001,"15min":0.97199999999999998},"min":{"1min":0.53100000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":0.93600000000000005,"5min":3.8439999999999999,"15min":3.8439999999999999},"last":0.72399999999999998},{"interface":"front","average":{"1min":0.68799999999999994,"5min":0.90500000000000003,"15min":0.99299999999999999},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.95899999999999996,"5min":3.9689999999999999,"15min":3.9689999999999999},"last":0.81100000000000005}]}]},{"osd":0,"up_from":13,"seq":55834574901,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32368,"kb_used_data":1184,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339472,"statfs":{"total":96636764160,"available":96603619328,"internally_reserved":0,"allocated":1212416,"data_stored":1137718,"data_compressed":33374,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Nov 28 20:02:58 2023","interfaces":[{"interface":"back","average":{"1min":0.38700000000000001,"5min":0.51300000000000001,"15min":0.63100000000000001},"min":{"1min":0.26000000000000001,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":0.80100000000000005,"5min":4.883,"15min":4.883},"last":0.27100000000000002},{"interface":"front","average":{"1min":0.47999999999999998,"5min":0.621,"15min":0.79200000000000004},"min":{"1min":0.23899999999999999,"5min":0.23899999999999999,"15min":0.23899999999999999},"max":{"1min":1.7669999999999999,"5min":8.0800000000000001,"15min":8.0800000000000001},"last":0.40000000000000002}]},{"osd":2,"last update":"Tue Nov 28 20:02:58 2023","interfaces":[{"interface":"back","average":{"1min":0.48599999999999999,"5min":0.67700000000000005,"15min":0.875},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":1.0309999999999999,"5min":8.1029999999999998,"15min":8.1029999999999998},"last":0.621},{"interface":"front","average":{"1min":0.55300000000000005,"5min":0.70699999999999996,"15min":0.89300000000000002},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":1.802,"5min":8.1310000000000002,"15min":8.1310000000000002},"last":0.66500000000000004}]},{"osd":3,"last update":"Tue Nov 28 20:02:58 2023","interfaces":[{"interface":"back","average":{"1min":0.47399999999999998,"5min":0.57399999999999995,"15min":0.68899999999999995},"min":{"1min":0.27700000000000002,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":1.5629999999999999,"5min":4.3949999999999996,"15min":4.3949999999999996},"last":0.378},{"interface":"front","average":{"1min":0.58099999999999996,"5min":0.61599999999999999,"15min":0.70999999999999996},"min":{"1min":0.34999999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":2.0920000000000001,"5min":4.3470000000000004,"15min":4.3470000000000004},"last":0.41899999999999998}]},{"osd":4,"last update":"Tue Nov 28 20:02:58 2023","interfaces":[{"interface":"back","average":{"1min":0.747,"5min":0.85899999999999999,"15min":0.98699999999999999},"min":{"1min":0.52400000000000002,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":1.52,"5min":4.6360000000000001,"15min":4.6360000000000001},"last":0.81000000000000005},{"interface":"front","average":{"1min":0.70799999999999996,"5min":0.86499999999999999,"15min":0.98999999999999999},"min":{"1min":0.53800000000000003,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":0.98099999999999998,"5min":4.4710000000000001,"15min":4.4710000000000001},"last":0.64900000000000002}]},{"osd":5,"last update":"Tue Nov 28 20:02:58 2023","interfaces":[{"interface":"back","average":{"1min":0.751,"5min":0.87,"15min":1},"min":{"1min":0.52300000000000002,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.6659999999999999,"5min":4.6120000000000001,"15min":4.6120000000000001},"last":0.58799999999999997},{"interface":"front","average":{"1min":0.79300000000000004,"5min":0.88500000000000001,"15min":0.996},"min":{"1min":0.65000000000000002,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.595,"5min":4.5449999999999999,"15min":4.5449999999999999},"last":0.59899999999999998}]},{"osd":6,"last update":"Tue Nov 28 20:02:58 2023","interfaces":[{"interface":"back","average":{"1min":0.77000000000000002,"5min":0.88300000000000001,"15min":1.0129999999999999},"min":{"1min":0.57299999999999995,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":2.149,"5min":4.657,"15min":4.657},"last":0.68300000000000005},{"interface":"front","average":{"1min":0.80400000000000005,"5min":0.89900000000000002,"15min":1.0309999999999999},"min":{"1min":0.60999999999999999,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":2.2130000000000001,"5min":4.5259999999999998,"15min":4.5259999999999998},"last":0.71199999999999997}]},{"osd":7,"last update":"Tue Nov 28 20:02:58 2023","interfaces":[{"interface":"back","average":{"1min":0.754,"5min":0.88300000000000001,"15min":1.028},"min":{"1min":0.56299999999999994,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":1.7270000000000001,"5min":4.7320000000000002,"15min":4.7320000000000002},"last":0.55000000000000004},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.86899999999999999,"15min":0.98699999999999999},"min":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":1.0880000000000001,"5min":4.4939999999999998,"15min":4.4939999999999998},"last":0.69299999999999995}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33374,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33374,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-28T20:03:07.533 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-28T20:03:07.670 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:07.664+0000 7fd8d1ff5640 1 Processor -- start 2023-11-28T20:03:07.671 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:07.668+0000 7fd8d1ff5640 1 -- start start 2023-11-28T20:03:07.671 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:07.668+0000 7fd8d1ff5640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd8cc14fd10 0x7fd8cc0a4dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:03:07.672 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:07.668+0000 7fd8d1ff5640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd8cc0c5710 con 0x7fd8cc156110 2023-11-28T20:03:07.672 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:07.668+0000 7fd8d1ff5640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd8cc155c80 con 0x7fd8cc0a5300 2023-11-28T20:03:07.672 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:07.668+0000 7fd8d1ff5640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8cc06c5e0 con 0x7fd8cc14fd10 2023-11-28T20:03:07.672 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:07.668+0000 7fd8cbfff640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7fd8cc156110 0x7fd8cc15ce50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:42954/0 (socket says 172.21.15.78:42954) 2023-11-28T20:03:07.672 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:07.668+0000 7fd8cbfff640 1 -- 172.21.15.78:0/2069557198 learned_addr learned my addr 172.21.15.78:0/2069557198 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-11-28T20:03:07.674 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:07.668+0000 7fd8caffd640 1 -- 172.21.15.78:0/2069557198 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2946063826 0 0) 0x7fd8cc0c5710 con 0x7fd8cc156110 2023-11-28T20:03:07.674 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:07.668+0000 7fd8caffd640 1 -- 172.21.15.78:0/2069557198 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd8b8003530 con 0x7fd8cc156110 2023-11-28T20:03:07.674 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:07.668+0000 7fd8cb7fe640 1 --2- 172.21.15.78:0/2069557198 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd8cc14fd10 0x7fd8cc0a4dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:03:07.675 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:07.668+0000 7fd8caffd640 1 -- 172.21.15.78:0/2069557198 <== mon.0 v1:172.21.15.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3336985948 0 0) 0x7fd8b8003530 con 0x7fd8cc156110 2023-11-28T20:03:07.675 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:07.668+0000 7fd8caffd640 1 -- 172.21.15.78:0/2069557198 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd8cc14fd10 msgr2=0x7fd8cc0a4dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:03:07.675 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:07.668+0000 7fd8caffd640 1 --2- 172.21.15.78:0/2069557198 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd8cc14fd10 0x7fd8cc0a4dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:03:07.675 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:07.668+0000 7fd8caffd640 1 -- 172.21.15.78:0/2069557198 >> v1:172.21.15.179:6789/0 conn(0x7fd8cc0a5300 legacy=0x7fd8cc071e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:03:07.675 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:07.668+0000 7fd8caffd640 1 -- 172.21.15.78:0/2069557198 --> v1:172.21.15.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8cc0c4e70 con 0x7fd8cc156110 2023-11-28T20:03:07.675 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:07.668+0000 7fd8caffd640 1 -- 172.21.15.78:0/2069557198 <== mon.0 v1:172.21.15.78:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3326804700 0 0) 0x7fd8c4001a00 con 0x7fd8cc156110 2023-11-28T20:03:07.675 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:07.668+0000 7fd8caffd640 1 -- 172.21.15.78:0/2069557198 >> v1:172.21.15.78:6789/0 conn(0x7fd8cc156110 legacy=0x7fd8cc15ce50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:03:07.675 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:07.668+0000 7fd8caffd640 1 --2- 172.21.15.78:0/2069557198 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd8b80039b0 0x7fd8b8003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:03:07.676 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:07.668+0000 7fd8caffd640 1 --2- 172.21.15.78:0/2069557198 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd8b80047d0 0x7fd8b8004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:03:07.676 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:07.668+0000 7fd8caffd640 1 --2- 172.21.15.78:0/2069557198 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd8cc14fd10 0x7fd8b800b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:03:07.676 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:07.668+0000 7fd8caffd640 1 -- 172.21.15.78:0/2069557198 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8b80054e0 con 0x7fd8b80047d0 2023-11-28T20:03:07.676 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:07.668+0000 7fd8caffd640 1 -- 172.21.15.78:0/2069557198 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8b8005650 con 0x7fd8b80039b0 2023-11-28T20:03:07.676 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:07.668+0000 7fd8caffd640 1 -- 172.21.15.78:0/2069557198 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8b800bf00 con 0x7fd8cc14fd10 2023-11-28T20:03:07.676 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:07.668+0000 7fd8c3fff640 1 --2- 172.21.15.78:0/2069557198 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd8b80047d0 0x7fd8b8004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:03:07.676 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:07.668+0000 7fd8cb7fe640 1 --2- 172.21.15.78:0/2069557198 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd8b80039b0 0x7fd8b8003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:03:07.677 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:07.668+0000 7fd8cbfff640 1 --2- 172.21.15.78:0/2069557198 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd8cc14fd10 0x7fd8b800b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:03:07.677 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:07.668+0000 7fd8c3fff640 1 -- 172.21.15.78:0/2069557198 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd8cc14fd10 msgr2=0x7fd8b800b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:03:07.677 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:07.668+0000 7fd8c3fff640 1 --2- 172.21.15.78:0/2069557198 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd8cc14fd10 0x7fd8b800b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:03:07.677 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:07.668+0000 7fd8c3fff640 1 -- 172.21.15.78:0/2069557198 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd8b80039b0 msgr2=0x7fd8b8003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:03:07.677 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:07.668+0000 7fd8c3fff640 1 --2- 172.21.15.78:0/2069557198 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd8b80039b0 0x7fd8b8003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:03:07.677 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:07.668+0000 7fd8c3fff640 1 -- 172.21.15.78:0/2069557198 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8b8003530 con 0x7fd8b80047d0 2023-11-28T20:03:07.677 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:07.668+0000 7fd8cbfff640 1 --2- 172.21.15.78:0/2069557198 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd8cc14fd10 0x7fd8b800b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T20:03:07.678 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:07.672+0000 7fd8c3fff640 1 --2- 172.21.15.78:0/2069557198 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd8b80047d0 0x7fd8b8004c50 secure :-1 s=READY pgs=1141 cs=0 l=1 rev1=1 crypto rx=0x7fd8b4001780 tx=0x7fd8b401c3d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=32b5a21e9a772fa1 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:03:07.679 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:07.672+0000 7fd8caffd640 1 -- 172.21.15.78:0/2069557198 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8b40052d0 con 0x7fd8b80047d0 2023-11-28T20:03:07.679 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:07.672+0000 7fd8caffd640 1 -- 172.21.15.78:0/2069557198 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd8b40a7050 con 0x7fd8b80047d0 2023-11-28T20:03:07.679 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:07.672+0000 7fd8caffd640 1 -- 172.21.15.78:0/2069557198 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8b4003600 con 0x7fd8b80047d0 2023-11-28T20:03:07.679 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:07.672+0000 7fd8d1ff5640 1 -- 172.21.15.78:0/2069557198 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd8b80047d0 msgr2=0x7fd8b8004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:03:07.679 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:07.672+0000 7fd8d1ff5640 1 --2- 172.21.15.78:0/2069557198 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd8b80047d0 0x7fd8b8004c50 secure :-1 s=READY pgs=1141 cs=0 l=1 rev1=1 crypto rx=0x7fd8b4001780 tx=0x7fd8b401c3d0 comp rx=0 tx=0).stop 2023-11-28T20:03:07.679 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:07.672+0000 7fd8cbfff640 1 -- 172.21.15.78:0/2069557198 reap_dead start 2023-11-28T20:03:07.679 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:07.672+0000 7fd8d1ff5640 1 -- 172.21.15.78:0/2069557198 shutdown_connections 2023-11-28T20:03:07.679 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:07.672+0000 7fd8d1ff5640 1 -- 172.21.15.78:0/2069557198 >> 172.21.15.78:0/2069557198 conn(0x7fd8cc0a7810 msgr2=0x7fd8cc0a7c20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:03:07.680 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:07.672+0000 7fd8d1ff5640 1 -- 172.21.15.78:0/2069557198 shutdown_connections 2023-11-28T20:03:07.680 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:07.672+0000 7fd8d1ff5640 1 -- 172.21.15.78:0/2069557198 wait complete. 2023-11-28T20:03:07.682 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:07.676+0000 7fd8d1ff5640 1 Processor -- start 2023-11-28T20:03:07.682 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:07.676+0000 7fd8d1ff5640 1 -- start start 2023-11-28T20:03:07.682 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:07.676+0000 7fd8d1ff5640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd8b80047d0 0x7fd8cc0aa230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:03:07.682 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:07.676+0000 7fd8d1ff5640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd8cc0ab2f0 0x7fd8cc1427b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:03:07.682 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:07.676+0000 7fd8d1ff5640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd8cc1dffc0 0x7fd8cc1e0440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:03:07.682 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:07.676+0000 7fd8d1ff5640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8cc146d10 con 0x7fd8b80047d0 2023-11-28T20:03:07.683 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:07.676+0000 7fd8d1ff5640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8cc0ab750 con 0x7fd8cc1dffc0 2023-11-28T20:03:07.683 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:07.676+0000 7fd8d1ff5640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8cc0aab40 con 0x7fd8cc0ab2f0 2023-11-28T20:03:07.683 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:07.676+0000 7fd8cb7fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd8b80047d0 0x7fd8cc0aa230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:03:07.683 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:07.676+0000 7fd8cb7fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd8b80047d0 0x7fd8cc0aa230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:47660/0 (socket says 172.21.15.78:47660) 2023-11-28T20:03:07.683 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:07.676+0000 7fd8cb7fe640 1 -- 172.21.15.78:0/3969250461 learned_addr learned my addr 172.21.15.78:0/3969250461 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T20:03:07.683 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:07.676+0000 7fd8c3fff640 1 --2- 172.21.15.78:0/3969250461 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd8cc0ab2f0 0x7fd8cc1427b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:03:07.683 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:07.676+0000 7fd8cb7fe640 1 -- 172.21.15.78:0/3969250461 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd8cc0ab2f0 msgr2=0x7fd8cc1427b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:03:07.684 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:07.676+0000 7fd8cbfff640 1 --2- 172.21.15.78:0/3969250461 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd8cc1dffc0 0x7fd8cc1e0440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:03:07.684 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:07.676+0000 7fd8cb7fe640 1 --2- 172.21.15.78:0/3969250461 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd8cc0ab2f0 0x7fd8cc1427b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:03:07.684 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:07.676+0000 7fd8cb7fe640 1 -- 172.21.15.78:0/3969250461 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd8cc1dffc0 msgr2=0x7fd8cc1e0440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:03:07.684 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:07.676+0000 7fd8cb7fe640 1 --2- 172.21.15.78:0/3969250461 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd8cc1dffc0 0x7fd8cc1e0440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:03:07.684 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:07.676+0000 7fd8cb7fe640 1 -- 172.21.15.78:0/3969250461 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8cc1eac00 con 0x7fd8b80047d0 2023-11-28T20:03:07.684 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:07.676+0000 7fd8cbfff640 1 --2- 172.21.15.78:0/3969250461 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd8cc1dffc0 0x7fd8cc1e0440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T20:03:07.684 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:07.676+0000 7fd8c3fff640 1 --2- 172.21.15.78:0/3969250461 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd8cc0ab2f0 0x7fd8cc1427b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T20:03:07.684 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:07.676+0000 7fd8cb7fe640 1 --2- 172.21.15.78:0/3969250461 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd8b80047d0 0x7fd8cc0aa230 secure :-1 s=READY pgs=1142 cs=0 l=1 rev1=1 crypto rx=0x7fd8bc00b7f0 tx=0x7fd8bc00bcb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:03:07.685 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:07.676+0000 7fd8c8ff9640 1 -- 172.21.15.78:0/3969250461 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8bc004170 con 0x7fd8b80047d0 2023-11-28T20:03:07.685 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:07.676+0000 7fd8c8ff9640 1 -- 172.21.15.78:0/3969250461 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd8bc010830 con 0x7fd8b80047d0 2023-11-28T20:03:07.685 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:07.676+0000 7fd8c8ff9640 1 -- 172.21.15.78:0/3969250461 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8bc010be0 con 0x7fd8b80047d0 2023-11-28T20:03:07.685 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:07.676+0000 7fd8d1ff5640 1 -- 172.21.15.78:0/3969250461 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd8cc0aa860 con 0x7fd8b80047d0 2023-11-28T20:03:07.685 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:07.676+0000 7fd8d1ff5640 1 -- 172.21.15.78:0/3969250461 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd8cc1ea890 con 0x7fd8b80047d0 2023-11-28T20:03:07.686 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:07.676+0000 7fd8d1ff5640 1 -- 172.21.15.78:0/3969250461 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd8cc067630 con 0x7fd8b80047d0 2023-11-28T20:03:07.686 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:07.680+0000 7fd8c8ff9640 1 -- 172.21.15.78:0/3969250461 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fd8bc014430 con 0x7fd8b80047d0 2023-11-28T20:03:07.686 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:07.680+0000 7fd8c8ff9640 1 --2- 172.21.15.78:0/3969250461 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fd8ac066470 0x7fd8ac068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:03:07.687 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:07.680+0000 7fd8c8ff9640 1 -- 172.21.15.78:0/3969250461 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 5349+0+0 (secure 0 0 0) 0x7fd8bc0845c0 con 0x7fd8b80047d0 2023-11-28T20:03:07.687 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:07.680+0000 7fd8c3fff640 1 --2- 172.21.15.78:0/3969250461 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fd8ac066470 0x7fd8ac068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:03:07.687 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:07.680+0000 7fd8c3fff640 1 --2- 172.21.15.78:0/3969250461 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fd8ac066470 0x7fd8ac068930 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7fd8b4001750 tx=0x7fd8b40011a0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:03:07.688 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:07.684+0000 7fd8c8ff9640 1 -- 172.21.15.78:0/3969250461 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fd8bc051ba0 con 0x7fd8b80047d0 2023-11-28T20:03:07.836 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:07.832+0000 7fd8d1ff5640 1 -- 172.21.15.78:0/3969250461 --> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fd8cc14d720 con 0x7fd8ac066470 2023-11-28T20:03:07.838 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:07.836+0000 7fd8c8ff9640 1 -- 172.21.15.78:0/3969250461 <== mgr.4106 v2:172.21.15.78:6832/2935380957 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+50731 (secure 0 0 0) 0x7fd8cc14d720 con 0x7fd8ac066470 2023-11-28T20:03:07.839 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-11-28T20:03:07.839 INFO:teuthology.orchestra.run.smithi078.stderr:dumped all 2023-11-28T20:03:07.841 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:07.836+0000 7fd8d1ff5640 1 -- 172.21.15.78:0/3969250461 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fd8ac066470 msgr2=0x7fd8ac068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:03:07.841 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:07.836+0000 7fd8d1ff5640 1 --2- 172.21.15.78:0/3969250461 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fd8ac066470 0x7fd8ac068930 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7fd8b4001750 tx=0x7fd8b40011a0 comp rx=0 tx=0).stop 2023-11-28T20:03:07.841 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:07.836+0000 7fd8d1ff5640 1 -- 172.21.15.78:0/3969250461 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd8b80047d0 msgr2=0x7fd8cc0aa230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:03:07.841 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:07.836+0000 7fd8d1ff5640 1 --2- 172.21.15.78:0/3969250461 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd8b80047d0 0x7fd8cc0aa230 secure :-1 s=READY pgs=1142 cs=0 l=1 rev1=1 crypto rx=0x7fd8bc00b7f0 tx=0x7fd8bc00bcb0 comp rx=0 tx=0).stop 2023-11-28T20:03:07.841 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:07.836+0000 7fd8d1ff5640 1 -- 172.21.15.78:0/3969250461 shutdown_connections 2023-11-28T20:03:07.841 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:07.836+0000 7fd8d1ff5640 1 --2- 172.21.15.78:0/3969250461 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fd8ac066470 0x7fd8ac068930 unknown :-1 s=CLOSED pgs=540 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:03:07.841 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:07.836+0000 7fd8d1ff5640 1 --2- 172.21.15.78:0/3969250461 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd8cc0ab2f0 0x7fd8cc1427b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:03:07.842 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:07.836+0000 7fd8d1ff5640 1 --2- 172.21.15.78:0/3969250461 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd8cc1dffc0 0x7fd8cc1e0440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:03:07.842 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:07.836+0000 7fd8d1ff5640 1 --2- 172.21.15.78:0/3969250461 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd8b80047d0 0x7fd8cc0aa230 unknown :-1 s=CLOSED pgs=1142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:03:07.842 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:07.836+0000 7fd8d1ff5640 1 -- 172.21.15.78:0/3969250461 >> 172.21.15.78:0/3969250461 conn(0x7fd8cc0a7810 msgr2=0x7fd8cc0a6610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:03:07.842 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:07.836+0000 7fd8d1ff5640 1 -- 172.21.15.78:0/3969250461 shutdown_connections 2023-11-28T20:03:07.842 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:07.836+0000 7fd8d1ff5640 1 -- 172.21.15.78:0/3969250461 wait complete. 2023-11-28T20:03:07.860 INFO:teuthology.orchestra.run.smithi078.stdout:{"pg_ready":true,"pg_map":{"version":213,"stamp":"2023-11-28T20:03:06.003782+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":217,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":258448,"kb_used_data":9000,"kb_used_omap":12,"kb_used_meta":249331,"kb_avail":754716272,"statfs":{"total":773094113280,"available":772829462528,"internally_reserved":0,"allocated":9216000,"data_stored":5519038,"data_compressed":66748,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":12752,"internal_metadata":255315504},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":57,"apply_latency_ms":57,"commit_latency_ns":57000000,"apply_latency_ns":57000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-12079,"num_objects":-23,"num_object_clones":0,"num_object_copies":-46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-23,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-60,"num_write_kb":-32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001389"},"pg_stats":[{"pgid":"1.0","version":"17'117","reported_seq":226,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-11-28T20:02:58.009429+0000","last_change":"2023-11-28T19:58:56.136501+0000","last_active":"2023-11-28T20:02:58.009429+0000","last_peered":"2023-11-28T20:02:58.009429+0000","last_clean":"2023-11-28T20:02:58.009429+0000","last_became_active":"2023-11-28T19:58:56.135998+0000","last_became_peered":"2023-11-28T19:58:56.135998+0000","last_unstale":"2023-11-28T20:02:58.009429+0000","last_undegraded":"2023-11-28T20:02:58.009429+0000","last_fullsized":"2023-11-28T20:02:58.009429+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:58:54.602349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:58:54.602349+0000","last_clean_scrub_stamp":"2023-11-28T19:58:54.602349+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:33:42.723349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":66748,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574902,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32348,"kb_used_data":1164,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339492,"statfs":{"total":96636764160,"available":96603639808,"internally_reserved":0,"allocated":1191936,"data_stored":1126507,"data_compressed":33374,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 20:03:01 2023","interfaces":[{"interface":"back","average":{"1min":0.65600000000000003,"5min":0.66700000000000004,"15min":0.67500000000000004},"min":{"1min":0.45100000000000001,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.84299999999999997,"5min":0.94299999999999995,"15min":0.94299999999999995},"last":0.75800000000000001},{"interface":"front","average":{"1min":0.67200000000000004,"5min":0.66800000000000004,"15min":0.67900000000000005},"min":{"1min":0.47799999999999998,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":0.81100000000000005,"5min":1.014,"15min":1.014},"last":0.67400000000000004}]},{"osd":1,"last update":"Tue Nov 28 20:03:01 2023","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.63800000000000001,"15min":0.64300000000000002},"min":{"1min":0.47699999999999998,"5min":0.438,"15min":0.438},"max":{"1min":0.84199999999999997,"5min":0.95099999999999996,"15min":0.95099999999999996},"last":0.53100000000000003},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.66900000000000004,"15min":0.69099999999999995},"min":{"1min":0.47799999999999998,"5min":0.432,"15min":0.432},"max":{"1min":0.77600000000000002,"5min":1.0900000000000001,"15min":1.0900000000000001},"last":0.56999999999999995}]},{"osd":2,"last update":"Tue Nov 28 20:03:01 2023","interfaces":[{"interface":"back","average":{"1min":0.70399999999999996,"5min":0.70299999999999996,"15min":0.72399999999999998},"min":{"1min":0.52800000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.86099999999999999,"5min":0.98799999999999999,"15min":0.98799999999999999},"last":0.65600000000000003},{"interface":"front","average":{"1min":0.67600000000000005,"5min":0.68100000000000005,"15min":0.69799999999999995},"min":{"1min":0.504,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":0.84999999999999998,"5min":1.514,"15min":1.514},"last":0.74399999999999999}]},{"osd":3,"last update":"Tue Nov 28 20:03:01 2023","interfaces":[{"interface":"back","average":{"1min":0.69699999999999995,"5min":0.69699999999999995,"15min":0.69899999999999995},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":0.93200000000000005,"5min":1.0449999999999999,"15min":1.0449999999999999},"last":0.59999999999999998},{"interface":"front","average":{"1min":0.70999999999999996,"5min":0.749,"15min":0.77800000000000002},"min":{"1min":0.53100000000000003,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":0.86599999999999999,"5min":1.1299999999999999,"15min":1.1299999999999999},"last":0.72099999999999997}]},{"osd":4,"last update":"Tue Nov 28 20:03:01 2023","interfaces":[{"interface":"back","average":{"1min":0.64600000000000002,"5min":0.629,"15min":0.63700000000000001},"min":{"1min":0.443,"5min":0.378,"15min":0.378},"max":{"1min":0.86799999999999999,"5min":1.2829999999999999,"15min":1.2829999999999999},"last":0.621},{"interface":"front","average":{"1min":0.70899999999999996,"5min":0.70399999999999996,"15min":0.72399999999999998},"min":{"1min":0.439,"5min":0.379,"15min":0.379},"max":{"1min":0.98199999999999998,"5min":1.1120000000000001,"15min":1.1120000000000001},"last":0.439}]},{"osd":5,"last update":"Tue Nov 28 20:03:01 2023","interfaces":[{"interface":"back","average":{"1min":0.68300000000000005,"5min":0.65200000000000002,"15min":0.67400000000000004},"min":{"1min":0.42599999999999999,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.86299999999999999,"5min":1.1699999999999999,"15min":1.1699999999999999},"last":0.78400000000000003},{"interface":"front","average":{"1min":0.70099999999999996,"5min":0.72399999999999998,"15min":0.752},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":0.92000000000000004,"5min":1.3300000000000001,"15min":1.3300000000000001},"last":0.77300000000000002}]},{"osd":6,"last update":"Tue Nov 28 20:03:01 2023","interfaces":[{"interface":"back","average":{"1min":0.76100000000000001,"5min":0.75900000000000001,"15min":0.77400000000000002},"min":{"1min":0.59999999999999998,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.95599999999999996,"5min":1.3919999999999999,"15min":1.3919999999999999},"last":0.70399999999999996},{"interface":"front","average":{"1min":0.70399999999999996,"5min":0.70299999999999996,"15min":0.73199999999999998},"min":{"1min":0.443,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":1.018,"5min":1.23,"15min":1.23},"last":0.68799999999999994}]}]},{"osd":6,"up_from":13,"seq":55834574900,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32312,"kb_used_data":1132,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339528,"statfs":{"total":96636764160,"available":96603676672,"internally_reserved":0,"allocated":1159168,"data_stored":554304,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 20:02:55 2023","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.61799999999999999,"15min":0.61599999999999999},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.88700000000000001,"5min":0.91600000000000004,"15min":0.91600000000000004},"last":0.51500000000000001},{"interface":"front","average":{"1min":0.63500000000000001,"5min":0.65400000000000003,"15min":0.66000000000000003},"min":{"1min":0.49399999999999999,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":0.91900000000000004,"5min":0.98999999999999999,"15min":0.98999999999999999},"last":0.625}]},{"osd":1,"last update":"Tue Nov 28 20:02:55 2023","interfaces":[{"interface":"back","average":{"1min":0.73499999999999999,"5min":0.755,"15min":0.77900000000000003},"min":{"1min":0.55800000000000005,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":0.89000000000000001,"5min":1.105,"15min":1.105},"last":0.66800000000000004},{"interface":"front","average":{"1min":0.66300000000000003,"5min":0.67100000000000004,"15min":0.68100000000000005},"min":{"1min":0.50600000000000001,"5min":0.443,"15min":0.443},"max":{"1min":0.879,"5min":0.95899999999999996,"15min":0.95899999999999996},"last":0.68400000000000005}]},{"osd":2,"last update":"Tue Nov 28 20:02:55 2023","interfaces":[{"interface":"back","average":{"1min":0.64000000000000001,"5min":0.67000000000000004,"15min":0.68999999999999995},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.81599999999999995,"5min":0.93400000000000005,"15min":0.93400000000000005},"last":0.48499999999999999},{"interface":"front","average":{"1min":0.70599999999999996,"5min":0.70099999999999996,"15min":0.71299999999999997},"min":{"1min":0.46999999999999997,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":0.84299999999999997,"5min":1.006,"15min":1.006},"last":0.71999999999999997}]},{"osd":3,"last update":"Tue Nov 28 20:02:55 2023","interfaces":[{"interface":"back","average":{"1min":0.69499999999999995,"5min":0.71699999999999997,"15min":0.73799999999999999},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.86399999999999999,"5min":1.056,"15min":1.056},"last":0.57599999999999996},{"interface":"front","average":{"1min":0.66500000000000004,"5min":0.66200000000000003,"15min":0.67700000000000005},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.87,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.53400000000000003}]},{"osd":4,"last update":"Tue Nov 28 20:02:55 2023","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.61799999999999999,"15min":0.626},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.81000000000000005,"5min":0.97599999999999998,"15min":0.97599999999999998},"last":0.55500000000000005},{"interface":"front","average":{"1min":0.67300000000000004,"5min":0.67400000000000004,"15min":0.71699999999999997},"min":{"1min":0.46999999999999997,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.82799999999999996,"5min":1.389,"15min":1.389},"last":0.70299999999999996}]},{"osd":5,"last update":"Tue Nov 28 20:02:55 2023","interfaces":[{"interface":"back","average":{"1min":0.70399999999999996,"5min":0.749,"15min":0.79400000000000004},"min":{"1min":0.49399999999999999,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.95499999999999996,"5min":1.4259999999999999,"15min":1.4259999999999999},"last":0.73399999999999999},{"interface":"front","average":{"1min":0.69199999999999995,"5min":0.71599999999999997,"15min":0.747},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.90000000000000002,"5min":1.276,"15min":1.276},"last":0.46600000000000003}]},{"osd":7,"last update":"Tue Nov 28 20:02:55 2023","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.67100000000000004,"15min":0.69999999999999996},"min":{"1min":0.379,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.90300000000000002,"5min":1.014,"15min":1.014},"last":0.60499999999999998},{"interface":"front","average":{"1min":0.73799999999999999,"5min":0.76100000000000001,"15min":0.80700000000000005},"min":{"1min":0.52700000000000002,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":0.92200000000000004,"5min":1.242,"15min":1.242},"last":0.64000000000000001}]}]},{"osd":5,"up_from":13,"seq":55834574902,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32284,"kb_used_data":1104,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339556,"statfs":{"total":96636764160,"available":96603705344,"internally_reserved":0,"allocated":1130496,"data_stored":542557,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 20:03:02 2023","interfaces":[{"interface":"back","average":{"1min":0.85899999999999999,"5min":0.71399999999999997,"15min":0.71099999999999997},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":5.9080000000000004,"5min":5.9080000000000004,"15min":5.9080000000000004},"last":0.45900000000000002},{"interface":"front","average":{"1min":0.84099999999999997,"5min":0.70999999999999996,"15min":0.71599999999999997},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":4.8789999999999996,"5min":4.8789999999999996,"15min":4.8789999999999996},"last":0.73699999999999999}]},{"osd":1,"last update":"Tue Nov 28 20:03:02 2023","interfaces":[{"interface":"back","average":{"1min":0.875,"5min":0.71899999999999997,"15min":0.71499999999999997},"min":{"1min":0.42599999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":5.1529999999999996,"5min":5.1529999999999996,"15min":5.1529999999999996},"last":0.67200000000000004},{"interface":"front","average":{"1min":0.91700000000000004,"5min":0.73099999999999998,"15min":0.72899999999999998},"min":{"1min":0.41199999999999998,"5min":0.38,"15min":0.38},"max":{"1min":6.3630000000000004,"5min":6.3630000000000004,"15min":6.3630000000000004},"last":0.41199999999999998}]},{"osd":2,"last update":"Tue Nov 28 20:03:02 2023","interfaces":[{"interface":"back","average":{"1min":0.83299999999999996,"5min":0.81100000000000005,"15min":0.90100000000000002},"min":{"1min":0.47799999999999998,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":4.3639999999999999,"5min":5.0880000000000001,"15min":5.0880000000000001},"last":0.878},{"interface":"front","average":{"1min":0.93700000000000006,"5min":0.86599999999999999,"15min":0.95599999999999996},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":6.335,"5min":6.335,"15min":6.335},"last":0.56999999999999995}]},{"osd":3,"last update":"Tue Nov 28 20:03:02 2023","interfaces":[{"interface":"back","average":{"1min":0.92200000000000004,"5min":0.88,"15min":0.97799999999999998},"min":{"1min":0.56399999999999995,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":4.9710000000000001,"5min":5.0469999999999997,"15min":5.0469999999999997},"last":0.81499999999999995},{"interface":"front","average":{"1min":0.878,"5min":0.85399999999999998,"15min":0.95199999999999996},"min":{"1min":0.51600000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":5.0439999999999996,"5min":5.0439999999999996,"15min":5.0439999999999996},"last":0.61099999999999999}]},{"osd":4,"last update":"Tue Nov 28 20:03:02 2023","interfaces":[{"interface":"back","average":{"1min":0.88200000000000001,"5min":0.68100000000000005,"15min":0.67800000000000005},"min":{"1min":0.38700000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":6.5380000000000003,"5min":6.5380000000000003,"15min":6.5380000000000003},"last":0.78900000000000003},{"interface":"front","average":{"1min":0.85899999999999999,"5min":0.74299999999999999,"15min":0.745},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":5.0179999999999998,"5min":5.0179999999999998,"15min":5.0179999999999998},"last":0.93999999999999995}]},{"osd":6,"last update":"Tue Nov 28 20:03:02 2023","interfaces":[{"interface":"back","average":{"1min":0.871,"5min":0.73899999999999999,"15min":0.71699999999999997},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":5.21,"5min":5.21,"15min":5.21},"last":0.85099999999999998},{"interface":"front","average":{"1min":0.94699999999999995,"5min":0.76400000000000001,"15min":0.753},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":6.4790000000000001,"5min":6.4790000000000001,"15min":6.4790000000000001},"last":0.83399999999999996}]},{"osd":7,"last update":"Tue Nov 28 20:03:02 2023","interfaces":[{"interface":"back","average":{"1min":0.93999999999999995,"5min":0.80400000000000005,"15min":0.79200000000000004},"min":{"1min":0.53100000000000003,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":5.6360000000000001,"5min":5.6360000000000001,"15min":5.6360000000000001},"last":0.91200000000000003},{"interface":"front","average":{"1min":0.92800000000000005,"5min":0.80800000000000005,"15min":0.80300000000000005},"min":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":5.5819999999999999,"5min":5.5819999999999999,"15min":5.5819999999999999},"last":0.76200000000000001}]}]},{"osd":4,"up_from":13,"seq":55834574901,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32292,"kb_used_data":1112,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339548,"statfs":{"total":96636764160,"available":96603697152,"internally_reserved":0,"allocated":1138688,"data_stored":542649,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 20:03:01 2023","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.68100000000000005,"15min":0.70099999999999996},"min":{"1min":0.51800000000000002,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.85199999999999998,"5min":1.107,"15min":1.107},"last":0.66400000000000003},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.66300000000000003,"15min":0.69699999999999995},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.81499999999999995,"5min":1.163,"15min":1.163},"last":0.63800000000000001}]},{"osd":1,"last update":"Tue Nov 28 20:03:01 2023","interfaces":[{"interface":"back","average":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.74199999999999999},"min":{"1min":0.41499999999999998,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.95499999999999996,"5min":1.111,"15min":1.111},"last":0.76900000000000002},{"interface":"front","average":{"1min":0.70499999999999996,"5min":0.75800000000000001,"15min":0.79500000000000004},"min":{"1min":0.502,"5min":0.443,"15min":0.443},"max":{"1min":0.91000000000000003,"5min":1.238,"15min":1.238},"last":0.75900000000000001}]},{"osd":2,"last update":"Tue Nov 28 20:03:01 2023","interfaces":[{"interface":"back","average":{"1min":0.68300000000000005,"5min":0.73099999999999998,"15min":0.76500000000000001},"min":{"1min":0.44500000000000001,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.92700000000000005,"5min":1.0669999999999999,"15min":1.0669999999999999},"last":0.71599999999999997},{"interface":"front","average":{"1min":0.74399999999999999,"5min":0.75900000000000001,"15min":0.79700000000000004},"min":{"1min":0.63600000000000001,"5min":0.438,"15min":0.438},"max":{"1min":0.86399999999999999,"5min":1.1359999999999999,"15min":1.1359999999999999},"last":0.70299999999999996}]},{"osd":3,"last update":"Tue Nov 28 20:03:01 2023","interfaces":[{"interface":"back","average":{"1min":0.626,"5min":0.70899999999999996,"15min":0.77100000000000002},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":0.76300000000000001,"5min":1.202,"15min":1.202},"last":0.74199999999999999},{"interface":"front","average":{"1min":0.71699999999999997,"5min":0.745,"15min":0.77900000000000003},"min":{"1min":0.50600000000000001,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":0.90100000000000002,"5min":1.0669999999999999,"15min":1.0669999999999999},"last":0.81200000000000006}]},{"osd":5,"last update":"Tue Nov 28 20:03:01 2023","interfaces":[{"interface":"back","average":{"1min":0.59699999999999998,"5min":0.67000000000000004,"15min":0.70599999999999996},"min":{"1min":0.38400000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.78900000000000003,"5min":0.95899999999999996,"15min":0.95899999999999996},"last":0.61899999999999999},{"interface":"front","average":{"1min":0.60499999999999998,"5min":0.66200000000000003,"15min":0.69599999999999995},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.92200000000000004,"5min":1.034,"15min":1.034},"last":0.68600000000000005}]},{"osd":6,"last update":"Tue Nov 28 20:03:01 2023","interfaces":[{"interface":"back","average":{"1min":0.69699999999999995,"5min":0.68400000000000005,"15min":0.71799999999999997},"min":{"1min":0.48699999999999999,"5min":0.438,"15min":0.438},"max":{"1min":0.94499999999999995,"5min":1.0309999999999999,"15min":1.0309999999999999},"last":0.58999999999999997},{"interface":"front","average":{"1min":0.68200000000000005,"5min":0.746,"15min":0.77100000000000002},"min":{"1min":0.48799999999999999,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":0.88800000000000001,"5min":1.002,"15min":1.002},"last":0.56200000000000006}]},{"osd":7,"last update":"Tue Nov 28 20:03:01 2023","interfaces":[{"interface":"back","average":{"1min":0.69899999999999995,"5min":0.74099999999999999,"15min":0.77200000000000002},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":0.89800000000000002,"5min":1.089,"15min":1.089},"last":0.78800000000000003},{"interface":"front","average":{"1min":0.80700000000000005,"5min":0.82399999999999995,"15min":0.85399999999999998},"min":{"1min":0.68200000000000005,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":0.97199999999999998,"5min":1.1459999999999999,"15min":1.1459999999999999},"last":0.85599999999999998}]}]},{"osd":3,"up_from":13,"seq":55834574902,"num_pgs":45,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32280,"kb_used_data":1100,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339560,"statfs":{"total":96636764160,"available":96603709440,"internally_reserved":0,"allocated":1126400,"data_stored":536699,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":10,"apply_latency_ms":10,"commit_latency_ns":10000000,"apply_latency_ns":10000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 20:02:58 2023","interfaces":[{"interface":"back","average":{"1min":0.40200000000000002,"5min":0.432,"15min":0.442},"min":{"1min":0.31,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":0.52100000000000002,"5min":1.7130000000000001,"15min":1.7130000000000001},"last":0.503},{"interface":"front","average":{"1min":0.46000000000000002,"5min":0.46300000000000002,"15min":0.46999999999999997},"min":{"1min":0.377,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.57899999999999996,"5min":3.0630000000000002,"15min":3.0630000000000002},"last":0.54500000000000004}]},{"osd":1,"last update":"Tue Nov 28 20:02:58 2023","interfaces":[{"interface":"back","average":{"1min":0.434,"5min":0.44800000000000001,"15min":0.46999999999999997},"min":{"1min":0.32900000000000001,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.85399999999999998,"5min":0.89200000000000002,"15min":0.89200000000000002},"last":0.85399999999999998},{"interface":"front","average":{"1min":0.438,"5min":0.50800000000000001,"15min":0.50600000000000001},"min":{"1min":0.30599999999999999,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.66700000000000004,"5min":5.8920000000000003,"15min":5.8920000000000003},"last":0.41799999999999998}]},{"osd":2,"last update":"Tue Nov 28 20:02:58 2023","interfaces":[{"interface":"back","average":{"1min":0.499,"5min":0.54100000000000004,"15min":0.53600000000000003},"min":{"1min":0.36199999999999999,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.621,"5min":4.6390000000000002,"15min":4.6390000000000002},"last":0.60299999999999998},{"interface":"front","average":{"1min":0.52100000000000002,"5min":0.626,"15min":0.59899999999999998},"min":{"1min":0.42099999999999999,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.80200000000000005,"5min":11.593,"15min":11.593},"last":0.80200000000000005}]},{"osd":4,"last update":"Tue Nov 28 20:02:58 2023","interfaces":[{"interface":"back","average":{"1min":0.98699999999999999,"5min":0.83899999999999997,"15min":0.78700000000000003},"min":{"1min":0.61599999999999999,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":5.2629999999999999,"5min":5.5549999999999997,"15min":5.5549999999999997},"last":5.2629999999999999},{"interface":"front","average":{"1min":1.0229999999999999,"5min":0.92300000000000004,"15min":0.84299999999999997},"min":{"1min":0.60999999999999999,"5min":0.503,"15min":0.503},"max":{"1min":5.4939999999999998,"5min":11.747,"15min":11.747},"last":5.4939999999999998}]},{"osd":5,"last update":"Tue Nov 28 20:02:58 2023","interfaces":[{"interface":"back","average":{"1min":0.92900000000000005,"5min":0.88300000000000001,"15min":0.82699999999999996},"min":{"1min":0.52600000000000002,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":5.4450000000000003,"5min":11.705,"15min":11.705},"last":5.4450000000000003},{"interface":"front","average":{"1min":0.94499999999999995,"5min":0.79900000000000004,"15min":0.80100000000000005},"min":{"1min":0.56599999999999995,"5min":0.495,"15min":0.495},"max":{"1min":4.681,"5min":4.681,"15min":4.681},"last":4.681}]},{"osd":6,"last update":"Tue Nov 28 20:02:58 2023","interfaces":[{"interface":"back","average":{"1min":0.78500000000000003,"5min":0.80700000000000005,"15min":0.83099999999999996},"min":{"1min":0.54600000000000004,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":1,"5min":1.6639999999999999,"15min":1.6639999999999999},"last":1},{"interface":"front","average":{"1min":0.81499999999999995,"5min":0.81699999999999995,"15min":0.77100000000000002},"min":{"1min":0.55200000000000005,"5min":0.495,"15min":0.495},"max":{"1min":1.0329999999999999,"5min":4.0679999999999996,"15min":4.0679999999999996},"last":0.90600000000000003}]},{"osd":7,"last update":"Tue Nov 28 20:02:58 2023","interfaces":[{"interface":"back","average":{"1min":0.90100000000000002,"5min":0.90600000000000003,"15min":0.86799999999999999},"min":{"1min":0.64700000000000002,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":2.6589999999999998,"5min":6.6619999999999999,"15min":6.6619999999999999},"last":2.6589999999999998},{"interface":"front","average":{"1min":0.94099999999999995,"5min":0.93300000000000005,"15min":0.90500000000000003},"min":{"1min":0.57399999999999995,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":4.6539999999999999,"5min":11.782,"15min":11.782},"last":4.6539999999999999}]}]},{"osd":2,"up_from":13,"seq":55834574900,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32288,"kb_used_data":1108,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339552,"statfs":{"total":96636764160,"available":96603701248,"internally_reserved":0,"allocated":1134592,"data_stored":542591,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 20:02:57 2023","interfaces":[{"interface":"back","average":{"1min":0.39300000000000002,"5min":0.42499999999999999,"15min":0.44500000000000001},"min":{"1min":0.254,"5min":0.254,"15min":0.254},"max":{"1min":0.58399999999999996,"5min":0.74099999999999999,"15min":0.74099999999999999},"last":0.46800000000000003},{"interface":"front","average":{"1min":0.35799999999999998,"5min":0.436,"15min":0.46700000000000003},"min":{"1min":0.27300000000000002,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.46999999999999997,"5min":0.67700000000000005,"15min":0.67700000000000005},"last":0.51000000000000001}]},{"osd":1,"last update":"Tue Nov 28 20:02:57 2023","interfaces":[{"interface":"back","average":{"1min":0.437,"5min":0.47399999999999998,"15min":0.501},"min":{"1min":0.33600000000000002,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.50600000000000001,"5min":1.0389999999999999,"15min":1.0389999999999999},"last":0.34999999999999998},{"interface":"front","average":{"1min":0.433,"5min":0.46500000000000002,"15min":0.49099999999999999},"min":{"1min":0.28899999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.56699999999999995,"5min":0.70999999999999996,"15min":0.70999999999999996},"last":0.501}]},{"osd":3,"last update":"Tue Nov 28 20:02:57 2023","interfaces":[{"interface":"back","average":{"1min":0.41299999999999998,"5min":0.45100000000000001,"15min":0.46500000000000002},"min":{"1min":0.32100000000000001,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"last":0.42599999999999999},{"interface":"front","average":{"1min":0.46700000000000003,"5min":0.53400000000000003,"15min":0.57199999999999995},"min":{"1min":0.39700000000000002,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.56399999999999995,"5min":0.98499999999999999,"15min":0.98499999999999999},"last":0.45100000000000001}]},{"osd":4,"last update":"Tue Nov 28 20:02:57 2023","interfaces":[{"interface":"back","average":{"1min":0.69199999999999995,"5min":0.76900000000000002,"15min":0.83099999999999996},"min":{"1min":0.5,"5min":0.5,"15min":0.5},"max":{"1min":0.97199999999999998,"5min":1.139,"15min":1.139},"last":0.68700000000000006},{"interface":"front","average":{"1min":0.65900000000000003,"5min":0.75700000000000001,"15min":0.82099999999999995},"min":{"1min":0.51600000000000001,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":0.82699999999999996,"5min":1.238,"15min":1.238},"last":0.73599999999999999}]},{"osd":5,"last update":"Tue Nov 28 20:02:57 2023","interfaces":[{"interface":"back","average":{"1min":0.69799999999999995,"5min":0.77400000000000002,"15min":0.84799999999999998},"min":{"1min":0.55300000000000005,"5min":0.437,"15min":0.437},"max":{"1min":0.94499999999999995,"5min":1.6180000000000001,"15min":1.6180000000000001},"last":0.63500000000000001},{"interface":"front","average":{"1min":0.65600000000000003,"5min":0.748,"15min":0.80600000000000005},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":0.84099999999999997,"5min":1.339,"15min":1.339},"last":0.72099999999999997}]},{"osd":6,"last update":"Tue Nov 28 20:02:57 2023","interfaces":[{"interface":"back","average":{"1min":0.69699999999999995,"5min":0.751,"15min":0.78700000000000003},"min":{"1min":0.54300000000000004,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":0.88300000000000001,"5min":1.1839999999999999,"15min":1.1839999999999999},"last":0.755},{"interface":"front","average":{"1min":0.67500000000000004,"5min":0.76500000000000001,"15min":0.82899999999999996},"min":{"1min":0.52400000000000002,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":0.93000000000000005,"5min":1.099,"15min":1.099},"last":0.65400000000000003}]},{"osd":7,"last update":"Tue Nov 28 20:02:57 2023","interfaces":[{"interface":"back","average":{"1min":0.67200000000000004,"5min":0.77800000000000002,"15min":0.85199999999999998},"min":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":0.86899999999999999,"5min":1.4590000000000001,"15min":1.4590000000000001},"last":0.70899999999999996},{"interface":"front","average":{"1min":0.71299999999999997,"5min":0.77800000000000002,"15min":0.83699999999999997},"min":{"1min":0.57199999999999995,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":0.85499999999999998,"5min":1.387,"15min":1.387},"last":0.62}]}]},{"osd":1,"up_from":13,"seq":55834574902,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32276,"kb_used_data":1096,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339564,"statfs":{"total":96636764160,"available":96603713536,"internally_reserved":0,"allocated":1122304,"data_stored":536013,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":10,"apply_latency_ms":10,"commit_latency_ns":10000000,"apply_latency_ns":10000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 20:02:00 2023","interfaces":[{"interface":"back","average":{"1min":0.38700000000000001,"5min":0.54600000000000004,"15min":0.62},"min":{"1min":0.249,"5min":0.249,"15min":0.249},"max":{"1min":0.60699999999999998,"5min":3.8740000000000001,"15min":3.8740000000000001},"last":0.48899999999999999},{"interface":"front","average":{"1min":0.42099999999999999,"5min":0.51000000000000001,"15min":0.55100000000000005},"min":{"1min":0.32300000000000001,"5min":0.25,"15min":0.25},"max":{"1min":0.60399999999999998,"5min":2.0760000000000001,"15min":2.0760000000000001},"last":0.36799999999999999}]},{"osd":2,"last update":"Tue Nov 28 20:02:00 2023","interfaces":[{"interface":"back","average":{"1min":0.41399999999999998,"5min":0.56000000000000005,"15min":0.626},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.70799999999999996,"5min":3.7320000000000002,"15min":3.7320000000000002},"last":0.41099999999999998},{"interface":"front","average":{"1min":0.46899999999999997,"5min":0.63400000000000001,"15min":0.71799999999999997},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.67000000000000004,"5min":3.9089999999999998,"15min":3.9089999999999998},"last":0.443}]},{"osd":3,"last update":"Tue Nov 28 20:02:00 2023","interfaces":[{"interface":"back","average":{"1min":0.52200000000000002,"5min":0.61799999999999999,"15min":0.66000000000000003},"min":{"1min":0.436,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.70799999999999996,"5min":1.6399999999999999,"15min":1.6399999999999999},"last":0.53200000000000003},{"interface":"front","average":{"1min":0.45500000000000002,"5min":0.61599999999999999,"15min":0.67400000000000004},"min":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.625,"5min":2.5270000000000001,"15min":2.5270000000000001},"last":0.42999999999999999}]},{"osd":4,"last update":"Tue Nov 28 20:02:00 2023","interfaces":[{"interface":"back","average":{"1min":0.69799999999999995,"5min":0.81699999999999995,"15min":0.86899999999999999},"min":{"1min":0.42199999999999999,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.91400000000000003,"5min":3.1659999999999999,"15min":3.1659999999999999},"last":0.67400000000000004},{"interface":"front","average":{"1min":0.69699999999999995,"5min":0.84399999999999997,"15min":0.91200000000000003},"min":{"1min":0.52300000000000002,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.94299999999999995,"5min":3.7959999999999998,"15min":3.7959999999999998},"last":0.77000000000000002}]},{"osd":5,"last update":"Tue Nov 28 20:02:00 2023","interfaces":[{"interface":"back","average":{"1min":0.71399999999999997,"5min":0.875,"15min":0.95099999999999996},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":1.004,"5min":4.1479999999999997,"15min":4.1479999999999997},"last":0.75900000000000001},{"interface":"front","average":{"1min":0.69799999999999995,"5min":0.82599999999999996,"15min":0.88200000000000001},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":0.87,"5min":3.5569999999999999,"15min":3.5569999999999999},"last":0.63900000000000001}]},{"osd":6,"last update":"Tue Nov 28 20:02:00 2023","interfaces":[{"interface":"back","average":{"1min":0.72399999999999998,"5min":0.88800000000000001,"15min":0.95699999999999996},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":0.94499999999999995,"5min":2.863,"15min":2.863},"last":0.78900000000000003},{"interface":"front","average":{"1min":0.76800000000000002,"5min":0.89800000000000002,"15min":0.95399999999999996},"min":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":0.97999999999999998,"5min":3.371,"15min":3.371},"last":0.74399999999999999}]},{"osd":7,"last update":"Tue Nov 28 20:02:00 2023","interfaces":[{"interface":"back","average":{"1min":0.70299999999999996,"5min":0.89100000000000001,"15min":0.97199999999999998},"min":{"1min":0.53100000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":0.93600000000000005,"5min":3.8439999999999999,"15min":3.8439999999999999},"last":0.72399999999999998},{"interface":"front","average":{"1min":0.68799999999999994,"5min":0.90500000000000003,"15min":0.99299999999999999},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.95899999999999996,"5min":3.9689999999999999,"15min":3.9689999999999999},"last":0.81100000000000005}]}]},{"osd":0,"up_from":13,"seq":55834574901,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32368,"kb_used_data":1184,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339472,"statfs":{"total":96636764160,"available":96603619328,"internally_reserved":0,"allocated":1212416,"data_stored":1137718,"data_compressed":33374,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Nov 28 20:02:58 2023","interfaces":[{"interface":"back","average":{"1min":0.38700000000000001,"5min":0.51300000000000001,"15min":0.63100000000000001},"min":{"1min":0.26000000000000001,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":0.80100000000000005,"5min":4.883,"15min":4.883},"last":0.27100000000000002},{"interface":"front","average":{"1min":0.47999999999999998,"5min":0.621,"15min":0.79200000000000004},"min":{"1min":0.23899999999999999,"5min":0.23899999999999999,"15min":0.23899999999999999},"max":{"1min":1.7669999999999999,"5min":8.0800000000000001,"15min":8.0800000000000001},"last":0.40000000000000002}]},{"osd":2,"last update":"Tue Nov 28 20:02:58 2023","interfaces":[{"interface":"back","average":{"1min":0.48599999999999999,"5min":0.67700000000000005,"15min":0.875},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":1.0309999999999999,"5min":8.1029999999999998,"15min":8.1029999999999998},"last":0.621},{"interface":"front","average":{"1min":0.55300000000000005,"5min":0.70699999999999996,"15min":0.89300000000000002},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":1.802,"5min":8.1310000000000002,"15min":8.1310000000000002},"last":0.66500000000000004}]},{"osd":3,"last update":"Tue Nov 28 20:02:58 2023","interfaces":[{"interface":"back","average":{"1min":0.47399999999999998,"5min":0.57399999999999995,"15min":0.68899999999999995},"min":{"1min":0.27700000000000002,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":1.5629999999999999,"5min":4.3949999999999996,"15min":4.3949999999999996},"last":0.378},{"interface":"front","average":{"1min":0.58099999999999996,"5min":0.61599999999999999,"15min":0.70999999999999996},"min":{"1min":0.34999999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":2.0920000000000001,"5min":4.3470000000000004,"15min":4.3470000000000004},"last":0.41899999999999998}]},{"osd":4,"last update":"Tue Nov 28 20:02:58 2023","interfaces":[{"interface":"back","average":{"1min":0.747,"5min":0.85899999999999999,"15min":0.98699999999999999},"min":{"1min":0.52400000000000002,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":1.52,"5min":4.6360000000000001,"15min":4.6360000000000001},"last":0.81000000000000005},{"interface":"front","average":{"1min":0.70799999999999996,"5min":0.86499999999999999,"15min":0.98999999999999999},"min":{"1min":0.53800000000000003,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":0.98099999999999998,"5min":4.4710000000000001,"15min":4.4710000000000001},"last":0.64900000000000002}]},{"osd":5,"last update":"Tue Nov 28 20:02:58 2023","interfaces":[{"interface":"back","average":{"1min":0.751,"5min":0.87,"15min":1},"min":{"1min":0.52300000000000002,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.6659999999999999,"5min":4.6120000000000001,"15min":4.6120000000000001},"last":0.58799999999999997},{"interface":"front","average":{"1min":0.79300000000000004,"5min":0.88500000000000001,"15min":0.996},"min":{"1min":0.65000000000000002,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.595,"5min":4.5449999999999999,"15min":4.5449999999999999},"last":0.59899999999999998}]},{"osd":6,"last update":"Tue Nov 28 20:02:58 2023","interfaces":[{"interface":"back","average":{"1min":0.77000000000000002,"5min":0.88300000000000001,"15min":1.0129999999999999},"min":{"1min":0.57299999999999995,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":2.149,"5min":4.657,"15min":4.657},"last":0.68300000000000005},{"interface":"front","average":{"1min":0.80400000000000005,"5min":0.89900000000000002,"15min":1.0309999999999999},"min":{"1min":0.60999999999999999,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":2.2130000000000001,"5min":4.5259999999999998,"15min":4.5259999999999998},"last":0.71199999999999997}]},{"osd":7,"last update":"Tue Nov 28 20:02:58 2023","interfaces":[{"interface":"back","average":{"1min":0.754,"5min":0.88300000000000001,"15min":1.028},"min":{"1min":0.56299999999999994,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":1.7270000000000001,"5min":4.7320000000000002,"15min":4.7320000000000002},"last":0.55000000000000004},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.86899999999999999,"15min":0.98699999999999999},"min":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":1.0880000000000001,"5min":4.4939999999999998,"15min":4.4939999999999998},"last":0.69299999999999995}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33374,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33374,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-28T20:03:07.861 INFO:tasks.ceph.ceph_manager.ceph:clean! 2023-11-28T20:03:07.861 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-28T20:03:07.998 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:07.992+0000 7f1a0e5aa640 1 Processor -- start 2023-11-28T20:03:07.998 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:07.992+0000 7f1a0e5aa640 1 -- start start 2023-11-28T20:03:07.999 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:07.996+0000 7f1a0e5aa640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1a08071e30 0x7f1a08072290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:03:07.999 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:07.996+0000 7f1a0e5aa640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f1a08156110 0x7f1a081565a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:03:07.999 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:07.996+0000 7f1a0e5aa640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1a080c5710 con 0x7f1a0814fd10 2023-11-28T20:03:08.000 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:07.996+0000 7f1a0e5aa640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1a0806c5e0 con 0x7f1a08156110 2023-11-28T20:03:08.000 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:07.996+0000 7f1a0e5aa640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a08155c80 con 0x7f1a08071e30 2023-11-28T20:03:08.001 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:07.996+0000 7f1a0cb47640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f1a08156110 0x7f1a081565a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:03:08.001 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:07.996+0000 7f1a077fe640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1a08071e30 0x7f1a08072290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:03:08.001 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:07.996+0000 7f1a0cb47640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f1a08156110 0x7f1a081565a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.78:60380/0 (socket says 172.21.15.78:60380) 2023-11-28T20:03:08.001 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:07.996+0000 7f1a0cb47640 1 -- 172.21.15.78:0/1301008573 learned_addr learned my addr 172.21.15.78:0/1301008573 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T20:03:08.001 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:07.996+0000 7f1a07fff640 1 --1- 172.21.15.78:0/1301008573 >> v1:172.21.15.179:6789/0 conn(0x7f1a0814fd10 0x7f1a080a4dc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.179:6789/0 says I am v1:172.21.15.78:56620/0 (socket says 172.21.15.78:56620) 2023-11-28T20:03:08.001 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:07.996+0000 7f1a0cb47640 1 -- 172.21.15.78:0/1301008573 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1a08071e30 msgr2=0x7f1a08072290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:03:08.002 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:07.996+0000 7f1a0cb47640 1 --2- 172.21.15.78:0/1301008573 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1a08071e30 0x7f1a08072290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:03:08.002 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:07.996+0000 7f1a0cb47640 1 -- 172.21.15.78:0/1301008573 >> v1:172.21.15.179:6789/0 conn(0x7f1a0814fd10 legacy=0x7f1a080a4dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:03:08.002 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:07.996+0000 7f1a0cb47640 1 -- 172.21.15.78:0/1301008573 --> v2:172.21.15.179:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a080c4e70 con 0x7f1a08156110 2023-11-28T20:03:08.002 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:07.996+0000 7f1a077fe640 1 --2- 172.21.15.78:0/1301008573 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1a08071e30 0x7f1a08072290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T20:03:08.003 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:08.000+0000 7f1a0cb47640 1 --2- 172.21.15.78:0/1301008573 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1a08156110 0x7f1a081565a0 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f1a00009e50 tx=0x7f1a0001c8c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=87feedb143549f34 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:03:08.004 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:08.000+0000 7f1a06ffd640 1 -- 172.21.15.78:0/1301008573 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a000a5780 con 0x7f1a08156110 2023-11-28T20:03:08.004 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:08.000+0000 7f1a06ffd640 1 -- 172.21.15.78:0/1301008573 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a000a58e0 con 0x7f1a08156110 2023-11-28T20:03:08.004 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:08.000+0000 7f1a06ffd640 1 -- 172.21.15.78:0/1301008573 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a000a5c70 con 0x7f1a08156110 2023-11-28T20:03:08.005 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:08.000+0000 7f1a0e5aa640 1 -- 172.21.15.78:0/1301008573 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1a08156110 msgr2=0x7f1a081565a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:03:08.005 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:08.000+0000 7f1a0e5aa640 1 --2- 172.21.15.78:0/1301008573 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1a08156110 0x7f1a081565a0 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f1a00009e50 tx=0x7f1a0001c8c0 comp rx=0 tx=0).stop 2023-11-28T20:03:08.005 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:08.000+0000 7f1a0e5aa640 1 -- 172.21.15.78:0/1301008573 shutdown_connections 2023-11-28T20:03:08.005 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:08.000+0000 7f1a0e5aa640 1 --2- 172.21.15.78:0/1301008573 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1a08156110 0x7f1a081565a0 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:03:08.005 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:08.000+0000 7f1a0e5aa640 1 --2- 172.21.15.78:0/1301008573 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1a08071e30 0x7f1a08072290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:03:08.005 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:08.000+0000 7f1a0e5aa640 1 -- 172.21.15.78:0/1301008573 >> 172.21.15.78:0/1301008573 conn(0x7f1a080a7810 msgr2=0x7f1a080a7c20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:03:08.005 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:08.000+0000 7f1a0e5aa640 1 -- 172.21.15.78:0/1301008573 shutdown_connections 2023-11-28T20:03:08.005 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:08.000+0000 7f1a0e5aa640 1 -- 172.21.15.78:0/1301008573 wait complete. 2023-11-28T20:03:08.006 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:08.000+0000 7f1a0e5aa640 1 Processor -- start 2023-11-28T20:03:08.006 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:08.004+0000 7f1a0e5aa640 1 -- start start 2023-11-28T20:03:08.007 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:08.004+0000 7f1a0e5aa640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1a08071e30 0x7f1a08150bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:03:08.008 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:08.004+0000 7f1a0e5aa640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1a0814fd10 0x7f1a081f0a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:03:08.008 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:08.004+0000 7f1a0e5aa640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1a08156110 0x7f1a0814ef00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:03:08.008 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:08.004+0000 7f1a0e5aa640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a081f0fa0 con 0x7f1a08156110 2023-11-28T20:03:08.008 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:08.004+0000 7f1a0e5aa640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a081ece30 con 0x7f1a0814fd10 2023-11-28T20:03:08.008 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:08.004+0000 7f1a0e5aa640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a081ecae0 con 0x7f1a08071e30 2023-11-28T20:03:08.008 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:08.004+0000 7f1a0cb47640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1a08156110 0x7f1a0814ef00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:03:08.008 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:08.004+0000 7f1a0cb47640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1a08156110 0x7f1a0814ef00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:47674/0 (socket says 172.21.15.78:47674) 2023-11-28T20:03:08.009 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:08.004+0000 7f1a0cb47640 1 -- 172.21.15.78:0/1531906260 learned_addr learned my addr 172.21.15.78:0/1531906260 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T20:03:08.009 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:08.004+0000 7f1a07fff640 1 --2- 172.21.15.78:0/1531906260 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1a08071e30 0x7f1a08150bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:03:08.009 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:08.004+0000 7f1a077fe640 1 --2- 172.21.15.78:0/1531906260 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1a0814fd10 0x7f1a081f0a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:03:08.010 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:08.004+0000 7f1a0cb47640 1 -- 172.21.15.78:0/1531906260 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1a08071e30 msgr2=0x7f1a08150bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:03:08.010 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:08.004+0000 7f1a0cb47640 1 --2- 172.21.15.78:0/1531906260 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1a08071e30 0x7f1a08150bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:03:08.010 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:08.004+0000 7f1a0cb47640 1 -- 172.21.15.78:0/1531906260 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1a0814fd10 msgr2=0x7f1a081f0a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:03:08.011 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:08.004+0000 7f1a0cb47640 1 --2- 172.21.15.78:0/1531906260 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1a0814fd10 0x7f1a081f0a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:03:08.011 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:08.004+0000 7f1a0cb47640 1 -- 172.21.15.78:0/1531906260 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19fc009420 con 0x7f1a08156110 2023-11-28T20:03:08.011 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:08.004+0000 7f1a0cb47640 1 --2- 172.21.15.78:0/1531906260 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1a08156110 0x7f1a0814ef00 secure :-1 s=READY pgs=1143 cs=0 l=1 rev1=1 crypto rx=0x7f1a000af040 tx=0x7f1a00019660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:03:08.011 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:08.004+0000 7f1a04ff9640 1 -- 172.21.15.78:0/1531906260 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a000b8670 con 0x7f1a08156110 2023-11-28T20:03:08.011 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:08.004+0000 7f1a04ff9640 1 -- 172.21.15.78:0/1531906260 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a000b87d0 con 0x7f1a08156110 2023-11-28T20:03:08.011 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:08.004+0000 7f1a04ff9640 1 -- 172.21.15.78:0/1531906260 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a000b8b80 con 0x7f1a08156110 2023-11-28T20:03:08.011 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:08.004+0000 7f1a0e5aa640 1 -- 172.21.15.78:0/1531906260 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1a00009b30 con 0x7f1a08156110 2023-11-28T20:03:08.012 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:08.004+0000 7f1a0e5aa640 1 -- 172.21.15.78:0/1531906260 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1a080ab360 con 0x7f1a08156110 2023-11-28T20:03:08.012 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:08.004+0000 7f1a0e5aa640 1 -- 172.21.15.78:0/1531906260 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1a08067630 con 0x7f1a08156110 2023-11-28T20:03:08.012 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:08.008+0000 7f1a04ff9640 1 -- 172.21.15.78:0/1531906260 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f1a000b8ce0 con 0x7f1a08156110 2023-11-28T20:03:08.013 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:08.008+0000 7f1a04ff9640 1 --2- 172.21.15.78:0/1531906260 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f19f4066470 0x7f19f4068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:03:08.013 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:08.008+0000 7f1a04ff9640 1 -- 172.21.15.78:0/1531906260 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 5349+0+0 (secure 0 0 0) 0x7f1a0011f040 con 0x7f1a08156110 2023-11-28T20:03:08.013 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:08.008+0000 7f1a07fff640 1 --2- 172.21.15.78:0/1531906260 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f19f4066470 0x7f19f4068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:03:08.013 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:08.008+0000 7f1a07fff640 1 --2- 172.21.15.78:0/1531906260 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f19f4066470 0x7f19f4068930 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7f19f8000f70 tx=0x7f19f8007e50 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:03:08.016 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:08.012+0000 7f1a04ff9640 1 -- 172.21.15.78:0/1531906260 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f1a000ec760 con 0x7f1a08156110 2023-11-28T20:03:08.163 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:08.160+0000 7f1a0e5aa640 1 -- 172.21.15.78:0/1531906260 --> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f1a081ecf70 con 0x7f19f4066470 2023-11-28T20:03:08.166 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:08.160+0000 7f1a04ff9640 1 -- 172.21.15.78:0/1531906260 <== mgr.4106 v2:172.21.15.78:6832/2935380957 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+50731 (secure 0 0 0) 0x7f1a081ecf70 con 0x7f19f4066470 2023-11-28T20:03:08.166 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-11-28T20:03:08.167 INFO:teuthology.orchestra.run.smithi078.stderr:dumped all 2023-11-28T20:03:08.168 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:08.164+0000 7f1a0e5aa640 1 -- 172.21.15.78:0/1531906260 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f19f4066470 msgr2=0x7f19f4068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:03:08.168 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:08.164+0000 7f1a0e5aa640 1 --2- 172.21.15.78:0/1531906260 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f19f4066470 0x7f19f4068930 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7f19f8000f70 tx=0x7f19f8007e50 comp rx=0 tx=0).stop 2023-11-28T20:03:08.168 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:08.164+0000 7f1a0e5aa640 1 -- 172.21.15.78:0/1531906260 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1a08156110 msgr2=0x7f1a0814ef00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:03:08.168 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:08.164+0000 7f1a0e5aa640 1 --2- 172.21.15.78:0/1531906260 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1a08156110 0x7f1a0814ef00 secure :-1 s=READY pgs=1143 cs=0 l=1 rev1=1 crypto rx=0x7f1a000af040 tx=0x7f1a00019660 comp rx=0 tx=0).stop 2023-11-28T20:03:08.168 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:08.164+0000 7f1a0e5aa640 1 -- 172.21.15.78:0/1531906260 shutdown_connections 2023-11-28T20:03:08.168 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:08.164+0000 7f1a0e5aa640 1 --2- 172.21.15.78:0/1531906260 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f19f4066470 0x7f19f4068930 unknown :-1 s=CLOSED pgs=541 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:03:08.169 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:08.164+0000 7f1a0e5aa640 1 --2- 172.21.15.78:0/1531906260 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1a08156110 0x7f1a0814ef00 unknown :-1 s=CLOSED pgs=1143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:03:08.169 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:08.164+0000 7f1a0e5aa640 1 --2- 172.21.15.78:0/1531906260 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1a0814fd10 0x7f1a081f0a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:03:08.169 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:08.164+0000 7f1a0e5aa640 1 --2- 172.21.15.78:0/1531906260 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1a08071e30 0x7f1a08150bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:03:08.169 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:08.164+0000 7f1a0e5aa640 1 -- 172.21.15.78:0/1531906260 >> 172.21.15.78:0/1531906260 conn(0x7f1a080a7810 msgr2=0x7f1a0806d1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:03:08.169 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:08.164+0000 7f1a0e5aa640 1 -- 172.21.15.78:0/1531906260 shutdown_connections 2023-11-28T20:03:08.169 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:08.164+0000 7f1a0e5aa640 1 -- 172.21.15.78:0/1531906260 wait complete. 2023-11-28T20:03:08.187 INFO:teuthology.orchestra.run.smithi078.stdout:{"pg_ready":true,"pg_map":{"version":214,"stamp":"2023-11-28T20:03:08.004095+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":217,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":258448,"kb_used_data":9000,"kb_used_omap":12,"kb_used_meta":249331,"kb_avail":754716272,"statfs":{"total":773094113280,"available":772829462528,"internally_reserved":0,"allocated":9216000,"data_stored":5519038,"data_compressed":66748,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":12752,"internal_metadata":255315504},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":57,"apply_latency_ms":57,"commit_latency_ns":57000000,"apply_latency_ns":57000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-12079,"num_objects":-23,"num_object_clones":0,"num_object_copies":-46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-23,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-60,"num_write_kb":-32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001342"},"pg_stats":[{"pgid":"1.0","version":"17'117","reported_seq":226,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-11-28T20:02:58.009429+0000","last_change":"2023-11-28T19:58:56.136501+0000","last_active":"2023-11-28T20:02:58.009429+0000","last_peered":"2023-11-28T20:02:58.009429+0000","last_clean":"2023-11-28T20:02:58.009429+0000","last_became_active":"2023-11-28T19:58:56.135998+0000","last_became_peered":"2023-11-28T19:58:56.135998+0000","last_unstale":"2023-11-28T20:02:58.009429+0000","last_undegraded":"2023-11-28T20:02:58.009429+0000","last_fullsized":"2023-11-28T20:02:58.009429+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:58:54.602349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:58:54.602349+0000","last_clean_scrub_stamp":"2023-11-28T19:58:54.602349+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:33:42.723349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":66748,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574902,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32348,"kb_used_data":1164,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339492,"statfs":{"total":96636764160,"available":96603639808,"internally_reserved":0,"allocated":1191936,"data_stored":1126507,"data_compressed":33374,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 20:03:01 2023","interfaces":[{"interface":"back","average":{"1min":0.65600000000000003,"5min":0.66700000000000004,"15min":0.67500000000000004},"min":{"1min":0.45100000000000001,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.84299999999999997,"5min":0.94299999999999995,"15min":0.94299999999999995},"last":0.75800000000000001},{"interface":"front","average":{"1min":0.67200000000000004,"5min":0.66800000000000004,"15min":0.67900000000000005},"min":{"1min":0.47799999999999998,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":0.81100000000000005,"5min":1.014,"15min":1.014},"last":0.67400000000000004}]},{"osd":1,"last update":"Tue Nov 28 20:03:01 2023","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.63800000000000001,"15min":0.64300000000000002},"min":{"1min":0.47699999999999998,"5min":0.438,"15min":0.438},"max":{"1min":0.84199999999999997,"5min":0.95099999999999996,"15min":0.95099999999999996},"last":0.53100000000000003},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.66900000000000004,"15min":0.69099999999999995},"min":{"1min":0.47799999999999998,"5min":0.432,"15min":0.432},"max":{"1min":0.77600000000000002,"5min":1.0900000000000001,"15min":1.0900000000000001},"last":0.56999999999999995}]},{"osd":2,"last update":"Tue Nov 28 20:03:01 2023","interfaces":[{"interface":"back","average":{"1min":0.70399999999999996,"5min":0.70299999999999996,"15min":0.72399999999999998},"min":{"1min":0.52800000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.86099999999999999,"5min":0.98799999999999999,"15min":0.98799999999999999},"last":0.65600000000000003},{"interface":"front","average":{"1min":0.67600000000000005,"5min":0.68100000000000005,"15min":0.69799999999999995},"min":{"1min":0.504,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":0.84999999999999998,"5min":1.514,"15min":1.514},"last":0.74399999999999999}]},{"osd":3,"last update":"Tue Nov 28 20:03:01 2023","interfaces":[{"interface":"back","average":{"1min":0.69699999999999995,"5min":0.69699999999999995,"15min":0.69899999999999995},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":0.93200000000000005,"5min":1.0449999999999999,"15min":1.0449999999999999},"last":0.59999999999999998},{"interface":"front","average":{"1min":0.70999999999999996,"5min":0.749,"15min":0.77800000000000002},"min":{"1min":0.53100000000000003,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":0.86599999999999999,"5min":1.1299999999999999,"15min":1.1299999999999999},"last":0.72099999999999997}]},{"osd":4,"last update":"Tue Nov 28 20:03:01 2023","interfaces":[{"interface":"back","average":{"1min":0.64600000000000002,"5min":0.629,"15min":0.63700000000000001},"min":{"1min":0.443,"5min":0.378,"15min":0.378},"max":{"1min":0.86799999999999999,"5min":1.2829999999999999,"15min":1.2829999999999999},"last":0.621},{"interface":"front","average":{"1min":0.70899999999999996,"5min":0.70399999999999996,"15min":0.72399999999999998},"min":{"1min":0.439,"5min":0.379,"15min":0.379},"max":{"1min":0.98199999999999998,"5min":1.1120000000000001,"15min":1.1120000000000001},"last":0.439}]},{"osd":5,"last update":"Tue Nov 28 20:03:01 2023","interfaces":[{"interface":"back","average":{"1min":0.68300000000000005,"5min":0.65200000000000002,"15min":0.67400000000000004},"min":{"1min":0.42599999999999999,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.86299999999999999,"5min":1.1699999999999999,"15min":1.1699999999999999},"last":0.78400000000000003},{"interface":"front","average":{"1min":0.70099999999999996,"5min":0.72399999999999998,"15min":0.752},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":0.92000000000000004,"5min":1.3300000000000001,"15min":1.3300000000000001},"last":0.77300000000000002}]},{"osd":6,"last update":"Tue Nov 28 20:03:01 2023","interfaces":[{"interface":"back","average":{"1min":0.76100000000000001,"5min":0.75900000000000001,"15min":0.77400000000000002},"min":{"1min":0.59999999999999998,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.95599999999999996,"5min":1.3919999999999999,"15min":1.3919999999999999},"last":0.70399999999999996},{"interface":"front","average":{"1min":0.70399999999999996,"5min":0.70299999999999996,"15min":0.73199999999999998},"min":{"1min":0.443,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":1.018,"5min":1.23,"15min":1.23},"last":0.68799999999999994}]}]},{"osd":6,"up_from":13,"seq":55834574900,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32312,"kb_used_data":1132,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339528,"statfs":{"total":96636764160,"available":96603676672,"internally_reserved":0,"allocated":1159168,"data_stored":554304,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 20:02:55 2023","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.61799999999999999,"15min":0.61599999999999999},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.88700000000000001,"5min":0.91600000000000004,"15min":0.91600000000000004},"last":0.51500000000000001},{"interface":"front","average":{"1min":0.63500000000000001,"5min":0.65400000000000003,"15min":0.66000000000000003},"min":{"1min":0.49399999999999999,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":0.91900000000000004,"5min":0.98999999999999999,"15min":0.98999999999999999},"last":0.625}]},{"osd":1,"last update":"Tue Nov 28 20:02:55 2023","interfaces":[{"interface":"back","average":{"1min":0.73499999999999999,"5min":0.755,"15min":0.77900000000000003},"min":{"1min":0.55800000000000005,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":0.89000000000000001,"5min":1.105,"15min":1.105},"last":0.66800000000000004},{"interface":"front","average":{"1min":0.66300000000000003,"5min":0.67100000000000004,"15min":0.68100000000000005},"min":{"1min":0.50600000000000001,"5min":0.443,"15min":0.443},"max":{"1min":0.879,"5min":0.95899999999999996,"15min":0.95899999999999996},"last":0.68400000000000005}]},{"osd":2,"last update":"Tue Nov 28 20:02:55 2023","interfaces":[{"interface":"back","average":{"1min":0.64000000000000001,"5min":0.67000000000000004,"15min":0.68999999999999995},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.81599999999999995,"5min":0.93400000000000005,"15min":0.93400000000000005},"last":0.48499999999999999},{"interface":"front","average":{"1min":0.70599999999999996,"5min":0.70099999999999996,"15min":0.71299999999999997},"min":{"1min":0.46999999999999997,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":0.84299999999999997,"5min":1.006,"15min":1.006},"last":0.71999999999999997}]},{"osd":3,"last update":"Tue Nov 28 20:02:55 2023","interfaces":[{"interface":"back","average":{"1min":0.69499999999999995,"5min":0.71699999999999997,"15min":0.73799999999999999},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.86399999999999999,"5min":1.056,"15min":1.056},"last":0.57599999999999996},{"interface":"front","average":{"1min":0.66500000000000004,"5min":0.66200000000000003,"15min":0.67700000000000005},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.87,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.53400000000000003}]},{"osd":4,"last update":"Tue Nov 28 20:02:55 2023","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.61799999999999999,"15min":0.626},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.81000000000000005,"5min":0.97599999999999998,"15min":0.97599999999999998},"last":0.55500000000000005},{"interface":"front","average":{"1min":0.67300000000000004,"5min":0.67400000000000004,"15min":0.71699999999999997},"min":{"1min":0.46999999999999997,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.82799999999999996,"5min":1.389,"15min":1.389},"last":0.70299999999999996}]},{"osd":5,"last update":"Tue Nov 28 20:02:55 2023","interfaces":[{"interface":"back","average":{"1min":0.70399999999999996,"5min":0.749,"15min":0.79400000000000004},"min":{"1min":0.49399999999999999,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.95499999999999996,"5min":1.4259999999999999,"15min":1.4259999999999999},"last":0.73399999999999999},{"interface":"front","average":{"1min":0.69199999999999995,"5min":0.71599999999999997,"15min":0.747},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.90000000000000002,"5min":1.276,"15min":1.276},"last":0.46600000000000003}]},{"osd":7,"last update":"Tue Nov 28 20:02:55 2023","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.67100000000000004,"15min":0.69999999999999996},"min":{"1min":0.379,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.90300000000000002,"5min":1.014,"15min":1.014},"last":0.60499999999999998},{"interface":"front","average":{"1min":0.73799999999999999,"5min":0.76100000000000001,"15min":0.80700000000000005},"min":{"1min":0.52700000000000002,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":0.92200000000000004,"5min":1.242,"15min":1.242},"last":0.64000000000000001}]}]},{"osd":5,"up_from":13,"seq":55834574902,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32284,"kb_used_data":1104,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339556,"statfs":{"total":96636764160,"available":96603705344,"internally_reserved":0,"allocated":1130496,"data_stored":542557,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 20:03:02 2023","interfaces":[{"interface":"back","average":{"1min":0.85899999999999999,"5min":0.71399999999999997,"15min":0.71099999999999997},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":5.9080000000000004,"5min":5.9080000000000004,"15min":5.9080000000000004},"last":0.45900000000000002},{"interface":"front","average":{"1min":0.84099999999999997,"5min":0.70999999999999996,"15min":0.71599999999999997},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":4.8789999999999996,"5min":4.8789999999999996,"15min":4.8789999999999996},"last":0.73699999999999999}]},{"osd":1,"last update":"Tue Nov 28 20:03:02 2023","interfaces":[{"interface":"back","average":{"1min":0.875,"5min":0.71899999999999997,"15min":0.71499999999999997},"min":{"1min":0.42599999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":5.1529999999999996,"5min":5.1529999999999996,"15min":5.1529999999999996},"last":0.67200000000000004},{"interface":"front","average":{"1min":0.91700000000000004,"5min":0.73099999999999998,"15min":0.72899999999999998},"min":{"1min":0.41199999999999998,"5min":0.38,"15min":0.38},"max":{"1min":6.3630000000000004,"5min":6.3630000000000004,"15min":6.3630000000000004},"last":0.41199999999999998}]},{"osd":2,"last update":"Tue Nov 28 20:03:02 2023","interfaces":[{"interface":"back","average":{"1min":0.83299999999999996,"5min":0.81100000000000005,"15min":0.90100000000000002},"min":{"1min":0.47799999999999998,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":4.3639999999999999,"5min":5.0880000000000001,"15min":5.0880000000000001},"last":0.878},{"interface":"front","average":{"1min":0.93700000000000006,"5min":0.86599999999999999,"15min":0.95599999999999996},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":6.335,"5min":6.335,"15min":6.335},"last":0.56999999999999995}]},{"osd":3,"last update":"Tue Nov 28 20:03:02 2023","interfaces":[{"interface":"back","average":{"1min":0.92200000000000004,"5min":0.88,"15min":0.97799999999999998},"min":{"1min":0.56399999999999995,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":4.9710000000000001,"5min":5.0469999999999997,"15min":5.0469999999999997},"last":0.81499999999999995},{"interface":"front","average":{"1min":0.878,"5min":0.85399999999999998,"15min":0.95199999999999996},"min":{"1min":0.51600000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":5.0439999999999996,"5min":5.0439999999999996,"15min":5.0439999999999996},"last":0.61099999999999999}]},{"osd":4,"last update":"Tue Nov 28 20:03:02 2023","interfaces":[{"interface":"back","average":{"1min":0.88200000000000001,"5min":0.68100000000000005,"15min":0.67800000000000005},"min":{"1min":0.38700000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":6.5380000000000003,"5min":6.5380000000000003,"15min":6.5380000000000003},"last":0.78900000000000003},{"interface":"front","average":{"1min":0.85899999999999999,"5min":0.74299999999999999,"15min":0.745},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":5.0179999999999998,"5min":5.0179999999999998,"15min":5.0179999999999998},"last":0.93999999999999995}]},{"osd":6,"last update":"Tue Nov 28 20:03:02 2023","interfaces":[{"interface":"back","average":{"1min":0.871,"5min":0.73899999999999999,"15min":0.71699999999999997},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":5.21,"5min":5.21,"15min":5.21},"last":0.85099999999999998},{"interface":"front","average":{"1min":0.94699999999999995,"5min":0.76400000000000001,"15min":0.753},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":6.4790000000000001,"5min":6.4790000000000001,"15min":6.4790000000000001},"last":0.83399999999999996}]},{"osd":7,"last update":"Tue Nov 28 20:03:02 2023","interfaces":[{"interface":"back","average":{"1min":0.93999999999999995,"5min":0.80400000000000005,"15min":0.79200000000000004},"min":{"1min":0.53100000000000003,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":5.6360000000000001,"5min":5.6360000000000001,"15min":5.6360000000000001},"last":0.91200000000000003},{"interface":"front","average":{"1min":0.92800000000000005,"5min":0.80800000000000005,"15min":0.80300000000000005},"min":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":5.5819999999999999,"5min":5.5819999999999999,"15min":5.5819999999999999},"last":0.76200000000000001}]}]},{"osd":4,"up_from":13,"seq":55834574901,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32292,"kb_used_data":1112,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339548,"statfs":{"total":96636764160,"available":96603697152,"internally_reserved":0,"allocated":1138688,"data_stored":542649,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 20:03:01 2023","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.68100000000000005,"15min":0.70099999999999996},"min":{"1min":0.51800000000000002,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.85199999999999998,"5min":1.107,"15min":1.107},"last":0.66400000000000003},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.66300000000000003,"15min":0.69699999999999995},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.81499999999999995,"5min":1.163,"15min":1.163},"last":0.63800000000000001}]},{"osd":1,"last update":"Tue Nov 28 20:03:01 2023","interfaces":[{"interface":"back","average":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.74199999999999999},"min":{"1min":0.41499999999999998,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.95499999999999996,"5min":1.111,"15min":1.111},"last":0.76900000000000002},{"interface":"front","average":{"1min":0.70499999999999996,"5min":0.75800000000000001,"15min":0.79500000000000004},"min":{"1min":0.502,"5min":0.443,"15min":0.443},"max":{"1min":0.91000000000000003,"5min":1.238,"15min":1.238},"last":0.75900000000000001}]},{"osd":2,"last update":"Tue Nov 28 20:03:01 2023","interfaces":[{"interface":"back","average":{"1min":0.68300000000000005,"5min":0.73099999999999998,"15min":0.76500000000000001},"min":{"1min":0.44500000000000001,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.92700000000000005,"5min":1.0669999999999999,"15min":1.0669999999999999},"last":0.71599999999999997},{"interface":"front","average":{"1min":0.74399999999999999,"5min":0.75900000000000001,"15min":0.79700000000000004},"min":{"1min":0.63600000000000001,"5min":0.438,"15min":0.438},"max":{"1min":0.86399999999999999,"5min":1.1359999999999999,"15min":1.1359999999999999},"last":0.70299999999999996}]},{"osd":3,"last update":"Tue Nov 28 20:03:01 2023","interfaces":[{"interface":"back","average":{"1min":0.626,"5min":0.70899999999999996,"15min":0.77100000000000002},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":0.76300000000000001,"5min":1.202,"15min":1.202},"last":0.74199999999999999},{"interface":"front","average":{"1min":0.71699999999999997,"5min":0.745,"15min":0.77900000000000003},"min":{"1min":0.50600000000000001,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":0.90100000000000002,"5min":1.0669999999999999,"15min":1.0669999999999999},"last":0.81200000000000006}]},{"osd":5,"last update":"Tue Nov 28 20:03:01 2023","interfaces":[{"interface":"back","average":{"1min":0.59699999999999998,"5min":0.67000000000000004,"15min":0.70599999999999996},"min":{"1min":0.38400000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.78900000000000003,"5min":0.95899999999999996,"15min":0.95899999999999996},"last":0.61899999999999999},{"interface":"front","average":{"1min":0.60499999999999998,"5min":0.66200000000000003,"15min":0.69599999999999995},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.92200000000000004,"5min":1.034,"15min":1.034},"last":0.68600000000000005}]},{"osd":6,"last update":"Tue Nov 28 20:03:01 2023","interfaces":[{"interface":"back","average":{"1min":0.69699999999999995,"5min":0.68400000000000005,"15min":0.71799999999999997},"min":{"1min":0.48699999999999999,"5min":0.438,"15min":0.438},"max":{"1min":0.94499999999999995,"5min":1.0309999999999999,"15min":1.0309999999999999},"last":0.58999999999999997},{"interface":"front","average":{"1min":0.68200000000000005,"5min":0.746,"15min":0.77100000000000002},"min":{"1min":0.48799999999999999,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":0.88800000000000001,"5min":1.002,"15min":1.002},"last":0.56200000000000006}]},{"osd":7,"last update":"Tue Nov 28 20:03:01 2023","interfaces":[{"interface":"back","average":{"1min":0.69899999999999995,"5min":0.74099999999999999,"15min":0.77200000000000002},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":0.89800000000000002,"5min":1.089,"15min":1.089},"last":0.78800000000000003},{"interface":"front","average":{"1min":0.80700000000000005,"5min":0.82399999999999995,"15min":0.85399999999999998},"min":{"1min":0.68200000000000005,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":0.97199999999999998,"5min":1.1459999999999999,"15min":1.1459999999999999},"last":0.85599999999999998}]}]},{"osd":3,"up_from":13,"seq":55834574902,"num_pgs":45,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32280,"kb_used_data":1100,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339560,"statfs":{"total":96636764160,"available":96603709440,"internally_reserved":0,"allocated":1126400,"data_stored":536699,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":10,"apply_latency_ms":10,"commit_latency_ns":10000000,"apply_latency_ns":10000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 20:02:58 2023","interfaces":[{"interface":"back","average":{"1min":0.40200000000000002,"5min":0.432,"15min":0.442},"min":{"1min":0.31,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":0.52100000000000002,"5min":1.7130000000000001,"15min":1.7130000000000001},"last":0.503},{"interface":"front","average":{"1min":0.46000000000000002,"5min":0.46300000000000002,"15min":0.46999999999999997},"min":{"1min":0.377,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.57899999999999996,"5min":3.0630000000000002,"15min":3.0630000000000002},"last":0.54500000000000004}]},{"osd":1,"last update":"Tue Nov 28 20:02:58 2023","interfaces":[{"interface":"back","average":{"1min":0.434,"5min":0.44800000000000001,"15min":0.46999999999999997},"min":{"1min":0.32900000000000001,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.85399999999999998,"5min":0.89200000000000002,"15min":0.89200000000000002},"last":0.85399999999999998},{"interface":"front","average":{"1min":0.438,"5min":0.50800000000000001,"15min":0.50600000000000001},"min":{"1min":0.30599999999999999,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.66700000000000004,"5min":5.8920000000000003,"15min":5.8920000000000003},"last":0.41799999999999998}]},{"osd":2,"last update":"Tue Nov 28 20:02:58 2023","interfaces":[{"interface":"back","average":{"1min":0.499,"5min":0.54100000000000004,"15min":0.53600000000000003},"min":{"1min":0.36199999999999999,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.621,"5min":4.6390000000000002,"15min":4.6390000000000002},"last":0.60299999999999998},{"interface":"front","average":{"1min":0.52100000000000002,"5min":0.626,"15min":0.59899999999999998},"min":{"1min":0.42099999999999999,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.80200000000000005,"5min":11.593,"15min":11.593},"last":0.80200000000000005}]},{"osd":4,"last update":"Tue Nov 28 20:02:58 2023","interfaces":[{"interface":"back","average":{"1min":0.98699999999999999,"5min":0.83899999999999997,"15min":0.78700000000000003},"min":{"1min":0.61599999999999999,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":5.2629999999999999,"5min":5.5549999999999997,"15min":5.5549999999999997},"last":5.2629999999999999},{"interface":"front","average":{"1min":1.0229999999999999,"5min":0.92300000000000004,"15min":0.84299999999999997},"min":{"1min":0.60999999999999999,"5min":0.503,"15min":0.503},"max":{"1min":5.4939999999999998,"5min":11.747,"15min":11.747},"last":5.4939999999999998}]},{"osd":5,"last update":"Tue Nov 28 20:02:58 2023","interfaces":[{"interface":"back","average":{"1min":0.92900000000000005,"5min":0.88300000000000001,"15min":0.82699999999999996},"min":{"1min":0.52600000000000002,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":5.4450000000000003,"5min":11.705,"15min":11.705},"last":5.4450000000000003},{"interface":"front","average":{"1min":0.94499999999999995,"5min":0.79900000000000004,"15min":0.80100000000000005},"min":{"1min":0.56599999999999995,"5min":0.495,"15min":0.495},"max":{"1min":4.681,"5min":4.681,"15min":4.681},"last":4.681}]},{"osd":6,"last update":"Tue Nov 28 20:02:58 2023","interfaces":[{"interface":"back","average":{"1min":0.78500000000000003,"5min":0.80700000000000005,"15min":0.83099999999999996},"min":{"1min":0.54600000000000004,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":1,"5min":1.6639999999999999,"15min":1.6639999999999999},"last":1},{"interface":"front","average":{"1min":0.81499999999999995,"5min":0.81699999999999995,"15min":0.77100000000000002},"min":{"1min":0.55200000000000005,"5min":0.495,"15min":0.495},"max":{"1min":1.0329999999999999,"5min":4.0679999999999996,"15min":4.0679999999999996},"last":0.90600000000000003}]},{"osd":7,"last update":"Tue Nov 28 20:02:58 2023","interfaces":[{"interface":"back","average":{"1min":0.90100000000000002,"5min":0.90600000000000003,"15min":0.86799999999999999},"min":{"1min":0.64700000000000002,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":2.6589999999999998,"5min":6.6619999999999999,"15min":6.6619999999999999},"last":2.6589999999999998},{"interface":"front","average":{"1min":0.94099999999999995,"5min":0.93300000000000005,"15min":0.90500000000000003},"min":{"1min":0.57399999999999995,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":4.6539999999999999,"5min":11.782,"15min":11.782},"last":4.6539999999999999}]}]},{"osd":2,"up_from":13,"seq":55834574900,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32288,"kb_used_data":1108,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339552,"statfs":{"total":96636764160,"available":96603701248,"internally_reserved":0,"allocated":1134592,"data_stored":542591,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 20:02:57 2023","interfaces":[{"interface":"back","average":{"1min":0.39300000000000002,"5min":0.42499999999999999,"15min":0.44500000000000001},"min":{"1min":0.254,"5min":0.254,"15min":0.254},"max":{"1min":0.58399999999999996,"5min":0.74099999999999999,"15min":0.74099999999999999},"last":0.46800000000000003},{"interface":"front","average":{"1min":0.35799999999999998,"5min":0.436,"15min":0.46700000000000003},"min":{"1min":0.27300000000000002,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.46999999999999997,"5min":0.67700000000000005,"15min":0.67700000000000005},"last":0.51000000000000001}]},{"osd":1,"last update":"Tue Nov 28 20:02:57 2023","interfaces":[{"interface":"back","average":{"1min":0.437,"5min":0.47399999999999998,"15min":0.501},"min":{"1min":0.33600000000000002,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.50600000000000001,"5min":1.0389999999999999,"15min":1.0389999999999999},"last":0.34999999999999998},{"interface":"front","average":{"1min":0.433,"5min":0.46500000000000002,"15min":0.49099999999999999},"min":{"1min":0.28899999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.56699999999999995,"5min":0.70999999999999996,"15min":0.70999999999999996},"last":0.501}]},{"osd":3,"last update":"Tue Nov 28 20:02:57 2023","interfaces":[{"interface":"back","average":{"1min":0.41299999999999998,"5min":0.45100000000000001,"15min":0.46500000000000002},"min":{"1min":0.32100000000000001,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"last":0.42599999999999999},{"interface":"front","average":{"1min":0.46700000000000003,"5min":0.53400000000000003,"15min":0.57199999999999995},"min":{"1min":0.39700000000000002,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.56399999999999995,"5min":0.98499999999999999,"15min":0.98499999999999999},"last":0.45100000000000001}]},{"osd":4,"last update":"Tue Nov 28 20:02:57 2023","interfaces":[{"interface":"back","average":{"1min":0.69199999999999995,"5min":0.76900000000000002,"15min":0.83099999999999996},"min":{"1min":0.5,"5min":0.5,"15min":0.5},"max":{"1min":0.97199999999999998,"5min":1.139,"15min":1.139},"last":0.68700000000000006},{"interface":"front","average":{"1min":0.65900000000000003,"5min":0.75700000000000001,"15min":0.82099999999999995},"min":{"1min":0.51600000000000001,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":0.82699999999999996,"5min":1.238,"15min":1.238},"last":0.73599999999999999}]},{"osd":5,"last update":"Tue Nov 28 20:02:57 2023","interfaces":[{"interface":"back","average":{"1min":0.69799999999999995,"5min":0.77400000000000002,"15min":0.84799999999999998},"min":{"1min":0.55300000000000005,"5min":0.437,"15min":0.437},"max":{"1min":0.94499999999999995,"5min":1.6180000000000001,"15min":1.6180000000000001},"last":0.63500000000000001},{"interface":"front","average":{"1min":0.65600000000000003,"5min":0.748,"15min":0.80600000000000005},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":0.84099999999999997,"5min":1.339,"15min":1.339},"last":0.72099999999999997}]},{"osd":6,"last update":"Tue Nov 28 20:02:57 2023","interfaces":[{"interface":"back","average":{"1min":0.69699999999999995,"5min":0.751,"15min":0.78700000000000003},"min":{"1min":0.54300000000000004,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":0.88300000000000001,"5min":1.1839999999999999,"15min":1.1839999999999999},"last":0.755},{"interface":"front","average":{"1min":0.67500000000000004,"5min":0.76500000000000001,"15min":0.82899999999999996},"min":{"1min":0.52400000000000002,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":0.93000000000000005,"5min":1.099,"15min":1.099},"last":0.65400000000000003}]},{"osd":7,"last update":"Tue Nov 28 20:02:57 2023","interfaces":[{"interface":"back","average":{"1min":0.67200000000000004,"5min":0.77800000000000002,"15min":0.85199999999999998},"min":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":0.86899999999999999,"5min":1.4590000000000001,"15min":1.4590000000000001},"last":0.70899999999999996},{"interface":"front","average":{"1min":0.71299999999999997,"5min":0.77800000000000002,"15min":0.83699999999999997},"min":{"1min":0.57199999999999995,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":0.85499999999999998,"5min":1.387,"15min":1.387},"last":0.62}]}]},{"osd":1,"up_from":13,"seq":55834574902,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32276,"kb_used_data":1096,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339564,"statfs":{"total":96636764160,"available":96603713536,"internally_reserved":0,"allocated":1122304,"data_stored":536013,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":10,"apply_latency_ms":10,"commit_latency_ns":10000000,"apply_latency_ns":10000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 20:02:00 2023","interfaces":[{"interface":"back","average":{"1min":0.38700000000000001,"5min":0.54600000000000004,"15min":0.62},"min":{"1min":0.249,"5min":0.249,"15min":0.249},"max":{"1min":0.60699999999999998,"5min":3.8740000000000001,"15min":3.8740000000000001},"last":0.48899999999999999},{"interface":"front","average":{"1min":0.42099999999999999,"5min":0.51000000000000001,"15min":0.55100000000000005},"min":{"1min":0.32300000000000001,"5min":0.25,"15min":0.25},"max":{"1min":0.60399999999999998,"5min":2.0760000000000001,"15min":2.0760000000000001},"last":0.36799999999999999}]},{"osd":2,"last update":"Tue Nov 28 20:02:00 2023","interfaces":[{"interface":"back","average":{"1min":0.41399999999999998,"5min":0.56000000000000005,"15min":0.626},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.70799999999999996,"5min":3.7320000000000002,"15min":3.7320000000000002},"last":0.41099999999999998},{"interface":"front","average":{"1min":0.46899999999999997,"5min":0.63400000000000001,"15min":0.71799999999999997},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.67000000000000004,"5min":3.9089999999999998,"15min":3.9089999999999998},"last":0.443}]},{"osd":3,"last update":"Tue Nov 28 20:02:00 2023","interfaces":[{"interface":"back","average":{"1min":0.52200000000000002,"5min":0.61799999999999999,"15min":0.66000000000000003},"min":{"1min":0.436,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.70799999999999996,"5min":1.6399999999999999,"15min":1.6399999999999999},"last":0.53200000000000003},{"interface":"front","average":{"1min":0.45500000000000002,"5min":0.61599999999999999,"15min":0.67400000000000004},"min":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.625,"5min":2.5270000000000001,"15min":2.5270000000000001},"last":0.42999999999999999}]},{"osd":4,"last update":"Tue Nov 28 20:02:00 2023","interfaces":[{"interface":"back","average":{"1min":0.69799999999999995,"5min":0.81699999999999995,"15min":0.86899999999999999},"min":{"1min":0.42199999999999999,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.91400000000000003,"5min":3.1659999999999999,"15min":3.1659999999999999},"last":0.67400000000000004},{"interface":"front","average":{"1min":0.69699999999999995,"5min":0.84399999999999997,"15min":0.91200000000000003},"min":{"1min":0.52300000000000002,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.94299999999999995,"5min":3.7959999999999998,"15min":3.7959999999999998},"last":0.77000000000000002}]},{"osd":5,"last update":"Tue Nov 28 20:02:00 2023","interfaces":[{"interface":"back","average":{"1min":0.71399999999999997,"5min":0.875,"15min":0.95099999999999996},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":1.004,"5min":4.1479999999999997,"15min":4.1479999999999997},"last":0.75900000000000001},{"interface":"front","average":{"1min":0.69799999999999995,"5min":0.82599999999999996,"15min":0.88200000000000001},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":0.87,"5min":3.5569999999999999,"15min":3.5569999999999999},"last":0.63900000000000001}]},{"osd":6,"last update":"Tue Nov 28 20:02:00 2023","interfaces":[{"interface":"back","average":{"1min":0.72399999999999998,"5min":0.88800000000000001,"15min":0.95699999999999996},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":0.94499999999999995,"5min":2.863,"15min":2.863},"last":0.78900000000000003},{"interface":"front","average":{"1min":0.76800000000000002,"5min":0.89800000000000002,"15min":0.95399999999999996},"min":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":0.97999999999999998,"5min":3.371,"15min":3.371},"last":0.74399999999999999}]},{"osd":7,"last update":"Tue Nov 28 20:02:00 2023","interfaces":[{"interface":"back","average":{"1min":0.70299999999999996,"5min":0.89100000000000001,"15min":0.97199999999999998},"min":{"1min":0.53100000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":0.93600000000000005,"5min":3.8439999999999999,"15min":3.8439999999999999},"last":0.72399999999999998},{"interface":"front","average":{"1min":0.68799999999999994,"5min":0.90500000000000003,"15min":0.99299999999999999},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.95899999999999996,"5min":3.9689999999999999,"15min":3.9689999999999999},"last":0.81100000000000005}]}]},{"osd":0,"up_from":13,"seq":55834574901,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32368,"kb_used_data":1184,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339472,"statfs":{"total":96636764160,"available":96603619328,"internally_reserved":0,"allocated":1212416,"data_stored":1137718,"data_compressed":33374,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Nov 28 20:02:58 2023","interfaces":[{"interface":"back","average":{"1min":0.38700000000000001,"5min":0.51300000000000001,"15min":0.63100000000000001},"min":{"1min":0.26000000000000001,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":0.80100000000000005,"5min":4.883,"15min":4.883},"last":0.27100000000000002},{"interface":"front","average":{"1min":0.47999999999999998,"5min":0.621,"15min":0.79200000000000004},"min":{"1min":0.23899999999999999,"5min":0.23899999999999999,"15min":0.23899999999999999},"max":{"1min":1.7669999999999999,"5min":8.0800000000000001,"15min":8.0800000000000001},"last":0.40000000000000002}]},{"osd":2,"last update":"Tue Nov 28 20:02:58 2023","interfaces":[{"interface":"back","average":{"1min":0.48599999999999999,"5min":0.67700000000000005,"15min":0.875},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":1.0309999999999999,"5min":8.1029999999999998,"15min":8.1029999999999998},"last":0.621},{"interface":"front","average":{"1min":0.55300000000000005,"5min":0.70699999999999996,"15min":0.89300000000000002},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":1.802,"5min":8.1310000000000002,"15min":8.1310000000000002},"last":0.66500000000000004}]},{"osd":3,"last update":"Tue Nov 28 20:02:58 2023","interfaces":[{"interface":"back","average":{"1min":0.47399999999999998,"5min":0.57399999999999995,"15min":0.68899999999999995},"min":{"1min":0.27700000000000002,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":1.5629999999999999,"5min":4.3949999999999996,"15min":4.3949999999999996},"last":0.378},{"interface":"front","average":{"1min":0.58099999999999996,"5min":0.61599999999999999,"15min":0.70999999999999996},"min":{"1min":0.34999999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":2.0920000000000001,"5min":4.3470000000000004,"15min":4.3470000000000004},"last":0.41899999999999998}]},{"osd":4,"last update":"Tue Nov 28 20:02:58 2023","interfaces":[{"interface":"back","average":{"1min":0.747,"5min":0.85899999999999999,"15min":0.98699999999999999},"min":{"1min":0.52400000000000002,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":1.52,"5min":4.6360000000000001,"15min":4.6360000000000001},"last":0.81000000000000005},{"interface":"front","average":{"1min":0.70799999999999996,"5min":0.86499999999999999,"15min":0.98999999999999999},"min":{"1min":0.53800000000000003,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":0.98099999999999998,"5min":4.4710000000000001,"15min":4.4710000000000001},"last":0.64900000000000002}]},{"osd":5,"last update":"Tue Nov 28 20:02:58 2023","interfaces":[{"interface":"back","average":{"1min":0.751,"5min":0.87,"15min":1},"min":{"1min":0.52300000000000002,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.6659999999999999,"5min":4.6120000000000001,"15min":4.6120000000000001},"last":0.58799999999999997},{"interface":"front","average":{"1min":0.79300000000000004,"5min":0.88500000000000001,"15min":0.996},"min":{"1min":0.65000000000000002,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.595,"5min":4.5449999999999999,"15min":4.5449999999999999},"last":0.59899999999999998}]},{"osd":6,"last update":"Tue Nov 28 20:02:58 2023","interfaces":[{"interface":"back","average":{"1min":0.77000000000000002,"5min":0.88300000000000001,"15min":1.0129999999999999},"min":{"1min":0.57299999999999995,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":2.149,"5min":4.657,"15min":4.657},"last":0.68300000000000005},{"interface":"front","average":{"1min":0.80400000000000005,"5min":0.89900000000000002,"15min":1.0309999999999999},"min":{"1min":0.60999999999999999,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":2.2130000000000001,"5min":4.5259999999999998,"15min":4.5259999999999998},"last":0.71199999999999997}]},{"osd":7,"last update":"Tue Nov 28 20:02:58 2023","interfaces":[{"interface":"back","average":{"1min":0.754,"5min":0.88300000000000001,"15min":1.028},"min":{"1min":0.56299999999999994,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":1.7270000000000001,"5min":4.7320000000000002,"15min":4.7320000000000002},"last":0.55000000000000004},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.86899999999999999,"15min":0.98699999999999999},"min":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":1.0880000000000001,"5min":4.4939999999999998,"15min":4.4939999999999998},"last":0.69299999999999995}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33374,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33374,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-28T20:03:08.188 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-28T20:03:08.325 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:08.320+0000 7f9bf3609640 1 Processor -- start 2023-11-28T20:03:08.326 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:08.320+0000 7f9bf3609640 1 -- start start 2023-11-28T20:03:08.327 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:08.320+0000 7f9bf3609640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f9bec14fd10 0x7f9bec0a4dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:03:08.327 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:08.320+0000 7f9bf3609640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9bec0a5300 0x7f9bec071e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:03:08.327 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:08.320+0000 7f9bf3609640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f9bec072370 0x7f9bec156110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:03:08.327 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:08.320+0000 7f9bf3609640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9bec06c5e0 con 0x7f9bec072370 2023-11-28T20:03:08.327 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:08.320+0000 7f9bf3609640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9bec0c5710 con 0x7f9bec14fd10 2023-11-28T20:03:08.328 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:08.320+0000 7f9bf3609640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9bec155c80 con 0x7f9bec0a5300 2023-11-28T20:03:08.328 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:08.324+0000 7f9bf1ba6640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f9bec072370 0x7f9bec156110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:03:08.328 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:08.324+0000 7f9bf1ba6640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f9bec072370 0x7f9bec156110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:47682/0 (socket says 172.21.15.78:47682) 2023-11-28T20:03:08.328 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:08.324+0000 7f9bf1ba6640 1 -- 172.21.15.78:0/2764897721 learned_addr learned my addr 172.21.15.78:0/2764897721 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T20:03:08.328 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:08.324+0000 7f9bf0ba4640 1 --2- 172.21.15.78:0/2764897721 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9bec0a5300 0x7f9bec071e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:03:08.328 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:08.324+0000 7f9bf13a5640 1 --2- 172.21.15.78:0/2764897721 >> v2:172.21.15.179:3300/0 conn(0x7f9bec14fd10 0x7f9bec0a4dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:03:08.328 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:08.324+0000 7f9bf1ba6640 1 -- 172.21.15.78:0/2764897721 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9bec0a5300 msgr2=0x7f9bec071e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:03:08.328 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:08.324+0000 7f9bf1ba6640 1 --2- 172.21.15.78:0/2764897721 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9bec0a5300 0x7f9bec071e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:03:08.329 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:08.324+0000 7f9bf1ba6640 1 -- 172.21.15.78:0/2764897721 >> v2:172.21.15.179:3300/0 conn(0x7f9bec14fd10 msgr2=0x7f9bec0a4dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:03:08.329 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:08.324+0000 7f9bf1ba6640 1 --2- 172.21.15.78:0/2764897721 >> v2:172.21.15.179:3300/0 conn(0x7f9bec14fd10 0x7f9bec0a4dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:03:08.329 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:08.324+0000 7f9bf1ba6640 1 -- 172.21.15.78:0/2764897721 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9bec0c4e70 con 0x7f9bec072370 2023-11-28T20:03:08.329 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:08.324+0000 7f9bf0ba4640 1 --2- 172.21.15.78:0/2764897721 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9bec0a5300 0x7f9bec071e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T20:03:08.329 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:08.324+0000 7f9bf13a5640 1 --2- 172.21.15.78:0/2764897721 >> v2:172.21.15.179:3300/0 conn(0x7f9bec14fd10 0x7f9bec0a4dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T20:03:08.330 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:08.324+0000 7f9bf1ba6640 1 --2- 172.21.15.78:0/2764897721 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9bec072370 0x7f9bec156110 secure :-1 s=READY pgs=1144 cs=0 l=1 rev1=1 crypto rx=0x7f9bec06b5a0 tx=0x7f9be401c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9ebb4a75394014d4 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:03:08.330 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:08.324+0000 7f9be3fff640 1 -- 172.21.15.78:0/2764897721 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9be40a5610 con 0x7f9bec072370 2023-11-28T20:03:08.330 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:08.324+0000 7f9be3fff640 1 -- 172.21.15.78:0/2764897721 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9be40a5770 con 0x7f9bec072370 2023-11-28T20:03:08.330 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:08.324+0000 7f9be3fff640 1 -- 172.21.15.78:0/2764897721 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9be40a5b00 con 0x7f9bec072370 2023-11-28T20:03:08.331 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:08.328+0000 7f9bf3609640 1 -- 172.21.15.78:0/2764897721 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9bec072370 msgr2=0x7f9bec156110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:03:08.331 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:08.328+0000 7f9bf3609640 1 --2- 172.21.15.78:0/2764897721 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9bec072370 0x7f9bec156110 secure :-1 s=READY pgs=1144 cs=0 l=1 rev1=1 crypto rx=0x7f9bec06b5a0 tx=0x7f9be401c880 comp rx=0 tx=0).stop 2023-11-28T20:03:08.332 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:08.328+0000 7f9bf3609640 1 -- 172.21.15.78:0/2764897721 shutdown_connections 2023-11-28T20:03:08.332 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:08.328+0000 7f9bf3609640 1 --2- 172.21.15.78:0/2764897721 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9bec072370 0x7f9bec156110 unknown :-1 s=CLOSED pgs=1144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:03:08.332 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:08.328+0000 7f9bf3609640 1 --2- 172.21.15.78:0/2764897721 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9bec0a5300 0x7f9bec071e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:03:08.332 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:08.328+0000 7f9bf3609640 1 --2- 172.21.15.78:0/2764897721 >> v2:172.21.15.179:3300/0 conn(0x7f9bec14fd10 0x7f9bec0a4dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:03:08.332 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:08.328+0000 7f9bf3609640 1 -- 172.21.15.78:0/2764897721 >> 172.21.15.78:0/2764897721 conn(0x7f9bec0a7810 msgr2=0x7f9bec0a7c20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:03:08.332 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:08.328+0000 7f9bf3609640 1 -- 172.21.15.78:0/2764897721 shutdown_connections 2023-11-28T20:03:08.332 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:08.328+0000 7f9bf3609640 1 -- 172.21.15.78:0/2764897721 wait complete. 2023-11-28T20:03:08.333 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:08.328+0000 7f9bf3609640 1 Processor -- start 2023-11-28T20:03:08.333 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:08.328+0000 7f9bf3609640 1 -- start start 2023-11-28T20:03:08.334 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:08.328+0000 7f9bf3609640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9bec072370 0x7f9bec1f0d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:03:08.335 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:08.328+0000 7f9bf3609640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9bec0a5300 0x7f9bec1ef9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:03:08.335 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:08.328+0000 7f9bf3609640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9bec14fd10 0x7f9bec0aaad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:03:08.335 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:08.328+0000 7f9bf3609640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9bec0a6a30 con 0x7f9bec14fd10 2023-11-28T20:03:08.335 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:08.328+0000 7f9bf3609640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9bec1f12d0 con 0x7f9bec0a5300 2023-11-28T20:03:08.335 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:08.328+0000 7f9bf3609640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9bec14f580 con 0x7f9bec072370 2023-11-28T20:03:08.335 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:08.328+0000 7f9bf1ba6640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9bec14fd10 0x7f9bec0aaad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:03:08.335 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:08.328+0000 7f9bf1ba6640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9bec14fd10 0x7f9bec0aaad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:47688/0 (socket says 172.21.15.78:47688) 2023-11-28T20:03:08.336 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:08.328+0000 7f9bf1ba6640 1 -- 172.21.15.78:0/2149329512 learned_addr learned my addr 172.21.15.78:0/2149329512 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T20:03:08.336 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:08.328+0000 7f9bf13a5640 1 --2- 172.21.15.78:0/2149329512 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9bec072370 0x7f9bec1f0d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:03:08.336 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:08.328+0000 7f9bf0ba4640 1 --2- 172.21.15.78:0/2149329512 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9bec0a5300 0x7f9bec1ef9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:03:08.336 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:08.332+0000 7f9bf1ba6640 1 -- 172.21.15.78:0/2149329512 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9bec072370 msgr2=0x7f9bec1f0d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:03:08.336 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:08.332+0000 7f9bf1ba6640 1 --2- 172.21.15.78:0/2149329512 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9bec072370 0x7f9bec1f0d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:03:08.336 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:08.332+0000 7f9bf1ba6640 1 -- 172.21.15.78:0/2149329512 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9bec0a5300 msgr2=0x7f9bec1ef9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:03:08.336 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:08.332+0000 7f9bf1ba6640 1 --2- 172.21.15.78:0/2149329512 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9bec0a5300 0x7f9bec1ef9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:03:08.336 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:08.332+0000 7f9bf1ba6640 1 -- 172.21.15.78:0/2149329512 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9be4009b30 con 0x7f9bec14fd10 2023-11-28T20:03:08.337 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:08.332+0000 7f9bf1ba6640 1 --2- 172.21.15.78:0/2149329512 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9bec14fd10 0x7f9bec0aaad0 secure :-1 s=READY pgs=1145 cs=0 l=1 rev1=1 crypto rx=0x7f9be40af040 tx=0x7f9bec153560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:03:08.338 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:08.332+0000 7f9be1ffb640 1 -- 172.21.15.78:0/2149329512 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9be40b8670 con 0x7f9bec14fd10 2023-11-28T20:03:08.338 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:08.332+0000 7f9be1ffb640 1 -- 172.21.15.78:0/2149329512 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9be40b87d0 con 0x7f9bec14fd10 2023-11-28T20:03:08.338 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:08.332+0000 7f9bf3609640 1 -- 172.21.15.78:0/2149329512 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9bec14efc0 con 0x7f9bec14fd10 2023-11-28T20:03:08.338 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:08.332+0000 7f9be1ffb640 1 -- 172.21.15.78:0/2149329512 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9be40b8b80 con 0x7f9bec14fd10 2023-11-28T20:03:08.338 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:08.332+0000 7f9bf3609640 1 -- 172.21.15.78:0/2149329512 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9bec0c0930 con 0x7f9bec14fd10 2023-11-28T20:03:08.338 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:08.332+0000 7f9bf3609640 1 -- 172.21.15.78:0/2149329512 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9bec1ece60 con 0x7f9bec14fd10 2023-11-28T20:03:08.338 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:08.332+0000 7f9be1ffb640 1 -- 172.21.15.78:0/2149329512 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f9be40b8ce0 con 0x7f9bec14fd10 2023-11-28T20:03:08.339 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:08.332+0000 7f9be1ffb640 1 --2- 172.21.15.78:0/2149329512 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f9bd0066470 0x7f9bd0068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:03:08.339 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:08.336+0000 7f9be1ffb640 1 -- 172.21.15.78:0/2149329512 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 5349+0+0 (secure 0 0 0) 0x7f9be411f1b0 con 0x7f9bec14fd10 2023-11-28T20:03:08.339 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:08.336+0000 7f9bf13a5640 1 --2- 172.21.15.78:0/2149329512 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f9bd0066470 0x7f9bd0068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:03:08.340 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:08.336+0000 7f9bf13a5640 1 --2- 172.21.15.78:0/2149329512 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f9bd0066470 0x7f9bd0068930 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f9be8006e90 tx=0x7f9be8008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:03:08.342 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:08.340+0000 7f9be1ffb640 1 -- 172.21.15.78:0/2149329512 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f9be40ecab0 con 0x7f9bec14fd10 2023-11-28T20:03:08.495 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:08.492+0000 7f9bf3609640 1 -- 172.21.15.78:0/2149329512 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9bec067630 con 0x7f9bec14fd10 2023-11-28T20:03:08.496 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:08.492+0000 7f9be1ffb640 1 -- 172.21.15.78:0/2149329512 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v93) v1 ==== 74+0+13296 (secure 0 0 0) 0x7f9be4009510 con 0x7f9bec14fd10 2023-11-28T20:03:08.497 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-11-28T20:03:08.497 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":93,"fsid":"dd9780e8-3bda-44fa-a9f0-fa07d19d901d","created":"2023-11-28T19:58:40.969556+0000","modified":"2023-11-28T20:03:05.359025+0000","last_up_change":"2023-11-28T19:58:52.596716+0000","last_in_change":"2023-11-28T19:58:43.609275+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":16,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-28T19:58:54.011229+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e84245ac-b5da-429e-af18-39acaa2b33e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6800","nonce":3358701235},{"type":"v1","addr":"172.21.15.78:6801","nonce":3358701235}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6802","nonce":3358701235},{"type":"v1","addr":"172.21.15.78:6803","nonce":3358701235}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6806","nonce":3358701235},{"type":"v1","addr":"172.21.15.78:6807","nonce":3358701235}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6804","nonce":3358701235},{"type":"v1","addr":"172.21.15.78:6805","nonce":3358701235}]},"public_addr":"172.21.15.78:6801/3358701235","cluster_addr":"172.21.15.78:6803/3358701235","heartbeat_back_addr":"172.21.15.78:6807/3358701235","heartbeat_front_addr":"172.21.15.78:6805/3358701235","state":["exists","up"]},{"osd":1,"uuid":"e634831d-c4e2-48d9-870c-9556ae162981","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6808","nonce":3211476654},{"type":"v1","addr":"172.21.15.78:6809","nonce":3211476654}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6810","nonce":3211476654},{"type":"v1","addr":"172.21.15.78:6811","nonce":3211476654}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6814","nonce":3211476654},{"type":"v1","addr":"172.21.15.78:6815","nonce":3211476654}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6812","nonce":3211476654},{"type":"v1","addr":"172.21.15.78:6813","nonce":3211476654}]},"public_addr":"172.21.15.78:6809/3211476654","cluster_addr":"172.21.15.78:6811/3211476654","heartbeat_back_addr":"172.21.15.78:6815/3211476654","heartbeat_front_addr":"172.21.15.78:6813/3211476654","state":["exists","up"]},{"osd":2,"uuid":"274c8395-6534-41f0-b8fb-a00af8985aa8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6816","nonce":2532904479},{"type":"v1","addr":"172.21.15.78:6817","nonce":2532904479}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6818","nonce":2532904479},{"type":"v1","addr":"172.21.15.78:6819","nonce":2532904479}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6822","nonce":2532904479},{"type":"v1","addr":"172.21.15.78:6823","nonce":2532904479}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6820","nonce":2532904479},{"type":"v1","addr":"172.21.15.78:6821","nonce":2532904479}]},"public_addr":"172.21.15.78:6817/2532904479","cluster_addr":"172.21.15.78:6819/2532904479","heartbeat_back_addr":"172.21.15.78:6823/2532904479","heartbeat_front_addr":"172.21.15.78:6821/2532904479","state":["exists","up"]},{"osd":3,"uuid":"77acc9af-7d4d-4b18-8cf5-d62f5971b7c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6824","nonce":3442991267},{"type":"v1","addr":"172.21.15.78:6825","nonce":3442991267}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6826","nonce":3442991267},{"type":"v1","addr":"172.21.15.78:6827","nonce":3442991267}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6830","nonce":3442991267},{"type":"v1","addr":"172.21.15.78:6831","nonce":3442991267}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6828","nonce":3442991267},{"type":"v1","addr":"172.21.15.78:6829","nonce":3442991267}]},"public_addr":"172.21.15.78:6825/3442991267","cluster_addr":"172.21.15.78:6827/3442991267","heartbeat_back_addr":"172.21.15.78:6831/3442991267","heartbeat_front_addr":"172.21.15.78:6829/3442991267","state":["exists","up"]},{"osd":4,"uuid":"5c62bc66-6b34-4b7f-a66b-9a743969138c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":802983577},{"type":"v1","addr":"172.21.15.179:6809","nonce":802983577}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":802983577},{"type":"v1","addr":"172.21.15.179:6811","nonce":802983577}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":802983577},{"type":"v1","addr":"172.21.15.179:6815","nonce":802983577}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":802983577},{"type":"v1","addr":"172.21.15.179:6813","nonce":802983577}]},"public_addr":"172.21.15.179:6809/802983577","cluster_addr":"172.21.15.179:6811/802983577","heartbeat_back_addr":"172.21.15.179:6815/802983577","heartbeat_front_addr":"172.21.15.179:6813/802983577","state":["exists","up"]},{"osd":5,"uuid":"67db6d36-f684-4079-b0cd-82b4dd61461f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":518192887},{"type":"v1","addr":"172.21.15.179:6818","nonce":518192887}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":518192887},{"type":"v1","addr":"172.21.15.179:6822","nonce":518192887}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":518192887},{"type":"v1","addr":"172.21.15.179:6829","nonce":518192887}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6824","nonce":518192887},{"type":"v1","addr":"172.21.15.179:6826","nonce":518192887}]},"public_addr":"172.21.15.179:6818/518192887","cluster_addr":"172.21.15.179:6822/518192887","heartbeat_back_addr":"172.21.15.179:6829/518192887","heartbeat_front_addr":"172.21.15.179:6826/518192887","state":["exists","up"]},{"osd":6,"uuid":"12e670af-5a16-4c81-9f97-defa66cab967","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":815435378},{"type":"v1","addr":"172.21.15.179:6801","nonce":815435378}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":815435378},{"type":"v1","addr":"172.21.15.179:6803","nonce":815435378}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":815435378},{"type":"v1","addr":"172.21.15.179:6807","nonce":815435378}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":815435378},{"type":"v1","addr":"172.21.15.179:6805","nonce":815435378}]},"public_addr":"172.21.15.179:6801/815435378","cluster_addr":"172.21.15.179:6803/815435378","heartbeat_back_addr":"172.21.15.179:6807/815435378","heartbeat_front_addr":"172.21.15.179:6805/815435378","state":["exists","up"]},{"osd":7,"uuid":"fe630650-2eb3-49ad-8676-c341e6332eb1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6817","nonce":2848432339},{"type":"v1","addr":"172.21.15.179:6819","nonce":2848432339}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6821","nonce":2848432339},{"type":"v1","addr":"172.21.15.179:6823","nonce":2848432339}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":2848432339},{"type":"v1","addr":"172.21.15.179:6831","nonce":2848432339}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6825","nonce":2848432339},{"type":"v1","addr":"172.21.15.179:6827","nonce":2848432339}]},"public_addr":"172.21.15.179:6819/2848432339","cluster_addr":"172.21.15.179:6823/2848432339","heartbeat_back_addr":"172.21.15.179:6831/2848432339","heartbeat_front_addr":"172.21.15.179:6827/2848432339","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:58:49.255433+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:58:49.412880+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:58:49.559295+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:58:49.245237+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:58:49.184557+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:58:49.329851+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:58:49.366012+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:58:49.349604+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.179:6833/2749579094":"2023-11-29T20:03:02.352269+0000","172.21.15.179:6835/2749579094":"2023-11-29T20:03:02.352269+0000","172.21.15.78:6837/20108235":"2023-11-29T20:02:55.575854+0000","172.21.15.78:6835/20108235":"2023-11-29T20:02:55.575854+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-28T20:03:08.498 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:08.492+0000 7f9bf3609640 1 -- 172.21.15.78:0/2149329512 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f9bd0066470 msgr2=0x7f9bd0068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:03:08.499 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:08.492+0000 7f9bf3609640 1 --2- 172.21.15.78:0/2149329512 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f9bd0066470 0x7f9bd0068930 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f9be8006e90 tx=0x7f9be8008040 comp rx=0 tx=0).stop 2023-11-28T20:03:08.499 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:08.492+0000 7f9bf3609640 1 -- 172.21.15.78:0/2149329512 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9bec14fd10 msgr2=0x7f9bec0aaad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:03:08.499 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:08.492+0000 7f9bf3609640 1 --2- 172.21.15.78:0/2149329512 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9bec14fd10 0x7f9bec0aaad0 secure :-1 s=READY pgs=1145 cs=0 l=1 rev1=1 crypto rx=0x7f9be40af040 tx=0x7f9bec153560 comp rx=0 tx=0).stop 2023-11-28T20:03:08.499 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:08.492+0000 7f9bf3609640 1 -- 172.21.15.78:0/2149329512 shutdown_connections 2023-11-28T20:03:08.499 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:08.492+0000 7f9bf3609640 1 --2- 172.21.15.78:0/2149329512 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f9bd0066470 0x7f9bd0068930 unknown :-1 s=CLOSED pgs=542 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:03:08.499 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:08.492+0000 7f9bf3609640 1 --2- 172.21.15.78:0/2149329512 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9bec14fd10 0x7f9bec0aaad0 unknown :-1 s=CLOSED pgs=1145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:03:08.499 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:08.492+0000 7f9bf3609640 1 --2- 172.21.15.78:0/2149329512 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9bec0a5300 0x7f9bec1ef9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:03:08.499 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:08.492+0000 7f9bf3609640 1 --2- 172.21.15.78:0/2149329512 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9bec072370 0x7f9bec1f0d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:03:08.500 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:08.492+0000 7f9bf3609640 1 -- 172.21.15.78:0/2149329512 >> 172.21.15.78:0/2149329512 conn(0x7f9bec0a7810 msgr2=0x7f9bec154740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:03:08.500 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:08.496+0000 7f9bf3609640 1 -- 172.21.15.78:0/2149329512 shutdown_connections 2023-11-28T20:03:08.500 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:08.496+0000 7f9bf3609640 1 -- 172.21.15.78:0/2149329512 wait complete. 2023-11-28T20:03:09.518 INFO:tasks.ceph:Scrubbing osd.0 2023-11-28T20:03:09.519 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2023-11-28T20:03:09.669 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:09.664+0000 7f7dd92fe640 1 Processor -- start 2023-11-28T20:03:09.669 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:09.664+0000 7f7dd92fe640 1 -- start start 2023-11-28T20:03:09.670 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:09.664+0000 7f7dd92fe640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f7dd40c2000 0x7f7dd4157980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:03:09.671 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:09.664+0000 7f7dd92fe640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7dd4071fd0 0x7f7dd415ed10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:03:09.671 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:09.664+0000 7f7dd92fe640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7dd40bce20 con 0x7f7dd406baa0 2023-11-28T20:03:09.671 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:09.664+0000 7f7dd92fe640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7dd4066a80 con 0x7f7dd40c2000 2023-11-28T20:03:09.671 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:09.664+0000 7f7dd92fe640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7dd41584c0 con 0x7f7dd4071fd0 2023-11-28T20:03:09.671 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:09.664+0000 7f7dd2ffd640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f7dd406baa0 0x7f7dd40bb1d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:42970/0 (socket says 172.21.15.78:42970) 2023-11-28T20:03:09.671 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:09.664+0000 7f7dd2ffd640 1 -- 172.21.15.78:0/2457613538 learned_addr learned my addr 172.21.15.78:0/2457613538 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-11-28T20:03:09.671 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:09.668+0000 7f7dca7fc640 1 --2- 172.21.15.78:0/2457613538 >> v2:172.21.15.179:3300/0 conn(0x7f7dd40c2000 0x7f7dd4157980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:03:09.671 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:09.668+0000 7f7dd37fe640 1 --2- 172.21.15.78:0/2457613538 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7dd4071fd0 0x7f7dd415ed10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:03:09.672 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:09.668+0000 7f7dd27fc640 1 -- 172.21.15.78:0/2457613538 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2395623091 0 0) 0x7f7dd40bce20 con 0x7f7dd406baa0 2023-11-28T20:03:09.672 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:09.668+0000 7f7dd27fc640 1 -- 172.21.15.78:0/2457613538 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7dc0003530 con 0x7f7dd406baa0 2023-11-28T20:03:09.673 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:09.668+0000 7f7dd27fc640 1 -- 172.21.15.78:0/2457613538 <== mon.0 v1:172.21.15.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1260007770 0 0) 0x7f7dc0003530 con 0x7f7dd406baa0 2023-11-28T20:03:09.673 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:09.668+0000 7f7dd27fc640 1 -- 172.21.15.78:0/2457613538 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7dd4071fd0 msgr2=0x7f7dd415ed10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:03:09.673 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:09.668+0000 7f7dd27fc640 1 --2- 172.21.15.78:0/2457613538 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7dd4071fd0 0x7f7dd415ed10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:03:09.674 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:09.668+0000 7f7dd27fc640 1 -- 172.21.15.78:0/2457613538 >> v2:172.21.15.179:3300/0 conn(0x7f7dd40c2000 msgr2=0x7f7dd4157980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:03:09.674 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:09.668+0000 7f7dd27fc640 1 --2- 172.21.15.78:0/2457613538 >> v2:172.21.15.179:3300/0 conn(0x7f7dd40c2000 0x7f7dd4157980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:03:09.674 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:09.668+0000 7f7dd27fc640 1 -- 172.21.15.78:0/2457613538 --> v1:172.21.15.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7dd4158910 con 0x7f7dd406baa0 2023-11-28T20:03:09.674 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:09.668+0000 7f7dd27fc640 1 -- 172.21.15.78:0/2457613538 <== mon.0 v1:172.21.15.78:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3326804700 0 0) 0x7f7dbc001680 con 0x7f7dd406baa0 2023-11-28T20:03:09.674 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:09.668+0000 7f7dd27fc640 1 -- 172.21.15.78:0/2457613538 >> v1:172.21.15.78:6789/0 conn(0x7f7dd406baa0 legacy=0x7f7dd40bb1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:03:09.674 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:09.668+0000 7f7dd27fc640 1 --2- 172.21.15.78:0/2457613538 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7dc0003980 0x7f7dc0003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:03:09.674 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:09.668+0000 7f7dd27fc640 1 --2- 172.21.15.78:0/2457613538 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7dd4071fd0 0x7f7dc00047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:03:09.675 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:09.668+0000 7f7dd27fc640 1 --2- 172.21.15.78:0/2457613538 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7dc0004d10 0x7f7dc0005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:03:09.675 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:09.668+0000 7f7dd27fc640 1 -- 172.21.15.78:0/2457613538 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7dd4066a80 con 0x7f7dc0004d10 2023-11-28T20:03:09.675 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:09.668+0000 7f7dd27fc640 1 -- 172.21.15.78:0/2457613538 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7dd41584c0 con 0x7f7dc0003980 2023-11-28T20:03:09.675 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:09.668+0000 7f7dd27fc640 1 -- 172.21.15.78:0/2457613538 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7dc000b9c0 con 0x7f7dd4071fd0 2023-11-28T20:03:09.675 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:09.668+0000 7f7dca7fc640 1 --2- 172.21.15.78:0/2457613538 >> v2:172.21.15.179:3300/0 conn(0x7f7dd40c2000 0x7f7dd4157980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T20:03:09.675 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:09.668+0000 7f7dd37fe640 1 --2- 172.21.15.78:0/2457613538 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7dc0004d10 0x7f7dc0005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:03:09.675 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:09.668+0000 7f7dd2ffd640 1 --2- 172.21.15.78:0/2457613538 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7dc0003980 0x7f7dc0003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:03:09.675 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:09.668+0000 7f7dca7fc640 1 --2- 172.21.15.78:0/2457613538 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7dd4071fd0 0x7f7dc00047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:03:09.676 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:09.668+0000 7f7dd37fe640 1 -- 172.21.15.78:0/2457613538 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7dd4071fd0 msgr2=0x7f7dc00047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:03:09.676 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:09.668+0000 7f7dd37fe640 1 --2- 172.21.15.78:0/2457613538 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7dd4071fd0 0x7f7dc00047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:03:09.676 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:09.668+0000 7f7dd37fe640 1 -- 172.21.15.78:0/2457613538 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7dc0003980 msgr2=0x7f7dc0003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:03:09.676 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:09.668+0000 7f7dd37fe640 1 --2- 172.21.15.78:0/2457613538 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7dc0003980 0x7f7dc0003da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:03:09.676 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:09.668+0000 7f7dd37fe640 1 -- 172.21.15.78:0/2457613538 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7dc0003530 con 0x7f7dc0004d10 2023-11-28T20:03:09.676 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:09.668+0000 7f7dd2ffd640 1 --2- 172.21.15.78:0/2457613538 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7dc0003980 0x7f7dc0003da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T20:03:09.678 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:09.672+0000 7f7dd37fe640 1 --2- 172.21.15.78:0/2457613538 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7dc0004d10 0x7f7dc0005190 secure :-1 s=READY pgs=1147 cs=0 l=1 rev1=1 crypto rx=0x7f7dcc009f90 tx=0x7f7dcc01cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=af380f57d611385c server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:03:09.678 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:09.672+0000 7f7dd27fc640 1 -- 172.21.15.78:0/2457613538 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7dcc0a5c30 con 0x7f7dc0004d10 2023-11-28T20:03:09.678 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:09.672+0000 7f7dd27fc640 1 -- 172.21.15.78:0/2457613538 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7dcc00f040 con 0x7f7dc0004d10 2023-11-28T20:03:09.678 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:09.672+0000 7f7dd27fc640 1 -- 172.21.15.78:0/2457613538 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7dcc0ad440 con 0x7f7dc0004d10 2023-11-28T20:03:09.678 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:09.672+0000 7f7dd92fe640 1 -- 172.21.15.78:0/2457613538 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7dc0004d10 msgr2=0x7f7dc0005190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:03:09.678 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:09.672+0000 7f7dd92fe640 1 --2- 172.21.15.78:0/2457613538 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7dc0004d10 0x7f7dc0005190 secure :-1 s=READY pgs=1147 cs=0 l=1 rev1=1 crypto rx=0x7f7dcc009f90 tx=0x7f7dcc01cc20 comp rx=0 tx=0).stop 2023-11-28T20:03:09.679 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:09.672+0000 7f7dd37fe640 1 -- 172.21.15.78:0/2457613538 reap_dead start 2023-11-28T20:03:09.679 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:09.672+0000 7f7dd92fe640 1 -- 172.21.15.78:0/2457613538 shutdown_connections 2023-11-28T20:03:09.679 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:09.672+0000 7f7dd92fe640 1 -- 172.21.15.78:0/2457613538 >> 172.21.15.78:0/2457613538 conn(0x7f7dd40c2cb0 msgr2=0x7f7dd40c30c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:03:09.679 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:09.672+0000 7f7dd92fe640 1 -- 172.21.15.78:0/2457613538 shutdown_connections 2023-11-28T20:03:09.679 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:09.672+0000 7f7dd92fe640 1 -- 172.21.15.78:0/2457613538 wait complete. 2023-11-28T20:03:09.679 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:09.672+0000 7f7dd92fe640 1 Processor -- start 2023-11-28T20:03:09.679 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:09.672+0000 7f7dd92fe640 1 -- start start 2023-11-28T20:03:09.681 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:09.676+0000 7f7dd92fe640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7dc0004d10 0x7f7dd4145db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:03:09.681 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:09.676+0000 7f7dd92fe640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7dd40c07b0 0x7f7dd40c5520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:03:09.681 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:09.676+0000 7f7dd92fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7dd40c5a60 0x7f7dd4144950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:03:09.682 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:09.676+0000 7f7dd92fe640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7dd41462f0 con 0x7f7dd40c5a60 2023-11-28T20:03:09.682 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:09.676+0000 7f7dd92fe640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7dd40ab1d0 con 0x7f7dc0004d10 2023-11-28T20:03:09.682 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:09.676+0000 7f7dd92fe640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7dd40ab4b0 con 0x7f7dd40c07b0 2023-11-28T20:03:09.682 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:09.676+0000 7f7dd37fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7dd40c5a60 0x7f7dd4144950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:03:09.682 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:09.676+0000 7f7dd37fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7dd40c5a60 0x7f7dd4144950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:47706/0 (socket says 172.21.15.78:47706) 2023-11-28T20:03:09.682 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:09.676+0000 7f7dd37fe640 1 -- 172.21.15.78:0/1932106053 learned_addr learned my addr 172.21.15.78:0/1932106053 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T20:03:09.682 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:09.676+0000 7f7dca7fc640 1 --2- 172.21.15.78:0/1932106053 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7dd40c07b0 0x7f7dd40c5520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:03:09.682 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:09.676+0000 7f7dd2ffd640 1 --2- 172.21.15.78:0/1932106053 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7dc0004d10 0x7f7dd4145db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:03:09.683 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:09.676+0000 7f7dd37fe640 1 -- 172.21.15.78:0/1932106053 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7dd40c07b0 msgr2=0x7f7dd40c5520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:03:09.683 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:09.676+0000 7f7dd37fe640 1 --2- 172.21.15.78:0/1932106053 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7dd40c07b0 0x7f7dd40c5520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:03:09.683 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:09.676+0000 7f7dd37fe640 1 -- 172.21.15.78:0/1932106053 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7dc0004d10 msgr2=0x7f7dd4145db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:03:09.683 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:09.676+0000 7f7dd37fe640 1 --2- 172.21.15.78:0/1932106053 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7dc0004d10 0x7f7dd4145db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:03:09.683 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:09.676+0000 7f7dd37fe640 1 -- 172.21.15.78:0/1932106053 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7dd40ab790 con 0x7f7dd40c5a60 2023-11-28T20:03:09.683 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:09.676+0000 7f7dca7fc640 1 --2- 172.21.15.78:0/1932106053 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7dd40c07b0 0x7f7dd40c5520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T20:03:09.683 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:09.676+0000 7f7dd2ffd640 1 --2- 172.21.15.78:0/1932106053 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7dc0004d10 0x7f7dd4145db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T20:03:09.683 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:09.676+0000 7f7dd37fe640 1 --2- 172.21.15.78:0/1932106053 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7dd40c5a60 0x7f7dd4144950 secure :-1 s=READY pgs=1148 cs=0 l=1 rev1=1 crypto rx=0x7f7dcc0b0040 tx=0x7f7dcc009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:03:09.684 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:09.676+0000 7f7dcbfff640 1 -- 172.21.15.78:0/1932106053 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7dcc0039a0 con 0x7f7dd40c5a60 2023-11-28T20:03:09.684 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:09.676+0000 7f7dcbfff640 1 -- 172.21.15.78:0/1932106053 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7dcc003b00 con 0x7f7dd40c5a60 2023-11-28T20:03:09.684 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:09.676+0000 7f7dcbfff640 1 -- 172.21.15.78:0/1932106053 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7dcc003e90 con 0x7f7dd40c5a60 2023-11-28T20:03:09.684 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:09.676+0000 7f7dd92fe640 1 -- 172.21.15.78:0/1932106053 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7dd40aba70 con 0x7f7dd40c5a60 2023-11-28T20:03:09.684 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:09.676+0000 7f7dd92fe640 1 -- 172.21.15.78:0/1932106053 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7dd4145060 con 0x7f7dd40c5a60 2023-11-28T20:03:09.684 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:09.676+0000 7f7dd92fe640 1 -- 172.21.15.78:0/1932106053 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f7dd41ed290 con 0x7f7dd40c5a60 2023-11-28T20:03:09.685 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:09.676+0000 7f7dcbfff640 1 -- 172.21.15.78:0/1932106053 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f7dcc0b4040 con 0x7f7dd40c5a60 2023-11-28T20:03:09.686 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:09.680+0000 7f7dcbfff640 1 --2- 172.21.15.78:0/1932106053 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f7db4066470 0x7f7db4068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:03:09.686 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:09.680+0000 7f7dcbfff640 1 -- 172.21.15.78:0/1932106053 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 5349+0+0 (secure 0 0 0) 0x7f7dcc11dfe0 con 0x7f7dd40c5a60 2023-11-28T20:03:09.686 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:09.680+0000 7f7dd2ffd640 1 --2- 172.21.15.78:0/1932106053 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f7db4066470 0x7f7db4068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:03:09.686 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:09.680+0000 7f7dcbfff640 1 --2- 172.21.15.78:0/1932106053 >> [v2:172.21.15.78:6800/3358701235,v1:172.21.15.78:6801/3358701235] conn(0x7f7db406c6a0 0x7f7db406eae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:03:09.686 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:09.680+0000 7f7dcbfff640 1 -- 172.21.15.78:0/1932106053 --> [v2:172.21.15.78:6800/3358701235,v1:172.21.15.78:6801/3358701235] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f7db406f1b0 con 0x7f7db406c6a0 2023-11-28T20:03:09.686 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:09.680+0000 7f7dcbfff640 1 -- 172.21.15.78:0/1932106053 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_get_version_reply(handle=1 version=93) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7dcc11e350 con 0x7f7dd40c5a60 2023-11-28T20:03:09.686 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:09.680+0000 7f7dca7fc640 1 --2- 172.21.15.78:0/1932106053 >> [v2:172.21.15.78:6800/3358701235,v1:172.21.15.78:6801/3358701235] conn(0x7f7db406c6a0 0x7f7db406eae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:03:09.687 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:09.680+0000 7f7dd2ffd640 1 --2- 172.21.15.78:0/1932106053 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f7db4066470 0x7f7db4068930 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f7dbc000c10 tx=0x7f7dbc009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:03:09.687 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:09.680+0000 7f7dca7fc640 1 --2- 172.21.15.78:0/1932106053 >> [v2:172.21.15.78:6800/3358701235,v1:172.21.15.78:6801/3358701235] conn(0x7f7db406c6a0 0x7f7db406eae0 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:03:09.687 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:09.680+0000 7f7dcbfff640 1 -- 172.21.15.78:0/1932106053 <== osd.0 v2:172.21.15.78:6800/3358701235 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7f7db406f1b0 con 0x7f7db406c6a0 2023-11-28T20:03:09.697 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:09.692+0000 7f7dd92fe640 1 -- 172.21.15.78:0/1932106053 --> [v2:172.21.15.78:6800/3358701235,v1:172.21.15.78:6801/3358701235] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f7dd40bd050 con 0x7f7db406c6a0 2023-11-28T20:03:09.698 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:09.692+0000 7f7dcbfff640 1 -- 172.21.15.78:0/1932106053 <== osd.0 v2:172.21.15.78:6800/3358701235 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f7dc4009a60 con 0x7f7db406c6a0 2023-11-28T20:03:09.698 INFO:teuthology.orchestra.run.smithi078.stdout:{ 2023-11-28T20:03:09.698 INFO:teuthology.orchestra.run.smithi078.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2023-11-28T20:03:09.698 INFO:teuthology.orchestra.run.smithi078.stdout:} 2023-11-28T20:03:09.699 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:09.692+0000 7f7dd92fe640 1 -- 172.21.15.78:0/1932106053 >> [v2:172.21.15.78:6800/3358701235,v1:172.21.15.78:6801/3358701235] conn(0x7f7db406c6a0 msgr2=0x7f7db406eae0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:03:09.700 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:09.692+0000 7f7dd92fe640 1 --2- 172.21.15.78:0/1932106053 >> [v2:172.21.15.78:6800/3358701235,v1:172.21.15.78:6801/3358701235] conn(0x7f7db406c6a0 0x7f7db406eae0 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:03:09.700 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:09.692+0000 7f7dd92fe640 1 -- 172.21.15.78:0/1932106053 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f7db4066470 msgr2=0x7f7db4068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:03:09.700 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:09.692+0000 7f7dd92fe640 1 --2- 172.21.15.78:0/1932106053 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f7db4066470 0x7f7db4068930 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f7dbc000c10 tx=0x7f7dbc009040 comp rx=0 tx=0).stop 2023-11-28T20:03:09.700 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:09.692+0000 7f7dd92fe640 1 -- 172.21.15.78:0/1932106053 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7dd40c5a60 msgr2=0x7f7dd4144950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:03:09.700 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:09.692+0000 7f7dd92fe640 1 --2- 172.21.15.78:0/1932106053 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7dd40c5a60 0x7f7dd4144950 secure :-1 s=READY pgs=1148 cs=0 l=1 rev1=1 crypto rx=0x7f7dcc0b0040 tx=0x7f7dcc009750 comp rx=0 tx=0).stop 2023-11-28T20:03:09.701 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:09.692+0000 7f7dd37fe640 1 -- 172.21.15.78:0/1932106053 reap_dead start 2023-11-28T20:03:09.701 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:09.692+0000 7f7dd92fe640 1 -- 172.21.15.78:0/1932106053 shutdown_connections 2023-11-28T20:03:09.701 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:09.692+0000 7f7dd92fe640 1 -- 172.21.15.78:0/1932106053 >> 172.21.15.78:0/1932106053 conn(0x7f7dd40c2cb0 msgr2=0x7f7dd40c3230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:03:09.701 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:09.692+0000 7f7dd92fe640 1 -- 172.21.15.78:0/1932106053 shutdown_connections 2023-11-28T20:03:09.701 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:09.692+0000 7f7dd92fe640 1 -- 172.21.15.78:0/1932106053 wait complete. 2023-11-28T20:03:09.716 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2023-11-28T20:03:09.855 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:09.852+0000 7fa562e09640 1 Processor -- start 2023-11-28T20:03:09.855 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:09.852+0000 7fa562e09640 1 -- start start 2023-11-28T20:03:09.856 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:09.852+0000 7fa562e09640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fa55c0c2110 0x7fa55c0c5ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:03:09.857 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:09.852+0000 7fa562e09640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fa55c0c0c80 0x7fa55c0c61e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:03:09.857 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:09.852+0000 7fa562e09640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa55c0a93d0 con 0x7fa55c154390 2023-11-28T20:03:09.857 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:09.852+0000 7fa562e09640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa55c0aa1c0 con 0x7fa55c0c0c80 2023-11-28T20:03:09.857 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:09.852+0000 7fa562e09640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa55c154770 con 0x7fa55c0c2110 2023-11-28T20:03:09.857 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:09.852+0000 7fa5613a6640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fa55c0c0c80 0x7fa55c0c61e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:03:09.857 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:09.852+0000 7fa5613a6640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fa55c0c0c80 0x7fa55c0c61e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:47720/0 (socket says 172.21.15.78:47720) 2023-11-28T20:03:09.857 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:09.852+0000 7fa5613a6640 1 -- 172.21.15.78:0/3512130686 learned_addr learned my addr 172.21.15.78:0/3512130686 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T20:03:09.858 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:09.852+0000 7fa55bfff640 1 --2- 172.21.15.78:0/3512130686 >> v2:172.21.15.179:3300/0 conn(0x7fa55c0c2110 0x7fa55c0c5ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:03:09.858 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:09.852+0000 7fa5613a6640 1 -- 172.21.15.78:0/3512130686 >> v2:172.21.15.179:3300/0 conn(0x7fa55c0c2110 msgr2=0x7fa55c0c5ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:03:09.858 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:09.852+0000 7fa5613a6640 1 --2- 172.21.15.78:0/3512130686 >> v2:172.21.15.179:3300/0 conn(0x7fa55c0c2110 0x7fa55c0c5ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:03:09.858 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:09.852+0000 7fa5613a6640 1 -- 172.21.15.78:0/3512130686 >> v1:172.21.15.179:6789/0 conn(0x7fa55c154390 legacy=0x7fa55c0c4a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:03:09.858 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:09.852+0000 7fa5613a6640 1 -- 172.21.15.78:0/3512130686 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa55c0a9640 con 0x7fa55c0c0c80 2023-11-28T20:03:09.859 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:09.856+0000 7fa5613a6640 1 --2- 172.21.15.78:0/3512130686 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa55c0c0c80 0x7fa55c0c61e0 secure :-1 s=READY pgs=1149 cs=0 l=1 rev1=1 crypto rx=0x7fa55c0bfe50 tx=0x7fa55401c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9508851e709a8e9 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:03:09.861 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:09.856+0000 7fa55b7fe640 1 -- 172.21.15.78:0/3512130686 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5540a5850 con 0x7fa55c0c0c80 2023-11-28T20:03:09.861 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:09.856+0000 7fa55b7fe640 1 -- 172.21.15.78:0/3512130686 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa5540a59b0 con 0x7fa55c0c0c80 2023-11-28T20:03:09.861 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:09.856+0000 7fa55b7fe640 1 -- 172.21.15.78:0/3512130686 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5540a5d40 con 0x7fa55c0c0c80 2023-11-28T20:03:09.861 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:09.856+0000 7fa562e09640 1 -- 172.21.15.78:0/3512130686 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa55c0c0c80 msgr2=0x7fa55c0c61e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:03:09.861 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:09.856+0000 7fa562e09640 1 --2- 172.21.15.78:0/3512130686 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa55c0c0c80 0x7fa55c0c61e0 secure :-1 s=READY pgs=1149 cs=0 l=1 rev1=1 crypto rx=0x7fa55c0bfe50 tx=0x7fa55401c990 comp rx=0 tx=0).stop 2023-11-28T20:03:09.861 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:09.856+0000 7fa562e09640 1 -- 172.21.15.78:0/3512130686 shutdown_connections 2023-11-28T20:03:09.861 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:09.856+0000 7fa562e09640 1 --2- 172.21.15.78:0/3512130686 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa55c0c0c80 0x7fa55c0c61e0 unknown :-1 s=CLOSED pgs=1149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:03:09.862 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:09.856+0000 7fa562e09640 1 --2- 172.21.15.78:0/3512130686 >> v2:172.21.15.179:3300/0 conn(0x7fa55c0c2110 0x7fa55c0c5ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:03:09.862 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:09.856+0000 7fa562e09640 1 -- 172.21.15.78:0/3512130686 >> 172.21.15.78:0/3512130686 conn(0x7fa55c06b220 msgr2=0x7fa55c0a77e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:03:09.862 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:09.856+0000 7fa562e09640 1 -- 172.21.15.78:0/3512130686 shutdown_connections 2023-11-28T20:03:09.862 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:09.856+0000 7fa562e09640 1 -- 172.21.15.78:0/3512130686 wait complete. 2023-11-28T20:03:09.862 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:09.856+0000 7fa562e09640 1 Processor -- start 2023-11-28T20:03:09.863 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:09.856+0000 7fa562e09640 1 -- start start 2023-11-28T20:03:09.864 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:09.860+0000 7fa562e09640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa55c0c0c80 0x7fa55c13fe20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:03:09.864 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:09.860+0000 7fa562e09640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa55c0c2110 0x7fa55c14fce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:03:09.864 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:09.860+0000 7fa562e09640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa55c154390 0x7fa55c150220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:03:09.864 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:09.860+0000 7fa562e09640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa55c0717c0 con 0x7fa55c0c2110 2023-11-28T20:03:09.864 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:09.860+0000 7fa562e09640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa55c070d80 con 0x7fa55c0c0c80 2023-11-28T20:03:09.865 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:09.860+0000 7fa562e09640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa55c072690 con 0x7fa55c154390 2023-11-28T20:03:09.865 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:09.860+0000 7fa55bfff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa55c0c2110 0x7fa55c14fce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:03:09.865 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:09.860+0000 7fa55bfff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa55c0c2110 0x7fa55c14fce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:47722/0 (socket says 172.21.15.78:47722) 2023-11-28T20:03:09.865 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:09.860+0000 7fa55bfff640 1 -- 172.21.15.78:0/541194328 learned_addr learned my addr 172.21.15.78:0/541194328 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T20:03:09.865 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:09.860+0000 7fa5613a6640 1 --2- 172.21.15.78:0/541194328 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa55c154390 0x7fa55c150220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:03:09.865 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:09.860+0000 7fa560ba5640 1 --2- 172.21.15.78:0/541194328 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa55c0c0c80 0x7fa55c13fe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:03:09.865 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:09.860+0000 7fa55bfff640 1 -- 172.21.15.78:0/541194328 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa55c154390 msgr2=0x7fa55c150220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:03:09.866 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:09.860+0000 7fa55bfff640 1 --2- 172.21.15.78:0/541194328 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa55c154390 0x7fa55c150220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:03:09.866 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:09.860+0000 7fa55bfff640 1 -- 172.21.15.78:0/541194328 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa55c0c0c80 msgr2=0x7fa55c13fe20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:03:09.866 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:09.860+0000 7fa55bfff640 1 --2- 172.21.15.78:0/541194328 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa55c0c0c80 0x7fa55c13fe20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:03:09.866 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:09.860+0000 7fa55bfff640 1 -- 172.21.15.78:0/541194328 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa554009b30 con 0x7fa55c0c2110 2023-11-28T20:03:09.866 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:09.860+0000 7fa55bfff640 1 --2- 172.21.15.78:0/541194328 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa55c0c2110 0x7fa55c14fce0 secure :-1 s=READY pgs=1150 cs=0 l=1 rev1=1 crypto rx=0x7fa54800d830 tx=0x7fa54800dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:03:09.867 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:09.860+0000 7fa5597fa640 1 -- 172.21.15.78:0/541194328 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa54800b6c0 con 0x7fa55c0c2110 2023-11-28T20:03:09.868 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:09.860+0000 7fa5597fa640 1 -- 172.21.15.78:0/541194328 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa54800b820 con 0x7fa55c0c2110 2023-11-28T20:03:09.868 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:09.860+0000 7fa5597fa640 1 -- 172.21.15.78:0/541194328 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa54800bb90 con 0x7fa55c0c2110 2023-11-28T20:03:09.868 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:09.860+0000 7fa562e09640 1 -- 172.21.15.78:0/541194328 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa55c070aa0 con 0x7fa55c0c2110 2023-11-28T20:03:09.868 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:09.860+0000 7fa562e09640 1 -- 172.21.15.78:0/541194328 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa55c0713e0 con 0x7fa55c0c2110 2023-11-28T20:03:09.868 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:09.860+0000 7fa562e09640 1 -- 172.21.15.78:0/541194328 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa55c0715a0 con 0x7fa55c0c2110 2023-11-28T20:03:09.868 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:09.864+0000 7fa5597fa640 1 -- 172.21.15.78:0/541194328 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fa54801e460 con 0x7fa55c0c2110 2023-11-28T20:03:09.868 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:09.864+0000 7fa5597fa640 1 --2- 172.21.15.78:0/541194328 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fa5400664a0 0x7fa540068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:03:09.869 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:09.864+0000 7fa5597fa640 1 -- 172.21.15.78:0/541194328 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 5349+0+0 (secure 0 0 0) 0x7fa548084490 con 0x7fa55c0c2110 2023-11-28T20:03:09.869 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:09.864+0000 7fa560ba5640 1 --2- 172.21.15.78:0/541194328 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fa5400664a0 0x7fa540068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:03:09.869 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:09.864+0000 7fa560ba5640 1 --2- 172.21.15.78:0/541194328 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fa5400664a0 0x7fa540068960 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7fa55000b810 tx=0x7fa550008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:03:09.871 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:09.868+0000 7fa5597fa640 1 -- 172.21.15.78:0/541194328 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fa548051a60 con 0x7fa55c0c2110 2023-11-28T20:03:10.020 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:10.016+0000 7fa562e09640 1 -- 172.21.15.78:0/541194328 --> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "0", "target": ["mon-mgr", ""]}) v1 -- 0x7fa55c0aa690 con 0x7fa5400664a0 2023-11-28T20:03:10.021 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:10.016+0000 7fa5597fa640 1 -- 172.21.15.78:0/541194328 <== mgr.4106 v2:172.21.15.78:6832/2935380957 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 0 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fa55000b400 con 0x7fa5400664a0 2023-11-28T20:03:10.021 INFO:teuthology.orchestra.run.smithi078.stderr:instructed osd(s) 0 to deep-scrub 2023-11-28T20:03:10.023 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:10.020+0000 7fa562e09640 1 -- 172.21.15.78:0/541194328 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fa5400664a0 msgr2=0x7fa540068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:03:10.023 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:10.020+0000 7fa562e09640 1 --2- 172.21.15.78:0/541194328 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fa5400664a0 0x7fa540068960 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7fa55000b810 tx=0x7fa550008040 comp rx=0 tx=0).stop 2023-11-28T20:03:10.024 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:10.020+0000 7fa562e09640 1 -- 172.21.15.78:0/541194328 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa55c0c2110 msgr2=0x7fa55c14fce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:03:10.024 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:10.020+0000 7fa562e09640 1 --2- 172.21.15.78:0/541194328 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa55c0c2110 0x7fa55c14fce0 secure :-1 s=READY pgs=1150 cs=0 l=1 rev1=1 crypto rx=0x7fa54800d830 tx=0x7fa54800dcf0 comp rx=0 tx=0).stop 2023-11-28T20:03:10.024 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:10.020+0000 7fa562e09640 1 -- 172.21.15.78:0/541194328 shutdown_connections 2023-11-28T20:03:10.024 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:10.020+0000 7fa562e09640 1 --2- 172.21.15.78:0/541194328 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fa5400664a0 0x7fa540068960 unknown :-1 s=CLOSED pgs=544 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:03:10.025 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:10.020+0000 7fa562e09640 1 --2- 172.21.15.78:0/541194328 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa55c154390 0x7fa55c150220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:03:10.025 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:10.020+0000 7fa562e09640 1 --2- 172.21.15.78:0/541194328 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa55c0c2110 0x7fa55c14fce0 unknown :-1 s=CLOSED pgs=1150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:03:10.025 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:10.020+0000 7fa562e09640 1 --2- 172.21.15.78:0/541194328 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa55c0c0c80 0x7fa55c13fe20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:03:10.025 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:10.020+0000 7fa562e09640 1 -- 172.21.15.78:0/541194328 >> 172.21.15.78:0/541194328 conn(0x7fa55c06b220 msgr2=0x7fa55c152ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:03:10.026 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:10.020+0000 7fa562e09640 1 -- 172.21.15.78:0/541194328 shutdown_connections 2023-11-28T20:03:10.026 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:10.020+0000 7fa562e09640 1 -- 172.21.15.78:0/541194328 wait complete. 2023-11-28T20:03:10.042 INFO:tasks.ceph:Scrubbing osd.1 2023-11-28T20:03:10.043 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2023-11-28T20:03:10.184 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:10.180+0000 7f097d409640 1 Processor -- start 2023-11-28T20:03:10.185 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:10.180+0000 7f097d409640 1 -- start start 2023-11-28T20:03:10.186 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:10.180+0000 7f097d409640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f09781510b0 0x7f09780c1920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:03:10.186 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:10.180+0000 7f097d409640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f09780c3de0 0x7f09780aabe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:03:10.186 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:10.180+0000 7f097d409640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f09780c0170 con 0x7f09780c1540 2023-11-28T20:03:10.186 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:10.180+0000 7f097d409640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f09780a9720 con 0x7f09780c3de0 2023-11-28T20:03:10.186 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:10.180+0000 7f097d409640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f097806de60 con 0x7f09781510b0 2023-11-28T20:03:10.186 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:10.180+0000 7f0976ffd640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f09780c1540 0x7f09780c36d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:42984/0 (socket says 172.21.15.78:42984) 2023-11-28T20:03:10.187 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:10.180+0000 7f0976ffd640 1 -- 172.21.15.78:0/216966734 learned_addr learned my addr 172.21.15.78:0/216966734 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-11-28T20:03:10.187 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:10.180+0000 7f09777fe640 1 --2- 172.21.15.78:0/216966734 >> v2:172.21.15.78:3300/0 conn(0x7f09780c3de0 0x7f09780aabe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:03:10.187 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:10.180+0000 7f096e7fc640 1 --2- 172.21.15.78:0/216966734 >> v2:172.21.15.179:3300/0 conn(0x7f09781510b0 0x7f09780c1920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:03:10.188 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:10.184+0000 7f09767fc640 1 -- 172.21.15.78:0/216966734 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 932605572 0 0) 0x7f09780c0170 con 0x7f09780c1540 2023-11-28T20:03:10.188 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:10.184+0000 7f09767fc640 1 -- 172.21.15.78:0/216966734 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0964003530 con 0x7f09780c1540 2023-11-28T20:03:10.188 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:10.184+0000 7f09777fe640 1 -- 172.21.15.78:0/216966734 >> v2:172.21.15.179:3300/0 conn(0x7f09781510b0 msgr2=0x7f09780c1920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:03:10.188 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:10.184+0000 7f09777fe640 1 --2- 172.21.15.78:0/216966734 >> v2:172.21.15.179:3300/0 conn(0x7f09781510b0 0x7f09780c1920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:03:10.188 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:10.184+0000 7f09777fe640 1 -- 172.21.15.78:0/216966734 >> v1:172.21.15.78:6789/0 conn(0x7f09780c1540 legacy=0x7f09780c36d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:03:10.188 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:10.184+0000 7f09777fe640 1 -- 172.21.15.78:0/216966734 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09780c03c0 con 0x7f09780c3de0 2023-11-28T20:03:10.190 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:10.184+0000 7f09777fe640 1 --2- 172.21.15.78:0/216966734 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f09780c3de0 0x7f09780aabe0 secure :-1 s=READY pgs=1152 cs=0 l=1 rev1=1 crypto rx=0x7f097806c180 tx=0x7f097001c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=48b044d8b630013d server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:03:10.191 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:10.184+0000 7f09767fc640 1 -- 172.21.15.78:0/216966734 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09780ab930 con 0x7f09780c3de0 2023-11-28T20:03:10.191 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:10.184+0000 7f09767fc640 1 -- 172.21.15.78:0/216966734 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f09700a5820 con 0x7f09780c3de0 2023-11-28T20:03:10.191 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:10.184+0000 7f09767fc640 1 -- 172.21.15.78:0/216966734 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09700a5bb0 con 0x7f09780c3de0 2023-11-28T20:03:10.191 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:10.184+0000 7f097d409640 1 -- 172.21.15.78:0/216966734 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f09780c3de0 msgr2=0x7f09780aabe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:03:10.191 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:10.184+0000 7f097d409640 1 --2- 172.21.15.78:0/216966734 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f09780c3de0 0x7f09780aabe0 secure :-1 s=READY pgs=1152 cs=0 l=1 rev1=1 crypto rx=0x7f097806c180 tx=0x7f097001c850 comp rx=0 tx=0).stop 2023-11-28T20:03:10.191 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:10.184+0000 7f097d409640 1 -- 172.21.15.78:0/216966734 shutdown_connections 2023-11-28T20:03:10.191 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:10.184+0000 7f097d409640 1 --2- 172.21.15.78:0/216966734 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f09780c3de0 0x7f09780aabe0 unknown :-1 s=CLOSED pgs=1152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:03:10.192 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:10.184+0000 7f097d409640 1 --2- 172.21.15.78:0/216966734 >> v2:172.21.15.179:3300/0 conn(0x7f09781510b0 0x7f09780c1920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:03:10.192 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:10.184+0000 7f097d409640 1 -- 172.21.15.78:0/216966734 >> 172.21.15.78:0/216966734 conn(0x7f09780a7520 msgr2=0x7f09780a7930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:03:10.192 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:10.188+0000 7f097d409640 1 -- 172.21.15.78:0/216966734 shutdown_connections 2023-11-28T20:03:10.192 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:10.188+0000 7f097d409640 1 -- 172.21.15.78:0/216966734 wait complete. 2023-11-28T20:03:10.192 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:10.188+0000 7f097d409640 1 Processor -- start 2023-11-28T20:03:10.193 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:10.188+0000 7f097d409640 1 -- start start 2023-11-28T20:03:10.194 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:10.188+0000 7f097d409640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f09780c1540 0x7f09781f0880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:03:10.195 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:10.188+0000 7f097d409640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f09780c3de0 0x7f0978144f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:03:10.195 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:10.188+0000 7f097d409640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f09781510b0 0x7f09781454b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:03:10.195 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:10.188+0000 7f097d409640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09781f0dc0 con 0x7f09780c1540 2023-11-28T20:03:10.195 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:10.188+0000 7f097d409640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f097814d0a0 con 0x7f09780c3de0 2023-11-28T20:03:10.195 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:10.188+0000 7f097d409640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f097814b770 con 0x7f09781510b0 2023-11-28T20:03:10.195 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:10.188+0000 7f0976ffd640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f09780c1540 0x7f09781f0880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:03:10.195 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:10.188+0000 7f0976ffd640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f09780c1540 0x7f09781f0880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:47736/0 (socket says 172.21.15.78:47736) 2023-11-28T20:03:10.195 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:10.188+0000 7f0976ffd640 1 -- 172.21.15.78:0/3344806460 learned_addr learned my addr 172.21.15.78:0/3344806460 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T20:03:10.196 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:10.188+0000 7f09777fe640 1 --2- 172.21.15.78:0/3344806460 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f09781510b0 0x7f09781454b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:03:10.196 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:10.188+0000 7f096e7fc640 1 --2- 172.21.15.78:0/3344806460 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f09780c3de0 0x7f0978144f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:03:10.196 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:10.188+0000 7f0976ffd640 1 -- 172.21.15.78:0/3344806460 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f09781510b0 msgr2=0x7f09781454b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:03:10.196 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:10.188+0000 7f0976ffd640 1 --2- 172.21.15.78:0/3344806460 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f09781510b0 0x7f09781454b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:03:10.196 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:10.188+0000 7f0976ffd640 1 -- 172.21.15.78:0/3344806460 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f09780c3de0 msgr2=0x7f0978144f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:03:10.196 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:10.188+0000 7f0976ffd640 1 --2- 172.21.15.78:0/3344806460 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f09780c3de0 0x7f0978144f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:03:10.196 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:10.188+0000 7f0976ffd640 1 -- 172.21.15.78:0/3344806460 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0970009a70 con 0x7f09780c1540 2023-11-28T20:03:10.197 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:10.188+0000 7f0976ffd640 1 --2- 172.21.15.78:0/3344806460 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f09780c1540 0x7f09781f0880 secure :-1 s=READY pgs=1153 cs=0 l=1 rev1=1 crypto rx=0x7f096000c500 tx=0x7f096000c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:03:10.197 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:10.188+0000 7f096ffff640 1 -- 172.21.15.78:0/3344806460 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0960005cf0 con 0x7f09780c1540 2023-11-28T20:03:10.197 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:10.188+0000 7f096ffff640 1 -- 172.21.15.78:0/3344806460 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0960005e50 con 0x7f09780c1540 2023-11-28T20:03:10.197 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:10.188+0000 7f097d409640 1 -- 172.21.15.78:0/3344806460 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f097813ee70 con 0x7f09780c1540 2023-11-28T20:03:10.197 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:10.192+0000 7f096ffff640 1 -- 172.21.15.78:0/3344806460 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09600072f0 con 0x7f09780c1540 2023-11-28T20:03:10.197 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:10.192+0000 7f097d409640 1 -- 172.21.15.78:0/3344806460 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f097813eb90 con 0x7f09780c1540 2023-11-28T20:03:10.199 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:10.192+0000 7f097d409640 1 -- 172.21.15.78:0/3344806460 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f0978151fd0 con 0x7f09780c1540 2023-11-28T20:03:10.199 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:10.192+0000 7f096ffff640 1 -- 172.21.15.78:0/3344806460 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f0960007450 con 0x7f09780c1540 2023-11-28T20:03:10.199 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:10.192+0000 7f096ffff640 1 --2- 172.21.15.78:0/3344806460 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f0958066470 0x7f0958068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:03:10.199 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:10.192+0000 7f096ffff640 1 -- 172.21.15.78:0/3344806460 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 5349+0+0 (secure 0 0 0) 0x7f0960083320 con 0x7f09780c1540 2023-11-28T20:03:10.199 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:10.192+0000 7f096e7fc640 1 --2- 172.21.15.78:0/3344806460 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f0958066470 0x7f0958068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:03:10.199 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:10.192+0000 7f096ffff640 1 --2- 172.21.15.78:0/3344806460 >> [v2:172.21.15.78:6808/3211476654,v1:172.21.15.78:6809/3211476654] conn(0x7f095806c810 0x7f095806ec50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:03:10.200 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:10.192+0000 7f096ffff640 1 -- 172.21.15.78:0/3344806460 --> [v2:172.21.15.78:6808/3211476654,v1:172.21.15.78:6809/3211476654] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f095806f320 con 0x7f095806c810 2023-11-28T20:03:10.200 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:10.192+0000 7f096ffff640 1 -- 172.21.15.78:0/3344806460 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_get_version_reply(handle=1 version=93) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0960085900 con 0x7f09780c1540 2023-11-28T20:03:10.200 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:10.192+0000 7f09777fe640 1 --2- 172.21.15.78:0/3344806460 >> [v2:172.21.15.78:6808/3211476654,v1:172.21.15.78:6809/3211476654] conn(0x7f095806c810 0x7f095806ec50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:03:10.200 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:10.192+0000 7f096e7fc640 1 --2- 172.21.15.78:0/3344806460 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f0958066470 0x7f0958068930 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7f097815d360 tx=0x7f0968008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:03:10.200 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:10.196+0000 7f09777fe640 1 --2- 172.21.15.78:0/3344806460 >> [v2:172.21.15.78:6808/3211476654,v1:172.21.15.78:6809/3211476654] conn(0x7f095806c810 0x7f095806ec50 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:03:10.200 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:10.196+0000 7f096ffff640 1 -- 172.21.15.78:0/3344806460 <== osd.1 v2:172.21.15.78:6808/3211476654 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7f095806f320 con 0x7f095806c810 2023-11-28T20:03:10.212 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:10.208+0000 7f097d409640 1 -- 172.21.15.78:0/3344806460 --> [v2:172.21.15.78:6808/3211476654,v1:172.21.15.78:6809/3211476654] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f09780c0f40 con 0x7f095806c810 2023-11-28T20:03:10.213 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:10.208+0000 7f096ffff640 1 -- 172.21.15.78:0/3344806460 <== osd.1 v2:172.21.15.78:6808/3211476654 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f0970009450 con 0x7f095806c810 2023-11-28T20:03:10.213 INFO:teuthology.orchestra.run.smithi078.stdout:{ 2023-11-28T20:03:10.213 INFO:teuthology.orchestra.run.smithi078.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2023-11-28T20:03:10.213 INFO:teuthology.orchestra.run.smithi078.stdout:} 2023-11-28T20:03:10.214 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:10.208+0000 7f097d409640 1 -- 172.21.15.78:0/3344806460 >> [v2:172.21.15.78:6808/3211476654,v1:172.21.15.78:6809/3211476654] conn(0x7f095806c810 msgr2=0x7f095806ec50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:03:10.214 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:10.208+0000 7f097d409640 1 --2- 172.21.15.78:0/3344806460 >> [v2:172.21.15.78:6808/3211476654,v1:172.21.15.78:6809/3211476654] conn(0x7f095806c810 0x7f095806ec50 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:03:10.214 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:10.208+0000 7f097d409640 1 -- 172.21.15.78:0/3344806460 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f0958066470 msgr2=0x7f0958068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:03:10.215 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:10.208+0000 7f097d409640 1 --2- 172.21.15.78:0/3344806460 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f0958066470 0x7f0958068930 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7f097815d360 tx=0x7f0968008040 comp rx=0 tx=0).stop 2023-11-28T20:03:10.215 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:10.208+0000 7f097d409640 1 -- 172.21.15.78:0/3344806460 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f09780c1540 msgr2=0x7f09781f0880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:03:10.215 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:10.208+0000 7f097d409640 1 --2- 172.21.15.78:0/3344806460 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f09780c1540 0x7f09781f0880 secure :-1 s=READY pgs=1153 cs=0 l=1 rev1=1 crypto rx=0x7f096000c500 tx=0x7f096000c9c0 comp rx=0 tx=0).stop 2023-11-28T20:03:10.215 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:10.208+0000 7f09777fe640 1 -- 172.21.15.78:0/3344806460 reap_dead start 2023-11-28T20:03:10.215 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:10.208+0000 7f097d409640 1 -- 172.21.15.78:0/3344806460 shutdown_connections 2023-11-28T20:03:10.215 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:10.208+0000 7f097d409640 1 -- 172.21.15.78:0/3344806460 >> 172.21.15.78:0/3344806460 conn(0x7f09780a7520 msgr2=0x7f09780a7900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:03:10.215 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:10.208+0000 7f097d409640 1 -- 172.21.15.78:0/3344806460 shutdown_connections 2023-11-28T20:03:10.215 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:10.208+0000 7f097d409640 1 -- 172.21.15.78:0/3344806460 wait complete. 2023-11-28T20:03:10.231 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2023-11-28T20:03:10.369 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:10.364+0000 7f3d7a65a640 1 Processor -- start 2023-11-28T20:03:10.369 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:10.364+0000 7f3d7a65a640 1 -- start start 2023-11-28T20:03:10.370 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:10.364+0000 7f3d7a65a640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3d740a5370 0x7f3d7414f870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:03:10.370 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:10.364+0000 7f3d7a65a640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f3d74072810 0x7f3d7414fdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:03:10.370 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:10.364+0000 7f3d7a65a640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3d741524b0 con 0x7f3d740a4f90 2023-11-28T20:03:10.370 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:10.364+0000 7f3d7a65a640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3d740c60d0 con 0x7f3d74072810 2023-11-28T20:03:10.371 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:10.364+0000 7f3d7a65a640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d740c62f0 con 0x7f3d740a5370 2023-11-28T20:03:10.371 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:10.364+0000 7f3d78bf7640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f3d74072810 0x7f3d7414fdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:03:10.371 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:10.364+0000 7f3d73fff640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f3d740a4f90 0x7f3d740c59c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:43000/0 (socket says 172.21.15.78:43000) 2023-11-28T20:03:10.371 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:10.364+0000 7f3d73fff640 1 -- 172.21.15.78:0/1389660334 learned_addr learned my addr 172.21.15.78:0/1389660334 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-11-28T20:03:10.372 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:10.368+0000 7f3d737fe640 1 --2- 172.21.15.78:0/1389660334 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3d740a5370 0x7f3d7414f870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:03:10.372 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:10.368+0000 7f3d78bf7640 1 -- 172.21.15.78:0/1389660334 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3d740a5370 msgr2=0x7f3d7414f870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:03:10.372 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:10.368+0000 7f3d78bf7640 1 --2- 172.21.15.78:0/1389660334 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3d740a5370 0x7f3d7414f870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:03:10.372 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:10.368+0000 7f3d78bf7640 1 -- 172.21.15.78:0/1389660334 >> v1:172.21.15.78:6789/0 conn(0x7f3d740a4f90 legacy=0x7f3d740c59c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:03:10.372 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:10.368+0000 7f3d78bf7640 1 -- 172.21.15.78:0/1389660334 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d74152770 con 0x7f3d74072810 2023-11-28T20:03:10.373 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:10.368+0000 7f3d72ffd640 1 -- 172.21.15.78:0/1389660334 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3726120292 0 0) 0x7f3d741524b0 con 0x7f3d740a4f90 2023-11-28T20:03:10.373 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:10.368+0000 7f3d78bf7640 1 --2- 172.21.15.78:0/1389660334 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3d74072810 0x7f3d7414fdb0 secure :-1 s=READY pgs=1155 cs=0 l=1 rev1=1 crypto rx=0x7f3d6c009d90 tx=0x7f3d6c01c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b0d2edff0cc50b47 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:03:10.374 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:10.368+0000 7f3d72ffd640 1 -- 172.21.15.78:0/1389660334 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d6c0a5780 con 0x7f3d74072810 2023-11-28T20:03:10.374 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:10.368+0000 7f3d72ffd640 1 -- 172.21.15.78:0/1389660334 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d6c0a58e0 con 0x7f3d74072810 2023-11-28T20:03:10.374 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:10.368+0000 7f3d72ffd640 1 -- 172.21.15.78:0/1389660334 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d6c0a5c70 con 0x7f3d74072810 2023-11-28T20:03:10.375 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:10.368+0000 7f3d7a65a640 1 -- 172.21.15.78:0/1389660334 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3d74072810 msgr2=0x7f3d7414fdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:03:10.375 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:10.368+0000 7f3d7a65a640 1 --2- 172.21.15.78:0/1389660334 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3d74072810 0x7f3d7414fdb0 secure :-1 s=READY pgs=1155 cs=0 l=1 rev1=1 crypto rx=0x7f3d6c009d90 tx=0x7f3d6c01c8c0 comp rx=0 tx=0).stop 2023-11-28T20:03:10.375 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:10.372+0000 7f3d7a65a640 1 -- 172.21.15.78:0/1389660334 shutdown_connections 2023-11-28T20:03:10.375 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:10.372+0000 7f3d7a65a640 1 --2- 172.21.15.78:0/1389660334 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3d74072810 0x7f3d7414fdb0 unknown :-1 s=CLOSED pgs=1155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:03:10.375 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:10.372+0000 7f3d7a65a640 1 --2- 172.21.15.78:0/1389660334 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3d740a5370 0x7f3d7414f870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:03:10.376 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:10.372+0000 7f3d7a65a640 1 -- 172.21.15.78:0/1389660334 >> 172.21.15.78:0/1389660334 conn(0x7f3d7406b220 msgr2=0x7f3d740a77e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:03:10.376 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:10.372+0000 7f3d7a65a640 1 -- 172.21.15.78:0/1389660334 shutdown_connections 2023-11-28T20:03:10.376 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:10.372+0000 7f3d7a65a640 1 -- 172.21.15.78:0/1389660334 wait complete. 2023-11-28T20:03:10.376 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:10.372+0000 7f3d7a65a640 1 Processor -- start 2023-11-28T20:03:10.377 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:10.372+0000 7f3d7a65a640 1 -- start start 2023-11-28T20:03:10.378 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:10.372+0000 7f3d7a65a640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3d74072810 0x7f3d7414f860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:03:10.378 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:10.372+0000 7f3d7a65a640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3d740a4f90 0x7f3d741499b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:03:10.379 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:10.372+0000 7f3d7a65a640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3d740a5370 0x7f3d74149ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:03:10.379 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:10.372+0000 7f3d7a65a640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d7414ab70 con 0x7f3d74072810 2023-11-28T20:03:10.379 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:10.372+0000 7f3d7a65a640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d741576c0 con 0x7f3d740a5370 2023-11-28T20:03:10.379 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:10.372+0000 7f3d7a65a640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d74156350 con 0x7f3d740a4f90 2023-11-28T20:03:10.379 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:10.372+0000 7f3d73fff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3d74072810 0x7f3d7414f860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:03:10.379 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:10.372+0000 7f3d73fff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3d74072810 0x7f3d7414f860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:47756/0 (socket says 172.21.15.78:47756) 2023-11-28T20:03:10.379 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:10.372+0000 7f3d73fff640 1 -- 172.21.15.78:0/2366675042 learned_addr learned my addr 172.21.15.78:0/2366675042 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T20:03:10.380 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:10.372+0000 7f3d737fe640 1 --2- 172.21.15.78:0/2366675042 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3d740a4f90 0x7f3d741499b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:03:10.380 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:10.372+0000 7f3d78bf7640 1 --2- 172.21.15.78:0/2366675042 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3d740a5370 0x7f3d74149ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:03:10.380 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:10.372+0000 7f3d73fff640 1 -- 172.21.15.78:0/2366675042 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3d740a4f90 msgr2=0x7f3d741499b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:03:10.380 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:10.372+0000 7f3d73fff640 1 --2- 172.21.15.78:0/2366675042 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3d740a4f90 0x7f3d741499b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:03:10.380 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:10.372+0000 7f3d73fff640 1 -- 172.21.15.78:0/2366675042 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3d740a5370 msgr2=0x7f3d74149ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:03:10.380 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:10.372+0000 7f3d73fff640 1 --2- 172.21.15.78:0/2366675042 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3d740a5370 0x7f3d74149ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:03:10.380 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:10.372+0000 7f3d73fff640 1 -- 172.21.15.78:0/2366675042 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d6c009a70 con 0x7f3d74072810 2023-11-28T20:03:10.381 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:10.372+0000 7f3d737fe640 1 --2- 172.21.15.78:0/2366675042 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3d740a4f90 0x7f3d741499b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T20:03:10.381 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:10.376+0000 7f3d73fff640 1 --2- 172.21.15.78:0/2366675042 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3d74072810 0x7f3d7414f860 secure :-1 s=READY pgs=1156 cs=0 l=1 rev1=1 crypto rx=0x7f3d640011f0 tx=0x7f3d6400c9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:03:10.382 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:10.376+0000 7f3d70ff9640 1 -- 172.21.15.78:0/2366675042 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d640074e0 con 0x7f3d74072810 2023-11-28T20:03:10.382 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:10.376+0000 7f3d70ff9640 1 -- 172.21.15.78:0/2366675042 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d64007640 con 0x7f3d74072810 2023-11-28T20:03:10.382 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:10.376+0000 7f3d70ff9640 1 -- 172.21.15.78:0/2366675042 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d64004a10 con 0x7f3d74072810 2023-11-28T20:03:10.383 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:10.376+0000 7f3d7a65a640 1 -- 172.21.15.78:0/2366675042 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3d741ef130 con 0x7f3d74072810 2023-11-28T20:03:10.383 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:10.376+0000 7f3d7a65a640 1 -- 172.21.15.78:0/2366675042 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3d741eee50 con 0x7f3d74072810 2023-11-28T20:03:10.383 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:10.376+0000 7f3d7a65a640 1 -- 172.21.15.78:0/2366675042 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3d741eec40 con 0x7f3d74072810 2023-11-28T20:03:10.383 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:10.376+0000 7f3d70ff9640 1 -- 172.21.15.78:0/2366675042 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f3d64004b70 con 0x7f3d74072810 2023-11-28T20:03:10.383 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:10.376+0000 7f3d70ff9640 1 --2- 172.21.15.78:0/2366675042 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f3d60066470 0x7f3d60068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:03:10.384 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:10.376+0000 7f3d70ff9640 1 -- 172.21.15.78:0/2366675042 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 5349+0+0 (secure 0 0 0) 0x7f3d64082ff0 con 0x7f3d74072810 2023-11-28T20:03:10.384 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:10.376+0000 7f3d737fe640 1 --2- 172.21.15.78:0/2366675042 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f3d60066470 0x7f3d60068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:03:10.384 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:10.380+0000 7f3d737fe640 1 --2- 172.21.15.78:0/2366675042 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f3d60066470 0x7f3d60068930 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7f3d74150a80 tx=0x7f3d68008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:03:10.388 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:10.384+0000 7f3d70ff9640 1 -- 172.21.15.78:0/2366675042 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f3d640b4280 con 0x7f3d74072810 2023-11-28T20:03:10.539 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:10.536+0000 7f3d7a65a640 1 -- 172.21.15.78:0/2366675042 --> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "1", "target": ["mon-mgr", ""]}) v1 -- 0x7f3d7414afa0 con 0x7f3d60066470 2023-11-28T20:03:10.540 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:10.536+0000 7f3d70ff9640 1 -- 172.21.15.78:0/2366675042 <== mgr.4106 v2:172.21.15.78:6832/2935380957 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 1 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f3d7414afa0 con 0x7f3d60066470 2023-11-28T20:03:10.540 INFO:teuthology.orchestra.run.smithi078.stderr:instructed osd(s) 1 to deep-scrub 2023-11-28T20:03:10.542 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:10.536+0000 7f3d7a65a640 1 -- 172.21.15.78:0/2366675042 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f3d60066470 msgr2=0x7f3d60068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:03:10.542 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:10.536+0000 7f3d7a65a640 1 --2- 172.21.15.78:0/2366675042 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f3d60066470 0x7f3d60068930 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7f3d74150a80 tx=0x7f3d68008040 comp rx=0 tx=0).stop 2023-11-28T20:03:10.542 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:10.536+0000 7f3d7a65a640 1 -- 172.21.15.78:0/2366675042 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3d74072810 msgr2=0x7f3d7414f860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:03:10.542 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:10.536+0000 7f3d7a65a640 1 --2- 172.21.15.78:0/2366675042 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3d74072810 0x7f3d7414f860 secure :-1 s=READY pgs=1156 cs=0 l=1 rev1=1 crypto rx=0x7f3d640011f0 tx=0x7f3d6400c9b0 comp rx=0 tx=0).stop 2023-11-28T20:03:10.542 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:10.536+0000 7f3d7a65a640 1 -- 172.21.15.78:0/2366675042 shutdown_connections 2023-11-28T20:03:10.543 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:10.536+0000 7f3d7a65a640 1 --2- 172.21.15.78:0/2366675042 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f3d60066470 0x7f3d60068930 unknown :-1 s=CLOSED pgs=546 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:03:10.543 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:10.536+0000 7f3d7a65a640 1 --2- 172.21.15.78:0/2366675042 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3d740a4f90 0x7f3d741499b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:03:10.543 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:10.536+0000 7f3d7a65a640 1 --2- 172.21.15.78:0/2366675042 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3d740a5370 0x7f3d74149ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:03:10.543 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:10.536+0000 7f3d7a65a640 1 --2- 172.21.15.78:0/2366675042 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3d74072810 0x7f3d7414f860 unknown :-1 s=CLOSED pgs=1156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:03:10.543 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:10.536+0000 7f3d7a65a640 1 -- 172.21.15.78:0/2366675042 >> 172.21.15.78:0/2366675042 conn(0x7f3d7406b220 msgr2=0x7f3d74151e20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:03:10.543 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:10.536+0000 7f3d7a65a640 1 -- 172.21.15.78:0/2366675042 shutdown_connections 2023-11-28T20:03:10.543 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:10.536+0000 7f3d7a65a640 1 -- 172.21.15.78:0/2366675042 wait complete. 2023-11-28T20:03:10.561 INFO:tasks.ceph:Scrubbing osd.2 2023-11-28T20:03:10.561 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2023-11-28T20:03:10.725 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:10.700+0000 7fcdcbe9e640 1 Processor -- start 2023-11-28T20:03:10.727 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:10.700+0000 7fcdcbe9e640 1 -- start start 2023-11-28T20:03:10.727 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:10.700+0000 7fcdcbe9e640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fcdc414b1e0 0x7fcdc40c1700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:03:10.728 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:10.700+0000 7fcdcbe9e640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcdc40c5300 0x7fcdc40a9c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:03:10.729 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:10.700+0000 7fcdcbe9e640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcdc40a4e20 con 0x7fcdc4151280 2023-11-28T20:03:10.730 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:10.700+0000 7fcdcbe9e640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcdc41558d0 con 0x7fcdc414b1e0 2023-11-28T20:03:10.730 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:10.700+0000 7fcdcbe9e640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcdc40a50e0 con 0x7fcdc40c5300 2023-11-28T20:03:10.731 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:10.700+0000 7fcdc9c3a640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fcdc414b1e0 0x7fcdc40c1700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:03:10.732 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:10.700+0000 7fcdc9c3a640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fcdc414b1e0 0x7fcdc40c1700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:47772/0 (socket says 172.21.15.78:47772) 2023-11-28T20:03:10.732 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:10.700+0000 7fcdc9c3a640 1 -- 172.21.15.78:0/3287890523 learned_addr learned my addr 172.21.15.78:0/3287890523 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T20:03:10.733 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:10.700+0000 7fcdc9439640 1 --2- 172.21.15.78:0/3287890523 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcdc40c5300 0x7fcdc40a9c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:03:10.733 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:10.700+0000 7fcdc9c3a640 1 -- 172.21.15.78:0/3287890523 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcdc40c5300 msgr2=0x7fcdc40a9c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:03:10.734 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:10.700+0000 7fcdc9c3a640 1 --2- 172.21.15.78:0/3287890523 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcdc40c5300 0x7fcdc40a9c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:03:10.735 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:10.700+0000 7fcdc9c3a640 1 -- 172.21.15.78:0/3287890523 >> v1:172.21.15.179:6789/0 conn(0x7fcdc4151280 legacy=0x7fcdc4151710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:03:10.735 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:10.700+0000 7fcdc9c3a640 1 -- 172.21.15.78:0/3287890523 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcdc40c0f00 con 0x7fcdc414b1e0 2023-11-28T20:03:10.736 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:10.704+0000 7fcdc9c3a640 1 --2- 172.21.15.78:0/3287890523 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcdc414b1e0 0x7fcdc40c1700 secure :-1 s=READY pgs=1157 cs=0 l=1 rev1=1 crypto rx=0x7fcdc0009870 tx=0x7fcdc001c540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=80fdb3051bf39e4d server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:03:10.737 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:10.704+0000 7fcdc8c38640 1 -- 172.21.15.78:0/3287890523 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcdc00ab650 con 0x7fcdc414b1e0 2023-11-28T20:03:10.738 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:10.704+0000 7fcdc8c38640 1 -- 172.21.15.78:0/3287890523 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcdc00ab7b0 con 0x7fcdc414b1e0 2023-11-28T20:03:10.738 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:10.704+0000 7fcdc8c38640 1 -- 172.21.15.78:0/3287890523 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcdc00abb40 con 0x7fcdc414b1e0 2023-11-28T20:03:10.739 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:10.704+0000 7fcdcbe9e640 1 -- 172.21.15.78:0/3287890523 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcdc414b1e0 msgr2=0x7fcdc40c1700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:03:10.739 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:10.704+0000 7fcdcbe9e640 1 --2- 172.21.15.78:0/3287890523 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcdc414b1e0 0x7fcdc40c1700 secure :-1 s=READY pgs=1157 cs=0 l=1 rev1=1 crypto rx=0x7fcdc0009870 tx=0x7fcdc001c540 comp rx=0 tx=0).stop 2023-11-28T20:03:10.740 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:10.704+0000 7fcdcbe9e640 1 -- 172.21.15.78:0/3287890523 shutdown_connections 2023-11-28T20:03:10.742 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:10.704+0000 7fcdcbe9e640 1 --2- 172.21.15.78:0/3287890523 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcdc40c5300 0x7fcdc40a9c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:03:10.743 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:10.704+0000 7fcdcbe9e640 1 --2- 172.21.15.78:0/3287890523 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcdc414b1e0 0x7fcdc40c1700 unknown :-1 s=CLOSED pgs=1157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:03:10.743 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:10.704+0000 7fcdcbe9e640 1 -- 172.21.15.78:0/3287890523 >> 172.21.15.78:0/3287890523 conn(0x7fcdc40c59f0 msgr2=0x7fcdc40c5e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:03:10.745 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:10.704+0000 7fcdcbe9e640 1 -- 172.21.15.78:0/3287890523 shutdown_connections 2023-11-28T20:03:10.746 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:10.704+0000 7fcdcbe9e640 1 -- 172.21.15.78:0/3287890523 wait complete. 2023-11-28T20:03:10.746 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:10.708+0000 7fcdcbe9e640 1 Processor -- start 2023-11-28T20:03:10.747 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:10.708+0000 7fcdcbe9e640 1 -- start start 2023-11-28T20:03:10.747 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:10.708+0000 7fcdcbe9e640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcdc40c5300 0x7fcdc41470a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:03:10.748 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:10.708+0000 7fcdcbe9e640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcdc414b1e0 0x7fcdc41435d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:03:10.748 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:10.708+0000 7fcdcbe9e640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcdc4151280 0x7fcdc41495d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:03:10.749 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:10.708+0000 7fcdcbe9e640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcdc4149e40 con 0x7fcdc4151280 2023-11-28T20:03:10.750 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:10.708+0000 7fcdcbe9e640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcdc41462e0 con 0x7fcdc414b1e0 2023-11-28T20:03:10.750 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:10.708+0000 7fcdcbe9e640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcdc41465c0 con 0x7fcdc40c5300 2023-11-28T20:03:10.750 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:10.708+0000 7fcdca43b640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcdc4151280 0x7fcdc41495d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:03:10.751 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:10.708+0000 7fcdca43b640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcdc4151280 0x7fcdc41495d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:47776/0 (socket says 172.21.15.78:47776) 2023-11-28T20:03:10.751 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:10.708+0000 7fcdc9c3a640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcdc40c5300 0x7fcdc41470a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:03:10.751 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:10.708+0000 7fcdca43b640 1 -- 172.21.15.78:0/4141569808 learned_addr learned my addr 172.21.15.78:0/4141569808 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T20:03:10.751 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:10.708+0000 7fcdc9439640 1 --2- 172.21.15.78:0/4141569808 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcdc414b1e0 0x7fcdc41435d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:03:10.751 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:10.708+0000 7fcdca43b640 1 -- 172.21.15.78:0/4141569808 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcdc40c5300 msgr2=0x7fcdc41470a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:03:10.752 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:10.708+0000 7fcdca43b640 1 --2- 172.21.15.78:0/4141569808 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcdc40c5300 0x7fcdc41470a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:03:10.752 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:10.708+0000 7fcdca43b640 1 -- 172.21.15.78:0/4141569808 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcdc414b1e0 msgr2=0x7fcdc41435d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:03:10.752 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:10.708+0000 7fcdca43b640 1 --2- 172.21.15.78:0/4141569808 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcdc414b1e0 0x7fcdc41435d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:03:10.752 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:10.708+0000 7fcdca43b640 1 -- 172.21.15.78:0/4141569808 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcdc00094d0 con 0x7fcdc4151280 2023-11-28T20:03:10.752 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:10.708+0000 7fcdca43b640 1 --2- 172.21.15.78:0/4141569808 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcdc4151280 0x7fcdc41495d0 secure :-1 s=READY pgs=1158 cs=0 l=1 rev1=1 crypto rx=0x7fcdbc00c730 tx=0x7fcdbc00cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:03:10.752 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:10.708+0000 7fcdba7fc640 1 -- 172.21.15.78:0/4141569808 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcdbc003ba0 con 0x7fcdc4151280 2023-11-28T20:03:10.752 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:10.708+0000 7fcdba7fc640 1 -- 172.21.15.78:0/4141569808 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcdbc003d00 con 0x7fcdc4151280 2023-11-28T20:03:10.753 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:10.708+0000 7fcdba7fc640 1 -- 172.21.15.78:0/4141569808 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcdbc005310 con 0x7fcdc4151280 2023-11-28T20:03:10.753 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:10.708+0000 7fcdcbe9e640 1 -- 172.21.15.78:0/4141569808 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcdc41468a0 con 0x7fcdc4151280 2023-11-28T20:03:10.753 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:10.708+0000 7fcdcbe9e640 1 -- 172.21.15.78:0/4141569808 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcdc40ab480 con 0x7fcdc4151280 2023-11-28T20:03:10.753 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:10.708+0000 7fcdcbe9e640 1 -- 172.21.15.78:0/4141569808 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fcdc40c4180 con 0x7fcdc4151280 2023-11-28T20:03:10.753 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:10.712+0000 7fcdba7fc640 1 -- 172.21.15.78:0/4141569808 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fcdbc005680 con 0x7fcdc4151280 2023-11-28T20:03:10.753 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:10.712+0000 7fcdba7fc640 1 --2- 172.21.15.78:0/4141569808 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fcda80664a0 0x7fcda8068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:03:10.753 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:10.712+0000 7fcdba7fc640 1 -- 172.21.15.78:0/4141569808 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 5349+0+0 (secure 0 0 0) 0x7fcdbc083b00 con 0x7fcdc4151280 2023-11-28T20:03:10.754 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:10.712+0000 7fcdc9c3a640 1 --2- 172.21.15.78:0/4141569808 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fcda80664a0 0x7fcda8068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:03:10.754 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:10.712+0000 7fcdba7fc640 1 --2- 172.21.15.78:0/4141569808 >> [v2:172.21.15.78:6816/2532904479,v1:172.21.15.78:6817/2532904479] conn(0x7fcda806c840 0x7fcda806ec80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:03:10.754 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:10.712+0000 7fcdba7fc640 1 -- 172.21.15.78:0/4141569808 --> [v2:172.21.15.78:6816/2532904479,v1:172.21.15.78:6817/2532904479] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fcda806f350 con 0x7fcda806c840 2023-11-28T20:03:10.754 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:10.712+0000 7fcdba7fc640 1 -- 172.21.15.78:0/4141569808 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_get_version_reply(handle=1 version=93) v2 ==== 24+0+0 (secure 0 0 0) 0x7fcdbc0882a0 con 0x7fcdc4151280 2023-11-28T20:03:10.754 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:10.712+0000 7fcdc9439640 1 --2- 172.21.15.78:0/4141569808 >> [v2:172.21.15.78:6816/2532904479,v1:172.21.15.78:6817/2532904479] conn(0x7fcda806c840 0x7fcda806ec80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:03:10.754 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:10.712+0000 7fcdc9c3a640 1 --2- 172.21.15.78:0/4141569808 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fcda80664a0 0x7fcda8068960 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7fcdc00af000 tx=0x7fcdc00b6040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:03:10.754 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:10.712+0000 7fcdc9439640 1 --2- 172.21.15.78:0/4141569808 >> [v2:172.21.15.78:6816/2532904479,v1:172.21.15.78:6817/2532904479] conn(0x7fcda806c840 0x7fcda806ec80 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:03:10.755 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:10.712+0000 7fcdba7fc640 1 -- 172.21.15.78:0/4141569808 <== osd.2 v2:172.21.15.78:6816/2532904479 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7fcda806f350 con 0x7fcda806c840 2023-11-28T20:03:10.755 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:10.724+0000 7fcdcbe9e640 1 -- 172.21.15.78:0/4141569808 --> [v2:172.21.15.78:6816/2532904479,v1:172.21.15.78:6817/2532904479] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fcdc4067630 con 0x7fcda806c840 2023-11-28T20:03:10.755 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:10.728+0000 7fcdba7fc640 1 -- 172.21.15.78:0/4141569808 <== osd.2 v2:172.21.15.78:6816/2532904479 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7fcdc4067630 con 0x7fcda806c840 2023-11-28T20:03:10.756 INFO:teuthology.orchestra.run.smithi078.stdout:{ 2023-11-28T20:03:10.756 INFO:teuthology.orchestra.run.smithi078.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2023-11-28T20:03:10.756 INFO:teuthology.orchestra.run.smithi078.stdout:} 2023-11-28T20:03:10.757 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:10.728+0000 7fcdcbe9e640 1 -- 172.21.15.78:0/4141569808 >> [v2:172.21.15.78:6816/2532904479,v1:172.21.15.78:6817/2532904479] conn(0x7fcda806c840 msgr2=0x7fcda806ec80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:03:10.758 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:10.728+0000 7fcdcbe9e640 1 --2- 172.21.15.78:0/4141569808 >> [v2:172.21.15.78:6816/2532904479,v1:172.21.15.78:6817/2532904479] conn(0x7fcda806c840 0x7fcda806ec80 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:03:10.758 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:10.728+0000 7fcdcbe9e640 1 -- 172.21.15.78:0/4141569808 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fcda80664a0 msgr2=0x7fcda8068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:03:10.758 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:10.728+0000 7fcdcbe9e640 1 --2- 172.21.15.78:0/4141569808 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fcda80664a0 0x7fcda8068960 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7fcdc00af000 tx=0x7fcdc00b6040 comp rx=0 tx=0).stop 2023-11-28T20:03:10.758 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:10.728+0000 7fcdcbe9e640 1 -- 172.21.15.78:0/4141569808 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcdc4151280 msgr2=0x7fcdc41495d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:03:10.758 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:10.728+0000 7fcdcbe9e640 1 --2- 172.21.15.78:0/4141569808 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcdc4151280 0x7fcdc41495d0 secure :-1 s=READY pgs=1158 cs=0 l=1 rev1=1 crypto rx=0x7fcdbc00c730 tx=0x7fcdbc00cbf0 comp rx=0 tx=0).stop 2023-11-28T20:03:10.759 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:10.728+0000 7fcdca43b640 1 -- 172.21.15.78:0/4141569808 reap_dead start 2023-11-28T20:03:10.759 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:10.728+0000 7fcdcbe9e640 1 -- 172.21.15.78:0/4141569808 shutdown_connections 2023-11-28T20:03:10.759 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:10.728+0000 7fcdcbe9e640 1 -- 172.21.15.78:0/4141569808 >> 172.21.15.78:0/4141569808 conn(0x7fcdc40c59f0 msgr2=0x7fcdc40bed60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:03:10.759 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:10.728+0000 7fcdcbe9e640 1 -- 172.21.15.78:0/4141569808 shutdown_connections 2023-11-28T20:03:10.759 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:10.728+0000 7fcdcbe9e640 1 -- 172.21.15.78:0/4141569808 wait complete. 2023-11-28T20:03:10.760 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2023-11-28T20:03:10.898 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:10.892+0000 7f93b3417640 1 Processor -- start 2023-11-28T20:03:10.899 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:10.896+0000 7f93b3417640 1 -- start start 2023-11-28T20:03:10.900 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:10.896+0000 7f93b3417640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f93ac0c2110 0x7f93ac0c5ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:03:10.900 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:10.896+0000 7f93b3417640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f93ac0a93d0 con 0x7f93ac0c0c80 2023-11-28T20:03:10.900 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:10.896+0000 7f93b3417640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f93ac0a9640 con 0x7f93ac154390 2023-11-28T20:03:10.900 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:10.896+0000 7f93b3417640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f93ac0aa1c0 con 0x7f93ac0c2110 2023-11-28T20:03:10.900 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:10.896+0000 7f93b19b4640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f93ac0c0c80 0x7f93ac0c61e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:43008/0 (socket says 172.21.15.78:43008) 2023-11-28T20:03:10.900 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:10.896+0000 7f93b19b4640 1 -- 172.21.15.78:0/1712455451 learned_addr learned my addr 172.21.15.78:0/1712455451 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-11-28T20:03:10.902 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:10.896+0000 7f93b09b2640 1 --2- 172.21.15.78:0/1712455451 >> v2:172.21.15.179:3300/0 conn(0x7f93ac0c2110 0x7f93ac0c5ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:03:10.902 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:10.896+0000 7f93a3fff640 1 -- 172.21.15.78:0/1712455451 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 806241660 0 0) 0x7f93ac0a93d0 con 0x7f93ac0c0c80 2023-11-28T20:03:10.903 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:10.896+0000 7f93a3fff640 1 -- 172.21.15.78:0/1712455451 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9398003530 con 0x7f93ac0c0c80 2023-11-28T20:03:10.903 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:10.896+0000 7f93a3fff640 1 -- 172.21.15.78:0/1712455451 <== mon.0 v1:172.21.15.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2559862093 0 0) 0x7f9398003530 con 0x7f93ac0c0c80 2023-11-28T20:03:10.903 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:10.896+0000 7f93a3fff640 1 -- 172.21.15.78:0/1712455451 >> v2:172.21.15.179:3300/0 conn(0x7f93ac0c2110 msgr2=0x7f93ac0c5ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:03:10.903 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:10.896+0000 7f93a3fff640 1 --2- 172.21.15.78:0/1712455451 >> v2:172.21.15.179:3300/0 conn(0x7f93ac0c2110 0x7f93ac0c5ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:03:10.903 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:10.896+0000 7f93a3fff640 1 -- 172.21.15.78:0/1712455451 >> v1:172.21.15.179:6789/0 conn(0x7f93ac154390 legacy=0x7f93ac0c4a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:03:10.903 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:10.896+0000 7f93a3fff640 1 -- 172.21.15.78:0/1712455451 --> v1:172.21.15.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93ac0a9920 con 0x7f93ac0c0c80 2023-11-28T20:03:10.903 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:10.896+0000 7f93a3fff640 1 -- 172.21.15.78:0/1712455451 <== mon.0 v1:172.21.15.78:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3326804700 0 0) 0x7f93a4001a00 con 0x7f93ac0c0c80 2023-11-28T20:03:10.903 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:10.896+0000 7f93a3fff640 1 -- 172.21.15.78:0/1712455451 >> v1:172.21.15.78:6789/0 conn(0x7f93ac0c0c80 legacy=0x7f93ac0c61e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:03:10.904 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:10.896+0000 7f93a3fff640 1 --2- 172.21.15.78:0/1712455451 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9398003980 0x7f9398003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:03:10.904 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:10.896+0000 7f93a3fff640 1 --2- 172.21.15.78:0/1712455451 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f93980047d0 0x7f9398004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:03:10.904 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:10.896+0000 7f93a3fff640 1 --2- 172.21.15.78:0/1712455451 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9398005190 0x7f939800b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:03:10.904 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:10.896+0000 7f93a3fff640 1 -- 172.21.15.78:0/1712455451 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93ac0aa1c0 con 0x7f9398003980 2023-11-28T20:03:10.904 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:10.896+0000 7f93a3fff640 1 -- 172.21.15.78:0/1712455451 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f939800c030 con 0x7f9398005190 2023-11-28T20:03:10.904 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:10.896+0000 7f93a3fff640 1 -- 172.21.15.78:0/1712455451 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f939800e400 con 0x7f93980047d0 2023-11-28T20:03:10.904 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:10.896+0000 7f93b11b3640 1 --2- 172.21.15.78:0/1712455451 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9398003980 0x7f9398003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:03:10.905 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:10.896+0000 7f93b19b4640 1 --2- 172.21.15.78:0/1712455451 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9398005190 0x7f939800b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:03:10.905 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:10.896+0000 7f93b09b2640 1 --2- 172.21.15.78:0/1712455451 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f93980047d0 0x7f9398004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:03:10.905 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:10.896+0000 7f93b11b3640 1 -- 172.21.15.78:0/1712455451 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f93980047d0 msgr2=0x7f9398004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:03:10.905 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:10.896+0000 7f93b11b3640 1 --2- 172.21.15.78:0/1712455451 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f93980047d0 0x7f9398004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:03:10.905 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:10.896+0000 7f93b11b3640 1 -- 172.21.15.78:0/1712455451 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9398005190 msgr2=0x7f939800b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:03:10.905 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:10.896+0000 7f93b11b3640 1 --2- 172.21.15.78:0/1712455451 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9398005190 0x7f939800b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:03:10.905 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:10.896+0000 7f93b11b3640 1 -- 172.21.15.78:0/1712455451 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9398003530 con 0x7f9398003980 2023-11-28T20:03:10.905 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:10.896+0000 7f93b19b4640 1 --2- 172.21.15.78:0/1712455451 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9398005190 0x7f939800b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T20:03:10.906 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:10.896+0000 7f93b09b2640 1 --2- 172.21.15.78:0/1712455451 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f93980047d0 0x7f9398004c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T20:03:10.906 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:10.896+0000 7f93b19b4640 1 -- 172.21.15.78:0/1712455451 reap_dead start 2023-11-28T20:03:10.907 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:10.900+0000 7f93b11b3640 1 --2- 172.21.15.78:0/1712455451 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9398003980 0x7f9398003da0 secure :-1 s=READY pgs=1160 cs=0 l=1 rev1=1 crypto rx=0x7f93a8001780 tx=0x7f93a801c3e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bd32da92368ef51c server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:03:10.908 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:10.900+0000 7f93a3fff640 1 -- 172.21.15.78:0/1712455451 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93a80a4ea0 con 0x7f9398003980 2023-11-28T20:03:10.908 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:10.900+0000 7f93a3fff640 1 -- 172.21.15.78:0/1712455451 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f93a80a7050 con 0x7f9398003980 2023-11-28T20:03:10.908 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:10.900+0000 7f93a3fff640 1 -- 172.21.15.78:0/1712455451 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93a8003600 con 0x7f9398003980 2023-11-28T20:03:10.909 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:10.900+0000 7f93b3417640 1 -- 172.21.15.78:0/1712455451 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9398003980 msgr2=0x7f9398003da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:03:10.909 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:10.900+0000 7f93b3417640 1 --2- 172.21.15.78:0/1712455451 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9398003980 0x7f9398003da0 secure :-1 s=READY pgs=1160 cs=0 l=1 rev1=1 crypto rx=0x7f93a8001780 tx=0x7f93a801c3e0 comp rx=0 tx=0).stop 2023-11-28T20:03:10.909 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:10.900+0000 7f93b3417640 1 -- 172.21.15.78:0/1712455451 shutdown_connections 2023-11-28T20:03:10.909 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:10.900+0000 7f93b3417640 1 --2- 172.21.15.78:0/1712455451 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9398003980 0x7f9398003da0 unknown :-1 s=CLOSED pgs=1160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:03:10.909 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:10.900+0000 7f93b3417640 1 -- 172.21.15.78:0/1712455451 >> 172.21.15.78:0/1712455451 conn(0x7f93ac06b220 msgr2=0x7f93ac0a77e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:03:10.909 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:10.900+0000 7f93b3417640 1 -- 172.21.15.78:0/1712455451 shutdown_connections 2023-11-28T20:03:10.909 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:10.900+0000 7f93b3417640 1 -- 172.21.15.78:0/1712455451 wait complete. 2023-11-28T20:03:10.909 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:10.904+0000 7f93b3417640 1 Processor -- start 2023-11-28T20:03:10.910 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:10.904+0000 7f93b3417640 1 -- start start 2023-11-28T20:03:10.911 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:10.904+0000 7f93b3417640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9398003980 0x7f93ac1457d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:03:10.912 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:10.904+0000 7f93b3417640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f93ac1f13c0 0x7f93ac0bee60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:03:10.912 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:10.904+0000 7f93b3417640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f93ac146040 0x7f93ac1ed210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:03:10.912 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:10.904+0000 7f93b3417640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93ac1f0f30 con 0x7f93ac146040 2023-11-28T20:03:10.912 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:10.904+0000 7f93b3417640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93ac1f0920 con 0x7f93ac1f13c0 2023-11-28T20:03:10.912 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:10.904+0000 7f93b3417640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f93ac147240 con 0x7f9398003980 2023-11-28T20:03:10.912 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:10.904+0000 7f93b19b4640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f93ac146040 0x7f93ac1ed210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:03:10.912 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:10.904+0000 7f93b19b4640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f93ac146040 0x7f93ac1ed210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:47800/0 (socket says 172.21.15.78:47800) 2023-11-28T20:03:10.913 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:10.904+0000 7f93b19b4640 1 -- 172.21.15.78:0/3287110213 learned_addr learned my addr 172.21.15.78:0/3287110213 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T20:03:10.913 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:10.904+0000 7f93b11b3640 1 --2- 172.21.15.78:0/3287110213 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9398003980 0x7f93ac1457d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:03:10.913 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:10.904+0000 7f93b09b2640 1 --2- 172.21.15.78:0/3287110213 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f93ac1f13c0 0x7f93ac0bee60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:03:10.913 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:10.904+0000 7f93b19b4640 1 -- 172.21.15.78:0/3287110213 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9398003980 msgr2=0x7f93ac1457d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:03:10.913 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:10.904+0000 7f93b19b4640 1 --2- 172.21.15.78:0/3287110213 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9398003980 0x7f93ac1457d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:03:10.913 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:10.904+0000 7f93b19b4640 1 -- 172.21.15.78:0/3287110213 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f93ac1f13c0 msgr2=0x7f93ac0bee60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:03:10.913 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:10.904+0000 7f93b19b4640 1 --2- 172.21.15.78:0/3287110213 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f93ac1f13c0 0x7f93ac0bee60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:03:10.913 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:10.904+0000 7f93b19b4640 1 -- 172.21.15.78:0/3287110213 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93ac146f60 con 0x7f93ac146040 2023-11-28T20:03:10.914 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:10.904+0000 7f93b19b4640 1 --2- 172.21.15.78:0/3287110213 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f93ac146040 0x7f93ac1ed210 secure :-1 s=READY pgs=1161 cs=0 l=1 rev1=1 crypto rx=0x7f93ac06d700 tx=0x7f93a4007bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:03:10.914 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:10.904+0000 7f93a1ffb640 1 -- 172.21.15.78:0/3287110213 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93a400ea80 con 0x7f93ac146040 2023-11-28T20:03:10.914 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:10.904+0000 7f93a1ffb640 1 -- 172.21.15.78:0/3287110213 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f93a400ebe0 con 0x7f93ac146040 2023-11-28T20:03:10.914 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:10.904+0000 7f93a1ffb640 1 -- 172.21.15.78:0/3287110213 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93a4013420 con 0x7f93ac146040 2023-11-28T20:03:10.914 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:10.904+0000 7f93b3417640 1 -- 172.21.15.78:0/3287110213 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f93ac1f0bc0 con 0x7f93ac146040 2023-11-28T20:03:10.914 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:10.904+0000 7f93b3417640 1 -- 172.21.15.78:0/3287110213 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f93ac06fc00 con 0x7f93ac146040 2023-11-28T20:03:10.914 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:10.908+0000 7f93b3417640 1 -- 172.21.15.78:0/3287110213 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f93ac1f0780 con 0x7f93ac146040 2023-11-28T20:03:10.915 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:10.908+0000 7f93a1ffb640 1 -- 172.21.15.78:0/3287110213 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f93a4013580 con 0x7f93ac146040 2023-11-28T20:03:10.915 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:10.908+0000 7f93a1ffb640 1 --2- 172.21.15.78:0/3287110213 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f93900664a0 0x7f9390068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:03:10.915 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:10.908+0000 7f93a1ffb640 1 -- 172.21.15.78:0/3287110213 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 5349+0+0 (secure 0 0 0) 0x7f93a4084120 con 0x7f93ac146040 2023-11-28T20:03:10.916 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:10.908+0000 7f93b11b3640 1 --2- 172.21.15.78:0/3287110213 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f93900664a0 0x7f9390068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:03:10.916 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:10.908+0000 7f93b11b3640 1 --2- 172.21.15.78:0/3287110213 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f93900664a0 0x7f9390068960 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7f93a8001750 tx=0x7f93a80011a0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:03:10.916 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:10.912+0000 7f93a1ffb640 1 -- 172.21.15.78:0/3287110213 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f93ac1f0780 con 0x7f93ac146040 2023-11-28T20:03:11.067 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:11.060+0000 7f93b3417640 1 -- 172.21.15.78:0/3287110213 --> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "2", "target": ["mon-mgr", ""]}) v1 -- 0x7f93ac1f0780 con 0x7f93900664a0 2023-11-28T20:03:11.067 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:11.064+0000 7f93a1ffb640 1 -- 172.21.15.78:0/3287110213 <== mgr.4106 v2:172.21.15.78:6832/2935380957 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 2 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f93ac1f0780 con 0x7f93900664a0 2023-11-28T20:03:11.068 INFO:teuthology.orchestra.run.smithi078.stderr:instructed osd(s) 2 to deep-scrub 2023-11-28T20:03:11.069 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:11.064+0000 7f93b3417640 1 -- 172.21.15.78:0/3287110213 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f93900664a0 msgr2=0x7f9390068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:03:11.069 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:11.064+0000 7f93b3417640 1 --2- 172.21.15.78:0/3287110213 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f93900664a0 0x7f9390068960 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7f93a8001750 tx=0x7f93a80011a0 comp rx=0 tx=0).stop 2023-11-28T20:03:11.070 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:11.064+0000 7f93b3417640 1 -- 172.21.15.78:0/3287110213 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f93ac146040 msgr2=0x7f93ac1ed210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:03:11.070 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:11.064+0000 7f93b3417640 1 --2- 172.21.15.78:0/3287110213 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f93ac146040 0x7f93ac1ed210 secure :-1 s=READY pgs=1161 cs=0 l=1 rev1=1 crypto rx=0x7f93ac06d700 tx=0x7f93a4007bc0 comp rx=0 tx=0).stop 2023-11-28T20:03:11.070 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:11.064+0000 7f93b3417640 1 -- 172.21.15.78:0/3287110213 shutdown_connections 2023-11-28T20:03:11.070 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:11.064+0000 7f93b3417640 1 --2- 172.21.15.78:0/3287110213 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f93900664a0 0x7f9390068960 unknown :-1 s=CLOSED pgs=548 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:03:11.070 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:11.064+0000 7f93b3417640 1 --2- 172.21.15.78:0/3287110213 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f93ac146040 0x7f93ac1ed210 unknown :-1 s=CLOSED pgs=1161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:03:11.071 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:11.064+0000 7f93b3417640 1 --2- 172.21.15.78:0/3287110213 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f93ac1f13c0 0x7f93ac0bee60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:03:11.071 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:11.064+0000 7f93b3417640 1 --2- 172.21.15.78:0/3287110213 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9398003980 0x7f93ac1457d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:03:11.071 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:11.064+0000 7f93b3417640 1 -- 172.21.15.78:0/3287110213 >> 172.21.15.78:0/3287110213 conn(0x7f93ac06b220 msgr2=0x7f93ac06c920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:03:11.071 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:11.064+0000 7f93b3417640 1 -- 172.21.15.78:0/3287110213 shutdown_connections 2023-11-28T20:03:11.071 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:11.064+0000 7f93b3417640 1 -- 172.21.15.78:0/3287110213 wait complete. 2023-11-28T20:03:11.087 INFO:tasks.ceph:Scrubbing osd.3 2023-11-28T20:03:11.088 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2023-11-28T20:03:11.229 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:11.224+0000 7fd72e1f8640 1 Processor -- start 2023-11-28T20:03:11.229 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:11.224+0000 7fd72e1f8640 1 -- start start 2023-11-28T20:03:11.231 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:11.224+0000 7fd72e1f8640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fd72814f850 0x7fd7280aacf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:03:11.231 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:11.224+0000 7fd72e1f8640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd72814fc30 0x7fd7280c3cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:03:11.231 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:11.224+0000 7fd72e1f8640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd728152910 con 0x7fd72806d840 2023-11-28T20:03:11.231 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:11.224+0000 7fd72e1f8640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd7280c2240 con 0x7fd72814f850 2023-11-28T20:03:11.231 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:11.224+0000 7fd72e1f8640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd728152bf0 con 0x7fd72814fc30 2023-11-28T20:03:11.232 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:11.228+0000 7fd7277fe640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fd72814f850 0x7fd7280aacf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:03:11.232 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:11.228+0000 7fd7277fe640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fd72814f850 0x7fd7280aacf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:47808/0 (socket says 172.21.15.78:47808) 2023-11-28T20:03:11.232 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:11.228+0000 7fd7277fe640 1 -- 172.21.15.78:0/4138474398 learned_addr learned my addr 172.21.15.78:0/4138474398 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T20:03:11.232 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:11.228+0000 7fd726ffd640 1 --2- 172.21.15.78:0/4138474398 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd72814fc30 0x7fd7280c3cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:03:11.232 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:11.228+0000 7fd7277fe640 1 -- 172.21.15.78:0/4138474398 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd72814fc30 msgr2=0x7fd7280c3cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:03:11.232 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:11.228+0000 7fd7277fe640 1 --2- 172.21.15.78:0/4138474398 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd72814fc30 0x7fd7280c3cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:03:11.232 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:11.228+0000 7fd7277fe640 1 -- 172.21.15.78:0/4138474398 >> v1:172.21.15.179:6789/0 conn(0x7fd72806d840 legacy=0x7fd7280c4210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:03:11.232 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:11.228+0000 7fd7277fe640 1 -- 172.21.15.78:0/4138474398 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd728152ed0 con 0x7fd72814f850 2023-11-28T20:03:11.233 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:11.228+0000 7fd726ffd640 1 --2- 172.21.15.78:0/4138474398 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd72814fc30 0x7fd7280c3cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T20:03:11.234 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:11.228+0000 7fd7277fe640 1 --2- 172.21.15.78:0/4138474398 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd72814f850 0x7fd7280aacf0 secure :-1 s=READY pgs=1162 cs=0 l=1 rev1=1 crypto rx=0x7fd718009870 tx=0x7fd71801c540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=851dec1aca7a233f server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:03:11.235 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:11.228+0000 7fd7267fc640 1 -- 172.21.15.78:0/4138474398 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7180a9620 con 0x7fd72814f850 2023-11-28T20:03:11.236 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:11.228+0000 7fd7267fc640 1 -- 172.21.15.78:0/4138474398 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd7180a9780 con 0x7fd72814f850 2023-11-28T20:03:11.236 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:11.228+0000 7fd7267fc640 1 -- 172.21.15.78:0/4138474398 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7180a9b10 con 0x7fd72814f850 2023-11-28T20:03:11.236 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:11.232+0000 7fd72e1f8640 1 -- 172.21.15.78:0/4138474398 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd72814f850 msgr2=0x7fd7280aacf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:03:11.237 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:11.232+0000 7fd72e1f8640 1 --2- 172.21.15.78:0/4138474398 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd72814f850 0x7fd7280aacf0 secure :-1 s=READY pgs=1162 cs=0 l=1 rev1=1 crypto rx=0x7fd718009870 tx=0x7fd71801c540 comp rx=0 tx=0).stop 2023-11-28T20:03:11.237 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:11.232+0000 7fd72e1f8640 1 -- 172.21.15.78:0/4138474398 shutdown_connections 2023-11-28T20:03:11.237 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:11.232+0000 7fd72e1f8640 1 --2- 172.21.15.78:0/4138474398 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd72814fc30 0x7fd7280c3cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:03:11.237 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:11.232+0000 7fd72e1f8640 1 --2- 172.21.15.78:0/4138474398 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd72814f850 0x7fd7280aacf0 unknown :-1 s=CLOSED pgs=1162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:03:11.238 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:11.232+0000 7fd72e1f8640 1 -- 172.21.15.78:0/4138474398 >> 172.21.15.78:0/4138474398 conn(0x7fd7280c59f0 msgr2=0x7fd7280c5e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:03:11.238 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:11.232+0000 7fd72e1f8640 1 -- 172.21.15.78:0/4138474398 shutdown_connections 2023-11-28T20:03:11.238 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:11.232+0000 7fd72e1f8640 1 -- 172.21.15.78:0/4138474398 wait complete. 2023-11-28T20:03:11.240 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:11.232+0000 7fd72e1f8640 1 Processor -- start 2023-11-28T20:03:11.240 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:11.232+0000 7fd72e1f8640 1 -- start start 2023-11-28T20:03:11.241 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:11.232+0000 7fd72e1f8640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd72806d840 0x7fd7281f0b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:03:11.241 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:11.232+0000 7fd72e1f8640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd72814f850 0x7fd72814ae10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:03:11.241 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:11.232+0000 7fd72e1f8640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd72814fc30 0x7fd7280a98b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:03:11.241 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:11.232+0000 7fd72e1f8640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7281f13d0 con 0x7fd72814f850 2023-11-28T20:03:11.241 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:11.232+0000 7fd72e1f8640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd728154200 con 0x7fd72806d840 2023-11-28T20:03:11.242 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:11.232+0000 7fd72e1f8640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd7281f1670 con 0x7fd72814fc30 2023-11-28T20:03:11.242 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:11.232+0000 7fd726ffd640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd72814f850 0x7fd72814ae10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:03:11.242 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:11.232+0000 7fd726ffd640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd72814f850 0x7fd72814ae10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:47824/0 (socket says 172.21.15.78:47824) 2023-11-28T20:03:11.242 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:11.232+0000 7fd726ffd640 1 -- 172.21.15.78:0/3928654495 learned_addr learned my addr 172.21.15.78:0/3928654495 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T20:03:11.242 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:11.232+0000 7fd7277fe640 1 --2- 172.21.15.78:0/3928654495 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd72806d840 0x7fd7281f0b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:03:11.242 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:11.232+0000 7fd727fff640 1 --2- 172.21.15.78:0/3928654495 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd72814fc30 0x7fd7280a98b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:03:11.242 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:11.236+0000 7fd726ffd640 1 -- 172.21.15.78:0/3928654495 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd72814fc30 msgr2=0x7fd7280a98b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:03:11.242 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:11.236+0000 7fd726ffd640 1 --2- 172.21.15.78:0/3928654495 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd72814fc30 0x7fd7280a98b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:03:11.243 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:11.236+0000 7fd726ffd640 1 -- 172.21.15.78:0/3928654495 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd72806d840 msgr2=0x7fd7281f0b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:03:11.243 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:11.236+0000 7fd726ffd640 1 --2- 172.21.15.78:0/3928654495 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd72806d840 0x7fd7281f0b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:03:11.243 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:11.236+0000 7fd726ffd640 1 -- 172.21.15.78:0/3928654495 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7180094d0 con 0x7fd72814f850 2023-11-28T20:03:11.243 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:11.236+0000 7fd727fff640 1 --2- 172.21.15.78:0/3928654495 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd72814fc30 0x7fd7280a98b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T20:03:11.243 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:11.236+0000 7fd726ffd640 1 --2- 172.21.15.78:0/3928654495 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd72814f850 0x7fd72814ae10 secure :-1 s=READY pgs=1163 cs=0 l=1 rev1=1 crypto rx=0x7fd71c00d800 tx=0x7fd71c00dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:03:11.243 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:11.236+0000 7fd70ffff640 1 -- 172.21.15.78:0/3928654495 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd71c0096c0 con 0x7fd72814f850 2023-11-28T20:03:11.243 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:11.236+0000 7fd70ffff640 1 -- 172.21.15.78:0/3928654495 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd71c009820 con 0x7fd72814f850 2023-11-28T20:03:11.244 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:11.236+0000 7fd70ffff640 1 -- 172.21.15.78:0/3928654495 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd71c009bd0 con 0x7fd72814f850 2023-11-28T20:03:11.244 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:11.236+0000 7fd72e1f8640 1 -- 172.21.15.78:0/3928654495 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd7281544e0 con 0x7fd72814f850 2023-11-28T20:03:11.244 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:11.236+0000 7fd72e1f8640 1 -- 172.21.15.78:0/3928654495 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd728150330 con 0x7fd72814f850 2023-11-28T20:03:11.244 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:11.236+0000 7fd72e1f8640 1 -- 172.21.15.78:0/3928654495 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fd7281526d0 con 0x7fd72814f850 2023-11-28T20:03:11.245 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:11.236+0000 7fd70ffff640 1 -- 172.21.15.78:0/3928654495 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fd71c009d30 con 0x7fd72814f850 2023-11-28T20:03:11.245 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:11.236+0000 7fd70ffff640 1 --2- 172.21.15.78:0/3928654495 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fd714066470 0x7fd714068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:03:11.246 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:11.236+0000 7fd70ffff640 1 -- 172.21.15.78:0/3928654495 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 5349+0+0 (secure 0 0 0) 0x7fd71c084400 con 0x7fd72814f850 2023-11-28T20:03:11.246 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:11.240+0000 7fd7277fe640 1 --2- 172.21.15.78:0/3928654495 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fd714066470 0x7fd714068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:03:11.246 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:11.240+0000 7fd70ffff640 1 --2- 172.21.15.78:0/3928654495 >> [v2:172.21.15.78:6824/3442991267,v1:172.21.15.78:6825/3442991267] conn(0x7fd71406c810 0x7fd71406ec50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:03:11.246 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:11.240+0000 7fd70ffff640 1 -- 172.21.15.78:0/3928654495 --> [v2:172.21.15.78:6824/3442991267,v1:172.21.15.78:6825/3442991267] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fd71406f320 con 0x7fd71406c810 2023-11-28T20:03:11.246 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:11.240+0000 7fd70ffff640 1 -- 172.21.15.78:0/3928654495 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_get_version_reply(handle=1 version=93) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd71c0869e0 con 0x7fd72814f850 2023-11-28T20:03:11.246 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:11.240+0000 7fd727fff640 1 --2- 172.21.15.78:0/3928654495 >> [v2:172.21.15.78:6824/3442991267,v1:172.21.15.78:6825/3442991267] conn(0x7fd71406c810 0x7fd71406ec50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:03:11.246 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:11.240+0000 7fd7277fe640 1 --2- 172.21.15.78:0/3928654495 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fd714066470 0x7fd714068930 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7fd7180ae000 tx=0x7fd7180b3040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:03:11.246 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:11.240+0000 7fd727fff640 1 --2- 172.21.15.78:0/3928654495 >> [v2:172.21.15.78:6824/3442991267,v1:172.21.15.78:6825/3442991267] conn(0x7fd71406c810 0x7fd71406ec50 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:03:11.247 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:11.240+0000 7fd70ffff640 1 -- 172.21.15.78:0/3928654495 <== osd.3 v2:172.21.15.78:6824/3442991267 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7fd71406f320 con 0x7fd71406c810 2023-11-28T20:03:11.257 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:11.252+0000 7fd72e1f8640 1 -- 172.21.15.78:0/3928654495 --> [v2:172.21.15.78:6824/3442991267,v1:172.21.15.78:6825/3442991267] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fd7280704d0 con 0x7fd71406c810 2023-11-28T20:03:11.258 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:11.252+0000 7fd70ffff640 1 -- 172.21.15.78:0/3928654495 <== osd.3 v2:172.21.15.78:6824/3442991267 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7fd7280704d0 con 0x7fd71406c810 2023-11-28T20:03:11.258 INFO:teuthology.orchestra.run.smithi078.stdout:{ 2023-11-28T20:03:11.258 INFO:teuthology.orchestra.run.smithi078.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2023-11-28T20:03:11.258 INFO:teuthology.orchestra.run.smithi078.stdout:} 2023-11-28T20:03:11.259 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:11.252+0000 7fd72e1f8640 1 -- 172.21.15.78:0/3928654495 >> [v2:172.21.15.78:6824/3442991267,v1:172.21.15.78:6825/3442991267] conn(0x7fd71406c810 msgr2=0x7fd71406ec50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:03:11.259 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:11.252+0000 7fd72e1f8640 1 --2- 172.21.15.78:0/3928654495 >> [v2:172.21.15.78:6824/3442991267,v1:172.21.15.78:6825/3442991267] conn(0x7fd71406c810 0x7fd71406ec50 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:03:11.259 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:11.252+0000 7fd72e1f8640 1 -- 172.21.15.78:0/3928654495 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fd714066470 msgr2=0x7fd714068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:03:11.260 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:11.252+0000 7fd72e1f8640 1 --2- 172.21.15.78:0/3928654495 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fd714066470 0x7fd714068930 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7fd7180ae000 tx=0x7fd7180b3040 comp rx=0 tx=0).stop 2023-11-28T20:03:11.260 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:11.252+0000 7fd72e1f8640 1 -- 172.21.15.78:0/3928654495 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd72814f850 msgr2=0x7fd72814ae10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:03:11.260 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:11.252+0000 7fd72e1f8640 1 --2- 172.21.15.78:0/3928654495 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd72814f850 0x7fd72814ae10 secure :-1 s=READY pgs=1163 cs=0 l=1 rev1=1 crypto rx=0x7fd71c00d800 tx=0x7fd71c00dcc0 comp rx=0 tx=0).stop 2023-11-28T20:03:11.260 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:11.252+0000 7fd727fff640 1 -- 172.21.15.78:0/3928654495 reap_dead start 2023-11-28T20:03:11.260 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:11.252+0000 7fd72e1f8640 1 -- 172.21.15.78:0/3928654495 shutdown_connections 2023-11-28T20:03:11.260 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:11.252+0000 7fd72e1f8640 1 -- 172.21.15.78:0/3928654495 >> 172.21.15.78:0/3928654495 conn(0x7fd7280c59f0 msgr2=0x7fd7281508f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:03:11.260 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:11.252+0000 7fd72e1f8640 1 -- 172.21.15.78:0/3928654495 shutdown_connections 2023-11-28T20:03:11.260 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:11.252+0000 7fd72e1f8640 1 -- 172.21.15.78:0/3928654495 wait complete. 2023-11-28T20:03:11.276 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2023-11-28T20:03:11.415 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:11.412+0000 7f0b727b8640 1 Processor -- start 2023-11-28T20:03:11.416 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:11.412+0000 7f0b727b8640 1 -- start start 2023-11-28T20:03:11.417 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:11.412+0000 7f0b727b8640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f0b6c0a4f90 0x7f0b6c0c59c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:03:11.417 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:11.412+0000 7f0b727b8640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f0b6c0a5370 0x7f0b6c14f870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:03:11.417 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:11.412+0000 7f0b727b8640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0b6c072810 0x7f0b6c14fdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:03:11.418 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:11.412+0000 7f0b727b8640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0b6c1524b0 con 0x7f0b6c0a5370 2023-11-28T20:03:11.418 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:11.412+0000 7f0b727b8640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0b6c0c62f0 con 0x7f0b6c0a4f90 2023-11-28T20:03:11.418 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:11.412+0000 7f0b727b8640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0b6c152770 con 0x7f0b6c072810 2023-11-28T20:03:11.418 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:11.412+0000 7f0b6b7fe640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f0b6c0a5370 0x7f0b6c14f870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:03:11.418 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:11.412+0000 7f0b6bfff640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f0b6c0a4f90 0x7f0b6c0c59c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:03:11.418 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:11.412+0000 7f0b6b7fe640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f0b6c0a5370 0x7f0b6c14f870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:47830/0 (socket says 172.21.15.78:47830) 2023-11-28T20:03:11.418 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:11.412+0000 7f0b6b7fe640 1 -- 172.21.15.78:0/90445203 learned_addr learned my addr 172.21.15.78:0/90445203 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T20:03:11.419 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:11.412+0000 7f0b70d55640 1 --2- 172.21.15.78:0/90445203 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0b6c072810 0x7f0b6c14fdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:03:11.419 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:11.412+0000 7f0b6b7fe640 1 -- 172.21.15.78:0/90445203 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0b6c072810 msgr2=0x7f0b6c14fdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:03:11.419 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:11.412+0000 7f0b6b7fe640 1 --2- 172.21.15.78:0/90445203 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0b6c072810 0x7f0b6c14fdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:03:11.419 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:11.412+0000 7f0b6b7fe640 1 -- 172.21.15.78:0/90445203 >> v2:172.21.15.179:3300/0 conn(0x7f0b6c0a4f90 msgr2=0x7f0b6c0c59c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:03:11.420 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:11.412+0000 7f0b6b7fe640 1 --2- 172.21.15.78:0/90445203 >> v2:172.21.15.179:3300/0 conn(0x7f0b6c0a4f90 0x7f0b6c0c59c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:03:11.420 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:11.412+0000 7f0b6b7fe640 1 -- 172.21.15.78:0/90445203 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b6c152a50 con 0x7f0b6c0a5370 2023-11-28T20:03:11.421 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:11.416+0000 7f0b6b7fe640 1 --2- 172.21.15.78:0/90445203 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0b6c0a5370 0x7f0b6c14f870 secure :-1 s=READY pgs=1164 cs=0 l=1 rev1=1 crypto rx=0x7f0b6c0ab050 tx=0x7f0b6001c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=56fe4055406bb90c server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:03:11.421 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:11.416+0000 7f0b6affd640 1 -- 172.21.15.78:0/90445203 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b600ab600 con 0x7f0b6c0a5370 2023-11-28T20:03:11.422 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:11.416+0000 7f0b6affd640 1 -- 172.21.15.78:0/90445203 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b600a7050 con 0x7f0b6c0a5370 2023-11-28T20:03:11.422 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:11.416+0000 7f0b6affd640 1 -- 172.21.15.78:0/90445203 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b600ab980 con 0x7f0b6c0a5370 2023-11-28T20:03:11.422 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:11.416+0000 7f0b727b8640 1 -- 172.21.15.78:0/90445203 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0b6c0a5370 msgr2=0x7f0b6c14f870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:03:11.422 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:11.416+0000 7f0b727b8640 1 --2- 172.21.15.78:0/90445203 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0b6c0a5370 0x7f0b6c14f870 secure :-1 s=READY pgs=1164 cs=0 l=1 rev1=1 crypto rx=0x7f0b6c0ab050 tx=0x7f0b6001c470 comp rx=0 tx=0).stop 2023-11-28T20:03:11.423 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:11.416+0000 7f0b727b8640 1 -- 172.21.15.78:0/90445203 shutdown_connections 2023-11-28T20:03:11.423 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:11.416+0000 7f0b727b8640 1 --2- 172.21.15.78:0/90445203 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0b6c072810 0x7f0b6c14fdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:03:11.423 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:11.416+0000 7f0b727b8640 1 --2- 172.21.15.78:0/90445203 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0b6c0a5370 0x7f0b6c14f870 unknown :-1 s=CLOSED pgs=1164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:03:11.423 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:11.416+0000 7f0b727b8640 1 --2- 172.21.15.78:0/90445203 >> v2:172.21.15.179:3300/0 conn(0x7f0b6c0a4f90 0x7f0b6c0c59c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:03:11.424 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:11.416+0000 7f0b727b8640 1 -- 172.21.15.78:0/90445203 >> 172.21.15.78:0/90445203 conn(0x7f0b6c06b220 msgr2=0x7f0b6c0a77e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:03:11.424 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:11.416+0000 7f0b727b8640 1 -- 172.21.15.78:0/90445203 shutdown_connections 2023-11-28T20:03:11.424 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:11.416+0000 7f0b727b8640 1 -- 172.21.15.78:0/90445203 wait complete. 2023-11-28T20:03:11.426 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:11.420+0000 7f0b727b8640 1 Processor -- start 2023-11-28T20:03:11.426 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:11.420+0000 7f0b727b8640 1 -- start start 2023-11-28T20:03:11.426 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:11.420+0000 7f0b727b8640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0b6c072810 0x7f0b6c147a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:03:11.427 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:11.420+0000 7f0b727b8640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0b6c0a4f90 0x7f0b6c0c28b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:03:11.427 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:11.420+0000 7f0b727b8640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0b6c0a5370 0x7f0b6c1eb060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:03:11.427 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:11.420+0000 7f0b727b8640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b6c0c33c0 con 0x7f0b6c0a5370 2023-11-28T20:03:11.427 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:11.420+0000 7f0b727b8640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b6c1eee70 con 0x7f0b6c0a4f90 2023-11-28T20:03:11.427 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:11.420+0000 7f0b727b8640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0b6c1ef150 con 0x7f0b6c072810 2023-11-28T20:03:11.427 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:11.420+0000 7f0b70d55640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0b6c0a5370 0x7f0b6c1eb060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:03:11.427 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:11.420+0000 7f0b70d55640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0b6c0a5370 0x7f0b6c1eb060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:47832/0 (socket says 172.21.15.78:47832) 2023-11-28T20:03:11.428 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:11.420+0000 7f0b70d55640 1 -- 172.21.15.78:0/1999180583 learned_addr learned my addr 172.21.15.78:0/1999180583 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T20:03:11.428 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:11.420+0000 7f0b6b7fe640 1 --2- 172.21.15.78:0/1999180583 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0b6c0a4f90 0x7f0b6c0c28b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:03:11.428 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:11.420+0000 7f0b70d55640 1 -- 172.21.15.78:0/1999180583 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0b6c072810 msgr2=0x7f0b6c147a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:03:11.428 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:11.420+0000 7f0b6bfff640 1 --2- 172.21.15.78:0/1999180583 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0b6c072810 0x7f0b6c147a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:03:11.428 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:11.420+0000 7f0b70d55640 1 --2- 172.21.15.78:0/1999180583 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0b6c072810 0x7f0b6c147a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:03:11.428 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:11.420+0000 7f0b70d55640 1 -- 172.21.15.78:0/1999180583 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0b6c0a4f90 msgr2=0x7f0b6c0c28b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:03:11.429 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:11.420+0000 7f0b70d55640 1 --2- 172.21.15.78:0/1999180583 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0b6c0a4f90 0x7f0b6c0c28b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:03:11.429 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:11.420+0000 7f0b70d55640 1 -- 172.21.15.78:0/1999180583 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b600094d0 con 0x7f0b6c0a5370 2023-11-28T20:03:11.429 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:11.420+0000 7f0b6b7fe640 1 --2- 172.21.15.78:0/1999180583 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0b6c0a4f90 0x7f0b6c0c28b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T20:03:11.429 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:11.420+0000 7f0b70d55640 1 --2- 172.21.15.78:0/1999180583 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0b6c0a5370 0x7f0b6c1eb060 secure :-1 s=READY pgs=1165 cs=0 l=1 rev1=1 crypto rx=0x7f0b6400efc0 tx=0x7f0b6400c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:03:11.429 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:11.420+0000 7f0b68ff9640 1 -- 172.21.15.78:0/1999180583 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b64009ca0 con 0x7f0b6c0a5370 2023-11-28T20:03:11.429 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:11.420+0000 7f0b68ff9640 1 -- 172.21.15.78:0/1999180583 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b6400f040 con 0x7f0b6c0a5370 2023-11-28T20:03:11.429 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:11.420+0000 7f0b68ff9640 1 -- 172.21.15.78:0/1999180583 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b640146c0 con 0x7f0b6c0a5370 2023-11-28T20:03:11.429 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:11.420+0000 7f0b727b8640 1 -- 172.21.15.78:0/1999180583 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0b6c1551a0 con 0x7f0b6c0a5370 2023-11-28T20:03:11.430 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:11.420+0000 7f0b727b8640 1 -- 172.21.15.78:0/1999180583 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0b6c148900 con 0x7f0b6c0a5370 2023-11-28T20:03:11.430 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:11.420+0000 7f0b727b8640 1 -- 172.21.15.78:0/1999180583 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0b6c1556c0 con 0x7f0b6c0a5370 2023-11-28T20:03:11.431 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:11.424+0000 7f0b68ff9640 1 -- 172.21.15.78:0/1999180583 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f0b64014820 con 0x7f0b6c0a5370 2023-11-28T20:03:11.431 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:11.424+0000 7f0b68ff9640 1 --2- 172.21.15.78:0/1999180583 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f0b58066470 0x7f0b58068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:03:11.431 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:11.424+0000 7f0b68ff9640 1 -- 172.21.15.78:0/1999180583 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 5349+0+0 (secure 0 0 0) 0x7f0b64084bf0 con 0x7f0b6c0a5370 2023-11-28T20:03:11.431 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:11.424+0000 7f0b6bfff640 1 --2- 172.21.15.78:0/1999180583 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f0b58066470 0x7f0b58068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:03:11.431 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:11.424+0000 7f0b6bfff640 1 --2- 172.21.15.78:0/1999180583 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f0b58066470 0x7f0b58068930 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7f0b5c0099b0 tx=0x7f0b5c008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:03:11.432 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:11.428+0000 7f0b68ff9640 1 -- 172.21.15.78:0/1999180583 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f0b6c1556c0 con 0x7f0b6c0a5370 2023-11-28T20:03:11.581 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:11.576+0000 7f0b727b8640 1 -- 172.21.15.78:0/1999180583 --> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "3", "target": ["mon-mgr", ""]}) v1 -- 0x7f0b6c155020 con 0x7f0b58066470 2023-11-28T20:03:11.581 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:11.576+0000 7f0b68ff9640 1 -- 172.21.15.78:0/1999180583 <== mgr.4106 v2:172.21.15.78:6832/2935380957 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 3 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f0b5c010870 con 0x7f0b58066470 2023-11-28T20:03:11.581 INFO:teuthology.orchestra.run.smithi078.stderr:instructed osd(s) 3 to deep-scrub 2023-11-28T20:03:11.583 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:11.580+0000 7f0b727b8640 1 -- 172.21.15.78:0/1999180583 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f0b58066470 msgr2=0x7f0b58068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:03:11.584 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:11.580+0000 7f0b727b8640 1 --2- 172.21.15.78:0/1999180583 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f0b58066470 0x7f0b58068930 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7f0b5c0099b0 tx=0x7f0b5c008040 comp rx=0 tx=0).stop 2023-11-28T20:03:11.584 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:11.580+0000 7f0b727b8640 1 -- 172.21.15.78:0/1999180583 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0b6c0a5370 msgr2=0x7f0b6c1eb060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:03:11.584 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:11.580+0000 7f0b727b8640 1 --2- 172.21.15.78:0/1999180583 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0b6c0a5370 0x7f0b6c1eb060 secure :-1 s=READY pgs=1165 cs=0 l=1 rev1=1 crypto rx=0x7f0b6400efc0 tx=0x7f0b6400c490 comp rx=0 tx=0).stop 2023-11-28T20:03:11.584 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:11.580+0000 7f0b727b8640 1 -- 172.21.15.78:0/1999180583 shutdown_connections 2023-11-28T20:03:11.584 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:11.580+0000 7f0b727b8640 1 --2- 172.21.15.78:0/1999180583 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f0b58066470 0x7f0b58068930 unknown :-1 s=CLOSED pgs=550 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:03:11.584 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:11.580+0000 7f0b727b8640 1 --2- 172.21.15.78:0/1999180583 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0b6c0a5370 0x7f0b6c1eb060 unknown :-1 s=CLOSED pgs=1165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:03:11.584 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:11.580+0000 7f0b727b8640 1 --2- 172.21.15.78:0/1999180583 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0b6c0a4f90 0x7f0b6c0c28b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:03:11.584 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:11.580+0000 7f0b727b8640 1 --2- 172.21.15.78:0/1999180583 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0b6c072810 0x7f0b6c147a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:03:11.585 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:11.580+0000 7f0b727b8640 1 -- 172.21.15.78:0/1999180583 >> 172.21.15.78:0/1999180583 conn(0x7f0b6c06b220 msgr2=0x7f0b6c14f2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:03:11.585 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:11.580+0000 7f0b727b8640 1 -- 172.21.15.78:0/1999180583 shutdown_connections 2023-11-28T20:03:11.585 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:11.580+0000 7f0b727b8640 1 -- 172.21.15.78:0/1999180583 wait complete. 2023-11-28T20:03:11.602 INFO:tasks.ceph:Scrubbing osd.4 2023-11-28T20:03:11.603 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 config set osd_debug_deep_scrub_sleep 0 2023-11-28T20:03:11.743 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:11.740+0000 7f5f2e5f8640 1 Processor -- start 2023-11-28T20:03:11.743 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:11.740+0000 7f5f2e5f8640 1 -- start start 2023-11-28T20:03:11.745 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:11.740+0000 7f5f2e5f8640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f5f2814b1e0 0x7f5f280c1700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:03:11.746 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:11.740+0000 7f5f2e5f8640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5f281548c0 0x7f5f28154d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:03:11.746 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:11.740+0000 7f5f2e5f8640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5f280a4e20 con 0x7f5f280c5300 2023-11-28T20:03:11.746 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:11.740+0000 7f5f2e5f8640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5f280a50e0 con 0x7f5f2814b1e0 2023-11-28T20:03:11.746 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:11.740+0000 7f5f2e5f8640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f280c0f00 con 0x7f5f281548c0 2023-11-28T20:03:11.746 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:11.740+0000 7f5f27fff640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f5f2814b1e0 0x7f5f280c1700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:03:11.746 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:11.740+0000 7f5f2cb95640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5f281548c0 0x7f5f28154d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:03:11.746 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:11.740+0000 7f5f27fff640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f5f2814b1e0 0x7f5f280c1700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.78:60574/0 (socket says 172.21.15.78:60574) 2023-11-28T20:03:11.747 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:11.740+0000 7f5f27fff640 1 -- 172.21.15.78:0/3952194416 learned_addr learned my addr 172.21.15.78:0/3952194416 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T20:03:11.747 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:11.740+0000 7f5f27fff640 1 -- 172.21.15.78:0/3952194416 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5f281548c0 msgr2=0x7f5f28154d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:03:11.747 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:11.740+0000 7f5f27fff640 1 --2- 172.21.15.78:0/3952194416 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5f281548c0 0x7f5f28154d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:03:11.747 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:11.740+0000 7f5f27fff640 1 -- 172.21.15.78:0/3952194416 >> v1:172.21.15.179:6789/0 conn(0x7f5f280c5300 legacy=0x7f5f280a9c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:03:11.747 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:11.740+0000 7f5f27fff640 1 -- 172.21.15.78:0/3952194416 --> v2:172.21.15.179:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f280c11e0 con 0x7f5f2814b1e0 2023-11-28T20:03:11.748 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:11.744+0000 7f5f27fff640 1 --2- 172.21.15.78:0/3952194416 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5f2814b1e0 0x7f5f280c1700 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f5f18009870 tx=0x7f5f1801c540 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bc3536a6a25c0f85 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:03:11.748 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:11.744+0000 7f5f26ffd640 1 -- 172.21.15.78:0/3952194416 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f180ab650 con 0x7f5f2814b1e0 2023-11-28T20:03:11.749 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:11.744+0000 7f5f26ffd640 1 -- 172.21.15.78:0/3952194416 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f180ab7b0 con 0x7f5f2814b1e0 2023-11-28T20:03:11.749 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:11.744+0000 7f5f26ffd640 1 -- 172.21.15.78:0/3952194416 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f180abb40 con 0x7f5f2814b1e0 2023-11-28T20:03:11.750 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:11.744+0000 7f5f2e5f8640 1 -- 172.21.15.78:0/3952194416 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5f2814b1e0 msgr2=0x7f5f280c1700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:03:11.750 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:11.744+0000 7f5f2e5f8640 1 --2- 172.21.15.78:0/3952194416 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5f2814b1e0 0x7f5f280c1700 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f5f18009870 tx=0x7f5f1801c540 comp rx=0 tx=0).stop 2023-11-28T20:03:11.750 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:11.744+0000 7f5f2e5f8640 1 -- 172.21.15.78:0/3952194416 shutdown_connections 2023-11-28T20:03:11.750 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:11.744+0000 7f5f2e5f8640 1 --2- 172.21.15.78:0/3952194416 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5f281548c0 0x7f5f28154d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:03:11.750 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:11.744+0000 7f5f2e5f8640 1 --2- 172.21.15.78:0/3952194416 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5f2814b1e0 0x7f5f280c1700 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:03:11.750 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:11.744+0000 7f5f2e5f8640 1 -- 172.21.15.78:0/3952194416 >> 172.21.15.78:0/3952194416 conn(0x7f5f280c59f0 msgr2=0x7f5f280c5e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:03:11.750 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:11.744+0000 7f5f2e5f8640 1 -- 172.21.15.78:0/3952194416 shutdown_connections 2023-11-28T20:03:11.751 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:11.744+0000 7f5f2e5f8640 1 -- 172.21.15.78:0/3952194416 wait complete. 2023-11-28T20:03:11.751 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:11.748+0000 7f5f2e5f8640 1 Processor -- start 2023-11-28T20:03:11.751 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:11.748+0000 7f5f2e5f8640 1 -- start start 2023-11-28T20:03:11.752 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:11.748+0000 7f5f2e5f8640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5f280c5300 0x7f5f28153cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:03:11.753 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:11.748+0000 7f5f2e5f8640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5f2814b1e0 0x7f5f28154210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:03:11.753 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:11.748+0000 7f5f2e5f8640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5f281548c0 0x7f5f2806cbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:03:11.753 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:11.748+0000 7f5f2e5f8640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f281520e0 con 0x7f5f2814b1e0 2023-11-28T20:03:11.753 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:11.748+0000 7f5f2e5f8640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f281eecc0 con 0x7f5f280c5300 2023-11-28T20:03:11.753 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:11.748+0000 7f5f2e5f8640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f281ef1f0 con 0x7f5f281548c0 2023-11-28T20:03:11.753 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:11.748+0000 7f5f277fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5f2814b1e0 0x7f5f28154210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:03:11.753 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:11.748+0000 7f5f277fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5f2814b1e0 0x7f5f28154210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:47834/0 (socket says 172.21.15.78:47834) 2023-11-28T20:03:11.754 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:11.748+0000 7f5f277fe640 1 -- 172.21.15.78:0/2172882632 learned_addr learned my addr 172.21.15.78:0/2172882632 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T20:03:11.754 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:11.748+0000 7f5f2cb95640 1 --2- 172.21.15.78:0/2172882632 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5f281548c0 0x7f5f2806cbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:03:11.754 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:11.748+0000 7f5f27fff640 1 --2- 172.21.15.78:0/2172882632 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5f280c5300 0x7f5f28153cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:03:11.754 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:11.748+0000 7f5f277fe640 1 -- 172.21.15.78:0/2172882632 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5f281548c0 msgr2=0x7f5f2806cbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:03:11.754 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:11.748+0000 7f5f277fe640 1 --2- 172.21.15.78:0/2172882632 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5f281548c0 0x7f5f2806cbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:03:11.754 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:11.748+0000 7f5f277fe640 1 -- 172.21.15.78:0/2172882632 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5f280c5300 msgr2=0x7f5f28153cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:03:11.754 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:11.748+0000 7f5f277fe640 1 --2- 172.21.15.78:0/2172882632 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5f280c5300 0x7f5f28153cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:03:11.755 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:11.748+0000 7f5f277fe640 1 -- 172.21.15.78:0/2172882632 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f180094d0 con 0x7f5f2814b1e0 2023-11-28T20:03:11.756 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:11.748+0000 7f5f277fe640 1 --2- 172.21.15.78:0/2172882632 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5f2814b1e0 0x7f5f28154210 secure :-1 s=READY pgs=1166 cs=0 l=1 rev1=1 crypto rx=0x7f5f1c00c420 tx=0x7f5f1c00c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:03:11.756 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:11.748+0000 7f5f24ff9640 1 -- 172.21.15.78:0/2172882632 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f1c0052d0 con 0x7f5f2814b1e0 2023-11-28T20:03:11.756 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:11.748+0000 7f5f24ff9640 1 -- 172.21.15.78:0/2172882632 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f1c005430 con 0x7f5f2814b1e0 2023-11-28T20:03:11.756 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:11.748+0000 7f5f24ff9640 1 -- 172.21.15.78:0/2172882632 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f1c003820 con 0x7f5f2814b1e0 2023-11-28T20:03:11.756 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:11.748+0000 7f5f2e5f8640 1 -- 172.21.15.78:0/2172882632 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5f281eef10 con 0x7f5f2814b1e0 2023-11-28T20:03:11.756 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:11.748+0000 7f5f2e5f8640 1 -- 172.21.15.78:0/2172882632 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5f28151d00 con 0x7f5f2814b1e0 2023-11-28T20:03:11.756 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:11.748+0000 7f5f2e5f8640 1 -- 172.21.15.78:0/2172882632 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f5f280c6890 con 0x7f5f2814b1e0 2023-11-28T20:03:11.757 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:11.752+0000 7f5f24ff9640 1 -- 172.21.15.78:0/2172882632 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f5f1c003980 con 0x7f5f2814b1e0 2023-11-28T20:03:11.758 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:11.752+0000 7f5f24ff9640 1 --2- 172.21.15.78:0/2172882632 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f5f14066470 0x7f5f14068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:03:11.758 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:11.752+0000 7f5f24ff9640 1 -- 172.21.15.78:0/2172882632 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 5349+0+0 (secure 0 0 0) 0x7f5f1c0831e0 con 0x7f5f2814b1e0 2023-11-28T20:03:11.758 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:11.752+0000 7f5f27fff640 1 --2- 172.21.15.78:0/2172882632 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f5f14066470 0x7f5f14068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:03:11.758 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:11.752+0000 7f5f24ff9640 1 --2- 172.21.15.78:0/2172882632 >> [v2:172.21.15.179:6808/802983577,v1:172.21.15.179:6809/802983577] conn(0x7f5f1406c810 0x7f5f1406ec50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:03:11.758 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:11.752+0000 7f5f24ff9640 1 -- 172.21.15.78:0/2172882632 --> [v2:172.21.15.179:6808/802983577,v1:172.21.15.179:6809/802983577] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f5f1406f320 con 0x7f5f1406c810 2023-11-28T20:03:11.758 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:11.752+0000 7f5f24ff9640 1 -- 172.21.15.78:0/2172882632 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_get_version_reply(handle=1 version=93) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5f1c085760 con 0x7f5f2814b1e0 2023-11-28T20:03:11.758 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:11.752+0000 7f5f2cb95640 1 --2- 172.21.15.78:0/2172882632 >> [v2:172.21.15.179:6808/802983577,v1:172.21.15.179:6809/802983577] conn(0x7f5f1406c810 0x7f5f1406ec50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:03:11.759 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:11.752+0000 7f5f27fff640 1 --2- 172.21.15.78:0/2172882632 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f5f14066470 0x7f5f14068930 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7f5f180af000 tx=0x7f5f180b6040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:03:11.759 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:11.752+0000 7f5f2cb95640 1 --2- 172.21.15.78:0/2172882632 >> [v2:172.21.15.179:6808/802983577,v1:172.21.15.179:6809/802983577] conn(0x7f5f1406c810 0x7f5f1406ec50 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:03:11.759 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:11.756+0000 7f5f24ff9640 1 -- 172.21.15.78:0/2172882632 <== osd.4 v2:172.21.15.179:6808/802983577 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7f5f1406f320 con 0x7f5f1406c810 2023-11-28T20:03:11.771 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:11.768+0000 7f5f2e5f8640 1 -- 172.21.15.78:0/2172882632 --> [v2:172.21.15.179:6808/802983577,v1:172.21.15.179:6809/802983577] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f5f2814b7d0 con 0x7f5f1406c810 2023-11-28T20:03:11.772 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:11.768+0000 7f5f24ff9640 1 -- 172.21.15.78:0/2172882632 <== osd.4 v2:172.21.15.179:6808/802983577 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f5f2000f040 con 0x7f5f1406c810 2023-11-28T20:03:11.772 INFO:teuthology.orchestra.run.smithi078.stdout:{ 2023-11-28T20:03:11.772 INFO:teuthology.orchestra.run.smithi078.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2023-11-28T20:03:11.772 INFO:teuthology.orchestra.run.smithi078.stdout:} 2023-11-28T20:03:11.773 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:11.768+0000 7f5f2e5f8640 1 -- 172.21.15.78:0/2172882632 >> [v2:172.21.15.179:6808/802983577,v1:172.21.15.179:6809/802983577] conn(0x7f5f1406c810 msgr2=0x7f5f1406ec50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:03:11.773 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:11.768+0000 7f5f2e5f8640 1 --2- 172.21.15.78:0/2172882632 >> [v2:172.21.15.179:6808/802983577,v1:172.21.15.179:6809/802983577] conn(0x7f5f1406c810 0x7f5f1406ec50 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:03:11.773 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:11.768+0000 7f5f2e5f8640 1 -- 172.21.15.78:0/2172882632 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f5f14066470 msgr2=0x7f5f14068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:03:11.774 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:11.768+0000 7f5f2e5f8640 1 --2- 172.21.15.78:0/2172882632 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f5f14066470 0x7f5f14068930 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7f5f180af000 tx=0x7f5f180b6040 comp rx=0 tx=0).stop 2023-11-28T20:03:11.774 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:11.768+0000 7f5f2e5f8640 1 -- 172.21.15.78:0/2172882632 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5f2814b1e0 msgr2=0x7f5f28154210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:03:11.774 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:11.768+0000 7f5f2e5f8640 1 --2- 172.21.15.78:0/2172882632 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5f2814b1e0 0x7f5f28154210 secure :-1 s=READY pgs=1166 cs=0 l=1 rev1=1 crypto rx=0x7f5f1c00c420 tx=0x7f5f1c00c8e0 comp rx=0 tx=0).stop 2023-11-28T20:03:11.774 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:11.768+0000 7f5f2cb95640 1 -- 172.21.15.78:0/2172882632 reap_dead start 2023-11-28T20:03:11.774 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:11.768+0000 7f5f2e5f8640 1 -- 172.21.15.78:0/2172882632 shutdown_connections 2023-11-28T20:03:11.774 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:11.768+0000 7f5f2e5f8640 1 -- 172.21.15.78:0/2172882632 >> 172.21.15.78:0/2172882632 conn(0x7f5f280c59f0 msgr2=0x7f5f28143de0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:03:11.774 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:11.768+0000 7f5f2e5f8640 1 -- 172.21.15.78:0/2172882632 shutdown_connections 2023-11-28T20:03:11.775 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:11.768+0000 7f5f2e5f8640 1 -- 172.21.15.78:0/2172882632 wait complete. 2023-11-28T20:03:11.790 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 4 2023-11-28T20:03:11.929 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:11.924+0000 7f7e29caa640 1 Processor -- start 2023-11-28T20:03:11.930 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:11.924+0000 7f7e29caa640 1 -- start start 2023-11-28T20:03:11.931 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:11.928+0000 7f7e29caa640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f7e240c66b0 0x7f7e240a4fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:03:11.931 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:11.928+0000 7f7e29caa640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7e2414e550 0x7f7e240c5a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:03:11.931 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:11.928+0000 7f7e29caa640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7e240a4cc0 con 0x7f7e2406bc70 2023-11-28T20:03:11.931 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:11.928+0000 7f7e29caa640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7e240c23d0 con 0x7f7e240c66b0 2023-11-28T20:03:11.931 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:11.928+0000 7f7e29caa640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e240c1b70 con 0x7f7e2414e550 2023-11-28T20:03:11.932 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:11.928+0000 7f7e22ffd640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f7e240c66b0 0x7f7e240a4fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:03:11.933 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:11.928+0000 7f7e22ffd640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f7e240c66b0 0x7f7e240a4fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.78:60582/0 (socket says 172.21.15.78:60582) 2023-11-28T20:03:11.933 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:11.928+0000 7f7e22ffd640 1 -- 172.21.15.78:0/1757900579 learned_addr learned my addr 172.21.15.78:0/1757900579 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T20:03:11.933 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:11.928+0000 7f7e237fe640 1 --1- 172.21.15.78:0/1757900579 >> v1:172.21.15.179:6789/0 conn(0x7f7e2406bc70 0x7f7e2414de40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.179:6789/0 says I am v1:172.21.15.78:56684/0 (socket says 172.21.15.78:56684) 2023-11-28T20:03:11.933 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:11.928+0000 7f7e23fff640 1 --2- 172.21.15.78:0/1757900579 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7e2414e550 0x7f7e240c5a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:03:11.933 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:11.928+0000 7f7e23fff640 1 -- 172.21.15.78:0/1757900579 >> v2:172.21.15.179:3300/0 conn(0x7f7e240c66b0 msgr2=0x7f7e240a4fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:03:11.933 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:11.928+0000 7f7e23fff640 1 --2- 172.21.15.78:0/1757900579 >> v2:172.21.15.179:3300/0 conn(0x7f7e240c66b0 0x7f7e240a4fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:03:11.933 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:11.928+0000 7f7e23fff640 1 -- 172.21.15.78:0/1757900579 >> v1:172.21.15.179:6789/0 conn(0x7f7e2406bc70 legacy=0x7f7e2414de40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:03:11.934 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:11.928+0000 7f7e23fff640 1 -- 172.21.15.78:0/1757900579 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e240c1d80 con 0x7f7e2414e550 2023-11-28T20:03:11.934 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:11.928+0000 7f7e22ffd640 1 --2- 172.21.15.78:0/1757900579 >> v2:172.21.15.179:3300/0 conn(0x7f7e240c66b0 0x7f7e240a4fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T20:03:11.935 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:11.932+0000 7f7e23fff640 1 --2- 172.21.15.78:0/1757900579 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7e2414e550 0x7f7e240c5a30 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f7e1c009d90 tx=0x7f7e1c01c830 comp rx=0 tx=0).ready entity=mon.2 client_cookie=458d1fc7d20f941b server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:03:11.935 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:11.932+0000 7f7e227fc640 1 -- 172.21.15.78:0/1757900579 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e1c0a57a0 con 0x7f7e2414e550 2023-11-28T20:03:11.935 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:11.932+0000 7f7e227fc640 1 -- 172.21.15.78:0/1757900579 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e1c0a5900 con 0x7f7e2414e550 2023-11-28T20:03:11.936 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:11.932+0000 7f7e227fc640 1 -- 172.21.15.78:0/1757900579 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e1c0a5c90 con 0x7f7e2414e550 2023-11-28T20:03:11.936 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:11.932+0000 7f7e29caa640 1 -- 172.21.15.78:0/1757900579 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7e2414e550 msgr2=0x7f7e240c5a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:03:11.937 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:11.932+0000 7f7e29caa640 1 --2- 172.21.15.78:0/1757900579 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7e2414e550 0x7f7e240c5a30 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f7e1c009d90 tx=0x7f7e1c01c830 comp rx=0 tx=0).stop 2023-11-28T20:03:11.937 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:11.932+0000 7f7e29caa640 1 -- 172.21.15.78:0/1757900579 shutdown_connections 2023-11-28T20:03:11.937 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:11.932+0000 7f7e29caa640 1 --2- 172.21.15.78:0/1757900579 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7e2414e550 0x7f7e240c5a30 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:03:11.938 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:11.932+0000 7f7e29caa640 1 --2- 172.21.15.78:0/1757900579 >> v2:172.21.15.179:3300/0 conn(0x7f7e240c66b0 0x7f7e240a4fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:03:11.938 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:11.932+0000 7f7e29caa640 1 -- 172.21.15.78:0/1757900579 >> 172.21.15.78:0/1757900579 conn(0x7f7e2406b220 msgr2=0x7f7e240a77e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:03:11.938 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:11.932+0000 7f7e29caa640 1 -- 172.21.15.78:0/1757900579 shutdown_connections 2023-11-28T20:03:11.938 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:11.932+0000 7f7e29caa640 1 -- 172.21.15.78:0/1757900579 wait complete. 2023-11-28T20:03:11.939 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:11.932+0000 7f7e29caa640 1 Processor -- start 2023-11-28T20:03:11.939 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:11.932+0000 7f7e29caa640 1 -- start start 2023-11-28T20:03:11.940 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:11.936+0000 7f7e29caa640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7e2406bc70 0x7f7e241479b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:03:11.940 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:11.936+0000 7f7e29caa640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7e240c66b0 0x7f7e2413afc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:03:11.940 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:11.936+0000 7f7e29caa640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7e2414e550 0x7f7e2413b500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:03:11.940 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:11.936+0000 7f7e29caa640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e241485c0 con 0x7f7e2406bc70 2023-11-28T20:03:11.940 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:11.936+0000 7f7e29caa640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e24141cc0 con 0x7f7e2414e550 2023-11-28T20:03:11.940 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:11.936+0000 7f7e29caa640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e2414ef40 con 0x7f7e240c66b0 2023-11-28T20:03:11.941 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:11.936+0000 7f7e237fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7e2406bc70 0x7f7e241479b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:03:11.941 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:11.936+0000 7f7e237fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7e2406bc70 0x7f7e241479b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:47838/0 (socket says 172.21.15.78:47838) 2023-11-28T20:03:11.941 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:11.936+0000 7f7e237fe640 1 -- 172.21.15.78:0/2250671587 learned_addr learned my addr 172.21.15.78:0/2250671587 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T20:03:11.941 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:11.936+0000 7f7e23fff640 1 --2- 172.21.15.78:0/2250671587 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7e2414e550 0x7f7e2413b500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:03:11.941 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:11.936+0000 7f7e22ffd640 1 --2- 172.21.15.78:0/2250671587 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7e240c66b0 0x7f7e2413afc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:03:11.941 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:11.936+0000 7f7e237fe640 1 -- 172.21.15.78:0/2250671587 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7e240c66b0 msgr2=0x7f7e2413afc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:03:11.942 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:11.936+0000 7f7e237fe640 1 --2- 172.21.15.78:0/2250671587 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7e240c66b0 0x7f7e2413afc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:03:11.942 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:11.936+0000 7f7e237fe640 1 -- 172.21.15.78:0/2250671587 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7e2414e550 msgr2=0x7f7e2413b500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:03:11.942 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:11.936+0000 7f7e237fe640 1 --2- 172.21.15.78:0/2250671587 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7e2414e550 0x7f7e2413b500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:03:11.942 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:11.936+0000 7f7e237fe640 1 -- 172.21.15.78:0/2250671587 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e1800b770 con 0x7f7e2406bc70 2023-11-28T20:03:11.943 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:11.936+0000 7f7e237fe640 1 --2- 172.21.15.78:0/2250671587 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7e2406bc70 0x7f7e241479b0 secure :-1 s=READY pgs=1167 cs=0 l=1 rev1=1 crypto rx=0x7f7e1400c490 tx=0x7f7e1400c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:03:11.944 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:11.936+0000 7f7e0bfff640 1 -- 172.21.15.78:0/2250671587 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e14007480 con 0x7f7e2406bc70 2023-11-28T20:03:11.944 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:11.936+0000 7f7e0bfff640 1 -- 172.21.15.78:0/2250671587 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e140075e0 con 0x7f7e2406bc70 2023-11-28T20:03:11.944 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:11.936+0000 7f7e0bfff640 1 -- 172.21.15.78:0/2250671587 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e14004a10 con 0x7f7e2406bc70 2023-11-28T20:03:11.944 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:11.936+0000 7f7e29caa640 1 -- 172.21.15.78:0/2250671587 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7e1c009a70 con 0x7f7e2406bc70 2023-11-28T20:03:11.944 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:11.936+0000 7f7e29caa640 1 -- 172.21.15.78:0/2250671587 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7e24141320 con 0x7f7e2406bc70 2023-11-28T20:03:11.945 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:11.936+0000 7f7e29caa640 1 -- 172.21.15.78:0/2250671587 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7e240a5410 con 0x7f7e2406bc70 2023-11-28T20:03:11.945 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:11.936+0000 7f7e0bfff640 1 -- 172.21.15.78:0/2250671587 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f7e14004b70 con 0x7f7e2406bc70 2023-11-28T20:03:11.945 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:11.940+0000 7f7e0bfff640 1 --2- 172.21.15.78:0/2250671587 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f7e10066470 0x7f7e10068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:03:11.945 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:11.940+0000 7f7e0bfff640 1 -- 172.21.15.78:0/2250671587 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 5349+0+0 (secure 0 0 0) 0x7f7e14082dd0 con 0x7f7e2406bc70 2023-11-28T20:03:11.945 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:11.940+0000 7f7e22ffd640 1 --2- 172.21.15.78:0/2250671587 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f7e10066470 0x7f7e10068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:03:11.946 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:11.940+0000 7f7e22ffd640 1 --2- 172.21.15.78:0/2250671587 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f7e10066470 0x7f7e10068930 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7f7e240a5b00 tx=0x7f7e1800b450 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:03:11.947 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:11.944+0000 7f7e0bfff640 1 -- 172.21.15.78:0/2250671587 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f7e140504f0 con 0x7f7e2406bc70 2023-11-28T20:03:12.100 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:12.096+0000 7f7e29caa640 1 -- 172.21.15.78:0/2250671587 --> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "4", "target": ["mon-mgr", ""]}) v1 -- 0x7f7e24151720 con 0x7f7e10066470 2023-11-28T20:03:12.100 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:12.096+0000 7f7e0bfff640 1 -- 172.21.15.78:0/2250671587 <== mgr.4106 v2:172.21.15.78:6832/2935380957 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 4 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f7e1800bc00 con 0x7f7e10066470 2023-11-28T20:03:12.100 INFO:teuthology.orchestra.run.smithi078.stderr:instructed osd(s) 4 to deep-scrub 2023-11-28T20:03:12.102 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:12.096+0000 7f7e29caa640 1 -- 172.21.15.78:0/2250671587 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f7e10066470 msgr2=0x7f7e10068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:03:12.102 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:12.096+0000 7f7e29caa640 1 --2- 172.21.15.78:0/2250671587 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f7e10066470 0x7f7e10068930 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7f7e240a5b00 tx=0x7f7e1800b450 comp rx=0 tx=0).stop 2023-11-28T20:03:12.102 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:12.096+0000 7f7e29caa640 1 -- 172.21.15.78:0/2250671587 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7e2406bc70 msgr2=0x7f7e241479b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:03:12.102 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:12.096+0000 7f7e29caa640 1 --2- 172.21.15.78:0/2250671587 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7e2406bc70 0x7f7e241479b0 secure :-1 s=READY pgs=1167 cs=0 l=1 rev1=1 crypto rx=0x7f7e1400c490 tx=0x7f7e1400c950 comp rx=0 tx=0).stop 2023-11-28T20:03:12.103 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:12.096+0000 7f7e29caa640 1 -- 172.21.15.78:0/2250671587 shutdown_connections 2023-11-28T20:03:12.103 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:12.096+0000 7f7e29caa640 1 --2- 172.21.15.78:0/2250671587 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f7e10066470 0x7f7e10068930 unknown :-1 s=CLOSED pgs=552 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:03:12.103 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:12.096+0000 7f7e29caa640 1 --2- 172.21.15.78:0/2250671587 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7e240c66b0 0x7f7e2413afc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:03:12.103 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:12.096+0000 7f7e29caa640 1 --2- 172.21.15.78:0/2250671587 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7e2414e550 0x7f7e2413b500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:03:12.103 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:12.096+0000 7f7e29caa640 1 --2- 172.21.15.78:0/2250671587 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7e2406bc70 0x7f7e241479b0 unknown :-1 s=CLOSED pgs=1167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:03:12.103 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:12.096+0000 7f7e29caa640 1 -- 172.21.15.78:0/2250671587 >> 172.21.15.78:0/2250671587 conn(0x7f7e2406b220 msgr2=0x7f7e2414f410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:03:12.104 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:12.096+0000 7f7e29caa640 1 -- 172.21.15.78:0/2250671587 shutdown_connections 2023-11-28T20:03:12.104 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:12.096+0000 7f7e29caa640 1 -- 172.21.15.78:0/2250671587 wait complete. 2023-11-28T20:03:12.121 INFO:tasks.ceph:Scrubbing osd.5 2023-11-28T20:03:12.121 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 config set osd_debug_deep_scrub_sleep 0 2023-11-28T20:03:12.262 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:12.256+0000 7fcedd2d6640 1 Processor -- start 2023-11-28T20:03:12.263 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:12.256+0000 7fcedd2d6640 1 -- start start 2023-11-28T20:03:12.265 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:12.260+0000 7fcedd2d6640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fced814b1e0 0x7fced80c1700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:03:12.265 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:12.260+0000 7fcedd2d6640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fced80a4e20 con 0x7fced80c5300 2023-11-28T20:03:12.265 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:12.260+0000 7fcedd2d6640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fced80a50e0 con 0x7fced81548c0 2023-11-28T20:03:12.265 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:12.260+0000 7fcedd2d6640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fced80c0f00 con 0x7fced814b1e0 2023-11-28T20:03:12.266 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:12.260+0000 7fcece7fc640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7fced80c5300 0x7fced80a9c30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:43014/0 (socket says 172.21.15.78:43014) 2023-11-28T20:03:12.266 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:12.260+0000 7fcece7fc640 1 -- 172.21.15.78:0/1780527096 learned_addr learned my addr 172.21.15.78:0/1780527096 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-11-28T20:03:12.266 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:12.260+0000 7fced6ffd640 1 --2- 172.21.15.78:0/1780527096 >> v2:172.21.15.179:3300/0 conn(0x7fced814b1e0 0x7fced80c1700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:03:12.266 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:12.260+0000 7fced67fc640 1 -- 172.21.15.78:0/1780527096 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 744858406 0 0) 0x7fced80a4e20 con 0x7fced80c5300 2023-11-28T20:03:12.267 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:12.260+0000 7fced67fc640 1 -- 172.21.15.78:0/1780527096 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcec4003530 con 0x7fced80c5300 2023-11-28T20:03:12.267 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:12.260+0000 7fced67fc640 1 -- 172.21.15.78:0/1780527096 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2740478192 0 0) 0x7fced80a50e0 con 0x7fced81548c0 2023-11-28T20:03:12.267 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:12.260+0000 7fced67fc640 1 -- 172.21.15.78:0/1780527096 --> v1:172.21.15.179:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fced80a4e20 con 0x7fced81548c0 2023-11-28T20:03:12.268 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:12.260+0000 7fced6ffd640 1 -- 172.21.15.78:0/1780527096 >> v1:172.21.15.179:6789/0 conn(0x7fced81548c0 legacy=0x7fced8154d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:03:12.268 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:12.260+0000 7fced6ffd640 1 -- 172.21.15.78:0/1780527096 >> v1:172.21.15.78:6789/0 conn(0x7fced80c5300 legacy=0x7fced80a9c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:03:12.268 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:12.260+0000 7fced6ffd640 1 -- 172.21.15.78:0/1780527096 --> v2:172.21.15.179:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fced80c11e0 con 0x7fced814b1e0 2023-11-28T20:03:12.269 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:12.264+0000 7fced6ffd640 1 --2- 172.21.15.78:0/1780527096 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fced814b1e0 0x7fced80c1700 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7fcec8009d90 tx=0x7fcec801c950 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ec942857b37c3499 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:03:12.270 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:12.264+0000 7fced67fc640 1 -- 172.21.15.78:0/1780527096 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcec80a5810 con 0x7fced814b1e0 2023-11-28T20:03:12.270 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:12.264+0000 7fced67fc640 1 -- 172.21.15.78:0/1780527096 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcec80a5970 con 0x7fced814b1e0 2023-11-28T20:03:12.270 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:12.264+0000 7fced67fc640 1 -- 172.21.15.78:0/1780527096 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcec80a5d00 con 0x7fced814b1e0 2023-11-28T20:03:12.270 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:12.264+0000 7fcedd2d6640 1 -- 172.21.15.78:0/1780527096 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fced814b1e0 msgr2=0x7fced80c1700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:03:12.270 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:12.264+0000 7fcedd2d6640 1 --2- 172.21.15.78:0/1780527096 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fced814b1e0 0x7fced80c1700 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7fcec8009d90 tx=0x7fcec801c950 comp rx=0 tx=0).stop 2023-11-28T20:03:12.270 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:12.264+0000 7fcedd2d6640 1 -- 172.21.15.78:0/1780527096 shutdown_connections 2023-11-28T20:03:12.270 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:12.264+0000 7fcedd2d6640 1 --2- 172.21.15.78:0/1780527096 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fced814b1e0 0x7fced80c1700 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:03:12.271 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:12.264+0000 7fcedd2d6640 1 -- 172.21.15.78:0/1780527096 >> 172.21.15.78:0/1780527096 conn(0x7fced80c59f0 msgr2=0x7fced80c5e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:03:12.271 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:12.264+0000 7fcedd2d6640 1 -- 172.21.15.78:0/1780527096 shutdown_connections 2023-11-28T20:03:12.271 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:12.264+0000 7fcedd2d6640 1 -- 172.21.15.78:0/1780527096 wait complete. 2023-11-28T20:03:12.274 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:12.264+0000 7fcedd2d6640 1 Processor -- start 2023-11-28T20:03:12.274 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:12.264+0000 7fcedd2d6640 1 -- start start 2023-11-28T20:03:12.275 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:12.268+0000 7fcedd2d6640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fced80c5300 0x7fced8148190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:03:12.275 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:12.268+0000 7fcedd2d6640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fced814b1e0 0x7fced8070f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:03:12.275 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:12.268+0000 7fcedd2d6640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fced81548c0 0x7fced8071470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:03:12.276 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:12.268+0000 7fcedd2d6640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fced813f970 con 0x7fced80c5300 2023-11-28T20:03:12.276 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:12.268+0000 7fcedd2d6640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fced81ebca0 con 0x7fced814b1e0 2023-11-28T20:03:12.276 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:12.268+0000 7fcedd2d6640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fced8072600 con 0x7fced81548c0 2023-11-28T20:03:12.276 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:12.268+0000 7fced6ffd640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fced80c5300 0x7fced8148190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:03:12.277 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:12.268+0000 7fced6ffd640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fced80c5300 0x7fced8148190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:47846/0 (socket says 172.21.15.78:47846) 2023-11-28T20:03:12.277 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:12.268+0000 7fced6ffd640 1 -- 172.21.15.78:0/1633869131 learned_addr learned my addr 172.21.15.78:0/1633869131 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T20:03:12.277 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:12.268+0000 7fcece7fc640 1 --2- 172.21.15.78:0/1633869131 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fced814b1e0 0x7fced8070f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:03:12.277 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:12.268+0000 7fced77fe640 1 --2- 172.21.15.78:0/1633869131 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fced81548c0 0x7fced8071470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:03:12.277 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:12.268+0000 7fced6ffd640 1 -- 172.21.15.78:0/1633869131 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fced81548c0 msgr2=0x7fced8071470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:03:12.278 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:12.268+0000 7fced6ffd640 1 --2- 172.21.15.78:0/1633869131 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fced81548c0 0x7fced8071470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:03:12.278 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:12.268+0000 7fced6ffd640 1 -- 172.21.15.78:0/1633869131 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fced814b1e0 msgr2=0x7fced8070f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:03:12.278 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:12.268+0000 7fced6ffd640 1 --2- 172.21.15.78:0/1633869131 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fced814b1e0 0x7fced8070f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:03:12.278 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:12.268+0000 7fced6ffd640 1 -- 172.21.15.78:0/1633869131 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcec8009a70 con 0x7fced80c5300 2023-11-28T20:03:12.278 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:12.268+0000 7fced77fe640 1 --2- 172.21.15.78:0/1633869131 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fced81548c0 0x7fced8071470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T20:03:12.279 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:12.268+0000 7fced6ffd640 1 --2- 172.21.15.78:0/1633869131 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fced80c5300 0x7fced8148190 secure :-1 s=READY pgs=1169 cs=0 l=1 rev1=1 crypto rx=0x7fcec80b0040 tx=0x7fcec80196f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:03:12.279 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:12.268+0000 7fcecffff640 1 -- 172.21.15.78:0/1633869131 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcec80ad640 con 0x7fced80c5300 2023-11-28T20:03:12.279 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:12.268+0000 7fcecffff640 1 -- 172.21.15.78:0/1633869131 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcec80ad7a0 con 0x7fced80c5300 2023-11-28T20:03:12.279 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:12.268+0000 7fcecffff640 1 -- 172.21.15.78:0/1633869131 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcec80adb30 con 0x7fced80c5300 2023-11-28T20:03:12.279 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:12.268+0000 7fcedd2d6640 1 -- 172.21.15.78:0/1633869131 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fced81eb120 con 0x7fced80c5300 2023-11-28T20:03:12.279 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:12.268+0000 7fcedd2d6640 1 -- 172.21.15.78:0/1633869131 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fced81eb6e0 con 0x7fced80c5300 2023-11-28T20:03:12.280 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:12.268+0000 7fcedd2d6640 1 -- 172.21.15.78:0/1633869131 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fced814b7d0 con 0x7fced80c5300 2023-11-28T20:03:12.280 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:12.268+0000 7fcecffff640 1 -- 172.21.15.78:0/1633869131 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fcec80b4050 con 0x7fced80c5300 2023-11-28T20:03:12.281 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:12.272+0000 7fcecffff640 1 --2- 172.21.15.78:0/1633869131 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fceb8066470 0x7fceb8068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:03:12.281 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:12.272+0000 7fcecffff640 1 -- 172.21.15.78:0/1633869131 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 5349+0+0 (secure 0 0 0) 0x7fcec811efa0 con 0x7fced80c5300 2023-11-28T20:03:12.282 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:12.272+0000 7fcece7fc640 1 --2- 172.21.15.78:0/1633869131 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fceb8066470 0x7fceb8068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:03:12.282 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:12.272+0000 7fcecffff640 1 --2- 172.21.15.78:0/1633869131 >> [v2:172.21.15.179:6816/518192887,v1:172.21.15.179:6818/518192887] conn(0x7fceb806c810 0x7fceb806ec50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:03:12.282 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:12.272+0000 7fcecffff640 1 -- 172.21.15.78:0/1633869131 --> [v2:172.21.15.179:6816/518192887,v1:172.21.15.179:6818/518192887] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fceb806f320 con 0x7fceb806c810 2023-11-28T20:03:12.282 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:12.272+0000 7fcecffff640 1 -- 172.21.15.78:0/1633869131 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_get_version_reply(handle=1 version=93) v2 ==== 24+0+0 (secure 0 0 0) 0x7fcec811f310 con 0x7fced80c5300 2023-11-28T20:03:12.282 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:12.272+0000 7fced77fe640 1 --2- 172.21.15.78:0/1633869131 >> [v2:172.21.15.179:6816/518192887,v1:172.21.15.179:6818/518192887] conn(0x7fceb806c810 0x7fceb806ec50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:03:12.282 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:12.272+0000 7fcece7fc640 1 --2- 172.21.15.78:0/1633869131 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fceb8066470 0x7fceb8068930 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7fced80c0b10 tx=0x7fcec0007d80 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:03:12.282 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:12.272+0000 7fced77fe640 1 --2- 172.21.15.78:0/1633869131 >> [v2:172.21.15.179:6816/518192887,v1:172.21.15.179:6818/518192887] conn(0x7fceb806c810 0x7fceb806ec50 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:03:12.283 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:12.272+0000 7fcecffff640 1 -- 172.21.15.78:0/1633869131 <== osd.5 v2:172.21.15.179:6816/518192887 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7fceb806f320 con 0x7fceb806c810 2023-11-28T20:03:12.290 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:12.284+0000 7fcedd2d6640 1 -- 172.21.15.78:0/1633869131 --> [v2:172.21.15.179:6816/518192887,v1:172.21.15.179:6818/518192887] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fced8067630 con 0x7fceb806c810 2023-11-28T20:03:12.290 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:12.284+0000 7fcecffff640 1 -- 172.21.15.78:0/1633869131 <== osd.5 v2:172.21.15.179:6816/518192887 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7fced8067630 con 0x7fceb806c810 2023-11-28T20:03:12.291 INFO:teuthology.orchestra.run.smithi078.stdout:{ 2023-11-28T20:03:12.291 INFO:teuthology.orchestra.run.smithi078.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2023-11-28T20:03:12.291 INFO:teuthology.orchestra.run.smithi078.stdout:} 2023-11-28T20:03:12.292 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:12.288+0000 7fcedd2d6640 1 -- 172.21.15.78:0/1633869131 >> [v2:172.21.15.179:6816/518192887,v1:172.21.15.179:6818/518192887] conn(0x7fceb806c810 msgr2=0x7fceb806ec50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:03:12.293 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:12.288+0000 7fcedd2d6640 1 --2- 172.21.15.78:0/1633869131 >> [v2:172.21.15.179:6816/518192887,v1:172.21.15.179:6818/518192887] conn(0x7fceb806c810 0x7fceb806ec50 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:03:12.293 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:12.288+0000 7fcedd2d6640 1 -- 172.21.15.78:0/1633869131 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fceb8066470 msgr2=0x7fceb8068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:03:12.293 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:12.288+0000 7fcedd2d6640 1 --2- 172.21.15.78:0/1633869131 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fceb8066470 0x7fceb8068930 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7fced80c0b10 tx=0x7fcec0007d80 comp rx=0 tx=0).stop 2023-11-28T20:03:12.294 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:12.288+0000 7fcedd2d6640 1 -- 172.21.15.78:0/1633869131 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fced80c5300 msgr2=0x7fced8148190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:03:12.294 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:12.288+0000 7fcedd2d6640 1 --2- 172.21.15.78:0/1633869131 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fced80c5300 0x7fced8148190 secure :-1 s=READY pgs=1169 cs=0 l=1 rev1=1 crypto rx=0x7fcec80b0040 tx=0x7fcec80196f0 comp rx=0 tx=0).stop 2023-11-28T20:03:12.294 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:12.288+0000 7fced77fe640 1 -- 172.21.15.78:0/1633869131 reap_dead start 2023-11-28T20:03:12.294 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:12.288+0000 7fcedd2d6640 1 -- 172.21.15.78:0/1633869131 shutdown_connections 2023-11-28T20:03:12.295 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:12.288+0000 7fcedd2d6640 1 -- 172.21.15.78:0/1633869131 >> 172.21.15.78:0/1633869131 conn(0x7fced80c59f0 msgr2=0x7fced80c4a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:03:12.295 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:12.288+0000 7fcedd2d6640 1 -- 172.21.15.78:0/1633869131 shutdown_connections 2023-11-28T20:03:12.295 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:12.288+0000 7fcedd2d6640 1 -- 172.21.15.78:0/1633869131 wait complete. 2023-11-28T20:03:12.309 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 5 2023-11-28T20:03:12.448 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:12.444+0000 7f9d0517d640 1 Processor -- start 2023-11-28T20:03:12.448 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:12.444+0000 7f9d0517d640 1 -- start start 2023-11-28T20:03:12.451 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:12.444+0000 7f9d0517d640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f9d000c6650 0x7f9d00154f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:03:12.451 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:12.444+0000 7f9d0517d640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9d000c45f0 con 0x7f9d000c6a30 2023-11-28T20:03:12.451 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:12.444+0000 7f9d0517d640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9d000c50e0 con 0x7f9d00158540 2023-11-28T20:03:12.452 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:12.444+0000 7f9d0517d640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9d000c6e90 con 0x7f9d000c6650 2023-11-28T20:03:12.452 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:12.444+0000 7f9cff7fe640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f9d000c6a30 0x7f9d00157e30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:43026/0 (socket says 172.21.15.78:43026) 2023-11-28T20:03:12.452 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:12.444+0000 7f9cff7fe640 1 -- 172.21.15.78:0/4172910697 learned_addr learned my addr 172.21.15.78:0/4172910697 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-11-28T20:03:12.452 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:12.444+0000 7f9cfffff640 1 --2- 172.21.15.78:0/4172910697 >> v2:172.21.15.179:3300/0 conn(0x7f9d000c6650 0x7f9d00154f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:03:12.452 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:12.444+0000 7f9cfeffd640 1 -- 172.21.15.78:0/4172910697 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4023151721 0 0) 0x7f9d000c45f0 con 0x7f9d000c6a30 2023-11-28T20:03:12.452 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:12.444+0000 7f9cfeffd640 1 -- 172.21.15.78:0/4172910697 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9ce8003530 con 0x7f9d000c6a30 2023-11-28T20:03:12.452 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:12.444+0000 7f9cfeffd640 1 -- 172.21.15.78:0/4172910697 <== mon.0 v1:172.21.15.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1227233920 0 0) 0x7f9ce8003530 con 0x7f9d000c6a30 2023-11-28T20:03:12.453 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:12.444+0000 7f9cfeffd640 1 -- 172.21.15.78:0/4172910697 >> v2:172.21.15.179:3300/0 conn(0x7f9d000c6650 msgr2=0x7f9d00154f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:03:12.453 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:12.444+0000 7f9cfeffd640 1 --2- 172.21.15.78:0/4172910697 >> v2:172.21.15.179:3300/0 conn(0x7f9d000c6650 0x7f9d00154f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:03:12.453 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:12.444+0000 7f9cfeffd640 1 -- 172.21.15.78:0/4172910697 >> v1:172.21.15.179:6789/0 conn(0x7f9d00158540 legacy=0x7f9d0015ee50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:03:12.453 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:12.444+0000 7f9cfeffd640 1 -- 172.21.15.78:0/4172910697 --> v1:172.21.15.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d001589d0 con 0x7f9d000c6a30 2023-11-28T20:03:12.453 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:12.444+0000 7f9cfeffd640 1 -- 172.21.15.78:0/4172910697 <== mon.0 v1:172.21.15.78:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3326804700 0 0) 0x7f9cf4001680 con 0x7f9d000c6a30 2023-11-28T20:03:12.453 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:12.444+0000 7f9cfeffd640 1 -- 172.21.15.78:0/4172910697 >> v1:172.21.15.78:6789/0 conn(0x7f9d000c6a30 legacy=0x7f9d00157e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:03:12.453 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:12.444+0000 7f9cfeffd640 1 --2- 172.21.15.78:0/4172910697 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9ce8003980 0x7f9ce8003d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:03:12.453 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:12.444+0000 7f9cfeffd640 1 --2- 172.21.15.78:0/4172910697 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9ce8004380 0x7f9ce8004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:03:12.454 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:12.444+0000 7f9cfeffd640 1 --2- 172.21.15.78:0/4172910697 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9ce80050f0 0x7f9ce800b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:03:12.454 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:12.444+0000 7f9cfeffd640 1 -- 172.21.15.78:0/4172910697 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d000c6e90 con 0x7f9ce80050f0 2023-11-28T20:03:12.454 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:12.444+0000 7f9cfeffd640 1 -- 172.21.15.78:0/4172910697 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ce800c030 con 0x7f9ce8003980 2023-11-28T20:03:12.454 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:12.444+0000 7f9cfeffd640 1 -- 172.21.15.78:0/4172910697 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ce800c1f0 con 0x7f9ce8004380 2023-11-28T20:03:12.454 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:12.448+0000 7f9d0497c640 1 --2- 172.21.15.78:0/4172910697 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9ce80050f0 0x7f9ce800b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:03:12.454 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:12.448+0000 7f9cff7fe640 1 --2- 172.21.15.78:0/4172910697 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9ce8004380 0x7f9ce8004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:03:12.454 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:12.448+0000 7f9cfffff640 1 --2- 172.21.15.78:0/4172910697 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9ce8003980 0x7f9ce8003d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:03:12.454 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:12.448+0000 7f9d0497c640 1 -- 172.21.15.78:0/4172910697 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9ce8004380 msgr2=0x7f9ce8004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:03:12.455 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:12.448+0000 7f9d0497c640 1 --2- 172.21.15.78:0/4172910697 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9ce8004380 0x7f9ce8004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:03:12.455 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:12.448+0000 7f9d0497c640 1 -- 172.21.15.78:0/4172910697 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9ce8003980 msgr2=0x7f9ce8003d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:03:12.455 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:12.448+0000 7f9d0497c640 1 --2- 172.21.15.78:0/4172910697 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9ce8003980 0x7f9ce8003d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:03:12.455 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:12.448+0000 7f9d0497c640 1 -- 172.21.15.78:0/4172910697 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ce8003530 con 0x7f9ce80050f0 2023-11-28T20:03:12.456 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:12.448+0000 7f9d0497c640 1 -- 172.21.15.78:0/4172910697 reap_dead start 2023-11-28T20:03:12.456 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:12.448+0000 7f9d0497c640 1 --2- 172.21.15.78:0/4172910697 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9ce80050f0 0x7f9ce800b990 secure :-1 s=READY pgs=1171 cs=0 l=1 rev1=1 crypto rx=0x7f9cf8001e70 tx=0x7f9cf801c760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9b5b7996b7abd58d server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:03:12.457 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:12.448+0000 7f9cfeffd640 1 -- 172.21.15.78:0/4172910697 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cf8003b80 con 0x7f9ce80050f0 2023-11-28T20:03:12.457 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:12.448+0000 7f9cfeffd640 1 -- 172.21.15.78:0/4172910697 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9cf8003d00 con 0x7f9ce80050f0 2023-11-28T20:03:12.457 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:12.448+0000 7f9cfeffd640 1 -- 172.21.15.78:0/4172910697 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cf8005260 con 0x7f9ce80050f0 2023-11-28T20:03:12.457 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:12.448+0000 7f9d0517d640 1 -- 172.21.15.78:0/4172910697 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9ce80050f0 msgr2=0x7f9ce800b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:03:12.457 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:12.448+0000 7f9d0517d640 1 --2- 172.21.15.78:0/4172910697 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9ce80050f0 0x7f9ce800b990 secure :-1 s=READY pgs=1171 cs=0 l=1 rev1=1 crypto rx=0x7f9cf8001e70 tx=0x7f9cf801c760 comp rx=0 tx=0).stop 2023-11-28T20:03:12.457 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:12.452+0000 7f9d0517d640 1 -- 172.21.15.78:0/4172910697 shutdown_connections 2023-11-28T20:03:12.457 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:12.452+0000 7f9d0517d640 1 --2- 172.21.15.78:0/4172910697 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9ce80050f0 0x7f9ce800b990 unknown :-1 s=CLOSED pgs=1171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:03:12.458 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:12.452+0000 7f9d0517d640 1 -- 172.21.15.78:0/4172910697 >> 172.21.15.78:0/4172910697 conn(0x7f9d000ab9d0 msgr2=0x7f9d000abde0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:03:12.458 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:12.452+0000 7f9d0517d640 1 -- 172.21.15.78:0/4172910697 shutdown_connections 2023-11-28T20:03:12.458 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:12.452+0000 7f9d0517d640 1 -- 172.21.15.78:0/4172910697 wait complete. 2023-11-28T20:03:12.458 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:12.452+0000 7f9d0517d640 1 Processor -- start 2023-11-28T20:03:12.458 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:12.452+0000 7f9d0517d640 1 -- start start 2023-11-28T20:03:12.460 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:12.452+0000 7f9d0517d640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9ce80050f0 0x7f9d000c1600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:03:12.460 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:12.452+0000 7f9d0517d640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9d00151200 0x7f9d000c9840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:03:12.460 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:12.452+0000 7f9d0517d640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9d000c9d80 0x7f9d000c87e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:03:12.460 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:12.452+0000 7f9d0517d640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d00150eb0 con 0x7f9d00151200 2023-11-28T20:03:12.460 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:12.452+0000 7f9d0517d640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d001506a0 con 0x7f9ce80050f0 2023-11-28T20:03:12.460 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:12.452+0000 7f9d0517d640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d000c3bc0 con 0x7f9d000c9d80 2023-11-28T20:03:12.460 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:12.452+0000 7f9cff7fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9d00151200 0x7f9d000c9840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:03:12.461 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:12.452+0000 7f9cff7fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9d00151200 0x7f9d000c9840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:47870/0 (socket says 172.21.15.78:47870) 2023-11-28T20:03:12.461 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:12.452+0000 7f9cff7fe640 1 -- 172.21.15.78:0/2976685347 learned_addr learned my addr 172.21.15.78:0/2976685347 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T20:03:12.461 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:12.452+0000 7f9cff7fe640 1 -- 172.21.15.78:0/2976685347 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9d000c9d80 msgr2=0x7f9d000c87e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:03:12.461 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:12.452+0000 7f9cff7fe640 1 --2- 172.21.15.78:0/2976685347 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9d000c9d80 0x7f9d000c87e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:03:12.461 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:12.452+0000 7f9cff7fe640 1 -- 172.21.15.78:0/2976685347 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9ce80050f0 msgr2=0x7f9d000c1600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:03:12.461 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:12.452+0000 7f9cff7fe640 1 --2- 172.21.15.78:0/2976685347 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9ce80050f0 0x7f9d000c1600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:03:12.461 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:12.452+0000 7f9cff7fe640 1 -- 172.21.15.78:0/2976685347 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d001508f0 con 0x7f9d00151200 2023-11-28T20:03:12.462 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:12.452+0000 7f9cff7fe640 1 --2- 172.21.15.78:0/2976685347 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9d00151200 0x7f9d000c9840 secure :-1 s=READY pgs=1172 cs=0 l=1 rev1=1 crypto rx=0x7f9cf40076a0 tx=0x7f9cf40076d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:03:12.462 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:12.456+0000 7f9cfcff9640 1 -- 172.21.15.78:0/2976685347 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cf4007ea0 con 0x7f9d00151200 2023-11-28T20:03:12.462 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:12.456+0000 7f9cfcff9640 1 -- 172.21.15.78:0/2976685347 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9cf4016610 con 0x7f9d00151200 2023-11-28T20:03:12.462 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:12.456+0000 7f9cfcff9640 1 -- 172.21.15.78:0/2976685347 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cf40169c0 con 0x7f9d00151200 2023-11-28T20:03:12.462 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:12.456+0000 7f9d0517d640 1 -- 172.21.15.78:0/2976685347 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9d00150bd0 con 0x7f9d00151200 2023-11-28T20:03:12.462 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:12.456+0000 7f9d0517d640 1 -- 172.21.15.78:0/2976685347 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9d000c36a0 con 0x7f9d00151200 2023-11-28T20:03:12.462 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:12.456+0000 7f9d0517d640 1 -- 172.21.15.78:0/2976685347 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9d000c3200 con 0x7f9d00151200 2023-11-28T20:03:12.463 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:12.456+0000 7f9cfcff9640 1 -- 172.21.15.78:0/2976685347 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f9cf4016b20 con 0x7f9d00151200 2023-11-28T20:03:12.463 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:12.456+0000 7f9cfcff9640 1 --2- 172.21.15.78:0/2976685347 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f9cec066470 0x7f9cec068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:03:12.464 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:12.456+0000 7f9cfcff9640 1 -- 172.21.15.78:0/2976685347 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 5349+0+0 (secure 0 0 0) 0x7f9cf4086b60 con 0x7f9d00151200 2023-11-28T20:03:12.464 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:12.456+0000 7f9cfffff640 1 --2- 172.21.15.78:0/2976685347 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f9cec066470 0x7f9cec068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:03:12.464 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:12.456+0000 7f9cfffff640 1 --2- 172.21.15.78:0/2976685347 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f9cec066470 0x7f9cec068930 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7f9cf0009a60 tx=0x7f9cf0009340 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:03:12.465 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:12.460+0000 7f9cfcff9640 1 -- 172.21.15.78:0/2976685347 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f9cf4054130 con 0x7f9d00151200 2023-11-28T20:03:12.613 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:12.608+0000 7f9d0517d640 1 -- 172.21.15.78:0/2976685347 --> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "5", "target": ["mon-mgr", ""]}) v1 -- 0x7f9d000c4e00 con 0x7f9cec066470 2023-11-28T20:03:12.613 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:12.608+0000 7f9cfcff9640 1 -- 172.21.15.78:0/2976685347 <== mgr.4106 v2:172.21.15.78:6832/2935380957 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 5 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f9cf0011900 con 0x7f9cec066470 2023-11-28T20:03:12.614 INFO:teuthology.orchestra.run.smithi078.stderr:instructed osd(s) 5 to deep-scrub 2023-11-28T20:03:12.615 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:12.612+0000 7f9d0517d640 1 -- 172.21.15.78:0/2976685347 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f9cec066470 msgr2=0x7f9cec068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:03:12.615 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:12.612+0000 7f9d0517d640 1 --2- 172.21.15.78:0/2976685347 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f9cec066470 0x7f9cec068930 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7f9cf0009a60 tx=0x7f9cf0009340 comp rx=0 tx=0).stop 2023-11-28T20:03:12.615 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:12.612+0000 7f9d0517d640 1 -- 172.21.15.78:0/2976685347 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9d00151200 msgr2=0x7f9d000c9840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:03:12.616 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:12.612+0000 7f9d0517d640 1 --2- 172.21.15.78:0/2976685347 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9d00151200 0x7f9d000c9840 secure :-1 s=READY pgs=1172 cs=0 l=1 rev1=1 crypto rx=0x7f9cf40076a0 tx=0x7f9cf40076d0 comp rx=0 tx=0).stop 2023-11-28T20:03:12.616 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:12.612+0000 7f9d0517d640 1 -- 172.21.15.78:0/2976685347 shutdown_connections 2023-11-28T20:03:12.616 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:12.612+0000 7f9d0517d640 1 --2- 172.21.15.78:0/2976685347 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f9cec066470 0x7f9cec068930 unknown :-1 s=CLOSED pgs=554 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:03:12.616 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:12.612+0000 7f9d0517d640 1 --2- 172.21.15.78:0/2976685347 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9d000c9d80 0x7f9d000c87e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:03:12.616 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:12.612+0000 7f9d0517d640 1 --2- 172.21.15.78:0/2976685347 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9d00151200 0x7f9d000c9840 unknown :-1 s=CLOSED pgs=1172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:03:12.616 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:12.612+0000 7f9d0517d640 1 --2- 172.21.15.78:0/2976685347 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9ce80050f0 0x7f9d000c1600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:03:12.616 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:12.612+0000 7f9d0517d640 1 -- 172.21.15.78:0/2976685347 >> 172.21.15.78:0/2976685347 conn(0x7f9d000ab9d0 msgr2=0x7f9d00149ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:03:12.616 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:12.612+0000 7f9d0517d640 1 -- 172.21.15.78:0/2976685347 shutdown_connections 2023-11-28T20:03:12.617 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:12.612+0000 7f9d0517d640 1 -- 172.21.15.78:0/2976685347 wait complete. 2023-11-28T20:03:12.635 INFO:tasks.ceph:Scrubbing osd.6 2023-11-28T20:03:12.635 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 config set osd_debug_deep_scrub_sleep 0 2023-11-28T20:03:12.775 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:12.772+0000 7f73fcb1d640 1 Processor -- start 2023-11-28T20:03:12.775 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:12.772+0000 7f73fcb1d640 1 -- start start 2023-11-28T20:03:12.777 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:12.772+0000 7f73fcb1d640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f73f814e2a0 0x7f73f81516a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:03:12.777 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:12.772+0000 7f73fcb1d640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f73f80a9460 0x7f73f80c4180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:03:12.777 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:12.772+0000 7f73fcb1d640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f73f80a9910 0x7f73f806bc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:03:12.777 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:12.772+0000 7f73fcb1d640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f73f8151210 con 0x7f73f814e2a0 2023-11-28T20:03:12.777 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:12.772+0000 7f73fcb1d640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f73f814e680 con 0x7f73f80a9460 2023-11-28T20:03:12.777 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:12.772+0000 7f73fcb1d640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f73f8150be0 con 0x7f73f80a9910 2023-11-28T20:03:12.778 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:12.772+0000 7f73f659c640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f73f814e2a0 0x7f73f81516a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:03:12.778 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:12.772+0000 7f73f659c640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f73f814e2a0 0x7f73f81516a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:47880/0 (socket says 172.21.15.78:47880) 2023-11-28T20:03:12.778 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:12.772+0000 7f73f659c640 1 -- 172.21.15.78:0/1482387300 learned_addr learned my addr 172.21.15.78:0/1482387300 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T20:03:12.778 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:12.772+0000 7f73f5d9b640 1 --2- 172.21.15.78:0/1482387300 >> v2:172.21.15.179:3300/0 conn(0x7f73f80a9460 0x7f73f80c4180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:03:12.778 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:12.772+0000 7f73f6d9d640 1 --2- 172.21.15.78:0/1482387300 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f73f80a9910 0x7f73f806bc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:03:12.778 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:12.772+0000 7f73f659c640 1 -- 172.21.15.78:0/1482387300 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f73f80a9910 msgr2=0x7f73f806bc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:03:12.778 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:12.772+0000 7f73f659c640 1 --2- 172.21.15.78:0/1482387300 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f73f80a9910 0x7f73f806bc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:03:12.778 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:12.772+0000 7f73f659c640 1 -- 172.21.15.78:0/1482387300 >> v2:172.21.15.179:3300/0 conn(0x7f73f80a9460 msgr2=0x7f73f80c4180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:03:12.779 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:12.772+0000 7f73f659c640 1 --2- 172.21.15.78:0/1482387300 >> v2:172.21.15.179:3300/0 conn(0x7f73f80a9460 0x7f73f80c4180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:03:12.779 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:12.772+0000 7f73f659c640 1 -- 172.21.15.78:0/1482387300 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73f80c53c0 con 0x7f73f814e2a0 2023-11-28T20:03:12.779 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:12.776+0000 7f73f659c640 1 --2- 172.21.15.78:0/1482387300 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f73f814e2a0 0x7f73f81516a0 secure :-1 s=READY pgs=1173 cs=0 l=1 rev1=1 crypto rx=0x7f73f8066f50 tx=0x7f73e801c500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8759e60ea0b84212 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:03:12.780 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:12.776+0000 7f73f559a640 1 -- 172.21.15.78:0/1482387300 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73e80ac630 con 0x7f73f814e2a0 2023-11-28T20:03:12.780 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:12.776+0000 7f73f559a640 1 -- 172.21.15.78:0/1482387300 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f73e80ac790 con 0x7f73f814e2a0 2023-11-28T20:03:12.780 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:12.776+0000 7f73f559a640 1 -- 172.21.15.78:0/1482387300 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73e80acb20 con 0x7f73f814e2a0 2023-11-28T20:03:12.781 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:12.776+0000 7f73fcb1d640 1 -- 172.21.15.78:0/1482387300 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f73f814e2a0 msgr2=0x7f73f81516a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:03:12.781 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:12.776+0000 7f73fcb1d640 1 --2- 172.21.15.78:0/1482387300 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f73f814e2a0 0x7f73f81516a0 secure :-1 s=READY pgs=1173 cs=0 l=1 rev1=1 crypto rx=0x7f73f8066f50 tx=0x7f73e801c500 comp rx=0 tx=0).stop 2023-11-28T20:03:12.781 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:12.776+0000 7f73fcb1d640 1 -- 172.21.15.78:0/1482387300 shutdown_connections 2023-11-28T20:03:12.782 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:12.776+0000 7f73fcb1d640 1 --2- 172.21.15.78:0/1482387300 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f73f80a9910 0x7f73f806bc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:03:12.782 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:12.776+0000 7f73fcb1d640 1 --2- 172.21.15.78:0/1482387300 >> v2:172.21.15.179:3300/0 conn(0x7f73f80a9460 0x7f73f80c4180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:03:12.782 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:12.776+0000 7f73fcb1d640 1 --2- 172.21.15.78:0/1482387300 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f73f814e2a0 0x7f73f81516a0 unknown :-1 s=CLOSED pgs=1173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:03:12.782 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:12.776+0000 7f73fcb1d640 1 -- 172.21.15.78:0/1482387300 >> 172.21.15.78:0/1482387300 conn(0x7f73f80c59f0 msgr2=0x7f73f80c5e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:03:12.782 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:12.776+0000 7f73fcb1d640 1 -- 172.21.15.78:0/1482387300 shutdown_connections 2023-11-28T20:03:12.783 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:12.776+0000 7f73fcb1d640 1 -- 172.21.15.78:0/1482387300 wait complete. 2023-11-28T20:03:12.785 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:12.780+0000 7f73fcb1d640 1 Processor -- start 2023-11-28T20:03:12.785 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:12.780+0000 7f73fcb1d640 1 -- start start 2023-11-28T20:03:12.785 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:12.780+0000 7f73fcb1d640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f73f80a9460 0x7f73f8142dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:03:12.785 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:12.780+0000 7f73fcb1d640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f73f80a9910 0x7f73f8072370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:03:12.785 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:12.780+0000 7f73fcb1d640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f73f814e2a0 0x7f73f8070010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:03:12.785 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:12.780+0000 7f73fcb1d640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73f8071120 con 0x7f73f80a9910 2023-11-28T20:03:12.786 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:12.780+0000 7f73fcb1d640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73f8070d80 con 0x7f73f80a9460 2023-11-28T20:03:12.786 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:12.780+0000 7f73fcb1d640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f73f8152c60 con 0x7f73f814e2a0 2023-11-28T20:03:12.786 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:12.780+0000 7f73f5d9b640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f73f80a9910 0x7f73f8072370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:03:12.786 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:12.780+0000 7f73f5d9b640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f73f80a9910 0x7f73f8072370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:47886/0 (socket says 172.21.15.78:47886) 2023-11-28T20:03:12.786 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:12.780+0000 7f73f5d9b640 1 -- 172.21.15.78:0/1457540230 learned_addr learned my addr 172.21.15.78:0/1457540230 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T20:03:12.786 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:12.780+0000 7f73f659c640 1 --2- 172.21.15.78:0/1457540230 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f73f80a9460 0x7f73f8142dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:03:12.786 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:12.780+0000 7f73f6d9d640 1 --2- 172.21.15.78:0/1457540230 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f73f814e2a0 0x7f73f8070010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:03:12.787 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:12.780+0000 7f73f5d9b640 1 -- 172.21.15.78:0/1457540230 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f73f814e2a0 msgr2=0x7f73f8070010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:03:12.787 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:12.780+0000 7f73f5d9b640 1 --2- 172.21.15.78:0/1457540230 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f73f814e2a0 0x7f73f8070010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:03:12.787 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:12.780+0000 7f73f5d9b640 1 -- 172.21.15.78:0/1457540230 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f73f80a9460 msgr2=0x7f73f8142dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:03:12.787 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:12.780+0000 7f73f5d9b640 1 --2- 172.21.15.78:0/1457540230 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f73f80a9460 0x7f73f8142dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:03:12.787 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:12.780+0000 7f73f5d9b640 1 -- 172.21.15.78:0/1457540230 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73e80094d0 con 0x7f73f80a9910 2023-11-28T20:03:12.787 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:12.780+0000 7f73f659c640 1 --2- 172.21.15.78:0/1457540230 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f73f80a9460 0x7f73f8142dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T20:03:12.787 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:12.780+0000 7f73f5d9b640 1 --2- 172.21.15.78:0/1457540230 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f73f80a9910 0x7f73f8072370 secure :-1 s=READY pgs=1174 cs=0 l=1 rev1=1 crypto rx=0x7f73ec00e8b0 tx=0x7f73ec00ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:03:12.787 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:12.780+0000 7f73e6ffd640 1 -- 172.21.15.78:0/1457540230 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73ec00c940 con 0x7f73f80a9910 2023-11-28T20:03:12.788 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:12.780+0000 7f73e6ffd640 1 -- 172.21.15.78:0/1457540230 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f73ec00caa0 con 0x7f73f80a9910 2023-11-28T20:03:12.788 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:12.780+0000 7f73e6ffd640 1 -- 172.21.15.78:0/1457540230 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73ec00ce30 con 0x7f73f80a9910 2023-11-28T20:03:12.788 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:12.780+0000 7f73fcb1d640 1 -- 172.21.15.78:0/1457540230 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f73f8153220 con 0x7f73f80a9910 2023-11-28T20:03:12.788 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:12.780+0000 7f73fcb1d640 1 -- 172.21.15.78:0/1457540230 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f73f8153f60 con 0x7f73f80a9910 2023-11-28T20:03:12.789 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:12.780+0000 7f73fcb1d640 1 -- 172.21.15.78:0/1457540230 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f73f806d450 con 0x7f73f80a9910 2023-11-28T20:03:12.789 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:12.784+0000 7f73e6ffd640 1 -- 172.21.15.78:0/1457540230 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f73ec013470 con 0x7f73f80a9910 2023-11-28T20:03:12.789 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:12.784+0000 7f73e6ffd640 1 --2- 172.21.15.78:0/1457540230 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f73d8066470 0x7f73d8068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:03:12.790 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:12.784+0000 7f73e6ffd640 1 -- 172.21.15.78:0/1457540230 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 5349+0+0 (secure 0 0 0) 0x7f73ec083e50 con 0x7f73f80a9910 2023-11-28T20:03:12.790 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:12.784+0000 7f73f659c640 1 --2- 172.21.15.78:0/1457540230 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f73d8066470 0x7f73d8068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:03:12.790 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:12.784+0000 7f73e6ffd640 1 --2- 172.21.15.78:0/1457540230 >> [v2:172.21.15.179:6800/815435378,v1:172.21.15.179:6801/815435378] conn(0x7f73d806c810 0x7f73d806ec50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:03:12.790 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:12.784+0000 7f73e6ffd640 1 -- 172.21.15.78:0/1457540230 --> [v2:172.21.15.179:6800/815435378,v1:172.21.15.179:6801/815435378] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f73d806f320 con 0x7f73d806c810 2023-11-28T20:03:12.790 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:12.784+0000 7f73e6ffd640 1 -- 172.21.15.78:0/1457540230 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_get_version_reply(handle=1 version=93) v2 ==== 24+0+0 (secure 0 0 0) 0x7f73ec086430 con 0x7f73f80a9910 2023-11-28T20:03:12.790 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:12.784+0000 7f73f6d9d640 1 --2- 172.21.15.78:0/1457540230 >> [v2:172.21.15.179:6800/815435378,v1:172.21.15.179:6801/815435378] conn(0x7f73d806c810 0x7f73d806ec50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:03:12.791 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:12.784+0000 7f73f659c640 1 --2- 172.21.15.78:0/1457540230 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f73d8066470 0x7f73d8068930 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7f73e80ae000 tx=0x7f73e8008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:03:12.791 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:12.784+0000 7f73f6d9d640 1 --2- 172.21.15.78:0/1457540230 >> [v2:172.21.15.179:6800/815435378,v1:172.21.15.179:6801/815435378] conn(0x7f73d806c810 0x7f73d806ec50 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:03:12.791 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:12.784+0000 7f73e6ffd640 1 -- 172.21.15.78:0/1457540230 <== osd.6 v2:172.21.15.179:6800/815435378 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7f73d806f320 con 0x7f73d806c810 2023-11-28T20:03:12.802 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:12.800+0000 7f73fcb1d640 1 -- 172.21.15.78:0/1457540230 --> [v2:172.21.15.179:6800/815435378,v1:172.21.15.179:6801/815435378] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f73f81533b0 con 0x7f73d806c810 2023-11-28T20:03:12.803 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:12.800+0000 7f73e6ffd640 1 -- 172.21.15.78:0/1457540230 <== osd.6 v2:172.21.15.179:6800/815435378 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f73f81533b0 con 0x7f73d806c810 2023-11-28T20:03:12.804 INFO:teuthology.orchestra.run.smithi078.stdout:{ 2023-11-28T20:03:12.804 INFO:teuthology.orchestra.run.smithi078.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2023-11-28T20:03:12.805 INFO:teuthology.orchestra.run.smithi078.stdout:} 2023-11-28T20:03:12.806 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:12.800+0000 7f73fcb1d640 1 -- 172.21.15.78:0/1457540230 >> [v2:172.21.15.179:6800/815435378,v1:172.21.15.179:6801/815435378] conn(0x7f73d806c810 msgr2=0x7f73d806ec50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:03:12.806 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:12.800+0000 7f73fcb1d640 1 --2- 172.21.15.78:0/1457540230 >> [v2:172.21.15.179:6800/815435378,v1:172.21.15.179:6801/815435378] conn(0x7f73d806c810 0x7f73d806ec50 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:03:12.807 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:12.800+0000 7f73fcb1d640 1 -- 172.21.15.78:0/1457540230 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f73d8066470 msgr2=0x7f73d8068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:03:12.807 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:12.800+0000 7f73fcb1d640 1 --2- 172.21.15.78:0/1457540230 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f73d8066470 0x7f73d8068930 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7f73e80ae000 tx=0x7f73e8008040 comp rx=0 tx=0).stop 2023-11-28T20:03:12.807 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:12.800+0000 7f73fcb1d640 1 -- 172.21.15.78:0/1457540230 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f73f80a9910 msgr2=0x7f73f8072370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:03:12.807 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:12.800+0000 7f73fcb1d640 1 --2- 172.21.15.78:0/1457540230 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f73f80a9910 0x7f73f8072370 secure :-1 s=READY pgs=1174 cs=0 l=1 rev1=1 crypto rx=0x7f73ec00e8b0 tx=0x7f73ec00ed70 comp rx=0 tx=0).stop 2023-11-28T20:03:12.808 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:12.800+0000 7f73f6d9d640 1 -- 172.21.15.78:0/1457540230 reap_dead start 2023-11-28T20:03:12.808 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:12.800+0000 7f73fcb1d640 1 -- 172.21.15.78:0/1457540230 shutdown_connections 2023-11-28T20:03:12.808 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:12.800+0000 7f73fcb1d640 1 -- 172.21.15.78:0/1457540230 >> 172.21.15.78:0/1457540230 conn(0x7f73f80c59f0 msgr2=0x7f73f81503e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:03:12.808 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:12.800+0000 7f73fcb1d640 1 -- 172.21.15.78:0/1457540230 shutdown_connections 2023-11-28T20:03:12.808 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:12.800+0000 7f73fcb1d640 1 -- 172.21.15.78:0/1457540230 wait complete. 2023-11-28T20:03:12.823 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 6 2023-11-28T20:03:12.962 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:12.956+0000 7f05a5e79640 1 Processor -- start 2023-11-28T20:03:12.962 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:12.956+0000 7f05a5e79640 1 -- start start 2023-11-28T20:03:12.963 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:12.960+0000 7f05a5e79640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f05a00a4f90 0x7f05a00c59c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:03:12.963 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:12.960+0000 7f05a5e79640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f05a00a5370 0x7f05a014f870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:03:12.964 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:12.960+0000 7f05a5e79640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f05a01524b0 con 0x7f05a0072810 2023-11-28T20:03:12.964 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:12.960+0000 7f05a5e79640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f05a00c62f0 con 0x7f05a00a4f90 2023-11-28T20:03:12.964 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:12.960+0000 7f05a5e79640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05a0152770 con 0x7f05a00a5370 2023-11-28T20:03:12.964 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:12.960+0000 7f059f7fe640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f05a00a4f90 0x7f05a00c59c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:03:12.964 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:12.960+0000 7f059ffff640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f05a0072810 0x7f05a00c0800 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:43036/0 (socket says 172.21.15.78:43036) 2023-11-28T20:03:12.964 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:12.960+0000 7f059ffff640 1 -- 172.21.15.78:0/997844887 learned_addr learned my addr 172.21.15.78:0/997844887 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-11-28T20:03:12.965 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:12.960+0000 7f059effd640 1 --2- 172.21.15.78:0/997844887 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f05a00a5370 0x7f05a014f870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:03:12.965 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:12.960+0000 7f059f7fe640 1 -- 172.21.15.78:0/997844887 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f05a00a5370 msgr2=0x7f05a014f870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:03:12.966 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:12.960+0000 7f059f7fe640 1 --2- 172.21.15.78:0/997844887 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f05a00a5370 0x7f05a014f870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:03:12.966 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:12.960+0000 7f059f7fe640 1 -- 172.21.15.78:0/997844887 >> v1:172.21.15.78:6789/0 conn(0x7f05a0072810 legacy=0x7f05a00c0800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:03:12.966 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:12.960+0000 7f059f7fe640 1 -- 172.21.15.78:0/997844887 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05a0152a50 con 0x7f05a00a4f90 2023-11-28T20:03:12.967 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:12.960+0000 7f059effd640 1 --2- 172.21.15.78:0/997844887 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f05a00a5370 0x7f05a014f870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T20:03:12.968 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:12.964+0000 7f059f7fe640 1 --2- 172.21.15.78:0/997844887 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f05a00a4f90 0x7f05a00c59c0 secure :-1 s=READY pgs=1176 cs=0 l=1 rev1=1 crypto rx=0x7f05900097c0 tx=0x7f059001c3f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eccdb790386984a9 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:03:12.968 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:12.964+0000 7f059e7fc640 1 -- 172.21.15.78:0/997844887 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05900ab600 con 0x7f05a00a4f90 2023-11-28T20:03:12.968 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:12.964+0000 7f059e7fc640 1 -- 172.21.15.78:0/997844887 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f05900a7050 con 0x7f05a00a4f90 2023-11-28T20:03:12.969 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:12.964+0000 7f059e7fc640 1 -- 172.21.15.78:0/997844887 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05900ab980 con 0x7f05a00a4f90 2023-11-28T20:03:12.969 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:12.964+0000 7f05a5e79640 1 -- 172.21.15.78:0/997844887 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f05a00a4f90 msgr2=0x7f05a00c59c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:03:12.970 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:12.964+0000 7f05a5e79640 1 --2- 172.21.15.78:0/997844887 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f05a00a4f90 0x7f05a00c59c0 secure :-1 s=READY pgs=1176 cs=0 l=1 rev1=1 crypto rx=0x7f05900097c0 tx=0x7f059001c3f0 comp rx=0 tx=0).stop 2023-11-28T20:03:12.970 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:12.964+0000 7f05a5e79640 1 -- 172.21.15.78:0/997844887 shutdown_connections 2023-11-28T20:03:12.971 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:12.964+0000 7f05a5e79640 1 --2- 172.21.15.78:0/997844887 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f05a00a5370 0x7f05a014f870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:03:12.971 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:12.964+0000 7f05a5e79640 1 --2- 172.21.15.78:0/997844887 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f05a00a4f90 0x7f05a00c59c0 unknown :-1 s=CLOSED pgs=1176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:03:12.971 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:12.964+0000 7f05a5e79640 1 -- 172.21.15.78:0/997844887 >> 172.21.15.78:0/997844887 conn(0x7f05a006b220 msgr2=0x7f05a00a77e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:03:12.971 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:12.964+0000 7f05a5e79640 1 -- 172.21.15.78:0/997844887 shutdown_connections 2023-11-28T20:03:12.971 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:12.964+0000 7f05a5e79640 1 -- 172.21.15.78:0/997844887 wait complete. 2023-11-28T20:03:12.974 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:12.964+0000 7f05a5e79640 1 Processor -- start 2023-11-28T20:03:12.974 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:12.964+0000 7f05a5e79640 1 -- start start 2023-11-28T20:03:12.974 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:12.968+0000 7f05a5e79640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f05a0072810 0x7f05a00a8e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:03:12.974 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:12.968+0000 7f05a5e79640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f05a00a4f90 0x7f05a0151150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:03:12.974 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:12.968+0000 7f05a5e79640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f05a00a5370 0x7f05a0151690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:03:12.974 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:12.968+0000 7f05a5e79640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05a0150700 con 0x7f05a00a5370 2023-11-28T20:03:12.974 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:12.968+0000 7f05a5e79640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05a01499c0 con 0x7f05a00a4f90 2023-11-28T20:03:12.975 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:12.968+0000 7f05a5e79640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05a00aa270 con 0x7f05a0072810 2023-11-28T20:03:12.975 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:12.968+0000 7f059ffff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f05a00a5370 0x7f05a0151690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:03:12.975 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:12.968+0000 7f059ffff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f05a00a5370 0x7f05a0151690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:47906/0 (socket says 172.21.15.78:47906) 2023-11-28T20:03:12.975 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:12.968+0000 7f059ffff640 1 -- 172.21.15.78:0/65805308 learned_addr learned my addr 172.21.15.78:0/65805308 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T20:03:12.975 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:12.968+0000 7f059f7fe640 1 --2- 172.21.15.78:0/65805308 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f05a0072810 0x7f05a00a8e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:03:12.975 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:12.968+0000 7f059effd640 1 --2- 172.21.15.78:0/65805308 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f05a00a4f90 0x7f05a0151150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:03:12.975 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:12.968+0000 7f059ffff640 1 -- 172.21.15.78:0/65805308 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f05a0072810 msgr2=0x7f05a00a8e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:03:12.976 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:12.968+0000 7f059ffff640 1 --2- 172.21.15.78:0/65805308 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f05a0072810 0x7f05a00a8e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:03:12.976 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:12.968+0000 7f059ffff640 1 -- 172.21.15.78:0/65805308 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f05a00a4f90 msgr2=0x7f05a0151150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:03:12.976 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:12.968+0000 7f059ffff640 1 --2- 172.21.15.78:0/65805308 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f05a00a4f90 0x7f05a0151150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:03:12.976 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:12.968+0000 7f059ffff640 1 -- 172.21.15.78:0/65805308 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0590009420 con 0x7f05a00a5370 2023-11-28T20:03:12.976 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:12.968+0000 7f059ffff640 1 --2- 172.21.15.78:0/65805308 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f05a00a5370 0x7f05a0151690 secure :-1 s=READY pgs=1177 cs=0 l=1 rev1=1 crypto rx=0x7f059800cbc0 tx=0x7f059800a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:03:12.976 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:12.968+0000 7f0587fff640 1 -- 172.21.15.78:0/65805308 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f059800ace0 con 0x7f05a00a5370 2023-11-28T20:03:12.976 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:12.968+0000 7f0587fff640 1 -- 172.21.15.78:0/65805308 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f059800ae40 con 0x7f05a00a5370 2023-11-28T20:03:12.976 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:12.968+0000 7f0587fff640 1 -- 172.21.15.78:0/65805308 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0598012600 con 0x7f05a00a5370 2023-11-28T20:03:12.977 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:12.968+0000 7f05a5e79640 1 -- 172.21.15.78:0/65805308 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f05a0150ce0 con 0x7f05a00a5370 2023-11-28T20:03:12.977 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:12.968+0000 7f05a5e79640 1 -- 172.21.15.78:0/65805308 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f05a014af00 con 0x7f05a00a5370 2023-11-28T20:03:12.977 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:12.968+0000 7f05a5e79640 1 -- 172.21.15.78:0/65805308 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f05a0150e70 con 0x7f05a00a5370 2023-11-28T20:03:12.977 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:12.968+0000 7f0587fff640 1 -- 172.21.15.78:0/65805308 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f0598007070 con 0x7f05a00a5370 2023-11-28T20:03:12.978 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:12.972+0000 7f0587fff640 1 --2- 172.21.15.78:0/65805308 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f058c066470 0x7f058c068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:03:12.978 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:12.972+0000 7f0587fff640 1 -- 172.21.15.78:0/65805308 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 5349+0+0 (secure 0 0 0) 0x7f0598083b10 con 0x7f05a00a5370 2023-11-28T20:03:12.978 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:12.972+0000 7f059f7fe640 1 --2- 172.21.15.78:0/65805308 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f058c066470 0x7f058c068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:03:12.978 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:12.972+0000 7f059f7fe640 1 --2- 172.21.15.78:0/65805308 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f058c066470 0x7f058c068930 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7f05900ad000 tx=0x7f0590008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:03:12.979 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:12.972+0000 7f0587fff640 1 -- 172.21.15.78:0/65805308 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f05a0150e70 con 0x7f05a00a5370 2023-11-28T20:03:13.129 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:13.124+0000 7f05a5e79640 1 -- 172.21.15.78:0/65805308 --> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "6", "target": ["mon-mgr", ""]}) v1 -- 0x7f05a015f590 con 0x7f058c066470 2023-11-28T20:03:13.129 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:13.124+0000 7f0587fff640 1 -- 172.21.15.78:0/65805308 <== mgr.4106 v2:172.21.15.78:6832/2935380957 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 6 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f05900ab860 con 0x7f058c066470 2023-11-28T20:03:13.129 INFO:teuthology.orchestra.run.smithi078.stderr:instructed osd(s) 6 to deep-scrub 2023-11-28T20:03:13.131 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:13.128+0000 7f05a5e79640 1 -- 172.21.15.78:0/65805308 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f058c066470 msgr2=0x7f058c068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:03:13.132 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:13.128+0000 7f05a5e79640 1 --2- 172.21.15.78:0/65805308 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f058c066470 0x7f058c068930 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7f05900ad000 tx=0x7f0590008040 comp rx=0 tx=0).stop 2023-11-28T20:03:13.132 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:13.128+0000 7f05a5e79640 1 -- 172.21.15.78:0/65805308 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f05a00a5370 msgr2=0x7f05a0151690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:03:13.132 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:13.128+0000 7f05a5e79640 1 --2- 172.21.15.78:0/65805308 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f05a00a5370 0x7f05a0151690 secure :-1 s=READY pgs=1177 cs=0 l=1 rev1=1 crypto rx=0x7f059800cbc0 tx=0x7f059800a430 comp rx=0 tx=0).stop 2023-11-28T20:03:13.132 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:13.128+0000 7f05a5e79640 1 -- 172.21.15.78:0/65805308 shutdown_connections 2023-11-28T20:03:13.132 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:13.128+0000 7f05a5e79640 1 --2- 172.21.15.78:0/65805308 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f058c066470 0x7f058c068930 unknown :-1 s=CLOSED pgs=556 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:03:13.132 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:13.128+0000 7f05a5e79640 1 --2- 172.21.15.78:0/65805308 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f05a00a5370 0x7f05a0151690 unknown :-1 s=CLOSED pgs=1177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:03:13.132 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:13.128+0000 7f05a5e79640 1 --2- 172.21.15.78:0/65805308 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f05a00a4f90 0x7f05a0151150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:03:13.133 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:13.128+0000 7f05a5e79640 1 --2- 172.21.15.78:0/65805308 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f05a0072810 0x7f05a00a8e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:03:13.133 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:13.128+0000 7f05a5e79640 1 -- 172.21.15.78:0/65805308 >> 172.21.15.78:0/65805308 conn(0x7f05a006b220 msgr2=0x7f05a00a6860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:03:13.133 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:13.128+0000 7f05a5e79640 1 -- 172.21.15.78:0/65805308 shutdown_connections 2023-11-28T20:03:13.133 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:13.128+0000 7f05a5e79640 1 -- 172.21.15.78:0/65805308 wait complete. 2023-11-28T20:03:13.150 INFO:tasks.ceph:Scrubbing osd.7 2023-11-28T20:03:13.150 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 config set osd_debug_deep_scrub_sleep 0 2023-11-28T20:03:13.290 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:13.284+0000 7f2e85f10640 1 Processor -- start 2023-11-28T20:03:13.291 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:13.288+0000 7f2e85f10640 1 -- start start 2023-11-28T20:03:13.292 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:13.288+0000 7f2e85f10640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f2e80151ac0 0x7f2e8006ede0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:03:13.292 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:13.288+0000 7f2e85f10640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2e800c7430 0x7f2e800a6cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:03:13.292 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:13.288+0000 7f2e85f10640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2e800c1980 con 0x7f2e8006f550 2023-11-28T20:03:13.293 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:13.288+0000 7f2e85f10640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2e800c6fa0 con 0x7f2e80151ac0 2023-11-28T20:03:13.293 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:13.288+0000 7f2e85f10640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e800c1bd0 con 0x7f2e800c7430 2023-11-28T20:03:13.293 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:13.288+0000 7f2e84f0e640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f2e80151ac0 0x7f2e8006ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:03:13.293 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:13.288+0000 7f2e84f0e640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f2e80151ac0 0x7f2e8006ede0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:47910/0 (socket says 172.21.15.78:47910) 2023-11-28T20:03:13.293 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:13.288+0000 7f2e84f0e640 1 -- 172.21.15.78:0/2347188216 learned_addr learned my addr 172.21.15.78:0/2347188216 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T20:03:13.293 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:13.288+0000 7f2e8570f640 1 --2- 172.21.15.78:0/2347188216 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2e800c7430 0x7f2e800a6cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:03:13.293 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:13.288+0000 7f2e84f0e640 1 -- 172.21.15.78:0/2347188216 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2e800c7430 msgr2=0x7f2e800a6cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:03:13.294 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:13.288+0000 7f2e84f0e640 1 --2- 172.21.15.78:0/2347188216 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2e800c7430 0x7f2e800a6cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:03:13.294 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:13.288+0000 7f2e84f0e640 1 -- 172.21.15.78:0/2347188216 >> v1:172.21.15.179:6789/0 conn(0x7f2e8006f550 legacy=0x7f2e80157a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:03:13.294 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:13.288+0000 7f2e84f0e640 1 -- 172.21.15.78:0/2347188216 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e800c1eb0 con 0x7f2e80151ac0 2023-11-28T20:03:13.295 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:13.292+0000 7f2e84f0e640 1 --2- 172.21.15.78:0/2347188216 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2e80151ac0 0x7f2e8006ede0 secure :-1 s=READY pgs=1178 cs=0 l=1 rev1=1 crypto rx=0x7f2e74009870 tx=0x7f2e7401c3f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=490bed0a37bff46a server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:03:13.296 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:13.292+0000 7f2e7f7fe640 1 -- 172.21.15.78:0/2347188216 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e740ab610 con 0x7f2e80151ac0 2023-11-28T20:03:13.296 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:13.292+0000 7f2e7f7fe640 1 -- 172.21.15.78:0/2347188216 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e740ab770 con 0x7f2e80151ac0 2023-11-28T20:03:13.296 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:13.292+0000 7f2e7f7fe640 1 -- 172.21.15.78:0/2347188216 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e740abb00 con 0x7f2e80151ac0 2023-11-28T20:03:13.297 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:13.292+0000 7f2e85f10640 1 -- 172.21.15.78:0/2347188216 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2e80151ac0 msgr2=0x7f2e8006ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:03:13.297 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:13.292+0000 7f2e85f10640 1 --2- 172.21.15.78:0/2347188216 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2e80151ac0 0x7f2e8006ede0 secure :-1 s=READY pgs=1178 cs=0 l=1 rev1=1 crypto rx=0x7f2e74009870 tx=0x7f2e7401c3f0 comp rx=0 tx=0).stop 2023-11-28T20:03:13.297 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:13.292+0000 7f2e85f10640 1 -- 172.21.15.78:0/2347188216 shutdown_connections 2023-11-28T20:03:13.297 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:13.292+0000 7f2e85f10640 1 --2- 172.21.15.78:0/2347188216 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2e800c7430 0x7f2e800a6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:03:13.297 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:13.292+0000 7f2e85f10640 1 --2- 172.21.15.78:0/2347188216 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2e80151ac0 0x7f2e8006ede0 unknown :-1 s=CLOSED pgs=1178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:03:13.297 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:13.292+0000 7f2e85f10640 1 -- 172.21.15.78:0/2347188216 >> 172.21.15.78:0/2347188216 conn(0x7f2e800662a0 msgr2=0x7f2e800666b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:03:13.298 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:13.292+0000 7f2e85f10640 1 -- 172.21.15.78:0/2347188216 shutdown_connections 2023-11-28T20:03:13.298 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:13.292+0000 7f2e85f10640 1 -- 172.21.15.78:0/2347188216 wait complete. 2023-11-28T20:03:13.298 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:13.292+0000 7f2e85f10640 1 Processor -- start 2023-11-28T20:03:13.298 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:13.292+0000 7f2e85f10640 1 -- start start 2023-11-28T20:03:13.300 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:13.296+0000 7f2e85f10640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2e8006f550 0x7f2e800a9ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:03:13.301 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:13.296+0000 7f2e85f10640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2e800c7430 0x7f2e8014baf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:03:13.301 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:13.296+0000 7f2e85f10640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2e80151ac0 0x7f2e800ab1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:03:13.301 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:13.296+0000 7f2e85f10640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e801f0b00 con 0x7f2e8006f550 2023-11-28T20:03:13.301 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:13.296+0000 7f2e85f10640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e800a8270 con 0x7f2e80151ac0 2023-11-28T20:03:13.301 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:13.296+0000 7f2e85f10640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e801f1030 con 0x7f2e800c7430 2023-11-28T20:03:13.301 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:13.296+0000 7f2e84f0e640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2e8006f550 0x7f2e800a9ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:03:13.301 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:13.296+0000 7f2e84f0e640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2e8006f550 0x7f2e800a9ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:47926/0 (socket says 172.21.15.78:47926) 2023-11-28T20:03:13.301 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:13.296+0000 7f2e84f0e640 1 -- 172.21.15.78:0/1989463680 learned_addr learned my addr 172.21.15.78:0/1989463680 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T20:03:13.302 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:13.296+0000 7f2e8570f640 1 --2- 172.21.15.78:0/1989463680 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2e80151ac0 0x7f2e800ab1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:03:13.302 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:13.296+0000 7f2e7ffff640 1 --2- 172.21.15.78:0/1989463680 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2e800c7430 0x7f2e8014baf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:03:13.302 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:13.296+0000 7f2e84f0e640 1 -- 172.21.15.78:0/1989463680 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2e800c7430 msgr2=0x7f2e8014baf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:03:13.302 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:13.296+0000 7f2e84f0e640 1 --2- 172.21.15.78:0/1989463680 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2e800c7430 0x7f2e8014baf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:03:13.302 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:13.296+0000 7f2e84f0e640 1 -- 172.21.15.78:0/1989463680 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2e80151ac0 msgr2=0x7f2e800ab1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:03:13.302 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:13.296+0000 7f2e84f0e640 1 --2- 172.21.15.78:0/1989463680 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2e80151ac0 0x7f2e800ab1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:03:13.302 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:13.296+0000 7f2e84f0e640 1 -- 172.21.15.78:0/1989463680 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e740094d0 con 0x7f2e8006f550 2023-11-28T20:03:13.303 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:13.296+0000 7f2e7ffff640 1 --2- 172.21.15.78:0/1989463680 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2e800c7430 0x7f2e8014baf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T20:03:13.303 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:13.296+0000 7f2e84f0e640 1 --2- 172.21.15.78:0/1989463680 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2e8006f550 0x7f2e800a9ee0 secure :-1 s=READY pgs=1179 cs=0 l=1 rev1=1 crypto rx=0x7f2e740ad040 tx=0x7f2e7401ac30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:03:13.303 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:13.296+0000 7f2e7d7fa640 1 -- 172.21.15.78:0/1989463680 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e740b4800 con 0x7f2e8006f550 2023-11-28T20:03:13.303 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:13.296+0000 7f2e7d7fa640 1 -- 172.21.15.78:0/1989463680 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e740b4960 con 0x7f2e8006f550 2023-11-28T20:03:13.303 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:13.296+0000 7f2e85f10640 1 -- 172.21.15.78:0/1989463680 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2e800a7840 con 0x7f2e8006f550 2023-11-28T20:03:13.303 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:13.296+0000 7f2e7d7fa640 1 -- 172.21.15.78:0/1989463680 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e740b4d10 con 0x7f2e8006f550 2023-11-28T20:03:13.303 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:13.296+0000 7f2e85f10640 1 -- 172.21.15.78:0/1989463680 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2e800aa420 con 0x7f2e8006f550 2023-11-28T20:03:13.305 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:13.296+0000 7f2e85f10640 1 -- 172.21.15.78:0/1989463680 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f2e80151ea0 con 0x7f2e8006f550 2023-11-28T20:03:13.306 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:13.300+0000 7f2e7d7fa640 1 -- 172.21.15.78:0/1989463680 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f2e740c7440 con 0x7f2e8006f550 2023-11-28T20:03:13.306 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:13.300+0000 7f2e7d7fa640 1 --2- 172.21.15.78:0/1989463680 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f2e64066470 0x7f2e64068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:03:13.306 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:13.300+0000 7f2e7d7fa640 1 -- 172.21.15.78:0/1989463680 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 5349+0+0 (secure 0 0 0) 0x7f2e7411e750 con 0x7f2e8006f550 2023-11-28T20:03:13.306 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:13.300+0000 7f2e7ffff640 1 --2- 172.21.15.78:0/1989463680 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f2e64066470 0x7f2e64068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:03:13.306 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:13.300+0000 7f2e7d7fa640 1 --2- 172.21.15.78:0/1989463680 >> [v2:172.21.15.179:6817/2848432339,v1:172.21.15.179:6819/2848432339] conn(0x7f2e6406c810 0x7f2e6406ec50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:03:13.306 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:13.300+0000 7f2e7d7fa640 1 -- 172.21.15.78:0/1989463680 --> [v2:172.21.15.179:6817/2848432339,v1:172.21.15.179:6819/2848432339] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f2e6406f320 con 0x7f2e6406c810 2023-11-28T20:03:13.307 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:13.300+0000 7f2e7d7fa640 1 -- 172.21.15.78:0/1989463680 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_get_version_reply(handle=1 version=93) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2e74120e10 con 0x7f2e8006f550 2023-11-28T20:03:13.307 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:13.300+0000 7f2e8570f640 1 --2- 172.21.15.78:0/1989463680 >> [v2:172.21.15.179:6817/2848432339,v1:172.21.15.179:6819/2848432339] conn(0x7f2e6406c810 0x7f2e6406ec50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:03:13.307 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:13.300+0000 7f2e7ffff640 1 --2- 172.21.15.78:0/1989463680 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f2e64066470 0x7f2e64068930 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7f2e801ea980 tx=0x7f2e6c009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:03:13.307 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:13.300+0000 7f2e8570f640 1 --2- 172.21.15.78:0/1989463680 >> [v2:172.21.15.179:6817/2848432339,v1:172.21.15.179:6819/2848432339] conn(0x7f2e6406c810 0x7f2e6406ec50 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:03:13.307 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:13.300+0000 7f2e7d7fa640 1 -- 172.21.15.78:0/1989463680 <== osd.7 v2:172.21.15.179:6817/2848432339 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7f2e6406f320 con 0x7f2e6406c810 2023-11-28T20:03:13.318 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:13.312+0000 7f2e85f10640 1 -- 172.21.15.78:0/1989463680 --> [v2:172.21.15.179:6817/2848432339,v1:172.21.15.179:6819/2848432339] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f2e80157990 con 0x7f2e6406c810 2023-11-28T20:03:13.319 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:13.316+0000 7f2e7d7fa640 1 -- 172.21.15.78:0/1989463680 <== osd.7 v2:172.21.15.179:6817/2848432339 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f2e80157990 con 0x7f2e6406c810 2023-11-28T20:03:13.319 INFO:teuthology.orchestra.run.smithi078.stdout:{ 2023-11-28T20:03:13.320 INFO:teuthology.orchestra.run.smithi078.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2023-11-28T20:03:13.320 INFO:teuthology.orchestra.run.smithi078.stdout:} 2023-11-28T20:03:13.321 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:13.316+0000 7f2e85f10640 1 -- 172.21.15.78:0/1989463680 >> [v2:172.21.15.179:6817/2848432339,v1:172.21.15.179:6819/2848432339] conn(0x7f2e6406c810 msgr2=0x7f2e6406ec50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:03:13.321 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:13.316+0000 7f2e85f10640 1 --2- 172.21.15.78:0/1989463680 >> [v2:172.21.15.179:6817/2848432339,v1:172.21.15.179:6819/2848432339] conn(0x7f2e6406c810 0x7f2e6406ec50 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:03:13.321 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:13.316+0000 7f2e85f10640 1 -- 172.21.15.78:0/1989463680 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f2e64066470 msgr2=0x7f2e64068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:03:13.321 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:13.316+0000 7f2e85f10640 1 --2- 172.21.15.78:0/1989463680 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f2e64066470 0x7f2e64068930 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7f2e801ea980 tx=0x7f2e6c009040 comp rx=0 tx=0).stop 2023-11-28T20:03:13.321 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:13.316+0000 7f2e85f10640 1 -- 172.21.15.78:0/1989463680 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2e8006f550 msgr2=0x7f2e800a9ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:03:13.322 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:13.316+0000 7f2e85f10640 1 --2- 172.21.15.78:0/1989463680 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2e8006f550 0x7f2e800a9ee0 secure :-1 s=READY pgs=1179 cs=0 l=1 rev1=1 crypto rx=0x7f2e740ad040 tx=0x7f2e7401ac30 comp rx=0 tx=0).stop 2023-11-28T20:03:13.322 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:13.316+0000 7f2e8570f640 1 -- 172.21.15.78:0/1989463680 reap_dead start 2023-11-28T20:03:13.322 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:13.316+0000 7f2e85f10640 1 -- 172.21.15.78:0/1989463680 shutdown_connections 2023-11-28T20:03:13.322 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:13.316+0000 7f2e85f10640 1 -- 172.21.15.78:0/1989463680 >> 172.21.15.78:0/1989463680 conn(0x7f2e800662a0 msgr2=0x7f2e8006f930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:03:13.323 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:13.316+0000 7f2e85f10640 1 -- 172.21.15.78:0/1989463680 shutdown_connections 2023-11-28T20:03:13.323 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:13.316+0000 7f2e85f10640 1 -- 172.21.15.78:0/1989463680 wait complete. 2023-11-28T20:03:13.339 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 7 2023-11-28T20:03:13.477 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:13.472+0000 7fb4fbe17640 1 Processor -- start 2023-11-28T20:03:13.477 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:13.472+0000 7fb4fbe17640 1 -- start start 2023-11-28T20:03:13.479 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:13.472+0000 7fb4fbe17640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fb4f4154390 0x7fb4f40c4a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:03:13.479 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:13.472+0000 7fb4fbe17640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fb4f40c2110 0x7fb4f40c5ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:03:13.479 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:13.476+0000 7fb4fbe17640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb4f40a93d0 con 0x7fb4f40c4f80 2023-11-28T20:03:13.479 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:13.476+0000 7fb4fbe17640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb4f40aa1c0 con 0x7fb4f40c2110 2023-11-28T20:03:13.480 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:13.476+0000 7fb4fbe17640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb4f4154770 con 0x7fb4f4154390 2023-11-28T20:03:13.480 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:13.476+0000 7fb4f93b2640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fb4f40c2110 0x7fb4f40c5ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:03:13.480 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:13.476+0000 7fb4f9bb3640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fb4f4154390 0x7fb4f40c4a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:03:13.480 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:13.476+0000 7fb4f93b2640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fb4f40c2110 0x7fb4f40c5ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:47942/0 (socket says 172.21.15.78:47942) 2023-11-28T20:03:13.480 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:13.476+0000 7fb4f93b2640 1 -- 172.21.15.78:0/2855014926 learned_addr learned my addr 172.21.15.78:0/2855014926 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T20:03:13.480 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:13.476+0000 7fb4f93b2640 1 -- 172.21.15.78:0/2855014926 >> v2:172.21.15.179:3300/0 conn(0x7fb4f4154390 msgr2=0x7fb4f40c4a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:03:13.480 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:13.476+0000 7fb4f93b2640 1 --2- 172.21.15.78:0/2855014926 >> v2:172.21.15.179:3300/0 conn(0x7fb4f4154390 0x7fb4f40c4a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:03:13.480 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:13.476+0000 7fb4f93b2640 1 -- 172.21.15.78:0/2855014926 >> v1:172.21.15.179:6789/0 conn(0x7fb4f40c4f80 legacy=0x7fb4f40c61e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:03:13.481 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:13.476+0000 7fb4f93b2640 1 -- 172.21.15.78:0/2855014926 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4f40a9640 con 0x7fb4f40c2110 2023-11-28T20:03:13.482 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:13.476+0000 7fb4f93b2640 1 --2- 172.21.15.78:0/2855014926 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb4f40c2110 0x7fb4f40c5ca0 secure :-1 s=READY pgs=1180 cs=0 l=1 rev1=1 crypto rx=0x7fb4f40a83b0 tx=0x7fb4e401c500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=88880f75173fae69 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:03:13.482 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:13.476+0000 7fb4f8bb1640 1 -- 172.21.15.78:0/2855014926 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4e40ab610 con 0x7fb4f40c2110 2023-11-28T20:03:13.483 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:13.480+0000 7fb4f8bb1640 1 -- 172.21.15.78:0/2855014926 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb4e40ab770 con 0x7fb4f40c2110 2023-11-28T20:03:13.483 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:13.480+0000 7fb4f8bb1640 1 -- 172.21.15.78:0/2855014926 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4e40abb00 con 0x7fb4f40c2110 2023-11-28T20:03:13.483 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:13.480+0000 7fb4fbe17640 1 -- 172.21.15.78:0/2855014926 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb4f40c2110 msgr2=0x7fb4f40c5ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:03:13.484 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:13.480+0000 7fb4fbe17640 1 --2- 172.21.15.78:0/2855014926 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb4f40c2110 0x7fb4f40c5ca0 secure :-1 s=READY pgs=1180 cs=0 l=1 rev1=1 crypto rx=0x7fb4f40a83b0 tx=0x7fb4e401c500 comp rx=0 tx=0).stop 2023-11-28T20:03:13.484 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:13.480+0000 7fb4fbe17640 1 -- 172.21.15.78:0/2855014926 shutdown_connections 2023-11-28T20:03:13.484 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:13.480+0000 7fb4fbe17640 1 --2- 172.21.15.78:0/2855014926 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb4f40c2110 0x7fb4f40c5ca0 unknown :-1 s=CLOSED pgs=1180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:03:13.484 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:13.480+0000 7fb4fbe17640 1 --2- 172.21.15.78:0/2855014926 >> v2:172.21.15.179:3300/0 conn(0x7fb4f4154390 0x7fb4f40c4a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:03:13.484 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:13.480+0000 7fb4fbe17640 1 -- 172.21.15.78:0/2855014926 >> 172.21.15.78:0/2855014926 conn(0x7fb4f406b220 msgr2=0x7fb4f40a77e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:03:13.484 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:13.480+0000 7fb4fbe17640 1 -- 172.21.15.78:0/2855014926 shutdown_connections 2023-11-28T20:03:13.485 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:13.480+0000 7fb4fbe17640 1 -- 172.21.15.78:0/2855014926 wait complete. 2023-11-28T20:03:13.487 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:13.480+0000 7fb4fbe17640 1 Processor -- start 2023-11-28T20:03:13.487 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:13.480+0000 7fb4fbe17640 1 -- start start 2023-11-28T20:03:13.487 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:13.480+0000 7fb4fbe17640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb4f40c2110 0x7fb4f41437b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:03:13.487 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:13.480+0000 7fb4fbe17640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb4f40c4f80 0x7fb4f4152660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:03:13.488 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:13.480+0000 7fb4fbe17640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb4f4154390 0x7fb4f41496b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:03:13.488 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:13.480+0000 7fb4fbe17640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4f4153a90 con 0x7fb4f40c4f80 2023-11-28T20:03:13.488 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:13.480+0000 7fb4fbe17640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4f40a7d70 con 0x7fb4f4154390 2023-11-28T20:03:13.488 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:13.480+0000 7fb4fbe17640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb4f4148ef0 con 0x7fb4f40c2110 2023-11-28T20:03:13.488 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:13.480+0000 7fb4f93b2640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb4f40c4f80 0x7fb4f4152660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:03:13.489 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:13.480+0000 7fb4f93b2640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb4f40c4f80 0x7fb4f4152660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:47956/0 (socket says 172.21.15.78:47956) 2023-11-28T20:03:13.489 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:13.480+0000 7fb4f93b2640 1 -- 172.21.15.78:0/1500930686 learned_addr learned my addr 172.21.15.78:0/1500930686 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T20:03:13.489 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:13.480+0000 7fb4f93b2640 1 -- 172.21.15.78:0/1500930686 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb4f40c2110 msgr2=0x7fb4f41437b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:03:13.489 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:13.484+0000 7fb4f93b2640 1 --2- 172.21.15.78:0/1500930686 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb4f40c2110 0x7fb4f41437b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:03:13.489 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:13.484+0000 7fb4f93b2640 1 -- 172.21.15.78:0/1500930686 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb4f4154390 msgr2=0x7fb4f41496b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:03:13.489 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:13.484+0000 7fb4f93b2640 1 --2- 172.21.15.78:0/1500930686 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb4f4154390 0x7fb4f41496b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:03:13.489 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:13.484+0000 7fb4f93b2640 1 -- 172.21.15.78:0/1500930686 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4e40094d0 con 0x7fb4f40c4f80 2023-11-28T20:03:13.489 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:13.484+0000 7fb4f93b2640 1 --2- 172.21.15.78:0/1500930686 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb4f40c4f80 0x7fb4f4152660 secure :-1 s=READY pgs=1181 cs=0 l=1 rev1=1 crypto rx=0x7fb4e40ad040 tx=0x7fb4e401ad40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:03:13.490 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:13.484+0000 7fb4ea7fc640 1 -- 172.21.15.78:0/1500930686 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4e40b4800 con 0x7fb4f40c4f80 2023-11-28T20:03:13.490 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:13.484+0000 7fb4ea7fc640 1 -- 172.21.15.78:0/1500930686 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb4e40b4960 con 0x7fb4f40c4f80 2023-11-28T20:03:13.490 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:13.484+0000 7fb4fbe17640 1 -- 172.21.15.78:0/1500930686 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb4f4144150 con 0x7fb4f40c4f80 2023-11-28T20:03:13.490 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:13.484+0000 7fb4ea7fc640 1 -- 172.21.15.78:0/1500930686 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4e40b4d10 con 0x7fb4f40c4f80 2023-11-28T20:03:13.490 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:13.484+0000 7fb4fbe17640 1 -- 172.21.15.78:0/1500930686 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb4f4149190 con 0x7fb4f40c4f80 2023-11-28T20:03:13.491 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:13.484+0000 7fb4fbe17640 1 -- 172.21.15.78:0/1500930686 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb4f40aa650 con 0x7fb4f40c4f80 2023-11-28T20:03:13.491 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:13.484+0000 7fb4ea7fc640 1 -- 172.21.15.78:0/1500930686 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fb4e40b3380 con 0x7fb4f40c4f80 2023-11-28T20:03:13.491 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:13.484+0000 7fb4ea7fc640 1 --2- 172.21.15.78:0/1500930686 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fb4d80664a0 0x7fb4d8068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:03:13.491 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:13.484+0000 7fb4ea7fc640 1 -- 172.21.15.78:0/1500930686 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 5349+0+0 (secure 0 0 0) 0x7fb4e411dbb0 con 0x7fb4f40c4f80 2023-11-28T20:03:13.492 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:13.484+0000 7fb4f9bb3640 1 --2- 172.21.15.78:0/1500930686 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fb4d80664a0 0x7fb4d8068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:03:13.492 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:13.488+0000 7fb4f9bb3640 1 --2- 172.21.15.78:0/1500930686 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fb4d80664a0 0x7fb4d8068960 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7fb4f0006aa0 tx=0x7fb4f0006a30 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:03:13.493 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:13.488+0000 7fb4ea7fc640 1 -- 172.21.15.78:0/1500930686 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fb4e40eb2a0 con 0x7fb4f40c4f80 2023-11-28T20:03:13.642 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:13.636+0000 7fb4fbe17640 1 -- 172.21.15.78:0/1500930686 --> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "7", "target": ["mon-mgr", ""]}) v1 -- 0x7fb4f4149380 con 0x7fb4d80664a0 2023-11-28T20:03:13.642 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:13.636+0000 7fb4ea7fc640 1 -- 172.21.15.78:0/1500930686 <== mgr.4106 v2:172.21.15.78:6832/2935380957 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 7 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fb4f4149380 con 0x7fb4d80664a0 2023-11-28T20:03:13.643 INFO:teuthology.orchestra.run.smithi078.stderr:instructed osd(s) 7 to deep-scrub 2023-11-28T20:03:13.644 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:13.640+0000 7fb4fbe17640 1 -- 172.21.15.78:0/1500930686 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fb4d80664a0 msgr2=0x7fb4d8068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:03:13.644 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:13.640+0000 7fb4fbe17640 1 --2- 172.21.15.78:0/1500930686 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fb4d80664a0 0x7fb4d8068960 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7fb4f0006aa0 tx=0x7fb4f0006a30 comp rx=0 tx=0).stop 2023-11-28T20:03:13.645 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:13.640+0000 7fb4fbe17640 1 -- 172.21.15.78:0/1500930686 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb4f40c4f80 msgr2=0x7fb4f4152660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:03:13.645 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:13.640+0000 7fb4fbe17640 1 --2- 172.21.15.78:0/1500930686 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb4f40c4f80 0x7fb4f4152660 secure :-1 s=READY pgs=1181 cs=0 l=1 rev1=1 crypto rx=0x7fb4e40ad040 tx=0x7fb4e401ad40 comp rx=0 tx=0).stop 2023-11-28T20:03:13.645 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:13.640+0000 7fb4fbe17640 1 -- 172.21.15.78:0/1500930686 shutdown_connections 2023-11-28T20:03:13.645 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:13.640+0000 7fb4fbe17640 1 --2- 172.21.15.78:0/1500930686 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fb4d80664a0 0x7fb4d8068960 unknown :-1 s=CLOSED pgs=558 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:03:13.645 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:13.640+0000 7fb4fbe17640 1 --2- 172.21.15.78:0/1500930686 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb4f4154390 0x7fb4f41496b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:03:13.645 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:13.640+0000 7fb4fbe17640 1 --2- 172.21.15.78:0/1500930686 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb4f40c4f80 0x7fb4f4152660 unknown :-1 s=CLOSED pgs=1181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:03:13.645 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:13.640+0000 7fb4fbe17640 1 --2- 172.21.15.78:0/1500930686 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb4f40c2110 0x7fb4f41437b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:03:13.645 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:13.640+0000 7fb4fbe17640 1 -- 172.21.15.78:0/1500930686 >> 172.21.15.78:0/1500930686 conn(0x7fb4f406b220 msgr2=0x7fb4f40c3620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:03:13.646 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:13.640+0000 7fb4fbe17640 1 -- 172.21.15.78:0/1500930686 shutdown_connections 2023-11-28T20:03:13.646 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:13.640+0000 7fb4fbe17640 1 -- 172.21.15.78:0/1500930686 wait complete. 2023-11-28T20:03:13.663 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-28T20:03:13.799 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:13.796+0000 7f407f7aa640 1 Processor -- start 2023-11-28T20:03:13.800 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:13.796+0000 7f407f7aa640 1 -- start start 2023-11-28T20:03:13.802 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:13.796+0000 7f407f7aa640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f40780af4c0 0x7f4078154f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:03:13.802 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:13.796+0000 7f407f7aa640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f40780c67d0 0x7f40780c6c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:03:13.802 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:13.796+0000 7f407f7aa640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f407806b9f0 0x7f407806be40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:03:13.802 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:13.796+0000 7f407f7aa640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4078155460 con 0x7f407806b9f0 2023-11-28T20:03:13.802 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:13.796+0000 7f407f7aa640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f407806c380 con 0x7f40780af4c0 2023-11-28T20:03:13.802 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:13.796+0000 7f407f7aa640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40780c4890 con 0x7f40780c67d0 2023-11-28T20:03:13.802 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:13.796+0000 7f407dd47640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f407806b9f0 0x7f407806be40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:03:13.803 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:13.796+0000 7f407dd47640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f407806b9f0 0x7f407806be40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:47964/0 (socket says 172.21.15.78:47964) 2023-11-28T20:03:13.803 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:13.796+0000 7f407dd47640 1 -- 172.21.15.78:0/1391987666 learned_addr learned my addr 172.21.15.78:0/1391987666 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T20:03:13.803 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:13.796+0000 7f407d546640 1 --2- 172.21.15.78:0/1391987666 >> v2:172.21.15.179:3300/0 conn(0x7f40780af4c0 0x7f4078154f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:03:13.803 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:13.796+0000 7f407cd45640 1 --2- 172.21.15.78:0/1391987666 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f40780c67d0 0x7f40780c6c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:03:13.803 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:13.796+0000 7f407dd47640 1 -- 172.21.15.78:0/1391987666 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f40780c67d0 msgr2=0x7f40780c6c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:03:13.803 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:13.796+0000 7f407dd47640 1 --2- 172.21.15.78:0/1391987666 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f40780c67d0 0x7f40780c6c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:03:13.803 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:13.796+0000 7f407dd47640 1 -- 172.21.15.78:0/1391987666 >> v2:172.21.15.179:3300/0 conn(0x7f40780af4c0 msgr2=0x7f4078154f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:03:13.804 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:13.796+0000 7f407dd47640 1 --2- 172.21.15.78:0/1391987666 >> v2:172.21.15.179:3300/0 conn(0x7f40780af4c0 0x7f4078154f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:03:13.804 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:13.796+0000 7f407dd47640 1 -- 172.21.15.78:0/1391987666 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40780af8a0 con 0x7f407806b9f0 2023-11-28T20:03:13.804 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:13.796+0000 7f407cd45640 1 --2- 172.21.15.78:0/1391987666 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f40780c67d0 0x7f40780c6c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T20:03:13.805 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:13.800+0000 7f407dd47640 1 --2- 172.21.15.78:0/1391987666 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f407806b9f0 0x7f407806be40 secure :-1 s=READY pgs=1182 cs=0 l=1 rev1=1 crypto rx=0x7f40780a9790 tx=0x7f407001c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bfcf6f4617ea0fd2 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:03:13.805 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:13.800+0000 7f406ffff640 1 -- 172.21.15.78:0/1391987666 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40700a5790 con 0x7f407806b9f0 2023-11-28T20:03:13.805 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:13.800+0000 7f406ffff640 1 -- 172.21.15.78:0/1391987666 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40700a58f0 con 0x7f407806b9f0 2023-11-28T20:03:13.805 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:13.800+0000 7f406ffff640 1 -- 172.21.15.78:0/1391987666 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40700a5c80 con 0x7f407806b9f0 2023-11-28T20:03:13.805 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:13.800+0000 7f407f7aa640 1 -- 172.21.15.78:0/1391987666 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f407806b9f0 msgr2=0x7f407806be40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:03:13.806 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:13.800+0000 7f407f7aa640 1 --2- 172.21.15.78:0/1391987666 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f407806b9f0 0x7f407806be40 secure :-1 s=READY pgs=1182 cs=0 l=1 rev1=1 crypto rx=0x7f40780a9790 tx=0x7f407001c910 comp rx=0 tx=0).stop 2023-11-28T20:03:13.806 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:13.800+0000 7f407f7aa640 1 -- 172.21.15.78:0/1391987666 shutdown_connections 2023-11-28T20:03:13.806 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:13.800+0000 7f407f7aa640 1 --2- 172.21.15.78:0/1391987666 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f407806b9f0 0x7f407806be40 unknown :-1 s=CLOSED pgs=1182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:03:13.806 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:13.800+0000 7f407f7aa640 1 --2- 172.21.15.78:0/1391987666 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f40780c67d0 0x7f40780c6c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:03:13.806 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:13.800+0000 7f407f7aa640 1 --2- 172.21.15.78:0/1391987666 >> v2:172.21.15.179:3300/0 conn(0x7f40780af4c0 0x7f4078154f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:03:13.806 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:13.800+0000 7f407f7aa640 1 -- 172.21.15.78:0/1391987666 >> 172.21.15.78:0/1391987666 conn(0x7f40780ab9d0 msgr2=0x7f40780abde0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:03:13.806 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:13.800+0000 7f407f7aa640 1 -- 172.21.15.78:0/1391987666 shutdown_connections 2023-11-28T20:03:13.807 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:13.800+0000 7f407f7aa640 1 -- 172.21.15.78:0/1391987666 wait complete. 2023-11-28T20:03:13.807 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:13.804+0000 7f407f7aa640 1 Processor -- start 2023-11-28T20:03:13.807 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:13.804+0000 7f407f7aa640 1 -- start start 2023-11-28T20:03:13.809 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:13.804+0000 7f407f7aa640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f407806b9f0 0x7f40780ae360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:03:13.809 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:13.804+0000 7f407f7aa640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f40780af4c0 0x7f4078150840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:03:13.809 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:13.804+0000 7f407f7aa640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f40780c67d0 0x7f40780c2440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:03:13.810 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:13.804+0000 7f407f7aa640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f407814eb30 con 0x7f40780af4c0 2023-11-28T20:03:13.810 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:13.804+0000 7f407f7aa640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f407814df20 con 0x7f407806b9f0 2023-11-28T20:03:13.810 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:13.804+0000 7f407f7aa640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f407814e200 con 0x7f40780c67d0 2023-11-28T20:03:13.810 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:13.804+0000 7f407cd45640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f40780af4c0 0x7f4078150840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:03:13.810 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:13.804+0000 7f407cd45640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f40780af4c0 0x7f4078150840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:47972/0 (socket says 172.21.15.78:47972) 2023-11-28T20:03:13.811 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:13.804+0000 7f407cd45640 1 -- 172.21.15.78:0/3420139014 learned_addr learned my addr 172.21.15.78:0/3420139014 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T20:03:13.811 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:13.804+0000 7f407d546640 1 --2- 172.21.15.78:0/3420139014 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f407806b9f0 0x7f40780ae360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:03:13.811 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:13.804+0000 7f407dd47640 1 --2- 172.21.15.78:0/3420139014 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f40780c67d0 0x7f40780c2440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:03:13.811 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:13.804+0000 7f407cd45640 1 -- 172.21.15.78:0/3420139014 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f40780c67d0 msgr2=0x7f40780c2440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:03:13.811 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:13.804+0000 7f407cd45640 1 --2- 172.21.15.78:0/3420139014 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f40780c67d0 0x7f40780c2440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:03:13.811 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:13.804+0000 7f407cd45640 1 -- 172.21.15.78:0/3420139014 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f407806b9f0 msgr2=0x7f40780ae360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:03:13.811 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:13.804+0000 7f407cd45640 1 --2- 172.21.15.78:0/3420139014 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f407806b9f0 0x7f40780ae360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:03:13.811 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:13.804+0000 7f407cd45640 1 -- 172.21.15.78:0/3420139014 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4070009b30 con 0x7f40780af4c0 2023-11-28T20:03:13.812 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:13.804+0000 7f407dd47640 1 --2- 172.21.15.78:0/3420139014 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f40780c67d0 0x7f40780c2440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T20:03:13.812 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:13.804+0000 7f407cd45640 1 --2- 172.21.15.78:0/3420139014 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f40780af4c0 0x7f4078150840 secure :-1 s=READY pgs=1183 cs=0 l=1 rev1=1 crypto rx=0x7f406800e810 tx=0x7f406800ecd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:03:13.812 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:13.804+0000 7f406dffb640 1 -- 172.21.15.78:0/3420139014 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f406800c8d0 con 0x7f40780af4c0 2023-11-28T20:03:13.812 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:13.804+0000 7f406dffb640 1 -- 172.21.15.78:0/3420139014 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f406800ca30 con 0x7f40780af4c0 2023-11-28T20:03:13.812 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:13.804+0000 7f406dffb640 1 -- 172.21.15.78:0/3420139014 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f406800cde0 con 0x7f40780af4c0 2023-11-28T20:03:13.812 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:13.804+0000 7f407f7aa640 1 -- 172.21.15.78:0/3420139014 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f407814e4e0 con 0x7f40780af4c0 2023-11-28T20:03:13.812 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:13.804+0000 7f407f7aa640 1 -- 172.21.15.78:0/3420139014 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f40780c1db0 con 0x7f40780af4c0 2023-11-28T20:03:13.813 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:13.804+0000 7f407f7aa640 1 -- 172.21.15.78:0/3420139014 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4078067630 con 0x7f40780af4c0 2023-11-28T20:03:13.814 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:13.808+0000 7f406dffb640 1 -- 172.21.15.78:0/3420139014 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f4068013410 con 0x7f40780af4c0 2023-11-28T20:03:13.814 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:13.808+0000 7f406dffb640 1 --2- 172.21.15.78:0/3420139014 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f405c066470 0x7f405c068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:03:13.814 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:13.808+0000 7f406dffb640 1 -- 172.21.15.78:0/3420139014 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 5349+0+0 (secure 0 0 0) 0x7f4068083a30 con 0x7f40780af4c0 2023-11-28T20:03:13.814 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:13.808+0000 7f407d546640 1 --2- 172.21.15.78:0/3420139014 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f405c066470 0x7f405c068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:03:13.814 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:13.808+0000 7f407d546640 1 --2- 172.21.15.78:0/3420139014 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f405c066470 0x7f405c068930 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7f4078067a20 tx=0x7f4074009190 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:03:13.816 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:13.812+0000 7f406dffb640 1 -- 172.21.15.78:0/3420139014 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f4068051150 con 0x7f40780af4c0 2023-11-28T20:03:13.962 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:13.956+0000 7f407f7aa640 1 -- 172.21.15.78:0/3420139014 --> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f407815e100 con 0x7f405c066470 2023-11-28T20:03:13.964 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:13.960+0000 7f406dffb640 1 -- 172.21.15.78:0/3420139014 <== mgr.4106 v2:172.21.15.78:6832/2935380957 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+50724 (secure 0 0 0) 0x7f407815e100 con 0x7f405c066470 2023-11-28T20:03:13.965 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-11-28T20:03:13.965 INFO:teuthology.orchestra.run.smithi078.stderr:dumped all 2023-11-28T20:03:13.966 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:13.960+0000 7f407f7aa640 1 -- 172.21.15.78:0/3420139014 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f405c066470 msgr2=0x7f405c068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:03:13.967 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:13.960+0000 7f407f7aa640 1 --2- 172.21.15.78:0/3420139014 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f405c066470 0x7f405c068930 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7f4078067a20 tx=0x7f4074009190 comp rx=0 tx=0).stop 2023-11-28T20:03:13.967 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:13.960+0000 7f407f7aa640 1 -- 172.21.15.78:0/3420139014 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f40780af4c0 msgr2=0x7f4078150840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:03:13.967 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:13.960+0000 7f407f7aa640 1 --2- 172.21.15.78:0/3420139014 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f40780af4c0 0x7f4078150840 secure :-1 s=READY pgs=1183 cs=0 l=1 rev1=1 crypto rx=0x7f406800e810 tx=0x7f406800ecd0 comp rx=0 tx=0).stop 2023-11-28T20:03:13.967 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:13.960+0000 7f407f7aa640 1 -- 172.21.15.78:0/3420139014 shutdown_connections 2023-11-28T20:03:13.967 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:13.960+0000 7f407f7aa640 1 --2- 172.21.15.78:0/3420139014 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f405c066470 0x7f405c068930 unknown :-1 s=CLOSED pgs=559 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:03:13.967 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:13.960+0000 7f407f7aa640 1 --2- 172.21.15.78:0/3420139014 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f40780c67d0 0x7f40780c2440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:03:13.968 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:13.960+0000 7f407f7aa640 1 --2- 172.21.15.78:0/3420139014 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f40780af4c0 0x7f4078150840 unknown :-1 s=CLOSED pgs=1183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:03:13.968 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:13.960+0000 7f407f7aa640 1 --2- 172.21.15.78:0/3420139014 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f407806b9f0 0x7f40780ae360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:03:13.968 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:13.960+0000 7f407f7aa640 1 -- 172.21.15.78:0/3420139014 >> 172.21.15.78:0/3420139014 conn(0x7f40780ab9d0 msgr2=0x7f4078155c90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:03:13.968 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:13.964+0000 7f407f7aa640 1 -- 172.21.15.78:0/3420139014 shutdown_connections 2023-11-28T20:03:13.969 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:13.964+0000 7f407f7aa640 1 -- 172.21.15.78:0/3420139014 wait complete. 2023-11-28T20:03:13.985 INFO:teuthology.orchestra.run.smithi078.stdout:{"pg_ready":true,"pg_map":{"version":216,"stamp":"2023-11-28T20:03:12.004662+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":59,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":258676,"kb_used_data":9216,"kb_used_omap":12,"kb_used_meta":249331,"kb_avail":754716044,"statfs":{"total":773094113280,"available":772829229056,"internally_reserved":0,"allocated":9437184,"data_stored":5621384,"data_compressed":66748,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":12752,"internal_metadata":255315504},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":23,"apply_latency_ms":23,"commit_latency_ns":23000000,"apply_latency_ns":23000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-12079,"num_objects":-23,"num_object_clones":0,"num_object_copies":-46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-23,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-60,"num_write_kb":-32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.001485"},"pg_stats":[{"pgid":"1.0","version":"17'117","reported_seq":229,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-11-28T20:03:04.363116+0000","last_change":"2023-11-28T19:58:56.136501+0000","last_active":"2023-11-28T20:03:04.363116+0000","last_peered":"2023-11-28T20:03:04.363116+0000","last_clean":"2023-11-28T20:03:04.363116+0000","last_became_active":"2023-11-28T19:58:56.135998+0000","last_became_peered":"2023-11-28T19:58:56.135998+0000","last_unstale":"2023-11-28T20:03:04.363116+0000","last_undegraded":"2023-11-28T20:03:04.363116+0000","last_fullsized":"2023-11-28T20:03:04.363116+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:58:54.602349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:58:54.602349+0000","last_clean_scrub_stamp":"2023-11-28T19:58:54.602349+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:33:42.723349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":66748,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574903,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32380,"kb_used_data":1200,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339460,"statfs":{"total":96636764160,"available":96603607040,"internally_reserved":0,"allocated":1228800,"data_stored":1145449,"data_compressed":33374,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 20:03:01 2023","interfaces":[{"interface":"back","average":{"1min":0.65600000000000003,"5min":0.66700000000000004,"15min":0.67500000000000004},"min":{"1min":0.45100000000000001,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.84299999999999997,"5min":0.94299999999999995,"15min":0.94299999999999995},"last":0.48499999999999999},{"interface":"front","average":{"1min":0.67200000000000004,"5min":0.66800000000000004,"15min":0.67900000000000005},"min":{"1min":0.47799999999999998,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":0.81100000000000005,"5min":1.014,"15min":1.014},"last":0.876}]},{"osd":1,"last update":"Tue Nov 28 20:03:01 2023","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.63800000000000001,"15min":0.64300000000000002},"min":{"1min":0.47699999999999998,"5min":0.438,"15min":0.438},"max":{"1min":0.84199999999999997,"5min":0.95099999999999996,"15min":0.95099999999999996},"last":0.67500000000000004},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.66900000000000004,"15min":0.69099999999999995},"min":{"1min":0.47799999999999998,"5min":0.432,"15min":0.432},"max":{"1min":0.77600000000000002,"5min":1.0900000000000001,"15min":1.0900000000000001},"last":0.69199999999999995}]},{"osd":2,"last update":"Tue Nov 28 20:03:01 2023","interfaces":[{"interface":"back","average":{"1min":0.70399999999999996,"5min":0.70299999999999996,"15min":0.72399999999999998},"min":{"1min":0.52800000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.86099999999999999,"5min":0.98799999999999999,"15min":0.98799999999999999},"last":0.79700000000000004},{"interface":"front","average":{"1min":0.67600000000000005,"5min":0.68100000000000005,"15min":0.69799999999999995},"min":{"1min":0.504,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":0.84999999999999998,"5min":1.514,"15min":1.514},"last":0.82399999999999995}]},{"osd":3,"last update":"Tue Nov 28 20:03:01 2023","interfaces":[{"interface":"back","average":{"1min":0.69699999999999995,"5min":0.69699999999999995,"15min":0.69899999999999995},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":0.93200000000000005,"5min":1.0449999999999999,"15min":1.0449999999999999},"last":0.61299999999999999},{"interface":"front","average":{"1min":0.70999999999999996,"5min":0.749,"15min":0.77800000000000002},"min":{"1min":0.53100000000000003,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":0.86599999999999999,"5min":1.1299999999999999,"15min":1.1299999999999999},"last":0.63500000000000001}]},{"osd":4,"last update":"Tue Nov 28 20:03:01 2023","interfaces":[{"interface":"back","average":{"1min":0.64600000000000002,"5min":0.629,"15min":0.63700000000000001},"min":{"1min":0.443,"5min":0.378,"15min":0.378},"max":{"1min":0.86799999999999999,"5min":1.2829999999999999,"15min":1.2829999999999999},"last":0.92600000000000005},{"interface":"front","average":{"1min":0.70899999999999996,"5min":0.70399999999999996,"15min":0.72399999999999998},"min":{"1min":0.439,"5min":0.379,"15min":0.379},"max":{"1min":0.98199999999999998,"5min":1.1120000000000001,"15min":1.1120000000000001},"last":0.75800000000000001}]},{"osd":5,"last update":"Tue Nov 28 20:03:01 2023","interfaces":[{"interface":"back","average":{"1min":0.68300000000000005,"5min":0.65200000000000002,"15min":0.67400000000000004},"min":{"1min":0.42599999999999999,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.86299999999999999,"5min":1.1699999999999999,"15min":1.1699999999999999},"last":0.84399999999999997},{"interface":"front","average":{"1min":0.70099999999999996,"5min":0.72399999999999998,"15min":0.752},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":0.92000000000000004,"5min":1.3300000000000001,"15min":1.3300000000000001},"last":0.90300000000000002}]},{"osd":6,"last update":"Tue Nov 28 20:03:01 2023","interfaces":[{"interface":"back","average":{"1min":0.76100000000000001,"5min":0.75900000000000001,"15min":0.77400000000000002},"min":{"1min":0.59999999999999998,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.95599999999999996,"5min":1.3919999999999999,"15min":1.3919999999999999},"last":0.95099999999999996},{"interface":"front","average":{"1min":0.70399999999999996,"5min":0.70299999999999996,"15min":0.73199999999999998},"min":{"1min":0.443,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":1.018,"5min":1.23,"15min":1.23},"last":0.72799999999999998}]}]},{"osd":6,"up_from":13,"seq":55834574901,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32316,"kb_used_data":1136,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339524,"statfs":{"total":96636764160,"available":96603672576,"internally_reserved":0,"allocated":1163264,"data_stored":555081,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 20:02:55 2023","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.61799999999999999,"15min":0.61599999999999999},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.88700000000000001,"5min":0.91600000000000004,"15min":0.91600000000000004},"last":0.58799999999999997},{"interface":"front","average":{"1min":0.63500000000000001,"5min":0.65400000000000003,"15min":0.66000000000000003},"min":{"1min":0.49399999999999999,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":0.91900000000000004,"5min":0.98999999999999999,"15min":0.98999999999999999},"last":0.73999999999999999}]},{"osd":1,"last update":"Tue Nov 28 20:02:55 2023","interfaces":[{"interface":"back","average":{"1min":0.73499999999999999,"5min":0.755,"15min":0.77900000000000003},"min":{"1min":0.55800000000000005,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":0.89000000000000001,"5min":1.105,"15min":1.105},"last":0.78900000000000003},{"interface":"front","average":{"1min":0.66300000000000003,"5min":0.67100000000000004,"15min":0.68100000000000005},"min":{"1min":0.50600000000000001,"5min":0.443,"15min":0.443},"max":{"1min":0.879,"5min":0.95899999999999996,"15min":0.95899999999999996},"last":0.69099999999999995}]},{"osd":2,"last update":"Tue Nov 28 20:02:55 2023","interfaces":[{"interface":"back","average":{"1min":0.64000000000000001,"5min":0.67000000000000004,"15min":0.68999999999999995},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.81599999999999995,"5min":0.93400000000000005,"15min":0.93400000000000005},"last":0.66900000000000004},{"interface":"front","average":{"1min":0.70599999999999996,"5min":0.70099999999999996,"15min":0.71299999999999997},"min":{"1min":0.46999999999999997,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":0.84299999999999997,"5min":1.006,"15min":1.006},"last":0.87}]},{"osd":3,"last update":"Tue Nov 28 20:02:55 2023","interfaces":[{"interface":"back","average":{"1min":0.69499999999999995,"5min":0.71699999999999997,"15min":0.73799999999999999},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.86399999999999999,"5min":1.056,"15min":1.056},"last":0.84699999999999998},{"interface":"front","average":{"1min":0.66500000000000004,"5min":0.66200000000000003,"15min":0.67700000000000005},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.87,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.72599999999999998}]},{"osd":4,"last update":"Tue Nov 28 20:02:55 2023","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.61799999999999999,"15min":0.626},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.81000000000000005,"5min":0.97599999999999998,"15min":0.97599999999999998},"last":0.91100000000000003},{"interface":"front","average":{"1min":0.67300000000000004,"5min":0.67400000000000004,"15min":0.71699999999999997},"min":{"1min":0.46999999999999997,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.82799999999999996,"5min":1.389,"15min":1.389},"last":0.89300000000000002}]},{"osd":5,"last update":"Tue Nov 28 20:02:55 2023","interfaces":[{"interface":"back","average":{"1min":0.70399999999999996,"5min":0.749,"15min":0.79400000000000004},"min":{"1min":0.49399999999999999,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.95499999999999996,"5min":1.4259999999999999,"15min":1.4259999999999999},"last":1.032},{"interface":"front","average":{"1min":0.69199999999999995,"5min":0.71599999999999997,"15min":0.747},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.90000000000000002,"5min":1.276,"15min":1.276},"last":1.0049999999999999}]},{"osd":7,"last update":"Tue Nov 28 20:02:55 2023","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.67100000000000004,"15min":0.69999999999999996},"min":{"1min":0.379,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.90300000000000002,"5min":1.014,"15min":1.014},"last":0.82199999999999995},{"interface":"front","average":{"1min":0.73799999999999999,"5min":0.76100000000000001,"15min":0.80700000000000005},"min":{"1min":0.52700000000000002,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":0.92200000000000004,"5min":1.242,"15min":1.242},"last":0.96099999999999997}]}]},{"osd":5,"up_from":13,"seq":55834574903,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32320,"kb_used_data":1136,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339520,"statfs":{"total":96636764160,"available":96603668480,"internally_reserved":0,"allocated":1163264,"data_stored":555081,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 20:03:02 2023","interfaces":[{"interface":"back","average":{"1min":0.85899999999999999,"5min":0.71399999999999997,"15min":0.71099999999999997},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":5.9080000000000004,"5min":5.9080000000000004,"15min":5.9080000000000004},"last":0.77700000000000002},{"interface":"front","average":{"1min":0.84099999999999997,"5min":0.70999999999999996,"15min":0.71599999999999997},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":4.8789999999999996,"5min":4.8789999999999996,"15min":4.8789999999999996},"last":0.55300000000000005}]},{"osd":1,"last update":"Tue Nov 28 20:03:02 2023","interfaces":[{"interface":"back","average":{"1min":0.875,"5min":0.71899999999999997,"15min":0.71499999999999997},"min":{"1min":0.42599999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":5.1529999999999996,"5min":5.1529999999999996,"15min":5.1529999999999996},"last":1.006},{"interface":"front","average":{"1min":0.91700000000000004,"5min":0.73099999999999998,"15min":0.72899999999999998},"min":{"1min":0.41199999999999998,"5min":0.38,"15min":0.38},"max":{"1min":6.3630000000000004,"5min":6.3630000000000004,"15min":6.3630000000000004},"last":0.90200000000000002}]},{"osd":2,"last update":"Tue Nov 28 20:03:02 2023","interfaces":[{"interface":"back","average":{"1min":0.83299999999999996,"5min":0.81100000000000005,"15min":0.90100000000000002},"min":{"1min":0.47799999999999998,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":4.3639999999999999,"5min":5.0880000000000001,"15min":5.0880000000000001},"last":0.625},{"interface":"front","average":{"1min":0.93700000000000006,"5min":0.86599999999999999,"15min":0.95599999999999996},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":6.335,"5min":6.335,"15min":6.335},"last":0.93000000000000005}]},{"osd":3,"last update":"Tue Nov 28 20:03:02 2023","interfaces":[{"interface":"back","average":{"1min":0.92200000000000004,"5min":0.88,"15min":0.97799999999999998},"min":{"1min":0.56399999999999995,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":4.9710000000000001,"5min":5.0469999999999997,"15min":5.0469999999999997},"last":0.75800000000000001},{"interface":"front","average":{"1min":0.878,"5min":0.85399999999999998,"15min":0.95199999999999996},"min":{"1min":0.51600000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":5.0439999999999996,"5min":5.0439999999999996,"15min":5.0439999999999996},"last":0.97799999999999998}]},{"osd":4,"last update":"Tue Nov 28 20:03:02 2023","interfaces":[{"interface":"back","average":{"1min":0.88200000000000001,"5min":0.68100000000000005,"15min":0.67800000000000005},"min":{"1min":0.38700000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":6.5380000000000003,"5min":6.5380000000000003,"15min":6.5380000000000003},"last":0.83599999999999997},{"interface":"front","average":{"1min":0.85899999999999999,"5min":0.74299999999999999,"15min":0.745},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":5.0179999999999998,"5min":5.0179999999999998,"15min":5.0179999999999998},"last":0.71199999999999997}]},{"osd":6,"last update":"Tue Nov 28 20:03:02 2023","interfaces":[{"interface":"back","average":{"1min":0.871,"5min":0.73899999999999999,"15min":0.71699999999999997},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":5.21,"5min":5.21,"15min":5.21},"last":1.0569999999999999},{"interface":"front","average":{"1min":0.94699999999999995,"5min":0.76400000000000001,"15min":0.753},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":6.4790000000000001,"5min":6.4790000000000001,"15min":6.4790000000000001},"last":0.95799999999999996}]},{"osd":7,"last update":"Tue Nov 28 20:03:02 2023","interfaces":[{"interface":"back","average":{"1min":0.93999999999999995,"5min":0.80400000000000005,"15min":0.79200000000000004},"min":{"1min":0.53100000000000003,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":5.6360000000000001,"5min":5.6360000000000001,"15min":5.6360000000000001},"last":0.66700000000000004},{"interface":"front","average":{"1min":0.92800000000000005,"5min":0.80800000000000005,"15min":0.80300000000000005},"min":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":5.5819999999999999,"5min":5.5819999999999999,"15min":5.5819999999999999},"last":1.032}]}]},{"osd":4,"up_from":13,"seq":55834574902,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32320,"kb_used_data":1136,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339520,"statfs":{"total":96636764160,"available":96603668480,"internally_reserved":0,"allocated":1163264,"data_stored":555081,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 20:03:01 2023","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.68100000000000005,"15min":0.70099999999999996},"min":{"1min":0.51800000000000002,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.85199999999999998,"5min":1.107,"15min":1.107},"last":0.745},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.66300000000000003,"15min":0.69699999999999995},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.81499999999999995,"5min":1.163,"15min":1.163},"last":0.49299999999999999}]},{"osd":1,"last update":"Tue Nov 28 20:03:01 2023","interfaces":[{"interface":"back","average":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.74199999999999999},"min":{"1min":0.41499999999999998,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.95499999999999996,"5min":1.111,"15min":1.111},"last":0.65200000000000002},{"interface":"front","average":{"1min":0.70499999999999996,"5min":0.75800000000000001,"15min":0.79500000000000004},"min":{"1min":0.502,"5min":0.443,"15min":0.443},"max":{"1min":0.91000000000000003,"5min":1.238,"15min":1.238},"last":0.66000000000000003}]},{"osd":2,"last update":"Tue Nov 28 20:03:01 2023","interfaces":[{"interface":"back","average":{"1min":0.68300000000000005,"5min":0.73099999999999998,"15min":0.76500000000000001},"min":{"1min":0.44500000000000001,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.92700000000000005,"5min":1.0669999999999999,"15min":1.0669999999999999},"last":0.67600000000000005},{"interface":"front","average":{"1min":0.74399999999999999,"5min":0.75900000000000001,"15min":0.79700000000000004},"min":{"1min":0.63600000000000001,"5min":0.438,"15min":0.438},"max":{"1min":0.86399999999999999,"5min":1.1359999999999999,"15min":1.1359999999999999},"last":0.70499999999999996}]},{"osd":3,"last update":"Tue Nov 28 20:03:01 2023","interfaces":[{"interface":"back","average":{"1min":0.626,"5min":0.70899999999999996,"15min":0.77100000000000002},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":0.76300000000000001,"5min":1.202,"15min":1.202},"last":0.53900000000000003},{"interface":"front","average":{"1min":0.71699999999999997,"5min":0.745,"15min":0.77900000000000003},"min":{"1min":0.50600000000000001,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":0.90100000000000002,"5min":1.0669999999999999,"15min":1.0669999999999999},"last":0.61699999999999999}]},{"osd":5,"last update":"Tue Nov 28 20:03:01 2023","interfaces":[{"interface":"back","average":{"1min":0.59699999999999998,"5min":0.67000000000000004,"15min":0.70599999999999996},"min":{"1min":0.38400000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.78900000000000003,"5min":0.95899999999999996,"15min":0.95899999999999996},"last":0.58199999999999996},{"interface":"front","average":{"1min":0.60499999999999998,"5min":0.66200000000000003,"15min":0.69599999999999995},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.92200000000000004,"5min":1.034,"15min":1.034},"last":0.45600000000000002}]},{"osd":6,"last update":"Tue Nov 28 20:03:01 2023","interfaces":[{"interface":"back","average":{"1min":0.69699999999999995,"5min":0.68400000000000005,"15min":0.71799999999999997},"min":{"1min":0.48699999999999999,"5min":0.438,"15min":0.438},"max":{"1min":0.94499999999999995,"5min":1.0309999999999999,"15min":1.0309999999999999},"last":0.504},{"interface":"front","average":{"1min":0.68200000000000005,"5min":0.746,"15min":0.77100000000000002},"min":{"1min":0.48799999999999999,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":0.88800000000000001,"5min":1.002,"15min":1.002},"last":0.47599999999999998}]},{"osd":7,"last update":"Tue Nov 28 20:03:01 2023","interfaces":[{"interface":"back","average":{"1min":0.69899999999999995,"5min":0.74099999999999999,"15min":0.77200000000000002},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":0.89800000000000002,"5min":1.089,"15min":1.089},"last":0.60199999999999998},{"interface":"front","average":{"1min":0.80700000000000005,"5min":0.82399999999999995,"15min":0.85399999999999998},"min":{"1min":0.68200000000000005,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":0.97199999999999998,"5min":1.1459999999999999,"15min":1.1459999999999999},"last":0.72799999999999998}]}]},{"osd":3,"up_from":13,"seq":55834574903,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32316,"kb_used_data":1136,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339524,"statfs":{"total":96636764160,"available":96603672576,"internally_reserved":0,"allocated":1163264,"data_stored":555081,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 20:02:58 2023","interfaces":[{"interface":"back","average":{"1min":0.40200000000000002,"5min":0.432,"15min":0.442},"min":{"1min":0.31,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":0.52100000000000002,"5min":1.7130000000000001,"15min":1.7130000000000001},"last":0.34100000000000003},{"interface":"front","average":{"1min":0.46000000000000002,"5min":0.46300000000000002,"15min":0.46999999999999997},"min":{"1min":0.377,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.57899999999999996,"5min":3.0630000000000002,"15min":3.0630000000000002},"last":0.60899999999999999}]},{"osd":1,"last update":"Tue Nov 28 20:02:58 2023","interfaces":[{"interface":"back","average":{"1min":0.434,"5min":0.44800000000000001,"15min":0.46999999999999997},"min":{"1min":0.32900000000000001,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.85399999999999998,"5min":0.89200000000000002,"15min":0.89200000000000002},"last":0.624},{"interface":"front","average":{"1min":0.438,"5min":0.50800000000000001,"15min":0.50600000000000001},"min":{"1min":0.30599999999999999,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.66700000000000004,"5min":5.8920000000000003,"15min":5.8920000000000003},"last":0.44}]},{"osd":2,"last update":"Tue Nov 28 20:02:58 2023","interfaces":[{"interface":"back","average":{"1min":0.499,"5min":0.54100000000000004,"15min":0.53600000000000003},"min":{"1min":0.36199999999999999,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.621,"5min":4.6390000000000002,"15min":4.6390000000000002},"last":0.50800000000000001},{"interface":"front","average":{"1min":0.52100000000000002,"5min":0.626,"15min":0.59899999999999998},"min":{"1min":0.42099999999999999,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.80200000000000005,"5min":11.593,"15min":11.593},"last":0.73299999999999998}]},{"osd":4,"last update":"Tue Nov 28 20:02:58 2023","interfaces":[{"interface":"back","average":{"1min":0.98699999999999999,"5min":0.83899999999999997,"15min":0.78700000000000003},"min":{"1min":0.61599999999999999,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":5.2629999999999999,"5min":5.5549999999999997,"15min":5.5549999999999997},"last":0.63500000000000001},{"interface":"front","average":{"1min":1.0229999999999999,"5min":0.92300000000000004,"15min":0.84299999999999997},"min":{"1min":0.60999999999999999,"5min":0.503,"15min":0.503},"max":{"1min":5.4939999999999998,"5min":11.747,"15min":11.747},"last":0.79300000000000004}]},{"osd":5,"last update":"Tue Nov 28 20:02:58 2023","interfaces":[{"interface":"back","average":{"1min":0.92900000000000005,"5min":0.88300000000000001,"15min":0.82699999999999996},"min":{"1min":0.52600000000000002,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":5.4450000000000003,"5min":11.705,"15min":11.705},"last":0.97199999999999998},{"interface":"front","average":{"1min":0.94499999999999995,"5min":0.79900000000000004,"15min":0.80100000000000005},"min":{"1min":0.56599999999999995,"5min":0.495,"15min":0.495},"max":{"1min":4.681,"5min":4.681,"15min":4.681},"last":0.89600000000000002}]},{"osd":6,"last update":"Tue Nov 28 20:02:58 2023","interfaces":[{"interface":"back","average":{"1min":0.78500000000000003,"5min":0.80700000000000005,"15min":0.83099999999999996},"min":{"1min":0.54600000000000004,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":1,"5min":1.6639999999999999,"15min":1.6639999999999999},"last":0.64100000000000001},{"interface":"front","average":{"1min":0.81499999999999995,"5min":0.81699999999999995,"15min":0.77100000000000002},"min":{"1min":0.55200000000000005,"5min":0.495,"15min":0.495},"max":{"1min":1.0329999999999999,"5min":4.0679999999999996,"15min":4.0679999999999996},"last":0.58699999999999997}]},{"osd":7,"last update":"Tue Nov 28 20:02:58 2023","interfaces":[{"interface":"back","average":{"1min":0.90100000000000002,"5min":0.90600000000000003,"15min":0.86799999999999999},"min":{"1min":0.64700000000000002,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":2.6589999999999998,"5min":6.6619999999999999,"15min":6.6619999999999999},"last":0.65700000000000003},{"interface":"front","average":{"1min":0.94099999999999995,"5min":0.93300000000000005,"15min":0.90500000000000003},"min":{"1min":0.57399999999999995,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":4.6539999999999999,"5min":11.782,"15min":11.782},"last":0.68899999999999995}]}]},{"osd":2,"up_from":13,"seq":55834574901,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32316,"kb_used_data":1136,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339524,"statfs":{"total":96636764160,"available":96603672576,"internally_reserved":0,"allocated":1163264,"data_stored":555081,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 20:02:57 2023","interfaces":[{"interface":"back","average":{"1min":0.39300000000000002,"5min":0.42499999999999999,"15min":0.44500000000000001},"min":{"1min":0.254,"5min":0.254,"15min":0.254},"max":{"1min":0.58399999999999996,"5min":0.74099999999999999,"15min":0.74099999999999999},"last":0.59699999999999998},{"interface":"front","average":{"1min":0.35799999999999998,"5min":0.436,"15min":0.46700000000000003},"min":{"1min":0.27300000000000002,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.46999999999999997,"5min":0.67700000000000005,"15min":0.67700000000000005},"last":0.66600000000000004}]},{"osd":1,"last update":"Tue Nov 28 20:02:57 2023","interfaces":[{"interface":"back","average":{"1min":0.437,"5min":0.47399999999999998,"15min":0.501},"min":{"1min":0.33600000000000002,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.50600000000000001,"5min":1.0389999999999999,"15min":1.0389999999999999},"last":0.61899999999999999},{"interface":"front","average":{"1min":0.433,"5min":0.46500000000000002,"15min":0.49099999999999999},"min":{"1min":0.28899999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.56699999999999995,"5min":0.70999999999999996,"15min":0.70999999999999996},"last":0.65500000000000003}]},{"osd":3,"last update":"Tue Nov 28 20:02:57 2023","interfaces":[{"interface":"back","average":{"1min":0.41299999999999998,"5min":0.45100000000000001,"15min":0.46500000000000002},"min":{"1min":0.32100000000000001,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"last":0.64000000000000001},{"interface":"front","average":{"1min":0.46700000000000003,"5min":0.53400000000000003,"15min":0.57199999999999995},"min":{"1min":0.39700000000000002,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.56399999999999995,"5min":0.98499999999999999,"15min":0.98499999999999999},"last":0.70399999999999996}]},{"osd":4,"last update":"Tue Nov 28 20:02:57 2023","interfaces":[{"interface":"back","average":{"1min":0.69199999999999995,"5min":0.76900000000000002,"15min":0.83099999999999996},"min":{"1min":0.5,"5min":0.5,"15min":0.5},"max":{"1min":0.97199999999999998,"5min":1.139,"15min":1.139},"last":0.98999999999999999},{"interface":"front","average":{"1min":0.65900000000000003,"5min":0.75700000000000001,"15min":0.82099999999999995},"min":{"1min":0.51600000000000001,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":0.82699999999999996,"5min":1.238,"15min":1.238},"last":0.93300000000000005}]},{"osd":5,"last update":"Tue Nov 28 20:02:57 2023","interfaces":[{"interface":"back","average":{"1min":0.69799999999999995,"5min":0.77400000000000002,"15min":0.84799999999999998},"min":{"1min":0.55300000000000005,"5min":0.437,"15min":0.437},"max":{"1min":0.94499999999999995,"5min":1.6180000000000001,"15min":1.6180000000000001},"last":0.86799999999999999},{"interface":"front","average":{"1min":0.65600000000000003,"5min":0.748,"15min":0.80600000000000005},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":0.84099999999999997,"5min":1.339,"15min":1.339},"last":0.96899999999999997}]},{"osd":6,"last update":"Tue Nov 28 20:02:57 2023","interfaces":[{"interface":"back","average":{"1min":0.69699999999999995,"5min":0.751,"15min":0.78700000000000003},"min":{"1min":0.54300000000000004,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":0.88300000000000001,"5min":1.1839999999999999,"15min":1.1839999999999999},"last":0.92200000000000004},{"interface":"front","average":{"1min":0.67500000000000004,"5min":0.76500000000000001,"15min":0.82899999999999996},"min":{"1min":0.52400000000000002,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":0.93000000000000005,"5min":1.099,"15min":1.099},"last":0.88300000000000001}]},{"osd":7,"last update":"Tue Nov 28 20:02:57 2023","interfaces":[{"interface":"back","average":{"1min":0.67200000000000004,"5min":0.77800000000000002,"15min":0.85199999999999998},"min":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":0.86899999999999999,"5min":1.4590000000000001,"15min":1.4590000000000001},"last":0.89700000000000002},{"interface":"front","average":{"1min":0.71299999999999997,"5min":0.77800000000000002,"15min":0.83699999999999997},"min":{"1min":0.57199999999999995,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":0.85499999999999998,"5min":1.387,"15min":1.387},"last":0.95099999999999996}]}]},{"osd":1,"up_from":13,"seq":55834574903,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32324,"kb_used_data":1136,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339516,"statfs":{"total":96636764160,"available":96603664384,"internally_reserved":0,"allocated":1163264,"data_stored":555081,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 20:03:04 2023","interfaces":[{"interface":"back","average":{"1min":0.372,"5min":0.48899999999999999,"15min":0.60099999999999998},"min":{"1min":0.23300000000000001,"5min":0.23300000000000001,"15min":0.23300000000000001},"max":{"1min":0.48899999999999999,"5min":3.8740000000000001,"15min":3.8740000000000001},"last":0.56200000000000006},{"interface":"front","average":{"1min":0.38900000000000001,"5min":0.47299999999999998,"15min":0.53900000000000003},"min":{"1min":0.26900000000000002,"5min":0.25,"15min":0.25},"max":{"1min":0.495,"5min":2.0760000000000001,"15min":2.0760000000000001},"last":0.64500000000000002}]},{"osd":2,"last update":"Tue Nov 28 20:03:04 2023","interfaces":[{"interface":"back","average":{"1min":0.38,"5min":0.504,"15min":0.60699999999999998},"min":{"1min":0.315,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.44700000000000001,"5min":3.7320000000000002,"15min":3.7320000000000002},"last":0.47699999999999998},{"interface":"front","average":{"1min":0.42999999999999999,"5min":0.56799999999999995,"15min":0.69599999999999995},"min":{"1min":0.28999999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.59299999999999997,"5min":3.9089999999999998,"15min":3.9089999999999998},"last":0.51400000000000001}]},{"osd":3,"last update":"Tue Nov 28 20:03:04 2023","interfaces":[{"interface":"back","average":{"1min":0.51000000000000001,"5min":0.58399999999999996,"15min":0.64800000000000002},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":0.64200000000000002,"5min":1.6399999999999999,"15min":1.6399999999999999},"last":0.628},{"interface":"front","average":{"1min":0.48299999999999998,"5min":0.57199999999999995,"15min":0.65900000000000003},"min":{"1min":0.34000000000000002,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.58599999999999997,"5min":2.5270000000000001,"15min":2.5270000000000001},"last":0.58699999999999997}]},{"osd":4,"last update":"Tue Nov 28 20:03:04 2023","interfaces":[{"interface":"back","average":{"1min":0.65500000000000003,"5min":0.76900000000000002,"15min":0.85299999999999998},"min":{"1min":0.441,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.88500000000000001,"5min":3.1659999999999999,"15min":3.1659999999999999},"last":0.77700000000000002},{"interface":"front","average":{"1min":0.67200000000000004,"5min":0.78900000000000003,"15min":0.89300000000000002},"min":{"1min":0.51600000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.85699999999999998,"5min":3.7959999999999998,"15min":3.7959999999999998},"last":0.90600000000000003}]},{"osd":5,"last update":"Tue Nov 28 20:03:04 2023","interfaces":[{"interface":"back","average":{"1min":0.69099999999999995,"5min":0.81599999999999995,"15min":0.93100000000000005},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.91600000000000004,"5min":4.1479999999999997,"15min":4.1479999999999997},"last":0.88800000000000001},{"interface":"front","average":{"1min":0.64200000000000002,"5min":0.77200000000000002,"15min":0.86399999999999999},"min":{"1min":0.55000000000000004,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":0.76300000000000001,"5min":3.5569999999999999,"15min":3.5569999999999999},"last":0.91700000000000004}]},{"osd":6,"last update":"Tue Nov 28 20:03:04 2023","interfaces":[{"interface":"back","average":{"1min":0.69299999999999995,"5min":0.82799999999999996,"15min":0.93700000000000006},"min":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":0.90100000000000002,"5min":2.863,"15min":2.863},"last":0.76800000000000002},{"interface":"front","average":{"1min":0.72099999999999997,"5min":0.84499999999999997,"15min":0.93700000000000006},"min":{"1min":0.56000000000000005,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":0.91900000000000004,"5min":3.371,"15min":3.371},"last":0.81799999999999995}]},{"osd":7,"last update":"Tue Nov 28 20:03:04 2023","interfaces":[{"interface":"back","average":{"1min":0.71799999999999997,"5min":0.83199999999999996,"15min":0.95199999999999996},"min":{"1min":0.58399999999999996,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":0.91600000000000004,"5min":3.8439999999999999,"15min":3.8439999999999999},"last":0.873},{"interface":"front","average":{"1min":0.69999999999999996,"5min":0.83799999999999997,"15min":0.97099999999999997},"min":{"1min":0.53200000000000003,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.93200000000000005,"5min":3.9689999999999999,"15min":3.9689999999999999},"last":0.73499999999999999}]}]},{"osd":0,"up_from":13,"seq":55834574902,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32384,"kb_used_data":1200,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339456,"statfs":{"total":96636764160,"available":96603602944,"internally_reserved":0,"allocated":1228800,"data_stored":1145449,"data_compressed":33374,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Nov 28 20:02:58 2023","interfaces":[{"interface":"back","average":{"1min":0.38700000000000001,"5min":0.51300000000000001,"15min":0.63100000000000001},"min":{"1min":0.26000000000000001,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":0.80100000000000005,"5min":4.883,"15min":4.883},"last":0.27100000000000002},{"interface":"front","average":{"1min":0.47999999999999998,"5min":0.621,"15min":0.79200000000000004},"min":{"1min":0.23899999999999999,"5min":0.23899999999999999,"15min":0.23899999999999999},"max":{"1min":1.7669999999999999,"5min":8.0800000000000001,"15min":8.0800000000000001},"last":0.40000000000000002}]},{"osd":2,"last update":"Tue Nov 28 20:02:58 2023","interfaces":[{"interface":"back","average":{"1min":0.48599999999999999,"5min":0.67700000000000005,"15min":0.875},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":1.0309999999999999,"5min":8.1029999999999998,"15min":8.1029999999999998},"last":0.621},{"interface":"front","average":{"1min":0.55300000000000005,"5min":0.70699999999999996,"15min":0.89300000000000002},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":1.802,"5min":8.1310000000000002,"15min":8.1310000000000002},"last":0.66500000000000004}]},{"osd":3,"last update":"Tue Nov 28 20:02:58 2023","interfaces":[{"interface":"back","average":{"1min":0.47399999999999998,"5min":0.57399999999999995,"15min":0.68899999999999995},"min":{"1min":0.27700000000000002,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":1.5629999999999999,"5min":4.3949999999999996,"15min":4.3949999999999996},"last":0.378},{"interface":"front","average":{"1min":0.58099999999999996,"5min":0.61599999999999999,"15min":0.70999999999999996},"min":{"1min":0.34999999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":2.0920000000000001,"5min":4.3470000000000004,"15min":4.3470000000000004},"last":0.41899999999999998}]},{"osd":4,"last update":"Tue Nov 28 20:02:58 2023","interfaces":[{"interface":"back","average":{"1min":0.747,"5min":0.85899999999999999,"15min":0.98699999999999999},"min":{"1min":0.52400000000000002,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":1.52,"5min":4.6360000000000001,"15min":4.6360000000000001},"last":0.81000000000000005},{"interface":"front","average":{"1min":0.70799999999999996,"5min":0.86499999999999999,"15min":0.98999999999999999},"min":{"1min":0.53800000000000003,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":0.98099999999999998,"5min":4.4710000000000001,"15min":4.4710000000000001},"last":0.64900000000000002}]},{"osd":5,"last update":"Tue Nov 28 20:02:58 2023","interfaces":[{"interface":"back","average":{"1min":0.751,"5min":0.87,"15min":1},"min":{"1min":0.52300000000000002,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.6659999999999999,"5min":4.6120000000000001,"15min":4.6120000000000001},"last":0.58799999999999997},{"interface":"front","average":{"1min":0.79300000000000004,"5min":0.88500000000000001,"15min":0.996},"min":{"1min":0.65000000000000002,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.595,"5min":4.5449999999999999,"15min":4.5449999999999999},"last":0.59899999999999998}]},{"osd":6,"last update":"Tue Nov 28 20:02:58 2023","interfaces":[{"interface":"back","average":{"1min":0.77000000000000002,"5min":0.88300000000000001,"15min":1.0129999999999999},"min":{"1min":0.57299999999999995,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":2.149,"5min":4.657,"15min":4.657},"last":0.68300000000000005},{"interface":"front","average":{"1min":0.80400000000000005,"5min":0.89900000000000002,"15min":1.0309999999999999},"min":{"1min":0.60999999999999999,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":2.2130000000000001,"5min":4.5259999999999998,"15min":4.5259999999999998},"last":0.71199999999999997}]},{"osd":7,"last update":"Tue Nov 28 20:02:58 2023","interfaces":[{"interface":"back","average":{"1min":0.754,"5min":0.88300000000000001,"15min":1.028},"min":{"1min":0.56299999999999994,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":1.7270000000000001,"5min":4.7320000000000002,"15min":4.7320000000000002},"last":0.55000000000000004},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.86899999999999999,"15min":0.98699999999999999},"min":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":1.0880000000000001,"5min":4.4939999999999998,"15min":4.4939999999999998},"last":0.69299999999999995}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33374,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33374,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-28T20:03:13.990 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2023-11-28T19:58:54.602349+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=28, tm_hour=19, tm_min=58, tm_sec=54, tm_wday=1, tm_yday=332, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=28, tm_hour=20, tm_min=3, tm_sec=8, tm_wday=1, tm_yday=332, tm_isdst=0) 2023-11-28T20:03:13.991 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-11-28T20:03:33.994 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-28T20:03:34.144 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:34.140+0000 7feaed49c640 1 Processor -- start 2023-11-28T20:03:34.144 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:34.140+0000 7feaed49c640 1 -- start start 2023-11-28T20:03:34.145 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:34.140+0000 7feaed49c640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7feae814fd10 0x7feae80a4dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:03:34.145 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:34.140+0000 7feaed49c640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feae80c5710 con 0x7feae8156110 2023-11-28T20:03:34.146 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:34.140+0000 7feaed49c640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feae8155c80 con 0x7feae80a5300 2023-11-28T20:03:34.146 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:34.140+0000 7feaed49c640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feae806c5e0 con 0x7feae814fd10 2023-11-28T20:03:34.146 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:34.140+0000 7feae6ffd640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7feae814fd10 0x7feae80a4dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:03:34.146 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:34.140+0000 7feae77fe640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7feae8156110 0x7feae815ce50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:58080/0 (socket says 172.21.15.78:58080) 2023-11-28T20:03:34.146 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:34.140+0000 7feae77fe640 1 -- 172.21.15.78:0/2987251444 learned_addr learned my addr 172.21.15.78:0/2987251444 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-11-28T20:03:34.147 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:34.140+0000 7feae6ffd640 1 -- 172.21.15.78:0/2987251444 >> v1:172.21.15.179:6789/0 conn(0x7feae80a5300 legacy=0x7feae8071e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:03:34.147 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:34.140+0000 7feae6ffd640 1 -- 172.21.15.78:0/2987251444 >> v1:172.21.15.78:6789/0 conn(0x7feae8156110 legacy=0x7feae815ce50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:03:34.147 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:34.140+0000 7feae6ffd640 1 -- 172.21.15.78:0/2987251444 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feae80c4e70 con 0x7feae814fd10 2023-11-28T20:03:34.147 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:34.140+0000 7feae67fc640 1 -- 172.21.15.78:0/2987251444 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 355365117 0 0) 0x7feae80c5710 con 0x7feae8156110 2023-11-28T20:03:34.149 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:34.144+0000 7feae6ffd640 1 --2- 172.21.15.78:0/2987251444 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7feae814fd10 0x7feae80a4dc0 secure :-1 s=READY pgs=1185 cs=0 l=1 rev1=1 crypto rx=0x7fead8009d90 tx=0x7fead801c7c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cc439faa26438727 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:03:34.149 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:34.144+0000 7feae67fc640 1 -- 172.21.15.78:0/2987251444 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fead80a5880 con 0x7feae814fd10 2023-11-28T20:03:34.149 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:34.144+0000 7feae67fc640 1 -- 172.21.15.78:0/2987251444 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fead80a59e0 con 0x7feae814fd10 2023-11-28T20:03:34.149 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:34.144+0000 7feae67fc640 1 -- 172.21.15.78:0/2987251444 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fead80a5d70 con 0x7feae814fd10 2023-11-28T20:03:34.150 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:34.144+0000 7feaed49c640 1 -- 172.21.15.78:0/2987251444 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7feae814fd10 msgr2=0x7feae80a4dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:03:34.150 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:34.144+0000 7feaed49c640 1 --2- 172.21.15.78:0/2987251444 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7feae814fd10 0x7feae80a4dc0 secure :-1 s=READY pgs=1185 cs=0 l=1 rev1=1 crypto rx=0x7fead8009d90 tx=0x7fead801c7c0 comp rx=0 tx=0).stop 2023-11-28T20:03:34.151 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:34.144+0000 7feaed49c640 1 -- 172.21.15.78:0/2987251444 shutdown_connections 2023-11-28T20:03:34.151 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:34.144+0000 7feaed49c640 1 --2- 172.21.15.78:0/2987251444 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7feae814fd10 0x7feae80a4dc0 unknown :-1 s=CLOSED pgs=1185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:03:34.151 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:34.144+0000 7feaed49c640 1 -- 172.21.15.78:0/2987251444 >> 172.21.15.78:0/2987251444 conn(0x7feae80a7810 msgr2=0x7feae80a7c20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:03:34.151 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:34.144+0000 7feaed49c640 1 -- 172.21.15.78:0/2987251444 shutdown_connections 2023-11-28T20:03:34.151 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:34.144+0000 7feaed49c640 1 -- 172.21.15.78:0/2987251444 wait complete. 2023-11-28T20:03:34.152 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:34.148+0000 7feaed49c640 1 Processor -- start 2023-11-28T20:03:34.152 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:34.148+0000 7feaed49c640 1 -- start start 2023-11-28T20:03:34.154 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:34.148+0000 7feaed49c640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7feae80a5300 0x7feae80c1340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:03:34.154 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:34.148+0000 7feaed49c640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7feae814fd10 0x7feae81ecd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:03:34.154 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:34.148+0000 7feaed49c640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7feae8156110 0x7feae80bf0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:03:34.154 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:34.148+0000 7feaed49c640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feae80c0a40 con 0x7feae80a5300 2023-11-28T20:03:34.155 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:34.148+0000 7feaed49c640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feae8071630 con 0x7feae814fd10 2023-11-28T20:03:34.155 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:34.148+0000 7feaed49c640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feae8071910 con 0x7feae8156110 2023-11-28T20:03:34.155 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:34.148+0000 7feae6ffd640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7feae80a5300 0x7feae80c1340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:03:34.155 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:34.148+0000 7feae6ffd640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7feae80a5300 0x7feae80c1340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:37090/0 (socket says 172.21.15.78:37090) 2023-11-28T20:03:34.155 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:34.148+0000 7feae6ffd640 1 -- 172.21.15.78:0/3814694778 learned_addr learned my addr 172.21.15.78:0/3814694778 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T20:03:34.155 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:34.148+0000 7feade7fc640 1 --2- 172.21.15.78:0/3814694778 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7feae814fd10 0x7feae81ecd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:03:34.155 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:34.148+0000 7feae77fe640 1 --2- 172.21.15.78:0/3814694778 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7feae8156110 0x7feae80bf0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:03:34.155 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:34.148+0000 7feae6ffd640 1 -- 172.21.15.78:0/3814694778 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7feae8156110 msgr2=0x7feae80bf0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:03:34.156 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:34.148+0000 7feae6ffd640 1 --2- 172.21.15.78:0/3814694778 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7feae8156110 0x7feae80bf0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:03:34.156 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:34.148+0000 7feae6ffd640 1 -- 172.21.15.78:0/3814694778 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7feae814fd10 msgr2=0x7feae81ecd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:03:34.156 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:34.148+0000 7feae6ffd640 1 --2- 172.21.15.78:0/3814694778 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7feae814fd10 0x7feae81ecd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:03:34.156 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:34.148+0000 7feae6ffd640 1 -- 172.21.15.78:0/3814694778 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fead8009a70 con 0x7feae80a5300 2023-11-28T20:03:34.156 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:34.148+0000 7feae77fe640 1 --2- 172.21.15.78:0/3814694778 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7feae8156110 0x7feae80bf0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T20:03:34.156 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:34.148+0000 7feae6ffd640 1 --2- 172.21.15.78:0/3814694778 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7feae80a5300 0x7feae80c1340 secure :-1 s=READY pgs=1186 cs=0 l=1 rev1=1 crypto rx=0x7fead80b0040 tx=0x7fead8019560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:03:34.156 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:34.148+0000 7feadffff640 1 -- 172.21.15.78:0/3814694778 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fead80ad850 con 0x7feae80a5300 2023-11-28T20:03:34.157 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:34.148+0000 7feadffff640 1 -- 172.21.15.78:0/3814694778 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fead80ad9b0 con 0x7feae80a5300 2023-11-28T20:03:34.157 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:34.148+0000 7feadffff640 1 -- 172.21.15.78:0/3814694778 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fead80add60 con 0x7feae80a5300 2023-11-28T20:03:34.157 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:34.148+0000 7feaed49c640 1 -- 172.21.15.78:0/3814694778 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feae8071bf0 con 0x7feae80a5300 2023-11-28T20:03:34.157 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:34.152+0000 7feaed49c640 1 -- 172.21.15.78:0/3814694778 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feae8150700 con 0x7feae80a5300 2023-11-28T20:03:34.158 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:34.152+0000 7feaed49c640 1 -- 172.21.15.78:0/3814694778 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feae81508f0 con 0x7feae80a5300 2023-11-28T20:03:34.158 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:34.152+0000 7feadffff640 1 -- 172.21.15.78:0/3814694778 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fead80b4050 con 0x7feae80a5300 2023-11-28T20:03:34.158 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:34.152+0000 7feadffff640 1 --2- 172.21.15.78:0/3814694778 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7feac80664a0 0x7feac8068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:03:34.158 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:34.152+0000 7feadffff640 1 -- 172.21.15.78:0/3814694778 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 5349+0+0 (secure 0 0 0) 0x7fead811ed50 con 0x7feae80a5300 2023-11-28T20:03:34.158 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:34.152+0000 7feade7fc640 1 --2- 172.21.15.78:0/3814694778 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7feac80664a0 0x7feac8068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:03:34.159 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:34.152+0000 7feade7fc640 1 --2- 172.21.15.78:0/3814694778 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7feac80664a0 0x7feac8068960 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7feae815e2e0 tx=0x7fead0007e40 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:03:34.161 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:34.156+0000 7feadffff640 1 -- 172.21.15.78:0/3814694778 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fead80ec290 con 0x7feae80a5300 2023-11-28T20:03:34.306 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:34.304+0000 7feaed49c640 1 -- 172.21.15.78:0/3814694778 --> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7feae80aba00 con 0x7feac80664a0 2023-11-28T20:03:34.308 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:34.304+0000 7feadffff640 1 -- 172.21.15.78:0/3814694778 <== mgr.4106 v2:172.21.15.78:6832/2935380957 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+50594 (secure 0 0 0) 0x7fead0004c00 con 0x7feac80664a0 2023-11-28T20:03:34.309 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-11-28T20:03:34.310 INFO:teuthology.orchestra.run.smithi078.stderr:dumped all 2023-11-28T20:03:34.311 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:34.308+0000 7feaed49c640 1 -- 172.21.15.78:0/3814694778 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7feac80664a0 msgr2=0x7feac8068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:03:34.311 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:34.308+0000 7feaed49c640 1 --2- 172.21.15.78:0/3814694778 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7feac80664a0 0x7feac8068960 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7feae815e2e0 tx=0x7fead0007e40 comp rx=0 tx=0).stop 2023-11-28T20:03:34.311 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:34.308+0000 7feaed49c640 1 -- 172.21.15.78:0/3814694778 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7feae80a5300 msgr2=0x7feae80c1340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:03:34.311 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:34.308+0000 7feaed49c640 1 --2- 172.21.15.78:0/3814694778 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7feae80a5300 0x7feae80c1340 secure :-1 s=READY pgs=1186 cs=0 l=1 rev1=1 crypto rx=0x7fead80b0040 tx=0x7fead8019560 comp rx=0 tx=0).stop 2023-11-28T20:03:34.311 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:34.308+0000 7feaed49c640 1 -- 172.21.15.78:0/3814694778 shutdown_connections 2023-11-28T20:03:34.311 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:34.308+0000 7feaed49c640 1 --2- 172.21.15.78:0/3814694778 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7feac80664a0 0x7feac8068960 unknown :-1 s=CLOSED pgs=560 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:03:34.311 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:34.308+0000 7feaed49c640 1 --2- 172.21.15.78:0/3814694778 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7feae8156110 0x7feae80bf0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:03:34.312 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:34.308+0000 7feaed49c640 1 --2- 172.21.15.78:0/3814694778 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7feae814fd10 0x7feae81ecd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:03:34.312 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:34.308+0000 7feaed49c640 1 --2- 172.21.15.78:0/3814694778 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7feae80a5300 0x7feae80c1340 unknown :-1 s=CLOSED pgs=1186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:03:34.312 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:34.308+0000 7feaed49c640 1 -- 172.21.15.78:0/3814694778 >> 172.21.15.78:0/3814694778 conn(0x7feae80a7810 msgr2=0x7feae80aa910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:03:34.312 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:34.308+0000 7feaed49c640 1 -- 172.21.15.78:0/3814694778 shutdown_connections 2023-11-28T20:03:34.312 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:34.308+0000 7feaed49c640 1 -- 172.21.15.78:0/3814694778 wait complete. 2023-11-28T20:03:34.329 INFO:teuthology.orchestra.run.smithi078.stdout:{"pg_ready":true,"pg_map":{"version":227,"stamp":"2023-11-28T20:03:34.009530+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":258664,"kb_used_data":9216,"kb_used_omap":12,"kb_used_meta":249331,"kb_avail":754716056,"statfs":{"total":773094113280,"available":772829241344,"internally_reserved":0,"allocated":9437184,"data_stored":5621384,"data_compressed":66748,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":12752,"internal_metadata":255315504},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002779"},"pg_stats":[{"pgid":"1.0","version":"93'119","reported_seq":240,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-11-28T20:03:15.303061+0000","last_change":"2023-11-28T20:03:15.303088+0000","last_active":"2023-11-28T20:03:15.303061+0000","last_peered":"2023-11-28T20:03:15.303061+0000","last_clean":"2023-11-28T20:03:15.303061+0000","last_became_active":"2023-11-28T19:58:56.135998+0000","last_became_peered":"2023-11-28T19:58:56.135998+0000","last_unstale":"2023-11-28T20:03:15.303061+0000","last_undegraded":"2023-11-28T20:03:15.303061+0000","last_fullsized":"2023-11-28T20:03:15.303061+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"93'119","last_scrub_stamp":"2023-11-28T20:03:15.302971+0000","last_deep_scrub":"93'119","last_deep_scrub_stamp":"2023-11-28T20:03:15.302971+0000","last_clean_scrub_stamp":"2023-11-28T20:03:15.302971+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:55:52.831803+0000","scrub_duration":0.0093462070000000005,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":66748,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574908,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32376,"kb_used_data":1200,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339464,"statfs":{"total":96636764160,"available":96603611136,"internally_reserved":0,"allocated":1228800,"data_stored":1145449,"data_compressed":33374,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 20:03:01 2023","interfaces":[{"interface":"back","average":{"1min":0.65600000000000003,"5min":0.66700000000000004,"15min":0.67500000000000004},"min":{"1min":0.45100000000000001,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.84299999999999997,"5min":0.94299999999999995,"15min":0.94299999999999995},"last":0.80500000000000005},{"interface":"front","average":{"1min":0.67200000000000004,"5min":0.66800000000000004,"15min":0.67900000000000005},"min":{"1min":0.47799999999999998,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":0.81100000000000005,"5min":1.014,"15min":1.014},"last":0.81899999999999995}]},{"osd":1,"last update":"Tue Nov 28 20:03:01 2023","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.63800000000000001,"15min":0.64300000000000002},"min":{"1min":0.47699999999999998,"5min":0.438,"15min":0.438},"max":{"1min":0.84199999999999997,"5min":0.95099999999999996,"15min":0.95099999999999996},"last":0.76000000000000001},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.66900000000000004,"15min":0.69099999999999995},"min":{"1min":0.47799999999999998,"5min":0.432,"15min":0.432},"max":{"1min":0.77600000000000002,"5min":1.0900000000000001,"15min":1.0900000000000001},"last":0.61299999999999999}]},{"osd":2,"last update":"Tue Nov 28 20:03:01 2023","interfaces":[{"interface":"back","average":{"1min":0.70399999999999996,"5min":0.70299999999999996,"15min":0.72399999999999998},"min":{"1min":0.52800000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.86099999999999999,"5min":0.98799999999999999,"15min":0.98799999999999999},"last":0.73399999999999999},{"interface":"front","average":{"1min":0.67600000000000005,"5min":0.68100000000000005,"15min":0.69799999999999995},"min":{"1min":0.504,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":0.84999999999999998,"5min":1.514,"15min":1.514},"last":0.65600000000000003}]},{"osd":3,"last update":"Tue Nov 28 20:03:01 2023","interfaces":[{"interface":"back","average":{"1min":0.69699999999999995,"5min":0.69699999999999995,"15min":0.69899999999999995},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":0.93200000000000005,"5min":1.0449999999999999,"15min":1.0449999999999999},"last":0.56000000000000005},{"interface":"front","average":{"1min":0.70999999999999996,"5min":0.749,"15min":0.77800000000000002},"min":{"1min":0.53100000000000003,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":0.86599999999999999,"5min":1.1299999999999999,"15min":1.1299999999999999},"last":0.77700000000000002}]},{"osd":4,"last update":"Tue Nov 28 20:03:01 2023","interfaces":[{"interface":"back","average":{"1min":0.64600000000000002,"5min":0.629,"15min":0.63700000000000001},"min":{"1min":0.443,"5min":0.378,"15min":0.378},"max":{"1min":0.86799999999999999,"5min":1.2829999999999999,"15min":1.2829999999999999},"last":0.79200000000000004},{"interface":"front","average":{"1min":0.70899999999999996,"5min":0.70399999999999996,"15min":0.72399999999999998},"min":{"1min":0.439,"5min":0.379,"15min":0.379},"max":{"1min":0.98199999999999998,"5min":1.1120000000000001,"15min":1.1120000000000001},"last":0.83499999999999996}]},{"osd":5,"last update":"Tue Nov 28 20:03:01 2023","interfaces":[{"interface":"back","average":{"1min":0.68300000000000005,"5min":0.65200000000000002,"15min":0.67400000000000004},"min":{"1min":0.42599999999999999,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.86299999999999999,"5min":1.1699999999999999,"15min":1.1699999999999999},"last":0.68200000000000005},{"interface":"front","average":{"1min":0.70099999999999996,"5min":0.72399999999999998,"15min":0.752},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":0.92000000000000004,"5min":1.3300000000000001,"15min":1.3300000000000001},"last":0.71199999999999997}]},{"osd":6,"last update":"Tue Nov 28 20:03:01 2023","interfaces":[{"interface":"back","average":{"1min":0.76100000000000001,"5min":0.75900000000000001,"15min":0.77400000000000002},"min":{"1min":0.59999999999999998,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.95599999999999996,"5min":1.3919999999999999,"15min":1.3919999999999999},"last":0.749},{"interface":"front","average":{"1min":0.70399999999999996,"5min":0.70299999999999996,"15min":0.73199999999999998},"min":{"1min":0.443,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":1.018,"5min":1.23,"15min":1.23},"last":0.69399999999999995}]}]},{"osd":6,"up_from":13,"seq":55834574906,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32316,"kb_used_data":1136,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339524,"statfs":{"total":96636764160,"available":96603672576,"internally_reserved":0,"allocated":1163264,"data_stored":555081,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 20:02:55 2023","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.61799999999999999,"15min":0.61599999999999999},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.88700000000000001,"5min":0.91600000000000004,"15min":0.91600000000000004},"last":0.85999999999999999},{"interface":"front","average":{"1min":0.63500000000000001,"5min":0.65400000000000003,"15min":0.66000000000000003},"min":{"1min":0.49399999999999999,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":0.91900000000000004,"5min":0.98999999999999999,"15min":0.98999999999999999},"last":0.72399999999999998}]},{"osd":1,"last update":"Tue Nov 28 20:02:55 2023","interfaces":[{"interface":"back","average":{"1min":0.73499999999999999,"5min":0.755,"15min":0.77900000000000003},"min":{"1min":0.55800000000000005,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":0.89000000000000001,"5min":1.105,"15min":1.105},"last":0.80100000000000005},{"interface":"front","average":{"1min":0.66300000000000003,"5min":0.67100000000000004,"15min":0.68100000000000005},"min":{"1min":0.50600000000000001,"5min":0.443,"15min":0.443},"max":{"1min":0.879,"5min":0.95899999999999996,"15min":0.95899999999999996},"last":0.92400000000000004}]},{"osd":2,"last update":"Tue Nov 28 20:02:55 2023","interfaces":[{"interface":"back","average":{"1min":0.64000000000000001,"5min":0.67000000000000004,"15min":0.68999999999999995},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.81599999999999995,"5min":0.93400000000000005,"15min":0.93400000000000005},"last":0.748},{"interface":"front","average":{"1min":0.70599999999999996,"5min":0.70099999999999996,"15min":0.71299999999999997},"min":{"1min":0.46999999999999997,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":0.84299999999999997,"5min":1.006,"15min":1.006},"last":0.95299999999999996}]},{"osd":3,"last update":"Tue Nov 28 20:02:55 2023","interfaces":[{"interface":"back","average":{"1min":0.69499999999999995,"5min":0.71699999999999997,"15min":0.73799999999999999},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.86399999999999999,"5min":1.056,"15min":1.056},"last":0.76200000000000001},{"interface":"front","average":{"1min":0.66500000000000004,"5min":0.66200000000000003,"15min":0.67700000000000005},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.87,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.81200000000000006}]},{"osd":4,"last update":"Tue Nov 28 20:02:55 2023","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.61799999999999999,"15min":0.626},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.81000000000000005,"5min":0.97599999999999998,"15min":0.97599999999999998},"last":0.83299999999999996},{"interface":"front","average":{"1min":0.67300000000000004,"5min":0.67400000000000004,"15min":0.71699999999999997},"min":{"1min":0.46999999999999997,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.82799999999999996,"5min":1.389,"15min":1.389},"last":0.624}]},{"osd":5,"last update":"Tue Nov 28 20:02:55 2023","interfaces":[{"interface":"back","average":{"1min":0.70399999999999996,"5min":0.749,"15min":0.79400000000000004},"min":{"1min":0.49399999999999999,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.95499999999999996,"5min":1.4259999999999999,"15min":1.4259999999999999},"last":0.67800000000000005},{"interface":"front","average":{"1min":0.69199999999999995,"5min":0.71599999999999997,"15min":0.747},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.90000000000000002,"5min":1.276,"15min":1.276},"last":0.78200000000000003}]},{"osd":7,"last update":"Tue Nov 28 20:02:55 2023","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.67100000000000004,"15min":0.69999999999999996},"min":{"1min":0.379,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.90300000000000002,"5min":1.014,"15min":1.014},"last":0.65300000000000002},{"interface":"front","average":{"1min":0.73799999999999999,"5min":0.76100000000000001,"15min":0.80700000000000005},"min":{"1min":0.52700000000000002,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":0.92200000000000004,"5min":1.242,"15min":1.242},"last":0.88800000000000001}]}]},{"osd":5,"up_from":13,"seq":55834574908,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32320,"kb_used_data":1136,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339520,"statfs":{"total":96636764160,"available":96603668480,"internally_reserved":0,"allocated":1163264,"data_stored":555081,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 20:03:02 2023","interfaces":[{"interface":"back","average":{"1min":0.85899999999999999,"5min":0.71399999999999997,"15min":0.71099999999999997},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":5.9080000000000004,"5min":5.9080000000000004,"15min":5.9080000000000004},"last":0.64300000000000002},{"interface":"front","average":{"1min":0.84099999999999997,"5min":0.70999999999999996,"15min":0.71599999999999997},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":4.8789999999999996,"5min":4.8789999999999996,"15min":4.8789999999999996},"last":0.85099999999999998}]},{"osd":1,"last update":"Tue Nov 28 20:03:02 2023","interfaces":[{"interface":"back","average":{"1min":0.875,"5min":0.71899999999999997,"15min":0.71499999999999997},"min":{"1min":0.42599999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":5.1529999999999996,"5min":5.1529999999999996,"15min":5.1529999999999996},"last":0.78600000000000003},{"interface":"front","average":{"1min":0.91700000000000004,"5min":0.73099999999999998,"15min":0.72899999999999998},"min":{"1min":0.41199999999999998,"5min":0.38,"15min":0.38},"max":{"1min":6.3630000000000004,"5min":6.3630000000000004,"15min":6.3630000000000004},"last":0.59699999999999998}]},{"osd":2,"last update":"Tue Nov 28 20:03:02 2023","interfaces":[{"interface":"back","average":{"1min":0.83299999999999996,"5min":0.81100000000000005,"15min":0.90100000000000002},"min":{"1min":0.47799999999999998,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":4.3639999999999999,"5min":5.0880000000000001,"15min":5.0880000000000001},"last":0.73299999999999998},{"interface":"front","average":{"1min":0.93700000000000006,"5min":0.86599999999999999,"15min":0.95599999999999996},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":6.335,"5min":6.335,"15min":6.335},"last":0.83399999999999996}]},{"osd":3,"last update":"Tue Nov 28 20:03:02 2023","interfaces":[{"interface":"back","average":{"1min":0.92200000000000004,"5min":0.88,"15min":0.97799999999999998},"min":{"1min":0.56399999999999995,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":4.9710000000000001,"5min":5.0469999999999997,"15min":5.0469999999999997},"last":0.76400000000000001},{"interface":"front","average":{"1min":0.878,"5min":0.85399999999999998,"15min":0.95199999999999996},"min":{"1min":0.51600000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":5.0439999999999996,"5min":5.0439999999999996,"15min":5.0439999999999996},"last":0.70599999999999996}]},{"osd":4,"last update":"Tue Nov 28 20:03:02 2023","interfaces":[{"interface":"back","average":{"1min":0.88200000000000001,"5min":0.68100000000000005,"15min":0.67800000000000005},"min":{"1min":0.38700000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":6.5380000000000003,"5min":6.5380000000000003,"15min":6.5380000000000003},"last":0.52600000000000002},{"interface":"front","average":{"1min":0.85899999999999999,"5min":0.74299999999999999,"15min":0.745},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":5.0179999999999998,"5min":5.0179999999999998,"15min":5.0179999999999998},"last":0.66000000000000003}]},{"osd":6,"last update":"Tue Nov 28 20:03:02 2023","interfaces":[{"interface":"back","average":{"1min":0.871,"5min":0.73899999999999999,"15min":0.71699999999999997},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":5.21,"5min":5.21,"15min":5.21},"last":0.56399999999999995},{"interface":"front","average":{"1min":0.94699999999999995,"5min":0.76400000000000001,"15min":0.753},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":6.4790000000000001,"5min":6.4790000000000001,"15min":6.4790000000000001},"last":0.68600000000000005}]},{"osd":7,"last update":"Tue Nov 28 20:03:02 2023","interfaces":[{"interface":"back","average":{"1min":0.93999999999999995,"5min":0.80400000000000005,"15min":0.79200000000000004},"min":{"1min":0.53100000000000003,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":5.6360000000000001,"5min":5.6360000000000001,"15min":5.6360000000000001},"last":0.81100000000000005},{"interface":"front","average":{"1min":0.92800000000000005,"5min":0.80800000000000005,"15min":0.80300000000000005},"min":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":5.5819999999999999,"5min":5.5819999999999999,"15min":5.5819999999999999},"last":0.751}]}]},{"osd":4,"up_from":13,"seq":55834574907,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32320,"kb_used_data":1136,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339520,"statfs":{"total":96636764160,"available":96603668480,"internally_reserved":0,"allocated":1163264,"data_stored":555081,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 20:03:01 2023","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.68100000000000005,"15min":0.70099999999999996},"min":{"1min":0.51800000000000002,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.85199999999999998,"5min":1.107,"15min":1.107},"last":0.64200000000000002},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.66300000000000003,"15min":0.69699999999999995},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.81499999999999995,"5min":1.163,"15min":1.163},"last":0.52800000000000002}]},{"osd":1,"last update":"Tue Nov 28 20:03:01 2023","interfaces":[{"interface":"back","average":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.74199999999999999},"min":{"1min":0.41499999999999998,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.95499999999999996,"5min":1.111,"15min":1.111},"last":0.66400000000000003},{"interface":"front","average":{"1min":0.70499999999999996,"5min":0.75800000000000001,"15min":0.79500000000000004},"min":{"1min":0.502,"5min":0.443,"15min":0.443},"max":{"1min":0.91000000000000003,"5min":1.238,"15min":1.238},"last":0.745}]},{"osd":2,"last update":"Tue Nov 28 20:03:01 2023","interfaces":[{"interface":"back","average":{"1min":0.68300000000000005,"5min":0.73099999999999998,"15min":0.76500000000000001},"min":{"1min":0.44500000000000001,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.92700000000000005,"5min":1.0669999999999999,"15min":1.0669999999999999},"last":0.61899999999999999},{"interface":"front","average":{"1min":0.74399999999999999,"5min":0.75900000000000001,"15min":0.79700000000000004},"min":{"1min":0.63600000000000001,"5min":0.438,"15min":0.438},"max":{"1min":0.86399999999999999,"5min":1.1359999999999999,"15min":1.1359999999999999},"last":0.69699999999999995}]},{"osd":3,"last update":"Tue Nov 28 20:03:01 2023","interfaces":[{"interface":"back","average":{"1min":0.626,"5min":0.70899999999999996,"15min":0.77100000000000002},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":0.76300000000000001,"5min":1.202,"15min":1.202},"last":0.59299999999999997},{"interface":"front","average":{"1min":0.71699999999999997,"5min":0.745,"15min":0.77900000000000003},"min":{"1min":0.50600000000000001,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":0.90100000000000002,"5min":1.0669999999999999,"15min":1.0669999999999999},"last":0.54700000000000004}]},{"osd":5,"last update":"Tue Nov 28 20:03:01 2023","interfaces":[{"interface":"back","average":{"1min":0.59699999999999998,"5min":0.67000000000000004,"15min":0.70599999999999996},"min":{"1min":0.38400000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.78900000000000003,"5min":0.95899999999999996,"15min":0.95899999999999996},"last":0.41199999999999998},{"interface":"front","average":{"1min":0.60499999999999998,"5min":0.66200000000000003,"15min":0.69599999999999995},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.92200000000000004,"5min":1.034,"15min":1.034},"last":0.45000000000000001}]},{"osd":6,"last update":"Tue Nov 28 20:03:01 2023","interfaces":[{"interface":"back","average":{"1min":0.69699999999999995,"5min":0.68400000000000005,"15min":0.71799999999999997},"min":{"1min":0.48699999999999999,"5min":0.438,"15min":0.438},"max":{"1min":0.94499999999999995,"5min":1.0309999999999999,"15min":1.0309999999999999},"last":0.47499999999999998},{"interface":"front","average":{"1min":0.68200000000000005,"5min":0.746,"15min":0.77100000000000002},"min":{"1min":0.48799999999999999,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":0.88800000000000001,"5min":1.002,"15min":1.002},"last":0.56799999999999995}]},{"osd":7,"last update":"Tue Nov 28 20:03:01 2023","interfaces":[{"interface":"back","average":{"1min":0.69899999999999995,"5min":0.74099999999999999,"15min":0.77200000000000002},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":0.89800000000000002,"5min":1.089,"15min":1.089},"last":0.504},{"interface":"front","average":{"1min":0.80700000000000005,"5min":0.82399999999999995,"15min":0.85399999999999998},"min":{"1min":0.68200000000000005,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":0.97199999999999998,"5min":1.1459999999999999,"15min":1.1459999999999999},"last":0.71899999999999997}]}]},{"osd":3,"up_from":13,"seq":55834574908,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32316,"kb_used_data":1136,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339524,"statfs":{"total":96636764160,"available":96603672576,"internally_reserved":0,"allocated":1163264,"data_stored":555081,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 20:02:58 2023","interfaces":[{"interface":"back","average":{"1min":0.40200000000000002,"5min":0.432,"15min":0.442},"min":{"1min":0.31,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":0.52100000000000002,"5min":1.7130000000000001,"15min":1.7130000000000001},"last":0.41599999999999998},{"interface":"front","average":{"1min":0.46000000000000002,"5min":0.46300000000000002,"15min":0.46999999999999997},"min":{"1min":0.377,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.57899999999999996,"5min":3.0630000000000002,"15min":3.0630000000000002},"last":0.46500000000000002}]},{"osd":1,"last update":"Tue Nov 28 20:02:58 2023","interfaces":[{"interface":"back","average":{"1min":0.434,"5min":0.44800000000000001,"15min":0.46999999999999997},"min":{"1min":0.32900000000000001,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.85399999999999998,"5min":0.89200000000000002,"15min":0.89200000000000002},"last":0.39300000000000002},{"interface":"front","average":{"1min":0.438,"5min":0.50800000000000001,"15min":0.50600000000000001},"min":{"1min":0.30599999999999999,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.66700000000000004,"5min":5.8920000000000003,"15min":5.8920000000000003},"last":0.48799999999999999}]},{"osd":2,"last update":"Tue Nov 28 20:02:58 2023","interfaces":[{"interface":"back","average":{"1min":0.499,"5min":0.54100000000000004,"15min":0.53600000000000003},"min":{"1min":0.36199999999999999,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.621,"5min":4.6390000000000002,"15min":4.6390000000000002},"last":0.54700000000000004},{"interface":"front","average":{"1min":0.52100000000000002,"5min":0.626,"15min":0.59899999999999998},"min":{"1min":0.42099999999999999,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.80200000000000005,"5min":11.593,"15min":11.593},"last":0.59199999999999997}]},{"osd":4,"last update":"Tue Nov 28 20:02:58 2023","interfaces":[{"interface":"back","average":{"1min":0.98699999999999999,"5min":0.83899999999999997,"15min":0.78700000000000003},"min":{"1min":0.61599999999999999,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":5.2629999999999999,"5min":5.5549999999999997,"15min":5.5549999999999997},"last":0.85899999999999999},{"interface":"front","average":{"1min":1.0229999999999999,"5min":0.92300000000000004,"15min":0.84299999999999997},"min":{"1min":0.60999999999999999,"5min":0.503,"15min":0.503},"max":{"1min":5.4939999999999998,"5min":11.747,"15min":11.747},"last":0.91600000000000004}]},{"osd":5,"last update":"Tue Nov 28 20:02:58 2023","interfaces":[{"interface":"back","average":{"1min":0.92900000000000005,"5min":0.88300000000000001,"15min":0.82699999999999996},"min":{"1min":0.52600000000000002,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":5.4450000000000003,"5min":11.705,"15min":11.705},"last":0.877},{"interface":"front","average":{"1min":0.94499999999999995,"5min":0.79900000000000004,"15min":0.80100000000000005},"min":{"1min":0.56599999999999995,"5min":0.495,"15min":0.495},"max":{"1min":4.681,"5min":4.681,"15min":4.681},"last":0.80600000000000005}]},{"osd":6,"last update":"Tue Nov 28 20:02:58 2023","interfaces":[{"interface":"back","average":{"1min":0.78500000000000003,"5min":0.80700000000000005,"15min":0.83099999999999996},"min":{"1min":0.54600000000000004,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":1,"5min":1.6639999999999999,"15min":1.6639999999999999},"last":0.89700000000000002},{"interface":"front","average":{"1min":0.81499999999999995,"5min":0.81699999999999995,"15min":0.77100000000000002},"min":{"1min":0.55200000000000005,"5min":0.495,"15min":0.495},"max":{"1min":1.0329999999999999,"5min":4.0679999999999996,"15min":4.0679999999999996},"last":0.97599999999999998}]},{"osd":7,"last update":"Tue Nov 28 20:02:58 2023","interfaces":[{"interface":"back","average":{"1min":0.90100000000000002,"5min":0.90600000000000003,"15min":0.86799999999999999},"min":{"1min":0.64700000000000002,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":2.6589999999999998,"5min":6.6619999999999999,"15min":6.6619999999999999},"last":0.93700000000000006},{"interface":"front","average":{"1min":0.94099999999999995,"5min":0.93300000000000005,"15min":0.90500000000000003},"min":{"1min":0.57399999999999995,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":4.6539999999999999,"5min":11.782,"15min":11.782},"last":0.79300000000000004}]}]},{"osd":2,"up_from":13,"seq":55834574906,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32316,"kb_used_data":1136,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339524,"statfs":{"total":96636764160,"available":96603672576,"internally_reserved":0,"allocated":1163264,"data_stored":555081,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 20:02:57 2023","interfaces":[{"interface":"back","average":{"1min":0.39300000000000002,"5min":0.42499999999999999,"15min":0.44500000000000001},"min":{"1min":0.254,"5min":0.254,"15min":0.254},"max":{"1min":0.58399999999999996,"5min":0.74099999999999999,"15min":0.74099999999999999},"last":0.67900000000000005},{"interface":"front","average":{"1min":0.35799999999999998,"5min":0.436,"15min":0.46700000000000003},"min":{"1min":0.27300000000000002,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.46999999999999997,"5min":0.67700000000000005,"15min":0.67700000000000005},"last":0.42499999999999999}]},{"osd":1,"last update":"Tue Nov 28 20:02:57 2023","interfaces":[{"interface":"back","average":{"1min":0.437,"5min":0.47399999999999998,"15min":0.501},"min":{"1min":0.33600000000000002,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.50600000000000001,"5min":1.0389999999999999,"15min":1.0389999999999999},"last":0.65200000000000002},{"interface":"front","average":{"1min":0.433,"5min":0.46500000000000002,"15min":0.49099999999999999},"min":{"1min":0.28899999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.56699999999999995,"5min":0.70999999999999996,"15min":0.70999999999999996},"last":0.623}]},{"osd":3,"last update":"Tue Nov 28 20:02:57 2023","interfaces":[{"interface":"back","average":{"1min":0.41299999999999998,"5min":0.45100000000000001,"15min":0.46500000000000002},"min":{"1min":0.32100000000000001,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"last":0.373},{"interface":"front","average":{"1min":0.46700000000000003,"5min":0.53400000000000003,"15min":0.57199999999999995},"min":{"1min":0.39700000000000002,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.56399999999999995,"5min":0.98499999999999999,"15min":0.98499999999999999},"last":0.499}]},{"osd":4,"last update":"Tue Nov 28 20:02:57 2023","interfaces":[{"interface":"back","average":{"1min":0.69199999999999995,"5min":0.76900000000000002,"15min":0.83099999999999996},"min":{"1min":0.5,"5min":0.5,"15min":0.5},"max":{"1min":0.97199999999999998,"5min":1.139,"15min":1.139},"last":0.72999999999999998},{"interface":"front","average":{"1min":0.65900000000000003,"5min":0.75700000000000001,"15min":0.82099999999999995},"min":{"1min":0.51600000000000001,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":0.82699999999999996,"5min":1.238,"15min":1.238},"last":0.83399999999999996}]},{"osd":5,"last update":"Tue Nov 28 20:02:57 2023","interfaces":[{"interface":"back","average":{"1min":0.69799999999999995,"5min":0.77400000000000002,"15min":0.84799999999999998},"min":{"1min":0.55300000000000005,"5min":0.437,"15min":0.437},"max":{"1min":0.94499999999999995,"5min":1.6180000000000001,"15min":1.6180000000000001},"last":0.78100000000000003},{"interface":"front","average":{"1min":0.65600000000000003,"5min":0.748,"15min":0.80600000000000005},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":0.84099999999999997,"5min":1.339,"15min":1.339},"last":0.59699999999999998}]},{"osd":6,"last update":"Tue Nov 28 20:02:57 2023","interfaces":[{"interface":"back","average":{"1min":0.69699999999999995,"5min":0.751,"15min":0.78700000000000003},"min":{"1min":0.54300000000000004,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":0.88300000000000001,"5min":1.1839999999999999,"15min":1.1839999999999999},"last":0.70799999999999996},{"interface":"front","average":{"1min":0.67500000000000004,"5min":0.76500000000000001,"15min":0.82899999999999996},"min":{"1min":0.52400000000000002,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":0.93000000000000005,"5min":1.099,"15min":1.099},"last":0.81000000000000005}]},{"osd":7,"last update":"Tue Nov 28 20:02:57 2023","interfaces":[{"interface":"back","average":{"1min":0.67200000000000004,"5min":0.77800000000000002,"15min":0.85199999999999998},"min":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":0.86899999999999999,"5min":1.4590000000000001,"15min":1.4590000000000001},"last":0.93899999999999995},{"interface":"front","average":{"1min":0.71299999999999997,"5min":0.77800000000000002,"15min":0.83699999999999997},"min":{"1min":0.57199999999999995,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":0.85499999999999998,"5min":1.387,"15min":1.387},"last":0.76100000000000001}]}]},{"osd":1,"up_from":13,"seq":55834574908,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32324,"kb_used_data":1136,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339516,"statfs":{"total":96636764160,"available":96603664384,"internally_reserved":0,"allocated":1163264,"data_stored":555081,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 20:03:04 2023","interfaces":[{"interface":"back","average":{"1min":0.372,"5min":0.48899999999999999,"15min":0.60099999999999998},"min":{"1min":0.23300000000000001,"5min":0.23300000000000001,"15min":0.23300000000000001},"max":{"1min":0.48899999999999999,"5min":3.8740000000000001,"15min":3.8740000000000001},"last":0.33700000000000002},{"interface":"front","average":{"1min":0.38900000000000001,"5min":0.47299999999999998,"15min":0.53900000000000003},"min":{"1min":0.26900000000000002,"5min":0.25,"15min":0.25},"max":{"1min":0.495,"5min":2.0760000000000001,"15min":2.0760000000000001},"last":0.36499999999999999}]},{"osd":2,"last update":"Tue Nov 28 20:03:04 2023","interfaces":[{"interface":"back","average":{"1min":0.38,"5min":0.504,"15min":0.60699999999999998},"min":{"1min":0.315,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.44700000000000001,"5min":3.7320000000000002,"15min":3.7320000000000002},"last":0.495},{"interface":"front","average":{"1min":0.42999999999999999,"5min":0.56799999999999995,"15min":0.69599999999999995},"min":{"1min":0.28999999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.59299999999999997,"5min":3.9089999999999998,"15min":3.9089999999999998},"last":0.437}]},{"osd":3,"last update":"Tue Nov 28 20:03:04 2023","interfaces":[{"interface":"back","average":{"1min":0.51000000000000001,"5min":0.58399999999999996,"15min":0.64800000000000002},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":0.64200000000000002,"5min":1.6399999999999999,"15min":1.6399999999999999},"last":0.60899999999999999},{"interface":"front","average":{"1min":0.48299999999999998,"5min":0.57199999999999995,"15min":0.65900000000000003},"min":{"1min":0.34000000000000002,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.58599999999999997,"5min":2.5270000000000001,"15min":2.5270000000000001},"last":0.56499999999999995}]},{"osd":4,"last update":"Tue Nov 28 20:03:04 2023","interfaces":[{"interface":"back","average":{"1min":0.65500000000000003,"5min":0.76900000000000002,"15min":0.85299999999999998},"min":{"1min":0.441,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.88500000000000001,"5min":3.1659999999999999,"15min":3.1659999999999999},"last":0.88400000000000001},{"interface":"front","average":{"1min":0.67200000000000004,"5min":0.78900000000000003,"15min":0.89300000000000002},"min":{"1min":0.51600000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.85699999999999998,"5min":3.7959999999999998,"15min":3.7959999999999998},"last":0.78200000000000003}]},{"osd":5,"last update":"Tue Nov 28 20:03:04 2023","interfaces":[{"interface":"back","average":{"1min":0.69099999999999995,"5min":0.81599999999999995,"15min":0.93100000000000005},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.91600000000000004,"5min":4.1479999999999997,"15min":4.1479999999999997},"last":0.73699999999999999},{"interface":"front","average":{"1min":0.64200000000000002,"5min":0.77200000000000002,"15min":0.86399999999999999},"min":{"1min":0.55000000000000004,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":0.76300000000000001,"5min":3.5569999999999999,"15min":3.5569999999999999},"last":0.85099999999999998}]},{"osd":6,"last update":"Tue Nov 28 20:03:04 2023","interfaces":[{"interface":"back","average":{"1min":0.69299999999999995,"5min":0.82799999999999996,"15min":0.93700000000000006},"min":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":0.90100000000000002,"5min":2.863,"15min":2.863},"last":0.83499999999999996},{"interface":"front","average":{"1min":0.72099999999999997,"5min":0.84499999999999997,"15min":0.93700000000000006},"min":{"1min":0.56000000000000005,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":0.91900000000000004,"5min":3.371,"15min":3.371},"last":0.81799999999999995}]},{"osd":7,"last update":"Tue Nov 28 20:03:04 2023","interfaces":[{"interface":"back","average":{"1min":0.71799999999999997,"5min":0.83199999999999996,"15min":0.95199999999999996},"min":{"1min":0.58399999999999996,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":0.91600000000000004,"5min":3.8439999999999999,"15min":3.8439999999999999},"last":0.753},{"interface":"front","average":{"1min":0.69999999999999996,"5min":0.83799999999999997,"15min":0.97099999999999997},"min":{"1min":0.53200000000000003,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.93200000000000005,"5min":3.9689999999999999,"15min":3.9689999999999999},"last":0.76800000000000002}]}]},{"osd":0,"up_from":13,"seq":55834574907,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32376,"kb_used_data":1200,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339464,"statfs":{"total":96636764160,"available":96603611136,"internally_reserved":0,"allocated":1228800,"data_stored":1145449,"data_compressed":33374,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Nov 28 20:02:58 2023","interfaces":[{"interface":"back","average":{"1min":0.38700000000000001,"5min":0.51300000000000001,"15min":0.63100000000000001},"min":{"1min":0.26000000000000001,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":0.80100000000000005,"5min":4.883,"15min":4.883},"last":0.311},{"interface":"front","average":{"1min":0.47999999999999998,"5min":0.621,"15min":0.79200000000000004},"min":{"1min":0.23899999999999999,"5min":0.23899999999999999,"15min":0.23899999999999999},"max":{"1min":1.7669999999999999,"5min":8.0800000000000001,"15min":8.0800000000000001},"last":0.45100000000000001}]},{"osd":2,"last update":"Tue Nov 28 20:02:58 2023","interfaces":[{"interface":"back","average":{"1min":0.48599999999999999,"5min":0.67700000000000005,"15min":0.875},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":1.0309999999999999,"5min":8.1029999999999998,"15min":8.1029999999999998},"last":0.505},{"interface":"front","average":{"1min":0.55300000000000005,"5min":0.70699999999999996,"15min":0.89300000000000002},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":1.802,"5min":8.1310000000000002,"15min":8.1310000000000002},"last":0.52500000000000002}]},{"osd":3,"last update":"Tue Nov 28 20:02:58 2023","interfaces":[{"interface":"back","average":{"1min":0.47399999999999998,"5min":0.57399999999999995,"15min":0.68899999999999995},"min":{"1min":0.27700000000000002,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":1.5629999999999999,"5min":4.3949999999999996,"15min":4.3949999999999996},"last":0.39000000000000001},{"interface":"front","average":{"1min":0.58099999999999996,"5min":0.61599999999999999,"15min":0.70999999999999996},"min":{"1min":0.34999999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":2.0920000000000001,"5min":4.3470000000000004,"15min":4.3470000000000004},"last":0.53900000000000003}]},{"osd":4,"last update":"Tue Nov 28 20:02:58 2023","interfaces":[{"interface":"back","average":{"1min":0.747,"5min":0.85899999999999999,"15min":0.98699999999999999},"min":{"1min":0.52400000000000002,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":1.52,"5min":4.6360000000000001,"15min":4.6360000000000001},"last":0.68999999999999995},{"interface":"front","average":{"1min":0.70799999999999996,"5min":0.86499999999999999,"15min":0.98999999999999999},"min":{"1min":0.53800000000000003,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":0.98099999999999998,"5min":4.4710000000000001,"15min":4.4710000000000001},"last":0.82399999999999995}]},{"osd":5,"last update":"Tue Nov 28 20:02:58 2023","interfaces":[{"interface":"back","average":{"1min":0.751,"5min":0.87,"15min":1},"min":{"1min":0.52300000000000002,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.6659999999999999,"5min":4.6120000000000001,"15min":4.6120000000000001},"last":0.70399999999999996},{"interface":"front","average":{"1min":0.79300000000000004,"5min":0.88500000000000001,"15min":0.996},"min":{"1min":0.65000000000000002,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.595,"5min":4.5449999999999999,"15min":4.5449999999999999},"last":0.81100000000000005}]},{"osd":6,"last update":"Tue Nov 28 20:02:58 2023","interfaces":[{"interface":"back","average":{"1min":0.77000000000000002,"5min":0.88300000000000001,"15min":1.0129999999999999},"min":{"1min":0.57299999999999995,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":2.149,"5min":4.657,"15min":4.657},"last":0.72999999999999998},{"interface":"front","average":{"1min":0.80400000000000005,"5min":0.89900000000000002,"15min":1.0309999999999999},"min":{"1min":0.60999999999999999,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":2.2130000000000001,"5min":4.5259999999999998,"15min":4.5259999999999998},"last":0.84399999999999997}]},{"osd":7,"last update":"Tue Nov 28 20:02:58 2023","interfaces":[{"interface":"back","average":{"1min":0.754,"5min":0.88300000000000001,"15min":1.028},"min":{"1min":0.56299999999999994,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":1.7270000000000001,"5min":4.7320000000000002,"15min":4.7320000000000002},"last":0.78000000000000003},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.86899999999999999,"15min":0.98699999999999999},"min":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":1.0880000000000001,"5min":4.4939999999999998,"15min":4.4939999999999998},"last":0.752}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33374,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33374,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-28T20:03:34.331 DEBUG:teuthology.orchestra.run.smithi078:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2023-11-28T20:03:34.467 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:34.464+0000 7f26d32c9640 1 Processor -- start 2023-11-28T20:03:34.467 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:34.464+0000 7f26d32c9640 1 -- start start 2023-11-28T20:03:34.468 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:34.464+0000 7f26d32c9640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f26cc156200 0x7f26cc0c0370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:03:34.469 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:34.464+0000 7f26d32c9640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f26cc15bf70 0x7f26cc15c3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:03:34.469 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:34.464+0000 7f26d32c9640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f26cc06bce0 con 0x7f26cc0c0e10 2023-11-28T20:03:34.469 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:34.464+0000 7f26d32c9640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f26cc06d8d0 con 0x7f26cc156200 2023-11-28T20:03:34.469 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:34.464+0000 7f26d32c9640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f26cc0c2270 con 0x7f26cc15bf70 2023-11-28T20:03:34.469 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:34.464+0000 7f26d1065640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f26cc156200 0x7f26cc0c0370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:03:34.469 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:34.464+0000 7f26d1065640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f26cc156200 0x7f26cc0c0370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:37102/0 (socket says 172.21.15.78:37102) 2023-11-28T20:03:34.469 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:34.464+0000 7f26d1065640 1 -- 172.21.15.78:0/738255120 learned_addr learned my addr 172.21.15.78:0/738255120 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T20:03:34.470 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:34.464+0000 7f26d1866640 1 --2- 172.21.15.78:0/738255120 >> v2:172.21.15.179:3300/0 conn(0x7f26cc15bf70 0x7f26cc15c3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:03:34.470 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:34.464+0000 7f26d1065640 1 -- 172.21.15.78:0/738255120 >> v2:172.21.15.179:3300/0 conn(0x7f26cc15bf70 msgr2=0x7f26cc15c3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:03:34.470 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:34.464+0000 7f26d1065640 1 --2- 172.21.15.78:0/738255120 >> v2:172.21.15.179:3300/0 conn(0x7f26cc15bf70 0x7f26cc15c3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:03:34.473 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:34.464+0000 7f26d1065640 1 -- 172.21.15.78:0/738255120 >> v1:172.21.15.179:6789/0 conn(0x7f26cc0c0e10 legacy=0x7f26cc0c1b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:03:34.473 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:34.464+0000 7f26d1065640 1 -- 172.21.15.78:0/738255120 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26cc15cc60 con 0x7f26cc156200 2023-11-28T20:03:34.474 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:34.464+0000 7f26d1866640 1 --2- 172.21.15.78:0/738255120 >> v2:172.21.15.179:3300/0 conn(0x7f26cc15bf70 0x7f26cc15c3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T20:03:34.477 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:34.468+0000 7f26d1065640 1 --2- 172.21.15.78:0/738255120 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f26cc156200 0x7f26cc0c0370 secure :-1 s=READY pgs=1187 cs=0 l=1 rev1=1 crypto rx=0x7f26cc0c6ad0 tx=0x7f26c801c370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=56c4ae8b3a2d366d server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:03:34.477 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:34.468+0000 7f26c3fff640 1 -- 172.21.15.78:0/738255120 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26c8004230 con 0x7f26cc156200 2023-11-28T20:03:34.477 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:34.468+0000 7f26c3fff640 1 -- 172.21.15.78:0/738255120 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f26c80a7050 con 0x7f26cc156200 2023-11-28T20:03:34.477 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:34.468+0000 7f26c3fff640 1 -- 172.21.15.78:0/738255120 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26c8003620 con 0x7f26cc156200 2023-11-28T20:03:34.477 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:34.468+0000 7f26d32c9640 1 -- 172.21.15.78:0/738255120 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f26cc156200 msgr2=0x7f26cc0c0370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:03:34.477 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:34.468+0000 7f26d32c9640 1 --2- 172.21.15.78:0/738255120 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f26cc156200 0x7f26cc0c0370 secure :-1 s=READY pgs=1187 cs=0 l=1 rev1=1 crypto rx=0x7f26cc0c6ad0 tx=0x7f26c801c370 comp rx=0 tx=0).stop 2023-11-28T20:03:34.478 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:34.468+0000 7f26d32c9640 1 -- 172.21.15.78:0/738255120 shutdown_connections 2023-11-28T20:03:34.478 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:34.468+0000 7f26d32c9640 1 --2- 172.21.15.78:0/738255120 >> v2:172.21.15.179:3300/0 conn(0x7f26cc15bf70 0x7f26cc15c3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:03:34.478 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:34.468+0000 7f26d32c9640 1 --2- 172.21.15.78:0/738255120 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f26cc156200 0x7f26cc0c0370 unknown :-1 s=CLOSED pgs=1187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:03:34.478 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:34.468+0000 7f26d32c9640 1 -- 172.21.15.78:0/738255120 >> 172.21.15.78:0/738255120 conn(0x7f26cc0c59f0 msgr2=0x7f26cc0c5e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:03:34.478 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:34.468+0000 7f26d32c9640 1 -- 172.21.15.78:0/738255120 shutdown_connections 2023-11-28T20:03:34.478 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:34.468+0000 7f26d32c9640 1 -- 172.21.15.78:0/738255120 wait complete. 2023-11-28T20:03:34.478 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:34.472+0000 7f26d32c9640 1 Processor -- start 2023-11-28T20:03:34.478 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:34.472+0000 7f26d32c9640 1 -- start start 2023-11-28T20:03:34.479 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:34.472+0000 7f26d32c9640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f26cc0c0e10 0x7f26cc0a6bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:03:34.479 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:34.472+0000 7f26d32c9640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f26cc156200 0x7f26cc070b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:03:34.479 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:34.472+0000 7f26d32c9640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f26cc15bf70 0x7f26cc071440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:03:34.479 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:34.472+0000 7f26d32c9640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26cc0721d0 con 0x7f26cc0c0e10 2023-11-28T20:03:34.479 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:34.472+0000 7f26d32c9640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26cc0ab960 con 0x7f26cc15bf70 2023-11-28T20:03:34.479 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:34.472+0000 7f26d32c9640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f26cc0ab3a0 con 0x7f26cc156200 2023-11-28T20:03:34.479 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:34.472+0000 7f26d1065640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f26cc0c0e10 0x7f26cc0a6bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:03:34.479 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:34.472+0000 7f26d1065640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f26cc0c0e10 0x7f26cc0a6bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:37116/0 (socket says 172.21.15.78:37116) 2023-11-28T20:03:34.480 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:34.472+0000 7f26d1065640 1 -- 172.21.15.78:0/2644107298 learned_addr learned my addr 172.21.15.78:0/2644107298 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T20:03:34.480 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:34.472+0000 7f26d1866640 1 --2- 172.21.15.78:0/2644107298 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f26cc15bf70 0x7f26cc071440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:03:34.480 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:34.472+0000 7f26d0864640 1 --2- 172.21.15.78:0/2644107298 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f26cc156200 0x7f26cc070b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:03:34.480 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:34.472+0000 7f26d1065640 1 -- 172.21.15.78:0/2644107298 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f26cc156200 msgr2=0x7f26cc070b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:03:34.480 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:34.472+0000 7f26d1065640 1 --2- 172.21.15.78:0/2644107298 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f26cc156200 0x7f26cc070b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:03:34.480 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:34.472+0000 7f26d1065640 1 -- 172.21.15.78:0/2644107298 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f26cc15bf70 msgr2=0x7f26cc071440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:03:34.480 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:34.472+0000 7f26d1065640 1 --2- 172.21.15.78:0/2644107298 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f26cc15bf70 0x7f26cc071440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:03:34.480 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:34.472+0000 7f26d1065640 1 -- 172.21.15.78:0/2644107298 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26c80094d0 con 0x7f26cc0c0e10 2023-11-28T20:03:34.481 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:34.472+0000 7f26d1866640 1 --2- 172.21.15.78:0/2644107298 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f26cc15bf70 0x7f26cc071440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T20:03:34.481 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:34.472+0000 7f26d1065640 1 --2- 172.21.15.78:0/2644107298 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f26cc0c0e10 0x7f26cc0a6bc0 secure :-1 s=READY pgs=1188 cs=0 l=1 rev1=1 crypto rx=0x7f26c8019fa0 tx=0x7f26c8019110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:03:34.481 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:34.472+0000 7f26c1ffb640 1 -- 172.21.15.78:0/2644107298 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26c8003cf0 con 0x7f26cc0c0e10 2023-11-28T20:03:34.481 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:34.472+0000 7f26c1ffb640 1 -- 172.21.15.78:0/2644107298 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f26c8003e70 con 0x7f26cc0c0e10 2023-11-28T20:03:34.481 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:34.472+0000 7f26c1ffb640 1 -- 172.21.15.78:0/2644107298 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26c80ab660 con 0x7f26cc0c0e10 2023-11-28T20:03:34.481 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:34.472+0000 7f26d32c9640 1 -- 172.21.15.78:0/2644107298 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f26cc0ab680 con 0x7f26cc0c0e10 2023-11-28T20:03:34.481 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:34.472+0000 7f26d32c9640 1 -- 172.21.15.78:0/2644107298 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f26cc0a90a0 con 0x7f26cc0c0e10 2023-11-28T20:03:34.482 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:34.472+0000 7f26d32c9640 1 -- 172.21.15.78:0/2644107298 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f26cc067630 con 0x7f26cc0c0e10 2023-11-28T20:03:34.482 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:34.476+0000 7f26c1ffb640 1 -- 172.21.15.78:0/2644107298 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f26c80b2040 con 0x7f26cc0c0e10 2023-11-28T20:03:34.483 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:34.476+0000 7f26c1ffb640 1 --2- 172.21.15.78:0/2644107298 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f26b00664a0 0x7f26b0068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:03:34.483 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:34.476+0000 7f26c1ffb640 1 -- 172.21.15.78:0/2644107298 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 5349+0+0 (secure 0 0 0) 0x7f26c811e160 con 0x7f26cc0c0e10 2023-11-28T20:03:34.483 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:34.476+0000 7f26d0864640 1 --2- 172.21.15.78:0/2644107298 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f26b00664a0 0x7f26b0068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:03:34.483 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:34.476+0000 7f26d0864640 1 --2- 172.21.15.78:0/2644107298 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f26b00664a0 0x7f26b0068960 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7f26bc00b810 tx=0x7f26bc008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:03:34.483 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:34.480+0000 7f26c1ffb640 1 -- 172.21.15.78:0/2644107298 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f26c80eb730 con 0x7f26cc0c0e10 2023-11-28T20:03:34.633 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:34.628+0000 7f26d32c9640 1 -- 172.21.15.78:0/2644107298 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command([{prefix=config set, name=mon_health_to_clog}] v 0) v1 -- 0x7f26cc0c42d0 con 0x7f26cc0c0e10 2023-11-28T20:03:34.637 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:34.632+0000 7f26c1ffb640 1 -- 172.21.15.78:0/2644107298 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_health_to_clog}]=0 v16)=0 v16) v1 ==== 123+0+0 (secure 0 0 0) 0x7f26c80eed50 con 0x7f26cc0c0e10 2023-11-28T20:03:34.639 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:34.632+0000 7f26c1ffb640 1 -- 172.21.15.78:0/2644107298 <== mon.0 v2:172.21.15.78:3300/0 8 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f26c80eb730 con 0x7f26cc0c0e10 2023-11-28T20:03:34.641 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:34.636+0000 7f26d32c9640 1 -- 172.21.15.78:0/2644107298 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f26b00664a0 msgr2=0x7f26b0068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:03:34.641 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:34.636+0000 7f26d32c9640 1 --2- 172.21.15.78:0/2644107298 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f26b00664a0 0x7f26b0068960 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7f26bc00b810 tx=0x7f26bc008040 comp rx=0 tx=0).stop 2023-11-28T20:03:34.641 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:34.636+0000 7f26d32c9640 1 -- 172.21.15.78:0/2644107298 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f26cc0c0e10 msgr2=0x7f26cc0a6bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:03:34.642 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:34.636+0000 7f26d32c9640 1 --2- 172.21.15.78:0/2644107298 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f26cc0c0e10 0x7f26cc0a6bc0 secure :-1 s=READY pgs=1188 cs=0 l=1 rev1=1 crypto rx=0x7f26c8019fa0 tx=0x7f26c8019110 comp rx=0 tx=0).stop 2023-11-28T20:03:34.642 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:34.636+0000 7f26d32c9640 1 -- 172.21.15.78:0/2644107298 shutdown_connections 2023-11-28T20:03:34.642 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:34.636+0000 7f26d32c9640 1 --2- 172.21.15.78:0/2644107298 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7f26b00664a0 0x7f26b0068960 unknown :-1 s=CLOSED pgs=561 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:03:34.642 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:34.636+0000 7f26d32c9640 1 --2- 172.21.15.78:0/2644107298 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f26cc156200 0x7f26cc070b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:03:34.643 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:34.636+0000 7f26d32c9640 1 --2- 172.21.15.78:0/2644107298 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f26cc15bf70 0x7f26cc071440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:03:34.643 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:34.636+0000 7f26d32c9640 1 --2- 172.21.15.78:0/2644107298 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f26cc0c0e10 0x7f26cc0a6bc0 unknown :-1 s=CLOSED pgs=1188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:03:34.643 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:34.636+0000 7f26d32c9640 1 -- 172.21.15.78:0/2644107298 >> 172.21.15.78:0/2644107298 conn(0x7f26cc0c59f0 msgr2=0x7f26cc15a580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:03:34.643 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:34.636+0000 7f26d32c9640 1 -- 172.21.15.78:0/2644107298 shutdown_connections 2023-11-28T20:03:34.643 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:34.636+0000 7f26d32c9640 1 -- 172.21.15.78:0/2644107298 wait complete. 2023-11-28T20:03:34.659 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-11-28T20:03:34.660 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-28T20:03:34.662 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T20:03:34.666 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T20:03:34.798 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:34.796+0000 7fa447a79640 1 Processor -- start 2023-11-28T20:03:34.799 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:34.796+0000 7fa447a79640 1 -- start start 2023-11-28T20:03:34.800 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:34.796+0000 7fa447a79640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa4400c0f30 0x7fa440072580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:03:34.801 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:34.796+0000 7fa447a79640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fa4400c3960 0x7fa4400c0460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:03:34.801 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:34.796+0000 7fa447a79640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa4400c1a50 con 0x7fa440159280 2023-11-28T20:03:34.801 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:34.796+0000 7fa447a79640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa4400c3de0 con 0x7fa4400c3960 2023-11-28T20:03:34.801 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:34.796+0000 7fa447a79640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa4400c1ca0 con 0x7fa4400c0f30 2023-11-28T20:03:34.801 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:34.796+0000 7fa445014640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fa4400c3960 0x7fa4400c0460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:03:34.802 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:34.796+0000 7fa445014640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fa4400c3960 0x7fa4400c0460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:37124/0 (socket says 172.21.15.78:37124) 2023-11-28T20:03:34.802 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:34.796+0000 7fa445014640 1 -- 172.21.15.78:0/341082255 learned_addr learned my addr 172.21.15.78:0/341082255 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T20:03:34.802 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:34.796+0000 7fa445014640 1 -- 172.21.15.78:0/341082255 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa4400c0f30 msgr2=0x7fa440072580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:03:34.802 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:34.796+0000 7fa445014640 1 --2- 172.21.15.78:0/341082255 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa4400c0f30 0x7fa440072580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:03:34.803 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:34.796+0000 7fa445014640 1 -- 172.21.15.78:0/341082255 >> v1:172.21.15.179:6789/0 conn(0x7fa440159280 legacy=0x7fa440155ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:03:34.803 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:34.796+0000 7fa445014640 1 -- 172.21.15.78:0/341082255 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4400c1f80 con 0x7fa4400c3960 2023-11-28T20:03:34.804 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:34.800+0000 7fa445014640 1 --2- 172.21.15.78:0/341082255 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa4400c3960 0x7fa4400c0460 secure :-1 s=READY pgs=1189 cs=0 l=1 rev1=1 crypto rx=0x7fa430009870 tx=0x7fa43001c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e143465f8a78ef4e server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:03:34.804 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:34.800+0000 7fa444813640 1 -- 172.21.15.78:0/341082255 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4300ab650 con 0x7fa4400c3960 2023-11-28T20:03:34.804 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:34.800+0000 7fa444813640 1 -- 172.21.15.78:0/341082255 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7fa4300ab7b0 con 0x7fa4400c3960 2023-11-28T20:03:34.804 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:34.800+0000 7fa444813640 1 -- 172.21.15.78:0/341082255 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4300abb60 con 0x7fa4400c3960 2023-11-28T20:03:34.804 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:34.800+0000 7fa447a79640 1 -- 172.21.15.78:0/341082255 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa4400c3960 msgr2=0x7fa4400c0460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:03:34.805 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:34.800+0000 7fa447a79640 1 --2- 172.21.15.78:0/341082255 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa4400c3960 0x7fa4400c0460 secure :-1 s=READY pgs=1189 cs=0 l=1 rev1=1 crypto rx=0x7fa430009870 tx=0x7fa43001c470 comp rx=0 tx=0).stop 2023-11-28T20:03:34.805 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:34.800+0000 7fa447a79640 1 -- 172.21.15.78:0/341082255 shutdown_connections 2023-11-28T20:03:34.806 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:34.800+0000 7fa447a79640 1 --2- 172.21.15.78:0/341082255 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa4400c3960 0x7fa4400c0460 unknown :-1 s=CLOSED pgs=1189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:03:34.806 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:34.800+0000 7fa447a79640 1 --2- 172.21.15.78:0/341082255 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa4400c0f30 0x7fa440072580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:03:34.806 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:34.800+0000 7fa447a79640 1 -- 172.21.15.78:0/341082255 >> 172.21.15.78:0/341082255 conn(0x7fa4400a7810 msgr2=0x7fa4400a7c20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:03:34.806 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:34.800+0000 7fa447a79640 1 -- 172.21.15.78:0/341082255 shutdown_connections 2023-11-28T20:03:34.807 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:34.800+0000 7fa447a79640 1 -- 172.21.15.78:0/341082255 wait complete. 2023-11-28T20:03:34.809 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:34.800+0000 7fa447a79640 1 Processor -- start 2023-11-28T20:03:34.809 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:34.804+0000 7fa447a79640 1 -- start start 2023-11-28T20:03:34.809 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:34.804+0000 7fa447a79640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa4400c0f30 0x7fa44014fcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:03:34.809 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:34.804+0000 7fa447a79640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa4400c3960 0x7fa4401f2ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:03:34.810 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:34.804+0000 7fa447a79640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa440159280 0x7fa4401f3430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:03:34.810 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:34.804+0000 7fa447a79640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4401f4d80 con 0x7fa4400c3960 2023-11-28T20:03:34.810 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:34.804+0000 7fa447a79640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4401f5be0 con 0x7fa440159280 2023-11-28T20:03:34.810 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:34.804+0000 7fa447a79640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa4401f4fd0 con 0x7fa4400c0f30 2023-11-28T20:03:34.811 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:34.804+0000 7fa445014640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa4400c3960 0x7fa4401f2ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:03:34.811 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:34.804+0000 7fa445014640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa4400c3960 0x7fa4401f2ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:37130/0 (socket says 172.21.15.78:37130) 2023-11-28T20:03:34.811 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:34.804+0000 7fa445014640 1 -- 172.21.15.78:0/1445412916 learned_addr learned my addr 172.21.15.78:0/1445412916 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-11-28T20:03:34.811 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:34.804+0000 7fa445014640 1 -- 172.21.15.78:0/1445412916 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa4400c0f30 msgr2=0x7fa44014fcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:03:34.811 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:34.804+0000 7fa445014640 1 --2- 172.21.15.78:0/1445412916 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa4400c0f30 0x7fa44014fcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:03:34.812 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:34.804+0000 7fa445014640 1 -- 172.21.15.78:0/1445412916 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa440159280 msgr2=0x7fa4401f3430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:03:34.812 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:34.804+0000 7fa446016640 1 --2- 172.21.15.78:0/1445412916 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa440159280 0x7fa4401f3430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:03:34.812 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:34.804+0000 7fa445014640 1 --2- 172.21.15.78:0/1445412916 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa440159280 0x7fa4401f3430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:03:34.812 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:34.804+0000 7fa445014640 1 -- 172.21.15.78:0/1445412916 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4300094d0 con 0x7fa4400c3960 2023-11-28T20:03:34.813 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:34.804+0000 7fa446016640 1 --2- 172.21.15.78:0/1445412916 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa440159280 0x7fa4401f3430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T20:03:34.813 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:34.804+0000 7fa445014640 1 --2- 172.21.15.78:0/1445412916 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa4400c3960 0x7fa4401f2ef0 secure :-1 s=READY pgs=1190 cs=0 l=1 rev1=1 crypto rx=0x7fa4300ad040 tx=0x7fa43001acb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:03:34.813 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:34.804+0000 7fa4367fc640 1 -- 172.21.15.78:0/1445412916 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4300b48c0 con 0x7fa4400c3960 2023-11-28T20:03:34.814 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:34.804+0000 7fa4367fc640 1 -- 172.21.15.78:0/1445412916 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7fa4300b4a60 con 0x7fa4400c3960 2023-11-28T20:03:34.814 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:34.804+0000 7fa447a79640 1 -- 172.21.15.78:0/1445412916 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa4401f52b0 con 0x7fa4400c3960 2023-11-28T20:03:34.814 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:34.804+0000 7fa4367fc640 1 -- 172.21.15.78:0/1445412916 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4300b4e30 con 0x7fa4400c3960 2023-11-28T20:03:34.814 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:34.804+0000 7fa447a79640 1 -- 172.21.15.78:0/1445412916 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa4401f5870 con 0x7fa4400c3960 2023-11-28T20:03:34.817 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:34.804+0000 7fa447a79640 1 -- 172.21.15.78:0/1445412916 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa440067630 con 0x7fa4400c3960 2023-11-28T20:03:34.817 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:34.808+0000 7fa4367fc640 1 -- 172.21.15.78:0/1445412916 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fa4300c7440 con 0x7fa4400c3960 2023-11-28T20:03:34.817 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:34.808+0000 7fa4367fc640 1 --2- 172.21.15.78:0/1445412916 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fa424066470 0x7fa424068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:03:34.818 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:34.808+0000 7fa4367fc640 1 -- 172.21.15.78:0/1445412916 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 5349+0+0 (secure 0 0 0) 0x7fa43011ece0 con 0x7fa4400c3960 2023-11-28T20:03:34.818 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:34.808+0000 7fa445815640 1 --2- 172.21.15.78:0/1445412916 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fa424066470 0x7fa424068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:03:34.818 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:34.808+0000 7fa445815640 1 --2- 172.21.15.78:0/1445412916 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fa424066470 0x7fa424068930 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7fa4400a84f0 tx=0x7fa43c006ca0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:03:34.818 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:34.812+0000 7fa4367fc640 1 -- 172.21.15.78:0/1445412916 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fa4300ec3d0 con 0x7fa4400c3960 2023-11-28T20:03:34.999 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:34.996+0000 7fa447a79640 1 -- 172.21.15.78:0/1445412916 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa44006d860 con 0x7fa4400c3960 2023-11-28T20:03:35.000 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:34.996+0000 7fa4367fc640 1 -- 172.21.15.78:0/1445412916 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 55 v55) v1 ==== 94+0+3705 (secure 0 0 0) 0x7fa4300ef9f0 con 0x7fa4400c3960 2023-11-28T20:03:35.000 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-11-28T20:03:35.000 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":55,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5834,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6834/3259525552","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6832","nonce":3259525552},{"type":"v1","addr":"172.21.15.179:6834","nonce":3259525552}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":41},{"gid":6296,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6835/1369651046","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6833","nonce":1369651046},{"type":"v1","addr":"172.21.15.179:6835","nonce":1369651046}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":55},{"gid":6466,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6836/3096284673","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6834","nonce":3096284673},{"type":"v1","addr":"172.21.15.78:6836","nonce":3096284673}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":41},{"gid":7320,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6837/1031394527","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6835","nonce":1031394527},{"type":"v1","addr":"172.21.15.78:6837","nonce":1031394527}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":53}],"filesystems":[]} 2023-11-28T20:03:35.001 INFO:teuthology.orchestra.run.smithi078.stderr:dumped fsmap epoch 55 2023-11-28T20:03:35.002 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:34.996+0000 7fa447a79640 1 -- 172.21.15.78:0/1445412916 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fa424066470 msgr2=0x7fa424068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:03:35.002 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:34.996+0000 7fa447a79640 1 --2- 172.21.15.78:0/1445412916 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fa424066470 0x7fa424068930 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7fa4400a84f0 tx=0x7fa43c006ca0 comp rx=0 tx=0).stop 2023-11-28T20:03:35.002 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:34.996+0000 7fa447a79640 1 -- 172.21.15.78:0/1445412916 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa4400c3960 msgr2=0x7fa4401f2ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:03:35.002 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:34.996+0000 7fa447a79640 1 --2- 172.21.15.78:0/1445412916 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa4400c3960 0x7fa4401f2ef0 secure :-1 s=READY pgs=1190 cs=0 l=1 rev1=1 crypto rx=0x7fa4300ad040 tx=0x7fa43001acb0 comp rx=0 tx=0).stop 2023-11-28T20:03:35.003 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:34.996+0000 7fa447a79640 1 -- 172.21.15.78:0/1445412916 shutdown_connections 2023-11-28T20:03:35.003 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:34.996+0000 7fa447a79640 1 --2- 172.21.15.78:0/1445412916 >> [v2:172.21.15.78:6832/2935380957,v1:172.21.15.78:6833/2935380957] conn(0x7fa424066470 0x7fa424068930 unknown :-1 s=CLOSED pgs=562 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:03:35.003 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:34.996+0000 7fa447a79640 1 --2- 172.21.15.78:0/1445412916 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa440159280 0x7fa4401f3430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:03:35.003 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:34.996+0000 7fa447a79640 1 --2- 172.21.15.78:0/1445412916 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa4400c3960 0x7fa4401f2ef0 unknown :-1 s=CLOSED pgs=1190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:03:35.003 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:34.996+0000 7fa447a79640 1 --2- 172.21.15.78:0/1445412916 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa4400c0f30 0x7fa44014fcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:03:35.004 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:34.996+0000 7fa447a79640 1 -- 172.21.15.78:0/1445412916 >> 172.21.15.78:0/1445412916 conn(0x7fa4400a7810 msgr2=0x7fa44006bdf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:03:35.004 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:34.996+0000 7fa447a79640 1 -- 172.21.15.78:0/1445412916 shutdown_connections 2023-11-28T20:03:35.004 INFO:teuthology.orchestra.run.smithi078.stderr:2023-11-28T20:03:34.996+0000 7fa447a79640 1 -- 172.21.15.78:0/1445412916 wait complete. 2023-11-28T20:03:35.021 DEBUG:tasks.cephfs.filesystem:already dead... 2023-11-28T20:03:35.021 INFO:teuthology.misc:Shutting down mds daemons... 2023-11-28T20:03:35.022 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-11-28T20:03:35.022 INFO:teuthology.orchestra.run:waiting for 300 2023-11-28T20:03:35.034 INFO:tasks.ceph.mds.a:Stopped 2023-11-28T20:03:35.035 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-11-28T20:03:35.035 INFO:teuthology.orchestra.run:waiting for 300 2023-11-28T20:03:35.094 INFO:tasks.ceph.mds.c:Stopped 2023-11-28T20:03:35.095 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-11-28T20:03:35.095 INFO:teuthology.orchestra.run:waiting for 300 2023-11-28T20:03:35.110 INFO:tasks.ceph.mds.b:Stopped 2023-11-28T20:03:35.110 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-11-28T20:03:35.110 INFO:teuthology.orchestra.run:waiting for 300 2023-11-28T20:03:35.171 INFO:tasks.ceph.mds.d:Stopped 2023-11-28T20:03:35.171 INFO:teuthology.misc:Shutting down osd daemons... 2023-11-28T20:03:35.171 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2023-11-28T20:03:35.171 INFO:teuthology.orchestra.run:waiting for 300 2023-11-28T20:03:35.230 INFO:tasks.ceph.osd.0:Stopped 2023-11-28T20:03:35.231 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2023-11-28T20:03:35.231 INFO:teuthology.orchestra.run:waiting for 300 2023-11-28T20:03:35.326 INFO:tasks.ceph.osd.1:Stopped 2023-11-28T20:03:35.326 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2023-11-28T20:03:35.327 INFO:teuthology.orchestra.run:waiting for 300 2023-11-28T20:03:35.413 INFO:tasks.ceph.osd.2:Stopped 2023-11-28T20:03:35.414 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2023-11-28T20:03:35.414 INFO:teuthology.orchestra.run:waiting for 300 2023-11-28T20:03:35.498 INFO:tasks.ceph.osd.3:Stopped 2023-11-28T20:03:35.498 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2023-11-28T20:03:35.498 INFO:teuthology.orchestra.run:waiting for 300 2023-11-28T20:03:35.579 INFO:tasks.ceph.osd.4:Stopped 2023-11-28T20:03:35.580 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2023-11-28T20:03:35.580 INFO:teuthology.orchestra.run:waiting for 300 2023-11-28T20:03:35.669 INFO:tasks.ceph.osd.5:Stopped 2023-11-28T20:03:35.669 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2023-11-28T20:03:35.669 INFO:teuthology.orchestra.run:waiting for 300 2023-11-28T20:03:35.751 INFO:tasks.ceph.osd.6:Stopped 2023-11-28T20:03:35.751 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2023-11-28T20:03:35.751 INFO:teuthology.orchestra.run:waiting for 300 2023-11-28T20:03:35.845 INFO:tasks.ceph.osd.7:Stopped 2023-11-28T20:03:35.846 INFO:teuthology.misc:Shutting down mgr daemons... 2023-11-28T20:03:35.846 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2023-11-28T20:03:35.846 INFO:teuthology.orchestra.run:waiting for 300 2023-11-28T20:03:35.900 INFO:tasks.ceph.mgr.y:Stopped 2023-11-28T20:03:35.900 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2023-11-28T20:03:35.901 INFO:teuthology.orchestra.run:waiting for 300 2023-11-28T20:03:35.950 INFO:tasks.ceph.mgr.x:Stopped 2023-11-28T20:03:35.950 INFO:teuthology.misc:Shutting down mon daemons... 2023-11-28T20:03:35.950 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2023-11-28T20:03:35.950 INFO:teuthology.orchestra.run:waiting for 300 2023-11-28T20:03:35.969 INFO:tasks.ceph.mon.a:Stopped 2023-11-28T20:03:35.969 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2023-11-28T20:03:35.969 INFO:teuthology.orchestra.run:waiting for 300 2023-11-28T20:03:35.986 INFO:tasks.ceph.mon.b:Stopped 2023-11-28T20:03:35.986 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2023-11-28T20:03:35.986 INFO:teuthology.orchestra.run:waiting for 300 2023-11-28T20:03:36.049 INFO:tasks.ceph.mon.c:Stopped 2023-11-28T20:03:36.050 INFO:tasks.ceph:Checking cluster log for badness... 2023-11-28T20:03:36.050 DEBUG:teuthology.orchestra.run.smithi078:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v 'overall HEALTH_' | egrep -v '\(FS_DEGRADED\)' | egrep -v '\(MDS_FAILED\)' | egrep -v '\(MDS_DEGRADED\)' | egrep -v '\(FS_WITH_FAILED_MDS\)' | egrep -v '\(MDS_DAMAGE\)' | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(FS_INLINE_DATA_DEPRECATED\)' | egrep -v '\(POOL_APP_NOT_ENABLED\)' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | head -n 1 2023-11-28T20:03:36.080 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi078.front.sepia.ceph.com 2023-11-28T20:03:36.080 DEBUG:teuthology.orchestra.run.smithi078:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2023-11-28T20:03:36.448 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi078.front.sepia.ceph.com 2023-11-28T20:03:36.448 DEBUG:teuthology.orchestra.run.smithi078:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2023-11-28T20:03:36.683 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi078.front.sepia.ceph.com 2023-11-28T20:03:36.684 DEBUG:teuthology.orchestra.run.smithi078:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2023-11-28T20:03:36.859 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi078.front.sepia.ceph.com 2023-11-28T20:03:36.859 DEBUG:teuthology.orchestra.run.smithi078:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2023-11-28T20:03:37.060 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@smithi179.front.sepia.ceph.com 2023-11-28T20:03:37.061 DEBUG:teuthology.orchestra.run.smithi179:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2023-11-28T20:03:37.217 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@smithi179.front.sepia.ceph.com 2023-11-28T20:03:37.217 DEBUG:teuthology.orchestra.run.smithi179:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2023-11-28T20:03:37.380 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-6 on ubuntu@smithi179.front.sepia.ceph.com 2023-11-28T20:03:37.380 DEBUG:teuthology.orchestra.run.smithi179:> sync && sudo umount -f /var/lib/ceph/osd/ceph-6 2023-11-28T20:03:37.527 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@smithi179.front.sepia.ceph.com 2023-11-28T20:03:37.527 DEBUG:teuthology.orchestra.run.smithi179:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 2023-11-28T20:03:37.669 INFO:tasks.ceph:Archiving mon data... 2023-11-28T20:03:37.670 DEBUG:teuthology.misc:Transferring archived files from smithi078:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/vshankar-2023-11-28_06:29:14-fs-wip-vshankar-testing-20231127.102914-testing-default-smithi/7469593/data/mon.a.tgz 2023-11-28T20:03:37.670 DEBUG:teuthology.orchestra.run.smithi078:> mktemp 2023-11-28T20:03:37.681 INFO:teuthology.orchestra.run.smithi078.stdout:/tmp/tmp.NgrG3po2qE 2023-11-28T20:03:37.681 DEBUG:teuthology.orchestra.run.smithi078:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.NgrG3po2qE 2023-11-28T20:03:37.842 DEBUG:teuthology.orchestra.run.smithi078:> sudo chmod 0666 /tmp/tmp.NgrG3po2qE 2023-11-28T20:03:37.925 DEBUG:teuthology.orchestra.remote:smithi078:/tmp/tmp.NgrG3po2qE is 481KB 2023-11-28T20:03:37.992 DEBUG:teuthology.orchestra.run.smithi078:> rm -fr /tmp/tmp.NgrG3po2qE 2023-11-28T20:03:38.001 DEBUG:teuthology.misc:Transferring archived files from smithi179:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/vshankar-2023-11-28_06:29:14-fs-wip-vshankar-testing-20231127.102914-testing-default-smithi/7469593/data/mon.b.tgz 2023-11-28T20:03:38.001 DEBUG:teuthology.orchestra.run.smithi179:> mktemp 2023-11-28T20:03:38.011 INFO:teuthology.orchestra.run.smithi179.stdout:/tmp/tmp.si7v7tKcm0 2023-11-28T20:03:38.012 DEBUG:teuthology.orchestra.run.smithi179:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.si7v7tKcm0 2023-11-28T20:03:38.198 DEBUG:teuthology.orchestra.run.smithi179:> sudo chmod 0666 /tmp/tmp.si7v7tKcm0 2023-11-28T20:03:38.274 DEBUG:teuthology.orchestra.remote:smithi179:/tmp/tmp.si7v7tKcm0 is 618KB 2023-11-28T20:03:38.343 DEBUG:teuthology.orchestra.run.smithi179:> rm -fr /tmp/tmp.si7v7tKcm0 2023-11-28T20:03:38.353 DEBUG:teuthology.misc:Transferring archived files from smithi179:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/vshankar-2023-11-28_06:29:14-fs-wip-vshankar-testing-20231127.102914-testing-default-smithi/7469593/data/mon.c.tgz 2023-11-28T20:03:38.353 DEBUG:teuthology.orchestra.run.smithi179:> mktemp 2023-11-28T20:03:38.404 INFO:teuthology.orchestra.run.smithi179.stdout:/tmp/tmp.1XZOLmLXcq 2023-11-28T20:03:38.405 DEBUG:teuthology.orchestra.run.smithi179:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.1XZOLmLXcq 2023-11-28T20:03:38.593 DEBUG:teuthology.orchestra.run.smithi179:> sudo chmod 0666 /tmp/tmp.1XZOLmLXcq 2023-11-28T20:03:38.669 DEBUG:teuthology.orchestra.remote:smithi179:/tmp/tmp.1XZOLmLXcq is 618KB 2023-11-28T20:03:38.743 DEBUG:teuthology.orchestra.run.smithi179:> rm -fr /tmp/tmp.1XZOLmLXcq 2023-11-28T20:03:38.751 INFO:tasks.ceph:Cleaning ceph cluster... 2023-11-28T20:03:38.752 DEBUG:teuthology.orchestra.run.smithi078:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2023-11-28T20:03:38.755 DEBUG:teuthology.orchestra.run.smithi179:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2023-11-28T20:03:38.816 INFO:tasks.ceph:Checking for errors in any valgrind logs... 2023-11-28T20:03:38.816 DEBUG:teuthology.orchestra.run.smithi078:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2023-11-28T20:03:38.821 DEBUG:teuthology.orchestra.run.smithi179:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2023-11-28T20:03:38.851 INFO:teuthology.orchestra.run.smithi078.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2023-11-28T20:03:38.909 INFO:teuthology.orchestra.run.smithi179.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2023-11-28T20:03:38.916 INFO:tasks.ceph:Archiving crash dumps... 2023-11-28T20:03:38.918 DEBUG:teuthology.misc:Transferring archived files from smithi078:/var/lib/ceph/crash to /home/teuthworker/archive/vshankar-2023-11-28_06:29:14-fs-wip-vshankar-testing-20231127.102914-testing-default-smithi/7469593/remote/smithi078/crash 2023-11-28T20:03:38.918 DEBUG:teuthology.orchestra.run.smithi078:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2023-11-28T20:03:38.941 DEBUG:teuthology.misc:Transferring archived files from smithi179:/var/lib/ceph/crash to /home/teuthworker/archive/vshankar-2023-11-28_06:29:14-fs-wip-vshankar-testing-20231127.102914-testing-default-smithi/7469593/remote/smithi179/crash 2023-11-28T20:03:38.942 DEBUG:teuthology.orchestra.run.smithi179:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2023-11-28T20:03:38.962 INFO:tasks.ceph:Shutting down logrotate 2023-11-28T20:03:38.962 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T20:03:38.993 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T20:03:39.060 DEBUG:teuthology.orchestra.run.smithi078:> sudo rm /etc/logrotate.d/ceph-test.conf 2023-11-28T20:03:39.081 DEBUG:teuthology.orchestra.run.smithi179:> sudo rm /etc/logrotate.d/ceph-test.conf 2023-11-28T20:03:39.100 INFO:tasks.ceph:Compressing logs... 2023-11-28T20:03:39.101 DEBUG:teuthology.orchestra.run.smithi078:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2023-11-28T20:03:39.125 DEBUG:teuthology.orchestra.run.smithi179:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2023-11-28T20:03:39.152 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54153.log 2023-11-28T20:03:39.153 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46159.log 2023-11-28T20:03:39.154 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.54153.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43050.log 2023-11-28T20:03:39.154 INFO:teuthology.orchestra.run.smithi078.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.54153.log.gz 2023-11-28T20:03:39.155 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.46159.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45633.log 2023-11-28T20:03:39.155 INFO:teuthology.orchestra.run.smithi078.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.46159.log.gz 2023-11-28T20:03:39.156 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.43050.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49708.log 2023-11-28T20:03:39.156 INFO:teuthology.orchestra.run.smithi078.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.43050.log.gz 2023-11-28T20:03:39.159 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.45633.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.45633.log.gz 2023-11-28T20:03:39.159 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52508.log 2023-11-28T20:03:39.159 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.49708.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46649.log 2023-11-28T20:03:39.159 INFO:teuthology.orchestra.run.smithi078.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.49708.log.gz 2023-11-28T20:03:39.160 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.52508.log: 89.4%gzip -- replaced with /var/log/ceph/ceph-client.admin.52508.log.gz 2023-11-28T20:03:39.160 INFO:teuthology.orchestra.run.smithi078.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.47399.log 2023-11-28T20:03:39.161 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.46649.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53470.log 2023-11-28T20:03:39.161 INFO:teuthology.orchestra.run.smithi078.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.46649.log.gz 2023-11-28T20:03:39.161 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.47399.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52808.log 2023-11-28T20:03:39.162 INFO:teuthology.orchestra.run.smithi078.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.47399.log.gz 2023-11-28T20:03:39.162 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.53470.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42972.log 2023-11-28T20:03:39.163 INFO:teuthology.orchestra.run.smithi078.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.53470.log.gz 2023-11-28T20:03:39.164 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.52808.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42918.log 2023-11-28T20:03:39.164 INFO:teuthology.orchestra.run.smithi078.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.52808.log.gz 2023-11-28T20:03:39.165 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.42972.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55710.log 2023-11-28T20:03:39.165 INFO:teuthology.orchestra.run.smithi078.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.42972.log.gz 2023-11-28T20:03:39.165 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.42918.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48527.log 2023-11-28T20:03:39.167 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.55710.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55254.log 2023-11-28T20:03:39.167 INFO:teuthology.orchestra.run.smithi078.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.55710.log.gz 2023-11-28T20:03:39.167 INFO:teuthology.orchestra.run.smithi078.stderr: 92.7% -- replaced with /var/log/ceph/ceph-client.admin.42918.log.gz 2023-11-28T20:03:39.168 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.48527.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49866.log 2023-11-28T20:03:39.168 INFO:teuthology.orchestra.run.smithi078.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.48527.log.gz 2023-11-28T20:03:39.168 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.55254.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48319.log 2023-11-28T20:03:39.169 INFO:teuthology.orchestra.run.smithi078.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.55254.log.gz 2023-11-28T20:03:39.169 INFO:teuthology.orchestra.run.smithi179.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38408.log 2023-11-28T20:03:39.170 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.49866.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43524.log 2023-11-28T20:03:39.170 INFO:teuthology.orchestra.run.smithi078.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.49866.log.gz 2023-11-28T20:03:39.172 INFO:teuthology.orchestra.run.smithi179.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38336.log 2023-11-28T20:03:39.172 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-client.admin.38408.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.7.log 2023-11-28T20:03:39.172 INFO:teuthology.orchestra.run.smithi179.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.38408.log.gz 2023-11-28T20:03:39.173 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.48319.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.48319.log.gz 2023-11-28T20:03:39.173 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50748.log 2023-11-28T20:03:39.173 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.43524.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43805.log 2023-11-28T20:03:39.173 INFO:teuthology.orchestra.run.smithi078.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.43524.log.gz 2023-11-28T20:03:39.173 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.50748.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.y.log 2023-11-28T20:03:39.174 INFO:teuthology.orchestra.run.smithi078.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.50748.log.gz 2023-11-28T20:03:39.176 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.43805.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44705.log 2023-11-28T20:03:39.176 INFO:teuthology.orchestra.run.smithi078.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.43805.log.gz 2023-11-28T20:03:39.176 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-mgr.y.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56100.log 2023-11-28T20:03:39.177 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-client.admin.38336.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.38336.log.gz 2023-11-28T20:03:39.177 INFO:teuthology.orchestra.run.smithi179.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.6.log 2023-11-28T20:03:39.177 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-osd.7.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.1.42588.log 2023-11-28T20:03:39.177 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-osd.6.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38432.log 2023-11-28T20:03:39.178 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-client.1.42588.log: 0.0% -- replaced with /var/log/ceph/ceph-client.1.42588.log.gz 2023-11-28T20:03:39.178 INFO:teuthology.orchestra.run.smithi179.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.5.log 2023-11-28T20:03:39.178 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-client.admin.38432.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.testuser.42973.log 2023-11-28T20:03:39.178 INFO:teuthology.orchestra.run.smithi179.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.38432.log.gz 2023-11-28T20:03:39.179 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38480.log 2023-11-28T20:03:39.180 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-client.testuser.42973.log: 0.0% -- replaced with /var/log/ceph/ceph-client.testuser.42973.log.gz 2023-11-28T20:03:39.180 INFO:teuthology.orchestra.run.smithi179.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.1.42758.log 2023-11-28T20:03:39.181 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.44705.log: gzip -5 --verbose -- 89.1% /var/log/ceph/ceph-client.admin.46923.log 2023-11-28T20:03:39.181 INFO:teuthology.orchestra.run.smithi078.stderr: -- replaced with /var/log/ceph/ceph-client.admin.44705.log.gz 2023-11-28T20:03:39.182 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.56100.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48007.log 2023-11-28T20:03:39.182 INFO:teuthology.orchestra.run.smithi078.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.56100.log.gz 2023-11-28T20:03:39.182 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.46923.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50694.log 2023-11-28T20:03:39.182 INFO:teuthology.orchestra.run.smithi078.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.46923.log.gz 2023-11-28T20:03:39.182 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.48007.log: gzip -5 --verbose 88.8% -- -- replaced with /var/log/ceph/ceph-client.admin.48007.log.gz /var/log/ceph/ceph-client.admin.42532.log 2023-11-28T20:03:39.182 INFO:teuthology.orchestra.run.smithi078.stderr: 2023-11-28T20:03:39.182 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.50694.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.50694.log.gz 2023-11-28T20:03:39.183 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56124.log 2023-11-28T20:03:39.183 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.42532.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48293.log 2023-11-28T20:03:39.183 INFO:teuthology.orchestra.run.smithi078.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.42532.log.gz 2023-11-28T20:03:39.186 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-client.admin.38480.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38384.log 2023-11-28T20:03:39.187 INFO:teuthology.orchestra.run.smithi179.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.38480.log.gz 2023-11-28T20:03:39.187 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-client.1.42758.log: 0.0% -- replaced with /var/log/ceph/ceph-client.1.42758.log.gz 2023-11-28T20:03:39.187 INFO:teuthology.orchestra.run.smithi179.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2023-11-28T20:03:39.187 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-client.admin.38384.log: gzip -5 --verbose -- /var/log/ceph/ceph.log 2023-11-28T20:03:39.187 INFO:teuthology.orchestra.run.smithi179.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.38384.log.gz 2023-11-28T20:03:39.188 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-mgr.x.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.c.log 2023-11-28T20:03:39.188 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2023-11-28T20:03:39.189 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.56124.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53232.log 2023-11-28T20:03:39.189 INFO:teuthology.orchestra.run.smithi078.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.56124.log.gz 2023-11-28T20:03:39.190 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.48293.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.48293.log.gz 2023-11-28T20:03:39.190 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55970.log 2023-11-28T20:03:39.190 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.53232.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.53232.log.gz 2023-11-28T20:03:39.190 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44017.log 2023-11-28T20:03:39.190 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.55970.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51966.log 2023-11-28T20:03:39.190 INFO:teuthology.orchestra.run.smithi078.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.55970.log.gz 2023-11-28T20:03:39.190 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.44017.log: gzip 88.5% -5 -- replaced with /var/log/ceph/ceph-client.admin.44017.log.gz --verbose 2023-11-28T20:03:39.190 INFO:teuthology.orchestra.run.smithi078.stderr: -- /var/log/ceph/ceph-client.admin.52834.log 2023-11-28T20:03:39.191 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.51966.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54309.log 2023-11-28T20:03:39.191 INFO:teuthology.orchestra.run.smithi078.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.51966.log.gz 2023-11-28T20:03:39.191 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.52834.log: gzip -5 --verbose 87.0% -- -- replaced with /var/log/ceph/ceph-client.admin.52834.log.gz 2023-11-28T20:03:39.191 INFO:teuthology.orchestra.run.smithi078.stderr: /var/log/ceph/ceph-client.admin.49512.log 2023-11-28T20:03:39.191 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.54309.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42716.log 2023-11-28T20:03:39.191 INFO:teuthology.orchestra.run.smithi078.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.54309.log.gz 2023-11-28T20:03:39.196 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-mon.c.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.d.log 2023-11-28T20:03:39.196 INFO:teuthology.orchestra.run.smithi179.stderr: 92.3% -- replaced with /var/log/ceph/ceph.log.gz 2023-11-28T20:03:39.196 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph.audit.log: 93.7% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2023-11-28T20:03:39.196 INFO:teuthology.orchestra.run.smithi179.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.1.42532.log 2023-11-28T20:03:39.196 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-mds.d.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.1.42860.log 2023-11-28T20:03:39.197 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-client.1.42532.log: 93.1% -- replaced with /var/log/ceph/ceph-mds.d.log.gz 2023-11-28T20:03:39.197 INFO:teuthology.orchestra.run.smithi179.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.1.42532.log.gz 2023-11-28T20:03:39.197 INFO:teuthology.orchestra.run.smithi179.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.b.log 2023-11-28T20:03:39.197 INFO:teuthology.orchestra.run.smithi179.stderr: 93.6%/var/log/ceph/ceph-client.1.42860.log: -- replaced with /var/log/ceph/ceph.audit.log.gz 2023-11-28T20:03:39.197 INFO:teuthology.orchestra.run.smithi179.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.1.42860.log.gz 2023-11-28T20:03:39.197 INFO:teuthology.orchestra.run.smithi179.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38312.log 2023-11-28T20:03:39.197 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-mds.b.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.b.log 2023-11-28T20:03:39.197 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-client.admin.38312.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38456.log 2023-11-28T20:03:39.198 INFO:teuthology.orchestra.run.smithi179.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.38312.log.gz 2023-11-28T20:03:39.200 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-mon.b.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.4.log 2023-11-28T20:03:39.200 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-client.admin.38456.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.38456.log.gz 2023-11-28T20:03:39.201 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.49512.log: gzip -5 --verbose -- 88.8% /var/log/ceph/ceph-client.0.44816.log -- replaced with /var/log/ceph/ceph-client.admin.49512.log.gz 2023-11-28T20:03:39.201 INFO:teuthology.orchestra.run.smithi078.stderr: 2023-11-28T20:03:39.201 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.42716.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50240.log 2023-11-28T20:03:39.201 INFO:teuthology.orchestra.run.smithi078.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.42716.log.gz 2023-11-28T20:03:39.201 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.0.44816.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.44816.log.gz 2023-11-28T20:03:39.202 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48735.log 2023-11-28T20:03:39.202 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.50240.log: gzip -5 --verbose -- 88.1% /var/log/ceph/ceph-client.admin.43592.log -- replaced with /var/log/ceph/ceph-client.admin.50240.log.gz 2023-11-28T20:03:39.202 INFO:teuthology.orchestra.run.smithi078.stderr: 2023-11-28T20:03:39.202 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.48735.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49368.log 2023-11-28T20:03:39.202 INFO:teuthology.orchestra.run.smithi078.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.48735.log.gz 2023-11-28T20:03:39.202 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.43592.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46949.log 2023-11-28T20:03:39.202 INFO:teuthology.orchestra.run.smithi078.stderr: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.43592.log.gz 2023-11-28T20:03:39.203 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.49368.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.49368.log.gz 2023-11-28T20:03:39.203 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2023-11-28T20:03:39.203 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.46949.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53626.log 2023-11-28T20:03:39.203 INFO:teuthology.orchestra.run.smithi078.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.46949.log.gz 2023-11-28T20:03:39.203 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43076.log 2023-11-28T20:03:39.203 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.53626.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.53626.log.gz 2023-11-28T20:03:39.204 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43233.log 2023-11-28T20:03:39.204 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.43076.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55490.log 2023-11-28T20:03:39.204 INFO:teuthology.orchestra.run.smithi078.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.43076.log.gz 2023-11-28T20:03:39.204 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.43233.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.43233.log.gz 2023-11-28T20:03:39.204 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53366.log 2023-11-28T20:03:39.205 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-osd.4.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.1.42402.log 2023-11-28T20:03:39.207 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.55490.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56152.log 2023-11-28T20:03:39.207 INFO:teuthology.orchestra.run.smithi078.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.55490.log.gz 2023-11-28T20:03:39.207 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.53366.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.53366.log.gz 2023-11-28T20:03:39.207 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55000.log 2023-11-28T20:03:39.207 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.56152.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53128.log 2023-11-28T20:03:39.208 INFO:teuthology.orchestra.run.smithi078.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.56152.log.gz 2023-11-28T20:03:39.208 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.55000.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.55000.log.gz 2023-11-28T20:03:39.208 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46623.log 2023-11-28T20:03:39.208 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.53128.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47665.log 2023-11-28T20:03:39.208 INFO:teuthology.orchestra.run.smithi078.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.53128.log.gz 2023-11-28T20:03:39.210 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.46623.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.46623.log.gz 2023-11-28T20:03:39.210 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53730.log 2023-11-28T20:03:39.210 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.47665.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.47665.log.gz 2023-11-28T20:03:39.210 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46289.log 2023-11-28T20:03:39.211 INFO:teuthology.orchestra.run.smithi179.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.1.42914.log 2023-11-28T20:03:39.211 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-client.1.42402.log: 0.0% -- replaced with /var/log/ceph/ceph-client.1.42402.log.gz 2023-11-28T20:03:39.211 INFO:teuthology.orchestra.run.smithi179.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38360.log 2023-11-28T20:03:39.212 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-client.1.42914.log: gzip 0.0% -5 -- replaced with /var/log/ceph/ceph-client.1.42914.log.gz --verbose 2023-11-28T20:03:39.212 INFO:teuthology.orchestra.run.smithi179.stderr: -- /var/log/ceph/ceph-client.1.42710.log 2023-11-28T20:03:39.213 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-client.1.42710.log: 0.0% -- replaced with /var/log/ceph/ceph-client.1.42710.log.gz 2023-11-28T20:03:39.214 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.53730.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.53730.log.gz 2023-11-28T20:03:39.214 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50668.log 2023-11-28T20:03:39.214 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.46289.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.46289.log.gz 2023-11-28T20:03:39.215 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51758.log 2023-11-28T20:03:39.215 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.50668.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.50668.log.gz 2023-11-28T20:03:39.215 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53548.log 2023-11-28T20:03:39.215 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.51758.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50986.log 2023-11-28T20:03:39.215 INFO:teuthology.orchestra.run.smithi078.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.51758.log.gz 2023-11-28T20:03:39.216 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-client.admin.38360.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.38360.log.gz 2023-11-28T20:03:39.217 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.53548.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.53548.log.gz 2023-11-28T20:03:39.217 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52562.log 2023-11-28T20:03:39.217 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.50986.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51064.log 2023-11-28T20:03:39.217 INFO:teuthology.orchestra.run.smithi078.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.50986.log.gz 2023-11-28T20:03:39.218 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.52562.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.52562.log.gz 2023-11-28T20:03:39.218 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45977.log 2023-11-28T20:03:39.219 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.51064.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55332.log 2023-11-28T20:03:39.219 INFO:teuthology.orchestra.run.smithi078.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.51064.log.gz 2023-11-28T20:03:39.220 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.45977.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.45977.log.gz 2023-11-28T20:03:39.220 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55996.log 2023-11-28T20:03:39.221 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.55332.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46185.log 2023-11-28T20:03:39.221 INFO:teuthology.orchestra.run.smithi078.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.55332.log.gz 2023-11-28T20:03:39.222 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.55996.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.55996.log.gz 2023-11-28T20:03:39.222 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48449.log 2023-11-28T20:03:39.223 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.46185.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.46185.log.gz 2023-11-28T20:03:39.224 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50538.log 2023-11-28T20:03:39.224 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.48449.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.48449.log.gz 2023-11-28T20:03:39.225 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48709.log 2023-11-28T20:03:39.226 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.50538.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46519.log 2023-11-28T20:03:39.226 INFO:teuthology.orchestra.run.smithi078.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.50538.log.gz 2023-11-28T20:03:39.226 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.48709.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.48709.log.gz 2023-11-28T20:03:39.227 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48111.log 2023-11-28T20:03:39.228 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.46519.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51167.log 2023-11-28T20:03:39.228 INFO:teuthology.orchestra.run.smithi078.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.46519.log.gz 2023-11-28T20:03:39.229 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.48111.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.48111.log.gz 2023-11-28T20:03:39.229 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54057.log 2023-11-28T20:03:39.230 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.51167.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54870.log 2023-11-28T20:03:39.230 INFO:teuthology.orchestra.run.smithi078.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.51167.log.gz 2023-11-28T20:03:39.231 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.54057.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.54057.log.gz 2023-11-28T20:03:39.231 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43290.log 2023-11-28T20:03:39.232 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.54870.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45495.log 2023-11-28T20:03:39.233 INFO:teuthology.orchestra.run.smithi078.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.54870.log.gz 2023-11-28T20:03:39.234 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.43290.log: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.43290.log.gz 2023-11-28T20:03:39.234 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48267.log 2023-11-28T20:03:39.235 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.45495.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51836.log 2023-11-28T20:03:39.235 INFO:teuthology.orchestra.run.smithi078.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.45495.log.gz 2023-11-28T20:03:39.236 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.48267.log: 91.6% -- replaced with /var/log/ceph/ceph-mgr.y.log.gz 2023-11-28T20:03:39.236 INFO:teuthology.orchestra.run.smithi078.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.48267.log.gz 2023-11-28T20:03:39.237 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48579.log 2023-11-28T20:03:39.239 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.51836.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42690.log 2023-11-28T20:03:39.239 INFO:teuthology.orchestra.run.smithi078.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.51836.log.gz 2023-11-28T20:03:39.239 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.48579.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.48579.log.gz 2023-11-28T20:03:39.239 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44644.log 2023-11-28T20:03:39.240 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.42690.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55384.log 2023-11-28T20:03:39.240 INFO:teuthology.orchestra.run.smithi078.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.42690.log.gz 2023-11-28T20:03:39.241 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.44644.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49067.log 2023-11-28T20:03:39.242 INFO:teuthology.orchestra.run.smithi078.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.44644.log.gz 2023-11-28T20:03:39.242 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.55384.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45742.log 2023-11-28T20:03:39.242 INFO:teuthology.orchestra.run.smithi078.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.55384.log.gz 2023-11-28T20:03:39.243 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.49067.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48143.log 2023-11-28T20:03:39.243 INFO:teuthology.orchestra.run.smithi078.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.49067.log.gz 2023-11-28T20:03:39.244 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.45742.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.45742.log.gz 2023-11-28T20:03:39.244 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54127.log 2023-11-28T20:03:39.244 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.48143.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51245.log 2023-11-28T20:03:39.245 INFO:teuthology.orchestra.run.smithi078.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.48143.log.gz 2023-11-28T20:03:39.245 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.54127.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55606.log 2023-11-28T20:03:39.246 INFO:teuthology.orchestra.run.smithi078.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.54127.log.gz 2023-11-28T20:03:39.247 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.51245.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53973.log 2023-11-28T20:03:39.247 INFO:teuthology.orchestra.run.smithi078.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.51245.log.gz 2023-11-28T20:03:39.248 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.55606.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.55606.log.gz 2023-11-28T20:03:39.248 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46467.log 2023-11-28T20:03:39.249 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.53973.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53312.log 2023-11-28T20:03:39.249 INFO:teuthology.orchestra.run.smithi078.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.53973.log.gz 2023-11-28T20:03:39.250 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.46467.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.46467.log.gz 2023-11-28T20:03:39.250 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55892.log 2023-11-28T20:03:39.251 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.53312.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42099.log 2023-11-28T20:03:39.251 INFO:teuthology.orchestra.run.smithi078.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.53312.log.gz 2023-11-28T20:03:39.252 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.55892.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.55892.log.gz 2023-11-28T20:03:39.252 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51914.log 2023-11-28T20:03:39.253 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.42099.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51271.log 2023-11-28T20:03:39.253 INFO:teuthology.orchestra.run.smithi078.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.42099.log.gz 2023-11-28T20:03:39.254 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.51914.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.51914.log.gz 2023-11-28T20:03:39.254 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38422.log 2023-11-28T20:03:39.255 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.51271.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54231.log 2023-11-28T20:03:39.255 INFO:teuthology.orchestra.run.smithi078.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.51271.log.gz 2023-11-28T20:03:39.256 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.38422.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44019.log 2023-11-28T20:03:39.256 INFO:teuthology.orchestra.run.smithi078.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.38422.log.gz 2023-11-28T20:03:39.257 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.54231.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53258.log 2023-11-28T20:03:39.257 INFO:teuthology.orchestra.run.smithi078.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.54231.log.gz 2023-11-28T20:03:39.258 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.44019.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.44019.log.gz 2023-11-28T20:03:39.258 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2023-11-28T20:03:39.260 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.53258.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43181.log 2023-11-28T20:03:39.260 INFO:teuthology.orchestra.run.smithi078.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.53258.log.gz 2023-11-28T20:03:39.260 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46819.log 2023-11-28T20:03:39.261 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.43181.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52089.log 2023-11-28T20:03:39.261 INFO:teuthology.orchestra.run.smithi078.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.43181.log.gz 2023-11-28T20:03:39.262 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.46819.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.46819.log.gz 2023-11-28T20:03:39.262 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49538.log 2023-11-28T20:03:39.263 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.52089.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48423.log 2023-11-28T20:03:39.264 INFO:teuthology.orchestra.run.smithi078.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.52089.log.gz 2023-11-28T20:03:39.264 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.49538.log: gzip -5 88.9% --verbose -- replaced with /var/log/ceph/ceph-client.admin.49538.log.gz -- 2023-11-28T20:03:39.265 INFO:teuthology.orchestra.run.smithi078.stderr: /var/log/ceph/ceph-client.admin.53782.log 2023-11-28T20:03:39.266 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.48423.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53600.log 2023-11-28T20:03:39.266 INFO:teuthology.orchestra.run.smithi078.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.48423.log.gz 2023-11-28T20:03:39.267 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.53782.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49223.log 2023-11-28T20:03:39.267 INFO:teuthology.orchestra.run.smithi078.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.53782.log.gz 2023-11-28T20:03:39.268 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.53600.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53206.log 2023-11-28T20:03:39.268 INFO:teuthology.orchestra.run.smithi078.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.53600.log.gz 2023-11-28T20:03:39.269 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.49223.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51888.log 2023-11-28T20:03:39.269 INFO:teuthology.orchestra.run.smithi078.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.49223.log.gz 2023-11-28T20:03:39.273 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.53206.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52168.log 2023-11-28T20:03:39.273 INFO:teuthology.orchestra.run.smithi078.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.53206.log.gz 2023-11-28T20:03:39.275 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.51888.log: gzip -5 --verbose -- 88.3% /var/log/ceph/ceph-client.admin.55228.log 2023-11-28T20:03:39.275 INFO:teuthology.orchestra.run.smithi078.stderr: -- replaced with /var/log/ceph/ceph-client.admin.51888.log.gz 2023-11-28T20:03:39.275 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.52168.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43129.log 2023-11-28T20:03:39.275 INFO:teuthology.orchestra.run.smithi078.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.52168.log.gz 2023-11-28T20:03:39.275 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.55228.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.55228.log.gz 2023-11-28T20:03:39.275 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50486.log 2023-11-28T20:03:39.276 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.43129.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.43129.log.gz 2023-11-28T20:03:39.276 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49171.log 2023-11-28T20:03:39.277 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.50486.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44006.log 2023-11-28T20:03:39.277 INFO:teuthology.orchestra.run.smithi078.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.50486.log.gz 2023-11-28T20:03:39.277 INFO:teuthology.orchestra.run.smithi179.stderr: 92.5% -- replaced with /var/log/ceph/ceph-mds.b.log.gz 2023-11-28T20:03:39.278 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.49171.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49015.log 2023-11-28T20:03:39.278 INFO:teuthology.orchestra.run.smithi078.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.49171.log.gz 2023-11-28T20:03:39.279 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.44006.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.44006.log.gz 2023-11-28T20:03:39.279 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48605.log 2023-11-28T20:03:39.279 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.49015.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46415.log 2023-11-28T20:03:39.280 INFO:teuthology.orchestra.run.smithi078.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.49015.log.gz 2023-11-28T20:03:39.281 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.48605.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.48605.log.gz 2023-11-28T20:03:39.281 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46055.log 2023-11-28T20:03:39.282 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.46415.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47347.log 2023-11-28T20:03:39.282 INFO:teuthology.orchestra.run.smithi078.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.46415.log.gz 2023-11-28T20:03:39.283 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.46055.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48683.log 2023-11-28T20:03:39.283 INFO:teuthology.orchestra.run.smithi078.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.46055.log.gz 2023-11-28T20:03:39.284 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.47347.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.47347.log.gz 2023-11-28T20:03:39.284 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44200.log 2023-11-28T20:03:39.285 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.48683.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.48683.log.gz 2023-11-28T20:03:39.286 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2023-11-28T20:03:39.286 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.44200.log: gzip 88.4% -- replaced with /var/log/ceph/ceph-client.admin.44200.log.gz -5 2023-11-28T20:03:39.287 INFO:teuthology.orchestra.run.smithi078.stderr: --verbose -- /var/log/ceph/ceph-client.admin.55788.log 2023-11-28T20:03:39.287 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-mon.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52116.log 2023-11-28T20:03:39.288 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.55788.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.55788.log.gz 2023-11-28T20:03:39.289 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47155.log 2023-11-28T20:03:39.290 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.52116.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55762.log 2023-11-28T20:03:39.290 INFO:teuthology.orchestra.run.smithi078.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.52116.log.gz 2023-11-28T20:03:39.292 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.47155.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.47155.log.gz 2023-11-28T20:03:39.292 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53756.log 2023-11-28T20:03:39.292 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.55762.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.55762.log.gz 2023-11-28T20:03:39.293 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45235.log 2023-11-28T20:03:39.294 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.53756.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44871.log 2023-11-28T20:03:39.295 INFO:teuthology.orchestra.run.smithi078.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.53756.log.gz 2023-11-28T20:03:39.296 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.45235.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.45235.log.gz 2023-11-28T20:03:39.296 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49620.log 2023-11-28T20:03:39.297 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.44871.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.44871.log.gz 2023-11-28T20:03:39.297 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53284.log 2023-11-28T20:03:39.300 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.49620.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53869.log 2023-11-28T20:03:39.300 INFO:teuthology.orchestra.run.smithi078.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.49620.log.gz 2023-11-28T20:03:39.300 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.53284.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.53284.log.gz 2023-11-28T20:03:39.300 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44460.log 2023-11-28T20:03:39.301 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.53869.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.53869.log.gz 2023-11-28T20:03:39.301 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53839.log 2023-11-28T20:03:39.302 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.44460.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.44460.log.gz 2023-11-28T20:03:39.303 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55462.log 2023-11-28T20:03:39.303 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.53839.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.53839.log.gz 2023-11-28T20:03:39.304 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56022.log 2023-11-28T20:03:39.305 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.55462.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53180.log 2023-11-28T20:03:39.306 INFO:teuthology.orchestra.run.smithi078.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.55462.log.gz 2023-11-28T20:03:39.306 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.56022.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.56022.log.gz 2023-11-28T20:03:39.307 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51784.log 2023-11-28T20:03:39.307 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.53180.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.53180.log.gz 2023-11-28T20:03:39.308 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50616.log 2023-11-28T20:03:39.309 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.51784.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55202.log 2023-11-28T20:03:39.310 INFO:teuthology.orchestra.run.smithi078.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.51784.log.gz 2023-11-28T20:03:39.310 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.50616.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.50616.log.gz 2023-11-28T20:03:39.311 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50512.log 2023-11-28T20:03:39.311 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.55202.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.55202.log.gz 2023-11-28T20:03:39.312 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52246.log 2023-11-28T20:03:39.313 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.50512.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51557.log 2023-11-28T20:03:39.314 INFO:teuthology.orchestra.run.smithi078.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.50512.log.gz 2023-11-28T20:03:39.315 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.52246.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48806.log 2023-11-28T20:03:39.315 INFO:teuthology.orchestra.run.smithi078.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.52246.log.gz 2023-11-28T20:03:39.316 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.51557.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.51557.log.gz 2023-11-28T20:03:39.316 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47873.log 2023-11-28T20:03:39.317 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.48806.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42612.log 2023-11-28T20:03:39.317 INFO:teuthology.orchestra.run.smithi078.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.48806.log.gz 2023-11-28T20:03:39.318 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.47873.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.47873.log.gz 2023-11-28T20:03:39.319 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49682.log 2023-11-28T20:03:39.320 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.42612.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48962.log 2023-11-28T20:03:39.320 INFO:teuthology.orchestra.run.smithi078.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.42612.log.gz 2023-11-28T20:03:39.321 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.49682.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.49682.log.gz 2023-11-28T20:03:39.321 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54179.log 2023-11-28T20:03:39.322 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.48962.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.48962.log.gz 2023-11-28T20:03:39.323 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49093.log 2023-11-28T20:03:39.324 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.54179.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50056.log 2023-11-28T20:03:39.324 INFO:teuthology.orchestra.run.smithi078.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.54179.log.gz 2023-11-28T20:03:39.325 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.49093.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.49093.log.gz 2023-11-28T20:03:39.325 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54974.log 2023-11-28T20:03:39.327 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.50056.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.50056.log.gz 2023-11-28T20:03:39.327 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47847.log 2023-11-28T20:03:39.328 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.54974.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.54974.log.gz 2023-11-28T20:03:39.328 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55814.log 2023-11-28T20:03:39.329 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.47847.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54552.log 2023-11-28T20:03:39.330 INFO:teuthology.orchestra.run.smithi078.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.47847.log.gz 2023-11-28T20:03:39.333 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.55814.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.55814.log.gz 2023-11-28T20:03:39.333 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49814.log 2023-11-28T20:03:39.333 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.54552.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.54552.log.gz 2023-11-28T20:03:39.333 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45131.log 2023-11-28T20:03:39.334 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.49814.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54844.log 2023-11-28T20:03:39.334 INFO:teuthology.orchestra.run.smithi078.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.49814.log.gz 2023-11-28T20:03:39.335 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.45131.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45001.log 2023-11-28T20:03:39.335 INFO:teuthology.orchestra.run.smithi078.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.45131.log.gz 2023-11-28T20:03:39.336 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.54844.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.54844.log.gz 2023-11-28T20:03:39.336 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49486.log 2023-11-28T20:03:39.338 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.45001.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43155.log 2023-11-28T20:03:39.338 INFO:teuthology.orchestra.run.smithi078.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.45001.log.gz 2023-11-28T20:03:39.339 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.49486.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.49486.log.gz 2023-11-28T20:03:39.339 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44538.log 2023-11-28T20:03:39.340 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.43155.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.43155.log.gz 2023-11-28T20:03:39.341 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43498.log 2023-11-28T20:03:39.342 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.44538.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.44538.log.gz 2023-11-28T20:03:39.342 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50564.log 2023-11-28T20:03:39.343 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.43498.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.43498.log.gz 2023-11-28T20:03:39.344 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55632.log 2023-11-28T20:03:39.345 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.50564.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.50564.log.gz 2023-11-28T20:03:39.345 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53652.log 2023-11-28T20:03:39.346 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.55632.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51401.log 2023-11-28T20:03:39.347 INFO:teuthology.orchestra.run.smithi078.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.55632.log.gz 2023-11-28T20:03:39.348 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.53652.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47925.log 2023-11-28T20:03:39.348 INFO:teuthology.orchestra.run.smithi078.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.53652.log.gz 2023-11-28T20:03:39.349 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.51401.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.51401.log.gz 2023-11-28T20:03:39.349 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48241.log 2023-11-28T20:03:39.350 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.47925.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52676.log 2023-11-28T20:03:39.351 INFO:teuthology.orchestra.run.smithi078.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.47925.log.gz 2023-11-28T20:03:39.351 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.48241.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.48241.log.gz 2023-11-28T20:03:39.352 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51992.log 2023-11-28T20:03:39.353 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.52676.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.52676.log.gz 2023-11-28T20:03:39.353 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45846.log 2023-11-28T20:03:39.354 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.51992.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46323.log 2023-11-28T20:03:39.355 INFO:teuthology.orchestra.run.smithi078.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.51992.log.gz 2023-11-28T20:03:39.355 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.45846.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.45846.log.gz 2023-11-28T20:03:39.356 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52304.log 2023-11-28T20:03:39.357 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.46323.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.46323.log.gz 2023-11-28T20:03:39.357 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49302.log 2023-11-28T20:03:39.359 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.52304.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47717.log 2023-11-28T20:03:39.359 INFO:teuthology.orchestra.run.smithi078.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.52304.log.gz 2023-11-28T20:03:39.360 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.49302.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.49302.log.gz 2023-11-28T20:03:39.360 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48033.log 2023-11-28T20:03:39.361 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.47717.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42664.log 2023-11-28T20:03:39.362 INFO:teuthology.orchestra.run.smithi078.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.47717.log.gz 2023-11-28T20:03:39.363 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.48033.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.48033.log.gz 2023-11-28T20:03:39.363 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45105.log 2023-11-28T20:03:39.364 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.42664.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.42664.log.gz 2023-11-28T20:03:39.364 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44004.log 2023-11-28T20:03:39.366 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.45105.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.45105.log.gz 2023-11-28T20:03:39.366 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55026.log 2023-11-28T20:03:39.367 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.44004.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47481.log 2023-11-28T20:03:39.368 INFO:teuthology.orchestra.run.smithi078.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.44004.log.gz 2023-11-28T20:03:39.369 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.55026.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44016.log 2023-11-28T20:03:39.369 INFO:teuthology.orchestra.run.smithi078.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.55026.log.gz 2023-11-28T20:03:39.370 INFO:teuthology.orchestra.run.smithi179.stderr: 91.1% -- replaced with /var/log/ceph/ceph-mon.b.log.gz 2023-11-28T20:03:39.370 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.47481.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53522.log 2023-11-28T20:03:39.371 INFO:teuthology.orchestra.run.smithi078.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.47481.log.gz 2023-11-28T20:03:39.372 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.44016.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54283.log 2023-11-28T20:03:39.372 INFO:teuthology.orchestra.run.smithi078.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.44016.log.gz 2023-11-28T20:03:39.373 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.53522.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47001.log 2023-11-28T20:03:39.373 INFO:teuthology.orchestra.run.smithi078.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.53522.log.gz 2023-11-28T20:03:39.375 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.54283.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.54283.log.gz 2023-11-28T20:03:39.375 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45183.log 2023-11-28T20:03:39.376 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.47001.log: 89.1%gzip -- replaced with /var/log/ceph/ceph-client.admin.47001.log.gz 2023-11-28T20:03:39.376 INFO:teuthology.orchestra.run.smithi078.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.53102.log 2023-11-28T20:03:39.378 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.45183.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53999.log 2023-11-28T20:03:39.378 INFO:teuthology.orchestra.run.smithi078.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.45183.log.gz 2023-11-28T20:03:39.379 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.53102.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.53102.log.gz 2023-11-28T20:03:39.379 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49041.log 2023-11-28T20:03:39.380 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.53999.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48214.log 2023-11-28T20:03:39.381 INFO:teuthology.orchestra.run.smithi078.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.53999.log.gz 2023-11-28T20:03:39.391 INFO:teuthology.orchestra.run.smithi179.stderr: 91.8% -- replaced with /var/log/ceph/ceph-mon.c.log.gz 2023-11-28T20:03:39.392 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.49041.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.49041.log.gz 2023-11-28T20:03:39.392 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55944.log 2023-11-28T20:03:39.392 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.48214.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.48214.log.gz 2023-11-28T20:03:39.392 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48631.log 2023-11-28T20:03:39.393 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.55944.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51375.log 2023-11-28T20:03:39.393 INFO:teuthology.orchestra.run.smithi078.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.55944.log.gz 2023-11-28T20:03:39.394 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.48631.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.48631.log.gz 2023-11-28T20:03:39.394 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45685.log 2023-11-28T20:03:39.394 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.51375.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.51375.log.gz 2023-11-28T20:03:39.394 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45469.log 2023-11-28T20:03:39.394 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.45685.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.45685.log.gz 2023-11-28T20:03:39.394 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51732.log 2023-11-28T20:03:39.395 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.45469.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48345.log 2023-11-28T20:03:39.395 INFO:teuthology.orchestra.run.smithi078.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.45469.log.gz 2023-11-28T20:03:39.395 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.51732.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.51732.log.gz 2023-11-28T20:03:39.395 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50160.log 2023-11-28T20:03:39.397 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.48345.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.48345.log.gz 2023-11-28T20:03:39.397 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54922.log 2023-11-28T20:03:39.397 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.50160.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45768.log 2023-11-28T20:03:39.397 INFO:teuthology.orchestra.run.smithi078.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.50160.log.gz 2023-11-28T20:03:39.397 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.54922.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.54922.log.gz 2023-11-28T20:03:39.397 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52142.log 2023-11-28T20:03:39.398 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.45768.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52220.log 2023-11-28T20:03:39.398 INFO:teuthology.orchestra.run.smithi078.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.45768.log.gz 2023-11-28T20:03:39.399 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.52142.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.52142.log.gz 2023-11-28T20:03:39.399 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51661.log 2023-11-28T20:03:39.400 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.52220.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.52220.log.gz 2023-11-28T20:03:39.400 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52650.log 2023-11-28T20:03:39.401 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.51661.log: gzip -5 88.8% --verbose -- replaced with /var/log/ceph/ceph-client.admin.51661.log.gz -- 2023-11-28T20:03:39.401 INFO:teuthology.orchestra.run.smithi078.stderr: /var/log/ceph/ceph-osd.3.log 2023-11-28T20:03:39.403 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.52650.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.52650.log.gz 2023-11-28T20:03:39.403 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52402.log 2023-11-28T20:03:39.404 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-osd.3.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55358.log 2023-11-28T20:03:39.405 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.52402.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.52402.log.gz 2023-11-28T20:03:39.405 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44923.log 2023-11-28T20:03:39.407 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.55358.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51453.log 2023-11-28T20:03:39.407 INFO:teuthology.orchestra.run.smithi078.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.55358.log.gz 2023-11-28T20:03:39.408 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.44923.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50108.log 2023-11-28T20:03:39.408 INFO:teuthology.orchestra.run.smithi078.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.44923.log.gz 2023-11-28T20:03:39.410 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.51453.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.testuser.48198.log 2023-11-28T20:03:39.410 INFO:teuthology.orchestra.run.smithi078.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.51453.log.gz 2023-11-28T20:03:39.411 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.50108.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.50108.log.gz 2023-11-28T20:03:39.411 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48059.log 2023-11-28T20:03:39.412 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.testuser.48198.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46211.log 2023-11-28T20:03:39.412 INFO:teuthology.orchestra.run.smithi078.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.testuser.48198.log.gz 2023-11-28T20:03:39.414 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.48059.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.48059.log.gz 2023-11-28T20:03:39.414 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52964.log 2023-11-28T20:03:39.415 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.46211.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.46211.log.gz 2023-11-28T20:03:39.415 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.testuser.51151.log 2023-11-28T20:03:39.417 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.52964.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.52964.log.gz 2023-11-28T20:03:39.417 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54469.log 2023-11-28T20:03:39.418 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.testuser.51151.log: 0.0% -- replaced with /var/log/ceph/ceph-client.testuser.51151.log.gz 2023-11-28T20:03:39.418 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45820.log 2023-11-28T20:03:39.419 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.54469.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.54469.log.gz 2023-11-28T20:03:39.420 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43550.log 2023-11-28T20:03:39.421 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.45820.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.45820.log.gz 2023-11-28T20:03:39.421 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43024.log 2023-11-28T20:03:39.423 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.43550.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.43550.log.gz 2023-11-28T20:03:39.423 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50720.log 2023-11-28T20:03:39.424 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.43024.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.43024.log.gz 2023-11-28T20:03:39.425 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49564.log 2023-11-28T20:03:39.426 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.50720.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.50720.log.gz 2023-11-28T20:03:39.426 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47769.log 2023-11-28T20:03:39.428 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.49564.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.49564.log.gz 2023-11-28T20:03:39.428 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53444.log 2023-11-28T20:03:39.429 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.47769.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.47769.log.gz 2023-11-28T20:03:39.429 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52590.log 2023-11-28T20:03:39.431 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.53444.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.53444.log.gz 2023-11-28T20:03:39.431 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45209.log 2023-11-28T20:03:39.432 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.52590.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.52590.log.gz 2023-11-28T20:03:39.432 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51193.log 2023-11-28T20:03:39.434 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.45209.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.45209.log.gz 2023-11-28T20:03:39.434 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47027.log 2023-11-28T20:03:39.435 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.51193.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.51193.log.gz 2023-11-28T20:03:39.435 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48988.log 2023-11-28T20:03:39.437 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.47027.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.47027.log.gz 2023-11-28T20:03:39.437 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50800.log 2023-11-28T20:03:39.438 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.48988.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53921.log 2023-11-28T20:03:39.438 INFO:teuthology.orchestra.run.smithi078.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.48988.log.gz 2023-11-28T20:03:39.439 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.50800.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.50800.log.gz 2023-11-28T20:03:39.440 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44512.log 2023-11-28T20:03:39.441 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.53921.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44020.log 2023-11-28T20:03:39.441 INFO:teuthology.orchestra.run.smithi078.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.53921.log.gz 2023-11-28T20:03:39.442 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.44512.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.44512.log.gz 2023-11-28T20:03:39.442 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50934.log 2023-11-28T20:03:39.444 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.44020.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.44020.log.gz 2023-11-28T20:03:39.445 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54025.log 2023-11-28T20:03:39.445 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.50934.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.50934.log.gz 2023-11-28T20:03:39.445 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45547.log 2023-11-28T20:03:39.447 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.54025.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.54025.log.gz 2023-11-28T20:03:39.447 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2023-11-28T20:03:39.448 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.45547.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55684.log 2023-11-28T20:03:39.449 INFO:teuthology.orchestra.run.smithi078.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.45547.log.gz 2023-11-28T20:03:39.450 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55150.log 2023-11-28T20:03:39.452 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.55684.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52990.log 2023-11-28T20:03:39.452 INFO:teuthology.orchestra.run.smithi078.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.55684.log.gz 2023-11-28T20:03:39.453 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.55150.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54792.log 2023-11-28T20:03:39.453 INFO:teuthology.orchestra.run.smithi078.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.55150.log.gz 2023-11-28T20:03:39.455 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.52990.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53678.log 2023-11-28T20:03:39.455 INFO:teuthology.orchestra.run.smithi078.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.52990.log.gz 2023-11-28T20:03:39.456 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.54792.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.54792.log.gz 2023-11-28T20:03:39.456 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42560.log 2023-11-28T20:03:39.457 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.53678.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.53678.log.gz 2023-11-28T20:03:39.457 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50908.log 2023-11-28T20:03:39.459 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.42560.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50826.log 2023-11-28T20:03:39.460 INFO:teuthology.orchestra.run.smithi078.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.42560.log.gz 2023-11-28T20:03:39.461 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.50908.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46263.log 2023-11-28T20:03:39.461 INFO:teuthology.orchestra.run.smithi078.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.50908.log.gz 2023-11-28T20:03:39.462 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.50826.log: gzip -5 --verbose 89.2% -- -- replaced with /var/log/ceph/ceph-client.admin.50826.log.gz /var/log/ceph/ceph-client.admin.42422.log 2023-11-28T20:03:39.462 INFO:teuthology.orchestra.run.smithi078.stderr: 2023-11-28T20:03:39.464 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.46263.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.46263.log.gz 2023-11-28T20:03:39.465 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.42422.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.42422.log.gz 2023-11-28T20:03:39.465 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44618.log 2023-11-28T20:03:39.467 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50590.log 2023-11-28T20:03:39.468 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.44618.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46897.log 2023-11-28T20:03:39.469 INFO:teuthology.orchestra.run.smithi078.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.44618.log.gz 2023-11-28T20:03:39.470 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.50590.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.50590.log.gz 2023-11-28T20:03:39.471 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.46897.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.46897.log.gz 2023-11-28T20:03:39.472 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55554.log 2023-11-28T20:03:39.473 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47795.log 2023-11-28T20:03:39.475 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.55554.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54495.log 2023-11-28T20:03:39.475 INFO:teuthology.orchestra.run.smithi078.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.55554.log.gz 2023-11-28T20:03:39.476 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.47795.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45079.log 2023-11-28T20:03:39.476 INFO:teuthology.orchestra.run.smithi078.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.47795.log.gz 2023-11-28T20:03:39.478 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.54495.log: gzip -5 --verbose -- 88.7% /var/log/ceph/ceph-client.admin.44226.log -- replaced with /var/log/ceph/ceph-client.admin.54495.log.gz 2023-11-28T20:03:39.478 INFO:teuthology.orchestra.run.smithi078.stderr: 2023-11-28T20:03:39.479 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.45079.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45313.log 2023-11-28T20:03:39.479 INFO:teuthology.orchestra.run.smithi078.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.45079.log.gz 2023-11-28T20:03:39.481 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.44226.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44356.log 2023-11-28T20:03:39.481 INFO:teuthology.orchestra.run.smithi078.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.44226.log.gz 2023-11-28T20:03:39.482 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.45313.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52860.log 2023-11-28T20:03:39.482 INFO:teuthology.orchestra.run.smithi078.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.45313.log.gz 2023-11-28T20:03:39.483 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.44356.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.44356.log.gz 2023-11-28T20:03:39.483 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55176.log 2023-11-28T20:03:39.485 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.52860.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.52860.log.gz 2023-11-28T20:03:39.485 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47105.log 2023-11-28T20:03:39.486 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.55176.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54526.log 2023-11-28T20:03:39.487 INFO:teuthology.orchestra.run.smithi078.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.55176.log.gz 2023-11-28T20:03:39.488 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.47105.log: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.47105.log.gz 2023-11-28T20:03:39.489 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.54526.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.54526.log.gz 2023-11-28T20:03:39.490 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43812.log 2023-11-28T20:03:39.491 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50408.log 2023-11-28T20:03:39.493 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.43812.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52534.log 2023-11-28T20:03:39.493 INFO:teuthology.orchestra.run.smithi078.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.43812.log.gz 2023-11-28T20:03:39.494 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.50408.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46493.log 2023-11-28T20:03:39.494 INFO:teuthology.orchestra.run.smithi078.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.50408.log.gz 2023-11-28T20:03:39.495 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.52534.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.52534.log.gz 2023-11-28T20:03:39.496 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54766.log 2023-11-28T20:03:39.497 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.46493.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42742.log 2023-11-28T20:03:39.497 INFO:teuthology.orchestra.run.smithi078.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.46493.log.gz 2023-11-28T20:03:39.499 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.54766.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43259.log 2023-11-28T20:03:39.499 INFO:teuthology.orchestra.run.smithi078.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.54766.log.gz 2023-11-28T20:03:39.500 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.42742.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52912.log 2023-11-28T20:03:39.501 INFO:teuthology.orchestra.run.smithi078.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.42742.log.gz 2023-11-28T20:03:39.502 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.43259.log: gzip 88.2% -5 -- replaced with /var/log/ceph/ceph-client.admin.43259.log.gz --verbose 2023-11-28T20:03:39.502 INFO:teuthology.orchestra.run.smithi078.stderr: -- /var/log/ceph/ceph-client.admin.44592.log 2023-11-28T20:03:39.503 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.52912.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.52912.log.gz 2023-11-28T20:03:39.503 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51349.log 2023-11-28T20:03:39.504 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.44592.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52938.log 2023-11-28T20:03:39.505 INFO:teuthology.orchestra.run.smithi078.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.44592.log.gz 2023-11-28T20:03:39.506 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.51349.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46705.log 2023-11-28T20:03:39.506 INFO:teuthology.orchestra.run.smithi078.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.51349.log.gz 2023-11-28T20:03:39.507 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.52938.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.52938.log.gzgzip 2023-11-28T20:03:39.507 INFO:teuthology.orchestra.run.smithi078.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.45365.log 2023-11-28T20:03:39.509 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.46705.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49592.log 2023-11-28T20:03:39.509 INFO:teuthology.orchestra.run.smithi078.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.46705.log.gz 2023-11-28T20:03:39.510 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.45365.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51687.log 2023-11-28T20:03:39.510 INFO:teuthology.orchestra.run.smithi078.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.45365.log.gz 2023-11-28T20:03:39.512 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.49592.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.49592.log.gz 2023-11-28T20:03:39.513 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.51687.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.51687.log.gz 2023-11-28T20:03:39.513 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44382.log 2023-11-28T20:03:39.515 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52482.log 2023-11-28T20:03:39.516 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.44382.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.44382.log.gz 2023-11-28T20:03:39.516 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53154.log 2023-11-28T20:03:39.518 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.52482.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51297.log 2023-11-28T20:03:39.518 INFO:teuthology.orchestra.run.smithi078.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.52482.log.gz 2023-11-28T20:03:39.519 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.53154.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.53154.log.gz 2023-11-28T20:03:39.519 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42370.log 2023-11-28T20:03:39.521 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.51297.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45711.log 2023-11-28T20:03:39.521 INFO:teuthology.orchestra.run.smithi078.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.51297.log.gz 2023-11-28T20:03:39.522 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.42370.log: gzip -5 88.2% --verbose -- -- replaced with /var/log/ceph/ceph-client.admin.42370.log.gz /var/log/ceph/ceph-client.admin.52272.log 2023-11-28T20:03:39.522 INFO:teuthology.orchestra.run.smithi078.stderr: 2023-11-28T20:03:39.524 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.45711.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55436.log 2023-11-28T20:03:39.524 INFO:teuthology.orchestra.run.smithi078.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.45711.log.gz 2023-11-28T20:03:39.525 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.52272.log: gzip 88.6% -- replaced with /var/log/ceph/ceph-client.admin.52272.log.gz -5 2023-11-28T20:03:39.525 INFO:teuthology.orchestra.run.smithi078.stderr: --verbose -- /var/log/ceph/ceph-client.admin.53418.log 2023-11-28T20:03:39.527 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.55436.log: gzip 87.6% -5 -- replaced with /var/log/ceph/ceph-client.admin.55436.log.gz --verbose 2023-11-28T20:03:39.527 INFO:teuthology.orchestra.run.smithi078.stderr: -- /var/log/ceph/ceph-client.admin.42344.log 2023-11-28T20:03:39.528 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.53418.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.53418.log.gz 2023-11-28T20:03:39.528 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55098.log 2023-11-28T20:03:39.529 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.42344.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55306.log 2023-11-28T20:03:39.530 INFO:teuthology.orchestra.run.smithi078.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.42344.log.gz 2023-11-28T20:03:39.531 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.55098.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47427.log 2023-11-28T20:03:39.531 INFO:teuthology.orchestra.run.smithi078.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.55098.log.gz 2023-11-28T20:03:39.533 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.55306.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.55306.log.gz 2023-11-28T20:03:39.533 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52782.log 2023-11-28T20:03:39.535 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.47427.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.47427.log.gz 2023-11-28T20:03:39.535 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55918.log 2023-11-28T20:03:39.537 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.52782.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47899.log 2023-11-28T20:03:39.537 INFO:teuthology.orchestra.run.smithi078.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.52782.log.gz 2023-11-28T20:03:39.538 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.55918.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.55918.log.gz 2023-11-28T20:03:39.538 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51219.log 2023-11-28T20:03:39.539 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.47899.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.47899.log.gz 2023-11-28T20:03:39.540 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54656.log 2023-11-28T20:03:39.541 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.51219.log: gzip -5 --verbose -- 89.3% /var/log/ceph/ceph.log -- replaced with /var/log/ceph/ceph-client.admin.51219.log.gz 2023-11-28T20:03:39.541 INFO:teuthology.orchestra.run.smithi078.stderr: 2023-11-28T20:03:39.542 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.54656.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52454.log 2023-11-28T20:03:39.542 INFO:teuthology.orchestra.run.smithi078.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.54656.log.gz 2023-11-28T20:03:39.544 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43420.log 2023-11-28T20:03:39.545 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.52454.log: 86.2% -- replaced with /var/log/ceph/ceph.log.gz 2023-11-28T20:03:39.546 INFO:teuthology.orchestra.run.smithi078.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.52454.log.gz 2023-11-28T20:03:39.546 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46545.log 2023-11-28T20:03:39.548 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.43420.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.43420.log.gz 2023-11-28T20:03:39.548 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42318.log 2023-11-28T20:03:39.549 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.46545.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48858.log 2023-11-28T20:03:39.549 INFO:teuthology.orchestra.run.smithi078.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.46545.log.gz 2023-11-28T20:03:39.551 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.42318.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55658.log 2023-11-28T20:03:39.551 INFO:teuthology.orchestra.run.smithi078.stderr: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.42318.log.gz 2023-11-28T20:03:39.552 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.48858.log: gzip 87.7% -- replaced with /var/log/ceph/ceph-client.admin.48858.log.gz -5 2023-11-28T20:03:39.552 INFO:teuthology.orchestra.run.smithi078.stderr: --verbose -- /var/log/ceph/ceph-client.admin.56074.log 2023-11-28T20:03:39.552 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.55658.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48397.log 2023-11-28T20:03:39.553 INFO:teuthology.orchestra.run.smithi078.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.55658.log.gz 2023-11-28T20:03:39.554 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.56074.log: gzip 89.3% -- replaced with /var/log/ceph/ceph-client.admin.56074.log.gz 2023-11-28T20:03:39.555 INFO:teuthology.orchestra.run.smithi078.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.42167.log 2023-11-28T20:03:39.555 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.48397.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.48397.log.gz 2023-11-28T20:03:39.556 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52730.log 2023-11-28T20:03:39.557 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.42167.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44564.log 2023-11-28T20:03:39.558 INFO:teuthology.orchestra.run.smithi078.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.42167.log.gz 2023-11-28T20:03:39.559 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.52730.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.52730.log.gz 2023-11-28T20:03:39.560 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49249.log 2023-11-28T20:03:39.561 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.44564.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45417.log 2023-11-28T20:03:39.561 INFO:teuthology.orchestra.run.smithi078.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.44564.log.gz 2023-11-28T20:03:39.562 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.49249.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46975.log 2023-11-28T20:03:39.562 INFO:teuthology.orchestra.run.smithi078.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.49249.log.gz 2023-11-28T20:03:39.563 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.45417.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52044.log 2023-11-28T20:03:39.563 INFO:teuthology.orchestra.run.smithi078.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.45417.log.gz 2023-11-28T20:03:39.565 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.46975.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52336.log 2023-11-28T20:03:39.565 INFO:teuthology.orchestra.run.smithi078.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.46975.log.gz 2023-11-28T20:03:39.566 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.52044.log: gzip -5 88.6% --verbose -- replaced with /var/log/ceph/ceph-client.admin.52044.log.gz -- 2023-11-28T20:03:39.566 INFO:teuthology.orchestra.run.smithi078.stderr: /var/log/ceph/ceph-client.admin.49119.log 2023-11-28T20:03:39.568 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.52336.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.47201.log 2023-11-28T20:03:39.568 INFO:teuthology.orchestra.run.smithi078.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.52336.log.gz 2023-11-28T20:03:39.569 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.49119.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49197.log 2023-11-28T20:03:39.569 INFO:teuthology.orchestra.run.smithi078.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.49119.log.gz 2023-11-28T20:03:39.570 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.0.47201.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.47201.log.gz 2023-11-28T20:03:39.571 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51940.log 2023-11-28T20:03:39.572 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.49197.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.49197.log.gz 2023-11-28T20:03:39.572 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48657.log 2023-11-28T20:03:39.574 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.51940.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46597.log 2023-11-28T20:03:39.574 INFO:teuthology.orchestra.run.smithi078.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.51940.log.gz 2023-11-28T20:03:39.575 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.48657.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.48657.log.gzgzip 2023-11-28T20:03:39.575 INFO:teuthology.orchestra.run.smithi078.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.56048.log 2023-11-28T20:03:39.577 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.46597.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51531.log 2023-11-28T20:03:39.577 INFO:teuthology.orchestra.run.smithi078.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.46597.log.gz 2023-11-28T20:03:39.578 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.56048.log: 88.1%gzip -- replaced with /var/log/ceph/ceph-client.admin.56048.log.gz 2023-11-28T20:03:39.578 INFO:teuthology.orchestra.run.smithi078.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.42265.log 2023-11-28T20:03:39.579 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.51531.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.51531.log.gz 2023-11-28T20:03:39.581 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.42265.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.42265.log.gz 2023-11-28T20:03:39.581 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45607.log 2023-11-28T20:03:39.583 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51012.log 2023-11-28T20:03:39.584 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.45607.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48936.log 2023-11-28T20:03:39.584 INFO:teuthology.orchestra.run.smithi078.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.45607.log.gz 2023-11-28T20:03:39.586 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.51012.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50960.log 2023-11-28T20:03:39.586 INFO:teuthology.orchestra.run.smithi078.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.51012.log.gz 2023-11-28T20:03:39.587 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.48936.log: gzip -5 88.9% --verbose -- -- replaced with /var/log/ceph/ceph-client.admin.48936.log.gz /var/log/ceph/ceph.tmp-client.admin.33411.log 2023-11-28T20:03:39.587 INFO:teuthology.orchestra.run.smithi078.stderr: 2023-11-28T20:03:39.589 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.50960.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43368.log 2023-11-28T20:03:39.589 INFO:teuthology.orchestra.run.smithi078.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.50960.log.gz 2023-11-28T20:03:39.589 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph.tmp-client.admin.33411.log: 0.0% -- replaced with /var/log/ceph/ceph.tmp-client.admin.33411.log.gz 2023-11-28T20:03:39.590 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54391.log 2023-11-28T20:03:39.592 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.43368.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50268.log 2023-11-28T20:03:39.592 INFO:teuthology.orchestra.run.smithi078.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.43368.log.gz 2023-11-28T20:03:39.593 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.54391.log: gzip -5 89.2% --verbose -- -- replaced with /var/log/ceph/ceph-client.admin.54391.log.gz /var/log/ceph/ceph-client.admin.47321.log 2023-11-28T20:03:39.593 INFO:teuthology.orchestra.run.smithi078.stderr: 2023-11-28T20:03:39.594 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.50268.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.50268.log.gz 2023-11-28T20:03:39.595 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50354.log 2023-11-28T20:03:39.596 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.47321.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46871.log 2023-11-28T20:03:39.597 INFO:teuthology.orchestra.run.smithi078.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.47321.log.gz 2023-11-28T20:03:39.598 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.50354.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42792.log 2023-11-28T20:03:39.598 INFO:teuthology.orchestra.run.smithi078.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.50354.log.gz 2023-11-28T20:03:39.599 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.46871.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53574.log 2023-11-28T20:03:39.599 INFO:teuthology.orchestra.run.smithi078.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.46871.log.gz 2023-11-28T20:03:39.601 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.42792.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49434.log 2023-11-28T20:03:39.601 INFO:teuthology.orchestra.run.smithi078.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.42792.log.gz 2023-11-28T20:03:39.602 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.53574.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47217.log 2023-11-28T20:03:39.602 INFO:teuthology.orchestra.run.smithi078.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.53574.log.gz 2023-11-28T20:03:39.603 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.49434.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.49434.log.gz 2023-11-28T20:03:39.603 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50878.log 2023-11-28T20:03:39.605 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.47217.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46389.log 2023-11-28T20:03:39.605 INFO:teuthology.orchestra.run.smithi078.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.47217.log.gz 2023-11-28T20:03:39.606 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.50878.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.50878.log.gz 2023-11-28T20:03:39.606 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49276.log 2023-11-28T20:03:39.607 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.46389.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.46389.log.gz 2023-11-28T20:03:39.608 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55124.log 2023-11-28T20:03:39.609 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.49276.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55410.log 2023-11-28T20:03:39.610 INFO:teuthology.orchestra.run.smithi078.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.49276.log.gz 2023-11-28T20:03:39.611 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.55124.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47559.log 2023-11-28T20:03:39.611 INFO:teuthology.orchestra.run.smithi078.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.55124.log.gz 2023-11-28T20:03:39.612 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.55410.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.55410.log.gz 2023-11-28T20:03:39.613 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54443.log 2023-11-28T20:03:39.613 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.47559.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.47559.log.gz 2023-11-28T20:03:39.614 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54365.log 2023-11-28T20:03:39.616 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.54443.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51505.log 2023-11-28T20:03:39.616 INFO:teuthology.orchestra.run.smithi078.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.54443.log.gz 2023-11-28T20:03:39.617 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.54365.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54604.log 2023-11-28T20:03:39.617 INFO:teuthology.orchestra.run.smithi078.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.54365.log.gz 2023-11-28T20:03:39.619 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.51505.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46237.log 2023-11-28T20:03:39.619 INFO:teuthology.orchestra.run.smithi078.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.51505.log.gz 2023-11-28T20:03:39.620 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.54604.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.54604.log.gz 2023-11-28T20:03:39.621 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.46237.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.46237.log.gz 2023-11-28T20:03:39.622 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45925.log 2023-11-28T20:03:39.623 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48553.log 2023-11-28T20:03:39.625 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.45925.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43602.log 2023-11-28T20:03:39.625 INFO:teuthology.orchestra.run.smithi078.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.45925.log.gz 2023-11-28T20:03:39.626 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.48553.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48501.log 2023-11-28T20:03:39.626 INFO:teuthology.orchestra.run.smithi078.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.48553.log.gz 2023-11-28T20:03:39.628 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.43602.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50030.log 2023-11-28T20:03:39.628 INFO:teuthology.orchestra.run.smithi078.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.43602.log.gz 2023-11-28T20:03:39.629 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.48501.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54630.log 2023-11-28T20:03:39.629 INFO:teuthology.orchestra.run.smithi078.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.48501.log.gz 2023-11-28T20:03:39.631 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.50030.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46003.log 2023-11-28T20:03:39.631 INFO:teuthology.orchestra.run.smithi078.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.50030.log.gz 2023-11-28T20:03:39.632 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.54630.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55280.log 2023-11-28T20:03:39.632 INFO:teuthology.orchestra.run.smithi078.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.54630.log.gz 2023-11-28T20:03:39.634 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.46003.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53704.log 2023-11-28T20:03:39.634 INFO:teuthology.orchestra.run.smithi078.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.46003.log.gz 2023-11-28T20:03:39.635 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.55280.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48085.log 2023-11-28T20:03:39.635 INFO:teuthology.orchestra.run.smithi078.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.55280.log.gz 2023-11-28T20:03:39.636 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.53704.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.53704.log.gz 2023-11-28T20:03:39.637 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43316.log 2023-11-28T20:03:39.638 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.48085.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47981.log 2023-11-28T20:03:39.638 INFO:teuthology.orchestra.run.smithi078.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.48085.log.gz 2023-11-28T20:03:39.639 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.43316.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49334.log 2023-11-28T20:03:39.640 INFO:teuthology.orchestra.run.smithi078.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.43316.log.gz 2023-11-28T20:03:39.641 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.47981.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47691.log 2023-11-28T20:03:39.641 INFO:teuthology.orchestra.run.smithi078.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.47981.log.gz 2023-11-28T20:03:39.642 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.49334.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.49334.log.gz 2023-11-28T20:03:39.643 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43342.log 2023-11-28T20:03:39.644 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.47691.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51635.log 2023-11-28T20:03:39.644 INFO:teuthology.orchestra.run.smithi078.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.47691.log.gz 2023-11-28T20:03:39.645 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.43342.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45951.log 2023-11-28T20:03:39.646 INFO:teuthology.orchestra.run.smithi078.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.43342.log.gz 2023-11-28T20:03:39.647 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.51635.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.51635.log.gz 2023-11-28T20:03:39.647 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54740.log 2023-11-28T20:03:39.648 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.45951.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50302.log 2023-11-28T20:03:39.649 INFO:teuthology.orchestra.run.smithi078.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.45951.log.gz 2023-11-28T20:03:39.650 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.54740.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49145.log 2023-11-28T20:03:39.650 INFO:teuthology.orchestra.run.smithi078.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.54740.log.gz 2023-11-28T20:03:39.651 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.50302.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53496.log 2023-11-28T20:03:39.651 INFO:teuthology.orchestra.run.smithi078.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.50302.log.gz 2023-11-28T20:03:39.653 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.49145.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55052.log 2023-11-28T20:03:39.653 INFO:teuthology.orchestra.run.smithi078.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.49145.log.gz 2023-11-28T20:03:39.654 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.53496.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43446.log 2023-11-28T20:03:39.654 INFO:teuthology.orchestra.run.smithi078.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.53496.log.gz 2023-11-28T20:03:39.655 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.55052.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2023-11-28T20:03:39.656 INFO:teuthology.orchestra.run.smithi078.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.55052.log.gz 2023-11-28T20:03:39.657 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.43446.log: gzip 89.0% -5 --verbose -- /var/log/ceph/ceph-mds.c.log 2023-11-28T20:03:39.657 INFO:teuthology.orchestra.run.smithi078.stderr: -- replaced with /var/log/ceph/ceph-client.admin.43446.log.gz 2023-11-28T20:03:39.661 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph.audit.log: /var/log/ceph/ceph-mds.c.log: 89.2% -- replaced with /var/log/ceph/ceph.audit.log.gz 2023-11-28T20:03:39.661 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43603.log 2023-11-28T20:03:39.663 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49892.log 2023-11-28T20:03:39.664 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.43603.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.43603.log.gz 2023-11-28T20:03:39.665 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.49892.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.49892.log.gz 2023-11-28T20:03:39.666 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50642.log 2023-11-28T20:03:39.668 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45872.log 2023-11-28T20:03:39.669 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.50642.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.50642.log.gz 2023-11-28T20:03:39.670 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.45872.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.45872.log.gz 2023-11-28T20:03:39.671 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45659.log 2023-11-28T20:03:39.673 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.a.log 2023-11-28T20:03:39.674 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.45659.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.45659.log.gz 2023-11-28T20:03:39.678 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-mds.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47373.log 2023-11-28T20:03:39.680 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42396.log 2023-11-28T20:03:39.681 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.47373.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.47373.log.gz 2023-11-28T20:03:39.683 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45053.log 2023-11-28T20:03:39.686 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.42396.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54205.log 2023-11-28T20:03:39.687 INFO:teuthology.orchestra.run.smithi078.stderr: 88.9%/var/log/ceph/ceph-client.admin.45053.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43587.log 2023-11-28T20:03:39.687 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.54205.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.54205.log.gz 2023-11-28T20:03:39.688 INFO:teuthology.orchestra.run.smithi078.stderr: -- replaced with /var/log/ceph/ceph-client.admin.42396.log.gz 2023-11-28T20:03:39.688 INFO:teuthology.orchestra.run.smithi078.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.45053.log.gz 2023-11-28T20:03:39.690 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50082.log 2023-11-28T20:03:39.691 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.43587.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.43587.log.gz 2023-11-28T20:03:39.693 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42200.log 2023-11-28T20:03:39.694 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.50082.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.50082.log.gz 2023-11-28T20:03:39.697 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.42200.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.42200.log.gz 2023-11-28T20:03:39.698 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51323.log 2023-11-28T20:03:39.701 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.51323.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.51323.log.gz 2023-11-28T20:03:39.701 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46845.log 2023-11-28T20:03:39.703 INFO:teuthology.orchestra.run.smithi078.stderr: 92.7% -- replaced with /var/log/ceph/ceph-mds.c.log.gz 2023-11-28T20:03:39.704 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.46845.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43472.log 2023-11-28T20:03:39.704 INFO:teuthology.orchestra.run.smithi078.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.46845.log.gz 2023-11-28T20:03:39.705 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43811.log 2023-11-28T20:03:39.707 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.43472.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.43472.log.gz 2023-11-28T20:03:39.707 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50212.log 2023-11-28T20:03:39.708 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.43811.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.43811.log.gz 2023-11-28T20:03:39.710 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.50212.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.50212.log.gz 2023-11-28T20:03:39.710 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46133.log 2023-11-28T20:03:39.712 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52756.log 2023-11-28T20:03:39.714 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.46133.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.46133.log.gz 2023-11-28T20:03:39.715 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.52756.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.52756.log.gz 2023-11-28T20:03:39.715 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55580.log 2023-11-28T20:03:39.717 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45287.log 2023-11-28T20:03:39.718 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.55580.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.55580.log.gz 2023-11-28T20:03:39.720 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.45287.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.45287.log.gz 2023-11-28T20:03:39.720 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47821.log 2023-11-28T20:03:39.721 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38320.log 2023-11-28T20:03:39.723 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.47821.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.47821.log.gz 2023-11-28T20:03:39.724 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.38320.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.38320.log.gz 2023-11-28T20:03:39.724 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46765.log 2023-11-28T20:03:39.726 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47243.log 2023-11-28T20:03:39.728 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.46765.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.46765.log.gz 2023-11-28T20:03:39.728 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.47243.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.47243.log.gz 2023-11-28T20:03:39.729 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49918.log 2023-11-28T20:03:39.730 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52018.log 2023-11-28T20:03:39.733 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.49918.log: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.49918.log.gz 2023-11-28T20:03:39.733 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.52018.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.52018.log.gz 2023-11-28T20:03:39.734 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46791.log 2023-11-28T20:03:39.735 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50852.log 2023-11-28T20:03:39.737 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.46791.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.46791.log.gz 2023-11-28T20:03:39.738 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.50852.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.50852.log.gz 2023-11-28T20:03:39.738 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47533.log 2023-11-28T20:03:39.740 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45899.log 2023-11-28T20:03:39.741 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.47533.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.47533.log.gz 2023-11-28T20:03:39.742 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47269.log 2023-11-28T20:03:39.744 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.45899.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.45899.log.gz 2023-11-28T20:03:39.745 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46571.log 2023-11-28T20:03:39.746 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.47269.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.47269.log.gz 2023-11-28T20:03:39.747 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.46571.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.46571.log.gz 2023-11-28T20:03:39.747 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55516.log 2023-11-28T20:03:39.749 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54818.log 2023-11-28T20:03:39.750 INFO:teuthology.orchestra.run.smithi078.stderr: 92.5% -- replaced with /var/log/ceph/ceph-mds.a.log.gz 2023-11-28T20:03:39.751 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.55516.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.55516.log.gz 2023-11-28T20:03:39.752 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.54818.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.54818.log.gz 2023-11-28T20:03:39.752 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50774.log 2023-11-28T20:03:39.754 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51609.log 2023-11-28T20:03:39.755 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.50774.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49736.log 2023-11-28T20:03:39.756 INFO:teuthology.orchestra.run.smithi078.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.50774.log.gz 2023-11-28T20:03:39.758 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.51609.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.51609.log.gz 2023-11-28T20:03:39.759 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.49736.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.49736.log.gz 2023-11-28T20:03:39.759 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48884.log 2023-11-28T20:03:39.760 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44408.log 2023-11-28T20:03:39.761 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.48884.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54896.log 2023-11-28T20:03:39.762 INFO:teuthology.orchestra.run.smithi078.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.48884.log.gz 2023-11-28T20:03:39.763 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.44408.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52194.log 2023-11-28T20:03:39.763 INFO:teuthology.orchestra.run.smithi078.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.44408.log.gz 2023-11-28T20:03:39.764 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.54896.log: gzip 88.9% -- replaced with /var/log/ceph/ceph-client.admin.54896.log.gz 2023-11-28T20:03:39.765 INFO:teuthology.orchestra.run.smithi078.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.53340.log 2023-11-28T20:03:39.766 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.52194.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44975.log 2023-11-28T20:03:39.766 INFO:teuthology.orchestra.run.smithi078.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.52194.log.gz 2023-11-28T20:03:39.768 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.53340.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48910.log 2023-11-28T20:03:39.768 INFO:teuthology.orchestra.run.smithi078.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.53340.log.gz 2023-11-28T20:03:39.769 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.44975.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46081.log 2023-11-28T20:03:39.769 INFO:teuthology.orchestra.run.smithi078.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.44975.log.gz 2023-11-28T20:03:39.771 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.48910.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43586.log 2023-11-28T20:03:39.771 INFO:teuthology.orchestra.run.smithi078.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.48910.log.gz 2023-11-28T20:03:39.772 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.46081.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42291.log 2023-11-28T20:03:39.773 INFO:teuthology.orchestra.run.smithi078.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.46081.log.gz 2023-11-28T20:03:39.774 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.43586.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48832.log 2023-11-28T20:03:39.774 INFO:teuthology.orchestra.run.smithi078.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.43586.log.gz 2023-11-28T20:03:39.775 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.42291.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42586.log 2023-11-28T20:03:39.775 INFO:teuthology.orchestra.run.smithi078.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.42291.log.gz 2023-11-28T20:03:39.776 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.48832.log: gzip 87.6% -- replaced with /var/log/ceph/ceph-client.admin.48832.log.gz 2023-11-28T20:03:39.777 INFO:teuthology.orchestra.run.smithi078.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.48371.log 2023-11-28T20:03:39.777 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.42586.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.42586.log.gz 2023-11-28T20:03:39.778 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52428.log 2023-11-28T20:03:39.779 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.48371.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55866.log 2023-11-28T20:03:39.780 INFO:teuthology.orchestra.run.smithi078.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.48371.log.gz 2023-11-28T20:03:39.780 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.52428.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.52428.log.gz 2023-11-28T20:03:39.781 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44330.log 2023-11-28T20:03:39.782 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.55866.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.55866.log.gz 2023-11-28T20:03:39.782 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45157.log 2023-11-28T20:03:39.784 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.44330.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46107.log 2023-11-28T20:03:39.784 INFO:teuthology.orchestra.run.smithi078.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.44330.log.gz 2023-11-28T20:03:39.785 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.45157.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55736.log 2023-11-28T20:03:39.786 INFO:teuthology.orchestra.run.smithi078.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.45157.log.gz 2023-11-28T20:03:39.787 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.46107.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.46107.log.gz 2023-11-28T20:03:39.787 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43810.log 2023-11-28T20:03:39.788 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.55736.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.55736.log.gz 2023-11-28T20:03:39.789 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54682.log 2023-11-28T20:03:39.790 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.43810.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44897.log 2023-11-28T20:03:39.790 INFO:teuthology.orchestra.run.smithi078.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.43810.log.gz 2023-11-28T20:03:39.791 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.54682.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43599.log 2023-11-28T20:03:39.791 INFO:teuthology.orchestra.run.smithi078.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.54682.log.gz 2023-11-28T20:03:39.793 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.44897.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43597.log 2023-11-28T20:03:39.794 INFO:teuthology.orchestra.run.smithi078.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.44897.log.gz 2023-11-28T20:03:39.794 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.43599.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38203.log 2023-11-28T20:03:39.794 INFO:teuthology.orchestra.run.smithi078.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.43599.log.gz 2023-11-28T20:03:39.796 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.43597.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45794.log 2023-11-28T20:03:39.796 INFO:teuthology.orchestra.run.smithi078.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.43597.log.gz 2023-11-28T20:03:39.797 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.38203.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44252.log 2023-11-28T20:03:39.797 INFO:teuthology.orchestra.run.smithi078.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.38203.log.gz 2023-11-28T20:03:39.798 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.45794.log: gzip 88.4% -- replaced with /var/log/ceph/ceph-client.admin.45794.log.gz 2023-11-28T20:03:39.799 INFO:teuthology.orchestra.run.smithi078.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.47955.log 2023-11-28T20:03:39.800 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.44252.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.44252.log.gz 2023-11-28T20:03:39.800 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51862.log 2023-11-28T20:03:39.802 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.47955.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48475.log 2023-11-28T20:03:39.802 INFO:teuthology.orchestra.run.smithi078.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.47955.log.gz 2023-11-28T20:03:39.803 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.51862.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52624.log 2023-11-28T20:03:39.803 INFO:teuthology.orchestra.run.smithi078.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.51862.log.gz 2023-11-28T20:03:39.805 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.48475.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53040.log 2023-11-28T20:03:39.805 INFO:teuthology.orchestra.run.smithi078.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.48475.log.gz 2023-11-28T20:03:39.806 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.52624.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50186.log 2023-11-28T20:03:39.806 INFO:teuthology.orchestra.run.smithi078.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.52624.log.gz 2023-11-28T20:03:39.807 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.53040.log: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.53040.log.gz 2023-11-28T20:03:39.808 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53947.log 2023-11-28T20:03:39.809 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.50186.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43799.log 2023-11-28T20:03:39.809 INFO:teuthology.orchestra.run.smithi078.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.50186.log.gz 2023-11-28T20:03:39.811 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.53947.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51038.log 2023-11-28T20:03:39.811 INFO:teuthology.orchestra.run.smithi078.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.53947.log.gz 2023-11-28T20:03:39.812 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.43799.log: gzip 89.6% -5 --verbose -- replaced with /var/log/ceph/ceph-client.admin.43799.log.gz -- 2023-11-28T20:03:39.813 INFO:teuthology.orchestra.run.smithi078.stderr: /var/log/ceph/ceph-client.admin.45261.log 2023-11-28T20:03:39.814 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.51038.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47507.log 2023-11-28T20:03:39.814 INFO:teuthology.orchestra.run.smithi078.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.51038.log.gz 2023-11-28T20:03:39.815 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.45261.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47455.log 2023-11-28T20:03:39.815 INFO:teuthology.orchestra.run.smithi078.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.45261.log.gz 2023-11-28T20:03:39.816 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.47507.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.47507.log.gz 2023-11-28T20:03:39.817 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49460.log 2023-11-28T20:03:39.818 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.47455.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49968.log 2023-11-28T20:03:39.818 INFO:teuthology.orchestra.run.smithi078.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.47455.log.gz 2023-11-28T20:03:39.820 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.49460.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45581.log 2023-11-28T20:03:39.820 INFO:teuthology.orchestra.run.smithi078.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.49460.log.gz 2023-11-28T20:03:39.821 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.49968.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42998.log 2023-11-28T20:03:39.821 INFO:teuthology.orchestra.run.smithi078.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.49968.log.gz 2023-11-28T20:03:39.823 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.45581.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46029.log 2023-11-28T20:03:39.823 INFO:teuthology.orchestra.run.smithi078.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.45581.log.gz 2023-11-28T20:03:39.824 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.42998.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.42998.log.gz 2023-11-28T20:03:39.826 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.46029.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.46029.log.gz 2023-11-28T20:03:39.826 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47613.log 2023-11-28T20:03:39.827 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43792.log 2023-11-28T20:03:39.829 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.47613.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50328.log 2023-11-28T20:03:39.829 INFO:teuthology.orchestra.run.smithi078.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.47613.log.gz 2023-11-28T20:03:39.830 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.43792.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47079.log 2023-11-28T20:03:39.831 INFO:teuthology.orchestra.run.smithi078.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.43792.log.gz 2023-11-28T20:03:39.832 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.50328.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45027.log 2023-11-28T20:03:39.832 INFO:teuthology.orchestra.run.smithi078.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.50328.log.gz 2023-11-28T20:03:39.833 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.47079.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.47079.log.gz 2023-11-28T20:03:39.834 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.45027.log: 91.0% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2023-11-28T20:03:39.835 INFO:teuthology.orchestra.run.smithi078.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.45027.log.gz 2023-11-28T20:03:39.835 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52704.log 2023-11-28T20:03:39.837 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45339.log 2023-11-28T20:03:39.838 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.52704.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53392.log 2023-11-28T20:03:39.838 INFO:teuthology.orchestra.run.smithi078.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.52704.log.gz 2023-11-28T20:03:39.839 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.45339.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50382.log 2023-11-28T20:03:39.840 INFO:teuthology.orchestra.run.smithi078.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.45339.log.gz 2023-11-28T20:03:39.841 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.53392.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43394.log 2023-11-28T20:03:39.841 INFO:teuthology.orchestra.run.smithi078.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.53392.log.gz 2023-11-28T20:03:39.842 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.50382.log: gzip 88.3% -- replaced with /var/log/ceph/ceph-client.admin.50382.log.gz 2023-11-28T20:03:39.842 INFO:teuthology.orchestra.run.smithi078.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.47295.log 2023-11-28T20:03:39.843 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.43394.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44278.log 2023-11-28T20:03:39.844 INFO:teuthology.orchestra.run.smithi078.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.43394.log.gz 2023-11-28T20:03:39.845 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.47295.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47639.log 2023-11-28T20:03:39.845 INFO:teuthology.orchestra.run.smithi078.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.47295.log.gz 2023-11-28T20:03:39.847 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.44278.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54578.log 2023-11-28T20:03:39.847 INFO:teuthology.orchestra.run.smithi078.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.44278.log.gz 2023-11-28T20:03:39.848 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.47639.log: gzip 88.3% -- replaced with /var/log/ceph/ceph-client.admin.47639.log.gz -5 2023-11-28T20:03:39.848 INFO:teuthology.orchestra.run.smithi078.stderr: --verbose -- /var/log/ceph/ceph-client.0.50014.log 2023-11-28T20:03:39.849 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.54578.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49762.log 2023-11-28T20:03:39.849 INFO:teuthology.orchestra.run.smithi078.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.54578.log.gz 2023-11-28T20:03:39.850 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.0.50014.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.50014.log.gz 2023-11-28T20:03:39.851 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42452.log 2023-11-28T20:03:39.852 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.49762.log: gzip -5 --verbose -- 87.8% /var/log/ceph/ceph-client.admin.53895.log 2023-11-28T20:03:39.852 INFO:teuthology.orchestra.run.smithi078.stderr: -- replaced with /var/log/ceph/ceph-client.admin.49762.log.gz 2023-11-28T20:03:39.854 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.42452.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49654.log 2023-11-28T20:03:39.854 INFO:teuthology.orchestra.run.smithi078.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.42452.log.gz 2023-11-28T20:03:39.855 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.53895.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43102.log 2023-11-28T20:03:39.855 INFO:teuthology.orchestra.run.smithi078.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.53895.log.gz 2023-11-28T20:03:39.857 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.49654.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46677.log 2023-11-28T20:03:39.857 INFO:teuthology.orchestra.run.smithi078.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.49654.log.gz 2023-11-28T20:03:39.858 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.43102.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49788.log 2023-11-28T20:03:39.858 INFO:teuthology.orchestra.run.smithi078.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.43102.log.gz 2023-11-28T20:03:39.859 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.46677.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47743.log 2023-11-28T20:03:39.860 INFO:teuthology.orchestra.run.smithi078.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.46677.log.gz 2023-11-28T20:03:39.861 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.49788.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.49788.log.gz 2023-11-28T20:03:39.861 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.testuser.54112.log 2023-11-28T20:03:39.863 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.47743.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42638.log 2023-11-28T20:03:39.863 INFO:teuthology.orchestra.run.smithi078.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.47743.log.gz 2023-11-28T20:03:39.863 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.testuser.54112.log: 0.0% -- replaced with /var/log/ceph/ceph-client.testuser.54112.log.gz 2023-11-28T20:03:39.864 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50134.log 2023-11-28T20:03:39.865 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.42638.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.53086.log 2023-11-28T20:03:39.866 INFO:teuthology.orchestra.run.smithi078.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.42638.log.gz 2023-11-28T20:03:39.867 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.50134.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55840.log 2023-11-28T20:03:39.867 INFO:teuthology.orchestra.run.smithi078.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.50134.log.gz 2023-11-28T20:03:39.868 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.0.53086.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.53086.log.gz 2023-11-28T20:03:39.868 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43808.log 2023-11-28T20:03:39.870 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.55840.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.55840.log.gz 2023-11-28T20:03:39.870 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43796.log 2023-11-28T20:03:39.871 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.43808.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53811.log 2023-11-28T20:03:39.871 INFO:teuthology.orchestra.run.smithi078.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.43808.log.gz 2023-11-28T20:03:39.873 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.43796.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52886.log 2023-11-28T20:03:39.873 INFO:teuthology.orchestra.run.smithi078.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.43796.log.gz 2023-11-28T20:03:39.874 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.53811.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51479.log 2023-11-28T20:03:39.874 INFO:teuthology.orchestra.run.smithi078.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.53811.log.gz 2023-11-28T20:03:39.875 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.52886.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50434.log 2023-11-28T20:03:39.876 INFO:teuthology.orchestra.run.smithi078.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.52886.log.gz 2023-11-28T20:03:39.877 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.51479.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.51479.log.gz 2023-11-28T20:03:39.877 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51096.log 2023-11-28T20:03:39.878 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.50434.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46441.log 2023-11-28T20:03:39.879 INFO:teuthology.orchestra.run.smithi078.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.50434.log.gz 2023-11-28T20:03:39.880 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.51096.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51583.log 2023-11-28T20:03:39.880 INFO:teuthology.orchestra.run.smithi078.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.51096.log.gz 2023-11-28T20:03:39.881 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.46441.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44486.log 2023-11-28T20:03:39.881 INFO:teuthology.orchestra.run.smithi078.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.46441.log.gz 2023-11-28T20:03:39.883 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.51583.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54948.log 2023-11-28T20:03:39.883 INFO:teuthology.orchestra.run.smithi078.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.51583.log.gz 2023-11-28T20:03:39.884 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.44486.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47053.log 2023-11-28T20:03:39.884 INFO:teuthology.orchestra.run.smithi078.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.44486.log.gz 2023-11-28T20:03:39.886 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.54948.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44304.log 2023-11-28T20:03:39.886 INFO:teuthology.orchestra.run.smithi078.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.54948.log.gz 2023-11-28T20:03:39.890 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.47053.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44949.log 2023-11-28T20:03:39.890 INFO:teuthology.orchestra.run.smithi078.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.47053.log.gz 2023-11-28T20:03:39.890 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.44304.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48780.log 2023-11-28T20:03:39.890 INFO:teuthology.orchestra.run.smithi078.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.44304.log.gz 2023-11-28T20:03:39.891 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.44949.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46739.log 2023-11-28T20:03:39.891 INFO:teuthology.orchestra.run.smithi078.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.44949.log.gz 2023-11-28T20:03:39.892 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.48780.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43992.log 2023-11-28T20:03:39.892 INFO:teuthology.orchestra.run.smithi078.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.48780.log.gz 2023-11-28T20:03:39.893 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.46739.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45521.log 2023-11-28T20:03:39.893 INFO:teuthology.orchestra.run.smithi078.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.46739.log.gz 2023-11-28T20:03:39.894 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.43992.log: gzip -5 88.5% --verbose -- -- replaced with /var/log/ceph/ceph-client.admin.43992.log.gz /var/log/ceph/ceph-client.admin.44845.log 2023-11-28T20:03:39.895 INFO:teuthology.orchestra.run.smithi078.stderr: 2023-11-28T20:03:39.896 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.45521.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.45521.log.gz 2023-11-28T20:03:39.896 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42506.log 2023-11-28T20:03:39.897 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.44845.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45443.log 2023-11-28T20:03:39.897 INFO:teuthology.orchestra.run.smithi078.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.44845.log.gz 2023-11-28T20:03:39.899 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.42506.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50460.log 2023-11-28T20:03:39.899 INFO:teuthology.orchestra.run.smithi078.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.42506.log.gz 2023-11-28T20:03:39.900 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.45443.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42480.log 2023-11-28T20:03:39.900 INFO:teuthology.orchestra.run.smithi078.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.45443.log.gz 2023-11-28T20:03:39.901 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.50460.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.50460.log.gz 2023-11-28T20:03:39.902 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43207.log 2023-11-28T20:03:39.904 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.42480.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45391.log 2023-11-28T20:03:39.904 INFO:teuthology.orchestra.run.smithi078.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.42480.log.gz 2023-11-28T20:03:39.905 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.43207.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43604.log 2023-11-28T20:03:39.905 INFO:teuthology.orchestra.run.smithi078.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.43207.log.gz 2023-11-28T20:03:39.906 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.45391.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47585.log 2023-11-28T20:03:39.906 INFO:teuthology.orchestra.run.smithi078.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.45391.log.gz 2023-11-28T20:03:39.907 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.43604.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.43604.log.gz 2023-11-28T20:03:39.908 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54714.log 2023-11-28T20:03:39.909 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.47585.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.47585.log.gz 2023-11-28T20:03:39.909 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54417.log 2023-11-28T20:03:39.910 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.54714.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.54714.log.gz 2023-11-28T20:03:39.911 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44013.log 2023-11-28T20:03:39.912 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.54417.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54257.log 2023-11-28T20:03:39.913 INFO:teuthology.orchestra.run.smithi078.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.54417.log.gz 2023-11-28T20:03:39.914 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.44013.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49840.log 2023-11-28T20:03:39.914 INFO:teuthology.orchestra.run.smithi078.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.44013.log.gz 2023-11-28T20:03:39.915 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.54257.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54339.log 2023-11-28T20:03:39.916 INFO:teuthology.orchestra.run.smithi078.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.54257.log.gz 2023-11-28T20:03:39.917 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.49840.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51427.log 2023-11-28T20:03:39.917 INFO:teuthology.orchestra.run.smithi078.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.49840.log.gz 2023-11-28T20:03:39.918 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.54339.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44434.log 2023-11-28T20:03:39.919 INFO:teuthology.orchestra.run.smithi078.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.54339.log.gz 2023-11-28T20:03:39.920 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.51427.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51810.log 2023-11-28T20:03:39.920 INFO:teuthology.orchestra.run.smithi078.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.51427.log.gz 2023-11-28T20:03:39.921 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.44434.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.44434.log.gz 2023-11-28T20:03:39.923 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.51810.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.51810.log.gz 2023-11-28T20:03:40.099 INFO:teuthology.orchestra.run.smithi179.stderr: 93.3% -- replaced with /var/log/ceph/ceph-osd.6.log.gz 2023-11-28T20:03:40.154 INFO:teuthology.orchestra.run.smithi179.stderr: 93.3% -- replaced with /var/log/ceph/ceph-osd.5.log.gz 2023-11-28T20:03:40.194 INFO:teuthology.orchestra.run.smithi179.stderr: 93.2% -- replaced with /var/log/ceph/ceph-osd.7.log.gz 2023-11-28T20:03:40.218 INFO:teuthology.orchestra.run.smithi179.stderr: 93.3% -- replaced with /var/log/ceph/ceph-osd.4.log.gz 2023-11-28T20:03:40.219 INFO:teuthology.orchestra.run.smithi179.stderr: 2023-11-28T20:03:40.219 INFO:teuthology.orchestra.run.smithi179.stderr:real 0m1.069s 2023-11-28T20:03:40.219 INFO:teuthology.orchestra.run.smithi179.stderr:user 0m4.104s 2023-11-28T20:03:40.220 INFO:teuthology.orchestra.run.smithi179.stderr:sys 0m0.405s 2023-11-28T20:03:40.263 INFO:teuthology.orchestra.run.smithi078.stderr: 93.3% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2023-11-28T20:03:40.317 INFO:teuthology.orchestra.run.smithi078.stderr: 93.3% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2023-11-28T20:03:40.500 INFO:teuthology.orchestra.run.smithi078.stderr: 93.3% -- replaced with /var/log/ceph/ceph-osd.3.log.gz 2023-11-28T20:03:40.515 INFO:teuthology.orchestra.run.smithi078.stderr: 93.3% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2023-11-28T20:03:40.517 INFO:teuthology.orchestra.run.smithi078.stderr: 2023-11-28T20:03:40.517 INFO:teuthology.orchestra.run.smithi078.stderr:real 0m1.389s 2023-11-28T20:03:40.517 INFO:teuthology.orchestra.run.smithi078.stderr:user 0m5.234s 2023-11-28T20:03:40.518 INFO:teuthology.orchestra.run.smithi078.stderr:sys 0m1.385s 2023-11-28T20:03:40.519 INFO:tasks.ceph:Archiving logs... 2023-11-28T20:03:40.519 DEBUG:teuthology.misc:Transferring archived files from smithi078:/var/log/ceph to /home/teuthworker/archive/vshankar-2023-11-28_06:29:14-fs-wip-vshankar-testing-20231127.102914-testing-default-smithi/7469593/remote/smithi078/log 2023-11-28T20:03:40.520 DEBUG:teuthology.orchestra.run.smithi078:> sudo tar c -f - -C /var/log/ceph -- . 2023-11-28T20:03:41.573 DEBUG:teuthology.misc:Transferring archived files from smithi179:/var/log/ceph to /home/teuthworker/archive/vshankar-2023-11-28_06:29:14-fs-wip-vshankar-testing-20231127.102914-testing-default-smithi/7469593/remote/smithi179/log 2023-11-28T20:03:41.574 DEBUG:teuthology.orchestra.run.smithi179:> sudo tar c -f - -C /var/log/ceph -- . 2023-11-28T20:03:42.111 DEBUG:teuthology.run_tasks:Unwinding manager install 2023-11-28T20:03:42.120 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2023-11-28T20:03:42.121 DEBUG:teuthology.orchestra.run.smithi078:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2023-11-28T20:03:42.125 DEBUG:teuthology.orchestra.run.smithi179:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2023-11-28T20:03:42.196 DEBUG:teuthology.run_tasks:Unwinding manager clock 2023-11-28T20:03:42.205 INFO:teuthology.task.clock:Checking final clock skew... 2023-11-28T20:03:42.205 DEBUG:teuthology.orchestra.run.smithi078:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-11-28T20:03:42.209 DEBUG:teuthology.orchestra.run.smithi179:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-11-28T20:03:42.221 INFO:teuthology.orchestra.run.smithi078.stdout: remote refid st t when poll reach delay offset jitter 2023-11-28T20:03:42.221 INFO:teuthology.orchestra.run.smithi078.stdout:============================================================================== 2023-11-28T20:03:42.222 INFO:teuthology.orchestra.run.smithi078.stdout:*hv01.front.sepi 44.4.53.2 2 u 45 64 377 0.068 -0.086 1.524 2023-11-28T20:03:42.222 INFO:teuthology.orchestra.run.smithi078.stdout:+hv02.front.sepi 63.231.80.2 3 u 43 64 377 0.080 -0.022 0.856 2023-11-28T20:03:42.222 INFO:teuthology.orchestra.run.smithi078.stdout:+hv03.front.sepi 74.6.168.72 3 u 42 64 377 0.084 -1.040 0.921 2023-11-28T20:03:42.222 INFO:teuthology.orchestra.run.smithi078.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2023-11-28T20:03:42.225 INFO:teuthology.orchestra.run.smithi179.stdout: remote refid st t when poll reach delay offset jitter 2023-11-28T20:03:42.225 INFO:teuthology.orchestra.run.smithi179.stdout:============================================================================== 2023-11-28T20:03:42.226 INFO:teuthology.orchestra.run.smithi179.stdout:*hv01.front.sepi 44.4.53.2 2 u 34 64 377 0.155 -1.391 0.940 2023-11-28T20:03:42.226 INFO:teuthology.orchestra.run.smithi179.stdout:+hv02.front.sepi 63.231.80.2 3 u 44 64 377 0.116 -0.183 1.133 2023-11-28T20:03:42.226 INFO:teuthology.orchestra.run.smithi179.stdout:+hv03.front.sepi 74.6.168.72 3 u 47 64 377 0.160 -1.633 1.032 2023-11-28T20:03:42.226 INFO:teuthology.orchestra.run.smithi179.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2023-11-28T20:03:42.227 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2023-11-28T20:03:42.237 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2023-11-28T20:03:42.238 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2023-11-28T20:03:42.247 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2023-11-28T20:03:42.257 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2023-11-28T20:03:42.265 INFO:teuthology.task.internal:Duration was 1029.460524 seconds 2023-11-28T20:03:42.265 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2023-11-28T20:03:42.275 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2023-11-28T20:03:42.275 DEBUG:teuthology.orchestra.run.smithi078:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2023-11-28T20:03:42.279 DEBUG:teuthology.orchestra.run.smithi179:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2023-11-28T20:03:42.392 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2023-11-28T20:03:42.392 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi078.front.sepia.ceph.com 2023-11-28T20:03:42.392 DEBUG:teuthology.orchestra.run.smithi078:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2023-11-28T20:03:42.415 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi179.front.sepia.ceph.com 2023-11-28T20:03:42.415 DEBUG:teuthology.orchestra.run.smithi179:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2023-11-28T20:03:42.437 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2023-11-28T20:03:42.438 DEBUG:teuthology.orchestra.run.smithi078:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-11-28T20:03:42.465 DEBUG:teuthology.orchestra.run.smithi179:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-11-28T20:03:42.519 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2023-11-28T20:03:42.519 DEBUG:teuthology.orchestra.run.smithi078:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-11-28T20:03:42.545 DEBUG:teuthology.orchestra.run.smithi179:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-11-28T20:03:42.646 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2023-11-28T20:03:42.657 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2023-11-28T20:03:42.657 DEBUG:teuthology.orchestra.run.smithi078:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2023-11-28T20:03:42.681 DEBUG:teuthology.orchestra.run.smithi179:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2023-11-28T20:03:42.702 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2023-11-28T20:03:42.714 DEBUG:teuthology.orchestra.run.smithi078:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2023-11-28T20:03:42.725 DEBUG:teuthology.orchestra.run.smithi179:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2023-11-28T20:03:42.740 INFO:teuthology.orchestra.run.smithi078.stdout:kernel.core_pattern = core 2023-11-28T20:03:42.762 INFO:teuthology.orchestra.run.smithi179.stdout:kernel.core_pattern = core 2023-11-28T20:03:42.781 DEBUG:teuthology.orchestra.run.smithi078:> test -e /home/ubuntu/cephtest/archive/coredump 2023-11-28T20:03:42.809 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-28T20:03:42.809 DEBUG:teuthology.orchestra.run.smithi179:> test -e /home/ubuntu/cephtest/archive/coredump 2023-11-28T20:03:42.835 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-28T20:03:42.835 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2023-11-28T20:03:42.845 INFO:teuthology.task.internal:Transferring archived files... 2023-11-28T20:03:42.846 DEBUG:teuthology.misc:Transferring archived files from smithi078:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/vshankar-2023-11-28_06:29:14-fs-wip-vshankar-testing-20231127.102914-testing-default-smithi/7469593/remote/smithi078 2023-11-28T20:03:42.847 DEBUG:teuthology.orchestra.run.smithi078:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2023-11-28T20:03:42.879 DEBUG:teuthology.misc:Transferring archived files from smithi179:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/vshankar-2023-11-28_06:29:14-fs-wip-vshankar-testing-20231127.102914-testing-default-smithi/7469593/remote/smithi179 2023-11-28T20:03:42.879 DEBUG:teuthology.orchestra.run.smithi179:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2023-11-28T20:03:42.903 INFO:teuthology.task.internal:Removing archive directory... 2023-11-28T20:03:42.904 DEBUG:teuthology.orchestra.run.smithi078:> rm -rf -- /home/ubuntu/cephtest/archive 2023-11-28T20:03:42.920 DEBUG:teuthology.orchestra.run.smithi179:> rm -rf -- /home/ubuntu/cephtest/archive 2023-11-28T20:03:42.956 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2023-11-28T20:03:42.968 INFO:teuthology.task.internal:Not uploading archives. 2023-11-28T20:03:42.968 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2023-11-28T20:03:42.984 INFO:teuthology.task.internal:Tidying up after the test... 2023-11-28T20:03:42.985 DEBUG:teuthology.orchestra.run.smithi078:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2023-11-28T20:03:42.989 DEBUG:teuthology.orchestra.run.smithi179:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2023-11-28T20:03:42.994 INFO:teuthology.orchestra.run.smithi078.stdout: 655428 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Nov 28 20:03 /home/ubuntu/cephtest 2023-11-28T20:03:43.008 INFO:teuthology.orchestra.run.smithi179.stdout: 655437 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Nov 28 20:03 /home/ubuntu/cephtest 2023-11-28T20:03:43.010 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2023-11-28T20:03:43.022 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2023-11-28T20:03:43.046 INFO:teuthology.nuke:Checking targets against current locks 2023-11-28T20:03:43.077 DEBUG:teuthology.nuke:shortname: smithi078 2023-11-28T20:03:43.077 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-11-28T20:03:43.097 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi078.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vshankar-2023-11-28_06:29:14-fs-wip-vshankar-testing-20231127.102914-testing-default-smithi/7469593', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-11-28 19:37:39.621432', 'locked_by': 'scheduled_vshankar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBH/BeLiF6FTEmVwv4xjOSLQMi1fcn6OhmXMNOPbYsX9UlDQVQgA3D8ZYxMasqYDlK9yyf4L2ZFq8uURMFenUqRM='} 2023-11-28T20:03:43.101 DEBUG:teuthology.nuke:shortname: smithi179 2023-11-28T20:03:43.101 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-11-28T20:03:43.123 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi179.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vshankar-2023-11-28_06:29:14-fs-wip-vshankar-testing-20231127.102914-testing-default-smithi/7469593', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-11-28 19:37:39.619886', 'locked_by': 'scheduled_vshankar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBIR0Ew728ISPUwTPh1+symK9Vcl9MvI/7y0fWrxFmT3H1OOhgkayTfBUsQ3QNFFmaHkudSbzgGgjwY6jUo6/cjM='} 2023-11-28T20:03:43.144 INFO:teuthology.orchestra.console.smithi078:Power off 2023-11-28T20:03:43.144 DEBUG:teuthology.orchestra.console.smithi078:pexpect command: ipmitool -H smithi078.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-11-28T20:03:43.173 DEBUG:teuthology.orchestra.console.smithi078:power off output: Chassis Power Control: Down/Off 2023-11-28T20:03:43.173 DEBUG:teuthology.orchestra.console.smithi078:pexpect command: ipmitool -H smithi078.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-28T20:03:43.190 INFO:teuthology.orchestra.console.smithi179:Power off 2023-11-28T20:03:43.190 DEBUG:teuthology.orchestra.console.smithi179:pexpect command: ipmitool -H smithi179.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-11-28T20:03:43.200 DEBUG:teuthology.orchestra.console.smithi078:check power output: Chassis Power is on 2023-11-28T20:03:43.213 DEBUG:teuthology.orchestra.console.smithi179:power off output: Chassis Power Control: Down/Off 2023-11-28T20:03:43.213 DEBUG:teuthology.orchestra.console.smithi179:pexpect command: ipmitool -H smithi179.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-28T20:03:43.240 DEBUG:teuthology.orchestra.console.smithi179:check power output: Chassis Power is on 2023-11-28T20:03:47.201 DEBUG:teuthology.orchestra.console.smithi078:pexpect command: ipmitool -H smithi078.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-28T20:03:47.347 DEBUG:teuthology.orchestra.console.smithi179:pexpect command: ipmitool -H smithi179.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-28T20:03:47.449 DEBUG:teuthology.orchestra.console.smithi078:check power output: Chassis Power is on 2023-11-28T20:03:47.456 DEBUG:teuthology.orchestra.console.smithi179:check power output: Chassis Power is on 2023-11-28T20:03:51.453 DEBUG:teuthology.orchestra.console.smithi078:pexpect command: ipmitool -H smithi078.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-28T20:03:51.462 DEBUG:teuthology.orchestra.console.smithi179:pexpect command: ipmitool -H smithi179.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-28T20:03:51.564 DEBUG:teuthology.orchestra.console.smithi078:check power output: Chassis Power is off 2023-11-28T20:03:51.571 DEBUG:teuthology.orchestra.console.smithi179:check power output: Chassis Power is on 2023-11-28T20:03:51.666 INFO:teuthology.orchestra.console.smithi078:Power off completed 2023-11-28T20:03:55.574 DEBUG:teuthology.orchestra.console.smithi179:pexpect command: ipmitool -H smithi179.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-28T20:03:55.684 DEBUG:teuthology.orchestra.console.smithi179:check power output: Chassis Power is off 2023-11-28T20:03:55.785 INFO:teuthology.orchestra.console.smithi179:Power off completed 2023-11-28T20:03:55.890 INFO:teuthology.run:Summary data: client.0-kernel-sha1: 8247bbb5b470f7e2a1f3eefcc16e24cf1338f606 client.1-kernel-sha1: 8247bbb5b470f7e2a1f3eefcc16e24cf1338f606 description: fs/multifs/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-2c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore-ec/bluestore-comp-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down mon-debug} tasks/multifs-auth} duration: 1029.4605240821838 failure_reason: 'Test failure: test_r_with_fsname_and_no_path_in_cap (tasks.cephfs.test_multifs_auth.TestMDSCaps)' flavor: default owner: scheduled_vshankar@teuthology sentry_event: https://sentry.ceph.com/organizations/ceph/?query=196a95889df544b39210ab79fe94e97e status: fail success: false 2023-11-28T20:03:55.891 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-28T20:03:55.972 INFO:teuthology.run:FAIL